2023-11-15T01:08:12.013 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-15T01:08:12.017 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075 --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075/orig.config.yaml 2023-11-15T01:08:12.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T01:08:12.159 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075 branch: wip-yuri4-testing-2023-11-13-0820-pacific description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: yweinste@redhat.com first_in_suite: false job_id: '7458075' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri4-testing-2023-11-13-0820-pacific ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 620f25c1794f62207424fc9319427943fb8d1fae ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 620f25c1794f62207424fc9319427943fb8d1fae selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2023-11-13-0820-pacific sha1: 620f25c1794f62207424fc9319427943fb8d1fae owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5345 sha1: 620f25c1794f62207424fc9319427943fb8d1fae sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri4-testing-2023-11-13-0820-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_620f25c1794f62207424fc9319427943fb8d1fae/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 620f25c1794f62207424fc9319427943fb8d1fae targets: smithi001.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJeFylrmsKFW81CfzONyFLuEEkwlYoHfyZEe/20rdwDOWr4O1mHrlgMK1nfliLLBrxbQw+OniB5V0ngiiD24By8= smithi141.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRe93QIcO8EMbYevl+g6VFx5qJmSBRJHUVgq8TO9pdI8ccHzx0Nil5qaualtx3+f9S0HUsYLIV8zz7pJ+2gUSQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-14_20:31:57 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3590714 2023-11-15T01:08:12.159 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_620f25c1794f62207424fc9319427943fb8d1fae/qa; will attempt to use it 2023-11-15T01:08:12.160 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_620f25c1794f62207424fc9319427943fb8d1fae/qa/tasks 2023-11-15T01:08:12.160 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-15T01:08:12.162 INFO:teuthology.task.internal:Checking packages... 2023-11-15T01:08:12.185 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '620f25c1794f62207424fc9319427943fb8d1fae' 2023-11-15T01:08:12.186 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-15T01:08:12.186 INFO:teuthology.packaging:ref: None 2023-11-15T01:08:12.186 INFO:teuthology.packaging:tag: None 2023-11-15T01:08:12.187 INFO:teuthology.packaging:branch: wip-yuri4-testing-2023-11-13-0820-pacific 2023-11-15T01:08:12.187 INFO:teuthology.packaging:sha1: 620f25c1794f62207424fc9319427943fb8d1fae 2023-11-15T01:08:12.187 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri4-testing-2023-11-13-0820-pacific 2023-11-15T01:08:12.407 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-170.g620f25c1 2023-11-15T01:08:12.408 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-15T01:08:12.415 INFO:teuthology.task.internal:no buildpackages task found 2023-11-15T01:08:12.415 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-15T01:08:12.421 INFO:teuthology.task.internal:Saving configuration 2023-11-15T01:08:12.440 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-15T01:08:12.446 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T01:08:12.469 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 01:03:00.631046', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJeFylrmsKFW81CfzONyFLuEEkwlYoHfyZEe/20rdwDOWr4O1mHrlgMK1nfliLLBrxbQw+OniB5V0ngiiD24By8='} 2023-11-15T01:08:12.487 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 01:03:00.632880', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRe93QIcO8EMbYevl+g6VFx5qJmSBRJHUVgq8TO9pdI8ccHzx0Nil5qaualtx3+f9S0HUsYLIV8zz7pJ+2gUSQ='} 2023-11-15T01:08:12.487 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-15T01:08:12.494 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-15T01:08:12.494 INFO:teuthology.task.internal:roles: ubuntu@smithi141.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-15T01:08:12.494 INFO:teuthology.run_tasks:Running task console_log... 2023-11-15T01:08:12.563 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7c4729eb80>, signals=[15]) 2023-11-15T01:08:12.564 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-15T01:08:12.570 INFO:teuthology.task.internal:Opening connections... 2023-11-15T01:08:12.571 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T01:08:12.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T01:08:12.640 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi141.front.sepia.ceph.com 2023-11-15T01:08:12.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T01:08:12.709 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-15T01:08:12.715 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2023-11-15T01:08:12.734 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2023-11-15T01:08:12.734 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2023-11-15T01:08:12.791 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Red Hat Enterprise Linux" 2023-11-15T01:08:12.791 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8.4 (Ootpa)" 2023-11-15T01:08:12.792 INFO:teuthology.orchestra.run.smithi001.stdout:ID="rhel" 2023-11-15T01:08:12.792 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="fedora" 2023-11-15T01:08:12.792 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8.4" 2023-11-15T01:08:12.792 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8" 2023-11-15T01:08:12.792 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-15T01:08:12.793 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2023-11-15T01:08:12.793 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-15T01:08:12.793 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.redhat.com/" 2023-11-15T01:08:12.793 INFO:teuthology.orchestra.run.smithi001.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-15T01:08:12.793 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T01:08:12.794 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:08:12.794 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T01:08:12.794 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-15T01:08:12.794 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-15T01:08:12.794 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-15T01:08:12.795 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2023-11-15T01:08:12.825 DEBUG:teuthology.orchestra.run.smithi141:> uname -m 2023-11-15T01:08:12.842 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2023-11-15T01:08:12.842 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-11-15T01:08:12.898 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Red Hat Enterprise Linux" 2023-11-15T01:08:12.898 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8.4 (Ootpa)" 2023-11-15T01:08:12.899 INFO:teuthology.orchestra.run.smithi141.stdout:ID="rhel" 2023-11-15T01:08:12.899 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="fedora" 2023-11-15T01:08:12.899 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8.4" 2023-11-15T01:08:12.899 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8" 2023-11-15T01:08:12.899 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-15T01:08:12.900 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-11-15T01:08:12.900 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-15T01:08:12.900 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.redhat.com/" 2023-11-15T01:08:12.900 INFO:teuthology.orchestra.run.smithi141.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-15T01:08:12.900 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T01:08:12.901 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:08:12.901 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T01:08:12.901 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-15T01:08:12.901 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-15T01:08:12.901 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-15T01:08:12.902 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-11-15T01:08:12.924 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-15T01:08:12.934 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-15T01:08:12.942 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-15T01:08:12.942 DEBUG:teuthology.orchestra.run.smithi001:> test '!' -e /home/ubuntu/cephtest 2023-11-15T01:08:12.945 DEBUG:teuthology.orchestra.run.smithi141:> test '!' -e /home/ubuntu/cephtest 2023-11-15T01:08:12.960 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-15T01:08:12.966 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-15T01:08:12.967 DEBUG:teuthology.orchestra.run.smithi001:> test -z $(ls -A /var/lib/ceph) 2023-11-15T01:08:13.001 DEBUG:teuthology.orchestra.run.smithi141:> test -z $(ls -A /var/lib/ceph) 2023-11-15T01:08:13.016 INFO:teuthology.orchestra.run.smithi001.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-11-15T01:08:13.018 INFO:teuthology.orchestra.run.smithi141.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-11-15T01:08:13.018 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-15T01:08:13.076 INFO:teuthology.run_tasks:Running task kernel... 2023-11-15T01:08:13.090 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-11-15T01:08:13.091 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-11-15T01:08:13.092 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-11-15T01:08:13.092 DEBUG:teuthology.orchestra.run.smithi001:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-15T01:08:13.093 DEBUG:teuthology.orchestra.run.smithi141:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-15T01:08:13.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-15T01:08:13.108 DEBUG:teuthology.orchestra.run.smithi141:> uname -r 2023-11-15T01:08:13.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-15T01:08:13.110 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2023-11-15T01:08:13.164 INFO:teuthology.orchestra.run.smithi141.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-11-15T01:08:13.165 INFO:teuthology.task.kernel:Running kernel on smithi141: 4.18.0-305.25.1.el8_4.x86_64 2023-11-15T01:08:13.165 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum install -y kernel 2023-11-15T01:08:13.167 INFO:teuthology.orchestra.run.smithi001.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-11-15T01:08:13.167 INFO:teuthology.task.kernel:Running kernel on smithi001: 4.18.0-305.25.1.el8_4.x86_64 2023-11-15T01:08:13.167 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum install -y kernel 2023-11-15T01:08:14.559 INFO:teuthology.orchestra.run.smithi141.stdout:Updating Subscription Management repositories. 2023-11-15T01:08:14.559 INFO:teuthology.orchestra.run.smithi141.stdout:Unable to read consumer identity 2023-11-15T01:08:14.651 INFO:teuthology.orchestra.run.smithi001.stdout:Updating Subscription Management repositories. 2023-11-15T01:08:14.652 INFO:teuthology.orchestra.run.smithi001.stdout:Unable to read consumer identity 2023-11-15T01:08:15.999 INFO:teuthology.orchestra.run.smithi141.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-11-15T01:08:16.034 INFO:teuthology.orchestra.run.smithi001.stdout:Copr repo for python3-asyncssh owned by ceph 37 kB/s | 3.5 kB 00:00 2023-11-15T01:08:16.693 INFO:teuthology.orchestra.run.smithi141.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-11-15T01:08:17.160 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-11-15T01:08:19.991 INFO:teuthology.orchestra.run.smithi141.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-11-15T01:08:20.070 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:00:01 ago on Wed 15 Nov 2023 01:08:19 AM UTC. 2023-11-15T01:08:20.642 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-11-15T01:08:20.764 INFO:teuthology.orchestra.run.smithi141.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-11-15T01:08:20.764 INFO:teuthology.orchestra.run.smithi141.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-11-15T01:08:20.764 INFO:teuthology.orchestra.run.smithi141.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-11-15T01:08:20.924 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-11-15T01:08:20.925 INFO:teuthology.orchestra.run.smithi141.stdout:Nothing to do. 2023-11-15T01:08:20.925 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-11-15T01:08:21.061 DEBUG:teuthology.orchestra.run.smithi141:> echo no | sudo yum reinstall kernel || true 2023-11-15T01:08:21.406 INFO:teuthology.orchestra.run.smithi141.stdout:Updating Subscription Management repositories. 2023-11-15T01:08:21.406 INFO:teuthology.orchestra.run.smithi141.stdout:Unable to read consumer identity 2023-11-15T01:08:21.570 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-11-15T01:08:21.570 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-11-15T01:08:21.571 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-11-15T01:08:21.693 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:00:02 ago on Wed 15 Nov 2023 01:08:19 AM UTC. 2023-11-15T01:08:21.712 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2023-11-15T01:08:21.713 INFO:teuthology.orchestra.run.smithi001.stdout:Nothing to do. 2023-11-15T01:08:21.714 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2023-11-15T01:08:21.830 INFO:teuthology.orchestra.run.smithi141.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-11-15T01:08:21.831 INFO:teuthology.orchestra.run.smithi141.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-15T01:08:21.831 INFO:teuthology.orchestra.run.smithi141.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-15T01:08:21.846 DEBUG:teuthology.orchestra.run.smithi001:> echo no | sudo yum reinstall kernel || true 2023-11-15T01:08:21.865 INFO:teuthology.orchestra.run.smithi141.stderr:Error: No packages marked for reinstall. 2023-11-15T01:08:21.915 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum reinstall -y kernel || true 2023-11-15T01:08:22.216 INFO:teuthology.orchestra.run.smithi001.stdout:Updating Subscription Management repositories. 2023-11-15T01:08:22.216 INFO:teuthology.orchestra.run.smithi001.stdout:Unable to read consumer identity 2023-11-15T01:08:22.256 INFO:teuthology.orchestra.run.smithi141.stdout:Updating Subscription Management repositories. 2023-11-15T01:08:22.257 INFO:teuthology.orchestra.run.smithi141.stdout:Unable to read consumer identity 2023-11-15T01:08:22.523 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:00:02 ago on Wed 15 Nov 2023 01:08:20 AM UTC. 2023-11-15T01:08:22.547 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:00:03 ago on Wed 15 Nov 2023 01:08:19 AM UTC. 2023-11-15T01:08:22.658 INFO:teuthology.orchestra.run.smithi001.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-11-15T01:08:22.658 INFO:teuthology.orchestra.run.smithi001.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-15T01:08:22.658 INFO:teuthology.orchestra.run.smithi001.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-15T01:08:22.687 INFO:teuthology.orchestra.run.smithi001.stderr:Error: No packages marked for reinstall. 2023-11-15T01:08:22.688 INFO:teuthology.orchestra.run.smithi141.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-11-15T01:08:22.689 INFO:teuthology.orchestra.run.smithi141.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-15T01:08:22.689 INFO:teuthology.orchestra.run.smithi141.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-15T01:08:22.709 INFO:teuthology.orchestra.run.smithi141.stderr:Error: No packages marked for reinstall. 2023-11-15T01:08:22.738 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum reinstall -y kernel || true 2023-11-15T01:08:22.759 DEBUG:teuthology.orchestra.run.smithi141:> rpm -q kernel | sort -rV | head -n 1 2023-11-15T01:08:22.883 INFO:teuthology.orchestra.run.smithi141.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-11-15T01:08:22.884 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-11-15T01:08:22.884 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-11-15T01:08:22.884 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-15T01:08:22.885 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-15T01:08:22.885 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-11-15T01:08:22.885 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi141.front.sepia.ceph.com, path=None, version=distro) 2023-11-15T01:08:22.885 DEBUG:teuthology.orchestra.run.smithi141:> rpm -q kernel | sort -rV | head -n 1 2023-11-15T01:08:23.014 INFO:teuthology.orchestra.run.smithi141.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-11-15T01:08:23.015 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-11-15T01:08:23.015 DEBUG:teuthology.orchestra.run.smithi141:> sudo rpm -qi grub2-tools 2023-11-15T01:08:23.042 INFO:teuthology.orchestra.run.smithi141.stdout:Name : grub2-tools 2023-11-15T01:08:23.042 INFO:teuthology.orchestra.run.smithi141.stdout:Epoch : 1 2023-11-15T01:08:23.042 INFO:teuthology.orchestra.run.smithi141.stdout:Version : 2.02 2023-11-15T01:08:23.043 INFO:teuthology.orchestra.run.smithi141.stdout:Release : 99.el8_4.1 2023-11-15T01:08:23.043 INFO:teuthology.orchestra.run.smithi141.stdout:Architecture: x86_64 2023-11-15T01:08:23.043 INFO:teuthology.orchestra.run.smithi141.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-11-15T01:08:23.043 INFO:teuthology.orchestra.run.smithi141.stdout:Group : System Environment/Base 2023-11-15T01:08:23.043 INFO:teuthology.orchestra.run.smithi141.stdout:Size : 9264631 2023-11-15T01:08:23.044 INFO:teuthology.orchestra.run.smithi141.stdout:License : GPLv3+ 2023-11-15T01:08:23.044 INFO:teuthology.orchestra.run.smithi141.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-11-15T01:08:23.044 INFO:teuthology.orchestra.run.smithi141.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-11-15T01:08:23.044 INFO:teuthology.orchestra.run.smithi141.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-11-15T01:08:23.045 INFO:teuthology.orchestra.run.smithi141.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-11-15T01:08:23.045 INFO:teuthology.orchestra.run.smithi141.stdout:Relocations : (not relocatable) 2023-11-15T01:08:23.045 INFO:teuthology.orchestra.run.smithi141.stdout:Packager : Red Hat, Inc. 2023-11-15T01:08:23.045 INFO:teuthology.orchestra.run.smithi141.stdout:Vendor : Red Hat, Inc. 2023-11-15T01:08:23.045 INFO:teuthology.orchestra.run.smithi141.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-15T01:08:23.045 INFO:teuthology.orchestra.run.smithi141.stdout:Summary : Support tools for GRUB. 2023-11-15T01:08:23.046 INFO:teuthology.orchestra.run.smithi141.stdout:Description : 2023-11-15T01:08:23.046 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:08:23.046 INFO:teuthology.orchestra.run.smithi141.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-15T01:08:23.046 INFO:teuthology.orchestra.run.smithi141.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-15T01:08:23.047 INFO:teuthology.orchestra.run.smithi141.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-15T01:08:23.047 INFO:teuthology.orchestra.run.smithi141.stdout:hardware devices. 2023-11-15T01:08:23.047 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:08:23.047 INFO:teuthology.orchestra.run.smithi141.stdout:This subpackage provides tools for support of all platforms. 2023-11-15T01:08:23.048 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-15T01:08:23.049 INFO:teuthology.task.kernel:Updating grub on smithi141 to boot 4.18.0-425.3.1.el8.x86_64 2023-11-15T01:08:23.049 DEBUG:teuthology.orchestra.run.smithi141:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-15T01:08:23.102 INFO:teuthology.orchestra.run.smithi001.stdout:Updating Subscription Management repositories. 2023-11-15T01:08:23.103 INFO:teuthology.orchestra.run.smithi001.stdout:Unable to read consumer identity 2023-11-15T01:08:23.405 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:00:03 ago on Wed 15 Nov 2023 01:08:20 AM UTC. 2023-11-15T01:08:23.557 INFO:teuthology.orchestra.run.smithi001.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-11-15T01:08:23.557 INFO:teuthology.orchestra.run.smithi001.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-15T01:08:23.558 INFO:teuthology.orchestra.run.smithi001.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-15T01:08:23.571 INFO:teuthology.orchestra.run.smithi001.stderr:Error: No packages marked for reinstall. 2023-11-15T01:08:23.622 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2023-11-15T01:08:23.754 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-11-15T01:08:23.755 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-11-15T01:08:23.755 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-11-15T01:08:23.755 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-15T01:08:23.756 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-15T01:08:23.756 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-11-15T01:08:23.756 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi001.front.sepia.ceph.com, path=None, version=distro) 2023-11-15T01:08:23.756 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2023-11-15T01:08:23.887 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-11-15T01:08:23.887 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-11-15T01:08:23.888 DEBUG:teuthology.orchestra.run.smithi001:> sudo rpm -qi grub2-tools 2023-11-15T01:08:23.918 INFO:teuthology.orchestra.run.smithi001.stdout:Name : grub2-tools 2023-11-15T01:08:23.918 INFO:teuthology.orchestra.run.smithi001.stdout:Epoch : 1 2023-11-15T01:08:23.919 INFO:teuthology.orchestra.run.smithi001.stdout:Version : 2.02 2023-11-15T01:08:23.919 INFO:teuthology.orchestra.run.smithi001.stdout:Release : 99.el8_4.1 2023-11-15T01:08:23.919 INFO:teuthology.orchestra.run.smithi001.stdout:Architecture: x86_64 2023-11-15T01:08:23.919 INFO:teuthology.orchestra.run.smithi001.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-11-15T01:08:23.919 INFO:teuthology.orchestra.run.smithi001.stdout:Group : System Environment/Base 2023-11-15T01:08:23.920 INFO:teuthology.orchestra.run.smithi001.stdout:Size : 9264631 2023-11-15T01:08:23.920 INFO:teuthology.orchestra.run.smithi001.stdout:License : GPLv3+ 2023-11-15T01:08:23.920 INFO:teuthology.orchestra.run.smithi001.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-11-15T01:08:23.920 INFO:teuthology.orchestra.run.smithi001.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-11-15T01:08:23.920 INFO:teuthology.orchestra.run.smithi001.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-11-15T01:08:23.921 INFO:teuthology.orchestra.run.smithi001.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-11-15T01:08:23.921 INFO:teuthology.orchestra.run.smithi001.stdout:Relocations : (not relocatable) 2023-11-15T01:08:23.921 INFO:teuthology.orchestra.run.smithi001.stdout:Packager : Red Hat, Inc. 2023-11-15T01:08:23.921 INFO:teuthology.orchestra.run.smithi001.stdout:Vendor : Red Hat, Inc. 2023-11-15T01:08:23.921 INFO:teuthology.orchestra.run.smithi001.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-15T01:08:23.922 INFO:teuthology.orchestra.run.smithi001.stdout:Summary : Support tools for GRUB. 2023-11-15T01:08:23.922 INFO:teuthology.orchestra.run.smithi001.stdout:Description : 2023-11-15T01:08:23.922 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:08:23.922 INFO:teuthology.orchestra.run.smithi001.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-15T01:08:23.922 INFO:teuthology.orchestra.run.smithi001.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-15T01:08:23.923 INFO:teuthology.orchestra.run.smithi001.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-15T01:08:23.923 INFO:teuthology.orchestra.run.smithi001.stdout:hardware devices. 2023-11-15T01:08:23.923 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:08:23.923 INFO:teuthology.orchestra.run.smithi001.stdout:This subpackage provides tools for support of all platforms. 2023-11-15T01:08:23.923 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-15T01:08:23.924 INFO:teuthology.task.kernel:Updating grub on smithi001 to boot 4.18.0-425.3.1.el8.x86_64 2023-11-15T01:08:23.924 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-15T01:08:24.419 INFO:teuthology.orchestra.run.smithi141.stderr:Generating grub configuration file ... 2023-11-15T01:08:25.017 INFO:teuthology.orchestra.run.smithi001.stderr:Generating grub configuration file ... 2023-11-15T01:08:26.477 INFO:teuthology.orchestra.run.smithi141.stderr:done 2023-11-15T01:08:26.479 DEBUG:teuthology.orchestra.run.smithi141:> mktemp 2023-11-15T01:08:26.493 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.5tcwwWKPY2 2023-11-15T01:08:26.494 DEBUG:teuthology.orchestra.run.smithi141:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.5tcwwWKPY2 2023-11-15T01:08:26.567 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.5tcwwWKPY2 2023-11-15T01:08:26.713 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.5tcwwWKPY2 is 6KB 2023-11-15T01:08:26.761 DEBUG:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.5tcwwWKPY2 2023-11-15T01:08:26.775 DEBUG:teuthology.orchestra.run.smithi141:> sudo /bin/ls /boot/loader/entries || true 2023-11-15T01:08:26.847 INFO:teuthology.orchestra.run.smithi141.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-11-15T01:08:26.847 INFO:teuthology.orchestra.run.smithi141.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-11-15T01:08:26.847 INFO:teuthology.orchestra.run.smithi141.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-11-15T01:08:26.847 INFO:teuthology.orchestra.run.smithi141.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-11-15T01:08:26.849 DEBUG:teuthology.orchestra.run.smithi141:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-11-15T01:08:26.898 INFO:teuthology.orchestra.run.smithi001.stderr:done 2023-11-15T01:08:26.899 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2023-11-15T01:08:26.914 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.jomOt8VzhV 2023-11-15T01:08:26.914 DEBUG:teuthology.orchestra.run.smithi001:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jomOt8VzhV 2023-11-15T01:08:26.982 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.jomOt8VzhV 2023-11-15T01:08:27.002 DEBUG:teuthology.orchestra.run.smithi141:> sudo shutdown -r now 2023-11-15T01:08:27.139 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.jomOt8VzhV is 6KB 2023-11-15T01:08:27.158 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.jomOt8VzhV 2023-11-15T01:08:27.172 DEBUG:teuthology.orchestra.run.smithi001:> sudo /bin/ls /boot/loader/entries || true 2023-11-15T01:08:27.244 INFO:teuthology.orchestra.run.smithi001.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-11-15T01:08:27.244 INFO:teuthology.orchestra.run.smithi001.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-11-15T01:08:27.244 INFO:teuthology.orchestra.run.smithi001.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-11-15T01:08:27.244 INFO:teuthology.orchestra.run.smithi001.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-11-15T01:08:27.245 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-11-15T01:08:27.407 DEBUG:teuthology.orchestra.run.smithi001:> sudo shutdown -r now 2023-11-15T01:08:57.034 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-15T01:08:57.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-11-15T01:08:57.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T01:08:57.410 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-15T01:08:57.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-11-15T01:08:57.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T01:09:15.514 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-11-15T01:09:15.770 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-11-15T01:09:24.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-11-15T01:09:24.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T01:09:24.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-11-15T01:09:24.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T01:09:27.578 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-11-15T01:09:27.834 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-11-15T01:09:39.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-11-15T01:09:39.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T01:09:39.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-11-15T01:09:39.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T01:10:11.487 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-11-15T01:10:11.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-11-15T01:10:11.749 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-11-15T01:10:11.750 DEBUG:teuthology.orchestra.run.smithi141:> uname -r 2023-11-15T01:10:11.751 DEBUG:teuthology.orchestra.run.smithi001:> true 2023-11-15T01:10:11.764 INFO:teuthology.orchestra.run.smithi141.stdout:4.18.0-425.3.1.el8.x86_64 2023-11-15T01:10:11.764 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-11-15T01:10:11.764 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-15T01:10:11.765 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-11-15T01:10:12.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-11-15T01:10:12.028 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-11-15T01:10:12.029 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2023-11-15T01:10:12.043 INFO:teuthology.orchestra.run.smithi001.stdout:4.18.0-425.3.1.el8.x86_64 2023-11-15T01:10:12.043 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-11-15T01:10:12.043 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-15T01:10:12.043 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-11-15T01:10:12.766 DEBUG:teuthology.parallel:result is None 2023-11-15T01:10:13.045 DEBUG:teuthology.parallel:result is None 2023-11-15T01:10:13.046 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-15T01:10:13.057 INFO:teuthology.task.internal:Creating test directory... 2023-11-15T01:10:13.057 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-15T01:10:13.060 DEBUG:teuthology.orchestra.run.smithi141:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-15T01:10:13.100 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-15T01:10:13.109 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-15T01:10:13.116 INFO:teuthology.task.internal:Creating archive directory... 2023-11-15T01:10:13.116 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-15T01:10:13.118 DEBUG:teuthology.orchestra.run.smithi141:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-15T01:10:13.463 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-15T01:10:13.471 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-15T01:10:13.472 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-15T01:10:13.474 DEBUG:teuthology.orchestra.run.smithi141:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-15T01:10:13.633 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-15T01:10:13.690 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-15T01:10:14.086 INFO:teuthology.orchestra.run.smithi141.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-15T01:10:14.232 INFO:teuthology.orchestra.run.smithi141.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-15T01:10:14.255 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-15T01:10:14.263 INFO:teuthology.task.internal:Configuring sudo... 2023-11-15T01:10:14.264 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-15T01:10:14.308 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-15T01:10:14.707 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-15T01:10:14.716 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-15T01:10:14.716 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-15T01:10:14.765 DEBUG:teuthology.orchestra.run.smithi141:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-15T01:10:15.032 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-15T01:10:15.379 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-15T01:10:15.689 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-15T01:10:16.048 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-15T01:10:16.153 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:10:16.154 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-15T01:10:16.184 DEBUG:teuthology.orchestra.run.smithi141:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-15T01:10:16.227 DEBUG:teuthology.orchestra.run.smithi141:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-15T01:10:16.293 DEBUG:teuthology.orchestra.run.smithi141:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-15T01:10:16.334 DEBUG:teuthology.orchestra.run.smithi141:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-15T01:10:16.374 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:10:16.374 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-15T01:10:16.438 DEBUG:teuthology.orchestra.run.smithi001:> sudo service rsyslog restart 2023-11-15T01:10:16.441 DEBUG:teuthology.orchestra.run.smithi141:> sudo service rsyslog restart 2023-11-15T01:10:16.538 INFO:teuthology.orchestra.run.smithi141.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-15T01:10:16.592 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-15T01:10:16.949 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-15T01:10:16.958 INFO:teuthology.task.internal:Starting timer... 2023-11-15T01:10:16.958 INFO:teuthology.run_tasks:Running task pcp... 2023-11-15T01:10:17.024 INFO:teuthology.run_tasks:Running task selinux... 2023-11-15T01:10:17.032 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-11-15T01:10:17.033 DEBUG:teuthology.orchestra.run.smithi001:> sudo service auditd rotate 2023-11-15T01:10:17.118 INFO:teuthology.orchestra.run.smithi001.stdout:Rotating logs: [ OK ] 2023-11-15T01:10:17.120 DEBUG:teuthology.orchestra.run.smithi141:> sudo service auditd rotate 2023-11-15T01:10:17.183 INFO:teuthology.orchestra.run.smithi141.stdout:Rotating logs: [ OK ] 2023-11-15T01:10:17.185 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-15T01:10:17.185 DEBUG:teuthology.orchestra.run.smithi001:> /usr/sbin/getenforce 2023-11-15T01:10:17.206 INFO:teuthology.orchestra.run.smithi001.stdout:Permissive 2023-11-15T01:10:17.207 DEBUG:teuthology.orchestra.run.smithi141:> /usr/sbin/getenforce 2023-11-15T01:10:17.230 INFO:teuthology.orchestra.run.smithi141.stdout:Permissive 2023-11-15T01:10:17.231 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi001.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi141.front.sepia.ceph.com': 'permissive'} 2023-11-15T01:10:17.231 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-15T01:10:17.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-15T01:10:17.277 DEBUG:teuthology.orchestra.run.smithi141:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-15T01:10:17.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-15T01:10:17.303 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-15T01:10:17.303 DEBUG:teuthology.orchestra.run.smithi001:> sudo /usr/sbin/setenforce permissive 2023-11-15T01:10:17.341 DEBUG:teuthology.orchestra.run.smithi141:> sudo /usr/sbin/setenforce permissive 2023-11-15T01:10:17.378 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-15T01:10:17.388 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-15T01:10:17.388 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-15T01:10:17.405 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-15T01:10:17.406 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi001.front.sepia.ceph.com,smithi141.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-15T01:18:36.337 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi001.front.sepia.ceph.com'), Remote(name='ubuntu@smithi141.front.sepia.ceph.com')] 2023-11-15T01:18:36.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-11-15T01:18:36.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T01:18:36.409 DEBUG:teuthology.orchestra.run.smithi001:> true 2023-11-15T01:18:36.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-11-15T01:18:36.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-11-15T01:18:36.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T01:18:36.546 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-11-15T01:18:36.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-11-15T01:18:36.569 INFO:teuthology.run_tasks:Running task clock... 2023-11-15T01:18:36.582 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-15T01:18:36.583 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-15T01:18:36.584 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-15T01:18:36.586 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-15T01:18:36.586 DEBUG:teuthology.orchestra.run.smithi141:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-15T01:18:36.614 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-15T01:18:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-15T01:18:36.638 INFO:teuthology.orchestra.run.smithi141.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-15T01:18:36.652 INFO:teuthology.orchestra.run.smithi141.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-15T01:18:36.667 INFO:teuthology.orchestra.run.smithi001.stderr:sudo: ntpd: command not found 2023-11-15T01:18:36.678 INFO:teuthology.orchestra.run.smithi001.stdout:506 Cannot talk to daemon 2023-11-15T01:18:36.684 INFO:teuthology.orchestra.run.smithi141.stderr:sudo: ntpd: command not found 2023-11-15T01:18:36.692 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-15T01:18:36.695 INFO:teuthology.orchestra.run.smithi141.stdout:506 Cannot talk to daemon 2023-11-15T01:18:36.706 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-15T01:18:36.708 INFO:teuthology.orchestra.run.smithi141.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-15T01:18:36.722 INFO:teuthology.orchestra.run.smithi141.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-15T01:18:36.776 INFO:teuthology.orchestra.run.smithi001.stderr:bash: ntpq: command not found 2023-11-15T01:18:36.781 INFO:teuthology.orchestra.run.smithi001.stdout:210 Number of sources = 4 2023-11-15T01:18:36.782 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-15T01:18:36.782 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2023-11-15T01:18:36.782 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-15T01:18:36.782 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-15T01:18:36.783 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-15T01:18:36.783 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-15T01:18:36.807 INFO:teuthology.orchestra.run.smithi141.stderr:bash: ntpq: command not found 2023-11-15T01:18:36.811 INFO:teuthology.orchestra.run.smithi141.stdout:210 Number of sources = 4 2023-11-15T01:18:36.811 INFO:teuthology.orchestra.run.smithi141.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-15T01:18:36.811 INFO:teuthology.orchestra.run.smithi141.stdout:=============================================================================== 2023-11-15T01:18:36.811 INFO:teuthology.orchestra.run.smithi141.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-15T01:18:36.812 INFO:teuthology.orchestra.run.smithi141.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-15T01:18:36.812 INFO:teuthology.orchestra.run.smithi141.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-15T01:18:36.812 INFO:teuthology.orchestra.run.smithi141.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-15T01:18:36.812 INFO:teuthology.run_tasks:Running task install... 2023-11-15T01:18:36.821 DEBUG:teuthology.task.install:project ceph 2023-11-15T01:18:36.822 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '620f25c1794f62207424fc9319427943fb8d1fae'}} 2023-11-15T01:18:36.822 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '620f25c1794f62207424fc9319427943fb8d1fae'} 2023-11-15T01:18:36.822 INFO:teuthology.task.install:Using flavor: default 2023-11-15T01:18:36.828 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-15T01:18:36.828 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-15T01:18:36.829 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '620f25c1794f62207424fc9319427943fb8d1fae', 'tag': None, 'wait_for_package': False} 2023-11-15T01:18:36.829 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=620f25c1794f62207424fc9319427943fb8d1fae 2023-11-15T01:18:36.831 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '620f25c1794f62207424fc9319427943fb8d1fae', 'tag': None, 'wait_for_package': False} 2023-11-15T01:18:36.832 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=620f25c1794f62207424fc9319427943fb8d1fae 2023-11-15T01:18:36.989 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-11-13-0820-pacific/620f25c1794f62207424fc9319427943fb8d1fae/centos/8/flavors/default/ 2023-11-15T01:18:36.989 INFO:teuthology.task.install.rpm:Package version is 16.2.14-170.g620f25c1 2023-11-15T01:18:37.051 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-11-13-0820-pacific/620f25c1794f62207424fc9319427943fb8d1fae/centos/8/flavors/default/ 2023-11-15T01:18:37.051 INFO:teuthology.task.install.rpm:Package version is 16.2.14-170.g620f25c1 2023-11-15T01:18:37.161 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-11-13-0820-pacific/620f25c1794f62207424fc9319427943fb8d1fae/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-11-13-0820-pacific/620f25c1794f62207424fc9319427943fb8d1fae/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-11-13-0820-pacific/620f25c1794f62207424fc9319427943fb8d1fae/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-15T01:18:37.161 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:18:37.162 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-15T01:18:37.187 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-11-15T01:18:37.188 DEBUG:teuthology.orchestra.run.smithi141:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/620f25c1794f62207424fc9319427943fb8d1fae/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-15T01:18:37.232 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-11-13-0820-pacific/620f25c1794f62207424fc9319427943fb8d1fae/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-11-13-0820-pacific/620f25c1794f62207424fc9319427943fb8d1fae/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-11-13-0820-pacific/620f25c1794f62207424fc9319427943fb8d1fae/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-15T01:18:37.232 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:18:37.233 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-15T01:18:37.255 DEBUG:teuthology.orchestra.run.smithi141:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-15T01:18:37.261 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-11-15T01:18:37.261 DEBUG:teuthology.orchestra.run.smithi001:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/620f25c1794f62207424fc9319427943fb8d1fae/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-15T01:18:37.328 DEBUG:teuthology.orchestra.run.smithi001:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-15T01:18:37.329 DEBUG:teuthology.orchestra.run.smithi141:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-15T01:18:37.393 INFO:teuthology.orchestra.run.smithi141.stdout:check_obsoletes = 1 2023-11-15T01:18:37.394 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum clean all 2023-11-15T01:18:37.406 DEBUG:teuthology.orchestra.run.smithi001:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-15T01:18:37.471 INFO:teuthology.orchestra.run.smithi001.stdout:check_obsoletes = 1 2023-11-15T01:18:37.472 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum clean all 2023-11-15T01:18:37.786 INFO:teuthology.orchestra.run.smithi141.stdout:Updating Subscription Management repositories. 2023-11-15T01:18:37.886 INFO:teuthology.orchestra.run.smithi001.stdout:Updating Subscription Management repositories. 2023-11-15T01:18:38.135 INFO:teuthology.orchestra.run.smithi141.stdout:44 files removed 2023-11-15T01:18:38.186 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-11-15T01:18:38.237 INFO:teuthology.orchestra.run.smithi001.stdout:44 files removed 2023-11-15T01:18:38.289 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-11-15T01:18:38.534 INFO:teuthology.orchestra.run.smithi141.stdout:Updating Subscription Management repositories. 2023-11-15T01:18:38.660 INFO:teuthology.orchestra.run.smithi001.stdout:Updating Subscription Management repositories. 2023-11-15T01:18:39.272 INFO:teuthology.orchestra.run.smithi141.stdout:ceph packages for x86_64 265 kB/s | 76 kB 00:00 2023-11-15T01:18:39.425 INFO:teuthology.orchestra.run.smithi001.stdout:ceph packages for x86_64 236 kB/s | 76 kB 00:00 2023-11-15T01:18:39.554 INFO:teuthology.orchestra.run.smithi141.stdout:ceph noarch packages 63 kB/s | 15 kB 00:00 2023-11-15T01:18:39.775 INFO:teuthology.orchestra.run.smithi001.stdout:ceph noarch packages 50 kB/s | 15 kB 00:00 2023-11-15T01:18:39.830 INFO:teuthology.orchestra.run.smithi141.stdout:ceph source packages 5.8 kB/s | 1.4 kB 00:00 2023-11-15T01:18:39.931 INFO:teuthology.orchestra.run.smithi141.stdout:Copr repo for python3-asyncssh owned by ceph 48 kB/s | 3.5 kB 00:00 2023-11-15T01:18:40.116 INFO:teuthology.orchestra.run.smithi001.stdout:ceph source packages 4.7 kB/s | 1.4 kB 00:00 2023-11-15T01:18:40.218 INFO:teuthology.orchestra.run.smithi001.stdout:Copr repo for python3-asyncssh owned by ceph 49 kB/s | 3.5 kB 00:00 2023-11-15T01:18:41.156 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-11-15T01:18:41.683 INFO:teuthology.orchestra.run.smithi141.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 16 MB 00:01 2023-11-15T01:18:44.711 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 3.9 MB/s | 24 kB 00:00 2023-11-15T01:18:44.976 INFO:teuthology.orchestra.run.smithi141.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-11-15T01:18:45.105 INFO:teuthology.orchestra.run.smithi001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 107 MB/s | 33 MB 00:00 2023-11-15T01:18:45.352 INFO:teuthology.orchestra.run.smithi141.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 130 MB/s | 38 MB 00:00 2023-11-15T01:18:50.630 INFO:teuthology.orchestra.run.smithi001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 111 MB/s | 38 MB 00:00 2023-11-15T01:18:50.874 INFO:teuthology.orchestra.run.smithi141.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 124 MB/s | 33 MB 00:00 2023-11-15T01:18:58.824 INFO:teuthology.orchestra.run.smithi141.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-15T01:18:58.824 INFO:teuthology.orchestra.run.smithi141.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-15T01:18:58.835 INFO:teuthology.orchestra.run.smithi141.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-11-15T01:18:58.835 INFO:teuthology.orchestra.run.smithi141.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-11-15T01:18:58.836 INFO:teuthology.orchestra.run.smithi141.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-11-15T01:18:58.837 INFO:teuthology.orchestra.run.smithi141.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-15T01:18:58.839 INFO:teuthology.orchestra.run.smithi141.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-15T01:18:58.841 INFO:teuthology.orchestra.run.smithi141.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-11-15T01:18:58.842 INFO:teuthology.orchestra.run.smithi141.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-11-15T01:18:59.327 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-11-15T01:18:59.338 INFO:teuthology.orchestra.run.smithi141.stdout:====================================================================================================================== 2023-11-15T01:18:59.339 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2023-11-15T01:18:59.339 INFO:teuthology.orchestra.run.smithi141.stdout:====================================================================================================================== 2023-11-15T01:18:59.339 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-11-15T01:18:59.339 INFO:teuthology.orchestra.run.smithi141.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-15T01:18:59.339 INFO:teuthology.orchestra.run.smithi141.stdout: ceph x86_64 2:16.2.14-170.g620f25c1.el8 ceph 6.4 k 2023-11-15T01:18:59.340 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-base x86_64 2:16.2.14-170.g620f25c1.el8 ceph 6.1 M 2023-11-15T01:18:59.340 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-fuse x86_64 2:16.2.14-170.g620f25c1.el8 ceph 910 k 2023-11-15T01:18:59.340 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-170.g620f25c1.el8 ceph 161 k 2023-11-15T01:18:59.340 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr x86_64 2:16.2.14-170.g620f25c1.el8 ceph 1.6 M 2023-11-15T01:18:59.340 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-cephadm noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 116 k 2023-11-15T01:18:59.341 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-dashboard noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 3.1 M 2023-11-15T01:18:59.341 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 8.6 M 2023-11-15T01:18:59.341 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-rook noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 27 k 2023-11-15T01:18:59.341 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-radosgw x86_64 2:16.2.14-170.g620f25c1.el8 ceph 12 M 2023-11-15T01:18:59.341 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-test x86_64 2:16.2.14-170.g620f25c1.el8 ceph 52 M 2023-11-15T01:18:59.342 INFO:teuthology.orchestra.run.smithi141.stdout: cephadm noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 85 k 2023-11-15T01:18:59.342 INFO:teuthology.orchestra.run.smithi141.stdout: cephfs-mirror x86_64 2:16.2.14-170.g620f25c1.el8 ceph 257 k 2023-11-15T01:18:59.342 INFO:teuthology.orchestra.run.smithi141.stdout: cephfs-top noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 19 k 2023-11-15T01:18:59.342 INFO:teuthology.orchestra.run.smithi141.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-11-15T01:18:59.342 INFO:teuthology.orchestra.run.smithi141.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-15T01:18:59.343 INFO:teuthology.orchestra.run.smithi141.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-15T01:18:59.343 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs-devel x86_64 2:16.2.14-170.g620f25c1.el8 ceph 25 k 2023-11-15T01:18:59.343 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs2 x86_64 2:16.2.14-170.g620f25c1.el8 ceph 824 k 2023-11-15T01:18:59.343 INFO:teuthology.orchestra.run.smithi141.stdout: librados-devel x86_64 2:16.2.14-170.g620f25c1.el8 ceph 131 k 2023-11-15T01:18:59.343 INFO:teuthology.orchestra.run.smithi141.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-15T01:18:59.344 INFO:teuthology.orchestra.run.smithi141.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-11-15T01:18:59.344 INFO:teuthology.orchestra.run.smithi141.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-15T01:18:59.344 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cephfs x86_64 2:16.2.14-170.g620f25c1.el8 ceph 215 k 2023-11-15T01:18:59.344 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rados x86_64 2:16.2.14-170.g620f25c1.el8 ceph 390 k 2023-11-15T01:18:59.344 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rbd x86_64 2:16.2.14-170.g620f25c1.el8 ceph 369 k 2023-11-15T01:18:59.345 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rgw x86_64 2:16.2.14-170.g620f25c1.el8 ceph 114 k 2023-11-15T01:18:59.345 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-fuse x86_64 2:16.2.14-170.g620f25c1.el8 ceph 88 k 2023-11-15T01:18:59.345 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-mirror x86_64 2:16.2.14-170.g620f25c1.el8 ceph 3.7 M 2023-11-15T01:18:59.345 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-nbd x86_64 2:16.2.14-170.g620f25c1.el8 ceph 175 k 2023-11-15T01:18:59.345 INFO:teuthology.orchestra.run.smithi141.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-11-15T01:18:59.345 INFO:teuthology.orchestra.run.smithi141.stdout:Upgrading: 2023-11-15T01:18:59.346 INFO:teuthology.orchestra.run.smithi141.stdout: librados2 x86_64 2:16.2.14-170.g620f25c1.el8 ceph 3.7 M 2023-11-15T01:18:59.346 INFO:teuthology.orchestra.run.smithi141.stdout: librbd1 x86_64 2:16.2.14-170.g620f25c1.el8 ceph 4.2 M 2023-11-15T01:18:59.346 INFO:teuthology.orchestra.run.smithi141.stdout:Installing dependencies: 2023-11-15T01:18:59.346 INFO:teuthology.orchestra.run.smithi141.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-15T01:18:59.346 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-common x86_64 2:16.2.14-170.g620f25c1.el8 ceph 24 M 2023-11-15T01:18:59.347 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-grafana-dashboards noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 24 k 2023-11-15T01:18:59.347 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mds x86_64 2:16.2.14-170.g620f25c1.el8 ceph 2.4 M 2023-11-15T01:18:59.347 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-modules-core noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 245 k 2023-11-15T01:18:59.347 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mon x86_64 2:16.2.14-170.g620f25c1.el8 ceph 5.0 M 2023-11-15T01:18:59.347 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-osd x86_64 2:16.2.14-170.g620f25c1.el8 ceph 18 M 2023-11-15T01:18:59.348 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-prometheus-alerts noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 15 k 2023-11-15T01:18:59.348 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-selinux x86_64 2:16.2.14-170.g620f25c1.el8 ceph 26 k 2023-11-15T01:18:59.348 INFO:teuthology.orchestra.run.smithi141.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-15T01:18:59.348 INFO:teuthology.orchestra.run.smithi141.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-15T01:18:59.348 INFO:teuthology.orchestra.run.smithi141.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-11-15T01:18:59.349 INFO:teuthology.orchestra.run.smithi141.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-15T01:18:59.349 INFO:teuthology.orchestra.run.smithi141.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-15T01:18:59.349 INFO:teuthology.orchestra.run.smithi141.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-11-15T01:18:59.349 INFO:teuthology.orchestra.run.smithi141.stdout: libcephsqlite x86_64 2:16.2.14-170.g620f25c1.el8 ceph 174 k 2023-11-15T01:18:59.349 INFO:teuthology.orchestra.run.smithi141.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-11-15T01:18:59.350 INFO:teuthology.orchestra.run.smithi141.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-11-15T01:18:59.350 INFO:teuthology.orchestra.run.smithi141.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-15T01:18:59.350 INFO:teuthology.orchestra.run.smithi141.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-11-15T01:18:59.350 INFO:teuthology.orchestra.run.smithi141.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-15T01:18:59.350 INFO:teuthology.orchestra.run.smithi141.stdout: libradosstriper1 x86_64 2:16.2.14-170.g620f25c1.el8 ceph 493 k 2023-11-15T01:18:59.351 INFO:teuthology.orchestra.run.smithi141.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-11-15T01:18:59.351 INFO:teuthology.orchestra.run.smithi141.stdout: librgw2 x86_64 2:16.2.14-170.g620f25c1.el8 ceph 3.8 M 2023-11-15T01:18:59.351 INFO:teuthology.orchestra.run.smithi141.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-15T01:18:59.351 INFO:teuthology.orchestra.run.smithi141.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-11-15T01:18:59.351 INFO:teuthology.orchestra.run.smithi141.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-15T01:18:59.352 INFO:teuthology.orchestra.run.smithi141.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-15T01:18:59.352 INFO:teuthology.orchestra.run.smithi141.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-15T01:18:59.352 INFO:teuthology.orchestra.run.smithi141.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-15T01:18:59.352 INFO:teuthology.orchestra.run.smithi141.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-11-15T01:18:59.352 INFO:teuthology.orchestra.run.smithi141.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-15T01:18:59.353 INFO:teuthology.orchestra.run.smithi141.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-15T01:18:59.353 INFO:teuthology.orchestra.run.smithi141.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-15T01:18:59.353 INFO:teuthology.orchestra.run.smithi141.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-15T01:18:59.353 INFO:teuthology.orchestra.run.smithi141.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-11-15T01:18:59.353 INFO:teuthology.orchestra.run.smithi141.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-15T01:18:59.354 INFO:teuthology.orchestra.run.smithi141.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-15T01:18:59.354 INFO:teuthology.orchestra.run.smithi141.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-15T01:18:59.354 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-15T01:18:59.354 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ceph-argparse x86_64 2:16.2.14-170.g620f25c1.el8 ceph 45 k 2023-11-15T01:18:59.354 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ceph-common x86_64 2:16.2.14-170.g620f25c1.el8 ceph 99 k 2023-11-15T01:18:59.355 INFO:teuthology.orchestra.run.smithi141.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-15T01:18:59.355 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-15T01:18:59.355 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-15T01:18:59.355 INFO:teuthology.orchestra.run.smithi141.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-11-15T01:18:59.355 INFO:teuthology.orchestra.run.smithi141.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-15T01:18:59.356 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-15T01:18:59.356 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-15T01:18:59.356 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-15T01:18:59.356 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-15T01:18:59.356 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-15T01:18:59.356 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-15T01:18:59.357 INFO:teuthology.orchestra.run.smithi141.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-15T01:18:59.357 INFO:teuthology.orchestra.run.smithi141.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-15T01:18:59.357 INFO:teuthology.orchestra.run.smithi141.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-15T01:18:59.357 INFO:teuthology.orchestra.run.smithi141.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-15T01:18:59.357 INFO:teuthology.orchestra.run.smithi141.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-15T01:18:59.358 INFO:teuthology.orchestra.run.smithi141.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-15T01:18:59.358 INFO:teuthology.orchestra.run.smithi141.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-15T01:18:59.358 INFO:teuthology.orchestra.run.smithi141.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-15T01:18:59.358 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-15T01:18:59.358 INFO:teuthology.orchestra.run.smithi141.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-15T01:18:59.359 INFO:teuthology.orchestra.run.smithi141.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-15T01:18:59.359 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-15T01:18:59.359 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-15T01:18:59.359 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-15T01:18:59.359 INFO:teuthology.orchestra.run.smithi141.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-11-15T01:18:59.360 INFO:teuthology.orchestra.run.smithi141.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-15T01:18:59.360 INFO:teuthology.orchestra.run.smithi141.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-15T01:18:59.360 INFO:teuthology.orchestra.run.smithi141.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-15T01:18:59.360 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-15T01:18:59.360 INFO:teuthology.orchestra.run.smithi141.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-11-15T01:18:59.361 INFO:teuthology.orchestra.run.smithi141.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-15T01:18:59.361 INFO:teuthology.orchestra.run.smithi141.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-15T01:18:59.361 INFO:teuthology.orchestra.run.smithi141.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-15T01:18:59.361 INFO:teuthology.orchestra.run.smithi141.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-15T01:18:59.361 INFO:teuthology.orchestra.run.smithi141.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-15T01:18:59.361 INFO:teuthology.orchestra.run.smithi141.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-15T01:18:59.362 INFO:teuthology.orchestra.run.smithi141.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-15T01:18:59.362 INFO:teuthology.orchestra.run.smithi141.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-15T01:18:59.362 INFO:teuthology.orchestra.run.smithi141.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-15T01:18:59.362 INFO:teuthology.orchestra.run.smithi141.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-15T01:18:59.362 INFO:teuthology.orchestra.run.smithi141.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-11-15T01:18:59.363 INFO:teuthology.orchestra.run.smithi141.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-15T01:18:59.363 INFO:teuthology.orchestra.run.smithi141.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-15T01:18:59.363 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:18:59.363 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-11-15T01:18:59.363 INFO:teuthology.orchestra.run.smithi141.stdout:====================================================================================================================== 2023-11-15T01:18:59.364 INFO:teuthology.orchestra.run.smithi141.stdout:Install 118 Packages 2023-11-15T01:18:59.364 INFO:teuthology.orchestra.run.smithi141.stdout:Upgrade 2 Packages 2023-11-15T01:18:59.364 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:18:59.364 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 201 M 2023-11-15T01:18:59.365 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-11-15T01:18:59.725 INFO:teuthology.orchestra.run.smithi141.stdout:(1/120): ceph-16.2.14-170.g620f25c1.el8.x86_64. 28 kB/s | 6.4 kB 00:00 2023-11-15T01:19:00.101 INFO:teuthology.orchestra.run.smithi001.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-15T01:19:00.102 INFO:teuthology.orchestra.run.smithi001.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-15T01:19:00.113 INFO:teuthology.orchestra.run.smithi001.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-11-15T01:19:00.114 INFO:teuthology.orchestra.run.smithi001.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-11-15T01:19:00.115 INFO:teuthology.orchestra.run.smithi001.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-11-15T01:19:00.116 INFO:teuthology.orchestra.run.smithi001.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-15T01:19:00.118 INFO:teuthology.orchestra.run.smithi001.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-15T01:19:00.120 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-11-15T01:19:00.121 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-11-15T01:19:00.642 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2023-11-15T01:19:00.654 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================================================== 2023-11-15T01:19:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2023-11-15T01:19:00.655 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================================================== 2023-11-15T01:19:00.655 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2023-11-15T01:19:00.655 INFO:teuthology.orchestra.run.smithi001.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-15T01:19:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: ceph x86_64 2:16.2.14-170.g620f25c1.el8 ceph 6.4 k 2023-11-15T01:19:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base x86_64 2:16.2.14-170.g620f25c1.el8 ceph 6.1 M 2023-11-15T01:19:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse x86_64 2:16.2.14-170.g620f25c1.el8 ceph 910 k 2023-11-15T01:19:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-170.g620f25c1.el8 ceph 161 k 2023-11-15T01:19:00.656 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr x86_64 2:16.2.14-170.g620f25c1.el8 ceph 1.6 M 2023-11-15T01:19:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 116 k 2023-11-15T01:19:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 3.1 M 2023-11-15T01:19:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 8.6 M 2023-11-15T01:19:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 27 k 2023-11-15T01:19:00.657 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw x86_64 2:16.2.14-170.g620f25c1.el8 ceph 12 M 2023-11-15T01:19:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test x86_64 2:16.2.14-170.g620f25c1.el8 ceph 52 M 2023-11-15T01:19:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 85 k 2023-11-15T01:19:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror x86_64 2:16.2.14-170.g620f25c1.el8 ceph 257 k 2023-11-15T01:19:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 19 k 2023-11-15T01:19:00.658 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-11-15T01:19:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-15T01:19:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-15T01:19:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel x86_64 2:16.2.14-170.g620f25c1.el8 ceph 25 k 2023-11-15T01:19:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2 x86_64 2:16.2.14-170.g620f25c1.el8 ceph 824 k 2023-11-15T01:19:00.659 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel x86_64 2:16.2.14-170.g620f25c1.el8 ceph 131 k 2023-11-15T01:19:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-15T01:19:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-11-15T01:19:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-15T01:19:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs x86_64 2:16.2.14-170.g620f25c1.el8 ceph 215 k 2023-11-15T01:19:00.660 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados x86_64 2:16.2.14-170.g620f25c1.el8 ceph 390 k 2023-11-15T01:19:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd x86_64 2:16.2.14-170.g620f25c1.el8 ceph 369 k 2023-11-15T01:19:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw x86_64 2:16.2.14-170.g620f25c1.el8 ceph 114 k 2023-11-15T01:19:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse x86_64 2:16.2.14-170.g620f25c1.el8 ceph 88 k 2023-11-15T01:19:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror x86_64 2:16.2.14-170.g620f25c1.el8 ceph 3.7 M 2023-11-15T01:19:00.661 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd x86_64 2:16.2.14-170.g620f25c1.el8 ceph 175 k 2023-11-15T01:19:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-11-15T01:19:00.662 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrading: 2023-11-15T01:19:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: librados2 x86_64 2:16.2.14-170.g620f25c1.el8 ceph 3.7 M 2023-11-15T01:19:00.662 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1 x86_64 2:16.2.14-170.g620f25c1.el8 ceph 4.2 M 2023-11-15T01:19:00.662 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2023-11-15T01:19:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-15T01:19:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common x86_64 2:16.2.14-170.g620f25c1.el8 ceph 24 M 2023-11-15T01:19:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 24 k 2023-11-15T01:19:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds x86_64 2:16.2.14-170.g620f25c1.el8 ceph 2.4 M 2023-11-15T01:19:00.663 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 245 k 2023-11-15T01:19:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon x86_64 2:16.2.14-170.g620f25c1.el8 ceph 5.0 M 2023-11-15T01:19:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd x86_64 2:16.2.14-170.g620f25c1.el8 ceph 18 M 2023-11-15T01:19:00.664 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts noarch 2:16.2.14-170.g620f25c1.el8 ceph-noarch 15 k 2023-11-15T01:19:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux x86_64 2:16.2.14-170.g620f25c1.el8 ceph 26 k 2023-11-15T01:19:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-15T01:19:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-15T01:19:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-11-15T01:19:00.665 INFO:teuthology.orchestra.run.smithi001.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-15T01:19:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-15T01:19:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-11-15T01:19:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite x86_64 2:16.2.14-170.g620f25c1.el8 ceph 174 k 2023-11-15T01:19:00.666 INFO:teuthology.orchestra.run.smithi001.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-11-15T01:19:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-11-15T01:19:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-15T01:19:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-11-15T01:19:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-15T01:19:00.667 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1 x86_64 2:16.2.14-170.g620f25c1.el8 ceph 493 k 2023-11-15T01:19:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-11-15T01:19:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2 x86_64 2:16.2.14-170.g620f25c1.el8 ceph 3.8 M 2023-11-15T01:19:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-15T01:19:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-11-15T01:19:00.668 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-15T01:19:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-15T01:19:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-15T01:19:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-15T01:19:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-11-15T01:19:00.669 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-15T01:19:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-15T01:19:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-15T01:19:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-15T01:19:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-11-15T01:19:00.670 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-15T01:19:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-15T01:19:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-15T01:19:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-15T01:19:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse x86_64 2:16.2.14-170.g620f25c1.el8 ceph 45 k 2023-11-15T01:19:00.671 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common x86_64 2:16.2.14-170.g620f25c1.el8 ceph 99 k 2023-11-15T01:19:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-15T01:19:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-15T01:19:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-15T01:19:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-11-15T01:19:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-15T01:19:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-15T01:19:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-15T01:19:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-15T01:19:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-15T01:19:00.673 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-15T01:19:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-15T01:19:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-15T01:19:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-15T01:19:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-15T01:19:00.674 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-15T01:19:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-15T01:19:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-15T01:19:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-15T01:19:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-15T01:19:00.675 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-15T01:19:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-15T01:19:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-15T01:19:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-15T01:19:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-15T01:19:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-15T01:19:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-11-15T01:19:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-15T01:19:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-15T01:19:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-15T01:19:00.677 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-15T01:19:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-11-15T01:19:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-15T01:19:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-15T01:19:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-15T01:19:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-15T01:19:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-15T01:19:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-15T01:19:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-15T01:19:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-15T01:19:00.679 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-15T01:19:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-15T01:19:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-11-15T01:19:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-15T01:19:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-15T01:19:00.680 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:19:00.681 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2023-11-15T01:19:00.681 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================================================== 2023-11-15T01:19:00.681 INFO:teuthology.orchestra.run.smithi001.stdout:Install 118 Packages 2023-11-15T01:19:00.681 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrade 2 Packages 2023-11-15T01:19:00.681 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:19:00.682 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 201 M 2023-11-15T01:19:00.682 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2023-11-15T01:19:00.938 INFO:teuthology.orchestra.run.smithi001.stdout:(1/120): ceph-16.2.14-170.g620f25c1.el8.x86_64. 27 kB/s | 6.4 kB 00:00 2023-11-15T01:19:00.982 INFO:teuthology.orchestra.run.smithi141.stdout:(2/120): ceph-fuse-16.2.14-170.g620f25c1.el8.x8 725 kB/s | 910 kB 00:01 2023-11-15T01:19:01.287 INFO:teuthology.orchestra.run.smithi141.stdout:(3/120): ceph-immutable-object-cache-16.2.14-17 528 kB/s | 161 kB 00:00 2023-11-15T01:19:02.093 INFO:teuthology.orchestra.run.smithi001.stdout:(2/120): ceph-fuse-16.2.14-170.g620f25c1.el8.x8 788 kB/s | 910 kB 00:01 2023-11-15T01:19:02.242 INFO:teuthology.orchestra.run.smithi001.stdout:(3/120): ceph-immutable-object-cache-16.2.14-17 1.1 MB/s | 161 kB 00:00 2023-11-15T01:19:03.821 INFO:teuthology.orchestra.run.smithi001.stdout:(4/120): ceph-common-16.2.14-170.g620f25c1.el8. 7.8 MB/s | 24 MB 00:03 2023-11-15T01:19:04.061 INFO:teuthology.orchestra.run.smithi001.stdout:(5/120): ceph-mgr-16.2.14-170.g620f25c1.el8.x86 6.7 MB/s | 1.6 MB 00:00 2023-11-15T01:19:04.221 INFO:teuthology.orchestra.run.smithi001.stdout:(6/120): ceph-base-16.2.14-170.g620f25c1.el8.x8 1.7 MB/s | 6.1 MB 00:03 2023-11-15T01:19:04.704 INFO:teuthology.orchestra.run.smithi001.stdout:(7/120): ceph-mon-16.2.14-170.g620f25c1.el8.x86 7.8 MB/s | 5.0 MB 00:00 2023-11-15T01:19:04.715 INFO:teuthology.orchestra.run.smithi141.stdout:(4/120): ceph-mds-16.2.14-170.g620f25c1.el8.x86 731 kB/s | 2.4 MB 00:03 2023-11-15T01:19:05.168 INFO:teuthology.orchestra.run.smithi001.stdout:(8/120): ceph-mds-16.2.14-170.g620f25c1.el8.x86 857 kB/s | 2.4 MB 00:02 2023-11-15T01:19:05.179 INFO:teuthology.orchestra.run.smithi141.stdout:(5/120): ceph-base-16.2.14-170.g620f25c1.el8.x8 1.1 MB/s | 6.1 MB 00:05 2023-11-15T01:19:05.215 INFO:teuthology.orchestra.run.smithi001.stdout:(9/120): ceph-selinux-16.2.14-170.g620f25c1.el8 548 kB/s | 26 kB 00:00 2023-11-15T01:19:05.699 INFO:teuthology.orchestra.run.smithi141.stdout:(6/120): ceph-common-16.2.14-170.g620f25c1.el8. 3.9 MB/s | 24 MB 00:06 2023-11-15T01:19:05.978 INFO:teuthology.orchestra.run.smithi001.stdout:(10/120): ceph-radosgw-16.2.14-170.g620f25c1.el 9.1 MB/s | 12 MB 00:01 2023-11-15T01:19:06.046 INFO:teuthology.orchestra.run.smithi001.stdout:(11/120): cephfs-mirror-16.2.14-170.g620f25c1.e 3.7 MB/s | 257 kB 00:00 2023-11-15T01:19:06.105 INFO:teuthology.orchestra.run.smithi001.stdout:(12/120): libcephfs-devel-16.2.14-170.g620f25c1 443 kB/s | 25 kB 00:00 2023-11-15T01:19:06.242 INFO:teuthology.orchestra.run.smithi001.stdout:(13/120): libcephfs2-16.2.14-170.g620f25c1.el8. 5.8 MB/s | 824 kB 00:00 2023-11-15T01:19:06.298 INFO:teuthology.orchestra.run.smithi001.stdout:(14/120): libcephsqlite-16.2.14-170.g620f25c1.e 3.0 MB/s | 174 kB 00:00 2023-11-15T01:19:06.325 INFO:teuthology.orchestra.run.smithi141.stdout:(7/120): ceph-mgr-16.2.14-170.g620f25c1.el8.x86 1.0 MB/s | 1.6 MB 00:01 2023-11-15T01:19:06.352 INFO:teuthology.orchestra.run.smithi001.stdout:(15/120): librados-devel-16.2.14-170.g620f25c1. 2.4 MB/s | 131 kB 00:00 2023-11-15T01:19:06.405 INFO:teuthology.orchestra.run.smithi001.stdout:(16/120): libradosstriper1-16.2.14-170.g620f25c 9.1 MB/s | 493 kB 00:00 2023-11-15T01:19:06.853 INFO:teuthology.orchestra.run.smithi001.stdout:(17/120): librgw2-16.2.14-170.g620f25c1.el8.x86 8.5 MB/s | 3.8 MB 00:00 2023-11-15T01:19:06.900 INFO:teuthology.orchestra.run.smithi001.stdout:(18/120): python3-ceph-argparse-16.2.14-170.g62 974 kB/s | 45 kB 00:00 2023-11-15T01:19:06.942 INFO:teuthology.orchestra.run.smithi001.stdout:(19/120): python3-ceph-common-16.2.14-170.g620f 2.3 MB/s | 99 kB 00:00 2023-11-15T01:19:06.983 INFO:teuthology.orchestra.run.smithi001.stdout:(20/120): python3-cephfs-16.2.14-170.g620f25c1. 5.2 MB/s | 215 kB 00:00 2023-11-15T01:19:07.047 INFO:teuthology.orchestra.run.smithi001.stdout:(21/120): python3-rados-16.2.14-170.g620f25c1.e 5.9 MB/s | 390 kB 00:00 2023-11-15T01:19:07.113 INFO:teuthology.orchestra.run.smithi001.stdout:(22/120): python3-rbd-16.2.14-170.g620f25c1.el8 5.5 MB/s | 369 kB 00:00 2023-11-15T01:19:07.166 INFO:teuthology.orchestra.run.smithi001.stdout:(23/120): python3-rgw-16.2.14-170.g620f25c1.el8 2.1 MB/s | 114 kB 00:00 2023-11-15T01:19:07.221 INFO:teuthology.orchestra.run.smithi001.stdout:(24/120): rbd-fuse-16.2.14-170.g620f25c1.el8.x8 1.6 MB/s | 88 kB 00:00 2023-11-15T01:19:07.664 INFO:teuthology.orchestra.run.smithi001.stdout:(25/120): rbd-mirror-16.2.14-170.g620f25c1.el8. 8.3 MB/s | 3.7 MB 00:00 2023-11-15T01:19:07.722 INFO:teuthology.orchestra.run.smithi001.stdout:(26/120): rbd-nbd-16.2.14-170.g620f25c1.el8.x86 3.0 MB/s | 175 kB 00:00 2023-11-15T01:19:07.763 INFO:teuthology.orchestra.run.smithi001.stdout:(27/120): ceph-grafana-dashboards-16.2.14-170.g 592 kB/s | 24 kB 00:00 2023-11-15T01:19:07.799 INFO:teuthology.orchestra.run.smithi001.stdout:(28/120): ceph-mgr-cephadm-16.2.14-170.g620f25c 3.2 MB/s | 116 kB 00:00 2023-11-15T01:19:08.163 INFO:teuthology.orchestra.run.smithi001.stdout:(29/120): ceph-mgr-dashboard-16.2.14-170.g620f2 8.6 MB/s | 3.1 MB 00:00 2023-11-15T01:19:08.353 INFO:teuthology.orchestra.run.smithi141.stdout:(8/120): ceph-mon-16.2.14-170.g620f25c1.el8.x86 1.6 MB/s | 5.0 MB 00:03 2023-11-15T01:19:08.419 INFO:teuthology.orchestra.run.smithi141.stdout:(9/120): ceph-selinux-16.2.14-170.g620f25c1.el8 391 kB/s | 26 kB 00:00 2023-11-15T01:19:09.362 INFO:teuthology.orchestra.run.smithi001.stdout:(30/120): ceph-mgr-diskprediction-local-16.2.14 7.2 MB/s | 8.6 MB 00:01 2023-11-15T01:19:09.398 INFO:teuthology.orchestra.run.smithi001.stdout:(31/120): ceph-mgr-modules-core-16.2.14-170.g62 6.8 MB/s | 245 kB 00:00 2023-11-15T01:19:09.431 INFO:teuthology.orchestra.run.smithi001.stdout:(32/120): ceph-mgr-rook-16.2.14-170.g620f25c1.e 825 kB/s | 27 kB 00:00 2023-11-15T01:19:09.456 INFO:teuthology.orchestra.run.smithi001.stdout:(33/120): ceph-prometheus-alerts-16.2.14-170.g6 597 kB/s | 15 kB 00:00 2023-11-15T01:19:09.487 INFO:teuthology.orchestra.run.smithi001.stdout:(34/120): cephadm-16.2.14-170.g620f25c1.el8.noa 2.8 MB/s | 85 kB 00:00 2023-11-15T01:19:09.518 INFO:teuthology.orchestra.run.smithi001.stdout:(35/120): cephfs-top-16.2.14-170.g620f25c1.el8. 601 kB/s | 19 kB 00:00 2023-11-15T01:19:09.628 INFO:teuthology.orchestra.run.smithi001.stdout:(36/120): gperftools-libs-2.7-9.el8.x86_64.rpm 2.7 MB/s | 306 kB 00:00 2023-11-15T01:19:09.650 INFO:teuthology.orchestra.run.smithi001.stdout:(37/120): leveldb-1.22-1.el8.x86_64.rpm 8.0 MB/s | 181 kB 00:00 2023-11-15T01:19:09.669 INFO:teuthology.orchestra.run.smithi001.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 3.1 MB/s | 59 kB 00:00 2023-11-15T01:19:09.687 INFO:teuthology.orchestra.run.smithi001.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 4.0 MB/s | 75 kB 00:00 2023-11-15T01:19:09.708 INFO:teuthology.orchestra.run.smithi001.stdout:(40/120): python3-apipkg-1.5-6.el8.noarch.rpm 1.0 MB/s | 21 kB 00:00 2023-11-15T01:19:09.727 INFO:teuthology.orchestra.run.smithi001.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.2 MB/s | 44 kB 00:00 2023-11-15T01:19:09.751 INFO:teuthology.orchestra.run.smithi001.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 7.9 MB/s | 185 kB 00:00 2023-11-15T01:19:09.771 INFO:teuthology.orchestra.run.smithi001.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.7 MB/s | 33 kB 00:00 2023-11-15T01:19:09.790 INFO:teuthology.orchestra.run.smithi001.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 843 kB/s | 16 kB 00:00 2023-11-15T01:19:09.813 INFO:teuthology.orchestra.run.smithi001.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 7.6 MB/s | 173 kB 00:00 2023-11-15T01:19:09.840 INFO:teuthology.orchestra.run.smithi001.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 14 MB/s | 384 kB 00:00 2023-11-15T01:19:09.865 INFO:teuthology.orchestra.run.smithi001.stdout:(47/120): python3-execnet-1.7.1-1.el8.noarch.rp 15 MB/s | 355 kB 00:00 2023-11-15T01:19:09.885 INFO:teuthology.orchestra.run.smithi001.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 4.0 MB/s | 81 kB 00:00 2023-11-15T01:19:09.904 INFO:teuthology.orchestra.run.smithi001.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 578 kB/s | 11 kB 00:00 2023-11-15T01:19:09.924 INFO:teuthology.orchestra.run.smithi001.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 903 kB/s | 18 kB 00:00 2023-11-15T01:19:09.973 INFO:teuthology.orchestra.run.smithi001.stdout:(51/120): python3-kubernetes-11.0.0-6.el8.noarc 24 MB/s | 1.2 MB 00:00 2023-11-15T01:19:09.993 INFO:teuthology.orchestra.run.smithi001.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 2.4 MB/s | 49 kB 00:00 2023-11-15T01:19:10.013 INFO:teuthology.orchestra.run.smithi001.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 2.9 MB/s | 59 kB 00:00 2023-11-15T01:19:10.037 INFO:teuthology.orchestra.run.smithi001.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 12 MB/s | 283 kB 00:00 2023-11-15T01:19:10.056 INFO:teuthology.orchestra.run.smithi001.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 814 kB/s | 16 kB 00:00 2023-11-15T01:19:10.076 INFO:teuthology.orchestra.run.smithi001.stdout:(56/120): python3-remoto-1.2.1-1.el8.noarch.rpm 2.4 MB/s | 49 kB 00:00 2023-11-15T01:19:10.096 INFO:teuthology.orchestra.run.smithi001.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.7 MB/s | 34 kB 00:00 2023-11-15T01:19:10.118 INFO:teuthology.orchestra.run.smithi001.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 8.9 MB/s | 196 kB 00:00 2023-11-15T01:19:10.138 INFO:teuthology.orchestra.run.smithi001.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 3.1 MB/s | 64 kB 00:00 2023-11-15T01:19:10.158 INFO:teuthology.orchestra.run.smithi001.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 958 kB/s | 19 kB 00:00 2023-11-15T01:19:10.177 INFO:teuthology.orchestra.run.smithi001.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 1.2 MB/s | 24 kB 00:00 2023-11-15T01:19:10.197 INFO:teuthology.orchestra.run.smithi001.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 1.5 MB/s | 29 kB 00:00 2023-11-15T01:19:10.217 INFO:teuthology.orchestra.run.smithi001.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 1.4 MB/s | 27 kB 00:00 2023-11-15T01:19:10.240 INFO:teuthology.orchestra.run.smithi001.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 11 MB/s | 255 kB 00:00 2023-11-15T01:19:10.262 INFO:teuthology.orchestra.run.smithi001.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 11 MB/s | 251 kB 00:00 2023-11-15T01:19:10.282 INFO:teuthology.orchestra.run.smithi001.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 3.0 MB/s | 61 kB 00:00 2023-11-15T01:19:10.303 INFO:teuthology.orchestra.run.smithi001.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 4.1 MB/s | 85 kB 00:00 2023-11-15T01:19:10.322 INFO:teuthology.orchestra.run.smithi001.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 1.2 MB/s | 23 kB 00:00 2023-11-15T01:19:10.326 INFO:teuthology.orchestra.run.smithi001.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 19 MB/s | 70 kB 00:00 2023-11-15T01:19:10.433 INFO:teuthology.orchestra.run.smithi141.stdout:(10/120): ceph-osd-16.2.14-170.g620f25c1.el8.x8 3.9 MB/s | 18 MB 00:04 2023-11-15T01:19:10.475 INFO:teuthology.orchestra.run.smithi141.stdout:(11/120): cephfs-mirror-16.2.14-170.g620f25c1.e 5.9 MB/s | 257 kB 00:00 2023-11-15T01:19:10.512 INFO:teuthology.orchestra.run.smithi141.stdout:(12/120): libcephfs-devel-16.2.14-170.g620f25c1 697 kB/s | 25 kB 00:00 2023-11-15T01:19:10.633 INFO:teuthology.orchestra.run.smithi141.stdout:(13/120): libcephfs2-16.2.14-170.g620f25c1.el8. 6.7 MB/s | 824 kB 00:00 2023-11-15T01:19:10.665 INFO:teuthology.orchestra.run.smithi141.stdout:(14/120): ceph-radosgw-16.2.14-170.g620f25c1.el 2.7 MB/s | 12 MB 00:04 2023-11-15T01:19:10.672 INFO:teuthology.orchestra.run.smithi141.stdout:(15/120): libcephsqlite-16.2.14-170.g620f25c1.e 4.3 MB/s | 174 kB 00:00 2023-11-15T01:19:10.687 INFO:teuthology.orchestra.run.smithi141.stdout:(16/120): librados-devel-16.2.14-170.g620f25c1. 5.9 MB/s | 131 kB 00:00 2023-11-15T01:19:10.732 INFO:teuthology.orchestra.run.smithi001.stdout:(70/120): python3-scipy-1.0.0-20.module+el8.1.0 36 MB/s | 15 MB 00:00 2023-11-15T01:19:10.749 INFO:teuthology.orchestra.run.smithi001.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 2.6 MB/s | 44 kB 00:00 2023-11-15T01:19:10.752 INFO:teuthology.orchestra.run.smithi141.stdout:(17/120): libradosstriper1-16.2.14-170.g620f25c 6.0 MB/s | 493 kB 00:00 2023-11-15T01:19:10.764 INFO:teuthology.orchestra.run.smithi001.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.7 MB/s | 27 kB 00:00 2023-11-15T01:19:10.779 INFO:teuthology.orchestra.run.smithi001.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 11 MB/s | 161 kB 00:00 2023-11-15T01:19:10.791 INFO:teuthology.orchestra.run.smithi141.stdout:(18/120): python3-ceph-argparse-16.2.14-170.g62 1.1 MB/s | 45 kB 00:00 2023-11-15T01:19:10.797 INFO:teuthology.orchestra.run.smithi001.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 18 MB/s | 320 kB 00:00 2023-11-15T01:19:10.816 INFO:teuthology.orchestra.run.smithi001.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 23 MB/s | 457 kB 00:00 2023-11-15T01:19:10.830 INFO:teuthology.orchestra.run.smithi141.stdout:(19/120): python3-ceph-common-16.2.14-170.g620f 2.5 MB/s | 99 kB 00:00 2023-11-15T01:19:10.878 INFO:teuthology.orchestra.run.smithi141.stdout:(20/120): python3-cephfs-16.2.14-170.g620f25c1. 4.4 MB/s | 215 kB 00:00 2023-11-15T01:19:10.890 INFO:teuthology.orchestra.run.smithi001.stdout:(76/120): python3-babel-2.5.1-5.el8.noarch.rpm 65 MB/s | 4.8 MB 00:00 2023-11-15T01:19:10.904 INFO:teuthology.orchestra.run.smithi001.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.8 MB/s | 39 kB 00:00 2023-11-15T01:19:10.924 INFO:teuthology.orchestra.run.smithi001.stdout:(78/120): bison-3.0.4-10.el8.x86_64.rpm 34 MB/s | 688 kB 00:00 2023-11-15T01:19:10.940 INFO:teuthology.orchestra.run.smithi001.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 16 MB/s | 259 kB 00:00 2023-11-15T01:19:10.954 INFO:teuthology.orchestra.run.smithi001.stdout:(80/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 15 MB/s | 225 kB 00:00 2023-11-15T01:19:10.961 INFO:teuthology.orchestra.run.smithi141.stdout:(21/120): python3-rados-16.2.14-170.g620f25c1.e 4.6 MB/s | 390 kB 00:00 2023-11-15T01:19:10.967 INFO:teuthology.orchestra.run.smithi001.stdout:(81/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 9.8 MB/s | 126 kB 00:00 2023-11-15T01:19:11.026 INFO:teuthology.orchestra.run.smithi001.stdout:(82/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 64 MB/s | 3.7 MB 00:00 2023-11-15T01:19:11.040 INFO:teuthology.orchestra.run.smithi001.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 13 MB/s | 187 kB 00:00 2023-11-15T01:19:11.044 INFO:teuthology.orchestra.run.smithi141.stdout:(22/120): python3-rbd-16.2.14-170.g620f25c1.el8 4.4 MB/s | 369 kB 00:00 2023-11-15T01:19:11.058 INFO:teuthology.orchestra.run.smithi001.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 30 MB/s | 538 kB 00:00 2023-11-15T01:19:11.074 INFO:teuthology.orchestra.run.smithi001.stdout:(85/120): socat-1.7.3.3-2.el8.x86_64.rpm 19 MB/s | 302 kB 00:00 2023-11-15T01:19:11.086 INFO:teuthology.orchestra.run.smithi141.stdout:(23/120): python3-rgw-16.2.14-170.g620f25c1.el8 2.7 MB/s | 114 kB 00:00 2023-11-15T01:19:11.087 INFO:teuthology.orchestra.run.smithi001.stdout:(86/120): python3-mako-1.0.6-13.el8.noarch.rpm 12 MB/s | 157 kB 00:00 2023-11-15T01:19:11.100 INFO:teuthology.orchestra.run.smithi001.stdout:(87/120): python3-pyasn1-modules-0.3.7-6.el8.no 8.8 MB/s | 110 kB 00:00 2023-11-15T01:19:11.115 INFO:teuthology.orchestra.run.smithi001.stdout:(88/120): librdkafka-0.11.4-1.el8.x86_64.rpm 23 MB/s | 353 kB 00:00 2023-11-15T01:19:11.128 INFO:teuthology.orchestra.run.smithi001.stdout:(89/120): python3-jsonpointer-1.10-11.el8.noarc 1.6 MB/s | 20 kB 00:00 2023-11-15T01:19:11.129 INFO:teuthology.orchestra.run.smithi141.stdout:(24/120): rbd-fuse-16.2.14-170.g620f25c1.el8.x8 2.0 MB/s | 88 kB 00:00 2023-11-15T01:19:11.148 INFO:teuthology.orchestra.run.smithi001.stdout:(90/120): libtool-2.4.6-25.el8.x86_64.rpm 36 MB/s | 709 kB 00:00 2023-11-15T01:19:11.159 INFO:teuthology.orchestra.run.smithi001.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.6 MB/s | 54 kB 00:00 2023-11-15T01:19:11.230 INFO:teuthology.orchestra.run.smithi001.stdout:(92/120): openblas-threads-0.3.12-1.el8.x86_64. 68 MB/s | 4.7 MB 00:00 2023-11-15T01:19:11.238 INFO:teuthology.orchestra.run.smithi141.stdout:(25/120): librgw2-16.2.14-170.g620f25c1.el8.x86 6.9 MB/s | 3.8 MB 00:00 2023-11-15T01:19:11.283 INFO:teuthology.orchestra.run.smithi141.stdout:(26/120): rbd-nbd-16.2.14-170.g620f25c1.el8.x86 3.8 MB/s | 175 kB 00:00 2023-11-15T01:19:11.299 INFO:teuthology.orchestra.run.smithi001.stdout:(93/120): openblas-0.3.12-1.el8.x86_64.rpm 67 MB/s | 4.6 MB 00:00 2023-11-15T01:19:11.304 INFO:teuthology.orchestra.run.smithi141.stdout:(27/120): ceph-grafana-dashboards-16.2.14-170.g 1.1 MB/s | 24 kB 00:00 2023-11-15T01:19:11.320 INFO:teuthology.orchestra.run.smithi001.stdout:(94/120): automake-1.16.1-7.el8.noarch.rpm 34 MB/s | 713 kB 00:00 2023-11-15T01:19:11.329 INFO:teuthology.orchestra.run.smithi141.stdout:(28/120): ceph-mgr-cephadm-16.2.14-170.g620f25c 4.6 MB/s | 116 kB 00:00 2023-11-15T01:19:11.331 INFO:teuthology.orchestra.run.smithi001.stdout:(95/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.6 MB/s | 19 kB 00:00 2023-11-15T01:19:11.343 INFO:teuthology.orchestra.run.smithi001.stdout:(96/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.7 MB/s | 43 kB 00:00 2023-11-15T01:19:11.356 INFO:teuthology.orchestra.run.smithi001.stdout:(97/120): python3-oauthlib-2.1.0-1.el8.noarch.r 12 MB/s | 155 kB 00:00 2023-11-15T01:19:11.370 INFO:teuthology.orchestra.run.smithi001.stdout:(98/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 15 MB/s | 220 kB 00:00 2023-11-15T01:19:11.382 INFO:teuthology.orchestra.run.smithi001.stdout:(99/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.8 MB/s | 48 kB 00:00 2023-11-15T01:19:11.396 INFO:teuthology.orchestra.run.smithi001.stdout:(100/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 17 MB/s | 229 kB 00:00 2023-11-15T01:19:11.409 INFO:teuthology.orchestra.run.smithi001.stdout:(101/120): python3-requests-oauthlib-1.0.0-1.el 3.3 MB/s | 43 kB 00:00 2023-11-15T01:19:11.449 INFO:teuthology.orchestra.run.smithi001.stdout:(102/120): openssl-devel-1.1.1g-15.el8_3.x86_64 59 MB/s | 2.3 MB 00:00 2023-11-15T01:19:11.460 INFO:teuthology.orchestra.run.smithi001.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.5 MB/s | 18 kB 00:00 2023-11-15T01:19:11.479 INFO:teuthology.orchestra.run.smithi001.stdout:(104/120): pcre2-devel-10.32-2.el8.x86_64.rpm 32 MB/s | 605 kB 00:00 2023-11-15T01:19:11.492 INFO:teuthology.orchestra.run.smithi001.stdout:(105/120): fuse-2.9.7-12.el8.x86_64.rpm 6.3 MB/s | 83 kB 00:00 2023-11-15T01:19:11.505 INFO:teuthology.orchestra.run.smithi001.stdout:(106/120): elfutils-libelf-devel-0.182-3.el8.x8 4.5 MB/s | 59 kB 00:00 2023-11-15T01:19:11.518 INFO:teuthology.orchestra.run.smithi001.stdout:(107/120): libquadmath-8.4.1-1.el8.x86_64.rpm 13 MB/s | 169 kB 00:00 2023-11-15T01:19:11.529 INFO:teuthology.orchestra.run.smithi001.stdout:(108/120): libcom_err-devel-1.45.6-1.el8.x86_64 3.3 MB/s | 38 kB 00:00 2023-11-15T01:19:11.541 INFO:teuthology.orchestra.run.smithi001.stdout:(109/120): libsepol-devel-2.9-2.el8.x86_64.rpm 7.2 MB/s | 86 kB 00:00 2023-11-15T01:19:11.553 INFO:teuthology.orchestra.run.smithi001.stdout:(110/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.8 MB/s | 58 kB 00:00 2023-11-15T01:19:11.566 INFO:teuthology.orchestra.run.smithi001.stdout:(111/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.7 MB/s | 47 kB 00:00 2023-11-15T01:19:11.584 INFO:teuthology.orchestra.run.smithi001.stdout:(112/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 31 MB/s | 559 kB 00:00 2023-11-15T01:19:11.603 INFO:teuthology.orchestra.run.smithi001.stdout:(113/120): libgfortran-8.4.1-1.el8.x86_64.rpm 33 MB/s | 639 kB 00:00 2023-11-15T01:19:11.615 INFO:teuthology.orchestra.run.smithi001.stdout:(114/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 5.5 MB/s | 70 kB 00:00 2023-11-15T01:19:11.629 INFO:teuthology.orchestra.run.smithi001.stdout:(115/120): libselinux-devel-2.9-5.el8.x86_64.rp 15 MB/s | 200 kB 00:00 2023-11-15T01:19:11.641 INFO:teuthology.orchestra.run.smithi001.stdout:(116/120): libuuid-devel-2.32.1-27.el8.x86_64.r 7.8 MB/s | 97 kB 00:00 2023-11-15T01:19:11.647 INFO:teuthology.orchestra.run.smithi141.stdout:(29/120): rbd-mirror-16.2.14-170.g620f25c1.el8. 7.1 MB/s | 3.7 MB 00:00 2023-11-15T01:19:11.901 INFO:teuthology.orchestra.run.smithi141.stdout:(30/120): ceph-mgr-dashboard-16.2.14-170.g620f2 5.5 MB/s | 3.1 MB 00:00 2023-11-15T01:19:11.992 INFO:teuthology.orchestra.run.smithi141.stdout:(31/120): ceph-mgr-modules-core-16.2.14-170.g62 2.6 MB/s | 245 kB 00:00 2023-11-15T01:19:12.035 INFO:teuthology.orchestra.run.smithi141.stdout:(32/120): ceph-mgr-rook-16.2.14-170.g620f25c1.e 643 kB/s | 27 kB 00:00 2023-11-15T01:19:12.077 INFO:teuthology.orchestra.run.smithi141.stdout:(33/120): ceph-prometheus-alerts-16.2.14-170.g6 351 kB/s | 15 kB 00:00 2023-11-15T01:19:12.114 INFO:teuthology.orchestra.run.smithi001.stdout:(117/120): librados2-16.2.14-170.g620f25c1.el8. 7.9 MB/s | 3.7 MB 00:00 2023-11-15T01:19:12.122 INFO:teuthology.orchestra.run.smithi141.stdout:(34/120): cephadm-16.2.14-170.g620f25c1.el8.noa 1.9 MB/s | 85 kB 00:00 2023-11-15T01:19:12.166 INFO:teuthology.orchestra.run.smithi141.stdout:(35/120): cephfs-top-16.2.14-170.g620f25c1.el8. 417 kB/s | 19 kB 00:00 2023-11-15T01:19:12.500 INFO:teuthology.orchestra.run.smithi001.stdout:(118/120): librbd1-16.2.14-170.g620f25c1.el8.x8 11 MB/s | 4.2 MB 00:00 2023-11-15T01:19:12.723 INFO:teuthology.orchestra.run.smithi001.stdout:(119/120): ceph-osd-16.2.14-170.g620f25c1.el8.x 2.2 MB/s | 18 MB 00:08 2023-11-15T01:19:12.927 INFO:teuthology.orchestra.run.smithi141.stdout:(36/120): ceph-mgr-diskprediction-local-16.2.14 6.7 MB/s | 8.6 MB 00:01 2023-11-15T01:19:12.929 INFO:teuthology.orchestra.run.smithi141.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 402 kB/s | 306 kB 00:00 2023-11-15T01:19:13.014 INFO:teuthology.orchestra.run.smithi141.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 697 kB/s | 59 kB 00:00 2023-11-15T01:19:13.098 INFO:teuthology.orchestra.run.smithi141.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 892 kB/s | 75 kB 00:00 2023-11-15T01:19:13.179 INFO:teuthology.orchestra.run.smithi141.stdout:(40/120): python3-apipkg-1.5-6.el8.noarch.rpm 260 kB/s | 21 kB 00:00 2023-11-15T01:19:13.270 INFO:teuthology.orchestra.run.smithi141.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 485 kB/s | 44 kB 00:00 2023-11-15T01:19:13.509 INFO:teuthology.orchestra.run.smithi141.stdout:(42/120): leveldb-1.22-1.el8.x86_64.rpm 311 kB/s | 181 kB 00:00 2023-11-15T01:19:13.513 INFO:teuthology.orchestra.run.smithi141.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 761 kB/s | 185 kB 00:00 2023-11-15T01:19:13.596 INFO:teuthology.orchestra.run.smithi141.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 380 kB/s | 33 kB 00:00 2023-11-15T01:19:13.596 INFO:teuthology.orchestra.run.smithi141.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 196 kB/s | 16 kB 00:00 2023-11-15T01:19:13.884 INFO:teuthology.orchestra.run.smithi141.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 599 kB/s | 173 kB 00:00 2023-11-15T01:19:14.197 INFO:teuthology.orchestra.run.smithi141.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 641 kB/s | 384 kB 00:00 2023-11-15T01:19:14.402 INFO:teuthology.orchestra.run.smithi141.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 397 kB/s | 81 kB 00:00 2023-11-15T01:19:14.467 INFO:teuthology.orchestra.run.smithi141.stdout:(49/120): python3-execnet-1.7.1-1.el8.noarch.rp 610 kB/s | 355 kB 00:00 2023-11-15T01:19:14.492 INFO:teuthology.orchestra.run.smithi141.stdout:(50/120): python3-jaraco-6.2-6.el8.noarch.rpm 123 kB/s | 11 kB 00:00 2023-11-15T01:19:14.564 INFO:teuthology.orchestra.run.smithi141.stdout:(51/120): python3-jaraco-functools-2.0-4.el8.no 182 kB/s | 18 kB 00:00 2023-11-15T01:19:14.645 INFO:teuthology.orchestra.run.smithi141.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 605 kB/s | 49 kB 00:00 2023-11-15T01:19:14.725 INFO:teuthology.orchestra.run.smithi141.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 730 kB/s | 59 kB 00:00 2023-11-15T01:19:15.282 INFO:teuthology.orchestra.run.smithi141.stdout:(54/120): ceph-test-16.2.14-170.g620f25c1.el8.x 7.5 MB/s | 52 MB 00:06 2023-11-15T01:19:15.284 INFO:teuthology.orchestra.run.smithi141.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 506 kB/s | 283 kB 00:00 2023-11-15T01:19:15.390 INFO:teuthology.orchestra.run.smithi141.stdout:(56/120): python3-remoto-1.2.1-1.el8.noarch.rpm 461 kB/s | 49 kB 00:00 2023-11-15T01:19:15.471 INFO:teuthology.orchestra.run.smithi141.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 419 kB/s | 34 kB 00:00 2023-11-15T01:19:15.711 INFO:teuthology.orchestra.run.smithi141.stdout:(58/120): python3-portend-2.6-1.el8.noarch.rpm 36 kB/s | 16 kB 00:00 2023-11-15T01:19:15.713 INFO:teuthology.orchestra.run.smithi141.stdout:(59/120): python3-routes-2.4.1-12.el8.noarch.rp 809 kB/s | 196 kB 00:00 2023-11-15T01:19:15.796 INFO:teuthology.orchestra.run.smithi141.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 226 kB/s | 19 kB 00:00 2023-11-15T01:19:15.874 INFO:teuthology.orchestra.run.smithi141.stdout:(61/120): python3-rsa-4.9-2.el8.noarch.rpm 393 kB/s | 64 kB 00:00 2023-11-15T01:19:15.876 INFO:teuthology.orchestra.run.smithi141.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 300 kB/s | 24 kB 00:00 2023-11-15T01:19:15.955 INFO:teuthology.orchestra.run.smithi141.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 360 kB/s | 29 kB 00:00 2023-11-15T01:19:15.964 INFO:teuthology.orchestra.run.smithi141.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 314 kB/s | 27 kB 00:00 2023-11-15T01:19:15.984 INFO:teuthology.orchestra.run.smithi001.stdout:(120/120): ceph-test-16.2.14-170.g620f25c1.el8. 4.8 MB/s | 52 MB 00:10 2023-11-15T01:19:15.988 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2023-11-15T01:19:15.989 INFO:teuthology.orchestra.run.smithi001.stdout:Total 13 MB/s | 201 MB 00:15 2023-11-15T01:19:16.046 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2023-11-15T01:19:16.100 INFO:teuthology.orchestra.run.smithi141.stdout:(65/120): python3-kubernetes-11.0.0-6.el8.noarc 742 kB/s | 1.2 MB 00:01 2023-11-15T01:19:16.171 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2023-11-15T01:19:16.171 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2023-11-15T01:19:16.192 INFO:teuthology.orchestra.run.smithi141.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 672 kB/s | 61 kB 00:00 2023-11-15T01:19:16.278 INFO:teuthology.orchestra.run.smithi141.stdout:(67/120): python3-waitress-1.4.3-1.el8.noarch.r 792 kB/s | 255 kB 00:00 2023-11-15T01:19:16.282 INFO:teuthology.orchestra.run.smithi141.stdout:(68/120): python3-webob-1.8.5-1.el8.1.noarch.rp 790 kB/s | 251 kB 00:00 2023-11-15T01:19:16.287 INFO:teuthology.orchestra.run.smithi141.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-11-15T01:19:16.318 INFO:teuthology.orchestra.run.smithi141.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 608 kB/s | 19 kB 00:00 2023-11-15T01:19:16.334 INFO:teuthology.orchestra.run.smithi141.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.7 MB/s | 43 kB 00:00 2023-11-15T01:19:16.350 INFO:teuthology.orchestra.run.smithi141.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 9.4 MB/s | 155 kB 00:00 2023-11-15T01:19:16.352 INFO:teuthology.orchestra.run.smithi141.stdout:(73/120): python3-webtest-2.0.33-1.el8.noarch.r 532 kB/s | 85 kB 00:00 2023-11-15T01:19:16.359 INFO:teuthology.orchestra.run.smithi141.stdout:(74/120): python3-zc-lockfile-2.0-2.el8.noarch. 284 kB/s | 23 kB 00:00 2023-11-15T01:19:16.375 INFO:teuthology.orchestra.run.smithi141.stdout:(75/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.7 MB/s | 220 kB 00:00 2023-11-15T01:19:16.382 INFO:teuthology.orchestra.run.smithi141.stdout:(76/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.6 MB/s | 48 kB 00:00 2023-11-15T01:19:16.391 INFO:teuthology.orchestra.run.smithi141.stdout:(77/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 7.0 MB/s | 229 kB 00:00 2023-11-15T01:19:16.392 INFO:teuthology.orchestra.run.smithi141.stdout:(78/120): python3-requests-oauthlib-1.0.0-1.el8 2.5 MB/s | 43 kB 00:00 2023-11-15T01:19:16.405 INFO:teuthology.orchestra.run.smithi141.stdout:(79/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.3 MB/s | 18 kB 00:00 2023-11-15T01:19:16.418 INFO:teuthology.orchestra.run.smithi141.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 23 MB/s | 605 kB 00:00 2023-11-15T01:19:16.420 INFO:teuthology.orchestra.run.smithi141.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 5.6 MB/s | 83 kB 00:00 2023-11-15T01:19:16.428 INFO:teuthology.orchestra.run.smithi141.stdout:(82/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 50 MB/s | 2.3 MB 00:00 2023-11-15T01:19:16.432 INFO:teuthology.orchestra.run.smithi141.stdout:(83/120): elfutils-libelf-devel-0.182-3.el8.x86 4.2 MB/s | 59 kB 00:00 2023-11-15T01:19:16.436 INFO:teuthology.orchestra.run.smithi141.stdout:(84/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-11-15T01:19:16.443 INFO:teuthology.orchestra.run.smithi141.stdout:(85/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.5 MB/s | 38 kB 00:00 2023-11-15T01:19:16.446 INFO:teuthology.orchestra.run.smithi141.stdout:(86/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.9 MB/s | 86 kB 00:00 2023-11-15T01:19:16.451 INFO:teuthology.orchestra.run.smithi141.stdout:(87/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.7 MB/s | 58 kB 00:00 2023-11-15T01:19:16.457 INFO:teuthology.orchestra.run.smithi141.stdout:(88/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.4 MB/s | 47 kB 00:00 2023-11-15T01:19:16.466 INFO:teuthology.orchestra.run.smithi141.stdout:(89/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 28 MB/s | 559 kB 00:00 2023-11-15T01:19:16.472 INFO:teuthology.orchestra.run.smithi141.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.6 MB/s | 70 kB 00:00 2023-11-15T01:19:16.474 INFO:teuthology.orchestra.run.smithi141.stdout:(91/120): libgfortran-8.4.1-1.el8.x86_64.rpm 27 MB/s | 639 kB 00:00 2023-11-15T01:19:16.485 INFO:teuthology.orchestra.run.smithi141.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 11 MB/s | 200 kB 00:00 2023-11-15T01:19:16.496 INFO:teuthology.orchestra.run.smithi141.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 4.1 MB/s | 97 kB 00:00 2023-11-15T01:19:16.504 INFO:teuthology.orchestra.run.smithi141.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 2.3 MB/s | 44 kB 00:00 2023-11-15T01:19:16.511 INFO:teuthology.orchestra.run.smithi141.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.7 MB/s | 27 kB 00:00 2023-11-15T01:19:16.519 INFO:teuthology.orchestra.run.smithi141.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 10 MB/s | 161 kB 00:00 2023-11-15T01:19:16.528 INFO:teuthology.orchestra.run.smithi141.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 18 MB/s | 320 kB 00:00 2023-11-15T01:19:16.538 INFO:teuthology.orchestra.run.smithi141.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 24 MB/s | 457 kB 00:00 2023-11-15T01:19:16.551 INFO:teuthology.orchestra.run.smithi141.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.9 MB/s | 39 kB 00:00 2023-11-15T01:19:16.574 INFO:teuthology.orchestra.run.smithi141.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 30 MB/s | 688 kB 00:00 2023-11-15T01:19:16.590 INFO:teuthology.orchestra.run.smithi141.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 16 MB/s | 259 kB 00:00 2023-11-15T01:19:16.613 INFO:teuthology.orchestra.run.smithi141.stdout:(102/120): python3-babel-2.5.1-5.el8.noarch.rpm 57 MB/s | 4.8 MB 00:00 2023-11-15T01:19:16.617 INFO:teuthology.orchestra.run.smithi141.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 8.3 MB/s | 225 kB 00:00 2023-11-15T01:19:16.630 INFO:teuthology.orchestra.run.smithi141.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 7.6 MB/s | 126 kB 00:00 2023-11-15T01:19:16.646 INFO:teuthology.orchestra.run.smithi141.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-11-15T01:19:16.762 INFO:teuthology.orchestra.run.smithi141.stdout:(106/120): python3-scipy-1.0.0-20.module+el8.1. 51 MB/s | 15 MB 00:00 2023-11-15T01:19:16.767 INFO:teuthology.orchestra.run.smithi141.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 4.3 MB/s | 538 kB 00:00 2023-11-15T01:19:16.780 INFO:teuthology.orchestra.run.smithi141.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 17 MB/s | 302 kB 00:00 2023-11-15T01:19:16.790 INFO:teuthology.orchestra.run.smithi141.stdout:(109/120): python3-numpy-1.14.3-9.el8.x86_64.rp 22 MB/s | 3.7 MB 00:00 2023-11-15T01:19:16.792 INFO:teuthology.orchestra.run.smithi141.stdout:(110/120): python3-mako-1.0.6-13.el8.noarch.rpm 6.2 MB/s | 157 kB 00:00 2023-11-15T01:19:16.794 INFO:teuthology.orchestra.run.smithi141.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 8.0 MB/s | 110 kB 00:00 2023-11-15T01:19:16.804 INFO:teuthology.orchestra.run.smithi141.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.7 MB/s | 20 kB 00:00 2023-11-15T01:19:16.808 INFO:teuthology.orchestra.run.smithi141.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 20 MB/s | 353 kB 00:00 2023-11-15T01:19:16.815 INFO:teuthology.orchestra.run.smithi141.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 33 MB/s | 709 kB 00:00 2023-11-15T01:19:16.817 INFO:teuthology.orchestra.run.smithi141.stdout:(115/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.2 MB/s | 54 kB 00:00 2023-11-15T01:19:16.840 INFO:teuthology.orchestra.run.smithi141.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 31 MB/s | 713 kB 00:00 2023-11-15T01:19:16.887 INFO:teuthology.orchestra.run.smithi141.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 60 MB/s | 4.7 MB 00:00 2023-11-15T01:19:16.906 INFO:teuthology.orchestra.run.smithi141.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 50 MB/s | 4.6 MB 00:00 2023-11-15T01:19:17.230 INFO:teuthology.orchestra.run.smithi141.stdout:(119/120): librbd1-16.2.14-170.g620f25c1.el8.x8 12 MB/s | 4.2 MB 00:00 2023-11-15T01:19:17.352 INFO:teuthology.orchestra.run.smithi141.stdout:(120/120): librados2-16.2.14-170.g620f25c1.el8. 7.3 MB/s | 3.7 MB 00:00 2023-11-15T01:19:17.356 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-11-15T01:19:17.357 INFO:teuthology.orchestra.run.smithi141.stdout:Total 11 MB/s | 201 MB 00:18 2023-11-15T01:19:17.404 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-11-15T01:19:17.515 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-11-15T01:19:17.516 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-11-15T01:19:17.821 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2023-11-15T01:19:17.825 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2023-11-15T01:19:19.277 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-11-15T01:19:19.282 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-11-15T01:19:22.722 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2023-11-15T01:19:22.944 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-11-15T01:19:23.144 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/122 2023-11-15T01:19:23.382 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/122 2023-11-15T01:19:23.564 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 4/122 2023-11-15T01:19:23.700 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 4/122 2023-11-15T01:19:23.913 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/122 2023-11-15T01:19:24.025 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-11-15T01:19:24.262 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-11-15T01:19:24.320 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/122 2023-11-15T01:19:24.547 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librados2-2:16.2.14-170.g620f25c1.el8.x86_64 6/122 2023-11-15T01:19:24.986 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:16.2.14-170.g620f25c1.el8.x86_64 6/122 2023-11-15T01:19:25.128 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/122 2023-11-15T01:19:25.172 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librbd1-2:16.2.14-170.g620f25c1.el8.x86_64 7/122 2023-11-15T01:19:25.318 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-11-15T01:19:25.344 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:16.2.14-170.g620f25c1.el8.x86_64 7/122 2023-11-15T01:19:25.484 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-11-15T01:19:25.564 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs2-2:16.2.14-170.g620f25c1.el8.x86_64 8/122 2023-11-15T01:19:25.669 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephfs2-2:16.2.14-170.g620f25c1.el8.x86_64 8/122 2023-11-15T01:19:25.709 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-11-15T01:19:26.094 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-11-15T01:19:26.211 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rados-2:16.2.14-170.g620f25c1.el8.x86_64 9/122 2023-11-15T01:19:26.267 INFO:teuthology.orchestra.run.smithi141.stdout: Upgrading : librados2-2:16.2.14-170.g620f25c1.el8.x86_64 5/122 2023-11-15T01:19:26.405 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librgw2-2:16.2.14-170.g620f25c1.el8.x86_64 10/122 2023-11-15T01:19:26.502 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librgw2-2:16.2.14-170.g620f25c1.el8.x86_64 10/122 2023-11-15T01:19:26.716 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librados2-2:16.2.14-170.g620f25c1.el8.x86_64 5/122 2023-11-15T01:19:26.743 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-11-15T01:19:26.917 INFO:teuthology.orchestra.run.smithi141.stdout: Upgrading : librbd1-2:16.2.14-170.g620f25c1.el8.x86_64 6/122 2023-11-15T01:19:26.920 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-11-15T01:19:27.057 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librbd1-2:16.2.14-170.g620f25c1.el8.x86_64 6/122 2023-11-15T01:19:27.105 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephsqlite-2:16.2.14-170.g620f25c1.el8.x86_64 13/122 2023-11-15T01:19:27.264 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephsqlite-2:16.2.14-170.g620f25c1.el8.x86_64 13/122 2023-11-15T01:19:27.275 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libcephfs2-2:16.2.14-170.g620f25c1.el8.x86_64 7/122 2023-11-15T01:19:27.369 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: libcephfs2-2:16.2.14-170.g620f25c1.el8.x86_64 7/122 2023-11-15T01:19:27.409 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libradosstriper1-2:16.2.14-170.g620f25c1.el8.x86 14/122 2023-11-15T01:19:27.502 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libradosstriper1-2:16.2.14-170.g620f25c1.el8.x86 14/122 2023-11-15T01:19:27.592 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-rados-2:16.2.14-170.g620f25c1.el8.x86_64 8/122 2023-11-15T01:19:27.640 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-11-15T01:19:27.830 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-11-15T01:19:27.972 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-11-15T01:19:28.071 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/122 2023-11-15T01:19:28.163 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-11-15T01:19:28.275 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : librgw2-2:16.2.14-170.g620f25c1.el8.x86_64 10/122 2023-11-15T01:19:28.384 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librgw2-2:16.2.14-170.g620f25c1.el8.x86_64 10/122 2023-11-15T01:19:28.637 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-11-15T01:19:28.779 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-11-15T01:19:28.790 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-11-15T01:19:28.955 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-11-15T01:19:28.992 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libcephsqlite-2:16.2.14-170.g620f25c1.el8.x86_64 13/122 2023-11-15T01:19:29.097 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: libcephsqlite-2:16.2.14-170.g620f25c1.el8.x86_64 13/122 2023-11-15T01:19:29.287 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libradosstriper1-2:16.2.14-170.g620f25c1.el8.x86 14/122 2023-11-15T01:19:29.363 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: libradosstriper1-2:16.2.14-170.g620f25c1.el8.x86 14/122 2023-11-15T01:19:29.526 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-11-15T01:19:29.563 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-11-15T01:19:29.754 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-11-15T01:19:29.822 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-11-15T01:19:30.075 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-11-15T01:19:30.262 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-11-15T01:19:30.442 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-11-15T01:19:30.527 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-11-15T01:19:30.578 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-11-15T01:19:30.758 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-11-15T01:19:31.208 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-11-15T01:19:31.307 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-11-15T01:19:31.425 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-11-15T01:19:31.491 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-11-15T01:19:31.588 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-11-15T01:19:31.867 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-11-15T01:19:32.027 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-11-15T01:19:32.155 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-11-15T01:19:32.233 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-11-15T01:19:32.365 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-11-15T01:19:32.544 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-common-2:16.2.14-170.g620f25c1.el8. 26/122 2023-11-15T01:19:32.674 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-argparse-2:16.2.14-170.g620f25c1.el 27/122 2023-11-15T01:19:32.919 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cephfs-2:16.2.14-170.g620f25c1.el8.x86_6 28/122 2023-11-15T01:19:33.000 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-11-15T01:19:33.286 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-11-15T01:19:33.546 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-11-15T01:19:33.771 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-11-15T01:19:33.972 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-11-15T01:19:33.972 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-ceph-common-2:16.2.14-170.g620f25c1.el8. 26/122 2023-11-15T01:19:34.105 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-ceph-argparse-2:16.2.14-170.g620f25c1.el 27/122 2023-11-15T01:19:34.327 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-11-15T01:19:34.365 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cephfs-2:16.2.14-170.g620f25c1.el8.x86_6 28/122 2023-11-15T01:19:34.605 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-11-15T01:19:34.642 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-11-15T01:19:34.895 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-11-15T01:19:34.906 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-11-15T01:19:35.157 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-11-15T01:19:35.191 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-11-15T01:19:35.437 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-11-15T01:19:37.223 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-11-15T01:19:37.571 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-11-15T01:19:37.636 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-11-15T01:19:37.959 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-11-15T01:19:38.203 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-11-15T01:19:38.424 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-11-15T01:19:38.575 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-11-15T01:19:38.623 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rgw-2:16.2.14-170.g620f25c1.el8.x86_64 38/122 2023-11-15T01:19:38.813 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rbd-2:16.2.14-170.g620f25c1.el8.x86_64 39/122 2023-11-15T01:19:38.911 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-11-15T01:19:39.009 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librados-devel-2:16.2.14-170.g620f25c1.el8.x86_6 40/122 2023-11-15T01:19:39.161 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-11-15T01:19:39.167 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-11-15T01:19:39.325 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-11-15T01:19:39.420 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-11-15T01:19:39.508 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-11-15T01:19:39.644 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-11-15T01:19:39.647 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-11-15T01:19:39.816 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-11-15T01:19:39.824 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-rgw-2:16.2.14-170.g620f25c1.el8.x86_64 38/122 2023-11-15T01:19:40.012 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-rbd-2:16.2.14-170.g620f25c1.el8.x86_64 39/122 2023-11-15T01:19:40.018 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-11-15T01:19:40.174 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-11-15T01:19:40.290 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : librados-devel-2:16.2.14-170.g620f25c1.el8.x86_6 40/122 2023-11-15T01:19:40.505 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-11-15T01:19:40.522 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-11-15T01:19:40.680 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-11-15T01:19:40.777 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-11-15T01:19:40.915 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-11-15T01:19:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-11-15T01:19:41.105 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-11-15T01:19:41.281 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-11-15T01:19:41.348 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-11-15T01:19:41.402 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-11-15T01:19:41.540 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-11-15T01:19:41.610 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-11-15T01:19:41.691 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-11-15T01:19:41.819 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-11-15T01:19:41.888 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-11-15T01:19:42.052 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-11-15T01:19:42.068 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-11-15T01:19:42.241 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-11-15T01:19:42.266 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-11-15T01:19:42.411 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-11-15T01:19:42.425 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-11-15T01:19:42.512 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-11-15T01:19:42.560 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-11-15T01:19:42.670 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-11-15T01:19:42.773 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-11-15T01:19:42.878 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-11-15T01:19:42.950 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-11-15T01:19:43.038 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-11-15T01:19:43.186 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-11-15T01:19:43.271 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-11-15T01:19:43.468 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-11-15T01:19:43.552 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-11-15T01:19:43.704 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-11-15T01:19:43.823 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-11-15T01:19:43.917 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-11-15T01:19:44.058 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-11-15T01:19:44.113 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-11-15T01:19:44.232 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-11-15T01:19:44.256 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-11-15T01:19:44.426 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-11-15T01:19:44.452 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-11-15T01:19:44.644 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-11-15T01:19:44.745 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-11-15T01:19:44.840 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 68/122 2023-11-15T01:19:44.997 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-11-15T01:19:45.044 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 69/122 2023-11-15T01:19:45.208 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-11-15T01:19:45.250 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 70/122 2023-11-15T01:19:45.385 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-11-15T01:19:45.450 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 71/122 2023-11-15T01:19:45.541 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-11-15T01:19:45.685 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 72/122 2023-11-15T01:19:45.765 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-11-15T01:19:46.009 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-11-15T01:19:46.017 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-portend-2.6-1.el8.noarch 73/122 2023-11-15T01:19:46.201 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 68/122 2023-11-15T01:19:46.286 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 74/122 2023-11-15T01:19:46.404 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 69/122 2023-11-15T01:19:46.537 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 75/122 2023-11-15T01:19:46.676 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 70/122 2023-11-15T01:19:46.791 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 76/122 2023-11-15T01:19:46.911 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 71/122 2023-11-15T01:19:47.112 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 72/122 2023-11-15T01:19:47.427 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-portend-2.6-1.el8.noarch 73/122 2023-11-15T01:19:47.713 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 74/122 2023-11-15T01:19:47.930 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 75/122 2023-11-15T01:19:48.033 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 77/122 2023-11-15T01:19:48.189 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 76/122 2023-11-15T01:19:48.361 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/122 2023-11-15T01:19:48.614 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 79/122 2023-11-15T01:19:48.940 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/122 2023-11-15T01:19:49.209 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 81/122 2023-11-15T01:19:49.366 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 77/122 2023-11-15T01:19:49.435 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/122 2023-11-15T01:19:49.669 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/122 2023-11-15T01:19:49.682 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/122 2023-11-15T01:19:49.923 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 79/122 2023-11-15T01:19:50.011 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/122 2023-11-15T01:19:50.238 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/122 2023-11-15T01:19:50.241 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/122 2023-11-15T01:19:50.414 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/122 2023-11-15T01:19:50.558 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 81/122 2023-11-15T01:19:50.661 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/122 2023-11-15T01:19:50.778 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/122 2023-11-15T01:19:51.083 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/122 2023-11-15T01:19:51.360 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/122 2023-11-15T01:19:51.554 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/122 2023-11-15T01:19:51.763 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/122 2023-11-15T01:19:51.996 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/122 2023-11-15T01:19:55.923 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:16.2.14-170.g620f25c1.el8.x86_64 88/122 2023-11-15T01:19:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-common-2:16.2.14-170.g620f25c1.el8.x86_64 88/122 2023-11-15T01:19:56.914 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-common-2:16.2.14-170.g620f25c1.el8.x86_64 88/122 2023-11-15T01:19:56.961 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:16.2.14-170.g620f25c1.el8.x86_64 88/122 2023-11-15T01:19:57.154 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-common-2:16.2.14-170.g620f25c1.el8.x86_64 88/122 2023-11-15T01:19:57.432 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-base-2:16.2.14-170.g620f25c1.el8.x86_64 89/122 2023-11-15T01:19:57.531 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-base-2:16.2.14-170.g620f25c1.el8.x86_64 89/122 2023-11-15T01:19:57.718 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-selinux-2:16.2.14-170.g620f25c1.el8.x86_64 90/122 2023-11-15T01:19:57.861 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-common-2:16.2.14-170.g620f25c1.el8.x86_64 88/122 2023-11-15T01:19:58.160 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-base-2:16.2.14-170.g620f25c1.el8.x86_64 89/122 2023-11-15T01:19:58.262 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-base-2:16.2.14-170.g620f25c1.el8.x86_64 89/122 2023-11-15T01:19:58.387 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-selinux-2:16.2.14-170.g620f25c1.el8.x86_64 90/122 2023-11-15T01:20:16.398 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-selinux-2:16.2.14-170.g620f25c1.el8.x86_64 90/122 2023-11-15T01:20:16.398 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /sys 2023-11-15T01:20:16.399 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /proc 2023-11-15T01:20:16.399 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /dev 2023-11-15T01:20:16.399 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /run 2023-11-15T01:20:16.399 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /mnt 2023-11-15T01:20:16.399 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /var/tmp 2023-11-15T01:20:16.400 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /home 2023-11-15T01:20:16.400 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /tmp 2023-11-15T01:20:16.400 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /dev 2023-11-15T01:20:16.400 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:16.401 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-selinux-2:16.2.14-170.g620f25c1.el8.x86_64 90/122 2023-11-15T01:20:16.401 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /sys 2023-11-15T01:20:16.401 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /proc 2023-11-15T01:20:16.401 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /dev 2023-11-15T01:20:16.401 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /run 2023-11-15T01:20:16.401 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /mnt 2023-11-15T01:20:16.402 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /var/tmp 2023-11-15T01:20:16.402 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /home 2023-11-15T01:20:16.402 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /tmp 2023-11-15T01:20:16.402 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /dev 2023-11-15T01:20:16.402 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:16.790 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mds-2:16.2.14-170.g620f25c1.el8.x86_64 91/122 2023-11-15T01:20:16.792 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mds-2:16.2.14-170.g620f25c1.el8.x86_64 91/122 2023-11-15T01:20:17.216 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mds-2:16.2.14-170.g620f25c1.el8.x86_64 91/122 2023-11-15T01:20:17.242 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mds-2:16.2.14-170.g620f25c1.el8.x86_64 91/122 2023-11-15T01:20:17.375 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mon-2:16.2.14-170.g620f25c1.el8.x86_64 92/122 2023-11-15T01:20:17.407 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mon-2:16.2.14-170.g620f25c1.el8.x86_64 92/122 2023-11-15T01:20:18.872 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mon-2:16.2.14-170.g620f25c1.el8.x86_64 92/122 2023-11-15T01:20:19.007 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mon-2:16.2.14-170.g620f25c1.el8.x86_64 92/122 2023-11-15T01:20:19.050 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-osd-2:16.2.14-170.g620f25c1.el8.x86_64 93/122 2023-11-15T01:20:19.070 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-osd-2:16.2.14-170.g620f25c1.el8.x86_64 93/122 2023-11-15T01:20:19.165 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-osd-2:16.2.14-170.g620f25c1.el8.x86_64 93/122 2023-11-15T01:20:19.188 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-osd-2:16.2.14-170.g620f25c1.el8.x86_64 93/122 2023-11-15T01:20:21.983 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: cephadm-2:16.2.14-170.g620f25c1.el8.noarch 94/122 2023-11-15T01:20:22.184 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : cephadm-2:16.2.14-170.g620f25c1.el8.noarch 94/122 2023-11-15T01:20:22.263 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephadm-2:16.2.14-170.g620f25c1.el8.noarch 94/122 2023-11-15T01:20:22.356 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-170.g620f25c1.e 95/122 2023-11-15T01:20:22.442 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephadm-2:16.2.14-170.g620f25c1.el8.noarch 94/122 2023-11-15T01:20:22.559 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-170.g620f25c1. 96/122 2023-11-15T01:20:22.596 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-170.g620f25c1.e 95/122 2023-11-15T01:20:22.716 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-170.g620f25c1.el8.noa 97/122 2023-11-15T01:20:22.785 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-170.g620f25c1. 96/122 2023-11-15T01:20:22.973 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-170.g620f25c1.el8.noa 97/122 2023-11-15T01:20:23.665 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-170.g620f25c1.el8.noa 97/122 2023-11-15T01:20:23.938 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-170.g620f25c1.el8.n 98/122 2023-11-15T01:20:23.992 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-170.g620f25c1.el8.noa 97/122 2023-11-15T01:20:24.266 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-170.g620f25c1.el8.n 98/122 2023-11-15T01:20:24.981 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-170.g620f25c1.el8.n 98/122 2023-11-15T01:20:25.157 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-170.g620 99/122 2023-11-15T01:20:25.251 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-170.g620 99/122 2023-11-15T01:20:25.380 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-170.g620f25c1.el8.n 98/122 2023-11-15T01:20:25.530 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-170.g620 99/122 2023-11-15T01:20:25.615 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-170.g620f25c1.el 100/122 2023-11-15T01:20:25.632 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-170.g620 99/122 2023-11-15T01:20:25.797 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-2:16.2.14-170.g620f25c1.el8.x86_64 101/122 2023-11-15T01:20:25.824 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mgr-2:16.2.14-170.g620f25c1.el8.x86_64 101/122 2023-11-15T01:20:25.982 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-rook-2:16.2.14-170.g620f25c1.el8.noarch 102/122 2023-11-15T01:20:25.993 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-170.g620f25c1.el8.noarch 102/122 2023-11-15T01:20:26.010 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-170.g620f25c1.el 100/122 2023-11-15T01:20:26.204 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-2:16.2.14-170.g620f25c1.el8.x86_64 101/122 2023-11-15T01:20:26.232 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-2:16.2.14-170.g620f25c1.el8.x86_64 101/122 2023-11-15T01:20:26.347 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-rook-2:16.2.14-170.g620f25c1.el8.noarch 102/122 2023-11-15T01:20:26.359 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-170.g620f25c1.el8.noarch 102/122 2023-11-15T01:20:27.054 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-2:16.2.14-170.g620f25c1.el8.x86_64 103/122 2023-11-15T01:20:27.280 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-radosgw-2:16.2.14-170.g620f25c1.el8.x86_64 104/122 2023-11-15T01:20:27.378 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-170.g620f25c1.el8.x86_64 104/122 2023-11-15T01:20:27.503 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-2:16.2.14-170.g620f25c1.el8.x86_64 103/122 2023-11-15T01:20:27.540 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-170.g620f2 105/122 2023-11-15T01:20:27.582 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-170.g620f2 105/122 2023-11-15T01:20:27.703 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-radosgw-2:16.2.14-170.g620f25c1.el8.x86_64 104/122 2023-11-15T01:20:27.715 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : cephfs-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 106/122 2023-11-15T01:20:27.823 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-170.g620f25c1.el8.x86_64 104/122 2023-11-15T01:20:27.964 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-170.g620f2 105/122 2023-11-15T01:20:28.007 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-170.g620f2 105/122 2023-11-15T01:20:28.061 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: cephfs-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 106/122 2023-11-15T01:20:28.139 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 106/122 2023-11-15T01:20:28.240 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : rbd-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 107/122 2023-11-15T01:20:28.506 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephfs-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 106/122 2023-11-15T01:20:28.689 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 107/122 2023-11-15T01:20:32.827 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: rbd-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 107/122 2023-11-15T01:20:33.546 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: rbd-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 107/122 2023-11-15T01:20:33.822 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-test-2:16.2.14-170.g620f25c1.el8.x86_64 108/122 2023-11-15T01:20:33.868 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-test-2:16.2.14-170.g620f25c1.el8.x86_64 108/122 2023-11-15T01:20:34.038 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-11-15T01:20:34.188 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-11-15T01:20:34.385 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-fuse-2:16.2.14-170.g620f25c1.el8.x86_64 110/122 2023-11-15T01:20:34.608 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-11-15T01:20:34.796 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-11-15T01:20:34.804 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-11-15T01:20:34.807 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-11-15T01:20:34.959 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libcephfs-devel-2:16.2.14-170.g620f25c1.el8.x86_ 113/122 2023-11-15T01:20:35.143 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-11-15T01:20:35.187 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-11-15T01:20:35.338 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : cephfs-top-2:16.2.14-170.g620f25c1.el8.noarch 115/122 2023-11-15T01:20:35.512 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : rbd-fuse-2:16.2.14-170.g620f25c1.el8.x86_64 116/122 2023-11-15T01:20:35.520 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-fuse-2:16.2.14-170.g620f25c1.el8.x86_64 111/122 2023-11-15T01:20:35.725 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-11-15T01:20:35.785 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : rbd-nbd-2:16.2.14-170.g620f25c1.el8.x86_64 117/122 2023-11-15T01:20:35.859 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs-devel-2:16.2.14-170.g620f25c1.el8.x86_ 113/122 2023-11-15T01:20:35.996 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-11-15T01:20:36.010 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-11-15T01:20:36.054 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-11-15T01:20:36.188 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-top-2:16.2.14-170.g620f25c1.el8.noarch 115/122 2023-11-15T01:20:36.205 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-11-15T01:20:36.213 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-11-15T01:20:36.347 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-fuse-2:16.2.14-170.g620f25c1.el8.x86_64 116/122 2023-11-15T01:20:36.374 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-11-15T01:20:36.374 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-11-15T01:20:36.506 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-nbd-2:16.2.14-170.g620f25c1.el8.x86_64 117/122 2023-11-15T01:20:36.607 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-11-15T01:20:36.608 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-11-15T01:20:36.709 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-11-15T01:20:36.904 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-11-15T01:20:36.970 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-11-15T01:20:37.162 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-11-15T01:20:37.173 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-11-15T01:20:37.173 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-11-15T01:20:37.391 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-11-15T01:20:37.391 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-11-15T01:20:37.495 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-11-15T01:20:37.495 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-2:16.2.14-170.g620f25c1.el8.x86_64 1/122 2023-11-15T01:20:37.495 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-base-2:16.2.14-170.g620f25c1.el8.x86_64 2/122 2023-11-15T01:20:37.495 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-common-2:16.2.14-170.g620f25c1.el8.x86_64 3/122 2023-11-15T01:20:37.496 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-fuse-2:16.2.14-170.g620f25c1.el8.x86_64 4/122 2023-11-15T01:20:37.496 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-170.g620f2 5/122 2023-11-15T01:20:37.496 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mds-2:16.2.14-170.g620f25c1.el8.x86_64 6/122 2023-11-15T01:20:37.496 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-2:16.2.14-170.g620f25c1.el8.x86_64 7/122 2023-11-15T01:20:37.496 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mon-2:16.2.14-170.g620f25c1.el8.x86_64 8/122 2023-11-15T01:20:37.497 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-osd-2:16.2.14-170.g620f25c1.el8.x86_64 9/122 2023-11-15T01:20:37.497 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-radosgw-2:16.2.14-170.g620f25c1.el8.x86_64 10/122 2023-11-15T01:20:37.497 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-selinux-2:16.2.14-170.g620f25c1.el8.x86_64 11/122 2023-11-15T01:20:37.497 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-test-2:16.2.14-170.g620f25c1.el8.x86_64 12/122 2023-11-15T01:20:37.497 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : cephfs-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 13/122 2023-11-15T01:20:37.498 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libcephfs-devel-2:16.2.14-170.g620f25c1.el8.x86_ 14/122 2023-11-15T01:20:37.498 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libcephfs2-2:16.2.14-170.g620f25c1.el8.x86_64 15/122 2023-11-15T01:20:37.498 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libcephsqlite-2:16.2.14-170.g620f25c1.el8.x86_64 16/122 2023-11-15T01:20:37.498 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librados-devel-2:16.2.14-170.g620f25c1.el8.x86_6 17/122 2023-11-15T01:20:37.498 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libradosstriper1-2:16.2.14-170.g620f25c1.el8.x86 18/122 2023-11-15T01:20:37.498 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librgw2-2:16.2.14-170.g620f25c1.el8.x86_64 19/122 2023-11-15T01:20:37.499 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-ceph-argparse-2:16.2.14-170.g620f25c1.el 20/122 2023-11-15T01:20:37.499 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-ceph-common-2:16.2.14-170.g620f25c1.el8. 21/122 2023-11-15T01:20:37.499 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cephfs-2:16.2.14-170.g620f25c1.el8.x86_6 22/122 2023-11-15T01:20:37.499 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-rados-2:16.2.14-170.g620f25c1.el8.x86_64 23/122 2023-11-15T01:20:37.499 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-rbd-2:16.2.14-170.g620f25c1.el8.x86_64 24/122 2023-11-15T01:20:37.500 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-rgw-2:16.2.14-170.g620f25c1.el8.x86_64 25/122 2023-11-15T01:20:37.500 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : rbd-fuse-2:16.2.14-170.g620f25c1.el8.x86_64 26/122 2023-11-15T01:20:37.500 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : rbd-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 27/122 2023-11-15T01:20:37.508 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : rbd-nbd-2:16.2.14-170.g620f25c1.el8.x86_64 28/122 2023-11-15T01:20:37.508 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-170.g620f25c1. 29/122 2023-11-15T01:20:37.508 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-170.g620f25c1.el8.noa 30/122 2023-11-15T01:20:37.508 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-170.g620f25c1.el8.n 31/122 2023-11-15T01:20:37.509 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-170.g620 32/122 2023-11-15T01:20:37.509 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-170.g620f25c1.el 33/122 2023-11-15T01:20:37.509 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-rook-2:16.2.14-170.g620f25c1.el8.noarch 34/122 2023-11-15T01:20:37.509 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-170.g620f25c1.e 35/122 2023-11-15T01:20:37.509 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : cephadm-2:16.2.14-170.g620f25c1.el8.noarch 36/122 2023-11-15T01:20:37.509 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : cephfs-top-2:16.2.14-170.g620f25c1.el8.noarch 37/122 2023-11-15T01:20:37.510 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/122 2023-11-15T01:20:37.510 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/122 2023-11-15T01:20:37.510 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-11-15T01:20:37.510 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-11-15T01:20:37.510 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/122 2023-11-15T01:20:37.511 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-11-15T01:20:37.511 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-11-15T01:20:37.511 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-11-15T01:20:37.511 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-11-15T01:20:37.511 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-11-15T01:20:37.512 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-11-15T01:20:37.512 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/122 2023-11-15T01:20:37.512 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/122 2023-11-15T01:20:37.512 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/122 2023-11-15T01:20:37.512 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/122 2023-11-15T01:20:37.513 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/122 2023-11-15T01:20:37.513 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/122 2023-11-15T01:20:37.513 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/122 2023-11-15T01:20:37.513 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-11-15T01:20:37.513 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-11-15T01:20:37.513 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/122 2023-11-15T01:20:37.514 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/122 2023-11-15T01:20:37.514 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/122 2023-11-15T01:20:37.514 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/122 2023-11-15T01:20:37.514 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/122 2023-11-15T01:20:37.514 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/122 2023-11-15T01:20:37.515 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/122 2023-11-15T01:20:37.515 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/122 2023-11-15T01:20:37.515 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/122 2023-11-15T01:20:37.515 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/122 2023-11-15T01:20:37.515 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/122 2023-11-15T01:20:37.515 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/122 2023-11-15T01:20:37.516 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/122 2023-11-15T01:20:37.516 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-11-15T01:20:37.516 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-11-15T01:20:37.516 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-11-15T01:20:37.516 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-11-15T01:20:37.517 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-11-15T01:20:37.517 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-11-15T01:20:37.517 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-11-15T01:20:37.517 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-11-15T01:20:37.517 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-11-15T01:20:37.517 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-11-15T01:20:37.518 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-11-15T01:20:37.518 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-11-15T01:20:37.518 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-11-15T01:20:37.518 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-11-15T01:20:37.518 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-11-15T01:20:37.519 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-11-15T01:20:37.519 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-11-15T01:20:37.519 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-11-15T01:20:37.519 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-11-15T01:20:37.519 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-11-15T01:20:37.520 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-11-15T01:20:37.520 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-11-15T01:20:37.520 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-11-15T01:20:37.520 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-11-15T01:20:37.520 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-11-15T01:20:37.520 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-11-15T01:20:37.521 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-11-15T01:20:37.521 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-11-15T01:20:37.521 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-11-15T01:20:37.521 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-11-15T01:20:37.521 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-11-15T01:20:37.522 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-11-15T01:20:37.522 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-11-15T01:20:37.522 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-11-15T01:20:37.522 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-11-15T01:20:37.522 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-11-15T01:20:37.522 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-11-15T01:20:37.523 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-11-15T01:20:37.523 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-11-15T01:20:37.523 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-11-15T01:20:37.523 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-11-15T01:20:37.523 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-11-15T01:20:37.524 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-11-15T01:20:37.524 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-11-15T01:20:37.524 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-11-15T01:20:37.524 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-11-15T01:20:37.524 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-11-15T01:20:37.524 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-11-15T01:20:37.525 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librados2-2:16.2.14-170.g620f25c1.el8.x86_64 119/122 2023-11-15T01:20:37.525 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-11-15T01:20:37.525 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librbd1-2:16.2.14-170.g620f25c1.el8.x86_64 121/122 2023-11-15T01:20:38.310 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-11-15T01:20:38.311 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-2:16.2.14-170.g620f25c1.el8.x86_64 1/122 2023-11-15T01:20:38.311 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-base-2:16.2.14-170.g620f25c1.el8.x86_64 2/122 2023-11-15T01:20:38.311 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-common-2:16.2.14-170.g620f25c1.el8.x86_64 3/122 2023-11-15T01:20:38.311 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-fuse-2:16.2.14-170.g620f25c1.el8.x86_64 4/122 2023-11-15T01:20:38.312 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-170.g620f2 5/122 2023-11-15T01:20:38.312 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mds-2:16.2.14-170.g620f25c1.el8.x86_64 6/122 2023-11-15T01:20:38.312 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-2:16.2.14-170.g620f25c1.el8.x86_64 7/122 2023-11-15T01:20:38.312 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mon-2:16.2.14-170.g620f25c1.el8.x86_64 8/122 2023-11-15T01:20:38.312 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-osd-2:16.2.14-170.g620f25c1.el8.x86_64 9/122 2023-11-15T01:20:38.313 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-radosgw-2:16.2.14-170.g620f25c1.el8.x86_64 10/122 2023-11-15T01:20:38.313 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-selinux-2:16.2.14-170.g620f25c1.el8.x86_64 11/122 2023-11-15T01:20:38.313 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-test-2:16.2.14-170.g620f25c1.el8.x86_64 12/122 2023-11-15T01:20:38.313 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 13/122 2023-11-15T01:20:38.313 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs-devel-2:16.2.14-170.g620f25c1.el8.x86_ 14/122 2023-11-15T01:20:38.313 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs2-2:16.2.14-170.g620f25c1.el8.x86_64 15/122 2023-11-15T01:20:38.314 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephsqlite-2:16.2.14-170.g620f25c1.el8.x86_64 16/122 2023-11-15T01:20:38.314 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados-devel-2:16.2.14-170.g620f25c1.el8.x86_6 17/122 2023-11-15T01:20:38.314 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libradosstriper1-2:16.2.14-170.g620f25c1.el8.x86 18/122 2023-11-15T01:20:38.314 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librgw2-2:16.2.14-170.g620f25c1.el8.x86_64 19/122 2023-11-15T01:20:38.314 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-argparse-2:16.2.14-170.g620f25c1.el 20/122 2023-11-15T01:20:38.315 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-common-2:16.2.14-170.g620f25c1.el8. 21/122 2023-11-15T01:20:38.315 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cephfs-2:16.2.14-170.g620f25c1.el8.x86_6 22/122 2023-11-15T01:20:38.315 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rados-2:16.2.14-170.g620f25c1.el8.x86_64 23/122 2023-11-15T01:20:38.315 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rbd-2:16.2.14-170.g620f25c1.el8.x86_64 24/122 2023-11-15T01:20:38.315 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rgw-2:16.2.14-170.g620f25c1.el8.x86_64 25/122 2023-11-15T01:20:38.316 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-fuse-2:16.2.14-170.g620f25c1.el8.x86_64 26/122 2023-11-15T01:20:38.316 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 27/122 2023-11-15T01:20:38.316 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-nbd-2:16.2.14-170.g620f25c1.el8.x86_64 28/122 2023-11-15T01:20:38.324 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-170.g620f25c1. 29/122 2023-11-15T01:20:38.324 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-170.g620f25c1.el8.noa 30/122 2023-11-15T01:20:38.325 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-170.g620f25c1.el8.n 31/122 2023-11-15T01:20:38.325 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-170.g620 32/122 2023-11-15T01:20:38.325 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-170.g620f25c1.el 33/122 2023-11-15T01:20:38.325 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-rook-2:16.2.14-170.g620f25c1.el8.noarch 34/122 2023-11-15T01:20:38.325 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-170.g620f25c1.e 35/122 2023-11-15T01:20:38.326 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephadm-2:16.2.14-170.g620f25c1.el8.noarch 36/122 2023-11-15T01:20:38.326 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-top-2:16.2.14-170.g620f25c1.el8.noarch 37/122 2023-11-15T01:20:38.326 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/122 2023-11-15T01:20:38.326 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/122 2023-11-15T01:20:38.326 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-11-15T01:20:38.327 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-11-15T01:20:38.327 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/122 2023-11-15T01:20:38.327 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-11-15T01:20:38.327 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-11-15T01:20:38.327 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-11-15T01:20:38.327 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-11-15T01:20:38.328 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-11-15T01:20:38.328 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-11-15T01:20:38.328 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/122 2023-11-15T01:20:38.328 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/122 2023-11-15T01:20:38.328 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/122 2023-11-15T01:20:38.329 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/122 2023-11-15T01:20:38.329 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/122 2023-11-15T01:20:38.329 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/122 2023-11-15T01:20:38.329 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/122 2023-11-15T01:20:38.329 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-11-15T01:20:38.330 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-11-15T01:20:38.330 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/122 2023-11-15T01:20:38.330 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/122 2023-11-15T01:20:38.330 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/122 2023-11-15T01:20:38.330 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/122 2023-11-15T01:20:38.331 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/122 2023-11-15T01:20:38.331 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/122 2023-11-15T01:20:38.331 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/122 2023-11-15T01:20:38.331 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/122 2023-11-15T01:20:38.331 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/122 2023-11-15T01:20:38.331 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/122 2023-11-15T01:20:38.332 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/122 2023-11-15T01:20:38.332 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/122 2023-11-15T01:20:38.332 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/122 2023-11-15T01:20:38.332 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-11-15T01:20:38.332 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-11-15T01:20:38.333 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-11-15T01:20:38.333 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-11-15T01:20:38.333 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-11-15T01:20:38.333 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-11-15T01:20:38.333 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-11-15T01:20:38.334 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-11-15T01:20:38.334 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-11-15T01:20:38.334 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-11-15T01:20:38.334 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-11-15T01:20:38.334 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-11-15T01:20:38.335 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-11-15T01:20:38.335 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-11-15T01:20:38.335 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-11-15T01:20:38.335 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-11-15T01:20:38.335 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-11-15T01:20:38.335 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-11-15T01:20:38.336 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-11-15T01:20:38.336 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-11-15T01:20:38.336 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-11-15T01:20:38.336 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-11-15T01:20:38.336 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-11-15T01:20:38.337 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-11-15T01:20:38.337 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-11-15T01:20:38.337 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-11-15T01:20:38.337 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-11-15T01:20:38.337 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-11-15T01:20:38.338 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-11-15T01:20:38.338 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-11-15T01:20:38.338 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-11-15T01:20:38.338 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-11-15T01:20:38.338 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-11-15T01:20:38.339 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-11-15T01:20:38.339 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-11-15T01:20:38.339 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-11-15T01:20:38.339 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-11-15T01:20:38.339 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-11-15T01:20:38.339 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-11-15T01:20:38.340 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-11-15T01:20:38.340 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-11-15T01:20:38.340 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-11-15T01:20:38.340 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-11-15T01:20:38.340 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-11-15T01:20:38.341 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-11-15T01:20:38.341 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-11-15T01:20:38.341 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-11-15T01:20:38.341 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-11-15T01:20:38.341 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:16.2.14-170.g620f25c1.el8.x86_64 119/122 2023-11-15T01:20:38.342 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-11-15T01:20:38.342 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:16.2.14-170.g620f25c1.el8.x86_64 121/122 2023-11-15T01:20:39.681 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-11-15T01:20:39.681 INFO:teuthology.orchestra.run.smithi141.stdout:Last metadata expiration check: 0:01:49 ago on Wed 15 Nov 2023 01:18:50 AM UTC. 2023-11-15T01:20:40.685 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-11-15T01:20:40.685 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:01:50 ago on Wed 15 Nov 2023 01:18:50 AM UTC. 2023-11-15T01:20:41.687 INFO:teuthology.orchestra.run.smithi141.stdout:Installed products updated. 2023-11-15T01:20:41.843 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:41.844 INFO:teuthology.orchestra.run.smithi141.stdout:Upgraded: 2023-11-15T01:20:41.844 INFO:teuthology.orchestra.run.smithi141.stdout: librados2-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.844 INFO:teuthology.orchestra.run.smithi141.stdout: librbd1-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.844 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-11-15T01:20:41.844 INFO:teuthology.orchestra.run.smithi141.stdout: automake-1.16.1-7.el8.noarch 2023-11-15T01:20:41.845 INFO:teuthology.orchestra.run.smithi141.stdout: bison-3.0.4-10.el8.x86_64 2023-11-15T01:20:41.845 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.845 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-base-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.845 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-common-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.845 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-fuse-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.845 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-grafana-dashboards-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:41.846 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-immutable-object-cache-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.846 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mds-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.846 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.846 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-cephadm-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:41.846 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-dashboard-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:41.847 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-diskprediction-local-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:41.847 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-modules-core-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:41.847 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-rook-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:41.847 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mon-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.847 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-osd-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.848 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-prometheus-alerts-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:41.848 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-radosgw-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.848 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-selinux-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.848 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-test-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.848 INFO:teuthology.orchestra.run.smithi141.stdout: cephadm-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:41.849 INFO:teuthology.orchestra.run.smithi141.stdout: cephfs-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.849 INFO:teuthology.orchestra.run.smithi141.stdout: cephfs-top-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:41.849 INFO:teuthology.orchestra.run.smithi141.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-11-15T01:20:41.849 INFO:teuthology.orchestra.run.smithi141.stdout: flex-2.6.1-9.el8.x86_64 2023-11-15T01:20:41.849 INFO:teuthology.orchestra.run.smithi141.stdout: fuse-2.9.7-12.el8.x86_64 2023-11-15T01:20:41.850 INFO:teuthology.orchestra.run.smithi141.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-15T01:20:41.850 INFO:teuthology.orchestra.run.smithi141.stdout: jq-1.5-12.el8.x86_64 2023-11-15T01:20:41.850 INFO:teuthology.orchestra.run.smithi141.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-11-15T01:20:41.850 INFO:teuthology.orchestra.run.smithi141.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-11-15T01:20:41.850 INFO:teuthology.orchestra.run.smithi141.stdout: leveldb-1.22-1.el8.x86_64 2023-11-15T01:20:41.851 INFO:teuthology.orchestra.run.smithi141.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-15T01:20:41.851 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs-devel-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.851 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs2-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.851 INFO:teuthology.orchestra.run.smithi141.stdout: libcephsqlite-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.851 INFO:teuthology.orchestra.run.smithi141.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-11-15T01:20:41.852 INFO:teuthology.orchestra.run.smithi141.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-11-15T01:20:41.852 INFO:teuthology.orchestra.run.smithi141.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-15T01:20:41.852 INFO:teuthology.orchestra.run.smithi141.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-11-15T01:20:41.852 INFO:teuthology.orchestra.run.smithi141.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-15T01:20:41.852 INFO:teuthology.orchestra.run.smithi141.stdout: librados-devel-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.852 INFO:teuthology.orchestra.run.smithi141.stdout: libradosstriper1-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.853 INFO:teuthology.orchestra.run.smithi141.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-11-15T01:20:41.853 INFO:teuthology.orchestra.run.smithi141.stdout: librgw2-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.853 INFO:teuthology.orchestra.run.smithi141.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-15T01:20:41.853 INFO:teuthology.orchestra.run.smithi141.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-11-15T01:20:41.853 INFO:teuthology.orchestra.run.smithi141.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-15T01:20:41.854 INFO:teuthology.orchestra.run.smithi141.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-15T01:20:41.854 INFO:teuthology.orchestra.run.smithi141.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-11-15T01:20:41.854 INFO:teuthology.orchestra.run.smithi141.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-15T01:20:41.854 INFO:teuthology.orchestra.run.smithi141.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-15T01:20:41.854 INFO:teuthology.orchestra.run.smithi141.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-15T01:20:41.855 INFO:teuthology.orchestra.run.smithi141.stdout: openblas-0.3.12-1.el8.x86_64 2023-11-15T01:20:41.855 INFO:teuthology.orchestra.run.smithi141.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-11-15T01:20:41.855 INFO:teuthology.orchestra.run.smithi141.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-11-15T01:20:41.855 INFO:teuthology.orchestra.run.smithi141.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-15T01:20:41.855 INFO:teuthology.orchestra.run.smithi141.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-15T01:20:41.856 INFO:teuthology.orchestra.run.smithi141.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-15T01:20:41.856 INFO:teuthology.orchestra.run.smithi141.stdout: python3-apipkg-1.5-6.el8.noarch 2023-11-15T01:20:41.856 INFO:teuthology.orchestra.run.smithi141.stdout: python3-babel-2.5.1-5.el8.noarch 2023-11-15T01:20:41.856 INFO:teuthology.orchestra.run.smithi141.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-15T01:20:41.856 INFO:teuthology.orchestra.run.smithi141.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-15T01:20:41.856 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-15T01:20:41.857 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ceph-argparse-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.857 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ceph-common-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.857 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cephfs-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.857 INFO:teuthology.orchestra.run.smithi141.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-15T01:20:41.857 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-15T01:20:41.858 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-15T01:20:41.858 INFO:teuthology.orchestra.run.smithi141.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-11-15T01:20:41.858 INFO:teuthology.orchestra.run.smithi141.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-15T01:20:41.858 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-15T01:20:41.858 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-15T01:20:41.859 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-11-15T01:20:41.859 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-15T01:20:41.859 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-15T01:20:41.859 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-15T01:20:41.859 INFO:teuthology.orchestra.run.smithi141.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-15T01:20:41.860 INFO:teuthology.orchestra.run.smithi141.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-15T01:20:41.860 INFO:teuthology.orchestra.run.smithi141.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-15T01:20:41.860 INFO:teuthology.orchestra.run.smithi141.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-15T01:20:41.860 INFO:teuthology.orchestra.run.smithi141.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-15T01:20:41.860 INFO:teuthology.orchestra.run.smithi141.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-11-15T01:20:41.861 INFO:teuthology.orchestra.run.smithi141.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-11-15T01:20:41.861 INFO:teuthology.orchestra.run.smithi141.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-15T01:20:41.861 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-15T01:20:41.861 INFO:teuthology.orchestra.run.smithi141.stdout: python3-portend-2.6-1.el8.noarch 2023-11-15T01:20:41.861 INFO:teuthology.orchestra.run.smithi141.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-15T01:20:41.861 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-15T01:20:41.862 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-15T01:20:41.862 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-15T01:20:41.862 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rados-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.862 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rbd-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.862 INFO:teuthology.orchestra.run.smithi141.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-11-15T01:20:41.863 INFO:teuthology.orchestra.run.smithi141.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-15T01:20:41.863 INFO:teuthology.orchestra.run.smithi141.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-15T01:20:41.863 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rgw-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.863 INFO:teuthology.orchestra.run.smithi141.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-15T01:20:41.863 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-15T01:20:41.864 INFO:teuthology.orchestra.run.smithi141.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-11-15T01:20:41.864 INFO:teuthology.orchestra.run.smithi141.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-15T01:20:41.864 INFO:teuthology.orchestra.run.smithi141.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-15T01:20:41.864 INFO:teuthology.orchestra.run.smithi141.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-15T01:20:41.864 INFO:teuthology.orchestra.run.smithi141.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-15T01:20:41.865 INFO:teuthology.orchestra.run.smithi141.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-15T01:20:41.865 INFO:teuthology.orchestra.run.smithi141.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-15T01:20:41.865 INFO:teuthology.orchestra.run.smithi141.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-15T01:20:41.865 INFO:teuthology.orchestra.run.smithi141.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-15T01:20:41.865 INFO:teuthology.orchestra.run.smithi141.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-15T01:20:41.866 INFO:teuthology.orchestra.run.smithi141.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-15T01:20:41.866 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-fuse-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.866 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.866 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-nbd-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:41.866 INFO:teuthology.orchestra.run.smithi141.stdout: socat-1.7.3.3-2.el8.x86_64 2023-11-15T01:20:41.867 INFO:teuthology.orchestra.run.smithi141.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-11-15T01:20:41.867 INFO:teuthology.orchestra.run.smithi141.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-15T01:20:41.867 INFO:teuthology.orchestra.run.smithi141.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-11-15T01:20:41.867 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:41.868 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-11-15T01:20:42.123 DEBUG:teuthology.parallel:result is None 2023-11-15T01:20:42.612 INFO:teuthology.orchestra.run.smithi001.stdout:Installed products updated. 2023-11-15T01:20:42.786 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:42.786 INFO:teuthology.orchestra.run.smithi001.stdout:Upgraded: 2023-11-15T01:20:42.787 INFO:teuthology.orchestra.run.smithi001.stdout: librados2-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.787 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.787 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2023-11-15T01:20:42.788 INFO:teuthology.orchestra.run.smithi001.stdout: automake-1.16.1-7.el8.noarch 2023-11-15T01:20:42.788 INFO:teuthology.orchestra.run.smithi001.stdout: bison-3.0.4-10.el8.x86_64 2023-11-15T01:20:42.788 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.789 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.789 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.789 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.790 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:42.790 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.790 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.791 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.791 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:42.791 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:42.791 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:42.791 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:42.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:42.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:42.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.793 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.793 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.793 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:42.793 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.794 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top-2:16.2.14-170.g620f25c1.el8.noarch 2023-11-15T01:20:42.794 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-11-15T01:20:42.794 INFO:teuthology.orchestra.run.smithi001.stdout: flex-2.6.1-9.el8.x86_64 2023-11-15T01:20:42.794 INFO:teuthology.orchestra.run.smithi001.stdout: fuse-2.9.7-12.el8.x86_64 2023-11-15T01:20:42.794 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-15T01:20:42.795 INFO:teuthology.orchestra.run.smithi001.stdout: jq-1.5-12.el8.x86_64 2023-11-15T01:20:42.795 INFO:teuthology.orchestra.run.smithi001.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-11-15T01:20:42.795 INFO:teuthology.orchestra.run.smithi001.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-11-15T01:20:42.795 INFO:teuthology.orchestra.run.smithi001.stdout: leveldb-1.22-1.el8.x86_64 2023-11-15T01:20:42.795 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-15T01:20:42.796 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.796 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.796 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.796 INFO:teuthology.orchestra.run.smithi001.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-11-15T01:20:42.796 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-11-15T01:20:42.797 INFO:teuthology.orchestra.run.smithi001.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-15T01:20:42.797 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-11-15T01:20:42.797 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-15T01:20:42.797 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.797 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-11-15T01:20:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-15T01:20:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-11-15T01:20:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-15T01:20:42.799 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-15T01:20:42.799 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-11-15T01:20:42.799 INFO:teuthology.orchestra.run.smithi001.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-15T01:20:42.799 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-15T01:20:42.799 INFO:teuthology.orchestra.run.smithi001.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-15T01:20:42.800 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-0.3.12-1.el8.x86_64 2023-11-15T01:20:42.800 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-11-15T01:20:42.800 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-11-15T01:20:42.800 INFO:teuthology.orchestra.run.smithi001.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-15T01:20:42.800 INFO:teuthology.orchestra.run.smithi001.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-15T01:20:42.801 INFO:teuthology.orchestra.run.smithi001.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-15T01:20:42.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-apipkg-1.5-6.el8.noarch 2023-11-15T01:20:42.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel-2.5.1-5.el8.noarch 2023-11-15T01:20:42.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-15T01:20:42.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-15T01:20:42.802 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-15T01:20:42.802 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.802 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.802 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.802 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-15T01:20:42.805 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-15T01:20:42.806 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-15T01:20:42.806 INFO:teuthology.orchestra.run.smithi001.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-11-15T01:20:42.807 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-15T01:20:42.807 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-15T01:20:42.807 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-15T01:20:42.807 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-11-15T01:20:42.807 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-15T01:20:42.808 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-15T01:20:42.808 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-15T01:20:42.808 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-15T01:20:42.808 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-15T01:20:42.808 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-15T01:20:42.809 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-15T01:20:42.809 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-15T01:20:42.809 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-11-15T01:20:42.809 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-11-15T01:20:42.809 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-15T01:20:42.810 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-15T01:20:42.810 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend-2.6-1.el8.noarch 2023-11-15T01:20:42.810 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-15T01:20:42.810 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-15T01:20:42.811 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-15T01:20:42.811 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-15T01:20:42.811 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.811 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.811 INFO:teuthology.orchestra.run.smithi001.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-11-15T01:20:42.812 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-15T01:20:42.812 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-15T01:20:42.812 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.812 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-15T01:20:42.812 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-15T01:20:42.813 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-11-15T01:20:42.813 INFO:teuthology.orchestra.run.smithi001.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-15T01:20:42.813 INFO:teuthology.orchestra.run.smithi001.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-15T01:20:42.813 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-15T01:20:42.813 INFO:teuthology.orchestra.run.smithi001.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-15T01:20:42.814 INFO:teuthology.orchestra.run.smithi001.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-15T01:20:42.814 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-15T01:20:42.814 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-15T01:20:42.814 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-15T01:20:42.815 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-15T01:20:42.815 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-15T01:20:42.815 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.815 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.816 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd-2:16.2.14-170.g620f25c1.el8.x86_64 2023-11-15T01:20:42.816 INFO:teuthology.orchestra.run.smithi001.stdout: socat-1.7.3.3-2.el8.x86_64 2023-11-15T01:20:42.816 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-11-15T01:20:42.816 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-15T01:20:42.817 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-11-15T01:20:42.817 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:42.817 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2023-11-15T01:20:43.148 DEBUG:teuthology.parallel:result is None 2023-11-15T01:20:43.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=620f25c1794f62207424fc9319427943fb8d1fae 2023-11-15T01:20:43.350 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-15T01:20:43.372 INFO:teuthology.orchestra.run.smithi001.stdout:16.2.14-170.g620f25c1.el8 2023-11-15T01:20:43.372 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-170.g620f25c1.el8 2023-11-15T01:20:43.373 INFO:teuthology.task.install:The correct ceph version 16.2.14-170.g620f25c1 is installed. 2023-11-15T01:20:43.373 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=620f25c1794f62207424fc9319427943fb8d1fae 2023-11-15T01:20:43.550 DEBUG:teuthology.orchestra.run.smithi141:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-15T01:20:43.574 INFO:teuthology.orchestra.run.smithi141.stdout:16.2.14-170.g620f25c1.el8 2023-11-15T01:20:43.574 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-170.g620f25c1.el8 2023-11-15T01:20:43.575 INFO:teuthology.task.install:The correct ceph version 16.2.14-170.g620f25c1 is installed. 2023-11-15T01:20:43.575 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-15T01:20:43.576 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:20:43.576 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-15T01:20:43.617 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:20:43.618 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-15T01:20:43.659 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-15T01:20:43.660 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:20:43.660 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/daemon-helper 2023-11-15T01:20:43.686 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-15T01:20:43.751 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:20:43.752 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/usr/bin/daemon-helper 2023-11-15T01:20:43.778 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-15T01:20:43.844 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-15T01:20:43.845 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:20:43.845 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-15T01:20:43.870 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-15T01:20:43.936 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:20:43.936 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-15T01:20:43.961 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-15T01:20:44.025 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-15T01:20:44.025 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:20:44.026 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/stdin-killer 2023-11-15T01:20:44.051 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-15T01:20:44.115 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:20:44.116 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/usr/bin/stdin-killer 2023-11-15T01:20:44.140 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-15T01:20:44.205 INFO:teuthology.run_tasks:Running task ceph... 2023-11-15T01:20:44.268 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-15T01:20:44.268 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 777 /var/log/ceph 2023-11-15T01:20:44.271 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 777 /var/log/ceph 2023-11-15T01:20:44.295 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-15T01:20:44.296 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-15T01:20:44.336 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-15T01:20:44.360 INFO:tasks.ceph:Creating extra log directories... 2023-11-15T01:20:44.361 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-15T01:20:44.402 DEBUG:teuthology.orchestra.run.smithi141:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-15T01:20:44.432 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-15T01:20:44.432 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-15T01:20:44.433 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-15T01:20:44.433 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:20:44.434 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-15T01:20:44.481 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-15T01:20:44.606 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-15T01:20:44.631 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:20:44.631 DEBUG:teuthology.orchestra.run.smithi141:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-15T01:20:44.646 DEBUG:teuthology.orchestra.run.smithi141:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-15T01:20:44.754 DEBUG:teuthology.orchestra.run.smithi141:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-15T01:20:44.801 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-15T01:20:44.801 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-15T01:20:44.802 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075', 'branch': 'wip-yuri4-testing-2023-11-13-0820-pacific', 'description': 'fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7458075', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2023-11-13-0820-pacific'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '620f25c1794f62207424fc9319427943fb8d1fae'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '620f25c1794f62207424fc9319427943fb8d1fae'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2023-11-13-0820-pacific', 'sha1': '620f25c1794f62207424fc9319427943fb8d1fae'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5345, 'sha1': '620f25c1794f62207424fc9319427943fb8d1fae', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri4-testing-2023-11-13-0820-pacific', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_620f25c1794f62207424fc9319427943fb8d1fae/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '620f25c1794f62207424fc9319427943fb8d1fae', 'targets': {'smithi001.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJeFylrmsKFW81CfzONyFLuEEkwlYoHfyZEe/20rdwDOWr4O1mHrlgMK1nfliLLBrxbQw+OniB5V0ngiiD24By8=', 'smithi141.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRe93QIcO8EMbYevl+g6VFx5qJmSBRJHUVgq8TO9pdI8ccHzx0Nil5qaualtx3+f9S0HUsYLIV8zz7pJ+2gUSQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '620f25c1794f62207424fc9319427943fb8d1fae'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-14_20:31:57', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3590714'} 2023-11-15T01:20:44.803 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-15T01:20:44.805 DEBUG:teuthology.orchestra.run.smithi141:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-15T01:20:44.849 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m0777 -- /var/run/ceph 2023-11-15T01:20:44.860 DEBUG:teuthology.orchestra.run.smithi141:> sudo install -d -m0777 -- /var/run/ceph 2023-11-15T01:20:44.913 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:20:44.914 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/scratch_devs of=/dev/stdout 2023-11-15T01:20:44.938 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-15T01:20:44.938 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_1 2023-11-15T01:20:44.993 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-15T01:20:44.994 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-15T01:20:44.994 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 6h/6d Inode: 216822 Links: 1 2023-11-15T01:20:44.994 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-15T01:20:44.994 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2023-11-15T01:20:44.994 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2023-11-15 01:20:37.849002417 +0000 2023-11-15T01:20:44.995 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2023-11-15 01:18:07.891804085 +0000 2023-11-15T01:20:44.995 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2023-11-15 01:18:07.891804085 +0000 2023-11-15T01:20:44.995 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: - 2023-11-15T01:20:44.995 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-15T01:20:45.057 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2023-11-15T01:20:45.057 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2023-11-15T01:20:45.057 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.00011695 s, 4.4 MB/s 2023-11-15T01:20:45.058 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-15T01:20:45.114 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_2 2023-11-15T01:20:45.170 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-15T01:20:45.171 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-15T01:20:45.171 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 6h/6d Inode: 219080 Links: 1 2023-11-15T01:20:45.171 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-15T01:20:45.171 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2023-11-15T01:20:45.172 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2023-11-15 01:20:37.849002417 +0000 2023-11-15T01:20:45.172 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2023-11-15 01:18:08.416797481 +0000 2023-11-15T01:20:45.172 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2023-11-15 01:18:08.416797481 +0000 2023-11-15T01:20:45.172 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: - 2023-11-15T01:20:45.172 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-15T01:20:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2023-11-15T01:20:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2023-11-15T01:20:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000111044 s, 4.6 MB/s 2023-11-15T01:20:45.236 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-15T01:20:45.292 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_3 2023-11-15T01:20:45.348 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-15T01:20:45.348 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-15T01:20:45.348 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 6h/6d Inode: 219858 Links: 1 2023-11-15T01:20:45.348 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-15T01:20:45.348 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2023-11-15T01:20:45.349 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2023-11-15 01:20:37.849002417 +0000 2023-11-15T01:20:45.349 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2023-11-15 01:18:08.959790651 +0000 2023-11-15T01:20:45.349 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2023-11-15 01:18:08.959790651 +0000 2023-11-15T01:20:45.349 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: - 2023-11-15T01:20:45.350 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-15T01:20:45.411 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2023-11-15T01:20:45.412 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2023-11-15T01:20:45.412 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000129881 s, 3.9 MB/s 2023-11-15T01:20:45.413 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-15T01:20:45.469 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_4 2023-11-15T01:20:45.525 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-15T01:20:45.525 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-15T01:20:45.525 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 6h/6d Inode: 224323 Links: 1 2023-11-15T01:20:45.526 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-15T01:20:45.526 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2023-11-15T01:20:45.526 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2023-11-15 01:20:37.850002404 +0000 2023-11-15T01:20:45.526 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2023-11-15 01:18:09.477784135 +0000 2023-11-15T01:20:45.526 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2023-11-15 01:18:09.477784135 +0000 2023-11-15T01:20:45.527 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: - 2023-11-15T01:20:45.527 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-15T01:20:45.589 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2023-11-15T01:20:45.589 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2023-11-15T01:20:45.589 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000110407 s, 4.6 MB/s 2023-11-15T01:20:45.591 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-15T01:20:45.647 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-15T01:20:45.647 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:20:45.648 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/scratch_devs of=/dev/stdout 2023-11-15T01:20:45.663 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-15T01:20:45.664 DEBUG:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_1 2023-11-15T01:20:45.719 INFO:teuthology.orchestra.run.smithi141.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-15T01:20:45.719 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-15T01:20:45.719 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 6h/6d Inode: 223418 Links: 1 2023-11-15T01:20:45.720 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-15T01:20:45.720 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2023-11-15T01:20:45.720 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2023-11-15 01:20:37.075092046 +0000 2023-11-15T01:20:45.720 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2023-11-15 01:17:52.821889772 +0000 2023-11-15T01:20:45.720 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2023-11-15 01:17:52.821889772 +0000 2023-11-15T01:20:45.720 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: - 2023-11-15T01:20:45.721 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-15T01:20:45.784 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2023-11-15T01:20:45.784 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2023-11-15T01:20:45.784 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes copied, 0.000256065 s, 2.0 MB/s 2023-11-15T01:20:45.785 DEBUG:teuthology.orchestra.run.smithi141:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-15T01:20:45.842 DEBUG:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_2 2023-11-15T01:20:45.897 INFO:teuthology.orchestra.run.smithi141.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-15T01:20:45.898 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-15T01:20:45.898 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 6h/6d Inode: 224292 Links: 1 2023-11-15T01:20:45.899 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-15T01:20:45.899 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2023-11-15T01:20:45.899 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2023-11-15 01:20:37.076092025 +0000 2023-11-15T01:20:45.899 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2023-11-15 01:17:53.329878804 +0000 2023-11-15T01:20:45.900 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2023-11-15 01:17:53.329878804 +0000 2023-11-15T01:20:45.900 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: - 2023-11-15T01:20:45.900 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-15T01:20:45.961 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2023-11-15T01:20:45.961 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2023-11-15T01:20:45.961 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes copied, 0.000283989 s, 1.8 MB/s 2023-11-15T01:20:45.962 DEBUG:teuthology.orchestra.run.smithi141:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-15T01:20:46.018 DEBUG:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_3 2023-11-15T01:20:46.072 INFO:teuthology.orchestra.run.smithi141.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-15T01:20:46.073 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-15T01:20:46.073 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 6h/6d Inode: 217970 Links: 1 2023-11-15T01:20:46.073 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-15T01:20:46.073 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2023-11-15T01:20:46.073 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2023-11-15 01:20:37.076092025 +0000 2023-11-15T01:20:46.074 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2023-11-15 01:17:53.813868355 +0000 2023-11-15T01:20:46.074 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2023-11-15 01:17:53.813868355 +0000 2023-11-15T01:20:46.074 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: - 2023-11-15T01:20:46.074 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-15T01:20:46.135 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2023-11-15T01:20:46.135 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2023-11-15T01:20:46.136 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes copied, 0.000223065 s, 2.3 MB/s 2023-11-15T01:20:46.136 DEBUG:teuthology.orchestra.run.smithi141:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-15T01:20:46.192 DEBUG:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_4 2023-11-15T01:20:46.247 INFO:teuthology.orchestra.run.smithi141.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-15T01:20:46.247 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-15T01:20:46.248 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 6h/6d Inode: 218089 Links: 1 2023-11-15T01:20:46.248 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-15T01:20:46.248 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2023-11-15T01:20:46.248 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2023-11-15 01:20:37.076092025 +0000 2023-11-15T01:20:46.248 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2023-11-15 01:17:54.289858078 +0000 2023-11-15T01:20:46.249 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2023-11-15 01:17:54.289858078 +0000 2023-11-15T01:20:46.249 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: - 2023-11-15T01:20:46.249 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-15T01:20:46.311 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2023-11-15T01:20:46.311 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2023-11-15T01:20:46.311 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes copied, 0.000191548 s, 2.7 MB/s 2023-11-15T01:20:46.312 DEBUG:teuthology.orchestra.run.smithi141:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-15T01:20:46.368 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-15T01:20:46.368 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi001.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi141.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-15T01:20:46.368 INFO:tasks.ceph:Generating config... 2023-11-15T01:20:46.370 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-15T01:20:46.370 INFO:tasks.ceph:[client] debug client = 20 2023-11-15T01:20:46.370 INFO:tasks.ceph:[client] debug ms = 1 2023-11-15T01:20:46.371 INFO:tasks.ceph:[client] pid file = 2023-11-15T01:20:46.371 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-15T01:20:46.371 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-15T01:20:46.371 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-15T01:20:46.372 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-15T01:20:46.372 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-15T01:20:46.372 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-15T01:20:46.372 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-15T01:20:46.373 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-15T01:20:46.373 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-15T01:20:46.373 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-15T01:20:46.373 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-15T01:20:46.374 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-15T01:20:46.374 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-15T01:20:46.374 INFO:tasks.ceph:[mgr] debug client = 20 2023-11-15T01:20:46.374 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-11-15T01:20:46.375 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-15T01:20:46.375 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-15T01:20:46.375 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-15T01:20:46.375 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-15T01:20:46.376 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-15T01:20:46.377 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-15T01:20:46.378 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-15T01:20:46.378 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-15T01:20:46.378 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-15T01:20:46.379 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-15T01:20:46.379 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-15T01:20:46.379 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-15T01:20:46.380 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-15T01:20:46.380 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-15T01:20:46.380 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-15T01:20:46.380 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-15T01:20:46.381 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-15T01:20:46.381 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-15T01:20:46.381 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-15T01:20:46.381 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-15T01:20:46.382 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-15T01:20:46.382 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-15T01:20:46.382 INFO:tasks.ceph:Setting up mon.a... 2023-11-15T01:20:46.383 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-15T01:20:46.447 INFO:teuthology.orchestra.run.smithi001.stdout:creating /etc/ceph/ceph.keyring 2023-11-15T01:20:46.449 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-15T01:20:46.490 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-15T01:20:46.556 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.1'), ('mon.b', '172.21.15.141'), ('mon.c', '[v2:172.21.15.141:3301,v1:172.21.15.141:6790]')] 2023-11-15T01:20:46.557 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.1,172.21.15.141,[v2:172.21.15.141:3301,v1:172.21.15.141:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-15T01:20:46.558 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:20:46.559 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-15T01:20:46.611 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.1 --add b 172.21.15.141 --addv c '[v2:172.21.15.141:3301,v1:172.21.15.141:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-15T01:20:46.693 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-15T01:20:46.693 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: generated fsid 32ffb44b-12dc-4e79-bad7-24a9692dabf6 2023-11-15T01:20:46.694 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 0 2023-11-15T01:20:46.694 INFO:teuthology.orchestra.run.smithi001.stdout:fsid 32ffb44b-12dc-4e79-bad7-24a9692dabf6 2023-11-15T01:20:46.694 INFO:teuthology.orchestra.run.smithi001.stdout:last_changed 2023-11-15T01:20:46.693383+0000 2023-11-15T01:20:46.694 INFO:teuthology.orchestra.run.smithi001.stdout:created 2023-11-15T01:20:46.693383+0000 2023-11-15T01:20:46.694 INFO:teuthology.orchestra.run.smithi001.stdout:min_mon_release 0 (unknown) 2023-11-15T01:20:46.695 INFO:teuthology.orchestra.run.smithi001.stdout:election_strategy: 1 2023-11-15T01:20:46.695 INFO:teuthology.orchestra.run.smithi001.stdout:0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2023-11-15T01:20:46.695 INFO:teuthology.orchestra.run.smithi001.stdout:1: [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] mon.b 2023-11-15T01:20:46.695 INFO:teuthology.orchestra.run.smithi001.stdout:2: [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] mon.c 2023-11-15T01:20:46.695 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-15T01:20:46.697 DEBUG:teuthology.orchestra.run.smithi001:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-15T01:20:46.752 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 32ffb44b-12dc-4e79-bad7-24a9692dabf6... 2023-11-15T01:20:46.753 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-15T01:20:46.794 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-15T01:20:46.836 INFO:teuthology.orchestra.run.smithi001.stdout:[global] 2023-11-15T01:20:46.837 INFO:teuthology.orchestra.run.smithi001.stdout: chdir = "" 2023-11-15T01:20:46.837 INFO:teuthology.orchestra.run.smithi001.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-15T01:20:46.837 INFO:teuthology.orchestra.run.smithi001.stdout: auth supported = cephx 2023-11-15T01:20:46.837 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.837 INFO:teuthology.orchestra.run.smithi001.stdout: filestore xattr use omap = true 2023-11-15T01:20:46.838 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.838 INFO:teuthology.orchestra.run.smithi001.stdout: mon clock drift allowed = 1.000 2023-11-15T01:20:46.838 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.838 INFO:teuthology.orchestra.run.smithi001.stdout: osd crush chooseleaf type = 0 2023-11-15T01:20:46.838 INFO:teuthology.orchestra.run.smithi001.stdout: auth debug = true 2023-11-15T01:20:46.839 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.839 INFO:teuthology.orchestra.run.smithi001.stdout: ms die on old message = true 2023-11-15T01:20:46.839 INFO:teuthology.orchestra.run.smithi001.stdout: ms die on bug = true 2023-11-15T01:20:46.839 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.839 INFO:teuthology.orchestra.run.smithi001.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-15T01:20:46.840 INFO:teuthology.orchestra.run.smithi001.stdout: mon pg warn max object skew = 0 2023-11-15T01:20:46.840 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.840 INFO:teuthology.orchestra.run.smithi001.stdout: # disable pg_autoscaler by default for new pools 2023-11-15T01:20:46.840 INFO:teuthology.orchestra.run.smithi001.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-15T01:20:46.840 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.841 INFO:teuthology.orchestra.run.smithi001.stdout: osd pool default size = 2 2023-11-15T01:20:46.841 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.841 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd allow primary affinity = true 2023-11-15T01:20:46.841 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd allow pg remap = true 2023-11-15T01:20:46.841 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on legacy crush tunables = false 2023-11-15T01:20:46.841 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on crush straw calc version zero = false 2023-11-15T01:20:46.842 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on no sortbitwise = false 2023-11-15T01:20:46.842 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on osd down out interval zero = false 2023-11-15T01:20:46.842 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on too few osds = false 2023-11-15T01:20:46.842 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-15T01:20:46.842 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-15T01:20:46.843 INFO:teuthology.orchestra.run.smithi001.stdout: mon_allow_pool_size_one = true 2023-11-15T01:20:46.843 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.843 INFO:teuthology.orchestra.run.smithi001.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-11-15T01:20:46.843 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.843 INFO:teuthology.orchestra.run.smithi001.stdout: osd default data pool replay window = 5 2023-11-15T01:20:46.844 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.844 INFO:teuthology.orchestra.run.smithi001.stdout: mon allow pool delete = true 2023-11-15T01:20:46.844 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.844 INFO:teuthology.orchestra.run.smithi001.stdout: mon cluster log file level = debug 2023-11-15T01:20:46.844 INFO:teuthology.orchestra.run.smithi001.stdout: debug asserts on shutdown = true 2023-11-15T01:20:46.845 INFO:teuthology.orchestra.run.smithi001.stdout: mon health detail to clog = false 2023-11-15T01:20:46.845 INFO:teuthology.orchestra.run.smithi001.stdout: mon host = "172.21.15.1,172.21.15.141,[v2:172.21.15.141:3301,v1:172.21.15.141:6790]" 2023-11-15T01:20:46.845 INFO:teuthology.orchestra.run.smithi001.stdout: ms die on skipped message = False 2023-11-15T01:20:46.845 INFO:teuthology.orchestra.run.smithi001.stdout: fsid = 32ffb44b-12dc-4e79-bad7-24a9692dabf6 2023-11-15T01:20:46.845 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.845 INFO:teuthology.orchestra.run.smithi001.stdout:[osd] 2023-11-15T01:20:46.846 INFO:teuthology.orchestra.run.smithi001.stdout: osd journal size = 100 2023-11-15T01:20:46.846 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.846 INFO:teuthology.orchestra.run.smithi001.stdout: osd scrub load threshold = 5.0 2023-11-15T01:20:46.846 INFO:teuthology.orchestra.run.smithi001.stdout: osd scrub max interval = 600 2023-11-15T01:20:46.846 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.847 INFO:teuthology.orchestra.run.smithi001.stdout: osd recover clone overlap = true 2023-11-15T01:20:46.847 INFO:teuthology.orchestra.run.smithi001.stdout: osd recovery max chunk = 1048576 2023-11-15T01:20:46.847 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.847 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug shutdown = true 2023-11-15T01:20:46.847 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug op order = true 2023-11-15T01:20:46.848 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug verify stray on activate = true 2023-11-15T01:20:46.848 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.848 INFO:teuthology.orchestra.run.smithi001.stdout: osd open classes on start = true 2023-11-15T01:20:46.848 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug pg log writeout = true 2023-11-15T01:20:46.848 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.849 INFO:teuthology.orchestra.run.smithi001.stdout: osd deep scrub update digest min age = 30 2023-11-15T01:20:46.849 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.849 INFO:teuthology.orchestra.run.smithi001.stdout: osd map max advance = 10 2023-11-15T01:20:46.849 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.849 INFO:teuthology.orchestra.run.smithi001.stdout: journal zero on create = true 2023-11-15T01:20:46.850 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.850 INFO:teuthology.orchestra.run.smithi001.stdout: filestore ondisk finisher threads = 3 2023-11-15T01:20:46.850 INFO:teuthology.orchestra.run.smithi001.stdout: filestore apply finisher threads = 3 2023-11-15T01:20:46.850 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.850 INFO:teuthology.orchestra.run.smithi001.stdout: bdev debug aio = true 2023-11-15T01:20:46.851 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug misdirected ops = true 2023-11-15T01:20:46.851 INFO:teuthology.orchestra.run.smithi001.stdout: bdev async discard = True 2023-11-15T01:20:46.851 INFO:teuthology.orchestra.run.smithi001.stdout: bdev enable discard = True 2023-11-15T01:20:46.851 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore allocator = bitmap 2023-11-15T01:20:46.851 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore block size = 96636764160 2023-11-15T01:20:46.852 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore fsck on mount = True 2023-11-15T01:20:46.852 INFO:teuthology.orchestra.run.smithi001.stdout: debug bluefs = 1/20 2023-11-15T01:20:46.852 INFO:teuthology.orchestra.run.smithi001.stdout: debug bluestore = 1/20 2023-11-15T01:20:46.852 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2023-11-15T01:20:46.852 INFO:teuthology.orchestra.run.smithi001.stdout: debug osd = 20 2023-11-15T01:20:46.852 INFO:teuthology.orchestra.run.smithi001.stdout: debug rocksdb = 4/10 2023-11-15T01:20:46.853 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd backfillfull_ratio = 0.85 2023-11-15T01:20:46.853 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd full ratio = 0.9 2023-11-15T01:20:46.853 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd nearfull ratio = 0.8 2023-11-15T01:20:46.853 INFO:teuthology.orchestra.run.smithi001.stdout: osd failsafe full ratio = 0.95 2023-11-15T01:20:46.853 INFO:teuthology.orchestra.run.smithi001.stdout: osd objectstore = bluestore 2023-11-15T01:20:46.854 INFO:teuthology.orchestra.run.smithi001.stdout: osd op complaint time = 180 2023-11-15T01:20:46.854 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.854 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr] 2023-11-15T01:20:46.854 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2023-11-15T01:20:46.854 INFO:teuthology.orchestra.run.smithi001.stdout: debug mgr = 20 2023-11-15T01:20:46.855 INFO:teuthology.orchestra.run.smithi001.stdout: debug mon = 20 2023-11-15T01:20:46.855 INFO:teuthology.orchestra.run.smithi001.stdout: debug auth = 20 2023-11-15T01:20:46.855 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min pgs per osd = 4 2023-11-15T01:20:46.855 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min bytes per osd = 10 2023-11-15T01:20:46.855 INFO:teuthology.orchestra.run.smithi001.stdout: mgr/telemetry/nag = false 2023-11-15T01:20:46.855 INFO:teuthology.orchestra.run.smithi001.stdout: debug client = 20 2023-11-15T01:20:46.856 INFO:teuthology.orchestra.run.smithi001.stdout: debug finisher = 20 2023-11-15T01:20:46.856 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.856 INFO:teuthology.orchestra.run.smithi001.stdout:[mon] 2023-11-15T01:20:46.856 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2023-11-15T01:20:46.856 INFO:teuthology.orchestra.run.smithi001.stdout: debug mon = 20 2023-11-15T01:20:46.857 INFO:teuthology.orchestra.run.smithi001.stdout: debug paxos = 20 2023-11-15T01:20:46.857 INFO:teuthology.orchestra.run.smithi001.stdout: debug auth = 20 2023-11-15T01:20:46.857 INFO:teuthology.orchestra.run.smithi001.stdout: mon data avail warn = 5 2023-11-15T01:20:46.857 INFO:teuthology.orchestra.run.smithi001.stdout: mon mgr mkfs grace = 240 2023-11-15T01:20:46.857 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min pgs per osd = 4 2023-11-15T01:20:46.857 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd reporter subtree level = osd 2023-11-15T01:20:46.858 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd prime pg temp = true 2023-11-15T01:20:46.858 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min bytes per osd = 10 2023-11-15T01:20:46.858 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.858 INFO:teuthology.orchestra.run.smithi001.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-15T01:20:46.858 INFO:teuthology.orchestra.run.smithi001.stdout: auth mon ticket ttl = 660 # 11m 2023-11-15T01:20:46.859 INFO:teuthology.orchestra.run.smithi001.stdout: auth service ticket ttl = 240 # 4m 2023-11-15T01:20:46.859 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.859 INFO:teuthology.orchestra.run.smithi001.stdout: # don't complain about insecure global_id in the test suite 2023-11-15T01:20:46.859 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-15T01:20:46.859 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-15T01:20:46.860 INFO:teuthology.orchestra.run.smithi001.stdout: mon op complaint time = 120 2023-11-15T01:20:46.860 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:20:46.860 INFO:teuthology.orchestra.run.smithi001.stdout:[client] 2023-11-15T01:20:46.860 INFO:teuthology.orchestra.run.smithi001.stdout: rgw cache enabled = true 2023-11-15T01:20:46.860 INFO:teuthology.orchestra.run.smithi001.stdout: rgw enable ops log = true 2023-11-15T01:20:46.860 INFO:teuthology.orchestra.run.smithi001.stdout: rgw enable usage log = true 2023-11-15T01:20:46.861 INFO:teuthology.orchestra.run.smithi001.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-15T01:20:46.861 INFO:teuthology.orchestra.run.smithi001.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-15T01:20:46.861 INFO:teuthology.orchestra.run.smithi001.stdout: client mount timeout = 600 2023-11-15T01:20:46.861 INFO:teuthology.orchestra.run.smithi001.stdout: debug client = 20 2023-11-15T01:20:46.861 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2023-11-15T01:20:46.862 INFO:teuthology.orchestra.run.smithi001.stdout: pid file = "" 2023-11-15T01:20:46.862 INFO:teuthology.orchestra.run.smithi001.stdout: rados mon op timeout = 900 2023-11-15T01:20:46.862 INFO:teuthology.orchestra.run.smithi001.stdout: rados osd op timeout = 900 2023-11-15T01:20:46.862 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.a] 2023-11-15T01:20:46.862 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.b] 2023-11-15T01:20:46.863 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.c] 2023-11-15T01:20:46.863 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a] 2023-11-15T01:20:46.863 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.c] 2023-11-15T01:20:46.863 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.b] 2023-11-15T01:20:46.863 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.d] 2023-11-15T01:20:46.864 INFO:teuthology.orchestra.run.smithi001.stdout:[mds] 2023-11-15T01:20:46.864 INFO:teuthology.orchestra.run.smithi001.stdout: debug mds = 20 2023-11-15T01:20:46.864 INFO:teuthology.orchestra.run.smithi001.stdout: debug mds balancer = 20 2023-11-15T01:20:46.864 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2023-11-15T01:20:46.864 INFO:teuthology.orchestra.run.smithi001.stdout: mds debug frag = True 2023-11-15T01:20:46.864 INFO:teuthology.orchestra.run.smithi001.stdout: mds debug scatterstat = True 2023-11-15T01:20:46.865 INFO:teuthology.orchestra.run.smithi001.stdout: mds op complaint time = 180 2023-11-15T01:20:46.865 INFO:teuthology.orchestra.run.smithi001.stdout: mds verify scatter = True 2023-11-15T01:20:46.865 INFO:teuthology.orchestra.run.smithi001.stdout: osd op complaint time = 180 2023-11-15T01:20:46.865 INFO:teuthology.orchestra.run.smithi001.stdout: rados mon op timeout = 900 2023-11-15T01:20:46.865 INFO:teuthology.orchestra.run.smithi001.stdout: rados osd op timeout = 900 2023-11-15T01:20:46.867 INFO:teuthology.orchestra.run.smithi141.stdout:[global] 2023-11-15T01:20:46.867 INFO:teuthology.orchestra.run.smithi141.stdout: chdir = "" 2023-11-15T01:20:46.868 INFO:teuthology.orchestra.run.smithi141.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-15T01:20:46.868 INFO:teuthology.orchestra.run.smithi141.stdout: auth supported = cephx 2023-11-15T01:20:46.868 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.868 INFO:teuthology.orchestra.run.smithi141.stdout: filestore xattr use omap = true 2023-11-15T01:20:46.868 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.869 INFO:teuthology.orchestra.run.smithi141.stdout: mon clock drift allowed = 1.000 2023-11-15T01:20:46.869 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.869 INFO:teuthology.orchestra.run.smithi141.stdout: osd crush chooseleaf type = 0 2023-11-15T01:20:46.869 INFO:teuthology.orchestra.run.smithi141.stdout: auth debug = true 2023-11-15T01:20:46.869 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.869 INFO:teuthology.orchestra.run.smithi141.stdout: ms die on old message = true 2023-11-15T01:20:46.870 INFO:teuthology.orchestra.run.smithi141.stdout: ms die on bug = true 2023-11-15T01:20:46.870 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.870 INFO:teuthology.orchestra.run.smithi141.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-15T01:20:46.870 INFO:teuthology.orchestra.run.smithi141.stdout: mon pg warn max object skew = 0 2023-11-15T01:20:46.870 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.871 INFO:teuthology.orchestra.run.smithi141.stdout: # disable pg_autoscaler by default for new pools 2023-11-15T01:20:46.871 INFO:teuthology.orchestra.run.smithi141.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-15T01:20:46.871 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.871 INFO:teuthology.orchestra.run.smithi141.stdout: osd pool default size = 2 2023-11-15T01:20:46.871 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.872 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd allow primary affinity = true 2023-11-15T01:20:46.872 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd allow pg remap = true 2023-11-15T01:20:46.872 INFO:teuthology.orchestra.run.smithi141.stdout: mon warn on legacy crush tunables = false 2023-11-15T01:20:46.872 INFO:teuthology.orchestra.run.smithi141.stdout: mon warn on crush straw calc version zero = false 2023-11-15T01:20:46.872 INFO:teuthology.orchestra.run.smithi141.stdout: mon warn on no sortbitwise = false 2023-11-15T01:20:46.873 INFO:teuthology.orchestra.run.smithi141.stdout: mon warn on osd down out interval zero = false 2023-11-15T01:20:46.873 INFO:teuthology.orchestra.run.smithi141.stdout: mon warn on too few osds = false 2023-11-15T01:20:46.873 INFO:teuthology.orchestra.run.smithi141.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-15T01:20:46.873 INFO:teuthology.orchestra.run.smithi141.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-15T01:20:46.873 INFO:teuthology.orchestra.run.smithi141.stdout: mon_allow_pool_size_one = true 2023-11-15T01:20:46.873 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.874 INFO:teuthology.orchestra.run.smithi141.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-11-15T01:20:46.874 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.874 INFO:teuthology.orchestra.run.smithi141.stdout: osd default data pool replay window = 5 2023-11-15T01:20:46.874 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.874 INFO:teuthology.orchestra.run.smithi141.stdout: mon allow pool delete = true 2023-11-15T01:20:46.875 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.875 INFO:teuthology.orchestra.run.smithi141.stdout: mon cluster log file level = debug 2023-11-15T01:20:46.875 INFO:teuthology.orchestra.run.smithi141.stdout: debug asserts on shutdown = true 2023-11-15T01:20:46.875 INFO:teuthology.orchestra.run.smithi141.stdout: mon health detail to clog = false 2023-11-15T01:20:46.875 INFO:teuthology.orchestra.run.smithi141.stdout: mon host = "172.21.15.1,172.21.15.141,[v2:172.21.15.141:3301,v1:172.21.15.141:6790]" 2023-11-15T01:20:46.876 INFO:teuthology.orchestra.run.smithi141.stdout: ms die on skipped message = False 2023-11-15T01:20:46.876 INFO:teuthology.orchestra.run.smithi141.stdout: fsid = 32ffb44b-12dc-4e79-bad7-24a9692dabf6 2023-11-15T01:20:46.876 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.876 INFO:teuthology.orchestra.run.smithi141.stdout:[osd] 2023-11-15T01:20:46.876 INFO:teuthology.orchestra.run.smithi141.stdout: osd journal size = 100 2023-11-15T01:20:46.877 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.877 INFO:teuthology.orchestra.run.smithi141.stdout: osd scrub load threshold = 5.0 2023-11-15T01:20:46.877 INFO:teuthology.orchestra.run.smithi141.stdout: osd scrub max interval = 600 2023-11-15T01:20:46.877 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.877 INFO:teuthology.orchestra.run.smithi141.stdout: osd recover clone overlap = true 2023-11-15T01:20:46.877 INFO:teuthology.orchestra.run.smithi141.stdout: osd recovery max chunk = 1048576 2023-11-15T01:20:46.878 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.878 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug shutdown = true 2023-11-15T01:20:46.878 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug op order = true 2023-11-15T01:20:46.878 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug verify stray on activate = true 2023-11-15T01:20:46.878 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.879 INFO:teuthology.orchestra.run.smithi141.stdout: osd open classes on start = true 2023-11-15T01:20:46.879 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug pg log writeout = true 2023-11-15T01:20:46.879 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.879 INFO:teuthology.orchestra.run.smithi141.stdout: osd deep scrub update digest min age = 30 2023-11-15T01:20:46.879 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.880 INFO:teuthology.orchestra.run.smithi141.stdout: osd map max advance = 10 2023-11-15T01:20:46.880 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.880 INFO:teuthology.orchestra.run.smithi141.stdout: journal zero on create = true 2023-11-15T01:20:46.880 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.880 INFO:teuthology.orchestra.run.smithi141.stdout: filestore ondisk finisher threads = 3 2023-11-15T01:20:46.880 INFO:teuthology.orchestra.run.smithi141.stdout: filestore apply finisher threads = 3 2023-11-15T01:20:46.881 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.881 INFO:teuthology.orchestra.run.smithi141.stdout: bdev debug aio = true 2023-11-15T01:20:46.881 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug misdirected ops = true 2023-11-15T01:20:46.881 INFO:teuthology.orchestra.run.smithi141.stdout: bdev async discard = True 2023-11-15T01:20:46.881 INFO:teuthology.orchestra.run.smithi141.stdout: bdev enable discard = True 2023-11-15T01:20:46.882 INFO:teuthology.orchestra.run.smithi141.stdout: bluestore allocator = bitmap 2023-11-15T01:20:46.882 INFO:teuthology.orchestra.run.smithi141.stdout: bluestore block size = 96636764160 2023-11-15T01:20:46.882 INFO:teuthology.orchestra.run.smithi141.stdout: bluestore fsck on mount = True 2023-11-15T01:20:46.882 INFO:teuthology.orchestra.run.smithi141.stdout: debug bluefs = 1/20 2023-11-15T01:20:46.882 INFO:teuthology.orchestra.run.smithi141.stdout: debug bluestore = 1/20 2023-11-15T01:20:46.883 INFO:teuthology.orchestra.run.smithi141.stdout: debug ms = 1 2023-11-15T01:20:46.883 INFO:teuthology.orchestra.run.smithi141.stdout: debug osd = 20 2023-11-15T01:20:46.883 INFO:teuthology.orchestra.run.smithi141.stdout: debug rocksdb = 4/10 2023-11-15T01:20:46.883 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd backfillfull_ratio = 0.85 2023-11-15T01:20:46.883 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd full ratio = 0.9 2023-11-15T01:20:46.884 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd nearfull ratio = 0.8 2023-11-15T01:20:46.884 INFO:teuthology.orchestra.run.smithi141.stdout: osd failsafe full ratio = 0.95 2023-11-15T01:20:46.884 INFO:teuthology.orchestra.run.smithi141.stdout: osd objectstore = bluestore 2023-11-15T01:20:46.884 INFO:teuthology.orchestra.run.smithi141.stdout: osd op complaint time = 180 2023-11-15T01:20:46.884 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.884 INFO:teuthology.orchestra.run.smithi141.stdout:[mgr] 2023-11-15T01:20:46.885 INFO:teuthology.orchestra.run.smithi141.stdout: debug ms = 1 2023-11-15T01:20:46.885 INFO:teuthology.orchestra.run.smithi141.stdout: debug mgr = 20 2023-11-15T01:20:46.885 INFO:teuthology.orchestra.run.smithi141.stdout: debug mon = 20 2023-11-15T01:20:46.885 INFO:teuthology.orchestra.run.smithi141.stdout: debug auth = 20 2023-11-15T01:20:46.885 INFO:teuthology.orchestra.run.smithi141.stdout: mon reweight min pgs per osd = 4 2023-11-15T01:20:46.886 INFO:teuthology.orchestra.run.smithi141.stdout: mon reweight min bytes per osd = 10 2023-11-15T01:20:46.886 INFO:teuthology.orchestra.run.smithi141.stdout: mgr/telemetry/nag = false 2023-11-15T01:20:46.886 INFO:teuthology.orchestra.run.smithi141.stdout: debug client = 20 2023-11-15T01:20:46.886 INFO:teuthology.orchestra.run.smithi141.stdout: debug finisher = 20 2023-11-15T01:20:46.886 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.887 INFO:teuthology.orchestra.run.smithi141.stdout:[mon] 2023-11-15T01:20:46.887 INFO:teuthology.orchestra.run.smithi141.stdout: debug ms = 1 2023-11-15T01:20:46.887 INFO:teuthology.orchestra.run.smithi141.stdout: debug mon = 20 2023-11-15T01:20:46.887 INFO:teuthology.orchestra.run.smithi141.stdout: debug paxos = 20 2023-11-15T01:20:46.887 INFO:teuthology.orchestra.run.smithi141.stdout: debug auth = 20 2023-11-15T01:20:46.887 INFO:teuthology.orchestra.run.smithi141.stdout: mon data avail warn = 5 2023-11-15T01:20:46.888 INFO:teuthology.orchestra.run.smithi141.stdout: mon mgr mkfs grace = 240 2023-11-15T01:20:46.888 INFO:teuthology.orchestra.run.smithi141.stdout: mon reweight min pgs per osd = 4 2023-11-15T01:20:46.888 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd reporter subtree level = osd 2023-11-15T01:20:46.888 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd prime pg temp = true 2023-11-15T01:20:46.888 INFO:teuthology.orchestra.run.smithi141.stdout: mon reweight min bytes per osd = 10 2023-11-15T01:20:46.889 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.889 INFO:teuthology.orchestra.run.smithi141.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-15T01:20:46.889 INFO:teuthology.orchestra.run.smithi141.stdout: auth mon ticket ttl = 660 # 11m 2023-11-15T01:20:46.889 INFO:teuthology.orchestra.run.smithi141.stdout: auth service ticket ttl = 240 # 4m 2023-11-15T01:20:46.889 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.890 INFO:teuthology.orchestra.run.smithi141.stdout: # don't complain about insecure global_id in the test suite 2023-11-15T01:20:46.890 INFO:teuthology.orchestra.run.smithi141.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-15T01:20:46.890 INFO:teuthology.orchestra.run.smithi141.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-15T01:20:46.890 INFO:teuthology.orchestra.run.smithi141.stdout: mon op complaint time = 120 2023-11-15T01:20:46.891 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-15T01:20:46.891 INFO:teuthology.orchestra.run.smithi141.stdout:[client] 2023-11-15T01:20:46.891 INFO:teuthology.orchestra.run.smithi141.stdout: rgw cache enabled = true 2023-11-15T01:20:46.891 INFO:teuthology.orchestra.run.smithi141.stdout: rgw enable ops log = true 2023-11-15T01:20:46.891 INFO:teuthology.orchestra.run.smithi141.stdout: rgw enable usage log = true 2023-11-15T01:20:46.891 INFO:teuthology.orchestra.run.smithi141.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-15T01:20:46.892 INFO:teuthology.orchestra.run.smithi141.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-15T01:20:46.892 INFO:teuthology.orchestra.run.smithi141.stdout: client mount timeout = 600 2023-11-15T01:20:46.892 INFO:teuthology.orchestra.run.smithi141.stdout: debug client = 20 2023-11-15T01:20:46.892 INFO:teuthology.orchestra.run.smithi141.stdout: debug ms = 1 2023-11-15T01:20:46.892 INFO:teuthology.orchestra.run.smithi141.stdout: pid file = "" 2023-11-15T01:20:46.893 INFO:teuthology.orchestra.run.smithi141.stdout: rados mon op timeout = 900 2023-11-15T01:20:46.893 INFO:teuthology.orchestra.run.smithi141.stdout: rados osd op timeout = 900 2023-11-15T01:20:46.893 INFO:teuthology.orchestra.run.smithi141.stdout:[mon.a] 2023-11-15T01:20:46.893 INFO:teuthology.orchestra.run.smithi141.stdout:[mon.b] 2023-11-15T01:20:46.893 INFO:teuthology.orchestra.run.smithi141.stdout:[mon.c] 2023-11-15T01:20:46.894 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.a] 2023-11-15T01:20:46.894 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.c] 2023-11-15T01:20:46.894 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.b] 2023-11-15T01:20:46.894 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.d] 2023-11-15T01:20:46.894 INFO:teuthology.orchestra.run.smithi141.stdout:[mds] 2023-11-15T01:20:46.894 INFO:teuthology.orchestra.run.smithi141.stdout: debug mds = 20 2023-11-15T01:20:46.895 INFO:teuthology.orchestra.run.smithi141.stdout: debug mds balancer = 20 2023-11-15T01:20:46.895 INFO:teuthology.orchestra.run.smithi141.stdout: debug ms = 1 2023-11-15T01:20:46.895 INFO:teuthology.orchestra.run.smithi141.stdout: mds debug frag = True 2023-11-15T01:20:46.895 INFO:teuthology.orchestra.run.smithi141.stdout: mds debug scatterstat = True 2023-11-15T01:20:46.895 INFO:teuthology.orchestra.run.smithi141.stdout: mds op complaint time = 180 2023-11-15T01:20:46.896 INFO:teuthology.orchestra.run.smithi141.stdout: mds verify scatter = True 2023-11-15T01:20:46.896 INFO:teuthology.orchestra.run.smithi141.stdout: osd op complaint time = 180 2023-11-15T01:20:46.896 INFO:teuthology.orchestra.run.smithi141.stdout: rados mon op timeout = 900 2023-11-15T01:20:46.896 INFO:teuthology.orchestra.run.smithi141.stdout: rados osd op timeout = 900 2023-11-15T01:20:46.896 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-15T01:20:46.897 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-15T01:20:46.958 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-15T01:20:46.959 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:20:46.959 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-15T01:20:46.974 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:20:46.975 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-15T01:20:47.029 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T01:20:47.029 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:20:47.030 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-15T01:20:47.030 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-15T01:20:47.104 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:20:47.105 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-15T01:20:47.159 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi141.front.sepia.ceph.com 2023-11-15T01:20:47.159 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:20:47.160 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-15T01:20:47.160 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-15T01:20:47.194 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:20:47.194 DEBUG:teuthology.orchestra.run.smithi141:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-15T01:20:47.248 INFO:tasks.ceph:Setting up mon nodes... 2023-11-15T01:20:47.248 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-15T01:20:47.249 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-15T01:20:47.297 INFO:teuthology.orchestra.run.smithi001.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-15T01:20:47.299 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-15T01:20:47.367 INFO:teuthology.orchestra.run.smithi141.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-15T01:20:47.369 INFO:tasks.ceph:Setting up mds nodes... 2023-11-15T01:20:47.369 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-15T01:20:47.418 INFO:teuthology.orchestra.run.smithi001.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-15T01:20:47.421 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-15T01:20:47.446 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-15T01:20:47.535 INFO:teuthology.orchestra.run.smithi001.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-15T01:20:47.538 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-15T01:20:47.563 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-15T01:20:47.610 INFO:teuthology.orchestra.run.smithi141.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-15T01:20:47.613 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-15T01:20:47.636 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-15T01:20:47.723 INFO:teuthology.orchestra.run.smithi141.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-15T01:20:47.726 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-15T01:20:47.750 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-15T01:20:47.750 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-15T01:20:47.788 INFO:teuthology.orchestra.run.smithi001.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-15T01:20:47.801 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-15T01:20:47.879 INFO:teuthology.orchestra.run.smithi001.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-15T01:20:47.892 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-15T01:20:47.929 INFO:teuthology.orchestra.run.smithi141.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-15T01:20:47.941 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-15T01:20:48.018 INFO:teuthology.orchestra.run.smithi141.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-15T01:20:48.030 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-15T01:20:48.031 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi001.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi141.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-15T01:20:48.031 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-15T01:20:48.056 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-15T01:20:48.057 INFO:tasks.ceph:role: osd.0 2023-11-15T01:20:48.057 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T01:20:48.057 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-15T01:20:48.121 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-15T01:20:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-15T01:20:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-15T01:20:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 2023-11-15T01:20:48.122 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-15T01:20:48.122 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2023-11-15T01:20:48.122 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-15T01:20:48.122 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-15T01:20:48.122 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-15T01:20:48.123 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-15T01:20:48.144 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2023-11-15T01:20:48.145 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2023-11-15T01:20:48.146 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-15T01:20:48.224 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-15T01:20:48.294 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-15T01:20:48.359 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-15T01:20:48.360 INFO:tasks.ceph:role: osd.1 2023-11-15T01:20:48.360 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T01:20:48.360 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-15T01:20:48.424 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-15T01:20:48.424 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-15T01:20:48.424 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-15T01:20:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 2023-11-15T01:20:48.425 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-15T01:20:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2023-11-15T01:20:48.425 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-15T01:20:48.426 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-15T01:20:48.426 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-15T01:20:48.426 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-15T01:20:48.447 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2023-11-15T01:20:48.448 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2023-11-15T01:20:48.449 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-15T01:20:48.527 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-15T01:20:48.596 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-15T01:20:48.662 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-15T01:20:48.662 INFO:tasks.ceph:role: osd.2 2023-11-15T01:20:48.662 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T01:20:48.663 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-15T01:20:48.728 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-15T01:20:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-15T01:20:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-15T01:20:48.729 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 2023-11-15T01:20:48.729 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-15T01:20:48.729 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2023-11-15T01:20:48.729 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-15T01:20:48.730 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-15T01:20:48.730 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-15T01:20:48.730 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-15T01:20:48.750 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2023-11-15T01:20:48.753 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2023-11-15T01:20:48.753 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-15T01:20:48.831 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-15T01:20:48.900 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-15T01:20:48.965 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-15T01:20:48.966 INFO:tasks.ceph:role: osd.3 2023-11-15T01:20:48.966 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T01:20:48.967 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-15T01:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-15T01:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-15T01:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-15T01:20:49.031 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 2023-11-15T01:20:49.031 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-15T01:20:49.031 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2023-11-15T01:20:49.031 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-15T01:20:49.032 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-15T01:20:49.032 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-15T01:20:49.032 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-15T01:20:49.052 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2023-11-15T01:20:49.054 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2023-11-15T01:20:49.054 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-15T01:20:49.131 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-15T01:20:49.200 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-15T01:20:49.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:49.295+0000 7ff922c22380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-15T01:20:49.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:49.295+0000 7ff922c22380 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-15T01:20:49.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:49.295+0000 7ff922c22380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-15T01:20:49.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:49.295+0000 7ff922c22380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-15T01:20:49.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:49.295+0000 7ff922c22380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-15T01:20:49.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:49.295+0000 7ff922c22380 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-15T01:20:52.149 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-15T01:20:52.185 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-15T01:20:52.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:52.269+0000 7f7d62afc380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-15T01:20:52.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:52.270+0000 7f7d62afc380 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-15T01:20:52.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:52.270+0000 7f7d62afc380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-15T01:20:52.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:52.270+0000 7f7d62afc380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-15T01:20:52.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:52.270+0000 7f7d62afc380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-15T01:20:52.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:52.270+0000 7f7d62afc380 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-15T01:20:55.114 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-15T01:20:55.145 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-15T01:20:55.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:55.231+0000 7f52dd73f380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-15T01:20:55.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:55.232+0000 7f52dd73f380 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-15T01:20:55.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:55.232+0000 7f52dd73f380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-15T01:20:55.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:55.232+0000 7f52dd73f380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-15T01:20:55.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:55.232+0000 7f52dd73f380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-15T01:20:55.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:55.232+0000 7f52dd73f380 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-15T01:20:58.078 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-15T01:20:58.111 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-15T01:20:58.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:58.196+0000 7f4ccd1e2380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-15T01:20:58.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:58.197+0000 7f4ccd1e2380 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-15T01:20:58.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:58.197+0000 7f4ccd1e2380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-15T01:20:58.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:58.197+0000 7f4ccd1e2380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-15T01:20:58.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:58.197+0000 7f4ccd1e2380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-15T01:20:58.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:20:58.197+0000 7f4ccd1e2380 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-15T01:21:01.037 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-15T01:21:01.066 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-15T01:21:01.096 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-15T01:21:01.097 INFO:tasks.ceph:role: osd.4 2023-11-15T01:21:01.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-15T01:21:01.097 DEBUG:teuthology.orchestra.run.smithi141:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-15T01:21:01.169 INFO:teuthology.orchestra.run.smithi141.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-15T01:21:01.169 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-15T01:21:01.170 INFO:teuthology.orchestra.run.smithi141.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-15T01:21:01.170 INFO:teuthology.orchestra.run.smithi141.stdout: = reflink=1 2023-11-15T01:21:01.170 INFO:teuthology.orchestra.run.smithi141.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-15T01:21:01.170 INFO:teuthology.orchestra.run.smithi141.stdout: = sunit=0 swidth=0 blks 2023-11-15T01:21:01.170 INFO:teuthology.orchestra.run.smithi141.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-15T01:21:01.171 INFO:teuthology.orchestra.run.smithi141.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-15T01:21:01.171 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-15T01:21:01.171 INFO:teuthology.orchestra.run.smithi141.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-15T01:21:01.612 INFO:teuthology.orchestra.run.smithi141.stdout:Discarding blocks...Done. 2023-11-15T01:21:01.613 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi141.front.sepia.ceph.com -o noatime 2023-11-15T01:21:01.614 DEBUG:teuthology.orchestra.run.smithi141:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-15T01:21:01.789 DEBUG:teuthology.orchestra.run.smithi141:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-15T01:21:01.823 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-15T01:21:01.890 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-15T01:21:01.891 INFO:tasks.ceph:role: osd.5 2023-11-15T01:21:01.891 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-15T01:21:01.891 DEBUG:teuthology.orchestra.run.smithi141:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-15T01:21:01.963 INFO:teuthology.orchestra.run.smithi141.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-15T01:21:01.964 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-15T01:21:01.964 INFO:teuthology.orchestra.run.smithi141.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-15T01:21:01.964 INFO:teuthology.orchestra.run.smithi141.stdout: = reflink=1 2023-11-15T01:21:01.964 INFO:teuthology.orchestra.run.smithi141.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-15T01:21:01.964 INFO:teuthology.orchestra.run.smithi141.stdout: = sunit=0 swidth=0 blks 2023-11-15T01:21:01.965 INFO:teuthology.orchestra.run.smithi141.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-15T01:21:01.965 INFO:teuthology.orchestra.run.smithi141.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-15T01:21:01.965 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-15T01:21:01.965 INFO:teuthology.orchestra.run.smithi141.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-15T01:21:02.393 INFO:teuthology.orchestra.run.smithi141.stdout:Discarding blocks...Done. 2023-11-15T01:21:02.395 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi141.front.sepia.ceph.com -o noatime 2023-11-15T01:21:02.396 DEBUG:teuthology.orchestra.run.smithi141:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-15T01:21:02.502 DEBUG:teuthology.orchestra.run.smithi141:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-15T01:21:02.532 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-15T01:21:02.596 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-15T01:21:02.596 INFO:tasks.ceph:role: osd.6 2023-11-15T01:21:02.597 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-15T01:21:02.597 DEBUG:teuthology.orchestra.run.smithi141:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-15T01:21:02.668 INFO:teuthology.orchestra.run.smithi141.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-15T01:21:02.669 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-15T01:21:02.669 INFO:teuthology.orchestra.run.smithi141.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-15T01:21:02.669 INFO:teuthology.orchestra.run.smithi141.stdout: = reflink=1 2023-11-15T01:21:02.669 INFO:teuthology.orchestra.run.smithi141.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-15T01:21:02.670 INFO:teuthology.orchestra.run.smithi141.stdout: = sunit=0 swidth=0 blks 2023-11-15T01:21:02.670 INFO:teuthology.orchestra.run.smithi141.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-15T01:21:02.670 INFO:teuthology.orchestra.run.smithi141.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-15T01:21:02.670 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-15T01:21:02.670 INFO:teuthology.orchestra.run.smithi141.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-15T01:21:03.129 INFO:teuthology.orchestra.run.smithi141.stdout:Discarding blocks...Done. 2023-11-15T01:21:03.131 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi141.front.sepia.ceph.com -o noatime 2023-11-15T01:21:03.131 DEBUG:teuthology.orchestra.run.smithi141:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-15T01:21:03.298 DEBUG:teuthology.orchestra.run.smithi141:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-15T01:21:03.330 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-15T01:21:03.397 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-15T01:21:03.398 INFO:tasks.ceph:role: osd.7 2023-11-15T01:21:03.398 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-15T01:21:03.398 DEBUG:teuthology.orchestra.run.smithi141:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-15T01:21:03.471 INFO:teuthology.orchestra.run.smithi141.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-15T01:21:03.471 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-15T01:21:03.471 INFO:teuthology.orchestra.run.smithi141.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-15T01:21:03.471 INFO:teuthology.orchestra.run.smithi141.stdout: = reflink=1 2023-11-15T01:21:03.472 INFO:teuthology.orchestra.run.smithi141.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-15T01:21:03.472 INFO:teuthology.orchestra.run.smithi141.stdout: = sunit=0 swidth=0 blks 2023-11-15T01:21:03.472 INFO:teuthology.orchestra.run.smithi141.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-15T01:21:03.472 INFO:teuthology.orchestra.run.smithi141.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-15T01:21:03.472 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-15T01:21:03.473 INFO:teuthology.orchestra.run.smithi141.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-15T01:21:03.919 INFO:teuthology.orchestra.run.smithi141.stdout:Discarding blocks...Done. 2023-11-15T01:21:03.922 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi141.front.sepia.ceph.com -o noatime 2023-11-15T01:21:03.922 DEBUG:teuthology.orchestra.run.smithi141:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-15T01:21:04.093 DEBUG:teuthology.orchestra.run.smithi141:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-15T01:21:04.127 DEBUG:teuthology.orchestra.run.smithi141:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-15T01:21:04.262 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:04.261+0000 7f60b9c1c380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-15T01:21:04.263 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:04.261+0000 7f60b9c1c380 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-15T01:21:04.263 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:04.261+0000 7f60b9c1c380 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-15T01:21:04.263 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:04.261+0000 7f60b9c1c380 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-15T01:21:04.263 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:04.261+0000 7f60b9c1c380 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-15T01:21:04.263 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:04.262+0000 7f60b9c1c380 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-15T01:21:07.110 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-15T01:21:07.139 DEBUG:teuthology.orchestra.run.smithi141:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-15T01:21:07.224 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:07.223+0000 7f545c001380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-15T01:21:07.225 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:07.224+0000 7f545c001380 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-15T01:21:07.225 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:07.224+0000 7f545c001380 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-15T01:21:07.225 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:07.224+0000 7f545c001380 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-15T01:21:07.225 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:07.224+0000 7f545c001380 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-15T01:21:07.226 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:07.224+0000 7f545c001380 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-15T01:21:10.072 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-15T01:21:10.101 DEBUG:teuthology.orchestra.run.smithi141:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-15T01:21:10.186 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:10.185+0000 7f82a31f5380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-15T01:21:10.187 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:10.185+0000 7f82a31f5380 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-15T01:21:10.187 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:10.185+0000 7f82a31f5380 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-15T01:21:10.187 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:10.185+0000 7f82a31f5380 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-15T01:21:10.187 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:10.185+0000 7f82a31f5380 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-15T01:21:10.187 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:10.186+0000 7f82a31f5380 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-15T01:21:13.037 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-15T01:21:13.062 DEBUG:teuthology.orchestra.run.smithi141:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-15T01:21:13.143 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:13.142+0000 7f135e525380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-15T01:21:13.143 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:13.142+0000 7f135e525380 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-15T01:21:13.143 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:13.142+0000 7f135e525380 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-15T01:21:13.144 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:13.142+0000 7f135e525380 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-15T01:21:13.144 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:13.142+0000 7f135e525380 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-15T01:21:13.144 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:13.142+0000 7f135e525380 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-15T01:21:14.804 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:21:14.807 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:21:15.986 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-15T01:21:16.014 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-15T01:21:16.014 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:21:16.014 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-15T01:21:16.045 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:21:16.045 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-15T01:21:16.114 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:21:16.115 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-15T01:21:16.183 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:21:16.183 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-15T01:21:16.251 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:21:16.251 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-15T01:21:16.318 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:21:16.319 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-15T01:21:16.385 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:21:16.386 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-15T01:21:16.452 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:21:16.452 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-15T01:21:16.481 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:21:16.482 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-15T01:21:16.549 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:21:16.549 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-15T01:21:16.615 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:21:16.616 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-15T01:21:16.681 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:21:16.682 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-15T01:21:16.747 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:21:16.747 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-15T01:21:16.811 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:21:16.812 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-15T01:21:16.876 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:21:16.876 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-15T01:21:16.895 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:21:16.896 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-15T01:21:16.953 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:21:16.954 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-15T01:21:16.969 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:21:16.970 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-15T01:21:17.024 INFO:tasks.ceph:Adding keys to all mons... 2023-11-15T01:21:17.024 DEBUG:teuthology.orchestra.run.smithi001:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-15T01:21:17.027 DEBUG:teuthology.orchestra.run.smithi141:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-15T01:21:17.067 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr.y] 2023-11-15T01:21:17.068 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQDvHFRl8nW3ERAA4CJQt/ZEZCJ9UaRRuEHfzw== 2023-11-15T01:21:17.068 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a] 2023-11-15T01:21:17.068 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQDvHFRlmtf5GBAA2CojasXoquGQ9L5rKjVwTQ== 2023-11-15T01:21:17.068 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.c] 2023-11-15T01:21:17.069 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQDvHFRlWTrwHxAAqLVpwNca0vAXUBFnWUN3pg== 2023-11-15T01:21:17.069 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.0] 2023-11-15T01:21:17.069 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQDxHFRlII6rERAA/kvPPhTPHHy6pu5wSPsR/A== 2023-11-15T01:21:17.069 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.1] 2023-11-15T01:21:17.069 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQD0HFRlPkstEBAAqx31fnNonRCVh98eY6qbxQ== 2023-11-15T01:21:17.070 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.2] 2023-11-15T01:21:17.070 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQD3HFRl8e3nDRAAKigcbIo0/BFo0Qi6rV+amQ== 2023-11-15T01:21:17.070 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.3] 2023-11-15T01:21:17.070 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQD6HFRlbwDTCxAAkWv04RyNqW4p8pOqvYCS3A== 2023-11-15T01:21:17.070 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr.x] 2023-11-15T01:21:17.071 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQDvHFRlnyjlFRAAjJwtxkAvJ0ZGmvOOawQseQ== 2023-11-15T01:21:17.071 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.b] 2023-11-15T01:21:17.071 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQDvHFRl/Y5mJBAAz7iLl3kBJ8kSsyTetTZByw== 2023-11-15T01:21:17.071 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.d] 2023-11-15T01:21:17.071 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQDvHFRlVwUnKxAAhx2/mX1ljgQwJLagVpmZIA== 2023-11-15T01:21:17.072 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.4] 2023-11-15T01:21:17.072 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAAHVRlTQihDxAA/HcZbSytP9qD5PsTjvJBoA== 2023-11-15T01:21:17.072 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.5] 2023-11-15T01:21:17.072 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQADHVRlQ2hjDRAAFiI+hKubCPcZ/1AJVu1fvQ== 2023-11-15T01:21:17.073 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.6] 2023-11-15T01:21:17.073 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAGHVRl/KEbCxAAmKTnRU4m4qNzX+SVcFY+Qw== 2023-11-15T01:21:17.073 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.7] 2023-11-15T01:21:17.073 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAJHVRl4wOFCBAAAiGT4UPE5vSb2LjqgGgGFw== 2023-11-15T01:21:17.073 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2023-11-15T01:21:17.074 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQDvHFRl2hkHLxAAxQE/Cslig6gmXR/xcVlRuw== 2023-11-15T01:21:17.074 INFO:teuthology.orchestra.run.smithi001.stdout:[client.2] 2023-11-15T01:21:17.074 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQDvHFRlFrJvNBAAH97x7ERzuzpWrUALO+HvpA== 2023-11-15T01:21:17.074 INFO:teuthology.orchestra.run.smithi001.stdout:[client.1] 2023-11-15T01:21:17.075 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQDvHFRltolkNxAAXmQ4yXOlavwqKq2jFKwsYQ== 2023-11-15T01:21:17.075 INFO:teuthology.orchestra.run.smithi001.stdout:[client.3] 2023-11-15T01:21:17.075 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQDwHFRlko0ZARAA2RqeRJGwWns00DeWgd/9hA== 2023-11-15T01:21:17.087 INFO:teuthology.orchestra.run.smithi141.stdout:[mgr.y] 2023-11-15T01:21:17.087 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDvHFRl8nW3ERAA4CJQt/ZEZCJ9UaRRuEHfzw== 2023-11-15T01:21:17.088 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.a] 2023-11-15T01:21:17.088 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDvHFRlmtf5GBAA2CojasXoquGQ9L5rKjVwTQ== 2023-11-15T01:21:17.088 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.c] 2023-11-15T01:21:17.088 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDvHFRlWTrwHxAAqLVpwNca0vAXUBFnWUN3pg== 2023-11-15T01:21:17.088 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.0] 2023-11-15T01:21:17.088 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDxHFRlII6rERAA/kvPPhTPHHy6pu5wSPsR/A== 2023-11-15T01:21:17.089 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.1] 2023-11-15T01:21:17.089 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQD0HFRlPkstEBAAqx31fnNonRCVh98eY6qbxQ== 2023-11-15T01:21:17.089 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.2] 2023-11-15T01:21:17.089 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQD3HFRl8e3nDRAAKigcbIo0/BFo0Qi6rV+amQ== 2023-11-15T01:21:17.089 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.3] 2023-11-15T01:21:17.090 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQD6HFRlbwDTCxAAkWv04RyNqW4p8pOqvYCS3A== 2023-11-15T01:21:17.090 INFO:teuthology.orchestra.run.smithi141.stdout:[mgr.x] 2023-11-15T01:21:17.090 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDvHFRlnyjlFRAAjJwtxkAvJ0ZGmvOOawQseQ== 2023-11-15T01:21:17.090 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.b] 2023-11-15T01:21:17.090 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDvHFRl/Y5mJBAAz7iLl3kBJ8kSsyTetTZByw== 2023-11-15T01:21:17.091 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.d] 2023-11-15T01:21:17.091 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDvHFRlVwUnKxAAhx2/mX1ljgQwJLagVpmZIA== 2023-11-15T01:21:17.091 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.4] 2023-11-15T01:21:17.091 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQAAHVRlTQihDxAA/HcZbSytP9qD5PsTjvJBoA== 2023-11-15T01:21:17.091 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.5] 2023-11-15T01:21:17.092 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQADHVRlQ2hjDRAAFiI+hKubCPcZ/1AJVu1fvQ== 2023-11-15T01:21:17.092 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.6] 2023-11-15T01:21:17.092 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQAGHVRl/KEbCxAAmKTnRU4m4qNzX+SVcFY+Qw== 2023-11-15T01:21:17.092 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.7] 2023-11-15T01:21:17.092 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQAJHVRl4wOFCBAAAiGT4UPE5vSb2LjqgGgGFw== 2023-11-15T01:21:17.093 INFO:teuthology.orchestra.run.smithi141.stdout:[client.0] 2023-11-15T01:21:17.093 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDvHFRl2hkHLxAAxQE/Cslig6gmXR/xcVlRuw== 2023-11-15T01:21:17.093 INFO:teuthology.orchestra.run.smithi141.stdout:[client.2] 2023-11-15T01:21:17.093 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDvHFRlFrJvNBAAH97x7ERzuzpWrUALO+HvpA== 2023-11-15T01:21:17.093 INFO:teuthology.orchestra.run.smithi141.stdout:[client.1] 2023-11-15T01:21:17.094 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDvHFRltolkNxAAXmQ4yXOlavwqKq2jFKwsYQ== 2023-11-15T01:21:17.094 INFO:teuthology.orchestra.run.smithi141.stdout:[client.3] 2023-11-15T01:21:17.094 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDwHFRlko0ZARAA2RqeRJGwWns00DeWgd/9hA== 2023-11-15T01:21:17.095 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-15T01:21:17.118 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-15T01:21:17.182 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-15T01:21:17.185 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-15T01:21:17.235 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-15T01:21:17.238 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-15T01:21:17.287 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.290 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.336 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.338 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.384 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.387 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.433 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.435 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.481 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-15T01:21:17.483 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-15T01:21:17.529 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-15T01:21:17.532 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-15T01:21:17.580 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-15T01:21:17.582 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-15T01:21:17.633 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.635 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.681 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.683 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.730 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.735 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.782 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.785 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-15T01:21:17.832 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-15T01:21:17.834 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-15T01:21:17.884 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-15T01:21:17.887 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-15T01:21:17.937 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-15T01:21:17.939 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-15T01:21:17.988 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-15T01:21:17.991 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-15T01:21:18.040 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-15T01:21:18.040 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-15T01:21:18.065 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-15T01:21:18.157 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-15T01:21:18.182 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-15T01:21:18.207 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-15T01:21:18.298 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-15T01:21:18.323 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-15T01:21:18.387 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-15T01:21:18.477 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-15T01:21:18.501 DEBUG:teuthology.orchestra.run.smithi001:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-15T01:21:18.504 DEBUG:teuthology.orchestra.run.smithi141:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-15T01:21:18.556 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-15T01:21:18.556 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-15T01:21:18.557 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-15T01:21:18.559 INFO:tasks.ceph.mon.a:Started 2023-11-15T01:21:18.560 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-15T01:21:18.560 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-15T01:21:18.599 INFO:tasks.ceph.mon.b:Started 2023-11-15T01:21:18.599 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-15T01:21:18.599 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-15T01:21:18.602 INFO:tasks.ceph.mon.c:Started 2023-11-15T01:21:18.602 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-15T01:21:18.603 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-15T01:21:18.603 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-15T01:21:18.605 INFO:tasks.ceph.mgr.y:Started 2023-11-15T01:21:18.606 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-15T01:21:18.606 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-15T01:21:18.608 INFO:tasks.ceph.mgr.x:Started 2023-11-15T01:21:18.608 INFO:tasks.ceph:Setting crush tunables to default 2023-11-15T01:21:18.609 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph osd crush tunables default 2023-11-15T01:21:18.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.726+0000 7f83451d9700 1 Processor -- start 2023-11-15T01:21:18.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.726+0000 7f83451d9700 1 -- start start 2023-11-15T01:21:18.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.726+0000 7f83451d9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f834014ec30 0x7f83400638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:18.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.726+0000 7f83451d9700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8340063db0 0x7f8340154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:18.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f83451d9700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8340155610 con 0x7f83401551a0 2023-11-15T01:21:18.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f83451d9700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83400c5640 con 0x7f8340063db0 2023-11-15T01:21:18.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f83451d9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83400c3e30 con 0x7f834014ec30 2023-11-15T01:21:18.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f833e59c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8340063db0 0x7f8340154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:18.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f833ed9d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f834014ec30 0x7f83400638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:18.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f833e59c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8340063db0 0x7f8340154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:33792/0 (socket says 172.21.15.1:33792) 2023-11-15T01:21:18.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f833f59e700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f83401551a0 0x7f83401516e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:57616/0 (socket says 172.21.15.1:57616) 2023-11-15T01:21:18.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f833e59c700 1 -- 172.21.15.1:0/1230131957 learned_addr learned my addr 172.21.15.1:0/1230131957 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:18.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f833e59c700 1 -- 172.21.15.1:0/1230131957 >> v2:172.21.15.141:3300/0 conn(0x7f8340063db0 msgr2=0x7f8340154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-15T01:21:18.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f833e59c700 1 -- 172.21.15.1:0/1230131957 >> v2:172.21.15.141:3300/0 conn(0x7f8340063db0 msgr2=0x7f8340154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-15T01:21:18.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f833e59c700 1 --2- 172.21.15.1:0/1230131957 >> v2:172.21.15.141:3300/0 conn(0x7f8340063db0 0x7f8340154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-15T01:21:18.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f833ed9d700 1 -- 172.21.15.1:0/1230131957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f834014ec30 msgr2=0x7f83400638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-15T01:21:18.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f833ed9d700 1 -- 172.21.15.1:0/1230131957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f834014ec30 msgr2=0x7f83400638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-15T01:21:18.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f833ed9d700 1 --2- 172.21.15.1:0/1230131957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f834014ec30 0x7f83400638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-15T01:21:18.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f833e59c700 1 --2- 172.21.15.1:0/1230131957 >> v2:172.21.15.141:3300/0 conn(0x7f8340063db0 0x7f8340154cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:21:18.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.727+0000 7f833ed9d700 1 --2- 172.21.15.1:0/1230131957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f834014ec30 0x7f83400638c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:21:18.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.892+0000 7f833dd9b700 1 -- 172.21.15.1:0/1230131957 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151436381 0 0) 0x7f8340155610 con 0x7f83401551a0 2023-11-15T01:21:18.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.892+0000 7f833dd9b700 1 -- 172.21.15.1:0/1230131957 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83280033f0 con 0x7f83401551a0 2023-11-15T01:21:18.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833dd9b700 1 -- 172.21.15.1:0/1230131957 <== mon.1 v1:172.21.15.141:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1258678426 0 0) 0x7f83280033f0 con 0x7f83401551a0 2023-11-15T01:21:18.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833dd9b700 1 -- 172.21.15.1:0/1230131957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f834014ec30 msgr2=0x7f83400638c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-15T01:21:18.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833dd9b700 1 --2- 172.21.15.1:0/1230131957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f834014ec30 0x7f83400638c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:18.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833dd9b700 1 -- 172.21.15.1:0/1230131957 >> v2:172.21.15.141:3300/0 conn(0x7f8340063db0 msgr2=0x7f8340154cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-15T01:21:18.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833dd9b700 1 --2- 172.21.15.1:0/1230131957 >> v2:172.21.15.141:3300/0 conn(0x7f8340063db0 0x7f8340154cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:18.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833dd9b700 1 -- 172.21.15.1:0/1230131957 --> v1:172.21.15.141:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83400c3590 con 0x7f83401551a0 2023-11-15T01:21:18.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833dd9b700 1 -- 172.21.15.1:0/1230131957 <== mon.1 v1:172.21.15.141:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f83380017f0 con 0x7f83401551a0 2023-11-15T01:21:18.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833dd9b700 1 -- 172.21.15.1:0/1230131957 >> v1:172.21.15.141:6789/0 conn(0x7f83401551a0 legacy=0x7f83401516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:18.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833dd9b700 1 --2- 172.21.15.1:0/1230131957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f834014ec30 0x7f8328003960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:18.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833dd9b700 1 --2- 172.21.15.1:0/1230131957 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8328003f90 0x7f8328004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833dd9b700 1 --2- 172.21.15.1:0/1230131957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8328004b80 0x7f8328005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833dd9b700 1 -- 172.21.15.1:0/1230131957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400c5640 con 0x7f8328004b80 2023-11-15T01:21:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833dd9b700 1 -- 172.21.15.1:0/1230131957 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400c3e30 con 0x7f8328003f90 2023-11-15T01:21:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833dd9b700 1 -- 172.21.15.1:0/1230131957 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832800ba70 con 0x7f834014ec30 2023-11-15T01:21:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833f59e700 1 --2- 172.21.15.1:0/1230131957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8328004b80 0x7f8328005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833ed9d700 1 --2- 172.21.15.1:0/1230131957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f834014ec30 0x7f8328003960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833e59c700 1 --2- 172.21.15.1:0/1230131957 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8328003f90 0x7f8328004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833f59e700 1 -- 172.21.15.1:0/1230131957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f834014ec30 msgr2=0x7f8328003960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833f59e700 1 --2- 172.21.15.1:0/1230131957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f834014ec30 0x7f8328003960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:18.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833f59e700 1 -- 172.21.15.1:0/1230131957 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8328003f90 msgr2=0x7f8328004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:18.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833f59e700 1 --2- 172.21.15.1:0/1230131957 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8328003f90 0x7f8328004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:18.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833f59e700 1 -- 172.21.15.1:0/1230131957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83280033f0 con 0x7f8328004b80 2023-11-15T01:21:18.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833e59c700 1 --2- 172.21.15.1:0/1230131957 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8328003f90 0x7f8328004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:18.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.898+0000 7f833f59e700 1 --2- 172.21.15.1:0/1230131957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8328004b80 0x7f8328005000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f833800c390 tx=0x7f8338007f00).ready entity=mon.0 client_cookie=caf9658bcb111d83 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:18.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.899+0000 7f833dd9b700 1 -- 172.21.15.1:0/1230131957 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800ccc0 con 0x7f8328004b80 2023-11-15T01:21:18.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.899+0000 7f833dd9b700 1 -- 172.21.15.1:0/1230131957 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833800ce20 con 0x7f8328004b80 2023-11-15T01:21:18.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.899+0000 7f833dd9b700 1 -- 172.21.15.1:0/1230131957 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338005cb0 con 0x7f8328004b80 2023-11-15T01:21:18.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.899+0000 7f83451d9700 1 -- 172.21.15.1:0/1230131957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8328004b80 msgr2=0x7f8328005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.899+0000 7f83451d9700 1 --2- 172.21.15.1:0/1230131957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8328004b80 0x7f8328005000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f833800c390 tx=0x7f8338007f00).stop 2023-11-15T01:21:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.899+0000 7f833f59e700 1 -- 172.21.15.1:0/1230131957 reap_dead start 2023-11-15T01:21:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.899+0000 7f83451d9700 1 -- 172.21.15.1:0/1230131957 shutdown_connections 2023-11-15T01:21:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.899+0000 7f83451d9700 1 -- 172.21.15.1:0/1230131957 >> 172.21.15.1:0/1230131957 conn(0x7f83400c8050 msgr2=0x7f83400c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.899+0000 7f83451d9700 1 -- 172.21.15.1:0/1230131957 shutdown_connections 2023-11-15T01:21:18.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.899+0000 7f83451d9700 1 -- 172.21.15.1:0/1230131957 wait complete. 2023-11-15T01:21:18.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.901+0000 7f83451d9700 1 Processor -- start 2023-11-15T01:21:18.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.901+0000 7f83451d9700 1 -- start start 2023-11-15T01:21:18.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f83451d9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f83401548f0 0x7f83400632d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:18.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f83451d9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f83401625d0 0x7f8340065f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:18.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f83451d9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8340066440 0x7f83400bf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:18.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f83451d9700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8340165f20 con 0x7f8340066440 2023-11-15T01:21:18.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f83451d9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400668c0 con 0x7f83401548f0 2023-11-15T01:21:18.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f83451d9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8340165bf0 con 0x7f83401625d0 2023-11-15T01:21:18.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f833f59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8340066440 0x7f83400bf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:18.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f833f59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8340066440 0x7f83400bf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54978/0 (socket says 172.21.15.1:54978) 2023-11-15T01:21:18.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f833f59e700 1 -- 172.21.15.1:0/381736334 learned_addr learned my addr 172.21.15.1:0/381736334 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:18.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f833e59c700 1 --2- 172.21.15.1:0/381736334 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f83401625d0 0x7f8340065f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:18.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f833ed9d700 1 --2- 172.21.15.1:0/381736334 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f83401548f0 0x7f83400632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:18.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f833f59e700 1 -- 172.21.15.1:0/381736334 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f83401625d0 msgr2=0x7f8340065f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:18.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f833f59e700 1 --2- 172.21.15.1:0/381736334 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f83401625d0 0x7f8340065f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:18.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f833f59e700 1 -- 172.21.15.1:0/381736334 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f83401548f0 msgr2=0x7f83400632d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:18.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f833f59e700 1 --2- 172.21.15.1:0/381736334 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f83401548f0 0x7f83400632d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:18.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f833f59e700 1 -- 172.21.15.1:0/381736334 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8340162e50 con 0x7f8340066440 2023-11-15T01:21:18.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f833f59e700 1 --2- 172.21.15.1:0/381736334 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8340066440 0x7f83400bf4b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f8338000f80 tx=0x7f8338015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:18.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f8326ffd700 1 -- 172.21.15.1:0/381736334 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800ccc0 con 0x7f8340066440 2023-11-15T01:21:18.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f8326ffd700 1 -- 172.21.15.1:0/381736334 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8338004a30 con 0x7f8340066440 2023-11-15T01:21:18.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f83451d9700 1 -- 172.21.15.1:0/381736334 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8340163130 con 0x7f8340066440 2023-11-15T01:21:18.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f8326ffd700 1 -- 172.21.15.1:0/381736334 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338004e30 con 0x7f8340066440 2023-11-15T01:21:18.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.902+0000 7f83451d9700 1 -- 172.21.15.1:0/381736334 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8340154cd0 con 0x7f8340066440 2023-11-15T01:21:18.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.903+0000 7f8326ffd700 1 -- 172.21.15.1:0/381736334 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f83380138c0 con 0x7f8340066440 2023-11-15T01:21:18.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.903+0000 7f8326ffd700 1 -- 172.21.15.1:0/381736334 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f83380204c0 con 0x7f8340066440 2023-11-15T01:21:18.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.903+0000 7f83451d9700 1 -- 172.21.15.1:0/381736334 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834006c7e0 con 0x7f8340066440 2023-11-15T01:21:18.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.906+0000 7f8326ffd700 1 -- 172.21.15.1:0/381736334 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f8338025060 con 0x7f8340066440 2023-11-15T01:21:18.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.979+0000 7f83451d9700 1 -- 172.21.15.1:0/381736334 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f83400c3870 con 0x7f8340066440 2023-11-15T01:21:18.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.982+0000 7f8326ffd700 1 -- 172.21.15.1:0/381736334 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f833802f020 con 0x7f8340066440 2023-11-15T01:21:18.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.983+0000 7f83451d9700 1 -- 172.21.15.1:0/381736334 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8340066440 msgr2=0x7f83400bf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:18.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.983+0000 7f83451d9700 1 --2- 172.21.15.1:0/381736334 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8340066440 0x7f83400bf4b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f8338000f80 tx=0x7f8338015000).stop 2023-11-15T01:21:18.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.983+0000 7f83451d9700 1 -- 172.21.15.1:0/381736334 shutdown_connections 2023-11-15T01:21:18.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.983+0000 7f83451d9700 1 --2- 172.21.15.1:0/381736334 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8340066440 0x7f83400bf4b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:18.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.983+0000 7f83451d9700 1 --2- 172.21.15.1:0/381736334 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f83401548f0 0x7f83400632d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:18.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.983+0000 7f83451d9700 1 --2- 172.21.15.1:0/381736334 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f83401625d0 0x7f8340065f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:18.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.983+0000 7f83451d9700 1 -- 172.21.15.1:0/381736334 >> 172.21.15.1:0/381736334 conn(0x7f83400c8050 msgr2=0x7f834014e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:18.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.983+0000 7f83451d9700 1 -- 172.21.15.1:0/381736334 shutdown_connections 2023-11-15T01:21:18.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:18.983+0000 7f83451d9700 1 -- 172.21.15.1:0/381736334 wait complete. 2023-11-15T01:21:18.986 INFO:teuthology.orchestra.run.smithi001.stderr:adjusted tunables profile to default 2023-11-15T01:21:18.996 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-15T01:21:18.997 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:21:18.997 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-15T01:21:19.022 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:21:19.022 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-15T01:21:19.033 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:19.032+0000 7fcd21cc3680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:21:19.073 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:19.072+0000 7f78fb56f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:21:19.089 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:21:19.089 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-15T01:21:19.101 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:19.101+0000 7fcd21cc3680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:21:19.147 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:19.146+0000 7f78fb56f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:21:19.155 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-11-15T01:21:19.155 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-15T01:21:19.220 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:21:19.221 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-15T01:21:19.245 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:21:19.245 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-15T01:21:19.308 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:21:19.309 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-15T01:21:19.372 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-15T01:21:19.373 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-15T01:21:19.436 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new 258e1dda-d8fc-4fb3-9b0b-450f861dc57b 0 2023-11-15T01:21:19.589 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.588+0000 7fb616950700 1 Processor -- start 2023-11-15T01:21:19.590 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.588+0000 7fb616950700 1 -- start start 2023-11-15T01:21:19.592 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.589+0000 7fb616950700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb6101540a0 0x7fb6100ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:19.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.589+0000 7fb616950700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb610154480 0x7fb6100ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:19.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.589+0000 7fb616950700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6100ca050 con 0x7fb6100c5f40 2023-11-15T01:21:19.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.589+0000 7fb616950700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6100c9440 con 0x7fb6101540a0 2023-11-15T01:21:19.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.589+0000 7fb616950700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6100c9720 con 0x7fb610154480 2023-11-15T01:21:19.593 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.589+0000 7fb60f7fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb610154480 0x7fb6100ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:19.594 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.589+0000 7fb60f7fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb610154480 0x7fb6100ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:56542/0 (socket says 172.21.15.141:56542) 2023-11-15T01:21:19.594 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.589+0000 7fb60f7fe700 1 -- 172.21.15.141:0/1405271775 learned_addr learned my addr 172.21.15.141:0/1405271775 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-15T01:21:19.594 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.589+0000 7fb614eed700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fb6100c5f40 0x7fb6100aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.141:54058/0 (socket says 172.21.15.141:54058) 2023-11-15T01:21:19.594 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.590+0000 7fb60ffff700 1 --2- 172.21.15.141:0/1405271775 >> v2:172.21.15.1:3300/0 conn(0x7fb6101540a0 0x7fb6100ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:19.594 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.590+0000 7fb60f7fe700 1 -- 172.21.15.141:0/1405271775 >> v2:172.21.15.1:3300/0 conn(0x7fb6101540a0 msgr2=0x7fb6100ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:19.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.590+0000 7fb60f7fe700 1 --2- 172.21.15.141:0/1405271775 >> v2:172.21.15.1:3300/0 conn(0x7fb6101540a0 0x7fb6100ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.590+0000 7fb60f7fe700 1 -- 172.21.15.141:0/1405271775 >> v1:172.21.15.141:6789/0 conn(0x7fb6100c5f40 legacy=0x7fb6100aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:19.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.590+0000 7fb60effd700 1 -- 172.21.15.141:0/1405271775 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120219889 0 0) 0x7fb6100ca050 con 0x7fb6100c5f40 2023-11-15T01:21:19.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.590+0000 7fb60f7fe700 1 -- 172.21.15.141:0/1405271775 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6100c9a00 con 0x7fb610154480 2023-11-15T01:21:19.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.590+0000 7fb60f7fe700 1 --2- 172.21.15.141:0/1405271775 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb610154480 0x7fb6100ca9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb6100c88f0 tx=0x7fb6000090f0).ready entity=mon.1 client_cookie=18f15ea539346794 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:19.596 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.590+0000 7fb60effd700 1 -- 172.21.15.141:0/1405271775 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60000b520 con 0x7fb610154480 2023-11-15T01:21:19.596 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.590+0000 7fb60effd700 1 -- 172.21.15.141:0/1405271775 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60000b680 con 0x7fb610154480 2023-11-15T01:21:19.596 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.590+0000 7fb60effd700 1 -- 172.21.15.141:0/1405271775 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60000ba00 con 0x7fb610154480 2023-11-15T01:21:19.596 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.591+0000 7fb616950700 1 -- 172.21.15.141:0/1405271775 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb610154480 msgr2=0x7fb6100ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:19.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.591+0000 7fb616950700 1 --2- 172.21.15.141:0/1405271775 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb610154480 0x7fb6100ca9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb6100c88f0 tx=0x7fb6000090f0).stop 2023-11-15T01:21:19.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.591+0000 7fb616950700 1 -- 172.21.15.141:0/1405271775 shutdown_connections 2023-11-15T01:21:19.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.591+0000 7fb616950700 1 --2- 172.21.15.141:0/1405271775 >> v2:172.21.15.1:3300/0 conn(0x7fb6101540a0 0x7fb6100ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.591+0000 7fb616950700 1 --2- 172.21.15.141:0/1405271775 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb610154480 0x7fb6100ca9d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.591+0000 7fb616950700 1 -- 172.21.15.141:0/1405271775 >> 172.21.15.141:0/1405271775 conn(0x7fb610064a70 msgr2=0x7fb610064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:19.598 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.591+0000 7fb616950700 1 -- 172.21.15.141:0/1405271775 shutdown_connections 2023-11-15T01:21:19.598 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.591+0000 7fb616950700 1 -- 172.21.15.141:0/1405271775 wait complete. 2023-11-15T01:21:19.598 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.592+0000 7fb616950700 1 Processor -- start 2023-11-15T01:21:19.598 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.592+0000 7fb616950700 1 -- start start 2023-11-15T01:21:19.601 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb616950700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6100c5f40 0x7fb6100b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:19.601 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb616950700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6101540a0 0x7fb610159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:19.601 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb616950700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb610154480 0x7fb6100c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:19.601 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb616950700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100c3fa0 con 0x7fb6100c5f40 2023-11-15T01:21:19.601 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb616950700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100c3390 con 0x7fb610154480 2023-11-15T01:21:19.602 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb616950700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100c3670 con 0x7fb6101540a0 2023-11-15T01:21:19.602 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb614eed700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb610154480 0x7fb6100c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:19.602 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb60f7fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6101540a0 0x7fb610159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:19.602 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb60f7fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6101540a0 0x7fb610159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:51980/0 (socket says 172.21.15.141:51980) 2023-11-15T01:21:19.602 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb60f7fe700 1 -- 172.21.15.141:0/3740888021 learned_addr learned my addr 172.21.15.141:0/3740888021 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-15T01:21:19.603 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb614eed700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb610154480 0x7fb6100c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:56552/0 (socket says 172.21.15.141:56552) 2023-11-15T01:21:19.603 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb60ffff700 1 --2- 172.21.15.141:0/3740888021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6100c5f40 0x7fb6100b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:19.603 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb614eed700 1 -- 172.21.15.141:0/3740888021 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6101540a0 msgr2=0x7fb610159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:19.603 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb614eed700 1 --2- 172.21.15.141:0/3740888021 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6101540a0 0x7fb610159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.603 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb614eed700 1 -- 172.21.15.141:0/3740888021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6100c5f40 msgr2=0x7fb6100b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:19.603 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb614eed700 1 --2- 172.21.15.141:0/3740888021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6100c5f40 0x7fb6100b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.604 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb614eed700 1 -- 172.21.15.141:0/3740888021 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb600009370 con 0x7fb610154480 2023-11-15T01:21:19.604 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb60f7fe700 1 --2- 172.21.15.141:0/3740888021 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6101540a0 0x7fb610159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:19.604 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb614eed700 1 --2- 172.21.15.141:0/3740888021 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb610154480 0x7fb6100c4430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fb608002230 tx=0x7fb608007eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:19.604 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb5f7fff700 1 -- 172.21.15.141:0/3740888021 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608005c70 con 0x7fb610154480 2023-11-15T01:21:19.604 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb5f7fff700 1 -- 172.21.15.141:0/3740888021 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb608005df0 con 0x7fb610154480 2023-11-15T01:21:19.605 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb616950700 1 -- 172.21.15.141:0/3740888021 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6100c3950 con 0x7fb610154480 2023-11-15T01:21:19.605 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb5f7fff700 1 -- 172.21.15.141:0/3740888021 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608007360 con 0x7fb610154480 2023-11-15T01:21:19.605 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.593+0000 7fb616950700 1 -- 172.21.15.141:0/3740888021 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6100b0f80 con 0x7fb610154480 2023-11-15T01:21:19.605 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.594+0000 7fb5f7fff700 1 -- 172.21.15.141:0/3740888021 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fb60801d440 con 0x7fb610154480 2023-11-15T01:21:19.605 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.594+0000 7fb5f7fff700 1 -- 172.21.15.141:0/3740888021 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fb608013780 con 0x7fb610154480 2023-11-15T01:21:19.606 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.594+0000 7fb616950700 1 -- 172.21.15.141:0/3740888021 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6100c4110 con 0x7fb610154480 2023-11-15T01:21:19.606 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.597+0000 7fb5f7fff700 1 -- 172.21.15.141:0/3740888021 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fb60801d920 con 0x7fb610154480 2023-11-15T01:21:19.633 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:19.632+0000 7fcd21cc3680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:21:19.666 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:19.664+0000 7f78fb56f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:21:19.678 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.677+0000 7fb616950700 1 -- 172.21.15.141:0/3740888021 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd new", "uuid": "258e1dda-d8fc-4fb3-9b0b-450f861dc57b", "id": 0} v 0) v1 -- 0x7fb61006c7e0 con 0x7fb610154480 2023-11-15T01:21:19.684 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.683+0000 7fb5f7fff700 1 -- 172.21.15.141:0/3740888021 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "258e1dda-d8fc-4fb3-9b0b-450f861dc57b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb60801dac0 con 0x7fb610154480 2023-11-15T01:21:19.684 INFO:teuthology.orchestra.run.smithi141.stdout:0 2023-11-15T01:21:19.685 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.684+0000 7fb616950700 1 -- 172.21.15.141:0/3740888021 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb610154480 msgr2=0x7fb6100c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:19.685 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.684+0000 7fb616950700 1 --2- 172.21.15.141:0/3740888021 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb610154480 0x7fb6100c4430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fb608002230 tx=0x7fb608007eb0).stop 2023-11-15T01:21:19.685 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.684+0000 7fb616950700 1 -- 172.21.15.141:0/3740888021 shutdown_connections 2023-11-15T01:21:19.685 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.684+0000 7fb616950700 1 --2- 172.21.15.141:0/3740888021 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb610154480 0x7fb6100c4430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.686 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.684+0000 7fb616950700 1 --2- 172.21.15.141:0/3740888021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6100c5f40 0x7fb6100b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.686 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.684+0000 7fb616950700 1 --2- 172.21.15.141:0/3740888021 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6101540a0 0x7fb610159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.686 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.684+0000 7fb616950700 1 -- 172.21.15.141:0/3740888021 >> 172.21.15.141:0/3740888021 conn(0x7fb610064a70 msgr2=0x7fb610064e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:19.686 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.684+0000 7fb616950700 1 -- 172.21.15.141:0/3740888021 shutdown_connections 2023-11-15T01:21:19.686 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.684+0000 7fb616950700 1 -- 172.21.15.141:0/3740888021 wait complete. 2023-11-15T01:21:19.696 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new f5eaa189-2d2d-49f4-937c-36beb144c6a5 1 2023-11-15T01:21:19.812 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.811+0000 7f1aca16d700 1 Processor -- start 2023-11-15T01:21:19.812 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.811+0000 7f1aca16d700 1 -- start start 2023-11-15T01:21:19.815 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1aca16d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1ac414e6e0 0x7f1ac414eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:19.815 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1aca16d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ac4155370 0x7f1ac40627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:19.815 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1aca16d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac4158e40 con 0x7f1ac4062ca0 2023-11-15T01:21:19.815 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1aca16d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac4063110 con 0x7f1ac414e6e0 2023-11-15T01:21:19.816 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1aca16d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac4158230 con 0x7f1ac4155370 2023-11-15T01:21:19.816 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1abbfff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ac4155370 0x7f1ac40627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:19.816 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1abbfff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ac4155370 0x7f1ac40627b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:51992/0 (socket says 172.21.15.141:51992) 2023-11-15T01:21:19.816 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1abbfff700 1 -- 172.21.15.141:0/3273226 learned_addr learned my addr 172.21.15.141:0/3273226 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-15T01:21:19.816 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1ac37fe700 1 --2- 172.21.15.141:0/3273226 >> v2:172.21.15.1:3300/0 conn(0x7f1ac414e6e0 0x7f1ac414eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:19.817 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1abbfff700 1 -- 172.21.15.141:0/3273226 >> v2:172.21.15.1:3300/0 conn(0x7f1ac414e6e0 msgr2=0x7f1ac414eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:19.817 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1abbfff700 1 --2- 172.21.15.141:0/3273226 >> v2:172.21.15.1:3300/0 conn(0x7f1ac414e6e0 0x7f1ac414eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.817 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1abbfff700 1 -- 172.21.15.141:0/3273226 >> v1:172.21.15.1:6789/0 conn(0x7f1ac4062ca0 legacy=0x7f1ac4069610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:19.817 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1abbfff700 1 -- 172.21.15.141:0/3273226 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac4158510 con 0x7f1ac4155370 2023-11-15T01:21:19.817 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1abbfff700 1 --2- 172.21.15.141:0/3273226 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ac4155370 0x7f1ac40627b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f1aac006fd0 tx=0x7f1aac0090f0).ready entity=mon.2 client_cookie=ffb352372cec02f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:19.818 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1ac2ffd700 1 -- 172.21.15.141:0/3273226 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac00b580 con 0x7f1ac4155370 2023-11-15T01:21:19.818 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1ac2ffd700 1 -- 172.21.15.141:0/3273226 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac00b6e0 con 0x7f1ac4155370 2023-11-15T01:21:19.818 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.812+0000 7f1ac2ffd700 1 -- 172.21.15.141:0/3273226 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac00ba60 con 0x7f1ac4155370 2023-11-15T01:21:19.818 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.813+0000 7f1aca16d700 1 -- 172.21.15.141:0/3273226 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ac4155370 msgr2=0x7f1ac40627b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:19.818 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.813+0000 7f1aca16d700 1 --2- 172.21.15.141:0/3273226 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ac4155370 0x7f1ac40627b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f1aac006fd0 tx=0x7f1aac0090f0).stop 2023-11-15T01:21:19.819 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.813+0000 7f1aca16d700 1 -- 172.21.15.141:0/3273226 shutdown_connections 2023-11-15T01:21:19.819 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.813+0000 7f1aca16d700 1 --2- 172.21.15.141:0/3273226 >> v2:172.21.15.1:3300/0 conn(0x7f1ac414e6e0 0x7f1ac414eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.819 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.813+0000 7f1aca16d700 1 --2- 172.21.15.141:0/3273226 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ac4155370 0x7f1ac40627b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.819 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.813+0000 7f1aca16d700 1 -- 172.21.15.141:0/3273226 >> 172.21.15.141:0/3273226 conn(0x7f1ac40c7dc0 msgr2=0x7f1ac40c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:19.819 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.813+0000 7f1aca16d700 1 -- 172.21.15.141:0/3273226 shutdown_connections 2023-11-15T01:21:19.820 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.813+0000 7f1aca16d700 1 -- 172.21.15.141:0/3273226 wait complete. 2023-11-15T01:21:19.820 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.814+0000 7f1aca16d700 1 Processor -- start 2023-11-15T01:21:19.820 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.814+0000 7f1aca16d700 1 -- start start 2023-11-15T01:21:19.822 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1aca16d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ac4062ca0 0x7f1ac4168060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:19.822 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1aca16d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ac414e6e0 0x7f1ac41672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:19.823 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1aca16d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ac4155370 0x7f1ac41677d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:19.823 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1aca16d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac4167cc0 con 0x7f1ac4155370 2023-11-15T01:21:19.823 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1aca16d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac40aa6d0 con 0x7f1ac4062ca0 2023-11-15T01:21:19.823 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1aca16d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac40a9ac0 con 0x7f1ac414e6e0 2023-11-15T01:21:19.824 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1abbfff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ac414e6e0 0x7f1ac41672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:19.824 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1ac37fe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ac4062ca0 0x7f1ac4168060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:19.824 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1abbfff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ac414e6e0 0x7f1ac41672e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:52006/0 (socket says 172.21.15.141:52006) 2023-11-15T01:21:19.824 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1abbfff700 1 -- 172.21.15.141:0/2594848622 learned_addr learned my addr 172.21.15.141:0/2594848622 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-15T01:21:19.824 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1ac3fff700 1 --2- 172.21.15.141:0/2594848622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ac4155370 0x7f1ac41677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:19.825 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1abbfff700 1 -- 172.21.15.141:0/2594848622 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ac4062ca0 msgr2=0x7f1ac4168060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:19.825 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1abbfff700 1 --2- 172.21.15.141:0/2594848622 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ac4062ca0 0x7f1ac4168060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.825 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1abbfff700 1 -- 172.21.15.141:0/2594848622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ac4155370 msgr2=0x7f1ac41677d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:19.825 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1abbfff700 1 --2- 172.21.15.141:0/2594848622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ac4155370 0x7f1ac41677d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.825 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1abbfff700 1 -- 172.21.15.141:0/2594848622 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac009370 con 0x7f1ac414e6e0 2023-11-15T01:21:19.826 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1abbfff700 1 --2- 172.21.15.141:0/2594848622 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ac414e6e0 0x7f1ac41672e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1ac4158370 tx=0x7f1aac017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:19.826 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1abb7fe700 1 -- 172.21.15.141:0/2594848622 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac000bc0 con 0x7f1ac414e6e0 2023-11-15T01:21:19.826 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1abb7fe700 1 -- 172.21.15.141:0/2594848622 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac00b850 con 0x7f1ac414e6e0 2023-11-15T01:21:19.826 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1aca16d700 1 -- 172.21.15.141:0/2594848622 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac40a9da0 con 0x7f1ac414e6e0 2023-11-15T01:21:19.826 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.815+0000 7f1abb7fe700 1 -- 172.21.15.141:0/2594848622 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac000d20 con 0x7f1ac414e6e0 2023-11-15T01:21:19.827 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.816+0000 7f1aca16d700 1 -- 172.21.15.141:0/2594848622 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac40aa360 con 0x7f1ac414e6e0 2023-11-15T01:21:19.827 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.816+0000 7f1abb7fe700 1 -- 172.21.15.141:0/2594848622 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f1aac01ccf0 con 0x7f1ac414e6e0 2023-11-15T01:21:19.827 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.816+0000 7f1abb7fe700 1 -- 172.21.15.141:0/2594848622 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f1aac027840 con 0x7f1ac414e6e0 2023-11-15T01:21:19.827 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.817+0000 7f1aca16d700 1 -- 172.21.15.141:0/2594848622 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac406c7e0 con 0x7f1ac414e6e0 2023-11-15T01:21:19.827 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.819+0000 7f1abb7fe700 1 -- 172.21.15.141:0/2594848622 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f1aac02c060 con 0x7f1ac414e6e0 2023-11-15T01:21:19.932 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.931+0000 7f1aca16d700 1 -- 172.21.15.141:0/2594848622 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f5eaa189-2d2d-49f4-937c-36beb144c6a5", "id": 1} v 0) v1 -- 0x7f1ac41587f0 con 0x7f1ac414e6e0 2023-11-15T01:21:19.939 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.939+0000 7f1abb7fe700 1 -- 172.21.15.141:0/2594848622 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f5eaa189-2d2d-49f4-937c-36beb144c6a5", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1aac022070 con 0x7f1ac414e6e0 2023-11-15T01:21:19.940 INFO:teuthology.orchestra.run.smithi141.stdout:1 2023-11-15T01:21:19.941 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.940+0000 7f1aca16d700 1 -- 172.21.15.141:0/2594848622 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ac414e6e0 msgr2=0x7f1ac41672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:19.941 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.940+0000 7f1aca16d700 1 --2- 172.21.15.141:0/2594848622 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ac414e6e0 0x7f1ac41672e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1ac4158370 tx=0x7f1aac017000).stop 2023-11-15T01:21:19.941 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.940+0000 7f1aca16d700 1 -- 172.21.15.141:0/2594848622 shutdown_connections 2023-11-15T01:21:19.941 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.940+0000 7f1aca16d700 1 --2- 172.21.15.141:0/2594848622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ac4155370 0x7f1ac41677d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.942 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.940+0000 7f1aca16d700 1 --2- 172.21.15.141:0/2594848622 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ac4062ca0 0x7f1ac4168060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.942 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.940+0000 7f1aca16d700 1 --2- 172.21.15.141:0/2594848622 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ac414e6e0 0x7f1ac41672e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:19.942 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.940+0000 7f1aca16d700 1 -- 172.21.15.141:0/2594848622 >> 172.21.15.141:0/2594848622 conn(0x7f1ac40c7dc0 msgr2=0x7f1ac4139c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:19.942 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.940+0000 7f1aca16d700 1 -- 172.21.15.141:0/2594848622 shutdown_connections 2023-11-15T01:21:19.942 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:19.940+0000 7f1aca16d700 1 -- 172.21.15.141:0/2594848622 wait complete. 2023-11-15T01:21:19.956 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new 07abd0db-e8ff-4edb-8f1d-d8f6b878f182 2 2023-11-15T01:21:20.070 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.069+0000 7f560fe5d700 1 Processor -- start 2023-11-15T01:21:20.071 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.070+0000 7f560fe5d700 1 -- start start 2023-11-15T01:21:20.073 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.070+0000 7f560fe5d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56081540a0 0x7f56080ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.073 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.070+0000 7f560fe5d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56080ca050 con 0x7f56080c6650 2023-11-15T01:21:20.073 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.070+0000 7f560fe5d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56080c9440 con 0x7f5608154480 2023-11-15T01:21:20.073 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.070+0000 7f560fe5d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080c9720 con 0x7f56081540a0 2023-11-15T01:21:20.074 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.071+0000 7f560dbf9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56081540a0 0x7f56080ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.074 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.071+0000 7f560d3f8700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f5608154480 0x7f56080c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.141:54072/0 (socket says 172.21.15.141:54072) 2023-11-15T01:21:20.074 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.071+0000 7f560d3f8700 1 -- 172.21.15.141:0/1704843397 learned_addr learned my addr 172.21.15.141:0/1704843397 (peer_addr_for_me v1:172.21.15.141:0/0) 2023-11-15T01:21:20.074 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.071+0000 7f560cbf7700 1 -- 172.21.15.141:0/1704843397 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151579046 0 0) 0x7f56080c9440 con 0x7f5608154480 2023-11-15T01:21:20.074 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.071+0000 7f560cbf7700 1 -- 172.21.15.141:0/1704843397 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f40033f0 con 0x7f5608154480 2023-11-15T01:21:20.075 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.071+0000 7f560dbf9700 1 -- 172.21.15.141:0/1704843397 >> v1:172.21.15.141:6789/0 conn(0x7f5608154480 legacy=0x7f56080c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.075 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.071+0000 7f560dbf9700 1 -- 172.21.15.141:0/1704843397 >> v1:172.21.15.1:6789/0 conn(0x7f56080c6650 legacy=0x7f56080aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.075 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.071+0000 7f560dbf9700 1 -- 172.21.15.141:0/1704843397 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56080c9a00 con 0x7f56081540a0 2023-11-15T01:21:20.075 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.071+0000 7f560dbf9700 1 --2- 172.21.15.141:0/1704843397 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56081540a0 0x7f56080ca4e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f55f8009790 tx=0x7f55f8009060).ready entity=mon.2 client_cookie=c70c45bcd13e35c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:20.075 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.071+0000 7f560cbf7700 1 -- 172.21.15.141:0/1704843397 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f800f510 con 0x7f56081540a0 2023-11-15T01:21:20.076 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.071+0000 7f560cbf7700 1 -- 172.21.15.141:0/1704843397 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f800f670 con 0x7f56081540a0 2023-11-15T01:21:20.076 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.071+0000 7f560cbf7700 1 -- 172.21.15.141:0/1704843397 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f800f9f0 con 0x7f56081540a0 2023-11-15T01:21:20.076 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.072+0000 7f560fe5d700 1 -- 172.21.15.141:0/1704843397 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56081540a0 msgr2=0x7f56080ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.076 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.072+0000 7f560fe5d700 1 --2- 172.21.15.141:0/1704843397 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56081540a0 0x7f56080ca4e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f55f8009790 tx=0x7f55f8009060).stop 2023-11-15T01:21:20.076 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.072+0000 7f560fe5d700 1 -- 172.21.15.141:0/1704843397 shutdown_connections 2023-11-15T01:21:20.077 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.072+0000 7f560fe5d700 1 --2- 172.21.15.141:0/1704843397 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56081540a0 0x7f56080ca4e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.077 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.072+0000 7f560fe5d700 1 -- 172.21.15.141:0/1704843397 >> 172.21.15.141:0/1704843397 conn(0x7f5608064a70 msgr2=0x7f5608064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:20.077 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.072+0000 7f560fe5d700 1 -- 172.21.15.141:0/1704843397 shutdown_connections 2023-11-15T01:21:20.077 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.072+0000 7f560fe5d700 1 -- 172.21.15.141:0/1704843397 wait complete. 2023-11-15T01:21:20.080 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.073+0000 7f560fe5d700 1 Processor -- start 2023-11-15T01:21:20.080 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.073+0000 7f560fe5d700 1 -- start start 2023-11-15T01:21:20.080 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560fe5d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56080c6650 0x7f560814db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.080 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560fe5d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56081540a0 0x7f56080c1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.081 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560fe5d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5608154480 0x7f56080c1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.081 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560fe5d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5608152740 con 0x7f5608154480 2023-11-15T01:21:20.081 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560fe5d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080a1e10 con 0x7f56080c6650 2023-11-15T01:21:20.081 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560fe5d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080c1c70 con 0x7f56081540a0 2023-11-15T01:21:20.081 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560d3f8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56081540a0 0x7f56080c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.081 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560dbf9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56080c6650 0x7f560814db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.082 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560d3f8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56081540a0 0x7f56080c1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:52016/0 (socket says 172.21.15.141:52016) 2023-11-15T01:21:20.082 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560d3f8700 1 -- 172.21.15.141:0/379099497 learned_addr learned my addr 172.21.15.141:0/379099497 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-15T01:21:20.082 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560e3fa700 1 --2- 172.21.15.141:0/379099497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5608154480 0x7f56080c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.082 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560d3f8700 1 -- 172.21.15.141:0/379099497 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56080c6650 msgr2=0x7f560814db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.082 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560d3f8700 1 --2- 172.21.15.141:0/379099497 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56080c6650 0x7f560814db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.083 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560d3f8700 1 -- 172.21.15.141:0/379099497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5608154480 msgr2=0x7f56080c1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.083 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560d3f8700 1 --2- 172.21.15.141:0/379099497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5608154480 0x7f56080c1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.083 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560d3f8700 1 -- 172.21.15.141:0/379099497 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f80092a0 con 0x7f56081540a0 2023-11-15T01:21:20.083 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560dbf9700 1 --2- 172.21.15.141:0/379099497 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56080c6650 0x7f560814db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:20.083 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560d3f8700 1 --2- 172.21.15.141:0/379099497 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56081540a0 0x7f56080c1290 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f560400c420 tx=0x7f5604007c50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:20.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f55fdffb700 1 -- 172.21.15.141:0/379099497 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56040070d0 con 0x7f56081540a0 2023-11-15T01:21:20.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f55fdffb700 1 -- 172.21.15.141:0/379099497 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5604007230 con 0x7f56081540a0 2023-11-15T01:21:20.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.074+0000 7f560fe5d700 1 -- 172.21.15.141:0/379099497 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560814b920 con 0x7f56081540a0 2023-11-15T01:21:20.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.075+0000 7f55fdffb700 1 -- 172.21.15.141:0/379099497 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56040075d0 con 0x7f56081540a0 2023-11-15T01:21:20.085 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.075+0000 7f55fdffb700 1 -- 172.21.15.141:0/379099497 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f5604005c10 con 0x7f56081540a0 2023-11-15T01:21:20.085 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.075+0000 7f560fe5d700 1 -- 172.21.15.141:0/379099497 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5608152180 con 0x7f56081540a0 2023-11-15T01:21:20.085 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.075+0000 7f55fdffb700 1 -- 172.21.15.141:0/379099497 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f5604013da0 con 0x7f56081540a0 2023-11-15T01:21:20.085 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.076+0000 7f560fe5d700 1 -- 172.21.15.141:0/379099497 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560814bab0 con 0x7f56081540a0 2023-11-15T01:21:20.085 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.078+0000 7f55fdffb700 1 -- 172.21.15.141:0/379099497 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f5604018070 con 0x7f56081540a0 2023-11-15T01:21:20.157 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.156+0000 7f560fe5d700 1 -- 172.21.15.141:0/379099497 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd new", "uuid": "07abd0db-e8ff-4edb-8f1d-d8f6b878f182", "id": 2} v 0) v1 -- 0x7f560806c7e0 con 0x7f56081540a0 2023-11-15T01:21:20.165 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.164+0000 7f55fdffb700 1 -- 172.21.15.141:0/379099497 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "07abd0db-e8ff-4edb-8f1d-d8f6b878f182", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5604013510 con 0x7f56081540a0 2023-11-15T01:21:20.165 INFO:teuthology.orchestra.run.smithi141.stdout:2 2023-11-15T01:21:20.166 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.165+0000 7f560fe5d700 1 -- 172.21.15.141:0/379099497 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56081540a0 msgr2=0x7f56080c1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.167 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.165+0000 7f560fe5d700 1 --2- 172.21.15.141:0/379099497 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56081540a0 0x7f56080c1290 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f560400c420 tx=0x7f5604007c50).stop 2023-11-15T01:21:20.167 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.165+0000 7f560fe5d700 1 -- 172.21.15.141:0/379099497 shutdown_connections 2023-11-15T01:21:20.167 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.165+0000 7f560fe5d700 1 --2- 172.21.15.141:0/379099497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5608154480 0x7f56080c1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.167 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.165+0000 7f560fe5d700 1 --2- 172.21.15.141:0/379099497 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56080c6650 0x7f560814db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.167 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.165+0000 7f560fe5d700 1 --2- 172.21.15.141:0/379099497 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56081540a0 0x7f56080c1290 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.168 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.165+0000 7f560fe5d700 1 -- 172.21.15.141:0/379099497 >> 172.21.15.141:0/379099497 conn(0x7f5608064a70 msgr2=0x7f56080ab6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:20.168 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.165+0000 7f560fe5d700 1 -- 172.21.15.141:0/379099497 shutdown_connections 2023-11-15T01:21:20.168 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.165+0000 7f560fe5d700 1 -- 172.21.15.141:0/379099497 wait complete. 2023-11-15T01:21:20.178 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new abb82def-5a3e-4448-bcac-91eabf9d8918 3 2023-11-15T01:21:20.294 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.293+0000 7fb863680700 1 Processor -- start 2023-11-15T01:21:20.295 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.293+0000 7fb863680700 1 -- start start 2023-11-15T01:21:20.297 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.294+0000 7fb863680700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb85c1540a0 0x7fb85c0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.297 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.294+0000 7fb863680700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85c0ca050 con 0x7fb85c0c6650 2023-11-15T01:21:20.298 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.294+0000 7fb863680700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85c0c9440 con 0x7fb85c154480 2023-11-15T01:21:20.298 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.294+0000 7fb863680700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85c0c9720 con 0x7fb85c1540a0 2023-11-15T01:21:20.298 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.294+0000 7fb860c1b700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fb85c154480 0x7fb85c0c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.141:54076/0 (socket says 172.21.15.141:54076) 2023-11-15T01:21:20.298 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.294+0000 7fb860c1b700 1 -- 172.21.15.141:0/758801283 learned_addr learned my addr 172.21.15.141:0/758801283 (peer_addr_for_me v1:172.21.15.141:0/0) 2023-11-15T01:21:20.299 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.295+0000 7fb86141c700 1 --2- 172.21.15.141:0/758801283 >> v2:172.21.15.1:3300/0 conn(0x7fb85c1540a0 0x7fb85c0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.299 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.295+0000 7fb84ffff700 1 -- 172.21.15.141:0/758801283 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198366596 0 0) 0x7fb85c0c9440 con 0x7fb85c154480 2023-11-15T01:21:20.299 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.295+0000 7fb84ffff700 1 -- 172.21.15.141:0/758801283 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8480033f0 con 0x7fb85c154480 2023-11-15T01:21:20.299 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.295+0000 7fb84ffff700 1 -- 172.21.15.141:0/758801283 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755332568 0 0) 0x7fb85c0ca050 con 0x7fb85c0c6650 2023-11-15T01:21:20.299 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.295+0000 7fb84ffff700 1 -- 172.21.15.141:0/758801283 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb85c0c9440 con 0x7fb85c0c6650 2023-11-15T01:21:20.300 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.295+0000 7fb86141c700 1 -- 172.21.15.141:0/758801283 >> v1:172.21.15.141:6789/0 conn(0x7fb85c154480 legacy=0x7fb85c0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.300 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.295+0000 7fb86141c700 1 -- 172.21.15.141:0/758801283 >> v1:172.21.15.1:6789/0 conn(0x7fb85c0c6650 legacy=0x7fb85c0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.300 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.295+0000 7fb86141c700 1 -- 172.21.15.141:0/758801283 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c0c9a00 con 0x7fb85c1540a0 2023-11-15T01:21:20.300 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.295+0000 7fb86141c700 1 --2- 172.21.15.141:0/758801283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb85c1540a0 0x7fb85c0ca4e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fb858009760 tx=0x7fb858009060).ready entity=mon.0 client_cookie=f81883bd4283dde6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:20.300 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.295+0000 7fb84ffff700 1 -- 172.21.15.141:0/758801283 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800d4a0 con 0x7fb85c1540a0 2023-11-15T01:21:20.301 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.295+0000 7fb84ffff700 1 -- 172.21.15.141:0/758801283 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85800d600 con 0x7fb85c1540a0 2023-11-15T01:21:20.301 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.295+0000 7fb84ffff700 1 -- 172.21.15.141:0/758801283 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800d980 con 0x7fb85c1540a0 2023-11-15T01:21:20.301 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.296+0000 7fb863680700 1 -- 172.21.15.141:0/758801283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb85c1540a0 msgr2=0x7fb85c0ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.301 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.296+0000 7fb863680700 1 --2- 172.21.15.141:0/758801283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb85c1540a0 0x7fb85c0ca4e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fb858009760 tx=0x7fb858009060).stop 2023-11-15T01:21:20.301 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.296+0000 7fb863680700 1 -- 172.21.15.141:0/758801283 shutdown_connections 2023-11-15T01:21:20.302 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.296+0000 7fb863680700 1 --2- 172.21.15.141:0/758801283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb85c1540a0 0x7fb85c0ca4e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.302 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.296+0000 7fb863680700 1 -- 172.21.15.141:0/758801283 >> 172.21.15.141:0/758801283 conn(0x7fb85c064a70 msgr2=0x7fb85c064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:20.302 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.296+0000 7fb863680700 1 -- 172.21.15.141:0/758801283 shutdown_connections 2023-11-15T01:21:20.302 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.296+0000 7fb863680700 1 -- 172.21.15.141:0/758801283 wait complete. 2023-11-15T01:21:20.305 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.297+0000 7fb863680700 1 Processor -- start 2023-11-15T01:21:20.305 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.297+0000 7fb863680700 1 -- start start 2023-11-15T01:21:20.305 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb863680700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb85c0c6650 0x7fb85c148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.305 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb863680700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb85c1540a0 0x7fb85c0a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb863680700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb85c154480 0x7fb85c0a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb863680700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0a5390 con 0x7fb85c1540a0 2023-11-15T01:21:20.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb863680700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c165950 con 0x7fb85c0c6650 2023-11-15T01:21:20.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb863680700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0b0020 con 0x7fb85c154480 2023-11-15T01:21:20.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb86141c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb85c0c6650 0x7fb85c148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb86141c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb85c0c6650 0x7fb85c148ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:56570/0 (socket says 172.21.15.141:56570) 2023-11-15T01:21:20.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb861c1d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb85c154480 0x7fb85c0a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb86141c700 1 -- 172.21.15.141:0/1313317357 learned_addr learned my addr 172.21.15.141:0/1313317357 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-15T01:21:20.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb860c1b700 1 --2- 172.21.15.141:0/1313317357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb85c1540a0 0x7fb85c0a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb861c1d700 1 -- 172.21.15.141:0/1313317357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb85c0c6650 msgr2=0x7fb85c148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.308 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb861c1d700 1 --2- 172.21.15.141:0/1313317357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb85c0c6650 0x7fb85c148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.308 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb861c1d700 1 -- 172.21.15.141:0/1313317357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb85c1540a0 msgr2=0x7fb85c0a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.308 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb861c1d700 1 --2- 172.21.15.141:0/1313317357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb85c1540a0 0x7fb85c0a49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.308 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb861c1d700 1 -- 172.21.15.141:0/1313317357 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8580092a0 con 0x7fb85c154480 2023-11-15T01:21:20.308 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb860c1b700 1 --2- 172.21.15.141:0/1313317357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb85c1540a0 0x7fb85c0a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:20.309 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.298+0000 7fb86141c700 1 --2- 172.21.15.141:0/1313317357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb85c0c6650 0x7fb85c148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:20.309 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.299+0000 7fb861c1d700 1 --2- 172.21.15.141:0/1313317357 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb85c154480 0x7fb85c0a4ea0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fb85c0aad30 tx=0x7fb854007ef0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:20.309 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.299+0000 7fb84d7fa700 1 -- 172.21.15.141:0/1313317357 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85400e4a0 con 0x7fb85c154480 2023-11-15T01:21:20.309 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.299+0000 7fb84d7fa700 1 -- 172.21.15.141:0/1313317357 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85400e600 con 0x7fb85c154480 2023-11-15T01:21:20.309 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.299+0000 7fb863680700 1 -- 172.21.15.141:0/1313317357 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c0b0300 con 0x7fb85c154480 2023-11-15T01:21:20.310 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.299+0000 7fb84d7fa700 1 -- 172.21.15.141:0/1313317357 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85400e980 con 0x7fb85c154480 2023-11-15T01:21:20.310 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.299+0000 7fb863680700 1 -- 172.21.15.141:0/1313317357 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c0b08c0 con 0x7fb85c154480 2023-11-15T01:21:20.310 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.299+0000 7fb84d7fa700 1 -- 172.21.15.141:0/1313317357 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fb85401c440 con 0x7fb85c154480 2023-11-15T01:21:20.311 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.299+0000 7fb84d7fa700 1 -- 172.21.15.141:0/1313317357 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7fb8540128c0 con 0x7fb85c154480 2023-11-15T01:21:20.311 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.300+0000 7fb863680700 1 -- 172.21.15.141:0/1313317357 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85c165ac0 con 0x7fb85c154480 2023-11-15T01:21:20.311 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.302+0000 7fb84d7fa700 1 -- 172.21.15.141:0/1313317357 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fb854021060 con 0x7fb85c154480 2023-11-15T01:21:20.387 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.386+0000 7fb863680700 1 -- 172.21.15.141:0/1313317357 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd new", "uuid": "abb82def-5a3e-4448-bcac-91eabf9d8918", "id": 3} v 0) v1 -- 0x7fb85c06c7e0 con 0x7fb85c154480 2023-11-15T01:21:20.397 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.396+0000 7fb84d7fa700 1 -- 172.21.15.141:0/1313317357 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "abb82def-5a3e-4448-bcac-91eabf9d8918", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb854017070 con 0x7fb85c154480 2023-11-15T01:21:20.398 INFO:teuthology.orchestra.run.smithi141.stdout:3 2023-11-15T01:21:20.399 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.397+0000 7fb863680700 1 -- 172.21.15.141:0/1313317357 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb85c154480 msgr2=0x7fb85c0a4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.399 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.397+0000 7fb863680700 1 --2- 172.21.15.141:0/1313317357 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb85c154480 0x7fb85c0a4ea0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fb85c0aad30 tx=0x7fb854007ef0).stop 2023-11-15T01:21:20.399 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.398+0000 7fb863680700 1 -- 172.21.15.141:0/1313317357 shutdown_connections 2023-11-15T01:21:20.399 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.398+0000 7fb863680700 1 --2- 172.21.15.141:0/1313317357 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb85c154480 0x7fb85c0a4ea0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.400 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.398+0000 7fb863680700 1 --2- 172.21.15.141:0/1313317357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb85c0c6650 0x7fb85c148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.400 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.398+0000 7fb863680700 1 --2- 172.21.15.141:0/1313317357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb85c1540a0 0x7fb85c0a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.400 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.398+0000 7fb863680700 1 -- 172.21.15.141:0/1313317357 >> 172.21.15.141:0/1313317357 conn(0x7fb85c064a70 msgr2=0x7fb85c0ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:20.400 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.398+0000 7fb863680700 1 -- 172.21.15.141:0/1313317357 shutdown_connections 2023-11-15T01:21:20.400 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.398+0000 7fb863680700 1 -- 172.21.15.141:0/1313317357 wait complete. 2023-11-15T01:21:20.413 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new 4820bf25-02bf-42ed-ac5e-e35b86be758a 4 2023-11-15T01:21:20.450 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:20.449+0000 7f78fb56f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:21:20.460 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:20.459+0000 7fcd21cc3680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:21:20.520 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:20.519+0000 7f78fb56f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:21:20.530 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:20.529+0000 7fcd21cc3680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:21:20.538 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.538+0000 7fa45c546700 1 Processor -- start 2023-11-15T01:21:20.539 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.538+0000 7fa45c546700 1 -- start start 2023-11-15T01:21:20.541 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa45c546700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa454154480 0x7fa4540c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.541 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa45c546700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa4540c6430 0x7fa4540aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.541 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa45c546700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4540ca050 con 0x7fa4541540a0 2023-11-15T01:21:20.541 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa45c546700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4540c68c0 con 0x7fa4540c6430 2023-11-15T01:21:20.542 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa45c546700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4540c9440 con 0x7fa454154480 2023-11-15T01:21:20.542 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa459ae1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa454154480 0x7fa4540c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.542 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa45a2e2700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fa4541540a0 0x7fa4540ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.141:54090/0 (socket says 172.21.15.141:54090) 2023-11-15T01:21:20.542 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa45a2e2700 1 -- 172.21.15.141:0/3118877299 learned_addr learned my addr 172.21.15.141:0/3118877299 (peer_addr_for_me v1:172.21.15.141:0/0) 2023-11-15T01:21:20.543 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa45aae3700 1 --2- 172.21.15.141:0/3118877299 >> v2:172.21.15.1:3300/0 conn(0x7fa4540c6430 0x7fa4540aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.543 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa459ae1700 1 -- 172.21.15.141:0/3118877299 >> v2:172.21.15.1:3300/0 conn(0x7fa4540c6430 msgr2=0x7fa4540aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:20.543 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa459ae1700 1 --2- 172.21.15.141:0/3118877299 >> v2:172.21.15.1:3300/0 conn(0x7fa4540c6430 0x7fa4540aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.543 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa459ae1700 1 -- 172.21.15.141:0/3118877299 >> v1:172.21.15.141:6789/0 conn(0x7fa4541540a0 legacy=0x7fa4540ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.543 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa459ae1700 1 -- 172.21.15.141:0/3118877299 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4540c9720 con 0x7fa454154480 2023-11-15T01:21:20.543 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa4592e0700 1 -- 172.21.15.141:0/3118877299 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245134528 0 0) 0x7fa4540ca050 con 0x7fa4541540a0 2023-11-15T01:21:20.544 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa459ae1700 1 --2- 172.21.15.141:0/3118877299 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa454154480 0x7fa4540c5f40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fa450009760 tx=0x7fa450009060).ready entity=mon.2 client_cookie=73b6583f41dfbfcb server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:20.544 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa4592e0700 1 -- 172.21.15.141:0/3118877299 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000f510 con 0x7fa454154480 2023-11-15T01:21:20.544 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa4592e0700 1 -- 172.21.15.141:0/3118877299 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45000f670 con 0x7fa454154480 2023-11-15T01:21:20.544 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.539+0000 7fa4592e0700 1 -- 172.21.15.141:0/3118877299 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000f9f0 con 0x7fa454154480 2023-11-15T01:21:20.544 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.540+0000 7fa45c546700 1 -- 172.21.15.141:0/3118877299 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa454154480 msgr2=0x7fa4540c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.545 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.540+0000 7fa45c546700 1 --2- 172.21.15.141:0/3118877299 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa454154480 0x7fa4540c5f40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fa450009760 tx=0x7fa450009060).stop 2023-11-15T01:21:20.545 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.540+0000 7fa45c546700 1 -- 172.21.15.141:0/3118877299 shutdown_connections 2023-11-15T01:21:20.545 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.540+0000 7fa45c546700 1 --2- 172.21.15.141:0/3118877299 >> v2:172.21.15.1:3300/0 conn(0x7fa4540c6430 0x7fa4540aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.545 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.540+0000 7fa45c546700 1 --2- 172.21.15.141:0/3118877299 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa454154480 0x7fa4540c5f40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.545 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.540+0000 7fa45c546700 1 -- 172.21.15.141:0/3118877299 >> 172.21.15.141:0/3118877299 conn(0x7fa454064a70 msgr2=0x7fa454064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:20.546 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.540+0000 7fa45c546700 1 -- 172.21.15.141:0/3118877299 shutdown_connections 2023-11-15T01:21:20.546 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.540+0000 7fa45c546700 1 -- 172.21.15.141:0/3118877299 wait complete. 2023-11-15T01:21:20.548 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.541+0000 7fa45c546700 1 Processor -- start 2023-11-15T01:21:20.549 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.541+0000 7fa45c546700 1 -- start start 2023-11-15T01:21:20.549 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45c546700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4540c6430 0x7fa454158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.549 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45c546700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4541540a0 0x7fa454152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.549 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45c546700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa454154480 0x7fa454152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.550 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45c546700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa454152c30 con 0x7fa4540c6430 2023-11-15T01:21:20.550 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45c546700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa454165d40 con 0x7fa4541540a0 2023-11-15T01:21:20.550 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45c546700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4540aff40 con 0x7fa454154480 2023-11-15T01:21:20.550 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45aae3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa454154480 0x7fa454152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.551 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa459ae1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4541540a0 0x7fa454152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.551 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45aae3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa454154480 0x7fa454152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:52042/0 (socket says 172.21.15.141:52042) 2023-11-15T01:21:20.551 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45aae3700 1 -- 172.21.15.141:0/2905174737 learned_addr learned my addr 172.21.15.141:0/2905174737 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-15T01:21:20.551 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45a2e2700 1 --2- 172.21.15.141:0/2905174737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4540c6430 0x7fa454158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.552 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45aae3700 1 -- 172.21.15.141:0/2905174737 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4541540a0 msgr2=0x7fa454152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.552 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45aae3700 1 --2- 172.21.15.141:0/2905174737 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4541540a0 0x7fa454152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.552 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45aae3700 1 -- 172.21.15.141:0/2905174737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4540c6430 msgr2=0x7fa454158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.552 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45aae3700 1 --2- 172.21.15.141:0/2905174737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4540c6430 0x7fa454158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.552 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45aae3700 1 -- 172.21.15.141:0/2905174737 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4500092a0 con 0x7fa454154480 2023-11-15T01:21:20.553 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa459ae1700 1 --2- 172.21.15.141:0/2905174737 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4541540a0 0x7fa454152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:20.553 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.542+0000 7fa45aae3700 1 --2- 172.21.15.141:0/2905174737 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa454154480 0x7fa454152740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fa44c009e20 tx=0x7fa44c00b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:20.553 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.543+0000 7fa44a7fc700 1 -- 172.21.15.141:0/2905174737 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c009b50 con 0x7fa454154480 2023-11-15T01:21:20.553 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.543+0000 7fa44a7fc700 1 -- 172.21.15.141:0/2905174737 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c00f040 con 0x7fa454154480 2023-11-15T01:21:20.553 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.543+0000 7fa45c546700 1 -- 172.21.15.141:0/2905174737 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4540b0220 con 0x7fa454154480 2023-11-15T01:21:20.553 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.543+0000 7fa44a7fc700 1 -- 172.21.15.141:0/2905174737 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c00ccb0 con 0x7fa454154480 2023-11-15T01:21:20.554 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.543+0000 7fa45c546700 1 -- 172.21.15.141:0/2905174737 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4540b07e0 con 0x7fa454154480 2023-11-15T01:21:20.554 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.543+0000 7fa44a7fc700 1 -- 172.21.15.141:0/2905174737 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fa44c013870 con 0x7fa454154480 2023-11-15T01:21:20.554 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.543+0000 7fa44a7fc700 1 -- 172.21.15.141:0/2905174737 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7fa44c01d990 con 0x7fa454154480 2023-11-15T01:21:20.554 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.544+0000 7fa45c546700 1 -- 172.21.15.141:0/2905174737 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa454165eb0 con 0x7fa454154480 2023-11-15T01:21:20.554 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.547+0000 7fa44a7fc700 1 -- 172.21.15.141:0/2905174737 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa44c013dc0 con 0x7fa454154480 2023-11-15T01:21:20.628 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.627+0000 7fa45c546700 1 -- 172.21.15.141:0/2905174737 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4820bf25-02bf-42ed-ac5e-e35b86be758a", "id": 4} v 0) v1 -- 0x7fa45406c7e0 con 0x7fa454154480 2023-11-15T01:21:20.636 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.635+0000 7fa44a7fc700 1 -- 172.21.15.141:0/2905174737 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4820bf25-02bf-42ed-ac5e-e35b86be758a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa44c01dc30 con 0x7fa454154480 2023-11-15T01:21:20.636 INFO:teuthology.orchestra.run.smithi141.stdout:4 2023-11-15T01:21:20.637 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.636+0000 7fa45c546700 1 -- 172.21.15.141:0/2905174737 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa454154480 msgr2=0x7fa454152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.638 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.636+0000 7fa45c546700 1 --2- 172.21.15.141:0/2905174737 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa454154480 0x7fa454152740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fa44c009e20 tx=0x7fa44c00b040).stop 2023-11-15T01:21:20.638 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.636+0000 7fa45c546700 1 -- 172.21.15.141:0/2905174737 shutdown_connections 2023-11-15T01:21:20.638 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.636+0000 7fa45c546700 1 --2- 172.21.15.141:0/2905174737 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa454154480 0x7fa454152740 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.638 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.636+0000 7fa45c546700 1 --2- 172.21.15.141:0/2905174737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4540c6430 0x7fa454158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.639 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.636+0000 7fa45c546700 1 --2- 172.21.15.141:0/2905174737 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4541540a0 0x7fa454152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.639 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.636+0000 7fa45c546700 1 -- 172.21.15.141:0/2905174737 >> 172.21.15.141:0/2905174737 conn(0x7fa454064a70 msgr2=0x7fa45414ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:20.639 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.636+0000 7fa45c546700 1 -- 172.21.15.141:0/2905174737 shutdown_connections 2023-11-15T01:21:20.639 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.637+0000 7fa45c546700 1 -- 172.21.15.141:0/2905174737 wait complete. 2023-11-15T01:21:20.649 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new 06808d54-5af3-4945-a877-b91d31656ae3 5 2023-11-15T01:21:20.715 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:20.714+0000 7f78fb56f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:21:20.729 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:20.729+0000 7fcd21cc3680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:21:20.770 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.762+0000 7fd69f8d0700 1 Processor -- start 2023-11-15T01:21:20.770 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.762+0000 7fd69f8d0700 1 -- start start 2023-11-15T01:21:20.770 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.763+0000 7fd69f8d0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd698154480 0x7fd6980c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.770 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.763+0000 7fd69f8d0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd6980c6430 0x7fd6980aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.771 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.763+0000 7fd69f8d0700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6980ca050 con 0x7fd6981540a0 2023-11-15T01:21:20.771 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.763+0000 7fd69f8d0700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6980c68c0 con 0x7fd6980c6430 2023-11-15T01:21:20.771 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.763+0000 7fd69f8d0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980c9440 con 0x7fd698154480 2023-11-15T01:21:20.771 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.763+0000 7fd69ce6b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd698154480 0x7fd6980c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.771 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.763+0000 7fd69d66c700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fd6981540a0 0x7fd6980ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.141:54102/0 (socket says 172.21.15.141:54102) 2023-11-15T01:21:20.772 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.763+0000 7fd69d66c700 1 -- 172.21.15.141:0/3230288268 learned_addr learned my addr 172.21.15.141:0/3230288268 (peer_addr_for_me v1:172.21.15.141:0/0) 2023-11-15T01:21:20.772 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.763+0000 7fd69de6d700 1 --2- 172.21.15.141:0/3230288268 >> v2:172.21.15.1:3300/0 conn(0x7fd6980c6430 0x7fd6980aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.772 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.763+0000 7fd69ce6b700 1 -- 172.21.15.141:0/3230288268 >> v2:172.21.15.1:3300/0 conn(0x7fd6980c6430 msgr2=0x7fd6980aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:20.772 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.763+0000 7fd69ce6b700 1 --2- 172.21.15.141:0/3230288268 >> v2:172.21.15.1:3300/0 conn(0x7fd6980c6430 0x7fd6980aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.772 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.763+0000 7fd69ce6b700 1 -- 172.21.15.141:0/3230288268 >> v1:172.21.15.141:6789/0 conn(0x7fd6981540a0 legacy=0x7fd6980ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.773 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.763+0000 7fd68ffff700 1 -- 172.21.15.141:0/3230288268 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275958961 0 0) 0x7fd6980ca050 con 0x7fd6981540a0 2023-11-15T01:21:20.773 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.763+0000 7fd69ce6b700 1 -- 172.21.15.141:0/3230288268 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6980c9720 con 0x7fd698154480 2023-11-15T01:21:20.773 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.763+0000 7fd69de6d700 1 --2- 172.21.15.141:0/3230288268 >> v2:172.21.15.1:3300/0 conn(0x7fd6980c6430 0x7fd6980aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:20.773 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.764+0000 7fd69ce6b700 1 --2- 172.21.15.141:0/3230288268 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd698154480 0x7fd6980c5f40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fd694009760 tx=0x7fd694009060).ready entity=mon.2 client_cookie=a126ed4f00b2b854 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:20.773 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.764+0000 7fd68ffff700 1 -- 172.21.15.141:0/3230288268 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69400b580 con 0x7fd698154480 2023-11-15T01:21:20.774 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.764+0000 7fd68ffff700 1 -- 172.21.15.141:0/3230288268 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69400b6e0 con 0x7fd698154480 2023-11-15T01:21:20.774 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.764+0000 7fd68ffff700 1 -- 172.21.15.141:0/3230288268 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69400ba60 con 0x7fd698154480 2023-11-15T01:21:20.774 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.764+0000 7fd69f8d0700 1 -- 172.21.15.141:0/3230288268 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd698154480 msgr2=0x7fd6980c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.774 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.764+0000 7fd69f8d0700 1 --2- 172.21.15.141:0/3230288268 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd698154480 0x7fd6980c5f40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fd694009760 tx=0x7fd694009060).stop 2023-11-15T01:21:20.775 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.764+0000 7fd69f8d0700 1 -- 172.21.15.141:0/3230288268 shutdown_connections 2023-11-15T01:21:20.775 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.764+0000 7fd69f8d0700 1 --2- 172.21.15.141:0/3230288268 >> v2:172.21.15.1:3300/0 conn(0x7fd6980c6430 0x7fd6980aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.775 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.764+0000 7fd69f8d0700 1 --2- 172.21.15.141:0/3230288268 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd698154480 0x7fd6980c5f40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.775 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.764+0000 7fd69f8d0700 1 -- 172.21.15.141:0/3230288268 >> 172.21.15.141:0/3230288268 conn(0x7fd698064a70 msgr2=0x7fd698064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:20.775 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.764+0000 7fd69f8d0700 1 -- 172.21.15.141:0/3230288268 shutdown_connections 2023-11-15T01:21:20.775 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.764+0000 7fd69f8d0700 1 -- 172.21.15.141:0/3230288268 wait complete. 2023-11-15T01:21:20.776 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.765+0000 7fd69f8d0700 1 Processor -- start 2023-11-15T01:21:20.776 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.765+0000 7fd69f8d0700 1 -- start start 2023-11-15T01:21:20.776 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.766+0000 7fd69f8d0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6980c6430 0x7fd69814cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.776 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.766+0000 7fd69f8d0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6981540a0 0x7fd698152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.776 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.766+0000 7fd69f8d0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd698154480 0x7fd6980ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.777 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.766+0000 7fd69f8d0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980afa20 con 0x7fd698154480 2023-11-15T01:21:20.777 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.766+0000 7fd69f8d0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69814d050 con 0x7fd6980c6430 2023-11-15T01:21:20.777 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.766+0000 7fd69f8d0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd698153970 con 0x7fd6981540a0 2023-11-15T01:21:20.777 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.766+0000 7fd69d66c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6980c6430 0x7fd69814cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.777 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.766+0000 7fd69ce6b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6981540a0 0x7fd698152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.778 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.766+0000 7fd69d66c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6980c6430 0x7fd69814cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:56586/0 (socket says 172.21.15.141:56586) 2023-11-15T01:21:20.778 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.766+0000 7fd69d66c700 1 -- 172.21.15.141:0/2557429711 learned_addr learned my addr 172.21.15.141:0/2557429711 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-15T01:21:20.778 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.766+0000 7fd69ce6b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6981540a0 0x7fd698152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:52060/0 (socket says 172.21.15.141:52060) 2023-11-15T01:21:20.778 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.767+0000 7fd69de6d700 1 --2- 172.21.15.141:0/2557429711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd698154480 0x7fd6980ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.778 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.767+0000 7fd69ce6b700 1 -- 172.21.15.141:0/2557429711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6980c6430 msgr2=0x7fd69814cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.778 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.767+0000 7fd69ce6b700 1 --2- 172.21.15.141:0/2557429711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6980c6430 0x7fd69814cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.779 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.767+0000 7fd69ce6b700 1 -- 172.21.15.141:0/2557429711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd698154480 msgr2=0x7fd6980ab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.779 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.767+0000 7fd69ce6b700 1 --2- 172.21.15.141:0/2557429711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd698154480 0x7fd6980ab110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.779 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.767+0000 7fd69ce6b700 1 -- 172.21.15.141:0/2557429711 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6940092a0 con 0x7fd6981540a0 2023-11-15T01:21:20.779 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.767+0000 7fd69d66c700 1 --2- 172.21.15.141:0/2557429711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6980c6430 0x7fd69814cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:20.779 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.767+0000 7fd69ce6b700 1 --2- 172.21.15.141:0/2557429711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6981540a0 0x7fd698152d20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd694014000 tx=0x7fd694017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:20.780 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.767+0000 7fd68d7fa700 1 -- 172.21.15.141:0/2557429711 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd694000bc0 con 0x7fd6981540a0 2023-11-15T01:21:20.780 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.767+0000 7fd68d7fa700 1 -- 172.21.15.141:0/2557429711 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69400b850 con 0x7fd6981540a0 2023-11-15T01:21:20.780 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.767+0000 7fd69f8d0700 1 -- 172.21.15.141:0/2557429711 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd698153690 con 0x7fd6981540a0 2023-11-15T01:21:20.780 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.767+0000 7fd68d7fa700 1 -- 172.21.15.141:0/2557429711 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd694000d20 con 0x7fd6981540a0 2023-11-15T01:21:20.780 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.767+0000 7fd69f8d0700 1 -- 172.21.15.141:0/2557429711 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6980af6b0 con 0x7fd6981540a0 2023-11-15T01:21:20.780 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.767+0000 7fd68d7fa700 1 -- 172.21.15.141:0/2557429711 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fd69401bcc0 con 0x7fd6981540a0 2023-11-15T01:21:20.781 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.767+0000 7fd68d7fa700 1 -- 172.21.15.141:0/2557429711 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fd694024cd0 con 0x7fd6981540a0 2023-11-15T01:21:20.781 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.768+0000 7fd69f8d0700 1 -- 172.21.15.141:0/2557429711 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69806c7e0 con 0x7fd6981540a0 2023-11-15T01:21:20.781 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.770+0000 7fd68d7fa700 1 -- 172.21.15.141:0/2557429711 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fd694029060 con 0x7fd6981540a0 2023-11-15T01:21:20.851 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.850+0000 7fd69f8d0700 1 -- 172.21.15.141:0/2557429711 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd new", "uuid": "06808d54-5af3-4945-a877-b91d31656ae3", "id": 5} v 0) v1 -- 0x7fd6980c9a00 con 0x7fd6981540a0 2023-11-15T01:21:20.858 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.858+0000 7fd68d7fa700 1 -- 172.21.15.141:0/2557429711 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "06808d54-5af3-4945-a877-b91d31656ae3", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd69401f070 con 0x7fd6981540a0 2023-11-15T01:21:20.859 INFO:teuthology.orchestra.run.smithi141.stdout:5 2023-11-15T01:21:20.860 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.859+0000 7fd69f8d0700 1 -- 172.21.15.141:0/2557429711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6981540a0 msgr2=0x7fd698152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.860 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.859+0000 7fd69f8d0700 1 --2- 172.21.15.141:0/2557429711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6981540a0 0x7fd698152d20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd694014000 tx=0x7fd694017000).stop 2023-11-15T01:21:20.860 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.859+0000 7fd69f8d0700 1 -- 172.21.15.141:0/2557429711 shutdown_connections 2023-11-15T01:21:20.861 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.859+0000 7fd69f8d0700 1 --2- 172.21.15.141:0/2557429711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd698154480 0x7fd6980ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.861 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.859+0000 7fd69f8d0700 1 --2- 172.21.15.141:0/2557429711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6980c6430 0x7fd69814cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.861 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.859+0000 7fd69f8d0700 1 --2- 172.21.15.141:0/2557429711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6981540a0 0x7fd698152d20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.861 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.859+0000 7fd69f8d0700 1 -- 172.21.15.141:0/2557429711 >> 172.21.15.141:0/2557429711 conn(0x7fd698064a70 msgr2=0x7fd69814d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:20.861 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.859+0000 7fd69f8d0700 1 -- 172.21.15.141:0/2557429711 shutdown_connections 2023-11-15T01:21:20.862 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.859+0000 7fd69f8d0700 1 -- 172.21.15.141:0/2557429711 wait complete. 2023-11-15T01:21:20.871 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new c6b482bc-4eb0-44bf-8830-ccac8c9b1790 6 2023-11-15T01:21:20.990 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.989+0000 7fe43c100700 1 Processor -- start 2023-11-15T01:21:20.990 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.989+0000 7fe43c100700 1 -- start start 2023-11-15T01:21:20.993 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.990+0000 7fe43c100700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe434154480 0x7fe4340c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.993 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.990+0000 7fe43c100700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4340c6430 0x7fe4340aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:20.993 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.990+0000 7fe43c100700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4340ca050 con 0x7fe4341540a0 2023-11-15T01:21:20.993 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.990+0000 7fe43c100700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4340c68c0 con 0x7fe434154480 2023-11-15T01:21:20.994 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.990+0000 7fe43c100700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4340c9440 con 0x7fe4340c6430 2023-11-15T01:21:20.994 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.990+0000 7fe43a69d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4340c6430 0x7fe4340aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.994 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.990+0000 7fe43a69d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4340c6430 0x7fe4340aaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:52070/0 (socket says 172.21.15.141:52070) 2023-11-15T01:21:20.994 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.990+0000 7fe43a69d700 1 -- 172.21.15.141:0/1696859595 learned_addr learned my addr 172.21.15.141:0/1696859595 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-15T01:21:20.994 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.991+0000 7fe43969b700 1 --2- 172.21.15.141:0/1696859595 >> v2:172.21.15.1:3300/0 conn(0x7fe434154480 0x7fe4340c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:20.995 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.991+0000 7fe43a69d700 1 -- 172.21.15.141:0/1696859595 >> v2:172.21.15.1:3300/0 conn(0x7fe434154480 msgr2=0x7fe4340c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:20.995 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.991+0000 7fe43a69d700 1 --2- 172.21.15.141:0/1696859595 >> v2:172.21.15.1:3300/0 conn(0x7fe434154480 0x7fe4340c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.995 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.991+0000 7fe43a69d700 1 -- 172.21.15.141:0/1696859595 >> v1:172.21.15.1:6789/0 conn(0x7fe4341540a0 legacy=0x7fe4340ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.995 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.991+0000 7fe43a69d700 1 -- 172.21.15.141:0/1696859595 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4340c9720 con 0x7fe4340c6430 2023-11-15T01:21:20.996 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.991+0000 7fe43a69d700 1 --2- 172.21.15.141:0/1696859595 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4340c6430 0x7fe4340aaf40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fe42c009f20 tx=0x7fe42c009840).ready entity=mon.2 client_cookie=5a380364bdef90b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:20.996 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.991+0000 7fe438e9a700 1 -- 172.21.15.141:0/1696859595 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c00e070 con 0x7fe4340c6430 2023-11-15T01:21:20.996 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.991+0000 7fe438e9a700 1 -- 172.21.15.141:0/1696859595 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c00b9d0 con 0x7fe4340c6430 2023-11-15T01:21:20.996 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.991+0000 7fe438e9a700 1 -- 172.21.15.141:0/1696859595 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c00bd50 con 0x7fe4340c6430 2023-11-15T01:21:20.996 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.992+0000 7fe43c100700 1 -- 172.21.15.141:0/1696859595 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4340c6430 msgr2=0x7fe4340aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:20.997 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.992+0000 7fe43c100700 1 --2- 172.21.15.141:0/1696859595 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4340c6430 0x7fe4340aaf40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fe42c009f20 tx=0x7fe42c009840).stop 2023-11-15T01:21:20.997 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.992+0000 7fe43c100700 1 -- 172.21.15.141:0/1696859595 shutdown_connections 2023-11-15T01:21:20.997 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.992+0000 7fe43c100700 1 --2- 172.21.15.141:0/1696859595 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4340c6430 0x7fe4340aaf40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.997 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.992+0000 7fe43c100700 1 --2- 172.21.15.141:0/1696859595 >> v2:172.21.15.1:3300/0 conn(0x7fe434154480 0x7fe4340c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:20.997 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.992+0000 7fe43c100700 1 -- 172.21.15.141:0/1696859595 >> 172.21.15.141:0/1696859595 conn(0x7fe434064a70 msgr2=0x7fe434064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:20.998 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.992+0000 7fe43c100700 1 -- 172.21.15.141:0/1696859595 shutdown_connections 2023-11-15T01:21:20.998 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.992+0000 7fe43c100700 1 -- 172.21.15.141:0/1696859595 wait complete. 2023-11-15T01:21:21.001 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.993+0000 7fe43c100700 1 Processor -- start 2023-11-15T01:21:21.001 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.993+0000 7fe43c100700 1 -- start start 2023-11-15T01:21:21.001 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.993+0000 7fe43c100700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4340c6430 0x7fe434168950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:21.001 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.993+0000 7fe43c100700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4341540a0 0x7fe434153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:21.002 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43c100700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe434154480 0x7fe4340af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:21.002 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43c100700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4340c46b0 con 0x7fe4340c6430 2023-11-15T01:21:21.002 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43c100700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4340c34b0 con 0x7fe434154480 2023-11-15T01:21:21.002 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43c100700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4340c48c0 con 0x7fe4341540a0 2023-11-15T01:21:21.002 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43969b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4341540a0 0x7fe434153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:21.003 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43a69d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe434154480 0x7fe4340af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:21.003 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43969b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4341540a0 0x7fe434153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:52080/0 (socket says 172.21.15.141:52080) 2023-11-15T01:21:21.003 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43969b700 1 -- 172.21.15.141:0/2234770546 learned_addr learned my addr 172.21.15.141:0/2234770546 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-15T01:21:21.003 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe439e9c700 1 --2- 172.21.15.141:0/2234770546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4340c6430 0x7fe434168950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:21.003 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43969b700 1 -- 172.21.15.141:0/2234770546 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe434154480 msgr2=0x7fe4340af5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:21.004 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43969b700 1 --2- 172.21.15.141:0/2234770546 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe434154480 0x7fe4340af5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.004 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43969b700 1 -- 172.21.15.141:0/2234770546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4340c6430 msgr2=0x7fe434168950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:21.004 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43969b700 1 --2- 172.21.15.141:0/2234770546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4340c6430 0x7fe434168950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.004 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43969b700 1 -- 172.21.15.141:0/2234770546 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c009ae0 con 0x7fe4341540a0 2023-11-15T01:21:21.004 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43a69d700 1 --2- 172.21.15.141:0/2234770546 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe434154480 0x7fe4340af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:21.005 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe439e9c700 1 --2- 172.21.15.141:0/2234770546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4340c6430 0x7fe434168950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:21.005 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43969b700 1 --2- 172.21.15.141:0/2234770546 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4341540a0 0x7fe434153300 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fe43000e900 tx=0x7fe430009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:21.005 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe429ffb700 1 -- 172.21.15.141:0/2234770546 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430012600 con 0x7fe4341540a0 2023-11-15T01:21:21.005 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe429ffb700 1 -- 172.21.15.141:0/2234770546 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe430012760 con 0x7fe4341540a0 2023-11-15T01:21:21.005 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe43c100700 1 -- 172.21.15.141:0/2234770546 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4340c4ba0 con 0x7fe4341540a0 2023-11-15T01:21:21.006 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.994+0000 7fe429ffb700 1 -- 172.21.15.141:0/2234770546 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430012ae0 con 0x7fe4341540a0 2023-11-15T01:21:21.006 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.995+0000 7fe429ffb700 1 -- 172.21.15.141:0/2234770546 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fe43001b660 con 0x7fe4341540a0 2023-11-15T01:21:21.006 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.995+0000 7fe43c100700 1 -- 172.21.15.141:0/2234770546 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4340c3940 con 0x7fe4341540a0 2023-11-15T01:21:21.006 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.995+0000 7fe429ffb700 1 -- 172.21.15.141:0/2234770546 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7fe43001baf0 con 0x7fe4341540a0 2023-11-15T01:21:21.006 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.995+0000 7fe43c100700 1 -- 172.21.15.141:0/2234770546 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43406c7e0 con 0x7fe4341540a0 2023-11-15T01:21:21.007 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:20.997+0000 7fe429ffb700 1 -- 172.21.15.141:0/2234770546 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fe43003ae50 con 0x7fe4341540a0 2023-11-15T01:21:21.079 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.078+0000 7fe43c100700 1 -- 172.21.15.141:0/2234770546 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c6b482bc-4eb0-44bf-8830-ccac8c9b1790", "id": 6} v 0) v1 -- 0x7fe4340c35f0 con 0x7fe4341540a0 2023-11-15T01:21:21.082 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.081+0000 7fe429ffb700 1 -- 172.21.15.141:0/2234770546 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6b482bc-4eb0-44bf-8830-ccac8c9b1790", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe430029030 con 0x7fe4341540a0 2023-11-15T01:21:21.082 INFO:teuthology.orchestra.run.smithi141.stdout:6 2023-11-15T01:21:21.083 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.082+0000 7fe43c100700 1 -- 172.21.15.141:0/2234770546 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4341540a0 msgr2=0x7fe434153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:21.083 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.082+0000 7fe43c100700 1 --2- 172.21.15.141:0/2234770546 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4341540a0 0x7fe434153300 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fe43000e900 tx=0x7fe430009060).stop 2023-11-15T01:21:21.083 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.082+0000 7fe43c100700 1 -- 172.21.15.141:0/2234770546 shutdown_connections 2023-11-15T01:21:21.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.082+0000 7fe43c100700 1 --2- 172.21.15.141:0/2234770546 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe434154480 0x7fe4340af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.082+0000 7fe43c100700 1 --2- 172.21.15.141:0/2234770546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4340c6430 0x7fe434168950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.082+0000 7fe43c100700 1 --2- 172.21.15.141:0/2234770546 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4341540a0 0x7fe434153300 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.082+0000 7fe43c100700 1 -- 172.21.15.141:0/2234770546 >> 172.21.15.141:0/2234770546 conn(0x7fe434064a70 msgr2=0x7fe434064fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:21.084 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.082+0000 7fe43c100700 1 -- 172.21.15.141:0/2234770546 shutdown_connections 2023-11-15T01:21:21.085 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.082+0000 7fe43c100700 1 -- 172.21.15.141:0/2234770546 wait complete. 2023-11-15T01:21:21.094 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new 8529e0b4-b421-4e0e-abaa-227d6866bd00 7 2023-11-15T01:21:21.174 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:21.173+0000 7f78fb56f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:21:21.194 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:21.193+0000 7fcd21cc3680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:21:21.208 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.207+0000 7f5eef0a9700 1 Processor -- start 2023-11-15T01:21:21.208 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.207+0000 7f5eef0a9700 1 -- start start 2023-11-15T01:21:21.211 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.208+0000 7f5eef0a9700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5ee8137030 0x7f5ee8137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:21.211 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.208+0000 7f5eef0a9700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5ee81588e0 0x7f5ee8066870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:21.211 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.208+0000 7f5eef0a9700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee80671b0 con 0x7f5ee8066d60 2023-11-15T01:21:21.212 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.208+0000 7f5eef0a9700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee8137900 con 0x7f5ee8137030 2023-11-15T01:21:21.212 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.208+0000 7f5eef0a9700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee8158d90 con 0x7f5ee81588e0 2023-11-15T01:21:21.212 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.208+0000 7f5ee7fff700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5ee81588e0 0x7f5ee8066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:21.212 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.208+0000 7f5ee7fff700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5ee81588e0 0x7f5ee8066870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:56602/0 (socket says 172.21.15.141:56602) 2023-11-15T01:21:21.212 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.208+0000 7f5ee7fff700 1 -- 172.21.15.141:0/3614634707 learned_addr learned my addr 172.21.15.141:0/3614634707 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-15T01:21:21.212 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.208+0000 7f5eece45700 1 --2- 172.21.15.141:0/3614634707 >> v2:172.21.15.1:3300/0 conn(0x7f5ee8137030 0x7f5ee8137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:21.213 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.208+0000 7f5ee7fff700 1 -- 172.21.15.141:0/3614634707 >> v2:172.21.15.1:3300/0 conn(0x7f5ee8137030 msgr2=0x7f5ee8137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:21.213 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.208+0000 7f5ee7fff700 1 --2- 172.21.15.141:0/3614634707 >> v2:172.21.15.1:3300/0 conn(0x7f5ee8137030 0x7f5ee8137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.213 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.208+0000 7f5ee7fff700 1 -- 172.21.15.141:0/3614634707 >> v1:172.21.15.141:6789/0 conn(0x7f5ee8066d60 legacy=0x7f5ee814e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:21.213 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.208+0000 7f5ee7fff700 1 -- 172.21.15.141:0/3614634707 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8154ce0 con 0x7f5ee81588e0 2023-11-15T01:21:21.214 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.208+0000 7f5ee77fe700 1 -- 172.21.15.141:0/3614634707 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345081754 0 0) 0x7f5ee80671b0 con 0x7f5ee8066d60 2023-11-15T01:21:21.214 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.208+0000 7f5eece45700 1 --2- 172.21.15.141:0/3614634707 >> v2:172.21.15.1:3300/0 conn(0x7f5ee8137030 0x7f5ee8137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:21.214 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.209+0000 7f5ee7fff700 1 --2- 172.21.15.141:0/3614634707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ee81588e0 0x7f5ee8066870 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f5ee80c89d0 tx=0x7f5ed40090f0).ready entity=mon.1 client_cookie=8b50f9ceb53f3ba3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:21.214 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.209+0000 7f5ee77fe700 1 -- 172.21.15.141:0/3614634707 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed400b600 con 0x7f5ee81588e0 2023-11-15T01:21:21.214 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.209+0000 7f5ee77fe700 1 -- 172.21.15.141:0/3614634707 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed400b760 con 0x7f5ee81588e0 2023-11-15T01:21:21.215 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.209+0000 7f5ee77fe700 1 -- 172.21.15.141:0/3614634707 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed400bae0 con 0x7f5ee81588e0 2023-11-15T01:21:21.215 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.209+0000 7f5eef0a9700 1 -- 172.21.15.141:0/3614634707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ee81588e0 msgr2=0x7f5ee8066870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:21.215 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.209+0000 7f5eef0a9700 1 --2- 172.21.15.141:0/3614634707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ee81588e0 0x7f5ee8066870 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f5ee80c89d0 tx=0x7f5ed40090f0).stop 2023-11-15T01:21:21.215 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.209+0000 7f5eef0a9700 1 -- 172.21.15.141:0/3614634707 shutdown_connections 2023-11-15T01:21:21.215 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.209+0000 7f5eef0a9700 1 --2- 172.21.15.141:0/3614634707 >> v2:172.21.15.1:3300/0 conn(0x7f5ee8137030 0x7f5ee8137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.215 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.209+0000 7f5eef0a9700 1 --2- 172.21.15.141:0/3614634707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ee81588e0 0x7f5ee8066870 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.216 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.209+0000 7f5eef0a9700 1 -- 172.21.15.141:0/3614634707 >> 172.21.15.141:0/3614634707 conn(0x7f5ee8063280 msgr2=0x7f5ee80c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:21.216 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.209+0000 7f5eef0a9700 1 -- 172.21.15.141:0/3614634707 shutdown_connections 2023-11-15T01:21:21.216 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.209+0000 7f5eef0a9700 1 -- 172.21.15.141:0/3614634707 wait complete. 2023-11-15T01:21:21.216 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.210+0000 7f5eef0a9700 1 Processor -- start 2023-11-15T01:21:21.219 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.211+0000 7f5eef0a9700 1 -- start start 2023-11-15T01:21:21.219 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.211+0000 7f5eef0a9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ee8066d60 0x7f5ee81504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:21.219 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.211+0000 7f5eef0a9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ee8137030 0x7f5ee80ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:21.219 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.211+0000 7f5eef0a9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ee81588e0 0x7f5ee80ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:21.220 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.211+0000 7f5eef0a9700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee8138280 con 0x7f5ee8066d60 2023-11-15T01:21:21.220 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.211+0000 7f5eef0a9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee813a580 con 0x7f5ee81588e0 2023-11-15T01:21:21.220 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.211+0000 7f5eef0a9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee813a860 con 0x7f5ee8137030 2023-11-15T01:21:21.220 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.211+0000 7f5eed646700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ee81588e0 0x7f5ee80ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:21.220 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.211+0000 7f5ee7fff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ee8137030 0x7f5ee80ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:21.221 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.211+0000 7f5eed646700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ee81588e0 0x7f5ee80ad370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:56616/0 (socket says 172.21.15.141:56616) 2023-11-15T01:21:21.221 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.211+0000 7f5eece45700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ee8066d60 0x7f5ee81504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:21.221 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5eed646700 1 -- 172.21.15.141:0/1523272173 learned_addr learned my addr 172.21.15.141:0/1523272173 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-15T01:21:21.221 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5eed646700 1 -- 172.21.15.141:0/1523272173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ee8137030 msgr2=0x7f5ee80ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:21.221 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5eed646700 1 --2- 172.21.15.141:0/1523272173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ee8137030 0x7f5ee80ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.222 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5eed646700 1 -- 172.21.15.141:0/1523272173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ee8066d60 msgr2=0x7f5ee81504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:21.222 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5eed646700 1 --2- 172.21.15.141:0/1523272173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ee8066d60 0x7f5ee81504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.222 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5eed646700 1 -- 172.21.15.141:0/1523272173 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed4009370 con 0x7f5ee81588e0 2023-11-15T01:21:21.222 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5ee7fff700 1 --2- 172.21.15.141:0/1523272173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ee8137030 0x7f5ee80ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:21.222 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5eece45700 1 --2- 172.21.15.141:0/1523272173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ee8066d60 0x7f5ee81504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:21.223 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5eed646700 1 --2- 172.21.15.141:0/1523272173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ee81588e0 0x7f5ee80ad370 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f5ee000c810 tx=0x7f5ee0001500).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:21.223 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5ee4ff9700 1 -- 172.21.15.141:0/1523272173 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee000e4a0 con 0x7f5ee81588e0 2023-11-15T01:21:21.223 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5ee4ff9700 1 -- 172.21.15.141:0/1523272173 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee000e620 con 0x7f5ee81588e0 2023-11-15T01:21:21.223 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5eef0a9700 1 -- 172.21.15.141:0/1523272173 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee8137c30 con 0x7f5ee81588e0 2023-11-15T01:21:21.223 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5ee4ff9700 1 -- 172.21.15.141:0/1523272173 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee000e9e0 con 0x7f5ee81588e0 2023-11-15T01:21:21.224 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5eef0a9700 1 -- 172.21.15.141:0/1523272173 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee8150ee0 con 0x7f5ee81588e0 2023-11-15T01:21:21.224 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5ee4ff9700 1 -- 172.21.15.141:0/1523272173 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f5ee001c440 con 0x7f5ee81588e0 2023-11-15T01:21:21.224 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.212+0000 7f5ee4ff9700 1 -- 172.21.15.141:0/1523272173 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f5ee0001570 con 0x7f5ee81588e0 2023-11-15T01:21:21.224 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.213+0000 7f5eef0a9700 1 -- 172.21.15.141:0/1523272173 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee806c7e0 con 0x7f5ee81588e0 2023-11-15T01:21:21.224 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.217+0000 7f5ee4ff9700 1 -- 172.21.15.141:0/1523272173 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f5ee0017070 con 0x7f5ee81588e0 2023-11-15T01:21:21.281 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:21.280+0000 7f78fb56f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:21:21.297 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.297+0000 7f5eef0a9700 1 -- 172.21.15.141:0/1523272173 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8529e0b4-b421-4e0e-abaa-227d6866bd00", "id": 7} v 0) v1 -- 0x7f5ee8068ee0 con 0x7f5ee81588e0 2023-11-15T01:21:21.304 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.303+0000 7f5ee4ff9700 1 -- 172.21.15.141:0/1523272173 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8529e0b4-b421-4e0e-abaa-227d6866bd00", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5ee001c940 con 0x7f5ee81588e0 2023-11-15T01:21:21.304 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:21.303+0000 7fcd21cc3680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:21:21.305 INFO:teuthology.orchestra.run.smithi141.stdout:7 2023-11-15T01:21:21.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.304+0000 7f5eef0a9700 1 -- 172.21.15.141:0/1523272173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ee81588e0 msgr2=0x7f5ee80ad370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:21.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.304+0000 7f5eef0a9700 1 --2- 172.21.15.141:0/1523272173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ee81588e0 0x7f5ee80ad370 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f5ee000c810 tx=0x7f5ee0001500).stop 2023-11-15T01:21:21.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.304+0000 7f5eef0a9700 1 -- 172.21.15.141:0/1523272173 shutdown_connections 2023-11-15T01:21:21.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.304+0000 7f5eef0a9700 1 --2- 172.21.15.141:0/1523272173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ee81588e0 0x7f5ee80ad370 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.304+0000 7f5eef0a9700 1 --2- 172.21.15.141:0/1523272173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ee8066d60 0x7f5ee81504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.304+0000 7f5eef0a9700 1 --2- 172.21.15.141:0/1523272173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ee8137030 0x7f5ee80ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.304+0000 7f5eef0a9700 1 -- 172.21.15.141:0/1523272173 >> 172.21.15.141:0/1523272173 conn(0x7f5ee8063280 msgr2=0x7f5ee80bde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:21.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.304+0000 7f5eef0a9700 1 -- 172.21.15.141:0/1523272173 shutdown_connections 2023-11-15T01:21:21.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:21.304+0000 7f5eef0a9700 1 -- 172.21.15.141:0/1523272173 wait complete. 2023-11-15T01:21:21.316 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-15T01:21:21.317 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-15T01:21:21.319 INFO:tasks.ceph.osd.0:Started 2023-11-15T01:21:21.320 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-15T01:21:21.320 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-15T01:21:21.322 INFO:tasks.ceph.osd.1:Started 2023-11-15T01:21:21.323 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-15T01:21:21.323 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-15T01:21:21.325 INFO:tasks.ceph.osd.2:Started 2023-11-15T01:21:21.325 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-15T01:21:21.326 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-15T01:21:21.328 INFO:tasks.ceph.osd.3:Started 2023-11-15T01:21:21.328 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-15T01:21:21.329 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-15T01:21:21.331 INFO:tasks.ceph.osd.4:Started 2023-11-15T01:21:21.331 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-15T01:21:21.331 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-15T01:21:21.333 INFO:tasks.ceph.osd.5:Started 2023-11-15T01:21:21.334 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-15T01:21:21.334 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-15T01:21:21.336 INFO:tasks.ceph.osd.6:Started 2023-11-15T01:21:21.337 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-15T01:21:21.337 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-15T01:21:21.339 INFO:tasks.ceph.osd.7:Started 2023-11-15T01:21:21.340 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:21:21.459 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:21.458+0000 7f78fb56f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:21:21.474 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:21.473+0000 7fcd21cc3680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:21:21.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.487+0000 7f42c3575700 1 Processor -- start 2023-11-15T01:21:21.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.487+0000 7f42c3575700 1 -- start start 2023-11-15T01:21:21.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.488+0000 7f42c3575700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42bc155530 0x7f42bc0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:21.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.488+0000 7f42c3575700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f42bc0c98b0 0x7f42bc0c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:21.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.488+0000 7f42c3575700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42bc0c7980 con 0x7f42bc151e10 2023-11-15T01:21:21.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.488+0000 7f42c3575700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42bc0ca210 con 0x7f42bc0c98b0 2023-11-15T01:21:21.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.488+0000 7f42c3575700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc0aa890 con 0x7f42bc155530 2023-11-15T01:21:21.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.488+0000 7f42c2d74700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f42bc0c98b0 0x7f42bc0c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:21.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.488+0000 7f42c2573700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f42bc151e10 0x7f42bc0aa0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34966/0 (socket says 172.21.15.1:34966) 2023-11-15T01:21:21.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.488+0000 7f42c2573700 1 -- 172.21.15.1:0/1845590049 learned_addr learned my addr 172.21.15.1:0/1845590049 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:21.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.488+0000 7f42c1d72700 1 --2- 172.21.15.1:0/1845590049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42bc155530 0x7f42bc0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:21.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.488+0000 7f42c2d74700 1 -- 172.21.15.1:0/1845590049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42bc155530 msgr2=0x7f42bc0c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:21.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.488+0000 7f42c2d74700 1 --2- 172.21.15.1:0/1845590049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42bc155530 0x7f42bc0c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.488+0000 7f42c2d74700 1 -- 172.21.15.1:0/1845590049 >> v1:172.21.15.1:6789/0 conn(0x7f42bc151e10 legacy=0x7f42bc0aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:21.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.488+0000 7f42c2d74700 1 -- 172.21.15.1:0/1845590049 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc0c7bd0 con 0x7f42bc0c98b0 2023-11-15T01:21:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.488+0000 7f42c1571700 1 -- 172.21.15.1:0/1845590049 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422077515 0 0) 0x7f42bc0c7980 con 0x7f42bc151e10 2023-11-15T01:21:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.489+0000 7f42c2d74700 1 --2- 172.21.15.1:0/1845590049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42bc0c98b0 0x7f42bc0c9d20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f42b4009e60 tx=0x7f42b4009780).ready entity=mon.0 client_cookie=371376d2e16f0dc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.489+0000 7f42c1571700 1 -- 172.21.15.1:0/1845590049 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b400e070 con 0x7f42bc0c98b0 2023-11-15T01:21:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.489+0000 7f42c1571700 1 -- 172.21.15.1:0/1845590049 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b400bb60 con 0x7f42bc0c98b0 2023-11-15T01:21:21.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.489+0000 7f42c1571700 1 -- 172.21.15.1:0/1845590049 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4012410 con 0x7f42bc0c98b0 2023-11-15T01:21:21.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.489+0000 7f42c3575700 1 -- 172.21.15.1:0/1845590049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42bc0c98b0 msgr2=0x7f42bc0c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:21.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.489+0000 7f42c3575700 1 --2- 172.21.15.1:0/1845590049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42bc0c98b0 0x7f42bc0c9d20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f42b4009e60 tx=0x7f42b4009780).stop 2023-11-15T01:21:21.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.489+0000 7f42c3575700 1 -- 172.21.15.1:0/1845590049 shutdown_connections 2023-11-15T01:21:21.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.489+0000 7f42c3575700 1 --2- 172.21.15.1:0/1845590049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42bc0c98b0 0x7f42bc0c9d20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.489+0000 7f42c3575700 1 --2- 172.21.15.1:0/1845590049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42bc155530 0x7f42bc0c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.489+0000 7f42c3575700 1 -- 172.21.15.1:0/1845590049 >> 172.21.15.1:0/1845590049 conn(0x7f42bc0947e0 msgr2=0x7f42bc06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:21.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.489+0000 7f42c3575700 1 -- 172.21.15.1:0/1845590049 shutdown_connections 2023-11-15T01:21:21.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.489+0000 7f42c3575700 1 -- 172.21.15.1:0/1845590049 wait complete. 2023-11-15T01:21:21.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.491+0000 7f42c3575700 1 Processor -- start 2023-11-15T01:21:21.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.491+0000 7f42c3575700 1 -- start start 2023-11-15T01:21:21.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.491+0000 7f42c3575700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42bc0c98b0 0x7f42bc0ad710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:21.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.491+0000 7f42c3575700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42bc151e10 0x7f42bc14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:21.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.491+0000 7f42c3575700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42bc155530 0x7f42bc0c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:21.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.491+0000 7f42c3575700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc0adc00 con 0x7f42bc155530 2023-11-15T01:21:21.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.491+0000 7f42c3575700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc153510 con 0x7f42bc151e10 2023-11-15T01:21:21.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.491+0000 7f42c3575700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc1537f0 con 0x7f42bc0c98b0 2023-11-15T01:21:21.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.491+0000 7f42c2d74700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42bc155530 0x7f42bc0c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:21.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.491+0000 7f42c2d74700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42bc155530 0x7f42bc0c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55024/0 (socket says 172.21.15.1:55024) 2023-11-15T01:21:21.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.491+0000 7f42c2d74700 1 -- 172.21.15.1:0/602395649 learned_addr learned my addr 172.21.15.1:0/602395649 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:21.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.492+0000 7f42c1d72700 1 --2- 172.21.15.1:0/602395649 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42bc151e10 0x7f42bc14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:21.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.492+0000 7f42c2573700 1 --2- 172.21.15.1:0/602395649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42bc0c98b0 0x7f42bc0ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:21.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.492+0000 7f42c2d74700 1 -- 172.21.15.1:0/602395649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42bc0c98b0 msgr2=0x7f42bc0ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:21.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.492+0000 7f42c2d74700 1 --2- 172.21.15.1:0/602395649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42bc0c98b0 0x7f42bc0ad710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.492+0000 7f42c2d74700 1 -- 172.21.15.1:0/602395649 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42bc151e10 msgr2=0x7f42bc14ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:21.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.492+0000 7f42c2d74700 1 --2- 172.21.15.1:0/602395649 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42bc151e10 0x7f42bc14ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.492+0000 7f42c2d74700 1 -- 172.21.15.1:0/602395649 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b4009a20 con 0x7f42bc155530 2023-11-15T01:21:21.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.492+0000 7f42c2d74700 1 --2- 172.21.15.1:0/602395649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42bc155530 0x7f42bc0c6160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f42b400b6c0 tx=0x7f42b4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:21.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.492+0000 7f42b27fc700 1 -- 172.21.15.1:0/602395649 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4012410 con 0x7f42bc155530 2023-11-15T01:21:21.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.492+0000 7f42b27fc700 1 -- 172.21.15.1:0/602395649 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b401d630 con 0x7f42bc155530 2023-11-15T01:21:21.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.492+0000 7f42c3575700 1 -- 172.21.15.1:0/602395649 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42bc153ad0 con 0x7f42bc155530 2023-11-15T01:21:21.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.492+0000 7f42b27fc700 1 -- 172.21.15.1:0/602395649 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b401d9f0 con 0x7f42bc155530 2023-11-15T01:21:21.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.492+0000 7f42c3575700 1 -- 172.21.15.1:0/602395649 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42bc154090 con 0x7f42bc155530 2023-11-15T01:21:21.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.492+0000 7f42b27fc700 1 -- 172.21.15.1:0/602395649 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f42b4026410 con 0x7f42bc155530 2023-11-15T01:21:21.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.492+0000 7f42b27fc700 1 -- 172.21.15.1:0/602395649 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f42b4026e40 con 0x7f42bc155530 2023-11-15T01:21:21.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.493+0000 7f42c3575700 1 -- 172.21.15.1:0/602395649 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42bc0afb10 con 0x7f42bc155530 2023-11-15T01:21:21.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.496+0000 7f42b27fc700 1 -- 172.21.15.1:0/602395649 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f42b4017070 con 0x7f42bc155530 2023-11-15T01:21:21.542 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:21.541+0000 7f78fb56f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:21:21.552 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:21.552+0000 7fcd21cc3680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:21:21.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.565+0000 7f42c3575700 1 -- 172.21.15.1:0/602395649 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42bc0475e0 con 0x7f42bc155530 2023-11-15T01:21:21.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.565+0000 7f42b27fc700 1 -- 172.21.15.1:0/602395649 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f42b40266c0 con 0x7f42bc155530 2023-11-15T01:21:21.567 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:21.567 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":10,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:21.298719+0000","last_up_change":"0.000000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:21:21.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.566+0000 7f42c3575700 1 -- 172.21.15.1:0/602395649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42bc155530 msgr2=0x7f42bc0c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:21.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.566+0000 7f42c3575700 1 --2- 172.21.15.1:0/602395649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42bc155530 0x7f42bc0c6160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f42b400b6c0 tx=0x7f42b4009780).stop 2023-11-15T01:21:21.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.566+0000 7f42c3575700 1 -- 172.21.15.1:0/602395649 shutdown_connections 2023-11-15T01:21:21.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.566+0000 7f42c3575700 1 --2- 172.21.15.1:0/602395649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42bc155530 0x7f42bc0c6160 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.566+0000 7f42c3575700 1 --2- 172.21.15.1:0/602395649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42bc0c98b0 0x7f42bc0ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.566+0000 7f42c3575700 1 --2- 172.21.15.1:0/602395649 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42bc151e10 0x7f42bc14ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:21.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.566+0000 7f42c3575700 1 -- 172.21.15.1:0/602395649 >> 172.21.15.1:0/602395649 conn(0x7f42bc0947e0 msgr2=0x7f42bc14f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:21.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.566+0000 7f42c3575700 1 -- 172.21.15.1:0/602395649 shutdown_connections 2023-11-15T01:21:21.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:21.566+0000 7f42c3575700 1 -- 172.21.15.1:0/602395649 wait complete. 2023-11-15T01:21:21.580 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-15T01:21:21.581 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-15T01:21:21.616 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:21.614+0000 7f78fb56f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:21:21.621 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:21.621+0000 7fcd21cc3680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:21:21.884 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:21.883+0000 7fcd21cc3680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:21:21.895 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:21.893+0000 7f78fb56f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:21:21.927 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-11-15T01:21:21.925+0000 7f56f7223380 -1 Falling back to public interface 2023-11-15T01:21:21.933 INFO:tasks.ceph.osd.4.smithi141.stderr:2023-11-15T01:21:21.932+0000 7fc35bd47380 -1 Falling back to public interface 2023-11-15T01:21:21.934 INFO:tasks.ceph.osd.6.smithi141.stderr:2023-11-15T01:21:21.932+0000 7f9287120380 -1 Falling back to public interface 2023-11-15T01:21:21.934 INFO:tasks.ceph.osd.6.smithi141.stderr:2023-11-15T01:21:21.932+0000 7f92812e5700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-11-15T01:21:21.935 INFO:tasks.ceph.osd.4.smithi141.stderr:2023-11-15T01:21:21.933+0000 7fc355f0c700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2023-11-15T01:21:21.935 INFO:tasks.ceph.osd.4.smithi141.stderr:2023-11-15T01:21:21.933+0000 7fc355f0c700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6804/0: (98) Address already in use 2023-11-15T01:21:21.935 INFO:tasks.ceph.osd.4.smithi141.stderr:2023-11-15T01:21:21.933+0000 7fc355f0c700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6809/0: (98) Address already in use 2023-11-15T01:21:21.944 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-11-15T01:21:21.942+0000 7ff921204380 -1 Falling back to public interface 2023-11-15T01:21:21.947 INFO:tasks.ceph.osd.5.smithi141.stderr:2023-11-15T01:21:21.946+0000 7fd3d48d9380 -1 Falling back to public interface 2023-11-15T01:21:21.953 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-11-15T01:21:21.951+0000 7f792397e380 -1 Falling back to public interface 2023-11-15T01:21:21.955 INFO:tasks.ceph.osd.7.smithi141.stderr:2023-11-15T01:21:21.954+0000 7fe66faf9380 -1 Falling back to public interface 2023-11-15T01:21:21.955 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-11-15T01:21:21.954+0000 7feac9781380 -1 Falling back to public interface 2023-11-15T01:21:22.088 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:22.087+0000 7fcd21cc3680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:21:22.099 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:22.098+0000 7f78fb56f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:21:22.388 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-15T01:21:22.497 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.495+0000 7f8b129dd700 1 Processor -- start 2023-11-15T01:21:22.497 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.495+0000 7f8b129dd700 1 -- start start 2023-11-15T01:21:22.500 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.496+0000 7f8b129dd700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8b0c0aa4d0 0x7f8b0c155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:22.500 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.496+0000 7f8b129dd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b0c0c80a0 0x7f8b0c0c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:22.500 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.496+0000 7f8b129dd700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0c158d20 con 0x7f8b0c0c6780 2023-11-15T01:21:22.501 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.496+0000 7f8b129dd700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0c1547b0 con 0x7f8b0c0aa4d0 2023-11-15T01:21:22.501 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.496+0000 7f8b129dd700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c155830 con 0x7f8b0c0c80a0 2023-11-15T01:21:22.501 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.496+0000 7f8b0b7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8b0c0c6780 0x7f8b0c0c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34974/0 (socket says 172.21.15.1:34974) 2023-11-15T01:21:22.501 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.496+0000 7f8b0b7fe700 1 -- 172.21.15.1:0/1434891283 learned_addr learned my addr 172.21.15.1:0/1434891283 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:22.502 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.496+0000 7f8b0bfff700 1 --2- 172.21.15.1:0/1434891283 >> v2:172.21.15.141:3300/0 conn(0x7f8b0c0aa4d0 0x7f8b0c155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:22.502 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.496+0000 7f8b10f7a700 1 --2- 172.21.15.1:0/1434891283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b0c0c80a0 0x7f8b0c0c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:22.502 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.497+0000 7f8b0affd700 1 -- 172.21.15.1:0/1434891283 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337152184 0 0) 0x7f8b0c158d20 con 0x7f8b0c0c6780 2023-11-15T01:21:22.502 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.497+0000 7f8b0affd700 1 -- 172.21.15.1:0/1434891283 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8af40033f0 con 0x7f8b0c0c6780 2023-11-15T01:21:22.502 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.497+0000 7f8b0bfff700 1 -- 172.21.15.1:0/1434891283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b0c0c80a0 msgr2=0x7f8b0c0c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:22.503 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.497+0000 7f8b0bfff700 1 --2- 172.21.15.1:0/1434891283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b0c0c80a0 0x7f8b0c0c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:22.503 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.497+0000 7f8b0bfff700 1 -- 172.21.15.1:0/1434891283 >> v1:172.21.15.1:6789/0 conn(0x7f8b0c0c6780 legacy=0x7f8b0c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:22.503 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.497+0000 7f8b0bfff700 1 -- 172.21.15.1:0/1434891283 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c157e90 con 0x7f8b0c0aa4d0 2023-11-15T01:21:22.503 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.497+0000 7f8b0bfff700 1 --2- 172.21.15.1:0/1434891283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b0c0aa4d0 0x7f8b0c155340 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8afc006fd0 tx=0x7f8afc006f40).ready entity=mon.1 client_cookie=c43e34130ea42047 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:22.503 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.497+0000 7f8b0affd700 1 -- 172.21.15.1:0/1434891283 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc005880 con 0x7f8b0c0aa4d0 2023-11-15T01:21:22.504 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.497+0000 7f8b0affd700 1 -- 172.21.15.1:0/1434891283 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc0059e0 con 0x7f8b0c0aa4d0 2023-11-15T01:21:22.504 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.497+0000 7f8b0affd700 1 -- 172.21.15.1:0/1434891283 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc005d60 con 0x7f8b0c0aa4d0 2023-11-15T01:21:22.504 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.498+0000 7f8b129dd700 1 -- 172.21.15.1:0/1434891283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b0c0aa4d0 msgr2=0x7f8b0c155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:22.504 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.498+0000 7f8b129dd700 1 --2- 172.21.15.1:0/1434891283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b0c0aa4d0 0x7f8b0c155340 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8afc006fd0 tx=0x7f8afc006f40).stop 2023-11-15T01:21:22.504 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.498+0000 7f8b129dd700 1 -- 172.21.15.1:0/1434891283 shutdown_connections 2023-11-15T01:21:22.505 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.498+0000 7f8b129dd700 1 --2- 172.21.15.1:0/1434891283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b0c0c80a0 0x7f8b0c0c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:22.505 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.498+0000 7f8b129dd700 1 --2- 172.21.15.1:0/1434891283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b0c0aa4d0 0x7f8b0c155340 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:22.505 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.498+0000 7f8b129dd700 1 -- 172.21.15.1:0/1434891283 >> 172.21.15.1:0/1434891283 conn(0x7f8b0c069fa0 msgr2=0x7f8b0c06a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:22.505 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.498+0000 7f8b129dd700 1 -- 172.21.15.1:0/1434891283 shutdown_connections 2023-11-15T01:21:22.505 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.498+0000 7f8b129dd700 1 -- 172.21.15.1:0/1434891283 wait complete. 2023-11-15T01:21:22.506 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.499+0000 7f8b129dd700 1 Processor -- start 2023-11-15T01:21:22.506 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.499+0000 7f8b129dd700 1 -- start start 2023-11-15T01:21:22.508 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b129dd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b0c0aa4d0 0x7f8b0c151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:22.508 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b129dd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b0c0c6780 0x7f8b0c0c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:22.509 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b129dd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c0c80a0 0x7f8b0c06a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:22.509 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b129dd700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c163fa0 con 0x7f8b0c0c80a0 2023-11-15T01:21:22.509 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b129dd700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c151580 con 0x7f8b0c0aa4d0 2023-11-15T01:21:22.509 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b129dd700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c0afb00 con 0x7f8b0c0c6780 2023-11-15T01:21:22.509 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b10f7a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c0c80a0 0x7f8b0c06a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:22.510 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b10f7a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c0c80a0 0x7f8b0c06a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55036/0 (socket says 172.21.15.1:55036) 2023-11-15T01:21:22.510 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b0bfff700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b0c0aa4d0 0x7f8b0c151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:22.510 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b0b7fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b0c0c6780 0x7f8b0c0c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:22.510 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b10f7a700 1 -- 172.21.15.1:0/2505849079 learned_addr learned my addr 172.21.15.1:0/2505849079 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:22.510 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b10f7a700 1 -- 172.21.15.1:0/2505849079 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b0c0c6780 msgr2=0x7f8b0c0c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:22.511 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b10f7a700 1 --2- 172.21.15.1:0/2505849079 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b0c0c6780 0x7f8b0c0c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:22.511 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b10f7a700 1 -- 172.21.15.1:0/2505849079 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b0c0aa4d0 msgr2=0x7f8b0c151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:22.511 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b10f7a700 1 --2- 172.21.15.1:0/2505849079 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b0c0aa4d0 0x7f8b0c151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:22.511 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b10f7a700 1 -- 172.21.15.1:0/2505849079 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc009250 con 0x7f8b0c0c80a0 2023-11-15T01:21:22.512 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b10f7a700 1 --2- 172.21.15.1:0/2505849079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c0c80a0 0x7f8b0c06a380 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f8b04009df0 tx=0x7f8b0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:22.512 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8af3fff700 1 -- 172.21.15.1:0/2505849079 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04009b50 con 0x7f8b0c0c80a0 2023-11-15T01:21:22.512 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8af3fff700 1 -- 172.21.15.1:0/2505849079 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0400f040 con 0x7f8b0c0c80a0 2023-11-15T01:21:22.512 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8b129dd700 1 -- 172.21.15.1:0/2505849079 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0c0c3390 con 0x7f8b0c0c80a0 2023-11-15T01:21:22.512 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.500+0000 7f8af3fff700 1 -- 172.21.15.1:0/2505849079 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0400ccb0 con 0x7f8b0c0c80a0 2023-11-15T01:21:22.513 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.501+0000 7f8b129dd700 1 -- 172.21.15.1:0/2505849079 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0c0c3950 con 0x7f8b0c0c80a0 2023-11-15T01:21:22.513 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.502+0000 7f8af3fff700 1 -- 172.21.15.1:0/2505849079 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f8b04013870 con 0x7f8b0c0c80a0 2023-11-15T01:21:22.513 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.502+0000 7f8af3fff700 1 -- 172.21.15.1:0/2505849079 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f8b0401db60 con 0x7f8b0c0c80a0 2023-11-15T01:21:22.513 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.502+0000 7f8b129dd700 1 -- 172.21.15.1:0/2505849079 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0c0475e0 con 0x7f8b0c0c80a0 2023-11-15T01:21:22.513 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.504+0000 7f8af3fff700 1 -- 172.21.15.1:0/2505849079 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f8b04013d00 con 0x7f8b0c0c80a0 2023-11-15T01:21:22.574 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.572+0000 7f8b129dd700 1 -- 172.21.15.1:0/2505849079 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b0c158130 con 0x7f8b0c0c80a0 2023-11-15T01:21:22.574 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.573+0000 7f8af3fff700 1 -- 172.21.15.1:0/2505849079 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f8b0401d460 con 0x7f8b0c0c80a0 2023-11-15T01:21:22.575 INFO:teuthology.misc.health.smithi001.stdout: 2023-11-15T01:21:22.575 INFO:teuthology.misc.health.smithi001.stdout:{"epoch":10,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:21.298719+0000","last_up_change":"0.000000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:21:22.576 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.574+0000 7f8b129dd700 1 -- 172.21.15.1:0/2505849079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c0c80a0 msgr2=0x7f8b0c06a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:22.576 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.574+0000 7f8b129dd700 1 --2- 172.21.15.1:0/2505849079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c0c80a0 0x7f8b0c06a380 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f8b04009df0 tx=0x7f8b0400b040).stop 2023-11-15T01:21:22.576 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.574+0000 7f8b129dd700 1 -- 172.21.15.1:0/2505849079 shutdown_connections 2023-11-15T01:21:22.577 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.574+0000 7f8b129dd700 1 --2- 172.21.15.1:0/2505849079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c0c80a0 0x7f8b0c06a380 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:22.577 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.574+0000 7f8b129dd700 1 --2- 172.21.15.1:0/2505849079 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b0c0aa4d0 0x7f8b0c151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:22.577 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.574+0000 7f8b129dd700 1 --2- 172.21.15.1:0/2505849079 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b0c0c6780 0x7f8b0c0c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:22.577 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.574+0000 7f8b129dd700 1 -- 172.21.15.1:0/2505849079 >> 172.21.15.1:0/2505849079 conn(0x7f8b0c069fa0 msgr2=0x7f8b0c151870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:22.577 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.574+0000 7f8b129dd700 1 -- 172.21.15.1:0/2505849079 shutdown_connections 2023-11-15T01:21:22.578 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:22.574+0000 7f8b129dd700 1 -- 172.21.15.1:0/2505849079 wait complete. 2023-11-15T01:21:22.587 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-15T01:21:22.755 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:22.754+0000 7fcd21cc3680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:21:22.805 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:22.803+0000 7f78fb56f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:21:22.824 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:22.823+0000 7fcd21cc3680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:21:22.921 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:22.875+0000 7f78fb56f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:21:22.921 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:22.901+0000 7fcd21cc3680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:21:22.958 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:22.956+0000 7f78fb56f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:21:23.050 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:23.049+0000 7fcd21cc3680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:21:23.112 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:23.111+0000 7f78fb56f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:21:23.120 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:23.119+0000 7fcd21cc3680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:21:23.186 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:23.184+0000 7f78fb56f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:21:23.235 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:23.234+0000 7fcd21cc3680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:21:23.308 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:23.307+0000 7f78fb56f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:21:23.343 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:23.343+0000 7fcd21cc3680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:21:23.422 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:23.420+0000 7f78fb56f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:21:23.665 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:23.665+0000 7fcd21cc3680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:21:23.735 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:23.734+0000 7fcd21cc3680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:21:23.770 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:23.768+0000 7f78fb56f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:21:23.846 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:21:23.844+0000 7f78fb56f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:21:24.770 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:24.768+0000 7fccd7f06700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-15T01:21:24.774 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:21:24.773+0000 7fccd7f06700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-15T01:21:25.389 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-11-15T01:21:25.389+0000 7f56f7223380 -1 osd.0 0 log_to_monitors {default=true} 2023-11-15T01:21:25.415 INFO:tasks.ceph.osd.5.smithi141.stderr:2023-11-15T01:21:25.414+0000 7fd3d48d9380 -1 osd.5 0 log_to_monitors {default=true} 2023-11-15T01:21:25.429 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-11-15T01:21:25.427+0000 7feac9781380 -1 osd.3 0 log_to_monitors {default=true} 2023-11-15T01:21:25.437 INFO:tasks.ceph.osd.6.smithi141.stderr:2023-11-15T01:21:25.436+0000 7f9287120380 -1 osd.6 0 log_to_monitors {default=true} 2023-11-15T01:21:25.445 INFO:tasks.ceph.osd.4.smithi141.stderr:2023-11-15T01:21:25.444+0000 7fc35bd47380 -1 osd.4 0 log_to_monitors {default=true} 2023-11-15T01:21:25.472 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-11-15T01:21:25.470+0000 7ff921204380 -1 osd.2 0 log_to_monitors {default=true} 2023-11-15T01:21:25.472 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-11-15T01:21:25.470+0000 7f792397e380 -1 osd.1 0 log_to_monitors {default=true} 2023-11-15T01:21:25.478 INFO:tasks.ceph.osd.7.smithi141.stderr:2023-11-15T01:21:25.478+0000 7fe66faf9380 -1 osd.7 0 log_to_monitors {default=true} 2023-11-15T01:21:26.767 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-11-15T01:21:26.766+0000 7f791a33c700 -1 osd.1 0 waiting for initial osdmap 2023-11-15T01:21:26.767 INFO:tasks.ceph.osd.4.smithi141.stderr:2023-11-15T01:21:26.766+0000 7fc352705700 -1 osd.4 0 waiting for initial osdmap 2023-11-15T01:21:26.768 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-11-15T01:21:26.766+0000 7f56edbe1700 -1 osd.0 0 waiting for initial osdmap 2023-11-15T01:21:26.768 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-11-15T01:21:26.766+0000 7feac013f700 -1 osd.3 0 waiting for initial osdmap 2023-11-15T01:21:26.769 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-11-15T01:21:26.767+0000 7ff917bc2700 -1 osd.2 0 waiting for initial osdmap 2023-11-15T01:21:26.770 INFO:tasks.ceph.osd.5.smithi141.stderr:2023-11-15T01:21:26.769+0000 7fd3cb297700 -1 osd.5 0 waiting for initial osdmap 2023-11-15T01:21:26.771 INFO:tasks.ceph.osd.7.smithi141.stderr:2023-11-15T01:21:26.771+0000 7fe6664b7700 -1 osd.7 0 waiting for initial osdmap 2023-11-15T01:21:26.774 INFO:tasks.ceph.osd.4.smithi141.stderr:2023-11-15T01:21:26.773+0000 7fc34ee81700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-15T01:21:26.774 INFO:tasks.ceph.osd.6.smithi141.stderr:2023-11-15T01:21:26.771+0000 7f927dade700 -1 osd.6 0 waiting for initial osdmap 2023-11-15T01:21:26.775 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-11-15T01:21:26.775+0000 7f7916ab8700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-15T01:21:26.775 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-11-15T01:21:26.774+0000 7feabc8bb700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-15T01:21:26.776 INFO:tasks.ceph.osd.5.smithi141.stderr:2023-11-15T01:21:26.775+0000 7fd3c7a13700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-15T01:21:26.776 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-11-15T01:21:26.775+0000 7f56ea35d700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-15T01:21:26.777 INFO:tasks.ceph.osd.7.smithi141.stderr:2023-11-15T01:21:26.776+0000 7fe662c33700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-15T01:21:26.777 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-11-15T01:21:26.775+0000 7ff91433e700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-15T01:21:26.781 INFO:tasks.ceph.osd.6.smithi141.stderr:2023-11-15T01:21:26.780+0000 7f927a25a700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-15T01:21:29.393 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-15T01:21:29.515 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.515+0000 7fce5c169700 1 Processor -- start 2023-11-15T01:21:29.515 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.515+0000 7fce5c169700 1 -- start start 2023-11-15T01:21:29.518 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.516+0000 7fce5c169700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce540c6780 0x7fce540c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:29.518 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.516+0000 7fce5c169700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce54155340 0x7fce540c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:29.518 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.516+0000 7fce5c169700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce54158d20 con 0x7fce540aa4d0 2023-11-15T01:21:29.518 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.516+0000 7fce5c169700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce541547b0 con 0x7fce54155340 2023-11-15T01:21:29.518 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.516+0000 7fce5c169700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce54157e90 con 0x7fce540c6780 2023-11-15T01:21:29.519 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.516+0000 7fce5a706700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce54155340 0x7fce540c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:29.519 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.516+0000 7fce5a706700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce54155340 0x7fce540c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43766/0 (socket says 172.21.15.1:43766) 2023-11-15T01:21:29.519 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.516+0000 7fce5a706700 1 -- 172.21.15.1:0/3876503504 learned_addr learned my addr 172.21.15.1:0/3876503504 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:29.519 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.516+0000 7fce59704700 1 --2- 172.21.15.1:0/3876503504 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce540c6780 0x7fce540c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:29.519 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.516+0000 7fce5a706700 1 -- 172.21.15.1:0/3876503504 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce540c6780 msgr2=0x7fce540c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:29.520 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.516+0000 7fce5a706700 1 --2- 172.21.15.1:0/3876503504 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce540c6780 0x7fce540c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:29.520 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.516+0000 7fce5a706700 1 -- 172.21.15.1:0/3876503504 >> v1:172.21.15.141:6789/0 conn(0x7fce540aa4d0 legacy=0x7fce540c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:29.520 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.516+0000 7fce5a706700 1 -- 172.21.15.1:0/3876503504 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce541557f0 con 0x7fce54155340 2023-11-15T01:21:29.520 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.516+0000 7fce5a706700 1 --2- 172.21.15.1:0/3876503504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce54155340 0x7fce540c94e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fce4c009f20 tx=0x7fce4c009840).ready entity=mon.0 client_cookie=606dc3998ad3c207 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:29.520 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.516+0000 7fce58f03700 1 -- 172.21.15.1:0/3876503504 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c00e070 con 0x7fce54155340 2023-11-15T01:21:29.521 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.517+0000 7fce58f03700 1 -- 172.21.15.1:0/3876503504 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c00b9d0 con 0x7fce54155340 2023-11-15T01:21:29.521 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.517+0000 7fce58f03700 1 -- 172.21.15.1:0/3876503504 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c00bd50 con 0x7fce54155340 2023-11-15T01:21:29.521 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.517+0000 7fce5c169700 1 -- 172.21.15.1:0/3876503504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce54155340 msgr2=0x7fce540c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:29.521 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.517+0000 7fce5c169700 1 --2- 172.21.15.1:0/3876503504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce54155340 0x7fce540c94e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fce4c009f20 tx=0x7fce4c009840).stop 2023-11-15T01:21:29.521 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.517+0000 7fce5c169700 1 -- 172.21.15.1:0/3876503504 shutdown_connections 2023-11-15T01:21:29.522 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.517+0000 7fce5c169700 1 --2- 172.21.15.1:0/3876503504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce54155340 0x7fce540c94e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:29.522 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.517+0000 7fce5c169700 1 --2- 172.21.15.1:0/3876503504 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce540c6780 0x7fce540c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:29.522 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.517+0000 7fce5c169700 1 -- 172.21.15.1:0/3876503504 >> 172.21.15.1:0/3876503504 conn(0x7fce54069fa0 msgr2=0x7fce5406a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:29.522 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.517+0000 7fce5c169700 1 -- 172.21.15.1:0/3876503504 shutdown_connections 2023-11-15T01:21:29.522 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.517+0000 7fce5c169700 1 -- 172.21.15.1:0/3876503504 wait complete. 2023-11-15T01:21:29.525 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.518+0000 7fce5c169700 1 Processor -- start 2023-11-15T01:21:29.525 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.518+0000 7fce5c169700 1 -- start start 2023-11-15T01:21:29.526 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.519+0000 7fce5c169700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce540aa4d0 0x7fce540ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:29.526 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.519+0000 7fce5c169700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce540c6780 0x7fce540ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:29.526 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.519+0000 7fce5c169700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce54155340 0x7fce540cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:29.526 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.519+0000 7fce5c169700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce540caff0 con 0x7fce540aa4d0 2023-11-15T01:21:29.526 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.519+0000 7fce5c169700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce540c4f10 con 0x7fce540c6780 2023-11-15T01:21:29.527 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.519+0000 7fce5c169700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce54167b60 con 0x7fce54155340 2023-11-15T01:21:29.527 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.519+0000 7fce59f05700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce540aa4d0 0x7fce540ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:29.527 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.519+0000 7fce59f05700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce540aa4d0 0x7fce540ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43780/0 (socket says 172.21.15.1:43780) 2023-11-15T01:21:29.527 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.519+0000 7fce59f05700 1 -- 172.21.15.1:0/231228141 learned_addr learned my addr 172.21.15.1:0/231228141 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:29.527 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.519+0000 7fce59704700 1 --2- 172.21.15.1:0/231228141 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce540c6780 0x7fce540ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:29.528 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.519+0000 7fce5a706700 1 --2- 172.21.15.1:0/231228141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce54155340 0x7fce540cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:29.528 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.520+0000 7fce59f05700 1 -- 172.21.15.1:0/231228141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce54155340 msgr2=0x7fce540cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:29.528 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.520+0000 7fce59f05700 1 --2- 172.21.15.1:0/231228141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce54155340 0x7fce540cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:29.528 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.520+0000 7fce59f05700 1 -- 172.21.15.1:0/231228141 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce540c6780 msgr2=0x7fce540ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:29.528 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.520+0000 7fce59f05700 1 --2- 172.21.15.1:0/231228141 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce540c6780 0x7fce540ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:29.529 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.520+0000 7fce59f05700 1 -- 172.21.15.1:0/231228141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c009ae0 con 0x7fce540aa4d0 2023-11-15T01:21:29.529 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.520+0000 7fce59704700 1 --2- 172.21.15.1:0/231228141 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce540c6780 0x7fce540ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:29.529 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.520+0000 7fce59f05700 1 --2- 172.21.15.1:0/231228141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce540aa4d0 0x7fce540ace50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fce5000c4c0 tx=0x7fce50007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:29.529 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.520+0000 7fce49ffb700 1 -- 172.21.15.1:0/231228141 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50007020 con 0x7fce540aa4d0 2023-11-15T01:21:29.529 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.520+0000 7fce49ffb700 1 -- 172.21.15.1:0/231228141 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce50007180 con 0x7fce540aa4d0 2023-11-15T01:21:29.529 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.520+0000 7fce5c169700 1 -- 172.21.15.1:0/231228141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce54167e40 con 0x7fce540aa4d0 2023-11-15T01:21:29.530 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.520+0000 7fce49ffb700 1 -- 172.21.15.1:0/231228141 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50007520 con 0x7fce540aa4d0 2023-11-15T01:21:29.530 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.520+0000 7fce5c169700 1 -- 172.21.15.1:0/231228141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce54168400 con 0x7fce540aa4d0 2023-11-15T01:21:29.530 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.521+0000 7fce5c169700 1 -- 172.21.15.1:0/231228141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce54168620 con 0x7fce540aa4d0 2023-11-15T01:21:29.530 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.521+0000 7fce49ffb700 1 -- 172.21.15.1:0/231228141 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fce50006900 con 0x7fce540aa4d0 2023-11-15T01:21:29.530 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.522+0000 7fce49ffb700 1 --2- 172.21.15.1:0/231228141 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fce3805f150 0x7fce38061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:29.531 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.522+0000 7fce49ffb700 1 -- 172.21.15.1:0/231228141 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7fce500797d0 con 0x7fce540aa4d0 2023-11-15T01:21:29.531 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.522+0000 7fce59704700 1 --2- 172.21.15.1:0/231228141 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fce3805f150 0x7fce38061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:29.531 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.522+0000 7fce59704700 1 --2- 172.21.15.1:0/231228141 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fce3805f150 0x7fce38061610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fce540cb300 tx=0x7fce44008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:29.531 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.526+0000 7fce49ffb700 1 -- 172.21.15.1:0/231228141 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fce5004af70 con 0x7fce540aa4d0 2023-11-15T01:21:29.701 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.700+0000 7fce5c169700 1 -- 172.21.15.1:0/231228141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce540475e0 con 0x7fce540aa4d0 2023-11-15T01:21:29.701 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.701+0000 7fce49ffb700 1 -- 172.21.15.1:0/231228141 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+12132 (secure 0 0 0) 0x7fce5004ee60 con 0x7fce540aa4d0 2023-11-15T01:21:29.702 INFO:teuthology.misc.health.smithi001.stdout: 2023-11-15T01:21:29.702 INFO:teuthology.misc.health.smithi001.stdout:{"epoch":14,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:28.778860+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:21:29.704 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.703+0000 7fce5c169700 1 -- 172.21.15.1:0/231228141 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fce3805f150 msgr2=0x7fce38061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:29.704 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.703+0000 7fce5c169700 1 --2- 172.21.15.1:0/231228141 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fce3805f150 0x7fce38061610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fce540cb300 tx=0x7fce44008040).stop 2023-11-15T01:21:29.704 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.703+0000 7fce5c169700 1 -- 172.21.15.1:0/231228141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce540aa4d0 msgr2=0x7fce540ace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:29.704 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.703+0000 7fce5c169700 1 --2- 172.21.15.1:0/231228141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce540aa4d0 0x7fce540ace50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fce5000c4c0 tx=0x7fce50007df0).stop 2023-11-15T01:21:29.705 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.703+0000 7fce5c169700 1 -- 172.21.15.1:0/231228141 shutdown_connections 2023-11-15T01:21:29.705 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.703+0000 7fce5c169700 1 --2- 172.21.15.1:0/231228141 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fce3805f150 0x7fce38061610 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:29.705 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.703+0000 7fce5c169700 1 --2- 172.21.15.1:0/231228141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce54155340 0x7fce540cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:29.705 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.703+0000 7fce5c169700 1 --2- 172.21.15.1:0/231228141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce540aa4d0 0x7fce540ace50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:29.705 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.703+0000 7fce5c169700 1 --2- 172.21.15.1:0/231228141 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce540c6780 0x7fce540ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:29.706 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.703+0000 7fce5c169700 1 -- 172.21.15.1:0/231228141 >> 172.21.15.1:0/231228141 conn(0x7fce54069fa0 msgr2=0x7fce54154930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:29.706 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.703+0000 7fce5c169700 1 -- 172.21.15.1:0/231228141 shutdown_connections 2023-11-15T01:21:29.706 INFO:teuthology.misc.health.smithi001.stderr:2023-11-15T01:21:29.703+0000 7fce5c169700 1 -- 172.21.15.1:0/231228141 wait complete. 2023-11-15T01:21:29.715 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-15T01:21:29.715 INFO:tasks.ceph:Creating RBD pool 2023-11-15T01:21:29.715 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-15T01:21:29.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.833+0000 7fc92c5af700 1 Processor -- start 2023-11-15T01:21:29.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.833+0000 7fc92c5af700 1 -- start start 2023-11-15T01:21:29.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.834+0000 7fc92c5af700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc9241540a0 0x7fc9240ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:29.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.834+0000 7fc92c5af700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9240c6650 0x7fc9240ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:29.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.834+0000 7fc92c5af700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9240ca050 con 0x7fc924154480 2023-11-15T01:21:29.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.834+0000 7fc92c5af700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9240c9440 con 0x7fc9241540a0 2023-11-15T01:21:29.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.834+0000 7fc92c5af700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240c9720 con 0x7fc9240c6650 2023-11-15T01:21:29.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.834+0000 7fc92a34b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc9241540a0 0x7fc9240ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:29.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.834+0000 7fc929b4a700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc924154480 0x7fc9240c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:35292/0 (socket says 172.21.15.1:35292) 2023-11-15T01:21:29.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.834+0000 7fc929b4a700 1 -- 172.21.15.1:0/1041123764 learned_addr learned my addr 172.21.15.1:0/1041123764 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:29.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.834+0000 7fc92ab4c700 1 --2- 172.21.15.1:0/1041123764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9240c6650 0x7fc9240ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:29.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.834+0000 7fc92a34b700 1 -- 172.21.15.1:0/1041123764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9240c6650 msgr2=0x7fc9240ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:29.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.834+0000 7fc92a34b700 1 --2- 172.21.15.1:0/1041123764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9240c6650 0x7fc9240ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:29.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.834+0000 7fc92a34b700 1 -- 172.21.15.1:0/1041123764 >> v1:172.21.15.1:6789/0 conn(0x7fc924154480 legacy=0x7fc9240c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:29.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.834+0000 7fc929349700 1 -- 172.21.15.1:0/1041123764 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746644822 0 0) 0x7fc9240ca050 con 0x7fc924154480 2023-11-15T01:21:29.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.834+0000 7fc92a34b700 1 -- 172.21.15.1:0/1041123764 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9240c9a00 con 0x7fc9241540a0 2023-11-15T01:21:29.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.834+0000 7fc92ab4c700 1 --2- 172.21.15.1:0/1041123764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9240c6650 0x7fc9240ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:29.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.835+0000 7fc92a34b700 1 --2- 172.21.15.1:0/1041123764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9241540a0 0x7fc9240ca4e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc920009760 tx=0x7fc920009060).ready entity=mon.0 client_cookie=187ee34c82fe3464 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:29.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.835+0000 7fc929349700 1 -- 172.21.15.1:0/1041123764 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92000b580 con 0x7fc9241540a0 2023-11-15T01:21:29.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.835+0000 7fc929349700 1 -- 172.21.15.1:0/1041123764 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92000b6e0 con 0x7fc9241540a0 2023-11-15T01:21:29.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.835+0000 7fc929349700 1 -- 172.21.15.1:0/1041123764 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92000ba60 con 0x7fc9241540a0 2023-11-15T01:21:29.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.835+0000 7fc92c5af700 1 -- 172.21.15.1:0/1041123764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9241540a0 msgr2=0x7fc9240ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:29.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.835+0000 7fc92c5af700 1 --2- 172.21.15.1:0/1041123764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9241540a0 0x7fc9240ca4e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc920009760 tx=0x7fc920009060).stop 2023-11-15T01:21:29.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.835+0000 7fc92c5af700 1 -- 172.21.15.1:0/1041123764 shutdown_connections 2023-11-15T01:21:29.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.835+0000 7fc92c5af700 1 --2- 172.21.15.1:0/1041123764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9240c6650 0x7fc9240ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:29.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.835+0000 7fc92c5af700 1 --2- 172.21.15.1:0/1041123764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9241540a0 0x7fc9240ca4e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:29.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.835+0000 7fc92c5af700 1 -- 172.21.15.1:0/1041123764 >> 172.21.15.1:0/1041123764 conn(0x7fc924064a70 msgr2=0x7fc924064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:29.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.835+0000 7fc92c5af700 1 -- 172.21.15.1:0/1041123764 shutdown_connections 2023-11-15T01:21:29.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.835+0000 7fc92c5af700 1 -- 172.21.15.1:0/1041123764 wait complete. 2023-11-15T01:21:29.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.836+0000 7fc92c5af700 1 Processor -- start 2023-11-15T01:21:29.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.836+0000 7fc92c5af700 1 -- start start 2023-11-15T01:21:29.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc92c5af700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9240c6650 0x7fc924168630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:29.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc92c5af700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9241540a0 0x7fc924144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:29.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc92c5af700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc924154480 0x7fc924159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:29.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc92c5af700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc924156ef0 con 0x7fc924154480 2023-11-15T01:21:29.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc92c5af700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240b0f00 con 0x7fc9241540a0 2023-11-15T01:21:29.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc92c5af700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240b0910 con 0x7fc9240c6650 2023-11-15T01:21:29.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc92ab4c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc924154480 0x7fc924159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:29.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc92ab4c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc924154480 0x7fc924159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43802/0 (socket says 172.21.15.1:43802) 2023-11-15T01:21:29.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc92ab4c700 1 -- 172.21.15.1:0/781896930 learned_addr learned my addr 172.21.15.1:0/781896930 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:29.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc929b4a700 1 --2- 172.21.15.1:0/781896930 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9241540a0 0x7fc924144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:29.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc92a34b700 1 --2- 172.21.15.1:0/781896930 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9240c6650 0x7fc924168630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:29.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc92ab4c700 1 -- 172.21.15.1:0/781896930 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9240c6650 msgr2=0x7fc924168630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:29.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc92ab4c700 1 --2- 172.21.15.1:0/781896930 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9240c6650 0x7fc924168630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:29.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc92ab4c700 1 -- 172.21.15.1:0/781896930 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9241540a0 msgr2=0x7fc924144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:29.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc92ab4c700 1 --2- 172.21.15.1:0/781896930 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9241540a0 0x7fc924144e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:29.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.837+0000 7fc92ab4c700 1 -- 172.21.15.1:0/781896930 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9200092a0 con 0x7fc924154480 2023-11-15T01:21:29.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.838+0000 7fc92ab4c700 1 --2- 172.21.15.1:0/781896930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc924154480 0x7fc924159920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc91c00d180 tx=0x7fc91c009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:29.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.838+0000 7fc91a7fc700 1 -- 172.21.15.1:0/781896930 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c00de20 con 0x7fc924154480 2023-11-15T01:21:29.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.838+0000 7fc91a7fc700 1 -- 172.21.15.1:0/781896930 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c00f040 con 0x7fc924154480 2023-11-15T01:21:29.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.838+0000 7fc92c5af700 1 -- 172.21.15.1:0/781896930 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc924159e10 con 0x7fc924154480 2023-11-15T01:21:29.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.838+0000 7fc91a7fc700 1 -- 172.21.15.1:0/781896930 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c013620 con 0x7fc924154480 2023-11-15T01:21:29.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.838+0000 7fc92c5af700 1 -- 172.21.15.1:0/781896930 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9240ae490 con 0x7fc924154480 2023-11-15T01:21:29.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.839+0000 7fc92c5af700 1 -- 172.21.15.1:0/781896930 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9240b10b0 con 0x7fc924154480 2023-11-15T01:21:29.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.839+0000 7fc91a7fc700 1 -- 172.21.15.1:0/781896930 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc91c013a10 con 0x7fc924154480 2023-11-15T01:21:29.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.840+0000 7fc91a7fc700 1 --2- 172.21.15.1:0/781896930 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc90805f150 0x7fc908061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:29.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.840+0000 7fc91a7fc700 1 -- 172.21.15.1:0/781896930 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4916+0+0 (secure 0 0 0) 0x7fc91c07a410 con 0x7fc924154480 2023-11-15T01:21:29.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.840+0000 7fc92a34b700 1 --2- 172.21.15.1:0/781896930 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc90805f150 0x7fc908061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:29.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.840+0000 7fc92a34b700 1 --2- 172.21.15.1:0/781896930 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc90805f150 0x7fc908061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc9240c4f70 tx=0x7fc920017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:29.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:29.844+0000 7fc91a7fc700 1 -- 172.21.15.1:0/781896930 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc9240b10b0 con 0x7fc924154480 2023-11-15T01:21:30.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.017+0000 7fc92c5af700 1 -- 172.21.15.1:0/781896930 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fc9240b10b0 con 0x7fc924154480 2023-11-15T01:21:30.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.796+0000 7fc91a7fc700 1 -- 172.21.15.1:0/781896930 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7fc9240b10b0 con 0x7fc924154480 2023-11-15T01:21:30.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.799+0000 7fc92c5af700 1 -- 172.21.15.1:0/781896930 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc90805f150 msgr2=0x7fc908061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:30.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.799+0000 7fc92c5af700 1 --2- 172.21.15.1:0/781896930 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc90805f150 0x7fc908061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc9240c4f70 tx=0x7fc920017000).stop 2023-11-15T01:21:30.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.799+0000 7fc92c5af700 1 -- 172.21.15.1:0/781896930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc924154480 msgr2=0x7fc924159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:30.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.799+0000 7fc92c5af700 1 --2- 172.21.15.1:0/781896930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc924154480 0x7fc924159920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc91c00d180 tx=0x7fc91c009a50).stop 2023-11-15T01:21:30.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.799+0000 7fc92c5af700 1 -- 172.21.15.1:0/781896930 shutdown_connections 2023-11-15T01:21:30.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.799+0000 7fc92c5af700 1 --2- 172.21.15.1:0/781896930 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc90805f150 0x7fc908061610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:30.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.799+0000 7fc92c5af700 1 --2- 172.21.15.1:0/781896930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc924154480 0x7fc924159920 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:30.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.799+0000 7fc92c5af700 1 --2- 172.21.15.1:0/781896930 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9240c6650 0x7fc924168630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:30.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.799+0000 7fc92c5af700 1 --2- 172.21.15.1:0/781896930 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9241540a0 0x7fc924144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:30.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.799+0000 7fc92c5af700 1 -- 172.21.15.1:0/781896930 >> 172.21.15.1:0/781896930 conn(0x7fc924064a70 msgr2=0x7fc9240c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:30.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.799+0000 7fc92c5af700 1 -- 172.21.15.1:0/781896930 shutdown_connections 2023-11-15T01:21:30.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.799+0000 7fc92c5af700 1 -- 172.21.15.1:0/781896930 wait complete. 2023-11-15T01:21:30.802 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'rbd' created 2023-11-15T01:21:30.815 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-15T01:21:30.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.941+0000 7fece5dda700 1 Processor -- start 2023-11-15T01:21:30.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.941+0000 7fece5dda700 1 -- start start 2023-11-15T01:21:30.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fece5dda700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fece00ca5d0 0x7fece00aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:30.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fece5dda700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fece0063b50 0x7fece015df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:30.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fece5dda700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece01548f0 con 0x7fece0155610 2023-11-15T01:21:30.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fece5dda700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece00aaa50 con 0x7fece0063b50 2023-11-15T01:21:30.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fece5dda700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece00aa4f0 con 0x7fece00ca5d0 2023-11-15T01:21:30.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fece55d9700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fece0063b50 0x7fece015df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:30.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fece55d9700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fece0063b50 0x7fece015df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43804/0 (socket says 172.21.15.1:43804) 2023-11-15T01:21:30.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fece55d9700 1 -- 172.21.15.1:0/3944897206 learned_addr learned my addr 172.21.15.1:0/3944897206 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:30.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fece4dd8700 1 --2- 172.21.15.1:0/3944897206 >> v2:172.21.15.141:3300/0 conn(0x7fece00ca5d0 0x7fece00aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:30.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fece55d9700 1 -- 172.21.15.1:0/3944897206 >> v2:172.21.15.141:3300/0 conn(0x7fece00ca5d0 msgr2=0x7fece00aa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:30.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fece55d9700 1 --2- 172.21.15.1:0/3944897206 >> v2:172.21.15.141:3300/0 conn(0x7fece00ca5d0 0x7fece00aa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:30.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fece55d9700 1 -- 172.21.15.1:0/3944897206 >> v1:172.21.15.141:6789/0 conn(0x7fece0155610 legacy=0x7fece0063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:30.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fece55d9700 1 -- 172.21.15.1:0/3944897206 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece00aa770 con 0x7fece0063b50 2023-11-15T01:21:30.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fece4dd8700 1 --2- 172.21.15.1:0/3944897206 >> v2:172.21.15.141:3300/0 conn(0x7fece00ca5d0 0x7fece00aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:30.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fece55d9700 1 --2- 172.21.15.1:0/3944897206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fece0063b50 0x7fece015df20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fece005f440 tx=0x7fecd8009840).ready entity=mon.0 client_cookie=1cc598356e01bf21 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:30.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.942+0000 7fecdf7fe700 1 -- 172.21.15.1:0/3944897206 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd800e070 con 0x7fece0063b50 2023-11-15T01:21:30.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.943+0000 7fecdf7fe700 1 -- 172.21.15.1:0/3944897206 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd800ba50 con 0x7fece0063b50 2023-11-15T01:21:30.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.943+0000 7fecdf7fe700 1 -- 172.21.15.1:0/3944897206 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd800bdd0 con 0x7fece0063b50 2023-11-15T01:21:30.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.943+0000 7fece5dda700 1 -- 172.21.15.1:0/3944897206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fece0063b50 msgr2=0x7fece015df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:30.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.943+0000 7fece5dda700 1 --2- 172.21.15.1:0/3944897206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fece0063b50 0x7fece015df20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fece005f440 tx=0x7fecd8009840).stop 2023-11-15T01:21:30.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.943+0000 7fece5dda700 1 -- 172.21.15.1:0/3944897206 shutdown_connections 2023-11-15T01:21:30.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.943+0000 7fece5dda700 1 --2- 172.21.15.1:0/3944897206 >> v2:172.21.15.141:3300/0 conn(0x7fece00ca5d0 0x7fece00aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:30.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.943+0000 7fece5dda700 1 --2- 172.21.15.1:0/3944897206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fece0063b50 0x7fece015df20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:30.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.943+0000 7fece5dda700 1 -- 172.21.15.1:0/3944897206 >> 172.21.15.1:0/3944897206 conn(0x7fece006a9b0 msgr2=0x7fece00cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:30.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.943+0000 7fece5dda700 1 -- 172.21.15.1:0/3944897206 shutdown_connections 2023-11-15T01:21:30.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.943+0000 7fece5dda700 1 -- 172.21.15.1:0/3944897206 wait complete. 2023-11-15T01:21:30.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.944+0000 7fece5dda700 1 Processor -- start 2023-11-15T01:21:30.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.945+0000 7fece5dda700 1 -- start start 2023-11-15T01:21:30.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.945+0000 7fece5dda700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fece0063b50 0x7fece00c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:30.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.945+0000 7fece5dda700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fece00ca5d0 0x7fece00a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:30.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.945+0000 7fece5dda700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fece0155610 0x7fece0167df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:30.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.945+0000 7fece5dda700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece00c2a90 con 0x7fece0063b50 2023-11-15T01:21:30.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.945+0000 7fece5dda700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece00c2d70 con 0x7fece00ca5d0 2023-11-15T01:21:30.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.945+0000 7fece5dda700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece00c3050 con 0x7fece0155610 2023-11-15T01:21:30.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.945+0000 7fece4dd8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fece0063b50 0x7fece00c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:30.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.945+0000 7fece4dd8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fece0063b50 0x7fece00c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43818/0 (socket says 172.21.15.1:43818) 2023-11-15T01:21:30.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.945+0000 7fece4dd8700 1 -- 172.21.15.1:0/68368441 learned_addr learned my addr 172.21.15.1:0/68368441 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:30.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.946+0000 7fece55d9700 1 --2- 172.21.15.1:0/68368441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fece0155610 0x7fece0167df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:30.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.946+0000 7fecdffff700 1 --2- 172.21.15.1:0/68368441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fece00ca5d0 0x7fece00a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:30.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.946+0000 7fece4dd8700 1 -- 172.21.15.1:0/68368441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fece0155610 msgr2=0x7fece0167df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:30.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.946+0000 7fece4dd8700 1 --2- 172.21.15.1:0/68368441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fece0155610 0x7fece0167df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:30.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.946+0000 7fece4dd8700 1 -- 172.21.15.1:0/68368441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fece00ca5d0 msgr2=0x7fece00a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:30.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.946+0000 7fece4dd8700 1 --2- 172.21.15.1:0/68368441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fece00ca5d0 0x7fece00a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:30.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.946+0000 7fece4dd8700 1 -- 172.21.15.1:0/68368441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd8009ae0 con 0x7fece0063b50 2023-11-15T01:21:30.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.946+0000 7fecdffff700 1 --2- 172.21.15.1:0/68368441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fece00ca5d0 0x7fece00a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:30.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.946+0000 7fece4dd8700 1 --2- 172.21.15.1:0/68368441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fece0063b50 0x7fece00c24d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fecd400d860 tx=0x7fecd4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:30.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.946+0000 7fecdcff9700 1 -- 172.21.15.1:0/68368441 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4011590 con 0x7fece0063b50 2023-11-15T01:21:30.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.946+0000 7fecdcff9700 1 -- 172.21.15.1:0/68368441 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd40116f0 con 0x7fece0063b50 2023-11-15T01:21:30.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.946+0000 7fecdcff9700 1 -- 172.21.15.1:0/68368441 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4011a70 con 0x7fece0063b50 2023-11-15T01:21:30.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.946+0000 7fece5dda700 1 -- 172.21.15.1:0/68368441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece00c3330 con 0x7fece0063b50 2023-11-15T01:21:30.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.946+0000 7fece5dda700 1 -- 172.21.15.1:0/68368441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece00a2260 con 0x7fece0063b50 2023-11-15T01:21:30.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.947+0000 7fece5dda700 1 -- 172.21.15.1:0/68368441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece00c5dd0 con 0x7fece0063b50 2023-11-15T01:21:30.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.947+0000 7fecdcff9700 1 -- 172.21.15.1:0/68368441 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fecd4012420 con 0x7fece0063b50 2023-11-15T01:21:30.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.948+0000 7fecdcff9700 1 --2- 172.21.15.1:0/68368441 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fecc405f150 0x7fecc4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:30.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.948+0000 7fecdcff9700 1 -- 172.21.15.1:0/68368441 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5258+0+0 (secure 0 0 0) 0x7fecd4079a40 con 0x7fece0063b50 2023-11-15T01:21:30.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.948+0000 7fecdffff700 1 --2- 172.21.15.1:0/68368441 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fecc405f150 0x7fecc4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:30.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.948+0000 7fecdffff700 1 --2- 172.21.15.1:0/68368441 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fecc405f150 0x7fecc4061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fece00c29c0 tx=0x7feccc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:30.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:30.952+0000 7fecdcff9700 1 -- 172.21.15.1:0/68368441 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fecd407be60 con 0x7fece0063b50 2023-11-15T01:21:31.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.127+0000 7fece5dda700 1 -- 172.21.15.1:0/68368441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fece00475e0 con 0x7fece0063b50 2023-11-15T01:21:31.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.800+0000 7fecdcff9700 1 -- 172.21.15.1:0/68368441 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7fecd404b010 con 0x7fece0063b50 2023-11-15T01:21:31.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.803+0000 7fece5dda700 1 -- 172.21.15.1:0/68368441 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fecc405f150 msgr2=0x7fecc4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:31.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.803+0000 7fece5dda700 1 --2- 172.21.15.1:0/68368441 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fecc405f150 0x7fecc4061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fece00c29c0 tx=0x7feccc009040).stop 2023-11-15T01:21:31.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.803+0000 7fece5dda700 1 -- 172.21.15.1:0/68368441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fece0063b50 msgr2=0x7fece00c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:31.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.803+0000 7fece5dda700 1 --2- 172.21.15.1:0/68368441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fece0063b50 0x7fece00c24d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fecd400d860 tx=0x7fecd4008040).stop 2023-11-15T01:21:31.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.803+0000 7fece5dda700 1 -- 172.21.15.1:0/68368441 shutdown_connections 2023-11-15T01:21:31.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.803+0000 7fece5dda700 1 --2- 172.21.15.1:0/68368441 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fecc405f150 0x7fecc4061610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:31.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.803+0000 7fece5dda700 1 --2- 172.21.15.1:0/68368441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fece0155610 0x7fece0167df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:31.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.803+0000 7fece5dda700 1 --2- 172.21.15.1:0/68368441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fece0063b50 0x7fece00c24d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:31.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.803+0000 7fece5dda700 1 --2- 172.21.15.1:0/68368441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fece00ca5d0 0x7fece00a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:31.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.803+0000 7fece5dda700 1 -- 172.21.15.1:0/68368441 >> 172.21.15.1:0/68368441 conn(0x7fece006a9b0 msgr2=0x7fece00ad1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:31.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.803+0000 7fece5dda700 1 -- 172.21.15.1:0/68368441 shutdown_connections 2023-11-15T01:21:31.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.803+0000 7fece5dda700 1 -- 172.21.15.1:0/68368441 wait complete. 2023-11-15T01:21:31.808 INFO:teuthology.orchestra.run.smithi001.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-15T01:21:31.822 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-15T01:21:31.823 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-15T01:21:31.823 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-15T01:21:31.825 INFO:tasks.ceph.mds.a:Started 2023-11-15T01:21:31.826 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-15T01:21:31.826 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-15T01:21:31.828 INFO:tasks.ceph.mds.c:Started 2023-11-15T01:21:31.828 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-15T01:21:31.829 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-15T01:21:31.831 INFO:tasks.ceph.mds.b:Started 2023-11-15T01:21:31.832 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-15T01:21:31.832 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-15T01:21:31.834 INFO:tasks.ceph.mds.d:Started 2023-11-15T01:21:31.835 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-15T01:21:31.835 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:21:31.905 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T01:21:31.906 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-11-15T01:21:31.911 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-15T01:21:31.911 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T01:21:31.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.963+0000 7f5b3ed3d700 1 Processor -- start 2023-11-15T01:21:31.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.963+0000 7f5b3ed3d700 1 -- start start 2023-11-15T01:21:31.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.963+0000 7f5b3ed3d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380629e0 0x7f5b380c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:31.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.963+0000 7f5b3ed3d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5b380abb40 0x7f5b38064df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:31.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.963+0000 7f5b3ed3d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b380a9f60 con 0x7f5b380c3400 2023-11-15T01:21:31.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.963+0000 7f5b3ed3d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b380c3880 con 0x7f5b380abb40 2023-11-15T01:21:31.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.963+0000 7f5b3ed3d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b38151700 con 0x7f5b380629e0 2023-11-15T01:21:31.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.964+0000 7f5b3d2da700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5b380abb40 0x7f5b38064df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:31.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.964+0000 7f5b3d2da700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5b380abb40 0x7f5b38064df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43840/0 (socket says 172.21.15.1:43840) 2023-11-15T01:21:31.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.964+0000 7f5b3d2da700 1 -- 172.21.15.1:0/2341526880 learned_addr learned my addr 172.21.15.1:0/2341526880 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:31.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.964+0000 7f5b3cad9700 1 --2- 172.21.15.1:0/2341526880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380629e0 0x7f5b380c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:31.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.964+0000 7f5b3d2da700 1 -- 172.21.15.1:0/2341526880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380629e0 msgr2=0x7f5b380c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:31.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.964+0000 7f5b3d2da700 1 --2- 172.21.15.1:0/2341526880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380629e0 0x7f5b380c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:31.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.964+0000 7f5b3d2da700 1 -- 172.21.15.1:0/2341526880 >> v1:172.21.15.141:6789/0 conn(0x7f5b380c3400 legacy=0x7f5b380ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:31.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.964+0000 7f5b3d2da700 1 -- 172.21.15.1:0/2341526880 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b380c2a80 con 0x7f5b380abb40 2023-11-15T01:21:31.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.964+0000 7f5b3cad9700 1 --2- 172.21.15.1:0/2341526880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380629e0 0x7f5b380c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:31.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.964+0000 7f5b3d2da700 1 --2- 172.21.15.1:0/2341526880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b380abb40 0x7f5b38064df0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5b3000d1d0 tx=0x7f5b3000ba50).ready entity=mon.0 client_cookie=5f2606d1f67cd6e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:31.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.964+0000 7f5b377fe700 1 -- 172.21.15.1:0/2341526880 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30010070 con 0x7f5b380abb40 2023-11-15T01:21:31.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.964+0000 7f5b377fe700 1 -- 172.21.15.1:0/2341526880 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3000b0d0 con 0x7f5b380abb40 2023-11-15T01:21:31.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.964+0000 7f5b377fe700 1 -- 172.21.15.1:0/2341526880 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3000b450 con 0x7f5b380abb40 2023-11-15T01:21:31.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.965+0000 7f5b3ed3d700 1 -- 172.21.15.1:0/2341526880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b380abb40 msgr2=0x7f5b38064df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:31.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.965+0000 7f5b3ed3d700 1 --2- 172.21.15.1:0/2341526880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b380abb40 0x7f5b38064df0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5b3000d1d0 tx=0x7f5b3000ba50).stop 2023-11-15T01:21:31.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.965+0000 7f5b3ed3d700 1 -- 172.21.15.1:0/2341526880 shutdown_connections 2023-11-15T01:21:31.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.965+0000 7f5b3ed3d700 1 --2- 172.21.15.1:0/2341526880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380629e0 0x7f5b380c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:31.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.965+0000 7f5b3ed3d700 1 --2- 172.21.15.1:0/2341526880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b380abb40 0x7f5b38064df0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:31.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.965+0000 7f5b3ed3d700 1 -- 172.21.15.1:0/2341526880 >> 172.21.15.1:0/2341526880 conn(0x7f5b380c74f0 msgr2=0x7f5b380c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:31.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.965+0000 7f5b3ed3d700 1 -- 172.21.15.1:0/2341526880 shutdown_connections 2023-11-15T01:21:31.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.965+0000 7f5b3ed3d700 1 -- 172.21.15.1:0/2341526880 wait complete. 2023-11-15T01:21:31.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.966+0000 7f5b3ed3d700 1 Processor -- start 2023-11-15T01:21:31.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.966+0000 7f5b3ed3d700 1 -- start start 2023-11-15T01:21:31.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3ed3d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b380629e0 0x7f5b38164640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:31.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3ed3d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b380c3400 0x7f5b3814b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:31.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3ed3d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b3814de30 0x7f5b3814e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:31.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3ed3d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b38148850 con 0x7f5b380629e0 2023-11-15T01:21:31.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3ed3d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b38148b30 con 0x7f5b380c3400 2023-11-15T01:21:31.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3ed3d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b38148e10 con 0x7f5b3814de30 2023-11-15T01:21:31.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3cad9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b380629e0 0x7f5b38164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:31.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3cad9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b380629e0 0x7f5b38164640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43848/0 (socket says 172.21.15.1:43848) 2023-11-15T01:21:31.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3cad9700 1 -- 172.21.15.1:0/2221953405 learned_addr learned my addr 172.21.15.1:0/2221953405 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:31.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3d2da700 1 --2- 172.21.15.1:0/2221953405 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b3814de30 0x7f5b3814e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:31.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b37fff700 1 --2- 172.21.15.1:0/2221953405 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b380c3400 0x7f5b3814b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:31.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3cad9700 1 -- 172.21.15.1:0/2221953405 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b3814de30 msgr2=0x7f5b3814e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:31.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3cad9700 1 --2- 172.21.15.1:0/2221953405 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b3814de30 0x7f5b3814e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:31.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3cad9700 1 -- 172.21.15.1:0/2221953405 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b380c3400 msgr2=0x7f5b3814b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:31.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3cad9700 1 --2- 172.21.15.1:0/2221953405 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b380c3400 0x7f5b3814b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:31.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3cad9700 1 -- 172.21.15.1:0/2221953405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3000bcf0 con 0x7f5b380629e0 2023-11-15T01:21:31.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.967+0000 7f5b3cad9700 1 --2- 172.21.15.1:0/2221953405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b380629e0 0x7f5b38164640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5b2000d860 tx=0x7f5b20008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:31.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.968+0000 7f5b34ff9700 1 -- 172.21.15.1:0/2221953405 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2000f520 con 0x7f5b380629e0 2023-11-15T01:21:31.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.968+0000 7f5b34ff9700 1 -- 172.21.15.1:0/2221953405 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2000f680 con 0x7f5b380629e0 2023-11-15T01:21:31.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.968+0000 7f5b3ed3d700 1 -- 172.21.15.1:0/2221953405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b381490f0 con 0x7f5b380629e0 2023-11-15T01:21:31.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.968+0000 7f5b34ff9700 1 -- 172.21.15.1:0/2221953405 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2000fa00 con 0x7f5b380629e0 2023-11-15T01:21:31.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.968+0000 7f5b3ed3d700 1 -- 172.21.15.1:0/2221953405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3814b530 con 0x7f5b380629e0 2023-11-15T01:21:31.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.969+0000 7f5b3ed3d700 1 -- 172.21.15.1:0/2221953405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b38149740 con 0x7f5b380629e0 2023-11-15T01:21:31.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.969+0000 7f5b34ff9700 1 -- 172.21.15.1:0/2221953405 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5b20013480 con 0x7f5b380629e0 2023-11-15T01:21:31.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.969+0000 7f5b34ff9700 1 --2- 172.21.15.1:0/2221953405 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5b1805f150 0x7f5b18061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:31.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.969+0000 7f5b34ff9700 1 -- 172.21.15.1:0/2221953405 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5b20079b50 con 0x7f5b380629e0 2023-11-15T01:21:31.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.969+0000 7f5b37fff700 1 --2- 172.21.15.1:0/2221953405 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5b1805f150 0x7f5b18061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:31.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.970+0000 7f5b37fff700 1 --2- 172.21.15.1:0/2221953405 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5b1805f150 0x7f5b18061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5b38150bb0 tx=0x7f5b28009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:31.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:31.973+0000 7f5b34ff9700 1 -- 172.21.15.1:0/2221953405 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5b2004b170 con 0x7f5b380629e0 2023-11-15T01:21:32.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.145+0000 7f5b3ed3d700 1 -- 172.21.15.1:0/2221953405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b3806c7e0 con 0x7f5b380629e0 2023-11-15T01:21:32.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.146+0000 7f5b34ff9700 1 -- 172.21.15.1:0/2221953405 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13674 (secure 0 0 0) 0x7f5b2000b3f0 con 0x7f5b380629e0 2023-11-15T01:21:32.147 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:32.147 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:31.795226+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:21:32.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.148+0000 7f5b3ed3d700 1 -- 172.21.15.1:0/2221953405 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5b1805f150 msgr2=0x7f5b18061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.148+0000 7f5b3ed3d700 1 --2- 172.21.15.1:0/2221953405 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5b1805f150 0x7f5b18061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5b38150bb0 tx=0x7f5b28009040).stop 2023-11-15T01:21:32.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.148+0000 7f5b3ed3d700 1 -- 172.21.15.1:0/2221953405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b380629e0 msgr2=0x7f5b38164640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.148+0000 7f5b3ed3d700 1 --2- 172.21.15.1:0/2221953405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b380629e0 0x7f5b38164640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5b2000d860 tx=0x7f5b20008040).stop 2023-11-15T01:21:32.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.148+0000 7f5b3ed3d700 1 -- 172.21.15.1:0/2221953405 shutdown_connections 2023-11-15T01:21:32.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.148+0000 7f5b3ed3d700 1 --2- 172.21.15.1:0/2221953405 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5b1805f150 0x7f5b18061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.148+0000 7f5b3ed3d700 1 --2- 172.21.15.1:0/2221953405 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b3814de30 0x7f5b3814e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.148+0000 7f5b3ed3d700 1 --2- 172.21.15.1:0/2221953405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b380629e0 0x7f5b38164640 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.148+0000 7f5b3ed3d700 1 --2- 172.21.15.1:0/2221953405 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b380c3400 0x7f5b3814b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.148+0000 7f5b3ed3d700 1 -- 172.21.15.1:0/2221953405 >> 172.21.15.1:0/2221953405 conn(0x7f5b380c74f0 msgr2=0x7f5b380acd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:32.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.148+0000 7f5b3ed3d700 1 -- 172.21.15.1:0/2221953405 shutdown_connections 2023-11-15T01:21:32.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.148+0000 7f5b3ed3d700 1 -- 172.21.15.1:0/2221953405 wait complete. 2023-11-15T01:21:32.161 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-15T01:21:32.161 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:21:32.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.282+0000 7f953b59e700 1 Processor -- start 2023-11-15T01:21:32.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.282+0000 7f953b59e700 1 -- start start 2023-11-15T01:21:32.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.283+0000 7f953b59e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f953c1541d0 0x7f953c1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.283+0000 7f953b59e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f953c0c60d0 0x7f953c0c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.283+0000 7f953b59e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953c155830 con 0x7f953c0c7a60 2023-11-15T01:21:32.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.283+0000 7f953b59e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f953c158f40 con 0x7f953c1541d0 2023-11-15T01:21:32.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.283+0000 7f953b59e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f953c154c20 con 0x7f953c0c60d0 2023-11-15T01:21:32.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.283+0000 7f953a59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f953c1541d0 0x7f953c1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.283+0000 7f953ad9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f953c0c7a60 0x7f953c0c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:35320/0 (socket says 172.21.15.1:35320) 2023-11-15T01:21:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.283+0000 7f953ad9d700 1 -- 172.21.15.1:0/945691883 learned_addr learned my addr 172.21.15.1:0/945691883 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.283+0000 7f9539d9b700 1 --2- 172.21.15.1:0/945691883 >> v2:172.21.15.141:3300/0 conn(0x7f953c0c60d0 0x7f953c0c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.283+0000 7f953a59c700 1 -- 172.21.15.1:0/945691883 >> v2:172.21.15.141:3300/0 conn(0x7f953c0c60d0 msgr2=0x7f953c0c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.283+0000 7f953a59c700 1 --2- 172.21.15.1:0/945691883 >> v2:172.21.15.141:3300/0 conn(0x7f953c0c60d0 0x7f953c0c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.283+0000 7f953a59c700 1 -- 172.21.15.1:0/945691883 >> v1:172.21.15.1:6789/0 conn(0x7f953c0c7a60 legacy=0x7f953c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.283+0000 7f953a59c700 1 -- 172.21.15.1:0/945691883 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c154f00 con 0x7f953c1541d0 2023-11-15T01:21:32.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.283+0000 7f953959a700 1 -- 172.21.15.1:0/945691883 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790877961 0 0) 0x7f953c155830 con 0x7f953c0c7a60 2023-11-15T01:21:32.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.283+0000 7f953a59c700 1 --2- 172.21.15.1:0/945691883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f953c1541d0 0x7f953c1545b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f953c05fbf0 tx=0x7f952c009060).ready entity=mon.0 client_cookie=f8dba000d26094b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:32.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.284+0000 7f953959a700 1 -- 172.21.15.1:0/945691883 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c00b580 con 0x7f953c1541d0 2023-11-15T01:21:32.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.284+0000 7f953959a700 1 -- 172.21.15.1:0/945691883 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952c00b6e0 con 0x7f953c1541d0 2023-11-15T01:21:32.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.284+0000 7f953959a700 1 -- 172.21.15.1:0/945691883 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c00ba60 con 0x7f953c1541d0 2023-11-15T01:21:32.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.284+0000 7f953b59e700 1 -- 172.21.15.1:0/945691883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f953c1541d0 msgr2=0x7f953c1545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.284+0000 7f953b59e700 1 --2- 172.21.15.1:0/945691883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f953c1541d0 0x7f953c1545b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f953c05fbf0 tx=0x7f952c009060).stop 2023-11-15T01:21:32.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.284+0000 7f953b59e700 1 -- 172.21.15.1:0/945691883 shutdown_connections 2023-11-15T01:21:32.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.284+0000 7f953b59e700 1 --2- 172.21.15.1:0/945691883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f953c1541d0 0x7f953c1545b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.284+0000 7f953b59e700 1 --2- 172.21.15.1:0/945691883 >> v2:172.21.15.141:3300/0 conn(0x7f953c0c60d0 0x7f953c0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.284+0000 7f953b59e700 1 -- 172.21.15.1:0/945691883 >> 172.21.15.1:0/945691883 conn(0x7f953c069ee0 msgr2=0x7f953c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:32.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.284+0000 7f953b59e700 1 -- 172.21.15.1:0/945691883 shutdown_connections 2023-11-15T01:21:32.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.284+0000 7f953b59e700 1 -- 172.21.15.1:0/945691883 wait complete. 2023-11-15T01:21:32.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.285+0000 7f953b59e700 1 Processor -- start 2023-11-15T01:21:32.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.285+0000 7f953b59e700 1 -- start start 2023-11-15T01:21:32.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.286+0000 7f953b59e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f953c0c60d0 0x7f953c14f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.286+0000 7f953b59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f953c0c7a60 0x7f953c157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.286+0000 7f953b59e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f953c1541d0 0x7f953c157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.286+0000 7f953b59e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c157e30 con 0x7f953c0c7a60 2023-11-15T01:21:32.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.286+0000 7f953b59e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c156a20 con 0x7f953c0c60d0 2023-11-15T01:21:32.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.286+0000 7f953b59e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953c156d00 con 0x7f953c1541d0 2023-11-15T01:21:32.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.286+0000 7f9539d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f953c0c7a60 0x7f953c157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.286+0000 7f9539d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f953c0c7a60 0x7f953c157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43872/0 (socket says 172.21.15.1:43872) 2023-11-15T01:21:32.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.286+0000 7f9539d9b700 1 -- 172.21.15.1:0/800943017 learned_addr learned my addr 172.21.15.1:0/800943017 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:32.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.286+0000 7f953a59c700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f953c0c60d0 0x7f953c14f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.286+0000 7f953ad9d700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f953c1541d0 0x7f953c157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.287+0000 7f9539d9b700 1 -- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f953c1541d0 msgr2=0x7f953c157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.287+0000 7f9539d9b700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f953c1541d0 0x7f953c157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.287+0000 7f9539d9b700 1 -- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f953c0c60d0 msgr2=0x7f953c14f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.287+0000 7f9539d9b700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f953c0c60d0 0x7f953c14f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.287+0000 7f9539d9b700 1 -- 172.21.15.1:0/800943017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c0092a0 con 0x7f953c0c7a60 2023-11-15T01:21:32.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.287+0000 7f953ad9d700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f953c1541d0 0x7f953c157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:32.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.287+0000 7f953a59c700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f953c0c60d0 0x7f953c14f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:32.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.287+0000 7f9539d9b700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f953c0c7a60 0x7f953c157450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f953000c850 tx=0x7f9530008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:32.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.287+0000 7f952a7fc700 1 -- 172.21.15.1:0/800943017 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530010580 con 0x7f953c0c7a60 2023-11-15T01:21:32.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.287+0000 7f952a7fc700 1 -- 172.21.15.1:0/800943017 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95300106e0 con 0x7f953c0c7a60 2023-11-15T01:21:32.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.287+0000 7f953b59e700 1 -- 172.21.15.1:0/800943017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953c156fe0 con 0x7f953c0c7a60 2023-11-15T01:21:32.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.287+0000 7f952a7fc700 1 -- 172.21.15.1:0/800943017 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530010a60 con 0x7f953c0c7a60 2023-11-15T01:21:32.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.287+0000 7f953b59e700 1 -- 172.21.15.1:0/800943017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953c0ae4b0 con 0x7f953c0c7a60 2023-11-15T01:21:32.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.288+0000 7f953b59e700 1 -- 172.21.15.1:0/800943017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953c0ae640 con 0x7f953c0c7a60 2023-11-15T01:21:32.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.288+0000 7f952a7fc700 1 -- 172.21.15.1:0/800943017 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f953001b460 con 0x7f953c0c7a60 2023-11-15T01:21:32.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.289+0000 7f952a7fc700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f951c05f150 0x7f951c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.289+0000 7f952a7fc700 1 -- 172.21.15.1:0/800943017 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9530079e00 con 0x7f953c0c7a60 2023-11-15T01:21:32.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.289+0000 7f953a59c700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f951c05f150 0x7f951c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.289+0000 7f953a59c700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f951c05f150 0x7f951c061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f952c00b340 tx=0x7f952c017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:32.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.294+0000 7f952a7fc700 1 -- 172.21.15.1:0/800943017 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f953004b3c0 con 0x7f953c0c7a60 2023-11-15T01:21:32.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.467+0000 7f953b59e700 1 -- 172.21.15.1:0/800943017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f953c0475e0 con 0x7f953c0c7a60 2023-11-15T01:21:32.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.467+0000 7f952a7fc700 1 -- 172.21.15.1:0/800943017 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f953004e9e0 con 0x7f953c0c7a60 2023-11-15T01:21:32.468 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:21:32.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.469+0000 7f953b59e700 1 -- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f951c05f150 msgr2=0x7f951c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.469+0000 7f953b59e700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f951c05f150 0x7f951c061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f952c00b340 tx=0x7f952c017000).stop 2023-11-15T01:21:32.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.469+0000 7f953b59e700 1 -- 172.21.15.1:0/800943017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f953c0c7a60 msgr2=0x7f953c157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.469+0000 7f953b59e700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f953c0c7a60 0x7f953c157450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f953000c850 tx=0x7f9530008040).stop 2023-11-15T01:21:32.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.469+0000 7f953b59e700 1 -- 172.21.15.1:0/800943017 shutdown_connections 2023-11-15T01:21:32.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.469+0000 7f953b59e700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f951c05f150 0x7f951c061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.469+0000 7f953b59e700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f953c1541d0 0x7f953c157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.469+0000 7f953b59e700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f953c0c60d0 0x7f953c14f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.469+0000 7f953b59e700 1 --2- 172.21.15.1:0/800943017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f953c0c7a60 0x7f953c157450 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.469+0000 7f953b59e700 1 -- 172.21.15.1:0/800943017 >> 172.21.15.1:0/800943017 conn(0x7f953c069ee0 msgr2=0x7f953c0ab020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:32.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.469+0000 7f953b59e700 1 -- 172.21.15.1:0/800943017 shutdown_connections 2023-11-15T01:21:32.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.469+0000 7f953b59e700 1 -- 172.21.15.1:0/800943017 wait complete. 2023-11-15T01:21:32.481 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:21:32.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.601+0000 7fb6d07f7700 1 Processor -- start 2023-11-15T01:21:32.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.601+0000 7fb6d07f7700 1 -- start start 2023-11-15T01:21:32.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.602+0000 7fb6d07f7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb6c8062970 0x7fb6c80c4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.602+0000 7fb6d07f7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6c813bbe0 0x7fb6c8062d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.602+0000 7fb6d07f7700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c8156310 con 0x7fb6c80661e0 2023-11-15T01:21:32.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.602+0000 7fb6d07f7700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c8065a30 con 0x7fb6c8062970 2023-11-15T01:21:32.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.602+0000 7fb6d07f7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c806a1c0 con 0x7fb6c813bbe0 2023-11-15T01:21:32.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.603+0000 7fb6ce593700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb6c8062970 0x7fb6c80c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.603+0000 7fb6ced94700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6c813bbe0 0x7fb6c8062d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.603+0000 7fb6cdd92700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fb6c80661e0 0x7fb6c813b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:50246/0 (socket says 172.21.15.1:50246) 2023-11-15T01:21:32.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.603+0000 7fb6cdd92700 1 -- 172.21.15.1:0/1811831792 learned_addr learned my addr 172.21.15.1:0/1811831792 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:32.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.603+0000 7fb6cd591700 1 -- 172.21.15.1:0/1811831792 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811754574 0 0) 0x7fb6c8156310 con 0x7fb6c80661e0 2023-11-15T01:21:32.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.603+0000 7fb6cd591700 1 -- 172.21.15.1:0/1811831792 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6b00033f0 con 0x7fb6c80661e0 2023-11-15T01:21:32.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.603+0000 7fb6ced94700 1 -- 172.21.15.1:0/1811831792 >> v2:172.21.15.141:3300/0 conn(0x7fb6c8062970 msgr2=0x7fb6c80c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:32.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.603+0000 7fb6ced94700 1 --2- 172.21.15.1:0/1811831792 >> v2:172.21.15.141:3300/0 conn(0x7fb6c8062970 0x7fb6c80c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.603+0000 7fb6ced94700 1 -- 172.21.15.1:0/1811831792 >> v1:172.21.15.141:6789/0 conn(0x7fb6c80661e0 legacy=0x7fb6c813b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.603+0000 7fb6ced94700 1 -- 172.21.15.1:0/1811831792 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c806a460 con 0x7fb6c813bbe0 2023-11-15T01:21:32.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.603+0000 7fb6ce593700 1 --2- 172.21.15.1:0/1811831792 >> v2:172.21.15.141:3300/0 conn(0x7fb6c8062970 0x7fb6c80c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:32.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.603+0000 7fb6ced94700 1 --2- 172.21.15.1:0/1811831792 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6c813bbe0 0x7fb6c8062d50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb6b8009760 tx=0x7fb6b8009060).ready entity=mon.2 client_cookie=cbe4f437192a1e88 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:32.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.603+0000 7fb6cd591700 1 -- 172.21.15.1:0/1811831792 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b800d4a0 con 0x7fb6c813bbe0 2023-11-15T01:21:32.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.604+0000 7fb6cd591700 1 -- 172.21.15.1:0/1811831792 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b800d600 con 0x7fb6c813bbe0 2023-11-15T01:21:32.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.604+0000 7fb6cd591700 1 -- 172.21.15.1:0/1811831792 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b800d980 con 0x7fb6c813bbe0 2023-11-15T01:21:32.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.604+0000 7fb6d07f7700 1 -- 172.21.15.1:0/1811831792 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6c813bbe0 msgr2=0x7fb6c8062d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.604+0000 7fb6d07f7700 1 --2- 172.21.15.1:0/1811831792 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6c813bbe0 0x7fb6c8062d50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb6b8009760 tx=0x7fb6b8009060).stop 2023-11-15T01:21:32.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.604+0000 7fb6d07f7700 1 -- 172.21.15.1:0/1811831792 shutdown_connections 2023-11-15T01:21:32.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.604+0000 7fb6d07f7700 1 --2- 172.21.15.1:0/1811831792 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6c813bbe0 0x7fb6c8062d50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.604+0000 7fb6d07f7700 1 --2- 172.21.15.1:0/1811831792 >> v2:172.21.15.141:3300/0 conn(0x7fb6c8062970 0x7fb6c80c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.604+0000 7fb6d07f7700 1 -- 172.21.15.1:0/1811831792 >> 172.21.15.1:0/1811831792 conn(0x7fb6c80c7dc0 msgr2=0x7fb6c80c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:32.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.604+0000 7fb6d07f7700 1 -- 172.21.15.1:0/1811831792 shutdown_connections 2023-11-15T01:21:32.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.604+0000 7fb6d07f7700 1 -- 172.21.15.1:0/1811831792 wait complete. 2023-11-15T01:21:32.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.605+0000 7fb6d07f7700 1 Processor -- start 2023-11-15T01:21:32.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.605+0000 7fb6d07f7700 1 -- start start 2023-11-15T01:21:32.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.606+0000 7fb6d07f7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb6c8062970 0x7fb6c8139980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.606+0000 7fb6d07f7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6c80661e0 0x7fb6c80abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.606+0000 7fb6d07f7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c813bbe0 0x7fb6c80bf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.606+0000 7fb6d07f7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80acf10 con 0x7fb6c813bbe0 2023-11-15T01:21:32.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.606+0000 7fb6d07f7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c8139e70 con 0x7fb6c8062970 2023-11-15T01:21:32.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.606+0000 7fb6d07f7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80ac180 con 0x7fb6c80661e0 2023-11-15T01:21:32.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.606+0000 7fb6ced94700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c813bbe0 0x7fb6c80bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.606+0000 7fb6ced94700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c813bbe0 0x7fb6c80bf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43878/0 (socket says 172.21.15.1:43878) 2023-11-15T01:21:32.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.606+0000 7fb6ced94700 1 -- 172.21.15.1:0/958107951 learned_addr learned my addr 172.21.15.1:0/958107951 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:32.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.606+0000 7fb6cdd92700 1 --2- 172.21.15.1:0/958107951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6c80661e0 0x7fb6c80abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.606+0000 7fb6ce593700 1 --2- 172.21.15.1:0/958107951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb6c8062970 0x7fb6c8139980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.607+0000 7fb6ced94700 1 -- 172.21.15.1:0/958107951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6c80661e0 msgr2=0x7fb6c80abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.607+0000 7fb6ced94700 1 --2- 172.21.15.1:0/958107951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6c80661e0 0x7fb6c80abc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.607+0000 7fb6ced94700 1 -- 172.21.15.1:0/958107951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb6c8062970 msgr2=0x7fb6c8139980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.607+0000 7fb6ced94700 1 --2- 172.21.15.1:0/958107951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb6c8062970 0x7fb6c8139980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.607+0000 7fb6ced94700 1 -- 172.21.15.1:0/958107951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c0009a20 con 0x7fb6c813bbe0 2023-11-15T01:21:32.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.607+0000 7fb6ce593700 1 --2- 172.21.15.1:0/958107951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb6c8062970 0x7fb6c8139980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:32.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.607+0000 7fb6ced94700 1 --2- 172.21.15.1:0/958107951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c813bbe0 0x7fb6c80bf720 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb6b8010000 tx=0x7fb6b8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:32.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.607+0000 7fb6c67fc700 1 -- 172.21.15.1:0/958107951 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b800d770 con 0x7fb6c813bbe0 2023-11-15T01:21:32.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.607+0000 7fb6c67fc700 1 -- 172.21.15.1:0/958107951 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b800d8d0 con 0x7fb6c813bbe0 2023-11-15T01:21:32.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.607+0000 7fb6d07f7700 1 -- 172.21.15.1:0/958107951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b80092a0 con 0x7fb6c813bbe0 2023-11-15T01:21:32.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.607+0000 7fb6c67fc700 1 -- 172.21.15.1:0/958107951 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b801d660 con 0x7fb6c813bbe0 2023-11-15T01:21:32.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.607+0000 7fb6d07f7700 1 -- 172.21.15.1:0/958107951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c80ac390 con 0x7fb6c813bbe0 2023-11-15T01:21:32.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.608+0000 7fb6d07f7700 1 -- 172.21.15.1:0/958107951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c806c7e0 con 0x7fb6c813bbe0 2023-11-15T01:21:32.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.608+0000 7fb6c67fc700 1 -- 172.21.15.1:0/958107951 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb6b801da50 con 0x7fb6c813bbe0 2023-11-15T01:21:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.608+0000 7fb6c67fc700 1 --2- 172.21.15.1:0/958107951 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb6b405f120 0x7fb6b40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.609+0000 7fb6c67fc700 1 -- 172.21.15.1:0/958107951 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb6b807b870 con 0x7fb6c813bbe0 2023-11-15T01:21:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.609+0000 7fb6ce593700 1 --2- 172.21.15.1:0/958107951 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb6b405f120 0x7fb6b40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.609+0000 7fb6ce593700 1 --2- 172.21.15.1:0/958107951 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb6b405f120 0x7fb6b40615e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fb6c00099f0 tx=0x7fb6c000b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:32.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.613+0000 7fb6c67fc700 1 -- 172.21.15.1:0/958107951 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb6b804cfe0 con 0x7fb6c813bbe0 2023-11-15T01:21:32.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.785+0000 7fb6d07f7700 1 -- 172.21.15.1:0/958107951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb6c8155cc0 con 0x7fb6c813bbe0 2023-11-15T01:21:32.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.785+0000 7fb6c67fc700 1 -- 172.21.15.1:0/958107951 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb6b8050600 con 0x7fb6c813bbe0 2023-11-15T01:21:32.786 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:21:32.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.787+0000 7fb6d07f7700 1 -- 172.21.15.1:0/958107951 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb6b405f120 msgr2=0x7fb6b40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.787+0000 7fb6d07f7700 1 --2- 172.21.15.1:0/958107951 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb6b405f120 0x7fb6b40615e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fb6c00099f0 tx=0x7fb6c000b040).stop 2023-11-15T01:21:32.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.787+0000 7fb6d07f7700 1 -- 172.21.15.1:0/958107951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c813bbe0 msgr2=0x7fb6c80bf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.787+0000 7fb6d07f7700 1 --2- 172.21.15.1:0/958107951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c813bbe0 0x7fb6c80bf720 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb6b8010000 tx=0x7fb6b8016000).stop 2023-11-15T01:21:32.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.787+0000 7fb6d07f7700 1 -- 172.21.15.1:0/958107951 shutdown_connections 2023-11-15T01:21:32.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.787+0000 7fb6d07f7700 1 --2- 172.21.15.1:0/958107951 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb6b405f120 0x7fb6b40615e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.787+0000 7fb6d07f7700 1 --2- 172.21.15.1:0/958107951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c813bbe0 0x7fb6c80bf720 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.787+0000 7fb6d07f7700 1 --2- 172.21.15.1:0/958107951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb6c8062970 0x7fb6c8139980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.787+0000 7fb6d07f7700 1 --2- 172.21.15.1:0/958107951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6c80661e0 0x7fb6c80abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.787+0000 7fb6d07f7700 1 -- 172.21.15.1:0/958107951 >> 172.21.15.1:0/958107951 conn(0x7fb6c80c7dc0 msgr2=0x7fb6c813a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:32.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.787+0000 7fb6d07f7700 1 -- 172.21.15.1:0/958107951 shutdown_connections 2023-11-15T01:21:32.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.787+0000 7fb6d07f7700 1 -- 172.21.15.1:0/958107951 wait complete. 2023-11-15T01:21:32.800 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:21:32.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.918+0000 7fbf66b6c700 1 Processor -- start 2023-11-15T01:21:32.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.918+0000 7fbf66b6c700 1 -- start start 2023-11-15T01:21:32.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.919+0000 7fbf66b6c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbf600bdfb0 0x7fbf600be390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.919+0000 7fbf66b6c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbf60154e70 0x7fbf60155270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.919+0000 7fbf66b6c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf600ad5e0 con 0x7fbf600c6d10 2023-11-15T01:21:32.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.919+0000 7fbf66b6c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf600bccd0 con 0x7fbf600bdfb0 2023-11-15T01:21:32.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.919+0000 7fbf66b6c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf600ad8c0 con 0x7fbf60154e70 2023-11-15T01:21:32.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.919+0000 7fbf64908700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbf600bdfb0 0x7fbf600be390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.919+0000 7fbf64908700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbf600bdfb0 0x7fbf600be390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43886/0 (socket says 172.21.15.1:43886) 2023-11-15T01:21:32.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.919+0000 7fbf64908700 1 -- 172.21.15.1:0/2200279891 learned_addr learned my addr 172.21.15.1:0/2200279891 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:32.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.919+0000 7fbf65109700 1 --2- 172.21.15.1:0/2200279891 >> v2:172.21.15.141:3300/0 conn(0x7fbf60154e70 0x7fbf60155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.919+0000 7fbf64908700 1 -- 172.21.15.1:0/2200279891 >> v2:172.21.15.141:3300/0 conn(0x7fbf60154e70 msgr2=0x7fbf60155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:32.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.919+0000 7fbf64908700 1 --2- 172.21.15.1:0/2200279891 >> v2:172.21.15.141:3300/0 conn(0x7fbf60154e70 0x7fbf60155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.919+0000 7fbf64908700 1 -- 172.21.15.1:0/2200279891 >> v1:172.21.15.141:6789/0 conn(0x7fbf600c6d10 legacy=0x7fbf600bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.919+0000 7fbf64908700 1 -- 172.21.15.1:0/2200279891 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf600adba0 con 0x7fbf600bdfb0 2023-11-15T01:21:32.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.919+0000 7fbf64908700 1 --2- 172.21.15.1:0/2200279891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf600bdfb0 0x7fbf600be390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbf60155f70 tx=0x7fbf540090f0).ready entity=mon.0 client_cookie=48fafd33881fdcd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:32.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.919+0000 7fbf5f7fe700 1 -- 172.21.15.1:0/2200279891 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400b520 con 0x7fbf600bdfb0 2023-11-15T01:21:32.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.920+0000 7fbf5f7fe700 1 -- 172.21.15.1:0/2200279891 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5400b680 con 0x7fbf600bdfb0 2023-11-15T01:21:32.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.920+0000 7fbf5f7fe700 1 -- 172.21.15.1:0/2200279891 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400ba00 con 0x7fbf600bdfb0 2023-11-15T01:21:32.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.920+0000 7fbf66b6c700 1 -- 172.21.15.1:0/2200279891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf600bdfb0 msgr2=0x7fbf600be390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.920+0000 7fbf66b6c700 1 --2- 172.21.15.1:0/2200279891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf600bdfb0 0x7fbf600be390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbf60155f70 tx=0x7fbf540090f0).stop 2023-11-15T01:21:32.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.920+0000 7fbf66b6c700 1 -- 172.21.15.1:0/2200279891 shutdown_connections 2023-11-15T01:21:32.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.920+0000 7fbf66b6c700 1 --2- 172.21.15.1:0/2200279891 >> v2:172.21.15.141:3300/0 conn(0x7fbf60154e70 0x7fbf60155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.920+0000 7fbf66b6c700 1 --2- 172.21.15.1:0/2200279891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf600bdfb0 0x7fbf600be390 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.920+0000 7fbf66b6c700 1 -- 172.21.15.1:0/2200279891 >> 172.21.15.1:0/2200279891 conn(0x7fbf600c7d70 msgr2=0x7fbf600c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:32.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.920+0000 7fbf66b6c700 1 -- 172.21.15.1:0/2200279891 shutdown_connections 2023-11-15T01:21:32.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.920+0000 7fbf66b6c700 1 -- 172.21.15.1:0/2200279891 wait complete. 2023-11-15T01:21:32.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.921+0000 7fbf66b6c700 1 Processor -- start 2023-11-15T01:21:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.921+0000 7fbf66b6c700 1 -- start start 2023-11-15T01:21:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.922+0000 7fbf66b6c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf600bdfb0 0x7fbf601469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.922+0000 7fbf66b6c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf600c6d10 0x7fbf60146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.922+0000 7fbf66b6c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf60154e70 0x7fbf60162aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.922+0000 7fbf66b6c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf601473c0 con 0x7fbf60154e70 2023-11-15T01:21:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.922+0000 7fbf66b6c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600bfeb0 con 0x7fbf600bdfb0 2023-11-15T01:21:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.922+0000 7fbf66b6c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600c1870 con 0x7fbf600c6d10 2023-11-15T01:21:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.922+0000 7fbf65109700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf60154e70 0x7fbf60162aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.922+0000 7fbf65109700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf60154e70 0x7fbf60162aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43896/0 (socket says 172.21.15.1:43896) 2023-11-15T01:21:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.922+0000 7fbf65109700 1 -- 172.21.15.1:0/1388668252 learned_addr learned my addr 172.21.15.1:0/1388668252 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.922+0000 7fbf64908700 1 --2- 172.21.15.1:0/1388668252 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf600bdfb0 0x7fbf601469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.922+0000 7fbf5ffff700 1 --2- 172.21.15.1:0/1388668252 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf600c6d10 0x7fbf60146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.923+0000 7fbf65109700 1 -- 172.21.15.1:0/1388668252 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf600c6d10 msgr2=0x7fbf60146ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.923+0000 7fbf65109700 1 --2- 172.21.15.1:0/1388668252 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf600c6d10 0x7fbf60146ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.923+0000 7fbf65109700 1 -- 172.21.15.1:0/1388668252 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf600bdfb0 msgr2=0x7fbf601469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:32.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.923+0000 7fbf65109700 1 --2- 172.21.15.1:0/1388668252 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf600bdfb0 0x7fbf601469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:32.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.923+0000 7fbf65109700 1 -- 172.21.15.1:0/1388668252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf54009370 con 0x7fbf60154e70 2023-11-15T01:21:32.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.923+0000 7fbf65109700 1 --2- 172.21.15.1:0/1388668252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf60154e70 0x7fbf60162aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fbf58009e90 tx=0x7fbf5800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:32.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.923+0000 7fbf5cff9700 1 -- 172.21.15.1:0/1388668252 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5800caa0 con 0x7fbf60154e70 2023-11-15T01:21:32.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.923+0000 7fbf5cff9700 1 -- 172.21.15.1:0/1388668252 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5800f040 con 0x7fbf60154e70 2023-11-15T01:21:32.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.923+0000 7fbf66b6c700 1 -- 172.21.15.1:0/1388668252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf600bf2a0 con 0x7fbf60154e70 2023-11-15T01:21:32.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.923+0000 7fbf5cff9700 1 -- 172.21.15.1:0/1388668252 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5800ce10 con 0x7fbf60154e70 2023-11-15T01:21:32.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.923+0000 7fbf66b6c700 1 -- 172.21.15.1:0/1388668252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf600bf860 con 0x7fbf60154e70 2023-11-15T01:21:32.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.924+0000 7fbf66b6c700 1 -- 172.21.15.1:0/1388668252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6006c7e0 con 0x7fbf60154e70 2023-11-15T01:21:32.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.924+0000 7fbf5cff9700 1 -- 172.21.15.1:0/1388668252 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbf58013610 con 0x7fbf60154e70 2023-11-15T01:21:32.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.925+0000 7fbf5cff9700 1 --2- 172.21.15.1:0/1388668252 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf4405f150 0x7fbf44061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:32.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.925+0000 7fbf5cff9700 1 -- 172.21.15.1:0/1388668252 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fbf5807a650 con 0x7fbf60154e70 2023-11-15T01:21:32.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.925+0000 7fbf64908700 1 --2- 172.21.15.1:0/1388668252 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf4405f150 0x7fbf44061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:32.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.925+0000 7fbf64908700 1 --2- 172.21.15.1:0/1388668252 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf4405f150 0x7fbf44061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fbf54009130 tx=0x7fbf54017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:32.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:32.929+0000 7fbf5cff9700 1 -- 172.21.15.1:0/1388668252 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbf5804bc70 con 0x7fbf60154e70 2023-11-15T01:21:33.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.144+0000 7fbf66b6c700 1 -- 172.21.15.1:0/1388668252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf6006a530 con 0x7fbf60154e70 2023-11-15T01:21:33.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.145+0000 7fbf5cff9700 1 -- 172.21.15.1:0/1388668252 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7fbf5804f290 con 0x7fbf60154e70 2023-11-15T01:21:33.146 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:33.146 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/843391361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":843391361},{"type":"v1","addr":"172.21.15.141:6837","nonce":843391361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2237478530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2237478530},{"type":"v1","addr":"172.21.15.141:6836","nonce":2237478530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2856672167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2856672167},{"type":"v1","addr":"172.21.15.1:6833","nonce":2856672167}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/4209655632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4209655632},{"type":"v1","addr":"172.21.15.1:6835","nonce":4209655632}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-11-15T01:21:33.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.147+0000 7fbf66b6c700 1 -- 172.21.15.1:0/1388668252 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf4405f150 msgr2=0x7fbf44061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.147+0000 7fbf66b6c700 1 --2- 172.21.15.1:0/1388668252 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf4405f150 0x7fbf44061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fbf54009130 tx=0x7fbf54017000).stop 2023-11-15T01:21:33.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.147+0000 7fbf66b6c700 1 -- 172.21.15.1:0/1388668252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf60154e70 msgr2=0x7fbf60162aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.147+0000 7fbf66b6c700 1 --2- 172.21.15.1:0/1388668252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf60154e70 0x7fbf60162aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fbf58009e90 tx=0x7fbf5800b040).stop 2023-11-15T01:21:33.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.147+0000 7fbf66b6c700 1 -- 172.21.15.1:0/1388668252 shutdown_connections 2023-11-15T01:21:33.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.147+0000 7fbf66b6c700 1 --2- 172.21.15.1:0/1388668252 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf4405f150 0x7fbf44061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.147+0000 7fbf66b6c700 1 --2- 172.21.15.1:0/1388668252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf60154e70 0x7fbf60162aa0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.147+0000 7fbf66b6c700 1 --2- 172.21.15.1:0/1388668252 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf600bdfb0 0x7fbf601469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.147+0000 7fbf66b6c700 1 --2- 172.21.15.1:0/1388668252 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf600c6d10 0x7fbf60146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.147+0000 7fbf66b6c700 1 -- 172.21.15.1:0/1388668252 >> 172.21.15.1:0/1388668252 conn(0x7fbf600c7d70 msgr2=0x7fbf600c40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:33.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.147+0000 7fbf66b6c700 1 -- 172.21.15.1:0/1388668252 shutdown_connections 2023-11-15T01:21:33.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.147+0000 7fbf66b6c700 1 -- 172.21.15.1:0/1388668252 wait complete. 2023-11-15T01:21:33.151 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 3 2023-11-15T01:21:33.159 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:21:33.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.277+0000 7f13ca189700 1 Processor -- start 2023-11-15T01:21:33.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.277+0000 7f13ca189700 1 -- start start 2023-11-15T01:21:33.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.277+0000 7f13ca189700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13c40ab1a0 0x7f13c4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.277+0000 7f13ca189700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c40aa060 0x7f13c40c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.277+0000 7f13ca189700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c40c06f0 con 0x7f13c4154150 2023-11-15T01:21:33.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.277+0000 7f13ca189700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c40c09d0 con 0x7f13c40ab1a0 2023-11-15T01:21:33.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.277+0000 7f13ca189700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c4158820 con 0x7f13c40aa060 2023-11-15T01:21:33.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.278+0000 7f13c2ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13c40ab1a0 0x7f13c4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.278+0000 7f13c2ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13c40ab1a0 0x7f13c4154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43902/0 (socket says 172.21.15.1:43902) 2023-11-15T01:21:33.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.278+0000 7f13c2ffd700 1 -- 172.21.15.1:0/2359182775 learned_addr learned my addr 172.21.15.1:0/2359182775 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:33.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.278+0000 7f13c2ffd700 1 -- 172.21.15.1:0/2359182775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c40aa060 msgr2=0x7f13c40c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:33.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.278+0000 7f13c3fff700 1 --2- 172.21.15.1:0/2359182775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c40aa060 0x7f13c40c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.278+0000 7f13c2ffd700 1 --2- 172.21.15.1:0/2359182775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c40aa060 0x7f13c40c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.278+0000 7f13c2ffd700 1 -- 172.21.15.1:0/2359182775 >> v1:172.21.15.141:6789/0 conn(0x7f13c4154150 legacy=0x7f13c4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:33.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.278+0000 7f13c2ffd700 1 -- 172.21.15.1:0/2359182775 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c4158b00 con 0x7f13c40ab1a0 2023-11-15T01:21:33.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.278+0000 7f13c2ffd700 1 --2- 172.21.15.1:0/2359182775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c40ab1a0 0x7f13c4154530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f13b8006fd0 tx=0x7f13b80090f0).ready entity=mon.0 client_cookie=5169eec73dd07647 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:33.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.278+0000 7f13c27fc700 1 -- 172.21.15.1:0/2359182775 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b800b600 con 0x7f13c40ab1a0 2023-11-15T01:21:33.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.278+0000 7f13c27fc700 1 -- 172.21.15.1:0/2359182775 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b800b760 con 0x7f13c40ab1a0 2023-11-15T01:21:33.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.278+0000 7f13c27fc700 1 -- 172.21.15.1:0/2359182775 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b800bb00 con 0x7f13c40ab1a0 2023-11-15T01:21:33.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.279+0000 7f13ca189700 1 -- 172.21.15.1:0/2359182775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c40ab1a0 msgr2=0x7f13c4154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.279+0000 7f13ca189700 1 --2- 172.21.15.1:0/2359182775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c40ab1a0 0x7f13c4154530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f13b8006fd0 tx=0x7f13b80090f0).stop 2023-11-15T01:21:33.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.279+0000 7f13ca189700 1 -- 172.21.15.1:0/2359182775 shutdown_connections 2023-11-15T01:21:33.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.279+0000 7f13ca189700 1 --2- 172.21.15.1:0/2359182775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c40aa060 0x7f13c40c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.279+0000 7f13ca189700 1 --2- 172.21.15.1:0/2359182775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c40ab1a0 0x7f13c4154530 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.279+0000 7f13ca189700 1 -- 172.21.15.1:0/2359182775 >> 172.21.15.1:0/2359182775 conn(0x7f13c4064aa0 msgr2=0x7f13c4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:33.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.279+0000 7f13ca189700 1 -- 172.21.15.1:0/2359182775 shutdown_connections 2023-11-15T01:21:33.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.279+0000 7f13ca189700 1 -- 172.21.15.1:0/2359182775 wait complete. 2023-11-15T01:21:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.280+0000 7f13ca189700 1 Processor -- start 2023-11-15T01:21:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.280+0000 7f13ca189700 1 -- start start 2023-11-15T01:21:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13ca189700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c40aa060 0x7f13c40c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13ca189700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13c40ab1a0 0x7f13c40c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13ca189700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c4154150 0x7f13c40c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13ca189700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c4156420 con 0x7f13c40aa060 2023-11-15T01:21:33.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13ca189700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c4153500 con 0x7f13c40ab1a0 2023-11-15T01:21:33.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13ca189700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c4157210 con 0x7f13c4154150 2023-11-15T01:21:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13c37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c40aa060 0x7f13c40c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13c37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c40aa060 0x7f13c40c2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43914/0 (socket says 172.21.15.1:43914) 2023-11-15T01:21:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13c37fe700 1 -- 172.21.15.1:0/616790907 learned_addr learned my addr 172.21.15.1:0/616790907 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13c2ffd700 1 --2- 172.21.15.1:0/616790907 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13c40ab1a0 0x7f13c40c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13c3fff700 1 --2- 172.21.15.1:0/616790907 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c4154150 0x7f13c40c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13c37fe700 1 -- 172.21.15.1:0/616790907 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c4154150 msgr2=0x7f13c40c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13c37fe700 1 --2- 172.21.15.1:0/616790907 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c4154150 0x7f13c40c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13c37fe700 1 -- 172.21.15.1:0/616790907 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13c40ab1a0 msgr2=0x7f13c40c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13c37fe700 1 --2- 172.21.15.1:0/616790907 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13c40ab1a0 0x7f13c40c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13c37fe700 1 -- 172.21.15.1:0/616790907 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b8009370 con 0x7f13c40aa060 2023-11-15T01:21:33.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13c3fff700 1 --2- 172.21.15.1:0/616790907 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c4154150 0x7f13c40c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:33.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13c37fe700 1 --2- 172.21.15.1:0/616790907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c40aa060 0x7f13c40c2140 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f13b400b460 tx=0x7f13b4006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:33.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.281+0000 7f13ab7fe700 1 -- 172.21.15.1:0/616790907 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b4012410 con 0x7f13c40aa060 2023-11-15T01:21:33.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.282+0000 7f13ab7fe700 1 -- 172.21.15.1:0/616790907 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b4012590 con 0x7f13c40aa060 2023-11-15T01:21:33.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.282+0000 7f13ca189700 1 -- 172.21.15.1:0/616790907 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c4156600 con 0x7f13c40aa060 2023-11-15T01:21:33.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.282+0000 7f13ab7fe700 1 -- 172.21.15.1:0/616790907 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b4012950 con 0x7f13c40aa060 2023-11-15T01:21:33.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.282+0000 7f13ca189700 1 -- 172.21.15.1:0/616790907 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c4156bc0 con 0x7f13c40aa060 2023-11-15T01:21:33.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.282+0000 7f13ca189700 1 -- 172.21.15.1:0/616790907 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c406c7e0 con 0x7f13c40aa060 2023-11-15T01:21:33.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.283+0000 7f13ab7fe700 1 -- 172.21.15.1:0/616790907 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f13b4012cc0 con 0x7f13c40aa060 2023-11-15T01:21:33.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.283+0000 7f13ab7fe700 1 --2- 172.21.15.1:0/616790907 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f150 0x7f13b0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.283+0000 7f13ab7fe700 1 -- 172.21.15.1:0/616790907 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f13b4079c80 con 0x7f13c40aa060 2023-11-15T01:21:33.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.283+0000 7f13c2ffd700 1 --2- 172.21.15.1:0/616790907 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f150 0x7f13b0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.284+0000 7f13c2ffd700 1 --2- 172.21.15.1:0/616790907 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f150 0x7f13b0061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f13c4157630 tx=0x7f13b8017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:33.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.287+0000 7f13ab7fe700 1 -- 172.21.15.1:0/616790907 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f13b404b2a0 con 0x7f13c40aa060 2023-11-15T01:21:33.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.458+0000 7f13ca189700 1 -- 172.21.15.1:0/616790907 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13c4158de0 con 0x7f13c40aa060 2023-11-15T01:21:33.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.459+0000 7f13ab7fe700 1 -- 172.21.15.1:0/616790907 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13661 (secure 0 0 0) 0x7f13b404e8c0 con 0x7f13c40aa060 2023-11-15T01:21:33.460 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:33.460 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":18,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:32.799436+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:21:33.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.461+0000 7f13ca189700 1 -- 172.21.15.1:0/616790907 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f150 msgr2=0x7f13b0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.461+0000 7f13ca189700 1 --2- 172.21.15.1:0/616790907 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f150 0x7f13b0061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f13c4157630 tx=0x7f13b8017000).stop 2023-11-15T01:21:33.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.461+0000 7f13ca189700 1 -- 172.21.15.1:0/616790907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c40aa060 msgr2=0x7f13c40c2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.461+0000 7f13ca189700 1 --2- 172.21.15.1:0/616790907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c40aa060 0x7f13c40c2140 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f13b400b460 tx=0x7f13b4006f20).stop 2023-11-15T01:21:33.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.461+0000 7f13ca189700 1 -- 172.21.15.1:0/616790907 shutdown_connections 2023-11-15T01:21:33.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.461+0000 7f13ca189700 1 --2- 172.21.15.1:0/616790907 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f150 0x7f13b0061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.461+0000 7f13ca189700 1 --2- 172.21.15.1:0/616790907 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c4154150 0x7f13c40c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.461+0000 7f13ca189700 1 --2- 172.21.15.1:0/616790907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c40aa060 0x7f13c40c2140 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.461+0000 7f13ca189700 1 --2- 172.21.15.1:0/616790907 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13c40ab1a0 0x7f13c40c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.461+0000 7f13ca189700 1 -- 172.21.15.1:0/616790907 >> 172.21.15.1:0/616790907 conn(0x7f13c4064aa0 msgr2=0x7f13c414d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:33.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.461+0000 7f13ca189700 1 -- 172.21.15.1:0/616790907 shutdown_connections 2023-11-15T01:21:33.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.461+0000 7f13ca189700 1 -- 172.21.15.1:0/616790907 wait complete. 2023-11-15T01:21:33.474 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-15T01:21:33.475 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:21:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.595+0000 7fbe78946700 1 Processor -- start 2023-11-15T01:21:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.595+0000 7fbe78946700 1 -- start start 2023-11-15T01:21:33.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.596+0000 7fbe78946700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbe740c8170 0x7fbe7415f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.596+0000 7fbe78946700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe74155830 con 0x7fbe741541d0 2023-11-15T01:21:33.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.596+0000 7fbe78946700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe74154c20 con 0x7fbe741545b0 2023-11-15T01:21:33.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.596+0000 7fbe78946700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe74158f40 con 0x7fbe740c8170 2023-11-15T01:21:33.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.596+0000 7fbe737fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fbe741541d0 0x7fbe740c60d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:35332/0 (socket says 172.21.15.1:35332) 2023-11-15T01:21:33.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.596+0000 7fbe73fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbe740c8170 0x7fbe7415f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.596+0000 7fbe737fe700 1 -- 172.21.15.1:0/2876460908 learned_addr learned my addr 172.21.15.1:0/2876460908 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:33.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.596+0000 7fbe73fff700 1 -- 172.21.15.1:0/2876460908 >> v1:172.21.15.141:6789/0 conn(0x7fbe741545b0 legacy=0x7fbe740c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.596+0000 7fbe73fff700 1 -- 172.21.15.1:0/2876460908 >> v1:172.21.15.1:6789/0 conn(0x7fbe741541d0 legacy=0x7fbe740c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.596+0000 7fbe73fff700 1 -- 172.21.15.1:0/2876460908 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe74154f00 con 0x7fbe740c8170 2023-11-15T01:21:33.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.596+0000 7fbe727fc700 1 -- 172.21.15.1:0/2876460908 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560399007 0 0) 0x7fbe74155830 con 0x7fbe741541d0 2023-11-15T01:21:33.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.596+0000 7fbe73fff700 1 --2- 172.21.15.1:0/2876460908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe740c8170 0x7fbe7415f2d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbe6c009e60 tx=0x7fbe6c009780).ready entity=mon.0 client_cookie=9456cf28cd1c408e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:33.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.597+0000 7fbe727fc700 1 -- 172.21.15.1:0/2876460908 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00e070 con 0x7fbe740c8170 2023-11-15T01:21:33.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.597+0000 7fbe727fc700 1 -- 172.21.15.1:0/2876460908 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c00bc30 con 0x7fbe740c8170 2023-11-15T01:21:33.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.597+0000 7fbe727fc700 1 -- 172.21.15.1:0/2876460908 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c012410 con 0x7fbe740c8170 2023-11-15T01:21:33.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.597+0000 7fbe78946700 1 -- 172.21.15.1:0/2876460908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe740c8170 msgr2=0x7fbe7415f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.597+0000 7fbe78946700 1 --2- 172.21.15.1:0/2876460908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe740c8170 0x7fbe7415f2d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbe6c009e60 tx=0x7fbe6c009780).stop 2023-11-15T01:21:33.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.597+0000 7fbe78946700 1 -- 172.21.15.1:0/2876460908 shutdown_connections 2023-11-15T01:21:33.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.597+0000 7fbe78946700 1 --2- 172.21.15.1:0/2876460908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe740c8170 0x7fbe7415f2d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.597+0000 7fbe78946700 1 -- 172.21.15.1:0/2876460908 >> 172.21.15.1:0/2876460908 conn(0x7fbe74069ee0 msgr2=0x7fbe7406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:33.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.597+0000 7fbe78946700 1 -- 172.21.15.1:0/2876460908 shutdown_connections 2023-11-15T01:21:33.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.597+0000 7fbe78946700 1 -- 172.21.15.1:0/2876460908 wait complete. 2023-11-15T01:21:33.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.598+0000 7fbe78946700 1 Processor -- start 2023-11-15T01:21:33.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.598+0000 7fbe78946700 1 -- start start 2023-11-15T01:21:33.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.599+0000 7fbe78946700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe740c8170 0x7fbe740c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.599+0000 7fbe78946700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe741541d0 0x7fbe74165060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.599+0000 7fbe78946700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe741545b0 0x7fbe740acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.599+0000 7fbe78946700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740c4e20 con 0x7fbe740c8170 2023-11-15T01:21:33.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.599+0000 7fbe78946700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe74165550 con 0x7fbe741541d0 2023-11-15T01:21:33.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.599+0000 7fbe78946700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740c42a0 con 0x7fbe741545b0 2023-11-15T01:21:33.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.599+0000 7fbe737fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe740c8170 0x7fbe740c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.599+0000 7fbe737fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe740c8170 0x7fbe740c3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43926/0 (socket says 172.21.15.1:43926) 2023-11-15T01:21:33.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.599+0000 7fbe737fe700 1 -- 172.21.15.1:0/1893051031 learned_addr learned my addr 172.21.15.1:0/1893051031 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:33.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.599+0000 7fbe73fff700 1 --2- 172.21.15.1:0/1893051031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe741545b0 0x7fbe740acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.599+0000 7fbe72ffd700 1 --2- 172.21.15.1:0/1893051031 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe741541d0 0x7fbe74165060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.600+0000 7fbe737fe700 1 -- 172.21.15.1:0/1893051031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe741545b0 msgr2=0x7fbe740acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.600+0000 7fbe737fe700 1 --2- 172.21.15.1:0/1893051031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe741545b0 0x7fbe740acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.600+0000 7fbe737fe700 1 -- 172.21.15.1:0/1893051031 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe741541d0 msgr2=0x7fbe74165060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.600+0000 7fbe737fe700 1 --2- 172.21.15.1:0/1893051031 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe741541d0 0x7fbe74165060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.600+0000 7fbe737fe700 1 -- 172.21.15.1:0/1893051031 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c009a20 con 0x7fbe740c8170 2023-11-15T01:21:33.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.600+0000 7fbe737fe700 1 --2- 172.21.15.1:0/1893051031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe740c8170 0x7fbe740c3c30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fbe6400c4c0 tx=0x7fbe64007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:33.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.600+0000 7fbe5b7fe700 1 -- 172.21.15.1:0/1893051031 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6400ce30 con 0x7fbe740c8170 2023-11-15T01:21:33.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.600+0000 7fbe5b7fe700 1 -- 172.21.15.1:0/1893051031 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640072e0 con 0x7fbe740c8170 2023-11-15T01:21:33.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.600+0000 7fbe5b7fe700 1 -- 172.21.15.1:0/1893051031 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640057a0 con 0x7fbe740c8170 2023-11-15T01:21:33.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.600+0000 7fbe78946700 1 -- 172.21.15.1:0/1893051031 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe740c4580 con 0x7fbe740c8170 2023-11-15T01:21:33.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.600+0000 7fbe78946700 1 -- 172.21.15.1:0/1893051031 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe740c4b40 con 0x7fbe740c8170 2023-11-15T01:21:33.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.601+0000 7fbe78946700 1 -- 172.21.15.1:0/1893051031 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe740475e0 con 0x7fbe740c8170 2023-11-15T01:21:33.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.601+0000 7fbe5b7fe700 1 -- 172.21.15.1:0/1893051031 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbe64005bd0 con 0x7fbe740c8170 2023-11-15T01:21:33.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.602+0000 7fbe5b7fe700 1 --2- 172.21.15.1:0/1893051031 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbe6005f120 0x7fbe600615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.602+0000 7fbe5b7fe700 1 -- 172.21.15.1:0/1893051031 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fbe64079480 con 0x7fbe740c8170 2023-11-15T01:21:33.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.602+0000 7fbe72ffd700 1 --2- 172.21.15.1:0/1893051031 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbe6005f120 0x7fbe600615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.602+0000 7fbe72ffd700 1 --2- 172.21.15.1:0/1893051031 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbe6005f120 0x7fbe600615e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbe74167b50 tx=0x7fbe68007d40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:33.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.606+0000 7fbe5b7fe700 1 -- 172.21.15.1:0/1893051031 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbe6404aaa0 con 0x7fbe740c8170 2023-11-15T01:21:33.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.777+0000 7fbe78946700 1 -- 172.21.15.1:0/1893051031 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbe740c9290 con 0x7fbe740c8170 2023-11-15T01:21:33.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.777+0000 7fbe5b7fe700 1 -- 172.21.15.1:0/1893051031 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbe6404e0c0 con 0x7fbe740c8170 2023-11-15T01:21:33.778 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:21:33.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.779+0000 7fbe78946700 1 -- 172.21.15.1:0/1893051031 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbe6005f120 msgr2=0x7fbe600615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.779+0000 7fbe78946700 1 --2- 172.21.15.1:0/1893051031 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbe6005f120 0x7fbe600615e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbe74167b50 tx=0x7fbe68007d40).stop 2023-11-15T01:21:33.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.779+0000 7fbe78946700 1 -- 172.21.15.1:0/1893051031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe740c8170 msgr2=0x7fbe740c3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.779+0000 7fbe78946700 1 --2- 172.21.15.1:0/1893051031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe740c8170 0x7fbe740c3c30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fbe6400c4c0 tx=0x7fbe64007c10).stop 2023-11-15T01:21:33.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.779+0000 7fbe78946700 1 -- 172.21.15.1:0/1893051031 shutdown_connections 2023-11-15T01:21:33.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.779+0000 7fbe78946700 1 --2- 172.21.15.1:0/1893051031 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbe6005f120 0x7fbe600615e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.779+0000 7fbe78946700 1 --2- 172.21.15.1:0/1893051031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe741545b0 0x7fbe740acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.779+0000 7fbe78946700 1 --2- 172.21.15.1:0/1893051031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe740c8170 0x7fbe740c3c30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.779+0000 7fbe78946700 1 --2- 172.21.15.1:0/1893051031 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe741541d0 0x7fbe74165060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.779+0000 7fbe78946700 1 -- 172.21.15.1:0/1893051031 >> 172.21.15.1:0/1893051031 conn(0x7fbe74069ee0 msgr2=0x7fbe740aa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:33.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.779+0000 7fbe78946700 1 -- 172.21.15.1:0/1893051031 shutdown_connections 2023-11-15T01:21:33.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.779+0000 7fbe78946700 1 -- 172.21.15.1:0/1893051031 wait complete. 2023-11-15T01:21:33.791 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:21:33.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.911+0000 7f3047a4c700 1 Processor -- start 2023-11-15T01:21:33.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.911+0000 7f3047a4c700 1 -- start start 2023-11-15T01:21:33.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.912+0000 7f3047a4c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f30400c3e30 0x7f30400c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.912+0000 7f3047a4c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3040154bf0 0x7f304013a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.912+0000 7f3047a4c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304006a020 con 0x7f3040069ba0 2023-11-15T01:21:33.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.912+0000 7f3047a4c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3040155bc0 con 0x7f3040154bf0 2023-11-15T01:21:33.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.912+0000 7f3047a4c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3040155320 con 0x7f30400c3e30 2023-11-15T01:21:33.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.912+0000 7f3045fe9700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3040154bf0 0x7f304013a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.913+0000 7f3045fe9700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3040154bf0 0x7f304013a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43940/0 (socket says 172.21.15.1:43940) 2023-11-15T01:21:33.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.913+0000 7f3045fe9700 1 -- 172.21.15.1:0/3439402603 learned_addr learned my addr 172.21.15.1:0/3439402603 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:33.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.913+0000 7f30457e8700 1 --2- 172.21.15.1:0/3439402603 >> v2:172.21.15.141:3300/0 conn(0x7f30400c3e30 0x7f30400c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.913+0000 7f3045fe9700 1 -- 172.21.15.1:0/3439402603 >> v2:172.21.15.141:3300/0 conn(0x7f30400c3e30 msgr2=0x7f30400c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:33.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.913+0000 7f3045fe9700 1 --2- 172.21.15.1:0/3439402603 >> v2:172.21.15.141:3300/0 conn(0x7f30400c3e30 0x7f30400c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.913+0000 7f3045fe9700 1 -- 172.21.15.1:0/3439402603 >> v1:172.21.15.141:6789/0 conn(0x7f3040069ba0 legacy=0x7f3040066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.913+0000 7f3045fe9700 1 -- 172.21.15.1:0/3439402603 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3040155600 con 0x7f3040154bf0 2023-11-15T01:21:33.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.913+0000 7f3045fe9700 1 --2- 172.21.15.1:0/3439402603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3040154bf0 0x7f304013a550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f30400690d0 tx=0x7f30300090f0).ready entity=mon.0 client_cookie=cf1a104033dcd76c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:33.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.913+0000 7f303ffff700 1 -- 172.21.15.1:0/3439402603 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303000b520 con 0x7f3040154bf0 2023-11-15T01:21:33.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.913+0000 7f303ffff700 1 -- 172.21.15.1:0/3439402603 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303000b680 con 0x7f3040154bf0 2023-11-15T01:21:33.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.913+0000 7f303ffff700 1 -- 172.21.15.1:0/3439402603 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303000ba00 con 0x7f3040154bf0 2023-11-15T01:21:33.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.914+0000 7f3047a4c700 1 -- 172.21.15.1:0/3439402603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3040154bf0 msgr2=0x7f304013a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.914+0000 7f3047a4c700 1 --2- 172.21.15.1:0/3439402603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3040154bf0 0x7f304013a550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f30400690d0 tx=0x7f30300090f0).stop 2023-11-15T01:21:33.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.914+0000 7f3047a4c700 1 -- 172.21.15.1:0/3439402603 shutdown_connections 2023-11-15T01:21:33.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.914+0000 7f3047a4c700 1 --2- 172.21.15.1:0/3439402603 >> v2:172.21.15.141:3300/0 conn(0x7f30400c3e30 0x7f30400c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.914+0000 7f3047a4c700 1 --2- 172.21.15.1:0/3439402603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3040154bf0 0x7f304013a550 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.914+0000 7f3047a4c700 1 -- 172.21.15.1:0/3439402603 >> 172.21.15.1:0/3439402603 conn(0x7f30400c7dc0 msgr2=0x7f30400c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.914+0000 7f3047a4c700 1 -- 172.21.15.1:0/3439402603 shutdown_connections 2023-11-15T01:21:33.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.914+0000 7f3047a4c700 1 -- 172.21.15.1:0/3439402603 wait complete. 2023-11-15T01:21:33.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.915+0000 7f3047a4c700 1 Processor -- start 2023-11-15T01:21:33.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.915+0000 7f3047a4c700 1 -- start start 2023-11-15T01:21:33.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f3047a4c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3040069ba0 0x7f3040153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f3047a4c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30400c3e30 0x7f30401641e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f3047a4c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3040154bf0 0x7f30401646d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f3047a4c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3040162490 con 0x7f3040069ba0 2023-11-15T01:21:33.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f3047a4c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30401618a0 con 0x7f30400c3e30 2023-11-15T01:21:33.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f3047a4c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3040161b60 con 0x7f3040154bf0 2023-11-15T01:21:33.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f30457e8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3040069ba0 0x7f3040153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f30457e8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3040069ba0 0x7f3040153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43954/0 (socket says 172.21.15.1:43954) 2023-11-15T01:21:33.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f30457e8700 1 -- 172.21.15.1:0/4146763200 learned_addr learned my addr 172.21.15.1:0/4146763200 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:33.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f3044fe7700 1 --2- 172.21.15.1:0/4146763200 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30400c3e30 0x7f30401641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f3045fe9700 1 --2- 172.21.15.1:0/4146763200 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3040154bf0 0x7f30401646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f30457e8700 1 -- 172.21.15.1:0/4146763200 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3040154bf0 msgr2=0x7f30401646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f30457e8700 1 --2- 172.21.15.1:0/4146763200 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3040154bf0 0x7f30401646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f30457e8700 1 -- 172.21.15.1:0/4146763200 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30400c3e30 msgr2=0x7f30401641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:33.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f30457e8700 1 --2- 172.21.15.1:0/4146763200 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30400c3e30 0x7f30401641e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:33.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f30457e8700 1 -- 172.21.15.1:0/4146763200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3030009370 con 0x7f3040069ba0 2023-11-15T01:21:33.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f3044fe7700 1 --2- 172.21.15.1:0/4146763200 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30400c3e30 0x7f30401641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:33.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f30457e8700 1 --2- 172.21.15.1:0/4146763200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3040069ba0 0x7f3040153a20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3038009f10 tx=0x7f303800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:33.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.916+0000 7f303d7fa700 1 -- 172.21.15.1:0/4146763200 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038009bf0 con 0x7f3040069ba0 2023-11-15T01:21:33.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.917+0000 7f303d7fa700 1 -- 172.21.15.1:0/4146763200 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303800f040 con 0x7f3040069ba0 2023-11-15T01:21:33.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.917+0000 7f303d7fa700 1 -- 172.21.15.1:0/4146763200 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303800ce90 con 0x7f3040069ba0 2023-11-15T01:21:33.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.917+0000 7f3047a4c700 1 -- 172.21.15.1:0/4146763200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3040161e40 con 0x7f3040069ba0 2023-11-15T01:21:33.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.917+0000 7f3047a4c700 1 -- 172.21.15.1:0/4146763200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3040164bc0 con 0x7f3040069ba0 2023-11-15T01:21:33.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.917+0000 7f3047a4c700 1 -- 172.21.15.1:0/4146763200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304006c7e0 con 0x7f3040069ba0 2023-11-15T01:21:33.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.918+0000 7f303d7fa700 1 -- 172.21.15.1:0/4146763200 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3038013610 con 0x7f3040069ba0 2023-11-15T01:21:33.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.918+0000 7f303d7fa700 1 --2- 172.21.15.1:0/4146763200 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f302c05f150 0x7f302c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:33.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.918+0000 7f303d7fa700 1 -- 172.21.15.1:0/4146763200 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f303807a770 con 0x7f3040069ba0 2023-11-15T01:21:33.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.918+0000 7f3044fe7700 1 --2- 172.21.15.1:0/4146763200 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f302c05f150 0x7f302c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:33.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.919+0000 7f3044fe7700 1 --2- 172.21.15.1:0/4146763200 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f302c05f150 0x7f302c061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f30400adfd0 tx=0x7f3034009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:33.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:33.922+0000 7f303d7fa700 1 -- 172.21.15.1:0/4146763200 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f303804bd90 con 0x7f3040069ba0 2023-11-15T01:21:34.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.094+0000 7f3047a4c700 1 -- 172.21.15.1:0/4146763200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f30401558e0 con 0x7f3040069ba0 2023-11-15T01:21:34.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.094+0000 7f303d7fa700 1 -- 172.21.15.1:0/4146763200 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f303804f3b0 con 0x7f3040069ba0 2023-11-15T01:21:34.095 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:21:34.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.096+0000 7f3047a4c700 1 -- 172.21.15.1:0/4146763200 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f302c05f150 msgr2=0x7f302c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:34.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.096+0000 7f3047a4c700 1 --2- 172.21.15.1:0/4146763200 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f302c05f150 0x7f302c061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f30400adfd0 tx=0x7f3034009040).stop 2023-11-15T01:21:34.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.096+0000 7f3047a4c700 1 -- 172.21.15.1:0/4146763200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3040069ba0 msgr2=0x7f3040153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:34.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.096+0000 7f3047a4c700 1 --2- 172.21.15.1:0/4146763200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3040069ba0 0x7f3040153a20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3038009f10 tx=0x7f303800b040).stop 2023-11-15T01:21:34.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.096+0000 7f3047a4c700 1 -- 172.21.15.1:0/4146763200 shutdown_connections 2023-11-15T01:21:34.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.096+0000 7f3047a4c700 1 --2- 172.21.15.1:0/4146763200 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f302c05f150 0x7f302c061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.096+0000 7f3047a4c700 1 --2- 172.21.15.1:0/4146763200 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3040154bf0 0x7f30401646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.096+0000 7f3047a4c700 1 --2- 172.21.15.1:0/4146763200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3040069ba0 0x7f3040153a20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.096+0000 7f3047a4c700 1 --2- 172.21.15.1:0/4146763200 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30400c3e30 0x7f30401641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.096+0000 7f3047a4c700 1 -- 172.21.15.1:0/4146763200 >> 172.21.15.1:0/4146763200 conn(0x7f30400c7dc0 msgr2=0x7f30400c5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:34.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.096+0000 7f3047a4c700 1 -- 172.21.15.1:0/4146763200 shutdown_connections 2023-11-15T01:21:34.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.096+0000 7f3047a4c700 1 -- 172.21.15.1:0/4146763200 wait complete. 2023-11-15T01:21:34.109 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-15T01:21:34.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.226+0000 7ff34926d700 1 Processor -- start 2023-11-15T01:21:34.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.226+0000 7ff34926d700 1 -- start start 2023-11-15T01:21:34.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.226+0000 7ff34926d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff344154150 0x7ff344154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:34.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.226+0000 7ff34926d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff3440aa060 0x7ff3440c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:34.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.226+0000 7ff34926d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3440c06f0 con 0x7ff3440ab1a0 2023-11-15T01:21:34.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.226+0000 7ff34926d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3440c09d0 con 0x7ff3440aa060 2023-11-15T01:21:34.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.226+0000 7ff34926d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff344158820 con 0x7ff344154150 2023-11-15T01:21:34.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.227+0000 7ff3427fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff3440ab1a0 0x7ff344158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:35344/0 (socket says 172.21.15.1:35344) 2023-11-15T01:21:34.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.227+0000 7ff3427fc700 1 -- 172.21.15.1:0/3269880543 learned_addr learned my addr 172.21.15.1:0/3269880543 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:34.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.227+0000 7ff3437fe700 1 --2- 172.21.15.1:0/3269880543 >> v2:172.21.15.141:3300/0 conn(0x7ff3440aa060 0x7ff3440c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:34.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.227+0000 7ff342ffd700 1 --2- 172.21.15.1:0/3269880543 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff344154150 0x7ff344154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:34.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.227+0000 7ff341ffb700 1 -- 172.21.15.1:0/3269880543 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251475338 0 0) 0x7ff3440c06f0 con 0x7ff3440ab1a0 2023-11-15T01:21:34.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.227+0000 7ff341ffb700 1 -- 172.21.15.1:0/3269880543 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3300033f0 con 0x7ff3440ab1a0 2023-11-15T01:21:34.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.227+0000 7ff341ffb700 1 -- 172.21.15.1:0/3269880543 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 154565665 0 0) 0x7ff3300033f0 con 0x7ff3440ab1a0 2023-11-15T01:21:34.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.227+0000 7ff3437fe700 1 -- 172.21.15.1:0/3269880543 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff344154150 msgr2=0x7ff344154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:34.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.227+0000 7ff3437fe700 1 --2- 172.21.15.1:0/3269880543 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff344154150 0x7ff344154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.227+0000 7ff3437fe700 1 -- 172.21.15.1:0/3269880543 >> v1:172.21.15.1:6789/0 conn(0x7ff3440ab1a0 legacy=0x7ff344158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:34.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.227+0000 7ff3437fe700 1 -- 172.21.15.1:0/3269880543 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff344158b00 con 0x7ff3440aa060 2023-11-15T01:21:34.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.227+0000 7ff342ffd700 1 --2- 172.21.15.1:0/3269880543 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff344154150 0x7ff344154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:34.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.227+0000 7ff3437fe700 1 --2- 172.21.15.1:0/3269880543 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff3440aa060 0x7ff3440c5f10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff33c009760 tx=0x7ff33c009060).ready entity=mon.1 client_cookie=4b234a46c736df8c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:34.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.227+0000 7ff341ffb700 1 -- 172.21.15.1:0/3269880543 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c001470 con 0x7ff3440aa060 2023-11-15T01:21:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.228+0000 7ff341ffb700 1 -- 172.21.15.1:0/3269880543 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c0090d0 con 0x7ff3440aa060 2023-11-15T01:21:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.228+0000 7ff341ffb700 1 -- 172.21.15.1:0/3269880543 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c011610 con 0x7ff3440aa060 2023-11-15T01:21:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.228+0000 7ff34926d700 1 -- 172.21.15.1:0/3269880543 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff3440aa060 msgr2=0x7ff3440c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.228+0000 7ff34926d700 1 --2- 172.21.15.1:0/3269880543 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff3440aa060 0x7ff3440c5f10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff33c009760 tx=0x7ff33c009060).stop 2023-11-15T01:21:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.228+0000 7ff34926d700 1 -- 172.21.15.1:0/3269880543 shutdown_connections 2023-11-15T01:21:34.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.228+0000 7ff34926d700 1 --2- 172.21.15.1:0/3269880543 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff3440aa060 0x7ff3440c5f10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.228+0000 7ff34926d700 1 --2- 172.21.15.1:0/3269880543 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff344154150 0x7ff344154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.228+0000 7ff34926d700 1 -- 172.21.15.1:0/3269880543 >> 172.21.15.1:0/3269880543 conn(0x7ff344064aa0 msgr2=0x7ff344064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:34.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.228+0000 7ff34926d700 1 -- 172.21.15.1:0/3269880543 shutdown_connections 2023-11-15T01:21:34.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.228+0000 7ff34926d700 1 -- 172.21.15.1:0/3269880543 wait complete. 2023-11-15T01:21:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.229+0000 7ff34926d700 1 Processor -- start 2023-11-15T01:21:34.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.229+0000 7ff34926d700 1 -- start start 2023-11-15T01:21:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff34926d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3440aa060 0x7ff3440c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff34926d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3440ab1a0 0x7ff3440cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff34926d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff344154150 0x7ff34414e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff34926d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440c9730 con 0x7ff3440aa060 2023-11-15T01:21:34.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff34926d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440cb480 con 0x7ff344154150 2023-11-15T01:21:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff34926d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440c9450 con 0x7ff3440ab1a0 2023-11-15T01:21:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff342ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3440aa060 0x7ff3440c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff342ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3440aa060 0x7ff3440c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43970/0 (socket says 172.21.15.1:43970) 2023-11-15T01:21:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff342ffd700 1 -- 172.21.15.1:0/2599236719 learned_addr learned my addr 172.21.15.1:0/2599236719 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff3427fc700 1 --2- 172.21.15.1:0/2599236719 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3440ab1a0 0x7ff3440cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff3437fe700 1 --2- 172.21.15.1:0/2599236719 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff344154150 0x7ff34414e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff342ffd700 1 -- 172.21.15.1:0/2599236719 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3440ab1a0 msgr2=0x7ff3440cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff342ffd700 1 --2- 172.21.15.1:0/2599236719 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3440ab1a0 0x7ff3440cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff342ffd700 1 -- 172.21.15.1:0/2599236719 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff344154150 msgr2=0x7ff34414e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff342ffd700 1 --2- 172.21.15.1:0/2599236719 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff344154150 0x7ff34414e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.230+0000 7ff342ffd700 1 -- 172.21.15.1:0/2599236719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff334009a20 con 0x7ff3440aa060 2023-11-15T01:21:34.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.231+0000 7ff342ffd700 1 --2- 172.21.15.1:0/2599236719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3440aa060 0x7ff3440c8eb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7ff33400c0f0 tx=0x7ff33400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:34.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.231+0000 7ff33affd700 1 -- 172.21.15.1:0/2599236719 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33400cc30 con 0x7ff3440aa060 2023-11-15T01:21:34.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.231+0000 7ff33affd700 1 -- 172.21.15.1:0/2599236719 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33400f040 con 0x7ff3440aa060 2023-11-15T01:21:34.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.231+0000 7ff33affd700 1 -- 172.21.15.1:0/2599236719 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334013400 con 0x7ff3440aa060 2023-11-15T01:21:34.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.231+0000 7ff34926d700 1 -- 172.21.15.1:0/2599236719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33c0092a0 con 0x7ff3440aa060 2023-11-15T01:21:34.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.231+0000 7ff34926d700 1 -- 172.21.15.1:0/2599236719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3440cb110 con 0x7ff3440aa060 2023-11-15T01:21:34.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.232+0000 7ff34926d700 1 -- 172.21.15.1:0/2599236719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34406c7e0 con 0x7ff3440aa060 2023-11-15T01:21:34.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.232+0000 7ff33affd700 1 -- 172.21.15.1:0/2599236719 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff3340137b0 con 0x7ff3440aa060 2023-11-15T01:21:34.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.233+0000 7ff33affd700 1 --2- 172.21.15.1:0/2599236719 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff32405f150 0x7ff324061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:34.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.233+0000 7ff33affd700 1 -- 172.21.15.1:0/2599236719 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff33407a770 con 0x7ff3440aa060 2023-11-15T01:21:34.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.233+0000 7ff3427fc700 1 --2- 172.21.15.1:0/2599236719 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff32405f150 0x7ff324061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:34.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.233+0000 7ff3427fc700 1 --2- 172.21.15.1:0/2599236719 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff32405f150 0x7ff324061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff3440a9f20 tx=0x7ff32c001a10).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:34.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.237+0000 7ff33affd700 1 -- 172.21.15.1:0/2599236719 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff33404bd90 con 0x7ff3440aa060 2023-11-15T01:21:34.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.409+0000 7ff34926d700 1 -- 172.21.15.1:0/2599236719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff3440c02a0 con 0x7ff3440aa060 2023-11-15T01:21:34.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.410+0000 7ff33affd700 1 -- 172.21.15.1:0/2599236719 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff33404f3b0 con 0x7ff3440aa060 2023-11-15T01:21:34.411 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:34.411 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T01:21:34.411 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:21:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2023-11-15T01:21:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "device_health_metrics" 2023-11-15T01:21:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:21:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:21:34.412 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 2, 2023-11-15T01:21:34.413 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "rbd" 2023-11-15T01:21:34.413 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:21:34.413 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T01:21:34.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.411+0000 7ff34926d700 1 -- 172.21.15.1:0/2599236719 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff32405f150 msgr2=0x7ff324061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:34.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.411+0000 7ff34926d700 1 --2- 172.21.15.1:0/2599236719 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff32405f150 0x7ff324061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff3440a9f20 tx=0x7ff32c001a10).stop 2023-11-15T01:21:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.411+0000 7ff34926d700 1 -- 172.21.15.1:0/2599236719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3440aa060 msgr2=0x7ff3440c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.411+0000 7ff34926d700 1 --2- 172.21.15.1:0/2599236719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3440aa060 0x7ff3440c8eb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7ff33400c0f0 tx=0x7ff33400b040).stop 2023-11-15T01:21:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.411+0000 7ff34926d700 1 -- 172.21.15.1:0/2599236719 shutdown_connections 2023-11-15T01:21:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.411+0000 7ff34926d700 1 --2- 172.21.15.1:0/2599236719 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff32405f150 0x7ff324061610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.411+0000 7ff34926d700 1 --2- 172.21.15.1:0/2599236719 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff344154150 0x7ff34414e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.411+0000 7ff34926d700 1 --2- 172.21.15.1:0/2599236719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3440aa060 0x7ff3440c8eb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.411+0000 7ff34926d700 1 --2- 172.21.15.1:0/2599236719 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3440ab1a0 0x7ff3440cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.411+0000 7ff34926d700 1 -- 172.21.15.1:0/2599236719 >> 172.21.15.1:0/2599236719 conn(0x7ff344064aa0 msgr2=0x7ff3440acdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:34.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.412+0000 7ff34926d700 1 -- 172.21.15.1:0/2599236719 shutdown_connections 2023-11-15T01:21:34.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.412+0000 7ff34926d700 1 -- 172.21.15.1:0/2599236719 wait complete. 2023-11-15T01:21:34.424 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-15T01:21:34.424 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-15T01:21:34.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.546+0000 7f7b3b0a7700 1 Processor -- start 2023-11-15T01:21:34.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.546+0000 7f7b3b0a7700 1 -- start start 2023-11-15T01:21:34.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b3b0a7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7b3414e790 0x7f7b34155360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:34.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b3b0a7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b34062ec0 0x7f7b340c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:34.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b3b0a7700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b340c5ef0 con 0x7f7b3414eb70 2023-11-15T01:21:34.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b3b0a7700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b340c2780 con 0x7f7b3414e790 2023-11-15T01:21:34.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b3b0a7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b34155850 con 0x7f7b34062ec0 2023-11-15T01:21:34.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b3a8a6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b34062ec0 0x7f7b340c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:34.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b3a0a5700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7b3414e790 0x7f7b34155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:34.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b398a4700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f7b3414eb70 0x7f7b340627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:50288/0 (socket says 172.21.15.1:50288) 2023-11-15T01:21:34.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b398a4700 1 -- 172.21.15.1:0/3407695866 learned_addr learned my addr 172.21.15.1:0/3407695866 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:34.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b3a8a6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b34062ec0 0x7f7b340c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:55280/0 (socket says 172.21.15.1:55280) 2023-11-15T01:21:34.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b3a0a5700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7b3414e790 0x7f7b34155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:38252/0 (socket says 172.21.15.1:38252) 2023-11-15T01:21:34.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b390a3700 1 -- 172.21.15.1:0/3407695866 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968523003 0 0) 0x7f7b340c5ef0 con 0x7f7b3414eb70 2023-11-15T01:21:34.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b390a3700 1 -- 172.21.15.1:0/3407695866 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b200033f0 con 0x7f7b3414eb70 2023-11-15T01:21:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b3a8a6700 1 -- 172.21.15.1:0/3407695866 >> v2:172.21.15.141:3300/0 conn(0x7f7b3414e790 msgr2=0x7f7b34155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b3a8a6700 1 --2- 172.21.15.1:0/3407695866 >> v2:172.21.15.141:3300/0 conn(0x7f7b3414e790 0x7f7b34155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b3a8a6700 1 -- 172.21.15.1:0/3407695866 >> v1:172.21.15.141:6789/0 conn(0x7f7b3414eb70 legacy=0x7f7b340627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b3a8a6700 1 -- 172.21.15.1:0/3407695866 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b34158440 con 0x7f7b34062ec0 2023-11-15T01:21:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.547+0000 7f7b3a0a5700 1 --2- 172.21.15.1:0/3407695866 >> v2:172.21.15.141:3300/0 conn(0x7f7b3414e790 0x7f7b34155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.548+0000 7f7b3a8a6700 1 --2- 172.21.15.1:0/3407695866 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b34062ec0 0x7f7b340c6380 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7b2c009e60 tx=0x7f7b2c009780).ready entity=mon.2 client_cookie=e0381a5105b2c68b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.548+0000 7f7b390a3700 1 -- 172.21.15.1:0/3407695866 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c00e070 con 0x7f7b34062ec0 2023-11-15T01:21:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.548+0000 7f7b390a3700 1 -- 172.21.15.1:0/3407695866 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c00bab0 con 0x7f7b34062ec0 2023-11-15T01:21:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.548+0000 7f7b390a3700 1 -- 172.21.15.1:0/3407695866 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c00be30 con 0x7f7b34062ec0 2023-11-15T01:21:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.548+0000 7f7b3b0a7700 1 -- 172.21.15.1:0/3407695866 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b34062ec0 msgr2=0x7f7b340c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.548+0000 7f7b3b0a7700 1 --2- 172.21.15.1:0/3407695866 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b34062ec0 0x7f7b340c6380 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7b2c009e60 tx=0x7f7b2c009780).stop 2023-11-15T01:21:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.548+0000 7f7b3b0a7700 1 -- 172.21.15.1:0/3407695866 shutdown_connections 2023-11-15T01:21:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.548+0000 7f7b3b0a7700 1 --2- 172.21.15.1:0/3407695866 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b34062ec0 0x7f7b340c6380 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.548+0000 7f7b3b0a7700 1 --2- 172.21.15.1:0/3407695866 >> v2:172.21.15.141:3300/0 conn(0x7f7b3414e790 0x7f7b34155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.548+0000 7f7b3b0a7700 1 -- 172.21.15.1:0/3407695866 >> 172.21.15.1:0/3407695866 conn(0x7f7b340c7e00 msgr2=0x7f7b340c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:34.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.548+0000 7f7b3b0a7700 1 -- 172.21.15.1:0/3407695866 shutdown_connections 2023-11-15T01:21:34.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.548+0000 7f7b3b0a7700 1 -- 172.21.15.1:0/3407695866 wait complete. 2023-11-15T01:21:34.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.549+0000 7f7b3b0a7700 1 Processor -- start 2023-11-15T01:21:34.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.549+0000 7f7b3b0a7700 1 -- start start 2023-11-15T01:21:34.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.550+0000 7f7b3b0a7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b34062ec0 0x7f7b340beea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:34.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.550+0000 7f7b3b0a7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b3414e790 0x7f7b340a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:34.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.550+0000 7f7b3b0a7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b3414eb70 0x7f7b340a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:34.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.550+0000 7f7b3b0a7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b341363e0 con 0x7f7b3414e790 2023-11-15T01:21:34.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.550+0000 7f7b3b0a7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b34136960 con 0x7f7b34062ec0 2023-11-15T01:21:34.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.550+0000 7f7b3b0a7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b341384c0 con 0x7f7b3414eb70 2023-11-15T01:21:34.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.550+0000 7f7b398a4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b3414e790 0x7f7b340a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:34.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.550+0000 7f7b398a4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b3414e790 0x7f7b340a4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43980/0 (socket says 172.21.15.1:43980) 2023-11-15T01:21:34.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.550+0000 7f7b398a4700 1 -- 172.21.15.1:0/939594842 learned_addr learned my addr 172.21.15.1:0/939594842 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:34.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.550+0000 7f7b3a0a5700 1 --2- 172.21.15.1:0/939594842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b34062ec0 0x7f7b340beea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:34.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.550+0000 7f7b3a8a6700 1 --2- 172.21.15.1:0/939594842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b3414eb70 0x7f7b340a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:34.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.551+0000 7f7b398a4700 1 -- 172.21.15.1:0/939594842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b3414eb70 msgr2=0x7f7b340a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:34.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.551+0000 7f7b398a4700 1 --2- 172.21.15.1:0/939594842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b3414eb70 0x7f7b340a4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.551+0000 7f7b398a4700 1 -- 172.21.15.1:0/939594842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b34062ec0 msgr2=0x7f7b340beea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:34.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.551+0000 7f7b398a4700 1 --2- 172.21.15.1:0/939594842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b34062ec0 0x7f7b340beea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:34.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.551+0000 7f7b398a4700 1 -- 172.21.15.1:0/939594842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b300092a0 con 0x7f7b3414e790 2023-11-15T01:21:34.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.551+0000 7f7b398a4700 1 --2- 172.21.15.1:0/939594842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b3414e790 0x7f7b340a4870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f7b2400c410 tx=0x7f7b24007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:34.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.551+0000 7f7b2a7fc700 1 -- 172.21.15.1:0/939594842 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b240070d0 con 0x7f7b3414e790 2023-11-15T01:21:34.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.551+0000 7f7b2a7fc700 1 -- 172.21.15.1:0/939594842 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b24007230 con 0x7f7b3414e790 2023-11-15T01:21:34.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.551+0000 7f7b3b0a7700 1 -- 172.21.15.1:0/939594842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2c009a20 con 0x7f7b3414e790 2023-11-15T01:21:34.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.551+0000 7f7b2a7fc700 1 -- 172.21.15.1:0/939594842 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b240075d0 con 0x7f7b3414e790 2023-11-15T01:21:34.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.551+0000 7f7b3b0a7700 1 -- 172.21.15.1:0/939594842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b340c1b20 con 0x7f7b3414e790 2023-11-15T01:21:34.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.552+0000 7f7b3b0a7700 1 -- 172.21.15.1:0/939594842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b340475e0 con 0x7f7b3414e790 2023-11-15T01:21:34.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.552+0000 7f7b2a7fc700 1 -- 172.21.15.1:0/939594842 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7b240059b0 con 0x7f7b3414e790 2023-11-15T01:21:34.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.553+0000 7f7b2a7fc700 1 --2- 172.21.15.1:0/939594842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7b1805f150 0x7f7b18061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:34.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.553+0000 7f7b2a7fc700 1 -- 172.21.15.1:0/939594842 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7b24079370 con 0x7f7b3414e790 2023-11-15T01:21:34.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.553+0000 7f7b3a0a5700 1 --2- 172.21.15.1:0/939594842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7b1805f150 0x7f7b18061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:34.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.553+0000 7f7b3a0a5700 1 --2- 172.21.15.1:0/939594842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7b1805f150 0x7f7b18061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7b30009dc0 tx=0x7f7b30009060).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:34.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.557+0000 7f7b2a7fc700 1 -- 172.21.15.1:0/939594842 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7b2404a990 con 0x7f7b3414e790 2023-11-15T01:21:34.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:34.728+0000 7f7b3b0a7700 1 -- 172.21.15.1:0/939594842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f7b34136aa0 con 0x7f7b3414e790 2023-11-15T01:21:35.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.651+0000 7f7b2a7fc700 1 -- 172.21.15.1:0/939594842 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 152+0+0 (secure 0 0 0) 0x7f7b24077e60 con 0x7f7b3414e790 2023-11-15T01:21:35.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.659+0000 7f7b3b0a7700 1 -- 172.21.15.1:0/939594842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7b1805f150 msgr2=0x7f7b18061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:35.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.659+0000 7f7b3b0a7700 1 --2- 172.21.15.1:0/939594842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7b1805f150 0x7f7b18061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7b30009dc0 tx=0x7f7b30009060).stop 2023-11-15T01:21:35.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.659+0000 7f7b3b0a7700 1 -- 172.21.15.1:0/939594842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b3414e790 msgr2=0x7f7b340a4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:35.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.659+0000 7f7b3b0a7700 1 --2- 172.21.15.1:0/939594842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b3414e790 0x7f7b340a4870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f7b2400c410 tx=0x7f7b24007c30).stop 2023-11-15T01:21:35.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.659+0000 7f7b3b0a7700 1 -- 172.21.15.1:0/939594842 shutdown_connections 2023-11-15T01:21:35.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.659+0000 7f7b3b0a7700 1 --2- 172.21.15.1:0/939594842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7b1805f150 0x7f7b18061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:35.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.659+0000 7f7b3b0a7700 1 --2- 172.21.15.1:0/939594842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b3414eb70 0x7f7b340a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:35.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.659+0000 7f7b3b0a7700 1 --2- 172.21.15.1:0/939594842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b34062ec0 0x7f7b340beea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:35.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.659+0000 7f7b3b0a7700 1 --2- 172.21.15.1:0/939594842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b3414e790 0x7f7b340a4870 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:35.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.659+0000 7f7b3b0a7700 1 -- 172.21.15.1:0/939594842 >> 172.21.15.1:0/939594842 conn(0x7f7b340c7e00 msgr2=0x7f7b34135ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:35.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.659+0000 7f7b3b0a7700 1 -- 172.21.15.1:0/939594842 shutdown_connections 2023-11-15T01:21:35.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.659+0000 7f7b3b0a7700 1 -- 172.21.15.1:0/939594842 wait complete. 2023-11-15T01:21:35.663 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2023-11-15T01:21:35.677 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-15T01:21:35.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.806+0000 7f19e3e41700 1 Processor -- start 2023-11-15T01:21:35.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.807+0000 7f19e3e41700 1 -- start start 2023-11-15T01:21:35.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.807+0000 7f19e3e41700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f19dc1540a0 0x7f19dc0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:35.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.807+0000 7f19e3e41700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f19dc154480 0x7f19dc0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:35.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.808+0000 7f19e3e41700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19dc0ca050 con 0x7f19dc0c5f40 2023-11-15T01:21:35.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.808+0000 7f19e3e41700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc0c9440 con 0x7f19dc154480 2023-11-15T01:21:35.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.808+0000 7f19e3e41700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc0c9720 con 0x7f19dc1540a0 2023-11-15T01:21:35.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.808+0000 7f19e13dc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f19dc154480 0x7f19dc0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:35.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.808+0000 7f19e13dc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f19dc154480 0x7f19dc0ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43986/0 (socket says 172.21.15.1:43986) 2023-11-15T01:21:35.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.808+0000 7f19e13dc700 1 -- 172.21.15.1:0/2050208542 learned_addr learned my addr 172.21.15.1:0/2050208542 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:35.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.808+0000 7f19e1bdd700 1 --2- 172.21.15.1:0/2050208542 >> v2:172.21.15.141:3300/0 conn(0x7f19dc1540a0 0x7f19dc0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:35.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.808+0000 7f19e13dc700 1 -- 172.21.15.1:0/2050208542 >> v2:172.21.15.141:3300/0 conn(0x7f19dc1540a0 msgr2=0x7f19dc0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:35.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.808+0000 7f19e13dc700 1 --2- 172.21.15.1:0/2050208542 >> v2:172.21.15.141:3300/0 conn(0x7f19dc1540a0 0x7f19dc0ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:35.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.808+0000 7f19e13dc700 1 -- 172.21.15.1:0/2050208542 >> v1:172.21.15.141:6789/0 conn(0x7f19dc0c5f40 legacy=0x7f19dc0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:35.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.808+0000 7f19e13dc700 1 -- 172.21.15.1:0/2050208542 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc0c9a00 con 0x7f19dc154480 2023-11-15T01:21:35.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.808+0000 7f19e13dc700 1 --2- 172.21.15.1:0/2050208542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19dc154480 0x7f19dc0ca9d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f19dc05ff40 tx=0x7f19d00090f0).ready entity=mon.0 client_cookie=6228e9ef4f8dee8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:35.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.808+0000 7f19e0bdb700 1 -- 172.21.15.1:0/2050208542 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d000b5a0 con 0x7f19dc154480 2023-11-15T01:21:35.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.808+0000 7f19e0bdb700 1 -- 172.21.15.1:0/2050208542 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d000b700 con 0x7f19dc154480 2023-11-15T01:21:35.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.808+0000 7f19e0bdb700 1 -- 172.21.15.1:0/2050208542 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d000ba80 con 0x7f19dc154480 2023-11-15T01:21:35.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.809+0000 7f19e3e41700 1 -- 172.21.15.1:0/2050208542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19dc154480 msgr2=0x7f19dc0ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:35.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.809+0000 7f19e3e41700 1 --2- 172.21.15.1:0/2050208542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19dc154480 0x7f19dc0ca9d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f19dc05ff40 tx=0x7f19d00090f0).stop 2023-11-15T01:21:35.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.809+0000 7f19e3e41700 1 -- 172.21.15.1:0/2050208542 shutdown_connections 2023-11-15T01:21:35.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.809+0000 7f19e3e41700 1 --2- 172.21.15.1:0/2050208542 >> v2:172.21.15.141:3300/0 conn(0x7f19dc1540a0 0x7f19dc0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:35.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.809+0000 7f19e3e41700 1 --2- 172.21.15.1:0/2050208542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19dc154480 0x7f19dc0ca9d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:35.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.809+0000 7f19e3e41700 1 -- 172.21.15.1:0/2050208542 >> 172.21.15.1:0/2050208542 conn(0x7f19dc064a70 msgr2=0x7f19dc064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:35.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.809+0000 7f19e3e41700 1 -- 172.21.15.1:0/2050208542 shutdown_connections 2023-11-15T01:21:35.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.809+0000 7f19e3e41700 1 -- 172.21.15.1:0/2050208542 wait complete. 2023-11-15T01:21:35.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.810+0000 7f19e3e41700 1 Processor -- start 2023-11-15T01:21:35.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.810+0000 7f19e3e41700 1 -- start start 2023-11-15T01:21:35.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e3e41700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19dc0c5f40 0x7f19dc0c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:35.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e3e41700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19dc1540a0 0x7f19dc157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:35.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e3e41700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19dc154480 0x7f19dc157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:35.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e3e41700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0af000 con 0x7f19dc0c5f40 2023-11-15T01:21:35.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e3e41700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0ae3f0 con 0x7f19dc1540a0 2023-11-15T01:21:35.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e3e41700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0ae6d0 con 0x7f19dc154480 2023-11-15T01:21:35.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e1bdd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19dc0c5f40 0x7f19dc0c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:35.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e1bdd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19dc0c5f40 0x7f19dc0c36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43990/0 (socket says 172.21.15.1:43990) 2023-11-15T01:21:35.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e1bdd700 1 -- 172.21.15.1:0/835083584 learned_addr learned my addr 172.21.15.1:0/835083584 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:35.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e23de700 1 --2- 172.21.15.1:0/835083584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19dc154480 0x7f19dc157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:35.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e13dc700 1 --2- 172.21.15.1:0/835083584 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19dc1540a0 0x7f19dc157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:35.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e1bdd700 1 -- 172.21.15.1:0/835083584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19dc154480 msgr2=0x7f19dc157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:35.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e1bdd700 1 --2- 172.21.15.1:0/835083584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19dc154480 0x7f19dc157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:35.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e1bdd700 1 -- 172.21.15.1:0/835083584 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19dc1540a0 msgr2=0x7f19dc157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:35.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e1bdd700 1 --2- 172.21.15.1:0/835083584 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19dc1540a0 0x7f19dc157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:35.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e1bdd700 1 -- 172.21.15.1:0/835083584 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d0009370 con 0x7f19dc0c5f40 2023-11-15T01:21:35.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.811+0000 7f19e1bdd700 1 --2- 172.21.15.1:0/835083584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19dc0c5f40 0x7f19dc0c36f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f19d400d890 tx=0x7f19d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:35.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.812+0000 7f19d9ffb700 1 -- 172.21.15.1:0/835083584 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d4011590 con 0x7f19dc0c5f40 2023-11-15T01:21:35.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.812+0000 7f19d9ffb700 1 -- 172.21.15.1:0/835083584 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d40116f0 con 0x7f19dc0c5f40 2023-11-15T01:21:35.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.812+0000 7f19d9ffb700 1 -- 172.21.15.1:0/835083584 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d4011a70 con 0x7f19dc0c5f40 2023-11-15T01:21:35.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.812+0000 7f19e3e41700 1 -- 172.21.15.1:0/835083584 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc0ae9b0 con 0x7f19dc0c5f40 2023-11-15T01:21:35.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.812+0000 7f19e3e41700 1 -- 172.21.15.1:0/835083584 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc0ae080 con 0x7f19dc0c5f40 2023-11-15T01:21:35.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.813+0000 7f19e3e41700 1 -- 172.21.15.1:0/835083584 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc06c7e0 con 0x7f19dc0c5f40 2023-11-15T01:21:35.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.813+0000 7f19d9ffb700 1 -- 172.21.15.1:0/835083584 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f19d401c460 con 0x7f19dc0c5f40 2023-11-15T01:21:35.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.813+0000 7f19d9ffb700 1 --2- 172.21.15.1:0/835083584 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f19c805f150 0x7f19c8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:35.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.814+0000 7f19d9ffb700 1 -- 172.21.15.1:0/835083584 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f19d4079d40 con 0x7f19dc0c5f40 2023-11-15T01:21:35.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.814+0000 7f19e13dc700 1 --2- 172.21.15.1:0/835083584 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f19c805f150 0x7f19c8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:35.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.814+0000 7f19e13dc700 1 --2- 172.21.15.1:0/835083584 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f19c805f150 0x7f19c8061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f19d0009130 tx=0x7f19d0015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:35.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.818+0000 7f19d9ffb700 1 -- 172.21.15.1:0/835083584 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f19d404b190 con 0x7f19dc0c5f40 2023-11-15T01:21:35.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:35.990+0000 7f19e3e41700 1 -- 172.21.15.1:0/835083584 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f19dc0c9ce0 con 0x7f19dc0c5f40 2023-11-15T01:21:36.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.656+0000 7f19d9ffb700 1 -- 172.21.15.1:0/835083584 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f19d404e7b0 con 0x7f19dc0c5f40 2023-11-15T01:21:36.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.661+0000 7f19e3e41700 1 -- 172.21.15.1:0/835083584 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f19c805f150 msgr2=0x7f19c8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:36.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.661+0000 7f19e3e41700 1 --2- 172.21.15.1:0/835083584 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f19c805f150 0x7f19c8061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f19d0009130 tx=0x7f19d0015000).stop 2023-11-15T01:21:36.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.661+0000 7f19e3e41700 1 -- 172.21.15.1:0/835083584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19dc0c5f40 msgr2=0x7f19dc0c36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:36.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.661+0000 7f19e3e41700 1 --2- 172.21.15.1:0/835083584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19dc0c5f40 0x7f19dc0c36f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f19d400d890 tx=0x7f19d4008040).stop 2023-11-15T01:21:36.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.662+0000 7f19e3e41700 1 -- 172.21.15.1:0/835083584 shutdown_connections 2023-11-15T01:21:36.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.662+0000 7f19e3e41700 1 --2- 172.21.15.1:0/835083584 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f19c805f150 0x7f19c8061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:36.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.662+0000 7f19e3e41700 1 --2- 172.21.15.1:0/835083584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19dc154480 0x7f19dc157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:36.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.662+0000 7f19e3e41700 1 --2- 172.21.15.1:0/835083584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19dc0c5f40 0x7f19dc0c36f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:36.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.662+0000 7f19e3e41700 1 --2- 172.21.15.1:0/835083584 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19dc1540a0 0x7f19dc157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:36.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.662+0000 7f19e3e41700 1 -- 172.21.15.1:0/835083584 >> 172.21.15.1:0/835083584 conn(0x7f19dc064a70 msgr2=0x7f19dc063730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:36.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.663+0000 7f19e3e41700 1 -- 172.21.15.1:0/835083584 shutdown_connections 2023-11-15T01:21:36.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.664+0000 7f19e3e41700 1 -- 172.21.15.1:0/835083584 wait complete. 2023-11-15T01:21:36.674 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2023-11-15T01:21:36.691 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-15T01:21:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.815+0000 7f9d5880f700 1 Processor -- start 2023-11-15T01:21:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.815+0000 7f9d5880f700 1 -- start start 2023-11-15T01:21:36.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.816+0000 7f9d5880f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9d541541d0 0x7f9d541545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:36.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.816+0000 7f9d5880f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d540c8170 0x7f9d540c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.816+0000 7f9d5880f700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d54155830 con 0x7f9d540c60d0 2023-11-15T01:21:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.816+0000 7f9d5880f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d54158f40 con 0x7f9d541541d0 2023-11-15T01:21:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.816+0000 7f9d5880f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d54154c20 con 0x7f9d540c8170 2023-11-15T01:21:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.816+0000 7f9d537fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9d541541d0 0x7f9d541545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.816+0000 7f9d537fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9d541541d0 0x7f9d541545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43996/0 (socket says 172.21.15.1:43996) 2023-11-15T01:21:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.816+0000 7f9d537fe700 1 -- 172.21.15.1:0/197338756 learned_addr learned my addr 172.21.15.1:0/197338756 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.816+0000 7f9d53fff700 1 --2- 172.21.15.1:0/197338756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d540c8170 0x7f9d540c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.816+0000 7f9d537fe700 1 -- 172.21.15.1:0/197338756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d540c8170 msgr2=0x7f9d540c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.816+0000 7f9d537fe700 1 --2- 172.21.15.1:0/197338756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d540c8170 0x7f9d540c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.816+0000 7f9d537fe700 1 -- 172.21.15.1:0/197338756 >> v1:172.21.15.141:6789/0 conn(0x7f9d540c60d0 legacy=0x7f9d540c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:36.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.816+0000 7f9d537fe700 1 -- 172.21.15.1:0/197338756 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d54154f00 con 0x7f9d541541d0 2023-11-15T01:21:36.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.817+0000 7f9d537fe700 1 --2- 172.21.15.1:0/197338756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d541541d0 0x7f9d541545b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9d44006fd0 tx=0x7f9d440090f0).ready entity=mon.0 client_cookie=9719c4285cd5d3be server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:36.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.817+0000 7f9d527fc700 1 -- 172.21.15.1:0/197338756 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400b600 con 0x7f9d541541d0 2023-11-15T01:21:36.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.817+0000 7f9d527fc700 1 -- 172.21.15.1:0/197338756 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4400b760 con 0x7f9d541541d0 2023-11-15T01:21:36.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.817+0000 7f9d527fc700 1 -- 172.21.15.1:0/197338756 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400bae0 con 0x7f9d541541d0 2023-11-15T01:21:36.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.817+0000 7f9d5880f700 1 -- 172.21.15.1:0/197338756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d541541d0 msgr2=0x7f9d541545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:36.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.817+0000 7f9d5880f700 1 --2- 172.21.15.1:0/197338756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d541541d0 0x7f9d541545b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9d44006fd0 tx=0x7f9d440090f0).stop 2023-11-15T01:21:36.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.817+0000 7f9d5880f700 1 -- 172.21.15.1:0/197338756 shutdown_connections 2023-11-15T01:21:36.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.817+0000 7f9d5880f700 1 --2- 172.21.15.1:0/197338756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d540c8170 0x7f9d540c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:36.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.817+0000 7f9d5880f700 1 --2- 172.21.15.1:0/197338756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d541541d0 0x7f9d541545b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:36.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.817+0000 7f9d5880f700 1 -- 172.21.15.1:0/197338756 >> 172.21.15.1:0/197338756 conn(0x7f9d54069ee0 msgr2=0x7f9d5406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:36.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.817+0000 7f9d5880f700 1 -- 172.21.15.1:0/197338756 shutdown_connections 2023-11-15T01:21:36.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.817+0000 7f9d5880f700 1 -- 172.21.15.1:0/197338756 wait complete. 2023-11-15T01:21:36.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.818+0000 7f9d5880f700 1 Processor -- start 2023-11-15T01:21:36.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.819+0000 7f9d5880f700 1 -- start start 2023-11-15T01:21:36.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.819+0000 7f9d5880f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d540c60d0 0x7f9d541520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:36.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.819+0000 7f9d5880f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d540c8170 0x7f9d540b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:36.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.819+0000 7f9d5880f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d541541d0 0x7f9d540b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:36.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.819+0000 7f9d5880f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d541584c0 con 0x7f9d540c60d0 2023-11-15T01:21:36.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.819+0000 7f9d5880f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540b10b0 con 0x7f9d541541d0 2023-11-15T01:21:36.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.819+0000 7f9d5880f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540ae0b0 con 0x7f9d540c8170 2023-11-15T01:21:36.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.819+0000 7f9d537fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d540c60d0 0x7f9d541520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:36.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.819+0000 7f9d537fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d540c60d0 0x7f9d541520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44004/0 (socket says 172.21.15.1:44004) 2023-11-15T01:21:36.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.819+0000 7f9d537fe700 1 -- 172.21.15.1:0/3871783448 learned_addr learned my addr 172.21.15.1:0/3871783448 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:36.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.820+0000 7f9d52ffd700 1 --2- 172.21.15.1:0/3871783448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d540c8170 0x7f9d540b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:36.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.820+0000 7f9d53fff700 1 --2- 172.21.15.1:0/3871783448 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d541541d0 0x7f9d540b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:36.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.820+0000 7f9d537fe700 1 -- 172.21.15.1:0/3871783448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d540c8170 msgr2=0x7f9d540b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:36.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.820+0000 7f9d537fe700 1 --2- 172.21.15.1:0/3871783448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d540c8170 0x7f9d540b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:36.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.820+0000 7f9d537fe700 1 -- 172.21.15.1:0/3871783448 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d541541d0 msgr2=0x7f9d540b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:36.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.820+0000 7f9d537fe700 1 --2- 172.21.15.1:0/3871783448 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d541541d0 0x7f9d540b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:36.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.820+0000 7f9d537fe700 1 -- 172.21.15.1:0/3871783448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d44009370 con 0x7f9d540c60d0 2023-11-15T01:21:36.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.820+0000 7f9d53fff700 1 --2- 172.21.15.1:0/3871783448 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d541541d0 0x7f9d540b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:36.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.820+0000 7f9d537fe700 1 --2- 172.21.15.1:0/3871783448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d540c60d0 0x7f9d541520c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9d5405fe80 tx=0x7f9d44017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:36.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.820+0000 7f9d3b7fe700 1 -- 172.21.15.1:0/3871783448 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400b8d0 con 0x7f9d540c60d0 2023-11-15T01:21:36.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.820+0000 7f9d3b7fe700 1 -- 172.21.15.1:0/3871783448 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4400ba30 con 0x7f9d540c60d0 2023-11-15T01:21:36.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.820+0000 7f9d5880f700 1 -- 172.21.15.1:0/3871783448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d540ae670 con 0x7f9d540c60d0 2023-11-15T01:21:36.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.820+0000 7f9d3b7fe700 1 -- 172.21.15.1:0/3871783448 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4401b660 con 0x7f9d540c60d0 2023-11-15T01:21:36.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.820+0000 7f9d5880f700 1 -- 172.21.15.1:0/3871783448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d54158260 con 0x7f9d540c60d0 2023-11-15T01:21:36.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.821+0000 7f9d5880f700 1 -- 172.21.15.1:0/3871783448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d540475e0 con 0x7f9d540c60d0 2023-11-15T01:21:36.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.821+0000 7f9d3b7fe700 1 -- 172.21.15.1:0/3871783448 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9d4401ba10 con 0x7f9d540c60d0 2023-11-15T01:21:36.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.822+0000 7f9d3b7fe700 1 --2- 172.21.15.1:0/3871783448 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d4005f150 0x7f9d40061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:36.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.822+0000 7f9d3b7fe700 1 -- 172.21.15.1:0/3871783448 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f9d4407ba90 con 0x7f9d540c60d0 2023-11-15T01:21:36.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.822+0000 7f9d52ffd700 1 --2- 172.21.15.1:0/3871783448 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d4005f150 0x7f9d40061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:36.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.823+0000 7f9d52ffd700 1 --2- 172.21.15.1:0/3871783448 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d4005f150 0x7f9d40061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9d541549d0 tx=0x7f9d48009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:36.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:36.826+0000 7f9d3b7fe700 1 -- 172.21.15.1:0/3871783448 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9d4404cdc0 con 0x7f9d540c60d0 2023-11-15T01:21:37.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.044+0000 7f9d5880f700 1 -- 172.21.15.1:0/3871783448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9d541551e0 con 0x7f9d540c60d0 2023-11-15T01:21:37.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.055+0000 7f9d3b7fe700 1 -- 172.21.15.1:0/3871783448 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9d440503e0 con 0x7f9d540c60d0 2023-11-15T01:21:37.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.060+0000 7f9d5880f700 1 -- 172.21.15.1:0/3871783448 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d4005f150 msgr2=0x7f9d40061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.060+0000 7f9d5880f700 1 --2- 172.21.15.1:0/3871783448 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d4005f150 0x7f9d40061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9d541549d0 tx=0x7f9d48009040).stop 2023-11-15T01:21:37.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.060+0000 7f9d5880f700 1 -- 172.21.15.1:0/3871783448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d540c60d0 msgr2=0x7f9d541520c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.060+0000 7f9d5880f700 1 --2- 172.21.15.1:0/3871783448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d540c60d0 0x7f9d541520c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9d5405fe80 tx=0x7f9d44017000).stop 2023-11-15T01:21:37.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.061+0000 7f9d5880f700 1 -- 172.21.15.1:0/3871783448 shutdown_connections 2023-11-15T01:21:37.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.061+0000 7f9d5880f700 1 --2- 172.21.15.1:0/3871783448 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d4005f150 0x7f9d40061610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.061+0000 7f9d5880f700 1 --2- 172.21.15.1:0/3871783448 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d541541d0 0x7f9d540b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.061+0000 7f9d5880f700 1 --2- 172.21.15.1:0/3871783448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d540c60d0 0x7f9d541520c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.061+0000 7f9d5880f700 1 --2- 172.21.15.1:0/3871783448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d540c8170 0x7f9d540b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.061+0000 7f9d5880f700 1 -- 172.21.15.1:0/3871783448 >> 172.21.15.1:0/3871783448 conn(0x7f9d54069ee0 msgr2=0x7f9d540abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:37.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.062+0000 7f9d5880f700 1 -- 172.21.15.1:0/3871783448 shutdown_connections 2023-11-15T01:21:37.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.062+0000 7f9d5880f700 1 -- 172.21.15.1:0/3871783448 wait complete. 2023-11-15T01:21:37.064 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 3 and data pool 4 2023-11-15T01:21:37.082 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:21:37.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.198+0000 7fb72cb70700 1 Processor -- start 2023-11-15T01:21:37.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.198+0000 7fb72cb70700 1 -- start start 2023-11-15T01:21:37.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.199+0000 7fb72cb70700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb728154680 0x7fb728069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.199+0000 7fb72cb70700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb7280bccd0 0x7fb7280bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.199+0000 7fb72cb70700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb7280627b0 0x7fb728062c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.199+0000 7fb72cb70700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7280c3360 con 0x7fb7280bccd0 2023-11-15T01:21:37.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.199+0000 7fb72cb70700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7280bd620 con 0x7fb7280627b0 2023-11-15T01:21:37.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.199+0000 7fb72cb70700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7280c2750 con 0x7fb728154680 2023-11-15T01:21:37.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb725d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb7280bccd0 0x7fb7280bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb725d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb7280bccd0 0x7fb7280bd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44012/0 (socket says 172.21.15.1:44012) 2023-11-15T01:21:37.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb725d9b700 1 -- 172.21.15.1:0/118433280 learned_addr learned my addr 172.21.15.1:0/118433280 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:37.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb72659c700 1 --2- 172.21.15.1:0/118433280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb728154680 0x7fb728069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb726d9d700 1 --2- 172.21.15.1:0/118433280 >> v2:172.21.15.141:3300/0 conn(0x7fb7280627b0 0x7fb728062c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb725d9b700 1 -- 172.21.15.1:0/118433280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb728154680 msgr2=0x7fb728069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:37.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb725d9b700 1 --2- 172.21.15.1:0/118433280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb728154680 0x7fb728069fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb725d9b700 1 -- 172.21.15.1:0/118433280 >> v2:172.21.15.141:3300/0 conn(0x7fb7280627b0 msgr2=0x7fb728062c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:37.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb725d9b700 1 --2- 172.21.15.1:0/118433280 >> v2:172.21.15.141:3300/0 conn(0x7fb7280627b0 0x7fb728062c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb725d9b700 1 -- 172.21.15.1:0/118433280 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7280c2a30 con 0x7fb7280bccd0 2023-11-15T01:21:37.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb726d9d700 1 --2- 172.21.15.1:0/118433280 >> v2:172.21.15.141:3300/0 conn(0x7fb7280627b0 0x7fb728062c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:37.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb72659c700 1 --2- 172.21.15.1:0/118433280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb728154680 0x7fb728069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:37.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb725d9b700 1 --2- 172.21.15.1:0/118433280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7280bccd0 0x7fb7280bd130 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fb7280c7aa0 tx=0x7fb7100090f0).ready entity=mon.0 client_cookie=80db19d85d915027 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:37.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb72559a700 1 -- 172.21.15.1:0/118433280 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71000b600 con 0x7fb7280bccd0 2023-11-15T01:21:37.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb72559a700 1 -- 172.21.15.1:0/118433280 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71000b760 con 0x7fb7280bccd0 2023-11-15T01:21:37.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.200+0000 7fb72559a700 1 -- 172.21.15.1:0/118433280 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71000bae0 con 0x7fb7280bccd0 2023-11-15T01:21:37.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.201+0000 7fb72cb70700 1 -- 172.21.15.1:0/118433280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7280bccd0 msgr2=0x7fb7280bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.201+0000 7fb72cb70700 1 --2- 172.21.15.1:0/118433280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7280bccd0 0x7fb7280bd130 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fb7280c7aa0 tx=0x7fb7100090f0).stop 2023-11-15T01:21:37.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.201+0000 7fb72cb70700 1 -- 172.21.15.1:0/118433280 shutdown_connections 2023-11-15T01:21:37.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.201+0000 7fb72cb70700 1 --2- 172.21.15.1:0/118433280 >> v2:172.21.15.141:3300/0 conn(0x7fb7280627b0 0x7fb728062c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.201+0000 7fb72cb70700 1 --2- 172.21.15.1:0/118433280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb728154680 0x7fb728069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.201+0000 7fb72cb70700 1 --2- 172.21.15.1:0/118433280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7280bccd0 0x7fb7280bd130 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.201+0000 7fb72cb70700 1 -- 172.21.15.1:0/118433280 >> 172.21.15.1:0/118433280 conn(0x7fb7280c7d70 msgr2=0x7fb7280c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:37.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.201+0000 7fb72cb70700 1 -- 172.21.15.1:0/118433280 shutdown_connections 2023-11-15T01:21:37.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.201+0000 7fb72cb70700 1 -- 172.21.15.1:0/118433280 wait complete. 2023-11-15T01:21:37.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.202+0000 7fb72cb70700 1 Processor -- start 2023-11-15T01:21:37.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.202+0000 7fb72cb70700 1 -- start start 2023-11-15T01:21:37.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb72cb70700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7280627b0 0x7fb728159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb72cb70700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7280bccd0 0x7fb72813fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb72cb70700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb728154680 0x7fb7280c0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb72cb70700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72813fff0 con 0x7fb7280bccd0 2023-11-15T01:21:37.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb72cb70700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7281589c0 con 0x7fb728154680 2023-11-15T01:21:37.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb72cb70700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb728159820 con 0x7fb7280627b0 2023-11-15T01:21:37.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb725d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7280bccd0 0x7fb72813fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb725d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7280bccd0 0x7fb72813fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44014/0 (socket says 172.21.15.1:44014) 2023-11-15T01:21:37.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb725d9b700 1 -- 172.21.15.1:0/4016106663 learned_addr learned my addr 172.21.15.1:0/4016106663 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:37.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb72659c700 1 --2- 172.21.15.1:0/4016106663 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7280627b0 0x7fb728159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb726d9d700 1 --2- 172.21.15.1:0/4016106663 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb728154680 0x7fb7280c0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb725d9b700 1 -- 172.21.15.1:0/4016106663 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7280627b0 msgr2=0x7fb728159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb725d9b700 1 --2- 172.21.15.1:0/4016106663 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7280627b0 0x7fb728159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb725d9b700 1 -- 172.21.15.1:0/4016106663 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb728154680 msgr2=0x7fb7280c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb725d9b700 1 --2- 172.21.15.1:0/4016106663 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb728154680 0x7fb7280c0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb725d9b700 1 -- 172.21.15.1:0/4016106663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710009370 con 0x7fb7280bccd0 2023-11-15T01:21:37.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb725d9b700 1 --2- 172.21.15.1:0/4016106663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7280bccd0 0x7fb72813fb00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb710009130 tx=0x7fb710017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:37.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb71e7fc700 1 -- 172.21.15.1:0/4016106663 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71000b8d0 con 0x7fb7280bccd0 2023-11-15T01:21:37.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb71e7fc700 1 -- 172.21.15.1:0/4016106663 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71000ba30 con 0x7fb7280bccd0 2023-11-15T01:21:37.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.203+0000 7fb72cb70700 1 -- 172.21.15.1:0/4016106663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7280c0a50 con 0x7fb7280bccd0 2023-11-15T01:21:37.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.204+0000 7fb71e7fc700 1 -- 172.21.15.1:0/4016106663 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71001c670 con 0x7fb7280bccd0 2023-11-15T01:21:37.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.204+0000 7fb72cb70700 1 -- 172.21.15.1:0/4016106663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb728158ef0 con 0x7fb7280bccd0 2023-11-15T01:21:37.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.205+0000 7fb72cb70700 1 -- 172.21.15.1:0/4016106663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72806c7e0 con 0x7fb7280bccd0 2023-11-15T01:21:37.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.205+0000 7fb71e7fc700 1 -- 172.21.15.1:0/4016106663 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb71001ca20 con 0x7fb7280bccd0 2023-11-15T01:21:37.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.205+0000 7fb71e7fc700 1 --2- 172.21.15.1:0/4016106663 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb70805f150 0x7fb708061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.205+0000 7fb71e7fc700 1 -- 172.21.15.1:0/4016106663 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb71007bee0 con 0x7fb7280bccd0 2023-11-15T01:21:37.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.205+0000 7fb72659c700 1 --2- 172.21.15.1:0/4016106663 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb70805f150 0x7fb708061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.206+0000 7fb72659c700 1 --2- 172.21.15.1:0/4016106663 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb70805f150 0x7fb708061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb72000f600 tx=0x7fb7200077b0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:37.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.209+0000 7fb71e7fc700 1 -- 172.21.15.1:0/4016106663 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb71004d1b0 con 0x7fb7280bccd0 2023-11-15T01:21:37.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.380+0000 7fb72cb70700 1 -- 172.21.15.1:0/4016106663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb728159960 con 0x7fb7280bccd0 2023-11-15T01:21:37.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.381+0000 7fb71e7fc700 1 -- 172.21.15.1:0/4016106663 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16893 (secure 0 0 0) 0x7fb71002a070 con 0x7fb7280bccd0 2023-11-15T01:21:37.382 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:37.382 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:37.045326+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:21:34.763591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-15T01:21:36.025071+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:21:37.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.383+0000 7fb72cb70700 1 -- 172.21.15.1:0/4016106663 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb70805f150 msgr2=0x7fb708061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.383+0000 7fb72cb70700 1 --2- 172.21.15.1:0/4016106663 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb70805f150 0x7fb708061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb72000f600 tx=0x7fb7200077b0).stop 2023-11-15T01:21:37.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.383+0000 7fb72cb70700 1 -- 172.21.15.1:0/4016106663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7280bccd0 msgr2=0x7fb72813fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.383+0000 7fb72cb70700 1 --2- 172.21.15.1:0/4016106663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7280bccd0 0x7fb72813fb00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb710009130 tx=0x7fb710017000).stop 2023-11-15T01:21:37.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.383+0000 7fb72cb70700 1 -- 172.21.15.1:0/4016106663 shutdown_connections 2023-11-15T01:21:37.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.383+0000 7fb72cb70700 1 --2- 172.21.15.1:0/4016106663 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb70805f150 0x7fb708061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.383+0000 7fb72cb70700 1 --2- 172.21.15.1:0/4016106663 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb728154680 0x7fb7280c0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.383+0000 7fb72cb70700 1 --2- 172.21.15.1:0/4016106663 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7280627b0 0x7fb728159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.383+0000 7fb72cb70700 1 --2- 172.21.15.1:0/4016106663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7280bccd0 0x7fb72813fb00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.383+0000 7fb72cb70700 1 -- 172.21.15.1:0/4016106663 >> 172.21.15.1:0/4016106663 conn(0x7fb7280c7d70 msgr2=0x7fb728062c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:37.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.383+0000 7fb72cb70700 1 -- 172.21.15.1:0/4016106663 shutdown_connections 2023-11-15T01:21:37.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.383+0000 7fb72cb70700 1 -- 172.21.15.1:0/4016106663 wait complete. 2023-11-15T01:21:37.396 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:21:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.513+0000 7f78cf147700 1 Processor -- start 2023-11-15T01:21:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.513+0000 7f78cf147700 1 -- start start 2023-11-15T01:21:37.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.514+0000 7f78cf147700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f78c80ab1a0 0x7f78c8154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.514+0000 7f78cf147700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c80c06f0 con 0x7f78c8154150 2023-11-15T01:21:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.514+0000 7f78cf147700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c80c09d0 con 0x7f78c80aa060 2023-11-15T01:21:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.514+0000 7f78cf147700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c8158820 con 0x7f78c80ab1a0 2023-11-15T01:21:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.514+0000 7f78ccee3700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f78c8154150 0x7f78c8158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:35346/0 (socket says 172.21.15.1:35346) 2023-11-15T01:21:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.514+0000 7f78ccee3700 1 -- 172.21.15.1:0/1782988192 learned_addr learned my addr 172.21.15.1:0/1782988192 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.514+0000 7f78c7fff700 1 --2- 172.21.15.1:0/1782988192 >> v2:172.21.15.141:3300/0 conn(0x7f78c80ab1a0 0x7f78c8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.515+0000 7f78c77fe700 1 -- 172.21.15.1:0/1782988192 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6532627 0 0) 0x7f78c80c06f0 con 0x7f78c8154150 2023-11-15T01:21:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.515+0000 7f78c77fe700 1 -- 172.21.15.1:0/1782988192 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78b40033f0 con 0x7f78c8154150 2023-11-15T01:21:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.515+0000 7f78c7fff700 1 -- 172.21.15.1:0/1782988192 >> v1:172.21.15.141:6789/0 conn(0x7f78c80aa060 legacy=0x7f78c80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.515+0000 7f78c7fff700 1 -- 172.21.15.1:0/1782988192 >> v1:172.21.15.1:6789/0 conn(0x7f78c8154150 legacy=0x7f78c8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.515+0000 7f78c77fe700 1 -- 172.21.15.1:0/1782988192 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846532832 0 0) 0x7f78c80c09d0 con 0x7f78c80aa060 2023-11-15T01:21:37.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.515+0000 7f78c7fff700 1 -- 172.21.15.1:0/1782988192 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c8158b00 con 0x7f78c80ab1a0 2023-11-15T01:21:37.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.515+0000 7f78c7fff700 1 --2- 172.21.15.1:0/1782988192 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78c80ab1a0 0x7f78c8154530 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f78b8009e60 tx=0x7f78b8009780).ready entity=mon.1 client_cookie=3a54668f8ce1d31c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:37.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.515+0000 7f78c77fe700 1 -- 172.21.15.1:0/1782988192 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800e070 con 0x7f78c80ab1a0 2023-11-15T01:21:37.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.515+0000 7f78c77fe700 1 -- 172.21.15.1:0/1782988192 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b800bb60 con 0x7f78c80ab1a0 2023-11-15T01:21:37.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.515+0000 7f78c77fe700 1 -- 172.21.15.1:0/1782988192 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800bee0 con 0x7f78c80ab1a0 2023-11-15T01:21:37.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.516+0000 7f78cf147700 1 -- 172.21.15.1:0/1782988192 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78c80ab1a0 msgr2=0x7f78c8154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.516+0000 7f78cf147700 1 --2- 172.21.15.1:0/1782988192 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78c80ab1a0 0x7f78c8154530 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f78b8009e60 tx=0x7f78b8009780).stop 2023-11-15T01:21:37.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.516+0000 7f78cf147700 1 -- 172.21.15.1:0/1782988192 shutdown_connections 2023-11-15T01:21:37.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.516+0000 7f78cf147700 1 --2- 172.21.15.1:0/1782988192 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78c80ab1a0 0x7f78c8154530 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.516+0000 7f78cf147700 1 -- 172.21.15.1:0/1782988192 >> 172.21.15.1:0/1782988192 conn(0x7f78c8064aa0 msgr2=0x7f78c8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:37.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.516+0000 7f78cf147700 1 -- 172.21.15.1:0/1782988192 shutdown_connections 2023-11-15T01:21:37.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.516+0000 7f78cf147700 1 -- 172.21.15.1:0/1782988192 wait complete. 2023-11-15T01:21:37.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.517+0000 7f78cf147700 1 Processor -- start 2023-11-15T01:21:37.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.517+0000 7f78cf147700 1 -- start start 2023-11-15T01:21:37.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78cf147700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78c80aa060 0x7f78c8147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78cf147700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78c80ab1a0 0x7f78c80c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78cf147700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78c8154150 0x7f78c80c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78cf147700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c80c46d0 con 0x7f78c80ab1a0 2023-11-15T01:21:37.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78cf147700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c80c49b0 con 0x7f78c8154150 2023-11-15T01:21:37.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78cf147700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c80c4c90 con 0x7f78c80aa060 2023-11-15T01:21:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78c7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78c80ab1a0 0x7f78c80c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78c7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78c80ab1a0 0x7f78c80c3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44026/0 (socket says 172.21.15.1:44026) 2023-11-15T01:21:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78c7fff700 1 -- 172.21.15.1:0/4191930891 learned_addr learned my addr 172.21.15.1:0/4191930891 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78ccee3700 1 --2- 172.21.15.1:0/4191930891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78c80aa060 0x7f78c8147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78cd6e4700 1 --2- 172.21.15.1:0/4191930891 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78c8154150 0x7f78c80c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78c7fff700 1 -- 172.21.15.1:0/4191930891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78c80aa060 msgr2=0x7f78c8147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78c7fff700 1 --2- 172.21.15.1:0/4191930891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78c80aa060 0x7f78c8147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78c7fff700 1 -- 172.21.15.1:0/4191930891 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78c8154150 msgr2=0x7f78c80c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78c7fff700 1 --2- 172.21.15.1:0/4191930891 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78c8154150 0x7f78c80c4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78c7fff700 1 -- 172.21.15.1:0/4191930891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b8009a20 con 0x7f78c80ab1a0 2023-11-15T01:21:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78cd6e4700 1 --2- 172.21.15.1:0/4191930891 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78c8154150 0x7f78c80c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78c7fff700 1 --2- 172.21.15.1:0/4191930891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78c80ab1a0 0x7f78c80c3b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f78c8062af0 tx=0x7f78b8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78c4ff9700 1 -- 172.21.15.1:0/4191930891 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8007000 con 0x7f78c80ab1a0 2023-11-15T01:21:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78c4ff9700 1 -- 172.21.15.1:0/4191930891 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b801d630 con 0x7f78c80ab1a0 2023-11-15T01:21:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78cf147700 1 -- 172.21.15.1:0/4191930891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c80c4f70 con 0x7f78c80ab1a0 2023-11-15T01:21:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78c4ff9700 1 -- 172.21.15.1:0/4191930891 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b801d9f0 con 0x7f78c80ab1a0 2023-11-15T01:21:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.518+0000 7f78cf147700 1 -- 172.21.15.1:0/4191930891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c81482d0 con 0x7f78c80ab1a0 2023-11-15T01:21:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.519+0000 7f78cf147700 1 -- 172.21.15.1:0/4191930891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c80ae420 con 0x7f78c80ab1a0 2023-11-15T01:21:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.520+0000 7f78c4ff9700 1 -- 172.21.15.1:0/4191930891 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f78b8003040 con 0x7f78c80ab1a0 2023-11-15T01:21:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.520+0000 7f78c4ff9700 1 --2- 172.21.15.1:0/4191930891 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f78a805f180 0x7f78a8061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.520+0000 7f78c4ff9700 1 -- 172.21.15.1:0/4191930891 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f78b807bfa0 con 0x7f78c80ab1a0 2023-11-15T01:21:37.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.520+0000 7f78ccee3700 1 --2- 172.21.15.1:0/4191930891 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f78a805f180 0x7f78a8061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.521+0000 7f78ccee3700 1 --2- 172.21.15.1:0/4191930891 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f78a805f180 0x7f78a8061640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f78c0005750 tx=0x7f78c0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:37.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.524+0000 7f78c4ff9700 1 -- 172.21.15.1:0/4191930891 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f78b80aaaf0 con 0x7f78c80ab1a0 2023-11-15T01:21:37.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.698+0000 7f78cf147700 1 -- 172.21.15.1:0/4191930891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78c806c7e0 con 0x7f78c80ab1a0 2023-11-15T01:21:37.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.699+0000 7f78c4ff9700 1 -- 172.21.15.1:0/4191930891 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16893 (secure 0 0 0) 0x7f78b804d270 con 0x7f78c80ab1a0 2023-11-15T01:21:37.700 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:37.700 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:37.045326+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:21:34.763591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-15T01:21:36.025071+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:21:37.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.701+0000 7f78cf147700 1 -- 172.21.15.1:0/4191930891 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f78a805f180 msgr2=0x7f78a8061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.701+0000 7f78cf147700 1 --2- 172.21.15.1:0/4191930891 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f78a805f180 0x7f78a8061640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f78c0005750 tx=0x7f78c0009040).stop 2023-11-15T01:21:37.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.701+0000 7f78cf147700 1 -- 172.21.15.1:0/4191930891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78c80ab1a0 msgr2=0x7f78c80c3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.701+0000 7f78cf147700 1 --2- 172.21.15.1:0/4191930891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78c80ab1a0 0x7f78c80c3b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f78c8062af0 tx=0x7f78b8009780).stop 2023-11-15T01:21:37.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.702+0000 7f78cf147700 1 -- 172.21.15.1:0/4191930891 shutdown_connections 2023-11-15T01:21:37.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.702+0000 7f78cf147700 1 --2- 172.21.15.1:0/4191930891 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f78a805f180 0x7f78a8061640 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.702+0000 7f78cf147700 1 --2- 172.21.15.1:0/4191930891 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78c8154150 0x7f78c80c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.702+0000 7f78cf147700 1 --2- 172.21.15.1:0/4191930891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78c80aa060 0x7f78c8147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.702+0000 7f78cf147700 1 --2- 172.21.15.1:0/4191930891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78c80ab1a0 0x7f78c80c3b50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.702+0000 7f78cf147700 1 -- 172.21.15.1:0/4191930891 >> 172.21.15.1:0/4191930891 conn(0x7f78c8064aa0 msgr2=0x7f78c80c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:37.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.702+0000 7f78cf147700 1 -- 172.21.15.1:0/4191930891 shutdown_connections 2023-11-15T01:21:37.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.702+0000 7f78cf147700 1 -- 172.21.15.1:0/4191930891 wait complete. 2023-11-15T01:21:37.714 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-15T01:21:37.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.834+0000 7f4f876c0700 1 Processor -- start 2023-11-15T01:21:37.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.834+0000 7f4f876c0700 1 -- start start 2023-11-15T01:21:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.835+0000 7f4f876c0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f80154480 0x7f4f800c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.835+0000 7f4f876c0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4f800c6430 0x7f4f800aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.835+0000 7f4f876c0700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f800ca050 con 0x7f4f801540a0 2023-11-15T01:21:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.835+0000 7f4f876c0700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f800c68c0 con 0x7f4f800c6430 2023-11-15T01:21:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.835+0000 7f4f876c0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f800c9440 con 0x7f4f80154480 2023-11-15T01:21:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.835+0000 7f4f85c5d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4f800c6430 0x7f4f800aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.835+0000 7f4f85c5d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4f800c6430 0x7f4f800aaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54670/0 (socket says 172.21.15.1:54670) 2023-11-15T01:21:37.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.835+0000 7f4f85c5d700 1 -- 172.21.15.1:0/3288567465 learned_addr learned my addr 172.21.15.1:0/3288567465 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:37.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.835+0000 7f4f84c5b700 1 --2- 172.21.15.1:0/3288567465 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f80154480 0x7f4f800c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.836+0000 7f4f85c5d700 1 -- 172.21.15.1:0/3288567465 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f80154480 msgr2=0x7f4f800c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:37.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.836+0000 7f4f85c5d700 1 --2- 172.21.15.1:0/3288567465 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f80154480 0x7f4f800c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.836+0000 7f4f85c5d700 1 -- 172.21.15.1:0/3288567465 >> v1:172.21.15.141:6789/0 conn(0x7f4f801540a0 legacy=0x7f4f800ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.836+0000 7f4f85c5d700 1 -- 172.21.15.1:0/3288567465 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f800c9720 con 0x7f4f800c6430 2023-11-15T01:21:37.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.836+0000 7f4f85c5d700 1 --2- 172.21.15.1:0/3288567465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f800c6430 0x7f4f800aaf40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f4f70009f20 tx=0x7f4f70009840).ready entity=mon.0 client_cookie=c6936e7fd82c8b88 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:37.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.836+0000 7f4f7ffff700 1 -- 172.21.15.1:0/3288567465 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7000e070 con 0x7f4f800c6430 2023-11-15T01:21:37.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.836+0000 7f4f7ffff700 1 -- 172.21.15.1:0/3288567465 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7000b9d0 con 0x7f4f800c6430 2023-11-15T01:21:37.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.836+0000 7f4f7ffff700 1 -- 172.21.15.1:0/3288567465 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7000bd50 con 0x7f4f800c6430 2023-11-15T01:21:37.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.836+0000 7f4f876c0700 1 -- 172.21.15.1:0/3288567465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f800c6430 msgr2=0x7f4f800aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.836+0000 7f4f876c0700 1 --2- 172.21.15.1:0/3288567465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f800c6430 0x7f4f800aaf40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f4f70009f20 tx=0x7f4f70009840).stop 2023-11-15T01:21:37.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.836+0000 7f4f876c0700 1 -- 172.21.15.1:0/3288567465 shutdown_connections 2023-11-15T01:21:37.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.836+0000 7f4f876c0700 1 --2- 172.21.15.1:0/3288567465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f800c6430 0x7f4f800aaf40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.836+0000 7f4f876c0700 1 --2- 172.21.15.1:0/3288567465 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f80154480 0x7f4f800c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.836+0000 7f4f876c0700 1 -- 172.21.15.1:0/3288567465 >> 172.21.15.1:0/3288567465 conn(0x7f4f80064a70 msgr2=0x7f4f80064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:37.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.836+0000 7f4f876c0700 1 -- 172.21.15.1:0/3288567465 shutdown_connections 2023-11-15T01:21:37.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.837+0000 7f4f876c0700 1 -- 172.21.15.1:0/3288567465 wait complete. 2023-11-15T01:21:37.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.838+0000 7f4f876c0700 1 Processor -- start 2023-11-15T01:21:37.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.838+0000 7f4f876c0700 1 -- start start 2023-11-15T01:21:37.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f876c0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f800c6430 0x7f4f80156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f876c0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f801540a0 0x7f4f80150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f876c0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f80154480 0x7f4f80151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f876c0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f80157f00 con 0x7f4f80154480 2023-11-15T01:21:37.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f876c0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f801572f0 con 0x7f4f801540a0 2023-11-15T01:21:37.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f876c0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f801575d0 con 0x7f4f800c6430 2023-11-15T01:21:37.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f85c5d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f80154480 0x7f4f80151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f85c5d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f80154480 0x7f4f80151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54680/0 (socket says 172.21.15.1:54680) 2023-11-15T01:21:37.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f85c5d700 1 -- 172.21.15.1:0/4046213088 learned_addr learned my addr 172.21.15.1:0/4046213088 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:37.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f8545c700 1 --2- 172.21.15.1:0/4046213088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f800c6430 0x7f4f80156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f84c5b700 1 --2- 172.21.15.1:0/4046213088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f801540a0 0x7f4f80150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f85c5d700 1 -- 172.21.15.1:0/4046213088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f800c6430 msgr2=0x7f4f80156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f85c5d700 1 --2- 172.21.15.1:0/4046213088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f800c6430 0x7f4f80156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f85c5d700 1 -- 172.21.15.1:0/4046213088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f801540a0 msgr2=0x7f4f80150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:37.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f85c5d700 1 --2- 172.21.15.1:0/4046213088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f801540a0 0x7f4f80150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:37.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f85c5d700 1 -- 172.21.15.1:0/4046213088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f70009ae0 con 0x7f4f80154480 2023-11-15T01:21:37.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f85c5d700 1 --2- 172.21.15.1:0/4046213088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f80154480 0x7f4f80151ba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f4f7000b610 tx=0x7f4f70009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:37.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f7d7fa700 1 -- 172.21.15.1:0/4046213088 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f700092e0 con 0x7f4f80154480 2023-11-15T01:21:37.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f7d7fa700 1 -- 172.21.15.1:0/4046213088 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7001d410 con 0x7f4f80154480 2023-11-15T01:21:37.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f876c0700 1 -- 172.21.15.1:0/4046213088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f801578b0 con 0x7f4f80154480 2023-11-15T01:21:37.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f7d7fa700 1 -- 172.21.15.1:0/4046213088 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7001d7d0 con 0x7f4f80154480 2023-11-15T01:21:37.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.839+0000 7f4f876c0700 1 -- 172.21.15.1:0/4046213088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f80156fb0 con 0x7f4f80154480 2023-11-15T01:21:37.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.840+0000 7f4f876c0700 1 -- 172.21.15.1:0/4046213088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8006c7e0 con 0x7f4f80154480 2023-11-15T01:21:37.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.841+0000 7f4f7d7fa700 1 -- 172.21.15.1:0/4046213088 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4f7001dc00 con 0x7f4f80154480 2023-11-15T01:21:37.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.841+0000 7f4f7d7fa700 1 --2- 172.21.15.1:0/4046213088 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f6c05f150 0x7f4f6c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:37.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.841+0000 7f4f7d7fa700 1 -- 172.21.15.1:0/4046213088 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4f7007bf30 con 0x7f4f80154480 2023-11-15T01:21:37.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.841+0000 7f4f8545c700 1 --2- 172.21.15.1:0/4046213088 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f6c05f150 0x7f4f6c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:37.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.841+0000 7f4f8545c700 1 --2- 172.21.15.1:0/4046213088 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f6c05f150 0x7f4f6c061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4f78003750 tx=0x7f4f78009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:37.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:37.845+0000 7f4f7d7fa700 1 -- 172.21.15.1:0/4046213088 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4f7004d200 con 0x7f4f80154480 2023-11-15T01:21:38.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:38.061+0000 7f4f876c0700 1 -- 172.21.15.1:0/4046213088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4f800c9a00 con 0x7f4f80154480 2023-11-15T01:21:39.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.054+0000 7f4f7d7fa700 1 -- 172.21.15.1:0/4046213088 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4f70050820 con 0x7f4f80154480 2023-11-15T01:21:39.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.057+0000 7f4f876c0700 1 -- 172.21.15.1:0/4046213088 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f6c05f150 msgr2=0x7f4f6c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:39.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.057+0000 7f4f876c0700 1 --2- 172.21.15.1:0/4046213088 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f6c05f150 0x7f4f6c061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4f78003750 tx=0x7f4f78009040).stop 2023-11-15T01:21:39.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.057+0000 7f4f876c0700 1 -- 172.21.15.1:0/4046213088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f80154480 msgr2=0x7f4f80151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:39.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.057+0000 7f4f876c0700 1 --2- 172.21.15.1:0/4046213088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f80154480 0x7f4f80151ba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f4f7000b610 tx=0x7f4f70009840).stop 2023-11-15T01:21:39.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.057+0000 7f4f876c0700 1 -- 172.21.15.1:0/4046213088 shutdown_connections 2023-11-15T01:21:39.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.057+0000 7f4f876c0700 1 --2- 172.21.15.1:0/4046213088 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f6c05f150 0x7f4f6c061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:39.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.057+0000 7f4f876c0700 1 --2- 172.21.15.1:0/4046213088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f80154480 0x7f4f80151ba0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:39.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.057+0000 7f4f876c0700 1 --2- 172.21.15.1:0/4046213088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f800c6430 0x7f4f80156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:39.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.057+0000 7f4f876c0700 1 --2- 172.21.15.1:0/4046213088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f801540a0 0x7f4f80150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:39.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.057+0000 7f4f876c0700 1 -- 172.21.15.1:0/4046213088 >> 172.21.15.1:0/4046213088 conn(0x7f4f80064a70 msgr2=0x7f4f80153250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:39.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.057+0000 7f4f876c0700 1 -- 172.21.15.1:0/4046213088 shutdown_connections 2023-11-15T01:21:39.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.057+0000 7f4f876c0700 1 -- 172.21.15.1:0/4046213088 wait complete. 2023-11-15T01:21:39.072 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-15T01:21:39.073 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-15T01:21:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.200+0000 7f7c3983a700 1 Processor -- start 2023-11-15T01:21:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.200+0000 7f7c3983a700 1 -- start start 2023-11-15T01:21:39.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c3983a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c340c4900 0x7f7c340c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:39.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c3983a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7c340c1ee0 0x7f7c340a6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:39.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c3983a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c340a4870 con 0x7f7c341576c0 2023-11-15T01:21:39.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c3983a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c340c2640 con 0x7f7c340c1ee0 2023-11-15T01:21:39.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c3983a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340a50f0 con 0x7f7c340c4900 2023-11-15T01:21:39.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c337fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7c340c1ee0 0x7f7c340a6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:39.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c32ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7c341576c0 0x7f7c340a5580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58070/0 (socket says 172.21.15.1:58070) 2023-11-15T01:21:39.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c32ffd700 1 -- 172.21.15.1:0/2928528610 learned_addr learned my addr 172.21.15.1:0/2928528610 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:39.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c337fe700 1 --2- 172.21.15.1:0/2928528610 >> v2:172.21.15.1:3300/0 conn(0x7f7c340c1ee0 0x7f7c340a6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54686/0 (socket says 172.21.15.1:54686) 2023-11-15T01:21:39.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c337fe700 1 -- 172.21.15.1:0/2928528610 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c340c4900 msgr2=0x7f7c340c19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:39.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c337fe700 1 --2- 172.21.15.1:0/2928528610 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c340c4900 0x7f7c340c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:21:39.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c337fe700 1 -- 172.21.15.1:0/2928528610 >> v1:172.21.15.1:6789/0 conn(0x7f7c341576c0 legacy=0x7f7c340a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:39.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c337fe700 1 -- 172.21.15.1:0/2928528610 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c340a5c90 con 0x7f7c340c1ee0 2023-11-15T01:21:39.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c337fe700 1 --2- 172.21.15.1:0/2928528610 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c340c1ee0 0x7f7c340a6050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7c2c009e60 tx=0x7f7c2c009780).ready entity=mon.0 client_cookie=d1bdfa74d817ac74 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:39.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c31ffb700 1 -- 172.21.15.1:0/2928528610 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00e070 con 0x7f7c340c1ee0 2023-11-15T01:21:39.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c31ffb700 1 -- 172.21.15.1:0/2928528610 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c00bc30 con 0x7f7c340c1ee0 2023-11-15T01:21:39.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.201+0000 7f7c31ffb700 1 -- 172.21.15.1:0/2928528610 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c012410 con 0x7f7c340c1ee0 2023-11-15T01:21:39.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.202+0000 7f7c3983a700 1 -- 172.21.15.1:0/2928528610 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c340c1ee0 msgr2=0x7f7c340a6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:39.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.202+0000 7f7c3983a700 1 --2- 172.21.15.1:0/2928528610 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c340c1ee0 0x7f7c340a6050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7c2c009e60 tx=0x7f7c2c009780).stop 2023-11-15T01:21:39.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.202+0000 7f7c3983a700 1 -- 172.21.15.1:0/2928528610 shutdown_connections 2023-11-15T01:21:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.202+0000 7f7c3983a700 1 --2- 172.21.15.1:0/2928528610 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c340c1ee0 0x7f7c340a6050 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.202+0000 7f7c3983a700 1 --2- 172.21.15.1:0/2928528610 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c340c4900 0x7f7c340c19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:21:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.202+0000 7f7c3983a700 1 -- 172.21.15.1:0/2928528610 >> 172.21.15.1:0/2928528610 conn(0x7f7c340c7c10 msgr2=0x7f7c340c3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.202+0000 7f7c3983a700 1 -- 172.21.15.1:0/2928528610 shutdown_connections 2023-11-15T01:21:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.202+0000 7f7c3983a700 1 -- 172.21.15.1:0/2928528610 wait complete. 2023-11-15T01:21:39.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.203+0000 7f7c3983a700 1 Processor -- start 2023-11-15T01:21:39.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.203+0000 7f7c3983a700 1 -- start start 2023-11-15T01:21:39.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c3983a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c340c1ee0 0x7f7c341651f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:39.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c3983a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c340c4900 0x7f7c34155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:39.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c3983a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c341576c0 0x7f7c34155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:39.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c3983a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c34155e10 con 0x7f7c340c4900 2023-11-15T01:21:39.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c3983a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c34154460 con 0x7f7c341576c0 2023-11-15T01:21:39.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c3983a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340ace60 con 0x7f7c340c1ee0 2023-11-15T01:21:39.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c327fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c340c4900 0x7f7c34155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:39.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c327fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c340c4900 0x7f7c34155430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54688/0 (socket says 172.21.15.1:54688) 2023-11-15T01:21:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c327fc700 1 -- 172.21.15.1:0/1298721372 learned_addr learned my addr 172.21.15.1:0/1298721372 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c32ffd700 1 --2- 172.21.15.1:0/1298721372 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c340c1ee0 0x7f7c341651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c337fe700 1 --2- 172.21.15.1:0/1298721372 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c341576c0 0x7f7c34155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c327fc700 1 -- 172.21.15.1:0/1298721372 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c340c1ee0 msgr2=0x7f7c341651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c327fc700 1 --2- 172.21.15.1:0/1298721372 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c340c1ee0 0x7f7c341651f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:39.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c327fc700 1 -- 172.21.15.1:0/1298721372 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c341576c0 msgr2=0x7f7c34155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:39.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c327fc700 1 --2- 172.21.15.1:0/1298721372 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c341576c0 0x7f7c34155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:39.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c327fc700 1 -- 172.21.15.1:0/1298721372 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c009a20 con 0x7f7c340c4900 2023-11-15T01:21:39.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.204+0000 7f7c327fc700 1 --2- 172.21.15.1:0/1298721372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c340c4900 0x7f7c34155430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f7c1c00b530 tx=0x7f7c1c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:39.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.205+0000 7f7c2affd700 1 -- 172.21.15.1:0/1298721372 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00d4a0 con 0x7f7c340c4900 2023-11-15T01:21:39.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.205+0000 7f7c2affd700 1 -- 172.21.15.1:0/1298721372 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c00d620 con 0x7f7c340c4900 2023-11-15T01:21:39.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.205+0000 7f7c3983a700 1 -- 172.21.15.1:0/1298721372 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c341656e0 con 0x7f7c340c4900 2023-11-15T01:21:39.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.205+0000 7f7c2affd700 1 -- 172.21.15.1:0/1298721372 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00d9e0 con 0x7f7c340c4900 2023-11-15T01:21:39.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.205+0000 7f7c3983a700 1 -- 172.21.15.1:0/1298721372 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c34153b30 con 0x7f7c340c4900 2023-11-15T01:21:39.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.206+0000 7f7c3983a700 1 -- 172.21.15.1:0/1298721372 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c341545d0 con 0x7f7c340c4900 2023-11-15T01:21:39.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.206+0000 7f7c2affd700 1 -- 172.21.15.1:0/1298721372 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7c1c012410 con 0x7f7c340c4900 2023-11-15T01:21:39.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.206+0000 7f7c2affd700 1 --2- 172.21.15.1:0/1298721372 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7c1405f150 0x7f7c14061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:39.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.206+0000 7f7c2affd700 1 -- 172.21.15.1:0/1298721372 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7c1c07a160 con 0x7f7c340c4900 2023-11-15T01:21:39.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.206+0000 7f7c32ffd700 1 --2- 172.21.15.1:0/1298721372 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7c1405f150 0x7f7c14061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:39.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.207+0000 7f7c32ffd700 1 --2- 172.21.15.1:0/1298721372 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7c1405f150 0x7f7c14061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7c34154c20 tx=0x7f7c24009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:39.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.210+0000 7f7c2affd700 1 -- 172.21.15.1:0/1298721372 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7c1c04b3d0 con 0x7f7c340c4900 2023-11-15T01:21:39.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:39.430+0000 7f7c3983a700 1 -- 172.21.15.1:0/1298721372 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7c340c46e0 con 0x7f7c340c4900 2023-11-15T01:21:40.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.059+0000 7f7c2affd700 1 -- 172.21.15.1:0/1298721372 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7c1c04e9f0 con 0x7f7c340c4900 2023-11-15T01:21:40.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.062+0000 7f7c3983a700 1 -- 172.21.15.1:0/1298721372 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7c1405f150 msgr2=0x7f7c14061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.062+0000 7f7c3983a700 1 --2- 172.21.15.1:0/1298721372 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7c1405f150 0x7f7c14061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7c34154c20 tx=0x7f7c24009040).stop 2023-11-15T01:21:40.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.062+0000 7f7c3983a700 1 -- 172.21.15.1:0/1298721372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c340c4900 msgr2=0x7f7c34155430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.062+0000 7f7c3983a700 1 --2- 172.21.15.1:0/1298721372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c340c4900 0x7f7c34155430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f7c1c00b530 tx=0x7f7c1c0090f0).stop 2023-11-15T01:21:40.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.062+0000 7f7c3983a700 1 -- 172.21.15.1:0/1298721372 shutdown_connections 2023-11-15T01:21:40.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.062+0000 7f7c3983a700 1 --2- 172.21.15.1:0/1298721372 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7c1405f150 0x7f7c14061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.062+0000 7f7c3983a700 1 --2- 172.21.15.1:0/1298721372 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c341576c0 0x7f7c34155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.062+0000 7f7c3983a700 1 --2- 172.21.15.1:0/1298721372 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c340c1ee0 0x7f7c341651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.062+0000 7f7c3983a700 1 --2- 172.21.15.1:0/1298721372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c340c4900 0x7f7c34155430 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.062+0000 7f7c3983a700 1 -- 172.21.15.1:0/1298721372 >> 172.21.15.1:0/1298721372 conn(0x7f7c340c7c10 msgr2=0x7f7c34065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:40.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.062+0000 7f7c3983a700 1 -- 172.21.15.1:0/1298721372 shutdown_connections 2023-11-15T01:21:40.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.062+0000 7f7c3983a700 1 -- 172.21.15.1:0/1298721372 wait complete. 2023-11-15T01:21:40.077 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-15T01:21:40.077 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:21:40.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.203+0000 7f65baa72700 1 Processor -- start 2023-11-15T01:21:40.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.203+0000 7f65baa72700 1 -- start start 2023-11-15T01:21:40.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65baa72700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f65b4155610 0x7f65b4068dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65baa72700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65b40ad370 0x7f65b40627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65baa72700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b40acee0 con 0x7f65b40692c0 2023-11-15T01:21:40.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65baa72700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b4069820 con 0x7f65b4155610 2023-11-15T01:21:40.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65baa72700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40ac890 con 0x7f65b40ad370 2023-11-15T01:21:40.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65b880e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f65b4155610 0x7f65b4068dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65b880e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f65b4155610 0x7f65b4068dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54694/0 (socket says 172.21.15.1:54694) 2023-11-15T01:21:40.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65b880e700 1 -- 172.21.15.1:0/3828733898 learned_addr learned my addr 172.21.15.1:0/3828733898 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:40.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65b880e700 1 -- 172.21.15.1:0/3828733898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65b40ad370 msgr2=0x7f65b40627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:40.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65b880e700 1 --2- 172.21.15.1:0/3828733898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65b40ad370 0x7f65b40627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:21:40.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65b880e700 1 -- 172.21.15.1:0/3828733898 >> v1:172.21.15.141:6789/0 conn(0x7f65b40692c0 legacy=0x7f65b40aa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:40.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65b880e700 1 -- 172.21.15.1:0/3828733898 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b40acb70 con 0x7f65b4155610 2023-11-15T01:21:40.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65b880e700 1 --2- 172.21.15.1:0/3828733898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65b4155610 0x7f65b4068dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f65a4006fd0 tx=0x7f65a40090f0).ready entity=mon.0 client_cookie=891e66d5b16b5268 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:40.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65b37fe700 1 -- 172.21.15.1:0/3828733898 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a400b600 con 0x7f65b4155610 2023-11-15T01:21:40.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65b37fe700 1 -- 172.21.15.1:0/3828733898 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a400b760 con 0x7f65b4155610 2023-11-15T01:21:40.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.204+0000 7f65b37fe700 1 -- 172.21.15.1:0/3828733898 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a400bae0 con 0x7f65b4155610 2023-11-15T01:21:40.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.205+0000 7f65baa72700 1 -- 172.21.15.1:0/3828733898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65b4155610 msgr2=0x7f65b4068dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.205+0000 7f65baa72700 1 --2- 172.21.15.1:0/3828733898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65b4155610 0x7f65b4068dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f65a4006fd0 tx=0x7f65a40090f0).stop 2023-11-15T01:21:40.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.205+0000 7f65baa72700 1 -- 172.21.15.1:0/3828733898 shutdown_connections 2023-11-15T01:21:40.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.205+0000 7f65baa72700 1 --2- 172.21.15.1:0/3828733898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65b40ad370 0x7f65b40627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:21:40.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.205+0000 7f65baa72700 1 --2- 172.21.15.1:0/3828733898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65b4155610 0x7f65b4068dd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.205+0000 7f65baa72700 1 -- 172.21.15.1:0/3828733898 >> 172.21.15.1:0/3828733898 conn(0x7f65b40c74f0 msgr2=0x7f65b40c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:40.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.205+0000 7f65baa72700 1 -- 172.21.15.1:0/3828733898 shutdown_connections 2023-11-15T01:21:40.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.205+0000 7f65baa72700 1 -- 172.21.15.1:0/3828733898 wait complete. 2023-11-15T01:21:40.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.206+0000 7f65baa72700 1 Processor -- start 2023-11-15T01:21:40.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.206+0000 7f65baa72700 1 -- start start 2023-11-15T01:21:40.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.207+0000 7f65baa72700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65b40692c0 0x7f65b41669c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.207+0000 7f65baa72700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65b40ad370 0x7f65b4162850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.207+0000 7f65baa72700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65b4155610 0x7f65b40a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.207+0000 7f65baa72700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b414d6a0 con 0x7f65b40ad370 2023-11-15T01:21:40.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.207+0000 7f65baa72700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40a22d0 con 0x7f65b4155610 2023-11-15T01:21:40.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.207+0000 7f65baa72700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40a25b0 con 0x7f65b40692c0 2023-11-15T01:21:40.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.207+0000 7f65b3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65b40ad370 0x7f65b4162850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.207+0000 7f65b3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65b40ad370 0x7f65b4162850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54696/0 (socket says 172.21.15.1:54696) 2023-11-15T01:21:40.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.207+0000 7f65b3fff700 1 -- 172.21.15.1:0/2361180391 learned_addr learned my addr 172.21.15.1:0/2361180391 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:40.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.207+0000 7f65b880e700 1 --2- 172.21.15.1:0/2361180391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65b40692c0 0x7f65b41669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.207+0000 7f65b900f700 1 --2- 172.21.15.1:0/2361180391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65b4155610 0x7f65b40a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.208+0000 7f65b3fff700 1 -- 172.21.15.1:0/2361180391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65b40692c0 msgr2=0x7f65b41669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.208+0000 7f65b3fff700 1 --2- 172.21.15.1:0/2361180391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65b40692c0 0x7f65b41669c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.208+0000 7f65b3fff700 1 -- 172.21.15.1:0/2361180391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65b4155610 msgr2=0x7f65b40a09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.208+0000 7f65b3fff700 1 --2- 172.21.15.1:0/2361180391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65b4155610 0x7f65b40a09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.208+0000 7f65b3fff700 1 -- 172.21.15.1:0/2361180391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a4009370 con 0x7f65b40ad370 2023-11-15T01:21:40.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.208+0000 7f65b3fff700 1 --2- 172.21.15.1:0/2361180391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65b40ad370 0x7f65b4162850 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f659c00c440 tx=0x7f659c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:40.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.208+0000 7f65b0ff9700 1 -- 172.21.15.1:0/2361180391 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c00f470 con 0x7f65b40ad370 2023-11-15T01:21:40.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.208+0000 7f65b0ff9700 1 -- 172.21.15.1:0/2361180391 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c00f5f0 con 0x7f65b40ad370 2023-11-15T01:21:40.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.208+0000 7f65b0ff9700 1 -- 172.21.15.1:0/2361180391 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c00f9b0 con 0x7f65b40ad370 2023-11-15T01:21:40.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.208+0000 7f65baa72700 1 -- 172.21.15.1:0/2361180391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b4162d40 con 0x7f65b40ad370 2023-11-15T01:21:40.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.208+0000 7f65baa72700 1 -- 172.21.15.1:0/2361180391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b40a1530 con 0x7f65b40ad370 2023-11-15T01:21:40.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.209+0000 7f65baa72700 1 -- 172.21.15.1:0/2361180391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b40a2720 con 0x7f65b40ad370 2023-11-15T01:21:40.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.209+0000 7f65b0ff9700 1 -- 172.21.15.1:0/2361180391 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f659c012400 con 0x7f65b40ad370 2023-11-15T01:21:40.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.210+0000 7f65b0ff9700 1 --2- 172.21.15.1:0/2361180391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f659405f120 0x7f65940615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.210+0000 7f65b0ff9700 1 -- 172.21.15.1:0/2361180391 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f659c0797a0 con 0x7f65b40ad370 2023-11-15T01:21:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.210+0000 7f65b880e700 1 --2- 172.21.15.1:0/2361180391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f659405f120 0x7f65940615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.210+0000 7f65b880e700 1 --2- 172.21.15.1:0/2361180391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f659405f120 0x7f65940615e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f65a4009130 tx=0x7f65a4017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.214+0000 7f65b0ff9700 1 -- 172.21.15.1:0/2361180391 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f659c048af0 con 0x7f65b40ad370 2023-11-15T01:21:40.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.429+0000 7f65baa72700 1 -- 172.21.15.1:0/2361180391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65b406c7e0 con 0x7f65b40ad370 2023-11-15T01:21:40.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.430+0000 7f65b0ff9700 1 -- 172.21.15.1:0/2361180391 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4480 (secure 0 0 0) 0x7f659c04aa00 con 0x7f65b40ad370 2023-11-15T01:21:40.431 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:40.431 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/843391361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":843391361},{"type":"v1","addr":"172.21.15.141:6837","nonce":843391361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2237478530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2237478530},{"type":"v1","addr":"172.21.15.141:6836","nonce":2237478530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2856672167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2856672167},{"type":"v1","addr":"172.21.15.1:6833","nonce":2856672167}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:21:37.045655+0000","modified":"2023-11-15T01:21:40.053500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/4209655632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4209655632},{"type":"v1","addr":"172.21.15.1:6835","nonce":4209655632}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-15T01:21:40.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.432+0000 7f65baa72700 1 -- 172.21.15.1:0/2361180391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f659405f120 msgr2=0x7f65940615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.432+0000 7f65baa72700 1 --2- 172.21.15.1:0/2361180391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f659405f120 0x7f65940615e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f65a4009130 tx=0x7f65a4017000).stop 2023-11-15T01:21:40.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.432+0000 7f65baa72700 1 -- 172.21.15.1:0/2361180391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65b40ad370 msgr2=0x7f65b4162850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.432+0000 7f65baa72700 1 --2- 172.21.15.1:0/2361180391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65b40ad370 0x7f65b4162850 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f659c00c440 tx=0x7f659c007de0).stop 2023-11-15T01:21:40.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.432+0000 7f65baa72700 1 -- 172.21.15.1:0/2361180391 shutdown_connections 2023-11-15T01:21:40.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.432+0000 7f65baa72700 1 --2- 172.21.15.1:0/2361180391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f659405f120 0x7f65940615e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.432+0000 7f65baa72700 1 --2- 172.21.15.1:0/2361180391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65b4155610 0x7f65b40a09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.432+0000 7f65baa72700 1 --2- 172.21.15.1:0/2361180391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65b40692c0 0x7f65b41669c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.432+0000 7f65baa72700 1 --2- 172.21.15.1:0/2361180391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65b40ad370 0x7f65b4162850 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.432+0000 7f65baa72700 1 -- 172.21.15.1:0/2361180391 >> 172.21.15.1:0/2361180391 conn(0x7f65b40c74f0 msgr2=0x7f65b40a9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:40.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.432+0000 7f65baa72700 1 -- 172.21.15.1:0/2361180391 shutdown_connections 2023-11-15T01:21:40.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.432+0000 7f65baa72700 1 -- 172.21.15.1:0/2361180391 wait complete. 2023-11-15T01:21:40.435 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2023-11-15T01:21:40.444 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:21:40.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.562+0000 7fa4418a0700 1 Processor -- start 2023-11-15T01:21:40.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.562+0000 7fa4418a0700 1 -- start start 2023-11-15T01:21:40.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa4418a0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa43c154150 0x7fa43c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa4418a0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa43c0ab1a0 0x7fa43c158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa4418a0700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43c0c06f0 con 0x7fa43c0aa060 2023-11-15T01:21:40.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa4418a0700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c0c09d0 con 0x7fa43c154150 2023-11-15T01:21:40.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa4418a0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c158820 con 0x7fa43c0ab1a0 2023-11-15T01:21:40.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa43affd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa43c154150 0x7fa43c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa43b7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa43c0aa060 0x7fa43c0c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58080/0 (socket says 172.21.15.1:58080) 2023-11-15T01:21:40.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa43b7fe700 1 -- 172.21.15.1:0/4188113687 learned_addr learned my addr 172.21.15.1:0/4188113687 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:40.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa43a7fc700 1 --2- 172.21.15.1:0/4188113687 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa43c0ab1a0 0x7fa43c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa43affd700 1 -- 172.21.15.1:0/4188113687 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa43c0ab1a0 msgr2=0x7fa43c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:40.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa43affd700 1 --2- 172.21.15.1:0/4188113687 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa43c0ab1a0 0x7fa43c158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa43affd700 1 -- 172.21.15.1:0/4188113687 >> v1:172.21.15.1:6789/0 conn(0x7fa43c0aa060 legacy=0x7fa43c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa43affd700 1 -- 172.21.15.1:0/4188113687 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c158b00 con 0x7fa43c154150 2023-11-15T01:21:40.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa439ffb700 1 -- 172.21.15.1:0/4188113687 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966093325 0 0) 0x7fa43c0c06f0 con 0x7fa43c0aa060 2023-11-15T01:21:40.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa43affd700 1 --2- 172.21.15.1:0/4188113687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa43c154150 0x7fa43c154530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fa42c009e60 tx=0x7fa42c009780).ready entity=mon.0 client_cookie=f4e1b7c54a4cfcea server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:40.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa439ffb700 1 -- 172.21.15.1:0/4188113687 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c00e070 con 0x7fa43c154150 2023-11-15T01:21:40.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa439ffb700 1 -- 172.21.15.1:0/4188113687 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c00bb60 con 0x7fa43c154150 2023-11-15T01:21:40.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.563+0000 7fa439ffb700 1 -- 172.21.15.1:0/4188113687 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c012410 con 0x7fa43c154150 2023-11-15T01:21:40.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.564+0000 7fa4418a0700 1 -- 172.21.15.1:0/4188113687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa43c154150 msgr2=0x7fa43c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.564+0000 7fa4418a0700 1 --2- 172.21.15.1:0/4188113687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa43c154150 0x7fa43c154530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fa42c009e60 tx=0x7fa42c009780).stop 2023-11-15T01:21:40.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.564+0000 7fa4418a0700 1 -- 172.21.15.1:0/4188113687 shutdown_connections 2023-11-15T01:21:40.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.564+0000 7fa4418a0700 1 --2- 172.21.15.1:0/4188113687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa43c154150 0x7fa43c154530 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.564+0000 7fa4418a0700 1 --2- 172.21.15.1:0/4188113687 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa43c0ab1a0 0x7fa43c158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.564+0000 7fa4418a0700 1 -- 172.21.15.1:0/4188113687 >> 172.21.15.1:0/4188113687 conn(0x7fa43c064aa0 msgr2=0x7fa43c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:40.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.564+0000 7fa4418a0700 1 -- 172.21.15.1:0/4188113687 shutdown_connections 2023-11-15T01:21:40.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.564+0000 7fa4418a0700 1 -- 172.21.15.1:0/4188113687 wait complete. 2023-11-15T01:21:40.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.565+0000 7fa4418a0700 1 Processor -- start 2023-11-15T01:21:40.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.565+0000 7fa4418a0700 1 -- start start 2023-11-15T01:21:40.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa4418a0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa43c0aa060 0x7fa43c0ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa4418a0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa43c0ab1a0 0x7fa43c14ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa4418a0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa43c154150 0x7fa43c14bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa4418a0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c14c3f0 con 0x7fa43c0ab1a0 2023-11-15T01:21:40.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa4418a0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c156790 con 0x7fa43c154150 2023-11-15T01:21:40.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa4418a0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c157a80 con 0x7fa43c0aa060 2023-11-15T01:21:40.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa43a7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa43c0ab1a0 0x7fa43c14ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa43a7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa43c0ab1a0 0x7fa43c14ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54716/0 (socket says 172.21.15.1:54716) 2023-11-15T01:21:40.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa43a7fc700 1 -- 172.21.15.1:0/1166953354 learned_addr learned my addr 172.21.15.1:0/1166953354 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:40.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa43b7fe700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa43c154150 0x7fa43c14bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa43affd700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa43c0aa060 0x7fa43c0ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa43a7fc700 1 -- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa43c0aa060 msgr2=0x7fa43c0ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa43a7fc700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa43c0aa060 0x7fa43c0ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa43a7fc700 1 -- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa43c154150 msgr2=0x7fa43c14bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa43a7fc700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa43c154150 0x7fa43c14bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa43a7fc700 1 -- 172.21.15.1:0/1166953354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c009a20 con 0x7fa43c0ab1a0 2023-11-15T01:21:40.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa43b7fe700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa43c154150 0x7fa43c14bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:40.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.566+0000 7fa43affd700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa43c0aa060 0x7fa43c0ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:40.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.567+0000 7fa43a7fc700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa43c0ab1a0 0x7fa43c14ba10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fa42400e930 tx=0x7fa424009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:40.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.567+0000 7fa432ffd700 1 -- 172.21.15.1:0/1166953354 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42400eed0 con 0x7fa43c0ab1a0 2023-11-15T01:21:40.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.567+0000 7fa432ffd700 1 -- 172.21.15.1:0/1166953354 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42400c850 con 0x7fa43c0ab1a0 2023-11-15T01:21:40.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.567+0000 7fa4418a0700 1 -- 172.21.15.1:0/1166953354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c1569e0 con 0x7fa43c0ab1a0 2023-11-15T01:21:40.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.567+0000 7fa432ffd700 1 -- 172.21.15.1:0/1166953354 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42400cbd0 con 0x7fa43c0ab1a0 2023-11-15T01:21:40.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.567+0000 7fa4418a0700 1 -- 172.21.15.1:0/1166953354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c156fa0 con 0x7fa43c0ab1a0 2023-11-15T01:21:40.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.568+0000 7fa4418a0700 1 -- 172.21.15.1:0/1166953354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43c06c7e0 con 0x7fa43c0ab1a0 2023-11-15T01:21:40.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.568+0000 7fa432ffd700 1 -- 172.21.15.1:0/1166953354 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa42401b400 con 0x7fa43c0ab1a0 2023-11-15T01:21:40.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.568+0000 7fa432ffd700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa41c05f150 0x7fa41c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.568+0000 7fa432ffd700 1 -- 172.21.15.1:0/1166953354 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa42407a760 con 0x7fa43c0ab1a0 2023-11-15T01:21:40.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.569+0000 7fa43affd700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa41c05f150 0x7fa41c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.569+0000 7fa43affd700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa41c05f150 0x7fa41c061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa43c14c680 tx=0x7fa42c009780).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:40.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.572+0000 7fa432ffd700 1 -- 172.21.15.1:0/1166953354 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa42404ba80 con 0x7fa43c0ab1a0 2023-11-15T01:21:40.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.746+0000 7fa4418a0700 1 -- 172.21.15.1:0/1166953354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa43c05f8b0 con 0x7fa43c0ab1a0 2023-11-15T01:21:40.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.746+0000 7fa432ffd700 1 -- 172.21.15.1:0/1166953354 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16880 (secure 0 0 0) 0x7fa42404f0a0 con 0x7fa43c0ab1a0 2023-11-15T01:21:40.747 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:40.748 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:38.047484+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:21:34.763591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-15T01:21:36.025071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:21:40.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.748+0000 7fa4418a0700 1 -- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa41c05f150 msgr2=0x7fa41c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.748+0000 7fa4418a0700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa41c05f150 0x7fa41c061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa43c14c680 tx=0x7fa42c009780).stop 2023-11-15T01:21:40.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.748+0000 7fa4418a0700 1 -- 172.21.15.1:0/1166953354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa43c0ab1a0 msgr2=0x7fa43c14ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.748+0000 7fa4418a0700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa43c0ab1a0 0x7fa43c14ba10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fa42400e930 tx=0x7fa424009060).stop 2023-11-15T01:21:40.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.748+0000 7fa4418a0700 1 -- 172.21.15.1:0/1166953354 shutdown_connections 2023-11-15T01:21:40.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.748+0000 7fa4418a0700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa41c05f150 0x7fa41c061610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.748+0000 7fa4418a0700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa43c154150 0x7fa43c14bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.748+0000 7fa4418a0700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa43c0aa060 0x7fa43c0ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.748+0000 7fa4418a0700 1 --2- 172.21.15.1:0/1166953354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa43c0ab1a0 0x7fa43c14ba10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.749+0000 7fa4418a0700 1 -- 172.21.15.1:0/1166953354 >> 172.21.15.1:0/1166953354 conn(0x7fa43c064aa0 msgr2=0x7fa43c14e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:40.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.749+0000 7fa4418a0700 1 -- 172.21.15.1:0/1166953354 shutdown_connections 2023-11-15T01:21:40.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.749+0000 7fa4418a0700 1 -- 172.21.15.1:0/1166953354 wait complete. 2023-11-15T01:21:40.761 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-15T01:21:40.762 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:21:40.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.879+0000 7f8ced30c700 1 Processor -- start 2023-11-15T01:21:40.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.879+0000 7f8ced30c700 1 -- start start 2023-11-15T01:21:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.879+0000 7f8ced30c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ce80ab1a0 0x7f8ce8154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.879+0000 7f8ced30c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8ce80aa060 0x7f8ce80c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.879+0000 7f8ced30c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce80c06f0 con 0x7f8ce8154150 2023-11-15T01:21:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.879+0000 7f8ced30c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce80c09d0 con 0x7f8ce80aa060 2023-11-15T01:21:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.879+0000 7f8ced30c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce8158820 con 0x7f8ce80ab1a0 2023-11-15T01:21:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.880+0000 7f8ce77fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8ce80aa060 0x7f8ce80c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.880+0000 7f8ce77fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8ce80aa060 0x7f8ce80c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54730/0 (socket says 172.21.15.1:54730) 2023-11-15T01:21:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.880+0000 7f8ce77fe700 1 -- 172.21.15.1:0/986037046 learned_addr learned my addr 172.21.15.1:0/986037046 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:40.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.880+0000 7f8ce67fc700 1 --2- 172.21.15.1:0/986037046 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ce80ab1a0 0x7f8ce8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.880+0000 7f8ce77fe700 1 -- 172.21.15.1:0/986037046 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ce80ab1a0 msgr2=0x7f8ce8154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.880+0000 7f8ce77fe700 1 --2- 172.21.15.1:0/986037046 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ce80ab1a0 0x7f8ce8154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.880+0000 7f8ce77fe700 1 -- 172.21.15.1:0/986037046 >> v1:172.21.15.141:6789/0 conn(0x7f8ce8154150 legacy=0x7f8ce8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.880+0000 7f8ce77fe700 1 -- 172.21.15.1:0/986037046 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce8158b00 con 0x7f8ce80aa060 2023-11-15T01:21:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.880+0000 7f8ce77fe700 1 --2- 172.21.15.1:0/986037046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ce80aa060 0x7f8ce80c5f10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8ce0009f20 tx=0x7f8ce0009840).ready entity=mon.0 client_cookie=faf36c7b1ae3de8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:40.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.880+0000 7f8ce5ffb700 1 -- 172.21.15.1:0/986037046 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000e070 con 0x7f8ce80aa060 2023-11-15T01:21:40.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.880+0000 7f8ce5ffb700 1 -- 172.21.15.1:0/986037046 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce000ba80 con 0x7f8ce80aa060 2023-11-15T01:21:40.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.880+0000 7f8ce5ffb700 1 -- 172.21.15.1:0/986037046 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000be00 con 0x7f8ce80aa060 2023-11-15T01:21:40.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.881+0000 7f8ced30c700 1 -- 172.21.15.1:0/986037046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ce80aa060 msgr2=0x7f8ce80c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.881+0000 7f8ced30c700 1 --2- 172.21.15.1:0/986037046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ce80aa060 0x7f8ce80c5f10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8ce0009f20 tx=0x7f8ce0009840).stop 2023-11-15T01:21:40.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.881+0000 7f8ced30c700 1 -- 172.21.15.1:0/986037046 shutdown_connections 2023-11-15T01:21:40.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.881+0000 7f8ced30c700 1 --2- 172.21.15.1:0/986037046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ce80aa060 0x7f8ce80c5f10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.881+0000 7f8ced30c700 1 --2- 172.21.15.1:0/986037046 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ce80ab1a0 0x7f8ce8154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.881+0000 7f8ced30c700 1 -- 172.21.15.1:0/986037046 >> 172.21.15.1:0/986037046 conn(0x7f8ce8064aa0 msgr2=0x7f8ce8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:40.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.881+0000 7f8ced30c700 1 -- 172.21.15.1:0/986037046 shutdown_connections 2023-11-15T01:21:40.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.881+0000 7f8ced30c700 1 -- 172.21.15.1:0/986037046 wait complete. 2023-11-15T01:21:40.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.882+0000 7f8ced30c700 1 Processor -- start 2023-11-15T01:21:40.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.882+0000 7f8ced30c700 1 -- start start 2023-11-15T01:21:40.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ced30c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ce80aa060 0x7f8ce80ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ced30c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ce80ab1a0 0x7f8ce814d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ced30c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ce8154150 0x7f8ce80cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ced30c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80c9d90 con 0x7f8ce80ab1a0 2023-11-15T01:21:40.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ced30c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80c9180 con 0x7f8ce8154150 2023-11-15T01:21:40.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ced30c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80c9460 con 0x7f8ce80aa060 2023-11-15T01:21:40.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ce67fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ce80ab1a0 0x7f8ce814d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ce67fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ce80ab1a0 0x7f8ce814d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54732/0 (socket says 172.21.15.1:54732) 2023-11-15T01:21:40.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ce67fc700 1 -- 172.21.15.1:0/2755254985 learned_addr learned my addr 172.21.15.1:0/2755254985 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:40.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ce77fe700 1 --2- 172.21.15.1:0/2755254985 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ce8154150 0x7f8ce80cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ce6ffd700 1 --2- 172.21.15.1:0/2755254985 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ce80aa060 0x7f8ce80ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ce67fc700 1 -- 172.21.15.1:0/2755254985 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ce80aa060 msgr2=0x7f8ce80ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ce67fc700 1 --2- 172.21.15.1:0/2755254985 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ce80aa060 0x7f8ce80ca220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ce67fc700 1 -- 172.21.15.1:0/2755254985 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ce8154150 msgr2=0x7f8ce80cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ce67fc700 1 --2- 172.21.15.1:0/2755254985 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ce8154150 0x7f8ce80cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ce67fc700 1 -- 172.21.15.1:0/2755254985 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce0009ae0 con 0x7f8ce80ab1a0 2023-11-15T01:21:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ce77fe700 1 --2- 172.21.15.1:0/2755254985 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ce8154150 0x7f8ce80cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:40.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ce67fc700 1 --2- 172.21.15.1:0/2755254985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ce80ab1a0 0x7f8ce814d840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f8cdc00d890 tx=0x7f8cdc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:40.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8cceffd700 1 -- 172.21.15.1:0/2755254985 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0125f0 con 0x7f8ce80ab1a0 2023-11-15T01:21:40.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8cceffd700 1 -- 172.21.15.1:0/2755254985 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc012750 con 0x7f8ce80ab1a0 2023-11-15T01:21:40.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8cceffd700 1 -- 172.21.15.1:0/2755254985 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc012ad0 con 0x7f8ce80ab1a0 2023-11-15T01:21:40.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ced30c700 1 -- 172.21.15.1:0/2755254985 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce80c9740 con 0x7f8ce80ab1a0 2023-11-15T01:21:40.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.883+0000 7f8ced30c700 1 -- 172.21.15.1:0/2755254985 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce80ca710 con 0x7f8ce80ab1a0 2023-11-15T01:21:40.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.884+0000 7f8ced30c700 1 -- 172.21.15.1:0/2755254985 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce80c9f40 con 0x7f8ce80ab1a0 2023-11-15T01:21:40.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.885+0000 7f8cceffd700 1 -- 172.21.15.1:0/2755254985 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8cdc013480 con 0x7f8ce80ab1a0 2023-11-15T01:21:40.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.885+0000 7f8cceffd700 1 --2- 172.21.15.1:0/2755254985 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8cd405f150 0x7f8cd4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:40.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.885+0000 7f8cceffd700 1 -- 172.21.15.1:0/2755254985 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8cdc07a3d0 con 0x7f8ce80ab1a0 2023-11-15T01:21:40.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.885+0000 7f8ce6ffd700 1 --2- 172.21.15.1:0/2755254985 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8cd405f150 0x7f8cd4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:40.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.886+0000 7f8ce6ffd700 1 --2- 172.21.15.1:0/2755254985 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8cd405f150 0x7f8cd4061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8cd80015e0 tx=0x7f8cd8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:40.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:40.889+0000 7f8cceffd700 1 -- 172.21.15.1:0/2755254985 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8ce80c9f40 con 0x7f8ce80ab1a0 2023-11-15T01:21:41.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.058+0000 7f8ced30c700 1 -- 172.21.15.1:0/2755254985 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ce80c9f40 con 0x7f8cd405f150 2023-11-15T01:21:41.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.069+0000 7f8cceffd700 1 -- 172.21.15.1:0/2755254985 <== mgr.4103 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336351 (secure 0 0 0) 0x7f8ce80c9f40 con 0x7f8cd405f150 2023-11-15T01:21:41.073 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:41.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.072+0000 7f8ced30c700 1 -- 172.21.15.1:0/2755254985 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8cd405f150 msgr2=0x7f8cd4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.072+0000 7f8ced30c700 1 --2- 172.21.15.1:0/2755254985 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8cd405f150 0x7f8cd4061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8cd80015e0 tx=0x7f8cd8009040).stop 2023-11-15T01:21:41.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.072+0000 7f8ced30c700 1 -- 172.21.15.1:0/2755254985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ce80ab1a0 msgr2=0x7f8ce814d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.072+0000 7f8ced30c700 1 --2- 172.21.15.1:0/2755254985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ce80ab1a0 0x7f8ce814d840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f8cdc00d890 tx=0x7f8cdc008040).stop 2023-11-15T01:21:41.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.072+0000 7f8ced30c700 1 -- 172.21.15.1:0/2755254985 shutdown_connections 2023-11-15T01:21:41.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.072+0000 7f8ced30c700 1 --2- 172.21.15.1:0/2755254985 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8cd405f150 0x7f8cd4061610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.072+0000 7f8ced30c700 1 --2- 172.21.15.1:0/2755254985 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ce8154150 0x7f8ce80cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.072+0000 7f8ced30c700 1 --2- 172.21.15.1:0/2755254985 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ce80aa060 0x7f8ce80ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.072+0000 7f8ced30c700 1 --2- 172.21.15.1:0/2755254985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ce80ab1a0 0x7f8ce814d840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.072+0000 7f8ced30c700 1 -- 172.21.15.1:0/2755254985 >> 172.21.15.1:0/2755254985 conn(0x7f8ce8064aa0 msgr2=0x7f8ce80ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:41.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.072+0000 7f8ced30c700 1 -- 172.21.15.1:0/2755254985 shutdown_connections 2023-11-15T01:21:41.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.072+0000 7f8ced30c700 1 -- 172.21.15.1:0/2755254985 wait complete. 2023-11-15T01:21:41.079 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:21:41.085 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-15T01:21:39.757902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378624,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596096,"statfs":{"total":773094113280,"available":770658402304,"internally_reserved":0,"allocated":1900544,"data_stored":687340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076736+0000","last_change":"2023-11-15T01:21:37.070154+0000","last_active":"2023-11-15T01:21:37.076736+0000","last_peered":"2023-11-15T01:21:37.076736+0000","last_clean":"2023-11-15T01:21:37.076736+0000","last_became_active":"2023-11-15T01:21:37.069444+0000","last_became_peered":"2023-11-15T01:21:37.069444+0000","last_unstale":"2023-11-15T01:21:37.076736+0000","last_undegraded":"2023-11-15T01:21:37.076736+0000","last_fullsized":"2023-11-15T01:21:37.076736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.064539+0000","last_change":"2023-11-15T01:21:36.678192+0000","last_active":"2023-11-15T01:21:37.064539+0000","last_peered":"2023-11-15T01:21:37.064539+0000","last_clean":"2023-11-15T01:21:37.064539+0000","last_became_active":"2023-11-15T01:21:36.677205+0000","last_became_peered":"2023-11-15T01:21:36.677205+0000","last_unstale":"2023-11-15T01:21:37.064539+0000","last_undegraded":"2023-11-15T01:21:37.064539+0000","last_fullsized":"2023-11-15T01:21:37.064539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.068262+0000","last_change":"2023-11-15T01:21:37.064541+0000","last_active":"2023-11-15T01:21:37.068262+0000","last_peered":"2023-11-15T01:21:37.068262+0000","last_clean":"2023-11-15T01:21:37.068262+0000","last_became_active":"2023-11-15T01:21:37.064244+0000","last_became_peered":"2023-11-15T01:21:37.064244+0000","last_unstale":"2023-11-15T01:21:37.068262+0000","last_undegraded":"2023-11-15T01:21:37.068262+0000","last_fullsized":"2023-11-15T01:21:37.068262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054518+0000","last_change":"2023-11-15T01:21:36.683547+0000","last_active":"2023-11-15T01:21:37.054518+0000","last_peered":"2023-11-15T01:21:37.054518+0000","last_clean":"2023-11-15T01:21:37.054518+0000","last_became_active":"2023-11-15T01:21:36.682979+0000","last_became_peered":"2023-11-15T01:21:36.682979+0000","last_unstale":"2023-11-15T01:21:37.054518+0000","last_undegraded":"2023-11-15T01:21:37.054518+0000","last_fullsized":"2023-11-15T01:21:37.054518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073255+0000","last_change":"2023-11-15T01:21:37.067297+0000","last_active":"2023-11-15T01:21:37.073255+0000","last_peered":"2023-11-15T01:21:37.073255+0000","last_clean":"2023-11-15T01:21:37.073255+0000","last_became_active":"2023-11-15T01:21:37.066997+0000","last_became_peered":"2023-11-15T01:21:37.066997+0000","last_unstale":"2023-11-15T01:21:37.073255+0000","last_undegraded":"2023-11-15T01:21:37.073255+0000","last_fullsized":"2023-11-15T01:21:37.073255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058796+0000","last_change":"2023-11-15T01:21:36.679373+0000","last_active":"2023-11-15T01:21:37.058796+0000","last_peered":"2023-11-15T01:21:37.058796+0000","last_clean":"2023-11-15T01:21:37.058796+0000","last_became_active":"2023-11-15T01:21:36.678627+0000","last_became_peered":"2023-11-15T01:21:36.678627+0000","last_unstale":"2023-11-15T01:21:37.058796+0000","last_undegraded":"2023-11-15T01:21:37.058796+0000","last_fullsized":"2023-11-15T01:21:37.058796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076950+0000","last_change":"2023-11-15T01:21:37.074270+0000","last_active":"2023-11-15T01:21:37.076950+0000","last_peered":"2023-11-15T01:21:37.076950+0000","last_clean":"2023-11-15T01:21:37.076950+0000","last_became_active":"2023-11-15T01:21:37.073966+0000","last_became_peered":"2023-11-15T01:21:37.073966+0000","last_unstale":"2023-11-15T01:21:37.076950+0000","last_undegraded":"2023-11-15T01:21:37.076950+0000","last_fullsized":"2023-11-15T01:21:37.076950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.052916+0000","last_change":"2023-11-15T01:21:36.679676+0000","last_active":"2023-11-15T01:21:37.052916+0000","last_peered":"2023-11-15T01:21:37.052916+0000","last_clean":"2023-11-15T01:21:37.052916+0000","last_became_active":"2023-11-15T01:21:36.679444+0000","last_became_peered":"2023-11-15T01:21:36.679444+0000","last_unstale":"2023-11-15T01:21:37.052916+0000","last_undegraded":"2023-11-15T01:21:37.052916+0000","last_fullsized":"2023-11-15T01:21:37.052916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077396+0000","last_change":"2023-11-15T01:21:37.075345+0000","last_active":"2023-11-15T01:21:37.077396+0000","last_peered":"2023-11-15T01:21:37.077396+0000","last_clean":"2023-11-15T01:21:37.077396+0000","last_became_active":"2023-11-15T01:21:37.074940+0000","last_became_peered":"2023-11-15T01:21:37.074940+0000","last_unstale":"2023-11-15T01:21:37.077396+0000","last_undegraded":"2023-11-15T01:21:37.077396+0000","last_fullsized":"2023-11-15T01:21:37.077396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059141+0000","last_change":"2023-11-15T01:21:36.675726+0000","last_active":"2023-11-15T01:21:37.059141+0000","last_peered":"2023-11-15T01:21:37.059141+0000","last_clean":"2023-11-15T01:21:37.059141+0000","last_became_active":"2023-11-15T01:21:36.675370+0000","last_became_peered":"2023-11-15T01:21:36.675370+0000","last_unstale":"2023-11-15T01:21:37.059141+0000","last_undegraded":"2023-11-15T01:21:37.059141+0000","last_fullsized":"2023-11-15T01:21:37.059141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073310+0000","last_change":"2023-11-15T01:21:37.071192+0000","last_active":"2023-11-15T01:21:37.073310+0000","last_peered":"2023-11-15T01:21:37.073310+0000","last_clean":"2023-11-15T01:21:37.073310+0000","last_became_active":"2023-11-15T01:21:37.070894+0000","last_became_peered":"2023-11-15T01:21:37.070894+0000","last_unstale":"2023-11-15T01:21:37.073310+0000","last_undegraded":"2023-11-15T01:21:37.073310+0000","last_fullsized":"2023-11-15T01:21:37.073310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077678+0000","last_change":"2023-11-15T01:21:36.678243+0000","last_active":"2023-11-15T01:21:37.077678+0000","last_peered":"2023-11-15T01:21:37.077678+0000","last_clean":"2023-11-15T01:21:37.077678+0000","last_became_active":"2023-11-15T01:21:36.675596+0000","last_became_peered":"2023-11-15T01:21:36.675596+0000","last_unstale":"2023-11-15T01:21:37.077678+0000","last_undegraded":"2023-11-15T01:21:37.077678+0000","last_fullsized":"2023-11-15T01:21:37.077678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075581+0000","last_change":"2023-11-15T01:21:37.070789+0000","last_active":"2023-11-15T01:21:37.075581+0000","last_peered":"2023-11-15T01:21:37.075581+0000","last_clean":"2023-11-15T01:21:37.075581+0000","last_became_active":"2023-11-15T01:21:37.070474+0000","last_became_peered":"2023-11-15T01:21:37.070474+0000","last_unstale":"2023-11-15T01:21:37.075581+0000","last_undegraded":"2023-11-15T01:21:37.075581+0000","last_fullsized":"2023-11-15T01:21:37.075581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077420+0000","last_change":"2023-11-15T01:21:36.681355+0000","last_active":"2023-11-15T01:21:37.077420+0000","last_peered":"2023-11-15T01:21:37.077420+0000","last_clean":"2023-11-15T01:21:37.077420+0000","last_became_active":"2023-11-15T01:21:36.681062+0000","last_became_peered":"2023-11-15T01:21:36.681062+0000","last_unstale":"2023-11-15T01:21:37.077420+0000","last_undegraded":"2023-11-15T01:21:37.077420+0000","last_fullsized":"2023-11-15T01:21:37.077420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076571+0000","last_change":"2023-11-15T01:21:37.069662+0000","last_active":"2023-11-15T01:21:37.076571+0000","last_peered":"2023-11-15T01:21:37.076571+0000","last_clean":"2023-11-15T01:21:37.076571+0000","last_became_active":"2023-11-15T01:21:37.069329+0000","last_became_peered":"2023-11-15T01:21:37.069329+0000","last_unstale":"2023-11-15T01:21:37.076571+0000","last_undegraded":"2023-11-15T01:21:37.076571+0000","last_fullsized":"2023-11-15T01:21:37.076571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076355+0000","last_change":"2023-11-15T01:21:36.678012+0000","last_active":"2023-11-15T01:21:37.076355+0000","last_peered":"2023-11-15T01:21:37.076355+0000","last_clean":"2023-11-15T01:21:37.076355+0000","last_became_active":"2023-11-15T01:21:36.677738+0000","last_became_peered":"2023-11-15T01:21:36.677738+0000","last_unstale":"2023-11-15T01:21:37.076355+0000","last_undegraded":"2023-11-15T01:21:37.076355+0000","last_fullsized":"2023-11-15T01:21:37.076355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081186+0000","last_change":"2023-11-15T01:21:37.077200+0000","last_active":"2023-11-15T01:21:37.081186+0000","last_peered":"2023-11-15T01:21:37.081186+0000","last_clean":"2023-11-15T01:21:37.081186+0000","last_became_active":"2023-11-15T01:21:37.076903+0000","last_became_peered":"2023-11-15T01:21:37.076903+0000","last_unstale":"2023-11-15T01:21:37.081186+0000","last_undegraded":"2023-11-15T01:21:37.081186+0000","last_fullsized":"2023-11-15T01:21:37.081186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051933+0000","last_change":"2023-11-15T01:21:36.673362+0000","last_active":"2023-11-15T01:21:37.051933+0000","last_peered":"2023-11-15T01:21:37.051933+0000","last_clean":"2023-11-15T01:21:37.051933+0000","last_became_active":"2023-11-15T01:21:36.671321+0000","last_became_peered":"2023-11-15T01:21:36.671321+0000","last_unstale":"2023-11-15T01:21:37.051933+0000","last_undegraded":"2023-11-15T01:21:37.051933+0000","last_fullsized":"2023-11-15T01:21:37.051933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078495+0000","last_change":"2023-11-15T01:21:37.071120+0000","last_active":"2023-11-15T01:21:37.078495+0000","last_peered":"2023-11-15T01:21:37.078495+0000","last_clean":"2023-11-15T01:21:37.078495+0000","last_became_active":"2023-11-15T01:21:37.070850+0000","last_became_peered":"2023-11-15T01:21:37.070850+0000","last_unstale":"2023-11-15T01:21:37.078495+0000","last_undegraded":"2023-11-15T01:21:37.078495+0000","last_fullsized":"2023-11-15T01:21:37.078495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060633+0000","last_change":"2023-11-15T01:21:36.681424+0000","last_active":"2023-11-15T01:21:37.060633+0000","last_peered":"2023-11-15T01:21:37.060633+0000","last_clean":"2023-11-15T01:21:37.060633+0000","last_became_active":"2023-11-15T01:21:36.680976+0000","last_became_peered":"2023-11-15T01:21:36.680976+0000","last_unstale":"2023-11-15T01:21:37.060633+0000","last_undegraded":"2023-11-15T01:21:37.060633+0000","last_fullsized":"2023-11-15T01:21:37.060633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081471+0000","last_change":"2023-11-15T01:21:37.079474+0000","last_active":"2023-11-15T01:21:37.081471+0000","last_peered":"2023-11-15T01:21:37.081471+0000","last_clean":"2023-11-15T01:21:37.081471+0000","last_became_active":"2023-11-15T01:21:37.078060+0000","last_became_peered":"2023-11-15T01:21:37.078060+0000","last_unstale":"2023-11-15T01:21:37.081471+0000","last_undegraded":"2023-11-15T01:21:37.081471+0000","last_fullsized":"2023-11-15T01:21:37.081471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061716+0000","last_change":"2023-11-15T01:21:36.674722+0000","last_active":"2023-11-15T01:21:37.061716+0000","last_peered":"2023-11-15T01:21:37.061716+0000","last_clean":"2023-11-15T01:21:37.061716+0000","last_became_active":"2023-11-15T01:21:36.674350+0000","last_became_peered":"2023-11-15T01:21:36.674350+0000","last_unstale":"2023-11-15T01:21:37.061716+0000","last_undegraded":"2023-11-15T01:21:37.061716+0000","last_fullsized":"2023-11-15T01:21:37.061716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.070132+0000","last_change":"2023-11-15T01:21:37.065467+0000","last_active":"2023-11-15T01:21:37.070132+0000","last_peered":"2023-11-15T01:21:37.070132+0000","last_clean":"2023-11-15T01:21:37.070132+0000","last_became_active":"2023-11-15T01:21:37.065154+0000","last_became_peered":"2023-11-15T01:21:37.065154+0000","last_unstale":"2023-11-15T01:21:37.070132+0000","last_undegraded":"2023-11-15T01:21:37.070132+0000","last_fullsized":"2023-11-15T01:21:37.070132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075966+0000","last_change":"2023-11-15T01:21:36.679946+0000","last_active":"2023-11-15T01:21:37.075966+0000","last_peered":"2023-11-15T01:21:37.075966+0000","last_clean":"2023-11-15T01:21:37.075966+0000","last_became_active":"2023-11-15T01:21:36.679643+0000","last_became_peered":"2023-11-15T01:21:36.679643+0000","last_unstale":"2023-11-15T01:21:37.075966+0000","last_undegraded":"2023-11-15T01:21:37.075966+0000","last_fullsized":"2023-11-15T01:21:37.075966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076313+0000","last_change":"2023-11-15T01:21:37.073362+0000","last_active":"2023-11-15T01:21:37.076313+0000","last_peered":"2023-11-15T01:21:37.076313+0000","last_clean":"2023-11-15T01:21:37.076313+0000","last_became_active":"2023-11-15T01:21:37.072950+0000","last_became_peered":"2023-11-15T01:21:37.072950+0000","last_unstale":"2023-11-15T01:21:37.076313+0000","last_undegraded":"2023-11-15T01:21:37.076313+0000","last_fullsized":"2023-11-15T01:21:37.076313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076535+0000","last_change":"2023-11-15T01:21:36.679282+0000","last_active":"2023-11-15T01:21:37.076535+0000","last_peered":"2023-11-15T01:21:37.076535+0000","last_clean":"2023-11-15T01:21:37.076535+0000","last_became_active":"2023-11-15T01:21:36.676942+0000","last_became_peered":"2023-11-15T01:21:36.676942+0000","last_unstale":"2023-11-15T01:21:37.076535+0000","last_undegraded":"2023-11-15T01:21:37.076535+0000","last_fullsized":"2023-11-15T01:21:37.076535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073625+0000","last_change":"2023-11-15T01:21:37.067894+0000","last_active":"2023-11-15T01:21:37.073625+0000","last_peered":"2023-11-15T01:21:37.073625+0000","last_clean":"2023-11-15T01:21:37.073625+0000","last_became_active":"2023-11-15T01:21:37.067199+0000","last_became_peered":"2023-11-15T01:21:37.067199+0000","last_unstale":"2023-11-15T01:21:37.073625+0000","last_undegraded":"2023-11-15T01:21:37.073625+0000","last_fullsized":"2023-11-15T01:21:37.073625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.064048+0000","last_change":"2023-11-15T01:21:36.682276+0000","last_active":"2023-11-15T01:21:37.064048+0000","last_peered":"2023-11-15T01:21:37.064048+0000","last_clean":"2023-11-15T01:21:37.064048+0000","last_became_active":"2023-11-15T01:21:36.681910+0000","last_became_peered":"2023-11-15T01:21:36.681910+0000","last_unstale":"2023-11-15T01:21:37.064048+0000","last_undegraded":"2023-11-15T01:21:37.064048+0000","last_fullsized":"2023-11-15T01:21:37.064048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075905+0000","last_change":"2023-11-15T01:21:37.068177+0000","last_active":"2023-11-15T01:21:37.075905+0000","last_peered":"2023-11-15T01:21:37.075905+0000","last_clean":"2023-11-15T01:21:37.075905+0000","last_became_active":"2023-11-15T01:21:37.067708+0000","last_became_peered":"2023-11-15T01:21:37.067708+0000","last_unstale":"2023-11-15T01:21:37.075905+0000","last_undegraded":"2023-11-15T01:21:37.075905+0000","last_fullsized":"2023-11-15T01:21:37.075905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058497+0000","last_change":"2023-11-15T01:21:36.674143+0000","last_active":"2023-11-15T01:21:37.058497+0000","last_peered":"2023-11-15T01:21:37.058497+0000","last_clean":"2023-11-15T01:21:37.058497+0000","last_became_active":"2023-11-15T01:21:36.673800+0000","last_became_peered":"2023-11-15T01:21:36.673800+0000","last_unstale":"2023-11-15T01:21:37.058497+0000","last_undegraded":"2023-11-15T01:21:37.058497+0000","last_fullsized":"2023-11-15T01:21:37.058497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075706+0000","last_change":"2023-11-15T01:21:37.071297+0000","last_active":"2023-11-15T01:21:37.075706+0000","last_peered":"2023-11-15T01:21:37.075706+0000","last_clean":"2023-11-15T01:21:37.075706+0000","last_became_active":"2023-11-15T01:21:37.070987+0000","last_became_peered":"2023-11-15T01:21:37.070987+0000","last_unstale":"2023-11-15T01:21:37.075706+0000","last_undegraded":"2023-11-15T01:21:37.075706+0000","last_fullsized":"2023-11-15T01:21:37.075706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079876+0000","last_change":"2023-11-15T01:21:36.679647+0000","last_active":"2023-11-15T01:21:37.079876+0000","last_peered":"2023-11-15T01:21:37.079876+0000","last_clean":"2023-11-15T01:21:37.079876+0000","last_became_active":"2023-11-15T01:21:36.679134+0000","last_became_peered":"2023-11-15T01:21:36.679134+0000","last_unstale":"2023-11-15T01:21:37.079876+0000","last_undegraded":"2023-11-15T01:21:37.079876+0000","last_fullsized":"2023-11-15T01:21:37.079876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075523+0000","last_change":"2023-11-15T01:21:37.071036+0000","last_active":"2023-11-15T01:21:37.075523+0000","last_peered":"2023-11-15T01:21:37.075523+0000","last_clean":"2023-11-15T01:21:37.075523+0000","last_became_active":"2023-11-15T01:21:37.070766+0000","last_became_peered":"2023-11-15T01:21:37.070766+0000","last_unstale":"2023-11-15T01:21:37.075523+0000","last_undegraded":"2023-11-15T01:21:37.075523+0000","last_fullsized":"2023-11-15T01:21:37.075523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053077+0000","last_change":"2023-11-15T01:21:36.677096+0000","last_active":"2023-11-15T01:21:37.053077+0000","last_peered":"2023-11-15T01:21:37.053077+0000","last_clean":"2023-11-15T01:21:37.053077+0000","last_became_active":"2023-11-15T01:21:36.676780+0000","last_became_peered":"2023-11-15T01:21:36.676780+0000","last_unstale":"2023-11-15T01:21:37.053077+0000","last_undegraded":"2023-11-15T01:21:37.053077+0000","last_fullsized":"2023-11-15T01:21:37.053077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075723+0000","last_change":"2023-11-15T01:21:37.071911+0000","last_active":"2023-11-15T01:21:37.075723+0000","last_peered":"2023-11-15T01:21:37.075723+0000","last_clean":"2023-11-15T01:21:37.075723+0000","last_became_active":"2023-11-15T01:21:37.071572+0000","last_became_peered":"2023-11-15T01:21:37.071572+0000","last_unstale":"2023-11-15T01:21:37.075723+0000","last_undegraded":"2023-11-15T01:21:37.075723+0000","last_fullsized":"2023-11-15T01:21:37.075723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061988+0000","last_change":"2023-11-15T01:21:36.665943+0000","last_active":"2023-11-15T01:21:37.061988+0000","last_peered":"2023-11-15T01:21:37.061988+0000","last_clean":"2023-11-15T01:21:37.061988+0000","last_became_active":"2023-11-15T01:21:36.663826+0000","last_became_peered":"2023-11-15T01:21:36.663826+0000","last_unstale":"2023-11-15T01:21:37.061988+0000","last_undegraded":"2023-11-15T01:21:37.061988+0000","last_fullsized":"2023-11-15T01:21:37.061988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079611+0000","last_change":"2023-11-15T01:21:37.078906+0000","last_active":"2023-11-15T01:21:37.079611+0000","last_peered":"2023-11-15T01:21:37.079611+0000","last_clean":"2023-11-15T01:21:37.079611+0000","last_became_active":"2023-11-15T01:21:37.078557+0000","last_became_peered":"2023-11-15T01:21:37.078557+0000","last_unstale":"2023-11-15T01:21:37.079611+0000","last_undegraded":"2023-11-15T01:21:37.079611+0000","last_fullsized":"2023-11-15T01:21:37.079611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060923+0000","last_change":"2023-11-15T01:21:36.684155+0000","last_active":"2023-11-15T01:21:37.060923+0000","last_peered":"2023-11-15T01:21:37.060923+0000","last_clean":"2023-11-15T01:21:37.060923+0000","last_became_active":"2023-11-15T01:21:36.683867+0000","last_became_peered":"2023-11-15T01:21:36.683867+0000","last_unstale":"2023-11-15T01:21:37.060923+0000","last_undegraded":"2023-11-15T01:21:37.060923+0000","last_fullsized":"2023-11-15T01:21:37.060923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.055130+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:21:37.055130+0000","last_peered":"2023-11-15T01:21:37.055130+0000","last_clean":"2023-11-15T01:21:37.055130+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:21:37.055130+0000","last_undegraded":"2023-11-15T01:21:37.055130+0000","last_fullsized":"2023-11-15T01:21:37.055130+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059501+0000","last_change":"2023-11-15T01:21:36.673900+0000","last_active":"2023-11-15T01:21:37.059501+0000","last_peered":"2023-11-15T01:21:37.059501+0000","last_clean":"2023-11-15T01:21:37.059501+0000","last_became_active":"2023-11-15T01:21:36.673523+0000","last_became_peered":"2023-11-15T01:21:36.673523+0000","last_unstale":"2023-11-15T01:21:37.059501+0000","last_undegraded":"2023-11-15T01:21:37.059501+0000","last_fullsized":"2023-11-15T01:21:37.059501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.066720+0000","last_change":"2023-11-15T01:21:37.065623+0000","last_active":"2023-11-15T01:21:37.066720+0000","last_peered":"2023-11-15T01:21:37.066720+0000","last_clean":"2023-11-15T01:21:37.066720+0000","last_became_active":"2023-11-15T01:21:37.065338+0000","last_became_peered":"2023-11-15T01:21:37.065338+0000","last_unstale":"2023-11-15T01:21:37.066720+0000","last_undegraded":"2023-11-15T01:21:37.066720+0000","last_fullsized":"2023-11-15T01:21:37.066720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058545+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:21:37.058545+0000","last_peered":"2023-11-15T01:21:37.058545+0000","last_clean":"2023-11-15T01:21:37.058545+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:21:37.058545+0000","last_undegraded":"2023-11-15T01:21:37.058545+0000","last_fullsized":"2023-11-15T01:21:37.058545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.065604+0000","last_change":"2023-11-15T01:21:36.675569+0000","last_active":"2023-11-15T01:21:37.065604+0000","last_peered":"2023-11-15T01:21:37.065604+0000","last_clean":"2023-11-15T01:21:37.065604+0000","last_became_active":"2023-11-15T01:21:36.675216+0000","last_became_peered":"2023-11-15T01:21:36.675216+0000","last_unstale":"2023-11-15T01:21:37.065604+0000","last_undegraded":"2023-11-15T01:21:37.065604+0000","last_fullsized":"2023-11-15T01:21:37.065604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.063934+0000","last_change":"2023-11-15T01:21:37.056059+0000","last_active":"2023-11-15T01:21:37.063934+0000","last_peered":"2023-11-15T01:21:37.063934+0000","last_clean":"2023-11-15T01:21:37.063934+0000","last_became_active":"2023-11-15T01:21:37.055792+0000","last_became_peered":"2023-11-15T01:21:37.055792+0000","last_unstale":"2023-11-15T01:21:37.063934+0000","last_undegraded":"2023-11-15T01:21:37.063934+0000","last_fullsized":"2023-11-15T01:21:37.063934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.066956+0000","last_change":"2023-11-15T01:21:37.066235+0000","last_active":"2023-11-15T01:21:37.066956+0000","last_peered":"2023-11-15T01:21:37.066956+0000","last_clean":"2023-11-15T01:21:37.066956+0000","last_became_active":"2023-11-15T01:21:37.066039+0000","last_became_peered":"2023-11-15T01:21:37.066039+0000","last_unstale":"2023-11-15T01:21:37.066956+0000","last_undegraded":"2023-11-15T01:21:37.066956+0000","last_fullsized":"2023-11-15T01:21:37.066956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.049466+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:21:37.049466+0000","last_peered":"2023-11-15T01:21:37.049466+0000","last_clean":"2023-11-15T01:21:37.049466+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:21:37.049466+0000","last_undegraded":"2023-11-15T01:21:37.049466+0000","last_fullsized":"2023-11-15T01:21:37.049466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054621+0000","last_change":"2023-11-15T01:21:36.675336+0000","last_active":"2023-11-15T01:21:37.054621+0000","last_peered":"2023-11-15T01:21:37.054621+0000","last_clean":"2023-11-15T01:21:37.054621+0000","last_became_active":"2023-11-15T01:21:36.675018+0000","last_became_peered":"2023-11-15T01:21:36.675018+0000","last_unstale":"2023-11-15T01:21:37.054621+0000","last_undegraded":"2023-11-15T01:21:37.054621+0000","last_fullsized":"2023-11-15T01:21:37.054621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075405+0000","last_change":"2023-11-15T01:21:37.072490+0000","last_active":"2023-11-15T01:21:37.075405+0000","last_peered":"2023-11-15T01:21:37.075405+0000","last_clean":"2023-11-15T01:21:37.075405+0000","last_became_active":"2023-11-15T01:21:37.072175+0000","last_became_peered":"2023-11-15T01:21:37.072175+0000","last_unstale":"2023-11-15T01:21:37.075405+0000","last_undegraded":"2023-11-15T01:21:37.075405+0000","last_fullsized":"2023-11-15T01:21:37.075405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058381+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:21:37.058381+0000","last_peered":"2023-11-15T01:21:37.058381+0000","last_clean":"2023-11-15T01:21:37.058381+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:21:37.058381+0000","last_undegraded":"2023-11-15T01:21:37.058381+0000","last_fullsized":"2023-11-15T01:21:37.058381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059508+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:21:37.059508+0000","last_peered":"2023-11-15T01:21:37.059508+0000","last_clean":"2023-11-15T01:21:37.059508+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:21:37.059508+0000","last_undegraded":"2023-11-15T01:21:37.059508+0000","last_fullsized":"2023-11-15T01:21:37.059508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059414+0000","last_change":"2023-11-15T01:21:36.679052+0000","last_active":"2023-11-15T01:21:37.059414+0000","last_peered":"2023-11-15T01:21:37.059414+0000","last_clean":"2023-11-15T01:21:37.059414+0000","last_became_active":"2023-11-15T01:21:36.678750+0000","last_became_peered":"2023-11-15T01:21:36.678750+0000","last_unstale":"2023-11-15T01:21:37.059414+0000","last_undegraded":"2023-11-15T01:21:37.059414+0000","last_fullsized":"2023-11-15T01:21:37.059414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075965+0000","last_change":"2023-11-15T01:21:37.068467+0000","last_active":"2023-11-15T01:21:37.075965+0000","last_peered":"2023-11-15T01:21:37.075965+0000","last_clean":"2023-11-15T01:21:37.075965+0000","last_became_active":"2023-11-15T01:21:37.068195+0000","last_became_peered":"2023-11-15T01:21:37.068195+0000","last_unstale":"2023-11-15T01:21:37.075965+0000","last_undegraded":"2023-11-15T01:21:37.075965+0000","last_fullsized":"2023-11-15T01:21:37.075965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059991+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:21:37.059991+0000","last_peered":"2023-11-15T01:21:37.059991+0000","last_clean":"2023-11-15T01:21:37.059991+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:21:37.059991+0000","last_undegraded":"2023-11-15T01:21:37.059991+0000","last_fullsized":"2023-11-15T01:21:37.059991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051461+0000","last_change":"2023-11-15T01:21:36.678021+0000","last_active":"2023-11-15T01:21:37.051461+0000","last_peered":"2023-11-15T01:21:37.051461+0000","last_clean":"2023-11-15T01:21:37.051461+0000","last_became_active":"2023-11-15T01:21:36.677747+0000","last_became_peered":"2023-11-15T01:21:36.677747+0000","last_unstale":"2023-11-15T01:21:37.051461+0000","last_undegraded":"2023-11-15T01:21:37.051461+0000","last_fullsized":"2023-11-15T01:21:37.051461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.064933+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:21:37.064933+0000","last_peered":"2023-11-15T01:21:37.064933+0000","last_clean":"2023-11-15T01:21:37.064933+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:21:37.064933+0000","last_undegraded":"2023-11-15T01:21:37.064933+0000","last_fullsized":"2023-11-15T01:21:37.064933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.055252+0000","last_change":"2023-11-15T01:21:36.675293+0000","last_active":"2023-11-15T01:21:37.055252+0000","last_peered":"2023-11-15T01:21:37.055252+0000","last_clean":"2023-11-15T01:21:37.055252+0000","last_became_active":"2023-11-15T01:21:36.674972+0000","last_became_peered":"2023-11-15T01:21:36.674972+0000","last_unstale":"2023-11-15T01:21:37.055252+0000","last_undegraded":"2023-11-15T01:21:37.055252+0000","last_fullsized":"2023-11-15T01:21:37.055252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075953+0000","last_change":"2023-11-15T01:21:37.069096+0000","last_active":"2023-11-15T01:21:37.075953+0000","last_peered":"2023-11-15T01:21:37.075953+0000","last_clean":"2023-11-15T01:21:37.075953+0000","last_became_active":"2023-11-15T01:21:37.068837+0000","last_became_peered":"2023-11-15T01:21:37.068837+0000","last_unstale":"2023-11-15T01:21:37.075953+0000","last_undegraded":"2023-11-15T01:21:37.075953+0000","last_fullsized":"2023-11-15T01:21:37.075953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.080003+0000","last_change":"2023-11-15T01:21:36.677731+0000","last_active":"2023-11-15T01:21:37.080003+0000","last_peered":"2023-11-15T01:21:37.080003+0000","last_clean":"2023-11-15T01:21:37.080003+0000","last_became_active":"2023-11-15T01:21:36.677473+0000","last_became_peered":"2023-11-15T01:21:36.677473+0000","last_unstale":"2023-11-15T01:21:37.080003+0000","last_undegraded":"2023-11-15T01:21:37.080003+0000","last_fullsized":"2023-11-15T01:21:37.080003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054763+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:21:37.054763+0000","last_peered":"2023-11-15T01:21:37.054763+0000","last_clean":"2023-11-15T01:21:37.054763+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:21:37.054763+0000","last_undegraded":"2023-11-15T01:21:37.054763+0000","last_fullsized":"2023-11-15T01:21:37.054763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076969+0000","last_change":"2023-11-15T01:21:37.074453+0000","last_active":"2023-11-15T01:21:37.076969+0000","last_peered":"2023-11-15T01:21:37.076969+0000","last_clean":"2023-11-15T01:21:37.076969+0000","last_became_active":"2023-11-15T01:21:37.074163+0000","last_became_peered":"2023-11-15T01:21:37.074163+0000","last_unstale":"2023-11-15T01:21:37.076969+0000","last_undegraded":"2023-11-15T01:21:37.076969+0000","last_fullsized":"2023-11-15T01:21:37.076969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054203+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:21:37.054203+0000","last_peered":"2023-11-15T01:21:37.054203+0000","last_clean":"2023-11-15T01:21:37.054203+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:21:37.054203+0000","last_undegraded":"2023-11-15T01:21:37.054203+0000","last_fullsized":"2023-11-15T01:21:37.054203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.052816+0000","last_change":"2023-11-15T01:21:36.677412+0000","last_active":"2023-11-15T01:21:37.052816+0000","last_peered":"2023-11-15T01:21:37.052816+0000","last_clean":"2023-11-15T01:21:37.052816+0000","last_became_active":"2023-11-15T01:21:36.677133+0000","last_became_peered":"2023-11-15T01:21:36.677133+0000","last_unstale":"2023-11-15T01:21:37.052816+0000","last_undegraded":"2023-11-15T01:21:37.052816+0000","last_fullsized":"2023-11-15T01:21:37.052816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076301+0000","last_change":"2023-11-15T01:21:37.073195+0000","last_active":"2023-11-15T01:21:37.076301+0000","last_peered":"2023-11-15T01:21:37.076301+0000","last_clean":"2023-11-15T01:21:37.076301+0000","last_became_active":"2023-11-15T01:21:37.069951+0000","last_became_peered":"2023-11-15T01:21:37.069951+0000","last_unstale":"2023-11-15T01:21:37.076301+0000","last_undegraded":"2023-11-15T01:21:37.076301+0000","last_fullsized":"2023-11-15T01:21:37.076301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060157+0000","last_change":"2023-11-15T01:21:37.056072+0000","last_active":"2023-11-15T01:21:37.060157+0000","last_peered":"2023-11-15T01:21:37.060157+0000","last_clean":"2023-11-15T01:21:37.060157+0000","last_became_active":"2023-11-15T01:21:37.055787+0000","last_became_peered":"2023-11-15T01:21:37.055787+0000","last_unstale":"2023-11-15T01:21:37.060157+0000","last_undegraded":"2023-11-15T01:21:37.060157+0000","last_fullsized":"2023-11-15T01:21:37.060157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051906+0000","last_change":"2023-11-15T01:21:36.672485+0000","last_active":"2023-11-15T01:21:37.051906+0000","last_peered":"2023-11-15T01:21:37.051906+0000","last_clean":"2023-11-15T01:21:37.051906+0000","last_became_active":"2023-11-15T01:21:36.672099+0000","last_became_peered":"2023-11-15T01:21:36.672099+0000","last_unstale":"2023-11-15T01:21:37.051906+0000","last_undegraded":"2023-11-15T01:21:37.051906+0000","last_fullsized":"2023-11-15T01:21:37.051906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081012+0000","last_change":"2023-11-15T01:21:37.077263+0000","last_active":"2023-11-15T01:21:37.081012+0000","last_peered":"2023-11-15T01:21:37.081012+0000","last_clean":"2023-11-15T01:21:37.081012+0000","last_became_active":"2023-11-15T01:21:37.076981+0000","last_became_peered":"2023-11-15T01:21:37.076981+0000","last_unstale":"2023-11-15T01:21:37.081012+0000","last_undegraded":"2023-11-15T01:21:37.081012+0000","last_fullsized":"2023-11-15T01:21:37.081012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058603+0000","last_change":"2023-11-15T01:21:36.677251+0000","last_active":"2023-11-15T01:21:37.058603+0000","last_peered":"2023-11-15T01:21:37.058603+0000","last_clean":"2023-11-15T01:21:37.058603+0000","last_became_active":"2023-11-15T01:21:36.676955+0000","last_became_peered":"2023-11-15T01:21:36.676955+0000","last_unstale":"2023-11-15T01:21:37.058603+0000","last_undegraded":"2023-11-15T01:21:37.058603+0000","last_fullsized":"2023-11-15T01:21:37.058603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075958+0000","last_change":"2023-11-15T01:21:37.073688+0000","last_active":"2023-11-15T01:21:37.075958+0000","last_peered":"2023-11-15T01:21:37.075958+0000","last_clean":"2023-11-15T01:21:37.075958+0000","last_became_active":"2023-11-15T01:21:37.073409+0000","last_became_peered":"2023-11-15T01:21:37.073409+0000","last_unstale":"2023-11-15T01:21:37.075958+0000","last_undegraded":"2023-11-15T01:21:37.075958+0000","last_fullsized":"2023-11-15T01:21:37.075958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073464+0000","last_change":"2023-11-15T01:21:36.675358+0000","last_active":"2023-11-15T01:21:37.073464+0000","last_peered":"2023-11-15T01:21:37.073464+0000","last_clean":"2023-11-15T01:21:37.073464+0000","last_became_active":"2023-11-15T01:21:36.675089+0000","last_became_peered":"2023-11-15T01:21:36.675089+0000","last_unstale":"2023-11-15T01:21:37.073464+0000","last_undegraded":"2023-11-15T01:21:37.073464+0000","last_fullsized":"2023-11-15T01:21:37.073464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077044+0000","last_change":"2023-11-15T01:21:37.074975+0000","last_active":"2023-11-15T01:21:37.077044+0000","last_peered":"2023-11-15T01:21:37.077044+0000","last_clean":"2023-11-15T01:21:37.077044+0000","last_became_active":"2023-11-15T01:21:37.068659+0000","last_became_peered":"2023-11-15T01:21:37.068659+0000","last_unstale":"2023-11-15T01:21:37.077044+0000","last_undegraded":"2023-11-15T01:21:37.077044+0000","last_fullsized":"2023-11-15T01:21:37.077044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.074074+0000","last_change":"2023-11-15T01:21:36.672628+0000","last_active":"2023-11-15T01:21:37.074074+0000","last_peered":"2023-11-15T01:21:37.074074+0000","last_clean":"2023-11-15T01:21:37.074074+0000","last_became_active":"2023-11-15T01:21:36.672235+0000","last_became_peered":"2023-11-15T01:21:36.672235+0000","last_unstale":"2023-11-15T01:21:37.074074+0000","last_undegraded":"2023-11-15T01:21:37.074074+0000","last_fullsized":"2023-11-15T01:21:37.074074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078770+0000","last_change":"2023-11-15T01:21:37.075172+0000","last_active":"2023-11-15T01:21:37.078770+0000","last_peered":"2023-11-15T01:21:37.078770+0000","last_clean":"2023-11-15T01:21:37.078770+0000","last_became_active":"2023-11-15T01:21:37.074844+0000","last_became_peered":"2023-11-15T01:21:37.074844+0000","last_unstale":"2023-11-15T01:21:37.078770+0000","last_undegraded":"2023-11-15T01:21:37.078770+0000","last_fullsized":"2023-11-15T01:21:37.078770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.070348+0000","last_change":"2023-11-15T01:21:36.681248+0000","last_active":"2023-11-15T01:21:37.070348+0000","last_peered":"2023-11-15T01:21:37.070348+0000","last_clean":"2023-11-15T01:21:37.070348+0000","last_became_active":"2023-11-15T01:21:36.680875+0000","last_became_peered":"2023-11-15T01:21:36.680875+0000","last_unstale":"2023-11-15T01:21:37.070348+0000","last_undegraded":"2023-11-15T01:21:37.070348+0000","last_fullsized":"2023-11-15T01:21:37.070348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072884+0000","last_change":"2023-11-15T01:21:37.070426+0000","last_active":"2023-11-15T01:21:37.072884+0000","last_peered":"2023-11-15T01:21:37.072884+0000","last_clean":"2023-11-15T01:21:37.072884+0000","last_became_active":"2023-11-15T01:21:37.070158+0000","last_became_peered":"2023-11-15T01:21:37.070158+0000","last_unstale":"2023-11-15T01:21:37.072884+0000","last_undegraded":"2023-11-15T01:21:37.072884+0000","last_fullsized":"2023-11-15T01:21:37.072884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053859+0000","last_change":"2023-11-15T01:21:36.674583+0000","last_active":"2023-11-15T01:21:37.053859+0000","last_peered":"2023-11-15T01:21:37.053859+0000","last_clean":"2023-11-15T01:21:37.053859+0000","last_became_active":"2023-11-15T01:21:36.674002+0000","last_became_peered":"2023-11-15T01:21:36.674002+0000","last_unstale":"2023-11-15T01:21:37.053859+0000","last_undegraded":"2023-11-15T01:21:37.053859+0000","last_fullsized":"2023-11-15T01:21:37.053859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.065776+0000","last_change":"2023-11-15T01:21:37.061993+0000","last_active":"2023-11-15T01:21:37.065776+0000","last_peered":"2023-11-15T01:21:37.065776+0000","last_clean":"2023-11-15T01:21:37.065776+0000","last_became_active":"2023-11-15T01:21:37.061379+0000","last_became_peered":"2023-11-15T01:21:37.061379+0000","last_unstale":"2023-11-15T01:21:37.065776+0000","last_undegraded":"2023-11-15T01:21:37.065776+0000","last_fullsized":"2023-11-15T01:21:37.065776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.049508+0000","last_change":"2023-11-15T01:21:36.666739+0000","last_active":"2023-11-15T01:21:37.049508+0000","last_peered":"2023-11-15T01:21:37.049508+0000","last_clean":"2023-11-15T01:21:37.049508+0000","last_became_active":"2023-11-15T01:21:36.666437+0000","last_became_peered":"2023-11-15T01:21:36.666437+0000","last_unstale":"2023-11-15T01:21:37.049508+0000","last_undegraded":"2023-11-15T01:21:37.049508+0000","last_fullsized":"2023-11-15T01:21:37.049508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.069514+0000","last_change":"2023-11-15T01:21:37.066195+0000","last_active":"2023-11-15T01:21:37.069514+0000","last_peered":"2023-11-15T01:21:37.069514+0000","last_clean":"2023-11-15T01:21:37.069514+0000","last_became_active":"2023-11-15T01:21:37.065915+0000","last_became_peered":"2023-11-15T01:21:37.065915+0000","last_unstale":"2023-11-15T01:21:37.069514+0000","last_undegraded":"2023-11-15T01:21:37.069514+0000","last_fullsized":"2023-11-15T01:21:37.069514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058395+0000","last_change":"2023-11-15T01:21:36.674457+0000","last_active":"2023-11-15T01:21:37.058395+0000","last_peered":"2023-11-15T01:21:37.058395+0000","last_clean":"2023-11-15T01:21:37.058395+0000","last_became_active":"2023-11-15T01:21:36.673479+0000","last_became_peered":"2023-11-15T01:21:36.673479+0000","last_unstale":"2023-11-15T01:21:37.058395+0000","last_undegraded":"2023-11-15T01:21:37.058395+0000","last_fullsized":"2023-11-15T01:21:37.058395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077664+0000","last_change":"2023-11-15T01:21:37.076770+0000","last_active":"2023-11-15T01:21:37.077664+0000","last_peered":"2023-11-15T01:21:37.077664+0000","last_clean":"2023-11-15T01:21:37.077664+0000","last_became_active":"2023-11-15T01:21:37.076474+0000","last_became_peered":"2023-11-15T01:21:37.076474+0000","last_unstale":"2023-11-15T01:21:37.077664+0000","last_undegraded":"2023-11-15T01:21:37.077664+0000","last_fullsized":"2023-11-15T01:21:37.077664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.052293+0000","last_change":"2023-11-15T01:21:36.677057+0000","last_active":"2023-11-15T01:21:37.052293+0000","last_peered":"2023-11-15T01:21:37.052293+0000","last_clean":"2023-11-15T01:21:37.052293+0000","last_became_active":"2023-11-15T01:21:36.676765+0000","last_became_peered":"2023-11-15T01:21:36.676765+0000","last_unstale":"2023-11-15T01:21:37.052293+0000","last_undegraded":"2023-11-15T01:21:37.052293+0000","last_fullsized":"2023-11-15T01:21:37.052293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079468+0000","last_change":"2023-11-15T01:21:37.077300+0000","last_active":"2023-11-15T01:21:37.079468+0000","last_peered":"2023-11-15T01:21:37.079468+0000","last_clean":"2023-11-15T01:21:37.079468+0000","last_became_active":"2023-11-15T01:21:37.076992+0000","last_became_peered":"2023-11-15T01:21:37.076992+0000","last_unstale":"2023-11-15T01:21:37.079468+0000","last_undegraded":"2023-11-15T01:21:37.079468+0000","last_fullsized":"2023-11-15T01:21:37.079468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059811+0000","last_change":"2023-11-15T01:21:36.675721+0000","last_active":"2023-11-15T01:21:37.059811+0000","last_peered":"2023-11-15T01:21:37.059811+0000","last_clean":"2023-11-15T01:21:37.059811+0000","last_became_active":"2023-11-15T01:21:36.675435+0000","last_became_peered":"2023-11-15T01:21:36.675435+0000","last_unstale":"2023-11-15T01:21:37.059811+0000","last_undegraded":"2023-11-15T01:21:37.059811+0000","last_fullsized":"2023-11-15T01:21:37.059811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078780+0000","last_change":"2023-11-15T01:21:37.075242+0000","last_active":"2023-11-15T01:21:37.078780+0000","last_peered":"2023-11-15T01:21:37.078780+0000","last_clean":"2023-11-15T01:21:37.078780+0000","last_became_active":"2023-11-15T01:21:37.074425+0000","last_became_peered":"2023-11-15T01:21:37.074425+0000","last_unstale":"2023-11-15T01:21:37.078780+0000","last_undegraded":"2023-11-15T01:21:37.078780+0000","last_fullsized":"2023-11-15T01:21:37.078780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054580+0000","last_change":"2023-11-15T01:21:36.682853+0000","last_active":"2023-11-15T01:21:37.054580+0000","last_peered":"2023-11-15T01:21:37.054580+0000","last_clean":"2023-11-15T01:21:37.054580+0000","last_became_active":"2023-11-15T01:21:36.682482+0000","last_became_peered":"2023-11-15T01:21:36.682482+0000","last_unstale":"2023-11-15T01:21:37.054580+0000","last_undegraded":"2023-11-15T01:21:37.054580+0000","last_fullsized":"2023-11-15T01:21:37.054580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077027+0000","last_change":"2023-11-15T01:21:37.069868+0000","last_active":"2023-11-15T01:21:37.077027+0000","last_peered":"2023-11-15T01:21:37.077027+0000","last_clean":"2023-11-15T01:21:37.077027+0000","last_became_active":"2023-11-15T01:21:37.069367+0000","last_became_peered":"2023-11-15T01:21:37.069367+0000","last_unstale":"2023-11-15T01:21:37.077027+0000","last_undegraded":"2023-11-15T01:21:37.077027+0000","last_fullsized":"2023-11-15T01:21:37.077027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053509+0000","last_change":"2023-11-15T01:21:36.676621+0000","last_active":"2023-11-15T01:21:37.053509+0000","last_peered":"2023-11-15T01:21:37.053509+0000","last_clean":"2023-11-15T01:21:37.053509+0000","last_became_active":"2023-11-15T01:21:36.676340+0000","last_became_peered":"2023-11-15T01:21:36.676340+0000","last_unstale":"2023-11-15T01:21:37.053509+0000","last_undegraded":"2023-11-15T01:21:37.053509+0000","last_fullsized":"2023-11-15T01:21:37.053509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061469+0000","last_change":"2023-11-15T01:21:37.056801+0000","last_active":"2023-11-15T01:21:37.061469+0000","last_peered":"2023-11-15T01:21:37.061469+0000","last_clean":"2023-11-15T01:21:37.061469+0000","last_became_active":"2023-11-15T01:21:37.056479+0000","last_became_peered":"2023-11-15T01:21:37.056479+0000","last_unstale":"2023-11-15T01:21:37.061469+0000","last_undegraded":"2023-11-15T01:21:37.061469+0000","last_fullsized":"2023-11-15T01:21:37.061469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061145+0000","last_change":"2023-11-15T01:21:36.677083+0000","last_active":"2023-11-15T01:21:37.061145+0000","last_peered":"2023-11-15T01:21:37.061145+0000","last_clean":"2023-11-15T01:21:37.061145+0000","last_became_active":"2023-11-15T01:21:36.675792+0000","last_became_peered":"2023-11-15T01:21:36.675792+0000","last_unstale":"2023-11-15T01:21:37.061145+0000","last_undegraded":"2023-11-15T01:21:37.061145+0000","last_fullsized":"2023-11-15T01:21:37.061145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.080375+0000","last_change":"2023-11-15T01:21:37.079437+0000","last_active":"2023-11-15T01:21:37.080375+0000","last_peered":"2023-11-15T01:21:37.080375+0000","last_clean":"2023-11-15T01:21:37.080375+0000","last_became_active":"2023-11-15T01:21:37.079183+0000","last_became_peered":"2023-11-15T01:21:37.079183+0000","last_unstale":"2023-11-15T01:21:37.080375+0000","last_undegraded":"2023-11-15T01:21:37.080375+0000","last_fullsized":"2023-11-15T01:21:37.080375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.057734+0000","last_change":"2023-11-15T01:21:36.674125+0000","last_active":"2023-11-15T01:21:37.057734+0000","last_peered":"2023-11-15T01:21:37.057734+0000","last_clean":"2023-11-15T01:21:37.057734+0000","last_became_active":"2023-11-15T01:21:36.673791+0000","last_became_peered":"2023-11-15T01:21:36.673791+0000","last_unstale":"2023-11-15T01:21:37.057734+0000","last_undegraded":"2023-11-15T01:21:37.057734+0000","last_fullsized":"2023-11-15T01:21:37.057734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075073+0000","last_change":"2023-11-15T01:21:37.069603+0000","last_active":"2023-11-15T01:21:37.075073+0000","last_peered":"2023-11-15T01:21:37.075073+0000","last_clean":"2023-11-15T01:21:37.075073+0000","last_became_active":"2023-11-15T01:21:37.069301+0000","last_became_peered":"2023-11-15T01:21:37.069301+0000","last_unstale":"2023-11-15T01:21:37.075073+0000","last_undegraded":"2023-11-15T01:21:37.075073+0000","last_fullsized":"2023-11-15T01:21:37.075073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060017+0000","last_change":"2023-11-15T01:21:36.676838+0000","last_active":"2023-11-15T01:21:37.060017+0000","last_peered":"2023-11-15T01:21:37.060017+0000","last_clean":"2023-11-15T01:21:37.060017+0000","last_became_active":"2023-11-15T01:21:36.676039+0000","last_became_peered":"2023-11-15T01:21:36.676039+0000","last_unstale":"2023-11-15T01:21:37.060017+0000","last_undegraded":"2023-11-15T01:21:37.060017+0000","last_fullsized":"2023-11-15T01:21:37.060017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060317+0000","last_change":"2023-11-15T01:21:37.056702+0000","last_active":"2023-11-15T01:21:37.060317+0000","last_peered":"2023-11-15T01:21:37.060317+0000","last_clean":"2023-11-15T01:21:37.060317+0000","last_became_active":"2023-11-15T01:21:37.056436+0000","last_became_peered":"2023-11-15T01:21:37.056436+0000","last_unstale":"2023-11-15T01:21:37.060317+0000","last_undegraded":"2023-11-15T01:21:37.060317+0000","last_fullsized":"2023-11-15T01:21:37.060317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058643+0000","last_change":"2023-11-15T01:21:36.678350+0000","last_active":"2023-11-15T01:21:37.058643+0000","last_peered":"2023-11-15T01:21:37.058643+0000","last_clean":"2023-11-15T01:21:37.058643+0000","last_became_active":"2023-11-15T01:21:36.678106+0000","last_became_peered":"2023-11-15T01:21:36.678106+0000","last_unstale":"2023-11-15T01:21:37.058643+0000","last_undegraded":"2023-11-15T01:21:37.058643+0000","last_fullsized":"2023-11-15T01:21:37.058643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075725+0000","last_change":"2023-11-15T01:21:37.071814+0000","last_active":"2023-11-15T01:21:37.075725+0000","last_peered":"2023-11-15T01:21:37.075725+0000","last_clean":"2023-11-15T01:21:37.075725+0000","last_became_active":"2023-11-15T01:21:37.071482+0000","last_became_peered":"2023-11-15T01:21:37.071482+0000","last_unstale":"2023-11-15T01:21:37.075725+0000","last_undegraded":"2023-11-15T01:21:37.075725+0000","last_fullsized":"2023-11-15T01:21:37.075725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076465+0000","last_change":"2023-11-15T01:21:36.680865+0000","last_active":"2023-11-15T01:21:37.076465+0000","last_peered":"2023-11-15T01:21:37.076465+0000","last_clean":"2023-11-15T01:21:37.076465+0000","last_became_active":"2023-11-15T01:21:36.680498+0000","last_became_peered":"2023-11-15T01:21:36.680498+0000","last_unstale":"2023-11-15T01:21:37.076465+0000","last_undegraded":"2023-11-15T01:21:37.076465+0000","last_fullsized":"2023-11-15T01:21:37.076465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081144+0000","last_change":"2023-11-15T01:21:37.076900+0000","last_active":"2023-11-15T01:21:37.081144+0000","last_peered":"2023-11-15T01:21:37.081144+0000","last_clean":"2023-11-15T01:21:37.081144+0000","last_became_active":"2023-11-15T01:21:37.076617+0000","last_became_peered":"2023-11-15T01:21:37.076617+0000","last_unstale":"2023-11-15T01:21:37.081144+0000","last_undegraded":"2023-11-15T01:21:37.081144+0000","last_fullsized":"2023-11-15T01:21:37.081144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053970+0000","last_change":"2023-11-15T01:21:36.677040+0000","last_active":"2023-11-15T01:21:37.053970+0000","last_peered":"2023-11-15T01:21:37.053970+0000","last_clean":"2023-11-15T01:21:37.053970+0000","last_became_active":"2023-11-15T01:21:36.676736+0000","last_became_peered":"2023-11-15T01:21:36.676736+0000","last_unstale":"2023-11-15T01:21:37.053970+0000","last_undegraded":"2023-11-15T01:21:37.053970+0000","last_fullsized":"2023-11-15T01:21:37.053970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075883+0000","last_change":"2023-11-15T01:21:37.068055+0000","last_active":"2023-11-15T01:21:37.075883+0000","last_peered":"2023-11-15T01:21:37.075883+0000","last_clean":"2023-11-15T01:21:37.075883+0000","last_became_active":"2023-11-15T01:21:37.067786+0000","last_became_peered":"2023-11-15T01:21:37.067786+0000","last_unstale":"2023-11-15T01:21:37.075883+0000","last_undegraded":"2023-11-15T01:21:37.075883+0000","last_fullsized":"2023-11-15T01:21:37.075883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076413+0000","last_change":"2023-11-15T01:21:36.675927+0000","last_active":"2023-11-15T01:21:37.076413+0000","last_peered":"2023-11-15T01:21:37.076413+0000","last_clean":"2023-11-15T01:21:37.076413+0000","last_became_active":"2023-11-15T01:21:36.675286+0000","last_became_peered":"2023-11-15T01:21:36.675286+0000","last_unstale":"2023-11-15T01:21:37.076413+0000","last_undegraded":"2023-11-15T01:21:37.076413+0000","last_fullsized":"2023-11-15T01:21:37.076413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077009+0000","last_change":"2023-11-15T01:21:37.069678+0000","last_active":"2023-11-15T01:21:37.077009+0000","last_peered":"2023-11-15T01:21:37.077009+0000","last_clean":"2023-11-15T01:21:37.077009+0000","last_became_active":"2023-11-15T01:21:37.069017+0000","last_became_peered":"2023-11-15T01:21:37.069017+0000","last_unstale":"2023-11-15T01:21:37.077009+0000","last_undegraded":"2023-11-15T01:21:37.077009+0000","last_fullsized":"2023-11-15T01:21:37.077009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.050814+0000","last_change":"2023-11-15T01:21:36.672474+0000","last_active":"2023-11-15T01:21:37.050814+0000","last_peered":"2023-11-15T01:21:37.050814+0000","last_clean":"2023-11-15T01:21:37.050814+0000","last_became_active":"2023-11-15T01:21:36.672186+0000","last_became_peered":"2023-11-15T01:21:36.672186+0000","last_unstale":"2023-11-15T01:21:37.050814+0000","last_undegraded":"2023-11-15T01:21:37.050814+0000","last_fullsized":"2023-11-15T01:21:37.050814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078455+0000","last_change":"2023-11-15T01:21:37.074607+0000","last_active":"2023-11-15T01:21:37.078455+0000","last_peered":"2023-11-15T01:21:37.078455+0000","last_clean":"2023-11-15T01:21:37.078455+0000","last_became_active":"2023-11-15T01:21:37.074310+0000","last_became_peered":"2023-11-15T01:21:37.074310+0000","last_unstale":"2023-11-15T01:21:37.078455+0000","last_undegraded":"2023-11-15T01:21:37.078455+0000","last_fullsized":"2023-11-15T01:21:37.078455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060400+0000","last_change":"2023-11-15T01:21:36.677133+0000","last_active":"2023-11-15T01:21:37.060400+0000","last_peered":"2023-11-15T01:21:37.060400+0000","last_clean":"2023-11-15T01:21:37.060400+0000","last_became_active":"2023-11-15T01:21:36.676843+0000","last_became_peered":"2023-11-15T01:21:36.676843+0000","last_unstale":"2023-11-15T01:21:37.060400+0000","last_undegraded":"2023-11-15T01:21:37.060400+0000","last_fullsized":"2023-11-15T01:21:37.060400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079526+0000","last_change":"2023-11-15T01:21:37.075385+0000","last_active":"2023-11-15T01:21:37.079526+0000","last_peered":"2023-11-15T01:21:37.079526+0000","last_clean":"2023-11-15T01:21:37.079526+0000","last_became_active":"2023-11-15T01:21:37.075019+0000","last_became_peered":"2023-11-15T01:21:37.075019+0000","last_unstale":"2023-11-15T01:21:37.079526+0000","last_undegraded":"2023-11-15T01:21:37.079526+0000","last_fullsized":"2023-11-15T01:21:37.079526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.067378+0000","last_change":"2023-11-15T01:21:36.674279+0000","last_active":"2023-11-15T01:21:37.067378+0000","last_peered":"2023-11-15T01:21:37.067378+0000","last_clean":"2023-11-15T01:21:37.067378+0000","last_became_active":"2023-11-15T01:21:36.673988+0000","last_became_peered":"2023-11-15T01:21:36.673988+0000","last_unstale":"2023-11-15T01:21:37.067378+0000","last_undegraded":"2023-11-15T01:21:37.067378+0000","last_fullsized":"2023-11-15T01:21:37.067378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.069329+0000","last_change":"2023-11-15T01:21:37.065238+0000","last_active":"2023-11-15T01:21:37.069329+0000","last_peered":"2023-11-15T01:21:37.069329+0000","last_clean":"2023-11-15T01:21:37.069329+0000","last_became_active":"2023-11-15T01:21:37.064939+0000","last_became_peered":"2023-11-15T01:21:37.064939+0000","last_unstale":"2023-11-15T01:21:37.069329+0000","last_undegraded":"2023-11-15T01:21:37.069329+0000","last_fullsized":"2023-11-15T01:21:37.069329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054633+0000","last_change":"2023-11-15T01:21:36.683715+0000","last_active":"2023-11-15T01:21:37.054633+0000","last_peered":"2023-11-15T01:21:37.054633+0000","last_clean":"2023-11-15T01:21:37.054633+0000","last_became_active":"2023-11-15T01:21:36.683268+0000","last_became_peered":"2023-11-15T01:21:36.683268+0000","last_unstale":"2023-11-15T01:21:37.054633+0000","last_undegraded":"2023-11-15T01:21:37.054633+0000","last_fullsized":"2023-11-15T01:21:37.054633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075490+0000","last_change":"2023-11-15T01:21:37.070543+0000","last_active":"2023-11-15T01:21:37.075490+0000","last_peered":"2023-11-15T01:21:37.075490+0000","last_clean":"2023-11-15T01:21:37.075490+0000","last_became_active":"2023-11-15T01:21:37.069750+0000","last_became_peered":"2023-11-15T01:21:37.069750+0000","last_unstale":"2023-11-15T01:21:37.075490+0000","last_undegraded":"2023-11-15T01:21:37.075490+0000","last_fullsized":"2023-11-15T01:21:37.075490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051998+0000","last_change":"2023-11-15T01:21:36.677974+0000","last_active":"2023-11-15T01:21:37.051998+0000","last_peered":"2023-11-15T01:21:37.051998+0000","last_clean":"2023-11-15T01:21:37.051998+0000","last_became_active":"2023-11-15T01:21:36.677594+0000","last_became_peered":"2023-11-15T01:21:36.677594+0000","last_unstale":"2023-11-15T01:21:37.051998+0000","last_undegraded":"2023-11-15T01:21:37.051998+0000","last_fullsized":"2023-11-15T01:21:37.051998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072732+0000","last_change":"2023-11-15T01:21:37.070356+0000","last_active":"2023-11-15T01:21:37.072732+0000","last_peered":"2023-11-15T01:21:37.072732+0000","last_clean":"2023-11-15T01:21:37.072732+0000","last_became_active":"2023-11-15T01:21:37.070072+0000","last_became_peered":"2023-11-15T01:21:37.070072+0000","last_unstale":"2023-11-15T01:21:37.072732+0000","last_undegraded":"2023-11-15T01:21:37.072732+0000","last_fullsized":"2023-11-15T01:21:37.072732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076470+0000","last_change":"2023-11-15T01:21:36.671536+0000","last_active":"2023-11-15T01:21:37.076470+0000","last_peered":"2023-11-15T01:21:37.076470+0000","last_clean":"2023-11-15T01:21:37.076470+0000","last_became_active":"2023-11-15T01:21:36.671247+0000","last_became_peered":"2023-11-15T01:21:36.671247+0000","last_unstale":"2023-11-15T01:21:37.076470+0000","last_undegraded":"2023-11-15T01:21:37.076470+0000","last_fullsized":"2023-11-15T01:21:37.076470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072659+0000","last_change":"2023-11-15T01:21:37.069675+0000","last_active":"2023-11-15T01:21:37.072659+0000","last_peered":"2023-11-15T01:21:37.072659+0000","last_clean":"2023-11-15T01:21:37.072659+0000","last_became_active":"2023-11-15T01:21:37.069397+0000","last_became_peered":"2023-11-15T01:21:37.069397+0000","last_unstale":"2023-11-15T01:21:37.072659+0000","last_undegraded":"2023-11-15T01:21:37.072659+0000","last_fullsized":"2023-11-15T01:21:37.072659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081458+0000","last_change":"2023-11-15T01:21:36.673107+0000","last_active":"2023-11-15T01:21:37.081458+0000","last_peered":"2023-11-15T01:21:37.081458+0000","last_clean":"2023-11-15T01:21:37.081458+0000","last_became_active":"2023-11-15T01:21:36.672803+0000","last_became_peered":"2023-11-15T01:21:36.672803+0000","last_unstale":"2023-11-15T01:21:37.081458+0000","last_undegraded":"2023-11-15T01:21:37.081458+0000","last_fullsized":"2023-11-15T01:21:37.081458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.069571+0000","last_change":"2023-11-15T01:21:37.066878+0000","last_active":"2023-11-15T01:21:37.069571+0000","last_peered":"2023-11-15T01:21:37.069571+0000","last_clean":"2023-11-15T01:21:37.069571+0000","last_became_active":"2023-11-15T01:21:37.066577+0000","last_became_peered":"2023-11-15T01:21:37.066577+0000","last_unstale":"2023-11-15T01:21:37.069571+0000","last_undegraded":"2023-11-15T01:21:37.069571+0000","last_fullsized":"2023-11-15T01:21:37.069571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054855+0000","last_change":"2023-11-15T01:21:36.681159+0000","last_active":"2023-11-15T01:21:37.054855+0000","last_peered":"2023-11-15T01:21:37.054855+0000","last_clean":"2023-11-15T01:21:37.054855+0000","last_became_active":"2023-11-15T01:21:36.680906+0000","last_became_peered":"2023-11-15T01:21:36.680906+0000","last_unstale":"2023-11-15T01:21:37.054855+0000","last_undegraded":"2023-11-15T01:21:37.054855+0000","last_fullsized":"2023-11-15T01:21:37.054855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078486+0000","last_change":"2023-11-15T01:21:37.074210+0000","last_active":"2023-11-15T01:21:37.078486+0000","last_peered":"2023-11-15T01:21:37.078486+0000","last_clean":"2023-11-15T01:21:37.078486+0000","last_became_active":"2023-11-15T01:21:37.073943+0000","last_became_peered":"2023-11-15T01:21:37.073943+0000","last_unstale":"2023-11-15T01:21:37.078486+0000","last_undegraded":"2023-11-15T01:21:37.078486+0000","last_fullsized":"2023-11-15T01:21:37.078486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053463+0000","last_change":"2023-11-15T01:21:36.679911+0000","last_active":"2023-11-15T01:21:37.053463+0000","last_peered":"2023-11-15T01:21:37.053463+0000","last_clean":"2023-11-15T01:21:37.053463+0000","last_became_active":"2023-11-15T01:21:36.679272+0000","last_became_peered":"2023-11-15T01:21:36.679272+0000","last_unstale":"2023-11-15T01:21:37.053463+0000","last_undegraded":"2023-11-15T01:21:37.053463+0000","last_fullsized":"2023-11-15T01:21:37.053463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073109+0000","last_change":"2023-11-15T01:21:37.068769+0000","last_active":"2023-11-15T01:21:37.073109+0000","last_peered":"2023-11-15T01:21:37.073109+0000","last_clean":"2023-11-15T01:21:37.073109+0000","last_became_active":"2023-11-15T01:21:37.068495+0000","last_became_peered":"2023-11-15T01:21:37.068495+0000","last_unstale":"2023-11-15T01:21:37.073109+0000","last_undegraded":"2023-11-15T01:21:37.073109+0000","last_fullsized":"2023-11-15T01:21:37.073109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060975+0000","last_change":"2023-11-15T01:21:36.683620+0000","last_active":"2023-11-15T01:21:37.060975+0000","last_peered":"2023-11-15T01:21:37.060975+0000","last_clean":"2023-11-15T01:21:37.060975+0000","last_became_active":"2023-11-15T01:21:36.683315+0000","last_became_peered":"2023-11-15T01:21:36.683315+0000","last_unstale":"2023-11-15T01:21:37.060975+0000","last_undegraded":"2023-11-15T01:21:37.060975+0000","last_fullsized":"2023-11-15T01:21:37.060975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079966+0000","last_change":"2023-11-15T01:21:37.078896+0000","last_active":"2023-11-15T01:21:37.079966+0000","last_peered":"2023-11-15T01:21:37.079966+0000","last_clean":"2023-11-15T01:21:37.079966+0000","last_became_active":"2023-11-15T01:21:37.078569+0000","last_became_peered":"2023-11-15T01:21:37.078569+0000","last_unstale":"2023-11-15T01:21:37.079966+0000","last_undegraded":"2023-11-15T01:21:37.079966+0000","last_fullsized":"2023-11-15T01:21:37.079966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061034+0000","last_change":"2023-11-15T01:21:36.670706+0000","last_active":"2023-11-15T01:21:37.061034+0000","last_peered":"2023-11-15T01:21:37.061034+0000","last_clean":"2023-11-15T01:21:37.061034+0000","last_became_active":"2023-11-15T01:21:36.670059+0000","last_became_peered":"2023-11-15T01:21:36.670059+0000","last_unstale":"2023-11-15T01:21:37.061034+0000","last_undegraded":"2023-11-15T01:21:37.061034+0000","last_fullsized":"2023-11-15T01:21:37.061034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.071946+0000","last_change":"2023-11-15T01:21:37.067713+0000","last_active":"2023-11-15T01:21:37.071946+0000","last_peered":"2023-11-15T01:21:37.071946+0000","last_clean":"2023-11-15T01:21:37.071946+0000","last_became_active":"2023-11-15T01:21:37.067395+0000","last_became_peered":"2023-11-15T01:21:37.067395+0000","last_unstale":"2023-11-15T01:21:37.071946+0000","last_undegraded":"2023-11-15T01:21:37.071946+0000","last_fullsized":"2023-11-15T01:21:37.071946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060748+0000","last_change":"2023-11-15T01:21:36.682781+0000","last_active":"2023-11-15T01:21:37.060748+0000","last_peered":"2023-11-15T01:21:37.060748+0000","last_clean":"2023-11-15T01:21:37.060748+0000","last_became_active":"2023-11-15T01:21:36.682480+0000","last_became_peered":"2023-11-15T01:21:36.682480+0000","last_unstale":"2023-11-15T01:21:37.060748+0000","last_undegraded":"2023-11-15T01:21:37.060748+0000","last_fullsized":"2023-11-15T01:21:37.060748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075509+0000","last_change":"2023-11-15T01:21:37.070705+0000","last_active":"2023-11-15T01:21:37.075509+0000","last_peered":"2023-11-15T01:21:37.075509+0000","last_clean":"2023-11-15T01:21:37.075509+0000","last_became_active":"2023-11-15T01:21:37.070269+0000","last_became_peered":"2023-11-15T01:21:37.070269+0000","last_unstale":"2023-11-15T01:21:37.075509+0000","last_undegraded":"2023-11-15T01:21:37.075509+0000","last_fullsized":"2023-11-15T01:21:37.075509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.066310+0000","last_change":"2023-11-15T01:21:36.681917+0000","last_active":"2023-11-15T01:21:37.066310+0000","last_peered":"2023-11-15T01:21:37.066310+0000","last_clean":"2023-11-15T01:21:37.066310+0000","last_became_active":"2023-11-15T01:21:36.681664+0000","last_became_peered":"2023-11-15T01:21:36.681664+0000","last_unstale":"2023-11-15T01:21:37.066310+0000","last_undegraded":"2023-11-15T01:21:37.066310+0000","last_fullsized":"2023-11-15T01:21:37.066310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061299+0000","last_change":"2023-11-15T01:21:37.056524+0000","last_active":"2023-11-15T01:21:37.061299+0000","last_peered":"2023-11-15T01:21:37.061299+0000","last_clean":"2023-11-15T01:21:37.061299+0000","last_became_active":"2023-11-15T01:21:37.056115+0000","last_became_peered":"2023-11-15T01:21:37.056115+0000","last_unstale":"2023-11-15T01:21:37.061299+0000","last_undegraded":"2023-11-15T01:21:37.061299+0000","last_fullsized":"2023-11-15T01:21:37.061299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076222+0000","last_change":"2023-11-15T01:21:36.675434+0000","last_active":"2023-11-15T01:21:37.076222+0000","last_peered":"2023-11-15T01:21:37.076222+0000","last_clean":"2023-11-15T01:21:37.076222+0000","last_became_active":"2023-11-15T01:21:36.675152+0000","last_became_peered":"2023-11-15T01:21:36.675152+0000","last_unstale":"2023-11-15T01:21:37.076222+0000","last_undegraded":"2023-11-15T01:21:37.076222+0000","last_fullsized":"2023-11-15T01:21:37.076222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.080142+0000","last_change":"2023-11-15T01:21:37.077249+0000","last_active":"2023-11-15T01:21:37.080142+0000","last_peered":"2023-11-15T01:21:37.080142+0000","last_clean":"2023-11-15T01:21:37.080142+0000","last_became_active":"2023-11-15T01:21:37.077009+0000","last_became_peered":"2023-11-15T01:21:37.077009+0000","last_unstale":"2023-11-15T01:21:37.080142+0000","last_undegraded":"2023-11-15T01:21:37.080142+0000","last_fullsized":"2023-11-15T01:21:37.080142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072218+0000","last_change":"2023-11-15T01:21:36.675491+0000","last_active":"2023-11-15T01:21:37.072218+0000","last_peered":"2023-11-15T01:21:37.072218+0000","last_clean":"2023-11-15T01:21:37.072218+0000","last_became_active":"2023-11-15T01:21:36.673535+0000","last_became_peered":"2023-11-15T01:21:36.673535+0000","last_unstale":"2023-11-15T01:21:37.072218+0000","last_undegraded":"2023-11-15T01:21:37.072218+0000","last_fullsized":"2023-11-15T01:21:37.072218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075938+0000","last_change":"2023-11-15T01:21:37.072360+0000","last_active":"2023-11-15T01:21:37.075938+0000","last_peered":"2023-11-15T01:21:37.075938+0000","last_clean":"2023-11-15T01:21:37.075938+0000","last_became_active":"2023-11-15T01:21:37.070013+0000","last_became_peered":"2023-11-15T01:21:37.070013+0000","last_unstale":"2023-11-15T01:21:37.075938+0000","last_undegraded":"2023-11-15T01:21:37.075938+0000","last_fullsized":"2023-11-15T01:21:37.075938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051462+0000","last_change":"2023-11-15T01:21:36.674145+0000","last_active":"2023-11-15T01:21:37.051462+0000","last_peered":"2023-11-15T01:21:37.051462+0000","last_clean":"2023-11-15T01:21:37.051462+0000","last_became_active":"2023-11-15T01:21:36.673862+0000","last_became_peered":"2023-11-15T01:21:36.673862+0000","last_unstale":"2023-11-15T01:21:37.051462+0000","last_undegraded":"2023-11-15T01:21:37.051462+0000","last_fullsized":"2023-11-15T01:21:37.051462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078508+0000","last_change":"2023-11-15T01:21:37.074359+0000","last_active":"2023-11-15T01:21:37.078508+0000","last_peered":"2023-11-15T01:21:37.078508+0000","last_clean":"2023-11-15T01:21:37.078508+0000","last_became_active":"2023-11-15T01:21:37.073936+0000","last_became_peered":"2023-11-15T01:21:37.073936+0000","last_unstale":"2023-11-15T01:21:37.078508+0000","last_undegraded":"2023-11-15T01:21:37.078508+0000","last_fullsized":"2023-11-15T01:21:37.078508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.055113+0000","last_change":"2023-11-15T01:21:36.681422+0000","last_active":"2023-11-15T01:21:37.055113+0000","last_peered":"2023-11-15T01:21:37.055113+0000","last_clean":"2023-11-15T01:21:37.055113+0000","last_became_active":"2023-11-15T01:21:36.680717+0000","last_became_peered":"2023-11-15T01:21:36.680717+0000","last_unstale":"2023-11-15T01:21:37.055113+0000","last_undegraded":"2023-11-15T01:21:37.055113+0000","last_fullsized":"2023-11-15T01:21:37.055113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073014+0000","last_change":"2023-11-15T01:21:37.071820+0000","last_active":"2023-11-15T01:21:37.073014+0000","last_peered":"2023-11-15T01:21:37.073014+0000","last_clean":"2023-11-15T01:21:37.073014+0000","last_became_active":"2023-11-15T01:21:37.071521+0000","last_became_peered":"2023-11-15T01:21:37.071521+0000","last_unstale":"2023-11-15T01:21:37.073014+0000","last_undegraded":"2023-11-15T01:21:37.073014+0000","last_fullsized":"2023-11-15T01:21:37.073014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076301+0000","last_change":"2023-11-15T01:21:36.676437+0000","last_active":"2023-11-15T01:21:37.076301+0000","last_peered":"2023-11-15T01:21:37.076301+0000","last_clean":"2023-11-15T01:21:37.076301+0000","last_became_active":"2023-11-15T01:21:36.676128+0000","last_became_peered":"2023-11-15T01:21:36.676128+0000","last_unstale":"2023-11-15T01:21:37.076301+0000","last_undegraded":"2023-11-15T01:21:37.076301+0000","last_fullsized":"2023-11-15T01:21:37.076301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297348,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074492,"statfs":{"total":96636764160,"available":96332279808,"internally_reserved":0,"allocated":258048,"data_stored":86755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297340,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074500,"statfs":{"total":96636764160,"available":96332288000,"internally_reserved":0,"allocated":249856,"data_stored":86933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:21:41.093 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:21:41.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.243+0000 7f2d28baa700 1 Processor -- start 2023-11-15T01:21:41.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.243+0000 7f2d28baa700 1 -- start start 2023-11-15T01:21:41.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.244+0000 7f2d28baa700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2d24151e10 0x7f2d24155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.244+0000 7f2d28baa700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d240c7980 con 0x7f2d240c86b0 2023-11-15T01:21:41.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.244+0000 7f2d28baa700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d240c8b10 con 0x7f2d240c98b0 2023-11-15T01:21:41.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.244+0000 7f2d28baa700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d240aa890 con 0x7f2d24151e10 2023-11-15T01:21:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.244+0000 7f2d22ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2d240c86b0 0x7f2d240aa0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58096/0 (socket says 172.21.15.1:58096) 2023-11-15T01:21:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.244+0000 7f2d22ffd700 1 -- 172.21.15.1:0/1221023006 learned_addr learned my addr 172.21.15.1:0/1221023006 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.244+0000 7f2d237fe700 1 --2- 172.21.15.1:0/1221023006 >> v2:172.21.15.141:3300/0 conn(0x7f2d24151e10 0x7f2d24155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.244+0000 7f2d227fc700 1 -- 172.21.15.1:0/1221023006 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307850275 0 0) 0x7f2d240c7980 con 0x7f2d240c86b0 2023-11-15T01:21:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.244+0000 7f2d227fc700 1 -- 172.21.15.1:0/1221023006 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d0c0033f0 con 0x7f2d240c86b0 2023-11-15T01:21:41.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.244+0000 7f2d227fc700 1 -- 172.21.15.1:0/1221023006 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 626613018 0 0) 0x7f2d0c0033f0 con 0x7f2d240c86b0 2023-11-15T01:21:41.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.244+0000 7f2d227fc700 1 -- 172.21.15.1:0/1221023006 >> v2:172.21.15.141:3300/0 conn(0x7f2d24151e10 msgr2=0x7f2d24155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:41.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.244+0000 7f2d227fc700 1 --2- 172.21.15.1:0/1221023006 >> v2:172.21.15.141:3300/0 conn(0x7f2d24151e10 0x7f2d24155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.244+0000 7f2d227fc700 1 -- 172.21.15.1:0/1221023006 >> v1:172.21.15.141:6789/0 conn(0x7f2d240c98b0 legacy=0x7f2d240c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d227fc700 1 -- 172.21.15.1:0/1221023006 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d240c7bd0 con 0x7f2d240c86b0 2023-11-15T01:21:41.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d227fc700 1 -- 172.21.15.1:0/1221023006 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f2d18001470 con 0x7f2d240c86b0 2023-11-15T01:21:41.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d227fc700 1 -- 172.21.15.1:0/1221023006 >> v1:172.21.15.1:6789/0 conn(0x7f2d240c86b0 legacy=0x7f2d240aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d227fc700 1 --2- 172.21.15.1:0/1221023006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d0c0038e0 0x7f2d0c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d227fc700 1 --2- 172.21.15.1:0/1221023006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d0c004690 0x7f2d0c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d227fc700 1 --2- 172.21.15.1:0/1221023006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d0c005000 0x7f2d0c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d227fc700 1 -- 172.21.15.1:0/1221023006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d240aa890 con 0x7f2d0c005000 2023-11-15T01:21:41.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d227fc700 1 -- 172.21.15.1:0/1221023006 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c00bf60 con 0x7f2d0c004690 2023-11-15T01:21:41.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d227fc700 1 -- 172.21.15.1:0/1221023006 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c00c0f0 con 0x7f2d0c0038e0 2023-11-15T01:21:41.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d23fff700 1 --2- 172.21.15.1:0/1221023006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d0c005000 0x7f2d0c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d22ffd700 1 --2- 172.21.15.1:0/1221023006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d0c004690 0x7f2d0c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d237fe700 1 --2- 172.21.15.1:0/1221023006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d0c0038e0 0x7f2d0c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d23fff700 1 -- 172.21.15.1:0/1221023006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d0c0038e0 msgr2=0x7f2d0c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d23fff700 1 --2- 172.21.15.1:0/1221023006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d0c0038e0 0x7f2d0c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d23fff700 1 -- 172.21.15.1:0/1221023006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d0c004690 msgr2=0x7f2d0c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d23fff700 1 --2- 172.21.15.1:0/1221023006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d0c004690 0x7f2d0c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d23fff700 1 -- 172.21.15.1:0/1221023006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c0033f0 con 0x7f2d0c005000 2023-11-15T01:21:41.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d237fe700 1 --2- 172.21.15.1:0/1221023006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d0c0038e0 0x7f2d0c003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:41.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d23fff700 1 -- 172.21.15.1:0/1221023006 reap_dead start 2023-11-15T01:21:41.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d23fff700 1 --2- 172.21.15.1:0/1221023006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d0c005000 0x7f2d0c00b8e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f2d1c001e30 tx=0x7f2d1c007f30).ready entity=mon.0 client_cookie=b6e9e32d8edebc77 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:41.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d227fc700 1 -- 172.21.15.1:0/1221023006 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c006a20 con 0x7f2d0c005000 2023-11-15T01:21:41.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d227fc700 1 -- 172.21.15.1:0/1221023006 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c006b80 con 0x7f2d0c005000 2023-11-15T01:21:41.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.245+0000 7f2d227fc700 1 -- 172.21.15.1:0/1221023006 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c00c5d0 con 0x7f2d0c005000 2023-11-15T01:21:41.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.246+0000 7f2d28baa700 1 -- 172.21.15.1:0/1221023006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d0c005000 msgr2=0x7f2d0c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.246+0000 7f2d28baa700 1 --2- 172.21.15.1:0/1221023006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d0c005000 0x7f2d0c00b8e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f2d1c001e30 tx=0x7f2d1c007f30).stop 2023-11-15T01:21:41.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.246+0000 7f2d28baa700 1 -- 172.21.15.1:0/1221023006 shutdown_connections 2023-11-15T01:21:41.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.246+0000 7f2d28baa700 1 --2- 172.21.15.1:0/1221023006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d0c005000 0x7f2d0c00b8e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.246+0000 7f2d28baa700 1 -- 172.21.15.1:0/1221023006 >> 172.21.15.1:0/1221023006 conn(0x7f2d240947e0 msgr2=0x7f2d2406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:41.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.246+0000 7f2d28baa700 1 -- 172.21.15.1:0/1221023006 shutdown_connections 2023-11-15T01:21:41.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.246+0000 7f2d28baa700 1 -- 172.21.15.1:0/1221023006 wait complete. 2023-11-15T01:21:41.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.247+0000 7f2d28baa700 1 Processor -- start 2023-11-15T01:21:41.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.247+0000 7f2d28baa700 1 -- start start 2023-11-15T01:21:41.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d28baa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d0c005000 0x7f2d24096cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d28baa700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d240971e0 0x7f2d240af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d28baa700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d240af590 0x7f2d240afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d28baa700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d24098670 con 0x7f2d240af590 2023-11-15T01:21:41.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d28baa700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d240aff00 con 0x7f2d240971e0 2023-11-15T01:21:41.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d28baa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d240b09f0 con 0x7f2d0c005000 2023-11-15T01:21:41.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d23fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d240af590 0x7f2d240afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d23fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d240af590 0x7f2d240afa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54752/0 (socket says 172.21.15.1:54752) 2023-11-15T01:21:41.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d23fff700 1 -- 172.21.15.1:0/2267163113 learned_addr learned my addr 172.21.15.1:0/2267163113 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:41.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d237fe700 1 --2- 172.21.15.1:0/2267163113 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d0c005000 0x7f2d24096cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d22ffd700 1 --2- 172.21.15.1:0/2267163113 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d240971e0 0x7f2d240af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d23fff700 1 -- 172.21.15.1:0/2267163113 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d0c005000 msgr2=0x7f2d24096cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d23fff700 1 --2- 172.21.15.1:0/2267163113 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d0c005000 0x7f2d24096cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d23fff700 1 -- 172.21.15.1:0/2267163113 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d240971e0 msgr2=0x7f2d240af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d23fff700 1 --2- 172.21.15.1:0/2267163113 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d240971e0 0x7f2d240af0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d23fff700 1 -- 172.21.15.1:0/2267163113 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d24097a60 con 0x7f2d240af590 2023-11-15T01:21:41.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.248+0000 7f2d23fff700 1 --2- 172.21.15.1:0/2267163113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d240af590 0x7f2d240afa10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f2d1c009000 tx=0x7f2d1c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:41.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.249+0000 7f2d0b7fe700 1 -- 172.21.15.1:0/2267163113 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c00c5d0 con 0x7f2d240af590 2023-11-15T01:21:41.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.249+0000 7f2d0b7fe700 1 -- 172.21.15.1:0/2267163113 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c013b50 con 0x7f2d240af590 2023-11-15T01:21:41.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.249+0000 7f2d28baa700 1 -- 172.21.15.1:0/2267163113 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d24097d40 con 0x7f2d240af590 2023-11-15T01:21:41.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.249+0000 7f2d0b7fe700 1 -- 172.21.15.1:0/2267163113 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c006a20 con 0x7f2d240af590 2023-11-15T01:21:41.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.249+0000 7f2d28baa700 1 -- 172.21.15.1:0/2267163113 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d24098300 con 0x7f2d240af590 2023-11-15T01:21:41.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.250+0000 7f2d28baa700 1 -- 172.21.15.1:0/2267163113 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d240475e0 con 0x7f2d240af590 2023-11-15T01:21:41.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.250+0000 7f2d0b7fe700 1 -- 172.21.15.1:0/2267163113 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2d1c01d680 con 0x7f2d240af590 2023-11-15T01:21:41.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.251+0000 7f2d0b7fe700 1 --2- 172.21.15.1:0/2267163113 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2d1005f150 0x7f2d10061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.251+0000 7f2d0b7fe700 1 -- 172.21.15.1:0/2267163113 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2d1c07b8d0 con 0x7f2d240af590 2023-11-15T01:21:41.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.251+0000 7f2d237fe700 1 --2- 172.21.15.1:0/2267163113 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2d1005f150 0x7f2d10061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.251+0000 7f2d237fe700 1 --2- 172.21.15.1:0/2267163113 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2d1005f150 0x7f2d10061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2d14006f70 tx=0x7f2d14008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:41.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.255+0000 7f2d0b7fe700 1 -- 172.21.15.1:0/2267163113 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2d1c04cba0 con 0x7f2d240af590 2023-11-15T01:21:41.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.424+0000 7f2d28baa700 1 -- 172.21.15.1:0/2267163113 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d240984f0 con 0x7f2d1005f150 2023-11-15T01:21:41.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.434+0000 7f2d0b7fe700 1 -- 172.21.15.1:0/2267163113 <== mgr.4103 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336351 (secure 0 0 0) 0x7f2d140097f0 con 0x7f2d1005f150 2023-11-15T01:21:41.438 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:41.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.437+0000 7f2d28baa700 1 -- 172.21.15.1:0/2267163113 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2d1005f150 msgr2=0x7f2d10061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.437+0000 7f2d28baa700 1 --2- 172.21.15.1:0/2267163113 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2d1005f150 0x7f2d10061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2d14006f70 tx=0x7f2d14008040).stop 2023-11-15T01:21:41.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.437+0000 7f2d28baa700 1 -- 172.21.15.1:0/2267163113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d240af590 msgr2=0x7f2d240afa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.437+0000 7f2d28baa700 1 --2- 172.21.15.1:0/2267163113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d240af590 0x7f2d240afa10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f2d1c009000 tx=0x7f2d1c016000).stop 2023-11-15T01:21:41.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.437+0000 7f2d28baa700 1 -- 172.21.15.1:0/2267163113 shutdown_connections 2023-11-15T01:21:41.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.437+0000 7f2d28baa700 1 --2- 172.21.15.1:0/2267163113 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2d1005f150 0x7f2d10061610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.437+0000 7f2d28baa700 1 --2- 172.21.15.1:0/2267163113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d240af590 0x7f2d240afa10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.437+0000 7f2d28baa700 1 --2- 172.21.15.1:0/2267163113 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d0c005000 0x7f2d24096cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.437+0000 7f2d28baa700 1 --2- 172.21.15.1:0/2267163113 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d240971e0 0x7f2d240af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.437+0000 7f2d28baa700 1 -- 172.21.15.1:0/2267163113 >> 172.21.15.1:0/2267163113 conn(0x7f2d240947e0 msgr2=0x7f2d24153180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:41.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.437+0000 7f2d28baa700 1 -- 172.21.15.1:0/2267163113 shutdown_connections 2023-11-15T01:21:41.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.437+0000 7f2d28baa700 1 -- 172.21.15.1:0/2267163113 wait complete. 2023-11-15T01:21:41.443 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:21:41.449 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-15T01:21:39.757902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378624,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596096,"statfs":{"total":773094113280,"available":770658402304,"internally_reserved":0,"allocated":1900544,"data_stored":687340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076736+0000","last_change":"2023-11-15T01:21:37.070154+0000","last_active":"2023-11-15T01:21:37.076736+0000","last_peered":"2023-11-15T01:21:37.076736+0000","last_clean":"2023-11-15T01:21:37.076736+0000","last_became_active":"2023-11-15T01:21:37.069444+0000","last_became_peered":"2023-11-15T01:21:37.069444+0000","last_unstale":"2023-11-15T01:21:37.076736+0000","last_undegraded":"2023-11-15T01:21:37.076736+0000","last_fullsized":"2023-11-15T01:21:37.076736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.064539+0000","last_change":"2023-11-15T01:21:36.678192+0000","last_active":"2023-11-15T01:21:37.064539+0000","last_peered":"2023-11-15T01:21:37.064539+0000","last_clean":"2023-11-15T01:21:37.064539+0000","last_became_active":"2023-11-15T01:21:36.677205+0000","last_became_peered":"2023-11-15T01:21:36.677205+0000","last_unstale":"2023-11-15T01:21:37.064539+0000","last_undegraded":"2023-11-15T01:21:37.064539+0000","last_fullsized":"2023-11-15T01:21:37.064539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.068262+0000","last_change":"2023-11-15T01:21:37.064541+0000","last_active":"2023-11-15T01:21:37.068262+0000","last_peered":"2023-11-15T01:21:37.068262+0000","last_clean":"2023-11-15T01:21:37.068262+0000","last_became_active":"2023-11-15T01:21:37.064244+0000","last_became_peered":"2023-11-15T01:21:37.064244+0000","last_unstale":"2023-11-15T01:21:37.068262+0000","last_undegraded":"2023-11-15T01:21:37.068262+0000","last_fullsized":"2023-11-15T01:21:37.068262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054518+0000","last_change":"2023-11-15T01:21:36.683547+0000","last_active":"2023-11-15T01:21:37.054518+0000","last_peered":"2023-11-15T01:21:37.054518+0000","last_clean":"2023-11-15T01:21:37.054518+0000","last_became_active":"2023-11-15T01:21:36.682979+0000","last_became_peered":"2023-11-15T01:21:36.682979+0000","last_unstale":"2023-11-15T01:21:37.054518+0000","last_undegraded":"2023-11-15T01:21:37.054518+0000","last_fullsized":"2023-11-15T01:21:37.054518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073255+0000","last_change":"2023-11-15T01:21:37.067297+0000","last_active":"2023-11-15T01:21:37.073255+0000","last_peered":"2023-11-15T01:21:37.073255+0000","last_clean":"2023-11-15T01:21:37.073255+0000","last_became_active":"2023-11-15T01:21:37.066997+0000","last_became_peered":"2023-11-15T01:21:37.066997+0000","last_unstale":"2023-11-15T01:21:37.073255+0000","last_undegraded":"2023-11-15T01:21:37.073255+0000","last_fullsized":"2023-11-15T01:21:37.073255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058796+0000","last_change":"2023-11-15T01:21:36.679373+0000","last_active":"2023-11-15T01:21:37.058796+0000","last_peered":"2023-11-15T01:21:37.058796+0000","last_clean":"2023-11-15T01:21:37.058796+0000","last_became_active":"2023-11-15T01:21:36.678627+0000","last_became_peered":"2023-11-15T01:21:36.678627+0000","last_unstale":"2023-11-15T01:21:37.058796+0000","last_undegraded":"2023-11-15T01:21:37.058796+0000","last_fullsized":"2023-11-15T01:21:37.058796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076950+0000","last_change":"2023-11-15T01:21:37.074270+0000","last_active":"2023-11-15T01:21:37.076950+0000","last_peered":"2023-11-15T01:21:37.076950+0000","last_clean":"2023-11-15T01:21:37.076950+0000","last_became_active":"2023-11-15T01:21:37.073966+0000","last_became_peered":"2023-11-15T01:21:37.073966+0000","last_unstale":"2023-11-15T01:21:37.076950+0000","last_undegraded":"2023-11-15T01:21:37.076950+0000","last_fullsized":"2023-11-15T01:21:37.076950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.052916+0000","last_change":"2023-11-15T01:21:36.679676+0000","last_active":"2023-11-15T01:21:37.052916+0000","last_peered":"2023-11-15T01:21:37.052916+0000","last_clean":"2023-11-15T01:21:37.052916+0000","last_became_active":"2023-11-15T01:21:36.679444+0000","last_became_peered":"2023-11-15T01:21:36.679444+0000","last_unstale":"2023-11-15T01:21:37.052916+0000","last_undegraded":"2023-11-15T01:21:37.052916+0000","last_fullsized":"2023-11-15T01:21:37.052916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077396+0000","last_change":"2023-11-15T01:21:37.075345+0000","last_active":"2023-11-15T01:21:37.077396+0000","last_peered":"2023-11-15T01:21:37.077396+0000","last_clean":"2023-11-15T01:21:37.077396+0000","last_became_active":"2023-11-15T01:21:37.074940+0000","last_became_peered":"2023-11-15T01:21:37.074940+0000","last_unstale":"2023-11-15T01:21:37.077396+0000","last_undegraded":"2023-11-15T01:21:37.077396+0000","last_fullsized":"2023-11-15T01:21:37.077396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059141+0000","last_change":"2023-11-15T01:21:36.675726+0000","last_active":"2023-11-15T01:21:37.059141+0000","last_peered":"2023-11-15T01:21:37.059141+0000","last_clean":"2023-11-15T01:21:37.059141+0000","last_became_active":"2023-11-15T01:21:36.675370+0000","last_became_peered":"2023-11-15T01:21:36.675370+0000","last_unstale":"2023-11-15T01:21:37.059141+0000","last_undegraded":"2023-11-15T01:21:37.059141+0000","last_fullsized":"2023-11-15T01:21:37.059141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073310+0000","last_change":"2023-11-15T01:21:37.071192+0000","last_active":"2023-11-15T01:21:37.073310+0000","last_peered":"2023-11-15T01:21:37.073310+0000","last_clean":"2023-11-15T01:21:37.073310+0000","last_became_active":"2023-11-15T01:21:37.070894+0000","last_became_peered":"2023-11-15T01:21:37.070894+0000","last_unstale":"2023-11-15T01:21:37.073310+0000","last_undegraded":"2023-11-15T01:21:37.073310+0000","last_fullsized":"2023-11-15T01:21:37.073310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077678+0000","last_change":"2023-11-15T01:21:36.678243+0000","last_active":"2023-11-15T01:21:37.077678+0000","last_peered":"2023-11-15T01:21:37.077678+0000","last_clean":"2023-11-15T01:21:37.077678+0000","last_became_active":"2023-11-15T01:21:36.675596+0000","last_became_peered":"2023-11-15T01:21:36.675596+0000","last_unstale":"2023-11-15T01:21:37.077678+0000","last_undegraded":"2023-11-15T01:21:37.077678+0000","last_fullsized":"2023-11-15T01:21:37.077678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075581+0000","last_change":"2023-11-15T01:21:37.070789+0000","last_active":"2023-11-15T01:21:37.075581+0000","last_peered":"2023-11-15T01:21:37.075581+0000","last_clean":"2023-11-15T01:21:37.075581+0000","last_became_active":"2023-11-15T01:21:37.070474+0000","last_became_peered":"2023-11-15T01:21:37.070474+0000","last_unstale":"2023-11-15T01:21:37.075581+0000","last_undegraded":"2023-11-15T01:21:37.075581+0000","last_fullsized":"2023-11-15T01:21:37.075581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077420+0000","last_change":"2023-11-15T01:21:36.681355+0000","last_active":"2023-11-15T01:21:37.077420+0000","last_peered":"2023-11-15T01:21:37.077420+0000","last_clean":"2023-11-15T01:21:37.077420+0000","last_became_active":"2023-11-15T01:21:36.681062+0000","last_became_peered":"2023-11-15T01:21:36.681062+0000","last_unstale":"2023-11-15T01:21:37.077420+0000","last_undegraded":"2023-11-15T01:21:37.077420+0000","last_fullsized":"2023-11-15T01:21:37.077420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076571+0000","last_change":"2023-11-15T01:21:37.069662+0000","last_active":"2023-11-15T01:21:37.076571+0000","last_peered":"2023-11-15T01:21:37.076571+0000","last_clean":"2023-11-15T01:21:37.076571+0000","last_became_active":"2023-11-15T01:21:37.069329+0000","last_became_peered":"2023-11-15T01:21:37.069329+0000","last_unstale":"2023-11-15T01:21:37.076571+0000","last_undegraded":"2023-11-15T01:21:37.076571+0000","last_fullsized":"2023-11-15T01:21:37.076571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076355+0000","last_change":"2023-11-15T01:21:36.678012+0000","last_active":"2023-11-15T01:21:37.076355+0000","last_peered":"2023-11-15T01:21:37.076355+0000","last_clean":"2023-11-15T01:21:37.076355+0000","last_became_active":"2023-11-15T01:21:36.677738+0000","last_became_peered":"2023-11-15T01:21:36.677738+0000","last_unstale":"2023-11-15T01:21:37.076355+0000","last_undegraded":"2023-11-15T01:21:37.076355+0000","last_fullsized":"2023-11-15T01:21:37.076355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081186+0000","last_change":"2023-11-15T01:21:37.077200+0000","last_active":"2023-11-15T01:21:37.081186+0000","last_peered":"2023-11-15T01:21:37.081186+0000","last_clean":"2023-11-15T01:21:37.081186+0000","last_became_active":"2023-11-15T01:21:37.076903+0000","last_became_peered":"2023-11-15T01:21:37.076903+0000","last_unstale":"2023-11-15T01:21:37.081186+0000","last_undegraded":"2023-11-15T01:21:37.081186+0000","last_fullsized":"2023-11-15T01:21:37.081186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051933+0000","last_change":"2023-11-15T01:21:36.673362+0000","last_active":"2023-11-15T01:21:37.051933+0000","last_peered":"2023-11-15T01:21:37.051933+0000","last_clean":"2023-11-15T01:21:37.051933+0000","last_became_active":"2023-11-15T01:21:36.671321+0000","last_became_peered":"2023-11-15T01:21:36.671321+0000","last_unstale":"2023-11-15T01:21:37.051933+0000","last_undegraded":"2023-11-15T01:21:37.051933+0000","last_fullsized":"2023-11-15T01:21:37.051933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078495+0000","last_change":"2023-11-15T01:21:37.071120+0000","last_active":"2023-11-15T01:21:37.078495+0000","last_peered":"2023-11-15T01:21:37.078495+0000","last_clean":"2023-11-15T01:21:37.078495+0000","last_became_active":"2023-11-15T01:21:37.070850+0000","last_became_peered":"2023-11-15T01:21:37.070850+0000","last_unstale":"2023-11-15T01:21:37.078495+0000","last_undegraded":"2023-11-15T01:21:37.078495+0000","last_fullsized":"2023-11-15T01:21:37.078495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060633+0000","last_change":"2023-11-15T01:21:36.681424+0000","last_active":"2023-11-15T01:21:37.060633+0000","last_peered":"2023-11-15T01:21:37.060633+0000","last_clean":"2023-11-15T01:21:37.060633+0000","last_became_active":"2023-11-15T01:21:36.680976+0000","last_became_peered":"2023-11-15T01:21:36.680976+0000","last_unstale":"2023-11-15T01:21:37.060633+0000","last_undegraded":"2023-11-15T01:21:37.060633+0000","last_fullsized":"2023-11-15T01:21:37.060633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081471+0000","last_change":"2023-11-15T01:21:37.079474+0000","last_active":"2023-11-15T01:21:37.081471+0000","last_peered":"2023-11-15T01:21:37.081471+0000","last_clean":"2023-11-15T01:21:37.081471+0000","last_became_active":"2023-11-15T01:21:37.078060+0000","last_became_peered":"2023-11-15T01:21:37.078060+0000","last_unstale":"2023-11-15T01:21:37.081471+0000","last_undegraded":"2023-11-15T01:21:37.081471+0000","last_fullsized":"2023-11-15T01:21:37.081471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061716+0000","last_change":"2023-11-15T01:21:36.674722+0000","last_active":"2023-11-15T01:21:37.061716+0000","last_peered":"2023-11-15T01:21:37.061716+0000","last_clean":"2023-11-15T01:21:37.061716+0000","last_became_active":"2023-11-15T01:21:36.674350+0000","last_became_peered":"2023-11-15T01:21:36.674350+0000","last_unstale":"2023-11-15T01:21:37.061716+0000","last_undegraded":"2023-11-15T01:21:37.061716+0000","last_fullsized":"2023-11-15T01:21:37.061716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.070132+0000","last_change":"2023-11-15T01:21:37.065467+0000","last_active":"2023-11-15T01:21:37.070132+0000","last_peered":"2023-11-15T01:21:37.070132+0000","last_clean":"2023-11-15T01:21:37.070132+0000","last_became_active":"2023-11-15T01:21:37.065154+0000","last_became_peered":"2023-11-15T01:21:37.065154+0000","last_unstale":"2023-11-15T01:21:37.070132+0000","last_undegraded":"2023-11-15T01:21:37.070132+0000","last_fullsized":"2023-11-15T01:21:37.070132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075966+0000","last_change":"2023-11-15T01:21:36.679946+0000","last_active":"2023-11-15T01:21:37.075966+0000","last_peered":"2023-11-15T01:21:37.075966+0000","last_clean":"2023-11-15T01:21:37.075966+0000","last_became_active":"2023-11-15T01:21:36.679643+0000","last_became_peered":"2023-11-15T01:21:36.679643+0000","last_unstale":"2023-11-15T01:21:37.075966+0000","last_undegraded":"2023-11-15T01:21:37.075966+0000","last_fullsized":"2023-11-15T01:21:37.075966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076313+0000","last_change":"2023-11-15T01:21:37.073362+0000","last_active":"2023-11-15T01:21:37.076313+0000","last_peered":"2023-11-15T01:21:37.076313+0000","last_clean":"2023-11-15T01:21:37.076313+0000","last_became_active":"2023-11-15T01:21:37.072950+0000","last_became_peered":"2023-11-15T01:21:37.072950+0000","last_unstale":"2023-11-15T01:21:37.076313+0000","last_undegraded":"2023-11-15T01:21:37.076313+0000","last_fullsized":"2023-11-15T01:21:37.076313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076535+0000","last_change":"2023-11-15T01:21:36.679282+0000","last_active":"2023-11-15T01:21:37.076535+0000","last_peered":"2023-11-15T01:21:37.076535+0000","last_clean":"2023-11-15T01:21:37.076535+0000","last_became_active":"2023-11-15T01:21:36.676942+0000","last_became_peered":"2023-11-15T01:21:36.676942+0000","last_unstale":"2023-11-15T01:21:37.076535+0000","last_undegraded":"2023-11-15T01:21:37.076535+0000","last_fullsized":"2023-11-15T01:21:37.076535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073625+0000","last_change":"2023-11-15T01:21:37.067894+0000","last_active":"2023-11-15T01:21:37.073625+0000","last_peered":"2023-11-15T01:21:37.073625+0000","last_clean":"2023-11-15T01:21:37.073625+0000","last_became_active":"2023-11-15T01:21:37.067199+0000","last_became_peered":"2023-11-15T01:21:37.067199+0000","last_unstale":"2023-11-15T01:21:37.073625+0000","last_undegraded":"2023-11-15T01:21:37.073625+0000","last_fullsized":"2023-11-15T01:21:37.073625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.064048+0000","last_change":"2023-11-15T01:21:36.682276+0000","last_active":"2023-11-15T01:21:37.064048+0000","last_peered":"2023-11-15T01:21:37.064048+0000","last_clean":"2023-11-15T01:21:37.064048+0000","last_became_active":"2023-11-15T01:21:36.681910+0000","last_became_peered":"2023-11-15T01:21:36.681910+0000","last_unstale":"2023-11-15T01:21:37.064048+0000","last_undegraded":"2023-11-15T01:21:37.064048+0000","last_fullsized":"2023-11-15T01:21:37.064048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075905+0000","last_change":"2023-11-15T01:21:37.068177+0000","last_active":"2023-11-15T01:21:37.075905+0000","last_peered":"2023-11-15T01:21:37.075905+0000","last_clean":"2023-11-15T01:21:37.075905+0000","last_became_active":"2023-11-15T01:21:37.067708+0000","last_became_peered":"2023-11-15T01:21:37.067708+0000","last_unstale":"2023-11-15T01:21:37.075905+0000","last_undegraded":"2023-11-15T01:21:37.075905+0000","last_fullsized":"2023-11-15T01:21:37.075905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058497+0000","last_change":"2023-11-15T01:21:36.674143+0000","last_active":"2023-11-15T01:21:37.058497+0000","last_peered":"2023-11-15T01:21:37.058497+0000","last_clean":"2023-11-15T01:21:37.058497+0000","last_became_active":"2023-11-15T01:21:36.673800+0000","last_became_peered":"2023-11-15T01:21:36.673800+0000","last_unstale":"2023-11-15T01:21:37.058497+0000","last_undegraded":"2023-11-15T01:21:37.058497+0000","last_fullsized":"2023-11-15T01:21:37.058497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075706+0000","last_change":"2023-11-15T01:21:37.071297+0000","last_active":"2023-11-15T01:21:37.075706+0000","last_peered":"2023-11-15T01:21:37.075706+0000","last_clean":"2023-11-15T01:21:37.075706+0000","last_became_active":"2023-11-15T01:21:37.070987+0000","last_became_peered":"2023-11-15T01:21:37.070987+0000","last_unstale":"2023-11-15T01:21:37.075706+0000","last_undegraded":"2023-11-15T01:21:37.075706+0000","last_fullsized":"2023-11-15T01:21:37.075706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079876+0000","last_change":"2023-11-15T01:21:36.679647+0000","last_active":"2023-11-15T01:21:37.079876+0000","last_peered":"2023-11-15T01:21:37.079876+0000","last_clean":"2023-11-15T01:21:37.079876+0000","last_became_active":"2023-11-15T01:21:36.679134+0000","last_became_peered":"2023-11-15T01:21:36.679134+0000","last_unstale":"2023-11-15T01:21:37.079876+0000","last_undegraded":"2023-11-15T01:21:37.079876+0000","last_fullsized":"2023-11-15T01:21:37.079876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075523+0000","last_change":"2023-11-15T01:21:37.071036+0000","last_active":"2023-11-15T01:21:37.075523+0000","last_peered":"2023-11-15T01:21:37.075523+0000","last_clean":"2023-11-15T01:21:37.075523+0000","last_became_active":"2023-11-15T01:21:37.070766+0000","last_became_peered":"2023-11-15T01:21:37.070766+0000","last_unstale":"2023-11-15T01:21:37.075523+0000","last_undegraded":"2023-11-15T01:21:37.075523+0000","last_fullsized":"2023-11-15T01:21:37.075523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053077+0000","last_change":"2023-11-15T01:21:36.677096+0000","last_active":"2023-11-15T01:21:37.053077+0000","last_peered":"2023-11-15T01:21:37.053077+0000","last_clean":"2023-11-15T01:21:37.053077+0000","last_became_active":"2023-11-15T01:21:36.676780+0000","last_became_peered":"2023-11-15T01:21:36.676780+0000","last_unstale":"2023-11-15T01:21:37.053077+0000","last_undegraded":"2023-11-15T01:21:37.053077+0000","last_fullsized":"2023-11-15T01:21:37.053077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075723+0000","last_change":"2023-11-15T01:21:37.071911+0000","last_active":"2023-11-15T01:21:37.075723+0000","last_peered":"2023-11-15T01:21:37.075723+0000","last_clean":"2023-11-15T01:21:37.075723+0000","last_became_active":"2023-11-15T01:21:37.071572+0000","last_became_peered":"2023-11-15T01:21:37.071572+0000","last_unstale":"2023-11-15T01:21:37.075723+0000","last_undegraded":"2023-11-15T01:21:37.075723+0000","last_fullsized":"2023-11-15T01:21:37.075723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061988+0000","last_change":"2023-11-15T01:21:36.665943+0000","last_active":"2023-11-15T01:21:37.061988+0000","last_peered":"2023-11-15T01:21:37.061988+0000","last_clean":"2023-11-15T01:21:37.061988+0000","last_became_active":"2023-11-15T01:21:36.663826+0000","last_became_peered":"2023-11-15T01:21:36.663826+0000","last_unstale":"2023-11-15T01:21:37.061988+0000","last_undegraded":"2023-11-15T01:21:37.061988+0000","last_fullsized":"2023-11-15T01:21:37.061988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079611+0000","last_change":"2023-11-15T01:21:37.078906+0000","last_active":"2023-11-15T01:21:37.079611+0000","last_peered":"2023-11-15T01:21:37.079611+0000","last_clean":"2023-11-15T01:21:37.079611+0000","last_became_active":"2023-11-15T01:21:37.078557+0000","last_became_peered":"2023-11-15T01:21:37.078557+0000","last_unstale":"2023-11-15T01:21:37.079611+0000","last_undegraded":"2023-11-15T01:21:37.079611+0000","last_fullsized":"2023-11-15T01:21:37.079611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060923+0000","last_change":"2023-11-15T01:21:36.684155+0000","last_active":"2023-11-15T01:21:37.060923+0000","last_peered":"2023-11-15T01:21:37.060923+0000","last_clean":"2023-11-15T01:21:37.060923+0000","last_became_active":"2023-11-15T01:21:36.683867+0000","last_became_peered":"2023-11-15T01:21:36.683867+0000","last_unstale":"2023-11-15T01:21:37.060923+0000","last_undegraded":"2023-11-15T01:21:37.060923+0000","last_fullsized":"2023-11-15T01:21:37.060923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.055130+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:21:37.055130+0000","last_peered":"2023-11-15T01:21:37.055130+0000","last_clean":"2023-11-15T01:21:37.055130+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:21:37.055130+0000","last_undegraded":"2023-11-15T01:21:37.055130+0000","last_fullsized":"2023-11-15T01:21:37.055130+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059501+0000","last_change":"2023-11-15T01:21:36.673900+0000","last_active":"2023-11-15T01:21:37.059501+0000","last_peered":"2023-11-15T01:21:37.059501+0000","last_clean":"2023-11-15T01:21:37.059501+0000","last_became_active":"2023-11-15T01:21:36.673523+0000","last_became_peered":"2023-11-15T01:21:36.673523+0000","last_unstale":"2023-11-15T01:21:37.059501+0000","last_undegraded":"2023-11-15T01:21:37.059501+0000","last_fullsized":"2023-11-15T01:21:37.059501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.066720+0000","last_change":"2023-11-15T01:21:37.065623+0000","last_active":"2023-11-15T01:21:37.066720+0000","last_peered":"2023-11-15T01:21:37.066720+0000","last_clean":"2023-11-15T01:21:37.066720+0000","last_became_active":"2023-11-15T01:21:37.065338+0000","last_became_peered":"2023-11-15T01:21:37.065338+0000","last_unstale":"2023-11-15T01:21:37.066720+0000","last_undegraded":"2023-11-15T01:21:37.066720+0000","last_fullsized":"2023-11-15T01:21:37.066720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058545+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:21:37.058545+0000","last_peered":"2023-11-15T01:21:37.058545+0000","last_clean":"2023-11-15T01:21:37.058545+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:21:37.058545+0000","last_undegraded":"2023-11-15T01:21:37.058545+0000","last_fullsized":"2023-11-15T01:21:37.058545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.065604+0000","last_change":"2023-11-15T01:21:36.675569+0000","last_active":"2023-11-15T01:21:37.065604+0000","last_peered":"2023-11-15T01:21:37.065604+0000","last_clean":"2023-11-15T01:21:37.065604+0000","last_became_active":"2023-11-15T01:21:36.675216+0000","last_became_peered":"2023-11-15T01:21:36.675216+0000","last_unstale":"2023-11-15T01:21:37.065604+0000","last_undegraded":"2023-11-15T01:21:37.065604+0000","last_fullsized":"2023-11-15T01:21:37.065604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.063934+0000","last_change":"2023-11-15T01:21:37.056059+0000","last_active":"2023-11-15T01:21:37.063934+0000","last_peered":"2023-11-15T01:21:37.063934+0000","last_clean":"2023-11-15T01:21:37.063934+0000","last_became_active":"2023-11-15T01:21:37.055792+0000","last_became_peered":"2023-11-15T01:21:37.055792+0000","last_unstale":"2023-11-15T01:21:37.063934+0000","last_undegraded":"2023-11-15T01:21:37.063934+0000","last_fullsized":"2023-11-15T01:21:37.063934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.066956+0000","last_change":"2023-11-15T01:21:37.066235+0000","last_active":"2023-11-15T01:21:37.066956+0000","last_peered":"2023-11-15T01:21:37.066956+0000","last_clean":"2023-11-15T01:21:37.066956+0000","last_became_active":"2023-11-15T01:21:37.066039+0000","last_became_peered":"2023-11-15T01:21:37.066039+0000","last_unstale":"2023-11-15T01:21:37.066956+0000","last_undegraded":"2023-11-15T01:21:37.066956+0000","last_fullsized":"2023-11-15T01:21:37.066956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.049466+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:21:37.049466+0000","last_peered":"2023-11-15T01:21:37.049466+0000","last_clean":"2023-11-15T01:21:37.049466+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:21:37.049466+0000","last_undegraded":"2023-11-15T01:21:37.049466+0000","last_fullsized":"2023-11-15T01:21:37.049466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054621+0000","last_change":"2023-11-15T01:21:36.675336+0000","last_active":"2023-11-15T01:21:37.054621+0000","last_peered":"2023-11-15T01:21:37.054621+0000","last_clean":"2023-11-15T01:21:37.054621+0000","last_became_active":"2023-11-15T01:21:36.675018+0000","last_became_peered":"2023-11-15T01:21:36.675018+0000","last_unstale":"2023-11-15T01:21:37.054621+0000","last_undegraded":"2023-11-15T01:21:37.054621+0000","last_fullsized":"2023-11-15T01:21:37.054621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075405+0000","last_change":"2023-11-15T01:21:37.072490+0000","last_active":"2023-11-15T01:21:37.075405+0000","last_peered":"2023-11-15T01:21:37.075405+0000","last_clean":"2023-11-15T01:21:37.075405+0000","last_became_active":"2023-11-15T01:21:37.072175+0000","last_became_peered":"2023-11-15T01:21:37.072175+0000","last_unstale":"2023-11-15T01:21:37.075405+0000","last_undegraded":"2023-11-15T01:21:37.075405+0000","last_fullsized":"2023-11-15T01:21:37.075405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058381+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:21:37.058381+0000","last_peered":"2023-11-15T01:21:37.058381+0000","last_clean":"2023-11-15T01:21:37.058381+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:21:37.058381+0000","last_undegraded":"2023-11-15T01:21:37.058381+0000","last_fullsized":"2023-11-15T01:21:37.058381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059508+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:21:37.059508+0000","last_peered":"2023-11-15T01:21:37.059508+0000","last_clean":"2023-11-15T01:21:37.059508+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:21:37.059508+0000","last_undegraded":"2023-11-15T01:21:37.059508+0000","last_fullsized":"2023-11-15T01:21:37.059508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059414+0000","last_change":"2023-11-15T01:21:36.679052+0000","last_active":"2023-11-15T01:21:37.059414+0000","last_peered":"2023-11-15T01:21:37.059414+0000","last_clean":"2023-11-15T01:21:37.059414+0000","last_became_active":"2023-11-15T01:21:36.678750+0000","last_became_peered":"2023-11-15T01:21:36.678750+0000","last_unstale":"2023-11-15T01:21:37.059414+0000","last_undegraded":"2023-11-15T01:21:37.059414+0000","last_fullsized":"2023-11-15T01:21:37.059414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075965+0000","last_change":"2023-11-15T01:21:37.068467+0000","last_active":"2023-11-15T01:21:37.075965+0000","last_peered":"2023-11-15T01:21:37.075965+0000","last_clean":"2023-11-15T01:21:37.075965+0000","last_became_active":"2023-11-15T01:21:37.068195+0000","last_became_peered":"2023-11-15T01:21:37.068195+0000","last_unstale":"2023-11-15T01:21:37.075965+0000","last_undegraded":"2023-11-15T01:21:37.075965+0000","last_fullsized":"2023-11-15T01:21:37.075965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059991+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:21:37.059991+0000","last_peered":"2023-11-15T01:21:37.059991+0000","last_clean":"2023-11-15T01:21:37.059991+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:21:37.059991+0000","last_undegraded":"2023-11-15T01:21:37.059991+0000","last_fullsized":"2023-11-15T01:21:37.059991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051461+0000","last_change":"2023-11-15T01:21:36.678021+0000","last_active":"2023-11-15T01:21:37.051461+0000","last_peered":"2023-11-15T01:21:37.051461+0000","last_clean":"2023-11-15T01:21:37.051461+0000","last_became_active":"2023-11-15T01:21:36.677747+0000","last_became_peered":"2023-11-15T01:21:36.677747+0000","last_unstale":"2023-11-15T01:21:37.051461+0000","last_undegraded":"2023-11-15T01:21:37.051461+0000","last_fullsized":"2023-11-15T01:21:37.051461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.064933+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:21:37.064933+0000","last_peered":"2023-11-15T01:21:37.064933+0000","last_clean":"2023-11-15T01:21:37.064933+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:21:37.064933+0000","last_undegraded":"2023-11-15T01:21:37.064933+0000","last_fullsized":"2023-11-15T01:21:37.064933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.055252+0000","last_change":"2023-11-15T01:21:36.675293+0000","last_active":"2023-11-15T01:21:37.055252+0000","last_peered":"2023-11-15T01:21:37.055252+0000","last_clean":"2023-11-15T01:21:37.055252+0000","last_became_active":"2023-11-15T01:21:36.674972+0000","last_became_peered":"2023-11-15T01:21:36.674972+0000","last_unstale":"2023-11-15T01:21:37.055252+0000","last_undegraded":"2023-11-15T01:21:37.055252+0000","last_fullsized":"2023-11-15T01:21:37.055252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075953+0000","last_change":"2023-11-15T01:21:37.069096+0000","last_active":"2023-11-15T01:21:37.075953+0000","last_peered":"2023-11-15T01:21:37.075953+0000","last_clean":"2023-11-15T01:21:37.075953+0000","last_became_active":"2023-11-15T01:21:37.068837+0000","last_became_peered":"2023-11-15T01:21:37.068837+0000","last_unstale":"2023-11-15T01:21:37.075953+0000","last_undegraded":"2023-11-15T01:21:37.075953+0000","last_fullsized":"2023-11-15T01:21:37.075953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.080003+0000","last_change":"2023-11-15T01:21:36.677731+0000","last_active":"2023-11-15T01:21:37.080003+0000","last_peered":"2023-11-15T01:21:37.080003+0000","last_clean":"2023-11-15T01:21:37.080003+0000","last_became_active":"2023-11-15T01:21:36.677473+0000","last_became_peered":"2023-11-15T01:21:36.677473+0000","last_unstale":"2023-11-15T01:21:37.080003+0000","last_undegraded":"2023-11-15T01:21:37.080003+0000","last_fullsized":"2023-11-15T01:21:37.080003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054763+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:21:37.054763+0000","last_peered":"2023-11-15T01:21:37.054763+0000","last_clean":"2023-11-15T01:21:37.054763+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:21:37.054763+0000","last_undegraded":"2023-11-15T01:21:37.054763+0000","last_fullsized":"2023-11-15T01:21:37.054763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076969+0000","last_change":"2023-11-15T01:21:37.074453+0000","last_active":"2023-11-15T01:21:37.076969+0000","last_peered":"2023-11-15T01:21:37.076969+0000","last_clean":"2023-11-15T01:21:37.076969+0000","last_became_active":"2023-11-15T01:21:37.074163+0000","last_became_peered":"2023-11-15T01:21:37.074163+0000","last_unstale":"2023-11-15T01:21:37.076969+0000","last_undegraded":"2023-11-15T01:21:37.076969+0000","last_fullsized":"2023-11-15T01:21:37.076969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054203+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:21:37.054203+0000","last_peered":"2023-11-15T01:21:37.054203+0000","last_clean":"2023-11-15T01:21:37.054203+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:21:37.054203+0000","last_undegraded":"2023-11-15T01:21:37.054203+0000","last_fullsized":"2023-11-15T01:21:37.054203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.052816+0000","last_change":"2023-11-15T01:21:36.677412+0000","last_active":"2023-11-15T01:21:37.052816+0000","last_peered":"2023-11-15T01:21:37.052816+0000","last_clean":"2023-11-15T01:21:37.052816+0000","last_became_active":"2023-11-15T01:21:36.677133+0000","last_became_peered":"2023-11-15T01:21:36.677133+0000","last_unstale":"2023-11-15T01:21:37.052816+0000","last_undegraded":"2023-11-15T01:21:37.052816+0000","last_fullsized":"2023-11-15T01:21:37.052816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076301+0000","last_change":"2023-11-15T01:21:37.073195+0000","last_active":"2023-11-15T01:21:37.076301+0000","last_peered":"2023-11-15T01:21:37.076301+0000","last_clean":"2023-11-15T01:21:37.076301+0000","last_became_active":"2023-11-15T01:21:37.069951+0000","last_became_peered":"2023-11-15T01:21:37.069951+0000","last_unstale":"2023-11-15T01:21:37.076301+0000","last_undegraded":"2023-11-15T01:21:37.076301+0000","last_fullsized":"2023-11-15T01:21:37.076301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060157+0000","last_change":"2023-11-15T01:21:37.056072+0000","last_active":"2023-11-15T01:21:37.060157+0000","last_peered":"2023-11-15T01:21:37.060157+0000","last_clean":"2023-11-15T01:21:37.060157+0000","last_became_active":"2023-11-15T01:21:37.055787+0000","last_became_peered":"2023-11-15T01:21:37.055787+0000","last_unstale":"2023-11-15T01:21:37.060157+0000","last_undegraded":"2023-11-15T01:21:37.060157+0000","last_fullsized":"2023-11-15T01:21:37.060157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051906+0000","last_change":"2023-11-15T01:21:36.672485+0000","last_active":"2023-11-15T01:21:37.051906+0000","last_peered":"2023-11-15T01:21:37.051906+0000","last_clean":"2023-11-15T01:21:37.051906+0000","last_became_active":"2023-11-15T01:21:36.672099+0000","last_became_peered":"2023-11-15T01:21:36.672099+0000","last_unstale":"2023-11-15T01:21:37.051906+0000","last_undegraded":"2023-11-15T01:21:37.051906+0000","last_fullsized":"2023-11-15T01:21:37.051906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081012+0000","last_change":"2023-11-15T01:21:37.077263+0000","last_active":"2023-11-15T01:21:37.081012+0000","last_peered":"2023-11-15T01:21:37.081012+0000","last_clean":"2023-11-15T01:21:37.081012+0000","last_became_active":"2023-11-15T01:21:37.076981+0000","last_became_peered":"2023-11-15T01:21:37.076981+0000","last_unstale":"2023-11-15T01:21:37.081012+0000","last_undegraded":"2023-11-15T01:21:37.081012+0000","last_fullsized":"2023-11-15T01:21:37.081012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058603+0000","last_change":"2023-11-15T01:21:36.677251+0000","last_active":"2023-11-15T01:21:37.058603+0000","last_peered":"2023-11-15T01:21:37.058603+0000","last_clean":"2023-11-15T01:21:37.058603+0000","last_became_active":"2023-11-15T01:21:36.676955+0000","last_became_peered":"2023-11-15T01:21:36.676955+0000","last_unstale":"2023-11-15T01:21:37.058603+0000","last_undegraded":"2023-11-15T01:21:37.058603+0000","last_fullsized":"2023-11-15T01:21:37.058603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075958+0000","last_change":"2023-11-15T01:21:37.073688+0000","last_active":"2023-11-15T01:21:37.075958+0000","last_peered":"2023-11-15T01:21:37.075958+0000","last_clean":"2023-11-15T01:21:37.075958+0000","last_became_active":"2023-11-15T01:21:37.073409+0000","last_became_peered":"2023-11-15T01:21:37.073409+0000","last_unstale":"2023-11-15T01:21:37.075958+0000","last_undegraded":"2023-11-15T01:21:37.075958+0000","last_fullsized":"2023-11-15T01:21:37.075958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073464+0000","last_change":"2023-11-15T01:21:36.675358+0000","last_active":"2023-11-15T01:21:37.073464+0000","last_peered":"2023-11-15T01:21:37.073464+0000","last_clean":"2023-11-15T01:21:37.073464+0000","last_became_active":"2023-11-15T01:21:36.675089+0000","last_became_peered":"2023-11-15T01:21:36.675089+0000","last_unstale":"2023-11-15T01:21:37.073464+0000","last_undegraded":"2023-11-15T01:21:37.073464+0000","last_fullsized":"2023-11-15T01:21:37.073464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077044+0000","last_change":"2023-11-15T01:21:37.074975+0000","last_active":"2023-11-15T01:21:37.077044+0000","last_peered":"2023-11-15T01:21:37.077044+0000","last_clean":"2023-11-15T01:21:37.077044+0000","last_became_active":"2023-11-15T01:21:37.068659+0000","last_became_peered":"2023-11-15T01:21:37.068659+0000","last_unstale":"2023-11-15T01:21:37.077044+0000","last_undegraded":"2023-11-15T01:21:37.077044+0000","last_fullsized":"2023-11-15T01:21:37.077044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.074074+0000","last_change":"2023-11-15T01:21:36.672628+0000","last_active":"2023-11-15T01:21:37.074074+0000","last_peered":"2023-11-15T01:21:37.074074+0000","last_clean":"2023-11-15T01:21:37.074074+0000","last_became_active":"2023-11-15T01:21:36.672235+0000","last_became_peered":"2023-11-15T01:21:36.672235+0000","last_unstale":"2023-11-15T01:21:37.074074+0000","last_undegraded":"2023-11-15T01:21:37.074074+0000","last_fullsized":"2023-11-15T01:21:37.074074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078770+0000","last_change":"2023-11-15T01:21:37.075172+0000","last_active":"2023-11-15T01:21:37.078770+0000","last_peered":"2023-11-15T01:21:37.078770+0000","last_clean":"2023-11-15T01:21:37.078770+0000","last_became_active":"2023-11-15T01:21:37.074844+0000","last_became_peered":"2023-11-15T01:21:37.074844+0000","last_unstale":"2023-11-15T01:21:37.078770+0000","last_undegraded":"2023-11-15T01:21:37.078770+0000","last_fullsized":"2023-11-15T01:21:37.078770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.070348+0000","last_change":"2023-11-15T01:21:36.681248+0000","last_active":"2023-11-15T01:21:37.070348+0000","last_peered":"2023-11-15T01:21:37.070348+0000","last_clean":"2023-11-15T01:21:37.070348+0000","last_became_active":"2023-11-15T01:21:36.680875+0000","last_became_peered":"2023-11-15T01:21:36.680875+0000","last_unstale":"2023-11-15T01:21:37.070348+0000","last_undegraded":"2023-11-15T01:21:37.070348+0000","last_fullsized":"2023-11-15T01:21:37.070348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072884+0000","last_change":"2023-11-15T01:21:37.070426+0000","last_active":"2023-11-15T01:21:37.072884+0000","last_peered":"2023-11-15T01:21:37.072884+0000","last_clean":"2023-11-15T01:21:37.072884+0000","last_became_active":"2023-11-15T01:21:37.070158+0000","last_became_peered":"2023-11-15T01:21:37.070158+0000","last_unstale":"2023-11-15T01:21:37.072884+0000","last_undegraded":"2023-11-15T01:21:37.072884+0000","last_fullsized":"2023-11-15T01:21:37.072884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053859+0000","last_change":"2023-11-15T01:21:36.674583+0000","last_active":"2023-11-15T01:21:37.053859+0000","last_peered":"2023-11-15T01:21:37.053859+0000","last_clean":"2023-11-15T01:21:37.053859+0000","last_became_active":"2023-11-15T01:21:36.674002+0000","last_became_peered":"2023-11-15T01:21:36.674002+0000","last_unstale":"2023-11-15T01:21:37.053859+0000","last_undegraded":"2023-11-15T01:21:37.053859+0000","last_fullsized":"2023-11-15T01:21:37.053859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.065776+0000","last_change":"2023-11-15T01:21:37.061993+0000","last_active":"2023-11-15T01:21:37.065776+0000","last_peered":"2023-11-15T01:21:37.065776+0000","last_clean":"2023-11-15T01:21:37.065776+0000","last_became_active":"2023-11-15T01:21:37.061379+0000","last_became_peered":"2023-11-15T01:21:37.061379+0000","last_unstale":"2023-11-15T01:21:37.065776+0000","last_undegraded":"2023-11-15T01:21:37.065776+0000","last_fullsized":"2023-11-15T01:21:37.065776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.049508+0000","last_change":"2023-11-15T01:21:36.666739+0000","last_active":"2023-11-15T01:21:37.049508+0000","last_peered":"2023-11-15T01:21:37.049508+0000","last_clean":"2023-11-15T01:21:37.049508+0000","last_became_active":"2023-11-15T01:21:36.666437+0000","last_became_peered":"2023-11-15T01:21:36.666437+0000","last_unstale":"2023-11-15T01:21:37.049508+0000","last_undegraded":"2023-11-15T01:21:37.049508+0000","last_fullsized":"2023-11-15T01:21:37.049508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.069514+0000","last_change":"2023-11-15T01:21:37.066195+0000","last_active":"2023-11-15T01:21:37.069514+0000","last_peered":"2023-11-15T01:21:37.069514+0000","last_clean":"2023-11-15T01:21:37.069514+0000","last_became_active":"2023-11-15T01:21:37.065915+0000","last_became_peered":"2023-11-15T01:21:37.065915+0000","last_unstale":"2023-11-15T01:21:37.069514+0000","last_undegraded":"2023-11-15T01:21:37.069514+0000","last_fullsized":"2023-11-15T01:21:37.069514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058395+0000","last_change":"2023-11-15T01:21:36.674457+0000","last_active":"2023-11-15T01:21:37.058395+0000","last_peered":"2023-11-15T01:21:37.058395+0000","last_clean":"2023-11-15T01:21:37.058395+0000","last_became_active":"2023-11-15T01:21:36.673479+0000","last_became_peered":"2023-11-15T01:21:36.673479+0000","last_unstale":"2023-11-15T01:21:37.058395+0000","last_undegraded":"2023-11-15T01:21:37.058395+0000","last_fullsized":"2023-11-15T01:21:37.058395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077664+0000","last_change":"2023-11-15T01:21:37.076770+0000","last_active":"2023-11-15T01:21:37.077664+0000","last_peered":"2023-11-15T01:21:37.077664+0000","last_clean":"2023-11-15T01:21:37.077664+0000","last_became_active":"2023-11-15T01:21:37.076474+0000","last_became_peered":"2023-11-15T01:21:37.076474+0000","last_unstale":"2023-11-15T01:21:37.077664+0000","last_undegraded":"2023-11-15T01:21:37.077664+0000","last_fullsized":"2023-11-15T01:21:37.077664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.052293+0000","last_change":"2023-11-15T01:21:36.677057+0000","last_active":"2023-11-15T01:21:37.052293+0000","last_peered":"2023-11-15T01:21:37.052293+0000","last_clean":"2023-11-15T01:21:37.052293+0000","last_became_active":"2023-11-15T01:21:36.676765+0000","last_became_peered":"2023-11-15T01:21:36.676765+0000","last_unstale":"2023-11-15T01:21:37.052293+0000","last_undegraded":"2023-11-15T01:21:37.052293+0000","last_fullsized":"2023-11-15T01:21:37.052293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079468+0000","last_change":"2023-11-15T01:21:37.077300+0000","last_active":"2023-11-15T01:21:37.079468+0000","last_peered":"2023-11-15T01:21:37.079468+0000","last_clean":"2023-11-15T01:21:37.079468+0000","last_became_active":"2023-11-15T01:21:37.076992+0000","last_became_peered":"2023-11-15T01:21:37.076992+0000","last_unstale":"2023-11-15T01:21:37.079468+0000","last_undegraded":"2023-11-15T01:21:37.079468+0000","last_fullsized":"2023-11-15T01:21:37.079468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059811+0000","last_change":"2023-11-15T01:21:36.675721+0000","last_active":"2023-11-15T01:21:37.059811+0000","last_peered":"2023-11-15T01:21:37.059811+0000","last_clean":"2023-11-15T01:21:37.059811+0000","last_became_active":"2023-11-15T01:21:36.675435+0000","last_became_peered":"2023-11-15T01:21:36.675435+0000","last_unstale":"2023-11-15T01:21:37.059811+0000","last_undegraded":"2023-11-15T01:21:37.059811+0000","last_fullsized":"2023-11-15T01:21:37.059811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078780+0000","last_change":"2023-11-15T01:21:37.075242+0000","last_active":"2023-11-15T01:21:37.078780+0000","last_peered":"2023-11-15T01:21:37.078780+0000","last_clean":"2023-11-15T01:21:37.078780+0000","last_became_active":"2023-11-15T01:21:37.074425+0000","last_became_peered":"2023-11-15T01:21:37.074425+0000","last_unstale":"2023-11-15T01:21:37.078780+0000","last_undegraded":"2023-11-15T01:21:37.078780+0000","last_fullsized":"2023-11-15T01:21:37.078780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054580+0000","last_change":"2023-11-15T01:21:36.682853+0000","last_active":"2023-11-15T01:21:37.054580+0000","last_peered":"2023-11-15T01:21:37.054580+0000","last_clean":"2023-11-15T01:21:37.054580+0000","last_became_active":"2023-11-15T01:21:36.682482+0000","last_became_peered":"2023-11-15T01:21:36.682482+0000","last_unstale":"2023-11-15T01:21:37.054580+0000","last_undegraded":"2023-11-15T01:21:37.054580+0000","last_fullsized":"2023-11-15T01:21:37.054580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077027+0000","last_change":"2023-11-15T01:21:37.069868+0000","last_active":"2023-11-15T01:21:37.077027+0000","last_peered":"2023-11-15T01:21:37.077027+0000","last_clean":"2023-11-15T01:21:37.077027+0000","last_became_active":"2023-11-15T01:21:37.069367+0000","last_became_peered":"2023-11-15T01:21:37.069367+0000","last_unstale":"2023-11-15T01:21:37.077027+0000","last_undegraded":"2023-11-15T01:21:37.077027+0000","last_fullsized":"2023-11-15T01:21:37.077027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053509+0000","last_change":"2023-11-15T01:21:36.676621+0000","last_active":"2023-11-15T01:21:37.053509+0000","last_peered":"2023-11-15T01:21:37.053509+0000","last_clean":"2023-11-15T01:21:37.053509+0000","last_became_active":"2023-11-15T01:21:36.676340+0000","last_became_peered":"2023-11-15T01:21:36.676340+0000","last_unstale":"2023-11-15T01:21:37.053509+0000","last_undegraded":"2023-11-15T01:21:37.053509+0000","last_fullsized":"2023-11-15T01:21:37.053509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061469+0000","last_change":"2023-11-15T01:21:37.056801+0000","last_active":"2023-11-15T01:21:37.061469+0000","last_peered":"2023-11-15T01:21:37.061469+0000","last_clean":"2023-11-15T01:21:37.061469+0000","last_became_active":"2023-11-15T01:21:37.056479+0000","last_became_peered":"2023-11-15T01:21:37.056479+0000","last_unstale":"2023-11-15T01:21:37.061469+0000","last_undegraded":"2023-11-15T01:21:37.061469+0000","last_fullsized":"2023-11-15T01:21:37.061469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061145+0000","last_change":"2023-11-15T01:21:36.677083+0000","last_active":"2023-11-15T01:21:37.061145+0000","last_peered":"2023-11-15T01:21:37.061145+0000","last_clean":"2023-11-15T01:21:37.061145+0000","last_became_active":"2023-11-15T01:21:36.675792+0000","last_became_peered":"2023-11-15T01:21:36.675792+0000","last_unstale":"2023-11-15T01:21:37.061145+0000","last_undegraded":"2023-11-15T01:21:37.061145+0000","last_fullsized":"2023-11-15T01:21:37.061145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.080375+0000","last_change":"2023-11-15T01:21:37.079437+0000","last_active":"2023-11-15T01:21:37.080375+0000","last_peered":"2023-11-15T01:21:37.080375+0000","last_clean":"2023-11-15T01:21:37.080375+0000","last_became_active":"2023-11-15T01:21:37.079183+0000","last_became_peered":"2023-11-15T01:21:37.079183+0000","last_unstale":"2023-11-15T01:21:37.080375+0000","last_undegraded":"2023-11-15T01:21:37.080375+0000","last_fullsized":"2023-11-15T01:21:37.080375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.057734+0000","last_change":"2023-11-15T01:21:36.674125+0000","last_active":"2023-11-15T01:21:37.057734+0000","last_peered":"2023-11-15T01:21:37.057734+0000","last_clean":"2023-11-15T01:21:37.057734+0000","last_became_active":"2023-11-15T01:21:36.673791+0000","last_became_peered":"2023-11-15T01:21:36.673791+0000","last_unstale":"2023-11-15T01:21:37.057734+0000","last_undegraded":"2023-11-15T01:21:37.057734+0000","last_fullsized":"2023-11-15T01:21:37.057734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075073+0000","last_change":"2023-11-15T01:21:37.069603+0000","last_active":"2023-11-15T01:21:37.075073+0000","last_peered":"2023-11-15T01:21:37.075073+0000","last_clean":"2023-11-15T01:21:37.075073+0000","last_became_active":"2023-11-15T01:21:37.069301+0000","last_became_peered":"2023-11-15T01:21:37.069301+0000","last_unstale":"2023-11-15T01:21:37.075073+0000","last_undegraded":"2023-11-15T01:21:37.075073+0000","last_fullsized":"2023-11-15T01:21:37.075073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060017+0000","last_change":"2023-11-15T01:21:36.676838+0000","last_active":"2023-11-15T01:21:37.060017+0000","last_peered":"2023-11-15T01:21:37.060017+0000","last_clean":"2023-11-15T01:21:37.060017+0000","last_became_active":"2023-11-15T01:21:36.676039+0000","last_became_peered":"2023-11-15T01:21:36.676039+0000","last_unstale":"2023-11-15T01:21:37.060017+0000","last_undegraded":"2023-11-15T01:21:37.060017+0000","last_fullsized":"2023-11-15T01:21:37.060017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060317+0000","last_change":"2023-11-15T01:21:37.056702+0000","last_active":"2023-11-15T01:21:37.060317+0000","last_peered":"2023-11-15T01:21:37.060317+0000","last_clean":"2023-11-15T01:21:37.060317+0000","last_became_active":"2023-11-15T01:21:37.056436+0000","last_became_peered":"2023-11-15T01:21:37.056436+0000","last_unstale":"2023-11-15T01:21:37.060317+0000","last_undegraded":"2023-11-15T01:21:37.060317+0000","last_fullsized":"2023-11-15T01:21:37.060317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058643+0000","last_change":"2023-11-15T01:21:36.678350+0000","last_active":"2023-11-15T01:21:37.058643+0000","last_peered":"2023-11-15T01:21:37.058643+0000","last_clean":"2023-11-15T01:21:37.058643+0000","last_became_active":"2023-11-15T01:21:36.678106+0000","last_became_peered":"2023-11-15T01:21:36.678106+0000","last_unstale":"2023-11-15T01:21:37.058643+0000","last_undegraded":"2023-11-15T01:21:37.058643+0000","last_fullsized":"2023-11-15T01:21:37.058643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075725+0000","last_change":"2023-11-15T01:21:37.071814+0000","last_active":"2023-11-15T01:21:37.075725+0000","last_peered":"2023-11-15T01:21:37.075725+0000","last_clean":"2023-11-15T01:21:37.075725+0000","last_became_active":"2023-11-15T01:21:37.071482+0000","last_became_peered":"2023-11-15T01:21:37.071482+0000","last_unstale":"2023-11-15T01:21:37.075725+0000","last_undegraded":"2023-11-15T01:21:37.075725+0000","last_fullsized":"2023-11-15T01:21:37.075725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076465+0000","last_change":"2023-11-15T01:21:36.680865+0000","last_active":"2023-11-15T01:21:37.076465+0000","last_peered":"2023-11-15T01:21:37.076465+0000","last_clean":"2023-11-15T01:21:37.076465+0000","last_became_active":"2023-11-15T01:21:36.680498+0000","last_became_peered":"2023-11-15T01:21:36.680498+0000","last_unstale":"2023-11-15T01:21:37.076465+0000","last_undegraded":"2023-11-15T01:21:37.076465+0000","last_fullsized":"2023-11-15T01:21:37.076465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081144+0000","last_change":"2023-11-15T01:21:37.076900+0000","last_active":"2023-11-15T01:21:37.081144+0000","last_peered":"2023-11-15T01:21:37.081144+0000","last_clean":"2023-11-15T01:21:37.081144+0000","last_became_active":"2023-11-15T01:21:37.076617+0000","last_became_peered":"2023-11-15T01:21:37.076617+0000","last_unstale":"2023-11-15T01:21:37.081144+0000","last_undegraded":"2023-11-15T01:21:37.081144+0000","last_fullsized":"2023-11-15T01:21:37.081144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053970+0000","last_change":"2023-11-15T01:21:36.677040+0000","last_active":"2023-11-15T01:21:37.053970+0000","last_peered":"2023-11-15T01:21:37.053970+0000","last_clean":"2023-11-15T01:21:37.053970+0000","last_became_active":"2023-11-15T01:21:36.676736+0000","last_became_peered":"2023-11-15T01:21:36.676736+0000","last_unstale":"2023-11-15T01:21:37.053970+0000","last_undegraded":"2023-11-15T01:21:37.053970+0000","last_fullsized":"2023-11-15T01:21:37.053970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075883+0000","last_change":"2023-11-15T01:21:37.068055+0000","last_active":"2023-11-15T01:21:37.075883+0000","last_peered":"2023-11-15T01:21:37.075883+0000","last_clean":"2023-11-15T01:21:37.075883+0000","last_became_active":"2023-11-15T01:21:37.067786+0000","last_became_peered":"2023-11-15T01:21:37.067786+0000","last_unstale":"2023-11-15T01:21:37.075883+0000","last_undegraded":"2023-11-15T01:21:37.075883+0000","last_fullsized":"2023-11-15T01:21:37.075883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076413+0000","last_change":"2023-11-15T01:21:36.675927+0000","last_active":"2023-11-15T01:21:37.076413+0000","last_peered":"2023-11-15T01:21:37.076413+0000","last_clean":"2023-11-15T01:21:37.076413+0000","last_became_active":"2023-11-15T01:21:36.675286+0000","last_became_peered":"2023-11-15T01:21:36.675286+0000","last_unstale":"2023-11-15T01:21:37.076413+0000","last_undegraded":"2023-11-15T01:21:37.076413+0000","last_fullsized":"2023-11-15T01:21:37.076413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077009+0000","last_change":"2023-11-15T01:21:37.069678+0000","last_active":"2023-11-15T01:21:37.077009+0000","last_peered":"2023-11-15T01:21:37.077009+0000","last_clean":"2023-11-15T01:21:37.077009+0000","last_became_active":"2023-11-15T01:21:37.069017+0000","last_became_peered":"2023-11-15T01:21:37.069017+0000","last_unstale":"2023-11-15T01:21:37.077009+0000","last_undegraded":"2023-11-15T01:21:37.077009+0000","last_fullsized":"2023-11-15T01:21:37.077009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.050814+0000","last_change":"2023-11-15T01:21:36.672474+0000","last_active":"2023-11-15T01:21:37.050814+0000","last_peered":"2023-11-15T01:21:37.050814+0000","last_clean":"2023-11-15T01:21:37.050814+0000","last_became_active":"2023-11-15T01:21:36.672186+0000","last_became_peered":"2023-11-15T01:21:36.672186+0000","last_unstale":"2023-11-15T01:21:37.050814+0000","last_undegraded":"2023-11-15T01:21:37.050814+0000","last_fullsized":"2023-11-15T01:21:37.050814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078455+0000","last_change":"2023-11-15T01:21:37.074607+0000","last_active":"2023-11-15T01:21:37.078455+0000","last_peered":"2023-11-15T01:21:37.078455+0000","last_clean":"2023-11-15T01:21:37.078455+0000","last_became_active":"2023-11-15T01:21:37.074310+0000","last_became_peered":"2023-11-15T01:21:37.074310+0000","last_unstale":"2023-11-15T01:21:37.078455+0000","last_undegraded":"2023-11-15T01:21:37.078455+0000","last_fullsized":"2023-11-15T01:21:37.078455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060400+0000","last_change":"2023-11-15T01:21:36.677133+0000","last_active":"2023-11-15T01:21:37.060400+0000","last_peered":"2023-11-15T01:21:37.060400+0000","last_clean":"2023-11-15T01:21:37.060400+0000","last_became_active":"2023-11-15T01:21:36.676843+0000","last_became_peered":"2023-11-15T01:21:36.676843+0000","last_unstale":"2023-11-15T01:21:37.060400+0000","last_undegraded":"2023-11-15T01:21:37.060400+0000","last_fullsized":"2023-11-15T01:21:37.060400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079526+0000","last_change":"2023-11-15T01:21:37.075385+0000","last_active":"2023-11-15T01:21:37.079526+0000","last_peered":"2023-11-15T01:21:37.079526+0000","last_clean":"2023-11-15T01:21:37.079526+0000","last_became_active":"2023-11-15T01:21:37.075019+0000","last_became_peered":"2023-11-15T01:21:37.075019+0000","last_unstale":"2023-11-15T01:21:37.079526+0000","last_undegraded":"2023-11-15T01:21:37.079526+0000","last_fullsized":"2023-11-15T01:21:37.079526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.067378+0000","last_change":"2023-11-15T01:21:36.674279+0000","last_active":"2023-11-15T01:21:37.067378+0000","last_peered":"2023-11-15T01:21:37.067378+0000","last_clean":"2023-11-15T01:21:37.067378+0000","last_became_active":"2023-11-15T01:21:36.673988+0000","last_became_peered":"2023-11-15T01:21:36.673988+0000","last_unstale":"2023-11-15T01:21:37.067378+0000","last_undegraded":"2023-11-15T01:21:37.067378+0000","last_fullsized":"2023-11-15T01:21:37.067378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.069329+0000","last_change":"2023-11-15T01:21:37.065238+0000","last_active":"2023-11-15T01:21:37.069329+0000","last_peered":"2023-11-15T01:21:37.069329+0000","last_clean":"2023-11-15T01:21:37.069329+0000","last_became_active":"2023-11-15T01:21:37.064939+0000","last_became_peered":"2023-11-15T01:21:37.064939+0000","last_unstale":"2023-11-15T01:21:37.069329+0000","last_undegraded":"2023-11-15T01:21:37.069329+0000","last_fullsized":"2023-11-15T01:21:37.069329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054633+0000","last_change":"2023-11-15T01:21:36.683715+0000","last_active":"2023-11-15T01:21:37.054633+0000","last_peered":"2023-11-15T01:21:37.054633+0000","last_clean":"2023-11-15T01:21:37.054633+0000","last_became_active":"2023-11-15T01:21:36.683268+0000","last_became_peered":"2023-11-15T01:21:36.683268+0000","last_unstale":"2023-11-15T01:21:37.054633+0000","last_undegraded":"2023-11-15T01:21:37.054633+0000","last_fullsized":"2023-11-15T01:21:37.054633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075490+0000","last_change":"2023-11-15T01:21:37.070543+0000","last_active":"2023-11-15T01:21:37.075490+0000","last_peered":"2023-11-15T01:21:37.075490+0000","last_clean":"2023-11-15T01:21:37.075490+0000","last_became_active":"2023-11-15T01:21:37.069750+0000","last_became_peered":"2023-11-15T01:21:37.069750+0000","last_unstale":"2023-11-15T01:21:37.075490+0000","last_undegraded":"2023-11-15T01:21:37.075490+0000","last_fullsized":"2023-11-15T01:21:37.075490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051998+0000","last_change":"2023-11-15T01:21:36.677974+0000","last_active":"2023-11-15T01:21:37.051998+0000","last_peered":"2023-11-15T01:21:37.051998+0000","last_clean":"2023-11-15T01:21:37.051998+0000","last_became_active":"2023-11-15T01:21:36.677594+0000","last_became_peered":"2023-11-15T01:21:36.677594+0000","last_unstale":"2023-11-15T01:21:37.051998+0000","last_undegraded":"2023-11-15T01:21:37.051998+0000","last_fullsized":"2023-11-15T01:21:37.051998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072732+0000","last_change":"2023-11-15T01:21:37.070356+0000","last_active":"2023-11-15T01:21:37.072732+0000","last_peered":"2023-11-15T01:21:37.072732+0000","last_clean":"2023-11-15T01:21:37.072732+0000","last_became_active":"2023-11-15T01:21:37.070072+0000","last_became_peered":"2023-11-15T01:21:37.070072+0000","last_unstale":"2023-11-15T01:21:37.072732+0000","last_undegraded":"2023-11-15T01:21:37.072732+0000","last_fullsized":"2023-11-15T01:21:37.072732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076470+0000","last_change":"2023-11-15T01:21:36.671536+0000","last_active":"2023-11-15T01:21:37.076470+0000","last_peered":"2023-11-15T01:21:37.076470+0000","last_clean":"2023-11-15T01:21:37.076470+0000","last_became_active":"2023-11-15T01:21:36.671247+0000","last_became_peered":"2023-11-15T01:21:36.671247+0000","last_unstale":"2023-11-15T01:21:37.076470+0000","last_undegraded":"2023-11-15T01:21:37.076470+0000","last_fullsized":"2023-11-15T01:21:37.076470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072659+0000","last_change":"2023-11-15T01:21:37.069675+0000","last_active":"2023-11-15T01:21:37.072659+0000","last_peered":"2023-11-15T01:21:37.072659+0000","last_clean":"2023-11-15T01:21:37.072659+0000","last_became_active":"2023-11-15T01:21:37.069397+0000","last_became_peered":"2023-11-15T01:21:37.069397+0000","last_unstale":"2023-11-15T01:21:37.072659+0000","last_undegraded":"2023-11-15T01:21:37.072659+0000","last_fullsized":"2023-11-15T01:21:37.072659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081458+0000","last_change":"2023-11-15T01:21:36.673107+0000","last_active":"2023-11-15T01:21:37.081458+0000","last_peered":"2023-11-15T01:21:37.081458+0000","last_clean":"2023-11-15T01:21:37.081458+0000","last_became_active":"2023-11-15T01:21:36.672803+0000","last_became_peered":"2023-11-15T01:21:36.672803+0000","last_unstale":"2023-11-15T01:21:37.081458+0000","last_undegraded":"2023-11-15T01:21:37.081458+0000","last_fullsized":"2023-11-15T01:21:37.081458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.069571+0000","last_change":"2023-11-15T01:21:37.066878+0000","last_active":"2023-11-15T01:21:37.069571+0000","last_peered":"2023-11-15T01:21:37.069571+0000","last_clean":"2023-11-15T01:21:37.069571+0000","last_became_active":"2023-11-15T01:21:37.066577+0000","last_became_peered":"2023-11-15T01:21:37.066577+0000","last_unstale":"2023-11-15T01:21:37.069571+0000","last_undegraded":"2023-11-15T01:21:37.069571+0000","last_fullsized":"2023-11-15T01:21:37.069571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054855+0000","last_change":"2023-11-15T01:21:36.681159+0000","last_active":"2023-11-15T01:21:37.054855+0000","last_peered":"2023-11-15T01:21:37.054855+0000","last_clean":"2023-11-15T01:21:37.054855+0000","last_became_active":"2023-11-15T01:21:36.680906+0000","last_became_peered":"2023-11-15T01:21:36.680906+0000","last_unstale":"2023-11-15T01:21:37.054855+0000","last_undegraded":"2023-11-15T01:21:37.054855+0000","last_fullsized":"2023-11-15T01:21:37.054855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078486+0000","last_change":"2023-11-15T01:21:37.074210+0000","last_active":"2023-11-15T01:21:37.078486+0000","last_peered":"2023-11-15T01:21:37.078486+0000","last_clean":"2023-11-15T01:21:37.078486+0000","last_became_active":"2023-11-15T01:21:37.073943+0000","last_became_peered":"2023-11-15T01:21:37.073943+0000","last_unstale":"2023-11-15T01:21:37.078486+0000","last_undegraded":"2023-11-15T01:21:37.078486+0000","last_fullsized":"2023-11-15T01:21:37.078486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053463+0000","last_change":"2023-11-15T01:21:36.679911+0000","last_active":"2023-11-15T01:21:37.053463+0000","last_peered":"2023-11-15T01:21:37.053463+0000","last_clean":"2023-11-15T01:21:37.053463+0000","last_became_active":"2023-11-15T01:21:36.679272+0000","last_became_peered":"2023-11-15T01:21:36.679272+0000","last_unstale":"2023-11-15T01:21:37.053463+0000","last_undegraded":"2023-11-15T01:21:37.053463+0000","last_fullsized":"2023-11-15T01:21:37.053463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073109+0000","last_change":"2023-11-15T01:21:37.068769+0000","last_active":"2023-11-15T01:21:37.073109+0000","last_peered":"2023-11-15T01:21:37.073109+0000","last_clean":"2023-11-15T01:21:37.073109+0000","last_became_active":"2023-11-15T01:21:37.068495+0000","last_became_peered":"2023-11-15T01:21:37.068495+0000","last_unstale":"2023-11-15T01:21:37.073109+0000","last_undegraded":"2023-11-15T01:21:37.073109+0000","last_fullsized":"2023-11-15T01:21:37.073109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060975+0000","last_change":"2023-11-15T01:21:36.683620+0000","last_active":"2023-11-15T01:21:37.060975+0000","last_peered":"2023-11-15T01:21:37.060975+0000","last_clean":"2023-11-15T01:21:37.060975+0000","last_became_active":"2023-11-15T01:21:36.683315+0000","last_became_peered":"2023-11-15T01:21:36.683315+0000","last_unstale":"2023-11-15T01:21:37.060975+0000","last_undegraded":"2023-11-15T01:21:37.060975+0000","last_fullsized":"2023-11-15T01:21:37.060975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079966+0000","last_change":"2023-11-15T01:21:37.078896+0000","last_active":"2023-11-15T01:21:37.079966+0000","last_peered":"2023-11-15T01:21:37.079966+0000","last_clean":"2023-11-15T01:21:37.079966+0000","last_became_active":"2023-11-15T01:21:37.078569+0000","last_became_peered":"2023-11-15T01:21:37.078569+0000","last_unstale":"2023-11-15T01:21:37.079966+0000","last_undegraded":"2023-11-15T01:21:37.079966+0000","last_fullsized":"2023-11-15T01:21:37.079966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061034+0000","last_change":"2023-11-15T01:21:36.670706+0000","last_active":"2023-11-15T01:21:37.061034+0000","last_peered":"2023-11-15T01:21:37.061034+0000","last_clean":"2023-11-15T01:21:37.061034+0000","last_became_active":"2023-11-15T01:21:36.670059+0000","last_became_peered":"2023-11-15T01:21:36.670059+0000","last_unstale":"2023-11-15T01:21:37.061034+0000","last_undegraded":"2023-11-15T01:21:37.061034+0000","last_fullsized":"2023-11-15T01:21:37.061034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.071946+0000","last_change":"2023-11-15T01:21:37.067713+0000","last_active":"2023-11-15T01:21:37.071946+0000","last_peered":"2023-11-15T01:21:37.071946+0000","last_clean":"2023-11-15T01:21:37.071946+0000","last_became_active":"2023-11-15T01:21:37.067395+0000","last_became_peered":"2023-11-15T01:21:37.067395+0000","last_unstale":"2023-11-15T01:21:37.071946+0000","last_undegraded":"2023-11-15T01:21:37.071946+0000","last_fullsized":"2023-11-15T01:21:37.071946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060748+0000","last_change":"2023-11-15T01:21:36.682781+0000","last_active":"2023-11-15T01:21:37.060748+0000","last_peered":"2023-11-15T01:21:37.060748+0000","last_clean":"2023-11-15T01:21:37.060748+0000","last_became_active":"2023-11-15T01:21:36.682480+0000","last_became_peered":"2023-11-15T01:21:36.682480+0000","last_unstale":"2023-11-15T01:21:37.060748+0000","last_undegraded":"2023-11-15T01:21:37.060748+0000","last_fullsized":"2023-11-15T01:21:37.060748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075509+0000","last_change":"2023-11-15T01:21:37.070705+0000","last_active":"2023-11-15T01:21:37.075509+0000","last_peered":"2023-11-15T01:21:37.075509+0000","last_clean":"2023-11-15T01:21:37.075509+0000","last_became_active":"2023-11-15T01:21:37.070269+0000","last_became_peered":"2023-11-15T01:21:37.070269+0000","last_unstale":"2023-11-15T01:21:37.075509+0000","last_undegraded":"2023-11-15T01:21:37.075509+0000","last_fullsized":"2023-11-15T01:21:37.075509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.066310+0000","last_change":"2023-11-15T01:21:36.681917+0000","last_active":"2023-11-15T01:21:37.066310+0000","last_peered":"2023-11-15T01:21:37.066310+0000","last_clean":"2023-11-15T01:21:37.066310+0000","last_became_active":"2023-11-15T01:21:36.681664+0000","last_became_peered":"2023-11-15T01:21:36.681664+0000","last_unstale":"2023-11-15T01:21:37.066310+0000","last_undegraded":"2023-11-15T01:21:37.066310+0000","last_fullsized":"2023-11-15T01:21:37.066310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061299+0000","last_change":"2023-11-15T01:21:37.056524+0000","last_active":"2023-11-15T01:21:37.061299+0000","last_peered":"2023-11-15T01:21:37.061299+0000","last_clean":"2023-11-15T01:21:37.061299+0000","last_became_active":"2023-11-15T01:21:37.056115+0000","last_became_peered":"2023-11-15T01:21:37.056115+0000","last_unstale":"2023-11-15T01:21:37.061299+0000","last_undegraded":"2023-11-15T01:21:37.061299+0000","last_fullsized":"2023-11-15T01:21:37.061299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076222+0000","last_change":"2023-11-15T01:21:36.675434+0000","last_active":"2023-11-15T01:21:37.076222+0000","last_peered":"2023-11-15T01:21:37.076222+0000","last_clean":"2023-11-15T01:21:37.076222+0000","last_became_active":"2023-11-15T01:21:36.675152+0000","last_became_peered":"2023-11-15T01:21:36.675152+0000","last_unstale":"2023-11-15T01:21:37.076222+0000","last_undegraded":"2023-11-15T01:21:37.076222+0000","last_fullsized":"2023-11-15T01:21:37.076222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.080142+0000","last_change":"2023-11-15T01:21:37.077249+0000","last_active":"2023-11-15T01:21:37.080142+0000","last_peered":"2023-11-15T01:21:37.080142+0000","last_clean":"2023-11-15T01:21:37.080142+0000","last_became_active":"2023-11-15T01:21:37.077009+0000","last_became_peered":"2023-11-15T01:21:37.077009+0000","last_unstale":"2023-11-15T01:21:37.080142+0000","last_undegraded":"2023-11-15T01:21:37.080142+0000","last_fullsized":"2023-11-15T01:21:37.080142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072218+0000","last_change":"2023-11-15T01:21:36.675491+0000","last_active":"2023-11-15T01:21:37.072218+0000","last_peered":"2023-11-15T01:21:37.072218+0000","last_clean":"2023-11-15T01:21:37.072218+0000","last_became_active":"2023-11-15T01:21:36.673535+0000","last_became_peered":"2023-11-15T01:21:36.673535+0000","last_unstale":"2023-11-15T01:21:37.072218+0000","last_undegraded":"2023-11-15T01:21:37.072218+0000","last_fullsized":"2023-11-15T01:21:37.072218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075938+0000","last_change":"2023-11-15T01:21:37.072360+0000","last_active":"2023-11-15T01:21:37.075938+0000","last_peered":"2023-11-15T01:21:37.075938+0000","last_clean":"2023-11-15T01:21:37.075938+0000","last_became_active":"2023-11-15T01:21:37.070013+0000","last_became_peered":"2023-11-15T01:21:37.070013+0000","last_unstale":"2023-11-15T01:21:37.075938+0000","last_undegraded":"2023-11-15T01:21:37.075938+0000","last_fullsized":"2023-11-15T01:21:37.075938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051462+0000","last_change":"2023-11-15T01:21:36.674145+0000","last_active":"2023-11-15T01:21:37.051462+0000","last_peered":"2023-11-15T01:21:37.051462+0000","last_clean":"2023-11-15T01:21:37.051462+0000","last_became_active":"2023-11-15T01:21:36.673862+0000","last_became_peered":"2023-11-15T01:21:36.673862+0000","last_unstale":"2023-11-15T01:21:37.051462+0000","last_undegraded":"2023-11-15T01:21:37.051462+0000","last_fullsized":"2023-11-15T01:21:37.051462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078508+0000","last_change":"2023-11-15T01:21:37.074359+0000","last_active":"2023-11-15T01:21:37.078508+0000","last_peered":"2023-11-15T01:21:37.078508+0000","last_clean":"2023-11-15T01:21:37.078508+0000","last_became_active":"2023-11-15T01:21:37.073936+0000","last_became_peered":"2023-11-15T01:21:37.073936+0000","last_unstale":"2023-11-15T01:21:37.078508+0000","last_undegraded":"2023-11-15T01:21:37.078508+0000","last_fullsized":"2023-11-15T01:21:37.078508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.055113+0000","last_change":"2023-11-15T01:21:36.681422+0000","last_active":"2023-11-15T01:21:37.055113+0000","last_peered":"2023-11-15T01:21:37.055113+0000","last_clean":"2023-11-15T01:21:37.055113+0000","last_became_active":"2023-11-15T01:21:36.680717+0000","last_became_peered":"2023-11-15T01:21:36.680717+0000","last_unstale":"2023-11-15T01:21:37.055113+0000","last_undegraded":"2023-11-15T01:21:37.055113+0000","last_fullsized":"2023-11-15T01:21:37.055113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073014+0000","last_change":"2023-11-15T01:21:37.071820+0000","last_active":"2023-11-15T01:21:37.073014+0000","last_peered":"2023-11-15T01:21:37.073014+0000","last_clean":"2023-11-15T01:21:37.073014+0000","last_became_active":"2023-11-15T01:21:37.071521+0000","last_became_peered":"2023-11-15T01:21:37.071521+0000","last_unstale":"2023-11-15T01:21:37.073014+0000","last_undegraded":"2023-11-15T01:21:37.073014+0000","last_fullsized":"2023-11-15T01:21:37.073014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076301+0000","last_change":"2023-11-15T01:21:36.676437+0000","last_active":"2023-11-15T01:21:37.076301+0000","last_peered":"2023-11-15T01:21:37.076301+0000","last_clean":"2023-11-15T01:21:37.076301+0000","last_became_active":"2023-11-15T01:21:36.676128+0000","last_became_peered":"2023-11-15T01:21:36.676128+0000","last_unstale":"2023-11-15T01:21:37.076301+0000","last_undegraded":"2023-11-15T01:21:37.076301+0000","last_fullsized":"2023-11-15T01:21:37.076301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297348,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074492,"statfs":{"total":96636764160,"available":96332279808,"internally_reserved":0,"allocated":258048,"data_stored":86755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297340,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074500,"statfs":{"total":96636764160,"available":96332288000,"internally_reserved":0,"allocated":249856,"data_stored":86933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:21:41.456 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-15T01:21:41.457 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-15T01:21:41.457 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-15T01:21:41.457 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-15T01:21:41.458 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-15T01:21:41.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.608+0000 7fb9b1259700 1 Processor -- start 2023-11-15T01:21:41.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.608+0000 7fb9b1259700 1 -- start start 2023-11-15T01:21:41.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.609+0000 7fb9b1259700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb9ac0c9fc0 0x7fb9ac0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.609+0000 7fb9b1259700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac0c7980 con 0x7fb9ac151e10 2023-11-15T01:21:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.609+0000 7fb9b1259700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac0aa890 con 0x7fb9ac155530 2023-11-15T01:21:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.609+0000 7fb9b1259700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac0c7bd0 con 0x7fb9ac0c9fc0 2023-11-15T01:21:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.609+0000 7fb9abfff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb9ac151e10 0x7fb9ac0aa0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58102/0 (socket says 172.21.15.1:58102) 2023-11-15T01:21:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.609+0000 7fb9b0a58700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb9ac0c9fc0 0x7fb9ac0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.609+0000 7fb9abfff700 1 -- 172.21.15.1:0/807252650 learned_addr learned my addr 172.21.15.1:0/807252650 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.609+0000 7fb9aaffd700 1 -- 172.21.15.1:0/807252650 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117727125 0 0) 0x7fb9ac0c7980 con 0x7fb9ac151e10 2023-11-15T01:21:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.609+0000 7fb9aaffd700 1 -- 172.21.15.1:0/807252650 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9940033f0 con 0x7fb9ac151e10 2023-11-15T01:21:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.609+0000 7fb9b0a58700 1 -- 172.21.15.1:0/807252650 >> v1:172.21.15.141:6789/0 conn(0x7fb9ac155530 legacy=0x7fb9ac0c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.609+0000 7fb9b0a58700 1 -- 172.21.15.1:0/807252650 >> v1:172.21.15.1:6789/0 conn(0x7fb9ac151e10 legacy=0x7fb9ac0aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.610+0000 7fb9b0a58700 1 -- 172.21.15.1:0/807252650 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac0c7eb0 con 0x7fb9ac0c9fc0 2023-11-15T01:21:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.610+0000 7fb9b0a58700 1 --2- 172.21.15.1:0/807252650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9ac0c9fc0 0x7fb9ac0c86b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb9a4009e60 tx=0x7fb9a4009780).ready entity=mon.0 client_cookie=fc9988d315699ce1 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.610+0000 7fb9aaffd700 1 -- 172.21.15.1:0/807252650 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a400e070 con 0x7fb9ac0c9fc0 2023-11-15T01:21:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.610+0000 7fb9aaffd700 1 -- 172.21.15.1:0/807252650 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a400bb60 con 0x7fb9ac0c9fc0 2023-11-15T01:21:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.610+0000 7fb9aaffd700 1 -- 172.21.15.1:0/807252650 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4012410 con 0x7fb9ac0c9fc0 2023-11-15T01:21:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.610+0000 7fb9b1259700 1 -- 172.21.15.1:0/807252650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9ac0c9fc0 msgr2=0x7fb9ac0c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.610+0000 7fb9b1259700 1 --2- 172.21.15.1:0/807252650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9ac0c9fc0 0x7fb9ac0c86b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb9a4009e60 tx=0x7fb9a4009780).stop 2023-11-15T01:21:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.610+0000 7fb9b1259700 1 -- 172.21.15.1:0/807252650 shutdown_connections 2023-11-15T01:21:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.610+0000 7fb9b1259700 1 --2- 172.21.15.1:0/807252650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9ac0c9fc0 0x7fb9ac0c86b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.610+0000 7fb9b1259700 1 -- 172.21.15.1:0/807252650 >> 172.21.15.1:0/807252650 conn(0x7fb9ac0947e0 msgr2=0x7fb9ac06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.610+0000 7fb9b1259700 1 -- 172.21.15.1:0/807252650 shutdown_connections 2023-11-15T01:21:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.610+0000 7fb9b1259700 1 -- 172.21.15.1:0/807252650 wait complete. 2023-11-15T01:21:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.612+0000 7fb9b1259700 1 Processor -- start 2023-11-15T01:21:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.612+0000 7fb9b1259700 1 -- start start 2023-11-15T01:21:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.612+0000 7fb9b1259700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9ac0c9fc0 0x7fb9ac13e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.612+0000 7fb9b1259700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9ac151e10 0x7fb9ac064720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.612+0000 7fb9b1259700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb9ac155530 0x7fb9ac064c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9b1259700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac13e5f0 con 0x7fb9ac151e10 2023-11-15T01:21:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9b1259700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac065100 con 0x7fb9ac0c9fc0 2023-11-15T01:21:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9b1259700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac13b5f0 con 0x7fb9ac155530 2023-11-15T01:21:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9ab7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9ac151e10 0x7fb9ac064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9ab7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9ac151e10 0x7fb9ac064720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54778/0 (socket says 172.21.15.1:54778) 2023-11-15T01:21:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9ab7fe700 1 -- 172.21.15.1:0/3212199356 learned_addr learned my addr 172.21.15.1:0/3212199356 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9abfff700 1 --2- 172.21.15.1:0/3212199356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9ac0c9fc0 0x7fb9ac13e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9b0a58700 1 --2- 172.21.15.1:0/3212199356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb9ac155530 0x7fb9ac064c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9ab7fe700 1 -- 172.21.15.1:0/3212199356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb9ac155530 msgr2=0x7fb9ac064c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9ab7fe700 1 --2- 172.21.15.1:0/3212199356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb9ac155530 0x7fb9ac064c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9ab7fe700 1 -- 172.21.15.1:0/3212199356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9ac0c9fc0 msgr2=0x7fb9ac13e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9ab7fe700 1 --2- 172.21.15.1:0/3212199356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9ac0c9fc0 0x7fb9ac13e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9ab7fe700 1 -- 172.21.15.1:0/3212199356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a4009a20 con 0x7fb9ac151e10 2023-11-15T01:21:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9ab7fe700 1 --2- 172.21.15.1:0/3212199356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9ac151e10 0x7fb9ac064720 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb99c00c470 tx=0x7fb99c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb993fff700 1 -- 172.21.15.1:0/3212199356 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c007020 con 0x7fb9ac151e10 2023-11-15T01:21:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb993fff700 1 -- 172.21.15.1:0/3212199356 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99c007180 con 0x7fb9ac151e10 2023-11-15T01:21:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9b1259700 1 -- 172.21.15.1:0/3212199356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac0ac600 con 0x7fb9ac151e10 2023-11-15T01:21:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb993fff700 1 -- 172.21.15.1:0/3212199356 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c007520 con 0x7fb9ac151e10 2023-11-15T01:21:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.613+0000 7fb9b1259700 1 -- 172.21.15.1:0/3212199356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac0abfb0 con 0x7fb9ac151e10 2023-11-15T01:21:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.614+0000 7fb9b1259700 1 -- 172.21.15.1:0/3212199356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ac0475e0 con 0x7fb9ac151e10 2023-11-15T01:21:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.614+0000 7fb993fff700 1 -- 172.21.15.1:0/3212199356 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb99c0068b0 con 0x7fb9ac151e10 2023-11-15T01:21:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.615+0000 7fb993fff700 1 --2- 172.21.15.1:0/3212199356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb99805f150 0x7fb998061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.615+0000 7fb993fff700 1 -- 172.21.15.1:0/3212199356 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb99c079560 con 0x7fb9ac151e10 2023-11-15T01:21:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.615+0000 7fb9abfff700 1 --2- 172.21.15.1:0/3212199356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb99805f150 0x7fb998061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.615+0000 7fb9abfff700 1 --2- 172.21.15.1:0/3212199356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb99805f150 0x7fb998061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb9a0005750 tx=0x7fb9a0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.619+0000 7fb993fff700 1 -- 172.21.15.1:0/3212199356 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb99c047af0 con 0x7fb9ac151e10 2023-11-15T01:21:41.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.836+0000 7fb9b1259700 1 -- 172.21.15.1:0/3212199356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb9ac060900 con 0x7fb9ac151e10 2023-11-15T01:21:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.839+0000 7fb993fff700 1 -- 172.21.15.1:0/3212199356 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+148955 (secure 0 0 0) 0x7fb99c0445f0 con 0x7fb9ac151e10 2023-11-15T01:21:41.842 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:41.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.841+0000 7fb9b1259700 1 -- 172.21.15.1:0/3212199356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb99805f150 msgr2=0x7fb998061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.841+0000 7fb9b1259700 1 --2- 172.21.15.1:0/3212199356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb99805f150 0x7fb998061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb9a0005750 tx=0x7fb9a0009040).stop 2023-11-15T01:21:41.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.841+0000 7fb9b1259700 1 -- 172.21.15.1:0/3212199356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9ac151e10 msgr2=0x7fb9ac064720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.841+0000 7fb9b1259700 1 --2- 172.21.15.1:0/3212199356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9ac151e10 0x7fb9ac064720 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb99c00c470 tx=0x7fb99c007e00).stop 2023-11-15T01:21:41.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.841+0000 7fb9b1259700 1 -- 172.21.15.1:0/3212199356 shutdown_connections 2023-11-15T01:21:41.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.841+0000 7fb9b1259700 1 --2- 172.21.15.1:0/3212199356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb99805f150 0x7fb998061610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.841+0000 7fb9b1259700 1 --2- 172.21.15.1:0/3212199356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb9ac155530 0x7fb9ac064c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.842+0000 7fb9b1259700 1 --2- 172.21.15.1:0/3212199356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9ac0c9fc0 0x7fb9ac13e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.842+0000 7fb9b1259700 1 --2- 172.21.15.1:0/3212199356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9ac151e10 0x7fb9ac064720 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.842+0000 7fb9b1259700 1 -- 172.21.15.1:0/3212199356 >> 172.21.15.1:0/3212199356 conn(0x7fb9ac0947e0 msgr2=0x7fb9ac14f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:41.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.842+0000 7fb9b1259700 1 -- 172.21.15.1:0/3212199356 shutdown_connections 2023-11-15T01:21:41.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.842+0000 7fb9b1259700 1 -- 172.21.15.1:0/3212199356 wait complete. 2023-11-15T01:21:41.854 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":4,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":90546},{"type":"v1","addr":"172.21.15.141:6833","nonce":90546}]},"active_addr":"172.21.15.141:6833/90546","active_change":"2023-11-15T01:21:23.749696+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.141:0","nonce":3577504655}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.141:0","nonce":1004848049}]}]} 2023-11-15T01:21:41.858 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-15T01:21:41.858 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-15T01:21:41.859 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:21:41.916 INFO:tasks.ceph.mds.c.smithi001.stderr:2023-11-15T01:21:41.916+0000 7f3c98963700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T01:21:41.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.976+0000 7fc0a9817700 1 Processor -- start 2023-11-15T01:21:41.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.976+0000 7fc0a9817700 1 -- start start 2023-11-15T01:21:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.977+0000 7fc0a9817700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc0a40ab1a0 0x7fc0a4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.977+0000 7fc0a9817700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc0a40aa060 0x7fc0a40c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.977+0000 7fc0a9817700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a40c06f0 con 0x7fc0a4154150 2023-11-15T01:21:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.977+0000 7fc0a9817700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a40c09d0 con 0x7fc0a40aa060 2023-11-15T01:21:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.977+0000 7fc0a9817700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a4158820 con 0x7fc0a40ab1a0 2023-11-15T01:21:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.977+0000 7fc0a37fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc0a40aa060 0x7fc0a40c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.977+0000 7fc0a37fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc0a40aa060 0x7fc0a40c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54782/0 (socket says 172.21.15.1:54782) 2023-11-15T01:21:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.977+0000 7fc0a37fe700 1 -- 172.21.15.1:0/1389105866 learned_addr learned my addr 172.21.15.1:0/1389105866 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.977+0000 7fc0a27fc700 1 --2- 172.21.15.1:0/1389105866 >> v2:172.21.15.141:3300/0 conn(0x7fc0a40ab1a0 0x7fc0a4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a37fe700 1 -- 172.21.15.1:0/1389105866 >> v2:172.21.15.141:3300/0 conn(0x7fc0a40ab1a0 msgr2=0x7fc0a4154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a37fe700 1 --2- 172.21.15.1:0/1389105866 >> v2:172.21.15.141:3300/0 conn(0x7fc0a40ab1a0 0x7fc0a4154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a37fe700 1 -- 172.21.15.1:0/1389105866 >> v1:172.21.15.141:6789/0 conn(0x7fc0a4154150 legacy=0x7fc0a4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a37fe700 1 -- 172.21.15.1:0/1389105866 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4158b00 con 0x7fc0a40aa060 2023-11-15T01:21:41.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a37fe700 1 --2- 172.21.15.1:0/1389105866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0a40aa060 0x7fc0a40c5f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fc0a4158750 tx=0x7fc094009840).ready entity=mon.0 client_cookie=2560738aa901ef2c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:41.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a1ffb700 1 -- 172.21.15.1:0/1389105866 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09400e070 con 0x7fc0a40aa060 2023-11-15T01:21:41.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a1ffb700 1 -- 172.21.15.1:0/1389105866 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09400ba20 con 0x7fc0a40aa060 2023-11-15T01:21:41.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a1ffb700 1 -- 172.21.15.1:0/1389105866 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09400bda0 con 0x7fc0a40aa060 2023-11-15T01:21:41.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a9817700 1 -- 172.21.15.1:0/1389105866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0a40aa060 msgr2=0x7fc0a40c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a9817700 1 --2- 172.21.15.1:0/1389105866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0a40aa060 0x7fc0a40c5f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fc0a4158750 tx=0x7fc094009840).stop 2023-11-15T01:21:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a9817700 1 -- 172.21.15.1:0/1389105866 shutdown_connections 2023-11-15T01:21:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a9817700 1 --2- 172.21.15.1:0/1389105866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0a40aa060 0x7fc0a40c5f10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a9817700 1 --2- 172.21.15.1:0/1389105866 >> v2:172.21.15.141:3300/0 conn(0x7fc0a40ab1a0 0x7fc0a4154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a9817700 1 -- 172.21.15.1:0/1389105866 >> 172.21.15.1:0/1389105866 conn(0x7fc0a4064aa0 msgr2=0x7fc0a4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:41.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a9817700 1 -- 172.21.15.1:0/1389105866 shutdown_connections 2023-11-15T01:21:41.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.978+0000 7fc0a9817700 1 -- 172.21.15.1:0/1389105866 wait complete. 2023-11-15T01:21:41.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.980+0000 7fc0a9817700 1 Processor -- start 2023-11-15T01:21:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.980+0000 7fc0a9817700 1 -- start start 2023-11-15T01:21:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.980+0000 7fc0a9817700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0a40aa060 0x7fc0a4156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.980+0000 7fc0a9817700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0a40ab1a0 0x7fc0a40ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.980+0000 7fc0a9817700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0a4154150 0x7fc0a4147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.980+0000 7fc0a9817700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4155ed0 con 0x7fc0a4154150 2023-11-15T01:21:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.980+0000 7fc0a9817700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4157350 con 0x7fc0a40ab1a0 2023-11-15T01:21:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.980+0000 7fc0a9817700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4157630 con 0x7fc0a40aa060 2023-11-15T01:21:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc0a37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0a4154150 0x7fc0a4147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc0a37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0a4154150 0x7fc0a4147d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54792/0 (socket says 172.21.15.1:54792) 2023-11-15T01:21:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc0a37fe700 1 -- 172.21.15.1:0/376077411 learned_addr learned my addr 172.21.15.1:0/376077411 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc0a27fc700 1 --2- 172.21.15.1:0/376077411 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0a40ab1a0 0x7fc0a40ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc0a2ffd700 1 --2- 172.21.15.1:0/376077411 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0a40aa060 0x7fc0a4156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc0a37fe700 1 -- 172.21.15.1:0/376077411 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0a40aa060 msgr2=0x7fc0a4156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc0a37fe700 1 --2- 172.21.15.1:0/376077411 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0a40aa060 0x7fc0a4156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc0a37fe700 1 -- 172.21.15.1:0/376077411 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0a40ab1a0 msgr2=0x7fc0a40ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc0a37fe700 1 --2- 172.21.15.1:0/376077411 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0a40ab1a0 0x7fc0a40ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc0a37fe700 1 -- 172.21.15.1:0/376077411 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094009ae0 con 0x7fc0a4154150 2023-11-15T01:21:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc0a2ffd700 1 --2- 172.21.15.1:0/376077411 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0a40aa060 0x7fc0a4156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc0a37fe700 1 --2- 172.21.15.1:0/376077411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0a4154150 0x7fc0a4147d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc09400b6c0 tx=0x7fc094009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc09affd700 1 -- 172.21.15.1:0/376077411 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0940092e0 con 0x7fc0a4154150 2023-11-15T01:21:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc09affd700 1 -- 172.21.15.1:0/376077411 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09401e470 con 0x7fc0a4154150 2023-11-15T01:21:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc0a9817700 1 -- 172.21.15.1:0/376077411 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a4157910 con 0x7fc0a4154150 2023-11-15T01:21:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc09affd700 1 -- 172.21.15.1:0/376077411 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09401e7f0 con 0x7fc0a4154150 2023-11-15T01:21:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.981+0000 7fc0a9817700 1 -- 172.21.15.1:0/376077411 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a4156850 con 0x7fc0a4154150 2023-11-15T01:21:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.982+0000 7fc09affd700 1 -- 172.21.15.1:0/376077411 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc094003040 con 0x7fc0a4154150 2023-11-15T01:21:41.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.982+0000 7fc0a9817700 1 -- 172.21.15.1:0/376077411 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a406c7e0 con 0x7fc0a4154150 2023-11-15T01:21:41.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.983+0000 7fc09affd700 1 --2- 172.21.15.1:0/376077411 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc08405f150 0x7fc084061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:41.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.983+0000 7fc09affd700 1 -- 172.21.15.1:0/376077411 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc09407b5f0 con 0x7fc0a4154150 2023-11-15T01:21:41.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.983+0000 7fc0a2ffd700 1 --2- 172.21.15.1:0/376077411 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc08405f150 0x7fc084061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:41.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.983+0000 7fc0a2ffd700 1 --2- 172.21.15.1:0/376077411 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc08405f150 0x7fc084061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc09c001690 tx=0x7fc09c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:41.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:41.987+0000 7fc09affd700 1 -- 172.21.15.1:0/376077411 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc09404c970 con 0x7fc0a4154150 2023-11-15T01:21:42.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.161+0000 7fc0a9817700 1 -- 172.21.15.1:0/376077411 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0a40c02a0 con 0x7fc0a4154150 2023-11-15T01:21:42.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.161+0000 7fc09affd700 1 -- 172.21.15.1:0/376077411 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16880 (secure 0 0 0) 0x7fc094023070 con 0x7fc0a4154150 2023-11-15T01:21:42.162 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:42.163 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:38.047484+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:21:34.763591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-15T01:21:36.025071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:21:42.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.163+0000 7fc0a9817700 1 -- 172.21.15.1:0/376077411 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc08405f150 msgr2=0x7fc084061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.163+0000 7fc0a9817700 1 --2- 172.21.15.1:0/376077411 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc08405f150 0x7fc084061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc09c001690 tx=0x7fc09c009040).stop 2023-11-15T01:21:42.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.163+0000 7fc0a9817700 1 -- 172.21.15.1:0/376077411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0a4154150 msgr2=0x7fc0a4147d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.163+0000 7fc0a9817700 1 --2- 172.21.15.1:0/376077411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0a4154150 0x7fc0a4147d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc09400b6c0 tx=0x7fc094009840).stop 2023-11-15T01:21:42.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.163+0000 7fc0a9817700 1 -- 172.21.15.1:0/376077411 shutdown_connections 2023-11-15T01:21:42.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.163+0000 7fc0a9817700 1 --2- 172.21.15.1:0/376077411 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc08405f150 0x7fc084061610 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.163+0000 7fc0a9817700 1 --2- 172.21.15.1:0/376077411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0a4154150 0x7fc0a4147d90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.163+0000 7fc0a9817700 1 --2- 172.21.15.1:0/376077411 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0a40aa060 0x7fc0a4156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.163+0000 7fc0a9817700 1 --2- 172.21.15.1:0/376077411 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0a40ab1a0 0x7fc0a40ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.163+0000 7fc0a9817700 1 -- 172.21.15.1:0/376077411 >> 172.21.15.1:0/376077411 conn(0x7fc0a4064aa0 msgr2=0x7fc0a40c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:42.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.163+0000 7fc0a9817700 1 -- 172.21.15.1:0/376077411 shutdown_connections 2023-11-15T01:21:42.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.163+0000 7fc0a9817700 1 -- 172.21.15.1:0/376077411 wait complete. 2023-11-15T01:21:42.176 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-15T01:21:42.177 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:21:42.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.293+0000 7fb97751f700 1 Processor -- start 2023-11-15T01:21:42.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.294+0000 7fb97751f700 1 -- start start 2023-11-15T01:21:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.294+0000 7fb97751f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb970154150 0x7fb970154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.295+0000 7fb97751f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9700c06f0 con 0x7fb9700aa060 2023-11-15T01:21:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.295+0000 7fb97751f700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9700c09d0 con 0x7fb9700ab1a0 2023-11-15T01:21:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.295+0000 7fb97751f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb970158820 con 0x7fb970154150 2023-11-15T01:21:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.295+0000 7fb9752bb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb970154150 0x7fb970154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.295+0000 7fb975abc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb9700aa060 0x7fb9700c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58118/0 (socket says 172.21.15.1:58118) 2023-11-15T01:21:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.295+0000 7fb975abc700 1 -- 172.21.15.1:0/3083565397 learned_addr learned my addr 172.21.15.1:0/3083565397 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.295+0000 7fb9752bb700 1 -- 172.21.15.1:0/3083565397 >> v1:172.21.15.141:6789/0 conn(0x7fb9700ab1a0 legacy=0x7fb970158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.295+0000 7fb9752bb700 1 -- 172.21.15.1:0/3083565397 >> v1:172.21.15.1:6789/0 conn(0x7fb9700aa060 legacy=0x7fb9700c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.295+0000 7fb96ffff700 1 -- 172.21.15.1:0/3083565397 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2599961416 0 0) 0x7fb9700c06f0 con 0x7fb9700aa060 2023-11-15T01:21:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.295+0000 7fb9752bb700 1 -- 172.21.15.1:0/3083565397 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb970158b00 con 0x7fb970154150 2023-11-15T01:21:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.295+0000 7fb9752bb700 1 --2- 172.21.15.1:0/3083565397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb970154150 0x7fb970154530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb968009760 tx=0x7fb968009060).ready entity=mon.0 client_cookie=3a0e53541cc912c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.295+0000 7fb96ffff700 1 -- 172.21.15.1:0/3083565397 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9680090d0 con 0x7fb970154150 2023-11-15T01:21:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.295+0000 7fb96ffff700 1 -- 172.21.15.1:0/3083565397 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96800b520 con 0x7fb970154150 2023-11-15T01:21:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.295+0000 7fb96ffff700 1 -- 172.21.15.1:0/3083565397 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96800b8a0 con 0x7fb970154150 2023-11-15T01:21:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.296+0000 7fb97751f700 1 -- 172.21.15.1:0/3083565397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb970154150 msgr2=0x7fb970154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.296+0000 7fb97751f700 1 --2- 172.21.15.1:0/3083565397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb970154150 0x7fb970154530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb968009760 tx=0x7fb968009060).stop 2023-11-15T01:21:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.296+0000 7fb97751f700 1 -- 172.21.15.1:0/3083565397 shutdown_connections 2023-11-15T01:21:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.296+0000 7fb97751f700 1 --2- 172.21.15.1:0/3083565397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb970154150 0x7fb970154530 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.296+0000 7fb97751f700 1 -- 172.21.15.1:0/3083565397 >> 172.21.15.1:0/3083565397 conn(0x7fb970064aa0 msgr2=0x7fb970064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.296+0000 7fb97751f700 1 -- 172.21.15.1:0/3083565397 shutdown_connections 2023-11-15T01:21:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.296+0000 7fb97751f700 1 -- 172.21.15.1:0/3083565397 wait complete. 2023-11-15T01:21:42.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.297+0000 7fb97751f700 1 Processor -- start 2023-11-15T01:21:42.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.297+0000 7fb97751f700 1 -- start start 2023-11-15T01:21:42.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb97751f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9700aa060 0x7fb97014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb97751f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9700ab1a0 0x7fb9700c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb97751f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb970154150 0x7fb9700c5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb97751f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb970164f10 con 0x7fb9700aa060 2023-11-15T01:21:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb97751f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9701651f0 con 0x7fb9700ab1a0 2023-11-15T01:21:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb97751f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9701654d0 con 0x7fb970154150 2023-11-15T01:21:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb9752bb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9700aa060 0x7fb97014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb9752bb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9700aa060 0x7fb97014ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54820/0 (socket says 172.21.15.1:54820) 2023-11-15T01:21:42.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb9752bb700 1 -- 172.21.15.1:0/1173045738 learned_addr learned my addr 172.21.15.1:0/1173045738 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:42.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb975abc700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb970154150 0x7fb9700c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb974aba700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9700ab1a0 0x7fb9700c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb9752bb700 1 -- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb970154150 msgr2=0x7fb9700c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb9752bb700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb970154150 0x7fb9700c5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb9752bb700 1 -- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9700ab1a0 msgr2=0x7fb9700c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb9752bb700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9700ab1a0 0x7fb9700c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb9752bb700 1 -- 172.21.15.1:0/1173045738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9680092a0 con 0x7fb9700aa060 2023-11-15T01:21:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb975abc700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb970154150 0x7fb9700c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb974aba700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9700ab1a0 0x7fb9700c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.298+0000 7fb9752bb700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9700aa060 0x7fb97014ea10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb968009eb0 tx=0x7fb968017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.299+0000 7fb96d7fa700 1 -- 172.21.15.1:0/1173045738 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968011b30 con 0x7fb9700aa060 2023-11-15T01:21:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.299+0000 7fb96d7fa700 1 -- 172.21.15.1:0/1173045738 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb968011c90 con 0x7fb9700aa060 2023-11-15T01:21:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.299+0000 7fb97751f700 1 -- 172.21.15.1:0/1173045738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9701657b0 con 0x7fb9700aa060 2023-11-15T01:21:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.299+0000 7fb96d7fa700 1 -- 172.21.15.1:0/1173045738 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96801b650 con 0x7fb9700aa060 2023-11-15T01:21:42.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.299+0000 7fb97751f700 1 -- 172.21.15.1:0/1173045738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb970164bc0 con 0x7fb9700aa060 2023-11-15T01:21:42.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.300+0000 7fb97751f700 1 -- 172.21.15.1:0/1173045738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97006c7e0 con 0x7fb9700aa060 2023-11-15T01:21:42.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.300+0000 7fb96d7fa700 1 -- 172.21.15.1:0/1173045738 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb96801ba40 con 0x7fb9700aa060 2023-11-15T01:21:42.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.300+0000 7fb96d7fa700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb95c05f150 0x7fb95c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.300+0000 7fb96d7fa700 1 -- 172.21.15.1:0/1173045738 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb96807bb40 con 0x7fb9700aa060 2023-11-15T01:21:42.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.301+0000 7fb974aba700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb95c05f150 0x7fb95c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.301+0000 7fb974aba700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb95c05f150 0x7fb95c061610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb9700ad170 tx=0x7fb964008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:42.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.304+0000 7fb96d7fa700 1 -- 172.21.15.1:0/1173045738 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb96804ce10 con 0x7fb9700aa060 2023-11-15T01:21:42.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.478+0000 7fb97751f700 1 -- 172.21.15.1:0/1173045738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb97005f8b0 con 0x7fb9700aa060 2023-11-15T01:21:42.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.479+0000 7fb96d7fa700 1 -- 172.21.15.1:0/1173045738 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16880 (secure 0 0 0) 0x7fb968050430 con 0x7fb9700aa060 2023-11-15T01:21:42.480 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:42.480 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:38.047484+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:21:34.763591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-15T01:21:36.025071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:21:42.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.481+0000 7fb97751f700 1 -- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb95c05f150 msgr2=0x7fb95c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.481+0000 7fb97751f700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb95c05f150 0x7fb95c061610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb9700ad170 tx=0x7fb964008040).stop 2023-11-15T01:21:42.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.481+0000 7fb97751f700 1 -- 172.21.15.1:0/1173045738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9700aa060 msgr2=0x7fb97014ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.481+0000 7fb97751f700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9700aa060 0x7fb97014ea10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb968009eb0 tx=0x7fb968017000).stop 2023-11-15T01:21:42.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.481+0000 7fb97751f700 1 -- 172.21.15.1:0/1173045738 shutdown_connections 2023-11-15T01:21:42.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.481+0000 7fb97751f700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb95c05f150 0x7fb95c061610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.481+0000 7fb97751f700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb970154150 0x7fb9700c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.481+0000 7fb97751f700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9700aa060 0x7fb97014ea10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.481+0000 7fb97751f700 1 --2- 172.21.15.1:0/1173045738 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9700ab1a0 0x7fb9700c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.481+0000 7fb97751f700 1 -- 172.21.15.1:0/1173045738 >> 172.21.15.1:0/1173045738 conn(0x7fb970064aa0 msgr2=0x7fb9700c9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:42.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.481+0000 7fb97751f700 1 -- 172.21.15.1:0/1173045738 shutdown_connections 2023-11-15T01:21:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.481+0000 7fb97751f700 1 -- 172.21.15.1:0/1173045738 wait complete. 2023-11-15T01:21:42.493 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-15T01:21:42.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.612+0000 7fa7aeda6700 1 Processor -- start 2023-11-15T01:21:42.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.612+0000 7fa7aeda6700 1 -- start start 2023-11-15T01:21:42.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.612+0000 7fa7aeda6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa7a8154250 0x7fa7a8154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.612+0000 7fa7aeda6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a8158ff0 con 0x7fa7a80c6110 2023-11-15T01:21:42.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7aeda6700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a8158100 con 0x7fa7a80aa700 2023-11-15T01:21:42.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7aeda6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a81583e0 con 0x7fa7a8154250 2023-11-15T01:21:42.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a7fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa7a80c6110 0x7fa7a80a9ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58128/0 (socket says 172.21.15.1:58128) 2023-11-15T01:21:42.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a7fff700 1 -- 172.21.15.1:0/3240656162 learned_addr learned my addr 172.21.15.1:0/3240656162 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:42.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7acb42700 1 --2- 172.21.15.1:0/3240656162 >> v2:172.21.15.141:3300/0 conn(0x7fa7a8154250 0x7fa7a8154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a77fe700 1 -- 172.21.15.1:0/3240656162 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389377139 0 0) 0x7fa7a8158ff0 con 0x7fa7a80c6110 2023-11-15T01:21:42.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a77fe700 1 -- 172.21.15.1:0/3240656162 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7940033f0 con 0x7fa7a80c6110 2023-11-15T01:21:42.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a77fe700 1 -- 172.21.15.1:0/3240656162 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2307789754 0 0) 0x7fa7940033f0 con 0x7fa7a80c6110 2023-11-15T01:21:42.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a77fe700 1 -- 172.21.15.1:0/3240656162 >> v2:172.21.15.141:3300/0 conn(0x7fa7a8154250 msgr2=0x7fa7a8154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:42.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a77fe700 1 --2- 172.21.15.1:0/3240656162 >> v2:172.21.15.141:3300/0 conn(0x7fa7a8154250 0x7fa7a8154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a77fe700 1 -- 172.21.15.1:0/3240656162 >> v1:172.21.15.141:6789/0 conn(0x7fa7a80aa700 legacy=0x7fa7a80c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a77fe700 1 -- 172.21.15.1:0/3240656162 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a81586c0 con 0x7fa7a80c6110 2023-11-15T01:21:42.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a77fe700 1 -- 172.21.15.1:0/3240656162 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fa798001470 con 0x7fa7a80c6110 2023-11-15T01:21:42.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a77fe700 1 -- 172.21.15.1:0/3240656162 >> v1:172.21.15.1:6789/0 conn(0x7fa7a80c6110 legacy=0x7fa7a80a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a77fe700 1 --2- 172.21.15.1:0/3240656162 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa7940038e0 0x7fa794003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a77fe700 1 --2- 172.21.15.1:0/3240656162 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa794004690 0x7fa794004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a77fe700 1 --2- 172.21.15.1:0/3240656162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794005000 0x7fa79400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a77fe700 1 -- 172.21.15.1:0/3240656162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a81583e0 con 0x7fa794005000 2023-11-15T01:21:42.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a77fe700 1 -- 172.21.15.1:0/3240656162 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79400beb0 con 0x7fa7940038e0 2023-11-15T01:21:42.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a77fe700 1 -- 172.21.15.1:0/3240656162 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79400c070 con 0x7fa794004690 2023-11-15T01:21:42.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7ad343700 1 --2- 172.21.15.1:0/3240656162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794005000 0x7fa79400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7acb42700 1 --2- 172.21.15.1:0/3240656162 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa7940038e0 0x7fa794003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.613+0000 7fa7a7fff700 1 --2- 172.21.15.1:0/3240656162 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa794004690 0x7fa794004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.614+0000 7fa7ad343700 1 -- 172.21.15.1:0/3240656162 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa794004690 msgr2=0x7fa794004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:42.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.614+0000 7fa7ad343700 1 --2- 172.21.15.1:0/3240656162 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa794004690 0x7fa794004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.614+0000 7fa7ad343700 1 -- 172.21.15.1:0/3240656162 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa7940038e0 msgr2=0x7fa794003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:42.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.614+0000 7fa7ad343700 1 --2- 172.21.15.1:0/3240656162 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa7940038e0 0x7fa794003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.614+0000 7fa7ad343700 1 -- 172.21.15.1:0/3240656162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7940033f0 con 0x7fa794005000 2023-11-15T01:21:42.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.614+0000 7fa7ad343700 1 -- 172.21.15.1:0/3240656162 reap_dead start 2023-11-15T01:21:42.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.614+0000 7fa7ad343700 1 --2- 172.21.15.1:0/3240656162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794005000 0x7fa79400b8e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa7a8158060 tx=0x7fa790007bb0).ready entity=mon.0 client_cookie=7cf034fe888f5577 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:42.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.614+0000 7fa7a77fe700 1 -- 172.21.15.1:0/3240656162 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790007020 con 0x7fa794005000 2023-11-15T01:21:42.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.614+0000 7fa7a77fe700 1 -- 172.21.15.1:0/3240656162 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa790007180 con 0x7fa794005000 2023-11-15T01:21:42.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.614+0000 7fa7a77fe700 1 -- 172.21.15.1:0/3240656162 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790007500 con 0x7fa794005000 2023-11-15T01:21:42.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.614+0000 7fa7aeda6700 1 -- 172.21.15.1:0/3240656162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794005000 msgr2=0x7fa79400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.614+0000 7fa7aeda6700 1 --2- 172.21.15.1:0/3240656162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794005000 0x7fa79400b8e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa7a8158060 tx=0x7fa790007bb0).stop 2023-11-15T01:21:42.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.615+0000 7fa7aeda6700 1 -- 172.21.15.1:0/3240656162 shutdown_connections 2023-11-15T01:21:42.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.615+0000 7fa7aeda6700 1 --2- 172.21.15.1:0/3240656162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794005000 0x7fa79400b8e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.615+0000 7fa7aeda6700 1 -- 172.21.15.1:0/3240656162 >> 172.21.15.1:0/3240656162 conn(0x7fa7a80c7b20 msgr2=0x7fa7a80c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:42.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.615+0000 7fa7aeda6700 1 -- 172.21.15.1:0/3240656162 shutdown_connections 2023-11-15T01:21:42.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.615+0000 7fa7aeda6700 1 -- 172.21.15.1:0/3240656162 wait complete. 2023-11-15T01:21:42.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.616+0000 7fa7aeda6700 1 Processor -- start 2023-11-15T01:21:42.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.616+0000 7fa7aeda6700 1 -- start start 2023-11-15T01:21:42.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7aeda6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa794005000 0x7fa7a8153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7aeda6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7a8155320 0x7fa7a81557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7aeda6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa7a80633a0 0x7fa7a8063820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7aeda6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a8168460 con 0x7fa7a8155320 2023-11-15T01:21:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7aeda6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a8063d10 con 0x7fa794005000 2023-11-15T01:21:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7aeda6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a8167b70 con 0x7fa7a80633a0 2023-11-15T01:21:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7a7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7a8155320 0x7fa7a81557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7a7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7a8155320 0x7fa7a81557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54834/0 (socket says 172.21.15.1:54834) 2023-11-15T01:21:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7a7fff700 1 -- 172.21.15.1:0/310341089 learned_addr learned my addr 172.21.15.1:0/310341089 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7acb42700 1 --2- 172.21.15.1:0/310341089 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa794005000 0x7fa7a8153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7ad343700 1 --2- 172.21.15.1:0/310341089 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa7a80633a0 0x7fa7a8063820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7a7fff700 1 -- 172.21.15.1:0/310341089 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa7a80633a0 msgr2=0x7fa7a8063820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7a7fff700 1 --2- 172.21.15.1:0/310341089 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa7a80633a0 0x7fa7a8063820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7a7fff700 1 -- 172.21.15.1:0/310341089 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa794005000 msgr2=0x7fa7a8153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7a7fff700 1 --2- 172.21.15.1:0/310341089 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa794005000 0x7fa7a8153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7a7fff700 1 -- 172.21.15.1:0/310341089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a8155d70 con 0x7fa7a8155320 2023-11-15T01:21:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7acb42700 1 --2- 172.21.15.1:0/310341089 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa794005000 0x7fa7a8153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7a7fff700 1 --2- 172.21.15.1:0/310341089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7a8155320 0x7fa7a81557a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fa7980077e0 tx=0x7fa7a8158f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7a4ff9700 1 -- 172.21.15.1:0/310341089 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798011590 con 0x7fa7a8155320 2023-11-15T01:21:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7a4ff9700 1 -- 172.21.15.1:0/310341089 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7980116f0 con 0x7fa7a8155320 2023-11-15T01:21:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7aeda6700 1 -- 172.21.15.1:0/310341089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a8167e10 con 0x7fa7a8155320 2023-11-15T01:21:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7a4ff9700 1 -- 172.21.15.1:0/310341089 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798011a70 con 0x7fa7a8155320 2023-11-15T01:21:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.617+0000 7fa7aeda6700 1 -- 172.21.15.1:0/310341089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a8153500 con 0x7fa7a8155320 2023-11-15T01:21:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.618+0000 7fa7aeda6700 1 -- 172.21.15.1:0/310341089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa7a806c7e0 con 0x7fa7a8155320 2023-11-15T01:21:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.619+0000 7fa7a4ff9700 1 -- 172.21.15.1:0/310341089 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa79801d3b0 con 0x7fa7a8155320 2023-11-15T01:21:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.619+0000 7fa7a4ff9700 1 --2- 172.21.15.1:0/310341089 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa78805f150 0x7fa788061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.619+0000 7fa7a4ff9700 1 -- 172.21.15.1:0/310341089 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa798079a70 con 0x7fa7a8155320 2023-11-15T01:21:42.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.619+0000 7fa7acb42700 1 --2- 172.21.15.1:0/310341089 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa78805f150 0x7fa788061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.619+0000 7fa7a4ff9700 1 --2- 172.21.15.1:0/310341089 >> [v2:172.21.15.1:6800/90903,v1:172.21.15.1:6801/90903] conn(0x7fa788068470 0x7fa78806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.619+0000 7fa7a4ff9700 1 -- 172.21.15.1:0/310341089 --> [v2:172.21.15.1:6800/90903,v1:172.21.15.1:6801/90903] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa78806af50 con 0x7fa788068470 2023-11-15T01:21:42.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.619+0000 7fa7a4ff9700 1 -- 172.21.15.1:0/310341089 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa79807e220 con 0x7fa7a8155320 2023-11-15T01:21:42.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.619+0000 7fa7ad343700 1 --2- 172.21.15.1:0/310341089 >> [v2:172.21.15.1:6800/90903,v1:172.21.15.1:6801/90903] conn(0x7fa788068470 0x7fa78806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.619+0000 7fa7acb42700 1 --2- 172.21.15.1:0/310341089 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa78805f150 0x7fa788061610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa7a00094d0 tx=0x7fa7a000b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:42.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.620+0000 7fa7ad343700 1 --2- 172.21.15.1:0/310341089 >> [v2:172.21.15.1:6800/90903,v1:172.21.15.1:6801/90903] conn(0x7fa788068470 0x7fa78806a8d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:42.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.620+0000 7fa7a4ff9700 1 -- 172.21.15.1:0/310341089 <== osd.0 v2:172.21.15.1:6800/90903 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fa78806af50 con 0x7fa788068470 2023-11-15T01:21:42.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.634+0000 7fa7aeda6700 1 -- 172.21.15.1:0/310341089 --> [v2:172.21.15.1:6800/90903,v1:172.21.15.1:6801/90903] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa7a81589a0 con 0x7fa788068470 2023-11-15T01:21:42.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.635+0000 7fa7a4ff9700 1 -- 172.21.15.1:0/310341089 <== osd.0 v2:172.21.15.1:6800/90903 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa7a81589a0 con 0x7fa788068470 2023-11-15T01:21:42.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.635+0000 7fa7aeda6700 1 -- 172.21.15.1:0/310341089 >> [v2:172.21.15.1:6800/90903,v1:172.21.15.1:6801/90903] conn(0x7fa788068470 msgr2=0x7fa78806a8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.635+0000 7fa7aeda6700 1 --2- 172.21.15.1:0/310341089 >> [v2:172.21.15.1:6800/90903,v1:172.21.15.1:6801/90903] conn(0x7fa788068470 0x7fa78806a8d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.635+0000 7fa7aeda6700 1 -- 172.21.15.1:0/310341089 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa78805f150 msgr2=0x7fa788061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.635+0000 7fa7aeda6700 1 --2- 172.21.15.1:0/310341089 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa78805f150 0x7fa788061610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa7a00094d0 tx=0x7fa7a000b040).stop 2023-11-15T01:21:42.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.635+0000 7fa7aeda6700 1 -- 172.21.15.1:0/310341089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7a8155320 msgr2=0x7fa7a81557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.635+0000 7fa7aeda6700 1 --2- 172.21.15.1:0/310341089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7a8155320 0x7fa7a81557a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fa7980077e0 tx=0x7fa7a8158f60).stop 2023-11-15T01:21:42.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.635+0000 7fa7ad343700 1 -- 172.21.15.1:0/310341089 reap_dead start 2023-11-15T01:21:42.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.635+0000 7fa7aeda6700 1 -- 172.21.15.1:0/310341089 shutdown_connections 2023-11-15T01:21:42.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.635+0000 7fa7aeda6700 1 -- 172.21.15.1:0/310341089 >> 172.21.15.1:0/310341089 conn(0x7fa7a80c7b20 msgr2=0x7fa7a814dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:42.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.635+0000 7fa7aeda6700 1 -- 172.21.15.1:0/310341089 shutdown_connections 2023-11-15T01:21:42.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.635+0000 7fa7aeda6700 1 -- 172.21.15.1:0/310341089 wait complete. 2023-11-15T01:21:42.647 INFO:teuthology.orchestra.run.smithi001.stdout:55834574852 2023-11-15T01:21:42.647 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-15T01:21:42.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.765+0000 7f35d71e6700 1 Processor -- start 2023-11-15T01:21:42.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.765+0000 7f35d71e6700 1 -- start start 2023-11-15T01:21:42.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.766+0000 7f35d71e6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f35d0154250 0x7f35d0154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.766+0000 7f35d71e6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d0158ff0 con 0x7f35d00c6110 2023-11-15T01:21:42.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.766+0000 7f35d71e6700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d0158100 con 0x7f35d00aa700 2023-11-15T01:21:42.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.766+0000 7f35d71e6700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d01583e0 con 0x7f35d0154250 2023-11-15T01:21:42.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.766+0000 7f35d4f82700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f35d0154250 0x7f35d0154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.766+0000 7f35cffff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f35d00c6110 0x7f35d00a9ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58140/0 (socket says 172.21.15.1:58140) 2023-11-15T01:21:42.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.766+0000 7f35cffff700 1 -- 172.21.15.1:0/77531678 learned_addr learned my addr 172.21.15.1:0/77531678 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:42.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.766+0000 7f35d4f82700 1 -- 172.21.15.1:0/77531678 >> v1:172.21.15.141:6789/0 conn(0x7f35d00aa700 legacy=0x7f35d00c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.766+0000 7f35d4f82700 1 -- 172.21.15.1:0/77531678 >> v1:172.21.15.1:6789/0 conn(0x7f35d00c6110 legacy=0x7f35d00a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.766+0000 7f35cf7fe700 1 -- 172.21.15.1:0/77531678 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910193800 0 0) 0x7f35d0158100 con 0x7f35d00aa700 2023-11-15T01:21:42.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.767+0000 7f35d4f82700 1 -- 172.21.15.1:0/77531678 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d01586c0 con 0x7f35d0154250 2023-11-15T01:21:42.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.767+0000 7f35d4f82700 1 --2- 172.21.15.1:0/77531678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d0154250 0x7f35d0154630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f35c8009e60 tx=0x7f35c8009780).ready entity=mon.0 client_cookie=c18763f4394c1788 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:42.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.767+0000 7f35cf7fe700 1 -- 172.21.15.1:0/77531678 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c800e070 con 0x7f35d0154250 2023-11-15T01:21:42.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.767+0000 7f35cf7fe700 1 -- 172.21.15.1:0/77531678 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c800bb30 con 0x7f35d0154250 2023-11-15T01:21:42.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.767+0000 7f35cf7fe700 1 -- 172.21.15.1:0/77531678 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c800beb0 con 0x7f35d0154250 2023-11-15T01:21:42.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.767+0000 7f35d71e6700 1 -- 172.21.15.1:0/77531678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d0154250 msgr2=0x7f35d0154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.767+0000 7f35d71e6700 1 --2- 172.21.15.1:0/77531678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d0154250 0x7f35d0154630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f35c8009e60 tx=0x7f35c8009780).stop 2023-11-15T01:21:42.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.767+0000 7f35d71e6700 1 -- 172.21.15.1:0/77531678 shutdown_connections 2023-11-15T01:21:42.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.767+0000 7f35d71e6700 1 --2- 172.21.15.1:0/77531678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d0154250 0x7f35d0154630 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.767+0000 7f35d71e6700 1 -- 172.21.15.1:0/77531678 >> 172.21.15.1:0/77531678 conn(0x7f35d00c7b20 msgr2=0x7f35d00c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:42.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.767+0000 7f35d71e6700 1 -- 172.21.15.1:0/77531678 shutdown_connections 2023-11-15T01:21:42.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.767+0000 7f35d71e6700 1 -- 172.21.15.1:0/77531678 wait complete. 2023-11-15T01:21:42.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.768+0000 7f35d71e6700 1 Processor -- start 2023-11-15T01:21:42.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.769+0000 7f35d71e6700 1 -- start start 2023-11-15T01:21:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.769+0000 7f35d71e6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35d00aa700 0x7f35d00c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.769+0000 7f35d71e6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d00c6110 0x7f35d014c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.769+0000 7f35d71e6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35d0154250 0x7f35d0164dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.769+0000 7f35d71e6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d014cdf0 con 0x7f35d00c6110 2023-11-15T01:21:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.769+0000 7f35d71e6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0156b50 con 0x7f35d0154250 2023-11-15T01:21:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.769+0000 7f35d71e6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d01652c0 con 0x7f35d00aa700 2023-11-15T01:21:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.769+0000 7f35cffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d00c6110 0x7f35d014c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.769+0000 7f35cffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d00c6110 0x7f35d014c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54860/0 (socket says 172.21.15.1:54860) 2023-11-15T01:21:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.769+0000 7f35cffff700 1 -- 172.21.15.1:0/3766058018 learned_addr learned my addr 172.21.15.1:0/3766058018 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.770+0000 7f35d4f82700 1 --2- 172.21.15.1:0/3766058018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35d00aa700 0x7f35d00c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.770+0000 7f35d5783700 1 --2- 172.21.15.1:0/3766058018 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35d0154250 0x7f35d0164dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.770+0000 7f35cffff700 1 -- 172.21.15.1:0/3766058018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35d00aa700 msgr2=0x7f35d00c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.770+0000 7f35cffff700 1 --2- 172.21.15.1:0/3766058018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35d00aa700 0x7f35d00c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.770+0000 7f35cffff700 1 -- 172.21.15.1:0/3766058018 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35d0154250 msgr2=0x7f35d0164dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.770+0000 7f35cffff700 1 --2- 172.21.15.1:0/3766058018 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35d0154250 0x7f35d0164dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.770+0000 7f35cffff700 1 -- 172.21.15.1:0/3766058018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c8009a20 con 0x7f35d00c6110 2023-11-15T01:21:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.770+0000 7f35cffff700 1 --2- 172.21.15.1:0/3766058018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d00c6110 0x7f35d014c900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f35c400c630 tx=0x7f35c4007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.770+0000 7f35ccff9700 1 -- 172.21.15.1:0/3766058018 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c40072e0 con 0x7f35d00c6110 2023-11-15T01:21:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.770+0000 7f35ccff9700 1 -- 172.21.15.1:0/3766058018 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c4007440 con 0x7f35d00c6110 2023-11-15T01:21:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.770+0000 7f35ccff9700 1 -- 172.21.15.1:0/3766058018 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c40057a0 con 0x7f35d00c6110 2023-11-15T01:21:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.770+0000 7f35d71e6700 1 -- 172.21.15.1:0/3766058018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d0155ca0 con 0x7f35d00c6110 2023-11-15T01:21:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.770+0000 7f35d71e6700 1 -- 172.21.15.1:0/3766058018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d0155f40 con 0x7f35d00c6110 2023-11-15T01:21:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.771+0000 7f35d71e6700 1 -- 172.21.15.1:0/3766058018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f35d006c7e0 con 0x7f35d00c6110 2023-11-15T01:21:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.771+0000 7f35ccff9700 1 -- 172.21.15.1:0/3766058018 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f35c4005b50 con 0x7f35d00c6110 2023-11-15T01:21:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.772+0000 7f35ccff9700 1 --2- 172.21.15.1:0/3766058018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35bc05f150 0x7f35bc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.772+0000 7f35ccff9700 1 -- 172.21.15.1:0/3766058018 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f35c4079930 con 0x7f35d00c6110 2023-11-15T01:21:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.772+0000 7f35d4f82700 1 --2- 172.21.15.1:0/3766058018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35bc05f150 0x7f35bc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.772+0000 7f35ccff9700 1 --2- 172.21.15.1:0/3766058018 >> [v2:172.21.15.1:6816/90904,v1:172.21.15.1:6817/90904] conn(0x7f35bc0684f0 0x7f35bc06a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.772+0000 7f35ccff9700 1 -- 172.21.15.1:0/3766058018 --> [v2:172.21.15.1:6816/90904,v1:172.21.15.1:6817/90904] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35bc06afd0 con 0x7f35bc0684f0 2023-11-15T01:21:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.772+0000 7f35ccff9700 1 -- 172.21.15.1:0/3766058018 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35c407e220 con 0x7f35d00c6110 2023-11-15T01:21:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.772+0000 7f35d5783700 1 --2- 172.21.15.1:0/3766058018 >> [v2:172.21.15.1:6816/90904,v1:172.21.15.1:6817/90904] conn(0x7f35bc0684f0 0x7f35bc06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.772+0000 7f35d4f82700 1 --2- 172.21.15.1:0/3766058018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35bc05f150 0x7f35bc061610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f35c80097c0 tx=0x7f35d0158f60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.772+0000 7f35d5783700 1 --2- 172.21.15.1:0/3766058018 >> [v2:172.21.15.1:6816/90904,v1:172.21.15.1:6817/90904] conn(0x7f35bc0684f0 0x7f35bc06a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.773+0000 7f35ccff9700 1 -- 172.21.15.1:0/3766058018 <== osd.1 v2:172.21.15.1:6816/90904 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f35bc06afd0 con 0x7f35bc0684f0 2023-11-15T01:21:42.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.787+0000 7f35d71e6700 1 -- 172.21.15.1:0/3766058018 --> [v2:172.21.15.1:6816/90904,v1:172.21.15.1:6817/90904] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f35d01589a0 con 0x7f35bc0684f0 2023-11-15T01:21:42.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.787+0000 7f35ccff9700 1 -- 172.21.15.1:0/3766058018 <== osd.1 v2:172.21.15.1:6816/90904 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f35d01589a0 con 0x7f35bc0684f0 2023-11-15T01:21:42.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.788+0000 7f35d71e6700 1 -- 172.21.15.1:0/3766058018 >> [v2:172.21.15.1:6816/90904,v1:172.21.15.1:6817/90904] conn(0x7f35bc0684f0 msgr2=0x7f35bc06a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.788+0000 7f35d71e6700 1 --2- 172.21.15.1:0/3766058018 >> [v2:172.21.15.1:6816/90904,v1:172.21.15.1:6817/90904] conn(0x7f35bc0684f0 0x7f35bc06a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.788+0000 7f35d71e6700 1 -- 172.21.15.1:0/3766058018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35bc05f150 msgr2=0x7f35bc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.788+0000 7f35d71e6700 1 --2- 172.21.15.1:0/3766058018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35bc05f150 0x7f35bc061610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f35c80097c0 tx=0x7f35d0158f60).stop 2023-11-15T01:21:42.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.788+0000 7f35d71e6700 1 -- 172.21.15.1:0/3766058018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d00c6110 msgr2=0x7f35d014c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.788+0000 7f35d71e6700 1 --2- 172.21.15.1:0/3766058018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d00c6110 0x7f35d014c900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f35c400c630 tx=0x7f35c4007d70).stop 2023-11-15T01:21:42.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.788+0000 7f35d5783700 1 -- 172.21.15.1:0/3766058018 reap_dead start 2023-11-15T01:21:42.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.788+0000 7f35d71e6700 1 -- 172.21.15.1:0/3766058018 shutdown_connections 2023-11-15T01:21:42.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.788+0000 7f35d71e6700 1 -- 172.21.15.1:0/3766058018 >> 172.21.15.1:0/3766058018 conn(0x7f35d00c7b20 msgr2=0x7f35d00ad3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:42.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.788+0000 7f35d71e6700 1 -- 172.21.15.1:0/3766058018 shutdown_connections 2023-11-15T01:21:42.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.788+0000 7f35d71e6700 1 -- 172.21.15.1:0/3766058018 wait complete. 2023-11-15T01:21:42.800 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-11-15T01:21:42.800 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-15T01:21:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.918+0000 7f8b4e3fe700 1 Processor -- start 2023-11-15T01:21:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.918+0000 7f8b4e3fe700 1 -- start start 2023-11-15T01:21:42.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.919+0000 7f8b4e3fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8b48154630 0x7f8b480a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.919+0000 7f8b4e3fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b480aa4e0 0x7f8b480c9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.919+0000 7f8b4e3fe700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b48158ff0 con 0x7f8b48154250 2023-11-15T01:21:42.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.919+0000 7f8b4e3fe700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b480aa970 con 0x7f8b48154630 2023-11-15T01:21:42.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.919+0000 7f8b4e3fe700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b48158100 con 0x7f8b480aa4e0 2023-11-15T01:21:42.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.919+0000 7f8b477fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8b48154630 0x7f8b480a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.919+0000 7f8b477fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8b48154630 0x7f8b480a9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54876/0 (socket says 172.21.15.1:54876) 2023-11-15T01:21:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.919+0000 7f8b47fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8b48154250 0x7f8b480c6110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58156/0 (socket says 172.21.15.1:58156) 2023-11-15T01:21:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.919+0000 7f8b477fe700 1 -- 172.21.15.1:0/646341149 learned_addr learned my addr 172.21.15.1:0/646341149 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.919+0000 7f8b4c99b700 1 --2- 172.21.15.1:0/646341149 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b480aa4e0 0x7f8b480c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.919+0000 7f8b477fe700 1 -- 172.21.15.1:0/646341149 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b480aa4e0 msgr2=0x7f8b480c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:42.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.919+0000 7f8b477fe700 1 --2- 172.21.15.1:0/646341149 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b480aa4e0 0x7f8b480c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.920+0000 7f8b477fe700 1 -- 172.21.15.1:0/646341149 >> v1:172.21.15.1:6789/0 conn(0x7f8b48154250 legacy=0x7f8b480c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.920+0000 7f8b46ffd700 1 -- 172.21.15.1:0/646341149 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010925748 0 0) 0x7f8b48158ff0 con 0x7f8b48154250 2023-11-15T01:21:42.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.920+0000 7f8b477fe700 1 -- 172.21.15.1:0/646341149 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b481583e0 con 0x7f8b48154630 2023-11-15T01:21:42.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.920+0000 7f8b477fe700 1 --2- 172.21.15.1:0/646341149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b48154630 0x7f8b480a9ff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f8b38006fd0 tx=0x7f8b380090f0).ready entity=mon.0 client_cookie=4f5c0cc50b25d7f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.920+0000 7f8b46ffd700 1 -- 172.21.15.1:0/646341149 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800b600 con 0x7f8b48154630 2023-11-15T01:21:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.920+0000 7f8b46ffd700 1 -- 172.21.15.1:0/646341149 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3800b760 con 0x7f8b48154630 2023-11-15T01:21:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.920+0000 7f8b46ffd700 1 -- 172.21.15.1:0/646341149 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800bae0 con 0x7f8b48154630 2023-11-15T01:21:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.920+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/646341149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b48154630 msgr2=0x7f8b480a9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.920+0000 7f8b4e3fe700 1 --2- 172.21.15.1:0/646341149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b48154630 0x7f8b480a9ff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f8b38006fd0 tx=0x7f8b380090f0).stop 2023-11-15T01:21:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.920+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/646341149 shutdown_connections 2023-11-15T01:21:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.920+0000 7f8b4e3fe700 1 --2- 172.21.15.1:0/646341149 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b480aa4e0 0x7f8b480c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.920+0000 7f8b4e3fe700 1 --2- 172.21.15.1:0/646341149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b48154630 0x7f8b480a9ff0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.920+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/646341149 >> 172.21.15.1:0/646341149 conn(0x7f8b480c7b20 msgr2=0x7f8b480c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.920+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/646341149 shutdown_connections 2023-11-15T01:21:42.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.920+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/646341149 wait complete. 2023-11-15T01:21:42.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.921+0000 7f8b4e3fe700 1 Processor -- start 2023-11-15T01:21:42.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.922+0000 7f8b4e3fe700 1 -- start start 2023-11-15T01:21:42.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.922+0000 7f8b4e3fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b480aa4e0 0x7f8b480af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.922+0000 7f8b4e3fe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b48154250 0x7f8b480c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.922+0000 7f8b4e3fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b48154630 0x7f8b480c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.922+0000 7f8b4e3fe700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480aef20 con 0x7f8b48154630 2023-11-15T01:21:42.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.922+0000 7f8b4e3fe700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480af8a0 con 0x7f8b48154250 2023-11-15T01:21:42.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.922+0000 7f8b4e3fe700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480ae030 con 0x7f8b480aa4e0 2023-11-15T01:21:42.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.922+0000 7f8b4c99b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b48154630 0x7f8b480c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.923+0000 7f8b4c99b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b48154630 0x7f8b480c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54882/0 (socket says 172.21.15.1:54882) 2023-11-15T01:21:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.923+0000 7f8b4c99b700 1 -- 172.21.15.1:0/3493617323 learned_addr learned my addr 172.21.15.1:0/3493617323 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.923+0000 7f8b477fe700 1 --2- 172.21.15.1:0/3493617323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b48154250 0x7f8b480c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.923+0000 7f8b47fff700 1 --2- 172.21.15.1:0/3493617323 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b480aa4e0 0x7f8b480af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.923+0000 7f8b4c99b700 1 -- 172.21.15.1:0/3493617323 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b480aa4e0 msgr2=0x7f8b480af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.923+0000 7f8b4c99b700 1 --2- 172.21.15.1:0/3493617323 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b480aa4e0 0x7f8b480af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.923+0000 7f8b4c99b700 1 -- 172.21.15.1:0/3493617323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b48154250 msgr2=0x7f8b480c2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.923+0000 7f8b4c99b700 1 --2- 172.21.15.1:0/3493617323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b48154250 0x7f8b480c2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.923+0000 7f8b4c99b700 1 -- 172.21.15.1:0/3493617323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38009370 con 0x7f8b48154630 2023-11-15T01:21:42.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.923+0000 7f8b4c99b700 1 --2- 172.21.15.1:0/3493617323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b48154630 0x7f8b480c48f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f8b40009fd0 tx=0x7f8b40009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:42.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.923+0000 7f8b3ffff700 1 -- 172.21.15.1:0/3493617323 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000ebf0 con 0x7f8b48154630 2023-11-15T01:21:42.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.923+0000 7f8b3ffff700 1 -- 172.21.15.1:0/3493617323 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4000ed50 con 0x7f8b48154630 2023-11-15T01:21:42.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.923+0000 7f8b3ffff700 1 -- 172.21.15.1:0/3493617323 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b40014610 con 0x7f8b48154630 2023-11-15T01:21:42.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.923+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/3493617323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b480ae310 con 0x7f8b48154630 2023-11-15T01:21:42.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.923+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/3493617323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b480ae8d0 con 0x7f8b48154630 2023-11-15T01:21:42.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.924+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/3493617323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b4806c7e0 con 0x7f8b48154630 2023-11-15T01:21:42.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.924+0000 7f8b3ffff700 1 -- 172.21.15.1:0/3493617323 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8b4001d3b0 con 0x7f8b48154630 2023-11-15T01:21:42.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.925+0000 7f8b3ffff700 1 --2- 172.21.15.1:0/3493617323 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b2805f150 0x7f8b28061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.925+0000 7f8b3ffff700 1 -- 172.21.15.1:0/3493617323 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8b4007a700 con 0x7f8b48154630 2023-11-15T01:21:42.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.925+0000 7f8b47fff700 1 --2- 172.21.15.1:0/3493617323 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b2805f150 0x7f8b28061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.925+0000 7f8b3ffff700 1 --2- 172.21.15.1:0/3493617323 >> [v2:172.21.15.1:6808/90915,v1:172.21.15.1:6809/90915] conn(0x7f8b280684f0 0x7f8b2806a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:42.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.925+0000 7f8b3ffff700 1 -- 172.21.15.1:0/3493617323 --> [v2:172.21.15.1:6808/90915,v1:172.21.15.1:6809/90915] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b2806afd0 con 0x7f8b280684f0 2023-11-15T01:21:42.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.925+0000 7f8b3ffff700 1 -- 172.21.15.1:0/3493617323 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b4007cc60 con 0x7f8b48154630 2023-11-15T01:21:42.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.925+0000 7f8b477fe700 1 --2- 172.21.15.1:0/3493617323 >> [v2:172.21.15.1:6808/90915,v1:172.21.15.1:6809/90915] conn(0x7f8b280684f0 0x7f8b2806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:42.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.925+0000 7f8b47fff700 1 --2- 172.21.15.1:0/3493617323 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b2805f150 0x7f8b28061610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f8b300011e0 tx=0x7f8b30007bd0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:42.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.925+0000 7f8b477fe700 1 --2- 172.21.15.1:0/3493617323 >> [v2:172.21.15.1:6808/90915,v1:172.21.15.1:6809/90915] conn(0x7f8b280684f0 0x7f8b2806a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:42.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.926+0000 7f8b3ffff700 1 -- 172.21.15.1:0/3493617323 <== osd.2 v2:172.21.15.1:6808/90915 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f8b2806afd0 con 0x7f8b280684f0 2023-11-15T01:21:42.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.940+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/3493617323 --> [v2:172.21.15.1:6808/90915,v1:172.21.15.1:6809/90915] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8b480af0d0 con 0x7f8b280684f0 2023-11-15T01:21:42.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.941+0000 7f8b3ffff700 1 -- 172.21.15.1:0/3493617323 <== osd.2 v2:172.21.15.1:6808/90915 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8b480af0d0 con 0x7f8b280684f0 2023-11-15T01:21:42.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.941+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/3493617323 >> [v2:172.21.15.1:6808/90915,v1:172.21.15.1:6809/90915] conn(0x7f8b280684f0 msgr2=0x7f8b2806a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.941+0000 7f8b4e3fe700 1 --2- 172.21.15.1:0/3493617323 >> [v2:172.21.15.1:6808/90915,v1:172.21.15.1:6809/90915] conn(0x7f8b280684f0 0x7f8b2806a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:42.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.941+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/3493617323 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b2805f150 msgr2=0x7f8b28061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.941+0000 7f8b4e3fe700 1 --2- 172.21.15.1:0/3493617323 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b2805f150 0x7f8b28061610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f8b300011e0 tx=0x7f8b30007bd0).stop 2023-11-15T01:21:42.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.941+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/3493617323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b48154630 msgr2=0x7f8b480c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:42.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.941+0000 7f8b4e3fe700 1 --2- 172.21.15.1:0/3493617323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b48154630 0x7f8b480c48f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f8b40009fd0 tx=0x7f8b40009900).stop 2023-11-15T01:21:42.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.941+0000 7f8b4c99b700 1 -- 172.21.15.1:0/3493617323 reap_dead start 2023-11-15T01:21:42.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.941+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/3493617323 shutdown_connections 2023-11-15T01:21:42.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.941+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/3493617323 >> 172.21.15.1:0/3493617323 conn(0x7f8b480c7b20 msgr2=0x7f8b480bffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:42.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.941+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/3493617323 shutdown_connections 2023-11-15T01:21:42.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:42.941+0000 7f8b4e3fe700 1 -- 172.21.15.1:0/3493617323 wait complete. 2023-11-15T01:21:42.953 INFO:teuthology.orchestra.run.smithi001.stdout:55834574853 2023-11-15T01:21:42.953 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-15T01:21:43.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.072+0000 7f7c131a4700 1 Processor -- start 2023-11-15T01:21:43.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.072+0000 7f7c131a4700 1 -- start start 2023-11-15T01:21:43.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c131a4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c0aa700 0x7f7c0c15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c131a4700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c158ff0 con 0x7f7c0c154630 2023-11-15T01:21:43.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c131a4700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c158100 con 0x7f7c0c154250 2023-11-15T01:21:43.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c131a4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c1583e0 con 0x7f7c0c0aa700 2023-11-15T01:21:43.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c0bfff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7c0c154630 0x7f7c0c0a9ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58164/0 (socket says 172.21.15.1:58164) 2023-11-15T01:21:43.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c0bfff700 1 -- 172.21.15.1:0/1158926161 learned_addr learned my addr 172.21.15.1:0/1158926161 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:43.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c11741700 1 --2- 172.21.15.1:0/1158926161 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c0aa700 0x7f7c0c15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199108740 0 0) 0x7f7c0c158ff0 con 0x7f7c0c154630 2023-11-15T01:21:43.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bf80033f0 con 0x7f7c0c154630 2023-11-15T01:21:43.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135033372 0 0) 0x7f7c0c158100 con 0x7f7c0c154250 2023-11-15T01:21:43.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c0c158ff0 con 0x7f7c0c154250 2023-11-15T01:21:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2469703219 0 0) 0x7f7bf80033f0 con 0x7f7c0c154630 2023-11-15T01:21:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c0aa700 msgr2=0x7f7c0c15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c0b7fe700 1 --2- 172.21.15.1:0/1158926161 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c0aa700 0x7f7c0c15f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 >> v1:172.21.15.141:6789/0 conn(0x7f7c0c154250 legacy=0x7f7c0c0c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c1586c0 con 0x7f7c0c154630 2023-11-15T01:21:43.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f7bfc0017f0 con 0x7f7c0c154630 2023-11-15T01:21:43.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.073+0000 7f7c11741700 1 --2- 172.21.15.1:0/1158926161 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c0aa700 0x7f7c0c15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:43.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 >> v1:172.21.15.1:6789/0 conn(0x7f7c0c154630 legacy=0x7f7c0c0a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c0b7fe700 1 --2- 172.21.15.1:0/1158926161 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bf8003aa0 0x7f7bf8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c0b7fe700 1 --2- 172.21.15.1:0/1158926161 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c0aa700 0x7f7bf8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c0b7fe700 1 --2- 172.21.15.1:0/1158926161 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bf8004b80 0x7f7bf8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c1583e0 con 0x7f7bf8003aa0 2023-11-15T01:21:43.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf800b910 con 0x7f7bf8004b80 2023-11-15T01:21:43.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf800bad0 con 0x7f7c0c0aa700 2023-11-15T01:21:43.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c10f40700 1 --2- 172.21.15.1:0/1158926161 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bf8003aa0 0x7f7bf8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c0bfff700 1 --2- 172.21.15.1:0/1158926161 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c0aa700 0x7f7bf8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c11741700 1 --2- 172.21.15.1:0/1158926161 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bf8004b80 0x7f7bf8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c10f40700 1 -- 172.21.15.1:0/1158926161 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c0aa700 msgr2=0x7f7bf8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:43.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c10f40700 1 --2- 172.21.15.1:0/1158926161 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c0aa700 0x7f7bf8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c10f40700 1 -- 172.21.15.1:0/1158926161 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bf8004b80 msgr2=0x7f7bf8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:43.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c10f40700 1 --2- 172.21.15.1:0/1158926161 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bf8004b80 0x7f7bf8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c10f40700 1 -- 172.21.15.1:0/1158926161 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040092a0 con 0x7f7bf8003aa0 2023-11-15T01:21:43.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c10f40700 1 --2- 172.21.15.1:0/1158926161 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bf8003aa0 0x7f7bf8003ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7bf4001890 tx=0x7f7bf4007bb0).ready entity=mon.0 client_cookie=62b0aaad6e698a7b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4007020 con 0x7f7bf8003aa0 2023-11-15T01:21:43.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf4007180 con 0x7f7bf8003aa0 2023-11-15T01:21:43.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.074+0000 7f7c0b7fe700 1 -- 172.21.15.1:0/1158926161 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4007500 con 0x7f7bf8003aa0 2023-11-15T01:21:43.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.075+0000 7f7c131a4700 1 -- 172.21.15.1:0/1158926161 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bf8003aa0 msgr2=0x7f7bf8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.075+0000 7f7c131a4700 1 --2- 172.21.15.1:0/1158926161 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bf8003aa0 0x7f7bf8003ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7bf4001890 tx=0x7f7bf4007bb0).stop 2023-11-15T01:21:43.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.075+0000 7f7c11741700 1 -- 172.21.15.1:0/1158926161 reap_dead start 2023-11-15T01:21:43.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.075+0000 7f7c131a4700 1 -- 172.21.15.1:0/1158926161 shutdown_connections 2023-11-15T01:21:43.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.075+0000 7f7c131a4700 1 -- 172.21.15.1:0/1158926161 >> 172.21.15.1:0/1158926161 conn(0x7f7c0c0c7b20 msgr2=0x7f7c0c0c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:43.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.075+0000 7f7c131a4700 1 -- 172.21.15.1:0/1158926161 shutdown_connections 2023-11-15T01:21:43.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.075+0000 7f7c131a4700 1 -- 172.21.15.1:0/1158926161 wait complete. 2023-11-15T01:21:43.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.076+0000 7f7c131a4700 1 Processor -- start 2023-11-15T01:21:43.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.076+0000 7f7c131a4700 1 -- start start 2023-11-15T01:21:43.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c131a4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bf8003aa0 0x7f7c0c144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c131a4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c0ad030 0x7f7c0c0ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c131a4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c0c155f10 0x7f7c0c156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c131a4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0ad9a0 con 0x7f7c0c155f10 2023-11-15T01:21:43.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c131a4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c156ba0 con 0x7f7bf8003aa0 2023-11-15T01:21:43.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c131a4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c156e80 con 0x7f7c0c0ad030 2023-11-15T01:21:43.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c11741700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c0c155f10 0x7f7c0c156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c11741700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c0c155f10 0x7f7c0c156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54908/0 (socket says 172.21.15.1:54908) 2023-11-15T01:21:43.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c11741700 1 -- 172.21.15.1:0/1608521131 learned_addr learned my addr 172.21.15.1:0/1608521131 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:43.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c10f40700 1 --2- 172.21.15.1:0/1608521131 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bf8003aa0 0x7f7c0c144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c0bfff700 1 --2- 172.21.15.1:0/1608521131 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c0ad030 0x7f7c0c0ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c11741700 1 -- 172.21.15.1:0/1608521131 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c0ad030 msgr2=0x7f7c0c0ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c11741700 1 --2- 172.21.15.1:0/1608521131 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c0ad030 0x7f7c0c0ad4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c11741700 1 -- 172.21.15.1:0/1608521131 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bf8003aa0 msgr2=0x7f7c0c144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c11741700 1 --2- 172.21.15.1:0/1608521131 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bf8003aa0 0x7f7c0c144cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c11741700 1 -- 172.21.15.1:0/1608521131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c157160 con 0x7f7c0c155f10 2023-11-15T01:21:43.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.077+0000 7f7c11741700 1 --2- 172.21.15.1:0/1608521131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c0c155f10 0x7f7c0c156370 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f7c0c0aab10 tx=0x7f7c04009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.078+0000 7f7c08ff9700 1 -- 172.21.15.1:0/1608521131 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04013680 con 0x7f7c0c155f10 2023-11-15T01:21:43.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.078+0000 7f7c08ff9700 1 -- 172.21.15.1:0/1608521131 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c040137e0 con 0x7f7c0c155f10 2023-11-15T01:21:43.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.078+0000 7f7c131a4700 1 -- 172.21.15.1:0/1608521131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c157440 con 0x7f7c0c155f10 2023-11-15T01:21:43.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.078+0000 7f7c08ff9700 1 -- 172.21.15.1:0/1608521131 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04013b60 con 0x7f7c0c155f10 2023-11-15T01:21:43.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.078+0000 7f7c131a4700 1 -- 172.21.15.1:0/1608521131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c156860 con 0x7f7c0c155f10 2023-11-15T01:21:43.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.078+0000 7f7c131a4700 1 -- 172.21.15.1:0/1608521131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c0c06c7e0 con 0x7f7c0c155f10 2023-11-15T01:21:43.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.079+0000 7f7c08ff9700 1 -- 172.21.15.1:0/1608521131 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7c04014440 con 0x7f7c0c155f10 2023-11-15T01:21:43.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.079+0000 7f7c08ff9700 1 --2- 172.21.15.1:0/1608521131 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7bec05f120 0x7f7bec0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.079+0000 7f7c08ff9700 1 -- 172.21.15.1:0/1608521131 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7c0407a290 con 0x7f7c0c155f10 2023-11-15T01:21:43.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.079+0000 7f7c08ff9700 1 --2- 172.21.15.1:0/1608521131 >> [v2:172.21.15.1:6824/90920,v1:172.21.15.1:6825/90920] conn(0x7f7bec0684c0 0x7f7bec06a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.079+0000 7f7c10f40700 1 --2- 172.21.15.1:0/1608521131 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7bec05f120 0x7f7bec0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.079+0000 7f7c08ff9700 1 -- 172.21.15.1:0/1608521131 --> [v2:172.21.15.1:6824/90920,v1:172.21.15.1:6825/90920] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7bec06afa0 con 0x7f7bec0684c0 2023-11-15T01:21:43.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.079+0000 7f7c08ff9700 1 -- 172.21.15.1:0/1608521131 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c0407c7f0 con 0x7f7c0c155f10 2023-11-15T01:21:43.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.080+0000 7f7c0bfff700 1 --2- 172.21.15.1:0/1608521131 >> [v2:172.21.15.1:6824/90920,v1:172.21.15.1:6825/90920] conn(0x7f7bec0684c0 0x7f7bec06a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.080+0000 7f7c10f40700 1 --2- 172.21.15.1:0/1608521131 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7bec05f120 0x7f7bec0615e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f7c0c0c4cb0 tx=0x7f7bf4016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.080+0000 7f7c0bfff700 1 --2- 172.21.15.1:0/1608521131 >> [v2:172.21.15.1:6824/90920,v1:172.21.15.1:6825/90920] conn(0x7f7bec0684c0 0x7f7bec06a920 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.080+0000 7f7c08ff9700 1 -- 172.21.15.1:0/1608521131 <== osd.3 v2:172.21.15.1:6824/90920 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f7bec06afa0 con 0x7f7bec0684c0 2023-11-15T01:21:43.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.095+0000 7f7c131a4700 1 -- 172.21.15.1:0/1608521131 --> [v2:172.21.15.1:6824/90920,v1:172.21.15.1:6825/90920] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7c0c157960 con 0x7f7bec0684c0 2023-11-15T01:21:43.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.095+0000 7f7c08ff9700 1 -- 172.21.15.1:0/1608521131 <== osd.3 v2:172.21.15.1:6824/90920 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7c0c157960 con 0x7f7bec0684c0 2023-11-15T01:21:43.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.095+0000 7f7c131a4700 1 -- 172.21.15.1:0/1608521131 >> [v2:172.21.15.1:6824/90920,v1:172.21.15.1:6825/90920] conn(0x7f7bec0684c0 msgr2=0x7f7bec06a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.095+0000 7f7c131a4700 1 --2- 172.21.15.1:0/1608521131 >> [v2:172.21.15.1:6824/90920,v1:172.21.15.1:6825/90920] conn(0x7f7bec0684c0 0x7f7bec06a920 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.095+0000 7f7c131a4700 1 -- 172.21.15.1:0/1608521131 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7bec05f120 msgr2=0x7f7bec0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.095+0000 7f7c131a4700 1 --2- 172.21.15.1:0/1608521131 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7bec05f120 0x7f7bec0615e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f7c0c0c4cb0 tx=0x7f7bf4016000).stop 2023-11-15T01:21:43.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.095+0000 7f7c131a4700 1 -- 172.21.15.1:0/1608521131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c0c155f10 msgr2=0x7f7c0c156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.095+0000 7f7c131a4700 1 --2- 172.21.15.1:0/1608521131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c0c155f10 0x7f7c0c156370 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f7c0c0aab10 tx=0x7f7c04009060).stop 2023-11-15T01:21:43.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.095+0000 7f7c11741700 1 -- 172.21.15.1:0/1608521131 reap_dead start 2023-11-15T01:21:43.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.095+0000 7f7c131a4700 1 -- 172.21.15.1:0/1608521131 shutdown_connections 2023-11-15T01:21:43.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.095+0000 7f7c131a4700 1 -- 172.21.15.1:0/1608521131 >> 172.21.15.1:0/1608521131 conn(0x7f7c0c0c7b20 msgr2=0x7f7c0c0ca020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:43.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.096+0000 7f7c131a4700 1 -- 172.21.15.1:0/1608521131 shutdown_connections 2023-11-15T01:21:43.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.096+0000 7f7c131a4700 1 -- 172.21.15.1:0/1608521131 wait complete. 2023-11-15T01:21:43.107 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-11-15T01:21:43.108 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-15T01:21:43.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.226+0000 7fd1cf154700 1 Processor -- start 2023-11-15T01:21:43.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.226+0000 7fd1cf154700 1 -- start start 2023-11-15T01:21:43.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1cf154700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd1c8151e10 0x7fd1c8155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1cf154700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd1c80c98b0 0x7fd1c80c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1cf154700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c80c7980 con 0x7fd1c80c86b0 2023-11-15T01:21:43.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1cf154700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c80c8b10 con 0x7fd1c8151e10 2023-11-15T01:21:43.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1cf154700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c80aa890 con 0x7fd1c80c98b0 2023-11-15T01:21:43.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1ce152700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd1c8151e10 0x7fd1c8155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1ce152700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd1c8151e10 0x7fd1c8155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54910/0 (socket says 172.21.15.1:54910) 2023-11-15T01:21:43.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1ce152700 1 -- 172.21.15.1:0/704776284 learned_addr learned my addr 172.21.15.1:0/704776284 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:43.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1ce953700 1 --2- 172.21.15.1:0/704776284 >> v2:172.21.15.141:3300/0 conn(0x7fd1c80c98b0 0x7fd1c80c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1ce152700 1 -- 172.21.15.1:0/704776284 >> v2:172.21.15.141:3300/0 conn(0x7fd1c80c98b0 msgr2=0x7fd1c80c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:43.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1ce152700 1 --2- 172.21.15.1:0/704776284 >> v2:172.21.15.141:3300/0 conn(0x7fd1c80c98b0 0x7fd1c80c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1ce152700 1 -- 172.21.15.1:0/704776284 >> v1:172.21.15.141:6789/0 conn(0x7fd1c80c86b0 legacy=0x7fd1c80aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1ce152700 1 -- 172.21.15.1:0/704776284 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80c7bd0 con 0x7fd1c8151e10 2023-11-15T01:21:43.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1ce953700 1 --2- 172.21.15.1:0/704776284 >> v2:172.21.15.141:3300/0 conn(0x7fd1c80c98b0 0x7fd1c80c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:43.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1ce152700 1 --2- 172.21.15.1:0/704776284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1c8151e10 0x7fd1c8155530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd1c80c9730 tx=0x7fd1b80090f0).ready entity=mon.0 client_cookie=4faad6cbf34dd349 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.227+0000 7fd1cd150700 1 -- 172.21.15.1:0/704776284 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b800b600 con 0x7fd1c8151e10 2023-11-15T01:21:43.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.228+0000 7fd1cd150700 1 -- 172.21.15.1:0/704776284 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b800b760 con 0x7fd1c8151e10 2023-11-15T01:21:43.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.228+0000 7fd1cd150700 1 -- 172.21.15.1:0/704776284 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b800bae0 con 0x7fd1c8151e10 2023-11-15T01:21:43.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.228+0000 7fd1cf154700 1 -- 172.21.15.1:0/704776284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1c8151e10 msgr2=0x7fd1c8155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.228+0000 7fd1cf154700 1 --2- 172.21.15.1:0/704776284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1c8151e10 0x7fd1c8155530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd1c80c9730 tx=0x7fd1b80090f0).stop 2023-11-15T01:21:43.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.228+0000 7fd1cf154700 1 -- 172.21.15.1:0/704776284 shutdown_connections 2023-11-15T01:21:43.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.228+0000 7fd1cf154700 1 --2- 172.21.15.1:0/704776284 >> v2:172.21.15.141:3300/0 conn(0x7fd1c80c98b0 0x7fd1c80c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.228+0000 7fd1cf154700 1 --2- 172.21.15.1:0/704776284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1c8151e10 0x7fd1c8155530 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.228+0000 7fd1cf154700 1 -- 172.21.15.1:0/704776284 >> 172.21.15.1:0/704776284 conn(0x7fd1c80947e0 msgr2=0x7fd1c806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:43.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.228+0000 7fd1cf154700 1 -- 172.21.15.1:0/704776284 shutdown_connections 2023-11-15T01:21:43.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.228+0000 7fd1cf154700 1 -- 172.21.15.1:0/704776284 wait complete. 2023-11-15T01:21:43.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.229+0000 7fd1cf154700 1 Processor -- start 2023-11-15T01:21:43.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.229+0000 7fd1cf154700 1 -- start start 2023-11-15T01:21:43.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1cf154700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1c80c86b0 0x7fd1c80aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1cf154700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1c80c98b0 0x7fd1c80a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1cf154700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1c8151e10 0x7fd1c81531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1cf154700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c80af230 con 0x7fd1c80c86b0 2023-11-15T01:21:43.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1cf154700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c80af9e0 con 0x7fd1c80c98b0 2023-11-15T01:21:43.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1cf154700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c80a9a50 con 0x7fd1c8151e10 2023-11-15T01:21:43.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1ce152700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1c80c86b0 0x7fd1c80aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1ce152700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1c80c86b0 0x7fd1c80aed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54920/0 (socket says 172.21.15.1:54920) 2023-11-15T01:21:43.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1ce152700 1 -- 172.21.15.1:0/3368894463 learned_addr learned my addr 172.21.15.1:0/3368894463 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:43.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1cd951700 1 --2- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1c80c98b0 0x7fd1c80a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1ce953700 1 --2- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1c8151e10 0x7fd1c81531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1ce152700 1 -- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1c8151e10 msgr2=0x7fd1c81531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1ce152700 1 --2- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1c8151e10 0x7fd1c81531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1ce152700 1 -- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1c80c98b0 msgr2=0x7fd1c80a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1ce152700 1 --2- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1c80c98b0 0x7fd1c80a9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1ce152700 1 -- 172.21.15.1:0/3368894463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b8009370 con 0x7fd1c80c86b0 2023-11-15T01:21:43.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1cd951700 1 --2- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1c80c98b0 0x7fd1c80a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:43.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.230+0000 7fd1ce152700 1 --2- 172.21.15.1:0/3368894463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1c80c86b0 0x7fd1c80aed40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd1c8084670 tx=0x7fd1b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.231+0000 7fd1c67fc700 1 -- 172.21.15.1:0/3368894463 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b800b8d0 con 0x7fd1c80c86b0 2023-11-15T01:21:43.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.231+0000 7fd1c67fc700 1 -- 172.21.15.1:0/3368894463 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b800ba30 con 0x7fd1c80c86b0 2023-11-15T01:21:43.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.231+0000 7fd1cf154700 1 -- 172.21.15.1:0/3368894463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c80af420 con 0x7fd1c80c86b0 2023-11-15T01:21:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.231+0000 7fd1c67fc700 1 -- 172.21.15.1:0/3368894463 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b801b660 con 0x7fd1c80c86b0 2023-11-15T01:21:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.231+0000 7fd1cf154700 1 -- 172.21.15.1:0/3368894463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c80a96e0 con 0x7fd1c80c86b0 2023-11-15T01:21:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.231+0000 7fd1cf154700 1 -- 172.21.15.1:0/3368894463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1c80475e0 con 0x7fd1c80c86b0 2023-11-15T01:21:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.232+0000 7fd1c67fc700 1 -- 172.21.15.1:0/3368894463 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd1b801b9d0 con 0x7fd1c80c86b0 2023-11-15T01:21:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.232+0000 7fd1c67fc700 1 --2- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd1b405f150 0x7fd1b4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.232+0000 7fd1c67fc700 1 -- 172.21.15.1:0/3368894463 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd1b807b6f0 con 0x7fd1c80c86b0 2023-11-15T01:21:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.232+0000 7fd1c67fc700 1 --2- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:6800/91135,v1:172.21.15.141:6802/91135] conn(0x7fd1b40684f0 0x7fd1b406a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.232+0000 7fd1c67fc700 1 -- 172.21.15.1:0/3368894463 --> [v2:172.21.15.141:6800/91135,v1:172.21.15.141:6802/91135] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1b406afd0 con 0x7fd1b40684f0 2023-11-15T01:21:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.232+0000 7fd1c67fc700 1 -- 172.21.15.1:0/3368894463 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1b807dd10 con 0x7fd1c80c86b0 2023-11-15T01:21:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.232+0000 7fd1cd951700 1 --2- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd1b405f150 0x7fd1b4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.233+0000 7fd1ce953700 1 --2- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:6800/91135,v1:172.21.15.141:6802/91135] conn(0x7fd1b40684f0 0x7fd1b406a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.233+0000 7fd1cd951700 1 --2- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd1b405f150 0x7fd1b4061610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd1c80b12c0 tx=0x7fd1bc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.233+0000 7fd1ce953700 1 --2- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:6800/91135,v1:172.21.15.141:6802/91135] conn(0x7fd1b40684f0 0x7fd1b406a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.234+0000 7fd1c67fc700 1 -- 172.21.15.1:0/3368894463 <== osd.4 v2:172.21.15.141:6800/91135 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fd1b406afd0 con 0x7fd1b40684f0 2023-11-15T01:21:43.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.248+0000 7fd1cf154700 1 -- 172.21.15.1:0/3368894463 --> [v2:172.21.15.141:6800/91135,v1:172.21.15.141:6802/91135] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd1c80aa610 con 0x7fd1b40684f0 2023-11-15T01:21:43.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.248+0000 7fd1c67fc700 1 -- 172.21.15.1:0/3368894463 <== osd.4 v2:172.21.15.141:6800/91135 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd1c80aa610 con 0x7fd1b40684f0 2023-11-15T01:21:43.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.249+0000 7fd1cf154700 1 -- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:6800/91135,v1:172.21.15.141:6802/91135] conn(0x7fd1b40684f0 msgr2=0x7fd1b406a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.249+0000 7fd1cf154700 1 --2- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:6800/91135,v1:172.21.15.141:6802/91135] conn(0x7fd1b40684f0 0x7fd1b406a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.249+0000 7fd1cf154700 1 -- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd1b405f150 msgr2=0x7fd1b4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.249+0000 7fd1cf154700 1 --2- 172.21.15.1:0/3368894463 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd1b405f150 0x7fd1b4061610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd1c80b12c0 tx=0x7fd1bc009040).stop 2023-11-15T01:21:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.249+0000 7fd1cf154700 1 -- 172.21.15.1:0/3368894463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1c80c86b0 msgr2=0x7fd1c80aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.249+0000 7fd1cf154700 1 --2- 172.21.15.1:0/3368894463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1c80c86b0 0x7fd1c80aed40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd1c8084670 tx=0x7fd1b8017000).stop 2023-11-15T01:21:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.249+0000 7fd1ce953700 1 -- 172.21.15.1:0/3368894463 reap_dead start 2023-11-15T01:21:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.249+0000 7fd1cf154700 1 -- 172.21.15.1:0/3368894463 shutdown_connections 2023-11-15T01:21:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.249+0000 7fd1cf154700 1 -- 172.21.15.1:0/3368894463 >> 172.21.15.1:0/3368894463 conn(0x7fd1c80947e0 msgr2=0x7fd1c80635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.249+0000 7fd1cf154700 1 -- 172.21.15.1:0/3368894463 shutdown_connections 2023-11-15T01:21:43.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.249+0000 7fd1cf154700 1 -- 172.21.15.1:0/3368894463 wait complete. 2023-11-15T01:21:43.260 INFO:teuthology.orchestra.run.smithi001.stdout:55834574852 2023-11-15T01:21:43.261 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-15T01:21:43.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.379+0000 7f4f60eb7700 1 Processor -- start 2023-11-15T01:21:43.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.379+0000 7f4f60eb7700 1 -- start start 2023-11-15T01:21:43.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.380+0000 7f4f60eb7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4f5c0bccd0 0x7f4f5c0bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.380+0000 7f4f60eb7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4f5c0c60b0 0x7f4f5c0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.380+0000 7f4f60eb7700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5c06a6b0 con 0x7f4f5c154680 2023-11-15T01:21:43.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.380+0000 7f4f60eb7700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5c0c3360 con 0x7f4f5c0bccd0 2023-11-15T01:21:43.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.380+0000 7f4f60eb7700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5c0bd620 con 0x7f4f5c0c60b0 2023-11-15T01:21:43.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.381+0000 7f4f59d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4f5c0bccd0 0x7f4f5c0bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.381+0000 7f4f5a59c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4f5c154680 0x7f4f5c069fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58174/0 (socket says 172.21.15.1:58174) 2023-11-15T01:21:43.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.381+0000 7f4f5a59c700 1 -- 172.21.15.1:0/3508719189 learned_addr learned my addr 172.21.15.1:0/3508719189 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:43.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.381+0000 7f4f5ad9d700 1 --2- 172.21.15.1:0/3508719189 >> v2:172.21.15.141:3300/0 conn(0x7f4f5c0c60b0 0x7f4f5c0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.381+0000 7f4f59d9b700 1 -- 172.21.15.1:0/3508719189 >> v2:172.21.15.141:3300/0 conn(0x7f4f5c0c60b0 msgr2=0x7f4f5c0c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:43.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.381+0000 7f4f59d9b700 1 --2- 172.21.15.1:0/3508719189 >> v2:172.21.15.141:3300/0 conn(0x7f4f5c0c60b0 0x7f4f5c0c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.381+0000 7f4f59d9b700 1 -- 172.21.15.1:0/3508719189 >> v1:172.21.15.1:6789/0 conn(0x7f4f5c154680 legacy=0x7f4f5c069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.381+0000 7f4f5959a700 1 -- 172.21.15.1:0/3508719189 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998294947 0 0) 0x7f4f5c06a6b0 con 0x7f4f5c154680 2023-11-15T01:21:43.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.381+0000 7f4f59d9b700 1 -- 172.21.15.1:0/3508719189 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0c2750 con 0x7f4f5c0bccd0 2023-11-15T01:21:43.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.381+0000 7f4f59d9b700 1 --2- 172.21.15.1:0/3508719189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f5c0bccd0 0x7f4f5c0bd130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f4f5c064cc0 tx=0x7f4f44009060).ready entity=mon.0 client_cookie=fd55d92728f3d1ea server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.381+0000 7f4f5959a700 1 -- 172.21.15.1:0/3508719189 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400b580 con 0x7f4f5c0bccd0 2023-11-15T01:21:43.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.381+0000 7f4f5959a700 1 -- 172.21.15.1:0/3508719189 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4400b6e0 con 0x7f4f5c0bccd0 2023-11-15T01:21:43.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.381+0000 7f4f5959a700 1 -- 172.21.15.1:0/3508719189 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400ba60 con 0x7f4f5c0bccd0 2023-11-15T01:21:43.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.382+0000 7f4f60eb7700 1 -- 172.21.15.1:0/3508719189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f5c0bccd0 msgr2=0x7f4f5c0bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.382+0000 7f4f60eb7700 1 --2- 172.21.15.1:0/3508719189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f5c0bccd0 0x7f4f5c0bd130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f4f5c064cc0 tx=0x7f4f44009060).stop 2023-11-15T01:21:43.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.382+0000 7f4f60eb7700 1 -- 172.21.15.1:0/3508719189 shutdown_connections 2023-11-15T01:21:43.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.382+0000 7f4f60eb7700 1 --2- 172.21.15.1:0/3508719189 >> v2:172.21.15.141:3300/0 conn(0x7f4f5c0c60b0 0x7f4f5c0c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.382+0000 7f4f60eb7700 1 --2- 172.21.15.1:0/3508719189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f5c0bccd0 0x7f4f5c0bd130 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.382+0000 7f4f60eb7700 1 -- 172.21.15.1:0/3508719189 >> 172.21.15.1:0/3508719189 conn(0x7f4f5c0c7d70 msgr2=0x7f4f5c0c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:43.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.382+0000 7f4f60eb7700 1 -- 172.21.15.1:0/3508719189 shutdown_connections 2023-11-15T01:21:43.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.382+0000 7f4f60eb7700 1 -- 172.21.15.1:0/3508719189 wait complete. 2023-11-15T01:21:43.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.383+0000 7f4f60eb7700 1 Processor -- start 2023-11-15T01:21:43.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.383+0000 7f4f60eb7700 1 -- start start 2023-11-15T01:21:43.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f60eb7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f5c0bccd0 0x7f4f5c0a8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f60eb7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f5c0c60b0 0x7f4f5c0aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f60eb7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f5c154680 0x7f4f5c0bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f60eb7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0ab210 con 0x7f4f5c0c60b0 2023-11-15T01:21:43.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f60eb7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0a95a0 con 0x7f4f5c0bccd0 2023-11-15T01:21:43.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f60eb7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0c02f0 con 0x7f4f5c154680 2023-11-15T01:21:43.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f59d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f5c0c60b0 0x7f4f5c0aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f59d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f5c0c60b0 0x7f4f5c0aad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54930/0 (socket says 172.21.15.1:54930) 2023-11-15T01:21:43.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f59d9b700 1 -- 172.21.15.1:0/588022688 learned_addr learned my addr 172.21.15.1:0/588022688 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:43.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f5a59c700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f5c0bccd0 0x7f4f5c0a8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f5ad9d700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f5c154680 0x7f4f5c0bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f59d9b700 1 -- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f5c154680 msgr2=0x7f4f5c0bfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f59d9b700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f5c154680 0x7f4f5c0bfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f59d9b700 1 -- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f5c0bccd0 msgr2=0x7f4f5c0a8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f59d9b700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f5c0bccd0 0x7f4f5c0a8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f59d9b700 1 -- 172.21.15.1:0/588022688 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f440092a0 con 0x7f4f5c0c60b0 2023-11-15T01:21:43.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f5a59c700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f5c0bccd0 0x7f4f5c0a8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:43.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f5ad9d700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f5c154680 0x7f4f5c0bfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:43.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f59d9b700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f5c0c60b0 0x7f4f5c0aad20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f4f44009fd0 tx=0x7f4f44017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f527fc700 1 -- 172.21.15.1:0/588022688 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400b850 con 0x7f4f5c0c60b0 2023-11-15T01:21:43.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f527fc700 1 -- 172.21.15.1:0/588022688 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4400b9b0 con 0x7f4f5c0c60b0 2023-11-15T01:21:43.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f60eb7700 1 -- 172.21.15.1:0/588022688 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5c0c0550 con 0x7f4f5c0c60b0 2023-11-15T01:21:43.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f527fc700 1 -- 172.21.15.1:0/588022688 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4401b660 con 0x7f4f5c0c60b0 2023-11-15T01:21:43.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.384+0000 7f4f60eb7700 1 -- 172.21.15.1:0/588022688 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5c0a9230 con 0x7f4f5c0c60b0 2023-11-15T01:21:43.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.385+0000 7f4f60eb7700 1 -- 172.21.15.1:0/588022688 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f5c06c7e0 con 0x7f4f5c0c60b0 2023-11-15T01:21:43.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.386+0000 7f4f527fc700 1 -- 172.21.15.1:0/588022688 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4f4401ba90 con 0x7f4f5c0c60b0 2023-11-15T01:21:43.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.386+0000 7f4f527fc700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f3c05f150 0x7f4f3c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.386+0000 7f4f527fc700 1 -- 172.21.15.1:0/588022688 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4f4407bc60 con 0x7f4f5c0c60b0 2023-11-15T01:21:43.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.386+0000 7f4f527fc700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:6816/91137,v1:172.21.15.141:6817/91137] conn(0x7f4f3c0684f0 0x7f4f3c06a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.386+0000 7f4f527fc700 1 -- 172.21.15.1:0/588022688 --> [v2:172.21.15.141:6816/91137,v1:172.21.15.141:6817/91137] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f3c06afd0 con 0x7f4f3c0684f0 2023-11-15T01:21:43.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.386+0000 7f4f527fc700 1 -- 172.21.15.1:0/588022688 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f44081070 con 0x7f4f5c0c60b0 2023-11-15T01:21:43.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.386+0000 7f4f5a59c700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f3c05f150 0x7f4f3c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.386+0000 7f4f5ad9d700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:6816/91137,v1:172.21.15.141:6817/91137] conn(0x7f4f3c0684f0 0x7f4f3c06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.386+0000 7f4f5a59c700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f3c05f150 0x7f4f3c061610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f4f540016f0 tx=0x7f4f54009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.387+0000 7f4f5ad9d700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:6816/91137,v1:172.21.15.141:6817/91137] conn(0x7f4f3c0684f0 0x7f4f3c06a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.387+0000 7f4f527fc700 1 -- 172.21.15.1:0/588022688 <== osd.5 v2:172.21.15.141:6816/91137 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f4f3c06afd0 con 0x7f4f3c0684f0 2023-11-15T01:21:43.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.402+0000 7f4f60eb7700 1 -- 172.21.15.1:0/588022688 --> [v2:172.21.15.141:6816/91137,v1:172.21.15.141:6817/91137] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4f5c0a9730 con 0x7f4f3c0684f0 2023-11-15T01:21:43.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.402+0000 7f4f527fc700 1 -- 172.21.15.1:0/588022688 <== osd.5 v2:172.21.15.141:6816/91137 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4f5c0a9730 con 0x7f4f3c0684f0 2023-11-15T01:21:43.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.403+0000 7f4f60eb7700 1 -- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:6816/91137,v1:172.21.15.141:6817/91137] conn(0x7f4f3c0684f0 msgr2=0x7f4f3c06a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.403+0000 7f4f60eb7700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:6816/91137,v1:172.21.15.141:6817/91137] conn(0x7f4f3c0684f0 0x7f4f3c06a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.403+0000 7f4f60eb7700 1 -- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f3c05f150 msgr2=0x7f4f3c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.403+0000 7f4f60eb7700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f3c05f150 0x7f4f3c061610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f4f540016f0 tx=0x7f4f54009040).stop 2023-11-15T01:21:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.403+0000 7f4f60eb7700 1 -- 172.21.15.1:0/588022688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f5c0c60b0 msgr2=0x7f4f5c0aad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.403+0000 7f4f60eb7700 1 --2- 172.21.15.1:0/588022688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f5c0c60b0 0x7f4f5c0aad20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f4f44009fd0 tx=0x7f4f44017000).stop 2023-11-15T01:21:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.403+0000 7f4f5ad9d700 1 -- 172.21.15.1:0/588022688 reap_dead start 2023-11-15T01:21:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.403+0000 7f4f60eb7700 1 -- 172.21.15.1:0/588022688 shutdown_connections 2023-11-15T01:21:43.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.403+0000 7f4f60eb7700 1 -- 172.21.15.1:0/588022688 >> 172.21.15.1:0/588022688 conn(0x7f4f5c0c7d70 msgr2=0x7f4f5c066560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:43.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.403+0000 7f4f60eb7700 1 -- 172.21.15.1:0/588022688 shutdown_connections 2023-11-15T01:21:43.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.403+0000 7f4f60eb7700 1 -- 172.21.15.1:0/588022688 wait complete. 2023-11-15T01:21:43.415 INFO:teuthology.orchestra.run.smithi001.stdout:55834574852 2023-11-15T01:21:43.415 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-15T01:21:43.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.533+0000 7f2ad19c6700 1 Processor -- start 2023-11-15T01:21:43.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.533+0000 7f2ad19c6700 1 -- start start 2023-11-15T01:21:43.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.534+0000 7f2ad19c6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2acc0c6900 0x7f2acc154af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.534+0000 7f2ad19c6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2acc0c97b0 0x7f2acc0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.534+0000 7f2ad19c6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2acc1582b0 con 0x7f2acc0c6520 2023-11-15T01:21:43.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.534+0000 7f2ad19c6700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2acc155b10 con 0x7f2acc0c97b0 2023-11-15T01:21:43.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.534+0000 7f2ad19c6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc154fe0 con 0x7f2acc0c6900 2023-11-15T01:21:43.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.534+0000 7f2acb7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2acc0c97b0 0x7f2acc0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.534+0000 7f2acaffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2acc0c6520 0x7f2acc0aa420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58184/0 (socket says 172.21.15.1:58184) 2023-11-15T01:21:43.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.534+0000 7f2acaffd700 1 -- 172.21.15.1:0/2463444059 learned_addr learned my addr 172.21.15.1:0/2463444059 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:43.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.535+0000 7f2aca7fc700 1 --2- 172.21.15.1:0/2463444059 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2acc0c6900 0x7f2acc154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.535+0000 7f2acb7fe700 1 -- 172.21.15.1:0/2463444059 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2acc0c6900 msgr2=0x7f2acc154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:43.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.535+0000 7f2acb7fe700 1 --2- 172.21.15.1:0/2463444059 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2acc0c6900 0x7f2acc154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.535+0000 7f2acb7fe700 1 -- 172.21.15.1:0/2463444059 >> v1:172.21.15.1:6789/0 conn(0x7f2acc0c6520 legacy=0x7f2acc0aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.535+0000 7f2acb7fe700 1 -- 172.21.15.1:0/2463444059 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc155270 con 0x7f2acc0c97b0 2023-11-15T01:21:43.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.535+0000 7f2ac9ffb700 1 -- 172.21.15.1:0/2463444059 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392642317 0 0) 0x7f2acc1582b0 con 0x7f2acc0c6520 2023-11-15T01:21:43.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.535+0000 7f2acb7fe700 1 --2- 172.21.15.1:0/2463444059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2acc0c97b0 0x7f2acc0c9c60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f2abc009760 tx=0x7f2abc009060).ready entity=mon.0 client_cookie=3cd46ce2c9206450 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.535+0000 7f2ac9ffb700 1 -- 172.21.15.1:0/2463444059 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00b580 con 0x7f2acc0c97b0 2023-11-15T01:21:43.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.535+0000 7f2ac9ffb700 1 -- 172.21.15.1:0/2463444059 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc00b6e0 con 0x7f2acc0c97b0 2023-11-15T01:21:43.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.535+0000 7f2ac9ffb700 1 -- 172.21.15.1:0/2463444059 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00ba60 con 0x7f2acc0c97b0 2023-11-15T01:21:43.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.535+0000 7f2ad19c6700 1 -- 172.21.15.1:0/2463444059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2acc0c97b0 msgr2=0x7f2acc0c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.536+0000 7f2ad19c6700 1 --2- 172.21.15.1:0/2463444059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2acc0c97b0 0x7f2acc0c9c60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f2abc009760 tx=0x7f2abc009060).stop 2023-11-15T01:21:43.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.536+0000 7f2ad19c6700 1 -- 172.21.15.1:0/2463444059 shutdown_connections 2023-11-15T01:21:43.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.536+0000 7f2ad19c6700 1 --2- 172.21.15.1:0/2463444059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2acc0c97b0 0x7f2acc0c9c60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.536+0000 7f2ad19c6700 1 --2- 172.21.15.1:0/2463444059 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2acc0c6900 0x7f2acc154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.536+0000 7f2ad19c6700 1 -- 172.21.15.1:0/2463444059 >> 172.21.15.1:0/2463444059 conn(0x7f2acc0cb060 msgr2=0x7f2acc0cb470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:43.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.536+0000 7f2ad19c6700 1 -- 172.21.15.1:0/2463444059 shutdown_connections 2023-11-15T01:21:43.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.536+0000 7f2ad19c6700 1 -- 172.21.15.1:0/2463444059 wait complete. 2023-11-15T01:21:43.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.537+0000 7f2ad19c6700 1 Processor -- start 2023-11-15T01:21:43.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.537+0000 7f2ad19c6700 1 -- start start 2023-11-15T01:21:43.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2ad19c6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2acc0c6520 0x7f2acc13c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2ad19c6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2acc0c6900 0x7f2acc0ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2ad19c6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2acc0c97b0 0x7f2acc0ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2ad19c6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0ae9f0 con 0x7f2acc0c97b0 2023-11-15T01:21:43.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2ad19c6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc14f130 con 0x7f2acc0c6900 2023-11-15T01:21:43.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2ad19c6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc14e520 con 0x7f2acc0c6520 2023-11-15T01:21:43.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2acb7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2acc0c97b0 0x7f2acc0ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2acb7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2acc0c97b0 0x7f2acc0ae500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54948/0 (socket says 172.21.15.1:54948) 2023-11-15T01:21:43.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2acb7fe700 1 -- 172.21.15.1:0/1237070003 learned_addr learned my addr 172.21.15.1:0/1237070003 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:43.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2acb7fe700 1 -- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2acc0c6520 msgr2=0x7f2acc13c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2aca7fc700 1 --2- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2acc0c6900 0x7f2acc0ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2acaffd700 1 --2- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2acc0c6520 0x7f2acc13c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2acb7fe700 1 --2- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2acc0c6520 0x7f2acc13c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2acb7fe700 1 -- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2acc0c6900 msgr2=0x7f2acc0ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2acb7fe700 1 --2- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2acc0c6900 0x7f2acc0ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2acb7fe700 1 -- 172.21.15.1:0/1237070003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc0092a0 con 0x7f2acc0c97b0 2023-11-15T01:21:43.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2acb7fe700 1 --2- 172.21.15.1:0/1237070003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2acc0c97b0 0x7f2acc0ae500 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f2acc0644a0 tx=0x7f2abc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2ac2ffd700 1 -- 172.21.15.1:0/1237070003 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00b850 con 0x7f2acc0c97b0 2023-11-15T01:21:43.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2ac2ffd700 1 -- 172.21.15.1:0/1237070003 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc00b9b0 con 0x7f2acc0c97b0 2023-11-15T01:21:43.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2ad19c6700 1 -- 172.21.15.1:0/1237070003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2acc14e800 con 0x7f2acc0c97b0 2023-11-15T01:21:43.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2ac2ffd700 1 -- 172.21.15.1:0/1237070003 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc01b650 con 0x7f2acc0c97b0 2023-11-15T01:21:43.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.538+0000 7f2ad19c6700 1 -- 172.21.15.1:0/1237070003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2acc14edc0 con 0x7f2acc0c97b0 2023-11-15T01:21:43.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.539+0000 7f2ad19c6700 1 -- 172.21.15.1:0/1237070003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2acc06c7e0 con 0x7f2acc0c97b0 2023-11-15T01:21:43.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.540+0000 7f2ac2ffd700 1 -- 172.21.15.1:0/1237070003 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2abc01bc50 con 0x7f2acc0c97b0 2023-11-15T01:21:43.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.540+0000 7f2ac2ffd700 1 --2- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2aac05f0c0 0x7f2aac061580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.540+0000 7f2ac2ffd700 1 -- 172.21.15.1:0/1237070003 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2abc07c070 con 0x7f2acc0c97b0 2023-11-15T01:21:43.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.540+0000 7f2ac2ffd700 1 --2- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:6801/91136,v1:172.21.15.141:6803/91136] conn(0x7f2aac0684e0 0x7f2aac06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.540+0000 7f2ac2ffd700 1 -- 172.21.15.1:0/1237070003 --> [v2:172.21.15.141:6801/91136,v1:172.21.15.141:6803/91136] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2aac06afc0 con 0x7f2aac0684e0 2023-11-15T01:21:43.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.540+0000 7f2acaffd700 1 --2- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2aac05f0c0 0x7f2aac061580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.540+0000 7f2ac2ffd700 1 -- 172.21.15.1:0/1237070003 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2abc07e690 con 0x7f2acc0c97b0 2023-11-15T01:21:43.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.540+0000 7f2aca7fc700 1 --2- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:6801/91136,v1:172.21.15.141:6803/91136] conn(0x7f2aac0684e0 0x7f2aac06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.541+0000 7f2acaffd700 1 --2- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2aac05f0c0 0x7f2aac061580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2ac4001d60 tx=0x7f2ac4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.541+0000 7f2aca7fc700 1 --2- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:6801/91136,v1:172.21.15.141:6803/91136] conn(0x7f2aac0684e0 0x7f2aac06a940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.541+0000 7f2ac2ffd700 1 -- 172.21.15.1:0/1237070003 <== osd.6 v2:172.21.15.141:6801/91136 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f2aac06afc0 con 0x7f2aac0684e0 2023-11-15T01:21:43.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.556+0000 7f2ad19c6700 1 -- 172.21.15.1:0/1237070003 --> [v2:172.21.15.141:6801/91136,v1:172.21.15.141:6803/91136] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2acc155550 con 0x7f2aac0684e0 2023-11-15T01:21:43.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.556+0000 7f2ac2ffd700 1 -- 172.21.15.1:0/1237070003 <== osd.6 v2:172.21.15.141:6801/91136 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2acc155550 con 0x7f2aac0684e0 2023-11-15T01:21:43.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.556+0000 7f2ad19c6700 1 -- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:6801/91136,v1:172.21.15.141:6803/91136] conn(0x7f2aac0684e0 msgr2=0x7f2aac06a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.556+0000 7f2ad19c6700 1 --2- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:6801/91136,v1:172.21.15.141:6803/91136] conn(0x7f2aac0684e0 0x7f2aac06a940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.556+0000 7f2ad19c6700 1 -- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2aac05f0c0 msgr2=0x7f2aac061580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.556+0000 7f2ad19c6700 1 --2- 172.21.15.1:0/1237070003 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2aac05f0c0 0x7f2aac061580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2ac4001d60 tx=0x7f2ac4009040).stop 2023-11-15T01:21:43.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.556+0000 7f2ad19c6700 1 -- 172.21.15.1:0/1237070003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2acc0c97b0 msgr2=0x7f2acc0ae500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.556+0000 7f2ad19c6700 1 --2- 172.21.15.1:0/1237070003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2acc0c97b0 0x7f2acc0ae500 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f2acc0644a0 tx=0x7f2abc017000).stop 2023-11-15T01:21:43.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.556+0000 7f2acb7fe700 1 -- 172.21.15.1:0/1237070003 reap_dead start 2023-11-15T01:21:43.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.556+0000 7f2ad19c6700 1 -- 172.21.15.1:0/1237070003 shutdown_connections 2023-11-15T01:21:43.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.556+0000 7f2ad19c6700 1 -- 172.21.15.1:0/1237070003 >> 172.21.15.1:0/1237070003 conn(0x7f2acc0cb060 msgr2=0x7f2acc0c16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:43.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.556+0000 7f2ad19c6700 1 -- 172.21.15.1:0/1237070003 shutdown_connections 2023-11-15T01:21:43.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.557+0000 7f2ad19c6700 1 -- 172.21.15.1:0/1237070003 wait complete. 2023-11-15T01:21:43.568 INFO:teuthology.orchestra.run.smithi001.stdout:55834574853 2023-11-15T01:21:43.569 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-15T01:21:43.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.687+0000 7f6c20490700 1 Processor -- start 2023-11-15T01:21:43.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.687+0000 7f6c20490700 1 -- start start 2023-11-15T01:21:43.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.688+0000 7f6c20490700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6c18154630 0x7f6c180a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.688+0000 7f6c20490700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c180aa4e0 0x7f6c180c9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.688+0000 7f6c20490700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c18158ff0 con 0x7f6c18154250 2023-11-15T01:21:43.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.688+0000 7f6c20490700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c180aa970 con 0x7f6c18154630 2023-11-15T01:21:43.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.688+0000 7f6c20490700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c18158100 con 0x7f6c180aa4e0 2023-11-15T01:21:43.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.688+0000 7f6c1da2b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6c18154630 0x7f6c180a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.688+0000 7f6c1e22c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6c18154250 0x7f6c180c6110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58198/0 (socket says 172.21.15.1:58198) 2023-11-15T01:21:43.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.688+0000 7f6c1e22c700 1 -- 172.21.15.1:0/2748649191 learned_addr learned my addr 172.21.15.1:0/2748649191 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:43.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.688+0000 7f6c1ea2d700 1 --2- 172.21.15.1:0/2748649191 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c180aa4e0 0x7f6c180c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c1da2b700 1 -- 172.21.15.1:0/2748649191 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c180aa4e0 msgr2=0x7f6c180c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:43.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c1da2b700 1 --2- 172.21.15.1:0/2748649191 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c180aa4e0 0x7f6c180c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c1da2b700 1 -- 172.21.15.1:0/2748649191 >> v1:172.21.15.1:6789/0 conn(0x7f6c18154250 legacy=0x7f6c180c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c1d22a700 1 -- 172.21.15.1:0/2748649191 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128147787 0 0) 0x7f6c18158ff0 con 0x7f6c18154250 2023-11-15T01:21:43.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c1da2b700 1 -- 172.21.15.1:0/2748649191 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c181583e0 con 0x7f6c18154630 2023-11-15T01:21:43.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c1ea2d700 1 --2- 172.21.15.1:0/2748649191 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c180aa4e0 0x7f6c180c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:43.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c1da2b700 1 --2- 172.21.15.1:0/2748649191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c18154630 0x7f6c180a9ff0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f6c0c009760 tx=0x7f6c0c009060).ready entity=mon.0 client_cookie=2d34ac9b858e291e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c1d22a700 1 -- 172.21.15.1:0/2748649191 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c00b580 con 0x7f6c18154630 2023-11-15T01:21:43.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c1d22a700 1 -- 172.21.15.1:0/2748649191 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c00b6e0 con 0x7f6c18154630 2023-11-15T01:21:43.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c1d22a700 1 -- 172.21.15.1:0/2748649191 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c00ba60 con 0x7f6c18154630 2023-11-15T01:21:43.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c20490700 1 -- 172.21.15.1:0/2748649191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c18154630 msgr2=0x7f6c180a9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c20490700 1 --2- 172.21.15.1:0/2748649191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c18154630 0x7f6c180a9ff0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f6c0c009760 tx=0x7f6c0c009060).stop 2023-11-15T01:21:43.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c20490700 1 -- 172.21.15.1:0/2748649191 shutdown_connections 2023-11-15T01:21:43.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c20490700 1 --2- 172.21.15.1:0/2748649191 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c180aa4e0 0x7f6c180c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c20490700 1 --2- 172.21.15.1:0/2748649191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c18154630 0x7f6c180a9ff0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c20490700 1 -- 172.21.15.1:0/2748649191 >> 172.21.15.1:0/2748649191 conn(0x7f6c180c7b20 msgr2=0x7f6c180c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:43.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c20490700 1 -- 172.21.15.1:0/2748649191 shutdown_connections 2023-11-15T01:21:43.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.689+0000 7f6c20490700 1 -- 172.21.15.1:0/2748649191 wait complete. 2023-11-15T01:21:43.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.691+0000 7f6c20490700 1 Processor -- start 2023-11-15T01:21:43.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.691+0000 7f6c20490700 1 -- start start 2023-11-15T01:21:43.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.691+0000 7f6c20490700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6c180aa4e0 0x7f6c181476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.691+0000 7f6c20490700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c18154250 0x7f6c180ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.691+0000 7f6c20490700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c18154630 0x7f6c181649f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.691+0000 7f6c20490700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c18155fc0 con 0x7f6c18154630 2023-11-15T01:21:43.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.691+0000 7f6c20490700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c180adb70 con 0x7f6c180aa4e0 2023-11-15T01:21:43.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.691+0000 7f6c20490700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c18156260 con 0x7f6c18154250 2023-11-15T01:21:43.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.691+0000 7f6c1ea2d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c18154630 0x7f6c181649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.691+0000 7f6c1ea2d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c18154630 0x7f6c181649f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54954/0 (socket says 172.21.15.1:54954) 2023-11-15T01:21:43.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.692+0000 7f6c1ea2d700 1 -- 172.21.15.1:0/3234029103 learned_addr learned my addr 172.21.15.1:0/3234029103 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:43.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.692+0000 7f6c1e22c700 1 --2- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6c180aa4e0 0x7f6c181476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.692+0000 7f6c1da2b700 1 --2- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c18154250 0x7f6c180ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.692+0000 7f6c1ea2d700 1 -- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c18154250 msgr2=0x7f6c180ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.692+0000 7f6c1ea2d700 1 --2- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c18154250 0x7f6c180ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.692+0000 7f6c1ea2d700 1 -- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6c180aa4e0 msgr2=0x7f6c181476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.692+0000 7f6c1ea2d700 1 --2- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6c180aa4e0 0x7f6c181476d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.692+0000 7f6c1ea2d700 1 -- 172.21.15.1:0/3234029103 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0092a0 con 0x7f6c18154630 2023-11-15T01:21:43.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.692+0000 7f6c1da2b700 1 --2- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c18154250 0x7f6c180ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:43.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.692+0000 7f6c1ea2d700 1 --2- 172.21.15.1:0/3234029103 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c18154630 0x7f6c181649f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6c0800d860 tx=0x7f6c08008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.692+0000 7f6c167fc700 1 -- 172.21.15.1:0/3234029103 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c080125f0 con 0x7f6c18154630 2023-11-15T01:21:43.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.692+0000 7f6c167fc700 1 -- 172.21.15.1:0/3234029103 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c08012750 con 0x7f6c18154630 2023-11-15T01:21:43.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.692+0000 7f6c20490700 1 -- 172.21.15.1:0/3234029103 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c18156540 con 0x7f6c18154630 2023-11-15T01:21:43.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.692+0000 7f6c167fc700 1 -- 172.21.15.1:0/3234029103 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c08012af0 con 0x7f6c18154630 2023-11-15T01:21:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.692+0000 7f6c20490700 1 -- 172.21.15.1:0/3234029103 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c18156b00 con 0x7f6c18154630 2023-11-15T01:21:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.693+0000 7f6c20490700 1 -- 172.21.15.1:0/3234029103 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6c1806c7e0 con 0x7f6c18154630 2023-11-15T01:21:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.693+0000 7f6c167fc700 1 -- 172.21.15.1:0/3234029103 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6c08013480 con 0x7f6c18154630 2023-11-15T01:21:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.694+0000 7f6c167fc700 1 --2- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c0405f150 0x7f6c04061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.694+0000 7f6c167fc700 1 -- 172.21.15.1:0/3234029103 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6c08079f50 con 0x7f6c18154630 2023-11-15T01:21:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.694+0000 7f6c167fc700 1 --2- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:6824/91166,v1:172.21.15.141:6825/91166] conn(0x7f6c040684f0 0x7f6c0406a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.694+0000 7f6c1e22c700 1 --2- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c0405f150 0x7f6c04061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.694+0000 7f6c167fc700 1 -- 172.21.15.1:0/3234029103 --> [v2:172.21.15.141:6824/91166,v1:172.21.15.141:6825/91166] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c0406afd0 con 0x7f6c040684f0 2023-11-15T01:21:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.694+0000 7f6c167fc700 1 -- 172.21.15.1:0/3234029103 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c0807c570 con 0x7f6c18154630 2023-11-15T01:21:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.694+0000 7f6c1da2b700 1 --2- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:6824/91166,v1:172.21.15.141:6825/91166] conn(0x7f6c040684f0 0x7f6c0406a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.694+0000 7f6c1e22c700 1 --2- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c0405f150 0x7f6c04061610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f6c10001560 tx=0x7f6c10007f30).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.695+0000 7f6c1da2b700 1 --2- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:6824/91166,v1:172.21.15.141:6825/91166] conn(0x7f6c040684f0 0x7f6c0406a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.695+0000 7f6c167fc700 1 -- 172.21.15.1:0/3234029103 <== osd.7 v2:172.21.15.141:6824/91166 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f6c0406afd0 con 0x7f6c040684f0 2023-11-15T01:21:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.710+0000 7f6c20490700 1 -- 172.21.15.1:0/3234029103 --> [v2:172.21.15.141:6824/91166,v1:172.21.15.141:6825/91166] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6c18156cf0 con 0x7f6c040684f0 2023-11-15T01:21:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.710+0000 7f6c167fc700 1 -- 172.21.15.1:0/3234029103 <== osd.7 v2:172.21.15.141:6824/91166 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6c18156cf0 con 0x7f6c040684f0 2023-11-15T01:21:43.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.710+0000 7f6c20490700 1 -- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:6824/91166,v1:172.21.15.141:6825/91166] conn(0x7f6c040684f0 msgr2=0x7f6c0406a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.710+0000 7f6c20490700 1 --2- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:6824/91166,v1:172.21.15.141:6825/91166] conn(0x7f6c040684f0 0x7f6c0406a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.710+0000 7f6c20490700 1 -- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c0405f150 msgr2=0x7f6c04061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.710+0000 7f6c20490700 1 --2- 172.21.15.1:0/3234029103 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c0405f150 0x7f6c04061610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f6c10001560 tx=0x7f6c10007f30).stop 2023-11-15T01:21:43.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.710+0000 7f6c20490700 1 -- 172.21.15.1:0/3234029103 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c18154630 msgr2=0x7f6c181649f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.710+0000 7f6c20490700 1 --2- 172.21.15.1:0/3234029103 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c18154630 0x7f6c181649f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6c0800d860 tx=0x7f6c08008040).stop 2023-11-15T01:21:43.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.710+0000 7f6c1ea2d700 1 -- 172.21.15.1:0/3234029103 reap_dead start 2023-11-15T01:21:43.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.710+0000 7f6c20490700 1 -- 172.21.15.1:0/3234029103 shutdown_connections 2023-11-15T01:21:43.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.710+0000 7f6c20490700 1 -- 172.21.15.1:0/3234029103 >> 172.21.15.1:0/3234029103 conn(0x7f6c180c7b20 msgr2=0x7f6c1815ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:43.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.711+0000 7f6c20490700 1 -- 172.21.15.1:0/3234029103 shutdown_connections 2023-11-15T01:21:43.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.711+0000 7f6c20490700 1 -- 172.21.15.1:0/3234029103 wait complete. 2023-11-15T01:21:43.722 INFO:teuthology.orchestra.run.smithi001.stdout:55834574852 2023-11-15T01:21:43.723 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-15T01:21:43.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.842+0000 7f81588b2700 1 Processor -- start 2023-11-15T01:21:43.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.842+0000 7f81588b2700 1 -- start start 2023-11-15T01:21:43.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f81588b2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8154154250 0x7f8154154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f81588b2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81540c6110 0x7f81540c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f81588b2700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f81540a9ff0 0x7f81540aa480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f81588b2700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8154158ff0 con 0x7f8154154250 2023-11-15T01:21:43.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f81588b2700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81540aa970 con 0x7f81540a9ff0 2023-11-15T01:21:43.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f81588b2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8154158100 con 0x7f81540c6110 2023-11-15T01:21:43.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f815259c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8154154250 0x7f8154154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f815259c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8154154250 0x7f8154154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54962/0 (socket says 172.21.15.1:54962) 2023-11-15T01:21:43.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f815259c700 1 -- 172.21.15.1:0/42336454 learned_addr learned my addr 172.21.15.1:0/42336454 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:43.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f815259c700 1 -- 172.21.15.1:0/42336454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81540c6110 msgr2=0x7f81540c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:43.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f8152d9d700 1 --2- 172.21.15.1:0/42336454 >> v2:172.21.15.141:3300/0 conn(0x7f81540a9ff0 0x7f81540aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f8151d9b700 1 --2- 172.21.15.1:0/42336454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81540c6110 0x7f81540c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f815259c700 1 --2- 172.21.15.1:0/42336454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81540c6110 0x7f81540c6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f815259c700 1 -- 172.21.15.1:0/42336454 >> v2:172.21.15.141:3300/0 conn(0x7f81540a9ff0 msgr2=0x7f81540aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:43.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f815259c700 1 --2- 172.21.15.1:0/42336454 >> v2:172.21.15.141:3300/0 conn(0x7f81540a9ff0 0x7f81540aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f815259c700 1 -- 172.21.15.1:0/42336454 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81541583e0 con 0x7f8154154250 2023-11-15T01:21:43.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f8152d9d700 1 --2- 172.21.15.1:0/42336454 >> v2:172.21.15.141:3300/0 conn(0x7f81540a9ff0 0x7f81540aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:43.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f815259c700 1 --2- 172.21.15.1:0/42336454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8154154250 0x7f8154154630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f8154064770 tx=0x7f81440090f0).ready entity=mon.0 client_cookie=ca2bb25b4ce97f2b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f815159a700 1 -- 172.21.15.1:0/42336454 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814400b600 con 0x7f8154154250 2023-11-15T01:21:43.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f815159a700 1 -- 172.21.15.1:0/42336454 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814400b760 con 0x7f8154154250 2023-11-15T01:21:43.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.843+0000 7f815159a700 1 -- 172.21.15.1:0/42336454 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814400bae0 con 0x7f8154154250 2023-11-15T01:21:43.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.844+0000 7f81588b2700 1 -- 172.21.15.1:0/42336454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8154154250 msgr2=0x7f8154154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.844+0000 7f81588b2700 1 --2- 172.21.15.1:0/42336454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8154154250 0x7f8154154630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f8154064770 tx=0x7f81440090f0).stop 2023-11-15T01:21:43.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.844+0000 7f81588b2700 1 -- 172.21.15.1:0/42336454 shutdown_connections 2023-11-15T01:21:43.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.844+0000 7f81588b2700 1 --2- 172.21.15.1:0/42336454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8154154250 0x7f8154154630 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.844+0000 7f81588b2700 1 --2- 172.21.15.1:0/42336454 >> v2:172.21.15.141:3300/0 conn(0x7f81540a9ff0 0x7f81540aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.844+0000 7f81588b2700 1 --2- 172.21.15.1:0/42336454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81540c6110 0x7f81540c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.844+0000 7f81588b2700 1 -- 172.21.15.1:0/42336454 >> 172.21.15.1:0/42336454 conn(0x7f81540c7b20 msgr2=0x7f81540c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:43.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.844+0000 7f81588b2700 1 -- 172.21.15.1:0/42336454 shutdown_connections 2023-11-15T01:21:43.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.844+0000 7f81588b2700 1 -- 172.21.15.1:0/42336454 wait complete. 2023-11-15T01:21:43.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.845+0000 7f81588b2700 1 Processor -- start 2023-11-15T01:21:43.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.845+0000 7f81588b2700 1 -- start start 2023-11-15T01:21:43.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f81588b2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81540a9ff0 0x7f8154144900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f81588b2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81540c6110 0x7f8154154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f81588b2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8154154250 0x7f81540c0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f81588b2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81540c2aa0 con 0x7f81540a9ff0 2023-11-15T01:21:43.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f81588b2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81540c3340 con 0x7f81540c6110 2023-11-15T01:21:43.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f81588b2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8154155800 con 0x7f8154154250 2023-11-15T01:21:43.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f815259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81540a9ff0 0x7f8154144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f815259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81540a9ff0 0x7f8154144900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54970/0 (socket says 172.21.15.1:54970) 2023-11-15T01:21:43.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f815259c700 1 -- 172.21.15.1:0/353942471 learned_addr learned my addr 172.21.15.1:0/353942471 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:43.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f8152d9d700 1 --2- 172.21.15.1:0/353942471 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8154154250 0x7f81540c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f8151d9b700 1 --2- 172.21.15.1:0/353942471 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81540c6110 0x7f8154154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f815259c700 1 -- 172.21.15.1:0/353942471 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8154154250 msgr2=0x7f81540c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f815259c700 1 --2- 172.21.15.1:0/353942471 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8154154250 0x7f81540c0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f815259c700 1 -- 172.21.15.1:0/353942471 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81540c6110 msgr2=0x7f8154154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:43.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f815259c700 1 --2- 172.21.15.1:0/353942471 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81540c6110 0x7f8154154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:43.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f815259c700 1 -- 172.21.15.1:0/353942471 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8144009370 con 0x7f81540a9ff0 2023-11-15T01:21:43.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f815259c700 1 --2- 172.21.15.1:0/353942471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81540a9ff0 0x7f8154144900 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8144009130 tx=0x7f8144017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.846+0000 7f814a7fc700 1 -- 172.21.15.1:0/353942471 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814400bae0 con 0x7f81540a9ff0 2023-11-15T01:21:43.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.847+0000 7f814a7fc700 1 -- 172.21.15.1:0/353942471 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8144000c90 con 0x7f81540a9ff0 2023-11-15T01:21:43.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.847+0000 7f81588b2700 1 -- 172.21.15.1:0/353942471 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81540c2cf0 con 0x7f81540a9ff0 2023-11-15T01:21:43.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.847+0000 7f814a7fc700 1 -- 172.21.15.1:0/353942471 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814401b660 con 0x7f81540a9ff0 2023-11-15T01:21:43.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.847+0000 7f81588b2700 1 -- 172.21.15.1:0/353942471 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8154144ff0 con 0x7f81540a9ff0 2023-11-15T01:21:43.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.848+0000 7f81588b2700 1 -- 172.21.15.1:0/353942471 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81541451e0 con 0x7f81540a9ff0 2023-11-15T01:21:43.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.848+0000 7f814a7fc700 1 -- 172.21.15.1:0/353942471 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f814401ba10 con 0x7f81540a9ff0 2023-11-15T01:21:43.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.848+0000 7f814a7fc700 1 --2- 172.21.15.1:0/353942471 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f813405f150 0x7f8134061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:43.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.848+0000 7f814a7fc700 1 -- 172.21.15.1:0/353942471 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f814407bb10 con 0x7f81540a9ff0 2023-11-15T01:21:43.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.848+0000 7f8151d9b700 1 --2- 172.21.15.1:0/353942471 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f813405f150 0x7f8134061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:43.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.849+0000 7f8151d9b700 1 --2- 172.21.15.1:0/353942471 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f813405f150 0x7f8134061610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f815414f460 tx=0x7f813c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:43.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:43.852+0000 7f814a7fc700 1 -- 172.21.15.1:0/353942471 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f814404cde0 con 0x7f81540a9ff0 2023-11-15T01:21:44.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:44.026+0000 7f81588b2700 1 -- 172.21.15.1:0/353942471 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f81540c3620 con 0x7f81540a9ff0 2023-11-15T01:21:44.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:44.026+0000 7f814a7fc700 1 -- 172.21.15.1:0/353942471 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8144050400 con 0x7f81540a9ff0 2023-11-15T01:21:44.027 INFO:teuthology.orchestra.run.smithi001.stdout:55834574851 2023-11-15T01:21:44.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:44.028+0000 7f81588b2700 1 -- 172.21.15.1:0/353942471 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f813405f150 msgr2=0x7f8134061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:44.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:44.028+0000 7f81588b2700 1 --2- 172.21.15.1:0/353942471 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f813405f150 0x7f8134061610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f815414f460 tx=0x7f813c008040).stop 2023-11-15T01:21:44.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:44.028+0000 7f81588b2700 1 -- 172.21.15.1:0/353942471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81540a9ff0 msgr2=0x7f8154144900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:44.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:44.028+0000 7f81588b2700 1 --2- 172.21.15.1:0/353942471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81540a9ff0 0x7f8154144900 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8144009130 tx=0x7f8144017000).stop 2023-11-15T01:21:44.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:44.028+0000 7f81588b2700 1 -- 172.21.15.1:0/353942471 shutdown_connections 2023-11-15T01:21:44.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:44.028+0000 7f81588b2700 1 --2- 172.21.15.1:0/353942471 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f813405f150 0x7f8134061610 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:44.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:44.028+0000 7f81588b2700 1 --2- 172.21.15.1:0/353942471 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8154154250 0x7f81540c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:44.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:44.028+0000 7f81588b2700 1 --2- 172.21.15.1:0/353942471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81540a9ff0 0x7f8154144900 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:44.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:44.028+0000 7f81588b2700 1 --2- 172.21.15.1:0/353942471 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81540c6110 0x7f8154154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:44.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:44.028+0000 7f81588b2700 1 -- 172.21.15.1:0/353942471 >> 172.21.15.1:0/353942471 conn(0x7f81540c7b20 msgr2=0x7f8154153110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:44.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:44.028+0000 7f81588b2700 1 -- 172.21.15.1:0/353942471 shutdown_connections 2023-11-15T01:21:44.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:44.028+0000 7f81588b2700 1 -- 172.21.15.1:0/353942471 wait complete. 2023-11-15T01:21:44.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2023-11-15T01:21:44.909 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:21:44.912 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:21:45.041 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-15T01:21:45.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.175+0000 7fe2f9b31700 1 Processor -- start 2023-11-15T01:21:45.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.175+0000 7fe2f9b31700 1 -- start start 2023-11-15T01:21:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.176+0000 7fe2f9b31700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe2f40be390 0x7fe2f40bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.176+0000 7fe2f9b31700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40ad5e0 con 0x7fe2f40bdfb0 2023-11-15T01:21:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.176+0000 7fe2f9b31700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40ad8c0 con 0x7fe2f40bd8f0 2023-11-15T01:21:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.176+0000 7fe2f9b31700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f40bccd0 con 0x7fe2f40be390 2023-11-15T01:21:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.176+0000 7fe2f2ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe2f40be390 0x7fe2f40bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.176+0000 7fe2f37fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe2f40bdfb0 0x7fe2f40c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58210/0 (socket says 172.21.15.1:58210) 2023-11-15T01:21:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.176+0000 7fe2f37fe700 1 -- 172.21.15.1:0/3839928091 learned_addr learned my addr 172.21.15.1:0/3839928091 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.177+0000 7fe2f2ffd700 1 -- 172.21.15.1:0/3839928091 >> v1:172.21.15.141:6789/0 conn(0x7fe2f40bd8f0 legacy=0x7fe2f4154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.177+0000 7fe2f2ffd700 1 -- 172.21.15.1:0/3839928091 >> v1:172.21.15.1:6789/0 conn(0x7fe2f40bdfb0 legacy=0x7fe2f40c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.177+0000 7fe2f27fc700 1 -- 172.21.15.1:0/3839928091 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634303231 0 0) 0x7fe2f40ad5e0 con 0x7fe2f40bdfb0 2023-11-15T01:21:45.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.177+0000 7fe2f2ffd700 1 -- 172.21.15.1:0/3839928091 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40adba0 con 0x7fe2f40be390 2023-11-15T01:21:45.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.177+0000 7fe2f2ffd700 1 --2- 172.21.15.1:0/3839928091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2f40be390 0x7fe2f40bd400 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fe2e8009760 tx=0x7fe2e8009060).ready entity=mon.0 client_cookie=ab550a5e0ae5d61b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:45.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.177+0000 7fe2f27fc700 1 -- 172.21.15.1:0/3839928091 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e800b520 con 0x7fe2f40be390 2023-11-15T01:21:45.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.177+0000 7fe2f27fc700 1 -- 172.21.15.1:0/3839928091 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e800b680 con 0x7fe2f40be390 2023-11-15T01:21:45.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.177+0000 7fe2f27fc700 1 -- 172.21.15.1:0/3839928091 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e800ba00 con 0x7fe2f40be390 2023-11-15T01:21:45.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.178+0000 7fe2f9b31700 1 -- 172.21.15.1:0/3839928091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2f40be390 msgr2=0x7fe2f40bd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.178+0000 7fe2f9b31700 1 --2- 172.21.15.1:0/3839928091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2f40be390 0x7fe2f40bd400 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fe2e8009760 tx=0x7fe2e8009060).stop 2023-11-15T01:21:45.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.178+0000 7fe2f9b31700 1 -- 172.21.15.1:0/3839928091 shutdown_connections 2023-11-15T01:21:45.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.178+0000 7fe2f9b31700 1 --2- 172.21.15.1:0/3839928091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2f40be390 0x7fe2f40bd400 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.178+0000 7fe2f9b31700 1 -- 172.21.15.1:0/3839928091 >> 172.21.15.1:0/3839928091 conn(0x7fe2f40c7d70 msgr2=0x7fe2f40c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:45.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.178+0000 7fe2f9b31700 1 -- 172.21.15.1:0/3839928091 shutdown_connections 2023-11-15T01:21:45.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.178+0000 7fe2f9b31700 1 -- 172.21.15.1:0/3839928091 wait complete. 2023-11-15T01:21:45.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.179+0000 7fe2f9b31700 1 Processor -- start 2023-11-15T01:21:45.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.179+0000 7fe2f9b31700 1 -- start start 2023-11-15T01:21:45.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f9b31700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2f40bd8f0 0x7fe2f414d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f9b31700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2f40bdfb0 0x7fe2f413d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f9b31700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2f40be390 0x7fe2f4156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f9b31700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40ac4c0 con 0x7fe2f40bdfb0 2023-11-15T01:21:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f9b31700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40ab840 con 0x7fe2f40be390 2023-11-15T01:21:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f9b31700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40abb20 con 0x7fe2f40bd8f0 2023-11-15T01:21:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2f40bdfb0 0x7fe2f413d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2f40bdfb0 0x7fe2f413d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54988/0 (socket says 172.21.15.1:54988) 2023-11-15T01:21:45.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f2ffd700 1 -- 172.21.15.1:0/373842703 learned_addr learned my addr 172.21.15.1:0/373842703 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:45.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f37fe700 1 --2- 172.21.15.1:0/373842703 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2f40bd8f0 0x7fe2f414d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f3fff700 1 --2- 172.21.15.1:0/373842703 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2f40be390 0x7fe2f4156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f2ffd700 1 -- 172.21.15.1:0/373842703 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2f40bd8f0 msgr2=0x7fe2f414d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f2ffd700 1 --2- 172.21.15.1:0/373842703 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2f40bd8f0 0x7fe2f414d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f2ffd700 1 -- 172.21.15.1:0/373842703 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2f40be390 msgr2=0x7fe2f4156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f2ffd700 1 --2- 172.21.15.1:0/373842703 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2f40be390 0x7fe2f4156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f2ffd700 1 -- 172.21.15.1:0/373842703 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e80092a0 con 0x7fe2f40bdfb0 2023-11-15T01:21:45.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f3fff700 1 --2- 172.21.15.1:0/373842703 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2f40be390 0x7fe2f4156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:45.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f2ffd700 1 --2- 172.21.15.1:0/373842703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2f40bdfb0 0x7fe2f413d870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fe2e8009eb0 tx=0x7fe2e8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:45.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2db7fe700 1 -- 172.21.15.1:0/373842703 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e800b7f0 con 0x7fe2f40bdfb0 2023-11-15T01:21:45.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2db7fe700 1 -- 172.21.15.1:0/373842703 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e800b950 con 0x7fe2f40bdfb0 2023-11-15T01:21:45.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.180+0000 7fe2f9b31700 1 -- 172.21.15.1:0/373842703 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f40abe00 con 0x7fe2f40bdfb0 2023-11-15T01:21:45.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.181+0000 7fe2db7fe700 1 -- 172.21.15.1:0/373842703 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e801b670 con 0x7fe2f40bdfb0 2023-11-15T01:21:45.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.181+0000 7fe2f9b31700 1 -- 172.21.15.1:0/373842703 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f414d650 con 0x7fe2f40bdfb0 2023-11-15T01:21:45.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.182+0000 7fe2f9b31700 1 -- 172.21.15.1:0/373842703 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f406c7e0 con 0x7fe2f40bdfb0 2023-11-15T01:21:45.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.182+0000 7fe2db7fe700 1 -- 172.21.15.1:0/373842703 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe2e801ba20 con 0x7fe2f40bdfb0 2023-11-15T01:21:45.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.182+0000 7fe2db7fe700 1 --2- 172.21.15.1:0/373842703 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2e005f150 0x7fe2e0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.183+0000 7fe2db7fe700 1 -- 172.21.15.1:0/373842703 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe2e807bb00 con 0x7fe2f40bdfb0 2023-11-15T01:21:45.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.183+0000 7fe2f37fe700 1 --2- 172.21.15.1:0/373842703 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2e005f150 0x7fe2e0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.183+0000 7fe2f37fe700 1 --2- 172.21.15.1:0/373842703 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2e005f150 0x7fe2e0061610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe2e40011e0 tx=0x7fe2e4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:45.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.187+0000 7fe2db7fe700 1 -- 172.21.15.1:0/373842703 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe2e804cdd0 con 0x7fe2f40bdfb0 2023-11-15T01:21:45.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.360+0000 7fe2f9b31700 1 -- 172.21.15.1:0/373842703 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe2f406a530 con 0x7fe2f40bdfb0 2023-11-15T01:21:45.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.361+0000 7fe2db7fe700 1 -- 172.21.15.1:0/373842703 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe2e8028020 con 0x7fe2f40bdfb0 2023-11-15T01:21:45.362 INFO:teuthology.orchestra.run.smithi001.stdout:55834574852 2023-11-15T01:21:45.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.362+0000 7fe2f9b31700 1 -- 172.21.15.1:0/373842703 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2e005f150 msgr2=0x7fe2e0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.362+0000 7fe2f9b31700 1 --2- 172.21.15.1:0/373842703 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2e005f150 0x7fe2e0061610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe2e40011e0 tx=0x7fe2e4009040).stop 2023-11-15T01:21:45.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.362+0000 7fe2f9b31700 1 -- 172.21.15.1:0/373842703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2f40bdfb0 msgr2=0x7fe2f413d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.362+0000 7fe2f9b31700 1 --2- 172.21.15.1:0/373842703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2f40bdfb0 0x7fe2f413d870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fe2e8009eb0 tx=0x7fe2e8017000).stop 2023-11-15T01:21:45.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.363+0000 7fe2f9b31700 1 -- 172.21.15.1:0/373842703 shutdown_connections 2023-11-15T01:21:45.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.363+0000 7fe2f9b31700 1 --2- 172.21.15.1:0/373842703 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2e005f150 0x7fe2e0061610 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.363+0000 7fe2f9b31700 1 --2- 172.21.15.1:0/373842703 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2f40be390 0x7fe2f4156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.363+0000 7fe2f9b31700 1 --2- 172.21.15.1:0/373842703 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2f40bd8f0 0x7fe2f414d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.363+0000 7fe2f9b31700 1 --2- 172.21.15.1:0/373842703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2f40bdfb0 0x7fe2f413d870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.363+0000 7fe2f9b31700 1 -- 172.21.15.1:0/373842703 >> 172.21.15.1:0/373842703 conn(0x7fe2f40c7d70 msgr2=0x7fe2f414dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:45.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.363+0000 7fe2f9b31700 1 -- 172.21.15.1:0/373842703 shutdown_connections 2023-11-15T01:21:45.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.363+0000 7fe2f9b31700 1 -- 172.21.15.1:0/373842703 wait complete. 2023-11-15T01:21:45.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2023-11-15T01:21:45.375 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-15T01:21:45.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.493+0000 7f11ff4b9700 1 Processor -- start 2023-11-15T01:21:45.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.493+0000 7f11ff4b9700 1 -- start start 2023-11-15T01:21:45.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.494+0000 7f11ff4b9700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f11f80a8230 0x7f11f80c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.494+0000 7f11ff4b9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11f80bf720 0x7f11f80c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.494+0000 7f11ff4b9700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f80835e0 con 0x7f11f80c39c0 2023-11-15T01:21:45.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.494+0000 7f11ff4b9700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f80beb80 con 0x7f11f80a8230 2023-11-15T01:21:45.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.494+0000 7f11ff4b9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80bdfb0 con 0x7f11f80bf720 2023-11-15T01:21:45.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.494+0000 7f11fd255700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f11f80a8230 0x7f11f80c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.495+0000 7f11fd255700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f11f80a8230 0x7f11f80c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55004/0 (socket says 172.21.15.1:55004) 2023-11-15T01:21:45.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.495+0000 7f11fd255700 1 -- 172.21.15.1:0/329404438 learned_addr learned my addr 172.21.15.1:0/329404438 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:45.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.495+0000 7f11fda56700 1 --2- 172.21.15.1:0/329404438 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11f80bf720 0x7f11f80c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.495+0000 7f11fd255700 1 -- 172.21.15.1:0/329404438 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11f80bf720 msgr2=0x7f11f80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:45.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.495+0000 7f11fd255700 1 --2- 172.21.15.1:0/329404438 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11f80bf720 0x7f11f80c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.495+0000 7f11fd255700 1 -- 172.21.15.1:0/329404438 >> v1:172.21.15.141:6789/0 conn(0x7f11f80c39c0 legacy=0x7f11f80bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.495+0000 7f11fd255700 1 -- 172.21.15.1:0/329404438 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80be250 con 0x7f11f80a8230 2023-11-15T01:21:45.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.495+0000 7f11fda56700 1 --2- 172.21.15.1:0/329404438 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11f80bf720 0x7f11f80c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:45.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.495+0000 7f11fd255700 1 --2- 172.21.15.1:0/329404438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11f80a8230 0x7f11f80c34d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f11f0006fd0 tx=0x7f11f00090f0).ready entity=mon.0 client_cookie=4f7a884fad2d6d9a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:45.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.495+0000 7f11f7fff700 1 -- 172.21.15.1:0/329404438 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f000b600 con 0x7f11f80a8230 2023-11-15T01:21:45.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.495+0000 7f11f7fff700 1 -- 172.21.15.1:0/329404438 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f000b760 con 0x7f11f80a8230 2023-11-15T01:21:45.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.495+0000 7f11f7fff700 1 -- 172.21.15.1:0/329404438 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f000bae0 con 0x7f11f80a8230 2023-11-15T01:21:45.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.496+0000 7f11ff4b9700 1 -- 172.21.15.1:0/329404438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11f80a8230 msgr2=0x7f11f80c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.496+0000 7f11ff4b9700 1 --2- 172.21.15.1:0/329404438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11f80a8230 0x7f11f80c34d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f11f0006fd0 tx=0x7f11f00090f0).stop 2023-11-15T01:21:45.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.496+0000 7f11ff4b9700 1 -- 172.21.15.1:0/329404438 shutdown_connections 2023-11-15T01:21:45.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.496+0000 7f11ff4b9700 1 --2- 172.21.15.1:0/329404438 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11f80bf720 0x7f11f80c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.496+0000 7f11ff4b9700 1 --2- 172.21.15.1:0/329404438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11f80a8230 0x7f11f80c34d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.496+0000 7f11ff4b9700 1 -- 172.21.15.1:0/329404438 >> 172.21.15.1:0/329404438 conn(0x7f11f8082f90 msgr2=0x7f11f80c8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:45.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.496+0000 7f11ff4b9700 1 -- 172.21.15.1:0/329404438 shutdown_connections 2023-11-15T01:21:45.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.496+0000 7f11ff4b9700 1 -- 172.21.15.1:0/329404438 wait complete. 2023-11-15T01:21:45.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.497+0000 7f11ff4b9700 1 Processor -- start 2023-11-15T01:21:45.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.497+0000 7f11ff4b9700 1 -- start start 2023-11-15T01:21:45.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11ff4b9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11f80a8230 0x7f11f8157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11ff4b9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11f80bf720 0x7f11f81531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11ff4b9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11f80c39c0 0x7f11f815aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11ff4b9700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f81536b0 con 0x7f11f80a8230 2023-11-15T01:21:45.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11ff4b9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f815afa0 con 0x7f11f80bf720 2023-11-15T01:21:45.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11ff4b9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f8158620 con 0x7f11f80c39c0 2023-11-15T01:21:45.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11fd255700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11f80a8230 0x7f11f8157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11fd255700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11f80a8230 0x7f11f8157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55016/0 (socket says 172.21.15.1:55016) 2023-11-15T01:21:45.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11fd255700 1 -- 172.21.15.1:0/2074097383 learned_addr learned my addr 172.21.15.1:0/2074097383 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:45.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11fca54700 1 --2- 172.21.15.1:0/2074097383 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11f80bf720 0x7f11f81531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11fda56700 1 --2- 172.21.15.1:0/2074097383 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11f80c39c0 0x7f11f815aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11fd255700 1 -- 172.21.15.1:0/2074097383 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11f80c39c0 msgr2=0x7f11f815aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11fd255700 1 --2- 172.21.15.1:0/2074097383 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11f80c39c0 0x7f11f815aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11fd255700 1 -- 172.21.15.1:0/2074097383 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11f80bf720 msgr2=0x7f11f81531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11fd255700 1 --2- 172.21.15.1:0/2074097383 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11f80bf720 0x7f11f81531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11fd255700 1 -- 172.21.15.1:0/2074097383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f0009370 con 0x7f11f80a8230 2023-11-15T01:21:45.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.498+0000 7f11fd255700 1 --2- 172.21.15.1:0/2074097383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11f80a8230 0x7f11f8157f90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f11f0009f50 tx=0x7f11f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:45.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.499+0000 7f11f57fa700 1 -- 172.21.15.1:0/2074097383 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f000bea0 con 0x7f11f80a8230 2023-11-15T01:21:45.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.499+0000 7f11f57fa700 1 -- 172.21.15.1:0/2074097383 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f000b8d0 con 0x7f11f80a8230 2023-11-15T01:21:45.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.499+0000 7f11ff4b9700 1 -- 172.21.15.1:0/2074097383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f8158900 con 0x7f11f80a8230 2023-11-15T01:21:45.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.499+0000 7f11f57fa700 1 -- 172.21.15.1:0/2074097383 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f001b660 con 0x7f11f80a8230 2023-11-15T01:21:45.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.499+0000 7f11ff4b9700 1 -- 172.21.15.1:0/2074097383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f80ad170 con 0x7f11f80a8230 2023-11-15T01:21:45.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.500+0000 7f11ff4b9700 1 -- 172.21.15.1:0/2074097383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f80ad390 con 0x7f11f80a8230 2023-11-15T01:21:45.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.500+0000 7f11f57fa700 1 -- 172.21.15.1:0/2074097383 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f11f001b9d0 con 0x7f11f80a8230 2023-11-15T01:21:45.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.500+0000 7f11f57fa700 1 --2- 172.21.15.1:0/2074097383 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f11e405f150 0x7f11e4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.501+0000 7f11f57fa700 1 -- 172.21.15.1:0/2074097383 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f11f007ba40 con 0x7f11f80a8230 2023-11-15T01:21:45.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.501+0000 7f11fca54700 1 --2- 172.21.15.1:0/2074097383 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f11e405f150 0x7f11e4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.501+0000 7f11fca54700 1 --2- 172.21.15.1:0/2074097383 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f11e405f150 0x7f11e4061610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f11f8153050 tx=0x7f11ec007d40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:45.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.505+0000 7f11f57fa700 1 -- 172.21.15.1:0/2074097383 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f11f007de60 con 0x7f11f80a8230 2023-11-15T01:21:45.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.677+0000 7f11ff4b9700 1 -- 172.21.15.1:0/2074097383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f11f8096d00 con 0x7f11f80a8230 2023-11-15T01:21:45.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.678+0000 7f11f57fa700 1 -- 172.21.15.1:0/2074097383 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f11f001f070 con 0x7f11f80a8230 2023-11-15T01:21:45.679 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-11-15T01:21:45.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.680+0000 7f11ff4b9700 1 -- 172.21.15.1:0/2074097383 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f11e405f150 msgr2=0x7f11e4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.680+0000 7f11ff4b9700 1 --2- 172.21.15.1:0/2074097383 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f11e405f150 0x7f11e4061610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f11f8153050 tx=0x7f11ec007d40).stop 2023-11-15T01:21:45.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.680+0000 7f11ff4b9700 1 -- 172.21.15.1:0/2074097383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11f80a8230 msgr2=0x7f11f8157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.680+0000 7f11ff4b9700 1 --2- 172.21.15.1:0/2074097383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11f80a8230 0x7f11f8157f90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f11f0009f50 tx=0x7f11f0017000).stop 2023-11-15T01:21:45.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.680+0000 7f11ff4b9700 1 -- 172.21.15.1:0/2074097383 shutdown_connections 2023-11-15T01:21:45.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.680+0000 7f11ff4b9700 1 --2- 172.21.15.1:0/2074097383 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f11e405f150 0x7f11e4061610 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.680+0000 7f11ff4b9700 1 --2- 172.21.15.1:0/2074097383 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11f80c39c0 0x7f11f815aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.680+0000 7f11ff4b9700 1 --2- 172.21.15.1:0/2074097383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11f80a8230 0x7f11f8157f90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.680+0000 7f11ff4b9700 1 --2- 172.21.15.1:0/2074097383 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11f80bf720 0x7f11f81531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.680+0000 7f11ff4b9700 1 -- 172.21.15.1:0/2074097383 >> 172.21.15.1:0/2074097383 conn(0x7f11f8082f90 msgr2=0x7f11f8064750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:45.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.680+0000 7f11ff4b9700 1 -- 172.21.15.1:0/2074097383 shutdown_connections 2023-11-15T01:21:45.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.680+0000 7f11ff4b9700 1 -- 172.21.15.1:0/2074097383 wait complete. 2023-11-15T01:21:45.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-11-15T01:21:45.693 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-15T01:21:45.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.812+0000 7f6f225eb700 1 Processor -- start 2023-11-15T01:21:45.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.812+0000 7f6f225eb700 1 -- start start 2023-11-15T01:21:45.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.813+0000 7f6f225eb700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6f1c151e10 0x7f6f1c155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.813+0000 7f6f225eb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6f1c0c86b0 0x7f6f1c0aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.813+0000 7f6f225eb700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f1c0c7980 con 0x7f6f1c0c98b0 2023-11-15T01:21:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.813+0000 7f6f225eb700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f1c0c8b10 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.813+0000 7f6f225eb700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f1c0aa5c0 con 0x7f6f1c151e10 2023-11-15T01:21:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.813+0000 7f6f20de8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6f1c0c86b0 0x7f6f1c0aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.813+0000 7f6f21dea700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6f1c0c98b0 0x7f6f1c0c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58212/0 (socket says 172.21.15.1:58212) 2023-11-15T01:21:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.813+0000 7f6f21dea700 1 -- 172.21.15.1:0/2346948836 learned_addr learned my addr 172.21.15.1:0/2346948836 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.813+0000 7f6f215e9700 1 --2- 172.21.15.1:0/2346948836 >> v2:172.21.15.141:3300/0 conn(0x7f6f1c151e10 0x7f6f1c155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.813+0000 7f6f20de8700 1 -- 172.21.15.1:0/2346948836 >> v2:172.21.15.141:3300/0 conn(0x7f6f1c151e10 msgr2=0x7f6f1c155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.813+0000 7f6f20de8700 1 --2- 172.21.15.1:0/2346948836 >> v2:172.21.15.141:3300/0 conn(0x7f6f1c151e10 0x7f6f1c155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.813+0000 7f6f20de8700 1 -- 172.21.15.1:0/2346948836 >> v1:172.21.15.1:6789/0 conn(0x7f6f1c0c98b0 legacy=0x7f6f1c0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.813+0000 7f6f20de8700 1 -- 172.21.15.1:0/2346948836 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1c0aa890 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.813+0000 7f6f20de8700 1 --2- 172.21.15.1:0/2346948836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f1c0c86b0 0x7f6f1c0aa0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f6f1c084780 tx=0x7f6f0c009060).ready entity=mon.0 client_cookie=839b587f893325e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:45.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.814+0000 7f6f13fff700 1 -- 172.21.15.1:0/2346948836 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00f510 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.814+0000 7f6f13fff700 1 -- 172.21.15.1:0/2346948836 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c00f670 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.814+0000 7f6f13fff700 1 -- 172.21.15.1:0/2346948836 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00f9f0 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.814+0000 7f6f225eb700 1 -- 172.21.15.1:0/2346948836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f1c0c86b0 msgr2=0x7f6f1c0aa0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.814+0000 7f6f225eb700 1 --2- 172.21.15.1:0/2346948836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f1c0c86b0 0x7f6f1c0aa0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f6f1c084780 tx=0x7f6f0c009060).stop 2023-11-15T01:21:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.814+0000 7f6f225eb700 1 -- 172.21.15.1:0/2346948836 shutdown_connections 2023-11-15T01:21:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.814+0000 7f6f225eb700 1 --2- 172.21.15.1:0/2346948836 >> v2:172.21.15.141:3300/0 conn(0x7f6f1c151e10 0x7f6f1c155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.814+0000 7f6f225eb700 1 --2- 172.21.15.1:0/2346948836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f1c0c86b0 0x7f6f1c0aa0d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.814+0000 7f6f225eb700 1 -- 172.21.15.1:0/2346948836 >> 172.21.15.1:0/2346948836 conn(0x7f6f1c0947e0 msgr2=0x7f6f1c06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.814+0000 7f6f225eb700 1 -- 172.21.15.1:0/2346948836 shutdown_connections 2023-11-15T01:21:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.814+0000 7f6f225eb700 1 -- 172.21.15.1:0/2346948836 wait complete. 2023-11-15T01:21:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.815+0000 7f6f225eb700 1 Processor -- start 2023-11-15T01:21:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.815+0000 7f6f225eb700 1 -- start start 2023-11-15T01:21:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.816+0000 7f6f225eb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f1c0c86b0 0x7f6f1c156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.816+0000 7f6f225eb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f1c0c98b0 0x7f6f1c0ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.816+0000 7f6f225eb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f1c151e10 0x7f6f1c14e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.816+0000 7f6f225eb700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c1583a0 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.816+0000 7f6f225eb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c158680 con 0x7f6f1c151e10 2023-11-15T01:21:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.816+0000 7f6f225eb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c158960 con 0x7f6f1c0c98b0 2023-11-15T01:21:45.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.816+0000 7f6f215e9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f1c0c86b0 0x7f6f1c156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.816+0000 7f6f215e9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f1c0c86b0 0x7f6f1c156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55022/0 (socket says 172.21.15.1:55022) 2023-11-15T01:21:45.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.816+0000 7f6f215e9700 1 -- 172.21.15.1:0/143792006 learned_addr learned my addr 172.21.15.1:0/143792006 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:45.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.817+0000 7f6f21dea700 1 --2- 172.21.15.1:0/143792006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f1c151e10 0x7f6f1c14e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.817+0000 7f6f215e9700 1 -- 172.21.15.1:0/143792006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f1c0c98b0 msgr2=0x7f6f1c0ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.817+0000 7f6f20de8700 1 --2- 172.21.15.1:0/143792006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f1c0c98b0 0x7f6f1c0ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.817+0000 7f6f215e9700 1 --2- 172.21.15.1:0/143792006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f1c0c98b0 0x7f6f1c0ae290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.817+0000 7f6f215e9700 1 -- 172.21.15.1:0/143792006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f1c151e10 msgr2=0x7f6f1c14e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:45.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.817+0000 7f6f215e9700 1 --2- 172.21.15.1:0/143792006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f1c151e10 0x7f6f1c14e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:45.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.817+0000 7f6f215e9700 1 -- 172.21.15.1:0/143792006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c0092a0 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.817+0000 7f6f21dea700 1 --2- 172.21.15.1:0/143792006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f1c151e10 0x7f6f1c14e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:45.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.817+0000 7f6f215e9700 1 --2- 172.21.15.1:0/143792006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f1c0c86b0 0x7f6f1c156d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f6f1800e900 tx=0x7f6f18009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:45.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.817+0000 7f6f117fa700 1 -- 172.21.15.1:0/143792006 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800c640 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.817+0000 7f6f117fa700 1 -- 172.21.15.1:0/143792006 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1800c7a0 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.817+0000 7f6f225eb700 1 -- 172.21.15.1:0/143792006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f1c158c40 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.817+0000 7f6f117fa700 1 -- 172.21.15.1:0/143792006 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800cb20 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.817+0000 7f6f225eb700 1 -- 172.21.15.1:0/143792006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f1c157300 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.818+0000 7f6f225eb700 1 -- 172.21.15.1:0/143792006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f1c159290 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.818+0000 7f6f117fa700 1 -- 172.21.15.1:0/143792006 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6f1801b400 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.819+0000 7f6f117fa700 1 --2- 172.21.15.1:0/143792006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f0005f150 0x7f6f00061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.819+0000 7f6f117fa700 1 -- 172.21.15.1:0/143792006 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6f1807a5d0 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.819+0000 7f6f20de8700 1 --2- 172.21.15.1:0/143792006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f0005f150 0x7f6f00061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.819+0000 7f6f20de8700 1 --2- 172.21.15.1:0/143792006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f0005f150 0x7f6f00061610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f6f1c0a97e0 tx=0x7f6f0c017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.823+0000 7f6f117fa700 1 -- 172.21.15.1:0/143792006 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6f1804b840 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.997+0000 7f6f225eb700 1 -- 172.21.15.1:0/143792006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6f1c0475e0 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.998+0000 7f6f117fa700 1 -- 172.21.15.1:0/143792006 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f18016070 con 0x7f6f1c0c86b0 2023-11-15T01:21:45.999 INFO:teuthology.orchestra.run.smithi001.stdout:55834574853 2023-11-15T01:21:46.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.999+0000 7f6f225eb700 1 -- 172.21.15.1:0/143792006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f0005f150 msgr2=0x7f6f00061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.999+0000 7f6f225eb700 1 --2- 172.21.15.1:0/143792006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f0005f150 0x7f6f00061610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f6f1c0a97e0 tx=0x7f6f0c017000).stop 2023-11-15T01:21:46.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.999+0000 7f6f225eb700 1 -- 172.21.15.1:0/143792006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f1c0c86b0 msgr2=0x7f6f1c156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.999+0000 7f6f225eb700 1 --2- 172.21.15.1:0/143792006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f1c0c86b0 0x7f6f1c156d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f6f1800e900 tx=0x7f6f18009060).stop 2023-11-15T01:21:46.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.999+0000 7f6f225eb700 1 -- 172.21.15.1:0/143792006 shutdown_connections 2023-11-15T01:21:46.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.999+0000 7f6f225eb700 1 --2- 172.21.15.1:0/143792006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f0005f150 0x7f6f00061610 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.999+0000 7f6f225eb700 1 --2- 172.21.15.1:0/143792006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f1c151e10 0x7f6f1c14e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.999+0000 7f6f225eb700 1 --2- 172.21.15.1:0/143792006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f1c0c86b0 0x7f6f1c156d90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:45.999+0000 7f6f225eb700 1 --2- 172.21.15.1:0/143792006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f1c0c98b0 0x7f6f1c0ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.000+0000 7f6f225eb700 1 -- 172.21.15.1:0/143792006 >> 172.21.15.1:0/143792006 conn(0x7f6f1c0947e0 msgr2=0x7f6f1c150440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.000+0000 7f6f225eb700 1 -- 172.21.15.1:0/143792006 shutdown_connections 2023-11-15T01:21:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.000+0000 7f6f225eb700 1 -- 172.21.15.1:0/143792006 wait complete. 2023-11-15T01:21:46.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-11-15T01:21:46.012 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-15T01:21:46.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.130+0000 7f64a09f4700 1 Processor -- start 2023-11-15T01:21:46.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.130+0000 7f64a09f4700 1 -- start start 2023-11-15T01:21:46.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.131+0000 7f64a09f4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f649c155530 0x7f649c0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.131+0000 7f64a09f4700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f649c0c7980 con 0x7f649c0c98b0 2023-11-15T01:21:46.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.131+0000 7f64a09f4700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f649c0aa890 con 0x7f649c151e10 2023-11-15T01:21:46.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.131+0000 7f64a09f4700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649c0c7bd0 con 0x7f649c155530 2023-11-15T01:21:46.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.131+0000 7f649a59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f649c155530 0x7f649c0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.131+0000 7f649b59e700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f649c0c98b0 0x7f649c0c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58224/0 (socket says 172.21.15.1:58224) 2023-11-15T01:21:46.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.131+0000 7f649b59e700 1 -- 172.21.15.1:0/1562100672 learned_addr learned my addr 172.21.15.1:0/1562100672 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:46.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.131+0000 7f649a59c700 1 -- 172.21.15.1:0/1562100672 >> v1:172.21.15.141:6789/0 conn(0x7f649c151e10 legacy=0x7f649c0aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.131+0000 7f649a59c700 1 -- 172.21.15.1:0/1562100672 >> v1:172.21.15.1:6789/0 conn(0x7f649c0c98b0 legacy=0x7f649c0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.131+0000 7f649a59c700 1 -- 172.21.15.1:0/1562100672 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649c0c7eb0 con 0x7f649c155530 2023-11-15T01:21:46.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.131+0000 7f6499d9b700 1 -- 172.21.15.1:0/1562100672 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046814849 0 0) 0x7f649c0c7980 con 0x7f649c0c98b0 2023-11-15T01:21:46.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.131+0000 7f649a59c700 1 --2- 172.21.15.1:0/1562100672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f649c155530 0x7f649c0c86b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f6484009760 tx=0x7f6484009060).ready entity=mon.0 client_cookie=ca0efd7b940ed7f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:46.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.132+0000 7f6499d9b700 1 -- 172.21.15.1:0/1562100672 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648400b580 con 0x7f649c155530 2023-11-15T01:21:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.132+0000 7f6499d9b700 1 -- 172.21.15.1:0/1562100672 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648400b6e0 con 0x7f649c155530 2023-11-15T01:21:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.132+0000 7f6499d9b700 1 -- 172.21.15.1:0/1562100672 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648400ba60 con 0x7f649c155530 2023-11-15T01:21:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.132+0000 7f64a09f4700 1 -- 172.21.15.1:0/1562100672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f649c155530 msgr2=0x7f649c0c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.132+0000 7f64a09f4700 1 --2- 172.21.15.1:0/1562100672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f649c155530 0x7f649c0c86b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f6484009760 tx=0x7f6484009060).stop 2023-11-15T01:21:46.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.132+0000 7f64a09f4700 1 -- 172.21.15.1:0/1562100672 shutdown_connections 2023-11-15T01:21:46.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.132+0000 7f64a09f4700 1 --2- 172.21.15.1:0/1562100672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f649c155530 0x7f649c0c86b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.132+0000 7f64a09f4700 1 -- 172.21.15.1:0/1562100672 >> 172.21.15.1:0/1562100672 conn(0x7f649c0947e0 msgr2=0x7f649c06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:46.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.132+0000 7f64a09f4700 1 -- 172.21.15.1:0/1562100672 shutdown_connections 2023-11-15T01:21:46.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.132+0000 7f64a09f4700 1 -- 172.21.15.1:0/1562100672 wait complete. 2023-11-15T01:21:46.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.133+0000 7f64a09f4700 1 Processor -- start 2023-11-15T01:21:46.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.134+0000 7f64a09f4700 1 -- start start 2023-11-15T01:21:46.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.134+0000 7f64a09f4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f649c0c98b0 0x7f649c146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.134+0000 7f64a09f4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f649c151e10 0x7f649c0aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.134+0000 7f64a09f4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f649c155530 0x7f649c0ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.134+0000 7f64a09f4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c0adbf0 con 0x7f649c155530 2023-11-15T01:21:46.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.134+0000 7f64a09f4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c0962f0 con 0x7f649c0c98b0 2023-11-15T01:21:46.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.134+0000 7f64a09f4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649c095a20 con 0x7f649c151e10 2023-11-15T01:21:46.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.134+0000 7f649b59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f649c155530 0x7f649c0ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.134+0000 7f649b59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f649c155530 0x7f649c0ab0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55030/0 (socket says 172.21.15.1:55030) 2023-11-15T01:21:46.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.134+0000 7f649b59e700 1 -- 172.21.15.1:0/2220510961 learned_addr learned my addr 172.21.15.1:0/2220510961 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:46.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.135+0000 7f649a59c700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f649c151e10 0x7f649c0aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.135+0000 7f649ad9d700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f649c0c98b0 0x7f649c146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.135+0000 7f649b59e700 1 -- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f649c151e10 msgr2=0x7f649c0aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.135+0000 7f649b59e700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f649c151e10 0x7f649c0aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.135+0000 7f649b59e700 1 -- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f649c0c98b0 msgr2=0x7f649c146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.135+0000 7f649b59e700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f649c0c98b0 0x7f649c146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.135+0000 7f649b59e700 1 -- 172.21.15.1:0/2220510961 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64840092a0 con 0x7f649c155530 2023-11-15T01:21:46.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.135+0000 7f649a59c700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f649c151e10 0x7f649c0aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:46.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.135+0000 7f649ad9d700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f649c0c98b0 0x7f649c146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:46.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.135+0000 7f649b59e700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f649c155530 0x7f649c0ab0f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f648c00c7e0 tx=0x7f648c007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:46.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.135+0000 7f6492ffd700 1 -- 172.21.15.1:0/2220510961 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c005d30 con 0x7f649c155530 2023-11-15T01:21:46.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.135+0000 7f6492ffd700 1 -- 172.21.15.1:0/2220510961 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c005e90 con 0x7f649c155530 2023-11-15T01:21:46.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.135+0000 7f6492ffd700 1 -- 172.21.15.1:0/2220510961 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c007320 con 0x7f649c155530 2023-11-15T01:21:46.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.135+0000 7f64a09f4700 1 -- 172.21.15.1:0/2220510961 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649c0ad910 con 0x7f649c155530 2023-11-15T01:21:46.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.135+0000 7f64a09f4700 1 -- 172.21.15.1:0/2220510961 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649c096000 con 0x7f649c155530 2023-11-15T01:21:46.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.136+0000 7f64a09f4700 1 -- 172.21.15.1:0/2220510961 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649c0475e0 con 0x7f649c155530 2023-11-15T01:21:46.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.136+0000 7f6492ffd700 1 -- 172.21.15.1:0/2220510961 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f648c007710 con 0x7f649c155530 2023-11-15T01:21:46.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.137+0000 7f6492ffd700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f647c05f150 0x7f647c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.137+0000 7f6492ffd700 1 -- 172.21.15.1:0/2220510961 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f648c07a220 con 0x7f649c155530 2023-11-15T01:21:46.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.137+0000 7f649ad9d700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f647c05f150 0x7f647c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.137+0000 7f649ad9d700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f647c05f150 0x7f647c061610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f6494001710 tx=0x7f6494009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:46.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.141+0000 7f6492ffd700 1 -- 172.21.15.1:0/2220510961 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f648c04b4f0 con 0x7f649c155530 2023-11-15T01:21:46.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.312+0000 7f64a09f4700 1 -- 172.21.15.1:0/2220510961 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f649c060900 con 0x7f649c155530 2023-11-15T01:21:46.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.312+0000 7f6492ffd700 1 -- 172.21.15.1:0/2220510961 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f648c04eb10 con 0x7f649c155530 2023-11-15T01:21:46.314 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-11-15T01:21:46.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.314+0000 7f64a09f4700 1 -- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f647c05f150 msgr2=0x7f647c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.314+0000 7f64a09f4700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f647c05f150 0x7f647c061610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f6494001710 tx=0x7f6494009040).stop 2023-11-15T01:21:46.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.314+0000 7f64a09f4700 1 -- 172.21.15.1:0/2220510961 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f649c155530 msgr2=0x7f649c0ab0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.314+0000 7f64a09f4700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f649c155530 0x7f649c0ab0f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f648c00c7e0 tx=0x7f648c007f90).stop 2023-11-15T01:21:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.314+0000 7f64a09f4700 1 -- 172.21.15.1:0/2220510961 shutdown_connections 2023-11-15T01:21:46.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.314+0000 7f64a09f4700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f647c05f150 0x7f647c061610 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.314+0000 7f64a09f4700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f649c155530 0x7f649c0ab0f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.314+0000 7f64a09f4700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f649c0c98b0 0x7f649c146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.314+0000 7f64a09f4700 1 --2- 172.21.15.1:0/2220510961 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f649c151e10 0x7f649c0aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.314+0000 7f64a09f4700 1 -- 172.21.15.1:0/2220510961 >> 172.21.15.1:0/2220510961 conn(0x7f649c0947e0 msgr2=0x7f649c1536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:46.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.314+0000 7f64a09f4700 1 -- 172.21.15.1:0/2220510961 shutdown_connections 2023-11-15T01:21:46.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.314+0000 7f64a09f4700 1 -- 172.21.15.1:0/2220510961 wait complete. 2023-11-15T01:21:46.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-11-15T01:21:46.327 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-15T01:21:46.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.446+0000 7f636cabf700 1 Processor -- start 2023-11-15T01:21:46.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.446+0000 7f636cabf700 1 -- start start 2023-11-15T01:21:46.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f636cabf700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6368154250 0x7f6368154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f636cabf700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63680aa700 0x7f63680c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f636cabf700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6368158ff0 con 0x7f63680c6110 2023-11-15T01:21:46.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f636cabf700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6368158100 con 0x7f6368154250 2023-11-15T01:21:46.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f636cabf700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63681583e0 con 0x7f63680aa700 2023-11-15T01:21:46.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f636659c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6368154250 0x7f6368154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f6365d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f63680c6110 0x7f63680a9ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58238/0 (socket says 172.21.15.1:58238) 2023-11-15T01:21:46.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f6365d9b700 1 -- 172.21.15.1:0/3763057023 learned_addr learned my addr 172.21.15.1:0/3763057023 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:46.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f636659c700 1 -- 172.21.15.1:0/3763057023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63680aa700 msgr2=0x7f63680c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:46.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f6366d9d700 1 --2- 172.21.15.1:0/3763057023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63680aa700 0x7f63680c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f636659c700 1 --2- 172.21.15.1:0/3763057023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63680aa700 0x7f63680c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f636559a700 1 -- 172.21.15.1:0/3763057023 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318109812 0 0) 0x7f6368158ff0 con 0x7f63680c6110 2023-11-15T01:21:46.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f636659c700 1 -- 172.21.15.1:0/3763057023 >> v1:172.21.15.1:6789/0 conn(0x7f63680c6110 legacy=0x7f63680a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f636659c700 1 -- 172.21.15.1:0/3763057023 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63681586c0 con 0x7f6368154250 2023-11-15T01:21:46.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f6366d9d700 1 --2- 172.21.15.1:0/3763057023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63680aa700 0x7f63680c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:46.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.447+0000 7f636659c700 1 --2- 172.21.15.1:0/3763057023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6368154250 0x7f6368154630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f6358009760 tx=0x7f6358009060).ready entity=mon.0 client_cookie=dbd696eddb46dcc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:46.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.448+0000 7f636559a700 1 -- 172.21.15.1:0/3763057023 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635800b580 con 0x7f6368154250 2023-11-15T01:21:46.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.448+0000 7f636559a700 1 -- 172.21.15.1:0/3763057023 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635800b6e0 con 0x7f6368154250 2023-11-15T01:21:46.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.448+0000 7f636559a700 1 -- 172.21.15.1:0/3763057023 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635800ba60 con 0x7f6368154250 2023-11-15T01:21:46.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.448+0000 7f636cabf700 1 -- 172.21.15.1:0/3763057023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6368154250 msgr2=0x7f6368154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.448+0000 7f636cabf700 1 --2- 172.21.15.1:0/3763057023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6368154250 0x7f6368154630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f6358009760 tx=0x7f6358009060).stop 2023-11-15T01:21:46.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.448+0000 7f636cabf700 1 -- 172.21.15.1:0/3763057023 shutdown_connections 2023-11-15T01:21:46.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.448+0000 7f636cabf700 1 --2- 172.21.15.1:0/3763057023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63680aa700 0x7f63680c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.448+0000 7f636cabf700 1 --2- 172.21.15.1:0/3763057023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6368154250 0x7f6368154630 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.448+0000 7f636cabf700 1 -- 172.21.15.1:0/3763057023 >> 172.21.15.1:0/3763057023 conn(0x7f63680c7b20 msgr2=0x7f63680c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:46.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.448+0000 7f636cabf700 1 -- 172.21.15.1:0/3763057023 shutdown_connections 2023-11-15T01:21:46.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.448+0000 7f636cabf700 1 -- 172.21.15.1:0/3763057023 wait complete. 2023-11-15T01:21:46.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.449+0000 7f636cabf700 1 Processor -- start 2023-11-15T01:21:46.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.449+0000 7f636cabf700 1 -- start start 2023-11-15T01:21:46.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.450+0000 7f636cabf700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63680aa700 0x7f6368156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.450+0000 7f636cabf700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63680c6110 0x7f63680acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.450+0000 7f636cabf700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6368154250 0x7f6368154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.450+0000 7f636cabf700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680c4500 con 0x7f63680c6110 2023-11-15T01:21:46.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.450+0000 7f636cabf700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63681557b0 con 0x7f6368154250 2023-11-15T01:21:46.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.450+0000 7f636cabf700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6368155a90 con 0x7f63680aa700 2023-11-15T01:21:46.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.450+0000 7f6365d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63680c6110 0x7f63680acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.450+0000 7f6365d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63680c6110 0x7f63680acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55050/0 (socket says 172.21.15.1:55050) 2023-11-15T01:21:46.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.450+0000 7f6365d9b700 1 -- 172.21.15.1:0/2700149269 learned_addr learned my addr 172.21.15.1:0/2700149269 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:46.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.450+0000 7f636659c700 1 --2- 172.21.15.1:0/2700149269 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63680aa700 0x7f6368156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.450+0000 7f6366d9d700 1 --2- 172.21.15.1:0/2700149269 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6368154250 0x7f6368154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.450+0000 7f6365d9b700 1 -- 172.21.15.1:0/2700149269 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63680aa700 msgr2=0x7f6368156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.451+0000 7f6365d9b700 1 --2- 172.21.15.1:0/2700149269 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63680aa700 0x7f6368156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.451+0000 7f6365d9b700 1 -- 172.21.15.1:0/2700149269 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6368154250 msgr2=0x7f6368154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.451+0000 7f6365d9b700 1 --2- 172.21.15.1:0/2700149269 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6368154250 0x7f6368154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.451+0000 7f6365d9b700 1 -- 172.21.15.1:0/2700149269 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63580092a0 con 0x7f63680c6110 2023-11-15T01:21:46.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.451+0000 7f6366d9d700 1 --2- 172.21.15.1:0/2700149269 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6368154250 0x7f6368154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:46.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.451+0000 7f6365d9b700 1 --2- 172.21.15.1:0/2700149269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63680c6110 0x7f63680acad0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f635c00c4c0 tx=0x7f635c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:46.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.451+0000 7f63567fc700 1 -- 172.21.15.1:0/2700149269 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c0072e0 con 0x7f63680c6110 2023-11-15T01:21:46.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.451+0000 7f63567fc700 1 -- 172.21.15.1:0/2700149269 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c007440 con 0x7f63680c6110 2023-11-15T01:21:46.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.451+0000 7f636cabf700 1 -- 172.21.15.1:0/2700149269 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6368155d70 con 0x7f63680c6110 2023-11-15T01:21:46.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.451+0000 7f63567fc700 1 -- 172.21.15.1:0/2700149269 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c0057a0 con 0x7f63680c6110 2023-11-15T01:21:46.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.451+0000 7f636cabf700 1 -- 172.21.15.1:0/2700149269 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63680acfc0 con 0x7f63680c6110 2023-11-15T01:21:46.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.452+0000 7f636cabf700 1 -- 172.21.15.1:0/2700149269 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6368156190 con 0x7f63680c6110 2023-11-15T01:21:46.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.452+0000 7f63567fc700 1 -- 172.21.15.1:0/2700149269 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f635c005bd0 con 0x7f63680c6110 2023-11-15T01:21:46.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.453+0000 7f63567fc700 1 --2- 172.21.15.1:0/2700149269 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f634805f150 0x7f6348061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.453+0000 7f63567fc700 1 -- 172.21.15.1:0/2700149269 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f635c079940 con 0x7f63680c6110 2023-11-15T01:21:46.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.453+0000 7f636659c700 1 --2- 172.21.15.1:0/2700149269 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f634805f150 0x7f6348061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.453+0000 7f636659c700 1 --2- 172.21.15.1:0/2700149269 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f634805f150 0x7f6348061610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f635800b340 tx=0x7f6358017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:46.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.457+0000 7f63567fc700 1 -- 172.21.15.1:0/2700149269 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6368156190 con 0x7f63680c6110 2023-11-15T01:21:46.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.630+0000 7f636cabf700 1 -- 172.21.15.1:0/2700149269 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6368156190 con 0x7f63680c6110 2023-11-15T01:21:46.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.630+0000 7f63567fc700 1 -- 172.21.15.1:0/2700149269 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6368156190 con 0x7f63680c6110 2023-11-15T01:21:46.631 INFO:teuthology.orchestra.run.smithi001.stdout:55834574852 2023-11-15T01:21:46.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.632+0000 7f636cabf700 1 -- 172.21.15.1:0/2700149269 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f634805f150 msgr2=0x7f6348061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.632+0000 7f636cabf700 1 --2- 172.21.15.1:0/2700149269 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f634805f150 0x7f6348061610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f635800b340 tx=0x7f6358017000).stop 2023-11-15T01:21:46.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.632+0000 7f636cabf700 1 -- 172.21.15.1:0/2700149269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63680c6110 msgr2=0x7f63680acad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.632+0000 7f636cabf700 1 --2- 172.21.15.1:0/2700149269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63680c6110 0x7f63680acad0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f635c00c4c0 tx=0x7f635c007c10).stop 2023-11-15T01:21:46.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.632+0000 7f636cabf700 1 -- 172.21.15.1:0/2700149269 shutdown_connections 2023-11-15T01:21:46.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.632+0000 7f636cabf700 1 --2- 172.21.15.1:0/2700149269 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f634805f150 0x7f6348061610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.632+0000 7f636cabf700 1 --2- 172.21.15.1:0/2700149269 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6368154250 0x7f6368154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.632+0000 7f636cabf700 1 --2- 172.21.15.1:0/2700149269 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63680aa700 0x7f6368156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.632+0000 7f636cabf700 1 --2- 172.21.15.1:0/2700149269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63680c6110 0x7f63680acad0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.632+0000 7f636cabf700 1 -- 172.21.15.1:0/2700149269 >> 172.21.15.1:0/2700149269 conn(0x7f63680c7b20 msgr2=0x7f63680bffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:46.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.632+0000 7f636cabf700 1 -- 172.21.15.1:0/2700149269 shutdown_connections 2023-11-15T01:21:46.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.632+0000 7f636cabf700 1 -- 172.21.15.1:0/2700149269 wait complete. 2023-11-15T01:21:46.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2023-11-15T01:21:46.645 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-15T01:21:46.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.763+0000 7fe9aac44700 1 Processor -- start 2023-11-15T01:21:46.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.763+0000 7fe9aac44700 1 -- start start 2023-11-15T01:21:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.764+0000 7fe9aac44700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe9a4155530 0x7fe9a40c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.764+0000 7fe9aac44700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe9a40c98b0 0x7fe9a40c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.764+0000 7fe9aac44700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a40c7980 con 0x7fe9a4151e10 2023-11-15T01:21:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.764+0000 7fe9aac44700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a40aa890 con 0x7fe9a40c98b0 2023-11-15T01:21:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.764+0000 7fe9aac44700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a40c7bd0 con 0x7fe9a4155530 2023-11-15T01:21:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.764+0000 7fe9aa443700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe9a40c98b0 0x7fe9a40c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.764+0000 7fe9aa443700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe9a40c98b0 0x7fe9a40c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55062/0 (socket says 172.21.15.1:55062) 2023-11-15T01:21:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.764+0000 7fe9aa443700 1 -- 172.21.15.1:0/4191415050 learned_addr learned my addr 172.21.15.1:0/4191415050 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.764+0000 7fe9a9441700 1 --2- 172.21.15.1:0/4191415050 >> v2:172.21.15.141:3300/0 conn(0x7fe9a4155530 0x7fe9a40c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.764+0000 7fe9aa443700 1 -- 172.21.15.1:0/4191415050 >> v2:172.21.15.141:3300/0 conn(0x7fe9a4155530 msgr2=0x7fe9a40c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.764+0000 7fe9aa443700 1 --2- 172.21.15.1:0/4191415050 >> v2:172.21.15.141:3300/0 conn(0x7fe9a4155530 0x7fe9a40c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.764+0000 7fe9aa443700 1 -- 172.21.15.1:0/4191415050 >> v1:172.21.15.141:6789/0 conn(0x7fe9a4151e10 legacy=0x7fe9a40aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.764+0000 7fe9aa443700 1 -- 172.21.15.1:0/4191415050 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a40c7eb0 con 0x7fe9a40c98b0 2023-11-15T01:21:46.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.765+0000 7fe9aa443700 1 --2- 172.21.15.1:0/4191415050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a40c98b0 0x7fe9a40c9cc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fe9a4157e90 tx=0x7fe994009840).ready entity=mon.0 client_cookie=45846da25c62e4bb server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:46.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.765+0000 7fe9a8c40700 1 -- 172.21.15.1:0/4191415050 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99400e070 con 0x7fe9a40c98b0 2023-11-15T01:21:46.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.765+0000 7fe9a8c40700 1 -- 172.21.15.1:0/4191415050 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99400ba20 con 0x7fe9a40c98b0 2023-11-15T01:21:46.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.765+0000 7fe9a8c40700 1 -- 172.21.15.1:0/4191415050 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99400bda0 con 0x7fe9a40c98b0 2023-11-15T01:21:46.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.765+0000 7fe9aac44700 1 -- 172.21.15.1:0/4191415050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a40c98b0 msgr2=0x7fe9a40c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.765+0000 7fe9aac44700 1 --2- 172.21.15.1:0/4191415050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a40c98b0 0x7fe9a40c9cc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fe9a4157e90 tx=0x7fe994009840).stop 2023-11-15T01:21:46.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.765+0000 7fe9aac44700 1 -- 172.21.15.1:0/4191415050 shutdown_connections 2023-11-15T01:21:46.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.765+0000 7fe9aac44700 1 --2- 172.21.15.1:0/4191415050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a40c98b0 0x7fe9a40c9cc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.765+0000 7fe9aac44700 1 --2- 172.21.15.1:0/4191415050 >> v2:172.21.15.141:3300/0 conn(0x7fe9a4155530 0x7fe9a40c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.765+0000 7fe9aac44700 1 -- 172.21.15.1:0/4191415050 >> 172.21.15.1:0/4191415050 conn(0x7fe9a40947e0 msgr2=0x7fe9a406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:46.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.765+0000 7fe9aac44700 1 -- 172.21.15.1:0/4191415050 shutdown_connections 2023-11-15T01:21:46.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.765+0000 7fe9aac44700 1 -- 172.21.15.1:0/4191415050 wait complete. 2023-11-15T01:21:46.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.766+0000 7fe9aac44700 1 Processor -- start 2023-11-15T01:21:46.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.766+0000 7fe9aac44700 1 -- start start 2023-11-15T01:21:46.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.767+0000 7fe9aac44700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9a40c98b0 0x7fe9a40ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.767+0000 7fe9aac44700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a4151e10 0x7fe9a40a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.767+0000 7fe9aac44700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a4155530 0x7fe9a40a9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.767+0000 7fe9aac44700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a40a9850 con 0x7fe9a4151e10 2023-11-15T01:21:46.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.767+0000 7fe9aac44700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a4164230 con 0x7fe9a4155530 2023-11-15T01:21:46.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.767+0000 7fe9aac44700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a40add30 con 0x7fe9a40c98b0 2023-11-15T01:21:46.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.767+0000 7fe9a9441700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a4151e10 0x7fe9a40a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.767+0000 7fe9a9441700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a4151e10 0x7fe9a40a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55068/0 (socket says 172.21.15.1:55068) 2023-11-15T01:21:46.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.767+0000 7fe9a9441700 1 -- 172.21.15.1:0/2236701586 learned_addr learned my addr 172.21.15.1:0/2236701586 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:46.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.767+0000 7fe9aa443700 1 --2- 172.21.15.1:0/2236701586 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a4155530 0x7fe9a40a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.767+0000 7fe9a9c42700 1 --2- 172.21.15.1:0/2236701586 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9a40c98b0 0x7fe9a40ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.768+0000 7fe9a9441700 1 -- 172.21.15.1:0/2236701586 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9a40c98b0 msgr2=0x7fe9a40ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.768+0000 7fe9a9441700 1 --2- 172.21.15.1:0/2236701586 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9a40c98b0 0x7fe9a40ab350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.768+0000 7fe9a9441700 1 -- 172.21.15.1:0/2236701586 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a4155530 msgr2=0x7fe9a40a9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.768+0000 7fe9a9441700 1 --2- 172.21.15.1:0/2236701586 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a4155530 0x7fe9a40a9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.768+0000 7fe9a9441700 1 -- 172.21.15.1:0/2236701586 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe994009ae0 con 0x7fe9a4151e10 2023-11-15T01:21:46.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.768+0000 7fe9aa443700 1 --2- 172.21.15.1:0/2236701586 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a4155530 0x7fe9a40a9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:46.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.768+0000 7fe9a9441700 1 --2- 172.21.15.1:0/2236701586 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a4151e10 0x7fe9a40a8e70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fe99800e900 tx=0x7fe998009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:46.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.768+0000 7fe9a1ffb700 1 -- 172.21.15.1:0/2236701586 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998012600 con 0x7fe9a4151e10 2023-11-15T01:21:46.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.768+0000 7fe9a1ffb700 1 -- 172.21.15.1:0/2236701586 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe998012760 con 0x7fe9a4151e10 2023-11-15T01:21:46.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.768+0000 7fe9a1ffb700 1 -- 172.21.15.1:0/2236701586 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998012ae0 con 0x7fe9a4151e10 2023-11-15T01:21:46.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.768+0000 7fe9aac44700 1 -- 172.21.15.1:0/2236701586 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a40ada50 con 0x7fe9a4151e10 2023-11-15T01:21:46.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.768+0000 7fe9aac44700 1 -- 172.21.15.1:0/2236701586 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a41647a0 con 0x7fe9a4151e10 2023-11-15T01:21:46.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.769+0000 7fe9aac44700 1 -- 172.21.15.1:0/2236701586 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a40aa640 con 0x7fe9a4151e10 2023-11-15T01:21:46.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.769+0000 7fe9a1ffb700 1 -- 172.21.15.1:0/2236701586 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe99801b400 con 0x7fe9a4151e10 2023-11-15T01:21:46.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.770+0000 7fe9a1ffb700 1 --2- 172.21.15.1:0/2236701586 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe99005f150 0x7fe990061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:46.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.770+0000 7fe9a1ffb700 1 -- 172.21.15.1:0/2236701586 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe99807a580 con 0x7fe9a4151e10 2023-11-15T01:21:46.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.770+0000 7fe9a9c42700 1 --2- 172.21.15.1:0/2236701586 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe99005f150 0x7fe990061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:46.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.770+0000 7fe9a9c42700 1 --2- 172.21.15.1:0/2236701586 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe99005f150 0x7fe990061610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe9a414f480 tx=0x7fe99c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:46.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.774+0000 7fe9a1ffb700 1 -- 172.21.15.1:0/2236701586 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe99804b7f0 con 0x7fe9a4151e10 2023-11-15T01:21:46.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.948+0000 7fe9aac44700 1 -- 172.21.15.1:0/2236701586 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe9a40475e0 con 0x7fe9a4151e10 2023-11-15T01:21:46.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.948+0000 7fe9a1ffb700 1 -- 172.21.15.1:0/2236701586 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe99804ee10 con 0x7fe9a4151e10 2023-11-15T01:21:46.949 INFO:teuthology.orchestra.run.smithi001.stdout:55834574853 2023-11-15T01:21:46.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.950+0000 7fe9aac44700 1 -- 172.21.15.1:0/2236701586 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe99005f150 msgr2=0x7fe990061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.950+0000 7fe9aac44700 1 --2- 172.21.15.1:0/2236701586 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe99005f150 0x7fe990061610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe9a414f480 tx=0x7fe99c009040).stop 2023-11-15T01:21:46.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.950+0000 7fe9aac44700 1 -- 172.21.15.1:0/2236701586 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a4151e10 msgr2=0x7fe9a40a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:46.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.950+0000 7fe9aac44700 1 --2- 172.21.15.1:0/2236701586 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a4151e10 0x7fe9a40a8e70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fe99800e900 tx=0x7fe998009060).stop 2023-11-15T01:21:46.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.950+0000 7fe9aac44700 1 -- 172.21.15.1:0/2236701586 shutdown_connections 2023-11-15T01:21:46.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.950+0000 7fe9aac44700 1 --2- 172.21.15.1:0/2236701586 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe99005f150 0x7fe990061610 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.950+0000 7fe9aac44700 1 --2- 172.21.15.1:0/2236701586 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9a4155530 0x7fe9a40a9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.950+0000 7fe9aac44700 1 --2- 172.21.15.1:0/2236701586 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9a40c98b0 0x7fe9a40ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.950+0000 7fe9aac44700 1 --2- 172.21.15.1:0/2236701586 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a4151e10 0x7fe9a40a8e70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:46.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.950+0000 7fe9aac44700 1 -- 172.21.15.1:0/2236701586 >> 172.21.15.1:0/2236701586 conn(0x7fe9a40947e0 msgr2=0x7fe9a414ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:46.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.950+0000 7fe9aac44700 1 -- 172.21.15.1:0/2236701586 shutdown_connections 2023-11-15T01:21:46.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:46.950+0000 7fe9aac44700 1 -- 172.21.15.1:0/2236701586 wait complete. 2023-11-15T01:21:46.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.5 2023-11-15T01:21:46.963 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-15T01:21:47.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.081+0000 7f1e663d4700 1 Processor -- start 2023-11-15T01:21:47.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.081+0000 7f1e663d4700 1 -- start start 2023-11-15T01:21:47.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.082+0000 7f1e663d4700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1e600c9fc0 0x7f1e600c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.082+0000 7f1e663d4700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e600c7980 con 0x7f1e60155530 2023-11-15T01:21:47.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.082+0000 7f1e663d4700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e600aa890 con 0x7f1e60151e10 2023-11-15T01:21:47.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.082+0000 7f1e663d4700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e600c7bd0 con 0x7f1e600c9fc0 2023-11-15T01:21:47.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.082+0000 7f1e64bd1700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f1e60155530 0x7f1e600c98b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58240/0 (socket says 172.21.15.1:58240) 2023-11-15T01:21:47.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.082+0000 7f1e64bd1700 1 -- 172.21.15.1:0/2937184719 learned_addr learned my addr 172.21.15.1:0/2937184719 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:47.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.082+0000 7f1e5ffff700 1 -- 172.21.15.1:0/2937184719 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102393808 0 0) 0x7f1e600c7980 con 0x7f1e60155530 2023-11-15T01:21:47.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.082+0000 7f1e65bd3700 1 --2- 172.21.15.1:0/2937184719 >> v2:172.21.15.141:3300/0 conn(0x7f1e600c9fc0 0x7f1e600c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.082+0000 7f1e5ffff700 1 -- 172.21.15.1:0/2937184719 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e480033f0 con 0x7f1e60155530 2023-11-15T01:21:47.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 -- 172.21.15.1:0/2937184719 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1211780485 0 0) 0x7f1e480033f0 con 0x7f1e60155530 2023-11-15T01:21:47.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 -- 172.21.15.1:0/2937184719 >> v2:172.21.15.141:3300/0 conn(0x7f1e600c9fc0 msgr2=0x7f1e600c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:47.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 --2- 172.21.15.1:0/2937184719 >> v2:172.21.15.141:3300/0 conn(0x7f1e600c9fc0 0x7f1e600c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 -- 172.21.15.1:0/2937184719 >> v1:172.21.15.141:6789/0 conn(0x7f1e60151e10 legacy=0x7f1e600aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 -- 172.21.15.1:0/2937184719 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e600c7eb0 con 0x7f1e60155530 2023-11-15T01:21:47.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 -- 172.21.15.1:0/2937184719 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f1e54001470 con 0x7f1e60155530 2023-11-15T01:21:47.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 -- 172.21.15.1:0/2937184719 >> v1:172.21.15.1:6789/0 conn(0x7f1e60155530 legacy=0x7f1e600c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 --2- 172.21.15.1:0/2937184719 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e480038e0 0x7f1e48003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 --2- 172.21.15.1:0/2937184719 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e48004690 0x7f1e48004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 --2- 172.21.15.1:0/2937184719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e48005000 0x7f1e4800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 -- 172.21.15.1:0/2937184719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e600c7bd0 con 0x7f1e48005000 2023-11-15T01:21:47.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 -- 172.21.15.1:0/2937184719 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4800beb0 con 0x7f1e48004690 2023-11-15T01:21:47.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 -- 172.21.15.1:0/2937184719 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4800c070 con 0x7f1e480038e0 2023-11-15T01:21:47.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e65bd3700 1 --2- 172.21.15.1:0/2937184719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e48005000 0x7f1e4800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e64bd1700 1 --2- 172.21.15.1:0/2937184719 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e48004690 0x7f1e48004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e653d2700 1 --2- 172.21.15.1:0/2937184719 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e480038e0 0x7f1e48003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e65bd3700 1 -- 172.21.15.1:0/2937184719 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e480038e0 msgr2=0x7f1e48003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:47.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e65bd3700 1 --2- 172.21.15.1:0/2937184719 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e480038e0 0x7f1e48003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e65bd3700 1 -- 172.21.15.1:0/2937184719 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e48004690 msgr2=0x7f1e48004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:47.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e65bd3700 1 --2- 172.21.15.1:0/2937184719 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e48004690 0x7f1e48004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e65bd3700 1 -- 172.21.15.1:0/2937184719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e480033f0 con 0x7f1e48005000 2023-11-15T01:21:47.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e65bd3700 1 -- 172.21.15.1:0/2937184719 reap_dead start 2023-11-15T01:21:47.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e65bd3700 1 --2- 172.21.15.1:0/2937184719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e48005000 0x7f1e4800b8e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f1e5000e210 tx=0x7f1e5000b040).ready entity=mon.0 client_cookie=22ce67302e780ae0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:47.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 -- 172.21.15.1:0/2937184719 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50009ac0 con 0x7f1e48005000 2023-11-15T01:21:47.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 -- 172.21.15.1:0/2937184719 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5000f040 con 0x7f1e48005000 2023-11-15T01:21:47.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.083+0000 7f1e5ffff700 1 -- 172.21.15.1:0/2937184719 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5000ed10 con 0x7f1e48005000 2023-11-15T01:21:47.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.084+0000 7f1e663d4700 1 -- 172.21.15.1:0/2937184719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e48005000 msgr2=0x7f1e4800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.084+0000 7f1e663d4700 1 --2- 172.21.15.1:0/2937184719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e48005000 0x7f1e4800b8e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f1e5000e210 tx=0x7f1e5000b040).stop 2023-11-15T01:21:47.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.084+0000 7f1e663d4700 1 -- 172.21.15.1:0/2937184719 shutdown_connections 2023-11-15T01:21:47.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.084+0000 7f1e663d4700 1 --2- 172.21.15.1:0/2937184719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e48005000 0x7f1e4800b8e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.084+0000 7f1e663d4700 1 -- 172.21.15.1:0/2937184719 >> 172.21.15.1:0/2937184719 conn(0x7f1e600947e0 msgr2=0x7f1e6006a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:47.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.084+0000 7f1e663d4700 1 -- 172.21.15.1:0/2937184719 shutdown_connections 2023-11-15T01:21:47.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.084+0000 7f1e663d4700 1 -- 172.21.15.1:0/2937184719 wait complete. 2023-11-15T01:21:47.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.085+0000 7f1e663d4700 1 Processor -- start 2023-11-15T01:21:47.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.085+0000 7f1e663d4700 1 -- start start 2023-11-15T01:21:47.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.086+0000 7f1e663d4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e48005000 0x7f1e600af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.086+0000 7f1e663d4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e6014ec30 0x7f1e600aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.086+0000 7f1e663d4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e6014f0b0 0x7f1e60156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.086+0000 7f1e663d4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e600ac7a0 con 0x7f1e6014f0b0 2023-11-15T01:21:47.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.086+0000 7f1e663d4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e600abed0 con 0x7f1e48005000 2023-11-15T01:21:47.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.086+0000 7f1e663d4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e600ab630 con 0x7f1e6014ec30 2023-11-15T01:21:47.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.086+0000 7f1e65bd3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e6014f0b0 0x7f1e60156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.086+0000 7f1e65bd3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e6014f0b0 0x7f1e60156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55082/0 (socket says 172.21.15.1:55082) 2023-11-15T01:21:47.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.086+0000 7f1e65bd3700 1 -- 172.21.15.1:0/934396962 learned_addr learned my addr 172.21.15.1:0/934396962 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:47.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.086+0000 7f1e64bd1700 1 --2- 172.21.15.1:0/934396962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e6014ec30 0x7f1e600aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.086+0000 7f1e653d2700 1 --2- 172.21.15.1:0/934396962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e48005000 0x7f1e600af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.087+0000 7f1e65bd3700 1 -- 172.21.15.1:0/934396962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e6014ec30 msgr2=0x7f1e600aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.087+0000 7f1e65bd3700 1 --2- 172.21.15.1:0/934396962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e6014ec30 0x7f1e600aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.087+0000 7f1e65bd3700 1 -- 172.21.15.1:0/934396962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e48005000 msgr2=0x7f1e600af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.087+0000 7f1e65bd3700 1 --2- 172.21.15.1:0/934396962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e48005000 0x7f1e600af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.087+0000 7f1e65bd3700 1 -- 172.21.15.1:0/934396962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e600ab910 con 0x7f1e6014f0b0 2023-11-15T01:21:47.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.087+0000 7f1e65bd3700 1 --2- 172.21.15.1:0/934396962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e6014f0b0 0x7f1e60156c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f1e5000afd0 tx=0x7f1e50018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:47.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.087+0000 7f1e5d7fa700 1 -- 172.21.15.1:0/934396962 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5001d460 con 0x7f1e6014f0b0 2023-11-15T01:21:47.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.087+0000 7f1e5d7fa700 1 -- 172.21.15.1:0/934396962 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5001d5e0 con 0x7f1e6014f0b0 2023-11-15T01:21:47.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.087+0000 7f1e663d4700 1 -- 172.21.15.1:0/934396962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e600abbf0 con 0x7f1e6014f0b0 2023-11-15T01:21:47.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.087+0000 7f1e5d7fa700 1 -- 172.21.15.1:0/934396962 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5001d9a0 con 0x7f1e6014f0b0 2023-11-15T01:21:47.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.087+0000 7f1e663d4700 1 -- 172.21.15.1:0/934396962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e600ab0f0 con 0x7f1e6014f0b0 2023-11-15T01:21:47.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.088+0000 7f1e663d4700 1 -- 172.21.15.1:0/934396962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e600475e0 con 0x7f1e6014f0b0 2023-11-15T01:21:47.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.088+0000 7f1e5d7fa700 1 -- 172.21.15.1:0/934396962 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1e50003020 con 0x7f1e6014f0b0 2023-11-15T01:21:47.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.089+0000 7f1e5d7fa700 1 --2- 172.21.15.1:0/934396962 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e4c05f120 0x7f1e4c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.089+0000 7f1e5d7fa700 1 -- 172.21.15.1:0/934396962 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1e5007c120 con 0x7f1e6014f0b0 2023-11-15T01:21:47.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.089+0000 7f1e653d2700 1 --2- 172.21.15.1:0/934396962 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e4c05f120 0x7f1e4c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.089+0000 7f1e653d2700 1 --2- 172.21.15.1:0/934396962 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e4c05f120 0x7f1e4c0615e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f1e58000f60 tx=0x7f1e58009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:47.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.093+0000 7f1e5d7fa700 1 -- 172.21.15.1:0/934396962 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1e5004d3f0 con 0x7f1e6014f0b0 2023-11-15T01:21:47.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.266+0000 7f1e663d4700 1 -- 172.21.15.1:0/934396962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1e600ac8e0 con 0x7f1e6014f0b0 2023-11-15T01:21:47.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.267+0000 7f1e5d7fa700 1 -- 172.21.15.1:0/934396962 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1e50017070 con 0x7f1e6014f0b0 2023-11-15T01:21:47.268 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-11-15T01:21:47.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.268+0000 7f1e663d4700 1 -- 172.21.15.1:0/934396962 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e4c05f120 msgr2=0x7f1e4c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.268+0000 7f1e663d4700 1 --2- 172.21.15.1:0/934396962 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e4c05f120 0x7f1e4c0615e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f1e58000f60 tx=0x7f1e58009040).stop 2023-11-15T01:21:47.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.269+0000 7f1e663d4700 1 -- 172.21.15.1:0/934396962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e6014f0b0 msgr2=0x7f1e60156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.269+0000 7f1e663d4700 1 --2- 172.21.15.1:0/934396962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e6014f0b0 0x7f1e60156c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f1e5000afd0 tx=0x7f1e50018000).stop 2023-11-15T01:21:47.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.269+0000 7f1e663d4700 1 -- 172.21.15.1:0/934396962 shutdown_connections 2023-11-15T01:21:47.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.269+0000 7f1e663d4700 1 --2- 172.21.15.1:0/934396962 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e4c05f120 0x7f1e4c0615e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.269+0000 7f1e663d4700 1 --2- 172.21.15.1:0/934396962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e6014f0b0 0x7f1e60156c20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.269+0000 7f1e663d4700 1 --2- 172.21.15.1:0/934396962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e48005000 0x7f1e600af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.269+0000 7f1e663d4700 1 --2- 172.21.15.1:0/934396962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e6014ec30 0x7f1e600aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.269+0000 7f1e663d4700 1 -- 172.21.15.1:0/934396962 >> 172.21.15.1:0/934396962 conn(0x7f1e600947e0 msgr2=0x7f1e6014fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:47.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.269+0000 7f1e663d4700 1 -- 172.21.15.1:0/934396962 shutdown_connections 2023-11-15T01:21:47.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.269+0000 7f1e663d4700 1 -- 172.21.15.1:0/934396962 wait complete. 2023-11-15T01:21:47.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2023-11-15T01:21:47.282 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-15T01:21:47.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.400+0000 7fe5a8e3d700 1 Processor -- start 2023-11-15T01:21:47.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.400+0000 7fe5a8e3d700 1 -- start start 2023-11-15T01:21:47.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.401+0000 7fe5a8e3d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe5a4154250 0x7fe5a4154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.401+0000 7fe5a8e3d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe5a40aa700 0x7fe5a40c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.401+0000 7fe5a8e3d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a4158ff0 con 0x7fe5a40c6110 2023-11-15T01:21:47.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.401+0000 7fe5a8e3d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a4158100 con 0x7fe5a4154250 2023-11-15T01:21:47.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.401+0000 7fe5a8e3d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a41583e0 con 0x7fe5a40aa700 2023-11-15T01:21:47.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.401+0000 7fe5a259c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe5a4154250 0x7fe5a4154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.401+0000 7fe5a1d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe5a40c6110 0x7fe5a40a9ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58250/0 (socket says 172.21.15.1:58250) 2023-11-15T01:21:47.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.401+0000 7fe5a1d9b700 1 -- 172.21.15.1:0/3619261607 learned_addr learned my addr 172.21.15.1:0/3619261607 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:47.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.402+0000 7fe5a2d9d700 1 --2- 172.21.15.1:0/3619261607 >> v2:172.21.15.141:3300/0 conn(0x7fe5a40aa700 0x7fe5a40c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.402+0000 7fe5a259c700 1 -- 172.21.15.1:0/3619261607 >> v2:172.21.15.141:3300/0 conn(0x7fe5a40aa700 msgr2=0x7fe5a40c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:47.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.402+0000 7fe5a259c700 1 --2- 172.21.15.1:0/3619261607 >> v2:172.21.15.141:3300/0 conn(0x7fe5a40aa700 0x7fe5a40c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.402+0000 7fe5a259c700 1 -- 172.21.15.1:0/3619261607 >> v1:172.21.15.1:6789/0 conn(0x7fe5a40c6110 legacy=0x7fe5a40a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.402+0000 7fe5a159a700 1 -- 172.21.15.1:0/3619261607 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731699152 0 0) 0x7fe5a4158ff0 con 0x7fe5a40c6110 2023-11-15T01:21:47.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.402+0000 7fe5a259c700 1 -- 172.21.15.1:0/3619261607 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a41586c0 con 0x7fe5a4154250 2023-11-15T01:21:47.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.402+0000 7fe5a259c700 1 --2- 172.21.15.1:0/3619261607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5a4154250 0x7fe5a4154630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fe5a40cb030 tx=0x7fe59c009060).ready entity=mon.0 client_cookie=4e5b3934d4a5ff4b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:47.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.402+0000 7fe5a159a700 1 -- 172.21.15.1:0/3619261607 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00f510 con 0x7fe5a4154250 2023-11-15T01:21:47.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.402+0000 7fe5a159a700 1 -- 172.21.15.1:0/3619261607 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c00f670 con 0x7fe5a4154250 2023-11-15T01:21:47.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.402+0000 7fe5a159a700 1 -- 172.21.15.1:0/3619261607 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00f9f0 con 0x7fe5a4154250 2023-11-15T01:21:47.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.403+0000 7fe5a8e3d700 1 -- 172.21.15.1:0/3619261607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5a4154250 msgr2=0x7fe5a4154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.403+0000 7fe5a8e3d700 1 --2- 172.21.15.1:0/3619261607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5a4154250 0x7fe5a4154630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fe5a40cb030 tx=0x7fe59c009060).stop 2023-11-15T01:21:47.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.403+0000 7fe5a8e3d700 1 -- 172.21.15.1:0/3619261607 shutdown_connections 2023-11-15T01:21:47.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.403+0000 7fe5a8e3d700 1 --2- 172.21.15.1:0/3619261607 >> v2:172.21.15.141:3300/0 conn(0x7fe5a40aa700 0x7fe5a40c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.403+0000 7fe5a8e3d700 1 --2- 172.21.15.1:0/3619261607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5a4154250 0x7fe5a4154630 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.403+0000 7fe5a8e3d700 1 -- 172.21.15.1:0/3619261607 >> 172.21.15.1:0/3619261607 conn(0x7fe5a40c7b20 msgr2=0x7fe5a40c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:47.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.403+0000 7fe5a8e3d700 1 -- 172.21.15.1:0/3619261607 shutdown_connections 2023-11-15T01:21:47.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.403+0000 7fe5a8e3d700 1 -- 172.21.15.1:0/3619261607 wait complete. 2023-11-15T01:21:47.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.404+0000 7fe5a8e3d700 1 Processor -- start 2023-11-15T01:21:47.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.404+0000 7fe5a8e3d700 1 -- start start 2023-11-15T01:21:47.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a8e3d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5a40aa700 0x7fe5a414cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a8e3d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5a40c6110 0x7fe5a41653a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a8e3d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe5a4154250 0x7fe5a414c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a8e3d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40c4f90 con 0x7fe5a40aa700 2023-11-15T01:21:47.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a8e3d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4164f10 con 0x7fe5a40c6110 2023-11-15T01:21:47.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a8e3d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4155570 con 0x7fe5a4154250 2023-11-15T01:21:47.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5a40aa700 0x7fe5a414cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5a40aa700 0x7fe5a414cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55098/0 (socket says 172.21.15.1:55098) 2023-11-15T01:21:47.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a259c700 1 -- 172.21.15.1:0/2858878187 learned_addr learned my addr 172.21.15.1:0/2858878187 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:47.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a259c700 1 -- 172.21.15.1:0/2858878187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe5a4154250 msgr2=0x7fe5a414c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a259c700 1 --2- 172.21.15.1:0/2858878187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe5a4154250 0x7fe5a414c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:21:47.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a259c700 1 -- 172.21.15.1:0/2858878187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5a40c6110 msgr2=0x7fe5a41653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a1d9b700 1 --2- 172.21.15.1:0/2858878187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5a40c6110 0x7fe5a41653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a259c700 1 --2- 172.21.15.1:0/2858878187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5a40c6110 0x7fe5a41653a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a259c700 1 -- 172.21.15.1:0/2858878187 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c0092a0 con 0x7fe5a40aa700 2023-11-15T01:21:47.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a259c700 1 --2- 172.21.15.1:0/2858878187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5a40aa700 0x7fe5a414cee0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fe59c009dd0 tx=0x7fe59c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:47.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe59a7fc700 1 -- 172.21.15.1:0/2858878187 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00f7e0 con 0x7fe5a40aa700 2023-11-15T01:21:47.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe59a7fc700 1 -- 172.21.15.1:0/2858878187 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c00f940 con 0x7fe5a40aa700 2023-11-15T01:21:47.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a8e3d700 1 -- 172.21.15.1:0/2858878187 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a4155850 con 0x7fe5a40aa700 2023-11-15T01:21:47.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe59a7fc700 1 -- 172.21.15.1:0/2858878187 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c01b690 con 0x7fe5a40aa700 2023-11-15T01:21:47.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.405+0000 7fe5a8e3d700 1 -- 172.21.15.1:0/2858878187 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a4164850 con 0x7fe5a40aa700 2023-11-15T01:21:47.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.406+0000 7fe5a8e3d700 1 -- 172.21.15.1:0/2858878187 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a4155a10 con 0x7fe5a40aa700 2023-11-15T01:21:47.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.407+0000 7fe59a7fc700 1 -- 172.21.15.1:0/2858878187 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe59c01ba00 con 0x7fe5a40aa700 2023-11-15T01:21:47.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.407+0000 7fe59a7fc700 1 --2- 172.21.15.1:0/2858878187 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe58405f150 0x7fe584061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.407+0000 7fe59a7fc700 1 -- 172.21.15.1:0/2858878187 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe59c07b870 con 0x7fe5a40aa700 2023-11-15T01:21:47.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.407+0000 7fe5a1d9b700 1 --2- 172.21.15.1:0/2858878187 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe58405f150 0x7fe584061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.408+0000 7fe5a1d9b700 1 --2- 172.21.15.1:0/2858878187 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe58405f150 0x7fe584061610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fe58c007fd0 tx=0x7fe58c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:47.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.411+0000 7fe59a7fc700 1 -- 172.21.15.1:0/2858878187 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe59c04cb40 con 0x7fe5a40aa700 2023-11-15T01:21:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.583+0000 7fe5a8e3d700 1 -- 172.21.15.1:0/2858878187 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe5a41589a0 con 0x7fe5a40aa700 2023-11-15T01:21:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.584+0000 7fe59a7fc700 1 -- 172.21.15.1:0/2858878187 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe59c01bcb0 con 0x7fe5a40aa700 2023-11-15T01:21:47.584 INFO:teuthology.orchestra.run.smithi001.stdout:55834574853 2023-11-15T01:21:47.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.585+0000 7fe5a8e3d700 1 -- 172.21.15.1:0/2858878187 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe58405f150 msgr2=0x7fe584061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.585+0000 7fe5a8e3d700 1 --2- 172.21.15.1:0/2858878187 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe58405f150 0x7fe584061610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fe58c007fd0 tx=0x7fe58c009040).stop 2023-11-15T01:21:47.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.585+0000 7fe5a8e3d700 1 -- 172.21.15.1:0/2858878187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5a40aa700 msgr2=0x7fe5a414cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.585+0000 7fe5a8e3d700 1 --2- 172.21.15.1:0/2858878187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5a40aa700 0x7fe5a414cee0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fe59c009dd0 tx=0x7fe59c017000).stop 2023-11-15T01:21:47.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.586+0000 7fe5a8e3d700 1 -- 172.21.15.1:0/2858878187 shutdown_connections 2023-11-15T01:21:47.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.586+0000 7fe5a8e3d700 1 --2- 172.21.15.1:0/2858878187 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe58405f150 0x7fe584061610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.586+0000 7fe5a8e3d700 1 --2- 172.21.15.1:0/2858878187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe5a4154250 0x7fe5a414c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:21:47.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.586+0000 7fe5a8e3d700 1 --2- 172.21.15.1:0/2858878187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5a40aa700 0x7fe5a414cee0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.586+0000 7fe5a8e3d700 1 --2- 172.21.15.1:0/2858878187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5a40c6110 0x7fe5a41653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.586+0000 7fe5a8e3d700 1 -- 172.21.15.1:0/2858878187 >> 172.21.15.1:0/2858878187 conn(0x7fe5a40c7b20 msgr2=0x7fe5a414e910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:47.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.586+0000 7fe5a8e3d700 1 -- 172.21.15.1:0/2858878187 shutdown_connections 2023-11-15T01:21:47.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.586+0000 7fe5a8e3d700 1 -- 172.21.15.1:0/2858878187 wait complete. 2023-11-15T01:21:47.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.7 2023-11-15T01:21:47.598 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-15T01:21:47.599 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:21:47.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.716+0000 7f62c4352700 1 Processor -- start 2023-11-15T01:21:47.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.717+0000 7f62c4352700 1 -- start start 2023-11-15T01:21:47.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.717+0000 7f62c4352700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62bc0bdfb0 0x7f62bc0be390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.717+0000 7f62c4352700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62bc0ad5e0 con 0x7f62bc154e70 2023-11-15T01:21:47.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.717+0000 7f62c4352700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62bc0ad8c0 con 0x7f62bc0c6d10 2023-11-15T01:21:47.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.717+0000 7f62c4352700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0bccd0 con 0x7f62bc0bdfb0 2023-11-15T01:21:47.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c28ef700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f62bc154e70 0x7f62bc150d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41512/0 (socket says 172.21.15.1:41512) 2023-11-15T01:21:47.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c28ef700 1 -- 172.21.15.1:0/3793959038 learned_addr learned my addr 172.21.15.1:0/3793959038 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:47.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c20ee700 1 --2- 172.21.15.1:0/3793959038 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62bc0bdfb0 0x7f62bc0be390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c10ec700 1 -- 172.21.15.1:0/3793959038 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439077634 0 0) 0x7f62bc0ad5e0 con 0x7f62bc154e70 2023-11-15T01:21:47.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c10ec700 1 -- 172.21.15.1:0/3793959038 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62a40033f0 con 0x7f62bc154e70 2023-11-15T01:21:47.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c10ec700 1 -- 172.21.15.1:0/3793959038 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3586246782 0 0) 0x7f62a40033f0 con 0x7f62bc154e70 2023-11-15T01:21:47.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c10ec700 1 -- 172.21.15.1:0/3793959038 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62bc0bdfb0 msgr2=0x7f62bc0be390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:47.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c10ec700 1 --2- 172.21.15.1:0/3793959038 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62bc0bdfb0 0x7f62bc0be390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c10ec700 1 -- 172.21.15.1:0/3793959038 >> v1:172.21.15.141:6789/0 conn(0x7f62bc0c6d10 legacy=0x7f62bc0bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c10ec700 1 -- 172.21.15.1:0/3793959038 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc0adba0 con 0x7f62bc154e70 2023-11-15T01:21:47.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c10ec700 1 -- 172.21.15.1:0/3793959038 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f62ac0017f0 con 0x7f62bc154e70 2023-11-15T01:21:47.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c10ec700 1 -- 172.21.15.1:0/3793959038 >> v1:172.21.15.1:6789/0 conn(0x7f62bc154e70 legacy=0x7f62bc150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c10ec700 1 --2- 172.21.15.1:0/3793959038 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62a4003910 0x7f62a4003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c10ec700 1 --2- 172.21.15.1:0/3793959038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a4004690 0x7f62a4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c10ec700 1 --2- 172.21.15.1:0/3793959038 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62bc0bdfb0 0x7f62a4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c10ec700 1 -- 172.21.15.1:0/3793959038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0bccd0 con 0x7f62a4004690 2023-11-15T01:21:47.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c10ec700 1 -- 172.21.15.1:0/3793959038 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a400b910 con 0x7f62a4003910 2023-11-15T01:21:47.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c10ec700 1 -- 172.21.15.1:0/3793959038 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a400dce0 con 0x7f62bc0bdfb0 2023-11-15T01:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c18ed700 1 --2- 172.21.15.1:0/3793959038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a4004690 0x7f62a4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c20ee700 1 --2- 172.21.15.1:0/3793959038 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62a4003910 0x7f62a4003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.718+0000 7f62c28ef700 1 --2- 172.21.15.1:0/3793959038 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62bc0bdfb0 0x7f62a4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c18ed700 1 -- 172.21.15.1:0/3793959038 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62bc0bdfb0 msgr2=0x7f62a4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c18ed700 1 --2- 172.21.15.1:0/3793959038 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62bc0bdfb0 0x7f62a4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c18ed700 1 -- 172.21.15.1:0/3793959038 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62a4003910 msgr2=0x7f62a4003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c18ed700 1 --2- 172.21.15.1:0/3793959038 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62a4003910 0x7f62a4003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c18ed700 1 -- 172.21.15.1:0/3793959038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a40033f0 con 0x7f62a4004690 2023-11-15T01:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c18ed700 1 --2- 172.21.15.1:0/3793959038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a4004690 0x7f62a4004b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f62b0001700 tx=0x7f62b0007bb0).ready entity=mon.0 client_cookie=e284782343c81c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c10ec700 1 -- 172.21.15.1:0/3793959038 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0007020 con 0x7f62a4004690 2023-11-15T01:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c10ec700 1 -- 172.21.15.1:0/3793959038 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b0007180 con 0x7f62a4004690 2023-11-15T01:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c10ec700 1 -- 172.21.15.1:0/3793959038 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0007500 con 0x7f62a4004690 2023-11-15T01:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c4352700 1 -- 172.21.15.1:0/3793959038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a4004690 msgr2=0x7f62a4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c4352700 1 --2- 172.21.15.1:0/3793959038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a4004690 0x7f62a4004b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f62b0001700 tx=0x7f62b0007bb0).stop 2023-11-15T01:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c28ef700 1 -- 172.21.15.1:0/3793959038 reap_dead start 2023-11-15T01:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c4352700 1 -- 172.21.15.1:0/3793959038 shutdown_connections 2023-11-15T01:21:47.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c4352700 1 -- 172.21.15.1:0/3793959038 >> 172.21.15.1:0/3793959038 conn(0x7f62bc0c7d70 msgr2=0x7f62bc0c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:47.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c4352700 1 -- 172.21.15.1:0/3793959038 shutdown_connections 2023-11-15T01:21:47.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.719+0000 7f62c4352700 1 -- 172.21.15.1:0/3793959038 wait complete. 2023-11-15T01:21:47.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.721+0000 7f62c4352700 1 Processor -- start 2023-11-15T01:21:47.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.721+0000 7f62c4352700 1 -- start start 2023-11-15T01:21:47.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.721+0000 7f62c4352700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62a4004690 0x7f62bc168d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.721+0000 7f62c4352700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62bc0a6e60 0x7f62bc1539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.721+0000 7f62c4352700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc1681e0 0x7f62bc168640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.721+0000 7f62c4352700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0c1800 con 0x7f62bc1681e0 2023-11-15T01:21:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.721+0000 7f62c4352700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0a9ef0 con 0x7f62a4004690 2023-11-15T01:21:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.721+0000 7f62c4352700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0c1370 con 0x7f62bc0a6e60 2023-11-15T01:21:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.721+0000 7f62c28ef700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc1681e0 0x7f62bc168640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.721+0000 7f62c28ef700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc1681e0 0x7f62bc168640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37048/0 (socket says 172.21.15.1:37048) 2023-11-15T01:21:47.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.721+0000 7f62c28ef700 1 -- 172.21.15.1:0/1174413017 learned_addr learned my addr 172.21.15.1:0/1174413017 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:47.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.722+0000 7f62c20ee700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62a4004690 0x7f62bc168d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.722+0000 7f62c18ed700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62bc0a6e60 0x7f62bc1539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.722+0000 7f62c28ef700 1 -- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62bc0a6e60 msgr2=0x7f62bc1539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.722+0000 7f62c28ef700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62bc0a6e60 0x7f62bc1539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.722+0000 7f62c28ef700 1 -- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62a4004690 msgr2=0x7f62bc168d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.722+0000 7f62c28ef700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62a4004690 0x7f62bc168d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.722+0000 7f62c28ef700 1 -- 172.21.15.1:0/1174413017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc0a72e0 con 0x7f62bc1681e0 2023-11-15T01:21:47.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.722+0000 7f62c20ee700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62a4004690 0x7f62bc168d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:47.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.722+0000 7f62c18ed700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62bc0a6e60 0x7f62bc1539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.722+0000 7f62c28ef700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc1681e0 0x7f62bc168640 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f62bc155250 tx=0x7f62ac001860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.722+0000 7f62ba7fc700 1 -- 172.21.15.1:0/1174413017 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac00f970 con 0x7f62bc1681e0 2023-11-15T01:21:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.722+0000 7f62ba7fc700 1 -- 172.21.15.1:0/1174413017 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac00fad0 con 0x7f62bc1681e0 2023-11-15T01:21:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.722+0000 7f62c4352700 1 -- 172.21.15.1:0/1174413017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62bc168b30 con 0x7f62bc1681e0 2023-11-15T01:21:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.722+0000 7f62ba7fc700 1 -- 172.21.15.1:0/1174413017 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac00fe50 con 0x7f62bc1681e0 2023-11-15T01:21:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.722+0000 7f62c4352700 1 -- 172.21.15.1:0/1174413017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62bc0aa400 con 0x7f62bc1681e0 2023-11-15T01:21:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.723+0000 7f62c4352700 1 -- 172.21.15.1:0/1174413017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62bc06c7e0 con 0x7f62bc1681e0 2023-11-15T01:21:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.723+0000 7f62ba7fc700 1 -- 172.21.15.1:0/1174413017 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f62ac015620 con 0x7f62bc1681e0 2023-11-15T01:21:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.723+0000 7f62ba7fc700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f62a805f150 0x7f62a8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.724+0000 7f62ba7fc700 1 -- 172.21.15.1:0/1174413017 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f62ac079dd0 con 0x7f62bc1681e0 2023-11-15T01:21:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.724+0000 7f62c20ee700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f62a805f150 0x7f62a8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:47.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.724+0000 7f62c20ee700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f62a805f150 0x7f62a8061610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f62b4009270 tx=0x7f62b4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:47.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.728+0000 7f62ba7fc700 1 -- 172.21.15.1:0/1174413017 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f62ac04b040 con 0x7f62bc1681e0 2023-11-15T01:21:47.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.898+0000 7f62c4352700 1 -- 172.21.15.1:0/1174413017 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62bc0aa620 con 0x7f62a805f150 2023-11-15T01:21:47.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.908+0000 7f62ba7fc700 1 -- 172.21.15.1:0/1174413017 <== mgr.4103 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336341 (secure 0 0 0) 0x7f62bc0aa620 con 0x7f62a805f150 2023-11-15T01:21:47.912 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.911+0000 7f62c4352700 1 -- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f62a805f150 msgr2=0x7f62a8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.911+0000 7f62c4352700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f62a805f150 0x7f62a8061610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f62b4009270 tx=0x7f62b4008040).stop 2023-11-15T01:21:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.911+0000 7f62c4352700 1 -- 172.21.15.1:0/1174413017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc1681e0 msgr2=0x7f62bc168640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.911+0000 7f62c4352700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc1681e0 0x7f62bc168640 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f62bc155250 tx=0x7f62ac001860).stop 2023-11-15T01:21:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.911+0000 7f62c4352700 1 -- 172.21.15.1:0/1174413017 shutdown_connections 2023-11-15T01:21:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.911+0000 7f62c4352700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f62a805f150 0x7f62a8061610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.911+0000 7f62c4352700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc1681e0 0x7f62bc168640 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.911+0000 7f62c4352700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62a4004690 0x7f62bc168d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.911+0000 7f62c4352700 1 --2- 172.21.15.1:0/1174413017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62bc0a6e60 0x7f62bc1539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.911+0000 7f62c4352700 1 -- 172.21.15.1:0/1174413017 >> 172.21.15.1:0/1174413017 conn(0x7f62bc0c7d70 msgr2=0x7f62bc0be390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.911+0000 7f62c4352700 1 -- 172.21.15.1:0/1174413017 shutdown_connections 2023-11-15T01:21:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:47.911+0000 7f62c4352700 1 -- 172.21.15.1:0/1174413017 wait complete. 2023-11-15T01:21:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:21:47.923 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T01:21:47.760102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378624,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596096,"statfs":{"total":773094113280,"available":770658402304,"internally_reserved":0,"allocated":1900544,"data_stored":687340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002199"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076736+0000","last_change":"2023-11-15T01:21:37.070154+0000","last_active":"2023-11-15T01:21:37.076736+0000","last_peered":"2023-11-15T01:21:37.076736+0000","last_clean":"2023-11-15T01:21:37.076736+0000","last_became_active":"2023-11-15T01:21:37.069444+0000","last_became_peered":"2023-11-15T01:21:37.069444+0000","last_unstale":"2023-11-15T01:21:37.076736+0000","last_undegraded":"2023-11-15T01:21:37.076736+0000","last_fullsized":"2023-11-15T01:21:37.076736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.064539+0000","last_change":"2023-11-15T01:21:36.678192+0000","last_active":"2023-11-15T01:21:37.064539+0000","last_peered":"2023-11-15T01:21:37.064539+0000","last_clean":"2023-11-15T01:21:37.064539+0000","last_became_active":"2023-11-15T01:21:36.677205+0000","last_became_peered":"2023-11-15T01:21:36.677205+0000","last_unstale":"2023-11-15T01:21:37.064539+0000","last_undegraded":"2023-11-15T01:21:37.064539+0000","last_fullsized":"2023-11-15T01:21:37.064539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.068262+0000","last_change":"2023-11-15T01:21:37.064541+0000","last_active":"2023-11-15T01:21:37.068262+0000","last_peered":"2023-11-15T01:21:37.068262+0000","last_clean":"2023-11-15T01:21:37.068262+0000","last_became_active":"2023-11-15T01:21:37.064244+0000","last_became_peered":"2023-11-15T01:21:37.064244+0000","last_unstale":"2023-11-15T01:21:37.068262+0000","last_undegraded":"2023-11-15T01:21:37.068262+0000","last_fullsized":"2023-11-15T01:21:37.068262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054518+0000","last_change":"2023-11-15T01:21:36.683547+0000","last_active":"2023-11-15T01:21:37.054518+0000","last_peered":"2023-11-15T01:21:37.054518+0000","last_clean":"2023-11-15T01:21:37.054518+0000","last_became_active":"2023-11-15T01:21:36.682979+0000","last_became_peered":"2023-11-15T01:21:36.682979+0000","last_unstale":"2023-11-15T01:21:37.054518+0000","last_undegraded":"2023-11-15T01:21:37.054518+0000","last_fullsized":"2023-11-15T01:21:37.054518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073255+0000","last_change":"2023-11-15T01:21:37.067297+0000","last_active":"2023-11-15T01:21:37.073255+0000","last_peered":"2023-11-15T01:21:37.073255+0000","last_clean":"2023-11-15T01:21:37.073255+0000","last_became_active":"2023-11-15T01:21:37.066997+0000","last_became_peered":"2023-11-15T01:21:37.066997+0000","last_unstale":"2023-11-15T01:21:37.073255+0000","last_undegraded":"2023-11-15T01:21:37.073255+0000","last_fullsized":"2023-11-15T01:21:37.073255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058796+0000","last_change":"2023-11-15T01:21:36.679373+0000","last_active":"2023-11-15T01:21:37.058796+0000","last_peered":"2023-11-15T01:21:37.058796+0000","last_clean":"2023-11-15T01:21:37.058796+0000","last_became_active":"2023-11-15T01:21:36.678627+0000","last_became_peered":"2023-11-15T01:21:36.678627+0000","last_unstale":"2023-11-15T01:21:37.058796+0000","last_undegraded":"2023-11-15T01:21:37.058796+0000","last_fullsized":"2023-11-15T01:21:37.058796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076950+0000","last_change":"2023-11-15T01:21:37.074270+0000","last_active":"2023-11-15T01:21:37.076950+0000","last_peered":"2023-11-15T01:21:37.076950+0000","last_clean":"2023-11-15T01:21:37.076950+0000","last_became_active":"2023-11-15T01:21:37.073966+0000","last_became_peered":"2023-11-15T01:21:37.073966+0000","last_unstale":"2023-11-15T01:21:37.076950+0000","last_undegraded":"2023-11-15T01:21:37.076950+0000","last_fullsized":"2023-11-15T01:21:37.076950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.052916+0000","last_change":"2023-11-15T01:21:36.679676+0000","last_active":"2023-11-15T01:21:37.052916+0000","last_peered":"2023-11-15T01:21:37.052916+0000","last_clean":"2023-11-15T01:21:37.052916+0000","last_became_active":"2023-11-15T01:21:36.679444+0000","last_became_peered":"2023-11-15T01:21:36.679444+0000","last_unstale":"2023-11-15T01:21:37.052916+0000","last_undegraded":"2023-11-15T01:21:37.052916+0000","last_fullsized":"2023-11-15T01:21:37.052916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077396+0000","last_change":"2023-11-15T01:21:37.075345+0000","last_active":"2023-11-15T01:21:37.077396+0000","last_peered":"2023-11-15T01:21:37.077396+0000","last_clean":"2023-11-15T01:21:37.077396+0000","last_became_active":"2023-11-15T01:21:37.074940+0000","last_became_peered":"2023-11-15T01:21:37.074940+0000","last_unstale":"2023-11-15T01:21:37.077396+0000","last_undegraded":"2023-11-15T01:21:37.077396+0000","last_fullsized":"2023-11-15T01:21:37.077396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059141+0000","last_change":"2023-11-15T01:21:36.675726+0000","last_active":"2023-11-15T01:21:37.059141+0000","last_peered":"2023-11-15T01:21:37.059141+0000","last_clean":"2023-11-15T01:21:37.059141+0000","last_became_active":"2023-11-15T01:21:36.675370+0000","last_became_peered":"2023-11-15T01:21:36.675370+0000","last_unstale":"2023-11-15T01:21:37.059141+0000","last_undegraded":"2023-11-15T01:21:37.059141+0000","last_fullsized":"2023-11-15T01:21:37.059141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073310+0000","last_change":"2023-11-15T01:21:37.071192+0000","last_active":"2023-11-15T01:21:37.073310+0000","last_peered":"2023-11-15T01:21:37.073310+0000","last_clean":"2023-11-15T01:21:37.073310+0000","last_became_active":"2023-11-15T01:21:37.070894+0000","last_became_peered":"2023-11-15T01:21:37.070894+0000","last_unstale":"2023-11-15T01:21:37.073310+0000","last_undegraded":"2023-11-15T01:21:37.073310+0000","last_fullsized":"2023-11-15T01:21:37.073310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077678+0000","last_change":"2023-11-15T01:21:36.678243+0000","last_active":"2023-11-15T01:21:37.077678+0000","last_peered":"2023-11-15T01:21:37.077678+0000","last_clean":"2023-11-15T01:21:37.077678+0000","last_became_active":"2023-11-15T01:21:36.675596+0000","last_became_peered":"2023-11-15T01:21:36.675596+0000","last_unstale":"2023-11-15T01:21:37.077678+0000","last_undegraded":"2023-11-15T01:21:37.077678+0000","last_fullsized":"2023-11-15T01:21:37.077678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075581+0000","last_change":"2023-11-15T01:21:37.070789+0000","last_active":"2023-11-15T01:21:37.075581+0000","last_peered":"2023-11-15T01:21:37.075581+0000","last_clean":"2023-11-15T01:21:37.075581+0000","last_became_active":"2023-11-15T01:21:37.070474+0000","last_became_peered":"2023-11-15T01:21:37.070474+0000","last_unstale":"2023-11-15T01:21:37.075581+0000","last_undegraded":"2023-11-15T01:21:37.075581+0000","last_fullsized":"2023-11-15T01:21:37.075581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077420+0000","last_change":"2023-11-15T01:21:36.681355+0000","last_active":"2023-11-15T01:21:37.077420+0000","last_peered":"2023-11-15T01:21:37.077420+0000","last_clean":"2023-11-15T01:21:37.077420+0000","last_became_active":"2023-11-15T01:21:36.681062+0000","last_became_peered":"2023-11-15T01:21:36.681062+0000","last_unstale":"2023-11-15T01:21:37.077420+0000","last_undegraded":"2023-11-15T01:21:37.077420+0000","last_fullsized":"2023-11-15T01:21:37.077420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076571+0000","last_change":"2023-11-15T01:21:37.069662+0000","last_active":"2023-11-15T01:21:37.076571+0000","last_peered":"2023-11-15T01:21:37.076571+0000","last_clean":"2023-11-15T01:21:37.076571+0000","last_became_active":"2023-11-15T01:21:37.069329+0000","last_became_peered":"2023-11-15T01:21:37.069329+0000","last_unstale":"2023-11-15T01:21:37.076571+0000","last_undegraded":"2023-11-15T01:21:37.076571+0000","last_fullsized":"2023-11-15T01:21:37.076571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076355+0000","last_change":"2023-11-15T01:21:36.678012+0000","last_active":"2023-11-15T01:21:37.076355+0000","last_peered":"2023-11-15T01:21:37.076355+0000","last_clean":"2023-11-15T01:21:37.076355+0000","last_became_active":"2023-11-15T01:21:36.677738+0000","last_became_peered":"2023-11-15T01:21:36.677738+0000","last_unstale":"2023-11-15T01:21:37.076355+0000","last_undegraded":"2023-11-15T01:21:37.076355+0000","last_fullsized":"2023-11-15T01:21:37.076355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081186+0000","last_change":"2023-11-15T01:21:37.077200+0000","last_active":"2023-11-15T01:21:37.081186+0000","last_peered":"2023-11-15T01:21:37.081186+0000","last_clean":"2023-11-15T01:21:37.081186+0000","last_became_active":"2023-11-15T01:21:37.076903+0000","last_became_peered":"2023-11-15T01:21:37.076903+0000","last_unstale":"2023-11-15T01:21:37.081186+0000","last_undegraded":"2023-11-15T01:21:37.081186+0000","last_fullsized":"2023-11-15T01:21:37.081186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051933+0000","last_change":"2023-11-15T01:21:36.673362+0000","last_active":"2023-11-15T01:21:37.051933+0000","last_peered":"2023-11-15T01:21:37.051933+0000","last_clean":"2023-11-15T01:21:37.051933+0000","last_became_active":"2023-11-15T01:21:36.671321+0000","last_became_peered":"2023-11-15T01:21:36.671321+0000","last_unstale":"2023-11-15T01:21:37.051933+0000","last_undegraded":"2023-11-15T01:21:37.051933+0000","last_fullsized":"2023-11-15T01:21:37.051933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078495+0000","last_change":"2023-11-15T01:21:37.071120+0000","last_active":"2023-11-15T01:21:37.078495+0000","last_peered":"2023-11-15T01:21:37.078495+0000","last_clean":"2023-11-15T01:21:37.078495+0000","last_became_active":"2023-11-15T01:21:37.070850+0000","last_became_peered":"2023-11-15T01:21:37.070850+0000","last_unstale":"2023-11-15T01:21:37.078495+0000","last_undegraded":"2023-11-15T01:21:37.078495+0000","last_fullsized":"2023-11-15T01:21:37.078495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060633+0000","last_change":"2023-11-15T01:21:36.681424+0000","last_active":"2023-11-15T01:21:37.060633+0000","last_peered":"2023-11-15T01:21:37.060633+0000","last_clean":"2023-11-15T01:21:37.060633+0000","last_became_active":"2023-11-15T01:21:36.680976+0000","last_became_peered":"2023-11-15T01:21:36.680976+0000","last_unstale":"2023-11-15T01:21:37.060633+0000","last_undegraded":"2023-11-15T01:21:37.060633+0000","last_fullsized":"2023-11-15T01:21:37.060633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081471+0000","last_change":"2023-11-15T01:21:37.079474+0000","last_active":"2023-11-15T01:21:37.081471+0000","last_peered":"2023-11-15T01:21:37.081471+0000","last_clean":"2023-11-15T01:21:37.081471+0000","last_became_active":"2023-11-15T01:21:37.078060+0000","last_became_peered":"2023-11-15T01:21:37.078060+0000","last_unstale":"2023-11-15T01:21:37.081471+0000","last_undegraded":"2023-11-15T01:21:37.081471+0000","last_fullsized":"2023-11-15T01:21:37.081471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061716+0000","last_change":"2023-11-15T01:21:36.674722+0000","last_active":"2023-11-15T01:21:37.061716+0000","last_peered":"2023-11-15T01:21:37.061716+0000","last_clean":"2023-11-15T01:21:37.061716+0000","last_became_active":"2023-11-15T01:21:36.674350+0000","last_became_peered":"2023-11-15T01:21:36.674350+0000","last_unstale":"2023-11-15T01:21:37.061716+0000","last_undegraded":"2023-11-15T01:21:37.061716+0000","last_fullsized":"2023-11-15T01:21:37.061716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.070132+0000","last_change":"2023-11-15T01:21:37.065467+0000","last_active":"2023-11-15T01:21:37.070132+0000","last_peered":"2023-11-15T01:21:37.070132+0000","last_clean":"2023-11-15T01:21:37.070132+0000","last_became_active":"2023-11-15T01:21:37.065154+0000","last_became_peered":"2023-11-15T01:21:37.065154+0000","last_unstale":"2023-11-15T01:21:37.070132+0000","last_undegraded":"2023-11-15T01:21:37.070132+0000","last_fullsized":"2023-11-15T01:21:37.070132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075966+0000","last_change":"2023-11-15T01:21:36.679946+0000","last_active":"2023-11-15T01:21:37.075966+0000","last_peered":"2023-11-15T01:21:37.075966+0000","last_clean":"2023-11-15T01:21:37.075966+0000","last_became_active":"2023-11-15T01:21:36.679643+0000","last_became_peered":"2023-11-15T01:21:36.679643+0000","last_unstale":"2023-11-15T01:21:37.075966+0000","last_undegraded":"2023-11-15T01:21:37.075966+0000","last_fullsized":"2023-11-15T01:21:37.075966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076313+0000","last_change":"2023-11-15T01:21:37.073362+0000","last_active":"2023-11-15T01:21:37.076313+0000","last_peered":"2023-11-15T01:21:37.076313+0000","last_clean":"2023-11-15T01:21:37.076313+0000","last_became_active":"2023-11-15T01:21:37.072950+0000","last_became_peered":"2023-11-15T01:21:37.072950+0000","last_unstale":"2023-11-15T01:21:37.076313+0000","last_undegraded":"2023-11-15T01:21:37.076313+0000","last_fullsized":"2023-11-15T01:21:37.076313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076535+0000","last_change":"2023-11-15T01:21:36.679282+0000","last_active":"2023-11-15T01:21:37.076535+0000","last_peered":"2023-11-15T01:21:37.076535+0000","last_clean":"2023-11-15T01:21:37.076535+0000","last_became_active":"2023-11-15T01:21:36.676942+0000","last_became_peered":"2023-11-15T01:21:36.676942+0000","last_unstale":"2023-11-15T01:21:37.076535+0000","last_undegraded":"2023-11-15T01:21:37.076535+0000","last_fullsized":"2023-11-15T01:21:37.076535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073625+0000","last_change":"2023-11-15T01:21:37.067894+0000","last_active":"2023-11-15T01:21:37.073625+0000","last_peered":"2023-11-15T01:21:37.073625+0000","last_clean":"2023-11-15T01:21:37.073625+0000","last_became_active":"2023-11-15T01:21:37.067199+0000","last_became_peered":"2023-11-15T01:21:37.067199+0000","last_unstale":"2023-11-15T01:21:37.073625+0000","last_undegraded":"2023-11-15T01:21:37.073625+0000","last_fullsized":"2023-11-15T01:21:37.073625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.064048+0000","last_change":"2023-11-15T01:21:36.682276+0000","last_active":"2023-11-15T01:21:37.064048+0000","last_peered":"2023-11-15T01:21:37.064048+0000","last_clean":"2023-11-15T01:21:37.064048+0000","last_became_active":"2023-11-15T01:21:36.681910+0000","last_became_peered":"2023-11-15T01:21:36.681910+0000","last_unstale":"2023-11-15T01:21:37.064048+0000","last_undegraded":"2023-11-15T01:21:37.064048+0000","last_fullsized":"2023-11-15T01:21:37.064048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075905+0000","last_change":"2023-11-15T01:21:37.068177+0000","last_active":"2023-11-15T01:21:37.075905+0000","last_peered":"2023-11-15T01:21:37.075905+0000","last_clean":"2023-11-15T01:21:37.075905+0000","last_became_active":"2023-11-15T01:21:37.067708+0000","last_became_peered":"2023-11-15T01:21:37.067708+0000","last_unstale":"2023-11-15T01:21:37.075905+0000","last_undegraded":"2023-11-15T01:21:37.075905+0000","last_fullsized":"2023-11-15T01:21:37.075905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058497+0000","last_change":"2023-11-15T01:21:36.674143+0000","last_active":"2023-11-15T01:21:37.058497+0000","last_peered":"2023-11-15T01:21:37.058497+0000","last_clean":"2023-11-15T01:21:37.058497+0000","last_became_active":"2023-11-15T01:21:36.673800+0000","last_became_peered":"2023-11-15T01:21:36.673800+0000","last_unstale":"2023-11-15T01:21:37.058497+0000","last_undegraded":"2023-11-15T01:21:37.058497+0000","last_fullsized":"2023-11-15T01:21:37.058497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075706+0000","last_change":"2023-11-15T01:21:37.071297+0000","last_active":"2023-11-15T01:21:37.075706+0000","last_peered":"2023-11-15T01:21:37.075706+0000","last_clean":"2023-11-15T01:21:37.075706+0000","last_became_active":"2023-11-15T01:21:37.070987+0000","last_became_peered":"2023-11-15T01:21:37.070987+0000","last_unstale":"2023-11-15T01:21:37.075706+0000","last_undegraded":"2023-11-15T01:21:37.075706+0000","last_fullsized":"2023-11-15T01:21:37.075706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079876+0000","last_change":"2023-11-15T01:21:36.679647+0000","last_active":"2023-11-15T01:21:37.079876+0000","last_peered":"2023-11-15T01:21:37.079876+0000","last_clean":"2023-11-15T01:21:37.079876+0000","last_became_active":"2023-11-15T01:21:36.679134+0000","last_became_peered":"2023-11-15T01:21:36.679134+0000","last_unstale":"2023-11-15T01:21:37.079876+0000","last_undegraded":"2023-11-15T01:21:37.079876+0000","last_fullsized":"2023-11-15T01:21:37.079876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075523+0000","last_change":"2023-11-15T01:21:37.071036+0000","last_active":"2023-11-15T01:21:37.075523+0000","last_peered":"2023-11-15T01:21:37.075523+0000","last_clean":"2023-11-15T01:21:37.075523+0000","last_became_active":"2023-11-15T01:21:37.070766+0000","last_became_peered":"2023-11-15T01:21:37.070766+0000","last_unstale":"2023-11-15T01:21:37.075523+0000","last_undegraded":"2023-11-15T01:21:37.075523+0000","last_fullsized":"2023-11-15T01:21:37.075523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053077+0000","last_change":"2023-11-15T01:21:36.677096+0000","last_active":"2023-11-15T01:21:37.053077+0000","last_peered":"2023-11-15T01:21:37.053077+0000","last_clean":"2023-11-15T01:21:37.053077+0000","last_became_active":"2023-11-15T01:21:36.676780+0000","last_became_peered":"2023-11-15T01:21:36.676780+0000","last_unstale":"2023-11-15T01:21:37.053077+0000","last_undegraded":"2023-11-15T01:21:37.053077+0000","last_fullsized":"2023-11-15T01:21:37.053077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075723+0000","last_change":"2023-11-15T01:21:37.071911+0000","last_active":"2023-11-15T01:21:37.075723+0000","last_peered":"2023-11-15T01:21:37.075723+0000","last_clean":"2023-11-15T01:21:37.075723+0000","last_became_active":"2023-11-15T01:21:37.071572+0000","last_became_peered":"2023-11-15T01:21:37.071572+0000","last_unstale":"2023-11-15T01:21:37.075723+0000","last_undegraded":"2023-11-15T01:21:37.075723+0000","last_fullsized":"2023-11-15T01:21:37.075723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061988+0000","last_change":"2023-11-15T01:21:36.665943+0000","last_active":"2023-11-15T01:21:37.061988+0000","last_peered":"2023-11-15T01:21:37.061988+0000","last_clean":"2023-11-15T01:21:37.061988+0000","last_became_active":"2023-11-15T01:21:36.663826+0000","last_became_peered":"2023-11-15T01:21:36.663826+0000","last_unstale":"2023-11-15T01:21:37.061988+0000","last_undegraded":"2023-11-15T01:21:37.061988+0000","last_fullsized":"2023-11-15T01:21:37.061988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079611+0000","last_change":"2023-11-15T01:21:37.078906+0000","last_active":"2023-11-15T01:21:37.079611+0000","last_peered":"2023-11-15T01:21:37.079611+0000","last_clean":"2023-11-15T01:21:37.079611+0000","last_became_active":"2023-11-15T01:21:37.078557+0000","last_became_peered":"2023-11-15T01:21:37.078557+0000","last_unstale":"2023-11-15T01:21:37.079611+0000","last_undegraded":"2023-11-15T01:21:37.079611+0000","last_fullsized":"2023-11-15T01:21:37.079611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060923+0000","last_change":"2023-11-15T01:21:36.684155+0000","last_active":"2023-11-15T01:21:37.060923+0000","last_peered":"2023-11-15T01:21:37.060923+0000","last_clean":"2023-11-15T01:21:37.060923+0000","last_became_active":"2023-11-15T01:21:36.683867+0000","last_became_peered":"2023-11-15T01:21:36.683867+0000","last_unstale":"2023-11-15T01:21:37.060923+0000","last_undegraded":"2023-11-15T01:21:37.060923+0000","last_fullsized":"2023-11-15T01:21:37.060923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.055130+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:21:37.055130+0000","last_peered":"2023-11-15T01:21:37.055130+0000","last_clean":"2023-11-15T01:21:37.055130+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:21:37.055130+0000","last_undegraded":"2023-11-15T01:21:37.055130+0000","last_fullsized":"2023-11-15T01:21:37.055130+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059501+0000","last_change":"2023-11-15T01:21:36.673900+0000","last_active":"2023-11-15T01:21:37.059501+0000","last_peered":"2023-11-15T01:21:37.059501+0000","last_clean":"2023-11-15T01:21:37.059501+0000","last_became_active":"2023-11-15T01:21:36.673523+0000","last_became_peered":"2023-11-15T01:21:36.673523+0000","last_unstale":"2023-11-15T01:21:37.059501+0000","last_undegraded":"2023-11-15T01:21:37.059501+0000","last_fullsized":"2023-11-15T01:21:37.059501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.066720+0000","last_change":"2023-11-15T01:21:37.065623+0000","last_active":"2023-11-15T01:21:37.066720+0000","last_peered":"2023-11-15T01:21:37.066720+0000","last_clean":"2023-11-15T01:21:37.066720+0000","last_became_active":"2023-11-15T01:21:37.065338+0000","last_became_peered":"2023-11-15T01:21:37.065338+0000","last_unstale":"2023-11-15T01:21:37.066720+0000","last_undegraded":"2023-11-15T01:21:37.066720+0000","last_fullsized":"2023-11-15T01:21:37.066720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058545+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:21:37.058545+0000","last_peered":"2023-11-15T01:21:37.058545+0000","last_clean":"2023-11-15T01:21:37.058545+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:21:37.058545+0000","last_undegraded":"2023-11-15T01:21:37.058545+0000","last_fullsized":"2023-11-15T01:21:37.058545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.065604+0000","last_change":"2023-11-15T01:21:36.675569+0000","last_active":"2023-11-15T01:21:37.065604+0000","last_peered":"2023-11-15T01:21:37.065604+0000","last_clean":"2023-11-15T01:21:37.065604+0000","last_became_active":"2023-11-15T01:21:36.675216+0000","last_became_peered":"2023-11-15T01:21:36.675216+0000","last_unstale":"2023-11-15T01:21:37.065604+0000","last_undegraded":"2023-11-15T01:21:37.065604+0000","last_fullsized":"2023-11-15T01:21:37.065604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.063934+0000","last_change":"2023-11-15T01:21:37.056059+0000","last_active":"2023-11-15T01:21:37.063934+0000","last_peered":"2023-11-15T01:21:37.063934+0000","last_clean":"2023-11-15T01:21:37.063934+0000","last_became_active":"2023-11-15T01:21:37.055792+0000","last_became_peered":"2023-11-15T01:21:37.055792+0000","last_unstale":"2023-11-15T01:21:37.063934+0000","last_undegraded":"2023-11-15T01:21:37.063934+0000","last_fullsized":"2023-11-15T01:21:37.063934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.066956+0000","last_change":"2023-11-15T01:21:37.066235+0000","last_active":"2023-11-15T01:21:37.066956+0000","last_peered":"2023-11-15T01:21:37.066956+0000","last_clean":"2023-11-15T01:21:37.066956+0000","last_became_active":"2023-11-15T01:21:37.066039+0000","last_became_peered":"2023-11-15T01:21:37.066039+0000","last_unstale":"2023-11-15T01:21:37.066956+0000","last_undegraded":"2023-11-15T01:21:37.066956+0000","last_fullsized":"2023-11-15T01:21:37.066956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.049466+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:21:37.049466+0000","last_peered":"2023-11-15T01:21:37.049466+0000","last_clean":"2023-11-15T01:21:37.049466+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:21:37.049466+0000","last_undegraded":"2023-11-15T01:21:37.049466+0000","last_fullsized":"2023-11-15T01:21:37.049466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054621+0000","last_change":"2023-11-15T01:21:36.675336+0000","last_active":"2023-11-15T01:21:37.054621+0000","last_peered":"2023-11-15T01:21:37.054621+0000","last_clean":"2023-11-15T01:21:37.054621+0000","last_became_active":"2023-11-15T01:21:36.675018+0000","last_became_peered":"2023-11-15T01:21:36.675018+0000","last_unstale":"2023-11-15T01:21:37.054621+0000","last_undegraded":"2023-11-15T01:21:37.054621+0000","last_fullsized":"2023-11-15T01:21:37.054621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075405+0000","last_change":"2023-11-15T01:21:37.072490+0000","last_active":"2023-11-15T01:21:37.075405+0000","last_peered":"2023-11-15T01:21:37.075405+0000","last_clean":"2023-11-15T01:21:37.075405+0000","last_became_active":"2023-11-15T01:21:37.072175+0000","last_became_peered":"2023-11-15T01:21:37.072175+0000","last_unstale":"2023-11-15T01:21:37.075405+0000","last_undegraded":"2023-11-15T01:21:37.075405+0000","last_fullsized":"2023-11-15T01:21:37.075405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058381+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:21:37.058381+0000","last_peered":"2023-11-15T01:21:37.058381+0000","last_clean":"2023-11-15T01:21:37.058381+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:21:37.058381+0000","last_undegraded":"2023-11-15T01:21:37.058381+0000","last_fullsized":"2023-11-15T01:21:37.058381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059508+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:21:37.059508+0000","last_peered":"2023-11-15T01:21:37.059508+0000","last_clean":"2023-11-15T01:21:37.059508+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:21:37.059508+0000","last_undegraded":"2023-11-15T01:21:37.059508+0000","last_fullsized":"2023-11-15T01:21:37.059508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059414+0000","last_change":"2023-11-15T01:21:36.679052+0000","last_active":"2023-11-15T01:21:37.059414+0000","last_peered":"2023-11-15T01:21:37.059414+0000","last_clean":"2023-11-15T01:21:37.059414+0000","last_became_active":"2023-11-15T01:21:36.678750+0000","last_became_peered":"2023-11-15T01:21:36.678750+0000","last_unstale":"2023-11-15T01:21:37.059414+0000","last_undegraded":"2023-11-15T01:21:37.059414+0000","last_fullsized":"2023-11-15T01:21:37.059414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075965+0000","last_change":"2023-11-15T01:21:37.068467+0000","last_active":"2023-11-15T01:21:37.075965+0000","last_peered":"2023-11-15T01:21:37.075965+0000","last_clean":"2023-11-15T01:21:37.075965+0000","last_became_active":"2023-11-15T01:21:37.068195+0000","last_became_peered":"2023-11-15T01:21:37.068195+0000","last_unstale":"2023-11-15T01:21:37.075965+0000","last_undegraded":"2023-11-15T01:21:37.075965+0000","last_fullsized":"2023-11-15T01:21:37.075965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059991+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:21:37.059991+0000","last_peered":"2023-11-15T01:21:37.059991+0000","last_clean":"2023-11-15T01:21:37.059991+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:21:37.059991+0000","last_undegraded":"2023-11-15T01:21:37.059991+0000","last_fullsized":"2023-11-15T01:21:37.059991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051461+0000","last_change":"2023-11-15T01:21:36.678021+0000","last_active":"2023-11-15T01:21:37.051461+0000","last_peered":"2023-11-15T01:21:37.051461+0000","last_clean":"2023-11-15T01:21:37.051461+0000","last_became_active":"2023-11-15T01:21:36.677747+0000","last_became_peered":"2023-11-15T01:21:36.677747+0000","last_unstale":"2023-11-15T01:21:37.051461+0000","last_undegraded":"2023-11-15T01:21:37.051461+0000","last_fullsized":"2023-11-15T01:21:37.051461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.064933+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:21:37.064933+0000","last_peered":"2023-11-15T01:21:37.064933+0000","last_clean":"2023-11-15T01:21:37.064933+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:21:37.064933+0000","last_undegraded":"2023-11-15T01:21:37.064933+0000","last_fullsized":"2023-11-15T01:21:37.064933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.055252+0000","last_change":"2023-11-15T01:21:36.675293+0000","last_active":"2023-11-15T01:21:37.055252+0000","last_peered":"2023-11-15T01:21:37.055252+0000","last_clean":"2023-11-15T01:21:37.055252+0000","last_became_active":"2023-11-15T01:21:36.674972+0000","last_became_peered":"2023-11-15T01:21:36.674972+0000","last_unstale":"2023-11-15T01:21:37.055252+0000","last_undegraded":"2023-11-15T01:21:37.055252+0000","last_fullsized":"2023-11-15T01:21:37.055252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075953+0000","last_change":"2023-11-15T01:21:37.069096+0000","last_active":"2023-11-15T01:21:37.075953+0000","last_peered":"2023-11-15T01:21:37.075953+0000","last_clean":"2023-11-15T01:21:37.075953+0000","last_became_active":"2023-11-15T01:21:37.068837+0000","last_became_peered":"2023-11-15T01:21:37.068837+0000","last_unstale":"2023-11-15T01:21:37.075953+0000","last_undegraded":"2023-11-15T01:21:37.075953+0000","last_fullsized":"2023-11-15T01:21:37.075953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.080003+0000","last_change":"2023-11-15T01:21:36.677731+0000","last_active":"2023-11-15T01:21:37.080003+0000","last_peered":"2023-11-15T01:21:37.080003+0000","last_clean":"2023-11-15T01:21:37.080003+0000","last_became_active":"2023-11-15T01:21:36.677473+0000","last_became_peered":"2023-11-15T01:21:36.677473+0000","last_unstale":"2023-11-15T01:21:37.080003+0000","last_undegraded":"2023-11-15T01:21:37.080003+0000","last_fullsized":"2023-11-15T01:21:37.080003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054763+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:21:37.054763+0000","last_peered":"2023-11-15T01:21:37.054763+0000","last_clean":"2023-11-15T01:21:37.054763+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:21:37.054763+0000","last_undegraded":"2023-11-15T01:21:37.054763+0000","last_fullsized":"2023-11-15T01:21:37.054763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076969+0000","last_change":"2023-11-15T01:21:37.074453+0000","last_active":"2023-11-15T01:21:37.076969+0000","last_peered":"2023-11-15T01:21:37.076969+0000","last_clean":"2023-11-15T01:21:37.076969+0000","last_became_active":"2023-11-15T01:21:37.074163+0000","last_became_peered":"2023-11-15T01:21:37.074163+0000","last_unstale":"2023-11-15T01:21:37.076969+0000","last_undegraded":"2023-11-15T01:21:37.076969+0000","last_fullsized":"2023-11-15T01:21:37.076969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054203+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:21:37.054203+0000","last_peered":"2023-11-15T01:21:37.054203+0000","last_clean":"2023-11-15T01:21:37.054203+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:21:37.054203+0000","last_undegraded":"2023-11-15T01:21:37.054203+0000","last_fullsized":"2023-11-15T01:21:37.054203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.052816+0000","last_change":"2023-11-15T01:21:36.677412+0000","last_active":"2023-11-15T01:21:37.052816+0000","last_peered":"2023-11-15T01:21:37.052816+0000","last_clean":"2023-11-15T01:21:37.052816+0000","last_became_active":"2023-11-15T01:21:36.677133+0000","last_became_peered":"2023-11-15T01:21:36.677133+0000","last_unstale":"2023-11-15T01:21:37.052816+0000","last_undegraded":"2023-11-15T01:21:37.052816+0000","last_fullsized":"2023-11-15T01:21:37.052816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076301+0000","last_change":"2023-11-15T01:21:37.073195+0000","last_active":"2023-11-15T01:21:37.076301+0000","last_peered":"2023-11-15T01:21:37.076301+0000","last_clean":"2023-11-15T01:21:37.076301+0000","last_became_active":"2023-11-15T01:21:37.069951+0000","last_became_peered":"2023-11-15T01:21:37.069951+0000","last_unstale":"2023-11-15T01:21:37.076301+0000","last_undegraded":"2023-11-15T01:21:37.076301+0000","last_fullsized":"2023-11-15T01:21:37.076301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060157+0000","last_change":"2023-11-15T01:21:37.056072+0000","last_active":"2023-11-15T01:21:37.060157+0000","last_peered":"2023-11-15T01:21:37.060157+0000","last_clean":"2023-11-15T01:21:37.060157+0000","last_became_active":"2023-11-15T01:21:37.055787+0000","last_became_peered":"2023-11-15T01:21:37.055787+0000","last_unstale":"2023-11-15T01:21:37.060157+0000","last_undegraded":"2023-11-15T01:21:37.060157+0000","last_fullsized":"2023-11-15T01:21:37.060157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051906+0000","last_change":"2023-11-15T01:21:36.672485+0000","last_active":"2023-11-15T01:21:37.051906+0000","last_peered":"2023-11-15T01:21:37.051906+0000","last_clean":"2023-11-15T01:21:37.051906+0000","last_became_active":"2023-11-15T01:21:36.672099+0000","last_became_peered":"2023-11-15T01:21:36.672099+0000","last_unstale":"2023-11-15T01:21:37.051906+0000","last_undegraded":"2023-11-15T01:21:37.051906+0000","last_fullsized":"2023-11-15T01:21:37.051906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081012+0000","last_change":"2023-11-15T01:21:37.077263+0000","last_active":"2023-11-15T01:21:37.081012+0000","last_peered":"2023-11-15T01:21:37.081012+0000","last_clean":"2023-11-15T01:21:37.081012+0000","last_became_active":"2023-11-15T01:21:37.076981+0000","last_became_peered":"2023-11-15T01:21:37.076981+0000","last_unstale":"2023-11-15T01:21:37.081012+0000","last_undegraded":"2023-11-15T01:21:37.081012+0000","last_fullsized":"2023-11-15T01:21:37.081012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058603+0000","last_change":"2023-11-15T01:21:36.677251+0000","last_active":"2023-11-15T01:21:37.058603+0000","last_peered":"2023-11-15T01:21:37.058603+0000","last_clean":"2023-11-15T01:21:37.058603+0000","last_became_active":"2023-11-15T01:21:36.676955+0000","last_became_peered":"2023-11-15T01:21:36.676955+0000","last_unstale":"2023-11-15T01:21:37.058603+0000","last_undegraded":"2023-11-15T01:21:37.058603+0000","last_fullsized":"2023-11-15T01:21:37.058603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075958+0000","last_change":"2023-11-15T01:21:37.073688+0000","last_active":"2023-11-15T01:21:37.075958+0000","last_peered":"2023-11-15T01:21:37.075958+0000","last_clean":"2023-11-15T01:21:37.075958+0000","last_became_active":"2023-11-15T01:21:37.073409+0000","last_became_peered":"2023-11-15T01:21:37.073409+0000","last_unstale":"2023-11-15T01:21:37.075958+0000","last_undegraded":"2023-11-15T01:21:37.075958+0000","last_fullsized":"2023-11-15T01:21:37.075958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073464+0000","last_change":"2023-11-15T01:21:36.675358+0000","last_active":"2023-11-15T01:21:37.073464+0000","last_peered":"2023-11-15T01:21:37.073464+0000","last_clean":"2023-11-15T01:21:37.073464+0000","last_became_active":"2023-11-15T01:21:36.675089+0000","last_became_peered":"2023-11-15T01:21:36.675089+0000","last_unstale":"2023-11-15T01:21:37.073464+0000","last_undegraded":"2023-11-15T01:21:37.073464+0000","last_fullsized":"2023-11-15T01:21:37.073464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077044+0000","last_change":"2023-11-15T01:21:37.074975+0000","last_active":"2023-11-15T01:21:37.077044+0000","last_peered":"2023-11-15T01:21:37.077044+0000","last_clean":"2023-11-15T01:21:37.077044+0000","last_became_active":"2023-11-15T01:21:37.068659+0000","last_became_peered":"2023-11-15T01:21:37.068659+0000","last_unstale":"2023-11-15T01:21:37.077044+0000","last_undegraded":"2023-11-15T01:21:37.077044+0000","last_fullsized":"2023-11-15T01:21:37.077044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.074074+0000","last_change":"2023-11-15T01:21:36.672628+0000","last_active":"2023-11-15T01:21:37.074074+0000","last_peered":"2023-11-15T01:21:37.074074+0000","last_clean":"2023-11-15T01:21:37.074074+0000","last_became_active":"2023-11-15T01:21:36.672235+0000","last_became_peered":"2023-11-15T01:21:36.672235+0000","last_unstale":"2023-11-15T01:21:37.074074+0000","last_undegraded":"2023-11-15T01:21:37.074074+0000","last_fullsized":"2023-11-15T01:21:37.074074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078770+0000","last_change":"2023-11-15T01:21:37.075172+0000","last_active":"2023-11-15T01:21:37.078770+0000","last_peered":"2023-11-15T01:21:37.078770+0000","last_clean":"2023-11-15T01:21:37.078770+0000","last_became_active":"2023-11-15T01:21:37.074844+0000","last_became_peered":"2023-11-15T01:21:37.074844+0000","last_unstale":"2023-11-15T01:21:37.078770+0000","last_undegraded":"2023-11-15T01:21:37.078770+0000","last_fullsized":"2023-11-15T01:21:37.078770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.070348+0000","last_change":"2023-11-15T01:21:36.681248+0000","last_active":"2023-11-15T01:21:37.070348+0000","last_peered":"2023-11-15T01:21:37.070348+0000","last_clean":"2023-11-15T01:21:37.070348+0000","last_became_active":"2023-11-15T01:21:36.680875+0000","last_became_peered":"2023-11-15T01:21:36.680875+0000","last_unstale":"2023-11-15T01:21:37.070348+0000","last_undegraded":"2023-11-15T01:21:37.070348+0000","last_fullsized":"2023-11-15T01:21:37.070348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072884+0000","last_change":"2023-11-15T01:21:37.070426+0000","last_active":"2023-11-15T01:21:37.072884+0000","last_peered":"2023-11-15T01:21:37.072884+0000","last_clean":"2023-11-15T01:21:37.072884+0000","last_became_active":"2023-11-15T01:21:37.070158+0000","last_became_peered":"2023-11-15T01:21:37.070158+0000","last_unstale":"2023-11-15T01:21:37.072884+0000","last_undegraded":"2023-11-15T01:21:37.072884+0000","last_fullsized":"2023-11-15T01:21:37.072884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053859+0000","last_change":"2023-11-15T01:21:36.674583+0000","last_active":"2023-11-15T01:21:37.053859+0000","last_peered":"2023-11-15T01:21:37.053859+0000","last_clean":"2023-11-15T01:21:37.053859+0000","last_became_active":"2023-11-15T01:21:36.674002+0000","last_became_peered":"2023-11-15T01:21:36.674002+0000","last_unstale":"2023-11-15T01:21:37.053859+0000","last_undegraded":"2023-11-15T01:21:37.053859+0000","last_fullsized":"2023-11-15T01:21:37.053859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.065776+0000","last_change":"2023-11-15T01:21:37.061993+0000","last_active":"2023-11-15T01:21:37.065776+0000","last_peered":"2023-11-15T01:21:37.065776+0000","last_clean":"2023-11-15T01:21:37.065776+0000","last_became_active":"2023-11-15T01:21:37.061379+0000","last_became_peered":"2023-11-15T01:21:37.061379+0000","last_unstale":"2023-11-15T01:21:37.065776+0000","last_undegraded":"2023-11-15T01:21:37.065776+0000","last_fullsized":"2023-11-15T01:21:37.065776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.049508+0000","last_change":"2023-11-15T01:21:36.666739+0000","last_active":"2023-11-15T01:21:37.049508+0000","last_peered":"2023-11-15T01:21:37.049508+0000","last_clean":"2023-11-15T01:21:37.049508+0000","last_became_active":"2023-11-15T01:21:36.666437+0000","last_became_peered":"2023-11-15T01:21:36.666437+0000","last_unstale":"2023-11-15T01:21:37.049508+0000","last_undegraded":"2023-11-15T01:21:37.049508+0000","last_fullsized":"2023-11-15T01:21:37.049508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.069514+0000","last_change":"2023-11-15T01:21:37.066195+0000","last_active":"2023-11-15T01:21:37.069514+0000","last_peered":"2023-11-15T01:21:37.069514+0000","last_clean":"2023-11-15T01:21:37.069514+0000","last_became_active":"2023-11-15T01:21:37.065915+0000","last_became_peered":"2023-11-15T01:21:37.065915+0000","last_unstale":"2023-11-15T01:21:37.069514+0000","last_undegraded":"2023-11-15T01:21:37.069514+0000","last_fullsized":"2023-11-15T01:21:37.069514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058395+0000","last_change":"2023-11-15T01:21:36.674457+0000","last_active":"2023-11-15T01:21:37.058395+0000","last_peered":"2023-11-15T01:21:37.058395+0000","last_clean":"2023-11-15T01:21:37.058395+0000","last_became_active":"2023-11-15T01:21:36.673479+0000","last_became_peered":"2023-11-15T01:21:36.673479+0000","last_unstale":"2023-11-15T01:21:37.058395+0000","last_undegraded":"2023-11-15T01:21:37.058395+0000","last_fullsized":"2023-11-15T01:21:37.058395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077664+0000","last_change":"2023-11-15T01:21:37.076770+0000","last_active":"2023-11-15T01:21:37.077664+0000","last_peered":"2023-11-15T01:21:37.077664+0000","last_clean":"2023-11-15T01:21:37.077664+0000","last_became_active":"2023-11-15T01:21:37.076474+0000","last_became_peered":"2023-11-15T01:21:37.076474+0000","last_unstale":"2023-11-15T01:21:37.077664+0000","last_undegraded":"2023-11-15T01:21:37.077664+0000","last_fullsized":"2023-11-15T01:21:37.077664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.052293+0000","last_change":"2023-11-15T01:21:36.677057+0000","last_active":"2023-11-15T01:21:37.052293+0000","last_peered":"2023-11-15T01:21:37.052293+0000","last_clean":"2023-11-15T01:21:37.052293+0000","last_became_active":"2023-11-15T01:21:36.676765+0000","last_became_peered":"2023-11-15T01:21:36.676765+0000","last_unstale":"2023-11-15T01:21:37.052293+0000","last_undegraded":"2023-11-15T01:21:37.052293+0000","last_fullsized":"2023-11-15T01:21:37.052293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079468+0000","last_change":"2023-11-15T01:21:37.077300+0000","last_active":"2023-11-15T01:21:37.079468+0000","last_peered":"2023-11-15T01:21:37.079468+0000","last_clean":"2023-11-15T01:21:37.079468+0000","last_became_active":"2023-11-15T01:21:37.076992+0000","last_became_peered":"2023-11-15T01:21:37.076992+0000","last_unstale":"2023-11-15T01:21:37.079468+0000","last_undegraded":"2023-11-15T01:21:37.079468+0000","last_fullsized":"2023-11-15T01:21:37.079468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059811+0000","last_change":"2023-11-15T01:21:36.675721+0000","last_active":"2023-11-15T01:21:37.059811+0000","last_peered":"2023-11-15T01:21:37.059811+0000","last_clean":"2023-11-15T01:21:37.059811+0000","last_became_active":"2023-11-15T01:21:36.675435+0000","last_became_peered":"2023-11-15T01:21:36.675435+0000","last_unstale":"2023-11-15T01:21:37.059811+0000","last_undegraded":"2023-11-15T01:21:37.059811+0000","last_fullsized":"2023-11-15T01:21:37.059811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078780+0000","last_change":"2023-11-15T01:21:37.075242+0000","last_active":"2023-11-15T01:21:37.078780+0000","last_peered":"2023-11-15T01:21:37.078780+0000","last_clean":"2023-11-15T01:21:37.078780+0000","last_became_active":"2023-11-15T01:21:37.074425+0000","last_became_peered":"2023-11-15T01:21:37.074425+0000","last_unstale":"2023-11-15T01:21:37.078780+0000","last_undegraded":"2023-11-15T01:21:37.078780+0000","last_fullsized":"2023-11-15T01:21:37.078780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054580+0000","last_change":"2023-11-15T01:21:36.682853+0000","last_active":"2023-11-15T01:21:37.054580+0000","last_peered":"2023-11-15T01:21:37.054580+0000","last_clean":"2023-11-15T01:21:37.054580+0000","last_became_active":"2023-11-15T01:21:36.682482+0000","last_became_peered":"2023-11-15T01:21:36.682482+0000","last_unstale":"2023-11-15T01:21:37.054580+0000","last_undegraded":"2023-11-15T01:21:37.054580+0000","last_fullsized":"2023-11-15T01:21:37.054580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077027+0000","last_change":"2023-11-15T01:21:37.069868+0000","last_active":"2023-11-15T01:21:37.077027+0000","last_peered":"2023-11-15T01:21:37.077027+0000","last_clean":"2023-11-15T01:21:37.077027+0000","last_became_active":"2023-11-15T01:21:37.069367+0000","last_became_peered":"2023-11-15T01:21:37.069367+0000","last_unstale":"2023-11-15T01:21:37.077027+0000","last_undegraded":"2023-11-15T01:21:37.077027+0000","last_fullsized":"2023-11-15T01:21:37.077027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-15T01:21:38.055101+0000","last_change":"2023-11-15T01:21:36.676621+0000","last_active":"2023-11-15T01:21:38.055101+0000","last_peered":"2023-11-15T01:21:38.055101+0000","last_clean":"2023-11-15T01:21:38.055101+0000","last_became_active":"2023-11-15T01:21:36.676340+0000","last_became_peered":"2023-11-15T01:21:36.676340+0000","last_unstale":"2023-11-15T01:21:38.055101+0000","last_undegraded":"2023-11-15T01:21:38.055101+0000","last_fullsized":"2023-11-15T01:21:38.055101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061469+0000","last_change":"2023-11-15T01:21:37.056801+0000","last_active":"2023-11-15T01:21:37.061469+0000","last_peered":"2023-11-15T01:21:37.061469+0000","last_clean":"2023-11-15T01:21:37.061469+0000","last_became_active":"2023-11-15T01:21:37.056479+0000","last_became_peered":"2023-11-15T01:21:37.056479+0000","last_unstale":"2023-11-15T01:21:37.061469+0000","last_undegraded":"2023-11-15T01:21:37.061469+0000","last_fullsized":"2023-11-15T01:21:37.061469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061145+0000","last_change":"2023-11-15T01:21:36.677083+0000","last_active":"2023-11-15T01:21:37.061145+0000","last_peered":"2023-11-15T01:21:37.061145+0000","last_clean":"2023-11-15T01:21:37.061145+0000","last_became_active":"2023-11-15T01:21:36.675792+0000","last_became_peered":"2023-11-15T01:21:36.675792+0000","last_unstale":"2023-11-15T01:21:37.061145+0000","last_undegraded":"2023-11-15T01:21:37.061145+0000","last_fullsized":"2023-11-15T01:21:37.061145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.080375+0000","last_change":"2023-11-15T01:21:37.079437+0000","last_active":"2023-11-15T01:21:37.080375+0000","last_peered":"2023-11-15T01:21:37.080375+0000","last_clean":"2023-11-15T01:21:37.080375+0000","last_became_active":"2023-11-15T01:21:37.079183+0000","last_became_peered":"2023-11-15T01:21:37.079183+0000","last_unstale":"2023-11-15T01:21:37.080375+0000","last_undegraded":"2023-11-15T01:21:37.080375+0000","last_fullsized":"2023-11-15T01:21:37.080375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.057734+0000","last_change":"2023-11-15T01:21:36.674125+0000","last_active":"2023-11-15T01:21:37.057734+0000","last_peered":"2023-11-15T01:21:37.057734+0000","last_clean":"2023-11-15T01:21:37.057734+0000","last_became_active":"2023-11-15T01:21:36.673791+0000","last_became_peered":"2023-11-15T01:21:36.673791+0000","last_unstale":"2023-11-15T01:21:37.057734+0000","last_undegraded":"2023-11-15T01:21:37.057734+0000","last_fullsized":"2023-11-15T01:21:37.057734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075073+0000","last_change":"2023-11-15T01:21:37.069603+0000","last_active":"2023-11-15T01:21:37.075073+0000","last_peered":"2023-11-15T01:21:37.075073+0000","last_clean":"2023-11-15T01:21:37.075073+0000","last_became_active":"2023-11-15T01:21:37.069301+0000","last_became_peered":"2023-11-15T01:21:37.069301+0000","last_unstale":"2023-11-15T01:21:37.075073+0000","last_undegraded":"2023-11-15T01:21:37.075073+0000","last_fullsized":"2023-11-15T01:21:37.075073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060017+0000","last_change":"2023-11-15T01:21:36.676838+0000","last_active":"2023-11-15T01:21:37.060017+0000","last_peered":"2023-11-15T01:21:37.060017+0000","last_clean":"2023-11-15T01:21:37.060017+0000","last_became_active":"2023-11-15T01:21:36.676039+0000","last_became_peered":"2023-11-15T01:21:36.676039+0000","last_unstale":"2023-11-15T01:21:37.060017+0000","last_undegraded":"2023-11-15T01:21:37.060017+0000","last_fullsized":"2023-11-15T01:21:37.060017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060317+0000","last_change":"2023-11-15T01:21:37.056702+0000","last_active":"2023-11-15T01:21:37.060317+0000","last_peered":"2023-11-15T01:21:37.060317+0000","last_clean":"2023-11-15T01:21:37.060317+0000","last_became_active":"2023-11-15T01:21:37.056436+0000","last_became_peered":"2023-11-15T01:21:37.056436+0000","last_unstale":"2023-11-15T01:21:37.060317+0000","last_undegraded":"2023-11-15T01:21:37.060317+0000","last_fullsized":"2023-11-15T01:21:37.060317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058643+0000","last_change":"2023-11-15T01:21:36.678350+0000","last_active":"2023-11-15T01:21:37.058643+0000","last_peered":"2023-11-15T01:21:37.058643+0000","last_clean":"2023-11-15T01:21:37.058643+0000","last_became_active":"2023-11-15T01:21:36.678106+0000","last_became_peered":"2023-11-15T01:21:36.678106+0000","last_unstale":"2023-11-15T01:21:37.058643+0000","last_undegraded":"2023-11-15T01:21:37.058643+0000","last_fullsized":"2023-11-15T01:21:37.058643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075725+0000","last_change":"2023-11-15T01:21:37.071814+0000","last_active":"2023-11-15T01:21:37.075725+0000","last_peered":"2023-11-15T01:21:37.075725+0000","last_clean":"2023-11-15T01:21:37.075725+0000","last_became_active":"2023-11-15T01:21:37.071482+0000","last_became_peered":"2023-11-15T01:21:37.071482+0000","last_unstale":"2023-11-15T01:21:37.075725+0000","last_undegraded":"2023-11-15T01:21:37.075725+0000","last_fullsized":"2023-11-15T01:21:37.075725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076465+0000","last_change":"2023-11-15T01:21:36.680865+0000","last_active":"2023-11-15T01:21:37.076465+0000","last_peered":"2023-11-15T01:21:37.076465+0000","last_clean":"2023-11-15T01:21:37.076465+0000","last_became_active":"2023-11-15T01:21:36.680498+0000","last_became_peered":"2023-11-15T01:21:36.680498+0000","last_unstale":"2023-11-15T01:21:37.076465+0000","last_undegraded":"2023-11-15T01:21:37.076465+0000","last_fullsized":"2023-11-15T01:21:37.076465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081144+0000","last_change":"2023-11-15T01:21:37.076900+0000","last_active":"2023-11-15T01:21:37.081144+0000","last_peered":"2023-11-15T01:21:37.081144+0000","last_clean":"2023-11-15T01:21:37.081144+0000","last_became_active":"2023-11-15T01:21:37.076617+0000","last_became_peered":"2023-11-15T01:21:37.076617+0000","last_unstale":"2023-11-15T01:21:37.081144+0000","last_undegraded":"2023-11-15T01:21:37.081144+0000","last_fullsized":"2023-11-15T01:21:37.081144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053970+0000","last_change":"2023-11-15T01:21:36.677040+0000","last_active":"2023-11-15T01:21:37.053970+0000","last_peered":"2023-11-15T01:21:37.053970+0000","last_clean":"2023-11-15T01:21:37.053970+0000","last_became_active":"2023-11-15T01:21:36.676736+0000","last_became_peered":"2023-11-15T01:21:36.676736+0000","last_unstale":"2023-11-15T01:21:37.053970+0000","last_undegraded":"2023-11-15T01:21:37.053970+0000","last_fullsized":"2023-11-15T01:21:37.053970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075883+0000","last_change":"2023-11-15T01:21:37.068055+0000","last_active":"2023-11-15T01:21:37.075883+0000","last_peered":"2023-11-15T01:21:37.075883+0000","last_clean":"2023-11-15T01:21:37.075883+0000","last_became_active":"2023-11-15T01:21:37.067786+0000","last_became_peered":"2023-11-15T01:21:37.067786+0000","last_unstale":"2023-11-15T01:21:37.075883+0000","last_undegraded":"2023-11-15T01:21:37.075883+0000","last_fullsized":"2023-11-15T01:21:37.075883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076413+0000","last_change":"2023-11-15T01:21:36.675927+0000","last_active":"2023-11-15T01:21:37.076413+0000","last_peered":"2023-11-15T01:21:37.076413+0000","last_clean":"2023-11-15T01:21:37.076413+0000","last_became_active":"2023-11-15T01:21:36.675286+0000","last_became_peered":"2023-11-15T01:21:36.675286+0000","last_unstale":"2023-11-15T01:21:37.076413+0000","last_undegraded":"2023-11-15T01:21:37.076413+0000","last_fullsized":"2023-11-15T01:21:37.076413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077009+0000","last_change":"2023-11-15T01:21:37.069678+0000","last_active":"2023-11-15T01:21:37.077009+0000","last_peered":"2023-11-15T01:21:37.077009+0000","last_clean":"2023-11-15T01:21:37.077009+0000","last_became_active":"2023-11-15T01:21:37.069017+0000","last_became_peered":"2023-11-15T01:21:37.069017+0000","last_unstale":"2023-11-15T01:21:37.077009+0000","last_undegraded":"2023-11-15T01:21:37.077009+0000","last_fullsized":"2023-11-15T01:21:37.077009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.050814+0000","last_change":"2023-11-15T01:21:36.672474+0000","last_active":"2023-11-15T01:21:37.050814+0000","last_peered":"2023-11-15T01:21:37.050814+0000","last_clean":"2023-11-15T01:21:37.050814+0000","last_became_active":"2023-11-15T01:21:36.672186+0000","last_became_peered":"2023-11-15T01:21:36.672186+0000","last_unstale":"2023-11-15T01:21:37.050814+0000","last_undegraded":"2023-11-15T01:21:37.050814+0000","last_fullsized":"2023-11-15T01:21:37.050814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078455+0000","last_change":"2023-11-15T01:21:37.074607+0000","last_active":"2023-11-15T01:21:37.078455+0000","last_peered":"2023-11-15T01:21:37.078455+0000","last_clean":"2023-11-15T01:21:37.078455+0000","last_became_active":"2023-11-15T01:21:37.074310+0000","last_became_peered":"2023-11-15T01:21:37.074310+0000","last_unstale":"2023-11-15T01:21:37.078455+0000","last_undegraded":"2023-11-15T01:21:37.078455+0000","last_fullsized":"2023-11-15T01:21:37.078455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060400+0000","last_change":"2023-11-15T01:21:36.677133+0000","last_active":"2023-11-15T01:21:37.060400+0000","last_peered":"2023-11-15T01:21:37.060400+0000","last_clean":"2023-11-15T01:21:37.060400+0000","last_became_active":"2023-11-15T01:21:36.676843+0000","last_became_peered":"2023-11-15T01:21:36.676843+0000","last_unstale":"2023-11-15T01:21:37.060400+0000","last_undegraded":"2023-11-15T01:21:37.060400+0000","last_fullsized":"2023-11-15T01:21:37.060400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079526+0000","last_change":"2023-11-15T01:21:37.075385+0000","last_active":"2023-11-15T01:21:37.079526+0000","last_peered":"2023-11-15T01:21:37.079526+0000","last_clean":"2023-11-15T01:21:37.079526+0000","last_became_active":"2023-11-15T01:21:37.075019+0000","last_became_peered":"2023-11-15T01:21:37.075019+0000","last_unstale":"2023-11-15T01:21:37.079526+0000","last_undegraded":"2023-11-15T01:21:37.079526+0000","last_fullsized":"2023-11-15T01:21:37.079526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.067378+0000","last_change":"2023-11-15T01:21:36.674279+0000","last_active":"2023-11-15T01:21:37.067378+0000","last_peered":"2023-11-15T01:21:37.067378+0000","last_clean":"2023-11-15T01:21:37.067378+0000","last_became_active":"2023-11-15T01:21:36.673988+0000","last_became_peered":"2023-11-15T01:21:36.673988+0000","last_unstale":"2023-11-15T01:21:37.067378+0000","last_undegraded":"2023-11-15T01:21:37.067378+0000","last_fullsized":"2023-11-15T01:21:37.067378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.069329+0000","last_change":"2023-11-15T01:21:37.065238+0000","last_active":"2023-11-15T01:21:37.069329+0000","last_peered":"2023-11-15T01:21:37.069329+0000","last_clean":"2023-11-15T01:21:37.069329+0000","last_became_active":"2023-11-15T01:21:37.064939+0000","last_became_peered":"2023-11-15T01:21:37.064939+0000","last_unstale":"2023-11-15T01:21:37.069329+0000","last_undegraded":"2023-11-15T01:21:37.069329+0000","last_fullsized":"2023-11-15T01:21:37.069329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054633+0000","last_change":"2023-11-15T01:21:36.683715+0000","last_active":"2023-11-15T01:21:37.054633+0000","last_peered":"2023-11-15T01:21:37.054633+0000","last_clean":"2023-11-15T01:21:37.054633+0000","last_became_active":"2023-11-15T01:21:36.683268+0000","last_became_peered":"2023-11-15T01:21:36.683268+0000","last_unstale":"2023-11-15T01:21:37.054633+0000","last_undegraded":"2023-11-15T01:21:37.054633+0000","last_fullsized":"2023-11-15T01:21:37.054633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075490+0000","last_change":"2023-11-15T01:21:37.070543+0000","last_active":"2023-11-15T01:21:37.075490+0000","last_peered":"2023-11-15T01:21:37.075490+0000","last_clean":"2023-11-15T01:21:37.075490+0000","last_became_active":"2023-11-15T01:21:37.069750+0000","last_became_peered":"2023-11-15T01:21:37.069750+0000","last_unstale":"2023-11-15T01:21:37.075490+0000","last_undegraded":"2023-11-15T01:21:37.075490+0000","last_fullsized":"2023-11-15T01:21:37.075490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051998+0000","last_change":"2023-11-15T01:21:36.677974+0000","last_active":"2023-11-15T01:21:37.051998+0000","last_peered":"2023-11-15T01:21:37.051998+0000","last_clean":"2023-11-15T01:21:37.051998+0000","last_became_active":"2023-11-15T01:21:36.677594+0000","last_became_peered":"2023-11-15T01:21:36.677594+0000","last_unstale":"2023-11-15T01:21:37.051998+0000","last_undegraded":"2023-11-15T01:21:37.051998+0000","last_fullsized":"2023-11-15T01:21:37.051998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072732+0000","last_change":"2023-11-15T01:21:37.070356+0000","last_active":"2023-11-15T01:21:37.072732+0000","last_peered":"2023-11-15T01:21:37.072732+0000","last_clean":"2023-11-15T01:21:37.072732+0000","last_became_active":"2023-11-15T01:21:37.070072+0000","last_became_peered":"2023-11-15T01:21:37.070072+0000","last_unstale":"2023-11-15T01:21:37.072732+0000","last_undegraded":"2023-11-15T01:21:37.072732+0000","last_fullsized":"2023-11-15T01:21:37.072732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076470+0000","last_change":"2023-11-15T01:21:36.671536+0000","last_active":"2023-11-15T01:21:37.076470+0000","last_peered":"2023-11-15T01:21:37.076470+0000","last_clean":"2023-11-15T01:21:37.076470+0000","last_became_active":"2023-11-15T01:21:36.671247+0000","last_became_peered":"2023-11-15T01:21:36.671247+0000","last_unstale":"2023-11-15T01:21:37.076470+0000","last_undegraded":"2023-11-15T01:21:37.076470+0000","last_fullsized":"2023-11-15T01:21:37.076470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072659+0000","last_change":"2023-11-15T01:21:37.069675+0000","last_active":"2023-11-15T01:21:37.072659+0000","last_peered":"2023-11-15T01:21:37.072659+0000","last_clean":"2023-11-15T01:21:37.072659+0000","last_became_active":"2023-11-15T01:21:37.069397+0000","last_became_peered":"2023-11-15T01:21:37.069397+0000","last_unstale":"2023-11-15T01:21:37.072659+0000","last_undegraded":"2023-11-15T01:21:37.072659+0000","last_fullsized":"2023-11-15T01:21:37.072659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081458+0000","last_change":"2023-11-15T01:21:36.673107+0000","last_active":"2023-11-15T01:21:37.081458+0000","last_peered":"2023-11-15T01:21:37.081458+0000","last_clean":"2023-11-15T01:21:37.081458+0000","last_became_active":"2023-11-15T01:21:36.672803+0000","last_became_peered":"2023-11-15T01:21:36.672803+0000","last_unstale":"2023-11-15T01:21:37.081458+0000","last_undegraded":"2023-11-15T01:21:37.081458+0000","last_fullsized":"2023-11-15T01:21:37.081458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.069571+0000","last_change":"2023-11-15T01:21:37.066878+0000","last_active":"2023-11-15T01:21:37.069571+0000","last_peered":"2023-11-15T01:21:37.069571+0000","last_clean":"2023-11-15T01:21:37.069571+0000","last_became_active":"2023-11-15T01:21:37.066577+0000","last_became_peered":"2023-11-15T01:21:37.066577+0000","last_unstale":"2023-11-15T01:21:37.069571+0000","last_undegraded":"2023-11-15T01:21:37.069571+0000","last_fullsized":"2023-11-15T01:21:37.069571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054855+0000","last_change":"2023-11-15T01:21:36.681159+0000","last_active":"2023-11-15T01:21:37.054855+0000","last_peered":"2023-11-15T01:21:37.054855+0000","last_clean":"2023-11-15T01:21:37.054855+0000","last_became_active":"2023-11-15T01:21:36.680906+0000","last_became_peered":"2023-11-15T01:21:36.680906+0000","last_unstale":"2023-11-15T01:21:37.054855+0000","last_undegraded":"2023-11-15T01:21:37.054855+0000","last_fullsized":"2023-11-15T01:21:37.054855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078486+0000","last_change":"2023-11-15T01:21:37.074210+0000","last_active":"2023-11-15T01:21:37.078486+0000","last_peered":"2023-11-15T01:21:37.078486+0000","last_clean":"2023-11-15T01:21:37.078486+0000","last_became_active":"2023-11-15T01:21:37.073943+0000","last_became_peered":"2023-11-15T01:21:37.073943+0000","last_unstale":"2023-11-15T01:21:37.078486+0000","last_undegraded":"2023-11-15T01:21:37.078486+0000","last_fullsized":"2023-11-15T01:21:37.078486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053463+0000","last_change":"2023-11-15T01:21:36.679911+0000","last_active":"2023-11-15T01:21:37.053463+0000","last_peered":"2023-11-15T01:21:37.053463+0000","last_clean":"2023-11-15T01:21:37.053463+0000","last_became_active":"2023-11-15T01:21:36.679272+0000","last_became_peered":"2023-11-15T01:21:36.679272+0000","last_unstale":"2023-11-15T01:21:37.053463+0000","last_undegraded":"2023-11-15T01:21:37.053463+0000","last_fullsized":"2023-11-15T01:21:37.053463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073109+0000","last_change":"2023-11-15T01:21:37.068769+0000","last_active":"2023-11-15T01:21:37.073109+0000","last_peered":"2023-11-15T01:21:37.073109+0000","last_clean":"2023-11-15T01:21:37.073109+0000","last_became_active":"2023-11-15T01:21:37.068495+0000","last_became_peered":"2023-11-15T01:21:37.068495+0000","last_unstale":"2023-11-15T01:21:37.073109+0000","last_undegraded":"2023-11-15T01:21:37.073109+0000","last_fullsized":"2023-11-15T01:21:37.073109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060975+0000","last_change":"2023-11-15T01:21:36.683620+0000","last_active":"2023-11-15T01:21:37.060975+0000","last_peered":"2023-11-15T01:21:37.060975+0000","last_clean":"2023-11-15T01:21:37.060975+0000","last_became_active":"2023-11-15T01:21:36.683315+0000","last_became_peered":"2023-11-15T01:21:36.683315+0000","last_unstale":"2023-11-15T01:21:37.060975+0000","last_undegraded":"2023-11-15T01:21:37.060975+0000","last_fullsized":"2023-11-15T01:21:37.060975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079966+0000","last_change":"2023-11-15T01:21:37.078896+0000","last_active":"2023-11-15T01:21:37.079966+0000","last_peered":"2023-11-15T01:21:37.079966+0000","last_clean":"2023-11-15T01:21:37.079966+0000","last_became_active":"2023-11-15T01:21:37.078569+0000","last_became_peered":"2023-11-15T01:21:37.078569+0000","last_unstale":"2023-11-15T01:21:37.079966+0000","last_undegraded":"2023-11-15T01:21:37.079966+0000","last_fullsized":"2023-11-15T01:21:37.079966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061034+0000","last_change":"2023-11-15T01:21:36.670706+0000","last_active":"2023-11-15T01:21:37.061034+0000","last_peered":"2023-11-15T01:21:37.061034+0000","last_clean":"2023-11-15T01:21:37.061034+0000","last_became_active":"2023-11-15T01:21:36.670059+0000","last_became_peered":"2023-11-15T01:21:36.670059+0000","last_unstale":"2023-11-15T01:21:37.061034+0000","last_undegraded":"2023-11-15T01:21:37.061034+0000","last_fullsized":"2023-11-15T01:21:37.061034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.071946+0000","last_change":"2023-11-15T01:21:37.067713+0000","last_active":"2023-11-15T01:21:37.071946+0000","last_peered":"2023-11-15T01:21:37.071946+0000","last_clean":"2023-11-15T01:21:37.071946+0000","last_became_active":"2023-11-15T01:21:37.067395+0000","last_became_peered":"2023-11-15T01:21:37.067395+0000","last_unstale":"2023-11-15T01:21:37.071946+0000","last_undegraded":"2023-11-15T01:21:37.071946+0000","last_fullsized":"2023-11-15T01:21:37.071946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060748+0000","last_change":"2023-11-15T01:21:36.682781+0000","last_active":"2023-11-15T01:21:37.060748+0000","last_peered":"2023-11-15T01:21:37.060748+0000","last_clean":"2023-11-15T01:21:37.060748+0000","last_became_active":"2023-11-15T01:21:36.682480+0000","last_became_peered":"2023-11-15T01:21:36.682480+0000","last_unstale":"2023-11-15T01:21:37.060748+0000","last_undegraded":"2023-11-15T01:21:37.060748+0000","last_fullsized":"2023-11-15T01:21:37.060748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075509+0000","last_change":"2023-11-15T01:21:37.070705+0000","last_active":"2023-11-15T01:21:37.075509+0000","last_peered":"2023-11-15T01:21:37.075509+0000","last_clean":"2023-11-15T01:21:37.075509+0000","last_became_active":"2023-11-15T01:21:37.070269+0000","last_became_peered":"2023-11-15T01:21:37.070269+0000","last_unstale":"2023-11-15T01:21:37.075509+0000","last_undegraded":"2023-11-15T01:21:37.075509+0000","last_fullsized":"2023-11-15T01:21:37.075509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.066310+0000","last_change":"2023-11-15T01:21:36.681917+0000","last_active":"2023-11-15T01:21:37.066310+0000","last_peered":"2023-11-15T01:21:37.066310+0000","last_clean":"2023-11-15T01:21:37.066310+0000","last_became_active":"2023-11-15T01:21:36.681664+0000","last_became_peered":"2023-11-15T01:21:36.681664+0000","last_unstale":"2023-11-15T01:21:37.066310+0000","last_undegraded":"2023-11-15T01:21:37.066310+0000","last_fullsized":"2023-11-15T01:21:37.066310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061299+0000","last_change":"2023-11-15T01:21:37.056524+0000","last_active":"2023-11-15T01:21:37.061299+0000","last_peered":"2023-11-15T01:21:37.061299+0000","last_clean":"2023-11-15T01:21:37.061299+0000","last_became_active":"2023-11-15T01:21:37.056115+0000","last_became_peered":"2023-11-15T01:21:37.056115+0000","last_unstale":"2023-11-15T01:21:37.061299+0000","last_undegraded":"2023-11-15T01:21:37.061299+0000","last_fullsized":"2023-11-15T01:21:37.061299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076222+0000","last_change":"2023-11-15T01:21:36.675434+0000","last_active":"2023-11-15T01:21:37.076222+0000","last_peered":"2023-11-15T01:21:37.076222+0000","last_clean":"2023-11-15T01:21:37.076222+0000","last_became_active":"2023-11-15T01:21:36.675152+0000","last_became_peered":"2023-11-15T01:21:36.675152+0000","last_unstale":"2023-11-15T01:21:37.076222+0000","last_undegraded":"2023-11-15T01:21:37.076222+0000","last_fullsized":"2023-11-15T01:21:37.076222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.080142+0000","last_change":"2023-11-15T01:21:37.077249+0000","last_active":"2023-11-15T01:21:37.080142+0000","last_peered":"2023-11-15T01:21:37.080142+0000","last_clean":"2023-11-15T01:21:37.080142+0000","last_became_active":"2023-11-15T01:21:37.077009+0000","last_became_peered":"2023-11-15T01:21:37.077009+0000","last_unstale":"2023-11-15T01:21:37.080142+0000","last_undegraded":"2023-11-15T01:21:37.080142+0000","last_fullsized":"2023-11-15T01:21:37.080142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072218+0000","last_change":"2023-11-15T01:21:36.675491+0000","last_active":"2023-11-15T01:21:37.072218+0000","last_peered":"2023-11-15T01:21:37.072218+0000","last_clean":"2023-11-15T01:21:37.072218+0000","last_became_active":"2023-11-15T01:21:36.673535+0000","last_became_peered":"2023-11-15T01:21:36.673535+0000","last_unstale":"2023-11-15T01:21:37.072218+0000","last_undegraded":"2023-11-15T01:21:37.072218+0000","last_fullsized":"2023-11-15T01:21:37.072218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075938+0000","last_change":"2023-11-15T01:21:37.072360+0000","last_active":"2023-11-15T01:21:37.075938+0000","last_peered":"2023-11-15T01:21:37.075938+0000","last_clean":"2023-11-15T01:21:37.075938+0000","last_became_active":"2023-11-15T01:21:37.070013+0000","last_became_peered":"2023-11-15T01:21:37.070013+0000","last_unstale":"2023-11-15T01:21:37.075938+0000","last_undegraded":"2023-11-15T01:21:37.075938+0000","last_fullsized":"2023-11-15T01:21:37.075938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051462+0000","last_change":"2023-11-15T01:21:36.674145+0000","last_active":"2023-11-15T01:21:37.051462+0000","last_peered":"2023-11-15T01:21:37.051462+0000","last_clean":"2023-11-15T01:21:37.051462+0000","last_became_active":"2023-11-15T01:21:36.673862+0000","last_became_peered":"2023-11-15T01:21:36.673862+0000","last_unstale":"2023-11-15T01:21:37.051462+0000","last_undegraded":"2023-11-15T01:21:37.051462+0000","last_fullsized":"2023-11-15T01:21:37.051462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078508+0000","last_change":"2023-11-15T01:21:37.074359+0000","last_active":"2023-11-15T01:21:37.078508+0000","last_peered":"2023-11-15T01:21:37.078508+0000","last_clean":"2023-11-15T01:21:37.078508+0000","last_became_active":"2023-11-15T01:21:37.073936+0000","last_became_peered":"2023-11-15T01:21:37.073936+0000","last_unstale":"2023-11-15T01:21:37.078508+0000","last_undegraded":"2023-11-15T01:21:37.078508+0000","last_fullsized":"2023-11-15T01:21:37.078508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.055113+0000","last_change":"2023-11-15T01:21:36.681422+0000","last_active":"2023-11-15T01:21:37.055113+0000","last_peered":"2023-11-15T01:21:37.055113+0000","last_clean":"2023-11-15T01:21:37.055113+0000","last_became_active":"2023-11-15T01:21:36.680717+0000","last_became_peered":"2023-11-15T01:21:36.680717+0000","last_unstale":"2023-11-15T01:21:37.055113+0000","last_undegraded":"2023-11-15T01:21:37.055113+0000","last_fullsized":"2023-11-15T01:21:37.055113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073014+0000","last_change":"2023-11-15T01:21:37.071820+0000","last_active":"2023-11-15T01:21:37.073014+0000","last_peered":"2023-11-15T01:21:37.073014+0000","last_clean":"2023-11-15T01:21:37.073014+0000","last_became_active":"2023-11-15T01:21:37.071521+0000","last_became_peered":"2023-11-15T01:21:37.071521+0000","last_unstale":"2023-11-15T01:21:37.073014+0000","last_undegraded":"2023-11-15T01:21:37.073014+0000","last_fullsized":"2023-11-15T01:21:37.073014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076301+0000","last_change":"2023-11-15T01:21:36.676437+0000","last_active":"2023-11-15T01:21:37.076301+0000","last_peered":"2023-11-15T01:21:37.076301+0000","last_clean":"2023-11-15T01:21:37.076301+0000","last_became_active":"2023-11-15T01:21:36.676128+0000","last_became_peered":"2023-11-15T01:21:36.676128+0000","last_unstale":"2023-11-15T01:21:37.076301+0000","last_undegraded":"2023-11-15T01:21:37.076301+0000","last_fullsized":"2023-11-15T01:21:37.076301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297348,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074492,"statfs":{"total":96636764160,"available":96332279808,"internally_reserved":0,"allocated":258048,"data_stored":86755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297340,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074500,"statfs":{"total":96636764160,"available":96332288000,"internally_reserved":0,"allocated":249856,"data_stored":86933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:21:47.930 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:21:48.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.080+0000 7ff663afa700 1 Processor -- start 2023-11-15T01:21:48.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.081+0000 7ff663afa700 1 -- start start 2023-11-15T01:21:48.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.081+0000 7ff663afa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff65c0bd130 0x7ff65c0c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.081+0000 7ff663afa700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65c06a6b0 con 0x7ff65c0bccd0 2023-11-15T01:21:48.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.081+0000 7ff663afa700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65c0c3360 con 0x7ff65c154680 2023-11-15T01:21:48.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.081+0000 7ff663afa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0c2750 con 0x7ff65c0bd130 2023-11-15T01:21:48.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff661095700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff65c0bccd0 0x7ff65c0c60b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41524/0 (socket says 172.21.15.1:41524) 2023-11-15T01:21:48.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff661095700 1 -- 172.21.15.1:0/3708874651 learned_addr learned my addr 172.21.15.1:0/3708874651 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff662097700 1 --2- 172.21.15.1:0/3708874651 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff65c0bd130 0x7ff65c0c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff660894700 1 -- 172.21.15.1:0/3708874651 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192742834 0 0) 0x7ff65c06a6b0 con 0x7ff65c0bccd0 2023-11-15T01:21:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff660894700 1 -- 172.21.15.1:0/3708874651 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6440033f0 con 0x7ff65c0bccd0 2023-11-15T01:21:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff660894700 1 -- 172.21.15.1:0/3708874651 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3569584876 0 0) 0x7ff6440033f0 con 0x7ff65c0bccd0 2023-11-15T01:21:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff660894700 1 -- 172.21.15.1:0/3708874651 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff65c0bd130 msgr2=0x7ff65c0c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff660894700 1 --2- 172.21.15.1:0/3708874651 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff65c0bd130 0x7ff65c0c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff660894700 1 -- 172.21.15.1:0/3708874651 >> v1:172.21.15.141:6789/0 conn(0x7ff65c154680 legacy=0x7ff65c069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff660894700 1 -- 172.21.15.1:0/3708874651 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c0c2a30 con 0x7ff65c0bccd0 2023-11-15T01:21:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff660894700 1 -- 172.21.15.1:0/3708874651 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7ff650001470 con 0x7ff65c0bccd0 2023-11-15T01:21:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff660894700 1 -- 172.21.15.1:0/3708874651 >> v1:172.21.15.1:6789/0 conn(0x7ff65c0bccd0 legacy=0x7ff65c0c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff660894700 1 --2- 172.21.15.1:0/3708874651 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff65c0bd130 0x7ff644003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff660894700 1 --2- 172.21.15.1:0/3708874651 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff644003e00 0x7ff644004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff660894700 1 --2- 172.21.15.1:0/3708874651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff644004b80 0x7ff644005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff660894700 1 -- 172.21.15.1:0/3708874651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0c2750 con 0x7ff644004b80 2023-11-15T01:21:48.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff660894700 1 -- 172.21.15.1:0/3708874651 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64400b8e0 con 0x7ff644003e00 2023-11-15T01:21:48.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff660894700 1 -- 172.21.15.1:0/3708874651 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64400baa0 con 0x7ff65c0bd130 2023-11-15T01:21:48.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff662097700 1 --2- 172.21.15.1:0/3708874651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff644004b80 0x7ff644005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff661095700 1 --2- 172.21.15.1:0/3708874651 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff644003e00 0x7ff644004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.082+0000 7ff661896700 1 --2- 172.21.15.1:0/3708874651 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff65c0bd130 0x7ff644003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.083+0000 7ff662097700 1 -- 172.21.15.1:0/3708874651 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff65c0bd130 msgr2=0x7ff644003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.083+0000 7ff662097700 1 --2- 172.21.15.1:0/3708874651 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff65c0bd130 0x7ff644003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.083+0000 7ff662097700 1 -- 172.21.15.1:0/3708874651 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff644003e00 msgr2=0x7ff644004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.083+0000 7ff662097700 1 --2- 172.21.15.1:0/3708874651 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff644003e00 0x7ff644004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.083+0000 7ff662097700 1 -- 172.21.15.1:0/3708874651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6440033f0 con 0x7ff644004b80 2023-11-15T01:21:48.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.083+0000 7ff661896700 1 --2- 172.21.15.1:0/3708874651 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff65c0bd130 0x7ff644003910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:48.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.083+0000 7ff662097700 1 --2- 172.21.15.1:0/3708874651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff644004b80 0x7ff644005000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7ff64c00e210 tx=0x7ff64c00b040).ready entity=mon.0 client_cookie=a3be7b0a4e08640a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:48.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.083+0000 7ff660894700 1 -- 172.21.15.1:0/3708874651 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c009ac0 con 0x7ff644004b80 2023-11-15T01:21:48.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.083+0000 7ff660894700 1 -- 172.21.15.1:0/3708874651 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c00f040 con 0x7ff644004b80 2023-11-15T01:21:48.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.083+0000 7ff660894700 1 -- 172.21.15.1:0/3708874651 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c00ecd0 con 0x7ff644004b80 2023-11-15T01:21:48.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.083+0000 7ff663afa700 1 -- 172.21.15.1:0/3708874651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff644004b80 msgr2=0x7ff644005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.083+0000 7ff663afa700 1 --2- 172.21.15.1:0/3708874651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff644004b80 0x7ff644005000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7ff64c00e210 tx=0x7ff64c00b040).stop 2023-11-15T01:21:48.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.083+0000 7ff662097700 1 -- 172.21.15.1:0/3708874651 reap_dead start 2023-11-15T01:21:48.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.083+0000 7ff663afa700 1 -- 172.21.15.1:0/3708874651 shutdown_connections 2023-11-15T01:21:48.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.084+0000 7ff663afa700 1 -- 172.21.15.1:0/3708874651 >> 172.21.15.1:0/3708874651 conn(0x7ff65c0c7d70 msgr2=0x7ff65c0c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:48.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.084+0000 7ff663afa700 1 -- 172.21.15.1:0/3708874651 shutdown_connections 2023-11-15T01:21:48.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.084+0000 7ff663afa700 1 -- 172.21.15.1:0/3708874651 wait complete. 2023-11-15T01:21:48.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.085+0000 7ff663afa700 1 Processor -- start 2023-11-15T01:21:48.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.085+0000 7ff663afa700 1 -- start start 2023-11-15T01:21:48.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.085+0000 7ff663afa700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff644004b80 0x7ff65c1677b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff663afa700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff65c0aa1a0 0x7ff65c164910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff663afa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff65c164e00 0x7ff65c0c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff663afa700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c1686e0 con 0x7ff65c0aa1a0 2023-11-15T01:21:48.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff663afa700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c164190 con 0x7ff644004b80 2023-11-15T01:21:48.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff663afa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c167e40 con 0x7ff65c164e00 2023-11-15T01:21:48.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff661095700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff65c0aa1a0 0x7ff65c164910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff661095700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff65c0aa1a0 0x7ff65c164910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37076/0 (socket says 172.21.15.1:37076) 2023-11-15T01:21:48.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff661095700 1 -- 172.21.15.1:0/774402273 learned_addr learned my addr 172.21.15.1:0/774402273 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:48.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff661896700 1 --2- 172.21.15.1:0/774402273 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff644004b80 0x7ff65c1677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff662097700 1 --2- 172.21.15.1:0/774402273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff65c164e00 0x7ff65c0c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff661095700 1 -- 172.21.15.1:0/774402273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff65c164e00 msgr2=0x7ff65c0c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff661095700 1 --2- 172.21.15.1:0/774402273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff65c164e00 0x7ff65c0c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff661095700 1 -- 172.21.15.1:0/774402273 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff644004b80 msgr2=0x7ff65c1677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff661095700 1 --2- 172.21.15.1:0/774402273 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff644004b80 0x7ff65c1677b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff661095700 1 -- 172.21.15.1:0/774402273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c168120 con 0x7ff65c0aa1a0 2023-11-15T01:21:48.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff662097700 1 --2- 172.21.15.1:0/774402273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff65c164e00 0x7ff65c0c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:48.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff661095700 1 --2- 172.21.15.1:0/774402273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff65c0aa1a0 0x7ff65c164910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7ff650004a10 tx=0x7ff650001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:48.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff659ffb700 1 -- 172.21.15.1:0/774402273 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65000f6c0 con 0x7ff65c0aa1a0 2023-11-15T01:21:48.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff659ffb700 1 -- 172.21.15.1:0/774402273 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65000f820 con 0x7ff65c0aa1a0 2023-11-15T01:21:48.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff663afa700 1 -- 172.21.15.1:0/774402273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65c168400 con 0x7ff65c0aa1a0 2023-11-15T01:21:48.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff659ffb700 1 -- 172.21.15.1:0/774402273 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65000fba0 con 0x7ff65c0aa1a0 2023-11-15T01:21:48.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.086+0000 7ff663afa700 1 -- 172.21.15.1:0/774402273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c0aa620 con 0x7ff65c0aa1a0 2023-11-15T01:21:48.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.087+0000 7ff663afa700 1 -- 172.21.15.1:0/774402273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65c06c7e0 con 0x7ff65c0aa1a0 2023-11-15T01:21:48.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.088+0000 7ff659ffb700 1 -- 172.21.15.1:0/774402273 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff65001d3b0 con 0x7ff65c0aa1a0 2023-11-15T01:21:48.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.088+0000 7ff659ffb700 1 --2- 172.21.15.1:0/774402273 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff64805f150 0x7ff648061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.088+0000 7ff659ffb700 1 -- 172.21.15.1:0/774402273 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff650079be0 con 0x7ff65c0aa1a0 2023-11-15T01:21:48.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.088+0000 7ff661896700 1 --2- 172.21.15.1:0/774402273 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff64805f150 0x7ff648061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.089+0000 7ff661896700 1 --2- 172.21.15.1:0/774402273 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff64805f150 0x7ff648061610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff654003950 tx=0x7ff65400c040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:48.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.092+0000 7ff659ffb700 1 -- 172.21.15.1:0/774402273 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff65004ae50 con 0x7ff65c0aa1a0 2023-11-15T01:21:48.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.260+0000 7ff663afa700 1 -- 172.21.15.1:0/774402273 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff65c0c2d10 con 0x7ff64805f150 2023-11-15T01:21:48.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.269+0000 7ff659ffb700 1 -- 172.21.15.1:0/774402273 <== mgr.4103 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336341 (secure 0 0 0) 0x7ff65c0c2d10 con 0x7ff64805f150 2023-11-15T01:21:48.274 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:48.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.273+0000 7ff663afa700 1 -- 172.21.15.1:0/774402273 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff64805f150 msgr2=0x7ff648061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.273+0000 7ff663afa700 1 --2- 172.21.15.1:0/774402273 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff64805f150 0x7ff648061610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff654003950 tx=0x7ff65400c040).stop 2023-11-15T01:21:48.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.273+0000 7ff663afa700 1 -- 172.21.15.1:0/774402273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff65c0aa1a0 msgr2=0x7ff65c164910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.273+0000 7ff663afa700 1 --2- 172.21.15.1:0/774402273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff65c0aa1a0 0x7ff65c164910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7ff650004a10 tx=0x7ff650001e70).stop 2023-11-15T01:21:48.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.273+0000 7ff663afa700 1 -- 172.21.15.1:0/774402273 shutdown_connections 2023-11-15T01:21:48.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.273+0000 7ff663afa700 1 --2- 172.21.15.1:0/774402273 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff64805f150 0x7ff648061610 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.273+0000 7ff663afa700 1 --2- 172.21.15.1:0/774402273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff65c164e00 0x7ff65c0c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.273+0000 7ff663afa700 1 --2- 172.21.15.1:0/774402273 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff644004b80 0x7ff65c1677b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.273+0000 7ff663afa700 1 --2- 172.21.15.1:0/774402273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff65c0aa1a0 0x7ff65c164910 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.273+0000 7ff663afa700 1 -- 172.21.15.1:0/774402273 >> 172.21.15.1:0/774402273 conn(0x7ff65c0c7d70 msgr2=0x7ff65c065d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:48.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.273+0000 7ff663afa700 1 -- 172.21.15.1:0/774402273 shutdown_connections 2023-11-15T01:21:48.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.273+0000 7ff663afa700 1 -- 172.21.15.1:0/774402273 wait complete. 2023-11-15T01:21:48.280 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:21:48.286 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T01:21:47.760102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378624,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596096,"statfs":{"total":773094113280,"available":770658402304,"internally_reserved":0,"allocated":1900544,"data_stored":687340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002199"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076736+0000","last_change":"2023-11-15T01:21:37.070154+0000","last_active":"2023-11-15T01:21:37.076736+0000","last_peered":"2023-11-15T01:21:37.076736+0000","last_clean":"2023-11-15T01:21:37.076736+0000","last_became_active":"2023-11-15T01:21:37.069444+0000","last_became_peered":"2023-11-15T01:21:37.069444+0000","last_unstale":"2023-11-15T01:21:37.076736+0000","last_undegraded":"2023-11-15T01:21:37.076736+0000","last_fullsized":"2023-11-15T01:21:37.076736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.064539+0000","last_change":"2023-11-15T01:21:36.678192+0000","last_active":"2023-11-15T01:21:37.064539+0000","last_peered":"2023-11-15T01:21:37.064539+0000","last_clean":"2023-11-15T01:21:37.064539+0000","last_became_active":"2023-11-15T01:21:36.677205+0000","last_became_peered":"2023-11-15T01:21:36.677205+0000","last_unstale":"2023-11-15T01:21:37.064539+0000","last_undegraded":"2023-11-15T01:21:37.064539+0000","last_fullsized":"2023-11-15T01:21:37.064539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.068262+0000","last_change":"2023-11-15T01:21:37.064541+0000","last_active":"2023-11-15T01:21:37.068262+0000","last_peered":"2023-11-15T01:21:37.068262+0000","last_clean":"2023-11-15T01:21:37.068262+0000","last_became_active":"2023-11-15T01:21:37.064244+0000","last_became_peered":"2023-11-15T01:21:37.064244+0000","last_unstale":"2023-11-15T01:21:37.068262+0000","last_undegraded":"2023-11-15T01:21:37.068262+0000","last_fullsized":"2023-11-15T01:21:37.068262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054518+0000","last_change":"2023-11-15T01:21:36.683547+0000","last_active":"2023-11-15T01:21:37.054518+0000","last_peered":"2023-11-15T01:21:37.054518+0000","last_clean":"2023-11-15T01:21:37.054518+0000","last_became_active":"2023-11-15T01:21:36.682979+0000","last_became_peered":"2023-11-15T01:21:36.682979+0000","last_unstale":"2023-11-15T01:21:37.054518+0000","last_undegraded":"2023-11-15T01:21:37.054518+0000","last_fullsized":"2023-11-15T01:21:37.054518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073255+0000","last_change":"2023-11-15T01:21:37.067297+0000","last_active":"2023-11-15T01:21:37.073255+0000","last_peered":"2023-11-15T01:21:37.073255+0000","last_clean":"2023-11-15T01:21:37.073255+0000","last_became_active":"2023-11-15T01:21:37.066997+0000","last_became_peered":"2023-11-15T01:21:37.066997+0000","last_unstale":"2023-11-15T01:21:37.073255+0000","last_undegraded":"2023-11-15T01:21:37.073255+0000","last_fullsized":"2023-11-15T01:21:37.073255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058796+0000","last_change":"2023-11-15T01:21:36.679373+0000","last_active":"2023-11-15T01:21:37.058796+0000","last_peered":"2023-11-15T01:21:37.058796+0000","last_clean":"2023-11-15T01:21:37.058796+0000","last_became_active":"2023-11-15T01:21:36.678627+0000","last_became_peered":"2023-11-15T01:21:36.678627+0000","last_unstale":"2023-11-15T01:21:37.058796+0000","last_undegraded":"2023-11-15T01:21:37.058796+0000","last_fullsized":"2023-11-15T01:21:37.058796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076950+0000","last_change":"2023-11-15T01:21:37.074270+0000","last_active":"2023-11-15T01:21:37.076950+0000","last_peered":"2023-11-15T01:21:37.076950+0000","last_clean":"2023-11-15T01:21:37.076950+0000","last_became_active":"2023-11-15T01:21:37.073966+0000","last_became_peered":"2023-11-15T01:21:37.073966+0000","last_unstale":"2023-11-15T01:21:37.076950+0000","last_undegraded":"2023-11-15T01:21:37.076950+0000","last_fullsized":"2023-11-15T01:21:37.076950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.052916+0000","last_change":"2023-11-15T01:21:36.679676+0000","last_active":"2023-11-15T01:21:37.052916+0000","last_peered":"2023-11-15T01:21:37.052916+0000","last_clean":"2023-11-15T01:21:37.052916+0000","last_became_active":"2023-11-15T01:21:36.679444+0000","last_became_peered":"2023-11-15T01:21:36.679444+0000","last_unstale":"2023-11-15T01:21:37.052916+0000","last_undegraded":"2023-11-15T01:21:37.052916+0000","last_fullsized":"2023-11-15T01:21:37.052916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077396+0000","last_change":"2023-11-15T01:21:37.075345+0000","last_active":"2023-11-15T01:21:37.077396+0000","last_peered":"2023-11-15T01:21:37.077396+0000","last_clean":"2023-11-15T01:21:37.077396+0000","last_became_active":"2023-11-15T01:21:37.074940+0000","last_became_peered":"2023-11-15T01:21:37.074940+0000","last_unstale":"2023-11-15T01:21:37.077396+0000","last_undegraded":"2023-11-15T01:21:37.077396+0000","last_fullsized":"2023-11-15T01:21:37.077396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059141+0000","last_change":"2023-11-15T01:21:36.675726+0000","last_active":"2023-11-15T01:21:37.059141+0000","last_peered":"2023-11-15T01:21:37.059141+0000","last_clean":"2023-11-15T01:21:37.059141+0000","last_became_active":"2023-11-15T01:21:36.675370+0000","last_became_peered":"2023-11-15T01:21:36.675370+0000","last_unstale":"2023-11-15T01:21:37.059141+0000","last_undegraded":"2023-11-15T01:21:37.059141+0000","last_fullsized":"2023-11-15T01:21:37.059141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073310+0000","last_change":"2023-11-15T01:21:37.071192+0000","last_active":"2023-11-15T01:21:37.073310+0000","last_peered":"2023-11-15T01:21:37.073310+0000","last_clean":"2023-11-15T01:21:37.073310+0000","last_became_active":"2023-11-15T01:21:37.070894+0000","last_became_peered":"2023-11-15T01:21:37.070894+0000","last_unstale":"2023-11-15T01:21:37.073310+0000","last_undegraded":"2023-11-15T01:21:37.073310+0000","last_fullsized":"2023-11-15T01:21:37.073310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077678+0000","last_change":"2023-11-15T01:21:36.678243+0000","last_active":"2023-11-15T01:21:37.077678+0000","last_peered":"2023-11-15T01:21:37.077678+0000","last_clean":"2023-11-15T01:21:37.077678+0000","last_became_active":"2023-11-15T01:21:36.675596+0000","last_became_peered":"2023-11-15T01:21:36.675596+0000","last_unstale":"2023-11-15T01:21:37.077678+0000","last_undegraded":"2023-11-15T01:21:37.077678+0000","last_fullsized":"2023-11-15T01:21:37.077678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075581+0000","last_change":"2023-11-15T01:21:37.070789+0000","last_active":"2023-11-15T01:21:37.075581+0000","last_peered":"2023-11-15T01:21:37.075581+0000","last_clean":"2023-11-15T01:21:37.075581+0000","last_became_active":"2023-11-15T01:21:37.070474+0000","last_became_peered":"2023-11-15T01:21:37.070474+0000","last_unstale":"2023-11-15T01:21:37.075581+0000","last_undegraded":"2023-11-15T01:21:37.075581+0000","last_fullsized":"2023-11-15T01:21:37.075581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077420+0000","last_change":"2023-11-15T01:21:36.681355+0000","last_active":"2023-11-15T01:21:37.077420+0000","last_peered":"2023-11-15T01:21:37.077420+0000","last_clean":"2023-11-15T01:21:37.077420+0000","last_became_active":"2023-11-15T01:21:36.681062+0000","last_became_peered":"2023-11-15T01:21:36.681062+0000","last_unstale":"2023-11-15T01:21:37.077420+0000","last_undegraded":"2023-11-15T01:21:37.077420+0000","last_fullsized":"2023-11-15T01:21:37.077420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076571+0000","last_change":"2023-11-15T01:21:37.069662+0000","last_active":"2023-11-15T01:21:37.076571+0000","last_peered":"2023-11-15T01:21:37.076571+0000","last_clean":"2023-11-15T01:21:37.076571+0000","last_became_active":"2023-11-15T01:21:37.069329+0000","last_became_peered":"2023-11-15T01:21:37.069329+0000","last_unstale":"2023-11-15T01:21:37.076571+0000","last_undegraded":"2023-11-15T01:21:37.076571+0000","last_fullsized":"2023-11-15T01:21:37.076571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076355+0000","last_change":"2023-11-15T01:21:36.678012+0000","last_active":"2023-11-15T01:21:37.076355+0000","last_peered":"2023-11-15T01:21:37.076355+0000","last_clean":"2023-11-15T01:21:37.076355+0000","last_became_active":"2023-11-15T01:21:36.677738+0000","last_became_peered":"2023-11-15T01:21:36.677738+0000","last_unstale":"2023-11-15T01:21:37.076355+0000","last_undegraded":"2023-11-15T01:21:37.076355+0000","last_fullsized":"2023-11-15T01:21:37.076355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081186+0000","last_change":"2023-11-15T01:21:37.077200+0000","last_active":"2023-11-15T01:21:37.081186+0000","last_peered":"2023-11-15T01:21:37.081186+0000","last_clean":"2023-11-15T01:21:37.081186+0000","last_became_active":"2023-11-15T01:21:37.076903+0000","last_became_peered":"2023-11-15T01:21:37.076903+0000","last_unstale":"2023-11-15T01:21:37.081186+0000","last_undegraded":"2023-11-15T01:21:37.081186+0000","last_fullsized":"2023-11-15T01:21:37.081186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051933+0000","last_change":"2023-11-15T01:21:36.673362+0000","last_active":"2023-11-15T01:21:37.051933+0000","last_peered":"2023-11-15T01:21:37.051933+0000","last_clean":"2023-11-15T01:21:37.051933+0000","last_became_active":"2023-11-15T01:21:36.671321+0000","last_became_peered":"2023-11-15T01:21:36.671321+0000","last_unstale":"2023-11-15T01:21:37.051933+0000","last_undegraded":"2023-11-15T01:21:37.051933+0000","last_fullsized":"2023-11-15T01:21:37.051933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078495+0000","last_change":"2023-11-15T01:21:37.071120+0000","last_active":"2023-11-15T01:21:37.078495+0000","last_peered":"2023-11-15T01:21:37.078495+0000","last_clean":"2023-11-15T01:21:37.078495+0000","last_became_active":"2023-11-15T01:21:37.070850+0000","last_became_peered":"2023-11-15T01:21:37.070850+0000","last_unstale":"2023-11-15T01:21:37.078495+0000","last_undegraded":"2023-11-15T01:21:37.078495+0000","last_fullsized":"2023-11-15T01:21:37.078495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060633+0000","last_change":"2023-11-15T01:21:36.681424+0000","last_active":"2023-11-15T01:21:37.060633+0000","last_peered":"2023-11-15T01:21:37.060633+0000","last_clean":"2023-11-15T01:21:37.060633+0000","last_became_active":"2023-11-15T01:21:36.680976+0000","last_became_peered":"2023-11-15T01:21:36.680976+0000","last_unstale":"2023-11-15T01:21:37.060633+0000","last_undegraded":"2023-11-15T01:21:37.060633+0000","last_fullsized":"2023-11-15T01:21:37.060633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081471+0000","last_change":"2023-11-15T01:21:37.079474+0000","last_active":"2023-11-15T01:21:37.081471+0000","last_peered":"2023-11-15T01:21:37.081471+0000","last_clean":"2023-11-15T01:21:37.081471+0000","last_became_active":"2023-11-15T01:21:37.078060+0000","last_became_peered":"2023-11-15T01:21:37.078060+0000","last_unstale":"2023-11-15T01:21:37.081471+0000","last_undegraded":"2023-11-15T01:21:37.081471+0000","last_fullsized":"2023-11-15T01:21:37.081471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061716+0000","last_change":"2023-11-15T01:21:36.674722+0000","last_active":"2023-11-15T01:21:37.061716+0000","last_peered":"2023-11-15T01:21:37.061716+0000","last_clean":"2023-11-15T01:21:37.061716+0000","last_became_active":"2023-11-15T01:21:36.674350+0000","last_became_peered":"2023-11-15T01:21:36.674350+0000","last_unstale":"2023-11-15T01:21:37.061716+0000","last_undegraded":"2023-11-15T01:21:37.061716+0000","last_fullsized":"2023-11-15T01:21:37.061716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.070132+0000","last_change":"2023-11-15T01:21:37.065467+0000","last_active":"2023-11-15T01:21:37.070132+0000","last_peered":"2023-11-15T01:21:37.070132+0000","last_clean":"2023-11-15T01:21:37.070132+0000","last_became_active":"2023-11-15T01:21:37.065154+0000","last_became_peered":"2023-11-15T01:21:37.065154+0000","last_unstale":"2023-11-15T01:21:37.070132+0000","last_undegraded":"2023-11-15T01:21:37.070132+0000","last_fullsized":"2023-11-15T01:21:37.070132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075966+0000","last_change":"2023-11-15T01:21:36.679946+0000","last_active":"2023-11-15T01:21:37.075966+0000","last_peered":"2023-11-15T01:21:37.075966+0000","last_clean":"2023-11-15T01:21:37.075966+0000","last_became_active":"2023-11-15T01:21:36.679643+0000","last_became_peered":"2023-11-15T01:21:36.679643+0000","last_unstale":"2023-11-15T01:21:37.075966+0000","last_undegraded":"2023-11-15T01:21:37.075966+0000","last_fullsized":"2023-11-15T01:21:37.075966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076313+0000","last_change":"2023-11-15T01:21:37.073362+0000","last_active":"2023-11-15T01:21:37.076313+0000","last_peered":"2023-11-15T01:21:37.076313+0000","last_clean":"2023-11-15T01:21:37.076313+0000","last_became_active":"2023-11-15T01:21:37.072950+0000","last_became_peered":"2023-11-15T01:21:37.072950+0000","last_unstale":"2023-11-15T01:21:37.076313+0000","last_undegraded":"2023-11-15T01:21:37.076313+0000","last_fullsized":"2023-11-15T01:21:37.076313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076535+0000","last_change":"2023-11-15T01:21:36.679282+0000","last_active":"2023-11-15T01:21:37.076535+0000","last_peered":"2023-11-15T01:21:37.076535+0000","last_clean":"2023-11-15T01:21:37.076535+0000","last_became_active":"2023-11-15T01:21:36.676942+0000","last_became_peered":"2023-11-15T01:21:36.676942+0000","last_unstale":"2023-11-15T01:21:37.076535+0000","last_undegraded":"2023-11-15T01:21:37.076535+0000","last_fullsized":"2023-11-15T01:21:37.076535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073625+0000","last_change":"2023-11-15T01:21:37.067894+0000","last_active":"2023-11-15T01:21:37.073625+0000","last_peered":"2023-11-15T01:21:37.073625+0000","last_clean":"2023-11-15T01:21:37.073625+0000","last_became_active":"2023-11-15T01:21:37.067199+0000","last_became_peered":"2023-11-15T01:21:37.067199+0000","last_unstale":"2023-11-15T01:21:37.073625+0000","last_undegraded":"2023-11-15T01:21:37.073625+0000","last_fullsized":"2023-11-15T01:21:37.073625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.064048+0000","last_change":"2023-11-15T01:21:36.682276+0000","last_active":"2023-11-15T01:21:37.064048+0000","last_peered":"2023-11-15T01:21:37.064048+0000","last_clean":"2023-11-15T01:21:37.064048+0000","last_became_active":"2023-11-15T01:21:36.681910+0000","last_became_peered":"2023-11-15T01:21:36.681910+0000","last_unstale":"2023-11-15T01:21:37.064048+0000","last_undegraded":"2023-11-15T01:21:37.064048+0000","last_fullsized":"2023-11-15T01:21:37.064048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075905+0000","last_change":"2023-11-15T01:21:37.068177+0000","last_active":"2023-11-15T01:21:37.075905+0000","last_peered":"2023-11-15T01:21:37.075905+0000","last_clean":"2023-11-15T01:21:37.075905+0000","last_became_active":"2023-11-15T01:21:37.067708+0000","last_became_peered":"2023-11-15T01:21:37.067708+0000","last_unstale":"2023-11-15T01:21:37.075905+0000","last_undegraded":"2023-11-15T01:21:37.075905+0000","last_fullsized":"2023-11-15T01:21:37.075905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058497+0000","last_change":"2023-11-15T01:21:36.674143+0000","last_active":"2023-11-15T01:21:37.058497+0000","last_peered":"2023-11-15T01:21:37.058497+0000","last_clean":"2023-11-15T01:21:37.058497+0000","last_became_active":"2023-11-15T01:21:36.673800+0000","last_became_peered":"2023-11-15T01:21:36.673800+0000","last_unstale":"2023-11-15T01:21:37.058497+0000","last_undegraded":"2023-11-15T01:21:37.058497+0000","last_fullsized":"2023-11-15T01:21:37.058497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075706+0000","last_change":"2023-11-15T01:21:37.071297+0000","last_active":"2023-11-15T01:21:37.075706+0000","last_peered":"2023-11-15T01:21:37.075706+0000","last_clean":"2023-11-15T01:21:37.075706+0000","last_became_active":"2023-11-15T01:21:37.070987+0000","last_became_peered":"2023-11-15T01:21:37.070987+0000","last_unstale":"2023-11-15T01:21:37.075706+0000","last_undegraded":"2023-11-15T01:21:37.075706+0000","last_fullsized":"2023-11-15T01:21:37.075706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079876+0000","last_change":"2023-11-15T01:21:36.679647+0000","last_active":"2023-11-15T01:21:37.079876+0000","last_peered":"2023-11-15T01:21:37.079876+0000","last_clean":"2023-11-15T01:21:37.079876+0000","last_became_active":"2023-11-15T01:21:36.679134+0000","last_became_peered":"2023-11-15T01:21:36.679134+0000","last_unstale":"2023-11-15T01:21:37.079876+0000","last_undegraded":"2023-11-15T01:21:37.079876+0000","last_fullsized":"2023-11-15T01:21:37.079876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075523+0000","last_change":"2023-11-15T01:21:37.071036+0000","last_active":"2023-11-15T01:21:37.075523+0000","last_peered":"2023-11-15T01:21:37.075523+0000","last_clean":"2023-11-15T01:21:37.075523+0000","last_became_active":"2023-11-15T01:21:37.070766+0000","last_became_peered":"2023-11-15T01:21:37.070766+0000","last_unstale":"2023-11-15T01:21:37.075523+0000","last_undegraded":"2023-11-15T01:21:37.075523+0000","last_fullsized":"2023-11-15T01:21:37.075523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053077+0000","last_change":"2023-11-15T01:21:36.677096+0000","last_active":"2023-11-15T01:21:37.053077+0000","last_peered":"2023-11-15T01:21:37.053077+0000","last_clean":"2023-11-15T01:21:37.053077+0000","last_became_active":"2023-11-15T01:21:36.676780+0000","last_became_peered":"2023-11-15T01:21:36.676780+0000","last_unstale":"2023-11-15T01:21:37.053077+0000","last_undegraded":"2023-11-15T01:21:37.053077+0000","last_fullsized":"2023-11-15T01:21:37.053077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075723+0000","last_change":"2023-11-15T01:21:37.071911+0000","last_active":"2023-11-15T01:21:37.075723+0000","last_peered":"2023-11-15T01:21:37.075723+0000","last_clean":"2023-11-15T01:21:37.075723+0000","last_became_active":"2023-11-15T01:21:37.071572+0000","last_became_peered":"2023-11-15T01:21:37.071572+0000","last_unstale":"2023-11-15T01:21:37.075723+0000","last_undegraded":"2023-11-15T01:21:37.075723+0000","last_fullsized":"2023-11-15T01:21:37.075723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061988+0000","last_change":"2023-11-15T01:21:36.665943+0000","last_active":"2023-11-15T01:21:37.061988+0000","last_peered":"2023-11-15T01:21:37.061988+0000","last_clean":"2023-11-15T01:21:37.061988+0000","last_became_active":"2023-11-15T01:21:36.663826+0000","last_became_peered":"2023-11-15T01:21:36.663826+0000","last_unstale":"2023-11-15T01:21:37.061988+0000","last_undegraded":"2023-11-15T01:21:37.061988+0000","last_fullsized":"2023-11-15T01:21:37.061988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079611+0000","last_change":"2023-11-15T01:21:37.078906+0000","last_active":"2023-11-15T01:21:37.079611+0000","last_peered":"2023-11-15T01:21:37.079611+0000","last_clean":"2023-11-15T01:21:37.079611+0000","last_became_active":"2023-11-15T01:21:37.078557+0000","last_became_peered":"2023-11-15T01:21:37.078557+0000","last_unstale":"2023-11-15T01:21:37.079611+0000","last_undegraded":"2023-11-15T01:21:37.079611+0000","last_fullsized":"2023-11-15T01:21:37.079611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060923+0000","last_change":"2023-11-15T01:21:36.684155+0000","last_active":"2023-11-15T01:21:37.060923+0000","last_peered":"2023-11-15T01:21:37.060923+0000","last_clean":"2023-11-15T01:21:37.060923+0000","last_became_active":"2023-11-15T01:21:36.683867+0000","last_became_peered":"2023-11-15T01:21:36.683867+0000","last_unstale":"2023-11-15T01:21:37.060923+0000","last_undegraded":"2023-11-15T01:21:37.060923+0000","last_fullsized":"2023-11-15T01:21:37.060923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.055130+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:21:37.055130+0000","last_peered":"2023-11-15T01:21:37.055130+0000","last_clean":"2023-11-15T01:21:37.055130+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:21:37.055130+0000","last_undegraded":"2023-11-15T01:21:37.055130+0000","last_fullsized":"2023-11-15T01:21:37.055130+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059501+0000","last_change":"2023-11-15T01:21:36.673900+0000","last_active":"2023-11-15T01:21:37.059501+0000","last_peered":"2023-11-15T01:21:37.059501+0000","last_clean":"2023-11-15T01:21:37.059501+0000","last_became_active":"2023-11-15T01:21:36.673523+0000","last_became_peered":"2023-11-15T01:21:36.673523+0000","last_unstale":"2023-11-15T01:21:37.059501+0000","last_undegraded":"2023-11-15T01:21:37.059501+0000","last_fullsized":"2023-11-15T01:21:37.059501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.066720+0000","last_change":"2023-11-15T01:21:37.065623+0000","last_active":"2023-11-15T01:21:37.066720+0000","last_peered":"2023-11-15T01:21:37.066720+0000","last_clean":"2023-11-15T01:21:37.066720+0000","last_became_active":"2023-11-15T01:21:37.065338+0000","last_became_peered":"2023-11-15T01:21:37.065338+0000","last_unstale":"2023-11-15T01:21:37.066720+0000","last_undegraded":"2023-11-15T01:21:37.066720+0000","last_fullsized":"2023-11-15T01:21:37.066720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058545+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:21:37.058545+0000","last_peered":"2023-11-15T01:21:37.058545+0000","last_clean":"2023-11-15T01:21:37.058545+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:21:37.058545+0000","last_undegraded":"2023-11-15T01:21:37.058545+0000","last_fullsized":"2023-11-15T01:21:37.058545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.065604+0000","last_change":"2023-11-15T01:21:36.675569+0000","last_active":"2023-11-15T01:21:37.065604+0000","last_peered":"2023-11-15T01:21:37.065604+0000","last_clean":"2023-11-15T01:21:37.065604+0000","last_became_active":"2023-11-15T01:21:36.675216+0000","last_became_peered":"2023-11-15T01:21:36.675216+0000","last_unstale":"2023-11-15T01:21:37.065604+0000","last_undegraded":"2023-11-15T01:21:37.065604+0000","last_fullsized":"2023-11-15T01:21:37.065604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.063934+0000","last_change":"2023-11-15T01:21:37.056059+0000","last_active":"2023-11-15T01:21:37.063934+0000","last_peered":"2023-11-15T01:21:37.063934+0000","last_clean":"2023-11-15T01:21:37.063934+0000","last_became_active":"2023-11-15T01:21:37.055792+0000","last_became_peered":"2023-11-15T01:21:37.055792+0000","last_unstale":"2023-11-15T01:21:37.063934+0000","last_undegraded":"2023-11-15T01:21:37.063934+0000","last_fullsized":"2023-11-15T01:21:37.063934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.066956+0000","last_change":"2023-11-15T01:21:37.066235+0000","last_active":"2023-11-15T01:21:37.066956+0000","last_peered":"2023-11-15T01:21:37.066956+0000","last_clean":"2023-11-15T01:21:37.066956+0000","last_became_active":"2023-11-15T01:21:37.066039+0000","last_became_peered":"2023-11-15T01:21:37.066039+0000","last_unstale":"2023-11-15T01:21:37.066956+0000","last_undegraded":"2023-11-15T01:21:37.066956+0000","last_fullsized":"2023-11-15T01:21:37.066956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.049466+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:21:37.049466+0000","last_peered":"2023-11-15T01:21:37.049466+0000","last_clean":"2023-11-15T01:21:37.049466+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:21:37.049466+0000","last_undegraded":"2023-11-15T01:21:37.049466+0000","last_fullsized":"2023-11-15T01:21:37.049466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054621+0000","last_change":"2023-11-15T01:21:36.675336+0000","last_active":"2023-11-15T01:21:37.054621+0000","last_peered":"2023-11-15T01:21:37.054621+0000","last_clean":"2023-11-15T01:21:37.054621+0000","last_became_active":"2023-11-15T01:21:36.675018+0000","last_became_peered":"2023-11-15T01:21:36.675018+0000","last_unstale":"2023-11-15T01:21:37.054621+0000","last_undegraded":"2023-11-15T01:21:37.054621+0000","last_fullsized":"2023-11-15T01:21:37.054621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075405+0000","last_change":"2023-11-15T01:21:37.072490+0000","last_active":"2023-11-15T01:21:37.075405+0000","last_peered":"2023-11-15T01:21:37.075405+0000","last_clean":"2023-11-15T01:21:37.075405+0000","last_became_active":"2023-11-15T01:21:37.072175+0000","last_became_peered":"2023-11-15T01:21:37.072175+0000","last_unstale":"2023-11-15T01:21:37.075405+0000","last_undegraded":"2023-11-15T01:21:37.075405+0000","last_fullsized":"2023-11-15T01:21:37.075405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058381+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:21:37.058381+0000","last_peered":"2023-11-15T01:21:37.058381+0000","last_clean":"2023-11-15T01:21:37.058381+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:21:37.058381+0000","last_undegraded":"2023-11-15T01:21:37.058381+0000","last_fullsized":"2023-11-15T01:21:37.058381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059508+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:21:37.059508+0000","last_peered":"2023-11-15T01:21:37.059508+0000","last_clean":"2023-11-15T01:21:37.059508+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:21:37.059508+0000","last_undegraded":"2023-11-15T01:21:37.059508+0000","last_fullsized":"2023-11-15T01:21:37.059508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059414+0000","last_change":"2023-11-15T01:21:36.679052+0000","last_active":"2023-11-15T01:21:37.059414+0000","last_peered":"2023-11-15T01:21:37.059414+0000","last_clean":"2023-11-15T01:21:37.059414+0000","last_became_active":"2023-11-15T01:21:36.678750+0000","last_became_peered":"2023-11-15T01:21:36.678750+0000","last_unstale":"2023-11-15T01:21:37.059414+0000","last_undegraded":"2023-11-15T01:21:37.059414+0000","last_fullsized":"2023-11-15T01:21:37.059414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075965+0000","last_change":"2023-11-15T01:21:37.068467+0000","last_active":"2023-11-15T01:21:37.075965+0000","last_peered":"2023-11-15T01:21:37.075965+0000","last_clean":"2023-11-15T01:21:37.075965+0000","last_became_active":"2023-11-15T01:21:37.068195+0000","last_became_peered":"2023-11-15T01:21:37.068195+0000","last_unstale":"2023-11-15T01:21:37.075965+0000","last_undegraded":"2023-11-15T01:21:37.075965+0000","last_fullsized":"2023-11-15T01:21:37.075965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059991+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:21:37.059991+0000","last_peered":"2023-11-15T01:21:37.059991+0000","last_clean":"2023-11-15T01:21:37.059991+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:21:37.059991+0000","last_undegraded":"2023-11-15T01:21:37.059991+0000","last_fullsized":"2023-11-15T01:21:37.059991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051461+0000","last_change":"2023-11-15T01:21:36.678021+0000","last_active":"2023-11-15T01:21:37.051461+0000","last_peered":"2023-11-15T01:21:37.051461+0000","last_clean":"2023-11-15T01:21:37.051461+0000","last_became_active":"2023-11-15T01:21:36.677747+0000","last_became_peered":"2023-11-15T01:21:36.677747+0000","last_unstale":"2023-11-15T01:21:37.051461+0000","last_undegraded":"2023-11-15T01:21:37.051461+0000","last_fullsized":"2023-11-15T01:21:37.051461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.064933+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:21:37.064933+0000","last_peered":"2023-11-15T01:21:37.064933+0000","last_clean":"2023-11-15T01:21:37.064933+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:21:37.064933+0000","last_undegraded":"2023-11-15T01:21:37.064933+0000","last_fullsized":"2023-11-15T01:21:37.064933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.055252+0000","last_change":"2023-11-15T01:21:36.675293+0000","last_active":"2023-11-15T01:21:37.055252+0000","last_peered":"2023-11-15T01:21:37.055252+0000","last_clean":"2023-11-15T01:21:37.055252+0000","last_became_active":"2023-11-15T01:21:36.674972+0000","last_became_peered":"2023-11-15T01:21:36.674972+0000","last_unstale":"2023-11-15T01:21:37.055252+0000","last_undegraded":"2023-11-15T01:21:37.055252+0000","last_fullsized":"2023-11-15T01:21:37.055252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075953+0000","last_change":"2023-11-15T01:21:37.069096+0000","last_active":"2023-11-15T01:21:37.075953+0000","last_peered":"2023-11-15T01:21:37.075953+0000","last_clean":"2023-11-15T01:21:37.075953+0000","last_became_active":"2023-11-15T01:21:37.068837+0000","last_became_peered":"2023-11-15T01:21:37.068837+0000","last_unstale":"2023-11-15T01:21:37.075953+0000","last_undegraded":"2023-11-15T01:21:37.075953+0000","last_fullsized":"2023-11-15T01:21:37.075953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.080003+0000","last_change":"2023-11-15T01:21:36.677731+0000","last_active":"2023-11-15T01:21:37.080003+0000","last_peered":"2023-11-15T01:21:37.080003+0000","last_clean":"2023-11-15T01:21:37.080003+0000","last_became_active":"2023-11-15T01:21:36.677473+0000","last_became_peered":"2023-11-15T01:21:36.677473+0000","last_unstale":"2023-11-15T01:21:37.080003+0000","last_undegraded":"2023-11-15T01:21:37.080003+0000","last_fullsized":"2023-11-15T01:21:37.080003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054763+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:21:37.054763+0000","last_peered":"2023-11-15T01:21:37.054763+0000","last_clean":"2023-11-15T01:21:37.054763+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:21:37.054763+0000","last_undegraded":"2023-11-15T01:21:37.054763+0000","last_fullsized":"2023-11-15T01:21:37.054763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076969+0000","last_change":"2023-11-15T01:21:37.074453+0000","last_active":"2023-11-15T01:21:37.076969+0000","last_peered":"2023-11-15T01:21:37.076969+0000","last_clean":"2023-11-15T01:21:37.076969+0000","last_became_active":"2023-11-15T01:21:37.074163+0000","last_became_peered":"2023-11-15T01:21:37.074163+0000","last_unstale":"2023-11-15T01:21:37.076969+0000","last_undegraded":"2023-11-15T01:21:37.076969+0000","last_fullsized":"2023-11-15T01:21:37.076969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054203+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:21:37.054203+0000","last_peered":"2023-11-15T01:21:37.054203+0000","last_clean":"2023-11-15T01:21:37.054203+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:21:37.054203+0000","last_undegraded":"2023-11-15T01:21:37.054203+0000","last_fullsized":"2023-11-15T01:21:37.054203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.052816+0000","last_change":"2023-11-15T01:21:36.677412+0000","last_active":"2023-11-15T01:21:37.052816+0000","last_peered":"2023-11-15T01:21:37.052816+0000","last_clean":"2023-11-15T01:21:37.052816+0000","last_became_active":"2023-11-15T01:21:36.677133+0000","last_became_peered":"2023-11-15T01:21:36.677133+0000","last_unstale":"2023-11-15T01:21:37.052816+0000","last_undegraded":"2023-11-15T01:21:37.052816+0000","last_fullsized":"2023-11-15T01:21:37.052816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076301+0000","last_change":"2023-11-15T01:21:37.073195+0000","last_active":"2023-11-15T01:21:37.076301+0000","last_peered":"2023-11-15T01:21:37.076301+0000","last_clean":"2023-11-15T01:21:37.076301+0000","last_became_active":"2023-11-15T01:21:37.069951+0000","last_became_peered":"2023-11-15T01:21:37.069951+0000","last_unstale":"2023-11-15T01:21:37.076301+0000","last_undegraded":"2023-11-15T01:21:37.076301+0000","last_fullsized":"2023-11-15T01:21:37.076301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060157+0000","last_change":"2023-11-15T01:21:37.056072+0000","last_active":"2023-11-15T01:21:37.060157+0000","last_peered":"2023-11-15T01:21:37.060157+0000","last_clean":"2023-11-15T01:21:37.060157+0000","last_became_active":"2023-11-15T01:21:37.055787+0000","last_became_peered":"2023-11-15T01:21:37.055787+0000","last_unstale":"2023-11-15T01:21:37.060157+0000","last_undegraded":"2023-11-15T01:21:37.060157+0000","last_fullsized":"2023-11-15T01:21:37.060157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051906+0000","last_change":"2023-11-15T01:21:36.672485+0000","last_active":"2023-11-15T01:21:37.051906+0000","last_peered":"2023-11-15T01:21:37.051906+0000","last_clean":"2023-11-15T01:21:37.051906+0000","last_became_active":"2023-11-15T01:21:36.672099+0000","last_became_peered":"2023-11-15T01:21:36.672099+0000","last_unstale":"2023-11-15T01:21:37.051906+0000","last_undegraded":"2023-11-15T01:21:37.051906+0000","last_fullsized":"2023-11-15T01:21:37.051906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081012+0000","last_change":"2023-11-15T01:21:37.077263+0000","last_active":"2023-11-15T01:21:37.081012+0000","last_peered":"2023-11-15T01:21:37.081012+0000","last_clean":"2023-11-15T01:21:37.081012+0000","last_became_active":"2023-11-15T01:21:37.076981+0000","last_became_peered":"2023-11-15T01:21:37.076981+0000","last_unstale":"2023-11-15T01:21:37.081012+0000","last_undegraded":"2023-11-15T01:21:37.081012+0000","last_fullsized":"2023-11-15T01:21:37.081012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058603+0000","last_change":"2023-11-15T01:21:36.677251+0000","last_active":"2023-11-15T01:21:37.058603+0000","last_peered":"2023-11-15T01:21:37.058603+0000","last_clean":"2023-11-15T01:21:37.058603+0000","last_became_active":"2023-11-15T01:21:36.676955+0000","last_became_peered":"2023-11-15T01:21:36.676955+0000","last_unstale":"2023-11-15T01:21:37.058603+0000","last_undegraded":"2023-11-15T01:21:37.058603+0000","last_fullsized":"2023-11-15T01:21:37.058603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075958+0000","last_change":"2023-11-15T01:21:37.073688+0000","last_active":"2023-11-15T01:21:37.075958+0000","last_peered":"2023-11-15T01:21:37.075958+0000","last_clean":"2023-11-15T01:21:37.075958+0000","last_became_active":"2023-11-15T01:21:37.073409+0000","last_became_peered":"2023-11-15T01:21:37.073409+0000","last_unstale":"2023-11-15T01:21:37.075958+0000","last_undegraded":"2023-11-15T01:21:37.075958+0000","last_fullsized":"2023-11-15T01:21:37.075958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073464+0000","last_change":"2023-11-15T01:21:36.675358+0000","last_active":"2023-11-15T01:21:37.073464+0000","last_peered":"2023-11-15T01:21:37.073464+0000","last_clean":"2023-11-15T01:21:37.073464+0000","last_became_active":"2023-11-15T01:21:36.675089+0000","last_became_peered":"2023-11-15T01:21:36.675089+0000","last_unstale":"2023-11-15T01:21:37.073464+0000","last_undegraded":"2023-11-15T01:21:37.073464+0000","last_fullsized":"2023-11-15T01:21:37.073464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077044+0000","last_change":"2023-11-15T01:21:37.074975+0000","last_active":"2023-11-15T01:21:37.077044+0000","last_peered":"2023-11-15T01:21:37.077044+0000","last_clean":"2023-11-15T01:21:37.077044+0000","last_became_active":"2023-11-15T01:21:37.068659+0000","last_became_peered":"2023-11-15T01:21:37.068659+0000","last_unstale":"2023-11-15T01:21:37.077044+0000","last_undegraded":"2023-11-15T01:21:37.077044+0000","last_fullsized":"2023-11-15T01:21:37.077044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.074074+0000","last_change":"2023-11-15T01:21:36.672628+0000","last_active":"2023-11-15T01:21:37.074074+0000","last_peered":"2023-11-15T01:21:37.074074+0000","last_clean":"2023-11-15T01:21:37.074074+0000","last_became_active":"2023-11-15T01:21:36.672235+0000","last_became_peered":"2023-11-15T01:21:36.672235+0000","last_unstale":"2023-11-15T01:21:37.074074+0000","last_undegraded":"2023-11-15T01:21:37.074074+0000","last_fullsized":"2023-11-15T01:21:37.074074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078770+0000","last_change":"2023-11-15T01:21:37.075172+0000","last_active":"2023-11-15T01:21:37.078770+0000","last_peered":"2023-11-15T01:21:37.078770+0000","last_clean":"2023-11-15T01:21:37.078770+0000","last_became_active":"2023-11-15T01:21:37.074844+0000","last_became_peered":"2023-11-15T01:21:37.074844+0000","last_unstale":"2023-11-15T01:21:37.078770+0000","last_undegraded":"2023-11-15T01:21:37.078770+0000","last_fullsized":"2023-11-15T01:21:37.078770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.070348+0000","last_change":"2023-11-15T01:21:36.681248+0000","last_active":"2023-11-15T01:21:37.070348+0000","last_peered":"2023-11-15T01:21:37.070348+0000","last_clean":"2023-11-15T01:21:37.070348+0000","last_became_active":"2023-11-15T01:21:36.680875+0000","last_became_peered":"2023-11-15T01:21:36.680875+0000","last_unstale":"2023-11-15T01:21:37.070348+0000","last_undegraded":"2023-11-15T01:21:37.070348+0000","last_fullsized":"2023-11-15T01:21:37.070348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072884+0000","last_change":"2023-11-15T01:21:37.070426+0000","last_active":"2023-11-15T01:21:37.072884+0000","last_peered":"2023-11-15T01:21:37.072884+0000","last_clean":"2023-11-15T01:21:37.072884+0000","last_became_active":"2023-11-15T01:21:37.070158+0000","last_became_peered":"2023-11-15T01:21:37.070158+0000","last_unstale":"2023-11-15T01:21:37.072884+0000","last_undegraded":"2023-11-15T01:21:37.072884+0000","last_fullsized":"2023-11-15T01:21:37.072884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053859+0000","last_change":"2023-11-15T01:21:36.674583+0000","last_active":"2023-11-15T01:21:37.053859+0000","last_peered":"2023-11-15T01:21:37.053859+0000","last_clean":"2023-11-15T01:21:37.053859+0000","last_became_active":"2023-11-15T01:21:36.674002+0000","last_became_peered":"2023-11-15T01:21:36.674002+0000","last_unstale":"2023-11-15T01:21:37.053859+0000","last_undegraded":"2023-11-15T01:21:37.053859+0000","last_fullsized":"2023-11-15T01:21:37.053859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.065776+0000","last_change":"2023-11-15T01:21:37.061993+0000","last_active":"2023-11-15T01:21:37.065776+0000","last_peered":"2023-11-15T01:21:37.065776+0000","last_clean":"2023-11-15T01:21:37.065776+0000","last_became_active":"2023-11-15T01:21:37.061379+0000","last_became_peered":"2023-11-15T01:21:37.061379+0000","last_unstale":"2023-11-15T01:21:37.065776+0000","last_undegraded":"2023-11-15T01:21:37.065776+0000","last_fullsized":"2023-11-15T01:21:37.065776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.049508+0000","last_change":"2023-11-15T01:21:36.666739+0000","last_active":"2023-11-15T01:21:37.049508+0000","last_peered":"2023-11-15T01:21:37.049508+0000","last_clean":"2023-11-15T01:21:37.049508+0000","last_became_active":"2023-11-15T01:21:36.666437+0000","last_became_peered":"2023-11-15T01:21:36.666437+0000","last_unstale":"2023-11-15T01:21:37.049508+0000","last_undegraded":"2023-11-15T01:21:37.049508+0000","last_fullsized":"2023-11-15T01:21:37.049508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.069514+0000","last_change":"2023-11-15T01:21:37.066195+0000","last_active":"2023-11-15T01:21:37.069514+0000","last_peered":"2023-11-15T01:21:37.069514+0000","last_clean":"2023-11-15T01:21:37.069514+0000","last_became_active":"2023-11-15T01:21:37.065915+0000","last_became_peered":"2023-11-15T01:21:37.065915+0000","last_unstale":"2023-11-15T01:21:37.069514+0000","last_undegraded":"2023-11-15T01:21:37.069514+0000","last_fullsized":"2023-11-15T01:21:37.069514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058395+0000","last_change":"2023-11-15T01:21:36.674457+0000","last_active":"2023-11-15T01:21:37.058395+0000","last_peered":"2023-11-15T01:21:37.058395+0000","last_clean":"2023-11-15T01:21:37.058395+0000","last_became_active":"2023-11-15T01:21:36.673479+0000","last_became_peered":"2023-11-15T01:21:36.673479+0000","last_unstale":"2023-11-15T01:21:37.058395+0000","last_undegraded":"2023-11-15T01:21:37.058395+0000","last_fullsized":"2023-11-15T01:21:37.058395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077664+0000","last_change":"2023-11-15T01:21:37.076770+0000","last_active":"2023-11-15T01:21:37.077664+0000","last_peered":"2023-11-15T01:21:37.077664+0000","last_clean":"2023-11-15T01:21:37.077664+0000","last_became_active":"2023-11-15T01:21:37.076474+0000","last_became_peered":"2023-11-15T01:21:37.076474+0000","last_unstale":"2023-11-15T01:21:37.077664+0000","last_undegraded":"2023-11-15T01:21:37.077664+0000","last_fullsized":"2023-11-15T01:21:37.077664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.052293+0000","last_change":"2023-11-15T01:21:36.677057+0000","last_active":"2023-11-15T01:21:37.052293+0000","last_peered":"2023-11-15T01:21:37.052293+0000","last_clean":"2023-11-15T01:21:37.052293+0000","last_became_active":"2023-11-15T01:21:36.676765+0000","last_became_peered":"2023-11-15T01:21:36.676765+0000","last_unstale":"2023-11-15T01:21:37.052293+0000","last_undegraded":"2023-11-15T01:21:37.052293+0000","last_fullsized":"2023-11-15T01:21:37.052293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079468+0000","last_change":"2023-11-15T01:21:37.077300+0000","last_active":"2023-11-15T01:21:37.079468+0000","last_peered":"2023-11-15T01:21:37.079468+0000","last_clean":"2023-11-15T01:21:37.079468+0000","last_became_active":"2023-11-15T01:21:37.076992+0000","last_became_peered":"2023-11-15T01:21:37.076992+0000","last_unstale":"2023-11-15T01:21:37.079468+0000","last_undegraded":"2023-11-15T01:21:37.079468+0000","last_fullsized":"2023-11-15T01:21:37.079468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.059811+0000","last_change":"2023-11-15T01:21:36.675721+0000","last_active":"2023-11-15T01:21:37.059811+0000","last_peered":"2023-11-15T01:21:37.059811+0000","last_clean":"2023-11-15T01:21:37.059811+0000","last_became_active":"2023-11-15T01:21:36.675435+0000","last_became_peered":"2023-11-15T01:21:36.675435+0000","last_unstale":"2023-11-15T01:21:37.059811+0000","last_undegraded":"2023-11-15T01:21:37.059811+0000","last_fullsized":"2023-11-15T01:21:37.059811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078780+0000","last_change":"2023-11-15T01:21:37.075242+0000","last_active":"2023-11-15T01:21:37.078780+0000","last_peered":"2023-11-15T01:21:37.078780+0000","last_clean":"2023-11-15T01:21:37.078780+0000","last_became_active":"2023-11-15T01:21:37.074425+0000","last_became_peered":"2023-11-15T01:21:37.074425+0000","last_unstale":"2023-11-15T01:21:37.078780+0000","last_undegraded":"2023-11-15T01:21:37.078780+0000","last_fullsized":"2023-11-15T01:21:37.078780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054580+0000","last_change":"2023-11-15T01:21:36.682853+0000","last_active":"2023-11-15T01:21:37.054580+0000","last_peered":"2023-11-15T01:21:37.054580+0000","last_clean":"2023-11-15T01:21:37.054580+0000","last_became_active":"2023-11-15T01:21:36.682482+0000","last_became_peered":"2023-11-15T01:21:36.682482+0000","last_unstale":"2023-11-15T01:21:37.054580+0000","last_undegraded":"2023-11-15T01:21:37.054580+0000","last_fullsized":"2023-11-15T01:21:37.054580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077027+0000","last_change":"2023-11-15T01:21:37.069868+0000","last_active":"2023-11-15T01:21:37.077027+0000","last_peered":"2023-11-15T01:21:37.077027+0000","last_clean":"2023-11-15T01:21:37.077027+0000","last_became_active":"2023-11-15T01:21:37.069367+0000","last_became_peered":"2023-11-15T01:21:37.069367+0000","last_unstale":"2023-11-15T01:21:37.077027+0000","last_undegraded":"2023-11-15T01:21:37.077027+0000","last_fullsized":"2023-11-15T01:21:37.077027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-15T01:21:38.055101+0000","last_change":"2023-11-15T01:21:36.676621+0000","last_active":"2023-11-15T01:21:38.055101+0000","last_peered":"2023-11-15T01:21:38.055101+0000","last_clean":"2023-11-15T01:21:38.055101+0000","last_became_active":"2023-11-15T01:21:36.676340+0000","last_became_peered":"2023-11-15T01:21:36.676340+0000","last_unstale":"2023-11-15T01:21:38.055101+0000","last_undegraded":"2023-11-15T01:21:38.055101+0000","last_fullsized":"2023-11-15T01:21:38.055101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061469+0000","last_change":"2023-11-15T01:21:37.056801+0000","last_active":"2023-11-15T01:21:37.061469+0000","last_peered":"2023-11-15T01:21:37.061469+0000","last_clean":"2023-11-15T01:21:37.061469+0000","last_became_active":"2023-11-15T01:21:37.056479+0000","last_became_peered":"2023-11-15T01:21:37.056479+0000","last_unstale":"2023-11-15T01:21:37.061469+0000","last_undegraded":"2023-11-15T01:21:37.061469+0000","last_fullsized":"2023-11-15T01:21:37.061469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061145+0000","last_change":"2023-11-15T01:21:36.677083+0000","last_active":"2023-11-15T01:21:37.061145+0000","last_peered":"2023-11-15T01:21:37.061145+0000","last_clean":"2023-11-15T01:21:37.061145+0000","last_became_active":"2023-11-15T01:21:36.675792+0000","last_became_peered":"2023-11-15T01:21:36.675792+0000","last_unstale":"2023-11-15T01:21:37.061145+0000","last_undegraded":"2023-11-15T01:21:37.061145+0000","last_fullsized":"2023-11-15T01:21:37.061145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.080375+0000","last_change":"2023-11-15T01:21:37.079437+0000","last_active":"2023-11-15T01:21:37.080375+0000","last_peered":"2023-11-15T01:21:37.080375+0000","last_clean":"2023-11-15T01:21:37.080375+0000","last_became_active":"2023-11-15T01:21:37.079183+0000","last_became_peered":"2023-11-15T01:21:37.079183+0000","last_unstale":"2023-11-15T01:21:37.080375+0000","last_undegraded":"2023-11-15T01:21:37.080375+0000","last_fullsized":"2023-11-15T01:21:37.080375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.057734+0000","last_change":"2023-11-15T01:21:36.674125+0000","last_active":"2023-11-15T01:21:37.057734+0000","last_peered":"2023-11-15T01:21:37.057734+0000","last_clean":"2023-11-15T01:21:37.057734+0000","last_became_active":"2023-11-15T01:21:36.673791+0000","last_became_peered":"2023-11-15T01:21:36.673791+0000","last_unstale":"2023-11-15T01:21:37.057734+0000","last_undegraded":"2023-11-15T01:21:37.057734+0000","last_fullsized":"2023-11-15T01:21:37.057734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075073+0000","last_change":"2023-11-15T01:21:37.069603+0000","last_active":"2023-11-15T01:21:37.075073+0000","last_peered":"2023-11-15T01:21:37.075073+0000","last_clean":"2023-11-15T01:21:37.075073+0000","last_became_active":"2023-11-15T01:21:37.069301+0000","last_became_peered":"2023-11-15T01:21:37.069301+0000","last_unstale":"2023-11-15T01:21:37.075073+0000","last_undegraded":"2023-11-15T01:21:37.075073+0000","last_fullsized":"2023-11-15T01:21:37.075073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060017+0000","last_change":"2023-11-15T01:21:36.676838+0000","last_active":"2023-11-15T01:21:37.060017+0000","last_peered":"2023-11-15T01:21:37.060017+0000","last_clean":"2023-11-15T01:21:37.060017+0000","last_became_active":"2023-11-15T01:21:36.676039+0000","last_became_peered":"2023-11-15T01:21:36.676039+0000","last_unstale":"2023-11-15T01:21:37.060017+0000","last_undegraded":"2023-11-15T01:21:37.060017+0000","last_fullsized":"2023-11-15T01:21:37.060017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060317+0000","last_change":"2023-11-15T01:21:37.056702+0000","last_active":"2023-11-15T01:21:37.060317+0000","last_peered":"2023-11-15T01:21:37.060317+0000","last_clean":"2023-11-15T01:21:37.060317+0000","last_became_active":"2023-11-15T01:21:37.056436+0000","last_became_peered":"2023-11-15T01:21:37.056436+0000","last_unstale":"2023-11-15T01:21:37.060317+0000","last_undegraded":"2023-11-15T01:21:37.060317+0000","last_fullsized":"2023-11-15T01:21:37.060317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.058643+0000","last_change":"2023-11-15T01:21:36.678350+0000","last_active":"2023-11-15T01:21:37.058643+0000","last_peered":"2023-11-15T01:21:37.058643+0000","last_clean":"2023-11-15T01:21:37.058643+0000","last_became_active":"2023-11-15T01:21:36.678106+0000","last_became_peered":"2023-11-15T01:21:36.678106+0000","last_unstale":"2023-11-15T01:21:37.058643+0000","last_undegraded":"2023-11-15T01:21:37.058643+0000","last_fullsized":"2023-11-15T01:21:37.058643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075725+0000","last_change":"2023-11-15T01:21:37.071814+0000","last_active":"2023-11-15T01:21:37.075725+0000","last_peered":"2023-11-15T01:21:37.075725+0000","last_clean":"2023-11-15T01:21:37.075725+0000","last_became_active":"2023-11-15T01:21:37.071482+0000","last_became_peered":"2023-11-15T01:21:37.071482+0000","last_unstale":"2023-11-15T01:21:37.075725+0000","last_undegraded":"2023-11-15T01:21:37.075725+0000","last_fullsized":"2023-11-15T01:21:37.075725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076465+0000","last_change":"2023-11-15T01:21:36.680865+0000","last_active":"2023-11-15T01:21:37.076465+0000","last_peered":"2023-11-15T01:21:37.076465+0000","last_clean":"2023-11-15T01:21:37.076465+0000","last_became_active":"2023-11-15T01:21:36.680498+0000","last_became_peered":"2023-11-15T01:21:36.680498+0000","last_unstale":"2023-11-15T01:21:37.076465+0000","last_undegraded":"2023-11-15T01:21:37.076465+0000","last_fullsized":"2023-11-15T01:21:37.076465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081144+0000","last_change":"2023-11-15T01:21:37.076900+0000","last_active":"2023-11-15T01:21:37.081144+0000","last_peered":"2023-11-15T01:21:37.081144+0000","last_clean":"2023-11-15T01:21:37.081144+0000","last_became_active":"2023-11-15T01:21:37.076617+0000","last_became_peered":"2023-11-15T01:21:37.076617+0000","last_unstale":"2023-11-15T01:21:37.081144+0000","last_undegraded":"2023-11-15T01:21:37.081144+0000","last_fullsized":"2023-11-15T01:21:37.081144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053970+0000","last_change":"2023-11-15T01:21:36.677040+0000","last_active":"2023-11-15T01:21:37.053970+0000","last_peered":"2023-11-15T01:21:37.053970+0000","last_clean":"2023-11-15T01:21:37.053970+0000","last_became_active":"2023-11-15T01:21:36.676736+0000","last_became_peered":"2023-11-15T01:21:36.676736+0000","last_unstale":"2023-11-15T01:21:37.053970+0000","last_undegraded":"2023-11-15T01:21:37.053970+0000","last_fullsized":"2023-11-15T01:21:37.053970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075883+0000","last_change":"2023-11-15T01:21:37.068055+0000","last_active":"2023-11-15T01:21:37.075883+0000","last_peered":"2023-11-15T01:21:37.075883+0000","last_clean":"2023-11-15T01:21:37.075883+0000","last_became_active":"2023-11-15T01:21:37.067786+0000","last_became_peered":"2023-11-15T01:21:37.067786+0000","last_unstale":"2023-11-15T01:21:37.075883+0000","last_undegraded":"2023-11-15T01:21:37.075883+0000","last_fullsized":"2023-11-15T01:21:37.075883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076413+0000","last_change":"2023-11-15T01:21:36.675927+0000","last_active":"2023-11-15T01:21:37.076413+0000","last_peered":"2023-11-15T01:21:37.076413+0000","last_clean":"2023-11-15T01:21:37.076413+0000","last_became_active":"2023-11-15T01:21:36.675286+0000","last_became_peered":"2023-11-15T01:21:36.675286+0000","last_unstale":"2023-11-15T01:21:37.076413+0000","last_undegraded":"2023-11-15T01:21:37.076413+0000","last_fullsized":"2023-11-15T01:21:37.076413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.077009+0000","last_change":"2023-11-15T01:21:37.069678+0000","last_active":"2023-11-15T01:21:37.077009+0000","last_peered":"2023-11-15T01:21:37.077009+0000","last_clean":"2023-11-15T01:21:37.077009+0000","last_became_active":"2023-11-15T01:21:37.069017+0000","last_became_peered":"2023-11-15T01:21:37.069017+0000","last_unstale":"2023-11-15T01:21:37.077009+0000","last_undegraded":"2023-11-15T01:21:37.077009+0000","last_fullsized":"2023-11-15T01:21:37.077009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.050814+0000","last_change":"2023-11-15T01:21:36.672474+0000","last_active":"2023-11-15T01:21:37.050814+0000","last_peered":"2023-11-15T01:21:37.050814+0000","last_clean":"2023-11-15T01:21:37.050814+0000","last_became_active":"2023-11-15T01:21:36.672186+0000","last_became_peered":"2023-11-15T01:21:36.672186+0000","last_unstale":"2023-11-15T01:21:37.050814+0000","last_undegraded":"2023-11-15T01:21:37.050814+0000","last_fullsized":"2023-11-15T01:21:37.050814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078455+0000","last_change":"2023-11-15T01:21:37.074607+0000","last_active":"2023-11-15T01:21:37.078455+0000","last_peered":"2023-11-15T01:21:37.078455+0000","last_clean":"2023-11-15T01:21:37.078455+0000","last_became_active":"2023-11-15T01:21:37.074310+0000","last_became_peered":"2023-11-15T01:21:37.074310+0000","last_unstale":"2023-11-15T01:21:37.078455+0000","last_undegraded":"2023-11-15T01:21:37.078455+0000","last_fullsized":"2023-11-15T01:21:37.078455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060400+0000","last_change":"2023-11-15T01:21:36.677133+0000","last_active":"2023-11-15T01:21:37.060400+0000","last_peered":"2023-11-15T01:21:37.060400+0000","last_clean":"2023-11-15T01:21:37.060400+0000","last_became_active":"2023-11-15T01:21:36.676843+0000","last_became_peered":"2023-11-15T01:21:36.676843+0000","last_unstale":"2023-11-15T01:21:37.060400+0000","last_undegraded":"2023-11-15T01:21:37.060400+0000","last_fullsized":"2023-11-15T01:21:37.060400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079526+0000","last_change":"2023-11-15T01:21:37.075385+0000","last_active":"2023-11-15T01:21:37.079526+0000","last_peered":"2023-11-15T01:21:37.079526+0000","last_clean":"2023-11-15T01:21:37.079526+0000","last_became_active":"2023-11-15T01:21:37.075019+0000","last_became_peered":"2023-11-15T01:21:37.075019+0000","last_unstale":"2023-11-15T01:21:37.079526+0000","last_undegraded":"2023-11-15T01:21:37.079526+0000","last_fullsized":"2023-11-15T01:21:37.079526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.067378+0000","last_change":"2023-11-15T01:21:36.674279+0000","last_active":"2023-11-15T01:21:37.067378+0000","last_peered":"2023-11-15T01:21:37.067378+0000","last_clean":"2023-11-15T01:21:37.067378+0000","last_became_active":"2023-11-15T01:21:36.673988+0000","last_became_peered":"2023-11-15T01:21:36.673988+0000","last_unstale":"2023-11-15T01:21:37.067378+0000","last_undegraded":"2023-11-15T01:21:37.067378+0000","last_fullsized":"2023-11-15T01:21:37.067378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.069329+0000","last_change":"2023-11-15T01:21:37.065238+0000","last_active":"2023-11-15T01:21:37.069329+0000","last_peered":"2023-11-15T01:21:37.069329+0000","last_clean":"2023-11-15T01:21:37.069329+0000","last_became_active":"2023-11-15T01:21:37.064939+0000","last_became_peered":"2023-11-15T01:21:37.064939+0000","last_unstale":"2023-11-15T01:21:37.069329+0000","last_undegraded":"2023-11-15T01:21:37.069329+0000","last_fullsized":"2023-11-15T01:21:37.069329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054633+0000","last_change":"2023-11-15T01:21:36.683715+0000","last_active":"2023-11-15T01:21:37.054633+0000","last_peered":"2023-11-15T01:21:37.054633+0000","last_clean":"2023-11-15T01:21:37.054633+0000","last_became_active":"2023-11-15T01:21:36.683268+0000","last_became_peered":"2023-11-15T01:21:36.683268+0000","last_unstale":"2023-11-15T01:21:37.054633+0000","last_undegraded":"2023-11-15T01:21:37.054633+0000","last_fullsized":"2023-11-15T01:21:37.054633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075490+0000","last_change":"2023-11-15T01:21:37.070543+0000","last_active":"2023-11-15T01:21:37.075490+0000","last_peered":"2023-11-15T01:21:37.075490+0000","last_clean":"2023-11-15T01:21:37.075490+0000","last_became_active":"2023-11-15T01:21:37.069750+0000","last_became_peered":"2023-11-15T01:21:37.069750+0000","last_unstale":"2023-11-15T01:21:37.075490+0000","last_undegraded":"2023-11-15T01:21:37.075490+0000","last_fullsized":"2023-11-15T01:21:37.075490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051998+0000","last_change":"2023-11-15T01:21:36.677974+0000","last_active":"2023-11-15T01:21:37.051998+0000","last_peered":"2023-11-15T01:21:37.051998+0000","last_clean":"2023-11-15T01:21:37.051998+0000","last_became_active":"2023-11-15T01:21:36.677594+0000","last_became_peered":"2023-11-15T01:21:36.677594+0000","last_unstale":"2023-11-15T01:21:37.051998+0000","last_undegraded":"2023-11-15T01:21:37.051998+0000","last_fullsized":"2023-11-15T01:21:37.051998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072732+0000","last_change":"2023-11-15T01:21:37.070356+0000","last_active":"2023-11-15T01:21:37.072732+0000","last_peered":"2023-11-15T01:21:37.072732+0000","last_clean":"2023-11-15T01:21:37.072732+0000","last_became_active":"2023-11-15T01:21:37.070072+0000","last_became_peered":"2023-11-15T01:21:37.070072+0000","last_unstale":"2023-11-15T01:21:37.072732+0000","last_undegraded":"2023-11-15T01:21:37.072732+0000","last_fullsized":"2023-11-15T01:21:37.072732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076470+0000","last_change":"2023-11-15T01:21:36.671536+0000","last_active":"2023-11-15T01:21:37.076470+0000","last_peered":"2023-11-15T01:21:37.076470+0000","last_clean":"2023-11-15T01:21:37.076470+0000","last_became_active":"2023-11-15T01:21:36.671247+0000","last_became_peered":"2023-11-15T01:21:36.671247+0000","last_unstale":"2023-11-15T01:21:37.076470+0000","last_undegraded":"2023-11-15T01:21:37.076470+0000","last_fullsized":"2023-11-15T01:21:37.076470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072659+0000","last_change":"2023-11-15T01:21:37.069675+0000","last_active":"2023-11-15T01:21:37.072659+0000","last_peered":"2023-11-15T01:21:37.072659+0000","last_clean":"2023-11-15T01:21:37.072659+0000","last_became_active":"2023-11-15T01:21:37.069397+0000","last_became_peered":"2023-11-15T01:21:37.069397+0000","last_unstale":"2023-11-15T01:21:37.072659+0000","last_undegraded":"2023-11-15T01:21:37.072659+0000","last_fullsized":"2023-11-15T01:21:37.072659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.081458+0000","last_change":"2023-11-15T01:21:36.673107+0000","last_active":"2023-11-15T01:21:37.081458+0000","last_peered":"2023-11-15T01:21:37.081458+0000","last_clean":"2023-11-15T01:21:37.081458+0000","last_became_active":"2023-11-15T01:21:36.672803+0000","last_became_peered":"2023-11-15T01:21:36.672803+0000","last_unstale":"2023-11-15T01:21:37.081458+0000","last_undegraded":"2023-11-15T01:21:37.081458+0000","last_fullsized":"2023-11-15T01:21:37.081458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.069571+0000","last_change":"2023-11-15T01:21:37.066878+0000","last_active":"2023-11-15T01:21:37.069571+0000","last_peered":"2023-11-15T01:21:37.069571+0000","last_clean":"2023-11-15T01:21:37.069571+0000","last_became_active":"2023-11-15T01:21:37.066577+0000","last_became_peered":"2023-11-15T01:21:37.066577+0000","last_unstale":"2023-11-15T01:21:37.069571+0000","last_undegraded":"2023-11-15T01:21:37.069571+0000","last_fullsized":"2023-11-15T01:21:37.069571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.054855+0000","last_change":"2023-11-15T01:21:36.681159+0000","last_active":"2023-11-15T01:21:37.054855+0000","last_peered":"2023-11-15T01:21:37.054855+0000","last_clean":"2023-11-15T01:21:37.054855+0000","last_became_active":"2023-11-15T01:21:36.680906+0000","last_became_peered":"2023-11-15T01:21:36.680906+0000","last_unstale":"2023-11-15T01:21:37.054855+0000","last_undegraded":"2023-11-15T01:21:37.054855+0000","last_fullsized":"2023-11-15T01:21:37.054855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078486+0000","last_change":"2023-11-15T01:21:37.074210+0000","last_active":"2023-11-15T01:21:37.078486+0000","last_peered":"2023-11-15T01:21:37.078486+0000","last_clean":"2023-11-15T01:21:37.078486+0000","last_became_active":"2023-11-15T01:21:37.073943+0000","last_became_peered":"2023-11-15T01:21:37.073943+0000","last_unstale":"2023-11-15T01:21:37.078486+0000","last_undegraded":"2023-11-15T01:21:37.078486+0000","last_fullsized":"2023-11-15T01:21:37.078486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.053463+0000","last_change":"2023-11-15T01:21:36.679911+0000","last_active":"2023-11-15T01:21:37.053463+0000","last_peered":"2023-11-15T01:21:37.053463+0000","last_clean":"2023-11-15T01:21:37.053463+0000","last_became_active":"2023-11-15T01:21:36.679272+0000","last_became_peered":"2023-11-15T01:21:36.679272+0000","last_unstale":"2023-11-15T01:21:37.053463+0000","last_undegraded":"2023-11-15T01:21:37.053463+0000","last_fullsized":"2023-11-15T01:21:37.053463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073109+0000","last_change":"2023-11-15T01:21:37.068769+0000","last_active":"2023-11-15T01:21:37.073109+0000","last_peered":"2023-11-15T01:21:37.073109+0000","last_clean":"2023-11-15T01:21:37.073109+0000","last_became_active":"2023-11-15T01:21:37.068495+0000","last_became_peered":"2023-11-15T01:21:37.068495+0000","last_unstale":"2023-11-15T01:21:37.073109+0000","last_undegraded":"2023-11-15T01:21:37.073109+0000","last_fullsized":"2023-11-15T01:21:37.073109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060975+0000","last_change":"2023-11-15T01:21:36.683620+0000","last_active":"2023-11-15T01:21:37.060975+0000","last_peered":"2023-11-15T01:21:37.060975+0000","last_clean":"2023-11-15T01:21:37.060975+0000","last_became_active":"2023-11-15T01:21:36.683315+0000","last_became_peered":"2023-11-15T01:21:36.683315+0000","last_unstale":"2023-11-15T01:21:37.060975+0000","last_undegraded":"2023-11-15T01:21:37.060975+0000","last_fullsized":"2023-11-15T01:21:37.060975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.079966+0000","last_change":"2023-11-15T01:21:37.078896+0000","last_active":"2023-11-15T01:21:37.079966+0000","last_peered":"2023-11-15T01:21:37.079966+0000","last_clean":"2023-11-15T01:21:37.079966+0000","last_became_active":"2023-11-15T01:21:37.078569+0000","last_became_peered":"2023-11-15T01:21:37.078569+0000","last_unstale":"2023-11-15T01:21:37.079966+0000","last_undegraded":"2023-11-15T01:21:37.079966+0000","last_fullsized":"2023-11-15T01:21:37.079966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061034+0000","last_change":"2023-11-15T01:21:36.670706+0000","last_active":"2023-11-15T01:21:37.061034+0000","last_peered":"2023-11-15T01:21:37.061034+0000","last_clean":"2023-11-15T01:21:37.061034+0000","last_became_active":"2023-11-15T01:21:36.670059+0000","last_became_peered":"2023-11-15T01:21:36.670059+0000","last_unstale":"2023-11-15T01:21:37.061034+0000","last_undegraded":"2023-11-15T01:21:37.061034+0000","last_fullsized":"2023-11-15T01:21:37.061034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.071946+0000","last_change":"2023-11-15T01:21:37.067713+0000","last_active":"2023-11-15T01:21:37.071946+0000","last_peered":"2023-11-15T01:21:37.071946+0000","last_clean":"2023-11-15T01:21:37.071946+0000","last_became_active":"2023-11-15T01:21:37.067395+0000","last_became_peered":"2023-11-15T01:21:37.067395+0000","last_unstale":"2023-11-15T01:21:37.071946+0000","last_undegraded":"2023-11-15T01:21:37.071946+0000","last_fullsized":"2023-11-15T01:21:37.071946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.060748+0000","last_change":"2023-11-15T01:21:36.682781+0000","last_active":"2023-11-15T01:21:37.060748+0000","last_peered":"2023-11-15T01:21:37.060748+0000","last_clean":"2023-11-15T01:21:37.060748+0000","last_became_active":"2023-11-15T01:21:36.682480+0000","last_became_peered":"2023-11-15T01:21:36.682480+0000","last_unstale":"2023-11-15T01:21:37.060748+0000","last_undegraded":"2023-11-15T01:21:37.060748+0000","last_fullsized":"2023-11-15T01:21:37.060748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075509+0000","last_change":"2023-11-15T01:21:37.070705+0000","last_active":"2023-11-15T01:21:37.075509+0000","last_peered":"2023-11-15T01:21:37.075509+0000","last_clean":"2023-11-15T01:21:37.075509+0000","last_became_active":"2023-11-15T01:21:37.070269+0000","last_became_peered":"2023-11-15T01:21:37.070269+0000","last_unstale":"2023-11-15T01:21:37.075509+0000","last_undegraded":"2023-11-15T01:21:37.075509+0000","last_fullsized":"2023-11-15T01:21:37.075509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.066310+0000","last_change":"2023-11-15T01:21:36.681917+0000","last_active":"2023-11-15T01:21:37.066310+0000","last_peered":"2023-11-15T01:21:37.066310+0000","last_clean":"2023-11-15T01:21:37.066310+0000","last_became_active":"2023-11-15T01:21:36.681664+0000","last_became_peered":"2023-11-15T01:21:36.681664+0000","last_unstale":"2023-11-15T01:21:37.066310+0000","last_undegraded":"2023-11-15T01:21:37.066310+0000","last_fullsized":"2023-11-15T01:21:37.066310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.061299+0000","last_change":"2023-11-15T01:21:37.056524+0000","last_active":"2023-11-15T01:21:37.061299+0000","last_peered":"2023-11-15T01:21:37.061299+0000","last_clean":"2023-11-15T01:21:37.061299+0000","last_became_active":"2023-11-15T01:21:37.056115+0000","last_became_peered":"2023-11-15T01:21:37.056115+0000","last_unstale":"2023-11-15T01:21:37.061299+0000","last_undegraded":"2023-11-15T01:21:37.061299+0000","last_fullsized":"2023-11-15T01:21:37.061299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076222+0000","last_change":"2023-11-15T01:21:36.675434+0000","last_active":"2023-11-15T01:21:37.076222+0000","last_peered":"2023-11-15T01:21:37.076222+0000","last_clean":"2023-11-15T01:21:37.076222+0000","last_became_active":"2023-11-15T01:21:36.675152+0000","last_became_peered":"2023-11-15T01:21:36.675152+0000","last_unstale":"2023-11-15T01:21:37.076222+0000","last_undegraded":"2023-11-15T01:21:37.076222+0000","last_fullsized":"2023-11-15T01:21:37.076222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.080142+0000","last_change":"2023-11-15T01:21:37.077249+0000","last_active":"2023-11-15T01:21:37.080142+0000","last_peered":"2023-11-15T01:21:37.080142+0000","last_clean":"2023-11-15T01:21:37.080142+0000","last_became_active":"2023-11-15T01:21:37.077009+0000","last_became_peered":"2023-11-15T01:21:37.077009+0000","last_unstale":"2023-11-15T01:21:37.080142+0000","last_undegraded":"2023-11-15T01:21:37.080142+0000","last_fullsized":"2023-11-15T01:21:37.080142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.072218+0000","last_change":"2023-11-15T01:21:36.675491+0000","last_active":"2023-11-15T01:21:37.072218+0000","last_peered":"2023-11-15T01:21:37.072218+0000","last_clean":"2023-11-15T01:21:37.072218+0000","last_became_active":"2023-11-15T01:21:36.673535+0000","last_became_peered":"2023-11-15T01:21:36.673535+0000","last_unstale":"2023-11-15T01:21:37.072218+0000","last_undegraded":"2023-11-15T01:21:37.072218+0000","last_fullsized":"2023-11-15T01:21:37.072218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.075938+0000","last_change":"2023-11-15T01:21:37.072360+0000","last_active":"2023-11-15T01:21:37.075938+0000","last_peered":"2023-11-15T01:21:37.075938+0000","last_clean":"2023-11-15T01:21:37.075938+0000","last_became_active":"2023-11-15T01:21:37.070013+0000","last_became_peered":"2023-11-15T01:21:37.070013+0000","last_unstale":"2023-11-15T01:21:37.075938+0000","last_undegraded":"2023-11-15T01:21:37.075938+0000","last_fullsized":"2023-11-15T01:21:37.075938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.051462+0000","last_change":"2023-11-15T01:21:36.674145+0000","last_active":"2023-11-15T01:21:37.051462+0000","last_peered":"2023-11-15T01:21:37.051462+0000","last_clean":"2023-11-15T01:21:37.051462+0000","last_became_active":"2023-11-15T01:21:36.673862+0000","last_became_peered":"2023-11-15T01:21:36.673862+0000","last_unstale":"2023-11-15T01:21:37.051462+0000","last_undegraded":"2023-11-15T01:21:37.051462+0000","last_fullsized":"2023-11-15T01:21:37.051462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.078508+0000","last_change":"2023-11-15T01:21:37.074359+0000","last_active":"2023-11-15T01:21:37.078508+0000","last_peered":"2023-11-15T01:21:37.078508+0000","last_clean":"2023-11-15T01:21:37.078508+0000","last_became_active":"2023-11-15T01:21:37.073936+0000","last_became_peered":"2023-11-15T01:21:37.073936+0000","last_unstale":"2023-11-15T01:21:37.078508+0000","last_undegraded":"2023-11-15T01:21:37.078508+0000","last_fullsized":"2023-11-15T01:21:37.078508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.055113+0000","last_change":"2023-11-15T01:21:36.681422+0000","last_active":"2023-11-15T01:21:37.055113+0000","last_peered":"2023-11-15T01:21:37.055113+0000","last_clean":"2023-11-15T01:21:37.055113+0000","last_became_active":"2023-11-15T01:21:36.680717+0000","last_became_peered":"2023-11-15T01:21:36.680717+0000","last_unstale":"2023-11-15T01:21:37.055113+0000","last_undegraded":"2023-11-15T01:21:37.055113+0000","last_fullsized":"2023-11-15T01:21:37.055113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.073014+0000","last_change":"2023-11-15T01:21:37.071820+0000","last_active":"2023-11-15T01:21:37.073014+0000","last_peered":"2023-11-15T01:21:37.073014+0000","last_clean":"2023-11-15T01:21:37.073014+0000","last_became_active":"2023-11-15T01:21:37.071521+0000","last_became_peered":"2023-11-15T01:21:37.071521+0000","last_unstale":"2023-11-15T01:21:37.073014+0000","last_undegraded":"2023-11-15T01:21:37.073014+0000","last_fullsized":"2023-11-15T01:21:37.073014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:36.650201+0000","last_clean_scrub_stamp":"2023-11-15T01:21:36.650201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-15T01:21:37.076301+0000","last_change":"2023-11-15T01:21:36.676437+0000","last_active":"2023-11-15T01:21:37.076301+0000","last_peered":"2023-11-15T01:21:37.076301+0000","last_clean":"2023-11-15T01:21:37.076301+0000","last_became_active":"2023-11-15T01:21:36.676128+0000","last_became_peered":"2023-11-15T01:21:36.676128+0000","last_unstale":"2023-11-15T01:21:37.076301+0000","last_undegraded":"2023-11-15T01:21:37.076301+0000","last_fullsized":"2023-11-15T01:21:37.076301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:35.647916+0000","last_clean_scrub_stamp":"2023-11-15T01:21:35.647916+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297348,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074492,"statfs":{"total":96636764160,"available":96332279808,"internally_reserved":0,"allocated":258048,"data_stored":86755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297340,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074500,"statfs":{"total":96636764160,"available":96332288000,"internally_reserved":0,"allocated":249856,"data_stored":86933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:21:48.293 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-15T01:21:48.293 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-15T01:21:48.294 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-15T01:21:48.294 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-15T01:21:48.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.441+0000 7f29b6967700 1 Processor -- start 2023-11-15T01:21:48.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.441+0000 7f29b6967700 1 -- start start 2023-11-15T01:21:48.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.442+0000 7f29b6967700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29b01548c0 0x7f29b00bc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.442+0000 7f29b6967700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b00c2ea0 con 0x7f29b0151d50 2023-11-15T01:21:48.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.442+0000 7f29b6967700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b00bcdd0 con 0x7f29b00bc940 2023-11-15T01:21:48.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.442+0000 7f29b6967700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00c4ed0 con 0x7f29b01548c0 2023-11-15T01:21:48.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.442+0000 7f29affff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f29b0151d50 0x7f29b00c1ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41526/0 (socket says 172.21.15.1:41526) 2023-11-15T01:21:48.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.442+0000 7f29affff700 1 -- 172.21.15.1:0/431486314 learned_addr learned my addr 172.21.15.1:0/431486314 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:48.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.442+0000 7f29af7fe700 1 --2- 172.21.15.1:0/431486314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29b01548c0 0x7f29b00bc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.443+0000 7f29aeffd700 1 -- 172.21.15.1:0/431486314 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860295479 0 0) 0x7f29b00c2ea0 con 0x7f29b0151d50 2023-11-15T01:21:48.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.443+0000 7f29aeffd700 1 -- 172.21.15.1:0/431486314 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f299c0033f0 con 0x7f29b0151d50 2023-11-15T01:21:48.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.443+0000 7f29aeffd700 1 -- 172.21.15.1:0/431486314 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575101235 0 0) 0x7f29b00bcdd0 con 0x7f29b00bc940 2023-11-15T01:21:48.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.443+0000 7f29aeffd700 1 -- 172.21.15.1:0/431486314 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b00c2ea0 con 0x7f29b00bc940 2023-11-15T01:21:48.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.443+0000 7f29af7fe700 1 -- 172.21.15.1:0/431486314 >> v1:172.21.15.141:6789/0 conn(0x7f29b00bc940 legacy=0x7f29b0065dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.443+0000 7f29af7fe700 1 -- 172.21.15.1:0/431486314 >> v1:172.21.15.1:6789/0 conn(0x7f29b0151d50 legacy=0x7f29b00c1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.443+0000 7f29af7fe700 1 -- 172.21.15.1:0/431486314 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00c2290 con 0x7f29b01548c0 2023-11-15T01:21:48.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.443+0000 7f29af7fe700 1 --2- 172.21.15.1:0/431486314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29b01548c0 0x7f29b00bc450 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f29a0009790 tx=0x7f29a0009060).ready entity=mon.2 client_cookie=ce36defcaffb0e80 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:48.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.443+0000 7f29aeffd700 1 -- 172.21.15.1:0/431486314 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a000f510 con 0x7f29b01548c0 2023-11-15T01:21:48.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.443+0000 7f29aeffd700 1 -- 172.21.15.1:0/431486314 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a000f670 con 0x7f29b01548c0 2023-11-15T01:21:48.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.443+0000 7f29aeffd700 1 -- 172.21.15.1:0/431486314 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a000f9f0 con 0x7f29b01548c0 2023-11-15T01:21:48.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.444+0000 7f29b6967700 1 -- 172.21.15.1:0/431486314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29b01548c0 msgr2=0x7f29b00bc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.444+0000 7f29b6967700 1 --2- 172.21.15.1:0/431486314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29b01548c0 0x7f29b00bc450 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f29a0009790 tx=0x7f29a0009060).stop 2023-11-15T01:21:48.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.444+0000 7f29b6967700 1 -- 172.21.15.1:0/431486314 shutdown_connections 2023-11-15T01:21:48.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.444+0000 7f29b6967700 1 --2- 172.21.15.1:0/431486314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29b01548c0 0x7f29b00bc450 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.444+0000 7f29b6967700 1 -- 172.21.15.1:0/431486314 >> 172.21.15.1:0/431486314 conn(0x7f29b00c7fa0 msgr2=0x7f29b00c3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:48.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.444+0000 7f29b6967700 1 -- 172.21.15.1:0/431486314 shutdown_connections 2023-11-15T01:21:48.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.444+0000 7f29b6967700 1 -- 172.21.15.1:0/431486314 wait complete. 2023-11-15T01:21:48.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.445+0000 7f29b6967700 1 Processor -- start 2023-11-15T01:21:48.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.445+0000 7f29b6967700 1 -- start start 2023-11-15T01:21:48.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29b6967700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29b00bc940 0x7f29b0141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29b6967700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29b0151d50 0x7f29b00ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29b6967700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29b01548c0 0x7f29b00acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29b6967700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00c0230 con 0x7f29b00bc940 2023-11-15T01:21:48.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29b6967700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00bf620 con 0x7f29b01548c0 2023-11-15T01:21:48.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29b6967700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00bf900 con 0x7f29b0151d50 2023-11-15T01:21:48.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29affff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29b00bc940 0x7f29b0141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29affff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29b00bc940 0x7f29b0141ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37082/0 (socket says 172.21.15.1:37082) 2023-11-15T01:21:48.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29affff700 1 -- 172.21.15.1:0/3820556692 learned_addr learned my addr 172.21.15.1:0/3820556692 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:48.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29af7fe700 1 --2- 172.21.15.1:0/3820556692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29b0151d50 0x7f29b00ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29b4f04700 1 --2- 172.21.15.1:0/3820556692 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29b01548c0 0x7f29b00acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29affff700 1 -- 172.21.15.1:0/3820556692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29b0151d50 msgr2=0x7f29b00ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29affff700 1 --2- 172.21.15.1:0/3820556692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29b0151d50 0x7f29b00ac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29affff700 1 -- 172.21.15.1:0/3820556692 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29b01548c0 msgr2=0x7f29b00acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29affff700 1 --2- 172.21.15.1:0/3820556692 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29b01548c0 0x7f29b00acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29affff700 1 -- 172.21.15.1:0/3820556692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a00092a0 con 0x7f29b00bc940 2023-11-15T01:21:48.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.446+0000 7f29affff700 1 --2- 172.21.15.1:0/3820556692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29b00bc940 0x7f29b0141ab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f299800c490 tx=0x7f2998007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:48.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.447+0000 7f29a7fff700 1 -- 172.21.15.1:0/3820556692 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29980070d0 con 0x7f29b00bc940 2023-11-15T01:21:48.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.447+0000 7f29a7fff700 1 -- 172.21.15.1:0/3820556692 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2998007230 con 0x7f29b00bc940 2023-11-15T01:21:48.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.447+0000 7f29b6967700 1 -- 172.21.15.1:0/3820556692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b00bfbe0 con 0x7f29b00bc940 2023-11-15T01:21:48.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.447+0000 7f29a7fff700 1 -- 172.21.15.1:0/3820556692 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29980075b0 con 0x7f29b00bc940 2023-11-15T01:21:48.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.447+0000 7f29b6967700 1 -- 172.21.15.1:0/3820556692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b00bf2d0 con 0x7f29b00bc940 2023-11-15T01:21:48.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.448+0000 7f29b6967700 1 -- 172.21.15.1:0/3820556692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b006c7e0 con 0x7f29b00bc940 2023-11-15T01:21:48.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.448+0000 7f29a7fff700 1 -- 172.21.15.1:0/3820556692 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f29980059b0 con 0x7f29b00bc940 2023-11-15T01:21:48.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.448+0000 7f29a7fff700 1 --2- 172.21.15.1:0/3820556692 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f299005f150 0x7f2990061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.448+0000 7f29a7fff700 1 -- 172.21.15.1:0/3820556692 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2998079850 con 0x7f29b00bc940 2023-11-15T01:21:48.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.449+0000 7f29af7fe700 1 --2- 172.21.15.1:0/3820556692 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f299005f150 0x7f2990061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.449+0000 7f29af7fe700 1 --2- 172.21.15.1:0/3820556692 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f299005f150 0x7f2990061610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f29a0009fd0 tx=0x7f29a0017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:48.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.452+0000 7f29a7fff700 1 -- 172.21.15.1:0/3820556692 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f299804ab20 con 0x7f29b00bc940 2023-11-15T01:21:48.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.665+0000 7f29b6967700 1 -- 172.21.15.1:0/3820556692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f29b00c47c0 con 0x7f29b00bc940 2023-11-15T01:21:48.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.666+0000 7f29a7fff700 1 -- 172.21.15.1:0/3820556692 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f299804e140 con 0x7f29b00bc940 2023-11-15T01:21:48.667 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:48.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.668+0000 7f29b6967700 1 -- 172.21.15.1:0/3820556692 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f299005f150 msgr2=0x7f2990061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.668+0000 7f29b6967700 1 --2- 172.21.15.1:0/3820556692 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f299005f150 0x7f2990061610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f29a0009fd0 tx=0x7f29a0017000).stop 2023-11-15T01:21:48.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.668+0000 7f29b6967700 1 -- 172.21.15.1:0/3820556692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29b00bc940 msgr2=0x7f29b0141ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.668+0000 7f29b6967700 1 --2- 172.21.15.1:0/3820556692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29b00bc940 0x7f29b0141ab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f299800c490 tx=0x7f2998007d20).stop 2023-11-15T01:21:48.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.668+0000 7f29b6967700 1 -- 172.21.15.1:0/3820556692 shutdown_connections 2023-11-15T01:21:48.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.668+0000 7f29b6967700 1 --2- 172.21.15.1:0/3820556692 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f299005f150 0x7f2990061610 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.668+0000 7f29b6967700 1 --2- 172.21.15.1:0/3820556692 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29b01548c0 0x7f29b00acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.668+0000 7f29b6967700 1 --2- 172.21.15.1:0/3820556692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29b00bc940 0x7f29b0141ab0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.668+0000 7f29b6967700 1 --2- 172.21.15.1:0/3820556692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29b0151d50 0x7f29b00ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.668+0000 7f29b6967700 1 -- 172.21.15.1:0/3820556692 >> 172.21.15.1:0/3820556692 conn(0x7f29b00c7fa0 msgr2=0x7f29b00c5400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:48.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.668+0000 7f29b6967700 1 -- 172.21.15.1:0/3820556692 shutdown_connections 2023-11-15T01:21:48.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.668+0000 7f29b6967700 1 -- 172.21.15.1:0/3820556692 wait complete. 2023-11-15T01:21:48.680 INFO:teuthology.orchestra.run.smithi001.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-15T01:21:48.680 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-15T01:21:48.681 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:21:48.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.798+0000 7f91ba187700 1 Processor -- start 2023-11-15T01:21:48.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.798+0000 7f91ba187700 1 -- start start 2023-11-15T01:21:48.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91ba187700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f91b4155790 0x7f91b40a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91ba187700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91b40a61b0 0x7f91b40bee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91ba187700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b4083630 con 0x7f91b4155b70 2023-11-15T01:21:48.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91ba187700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b40c5420 con 0x7f91b4155790 2023-11-15T01:21:48.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91ba187700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40c7c90 con 0x7f91b40a61b0 2023-11-15T01:21:48.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91b37fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f91b4155790 0x7f91b40a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91b3fff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91b40a61b0 0x7f91b40bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91b37fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f91b4155790 0x7f91b40a5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:42962/0 (socket says 172.21.15.1:42962) 2023-11-15T01:21:48.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91b3fff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91b40a61b0 0x7f91b40bee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:49030/0 (socket says 172.21.15.1:49030) 2023-11-15T01:21:48.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91b37fe700 1 -- 172.21.15.1:0/3170153688 learned_addr learned my addr 172.21.15.1:0/3170153688 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:48.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91b2ffd700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f91b4155b70 0x7f91b40c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:39150/0 (socket says 172.21.15.1:39150) 2023-11-15T01:21:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91b37fe700 1 -- 172.21.15.1:0/3170153688 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91b40a61b0 msgr2=0x7f91b40bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91b37fe700 1 --2- 172.21.15.1:0/3170153688 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91b40a61b0 0x7f91b40bee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91b37fe700 1 -- 172.21.15.1:0/3170153688 >> v1:172.21.15.141:6789/0 conn(0x7f91b4155b70 legacy=0x7f91b40c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91b37fe700 1 -- 172.21.15.1:0/3170153688 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b40c7960 con 0x7f91b4155790 2023-11-15T01:21:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.799+0000 7f91b3fff700 1 --2- 172.21.15.1:0/3170153688 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91b40a61b0 0x7f91b40bee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:48.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.800+0000 7f91b37fe700 1 --2- 172.21.15.1:0/3170153688 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91b4155790 0x7f91b40a5cc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f91a4009810 tx=0x7f91a4009060).ready entity=mon.1 client_cookie=2d1c99352cab19e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:48.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.800+0000 7f91b27fc700 1 -- 172.21.15.1:0/3170153688 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4005880 con 0x7f91b4155790 2023-11-15T01:21:48.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.800+0000 7f91b27fc700 1 -- 172.21.15.1:0/3170153688 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a40059e0 con 0x7f91b4155790 2023-11-15T01:21:48.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.800+0000 7f91b27fc700 1 -- 172.21.15.1:0/3170153688 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4005d60 con 0x7f91b4155790 2023-11-15T01:21:48.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.800+0000 7f91ba187700 1 -- 172.21.15.1:0/3170153688 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91b4155790 msgr2=0x7f91b40a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.800+0000 7f91ba187700 1 --2- 172.21.15.1:0/3170153688 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91b4155790 0x7f91b40a5cc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f91a4009810 tx=0x7f91a4009060).stop 2023-11-15T01:21:48.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.800+0000 7f91ba187700 1 -- 172.21.15.1:0/3170153688 shutdown_connections 2023-11-15T01:21:48.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.800+0000 7f91ba187700 1 --2- 172.21.15.1:0/3170153688 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91b40a61b0 0x7f91b40bee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.800+0000 7f91ba187700 1 --2- 172.21.15.1:0/3170153688 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91b4155790 0x7f91b40a5cc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.800+0000 7f91ba187700 1 -- 172.21.15.1:0/3170153688 >> 172.21.15.1:0/3170153688 conn(0x7f91b4082f90 msgr2=0x7f91b40c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:48.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.800+0000 7f91ba187700 1 -- 172.21.15.1:0/3170153688 shutdown_connections 2023-11-15T01:21:48.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.800+0000 7f91ba187700 1 -- 172.21.15.1:0/3170153688 wait complete. 2023-11-15T01:21:48.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.801+0000 7f91ba187700 1 Processor -- start 2023-11-15T01:21:48.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.802+0000 7f91ba187700 1 -- start start 2023-11-15T01:21:48.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.802+0000 7f91ba187700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91b40a61b0 0x7f91b414be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.802+0000 7f91ba187700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4155790 0x7f91b40aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.802+0000 7f91ba187700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91b4155b70 0x7f91b40aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.802+0000 7f91ba187700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40ab420 con 0x7f91b4155790 2023-11-15T01:21:48.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.802+0000 7f91ba187700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b414ce40 con 0x7f91b4155b70 2023-11-15T01:21:48.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.802+0000 7f91ba187700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b414c2f0 con 0x7f91b40a61b0 2023-11-15T01:21:48.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.802+0000 7f91b2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4155790 0x7f91b40aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.802+0000 7f91b2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4155790 0x7f91b40aaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37094/0 (socket says 172.21.15.1:37094) 2023-11-15T01:21:48.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.802+0000 7f91b2ffd700 1 -- 172.21.15.1:0/1111009904 learned_addr learned my addr 172.21.15.1:0/1111009904 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:48.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.803+0000 7f91b3fff700 1 --2- 172.21.15.1:0/1111009904 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91b4155b70 0x7f91b40aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.803+0000 7f91b37fe700 1 --2- 172.21.15.1:0/1111009904 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91b40a61b0 0x7f91b414be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.803+0000 7f91b2ffd700 1 -- 172.21.15.1:0/1111009904 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91b40a61b0 msgr2=0x7f91b414be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.803+0000 7f91b2ffd700 1 --2- 172.21.15.1:0/1111009904 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91b40a61b0 0x7f91b414be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.803+0000 7f91b2ffd700 1 -- 172.21.15.1:0/1111009904 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91b4155b70 msgr2=0x7f91b40aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.803+0000 7f91b2ffd700 1 --2- 172.21.15.1:0/1111009904 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91b4155b70 0x7f91b40aaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.803+0000 7f91b2ffd700 1 -- 172.21.15.1:0/1111009904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac009a20 con 0x7f91b4155790 2023-11-15T01:21:48.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.803+0000 7f91b2ffd700 1 --2- 172.21.15.1:0/1111009904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4155790 0x7f91b40aaa40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f91a800c490 tx=0x7f91a8007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:48.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.803+0000 7f919b7fe700 1 -- 172.21.15.1:0/1111009904 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80072e0 con 0x7f91b4155790 2023-11-15T01:21:48.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.803+0000 7f919b7fe700 1 -- 172.21.15.1:0/1111009904 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a8007440 con 0x7f91b4155790 2023-11-15T01:21:48.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.803+0000 7f91ba187700 1 -- 172.21.15.1:0/1111009904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a4009300 con 0x7f91b4155790 2023-11-15T01:21:48.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.803+0000 7f919b7fe700 1 -- 172.21.15.1:0/1111009904 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80058f0 con 0x7f91b4155790 2023-11-15T01:21:48.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.803+0000 7f91ba187700 1 -- 172.21.15.1:0/1111009904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b4064c70 con 0x7f91b4155790 2023-11-15T01:21:48.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.804+0000 7f91ba187700 1 -- 172.21.15.1:0/1111009904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b406c7e0 con 0x7f91b4155790 2023-11-15T01:21:48.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.804+0000 7f919b7fe700 1 -- 172.21.15.1:0/1111009904 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f91a8005ce0 con 0x7f91b4155790 2023-11-15T01:21:48.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.805+0000 7f919b7fe700 1 --2- 172.21.15.1:0/1111009904 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f91a005f150 0x7f91a0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:48.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.805+0000 7f919b7fe700 1 -- 172.21.15.1:0/1111009904 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f91a80799b0 con 0x7f91b4155790 2023-11-15T01:21:48.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.805+0000 7f91b37fe700 1 --2- 172.21.15.1:0/1111009904 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f91a005f150 0x7f91a0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:48.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.805+0000 7f91b37fe700 1 --2- 172.21.15.1:0/1111009904 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f91a005f150 0x7f91a0061610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f91a400b340 tx=0x7f91a4016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:48.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.809+0000 7f919b7fe700 1 -- 172.21.15.1:0/1111009904 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f91a804ac80 con 0x7f91b4155790 2023-11-15T01:21:48.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.983+0000 7f91ba187700 1 -- 172.21.15.1:0/1111009904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91b40c7490 con 0x7f91b4155790 2023-11-15T01:21:48.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.984+0000 7f919b7fe700 1 -- 172.21.15.1:0/1111009904 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16880 (secure 0 0 0) 0x7f91a804e2a0 con 0x7f91b4155790 2023-11-15T01:21:48.985 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:48.985 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:38.047484+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:21:34.763591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-15T01:21:36.025071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:21:48.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.986+0000 7f91ba187700 1 -- 172.21.15.1:0/1111009904 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f91a005f150 msgr2=0x7f91a0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.986+0000 7f91ba187700 1 --2- 172.21.15.1:0/1111009904 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f91a005f150 0x7f91a0061610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f91a400b340 tx=0x7f91a4016000).stop 2023-11-15T01:21:48.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.986+0000 7f91ba187700 1 -- 172.21.15.1:0/1111009904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4155790 msgr2=0x7f91b40aaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:48.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.986+0000 7f91ba187700 1 --2- 172.21.15.1:0/1111009904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4155790 0x7f91b40aaa40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f91a800c490 tx=0x7f91a8007df0).stop 2023-11-15T01:21:48.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.986+0000 7f91ba187700 1 -- 172.21.15.1:0/1111009904 shutdown_connections 2023-11-15T01:21:48.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.986+0000 7f91ba187700 1 --2- 172.21.15.1:0/1111009904 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f91a005f150 0x7f91a0061610 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.986+0000 7f91ba187700 1 --2- 172.21.15.1:0/1111009904 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91b4155b70 0x7f91b40aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.986+0000 7f91ba187700 1 --2- 172.21.15.1:0/1111009904 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91b40a61b0 0x7f91b414be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.986+0000 7f91ba187700 1 --2- 172.21.15.1:0/1111009904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91b4155790 0x7f91b40aaa40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:48.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.986+0000 7f91ba187700 1 -- 172.21.15.1:0/1111009904 >> 172.21.15.1:0/1111009904 conn(0x7f91b4082f90 msgr2=0x7f91b414ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:48.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.986+0000 7f91ba187700 1 -- 172.21.15.1:0/1111009904 shutdown_connections 2023-11-15T01:21:48.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:48.986+0000 7f91ba187700 1 -- 172.21.15.1:0/1111009904 wait complete. 2023-11-15T01:21:48.999 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T01:21:34.763591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T01:21:36.025071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T01:21:49.000 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:21:49.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.120+0000 7f2a0d4f2700 1 Processor -- start 2023-11-15T01:21:49.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.120+0000 7f2a0d4f2700 1 -- start start 2023-11-15T01:21:49.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.121+0000 7f2a0d4f2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2a080ad790 0x7f2a081555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.121+0000 7f2a0d4f2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a08158150 0x7f2a080c7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.121+0000 7f2a0d4f2700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a080c9210 con 0x7f2a080c7e70 2023-11-15T01:21:49.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.121+0000 7f2a0d4f2700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a080c6440 con 0x7f2a080ad790 2023-11-15T01:21:49.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.121+0000 7f2a0d4f2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08155ab0 con 0x7f2a08158150 2023-11-15T01:21:49.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.121+0000 7f2a06ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2a080ad790 0x7f2a081555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.121+0000 7f2a077fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2a080c7e70 0x7f2a08063550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41536/0 (socket says 172.21.15.1:41536) 2023-11-15T01:21:49.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.121+0000 7f2a077fe700 1 -- 172.21.15.1:0/3069591670 learned_addr learned my addr 172.21.15.1:0/3069591670 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:49.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.121+0000 7f2a06ffd700 1 -- 172.21.15.1:0/3069591670 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a08158150 msgr2=0x7f2a080c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:49.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.121+0000 7f2a06ffd700 1 --2- 172.21.15.1:0/3069591670 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a08158150 0x7f2a080c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:21:49.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.121+0000 7f2a06ffd700 1 -- 172.21.15.1:0/3069591670 >> v1:172.21.15.1:6789/0 conn(0x7f2a080c7e70 legacy=0x7f2a08063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.121+0000 7f2a06ffd700 1 -- 172.21.15.1:0/3069591670 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a08158650 con 0x7f2a080ad790 2023-11-15T01:21:49.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.121+0000 7f2a05ffb700 1 -- 172.21.15.1:0/3069591670 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776559176 0 0) 0x7f2a080c9210 con 0x7f2a080c7e70 2023-11-15T01:21:49.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.121+0000 7f2a06ffd700 1 --2- 172.21.15.1:0/3069591670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a080ad790 0x7f2a081555c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f2a00009e60 tx=0x7f2a00009780).ready entity=mon.0 client_cookie=de4b66e357759cc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:49.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.122+0000 7f2a05ffb700 1 -- 172.21.15.1:0/3069591670 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0000e070 con 0x7f2a080ad790 2023-11-15T01:21:49.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.122+0000 7f2a05ffb700 1 -- 172.21.15.1:0/3069591670 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0000bc30 con 0x7f2a080ad790 2023-11-15T01:21:49.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.122+0000 7f2a05ffb700 1 -- 172.21.15.1:0/3069591670 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a00012410 con 0x7f2a080ad790 2023-11-15T01:21:49.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.122+0000 7f2a0d4f2700 1 -- 172.21.15.1:0/3069591670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a080ad790 msgr2=0x7f2a081555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.122+0000 7f2a0d4f2700 1 --2- 172.21.15.1:0/3069591670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a080ad790 0x7f2a081555c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f2a00009e60 tx=0x7f2a00009780).stop 2023-11-15T01:21:49.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.122+0000 7f2a0d4f2700 1 -- 172.21.15.1:0/3069591670 shutdown_connections 2023-11-15T01:21:49.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.122+0000 7f2a0d4f2700 1 --2- 172.21.15.1:0/3069591670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a080ad790 0x7f2a081555c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.122+0000 7f2a0d4f2700 1 --2- 172.21.15.1:0/3069591670 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a08158150 0x7f2a080c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:21:49.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.122+0000 7f2a0d4f2700 1 -- 172.21.15.1:0/3069591670 >> 172.21.15.1:0/3069591670 conn(0x7f2a08064a90 msgr2=0x7f2a08064ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:49.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.122+0000 7f2a0d4f2700 1 -- 172.21.15.1:0/3069591670 shutdown_connections 2023-11-15T01:21:49.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.122+0000 7f2a0d4f2700 1 -- 172.21.15.1:0/3069591670 wait complete. 2023-11-15T01:21:49.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.123+0000 7f2a0d4f2700 1 Processor -- start 2023-11-15T01:21:49.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.123+0000 7f2a0d4f2700 1 -- start start 2023-11-15T01:21:49.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a0d4f2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a080ad790 0x7f2a080cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a0d4f2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a080c7e70 0x7f2a080b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a0d4f2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a08158150 0x7f2a080af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a0d4f2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a080b11b0 con 0x7f2a080ad790 2023-11-15T01:21:49.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a0d4f2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a080b0830 con 0x7f2a080c7e70 2023-11-15T01:21:49.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a0d4f2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a080afc20 con 0x7f2a08158150 2023-11-15T01:21:49.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a06ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a080ad790 0x7f2a080cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a06ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a080ad790 0x7f2a080cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37114/0 (socket says 172.21.15.1:37114) 2023-11-15T01:21:49.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a06ffd700 1 -- 172.21.15.1:0/1038223051 learned_addr learned my addr 172.21.15.1:0/1038223051 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:49.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a067fc700 1 --2- 172.21.15.1:0/1038223051 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a080c7e70 0x7f2a080b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a077fe700 1 --2- 172.21.15.1:0/1038223051 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a08158150 0x7f2a080af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a06ffd700 1 -- 172.21.15.1:0/1038223051 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a08158150 msgr2=0x7f2a080af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a06ffd700 1 --2- 172.21.15.1:0/1038223051 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a08158150 0x7f2a080af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a06ffd700 1 -- 172.21.15.1:0/1038223051 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a080c7e70 msgr2=0x7f2a080b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a06ffd700 1 --2- 172.21.15.1:0/1038223051 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a080c7e70 0x7f2a080b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.124+0000 7f2a06ffd700 1 -- 172.21.15.1:0/1038223051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a00009a20 con 0x7f2a080ad790 2023-11-15T01:21:49.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.125+0000 7f2a077fe700 1 --2- 172.21.15.1:0/1038223051 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a08158150 0x7f2a080af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:49.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.125+0000 7f2a06ffd700 1 --2- 172.21.15.1:0/1038223051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a080ad790 0x7f2a080cb3d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f2a080c2120 tx=0x7f2a00009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:49.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.125+0000 7f29feffd700 1 -- 172.21.15.1:0/1038223051 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0001d630 con 0x7f2a080ad790 2023-11-15T01:21:49.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.125+0000 7f29feffd700 1 -- 172.21.15.1:0/1038223051 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0001d790 con 0x7f2a080ad790 2023-11-15T01:21:49.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.125+0000 7f2a0d4f2700 1 -- 172.21.15.1:0/1038223051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a080aff00 con 0x7f2a080ad790 2023-11-15T01:21:49.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.125+0000 7f29feffd700 1 -- 172.21.15.1:0/1038223051 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0001db50 con 0x7f2a080ad790 2023-11-15T01:21:49.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.125+0000 7f2a0d4f2700 1 -- 172.21.15.1:0/1038223051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a080b04c0 con 0x7f2a080ad790 2023-11-15T01:21:49.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.126+0000 7f2a0d4f2700 1 -- 172.21.15.1:0/1038223051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a080b0b10 con 0x7f2a080ad790 2023-11-15T01:21:49.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.126+0000 7f29feffd700 1 -- 172.21.15.1:0/1038223051 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2a00003040 con 0x7f2a080ad790 2023-11-15T01:21:49.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.126+0000 7f29feffd700 1 --2- 172.21.15.1:0/1038223051 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f29e805f150 0x7f29e8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.127+0000 7f29feffd700 1 -- 172.21.15.1:0/1038223051 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2a0007c000 con 0x7f2a080ad790 2023-11-15T01:21:49.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.127+0000 7f2a067fc700 1 --2- 172.21.15.1:0/1038223051 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f29e805f150 0x7f29e8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.127+0000 7f2a067fc700 1 --2- 172.21.15.1:0/1038223051 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f29e805f150 0x7f29e8061610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f2a080af0e0 tx=0x7f29f0008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:49.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.131+0000 7f29feffd700 1 -- 172.21.15.1:0/1038223051 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2a0004d2d0 con 0x7f2a080ad790 2023-11-15T01:21:49.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.305+0000 7f2a0d4f2700 1 -- 172.21.15.1:0/1038223051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2a080475e0 con 0x7f2a080ad790 2023-11-15T01:21:49.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.305+0000 7f29feffd700 1 -- 172.21.15.1:0/1038223051 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2a000508f0 con 0x7f2a080ad790 2023-11-15T01:21:49.306 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:21:49.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.307+0000 7f2a0d4f2700 1 -- 172.21.15.1:0/1038223051 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f29e805f150 msgr2=0x7f29e8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.307+0000 7f2a0d4f2700 1 --2- 172.21.15.1:0/1038223051 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f29e805f150 0x7f29e8061610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f2a080af0e0 tx=0x7f29f0008040).stop 2023-11-15T01:21:49.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.307+0000 7f2a0d4f2700 1 -- 172.21.15.1:0/1038223051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a080ad790 msgr2=0x7f2a080cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.307+0000 7f2a0d4f2700 1 --2- 172.21.15.1:0/1038223051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a080ad790 0x7f2a080cb3d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f2a080c2120 tx=0x7f2a00009780).stop 2023-11-15T01:21:49.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.307+0000 7f2a0d4f2700 1 -- 172.21.15.1:0/1038223051 shutdown_connections 2023-11-15T01:21:49.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.307+0000 7f2a0d4f2700 1 --2- 172.21.15.1:0/1038223051 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f29e805f150 0x7f29e8061610 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.307+0000 7f2a0d4f2700 1 --2- 172.21.15.1:0/1038223051 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a08158150 0x7f2a080af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.307+0000 7f2a0d4f2700 1 --2- 172.21.15.1:0/1038223051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a080ad790 0x7f2a080cb3d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.307+0000 7f2a0d4f2700 1 --2- 172.21.15.1:0/1038223051 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a080c7e70 0x7f2a080b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.307+0000 7f2a0d4f2700 1 -- 172.21.15.1:0/1038223051 >> 172.21.15.1:0/1038223051 conn(0x7f2a08064a90 msgr2=0x7f2a08150d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:49.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.307+0000 7f2a0d4f2700 1 -- 172.21.15.1:0/1038223051 shutdown_connections 2023-11-15T01:21:49.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.307+0000 7f2a0d4f2700 1 -- 172.21.15.1:0/1038223051 wait complete. 2023-11-15T01:21:49.319 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:21:49.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.440+0000 7fb5c197d700 1 Processor -- start 2023-11-15T01:21:49.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.440+0000 7fb5c197d700 1 -- start start 2023-11-15T01:21:49.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.441+0000 7fb5c197d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb5bc0ad790 0x7fb5bc1555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.441+0000 7fb5c197d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb5bc0c8090 0x7fb5bc0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.441+0000 7fb5c197d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5bc0c9210 con 0x7fb5bc158150 2023-11-15T01:21:49.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.441+0000 7fb5c197d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5bc0c6440 con 0x7fb5bc0c8090 2023-11-15T01:21:49.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.441+0000 7fb5c197d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5bc155ab0 con 0x7fb5bc0ad790 2023-11-15T01:21:49.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.441+0000 7fb5bb7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb5bc0c8090 0x7fb5bc0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.441+0000 7fb5bb7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb5bc0c8090 0x7fb5bc0c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37118/0 (socket says 172.21.15.1:37118) 2023-11-15T01:21:49.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.441+0000 7fb5bb7fe700 1 -- 172.21.15.1:0/3527130857 learned_addr learned my addr 172.21.15.1:0/3527130857 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:49.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.441+0000 7fb5baffd700 1 --2- 172.21.15.1:0/3527130857 >> v2:172.21.15.141:3300/0 conn(0x7fb5bc0ad790 0x7fb5bc1555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.441+0000 7fb5bb7fe700 1 -- 172.21.15.1:0/3527130857 >> v2:172.21.15.141:3300/0 conn(0x7fb5bc0ad790 msgr2=0x7fb5bc1555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:49.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.441+0000 7fb5bb7fe700 1 --2- 172.21.15.1:0/3527130857 >> v2:172.21.15.141:3300/0 conn(0x7fb5bc0ad790 0x7fb5bc1555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.441+0000 7fb5bb7fe700 1 -- 172.21.15.1:0/3527130857 >> v1:172.21.15.141:6789/0 conn(0x7fb5bc158150 legacy=0x7fb5bc0c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:49.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.441+0000 7fb5bb7fe700 1 -- 172.21.15.1:0/3527130857 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc158650 con 0x7fb5bc0c8090 2023-11-15T01:21:49.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.441+0000 7fb5baffd700 1 --2- 172.21.15.1:0/3527130857 >> v2:172.21.15.141:3300/0 conn(0x7fb5bc0ad790 0x7fb5bc1555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:49.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.441+0000 7fb5bb7fe700 1 --2- 172.21.15.1:0/3527130857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc0c8090 0x7fb5bc0c96a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fb5bc0cc160 tx=0x7fb5ac009840).ready entity=mon.0 client_cookie=58dd81f18987860f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:49.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.442+0000 7fb5b9ffb700 1 -- 172.21.15.1:0/3527130857 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac00e070 con 0x7fb5bc0c8090 2023-11-15T01:21:49.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.442+0000 7fb5b9ffb700 1 -- 172.21.15.1:0/3527130857 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac00ba10 con 0x7fb5bc0c8090 2023-11-15T01:21:49.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.442+0000 7fb5b9ffb700 1 -- 172.21.15.1:0/3527130857 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac00bd90 con 0x7fb5bc0c8090 2023-11-15T01:21:49.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.442+0000 7fb5c197d700 1 -- 172.21.15.1:0/3527130857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc0c8090 msgr2=0x7fb5bc0c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.442+0000 7fb5c197d700 1 --2- 172.21.15.1:0/3527130857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc0c8090 0x7fb5bc0c96a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fb5bc0cc160 tx=0x7fb5ac009840).stop 2023-11-15T01:21:49.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.442+0000 7fb5c197d700 1 -- 172.21.15.1:0/3527130857 shutdown_connections 2023-11-15T01:21:49.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.442+0000 7fb5c197d700 1 --2- 172.21.15.1:0/3527130857 >> v2:172.21.15.141:3300/0 conn(0x7fb5bc0ad790 0x7fb5bc1555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.442+0000 7fb5c197d700 1 --2- 172.21.15.1:0/3527130857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc0c8090 0x7fb5bc0c96a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.442+0000 7fb5c197d700 1 -- 172.21.15.1:0/3527130857 >> 172.21.15.1:0/3527130857 conn(0x7fb5bc064a90 msgr2=0x7fb5bc064ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:49.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.442+0000 7fb5c197d700 1 -- 172.21.15.1:0/3527130857 shutdown_connections 2023-11-15T01:21:49.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.442+0000 7fb5c197d700 1 -- 172.21.15.1:0/3527130857 wait complete. 2023-11-15T01:21:49.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.443+0000 7fb5c197d700 1 Processor -- start 2023-11-15T01:21:49.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.443+0000 7fb5c197d700 1 -- start start 2023-11-15T01:21:49.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.444+0000 7fb5c197d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc0ad790 0x7fb5bc0acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.444+0000 7fb5c197d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5bc0c8090 0x7fb5bc153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.444+0000 7fb5c197d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc158150 0x7fb5bc143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.444+0000 7fb5c197d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc0ad450 con 0x7fb5bc158150 2023-11-15T01:21:49.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.444+0000 7fb5c197d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc0acad0 con 0x7fb5bc0c8090 2023-11-15T01:21:49.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.444+0000 7fb5c197d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc0abec0 con 0x7fb5bc0ad790 2023-11-15T01:21:49.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.444+0000 7fb5bb7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc158150 0x7fb5bc143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.444+0000 7fb5bb7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc158150 0x7fb5bc143990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37128/0 (socket says 172.21.15.1:37128) 2023-11-15T01:21:49.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.444+0000 7fb5bb7fe700 1 -- 172.21.15.1:0/3302493806 learned_addr learned my addr 172.21.15.1:0/3302493806 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:49.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.444+0000 7fb5ba7fc700 1 --2- 172.21.15.1:0/3302493806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5bc0c8090 0x7fb5bc153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.444+0000 7fb5baffd700 1 --2- 172.21.15.1:0/3302493806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc0ad790 0x7fb5bc0acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.445+0000 7fb5bb7fe700 1 -- 172.21.15.1:0/3302493806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc0ad790 msgr2=0x7fb5bc0acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.445+0000 7fb5bb7fe700 1 --2- 172.21.15.1:0/3302493806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc0ad790 0x7fb5bc0acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.445+0000 7fb5bb7fe700 1 -- 172.21.15.1:0/3302493806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5bc0c8090 msgr2=0x7fb5bc153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.445+0000 7fb5bb7fe700 1 --2- 172.21.15.1:0/3302493806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5bc0c8090 0x7fb5bc153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.445+0000 7fb5bb7fe700 1 -- 172.21.15.1:0/3302493806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac009ae0 con 0x7fb5bc158150 2023-11-15T01:21:49.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.445+0000 7fb5baffd700 1 --2- 172.21.15.1:0/3302493806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc0ad790 0x7fb5bc0acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:49.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.445+0000 7fb5bb7fe700 1 --2- 172.21.15.1:0/3302493806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc158150 0x7fb5bc143990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb5bc0c2120 tx=0x7fb5ac009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:49.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.445+0000 7fb5b2ffd700 1 -- 172.21.15.1:0/3302493806 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0092e0 con 0x7fb5bc158150 2023-11-15T01:21:49.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.445+0000 7fb5b2ffd700 1 -- 172.21.15.1:0/3302493806 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac01d410 con 0x7fb5bc158150 2023-11-15T01:21:49.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.445+0000 7fb5c197d700 1 -- 172.21.15.1:0/3302493806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5bc0ac1a0 con 0x7fb5bc158150 2023-11-15T01:21:49.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.445+0000 7fb5b2ffd700 1 -- 172.21.15.1:0/3302493806 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac01d7b0 con 0x7fb5bc158150 2023-11-15T01:21:49.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.445+0000 7fb5c197d700 1 -- 172.21.15.1:0/3302493806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc0ac760 con 0x7fb5bc158150 2023-11-15T01:21:49.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.446+0000 7fb5c197d700 1 -- 172.21.15.1:0/3302493806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5bc0acc60 con 0x7fb5bc158150 2023-11-15T01:21:49.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.446+0000 7fb5b2ffd700 1 -- 172.21.15.1:0/3302493806 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb5ac01dba0 con 0x7fb5bc158150 2023-11-15T01:21:49.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.447+0000 7fb5b2ffd700 1 --2- 172.21.15.1:0/3302493806 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb59c05f120 0x7fb59c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.447+0000 7fb5b2ffd700 1 -- 172.21.15.1:0/3302493806 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb5ac07c010 con 0x7fb5bc158150 2023-11-15T01:21:49.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.447+0000 7fb5baffd700 1 --2- 172.21.15.1:0/3302493806 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb59c05f120 0x7fb59c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.447+0000 7fb5baffd700 1 --2- 172.21.15.1:0/3302493806 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb59c05f120 0x7fb59c0615e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fb5bc0b1250 tx=0x7fb5b4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:49.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.451+0000 7fb5b2ffd700 1 -- 172.21.15.1:0/3302493806 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb5ac04d2e0 con 0x7fb5bc158150 2023-11-15T01:21:49.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.622+0000 7fb5c197d700 1 -- 172.21.15.1:0/3302493806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb5bc0acc60 con 0x7fb5bc158150 2023-11-15T01:21:49.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.622+0000 7fb5b2ffd700 1 -- 172.21.15.1:0/3302493806 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb5ac050900 con 0x7fb5bc158150 2023-11-15T01:21:49.623 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:21:49.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.624+0000 7fb5c197d700 1 -- 172.21.15.1:0/3302493806 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb59c05f120 msgr2=0x7fb59c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.624+0000 7fb5c197d700 1 --2- 172.21.15.1:0/3302493806 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb59c05f120 0x7fb59c0615e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fb5bc0b1250 tx=0x7fb5b4008040).stop 2023-11-15T01:21:49.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.624+0000 7fb5c197d700 1 -- 172.21.15.1:0/3302493806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc158150 msgr2=0x7fb5bc143990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.624+0000 7fb5c197d700 1 --2- 172.21.15.1:0/3302493806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc158150 0x7fb5bc143990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb5bc0c2120 tx=0x7fb5ac009840).stop 2023-11-15T01:21:49.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.624+0000 7fb5c197d700 1 -- 172.21.15.1:0/3302493806 shutdown_connections 2023-11-15T01:21:49.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.624+0000 7fb5c197d700 1 --2- 172.21.15.1:0/3302493806 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb59c05f120 0x7fb59c0615e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.624+0000 7fb5c197d700 1 --2- 172.21.15.1:0/3302493806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc158150 0x7fb5bc143990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.624+0000 7fb5c197d700 1 --2- 172.21.15.1:0/3302493806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc0ad790 0x7fb5bc0acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.624+0000 7fb5c197d700 1 --2- 172.21.15.1:0/3302493806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5bc0c8090 0x7fb5bc153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.624+0000 7fb5c197d700 1 -- 172.21.15.1:0/3302493806 >> 172.21.15.1:0/3302493806 conn(0x7fb5bc064a90 msgr2=0x7fb5bc151060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:49.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.624+0000 7fb5c197d700 1 -- 172.21.15.1:0/3302493806 shutdown_connections 2023-11-15T01:21:49.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.625+0000 7fb5c197d700 1 -- 172.21.15.1:0/3302493806 wait complete. 2023-11-15T01:21:49.637 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T01:21:49.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.758+0000 7f90158b6700 1 Processor -- start 2023-11-15T01:21:49.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.758+0000 7f90158b6700 1 -- start start 2023-11-15T01:21:49.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.759+0000 7f90158b6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f90100ad790 0x7f90101555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.759+0000 7f90158b6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9010158150 0x7f90100c7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.759+0000 7f90158b6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90100c9210 con 0x7f90100c7e70 2023-11-15T01:21:49.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.759+0000 7f90158b6700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90100c6440 con 0x7f90100ad790 2023-11-15T01:21:49.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.759+0000 7f90158b6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9010155ab0 con 0x7f9010158150 2023-11-15T01:21:49.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.759+0000 7f900effd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f90100ad790 0x7f90101555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.759+0000 7f900f7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f90100c7e70 0x7f9010063550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41544/0 (socket says 172.21.15.1:41544) 2023-11-15T01:21:49.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.759+0000 7f900effd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f90100ad790 0x7f90101555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37130/0 (socket says 172.21.15.1:37130) 2023-11-15T01:21:49.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.759+0000 7f900f7fe700 1 -- 172.21.15.1:0/3670677288 learned_addr learned my addr 172.21.15.1:0/3670677288 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:49.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.759+0000 7f900e7fc700 1 --2- 172.21.15.1:0/3670677288 >> v2:172.21.15.141:3300/0 conn(0x7f9010158150 0x7f90100c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.759+0000 7f900effd700 1 -- 172.21.15.1:0/3670677288 >> v2:172.21.15.141:3300/0 conn(0x7f9010158150 msgr2=0x7f90100c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:49.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.759+0000 7f900effd700 1 --2- 172.21.15.1:0/3670677288 >> v2:172.21.15.141:3300/0 conn(0x7f9010158150 0x7f90100c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.759+0000 7f900effd700 1 -- 172.21.15.1:0/3670677288 >> v1:172.21.15.1:6789/0 conn(0x7f90100c7e70 legacy=0x7f9010063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.759+0000 7f900effd700 1 -- 172.21.15.1:0/3670677288 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9010158650 con 0x7f90100ad790 2023-11-15T01:21:49.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.759+0000 7f900dffb700 1 -- 172.21.15.1:0/3670677288 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767197899 0 0) 0x7f90100c9210 con 0x7f90100c7e70 2023-11-15T01:21:49.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.760+0000 7f900effd700 1 --2- 172.21.15.1:0/3670677288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90100ad790 0x7f90101555c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f90101527a0 tx=0x7f9008009060).ready entity=mon.0 client_cookie=9f418cfc141a6564 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:49.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.760+0000 7f900dffb700 1 -- 172.21.15.1:0/3670677288 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900800f510 con 0x7f90100ad790 2023-11-15T01:21:49.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.760+0000 7f900dffb700 1 -- 172.21.15.1:0/3670677288 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900800f670 con 0x7f90100ad790 2023-11-15T01:21:49.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.760+0000 7f900dffb700 1 -- 172.21.15.1:0/3670677288 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900800f9f0 con 0x7f90100ad790 2023-11-15T01:21:49.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.760+0000 7f90158b6700 1 -- 172.21.15.1:0/3670677288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90100ad790 msgr2=0x7f90101555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.760+0000 7f90158b6700 1 --2- 172.21.15.1:0/3670677288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90100ad790 0x7f90101555c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f90101527a0 tx=0x7f9008009060).stop 2023-11-15T01:21:49.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.760+0000 7f90158b6700 1 -- 172.21.15.1:0/3670677288 shutdown_connections 2023-11-15T01:21:49.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.760+0000 7f90158b6700 1 --2- 172.21.15.1:0/3670677288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90100ad790 0x7f90101555c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.760+0000 7f90158b6700 1 --2- 172.21.15.1:0/3670677288 >> v2:172.21.15.141:3300/0 conn(0x7f9010158150 0x7f90100c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.760+0000 7f90158b6700 1 -- 172.21.15.1:0/3670677288 >> 172.21.15.1:0/3670677288 conn(0x7f9010064a90 msgr2=0x7f9010064ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:49.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.760+0000 7f90158b6700 1 -- 172.21.15.1:0/3670677288 shutdown_connections 2023-11-15T01:21:49.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.760+0000 7f90158b6700 1 -- 172.21.15.1:0/3670677288 wait complete. 2023-11-15T01:21:49.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.762+0000 7f90158b6700 1 Processor -- start 2023-11-15T01:21:49.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.762+0000 7f90158b6700 1 -- start start 2023-11-15T01:21:49.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.762+0000 7f90158b6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90100ad790 0x7f90100c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.762+0000 7f90158b6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90100c7e70 0x7f90100c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.762+0000 7f90158b6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9010158150 0x7f9010141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.762+0000 7f90158b6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90100c21f0 con 0x7f90100c7e70 2023-11-15T01:21:49.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.762+0000 7f90158b6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90100c24d0 con 0x7f9010158150 2023-11-15T01:21:49.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.762+0000 7f90158b6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90100c9ef0 con 0x7f90100ad790 2023-11-15T01:21:49.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.762+0000 7f900e7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90100c7e70 0x7f90100c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.762+0000 7f900e7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90100c7e70 0x7f90100c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37136/0 (socket says 172.21.15.1:37136) 2023-11-15T01:21:49.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.762+0000 7f900e7fc700 1 -- 172.21.15.1:0/3239429485 learned_addr learned my addr 172.21.15.1:0/3239429485 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:49.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.763+0000 7f900effd700 1 --2- 172.21.15.1:0/3239429485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90100ad790 0x7f90100c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.763+0000 7f900f7fe700 1 --2- 172.21.15.1:0/3239429485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9010158150 0x7f9010141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.763+0000 7f900e7fc700 1 -- 172.21.15.1:0/3239429485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90100ad790 msgr2=0x7f90100c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.763+0000 7f900e7fc700 1 --2- 172.21.15.1:0/3239429485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90100ad790 0x7f90100c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.763+0000 7f900e7fc700 1 -- 172.21.15.1:0/3239429485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9010158150 msgr2=0x7f9010141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.763+0000 7f900e7fc700 1 --2- 172.21.15.1:0/3239429485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9010158150 0x7f9010141cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.763+0000 7f900e7fc700 1 -- 172.21.15.1:0/3239429485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90080092a0 con 0x7f90100c7e70 2023-11-15T01:21:49.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.763+0000 7f900f7fe700 1 --2- 172.21.15.1:0/3239429485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9010158150 0x7f9010141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:49.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.763+0000 7f900e7fc700 1 --2- 172.21.15.1:0/3239429485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90100c7e70 0x7f90100c96a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f8ff800e900 tx=0x7f8ff8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:49.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.763+0000 7f9006ffd700 1 -- 172.21.15.1:0/3239429485 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8012600 con 0x7f90100c7e70 2023-11-15T01:21:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.763+0000 7f9006ffd700 1 -- 172.21.15.1:0/3239429485 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff8012760 con 0x7f90100c7e70 2023-11-15T01:21:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.763+0000 7f90158b6700 1 -- 172.21.15.1:0/3239429485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90100ca1d0 con 0x7f90100c7e70 2023-11-15T01:21:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.763+0000 7f9006ffd700 1 -- 172.21.15.1:0/3239429485 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8012ae0 con 0x7f90100c7e70 2023-11-15T01:21:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.763+0000 7f90158b6700 1 -- 172.21.15.1:0/3239429485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90100c9b90 con 0x7f90100c7e70 2023-11-15T01:21:49.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.764+0000 7f90158b6700 1 -- 172.21.15.1:0/3239429485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90100c2680 con 0x7f90100c7e70 2023-11-15T01:21:49.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.764+0000 7f9006ffd700 1 -- 172.21.15.1:0/3239429485 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8ff801b400 con 0x7f90100c7e70 2023-11-15T01:21:49.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.765+0000 7f9006ffd700 1 --2- 172.21.15.1:0/3239429485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8ff005f150 0x7f8ff0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:49.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.765+0000 7f9006ffd700 1 -- 172.21.15.1:0/3239429485 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8ff807a580 con 0x7f90100c7e70 2023-11-15T01:21:49.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.765+0000 7f900effd700 1 --2- 172.21.15.1:0/3239429485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8ff005f150 0x7f8ff0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:49.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.765+0000 7f900effd700 1 --2- 172.21.15.1:0/3239429485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8ff005f150 0x7f8ff0061610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f90101527a0 tx=0x7f9008017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:49.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.769+0000 7f9006ffd700 1 -- 172.21.15.1:0/3239429485 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f90100c2680 con 0x7f90100c7e70 2023-11-15T01:21:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.940+0000 7f90158b6700 1 -- 172.21.15.1:0/3239429485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90100c2640 con 0x7f90100c7e70 2023-11-15T01:21:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.940+0000 7f9006ffd700 1 -- 172.21.15.1:0/3239429485 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ff80160a0 con 0x7f90100c7e70 2023-11-15T01:21:49.941 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:21:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.942+0000 7f90158b6700 1 -- 172.21.15.1:0/3239429485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8ff005f150 msgr2=0x7f8ff0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.942+0000 7f90158b6700 1 --2- 172.21.15.1:0/3239429485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8ff005f150 0x7f8ff0061610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f90101527a0 tx=0x7f9008017000).stop 2023-11-15T01:21:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.942+0000 7f90158b6700 1 -- 172.21.15.1:0/3239429485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90100c7e70 msgr2=0x7f90100c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.942+0000 7f90158b6700 1 --2- 172.21.15.1:0/3239429485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90100c7e70 0x7f90100c96a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f8ff800e900 tx=0x7f8ff8009060).stop 2023-11-15T01:21:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.942+0000 7f90158b6700 1 -- 172.21.15.1:0/3239429485 shutdown_connections 2023-11-15T01:21:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.942+0000 7f90158b6700 1 --2- 172.21.15.1:0/3239429485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8ff005f150 0x7f8ff0061610 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.942+0000 7f90158b6700 1 --2- 172.21.15.1:0/3239429485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9010158150 0x7f9010141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.942+0000 7f90158b6700 1 --2- 172.21.15.1:0/3239429485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90100ad790 0x7f90100c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.942+0000 7f90158b6700 1 --2- 172.21.15.1:0/3239429485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90100c7e70 0x7f90100c96a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.942+0000 7f90158b6700 1 -- 172.21.15.1:0/3239429485 >> 172.21.15.1:0/3239429485 conn(0x7f9010064a90 msgr2=0x7f9010150f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.942+0000 7f90158b6700 1 -- 172.21.15.1:0/3239429485 shutdown_connections 2023-11-15T01:21:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:49.942+0000 7f90158b6700 1 -- 172.21.15.1:0/3239429485 wait complete. 2023-11-15T01:21:49.955 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T01:21:50.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.075+0000 7f71e3910700 1 Processor -- start 2023-11-15T01:21:50.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.075+0000 7f71e3910700 1 -- start start 2023-11-15T01:21:50.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.076+0000 7f71e3910700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f71dc1540a0 0x7f71dc0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.076+0000 7f71e3910700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc0c6650 0x7f71dc0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.076+0000 7f71e3910700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71dc0ca050 con 0x7f71dc154480 2023-11-15T01:21:50.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.076+0000 7f71e3910700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc0c9440 con 0x7f71dc1540a0 2023-11-15T01:21:50.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.076+0000 7f71e3910700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0c9720 con 0x7f71dc0c6650 2023-11-15T01:21:50.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.076+0000 7f71e16ac700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f71dc1540a0 0x7f71dc0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.076+0000 7f71e0eab700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f71dc154480 0x7f71dc0c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41556/0 (socket says 172.21.15.1:41556) 2023-11-15T01:21:50.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.076+0000 7f71e0eab700 1 -- 172.21.15.1:0/3697305302 learned_addr learned my addr 172.21.15.1:0/3697305302 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:50.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.076+0000 7f71e1ead700 1 --2- 172.21.15.1:0/3697305302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc0c6650 0x7f71dc0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71e16ac700 1 -- 172.21.15.1:0/3697305302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc0c6650 msgr2=0x7f71dc0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71e16ac700 1 --2- 172.21.15.1:0/3697305302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc0c6650 0x7f71dc0ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71e16ac700 1 -- 172.21.15.1:0/3697305302 >> v1:172.21.15.1:6789/0 conn(0x7f71dc154480 legacy=0x7f71dc0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71e16ac700 1 -- 172.21.15.1:0/3697305302 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0c9a00 con 0x7f71dc1540a0 2023-11-15T01:21:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71dbfff700 1 -- 172.21.15.1:0/3697305302 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159684633 0 0) 0x7f71dc0ca050 con 0x7f71dc154480 2023-11-15T01:21:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71e16ac700 1 --2- 172.21.15.1:0/3697305302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71dc1540a0 0x7f71dc0ca4e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f71d4009760 tx=0x7f71d4009060).ready entity=mon.0 client_cookie=bea22bbc97452c5e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71dbfff700 1 -- 172.21.15.1:0/3697305302 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400b580 con 0x7f71dc1540a0 2023-11-15T01:21:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71dbfff700 1 -- 172.21.15.1:0/3697305302 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d400b6e0 con 0x7f71dc1540a0 2023-11-15T01:21:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71dbfff700 1 -- 172.21.15.1:0/3697305302 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400ba60 con 0x7f71dc1540a0 2023-11-15T01:21:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71e3910700 1 -- 172.21.15.1:0/3697305302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71dc1540a0 msgr2=0x7f71dc0ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71e3910700 1 --2- 172.21.15.1:0/3697305302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71dc1540a0 0x7f71dc0ca4e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f71d4009760 tx=0x7f71d4009060).stop 2023-11-15T01:21:50.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71e3910700 1 -- 172.21.15.1:0/3697305302 shutdown_connections 2023-11-15T01:21:50.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71e3910700 1 --2- 172.21.15.1:0/3697305302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc0c6650 0x7f71dc0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71e3910700 1 --2- 172.21.15.1:0/3697305302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71dc1540a0 0x7f71dc0ca4e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71e3910700 1 -- 172.21.15.1:0/3697305302 >> 172.21.15.1:0/3697305302 conn(0x7f71dc064a70 msgr2=0x7f71dc064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71e3910700 1 -- 172.21.15.1:0/3697305302 shutdown_connections 2023-11-15T01:21:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.077+0000 7f71e3910700 1 -- 172.21.15.1:0/3697305302 wait complete. 2023-11-15T01:21:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.078+0000 7f71e3910700 1 Processor -- start 2023-11-15T01:21:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.078+0000 7f71e3910700 1 -- start start 2023-11-15T01:21:50.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.079+0000 7f71e3910700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71dc0c6650 0x7f71dc151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.079+0000 7f71e3910700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71dc1540a0 0x7f71dc0aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.079+0000 7f71e3910700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc154480 0x7f71dc1506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.079+0000 7f71e3910700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0c2e50 con 0x7f71dc1540a0 2023-11-15T01:21:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.079+0000 7f71e3910700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc151950 con 0x7f71dc0c6650 2023-11-15T01:21:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.079+0000 7f71e3910700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc150d40 con 0x7f71dc154480 2023-11-15T01:21:50.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.079+0000 7f71e0eab700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71dc1540a0 0x7f71dc0aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.079+0000 7f71e0eab700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71dc1540a0 0x7f71dc0aea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37150/0 (socket says 172.21.15.1:37150) 2023-11-15T01:21:50.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.079+0000 7f71e0eab700 1 -- 172.21.15.1:0/4184787084 learned_addr learned my addr 172.21.15.1:0/4184787084 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:50.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.080+0000 7f71e16ac700 1 --2- 172.21.15.1:0/4184787084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71dc0c6650 0x7f71dc151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.080+0000 7f71e1ead700 1 --2- 172.21.15.1:0/4184787084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc154480 0x7f71dc1506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.080+0000 7f71e0eab700 1 -- 172.21.15.1:0/4184787084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc154480 msgr2=0x7f71dc1506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.080+0000 7f71e0eab700 1 --2- 172.21.15.1:0/4184787084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc154480 0x7f71dc1506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.080+0000 7f71e0eab700 1 -- 172.21.15.1:0/4184787084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71dc0c6650 msgr2=0x7f71dc151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.080+0000 7f71e0eab700 1 --2- 172.21.15.1:0/4184787084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71dc0c6650 0x7f71dc151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.080+0000 7f71e0eab700 1 -- 172.21.15.1:0/4184787084 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d40092a0 con 0x7f71dc1540a0 2023-11-15T01:21:50.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.080+0000 7f71e16ac700 1 --2- 172.21.15.1:0/4184787084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71dc0c6650 0x7f71dc151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:50.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.080+0000 7f71e0eab700 1 --2- 172.21.15.1:0/4184787084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71dc1540a0 0x7f71dc0aea50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f71d000c4e0 tx=0x7f71d0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:50.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.080+0000 7f71d97fa700 1 -- 172.21.15.1:0/4184787084 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d00072e0 con 0x7f71dc1540a0 2023-11-15T01:21:50.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.080+0000 7f71d97fa700 1 -- 172.21.15.1:0/4184787084 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d0007440 con 0x7f71dc1540a0 2023-11-15T01:21:50.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.080+0000 7f71e3910700 1 -- 172.21.15.1:0/4184787084 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc151020 con 0x7f71dc1540a0 2023-11-15T01:21:50.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.080+0000 7f71d97fa700 1 -- 172.21.15.1:0/4184787084 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d00057a0 con 0x7f71dc1540a0 2023-11-15T01:21:50.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.080+0000 7f71e3910700 1 -- 172.21.15.1:0/4184787084 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc1515e0 con 0x7f71dc1540a0 2023-11-15T01:21:50.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.081+0000 7f71e3910700 1 -- 172.21.15.1:0/4184787084 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc06c7e0 con 0x7f71dc1540a0 2023-11-15T01:21:50.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.081+0000 7f71d97fa700 1 -- 172.21.15.1:0/4184787084 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f71d0005bd0 con 0x7f71dc1540a0 2023-11-15T01:21:50.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.082+0000 7f71d97fa700 1 --2- 172.21.15.1:0/4184787084 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71c805f150 0x7f71c8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.082+0000 7f71d97fa700 1 -- 172.21.15.1:0/4184787084 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f71d0079c80 con 0x7f71dc1540a0 2023-11-15T01:21:50.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.082+0000 7f71e16ac700 1 --2- 172.21.15.1:0/4184787084 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71c805f150 0x7f71c8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.082+0000 7f71e16ac700 1 --2- 172.21.15.1:0/4184787084 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71c805f150 0x7f71c8061610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f71d400b340 tx=0x7f71d4017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:50.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.086+0000 7f71d97fa700 1 -- 172.21.15.1:0/4184787084 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f71d004aef0 con 0x7f71dc1540a0 2023-11-15T01:21:50.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.256+0000 7f71e3910700 1 -- 172.21.15.1:0/4184787084 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71dc151a90 con 0x7f71dc1540a0 2023-11-15T01:21:50.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.256+0000 7f71d97fa700 1 -- 172.21.15.1:0/4184787084 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71d0018030 con 0x7f71dc1540a0 2023-11-15T01:21:50.257 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:21:50.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.258+0000 7f71e3910700 1 -- 172.21.15.1:0/4184787084 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71c805f150 msgr2=0x7f71c8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.258+0000 7f71e3910700 1 --2- 172.21.15.1:0/4184787084 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71c805f150 0x7f71c8061610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f71d400b340 tx=0x7f71d4017000).stop 2023-11-15T01:21:50.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.258+0000 7f71e3910700 1 -- 172.21.15.1:0/4184787084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71dc1540a0 msgr2=0x7f71dc0aea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.258+0000 7f71e3910700 1 --2- 172.21.15.1:0/4184787084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71dc1540a0 0x7f71dc0aea50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f71d000c4e0 tx=0x7f71d0007c70).stop 2023-11-15T01:21:50.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.258+0000 7f71e3910700 1 -- 172.21.15.1:0/4184787084 shutdown_connections 2023-11-15T01:21:50.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.258+0000 7f71e3910700 1 --2- 172.21.15.1:0/4184787084 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71c805f150 0x7f71c8061610 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.258+0000 7f71e3910700 1 --2- 172.21.15.1:0/4184787084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc154480 0x7f71dc1506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.258+0000 7f71e3910700 1 --2- 172.21.15.1:0/4184787084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71dc0c6650 0x7f71dc151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.258+0000 7f71e3910700 1 --2- 172.21.15.1:0/4184787084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71dc1540a0 0x7f71dc0aea50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.258+0000 7f71e3910700 1 -- 172.21.15.1:0/4184787084 >> 172.21.15.1:0/4184787084 conn(0x7f71dc064a70 msgr2=0x7f71dc15aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:50.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.258+0000 7f71e3910700 1 -- 172.21.15.1:0/4184787084 shutdown_connections 2023-11-15T01:21:50.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.258+0000 7f71e3910700 1 -- 172.21.15.1:0/4184787084 wait complete. 2023-11-15T01:21:50.270 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:21:50.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.388+0000 7efcda8c3700 1 Processor -- start 2023-11-15T01:21:50.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.388+0000 7efcda8c3700 1 -- start start 2023-11-15T01:21:50.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcda8c3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efcd4154150 0x7efcd4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcda8c3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcd40ab1a0 0x7efcd4158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcda8c3700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd40c06f0 con 0x7efcd40aa060 2023-11-15T01:21:50.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcda8c3700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd40c09d0 con 0x7efcd4154150 2023-11-15T01:21:50.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcda8c3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd4158820 con 0x7efcd40ab1a0 2023-11-15T01:21:50.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcd3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efcd4154150 0x7efcd4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcd8e60700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7efcd40aa060 0x7efcd40c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41558/0 (socket says 172.21.15.1:41558) 2023-11-15T01:21:50.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcd8e60700 1 -- 172.21.15.1:0/1557910871 learned_addr learned my addr 172.21.15.1:0/1557910871 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:50.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcd37fe700 1 --2- 172.21.15.1:0/1557910871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcd40ab1a0 0x7efcd4158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcd3fff700 1 -- 172.21.15.1:0/1557910871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcd40ab1a0 msgr2=0x7efcd4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:50.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcd3fff700 1 --2- 172.21.15.1:0/1557910871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcd40ab1a0 0x7efcd4158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcd3fff700 1 -- 172.21.15.1:0/1557910871 >> v1:172.21.15.1:6789/0 conn(0x7efcd40aa060 legacy=0x7efcd40c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcd3fff700 1 -- 172.21.15.1:0/1557910871 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd4158b00 con 0x7efcd4154150 2023-11-15T01:21:50.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcd2ffd700 1 -- 172.21.15.1:0/1557910871 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753974731 0 0) 0x7efcd40c06f0 con 0x7efcd40aa060 2023-11-15T01:21:50.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcd3fff700 1 --2- 172.21.15.1:0/1557910871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcd4154150 0x7efcd4154530 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7efcc4009760 tx=0x7efcc4009060).ready entity=mon.0 client_cookie=bc2aded3d46db37c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:50.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcd2ffd700 1 -- 172.21.15.1:0/1557910871 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc40090d0 con 0x7efcd4154150 2023-11-15T01:21:50.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcd2ffd700 1 -- 172.21.15.1:0/1557910871 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc400f510 con 0x7efcd4154150 2023-11-15T01:21:50.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.389+0000 7efcd2ffd700 1 -- 172.21.15.1:0/1557910871 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc400f890 con 0x7efcd4154150 2023-11-15T01:21:50.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.390+0000 7efcda8c3700 1 -- 172.21.15.1:0/1557910871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcd4154150 msgr2=0x7efcd4154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.390+0000 7efcda8c3700 1 --2- 172.21.15.1:0/1557910871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcd4154150 0x7efcd4154530 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7efcc4009760 tx=0x7efcc4009060).stop 2023-11-15T01:21:50.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.390+0000 7efcda8c3700 1 -- 172.21.15.1:0/1557910871 shutdown_connections 2023-11-15T01:21:50.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.390+0000 7efcda8c3700 1 --2- 172.21.15.1:0/1557910871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcd4154150 0x7efcd4154530 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.390+0000 7efcda8c3700 1 --2- 172.21.15.1:0/1557910871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcd40ab1a0 0x7efcd4158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.390+0000 7efcda8c3700 1 -- 172.21.15.1:0/1557910871 >> 172.21.15.1:0/1557910871 conn(0x7efcd4064aa0 msgr2=0x7efcd4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:50.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.390+0000 7efcda8c3700 1 -- 172.21.15.1:0/1557910871 shutdown_connections 2023-11-15T01:21:50.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.390+0000 7efcda8c3700 1 -- 172.21.15.1:0/1557910871 wait complete. 2023-11-15T01:21:50.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.391+0000 7efcda8c3700 1 Processor -- start 2023-11-15T01:21:50.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.391+0000 7efcda8c3700 1 -- start start 2023-11-15T01:21:50.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcda8c3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcd40aa060 0x7efcd40c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcda8c3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcd40ab1a0 0x7efcd41556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcda8c3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efcd4154150 0x7efcd4167dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcda8c3700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd40c2810 con 0x7efcd40ab1a0 2023-11-15T01:21:50.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcda8c3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd4155f30 con 0x7efcd4154150 2023-11-15T01:21:50.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcda8c3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd4156210 con 0x7efcd40aa060 2023-11-15T01:21:50.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcd37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcd40ab1a0 0x7efcd41556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcd37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcd40ab1a0 0x7efcd41556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37166/0 (socket says 172.21.15.1:37166) 2023-11-15T01:21:50.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcd37fe700 1 -- 172.21.15.1:0/165456380 learned_addr learned my addr 172.21.15.1:0/165456380 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:50.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcd3fff700 1 --2- 172.21.15.1:0/165456380 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcd40aa060 0x7efcd40c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcd8e60700 1 --2- 172.21.15.1:0/165456380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efcd4154150 0x7efcd4167dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcd37fe700 1 -- 172.21.15.1:0/165456380 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcd40aa060 msgr2=0x7efcd40c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcd37fe700 1 --2- 172.21.15.1:0/165456380 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcd40aa060 0x7efcd40c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcd37fe700 1 -- 172.21.15.1:0/165456380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efcd4154150 msgr2=0x7efcd4167dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcd37fe700 1 --2- 172.21.15.1:0/165456380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efcd4154150 0x7efcd4167dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcd37fe700 1 -- 172.21.15.1:0/165456380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc40092a0 con 0x7efcd40ab1a0 2023-11-15T01:21:50.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.392+0000 7efcd37fe700 1 --2- 172.21.15.1:0/165456380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcd40ab1a0 0x7efcd41556a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7efcc800e930 tx=0x7efcc8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:50.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.393+0000 7efcbbfff700 1 -- 172.21.15.1:0/165456380 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc8012600 con 0x7efcd40ab1a0 2023-11-15T01:21:50.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.393+0000 7efcbbfff700 1 -- 172.21.15.1:0/165456380 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc8012760 con 0x7efcd40ab1a0 2023-11-15T01:21:50.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.393+0000 7efcda8c3700 1 -- 172.21.15.1:0/165456380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd41564f0 con 0x7efcd40ab1a0 2023-11-15T01:21:50.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.393+0000 7efcbbfff700 1 -- 172.21.15.1:0/165456380 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc8012ae0 con 0x7efcd40ab1a0 2023-11-15T01:21:50.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.393+0000 7efcda8c3700 1 -- 172.21.15.1:0/165456380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd40c4cb0 con 0x7efcd40ab1a0 2023-11-15T01:21:50.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.394+0000 7efcda8c3700 1 -- 172.21.15.1:0/165456380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd40c29c0 con 0x7efcd40ab1a0 2023-11-15T01:21:50.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.394+0000 7efcbbfff700 1 -- 172.21.15.1:0/165456380 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efcc801b400 con 0x7efcd40ab1a0 2023-11-15T01:21:50.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.394+0000 7efcbbfff700 1 --2- 172.21.15.1:0/165456380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efcc005f150 0x7efcc0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.394+0000 7efcbbfff700 1 -- 172.21.15.1:0/165456380 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efcc807a5d0 con 0x7efcd40ab1a0 2023-11-15T01:21:50.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.395+0000 7efcd3fff700 1 --2- 172.21.15.1:0/165456380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efcc005f150 0x7efcc0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.395+0000 7efcd3fff700 1 --2- 172.21.15.1:0/165456380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efcc005f150 0x7efcc0061610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7efcc4009fd0 tx=0x7efcc4017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:50.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.398+0000 7efcbbfff700 1 -- 172.21.15.1:0/165456380 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efcd40c29c0 con 0x7efcd40ab1a0 2023-11-15T01:21:50.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.617+0000 7efcda8c3700 1 -- 172.21.15.1:0/165456380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcd40c2950 con 0x7efcd40ab1a0 2023-11-15T01:21:50.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.618+0000 7efcbbfff700 1 -- 172.21.15.1:0/165456380 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4480 (secure 0 0 0) 0x7efcc804b840 con 0x7efcd40ab1a0 2023-11-15T01:21:50.619 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:50.619 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/843391361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":843391361},{"type":"v1","addr":"172.21.15.141:6837","nonce":843391361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2237478530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2237478530},{"type":"v1","addr":"172.21.15.141:6836","nonce":2237478530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2856672167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2856672167},{"type":"v1","addr":"172.21.15.1:6833","nonce":2856672167}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:21:37.045655+0000","modified":"2023-11-15T01:21:40.053500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/4209655632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4209655632},{"type":"v1","addr":"172.21.15.1:6835","nonce":4209655632}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-15T01:21:50.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.619+0000 7efcda8c3700 1 -- 172.21.15.1:0/165456380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efcc005f150 msgr2=0x7efcc0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.619+0000 7efcda8c3700 1 --2- 172.21.15.1:0/165456380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efcc005f150 0x7efcc0061610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7efcc4009fd0 tx=0x7efcc4017000).stop 2023-11-15T01:21:50.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.619+0000 7efcda8c3700 1 -- 172.21.15.1:0/165456380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcd40ab1a0 msgr2=0x7efcd41556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.619+0000 7efcda8c3700 1 --2- 172.21.15.1:0/165456380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcd40ab1a0 0x7efcd41556a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7efcc800e930 tx=0x7efcc8009060).stop 2023-11-15T01:21:50.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.620+0000 7efcda8c3700 1 -- 172.21.15.1:0/165456380 shutdown_connections 2023-11-15T01:21:50.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.620+0000 7efcda8c3700 1 --2- 172.21.15.1:0/165456380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efcc005f150 0x7efcc0061610 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.620+0000 7efcda8c3700 1 --2- 172.21.15.1:0/165456380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efcd4154150 0x7efcd4167dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.620+0000 7efcda8c3700 1 --2- 172.21.15.1:0/165456380 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcd40aa060 0x7efcd40c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.620+0000 7efcda8c3700 1 --2- 172.21.15.1:0/165456380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcd40ab1a0 0x7efcd41556a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.620+0000 7efcda8c3700 1 -- 172.21.15.1:0/165456380 >> 172.21.15.1:0/165456380 conn(0x7efcd4064aa0 msgr2=0x7efcd414b420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:50.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.620+0000 7efcda8c3700 1 -- 172.21.15.1:0/165456380 shutdown_connections 2023-11-15T01:21:50.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.620+0000 7efcda8c3700 1 -- 172.21.15.1:0/165456380 wait complete. 2023-11-15T01:21:50.623 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2023-11-15T01:21:50.632 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:21:50.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.750+0000 7ff214109700 1 Processor -- start 2023-11-15T01:21:50.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.750+0000 7ff214109700 1 -- start start 2023-11-15T01:21:50.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.751+0000 7ff214109700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff20c0ab1a0 0x7ff20c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.751+0000 7ff214109700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff20c0aa060 0x7ff20c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.751+0000 7ff214109700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20c0c06f0 con 0x7ff20c154150 2023-11-15T01:21:50.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.751+0000 7ff214109700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff20c0c09d0 con 0x7ff20c0ab1a0 2023-11-15T01:21:50.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.751+0000 7ff214109700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c158820 con 0x7ff20c0aa060 2023-11-15T01:21:50.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.751+0000 7ff211ea5700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff20c154150 0x7ff20c158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41574/0 (socket says 172.21.15.1:41574) 2023-11-15T01:21:50.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.751+0000 7ff211ea5700 1 -- 172.21.15.1:0/523424571 learned_addr learned my addr 172.21.15.1:0/523424571 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:50.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.751+0000 7ff2116a4700 1 --2- 172.21.15.1:0/523424571 >> v2:172.21.15.141:3300/0 conn(0x7ff20c0ab1a0 0x7ff20c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.751+0000 7ff2126a6700 1 --2- 172.21.15.1:0/523424571 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff20c0aa060 0x7ff20c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.751+0000 7ff210ea3700 1 -- 172.21.15.1:0/523424571 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993998919 0 0) 0x7ff20c0c06f0 con 0x7ff20c154150 2023-11-15T01:21:50.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.751+0000 7ff210ea3700 1 -- 172.21.15.1:0/523424571 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f40033f0 con 0x7ff20c154150 2023-11-15T01:21:50.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 -- 172.21.15.1:0/523424571 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2064810049 0 0) 0x7ff1f40033f0 con 0x7ff20c154150 2023-11-15T01:21:50.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 -- 172.21.15.1:0/523424571 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff20c0aa060 msgr2=0x7ff20c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:50.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 --2- 172.21.15.1:0/523424571 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff20c0aa060 0x7ff20c0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 -- 172.21.15.1:0/523424571 >> v2:172.21.15.141:3300/0 conn(0x7ff20c0ab1a0 msgr2=0x7ff20c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:50.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 --2- 172.21.15.1:0/523424571 >> v2:172.21.15.141:3300/0 conn(0x7ff20c0ab1a0 0x7ff20c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 -- 172.21.15.1:0/523424571 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c158b00 con 0x7ff20c154150 2023-11-15T01:21:50.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 -- 172.21.15.1:0/523424571 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7ff2040017f0 con 0x7ff20c154150 2023-11-15T01:21:50.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 -- 172.21.15.1:0/523424571 >> v1:172.21.15.1:6789/0 conn(0x7ff20c154150 legacy=0x7ff20c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 --2- 172.21.15.1:0/523424571 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1f40038e0 0x7ff1f4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 --2- 172.21.15.1:0/523424571 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff20c0aa060 0x7ff1f4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 --2- 172.21.15.1:0/523424571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1f4004b80 0x7ff1f4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 -- 172.21.15.1:0/523424571 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0c09d0 con 0x7ff1f4004b80 2023-11-15T01:21:50.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 -- 172.21.15.1:0/523424571 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c158820 con 0x7ff1f40038e0 2023-11-15T01:21:50.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 -- 172.21.15.1:0/523424571 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f400b8e0 con 0x7ff20c0aa060 2023-11-15T01:21:50.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff2126a6700 1 --2- 172.21.15.1:0/523424571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1f4004b80 0x7ff1f4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff211ea5700 1 --2- 172.21.15.1:0/523424571 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1f40038e0 0x7ff1f4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff2116a4700 1 --2- 172.21.15.1:0/523424571 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff20c0aa060 0x7ff1f4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff2126a6700 1 -- 172.21.15.1:0/523424571 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff20c0aa060 msgr2=0x7ff1f4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:50.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff2126a6700 1 --2- 172.21.15.1:0/523424571 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff20c0aa060 0x7ff1f4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff2126a6700 1 -- 172.21.15.1:0/523424571 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1f40038e0 msgr2=0x7ff1f4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:50.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff2126a6700 1 --2- 172.21.15.1:0/523424571 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1f40038e0 0x7ff1f4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff2126a6700 1 -- 172.21.15.1:0/523424571 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f40033f0 con 0x7ff1f4004b80 2023-11-15T01:21:50.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff2126a6700 1 --2- 172.21.15.1:0/523424571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1f4004b80 0x7ff1f4005000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff1fc009a80 tx=0x7ff1fc009060).ready entity=mon.0 client_cookie=6bbdf98d5b9f422a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:50.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 -- 172.21.15.1:0/523424571 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc009430 con 0x7ff1f4004b80 2023-11-15T01:21:50.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 -- 172.21.15.1:0/523424571 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc00e640 con 0x7ff1f4004b80 2023-11-15T01:21:50.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.752+0000 7ff210ea3700 1 -- 172.21.15.1:0/523424571 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc00e9c0 con 0x7ff1f4004b80 2023-11-15T01:21:50.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.753+0000 7ff214109700 1 -- 172.21.15.1:0/523424571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1f4004b80 msgr2=0x7ff1f4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.753+0000 7ff214109700 1 --2- 172.21.15.1:0/523424571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1f4004b80 0x7ff1f4005000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff1fc009a80 tx=0x7ff1fc009060).stop 2023-11-15T01:21:50.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.753+0000 7ff2126a6700 1 -- 172.21.15.1:0/523424571 reap_dead start 2023-11-15T01:21:50.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.753+0000 7ff214109700 1 -- 172.21.15.1:0/523424571 shutdown_connections 2023-11-15T01:21:50.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.753+0000 7ff214109700 1 -- 172.21.15.1:0/523424571 >> 172.21.15.1:0/523424571 conn(0x7ff20c064aa0 msgr2=0x7ff20c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:50.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.753+0000 7ff214109700 1 -- 172.21.15.1:0/523424571 shutdown_connections 2023-11-15T01:21:50.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.753+0000 7ff214109700 1 -- 172.21.15.1:0/523424571 wait complete. 2023-11-15T01:21:50.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.754+0000 7ff214109700 1 Processor -- start 2023-11-15T01:21:50.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.754+0000 7ff214109700 1 -- start start 2023-11-15T01:21:50.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff214109700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1f4004b80 0x7ff20c0c2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff214109700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff20c0acd70 0x7ff20c0ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff214109700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff20c14c990 0x7ff20c14cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff214109700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0ca590 con 0x7ff20c14c990 2023-11-15T01:21:50.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff214109700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0c9670 con 0x7ff1f4004b80 2023-11-15T01:21:50.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff214109700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0c9910 con 0x7ff20c0acd70 2023-11-15T01:21:50.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff2126a6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff20c14c990 0x7ff20c14cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff2126a6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff20c14c990 0x7ff20c14cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37170/0 (socket says 172.21.15.1:37170) 2023-11-15T01:21:50.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff2126a6700 1 -- 172.21.15.1:0/2226462807 learned_addr learned my addr 172.21.15.1:0/2226462807 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:50.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff2116a4700 1 --2- 172.21.15.1:0/2226462807 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff20c0acd70 0x7ff20c0ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff211ea5700 1 --2- 172.21.15.1:0/2226462807 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1f4004b80 0x7ff20c0c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff2126a6700 1 -- 172.21.15.1:0/2226462807 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff20c0acd70 msgr2=0x7ff20c0ad1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff2126a6700 1 --2- 172.21.15.1:0/2226462807 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff20c0acd70 0x7ff20c0ad1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff2126a6700 1 -- 172.21.15.1:0/2226462807 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1f4004b80 msgr2=0x7ff20c0c2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff2126a6700 1 --2- 172.21.15.1:0/2226462807 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1f4004b80 0x7ff20c0c2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff2126a6700 1 -- 172.21.15.1:0/2226462807 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c0c9bf0 con 0x7ff20c14c990 2023-11-15T01:21:50.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff211ea5700 1 --2- 172.21.15.1:0/2226462807 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1f4004b80 0x7ff20c0c2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:50.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff2126a6700 1 --2- 172.21.15.1:0/2226462807 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff20c14c990 0x7ff20c14cdd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7ff1f40045a0 tx=0x7ff1fc01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:50.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.755+0000 7ff209ffb700 1 -- 172.21.15.1:0/2226462807 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc00ed30 con 0x7ff20c14c990 2023-11-15T01:21:50.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.756+0000 7ff209ffb700 1 -- 172.21.15.1:0/2226462807 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc00ee90 con 0x7ff20c14c990 2023-11-15T01:21:50.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.756+0000 7ff214109700 1 -- 172.21.15.1:0/2226462807 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20c0c9ed0 con 0x7ff20c14c990 2023-11-15T01:21:50.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.756+0000 7ff209ffb700 1 -- 172.21.15.1:0/2226462807 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc00e9c0 con 0x7ff20c14c990 2023-11-15T01:21:50.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.756+0000 7ff214109700 1 -- 172.21.15.1:0/2226462807 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20c0c2300 con 0x7ff20c14c990 2023-11-15T01:21:50.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.757+0000 7ff214109700 1 -- 172.21.15.1:0/2226462807 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20c0ca6d0 con 0x7ff20c14c990 2023-11-15T01:21:50.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.757+0000 7ff209ffb700 1 -- 172.21.15.1:0/2226462807 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff1fc026650 con 0x7ff20c14c990 2023-11-15T01:21:50.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.757+0000 7ff209ffb700 1 --2- 172.21.15.1:0/2226462807 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff1f805f180 0x7ff1f8061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:50.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.758+0000 7ff209ffb700 1 -- 172.21.15.1:0/2226462807 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff1fc000e40 con 0x7ff20c14c990 2023-11-15T01:21:50.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.758+0000 7ff211ea5700 1 --2- 172.21.15.1:0/2226462807 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff1f805f180 0x7ff1f8061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:50.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.758+0000 7ff211ea5700 1 --2- 172.21.15.1:0/2226462807 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff1f805f180 0x7ff1f8061640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7ff204007e50 tx=0x7ff204009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:50.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.762+0000 7ff209ffb700 1 -- 172.21.15.1:0/2226462807 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff20c0ca6d0 con 0x7ff20c14c990 2023-11-15T01:21:50.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.935+0000 7ff214109700 1 -- 172.21.15.1:0/2226462807 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff20c0ca6d0 con 0x7ff20c14c990 2023-11-15T01:21:50.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.936+0000 7ff209ffb700 1 -- 172.21.15.1:0/2226462807 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16880 (secure 0 0 0) 0x7ff20c0ca6d0 con 0x7ff20c14c990 2023-11-15T01:21:50.939 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:50.939 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:38.047484+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:21:34.763591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-15T01:21:36.025071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:21:50.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.938+0000 7ff214109700 1 -- 172.21.15.1:0/2226462807 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff1f805f180 msgr2=0x7ff1f8061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.938+0000 7ff214109700 1 --2- 172.21.15.1:0/2226462807 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff1f805f180 0x7ff1f8061640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7ff204007e50 tx=0x7ff204009040).stop 2023-11-15T01:21:50.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.938+0000 7ff214109700 1 -- 172.21.15.1:0/2226462807 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff20c14c990 msgr2=0x7ff20c14cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:50.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.938+0000 7ff214109700 1 --2- 172.21.15.1:0/2226462807 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff20c14c990 0x7ff20c14cdd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7ff1f40045a0 tx=0x7ff1fc01a000).stop 2023-11-15T01:21:50.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.938+0000 7ff214109700 1 -- 172.21.15.1:0/2226462807 shutdown_connections 2023-11-15T01:21:50.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.938+0000 7ff214109700 1 --2- 172.21.15.1:0/2226462807 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff1f805f180 0x7ff1f8061640 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.938+0000 7ff214109700 1 --2- 172.21.15.1:0/2226462807 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff20c14c990 0x7ff20c14cdd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.938+0000 7ff214109700 1 --2- 172.21.15.1:0/2226462807 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1f4004b80 0x7ff20c0c2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.938+0000 7ff214109700 1 --2- 172.21.15.1:0/2226462807 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff20c0acd70 0x7ff20c0ad1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:50.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.938+0000 7ff214109700 1 -- 172.21.15.1:0/2226462807 >> 172.21.15.1:0/2226462807 conn(0x7ff20c064aa0 msgr2=0x7ff20c063c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:50.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.938+0000 7ff214109700 1 -- 172.21.15.1:0/2226462807 shutdown_connections 2023-11-15T01:21:50.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:50.938+0000 7ff214109700 1 -- 172.21.15.1:0/2226462807 wait complete. 2023-11-15T01:21:50.951 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T01:21:34.763591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T01:21:36.025071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T01:21:50.951 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:21:51.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.071+0000 7f136e440700 1 Processor -- start 2023-11-15T01:21:51.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.071+0000 7f136e440700 1 -- start start 2023-11-15T01:21:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.072+0000 7f136e440700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1368154480 0x7f13680c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.072+0000 7f136e440700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13680c6430 0x7f13680aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.072+0000 7f136e440700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13680ca050 con 0x7f13681540a0 2023-11-15T01:21:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.072+0000 7f136e440700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13680c68c0 con 0x7f13680c6430 2023-11-15T01:21:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.072+0000 7f136e440700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13680c9440 con 0x7f1368154480 2023-11-15T01:21:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.072+0000 7f136c9dd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13680c6430 0x7f13680aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.072+0000 7f1367fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f13681540a0 0x7f13680ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41588/0 (socket says 172.21.15.1:41588) 2023-11-15T01:21:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.072+0000 7f1367fff700 1 -- 172.21.15.1:0/4127797649 learned_addr learned my addr 172.21.15.1:0/4127797649 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.073+0000 7f13677fe700 1 --2- 172.21.15.1:0/4127797649 >> v2:172.21.15.141:3300/0 conn(0x7f1368154480 0x7f13680c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.073+0000 7f136c9dd700 1 -- 172.21.15.1:0/4127797649 >> v2:172.21.15.141:3300/0 conn(0x7f1368154480 msgr2=0x7f13680c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.073+0000 7f136c9dd700 1 --2- 172.21.15.1:0/4127797649 >> v2:172.21.15.141:3300/0 conn(0x7f1368154480 0x7f13680c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.073+0000 7f136c9dd700 1 -- 172.21.15.1:0/4127797649 >> v1:172.21.15.1:6789/0 conn(0x7f13681540a0 legacy=0x7f13680ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.073+0000 7f136c9dd700 1 -- 172.21.15.1:0/4127797649 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13680c9720 con 0x7f13680c6430 2023-11-15T01:21:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.073+0000 7f1366ffd700 1 -- 172.21.15.1:0/4127797649 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881802990 0 0) 0x7f13680ca050 con 0x7f13681540a0 2023-11-15T01:21:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.073+0000 7f13677fe700 1 --2- 172.21.15.1:0/4127797649 >> v2:172.21.15.141:3300/0 conn(0x7f1368154480 0x7f13680c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.073+0000 7f136c9dd700 1 --2- 172.21.15.1:0/4127797649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13680c6430 0x7f13680aaf40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f13680c88f0 tx=0x7f1360009780).ready entity=mon.0 client_cookie=449113400eca9d6e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.073+0000 7f1366ffd700 1 -- 172.21.15.1:0/4127797649 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136000e070 con 0x7f13680c6430 2023-11-15T01:21:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.073+0000 7f1366ffd700 1 -- 172.21.15.1:0/4127797649 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136000bc30 con 0x7f13680c6430 2023-11-15T01:21:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.073+0000 7f1366ffd700 1 -- 172.21.15.1:0/4127797649 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360012410 con 0x7f13680c6430 2023-11-15T01:21:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.074+0000 7f136e440700 1 -- 172.21.15.1:0/4127797649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13680c6430 msgr2=0x7f13680aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.074+0000 7f136e440700 1 --2- 172.21.15.1:0/4127797649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13680c6430 0x7f13680aaf40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f13680c88f0 tx=0x7f1360009780).stop 2023-11-15T01:21:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.074+0000 7f136e440700 1 -- 172.21.15.1:0/4127797649 shutdown_connections 2023-11-15T01:21:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.074+0000 7f136e440700 1 --2- 172.21.15.1:0/4127797649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13680c6430 0x7f13680aaf40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.074+0000 7f136e440700 1 --2- 172.21.15.1:0/4127797649 >> v2:172.21.15.141:3300/0 conn(0x7f1368154480 0x7f13680c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.074+0000 7f136e440700 1 -- 172.21.15.1:0/4127797649 >> 172.21.15.1:0/4127797649 conn(0x7f1368064a70 msgr2=0x7f1368064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.074+0000 7f136e440700 1 -- 172.21.15.1:0/4127797649 shutdown_connections 2023-11-15T01:21:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.074+0000 7f136e440700 1 -- 172.21.15.1:0/4127797649 wait complete. 2023-11-15T01:21:51.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.075+0000 7f136e440700 1 Processor -- start 2023-11-15T01:21:51.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.075+0000 7f136e440700 1 -- start start 2023-11-15T01:21:51.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f136e440700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13680c6430 0x7f13680c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f136e440700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13681540a0 0x7f1368164ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f136e440700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1368154480 0x7f13680c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f136e440700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13681651d0 con 0x7f13681540a0 2023-11-15T01:21:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f136e440700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13680ae2b0 con 0x7f13680c6430 2023-11-15T01:21:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f136e440700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13680c4f20 con 0x7f1368154480 2023-11-15T01:21:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f13677fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13681540a0 0x7f1368164ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f13677fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13681540a0 0x7f1368164ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37194/0 (socket says 172.21.15.1:37194) 2023-11-15T01:21:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f13677fe700 1 -- 172.21.15.1:0/465761580 learned_addr learned my addr 172.21.15.1:0/465761580 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:51.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f1367fff700 1 --2- 172.21.15.1:0/465761580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13680c6430 0x7f13680c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f136c9dd700 1 --2- 172.21.15.1:0/465761580 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1368154480 0x7f13680c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f13677fe700 1 -- 172.21.15.1:0/465761580 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1368154480 msgr2=0x7f13680c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f13677fe700 1 --2- 172.21.15.1:0/465761580 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1368154480 0x7f13680c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f13677fe700 1 -- 172.21.15.1:0/465761580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13680c6430 msgr2=0x7f13680c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f13677fe700 1 --2- 172.21.15.1:0/465761580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13680c6430 0x7f13680c2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f13677fe700 1 -- 172.21.15.1:0/465761580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1360009a20 con 0x7f13681540a0 2023-11-15T01:21:51.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f1367fff700 1 --2- 172.21.15.1:0/465761580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13680c6430 0x7f13680c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:51.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f13677fe700 1 --2- 172.21.15.1:0/465761580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13681540a0 0x7f1368164ce0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f135c00c8b0 tx=0x7f135c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:51.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.076+0000 7f134ffff700 1 -- 172.21.15.1:0/465761580 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c010580 con 0x7f13681540a0 2023-11-15T01:21:51.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.077+0000 7f134ffff700 1 -- 172.21.15.1:0/465761580 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c0106e0 con 0x7f13681540a0 2023-11-15T01:21:51.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.077+0000 7f134ffff700 1 -- 172.21.15.1:0/465761580 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c010a60 con 0x7f13681540a0 2023-11-15T01:21:51.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.077+0000 7f136e440700 1 -- 172.21.15.1:0/465761580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13680c3e50 con 0x7f13681540a0 2023-11-15T01:21:51.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.077+0000 7f136e440700 1 -- 172.21.15.1:0/465761580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13680c43f0 con 0x7f13681540a0 2023-11-15T01:21:51.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.078+0000 7f136e440700 1 -- 172.21.15.1:0/465761580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13680ae080 con 0x7f13681540a0 2023-11-15T01:21:51.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.078+0000 7f134ffff700 1 -- 172.21.15.1:0/465761580 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f135c01b460 con 0x7f13681540a0 2023-11-15T01:21:51.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.078+0000 7f134ffff700 1 --2- 172.21.15.1:0/465761580 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f135405f150 0x7f1354061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.078+0000 7f134ffff700 1 -- 172.21.15.1:0/465761580 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f135c07a1a0 con 0x7f13681540a0 2023-11-15T01:21:51.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.078+0000 7f1367fff700 1 --2- 172.21.15.1:0/465761580 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f135405f150 0x7f1354061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.079+0000 7f1367fff700 1 --2- 172.21.15.1:0/465761580 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f135405f150 0x7f1354061610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1358007fd0 tx=0x7f1358009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:51.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.082+0000 7f134ffff700 1 -- 172.21.15.1:0/465761580 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f13680ae080 con 0x7f13681540a0 2023-11-15T01:21:51.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.254+0000 7f136e440700 1 -- 172.21.15.1:0/465761580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f13680ae080 con 0x7f13681540a0 2023-11-15T01:21:51.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.255+0000 7f134ffff700 1 -- 172.21.15.1:0/465761580 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f135c04b410 con 0x7f13681540a0 2023-11-15T01:21:51.255 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:21:51.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.256+0000 7f136e440700 1 -- 172.21.15.1:0/465761580 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f135405f150 msgr2=0x7f1354061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.256+0000 7f136e440700 1 --2- 172.21.15.1:0/465761580 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f135405f150 0x7f1354061610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1358007fd0 tx=0x7f1358009040).stop 2023-11-15T01:21:51.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.256+0000 7f136e440700 1 -- 172.21.15.1:0/465761580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13681540a0 msgr2=0x7f1368164ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.256+0000 7f136e440700 1 --2- 172.21.15.1:0/465761580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13681540a0 0x7f1368164ce0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f135c00c8b0 tx=0x7f135c008040).stop 2023-11-15T01:21:51.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.256+0000 7f136e440700 1 -- 172.21.15.1:0/465761580 shutdown_connections 2023-11-15T01:21:51.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.256+0000 7f136e440700 1 --2- 172.21.15.1:0/465761580 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f135405f150 0x7f1354061610 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.256+0000 7f136e440700 1 --2- 172.21.15.1:0/465761580 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1368154480 0x7f13680c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.256+0000 7f136e440700 1 --2- 172.21.15.1:0/465761580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13680c6430 0x7f13680c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.256+0000 7f136e440700 1 --2- 172.21.15.1:0/465761580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13681540a0 0x7f1368164ce0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.256+0000 7f136e440700 1 -- 172.21.15.1:0/465761580 >> 172.21.15.1:0/465761580 conn(0x7f1368064a70 msgr2=0x7f13680c14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:51.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.257+0000 7f136e440700 1 -- 172.21.15.1:0/465761580 shutdown_connections 2023-11-15T01:21:51.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.257+0000 7f136e440700 1 -- 172.21.15.1:0/465761580 wait complete. 2023-11-15T01:21:51.269 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:21:51.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.390+0000 7f9ed9137700 1 Processor -- start 2023-11-15T01:21:51.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.390+0000 7f9ed9137700 1 -- start start 2023-11-15T01:21:51.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed9137700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9ed41540a0 0x7f9ed40ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed9137700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ed40c6650 0x7f9ed40ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed9137700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed40ca050 con 0x7f9ed4154480 2023-11-15T01:21:51.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed9137700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed40c9440 con 0x7f9ed41540a0 2023-11-15T01:21:51.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed9137700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed40c9720 con 0x7f9ed40c6650 2023-11-15T01:21:51.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed2d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9ed41540a0 0x7f9ed40ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed259c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9ed4154480 0x7f9ed40c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41602/0 (socket says 172.21.15.1:41602) 2023-11-15T01:21:51.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed259c700 1 -- 172.21.15.1:0/2257152884 learned_addr learned my addr 172.21.15.1:0/2257152884 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:51.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed359e700 1 --2- 172.21.15.1:0/2257152884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ed40c6650 0x7f9ed40ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed2d9d700 1 -- 172.21.15.1:0/2257152884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ed40c6650 msgr2=0x7f9ed40ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:51.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed2d9d700 1 --2- 172.21.15.1:0/2257152884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ed40c6650 0x7f9ed40ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed2d9d700 1 -- 172.21.15.1:0/2257152884 >> v1:172.21.15.1:6789/0 conn(0x7f9ed4154480 legacy=0x7f9ed40c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed2d9d700 1 -- 172.21.15.1:0/2257152884 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed40c9a00 con 0x7f9ed41540a0 2023-11-15T01:21:51.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed1d9b700 1 -- 172.21.15.1:0/2257152884 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735474407 0 0) 0x7f9ed40ca050 con 0x7f9ed4154480 2023-11-15T01:21:51.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed2d9d700 1 --2- 172.21.15.1:0/2257152884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed41540a0 0x7f9ed40ca4e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f9ecc009760 tx=0x7f9ecc009060).ready entity=mon.0 client_cookie=e762013c08f9ced2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:51.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.391+0000 7f9ed1d9b700 1 -- 172.21.15.1:0/2257152884 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00b580 con 0x7f9ed41540a0 2023-11-15T01:21:51.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.392+0000 7f9ed1d9b700 1 -- 172.21.15.1:0/2257152884 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc00b6e0 con 0x7f9ed41540a0 2023-11-15T01:21:51.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.392+0000 7f9ed1d9b700 1 -- 172.21.15.1:0/2257152884 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00ba60 con 0x7f9ed41540a0 2023-11-15T01:21:51.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.392+0000 7f9ed9137700 1 -- 172.21.15.1:0/2257152884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed41540a0 msgr2=0x7f9ed40ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.392+0000 7f9ed9137700 1 --2- 172.21.15.1:0/2257152884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed41540a0 0x7f9ed40ca4e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f9ecc009760 tx=0x7f9ecc009060).stop 2023-11-15T01:21:51.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.392+0000 7f9ed9137700 1 -- 172.21.15.1:0/2257152884 shutdown_connections 2023-11-15T01:21:51.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.392+0000 7f9ed9137700 1 --2- 172.21.15.1:0/2257152884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ed40c6650 0x7f9ed40ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.392+0000 7f9ed9137700 1 --2- 172.21.15.1:0/2257152884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed41540a0 0x7f9ed40ca4e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.392+0000 7f9ed9137700 1 -- 172.21.15.1:0/2257152884 >> 172.21.15.1:0/2257152884 conn(0x7f9ed4064a70 msgr2=0x7f9ed4064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:51.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.392+0000 7f9ed9137700 1 -- 172.21.15.1:0/2257152884 shutdown_connections 2023-11-15T01:21:51.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.392+0000 7f9ed9137700 1 -- 172.21.15.1:0/2257152884 wait complete. 2023-11-15T01:21:51.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.393+0000 7f9ed9137700 1 Processor -- start 2023-11-15T01:21:51.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.393+0000 7f9ed9137700 1 -- start start 2023-11-15T01:21:51.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed9137700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ed40c6650 0x7f9ed4150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed9137700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed41540a0 0x7f9ed40c3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed9137700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ed4154480 0x7f9ed4152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed9137700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed40c4c40 con 0x7f9ed41540a0 2023-11-15T01:21:51.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed9137700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed40c4030 con 0x7f9ed40c6650 2023-11-15T01:21:51.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed9137700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed40c4310 con 0x7f9ed4154480 2023-11-15T01:21:51.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed41540a0 0x7f9ed40c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed41540a0 0x7f9ed40c3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37214/0 (socket says 172.21.15.1:37214) 2023-11-15T01:21:51.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed259c700 1 -- 172.21.15.1:0/3965564611 learned_addr learned my addr 172.21.15.1:0/3965564611 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:51.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed2d9d700 1 --2- 172.21.15.1:0/3965564611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ed40c6650 0x7f9ed4150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed359e700 1 --2- 172.21.15.1:0/3965564611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ed4154480 0x7f9ed4152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed259c700 1 -- 172.21.15.1:0/3965564611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ed4154480 msgr2=0x7f9ed4152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed259c700 1 --2- 172.21.15.1:0/3965564611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ed4154480 0x7f9ed4152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed259c700 1 -- 172.21.15.1:0/3965564611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ed40c6650 msgr2=0x7f9ed4150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed259c700 1 --2- 172.21.15.1:0/3965564611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ed40c6650 0x7f9ed4150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.394+0000 7f9ed259c700 1 -- 172.21.15.1:0/3965564611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0092a0 con 0x7f9ed41540a0 2023-11-15T01:21:51.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.395+0000 7f9ed259c700 1 --2- 172.21.15.1:0/3965564611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed41540a0 0x7f9ed40c3600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f9ebc001eb0 tx=0x7f9ebc007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:51.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.395+0000 7f9ecaffd700 1 -- 172.21.15.1:0/3965564611 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0070d0 con 0x7f9ed41540a0 2023-11-15T01:21:51.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.395+0000 7f9ecaffd700 1 -- 172.21.15.1:0/3965564611 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc007230 con 0x7f9ed41540a0 2023-11-15T01:21:51.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.395+0000 7f9ed9137700 1 -- 172.21.15.1:0/3965564611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed40c45f0 con 0x7f9ed41540a0 2023-11-15T01:21:51.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.395+0000 7f9ecaffd700 1 -- 172.21.15.1:0/3965564611 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0075d0 con 0x7f9ed41540a0 2023-11-15T01:21:51.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.395+0000 7f9ed9137700 1 -- 172.21.15.1:0/3965564611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed4151160 con 0x7f9ed41540a0 2023-11-15T01:21:51.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.396+0000 7f9ed9137700 1 -- 172.21.15.1:0/3965564611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed406c7e0 con 0x7f9ed41540a0 2023-11-15T01:21:51.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.396+0000 7f9ecaffd700 1 -- 172.21.15.1:0/3965564611 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9ebc005bc0 con 0x7f9ed41540a0 2023-11-15T01:21:51.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.396+0000 7f9ecaffd700 1 --2- 172.21.15.1:0/3965564611 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9eb405f150 0x7f9eb4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.396+0000 7f9ecaffd700 1 -- 172.21.15.1:0/3965564611 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9ebc079a20 con 0x7f9ed41540a0 2023-11-15T01:21:51.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.397+0000 7f9ed2d9d700 1 --2- 172.21.15.1:0/3965564611 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9eb405f150 0x7f9eb4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.397+0000 7f9ed2d9d700 1 --2- 172.21.15.1:0/3965564611 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9eb405f150 0x7f9eb4061610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f9ecc00b340 tx=0x7f9ecc017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:51.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.400+0000 7f9ecaffd700 1 -- 172.21.15.1:0/3965564611 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9ebc04acf0 con 0x7f9ed41540a0 2023-11-15T01:21:51.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.572+0000 7f9ed9137700 1 -- 172.21.15.1:0/3965564611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9ed40c9ce0 con 0x7f9ed41540a0 2023-11-15T01:21:51.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.573+0000 7f9ecaffd700 1 -- 172.21.15.1:0/3965564611 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9ebc04e310 con 0x7f9ed41540a0 2023-11-15T01:21:51.574 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:21:51.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.575+0000 7f9ed9137700 1 -- 172.21.15.1:0/3965564611 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9eb405f150 msgr2=0x7f9eb4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.575+0000 7f9ed9137700 1 --2- 172.21.15.1:0/3965564611 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9eb405f150 0x7f9eb4061610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f9ecc00b340 tx=0x7f9ecc017000).stop 2023-11-15T01:21:51.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.575+0000 7f9ed9137700 1 -- 172.21.15.1:0/3965564611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed41540a0 msgr2=0x7f9ed40c3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.575+0000 7f9ed9137700 1 --2- 172.21.15.1:0/3965564611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed41540a0 0x7f9ed40c3600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f9ebc001eb0 tx=0x7f9ebc007e90).stop 2023-11-15T01:21:51.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.575+0000 7f9ed9137700 1 -- 172.21.15.1:0/3965564611 shutdown_connections 2023-11-15T01:21:51.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.575+0000 7f9ed9137700 1 --2- 172.21.15.1:0/3965564611 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9eb405f150 0x7f9eb4061610 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.575+0000 7f9ed9137700 1 --2- 172.21.15.1:0/3965564611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ed4154480 0x7f9ed4152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.575+0000 7f9ed9137700 1 --2- 172.21.15.1:0/3965564611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ed40c6650 0x7f9ed4150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.575+0000 7f9ed9137700 1 --2- 172.21.15.1:0/3965564611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed41540a0 0x7f9ed40c3600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.575+0000 7f9ed9137700 1 -- 172.21.15.1:0/3965564611 >> 172.21.15.1:0/3965564611 conn(0x7f9ed4064a70 msgr2=0x7f9ed40ab1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:51.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.575+0000 7f9ed9137700 1 -- 172.21.15.1:0/3965564611 shutdown_connections 2023-11-15T01:21:51.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.575+0000 7f9ed9137700 1 -- 172.21.15.1:0/3965564611 wait complete. 2023-11-15T01:21:51.587 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T01:21:51.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.708+0000 7f9d1b0a6700 1 Processor -- start 2023-11-15T01:21:51.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.708+0000 7f9d1b0a6700 1 -- start start 2023-11-15T01:21:51.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d1b0a6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d141541d0 0x7f9d141545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d1b0a6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9d140c60d0 0x7f9d140c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d1b0a6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d14155830 con 0x7f9d140c7a60 2023-11-15T01:21:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d1b0a6700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d14158f40 con 0x7f9d140c60d0 2023-11-15T01:21:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d1b0a6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d14154c20 con 0x7f9d141541d0 2023-11-15T01:21:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d198a3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9d140c60d0 0x7f9d140c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d1a8a5700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9d140c7a60 0x7f9d14063640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41606/0 (socket says 172.21.15.1:41606) 2023-11-15T01:21:51.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d198a3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9d140c60d0 0x7f9d140c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37216/0 (socket says 172.21.15.1:37216) 2023-11-15T01:21:51.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d1a8a5700 1 -- 172.21.15.1:0/2196212093 learned_addr learned my addr 172.21.15.1:0/2196212093 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:51.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d1a0a4700 1 --2- 172.21.15.1:0/2196212093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d141541d0 0x7f9d141545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d198a3700 1 -- 172.21.15.1:0/2196212093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d141541d0 msgr2=0x7f9d141545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:51.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d198a3700 1 --2- 172.21.15.1:0/2196212093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d141541d0 0x7f9d141545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d198a3700 1 -- 172.21.15.1:0/2196212093 >> v1:172.21.15.1:6789/0 conn(0x7f9d140c7a60 legacy=0x7f9d14063640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d198a3700 1 -- 172.21.15.1:0/2196212093 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d14154f00 con 0x7f9d140c60d0 2023-11-15T01:21:51.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d190a2700 1 -- 172.21.15.1:0/2196212093 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245579705 0 0) 0x7f9d14155830 con 0x7f9d140c7a60 2023-11-15T01:21:51.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d198a3700 1 --2- 172.21.15.1:0/2196212093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d140c60d0 0x7f9d140c6550 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f9d08009760 tx=0x7f9d08009060).ready entity=mon.0 client_cookie=f6c2a09dec7716ec server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:51.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d190a2700 1 -- 172.21.15.1:0/2196212093 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0800b580 con 0x7f9d140c60d0 2023-11-15T01:21:51.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d190a2700 1 -- 172.21.15.1:0/2196212093 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0800b6e0 con 0x7f9d140c60d0 2023-11-15T01:21:51.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.709+0000 7f9d190a2700 1 -- 172.21.15.1:0/2196212093 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0800ba60 con 0x7f9d140c60d0 2023-11-15T01:21:51.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.710+0000 7f9d1b0a6700 1 -- 172.21.15.1:0/2196212093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d140c60d0 msgr2=0x7f9d140c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.710+0000 7f9d1b0a6700 1 --2- 172.21.15.1:0/2196212093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d140c60d0 0x7f9d140c6550 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f9d08009760 tx=0x7f9d08009060).stop 2023-11-15T01:21:51.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.710+0000 7f9d1b0a6700 1 -- 172.21.15.1:0/2196212093 shutdown_connections 2023-11-15T01:21:51.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.710+0000 7f9d1b0a6700 1 --2- 172.21.15.1:0/2196212093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d141541d0 0x7f9d141545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.710+0000 7f9d1b0a6700 1 --2- 172.21.15.1:0/2196212093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d140c60d0 0x7f9d140c6550 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.710+0000 7f9d1b0a6700 1 -- 172.21.15.1:0/2196212093 >> 172.21.15.1:0/2196212093 conn(0x7f9d14069ee0 msgr2=0x7f9d1406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:51.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.710+0000 7f9d1b0a6700 1 -- 172.21.15.1:0/2196212093 shutdown_connections 2023-11-15T01:21:51.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.710+0000 7f9d1b0a6700 1 -- 172.21.15.1:0/2196212093 wait complete. 2023-11-15T01:21:51.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.711+0000 7f9d1b0a6700 1 Processor -- start 2023-11-15T01:21:51.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.711+0000 7f9d1b0a6700 1 -- start start 2023-11-15T01:21:51.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d1b0a6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d140c60d0 0x7f9d140ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d1b0a6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d140c7a60 0x7f9d14164c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d1b0a6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d141541d0 0x7f9d141678b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d1b0a6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1414d760 con 0x7f9d140c7a60 2023-11-15T01:21:51.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d1b0a6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140afdb0 con 0x7f9d141541d0 2023-11-15T01:21:51.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d1b0a6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140b0090 con 0x7f9d140c60d0 2023-11-15T01:21:51.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d198a3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d140c7a60 0x7f9d14164c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d198a3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d140c7a60 0x7f9d14164c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37228/0 (socket says 172.21.15.1:37228) 2023-11-15T01:21:51.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d198a3700 1 -- 172.21.15.1:0/3401270634 learned_addr learned my addr 172.21.15.1:0/3401270634 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:51.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d1a0a4700 1 --2- 172.21.15.1:0/3401270634 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d140c60d0 0x7f9d140ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d1a8a5700 1 --2- 172.21.15.1:0/3401270634 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d141541d0 0x7f9d141678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d198a3700 1 -- 172.21.15.1:0/3401270634 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d140c60d0 msgr2=0x7f9d140ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d198a3700 1 --2- 172.21.15.1:0/3401270634 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d140c60d0 0x7f9d140ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d198a3700 1 -- 172.21.15.1:0/3401270634 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d141541d0 msgr2=0x7f9d141678b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d198a3700 1 --2- 172.21.15.1:0/3401270634 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d141541d0 0x7f9d141678b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d198a3700 1 -- 172.21.15.1:0/3401270634 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d080092a0 con 0x7f9d140c7a60 2023-11-15T01:21:51.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.712+0000 7f9d198a3700 1 --2- 172.21.15.1:0/3401270634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d140c7a60 0x7f9d14164c00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f9d08011000 tx=0x7f9d08017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:51.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.713+0000 7f9d127fc700 1 -- 172.21.15.1:0/3401270634 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08000bc0 con 0x7f9d140c7a60 2023-11-15T01:21:51.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.713+0000 7f9d127fc700 1 -- 172.21.15.1:0/3401270634 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0800b850 con 0x7f9d140c7a60 2023-11-15T01:21:51.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.713+0000 7f9d1b0a6700 1 -- 172.21.15.1:0/3401270634 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d140ae890 con 0x7f9d140c7a60 2023-11-15T01:21:51.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.713+0000 7f9d127fc700 1 -- 172.21.15.1:0/3401270634 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08000d20 con 0x7f9d140c7a60 2023-11-15T01:21:51.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.713+0000 7f9d1b0a6700 1 -- 172.21.15.1:0/3401270634 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d140aee50 con 0x7f9d140c7a60 2023-11-15T01:21:51.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.714+0000 7f9d1b0a6700 1 -- 172.21.15.1:0/3401270634 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d140b0200 con 0x7f9d140c7a60 2023-11-15T01:21:51.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.714+0000 7f9d127fc700 1 -- 172.21.15.1:0/3401270634 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9d0801bb00 con 0x7f9d140c7a60 2023-11-15T01:21:51.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.714+0000 7f9d127fc700 1 --2- 172.21.15.1:0/3401270634 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d0005f150 0x7f9d00061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:51.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.714+0000 7f9d127fc700 1 -- 172.21.15.1:0/3401270634 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9d0807bd90 con 0x7f9d140c7a60 2023-11-15T01:21:51.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.714+0000 7f9d1a0a4700 1 --2- 172.21.15.1:0/3401270634 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d0005f150 0x7f9d00061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:51.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.715+0000 7f9d1a0a4700 1 --2- 172.21.15.1:0/3401270634 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d0005f150 0x7f9d00061610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9d0c00bb10 tx=0x7f9d0c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:51.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.718+0000 7f9d127fc700 1 -- 172.21.15.1:0/3401270634 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9d0804d000 con 0x7f9d140c7a60 2023-11-15T01:21:51.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.892+0000 7f9d1b0a6700 1 -- 172.21.15.1:0/3401270634 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d140475e0 con 0x7f9d140c7a60 2023-11-15T01:21:51.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.892+0000 7f9d127fc700 1 -- 172.21.15.1:0/3401270634 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d0801f0a0 con 0x7f9d140c7a60 2023-11-15T01:21:51.893 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:21:51.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.894+0000 7f9d1b0a6700 1 -- 172.21.15.1:0/3401270634 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d0005f150 msgr2=0x7f9d00061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.894+0000 7f9d1b0a6700 1 --2- 172.21.15.1:0/3401270634 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d0005f150 0x7f9d00061610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9d0c00bb10 tx=0x7f9d0c008040).stop 2023-11-15T01:21:51.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.894+0000 7f9d1b0a6700 1 -- 172.21.15.1:0/3401270634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d140c7a60 msgr2=0x7f9d14164c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:51.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.894+0000 7f9d1b0a6700 1 --2- 172.21.15.1:0/3401270634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d140c7a60 0x7f9d14164c00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f9d08011000 tx=0x7f9d08017000).stop 2023-11-15T01:21:51.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.894+0000 7f9d1b0a6700 1 -- 172.21.15.1:0/3401270634 shutdown_connections 2023-11-15T01:21:51.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.894+0000 7f9d1b0a6700 1 --2- 172.21.15.1:0/3401270634 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d0005f150 0x7f9d00061610 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.894+0000 7f9d1b0a6700 1 --2- 172.21.15.1:0/3401270634 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d141541d0 0x7f9d141678b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.894+0000 7f9d1b0a6700 1 --2- 172.21.15.1:0/3401270634 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d140c60d0 0x7f9d140ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.894+0000 7f9d1b0a6700 1 --2- 172.21.15.1:0/3401270634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d140c7a60 0x7f9d14164c00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:51.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.894+0000 7f9d1b0a6700 1 -- 172.21.15.1:0/3401270634 >> 172.21.15.1:0/3401270634 conn(0x7f9d14069ee0 msgr2=0x7f9d140c1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:51.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.894+0000 7f9d1b0a6700 1 -- 172.21.15.1:0/3401270634 shutdown_connections 2023-11-15T01:21:51.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:51.894+0000 7f9d1b0a6700 1 -- 172.21.15.1:0/3401270634 wait complete. 2023-11-15T01:21:51.906 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T01:21:52.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.026+0000 7fd31a13b700 1 Processor -- start 2023-11-15T01:21:52.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.027+0000 7fd31a13b700 1 -- start start 2023-11-15T01:21:52.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.027+0000 7fd31a13b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd3141520c0 0x7fd3140c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.027+0000 7fd31a13b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3140637c0 0x7fd314156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.027+0000 7fd31a13b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3140c5b30 con 0x7fd314155db0 2023-11-15T01:21:52.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.027+0000 7fd31a13b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd314156720 con 0x7fd3141520c0 2023-11-15T01:21:52.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.027+0000 7fd31a13b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3140c5520 con 0x7fd3140637c0 2023-11-15T01:21:52.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.027+0000 7fd312ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd314155db0 0x7fd3140c5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41614/0 (socket says 172.21.15.1:41614) 2023-11-15T01:21:52.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd312ffd700 1 -- 172.21.15.1:0/4070509182 learned_addr learned my addr 172.21.15.1:0/4070509182 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:52.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd313fff700 1 --2- 172.21.15.1:0/4070509182 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3140637c0 0x7fd314156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 -- 172.21.15.1:0/4070509182 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669185164 0 0) 0x7fd3140c5b30 con 0x7fd314155db0 2023-11-15T01:21:52.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 -- 172.21.15.1:0/4070509182 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2fc0033f0 con 0x7fd314155db0 2023-11-15T01:21:52.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3137fe700 1 --2- 172.21.15.1:0/4070509182 >> v2:172.21.15.141:3300/0 conn(0x7fd3141520c0 0x7fd3140c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 -- 172.21.15.1:0/4070509182 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2641597331 0 0) 0x7fd2fc0033f0 con 0x7fd314155db0 2023-11-15T01:21:52.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 -- 172.21.15.1:0/4070509182 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3140637c0 msgr2=0x7fd314156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:52.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 --2- 172.21.15.1:0/4070509182 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3140637c0 0x7fd314156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 -- 172.21.15.1:0/4070509182 >> v2:172.21.15.141:3300/0 conn(0x7fd3141520c0 msgr2=0x7fd3140c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:52.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 --2- 172.21.15.1:0/4070509182 >> v2:172.21.15.141:3300/0 conn(0x7fd3141520c0 0x7fd3140c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 -- 172.21.15.1:0/4070509182 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3140c4f10 con 0x7fd314155db0 2023-11-15T01:21:52.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 -- 172.21.15.1:0/4070509182 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fd308001470 con 0x7fd314155db0 2023-11-15T01:21:52.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3137fe700 1 --2- 172.21.15.1:0/4070509182 >> v2:172.21.15.141:3300/0 conn(0x7fd3141520c0 0x7fd3140c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:52.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 -- 172.21.15.1:0/4070509182 >> v1:172.21.15.1:6789/0 conn(0x7fd314155db0 legacy=0x7fd3140c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 --2- 172.21.15.1:0/4070509182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2fc0038e0 0x7fd2fc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 --2- 172.21.15.1:0/4070509182 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3140637c0 0x7fd2fc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 --2- 172.21.15.1:0/4070509182 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2fc004b80 0x7fd2fc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 -- 172.21.15.1:0/4070509182 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd314156720 con 0x7fd2fc0038e0 2023-11-15T01:21:52.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 -- 172.21.15.1:0/4070509182 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3140c5520 con 0x7fd2fc004b80 2023-11-15T01:21:52.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3127fc700 1 -- 172.21.15.1:0/4070509182 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc00b8e0 con 0x7fd3140637c0 2023-11-15T01:21:52.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3137fe700 1 --2- 172.21.15.1:0/4070509182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2fc0038e0 0x7fd2fc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd312ffd700 1 --2- 172.21.15.1:0/4070509182 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3140637c0 0x7fd2fc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd313fff700 1 --2- 172.21.15.1:0/4070509182 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2fc004b80 0x7fd2fc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3137fe700 1 -- 172.21.15.1:0/4070509182 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3140637c0 msgr2=0x7fd2fc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:52.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3137fe700 1 --2- 172.21.15.1:0/4070509182 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3140637c0 0x7fd2fc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3137fe700 1 -- 172.21.15.1:0/4070509182 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2fc004b80 msgr2=0x7fd2fc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:52.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3137fe700 1 --2- 172.21.15.1:0/4070509182 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2fc004b80 0x7fd2fc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd3137fe700 1 -- 172.21.15.1:0/4070509182 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc0033f0 con 0x7fd2fc0038e0 2023-11-15T01:21:52.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.028+0000 7fd313fff700 1 --2- 172.21.15.1:0/4070509182 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2fc004b80 0x7fd2fc005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:52.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.029+0000 7fd3137fe700 1 --2- 172.21.15.1:0/4070509182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2fc0038e0 0x7fd2fc003d00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fd30400bad0 tx=0x7fd304008040).ready entity=mon.0 client_cookie=468167f9199dc7e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:52.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.029+0000 7fd3127fc700 1 -- 172.21.15.1:0/4070509182 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30400b410 con 0x7fd2fc0038e0 2023-11-15T01:21:52.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.029+0000 7fd3127fc700 1 -- 172.21.15.1:0/4070509182 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30400d5d0 con 0x7fd2fc0038e0 2023-11-15T01:21:52.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.029+0000 7fd3127fc700 1 -- 172.21.15.1:0/4070509182 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30400d950 con 0x7fd2fc0038e0 2023-11-15T01:21:52.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.029+0000 7fd31a13b700 1 -- 172.21.15.1:0/4070509182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2fc0038e0 msgr2=0x7fd2fc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.029+0000 7fd31a13b700 1 --2- 172.21.15.1:0/4070509182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2fc0038e0 0x7fd2fc003d00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fd30400bad0 tx=0x7fd304008040).stop 2023-11-15T01:21:52.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.029+0000 7fd313fff700 1 -- 172.21.15.1:0/4070509182 reap_dead start 2023-11-15T01:21:52.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.029+0000 7fd31a13b700 1 -- 172.21.15.1:0/4070509182 shutdown_connections 2023-11-15T01:21:52.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.029+0000 7fd31a13b700 1 -- 172.21.15.1:0/4070509182 >> 172.21.15.1:0/4070509182 conn(0x7fd3140c8050 msgr2=0x7fd3140c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:52.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.029+0000 7fd31a13b700 1 -- 172.21.15.1:0/4070509182 shutdown_connections 2023-11-15T01:21:52.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.029+0000 7fd31a13b700 1 -- 172.21.15.1:0/4070509182 wait complete. 2023-11-15T01:21:52.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.031+0000 7fd31a13b700 1 Processor -- start 2023-11-15T01:21:52.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.031+0000 7fd31a13b700 1 -- start start 2023-11-15T01:21:52.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.031+0000 7fd31a13b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2fc0038e0 0x7fd3140acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.031+0000 7fd31a13b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3140acfd0 0x7fd3141524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.031+0000 7fd31a13b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd314152990 0x7fd314152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.031+0000 7fd31a13b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd314162740 con 0x7fd3140acfd0 2023-11-15T01:21:52.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.031+0000 7fd31a13b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3140aa8d0 con 0x7fd2fc0038e0 2023-11-15T01:21:52.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.031+0000 7fd31a13b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3140aa5d0 con 0x7fd314152990 2023-11-15T01:21:52.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.031+0000 7fd312ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3140acfd0 0x7fd3141524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.031+0000 7fd312ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3140acfd0 0x7fd3141524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37240/0 (socket says 172.21.15.1:37240) 2023-11-15T01:21:52.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.031+0000 7fd312ffd700 1 -- 172.21.15.1:0/1350490864 learned_addr learned my addr 172.21.15.1:0/1350490864 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:52.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.032+0000 7fd313fff700 1 --2- 172.21.15.1:0/1350490864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd314152990 0x7fd314152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.032+0000 7fd312ffd700 1 -- 172.21.15.1:0/1350490864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd314152990 msgr2=0x7fd314152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.032+0000 7fd312ffd700 1 --2- 172.21.15.1:0/1350490864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd314152990 0x7fd314152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.032+0000 7fd3137fe700 1 --2- 172.21.15.1:0/1350490864 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2fc0038e0 0x7fd3140acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.032+0000 7fd312ffd700 1 -- 172.21.15.1:0/1350490864 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2fc0038e0 msgr2=0x7fd3140acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.032+0000 7fd312ffd700 1 --2- 172.21.15.1:0/1350490864 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2fc0038e0 0x7fd3140acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.032+0000 7fd312ffd700 1 -- 172.21.15.1:0/1350490864 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3140a68b0 con 0x7fd3140acfd0 2023-11-15T01:21:52.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.032+0000 7fd3137fe700 1 --2- 172.21.15.1:0/1350490864 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2fc0038e0 0x7fd3140acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:52.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.032+0000 7fd312ffd700 1 --2- 172.21.15.1:0/1350490864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3140acfd0 0x7fd3141524a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fd308004970 tx=0x7fd308001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:52.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.032+0000 7fd2fb7fe700 1 -- 172.21.15.1:0/1350490864 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30800f9a0 con 0x7fd3140acfd0 2023-11-15T01:21:52.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.032+0000 7fd2fb7fe700 1 -- 172.21.15.1:0/1350490864 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30800fb00 con 0x7fd3140acfd0 2023-11-15T01:21:52.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.032+0000 7fd31a13b700 1 -- 172.21.15.1:0/1350490864 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd314153690 con 0x7fd3140acfd0 2023-11-15T01:21:52.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.032+0000 7fd2fb7fe700 1 -- 172.21.15.1:0/1350490864 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30800fe80 con 0x7fd3140acfd0 2023-11-15T01:21:52.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.032+0000 7fd31a13b700 1 -- 172.21.15.1:0/1350490864 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd314153c50 con 0x7fd3140acfd0 2023-11-15T01:21:52.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.033+0000 7fd31a13b700 1 -- 172.21.15.1:0/1350490864 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3140aaa60 con 0x7fd3140acfd0 2023-11-15T01:21:52.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.034+0000 7fd2fb7fe700 1 -- 172.21.15.1:0/1350490864 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd308015620 con 0x7fd3140acfd0 2023-11-15T01:21:52.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.034+0000 7fd2fb7fe700 1 --2- 172.21.15.1:0/1350490864 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd30005f150 0x7fd300061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.034+0000 7fd2fb7fe700 1 -- 172.21.15.1:0/1350490864 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd30807a740 con 0x7fd3140acfd0 2023-11-15T01:21:52.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.034+0000 7fd3137fe700 1 --2- 172.21.15.1:0/1350490864 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd30005f150 0x7fd300061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.035+0000 7fd3137fe700 1 --2- 172.21.15.1:0/1350490864 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd30005f150 0x7fd300061610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fd30400b210 tx=0x7fd304008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:52.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.038+0000 7fd2fb7fe700 1 -- 172.21.15.1:0/1350490864 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd30804ba10 con 0x7fd3140acfd0 2023-11-15T01:21:52.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.210+0000 7fd31a13b700 1 -- 172.21.15.1:0/1350490864 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd31406c7e0 con 0x7fd3140acfd0 2023-11-15T01:21:52.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.211+0000 7fd2fb7fe700 1 -- 172.21.15.1:0/1350490864 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd30804f030 con 0x7fd3140acfd0 2023-11-15T01:21:52.212 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:21:52.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.212+0000 7fd31a13b700 1 -- 172.21.15.1:0/1350490864 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd30005f150 msgr2=0x7fd300061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.212+0000 7fd31a13b700 1 --2- 172.21.15.1:0/1350490864 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd30005f150 0x7fd300061610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fd30400b210 tx=0x7fd304008040).stop 2023-11-15T01:21:52.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.212+0000 7fd31a13b700 1 -- 172.21.15.1:0/1350490864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3140acfd0 msgr2=0x7fd3141524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.212+0000 7fd31a13b700 1 --2- 172.21.15.1:0/1350490864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3140acfd0 0x7fd3141524a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fd308004970 tx=0x7fd308001e90).stop 2023-11-15T01:21:52.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.212+0000 7fd31a13b700 1 -- 172.21.15.1:0/1350490864 shutdown_connections 2023-11-15T01:21:52.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.212+0000 7fd31a13b700 1 --2- 172.21.15.1:0/1350490864 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd30005f150 0x7fd300061610 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.212+0000 7fd31a13b700 1 --2- 172.21.15.1:0/1350490864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd314152990 0x7fd314152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.212+0000 7fd31a13b700 1 --2- 172.21.15.1:0/1350490864 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2fc0038e0 0x7fd3140acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.212+0000 7fd31a13b700 1 --2- 172.21.15.1:0/1350490864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3140acfd0 0x7fd3141524a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.212+0000 7fd31a13b700 1 -- 172.21.15.1:0/1350490864 >> 172.21.15.1:0/1350490864 conn(0x7fd3140c8050 msgr2=0x7fd314065f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:52.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.212+0000 7fd31a13b700 1 -- 172.21.15.1:0/1350490864 shutdown_connections 2023-11-15T01:21:52.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.212+0000 7fd31a13b700 1 -- 172.21.15.1:0/1350490864 wait complete. 2023-11-15T01:21:52.225 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:21:52.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.342+0000 7f302c60c700 1 Processor -- start 2023-11-15T01:21:52.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.342+0000 7f302c60c700 1 -- start start 2023-11-15T01:21:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.343+0000 7f302c60c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f30240bccd0 0x7f30240bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.343+0000 7f302c60c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302406a6b0 con 0x7f3024154680 2023-11-15T01:21:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.343+0000 7f302c60c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30240c3360 con 0x7f30240c60b0 2023-11-15T01:21:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.343+0000 7f302c60c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30240bd620 con 0x7f30240bccd0 2023-11-15T01:21:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.343+0000 7f302a3a8700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3024154680 0x7f3024069fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41628/0 (socket says 172.21.15.1:41628) 2023-11-15T01:21:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.343+0000 7f302a3a8700 1 -- 172.21.15.1:0/1124510994 learned_addr learned my addr 172.21.15.1:0/1124510994 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f3029ba7700 1 --2- 172.21.15.1:0/1124510994 >> v2:172.21.15.141:3300/0 conn(0x7f30240bccd0 0x7f30240bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f30293a6700 1 -- 172.21.15.1:0/1124510994 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807144271 0 0) 0x7f302406a6b0 con 0x7f3024154680 2023-11-15T01:21:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f30293a6700 1 -- 172.21.15.1:0/1124510994 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f300c0033f0 con 0x7f3024154680 2023-11-15T01:21:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f30293a6700 1 -- 172.21.15.1:0/1124510994 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3355159419 0 0) 0x7f300c0033f0 con 0x7f3024154680 2023-11-15T01:21:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f30293a6700 1 -- 172.21.15.1:0/1124510994 >> v2:172.21.15.141:3300/0 conn(0x7f30240bccd0 msgr2=0x7f30240bd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f30293a6700 1 --2- 172.21.15.1:0/1124510994 >> v2:172.21.15.141:3300/0 conn(0x7f30240bccd0 0x7f30240bd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f30293a6700 1 -- 172.21.15.1:0/1124510994 >> v1:172.21.15.141:6789/0 conn(0x7f30240c60b0 legacy=0x7f30240c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f30293a6700 1 -- 172.21.15.1:0/1124510994 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30240c2750 con 0x7f3024154680 2023-11-15T01:21:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f30293a6700 1 -- 172.21.15.1:0/1124510994 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f301c001470 con 0x7f3024154680 2023-11-15T01:21:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f30293a6700 1 -- 172.21.15.1:0/1124510994 >> v1:172.21.15.1:6789/0 conn(0x7f3024154680 legacy=0x7f3024069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f30293a6700 1 --2- 172.21.15.1:0/1124510994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300c0038e0 0x7f300c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f30293a6700 1 --2- 172.21.15.1:0/1124510994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f300c004690 0x7f300c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f30293a6700 1 --2- 172.21.15.1:0/1124510994 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f300c005000 0x7f300c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f30293a6700 1 -- 172.21.15.1:0/1124510994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30240bd620 con 0x7f300c0038e0 2023-11-15T01:21:52.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f30293a6700 1 -- 172.21.15.1:0/1124510994 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c00beb0 con 0x7f300c004690 2023-11-15T01:21:52.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f30293a6700 1 -- 172.21.15.1:0/1124510994 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300c00c070 con 0x7f300c005000 2023-11-15T01:21:52.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f302a3a8700 1 --2- 172.21.15.1:0/1124510994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300c0038e0 0x7f300c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f3029ba7700 1 --2- 172.21.15.1:0/1124510994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f300c004690 0x7f300c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f302aba9700 1 --2- 172.21.15.1:0/1124510994 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f300c005000 0x7f300c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f302a3a8700 1 -- 172.21.15.1:0/1124510994 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f300c005000 msgr2=0x7f300c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:52.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f302a3a8700 1 --2- 172.21.15.1:0/1124510994 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f300c005000 0x7f300c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f302a3a8700 1 -- 172.21.15.1:0/1124510994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f300c004690 msgr2=0x7f300c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:52.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f302a3a8700 1 --2- 172.21.15.1:0/1124510994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f300c004690 0x7f300c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f302a3a8700 1 -- 172.21.15.1:0/1124510994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300c0033f0 con 0x7f300c0038e0 2023-11-15T01:21:52.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.344+0000 7f302aba9700 1 -- 172.21.15.1:0/1124510994 reap_dead start 2023-11-15T01:21:52.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.345+0000 7f302a3a8700 1 --2- 172.21.15.1:0/1124510994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300c0038e0 0x7f300c003d00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f301c00c190 tx=0x7f301c001e50).ready entity=mon.0 client_cookie=ad8ef351d1d80aec server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:52.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.345+0000 7f30293a6700 1 -- 172.21.15.1:0/1124510994 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c007a20 con 0x7f300c0038e0 2023-11-15T01:21:52.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.345+0000 7f30293a6700 1 -- 172.21.15.1:0/1124510994 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c00cac0 con 0x7f300c0038e0 2023-11-15T01:21:52.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.345+0000 7f30293a6700 1 -- 172.21.15.1:0/1124510994 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c00ce40 con 0x7f300c0038e0 2023-11-15T01:21:52.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.345+0000 7f302c60c700 1 -- 172.21.15.1:0/1124510994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300c0038e0 msgr2=0x7f300c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.345+0000 7f302c60c700 1 --2- 172.21.15.1:0/1124510994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300c0038e0 0x7f300c003d00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f301c00c190 tx=0x7f301c001e50).stop 2023-11-15T01:21:52.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.345+0000 7f302c60c700 1 -- 172.21.15.1:0/1124510994 shutdown_connections 2023-11-15T01:21:52.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.345+0000 7f302c60c700 1 --2- 172.21.15.1:0/1124510994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300c0038e0 0x7f300c003d00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.345+0000 7f302c60c700 1 -- 172.21.15.1:0/1124510994 >> 172.21.15.1:0/1124510994 conn(0x7f30240c7d70 msgr2=0x7f30240c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:52.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.345+0000 7f302c60c700 1 -- 172.21.15.1:0/1124510994 shutdown_connections 2023-11-15T01:21:52.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.345+0000 7f302c60c700 1 -- 172.21.15.1:0/1124510994 wait complete. 2023-11-15T01:21:52.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.346+0000 7f302c60c700 1 Processor -- start 2023-11-15T01:21:52.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.347+0000 7f302c60c700 1 -- start start 2023-11-15T01:21:52.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.347+0000 7f302c60c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300c0038e0 0x7f30240ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.347+0000 7f302c60c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f302413f300 0x7f30240c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.347+0000 7f302c60c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30240c4c70 0x7f30240ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.347+0000 7f302c60c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30240a9540 con 0x7f300c0038e0 2023-11-15T01:21:52.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.347+0000 7f302c60c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30240ad260 con 0x7f30240c4c70 2023-11-15T01:21:52.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.347+0000 7f302c60c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30240c50d0 con 0x7f302413f300 2023-11-15T01:21:52.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.347+0000 7f302a3a8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300c0038e0 0x7f30240ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.347+0000 7f302a3a8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300c0038e0 0x7f30240ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37252/0 (socket says 172.21.15.1:37252) 2023-11-15T01:21:52.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.347+0000 7f302a3a8700 1 -- 172.21.15.1:0/3005607684 learned_addr learned my addr 172.21.15.1:0/3005607684 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:52.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.348+0000 7f3029ba7700 1 --2- 172.21.15.1:0/3005607684 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f302413f300 0x7f30240c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.348+0000 7f302a3a8700 1 -- 172.21.15.1:0/3005607684 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f302413f300 msgr2=0x7f30240c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.348+0000 7f302a3a8700 1 --2- 172.21.15.1:0/3005607684 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f302413f300 0x7f30240c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.348+0000 7f302aba9700 1 --2- 172.21.15.1:0/3005607684 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30240c4c70 0x7f30240ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.348+0000 7f302a3a8700 1 -- 172.21.15.1:0/3005607684 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30240c4c70 msgr2=0x7f30240ab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.348+0000 7f302a3a8700 1 --2- 172.21.15.1:0/3005607684 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30240c4c70 0x7f30240ab0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.348+0000 7f302a3a8700 1 -- 172.21.15.1:0/3005607684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30240ac650 con 0x7f300c0038e0 2023-11-15T01:21:52.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.348+0000 7f302aba9700 1 --2- 172.21.15.1:0/3005607684 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30240c4c70 0x7f30240ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:52.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.348+0000 7f302a3a8700 1 --2- 172.21.15.1:0/3005607684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300c0038e0 0x7f30240ad6f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f301c00c780 tx=0x7f301c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:52.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.348+0000 7f30227fc700 1 -- 172.21.15.1:0/3005607684 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c007460 con 0x7f300c0038e0 2023-11-15T01:21:52.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.348+0000 7f30227fc700 1 -- 172.21.15.1:0/3005607684 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c0075c0 con 0x7f300c0038e0 2023-11-15T01:21:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.348+0000 7f302c60c700 1 -- 172.21.15.1:0/3005607684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30240ac930 con 0x7f300c0038e0 2023-11-15T01:21:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.348+0000 7f30227fc700 1 -- 172.21.15.1:0/3005607684 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c0048e0 con 0x7f300c0038e0 2023-11-15T01:21:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.348+0000 7f302c60c700 1 -- 172.21.15.1:0/3005607684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30240acef0 con 0x7f300c0038e0 2023-11-15T01:21:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.349+0000 7f302c60c700 1 -- 172.21.15.1:0/3005607684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302406c7e0 con 0x7f300c0038e0 2023-11-15T01:21:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.349+0000 7f30227fc700 1 -- 172.21.15.1:0/3005607684 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f301c01c070 con 0x7f300c0038e0 2023-11-15T01:21:52.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.350+0000 7f30227fc700 1 --2- 172.21.15.1:0/3005607684 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f301005f150 0x7f3010061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.350+0000 7f30227fc700 1 -- 172.21.15.1:0/3005607684 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f301c07a910 con 0x7f300c0038e0 2023-11-15T01:21:52.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.350+0000 7f3029ba7700 1 --2- 172.21.15.1:0/3005607684 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f301005f150 0x7f3010061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.351+0000 7f3029ba7700 1 --2- 172.21.15.1:0/3005607684 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f301005f150 0x7f3010061610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f3018009270 tx=0x7f3018008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:52.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.354+0000 7f30227fc700 1 -- 172.21.15.1:0/3005607684 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f301c04bbe0 con 0x7f300c0038e0 2023-11-15T01:21:52.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.566+0000 7f302c60c700 1 -- 172.21.15.1:0/3005607684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30240c2a30 con 0x7f300c0038e0 2023-11-15T01:21:52.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.566+0000 7f30227fc700 1 -- 172.21.15.1:0/3005607684 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4480 (secure 0 0 0) 0x7f301c04f200 con 0x7f300c0038e0 2023-11-15T01:21:52.567 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:52.568 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/843391361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":843391361},{"type":"v1","addr":"172.21.15.141:6837","nonce":843391361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2237478530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2237478530},{"type":"v1","addr":"172.21.15.141:6836","nonce":2237478530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2856672167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2856672167},{"type":"v1","addr":"172.21.15.1:6833","nonce":2856672167}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:21:37.045655+0000","modified":"2023-11-15T01:21:40.053500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/4209655632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4209655632},{"type":"v1","addr":"172.21.15.1:6835","nonce":4209655632}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-15T01:21:52.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.568+0000 7f302c60c700 1 -- 172.21.15.1:0/3005607684 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f301005f150 msgr2=0x7f3010061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.568+0000 7f302c60c700 1 --2- 172.21.15.1:0/3005607684 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f301005f150 0x7f3010061610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f3018009270 tx=0x7f3018008040).stop 2023-11-15T01:21:52.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.568+0000 7f302c60c700 1 -- 172.21.15.1:0/3005607684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300c0038e0 msgr2=0x7f30240ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.568+0000 7f302c60c700 1 --2- 172.21.15.1:0/3005607684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300c0038e0 0x7f30240ad6f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f301c00c780 tx=0x7f301c015000).stop 2023-11-15T01:21:52.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.568+0000 7f302c60c700 1 -- 172.21.15.1:0/3005607684 shutdown_connections 2023-11-15T01:21:52.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.568+0000 7f302c60c700 1 --2- 172.21.15.1:0/3005607684 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f301005f150 0x7f3010061610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.568+0000 7f302c60c700 1 --2- 172.21.15.1:0/3005607684 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30240c4c70 0x7f30240ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.568+0000 7f302c60c700 1 --2- 172.21.15.1:0/3005607684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f300c0038e0 0x7f30240ad6f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.568+0000 7f302c60c700 1 --2- 172.21.15.1:0/3005607684 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f302413f300 0x7f30240c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.568+0000 7f302c60c700 1 -- 172.21.15.1:0/3005607684 >> 172.21.15.1:0/3005607684 conn(0x7f30240c7d70 msgr2=0x7f302415a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:52.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.568+0000 7f302c60c700 1 -- 172.21.15.1:0/3005607684 shutdown_connections 2023-11-15T01:21:52.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.568+0000 7f302c60c700 1 -- 172.21.15.1:0/3005607684 wait complete. 2023-11-15T01:21:52.572 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2023-11-15T01:21:52.581 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:21:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.700+0000 7fb8ac475700 1 Processor -- start 2023-11-15T01:21:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.700+0000 7fb8ac475700 1 -- start start 2023-11-15T01:21:52.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.701+0000 7fb8ac475700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8a4154150 0x7fb8a4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.701+0000 7fb8ac475700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb8a40ab1a0 0x7fb8a4158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.701+0000 7fb8ac475700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40c06f0 con 0x7fb8a40aa060 2023-11-15T01:21:52.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.701+0000 7fb8ac475700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a40c09d0 con 0x7fb8a40ab1a0 2023-11-15T01:21:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.701+0000 7fb8ac475700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4158820 con 0x7fb8a4154150 2023-11-15T01:21:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.701+0000 7fb8a9a10700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb8a40ab1a0 0x7fb8a4158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.701+0000 7fb8aaa12700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb8a40aa060 0x7fb8a40c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41630/0 (socket says 172.21.15.1:41630) 2023-11-15T01:21:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.701+0000 7fb8aaa12700 1 -- 172.21.15.1:0/3000361993 learned_addr learned my addr 172.21.15.1:0/3000361993 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.702+0000 7fb8aa211700 1 --2- 172.21.15.1:0/3000361993 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8a4154150 0x7fb8a4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.702+0000 7fb8a9a10700 1 -- 172.21.15.1:0/3000361993 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8a4154150 msgr2=0x7fb8a4154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.702+0000 7fb8a9a10700 1 --2- 172.21.15.1:0/3000361993 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8a4154150 0x7fb8a4154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.702+0000 7fb8a9a10700 1 -- 172.21.15.1:0/3000361993 >> v1:172.21.15.1:6789/0 conn(0x7fb8a40aa060 legacy=0x7fb8a40c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.702+0000 7fb8a9a10700 1 -- 172.21.15.1:0/3000361993 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a4158b00 con 0x7fb8a40ab1a0 2023-11-15T01:21:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.702+0000 7fb8a920f700 1 -- 172.21.15.1:0/3000361993 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579688875 0 0) 0x7fb8a40c06f0 con 0x7fb8a40aa060 2023-11-15T01:21:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.702+0000 7fb8a9a10700 1 --2- 172.21.15.1:0/3000361993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8a40ab1a0 0x7fb8a4158040 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fb898009760 tx=0x7fb898009060).ready entity=mon.0 client_cookie=efbd37f8a05a1f61 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.702+0000 7fb8a920f700 1 -- 172.21.15.1:0/3000361993 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8980090d0 con 0x7fb8a40ab1a0 2023-11-15T01:21:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.702+0000 7fb8a920f700 1 -- 172.21.15.1:0/3000361993 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89800b580 con 0x7fb8a40ab1a0 2023-11-15T01:21:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.702+0000 7fb8a920f700 1 -- 172.21.15.1:0/3000361993 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89800b900 con 0x7fb8a40ab1a0 2023-11-15T01:21:52.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.702+0000 7fb8ac475700 1 -- 172.21.15.1:0/3000361993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8a40ab1a0 msgr2=0x7fb8a4158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.702+0000 7fb8ac475700 1 --2- 172.21.15.1:0/3000361993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8a40ab1a0 0x7fb8a4158040 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fb898009760 tx=0x7fb898009060).stop 2023-11-15T01:21:52.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.703+0000 7fb8ac475700 1 -- 172.21.15.1:0/3000361993 shutdown_connections 2023-11-15T01:21:52.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.703+0000 7fb8ac475700 1 --2- 172.21.15.1:0/3000361993 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8a4154150 0x7fb8a4154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.703+0000 7fb8ac475700 1 --2- 172.21.15.1:0/3000361993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8a40ab1a0 0x7fb8a4158040 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.703+0000 7fb8ac475700 1 -- 172.21.15.1:0/3000361993 >> 172.21.15.1:0/3000361993 conn(0x7fb8a4064aa0 msgr2=0x7fb8a4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:52.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.703+0000 7fb8ac475700 1 -- 172.21.15.1:0/3000361993 shutdown_connections 2023-11-15T01:21:52.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.703+0000 7fb8ac475700 1 -- 172.21.15.1:0/3000361993 wait complete. 2023-11-15T01:21:52.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.704+0000 7fb8ac475700 1 Processor -- start 2023-11-15T01:21:52.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.704+0000 7fb8ac475700 1 -- start start 2023-11-15T01:21:52.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.704+0000 7fb8ac475700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8a40aa060 0x7fb8a40ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8ac475700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8a40ab1a0 0x7fb8a40c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8ac475700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8a4154150 0x7fb8a414dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8ac475700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4154e90 con 0x7fb8a4154150 2023-11-15T01:21:52.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8ac475700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4154b90 con 0x7fb8a40aa060 2023-11-15T01:21:52.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8ac475700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40c4cd0 con 0x7fb8a40ab1a0 2023-11-15T01:21:52.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8aaa12700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8a4154150 0x7fb8a414dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8aaa12700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8a4154150 0x7fb8a414dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37266/0 (socket says 172.21.15.1:37266) 2023-11-15T01:21:52.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8aaa12700 1 -- 172.21.15.1:0/1393241209 learned_addr learned my addr 172.21.15.1:0/1393241209 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:52.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8a9a10700 1 --2- 172.21.15.1:0/1393241209 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8a40ab1a0 0x7fb8a40c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8aa211700 1 --2- 172.21.15.1:0/1393241209 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8a40aa060 0x7fb8a40ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8aaa12700 1 -- 172.21.15.1:0/1393241209 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8a40ab1a0 msgr2=0x7fb8a40c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8aaa12700 1 --2- 172.21.15.1:0/1393241209 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8a40ab1a0 0x7fb8a40c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8aaa12700 1 -- 172.21.15.1:0/1393241209 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8a40aa060 msgr2=0x7fb8a40ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8aaa12700 1 --2- 172.21.15.1:0/1393241209 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8a40aa060 0x7fb8a40ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8aaa12700 1 -- 172.21.15.1:0/1393241209 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8980092a0 con 0x7fb8a4154150 2023-11-15T01:21:52.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8aa211700 1 --2- 172.21.15.1:0/1393241209 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8a40aa060 0x7fb8a40ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:52.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8aaa12700 1 --2- 172.21.15.1:0/1393241209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8a4154150 0x7fb8a414dd60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fb89400c810 tx=0x7fb894007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:52.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8a27fc700 1 -- 172.21.15.1:0/1393241209 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894005d30 con 0x7fb8a4154150 2023-11-15T01:21:52.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8a27fc700 1 -- 172.21.15.1:0/1393241209 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb894007110 con 0x7fb8a4154150 2023-11-15T01:21:52.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8ac475700 1 -- 172.21.15.1:0/1393241209 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a40c4fb0 con 0x7fb8a4154150 2023-11-15T01:21:52.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8a27fc700 1 -- 172.21.15.1:0/1393241209 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940074d0 con 0x7fb8a4154150 2023-11-15T01:21:52.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.705+0000 7fb8ac475700 1 -- 172.21.15.1:0/1393241209 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a40c48c0 con 0x7fb8a4154150 2023-11-15T01:21:52.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.706+0000 7fb8ac475700 1 -- 172.21.15.1:0/1393241209 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a40c5450 con 0x7fb8a4154150 2023-11-15T01:21:52.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.706+0000 7fb8a27fc700 1 -- 172.21.15.1:0/1393241209 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb894007880 con 0x7fb8a4154150 2023-11-15T01:21:52.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.707+0000 7fb8a27fc700 1 --2- 172.21.15.1:0/1393241209 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb89005f150 0x7fb890061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:52.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.707+0000 7fb8a27fc700 1 -- 172.21.15.1:0/1393241209 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb89407a250 con 0x7fb8a4154150 2023-11-15T01:21:52.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.707+0000 7fb8aa211700 1 --2- 172.21.15.1:0/1393241209 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb89005f150 0x7fb890061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:52.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.707+0000 7fb8aa211700 1 --2- 172.21.15.1:0/1393241209 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb89005f150 0x7fb890061610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fb89c009810 tx=0x7fb89c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:52.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.711+0000 7fb8a27fc700 1 -- 172.21.15.1:0/1393241209 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb89404b520 con 0x7fb8a4154150 2023-11-15T01:21:52.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.883+0000 7fb8ac475700 1 -- 172.21.15.1:0/1393241209 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8a406c7e0 con 0x7fb8a4154150 2023-11-15T01:21:52.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.884+0000 7fb8a27fc700 1 -- 172.21.15.1:0/1393241209 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16880 (secure 0 0 0) 0x7fb89404eb40 con 0x7fb8a4154150 2023-11-15T01:21:52.885 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:52.885 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:38.047484+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:21:34.763591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-15T01:21:36.025071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:21:52.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.886+0000 7fb8ac475700 1 -- 172.21.15.1:0/1393241209 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb89005f150 msgr2=0x7fb890061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.886+0000 7fb8ac475700 1 --2- 172.21.15.1:0/1393241209 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb89005f150 0x7fb890061610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fb89c009810 tx=0x7fb89c008040).stop 2023-11-15T01:21:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.886+0000 7fb8ac475700 1 -- 172.21.15.1:0/1393241209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8a4154150 msgr2=0x7fb8a414dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.886+0000 7fb8ac475700 1 --2- 172.21.15.1:0/1393241209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8a4154150 0x7fb8a414dd60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fb89400c810 tx=0x7fb894007f30).stop 2023-11-15T01:21:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.886+0000 7fb8ac475700 1 -- 172.21.15.1:0/1393241209 shutdown_connections 2023-11-15T01:21:52.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.886+0000 7fb8ac475700 1 --2- 172.21.15.1:0/1393241209 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb89005f150 0x7fb890061610 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.886+0000 7fb8ac475700 1 --2- 172.21.15.1:0/1393241209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8a4154150 0x7fb8a414dd60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.886+0000 7fb8ac475700 1 --2- 172.21.15.1:0/1393241209 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8a40aa060 0x7fb8a40ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.886+0000 7fb8ac475700 1 --2- 172.21.15.1:0/1393241209 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8a40ab1a0 0x7fb8a40c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:52.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.886+0000 7fb8ac475700 1 -- 172.21.15.1:0/1393241209 >> 172.21.15.1:0/1393241209 conn(0x7fb8a4064aa0 msgr2=0x7fb8a414feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:52.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.886+0000 7fb8ac475700 1 -- 172.21.15.1:0/1393241209 shutdown_connections 2023-11-15T01:21:52.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:52.886+0000 7fb8ac475700 1 -- 172.21.15.1:0/1393241209 wait complete. 2023-11-15T01:21:52.899 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:21:53.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.016+0000 7f50fa6f3700 1 Processor -- start 2023-11-15T01:21:53.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.016+0000 7f50fa6f3700 1 -- start start 2023-11-15T01:21:53.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.017+0000 7f50fa6f3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f50f4154150 0x7f50f4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.017+0000 7f50fa6f3700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f40c06f0 con 0x7f50f40aa060 2023-11-15T01:21:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.017+0000 7f50fa6f3700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f40c09d0 con 0x7f50f40ab1a0 2023-11-15T01:21:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.017+0000 7f50fa6f3700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f4158820 con 0x7f50f4154150 2023-11-15T01:21:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.017+0000 7f50f3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f50f4154150 0x7f50f4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.017+0000 7f50f3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f50f4154150 0x7f50f4154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37272/0 (socket says 172.21.15.1:37272) 2023-11-15T01:21:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.017+0000 7f50f8c90700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f50f40aa060 0x7f50f40c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41632/0 (socket says 172.21.15.1:41632) 2023-11-15T01:21:53.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.017+0000 7f50f3fff700 1 -- 172.21.15.1:0/1909854394 learned_addr learned my addr 172.21.15.1:0/1909854394 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:53.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.017+0000 7f50f3fff700 1 -- 172.21.15.1:0/1909854394 >> v1:172.21.15.141:6789/0 conn(0x7f50f40ab1a0 legacy=0x7f50f4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.017+0000 7f50f3fff700 1 -- 172.21.15.1:0/1909854394 >> v1:172.21.15.1:6789/0 conn(0x7f50f40aa060 legacy=0x7f50f40c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.017+0000 7f50f2ffd700 1 -- 172.21.15.1:0/1909854394 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668251056 0 0) 0x7f50f40c06f0 con 0x7f50f40aa060 2023-11-15T01:21:53.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.018+0000 7f50f3fff700 1 -- 172.21.15.1:0/1909854394 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f4158b00 con 0x7f50f4154150 2023-11-15T01:21:53.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.018+0000 7f50f3fff700 1 --2- 172.21.15.1:0/1909854394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50f4154150 0x7f50f4154530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f50e4006fd0 tx=0x7f50e40090f0).ready entity=mon.0 client_cookie=36a16a1be3f5bb6e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:53.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.018+0000 7f50f2ffd700 1 -- 172.21.15.1:0/1909854394 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e400b600 con 0x7f50f4154150 2023-11-15T01:21:53.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.018+0000 7f50f2ffd700 1 -- 172.21.15.1:0/1909854394 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e400b760 con 0x7f50f4154150 2023-11-15T01:21:53.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.018+0000 7f50f2ffd700 1 -- 172.21.15.1:0/1909854394 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e400bb00 con 0x7f50f4154150 2023-11-15T01:21:53.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.018+0000 7f50fa6f3700 1 -- 172.21.15.1:0/1909854394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50f4154150 msgr2=0x7f50f4154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.018+0000 7f50fa6f3700 1 --2- 172.21.15.1:0/1909854394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50f4154150 0x7f50f4154530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f50e4006fd0 tx=0x7f50e40090f0).stop 2023-11-15T01:21:53.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.018+0000 7f50fa6f3700 1 -- 172.21.15.1:0/1909854394 shutdown_connections 2023-11-15T01:21:53.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.018+0000 7f50fa6f3700 1 --2- 172.21.15.1:0/1909854394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50f4154150 0x7f50f4154530 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.018+0000 7f50fa6f3700 1 -- 172.21.15.1:0/1909854394 >> 172.21.15.1:0/1909854394 conn(0x7f50f4064aa0 msgr2=0x7f50f4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:53.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.018+0000 7f50fa6f3700 1 -- 172.21.15.1:0/1909854394 shutdown_connections 2023-11-15T01:21:53.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.018+0000 7f50fa6f3700 1 -- 172.21.15.1:0/1909854394 wait complete. 2023-11-15T01:21:53.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.019+0000 7f50fa6f3700 1 Processor -- start 2023-11-15T01:21:53.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.020+0000 7f50fa6f3700 1 -- start start 2023-11-15T01:21:53.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.020+0000 7f50fa6f3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50f40aa060 0x7f50f40ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.020+0000 7f50fa6f3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f50f40ab1a0 0x7f50f4157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.020+0000 7f50fa6f3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50f4154150 0x7f50f414d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.020+0000 7f50fa6f3700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f4157540 con 0x7f50f40aa060 2023-11-15T01:21:53.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.020+0000 7f50fa6f3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40ae680 con 0x7f50f40ab1a0 2023-11-15T01:21:53.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.020+0000 7f50fa6f3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40ae960 con 0x7f50f4154150 2023-11-15T01:21:53.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.020+0000 7f50f3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50f40aa060 0x7f50f40ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.020+0000 7f50f3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50f40aa060 0x7f50f40ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37280/0 (socket says 172.21.15.1:37280) 2023-11-15T01:21:53.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.020+0000 7f50f3fff700 1 -- 172.21.15.1:0/2459932703 learned_addr learned my addr 172.21.15.1:0/2459932703 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:53.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.021+0000 7f50f3fff700 1 -- 172.21.15.1:0/2459932703 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50f4154150 msgr2=0x7f50f414d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.021+0000 7f50f3fff700 1 --2- 172.21.15.1:0/2459932703 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50f4154150 0x7f50f414d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:21:53.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.021+0000 7f50f3fff700 1 -- 172.21.15.1:0/2459932703 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f50f40ab1a0 msgr2=0x7f50f4157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.021+0000 7f50f3fff700 1 --2- 172.21.15.1:0/2459932703 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f50f40ab1a0 0x7f50f4157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:21:53.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.021+0000 7f50f3fff700 1 -- 172.21.15.1:0/2459932703 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e4009370 con 0x7f50f40aa060 2023-11-15T01:21:53.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.021+0000 7f50f3fff700 1 --2- 172.21.15.1:0/2459932703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50f40aa060 0x7f50f40ae030 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f50e4009130 tx=0x7f50e4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:53.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.021+0000 7f50ebfff700 1 -- 172.21.15.1:0/2459932703 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e400b8d0 con 0x7f50f40aa060 2023-11-15T01:21:53.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.021+0000 7f50ebfff700 1 -- 172.21.15.1:0/2459932703 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e400ba50 con 0x7f50f40aa060 2023-11-15T01:21:53.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.021+0000 7f50fa6f3700 1 -- 172.21.15.1:0/2459932703 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f40aec40 con 0x7f50f40aa060 2023-11-15T01:21:53.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.021+0000 7f50ebfff700 1 -- 172.21.15.1:0/2459932703 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e401c670 con 0x7f50f40aa060 2023-11-15T01:21:53.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.021+0000 7f50fa6f3700 1 -- 172.21.15.1:0/2459932703 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f40c29e0 con 0x7f50f40aa060 2023-11-15T01:21:53.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.022+0000 7f50fa6f3700 1 -- 172.21.15.1:0/2459932703 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f406c7e0 con 0x7f50f40aa060 2023-11-15T01:21:53.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.022+0000 7f50ebfff700 1 -- 172.21.15.1:0/2459932703 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f50e401ca20 con 0x7f50f40aa060 2023-11-15T01:21:53.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.023+0000 7f50ebfff700 1 --2- 172.21.15.1:0/2459932703 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f50d405f120 0x7f50d40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.023+0000 7f50ebfff700 1 -- 172.21.15.1:0/2459932703 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f50e407bd00 con 0x7f50f40aa060 2023-11-15T01:21:53.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.023+0000 7f50f37fe700 1 --2- 172.21.15.1:0/2459932703 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f50d405f120 0x7f50d40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.023+0000 7f50f37fe700 1 --2- 172.21.15.1:0/2459932703 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f50d405f120 0x7f50d40615e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f50f40af770 tx=0x7f50dc0079c0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:53.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.027+0000 7f50ebfff700 1 -- 172.21.15.1:0/2459932703 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f50e404cfd0 con 0x7f50f40aa060 2023-11-15T01:21:53.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.244+0000 7f50fa6f3700 1 -- 172.21.15.1:0/2459932703 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50f4157ab0 con 0x7f50f40aa060 2023-11-15T01:21:53.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.244+0000 7f50ebfff700 1 -- 172.21.15.1:0/2459932703 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4480 (secure 0 0 0) 0x7f50e402a070 con 0x7f50f40aa060 2023-11-15T01:21:53.245 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:21:53.246 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/843391361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":843391361},{"type":"v1","addr":"172.21.15.141:6837","nonce":843391361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2237478530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2237478530},{"type":"v1","addr":"172.21.15.141:6836","nonce":2237478530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2856672167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2856672167},{"type":"v1","addr":"172.21.15.1:6833","nonce":2856672167}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:21:37.045655+0000","modified":"2023-11-15T01:21:40.053500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/4209655632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4209655632},{"type":"v1","addr":"172.21.15.1:6835","nonce":4209655632}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-15T01:21:53.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.246+0000 7f50fa6f3700 1 -- 172.21.15.1:0/2459932703 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f50d405f120 msgr2=0x7f50d40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.246+0000 7f50fa6f3700 1 --2- 172.21.15.1:0/2459932703 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f50d405f120 0x7f50d40615e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f50f40af770 tx=0x7f50dc0079c0).stop 2023-11-15T01:21:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.246+0000 7f50fa6f3700 1 -- 172.21.15.1:0/2459932703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50f40aa060 msgr2=0x7f50f40ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.246+0000 7f50fa6f3700 1 --2- 172.21.15.1:0/2459932703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50f40aa060 0x7f50f40ae030 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f50e4009130 tx=0x7f50e4017000).stop 2023-11-15T01:21:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.246+0000 7f50fa6f3700 1 -- 172.21.15.1:0/2459932703 shutdown_connections 2023-11-15T01:21:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.246+0000 7f50fa6f3700 1 --2- 172.21.15.1:0/2459932703 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f50d405f120 0x7f50d40615e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.246+0000 7f50fa6f3700 1 --2- 172.21.15.1:0/2459932703 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50f4154150 0x7f50f414d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:21:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.246+0000 7f50fa6f3700 1 --2- 172.21.15.1:0/2459932703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50f40aa060 0x7f50f40ae030 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.246+0000 7f50fa6f3700 1 --2- 172.21.15.1:0/2459932703 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f50f40ab1a0 0x7f50f4157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:21:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.246+0000 7f50fa6f3700 1 -- 172.21.15.1:0/2459932703 >> 172.21.15.1:0/2459932703 conn(0x7f50f4064aa0 msgr2=0x7f50f40634f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.246+0000 7f50fa6f3700 1 -- 172.21.15.1:0/2459932703 shutdown_connections 2023-11-15T01:21:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.246+0000 7f50fa6f3700 1 -- 172.21.15.1:0/2459932703 wait complete. 2023-11-15T01:21:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2023-11-15T01:21:53.661 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-15T01:21:37.045655+0000', 'modified': '2023-11-15T01:21:40.053500+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.1:6835/4209655632', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6834', 'nonce': 4209655632}, {'type': 'v1', 'addr': '172.21.15.1:6835', 'nonce': 4209655632}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-15T01:21:53.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-15T01:21:53.718 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-15T01:21:53.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.841+0000 7f22fcbe9700 1 Processor -- start 2023-11-15T01:21:53.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.841+0000 7f22fcbe9700 1 -- start start 2023-11-15T01:21:53.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22fcbe9700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f22f8155530 0x7f22f80c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22fcbe9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22f80c98b0 0x7f22f80c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22fcbe9700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f80c7980 con 0x7f22f8151e10 2023-11-15T01:21:53.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22fcbe9700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f80ca1f0 con 0x7f22f8155530 2023-11-15T01:21:53.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22fcbe9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80aa890 con 0x7f22f80c98b0 2023-11-15T01:21:53.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22f77fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f22f8151e10 0x7f22f80aa0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41634/0 (socket says 172.21.15.1:41634) 2023-11-15T01:21:53.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22f77fe700 1 -- 172.21.15.1:0/3189196246 learned_addr learned my addr 172.21.15.1:0/3189196246 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:53.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22f7fff700 1 --2- 172.21.15.1:0/3189196246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22f80c98b0 0x7f22f80c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22f67fc700 1 -- 172.21.15.1:0/3189196246 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443310809 0 0) 0x7f22f80c7980 con 0x7f22f8151e10 2023-11-15T01:21:53.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22f67fc700 1 -- 172.21.15.1:0/3189196246 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e00033f0 con 0x7f22f8151e10 2023-11-15T01:21:53.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/3189196246 >> v2:172.21.15.141:3300/0 conn(0x7f22f8155530 0x7f22f80c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22f67fc700 1 -- 172.21.15.1:0/3189196246 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3386998217 0 0) 0x7f22e00033f0 con 0x7f22f8151e10 2023-11-15T01:21:53.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22f67fc700 1 -- 172.21.15.1:0/3189196246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22f80c98b0 msgr2=0x7f22f80c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:53.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22f67fc700 1 --2- 172.21.15.1:0/3189196246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22f80c98b0 0x7f22f80c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22f67fc700 1 -- 172.21.15.1:0/3189196246 >> v2:172.21.15.141:3300/0 conn(0x7f22f8155530 msgr2=0x7f22f80c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:53.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22f67fc700 1 --2- 172.21.15.1:0/3189196246 >> v2:172.21.15.141:3300/0 conn(0x7f22f8155530 0x7f22f80c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22f67fc700 1 -- 172.21.15.1:0/3189196246 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f80c7bd0 con 0x7f22f8151e10 2023-11-15T01:21:53.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.842+0000 7f22f67fc700 1 -- 172.21.15.1:0/3189196246 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f22e8001470 con 0x7f22f8151e10 2023-11-15T01:21:53.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f67fc700 1 -- 172.21.15.1:0/3189196246 >> v1:172.21.15.1:6789/0 conn(0x7f22f8151e10 legacy=0x7f22f80aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f67fc700 1 --2- 172.21.15.1:0/3189196246 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22e00038e0 0x7f22e0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f67fc700 1 --2- 172.21.15.1:0/3189196246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22e0004690 0x7f22e0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f67fc700 1 --2- 172.21.15.1:0/3189196246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22f80c98b0 0x7f22e0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f67fc700 1 -- 172.21.15.1:0/3189196246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80ca1f0 con 0x7f22e0004690 2023-11-15T01:21:53.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f67fc700 1 -- 172.21.15.1:0/3189196246 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80aa890 con 0x7f22e00038e0 2023-11-15T01:21:53.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f67fc700 1 -- 172.21.15.1:0/3189196246 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e000b8e0 con 0x7f22f80c98b0 2023-11-15T01:21:53.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/3189196246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22e0004690 0x7f22e0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f77fe700 1 --2- 172.21.15.1:0/3189196246 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22e00038e0 0x7f22e0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f7fff700 1 --2- 172.21.15.1:0/3189196246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22f80c98b0 0x7f22e0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f6ffd700 1 -- 172.21.15.1:0/3189196246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22f80c98b0 msgr2=0x7f22e0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:53.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/3189196246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22f80c98b0 0x7f22e0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f6ffd700 1 -- 172.21.15.1:0/3189196246 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22e00038e0 msgr2=0x7f22e0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:53.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/3189196246 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22e00038e0 0x7f22e0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f6ffd700 1 -- 172.21.15.1:0/3189196246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e00033f0 con 0x7f22e0004690 2023-11-15T01:21:53.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/3189196246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22e0004690 0x7f22e0004b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f22ec009a80 tx=0x7f22ec009060).ready entity=mon.0 client_cookie=88a4607b9ce5f14 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:53.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f67fc700 1 -- 172.21.15.1:0/3189196246 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec009430 con 0x7f22e0004690 2023-11-15T01:21:53.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f67fc700 1 -- 172.21.15.1:0/3189196246 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec00e640 con 0x7f22e0004690 2023-11-15T01:21:53.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.843+0000 7f22f67fc700 1 -- 172.21.15.1:0/3189196246 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00e9c0 con 0x7f22e0004690 2023-11-15T01:21:53.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.844+0000 7f22fcbe9700 1 -- 172.21.15.1:0/3189196246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22e0004690 msgr2=0x7f22e0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.844+0000 7f22fcbe9700 1 --2- 172.21.15.1:0/3189196246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22e0004690 0x7f22e0004b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f22ec009a80 tx=0x7f22ec009060).stop 2023-11-15T01:21:53.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.844+0000 7f22f7fff700 1 -- 172.21.15.1:0/3189196246 reap_dead start 2023-11-15T01:21:53.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.844+0000 7f22fcbe9700 1 -- 172.21.15.1:0/3189196246 shutdown_connections 2023-11-15T01:21:53.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.844+0000 7f22fcbe9700 1 -- 172.21.15.1:0/3189196246 >> 172.21.15.1:0/3189196246 conn(0x7f22f80947e0 msgr2=0x7f22f806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:53.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.844+0000 7f22fcbe9700 1 -- 172.21.15.1:0/3189196246 shutdown_connections 2023-11-15T01:21:53.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.844+0000 7f22fcbe9700 1 -- 172.21.15.1:0/3189196246 wait complete. 2023-11-15T01:21:53.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.845+0000 7f22fcbe9700 1 Processor -- start 2023-11-15T01:21:53.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.845+0000 7f22fcbe9700 1 -- start start 2023-11-15T01:21:53.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22fcbe9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22e0004690 0x7f22f814cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22fcbe9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f81532d0 0x7f22f8153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22fcbe9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22f80ac940 0x7f22f80acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22fcbe9700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80ae800 con 0x7f22f81532d0 2023-11-15T01:21:53.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22fcbe9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80ad7c0 con 0x7f22f80ac940 2023-11-15T01:21:53.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22fcbe9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80adaa0 con 0x7f22e0004690 2023-11-15T01:21:53.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22f6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f81532d0 0x7f22f8153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22f6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f81532d0 0x7f22f8153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37308/0 (socket says 172.21.15.1:37308) 2023-11-15T01:21:53.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22f6ffd700 1 -- 172.21.15.1:0/3726323262 learned_addr learned my addr 172.21.15.1:0/3726323262 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:53.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22f7fff700 1 --2- 172.21.15.1:0/3726323262 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22f80ac940 0x7f22f80acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22f77fe700 1 --2- 172.21.15.1:0/3726323262 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22e0004690 0x7f22f814cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22f6ffd700 1 -- 172.21.15.1:0/3726323262 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22e0004690 msgr2=0x7f22f814cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/3726323262 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22e0004690 0x7f22f814cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22f6ffd700 1 -- 172.21.15.1:0/3726323262 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22f80ac940 msgr2=0x7f22f80acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/3726323262 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22f80ac940 0x7f22f80acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22f6ffd700 1 -- 172.21.15.1:0/3726323262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f80ae490 con 0x7f22f81532d0 2023-11-15T01:21:53.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.846+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/3726323262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f81532d0 0x7f22f8153750 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f22e0004480 tx=0x7f22ec01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:53.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.847+0000 7f22df7fe700 1 -- 172.21.15.1:0/3726323262 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec009ec0 con 0x7f22f81532d0 2023-11-15T01:21:53.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.847+0000 7f22df7fe700 1 -- 172.21.15.1:0/3726323262 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec00ed30 con 0x7f22f81532d0 2023-11-15T01:21:53.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.847+0000 7f22fcbe9700 1 -- 172.21.15.1:0/3726323262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f8153c40 con 0x7f22f81532d0 2023-11-15T01:21:53.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.847+0000 7f22df7fe700 1 -- 172.21.15.1:0/3726323262 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00eea0 con 0x7f22f81532d0 2023-11-15T01:21:53.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.847+0000 7f22fcbe9700 1 -- 172.21.15.1:0/3726323262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f80ad290 con 0x7f22f81532d0 2023-11-15T01:21:53.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.848+0000 7f22df7fe700 1 -- 172.21.15.1:0/3726323262 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f22ec01b660 con 0x7f22f81532d0 2023-11-15T01:21:53.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.848+0000 7f22df7fe700 1 --2- 172.21.15.1:0/3726323262 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f22e405f150 0x7f22e4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.848+0000 7f22df7fe700 1 -- 172.21.15.1:0/3726323262 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f22ec07baf0 con 0x7f22f81532d0 2023-11-15T01:21:53.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.849+0000 7f22f77fe700 1 --2- 172.21.15.1:0/3726323262 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f22e405f150 0x7f22e4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.849+0000 7f22f77fe700 1 --2- 172.21.15.1:0/3726323262 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f22e405f150 0x7f22e4061610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f22e8000e50 tx=0x7f22e8001e90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:53.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.850+0000 7f230f7e4b80 1 Processor -- start 2023-11-15T01:21:53.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.851+0000 7f230f7e4b80 1 -- start start 2023-11-15T01:21:53.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.851+0000 7f230f7e4b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 0x5643b5119880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.851+0000 7f230f7e4b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 0x5643b5119d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.851+0000 7f230f7e4b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b51147e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.851+0000 7f230f7e4b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b50df060 con 0x5643b5141cf0 2023-11-15T01:21:53.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.851+0000 7f230f7e4b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b50561f0 con 0x5643b51624e0 2023-11-15T01:21:53.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.851+0000 7f230f7e4b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643b506b440 con 0x5643b4ed5e40 2023-11-15T01:21:53.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.851+0000 7f22f7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b51147e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.852+0000 7f22f7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b51147e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37314/0 (socket says 172.21.15.1:37314) 2023-11-15T01:21:53.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.852+0000 7f22f7fff700 1 -- 172.21.15.1:0/754185486 learned_addr learned my addr 172.21.15.1:0/754185486 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:53.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.852+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/754185486 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 0x5643b5119d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.852+0000 7f22f77fe700 1 --2- 172.21.15.1:0/754185486 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 0x5643b5119880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.852+0000 7f22f7fff700 1 -- 172.21.15.1:0/754185486 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 msgr2=0x5643b5119880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:53.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.852+0000 7f22f7fff700 1 --2- 172.21.15.1:0/754185486 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 0x5643b5119880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.852+0000 7f22f7fff700 1 -- 172.21.15.1:0/754185486 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 msgr2=0x5643b5119d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:53.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.852+0000 7f22f7fff700 1 --2- 172.21.15.1:0/754185486 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 0x5643b5119d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.852+0000 7f22f7fff700 1 -- 172.21.15.1:0/754185486 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643b5064620 con 0x5643b5141cf0 2023-11-15T01:21:53.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.852+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/754185486 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 0x5643b5119d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:53.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.852+0000 7f22f7fff700 1 --2- 172.21.15.1:0/754185486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b51147e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f22f8083740 tx=0x7f22f000b040).ready entity=mon.0 client_cookie=46759aea8c461628 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:53.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.852+0000 7f22dcff9700 1 -- 172.21.15.1:0/754185486 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f000e040 con 0x5643b5141cf0 2023-11-15T01:21:53.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.852+0000 7f22dcff9700 1 -- 172.21.15.1:0/754185486 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f000f040 con 0x5643b5141cf0 2023-11-15T01:21:53.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.852+0000 7f22dcff9700 1 -- 172.21.15.1:0/754185486 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f001e400 con 0x5643b5141cf0 2023-11-15T01:21:53.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.853+0000 7f230f7e4b80 1 -- 172.21.15.1:0/754185486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 msgr2=0x5643b51147e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.853+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/754185486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b51147e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f22f8083740 tx=0x7f22f000b040).stop 2023-11-15T01:21:53.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.853+0000 7f230f7e4b80 1 -- 172.21.15.1:0/754185486 shutdown_connections 2023-11-15T01:21:53.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.853+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/754185486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b51147e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.853+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/754185486 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 0x5643b5119880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.853+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/754185486 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 0x5643b5119d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.853+0000 7f230f7e4b80 1 -- 172.21.15.1:0/754185486 >> 172.21.15.1:0/754185486 conn(0x5643b4f834a0 msgr2=0x5643b5162970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:53.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.853+0000 7f230f7e4b80 1 -- 172.21.15.1:0/754185486 shutdown_connections 2023-11-15T01:21:53.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.853+0000 7f230f7e4b80 1 -- 172.21.15.1:0/754185486 wait complete. 2023-11-15T01:21:53.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.853+0000 7f230f7e4b80 1 -- start start 2023-11-15T01:21:53.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.853+0000 7f230f7e4b80 1 Processor -- start 2023-11-15T01:21:53.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.854+0000 7f230f7e4b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 0x5643b51616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.854+0000 7f230f7e4b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b515bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.854+0000 7f230f7e4b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 0x5643b5146f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.854+0000 7f230f7e4b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b506b580 con 0x5643b5141cf0 2023-11-15T01:21:53.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.854+0000 7f230f7e4b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b506b800 con 0x5643b51624e0 2023-11-15T01:21:53.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.854+0000 7f230f7e4b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643b5036e10 con 0x5643b4ed5e40 2023-11-15T01:21:53.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.854+0000 7f22f6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b515bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.854+0000 7f230f7e4b80 10 client.0 ll_register_callbacks cb 0x5643b50d9640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:21:53.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.854+0000 7f22f6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b515bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37324/0 (socket says 172.21.15.1:37324) 2023-11-15T01:21:53.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.854+0000 7f22f6ffd700 1 -- 172.21.15.1:0/737445506 learned_addr learned my addr 172.21.15.1:0/737445506 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:53.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.854+0000 7f22f77fe700 1 --2- 172.21.15.1:0/737445506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 0x5643b51616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.854+0000 7f22f7fff700 1 --2- 172.21.15.1:0/737445506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 0x5643b5146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f22f6ffd700 1 -- 172.21.15.1:0/737445506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 msgr2=0x5643b51616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:53.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/737445506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 0x5643b51616b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f22f6ffd700 1 -- 172.21.15.1:0/737445506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 msgr2=0x5643b5146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:53.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/737445506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 0x5643b5146f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f22f6ffd700 1 -- 172.21.15.1:0/737445506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f0009d90 con 0x5643b5141cf0 2023-11-15T01:21:53.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f22f7fff700 1 --2- 172.21.15.1:0/737445506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 0x5643b5146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:53.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f22f77fe700 1 --2- 172.21.15.1:0/737445506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 0x5643b51616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:21:53.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/737445506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b515bc10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f22ec0509b0 tx=0x7f22ec011000).ready entity=mon.0 client_cookie=32ff63a5edd17798 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:53.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f22d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:21:53.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f22d5ffb700 1 -- 172.21.15.1:0/737445506 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec056070 con 0x5643b5141cf0 2023-11-15T01:21:53.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f22d5ffb700 1 -- 172.21.15.1:0/737445506 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f22ec01a3b0 con 0x5643b5141cf0 2023-11-15T01:21:53.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f230f7e4b80 1 -- 172.21.15.1:0/737445506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5643b510d720 con 0x5643b5141cf0 2023-11-15T01:21:53.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f22d5ffb700 1 -- 172.21.15.1:0/737445506 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22ec0561d0 con 0x5643b5141cf0 2023-11-15T01:21:53.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f230f7e4b80 10 client.4698 fetch_fsmap learned FSMap version 8 2023-11-15T01:21:53.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f230f7e4b80 1 -- 172.21.15.1:0/737445506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5643b505f9c0 con 0x5643b5141cf0 2023-11-15T01:21:53.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f22d5ffb700 1 -- 172.21.15.1:0/737445506 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5643b510d720 con 0x5643b5141cf0 2023-11-15T01:21:53.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f22d5ffb700 1 -- 172.21.15.1:0/737445506 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f22ec04c870 con 0x5643b5141cf0 2023-11-15T01:21:53.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f230f7e4b80 10 client.4698 fetch_fsmap finished waiting for FSMap version 8 2023-11-15T01:21:53.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f230f7e4b80 10 client.4698 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-15T01:21:53.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f230f7e4b80 20 client.4698 populate_metadata read hostname 'smithi001' 2023-11-15T01:21:53.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/737445506 >> [v2:172.21.15.1:6834/4209655632,v1:172.21.15.1:6835/4209655632] conn(0x5643b515c100 0x5643b513dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f230f7e4b80 4 client.4698 mds_command: new command op to 4275 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-15T01:21:53.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f230f7e4b80 1 -- 172.21.15.1:0/737445506 --> [v2:172.21.15.1:6834/4209655632,v1:172.21.15.1:6835/4209655632] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5643b4ed1ca0 con 0x5643b515c100 2023-11-15T01:21:53.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.855+0000 7f22f77fe700 1 --2- 172.21.15.1:0/737445506 >> [v2:172.21.15.1:6834/4209655632,v1:172.21.15.1:6835/4209655632] conn(0x5643b515c100 0x5643b513dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.856+0000 7f22f77fe700 1 --2- 172.21.15.1:0/737445506 >> [v2:172.21.15.1:6834/4209655632,v1:172.21.15.1:6835/4209655632] conn(0x5643b515c100 0x5643b513dfb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6bfc5f815bd6a43 server_cookie=7b7e7213e6eefcb3 in_seq=0 out_seq=0 2023-11-15T01:21:53.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.856+0000 7f22d5ffb700 10 client.4698 ms_handle_connect on v2:172.21.15.1:6834/4209655632 2023-11-15T01:21:53.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.856+0000 7f22d5ffb700 1 -- 172.21.15.1:0/737445506 <== mds.0 v2:172.21.15.1:6834/4209655632 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5643b4ed1ca0 con 0x5643b515c100 2023-11-15T01:21:53.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.856+0000 7f22d5ffb700 10 client.4698 handle_command_reply: tid=0 2023-11-15T01:21:53.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.856+0000 7f230f7e4b80 1 client.4698 shutdown 2023-11-15T01:21:53.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.856+0000 7f230f7e4b80 1 -- 172.21.15.1:0/737445506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 msgr2=0x5643b515bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.856+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/737445506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b515bc10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f22ec0509b0 tx=0x7f22ec011000).stop 2023-11-15T01:21:53.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.856+0000 7f230f7e4b80 1 -- 172.21.15.1:0/737445506 shutdown_connections 2023-11-15T01:21:53.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.856+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/737445506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 0x5643b5146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.856+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/737445506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 0x5643b51616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.856+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/737445506 >> [v2:172.21.15.1:6834/4209655632,v1:172.21.15.1:6835/4209655632] conn(0x5643b515c100 0x5643b513dfb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.856+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/737445506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b515bc10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.856+0000 7f22d5ffb700 0 client.4698 ms_handle_reset on v2:172.21.15.1:6834/4209655632 2023-11-15T01:21:53.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.856+0000 7f230f7e4b80 1 -- 172.21.15.1:0/737445506 >> 172.21.15.1:0/737445506 conn(0x5643b4f834a0 msgr2=0x5643b511ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:53.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.856+0000 7f230f7e4b80 1 -- 172.21.15.1:0/737445506 shutdown_connections 2023-11-15T01:21:53.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.857+0000 7f230f7e4b80 1 -- 172.21.15.1:0/737445506 wait complete. 2023-11-15T01:21:53.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.857+0000 7f230f7e4b80 20 client.4698 trim_cache size 0 max 16384 2023-11-15T01:21:53.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.873+0000 7f230f7e4b80 1 Processor -- start 2023-11-15T01:21:53.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.873+0000 7f230f7e4b80 1 -- start start 2023-11-15T01:21:53.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f230f7e4b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 0x5643b51199b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f230f7e4b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b513c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f230f7e4b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 0x5643b513f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f230f7e4b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b5140990 con 0x5643b5141cf0 2023-11-15T01:21:53.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f230f7e4b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b5118c00 con 0x5643b51624e0 2023-11-15T01:21:53.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f230f7e4b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643b51459a0 con 0x5643b4ed5e40 2023-11-15T01:21:53.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f22f6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b513c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f22f6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b513c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37334/0 (socket says 172.21.15.1:37334) 2023-11-15T01:21:53.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f22f6ffd700 1 -- 172.21.15.1:0/825455572 learned_addr learned my addr 172.21.15.1:0/825455572 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:53.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f22f77fe700 1 --2- 172.21.15.1:0/825455572 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 0x5643b51199b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f22f7fff700 1 --2- 172.21.15.1:0/825455572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 0x5643b513f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f22f6ffd700 1 -- 172.21.15.1:0/825455572 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 msgr2=0x5643b51199b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:53.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/825455572 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 0x5643b51199b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f22f6ffd700 1 -- 172.21.15.1:0/825455572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 msgr2=0x5643b513f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:53.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/825455572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 0x5643b513f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f22f6ffd700 1 -- 172.21.15.1:0/825455572 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643b505f710 con 0x5643b5141cf0 2023-11-15T01:21:53.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f22f77fe700 1 --2- 172.21.15.1:0/825455572 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 0x5643b51199b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:53.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f22f7fff700 1 --2- 172.21.15.1:0/825455572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 0x5643b513f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:53.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.874+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/825455572 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b513c940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f22ec07bdd0 tx=0x7f22ec03c000).ready entity=mon.0 client_cookie=3776a96640fd2752 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:53.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.875+0000 7f22dd7fa700 1 -- 172.21.15.1:0/825455572 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec01a3b0 con 0x5643b5141cf0 2023-11-15T01:21:53.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.875+0000 7f22dd7fa700 1 -- 172.21.15.1:0/825455572 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec050a20 con 0x5643b5141cf0 2023-11-15T01:21:53.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.875+0000 7f22dd7fa700 1 -- 172.21.15.1:0/825455572 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec050180 con 0x5643b5141cf0 2023-11-15T01:21:53.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.875+0000 7f230f7e4b80 1 -- 172.21.15.1:0/825455572 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 msgr2=0x5643b513c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.875+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/825455572 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b513c940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f22ec07bdd0 tx=0x7f22ec03c000).stop 2023-11-15T01:21:53.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.875+0000 7f230f7e4b80 1 -- 172.21.15.1:0/825455572 shutdown_connections 2023-11-15T01:21:53.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.875+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/825455572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b51624e0 0x5643b513f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.875+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/825455572 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b4ed5e40 0x5643b51199b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.875+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/825455572 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b5141cf0 0x5643b513c940 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.875+0000 7f230f7e4b80 1 -- 172.21.15.1:0/825455572 >> 172.21.15.1:0/825455572 conn(0x5643b4f834a0 msgr2=0x5643b511ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:53.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.875+0000 7f230f7e4b80 1 -- 172.21.15.1:0/825455572 shutdown_connections 2023-11-15T01:21:53.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.875+0000 7f230f7e4b80 1 -- 172.21.15.1:0/825455572 wait complete. 2023-11-15T01:21:53.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.876+0000 7f230f7e4b80 1 -- start start 2023-11-15T01:21:53.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.876+0000 7f230f7e4b80 1 Processor -- start 2023-11-15T01:21:53.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.876+0000 7f230f7e4b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b4ed5e40 0x5643b5119f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.876+0000 7f230f7e4b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b5141cf0 0x5643b515aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.876+0000 7f230f7e4b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b51624e0 0x5643b515b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.876+0000 7f230f7e4b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b515b8d0 con 0x5643b4ed5e40 2023-11-15T01:21:53.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.876+0000 7f230f7e4b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b513e650 con 0x5643b5141cf0 2023-11-15T01:21:53.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.876+0000 7f230f7e4b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643b513e930 con 0x5643b51624e0 2023-11-15T01:21:53.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f230f7e4b80 10 client.0 ll_register_callbacks cb 0x5643b50d9640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:21:53.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22f77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b4ed5e40 0x5643b5119f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22f77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b4ed5e40 0x5643b5119f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37338/0 (socket says 172.21.15.1:37338) 2023-11-15T01:21:53.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22f77fe700 1 -- 172.21.15.1:0/1847417785 learned_addr learned my addr 172.21.15.1:0/1847417785 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:53.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22f7fff700 1 --2- 172.21.15.1:0/1847417785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b51624e0 0x5643b515b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/1847417785 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b5141cf0 0x5643b515aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22f77fe700 1 -- 172.21.15.1:0/1847417785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b51624e0 msgr2=0x5643b515b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:53.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22f77fe700 1 --2- 172.21.15.1:0/1847417785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b51624e0 0x5643b515b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22f77fe700 1 -- 172.21.15.1:0/1847417785 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b5141cf0 msgr2=0x5643b515aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:53.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22f77fe700 1 --2- 172.21.15.1:0/1847417785 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b5141cf0 0x5643b515aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22f77fe700 1 -- 172.21.15.1:0/1847417785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643b505f9c0 con 0x5643b4ed5e40 2023-11-15T01:21:53.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/1847417785 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b5141cf0 0x5643b515aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:53.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22f7fff700 1 --2- 172.21.15.1:0/1847417785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b51624e0 0x5643b515b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:53.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22f77fe700 1 --2- 172.21.15.1:0/1847417785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b4ed5e40 0x5643b5119f80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f22e8001120 tx=0x7f22e8019040).ready entity=mon.0 client_cookie=e7b596f166bef61f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:53.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:21:53.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22d5ffb700 1 -- 172.21.15.1:0/1847417785 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8016ea0 con 0x5643b4ed5e40 2023-11-15T01:21:53.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22d5ffb700 1 -- 172.21.15.1:0/1847417785 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f22e8027570 con 0x5643b4ed5e40 2023-11-15T01:21:53.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f230f7e4b80 1 -- 172.21.15.1:0/1847417785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f22f000f040 con 0x5643b4ed5e40 2023-11-15T01:21:53.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22d5ffb700 1 -- 172.21.15.1:0/1847417785 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22e8027730 con 0x5643b4ed5e40 2023-11-15T01:21:53.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f230f7e4b80 10 client.4704 fetch_fsmap learned FSMap version 8 2023-11-15T01:21:53.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f230f7e4b80 1 -- 172.21.15.1:0/1847417785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5643b4ed6f80 con 0x5643b4ed5e40 2023-11-15T01:21:53.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22d5ffb700 1 -- 172.21.15.1:0/1847417785 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f000f040 con 0x5643b4ed5e40 2023-11-15T01:21:53.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f22d5ffb700 1 -- 172.21.15.1:0/1847417785 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f22e8027890 con 0x5643b4ed5e40 2023-11-15T01:21:53.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f230f7e4b80 10 client.4704 fetch_fsmap finished waiting for FSMap version 8 2023-11-15T01:21:53.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f230f7e4b80 10 client.4704 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-15T01:21:53.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f230f7e4b80 20 client.4704 populate_metadata read hostname 'smithi001' 2023-11-15T01:21:53.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/1847417785 >> [v2:172.21.15.1:6834/4209655632,v1:172.21.15.1:6835/4209655632] conn(0x5643b513f4c0 0x5643b513f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:53.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f230f7e4b80 4 client.4704 mds_command: new command op to 4275 tid=0[{"prefix": "status"}] 2023-11-15T01:21:53.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.877+0000 7f230f7e4b80 1 -- 172.21.15.1:0/1847417785 --> [v2:172.21.15.1:6834/4209655632,v1:172.21.15.1:6835/4209655632] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5643b4f08ca0 con 0x5643b513f4c0 2023-11-15T01:21:53.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/1847417785 >> [v2:172.21.15.1:6834/4209655632,v1:172.21.15.1:6835/4209655632] conn(0x5643b513f4c0 0x5643b513f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:53.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f22d5ffb700 10 client.4704 ms_handle_connect on v2:172.21.15.1:6834/4209655632 2023-11-15T01:21:53.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f22f6ffd700 1 --2- 172.21.15.1:0/1847417785 >> [v2:172.21.15.1:6834/4209655632,v1:172.21.15.1:6835/4209655632] conn(0x5643b513f4c0 0x5643b513f8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c513f0222ba82a78 server_cookie=ebdda8f61b8c7d2f in_seq=0 out_seq=0 2023-11-15T01:21:53.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f22d5ffb700 1 -- 172.21.15.1:0/1847417785 <== mds.0 v2:172.21.15.1:6834/4209655632 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5643b4f08ca0 con 0x5643b513f4c0 2023-11-15T01:21:53.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f22d5ffb700 10 client.4704 handle_command_reply: tid=0 2023-11-15T01:21:53.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f230f7e4b80 1 client.4704 shutdown 2023-11-15T01:21:53.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f230f7e4b80 1 -- 172.21.15.1:0/1847417785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b4ed5e40 msgr2=0x5643b5119f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/1847417785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b4ed5e40 0x5643b5119f80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f22e8001120 tx=0x7f22e8019040).stop 2023-11-15T01:21:53.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f230f7e4b80 1 -- 172.21.15.1:0/1847417785 shutdown_connections 2023-11-15T01:21:53.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/1847417785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5643b51624e0 0x5643b515b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/1847417785 >> [v2:172.21.15.1:6834/4209655632,v1:172.21.15.1:6835/4209655632] conn(0x5643b513f4c0 0x5643b513f8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/1847417785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b4ed5e40 0x5643b5119f80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f22d5ffb700 0 client.4704 ms_handle_reset on v2:172.21.15.1:6834/4209655632 2023-11-15T01:21:53.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f230f7e4b80 1 --2- 172.21.15.1:0/1847417785 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5643b5141cf0 0x5643b515aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f230f7e4b80 1 -- 172.21.15.1:0/1847417785 >> 172.21.15.1:0/1847417785 conn(0x5643b4f834a0 msgr2=0x5643b5110e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:53.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f230f7e4b80 1 -- 172.21.15.1:0/1847417785 shutdown_connections 2023-11-15T01:21:53.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f230f7e4b80 1 -- 172.21.15.1:0/1847417785 wait complete. 2023-11-15T01:21:53.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.878+0000 7f230f7e4b80 20 client.4704 trim_cache size 0 max 16384 2023-11-15T01:21:53.914 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T01:21:53.914 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "32ffb44b-12dc-4e79-bad7-24a9692dabf6", 2023-11-15T01:21:53.914 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2023-11-15T01:21:53.914 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 4275, 2023-11-15T01:21:53.915 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2023-11-15T01:21:53.915 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2023-11-15T01:21:53.915 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2023-11-15T01:21:53.915 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 16.831253694000001, 2023-11-15T01:21:53.915 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 8, 2023-11-15T01:21:53.916 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 22, 2023-11-15T01:21:53.916 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 22, 2023-11-15T01:21:53.916 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 21.969786139 2023-11-15T01:21:53.916 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T01:21:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.879+0000 7f22fcbe9700 1 -- 172.21.15.1:0/3726323262 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f22e405f150 msgr2=0x7f22e4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.879+0000 7f22fcbe9700 1 --2- 172.21.15.1:0/3726323262 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f22e405f150 0x7f22e4061610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f22e8000e50 tx=0x7f22e8001e90).stop 2023-11-15T01:21:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.879+0000 7f22fcbe9700 1 -- 172.21.15.1:0/3726323262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f81532d0 msgr2=0x7f22f8153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.879+0000 7f22fcbe9700 1 --2- 172.21.15.1:0/3726323262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f81532d0 0x7f22f8153750 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f22e0004480 tx=0x7f22ec01a000).stop 2023-11-15T01:21:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.879+0000 7f22fcbe9700 1 -- 172.21.15.1:0/3726323262 shutdown_connections 2023-11-15T01:21:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.879+0000 7f22fcbe9700 1 --2- 172.21.15.1:0/3726323262 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f22e405f150 0x7f22e4061610 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.879+0000 7f22fcbe9700 1 --2- 172.21.15.1:0/3726323262 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22f80ac940 0x7f22f80acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.879+0000 7f22fcbe9700 1 --2- 172.21.15.1:0/3726323262 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22e0004690 0x7f22f814cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.879+0000 7f22fcbe9700 1 --2- 172.21.15.1:0/3726323262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f81532d0 0x7f22f8153750 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.879+0000 7f22fcbe9700 1 -- 172.21.15.1:0/3726323262 >> 172.21.15.1:0/3726323262 conn(0x7f22f80947e0 msgr2=0x7f22f80a9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.879+0000 7f22fcbe9700 1 -- 172.21.15.1:0/3726323262 shutdown_connections 2023-11-15T01:21:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:53.879+0000 7f22fcbe9700 1 -- 172.21.15.1:0/3726323262 wait complete. 2023-11-15T01:21:53.921 INFO:teuthology.run_tasks:Running task kclient... 2023-11-15T01:21:53.952 INFO:tasks.kclient:Mounting kernel clients... 2023-11-15T01:21:53.952 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-15T01:21:53.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:53.953 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T01:21:53.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:53.970 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2023-11-15T01:21:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:Cannot find device "ceph-brx" 2023-11-15T01:21:54.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-15T01:21:54.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:54.040 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T01:21:54.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:54.096 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2023-11-15T01:21:54.162 INFO:teuthology.orchestra.run.smithi001.stderr:Cannot find device "ceph-brx" 2023-11-15T01:21:54.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-15T01:21:54.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:54.164 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list 2023-11-15T01:21:54.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:54.183 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link delete ceph-brx 2023-11-15T01:21:54.254 INFO:teuthology.orchestra.run.smithi141.stderr:Cannot find device "ceph-brx" 2023-11-15T01:21:54.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-15T01:21:54.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:54.257 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list 2023-11-15T01:21:54.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:54.314 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link delete ceph-brx 2023-11-15T01:21:54.382 INFO:teuthology.orchestra.run.smithi141.stderr:Cannot find device "ceph-brx" 2023-11-15T01:21:54.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-15T01:21:54.384 INFO:tasks.kclient:client.0 config is {} 2023-11-15T01:21:54.384 DEBUG:teuthology.orchestra.run.smithi001:> ceph fs ls 2023-11-15T01:21:54.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.490+0000 7fab0c2de700 1 Processor -- start 2023-11-15T01:21:54.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.491+0000 7fab0c2de700 1 -- start start 2023-11-15T01:21:54.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.491+0000 7fab0c2de700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab04158cf0 0x7fab040c1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:54.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.491+0000 7fab0c2de700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab04158150 con 0x7fab04062c10 2023-11-15T01:21:54.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab0c2de700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab04063670 con 0x7fab04154410 2023-11-15T01:21:54.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab0c2de700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab04063950 con 0x7fab04158cf0 2023-11-15T01:21:54.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09879700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fab04062c10 0x7fab041585e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41650/0 (socket says 172.21.15.1:41650) 2023-11-15T01:21:54.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09879700 1 -- 172.21.15.1:0/4014276600 learned_addr learned my addr 172.21.15.1:0/4014276600 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:21:54.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab0a87b700 1 --2- 172.21.15.1:0/4014276600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab04158cf0 0x7fab040c1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:54.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09078700 1 -- 172.21.15.1:0/4014276600 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879999668 0 0) 0x7fab04158150 con 0x7fab04062c10 2023-11-15T01:21:54.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09078700 1 -- 172.21.15.1:0/4014276600 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaec0033f0 con 0x7fab04062c10 2023-11-15T01:21:54.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09078700 1 -- 172.21.15.1:0/4014276600 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3656452635 0 0) 0x7faaec0033f0 con 0x7fab04062c10 2023-11-15T01:21:54.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09078700 1 -- 172.21.15.1:0/4014276600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab04158cf0 msgr2=0x7fab040c1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:54.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09078700 1 --2- 172.21.15.1:0/4014276600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab04158cf0 0x7fab040c1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:54.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09078700 1 -- 172.21.15.1:0/4014276600 >> v1:172.21.15.141:6789/0 conn(0x7fab04154410 legacy=0x7fab040ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:54.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09078700 1 -- 172.21.15.1:0/4014276600 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab04063c30 con 0x7fab04062c10 2023-11-15T01:21:54.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09078700 1 -- 172.21.15.1:0/4014276600 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7faaf8001470 con 0x7fab04062c10 2023-11-15T01:21:54.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09078700 1 -- 172.21.15.1:0/4014276600 >> v1:172.21.15.1:6789/0 conn(0x7fab04062c10 legacy=0x7fab041585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:54.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09078700 1 --2- 172.21.15.1:0/4014276600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab04158cf0 0x7faaec003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:54.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09078700 1 --2- 172.21.15.1:0/4014276600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec003e40 0x7faaec004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:54.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09078700 1 --2- 172.21.15.1:0/4014276600 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faaec004b80 0x7faaec005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:54.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09078700 1 -- 172.21.15.1:0/4014276600 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab04063950 con 0x7faaec003e40 2023-11-15T01:21:54.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09078700 1 -- 172.21.15.1:0/4014276600 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec00b990 con 0x7faaec004b80 2023-11-15T01:21:54.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09078700 1 -- 172.21.15.1:0/4014276600 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec00bb50 con 0x7fab04158cf0 2023-11-15T01:21:54.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab09879700 1 --2- 172.21.15.1:0/4014276600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec003e40 0x7faaec004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:54.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab0a07a700 1 --2- 172.21.15.1:0/4014276600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab04158cf0 0x7faaec003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:54.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.492+0000 7fab0a87b700 1 --2- 172.21.15.1:0/4014276600 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faaec004b80 0x7faaec005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:54.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.493+0000 7fab09879700 1 -- 172.21.15.1:0/4014276600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab04158cf0 msgr2=0x7faaec003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:54.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.493+0000 7fab09879700 1 --2- 172.21.15.1:0/4014276600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab04158cf0 0x7faaec003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:54.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.493+0000 7fab09879700 1 -- 172.21.15.1:0/4014276600 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faaec004b80 msgr2=0x7faaec005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:54.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.493+0000 7fab09879700 1 --2- 172.21.15.1:0/4014276600 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faaec004b80 0x7faaec005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:54.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.493+0000 7fab09879700 1 -- 172.21.15.1:0/4014276600 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec0033f0 con 0x7faaec003e40 2023-11-15T01:21:54.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.493+0000 7fab09879700 1 --2- 172.21.15.1:0/4014276600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec003e40 0x7faaec004690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7faaf800c190 tx=0x7faaf8001e50).ready entity=mon.0 client_cookie=79d27342e7d25f92 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:54.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.493+0000 7fab09078700 1 -- 172.21.15.1:0/4014276600 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8007a20 con 0x7faaec003e40 2023-11-15T01:21:54.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.493+0000 7fab09078700 1 -- 172.21.15.1:0/4014276600 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf800cac0 con 0x7faaec003e40 2023-11-15T01:21:54.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.493+0000 7fab09078700 1 -- 172.21.15.1:0/4014276600 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf800ce40 con 0x7faaec003e40 2023-11-15T01:21:54.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.493+0000 7fab0c2de700 1 -- 172.21.15.1:0/4014276600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec003e40 msgr2=0x7faaec004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:54.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.493+0000 7fab0c2de700 1 --2- 172.21.15.1:0/4014276600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec003e40 0x7faaec004690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7faaf800c190 tx=0x7faaf8001e50).stop 2023-11-15T01:21:54.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.493+0000 7fab0a87b700 1 -- 172.21.15.1:0/4014276600 reap_dead start 2023-11-15T01:21:54.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.494+0000 7fab0c2de700 1 -- 172.21.15.1:0/4014276600 shutdown_connections 2023-11-15T01:21:54.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.494+0000 7fab0c2de700 1 -- 172.21.15.1:0/4014276600 >> 172.21.15.1:0/4014276600 conn(0x7fab040cbbd0 msgr2=0x7fab040c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:54.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.494+0000 7fab0c2de700 1 -- 172.21.15.1:0/4014276600 shutdown_connections 2023-11-15T01:21:54.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.494+0000 7fab0c2de700 1 -- 172.21.15.1:0/4014276600 wait complete. 2023-11-15T01:21:54.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.495+0000 7fab0c2de700 1 Processor -- start 2023-11-15T01:21:54.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.495+0000 7fab0c2de700 1 -- start start 2023-11-15T01:21:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.495+0000 7fab0c2de700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec003e40 0x7fab040c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.495+0000 7fab0c2de700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab04164eb0 0x7fab04150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:54.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.495+0000 7fab0c2de700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab04150fd0 0x7fab04168450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:54.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.495+0000 7fab0c2de700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab041514d0 con 0x7faaec003e40 2023-11-15T01:21:54.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.495+0000 7fab0c2de700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab04155250 con 0x7fab04164eb0 2023-11-15T01:21:54.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.495+0000 7fab0c2de700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab04154920 con 0x7fab04150fd0 2023-11-15T01:21:54.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.495+0000 7fab0a07a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec003e40 0x7fab040c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.496+0000 7fab0a07a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec003e40 0x7fab040c5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37362/0 (socket says 172.21.15.1:37362) 2023-11-15T01:21:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.496+0000 7fab0a07a700 1 -- 172.21.15.1:0/1359995746 learned_addr learned my addr 172.21.15.1:0/1359995746 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.496+0000 7fab0a87b700 1 --2- 172.21.15.1:0/1359995746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab04150fd0 0x7fab04168450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.496+0000 7fab09879700 1 --2- 172.21.15.1:0/1359995746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab04164eb0 0x7fab04150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.496+0000 7fab0a07a700 1 -- 172.21.15.1:0/1359995746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab04150fd0 msgr2=0x7fab04168450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.496+0000 7fab0a07a700 1 --2- 172.21.15.1:0/1359995746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab04150fd0 0x7fab04168450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.496+0000 7fab0a07a700 1 -- 172.21.15.1:0/1359995746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab04164eb0 msgr2=0x7fab04150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.496+0000 7fab0a07a700 1 --2- 172.21.15.1:0/1359995746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab04164eb0 0x7fab04150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.496+0000 7fab0a07a700 1 -- 172.21.15.1:0/1359995746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab04154c00 con 0x7faaec003e40 2023-11-15T01:21:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.496+0000 7fab0a07a700 1 --2- 172.21.15.1:0/1359995746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec003e40 0x7fab040c5d20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7faafc00ebc0 tx=0x7faafc007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.496+0000 7fab027fc700 1 -- 172.21.15.1:0/1359995746 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc00c7e0 con 0x7faaec003e40 2023-11-15T01:21:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.496+0000 7fab027fc700 1 -- 172.21.15.1:0/1359995746 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc002e90 con 0x7faaec003e40 2023-11-15T01:21:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.496+0000 7fab0c2de700 1 -- 172.21.15.1:0/1359995746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab04154ee0 con 0x7faaec003e40 2023-11-15T01:21:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.496+0000 7fab027fc700 1 -- 172.21.15.1:0/1359995746 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc00cb50 con 0x7faaec003e40 2023-11-15T01:21:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.496+0000 7fab0c2de700 1 -- 172.21.15.1:0/1359995746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab040c6210 con 0x7faaec003e40 2023-11-15T01:21:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.497+0000 7fab0c2de700 1 -- 172.21.15.1:0/1359995746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab040475e0 con 0x7faaec003e40 2023-11-15T01:21:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.497+0000 7fab027fc700 1 -- 172.21.15.1:0/1359995746 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7faafc0133e0 con 0x7faaec003e40 2023-11-15T01:21:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.498+0000 7fab027fc700 1 --2- 172.21.15.1:0/1359995746 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faaf005f150 0x7faaf0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.498+0000 7fab027fc700 1 -- 172.21.15.1:0/1359995746 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faafc079d50 con 0x7faaec003e40 2023-11-15T01:21:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.498+0000 7fab09879700 1 --2- 172.21.15.1:0/1359995746 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faaf005f150 0x7faaf0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:54.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.498+0000 7fab09879700 1 --2- 172.21.15.1:0/1359995746 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faaf005f150 0x7faaf0061610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7faaf800ca90 tx=0x7faaf8015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:54.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.502+0000 7fab027fc700 1 -- 172.21.15.1:0/1359995746 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7faafc07d030 con 0x7faaec003e40 2023-11-15T01:21:54.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.721+0000 7fab0c2de700 1 -- 172.21.15.1:0/1359995746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fab04063f10 con 0x7faaec003e40 2023-11-15T01:21:54.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.721+0000 7fab027fc700 1 -- 172.21.15.1:0/1359995746 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7faafc04b070 con 0x7faaec003e40 2023-11-15T01:21:54.723 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-15T01:21:54.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.723+0000 7fab0c2de700 1 -- 172.21.15.1:0/1359995746 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faaf005f150 msgr2=0x7faaf0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:54.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.723+0000 7fab0c2de700 1 --2- 172.21.15.1:0/1359995746 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faaf005f150 0x7faaf0061610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7faaf800ca90 tx=0x7faaf8015000).stop 2023-11-15T01:21:54.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.723+0000 7fab0c2de700 1 -- 172.21.15.1:0/1359995746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec003e40 msgr2=0x7fab040c5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:54.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.723+0000 7fab0c2de700 1 --2- 172.21.15.1:0/1359995746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec003e40 0x7fab040c5d20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7faafc00ebc0 tx=0x7faafc007f30).stop 2023-11-15T01:21:54.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.723+0000 7fab0c2de700 1 -- 172.21.15.1:0/1359995746 shutdown_connections 2023-11-15T01:21:54.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.723+0000 7fab0c2de700 1 --2- 172.21.15.1:0/1359995746 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faaf005f150 0x7faaf0061610 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:54.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.723+0000 7fab0c2de700 1 --2- 172.21.15.1:0/1359995746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab04150fd0 0x7fab04168450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:54.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.723+0000 7fab0c2de700 1 --2- 172.21.15.1:0/1359995746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec003e40 0x7fab040c5d20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:54.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.723+0000 7fab0c2de700 1 --2- 172.21.15.1:0/1359995746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab04164eb0 0x7fab04150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:54.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.723+0000 7fab0c2de700 1 -- 172.21.15.1:0/1359995746 >> 172.21.15.1:0/1359995746 conn(0x7fab040cbbd0 msgr2=0x7fab040c0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:54.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.723+0000 7fab0c2de700 1 -- 172.21.15.1:0/1359995746 shutdown_connections 2023-11-15T01:21:54.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:54.724+0000 7fab0c2de700 1 -- 172.21.15.1:0/1359995746 wait complete. 2023-11-15T01:21:54.735 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-15T01:21:54.735 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-15T01:21:54.735 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-11-15T01:21:54.736 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-15T01:21:54.736 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-15T01:21:54.736 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-15T01:21:54.737 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-15T01:21:54.737 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-15T01:21:54.737 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T01:21:54.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:54.739 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-11-15T01:21:54.754 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:21:54.755 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T01:21:54.755 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T01:21:54.755 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:54.755 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-11-15T01:21:54.756 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:54.756 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:21:54.756 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:54.756 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-11-15T01:21:54.757 INFO:teuthology.orchestra.run.smithi001.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-15T01:21:54.757 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:54.757 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-11-15T01:21:54.757 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-15T01:21:54.757 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42490sec preferred_lft 42490sec 2023-11-15T01:21:54.758 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2023-11-15T01:21:54.758 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:54.758 INFO:teuthology.orchestra.run.smithi001.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:21:54.758 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:54.758 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-11-15T01:21:54.759 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:21:54.759 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:54.759 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-11-15T01:21:54.760 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-15T01:21:54.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:54.761 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:21:54.761 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:21:54.762 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add name ceph-brx type bridge 2023-11-15T01:21:54.762 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr flush dev ceph-brx 2023-11-15T01:21:54.762 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set ceph-brx up 2023-11-15T01:21:54.763 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-15T01:21:54.763 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:21:54.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:54.913 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-15T01:21:54.957 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-11-15T01:21:54.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:54.958 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-11-15T01:21:55.028 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-11-15T01:21:55.028 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-15T01:21:55.029 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-15T01:21:55.029 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-15T01:21:55.029 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-15T01:21:55.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:55.030 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:21:55.030 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:21:55.031 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-15T01:21:55.031 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-15T01:21:55.031 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-15T01:21:55.032 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:21:55.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:55.287 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T01:21:55.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:55.303 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list-id 2023-11-15T01:21:55.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:55.358 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:21:55.358 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:21:55.358 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-15T01:21:55.359 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-15T01:21:55.359 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:21:55.449 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-15T01:21:55.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:55.450 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:21:55.450 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:21:55.451 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-15T01:21:55.451 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-15T01:21:55.451 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-15T01:21:55.451 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-15T01:21:55.452 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-15T01:21:55.452 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:21:55.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:55.656 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:21:55.657 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:21:55.657 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2023-11-15T01:21:55.657 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set dev brx.0 master ceph-brx 2023-11-15T01:21:55.658 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:21:55.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:55.752 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-15T01:21:55.767 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-15T01:21:55.768 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:21:55.854 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:21:55.855 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:21:55.943 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:21:55.943 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:21:55.946 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-15T01:21:55.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:55.947 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-15T01:21:55.972 INFO:tasks.kclient:client.2 config is {} 2023-11-15T01:21:55.973 DEBUG:teuthology.orchestra.run.smithi001:> ceph fs ls 2023-11-15T01:21:56.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.116+0000 7f27245a6700 1 Processor -- start 2023-11-15T01:21:56.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.117+0000 7f27245a6700 1 -- start start 2023-11-15T01:21:56.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f27245a6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f271c062c10 0x7f271c1585e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:56.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f27245a6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c063140 0x7f271c158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:56.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f27245a6700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271c158150 con 0x7f271c154410 2023-11-15T01:21:56.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f27245a6700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271c158fc0 con 0x7f271c062c10 2023-11-15T01:21:56.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f27245a6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c063670 con 0x7f271c063140 2023-11-15T01:21:56.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f2721b41700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f271c062c10 0x7f271c1585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:56.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f2721b41700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f271c062c10 0x7f271c1585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37376/0 (socket says 172.21.15.1:37376) 2023-11-15T01:21:56.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f2721b41700 1 -- 172.21.15.1:0/2441365814 learned_addr learned my addr 172.21.15.1:0/2441365814 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:56.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f2722b43700 1 --2- 172.21.15.1:0/2441365814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c063140 0x7f271c158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:56.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f2721b41700 1 -- 172.21.15.1:0/2441365814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c063140 msgr2=0x7f271c158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:56.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f2721b41700 1 --2- 172.21.15.1:0/2441365814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c063140 0x7f271c158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:56.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f2721b41700 1 -- 172.21.15.1:0/2441365814 >> v1:172.21.15.141:6789/0 conn(0x7f271c154410 legacy=0x7f271c0ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:56.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f2721b41700 1 -- 172.21.15.1:0/2441365814 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c063950 con 0x7f271c062c10 2023-11-15T01:21:56.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f2721b41700 1 --2- 172.21.15.1:0/2441365814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f271c062c10 0x7f271c1585e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f2710006fd0 tx=0x7f27100090f0).ready entity=mon.0 client_cookie=3b7ce26f19f9430d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:56.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f2721340700 1 -- 172.21.15.1:0/2441365814 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000b600 con 0x7f271c062c10 2023-11-15T01:21:56.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f2721340700 1 -- 172.21.15.1:0/2441365814 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271000b760 con 0x7f271c062c10 2023-11-15T01:21:56.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.118+0000 7f2721340700 1 -- 172.21.15.1:0/2441365814 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000bae0 con 0x7f271c062c10 2023-11-15T01:21:56.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.119+0000 7f27245a6700 1 -- 172.21.15.1:0/2441365814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f271c062c10 msgr2=0x7f271c1585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:56.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.119+0000 7f27245a6700 1 --2- 172.21.15.1:0/2441365814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f271c062c10 0x7f271c1585e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f2710006fd0 tx=0x7f27100090f0).stop 2023-11-15T01:21:56.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.119+0000 7f27245a6700 1 -- 172.21.15.1:0/2441365814 shutdown_connections 2023-11-15T01:21:56.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.119+0000 7f27245a6700 1 --2- 172.21.15.1:0/2441365814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c063140 0x7f271c158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:56.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.119+0000 7f27245a6700 1 --2- 172.21.15.1:0/2441365814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f271c062c10 0x7f271c1585e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:56.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.119+0000 7f27245a6700 1 -- 172.21.15.1:0/2441365814 >> 172.21.15.1:0/2441365814 conn(0x7f271c0cbbd0 msgr2=0x7f271c0c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:56.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.119+0000 7f27245a6700 1 -- 172.21.15.1:0/2441365814 shutdown_connections 2023-11-15T01:21:56.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.119+0000 7f27245a6700 1 -- 172.21.15.1:0/2441365814 wait complete. 2023-11-15T01:21:56.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.120+0000 7f27245a6700 1 Processor -- start 2023-11-15T01:21:56.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.120+0000 7f27245a6700 1 -- start start 2023-11-15T01:21:56.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f27245a6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f271c062c10 0x7f271c14dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:56.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f27245a6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c063140 0x7f271c0c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:56.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f27245a6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f271c154410 0x7f271c0c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:56.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f27245a6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c0c5ed0 con 0x7f271c154410 2023-11-15T01:21:56.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f27245a6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c165ae0 con 0x7f271c062c10 2023-11-15T01:21:56.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f27245a6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c164f40 con 0x7f271c063140 2023-11-15T01:21:56.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f2722b43700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f271c154410 0x7f271c0c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:56.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f2722b43700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f271c154410 0x7f271c0c59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37392/0 (socket says 172.21.15.1:37392) 2023-11-15T01:21:56.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f2722b43700 1 -- 172.21.15.1:0/1090752268 learned_addr learned my addr 172.21.15.1:0/1090752268 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:21:56.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f2721b41700 1 --2- 172.21.15.1:0/1090752268 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c063140 0x7f271c0c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:56.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f2722342700 1 --2- 172.21.15.1:0/1090752268 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f271c062c10 0x7f271c14dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:56.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f2722b43700 1 -- 172.21.15.1:0/1090752268 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c063140 msgr2=0x7f271c0c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:56.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f2722b43700 1 --2- 172.21.15.1:0/1090752268 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c063140 0x7f271c0c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:56.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f2722b43700 1 -- 172.21.15.1:0/1090752268 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f271c062c10 msgr2=0x7f271c14dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:56.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f2722b43700 1 --2- 172.21.15.1:0/1090752268 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f271c062c10 0x7f271c14dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:56.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f2722b43700 1 -- 172.21.15.1:0/1090752268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2710009370 con 0x7f271c154410 2023-11-15T01:21:56.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f2722b43700 1 --2- 172.21.15.1:0/1090752268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f271c154410 0x7f271c0c59e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f270c009fd0 tx=0x7f270c009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:56.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.121+0000 7f271a7fc700 1 -- 172.21.15.1:0/1090752268 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c00ebf0 con 0x7f271c154410 2023-11-15T01:21:56.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.122+0000 7f271a7fc700 1 -- 172.21.15.1:0/1090752268 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c00ed50 con 0x7f271c154410 2023-11-15T01:21:56.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.122+0000 7f27245a6700 1 -- 172.21.15.1:0/1090752268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271c1651b0 con 0x7f271c154410 2023-11-15T01:21:56.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.122+0000 7f271a7fc700 1 -- 172.21.15.1:0/1090752268 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c014610 con 0x7f271c154410 2023-11-15T01:21:56.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.122+0000 7f27245a6700 1 -- 172.21.15.1:0/1090752268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271c14e260 con 0x7f271c154410 2023-11-15T01:21:56.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.122+0000 7f27245a6700 1 -- 172.21.15.1:0/1090752268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271c1655a0 con 0x7f271c154410 2023-11-15T01:21:56.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.123+0000 7f271a7fc700 1 -- 172.21.15.1:0/1090752268 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f270c01d3b0 con 0x7f271c154410 2023-11-15T01:21:56.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.123+0000 7f271a7fc700 1 --2- 172.21.15.1:0/1090752268 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f270805f150 0x7f2708061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:56.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.123+0000 7f271a7fc700 1 -- 172.21.15.1:0/1090752268 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f270c07a650 con 0x7f271c154410 2023-11-15T01:21:56.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.124+0000 7f2722342700 1 --2- 172.21.15.1:0/1090752268 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f270805f150 0x7f2708061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:56.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.124+0000 7f2722342700 1 --2- 172.21.15.1:0/1090752268 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f270805f150 0x7f2708061610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2714003920 tx=0x7f2714000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:56.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.127+0000 7f271a7fc700 1 -- 172.21.15.1:0/1090752268 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f270c04b8c0 con 0x7f271c154410 2023-11-15T01:21:56.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.346+0000 7f27245a6700 1 -- 172.21.15.1:0/1090752268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f271c1653a0 con 0x7f271c154410 2023-11-15T01:21:56.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.346+0000 7f271a7fc700 1 -- 172.21.15.1:0/1090752268 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f270c04eee0 con 0x7f271c154410 2023-11-15T01:21:56.347 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-15T01:21:56.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.348+0000 7f27245a6700 1 -- 172.21.15.1:0/1090752268 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f270805f150 msgr2=0x7f2708061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:56.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.348+0000 7f27245a6700 1 --2- 172.21.15.1:0/1090752268 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f270805f150 0x7f2708061610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2714003920 tx=0x7f2714000bc0).stop 2023-11-15T01:21:56.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.348+0000 7f27245a6700 1 -- 172.21.15.1:0/1090752268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f271c154410 msgr2=0x7f271c0c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:56.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.348+0000 7f27245a6700 1 --2- 172.21.15.1:0/1090752268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f271c154410 0x7f271c0c59e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f270c009fd0 tx=0x7f270c009900).stop 2023-11-15T01:21:56.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.348+0000 7f27245a6700 1 -- 172.21.15.1:0/1090752268 shutdown_connections 2023-11-15T01:21:56.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.348+0000 7f27245a6700 1 --2- 172.21.15.1:0/1090752268 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f270805f150 0x7f2708061610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:56.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.348+0000 7f27245a6700 1 --2- 172.21.15.1:0/1090752268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f271c154410 0x7f271c0c59e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:56.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.348+0000 7f27245a6700 1 --2- 172.21.15.1:0/1090752268 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f271c062c10 0x7f271c14dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:56.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.348+0000 7f27245a6700 1 --2- 172.21.15.1:0/1090752268 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c063140 0x7f271c0c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:56.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.348+0000 7f27245a6700 1 -- 172.21.15.1:0/1090752268 >> 172.21.15.1:0/1090752268 conn(0x7f271c0cbbd0 msgr2=0x7f271c0ca900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:56.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.348+0000 7f27245a6700 1 -- 172.21.15.1:0/1090752268 shutdown_connections 2023-11-15T01:21:56.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:21:56.348+0000 7f27245a6700 1 -- 172.21.15.1:0/1090752268 wait complete. 2023-11-15T01:21:56.359 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-15T01:21:56.360 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-15T01:21:56.360 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-11-15T01:21:56.360 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-15T01:21:56.360 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-15T01:21:56.360 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-15T01:21:56.361 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-15T01:21:56.361 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-15T01:21:56.361 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-15T01:21:56.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:56.362 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-11-15T01:21:56.377 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:21:56.377 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T01:21:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T01:21:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-11-15T01:21:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:56.378 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:21:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-11-15T01:21:56.379 INFO:teuthology.orchestra.run.smithi001.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-15T01:21:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-11-15T01:21:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-15T01:21:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42489sec preferred_lft 42489sec 2023-11-15T01:21:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2023-11-15T01:21:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:56.380 INFO:teuthology.orchestra.run.smithi001.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:21:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-11-15T01:21:56.381 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:21:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-11-15T01:21:56.381 INFO:teuthology.orchestra.run.smithi001.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:21:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-15T01:21:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::74ff:4aff:fef6:c8f5/64 scope link tentative 2023-11-15T01:21:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:56.383 INFO:teuthology.orchestra.run.smithi001.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:21:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-15T01:21:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::10ca:5cff:fe8a:9a23/64 scope link tentative 2023-11-15T01:21:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:56.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:56.384 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-15T01:21:56.442 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-11-15T01:21:56.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:56.443 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-11-15T01:21:56.500 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-11-15T01:21:56.500 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-15T01:21:56.501 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-15T01:21:56.501 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-15T01:21:56.501 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-15T01:21:56.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:56.502 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:21:56.502 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:21:56.502 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-15T01:21:56.503 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-15T01:21:56.503 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-15T01:21:56.503 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:21:56.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:56.603 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T01:21:56.618 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-15T01:21:56.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:56.619 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list-id 2023-11-15T01:21:56.674 INFO:teuthology.orchestra.run.smithi001.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-15T01:21:56.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:56.675 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:21:56.675 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:21:56.676 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-15T01:21:56.676 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-15T01:21:56.676 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:21:56.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:56.765 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-15T01:21:56.804 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:21:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T01:21:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T01:21:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-11-15T01:21:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:56.805 INFO:teuthology.orchestra.run.smithi001.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-15T01:21:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 32:28:9a:03:ad:0d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-15T01:21:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-15T01:21:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::3028:9aff:fe03:ad0d/64 scope link tentative 2023-11-15T01:21:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:56.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:56.822 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-15T01:21:56.908 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:21:56.909 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T01:21:56.909 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T01:21:56.909 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:56.909 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-11-15T01:21:56.910 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:56.910 INFO:teuthology.orchestra.run.smithi001.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-15T01:21:56.910 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 32:28:9a:03:ad:0d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-15T01:21:56.910 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-15T01:21:56.911 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:56.911 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::3028:9aff:fe03:ad0d/64 scope link tentative 2023-11-15T01:21:56.911 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:56.922 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-15T01:21:56.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:56.923 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:21:56.923 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:21:56.924 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-15T01:21:56.924 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-15T01:21:56.924 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-15T01:21:56.925 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-15T01:21:56.925 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-15T01:21:56.925 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:21:57.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:57.098 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:21:57.099 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:21:57.099 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.1 up 2023-11-15T01:21:57.099 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set dev brx.1 master ceph-brx 2023-11-15T01:21:57.099 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:21:57.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:57.181 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p /home/ubuntu/cephtest/mnt.2 2023-11-15T01:21:57.196 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-15T01:21:57.197 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:21:57.276 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:21:57.277 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:21:57.302 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:21:57.303 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:21:57.305 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-15T01:21:57.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:57.306 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-15T01:21:57.371 INFO:tasks.kclient:client.1 config is {} 2023-11-15T01:21:57.372 DEBUG:teuthology.orchestra.run.smithi141:> ceph fs ls 2023-11-15T01:21:57.484 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.483+0000 7f58754f7700 1 Processor -- start 2023-11-15T01:21:57.485 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.484+0000 7f58754f7700 1 -- start start 2023-11-15T01:21:57.487 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.484+0000 7f58754f7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f587014e920 0x7f58700629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:57.487 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.484+0000 7f58754f7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f587014ed00 0x7f5870157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:57.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.484+0000 7f58754f7700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5870063eb0 con 0x7f5870158490 2023-11-15T01:21:57.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.484+0000 7f58754f7700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5870158900 con 0x7f587014e920 2023-11-15T01:21:57.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.484+0000 7f58754f7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58700632a0 con 0x7f587014ed00 2023-11-15T01:21:57.488 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.485+0000 7f586e7fc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f587014ed00 0x7f5870157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:57.489 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.485+0000 7f586f7fe700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f5870158490 0x7f58701549d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.141:57848/0 (socket says 172.21.15.141:57848) 2023-11-15T01:21:57.489 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.485+0000 7f586f7fe700 1 -- 172.21.15.141:0/3326848628 learned_addr learned my addr 172.21.15.141:0/3326848628 (peer_addr_for_me v1:172.21.15.141:0/0) 2023-11-15T01:21:57.489 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.485+0000 7f586effd700 1 --2- 172.21.15.141:0/3326848628 >> v2:172.21.15.1:3300/0 conn(0x7f587014e920 0x7f58700629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:57.489 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.485+0000 7f586dffb700 1 -- 172.21.15.141:0/3326848628 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416393513 0 0) 0x7f5870063eb0 con 0x7f5870158490 2023-11-15T01:21:57.490 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.485+0000 7f586dffb700 1 -- 172.21.15.141:0/3326848628 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58580033f0 con 0x7f5870158490 2023-11-15T01:21:57.490 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.485+0000 7f586e7fc700 1 -- 172.21.15.141:0/3326848628 >> v2:172.21.15.1:3300/0 conn(0x7f587014e920 msgr2=0x7f58700629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:57.490 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.485+0000 7f586e7fc700 1 --2- 172.21.15.141:0/3326848628 >> v2:172.21.15.1:3300/0 conn(0x7f587014e920 0x7f58700629c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:57.491 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.485+0000 7f586e7fc700 1 -- 172.21.15.141:0/3326848628 >> v1:172.21.15.141:6789/0 conn(0x7f5870158490 legacy=0x7f58701549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:57.491 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.485+0000 7f586e7fc700 1 -- 172.21.15.141:0/3326848628 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5870063580 con 0x7f587014ed00 2023-11-15T01:21:57.492 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.485+0000 7f586effd700 1 --2- 172.21.15.141:0/3326848628 >> v2:172.21.15.1:3300/0 conn(0x7f587014e920 0x7f58700629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:57.492 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.485+0000 7f586e7fc700 1 --2- 172.21.15.141:0/3326848628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f587014ed00 0x7f5870157fa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5864009760 tx=0x7f5864009060).ready entity=mon.2 client_cookie=40cfa0d8fb549128 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:57.492 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.485+0000 7f586dffb700 1 -- 172.21.15.141:0/3326848628 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58640090d0 con 0x7f587014ed00 2023-11-15T01:21:57.493 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.485+0000 7f586dffb700 1 -- 172.21.15.141:0/3326848628 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586400f510 con 0x7f587014ed00 2023-11-15T01:21:57.493 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.485+0000 7f586dffb700 1 -- 172.21.15.141:0/3326848628 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586400f890 con 0x7f587014ed00 2023-11-15T01:21:57.493 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.486+0000 7f58754f7700 1 -- 172.21.15.141:0/3326848628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f587014ed00 msgr2=0x7f5870157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:57.494 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.486+0000 7f58754f7700 1 --2- 172.21.15.141:0/3326848628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f587014ed00 0x7f5870157fa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5864009760 tx=0x7f5864009060).stop 2023-11-15T01:21:57.494 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.486+0000 7f58754f7700 1 -- 172.21.15.141:0/3326848628 shutdown_connections 2023-11-15T01:21:57.494 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.486+0000 7f58754f7700 1 --2- 172.21.15.141:0/3326848628 >> v2:172.21.15.1:3300/0 conn(0x7f587014e920 0x7f58700629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:57.495 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.486+0000 7f58754f7700 1 --2- 172.21.15.141:0/3326848628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f587014ed00 0x7f5870157fa0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:57.495 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.486+0000 7f58754f7700 1 -- 172.21.15.141:0/3326848628 >> 172.21.15.141:0/3326848628 conn(0x7f58700cb0f0 msgr2=0x7f58700cb500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:57.495 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.486+0000 7f58754f7700 1 -- 172.21.15.141:0/3326848628 shutdown_connections 2023-11-15T01:21:57.495 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.486+0000 7f58754f7700 1 -- 172.21.15.141:0/3326848628 wait complete. 2023-11-15T01:21:57.499 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.487+0000 7f58754f7700 1 Processor -- start 2023-11-15T01:21:57.500 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.487+0000 7f58754f7700 1 -- start start 2023-11-15T01:21:57.500 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f58754f7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f587014e920 0x7f58700c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:57.500 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f58754f7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f587014ed00 0x7f58700c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:57.500 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f58754f7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5870158490 0x7f58701651b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:57.501 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f58754f7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58700c25a0 con 0x7f587014ed00 2023-11-15T01:21:57.501 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f58754f7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5870164990 con 0x7f587014e920 2023-11-15T01:21:57.501 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f58754f7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5870164c70 con 0x7f5870158490 2023-11-15T01:21:57.501 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f586effd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f587014e920 0x7f58700c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:57.502 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f586f7fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5870158490 0x7f58701651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:57.502 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f586effd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f587014e920 0x7f58700c2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:35750/0 (socket says 172.21.15.141:35750) 2023-11-15T01:21:57.502 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f586effd700 1 -- 172.21.15.141:0/2929938836 learned_addr learned my addr 172.21.15.141:0/2929938836 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-15T01:21:57.502 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f586e7fc700 1 --2- 172.21.15.141:0/2929938836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f587014ed00 0x7f58700c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:57.503 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f586f7fe700 1 -- 172.21.15.141:0/2929938836 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f587014e920 msgr2=0x7f58700c2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:57.503 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f586f7fe700 1 --2- 172.21.15.141:0/2929938836 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f587014e920 0x7f58700c2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:57.503 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f586f7fe700 1 -- 172.21.15.141:0/2929938836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f587014ed00 msgr2=0x7f58700c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:57.503 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f586f7fe700 1 --2- 172.21.15.141:0/2929938836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f587014ed00 0x7f58700c2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:57.503 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f586f7fe700 1 -- 172.21.15.141:0/2929938836 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58640092a0 con 0x7f5870158490 2023-11-15T01:21:57.504 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f586effd700 1 --2- 172.21.15.141:0/2929938836 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f587014e920 0x7f58700c2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:57.504 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.488+0000 7f586f7fe700 1 --2- 172.21.15.141:0/2929938836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5870158490 0x7f58701651b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f586800c790 tx=0x7f5868007f10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:57.504 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.489+0000 7f5856ffd700 1 -- 172.21.15.141:0/2929938836 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868005d30 con 0x7f5870158490 2023-11-15T01:21:57.504 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.489+0000 7f5856ffd700 1 -- 172.21.15.141:0/2929938836 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5868005e90 con 0x7f5870158490 2023-11-15T01:21:57.505 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.489+0000 7f58754f7700 1 -- 172.21.15.141:0/2929938836 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5870164f50 con 0x7f5870158490 2023-11-15T01:21:57.505 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.489+0000 7f5856ffd700 1 -- 172.21.15.141:0/2929938836 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58680072e0 con 0x7f5870158490 2023-11-15T01:21:57.505 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.489+0000 7f58754f7700 1 -- 172.21.15.141:0/2929938836 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58700c86a0 con 0x7f5870158490 2023-11-15T01:21:57.506 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.490+0000 7f58754f7700 1 -- 172.21.15.141:0/2929938836 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58700475e0 con 0x7f5870158490 2023-11-15T01:21:57.506 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.490+0000 7f5856ffd700 1 -- 172.21.15.141:0/2929938836 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5868007710 con 0x7f5870158490 2023-11-15T01:21:57.506 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.490+0000 7f5856ffd700 1 --2- 172.21.15.141:0/2929938836 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f585c05f120 0x7f585c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:57.507 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.490+0000 7f5856ffd700 1 -- 172.21.15.141:0/2929938836 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5868079a10 con 0x7f5870158490 2023-11-15T01:21:57.507 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.490+0000 7f586effd700 1 --2- 172.21.15.141:0/2929938836 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f585c05f120 0x7f585c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:57.507 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.491+0000 7f586effd700 1 --2- 172.21.15.141:0/2929938836 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f585c05f120 0x7f585c0615e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f586000afd0 tx=0x7f5860008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:57.508 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.495+0000 7f5856ffd700 1 -- 172.21.15.141:0/2929938836 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f586804ace0 con 0x7f5870158490 2023-11-15T01:21:57.700 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.699+0000 7f58754f7700 1 -- 172.21.15.141:0/2929938836 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5870164db0 con 0x7f5870158490 2023-11-15T01:21:57.700 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.699+0000 7f5856ffd700 1 -- 172.21.15.141:0/2929938836 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5870164db0 con 0x7f5870158490 2023-11-15T01:21:57.701 INFO:teuthology.orchestra.run.smithi141.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-15T01:21:57.702 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.701+0000 7f58754f7700 1 -- 172.21.15.141:0/2929938836 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f585c05f120 msgr2=0x7f585c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:57.702 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.701+0000 7f58754f7700 1 --2- 172.21.15.141:0/2929938836 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f585c05f120 0x7f585c0615e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f586000afd0 tx=0x7f5860008040).stop 2023-11-15T01:21:57.703 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.701+0000 7f58754f7700 1 -- 172.21.15.141:0/2929938836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5870158490 msgr2=0x7f58701651b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:57.703 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.701+0000 7f58754f7700 1 --2- 172.21.15.141:0/2929938836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5870158490 0x7f58701651b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f586800c790 tx=0x7f5868007f10).stop 2023-11-15T01:21:57.703 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.701+0000 7f58754f7700 1 -- 172.21.15.141:0/2929938836 shutdown_connections 2023-11-15T01:21:57.703 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.701+0000 7f58754f7700 1 --2- 172.21.15.141:0/2929938836 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f585c05f120 0x7f585c0615e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:57.703 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.701+0000 7f58754f7700 1 --2- 172.21.15.141:0/2929938836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5870158490 0x7f58701651b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:57.704 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.701+0000 7f58754f7700 1 --2- 172.21.15.141:0/2929938836 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f587014e920 0x7f58700c2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:57.704 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.701+0000 7f58754f7700 1 --2- 172.21.15.141:0/2929938836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f587014ed00 0x7f58700c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:57.704 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.701+0000 7f58754f7700 1 -- 172.21.15.141:0/2929938836 >> 172.21.15.141:0/2929938836 conn(0x7f58700cb0f0 msgr2=0x7f5870152690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:57.704 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.701+0000 7f58754f7700 1 -- 172.21.15.141:0/2929938836 shutdown_connections 2023-11-15T01:21:57.704 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:57.701+0000 7f58754f7700 1 -- 172.21.15.141:0/2929938836 wait complete. 2023-11-15T01:21:57.712 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-15T01:21:57.713 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-15T01:21:57.713 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi141.front.sepia.ceph.com 2023-11-15T01:21:57.713 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-15T01:21:57.713 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-15T01:21:57.714 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-15T01:21:57.714 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-15T01:21:57.714 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-15T01:21:57.715 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-15T01:21:57.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:57.715 DEBUG:teuthology.orchestra.run.smithi141:> ip addr 2023-11-15T01:21:57.730 INFO:teuthology.orchestra.run.smithi141.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:21:57.731 INFO:teuthology.orchestra.run.smithi141.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T01:21:57.731 INFO:teuthology.orchestra.run.smithi141.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T01:21:57.731 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:57.731 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 ::1/128 scope host 2023-11-15T01:21:57.731 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:57.732 INFO:teuthology.orchestra.run.smithi141.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:21:57.732 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:d9:3b:26 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:57.732 INFO:teuthology.orchestra.run.smithi141.stdout: altname enp7s0f0 2023-11-15T01:21:57.732 INFO:teuthology.orchestra.run.smithi141.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:21:57.733 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:d9:3b:27 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:57.733 INFO:teuthology.orchestra.run.smithi141.stdout: altname enp7s0f1 2023-11-15T01:21:57.733 INFO:teuthology.orchestra.run.smithi141.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:21:57.733 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:88:72:6c brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:57.733 INFO:teuthology.orchestra.run.smithi141.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-15T01:21:57.733 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:88:72:6d brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:57.734 INFO:teuthology.orchestra.run.smithi141.stdout: inet 172.21.15.141/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-15T01:21:57.734 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft 42482sec preferred_lft 42482sec 2023-11-15T01:21:57.734 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 fe80::ec4:7aff:fe88:726d/64 scope link 2023-11-15T01:21:57.734 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:57.735 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-15T01:21:57.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:57.736 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-15T01:21:57.736 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-15T01:21:57.736 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link add name ceph-brx type bridge 2023-11-15T01:21:57.736 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip addr flush dev ceph-brx 2023-11-15T01:21:57.737 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link set ceph-brx up 2023-11-15T01:21:57.737 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-15T01:21:57.737 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-15T01:21:57.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:57.904 DEBUG:teuthology.orchestra.run.smithi141:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-15T01:21:57.946 INFO:teuthology.orchestra.run.smithi141.stdout:1 2023-11-15T01:21:57.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:57.948 DEBUG:teuthology.orchestra.run.smithi141:> route 2023-11-15T01:21:58.019 INFO:teuthology.orchestra.run.smithi141.stdout:Kernel IP routing table 2023-11-15T01:21:58.019 INFO:teuthology.orchestra.run.smithi141.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-15T01:21:58.020 INFO:teuthology.orchestra.run.smithi141.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-15T01:21:58.020 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-15T01:21:58.020 INFO:teuthology.orchestra.run.smithi141.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-15T01:21:58.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:58.021 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-15T01:21:58.021 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-15T01:21:58.022 DEBUG:teuthology.orchestra.run.smithi141:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-15T01:21:58.022 DEBUG:teuthology.orchestra.run.smithi141:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-15T01:21:58.022 DEBUG:teuthology.orchestra.run.smithi141:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-15T01:21:58.023 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-15T01:21:58.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:58.278 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list 2023-11-15T01:21:58.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:58.293 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list-id 2023-11-15T01:21:58.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:58.347 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-15T01:21:58.348 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-15T01:21:58.348 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-15T01:21:58.348 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-15T01:21:58.349 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-15T01:21:58.436 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-15T01:21:58.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:58.437 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-15T01:21:58.438 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-15T01:21:58.438 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-15T01:21:58.438 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-15T01:21:58.439 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-15T01:21:58.439 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-15T01:21:58.439 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-15T01:21:58.439 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-15T01:21:58.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:58.625 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-15T01:21:58.625 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-15T01:21:58.625 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link set brx.0 up 2023-11-15T01:21:58.626 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link set dev brx.0 master ceph-brx 2023-11-15T01:21:58.626 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-15T01:21:58.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:58.719 DEBUG:teuthology.orchestra.run.smithi141:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-11-15T01:21:58.737 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-15T01:21:58.738 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:21:58.830 INFO:teuthology.orchestra.run.smithi141.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:21:58.831 INFO:teuthology.orchestra.run.smithi141.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:21:58.919 INFO:teuthology.orchestra.run.smithi141.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:21:58.919 INFO:teuthology.orchestra.run.smithi141.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:21:58.921 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-15T01:21:58.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:58.922 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-15T01:21:58.946 INFO:tasks.kclient:client.3 config is {} 2023-11-15T01:21:58.947 DEBUG:teuthology.orchestra.run.smithi141:> ceph fs ls 2023-11-15T01:21:59.087 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.086+0000 7f56be0fe700 1 Processor -- start 2023-11-15T01:21:59.087 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.086+0000 7f56be0fe700 1 -- start start 2023-11-15T01:21:59.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.087+0000 7f56be0fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f56b814b8b0 0x7f56b8065370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:59.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.087+0000 7f56be0fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56b80699e0 0x7f56b8064860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:59.093 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.087+0000 7f56be0fe700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b8155c10 con 0x7f56b8069560 2023-11-15T01:21:59.094 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.087+0000 7f56be0fe700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b81529b0 con 0x7f56b814b8b0 2023-11-15T01:21:59.094 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.087+0000 7f56be0fe700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8154db0 con 0x7f56b80699e0 2023-11-15T01:21:59.094 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.087+0000 7f56bd8fd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56b80699e0 0x7f56b8064860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:59.095 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.087+0000 7f56bd8fd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56b80699e0 0x7f56b8064860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:60142/0 (socket says 172.21.15.141:60142) 2023-11-15T01:21:59.095 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.087+0000 7f56bd8fd700 1 -- 172.21.15.141:0/368287292 learned_addr learned my addr 172.21.15.141:0/368287292 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-15T01:21:59.095 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.087+0000 7f56bd0fc700 1 --2- 172.21.15.141:0/368287292 >> v2:172.21.15.1:3300/0 conn(0x7f56b814b8b0 0x7f56b8065370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:59.095 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56bd8fd700 1 -- 172.21.15.141:0/368287292 >> v2:172.21.15.1:3300/0 conn(0x7f56b814b8b0 msgr2=0x7f56b8065370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:59.095 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56bd8fd700 1 --2- 172.21.15.141:0/368287292 >> v2:172.21.15.1:3300/0 conn(0x7f56b814b8b0 0x7f56b8065370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:59.096 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56bd8fd700 1 -- 172.21.15.141:0/368287292 >> v1:172.21.15.1:6789/0 conn(0x7f56b8069560 legacy=0x7f56b8064150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:21:59.096 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56bd8fd700 1 -- 172.21.15.141:0/368287292 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b8155000 con 0x7f56b80699e0 2023-11-15T01:21:59.096 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56bd0fc700 1 --2- 172.21.15.141:0/368287292 >> v2:172.21.15.1:3300/0 conn(0x7f56b814b8b0 0x7f56b8065370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:21:59.096 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56bd8fd700 1 --2- 172.21.15.141:0/368287292 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56b80699e0 0x7f56b8064860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f56b000d1a0 tx=0x7f56b000ba50).ready entity=mon.2 client_cookie=3fed943e0d899a71 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:59.096 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56affff700 1 -- 172.21.15.141:0/368287292 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b0010070 con 0x7f56b80699e0 2023-11-15T01:21:59.096 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56affff700 1 -- 172.21.15.141:0/368287292 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b000de80 con 0x7f56b80699e0 2023-11-15T01:21:59.097 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56affff700 1 -- 172.21.15.141:0/368287292 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b000b2e0 con 0x7f56b80699e0 2023-11-15T01:21:59.097 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56be0fe700 1 -- 172.21.15.141:0/368287292 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56b80699e0 msgr2=0x7f56b8064860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:59.097 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56be0fe700 1 --2- 172.21.15.141:0/368287292 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56b80699e0 0x7f56b8064860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f56b000d1a0 tx=0x7f56b000ba50).stop 2023-11-15T01:21:59.097 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56be0fe700 1 -- 172.21.15.141:0/368287292 shutdown_connections 2023-11-15T01:21:59.098 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56be0fe700 1 --2- 172.21.15.141:0/368287292 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56b80699e0 0x7f56b8064860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:59.098 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56be0fe700 1 --2- 172.21.15.141:0/368287292 >> v2:172.21.15.1:3300/0 conn(0x7f56b814b8b0 0x7f56b8065370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:59.098 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56be0fe700 1 -- 172.21.15.141:0/368287292 >> 172.21.15.141:0/368287292 conn(0x7f56b80c7c40 msgr2=0x7f56b80c8050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:59.098 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56be0fe700 1 -- 172.21.15.141:0/368287292 shutdown_connections 2023-11-15T01:21:59.099 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.088+0000 7f56be0fe700 1 -- 172.21.15.141:0/368287292 wait complete. 2023-11-15T01:21:59.099 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.090+0000 7f56be0fe700 1 Processor -- start 2023-11-15T01:21:59.099 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.090+0000 7f56be0fe700 1 -- start start 2023-11-15T01:21:59.101 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.090+0000 7f56be0fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56b8069560 0x7f56b8148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:59.101 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56be0fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b80699e0 0x7f56b8148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:59.101 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56be0fe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56b814b8b0 0x7f56b8164ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:59.102 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56be0fe700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8151670 con 0x7f56b80699e0 2023-11-15T01:21:59.102 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56be0fe700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8164640 con 0x7f56b814b8b0 2023-11-15T01:21:59.102 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56be0fe700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8150dd0 con 0x7f56b8069560 2023-11-15T01:21:59.102 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56bd0fc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56b8069560 0x7f56b8148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:59.103 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56bd8fd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56b814b8b0 0x7f56b8164ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:59.103 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56bd0fc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56b8069560 0x7f56b8148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:60148/0 (socket says 172.21.15.141:60148) 2023-11-15T01:21:59.103 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56bd0fc700 1 -- 172.21.15.141:0/3051113931 learned_addr learned my addr 172.21.15.141:0/3051113931 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-15T01:21:59.103 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56bd0fc700 1 -- 172.21.15.141:0/3051113931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56b814b8b0 msgr2=0x7f56b8164ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:59.103 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56bd0fc700 1 --2- 172.21.15.141:0/3051113931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56b814b8b0 0x7f56b8164ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:59.104 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56bd0fc700 1 -- 172.21.15.141:0/3051113931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b80699e0 msgr2=0x7f56b8148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:59.104 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56bd0fc700 1 --2- 172.21.15.141:0/3051113931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b80699e0 0x7f56b8148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:21:59.104 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56bd0fc700 1 -- 172.21.15.141:0/3051113931 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b000bcf0 con 0x7f56b8069560 2023-11-15T01:21:59.104 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56bd8fd700 1 --2- 172.21.15.141:0/3051113931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56b814b8b0 0x7f56b8164ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:21:59.104 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56bd0fc700 1 --2- 172.21.15.141:0/3051113931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56b8069560 0x7f56b8148f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f56b400c8b0 tx=0x7f56b4008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:59.105 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56ad7fa700 1 -- 172.21.15.141:0/3051113931 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b4010580 con 0x7f56b8069560 2023-11-15T01:21:59.105 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56ad7fa700 1 -- 172.21.15.141:0/3051113931 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b40106e0 con 0x7f56b8069560 2023-11-15T01:21:59.105 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56be0fe700 1 -- 172.21.15.141:0/3051113931 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b81510b0 con 0x7f56b8069560 2023-11-15T01:21:59.105 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56ad7fa700 1 -- 172.21.15.141:0/3051113931 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b4010a60 con 0x7f56b8069560 2023-11-15T01:21:59.105 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.091+0000 7f56be0fe700 1 -- 172.21.15.141:0/3051113931 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b8148740 con 0x7f56b8069560 2023-11-15T01:21:59.106 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.092+0000 7f56be0fe700 1 -- 172.21.15.141:0/3051113931 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b8164920 con 0x7f56b8069560 2023-11-15T01:21:59.107 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.093+0000 7f56ad7fa700 1 -- 172.21.15.141:0/3051113931 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f56b401b460 con 0x7f56b8069560 2023-11-15T01:21:59.107 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.093+0000 7f56ad7fa700 1 --2- 172.21.15.141:0/3051113931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f569c05f150 0x7f569c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:21:59.107 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.093+0000 7f56ad7fa700 1 -- 172.21.15.141:0/3051113931 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f56b407a090 con 0x7f56b8069560 2023-11-15T01:21:59.108 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.093+0000 7f56bc8fb700 1 --2- 172.21.15.141:0/3051113931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f569c05f150 0x7f569c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:21:59.108 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.094+0000 7f56bc8fb700 1 --2- 172.21.15.141:0/3051113931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f569c05f150 0x7f569c061610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f56b8150980 tx=0x7f56a80079a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:21:59.108 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.098+0000 7f56ad7fa700 1 -- 172.21.15.141:0/3051113931 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f56b404b300 con 0x7f56b8069560 2023-11-15T01:21:59.302 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.301+0000 7f56be0fe700 1 -- 172.21.15.141:0/3051113931 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f56b8164410 con 0x7f56b8069560 2023-11-15T01:21:59.303 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.302+0000 7f56ad7fa700 1 -- 172.21.15.141:0/3051113931 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f56b8164410 con 0x7f56b8069560 2023-11-15T01:21:59.303 INFO:teuthology.orchestra.run.smithi141.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-15T01:21:59.305 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.303+0000 7f56be0fe700 1 -- 172.21.15.141:0/3051113931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f569c05f150 msgr2=0x7f569c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:59.305 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.303+0000 7f56be0fe700 1 --2- 172.21.15.141:0/3051113931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f569c05f150 0x7f569c061610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f56b8150980 tx=0x7f56a80079a0).stop 2023-11-15T01:21:59.305 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.304+0000 7f56be0fe700 1 -- 172.21.15.141:0/3051113931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56b8069560 msgr2=0x7f56b8148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:21:59.305 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.304+0000 7f56be0fe700 1 --2- 172.21.15.141:0/3051113931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56b8069560 0x7f56b8148f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f56b400c8b0 tx=0x7f56b4008040).stop 2023-11-15T01:21:59.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.304+0000 7f56be0fe700 1 -- 172.21.15.141:0/3051113931 shutdown_connections 2023-11-15T01:21:59.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.304+0000 7f56be0fe700 1 --2- 172.21.15.141:0/3051113931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f569c05f150 0x7f569c061610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:59.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.304+0000 7f56be0fe700 1 --2- 172.21.15.141:0/3051113931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56b814b8b0 0x7f56b8164ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:59.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.304+0000 7f56be0fe700 1 --2- 172.21.15.141:0/3051113931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56b8069560 0x7f56b8148f80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:21:59.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.304+0000 7f56be0fe700 1 --2- 172.21.15.141:0/3051113931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b80699e0 0x7f56b8148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:21:59.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.304+0000 7f56be0fe700 1 -- 172.21.15.141:0/3051113931 >> 172.21.15.141:0/3051113931 conn(0x7f56b80c7c40 msgr2=0x7f56b80c6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:21:59.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.304+0000 7f56be0fe700 1 -- 172.21.15.141:0/3051113931 shutdown_connections 2023-11-15T01:21:59.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-15T01:21:59.304+0000 7f56be0fe700 1 -- 172.21.15.141:0/3051113931 wait complete. 2023-11-15T01:21:59.315 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-15T01:21:59.315 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-15T01:21:59.316 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi141.front.sepia.ceph.com 2023-11-15T01:21:59.316 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-15T01:21:59.316 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-15T01:21:59.316 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-15T01:21:59.317 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-15T01:21:59.317 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-15T01:21:59.317 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-15T01:21:59.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:59.318 DEBUG:teuthology.orchestra.run.smithi141:> ip addr 2023-11-15T01:21:59.334 INFO:teuthology.orchestra.run.smithi141.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:21:59.334 INFO:teuthology.orchestra.run.smithi141.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T01:21:59.334 INFO:teuthology.orchestra.run.smithi141.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T01:21:59.335 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:59.335 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 ::1/128 scope host 2023-11-15T01:21:59.335 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:59.335 INFO:teuthology.orchestra.run.smithi141.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:21:59.335 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:d9:3b:26 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:59.336 INFO:teuthology.orchestra.run.smithi141.stdout: altname enp7s0f0 2023-11-15T01:21:59.336 INFO:teuthology.orchestra.run.smithi141.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:21:59.336 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:d9:3b:27 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:59.336 INFO:teuthology.orchestra.run.smithi141.stdout: altname enp7s0f1 2023-11-15T01:21:59.336 INFO:teuthology.orchestra.run.smithi141.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:21:59.337 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:88:72:6c brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:59.337 INFO:teuthology.orchestra.run.smithi141.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-15T01:21:59.337 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:88:72:6d brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:59.337 INFO:teuthology.orchestra.run.smithi141.stdout: inet 172.21.15.141/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-15T01:21:59.337 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft 42480sec preferred_lft 42480sec 2023-11-15T01:21:59.338 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 fe80::ec4:7aff:fe88:726d/64 scope link 2023-11-15T01:21:59.338 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:59.338 INFO:teuthology.orchestra.run.smithi141.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:21:59.338 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 3a:c7:ed:ae:f3:0c brd ff:ff:ff:ff:ff:ff 2023-11-15T01:21:59.339 INFO:teuthology.orchestra.run.smithi141.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-15T01:21:59.339 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:59.339 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 fe80::745b:84ff:fe75:d2b6/64 scope link 2023-11-15T01:21:59.339 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:59.339 INFO:teuthology.orchestra.run.smithi141.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:21:59.340 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 3a:c7:ed:ae:f3:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-15T01:21:59.340 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 fe80::38c7:edff:feae:f30c/64 scope link tentative 2023-11-15T01:21:59.340 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:59.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:59.341 DEBUG:teuthology.orchestra.run.smithi141:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-15T01:21:59.397 INFO:teuthology.orchestra.run.smithi141.stdout:1 2023-11-15T01:21:59.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:59.399 DEBUG:teuthology.orchestra.run.smithi141:> route 2023-11-15T01:21:59.455 INFO:teuthology.orchestra.run.smithi141.stdout:Kernel IP routing table 2023-11-15T01:21:59.455 INFO:teuthology.orchestra.run.smithi141.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-15T01:21:59.456 INFO:teuthology.orchestra.run.smithi141.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-15T01:21:59.456 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-15T01:21:59.456 INFO:teuthology.orchestra.run.smithi141.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-15T01:21:59.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:59.457 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-15T01:21:59.457 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-15T01:21:59.457 DEBUG:teuthology.orchestra.run.smithi141:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-15T01:21:59.458 DEBUG:teuthology.orchestra.run.smithi141:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-15T01:21:59.458 DEBUG:teuthology.orchestra.run.smithi141:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-15T01:21:59.458 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-15T01:21:59.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:59.556 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list 2023-11-15T01:21:59.570 INFO:teuthology.orchestra.run.smithi141.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-15T01:21:59.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:59.571 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list-id 2023-11-15T01:21:59.625 INFO:teuthology.orchestra.run.smithi141.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-15T01:21:59.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:59.626 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-15T01:21:59.626 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-15T01:21:59.626 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-15T01:21:59.627 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-15T01:21:59.627 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-15T01:21:59.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:59.714 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-15T01:21:59.750 INFO:teuthology.orchestra.run.smithi141.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:21:59.751 INFO:teuthology.orchestra.run.smithi141.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T01:21:59.751 INFO:teuthology.orchestra.run.smithi141.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T01:21:59.751 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:59.751 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 ::1/128 scope host 2023-11-15T01:21:59.752 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:59.752 INFO:teuthology.orchestra.run.smithi141.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-15T01:21:59.752 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether b2:64:e3:b4:e4:bf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-15T01:21:59.752 INFO:teuthology.orchestra.run.smithi141.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-15T01:21:59.752 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:59.753 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 fe80::b064:e3ff:feb4:e4bf/64 scope link tentative 2023-11-15T01:21:59.753 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:59.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:59.759 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-15T01:21:59.833 INFO:teuthology.orchestra.run.smithi141.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:21:59.834 INFO:teuthology.orchestra.run.smithi141.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T01:21:59.834 INFO:teuthology.orchestra.run.smithi141.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T01:21:59.834 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:59.835 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 ::1/128 scope host 2023-11-15T01:21:59.835 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:59.835 INFO:teuthology.orchestra.run.smithi141.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-15T01:21:59.835 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether b2:64:e3:b4:e4:bf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-15T01:21:59.835 INFO:teuthology.orchestra.run.smithi141.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-15T01:21:59.836 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:59.836 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 fe80::b064:e3ff:feb4:e4bf/64 scope link tentative 2023-11-15T01:21:59.836 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:21:59.846 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-15T01:21:59.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:21:59.846 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-15T01:21:59.847 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-15T01:21:59.847 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-15T01:21:59.847 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-15T01:21:59.848 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-15T01:21:59.848 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-15T01:21:59.848 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-15T01:21:59.848 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-15T01:22:00.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:22:00.073 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-15T01:22:00.074 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-15T01:22:00.074 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link set brx.1 up 2023-11-15T01:22:00.074 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link set dev brx.1 master ceph-brx 2023-11-15T01:22:00.075 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-15T01:22:00.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:22:00.155 DEBUG:teuthology.orchestra.run.smithi141:> mkdir -p /home/ubuntu/cephtest/mnt.3 2023-11-15T01:22:00.169 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-15T01:22:00.169 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:22:00.247 INFO:teuthology.orchestra.run.smithi141.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:22:00.248 INFO:teuthology.orchestra.run.smithi141.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:22:00.273 INFO:teuthology.orchestra.run.smithi141.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:22:00.273 INFO:teuthology.orchestra.run.smithi141.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:22:00.275 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-15T01:22:00.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:22:00.275 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-15T01:22:00.339 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-15T01:22:00.357 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:22:00.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.488+0000 7f1e9b0f9700 1 Processor -- start 2023-11-15T01:22:00.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.488+0000 7f1e9b0f9700 1 -- start start 2023-11-15T01:22:00.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.489+0000 7f1e9b0f9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e94151e10 0x7f1e94155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:00.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.489+0000 7f1e9b0f9700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1e940c86b0 0x7f1e940aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:00.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.489+0000 7f1e9b0f9700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e940c7980 con 0x7f1e940c98b0 2023-11-15T01:22:00.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.489+0000 7f1e9b0f9700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e940c8b10 con 0x7f1e940c86b0 2023-11-15T01:22:00.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.489+0000 7f1e9b0f9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e940aa5c0 con 0x7f1e94151e10 2023-11-15T01:22:00.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.489+0000 7f1e998f6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1e940c86b0 0x7f1e940aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:00.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.489+0000 7f1e998f6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1e940c86b0 0x7f1e940aa0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44344/0 (socket says 172.21.15.1:44344) 2023-11-15T01:22:00.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.489+0000 7f1e998f6700 1 -- 172.21.15.1:0/908724751 learned_addr learned my addr 172.21.15.1:0/908724751 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.489+0000 7f1e9a0f7700 1 --2- 172.21.15.1:0/908724751 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e94151e10 0x7f1e94155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.490+0000 7f1e998f6700 1 -- 172.21.15.1:0/908724751 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e94151e10 msgr2=0x7f1e94155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.490+0000 7f1e998f6700 1 --2- 172.21.15.1:0/908724751 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e94151e10 0x7f1e94155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.490+0000 7f1e998f6700 1 -- 172.21.15.1:0/908724751 >> v1:172.21.15.141:6789/0 conn(0x7f1e940c98b0 legacy=0x7f1e940c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.490+0000 7f1e998f6700 1 -- 172.21.15.1:0/908724751 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e940aa890 con 0x7f1e940c86b0 2023-11-15T01:22:00.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.490+0000 7f1e998f6700 1 --2- 172.21.15.1:0/908724751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e940c86b0 0x7f1e940aa0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f1e88006fd0 tx=0x7f1e880090f0).ready entity=mon.0 client_cookie=1210c036cb340915 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:00.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.490+0000 7f1e990f5700 1 -- 172.21.15.1:0/908724751 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8800b580 con 0x7f1e940c86b0 2023-11-15T01:22:00.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.490+0000 7f1e990f5700 1 -- 172.21.15.1:0/908724751 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8800b6e0 con 0x7f1e940c86b0 2023-11-15T01:22:00.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.490+0000 7f1e990f5700 1 -- 172.21.15.1:0/908724751 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8800ba60 con 0x7f1e940c86b0 2023-11-15T01:22:00.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.490+0000 7f1e9b0f9700 1 -- 172.21.15.1:0/908724751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e940c86b0 msgr2=0x7f1e940aa0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:00.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.490+0000 7f1e9b0f9700 1 --2- 172.21.15.1:0/908724751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e940c86b0 0x7f1e940aa0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f1e88006fd0 tx=0x7f1e880090f0).stop 2023-11-15T01:22:00.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.490+0000 7f1e9b0f9700 1 -- 172.21.15.1:0/908724751 shutdown_connections 2023-11-15T01:22:00.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.490+0000 7f1e9b0f9700 1 --2- 172.21.15.1:0/908724751 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e94151e10 0x7f1e94155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:00.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.490+0000 7f1e9b0f9700 1 --2- 172.21.15.1:0/908724751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e940c86b0 0x7f1e940aa0d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:00.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.490+0000 7f1e9b0f9700 1 -- 172.21.15.1:0/908724751 >> 172.21.15.1:0/908724751 conn(0x7f1e940947e0 msgr2=0x7f1e9406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:00.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.491+0000 7f1e9b0f9700 1 -- 172.21.15.1:0/908724751 shutdown_connections 2023-11-15T01:22:00.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.491+0000 7f1e9b0f9700 1 -- 172.21.15.1:0/908724751 wait complete. 2023-11-15T01:22:00.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.492+0000 7f1e9b0f9700 1 Processor -- start 2023-11-15T01:22:00.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.492+0000 7f1e9b0f9700 1 -- start start 2023-11-15T01:22:00.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.492+0000 7f1e9b0f9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e940c86b0 0x7f1e94146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:00.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.492+0000 7f1e9b0f9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e940c98b0 0x7f1e940ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:00.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.492+0000 7f1e9b0f9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e94151e10 0x7f1e941570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:00.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.492+0000 7f1e9b0f9700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e94154780 con 0x7f1e940c98b0 2023-11-15T01:22:00.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.492+0000 7f1e9b0f9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e94158740 con 0x7f1e940c86b0 2023-11-15T01:22:00.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.492+0000 7f1e9b0f9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e94147420 con 0x7f1e94151e10 2023-11-15T01:22:00.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e998f6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e940c98b0 0x7f1e940ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:00.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e998f6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e940c98b0 0x7f1e940ad620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44354/0 (socket says 172.21.15.1:44354) 2023-11-15T01:22:00.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e998f6700 1 -- 172.21.15.1:0/999671774 learned_addr learned my addr 172.21.15.1:0/999671774 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:00.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e9a0f7700 1 --2- 172.21.15.1:0/999671774 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e940c86b0 0x7f1e94146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:00.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e9a8f8700 1 --2- 172.21.15.1:0/999671774 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e94151e10 0x7f1e941570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:00.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e998f6700 1 -- 172.21.15.1:0/999671774 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e94151e10 msgr2=0x7f1e941570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:00.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e998f6700 1 --2- 172.21.15.1:0/999671774 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e94151e10 0x7f1e941570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:00.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e998f6700 1 -- 172.21.15.1:0/999671774 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e940c86b0 msgr2=0x7f1e94146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:00.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e998f6700 1 --2- 172.21.15.1:0/999671774 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e940c86b0 0x7f1e94146f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:00.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e998f6700 1 -- 172.21.15.1:0/999671774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e88009370 con 0x7f1e940c98b0 2023-11-15T01:22:00.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e998f6700 1 --2- 172.21.15.1:0/999671774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e940c98b0 0x7f1e940ad620 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f1e88009130 tx=0x7f1e88017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:00.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e927fc700 1 -- 172.21.15.1:0/999671774 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88000bc0 con 0x7f1e940c98b0 2023-11-15T01:22:00.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e927fc700 1 -- 172.21.15.1:0/999671774 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8800b850 con 0x7f1e940c98b0 2023-11-15T01:22:00.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e9b0f9700 1 -- 172.21.15.1:0/999671774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e94153c00 con 0x7f1e940c98b0 2023-11-15T01:22:00.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e927fc700 1 -- 172.21.15.1:0/999671774 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8801c670 con 0x7f1e940c98b0 2023-11-15T01:22:00.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.493+0000 7f1e9b0f9700 1 -- 172.21.15.1:0/999671774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e941541c0 con 0x7f1e940c98b0 2023-11-15T01:22:00.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.494+0000 7f1e9b0f9700 1 -- 172.21.15.1:0/999671774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e940475e0 con 0x7f1e940c98b0 2023-11-15T01:22:00.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.495+0000 7f1e927fc700 1 -- 172.21.15.1:0/999671774 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1e8801caa0 con 0x7f1e940c98b0 2023-11-15T01:22:00.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.495+0000 7f1e927fc700 1 --2- 172.21.15.1:0/999671774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e8005f150 0x7f1e80061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:00.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.495+0000 7f1e927fc700 1 -- 172.21.15.1:0/999671774 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1e8807bce0 con 0x7f1e940c98b0 2023-11-15T01:22:00.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.495+0000 7f1e9a0f7700 1 --2- 172.21.15.1:0/999671774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e8005f150 0x7f1e80061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:00.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.496+0000 7f1e9a0f7700 1 --2- 172.21.15.1:0/999671774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e8005f150 0x7f1e80061610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1e84009fd0 tx=0x7f1e8400b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:00.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.500+0000 7f1e927fc700 1 -- 172.21.15.1:0/999671774 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1e8804cf50 con 0x7f1e940c98b0 2023-11-15T01:22:00.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.675+0000 7f1e9b0f9700 1 -- 172.21.15.1:0/999671774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e940c7bd0 con 0x7f1e940c98b0 2023-11-15T01:22:00.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.676+0000 7f1e927fc700 1 -- 172.21.15.1:0/999671774 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16880 (secure 0 0 0) 0x7f1e8802a030 con 0x7f1e940c98b0 2023-11-15T01:22:00.678 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:00.679 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:38.047484+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:21:34.763591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-15T01:21:36.025071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:22:00.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.678+0000 7f1e9b0f9700 1 -- 172.21.15.1:0/999671774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e8005f150 msgr2=0x7f1e80061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:00.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.678+0000 7f1e9b0f9700 1 --2- 172.21.15.1:0/999671774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e8005f150 0x7f1e80061610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1e84009fd0 tx=0x7f1e8400b040).stop 2023-11-15T01:22:00.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.678+0000 7f1e9b0f9700 1 -- 172.21.15.1:0/999671774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e940c98b0 msgr2=0x7f1e940ad620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:00.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.678+0000 7f1e9b0f9700 1 --2- 172.21.15.1:0/999671774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e940c98b0 0x7f1e940ad620 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f1e88009130 tx=0x7f1e88017000).stop 2023-11-15T01:22:00.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.678+0000 7f1e9b0f9700 1 -- 172.21.15.1:0/999671774 shutdown_connections 2023-11-15T01:22:00.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.678+0000 7f1e9b0f9700 1 --2- 172.21.15.1:0/999671774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e8005f150 0x7f1e80061610 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:00.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.678+0000 7f1e9b0f9700 1 --2- 172.21.15.1:0/999671774 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e94151e10 0x7f1e941570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:00.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.678+0000 7f1e9b0f9700 1 --2- 172.21.15.1:0/999671774 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e940c86b0 0x7f1e94146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:00.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.678+0000 7f1e9b0f9700 1 --2- 172.21.15.1:0/999671774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e940c98b0 0x7f1e940ad620 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:00.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.678+0000 7f1e9b0f9700 1 -- 172.21.15.1:0/999671774 >> 172.21.15.1:0/999671774 conn(0x7f1e940947e0 msgr2=0x7f1e940635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:00.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.679+0000 7f1e9b0f9700 1 -- 172.21.15.1:0/999671774 shutdown_connections 2023-11-15T01:22:00.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.679+0000 7f1e9b0f9700 1 -- 172.21.15.1:0/999671774 wait complete. 2023-11-15T01:22:00.692 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T01:21:34.763591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T01:21:36.025071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T01:22:00.693 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:22:00.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.813+0000 7f800de80700 1 Processor -- start 2023-11-15T01:22:00.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.813+0000 7f800de80700 1 -- start start 2023-11-15T01:22:00.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.814+0000 7f800de80700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f80081540a0 0x7f80080ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:00.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.814+0000 7f800de80700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8008154480 0x7f80080ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:00.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.814+0000 7f800de80700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80080ca050 con 0x7f80080c5f40 2023-11-15T01:22:00.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.814+0000 7f800de80700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80080c9440 con 0x7f80081540a0 2023-11-15T01:22:00.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.814+0000 7f800de80700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80080c9720 con 0x7f8008154480 2023-11-15T01:22:00.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.814+0000 7f8007fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f80080c5f40 0x7f80080aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34130/0 (socket says 172.21.15.1:34130) 2023-11-15T01:22:00.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.814+0000 7f8007fff700 1 -- 172.21.15.1:0/1435064933 learned_addr learned my addr 172.21.15.1:0/1435064933 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:00.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.814+0000 7f80077fe700 1 --2- 172.21.15.1:0/1435064933 >> v2:172.21.15.141:3300/0 conn(0x7f80081540a0 0x7f80080ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:00.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.814+0000 7f8006ffd700 1 --2- 172.21.15.1:0/1435064933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8008154480 0x7f80080ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:00.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.814+0000 7f80067fc700 1 -- 172.21.15.1:0/1435064933 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790399006 0 0) 0x7f80080ca050 con 0x7f80080c5f40 2023-11-15T01:22:00.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.814+0000 7f80067fc700 1 -- 172.21.15.1:0/1435064933 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ff00033f0 con 0x7f80080c5f40 2023-11-15T01:22:00.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 -- 172.21.15.1:0/1435064933 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 638932862 0 0) 0x7f7ff00033f0 con 0x7f80080c5f40 2023-11-15T01:22:00.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 -- 172.21.15.1:0/1435064933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8008154480 msgr2=0x7f80080ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:00.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 --2- 172.21.15.1:0/1435064933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8008154480 0x7f80080ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:00.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 -- 172.21.15.1:0/1435064933 >> v2:172.21.15.141:3300/0 conn(0x7f80081540a0 msgr2=0x7f80080ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:00.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 --2- 172.21.15.1:0/1435064933 >> v2:172.21.15.141:3300/0 conn(0x7f80081540a0 0x7f80080ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:00.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 -- 172.21.15.1:0/1435064933 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80080c9a00 con 0x7f80080c5f40 2023-11-15T01:22:00.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 -- 172.21.15.1:0/1435064933 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f80000017f0 con 0x7f80080c5f40 2023-11-15T01:22:00.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 -- 172.21.15.1:0/1435064933 >> v1:172.21.15.1:6789/0 conn(0x7f80080c5f40 legacy=0x7f80080aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 --2- 172.21.15.1:0/1435064933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ff00038e0 0x7f7ff0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 --2- 172.21.15.1:0/1435064933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8008154480 0x7f7ff0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 --2- 172.21.15.1:0/1435064933 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ff0004b80 0x7f7ff0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 -- 172.21.15.1:0/1435064933 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80080c9440 con 0x7f7ff00038e0 2023-11-15T01:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 -- 172.21.15.1:0/1435064933 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80080c9720 con 0x7f7ff0004b80 2023-11-15T01:22:00.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 -- 172.21.15.1:0/1435064933 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff000b8e0 con 0x7f8008154480 2023-11-15T01:22:00.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80077fe700 1 --2- 172.21.15.1:0/1435064933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ff00038e0 0x7f7ff0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:00.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f8006ffd700 1 --2- 172.21.15.1:0/1435064933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8008154480 0x7f7ff0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:00.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f8007fff700 1 --2- 172.21.15.1:0/1435064933 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ff0004b80 0x7f7ff0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:00.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80077fe700 1 -- 172.21.15.1:0/1435064933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8008154480 msgr2=0x7f7ff0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:00.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80077fe700 1 --2- 172.21.15.1:0/1435064933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8008154480 0x7f7ff0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:00.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80077fe700 1 -- 172.21.15.1:0/1435064933 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ff0004b80 msgr2=0x7f7ff0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:00.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80077fe700 1 --2- 172.21.15.1:0/1435064933 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ff0004b80 0x7f7ff0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:00.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80077fe700 1 -- 172.21.15.1:0/1435064933 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff00033f0 con 0x7f7ff00038e0 2023-11-15T01:22:00.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f8007fff700 1 --2- 172.21.15.1:0/1435064933 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ff0004b80 0x7f7ff0005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:00.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80077fe700 1 --2- 172.21.15.1:0/1435064933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ff00038e0 0x7f7ff0003d00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f7ff8009a80 tx=0x7f7ff8009060).ready entity=mon.0 client_cookie=f3dadab57b31e53c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:00.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 -- 172.21.15.1:0/1435064933 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8009430 con 0x7f7ff00038e0 2023-11-15T01:22:00.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 -- 172.21.15.1:0/1435064933 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff800e640 con 0x7f7ff00038e0 2023-11-15T01:22:00.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.815+0000 7f80067fc700 1 -- 172.21.15.1:0/1435064933 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800e9c0 con 0x7f7ff00038e0 2023-11-15T01:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.816+0000 7f800de80700 1 -- 172.21.15.1:0/1435064933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ff00038e0 msgr2=0x7f7ff0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.816+0000 7f800de80700 1 --2- 172.21.15.1:0/1435064933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ff00038e0 0x7f7ff0003d00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f7ff8009a80 tx=0x7f7ff8009060).stop 2023-11-15T01:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.816+0000 7f8007fff700 1 -- 172.21.15.1:0/1435064933 reap_dead start 2023-11-15T01:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.816+0000 7f800de80700 1 -- 172.21.15.1:0/1435064933 shutdown_connections 2023-11-15T01:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.816+0000 7f800de80700 1 -- 172.21.15.1:0/1435064933 >> 172.21.15.1:0/1435064933 conn(0x7f8008064a70 msgr2=0x7f8008064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:00.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.816+0000 7f800de80700 1 -- 172.21.15.1:0/1435064933 shutdown_connections 2023-11-15T01:22:00.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.816+0000 7f800de80700 1 -- 172.21.15.1:0/1435064933 wait complete. 2023-11-15T01:22:00.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.817+0000 7f800de80700 1 Processor -- start 2023-11-15T01:22:00.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.817+0000 7f800de80700 1 -- start start 2023-11-15T01:22:00.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f800de80700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ff00038e0 0x7f8008165360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:00.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f800de80700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8008155ce0 0x7f800814ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:00.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f800de80700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f800814ef30 0x7f80080ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:00.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f800de80700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8008155850 con 0x7f800814ef30 2023-11-15T01:22:00.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f800de80700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8008154960 con 0x7f7ff00038e0 2023-11-15T01:22:00.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f800de80700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8008154c40 con 0x7f8008155ce0 2023-11-15T01:22:00.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f8007fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f800814ef30 0x7f80080ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:00.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f8007fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f800814ef30 0x7f80080ae080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44368/0 (socket says 172.21.15.1:44368) 2023-11-15T01:22:00.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f8006ffd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8008155ce0 0x7f800814ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:00.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f8007fff700 1 -- 172.21.15.1:0/3872863942 learned_addr learned my addr 172.21.15.1:0/3872863942 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:00.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f80077fe700 1 --2- 172.21.15.1:0/3872863942 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ff00038e0 0x7f8008165360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:00.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f8006ffd700 1 -- 172.21.15.1:0/3872863942 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ff00038e0 msgr2=0x7f8008165360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:00.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f8006ffd700 1 --2- 172.21.15.1:0/3872863942 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ff00038e0 0x7f8008165360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f8006ffd700 1 -- 172.21.15.1:0/3872863942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f800814ef30 msgr2=0x7f80080ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f8006ffd700 1 --2- 172.21.15.1:0/3872863942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f800814ef30 0x7f80080ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f8006ffd700 1 -- 172.21.15.1:0/3872863942 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8008154f20 con 0x7f8008155ce0 2023-11-15T01:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f8007fff700 1 --2- 172.21.15.1:0/3872863942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f800814ef30 0x7f80080ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.818+0000 7f80077fe700 1 --2- 172.21.15.1:0/3872863942 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ff00038e0 0x7f8008165360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.819+0000 7f8006ffd700 1 --2- 172.21.15.1:0/3872863942 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8008155ce0 0x7f800814ea40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f7ffc0119c0 tx=0x7f7ffc009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.819+0000 7f7fef7fe700 1 -- 172.21.15.1:0/3872863942 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc011e50 con 0x7f8008155ce0 2023-11-15T01:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.819+0000 7f7fef7fe700 1 -- 172.21.15.1:0/3872863942 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc00f940 con 0x7f8008155ce0 2023-11-15T01:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.819+0000 7f800de80700 1 -- 172.21.15.1:0/3872863942 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8008155200 con 0x7f8008155ce0 2023-11-15T01:22:00.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.819+0000 7f7fef7fe700 1 -- 172.21.15.1:0/3872863942 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00fcc0 con 0x7f8008155ce0 2023-11-15T01:22:00.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.819+0000 7f800de80700 1 -- 172.21.15.1:0/3872863942 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8008165850 con 0x7f8008155ce0 2023-11-15T01:22:00.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.820+0000 7f800de80700 1 -- 172.21.15.1:0/3872863942 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8008155a00 con 0x7f8008155ce0 2023-11-15T01:22:00.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.820+0000 7f7fef7fe700 1 -- 172.21.15.1:0/3872863942 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7ffc014650 con 0x7f8008155ce0 2023-11-15T01:22:00.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.820+0000 7f7fef7fe700 1 --2- 172.21.15.1:0/3872863942 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7ff405f150 0x7f7ff4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:00.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.820+0000 7f7fef7fe700 1 -- 172.21.15.1:0/3872863942 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7ffc07acb0 con 0x7f8008155ce0 2023-11-15T01:22:00.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.821+0000 7f80077fe700 1 --2- 172.21.15.1:0/3872863942 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7ff405f150 0x7f7ff4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:00.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.821+0000 7f80077fe700 1 --2- 172.21.15.1:0/3872863942 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7ff405f150 0x7f7ff4061610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7ff8006d50 tx=0x7f7ff801a000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:00.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.825+0000 7f7fef7fe700 1 -- 172.21.15.1:0/3872863942 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7ffc04bf80 con 0x7f8008155ce0 2023-11-15T01:22:00.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.995+0000 7f800de80700 1 -- 172.21.15.1:0/3872863942 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f800806c7e0 con 0x7f8008155ce0 2023-11-15T01:22:00.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.995+0000 7f7fef7fe700 1 -- 172.21.15.1:0/3872863942 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7ffc04f5a0 con 0x7f8008155ce0 2023-11-15T01:22:00.997 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:22:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.997+0000 7f800de80700 1 -- 172.21.15.1:0/3872863942 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7ff405f150 msgr2=0x7f7ff4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.997+0000 7f800de80700 1 --2- 172.21.15.1:0/3872863942 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7ff405f150 0x7f7ff4061610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7ff8006d50 tx=0x7f7ff801a000).stop 2023-11-15T01:22:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.997+0000 7f800de80700 1 -- 172.21.15.1:0/3872863942 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8008155ce0 msgr2=0x7f800814ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.997+0000 7f800de80700 1 --2- 172.21.15.1:0/3872863942 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8008155ce0 0x7f800814ea40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f7ffc0119c0 tx=0x7f7ffc009060).stop 2023-11-15T01:22:01.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.997+0000 7f800de80700 1 -- 172.21.15.1:0/3872863942 shutdown_connections 2023-11-15T01:22:01.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.997+0000 7f800de80700 1 --2- 172.21.15.1:0/3872863942 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7ff405f150 0x7f7ff4061610 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.997+0000 7f800de80700 1 --2- 172.21.15.1:0/3872863942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f800814ef30 0x7f80080ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.997+0000 7f800de80700 1 --2- 172.21.15.1:0/3872863942 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ff00038e0 0x7f8008165360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.997+0000 7f800de80700 1 --2- 172.21.15.1:0/3872863942 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8008155ce0 0x7f800814ea40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.997+0000 7f800de80700 1 -- 172.21.15.1:0/3872863942 >> 172.21.15.1:0/3872863942 conn(0x7f8008064a70 msgr2=0x7f80080ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:01.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.997+0000 7f800de80700 1 -- 172.21.15.1:0/3872863942 shutdown_connections 2023-11-15T01:22:01.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:00.997+0000 7f800de80700 1 -- 172.21.15.1:0/3872863942 wait complete. 2023-11-15T01:22:01.011 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:22:01.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.133+0000 7fbd66155700 1 Processor -- start 2023-11-15T01:22:01.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.133+0000 7fbd66155700 1 -- start start 2023-11-15T01:22:01.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.134+0000 7fbd66155700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbd601545b0 0x7fbd600c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.134+0000 7fbd66155700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbd600c7f50 0x7fbd600c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.134+0000 7fbd66155700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd60155830 con 0x7fbd601541d0 2023-11-15T01:22:01.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.134+0000 7fbd66155700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd60158f40 con 0x7fbd600c7f50 2023-11-15T01:22:01.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.134+0000 7fbd66155700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd60154a30 con 0x7fbd601545b0 2023-11-15T01:22:01.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.134+0000 7fbd65954700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbd600c7f50 0x7fbd600c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.134+0000 7fbd65954700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbd600c7f50 0x7fbd600c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44376/0 (socket says 172.21.15.1:44376) 2023-11-15T01:22:01.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.134+0000 7fbd65954700 1 -- 172.21.15.1:0/3712334260 learned_addr learned my addr 172.21.15.1:0/3712334260 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:01.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.134+0000 7fbd64952700 1 --2- 172.21.15.1:0/3712334260 >> v2:172.21.15.141:3300/0 conn(0x7fbd601545b0 0x7fbd600c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.134+0000 7fbd65954700 1 -- 172.21.15.1:0/3712334260 >> v2:172.21.15.141:3300/0 conn(0x7fbd601545b0 msgr2=0x7fbd600c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:01.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.134+0000 7fbd65954700 1 --2- 172.21.15.1:0/3712334260 >> v2:172.21.15.141:3300/0 conn(0x7fbd601545b0 0x7fbd600c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.134+0000 7fbd65954700 1 -- 172.21.15.1:0/3712334260 >> v1:172.21.15.141:6789/0 conn(0x7fbd601541d0 legacy=0x7fbd600c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:01.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.134+0000 7fbd65954700 1 -- 172.21.15.1:0/3712334260 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd60154c20 con 0x7fbd600c7f50 2023-11-15T01:22:01.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.134+0000 7fbd64952700 1 --2- 172.21.15.1:0/3712334260 >> v2:172.21.15.141:3300/0 conn(0x7fbd601545b0 0x7fbd600c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:01.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.134+0000 7fbd65954700 1 --2- 172.21.15.1:0/3712334260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd600c7f50 0x7fbd600c9620 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fbd6005fbf0 tx=0x7fbd58009840).ready entity=mon.0 client_cookie=8d3a6017320de80e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:01.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.135+0000 7fbd5ffff700 1 -- 172.21.15.1:0/3712334260 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5800e070 con 0x7fbd600c7f50 2023-11-15T01:22:01.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.135+0000 7fbd5ffff700 1 -- 172.21.15.1:0/3712334260 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5800ba10 con 0x7fbd600c7f50 2023-11-15T01:22:01.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.135+0000 7fbd5ffff700 1 -- 172.21.15.1:0/3712334260 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5800bd90 con 0x7fbd600c7f50 2023-11-15T01:22:01.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.135+0000 7fbd66155700 1 -- 172.21.15.1:0/3712334260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd600c7f50 msgr2=0x7fbd600c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.135+0000 7fbd66155700 1 --2- 172.21.15.1:0/3712334260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd600c7f50 0x7fbd600c9620 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fbd6005fbf0 tx=0x7fbd58009840).stop 2023-11-15T01:22:01.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.135+0000 7fbd66155700 1 -- 172.21.15.1:0/3712334260 shutdown_connections 2023-11-15T01:22:01.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.135+0000 7fbd66155700 1 --2- 172.21.15.1:0/3712334260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd600c7f50 0x7fbd600c9620 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.135+0000 7fbd66155700 1 --2- 172.21.15.1:0/3712334260 >> v2:172.21.15.141:3300/0 conn(0x7fbd601545b0 0x7fbd600c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.135+0000 7fbd66155700 1 -- 172.21.15.1:0/3712334260 >> 172.21.15.1:0/3712334260 conn(0x7fbd60069ee0 msgr2=0x7fbd6006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:01.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.135+0000 7fbd66155700 1 -- 172.21.15.1:0/3712334260 shutdown_connections 2023-11-15T01:22:01.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.135+0000 7fbd66155700 1 -- 172.21.15.1:0/3712334260 wait complete. 2023-11-15T01:22:01.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.136+0000 7fbd66155700 1 Processor -- start 2023-11-15T01:22:01.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.136+0000 7fbd66155700 1 -- start start 2023-11-15T01:22:01.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.137+0000 7fbd66155700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd600c7f50 0x7fbd601429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.137+0000 7fbd66155700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd601541d0 0x7fbd6014ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.137+0000 7fbd66155700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd601545b0 0x7fbd6014ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.137+0000 7fbd66155700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6014f450 con 0x7fbd600c7f50 2023-11-15T01:22:01.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.137+0000 7fbd66155700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd601562e0 con 0x7fbd601541d0 2023-11-15T01:22:01.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.137+0000 7fbd66155700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd601565c0 con 0x7fbd601545b0 2023-11-15T01:22:01.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.137+0000 7fbd65153700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd600c7f50 0x7fbd601429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.137+0000 7fbd65153700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd600c7f50 0x7fbd601429b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44390/0 (socket says 172.21.15.1:44390) 2023-11-15T01:22:01.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.137+0000 7fbd65153700 1 -- 172.21.15.1:0/1193348905 learned_addr learned my addr 172.21.15.1:0/1193348905 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:01.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.137+0000 7fbd64952700 1 --2- 172.21.15.1:0/1193348905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd601541d0 0x7fbd6014ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.137+0000 7fbd65954700 1 --2- 172.21.15.1:0/1193348905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd601545b0 0x7fbd6014ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.138+0000 7fbd65153700 1 -- 172.21.15.1:0/1193348905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd601545b0 msgr2=0x7fbd6014ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.138+0000 7fbd65153700 1 --2- 172.21.15.1:0/1193348905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd601545b0 0x7fbd6014ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.138+0000 7fbd65153700 1 -- 172.21.15.1:0/1193348905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd601541d0 msgr2=0x7fbd6014ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.138+0000 7fbd65153700 1 --2- 172.21.15.1:0/1193348905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd601541d0 0x7fbd6014ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.138+0000 7fbd65153700 1 -- 172.21.15.1:0/1193348905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd58009ae0 con 0x7fbd600c7f50 2023-11-15T01:22:01.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.138+0000 7fbd65153700 1 --2- 172.21.15.1:0/1193348905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd600c7f50 0x7fbd601429b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fbd5000c440 tx=0x7fbd50007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:01.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.138+0000 7fbd5d7fa700 1 -- 172.21.15.1:0/1193348905 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5000cea0 con 0x7fbd600c7f50 2023-11-15T01:22:01.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.138+0000 7fbd5d7fa700 1 -- 172.21.15.1:0/1193348905 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5000f470 con 0x7fbd600c7f50 2023-11-15T01:22:01.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.138+0000 7fbd66155700 1 -- 172.21.15.1:0/1193348905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd601568a0 con 0x7fbd600c7f50 2023-11-15T01:22:01.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.138+0000 7fbd5d7fa700 1 -- 172.21.15.1:0/1193348905 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5000f810 con 0x7fbd600c7f50 2023-11-15T01:22:01.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.138+0000 7fbd66155700 1 -- 172.21.15.1:0/1193348905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd60156e60 con 0x7fbd600c7f50 2023-11-15T01:22:01.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.139+0000 7fbd66155700 1 -- 172.21.15.1:0/1193348905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd600475e0 con 0x7fbd600c7f50 2023-11-15T01:22:01.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.139+0000 7fbd5d7fa700 1 -- 172.21.15.1:0/1193348905 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbd5000fc40 con 0x7fbd600c7f50 2023-11-15T01:22:01.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.139+0000 7fbd5d7fa700 1 --2- 172.21.15.1:0/1193348905 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbd4c05f150 0x7fbd4c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.140+0000 7fbd5d7fa700 1 -- 172.21.15.1:0/1193348905 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbd50079630 con 0x7fbd600c7f50 2023-11-15T01:22:01.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.140+0000 7fbd64952700 1 --2- 172.21.15.1:0/1193348905 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbd4c05f150 0x7fbd4c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.140+0000 7fbd64952700 1 --2- 172.21.15.1:0/1193348905 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbd4c05f150 0x7fbd4c061610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fbd5400ab40 tx=0x7fbd54008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:01.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.144+0000 7fbd5d7fa700 1 -- 172.21.15.1:0/1193348905 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbd50048af0 con 0x7fbd600c7f50 2023-11-15T01:22:01.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.314+0000 7fbd66155700 1 -- 172.21.15.1:0/1193348905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbd60154f00 con 0x7fbd600c7f50 2023-11-15T01:22:01.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.314+0000 7fbd5d7fa700 1 -- 172.21.15.1:0/1193348905 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbd5004a9b0 con 0x7fbd600c7f50 2023-11-15T01:22:01.316 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:22:01.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.316+0000 7fbd66155700 1 -- 172.21.15.1:0/1193348905 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbd4c05f150 msgr2=0x7fbd4c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.316+0000 7fbd66155700 1 --2- 172.21.15.1:0/1193348905 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbd4c05f150 0x7fbd4c061610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fbd5400ab40 tx=0x7fbd54008040).stop 2023-11-15T01:22:01.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.316+0000 7fbd66155700 1 -- 172.21.15.1:0/1193348905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd600c7f50 msgr2=0x7fbd601429b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.316+0000 7fbd66155700 1 --2- 172.21.15.1:0/1193348905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd600c7f50 0x7fbd601429b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fbd5000c440 tx=0x7fbd50007de0).stop 2023-11-15T01:22:01.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.316+0000 7fbd66155700 1 -- 172.21.15.1:0/1193348905 shutdown_connections 2023-11-15T01:22:01.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.316+0000 7fbd66155700 1 --2- 172.21.15.1:0/1193348905 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbd4c05f150 0x7fbd4c061610 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.316+0000 7fbd66155700 1 --2- 172.21.15.1:0/1193348905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd601545b0 0x7fbd6014ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.316+0000 7fbd66155700 1 --2- 172.21.15.1:0/1193348905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd600c7f50 0x7fbd601429b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.316+0000 7fbd66155700 1 --2- 172.21.15.1:0/1193348905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd601541d0 0x7fbd6014ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.316+0000 7fbd66155700 1 -- 172.21.15.1:0/1193348905 >> 172.21.15.1:0/1193348905 conn(0x7fbd60069ee0 msgr2=0x7fbd600c5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:01.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.316+0000 7fbd66155700 1 -- 172.21.15.1:0/1193348905 shutdown_connections 2023-11-15T01:22:01.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.316+0000 7fbd66155700 1 -- 172.21.15.1:0/1193348905 wait complete. 2023-11-15T01:22:01.330 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T01:22:01.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.449+0000 7f4912227700 1 Processor -- start 2023-11-15T01:22:01.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.449+0000 7f4912227700 1 -- start start 2023-11-15T01:22:01.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.450+0000 7f4912227700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f490c137030 0x7f490c137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.450+0000 7f4912227700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490c154ce0 con 0x7f490c1588e0 2023-11-15T01:22:01.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.450+0000 7f4912227700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490c154fc0 con 0x7f490c066f80 2023-11-15T01:22:01.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.450+0000 7f4912227700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c137900 con 0x7f490c137030 2023-11-15T01:22:01.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.450+0000 7f490affd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f490c1588e0 0x7f490c066870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34132/0 (socket says 172.21.15.1:34132) 2023-11-15T01:22:01.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.450+0000 7f490affd700 1 -- 172.21.15.1:0/400696149 learned_addr learned my addr 172.21.15.1:0/400696149 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:01.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.450+0000 7f490b7fe700 1 --2- 172.21.15.1:0/400696149 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f490c137030 0x7f490c137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.450+0000 7f490a7fc700 1 -- 172.21.15.1:0/400696149 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443503990 0 0) 0x7f490c154ce0 con 0x7f490c1588e0 2023-11-15T01:22:01.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.450+0000 7f490a7fc700 1 -- 172.21.15.1:0/400696149 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48f40033f0 con 0x7f490c1588e0 2023-11-15T01:22:01.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.450+0000 7f490a7fc700 1 -- 172.21.15.1:0/400696149 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285472822 0 0) 0x7f490c154fc0 con 0x7f490c066f80 2023-11-15T01:22:01.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.451+0000 7f490a7fc700 1 -- 172.21.15.1:0/400696149 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f490c154ce0 con 0x7f490c066f80 2023-11-15T01:22:01.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.451+0000 7f490b7fe700 1 -- 172.21.15.1:0/400696149 >> v1:172.21.15.141:6789/0 conn(0x7f490c066f80 legacy=0x7f490c14e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.451+0000 7f490b7fe700 1 -- 172.21.15.1:0/400696149 >> v1:172.21.15.1:6789/0 conn(0x7f490c1588e0 legacy=0x7f490c066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.451+0000 7f490b7fe700 1 -- 172.21.15.1:0/400696149 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c1552a0 con 0x7f490c137030 2023-11-15T01:22:01.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.451+0000 7f490b7fe700 1 --2- 172.21.15.1:0/400696149 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f490c137030 0x7f490c137410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f48fc009790 tx=0x7f48fc009060).ready entity=mon.2 client_cookie=576c329aa32d5214 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:01.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.451+0000 7f490a7fc700 1 -- 172.21.15.1:0/400696149 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00f510 con 0x7f490c137030 2023-11-15T01:22:01.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.451+0000 7f490a7fc700 1 -- 172.21.15.1:0/400696149 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc00f670 con 0x7f490c137030 2023-11-15T01:22:01.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.451+0000 7f490a7fc700 1 -- 172.21.15.1:0/400696149 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00f9f0 con 0x7f490c137030 2023-11-15T01:22:01.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.451+0000 7f4912227700 1 -- 172.21.15.1:0/400696149 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f490c137030 msgr2=0x7f490c137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.451+0000 7f4912227700 1 --2- 172.21.15.1:0/400696149 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f490c137030 0x7f490c137410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f48fc009790 tx=0x7f48fc009060).stop 2023-11-15T01:22:01.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.451+0000 7f4912227700 1 -- 172.21.15.1:0/400696149 shutdown_connections 2023-11-15T01:22:01.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.451+0000 7f4912227700 1 --2- 172.21.15.1:0/400696149 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f490c137030 0x7f490c137410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.451+0000 7f4912227700 1 -- 172.21.15.1:0/400696149 >> 172.21.15.1:0/400696149 conn(0x7f490c063280 msgr2=0x7f490c0c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.452+0000 7f4912227700 1 -- 172.21.15.1:0/400696149 shutdown_connections 2023-11-15T01:22:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.452+0000 7f4912227700 1 -- 172.21.15.1:0/400696149 wait complete. 2023-11-15T01:22:01.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.453+0000 7f4912227700 1 Processor -- start 2023-11-15T01:22:01.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.453+0000 7f4912227700 1 -- start start 2023-11-15T01:22:01.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.453+0000 7f4912227700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f490c066f80 0x7f490c0ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.453+0000 7f4912227700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f490c137030 0x7f490c138480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.453+0000 7f4912227700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f490c1588e0 0x7f490c138970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.453+0000 7f4912227700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0abeb0 con 0x7f490c137030 2023-11-15T01:22:01.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f4912227700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0ac470 con 0x7f490c1588e0 2023-11-15T01:22:01.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f4912227700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c138f40 con 0x7f490c066f80 2023-11-15T01:22:01.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f490affd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f490c137030 0x7f490c138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f490affd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f490c137030 0x7f490c138480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44394/0 (socket says 172.21.15.1:44394) 2023-11-15T01:22:01.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f490affd700 1 -- 172.21.15.1:0/453979803 learned_addr learned my addr 172.21.15.1:0/453979803 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:01.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f490b7fe700 1 --2- 172.21.15.1:0/453979803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f490c066f80 0x7f490c0ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f490bfff700 1 --2- 172.21.15.1:0/453979803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f490c1588e0 0x7f490c138970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f490affd700 1 -- 172.21.15.1:0/453979803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f490c066f80 msgr2=0x7f490c0ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f490affd700 1 --2- 172.21.15.1:0/453979803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f490c066f80 0x7f490c0ae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f490affd700 1 -- 172.21.15.1:0/453979803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f490c1588e0 msgr2=0x7f490c138970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f490affd700 1 --2- 172.21.15.1:0/453979803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f490c1588e0 0x7f490c138970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f490affd700 1 -- 172.21.15.1:0/453979803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc0092a0 con 0x7f490c137030 2023-11-15T01:22:01.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f490affd700 1 --2- 172.21.15.1:0/453979803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f490c137030 0x7f490c138480 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f490000c440 tx=0x7f4900007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:01.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f48f37fe700 1 -- 172.21.15.1:0/453979803 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49000072e0 con 0x7f490c137030 2023-11-15T01:22:01.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f48f37fe700 1 -- 172.21.15.1:0/453979803 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4900007440 con 0x7f490c137030 2023-11-15T01:22:01.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f4912227700 1 -- 172.21.15.1:0/453979803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490c139220 con 0x7f490c137030 2023-11-15T01:22:01.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f48f37fe700 1 -- 172.21.15.1:0/453979803 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49000057a0 con 0x7f490c137030 2023-11-15T01:22:01.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.454+0000 7f4912227700 1 -- 172.21.15.1:0/453979803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490c0c4d50 con 0x7f490c137030 2023-11-15T01:22:01.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.455+0000 7f48f37fe700 1 -- 172.21.15.1:0/453979803 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4900005b90 con 0x7f490c137030 2023-11-15T01:22:01.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.455+0000 7f4912227700 1 -- 172.21.15.1:0/453979803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490c0ac620 con 0x7f490c137030 2023-11-15T01:22:01.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.456+0000 7f48f37fe700 1 --2- 172.21.15.1:0/453979803 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f48f805f150 0x7f48f8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.456+0000 7f48f37fe700 1 -- 172.21.15.1:0/453979803 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f49000799b0 con 0x7f490c137030 2023-11-15T01:22:01.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.456+0000 7f490b7fe700 1 --2- 172.21.15.1:0/453979803 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f48f805f150 0x7f48f8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.456+0000 7f490b7fe700 1 --2- 172.21.15.1:0/453979803 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f48f805f150 0x7f48f8061610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f48fc0096e0 tx=0x7f48fc017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:01.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.460+0000 7f48f37fe700 1 -- 172.21.15.1:0/453979803 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f490c0ac620 con 0x7f490c137030 2023-11-15T01:22:01.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.631+0000 7f4912227700 1 -- 172.21.15.1:0/453979803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f490c139460 con 0x7f490c137030 2023-11-15T01:22:01.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.631+0000 7f48f37fe700 1 -- 172.21.15.1:0/453979803 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f490004ac80 con 0x7f490c137030 2023-11-15T01:22:01.633 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:22:01.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.633+0000 7f4912227700 1 -- 172.21.15.1:0/453979803 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f48f805f150 msgr2=0x7f48f8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.633+0000 7f4912227700 1 --2- 172.21.15.1:0/453979803 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f48f805f150 0x7f48f8061610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f48fc0096e0 tx=0x7f48fc017000).stop 2023-11-15T01:22:01.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.633+0000 7f4912227700 1 -- 172.21.15.1:0/453979803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f490c137030 msgr2=0x7f490c138480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.633+0000 7f4912227700 1 --2- 172.21.15.1:0/453979803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f490c137030 0x7f490c138480 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f490000c440 tx=0x7f4900007c50).stop 2023-11-15T01:22:01.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.633+0000 7f4912227700 1 -- 172.21.15.1:0/453979803 shutdown_connections 2023-11-15T01:22:01.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.633+0000 7f4912227700 1 --2- 172.21.15.1:0/453979803 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f48f805f150 0x7f48f8061610 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.633+0000 7f4912227700 1 --2- 172.21.15.1:0/453979803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f490c1588e0 0x7f490c138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.633+0000 7f4912227700 1 --2- 172.21.15.1:0/453979803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f490c066f80 0x7f490c0ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.633+0000 7f4912227700 1 --2- 172.21.15.1:0/453979803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f490c137030 0x7f490c138480 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.633+0000 7f4912227700 1 -- 172.21.15.1:0/453979803 >> 172.21.15.1:0/453979803 conn(0x7f490c063280 msgr2=0x7f490c0c8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:01.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.634+0000 7f4912227700 1 -- 172.21.15.1:0/453979803 shutdown_connections 2023-11-15T01:22:01.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.634+0000 7f4912227700 1 -- 172.21.15.1:0/453979803 wait complete. 2023-11-15T01:22:01.647 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T01:22:01.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.767+0000 7ff6cd3ac700 1 Processor -- start 2023-11-15T01:22:01.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.767+0000 7ff6cd3ac700 1 -- start start 2023-11-15T01:22:01.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.768+0000 7ff6cd3ac700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff6c8066dc0 0x7ff6c8152740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.768+0000 7ff6cd3ac700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c80a7a10 con 0x7ff6c80627b0 2023-11-15T01:22:01.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.768+0000 7ff6cd3ac700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c8069d60 con 0x7ff6c8152360 2023-11-15T01:22:01.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.768+0000 7ff6cd3ac700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c806a600 con 0x7ff6c8066dc0 2023-11-15T01:22:01.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.768+0000 7ff6c67fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff6c8066dc0 0x7ff6c8152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.768+0000 7ff6c77fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff6c80627b0 0x7ff6c80a7ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34144/0 (socket says 172.21.15.1:34144) 2023-11-15T01:22:01.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.768+0000 7ff6c77fe700 1 -- 172.21.15.1:0/178837665 learned_addr learned my addr 172.21.15.1:0/178837665 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:01.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.768+0000 7ff6c67fc700 1 -- 172.21.15.1:0/178837665 >> v1:172.21.15.141:6789/0 conn(0x7ff6c8152360 legacy=0x7ff6c8069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.768+0000 7ff6c67fc700 1 -- 172.21.15.1:0/178837665 >> v1:172.21.15.1:6789/0 conn(0x7ff6c80627b0 legacy=0x7ff6c80a7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.768+0000 7ff6c67fc700 1 -- 172.21.15.1:0/178837665 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c806a040 con 0x7ff6c8066dc0 2023-11-15T01:22:01.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.768+0000 7ff6c5ffb700 1 -- 172.21.15.1:0/178837665 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014173962 0 0) 0x7ff6c80a7a10 con 0x7ff6c80627b0 2023-11-15T01:22:01.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.769+0000 7ff6c67fc700 1 --2- 172.21.15.1:0/178837665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c8066dc0 0x7ff6c8152740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7ff6b0009790 tx=0x7ff6b0009060).ready entity=mon.0 client_cookie=5eedfef03a422afe server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:01.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.769+0000 7ff6c5ffb700 1 -- 172.21.15.1:0/178837665 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b000b580 con 0x7ff6c8066dc0 2023-11-15T01:22:01.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.769+0000 7ff6c5ffb700 1 -- 172.21.15.1:0/178837665 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b000b6e0 con 0x7ff6c8066dc0 2023-11-15T01:22:01.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.769+0000 7ff6c5ffb700 1 -- 172.21.15.1:0/178837665 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b000ba60 con 0x7ff6c8066dc0 2023-11-15T01:22:01.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.769+0000 7ff6cd3ac700 1 -- 172.21.15.1:0/178837665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c8066dc0 msgr2=0x7ff6c8152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.769+0000 7ff6cd3ac700 1 --2- 172.21.15.1:0/178837665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c8066dc0 0x7ff6c8152740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7ff6b0009790 tx=0x7ff6b0009060).stop 2023-11-15T01:22:01.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.769+0000 7ff6cd3ac700 1 -- 172.21.15.1:0/178837665 shutdown_connections 2023-11-15T01:22:01.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.769+0000 7ff6cd3ac700 1 --2- 172.21.15.1:0/178837665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c8066dc0 0x7ff6c8152740 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.769+0000 7ff6cd3ac700 1 -- 172.21.15.1:0/178837665 >> 172.21.15.1:0/178837665 conn(0x7ff6c80c7c30 msgr2=0x7ff6c80c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:01.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.769+0000 7ff6cd3ac700 1 -- 172.21.15.1:0/178837665 shutdown_connections 2023-11-15T01:22:01.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.769+0000 7ff6cd3ac700 1 -- 172.21.15.1:0/178837665 wait complete. 2023-11-15T01:22:01.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.771+0000 7ff6cd3ac700 1 Processor -- start 2023-11-15T01:22:01.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.771+0000 7ff6cd3ac700 1 -- start start 2023-11-15T01:22:01.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.771+0000 7ff6cd3ac700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6c80627b0 0x7ff6c80a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.771+0000 7ff6cd3ac700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6c8066dc0 0x7ff6c80c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.771+0000 7ff6cd3ac700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c8152360 0x7ff6c81485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.771+0000 7ff6cd3ac700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c80aa300 con 0x7ff6c8152360 2023-11-15T01:22:01.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.771+0000 7ff6cd3ac700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c80c0ba0 con 0x7ff6c80627b0 2023-11-15T01:22:01.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.771+0000 7ff6cd3ac700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c8148aa0 con 0x7ff6c8066dc0 2023-11-15T01:22:01.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.772+0000 7ff6c77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c8152360 0x7ff6c81485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.772+0000 7ff6c77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c8152360 0x7ff6c81485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44418/0 (socket says 172.21.15.1:44418) 2023-11-15T01:22:01.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.772+0000 7ff6c77fe700 1 -- 172.21.15.1:0/2086756619 learned_addr learned my addr 172.21.15.1:0/2086756619 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:01.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.772+0000 7ff6c67fc700 1 --2- 172.21.15.1:0/2086756619 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6c8066dc0 0x7ff6c80c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.772+0000 7ff6c6ffd700 1 --2- 172.21.15.1:0/2086756619 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6c80627b0 0x7ff6c80a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.772+0000 7ff6c77fe700 1 -- 172.21.15.1:0/2086756619 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6c8066dc0 msgr2=0x7ff6c80c06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.772+0000 7ff6c77fe700 1 --2- 172.21.15.1:0/2086756619 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6c8066dc0 0x7ff6c80c06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.772+0000 7ff6c77fe700 1 -- 172.21.15.1:0/2086756619 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6c80627b0 msgr2=0x7ff6c80a9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.772+0000 7ff6c77fe700 1 --2- 172.21.15.1:0/2086756619 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6c80627b0 0x7ff6c80a9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.772+0000 7ff6c77fe700 1 -- 172.21.15.1:0/2086756619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b00092a0 con 0x7ff6c8152360 2023-11-15T01:22:01.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.772+0000 7ff6c77fe700 1 --2- 172.21.15.1:0/2086756619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c8152360 0x7ff6c81485b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7ff6c000c730 tx=0x7ff6c0001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:01.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.773+0000 7ff6beffd700 1 -- 172.21.15.1:0/2086756619 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0005d30 con 0x7ff6c8152360 2023-11-15T01:22:01.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.773+0000 7ff6cd3ac700 1 -- 172.21.15.1:0/2086756619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c80c0dd0 con 0x7ff6c8152360 2023-11-15T01:22:01.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.773+0000 7ff6beffd700 1 -- 172.21.15.1:0/2086756619 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c0005e90 con 0x7ff6c8152360 2023-11-15T01:22:01.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.773+0000 7ff6beffd700 1 -- 172.21.15.1:0/2086756619 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0007300 con 0x7ff6c8152360 2023-11-15T01:22:01.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.773+0000 7ff6cd3ac700 1 -- 172.21.15.1:0/2086756619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c80a4cd0 con 0x7ff6c8152360 2023-11-15T01:22:01.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.774+0000 7ff6cd3ac700 1 -- 172.21.15.1:0/2086756619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c80475e0 con 0x7ff6c8152360 2023-11-15T01:22:01.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.774+0000 7ff6beffd700 1 -- 172.21.15.1:0/2086756619 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff6c0007670 con 0x7ff6c8152360 2023-11-15T01:22:01.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.775+0000 7ff6beffd700 1 --2- 172.21.15.1:0/2086756619 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff6a805f180 0x7ff6a8061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:01.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.775+0000 7ff6beffd700 1 -- 172.21.15.1:0/2086756619 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff6c0079b60 con 0x7ff6c8152360 2023-11-15T01:22:01.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.775+0000 7ff6c6ffd700 1 --2- 172.21.15.1:0/2086756619 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff6a805f180 0x7ff6a8061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:01.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.775+0000 7ff6c6ffd700 1 --2- 172.21.15.1:0/2086756619 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff6a805f180 0x7ff6a8061640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7ff6c80665c0 tx=0x7ff6b8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:01.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.779+0000 7ff6beffd700 1 -- 172.21.15.1:0/2086756619 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff6c004ae30 con 0x7ff6c8152360 2023-11-15T01:22:01.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.952+0000 7ff6cd3ac700 1 -- 172.21.15.1:0/2086756619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6c80c79a0 con 0x7ff6c8152360 2023-11-15T01:22:01.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.953+0000 7ff6beffd700 1 -- 172.21.15.1:0/2086756619 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff6c00079a0 con 0x7ff6c8152360 2023-11-15T01:22:01.955 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:22:01.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.955+0000 7ff6cd3ac700 1 -- 172.21.15.1:0/2086756619 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff6a805f180 msgr2=0x7ff6a8061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.955+0000 7ff6cd3ac700 1 --2- 172.21.15.1:0/2086756619 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff6a805f180 0x7ff6a8061640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7ff6c80665c0 tx=0x7ff6b8009040).stop 2023-11-15T01:22:01.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.955+0000 7ff6cd3ac700 1 -- 172.21.15.1:0/2086756619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c8152360 msgr2=0x7ff6c81485b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:01.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.955+0000 7ff6cd3ac700 1 --2- 172.21.15.1:0/2086756619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c8152360 0x7ff6c81485b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7ff6c000c730 tx=0x7ff6c0001520).stop 2023-11-15T01:22:01.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.955+0000 7ff6cd3ac700 1 -- 172.21.15.1:0/2086756619 shutdown_connections 2023-11-15T01:22:01.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.955+0000 7ff6cd3ac700 1 --2- 172.21.15.1:0/2086756619 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff6a805f180 0x7ff6a8061640 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.955+0000 7ff6cd3ac700 1 --2- 172.21.15.1:0/2086756619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c8152360 0x7ff6c81485b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.955+0000 7ff6cd3ac700 1 --2- 172.21.15.1:0/2086756619 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6c80627b0 0x7ff6c80a9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.955+0000 7ff6cd3ac700 1 --2- 172.21.15.1:0/2086756619 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6c8066dc0 0x7ff6c80c06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:01.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.955+0000 7ff6cd3ac700 1 -- 172.21.15.1:0/2086756619 >> 172.21.15.1:0/2086756619 conn(0x7ff6c80c7c30 msgr2=0x7ff6c814fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:01.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.955+0000 7ff6cd3ac700 1 -- 172.21.15.1:0/2086756619 shutdown_connections 2023-11-15T01:22:01.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:01.955+0000 7ff6cd3ac700 1 -- 172.21.15.1:0/2086756619 wait complete. 2023-11-15T01:22:01.968 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:22:02.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.084+0000 7eff43676700 1 Processor -- start 2023-11-15T01:22:02.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.084+0000 7eff43676700 1 -- start start 2023-11-15T01:22:02.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.085+0000 7eff43676700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7eff3c154150 0x7eff3c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.085+0000 7eff43676700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7eff3c0ab1a0 0x7eff3c158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.085+0000 7eff43676700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3c0aa060 0x7eff3c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.085+0000 7eff43676700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c0c06f0 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.085+0000 7eff43676700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c0c09d0 con 0x7eff3c154150 2023-11-15T01:22:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.085+0000 7eff43676700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c158820 con 0x7eff3c0aa060 2023-11-15T01:22:02.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.085+0000 7eff40c11700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7eff3c0ab1a0 0x7eff3c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.085+0000 7eff40c11700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7eff3c0ab1a0 0x7eff3c158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44422/0 (socket says 172.21.15.1:44422) 2023-11-15T01:22:02.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.085+0000 7eff40c11700 1 -- 172.21.15.1:0/84883534 learned_addr learned my addr 172.21.15.1:0/84883534 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:02.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.085+0000 7eff41412700 1 --2- 172.21.15.1:0/84883534 >> v2:172.21.15.141:3300/0 conn(0x7eff3c154150 0x7eff3c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.085+0000 7eff41c13700 1 --2- 172.21.15.1:0/84883534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3c0aa060 0x7eff3c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.086+0000 7eff40c11700 1 -- 172.21.15.1:0/84883534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3c0aa060 msgr2=0x7eff3c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:02.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.086+0000 7eff40c11700 1 --2- 172.21.15.1:0/84883534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3c0aa060 0x7eff3c0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.086+0000 7eff40c11700 1 -- 172.21.15.1:0/84883534 >> v2:172.21.15.141:3300/0 conn(0x7eff3c154150 msgr2=0x7eff3c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:02.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.086+0000 7eff40c11700 1 --2- 172.21.15.1:0/84883534 >> v2:172.21.15.141:3300/0 conn(0x7eff3c154150 0x7eff3c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.086+0000 7eff40c11700 1 -- 172.21.15.1:0/84883534 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c158b00 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.086+0000 7eff41c13700 1 --2- 172.21.15.1:0/84883534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3c0aa060 0x7eff3c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:02.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.086+0000 7eff40c11700 1 --2- 172.21.15.1:0/84883534 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff3c0ab1a0 0x7eff3c158040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7eff3c06bfb0 tx=0x7eff300090f0).ready entity=mon.0 client_cookie=87e3092bf55481a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:02.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.086+0000 7eff3bfff700 1 -- 172.21.15.1:0/84883534 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3000b520 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.086+0000 7eff3bfff700 1 -- 172.21.15.1:0/84883534 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3000b680 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.086+0000 7eff3bfff700 1 -- 172.21.15.1:0/84883534 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3000ba20 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.086+0000 7eff43676700 1 -- 172.21.15.1:0/84883534 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff3c0ab1a0 msgr2=0x7eff3c158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.086+0000 7eff43676700 1 --2- 172.21.15.1:0/84883534 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff3c0ab1a0 0x7eff3c158040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7eff3c06bfb0 tx=0x7eff300090f0).stop 2023-11-15T01:22:02.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.087+0000 7eff43676700 1 -- 172.21.15.1:0/84883534 shutdown_connections 2023-11-15T01:22:02.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.087+0000 7eff43676700 1 --2- 172.21.15.1:0/84883534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3c0aa060 0x7eff3c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.087+0000 7eff43676700 1 --2- 172.21.15.1:0/84883534 >> v2:172.21.15.141:3300/0 conn(0x7eff3c154150 0x7eff3c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.087+0000 7eff43676700 1 --2- 172.21.15.1:0/84883534 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff3c0ab1a0 0x7eff3c158040 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.087+0000 7eff43676700 1 -- 172.21.15.1:0/84883534 >> 172.21.15.1:0/84883534 conn(0x7eff3c064aa0 msgr2=0x7eff3c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:02.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.087+0000 7eff43676700 1 -- 172.21.15.1:0/84883534 shutdown_connections 2023-11-15T01:22:02.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.087+0000 7eff43676700 1 -- 172.21.15.1:0/84883534 wait complete. 2023-11-15T01:22:02.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.088+0000 7eff43676700 1 Processor -- start 2023-11-15T01:22:02.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.088+0000 7eff43676700 1 -- start start 2023-11-15T01:22:02.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff43676700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3c0aa060 0x7eff3c157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff43676700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff3c0ab1a0 0x7eff3c0c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff43676700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff3c154150 0x7eff3c152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff43676700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0ca280 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff43676700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0c93a0 con 0x7eff3c154150 2023-11-15T01:22:02.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff43676700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0c9670 con 0x7eff3c0aa060 2023-11-15T01:22:02.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff40c11700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff3c0ab1a0 0x7eff3c0c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff40c11700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff3c0ab1a0 0x7eff3c0c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44438/0 (socket says 172.21.15.1:44438) 2023-11-15T01:22:02.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff40c11700 1 -- 172.21.15.1:0/2115245306 learned_addr learned my addr 172.21.15.1:0/2115245306 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:02.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff41c13700 1 --2- 172.21.15.1:0/2115245306 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff3c154150 0x7eff3c152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff40c11700 1 -- 172.21.15.1:0/2115245306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3c0aa060 msgr2=0x7eff3c157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff40c11700 1 --2- 172.21.15.1:0/2115245306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3c0aa060 0x7eff3c157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:02.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff40c11700 1 -- 172.21.15.1:0/2115245306 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff3c154150 msgr2=0x7eff3c152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff40c11700 1 --2- 172.21.15.1:0/2115245306 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff3c154150 0x7eff3c152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff40c11700 1 -- 172.21.15.1:0/2115245306 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff30009370 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff40c11700 1 --2- 172.21.15.1:0/2115245306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff3c0ab1a0 0x7eff3c0c8eb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7eff30006fd0 tx=0x7eff30017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:02.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff397fa700 1 -- 172.21.15.1:0/2115245306 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30000bc0 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff397fa700 1 -- 172.21.15.1:0/2115245306 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3000b7f0 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff43676700 1 -- 172.21.15.1:0/2115245306 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c0c9950 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff397fa700 1 -- 172.21.15.1:0/2115245306 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3001c420 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.089+0000 7eff43676700 1 -- 172.21.15.1:0/2115245306 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c0c9f10 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.090+0000 7eff43676700 1 -- 172.21.15.1:0/2115245306 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c1538d0 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.091+0000 7eff397fa700 1 -- 172.21.15.1:0/2115245306 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7eff3001c790 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.091+0000 7eff397fa700 1 --2- 172.21.15.1:0/2115245306 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7eff2805f150 0x7eff28061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.091+0000 7eff397fa700 1 -- 172.21.15.1:0/2115245306 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7eff3007bd50 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.091+0000 7eff41412700 1 --2- 172.21.15.1:0/2115245306 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7eff2805f150 0x7eff28061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.092+0000 7eff41412700 1 --2- 172.21.15.1:0/2115245306 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7eff2805f150 0x7eff28061610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7eff34009a30 tx=0x7eff34009060).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:02.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.095+0000 7eff397fa700 1 -- 172.21.15.1:0/2115245306 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7eff3007f030 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.268+0000 7eff43676700 1 -- 172.21.15.1:0/2115245306 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff3c06c7e0 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.269+0000 7eff397fa700 1 -- 172.21.15.1:0/2115245306 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16880 (secure 0 0 0) 0x7eff3002a030 con 0x7eff3c0ab1a0 2023-11-15T01:22:02.271 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:02.271 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:38.047484+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:21:34.763591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-15T01:21:36.025071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:22:02.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.271+0000 7eff43676700 1 -- 172.21.15.1:0/2115245306 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7eff2805f150 msgr2=0x7eff28061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.271+0000 7eff43676700 1 --2- 172.21.15.1:0/2115245306 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7eff2805f150 0x7eff28061610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7eff34009a30 tx=0x7eff34009060).stop 2023-11-15T01:22:02.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.271+0000 7eff43676700 1 -- 172.21.15.1:0/2115245306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff3c0ab1a0 msgr2=0x7eff3c0c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.271+0000 7eff43676700 1 --2- 172.21.15.1:0/2115245306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff3c0ab1a0 0x7eff3c0c8eb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7eff30006fd0 tx=0x7eff30017000).stop 2023-11-15T01:22:02.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.271+0000 7eff43676700 1 -- 172.21.15.1:0/2115245306 shutdown_connections 2023-11-15T01:22:02.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.271+0000 7eff43676700 1 --2- 172.21.15.1:0/2115245306 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7eff2805f150 0x7eff28061610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.271+0000 7eff43676700 1 --2- 172.21.15.1:0/2115245306 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff3c154150 0x7eff3c152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.271+0000 7eff43676700 1 --2- 172.21.15.1:0/2115245306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3c0aa060 0x7eff3c157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:02.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.271+0000 7eff43676700 1 --2- 172.21.15.1:0/2115245306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff3c0ab1a0 0x7eff3c0c8eb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.271+0000 7eff43676700 1 -- 172.21.15.1:0/2115245306 >> 172.21.15.1:0/2115245306 conn(0x7eff3c064aa0 msgr2=0x7eff3c159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:02.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.271+0000 7eff43676700 1 -- 172.21.15.1:0/2115245306 shutdown_connections 2023-11-15T01:22:02.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.271+0000 7eff43676700 1 -- 172.21.15.1:0/2115245306 wait complete. 2023-11-15T01:22:02.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T01:21:34.763591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T01:21:36.025071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T01:22:02.286 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:22:02.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.405+0000 7f1767171700 1 Processor -- start 2023-11-15T01:22:02.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.405+0000 7f1767171700 1 -- start start 2023-11-15T01:22:02.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.406+0000 7f1767171700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17601540a0 0x7f17600ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.406+0000 7f1767171700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f17600c6650 0x7f17600ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.406+0000 7f1767171700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17600ca050 con 0x7f1760154480 2023-11-15T01:22:02.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.406+0000 7f1767171700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17600c9440 con 0x7f17600c6650 2023-11-15T01:22:02.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.406+0000 7f1767171700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17600c9720 con 0x7f17601540a0 2023-11-15T01:22:02.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.406+0000 7f176570e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f17600c6650 0x7f17600ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.406+0000 7f1764f0d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17601540a0 0x7f17600ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.406+0000 7f1764f0d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17601540a0 0x7f17600ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:33652/0 (socket says 172.21.15.1:33652) 2023-11-15T01:22:02.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.406+0000 7f1764f0d700 1 -- 172.21.15.1:0/3263024176 learned_addr learned my addr 172.21.15.1:0/3263024176 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:02.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.406+0000 7f176570e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f17600c6650 0x7f17600ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:53806/0 (socket says 172.21.15.1:53806) 2023-11-15T01:22:02.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.406+0000 7f175ffff700 1 --1- 172.21.15.1:0/3263024176 >> v1:172.21.15.141:6789/0 conn(0x7f1760154480 0x7f17600c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:57296/0 (socket says 172.21.15.1:57296) 2023-11-15T01:22:02.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.407+0000 7f1764f0d700 1 -- 172.21.15.1:0/3263024176 >> v2:172.21.15.141:3300/0 conn(0x7f17600c6650 msgr2=0x7f17600ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.407+0000 7f1764f0d700 1 --2- 172.21.15.1:0/3263024176 >> v2:172.21.15.141:3300/0 conn(0x7f17600c6650 0x7f17600ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.407+0000 7f1764f0d700 1 -- 172.21.15.1:0/3263024176 >> v1:172.21.15.141:6789/0 conn(0x7f1760154480 legacy=0x7f17600c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.407+0000 7f1764f0d700 1 -- 172.21.15.1:0/3263024176 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17600c9a00 con 0x7f17601540a0 2023-11-15T01:22:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.407+0000 7f1764f0d700 1 --2- 172.21.15.1:0/3263024176 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17601540a0 0x7f17600ca4e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1758009f20 tx=0x7f1758009840).ready entity=mon.2 client_cookie=9577709c53290799 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.407+0000 7f175f7fe700 1 -- 172.21.15.1:0/3263024176 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175800e070 con 0x7f17601540a0 2023-11-15T01:22:02.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.407+0000 7f175f7fe700 1 -- 172.21.15.1:0/3263024176 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175800b9d0 con 0x7f17601540a0 2023-11-15T01:22:02.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.407+0000 7f175f7fe700 1 -- 172.21.15.1:0/3263024176 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175800bd50 con 0x7f17601540a0 2023-11-15T01:22:02.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.408+0000 7f1767171700 1 -- 172.21.15.1:0/3263024176 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17601540a0 msgr2=0x7f17600ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.408+0000 7f1767171700 1 --2- 172.21.15.1:0/3263024176 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17601540a0 0x7f17600ca4e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1758009f20 tx=0x7f1758009840).stop 2023-11-15T01:22:02.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.408+0000 7f1767171700 1 -- 172.21.15.1:0/3263024176 shutdown_connections 2023-11-15T01:22:02.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.408+0000 7f1767171700 1 --2- 172.21.15.1:0/3263024176 >> v2:172.21.15.141:3300/0 conn(0x7f17600c6650 0x7f17600ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.408+0000 7f1767171700 1 --2- 172.21.15.1:0/3263024176 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17601540a0 0x7f17600ca4e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.408+0000 7f1767171700 1 -- 172.21.15.1:0/3263024176 >> 172.21.15.1:0/3263024176 conn(0x7f1760064a70 msgr2=0x7f1760064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:02.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.408+0000 7f1767171700 1 -- 172.21.15.1:0/3263024176 shutdown_connections 2023-11-15T01:22:02.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.408+0000 7f1767171700 1 -- 172.21.15.1:0/3263024176 wait complete. 2023-11-15T01:22:02.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.409+0000 7f1767171700 1 Processor -- start 2023-11-15T01:22:02.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.409+0000 7f1767171700 1 -- start start 2023-11-15T01:22:02.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f1767171700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17600c6650 0x7f1760153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f1767171700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17601540a0 0x7f17600afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f1767171700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1760154480 0x7f17600aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f1767171700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1760165bb0 con 0x7f17600c6650 2023-11-15T01:22:02.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f1767171700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17600b0420 con 0x7f17601540a0 2023-11-15T01:22:02.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f1767171700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1760165880 con 0x7f1760154480 2023-11-15T01:22:02.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f1764f0d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17600c6650 0x7f1760153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f1764f0d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17600c6650 0x7f1760153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44452/0 (socket says 172.21.15.1:44452) 2023-11-15T01:22:02.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f1764f0d700 1 -- 172.21.15.1:0/2905203041 learned_addr learned my addr 172.21.15.1:0/2905203041 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:02.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f175ffff700 1 --2- 172.21.15.1:0/2905203041 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17601540a0 0x7f17600afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f176570e700 1 --2- 172.21.15.1:0/2905203041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1760154480 0x7f17600aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f1764f0d700 1 -- 172.21.15.1:0/2905203041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1760154480 msgr2=0x7f17600aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f1764f0d700 1 --2- 172.21.15.1:0/2905203041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1760154480 0x7f17600aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f1764f0d700 1 -- 172.21.15.1:0/2905203041 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17601540a0 msgr2=0x7f17600afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f1764f0d700 1 --2- 172.21.15.1:0/2905203041 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17601540a0 0x7f17600afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f1764f0d700 1 -- 172.21.15.1:0/2905203041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1758009ae0 con 0x7f17600c6650 2023-11-15T01:22:02.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f1764f0d700 1 --2- 172.21.15.1:0/2905203041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17600c6650 0x7f1760153300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f175800b900 tx=0x7f1758009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:02.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f175cff9700 1 -- 172.21.15.1:0/2905203041 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17580092e0 con 0x7f17600c6650 2023-11-15T01:22:02.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.410+0000 7f175cff9700 1 -- 172.21.15.1:0/2905203041 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175800bb40 con 0x7f17600c6650 2023-11-15T01:22:02.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.411+0000 7f1767171700 1 -- 172.21.15.1:0/2905203041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17600b0670 con 0x7f17600c6650 2023-11-15T01:22:02.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.411+0000 7f175cff9700 1 -- 172.21.15.1:0/2905203041 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175801d410 con 0x7f17600c6650 2023-11-15T01:22:02.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.411+0000 7f1767171700 1 -- 172.21.15.1:0/2905203041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17600b0c30 con 0x7f17600c6650 2023-11-15T01:22:02.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.412+0000 7f1767171700 1 -- 172.21.15.1:0/2905203041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176006c7e0 con 0x7f17600c6650 2023-11-15T01:22:02.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.412+0000 7f175cff9700 1 -- 172.21.15.1:0/2905203041 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f175801d780 con 0x7f17600c6650 2023-11-15T01:22:02.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.412+0000 7f175cff9700 1 --2- 172.21.15.1:0/2905203041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f174005f150 0x7f1740061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.412+0000 7f175cff9700 1 -- 172.21.15.1:0/2905203041 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f175807bba0 con 0x7f17600c6650 2023-11-15T01:22:02.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.413+0000 7f175ffff700 1 --2- 172.21.15.1:0/2905203041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f174005f150 0x7f1740061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.413+0000 7f175ffff700 1 --2- 172.21.15.1:0/2905203041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f174005f150 0x7f1740061610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f17600a3020 tx=0x7f1750007d30).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:02.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.417+0000 7f175cff9700 1 -- 172.21.15.1:0/2905203041 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f175804ce70 con 0x7f17600c6650 2023-11-15T01:22:02.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.588+0000 7f1767171700 1 -- 172.21.15.1:0/2905203041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f17600c9ce0 con 0x7f17600c6650 2023-11-15T01:22:02.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.588+0000 7f175cff9700 1 -- 172.21.15.1:0/2905203041 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1758050490 con 0x7f17600c6650 2023-11-15T01:22:02.590 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:22:02.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.590+0000 7f1767171700 1 -- 172.21.15.1:0/2905203041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f174005f150 msgr2=0x7f1740061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.590+0000 7f1767171700 1 --2- 172.21.15.1:0/2905203041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f174005f150 0x7f1740061610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f17600a3020 tx=0x7f1750007d30).stop 2023-11-15T01:22:02.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.590+0000 7f1767171700 1 -- 172.21.15.1:0/2905203041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17600c6650 msgr2=0x7f1760153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.590+0000 7f1767171700 1 --2- 172.21.15.1:0/2905203041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17600c6650 0x7f1760153300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f175800b900 tx=0x7f1758009840).stop 2023-11-15T01:22:02.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.590+0000 7f1767171700 1 -- 172.21.15.1:0/2905203041 shutdown_connections 2023-11-15T01:22:02.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.590+0000 7f1767171700 1 --2- 172.21.15.1:0/2905203041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f174005f150 0x7f1740061610 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.590+0000 7f1767171700 1 --2- 172.21.15.1:0/2905203041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1760154480 0x7f17600aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.590+0000 7f1767171700 1 --2- 172.21.15.1:0/2905203041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17600c6650 0x7f1760153300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.590+0000 7f1767171700 1 --2- 172.21.15.1:0/2905203041 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17601540a0 0x7f17600afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.590+0000 7f1767171700 1 -- 172.21.15.1:0/2905203041 >> 172.21.15.1:0/2905203041 conn(0x7f1760064a70 msgr2=0x7f17600abb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:02.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.590+0000 7f1767171700 1 -- 172.21.15.1:0/2905203041 shutdown_connections 2023-11-15T01:22:02.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.590+0000 7f1767171700 1 -- 172.21.15.1:0/2905203041 wait complete. 2023-11-15T01:22:02.604 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:22:02.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.723+0000 7fdf028fa700 1 Processor -- start 2023-11-15T01:22:02.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.723+0000 7fdf028fa700 1 -- start start 2023-11-15T01:22:02.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.724+0000 7fdf028fa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdefc1540a0 0x7fdefc0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.724+0000 7fdf028fa700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdefc154480 0x7fdefc0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.724+0000 7fdf028fa700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdefc0ca050 con 0x7fdefc0c5f40 2023-11-15T01:22:02.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.724+0000 7fdf028fa700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdefc0c9440 con 0x7fdefc154480 2023-11-15T01:22:02.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.724+0000 7fdf028fa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0c9720 con 0x7fdefc1540a0 2023-11-15T01:22:02.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.724+0000 7fdefb7fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdefc154480 0x7fdefc0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.724+0000 7fdefbfff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdefc1540a0 0x7fdefc0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.724+0000 7fdefb7fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdefc154480 0x7fdefc0ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:53818/0 (socket says 172.21.15.1:53818) 2023-11-15T01:22:02.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.724+0000 7fdefb7fe700 1 -- 172.21.15.1:0/2627769071 learned_addr learned my addr 172.21.15.1:0/2627769071 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:02.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.724+0000 7fdf00e97700 1 --1- 172.21.15.1:0/2627769071 >> v1:172.21.15.141:6789/0 conn(0x7fdefc0c5f40 0x7fdefc0aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:57306/0 (socket says 172.21.15.1:57306) 2023-11-15T01:22:02.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.725+0000 7fdefaffd700 1 -- 172.21.15.1:0/2627769071 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494028488 0 0) 0x7fdefc0ca050 con 0x7fdefc0c5f40 2023-11-15T01:22:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.725+0000 7fdefbfff700 1 -- 172.21.15.1:0/2627769071 >> v2:172.21.15.141:3300/0 conn(0x7fdefc154480 msgr2=0x7fdefc0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.725+0000 7fdefbfff700 1 --2- 172.21.15.1:0/2627769071 >> v2:172.21.15.141:3300/0 conn(0x7fdefc154480 0x7fdefc0ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.725+0000 7fdefbfff700 1 -- 172.21.15.1:0/2627769071 >> v1:172.21.15.141:6789/0 conn(0x7fdefc0c5f40 legacy=0x7fdefc0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.725+0000 7fdefbfff700 1 -- 172.21.15.1:0/2627769071 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc0c9a00 con 0x7fdefc1540a0 2023-11-15T01:22:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.725+0000 7fdefbfff700 1 --2- 172.21.15.1:0/2627769071 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdefc1540a0 0x7fdefc0ca4e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fdee4009760 tx=0x7fdee4009060).ready entity=mon.2 client_cookie=a8648c81a0f99bda server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.725+0000 7fdefaffd700 1 -- 172.21.15.1:0/2627769071 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee400f510 con 0x7fdefc1540a0 2023-11-15T01:22:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.725+0000 7fdefaffd700 1 -- 172.21.15.1:0/2627769071 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee400f670 con 0x7fdefc1540a0 2023-11-15T01:22:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.725+0000 7fdefaffd700 1 -- 172.21.15.1:0/2627769071 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee400f9f0 con 0x7fdefc1540a0 2023-11-15T01:22:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.725+0000 7fdf028fa700 1 -- 172.21.15.1:0/2627769071 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdefc1540a0 msgr2=0x7fdefc0ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.725+0000 7fdf028fa700 1 --2- 172.21.15.1:0/2627769071 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdefc1540a0 0x7fdefc0ca4e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fdee4009760 tx=0x7fdee4009060).stop 2023-11-15T01:22:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.726+0000 7fdf028fa700 1 -- 172.21.15.1:0/2627769071 shutdown_connections 2023-11-15T01:22:02.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.726+0000 7fdf028fa700 1 --2- 172.21.15.1:0/2627769071 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdefc1540a0 0x7fdefc0ca4e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.726+0000 7fdf028fa700 1 --2- 172.21.15.1:0/2627769071 >> v2:172.21.15.141:3300/0 conn(0x7fdefc154480 0x7fdefc0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.726+0000 7fdf028fa700 1 -- 172.21.15.1:0/2627769071 >> 172.21.15.1:0/2627769071 conn(0x7fdefc064a70 msgr2=0x7fdefc064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:02.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.726+0000 7fdf028fa700 1 -- 172.21.15.1:0/2627769071 shutdown_connections 2023-11-15T01:22:02.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.726+0000 7fdf028fa700 1 -- 172.21.15.1:0/2627769071 wait complete. 2023-11-15T01:22:02.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.727+0000 7fdf028fa700 1 Processor -- start 2023-11-15T01:22:02.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.727+0000 7fdf028fa700 1 -- start start 2023-11-15T01:22:02.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdf028fa700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdefc0c5f40 0x7fdefc14eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdf028fa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdefc1540a0 0x7fdefc0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdf028fa700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdefc154480 0x7fdefc0b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdf028fa700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0ae060 con 0x7fdefc0c5f40 2023-11-15T01:22:02.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdf028fa700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc14f390 con 0x7fdefc154480 2023-11-15T01:22:02.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdf028fa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0b1010 con 0x7fdefc1540a0 2023-11-15T01:22:02.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdefbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdefc0c5f40 0x7fdefc14eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdefbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdefc0c5f40 0x7fdefc14eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44454/0 (socket says 172.21.15.1:44454) 2023-11-15T01:22:02.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdefbfff700 1 -- 172.21.15.1:0/505602704 learned_addr learned my addr 172.21.15.1:0/505602704 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:02.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdf00e97700 1 --2- 172.21.15.1:0/505602704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdefc154480 0x7fdefc0b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdefb7fe700 1 --2- 172.21.15.1:0/505602704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdefc1540a0 0x7fdefc0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdefbfff700 1 -- 172.21.15.1:0/505602704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdefc1540a0 msgr2=0x7fdefc0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdefbfff700 1 --2- 172.21.15.1:0/505602704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdefc1540a0 0x7fdefc0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdefbfff700 1 -- 172.21.15.1:0/505602704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdefc154480 msgr2=0x7fdefc0b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdefbfff700 1 --2- 172.21.15.1:0/505602704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdefc154480 0x7fdefc0b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdefbfff700 1 -- 172.21.15.1:0/505602704 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee40092a0 con 0x7fdefc0c5f40 2023-11-15T01:22:02.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdefbfff700 1 --2- 172.21.15.1:0/505602704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdefc0c5f40 0x7fdefc14eea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fdee4009e00 tx=0x7fdee4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:02.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdef3fff700 1 -- 172.21.15.1:0/505602704 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee400fe80 con 0x7fdefc0c5f40 2023-11-15T01:22:02.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdef3fff700 1 -- 172.21.15.1:0/505602704 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee400f7e0 con 0x7fdefc0c5f40 2023-11-15T01:22:02.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdef3fff700 1 -- 172.21.15.1:0/505602704 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee401a650 con 0x7fdefc0c5f40 2023-11-15T01:22:02.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.728+0000 7fdf028fa700 1 -- 172.21.15.1:0/505602704 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdefc0c3960 con 0x7fdefc0c5f40 2023-11-15T01:22:02.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.729+0000 7fdf028fa700 1 -- 172.21.15.1:0/505602704 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdefc0ae590 con 0x7fdefc0c5f40 2023-11-15T01:22:02.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.730+0000 7fdf028fa700 1 -- 172.21.15.1:0/505602704 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdefc0aebe0 con 0x7fdefc0c5f40 2023-11-15T01:22:02.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.730+0000 7fdef3fff700 1 -- 172.21.15.1:0/505602704 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdee401a9c0 con 0x7fdefc0c5f40 2023-11-15T01:22:02.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.730+0000 7fdef3fff700 1 --2- 172.21.15.1:0/505602704 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdedc05f150 0x7fdedc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:02.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.730+0000 7fdef3fff700 1 -- 172.21.15.1:0/505602704 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdee407b340 con 0x7fdefc0c5f40 2023-11-15T01:22:02.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.730+0000 7fdefb7fe700 1 --2- 172.21.15.1:0/505602704 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdedc05f150 0x7fdedc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:02.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.731+0000 7fdefb7fe700 1 --2- 172.21.15.1:0/505602704 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdedc05f150 0x7fdedc061610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fdefc0c5170 tx=0x7fdeec0090f0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:02.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.734+0000 7fdef3fff700 1 -- 172.21.15.1:0/505602704 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdee404c610 con 0x7fdefc0c5f40 2023-11-15T01:22:02.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.907+0000 7fdf028fa700 1 -- 172.21.15.1:0/505602704 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdefc06c7e0 con 0x7fdefc0c5f40 2023-11-15T01:22:02.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.907+0000 7fdef3fff700 1 -- 172.21.15.1:0/505602704 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdee401f0a0 con 0x7fdefc0c5f40 2023-11-15T01:22:02.909 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:22:02.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.909+0000 7fdf028fa700 1 -- 172.21.15.1:0/505602704 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdedc05f150 msgr2=0x7fdedc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.909+0000 7fdf028fa700 1 --2- 172.21.15.1:0/505602704 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdedc05f150 0x7fdedc061610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fdefc0c5170 tx=0x7fdeec0090f0).stop 2023-11-15T01:22:02.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.909+0000 7fdf028fa700 1 -- 172.21.15.1:0/505602704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdefc0c5f40 msgr2=0x7fdefc14eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:02.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.909+0000 7fdf028fa700 1 --2- 172.21.15.1:0/505602704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdefc0c5f40 0x7fdefc14eea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fdee4009e00 tx=0x7fdee4017000).stop 2023-11-15T01:22:02.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.909+0000 7fdf028fa700 1 -- 172.21.15.1:0/505602704 shutdown_connections 2023-11-15T01:22:02.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.909+0000 7fdf028fa700 1 --2- 172.21.15.1:0/505602704 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdedc05f150 0x7fdedc061610 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.909+0000 7fdf028fa700 1 --2- 172.21.15.1:0/505602704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdefc154480 0x7fdefc0b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.909+0000 7fdf028fa700 1 --2- 172.21.15.1:0/505602704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdefc0c5f40 0x7fdefc14eea0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.909+0000 7fdf028fa700 1 --2- 172.21.15.1:0/505602704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdefc1540a0 0x7fdefc0b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:02.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.909+0000 7fdf028fa700 1 -- 172.21.15.1:0/505602704 >> 172.21.15.1:0/505602704 conn(0x7fdefc064a70 msgr2=0x7fdefc15a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:02.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.909+0000 7fdf028fa700 1 -- 172.21.15.1:0/505602704 shutdown_connections 2023-11-15T01:22:02.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:02.909+0000 7fdf028fa700 1 -- 172.21.15.1:0/505602704 wait complete. 2023-11-15T01:22:02.922 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T01:22:03.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.042+0000 7f17e3c93700 1 Processor -- start 2023-11-15T01:22:03.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.042+0000 7f17e3c93700 1 -- start start 2023-11-15T01:22:03.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.043+0000 7f17e3c93700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f17dc1540a0 0x7f17dc0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.043+0000 7f17e3c93700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f17dc0c6650 0x7f17dc0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.043+0000 7f17e3c93700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17dc0ca050 con 0x7f17dc154480 2023-11-15T01:22:03.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.043+0000 7f17e3c93700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17dc0c9440 con 0x7f17dc1540a0 2023-11-15T01:22:03.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.043+0000 7f17e3c93700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17dc0c9720 con 0x7f17dc0c6650 2023-11-15T01:22:03.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.043+0000 7f17e1a2f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f17dc1540a0 0x7f17dc0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.043+0000 7f17e1a2f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f17dc1540a0 0x7f17dc0ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44460/0 (socket says 172.21.15.1:44460) 2023-11-15T01:22:03.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.043+0000 7f17e1a2f700 1 -- 172.21.15.1:0/3638796289 learned_addr learned my addr 172.21.15.1:0/3638796289 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:03.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.043+0000 7f17e1a2f700 1 -- 172.21.15.1:0/3638796289 >> v2:172.21.15.141:3300/0 conn(0x7f17dc0c6650 msgr2=0x7f17dc0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:03.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.043+0000 7f17e2230700 1 --2- 172.21.15.1:0/3638796289 >> v2:172.21.15.141:3300/0 conn(0x7f17dc0c6650 0x7f17dc0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.043+0000 7f17e1a2f700 1 --2- 172.21.15.1:0/3638796289 >> v2:172.21.15.141:3300/0 conn(0x7f17dc0c6650 0x7f17dc0ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.043+0000 7f17e1a2f700 1 -- 172.21.15.1:0/3638796289 >> v1:172.21.15.141:6789/0 conn(0x7f17dc154480 legacy=0x7f17dc0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:03.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.043+0000 7f17e1a2f700 1 -- 172.21.15.1:0/3638796289 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc0c9a00 con 0x7f17dc1540a0 2023-11-15T01:22:03.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.043+0000 7f17e2230700 1 --2- 172.21.15.1:0/3638796289 >> v2:172.21.15.141:3300/0 conn(0x7f17dc0c6650 0x7f17dc0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:03.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.043+0000 7f17e1a2f700 1 --2- 172.21.15.1:0/3638796289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17dc1540a0 0x7f17dc0ca4e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f17dc084220 tx=0x7f17d80090f0).ready entity=mon.0 client_cookie=6c24ae6d07dde9ae server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:03.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.044+0000 7f17e0a2d700 1 -- 172.21.15.1:0/3638796289 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d800b5a0 con 0x7f17dc1540a0 2023-11-15T01:22:03.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.044+0000 7f17e0a2d700 1 -- 172.21.15.1:0/3638796289 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d800b700 con 0x7f17dc1540a0 2023-11-15T01:22:03.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.044+0000 7f17e0a2d700 1 -- 172.21.15.1:0/3638796289 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d800ba80 con 0x7f17dc1540a0 2023-11-15T01:22:03.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.044+0000 7f17e3c93700 1 -- 172.21.15.1:0/3638796289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17dc1540a0 msgr2=0x7f17dc0ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:03.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.044+0000 7f17e3c93700 1 --2- 172.21.15.1:0/3638796289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17dc1540a0 0x7f17dc0ca4e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f17dc084220 tx=0x7f17d80090f0).stop 2023-11-15T01:22:03.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.044+0000 7f17e3c93700 1 -- 172.21.15.1:0/3638796289 shutdown_connections 2023-11-15T01:22:03.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.044+0000 7f17e3c93700 1 --2- 172.21.15.1:0/3638796289 >> v2:172.21.15.141:3300/0 conn(0x7f17dc0c6650 0x7f17dc0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.044+0000 7f17e3c93700 1 --2- 172.21.15.1:0/3638796289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17dc1540a0 0x7f17dc0ca4e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.044+0000 7f17e3c93700 1 -- 172.21.15.1:0/3638796289 >> 172.21.15.1:0/3638796289 conn(0x7f17dc064a70 msgr2=0x7f17dc064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:03.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.044+0000 7f17e3c93700 1 -- 172.21.15.1:0/3638796289 shutdown_connections 2023-11-15T01:22:03.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.044+0000 7f17e3c93700 1 -- 172.21.15.1:0/3638796289 wait complete. 2023-11-15T01:22:03.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.045+0000 7f17e3c93700 1 Processor -- start 2023-11-15T01:22:03.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.045+0000 7f17e3c93700 1 -- start start 2023-11-15T01:22:03.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e3c93700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17dc0c6650 0x7f17dc0c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e3c93700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17dc1540a0 0x7f17dc14db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e3c93700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17dc154480 0x7f17dc0c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e3c93700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc14ed70 con 0x7f17dc1540a0 2023-11-15T01:22:03.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e3c93700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc14e480 con 0x7f17dc154480 2023-11-15T01:22:03.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e3c93700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc0c4e80 con 0x7f17dc0c6650 2023-11-15T01:22:03.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e122e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17dc1540a0 0x7f17dc14db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e122e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17dc1540a0 0x7f17dc14db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44474/0 (socket says 172.21.15.1:44474) 2023-11-15T01:22:03.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e122e700 1 -- 172.21.15.1:0/710062996 learned_addr learned my addr 172.21.15.1:0/710062996 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:03.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e1a2f700 1 --2- 172.21.15.1:0/710062996 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17dc0c6650 0x7f17dc0c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e2230700 1 --2- 172.21.15.1:0/710062996 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17dc154480 0x7f17dc0c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e122e700 1 -- 172.21.15.1:0/710062996 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17dc0c6650 msgr2=0x7f17dc0c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:03.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e122e700 1 --2- 172.21.15.1:0/710062996 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17dc0c6650 0x7f17dc0c2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e122e700 1 -- 172.21.15.1:0/710062996 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17dc154480 msgr2=0x7f17dc0c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:03.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e122e700 1 --2- 172.21.15.1:0/710062996 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17dc154480 0x7f17dc0c4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.046+0000 7f17e122e700 1 -- 172.21.15.1:0/710062996 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d8009370 con 0x7f17dc1540a0 2023-11-15T01:22:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.047+0000 7f17e122e700 1 --2- 172.21.15.1:0/710062996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17dc1540a0 0x7f17dc14db90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f17cc00b460 tx=0x7f17cc006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.047+0000 7f17d1ffb700 1 -- 172.21.15.1:0/710062996 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc012410 con 0x7f17dc1540a0 2023-11-15T01:22:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.047+0000 7f17d1ffb700 1 -- 172.21.15.1:0/710062996 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc012590 con 0x7f17dc1540a0 2023-11-15T01:22:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.047+0000 7f17e3c93700 1 -- 172.21.15.1:0/710062996 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17dc14e720 con 0x7f17dc1540a0 2023-11-15T01:22:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.047+0000 7f17d1ffb700 1 -- 172.21.15.1:0/710062996 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc012950 con 0x7f17dc1540a0 2023-11-15T01:22:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.047+0000 7f17e3c93700 1 -- 172.21.15.1:0/710062996 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17dc0c2660 con 0x7f17dc1540a0 2023-11-15T01:22:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.048+0000 7f17e3c93700 1 -- 172.21.15.1:0/710062996 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17dc06c7e0 con 0x7f17dc1540a0 2023-11-15T01:22:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.048+0000 7f17d1ffb700 1 -- 172.21.15.1:0/710062996 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f17cc012cc0 con 0x7f17dc1540a0 2023-11-15T01:22:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.049+0000 7f17d1ffb700 1 --2- 172.21.15.1:0/710062996 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f17c005f120 0x7f17c00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.049+0000 7f17d1ffb700 1 -- 172.21.15.1:0/710062996 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f17cc079ea0 con 0x7f17dc1540a0 2023-11-15T01:22:03.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.049+0000 7f17e1a2f700 1 --2- 172.21.15.1:0/710062996 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f17c005f120 0x7f17c00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.049+0000 7f17e1a2f700 1 --2- 172.21.15.1:0/710062996 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f17c005f120 0x7f17c00615e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f17d8009130 tx=0x7f17d8015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:03.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.053+0000 7f17d1ffb700 1 -- 172.21.15.1:0/710062996 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f17cc04b170 con 0x7f17dc1540a0 2023-11-15T01:22:03.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.224+0000 7f17e3c93700 1 -- 172.21.15.1:0/710062996 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17dc0c9ce0 con 0x7f17dc1540a0 2023-11-15T01:22:03.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.224+0000 7f17d1ffb700 1 -- 172.21.15.1:0/710062996 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f17cc04e790 con 0x7f17dc1540a0 2023-11-15T01:22:03.227 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:22:03.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.226+0000 7f17e3c93700 1 -- 172.21.15.1:0/710062996 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f17c005f120 msgr2=0x7f17c00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:03.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.226+0000 7f17e3c93700 1 --2- 172.21.15.1:0/710062996 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f17c005f120 0x7f17c00615e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f17d8009130 tx=0x7f17d8015000).stop 2023-11-15T01:22:03.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.226+0000 7f17e3c93700 1 -- 172.21.15.1:0/710062996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17dc1540a0 msgr2=0x7f17dc14db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:03.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.226+0000 7f17e3c93700 1 --2- 172.21.15.1:0/710062996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17dc1540a0 0x7f17dc14db90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f17cc00b460 tx=0x7f17cc006f20).stop 2023-11-15T01:22:03.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.227+0000 7f17e3c93700 1 -- 172.21.15.1:0/710062996 shutdown_connections 2023-11-15T01:22:03.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.227+0000 7f17e3c93700 1 --2- 172.21.15.1:0/710062996 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f17c005f120 0x7f17c00615e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.227+0000 7f17e3c93700 1 --2- 172.21.15.1:0/710062996 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17dc154480 0x7f17dc0c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.227+0000 7f17e3c93700 1 --2- 172.21.15.1:0/710062996 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17dc0c6650 0x7f17dc0c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.227+0000 7f17e3c93700 1 --2- 172.21.15.1:0/710062996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17dc1540a0 0x7f17dc14db90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.227+0000 7f17e3c93700 1 -- 172.21.15.1:0/710062996 >> 172.21.15.1:0/710062996 conn(0x7f17dc064a70 msgr2=0x7f17dc0abd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:03.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.227+0000 7f17e3c93700 1 -- 172.21.15.1:0/710062996 shutdown_connections 2023-11-15T01:22:03.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.227+0000 7f17e3c93700 1 -- 172.21.15.1:0/710062996 wait complete. 2023-11-15T01:22:03.240 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T01:22:03.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.359+0000 7ff491c5a700 1 Processor -- start 2023-11-15T01:22:03.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.359+0000 7ff491c5a700 1 -- start start 2023-11-15T01:22:03.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.360+0000 7ff491c5a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff48c1540a0 0x7ff48c0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.360+0000 7ff491c5a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff48c0c6650 0x7ff48c0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.360+0000 7ff491c5a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48c0ca050 con 0x7ff48c154480 2023-11-15T01:22:03.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.360+0000 7ff491c5a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48c0c9440 con 0x7ff48c1540a0 2023-11-15T01:22:03.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.360+0000 7ff491c5a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0c9720 con 0x7ff48c0c6650 2023-11-15T01:22:03.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.360+0000 7ff48b7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff48c1540a0 0x7ff48c0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.360+0000 7ff48b7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff48c1540a0 0x7ff48c0ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44484/0 (socket says 172.21.15.1:44484) 2023-11-15T01:22:03.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.360+0000 7ff48b7fe700 1 -- 172.21.15.1:0/2929710671 learned_addr learned my addr 172.21.15.1:0/2929710671 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:03.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.360+0000 7ff48bfff700 1 --2- 172.21.15.1:0/2929710671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff48c0c6650 0x7ff48c0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.360+0000 7ff48b7fe700 1 -- 172.21.15.1:0/2929710671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff48c0c6650 msgr2=0x7ff48c0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:03.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.360+0000 7ff48b7fe700 1 --2- 172.21.15.1:0/2929710671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff48c0c6650 0x7ff48c0ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.360+0000 7ff48b7fe700 1 -- 172.21.15.1:0/2929710671 >> v1:172.21.15.141:6789/0 conn(0x7ff48c154480 legacy=0x7ff48c0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:03.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.360+0000 7ff48b7fe700 1 -- 172.21.15.1:0/2929710671 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c0c9a00 con 0x7ff48c1540a0 2023-11-15T01:22:03.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.360+0000 7ff48bfff700 1 --2- 172.21.15.1:0/2929710671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff48c0c6650 0x7ff48c0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:03.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.361+0000 7ff48b7fe700 1 --2- 172.21.15.1:0/2929710671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c1540a0 0x7ff48c0ca4e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7ff47c006fd0 tx=0x7ff47c0090f0).ready entity=mon.0 client_cookie=c03059e4cbfd3f2d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:03.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.361+0000 7ff48a7fc700 1 -- 172.21.15.1:0/2929710671 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00b600 con 0x7ff48c1540a0 2023-11-15T01:22:03.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.361+0000 7ff48a7fc700 1 -- 172.21.15.1:0/2929710671 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c00b760 con 0x7ff48c1540a0 2023-11-15T01:22:03.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.361+0000 7ff48a7fc700 1 -- 172.21.15.1:0/2929710671 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00bae0 con 0x7ff48c1540a0 2023-11-15T01:22:03.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.361+0000 7ff491c5a700 1 -- 172.21.15.1:0/2929710671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c1540a0 msgr2=0x7ff48c0ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:03.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.361+0000 7ff491c5a700 1 --2- 172.21.15.1:0/2929710671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c1540a0 0x7ff48c0ca4e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7ff47c006fd0 tx=0x7ff47c0090f0).stop 2023-11-15T01:22:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.361+0000 7ff491c5a700 1 -- 172.21.15.1:0/2929710671 shutdown_connections 2023-11-15T01:22:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.361+0000 7ff491c5a700 1 --2- 172.21.15.1:0/2929710671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff48c0c6650 0x7ff48c0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.361+0000 7ff491c5a700 1 --2- 172.21.15.1:0/2929710671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c1540a0 0x7ff48c0ca4e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.361+0000 7ff491c5a700 1 -- 172.21.15.1:0/2929710671 >> 172.21.15.1:0/2929710671 conn(0x7ff48c064a70 msgr2=0x7ff48c064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:03.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.361+0000 7ff491c5a700 1 -- 172.21.15.1:0/2929710671 shutdown_connections 2023-11-15T01:22:03.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.361+0000 7ff491c5a700 1 -- 172.21.15.1:0/2929710671 wait complete. 2023-11-15T01:22:03.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.363+0000 7ff491c5a700 1 Processor -- start 2023-11-15T01:22:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.363+0000 7ff491c5a700 1 -- start start 2023-11-15T01:22:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.363+0000 7ff491c5a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c0c6650 0x7ff48c151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.363+0000 7ff491c5a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff48c1540a0 0x7ff48c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.363+0000 7ff491c5a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff48c154480 0x7ff48c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.363+0000 7ff491c5a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0cba90 con 0x7ff48c0c6650 2023-11-15T01:22:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.363+0000 7ff491c5a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0c4200 con 0x7ff48c1540a0 2023-11-15T01:22:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.363+0000 7ff491c5a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c158950 con 0x7ff48c154480 2023-11-15T01:22:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.363+0000 7ff48b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c0c6650 0x7ff48c151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.363+0000 7ff48b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c0c6650 0x7ff48c151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44490/0 (socket says 172.21.15.1:44490) 2023-11-15T01:22:03.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.363+0000 7ff48b7fe700 1 -- 172.21.15.1:0/2598336540 learned_addr learned my addr 172.21.15.1:0/2598336540 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:03.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.364+0000 7ff48bfff700 1 --2- 172.21.15.1:0/2598336540 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff48c154480 0x7ff48c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.364+0000 7ff48affd700 1 --2- 172.21.15.1:0/2598336540 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff48c1540a0 0x7ff48c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.364+0000 7ff48b7fe700 1 -- 172.21.15.1:0/2598336540 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff48c154480 msgr2=0x7ff48c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:03.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.364+0000 7ff48b7fe700 1 --2- 172.21.15.1:0/2598336540 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff48c154480 0x7ff48c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.364+0000 7ff48b7fe700 1 -- 172.21.15.1:0/2598336540 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff48c1540a0 msgr2=0x7ff48c0cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.364+0000 7ff48b7fe700 1 --2- 172.21.15.1:0/2598336540 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff48c1540a0 0x7ff48c0cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.364+0000 7ff48b7fe700 1 -- 172.21.15.1:0/2598336540 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c009370 con 0x7ff48c0c6650 2023-11-15T01:22:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.364+0000 7ff48b7fe700 1 --2- 172.21.15.1:0/2598336540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c0c6650 0x7ff48c151160 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7ff47c009f50 tx=0x7ff47c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.364+0000 7ff4737fe700 1 -- 172.21.15.1:0/2598336540 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00bae0 con 0x7ff48c0c6650 2023-11-15T01:22:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.364+0000 7ff4737fe700 1 -- 172.21.15.1:0/2598336540 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c000c90 con 0x7ff48c0c6650 2023-11-15T01:22:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.364+0000 7ff491c5a700 1 -- 172.21.15.1:0/2598336540 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48c151650 con 0x7ff48c0c6650 2023-11-15T01:22:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.364+0000 7ff4737fe700 1 -- 172.21.15.1:0/2598336540 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c01c670 con 0x7ff48c0c6650 2023-11-15T01:22:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.364+0000 7ff491c5a700 1 -- 172.21.15.1:0/2598336540 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48c158340 con 0x7ff48c0c6650 2023-11-15T01:22:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.365+0000 7ff491c5a700 1 -- 172.21.15.1:0/2598336540 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48c06c7e0 con 0x7ff48c0c6650 2023-11-15T01:22:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.365+0000 7ff4737fe700 1 -- 172.21.15.1:0/2598336540 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff47c01c9e0 con 0x7ff48c0c6650 2023-11-15T01:22:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.366+0000 7ff4737fe700 1 --2- 172.21.15.1:0/2598336540 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff47805f150 0x7ff478061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.366+0000 7ff4737fe700 1 -- 172.21.15.1:0/2598336540 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff47c07c010 con 0x7ff48c0c6650 2023-11-15T01:22:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.366+0000 7ff48affd700 1 --2- 172.21.15.1:0/2598336540 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff47805f150 0x7ff478061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.366+0000 7ff48affd700 1 --2- 172.21.15.1:0/2598336540 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff47805f150 0x7ff478061610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7ff48c0cbda0 tx=0x7ff480008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.370+0000 7ff4737fe700 1 -- 172.21.15.1:0/2598336540 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff47c04d380 con 0x7ff48c0c6650 2023-11-15T01:22:03.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.543+0000 7ff491c5a700 1 -- 172.21.15.1:0/2598336540 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff48c0c9ce0 con 0x7ff48c0c6650 2023-11-15T01:22:03.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.544+0000 7ff4737fe700 1 -- 172.21.15.1:0/2598336540 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff47c02a030 con 0x7ff48c0c6650 2023-11-15T01:22:03.546 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:22:03.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.545+0000 7ff491c5a700 1 -- 172.21.15.1:0/2598336540 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff47805f150 msgr2=0x7ff478061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:03.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.545+0000 7ff491c5a700 1 --2- 172.21.15.1:0/2598336540 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff47805f150 0x7ff478061610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7ff48c0cbda0 tx=0x7ff480008040).stop 2023-11-15T01:22:03.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.545+0000 7ff491c5a700 1 -- 172.21.15.1:0/2598336540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c0c6650 msgr2=0x7ff48c151160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:03.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.545+0000 7ff491c5a700 1 --2- 172.21.15.1:0/2598336540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c0c6650 0x7ff48c151160 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7ff47c009f50 tx=0x7ff47c017000).stop 2023-11-15T01:22:03.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.545+0000 7ff491c5a700 1 -- 172.21.15.1:0/2598336540 shutdown_connections 2023-11-15T01:22:03.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.545+0000 7ff491c5a700 1 --2- 172.21.15.1:0/2598336540 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff47805f150 0x7ff478061610 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.545+0000 7ff491c5a700 1 --2- 172.21.15.1:0/2598336540 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff48c154480 0x7ff48c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.545+0000 7ff491c5a700 1 --2- 172.21.15.1:0/2598336540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c0c6650 0x7ff48c151160 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.545+0000 7ff491c5a700 1 --2- 172.21.15.1:0/2598336540 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff48c1540a0 0x7ff48c0cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.545+0000 7ff491c5a700 1 -- 172.21.15.1:0/2598336540 >> 172.21.15.1:0/2598336540 conn(0x7ff48c064a70 msgr2=0x7ff48c064e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.545+0000 7ff491c5a700 1 -- 172.21.15.1:0/2598336540 shutdown_connections 2023-11-15T01:22:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.545+0000 7ff491c5a700 1 -- 172.21.15.1:0/2598336540 wait complete. 2023-11-15T01:22:03.559 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:22:03.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.675+0000 7f1c2977f700 1 Processor -- start 2023-11-15T01:22:03.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.675+0000 7f1c2977f700 1 -- start start 2023-11-15T01:22:03.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.676+0000 7f1c2977f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1c240c50b0 0x7f1c240c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.676+0000 7f1c2977f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1c24157d00 0x7f1c240c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.676+0000 7f1c2977f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c240bc360 0x7f1c240c1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.676+0000 7f1c2977f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c240633c0 con 0x7f1c240c50b0 2023-11-15T01:22:03.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.676+0000 7f1c2977f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c240627b0 con 0x7f1c24157d00 2023-11-15T01:22:03.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.676+0000 7f1c2977f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24062a90 con 0x7f1c240bc360 2023-11-15T01:22:03.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.676+0000 7f1c22ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1c240c50b0 0x7f1c240c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.676+0000 7f1c22ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1c240c50b0 0x7f1c240c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44502/0 (socket says 172.21.15.1:44502) 2023-11-15T01:22:03.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.676+0000 7f1c22ffd700 1 -- 172.21.15.1:0/400244113 learned_addr learned my addr 172.21.15.1:0/400244113 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:03.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.677+0000 7f1c227fc700 1 --2- 172.21.15.1:0/400244113 >> v2:172.21.15.141:3300/0 conn(0x7f1c24157d00 0x7f1c240c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.677+0000 7f1c237fe700 1 --2- 172.21.15.1:0/400244113 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c240bc360 0x7f1c240c1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.677+0000 7f1c22ffd700 1 -- 172.21.15.1:0/400244113 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c240bc360 msgr2=0x7f1c240c1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:03.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.677+0000 7f1c22ffd700 1 --2- 172.21.15.1:0/400244113 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c240bc360 0x7f1c240c1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.677+0000 7f1c22ffd700 1 -- 172.21.15.1:0/400244113 >> v2:172.21.15.141:3300/0 conn(0x7f1c24157d00 msgr2=0x7f1c240c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:03.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.677+0000 7f1c22ffd700 1 --2- 172.21.15.1:0/400244113 >> v2:172.21.15.141:3300/0 conn(0x7f1c24157d00 0x7f1c240c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.677+0000 7f1c22ffd700 1 -- 172.21.15.1:0/400244113 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24062d70 con 0x7f1c240c50b0 2023-11-15T01:22:03.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.677+0000 7f1c22ffd700 1 --2- 172.21.15.1:0/400244113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c240c50b0 0x7f1c240c6e00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f1c24158e30 tx=0x7f1c1c0090f0).ready entity=mon.0 client_cookie=191717fa11f237a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:03.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.677+0000 7f1c21ffb700 1 -- 172.21.15.1:0/400244113 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c00b600 con 0x7f1c240c50b0 2023-11-15T01:22:03.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.677+0000 7f1c21ffb700 1 -- 172.21.15.1:0/400244113 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c00b760 con 0x7f1c240c50b0 2023-11-15T01:22:03.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.677+0000 7f1c21ffb700 1 -- 172.21.15.1:0/400244113 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c00bae0 con 0x7f1c240c50b0 2023-11-15T01:22:03.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.677+0000 7f1c2977f700 1 -- 172.21.15.1:0/400244113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c240c50b0 msgr2=0x7f1c240c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:03.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.677+0000 7f1c2977f700 1 --2- 172.21.15.1:0/400244113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c240c50b0 0x7f1c240c6e00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f1c24158e30 tx=0x7f1c1c0090f0).stop 2023-11-15T01:22:03.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.677+0000 7f1c2977f700 1 -- 172.21.15.1:0/400244113 shutdown_connections 2023-11-15T01:22:03.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.677+0000 7f1c2977f700 1 --2- 172.21.15.1:0/400244113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c240c50b0 0x7f1c240c6e00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.678+0000 7f1c2977f700 1 --2- 172.21.15.1:0/400244113 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c240bc360 0x7f1c240c1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.678+0000 7f1c2977f700 1 --2- 172.21.15.1:0/400244113 >> v2:172.21.15.141:3300/0 conn(0x7f1c24157d00 0x7f1c240c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.678+0000 7f1c2977f700 1 -- 172.21.15.1:0/400244113 >> 172.21.15.1:0/400244113 conn(0x7f1c240c3e30 msgr2=0x7f1c240c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:03.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.678+0000 7f1c2977f700 1 -- 172.21.15.1:0/400244113 shutdown_connections 2023-11-15T01:22:03.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.678+0000 7f1c2977f700 1 -- 172.21.15.1:0/400244113 wait complete. 2023-11-15T01:22:03.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.679+0000 7f1c2977f700 1 Processor -- start 2023-11-15T01:22:03.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.679+0000 7f1c2977f700 1 -- start start 2023-11-15T01:22:03.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c2977f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c240bc360 0x7f1c240c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c2977f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c240c50b0 0x7f1c240bf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c2977f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c24157d00 0x7f1c24144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c2977f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240c1400 con 0x7f1c240bc360 2023-11-15T01:22:03.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c2977f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240bf8f0 con 0x7f1c24157d00 2023-11-15T01:22:03.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c2977f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240c03a0 con 0x7f1c240c50b0 2023-11-15T01:22:03.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c22ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c240bc360 0x7f1c240c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c22ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c240bc360 0x7f1c240c0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44508/0 (socket says 172.21.15.1:44508) 2023-11-15T01:22:03.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c22ffd700 1 -- 172.21.15.1:0/2538333569 learned_addr learned my addr 172.21.15.1:0/2538333569 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:03.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c237fe700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c24157d00 0x7f1c24144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c227fc700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c240c50b0 0x7f1c240bf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c22ffd700 1 -- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c240c50b0 msgr2=0x7f1c240bf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:03.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c22ffd700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c240c50b0 0x7f1c240bf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c22ffd700 1 -- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c24157d00 msgr2=0x7f1c24144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:03.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c22ffd700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c24157d00 0x7f1c24144ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c22ffd700 1 -- 172.21.15.1:0/2538333569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c009370 con 0x7f1c240bc360 2023-11-15T01:22:03.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c237fe700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c24157d00 0x7f1c24144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:03.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c227fc700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c240c50b0 0x7f1c240bf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:03.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c22ffd700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c240bc360 0x7f1c240c0f10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f1c1c009130 tx=0x7f1c1c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:03.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c1affd700 1 -- 172.21.15.1:0/2538333569 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c00b8d0 con 0x7f1c240bc360 2023-11-15T01:22:03.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c1affd700 1 -- 172.21.15.1:0/2538333569 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c00ba50 con 0x7f1c240bc360 2023-11-15T01:22:03.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c2977f700 1 -- 172.21.15.1:0/2538333569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c240bfb00 con 0x7f1c240bc360 2023-11-15T01:22:03.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c1affd700 1 -- 172.21.15.1:0/2538333569 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c01c670 con 0x7f1c240bc360 2023-11-15T01:22:03.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.680+0000 7f1c2977f700 1 -- 172.21.15.1:0/2538333569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c240c00c0 con 0x7f1c240bc360 2023-11-15T01:22:03.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.681+0000 7f1c2977f700 1 -- 172.21.15.1:0/2538333569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c240475e0 con 0x7f1c240bc360 2023-11-15T01:22:03.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.682+0000 7f1c1affd700 1 -- 172.21.15.1:0/2538333569 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1c1c01c9e0 con 0x7f1c240bc360 2023-11-15T01:22:03.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.682+0000 7f1c1affd700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1c0405f150 0x7f1c04061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:03.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.682+0000 7f1c1affd700 1 -- 172.21.15.1:0/2538333569 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1c1c07bed0 con 0x7f1c240bc360 2023-11-15T01:22:03.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.682+0000 7f1c227fc700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1c0405f150 0x7f1c04061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:03.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.683+0000 7f1c227fc700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1c0405f150 0x7f1c04061610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f1c24069dc0 tx=0x7f1c0c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:03.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.686+0000 7f1c1affd700 1 -- 172.21.15.1:0/2538333569 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1c1c04d1a0 con 0x7f1c240bc360 2023-11-15T01:22:03.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.860+0000 7f1c2977f700 1 -- 172.21.15.1:0/2538333569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c24063050 con 0x7f1c240bc360 2023-11-15T01:22:03.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.860+0000 7f1c1affd700 1 -- 172.21.15.1:0/2538333569 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16880 (secure 0 0 0) 0x7f1c1c02a070 con 0x7f1c240bc360 2023-11-15T01:22:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:03.863 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:38.047484+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:21:34.763591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-15T01:21:36.025071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:22:03.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.862+0000 7f1c2977f700 1 -- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1c0405f150 msgr2=0x7f1c04061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:03.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.862+0000 7f1c2977f700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1c0405f150 0x7f1c04061610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f1c24069dc0 tx=0x7f1c0c008040).stop 2023-11-15T01:22:03.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.862+0000 7f1c2977f700 1 -- 172.21.15.1:0/2538333569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c240bc360 msgr2=0x7f1c240c0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:03.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.862+0000 7f1c2977f700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c240bc360 0x7f1c240c0f10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f1c1c009130 tx=0x7f1c1c017000).stop 2023-11-15T01:22:03.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.862+0000 7f1c2977f700 1 -- 172.21.15.1:0/2538333569 shutdown_connections 2023-11-15T01:22:03.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.862+0000 7f1c2977f700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1c0405f150 0x7f1c04061610 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.862+0000 7f1c2977f700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c24157d00 0x7f1c24144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.862+0000 7f1c2977f700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c240bc360 0x7f1c240c0f10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.862+0000 7f1c2977f700 1 --2- 172.21.15.1:0/2538333569 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c240c50b0 0x7f1c240bf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:03.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.862+0000 7f1c2977f700 1 -- 172.21.15.1:0/2538333569 >> 172.21.15.1:0/2538333569 conn(0x7f1c240c3e30 msgr2=0x7f1c24063850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:03.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.862+0000 7f1c2977f700 1 -- 172.21.15.1:0/2538333569 shutdown_connections 2023-11-15T01:22:03.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.862+0000 7f1c2977f700 1 -- 172.21.15.1:0/2538333569 wait complete. 2023-11-15T01:22:03.876 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T01:21:34.763591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T01:21:36.025071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T01:22:03.877 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:22:03.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.996+0000 7f0056d08700 1 Processor -- start 2023-11-15T01:22:03.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.996+0000 7f0056d08700 1 -- start start 2023-11-15T01:22:04.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.997+0000 7f0056d08700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f005014e6e0 0x7f005014eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.997+0000 7f0056d08700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0050155370 0x7f00500627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.997+0000 7f0056d08700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0050158e40 con 0x7f0050062ca0 2023-11-15T01:22:04.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.997+0000 7f0056d08700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0050158230 con 0x7f005014e6e0 2023-11-15T01:22:04.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.997+0000 7f0056d08700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0050158510 con 0x7f0050155370 2023-11-15T01:22:04.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.997+0000 7f0054aa4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f005014e6e0 0x7f005014eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.997+0000 7f0054aa4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f005014e6e0 0x7f005014eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44516/0 (socket says 172.21.15.1:44516) 2023-11-15T01:22:04.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.997+0000 7f0054aa4700 1 -- 172.21.15.1:0/2086284357 learned_addr learned my addr 172.21.15.1:0/2086284357 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:04.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.998+0000 7f004ffff700 1 --2- 172.21.15.1:0/2086284357 >> v2:172.21.15.141:3300/0 conn(0x7f0050155370 0x7f00500627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.998+0000 7f0054aa4700 1 -- 172.21.15.1:0/2086284357 >> v2:172.21.15.141:3300/0 conn(0x7f0050155370 msgr2=0x7f00500627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:04.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.998+0000 7f0054aa4700 1 --2- 172.21.15.1:0/2086284357 >> v2:172.21.15.141:3300/0 conn(0x7f0050155370 0x7f00500627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.998+0000 7f0054aa4700 1 -- 172.21.15.1:0/2086284357 >> v1:172.21.15.141:6789/0 conn(0x7f0050062ca0 legacy=0x7f0050069610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.998+0000 7f0054aa4700 1 -- 172.21.15.1:0/2086284357 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00501587f0 con 0x7f005014e6e0 2023-11-15T01:22:04.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.998+0000 7f0054aa4700 1 --2- 172.21.15.1:0/2086284357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f005014e6e0 0x7f005014eac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f00500c5d20 tx=0x7f0048009840).ready entity=mon.0 client_cookie=8c9fce386cbae19f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:04.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.998+0000 7f004f7fe700 1 -- 172.21.15.1:0/2086284357 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004800e070 con 0x7f005014e6e0 2023-11-15T01:22:04.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.998+0000 7f004f7fe700 1 -- 172.21.15.1:0/2086284357 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004800ba20 con 0x7f005014e6e0 2023-11-15T01:22:04.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.998+0000 7f004f7fe700 1 -- 172.21.15.1:0/2086284357 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004800bda0 con 0x7f005014e6e0 2023-11-15T01:22:04.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.999+0000 7f0056d08700 1 -- 172.21.15.1:0/2086284357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f005014e6e0 msgr2=0x7f005014eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.999+0000 7f0056d08700 1 --2- 172.21.15.1:0/2086284357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f005014e6e0 0x7f005014eac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f00500c5d20 tx=0x7f0048009840).stop 2023-11-15T01:22:04.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.999+0000 7f0056d08700 1 -- 172.21.15.1:0/2086284357 shutdown_connections 2023-11-15T01:22:04.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.999+0000 7f0056d08700 1 --2- 172.21.15.1:0/2086284357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f005014e6e0 0x7f005014eac0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.999+0000 7f0056d08700 1 --2- 172.21.15.1:0/2086284357 >> v2:172.21.15.141:3300/0 conn(0x7f0050155370 0x7f00500627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.999+0000 7f0056d08700 1 -- 172.21.15.1:0/2086284357 >> 172.21.15.1:0/2086284357 conn(0x7f00500c7dc0 msgr2=0x7f00500c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:04.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.999+0000 7f0056d08700 1 -- 172.21.15.1:0/2086284357 shutdown_connections 2023-11-15T01:22:04.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:03.999+0000 7f0056d08700 1 -- 172.21.15.1:0/2086284357 wait complete. 2023-11-15T01:22:04.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.000+0000 7f0056d08700 1 Processor -- start 2023-11-15T01:22:04.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.000+0000 7f0056d08700 1 -- start start 2023-11-15T01:22:04.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f0056d08700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0050062ca0 0x7f005013d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f0056d08700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f005014e6e0 0x7f00500bee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f0056d08700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0050155370 0x7f00500a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f0056d08700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0050131040 con 0x7f0050155370 2023-11-15T01:22:04.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f0056d08700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00500c0b20 con 0x7f0050062ca0 2023-11-15T01:22:04.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f0056d08700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00500c0e00 con 0x7f005014e6e0 2023-11-15T01:22:04.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f00552a5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0050155370 0x7f00500a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f0054aa4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0050062ca0 0x7f005013d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f00552a5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0050155370 0x7f00500a6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44530/0 (socket says 172.21.15.1:44530) 2023-11-15T01:22:04.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f00552a5700 1 -- 172.21.15.1:0/1062202885 learned_addr learned my addr 172.21.15.1:0/1062202885 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:04.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f004ffff700 1 --2- 172.21.15.1:0/1062202885 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f005014e6e0 0x7f00500bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f00552a5700 1 -- 172.21.15.1:0/1062202885 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f005014e6e0 msgr2=0x7f00500bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f00552a5700 1 --2- 172.21.15.1:0/1062202885 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f005014e6e0 0x7f00500bee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f00552a5700 1 -- 172.21.15.1:0/1062202885 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0050062ca0 msgr2=0x7f005013d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f00552a5700 1 --2- 172.21.15.1:0/1062202885 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0050062ca0 0x7f005013d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f00552a5700 1 -- 172.21.15.1:0/1062202885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0048009ae0 con 0x7f0050155370 2023-11-15T01:22:04.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f00552a5700 1 --2- 172.21.15.1:0/1062202885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0050155370 0x7f00500a6a40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f003800c440 tx=0x7f0038007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:04.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f004cff9700 1 -- 172.21.15.1:0/1062202885 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00380123f0 con 0x7f0050155370 2023-11-15T01:22:04.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f004cff9700 1 -- 172.21.15.1:0/1062202885 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0038001e90 con 0x7f0050155370 2023-11-15T01:22:04.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f0056d08700 1 -- 172.21.15.1:0/1062202885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00500c10e0 con 0x7f0050155370 2023-11-15T01:22:04.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.001+0000 7f004cff9700 1 -- 172.21.15.1:0/1062202885 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038012760 con 0x7f0050155370 2023-11-15T01:22:04.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.002+0000 7f0056d08700 1 -- 172.21.15.1:0/1062202885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00500c13c0 con 0x7f0050155370 2023-11-15T01:22:04.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.003+0000 7f0056d08700 1 -- 172.21.15.1:0/1062202885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00500c0c60 con 0x7f0050155370 2023-11-15T01:22:04.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.003+0000 7f004cff9700 1 -- 172.21.15.1:0/1062202885 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0038012b50 con 0x7f0050155370 2023-11-15T01:22:04.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.003+0000 7f004cff9700 1 --2- 172.21.15.1:0/1062202885 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f003005f150 0x7f0030061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.003+0000 7f004cff9700 1 -- 172.21.15.1:0/1062202885 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f00380794d0 con 0x7f0050155370 2023-11-15T01:22:04.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.003+0000 7f0054aa4700 1 --2- 172.21.15.1:0/1062202885 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f003005f150 0x7f0030061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.004+0000 7f0054aa4700 1 --2- 172.21.15.1:0/1062202885 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f003005f150 0x7f0030061610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f005013a0b0 tx=0x7f00501548f0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:04.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.007+0000 7f004cff9700 1 -- 172.21.15.1:0/1062202885 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0038047af0 con 0x7f0050155370 2023-11-15T01:22:04.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.179+0000 7f0056d08700 1 -- 172.21.15.1:0/1062202885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f005006c7e0 con 0x7f0050155370 2023-11-15T01:22:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.179+0000 7f004cff9700 1 -- 172.21.15.1:0/1062202885 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f00500c0c60 con 0x7f0050155370 2023-11-15T01:22:04.181 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:22:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.181+0000 7f0056d08700 1 -- 172.21.15.1:0/1062202885 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f003005f150 msgr2=0x7f0030061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.181+0000 7f0056d08700 1 --2- 172.21.15.1:0/1062202885 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f003005f150 0x7f0030061610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f005013a0b0 tx=0x7f00501548f0).stop 2023-11-15T01:22:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.181+0000 7f0056d08700 1 -- 172.21.15.1:0/1062202885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0050155370 msgr2=0x7f00500a6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.181+0000 7f0056d08700 1 --2- 172.21.15.1:0/1062202885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0050155370 0x7f00500a6a40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f003800c440 tx=0x7f0038007d70).stop 2023-11-15T01:22:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.181+0000 7f0056d08700 1 -- 172.21.15.1:0/1062202885 shutdown_connections 2023-11-15T01:22:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.181+0000 7f0056d08700 1 --2- 172.21.15.1:0/1062202885 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f003005f150 0x7f0030061610 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.181+0000 7f0056d08700 1 --2- 172.21.15.1:0/1062202885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0050155370 0x7f00500a6a40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.181+0000 7f0056d08700 1 --2- 172.21.15.1:0/1062202885 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0050062ca0 0x7f005013d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.181+0000 7f0056d08700 1 --2- 172.21.15.1:0/1062202885 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f005014e6e0 0x7f00500bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.181+0000 7f0056d08700 1 -- 172.21.15.1:0/1062202885 >> 172.21.15.1:0/1062202885 conn(0x7f00500c7dc0 msgr2=0x7f00500c76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:04.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.181+0000 7f0056d08700 1 -- 172.21.15.1:0/1062202885 shutdown_connections 2023-11-15T01:22:04.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.181+0000 7f0056d08700 1 -- 172.21.15.1:0/1062202885 wait complete. 2023-11-15T01:22:04.194 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:22:04.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.313+0000 7fed2843a700 1 Processor -- start 2023-11-15T01:22:04.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.313+0000 7fed2843a700 1 -- start start 2023-11-15T01:22:04.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.314+0000 7fed2843a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed20062ec0 0x7fed2014eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.314+0000 7fed2843a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fed20155370 0x7fed200c6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.314+0000 7fed2843a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed20158e40 con 0x7fed2014e6e0 2023-11-15T01:22:04.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.314+0000 7fed2843a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed20158230 con 0x7fed20155370 2023-11-15T01:22:04.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.314+0000 7fed2843a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed20158510 con 0x7fed20062ec0 2023-11-15T01:22:04.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.315+0000 7fed261d6700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fed2014e6e0 0x7fed200627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34158/0 (socket says 172.21.15.1:34158) 2023-11-15T01:22:04.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.315+0000 7fed261d6700 1 -- 172.21.15.1:0/2794073676 learned_addr learned my addr 172.21.15.1:0/2794073676 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:04.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.315+0000 7fed259d5700 1 --2- 172.21.15.1:0/2794073676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed20062ec0 0x7fed2014eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.315+0000 7fed269d7700 1 --2- 172.21.15.1:0/2794073676 >> v2:172.21.15.141:3300/0 conn(0x7fed20155370 0x7fed200c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.315+0000 7fed251d4700 1 -- 172.21.15.1:0/2794073676 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906566827 0 0) 0x7fed20158e40 con 0x7fed2014e6e0 2023-11-15T01:22:04.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.315+0000 7fed251d4700 1 -- 172.21.15.1:0/2794073676 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed080033f0 con 0x7fed2014e6e0 2023-11-15T01:22:04.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.315+0000 7fed269d7700 1 -- 172.21.15.1:0/2794073676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed20062ec0 msgr2=0x7fed2014eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:04.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.315+0000 7fed269d7700 1 --2- 172.21.15.1:0/2794073676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed20062ec0 0x7fed2014eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.315+0000 7fed269d7700 1 -- 172.21.15.1:0/2794073676 >> v1:172.21.15.1:6789/0 conn(0x7fed2014e6e0 legacy=0x7fed200627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.315+0000 7fed251d4700 1 -- 172.21.15.1:0/2794073676 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1329778271 0 0) 0x7fed080033f0 con 0x7fed2014e6e0 2023-11-15T01:22:04.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.315+0000 7fed269d7700 1 -- 172.21.15.1:0/2794073676 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed201587f0 con 0x7fed20155370 2023-11-15T01:22:04.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.315+0000 7fed269d7700 1 --2- 172.21.15.1:0/2794073676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed20155370 0x7fed200c6480 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fed10009e60 tx=0x7fed10009780).ready entity=mon.1 client_cookie=43b92abdd4669f57 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:04.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.315+0000 7fed251d4700 1 -- 172.21.15.1:0/2794073676 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1000e070 con 0x7fed20155370 2023-11-15T01:22:04.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.315+0000 7fed251d4700 1 -- 172.21.15.1:0/2794073676 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1000b7a0 con 0x7fed20155370 2023-11-15T01:22:04.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.315+0000 7fed251d4700 1 -- 172.21.15.1:0/2794073676 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed18001470 con 0x7fed20155370 2023-11-15T01:22:04.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.316+0000 7fed2843a700 1 -- 172.21.15.1:0/2794073676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed20155370 msgr2=0x7fed200c6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.316+0000 7fed2843a700 1 --2- 172.21.15.1:0/2794073676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed20155370 0x7fed200c6480 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fed10009e60 tx=0x7fed10009780).stop 2023-11-15T01:22:04.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.316+0000 7fed2843a700 1 -- 172.21.15.1:0/2794073676 shutdown_connections 2023-11-15T01:22:04.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.316+0000 7fed2843a700 1 --2- 172.21.15.1:0/2794073676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed20155370 0x7fed200c6480 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.316+0000 7fed2843a700 1 --2- 172.21.15.1:0/2794073676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed20062ec0 0x7fed2014eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.316+0000 7fed2843a700 1 -- 172.21.15.1:0/2794073676 >> 172.21.15.1:0/2794073676 conn(0x7fed200c7dc0 msgr2=0x7fed200c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:04.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.316+0000 7fed2843a700 1 -- 172.21.15.1:0/2794073676 shutdown_connections 2023-11-15T01:22:04.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.316+0000 7fed2843a700 1 -- 172.21.15.1:0/2794073676 wait complete. 2023-11-15T01:22:04.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.317+0000 7fed2843a700 1 Processor -- start 2023-11-15T01:22:04.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.317+0000 7fed2843a700 1 -- start start 2023-11-15T01:22:04.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed2843a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed20062ec0 0x7fed200a7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed2843a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed2014e6e0 0x7fed200a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed2843a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed20155370 0x7fed200a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed2843a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed200a6150 con 0x7fed20062ec0 2023-11-15T01:22:04.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed2843a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed200a5250 con 0x7fed20155370 2023-11-15T01:22:04.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed2843a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed201570c0 con 0x7fed2014e6e0 2023-11-15T01:22:04.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed261d6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed20062ec0 0x7fed200a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed261d6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed20062ec0 0x7fed200a7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44546/0 (socket says 172.21.15.1:44546) 2023-11-15T01:22:04.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed261d6700 1 -- 172.21.15.1:0/3986934495 learned_addr learned my addr 172.21.15.1:0/3986934495 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:04.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed259d5700 1 --2- 172.21.15.1:0/3986934495 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed2014e6e0 0x7fed200a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed269d7700 1 --2- 172.21.15.1:0/3986934495 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed20155370 0x7fed200a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed261d6700 1 -- 172.21.15.1:0/3986934495 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed2014e6e0 msgr2=0x7fed200a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed261d6700 1 --2- 172.21.15.1:0/3986934495 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed2014e6e0 0x7fed200a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed261d6700 1 -- 172.21.15.1:0/3986934495 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed20155370 msgr2=0x7fed200a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed261d6700 1 --2- 172.21.15.1:0/3986934495 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed20155370 0x7fed200a4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed261d6700 1 -- 172.21.15.1:0/3986934495 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10009a20 con 0x7fed20062ec0 2023-11-15T01:22:04.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.318+0000 7fed259d5700 1 --2- 172.21.15.1:0/3986934495 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed2014e6e0 0x7fed200a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:04.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.319+0000 7fed261d6700 1 --2- 172.21.15.1:0/3986934495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed20062ec0 0x7fed200a7130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fed1800c840 tx=0x7fed18001aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:04.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.319+0000 7fed1e7fc700 1 -- 172.21.15.1:0/3986934495 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed18007170 con 0x7fed20062ec0 2023-11-15T01:22:04.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.319+0000 7fed1e7fc700 1 -- 172.21.15.1:0/3986934495 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed180072d0 con 0x7fed20062ec0 2023-11-15T01:22:04.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.319+0000 7fed1e7fc700 1 -- 172.21.15.1:0/3986934495 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed180048c0 con 0x7fed20062ec0 2023-11-15T01:22:04.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.319+0000 7fed2843a700 1 -- 172.21.15.1:0/3986934495 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed201564b0 con 0x7fed20062ec0 2023-11-15T01:22:04.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.319+0000 7fed2843a700 1 -- 172.21.15.1:0/3986934495 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed20156a70 con 0x7fed20062ec0 2023-11-15T01:22:04.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.320+0000 7fed2843a700 1 -- 172.21.15.1:0/3986934495 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed201573a0 con 0x7fed20062ec0 2023-11-15T01:22:04.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.320+0000 7fed1e7fc700 1 -- 172.21.15.1:0/3986934495 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fed18004c70 con 0x7fed20062ec0 2023-11-15T01:22:04.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.320+0000 7fed1e7fc700 1 --2- 172.21.15.1:0/3986934495 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed0c05f150 0x7fed0c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.321+0000 7fed1e7fc700 1 -- 172.21.15.1:0/3986934495 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fed18079c40 con 0x7fed20062ec0 2023-11-15T01:22:04.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.321+0000 7fed259d5700 1 --2- 172.21.15.1:0/3986934495 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed0c05f150 0x7fed0c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.321+0000 7fed259d5700 1 --2- 172.21.15.1:0/3986934495 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed0c05f150 0x7fed0c061610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fed200aa760 tx=0x7fed14008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:04.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.325+0000 7fed1e7fc700 1 -- 172.21.15.1:0/3986934495 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fed1804af10 con 0x7fed20062ec0 2023-11-15T01:22:04.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.495+0000 7fed2843a700 1 -- 172.21.15.1:0/3986934495 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fed2006c7e0 con 0x7fed20062ec0 2023-11-15T01:22:04.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.496+0000 7fed1e7fc700 1 -- 172.21.15.1:0/3986934495 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fed1804e530 con 0x7fed20062ec0 2023-11-15T01:22:04.498 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:22:04.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.497+0000 7fed2843a700 1 -- 172.21.15.1:0/3986934495 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed0c05f150 msgr2=0x7fed0c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.497+0000 7fed2843a700 1 --2- 172.21.15.1:0/3986934495 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed0c05f150 0x7fed0c061610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fed200aa760 tx=0x7fed14008040).stop 2023-11-15T01:22:04.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.497+0000 7fed2843a700 1 -- 172.21.15.1:0/3986934495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed20062ec0 msgr2=0x7fed200a7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.497+0000 7fed2843a700 1 --2- 172.21.15.1:0/3986934495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed20062ec0 0x7fed200a7130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fed1800c840 tx=0x7fed18001aa0).stop 2023-11-15T01:22:04.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.497+0000 7fed2843a700 1 -- 172.21.15.1:0/3986934495 shutdown_connections 2023-11-15T01:22:04.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.497+0000 7fed2843a700 1 --2- 172.21.15.1:0/3986934495 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed0c05f150 0x7fed0c061610 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.497+0000 7fed2843a700 1 --2- 172.21.15.1:0/3986934495 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed20155370 0x7fed200a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.497+0000 7fed2843a700 1 --2- 172.21.15.1:0/3986934495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed20062ec0 0x7fed200a7130 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.497+0000 7fed2843a700 1 --2- 172.21.15.1:0/3986934495 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed2014e6e0 0x7fed200a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.497+0000 7fed2843a700 1 -- 172.21.15.1:0/3986934495 >> 172.21.15.1:0/3986934495 conn(0x7fed200c7dc0 msgr2=0x7fed200bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:04.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.497+0000 7fed2843a700 1 -- 172.21.15.1:0/3986934495 shutdown_connections 2023-11-15T01:22:04.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.497+0000 7fed2843a700 1 -- 172.21.15.1:0/3986934495 wait complete. 2023-11-15T01:22:04.511 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T01:22:04.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.630+0000 7ffa9e1aa700 1 Processor -- start 2023-11-15T01:22:04.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.630+0000 7ffa9e1aa700 1 -- start start 2023-11-15T01:22:04.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.631+0000 7ffa9e1aa700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ffa98137030 0x7ffa98137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.631+0000 7ffa9e1aa700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ffa981588e0 0x7ffa98066870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.631+0000 7ffa9e1aa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffa98066d60 0x7ffa9814e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.631+0000 7ffa9e1aa700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa98137900 con 0x7ffa981588e0 2023-11-15T01:22:04.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.631+0000 7ffa9e1aa700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa980671b0 con 0x7ffa98137030 2023-11-15T01:22:04.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.631+0000 7ffa9e1aa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa98158d90 con 0x7ffa98066d60 2023-11-15T01:22:04.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.631+0000 7ffa96ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ffa981588e0 0x7ffa98066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.631+0000 7ffa96ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ffa981588e0 0x7ffa98066870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44562/0 (socket says 172.21.15.1:44562) 2023-11-15T01:22:04.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.631+0000 7ffa96ffd700 1 -- 172.21.15.1:0/2355907584 learned_addr learned my addr 172.21.15.1:0/2355907584 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:04.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.631+0000 7ffa97fff700 1 --2- 172.21.15.1:0/2355907584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffa98066d60 0x7ffa9814e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.631+0000 7ffa977fe700 1 --2- 172.21.15.1:0/2355907584 >> v2:172.21.15.141:3300/0 conn(0x7ffa98137030 0x7ffa98137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa96ffd700 1 -- 172.21.15.1:0/2355907584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffa98066d60 msgr2=0x7ffa9814e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:04.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa96ffd700 1 --2- 172.21.15.1:0/2355907584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffa98066d60 0x7ffa9814e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa96ffd700 1 -- 172.21.15.1:0/2355907584 >> v2:172.21.15.141:3300/0 conn(0x7ffa98137030 msgr2=0x7ffa98137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:04.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa96ffd700 1 --2- 172.21.15.1:0/2355907584 >> v2:172.21.15.141:3300/0 conn(0x7ffa98137030 0x7ffa98137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa96ffd700 1 -- 172.21.15.1:0/2355907584 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98154ce0 con 0x7ffa981588e0 2023-11-15T01:22:04.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa96ffd700 1 --2- 172.21.15.1:0/2355907584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981588e0 0x7ffa98066870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7ffa98063690 tx=0x7ffa8c0090f0).ready entity=mon.0 client_cookie=2bfb4dd0cf76e02e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:04.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa967fc700 1 -- 172.21.15.1:0/2355907584 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c00f510 con 0x7ffa981588e0 2023-11-15T01:22:04.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa967fc700 1 -- 172.21.15.1:0/2355907584 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c00f670 con 0x7ffa981588e0 2023-11-15T01:22:04.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa967fc700 1 -- 172.21.15.1:0/2355907584 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c00fa10 con 0x7ffa981588e0 2023-11-15T01:22:04.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa9e1aa700 1 -- 172.21.15.1:0/2355907584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981588e0 msgr2=0x7ffa98066870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa9e1aa700 1 --2- 172.21.15.1:0/2355907584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981588e0 0x7ffa98066870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7ffa98063690 tx=0x7ffa8c0090f0).stop 2023-11-15T01:22:04.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa9e1aa700 1 -- 172.21.15.1:0/2355907584 shutdown_connections 2023-11-15T01:22:04.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa9e1aa700 1 --2- 172.21.15.1:0/2355907584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffa98066d60 0x7ffa9814e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa9e1aa700 1 --2- 172.21.15.1:0/2355907584 >> v2:172.21.15.141:3300/0 conn(0x7ffa98137030 0x7ffa98137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa9e1aa700 1 --2- 172.21.15.1:0/2355907584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa981588e0 0x7ffa98066870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa9e1aa700 1 -- 172.21.15.1:0/2355907584 >> 172.21.15.1:0/2355907584 conn(0x7ffa98063280 msgr2=0x7ffa980c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:04.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa9e1aa700 1 -- 172.21.15.1:0/2355907584 shutdown_connections 2023-11-15T01:22:04.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.632+0000 7ffa9e1aa700 1 -- 172.21.15.1:0/2355907584 wait complete. 2023-11-15T01:22:04.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.634+0000 7ffa9e1aa700 1 Processor -- start 2023-11-15T01:22:04.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.634+0000 7ffa9e1aa700 1 -- start start 2023-11-15T01:22:04.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.634+0000 7ffa9e1aa700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa98066d60 0x7ffa98137a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.634+0000 7ffa9e1aa700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffa98137030 0x7ffa98150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.634+0000 7ffa9e1aa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffa981588e0 0x7ffa98167d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.634+0000 7ffa9e1aa700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980adbf0 con 0x7ffa98066d60 2023-11-15T01:22:04.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.634+0000 7ffa9e1aa700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980acfe0 con 0x7ffa98137030 2023-11-15T01:22:04.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.634+0000 7ffa9e1aa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980ad2c0 con 0x7ffa981588e0 2023-11-15T01:22:04.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.634+0000 7ffa977fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa98066d60 0x7ffa98137a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.634+0000 7ffa977fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa98066d60 0x7ffa98137a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44564/0 (socket says 172.21.15.1:44564) 2023-11-15T01:22:04.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.635+0000 7ffa977fe700 1 -- 172.21.15.1:0/3347565515 learned_addr learned my addr 172.21.15.1:0/3347565515 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:04.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.635+0000 7ffa97fff700 1 --2- 172.21.15.1:0/3347565515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffa981588e0 0x7ffa98167d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.635+0000 7ffa96ffd700 1 --2- 172.21.15.1:0/3347565515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffa98137030 0x7ffa98150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.635+0000 7ffa977fe700 1 -- 172.21.15.1:0/3347565515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffa981588e0 msgr2=0x7ffa98167d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.635+0000 7ffa977fe700 1 --2- 172.21.15.1:0/3347565515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffa981588e0 0x7ffa98167d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.635+0000 7ffa977fe700 1 -- 172.21.15.1:0/3347565515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffa98137030 msgr2=0x7ffa98150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.635+0000 7ffa977fe700 1 --2- 172.21.15.1:0/3347565515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffa98137030 0x7ffa98150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.635+0000 7ffa977fe700 1 -- 172.21.15.1:0/3347565515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c009370 con 0x7ffa98066d60 2023-11-15T01:22:04.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.635+0000 7ffa96ffd700 1 --2- 172.21.15.1:0/3347565515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffa98137030 0x7ffa98150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:04.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.635+0000 7ffa977fe700 1 --2- 172.21.15.1:0/3347565515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa98066d60 0x7ffa98137a70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7ffa8800e930 tx=0x7ffa88009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:04.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.635+0000 7ffa7f7fe700 1 -- 172.21.15.1:0/3347565515 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8800eed0 con 0x7ffa98066d60 2023-11-15T01:22:04.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.635+0000 7ffa7f7fe700 1 -- 172.21.15.1:0/3347565515 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8800c850 con 0x7ffa98066d60 2023-11-15T01:22:04.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.635+0000 7ffa7f7fe700 1 -- 172.21.15.1:0/3347565515 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8800cbd0 con 0x7ffa98066d60 2023-11-15T01:22:04.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.635+0000 7ffa9e1aa700 1 -- 172.21.15.1:0/3347565515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa980ad5a0 con 0x7ffa98066d60 2023-11-15T01:22:04.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.635+0000 7ffa9e1aa700 1 -- 172.21.15.1:0/3347565515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa980accc0 con 0x7ffa98066d60 2023-11-15T01:22:04.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.636+0000 7ffa9e1aa700 1 -- 172.21.15.1:0/3347565515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa980c7b70 con 0x7ffa98066d60 2023-11-15T01:22:04.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.637+0000 7ffa7f7fe700 1 -- 172.21.15.1:0/3347565515 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ffa8801b400 con 0x7ffa98066d60 2023-11-15T01:22:04.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.637+0000 7ffa7f7fe700 1 --2- 172.21.15.1:0/3347565515 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ffa8405f150 0x7ffa84061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.637+0000 7ffa7f7fe700 1 -- 172.21.15.1:0/3347565515 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffa8807a830 con 0x7ffa98066d60 2023-11-15T01:22:04.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.637+0000 7ffa96ffd700 1 --2- 172.21.15.1:0/3347565515 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ffa8405f150 0x7ffa84061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.638+0000 7ffa96ffd700 1 --2- 172.21.15.1:0/3347565515 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ffa8405f150 0x7ffa84061610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ffa8c009ec0 tx=0x7ffa8c017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:04.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.641+0000 7ffa7f7fe700 1 -- 172.21.15.1:0/3347565515 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ffa8804bb50 con 0x7ffa98066d60 2023-11-15T01:22:04.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.812+0000 7ffa9e1aa700 1 -- 172.21.15.1:0/3347565515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa9806c7e0 con 0x7ffa98066d60 2023-11-15T01:22:04.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.812+0000 7ffa7f7fe700 1 -- 172.21.15.1:0/3347565515 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa8804f170 con 0x7ffa98066d60 2023-11-15T01:22:04.814 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:22:04.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.814+0000 7ffa9e1aa700 1 -- 172.21.15.1:0/3347565515 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ffa8405f150 msgr2=0x7ffa84061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.814+0000 7ffa9e1aa700 1 --2- 172.21.15.1:0/3347565515 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ffa8405f150 0x7ffa84061610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ffa8c009ec0 tx=0x7ffa8c017000).stop 2023-11-15T01:22:04.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.814+0000 7ffa9e1aa700 1 -- 172.21.15.1:0/3347565515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa98066d60 msgr2=0x7ffa98137a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.814+0000 7ffa9e1aa700 1 --2- 172.21.15.1:0/3347565515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa98066d60 0x7ffa98137a70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7ffa8800e930 tx=0x7ffa88009060).stop 2023-11-15T01:22:04.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.814+0000 7ffa9e1aa700 1 -- 172.21.15.1:0/3347565515 shutdown_connections 2023-11-15T01:22:04.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.814+0000 7ffa9e1aa700 1 --2- 172.21.15.1:0/3347565515 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ffa8405f150 0x7ffa84061610 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.814+0000 7ffa9e1aa700 1 --2- 172.21.15.1:0/3347565515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffa981588e0 0x7ffa98167d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.814+0000 7ffa9e1aa700 1 --2- 172.21.15.1:0/3347565515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa98066d60 0x7ffa98137a70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.814+0000 7ffa9e1aa700 1 --2- 172.21.15.1:0/3347565515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffa98137030 0x7ffa98150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.814+0000 7ffa9e1aa700 1 -- 172.21.15.1:0/3347565515 >> 172.21.15.1:0/3347565515 conn(0x7ffa98063280 msgr2=0x7ffa98151d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:04.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.814+0000 7ffa9e1aa700 1 -- 172.21.15.1:0/3347565515 shutdown_connections 2023-11-15T01:22:04.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.814+0000 7ffa9e1aa700 1 -- 172.21.15.1:0/3347565515 wait complete. 2023-11-15T01:22:04.827 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T01:22:04.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.948+0000 7fa64acf0700 1 Processor -- start 2023-11-15T01:22:04.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.948+0000 7fa64acf0700 1 -- start start 2023-11-15T01:22:04.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.949+0000 7fa64acf0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa644154480 0x7fa6440c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.949+0000 7fa64acf0700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6440ca050 con 0x7fa6441540a0 2023-11-15T01:22:04.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.949+0000 7fa64acf0700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6440c68c0 con 0x7fa6440c6430 2023-11-15T01:22:04.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.949+0000 7fa64acf0700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6440c9440 con 0x7fa644154480 2023-11-15T01:22:04.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.949+0000 7fa648a8c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa6441540a0 0x7fa6440ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34172/0 (socket says 172.21.15.1:34172) 2023-11-15T01:22:04.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.949+0000 7fa648a8c700 1 -- 172.21.15.1:0/691716276 learned_addr learned my addr 172.21.15.1:0/691716276 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:04.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.949+0000 7fa643fff700 1 --2- 172.21.15.1:0/691716276 >> v2:172.21.15.1:3300/0 conn(0x7fa644154480 0x7fa6440c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.950+0000 7fa6437fe700 1 -- 172.21.15.1:0/691716276 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628265782 0 0) 0x7fa6440ca050 con 0x7fa6441540a0 2023-11-15T01:22:04.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.950+0000 7fa6437fe700 1 -- 172.21.15.1:0/691716276 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6300033f0 con 0x7fa6441540a0 2023-11-15T01:22:04.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.950+0000 7fa643fff700 1 -- 172.21.15.1:0/691716276 >> v1:172.21.15.141:6789/0 conn(0x7fa6440c6430 legacy=0x7fa6440aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:04.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.950+0000 7fa643fff700 1 -- 172.21.15.1:0/691716276 >> v1:172.21.15.1:6789/0 conn(0x7fa6441540a0 legacy=0x7fa6440ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.950+0000 7fa643fff700 1 -- 172.21.15.1:0/691716276 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6440c9720 con 0x7fa644154480 2023-11-15T01:22:04.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.950+0000 7fa643fff700 1 --2- 172.21.15.1:0/691716276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644154480 0x7fa6440c5f40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fa634009e60 tx=0x7fa634009780).ready entity=mon.0 client_cookie=23d73d6d80a77237 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:04.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.950+0000 7fa6437fe700 1 -- 172.21.15.1:0/691716276 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63400e070 con 0x7fa644154480 2023-11-15T01:22:04.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.950+0000 7fa6437fe700 1 -- 172.21.15.1:0/691716276 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63400bb20 con 0x7fa644154480 2023-11-15T01:22:04.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.950+0000 7fa6437fe700 1 -- 172.21.15.1:0/691716276 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63400bea0 con 0x7fa644154480 2023-11-15T01:22:04.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.950+0000 7fa64acf0700 1 -- 172.21.15.1:0/691716276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644154480 msgr2=0x7fa6440c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.950+0000 7fa64acf0700 1 --2- 172.21.15.1:0/691716276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644154480 0x7fa6440c5f40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fa634009e60 tx=0x7fa634009780).stop 2023-11-15T01:22:04.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.951+0000 7fa64acf0700 1 -- 172.21.15.1:0/691716276 shutdown_connections 2023-11-15T01:22:04.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.951+0000 7fa64acf0700 1 --2- 172.21.15.1:0/691716276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644154480 0x7fa6440c5f40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.951+0000 7fa64acf0700 1 -- 172.21.15.1:0/691716276 >> 172.21.15.1:0/691716276 conn(0x7fa644064a70 msgr2=0x7fa644064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:04.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.951+0000 7fa64acf0700 1 -- 172.21.15.1:0/691716276 shutdown_connections 2023-11-15T01:22:04.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.951+0000 7fa64acf0700 1 -- 172.21.15.1:0/691716276 wait complete. 2023-11-15T01:22:04.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.952+0000 7fa64acf0700 1 Processor -- start 2023-11-15T01:22:04.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.952+0000 7fa64acf0700 1 -- start start 2023-11-15T01:22:04.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64acf0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6440c6430 0x7fa64414ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64acf0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6441540a0 0x7fa6440c3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64acf0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644154480 0x7fa6440c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64acf0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440c4030 con 0x7fa644154480 2023-11-15T01:22:04.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64acf0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa644153320 con 0x7fa6441540a0 2023-11-15T01:22:04.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64acf0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa644164da0 con 0x7fa6440c6430 2023-11-15T01:22:04.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64928d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644154480 0x7fa6440c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64928d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644154480 0x7fa6440c3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44582/0 (socket says 172.21.15.1:44582) 2023-11-15T01:22:04.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64928d700 1 -- 172.21.15.1:0/1380077009 learned_addr learned my addr 172.21.15.1:0/1380077009 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa643fff700 1 --2- 172.21.15.1:0/1380077009 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6441540a0 0x7fa6440c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa648a8c700 1 --2- 172.21.15.1:0/1380077009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6440c6430 0x7fa64414ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64928d700 1 -- 172.21.15.1:0/1380077009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6440c6430 msgr2=0x7fa64414ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64928d700 1 --2- 172.21.15.1:0/1380077009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6440c6430 0x7fa64414ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64928d700 1 -- 172.21.15.1:0/1380077009 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6441540a0 msgr2=0x7fa6440c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:04.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64928d700 1 --2- 172.21.15.1:0/1380077009 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6441540a0 0x7fa6440c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:04.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64928d700 1 -- 172.21.15.1:0/1380077009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa634009a20 con 0x7fa644154480 2023-11-15T01:22:04.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa648a8c700 1 --2- 172.21.15.1:0/1380077009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6440c6430 0x7fa64414ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:04.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64928d700 1 --2- 172.21.15.1:0/1380077009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644154480 0x7fa6440c3b40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fa62c00c490 tx=0x7fa62c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:04.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa640ff9700 1 -- 172.21.15.1:0/1380077009 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c002ea0 con 0x7fa644154480 2023-11-15T01:22:04.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa640ff9700 1 -- 172.21.15.1:0/1380077009 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c00f470 con 0x7fa644154480 2023-11-15T01:22:04.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa640ff9700 1 -- 172.21.15.1:0/1380077009 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c00f810 con 0x7fa644154480 2023-11-15T01:22:04.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64acf0700 1 -- 172.21.15.1:0/1380077009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa644152cd0 con 0x7fa644154480 2023-11-15T01:22:04.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.953+0000 7fa64acf0700 1 -- 172.21.15.1:0/1380077009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa644152910 con 0x7fa644154480 2023-11-15T01:22:04.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.954+0000 7fa64acf0700 1 -- 172.21.15.1:0/1380077009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6441534b0 con 0x7fa644154480 2023-11-15T01:22:04.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.955+0000 7fa640ff9700 1 -- 172.21.15.1:0/1380077009 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa62c00fc40 con 0x7fa644154480 2023-11-15T01:22:04.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.955+0000 7fa640ff9700 1 --2- 172.21.15.1:0/1380077009 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa62405f120 0x7fa6240615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:04.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.955+0000 7fa640ff9700 1 -- 172.21.15.1:0/1380077009 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa62c079620 con 0x7fa644154480 2023-11-15T01:22:04.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.955+0000 7fa648a8c700 1 --2- 172.21.15.1:0/1380077009 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa62405f120 0x7fa6240615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:04.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.956+0000 7fa648a8c700 1 --2- 172.21.15.1:0/1380077009 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa62405f120 0x7fa6240615e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fa63c005750 tx=0x7fa63c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:04.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:04.959+0000 7fa640ff9700 1 -- 172.21.15.1:0/1380077009 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa62c047af0 con 0x7fa644154480 2023-11-15T01:22:05.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.130+0000 7fa64acf0700 1 -- 172.21.15.1:0/1380077009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa64406c7e0 con 0x7fa644154480 2023-11-15T01:22:05.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.130+0000 7fa640ff9700 1 -- 172.21.15.1:0/1380077009 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa62c04a8f0 con 0x7fa644154480 2023-11-15T01:22:05.132 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:22:05.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.132+0000 7fa64acf0700 1 -- 172.21.15.1:0/1380077009 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa62405f120 msgr2=0x7fa6240615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.132+0000 7fa64acf0700 1 --2- 172.21.15.1:0/1380077009 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa62405f120 0x7fa6240615e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fa63c005750 tx=0x7fa63c009040).stop 2023-11-15T01:22:05.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.132+0000 7fa64acf0700 1 -- 172.21.15.1:0/1380077009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644154480 msgr2=0x7fa6440c3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.132+0000 7fa64acf0700 1 --2- 172.21.15.1:0/1380077009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644154480 0x7fa6440c3b40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fa62c00c490 tx=0x7fa62c007de0).stop 2023-11-15T01:22:05.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.132+0000 7fa64acf0700 1 -- 172.21.15.1:0/1380077009 shutdown_connections 2023-11-15T01:22:05.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.132+0000 7fa64acf0700 1 --2- 172.21.15.1:0/1380077009 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa62405f120 0x7fa6240615e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.132+0000 7fa64acf0700 1 --2- 172.21.15.1:0/1380077009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644154480 0x7fa6440c3b40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.132+0000 7fa64acf0700 1 --2- 172.21.15.1:0/1380077009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6440c6430 0x7fa64414ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.132+0000 7fa64acf0700 1 --2- 172.21.15.1:0/1380077009 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6441540a0 0x7fa6440c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.132+0000 7fa64acf0700 1 -- 172.21.15.1:0/1380077009 >> 172.21.15.1:0/1380077009 conn(0x7fa644064a70 msgr2=0x7fa6440c0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:05.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.132+0000 7fa64acf0700 1 -- 172.21.15.1:0/1380077009 shutdown_connections 2023-11-15T01:22:05.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.132+0000 7fa64acf0700 1 -- 172.21.15.1:0/1380077009 wait complete. 2023-11-15T01:22:05.146 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:22:05.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.262+0000 7fb3b0dd8700 1 Processor -- start 2023-11-15T01:22:05.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.262+0000 7fb3b0dd8700 1 -- start start 2023-11-15T01:22:05.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.263+0000 7fb3b0dd8700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb3ac152340 0x7fb3ac152720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.263+0000 7fb3b0dd8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3ac062ec0 0x7fb3ac0698c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.263+0000 7fb3b0dd8700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ac069f00 con 0x7fb3ac069460 2023-11-15T01:22:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.263+0000 7fb3b0dd8700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ac06a1e0 con 0x7fb3ac152340 2023-11-15T01:22:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.263+0000 7fb3b0dd8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac06a4c0 con 0x7fb3ac062ec0 2023-11-15T01:22:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.263+0000 7fb3aaffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb3ac069460 0x7fb3ac0627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34188/0 (socket says 172.21.15.1:34188) 2023-11-15T01:22:05.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.263+0000 7fb3aaffd700 1 -- 172.21.15.1:0/3916134401 learned_addr learned my addr 172.21.15.1:0/3916134401 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:05.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.263+0000 7fb3aa7fc700 1 -- 172.21.15.1:0/3916134401 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640237090 0 0) 0x7fb3ac069f00 con 0x7fb3ac069460 2023-11-15T01:22:05.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.263+0000 7fb3ab7fe700 1 --2- 172.21.15.1:0/3916134401 >> v2:172.21.15.141:3300/0 conn(0x7fb3ac152340 0x7fb3ac152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.263+0000 7fb3abfff700 1 --2- 172.21.15.1:0/3916134401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3ac062ec0 0x7fb3ac0698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.263+0000 7fb3aa7fc700 1 -- 172.21.15.1:0/3916134401 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3980033f0 con 0x7fb3ac069460 2023-11-15T01:22:05.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 -- 172.21.15.1:0/3916134401 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 271945802 0 0) 0x7fb3980033f0 con 0x7fb3ac069460 2023-11-15T01:22:05.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 -- 172.21.15.1:0/3916134401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3ac062ec0 msgr2=0x7fb3ac0698c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:05.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 --2- 172.21.15.1:0/3916134401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3ac062ec0 0x7fb3ac0698c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 -- 172.21.15.1:0/3916134401 >> v2:172.21.15.141:3300/0 conn(0x7fb3ac152340 msgr2=0x7fb3ac152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:05.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 --2- 172.21.15.1:0/3916134401 >> v2:172.21.15.141:3300/0 conn(0x7fb3ac152340 0x7fb3ac152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 -- 172.21.15.1:0/3916134401 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac06a7a0 con 0x7fb3ac069460 2023-11-15T01:22:05.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 -- 172.21.15.1:0/3916134401 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fb394001470 con 0x7fb3ac069460 2023-11-15T01:22:05.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 -- 172.21.15.1:0/3916134401 >> v1:172.21.15.1:6789/0 conn(0x7fb3ac069460 legacy=0x7fb3ac0627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 --2- 172.21.15.1:0/3916134401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3980038e0 0x7fb398003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 --2- 172.21.15.1:0/3916134401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb398004690 0x7fb398004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 --2- 172.21.15.1:0/3916134401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3ac062ec0 0x7fb398005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 -- 172.21.15.1:0/3916134401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac06a1e0 con 0x7fb398004690 2023-11-15T01:22:05.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 -- 172.21.15.1:0/3916134401 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac06a4c0 con 0x7fb3980038e0 2023-11-15T01:22:05.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 -- 172.21.15.1:0/3916134401 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39800b8e0 con 0x7fb3ac062ec0 2023-11-15T01:22:05.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aaffd700 1 --2- 172.21.15.1:0/3916134401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb398004690 0x7fb398004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3ab7fe700 1 --2- 172.21.15.1:0/3916134401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3980038e0 0x7fb398003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3abfff700 1 --2- 172.21.15.1:0/3916134401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3ac062ec0 0x7fb398005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aaffd700 1 -- 172.21.15.1:0/3916134401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3ac062ec0 msgr2=0x7fb398005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:05.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aaffd700 1 --2- 172.21.15.1:0/3916134401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3ac062ec0 0x7fb398005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aaffd700 1 -- 172.21.15.1:0/3916134401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3980038e0 msgr2=0x7fb398003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:05.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aaffd700 1 --2- 172.21.15.1:0/3916134401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3980038e0 0x7fb398003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aaffd700 1 -- 172.21.15.1:0/3916134401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3980033f0 con 0x7fb398004690 2023-11-15T01:22:05.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aaffd700 1 --2- 172.21.15.1:0/3916134401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb398004690 0x7fb398004b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fb39400c210 tx=0x7fb394001e90).ready entity=mon.0 client_cookie=372a81ab32a4f9f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:05.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 -- 172.21.15.1:0/3916134401 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb394007a60 con 0x7fb398004690 2023-11-15T01:22:05.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 -- 172.21.15.1:0/3916134401 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39400cae0 con 0x7fb398004690 2023-11-15T01:22:05.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.264+0000 7fb3aa7fc700 1 -- 172.21.15.1:0/3916134401 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39400ce60 con 0x7fb398004690 2023-11-15T01:22:05.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.265+0000 7fb3b0dd8700 1 -- 172.21.15.1:0/3916134401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb398004690 msgr2=0x7fb398004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.265+0000 7fb3b0dd8700 1 --2- 172.21.15.1:0/3916134401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb398004690 0x7fb398004b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fb39400c210 tx=0x7fb394001e90).stop 2023-11-15T01:22:05.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.265+0000 7fb3abfff700 1 -- 172.21.15.1:0/3916134401 reap_dead start 2023-11-15T01:22:05.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.265+0000 7fb3b0dd8700 1 -- 172.21.15.1:0/3916134401 shutdown_connections 2023-11-15T01:22:05.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.265+0000 7fb3b0dd8700 1 -- 172.21.15.1:0/3916134401 >> 172.21.15.1:0/3916134401 conn(0x7fb3ac0c7c10 msgr2=0x7fb3ac0c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:05.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.265+0000 7fb3b0dd8700 1 -- 172.21.15.1:0/3916134401 shutdown_connections 2023-11-15T01:22:05.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.265+0000 7fb3b0dd8700 1 -- 172.21.15.1:0/3916134401 wait complete. 2023-11-15T01:22:05.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.266+0000 7fb3b0dd8700 1 Processor -- start 2023-11-15T01:22:05.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.266+0000 7fb3b0dd8700 1 -- start start 2023-11-15T01:22:05.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3b0dd8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb398004690 0x7fb3ac157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3b0dd8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3ac0c7210 0x7fb3ac1489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3b0dd8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3ac165230 0x7fb3ac0a8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3b0dd8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac164da0 con 0x7fb3ac165230 2023-11-15T01:22:05.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3b0dd8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac164a70 con 0x7fb398004690 2023-11-15T01:22:05.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3b0dd8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac157a20 con 0x7fb3ac0c7210 2023-11-15T01:22:05.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3abfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3ac165230 0x7fb3ac0a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3aaffd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3ac0c7210 0x7fb3ac1489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3abfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3ac165230 0x7fb3ac0a8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44598/0 (socket says 172.21.15.1:44598) 2023-11-15T01:22:05.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3abfff700 1 -- 172.21.15.1:0/1630787470 learned_addr learned my addr 172.21.15.1:0/1630787470 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:05.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3ab7fe700 1 --2- 172.21.15.1:0/1630787470 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb398004690 0x7fb3ac157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3abfff700 1 -- 172.21.15.1:0/1630787470 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3ac0c7210 msgr2=0x7fb3ac1489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3abfff700 1 --2- 172.21.15.1:0/1630787470 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3ac0c7210 0x7fb3ac1489c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3abfff700 1 -- 172.21.15.1:0/1630787470 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb398004690 msgr2=0x7fb3ac157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3abfff700 1 --2- 172.21.15.1:0/1630787470 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb398004690 0x7fb3ac157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.267+0000 7fb3abfff700 1 -- 172.21.15.1:0/1630787470 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac157d00 con 0x7fb3ac165230 2023-11-15T01:22:05.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.268+0000 7fb3abfff700 1 --2- 172.21.15.1:0/1630787470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3ac165230 0x7fb3ac0a8650 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fb3ac0656c0 tx=0x7fb39c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:05.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.268+0000 7fb3a37fe700 1 -- 172.21.15.1:0/1630787470 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c015440 con 0x7fb3ac165230 2023-11-15T01:22:05.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.268+0000 7fb3a37fe700 1 -- 172.21.15.1:0/1630787470 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c0155a0 con 0x7fb3ac165230 2023-11-15T01:22:05.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.268+0000 7fb3a37fe700 1 -- 172.21.15.1:0/1630787470 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c015940 con 0x7fb3ac165230 2023-11-15T01:22:05.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.268+0000 7fb3b0dd8700 1 -- 172.21.15.1:0/1630787470 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ac157fe0 con 0x7fb3ac165230 2023-11-15T01:22:05.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.268+0000 7fb3b0dd8700 1 -- 172.21.15.1:0/1630787470 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ac148eb0 con 0x7fb3ac165230 2023-11-15T01:22:05.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.269+0000 7fb3b0dd8700 1 -- 172.21.15.1:0/1630787470 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ac0475e0 con 0x7fb3ac165230 2023-11-15T01:22:05.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.269+0000 7fb3a37fe700 1 -- 172.21.15.1:0/1630787470 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb39c015d30 con 0x7fb3ac165230 2023-11-15T01:22:05.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.269+0000 7fb3a37fe700 1 --2- 172.21.15.1:0/1630787470 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb38c05f150 0x7fb38c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.269+0000 7fb3a37fe700 1 -- 172.21.15.1:0/1630787470 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb39c079b00 con 0x7fb3ac165230 2023-11-15T01:22:05.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.270+0000 7fb3ab7fe700 1 --2- 172.21.15.1:0/1630787470 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb38c05f150 0x7fb38c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.270+0000 7fb3ab7fe700 1 --2- 172.21.15.1:0/1630787470 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb38c05f150 0x7fb38c061610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb3a40094d0 tx=0x7fb3a400b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:05.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.274+0000 7fb3a37fe700 1 -- 172.21.15.1:0/1630787470 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb39c04ae80 con 0x7fb3ac165230 2023-11-15T01:22:05.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.444+0000 7fb3b0dd8700 1 -- 172.21.15.1:0/1630787470 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3ac14e630 con 0x7fb3ac165230 2023-11-15T01:22:05.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.445+0000 7fb3a37fe700 1 -- 172.21.15.1:0/1630787470 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16880 (secure 0 0 0) 0x7fb39c04e4a0 con 0x7fb3ac165230 2023-11-15T01:22:05.447 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:05.447 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:38.047484+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:21:34.763591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-15T01:21:36.025071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:22:05.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.447+0000 7fb3b0dd8700 1 -- 172.21.15.1:0/1630787470 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb38c05f150 msgr2=0x7fb38c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.447+0000 7fb3b0dd8700 1 --2- 172.21.15.1:0/1630787470 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb38c05f150 0x7fb38c061610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb3a40094d0 tx=0x7fb3a400b040).stop 2023-11-15T01:22:05.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.447+0000 7fb3b0dd8700 1 -- 172.21.15.1:0/1630787470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3ac165230 msgr2=0x7fb3ac0a8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.447+0000 7fb3b0dd8700 1 --2- 172.21.15.1:0/1630787470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3ac165230 0x7fb3ac0a8650 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fb3ac0656c0 tx=0x7fb39c008040).stop 2023-11-15T01:22:05.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.447+0000 7fb3b0dd8700 1 -- 172.21.15.1:0/1630787470 shutdown_connections 2023-11-15T01:22:05.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.447+0000 7fb3b0dd8700 1 --2- 172.21.15.1:0/1630787470 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb38c05f150 0x7fb38c061610 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.447+0000 7fb3b0dd8700 1 --2- 172.21.15.1:0/1630787470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3ac165230 0x7fb3ac0a8650 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.447+0000 7fb3b0dd8700 1 --2- 172.21.15.1:0/1630787470 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb398004690 0x7fb3ac157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.447+0000 7fb3b0dd8700 1 --2- 172.21.15.1:0/1630787470 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3ac0c7210 0x7fb3ac1489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.447+0000 7fb3b0dd8700 1 -- 172.21.15.1:0/1630787470 >> 172.21.15.1:0/1630787470 conn(0x7fb3ac0c7c10 msgr2=0x7fb3ac066970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:05.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.447+0000 7fb3b0dd8700 1 -- 172.21.15.1:0/1630787470 shutdown_connections 2023-11-15T01:22:05.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.447+0000 7fb3b0dd8700 1 -- 172.21.15.1:0/1630787470 wait complete. 2023-11-15T01:22:05.461 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T01:21:34.763591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T01:21:36.025071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T01:22:05.461 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:22:05.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.581+0000 7fb2f7cdb700 1 Processor -- start 2023-11-15T01:22:05.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.581+0000 7fb2f7cdb700 1 -- start start 2023-11-15T01:22:05.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f7cdb700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb2f0134fa0 0x7fb2f0155690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f7cdb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2f00bc320 0x7fb2f0068500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f7cdb700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f00bd400 con 0x7fb2f0135380 2023-11-15T01:22:05.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f7cdb700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f0152a40 con 0x7fb2f0134fa0 2023-11-15T01:22:05.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f7cdb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00bc7f0 con 0x7fb2f00bc320 2023-11-15T01:22:05.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f5276700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb2f0135380 0x7fb2f00bbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34204/0 (socket says 172.21.15.1:34204) 2023-11-15T01:22:05.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f5276700 1 -- 172.21.15.1:0/3971441968 learned_addr learned my addr 172.21.15.1:0/3971441968 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:05.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f5a77700 1 --2- 172.21.15.1:0/3971441968 >> v2:172.21.15.141:3300/0 conn(0x7fb2f0134fa0 0x7fb2f0155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 -- 172.21.15.1:0/3971441968 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029378372 0 0) 0x7fb2f00bd400 con 0x7fb2f0135380 2023-11-15T01:22:05.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f6278700 1 --2- 172.21.15.1:0/3971441968 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2f00bc320 0x7fb2f0068500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 -- 172.21.15.1:0/3971441968 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2dc0033f0 con 0x7fb2f0135380 2023-11-15T01:22:05.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 -- 172.21.15.1:0/3971441968 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1292436502 0 0) 0x7fb2dc0033f0 con 0x7fb2f0135380 2023-11-15T01:22:05.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 -- 172.21.15.1:0/3971441968 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2f00bc320 msgr2=0x7fb2f0068500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:05.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 --2- 172.21.15.1:0/3971441968 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2f00bc320 0x7fb2f0068500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 -- 172.21.15.1:0/3971441968 >> v2:172.21.15.141:3300/0 conn(0x7fb2f0134fa0 msgr2=0x7fb2f0155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:05.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 --2- 172.21.15.1:0/3971441968 >> v2:172.21.15.141:3300/0 conn(0x7fb2f0134fa0 0x7fb2f0155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 -- 172.21.15.1:0/3971441968 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f00bcad0 con 0x7fb2f0135380 2023-11-15T01:22:05.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 -- 172.21.15.1:0/3971441968 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fb2e0001470 con 0x7fb2f0135380 2023-11-15T01:22:05.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 -- 172.21.15.1:0/3971441968 >> v1:172.21.15.1:6789/0 conn(0x7fb2f0135380 legacy=0x7fb2f00bbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 --2- 172.21.15.1:0/3971441968 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2f00bc320 0x7fb2dc0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 --2- 172.21.15.1:0/3971441968 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2dc003e10 0x7fb2dc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 --2- 172.21.15.1:0/3971441968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2dc004b80 0x7fb2dc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 -- 172.21.15.1:0/3971441968 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0152a40 con 0x7fb2dc004b80 2023-11-15T01:22:05.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 -- 172.21.15.1:0/3971441968 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00bc7f0 con 0x7fb2dc003e10 2023-11-15T01:22:05.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.582+0000 7fb2f4a75700 1 -- 172.21.15.1:0/3971441968 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc00b8e0 con 0x7fb2f00bc320 2023-11-15T01:22:05.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.583+0000 7fb2f6278700 1 --2- 172.21.15.1:0/3971441968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2dc004b80 0x7fb2dc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.583+0000 7fb2f5276700 1 --2- 172.21.15.1:0/3971441968 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2dc003e10 0x7fb2dc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.583+0000 7fb2f5a77700 1 --2- 172.21.15.1:0/3971441968 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2f00bc320 0x7fb2dc0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.583+0000 7fb2f6278700 1 -- 172.21.15.1:0/3971441968 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2f00bc320 msgr2=0x7fb2dc0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:05.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.583+0000 7fb2f6278700 1 --2- 172.21.15.1:0/3971441968 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2f00bc320 0x7fb2dc0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.583+0000 7fb2f6278700 1 -- 172.21.15.1:0/3971441968 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2dc003e10 msgr2=0x7fb2dc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:05.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.583+0000 7fb2f6278700 1 --2- 172.21.15.1:0/3971441968 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2dc003e10 0x7fb2dc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.583+0000 7fb2f6278700 1 -- 172.21.15.1:0/3971441968 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc0033f0 con 0x7fb2dc004b80 2023-11-15T01:22:05.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.583+0000 7fb2f6278700 1 --2- 172.21.15.1:0/3971441968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2dc004b80 0x7fb2dc005000 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fb2f00bc720 tx=0x7fb2e800b040).ready entity=mon.0 client_cookie=eb58563c3bad64e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:05.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.583+0000 7fb2f4a75700 1 -- 172.21.15.1:0/3971441968 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8017070 con 0x7fb2dc004b80 2023-11-15T01:22:05.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.583+0000 7fb2f4a75700 1 -- 172.21.15.1:0/3971441968 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e800f040 con 0x7fb2dc004b80 2023-11-15T01:22:05.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.583+0000 7fb2f4a75700 1 -- 172.21.15.1:0/3971441968 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800ec90 con 0x7fb2dc004b80 2023-11-15T01:22:05.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.584+0000 7fb2f7cdb700 1 -- 172.21.15.1:0/3971441968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2dc004b80 msgr2=0x7fb2dc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.584+0000 7fb2f7cdb700 1 --2- 172.21.15.1:0/3971441968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2dc004b80 0x7fb2dc005000 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fb2f00bc720 tx=0x7fb2e800b040).stop 2023-11-15T01:22:05.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.584+0000 7fb2f6278700 1 -- 172.21.15.1:0/3971441968 reap_dead start 2023-11-15T01:22:05.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.584+0000 7fb2f7cdb700 1 -- 172.21.15.1:0/3971441968 shutdown_connections 2023-11-15T01:22:05.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.584+0000 7fb2f7cdb700 1 -- 172.21.15.1:0/3971441968 >> 172.21.15.1:0/3971441968 conn(0x7fb2f0063280 msgr2=0x7fb2f00c6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:05.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.584+0000 7fb2f7cdb700 1 -- 172.21.15.1:0/3971441968 shutdown_connections 2023-11-15T01:22:05.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.584+0000 7fb2f7cdb700 1 -- 172.21.15.1:0/3971441968 wait complete. 2023-11-15T01:22:05.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.585+0000 7fb2f7cdb700 1 Processor -- start 2023-11-15T01:22:05.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.585+0000 7fb2f7cdb700 1 -- start start 2023-11-15T01:22:05.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f7cdb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2f01334b0 0x7fb2f0133890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f7cdb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2f00ab170 0x7fb2f00ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f7cdb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2f0133fc0 0x7fb2f0134440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f7cdb700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0134930 con 0x7fb2f0133fc0 2023-11-15T01:22:05.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f7cdb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f014f430 con 0x7fb2f01334b0 2023-11-15T01:22:05.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f7cdb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00abc30 con 0x7fb2f00ab170 2023-11-15T01:22:05.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f6278700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2f0133fc0 0x7fb2f0134440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f6278700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2f0133fc0 0x7fb2f0134440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44608/0 (socket says 172.21.15.1:44608) 2023-11-15T01:22:05.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f6278700 1 -- 172.21.15.1:0/1069142561 learned_addr learned my addr 172.21.15.1:0/1069142561 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:05.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f5276700 1 --2- 172.21.15.1:0/1069142561 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2f00ab170 0x7fb2f00ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f5a77700 1 --2- 172.21.15.1:0/1069142561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2f01334b0 0x7fb2f0133890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f6278700 1 -- 172.21.15.1:0/1069142561 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2f00ab170 msgr2=0x7fb2f00ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f6278700 1 --2- 172.21.15.1:0/1069142561 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2f00ab170 0x7fb2f00ab5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f6278700 1 -- 172.21.15.1:0/1069142561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2f01334b0 msgr2=0x7fb2f0133890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f6278700 1 --2- 172.21.15.1:0/1069142561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2f01334b0 0x7fb2f0133890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f6278700 1 -- 172.21.15.1:0/1069142561 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f00abf10 con 0x7fb2f0133fc0 2023-11-15T01:22:05.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f6278700 1 --2- 172.21.15.1:0/1069142561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2f0133fc0 0x7fb2f0134440 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fb2dc0045a0 tx=0x7fb2e8019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:05.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2e5ffb700 1 -- 172.21.15.1:0/1069142561 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8009ac0 con 0x7fb2f0133fc0 2023-11-15T01:22:05.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2e5ffb700 1 -- 172.21.15.1:0/1069142561 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e800ec50 con 0x7fb2f0133fc0 2023-11-15T01:22:05.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2e5ffb700 1 -- 172.21.15.1:0/1069142561 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e801d650 con 0x7fb2f0133fc0 2023-11-15T01:22:05.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.586+0000 7fb2f7cdb700 1 -- 172.21.15.1:0/1069142561 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f00ac1f0 con 0x7fb2f0133fc0 2023-11-15T01:22:05.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.587+0000 7fb2f7cdb700 1 -- 172.21.15.1:0/1069142561 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f00aade0 con 0x7fb2f0133fc0 2023-11-15T01:22:05.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.588+0000 7fb2f7cdb700 1 -- 172.21.15.1:0/1069142561 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f006c7e0 con 0x7fb2f0133fc0 2023-11-15T01:22:05.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.588+0000 7fb2e5ffb700 1 -- 172.21.15.1:0/1069142561 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb2e8003020 con 0x7fb2f0133fc0 2023-11-15T01:22:05.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.588+0000 7fb2e5ffb700 1 --2- 172.21.15.1:0/1069142561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb2d405f150 0x7fb2d4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.588+0000 7fb2e5ffb700 1 -- 172.21.15.1:0/1069142561 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb2e807b100 con 0x7fb2f0133fc0 2023-11-15T01:22:05.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.589+0000 7fb2f5a77700 1 --2- 172.21.15.1:0/1069142561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb2d405f150 0x7fb2d4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.589+0000 7fb2f5a77700 1 --2- 172.21.15.1:0/1069142561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb2d405f150 0x7fb2d4061610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb2ec006d80 tx=0x7fb2ec009060).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:05.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.593+0000 7fb2e5ffb700 1 -- 172.21.15.1:0/1069142561 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb2e804c420 con 0x7fb2f0133fc0 2023-11-15T01:22:05.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.766+0000 7fb2f7cdb700 1 -- 172.21.15.1:0/1069142561 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb2f00bcdb0 con 0x7fb2f0133fc0 2023-11-15T01:22:05.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.766+0000 7fb2e5ffb700 1 -- 172.21.15.1:0/1069142561 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb2e8023020 con 0x7fb2f0133fc0 2023-11-15T01:22:05.768 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:22:05.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.768+0000 7fb2f7cdb700 1 -- 172.21.15.1:0/1069142561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb2d405f150 msgr2=0x7fb2d4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.768+0000 7fb2f7cdb700 1 --2- 172.21.15.1:0/1069142561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb2d405f150 0x7fb2d4061610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb2ec006d80 tx=0x7fb2ec009060).stop 2023-11-15T01:22:05.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.768+0000 7fb2f7cdb700 1 -- 172.21.15.1:0/1069142561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2f0133fc0 msgr2=0x7fb2f0134440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.768+0000 7fb2f7cdb700 1 --2- 172.21.15.1:0/1069142561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2f0133fc0 0x7fb2f0134440 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fb2dc0045a0 tx=0x7fb2e8019000).stop 2023-11-15T01:22:05.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.768+0000 7fb2f7cdb700 1 -- 172.21.15.1:0/1069142561 shutdown_connections 2023-11-15T01:22:05.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.768+0000 7fb2f7cdb700 1 --2- 172.21.15.1:0/1069142561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb2d405f150 0x7fb2d4061610 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.768+0000 7fb2f7cdb700 1 --2- 172.21.15.1:0/1069142561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2f0133fc0 0x7fb2f0134440 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.768+0000 7fb2f7cdb700 1 --2- 172.21.15.1:0/1069142561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2f01334b0 0x7fb2f0133890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.768+0000 7fb2f7cdb700 1 --2- 172.21.15.1:0/1069142561 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2f00ab170 0x7fb2f00ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.768+0000 7fb2f7cdb700 1 -- 172.21.15.1:0/1069142561 >> 172.21.15.1:0/1069142561 conn(0x7fb2f0063280 msgr2=0x7fb2f00a8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:05.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.768+0000 7fb2f7cdb700 1 -- 172.21.15.1:0/1069142561 shutdown_connections 2023-11-15T01:22:05.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.768+0000 7fb2f7cdb700 1 -- 172.21.15.1:0/1069142561 wait complete. 2023-11-15T01:22:05.781 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:22:05.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.900+0000 7f2641fca700 1 Processor -- start 2023-11-15T01:22:05.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.900+0000 7f2641fca700 1 -- start start 2023-11-15T01:22:05.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.901+0000 7f2641fca700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f263c1540a0 0x7f263c0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.901+0000 7f2641fca700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0ca050 con 0x7f263c0c6650 2023-11-15T01:22:05.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.901+0000 7f2641fca700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0c9440 con 0x7f263c154480 2023-11-15T01:22:05.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.901+0000 7f2641fca700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0c9720 con 0x7f263c1540a0 2023-11-15T01:22:05.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.901+0000 7f263b7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f263c1540a0 0x7f263c0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.901+0000 7f263bfff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f263c0c6650 0x7f263c0aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34220/0 (socket says 172.21.15.1:34220) 2023-11-15T01:22:05.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.901+0000 7f263bfff700 1 -- 172.21.15.1:0/3935848906 learned_addr learned my addr 172.21.15.1:0/3935848906 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:05.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.902+0000 7f263b7fe700 1 -- 172.21.15.1:0/3935848906 >> v1:172.21.15.141:6789/0 conn(0x7f263c154480 legacy=0x7f263c0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:05.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.902+0000 7f263b7fe700 1 -- 172.21.15.1:0/3935848906 >> v1:172.21.15.1:6789/0 conn(0x7f263c0c6650 legacy=0x7f263c0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.902+0000 7f263a7fc700 1 -- 172.21.15.1:0/3935848906 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260137438 0 0) 0x7f263c0ca050 con 0x7f263c0c6650 2023-11-15T01:22:05.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.902+0000 7f263b7fe700 1 -- 172.21.15.1:0/3935848906 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c0c9a00 con 0x7f263c1540a0 2023-11-15T01:22:05.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.902+0000 7f263b7fe700 1 --2- 172.21.15.1:0/3935848906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c1540a0 0x7f263c0ca4e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f262c009760 tx=0x7f262c009060).ready entity=mon.0 client_cookie=fde5056c15fded6f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:05.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.902+0000 7f263a7fc700 1 -- 172.21.15.1:0/3935848906 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c00b520 con 0x7f263c1540a0 2023-11-15T01:22:05.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.902+0000 7f263a7fc700 1 -- 172.21.15.1:0/3935848906 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c00b680 con 0x7f263c1540a0 2023-11-15T01:22:05.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.902+0000 7f263a7fc700 1 -- 172.21.15.1:0/3935848906 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c00ba00 con 0x7f263c1540a0 2023-11-15T01:22:05.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.902+0000 7f2641fca700 1 -- 172.21.15.1:0/3935848906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c1540a0 msgr2=0x7f263c0ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.902+0000 7f2641fca700 1 --2- 172.21.15.1:0/3935848906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c1540a0 0x7f263c0ca4e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f262c009760 tx=0x7f262c009060).stop 2023-11-15T01:22:05.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.902+0000 7f2641fca700 1 -- 172.21.15.1:0/3935848906 shutdown_connections 2023-11-15T01:22:05.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.902+0000 7f2641fca700 1 --2- 172.21.15.1:0/3935848906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c1540a0 0x7f263c0ca4e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:05.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.902+0000 7f2641fca700 1 -- 172.21.15.1:0/3935848906 >> 172.21.15.1:0/3935848906 conn(0x7f263c064a70 msgr2=0x7f263c064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:05.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.903+0000 7f2641fca700 1 -- 172.21.15.1:0/3935848906 shutdown_connections 2023-11-15T01:22:05.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.903+0000 7f2641fca700 1 -- 172.21.15.1:0/3935848906 wait complete. 2023-11-15T01:22:05.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.904+0000 7f2641fca700 1 Processor -- start 2023-11-15T01:22:05.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.904+0000 7f2641fca700 1 -- start start 2023-11-15T01:22:05.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.904+0000 7f2641fca700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c0c6650 0x7f263c14ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.904+0000 7f2641fca700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f263c1540a0 0x7f263c164b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.904+0000 7f2641fca700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f263c154480 0x7f263c152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.904+0000 7f2641fca700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0af110 con 0x7f263c0c6650 2023-11-15T01:22:05.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.904+0000 7f2641fca700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0ae500 con 0x7f263c154480 2023-11-15T01:22:05.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.904+0000 7f2641fca700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0ae7e0 con 0x7f263c1540a0 2023-11-15T01:22:05.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.905+0000 7f263b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c0c6650 0x7f263c14ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.905+0000 7f263b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c0c6650 0x7f263c14ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44620/0 (socket says 172.21.15.1:44620) 2023-11-15T01:22:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.905+0000 7f263b7fe700 1 -- 172.21.15.1:0/992745362 learned_addr learned my addr 172.21.15.1:0/992745362 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.905+0000 7f263b7fe700 1 -- 172.21.15.1:0/992745362 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f263c1540a0 msgr2=0x7f263c164b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.905+0000 7f263b7fe700 1 --2- 172.21.15.1:0/992745362 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f263c1540a0 0x7f263c164b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.905+0000 7f263b7fe700 1 -- 172.21.15.1:0/992745362 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f263c154480 msgr2=0x7f263c152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.905+0000 7f263b7fe700 1 --2- 172.21.15.1:0/992745362 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f263c154480 0x7f263c152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.905+0000 7f263b7fe700 1 -- 172.21.15.1:0/992745362 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c0092a0 con 0x7f263c0c6650 2023-11-15T01:22:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.905+0000 7f263b7fe700 1 --2- 172.21.15.1:0/992745362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c0c6650 0x7f263c14ed40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f262c009eb0 tx=0x7f262c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.905+0000 7f26237fe700 1 -- 172.21.15.1:0/992745362 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c00b7f0 con 0x7f263c0c6650 2023-11-15T01:22:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.905+0000 7f26237fe700 1 -- 172.21.15.1:0/992745362 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c00b950 con 0x7f263c0c6650 2023-11-15T01:22:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.905+0000 7f2641fca700 1 -- 172.21.15.1:0/992745362 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263c0aeac0 con 0x7f263c0c6650 2023-11-15T01:22:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.905+0000 7f26237fe700 1 -- 172.21.15.1:0/992745362 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c01b620 con 0x7f263c0c6650 2023-11-15T01:22:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.905+0000 7f2641fca700 1 -- 172.21.15.1:0/992745362 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263c14f230 con 0x7f263c0c6650 2023-11-15T01:22:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.906+0000 7f2641fca700 1 -- 172.21.15.1:0/992745362 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263c06c7e0 con 0x7f263c0c6650 2023-11-15T01:22:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.906+0000 7f26237fe700 1 -- 172.21.15.1:0/992745362 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f262c01b9d0 con 0x7f263c0c6650 2023-11-15T01:22:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.907+0000 7f26237fe700 1 --2- 172.21.15.1:0/992745362 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f262805f120 0x7f26280615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.907+0000 7f26237fe700 1 -- 172.21.15.1:0/992745362 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f262c07c020 con 0x7f263c0c6650 2023-11-15T01:22:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.907+0000 7f263affd700 1 --2- 172.21.15.1:0/992745362 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f262805f120 0x7f26280615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.908+0000 7f263affd700 1 --2- 172.21.15.1:0/992745362 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f262805f120 0x7f26280615e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f263c168030 tx=0x7f2630006ae0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:05.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:05.911+0000 7f26237fe700 1 -- 172.21.15.1:0/992745362 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f262c04d2f0 con 0x7f263c0c6650 2023-11-15T01:22:06.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.082+0000 7f2641fca700 1 -- 172.21.15.1:0/992745362 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f263c0c9ce0 con 0x7f263c0c6650 2023-11-15T01:22:06.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.083+0000 7f26237fe700 1 -- 172.21.15.1:0/992745362 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f262c050910 con 0x7f263c0c6650 2023-11-15T01:22:06.085 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:22:06.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.085+0000 7f2641fca700 1 -- 172.21.15.1:0/992745362 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f262805f120 msgr2=0x7f26280615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.085+0000 7f2641fca700 1 --2- 172.21.15.1:0/992745362 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f262805f120 0x7f26280615e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f263c168030 tx=0x7f2630006ae0).stop 2023-11-15T01:22:06.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.085+0000 7f2641fca700 1 -- 172.21.15.1:0/992745362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c0c6650 msgr2=0x7f263c14ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.085+0000 7f2641fca700 1 --2- 172.21.15.1:0/992745362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c0c6650 0x7f263c14ed40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f262c009eb0 tx=0x7f262c017000).stop 2023-11-15T01:22:06.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.085+0000 7f2641fca700 1 -- 172.21.15.1:0/992745362 shutdown_connections 2023-11-15T01:22:06.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.085+0000 7f2641fca700 1 --2- 172.21.15.1:0/992745362 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f262805f120 0x7f26280615e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.085+0000 7f2641fca700 1 --2- 172.21.15.1:0/992745362 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f263c154480 0x7f263c152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:06.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.085+0000 7f2641fca700 1 --2- 172.21.15.1:0/992745362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c0c6650 0x7f263c14ed40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.085+0000 7f2641fca700 1 --2- 172.21.15.1:0/992745362 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f263c1540a0 0x7f263c164b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:06.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.085+0000 7f2641fca700 1 -- 172.21.15.1:0/992745362 >> 172.21.15.1:0/992745362 conn(0x7f263c064a70 msgr2=0x7f263c064e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:06.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.085+0000 7f2641fca700 1 -- 172.21.15.1:0/992745362 shutdown_connections 2023-11-15T01:22:06.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.085+0000 7f2641fca700 1 -- 172.21.15.1:0/992745362 wait complete. 2023-11-15T01:22:06.098 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T01:22:06.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.217+0000 7f5c869be700 1 Processor -- start 2023-11-15T01:22:06.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.217+0000 7f5c869be700 1 -- start start 2023-11-15T01:22:06.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.218+0000 7f5c869be700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5c80154480 0x7f5c800c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.218+0000 7f5c869be700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c800ca050 con 0x7f5c801540a0 2023-11-15T01:22:06.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.218+0000 7f5c869be700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c800c68c0 con 0x7f5c800c6430 2023-11-15T01:22:06.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.218+0000 7f5c869be700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c800c9440 con 0x7f5c80154480 2023-11-15T01:22:06.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.218+0000 7f5c77fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5c80154480 0x7f5c800c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.218+0000 7f5c7ffff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5c801540a0 0x7f5c800ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34226/0 (socket says 172.21.15.1:34226) 2023-11-15T01:22:06.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.218+0000 7f5c7ffff700 1 -- 172.21.15.1:0/3798979183 learned_addr learned my addr 172.21.15.1:0/3798979183 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:06.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.219+0000 7f5c7f7fe700 1 -- 172.21.15.1:0/3798979183 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359241774 0 0) 0x7f5c800ca050 con 0x7f5c801540a0 2023-11-15T01:22:06.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.219+0000 7f5c7f7fe700 1 -- 172.21.15.1:0/3798979183 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c6c0033f0 con 0x7f5c801540a0 2023-11-15T01:22:06.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.219+0000 7f5c77fff700 1 -- 172.21.15.1:0/3798979183 >> v1:172.21.15.141:6789/0 conn(0x7f5c800c6430 legacy=0x7f5c800aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:06.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.219+0000 7f5c77fff700 1 -- 172.21.15.1:0/3798979183 >> v1:172.21.15.1:6789/0 conn(0x7f5c801540a0 legacy=0x7f5c800ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.219+0000 7f5c77fff700 1 -- 172.21.15.1:0/3798979183 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c800c9720 con 0x7f5c80154480 2023-11-15T01:22:06.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.219+0000 7f5c77fff700 1 --2- 172.21.15.1:0/3798979183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c80154480 0x7f5c800c5f40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f5c68009760 tx=0x7f5c68009060).ready entity=mon.0 client_cookie=b1bb4c6e3846392 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:06.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.219+0000 7f5c7f7fe700 1 -- 172.21.15.1:0/3798979183 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800f510 con 0x7f5c80154480 2023-11-15T01:22:06.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.219+0000 7f5c7f7fe700 1 -- 172.21.15.1:0/3798979183 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6800f670 con 0x7f5c80154480 2023-11-15T01:22:06.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.219+0000 7f5c7f7fe700 1 -- 172.21.15.1:0/3798979183 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800f9f0 con 0x7f5c80154480 2023-11-15T01:22:06.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.219+0000 7f5c869be700 1 -- 172.21.15.1:0/3798979183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c80154480 msgr2=0x7f5c800c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.219+0000 7f5c869be700 1 --2- 172.21.15.1:0/3798979183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c80154480 0x7f5c800c5f40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f5c68009760 tx=0x7f5c68009060).stop 2023-11-15T01:22:06.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.220+0000 7f5c869be700 1 -- 172.21.15.1:0/3798979183 shutdown_connections 2023-11-15T01:22:06.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.220+0000 7f5c869be700 1 --2- 172.21.15.1:0/3798979183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c80154480 0x7f5c800c5f40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.220+0000 7f5c869be700 1 -- 172.21.15.1:0/3798979183 >> 172.21.15.1:0/3798979183 conn(0x7f5c80064a70 msgr2=0x7f5c80064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:06.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.220+0000 7f5c869be700 1 -- 172.21.15.1:0/3798979183 shutdown_connections 2023-11-15T01:22:06.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.220+0000 7f5c869be700 1 -- 172.21.15.1:0/3798979183 wait complete. 2023-11-15T01:22:06.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.221+0000 7f5c869be700 1 Processor -- start 2023-11-15T01:22:06.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.221+0000 7f5c869be700 1 -- start start 2023-11-15T01:22:06.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.221+0000 7f5c869be700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c800c6430 0x7f5c801643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.221+0000 7f5c869be700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c801540a0 0x7f5c801648b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.221+0000 7f5c869be700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c80154480 0x7f5c800b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.221+0000 7f5c869be700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c80152f10 con 0x7f5c801540a0 2023-11-15T01:22:06.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.221+0000 7f5c869be700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800af050 con 0x7f5c80154480 2023-11-15T01:22:06.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.221+0000 7f5c869be700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800afb90 con 0x7f5c800c6430 2023-11-15T01:22:06.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c77fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c801540a0 0x7f5c801648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c77fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c801540a0 0x7f5c801648b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44644/0 (socket says 172.21.15.1:44644) 2023-11-15T01:22:06.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c77fff700 1 -- 172.21.15.1:0/2174182087 learned_addr learned my addr 172.21.15.1:0/2174182087 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:06.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c7ffff700 1 --2- 172.21.15.1:0/2174182087 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c800c6430 0x7f5c801643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c84f5b700 1 --2- 172.21.15.1:0/2174182087 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c80154480 0x7f5c800b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c77fff700 1 -- 172.21.15.1:0/2174182087 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c800c6430 msgr2=0x7f5c801643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c77fff700 1 --2- 172.21.15.1:0/2174182087 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c800c6430 0x7f5c801643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c77fff700 1 -- 172.21.15.1:0/2174182087 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c80154480 msgr2=0x7f5c800b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c77fff700 1 --2- 172.21.15.1:0/2174182087 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c80154480 0x7f5c800b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c77fff700 1 -- 172.21.15.1:0/2174182087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c680092a0 con 0x7f5c801540a0 2023-11-15T01:22:06.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c77fff700 1 --2- 172.21.15.1:0/2174182087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c801540a0 0x7f5c801648b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f5c68009e00 tx=0x7f5c68017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:06.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c7cff9700 1 -- 172.21.15.1:0/2174182087 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68000d10 con 0x7f5c801540a0 2023-11-15T01:22:06.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c7cff9700 1 -- 172.21.15.1:0/2174182087 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6800f9f0 con 0x7f5c801540a0 2023-11-15T01:22:06.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c869be700 1 -- 172.21.15.1:0/2174182087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c800af260 con 0x7f5c801540a0 2023-11-15T01:22:06.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c7cff9700 1 -- 172.21.15.1:0/2174182087 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6801b660 con 0x7f5c801540a0 2023-11-15T01:22:06.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.222+0000 7f5c869be700 1 -- 172.21.15.1:0/2174182087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c800af5f0 con 0x7f5c801540a0 2023-11-15T01:22:06.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.223+0000 7f5c869be700 1 -- 172.21.15.1:0/2174182087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8006c7e0 con 0x7f5c801540a0 2023-11-15T01:22:06.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.223+0000 7f5c7cff9700 1 -- 172.21.15.1:0/2174182087 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5c6801ba90 con 0x7f5c801540a0 2023-11-15T01:22:06.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.224+0000 7f5c7cff9700 1 --2- 172.21.15.1:0/2174182087 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5c6005f120 0x7f5c600615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.224+0000 7f5c7cff9700 1 -- 172.21.15.1:0/2174182087 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5c6807ba30 con 0x7f5c801540a0 2023-11-15T01:22:06.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.224+0000 7f5c7ffff700 1 --2- 172.21.15.1:0/2174182087 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5c6005f120 0x7f5c600615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.224+0000 7f5c7ffff700 1 --2- 172.21.15.1:0/2174182087 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5c6005f120 0x7f5c600615e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f5c70005750 tx=0x7f5c70009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:06.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.228+0000 7f5c7cff9700 1 -- 172.21.15.1:0/2174182087 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5c6804cd00 con 0x7f5c801540a0 2023-11-15T01:22:06.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.398+0000 7f5c869be700 1 -- 172.21.15.1:0/2174182087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c800af3f0 con 0x7f5c801540a0 2023-11-15T01:22:06.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.398+0000 7f5c7cff9700 1 -- 172.21.15.1:0/2174182087 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5c68050320 con 0x7f5c801540a0 2023-11-15T01:22:06.400 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:22:06.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.400+0000 7f5c869be700 1 -- 172.21.15.1:0/2174182087 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5c6005f120 msgr2=0x7f5c600615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.400+0000 7f5c869be700 1 --2- 172.21.15.1:0/2174182087 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5c6005f120 0x7f5c600615e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f5c70005750 tx=0x7f5c70009040).stop 2023-11-15T01:22:06.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.400+0000 7f5c869be700 1 -- 172.21.15.1:0/2174182087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c801540a0 msgr2=0x7f5c801648b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.400+0000 7f5c869be700 1 --2- 172.21.15.1:0/2174182087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c801540a0 0x7f5c801648b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f5c68009e00 tx=0x7f5c68017000).stop 2023-11-15T01:22:06.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.400+0000 7f5c869be700 1 -- 172.21.15.1:0/2174182087 shutdown_connections 2023-11-15T01:22:06.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.400+0000 7f5c869be700 1 --2- 172.21.15.1:0/2174182087 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5c6005f120 0x7f5c600615e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.400+0000 7f5c869be700 1 --2- 172.21.15.1:0/2174182087 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c80154480 0x7f5c800b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.400+0000 7f5c869be700 1 --2- 172.21.15.1:0/2174182087 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c800c6430 0x7f5c801643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.400+0000 7f5c869be700 1 --2- 172.21.15.1:0/2174182087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c801540a0 0x7f5c801648b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.400+0000 7f5c869be700 1 -- 172.21.15.1:0/2174182087 >> 172.21.15.1:0/2174182087 conn(0x7f5c80064a70 msgr2=0x7f5c8014edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:06.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.400+0000 7f5c869be700 1 -- 172.21.15.1:0/2174182087 shutdown_connections 2023-11-15T01:22:06.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.400+0000 7f5c869be700 1 -- 172.21.15.1:0/2174182087 wait complete. 2023-11-15T01:22:06.414 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T01:22:06.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.533+0000 7fbb3450e700 1 Processor -- start 2023-11-15T01:22:06.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.533+0000 7fbb3450e700 1 -- start start 2023-11-15T01:22:06.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.534+0000 7fbb3450e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbb2c1540a0 0x7fbb2c0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.534+0000 7fbb3450e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c0ca050 con 0x7fbb2c0c6650 2023-11-15T01:22:06.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.534+0000 7fbb3450e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c0c9440 con 0x7fbb2c154480 2023-11-15T01:22:06.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.534+0000 7fbb3450e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2c0c9720 con 0x7fbb2c1540a0 2023-11-15T01:22:06.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.534+0000 7fbb32aab700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fbb2c0c6650 0x7fbb2c0aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34236/0 (socket says 172.21.15.1:34236) 2023-11-15T01:22:06.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.534+0000 7fbb32aab700 1 -- 172.21.15.1:0/2757604318 learned_addr learned my addr 172.21.15.1:0/2757604318 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:06.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.534+0000 7fbb322aa700 1 --2- 172.21.15.1:0/2757604318 >> v2:172.21.15.141:3300/0 conn(0x7fbb2c1540a0 0x7fbb2c0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.534+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556983431 0 0) 0x7fbb2c0ca050 con 0x7fbb2c0c6650 2023-11-15T01:22:06.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.534+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb140033f0 con 0x7fbb2c0c6650 2023-11-15T01:22:06.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619383283 0 0) 0x7fbb2c0c9440 con 0x7fbb2c154480 2023-11-15T01:22:06.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb2c0ca050 con 0x7fbb2c154480 2023-11-15T01:22:06.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2564488143 0 0) 0x7fbb140033f0 con 0x7fbb2c0c6650 2023-11-15T01:22:06.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 >> v2:172.21.15.141:3300/0 conn(0x7fbb2c1540a0 msgr2=0x7fbb2c0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:06.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 --2- 172.21.15.1:0/2757604318 >> v2:172.21.15.141:3300/0 conn(0x7fbb2c1540a0 0x7fbb2c0ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 >> v1:172.21.15.141:6789/0 conn(0x7fbb2c154480 legacy=0x7fbb2c0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0c9a00 con 0x7fbb2c0c6650 2023-11-15T01:22:06.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fbb1c0017f0 con 0x7fbb2c0c6650 2023-11-15T01:22:06.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 >> v1:172.21.15.1:6789/0 conn(0x7fbb2c0c6650 legacy=0x7fbb2c0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 --2- 172.21.15.1:0/2757604318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb14003ac0 0x7fbb14003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 --2- 172.21.15.1:0/2757604318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb14004690 0x7fbb14004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 --2- 172.21.15.1:0/2757604318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb14005000 0x7fbb1400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0c9720 con 0x7fbb14005000 2023-11-15T01:22:06.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1400beb0 con 0x7fbb14003ac0 2023-11-15T01:22:06.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1400c070 con 0x7fbb14004690 2023-11-15T01:22:06.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb32aab700 1 --2- 172.21.15.1:0/2757604318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb14005000 0x7fbb1400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb322aa700 1 --2- 172.21.15.1:0/2757604318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb14003ac0 0x7fbb14003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb31aa9700 1 --2- 172.21.15.1:0/2757604318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb14004690 0x7fbb14004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb32aab700 1 -- 172.21.15.1:0/2757604318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb14004690 msgr2=0x7fbb14004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:06.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb32aab700 1 --2- 172.21.15.1:0/2757604318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb14004690 0x7fbb14004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb32aab700 1 -- 172.21.15.1:0/2757604318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb14003ac0 msgr2=0x7fbb14003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:06.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb32aab700 1 --2- 172.21.15.1:0/2757604318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb14003ac0 0x7fbb14003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb32aab700 1 -- 172.21.15.1:0/2757604318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb140033f0 con 0x7fbb14005000 2023-11-15T01:22:06.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb32aab700 1 -- 172.21.15.1:0/2757604318 reap_dead start 2023-11-15T01:22:06.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb32aab700 1 --2- 172.21.15.1:0/2757604318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb14005000 0x7fbb1400b8e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fbb2c0aad30 tx=0x7fbb1c007f40).ready entity=mon.0 client_cookie=b4ef06199d3996a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c00cc80 con 0x7fbb14005000 2023-11-15T01:22:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c00cde0 con 0x7fbb14005000 2023-11-15T01:22:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.535+0000 7fbb312a8700 1 -- 172.21.15.1:0/2757604318 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c005d70 con 0x7fbb14005000 2023-11-15T01:22:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.536+0000 7fbb3450e700 1 -- 172.21.15.1:0/2757604318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb14005000 msgr2=0x7fbb1400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.536+0000 7fbb3450e700 1 --2- 172.21.15.1:0/2757604318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb14005000 0x7fbb1400b8e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fbb2c0aad30 tx=0x7fbb1c007f40).stop 2023-11-15T01:22:06.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.536+0000 7fbb3450e700 1 -- 172.21.15.1:0/2757604318 shutdown_connections 2023-11-15T01:22:06.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.536+0000 7fbb3450e700 1 --2- 172.21.15.1:0/2757604318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb14005000 0x7fbb1400b8e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.536+0000 7fbb3450e700 1 -- 172.21.15.1:0/2757604318 >> 172.21.15.1:0/2757604318 conn(0x7fbb2c064a70 msgr2=0x7fbb2c064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:06.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.536+0000 7fbb3450e700 1 -- 172.21.15.1:0/2757604318 shutdown_connections 2023-11-15T01:22:06.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.536+0000 7fbb3450e700 1 -- 172.21.15.1:0/2757604318 wait complete. 2023-11-15T01:22:06.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.537+0000 7fbb3450e700 1 Processor -- start 2023-11-15T01:22:06.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.537+0000 7fbb3450e700 1 -- start start 2023-11-15T01:22:06.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb3450e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb14005000 0x7fbb2c157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb3450e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb2c158660 0x7fbb2c144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb3450e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb2c0c43d0 0x7fbb2c0c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb3450e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0c25d0 con 0x7fbb2c0c43d0 2023-11-15T01:22:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb3450e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c158ae0 con 0x7fbb2c158660 2023-11-15T01:22:06.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb3450e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0c4d40 con 0x7fbb14005000 2023-11-15T01:22:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb32aab700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb2c0c43d0 0x7fbb2c0c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb32aab700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb2c0c43d0 0x7fbb2c0c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44664/0 (socket says 172.21.15.1:44664) 2023-11-15T01:22:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb32aab700 1 -- 172.21.15.1:0/4079290386 learned_addr learned my addr 172.21.15.1:0/4079290386 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb322aa700 1 --2- 172.21.15.1:0/4079290386 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb14005000 0x7fbb2c157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb31aa9700 1 --2- 172.21.15.1:0/4079290386 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb2c158660 0x7fbb2c144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb32aab700 1 -- 172.21.15.1:0/4079290386 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb14005000 msgr2=0x7fbb2c157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb32aab700 1 --2- 172.21.15.1:0/4079290386 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb14005000 0x7fbb2c157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb32aab700 1 -- 172.21.15.1:0/4079290386 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb2c158660 msgr2=0x7fbb2c144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb32aab700 1 --2- 172.21.15.1:0/4079290386 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb2c158660 0x7fbb2c144b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.538+0000 7fbb32aab700 1 -- 172.21.15.1:0/4079290386 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0c22a0 con 0x7fbb2c0c43d0 2023-11-15T01:22:06.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.539+0000 7fbb32aab700 1 --2- 172.21.15.1:0/4079290386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb2c0c43d0 0x7fbb2c0c4850 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fbb1c001d40 tx=0x7fbb1c013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:06.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.539+0000 7fbb2a7fc700 1 -- 172.21.15.1:0/4079290386 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c004a30 con 0x7fbb2c0c43d0 2023-11-15T01:22:06.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.539+0000 7fbb2a7fc700 1 -- 172.21.15.1:0/4079290386 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c004b90 con 0x7fbb2c0c43d0 2023-11-15T01:22:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.539+0000 7fbb3450e700 1 -- 172.21.15.1:0/4079290386 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2c158d40 con 0x7fbb2c0c43d0 2023-11-15T01:22:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.539+0000 7fbb2a7fc700 1 -- 172.21.15.1:0/4079290386 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c013450 con 0x7fbb2c0c43d0 2023-11-15T01:22:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.539+0000 7fbb3450e700 1 -- 172.21.15.1:0/4079290386 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2c159300 con 0x7fbb2c0c43d0 2023-11-15T01:22:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.540+0000 7fbb3450e700 1 -- 172.21.15.1:0/4079290386 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2c06c7e0 con 0x7fbb2c0c43d0 2023-11-15T01:22:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.540+0000 7fbb2a7fc700 1 -- 172.21.15.1:0/4079290386 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbb1c013800 con 0x7fbb2c0c43d0 2023-11-15T01:22:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.540+0000 7fbb2a7fc700 1 --2- 172.21.15.1:0/4079290386 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb1805f150 0x7fbb18061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.541+0000 7fbb2a7fc700 1 -- 172.21.15.1:0/4079290386 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbb1c07ae30 con 0x7fbb2c0c43d0 2023-11-15T01:22:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.541+0000 7fbb322aa700 1 --2- 172.21.15.1:0/4079290386 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb1805f150 0x7fbb18061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.541+0000 7fbb322aa700 1 --2- 172.21.15.1:0/4079290386 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb1805f150 0x7fbb18061610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fbb24006d80 tx=0x7fbb24009060).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:06.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.545+0000 7fbb2a7fc700 1 -- 172.21.15.1:0/4079290386 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbb1c04c1a0 con 0x7fbb2c0c43d0 2023-11-15T01:22:06.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.717+0000 7fbb3450e700 1 -- 172.21.15.1:0/4079290386 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb2c0c20f0 con 0x7fbb2c0c43d0 2023-11-15T01:22:06.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.718+0000 7fbb2a7fc700 1 -- 172.21.15.1:0/4079290386 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb1c024020 con 0x7fbb2c0c43d0 2023-11-15T01:22:06.720 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:22:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.720+0000 7fbb3450e700 1 -- 172.21.15.1:0/4079290386 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb1805f150 msgr2=0x7fbb18061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.720+0000 7fbb3450e700 1 --2- 172.21.15.1:0/4079290386 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb1805f150 0x7fbb18061610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fbb24006d80 tx=0x7fbb24009060).stop 2023-11-15T01:22:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.720+0000 7fbb3450e700 1 -- 172.21.15.1:0/4079290386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb2c0c43d0 msgr2=0x7fbb2c0c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.720+0000 7fbb3450e700 1 --2- 172.21.15.1:0/4079290386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb2c0c43d0 0x7fbb2c0c4850 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fbb1c001d40 tx=0x7fbb1c013000).stop 2023-11-15T01:22:06.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.720+0000 7fbb3450e700 1 -- 172.21.15.1:0/4079290386 shutdown_connections 2023-11-15T01:22:06.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.720+0000 7fbb3450e700 1 --2- 172.21.15.1:0/4079290386 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb1805f150 0x7fbb18061610 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.720+0000 7fbb3450e700 1 --2- 172.21.15.1:0/4079290386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb2c0c43d0 0x7fbb2c0c4850 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.720+0000 7fbb3450e700 1 --2- 172.21.15.1:0/4079290386 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb14005000 0x7fbb2c157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.720+0000 7fbb3450e700 1 --2- 172.21.15.1:0/4079290386 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb2c158660 0x7fbb2c144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.720+0000 7fbb3450e700 1 -- 172.21.15.1:0/4079290386 >> 172.21.15.1:0/4079290386 conn(0x7fbb2c064a70 msgr2=0x7fbb2c0c0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:06.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.720+0000 7fbb3450e700 1 -- 172.21.15.1:0/4079290386 shutdown_connections 2023-11-15T01:22:06.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.720+0000 7fbb3450e700 1 -- 172.21.15.1:0/4079290386 wait complete. 2023-11-15T01:22:06.742 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-11-15T01:22:06.743 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-15T01:22:06.744 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-11-15T01:22:06.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.860+0000 7f50eb59e700 1 Processor -- start 2023-11-15T01:22:06.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.860+0000 7f50eb59e700 1 -- start start 2023-11-15T01:22:06.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.861+0000 7f50eb59e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50ec151e10 0x7f50ec155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.861+0000 7f50eb59e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ec0c7980 con 0x7f50ec0c86b0 2023-11-15T01:22:06.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.861+0000 7f50eb59e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ec0c8b10 con 0x7f50ec0c98b0 2023-11-15T01:22:06.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.861+0000 7f50eb59e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec0aa890 con 0x7f50ec151e10 2023-11-15T01:22:06.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.861+0000 7f50e9d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f50ec0c86b0 0x7f50ec0aa0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34242/0 (socket says 172.21.15.1:34242) 2023-11-15T01:22:06.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.861+0000 7f50e9d9b700 1 -- 172.21.15.1:0/3119270626 learned_addr learned my addr 172.21.15.1:0/3119270626 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:06.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.861+0000 7f50ea59c700 1 --2- 172.21.15.1:0/3119270626 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50ec151e10 0x7f50ec155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.862+0000 7f50e959a700 1 -- 172.21.15.1:0/3119270626 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334217859 0 0) 0x7f50ec0c7980 con 0x7f50ec0c86b0 2023-11-15T01:22:06.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.862+0000 7f50e959a700 1 -- 172.21.15.1:0/3119270626 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50d80033f0 con 0x7f50ec0c86b0 2023-11-15T01:22:06.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.862+0000 7f50e959a700 1 -- 172.21.15.1:0/3119270626 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891688319 0 0) 0x7f50ec0c8b10 con 0x7f50ec0c98b0 2023-11-15T01:22:06.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.862+0000 7f50e959a700 1 -- 172.21.15.1:0/3119270626 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50ec0c7980 con 0x7f50ec0c98b0 2023-11-15T01:22:06.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.862+0000 7f50ea59c700 1 -- 172.21.15.1:0/3119270626 >> v1:172.21.15.141:6789/0 conn(0x7f50ec0c98b0 legacy=0x7f50ec0c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.862+0000 7f50e959a700 1 -- 172.21.15.1:0/3119270626 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4034301885 0 0) 0x7f50d80033f0 con 0x7f50ec0c86b0 2023-11-15T01:22:06.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.862+0000 7f50ea59c700 1 -- 172.21.15.1:0/3119270626 >> v1:172.21.15.1:6789/0 conn(0x7f50ec0c86b0 legacy=0x7f50ec0aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.862+0000 7f50ea59c700 1 -- 172.21.15.1:0/3119270626 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec0c7bd0 con 0x7f50ec151e10 2023-11-15T01:22:06.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.862+0000 7f50ea59c700 1 --2- 172.21.15.1:0/3119270626 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50ec151e10 0x7f50ec155530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f50e4009790 tx=0x7f50e4009060).ready entity=mon.2 client_cookie=aab6e7c5717bcbe4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:06.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.862+0000 7f50e959a700 1 -- 172.21.15.1:0/3119270626 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4001470 con 0x7f50ec151e10 2023-11-15T01:22:06.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.862+0000 7f50e959a700 1 -- 172.21.15.1:0/3119270626 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e4011400 con 0x7f50ec151e10 2023-11-15T01:22:06.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.862+0000 7f50e959a700 1 -- 172.21.15.1:0/3119270626 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4011780 con 0x7f50ec151e10 2023-11-15T01:22:06.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.863+0000 7f50eb59e700 1 -- 172.21.15.1:0/3119270626 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50ec151e10 msgr2=0x7f50ec155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.863+0000 7f50eb59e700 1 --2- 172.21.15.1:0/3119270626 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50ec151e10 0x7f50ec155530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f50e4009790 tx=0x7f50e4009060).stop 2023-11-15T01:22:06.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.863+0000 7f50eb59e700 1 -- 172.21.15.1:0/3119270626 shutdown_connections 2023-11-15T01:22:06.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.863+0000 7f50eb59e700 1 --2- 172.21.15.1:0/3119270626 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50ec151e10 0x7f50ec155530 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.863+0000 7f50eb59e700 1 -- 172.21.15.1:0/3119270626 >> 172.21.15.1:0/3119270626 conn(0x7f50ec0947e0 msgr2=0x7f50ec06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:06.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.863+0000 7f50eb59e700 1 -- 172.21.15.1:0/3119270626 shutdown_connections 2023-11-15T01:22:06.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.863+0000 7f50eb59e700 1 -- 172.21.15.1:0/3119270626 wait complete. 2023-11-15T01:22:06.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.864+0000 7f50eb59e700 1 Processor -- start 2023-11-15T01:22:06.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.864+0000 7f50eb59e700 1 -- start start 2023-11-15T01:22:06.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50eb59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50ec0c86b0 0x7f50ec14ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50eb59e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50ec0c98b0 0x7f50ec0aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50eb59e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f50ec151e10 0x7f50ec0a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50eb59e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec0b0530 con 0x7f50ec0c86b0 2023-11-15T01:22:06.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50eb59e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec0af920 con 0x7f50ec151e10 2023-11-15T01:22:06.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50eb59e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec0afc00 con 0x7f50ec0c98b0 2023-11-15T01:22:06.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50ea59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50ec0c86b0 0x7f50ec14ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50ea59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50ec0c86b0 0x7f50ec14ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44676/0 (socket says 172.21.15.1:44676) 2023-11-15T01:22:06.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50ea59c700 1 -- 172.21.15.1:0/2277566291 learned_addr learned my addr 172.21.15.1:0/2277566291 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:06.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50e9d9b700 1 --2- 172.21.15.1:0/2277566291 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50ec0c98b0 0x7f50ec0aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50ead9d700 1 --2- 172.21.15.1:0/2277566291 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f50ec151e10 0x7f50ec0a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50ea59c700 1 -- 172.21.15.1:0/2277566291 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50ec0c98b0 msgr2=0x7f50ec0aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50ea59c700 1 --2- 172.21.15.1:0/2277566291 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50ec0c98b0 0x7f50ec0aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50ea59c700 1 -- 172.21.15.1:0/2277566291 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f50ec151e10 msgr2=0x7f50ec0a9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:06.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50ea59c700 1 --2- 172.21.15.1:0/2277566291 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f50ec151e10 0x7f50ec0a9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:06.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50ea59c700 1 -- 172.21.15.1:0/2277566291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e40092a0 con 0x7f50ec0c86b0 2023-11-15T01:22:06.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50e9d9b700 1 --2- 172.21.15.1:0/2277566291 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50ec0c98b0 0x7f50ec0aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:06.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50ea59c700 1 --2- 172.21.15.1:0/2277566291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50ec0c86b0 0x7f50ec14ed50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f50ec084670 tx=0x7f50e4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:06.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50e27fc700 1 -- 172.21.15.1:0/2277566291 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4010870 con 0x7f50ec0c86b0 2023-11-15T01:22:06.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50e27fc700 1 -- 172.21.15.1:0/2277566291 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e40109d0 con 0x7f50ec0c86b0 2023-11-15T01:22:06.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50e27fc700 1 -- 172.21.15.1:0/2277566291 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4010d90 con 0x7f50ec0c86b0 2023-11-15T01:22:06.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50eb59e700 1 -- 172.21.15.1:0/2277566291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ec0afee0 con 0x7f50ec0c86b0 2023-11-15T01:22:06.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.865+0000 7f50eb59e700 1 -- 172.21.15.1:0/2277566291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ec14f240 con 0x7f50ec0c86b0 2023-11-15T01:22:06.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.866+0000 7f50eb59e700 1 -- 172.21.15.1:0/2277566291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ec0475e0 con 0x7f50ec0c86b0 2023-11-15T01:22:06.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.867+0000 7f50e27fc700 1 -- 172.21.15.1:0/2277566291 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f50e40263b0 con 0x7f50ec0c86b0 2023-11-15T01:22:06.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.867+0000 7f50e27fc700 1 --2- 172.21.15.1:0/2277566291 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f50cc05f1d0 0x7f50cc061690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:06.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.867+0000 7f50e27fc700 1 -- 172.21.15.1:0/2277566291 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f50e407ae00 con 0x7f50ec0c86b0 2023-11-15T01:22:06.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.867+0000 7f50e9d9b700 1 --2- 172.21.15.1:0/2277566291 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f50cc05f1d0 0x7f50cc061690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:06.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.868+0000 7f50e9d9b700 1 --2- 172.21.15.1:0/2277566291 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f50cc05f1d0 0x7f50cc061690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f50d40015a0 tx=0x7f50d4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:06.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:06.871+0000 7f50e27fc700 1 -- 172.21.15.1:0/2277566291 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f50e404c110 con 0x7f50ec0c86b0 2023-11-15T01:22:07.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.115+0000 7f50eb59e700 1 -- 172.21.15.1:0/2277566291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f50ec0c7eb0 con 0x7f50ec0c86b0 2023-11-15T01:22:07.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.789+0000 7f50e27fc700 1 -- 172.21.15.1:0/2277566291 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7f50e4022070 con 0x7f50ec0c86b0 2023-11-15T01:22:07.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.791+0000 7f50eb59e700 1 -- 172.21.15.1:0/2277566291 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f50cc05f1d0 msgr2=0x7f50cc061690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:07.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.791+0000 7f50eb59e700 1 --2- 172.21.15.1:0/2277566291 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f50cc05f1d0 0x7f50cc061690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f50d40015a0 tx=0x7f50d4009040).stop 2023-11-15T01:22:07.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.791+0000 7f50eb59e700 1 -- 172.21.15.1:0/2277566291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50ec0c86b0 msgr2=0x7f50ec14ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:07.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.791+0000 7f50eb59e700 1 --2- 172.21.15.1:0/2277566291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50ec0c86b0 0x7f50ec14ed50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f50ec084670 tx=0x7f50e4016000).stop 2023-11-15T01:22:07.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.791+0000 7f50eb59e700 1 -- 172.21.15.1:0/2277566291 shutdown_connections 2023-11-15T01:22:07.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.791+0000 7f50eb59e700 1 --2- 172.21.15.1:0/2277566291 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f50cc05f1d0 0x7f50cc061690 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:07.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.791+0000 7f50eb59e700 1 --2- 172.21.15.1:0/2277566291 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f50ec151e10 0x7f50ec0a9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:07.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.791+0000 7f50eb59e700 1 --2- 172.21.15.1:0/2277566291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50ec0c86b0 0x7f50ec14ed50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:07.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.791+0000 7f50eb59e700 1 --2- 172.21.15.1:0/2277566291 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50ec0c98b0 0x7f50ec0aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:07.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.791+0000 7f50eb59e700 1 -- 172.21.15.1:0/2277566291 >> 172.21.15.1:0/2277566291 conn(0x7f50ec0947e0 msgr2=0x7f50ec154c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:07.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.791+0000 7f50eb59e700 1 -- 172.21.15.1:0/2277566291 shutdown_connections 2023-11-15T01:22:07.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.791+0000 7f50eb59e700 1 -- 172.21.15.1:0/2277566291 wait complete. 2023-11-15T01:22:07.807 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-15T01:22:07.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.933+0000 7f3dd759e700 1 Processor -- start 2023-11-15T01:22:07.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.933+0000 7f3dd759e700 1 -- start start 2023-11-15T01:22:07.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd759e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd81541d0 0x7f3dd81545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:07.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd759e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3dd80c8170 0x7f3dd80c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:07.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd759e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd8155830 con 0x7f3dd80c60d0 2023-11-15T01:22:07.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd759e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd8158f40 con 0x7f3dd80c8170 2023-11-15T01:22:07.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd759e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8154c20 con 0x7f3dd81541d0 2023-11-15T01:22:07.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd6d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3dd80c8170 0x7f3dd80c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:07.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd6d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3dd80c8170 0x7f3dd80c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43708/0 (socket says 172.21.15.1:43708) 2023-11-15T01:22:07.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd5d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3dd80c60d0 0x7f3dd80c7a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:33432/0 (socket says 172.21.15.1:33432) 2023-11-15T01:22:07.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd6d9d700 1 -- 172.21.15.1:0/4294436282 learned_addr learned my addr 172.21.15.1:0/4294436282 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:07.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd659c700 1 --2- 172.21.15.1:0/4294436282 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd81541d0 0x7f3dd81545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:07.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd6d9d700 1 -- 172.21.15.1:0/4294436282 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd81541d0 msgr2=0x7f3dd81545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:07.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd6d9d700 1 --2- 172.21.15.1:0/4294436282 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd81541d0 0x7f3dd81545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:07.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd6d9d700 1 -- 172.21.15.1:0/4294436282 >> v1:172.21.15.1:6789/0 conn(0x7f3dd80c60d0 legacy=0x7f3dd80c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:07.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd6d9d700 1 -- 172.21.15.1:0/4294436282 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd8154f00 con 0x7f3dd80c8170 2023-11-15T01:22:07.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd659c700 1 --2- 172.21.15.1:0/4294436282 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd81541d0 0x7f3dd81545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:07.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.934+0000 7f3dd6d9d700 1 --2- 172.21.15.1:0/4294436282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dd80c8170 0x7f3dd80c6550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f3dd0009f20 tx=0x7f3dd0009840).ready entity=mon.0 client_cookie=bcc012b3d91a52d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:07.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.935+0000 7f3dd559a700 1 -- 172.21.15.1:0/4294436282 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd000e070 con 0x7f3dd80c8170 2023-11-15T01:22:07.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.935+0000 7f3dd559a700 1 -- 172.21.15.1:0/4294436282 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd000ba80 con 0x7f3dd80c8170 2023-11-15T01:22:07.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.935+0000 7f3dd559a700 1 -- 172.21.15.1:0/4294436282 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd000be00 con 0x7f3dd80c8170 2023-11-15T01:22:07.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.935+0000 7f3dd759e700 1 -- 172.21.15.1:0/4294436282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dd80c8170 msgr2=0x7f3dd80c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:07.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.935+0000 7f3dd759e700 1 --2- 172.21.15.1:0/4294436282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dd80c8170 0x7f3dd80c6550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f3dd0009f20 tx=0x7f3dd0009840).stop 2023-11-15T01:22:07.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.935+0000 7f3dd759e700 1 -- 172.21.15.1:0/4294436282 shutdown_connections 2023-11-15T01:22:07.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.935+0000 7f3dd759e700 1 --2- 172.21.15.1:0/4294436282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dd80c8170 0x7f3dd80c6550 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:07.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.935+0000 7f3dd759e700 1 --2- 172.21.15.1:0/4294436282 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd81541d0 0x7f3dd81545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:07.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.935+0000 7f3dd759e700 1 -- 172.21.15.1:0/4294436282 >> 172.21.15.1:0/4294436282 conn(0x7f3dd8069ee0 msgr2=0x7f3dd806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:07.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.935+0000 7f3dd759e700 1 -- 172.21.15.1:0/4294436282 shutdown_connections 2023-11-15T01:22:07.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.935+0000 7f3dd759e700 1 -- 172.21.15.1:0/4294436282 wait complete. 2023-11-15T01:22:07.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.936+0000 7f3dd759e700 1 Processor -- start 2023-11-15T01:22:07.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.936+0000 7f3dd759e700 1 -- start start 2023-11-15T01:22:07.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.937+0000 7f3dd759e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dd80c60d0 0x7f3dd80b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:07.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.937+0000 7f3dd759e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dd80c8170 0x7f3dd80acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:07.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.937+0000 7f3dd759e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd81541d0 0x7f3dd80ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:07.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.937+0000 7f3dd759e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80ad9b0 con 0x7f3dd80c60d0 2023-11-15T01:22:07.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.937+0000 7f3dd759e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80b0670 con 0x7f3dd80c8170 2023-11-15T01:22:07.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.937+0000 7f3dd759e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd81475c0 con 0x7f3dd81541d0 2023-11-15T01:22:07.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.937+0000 7f3dd659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dd80c60d0 0x7f3dd80b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:07.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.937+0000 7f3dd659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dd80c60d0 0x7f3dd80b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43722/0 (socket says 172.21.15.1:43722) 2023-11-15T01:22:07.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.937+0000 7f3dd659c700 1 -- 172.21.15.1:0/466891553 learned_addr learned my addr 172.21.15.1:0/466891553 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:07.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.937+0000 7f3dd6d9d700 1 --2- 172.21.15.1:0/466891553 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd81541d0 0x7f3dd80ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:07.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.937+0000 7f3dd5d9b700 1 --2- 172.21.15.1:0/466891553 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dd80c8170 0x7f3dd80acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:07.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.938+0000 7f3dd659c700 1 -- 172.21.15.1:0/466891553 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd81541d0 msgr2=0x7f3dd80ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:07.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.938+0000 7f3dd659c700 1 --2- 172.21.15.1:0/466891553 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd81541d0 0x7f3dd80ad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:07.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.938+0000 7f3dd659c700 1 -- 172.21.15.1:0/466891553 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dd80c8170 msgr2=0x7f3dd80acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:07.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.938+0000 7f3dd659c700 1 --2- 172.21.15.1:0/466891553 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dd80c8170 0x7f3dd80acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:07.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.938+0000 7f3dd659c700 1 -- 172.21.15.1:0/466891553 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd0009ae0 con 0x7f3dd80c60d0 2023-11-15T01:22:07.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.938+0000 7f3dd659c700 1 --2- 172.21.15.1:0/466891553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dd80c60d0 0x7f3dd80b0180 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f3dc800c880 tx=0x7f3dc8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:07.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.938+0000 7f3dc67fc700 1 -- 172.21.15.1:0/466891553 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8010580 con 0x7f3dd80c60d0 2023-11-15T01:22:07.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.938+0000 7f3dc67fc700 1 -- 172.21.15.1:0/466891553 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc80106e0 con 0x7f3dd80c60d0 2023-11-15T01:22:07.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.938+0000 7f3dc67fc700 1 -- 172.21.15.1:0/466891553 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8010a60 con 0x7f3dd80c60d0 2023-11-15T01:22:07.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.938+0000 7f3dd759e700 1 -- 172.21.15.1:0/466891553 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd81478a0 con 0x7f3dd80c60d0 2023-11-15T01:22:07.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.938+0000 7f3dd759e700 1 -- 172.21.15.1:0/466891553 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd8147e60 con 0x7f3dd80c60d0 2023-11-15T01:22:07.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.939+0000 7f3dd759e700 1 -- 172.21.15.1:0/466891553 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd80475e0 con 0x7f3dd80c60d0 2023-11-15T01:22:07.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.939+0000 7f3dc67fc700 1 -- 172.21.15.1:0/466891553 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3dc801b460 con 0x7f3dd80c60d0 2023-11-15T01:22:07.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.940+0000 7f3dc67fc700 1 --2- 172.21.15.1:0/466891553 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3db805f150 0x7f3db8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:07.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.940+0000 7f3dc67fc700 1 -- 172.21.15.1:0/466891553 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3dc8079fa0 con 0x7f3dd80c60d0 2023-11-15T01:22:07.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.940+0000 7f3dd5d9b700 1 --2- 172.21.15.1:0/466891553 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3db805f150 0x7f3db8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:07.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.940+0000 7f3dd5d9b700 1 --2- 172.21.15.1:0/466891553 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3db805f150 0x7f3db8061610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3dd80c3b50 tx=0x7f3dcc007d30).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:07.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:07.944+0000 7f3dc67fc700 1 -- 172.21.15.1:0/466891553 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3dc80a8af0 con 0x7f3dd80c60d0 2023-11-15T01:22:08.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.119+0000 7f3dd759e700 1 -- 172.21.15.1:0/466891553 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3dd81551e0 con 0x7f3dd80c60d0 2023-11-15T01:22:08.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.122+0000 7f3dc67fc700 1 -- 172.21.15.1:0/466891553 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3dc804b210 con 0x7f3dd80c60d0 2023-11-15T01:22:08.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.124+0000 7f3dd759e700 1 -- 172.21.15.1:0/466891553 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3db805f150 msgr2=0x7f3db8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:08.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.124+0000 7f3dd759e700 1 --2- 172.21.15.1:0/466891553 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3db805f150 0x7f3db8061610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3dd80c3b50 tx=0x7f3dcc007d30).stop 2023-11-15T01:22:08.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.124+0000 7f3dd759e700 1 -- 172.21.15.1:0/466891553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dd80c60d0 msgr2=0x7f3dd80b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:08.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.124+0000 7f3dd759e700 1 --2- 172.21.15.1:0/466891553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dd80c60d0 0x7f3dd80b0180 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f3dc800c880 tx=0x7f3dc8008040).stop 2023-11-15T01:22:08.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.124+0000 7f3dd759e700 1 -- 172.21.15.1:0/466891553 shutdown_connections 2023-11-15T01:22:08.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.124+0000 7f3dd759e700 1 --2- 172.21.15.1:0/466891553 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3db805f150 0x7f3db8061610 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:08.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.124+0000 7f3dd759e700 1 --2- 172.21.15.1:0/466891553 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd81541d0 0x7f3dd80ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:08.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.124+0000 7f3dd759e700 1 --2- 172.21.15.1:0/466891553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dd80c60d0 0x7f3dd80b0180 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:08.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.124+0000 7f3dd759e700 1 --2- 172.21.15.1:0/466891553 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dd80c8170 0x7f3dd80acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:08.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.124+0000 7f3dd759e700 1 -- 172.21.15.1:0/466891553 >> 172.21.15.1:0/466891553 conn(0x7f3dd8069ee0 msgr2=0x7f3dd80c16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:08.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.124+0000 7f3dd759e700 1 -- 172.21.15.1:0/466891553 shutdown_connections 2023-11-15T01:22:08.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.124+0000 7f3dd759e700 1 -- 172.21.15.1:0/466891553 wait complete. 2023-11-15T01:22:08.138 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T01:22:08.139 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:22:08.178 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:22:08.222 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T01:22:08.222 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-15T01:22:08.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:22:08.223 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-15T01:22:08.258 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T01:22:08.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:22:08.259 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-15T01:22:08.315 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-15T01:22:08.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:22:08.315 DEBUG:teuthology.orchestra.run.smithi141:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-15T01:22:08.361 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-15T01:22:08.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:22:08.363 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-15T01:22:08.379 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-15T01:22:08.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:22:08.380 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-15T01:22:08.420 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T01:22:08.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:22:08.421 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-15T01:22:08.475 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-15T01:22:08.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:22:08.476 DEBUG:teuthology.orchestra.run.smithi141:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-15T01:22:08.510 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-15T01:22:08.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:22:08.511 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-15T01:22:08.566 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-15T01:22:08.567 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:22:08.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.685+0000 7f48a0d0b700 1 Processor -- start 2023-11-15T01:22:08.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.686+0000 7f48a0d0b700 1 -- start start 2023-11-15T01:22:08.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.686+0000 7f48a0d0b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f489c133e20 0x7f489c0c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:08.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.686+0000 7f48a0d0b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f489c0c59a0 0x7f489c134200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:08.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.686+0000 7f48a0d0b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f489c0c5020 0x7f489c065560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:08.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.686+0000 7f48a0d0b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489c1527e0 con 0x7f489c0c59a0 2023-11-15T01:22:08.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.686+0000 7f48a0d0b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489c1346f0 con 0x7f489c0c5020 2023-11-15T01:22:08.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.686+0000 7f48a0d0b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0c5ed0 con 0x7f489c133e20 2023-11-15T01:22:08.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.687+0000 7f489affd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f489c0c59a0 0x7f489c134200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:08.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.687+0000 7f489affd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f489c0c59a0 0x7f489c134200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43736/0 (socket says 172.21.15.1:43736) 2023-11-15T01:22:08.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.687+0000 7f489affd700 1 -- 172.21.15.1:0/3442432540 learned_addr learned my addr 172.21.15.1:0/3442432540 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:08.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.687+0000 7f489b7fe700 1 --2- 172.21.15.1:0/3442432540 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f489c133e20 0x7f489c0c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:08.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.687+0000 7f489bfff700 1 --2- 172.21.15.1:0/3442432540 >> v2:172.21.15.141:3300/0 conn(0x7f489c0c5020 0x7f489c065560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:08.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.687+0000 7f489affd700 1 -- 172.21.15.1:0/3442432540 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f489c133e20 msgr2=0x7f489c0c10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:08.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.687+0000 7f489affd700 1 --2- 172.21.15.1:0/3442432540 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f489c133e20 0x7f489c0c10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:08.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.687+0000 7f489affd700 1 -- 172.21.15.1:0/3442432540 >> v2:172.21.15.141:3300/0 conn(0x7f489c0c5020 msgr2=0x7f489c065560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:08.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.687+0000 7f489affd700 1 --2- 172.21.15.1:0/3442432540 >> v2:172.21.15.141:3300/0 conn(0x7f489c0c5020 0x7f489c065560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:08.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.687+0000 7f489affd700 1 -- 172.21.15.1:0/3442432540 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c0c61b0 con 0x7f489c0c59a0 2023-11-15T01:22:08.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.687+0000 7f489affd700 1 --2- 172.21.15.1:0/3442432540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f489c0c59a0 0x7f489c134200 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f489c137ad0 tx=0x7f48900090f0).ready entity=mon.0 client_cookie=bf68de1ffdfd66c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:08.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.687+0000 7f489a7fc700 1 -- 172.21.15.1:0/3442432540 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489000b600 con 0x7f489c0c59a0 2023-11-15T01:22:08.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.687+0000 7f489a7fc700 1 -- 172.21.15.1:0/3442432540 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489000b760 con 0x7f489c0c59a0 2023-11-15T01:22:08.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.687+0000 7f489a7fc700 1 -- 172.21.15.1:0/3442432540 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489000bae0 con 0x7f489c0c59a0 2023-11-15T01:22:08.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.688+0000 7f48a0d0b700 1 -- 172.21.15.1:0/3442432540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f489c0c59a0 msgr2=0x7f489c134200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:08.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.688+0000 7f48a0d0b700 1 --2- 172.21.15.1:0/3442432540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f489c0c59a0 0x7f489c134200 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f489c137ad0 tx=0x7f48900090f0).stop 2023-11-15T01:22:08.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.688+0000 7f48a0d0b700 1 -- 172.21.15.1:0/3442432540 shutdown_connections 2023-11-15T01:22:08.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.688+0000 7f48a0d0b700 1 --2- 172.21.15.1:0/3442432540 >> v2:172.21.15.141:3300/0 conn(0x7f489c0c5020 0x7f489c065560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:08.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.688+0000 7f48a0d0b700 1 --2- 172.21.15.1:0/3442432540 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f489c133e20 0x7f489c0c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:08.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.688+0000 7f48a0d0b700 1 --2- 172.21.15.1:0/3442432540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f489c0c59a0 0x7f489c134200 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:08.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.688+0000 7f48a0d0b700 1 -- 172.21.15.1:0/3442432540 >> 172.21.15.1:0/3442432540 conn(0x7f489c063280 msgr2=0x7f489c0c6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:08.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.688+0000 7f48a0d0b700 1 -- 172.21.15.1:0/3442432540 shutdown_connections 2023-11-15T01:22:08.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.688+0000 7f48a0d0b700 1 -- 172.21.15.1:0/3442432540 wait complete. 2023-11-15T01:22:08.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.689+0000 7f48a0d0b700 1 Processor -- start 2023-11-15T01:22:08.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.689+0000 7f48a0d0b700 1 -- start start 2023-11-15T01:22:08.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f48a0d0b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f489c0c5020 0x7f489c161730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:08.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f48a0d0b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f489c0c59a0 0x7f489c0ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:08.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f48a0d0b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f489c133e20 0x7f489c0ac560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:08.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f48a0d0b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0bf370 con 0x7f489c0c5020 2023-11-15T01:22:08.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f48a0d0b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c139c80 con 0x7f489c133e20 2023-11-15T01:22:08.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f48a0d0b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c1399a0 con 0x7f489c0c59a0 2023-11-15T01:22:08.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f489b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f489c0c5020 0x7f489c161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:08.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f489b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f489c0c5020 0x7f489c161730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43742/0 (socket says 172.21.15.1:43742) 2023-11-15T01:22:08.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f489b7fe700 1 -- 172.21.15.1:0/546643344 learned_addr learned my addr 172.21.15.1:0/546643344 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:08.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f489affd700 1 --2- 172.21.15.1:0/546643344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f489c0c59a0 0x7f489c0ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:08.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f489bfff700 1 --2- 172.21.15.1:0/546643344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f489c133e20 0x7f489c0ac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:08.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f489b7fe700 1 -- 172.21.15.1:0/546643344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f489c0c59a0 msgr2=0x7f489c0ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:08.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f489b7fe700 1 --2- 172.21.15.1:0/546643344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f489c0c59a0 0x7f489c0ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:08.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f489b7fe700 1 -- 172.21.15.1:0/546643344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f489c133e20 msgr2=0x7f489c0ac560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:08.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f489b7fe700 1 --2- 172.21.15.1:0/546643344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f489c133e20 0x7f489c0ac560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:08.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f489b7fe700 1 -- 172.21.15.1:0/546643344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4890009370 con 0x7f489c0c5020 2023-11-15T01:22:08.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f489bfff700 1 --2- 172.21.15.1:0/546643344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f489c133e20 0x7f489c0ac560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:08.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.690+0000 7f489b7fe700 1 --2- 172.21.15.1:0/546643344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f489c0c5020 0x7f489c161730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f488c00fb40 tx=0x7f488c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:08.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.691+0000 7f48837fe700 1 -- 172.21.15.1:0/546643344 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c009890 con 0x7f489c0c5020 2023-11-15T01:22:08.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.691+0000 7f48837fe700 1 -- 172.21.15.1:0/546643344 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c0099f0 con 0x7f489c0c5020 2023-11-15T01:22:08.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.691+0000 7f48a0d0b700 1 -- 172.21.15.1:0/546643344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c0bf5a0 con 0x7f489c0c5020 2023-11-15T01:22:08.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.691+0000 7f48837fe700 1 -- 172.21.15.1:0/546643344 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c009d70 con 0x7f489c0c5020 2023-11-15T01:22:08.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.691+0000 7f48a0d0b700 1 -- 172.21.15.1:0/546643344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489c0bfbe0 con 0x7f489c0c5020 2023-11-15T01:22:08.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.692+0000 7f48a0d0b700 1 -- 172.21.15.1:0/546643344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489c0acb10 con 0x7f489c0c5020 2023-11-15T01:22:08.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.692+0000 7f48837fe700 1 -- 172.21.15.1:0/546643344 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f488c01a670 con 0x7f489c0c5020 2023-11-15T01:22:08.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.692+0000 7f48837fe700 1 --2- 172.21.15.1:0/546643344 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f488805f150 0x7f4888061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:08.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.692+0000 7f48837fe700 1 -- 172.21.15.1:0/546643344 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f488c07c340 con 0x7f489c0c5020 2023-11-15T01:22:08.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.693+0000 7f489affd700 1 --2- 172.21.15.1:0/546643344 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f488805f150 0x7f4888061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:08.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.693+0000 7f489affd700 1 --2- 172.21.15.1:0/546643344 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f488805f150 0x7f4888061610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f489c137ad0 tx=0x7f4890017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:08.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.697+0000 7f48837fe700 1 -- 172.21.15.1:0/546643344 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f488c04d5b0 con 0x7f489c0c5020 2023-11-15T01:22:08.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.914+0000 7f48a0d0b700 1 -- 172.21.15.1:0/546643344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f489c0475e0 con 0x7f489c0c5020 2023-11-15T01:22:08.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.914+0000 7f48837fe700 1 -- 172.21.15.1:0/546643344 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4480 (secure 0 0 0) 0x7f488c050bd0 con 0x7f489c0c5020 2023-11-15T01:22:08.916 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:08.916 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/843391361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":843391361},{"type":"v1","addr":"172.21.15.141:6837","nonce":843391361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2237478530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2237478530},{"type":"v1","addr":"172.21.15.141:6836","nonce":2237478530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2856672167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2856672167},{"type":"v1","addr":"172.21.15.1:6833","nonce":2856672167}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:21:37.045655+0000","modified":"2023-11-15T01:21:40.053500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/4209655632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4209655632},{"type":"v1","addr":"172.21.15.1:6835","nonce":4209655632}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-15T01:22:08.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.916+0000 7f48a0d0b700 1 -- 172.21.15.1:0/546643344 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f488805f150 msgr2=0x7f4888061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:08.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.916+0000 7f48a0d0b700 1 --2- 172.21.15.1:0/546643344 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f488805f150 0x7f4888061610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f489c137ad0 tx=0x7f4890017000).stop 2023-11-15T01:22:08.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.916+0000 7f48a0d0b700 1 -- 172.21.15.1:0/546643344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f489c0c5020 msgr2=0x7f489c161730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:08.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.916+0000 7f48a0d0b700 1 --2- 172.21.15.1:0/546643344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f489c0c5020 0x7f489c161730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f488c00fb40 tx=0x7f488c008040).stop 2023-11-15T01:22:08.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.916+0000 7f48a0d0b700 1 -- 172.21.15.1:0/546643344 shutdown_connections 2023-11-15T01:22:08.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.916+0000 7f48a0d0b700 1 --2- 172.21.15.1:0/546643344 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f488805f150 0x7f4888061610 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:08.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.916+0000 7f48a0d0b700 1 --2- 172.21.15.1:0/546643344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f489c133e20 0x7f489c0ac560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:08.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.916+0000 7f48a0d0b700 1 --2- 172.21.15.1:0/546643344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f489c0c5020 0x7f489c161730 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:08.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.916+0000 7f48a0d0b700 1 --2- 172.21.15.1:0/546643344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f489c0c59a0 0x7f489c0ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:08.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.916+0000 7f48a0d0b700 1 -- 172.21.15.1:0/546643344 >> 172.21.15.1:0/546643344 conn(0x7f489c063280 msgr2=0x7f489c065560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:08.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.916+0000 7f48a0d0b700 1 -- 172.21.15.1:0/546643344 shutdown_connections 2023-11-15T01:22:08.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:08.916+0000 7f48a0d0b700 1 -- 172.21.15.1:0/546643344 wait complete. 2023-11-15T01:22:08.921 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2023-11-15T01:22:08.931 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:22:09.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.048+0000 7fe2e19c7700 1 Processor -- start 2023-11-15T01:22:09.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.048+0000 7fe2e19c7700 1 -- start start 2023-11-15T01:22:09.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2e19c7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2dc151e10 0x7fe2dc155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2e19c7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe2dc0c86b0 0x7fe2dc0aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2e19c7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe2dc0c98b0 0x7fe2dc0c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2e19c7700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc0c7980 con 0x7fe2dc0c98b0 2023-11-15T01:22:09.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2e19c7700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc0c8b10 con 0x7fe2dc0c86b0 2023-11-15T01:22:09.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2e19c7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0ca230 con 0x7fe2dc151e10 2023-11-15T01:22:09.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2e11c6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe2dc0c98b0 0x7fe2dc0c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2e11c6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe2dc0c98b0 0x7fe2dc0c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43754/0 (socket says 172.21.15.1:43754) 2023-11-15T01:22:09.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2e11c6700 1 -- 172.21.15.1:0/2069072796 learned_addr learned my addr 172.21.15.1:0/2069072796 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:09.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2e09c5700 1 --2- 172.21.15.1:0/2069072796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2dc151e10 0x7fe2dc155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2dbfff700 1 --2- 172.21.15.1:0/2069072796 >> v2:172.21.15.141:3300/0 conn(0x7fe2dc0c86b0 0x7fe2dc0aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2e11c6700 1 -- 172.21.15.1:0/2069072796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2dc151e10 msgr2=0x7fe2dc155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:09.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2e11c6700 1 --2- 172.21.15.1:0/2069072796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2dc151e10 0x7fe2dc155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2e11c6700 1 -- 172.21.15.1:0/2069072796 >> v2:172.21.15.141:3300/0 conn(0x7fe2dc0c86b0 msgr2=0x7fe2dc0aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:09.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2e11c6700 1 --2- 172.21.15.1:0/2069072796 >> v2:172.21.15.141:3300/0 conn(0x7fe2dc0c86b0 0x7fe2dc0aa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2e11c6700 1 -- 172.21.15.1:0/2069072796 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc0aa5c0 con 0x7fe2dc0c98b0 2023-11-15T01:22:09.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.049+0000 7fe2dbfff700 1 --2- 172.21.15.1:0/2069072796 >> v2:172.21.15.141:3300/0 conn(0x7fe2dc0c86b0 0x7fe2dc0aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:09.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.050+0000 7fe2e11c6700 1 --2- 172.21.15.1:0/2069072796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2dc0c98b0 0x7fe2dc0c9d40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fe2dc085d00 tx=0x7fe2c40090f0).ready entity=mon.0 client_cookie=7b8db47bba5366d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:09.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.050+0000 7fe2db7fe700 1 -- 172.21.15.1:0/2069072796 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c400b600 con 0x7fe2dc0c98b0 2023-11-15T01:22:09.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.050+0000 7fe2db7fe700 1 -- 172.21.15.1:0/2069072796 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c400b760 con 0x7fe2dc0c98b0 2023-11-15T01:22:09.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.050+0000 7fe2db7fe700 1 -- 172.21.15.1:0/2069072796 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c400bae0 con 0x7fe2dc0c98b0 2023-11-15T01:22:09.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.050+0000 7fe2e19c7700 1 -- 172.21.15.1:0/2069072796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2dc0c98b0 msgr2=0x7fe2dc0c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.050+0000 7fe2e19c7700 1 --2- 172.21.15.1:0/2069072796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2dc0c98b0 0x7fe2dc0c9d40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fe2dc085d00 tx=0x7fe2c40090f0).stop 2023-11-15T01:22:09.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.050+0000 7fe2e19c7700 1 -- 172.21.15.1:0/2069072796 shutdown_connections 2023-11-15T01:22:09.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.050+0000 7fe2e19c7700 1 --2- 172.21.15.1:0/2069072796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2dc0c98b0 0x7fe2dc0c9d40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.050+0000 7fe2e19c7700 1 --2- 172.21.15.1:0/2069072796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2dc151e10 0x7fe2dc155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.050+0000 7fe2e19c7700 1 --2- 172.21.15.1:0/2069072796 >> v2:172.21.15.141:3300/0 conn(0x7fe2dc0c86b0 0x7fe2dc0aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.050+0000 7fe2e19c7700 1 -- 172.21.15.1:0/2069072796 >> 172.21.15.1:0/2069072796 conn(0x7fe2dc0947e0 msgr2=0x7fe2dc06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:09.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.050+0000 7fe2e19c7700 1 -- 172.21.15.1:0/2069072796 shutdown_connections 2023-11-15T01:22:09.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.050+0000 7fe2e19c7700 1 -- 172.21.15.1:0/2069072796 wait complete. 2023-11-15T01:22:09.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.051+0000 7fe2e19c7700 1 Processor -- start 2023-11-15T01:22:09.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.052+0000 7fe2e19c7700 1 -- start start 2023-11-15T01:22:09.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.052+0000 7fe2e19c7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2dc0c86b0 0x7fe2dc14e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.052+0000 7fe2e19c7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2dc0c98b0 0x7fe2dc0accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.052+0000 7fe2e19c7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2dc151e10 0x7fe2dc163fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.052+0000 7fe2e19c7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc1550f0 con 0x7fe2dc151e10 2023-11-15T01:22:09.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.052+0000 7fe2e19c7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0ac840 con 0x7fe2dc0c86b0 2023-11-15T01:22:09.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.052+0000 7fe2e19c7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0abc70 con 0x7fe2dc0c98b0 2023-11-15T01:22:09.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.052+0000 7fe2e11c6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2dc151e10 0x7fe2dc163fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.052+0000 7fe2e11c6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2dc151e10 0x7fe2dc163fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43756/0 (socket says 172.21.15.1:43756) 2023-11-15T01:22:09.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.052+0000 7fe2e11c6700 1 -- 172.21.15.1:0/858440041 learned_addr learned my addr 172.21.15.1:0/858440041 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:09.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.053+0000 7fe2dbfff700 1 --2- 172.21.15.1:0/858440041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2dc0c98b0 0x7fe2dc0accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.053+0000 7fe2e09c5700 1 --2- 172.21.15.1:0/858440041 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2dc0c86b0 0x7fe2dc14e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.053+0000 7fe2e11c6700 1 -- 172.21.15.1:0/858440041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2dc0c98b0 msgr2=0x7fe2dc0accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.053+0000 7fe2e11c6700 1 --2- 172.21.15.1:0/858440041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2dc0c98b0 0x7fe2dc0accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.053+0000 7fe2e11c6700 1 -- 172.21.15.1:0/858440041 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2dc0c86b0 msgr2=0x7fe2dc14e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.053+0000 7fe2e11c6700 1 --2- 172.21.15.1:0/858440041 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2dc0c86b0 0x7fe2dc14e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.053+0000 7fe2e11c6700 1 -- 172.21.15.1:0/858440041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c4009370 con 0x7fe2dc151e10 2023-11-15T01:22:09.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.053+0000 7fe2e11c6700 1 --2- 172.21.15.1:0/858440041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2dc151e10 0x7fe2dc163fd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fe2dc084670 tx=0x7fe2c4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:09.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.053+0000 7fe2d8ff9700 1 -- 172.21.15.1:0/858440041 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4006d90 con 0x7fe2dc151e10 2023-11-15T01:22:09.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.053+0000 7fe2d8ff9700 1 -- 172.21.15.1:0/858440041 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c400bea0 con 0x7fe2dc151e10 2023-11-15T01:22:09.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.053+0000 7fe2e19c7700 1 -- 172.21.15.1:0/858440041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc0abf10 con 0x7fe2dc151e10 2023-11-15T01:22:09.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.053+0000 7fe2d8ff9700 1 -- 172.21.15.1:0/858440041 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c400bae0 con 0x7fe2dc151e10 2023-11-15T01:22:09.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.053+0000 7fe2e19c7700 1 -- 172.21.15.1:0/858440041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc0ac2a0 con 0x7fe2dc151e10 2023-11-15T01:22:09.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.054+0000 7fe2e19c7700 1 -- 172.21.15.1:0/858440041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc0ac9b0 con 0x7fe2dc151e10 2023-11-15T01:22:09.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.055+0000 7fe2d8ff9700 1 -- 172.21.15.1:0/858440041 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe2c401b870 con 0x7fe2dc151e10 2023-11-15T01:22:09.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.055+0000 7fe2d8ff9700 1 --2- 172.21.15.1:0/858440041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2bc05f150 0x7fe2bc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.055+0000 7fe2d8ff9700 1 -- 172.21.15.1:0/858440041 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe2c407bd80 con 0x7fe2dc151e10 2023-11-15T01:22:09.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.055+0000 7fe2e09c5700 1 --2- 172.21.15.1:0/858440041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2bc05f150 0x7fe2bc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.056+0000 7fe2e09c5700 1 --2- 172.21.15.1:0/858440041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2bc05f150 0x7fe2bc061610 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fe2d400bb10 tx=0x7fe2d4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:09.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.059+0000 7fe2d8ff9700 1 -- 172.21.15.1:0/858440041 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe2c404d050 con 0x7fe2dc151e10 2023-11-15T01:22:09.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.235+0000 7fe2e19c7700 1 -- 172.21.15.1:0/858440041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2dc0ac0a0 con 0x7fe2dc151e10 2023-11-15T01:22:09.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.236+0000 7fe2d8ff9700 1 -- 172.21.15.1:0/858440041 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16880 (secure 0 0 0) 0x7fe2c4050670 con 0x7fe2dc151e10 2023-11-15T01:22:09.237 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:09.238 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:38.047484+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:21:34.763591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-15T01:21:36.025071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:22:09.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.237+0000 7fe2e19c7700 1 -- 172.21.15.1:0/858440041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2bc05f150 msgr2=0x7fe2bc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.237+0000 7fe2e19c7700 1 --2- 172.21.15.1:0/858440041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2bc05f150 0x7fe2bc061610 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fe2d400bb10 tx=0x7fe2d4008040).stop 2023-11-15T01:22:09.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.237+0000 7fe2e19c7700 1 -- 172.21.15.1:0/858440041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2dc151e10 msgr2=0x7fe2dc163fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.237+0000 7fe2e19c7700 1 --2- 172.21.15.1:0/858440041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2dc151e10 0x7fe2dc163fd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fe2dc084670 tx=0x7fe2c4017000).stop 2023-11-15T01:22:09.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.237+0000 7fe2e19c7700 1 -- 172.21.15.1:0/858440041 shutdown_connections 2023-11-15T01:22:09.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.237+0000 7fe2e19c7700 1 --2- 172.21.15.1:0/858440041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2bc05f150 0x7fe2bc061610 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.237+0000 7fe2e19c7700 1 --2- 172.21.15.1:0/858440041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2dc151e10 0x7fe2dc163fd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.237+0000 7fe2e19c7700 1 --2- 172.21.15.1:0/858440041 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2dc0c86b0 0x7fe2dc14e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.237+0000 7fe2e19c7700 1 --2- 172.21.15.1:0/858440041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2dc0c98b0 0x7fe2dc0accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.237+0000 7fe2e19c7700 1 -- 172.21.15.1:0/858440041 >> 172.21.15.1:0/858440041 conn(0x7fe2dc0947e0 msgr2=0x7fe2dc0a8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:09.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.237+0000 7fe2e19c7700 1 -- 172.21.15.1:0/858440041 shutdown_connections 2023-11-15T01:22:09.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.237+0000 7fe2e19c7700 1 -- 172.21.15.1:0/858440041 wait complete. 2023-11-15T01:22:09.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T01:21:34.763591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T01:21:36.025071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T01:22:09.252 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:22:09.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.371+0000 7fd1aa455700 1 Processor -- start 2023-11-15T01:22:09.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.372+0000 7fd1aa455700 1 -- start start 2023-11-15T01:22:09.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.372+0000 7fd1aa455700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd1a4154480 0x7fd1a40c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.372+0000 7fd1aa455700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a40ca050 con 0x7fd1a40c6430 2023-11-15T01:22:09.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.372+0000 7fd1aa455700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a40c68c0 con 0x7fd1a41540a0 2023-11-15T01:22:09.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.372+0000 7fd1aa455700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a40c9440 con 0x7fd1a4154480 2023-11-15T01:22:09.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.373+0000 7fd1a37fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd1a4154480 0x7fd1a40c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.373+0000 7fd1a89f2700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd1a40c6430 0x7fd1a40aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:33444/0 (socket says 172.21.15.1:33444) 2023-11-15T01:22:09.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.373+0000 7fd1a89f2700 1 -- 172.21.15.1:0/3829230974 learned_addr learned my addr 172.21.15.1:0/3829230974 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:09.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.373+0000 7fd1a37fe700 1 -- 172.21.15.1:0/3829230974 >> v1:172.21.15.141:6789/0 conn(0x7fd1a41540a0 legacy=0x7fd1a40ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:09.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.373+0000 7fd1a37fe700 1 -- 172.21.15.1:0/3829230974 >> v1:172.21.15.1:6789/0 conn(0x7fd1a40c6430 legacy=0x7fd1a40aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.373+0000 7fd1a2ffd700 1 -- 172.21.15.1:0/3829230974 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370906500 0 0) 0x7fd1a40ca050 con 0x7fd1a40c6430 2023-11-15T01:22:09.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.373+0000 7fd1a37fe700 1 -- 172.21.15.1:0/3829230974 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a40c9720 con 0x7fd1a4154480 2023-11-15T01:22:09.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.373+0000 7fd1a37fe700 1 --2- 172.21.15.1:0/3829230974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1a4154480 0x7fd1a40c5f40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fd18c009760 tx=0x7fd18c009060).ready entity=mon.0 client_cookie=addf9a67aea857f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:09.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.373+0000 7fd1a2ffd700 1 -- 172.21.15.1:0/3829230974 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00b520 con 0x7fd1a4154480 2023-11-15T01:22:09.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.373+0000 7fd1a2ffd700 1 -- 172.21.15.1:0/3829230974 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c00b680 con 0x7fd1a4154480 2023-11-15T01:22:09.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.373+0000 7fd1a2ffd700 1 -- 172.21.15.1:0/3829230974 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00ba00 con 0x7fd1a4154480 2023-11-15T01:22:09.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.374+0000 7fd1aa455700 1 -- 172.21.15.1:0/3829230974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1a4154480 msgr2=0x7fd1a40c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.374+0000 7fd1aa455700 1 --2- 172.21.15.1:0/3829230974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1a4154480 0x7fd1a40c5f40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fd18c009760 tx=0x7fd18c009060).stop 2023-11-15T01:22:09.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.374+0000 7fd1aa455700 1 -- 172.21.15.1:0/3829230974 shutdown_connections 2023-11-15T01:22:09.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.374+0000 7fd1aa455700 1 --2- 172.21.15.1:0/3829230974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1a4154480 0x7fd1a40c5f40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.374+0000 7fd1aa455700 1 -- 172.21.15.1:0/3829230974 >> 172.21.15.1:0/3829230974 conn(0x7fd1a4064a70 msgr2=0x7fd1a4064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:09.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.374+0000 7fd1aa455700 1 -- 172.21.15.1:0/3829230974 shutdown_connections 2023-11-15T01:22:09.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.374+0000 7fd1aa455700 1 -- 172.21.15.1:0/3829230974 wait complete. 2023-11-15T01:22:09.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.375+0000 7fd1aa455700 1 Processor -- start 2023-11-15T01:22:09.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.375+0000 7fd1aa455700 1 -- start start 2023-11-15T01:22:09.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1aa455700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1a40c6430 0x7fd1a40b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1aa455700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1a41540a0 0x7fd1a41509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1aa455700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1a4154480 0x7fd1a414d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1aa455700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40af330 con 0x7fd1a41540a0 2023-11-15T01:22:09.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1aa455700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40aea50 con 0x7fd1a40c6430 2023-11-15T01:22:09.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1aa455700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4150ea0 con 0x7fd1a4154480 2023-11-15T01:22:09.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1a37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1a41540a0 0x7fd1a41509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1a37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1a41540a0 0x7fd1a41509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43764/0 (socket says 172.21.15.1:43764) 2023-11-15T01:22:09.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1a37fe700 1 -- 172.21.15.1:0/1147596086 learned_addr learned my addr 172.21.15.1:0/1147596086 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:09.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1a3fff700 1 --2- 172.21.15.1:0/1147596086 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1a40c6430 0x7fd1a40b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1a89f2700 1 --2- 172.21.15.1:0/1147596086 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1a4154480 0x7fd1a414d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1a37fe700 1 -- 172.21.15.1:0/1147596086 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1a4154480 msgr2=0x7fd1a414d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1a37fe700 1 --2- 172.21.15.1:0/1147596086 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1a4154480 0x7fd1a414d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1a37fe700 1 -- 172.21.15.1:0/1147596086 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1a40c6430 msgr2=0x7fd1a40b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1a37fe700 1 --2- 172.21.15.1:0/1147596086 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1a40c6430 0x7fd1a40b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1a37fe700 1 -- 172.21.15.1:0/1147596086 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c0092a0 con 0x7fd1a41540a0 2023-11-15T01:22:09.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1a89f2700 1 --2- 172.21.15.1:0/1147596086 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1a4154480 0x7fd1a414d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:09.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd1a37fe700 1 --2- 172.21.15.1:0/1147596086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1a41540a0 0x7fd1a41509b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fd18c009eb0 tx=0x7fd18c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:09.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.376+0000 7fd19bfff700 1 -- 172.21.15.1:0/1147596086 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00b7f0 con 0x7fd1a41540a0 2023-11-15T01:22:09.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.377+0000 7fd19bfff700 1 -- 172.21.15.1:0/1147596086 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c00b950 con 0x7fd1a41540a0 2023-11-15T01:22:09.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.377+0000 7fd1aa455700 1 -- 172.21.15.1:0/1147596086 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a40b0f10 con 0x7fd1a41540a0 2023-11-15T01:22:09.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.377+0000 7fd19bfff700 1 -- 172.21.15.1:0/1147596086 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c01b640 con 0x7fd1a41540a0 2023-11-15T01:22:09.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.377+0000 7fd1aa455700 1 -- 172.21.15.1:0/1147596086 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a40aefc0 con 0x7fd1a41540a0 2023-11-15T01:22:09.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.378+0000 7fd1aa455700 1 -- 172.21.15.1:0/1147596086 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a406c7e0 con 0x7fd1a41540a0 2023-11-15T01:22:09.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.378+0000 7fd19bfff700 1 -- 172.21.15.1:0/1147596086 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd18c01ba30 con 0x7fd1a41540a0 2023-11-15T01:22:09.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.378+0000 7fd19bfff700 1 --2- 172.21.15.1:0/1147596086 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd18405f150 0x7fd184061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.378+0000 7fd19bfff700 1 -- 172.21.15.1:0/1147596086 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd18c07c0c0 con 0x7fd1a41540a0 2023-11-15T01:22:09.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.378+0000 7fd1a3fff700 1 --2- 172.21.15.1:0/1147596086 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd18405f150 0x7fd184061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.379+0000 7fd1a3fff700 1 --2- 172.21.15.1:0/1147596086 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd18405f150 0x7fd184061610 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd1940036e0 tx=0x7fd194009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:09.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.382+0000 7fd19bfff700 1 -- 172.21.15.1:0/1147596086 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd18c04d390 con 0x7fd1a41540a0 2023-11-15T01:22:09.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.554+0000 7fd1aa455700 1 -- 172.21.15.1:0/1147596086 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd1a40c9a00 con 0x7fd1a41540a0 2023-11-15T01:22:09.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.555+0000 7fd19bfff700 1 -- 172.21.15.1:0/1147596086 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd18c01f0b0 con 0x7fd1a41540a0 2023-11-15T01:22:09.557 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:22:09.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.557+0000 7fd1aa455700 1 -- 172.21.15.1:0/1147596086 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd18405f150 msgr2=0x7fd184061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.557+0000 7fd1aa455700 1 --2- 172.21.15.1:0/1147596086 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd18405f150 0x7fd184061610 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd1940036e0 tx=0x7fd194009040).stop 2023-11-15T01:22:09.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.557+0000 7fd1aa455700 1 -- 172.21.15.1:0/1147596086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1a41540a0 msgr2=0x7fd1a41509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.557+0000 7fd1aa455700 1 --2- 172.21.15.1:0/1147596086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1a41540a0 0x7fd1a41509b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fd18c009eb0 tx=0x7fd18c017000).stop 2023-11-15T01:22:09.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.557+0000 7fd1aa455700 1 -- 172.21.15.1:0/1147596086 shutdown_connections 2023-11-15T01:22:09.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.557+0000 7fd1aa455700 1 --2- 172.21.15.1:0/1147596086 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd18405f150 0x7fd184061610 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.557+0000 7fd1aa455700 1 --2- 172.21.15.1:0/1147596086 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1a4154480 0x7fd1a414d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.557+0000 7fd1aa455700 1 --2- 172.21.15.1:0/1147596086 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1a40c6430 0x7fd1a40b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.557+0000 7fd1aa455700 1 --2- 172.21.15.1:0/1147596086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1a41540a0 0x7fd1a41509b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.557+0000 7fd1aa455700 1 -- 172.21.15.1:0/1147596086 >> 172.21.15.1:0/1147596086 conn(0x7fd1a4064a70 msgr2=0x7fd1a414ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:09.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.557+0000 7fd1aa455700 1 -- 172.21.15.1:0/1147596086 shutdown_connections 2023-11-15T01:22:09.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.557+0000 7fd1aa455700 1 -- 172.21.15.1:0/1147596086 wait complete. 2023-11-15T01:22:09.570 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:22:09.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.692+0000 7f4edd531700 1 Processor -- start 2023-11-15T01:22:09.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.692+0000 7f4edd531700 1 -- start start 2023-11-15T01:22:09.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.693+0000 7f4edd531700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4ed81540a0 0x7f4ed80ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.693+0000 7f4edd531700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ed80c6650 0x7f4ed80ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.693+0000 7f4edd531700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed80ca050 con 0x7f4ed8154480 2023-11-15T01:22:09.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.693+0000 7f4edd531700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed80c9440 con 0x7f4ed81540a0 2023-11-15T01:22:09.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.693+0000 7f4edd531700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80c9720 con 0x7f4ed80c6650 2023-11-15T01:22:09.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.693+0000 7f4ed6ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4ed81540a0 0x7f4ed80ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.693+0000 7f4ed67fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4ed8154480 0x7f4ed80c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:33454/0 (socket says 172.21.15.1:33454) 2023-11-15T01:22:09.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.693+0000 7f4ed67fc700 1 -- 172.21.15.1:0/2810584300 learned_addr learned my addr 172.21.15.1:0/2810584300 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:09.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.694+0000 7f4ed77fe700 1 --2- 172.21.15.1:0/2810584300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ed80c6650 0x7f4ed80ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.694+0000 7f4ed6ffd700 1 -- 172.21.15.1:0/2810584300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ed80c6650 msgr2=0x7f4ed80ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:09.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.694+0000 7f4ed6ffd700 1 --2- 172.21.15.1:0/2810584300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ed80c6650 0x7f4ed80ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.694+0000 7f4ed6ffd700 1 -- 172.21.15.1:0/2810584300 >> v1:172.21.15.1:6789/0 conn(0x7f4ed8154480 legacy=0x7f4ed80c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.694+0000 7f4ed6ffd700 1 -- 172.21.15.1:0/2810584300 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed80c9a00 con 0x7f4ed81540a0 2023-11-15T01:22:09.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.694+0000 7f4ed5ffb700 1 -- 172.21.15.1:0/2810584300 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184882697 0 0) 0x7f4ed80ca050 con 0x7f4ed8154480 2023-11-15T01:22:09.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.694+0000 7f4ed6ffd700 1 --2- 172.21.15.1:0/2810584300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed81540a0 0x7f4ed80ca4e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f4ed0009e60 tx=0x7f4ed0009780).ready entity=mon.0 client_cookie=5dd0d7997cb345b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:09.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.694+0000 7f4ed5ffb700 1 -- 172.21.15.1:0/2810584300 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed000e070 con 0x7f4ed81540a0 2023-11-15T01:22:09.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.694+0000 7f4ed5ffb700 1 -- 172.21.15.1:0/2810584300 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed000bb60 con 0x7f4ed81540a0 2023-11-15T01:22:09.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.694+0000 7f4ed5ffb700 1 -- 172.21.15.1:0/2810584300 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0012410 con 0x7f4ed81540a0 2023-11-15T01:22:09.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.694+0000 7f4edd531700 1 -- 172.21.15.1:0/2810584300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed81540a0 msgr2=0x7f4ed80ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.694+0000 7f4edd531700 1 --2- 172.21.15.1:0/2810584300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed81540a0 0x7f4ed80ca4e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f4ed0009e60 tx=0x7f4ed0009780).stop 2023-11-15T01:22:09.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.694+0000 7f4edd531700 1 -- 172.21.15.1:0/2810584300 shutdown_connections 2023-11-15T01:22:09.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.694+0000 7f4edd531700 1 --2- 172.21.15.1:0/2810584300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ed80c6650 0x7f4ed80ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.694+0000 7f4edd531700 1 --2- 172.21.15.1:0/2810584300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed81540a0 0x7f4ed80ca4e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.695+0000 7f4edd531700 1 -- 172.21.15.1:0/2810584300 >> 172.21.15.1:0/2810584300 conn(0x7f4ed8064a70 msgr2=0x7f4ed8064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:09.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.695+0000 7f4edd531700 1 -- 172.21.15.1:0/2810584300 shutdown_connections 2023-11-15T01:22:09.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.695+0000 7f4edd531700 1 -- 172.21.15.1:0/2810584300 wait complete. 2023-11-15T01:22:09.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.696+0000 7f4edd531700 1 Processor -- start 2023-11-15T01:22:09.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.696+0000 7f4edd531700 1 -- start start 2023-11-15T01:22:09.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4edd531700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ed80c6650 0x7f4ed80c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4edd531700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed81540a0 0x7f4ed8167ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4edd531700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ed8154480 0x7f4ed81681d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4edd531700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed81686c0 con 0x7f4ed81540a0 2023-11-15T01:22:09.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4edd531700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80c2dc0 con 0x7f4ed8154480 2023-11-15T01:22:09.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4edd531700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80c3380 con 0x7f4ed80c6650 2023-11-15T01:22:09.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4ed67fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed81540a0 0x7f4ed8167ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4ed67fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed81540a0 0x7f4ed8167ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43782/0 (socket says 172.21.15.1:43782) 2023-11-15T01:22:09.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4ed67fc700 1 -- 172.21.15.1:0/2627923191 learned_addr learned my addr 172.21.15.1:0/2627923191 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:09.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4ed67fc700 1 -- 172.21.15.1:0/2627923191 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ed80c6650 msgr2=0x7f4ed80c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4ed67fc700 1 --2- 172.21.15.1:0/2627923191 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ed80c6650 0x7f4ed80c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:09.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4ed67fc700 1 -- 172.21.15.1:0/2627923191 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ed8154480 msgr2=0x7f4ed81681d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4ed77fe700 1 --2- 172.21.15.1:0/2627923191 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ed8154480 0x7f4ed81681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4ed67fc700 1 --2- 172.21.15.1:0/2627923191 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ed8154480 0x7f4ed81681d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4ed67fc700 1 -- 172.21.15.1:0/2627923191 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed0009a20 con 0x7f4ed81540a0 2023-11-15T01:22:09.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4ed67fc700 1 --2- 172.21.15.1:0/2627923191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed81540a0 0x7f4ed8167ce0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f4ec000c510 tx=0x7f4ec0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:09.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4eceffd700 1 -- 172.21.15.1:0/2627923191 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec00072e0 con 0x7f4ed81540a0 2023-11-15T01:22:09.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4eceffd700 1 -- 172.21.15.1:0/2627923191 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec0007440 con 0x7f4ed81540a0 2023-11-15T01:22:09.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4edd531700 1 -- 172.21.15.1:0/2627923191 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed80b0c00 con 0x7f4ed81540a0 2023-11-15T01:22:09.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4eceffd700 1 -- 172.21.15.1:0/2627923191 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec00057a0 con 0x7f4ed81540a0 2023-11-15T01:22:09.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.697+0000 7f4edd531700 1 -- 172.21.15.1:0/2627923191 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed80c3010 con 0x7f4ed81540a0 2023-11-15T01:22:09.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.698+0000 7f4edd531700 1 -- 172.21.15.1:0/2627923191 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed806c7e0 con 0x7f4ed81540a0 2023-11-15T01:22:09.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.699+0000 7f4eceffd700 1 -- 172.21.15.1:0/2627923191 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4ec0005bd0 con 0x7f4ed81540a0 2023-11-15T01:22:09.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.699+0000 7f4eceffd700 1 --2- 172.21.15.1:0/2627923191 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4eb805f120 0x7f4eb80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:09.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.699+0000 7f4eceffd700 1 -- 172.21.15.1:0/2627923191 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4ec0079b20 con 0x7f4ed81540a0 2023-11-15T01:22:09.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.699+0000 7f4ed6ffd700 1 --2- 172.21.15.1:0/2627923191 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4eb805f120 0x7f4eb80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:09.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.700+0000 7f4ed6ffd700 1 --2- 172.21.15.1:0/2627923191 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4eb805f120 0x7f4eb80615e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f4ed0009e60 tx=0x7f4ed0009780).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:09.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.703+0000 7f4eceffd700 1 -- 172.21.15.1:0/2627923191 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4ec004adf0 con 0x7f4ed81540a0 2023-11-15T01:22:09.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.877+0000 7f4edd531700 1 -- 172.21.15.1:0/2627923191 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4ed80c34c0 con 0x7f4ed81540a0 2023-11-15T01:22:09.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.877+0000 7f4eceffd700 1 -- 172.21.15.1:0/2627923191 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4ec0018030 con 0x7f4ed81540a0 2023-11-15T01:22:09.880 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:22:09.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.879+0000 7f4edd531700 1 -- 172.21.15.1:0/2627923191 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4eb805f120 msgr2=0x7f4eb80615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.879+0000 7f4edd531700 1 --2- 172.21.15.1:0/2627923191 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4eb805f120 0x7f4eb80615e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f4ed0009e60 tx=0x7f4ed0009780).stop 2023-11-15T01:22:09.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.879+0000 7f4edd531700 1 -- 172.21.15.1:0/2627923191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed81540a0 msgr2=0x7f4ed8167ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:09.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.879+0000 7f4edd531700 1 --2- 172.21.15.1:0/2627923191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed81540a0 0x7f4ed8167ce0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f4ec000c510 tx=0x7f4ec0007c70).stop 2023-11-15T01:22:09.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.879+0000 7f4edd531700 1 -- 172.21.15.1:0/2627923191 shutdown_connections 2023-11-15T01:22:09.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.879+0000 7f4edd531700 1 --2- 172.21.15.1:0/2627923191 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4eb805f120 0x7f4eb80615e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.879+0000 7f4edd531700 1 --2- 172.21.15.1:0/2627923191 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ed8154480 0x7f4ed81681d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.879+0000 7f4edd531700 1 --2- 172.21.15.1:0/2627923191 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ed80c6650 0x7f4ed80c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:09.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.879+0000 7f4edd531700 1 --2- 172.21.15.1:0/2627923191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed81540a0 0x7f4ed8167ce0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:09.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.879+0000 7f4edd531700 1 -- 172.21.15.1:0/2627923191 >> 172.21.15.1:0/2627923191 conn(0x7f4ed8064a70 msgr2=0x7f4ed81530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:09.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.879+0000 7f4edd531700 1 -- 172.21.15.1:0/2627923191 shutdown_connections 2023-11-15T01:22:09.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:09.879+0000 7f4edd531700 1 -- 172.21.15.1:0/2627923191 wait complete. 2023-11-15T01:22:09.892 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T01:22:10.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.011+0000 7fc36c567700 1 Processor -- start 2023-11-15T01:22:10.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.011+0000 7fc36c567700 1 -- start start 2023-11-15T01:22:10.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.012+0000 7fc36c567700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc3641540a0 0x7fc3640ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.012+0000 7fc36c567700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc364154480 0x7fc3640ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.012+0000 7fc36c567700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3640ca050 con 0x7fc3640c5f40 2023-11-15T01:22:10.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.012+0000 7fc36c567700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3640c9440 con 0x7fc3641540a0 2023-11-15T01:22:10.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.012+0000 7fc36c567700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3640c9720 con 0x7fc364154480 2023-11-15T01:22:10.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.012+0000 7fc36a303700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc3641540a0 0x7fc3640ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.012+0000 7fc36a303700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc3641540a0 0x7fc3640ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43784/0 (socket says 172.21.15.1:43784) 2023-11-15T01:22:10.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.012+0000 7fc36a303700 1 -- 172.21.15.1:0/1242577559 learned_addr learned my addr 172.21.15.1:0/1242577559 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:10.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.012+0000 7fc369b02700 1 --2- 172.21.15.1:0/1242577559 >> v2:172.21.15.141:3300/0 conn(0x7fc364154480 0x7fc3640ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.013+0000 7fc36a303700 1 -- 172.21.15.1:0/1242577559 >> v2:172.21.15.141:3300/0 conn(0x7fc364154480 msgr2=0x7fc3640ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:10.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.013+0000 7fc36a303700 1 --2- 172.21.15.1:0/1242577559 >> v2:172.21.15.141:3300/0 conn(0x7fc364154480 0x7fc3640ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.013+0000 7fc36a303700 1 -- 172.21.15.1:0/1242577559 >> v1:172.21.15.141:6789/0 conn(0x7fc3640c5f40 legacy=0x7fc3640aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.013+0000 7fc36a303700 1 -- 172.21.15.1:0/1242577559 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3640c9a00 con 0x7fc3641540a0 2023-11-15T01:22:10.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.013+0000 7fc369b02700 1 --2- 172.21.15.1:0/1242577559 >> v2:172.21.15.141:3300/0 conn(0x7fc364154480 0x7fc3640ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:10.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.013+0000 7fc36a303700 1 --2- 172.21.15.1:0/1242577559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3641540a0 0x7fc3640ca4e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fc3640c88f0 tx=0x7fc3600090f0).ready entity=mon.0 client_cookie=e846c6715c04f00e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:10.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.013+0000 7fc369301700 1 -- 172.21.15.1:0/1242577559 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36000b600 con 0x7fc3641540a0 2023-11-15T01:22:10.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.013+0000 7fc369301700 1 -- 172.21.15.1:0/1242577559 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36000b760 con 0x7fc3641540a0 2023-11-15T01:22:10.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.013+0000 7fc369301700 1 -- 172.21.15.1:0/1242577559 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36000bae0 con 0x7fc3641540a0 2023-11-15T01:22:10.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.013+0000 7fc36c567700 1 -- 172.21.15.1:0/1242577559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3641540a0 msgr2=0x7fc3640ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.013+0000 7fc36c567700 1 --2- 172.21.15.1:0/1242577559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3641540a0 0x7fc3640ca4e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fc3640c88f0 tx=0x7fc3600090f0).stop 2023-11-15T01:22:10.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.014+0000 7fc36c567700 1 -- 172.21.15.1:0/1242577559 shutdown_connections 2023-11-15T01:22:10.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.014+0000 7fc36c567700 1 --2- 172.21.15.1:0/1242577559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3641540a0 0x7fc3640ca4e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.014+0000 7fc36c567700 1 --2- 172.21.15.1:0/1242577559 >> v2:172.21.15.141:3300/0 conn(0x7fc364154480 0x7fc3640ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.014+0000 7fc36c567700 1 -- 172.21.15.1:0/1242577559 >> 172.21.15.1:0/1242577559 conn(0x7fc364064a70 msgr2=0x7fc364064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:10.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.014+0000 7fc36c567700 1 -- 172.21.15.1:0/1242577559 shutdown_connections 2023-11-15T01:22:10.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.014+0000 7fc36c567700 1 -- 172.21.15.1:0/1242577559 wait complete. 2023-11-15T01:22:10.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.015+0000 7fc36c567700 1 Processor -- start 2023-11-15T01:22:10.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.015+0000 7fc36c567700 1 -- start start 2023-11-15T01:22:10.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.015+0000 7fc36c567700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3640c5f40 0x7fc364150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.015+0000 7fc36c567700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3641540a0 0x7fc36415a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.015+0000 7fc36c567700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc364154480 0x7fc36415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.015+0000 7fc36c567700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36415ae10 con 0x7fc3640c5f40 2023-11-15T01:22:10.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.015+0000 7fc36c567700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640af0e0 con 0x7fc3641540a0 2023-11-15T01:22:10.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.015+0000 7fc36c567700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640c3ee0 con 0x7fc364154480 2023-11-15T01:22:10.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc36a303700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3640c5f40 0x7fc364150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc36a303700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3640c5f40 0x7fc364150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43796/0 (socket says 172.21.15.1:43796) 2023-11-15T01:22:10.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc36a303700 1 -- 172.21.15.1:0/2142423578 learned_addr learned my addr 172.21.15.1:0/2142423578 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:10.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc369b02700 1 --2- 172.21.15.1:0/2142423578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3641540a0 0x7fc36415a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc36ab04700 1 --2- 172.21.15.1:0/2142423578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc364154480 0x7fc36415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc36a303700 1 -- 172.21.15.1:0/2142423578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc364154480 msgr2=0x7fc36415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc36a303700 1 --2- 172.21.15.1:0/2142423578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc364154480 0x7fc36415a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc36a303700 1 -- 172.21.15.1:0/2142423578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3641540a0 msgr2=0x7fc36415a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc36a303700 1 --2- 172.21.15.1:0/2142423578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3641540a0 0x7fc36415a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc36a303700 1 -- 172.21.15.1:0/2142423578 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc360009370 con 0x7fc3640c5f40 2023-11-15T01:22:10.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc36ab04700 1 --2- 172.21.15.1:0/2142423578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc364154480 0x7fc36415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:10.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc36a303700 1 --2- 172.21.15.1:0/2142423578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3640c5f40 0x7fc364150980 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fc360006fd0 tx=0x7fc360017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:10.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc35a7fc700 1 -- 172.21.15.1:0/2142423578 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36000bea0 con 0x7fc3640c5f40 2023-11-15T01:22:10.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc35a7fc700 1 -- 172.21.15.1:0/2142423578 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36000b8d0 con 0x7fc3640c5f40 2023-11-15T01:22:10.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc36c567700 1 -- 172.21.15.1:0/2142423578 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3640c41c0 con 0x7fc3640c5f40 2023-11-15T01:22:10.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc35a7fc700 1 -- 172.21.15.1:0/2142423578 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36001c670 con 0x7fc3640c5f40 2023-11-15T01:22:10.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.016+0000 7fc36c567700 1 -- 172.21.15.1:0/2142423578 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3640aed70 con 0x7fc3640c5f40 2023-11-15T01:22:10.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.017+0000 7fc36c567700 1 -- 172.21.15.1:0/2142423578 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36406c7e0 con 0x7fc3640c5f40 2023-11-15T01:22:10.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.017+0000 7fc35a7fc700 1 -- 172.21.15.1:0/2142423578 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc36001c9e0 con 0x7fc3640c5f40 2023-11-15T01:22:10.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.018+0000 7fc35a7fc700 1 --2- 172.21.15.1:0/2142423578 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc34805f150 0x7fc348061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.018+0000 7fc35a7fc700 1 -- 172.21.15.1:0/2142423578 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc36007bf20 con 0x7fc3640c5f40 2023-11-15T01:22:10.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.018+0000 7fc369b02700 1 --2- 172.21.15.1:0/2142423578 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc34805f150 0x7fc348061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.018+0000 7fc369b02700 1 --2- 172.21.15.1:0/2142423578 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc34805f150 0x7fc348061610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fc354006d80 tx=0x7fc354008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:10.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.022+0000 7fc35a7fc700 1 -- 172.21.15.1:0/2142423578 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc36004d290 con 0x7fc3640c5f40 2023-11-15T01:22:10.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.195+0000 7fc36c567700 1 -- 172.21.15.1:0/2142423578 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3640c9ce0 con 0x7fc3640c5f40 2023-11-15T01:22:10.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.196+0000 7fc35a7fc700 1 -- 172.21.15.1:0/2142423578 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc36002a070 con 0x7fc3640c5f40 2023-11-15T01:22:10.198 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:22:10.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.198+0000 7fc36c567700 1 -- 172.21.15.1:0/2142423578 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc34805f150 msgr2=0x7fc348061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.198+0000 7fc36c567700 1 --2- 172.21.15.1:0/2142423578 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc34805f150 0x7fc348061610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fc354006d80 tx=0x7fc354008040).stop 2023-11-15T01:22:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.198+0000 7fc36c567700 1 -- 172.21.15.1:0/2142423578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3640c5f40 msgr2=0x7fc364150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.198+0000 7fc36c567700 1 --2- 172.21.15.1:0/2142423578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3640c5f40 0x7fc364150980 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fc360006fd0 tx=0x7fc360017000).stop 2023-11-15T01:22:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.198+0000 7fc36c567700 1 -- 172.21.15.1:0/2142423578 shutdown_connections 2023-11-15T01:22:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.198+0000 7fc36c567700 1 --2- 172.21.15.1:0/2142423578 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc34805f150 0x7fc348061610 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.198+0000 7fc36c567700 1 --2- 172.21.15.1:0/2142423578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc364154480 0x7fc36415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.198+0000 7fc36c567700 1 --2- 172.21.15.1:0/2142423578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3640c5f40 0x7fc364150980 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.198+0000 7fc36c567700 1 --2- 172.21.15.1:0/2142423578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3641540a0 0x7fc36415a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.198+0000 7fc36c567700 1 -- 172.21.15.1:0/2142423578 >> 172.21.15.1:0/2142423578 conn(0x7fc364064a70 msgr2=0x7fc364063730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.198+0000 7fc36c567700 1 -- 172.21.15.1:0/2142423578 shutdown_connections 2023-11-15T01:22:10.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.198+0000 7fc36c567700 1 -- 172.21.15.1:0/2142423578 wait complete. 2023-11-15T01:22:10.211 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T01:22:10.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.331+0000 7fcc66405700 1 Processor -- start 2023-11-15T01:22:10.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.331+0000 7fcc66405700 1 -- start start 2023-11-15T01:22:10.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.331+0000 7fcc66405700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcc60154480 0x7fcc600c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.331+0000 7fcc66405700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc600c6430 0x7fcc600aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc66405700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc600ca050 con 0x7fcc601540a0 2023-11-15T01:22:10.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc66405700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc600c68c0 con 0x7fcc60154480 2023-11-15T01:22:10.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc66405700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc600c9440 con 0x7fcc600c6430 2023-11-15T01:22:10.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc5f7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcc60154480 0x7fcc600c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc5f7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcc60154480 0x7fcc600c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43806/0 (socket says 172.21.15.1:43806) 2023-11-15T01:22:10.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc5f7fe700 1 -- 172.21.15.1:0/3432089402 learned_addr learned my addr 172.21.15.1:0/3432089402 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:10.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc649a2700 1 --2- 172.21.15.1:0/3432089402 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc600c6430 0x7fcc600aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc5f7fe700 1 -- 172.21.15.1:0/3432089402 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc600c6430 msgr2=0x7fcc600aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:10.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc5f7fe700 1 --2- 172.21.15.1:0/3432089402 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc600c6430 0x7fcc600aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc5f7fe700 1 -- 172.21.15.1:0/3432089402 >> v1:172.21.15.141:6789/0 conn(0x7fcc601540a0 legacy=0x7fcc600ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc5f7fe700 1 -- 172.21.15.1:0/3432089402 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc600c9720 con 0x7fcc60154480 2023-11-15T01:22:10.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc649a2700 1 --2- 172.21.15.1:0/3432089402 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc600c6430 0x7fcc600aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:10.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc5f7fe700 1 --2- 172.21.15.1:0/3432089402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc60154480 0x7fcc600c5f40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fcc50006fd0 tx=0x7fcc500090f0).ready entity=mon.0 client_cookie=f14ebe450c24189a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:10.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc5effd700 1 -- 172.21.15.1:0/3432089402 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5000b600 con 0x7fcc60154480 2023-11-15T01:22:10.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc5effd700 1 -- 172.21.15.1:0/3432089402 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5000b760 con 0x7fcc60154480 2023-11-15T01:22:10.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.332+0000 7fcc5effd700 1 -- 172.21.15.1:0/3432089402 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5000bae0 con 0x7fcc60154480 2023-11-15T01:22:10.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.333+0000 7fcc66405700 1 -- 172.21.15.1:0/3432089402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc60154480 msgr2=0x7fcc600c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.333+0000 7fcc66405700 1 --2- 172.21.15.1:0/3432089402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc60154480 0x7fcc600c5f40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fcc50006fd0 tx=0x7fcc500090f0).stop 2023-11-15T01:22:10.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.333+0000 7fcc66405700 1 -- 172.21.15.1:0/3432089402 shutdown_connections 2023-11-15T01:22:10.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.333+0000 7fcc66405700 1 --2- 172.21.15.1:0/3432089402 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc600c6430 0x7fcc600aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.333+0000 7fcc66405700 1 --2- 172.21.15.1:0/3432089402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc60154480 0x7fcc600c5f40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.333+0000 7fcc66405700 1 -- 172.21.15.1:0/3432089402 >> 172.21.15.1:0/3432089402 conn(0x7fcc60064a70 msgr2=0x7fcc60064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:10.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.333+0000 7fcc66405700 1 -- 172.21.15.1:0/3432089402 shutdown_connections 2023-11-15T01:22:10.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.333+0000 7fcc66405700 1 -- 172.21.15.1:0/3432089402 wait complete. 2023-11-15T01:22:10.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.334+0000 7fcc66405700 1 Processor -- start 2023-11-15T01:22:10.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.334+0000 7fcc66405700 1 -- start start 2023-11-15T01:22:10.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc66405700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc600c6430 0x7fcc60164ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc66405700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc601540a0 0x7fcc60151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc66405700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc60154480 0x7fcc600c1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc66405700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc601654e0 con 0x7fcc60154480 2023-11-15T01:22:10.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc66405700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc600ae460 con 0x7fcc601540a0 2023-11-15T01:22:10.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc66405700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc600ae740 con 0x7fcc600c6430 2023-11-15T01:22:10.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc649a2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc60154480 0x7fcc600c1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc649a2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc60154480 0x7fcc600c1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43808/0 (socket says 172.21.15.1:43808) 2023-11-15T01:22:10.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc649a2700 1 -- 172.21.15.1:0/2132421179 learned_addr learned my addr 172.21.15.1:0/2132421179 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:10.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc5ffff700 1 --2- 172.21.15.1:0/2132421179 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc600c6430 0x7fcc60164ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc5f7fe700 1 --2- 172.21.15.1:0/2132421179 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc601540a0 0x7fcc60151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc649a2700 1 -- 172.21.15.1:0/2132421179 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc600c6430 msgr2=0x7fcc60164ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc649a2700 1 --2- 172.21.15.1:0/2132421179 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc600c6430 0x7fcc60164ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc649a2700 1 -- 172.21.15.1:0/2132421179 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc601540a0 msgr2=0x7fcc60151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc649a2700 1 --2- 172.21.15.1:0/2132421179 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc601540a0 0x7fcc60151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.335+0000 7fcc649a2700 1 -- 172.21.15.1:0/2132421179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc50009370 con 0x7fcc60154480 2023-11-15T01:22:10.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.336+0000 7fcc649a2700 1 --2- 172.21.15.1:0/2132421179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc60154480 0x7fcc600c1250 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fcc5800d180 tx=0x7fcc58009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:10.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.336+0000 7fcc57fff700 1 -- 172.21.15.1:0/2132421179 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5800dcc0 con 0x7fcc60154480 2023-11-15T01:22:10.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.336+0000 7fcc57fff700 1 -- 172.21.15.1:0/2132421179 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5800f040 con 0x7fcc60154480 2023-11-15T01:22:10.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.336+0000 7fcc66405700 1 -- 172.21.15.1:0/2132421179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc600aea20 con 0x7fcc60154480 2023-11-15T01:22:10.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.336+0000 7fcc57fff700 1 -- 172.21.15.1:0/2132421179 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58013600 con 0x7fcc60154480 2023-11-15T01:22:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.336+0000 7fcc66405700 1 -- 172.21.15.1:0/2132421179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6014dbf0 con 0x7fcc60154480 2023-11-15T01:22:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.337+0000 7fcc66405700 1 -- 172.21.15.1:0/2132421179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6006c7e0 con 0x7fcc60154480 2023-11-15T01:22:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.337+0000 7fcc57fff700 1 -- 172.21.15.1:0/2132421179 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcc580139b0 con 0x7fcc60154480 2023-11-15T01:22:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.338+0000 7fcc57fff700 1 --2- 172.21.15.1:0/2132421179 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcc4005f150 0x7fcc40061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.338+0000 7fcc57fff700 1 -- 172.21.15.1:0/2132421179 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcc5807a800 con 0x7fcc60154480 2023-11-15T01:22:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.338+0000 7fcc5ffff700 1 --2- 172.21.15.1:0/2132421179 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcc4005f150 0x7fcc40061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.338+0000 7fcc5ffff700 1 --2- 172.21.15.1:0/2132421179 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcc4005f150 0x7fcc40061610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fcc48003870 tx=0x7fcc48007d40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.342+0000 7fcc57fff700 1 -- 172.21.15.1:0/2132421179 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcc5804ba70 con 0x7fcc60154480 2023-11-15T01:22:10.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.514+0000 7fcc66405700 1 -- 172.21.15.1:0/2132421179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc600c9a00 con 0x7fcc60154480 2023-11-15T01:22:10.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.515+0000 7fcc57fff700 1 -- 172.21.15.1:0/2132421179 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc5804f090 con 0x7fcc60154480 2023-11-15T01:22:10.517 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:22:10.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.516+0000 7fcc66405700 1 -- 172.21.15.1:0/2132421179 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcc4005f150 msgr2=0x7fcc40061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.516+0000 7fcc66405700 1 --2- 172.21.15.1:0/2132421179 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcc4005f150 0x7fcc40061610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fcc48003870 tx=0x7fcc48007d40).stop 2023-11-15T01:22:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.516+0000 7fcc66405700 1 -- 172.21.15.1:0/2132421179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc60154480 msgr2=0x7fcc600c1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.516+0000 7fcc66405700 1 --2- 172.21.15.1:0/2132421179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc60154480 0x7fcc600c1250 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fcc5800d180 tx=0x7fcc58009a50).stop 2023-11-15T01:22:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.516+0000 7fcc66405700 1 -- 172.21.15.1:0/2132421179 shutdown_connections 2023-11-15T01:22:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.516+0000 7fcc66405700 1 --2- 172.21.15.1:0/2132421179 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcc4005f150 0x7fcc40061610 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.516+0000 7fcc66405700 1 --2- 172.21.15.1:0/2132421179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc60154480 0x7fcc600c1250 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.516+0000 7fcc66405700 1 --2- 172.21.15.1:0/2132421179 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc600c6430 0x7fcc60164ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.516+0000 7fcc66405700 1 --2- 172.21.15.1:0/2132421179 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc601540a0 0x7fcc60151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.516+0000 7fcc66405700 1 -- 172.21.15.1:0/2132421179 >> 172.21.15.1:0/2132421179 conn(0x7fcc60064a70 msgr2=0x7fcc601531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:10.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.516+0000 7fcc66405700 1 -- 172.21.15.1:0/2132421179 shutdown_connections 2023-11-15T01:22:10.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.516+0000 7fcc66405700 1 -- 172.21.15.1:0/2132421179 wait complete. 2023-11-15T01:22:10.530 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:22:10.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.646+0000 7fe56ae37700 1 Processor -- start 2023-11-15T01:22:10.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.646+0000 7fe56ae37700 1 -- start start 2023-11-15T01:22:10.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.647+0000 7fe56ae37700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe564154150 0x7fe564154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.647+0000 7fe56ae37700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5640c06f0 con 0x7fe5640aa060 2023-11-15T01:22:10.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.647+0000 7fe56ae37700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5640c09d0 con 0x7fe5640ab1a0 2023-11-15T01:22:10.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.647+0000 7fe56ae37700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe564158820 con 0x7fe564154150 2023-11-15T01:22:10.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.647+0000 7fe5693d4700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe5640aa060 0x7fe5640c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:33460/0 (socket says 172.21.15.1:33460) 2023-11-15T01:22:10.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.647+0000 7fe5693d4700 1 -- 172.21.15.1:0/3654792746 learned_addr learned my addr 172.21.15.1:0/3654792746 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:10.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe568bd3700 1 --2- 172.21.15.1:0/3654792746 >> v2:172.21.15.141:3300/0 conn(0x7fe564154150 0x7fe564154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5637fe700 1 -- 172.21.15.1:0/3654792746 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080335321 0 0) 0x7fe5640c06f0 con 0x7fe5640aa060 2023-11-15T01:22:10.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5637fe700 1 -- 172.21.15.1:0/3654792746 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5500033f0 con 0x7fe5640aa060 2023-11-15T01:22:10.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5637fe700 1 -- 172.21.15.1:0/3654792746 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1446040297 0 0) 0x7fe5500033f0 con 0x7fe5640aa060 2023-11-15T01:22:10.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5637fe700 1 -- 172.21.15.1:0/3654792746 >> v2:172.21.15.141:3300/0 conn(0x7fe564154150 msgr2=0x7fe564154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:10.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5637fe700 1 --2- 172.21.15.1:0/3654792746 >> v2:172.21.15.141:3300/0 conn(0x7fe564154150 0x7fe564154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5637fe700 1 -- 172.21.15.1:0/3654792746 >> v1:172.21.15.141:6789/0 conn(0x7fe5640ab1a0 legacy=0x7fe564158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5637fe700 1 -- 172.21.15.1:0/3654792746 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe564158b00 con 0x7fe5640aa060 2023-11-15T01:22:10.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5637fe700 1 -- 172.21.15.1:0/3654792746 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fe54c001470 con 0x7fe5640aa060 2023-11-15T01:22:10.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5637fe700 1 -- 172.21.15.1:0/3654792746 >> v1:172.21.15.1:6789/0 conn(0x7fe5640aa060 legacy=0x7fe5640c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5637fe700 1 --2- 172.21.15.1:0/3654792746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5500038e0 0x7fe550003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5637fe700 1 --2- 172.21.15.1:0/3654792746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe550004690 0x7fe550004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5637fe700 1 --2- 172.21.15.1:0/3654792746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe550005050 0x7fe55000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5637fe700 1 -- 172.21.15.1:0/3654792746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe564158820 con 0x7fe550005050 2023-11-15T01:22:10.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5637fe700 1 -- 172.21.15.1:0/3654792746 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55000bfe0 con 0x7fe5500038e0 2023-11-15T01:22:10.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5637fe700 1 -- 172.21.15.1:0/3654792746 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55000c1a0 con 0x7fe550004690 2023-11-15T01:22:10.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5693d4700 1 --2- 172.21.15.1:0/3654792746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe550005050 0x7fe55000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe568bd3700 1 --2- 172.21.15.1:0/3654792746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5500038e0 0x7fe550003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe563fff700 1 --2- 172.21.15.1:0/3654792746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe550004690 0x7fe550004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5693d4700 1 -- 172.21.15.1:0/3654792746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe550004690 msgr2=0x7fe550004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:10.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5693d4700 1 --2- 172.21.15.1:0/3654792746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe550004690 0x7fe550004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5693d4700 1 -- 172.21.15.1:0/3654792746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5500038e0 msgr2=0x7fe550003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:10.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5693d4700 1 --2- 172.21.15.1:0/3654792746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5500038e0 0x7fe550003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.648+0000 7fe5693d4700 1 -- 172.21.15.1:0/3654792746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5500033f0 con 0x7fe550005050 2023-11-15T01:22:10.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.649+0000 7fe5693d4700 1 -- 172.21.15.1:0/3654792746 reap_dead start 2023-11-15T01:22:10.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.649+0000 7fe5693d4700 1 --2- 172.21.15.1:0/3654792746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe550005050 0x7fe55000b8e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fe54c00c160 tx=0x7fe54c001e50).ready entity=mon.0 client_cookie=d0158ff92eeb6ee8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:10.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.649+0000 7fe5637fe700 1 -- 172.21.15.1:0/3654792746 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c007a20 con 0x7fe550005050 2023-11-15T01:22:10.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.649+0000 7fe5637fe700 1 -- 172.21.15.1:0/3654792746 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c00ca90 con 0x7fe550005050 2023-11-15T01:22:10.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.649+0000 7fe5637fe700 1 -- 172.21.15.1:0/3654792746 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c00ce10 con 0x7fe550005050 2023-11-15T01:22:10.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.649+0000 7fe56ae37700 1 -- 172.21.15.1:0/3654792746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe550005050 msgr2=0x7fe55000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.649+0000 7fe56ae37700 1 --2- 172.21.15.1:0/3654792746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe550005050 0x7fe55000b8e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fe54c00c160 tx=0x7fe54c001e50).stop 2023-11-15T01:22:10.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.649+0000 7fe56ae37700 1 -- 172.21.15.1:0/3654792746 shutdown_connections 2023-11-15T01:22:10.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.649+0000 7fe56ae37700 1 --2- 172.21.15.1:0/3654792746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe550005050 0x7fe55000b8e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.649+0000 7fe56ae37700 1 -- 172.21.15.1:0/3654792746 >> 172.21.15.1:0/3654792746 conn(0x7fe564064aa0 msgr2=0x7fe564064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:10.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.649+0000 7fe56ae37700 1 -- 172.21.15.1:0/3654792746 shutdown_connections 2023-11-15T01:22:10.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.649+0000 7fe56ae37700 1 -- 172.21.15.1:0/3654792746 wait complete. 2023-11-15T01:22:10.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.650+0000 7fe56ae37700 1 Processor -- start 2023-11-15T01:22:10.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.651+0000 7fe56ae37700 1 -- start start 2023-11-15T01:22:10.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.651+0000 7fe56ae37700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe550005050 0x7fe564156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.651+0000 7fe56ae37700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5641547a0 0x7fe56414d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.651+0000 7fe56ae37700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe564154c20 0x7fe564149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.651+0000 7fe56ae37700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640ab780 con 0x7fe564154c20 2023-11-15T01:22:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.651+0000 7fe56ae37700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe564156990 con 0x7fe5641547a0 2023-11-15T01:22:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.651+0000 7fe56ae37700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe564156c70 con 0x7fe550005050 2023-11-15T01:22:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe5693d4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe564154c20 0x7fe564149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe5693d4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe564154c20 0x7fe564149a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43826/0 (socket says 172.21.15.1:43826) 2023-11-15T01:22:10.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe5693d4700 1 -- 172.21.15.1:0/1205956160 learned_addr learned my addr 172.21.15.1:0/1205956160 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:10.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe563fff700 1 --2- 172.21.15.1:0/1205956160 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5641547a0 0x7fe56414d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe568bd3700 1 --2- 172.21.15.1:0/1205956160 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe550005050 0x7fe564156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe5693d4700 1 -- 172.21.15.1:0/1205956160 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe550005050 msgr2=0x7fe564156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe5693d4700 1 --2- 172.21.15.1:0/1205956160 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe550005050 0x7fe564156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe5693d4700 1 -- 172.21.15.1:0/1205956160 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5641547a0 msgr2=0x7fe56414d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe5693d4700 1 --2- 172.21.15.1:0/1205956160 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5641547a0 0x7fe56414d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe5693d4700 1 -- 172.21.15.1:0/1205956160 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe564156f50 con 0x7fe564154c20 2023-11-15T01:22:10.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe563fff700 1 --2- 172.21.15.1:0/1205956160 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5641547a0 0x7fe56414d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:10.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe5693d4700 1 --2- 172.21.15.1:0/1205956160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe564154c20 0x7fe564149a70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fe54c000c00 tx=0x7fe54c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:10.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe560ff9700 1 -- 172.21.15.1:0/1205956160 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c0048c0 con 0x7fe564154c20 2023-11-15T01:22:10.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe560ff9700 1 -- 172.21.15.1:0/1205956160 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c004a20 con 0x7fe564154c20 2023-11-15T01:22:10.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe56ae37700 1 -- 172.21.15.1:0/1205956160 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe564157230 con 0x7fe564154c20 2023-11-15T01:22:10.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe560ff9700 1 -- 172.21.15.1:0/1205956160 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c004dc0 con 0x7fe564154c20 2023-11-15T01:22:10.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.652+0000 7fe56ae37700 1 -- 172.21.15.1:0/1205956160 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56414d960 con 0x7fe564154c20 2023-11-15T01:22:10.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.653+0000 7fe56ae37700 1 -- 172.21.15.1:0/1205956160 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5640ab8f0 con 0x7fe564154c20 2023-11-15T01:22:10.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.653+0000 7fe560ff9700 1 -- 172.21.15.1:0/1205956160 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe54c013660 con 0x7fe564154c20 2023-11-15T01:22:10.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.654+0000 7fe560ff9700 1 --2- 172.21.15.1:0/1205956160 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe54405f150 0x7fe544061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:10.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.654+0000 7fe560ff9700 1 -- 172.21.15.1:0/1205956160 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe54c07af80 con 0x7fe564154c20 2023-11-15T01:22:10.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.654+0000 7fe568bd3700 1 --2- 172.21.15.1:0/1205956160 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe54405f150 0x7fe544061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:10.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.654+0000 7fe568bd3700 1 --2- 172.21.15.1:0/1205956160 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe54405f150 0x7fe544061610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe55c006d50 tx=0x7fe55c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:10.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.658+0000 7fe560ff9700 1 -- 172.21.15.1:0/1205956160 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe5640ab8f0 con 0x7fe564154c20 2023-11-15T01:22:10.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.872+0000 7fe56ae37700 1 -- 172.21.15.1:0/1205956160 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe56406c7e0 con 0x7fe564154c20 2023-11-15T01:22:10.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.872+0000 7fe560ff9700 1 -- 172.21.15.1:0/1205956160 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4480 (secure 0 0 0) 0x7fe54c025030 con 0x7fe564154c20 2023-11-15T01:22:10.875 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:10.875 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/843391361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":843391361},{"type":"v1","addr":"172.21.15.141:6837","nonce":843391361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2237478530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2237478530},{"type":"v1","addr":"172.21.15.141:6836","nonce":2237478530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2856672167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2856672167},{"type":"v1","addr":"172.21.15.1:6833","nonce":2856672167}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:21:37.045655+0000","modified":"2023-11-15T01:21:40.053500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/4209655632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4209655632},{"type":"v1","addr":"172.21.15.1:6835","nonce":4209655632}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-15T01:22:10.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.874+0000 7fe56ae37700 1 -- 172.21.15.1:0/1205956160 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe54405f150 msgr2=0x7fe544061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.874+0000 7fe56ae37700 1 --2- 172.21.15.1:0/1205956160 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe54405f150 0x7fe544061610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe55c006d50 tx=0x7fe55c008040).stop 2023-11-15T01:22:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.874+0000 7fe56ae37700 1 -- 172.21.15.1:0/1205956160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe564154c20 msgr2=0x7fe564149a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.874+0000 7fe56ae37700 1 --2- 172.21.15.1:0/1205956160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe564154c20 0x7fe564149a70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fe54c000c00 tx=0x7fe54c015000).stop 2023-11-15T01:22:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.874+0000 7fe56ae37700 1 -- 172.21.15.1:0/1205956160 shutdown_connections 2023-11-15T01:22:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.874+0000 7fe56ae37700 1 --2- 172.21.15.1:0/1205956160 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe54405f150 0x7fe544061610 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.874+0000 7fe56ae37700 1 --2- 172.21.15.1:0/1205956160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe564154c20 0x7fe564149a70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.874+0000 7fe56ae37700 1 --2- 172.21.15.1:0/1205956160 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe550005050 0x7fe564156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.874+0000 7fe56ae37700 1 --2- 172.21.15.1:0/1205956160 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5641547a0 0x7fe56414d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:10.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.874+0000 7fe56ae37700 1 -- 172.21.15.1:0/1205956160 >> 172.21.15.1:0/1205956160 conn(0x7fe564064aa0 msgr2=0x7fe564063460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:10.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.874+0000 7fe56ae37700 1 -- 172.21.15.1:0/1205956160 shutdown_connections 2023-11-15T01:22:10.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:10.874+0000 7fe56ae37700 1 -- 172.21.15.1:0/1205956160 wait complete. 2023-11-15T01:22:10.879 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2023-11-15T01:22:10.888 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:22:11.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.005+0000 7f9353160700 1 Processor -- start 2023-11-15T01:22:11.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.005+0000 7f9353160700 1 -- start start 2023-11-15T01:22:11.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.006+0000 7f9353160700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f934c0833a0 0x7f934c0a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.006+0000 7f9353160700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c0a85e0 con 0x7f934c154450 2023-11-15T01:22:11.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.006+0000 7f9353160700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c065660 con 0x7f934c0be520 2023-11-15T01:22:11.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.006+0000 7f9353160700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c065940 con 0x7f934c0833a0 2023-11-15T01:22:11.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.006+0000 7f9350efc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f934c154450 0x7f934c0bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:33466/0 (socket says 172.21.15.1:33466) 2023-11-15T01:22:11.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.006+0000 7f9350efc700 1 -- 172.21.15.1:0/4002015876 learned_addr learned my addr 172.21.15.1:0/4002015876 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:11.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.006+0000 7f934b7fe700 1 -- 172.21.15.1:0/4002015876 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225700663 0 0) 0x7f934c0a85e0 con 0x7f934c154450 2023-11-15T01:22:11.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.006+0000 7f934bfff700 1 --2- 172.21.15.1:0/4002015876 >> v2:172.21.15.141:3300/0 conn(0x7f934c0833a0 0x7f934c0a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.006+0000 7f934b7fe700 1 -- 172.21.15.1:0/4002015876 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93380033f0 con 0x7f934c154450 2023-11-15T01:22:11.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.006+0000 7f934b7fe700 1 -- 172.21.15.1:0/4002015876 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2934499226 0 0) 0x7f93380033f0 con 0x7f934c154450 2023-11-15T01:22:11.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.006+0000 7f934b7fe700 1 -- 172.21.15.1:0/4002015876 >> v2:172.21.15.141:3300/0 conn(0x7f934c0833a0 msgr2=0x7f934c0a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:11.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.006+0000 7f934b7fe700 1 --2- 172.21.15.1:0/4002015876 >> v2:172.21.15.141:3300/0 conn(0x7f934c0833a0 0x7f934c0a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.006+0000 7f934b7fe700 1 -- 172.21.15.1:0/4002015876 >> v1:172.21.15.141:6789/0 conn(0x7f934c0be520 legacy=0x7f934c0c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.006+0000 7f934b7fe700 1 -- 172.21.15.1:0/4002015876 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c0c6f50 con 0x7f934c154450 2023-11-15T01:22:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.006+0000 7f934b7fe700 1 -- 172.21.15.1:0/4002015876 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f9344001970 con 0x7f934c154450 2023-11-15T01:22:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f934b7fe700 1 -- 172.21.15.1:0/4002015876 >> v1:172.21.15.1:6789/0 conn(0x7f934c154450 legacy=0x7f934c0bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f934b7fe700 1 --2- 172.21.15.1:0/4002015876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93380038e0 0x7f9338003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f934b7fe700 1 --2- 172.21.15.1:0/4002015876 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9338004690 0x7f9338004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f934b7fe700 1 --2- 172.21.15.1:0/4002015876 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9338005000 0x7f933800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f934b7fe700 1 -- 172.21.15.1:0/4002015876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c065940 con 0x7f93380038e0 2023-11-15T01:22:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f934b7fe700 1 -- 172.21.15.1:0/4002015876 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933800beb0 con 0x7f9338005000 2023-11-15T01:22:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f934b7fe700 1 -- 172.21.15.1:0/4002015876 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933800c070 con 0x7f9338004690 2023-11-15T01:22:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f9350efc700 1 --2- 172.21.15.1:0/4002015876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93380038e0 0x7f9338003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f934bfff700 1 --2- 172.21.15.1:0/4002015876 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9338004690 0x7f9338004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f93516fd700 1 --2- 172.21.15.1:0/4002015876 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9338005000 0x7f933800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f9350efc700 1 -- 172.21.15.1:0/4002015876 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9338004690 msgr2=0x7f9338004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:11.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f9350efc700 1 --2- 172.21.15.1:0/4002015876 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9338004690 0x7f9338004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f9350efc700 1 -- 172.21.15.1:0/4002015876 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9338005000 msgr2=0x7f933800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:11.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f9350efc700 1 --2- 172.21.15.1:0/4002015876 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9338005000 0x7f933800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f9350efc700 1 -- 172.21.15.1:0/4002015876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93380033f0 con 0x7f93380038e0 2023-11-15T01:22:11.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f93516fd700 1 -- 172.21.15.1:0/4002015876 reap_dead start 2023-11-15T01:22:11.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f9350efc700 1 --2- 172.21.15.1:0/4002015876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93380038e0 0x7f9338003d00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f934400c5f0 tx=0x7f9344007b20).ready entity=mon.0 client_cookie=5cfae0e8419d62ae server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:11.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f934b7fe700 1 -- 172.21.15.1:0/4002015876 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344007d50 con 0x7f93380038e0 2023-11-15T01:22:11.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f934b7fe700 1 -- 172.21.15.1:0/4002015876 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934400cdf0 con 0x7f93380038e0 2023-11-15T01:22:11.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.007+0000 7f934b7fe700 1 -- 172.21.15.1:0/4002015876 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344005c00 con 0x7f93380038e0 2023-11-15T01:22:11.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.008+0000 7f9353160700 1 -- 172.21.15.1:0/4002015876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93380038e0 msgr2=0x7f9338003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.008+0000 7f9353160700 1 --2- 172.21.15.1:0/4002015876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93380038e0 0x7f9338003d00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f934400c5f0 tx=0x7f9344007b20).stop 2023-11-15T01:22:11.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.008+0000 7f9353160700 1 -- 172.21.15.1:0/4002015876 shutdown_connections 2023-11-15T01:22:11.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.008+0000 7f9353160700 1 --2- 172.21.15.1:0/4002015876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93380038e0 0x7f9338003d00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.008+0000 7f9353160700 1 -- 172.21.15.1:0/4002015876 >> 172.21.15.1:0/4002015876 conn(0x7f934c082f90 msgr2=0x7f934c0c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:11.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.008+0000 7f9353160700 1 -- 172.21.15.1:0/4002015876 shutdown_connections 2023-11-15T01:22:11.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.008+0000 7f9353160700 1 -- 172.21.15.1:0/4002015876 wait complete. 2023-11-15T01:22:11.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.009+0000 7f9353160700 1 Processor -- start 2023-11-15T01:22:11.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.009+0000 7f9353160700 1 -- start start 2023-11-15T01:22:11.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9353160700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93380038e0 0x7f934c150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9353160700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f934c0a6c90 0x7f934c0a7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9353160700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f934c164640 0x7f934c164ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9353160700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c150630 con 0x7f93380038e0 2023-11-15T01:22:11.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9353160700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c165ef0 con 0x7f934c164640 2023-11-15T01:22:11.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9353160700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0a8240 con 0x7f934c0a6c90 2023-11-15T01:22:11.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9350efc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93380038e0 0x7f934c150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9350efc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93380038e0 0x7f934c150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43836/0 (socket says 172.21.15.1:43836) 2023-11-15T01:22:11.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9350efc700 1 -- 172.21.15.1:0/2464886419 learned_addr learned my addr 172.21.15.1:0/2464886419 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:11.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f934bfff700 1 --2- 172.21.15.1:0/2464886419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f934c0a6c90 0x7f934c0a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f93516fd700 1 --2- 172.21.15.1:0/2464886419 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f934c164640 0x7f934c164ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9350efc700 1 -- 172.21.15.1:0/2464886419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f934c0a6c90 msgr2=0x7f934c0a7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9350efc700 1 --2- 172.21.15.1:0/2464886419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f934c0a6c90 0x7f934c0a7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9350efc700 1 -- 172.21.15.1:0/2464886419 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f934c164640 msgr2=0x7f934c164ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9350efc700 1 --2- 172.21.15.1:0/2464886419 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f934c164640 0x7f934c164ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9350efc700 1 -- 172.21.15.1:0/2464886419 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c0a7600 con 0x7f93380038e0 2023-11-15T01:22:11.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9350efc700 1 --2- 172.21.15.1:0/2464886419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93380038e0 0x7f934c150140 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f934400cbe0 tx=0x7f9344015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:11.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9348ff9700 1 -- 172.21.15.1:0/2464886419 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344001970 con 0x7f93380038e0 2023-11-15T01:22:11.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9348ff9700 1 -- 172.21.15.1:0/2464886419 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93440012f0 con 0x7f93380038e0 2023-11-15T01:22:11.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9348ff9700 1 -- 172.21.15.1:0/2464886419 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344005c00 con 0x7f93380038e0 2023-11-15T01:22:11.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.010+0000 7f9353160700 1 -- 172.21.15.1:0/2464886419 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934c1658e0 con 0x7f93380038e0 2023-11-15T01:22:11.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.011+0000 7f9353160700 1 -- 172.21.15.1:0/2464886419 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c165b80 con 0x7f93380038e0 2023-11-15T01:22:11.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.012+0000 7f9353160700 1 -- 172.21.15.1:0/2464886419 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c0bf520 con 0x7f93380038e0 2023-11-15T01:22:11.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.012+0000 7f9348ff9700 1 -- 172.21.15.1:0/2464886419 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9344013660 con 0x7f93380038e0 2023-11-15T01:22:11.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.012+0000 7f9348ff9700 1 --2- 172.21.15.1:0/2464886419 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f932c05f150 0x7f932c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.012+0000 7f9348ff9700 1 -- 172.21.15.1:0/2464886419 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f934407b110 con 0x7f93380038e0 2023-11-15T01:22:11.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.012+0000 7f934bfff700 1 --2- 172.21.15.1:0/2464886419 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f932c05f150 0x7f932c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.013+0000 7f934bfff700 1 --2- 172.21.15.1:0/2464886419 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f932c05f150 0x7f932c061610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f934c1514b0 tx=0x7f933c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:11.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.016+0000 7f9348ff9700 1 -- 172.21.15.1:0/2464886419 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f934404c3e0 con 0x7f93380038e0 2023-11-15T01:22:11.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.192+0000 7f9353160700 1 -- 172.21.15.1:0/2464886419 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f934c0bf0b0 con 0x7f93380038e0 2023-11-15T01:22:11.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.192+0000 7f9348ff9700 1 -- 172.21.15.1:0/2464886419 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16880 (secure 0 0 0) 0x7f9344024070 con 0x7f93380038e0 2023-11-15T01:22:11.195 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:11.195 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:38.047484+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:21:34.763591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-15T01:21:36.025071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:22:11.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.194+0000 7f9353160700 1 -- 172.21.15.1:0/2464886419 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f932c05f150 msgr2=0x7f932c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.194+0000 7f9353160700 1 --2- 172.21.15.1:0/2464886419 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f932c05f150 0x7f932c061610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f934c1514b0 tx=0x7f933c008040).stop 2023-11-15T01:22:11.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.194+0000 7f9353160700 1 -- 172.21.15.1:0/2464886419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93380038e0 msgr2=0x7f934c150140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.194+0000 7f9353160700 1 --2- 172.21.15.1:0/2464886419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93380038e0 0x7f934c150140 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f934400cbe0 tx=0x7f9344015000).stop 2023-11-15T01:22:11.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.194+0000 7f9353160700 1 -- 172.21.15.1:0/2464886419 shutdown_connections 2023-11-15T01:22:11.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.194+0000 7f9353160700 1 --2- 172.21.15.1:0/2464886419 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f932c05f150 0x7f932c061610 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.194+0000 7f9353160700 1 --2- 172.21.15.1:0/2464886419 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f934c164640 0x7f934c164ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.194+0000 7f9353160700 1 --2- 172.21.15.1:0/2464886419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93380038e0 0x7f934c150140 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.194+0000 7f9353160700 1 --2- 172.21.15.1:0/2464886419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f934c0a6c90 0x7f934c0a7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.194+0000 7f9353160700 1 -- 172.21.15.1:0/2464886419 >> 172.21.15.1:0/2464886419 conn(0x7f934c082f90 msgr2=0x7f934c064b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:11.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.195+0000 7f9353160700 1 -- 172.21.15.1:0/2464886419 shutdown_connections 2023-11-15T01:22:11.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.195+0000 7f9353160700 1 -- 172.21.15.1:0/2464886419 wait complete. 2023-11-15T01:22:11.209 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-15T01:22:11.209 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:22:11.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.327+0000 7f714d8e5700 1 Processor -- start 2023-11-15T01:22:11.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.327+0000 7f714d8e5700 1 -- start start 2023-11-15T01:22:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f714d8e5700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f71480c8390 0x7f714814e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f714d8e5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f71480c12e0 0x7f714814e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f714d8e5700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71481559e0 con 0x7f71480ca9b0 2023-11-15T01:22:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f714d8e5700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71480c7560 con 0x7f71480c12e0 2023-11-15T01:22:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f714d8e5700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7148154dd0 con 0x7f71480c8390 2023-11-15T01:22:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f71477fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f71480c12e0 0x7f714814e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f7146ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f71480ca9b0 0x7f71480c0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:33468/0 (socket says 172.21.15.1:33468) 2023-11-15T01:22:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f7146ffd700 1 -- 172.21.15.1:0/3285508677 learned_addr learned my addr 172.21.15.1:0/3285508677 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f71467fc700 1 --2- 172.21.15.1:0/3285508677 >> v2:172.21.15.141:3300/0 conn(0x7f71480c8390 0x7f714814e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f71477fe700 1 -- 172.21.15.1:0/3285508677 >> v2:172.21.15.141:3300/0 conn(0x7f71480c8390 msgr2=0x7f714814e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f71477fe700 1 --2- 172.21.15.1:0/3285508677 >> v2:172.21.15.141:3300/0 conn(0x7f71480c8390 0x7f714814e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f71477fe700 1 -- 172.21.15.1:0/3285508677 >> v1:172.21.15.1:6789/0 conn(0x7f71480ca9b0 legacy=0x7f71480c0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f7145ffb700 1 -- 172.21.15.1:0/3285508677 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004779249 0 0) 0x7f71481559e0 con 0x7f71480ca9b0 2023-11-15T01:22:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f71477fe700 1 -- 172.21.15.1:0/3285508677 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71481550b0 con 0x7f71480c12e0 2023-11-15T01:22:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f71467fc700 1 --2- 172.21.15.1:0/3285508677 >> v2:172.21.15.141:3300/0 conn(0x7f71480c8390 0x7f714814e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f71477fe700 1 --2- 172.21.15.1:0/3285508677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71480c12e0 0x7f714814e8c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f7148157f80 tx=0x7f7140009780).ready entity=mon.0 client_cookie=1e3ed5fee5abb963 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:11.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f7145ffb700 1 -- 172.21.15.1:0/3285508677 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714000e070 con 0x7f71480c12e0 2023-11-15T01:22:11.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f7145ffb700 1 -- 172.21.15.1:0/3285508677 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714000bc30 con 0x7f71480c12e0 2023-11-15T01:22:11.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.328+0000 7f7145ffb700 1 -- 172.21.15.1:0/3285508677 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140012410 con 0x7f71480c12e0 2023-11-15T01:22:11.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.329+0000 7f714d8e5700 1 -- 172.21.15.1:0/3285508677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71480c12e0 msgr2=0x7f714814e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.329+0000 7f714d8e5700 1 --2- 172.21.15.1:0/3285508677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71480c12e0 0x7f714814e8c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f7148157f80 tx=0x7f7140009780).stop 2023-11-15T01:22:11.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.329+0000 7f714d8e5700 1 -- 172.21.15.1:0/3285508677 shutdown_connections 2023-11-15T01:22:11.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.329+0000 7f714d8e5700 1 --2- 172.21.15.1:0/3285508677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71480c12e0 0x7f714814e8c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.329+0000 7f714d8e5700 1 --2- 172.21.15.1:0/3285508677 >> v2:172.21.15.141:3300/0 conn(0x7f71480c8390 0x7f714814e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.329+0000 7f714d8e5700 1 -- 172.21.15.1:0/3285508677 >> 172.21.15.1:0/3285508677 conn(0x7f7148084ec0 msgr2=0x7f71480947e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:11.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.329+0000 7f714d8e5700 1 -- 172.21.15.1:0/3285508677 shutdown_connections 2023-11-15T01:22:11.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.329+0000 7f714d8e5700 1 -- 172.21.15.1:0/3285508677 wait complete. 2023-11-15T01:22:11.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.330+0000 7f714d8e5700 1 Processor -- start 2023-11-15T01:22:11.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.330+0000 7f714d8e5700 1 -- start start 2023-11-15T01:22:11.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f714d8e5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71480c12e0 0x7f7148158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f714d8e5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71480c8390 0x7f7148151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f714d8e5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71480ca9b0 0x7f71480af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f714d8e5700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71480c4d00 con 0x7f71480ca9b0 2023-11-15T01:22:11.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f714d8e5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71480b0310 con 0x7f71480c8390 2023-11-15T01:22:11.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f714d8e5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71480c4a20 con 0x7f71480c12e0 2023-11-15T01:22:11.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f71477fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71480ca9b0 0x7f71480af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f71477fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71480ca9b0 0x7f71480af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43868/0 (socket says 172.21.15.1:43868) 2023-11-15T01:22:11.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f71477fe700 1 -- 172.21.15.1:0/2989079244 learned_addr learned my addr 172.21.15.1:0/2989079244 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:11.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f71467fc700 1 --2- 172.21.15.1:0/2989079244 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71480c8390 0x7f7148151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f7146ffd700 1 --2- 172.21.15.1:0/2989079244 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71480c12e0 0x7f7148158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f71477fe700 1 -- 172.21.15.1:0/2989079244 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71480c12e0 msgr2=0x7f7148158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f71477fe700 1 --2- 172.21.15.1:0/2989079244 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71480c12e0 0x7f7148158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f71477fe700 1 -- 172.21.15.1:0/2989079244 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71480c8390 msgr2=0x7f7148151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f71477fe700 1 --2- 172.21.15.1:0/2989079244 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71480c8390 0x7f7148151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f71477fe700 1 -- 172.21.15.1:0/2989079244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7140009a20 con 0x7f71480ca9b0 2023-11-15T01:22:11.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f7146ffd700 1 --2- 172.21.15.1:0/2989079244 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71480c12e0 0x7f7148158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:11.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.331+0000 7f71477fe700 1 --2- 172.21.15.1:0/2989079244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71480ca9b0 0x7f71480af050 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f7148084670 tx=0x7f7140009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:11.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.332+0000 7f712effd700 1 -- 172.21.15.1:0/2989079244 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400117d0 con 0x7f71480ca9b0 2023-11-15T01:22:11.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.332+0000 7f712effd700 1 -- 172.21.15.1:0/2989079244 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7140011930 con 0x7f71480ca9b0 2023-11-15T01:22:11.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.332+0000 7f714d8e5700 1 -- 172.21.15.1:0/2989079244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71480afcc0 con 0x7f71480ca9b0 2023-11-15T01:22:11.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.332+0000 7f712effd700 1 -- 172.21.15.1:0/2989079244 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140011cf0 con 0x7f71480ca9b0 2023-11-15T01:22:11.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.332+0000 7f714d8e5700 1 -- 172.21.15.1:0/2989079244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7148152210 con 0x7f71480ca9b0 2023-11-15T01:22:11.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.333+0000 7f714d8e5700 1 -- 172.21.15.1:0/2989079244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7148157dc0 con 0x7f71480ca9b0 2023-11-15T01:22:11.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.333+0000 7f712effd700 1 -- 172.21.15.1:0/2989079244 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7140003040 con 0x7f71480ca9b0 2023-11-15T01:22:11.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.333+0000 7f712effd700 1 --2- 172.21.15.1:0/2989079244 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f713405f120 0x7f71340615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.333+0000 7f712effd700 1 -- 172.21.15.1:0/2989079244 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f714007c220 con 0x7f71480ca9b0 2023-11-15T01:22:11.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.334+0000 7f7146ffd700 1 --2- 172.21.15.1:0/2989079244 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f713405f120 0x7f71340615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.334+0000 7f7146ffd700 1 --2- 172.21.15.1:0/2989079244 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f713405f120 0x7f71340615e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f7138001680 tx=0x7f7138009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:11.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.338+0000 7f712effd700 1 -- 172.21.15.1:0/2989079244 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f714004d4f0 con 0x7f71480ca9b0 2023-11-15T01:22:11.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.551+0000 7f714d8e5700 1 -- 172.21.15.1:0/2989079244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71480475e0 con 0x7f71480ca9b0 2023-11-15T01:22:11.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.551+0000 7f712effd700 1 -- 172.21.15.1:0/2989079244 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4480 (secure 0 0 0) 0x7f71480475e0 con 0x7f71480ca9b0 2023-11-15T01:22:11.554 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:11.554 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/843391361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":843391361},{"type":"v1","addr":"172.21.15.141:6837","nonce":843391361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2237478530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2237478530},{"type":"v1","addr":"172.21.15.141:6836","nonce":2237478530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2856672167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2856672167},{"type":"v1","addr":"172.21.15.1:6833","nonce":2856672167}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:21:37.045655+0000","modified":"2023-11-15T01:21:40.053500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/4209655632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4209655632},{"type":"v1","addr":"172.21.15.1:6835","nonce":4209655632}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-15T01:22:11.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.553+0000 7f714d8e5700 1 -- 172.21.15.1:0/2989079244 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f713405f120 msgr2=0x7f71340615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.553+0000 7f714d8e5700 1 --2- 172.21.15.1:0/2989079244 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f713405f120 0x7f71340615e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f7138001680 tx=0x7f7138009040).stop 2023-11-15T01:22:11.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.553+0000 7f714d8e5700 1 -- 172.21.15.1:0/2989079244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71480ca9b0 msgr2=0x7f71480af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.553+0000 7f714d8e5700 1 --2- 172.21.15.1:0/2989079244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71480ca9b0 0x7f71480af050 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f7148084670 tx=0x7f7140009780).stop 2023-11-15T01:22:11.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.553+0000 7f714d8e5700 1 -- 172.21.15.1:0/2989079244 shutdown_connections 2023-11-15T01:22:11.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.553+0000 7f714d8e5700 1 --2- 172.21.15.1:0/2989079244 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f713405f120 0x7f71340615e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.553+0000 7f714d8e5700 1 --2- 172.21.15.1:0/2989079244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71480ca9b0 0x7f71480af050 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.553+0000 7f714d8e5700 1 --2- 172.21.15.1:0/2989079244 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71480c12e0 0x7f7148158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.553+0000 7f714d8e5700 1 --2- 172.21.15.1:0/2989079244 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71480c8390 0x7f7148151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.553+0000 7f714d8e5700 1 -- 172.21.15.1:0/2989079244 >> 172.21.15.1:0/2989079244 conn(0x7f7148084ec0 msgr2=0x7f7148063f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:11.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.553+0000 7f714d8e5700 1 -- 172.21.15.1:0/2989079244 shutdown_connections 2023-11-15T01:22:11.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.553+0000 7f714d8e5700 1 -- 172.21.15.1:0/2989079244 wait complete. 2023-11-15T01:22:11.558 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2023-11-15T01:22:11.567 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:22:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.683+0000 7f098e9d6700 1 Processor -- start 2023-11-15T01:22:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.683+0000 7f098e9d6700 1 -- start start 2023-11-15T01:22:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.684+0000 7f098e9d6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09880629e0 0x7f09880c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.684+0000 7f098e9d6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f09880abb40 0x7f0988064df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.684+0000 7f098e9d6700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09880a9f60 con 0x7f09880c3400 2023-11-15T01:22:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.684+0000 7f098e9d6700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09880c3880 con 0x7f09880abb40 2023-11-15T01:22:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.684+0000 7f098e9d6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0988151700 con 0x7f09880629e0 2023-11-15T01:22:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.684+0000 7f098cf73700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f09880abb40 0x7f0988064df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.684+0000 7f098cf73700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f09880abb40 0x7f0988064df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43874/0 (socket says 172.21.15.1:43874) 2023-11-15T01:22:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.684+0000 7f098cf73700 1 -- 172.21.15.1:0/1633779939 learned_addr learned my addr 172.21.15.1:0/1633779939 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.685+0000 7f0987fff700 1 --2- 172.21.15.1:0/1633779939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09880629e0 0x7f09880c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.685+0000 7f098cf73700 1 -- 172.21.15.1:0/1633779939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09880629e0 msgr2=0x7f09880c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.685+0000 7f098cf73700 1 --2- 172.21.15.1:0/1633779939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09880629e0 0x7f09880c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.685+0000 7f098cf73700 1 -- 172.21.15.1:0/1633779939 >> v1:172.21.15.141:6789/0 conn(0x7f09880c3400 legacy=0x7f09880ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.685+0000 7f098cf73700 1 -- 172.21.15.1:0/1633779939 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09880c2a80 con 0x7f09880abb40 2023-11-15T01:22:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.685+0000 7f098cf73700 1 --2- 172.21.15.1:0/1633779939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09880abb40 0x7f0988064df0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f0980009f50 tx=0x7f0980009840).ready entity=mon.0 client_cookie=989d6d34ac65d6d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:11.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.685+0000 7f0986ffd700 1 -- 172.21.15.1:0/1633779939 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098000e070 con 0x7f09880abb40 2023-11-15T01:22:11.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.685+0000 7f0986ffd700 1 -- 172.21.15.1:0/1633779939 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098000ba30 con 0x7f09880abb40 2023-11-15T01:22:11.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.685+0000 7f0986ffd700 1 -- 172.21.15.1:0/1633779939 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098000bdb0 con 0x7f09880abb40 2023-11-15T01:22:11.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.686+0000 7f098e9d6700 1 -- 172.21.15.1:0/1633779939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09880abb40 msgr2=0x7f0988064df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.686+0000 7f098e9d6700 1 --2- 172.21.15.1:0/1633779939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09880abb40 0x7f0988064df0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f0980009f50 tx=0x7f0980009840).stop 2023-11-15T01:22:11.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.686+0000 7f098e9d6700 1 -- 172.21.15.1:0/1633779939 shutdown_connections 2023-11-15T01:22:11.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.686+0000 7f098e9d6700 1 --2- 172.21.15.1:0/1633779939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09880629e0 0x7f09880c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.686+0000 7f098e9d6700 1 --2- 172.21.15.1:0/1633779939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09880abb40 0x7f0988064df0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.686+0000 7f098e9d6700 1 -- 172.21.15.1:0/1633779939 >> 172.21.15.1:0/1633779939 conn(0x7f09880c74f0 msgr2=0x7f09880c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:11.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.686+0000 7f098e9d6700 1 -- 172.21.15.1:0/1633779939 shutdown_connections 2023-11-15T01:22:11.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.686+0000 7f098e9d6700 1 -- 172.21.15.1:0/1633779939 wait complete. 2023-11-15T01:22:11.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.687+0000 7f098e9d6700 1 Processor -- start 2023-11-15T01:22:11.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.687+0000 7f098e9d6700 1 -- start start 2023-11-15T01:22:11.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098e9d6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09880629e0 0x7f098814d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098e9d6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09880c3400 0x7f09880a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098e9d6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09880a2900 0x7f0988150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098e9d6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0988154160 con 0x7f09880a2900 2023-11-15T01:22:11.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098e9d6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0988153850 con 0x7f09880629e0 2023-11-15T01:22:11.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098e9d6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09880a2e60 con 0x7f09880c3400 2023-11-15T01:22:11.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098cf73700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09880a2900 0x7f0988150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098cf73700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09880a2900 0x7f0988150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43880/0 (socket says 172.21.15.1:43880) 2023-11-15T01:22:11.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098cf73700 1 -- 172.21.15.1:0/4111656977 learned_addr learned my addr 172.21.15.1:0/4111656977 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:11.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f0987fff700 1 --2- 172.21.15.1:0/4111656977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09880629e0 0x7f098814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f09877fe700 1 --2- 172.21.15.1:0/4111656977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09880c3400 0x7f09880a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098cf73700 1 -- 172.21.15.1:0/4111656977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09880c3400 msgr2=0x7f09880a2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098cf73700 1 --2- 172.21.15.1:0/4111656977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09880c3400 0x7f09880a2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098cf73700 1 -- 172.21.15.1:0/4111656977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09880629e0 msgr2=0x7f098814d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098cf73700 1 --2- 172.21.15.1:0/4111656977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09880629e0 0x7f098814d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098cf73700 1 -- 172.21.15.1:0/4111656977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0980009ae0 con 0x7f09880a2900 2023-11-15T01:22:11.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098cf73700 1 --2- 172.21.15.1:0/4111656977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09880a2900 0x7f0988150480 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f09880c5000 tx=0x7f0980009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:11.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f096ffff700 1 -- 172.21.15.1:0/4111656977 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09800092e0 con 0x7f09880a2900 2023-11-15T01:22:11.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f096ffff700 1 -- 172.21.15.1:0/4111656977 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098001e470 con 0x7f09880a2900 2023-11-15T01:22:11.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f098e9d6700 1 -- 172.21.15.1:0/4111656977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0988153b10 con 0x7f09880a2900 2023-11-15T01:22:11.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.688+0000 7f096ffff700 1 -- 172.21.15.1:0/4111656977 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098001e830 con 0x7f09880a2900 2023-11-15T01:22:11.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.689+0000 7f098e9d6700 1 -- 172.21.15.1:0/4111656977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098814d9f0 con 0x7f09880a2900 2023-11-15T01:22:11.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.690+0000 7f098e9d6700 1 -- 172.21.15.1:0/4111656977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09881542d0 con 0x7f09880a2900 2023-11-15T01:22:11.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.690+0000 7f096ffff700 1 -- 172.21.15.1:0/4111656977 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0980003040 con 0x7f09880a2900 2023-11-15T01:22:11.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.690+0000 7f096ffff700 1 --2- 172.21.15.1:0/4111656977 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f097405f150 0x7f0974061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:11.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.690+0000 7f096ffff700 1 -- 172.21.15.1:0/4111656977 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f098007b800 con 0x7f09880a2900 2023-11-15T01:22:11.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.690+0000 7f0987fff700 1 --2- 172.21.15.1:0/4111656977 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f097405f150 0x7f0974061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:11.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.691+0000 7f0987fff700 1 --2- 172.21.15.1:0/4111656977 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f097405f150 0x7f0974061610 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f097800bbc0 tx=0x7f0978008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:11.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.694+0000 7f096ffff700 1 -- 172.21.15.1:0/4111656977 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f098004cad0 con 0x7f09880a2900 2023-11-15T01:22:11.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.916+0000 7f098e9d6700 1 -- 172.21.15.1:0/4111656977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f098806c7e0 con 0x7f09880a2900 2023-11-15T01:22:11.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.916+0000 7f096ffff700 1 -- 172.21.15.1:0/4111656977 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4480 (secure 0 0 0) 0x7f0980023070 con 0x7f09880a2900 2023-11-15T01:22:11.919 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:11.919 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/843391361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":843391361},{"type":"v1","addr":"172.21.15.141:6837","nonce":843391361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2237478530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2237478530},{"type":"v1","addr":"172.21.15.141:6836","nonce":2237478530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2856672167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2856672167},{"type":"v1","addr":"172.21.15.1:6833","nonce":2856672167}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:21:37.045655+0000","modified":"2023-11-15T01:21:40.053500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/4209655632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4209655632},{"type":"v1","addr":"172.21.15.1:6835","nonce":4209655632}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-15T01:22:11.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.918+0000 7f098e9d6700 1 -- 172.21.15.1:0/4111656977 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f097405f150 msgr2=0x7f0974061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.918+0000 7f098e9d6700 1 --2- 172.21.15.1:0/4111656977 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f097405f150 0x7f0974061610 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f097800bbc0 tx=0x7f0978008040).stop 2023-11-15T01:22:11.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.918+0000 7f098e9d6700 1 -- 172.21.15.1:0/4111656977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09880a2900 msgr2=0x7f0988150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:11.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.918+0000 7f098e9d6700 1 --2- 172.21.15.1:0/4111656977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09880a2900 0x7f0988150480 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f09880c5000 tx=0x7f0980009840).stop 2023-11-15T01:22:11.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.918+0000 7f098e9d6700 1 -- 172.21.15.1:0/4111656977 shutdown_connections 2023-11-15T01:22:11.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.918+0000 7f098e9d6700 1 --2- 172.21.15.1:0/4111656977 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f097405f150 0x7f0974061610 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.918+0000 7f098e9d6700 1 --2- 172.21.15.1:0/4111656977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09880a2900 0x7f0988150480 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.918+0000 7f098e9d6700 1 --2- 172.21.15.1:0/4111656977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09880629e0 0x7f098814d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.918+0000 7f098e9d6700 1 --2- 172.21.15.1:0/4111656977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09880c3400 0x7f09880a2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:11.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.918+0000 7f098e9d6700 1 -- 172.21.15.1:0/4111656977 >> 172.21.15.1:0/4111656977 conn(0x7f09880c74f0 msgr2=0x7f09880c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:11.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.919+0000 7f098e9d6700 1 -- 172.21.15.1:0/4111656977 shutdown_connections 2023-11-15T01:22:11.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:11.919+0000 7f098e9d6700 1 -- 172.21.15.1:0/4111656977 wait complete. 2023-11-15T01:22:11.923 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2023-11-15T01:22:11.933 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:22:12.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.050+0000 7f5f9634b700 1 Processor -- start 2023-11-15T01:22:12.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.050+0000 7f5f9634b700 1 -- start start 2023-11-15T01:22:12.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.051+0000 7f5f9634b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5f90154e70 0x7f5f90155270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.051+0000 7f5f9634b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f900ad5e0 con 0x7f5f900bdfb0 2023-11-15T01:22:12.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.051+0000 7f5f9634b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f900ad8c0 con 0x7f5f900be390 2023-11-15T01:22:12.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.051+0000 7f5f9634b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f900bccd0 con 0x7f5f90154e70 2023-11-15T01:22:12.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.051+0000 7f5f948e8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5f90154e70 0x7f5f90155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.051+0000 7f5f8ffff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5f900bdfb0 0x7f5f900c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:33470/0 (socket says 172.21.15.1:33470) 2023-11-15T01:22:12.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.051+0000 7f5f8ffff700 1 -- 172.21.15.1:0/2931978953 learned_addr learned my addr 172.21.15.1:0/2931978953 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:12.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.051+0000 7f5f948e8700 1 -- 172.21.15.1:0/2931978953 >> v1:172.21.15.141:6789/0 conn(0x7f5f900be390 legacy=0x7f5f900bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:12.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.052+0000 7f5f948e8700 1 -- 172.21.15.1:0/2931978953 >> v1:172.21.15.1:6789/0 conn(0x7f5f900bdfb0 legacy=0x7f5f900c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.052+0000 7f5f8effd700 1 -- 172.21.15.1:0/2931978953 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193759152 0 0) 0x7f5f900ad5e0 con 0x7f5f900bdfb0 2023-11-15T01:22:12.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.052+0000 7f5f948e8700 1 -- 172.21.15.1:0/2931978953 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f900adba0 con 0x7f5f90154e70 2023-11-15T01:22:12.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.052+0000 7f5f948e8700 1 --2- 172.21.15.1:0/2931978953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f90154e70 0x7f5f90155270 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f5f88009e60 tx=0x7f5f88009780).ready entity=mon.0 client_cookie=95616d5809200835 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:12.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.052+0000 7f5f8effd700 1 -- 172.21.15.1:0/2931978953 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8800e070 con 0x7f5f90154e70 2023-11-15T01:22:12.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.052+0000 7f5f8effd700 1 -- 172.21.15.1:0/2931978953 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8800bc30 con 0x7f5f90154e70 2023-11-15T01:22:12.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.052+0000 7f5f8effd700 1 -- 172.21.15.1:0/2931978953 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88012410 con 0x7f5f90154e70 2023-11-15T01:22:12.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.052+0000 7f5f9634b700 1 -- 172.21.15.1:0/2931978953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f90154e70 msgr2=0x7f5f90155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.052+0000 7f5f9634b700 1 --2- 172.21.15.1:0/2931978953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f90154e70 0x7f5f90155270 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f5f88009e60 tx=0x7f5f88009780).stop 2023-11-15T01:22:12.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.052+0000 7f5f9634b700 1 -- 172.21.15.1:0/2931978953 shutdown_connections 2023-11-15T01:22:12.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.052+0000 7f5f9634b700 1 --2- 172.21.15.1:0/2931978953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f90154e70 0x7f5f90155270 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:12.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.052+0000 7f5f9634b700 1 -- 172.21.15.1:0/2931978953 >> 172.21.15.1:0/2931978953 conn(0x7f5f900c7d70 msgr2=0x7f5f900c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:12.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.052+0000 7f5f9634b700 1 -- 172.21.15.1:0/2931978953 shutdown_connections 2023-11-15T01:22:12.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.052+0000 7f5f9634b700 1 -- 172.21.15.1:0/2931978953 wait complete. 2023-11-15T01:22:12.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.054+0000 7f5f9634b700 1 Processor -- start 2023-11-15T01:22:12.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.054+0000 7f5f9634b700 1 -- start start 2023-11-15T01:22:12.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.054+0000 7f5f9634b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f900bdfb0 0x7f5f9014c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.054+0000 7f5f9634b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f900be390 0x7f5f9014c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.054+0000 7f5f9634b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f90154e70 0x7f5f900a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.054+0000 7f5f9634b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9014d150 con 0x7f5f900bdfb0 2023-11-15T01:22:12.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.054+0000 7f5f9634b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f90063210 con 0x7f5f900be390 2023-11-15T01:22:12.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.054+0000 7f5f9634b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900628e0 con 0x7f5f90154e70 2023-11-15T01:22:12.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.055+0000 7f5f8ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f900bdfb0 0x7f5f9014c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.055+0000 7f5f8ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f900bdfb0 0x7f5f9014c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43894/0 (socket says 172.21.15.1:43894) 2023-11-15T01:22:12.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.055+0000 7f5f8ffff700 1 -- 172.21.15.1:0/4020404380 learned_addr learned my addr 172.21.15.1:0/4020404380 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:12.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.055+0000 7f5f8ffff700 1 -- 172.21.15.1:0/4020404380 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f90154e70 msgr2=0x7f5f900a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.055+0000 7f5f8ffff700 1 --2- 172.21.15.1:0/4020404380 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f90154e70 0x7f5f900a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:12.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.055+0000 7f5f8ffff700 1 -- 172.21.15.1:0/4020404380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f900be390 msgr2=0x7f5f9014c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.055+0000 7f5f8ffff700 1 --2- 172.21.15.1:0/4020404380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f900be390 0x7f5f9014c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:12.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.055+0000 7f5f8ffff700 1 -- 172.21.15.1:0/4020404380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f88009a20 con 0x7f5f900bdfb0 2023-11-15T01:22:12.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.055+0000 7f5f8ffff700 1 --2- 172.21.15.1:0/4020404380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f900bdfb0 0x7f5f9014c900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f5f8000c4e0 tx=0x7f5f80007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:12.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.055+0000 7f5f87fff700 1 -- 172.21.15.1:0/4020404380 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f800072e0 con 0x7f5f900bdfb0 2023-11-15T01:22:12.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.055+0000 7f5f87fff700 1 -- 172.21.15.1:0/4020404380 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f80007440 con 0x7f5f900bdfb0 2023-11-15T01:22:12.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.055+0000 7f5f9634b700 1 -- 172.21.15.1:0/4020404380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f90062bc0 con 0x7f5f900bdfb0 2023-11-15T01:22:12.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.055+0000 7f5f87fff700 1 -- 172.21.15.1:0/4020404380 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f800057a0 con 0x7f5f900bdfb0 2023-11-15T01:22:12.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.055+0000 7f5f9634b700 1 -- 172.21.15.1:0/4020404380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9014cdf0 con 0x7f5f900bdfb0 2023-11-15T01:22:12.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.056+0000 7f5f9634b700 1 -- 172.21.15.1:0/4020404380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f900c7370 con 0x7f5f900bdfb0 2023-11-15T01:22:12.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.056+0000 7f5f87fff700 1 -- 172.21.15.1:0/4020404380 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5f80005bd0 con 0x7f5f900bdfb0 2023-11-15T01:22:12.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.057+0000 7f5f87fff700 1 --2- 172.21.15.1:0/4020404380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f7005f150 0x7f5f70061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.057+0000 7f5f87fff700 1 -- 172.21.15.1:0/4020404380 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5f80079b20 con 0x7f5f900bdfb0 2023-11-15T01:22:12.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.057+0000 7f5f8f7fe700 1 --2- 172.21.15.1:0/4020404380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f7005f150 0x7f5f70061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.057+0000 7f5f8f7fe700 1 --2- 172.21.15.1:0/4020404380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f7005f150 0x7f5f70061610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f5f900a7420 tx=0x7f5f780079a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:12.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.061+0000 7f5f87fff700 1 -- 172.21.15.1:0/4020404380 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5f8004adf0 con 0x7f5f900bdfb0 2023-11-15T01:22:12.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.233+0000 7f5f9634b700 1 -- 172.21.15.1:0/4020404380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f9006c7e0 con 0x7f5f900bdfb0 2023-11-15T01:22:12.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.234+0000 7f5f87fff700 1 -- 172.21.15.1:0/4020404380 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16880 (secure 0 0 0) 0x7f5f8004e410 con 0x7f5f900bdfb0 2023-11-15T01:22:12.236 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:12.236 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:21:38.047484+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:21:34.763591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-15T01:21:36.025071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:22:12.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.236+0000 7f5f9634b700 1 -- 172.21.15.1:0/4020404380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f7005f150 msgr2=0x7f5f70061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.236+0000 7f5f9634b700 1 --2- 172.21.15.1:0/4020404380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f7005f150 0x7f5f70061610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f5f900a7420 tx=0x7f5f780079a0).stop 2023-11-15T01:22:12.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.236+0000 7f5f9634b700 1 -- 172.21.15.1:0/4020404380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f900bdfb0 msgr2=0x7f5f9014c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.236+0000 7f5f9634b700 1 --2- 172.21.15.1:0/4020404380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f900bdfb0 0x7f5f9014c900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f5f8000c4e0 tx=0x7f5f80007c70).stop 2023-11-15T01:22:12.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.236+0000 7f5f9634b700 1 -- 172.21.15.1:0/4020404380 shutdown_connections 2023-11-15T01:22:12.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.236+0000 7f5f9634b700 1 --2- 172.21.15.1:0/4020404380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f7005f150 0x7f5f70061610 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:12.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.236+0000 7f5f9634b700 1 --2- 172.21.15.1:0/4020404380 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f90154e70 0x7f5f900a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:12.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.236+0000 7f5f9634b700 1 --2- 172.21.15.1:0/4020404380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f900bdfb0 0x7f5f9014c900 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:12.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.236+0000 7f5f9634b700 1 --2- 172.21.15.1:0/4020404380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f900be390 0x7f5f9014c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:12.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.236+0000 7f5f9634b700 1 -- 172.21.15.1:0/4020404380 >> 172.21.15.1:0/4020404380 conn(0x7f5f900c7d70 msgr2=0x7f5f90155250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:12.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.236+0000 7f5f9634b700 1 -- 172.21.15.1:0/4020404380 shutdown_connections 2023-11-15T01:22:12.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.236+0000 7f5f9634b700 1 -- 172.21.15.1:0/4020404380 wait complete. 2023-11-15T01:22:12.250 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-15T01:22:12.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.367+0000 7f6c78342700 1 Processor -- start 2023-11-15T01:22:12.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.367+0000 7f6c78342700 1 -- start start 2023-11-15T01:22:12.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.368+0000 7f6c78342700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6c70154250 0x7f6c70154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.368+0000 7f6c78342700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c70158ff0 con 0x7f6c700aa700 2023-11-15T01:22:12.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.368+0000 7f6c78342700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c70158100 con 0x7f6c700c6110 2023-11-15T01:22:12.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.368+0000 7f6c78342700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c701583e0 con 0x7f6c70154250 2023-11-15T01:22:12.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.368+0000 7f6c768df700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6c700aa700 0x7f6c700c9780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:33474/0 (socket says 172.21.15.1:33474) 2023-11-15T01:22:12.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.368+0000 7f6c768df700 1 -- 172.21.15.1:0/3882987503 learned_addr learned my addr 172.21.15.1:0/3882987503 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:12.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.369+0000 7f6c760de700 1 --2- 172.21.15.1:0/3882987503 >> v2:172.21.15.141:3300/0 conn(0x7f6c70154250 0x7f6c70154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.369+0000 7f6c750dc700 1 -- 172.21.15.1:0/3882987503 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680767202 0 0) 0x7f6c70158ff0 con 0x7f6c700aa700 2023-11-15T01:22:12.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.369+0000 7f6c750dc700 1 -- 172.21.15.1:0/3882987503 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c580033f0 con 0x7f6c700aa700 2023-11-15T01:22:12.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.369+0000 7f6c750dc700 1 -- 172.21.15.1:0/3882987503 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858390048 0 0) 0x7f6c70158100 con 0x7f6c700c6110 2023-11-15T01:22:12.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.369+0000 7f6c750dc700 1 -- 172.21.15.1:0/3882987503 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c70158ff0 con 0x7f6c700c6110 2023-11-15T01:22:12.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.369+0000 7f6c760de700 1 -- 172.21.15.1:0/3882987503 >> v1:172.21.15.141:6789/0 conn(0x7f6c700c6110 legacy=0x7f6c700a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.369+0000 7f6c750dc700 1 -- 172.21.15.1:0/3882987503 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1871217787 0 0) 0x7f6c580033f0 con 0x7f6c700aa700 2023-11-15T01:22:12.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.369+0000 7f6c760de700 1 -- 172.21.15.1:0/3882987503 >> v1:172.21.15.1:6789/0 conn(0x7f6c700aa700 legacy=0x7f6c700c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.369+0000 7f6c760de700 1 -- 172.21.15.1:0/3882987503 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c701586c0 con 0x7f6c70154250 2023-11-15T01:22:12.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.369+0000 7f6c760de700 1 --2- 172.21.15.1:0/3882987503 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6c70154250 0x7f6c70154630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6c68009760 tx=0x7f6c68009060).ready entity=mon.1 client_cookie=a98bb1ec7e702ef7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:12.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.369+0000 7f6c750dc700 1 -- 172.21.15.1:0/3882987503 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c600017f0 con 0x7f6c70154250 2023-11-15T01:22:12.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.369+0000 7f6c750dc700 1 -- 172.21.15.1:0/3882987503 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c68011400 con 0x7f6c70154250 2023-11-15T01:22:12.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.369+0000 7f6c750dc700 1 -- 172.21.15.1:0/3882987503 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68011780 con 0x7f6c70154250 2023-11-15T01:22:12.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.370+0000 7f6c78342700 1 -- 172.21.15.1:0/3882987503 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6c70154250 msgr2=0x7f6c70154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.370+0000 7f6c78342700 1 --2- 172.21.15.1:0/3882987503 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6c70154250 0x7f6c70154630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6c68009760 tx=0x7f6c68009060).stop 2023-11-15T01:22:12.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.370+0000 7f6c78342700 1 -- 172.21.15.1:0/3882987503 shutdown_connections 2023-11-15T01:22:12.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.370+0000 7f6c78342700 1 --2- 172.21.15.1:0/3882987503 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6c70154250 0x7f6c70154630 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:12.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.370+0000 7f6c78342700 1 -- 172.21.15.1:0/3882987503 >> 172.21.15.1:0/3882987503 conn(0x7f6c700c7b20 msgr2=0x7f6c700c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:12.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.370+0000 7f6c78342700 1 -- 172.21.15.1:0/3882987503 shutdown_connections 2023-11-15T01:22:12.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.370+0000 7f6c78342700 1 -- 172.21.15.1:0/3882987503 wait complete. 2023-11-15T01:22:12.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.371+0000 7f6c78342700 1 Processor -- start 2023-11-15T01:22:12.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.371+0000 7f6c78342700 1 -- start start 2023-11-15T01:22:12.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c78342700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c700aa700 0x7f6c700ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c78342700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c700c6110 0x7f6c70147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c78342700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6c70154250 0x7f6c70155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c78342700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700c33d0 con 0x7f6c700c6110 2023-11-15T01:22:12.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c78342700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700c3c70 con 0x7f6c70154250 2023-11-15T01:22:12.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c78342700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700ae500 con 0x7f6c700aa700 2023-11-15T01:22:12.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c758dd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c700c6110 0x7f6c70147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c758dd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c700c6110 0x7f6c70147de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43904/0 (socket says 172.21.15.1:43904) 2023-11-15T01:22:12.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c758dd700 1 -- 172.21.15.1:0/560882493 learned_addr learned my addr 172.21.15.1:0/560882493 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:12.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c768df700 1 --2- 172.21.15.1:0/560882493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6c70154250 0x7f6c70155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c760de700 1 --2- 172.21.15.1:0/560882493 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c700aa700 0x7f6c700ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c758dd700 1 -- 172.21.15.1:0/560882493 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c700aa700 msgr2=0x7f6c700ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c758dd700 1 --2- 172.21.15.1:0/560882493 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c700aa700 0x7f6c700ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:12.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c758dd700 1 -- 172.21.15.1:0/560882493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6c70154250 msgr2=0x7f6c70155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c758dd700 1 --2- 172.21.15.1:0/560882493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6c70154250 0x7f6c70155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:12.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c758dd700 1 -- 172.21.15.1:0/560882493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c680092a0 con 0x7f6c700c6110 2023-11-15T01:22:12.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.372+0000 7f6c758dd700 1 --2- 172.21.15.1:0/560882493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c700c6110 0x7f6c70147de0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f6c6400c4c0 tx=0x7f6c64007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:12.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.373+0000 7f6c6e7fc700 1 -- 172.21.15.1:0/560882493 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6400ce30 con 0x7f6c700c6110 2023-11-15T01:22:12.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.373+0000 7f6c6e7fc700 1 -- 172.21.15.1:0/560882493 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6400f470 con 0x7f6c700c6110 2023-11-15T01:22:12.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.373+0000 7f6c78342700 1 -- 172.21.15.1:0/560882493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c70156080 con 0x7f6c700c6110 2023-11-15T01:22:12.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.373+0000 7f6c6e7fc700 1 -- 172.21.15.1:0/560882493 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6400f810 con 0x7f6c700c6110 2023-11-15T01:22:12.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.373+0000 7f6c78342700 1 -- 172.21.15.1:0/560882493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c700c3900 con 0x7f6c700c6110 2023-11-15T01:22:12.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.374+0000 7f6c78342700 1 -- 172.21.15.1:0/560882493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7006c7e0 con 0x7f6c700c6110 2023-11-15T01:22:12.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.374+0000 7f6c6e7fc700 1 -- 172.21.15.1:0/560882493 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6c6400fbc0 con 0x7f6c700c6110 2023-11-15T01:22:12.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.374+0000 7f6c6e7fc700 1 --2- 172.21.15.1:0/560882493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c5c05f150 0x7f6c5c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.374+0000 7f6c6e7fc700 1 -- 172.21.15.1:0/560882493 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6c640796c0 con 0x7f6c700c6110 2023-11-15T01:22:12.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.375+0000 7f6c760de700 1 --2- 172.21.15.1:0/560882493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c5c05f150 0x7f6c5c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.375+0000 7f6c760de700 1 --2- 172.21.15.1:0/560882493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c5c05f150 0x7f6c5c061610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f6c68009270 tx=0x7f6c68016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:12.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.379+0000 7f6c6e7fc700 1 -- 172.21.15.1:0/560882493 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6c6404a990 con 0x7f6c700c6110 2023-11-15T01:22:12.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.595+0000 7f6c78342700 1 -- 172.21.15.1:0/560882493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6c700c9030 con 0x7f6c700c6110 2023-11-15T01:22:12.799 INFO:tasks.ceph.mon.a.smithi001.stderr:2023-11-15T01:22:12.798+0000 7f8072214700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-15T01:22:12.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.806+0000 7f6c6e7fc700 1 -- 172.21.15.1:0/560882493 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6c64077e60 con 0x7f6c700c6110 2023-11-15T01:22:12.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.808+0000 7f6c78342700 1 -- 172.21.15.1:0/560882493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c5c05f150 msgr2=0x7f6c5c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.808+0000 7f6c78342700 1 --2- 172.21.15.1:0/560882493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c5c05f150 0x7f6c5c061610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f6c68009270 tx=0x7f6c68016000).stop 2023-11-15T01:22:12.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.809+0000 7f6c78342700 1 -- 172.21.15.1:0/560882493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c700c6110 msgr2=0x7f6c70147de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.809+0000 7f6c78342700 1 --2- 172.21.15.1:0/560882493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c700c6110 0x7f6c70147de0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f6c6400c4c0 tx=0x7f6c64007c90).stop 2023-11-15T01:22:12.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.809+0000 7f6c78342700 1 -- 172.21.15.1:0/560882493 shutdown_connections 2023-11-15T01:22:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.809+0000 7f6c78342700 1 --2- 172.21.15.1:0/560882493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c5c05f150 0x7f6c5c061610 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.809+0000 7f6c78342700 1 --2- 172.21.15.1:0/560882493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6c70154250 0x7f6c70155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.809+0000 7f6c78342700 1 --2- 172.21.15.1:0/560882493 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6c700aa700 0x7f6c700ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.809+0000 7f6c78342700 1 --2- 172.21.15.1:0/560882493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c700c6110 0x7f6c70147de0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.809+0000 7f6c78342700 1 -- 172.21.15.1:0/560882493 >> 172.21.15.1:0/560882493 conn(0x7f6c700c7b20 msgr2=0x7f6c701594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.809+0000 7f6c78342700 1 -- 172.21.15.1:0/560882493 shutdown_connections 2023-11-15T01:22:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.809+0000 7f6c78342700 1 -- 172.21.15.1:0/560882493 wait complete. 2023-11-15T01:22:12.813 INFO:tasks.ceph.mds.c.smithi001.stderr: -1701> 2023-11-15T01:21:41.916+0000 7f3c98963700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T01:22:12.814 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-15T01:22:12.825 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-15T01:22:12.834 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-11-15T01:22:12.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.944+0000 7f05f7219700 1 Processor -- start 2023-11-15T01:22:12.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.944+0000 7f05f7219700 1 -- start start 2023-11-15T01:22:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.945+0000 7f05f7219700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05f01540a0 0x7f05f00ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.945+0000 7f05f7219700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f00ca050 con 0x7f05f00c6650 2023-11-15T01:22:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.945+0000 7f05f7219700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f00c9440 con 0x7f05f0154480 2023-11-15T01:22:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.945+0000 7f05f7219700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f00c9720 con 0x7f05f01540a0 2023-11-15T01:22:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.945+0000 7f05f57b6700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f05f00c6650 0x7f05f00aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:33476/0 (socket says 172.21.15.1:33476) 2023-11-15T01:22:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.945+0000 7f05f57b6700 1 -- 172.21.15.1:0/1853114514 learned_addr learned my addr 172.21.15.1:0/1853114514 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.945+0000 7f05f4fb5700 1 --2- 172.21.15.1:0/1853114514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05f01540a0 0x7f05f00ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.945+0000 7f05ef7fe700 1 -- 172.21.15.1:0/1853114514 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888532198 0 0) 0x7f05f00ca050 con 0x7f05f00c6650 2023-11-15T01:22:12.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.945+0000 7f05ef7fe700 1 -- 172.21.15.1:0/1853114514 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05dc0033f0 con 0x7f05f00c6650 2023-11-15T01:22:12.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05ef7fe700 1 -- 172.21.15.1:0/1853114514 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3832486450 0 0) 0x7f05dc0033f0 con 0x7f05f00c6650 2023-11-15T01:22:12.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05ef7fe700 1 -- 172.21.15.1:0/1853114514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05f01540a0 msgr2=0x7f05f00ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:12.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05ef7fe700 1 --2- 172.21.15.1:0/1853114514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05f01540a0 0x7f05f00ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:12.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05ef7fe700 1 -- 172.21.15.1:0/1853114514 >> v1:172.21.15.141:6789/0 conn(0x7f05f0154480 legacy=0x7f05f00c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05ef7fe700 1 -- 172.21.15.1:0/1853114514 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f00c9a00 con 0x7f05f00c6650 2023-11-15T01:22:12.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05ef7fe700 1 -- 172.21.15.1:0/1853114514 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f05d8001470 con 0x7f05f00c6650 2023-11-15T01:22:12.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05ef7fe700 1 -- 172.21.15.1:0/1853114514 >> v1:172.21.15.1:6789/0 conn(0x7f05f00c6650 legacy=0x7f05f00aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05ef7fe700 1 --2- 172.21.15.1:0/1853114514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05dc003910 0x7f05dc003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05ef7fe700 1 --2- 172.21.15.1:0/1853114514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05dc004690 0x7f05dc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05ef7fe700 1 --2- 172.21.15.1:0/1853114514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05f01540a0 0x7f05dc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05ef7fe700 1 -- 172.21.15.1:0/1853114514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f00c9720 con 0x7f05dc004690 2023-11-15T01:22:12.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05ef7fe700 1 -- 172.21.15.1:0/1853114514 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc00b8e0 con 0x7f05dc003910 2023-11-15T01:22:12.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05ef7fe700 1 -- 172.21.15.1:0/1853114514 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc00ba50 con 0x7f05f01540a0 2023-11-15T01:22:12.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05effff700 1 --2- 172.21.15.1:0/1853114514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05dc004690 0x7f05dc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05f4fb5700 1 --2- 172.21.15.1:0/1853114514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05dc003910 0x7f05dc003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05f57b6700 1 --2- 172.21.15.1:0/1853114514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05f01540a0 0x7f05dc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05effff700 1 -- 172.21.15.1:0/1853114514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05f01540a0 msgr2=0x7f05dc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:12.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05effff700 1 --2- 172.21.15.1:0/1853114514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05f01540a0 0x7f05dc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:12.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05effff700 1 -- 172.21.15.1:0/1853114514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05dc003910 msgr2=0x7f05dc003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:12.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05effff700 1 --2- 172.21.15.1:0/1853114514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05dc003910 0x7f05dc003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:12.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05effff700 1 -- 172.21.15.1:0/1853114514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc0033f0 con 0x7f05dc004690 2023-11-15T01:22:12.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.946+0000 7f05effff700 1 --2- 172.21.15.1:0/1853114514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05dc004690 0x7f05dc004b10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f05e00017f0 tx=0x7f05e0007b90).ready entity=mon.0 client_cookie=4f43465c56750424 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:12.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.947+0000 7f05ef7fe700 1 -- 172.21.15.1:0/1853114514 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0007ea0 con 0x7f05dc004690 2023-11-15T01:22:12.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.947+0000 7f05ef7fe700 1 -- 172.21.15.1:0/1853114514 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e0012400 con 0x7f05dc004690 2023-11-15T01:22:12.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.947+0000 7f05ef7fe700 1 -- 172.21.15.1:0/1853114514 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0012780 con 0x7f05dc004690 2023-11-15T01:22:12.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.947+0000 7f05f7219700 1 -- 172.21.15.1:0/1853114514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05dc004690 msgr2=0x7f05dc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.947+0000 7f05f7219700 1 --2- 172.21.15.1:0/1853114514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05dc004690 0x7f05dc004b10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f05e00017f0 tx=0x7f05e0007b90).stop 2023-11-15T01:22:12.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.947+0000 7f05f57b6700 1 -- 172.21.15.1:0/1853114514 reap_dead start 2023-11-15T01:22:12.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.947+0000 7f05f7219700 1 -- 172.21.15.1:0/1853114514 shutdown_connections 2023-11-15T01:22:12.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.947+0000 7f05f7219700 1 -- 172.21.15.1:0/1853114514 >> 172.21.15.1:0/1853114514 conn(0x7f05f0064a70 msgr2=0x7f05f0064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:12.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.947+0000 7f05f7219700 1 -- 172.21.15.1:0/1853114514 shutdown_connections 2023-11-15T01:22:12.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.947+0000 7f05f7219700 1 -- 172.21.15.1:0/1853114514 wait complete. 2023-11-15T01:22:12.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.948+0000 7f05f7219700 1 Processor -- start 2023-11-15T01:22:12.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.948+0000 7f05f7219700 1 -- start start 2023-11-15T01:22:12.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.949+0000 7f05f7219700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05dc004690 0x7f05f00638f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.949+0000 7f05f7219700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05f0063de0 0x7f05f00afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.949+0000 7f05f7219700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05f00b0160 0x7f05f013b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.949+0000 7f05f7219700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f00b05c0 con 0x7f05f00b0160 2023-11-15T01:22:12.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.949+0000 7f05f7219700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f0150750 con 0x7f05f0063de0 2023-11-15T01:22:12.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.949+0000 7f05f7219700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f00b1080 con 0x7f05dc004690 2023-11-15T01:22:12.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.949+0000 7f05f57b6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05f00b0160 0x7f05f013b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.949+0000 7f05f57b6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05f00b0160 0x7f05f013b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43942/0 (socket says 172.21.15.1:43942) 2023-11-15T01:22:12.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.949+0000 7f05f57b6700 1 -- 172.21.15.1:0/2321821914 learned_addr learned my addr 172.21.15.1:0/2321821914 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:12.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.949+0000 7f05f4fb5700 1 --2- 172.21.15.1:0/2321821914 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05dc004690 0x7f05f00638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.949+0000 7f05effff700 1 --2- 172.21.15.1:0/2321821914 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05f0063de0 0x7f05f00afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.950+0000 7f05f57b6700 1 -- 172.21.15.1:0/2321821914 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05dc004690 msgr2=0x7f05f00638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.950+0000 7f05f57b6700 1 --2- 172.21.15.1:0/2321821914 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05dc004690 0x7f05f00638f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:12.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.950+0000 7f05f57b6700 1 -- 172.21.15.1:0/2321821914 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05f0063de0 msgr2=0x7f05f00afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:12.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.950+0000 7f05f57b6700 1 --2- 172.21.15.1:0/2321821914 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05f0063de0 0x7f05f00afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:12.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.950+0000 7f05f57b6700 1 -- 172.21.15.1:0/2321821914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f00ae340 con 0x7f05f00b0160 2023-11-15T01:22:12.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.950+0000 7f05f57b6700 1 --2- 172.21.15.1:0/2321821914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05f00b0160 0x7f05f013b290 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f05f00aab60 tx=0x7f05d8001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:12.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.950+0000 7f05ecff9700 1 -- 172.21.15.1:0/2321821914 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d800f630 con 0x7f05f00b0160 2023-11-15T01:22:12.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.950+0000 7f05ecff9700 1 -- 172.21.15.1:0/2321821914 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d800f790 con 0x7f05f00b0160 2023-11-15T01:22:12.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.950+0000 7f05f7219700 1 -- 172.21.15.1:0/2321821914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f00b07e0 con 0x7f05f00b0160 2023-11-15T01:22:12.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.950+0000 7f05ecff9700 1 -- 172.21.15.1:0/2321821914 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d800fb30 con 0x7f05f00b0160 2023-11-15T01:22:12.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.950+0000 7f05f7219700 1 -- 172.21.15.1:0/2321821914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f00b0da0 con 0x7f05f00b0160 2023-11-15T01:22:12.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.951+0000 7f05f7219700 1 -- 172.21.15.1:0/2321821914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f0150900 con 0x7f05f00b0160 2023-11-15T01:22:12.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.951+0000 7f05ecff9700 1 -- 172.21.15.1:0/2321821914 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f05d8015410 con 0x7f05f00b0160 2023-11-15T01:22:12.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.952+0000 7f05ecff9700 1 --2- 172.21.15.1:0/2321821914 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05d005f150 0x7f05d0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:12.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.952+0000 7f05ecff9700 1 -- 172.21.15.1:0/2321821914 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f05d807a180 con 0x7f05f00b0160 2023-11-15T01:22:12.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.952+0000 7f05f4fb5700 1 --2- 172.21.15.1:0/2321821914 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05d005f150 0x7f05d0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:12.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.952+0000 7f05f4fb5700 1 --2- 172.21.15.1:0/2321821914 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05d005f150 0x7f05d0061610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f05e80094d0 tx=0x7f05e800b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:12.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:12.956+0000 7f05ecff9700 1 -- 172.21.15.1:0/2321821914 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f05f0150900 con 0x7f05f00b0160 2023-11-15T01:22:13.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.173+0000 7f05f7219700 1 -- 172.21.15.1:0/2321821914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f05f0150900 con 0x7f05f00b0160 2023-11-15T01:22:13.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.807+0000 7f05ecff9700 1 -- 172.21.15.1:0/2321821914 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f05f0150900 con 0x7f05f00b0160 2023-11-15T01:22:13.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.809+0000 7f05f7219700 1 -- 172.21.15.1:0/2321821914 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05d005f150 msgr2=0x7f05d0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:13.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.809+0000 7f05f7219700 1 --2- 172.21.15.1:0/2321821914 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05d005f150 0x7f05d0061610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f05e80094d0 tx=0x7f05e800b040).stop 2023-11-15T01:22:13.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.809+0000 7f05f7219700 1 -- 172.21.15.1:0/2321821914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05f00b0160 msgr2=0x7f05f013b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:13.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.809+0000 7f05f7219700 1 --2- 172.21.15.1:0/2321821914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05f00b0160 0x7f05f013b290 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f05f00aab60 tx=0x7f05d8001e70).stop 2023-11-15T01:22:13.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.809+0000 7f05f7219700 1 -- 172.21.15.1:0/2321821914 shutdown_connections 2023-11-15T01:22:13.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.809+0000 7f05f7219700 1 --2- 172.21.15.1:0/2321821914 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05d005f150 0x7f05d0061610 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:13.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.809+0000 7f05f7219700 1 --2- 172.21.15.1:0/2321821914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05f00b0160 0x7f05f013b290 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:13.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.809+0000 7f05f7219700 1 --2- 172.21.15.1:0/2321821914 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05dc004690 0x7f05f00638f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:13.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.809+0000 7f05f7219700 1 --2- 172.21.15.1:0/2321821914 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05f0063de0 0x7f05f00afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:13.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.809+0000 7f05f7219700 1 -- 172.21.15.1:0/2321821914 >> 172.21.15.1:0/2321821914 conn(0x7f05f0064a70 msgr2=0x7f05f00c0470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:13.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.809+0000 7f05f7219700 1 -- 172.21.15.1:0/2321821914 shutdown_connections 2023-11-15T01:22:13.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.810+0000 7f05f7219700 1 -- 172.21.15.1:0/2321821914 wait complete. 2023-11-15T01:22:13.825 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-15T01:22:13.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.990+0000 7fd1a2cfb700 1 Processor -- start 2023-11-15T01:22:13.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.990+0000 7fd1a2cfb700 1 -- start start 2023-11-15T01:22:13.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.991+0000 7fd1a2cfb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd19c0c3510 0x7fd19c0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:13.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.991+0000 7fd1a2cfb700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19c0c39a0 con 0x7fd19c064660 2023-11-15T01:22:13.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.991+0000 7fd1a2cfb700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19c0835c0 con 0x7fd19c0c53b0 2023-11-15T01:22:13.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.991+0000 7fd1a2cfb700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19c0c5790 con 0x7fd19c0c3510 2023-11-15T01:22:13.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.991+0000 7fd19bfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd19c0c3510 0x7fd19c0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:13.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.991+0000 7fd19bfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd19c0c3510 0x7fd19c0c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43944/0 (socket says 172.21.15.1:43944) 2023-11-15T01:22:13.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.991+0000 7fd19bfff700 1 -- 172.21.15.1:0/504761295 learned_addr learned my addr 172.21.15.1:0/504761295 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:13.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.992+0000 7fd19bfff700 1 -- 172.21.15.1:0/504761295 >> v1:172.21.15.141:6789/0 conn(0x7fd19c0c53b0 legacy=0x7fd19c0c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:13.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.992+0000 7fd19bfff700 1 -- 172.21.15.1:0/504761295 >> v1:172.21.15.1:6789/0 conn(0x7fd19c064660 legacy=0x7fd19c064ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:13.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.992+0000 7fd19bfff700 1 -- 172.21.15.1:0/504761295 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c0c6eb0 con 0x7fd19c0c3510 2023-11-15T01:22:13.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.992+0000 7fd19bfff700 1 --2- 172.21.15.1:0/504761295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd19c0c3510 0x7fd19c0c8660 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fd18c009f20 tx=0x7fd18c009840).ready entity=mon.0 client_cookie=507b8da97d3608a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:13.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.992+0000 7fd19b7fe700 1 -- 172.21.15.1:0/504761295 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00e070 con 0x7fd19c0c3510 2023-11-15T01:22:13.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.992+0000 7fd19b7fe700 1 -- 172.21.15.1:0/504761295 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c00bad0 con 0x7fd19c0c3510 2023-11-15T01:22:13.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.992+0000 7fd19b7fe700 1 -- 172.21.15.1:0/504761295 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00be50 con 0x7fd19c0c3510 2023-11-15T01:22:13.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.992+0000 7fd1a2cfb700 1 -- 172.21.15.1:0/504761295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd19c0c3510 msgr2=0x7fd19c0c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:13.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.992+0000 7fd1a2cfb700 1 --2- 172.21.15.1:0/504761295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd19c0c3510 0x7fd19c0c8660 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fd18c009f20 tx=0x7fd18c009840).stop 2023-11-15T01:22:13.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.992+0000 7fd1a2cfb700 1 -- 172.21.15.1:0/504761295 shutdown_connections 2023-11-15T01:22:13.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.992+0000 7fd1a2cfb700 1 --2- 172.21.15.1:0/504761295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd19c0c3510 0x7fd19c0c8660 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:13.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.992+0000 7fd1a2cfb700 1 -- 172.21.15.1:0/504761295 >> 172.21.15.1:0/504761295 conn(0x7fd19c082f90 msgr2=0x7fd19c0c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:13.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.992+0000 7fd1a2cfb700 1 -- 172.21.15.1:0/504761295 shutdown_connections 2023-11-15T01:22:13.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.992+0000 7fd1a2cfb700 1 -- 172.21.15.1:0/504761295 wait complete. 2023-11-15T01:22:14.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.994+0000 7fd1a2cfb700 1 Processor -- start 2023-11-15T01:22:14.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.994+0000 7fd1a2cfb700 1 -- start start 2023-11-15T01:22:14.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.994+0000 7fd1a2cfb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd19c064660 0x7fd19c165dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:14.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.994+0000 7fd1a2cfb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd19c0c53b0 0x7fd19c1676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:14.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.994+0000 7fd1a2cfb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd19c1662b0 0x7fd19c167ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:14.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.994+0000 7fd1a2cfb700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c165c30 con 0x7fd19c064660 2023-11-15T01:22:14.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.994+0000 7fd1a2cfb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0aa9a0 con 0x7fd19c1662b0 2023-11-15T01:22:14.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.994+0000 7fd1a2cfb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0aa070 con 0x7fd19c0c53b0 2023-11-15T01:22:14.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd1a0a97700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd19c064660 0x7fd19c165dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:14.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd1a0a97700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd19c064660 0x7fd19c165dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43948/0 (socket says 172.21.15.1:43948) 2023-11-15T01:22:14.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd1a0a97700 1 -- 172.21.15.1:0/251659384 learned_addr learned my addr 172.21.15.1:0/251659384 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:14.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd19bfff700 1 --2- 172.21.15.1:0/251659384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd19c0c53b0 0x7fd19c1676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:14.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd1a0a97700 1 -- 172.21.15.1:0/251659384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd19c0c53b0 msgr2=0x7fd19c1676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:14.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd1a0a97700 1 --2- 172.21.15.1:0/251659384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd19c0c53b0 0x7fd19c1676b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:14.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd1a1298700 1 --2- 172.21.15.1:0/251659384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd19c1662b0 0x7fd19c167ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:14.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd1a0a97700 1 -- 172.21.15.1:0/251659384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd19c1662b0 msgr2=0x7fd19c167ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:14.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd1a0a97700 1 --2- 172.21.15.1:0/251659384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd19c1662b0 0x7fd19c167ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:14.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd1a0a97700 1 -- 172.21.15.1:0/251659384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c009ae0 con 0x7fd19c064660 2023-11-15T01:22:14.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd1a0a97700 1 --2- 172.21.15.1:0/251659384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd19c064660 0x7fd19c165dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fd19400b490 tx=0x7fd194006f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:14.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd198ff9700 1 -- 172.21.15.1:0/251659384 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194012410 con 0x7fd19c064660 2023-11-15T01:22:14.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd198ff9700 1 -- 172.21.15.1:0/251659384 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1940125b0 con 0x7fd19c064660 2023-11-15T01:22:14.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd1a2cfb700 1 -- 172.21.15.1:0/251659384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19c0aa350 con 0x7fd19c064660 2023-11-15T01:22:14.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd198ff9700 1 -- 172.21.15.1:0/251659384 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194012970 con 0x7fd19c064660 2023-11-15T01:22:14.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.995+0000 7fd1a2cfb700 1 -- 172.21.15.1:0/251659384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19c0bffb0 con 0x7fd19c064660 2023-11-15T01:22:14.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.996+0000 7fd1a2cfb700 1 -- 172.21.15.1:0/251659384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19c06c7e0 con 0x7fd19c064660 2023-11-15T01:22:14.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.997+0000 7fd198ff9700 1 -- 172.21.15.1:0/251659384 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd194012d20 con 0x7fd19c064660 2023-11-15T01:22:14.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.997+0000 7fd198ff9700 1 --2- 172.21.15.1:0/251659384 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd17c05f150 0x7fd17c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:14.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.997+0000 7fd198ff9700 1 -- 172.21.15.1:0/251659384 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fd194079fb0 con 0x7fd19c064660 2023-11-15T01:22:14.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.997+0000 7fd19bfff700 1 --2- 172.21.15.1:0/251659384 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd17c05f150 0x7fd17c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:14.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:13.998+0000 7fd19bfff700 1 --2- 172.21.15.1:0/251659384 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd17c05f150 0x7fd17c061610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fd19c0c38f0 tx=0x7fd18c009840).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:14.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.001+0000 7fd198ff9700 1 -- 172.21.15.1:0/251659384 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd19404b230 con 0x7fd19c064660 2023-11-15T01:22:14.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.173+0000 7fd1a2cfb700 1 -- 172.21.15.1:0/251659384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd19c14fa30 con 0x7fd19c064660 2023-11-15T01:22:14.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.808+0000 7fd198ff9700 1 -- 172.21.15.1:0/251659384 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd19404e850 con 0x7fd19c064660 2023-11-15T01:22:14.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.811+0000 7fd1a2cfb700 1 -- 172.21.15.1:0/251659384 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd17c05f150 msgr2=0x7fd17c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:14.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.811+0000 7fd1a2cfb700 1 --2- 172.21.15.1:0/251659384 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd17c05f150 0x7fd17c061610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fd19c0c38f0 tx=0x7fd18c009840).stop 2023-11-15T01:22:14.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.811+0000 7fd1a2cfb700 1 -- 172.21.15.1:0/251659384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd19c064660 msgr2=0x7fd19c165dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:14.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.811+0000 7fd1a2cfb700 1 --2- 172.21.15.1:0/251659384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd19c064660 0x7fd19c165dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fd19400b490 tx=0x7fd194006f10).stop 2023-11-15T01:22:14.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.811+0000 7fd1a2cfb700 1 -- 172.21.15.1:0/251659384 shutdown_connections 2023-11-15T01:22:14.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.811+0000 7fd1a2cfb700 1 --2- 172.21.15.1:0/251659384 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd17c05f150 0x7fd17c061610 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:14.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.811+0000 7fd1a2cfb700 1 --2- 172.21.15.1:0/251659384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd19c1662b0 0x7fd19c167ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:14.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.811+0000 7fd1a2cfb700 1 --2- 172.21.15.1:0/251659384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd19c064660 0x7fd19c165dc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.811+0000 7fd1a2cfb700 1 --2- 172.21.15.1:0/251659384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd19c0c53b0 0x7fd19c1676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.811+0000 7fd1a2cfb700 1 -- 172.21.15.1:0/251659384 >> 172.21.15.1:0/251659384 conn(0x7fd19c082f90 msgr2=0x7fd19c0c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.812+0000 7fd1a2cfb700 1 -- 172.21.15.1:0/251659384 shutdown_connections 2023-11-15T01:22:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.812+0000 7fd1a2cfb700 1 -- 172.21.15.1:0/251659384 wait complete. 2023-11-15T01:22:14.816 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2023-11-15T01:22:14.827 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-15T01:22:14.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.951+0000 7f4d91a39700 1 Processor -- start 2023-11-15T01:22:14.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.951+0000 7f4d91a39700 1 -- start start 2023-11-15T01:22:14.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.952+0000 7f4d91a39700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d8c14b350 0x7f4d8c0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:14.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.952+0000 7f4d91a39700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c1580d0 con 0x7f4d8c0aa750 2023-11-15T01:22:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.952+0000 7f4d91a39700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c155000 con 0x7f4d8c14b730 2023-11-15T01:22:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.952+0000 7f4d91a39700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c1552e0 con 0x7f4d8c14b350 2023-11-15T01:22:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.952+0000 7f4d8b7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4d8c0aa750 0x7f4d8c158560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:33490/0 (socket says 172.21.15.1:33490) 2023-11-15T01:22:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d8b7fe700 1 -- 172.21.15.1:0/1050438394 learned_addr learned my addr 172.21.15.1:0/1050438394 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:14.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d8affd700 1 --2- 172.21.15.1:0/1050438394 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d8c14b350 0x7f4d8c0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:14.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d89ffb700 1 -- 172.21.15.1:0/1050438394 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026469022 0 0) 0x7f4d8c1580d0 con 0x7f4d8c0aa750 2023-11-15T01:22:14.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d89ffb700 1 -- 172.21.15.1:0/1050438394 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d780033f0 con 0x7f4d8c0aa750 2023-11-15T01:22:14.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d89ffb700 1 -- 172.21.15.1:0/1050438394 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2998711891 0 0) 0x7f4d780033f0 con 0x7f4d8c0aa750 2023-11-15T01:22:14.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d89ffb700 1 -- 172.21.15.1:0/1050438394 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d8c14b350 msgr2=0x7f4d8c0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:14.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d89ffb700 1 --2- 172.21.15.1:0/1050438394 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d8c14b350 0x7f4d8c0c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:14.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d89ffb700 1 -- 172.21.15.1:0/1050438394 >> v1:172.21.15.141:6789/0 conn(0x7f4d8c14b730 legacy=0x7f4d8c0aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:14.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d89ffb700 1 -- 172.21.15.1:0/1050438394 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c1555c0 con 0x7f4d8c0aa750 2023-11-15T01:22:14.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d89ffb700 1 -- 172.21.15.1:0/1050438394 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f4d7c001470 con 0x7f4d8c0aa750 2023-11-15T01:22:14.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d89ffb700 1 -- 172.21.15.1:0/1050438394 >> v1:172.21.15.1:6789/0 conn(0x7f4d8c0aa750 legacy=0x7f4d8c158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:14.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d89ffb700 1 --2- 172.21.15.1:0/1050438394 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d8c14b350 0x7f4d78003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:14.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d89ffb700 1 --2- 172.21.15.1:0/1050438394 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d78003e40 0x7f4d78004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:14.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d89ffb700 1 --2- 172.21.15.1:0/1050438394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d78004b80 0x7f4d78005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:14.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d89ffb700 1 -- 172.21.15.1:0/1050438394 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c1552e0 con 0x7f4d78004b80 2023-11-15T01:22:14.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d89ffb700 1 -- 172.21.15.1:0/1050438394 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7800b990 con 0x7f4d78003e40 2023-11-15T01:22:14.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d89ffb700 1 -- 172.21.15.1:0/1050438394 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7800bb50 con 0x7f4d8c14b350 2023-11-15T01:22:14.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d8b7fe700 1 --2- 172.21.15.1:0/1050438394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d78004b80 0x7f4d78005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:14.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d8affd700 1 --2- 172.21.15.1:0/1050438394 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d8c14b350 0x7f4d78003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:14.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.953+0000 7f4d8a7fc700 1 --2- 172.21.15.1:0/1050438394 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d78003e40 0x7f4d78004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:14.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d8b7fe700 1 -- 172.21.15.1:0/1050438394 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d8c14b350 msgr2=0x7f4d78003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:14.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d8b7fe700 1 --2- 172.21.15.1:0/1050438394 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d8c14b350 0x7f4d78003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:14.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d8b7fe700 1 -- 172.21.15.1:0/1050438394 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d78003e40 msgr2=0x7f4d78004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:14.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d8b7fe700 1 --2- 172.21.15.1:0/1050438394 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d78003e40 0x7f4d78004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:14.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d8b7fe700 1 -- 172.21.15.1:0/1050438394 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d780033f0 con 0x7f4d78004b80 2023-11-15T01:22:14.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d8affd700 1 --2- 172.21.15.1:0/1050438394 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d8c14b350 0x7f4d78003910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:14.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d8b7fe700 1 --2- 172.21.15.1:0/1050438394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d78004b80 0x7f4d78005000 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f4d8c0c56b0 tx=0x7f4d7c001e50).ready entity=mon.0 client_cookie=5df17658375ce60b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:14.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d89ffb700 1 -- 172.21.15.1:0/1050438394 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c015a90 con 0x7f4d78004b80 2023-11-15T01:22:14.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d89ffb700 1 -- 172.21.15.1:0/1050438394 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c015bf0 con 0x7f4d78004b80 2023-11-15T01:22:14.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d89ffb700 1 -- 172.21.15.1:0/1050438394 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00c8c0 con 0x7f4d78004b80 2023-11-15T01:22:14.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d91a39700 1 -- 172.21.15.1:0/1050438394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d78004b80 msgr2=0x7f4d78005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:14.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d91a39700 1 --2- 172.21.15.1:0/1050438394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d78004b80 0x7f4d78005000 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f4d8c0c56b0 tx=0x7f4d7c001e50).stop 2023-11-15T01:22:14.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d8b7fe700 1 -- 172.21.15.1:0/1050438394 reap_dead start 2023-11-15T01:22:14.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d91a39700 1 -- 172.21.15.1:0/1050438394 shutdown_connections 2023-11-15T01:22:14.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d91a39700 1 -- 172.21.15.1:0/1050438394 >> 172.21.15.1:0/1050438394 conn(0x7f4d8c069ee0 msgr2=0x7f4d8c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:14.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d91a39700 1 -- 172.21.15.1:0/1050438394 shutdown_connections 2023-11-15T01:22:14.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.954+0000 7f4d91a39700 1 -- 172.21.15.1:0/1050438394 wait complete. 2023-11-15T01:22:14.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.956+0000 7f4d91a39700 1 Processor -- start 2023-11-15T01:22:14.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.956+0000 7f4d91a39700 1 -- start start 2023-11-15T01:22:14.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.956+0000 7f4d91a39700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d78004b80 0x7f4d8c1442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:14.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d91a39700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d8c0c21a0 0x7f4d8c0c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:14.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d91a39700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d8c0c3450 0x7f4d8c0c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:14.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d91a39700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0c3220 con 0x7f4d8c0c3450 2023-11-15T01:22:14.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d91a39700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0ab860 con 0x7f4d8c0c21a0 2023-11-15T01:22:14.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d91a39700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0c3dc0 con 0x7f4d78004b80 2023-11-15T01:22:14.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d8b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d8c0c3450 0x7f4d8c0c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:14.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d8b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d8c0c3450 0x7f4d8c0c38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43964/0 (socket says 172.21.15.1:43964) 2023-11-15T01:22:14.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d8b7fe700 1 -- 172.21.15.1:0/1243864554 learned_addr learned my addr 172.21.15.1:0/1243864554 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:14.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d8a7fc700 1 --2- 172.21.15.1:0/1243864554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d8c0c21a0 0x7f4d8c0c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:14.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d8affd700 1 --2- 172.21.15.1:0/1243864554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d78004b80 0x7f4d8c1442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:14.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d8b7fe700 1 -- 172.21.15.1:0/1243864554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d78004b80 msgr2=0x7f4d8c1442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:14.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d8b7fe700 1 --2- 172.21.15.1:0/1243864554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d78004b80 0x7f4d8c1442e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:14.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d8b7fe700 1 -- 172.21.15.1:0/1243864554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d8c0c21a0 msgr2=0x7f4d8c0c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:14.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d8b7fe700 1 --2- 172.21.15.1:0/1243864554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d8c0c21a0 0x7f4d8c0c2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:14.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d8b7fe700 1 -- 172.21.15.1:0/1243864554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c156790 con 0x7f4d8c0c3450 2023-11-15T01:22:14.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d8affd700 1 --2- 172.21.15.1:0/1243864554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d78004b80 0x7f4d8c1442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:14.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d8b7fe700 1 --2- 172.21.15.1:0/1243864554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d8c0c3450 0x7f4d8c0c38d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f4d78005650 tx=0x7f4d7c01b000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:14.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d82ffd700 1 -- 172.21.15.1:0/1243864554 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c025070 con 0x7f4d8c0c3450 2023-11-15T01:22:14.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d82ffd700 1 -- 172.21.15.1:0/1243864554 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c000ea0 con 0x7f4d8c0c3450 2023-11-15T01:22:14.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d91a39700 1 -- 172.21.15.1:0/1243864554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8c0c2c60 con 0x7f4d8c0c3450 2023-11-15T01:22:14.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d82ffd700 1 -- 172.21.15.1:0/1243864554 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c007340 con 0x7f4d8c0c3450 2023-11-15T01:22:14.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.957+0000 7f4d91a39700 1 -- 172.21.15.1:0/1243864554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8c0ab4f0 con 0x7f4d8c0c3450 2023-11-15T01:22:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.958+0000 7f4d91a39700 1 -- 172.21.15.1:0/1243864554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8c0ab9f0 con 0x7f4d8c0c3450 2023-11-15T01:22:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.959+0000 7f4d82ffd700 1 -- 172.21.15.1:0/1243864554 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4d7c0046b0 con 0x7f4d8c0c3450 2023-11-15T01:22:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.959+0000 7f4d82ffd700 1 --2- 172.21.15.1:0/1243864554 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4d6c05f150 0x7f4d6c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.959+0000 7f4d82ffd700 1 -- 172.21.15.1:0/1243864554 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5769+0+0 (secure 0 0 0) 0x7f4d7c082ee0 con 0x7f4d8c0c3450 2023-11-15T01:22:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.959+0000 7f4d8affd700 1 --2- 172.21.15.1:0/1243864554 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4d6c05f150 0x7f4d6c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.960+0000 7f4d8affd700 1 --2- 172.21.15.1:0/1243864554 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4d6c05f150 0x7f4d6c061610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f4d84009fd0 tx=0x7f4d8400b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:14.987 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:22:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:14.963+0000 7f4d82ffd700 1 -- 172.21.15.1:0/1243864554 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4d7c054310 con 0x7f4d8c0c3450 2023-11-15T01:22:14.990 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:22:15.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:15.148+0000 7f4d91a39700 1 -- 172.21.15.1:0/1243864554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4d8c06c7e0 con 0x7f4d8c0c3450 2023-11-15T01:22:15.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:15.817+0000 7f4d82ffd700 1 -- 172.21.15.1:0/1243864554 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4d8c06c7e0 con 0x7f4d8c0c3450 2023-11-15T01:22:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:15.820+0000 7f4d91a39700 1 -- 172.21.15.1:0/1243864554 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4d6c05f150 msgr2=0x7f4d6c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:15.821+0000 7f4d91a39700 1 --2- 172.21.15.1:0/1243864554 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4d6c05f150 0x7f4d6c061610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f4d84009fd0 tx=0x7f4d8400b040).stop 2023-11-15T01:22:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:15.821+0000 7f4d91a39700 1 -- 172.21.15.1:0/1243864554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d8c0c3450 msgr2=0x7f4d8c0c38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:15.821+0000 7f4d91a39700 1 --2- 172.21.15.1:0/1243864554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d8c0c3450 0x7f4d8c0c38d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f4d78005650 tx=0x7f4d7c01b000).stop 2023-11-15T01:22:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:15.821+0000 7f4d91a39700 1 -- 172.21.15.1:0/1243864554 shutdown_connections 2023-11-15T01:22:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:15.821+0000 7f4d91a39700 1 --2- 172.21.15.1:0/1243864554 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4d6c05f150 0x7f4d6c061610 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:15.821+0000 7f4d91a39700 1 --2- 172.21.15.1:0/1243864554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d8c0c3450 0x7f4d8c0c38d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:15.821+0000 7f4d91a39700 1 --2- 172.21.15.1:0/1243864554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d78004b80 0x7f4d8c1442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:15.821+0000 7f4d91a39700 1 --2- 172.21.15.1:0/1243864554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d8c0c21a0 0x7f4d8c0c2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:15.821+0000 7f4d91a39700 1 -- 172.21.15.1:0/1243864554 >> 172.21.15.1:0/1243864554 conn(0x7f4d8c069ee0 msgr2=0x7f4d8c148170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:15.821+0000 7f4d91a39700 1 -- 172.21.15.1:0/1243864554 shutdown_connections 2023-11-15T01:22:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:15.821+0000 7f4d91a39700 1 -- 172.21.15.1:0/1243864554 wait complete. 2023-11-15T01:22:15.830 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2023-11-15T01:22:15.843 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-15T01:22:15.843 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-15T01:22:15.843 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-15T01:22:15.844 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:22:15.845 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-15T01:22:15.845 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-15T01:22:15.846 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-15T01:22:15.846 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:22:15.846 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-15T01:22:15.846 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-15T01:22:15.847 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-15T01:22:15.847 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:22:15.847 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-15T01:22:15.848 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-15T01:22:15.848 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-15T01:22:15.848 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:22:15.853 INFO:tasks.ceph.mds.a:Stopped 2023-11-15T01:22:15.854 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-15T01:22:15.855 INFO:tasks.ceph.mds.c:Stopped 2023-11-15T01:22:15.856 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-15T01:22:15.857 INFO:tasks.ceph.mds.b:Stopped 2023-11-15T01:22:15.857 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-15T01:22:15.858 INFO:tasks.ceph.mds.d:Stopped 2023-11-15T01:22:15.859 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-15T01:22:15.897 INFO:tasks.ceph.mds.a:Started 2023-11-15T01:22:15.898 DEBUG:teuthology.parallel:result is None 2023-11-15T01:22:15.898 INFO:tasks.ceph.mds.c:Started 2023-11-15T01:22:15.899 DEBUG:teuthology.parallel:result is None 2023-11-15T01:22:15.900 INFO:tasks.ceph.mds.b:Started 2023-11-15T01:22:15.901 DEBUG:teuthology.parallel:result is None 2023-11-15T01:22:15.902 INFO:tasks.ceph.mds.d:Started 2023-11-15T01:22:15.902 DEBUG:teuthology.parallel:result is None 2023-11-15T01:22:15.903 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-15T01:22:15.978 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T01:22:15.979 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-11-15T01:22:15.979 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-15T01:22:15.980 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T01:22:16.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.038+0000 7f81c7453700 1 Processor -- start 2023-11-15T01:22:16.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.038+0000 7f81c7453700 1 -- start start 2023-11-15T01:22:16.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.039+0000 7f81c7453700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c01518f0 0x7f81c00c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:16.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.039+0000 7f81c7453700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c00bce80 con 0x7f81c0065d60 2023-11-15T01:22:16.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.039+0000 7f81c7453700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c0151e80 con 0x7f81c00c2a70 2023-11-15T01:22:16.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.039+0000 7f81c7453700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00695a0 con 0x7f81c01518f0 2023-11-15T01:22:16.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.039+0000 7f81c49ee700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f81c0065d60 0x7f81c0069b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:33510/0 (socket says 172.21.15.1:33510) 2023-11-15T01:22:16.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.040+0000 7f81c49ee700 1 -- 172.21.15.1:0/20010197 learned_addr learned my addr 172.21.15.1:0/20010197 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:16.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.040+0000 7f81c59f0700 1 --2- 172.21.15.1:0/20010197 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c01518f0 0x7f81c00c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:16.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.040+0000 7f81b7fff700 1 -- 172.21.15.1:0/20010197 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831891665 0 0) 0x7f81c00bce80 con 0x7f81c0065d60 2023-11-15T01:22:16.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.040+0000 7f81b7fff700 1 -- 172.21.15.1:0/20010197 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81ac0033f0 con 0x7f81c0065d60 2023-11-15T01:22:16.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.040+0000 7f81b7fff700 1 -- 172.21.15.1:0/20010197 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81775115 0 0) 0x7f81c0151e80 con 0x7f81c00c2a70 2023-11-15T01:22:16.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.040+0000 7f81b7fff700 1 -- 172.21.15.1:0/20010197 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c00bce80 con 0x7f81c00c2a70 2023-11-15T01:22:16.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.040+0000 7f81c59f0700 1 -- 172.21.15.1:0/20010197 >> v1:172.21.15.141:6789/0 conn(0x7f81c00c2a70 legacy=0x7f81c0065650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:16.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.040+0000 7f81c59f0700 1 -- 172.21.15.1:0/20010197 >> v1:172.21.15.1:6789/0 conn(0x7f81c0065d60 legacy=0x7f81c0069b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:16.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.040+0000 7f81c59f0700 1 -- 172.21.15.1:0/20010197 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c0152160 con 0x7f81c01518f0 2023-11-15T01:22:16.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.040+0000 7f81c59f0700 1 --2- 172.21.15.1:0/20010197 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c01518f0 0x7f81c00c2e50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f81b8009e90 tx=0x7f81b8009780).ready entity=mon.2 client_cookie=21d5a0af18faa597 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:16.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.040+0000 7f81b7fff700 1 -- 172.21.15.1:0/20010197 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b800e070 con 0x7f81c01518f0 2023-11-15T01:22:16.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.040+0000 7f81b7fff700 1 -- 172.21.15.1:0/20010197 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b800bab0 con 0x7f81c01518f0 2023-11-15T01:22:16.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.040+0000 7f81b7fff700 1 -- 172.21.15.1:0/20010197 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b800be30 con 0x7f81c01518f0 2023-11-15T01:22:16.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.041+0000 7f81c7453700 1 -- 172.21.15.1:0/20010197 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c01518f0 msgr2=0x7f81c00c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:16.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.041+0000 7f81c7453700 1 --2- 172.21.15.1:0/20010197 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c01518f0 0x7f81c00c2e50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f81b8009e90 tx=0x7f81b8009780).stop 2023-11-15T01:22:16.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.041+0000 7f81c7453700 1 -- 172.21.15.1:0/20010197 shutdown_connections 2023-11-15T01:22:16.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.041+0000 7f81c7453700 1 --2- 172.21.15.1:0/20010197 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c01518f0 0x7f81c00c2e50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:16.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.041+0000 7f81c7453700 1 -- 172.21.15.1:0/20010197 >> 172.21.15.1:0/20010197 conn(0x7f81c00627b0 msgr2=0x7f81c0062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:16.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.041+0000 7f81c7453700 1 -- 172.21.15.1:0/20010197 shutdown_connections 2023-11-15T01:22:16.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.041+0000 7f81c7453700 1 -- 172.21.15.1:0/20010197 wait complete. 2023-11-15T01:22:16.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.042+0000 7f81c7453700 1 Processor -- start 2023-11-15T01:22:16.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.042+0000 7f81c7453700 1 -- start start 2023-11-15T01:22:16.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c7453700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81c0065d60 0x7f81c01368d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:16.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c7453700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c00c2a70 0x7f81c00bff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:16.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c7453700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c01518f0 0x7f81c00c0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:16.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c7453700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00c08f0 con 0x7f81c00c2a70 2023-11-15T01:22:16.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c7453700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c014db60 con 0x7f81c0065d60 2023-11-15T01:22:16.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c7453700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00aad40 con 0x7f81c01518f0 2023-11-15T01:22:16.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c49ee700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c00c2a70 0x7f81c00bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:16.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c49ee700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c00c2a70 0x7f81c00bff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43992/0 (socket says 172.21.15.1:43992) 2023-11-15T01:22:16.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c49ee700 1 -- 172.21.15.1:0/3676335432 learned_addr learned my addr 172.21.15.1:0/3676335432 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:16.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c51ef700 1 --2- 172.21.15.1:0/3676335432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81c0065d60 0x7f81c01368d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:16.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c59f0700 1 --2- 172.21.15.1:0/3676335432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c01518f0 0x7f81c00c0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:16.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c49ee700 1 -- 172.21.15.1:0/3676335432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c01518f0 msgr2=0x7f81c00c0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:16.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c49ee700 1 --2- 172.21.15.1:0/3676335432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c01518f0 0x7f81c00c0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:16.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c49ee700 1 -- 172.21.15.1:0/3676335432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81c0065d60 msgr2=0x7f81c01368d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:16.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c49ee700 1 --2- 172.21.15.1:0/3676335432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81c0065d60 0x7f81c01368d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.043+0000 7f81c49ee700 1 -- 172.21.15.1:0/3676335432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b8009a20 con 0x7f81c00c2a70 2023-11-15T01:22:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.044+0000 7f81c49ee700 1 --2- 172.21.15.1:0/3676335432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c00c2a70 0x7f81c00bff10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f81b000c490 tx=0x7f81b0007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.044+0000 7f81b57fa700 1 -- 172.21.15.1:0/3676335432 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b000ce40 con 0x7f81c00c2a70 2023-11-15T01:22:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.044+0000 7f81b57fa700 1 -- 172.21.15.1:0/3676335432 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b00072e0 con 0x7f81c00c2a70 2023-11-15T01:22:16.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.044+0000 7f81c7453700 1 -- 172.21.15.1:0/3676335432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c00ab020 con 0x7f81c00c2a70 2023-11-15T01:22:16.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.044+0000 7f81b57fa700 1 -- 172.21.15.1:0/3676335432 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0007660 con 0x7f81c00c2a70 2023-11-15T01:22:16.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.044+0000 7f81c7453700 1 -- 172.21.15.1:0/3676335432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c00ab5e0 con 0x7f81c00c2a70 2023-11-15T01:22:16.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.045+0000 7f81c7453700 1 -- 172.21.15.1:0/3676335432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c00ab770 con 0x7f81c00c2a70 2023-11-15T01:22:16.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.046+0000 7f81b57fa700 1 -- 172.21.15.1:0/3676335432 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f81b00059b0 con 0x7f81c00c2a70 2023-11-15T01:22:16.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.046+0000 7f81b57fa700 1 --2- 172.21.15.1:0/3676335432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f81a405f150 0x7f81a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:16.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.046+0000 7f81b57fa700 1 -- 172.21.15.1:0/3676335432 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f81b00796f0 con 0x7f81c00c2a70 2023-11-15T01:22:16.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.046+0000 7f81c51ef700 1 --2- 172.21.15.1:0/3676335432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f81a405f150 0x7f81a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:16.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.047+0000 7f81c51ef700 1 --2- 172.21.15.1:0/3676335432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f81a405f150 0x7f81a4061610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f81c014b230 tx=0x7f81bc007bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:16.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.050+0000 7f81b57fa700 1 -- 172.21.15.1:0/3676335432 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f81b004acc0 con 0x7f81c00c2a70 2023-11-15T01:22:16.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:16.241+0000 7f81c7453700 1 -- 172.21.15.1:0/3676335432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f81c006c7e0 con 0x7f81c00c2a70 2023-11-15T01:22:17.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.023+0000 7f81b57fa700 1 -- 172.21.15.1:0/3676335432 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f81b0018070 con 0x7f81c00c2a70 2023-11-15T01:22:17.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.025+0000 7f81c7453700 1 -- 172.21.15.1:0/3676335432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f81a405f150 msgr2=0x7f81a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.025+0000 7f81c7453700 1 --2- 172.21.15.1:0/3676335432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f81a405f150 0x7f81a4061610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f81c014b230 tx=0x7f81bc007bc0).stop 2023-11-15T01:22:17.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.025+0000 7f81c7453700 1 -- 172.21.15.1:0/3676335432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c00c2a70 msgr2=0x7f81c00bff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.025+0000 7f81c7453700 1 --2- 172.21.15.1:0/3676335432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c00c2a70 0x7f81c00bff10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f81b000c490 tx=0x7f81b0007ca0).stop 2023-11-15T01:22:17.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.026+0000 7f81c7453700 1 -- 172.21.15.1:0/3676335432 shutdown_connections 2023-11-15T01:22:17.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.026+0000 7f81c7453700 1 --2- 172.21.15.1:0/3676335432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f81a405f150 0x7f81a4061610 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.026+0000 7f81c7453700 1 --2- 172.21.15.1:0/3676335432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c01518f0 0x7f81c00c0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.026+0000 7f81c7453700 1 --2- 172.21.15.1:0/3676335432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81c0065d60 0x7f81c01368d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.026+0000 7f81c7453700 1 --2- 172.21.15.1:0/3676335432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c00c2a70 0x7f81c00bff10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.026+0000 7f81c7453700 1 -- 172.21.15.1:0/3676335432 >> 172.21.15.1:0/3676335432 conn(0x7f81c00627b0 msgr2=0x7f81c00c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:17.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.026+0000 7f81c7453700 1 -- 172.21.15.1:0/3676335432 shutdown_connections 2023-11-15T01:22:17.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.026+0000 7f81c7453700 1 -- 172.21.15.1:0/3676335432 wait complete. 2023-11-15T01:22:17.030 INFO:teuthology.orchestra.run.smithi001.stderr: removed all blocklist entries 2023-11-15T01:22:17.042 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-15T01:22:17.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.167+0000 7f13598d4700 1 Processor -- start 2023-11-15T01:22:17.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.167+0000 7f13598d4700 1 -- start start 2023-11-15T01:22:17.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.168+0000 7f13598d4700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1354155530 0x7f13540c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.168+0000 7f13598d4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13540c98b0 0x7f13540c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.168+0000 7f13598d4700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13540c7980 con 0x7f1354151e10 2023-11-15T01:22:17.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.168+0000 7f13598d4700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13540aa890 con 0x7f13540c98b0 2023-11-15T01:22:17.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.168+0000 7f13598d4700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13540c7bd0 con 0x7f1354155530 2023-11-15T01:22:17.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.168+0000 7f13590d3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13540c98b0 0x7f13540c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.168+0000 7f13590d3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13540c98b0 0x7f13540c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43994/0 (socket says 172.21.15.1:43994) 2023-11-15T01:22:17.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.168+0000 7f13590d3700 1 -- 172.21.15.1:0/3944878184 learned_addr learned my addr 172.21.15.1:0/3944878184 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:17.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.168+0000 7f1353fff700 1 --2- 172.21.15.1:0/3944878184 >> v2:172.21.15.141:3300/0 conn(0x7f1354155530 0x7f13540c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.168+0000 7f13590d3700 1 -- 172.21.15.1:0/3944878184 >> v2:172.21.15.141:3300/0 conn(0x7f1354155530 msgr2=0x7f13540c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:17.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.168+0000 7f13590d3700 1 --2- 172.21.15.1:0/3944878184 >> v2:172.21.15.141:3300/0 conn(0x7f1354155530 0x7f13540c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.168+0000 7f13590d3700 1 -- 172.21.15.1:0/3944878184 >> v1:172.21.15.141:6789/0 conn(0x7f1354151e10 legacy=0x7f13540aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:17.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.168+0000 7f13590d3700 1 -- 172.21.15.1:0/3944878184 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13540c7eb0 con 0x7f13540c98b0 2023-11-15T01:22:17.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.168+0000 7f1353fff700 1 --2- 172.21.15.1:0/3944878184 >> v2:172.21.15.141:3300/0 conn(0x7f1354155530 0x7f13540c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:17.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.169+0000 7f13590d3700 1 --2- 172.21.15.1:0/3944878184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13540c98b0 0x7f13540c9cc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f1354157e90 tx=0x7f133c0090f0).ready entity=mon.0 client_cookie=13a39d66e6d78a92 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:17.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.169+0000 7f13537fe700 1 -- 172.21.15.1:0/3944878184 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c00b5a0 con 0x7f13540c98b0 2023-11-15T01:22:17.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.169+0000 7f13537fe700 1 -- 172.21.15.1:0/3944878184 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c00b700 con 0x7f13540c98b0 2023-11-15T01:22:17.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.169+0000 7f13537fe700 1 -- 172.21.15.1:0/3944878184 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c00ba80 con 0x7f13540c98b0 2023-11-15T01:22:17.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.169+0000 7f13598d4700 1 -- 172.21.15.1:0/3944878184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13540c98b0 msgr2=0x7f13540c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.169+0000 7f13598d4700 1 --2- 172.21.15.1:0/3944878184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13540c98b0 0x7f13540c9cc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f1354157e90 tx=0x7f133c0090f0).stop 2023-11-15T01:22:17.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.169+0000 7f13598d4700 1 -- 172.21.15.1:0/3944878184 shutdown_connections 2023-11-15T01:22:17.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.169+0000 7f13598d4700 1 --2- 172.21.15.1:0/3944878184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13540c98b0 0x7f13540c9cc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.169+0000 7f13598d4700 1 --2- 172.21.15.1:0/3944878184 >> v2:172.21.15.141:3300/0 conn(0x7f1354155530 0x7f13540c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.169+0000 7f13598d4700 1 -- 172.21.15.1:0/3944878184 >> 172.21.15.1:0/3944878184 conn(0x7f13540947e0 msgr2=0x7f135406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:17.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.169+0000 7f13598d4700 1 -- 172.21.15.1:0/3944878184 shutdown_connections 2023-11-15T01:22:17.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.169+0000 7f13598d4700 1 -- 172.21.15.1:0/3944878184 wait complete. 2023-11-15T01:22:17.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.170+0000 7f13598d4700 1 Processor -- start 2023-11-15T01:22:17.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.171+0000 7f13598d4700 1 -- start start 2023-11-15T01:22:17.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.171+0000 7f13598d4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13540c98b0 0x7f13540a92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.171+0000 7f13598d4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1354151e10 0x7f13541674b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.171+0000 7f13598d4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1354155530 0x7f13541679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.171+0000 7f13598d4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1354167e90 con 0x7f1354151e10 2023-11-15T01:22:17.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.171+0000 7f13598d4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13540a8240 con 0x7f1354155530 2023-11-15T01:22:17.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.171+0000 7f13598d4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13540a8520 con 0x7f13540c98b0 2023-11-15T01:22:17.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f1353fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1354151e10 0x7f13541674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f1353fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1354151e10 0x7f13541674b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44010/0 (socket says 172.21.15.1:44010) 2023-11-15T01:22:17.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f1353fff700 1 -- 172.21.15.1:0/4240553520 learned_addr learned my addr 172.21.15.1:0/4240553520 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:17.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f13590d3700 1 --2- 172.21.15.1:0/4240553520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1354155530 0x7f13541679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f13588d2700 1 --2- 172.21.15.1:0/4240553520 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13540c98b0 0x7f13540a92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f1353fff700 1 -- 172.21.15.1:0/4240553520 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13540c98b0 msgr2=0x7f13540a92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f1353fff700 1 --2- 172.21.15.1:0/4240553520 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13540c98b0 0x7f13540a92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f1353fff700 1 -- 172.21.15.1:0/4240553520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1354155530 msgr2=0x7f13541679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f1353fff700 1 --2- 172.21.15.1:0/4240553520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1354155530 0x7f13541679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f1353fff700 1 -- 172.21.15.1:0/4240553520 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c009370 con 0x7f1354151e10 2023-11-15T01:22:17.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f13588d2700 1 --2- 172.21.15.1:0/4240553520 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13540c98b0 0x7f13540a92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:17.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f1353fff700 1 --2- 172.21.15.1:0/4240553520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1354151e10 0x7f13541674b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f134400c880 tx=0x7f1344008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:17.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f1350ff9700 1 -- 172.21.15.1:0/4240553520 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344010580 con 0x7f1354151e10 2023-11-15T01:22:17.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f1350ff9700 1 -- 172.21.15.1:0/4240553520 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13440106e0 con 0x7f1354151e10 2023-11-15T01:22:17.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f13598d4700 1 -- 172.21.15.1:0/4240553520 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13540a8800 con 0x7f1354151e10 2023-11-15T01:22:17.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f1350ff9700 1 -- 172.21.15.1:0/4240553520 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344010a80 con 0x7f1354151e10 2023-11-15T01:22:17.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.172+0000 7f13598d4700 1 -- 172.21.15.1:0/4240553520 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13540a8dc0 con 0x7f1354151e10 2023-11-15T01:22:17.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.174+0000 7f13598d4700 1 -- 172.21.15.1:0/4240553520 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13540475e0 con 0x7f1354151e10 2023-11-15T01:22:17.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.174+0000 7f1350ff9700 1 -- 172.21.15.1:0/4240553520 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f134401b460 con 0x7f1354151e10 2023-11-15T01:22:17.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.174+0000 7f1350ff9700 1 --2- 172.21.15.1:0/4240553520 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f133405f150 0x7f1334061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.174+0000 7f1350ff9700 1 -- 172.21.15.1:0/4240553520 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1344079dd0 con 0x7f1354151e10 2023-11-15T01:22:17.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.174+0000 7f13588d2700 1 --2- 172.21.15.1:0/4240553520 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f133405f150 0x7f1334061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.175+0000 7f13588d2700 1 --2- 172.21.15.1:0/4240553520 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f133405f150 0x7f1334061610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f134c007fd0 tx=0x7f134c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:17.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.178+0000 7f1350ff9700 1 -- 172.21.15.1:0/4240553520 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f134404b430 con 0x7f1354151e10 2023-11-15T01:22:17.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.417+0000 7f13598d4700 1 -- 172.21.15.1:0/4240553520 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1354060900 con 0x7f1354151e10 2023-11-15T01:22:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.417+0000 7f1350ff9700 1 -- 172.21.15.1:0/4240553520 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f134404ea50 con 0x7f1354151e10 2023-11-15T01:22:17.419 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:17.420 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T01:22:17.420 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_dump": [ 2023-11-15T01:22:17.420 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.420 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.a", 2023-11-15T01:22:17.420 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlmtf5GBAA2CojasXoquGQ9L5rKjVwTQ==", 2023-11-15T01:22:17.421 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.421 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:22:17.421 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:22:17.421 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:22:17.421 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:22:17.422 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.422 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.422 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.422 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.b", 2023-11-15T01:22:17.422 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl/Y5mJBAAz7iLl3kBJ8kSsyTetTZByw==", 2023-11-15T01:22:17.423 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.423 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:22:17.423 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:22:17.423 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:22:17.423 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:22:17.424 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.424 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.424 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.424 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.c", 2023-11-15T01:22:17.424 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlWTrwHxAAqLVpwNca0vAXUBFnWUN3pg==", 2023-11-15T01:22:17.425 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.425 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:22:17.425 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:22:17.425 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:22:17.425 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:22:17.426 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.426 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.426 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.426 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.d", 2023-11-15T01:22:17.426 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlVwUnKxAAhx2/mX1ljgQwJLagVpmZIA==", 2023-11-15T01:22:17.427 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.427 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:22:17.427 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:22:17.427 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:22:17.427 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:22:17.428 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.428 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.428 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.428 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.0", 2023-11-15T01:22:17.428 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDxHFRlII6rERAA/kvPPhTPHHy6pu5wSPsR/A==", 2023-11-15T01:22:17.428 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.429 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:22:17.429 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:22:17.429 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:22:17.429 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.429 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.430 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.430 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.1", 2023-11-15T01:22:17.430 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD0HFRlPkstEBAAqx31fnNonRCVh98eY6qbxQ==", 2023-11-15T01:22:17.430 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.430 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:22:17.431 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:22:17.431 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:22:17.431 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.431 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.432 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.432 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.2", 2023-11-15T01:22:17.432 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD3HFRl8e3nDRAAKigcbIo0/BFo0Qi6rV+amQ==", 2023-11-15T01:22:17.432 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.432 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:22:17.432 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:22:17.433 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:22:17.433 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.433 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.433 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.434 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.3", 2023-11-15T01:22:17.434 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD6HFRlbwDTCxAAkWv04RyNqW4p8pOqvYCS3A==", 2023-11-15T01:22:17.434 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.434 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:22:17.434 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:22:17.435 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:22:17.435 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.435 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.435 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.435 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.4", 2023-11-15T01:22:17.436 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAAHVRlTQihDxAA/HcZbSytP9qD5PsTjvJBoA==", 2023-11-15T01:22:17.436 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.436 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:22:17.436 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:22:17.436 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:22:17.437 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.437 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.437 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.437 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.5", 2023-11-15T01:22:17.437 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQADHVRlQ2hjDRAAFiI+hKubCPcZ/1AJVu1fvQ==", 2023-11-15T01:22:17.438 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.438 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:22:17.438 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:22:17.438 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:22:17.438 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.439 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.439 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.439 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.6", 2023-11-15T01:22:17.439 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAGHVRl/KEbCxAAmKTnRU4m4qNzX+SVcFY+Qw==", 2023-11-15T01:22:17.439 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.439 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:22:17.440 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:22:17.440 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:22:17.440 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.440 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.440 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.441 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.7", 2023-11-15T01:22:17.441 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAJHVRl4wOFCBAAAiGT4UPE5vSb2LjqgGgGFw==", 2023-11-15T01:22:17.441 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.441 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:22:17.441 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:22:17.442 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:22:17.442 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.442 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.442 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.442 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.0", 2023-11-15T01:22:17.443 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl2hkHLxAAxQE/Cslig6gmXR/xcVlRuw==", 2023-11-15T01:22:17.443 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.443 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:22:17.443 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:22:17.443 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:22:17.443 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:22:17.444 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.444 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.444 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.444 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.1", 2023-11-15T01:22:17.444 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRltolkNxAAXmQ4yXOlavwqKq2jFKwsYQ==", 2023-11-15T01:22:17.445 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.445 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:22:17.445 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:22:17.445 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:22:17.445 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:22:17.446 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.446 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.446 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.446 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.2", 2023-11-15T01:22:17.446 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlFrJvNBAAH97x7ERzuzpWrUALO+HvpA==", 2023-11-15T01:22:17.447 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.447 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:22:17.447 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:22:17.447 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:22:17.447 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:22:17.448 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.448 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.448 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.448 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.3", 2023-11-15T01:22:17.448 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDwHFRlko0ZARAA2RqeRJGwWns00DeWgd/9hA==", 2023-11-15T01:22:17.448 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:22:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:22:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:22:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:22:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.admin", 2023-11-15T01:22:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDuHFRlxIQDORAALrVIyQoaVSADkyv9yzMaZw==", 2023-11-15T01:22:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:22:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:22:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:22:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:22:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-mds", 2023-11-15T01:22:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAOHVRlSNtzNBAARHboY925vEUBhPvzonUUwA==", 2023-11-15T01:22:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-mds" 2023-11-15T01:22:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-mgr", 2023-11-15T01:22:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAOHVRl3OZzNBAApXRxOTwzJNQ1mdmXZqc08g==", 2023-11-15T01:22:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-15T01:22:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-osd", 2023-11-15T01:22:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAOHVRlee9zNBAAEXgUxDLNCmMGMRxY+PjDfw==", 2023-11-15T01:22:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-osd" 2023-11-15T01:22:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-rbd", 2023-11-15T01:22:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAOHVRlt/dzNBAAOze151BY75W+69MayxDb/A==", 2023-11-15T01:22:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-15T01:22:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-15T01:22:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAOHVRlVAB0NBAABjSc8knJf+ivddcXOLL18g==", 2023-11-15T01:22:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-15T01:22:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-rgw", 2023-11-15T01:22:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAOHVRlmgh0NBAAlOSDvBZdhZnuvIoEaEsaSw==", 2023-11-15T01:22:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-15T01:22:17.460 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.460 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.460 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.460 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.x", 2023-11-15T01:22:17.460 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlnyjlFRAAjJwtxkAvJ0ZGmvOOawQseQ==", 2023-11-15T01:22:17.461 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.461 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:22:17.461 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T01:22:17.461 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:22:17.461 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.462 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:17.462 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:17.462 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.y", 2023-11-15T01:22:17.462 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl8nW3ERAA4CJQt/ZEZCJ9UaRRuEHfzw==", 2023-11-15T01:22:17.462 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:22:17.463 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:22:17.463 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T01:22:17.463 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:22:17.463 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.463 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:17.464 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2023-11-15T01:22:17.464 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T01:22:17.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.419+0000 7f13598d4700 1 -- 172.21.15.1:0/4240553520 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f133405f150 msgr2=0x7f1334061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.419+0000 7f13598d4700 1 --2- 172.21.15.1:0/4240553520 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f133405f150 0x7f1334061610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f134c007fd0 tx=0x7f134c009040).stop 2023-11-15T01:22:17.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.419+0000 7f13598d4700 1 -- 172.21.15.1:0/4240553520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1354151e10 msgr2=0x7f13541674b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.419+0000 7f13598d4700 1 --2- 172.21.15.1:0/4240553520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1354151e10 0x7f13541674b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f134400c880 tx=0x7f1344008040).stop 2023-11-15T01:22:17.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.419+0000 7f13598d4700 1 -- 172.21.15.1:0/4240553520 shutdown_connections 2023-11-15T01:22:17.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.419+0000 7f13598d4700 1 --2- 172.21.15.1:0/4240553520 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f133405f150 0x7f1334061610 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.419+0000 7f13598d4700 1 --2- 172.21.15.1:0/4240553520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1354155530 0x7f13541679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.419+0000 7f13598d4700 1 --2- 172.21.15.1:0/4240553520 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13540c98b0 0x7f13540a92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.419+0000 7f13598d4700 1 --2- 172.21.15.1:0/4240553520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1354151e10 0x7f13541674b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.419+0000 7f13598d4700 1 -- 172.21.15.1:0/4240553520 >> 172.21.15.1:0/4240553520 conn(0x7f13540947e0 msgr2=0x7f1354064ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:17.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.419+0000 7f13598d4700 1 -- 172.21.15.1:0/4240553520 shutdown_connections 2023-11-15T01:22:17.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.419+0000 7f13598d4700 1 -- 172.21.15.1:0/4240553520 wait complete. 2023-11-15T01:22:17.469 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-15T01:22:17.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.587+0000 7f9641192700 1 Processor -- start 2023-11-15T01:22:17.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.587+0000 7f9641192700 1 -- start start 2023-11-15T01:22:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.587+0000 7f9641192700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f963c0c6520 0x7f963c154af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f9641192700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f963c0c97b0 0x7f963c0c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f9641192700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963c1582b0 con 0x7f963c0c6900 2023-11-15T01:22:17.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f9641192700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f963c155b10 con 0x7f963c0c97b0 2023-11-15T01:22:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f9641192700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963c154fe0 con 0x7f963c0c6520 2023-11-15T01:22:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f963a59c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f963c0c6900 0x7f963c0aa420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49068/0 (socket says 172.21.15.1:49068) 2023-11-15T01:22:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f963a59c700 1 -- 172.21.15.1:0/1019771335 learned_addr learned my addr 172.21.15.1:0/1019771335 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:17.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f963b59e700 1 --2- 172.21.15.1:0/1019771335 >> v2:172.21.15.141:3300/0 conn(0x7f963c0c97b0 0x7f963c0c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f963ad9d700 1 --2- 172.21.15.1:0/1019771335 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f963c0c6520 0x7f963c154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f9639d9b700 1 -- 172.21.15.1:0/1019771335 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138193607 0 0) 0x7f963c1582b0 con 0x7f963c0c6900 2023-11-15T01:22:17.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f9639d9b700 1 -- 172.21.15.1:0/1019771335 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96280033f0 con 0x7f963c0c6900 2023-11-15T01:22:17.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f963ad9d700 1 -- 172.21.15.1:0/1019771335 >> v2:172.21.15.141:3300/0 conn(0x7f963c0c97b0 msgr2=0x7f963c0c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:17.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f963ad9d700 1 --2- 172.21.15.1:0/1019771335 >> v2:172.21.15.141:3300/0 conn(0x7f963c0c97b0 0x7f963c0c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f963ad9d700 1 -- 172.21.15.1:0/1019771335 >> v1:172.21.15.1:6789/0 conn(0x7f963c0c6900 legacy=0x7f963c0aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f963ad9d700 1 -- 172.21.15.1:0/1019771335 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c155270 con 0x7f963c0c6520 2023-11-15T01:22:17.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f963b59e700 1 --2- 172.21.15.1:0/1019771335 >> v2:172.21.15.141:3300/0 conn(0x7f963c0c97b0 0x7f963c0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:17.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f963ad9d700 1 --2- 172.21.15.1:0/1019771335 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f963c0c6520 0x7f963c154af0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f962c009760 tx=0x7f962c009060).ready entity=mon.2 client_cookie=d54f9d136667cd6e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:17.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.588+0000 7f9639d9b700 1 -- 172.21.15.1:0/1019771335 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c00d4a0 con 0x7f963c0c6520 2023-11-15T01:22:17.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.589+0000 7f9639d9b700 1 -- 172.21.15.1:0/1019771335 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962c00d600 con 0x7f963c0c6520 2023-11-15T01:22:17.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.589+0000 7f9639d9b700 1 -- 172.21.15.1:0/1019771335 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c00d980 con 0x7f963c0c6520 2023-11-15T01:22:17.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.589+0000 7f9641192700 1 -- 172.21.15.1:0/1019771335 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f963c0c6520 msgr2=0x7f963c154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.589+0000 7f9641192700 1 --2- 172.21.15.1:0/1019771335 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f963c0c6520 0x7f963c154af0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f962c009760 tx=0x7f962c009060).stop 2023-11-15T01:22:17.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.589+0000 7f9641192700 1 -- 172.21.15.1:0/1019771335 shutdown_connections 2023-11-15T01:22:17.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.589+0000 7f9641192700 1 --2- 172.21.15.1:0/1019771335 >> v2:172.21.15.141:3300/0 conn(0x7f963c0c97b0 0x7f963c0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.589+0000 7f9641192700 1 --2- 172.21.15.1:0/1019771335 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f963c0c6520 0x7f963c154af0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.589+0000 7f9641192700 1 -- 172.21.15.1:0/1019771335 >> 172.21.15.1:0/1019771335 conn(0x7f963c0cb060 msgr2=0x7f963c0cb470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:17.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.589+0000 7f9641192700 1 -- 172.21.15.1:0/1019771335 shutdown_connections 2023-11-15T01:22:17.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.589+0000 7f9641192700 1 -- 172.21.15.1:0/1019771335 wait complete. 2023-11-15T01:22:17.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.590+0000 7f9641192700 1 Processor -- start 2023-11-15T01:22:17.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.590+0000 7f9641192700 1 -- start start 2023-11-15T01:22:17.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.591+0000 7f9641192700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f963c0c6520 0x7f963c0b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.591+0000 7f9641192700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f963c0c6900 0x7f963c1644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.591+0000 7f9641192700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f963c0c97b0 0x7f963c164990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.591+0000 7f9641192700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c0b1010 con 0x7f963c0c6520 2023-11-15T01:22:17.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.591+0000 7f9641192700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c0ab6e0 con 0x7f963c0c97b0 2023-11-15T01:22:17.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.591+0000 7f9641192700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963c15ab70 con 0x7f963c0c6900 2023-11-15T01:22:17.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.591+0000 7f963ad9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f963c0c6520 0x7f963c0b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.591+0000 7f963ad9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f963c0c6520 0x7f963c0b0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43924/0 (socket says 172.21.15.1:43924) 2023-11-15T01:22:17.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.591+0000 7f963ad9d700 1 -- 172.21.15.1:0/794370436 learned_addr learned my addr 172.21.15.1:0/794370436 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:17.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.591+0000 7f963b59e700 1 --2- 172.21.15.1:0/794370436 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f963c0c97b0 0x7f963c164990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.591+0000 7f963a59c700 1 --2- 172.21.15.1:0/794370436 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f963c0c6900 0x7f963c1644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.592+0000 7f963ad9d700 1 -- 172.21.15.1:0/794370436 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f963c0c6900 msgr2=0x7f963c1644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.592+0000 7f963ad9d700 1 --2- 172.21.15.1:0/794370436 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f963c0c6900 0x7f963c1644a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.592+0000 7f963ad9d700 1 -- 172.21.15.1:0/794370436 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f963c0c97b0 msgr2=0x7f963c164990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.592+0000 7f963ad9d700 1 --2- 172.21.15.1:0/794370436 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f963c0c97b0 0x7f963c164990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.592+0000 7f963ad9d700 1 -- 172.21.15.1:0/794370436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9634009a20 con 0x7f963c0c6520 2023-11-15T01:22:17.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.592+0000 7f963ad9d700 1 --2- 172.21.15.1:0/794370436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f963c0c6520 0x7f963c0b0090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f962c009d50 tx=0x7f962c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:17.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.592+0000 7f9632ffd700 1 -- 172.21.15.1:0/794370436 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c00dd30 con 0x7f963c0c6520 2023-11-15T01:22:17.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.592+0000 7f9632ffd700 1 -- 172.21.15.1:0/794370436 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962c00de90 con 0x7f963c0c6520 2023-11-15T01:22:17.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.592+0000 7f9641192700 1 -- 172.21.15.1:0/794370436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962c0092a0 con 0x7f963c0c6520 2023-11-15T01:22:17.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.592+0000 7f9632ffd700 1 -- 172.21.15.1:0/794370436 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c00d980 con 0x7f963c0c6520 2023-11-15T01:22:17.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.592+0000 7f9641192700 1 -- 172.21.15.1:0/794370436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963c0b0d30 con 0x7f963c0c6520 2023-11-15T01:22:17.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.593+0000 7f9641192700 1 -- 172.21.15.1:0/794370436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963c06c7e0 con 0x7f963c0c6520 2023-11-15T01:22:17.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.593+0000 7f9632ffd700 1 -- 172.21.15.1:0/794370436 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f962c01d640 con 0x7f963c0c6520 2023-11-15T01:22:17.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.593+0000 7f9632ffd700 1 --2- 172.21.15.1:0/794370436 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f961c05f150 0x7f961c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.594+0000 7f9632ffd700 1 -- 172.21.15.1:0/794370436 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f962c07b670 con 0x7f963c0c6520 2023-11-15T01:22:17.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.594+0000 7f963a59c700 1 --2- 172.21.15.1:0/794370436 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f961c05f150 0x7f961c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.594+0000 7f963a59c700 1 --2- 172.21.15.1:0/794370436 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f961c05f150 0x7f961c061610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f963c0ad7f0 tx=0x7f9624009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:17.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.598+0000 7f9632ffd700 1 -- 172.21.15.1:0/794370436 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f962c04cc90 con 0x7f963c0c6520 2023-11-15T01:22:17.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.837+0000 7f9641192700 1 -- 172.21.15.1:0/794370436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f963c155550 con 0x7f963c0c6520 2023-11-15T01:22:17.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.840+0000 7f9632ffd700 1 -- 172.21.15.1:0/794370436 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f962c0502b0 con 0x7f963c0c6520 2023-11-15T01:22:17.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.842+0000 7f9641192700 1 -- 172.21.15.1:0/794370436 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f961c05f150 msgr2=0x7f961c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.842+0000 7f9641192700 1 --2- 172.21.15.1:0/794370436 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f961c05f150 0x7f961c061610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f963c0ad7f0 tx=0x7f9624009040).stop 2023-11-15T01:22:17.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.842+0000 7f9641192700 1 -- 172.21.15.1:0/794370436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f963c0c6520 msgr2=0x7f963c0b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.842+0000 7f9641192700 1 --2- 172.21.15.1:0/794370436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f963c0c6520 0x7f963c0b0090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f962c009d50 tx=0x7f962c016000).stop 2023-11-15T01:22:17.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.842+0000 7f9641192700 1 -- 172.21.15.1:0/794370436 shutdown_connections 2023-11-15T01:22:17.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.842+0000 7f9641192700 1 --2- 172.21.15.1:0/794370436 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f961c05f150 0x7f961c061610 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.842+0000 7f9641192700 1 --2- 172.21.15.1:0/794370436 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f963c0c97b0 0x7f963c164990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.842+0000 7f9641192700 1 --2- 172.21.15.1:0/794370436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f963c0c6520 0x7f963c0b0090 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.842+0000 7f9641192700 1 --2- 172.21.15.1:0/794370436 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f963c0c6900 0x7f963c1644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.842+0000 7f9641192700 1 -- 172.21.15.1:0/794370436 >> 172.21.15.1:0/794370436 conn(0x7f963c0cb060 msgr2=0x7f963c155df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.842+0000 7f9641192700 1 -- 172.21.15.1:0/794370436 shutdown_connections 2023-11-15T01:22:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.842+0000 7f9641192700 1 -- 172.21.15.1:0/794370436 wait complete. 2023-11-15T01:22:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:updated 2023-11-15T01:22:17.855 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-15T01:22:17.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.973+0000 7f05e6873700 1 Processor -- start 2023-11-15T01:22:17.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.973+0000 7f05e6873700 1 -- start start 2023-11-15T01:22:17.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.974+0000 7f05e6873700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f05e0154150 0x7f05e0154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.974+0000 7f05e6873700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f05e00aa060 0x7f05e00c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.974+0000 7f05e6873700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e00c06f0 con 0x7f05e00ab1a0 2023-11-15T01:22:17.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.974+0000 7f05e6873700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e00c09d0 con 0x7f05e0154150 2023-11-15T01:22:17.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.974+0000 7f05e6873700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e0158820 con 0x7f05e00aa060 2023-11-15T01:22:17.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.974+0000 7f05dffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f05e0154150 0x7f05e0154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.974+0000 7f05dffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f05e0154150 0x7f05e0154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43930/0 (socket says 172.21.15.1:43930) 2023-11-15T01:22:17.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.974+0000 7f05dffff700 1 -- 172.21.15.1:0/1353480051 learned_addr learned my addr 172.21.15.1:0/1353480051 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:17.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.974+0000 7f05e4e10700 1 --2- 172.21.15.1:0/1353480051 >> v2:172.21.15.141:3300/0 conn(0x7f05e00aa060 0x7f05e00c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.974+0000 7f05dffff700 1 -- 172.21.15.1:0/1353480051 >> v2:172.21.15.141:3300/0 conn(0x7f05e00aa060 msgr2=0x7f05e00c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:17.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.974+0000 7f05dffff700 1 --2- 172.21.15.1:0/1353480051 >> v2:172.21.15.141:3300/0 conn(0x7f05e00aa060 0x7f05e00c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.974+0000 7f05dffff700 1 -- 172.21.15.1:0/1353480051 >> v1:172.21.15.141:6789/0 conn(0x7f05e00ab1a0 legacy=0x7f05e0158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.974+0000 7f05dffff700 1 -- 172.21.15.1:0/1353480051 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e0158b00 con 0x7f05e0154150 2023-11-15T01:22:17.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.974+0000 7f05e4e10700 1 --2- 172.21.15.1:0/1353480051 >> v2:172.21.15.141:3300/0 conn(0x7f05e00aa060 0x7f05e00c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:17.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.975+0000 7f05dffff700 1 --2- 172.21.15.1:0/1353480051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e0154150 0x7f05e0154530 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f05e0157f80 tx=0x7f05c80090f0).ready entity=mon.0 client_cookie=48bd9d3f0e48026c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:17.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.975+0000 7f05deffd700 1 -- 172.21.15.1:0/1353480051 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c800b600 con 0x7f05e0154150 2023-11-15T01:22:17.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.975+0000 7f05deffd700 1 -- 172.21.15.1:0/1353480051 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c800b760 con 0x7f05e0154150 2023-11-15T01:22:17.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.975+0000 7f05deffd700 1 -- 172.21.15.1:0/1353480051 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c800bb00 con 0x7f05e0154150 2023-11-15T01:22:17.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.975+0000 7f05e6873700 1 -- 172.21.15.1:0/1353480051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e0154150 msgr2=0x7f05e0154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.975+0000 7f05e6873700 1 --2- 172.21.15.1:0/1353480051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e0154150 0x7f05e0154530 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f05e0157f80 tx=0x7f05c80090f0).stop 2023-11-15T01:22:17.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.975+0000 7f05e6873700 1 -- 172.21.15.1:0/1353480051 shutdown_connections 2023-11-15T01:22:17.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.975+0000 7f05e6873700 1 --2- 172.21.15.1:0/1353480051 >> v2:172.21.15.141:3300/0 conn(0x7f05e00aa060 0x7f05e00c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.975+0000 7f05e6873700 1 --2- 172.21.15.1:0/1353480051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e0154150 0x7f05e0154530 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.975+0000 7f05e6873700 1 -- 172.21.15.1:0/1353480051 >> 172.21.15.1:0/1353480051 conn(0x7f05e0064aa0 msgr2=0x7f05e0064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:17.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.975+0000 7f05e6873700 1 -- 172.21.15.1:0/1353480051 shutdown_connections 2023-11-15T01:22:17.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.975+0000 7f05e6873700 1 -- 172.21.15.1:0/1353480051 wait complete. 2023-11-15T01:22:17.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.976+0000 7f05e6873700 1 Processor -- start 2023-11-15T01:22:17.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.977+0000 7f05e6873700 1 -- start start 2023-11-15T01:22:17.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.977+0000 7f05e6873700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e00aa060 0x7f05e00ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.977+0000 7f05e6873700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e00ab1a0 0x7f05e00c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.977+0000 7f05e6873700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05e0154150 0x7f05e0152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.977+0000 7f05e6873700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e013fb60 con 0x7f05e00aa060 2023-11-15T01:22:17.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.977+0000 7f05e6873700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e01406e0 con 0x7f05e0154150 2023-11-15T01:22:17.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.977+0000 7f05e6873700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e00c2630 con 0x7f05e00ab1a0 2023-11-15T01:22:17.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.977+0000 7f05dffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e00aa060 0x7f05e00ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.977+0000 7f05dffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e00aa060 0x7f05e00ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43932/0 (socket says 172.21.15.1:43932) 2023-11-15T01:22:17.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.977+0000 7f05dffff700 1 -- 172.21.15.1:0/3192820868 learned_addr learned my addr 172.21.15.1:0/3192820868 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:17.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.978+0000 7f05dffff700 1 -- 172.21.15.1:0/3192820868 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e00ab1a0 msgr2=0x7f05e00c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.978+0000 7f05e4e10700 1 --2- 172.21.15.1:0/3192820868 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05e0154150 0x7f05e0152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.978+0000 7f05dffff700 1 --2- 172.21.15.1:0/3192820868 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e00ab1a0 0x7f05e00c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:17.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.978+0000 7f05dffff700 1 -- 172.21.15.1:0/3192820868 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05e0154150 msgr2=0x7f05e0152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:17.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.978+0000 7f05dffff700 1 --2- 172.21.15.1:0/3192820868 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05e0154150 0x7f05e0152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:17.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.978+0000 7f05dffff700 1 -- 172.21.15.1:0/3192820868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c8009370 con 0x7f05e00aa060 2023-11-15T01:22:17.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.978+0000 7f05dffff700 1 --2- 172.21.15.1:0/3192820868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e00aa060 0x7f05e00ace90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f05c8006fd0 tx=0x7f05c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:17.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.978+0000 7f05d7fff700 1 -- 172.21.15.1:0/3192820868 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8002f30 con 0x7f05e00aa060 2023-11-15T01:22:17.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.978+0000 7f05d7fff700 1 -- 172.21.15.1:0/3192820868 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c800b8d0 con 0x7f05e00aa060 2023-11-15T01:22:17.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.978+0000 7f05e6873700 1 -- 172.21.15.1:0/3192820868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e00c28b0 con 0x7f05e00aa060 2023-11-15T01:22:17.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.978+0000 7f05d7fff700 1 -- 172.21.15.1:0/3192820868 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8024470 con 0x7f05e00aa060 2023-11-15T01:22:17.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.978+0000 7f05e6873700 1 -- 172.21.15.1:0/3192820868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e013fdb0 con 0x7f05e00aa060 2023-11-15T01:22:17.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.979+0000 7f05e6873700 1 -- 172.21.15.1:0/3192820868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e006c7e0 con 0x7f05e00aa060 2023-11-15T01:22:17.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.979+0000 7f05d7fff700 1 -- 172.21.15.1:0/3192820868 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f05c8021070 con 0x7f05e00aa060 2023-11-15T01:22:17.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.980+0000 7f05d7fff700 1 --2- 172.21.15.1:0/3192820868 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05c005f150 0x7f05c0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:17.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.980+0000 7f05d7fff700 1 -- 172.21.15.1:0/3192820868 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f05c807b840 con 0x7f05e00aa060 2023-11-15T01:22:17.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.980+0000 7f05df7fe700 1 --2- 172.21.15.1:0/3192820868 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05c005f150 0x7f05c0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:17.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.980+0000 7f05df7fe700 1 --2- 172.21.15.1:0/3192820868 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05c005f150 0x7f05c0061610 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f05e00c83d0 tx=0x7f05d0007980).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:17.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:17.984+0000 7f05d7fff700 1 -- 172.21.15.1:0/3192820868 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f05c804cf10 con 0x7f05e00aa060 2023-11-15T01:22:18.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.227+0000 7f05e6873700 1 -- 172.21.15.1:0/3192820868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f05e01539a0 con 0x7f05e00aa060 2023-11-15T01:22:18.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.230+0000 7f05d7fff700 1 -- 172.21.15.1:0/3192820868 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f05c8050530 con 0x7f05e00aa060 2023-11-15T01:22:18.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.232+0000 7f05e6873700 1 -- 172.21.15.1:0/3192820868 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05c005f150 msgr2=0x7f05c0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:18.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.232+0000 7f05e6873700 1 --2- 172.21.15.1:0/3192820868 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05c005f150 0x7f05c0061610 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f05e00c83d0 tx=0x7f05d0007980).stop 2023-11-15T01:22:18.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.232+0000 7f05e6873700 1 -- 172.21.15.1:0/3192820868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e00aa060 msgr2=0x7f05e00ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:18.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.232+0000 7f05e6873700 1 --2- 172.21.15.1:0/3192820868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e00aa060 0x7f05e00ace90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f05c8006fd0 tx=0x7f05c8017000).stop 2023-11-15T01:22:18.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.232+0000 7f05e6873700 1 -- 172.21.15.1:0/3192820868 shutdown_connections 2023-11-15T01:22:18.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.232+0000 7f05e6873700 1 --2- 172.21.15.1:0/3192820868 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05c005f150 0x7f05c0061610 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.232+0000 7f05e6873700 1 --2- 172.21.15.1:0/3192820868 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05e0154150 0x7f05e0152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.232+0000 7f05e6873700 1 --2- 172.21.15.1:0/3192820868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e00aa060 0x7f05e00ace90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.232+0000 7f05e6873700 1 --2- 172.21.15.1:0/3192820868 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e00ab1a0 0x7f05e00c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:18.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.232+0000 7f05e6873700 1 -- 172.21.15.1:0/3192820868 >> 172.21.15.1:0/3192820868 conn(0x7f05e0064aa0 msgr2=0x7f05e014da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:18.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.233+0000 7f05e6873700 1 -- 172.21.15.1:0/3192820868 shutdown_connections 2023-11-15T01:22:18.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.233+0000 7f05e6873700 1 -- 172.21.15.1:0/3192820868 wait complete. 2023-11-15T01:22:18.237 INFO:teuthology.orchestra.run.smithi001.stderr:updated 2023-11-15T01:22:18.246 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-15T01:22:18.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.364+0000 7fe00359e700 1 Processor -- start 2023-11-15T01:22:18.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.364+0000 7fe00359e700 1 -- start start 2023-11-15T01:22:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.365+0000 7fe00359e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0040c9fc0 0x7fe0040c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.365+0000 7fe00359e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0040c7980 con 0x7fe004151e10 2023-11-15T01:22:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.365+0000 7fe00359e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0040aa890 con 0x7fe004155530 2023-11-15T01:22:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.365+0000 7fe00359e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040c7bd0 con 0x7fe0040c9fc0 2023-11-15T01:22:18.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.365+0000 7fe00259c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe004151e10 0x7fe0040aa0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49082/0 (socket says 172.21.15.1:49082) 2023-11-15T01:22:18.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.365+0000 7fe00259c700 1 -- 172.21.15.1:0/2687419775 learned_addr learned my addr 172.21.15.1:0/2687419775 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:18.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.365+0000 7fe002d9d700 1 --2- 172.21.15.1:0/2687419775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0040c9fc0 0x7fe0040c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:18.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.365+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105679696 0 0) 0x7fe0040c7980 con 0x7fe004151e10 2023-11-15T01:22:18.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.365+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff00033f0 con 0x7fe004151e10 2023-11-15T01:22:18.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973667463 0 0) 0x7fe0040aa890 con 0x7fe004155530 2023-11-15T01:22:18.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0040c7980 con 0x7fe004155530 2023-11-15T01:22:18.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 949210537 0 0) 0x7fdff00033f0 con 0x7fe004151e10 2023-11-15T01:22:18.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0040c9fc0 msgr2=0x7fe0040c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00159a700 1 --2- 172.21.15.1:0/2687419775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0040c9fc0 0x7fe0040c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 >> v1:172.21.15.141:6789/0 conn(0x7fe004155530 legacy=0x7fe0040c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0040c7eb0 con 0x7fe004151e10 2023-11-15T01:22:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fdffc0017f0 con 0x7fe004151e10 2023-11-15T01:22:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe002d9d700 1 --2- 172.21.15.1:0/2687419775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0040c9fc0 0x7fe0040c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 >> v1:172.21.15.1:6789/0 conn(0x7fe004151e10 legacy=0x7fe0040aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00159a700 1 --2- 172.21.15.1:0/2687419775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff0003aa0 0x7fdff0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00159a700 1 --2- 172.21.15.1:0/2687419775 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdff0004690 0x7fdff0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00159a700 1 --2- 172.21.15.1:0/2687419775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0040c9fc0 0x7fdff0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040c7bd0 con 0x7fdff0003aa0 2023-11-15T01:22:18.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff000b8e0 con 0x7fdff0004690 2023-11-15T01:22:18.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff000ba70 con 0x7fe0040c9fc0 2023-11-15T01:22:18.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00259c700 1 --2- 172.21.15.1:0/2687419775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff0003aa0 0x7fdff0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:18.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe001d9b700 1 --2- 172.21.15.1:0/2687419775 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdff0004690 0x7fdff0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:18.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe002d9d700 1 --2- 172.21.15.1:0/2687419775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0040c9fc0 0x7fdff0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:18.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00259c700 1 -- 172.21.15.1:0/2687419775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0040c9fc0 msgr2=0x7fdff0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:18.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00259c700 1 --2- 172.21.15.1:0/2687419775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0040c9fc0 0x7fdff0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00259c700 1 -- 172.21.15.1:0/2687419775 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdff0004690 msgr2=0x7fdff0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:18.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00259c700 1 --2- 172.21.15.1:0/2687419775 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdff0004690 0x7fdff0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00259c700 1 -- 172.21.15.1:0/2687419775 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff40092a0 con 0x7fdff0003aa0 2023-11-15T01:22:18.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.366+0000 7fe00259c700 1 --2- 172.21.15.1:0/2687419775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff0003aa0 0x7fdff0003ea0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fdffc00c5c0 tx=0x7fdffc007f40).ready entity=mon.0 client_cookie=597fee19d5d383eb server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:18.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.367+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00cdc0 con 0x7fdff0003aa0 2023-11-15T01:22:18.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.367+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc005b20 con 0x7fdff0003aa0 2023-11-15T01:22:18.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.367+0000 7fe00159a700 1 -- 172.21.15.1:0/2687419775 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0070d0 con 0x7fdff0003aa0 2023-11-15T01:22:18.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.367+0000 7fe00359e700 1 -- 172.21.15.1:0/2687419775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff0003aa0 msgr2=0x7fdff0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:18.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.367+0000 7fe00359e700 1 --2- 172.21.15.1:0/2687419775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff0003aa0 0x7fdff0003ea0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fdffc00c5c0 tx=0x7fdffc007f40).stop 2023-11-15T01:22:18.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.367+0000 7fe002d9d700 1 -- 172.21.15.1:0/2687419775 reap_dead start 2023-11-15T01:22:18.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.367+0000 7fe00359e700 1 -- 172.21.15.1:0/2687419775 shutdown_connections 2023-11-15T01:22:18.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.367+0000 7fe00359e700 1 -- 172.21.15.1:0/2687419775 >> 172.21.15.1:0/2687419775 conn(0x7fe0040947e0 msgr2=0x7fe00406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:18.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.367+0000 7fe00359e700 1 -- 172.21.15.1:0/2687419775 shutdown_connections 2023-11-15T01:22:18.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.367+0000 7fe00359e700 1 -- 172.21.15.1:0/2687419775 wait complete. 2023-11-15T01:22:18.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.368+0000 7fe00359e700 1 Processor -- start 2023-11-15T01:22:18.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.368+0000 7fe00359e700 1 -- start start 2023-11-15T01:22:18.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe00359e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff0003aa0 0x7fe0040b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:18.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe00359e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe00414ef40 0x7fe0040ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:18.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe00359e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0040aecd0 0x7fe0040635a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:18.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe00359e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040afe20 con 0x7fdff0003aa0 2023-11-15T01:22:18.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe00359e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040af210 con 0x7fe00414ef40 2023-11-15T01:22:18.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe00359e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040af4f0 con 0x7fe0040aecd0 2023-11-15T01:22:18.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe00259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff0003aa0 0x7fe0040b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:18.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe00259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff0003aa0 0x7fe0040b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43966/0 (socket says 172.21.15.1:43966) 2023-11-15T01:22:18.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe00259c700 1 -- 172.21.15.1:0/3592614406 learned_addr learned my addr 172.21.15.1:0/3592614406 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:18.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe001d9b700 1 --2- 172.21.15.1:0/3592614406 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe00414ef40 0x7fe0040ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:18.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe002d9d700 1 --2- 172.21.15.1:0/3592614406 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0040aecd0 0x7fe0040635a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:18.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe00259c700 1 -- 172.21.15.1:0/3592614406 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0040aecd0 msgr2=0x7fe0040635a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:18.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe00259c700 1 --2- 172.21.15.1:0/3592614406 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0040aecd0 0x7fe0040635a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe00259c700 1 -- 172.21.15.1:0/3592614406 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe00414ef40 msgr2=0x7fe0040ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:18.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe00259c700 1 --2- 172.21.15.1:0/3592614406 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe00414ef40 0x7fe0040ae7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.369+0000 7fe00259c700 1 -- 172.21.15.1:0/3592614406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0040af7d0 con 0x7fdff0003aa0 2023-11-15T01:22:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.370+0000 7fe00259c700 1 --2- 172.21.15.1:0/3592614406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff0003aa0 0x7fe0040b02b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fdff00045e0 tx=0x7fdffc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.370+0000 7fdffa7fc700 1 -- 172.21.15.1:0/3592614406 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc007d00 con 0x7fdff0003aa0 2023-11-15T01:22:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.370+0000 7fdffa7fc700 1 -- 172.21.15.1:0/3592614406 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc007440 con 0x7fdff0003aa0 2023-11-15T01:22:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.370+0000 7fe00359e700 1 -- 172.21.15.1:0/3592614406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0040afab0 con 0x7fdff0003aa0 2023-11-15T01:22:18.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.370+0000 7fdffa7fc700 1 -- 172.21.15.1:0/3592614406 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0077c0 con 0x7fdff0003aa0 2023-11-15T01:22:18.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.370+0000 7fe00359e700 1 -- 172.21.15.1:0/3592614406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0040ae270 con 0x7fdff0003aa0 2023-11-15T01:22:18.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.371+0000 7fe00359e700 1 -- 172.21.15.1:0/3592614406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0040b0100 con 0x7fdff0003aa0 2023-11-15T01:22:18.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.371+0000 7fdffa7fc700 1 -- 172.21.15.1:0/3592614406 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdffc013660 con 0x7fdff0003aa0 2023-11-15T01:22:18.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.372+0000 7fdffa7fc700 1 --2- 172.21.15.1:0/3592614406 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdfe405f180 0x7fdfe4061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:18.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.372+0000 7fdffa7fc700 1 -- 172.21.15.1:0/3592614406 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdffc07aed0 con 0x7fdff0003aa0 2023-11-15T01:22:18.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.372+0000 7fe001d9b700 1 --2- 172.21.15.1:0/3592614406 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdfe405f180 0x7fdfe4061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:18.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.372+0000 7fe001d9b700 1 --2- 172.21.15.1:0/3592614406 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdfe405f180 0x7fdfe4061640 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fe0040addf0 tx=0x7fdfec007bb0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:18.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.376+0000 7fdffa7fc700 1 -- 172.21.15.1:0/3592614406 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdffc04c5a0 con 0x7fdff0003aa0 2023-11-15T01:22:18.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.618+0000 7fe00359e700 1 -- 172.21.15.1:0/3592614406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fe0040475e0 con 0x7fdff0003aa0 2023-11-15T01:22:18.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.622+0000 7fdffa7fc700 1 -- 172.21.15.1:0/3592614406 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdffc01a070 con 0x7fdff0003aa0 2023-11-15T01:22:18.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.624+0000 7fe00359e700 1 -- 172.21.15.1:0/3592614406 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdfe405f180 msgr2=0x7fdfe4061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:18.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.624+0000 7fe00359e700 1 --2- 172.21.15.1:0/3592614406 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdfe405f180 0x7fdfe4061640 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fe0040addf0 tx=0x7fdfec007bb0).stop 2023-11-15T01:22:18.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.624+0000 7fe00359e700 1 -- 172.21.15.1:0/3592614406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff0003aa0 msgr2=0x7fe0040b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:18.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.624+0000 7fe00359e700 1 --2- 172.21.15.1:0/3592614406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff0003aa0 0x7fe0040b02b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fdff00045e0 tx=0x7fdffc015000).stop 2023-11-15T01:22:18.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.624+0000 7fe00359e700 1 -- 172.21.15.1:0/3592614406 shutdown_connections 2023-11-15T01:22:18.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.624+0000 7fe00359e700 1 --2- 172.21.15.1:0/3592614406 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdfe405f180 0x7fdfe4061640 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.624+0000 7fe00359e700 1 --2- 172.21.15.1:0/3592614406 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0040aecd0 0x7fe0040635a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.624+0000 7fe00359e700 1 --2- 172.21.15.1:0/3592614406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff0003aa0 0x7fe0040b02b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.624+0000 7fe00359e700 1 --2- 172.21.15.1:0/3592614406 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe00414ef40 0x7fe0040ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.624+0000 7fe00359e700 1 -- 172.21.15.1:0/3592614406 >> 172.21.15.1:0/3592614406 conn(0x7fe0040947e0 msgr2=0x7fe0040a9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:18.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.624+0000 7fe00359e700 1 -- 172.21.15.1:0/3592614406 shutdown_connections 2023-11-15T01:22:18.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.624+0000 7fe00359e700 1 -- 172.21.15.1:0/3592614406 wait complete. 2023-11-15T01:22:18.628 INFO:teuthology.orchestra.run.smithi001.stderr:updated 2023-11-15T01:22:18.638 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-15T01:22:18.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.755+0000 7ff4328c0700 1 Processor -- start 2023-11-15T01:22:18.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.755+0000 7ff4328c0700 1 -- start start 2023-11-15T01:22:18.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff4328c0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff42c0c6520 0x7ff42c154af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:18.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff4328c0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff42c0c6900 0x7ff42c0aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:18.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff4328c0700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff42c0c97b0 0x7ff42c0c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:18.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff4328c0700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42c155b10 con 0x7ff42c0c6900 2023-11-15T01:22:18.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff4328c0700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42c1582b0 con 0x7ff42c0c97b0 2023-11-15T01:22:18.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff4328c0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c154fe0 con 0x7ff42c0c6520 2023-11-15T01:22:18.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff42b7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff42c0c6900 0x7ff42c0aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:18.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff42b7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff42c0c6900 0x7ff42c0aa420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43978/0 (socket says 172.21.15.1:43978) 2023-11-15T01:22:18.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff42b7fe700 1 -- 172.21.15.1:0/2967249452 learned_addr learned my addr 172.21.15.1:0/2967249452 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:18.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff430e5d700 1 --2- 172.21.15.1:0/2967249452 >> v2:172.21.15.141:3300/0 conn(0x7ff42c0c97b0 0x7ff42c0c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:18.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff42bfff700 1 --2- 172.21.15.1:0/2967249452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff42c0c6520 0x7ff42c154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:18.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff42b7fe700 1 -- 172.21.15.1:0/2967249452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff42c0c6520 msgr2=0x7ff42c154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:18.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff42b7fe700 1 --2- 172.21.15.1:0/2967249452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff42c0c6520 0x7ff42c154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff42b7fe700 1 -- 172.21.15.1:0/2967249452 >> v2:172.21.15.141:3300/0 conn(0x7ff42c0c97b0 msgr2=0x7ff42c0c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:18.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff42b7fe700 1 --2- 172.21.15.1:0/2967249452 >> v2:172.21.15.141:3300/0 conn(0x7ff42c0c97b0 0x7ff42c0c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.756+0000 7ff42b7fe700 1 -- 172.21.15.1:0/2967249452 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c0aa910 con 0x7ff42c0c6900 2023-11-15T01:22:18.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.757+0000 7ff42b7fe700 1 --2- 172.21.15.1:0/2967249452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c0c6900 0x7ff42c0aa420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7ff42c0c55f0 tx=0x7ff4200090f0).ready entity=mon.0 client_cookie=5471dadb2be8b185 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:18.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.757+0000 7ff42affd700 1 -- 172.21.15.1:0/2967249452 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42000b600 con 0x7ff42c0c6900 2023-11-15T01:22:18.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.757+0000 7ff42affd700 1 -- 172.21.15.1:0/2967249452 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42000b760 con 0x7ff42c0c6900 2023-11-15T01:22:18.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.757+0000 7ff42affd700 1 -- 172.21.15.1:0/2967249452 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42000bae0 con 0x7ff42c0c6900 2023-11-15T01:22:18.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.757+0000 7ff4328c0700 1 -- 172.21.15.1:0/2967249452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c0c6900 msgr2=0x7ff42c0aa420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:18.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.757+0000 7ff4328c0700 1 --2- 172.21.15.1:0/2967249452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c0c6900 0x7ff42c0aa420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7ff42c0c55f0 tx=0x7ff4200090f0).stop 2023-11-15T01:22:18.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.757+0000 7ff4328c0700 1 -- 172.21.15.1:0/2967249452 shutdown_connections 2023-11-15T01:22:18.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.757+0000 7ff4328c0700 1 --2- 172.21.15.1:0/2967249452 >> v2:172.21.15.141:3300/0 conn(0x7ff42c0c97b0 0x7ff42c0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.757+0000 7ff4328c0700 1 --2- 172.21.15.1:0/2967249452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff42c0c6520 0x7ff42c154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.757+0000 7ff4328c0700 1 --2- 172.21.15.1:0/2967249452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c0c6900 0x7ff42c0aa420 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.757+0000 7ff4328c0700 1 -- 172.21.15.1:0/2967249452 >> 172.21.15.1:0/2967249452 conn(0x7ff42c0cb060 msgr2=0x7ff42c0cb470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:18.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.757+0000 7ff4328c0700 1 -- 172.21.15.1:0/2967249452 shutdown_connections 2023-11-15T01:22:18.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.757+0000 7ff4328c0700 1 -- 172.21.15.1:0/2967249452 wait complete. 2023-11-15T01:22:18.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.758+0000 7ff4328c0700 1 Processor -- start 2023-11-15T01:22:18.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.759+0000 7ff4328c0700 1 -- start start 2023-11-15T01:22:18.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.759+0000 7ff4328c0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff42c0c6520 0x7ff42c1511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:18.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.759+0000 7ff4328c0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff42c0c6900 0x7ff42c0c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:18.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.759+0000 7ff4328c0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c0c97b0 0x7ff42c14d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:18.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.759+0000 7ff4328c0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0c5270 con 0x7ff42c0c97b0 2023-11-15T01:22:18.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.759+0000 7ff4328c0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0ab750 con 0x7ff42c0c6900 2023-11-15T01:22:18.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.759+0000 7ff4328c0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0c4cb0 con 0x7ff42c0c6520 2023-11-15T01:22:18.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.759+0000 7ff430e5d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c0c97b0 0x7ff42c14d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:18.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.759+0000 7ff430e5d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c0c97b0 0x7ff42c14d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43988/0 (socket says 172.21.15.1:43988) 2023-11-15T01:22:18.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.759+0000 7ff430e5d700 1 -- 172.21.15.1:0/4031720049 learned_addr learned my addr 172.21.15.1:0/4031720049 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:18.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.760+0000 7ff42b7fe700 1 --2- 172.21.15.1:0/4031720049 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff42c0c6900 0x7ff42c0c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:18.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.760+0000 7ff42bfff700 1 --2- 172.21.15.1:0/4031720049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff42c0c6520 0x7ff42c1511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:18.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.760+0000 7ff430e5d700 1 -- 172.21.15.1:0/4031720049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff42c0c6520 msgr2=0x7ff42c1511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:18.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.760+0000 7ff430e5d700 1 --2- 172.21.15.1:0/4031720049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff42c0c6520 0x7ff42c1511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.760+0000 7ff430e5d700 1 -- 172.21.15.1:0/4031720049 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff42c0c6900 msgr2=0x7ff42c0c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.760+0000 7ff430e5d700 1 --2- 172.21.15.1:0/4031720049 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff42c0c6900 0x7ff42c0c2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.760+0000 7ff430e5d700 1 -- 172.21.15.1:0/4031720049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff420009370 con 0x7ff42c0c97b0 2023-11-15T01:22:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.760+0000 7ff430e5d700 1 --2- 172.21.15.1:0/4031720049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c0c97b0 0x7ff42c14d730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7ff424007f20 tx=0x7ff424009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.760+0000 7ff413fff700 1 -- 172.21.15.1:0/4031720049 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42400eb90 con 0x7ff42c0c97b0 2023-11-15T01:22:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.760+0000 7ff413fff700 1 -- 172.21.15.1:0/4031720049 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42400ecf0 con 0x7ff42c0c97b0 2023-11-15T01:22:18.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.760+0000 7ff413fff700 1 -- 172.21.15.1:0/4031720049 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424014610 con 0x7ff42c0c97b0 2023-11-15T01:22:18.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.760+0000 7ff4328c0700 1 -- 172.21.15.1:0/4031720049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42c0c4f90 con 0x7ff42c0c97b0 2023-11-15T01:22:18.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.760+0000 7ff4328c0700 1 -- 172.21.15.1:0/4031720049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42c0c4910 con 0x7ff42c0c97b0 2023-11-15T01:22:18.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.761+0000 7ff4328c0700 1 -- 172.21.15.1:0/4031720049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42c0ab240 con 0x7ff42c0c97b0 2023-11-15T01:22:18.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.761+0000 7ff413fff700 1 -- 172.21.15.1:0/4031720049 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff424014980 con 0x7ff42c0c97b0 2023-11-15T01:22:18.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.762+0000 7ff413fff700 1 --2- 172.21.15.1:0/4031720049 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff41805f150 0x7ff418061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:18.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.762+0000 7ff413fff700 1 -- 172.21.15.1:0/4031720049 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff42407a290 con 0x7ff42c0c97b0 2023-11-15T01:22:18.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.762+0000 7ff42bfff700 1 --2- 172.21.15.1:0/4031720049 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff41805f150 0x7ff418061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:18.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.762+0000 7ff42bfff700 1 --2- 172.21.15.1:0/4031720049 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff41805f150 0x7ff418061610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7ff41c00bba0 tx=0x7ff41c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:18.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:18.766+0000 7ff413fff700 1 -- 172.21.15.1:0/4031720049 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff42c0ab240 con 0x7ff42c0c97b0 2023-11-15T01:22:19.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.013+0000 7ff4328c0700 1 -- 172.21.15.1:0/4031720049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff42c0ab240 con 0x7ff42c0c97b0 2023-11-15T01:22:19.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.016+0000 7ff413fff700 1 -- 172.21.15.1:0/4031720049 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff42c0ab240 con 0x7ff42c0c97b0 2023-11-15T01:22:19.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.018+0000 7ff4328c0700 1 -- 172.21.15.1:0/4031720049 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff41805f150 msgr2=0x7ff418061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.018+0000 7ff4328c0700 1 --2- 172.21.15.1:0/4031720049 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff41805f150 0x7ff418061610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7ff41c00bba0 tx=0x7ff41c008040).stop 2023-11-15T01:22:19.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.018+0000 7ff4328c0700 1 -- 172.21.15.1:0/4031720049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c0c97b0 msgr2=0x7ff42c14d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.018+0000 7ff4328c0700 1 --2- 172.21.15.1:0/4031720049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c0c97b0 0x7ff42c14d730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7ff424007f20 tx=0x7ff424009860).stop 2023-11-15T01:22:19.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.018+0000 7ff4328c0700 1 -- 172.21.15.1:0/4031720049 shutdown_connections 2023-11-15T01:22:19.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.018+0000 7ff4328c0700 1 --2- 172.21.15.1:0/4031720049 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff41805f150 0x7ff418061610 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.018+0000 7ff4328c0700 1 --2- 172.21.15.1:0/4031720049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c0c97b0 0x7ff42c14d730 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.018+0000 7ff4328c0700 1 --2- 172.21.15.1:0/4031720049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff42c0c6520 0x7ff42c1511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.018+0000 7ff4328c0700 1 --2- 172.21.15.1:0/4031720049 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff42c0c6900 0x7ff42c0c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.018+0000 7ff4328c0700 1 -- 172.21.15.1:0/4031720049 >> 172.21.15.1:0/4031720049 conn(0x7ff42c0cb060 msgr2=0x7ff42c0c0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:19.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.018+0000 7ff4328c0700 1 -- 172.21.15.1:0/4031720049 shutdown_connections 2023-11-15T01:22:19.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.018+0000 7ff4328c0700 1 -- 172.21.15.1:0/4031720049 wait complete. 2023-11-15T01:22:19.022 INFO:teuthology.orchestra.run.smithi001.stderr:updated 2023-11-15T01:22:19.031 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-15T01:22:19.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.149+0000 7f48797cb700 1 Processor -- start 2023-11-15T01:22:19.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.149+0000 7f48797cb700 1 -- start start 2023-11-15T01:22:19.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.150+0000 7f48797cb700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f48740be390 0x7f48740bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.150+0000 7f48797cb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48740bd8f0 0x7f4874154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.150+0000 7f48797cb700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48740ad5e0 con 0x7f48740bdfb0 2023-11-15T01:22:19.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.150+0000 7f48797cb700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48740bccd0 con 0x7f48740be390 2023-11-15T01:22:19.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.150+0000 7f48797cb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48740ad8c0 con 0x7f48740bd8f0 2023-11-15T01:22:19.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.150+0000 7f4872ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f48740bdfb0 0x7f48740c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49084/0 (socket says 172.21.15.1:49084) 2023-11-15T01:22:19.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.150+0000 7f4872ffd700 1 -- 172.21.15.1:0/3394228947 learned_addr learned my addr 172.21.15.1:0/3394228947 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:19.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f48737fe700 1 --2- 172.21.15.1:0/3394228947 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48740bd8f0 0x7f4874154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f48727fc700 1 --2- 172.21.15.1:0/3394228947 >> v2:172.21.15.141:3300/0 conn(0x7f48740be390 0x7f48740bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 -- 172.21.15.1:0/3394228947 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255625037 0 0) 0x7f48740ad5e0 con 0x7f48740bdfb0 2023-11-15T01:22:19.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 -- 172.21.15.1:0/3394228947 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48600033f0 con 0x7f48740bdfb0 2023-11-15T01:22:19.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 -- 172.21.15.1:0/3394228947 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3304207891 0 0) 0x7f48600033f0 con 0x7f48740bdfb0 2023-11-15T01:22:19.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 -- 172.21.15.1:0/3394228947 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48740bd8f0 msgr2=0x7f4874154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:19.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 --2- 172.21.15.1:0/3394228947 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48740bd8f0 0x7f4874154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 -- 172.21.15.1:0/3394228947 >> v2:172.21.15.141:3300/0 conn(0x7f48740be390 msgr2=0x7f48740bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:19.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 --2- 172.21.15.1:0/3394228947 >> v2:172.21.15.141:3300/0 conn(0x7f48740be390 0x7f48740bd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 -- 172.21.15.1:0/3394228947 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48740adba0 con 0x7f48740bdfb0 2023-11-15T01:22:19.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 -- 172.21.15.1:0/3394228947 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f486c001470 con 0x7f48740bdfb0 2023-11-15T01:22:19.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f48727fc700 1 --2- 172.21.15.1:0/3394228947 >> v2:172.21.15.141:3300/0 conn(0x7f48740be390 0x7f48740bd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:19.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 -- 172.21.15.1:0/3394228947 >> v1:172.21.15.1:6789/0 conn(0x7f48740bdfb0 legacy=0x7f48740c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 --2- 172.21.15.1:0/3394228947 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48600038e0 0x7f4860003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 --2- 172.21.15.1:0/3394228947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4860004690 0x7f4860004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 --2- 172.21.15.1:0/3394228947 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48740bd8f0 0x7f4860005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 -- 172.21.15.1:0/3394228947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48740bccd0 con 0x7f4860004690 2023-11-15T01:22:19.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 -- 172.21.15.1:0/3394228947 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48740ad8c0 con 0x7f48600038e0 2023-11-15T01:22:19.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4871ffb700 1 -- 172.21.15.1:0/3394228947 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486000b8e0 con 0x7f48740bd8f0 2023-11-15T01:22:19.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f48727fc700 1 --2- 172.21.15.1:0/3394228947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4860004690 0x7f4860004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f4872ffd700 1 --2- 172.21.15.1:0/3394228947 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48600038e0 0x7f4860003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f48737fe700 1 --2- 172.21.15.1:0/3394228947 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48740bd8f0 0x7f4860005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f48727fc700 1 -- 172.21.15.1:0/3394228947 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48740bd8f0 msgr2=0x7f4860005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:19.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f48727fc700 1 --2- 172.21.15.1:0/3394228947 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48740bd8f0 0x7f4860005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f48727fc700 1 -- 172.21.15.1:0/3394228947 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48600038e0 msgr2=0x7f4860003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:19.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f48727fc700 1 --2- 172.21.15.1:0/3394228947 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48600038e0 0x7f4860003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.151+0000 7f48727fc700 1 -- 172.21.15.1:0/3394228947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600033f0 con 0x7f4860004690 2023-11-15T01:22:19.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.152+0000 7f48727fc700 1 --2- 172.21.15.1:0/3394228947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4860004690 0x7f4860004b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f485c009c70 tx=0x7f485c009060).ready entity=mon.0 client_cookie=a5ac28b97c9d6940 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:19.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.152+0000 7f4871ffb700 1 -- 172.21.15.1:0/3394228947 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c0095c0 con 0x7f4860004690 2023-11-15T01:22:19.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.152+0000 7f4871ffb700 1 -- 172.21.15.1:0/3394228947 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c00e6f0 con 0x7f4860004690 2023-11-15T01:22:19.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.152+0000 7f4871ffb700 1 -- 172.21.15.1:0/3394228947 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c00ea70 con 0x7f4860004690 2023-11-15T01:22:19.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.152+0000 7f48797cb700 1 -- 172.21.15.1:0/3394228947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4860004690 msgr2=0x7f4860004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.152+0000 7f48797cb700 1 --2- 172.21.15.1:0/3394228947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4860004690 0x7f4860004b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f485c009c70 tx=0x7f485c009060).stop 2023-11-15T01:22:19.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.152+0000 7f48737fe700 1 -- 172.21.15.1:0/3394228947 reap_dead start 2023-11-15T01:22:19.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.152+0000 7f48797cb700 1 -- 172.21.15.1:0/3394228947 shutdown_connections 2023-11-15T01:22:19.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.152+0000 7f48797cb700 1 -- 172.21.15.1:0/3394228947 >> 172.21.15.1:0/3394228947 conn(0x7f48740c7d70 msgr2=0x7f48740c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:19.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.152+0000 7f48797cb700 1 -- 172.21.15.1:0/3394228947 shutdown_connections 2023-11-15T01:22:19.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.152+0000 7f48797cb700 1 -- 172.21.15.1:0/3394228947 wait complete. 2023-11-15T01:22:19.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.153+0000 7f48797cb700 1 Processor -- start 2023-11-15T01:22:19.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.154+0000 7f48797cb700 1 -- start start 2023-11-15T01:22:19.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.154+0000 7f48797cb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4860004690 0x7f48740bee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.154+0000 7f48797cb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4874152cf0 0x7f487414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.154+0000 7f48797cb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48740ac600 0x7f48740aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.154+0000 7f48797cb700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48740a8030 con 0x7f4874152cf0 2023-11-15T01:22:19.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.154+0000 7f48797cb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48740bfc70 con 0x7f48740ac600 2023-11-15T01:22:19.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.154+0000 7f48797cb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48740acf50 con 0x7f4860004690 2023-11-15T01:22:19.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.154+0000 7f48727fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4874152cf0 0x7f487414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.154+0000 7f48727fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4874152cf0 0x7f487414bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44006/0 (socket says 172.21.15.1:44006) 2023-11-15T01:22:19.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.154+0000 7f48727fc700 1 -- 172.21.15.1:0/1372895815 learned_addr learned my addr 172.21.15.1:0/1372895815 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:19.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.155+0000 7f4872ffd700 1 --2- 172.21.15.1:0/1372895815 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4860004690 0x7f48740bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.155+0000 7f48737fe700 1 --2- 172.21.15.1:0/1372895815 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48740ac600 0x7f48740aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.155+0000 7f48727fc700 1 -- 172.21.15.1:0/1372895815 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4860004690 msgr2=0x7f48740bee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.155+0000 7f48727fc700 1 --2- 172.21.15.1:0/1372895815 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4860004690 0x7f48740bee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.155+0000 7f48727fc700 1 -- 172.21.15.1:0/1372895815 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48740ac600 msgr2=0x7f48740aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.155+0000 7f48727fc700 1 --2- 172.21.15.1:0/1372895815 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48740ac600 0x7f48740aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.155+0000 7f48727fc700 1 -- 172.21.15.1:0/1372895815 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4874152700 con 0x7f4874152cf0 2023-11-15T01:22:19.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.155+0000 7f48727fc700 1 --2- 172.21.15.1:0/1372895815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4874152cf0 0x7f487414bab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f485c00e4b0 tx=0x7f485c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:19.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.155+0000 7f486affd700 1 -- 172.21.15.1:0/1372895815 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c020070 con 0x7f4874152cf0 2023-11-15T01:22:19.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.155+0000 7f486affd700 1 -- 172.21.15.1:0/1372895815 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c000bc0 con 0x7f4874152cf0 2023-11-15T01:22:19.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.155+0000 7f48797cb700 1 -- 172.21.15.1:0/1372895815 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48740bf3d0 con 0x7f4874152cf0 2023-11-15T01:22:19.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.155+0000 7f486affd700 1 -- 172.21.15.1:0/1372895815 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c00eab0 con 0x7f4874152cf0 2023-11-15T01:22:19.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.155+0000 7f48797cb700 1 -- 172.21.15.1:0/1372895815 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48740bf990 con 0x7f4874152cf0 2023-11-15T01:22:19.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.156+0000 7f48797cb700 1 -- 172.21.15.1:0/1372895815 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48740a85d0 con 0x7f4874152cf0 2023-11-15T01:22:19.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.156+0000 7f486affd700 1 -- 172.21.15.1:0/1372895815 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f485c024620 con 0x7f4874152cf0 2023-11-15T01:22:19.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.156+0000 7f486affd700 1 --2- 172.21.15.1:0/1372895815 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f485405f150 0x7f4854061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.157+0000 7f486affd700 1 -- 172.21.15.1:0/1372895815 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f485c07b240 con 0x7f4874152cf0 2023-11-15T01:22:19.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.157+0000 7f4872ffd700 1 --2- 172.21.15.1:0/1372895815 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f485405f150 0x7f4854061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.157+0000 7f4872ffd700 1 --2- 172.21.15.1:0/1372895815 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f485405f150 0x7f4854061610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f486c001d20 tx=0x7f486c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:19.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.161+0000 7f486affd700 1 -- 172.21.15.1:0/1372895815 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f485c04c950 con 0x7f4874152cf0 2023-11-15T01:22:19.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.401+0000 7f48797cb700 1 -- 172.21.15.1:0/1372895815 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f487406c7e0 con 0x7f4874152cf0 2023-11-15T01:22:19.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.405+0000 7f486affd700 1 -- 172.21.15.1:0/1372895815 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f485c029020 con 0x7f4874152cf0 2023-11-15T01:22:19.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.406+0000 7f48797cb700 1 -- 172.21.15.1:0/1372895815 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f485405f150 msgr2=0x7f4854061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.406+0000 7f48797cb700 1 --2- 172.21.15.1:0/1372895815 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f485405f150 0x7f4854061610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f486c001d20 tx=0x7f486c009040).stop 2023-11-15T01:22:19.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.406+0000 7f48797cb700 1 -- 172.21.15.1:0/1372895815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4874152cf0 msgr2=0x7f487414bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.406+0000 7f48797cb700 1 --2- 172.21.15.1:0/1372895815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4874152cf0 0x7f487414bab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f485c00e4b0 tx=0x7f485c01a000).stop 2023-11-15T01:22:19.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.406+0000 7f48797cb700 1 -- 172.21.15.1:0/1372895815 shutdown_connections 2023-11-15T01:22:19.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.406+0000 7f48797cb700 1 --2- 172.21.15.1:0/1372895815 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f485405f150 0x7f4854061610 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.406+0000 7f48797cb700 1 --2- 172.21.15.1:0/1372895815 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48740ac600 0x7f48740aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.406+0000 7f48797cb700 1 --2- 172.21.15.1:0/1372895815 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4860004690 0x7f48740bee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.406+0000 7f48797cb700 1 --2- 172.21.15.1:0/1372895815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4874152cf0 0x7f487414bab0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.406+0000 7f48797cb700 1 -- 172.21.15.1:0/1372895815 >> 172.21.15.1:0/1372895815 conn(0x7f48740c7d70 msgr2=0x7f487414e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:19.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.406+0000 7f48797cb700 1 -- 172.21.15.1:0/1372895815 shutdown_connections 2023-11-15T01:22:19.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.407+0000 7f48797cb700 1 -- 172.21.15.1:0/1372895815 wait complete. 2023-11-15T01:22:19.411 INFO:teuthology.orchestra.run.smithi001.stderr:updated 2023-11-15T01:22:19.420 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-15T01:22:19.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.537+0000 7fe91877c700 1 Processor -- start 2023-11-15T01:22:19.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.537+0000 7fe91877c700 1 -- start start 2023-11-15T01:22:19.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.538+0000 7fe91877c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe9100ab1a0 0x7fe910154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.538+0000 7fe91877c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe9100aa060 0x7fe9100c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.538+0000 7fe91877c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9100c06f0 con 0x7fe910154150 2023-11-15T01:22:19.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.538+0000 7fe91877c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9100c09d0 con 0x7fe9100aa060 2023-11-15T01:22:19.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.538+0000 7fe91877c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe910158820 con 0x7fe9100ab1a0 2023-11-15T01:22:19.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.538+0000 7fe916d19700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe9100aa060 0x7fe9100c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.539+0000 7fe916d19700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe9100aa060 0x7fe9100c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44018/0 (socket says 172.21.15.1:44018) 2023-11-15T01:22:19.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.539+0000 7fe916d19700 1 -- 172.21.15.1:0/1602463883 learned_addr learned my addr 172.21.15.1:0/1602463883 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:19.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.539+0000 7fe915d17700 1 --2- 172.21.15.1:0/1602463883 >> v2:172.21.15.141:3300/0 conn(0x7fe9100ab1a0 0x7fe910154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.539+0000 7fe916d19700 1 -- 172.21.15.1:0/1602463883 >> v2:172.21.15.141:3300/0 conn(0x7fe9100ab1a0 msgr2=0x7fe910154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:19.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.539+0000 7fe916d19700 1 --2- 172.21.15.1:0/1602463883 >> v2:172.21.15.141:3300/0 conn(0x7fe9100ab1a0 0x7fe910154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.539+0000 7fe916d19700 1 -- 172.21.15.1:0/1602463883 >> v1:172.21.15.141:6789/0 conn(0x7fe910154150 legacy=0x7fe910158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:19.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.539+0000 7fe916d19700 1 -- 172.21.15.1:0/1602463883 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910158b00 con 0x7fe9100aa060 2023-11-15T01:22:19.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.539+0000 7fe915d17700 1 --2- 172.21.15.1:0/1602463883 >> v2:172.21.15.141:3300/0 conn(0x7fe9100ab1a0 0x7fe910154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:19.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.539+0000 7fe916d19700 1 --2- 172.21.15.1:0/1602463883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9100aa060 0x7fe9100c5f10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fe910158750 tx=0x7fe900009840).ready entity=mon.0 client_cookie=143092f931407efc server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:19.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.539+0000 7fe915516700 1 -- 172.21.15.1:0/1602463883 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90000e070 con 0x7fe9100aa060 2023-11-15T01:22:19.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.539+0000 7fe915516700 1 -- 172.21.15.1:0/1602463883 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90000ba10 con 0x7fe9100aa060 2023-11-15T01:22:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.539+0000 7fe915516700 1 -- 172.21.15.1:0/1602463883 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90000bd90 con 0x7fe9100aa060 2023-11-15T01:22:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.540+0000 7fe91877c700 1 -- 172.21.15.1:0/1602463883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9100aa060 msgr2=0x7fe9100c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.540+0000 7fe91877c700 1 --2- 172.21.15.1:0/1602463883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9100aa060 0x7fe9100c5f10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fe910158750 tx=0x7fe900009840).stop 2023-11-15T01:22:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.540+0000 7fe91877c700 1 -- 172.21.15.1:0/1602463883 shutdown_connections 2023-11-15T01:22:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.540+0000 7fe91877c700 1 --2- 172.21.15.1:0/1602463883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9100aa060 0x7fe9100c5f10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.540+0000 7fe91877c700 1 --2- 172.21.15.1:0/1602463883 >> v2:172.21.15.141:3300/0 conn(0x7fe9100ab1a0 0x7fe910154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.540+0000 7fe91877c700 1 -- 172.21.15.1:0/1602463883 >> 172.21.15.1:0/1602463883 conn(0x7fe910064aa0 msgr2=0x7fe910064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:19.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.540+0000 7fe91877c700 1 -- 172.21.15.1:0/1602463883 shutdown_connections 2023-11-15T01:22:19.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.540+0000 7fe91877c700 1 -- 172.21.15.1:0/1602463883 wait complete. 2023-11-15T01:22:19.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.541+0000 7fe91877c700 1 Processor -- start 2023-11-15T01:22:19.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.541+0000 7fe91877c700 1 -- start start 2023-11-15T01:22:19.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe91877c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9100aa060 0x7fe9100c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe91877c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9100ab1a0 0x7fe91014cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe91877c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe910154150 0x7fe9100aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe91877c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100c4be0 con 0x7fe9100ab1a0 2023-11-15T01:22:19.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe91877c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100b0100 con 0x7fe9100aa060 2023-11-15T01:22:19.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe91877c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91014d240 con 0x7fe910154150 2023-11-15T01:22:19.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe915d17700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9100ab1a0 0x7fe91014cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe915d17700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9100ab1a0 0x7fe91014cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44020/0 (socket says 172.21.15.1:44020) 2023-11-15T01:22:19.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe915d17700 1 -- 172.21.15.1:0/2333213280 learned_addr learned my addr 172.21.15.1:0/2333213280 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:19.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe916d19700 1 --2- 172.21.15.1:0/2333213280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe910154150 0x7fe9100aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe916518700 1 --2- 172.21.15.1:0/2333213280 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9100aa060 0x7fe9100c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe915d17700 1 -- 172.21.15.1:0/2333213280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe910154150 msgr2=0x7fe9100aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe915d17700 1 --2- 172.21.15.1:0/2333213280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe910154150 0x7fe9100aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe915d17700 1 -- 172.21.15.1:0/2333213280 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9100aa060 msgr2=0x7fe9100c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe915d17700 1 --2- 172.21.15.1:0/2333213280 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9100aa060 0x7fe9100c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe915d17700 1 -- 172.21.15.1:0/2333213280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900009ae0 con 0x7fe9100ab1a0 2023-11-15T01:22:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe916518700 1 --2- 172.21.15.1:0/2333213280 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9100aa060 0x7fe9100c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe915d17700 1 --2- 172.21.15.1:0/2333213280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9100ab1a0 0x7fe91014cd50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fe90400c8b0 tx=0x7fe904008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe90e7fc700 1 -- 172.21.15.1:0/2333213280 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904010580 con 0x7fe9100ab1a0 2023-11-15T01:22:19.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe90e7fc700 1 -- 172.21.15.1:0/2333213280 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9040106e0 con 0x7fe9100ab1a0 2023-11-15T01:22:19.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe91877c700 1 -- 172.21.15.1:0/2333213280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9100af4f0 con 0x7fe9100ab1a0 2023-11-15T01:22:19.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe90e7fc700 1 -- 172.21.15.1:0/2333213280 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904010a60 con 0x7fe9100ab1a0 2023-11-15T01:22:19.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.542+0000 7fe91877c700 1 -- 172.21.15.1:0/2333213280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9100afab0 con 0x7fe9100ab1a0 2023-11-15T01:22:19.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.543+0000 7fe91877c700 1 -- 172.21.15.1:0/2333213280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe910154ab0 con 0x7fe9100ab1a0 2023-11-15T01:22:19.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.544+0000 7fe90e7fc700 1 -- 172.21.15.1:0/2333213280 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe90401b460 con 0x7fe9100ab1a0 2023-11-15T01:22:19.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.544+0000 7fe90e7fc700 1 --2- 172.21.15.1:0/2333213280 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe8fc05f150 0x7fe8fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.544+0000 7fe90e7fc700 1 -- 172.21.15.1:0/2333213280 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe904079db0 con 0x7fe9100ab1a0 2023-11-15T01:22:19.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.544+0000 7fe916518700 1 --2- 172.21.15.1:0/2333213280 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe8fc05f150 0x7fe8fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.545+0000 7fe916518700 1 --2- 172.21.15.1:0/2333213280 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe8fc05f150 0x7fe8fc061610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fe90800b8b0 tx=0x7fe908008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:19.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.548+0000 7fe90e7fc700 1 -- 172.21.15.1:0/2333213280 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe910154ab0 con 0x7fe9100ab1a0 2023-11-15T01:22:19.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.786+0000 7fe91877c700 1 -- 172.21.15.1:0/2333213280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fe910154ab0 con 0x7fe9100ab1a0 2023-11-15T01:22:19.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.789+0000 7fe90e7fc700 1 -- 172.21.15.1:0/2333213280 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe910154ab0 con 0x7fe9100ab1a0 2023-11-15T01:22:19.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.791+0000 7fe91877c700 1 -- 172.21.15.1:0/2333213280 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe8fc05f150 msgr2=0x7fe8fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.791+0000 7fe91877c700 1 --2- 172.21.15.1:0/2333213280 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe8fc05f150 0x7fe8fc061610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fe90800b8b0 tx=0x7fe908008040).stop 2023-11-15T01:22:19.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.791+0000 7fe91877c700 1 -- 172.21.15.1:0/2333213280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9100ab1a0 msgr2=0x7fe91014cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.791+0000 7fe91877c700 1 --2- 172.21.15.1:0/2333213280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9100ab1a0 0x7fe91014cd50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fe90400c8b0 tx=0x7fe904008040).stop 2023-11-15T01:22:19.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.791+0000 7fe91877c700 1 -- 172.21.15.1:0/2333213280 shutdown_connections 2023-11-15T01:22:19.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.791+0000 7fe91877c700 1 --2- 172.21.15.1:0/2333213280 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe8fc05f150 0x7fe8fc061610 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.791+0000 7fe91877c700 1 --2- 172.21.15.1:0/2333213280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe910154150 0x7fe9100aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.791+0000 7fe91877c700 1 --2- 172.21.15.1:0/2333213280 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9100aa060 0x7fe9100c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.792+0000 7fe91877c700 1 --2- 172.21.15.1:0/2333213280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9100ab1a0 0x7fe91014cd50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.792+0000 7fe91877c700 1 -- 172.21.15.1:0/2333213280 >> 172.21.15.1:0/2333213280 conn(0x7fe910064aa0 msgr2=0x7fe9100c90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:19.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.792+0000 7fe91877c700 1 -- 172.21.15.1:0/2333213280 shutdown_connections 2023-11-15T01:22:19.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.792+0000 7fe91877c700 1 -- 172.21.15.1:0/2333213280 wait complete. 2023-11-15T01:22:19.796 INFO:teuthology.orchestra.run.smithi001.stderr:updated 2023-11-15T01:22:19.805 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:22:19.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.923+0000 7f4421d43700 1 Processor -- start 2023-11-15T01:22:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.923+0000 7f4421d43700 1 -- start start 2023-11-15T01:22:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.923+0000 7f4421d43700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f441c155790 0x7f441c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.923+0000 7f4421d43700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f441c155b70 0x7f441c0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.923+0000 7f4421d43700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f441c0a61b0 0x7f441c0c8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.923+0000 7f4421d43700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c0c5420 con 0x7f441c155790 2023-11-15T01:22:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.923+0000 7f4421d43700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c083630 con 0x7f441c155b70 2023-11-15T01:22:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.923+0000 7f4421d43700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0c7c90 con 0x7f441c0a61b0 2023-11-15T01:22:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.924+0000 7f441b7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f441c155790 0x7f441c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.924+0000 7f441b7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f441c155790 0x7f441c0a5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44022/0 (socket says 172.21.15.1:44022) 2023-11-15T01:22:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.924+0000 7f441b7fe700 1 -- 172.21.15.1:0/3387847316 learned_addr learned my addr 172.21.15.1:0/3387847316 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.924+0000 7f441affd700 1 --2- 172.21.15.1:0/3387847316 >> v2:172.21.15.141:3300/0 conn(0x7f441c155b70 0x7f441c0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.924+0000 7f441bfff700 1 --2- 172.21.15.1:0/3387847316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f441c0a61b0 0x7f441c0c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.924+0000 7f441b7fe700 1 -- 172.21.15.1:0/3387847316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f441c0a61b0 msgr2=0x7f441c0c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.924+0000 7f441b7fe700 1 --2- 172.21.15.1:0/3387847316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f441c0a61b0 0x7f441c0c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.924+0000 7f441b7fe700 1 -- 172.21.15.1:0/3387847316 >> v2:172.21.15.141:3300/0 conn(0x7f441c155b70 msgr2=0x7f441c0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.924+0000 7f441b7fe700 1 --2- 172.21.15.1:0/3387847316 >> v2:172.21.15.141:3300/0 conn(0x7f441c155b70 0x7f441c0c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.924+0000 7f441b7fe700 1 -- 172.21.15.1:0/3387847316 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c0c8b00 con 0x7f441c155790 2023-11-15T01:22:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.924+0000 7f441b7fe700 1 --2- 172.21.15.1:0/3387847316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f441c155790 0x7f441c0a5cc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f441c06a7f0 tx=0x7f440c009060).ready entity=mon.0 client_cookie=65d59cf73f137519 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.924+0000 7f441a7fc700 1 -- 172.21.15.1:0/3387847316 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c005880 con 0x7f441c155790 2023-11-15T01:22:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.924+0000 7f441a7fc700 1 -- 172.21.15.1:0/3387847316 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c0059e0 con 0x7f441c155790 2023-11-15T01:22:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.924+0000 7f441a7fc700 1 -- 172.21.15.1:0/3387847316 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c005d60 con 0x7f441c155790 2023-11-15T01:22:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.925+0000 7f4421d43700 1 -- 172.21.15.1:0/3387847316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f441c155790 msgr2=0x7f441c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.925+0000 7f4421d43700 1 --2- 172.21.15.1:0/3387847316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f441c155790 0x7f441c0a5cc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f441c06a7f0 tx=0x7f440c009060).stop 2023-11-15T01:22:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.925+0000 7f4421d43700 1 -- 172.21.15.1:0/3387847316 shutdown_connections 2023-11-15T01:22:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.925+0000 7f4421d43700 1 --2- 172.21.15.1:0/3387847316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f441c155790 0x7f441c0a5cc0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.925+0000 7f4421d43700 1 --2- 172.21.15.1:0/3387847316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f441c0a61b0 0x7f441c0c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.925+0000 7f4421d43700 1 --2- 172.21.15.1:0/3387847316 >> v2:172.21.15.141:3300/0 conn(0x7f441c155b70 0x7f441c0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.925+0000 7f4421d43700 1 -- 172.21.15.1:0/3387847316 >> 172.21.15.1:0/3387847316 conn(0x7f441c082f90 msgr2=0x7f441c0c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.925+0000 7f4421d43700 1 -- 172.21.15.1:0/3387847316 shutdown_connections 2023-11-15T01:22:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.925+0000 7f4421d43700 1 -- 172.21.15.1:0/3387847316 wait complete. 2023-11-15T01:22:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.926+0000 7f4421d43700 1 Processor -- start 2023-11-15T01:22:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.926+0000 7f4421d43700 1 -- start start 2023-11-15T01:22:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f4421d43700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f441c0a61b0 0x7f441c165390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f4421d43700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f441c155790 0x7f441c1394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f4421d43700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f441c155b70 0x7f441c1399a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f4421d43700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0adae0 con 0x7f441c155790 2023-11-15T01:22:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f4421d43700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0aced0 con 0x7f441c155b70 2023-11-15T01:22:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f4421d43700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0ad1b0 con 0x7f441c0a61b0 2023-11-15T01:22:19.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f441affd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f441c155790 0x7f441c1394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f441affd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f441c155790 0x7f441c1394b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44028/0 (socket says 172.21.15.1:44028) 2023-11-15T01:22:19.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f441affd700 1 -- 172.21.15.1:0/985936957 learned_addr learned my addr 172.21.15.1:0/985936957 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:19.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f441bfff700 1 --2- 172.21.15.1:0/985936957 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f441c155b70 0x7f441c1399a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f441b7fe700 1 --2- 172.21.15.1:0/985936957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f441c0a61b0 0x7f441c165390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f441affd700 1 -- 172.21.15.1:0/985936957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f441c0a61b0 msgr2=0x7f441c165390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f441affd700 1 --2- 172.21.15.1:0/985936957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f441c0a61b0 0x7f441c165390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f441affd700 1 -- 172.21.15.1:0/985936957 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f441c155b70 msgr2=0x7f441c1399a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:19.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f441affd700 1 --2- 172.21.15.1:0/985936957 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f441c155b70 0x7f441c1399a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:19.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f441affd700 1 -- 172.21.15.1:0/985936957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c009300 con 0x7f441c155790 2023-11-15T01:22:19.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.927+0000 7f441affd700 1 --2- 172.21.15.1:0/985936957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f441c155790 0x7f441c1394b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f441000e190 tx=0x7f4410009920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:19.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.928+0000 7f44037fe700 1 -- 172.21.15.1:0/985936957 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441000ecd0 con 0x7f441c155790 2023-11-15T01:22:19.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.928+0000 7f44037fe700 1 -- 172.21.15.1:0/985936957 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441000ee30 con 0x7f441c155790 2023-11-15T01:22:19.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.928+0000 7f44037fe700 1 -- 172.21.15.1:0/985936957 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410014610 con 0x7f441c155790 2023-11-15T01:22:19.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.928+0000 7f4421d43700 1 -- 172.21.15.1:0/985936957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c0ad490 con 0x7f441c155790 2023-11-15T01:22:19.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.928+0000 7f4421d43700 1 -- 172.21.15.1:0/985936957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c14cc30 con 0x7f441c155790 2023-11-15T01:22:19.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.929+0000 7f4421d43700 1 -- 172.21.15.1:0/985936957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441c0adc90 con 0x7f441c155790 2023-11-15T01:22:19.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.929+0000 7f44037fe700 1 -- 172.21.15.1:0/985936957 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f441001d3b0 con 0x7f441c155790 2023-11-15T01:22:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.929+0000 7f44037fe700 1 --2- 172.21.15.1:0/985936957 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f440805f150 0x7f4408061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.929+0000 7f44037fe700 1 -- 172.21.15.1:0/985936957 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f441007a1e0 con 0x7f441c155790 2023-11-15T01:22:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.930+0000 7f441b7fe700 1 --2- 172.21.15.1:0/985936957 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f440805f150 0x7f4408061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.930+0000 7f441b7fe700 1 --2- 172.21.15.1:0/985936957 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f440805f150 0x7f4408061610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f441c0aeb30 tx=0x7f440c016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:19.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:19.934+0000 7f44037fe700 1 -- 172.21.15.1:0/985936957 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f441c0adc90 con 0x7f441c155790 2023-11-15T01:22:20.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.107+0000 7f4421d43700 1 -- 172.21.15.1:0/985936957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f441c06c7e0 con 0x7f441c155790 2023-11-15T01:22:20.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.108+0000 7f44037fe700 1 -- 172.21.15.1:0/985936957 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13664 (secure 0 0 0) 0x7f441004b7a0 con 0x7f441c155790 2023-11-15T01:22:20.110 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:20.110 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":30,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:22:17.021508+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:22:20.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.110+0000 7f4421d43700 1 -- 172.21.15.1:0/985936957 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f440805f150 msgr2=0x7f4408061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.110+0000 7f4421d43700 1 --2- 172.21.15.1:0/985936957 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f440805f150 0x7f4408061610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f441c0aeb30 tx=0x7f440c016000).stop 2023-11-15T01:22:20.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.110+0000 7f4421d43700 1 -- 172.21.15.1:0/985936957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f441c155790 msgr2=0x7f441c1394b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.110+0000 7f4421d43700 1 --2- 172.21.15.1:0/985936957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f441c155790 0x7f441c1394b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f441000e190 tx=0x7f4410009920).stop 2023-11-15T01:22:20.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.110+0000 7f4421d43700 1 -- 172.21.15.1:0/985936957 shutdown_connections 2023-11-15T01:22:20.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.110+0000 7f4421d43700 1 --2- 172.21.15.1:0/985936957 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f440805f150 0x7f4408061610 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.110+0000 7f4421d43700 1 --2- 172.21.15.1:0/985936957 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f441c155b70 0x7f441c1399a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.110+0000 7f4421d43700 1 --2- 172.21.15.1:0/985936957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f441c0a61b0 0x7f441c165390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.110+0000 7f4421d43700 1 --2- 172.21.15.1:0/985936957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f441c155790 0x7f441c1394b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.110+0000 7f4421d43700 1 -- 172.21.15.1:0/985936957 >> 172.21.15.1:0/985936957 conn(0x7f441c082f90 msgr2=0x7f441c0bde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:20.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.110+0000 7f4421d43700 1 -- 172.21.15.1:0/985936957 shutdown_connections 2023-11-15T01:22:20.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.110+0000 7f4421d43700 1 -- 172.21.15.1:0/985936957 wait complete. 2023-11-15T01:22:20.124 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-15T01:22:20.125 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:22:20.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.244+0000 7efe480a0700 1 Processor -- start 2023-11-15T01:22:20.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.244+0000 7efe480a0700 1 -- start start 2023-11-15T01:22:20.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.245+0000 7efe480a0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efe40062ec0 0x7efe4014eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.245+0000 7efe480a0700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efe40155370 0x7efe400c6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.245+0000 7efe480a0700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe40158e40 con 0x7efe4014e6e0 2023-11-15T01:22:20.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.245+0000 7efe480a0700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe40158230 con 0x7efe40062ec0 2023-11-15T01:22:20.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.245+0000 7efe480a0700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe40158510 con 0x7efe40155370 2023-11-15T01:22:20.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.245+0000 7efe4563b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efe40062ec0 0x7efe4014eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.245+0000 7efe4563b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efe40062ec0 0x7efe4014eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44038/0 (socket says 172.21.15.1:44038) 2023-11-15T01:22:20.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.245+0000 7efe4563b700 1 -- 172.21.15.1:0/3021201120 learned_addr learned my addr 172.21.15.1:0/3021201120 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:20.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.245+0000 7efe4663d700 1 --2- 172.21.15.1:0/3021201120 >> v2:172.21.15.141:3300/0 conn(0x7efe40155370 0x7efe400c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.246+0000 7efe4563b700 1 -- 172.21.15.1:0/3021201120 >> v2:172.21.15.141:3300/0 conn(0x7efe40155370 msgr2=0x7efe400c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:20.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.246+0000 7efe4563b700 1 --2- 172.21.15.1:0/3021201120 >> v2:172.21.15.141:3300/0 conn(0x7efe40155370 0x7efe400c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.246+0000 7efe4563b700 1 -- 172.21.15.1:0/3021201120 >> v1:172.21.15.141:6789/0 conn(0x7efe4014e6e0 legacy=0x7efe400627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:20.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.246+0000 7efe4563b700 1 -- 172.21.15.1:0/3021201120 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe401587f0 con 0x7efe40062ec0 2023-11-15T01:22:20.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.246+0000 7efe4563b700 1 --2- 172.21.15.1:0/3021201120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe40062ec0 0x7efe4014eac0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7efe4014efb0 tx=0x7efe340090f0).ready entity=mon.0 client_cookie=e0e1892eea682bbf server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:20.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.246+0000 7efe44e3a700 1 -- 172.21.15.1:0/3021201120 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400b5a0 con 0x7efe40062ec0 2023-11-15T01:22:20.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.246+0000 7efe44e3a700 1 -- 172.21.15.1:0/3021201120 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3400b700 con 0x7efe40062ec0 2023-11-15T01:22:20.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.246+0000 7efe44e3a700 1 -- 172.21.15.1:0/3021201120 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400ba80 con 0x7efe40062ec0 2023-11-15T01:22:20.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.246+0000 7efe480a0700 1 -- 172.21.15.1:0/3021201120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe40062ec0 msgr2=0x7efe4014eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.246+0000 7efe480a0700 1 --2- 172.21.15.1:0/3021201120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe40062ec0 0x7efe4014eac0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7efe4014efb0 tx=0x7efe340090f0).stop 2023-11-15T01:22:20.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.246+0000 7efe480a0700 1 -- 172.21.15.1:0/3021201120 shutdown_connections 2023-11-15T01:22:20.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.246+0000 7efe480a0700 1 --2- 172.21.15.1:0/3021201120 >> v2:172.21.15.141:3300/0 conn(0x7efe40155370 0x7efe400c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.246+0000 7efe480a0700 1 --2- 172.21.15.1:0/3021201120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe40062ec0 0x7efe4014eac0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.246+0000 7efe480a0700 1 -- 172.21.15.1:0/3021201120 >> 172.21.15.1:0/3021201120 conn(0x7efe400c7dc0 msgr2=0x7efe400c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:20.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.246+0000 7efe480a0700 1 -- 172.21.15.1:0/3021201120 shutdown_connections 2023-11-15T01:22:20.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.247+0000 7efe480a0700 1 -- 172.21.15.1:0/3021201120 wait complete. 2023-11-15T01:22:20.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.248+0000 7efe480a0700 1 Processor -- start 2023-11-15T01:22:20.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.248+0000 7efe480a0700 1 -- start start 2023-11-15T01:22:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.248+0000 7efe480a0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe40062ec0 0x7efe4014d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.248+0000 7efe480a0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe4014e6e0 0x7efe40156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.248+0000 7efe480a0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe40155370 0x7efe40157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.248+0000 7efe480a0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe40157640 con 0x7efe4014e6e0 2023-11-15T01:22:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.248+0000 7efe480a0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe400c1ad0 con 0x7efe40062ec0 2023-11-15T01:22:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.248+0000 7efe480a0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe400c1f60 con 0x7efe40155370 2023-11-15T01:22:20.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.248+0000 7efe4563b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe4014e6e0 0x7efe40156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.248+0000 7efe4563b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe4014e6e0 0x7efe40156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44054/0 (socket says 172.21.15.1:44054) 2023-11-15T01:22:20.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.248+0000 7efe4563b700 1 -- 172.21.15.1:0/868352170 learned_addr learned my addr 172.21.15.1:0/868352170 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:20.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.249+0000 7efe4663d700 1 --2- 172.21.15.1:0/868352170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe40155370 0x7efe40157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.249+0000 7efe45e3c700 1 --2- 172.21.15.1:0/868352170 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe40062ec0 0x7efe4014d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.249+0000 7efe4563b700 1 -- 172.21.15.1:0/868352170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe40155370 msgr2=0x7efe40157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.249+0000 7efe4563b700 1 --2- 172.21.15.1:0/868352170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe40155370 0x7efe40157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.249+0000 7efe4563b700 1 -- 172.21.15.1:0/868352170 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe40062ec0 msgr2=0x7efe4014d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.249+0000 7efe4563b700 1 --2- 172.21.15.1:0/868352170 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe40062ec0 0x7efe4014d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.249+0000 7efe4563b700 1 -- 172.21.15.1:0/868352170 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe34009370 con 0x7efe4014e6e0 2023-11-15T01:22:20.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.249+0000 7efe4663d700 1 --2- 172.21.15.1:0/868352170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe40155370 0x7efe40157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:20.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.249+0000 7efe4563b700 1 --2- 172.21.15.1:0/868352170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe4014e6e0 0x7efe40156c60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7efe34009130 tx=0x7efe34015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:20.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.249+0000 7efe3dffb700 1 -- 172.21.15.1:0/868352170 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400b870 con 0x7efe4014e6e0 2023-11-15T01:22:20.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.249+0000 7efe3dffb700 1 -- 172.21.15.1:0/868352170 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3400b9d0 con 0x7efe4014e6e0 2023-11-15T01:22:20.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.249+0000 7efe480a0700 1 -- 172.21.15.1:0/868352170 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe400c0ec0 con 0x7efe4014e6e0 2023-11-15T01:22:20.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.249+0000 7efe3dffb700 1 -- 172.21.15.1:0/868352170 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3401c670 con 0x7efe4014e6e0 2023-11-15T01:22:20.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.249+0000 7efe480a0700 1 -- 172.21.15.1:0/868352170 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe400c1480 con 0x7efe4014e6e0 2023-11-15T01:22:20.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.250+0000 7efe480a0700 1 -- 172.21.15.1:0/868352170 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4006c7e0 con 0x7efe4014e6e0 2023-11-15T01:22:20.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.251+0000 7efe3dffb700 1 -- 172.21.15.1:0/868352170 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efe3401c9e0 con 0x7efe4014e6e0 2023-11-15T01:22:20.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.251+0000 7efe3dffb700 1 --2- 172.21.15.1:0/868352170 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efe2c05f150 0x7efe2c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.251+0000 7efe3dffb700 1 -- 172.21.15.1:0/868352170 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7efe3407bc30 con 0x7efe4014e6e0 2023-11-15T01:22:20.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.251+0000 7efe45e3c700 1 --2- 172.21.15.1:0/868352170 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efe2c05f150 0x7efe2c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.252+0000 7efe45e3c700 1 --2- 172.21.15.1:0/868352170 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efe2c05f150 0x7efe2c061610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7efe38003e80 tx=0x7efe38009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:20.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.255+0000 7efe3dffb700 1 -- 172.21.15.1:0/868352170 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efe3404d250 con 0x7efe4014e6e0 2023-11-15T01:22:20.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.428+0000 7efe480a0700 1 -- 172.21.15.1:0/868352170 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efe40158ad0 con 0x7efe4014e6e0 2023-11-15T01:22:20.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.429+0000 7efe3dffb700 1 -- 172.21.15.1:0/868352170 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v30) v1 ==== 110+0+10 (secure 0 0 0) 0x7efe3402a020 con 0x7efe4014e6e0 2023-11-15T01:22:20.431 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:22:20.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.430+0000 7efe480a0700 1 -- 172.21.15.1:0/868352170 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efe2c05f150 msgr2=0x7efe2c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.430+0000 7efe480a0700 1 --2- 172.21.15.1:0/868352170 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efe2c05f150 0x7efe2c061610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7efe38003e80 tx=0x7efe38009040).stop 2023-11-15T01:22:20.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.430+0000 7efe480a0700 1 -- 172.21.15.1:0/868352170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe4014e6e0 msgr2=0x7efe40156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.430+0000 7efe480a0700 1 --2- 172.21.15.1:0/868352170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe4014e6e0 0x7efe40156c60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7efe34009130 tx=0x7efe34015000).stop 2023-11-15T01:22:20.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.430+0000 7efe480a0700 1 -- 172.21.15.1:0/868352170 shutdown_connections 2023-11-15T01:22:20.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.430+0000 7efe480a0700 1 --2- 172.21.15.1:0/868352170 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efe2c05f150 0x7efe2c061610 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.430+0000 7efe480a0700 1 --2- 172.21.15.1:0/868352170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe40155370 0x7efe40157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.430+0000 7efe480a0700 1 --2- 172.21.15.1:0/868352170 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe40062ec0 0x7efe4014d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.430+0000 7efe480a0700 1 --2- 172.21.15.1:0/868352170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe4014e6e0 0x7efe40156c60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.430+0000 7efe480a0700 1 -- 172.21.15.1:0/868352170 >> 172.21.15.1:0/868352170 conn(0x7efe400c7dc0 msgr2=0x7efe400627b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:20.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.431+0000 7efe480a0700 1 -- 172.21.15.1:0/868352170 shutdown_connections 2023-11-15T01:22:20.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.431+0000 7efe480a0700 1 -- 172.21.15.1:0/868352170 wait complete. 2023-11-15T01:22:20.444 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:22:20.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.563+0000 7fdad10e0700 1 Processor -- start 2023-11-15T01:22:20.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.563+0000 7fdad10e0700 1 -- start start 2023-11-15T01:22:20.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdad10e0700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdacc1540a0 0x7fdacc0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdad10e0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdacc154480 0x7fdacc0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdad10e0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdacc0c5f40 0x7fdacc0c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdad10e0700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc0ca050 con 0x7fdacc154480 2023-11-15T01:22:20.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdad10e0700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc0c68c0 con 0x7fdacc1540a0 2023-11-15T01:22:20.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdad10e0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0c9440 con 0x7fdacc0c5f40 2023-11-15T01:22:20.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdaca59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdacc154480 0x7fdacc0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdaca59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdacc154480 0x7fdacc0ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44064/0 (socket says 172.21.15.1:44064) 2023-11-15T01:22:20.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdaca59c700 1 -- 172.21.15.1:0/3231140065 learned_addr learned my addr 172.21.15.1:0/3231140065 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:20.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdacb59e700 1 --2- 172.21.15.1:0/3231140065 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdacc0c5f40 0x7fdacc0c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdacad9d700 1 --2- 172.21.15.1:0/3231140065 >> v2:172.21.15.141:3300/0 conn(0x7fdacc1540a0 0x7fdacc0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdaca59c700 1 -- 172.21.15.1:0/3231140065 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdacc0c5f40 msgr2=0x7fdacc0c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:20.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdaca59c700 1 --2- 172.21.15.1:0/3231140065 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdacc0c5f40 0x7fdacc0c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdaca59c700 1 -- 172.21.15.1:0/3231140065 >> v2:172.21.15.141:3300/0 conn(0x7fdacc1540a0 msgr2=0x7fdacc0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:20.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdaca59c700 1 --2- 172.21.15.1:0/3231140065 >> v2:172.21.15.141:3300/0 conn(0x7fdacc1540a0 0x7fdacc0ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.564+0000 7fdaca59c700 1 -- 172.21.15.1:0/3231140065 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc0c9720 con 0x7fdacc154480 2023-11-15T01:22:20.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.565+0000 7fdaca59c700 1 --2- 172.21.15.1:0/3231140065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdacc154480 0x7fdacc0ca9d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fdacc05ff40 tx=0x7fdab40090f0).ready entity=mon.0 client_cookie=b1e19e56df410dcd server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:20.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.565+0000 7fdac9d9b700 1 -- 172.21.15.1:0/3231140065 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab400b600 con 0x7fdacc154480 2023-11-15T01:22:20.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.565+0000 7fdac9d9b700 1 -- 172.21.15.1:0/3231140065 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab400b760 con 0x7fdacc154480 2023-11-15T01:22:20.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.565+0000 7fdac9d9b700 1 -- 172.21.15.1:0/3231140065 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab400bae0 con 0x7fdacc154480 2023-11-15T01:22:20.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.565+0000 7fdad10e0700 1 -- 172.21.15.1:0/3231140065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdacc154480 msgr2=0x7fdacc0ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.565+0000 7fdad10e0700 1 --2- 172.21.15.1:0/3231140065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdacc154480 0x7fdacc0ca9d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fdacc05ff40 tx=0x7fdab40090f0).stop 2023-11-15T01:22:20.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.565+0000 7fdad10e0700 1 -- 172.21.15.1:0/3231140065 shutdown_connections 2023-11-15T01:22:20.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.565+0000 7fdad10e0700 1 --2- 172.21.15.1:0/3231140065 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdacc0c5f40 0x7fdacc0c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.565+0000 7fdad10e0700 1 --2- 172.21.15.1:0/3231140065 >> v2:172.21.15.141:3300/0 conn(0x7fdacc1540a0 0x7fdacc0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.565+0000 7fdad10e0700 1 --2- 172.21.15.1:0/3231140065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdacc154480 0x7fdacc0ca9d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.565+0000 7fdad10e0700 1 -- 172.21.15.1:0/3231140065 >> 172.21.15.1:0/3231140065 conn(0x7fdacc064a70 msgr2=0x7fdacc064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:20.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.565+0000 7fdad10e0700 1 -- 172.21.15.1:0/3231140065 shutdown_connections 2023-11-15T01:22:20.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.565+0000 7fdad10e0700 1 -- 172.21.15.1:0/3231140065 wait complete. 2023-11-15T01:22:20.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.566+0000 7fdad10e0700 1 Processor -- start 2023-11-15T01:22:20.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.567+0000 7fdad10e0700 1 -- start start 2023-11-15T01:22:20.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.567+0000 7fdad10e0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdacc0c5f40 0x7fdacc168250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.567+0000 7fdad10e0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdacc1540a0 0x7fdacc14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.567+0000 7fdad10e0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdacc154480 0x7fdacc157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.567+0000 7fdad10e0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc158930 con 0x7fdacc1540a0 2023-11-15T01:22:20.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.567+0000 7fdad10e0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0af7b0 con 0x7fdacc154480 2023-11-15T01:22:20.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.567+0000 7fdad10e0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc157d20 con 0x7fdacc0c5f40 2023-11-15T01:22:20.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.567+0000 7fdaca59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdacc1540a0 0x7fdacc14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.567+0000 7fdaca59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdacc1540a0 0x7fdacc14ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44080/0 (socket says 172.21.15.1:44080) 2023-11-15T01:22:20.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.567+0000 7fdaca59c700 1 -- 172.21.15.1:0/3349960817 learned_addr learned my addr 172.21.15.1:0/3349960817 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:20.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.567+0000 7fdacb59e700 1 --2- 172.21.15.1:0/3349960817 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdacc154480 0x7fdacc157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.567+0000 7fdacad9d700 1 --2- 172.21.15.1:0/3349960817 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdacc0c5f40 0x7fdacc168250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.568+0000 7fdaca59c700 1 -- 172.21.15.1:0/3349960817 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdacc0c5f40 msgr2=0x7fdacc168250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.568+0000 7fdaca59c700 1 --2- 172.21.15.1:0/3349960817 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdacc0c5f40 0x7fdacc168250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.568+0000 7fdaca59c700 1 -- 172.21.15.1:0/3349960817 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdacc154480 msgr2=0x7fdacc157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.568+0000 7fdaca59c700 1 --2- 172.21.15.1:0/3349960817 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdacc154480 0x7fdacc157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.568+0000 7fdaca59c700 1 -- 172.21.15.1:0/3349960817 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab4009370 con 0x7fdacc1540a0 2023-11-15T01:22:20.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.568+0000 7fdaca59c700 1 --2- 172.21.15.1:0/3349960817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdacc1540a0 0x7fdacc14ec70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fdab4009130 tx=0x7fdab4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:20.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.568+0000 7fdac2ffd700 1 -- 172.21.15.1:0/3349960817 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab400bea0 con 0x7fdacc1540a0 2023-11-15T01:22:20.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.568+0000 7fdac2ffd700 1 -- 172.21.15.1:0/3349960817 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab400b8d0 con 0x7fdacc1540a0 2023-11-15T01:22:20.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.568+0000 7fdac2ffd700 1 -- 172.21.15.1:0/3349960817 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab401d680 con 0x7fdacc1540a0 2023-11-15T01:22:20.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.568+0000 7fdad10e0700 1 -- 172.21.15.1:0/3349960817 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc158000 con 0x7fdacc1540a0 2023-11-15T01:22:20.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.568+0000 7fdad10e0700 1 -- 172.21.15.1:0/3349960817 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc1585c0 con 0x7fdacc1540a0 2023-11-15T01:22:20.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.569+0000 7fdad10e0700 1 -- 172.21.15.1:0/3349960817 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc06c7e0 con 0x7fdacc1540a0 2023-11-15T01:22:20.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.569+0000 7fdac2ffd700 1 -- 172.21.15.1:0/3349960817 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdab401d9f0 con 0x7fdacc1540a0 2023-11-15T01:22:20.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.570+0000 7fdac2ffd700 1 --2- 172.21.15.1:0/3349960817 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdaac05f150 0x7fdaac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.570+0000 7fdac2ffd700 1 -- 172.21.15.1:0/3349960817 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdab407ba90 con 0x7fdacc1540a0 2023-11-15T01:22:20.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.570+0000 7fdacad9d700 1 --2- 172.21.15.1:0/3349960817 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdaac05f150 0x7fdaac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.570+0000 7fdacad9d700 1 --2- 172.21.15.1:0/3349960817 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdaac05f150 0x7fdaac061610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fdac4009fd0 tx=0x7fdac4009880).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:20.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.574+0000 7fdac2ffd700 1 -- 172.21.15.1:0/3349960817 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdab404d0b0 con 0x7fdacc1540a0 2023-11-15T01:22:20.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.747+0000 7fdad10e0700 1 -- 172.21.15.1:0/3349960817 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdacc0c9a00 con 0x7fdacc1540a0 2023-11-15T01:22:20.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.748+0000 7fdac2ffd700 1 -- 172.21.15.1:0/3349960817 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdab4021070 con 0x7fdacc1540a0 2023-11-15T01:22:20.750 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:22:20.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.749+0000 7fdad10e0700 1 -- 172.21.15.1:0/3349960817 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdaac05f150 msgr2=0x7fdaac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.749+0000 7fdad10e0700 1 --2- 172.21.15.1:0/3349960817 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdaac05f150 0x7fdaac061610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fdac4009fd0 tx=0x7fdac4009880).stop 2023-11-15T01:22:20.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.749+0000 7fdad10e0700 1 -- 172.21.15.1:0/3349960817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdacc1540a0 msgr2=0x7fdacc14ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.749+0000 7fdad10e0700 1 --2- 172.21.15.1:0/3349960817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdacc1540a0 0x7fdacc14ec70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fdab4009130 tx=0x7fdab4017000).stop 2023-11-15T01:22:20.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.750+0000 7fdad10e0700 1 -- 172.21.15.1:0/3349960817 shutdown_connections 2023-11-15T01:22:20.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.750+0000 7fdad10e0700 1 --2- 172.21.15.1:0/3349960817 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdaac05f150 0x7fdaac061610 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.750+0000 7fdad10e0700 1 --2- 172.21.15.1:0/3349960817 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdacc154480 0x7fdacc157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.750+0000 7fdad10e0700 1 --2- 172.21.15.1:0/3349960817 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdacc0c5f40 0x7fdacc168250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.750+0000 7fdad10e0700 1 --2- 172.21.15.1:0/3349960817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdacc1540a0 0x7fdacc14ec70 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.750+0000 7fdad10e0700 1 -- 172.21.15.1:0/3349960817 >> 172.21.15.1:0/3349960817 conn(0x7fdacc064a70 msgr2=0x7fdacc0aaf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:20.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.750+0000 7fdad10e0700 1 -- 172.21.15.1:0/3349960817 shutdown_connections 2023-11-15T01:22:20.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.750+0000 7fdad10e0700 1 -- 172.21.15.1:0/3349960817 wait complete. 2023-11-15T01:22:20.763 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-15T01:22:20.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.880+0000 7fd7e75b0700 1 Processor -- start 2023-11-15T01:22:20.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.880+0000 7fd7e75b0700 1 -- start start 2023-11-15T01:22:20.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.881+0000 7fd7e75b0700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd7e00833a0 0x7fd7e00a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.881+0000 7fd7e75b0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd7e00be520 0x7fd7e0154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.881+0000 7fd7e75b0700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e00a85e0 con 0x7fd7e0154450 2023-11-15T01:22:20.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.881+0000 7fd7e75b0700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e0065940 con 0x7fd7e00be520 2023-11-15T01:22:20.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.881+0000 7fd7e75b0700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e0065660 con 0x7fd7e00833a0 2023-11-15T01:22:20.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.881+0000 7fd7e5b4d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd7e00be520 0x7fd7e0154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.881+0000 7fd7e534c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd7e0154450 0x7fd7e00bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49090/0 (socket says 172.21.15.1:49090) 2023-11-15T01:22:20.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.881+0000 7fd7e5b4d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd7e00be520 0x7fd7e0154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44088/0 (socket says 172.21.15.1:44088) 2023-11-15T01:22:20.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.881+0000 7fd7e5b4d700 1 -- 172.21.15.1:0/675228009 learned_addr learned my addr 172.21.15.1:0/675228009 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:20.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.882+0000 7fd7e5b4d700 1 -- 172.21.15.1:0/675228009 >> v2:172.21.15.141:3300/0 conn(0x7fd7e00833a0 msgr2=0x7fd7e00a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:20.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.882+0000 7fd7e5b4d700 1 --2- 172.21.15.1:0/675228009 >> v2:172.21.15.141:3300/0 conn(0x7fd7e00833a0 0x7fd7e00a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:20.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.882+0000 7fd7e5b4d700 1 -- 172.21.15.1:0/675228009 >> v1:172.21.15.1:6789/0 conn(0x7fd7e0154450 legacy=0x7fd7e00bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.882+0000 7fd7dffff700 1 -- 172.21.15.1:0/675228009 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323249055 0 0) 0x7fd7e00a85e0 con 0x7fd7e0154450 2023-11-15T01:22:20.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.882+0000 7fd7e5b4d700 1 -- 172.21.15.1:0/675228009 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e00c6f50 con 0x7fd7e00be520 2023-11-15T01:22:20.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.882+0000 7fd7e5b4d700 1 --2- 172.21.15.1:0/675228009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e00be520 0x7fd7e0154830 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fd7e0158220 tx=0x7fd7d0009840).ready entity=mon.0 client_cookie=a03d5be1b7c3a53d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:20.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.882+0000 7fd7dffff700 1 -- 172.21.15.1:0/675228009 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000e070 con 0x7fd7e00be520 2023-11-15T01:22:20.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.882+0000 7fd7dffff700 1 -- 172.21.15.1:0/675228009 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d000ba50 con 0x7fd7e00be520 2023-11-15T01:22:20.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.882+0000 7fd7dffff700 1 -- 172.21.15.1:0/675228009 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000bdd0 con 0x7fd7e00be520 2023-11-15T01:22:20.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.882+0000 7fd7e75b0700 1 -- 172.21.15.1:0/675228009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e00be520 msgr2=0x7fd7e0154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.882+0000 7fd7e75b0700 1 --2- 172.21.15.1:0/675228009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e00be520 0x7fd7e0154830 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fd7e0158220 tx=0x7fd7d0009840).stop 2023-11-15T01:22:20.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.883+0000 7fd7e75b0700 1 -- 172.21.15.1:0/675228009 shutdown_connections 2023-11-15T01:22:20.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.883+0000 7fd7e75b0700 1 --2- 172.21.15.1:0/675228009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e00be520 0x7fd7e0154830 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.883+0000 7fd7e75b0700 1 --2- 172.21.15.1:0/675228009 >> v2:172.21.15.141:3300/0 conn(0x7fd7e00833a0 0x7fd7e00a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:20.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.883+0000 7fd7e75b0700 1 -- 172.21.15.1:0/675228009 >> 172.21.15.1:0/675228009 conn(0x7fd7e0082f90 msgr2=0x7fd7e00c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:20.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.883+0000 7fd7e75b0700 1 -- 172.21.15.1:0/675228009 shutdown_connections 2023-11-15T01:22:20.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.883+0000 7fd7e75b0700 1 -- 172.21.15.1:0/675228009 wait complete. 2023-11-15T01:22:20.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.884+0000 7fd7e75b0700 1 Processor -- start 2023-11-15T01:22:20.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.884+0000 7fd7e75b0700 1 -- start start 2023-11-15T01:22:20.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e75b0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e00833a0 0x7fd7e0164f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e75b0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7e00be520 0x7fd7e0151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e75b0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7e0154450 0x7fd7e0164460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e75b0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e014f5c0 con 0x7fd7e00833a0 2023-11-15T01:22:20.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e75b0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e0165430 con 0x7fd7e0154450 2023-11-15T01:22:20.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e75b0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e0152170 con 0x7fd7e00be520 2023-11-15T01:22:20.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e534c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e00833a0 0x7fd7e0164f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e534c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e00833a0 0x7fd7e0164f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44104/0 (socket says 172.21.15.1:44104) 2023-11-15T01:22:20.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e534c700 1 -- 172.21.15.1:0/3544587039 learned_addr learned my addr 172.21.15.1:0/3544587039 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:20.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e5b4d700 1 --2- 172.21.15.1:0/3544587039 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7e0154450 0x7fd7e0164460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e4b4b700 1 --2- 172.21.15.1:0/3544587039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7e00be520 0x7fd7e0151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e534c700 1 -- 172.21.15.1:0/3544587039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7e00be520 msgr2=0x7fd7e0151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e534c700 1 --2- 172.21.15.1:0/3544587039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7e00be520 0x7fd7e0151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e534c700 1 -- 172.21.15.1:0/3544587039 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7e0154450 msgr2=0x7fd7e0164460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:20.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e534c700 1 --2- 172.21.15.1:0/3544587039 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7e0154450 0x7fd7e0164460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:20.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e534c700 1 -- 172.21.15.1:0/3544587039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d0009ae0 con 0x7fd7e00833a0 2023-11-15T01:22:20.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e534c700 1 --2- 172.21.15.1:0/3544587039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e00833a0 0x7fd7e0164f40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fd7d800c490 tx=0x7fd7d8007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:20.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7dd7fa700 1 -- 172.21.15.1:0/3544587039 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80072e0 con 0x7fd7e00833a0 2023-11-15T01:22:20.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7dd7fa700 1 -- 172.21.15.1:0/3544587039 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d8007440 con 0x7fd7e00833a0 2023-11-15T01:22:20.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e75b0700 1 -- 172.21.15.1:0/3544587039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e014f7d0 con 0x7fd7e00833a0 2023-11-15T01:22:20.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7dd7fa700 1 -- 172.21.15.1:0/3544587039 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80058a0 con 0x7fd7e00833a0 2023-11-15T01:22:20.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.885+0000 7fd7e75b0700 1 -- 172.21.15.1:0/3544587039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e014fd90 con 0x7fd7e00833a0 2023-11-15T01:22:20.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.887+0000 7fd7e75b0700 1 -- 172.21.15.1:0/3544587039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e006c7e0 con 0x7fd7e00833a0 2023-11-15T01:22:20.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.887+0000 7fd7dd7fa700 1 -- 172.21.15.1:0/3544587039 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd7d8005c90 con 0x7fd7e00833a0 2023-11-15T01:22:20.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.887+0000 7fd7dd7fa700 1 --2- 172.21.15.1:0/3544587039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd7cc05f150 0x7fd7cc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:20.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.887+0000 7fd7dd7fa700 1 -- 172.21.15.1:0/3544587039 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd7d8079530 con 0x7fd7e00833a0 2023-11-15T01:22:20.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.887+0000 7fd7e4b4b700 1 --2- 172.21.15.1:0/3544587039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd7cc05f150 0x7fd7cc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:20.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.888+0000 7fd7e4b4b700 1 --2- 172.21.15.1:0/3544587039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd7cc05f150 0x7fd7cc061610 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fd7e0067ca0 tx=0x7fd7d4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:20.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:20.891+0000 7fd7dd7fa700 1 -- 172.21.15.1:0/3544587039 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd7d804ab50 con 0x7fd7e00833a0 2023-11-15T01:22:21.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.066+0000 7fd7e75b0700 1 -- 172.21.15.1:0/3544587039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd7e005f8b0 con 0x7fd7e00833a0 2023-11-15T01:22:21.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.067+0000 7fd7dd7fa700 1 -- 172.21.15.1:0/3544587039 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd7d80180a0 con 0x7fd7e00833a0 2023-11-15T01:22:21.069 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:21.069 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T01:22:21.069 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:21.069 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2023-11-15T01:22:21.070 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "device_health_metrics" 2023-11-15T01:22:21.070 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:22:21.070 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:21.070 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 2, 2023-11-15T01:22:21.070 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "rbd" 2023-11-15T01:22:21.071 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:21.071 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T01:22:21.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.069+0000 7fd7e75b0700 1 -- 172.21.15.1:0/3544587039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd7cc05f150 msgr2=0x7fd7cc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:21.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.069+0000 7fd7e75b0700 1 --2- 172.21.15.1:0/3544587039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd7cc05f150 0x7fd7cc061610 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fd7e0067ca0 tx=0x7fd7d4008040).stop 2023-11-15T01:22:21.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.069+0000 7fd7e75b0700 1 -- 172.21.15.1:0/3544587039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e00833a0 msgr2=0x7fd7e0164f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:21.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.069+0000 7fd7e75b0700 1 --2- 172.21.15.1:0/3544587039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e00833a0 0x7fd7e0164f40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fd7d800c490 tx=0x7fd7d8007dc0).stop 2023-11-15T01:22:21.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.069+0000 7fd7e75b0700 1 -- 172.21.15.1:0/3544587039 shutdown_connections 2023-11-15T01:22:21.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.069+0000 7fd7e75b0700 1 --2- 172.21.15.1:0/3544587039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd7cc05f150 0x7fd7cc061610 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.069+0000 7fd7e75b0700 1 --2- 172.21.15.1:0/3544587039 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7e0154450 0x7fd7e0164460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.069+0000 7fd7e75b0700 1 --2- 172.21.15.1:0/3544587039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e00833a0 0x7fd7e0164f40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.069+0000 7fd7e75b0700 1 --2- 172.21.15.1:0/3544587039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7e00be520 0x7fd7e0151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.069+0000 7fd7e75b0700 1 -- 172.21.15.1:0/3544587039 >> 172.21.15.1:0/3544587039 conn(0x7fd7e0082f90 msgr2=0x7fd7e00bde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:21.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.069+0000 7fd7e75b0700 1 -- 172.21.15.1:0/3544587039 shutdown_connections 2023-11-15T01:22:21.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.069+0000 7fd7e75b0700 1 -- 172.21.15.1:0/3544587039 wait complete. 2023-11-15T01:22:21.082 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-15T01:22:21.083 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-15T01:22:21.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.204+0000 7f1e029f9700 1 Processor -- start 2023-11-15T01:22:21.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.204+0000 7f1e029f9700 1 -- start start 2023-11-15T01:22:21.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e029f9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1dfc0ca5d0 0x7f1dfc0aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:21.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e029f9700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1dfc063b50 0x7f1dfc15df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:21.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e029f9700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dfc1548f0 con 0x7f1dfc155610 2023-11-15T01:22:21.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e029f9700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dfc0aaa50 con 0x7f1dfc063b50 2023-11-15T01:22:21.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e029f9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc0aa4f0 con 0x7f1dfc0ca5d0 2023-11-15T01:22:21.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e021f8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1dfc063b50 0x7f1dfc15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:21.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e021f8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1dfc063b50 0x7f1dfc15df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44108/0 (socket says 172.21.15.1:44108) 2023-11-15T01:22:21.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e021f8700 1 -- 172.21.15.1:0/1110976649 learned_addr learned my addr 172.21.15.1:0/1110976649 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:21.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e019f7700 1 --2- 172.21.15.1:0/1110976649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1dfc0ca5d0 0x7f1dfc0aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:21.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e021f8700 1 -- 172.21.15.1:0/1110976649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1dfc0ca5d0 msgr2=0x7f1dfc0aa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:21.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e021f8700 1 --2- 172.21.15.1:0/1110976649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1dfc0ca5d0 0x7f1dfc0aa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e021f8700 1 -- 172.21.15.1:0/1110976649 >> v1:172.21.15.141:6789/0 conn(0x7f1dfc155610 legacy=0x7f1dfc063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:21.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e021f8700 1 -- 172.21.15.1:0/1110976649 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc0aa770 con 0x7f1dfc063b50 2023-11-15T01:22:21.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e021f8700 1 --2- 172.21.15.1:0/1110976649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dfc063b50 0x7f1dfc15df20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f1dec009f20 tx=0x7f1dec009840).ready entity=mon.0 client_cookie=869ef90a43667085 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:21.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e009f5700 1 -- 172.21.15.1:0/1110976649 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec00e070 con 0x7f1dfc063b50 2023-11-15T01:22:21.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e009f5700 1 -- 172.21.15.1:0/1110976649 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec00b9d0 con 0x7f1dfc063b50 2023-11-15T01:22:21.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.205+0000 7f1e009f5700 1 -- 172.21.15.1:0/1110976649 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec00bd50 con 0x7f1dfc063b50 2023-11-15T01:22:21.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.206+0000 7f1e029f9700 1 -- 172.21.15.1:0/1110976649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dfc063b50 msgr2=0x7f1dfc15df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:21.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.206+0000 7f1e029f9700 1 --2- 172.21.15.1:0/1110976649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dfc063b50 0x7f1dfc15df20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f1dec009f20 tx=0x7f1dec009840).stop 2023-11-15T01:22:21.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.206+0000 7f1e029f9700 1 -- 172.21.15.1:0/1110976649 shutdown_connections 2023-11-15T01:22:21.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.206+0000 7f1e029f9700 1 --2- 172.21.15.1:0/1110976649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1dfc0ca5d0 0x7f1dfc0aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.206+0000 7f1e029f9700 1 --2- 172.21.15.1:0/1110976649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dfc063b50 0x7f1dfc15df20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.206+0000 7f1e029f9700 1 -- 172.21.15.1:0/1110976649 >> 172.21.15.1:0/1110976649 conn(0x7f1dfc06a9b0 msgr2=0x7f1dfc0cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:21.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.206+0000 7f1e029f9700 1 -- 172.21.15.1:0/1110976649 shutdown_connections 2023-11-15T01:22:21.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.206+0000 7f1e029f9700 1 -- 172.21.15.1:0/1110976649 wait complete. 2023-11-15T01:22:21.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.207+0000 7f1e029f9700 1 Processor -- start 2023-11-15T01:22:21.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.207+0000 7f1e029f9700 1 -- start start 2023-11-15T01:22:21.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e029f9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dfc063b50 0x7f1dfc150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:21.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e029f9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1dfc0ca5d0 0x7f1dfc150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:21.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e029f9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1dfc155610 0x7f1dfc0ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:21.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e029f9700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc167870 con 0x7f1dfc063b50 2023-11-15T01:22:21.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e029f9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc1512e0 con 0x7f1dfc155610 2023-11-15T01:22:21.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e029f9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc167ac0 con 0x7f1dfc0ca5d0 2023-11-15T01:22:21.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e019f7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dfc063b50 0x7f1dfc150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:21.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e019f7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dfc063b50 0x7f1dfc150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44110/0 (socket says 172.21.15.1:44110) 2023-11-15T01:22:21.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e019f7700 1 -- 172.21.15.1:0/1185383871 learned_addr learned my addr 172.21.15.1:0/1185383871 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:21.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e011f6700 1 --2- 172.21.15.1:0/1185383871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1dfc0ca5d0 0x7f1dfc150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:21.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e021f8700 1 --2- 172.21.15.1:0/1185383871 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1dfc155610 0x7f1dfc0ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:21.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e019f7700 1 -- 172.21.15.1:0/1185383871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1dfc0ca5d0 msgr2=0x7f1dfc150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:21.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e019f7700 1 --2- 172.21.15.1:0/1185383871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1dfc0ca5d0 0x7f1dfc150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e019f7700 1 -- 172.21.15.1:0/1185383871 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1dfc155610 msgr2=0x7f1dfc0ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:21.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e019f7700 1 --2- 172.21.15.1:0/1185383871 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1dfc155610 0x7f1dfc0ac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e019f7700 1 -- 172.21.15.1:0/1185383871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec009ae0 con 0x7f1dfc063b50 2023-11-15T01:22:21.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.208+0000 7f1e019f7700 1 --2- 172.21.15.1:0/1185383871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dfc063b50 0x7f1dfc150b50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f1df400e950 tx=0x7f1df4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:21.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.209+0000 7f1df9ffb700 1 -- 172.21.15.1:0/1185383871 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4009530 con 0x7f1dfc063b50 2023-11-15T01:22:21.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.209+0000 7f1df9ffb700 1 -- 172.21.15.1:0/1185383871 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df4012600 con 0x7f1dfc063b50 2023-11-15T01:22:21.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.209+0000 7f1e029f9700 1 -- 172.21.15.1:0/1185383871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dfc167da0 con 0x7f1dfc063b50 2023-11-15T01:22:21.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.209+0000 7f1df9ffb700 1 -- 172.21.15.1:0/1185383871 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4012980 con 0x7f1dfc063b50 2023-11-15T01:22:21.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.209+0000 7f1e029f9700 1 -- 172.21.15.1:0/1185383871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dfc168360 con 0x7f1dfc063b50 2023-11-15T01:22:21.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.210+0000 7f1e029f9700 1 -- 172.21.15.1:0/1185383871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dfc0cb610 con 0x7f1dfc063b50 2023-11-15T01:22:21.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.210+0000 7f1df9ffb700 1 -- 172.21.15.1:0/1185383871 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1df4012d30 con 0x7f1dfc063b50 2023-11-15T01:22:21.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.210+0000 7f1df9ffb700 1 --2- 172.21.15.1:0/1185383871 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1de805f150 0x7f1de8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:21.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.210+0000 7f1df9ffb700 1 -- 172.21.15.1:0/1185383871 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1df407a2f0 con 0x7f1dfc063b50 2023-11-15T01:22:21.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.210+0000 7f1e011f6700 1 --2- 172.21.15.1:0/1185383871 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1de805f150 0x7f1de8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:21.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.211+0000 7f1e011f6700 1 --2- 172.21.15.1:0/1185383871 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1de805f150 0x7f1de8061610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f1dfc0ad090 tx=0x7f1df0007d40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:21.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.214+0000 7f1df9ffb700 1 -- 172.21.15.1:0/1185383871 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1df404b910 con 0x7f1dfc063b50 2023-11-15T01:22:21.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.387+0000 7f1e029f9700 1 -- 172.21.15.1:0/1185383871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f1dfc154b30 con 0x7f1dfc063b50 2023-11-15T01:22:21.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.832+0000 7f1df9ffb700 1 -- 172.21.15.1:0/1185383871 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 152+0+0 (secure 0 0 0) 0x7f1df404ef30 con 0x7f1dfc063b50 2023-11-15T01:22:21.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.836+0000 7f1e029f9700 1 -- 172.21.15.1:0/1185383871 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1de805f150 msgr2=0x7f1de8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:21.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.836+0000 7f1e029f9700 1 --2- 172.21.15.1:0/1185383871 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1de805f150 0x7f1de8061610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f1dfc0ad090 tx=0x7f1df0007d40).stop 2023-11-15T01:22:21.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.836+0000 7f1e029f9700 1 -- 172.21.15.1:0/1185383871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dfc063b50 msgr2=0x7f1dfc150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:21.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.836+0000 7f1e029f9700 1 --2- 172.21.15.1:0/1185383871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dfc063b50 0x7f1dfc150b50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f1df400e950 tx=0x7f1df4009060).stop 2023-11-15T01:22:21.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.837+0000 7f1e029f9700 1 -- 172.21.15.1:0/1185383871 shutdown_connections 2023-11-15T01:22:21.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.837+0000 7f1e029f9700 1 --2- 172.21.15.1:0/1185383871 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1de805f150 0x7f1de8061610 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.837+0000 7f1e029f9700 1 --2- 172.21.15.1:0/1185383871 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1dfc155610 0x7f1dfc0ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.837+0000 7f1e029f9700 1 --2- 172.21.15.1:0/1185383871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dfc063b50 0x7f1dfc150b50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.837+0000 7f1e029f9700 1 --2- 172.21.15.1:0/1185383871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1dfc0ca5d0 0x7f1dfc150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.837+0000 7f1e029f9700 1 -- 172.21.15.1:0/1185383871 >> 172.21.15.1:0/1185383871 conn(0x7f1dfc06a9b0 msgr2=0x7f1dfc0c7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:21.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.838+0000 7f1e029f9700 1 -- 172.21.15.1:0/1185383871 shutdown_connections 2023-11-15T01:22:21.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.839+0000 7f1e029f9700 1 -- 172.21.15.1:0/1185383871 wait complete. 2023-11-15T01:22:21.841 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2023-11-15T01:22:21.855 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-15T01:22:21.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.980+0000 7f0b47f3e700 1 Processor -- start 2023-11-15T01:22:21.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.980+0000 7f0b47f3e700 1 -- start start 2023-11-15T01:22:21.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.981+0000 7f0b47f3e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0b401540a0 0x7f0b400ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:21.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.981+0000 7f0b47f3e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b400ca050 con 0x7f0b40154480 2023-11-15T01:22:21.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.981+0000 7f0b47f3e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b400c9440 con 0x7f0b400c6650 2023-11-15T01:22:21.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.981+0000 7f0b47f3e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b400c9720 con 0x7f0b401540a0 2023-11-15T01:22:21.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.981+0000 7f0b454d9700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0b40154480 0x7f0b400c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49102/0 (socket says 172.21.15.1:49102) 2023-11-15T01:22:21.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.981+0000 7f0b454d9700 1 -- 172.21.15.1:0/3497404404 learned_addr learned my addr 172.21.15.1:0/3497404404 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:21.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.982+0000 7f0b45cda700 1 --2- 172.21.15.1:0/3497404404 >> v2:172.21.15.141:3300/0 conn(0x7f0b401540a0 0x7f0b400ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:21.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.982+0000 7f0b44cd8700 1 -- 172.21.15.1:0/3497404404 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494668561 0 0) 0x7f0b400ca050 con 0x7f0b40154480 2023-11-15T01:22:21.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.982+0000 7f0b44cd8700 1 -- 172.21.15.1:0/3497404404 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b280033f0 con 0x7f0b40154480 2023-11-15T01:22:21.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.982+0000 7f0b44cd8700 1 -- 172.21.15.1:0/3497404404 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222936945 0 0) 0x7f0b400c9440 con 0x7f0b400c6650 2023-11-15T01:22:21.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.982+0000 7f0b44cd8700 1 -- 172.21.15.1:0/3497404404 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b400ca050 con 0x7f0b400c6650 2023-11-15T01:22:21.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.982+0000 7f0b45cda700 1 -- 172.21.15.1:0/3497404404 >> v1:172.21.15.141:6789/0 conn(0x7f0b400c6650 legacy=0x7f0b400aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:21.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.982+0000 7f0b45cda700 1 -- 172.21.15.1:0/3497404404 >> v1:172.21.15.1:6789/0 conn(0x7f0b40154480 legacy=0x7f0b400c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:21.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.982+0000 7f0b45cda700 1 -- 172.21.15.1:0/3497404404 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b400c9a00 con 0x7f0b401540a0 2023-11-15T01:22:21.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.982+0000 7f0b45cda700 1 --2- 172.21.15.1:0/3497404404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b401540a0 0x7f0b400ca4e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f0b38009e60 tx=0x7f0b38009780).ready entity=mon.1 client_cookie=7c13dabf86af015f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:21.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.982+0000 7f0b44cd8700 1 -- 172.21.15.1:0/3497404404 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800e070 con 0x7f0b401540a0 2023-11-15T01:22:21.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.982+0000 7f0b44cd8700 1 -- 172.21.15.1:0/3497404404 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3800bab0 con 0x7f0b401540a0 2023-11-15T01:22:21.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.982+0000 7f0b44cd8700 1 -- 172.21.15.1:0/3497404404 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800be30 con 0x7f0b401540a0 2023-11-15T01:22:21.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.983+0000 7f0b47f3e700 1 -- 172.21.15.1:0/3497404404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b401540a0 msgr2=0x7f0b400ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:21.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.983+0000 7f0b47f3e700 1 --2- 172.21.15.1:0/3497404404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b401540a0 0x7f0b400ca4e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f0b38009e60 tx=0x7f0b38009780).stop 2023-11-15T01:22:21.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.983+0000 7f0b47f3e700 1 -- 172.21.15.1:0/3497404404 shutdown_connections 2023-11-15T01:22:21.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.983+0000 7f0b47f3e700 1 --2- 172.21.15.1:0/3497404404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b401540a0 0x7f0b400ca4e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.983+0000 7f0b47f3e700 1 -- 172.21.15.1:0/3497404404 >> 172.21.15.1:0/3497404404 conn(0x7f0b40064a70 msgr2=0x7f0b40064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:21.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.983+0000 7f0b47f3e700 1 -- 172.21.15.1:0/3497404404 shutdown_connections 2023-11-15T01:22:21.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.983+0000 7f0b47f3e700 1 -- 172.21.15.1:0/3497404404 wait complete. 2023-11-15T01:22:21.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.984+0000 7f0b47f3e700 1 Processor -- start 2023-11-15T01:22:21.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.984+0000 7f0b47f3e700 1 -- start start 2023-11-15T01:22:21.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b47f3e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b400c6650 0x7f0b4014f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:21.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b47f3e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b401540a0 0x7f0b40159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:21.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b47f3e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b40154480 0x7f0b40159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:21.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b47f3e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4014f5c0 con 0x7f0b400c6650 2023-11-15T01:22:21.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b47f3e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b40159e00 con 0x7f0b401540a0 2023-11-15T01:22:21.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b47f3e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b400ae580 con 0x7f0b40154480 2023-11-15T01:22:21.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b45cda700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b400c6650 0x7f0b4014f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:21.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b45cda700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b400c6650 0x7f0b4014f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44124/0 (socket says 172.21.15.1:44124) 2023-11-15T01:22:21.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b45cda700 1 -- 172.21.15.1:0/3094659231 learned_addr learned my addr 172.21.15.1:0/3094659231 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:21.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b454d9700 1 --2- 172.21.15.1:0/3094659231 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b401540a0 0x7f0b40159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:21.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b464db700 1 --2- 172.21.15.1:0/3094659231 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b40154480 0x7f0b40159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:21.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b45cda700 1 -- 172.21.15.1:0/3094659231 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b40154480 msgr2=0x7f0b40159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:21.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b45cda700 1 --2- 172.21.15.1:0/3094659231 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b40154480 0x7f0b40159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b45cda700 1 -- 172.21.15.1:0/3094659231 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b401540a0 msgr2=0x7f0b40159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:21.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b45cda700 1 --2- 172.21.15.1:0/3094659231 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b401540a0 0x7f0b40159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:21.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b45cda700 1 -- 172.21.15.1:0/3094659231 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b38009a20 con 0x7f0b400c6650 2023-11-15T01:22:21.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b454d9700 1 --2- 172.21.15.1:0/3094659231 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b401540a0 0x7f0b40159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:21.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b45cda700 1 --2- 172.21.15.1:0/3094659231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b400c6650 0x7f0b4014f0d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f0b3800b610 tx=0x7f0b38009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:21.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b3dffb700 1 -- 172.21.15.1:0/3094659231 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3801d630 con 0x7f0b400c6650 2023-11-15T01:22:21.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b3dffb700 1 -- 172.21.15.1:0/3094659231 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3801d790 con 0x7f0b400c6650 2023-11-15T01:22:21.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b47f3e700 1 -- 172.21.15.1:0/3094659231 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b400c4da0 con 0x7f0b400c6650 2023-11-15T01:22:21.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.985+0000 7f0b3dffb700 1 -- 172.21.15.1:0/3094659231 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3801db50 con 0x7f0b400c6650 2023-11-15T01:22:21.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.986+0000 7f0b47f3e700 1 -- 172.21.15.1:0/3094659231 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b40158c00 con 0x7f0b400c6650 2023-11-15T01:22:21.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.987+0000 7f0b47f3e700 1 -- 172.21.15.1:0/3094659231 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b400ae860 con 0x7f0b400c6650 2023-11-15T01:22:21.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.987+0000 7f0b3dffb700 1 -- 172.21.15.1:0/3094659231 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0b38003040 con 0x7f0b400c6650 2023-11-15T01:22:21.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.987+0000 7f0b3dffb700 1 --2- 172.21.15.1:0/3094659231 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0b2c05f120 0x7f0b2c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:21.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.988+0000 7f0b3dffb700 1 -- 172.21.15.1:0/3094659231 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f0b3807bcd0 con 0x7f0b400c6650 2023-11-15T01:22:21.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.988+0000 7f0b454d9700 1 --2- 172.21.15.1:0/3094659231 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0b2c05f120 0x7f0b2c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:22.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.988+0000 7f0b454d9700 1 --2- 172.21.15.1:0/3094659231 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0b2c05f120 0x7f0b2c0615e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f0b4015ae70 tx=0x7f0b34009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:22.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:21.992+0000 7f0b3dffb700 1 -- 172.21.15.1:0/3094659231 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0b3804d180 con 0x7f0b400c6650 2023-11-15T01:22:22.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.166+0000 7f0b47f3e700 1 -- 172.21.15.1:0/3094659231 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0b4006c7e0 con 0x7f0b400c6650 2023-11-15T01:22:22.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.837+0000 7f0b3dffb700 1 -- 172.21.15.1:0/3094659231 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0b380507a0 con 0x7f0b400c6650 2023-11-15T01:22:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.842+0000 7f0b47f3e700 1 -- 172.21.15.1:0/3094659231 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0b2c05f120 msgr2=0x7f0b2c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.842+0000 7f0b47f3e700 1 --2- 172.21.15.1:0/3094659231 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0b2c05f120 0x7f0b2c0615e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f0b4015ae70 tx=0x7f0b34009040).stop 2023-11-15T01:22:22.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.842+0000 7f0b47f3e700 1 -- 172.21.15.1:0/3094659231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b400c6650 msgr2=0x7f0b4014f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:22.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.842+0000 7f0b47f3e700 1 --2- 172.21.15.1:0/3094659231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b400c6650 0x7f0b4014f0d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f0b3800b610 tx=0x7f0b38009780).stop 2023-11-15T01:22:22.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.843+0000 7f0b47f3e700 1 -- 172.21.15.1:0/3094659231 shutdown_connections 2023-11-15T01:22:22.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.843+0000 7f0b47f3e700 1 --2- 172.21.15.1:0/3094659231 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0b2c05f120 0x7f0b2c0615e0 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0x7f0b4015ae70 tx=0x7f0b34009040).stop 2023-11-15T01:22:22.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.843+0000 7f0b47f3e700 1 --2- 172.21.15.1:0/3094659231 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b40154480 0x7f0b40159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:22.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.843+0000 7f0b47f3e700 1 --2- 172.21.15.1:0/3094659231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b400c6650 0x7f0b4014f0d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:22.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.843+0000 7f0b47f3e700 1 --2- 172.21.15.1:0/3094659231 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b401540a0 0x7f0b40159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:22.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.843+0000 7f0b47f3e700 1 -- 172.21.15.1:0/3094659231 >> 172.21.15.1:0/3094659231 conn(0x7f0b40064a70 msgr2=0x7f0b400aba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:22.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.845+0000 7f0b47f3e700 1 -- 172.21.15.1:0/3094659231 shutdown_connections 2023-11-15T01:22:22.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.845+0000 7f0b47f3e700 1 -- 172.21.15.1:0/3094659231 wait complete. 2023-11-15T01:22:22.861 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2023-11-15T01:22:22.875 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-15T01:22:23.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.999+0000 7fe7cd96d700 1 Processor -- start 2023-11-15T01:22:23.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:22.999+0000 7fe7cd96d700 1 -- start start 2023-11-15T01:22:23.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.000+0000 7fe7cd96d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7c813a7e0 0x7fe7c80c2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.000+0000 7fe7cd96d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe7c8065670 0x7fe7c8151620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.000+0000 7fe7cd96d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c80bd950 con 0x7fe7c8066250 2023-11-15T01:22:23.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.000+0000 7fe7cd96d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c813abc0 con 0x7fe7c8065670 2023-11-15T01:22:23.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.000+0000 7fe7cd96d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c8151c70 con 0x7fe7c813a7e0 2023-11-15T01:22:23.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.000+0000 7fe7cd16c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe7c8066250 0x7fe7c80bdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49118/0 (socket says 172.21.15.1:49118) 2023-11-15T01:22:23.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.000+0000 7fe7cd16c700 1 -- 172.21.15.1:0/825993082 learned_addr learned my addr 172.21.15.1:0/825993082 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:23.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.000+0000 7fe7cc96b700 1 --2- 172.21.15.1:0/825993082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7c813a7e0 0x7fe7c80c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.000+0000 7fe7c77fe700 1 -- 172.21.15.1:0/825993082 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027440115 0 0) 0x7fe7c80bd950 con 0x7fe7c8066250 2023-11-15T01:22:23.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.000+0000 7fe7c77fe700 1 -- 172.21.15.1:0/825993082 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b00033f0 con 0x7fe7c8066250 2023-11-15T01:22:23.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.000+0000 7fe7c7fff700 1 --2- 172.21.15.1:0/825993082 >> v2:172.21.15.141:3300/0 conn(0x7fe7c8065670 0x7fe7c8151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c77fe700 1 -- 172.21.15.1:0/825993082 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1354776377 0 0) 0x7fe7b00033f0 con 0x7fe7c8066250 2023-11-15T01:22:23.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c77fe700 1 -- 172.21.15.1:0/825993082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7c813a7e0 msgr2=0x7fe7c80c2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:23.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c77fe700 1 --2- 172.21.15.1:0/825993082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7c813a7e0 0x7fe7c80c2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c77fe700 1 -- 172.21.15.1:0/825993082 >> v2:172.21.15.141:3300/0 conn(0x7fe7c8065670 msgr2=0x7fe7c8151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:23.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c77fe700 1 --2- 172.21.15.1:0/825993082 >> v2:172.21.15.141:3300/0 conn(0x7fe7c8065670 0x7fe7c8151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c77fe700 1 -- 172.21.15.1:0/825993082 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c8151f50 con 0x7fe7c8066250 2023-11-15T01:22:23.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c77fe700 1 -- 172.21.15.1:0/825993082 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fe7b8001470 con 0x7fe7c8066250 2023-11-15T01:22:23.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c77fe700 1 -- 172.21.15.1:0/825993082 >> v1:172.21.15.1:6789/0 conn(0x7fe7c8066250 legacy=0x7fe7c80bdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c77fe700 1 --2- 172.21.15.1:0/825993082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7c813a7e0 0x7fe7b00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c77fe700 1 --2- 172.21.15.1:0/825993082 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7b0003e10 0x7fe7b0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c77fe700 1 --2- 172.21.15.1:0/825993082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7b0004b80 0x7fe7b0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c77fe700 1 -- 172.21.15.1:0/825993082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c813abc0 con 0x7fe7b0004b80 2023-11-15T01:22:23.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c77fe700 1 -- 172.21.15.1:0/825993082 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c8151c70 con 0x7fe7b0003e10 2023-11-15T01:22:23.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c77fe700 1 -- 172.21.15.1:0/825993082 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b000daf0 con 0x7fe7c813a7e0 2023-11-15T01:22:23.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7cd16c700 1 --2- 172.21.15.1:0/825993082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7b0004b80 0x7fe7b0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c7fff700 1 --2- 172.21.15.1:0/825993082 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7b0003e10 0x7fe7b0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7cc96b700 1 --2- 172.21.15.1:0/825993082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7c813a7e0 0x7fe7b00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7cd16c700 1 -- 172.21.15.1:0/825993082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7c813a7e0 msgr2=0x7fe7b00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:23.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7cd16c700 1 --2- 172.21.15.1:0/825993082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7c813a7e0 0x7fe7b00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7cd16c700 1 -- 172.21.15.1:0/825993082 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7b0003e10 msgr2=0x7fe7b0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:23.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7cd16c700 1 --2- 172.21.15.1:0/825993082 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7b0003e10 0x7fe7b0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7cd16c700 1 -- 172.21.15.1:0/825993082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b00033f0 con 0x7fe7b0004b80 2023-11-15T01:22:23.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7cd16c700 1 --2- 172.21.15.1:0/825993082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7b0004b80 0x7fe7b0005000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fe7b800c240 tx=0x7fe7b8001e90).ready entity=mon.0 client_cookie=b4c013e089b466fd server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:23.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.001+0000 7fe7c77fe700 1 -- 172.21.15.1:0/825993082 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8007a60 con 0x7fe7b0004b80 2023-11-15T01:22:23.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.002+0000 7fe7c77fe700 1 -- 172.21.15.1:0/825993082 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b800cad0 con 0x7fe7b0004b80 2023-11-15T01:22:23.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.002+0000 7fe7c77fe700 1 -- 172.21.15.1:0/825993082 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b800ce50 con 0x7fe7b0004b80 2023-11-15T01:22:23.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.002+0000 7fe7cd96d700 1 -- 172.21.15.1:0/825993082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7b0004b80 msgr2=0x7fe7b0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.002+0000 7fe7cd96d700 1 --2- 172.21.15.1:0/825993082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7b0004b80 0x7fe7b0005000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fe7b800c240 tx=0x7fe7b8001e90).stop 2023-11-15T01:22:23.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.002+0000 7fe7cd16c700 1 -- 172.21.15.1:0/825993082 reap_dead start 2023-11-15T01:22:23.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.002+0000 7fe7cd96d700 1 -- 172.21.15.1:0/825993082 shutdown_connections 2023-11-15T01:22:23.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.002+0000 7fe7cd96d700 1 -- 172.21.15.1:0/825993082 >> 172.21.15.1:0/825993082 conn(0x7fe7c8064390 msgr2=0x7fe7c80c7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:23.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.002+0000 7fe7cd96d700 1 -- 172.21.15.1:0/825993082 shutdown_connections 2023-11-15T01:22:23.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.002+0000 7fe7cd96d700 1 -- 172.21.15.1:0/825993082 wait complete. 2023-11-15T01:22:23.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.003+0000 7fe7cd96d700 1 Processor -- start 2023-11-15T01:22:23.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.003+0000 7fe7cd96d700 1 -- start start 2023-11-15T01:22:23.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.004+0000 7fe7cd96d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7c8150700 0x7fe7c80ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.004+0000 7fe7cd96d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7c80ad520 0x7fe7c80a7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.004+0000 7fe7cd96d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c80a7d10 0x7fe7c80ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.004+0000 7fe7cd96d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80bf880 con 0x7fe7c80a7d10 2023-11-15T01:22:23.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.004+0000 7fe7cd96d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80aac10 con 0x7fe7c8150700 2023-11-15T01:22:23.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.004+0000 7fe7cd96d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80aaeb0 con 0x7fe7c80ad520 2023-11-15T01:22:23.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.004+0000 7fe7cd16c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c80a7d10 0x7fe7c80ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.004+0000 7fe7cd16c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c80a7d10 0x7fe7c80ab340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44142/0 (socket says 172.21.15.1:44142) 2023-11-15T01:22:23.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.004+0000 7fe7cd16c700 1 -- 172.21.15.1:0/3267178774 learned_addr learned my addr 172.21.15.1:0/3267178774 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:23.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.004+0000 7fe7c7fff700 1 --2- 172.21.15.1:0/3267178774 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7c80ad520 0x7fe7c80a7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.004+0000 7fe7cc96b700 1 --2- 172.21.15.1:0/3267178774 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7c8150700 0x7fe7c80ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.005+0000 7fe7cd16c700 1 -- 172.21.15.1:0/3267178774 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7c80ad520 msgr2=0x7fe7c80a7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.005+0000 7fe7cd16c700 1 --2- 172.21.15.1:0/3267178774 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7c80ad520 0x7fe7c80a7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.005+0000 7fe7cd16c700 1 -- 172.21.15.1:0/3267178774 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7c8150700 msgr2=0x7fe7c80ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.005+0000 7fe7cd16c700 1 --2- 172.21.15.1:0/3267178774 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7c8150700 0x7fe7c80ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.005+0000 7fe7cd16c700 1 -- 172.21.15.1:0/3267178774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c80ad9a0 con 0x7fe7c80a7d10 2023-11-15T01:22:23.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.005+0000 7fe7c7fff700 1 --2- 172.21.15.1:0/3267178774 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7c80ad520 0x7fe7c80a7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:23.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.005+0000 7fe7cd16c700 1 --2- 172.21.15.1:0/3267178774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c80a7d10 0x7fe7c80ab340 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fe7b800c160 tx=0x7fe7b8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:23.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.005+0000 7fe7c4ff9700 1 -- 172.21.15.1:0/3267178774 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8007a60 con 0x7fe7c80a7d10 2023-11-15T01:22:23.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.005+0000 7fe7c4ff9700 1 -- 172.21.15.1:0/3267178774 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b8001430 con 0x7fe7c80a7d10 2023-11-15T01:22:23.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.005+0000 7fe7cd96d700 1 -- 172.21.15.1:0/3267178774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c80a8550 con 0x7fe7c80a7d10 2023-11-15T01:22:23.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.005+0000 7fe7c4ff9700 1 -- 172.21.15.1:0/3267178774 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8004bb0 con 0x7fe7c80a7d10 2023-11-15T01:22:23.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.005+0000 7fe7cd96d700 1 -- 172.21.15.1:0/3267178774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c80a8b10 con 0x7fe7c80a7d10 2023-11-15T01:22:23.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.006+0000 7fe7cd96d700 1 -- 172.21.15.1:0/3267178774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c80a8d00 con 0x7fe7c80a7d10 2023-11-15T01:22:23.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.006+0000 7fe7c4ff9700 1 -- 172.21.15.1:0/3267178774 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe7b8013450 con 0x7fe7c80a7d10 2023-11-15T01:22:23.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.007+0000 7fe7c4ff9700 1 --2- 172.21.15.1:0/3267178774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe7b405f150 0x7fe7b4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.007+0000 7fe7c4ff9700 1 -- 172.21.15.1:0/3267178774 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fe7b807ab90 con 0x7fe7c80a7d10 2023-11-15T01:22:23.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.007+0000 7fe7cc96b700 1 --2- 172.21.15.1:0/3267178774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe7b405f150 0x7fe7b4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.008+0000 7fe7cc96b700 1 --2- 172.21.15.1:0/3267178774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe7b405f150 0x7fe7b4061610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fe7c00094d0 tx=0x7fe7c000b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:23.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.012+0000 7fe7c4ff9700 1 -- 172.21.15.1:0/3267178774 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe7b804bf10 con 0x7fe7c80a7d10 2023-11-15T01:22:23.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.226+0000 7fe7cd96d700 1 -- 172.21.15.1:0/3267178774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe7c80475e0 con 0x7fe7c80a7d10 2023-11-15T01:22:23.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.232+0000 7fe7c4ff9700 1 -- 172.21.15.1:0/3267178774 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe7b8025030 con 0x7fe7c80a7d10 2023-11-15T01:22:23.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.241+0000 7fe7cd96d700 1 -- 172.21.15.1:0/3267178774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe7b405f150 msgr2=0x7fe7b4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.241+0000 7fe7cd96d700 1 --2- 172.21.15.1:0/3267178774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe7b405f150 0x7fe7b4061610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fe7c00094d0 tx=0x7fe7c000b040).stop 2023-11-15T01:22:23.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.242+0000 7fe7cd96d700 1 -- 172.21.15.1:0/3267178774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c80a7d10 msgr2=0x7fe7c80ab340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.242+0000 7fe7cd96d700 1 --2- 172.21.15.1:0/3267178774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c80a7d10 0x7fe7c80ab340 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fe7b800c160 tx=0x7fe7b8015000).stop 2023-11-15T01:22:23.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.242+0000 7fe7cd96d700 1 -- 172.21.15.1:0/3267178774 shutdown_connections 2023-11-15T01:22:23.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.242+0000 7fe7cd96d700 1 --2- 172.21.15.1:0/3267178774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe7b405f150 0x7fe7b4061610 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.242+0000 7fe7cd96d700 1 --2- 172.21.15.1:0/3267178774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c80a7d10 0x7fe7c80ab340 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.242+0000 7fe7cd96d700 1 --2- 172.21.15.1:0/3267178774 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7c8150700 0x7fe7c80ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.242+0000 7fe7cd96d700 1 --2- 172.21.15.1:0/3267178774 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7c80ad520 0x7fe7c80a7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.242+0000 7fe7cd96d700 1 -- 172.21.15.1:0/3267178774 >> 172.21.15.1:0/3267178774 conn(0x7fe7c8064390 msgr2=0x7fe7c8154080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:23.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.242+0000 7fe7cd96d700 1 -- 172.21.15.1:0/3267178774 shutdown_connections 2023-11-15T01:22:23.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.243+0000 7fe7cd96d700 1 -- 172.21.15.1:0/3267178774 wait complete. 2023-11-15T01:22:23.254 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 5 and data pool 6 2023-11-15T01:22:23.264 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:22:23.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.381+0000 7f44d2392700 1 Processor -- start 2023-11-15T01:22:23.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.382+0000 7f44d2392700 1 -- start start 2023-11-15T01:22:23.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.382+0000 7f44d2392700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f44cc154150 0x7f44cc154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.382+0000 7f44d2392700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44cc0c06f0 con 0x7f44cc0aa060 2023-11-15T01:22:23.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.382+0000 7f44d2392700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44cc0c09d0 con 0x7f44cc0ab1a0 2023-11-15T01:22:23.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.382+0000 7f44d2392700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44cc158820 con 0x7f44cc154150 2023-11-15T01:22:23.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.382+0000 7f44cbfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f44cc154150 0x7f44cc154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.383+0000 7f44d092f700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f44cc0aa060 0x7f44cc0c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49130/0 (socket says 172.21.15.1:49130) 2023-11-15T01:22:23.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.383+0000 7f44d092f700 1 -- 172.21.15.1:0/952653285 learned_addr learned my addr 172.21.15.1:0/952653285 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:23.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.383+0000 7f44cbfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f44cc154150 0x7f44cc154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44144/0 (socket says 172.21.15.1:44144) 2023-11-15T01:22:23.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.383+0000 7f44cbfff700 1 -- 172.21.15.1:0/952653285 >> v1:172.21.15.141:6789/0 conn(0x7f44cc0ab1a0 legacy=0x7f44cc158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:23.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.383+0000 7f44cbfff700 1 -- 172.21.15.1:0/952653285 >> v1:172.21.15.1:6789/0 conn(0x7f44cc0aa060 legacy=0x7f44cc0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.383+0000 7f44cbfff700 1 -- 172.21.15.1:0/952653285 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc158b00 con 0x7f44cc154150 2023-11-15T01:22:23.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.383+0000 7f44cbfff700 1 --2- 172.21.15.1:0/952653285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44cc154150 0x7f44cc154530 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f44bc009760 tx=0x7f44bc009060).ready entity=mon.0 client_cookie=aee653ae6b693c89 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:23.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.383+0000 7f44caffd700 1 -- 172.21.15.1:0/952653285 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0090d0 con 0x7f44cc154150 2023-11-15T01:22:23.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.383+0000 7f44caffd700 1 -- 172.21.15.1:0/952653285 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc00b520 con 0x7f44cc154150 2023-11-15T01:22:23.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.383+0000 7f44caffd700 1 -- 172.21.15.1:0/952653285 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc00b8a0 con 0x7f44cc154150 2023-11-15T01:22:23.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.384+0000 7f44d2392700 1 -- 172.21.15.1:0/952653285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44cc154150 msgr2=0x7f44cc154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.384+0000 7f44d2392700 1 --2- 172.21.15.1:0/952653285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44cc154150 0x7f44cc154530 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f44bc009760 tx=0x7f44bc009060).stop 2023-11-15T01:22:23.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.384+0000 7f44d2392700 1 -- 172.21.15.1:0/952653285 shutdown_connections 2023-11-15T01:22:23.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.384+0000 7f44d2392700 1 --2- 172.21.15.1:0/952653285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44cc154150 0x7f44cc154530 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.384+0000 7f44d2392700 1 -- 172.21.15.1:0/952653285 >> 172.21.15.1:0/952653285 conn(0x7f44cc064aa0 msgr2=0x7f44cc064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:23.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.384+0000 7f44d2392700 1 -- 172.21.15.1:0/952653285 shutdown_connections 2023-11-15T01:22:23.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.384+0000 7f44d2392700 1 -- 172.21.15.1:0/952653285 wait complete. 2023-11-15T01:22:23.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.385+0000 7f44d2392700 1 Processor -- start 2023-11-15T01:22:23.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.385+0000 7f44d2392700 1 -- start start 2023-11-15T01:22:23.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44d2392700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44cc0aa060 0x7f44cc155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44d2392700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44cc0ab1a0 0x7f44cc157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44d2392700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44cc154150 0x7f44cc0c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44d2392700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc165400 con 0x7f44cc154150 2023-11-15T01:22:23.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44d2392700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc157a00 con 0x7f44cc0aa060 2023-11-15T01:22:23.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44d2392700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc1592d0 con 0x7f44cc0ab1a0 2023-11-15T01:22:23.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44d092f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44cc154150 0x7f44cc0c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44d092f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44cc154150 0x7f44cc0c2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44156/0 (socket says 172.21.15.1:44156) 2023-11-15T01:22:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44d092f700 1 -- 172.21.15.1:0/3809866430 learned_addr learned my addr 172.21.15.1:0/3809866430 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44cbfff700 1 --2- 172.21.15.1:0/3809866430 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44cc0aa060 0x7f44cc155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44cb7fe700 1 --2- 172.21.15.1:0/3809866430 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44cc0ab1a0 0x7f44cc157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44d092f700 1 -- 172.21.15.1:0/3809866430 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44cc0ab1a0 msgr2=0x7f44cc157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44d092f700 1 --2- 172.21.15.1:0/3809866430 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44cc0ab1a0 0x7f44cc157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44d092f700 1 -- 172.21.15.1:0/3809866430 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44cc0aa060 msgr2=0x7f44cc155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44d092f700 1 --2- 172.21.15.1:0/3809866430 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44cc0aa060 0x7f44cc155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44d092f700 1 -- 172.21.15.1:0/3809866430 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc0092a0 con 0x7f44cc154150 2023-11-15T01:22:23.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44cb7fe700 1 --2- 172.21.15.1:0/3809866430 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44cc0ab1a0 0x7f44cc157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:23.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44d092f700 1 --2- 172.21.15.1:0/3809866430 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44cc154150 0x7f44cc0c2300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f44c400c790 tx=0x7f44c40015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:23.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.386+0000 7f44c3fff700 1 -- 172.21.15.1:0/3809866430 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c4005d30 con 0x7f44cc154150 2023-11-15T01:22:23.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.387+0000 7f44c3fff700 1 -- 172.21.15.1:0/3809866430 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c4005e90 con 0x7f44cc154150 2023-11-15T01:22:23.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.387+0000 7f44d2392700 1 -- 172.21.15.1:0/3809866430 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44cc165120 con 0x7f44cc154150 2023-11-15T01:22:23.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.387+0000 7f44c3fff700 1 -- 172.21.15.1:0/3809866430 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c4007320 con 0x7f44cc154150 2023-11-15T01:22:23.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.387+0000 7f44d2392700 1 -- 172.21.15.1:0/3809866430 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44cc159870 con 0x7f44cc154150 2023-11-15T01:22:23.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.388+0000 7f44d2392700 1 -- 172.21.15.1:0/3809866430 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44cc159a90 con 0x7f44cc154150 2023-11-15T01:22:23.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.388+0000 7f44c3fff700 1 -- 172.21.15.1:0/3809866430 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f44c4007710 con 0x7f44cc154150 2023-11-15T01:22:23.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.388+0000 7f44c3fff700 1 --2- 172.21.15.1:0/3809866430 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f44ac05f150 0x7f44ac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.388+0000 7f44c3fff700 1 -- 172.21.15.1:0/3809866430 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f44c407a080 con 0x7f44cc154150 2023-11-15T01:22:23.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.389+0000 7f44cbfff700 1 --2- 172.21.15.1:0/3809866430 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f44ac05f150 0x7f44ac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.389+0000 7f44cbfff700 1 --2- 172.21.15.1:0/3809866430 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f44ac05f150 0x7f44ac061610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f44cc0ca390 tx=0x7f44bc017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:23.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.393+0000 7f44c3fff700 1 -- 172.21.15.1:0/3809866430 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f44c404b350 con 0x7f44cc154150 2023-11-15T01:22:23.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.564+0000 7f44d2392700 1 -- 172.21.15.1:0/3809866430 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44cc06c7e0 con 0x7f44cc154150 2023-11-15T01:22:23.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.565+0000 7f44c3fff700 1 -- 172.21.15.1:0/3809866430 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16893 (secure 0 0 0) 0x7f44c404e970 con 0x7f44cc154150 2023-11-15T01:22:23.567 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:23.567 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":33,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:22:23.228573+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:22:21.423841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-15T01:22:22.202076+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:22:23.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.567+0000 7f44d2392700 1 -- 172.21.15.1:0/3809866430 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f44ac05f150 msgr2=0x7f44ac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.567+0000 7f44d2392700 1 --2- 172.21.15.1:0/3809866430 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f44ac05f150 0x7f44ac061610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f44cc0ca390 tx=0x7f44bc017000).stop 2023-11-15T01:22:23.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.567+0000 7f44d2392700 1 -- 172.21.15.1:0/3809866430 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44cc154150 msgr2=0x7f44cc0c2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.567+0000 7f44d2392700 1 --2- 172.21.15.1:0/3809866430 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44cc154150 0x7f44cc0c2300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f44c400c790 tx=0x7f44c40015e0).stop 2023-11-15T01:22:23.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.567+0000 7f44d2392700 1 -- 172.21.15.1:0/3809866430 shutdown_connections 2023-11-15T01:22:23.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.567+0000 7f44d2392700 1 --2- 172.21.15.1:0/3809866430 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f44ac05f150 0x7f44ac061610 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.567+0000 7f44d2392700 1 --2- 172.21.15.1:0/3809866430 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44cc154150 0x7f44cc0c2300 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.567+0000 7f44d2392700 1 --2- 172.21.15.1:0/3809866430 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44cc0aa060 0x7f44cc155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.567+0000 7f44d2392700 1 --2- 172.21.15.1:0/3809866430 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44cc0ab1a0 0x7f44cc157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.567+0000 7f44d2392700 1 -- 172.21.15.1:0/3809866430 >> 172.21.15.1:0/3809866430 conn(0x7f44cc064aa0 msgr2=0x7f44cc0c7850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:23.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.567+0000 7f44d2392700 1 -- 172.21.15.1:0/3809866430 shutdown_connections 2023-11-15T01:22:23.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.567+0000 7f44d2392700 1 -- 172.21.15.1:0/3809866430 wait complete. 2023-11-15T01:22:23.581 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:22:23.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.699+0000 7ffad359e700 1 Processor -- start 2023-11-15T01:22:23.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.699+0000 7ffad359e700 1 -- start start 2023-11-15T01:22:23.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.700+0000 7ffad359e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffad4151fd0 0x7ffad40a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.700+0000 7ffad359e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ffad41523b0 0x7ffad40bf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.700+0000 7ffad359e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad40bec10 con 0x7ffad40bf590 2023-11-15T01:22:23.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.700+0000 7ffad359e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad40c7c70 con 0x7ffad41523b0 2023-11-15T01:22:23.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.700+0000 7ffad359e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad40c7f50 con 0x7ffad4151fd0 2023-11-15T01:22:23.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.700+0000 7ffad1d9b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ffad41523b0 0x7ffad40bf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.700+0000 7ffad259c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffad4151fd0 0x7ffad40a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.700+0000 7ffad259c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffad4151fd0 0x7ffad40a5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:42248/0 (socket says 172.21.15.1:42248) 2023-11-15T01:22:23.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.700+0000 7ffad2d9d700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7ffad40bf590 0x7ffad40c6b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:49226/0 (socket says 172.21.15.1:49226) 2023-11-15T01:22:23.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.700+0000 7ffad259c700 1 -- 172.21.15.1:0/2683012112 learned_addr learned my addr 172.21.15.1:0/2683012112 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:23.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.700+0000 7ffad1d9b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ffad41523b0 0x7ffad40bf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:38400/0 (socket says 172.21.15.1:38400) 2023-11-15T01:22:23.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad1d9b700 1 -- 172.21.15.1:0/2683012112 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffad4151fd0 msgr2=0x7ffad40a5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:23.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad1d9b700 1 --2- 172.21.15.1:0/2683012112 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffad4151fd0 0x7ffad40a5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad1d9b700 1 -- 172.21.15.1:0/2683012112 >> v1:172.21.15.141:6789/0 conn(0x7ffad40bf590 legacy=0x7ffad40c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad159a700 1 -- 172.21.15.1:0/2683012112 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967664676 0 0) 0x7ffad40bec10 con 0x7ffad40bf590 2023-11-15T01:22:23.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad1d9b700 1 -- 172.21.15.1:0/2683012112 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad40c8230 con 0x7ffad41523b0 2023-11-15T01:22:23.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad259c700 1 --2- 172.21.15.1:0/2683012112 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffad4151fd0 0x7ffad40a5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:23.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad1d9b700 1 --2- 172.21.15.1:0/2683012112 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffad41523b0 0x7ffad40bf0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ffac8009760 tx=0x7ffac8009060).ready entity=mon.1 client_cookie=ffa23681e6cc61a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:23.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad159a700 1 -- 172.21.15.1:0/2683012112 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac800f510 con 0x7ffad41523b0 2023-11-15T01:22:23.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad159a700 1 -- 172.21.15.1:0/2683012112 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac800f670 con 0x7ffad41523b0 2023-11-15T01:22:23.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad159a700 1 -- 172.21.15.1:0/2683012112 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac800f9f0 con 0x7ffad41523b0 2023-11-15T01:22:23.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad359e700 1 -- 172.21.15.1:0/2683012112 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffad41523b0 msgr2=0x7ffad40bf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad359e700 1 --2- 172.21.15.1:0/2683012112 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffad41523b0 0x7ffad40bf0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ffac8009760 tx=0x7ffac8009060).stop 2023-11-15T01:22:23.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad359e700 1 -- 172.21.15.1:0/2683012112 shutdown_connections 2023-11-15T01:22:23.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad359e700 1 --2- 172.21.15.1:0/2683012112 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffad4151fd0 0x7ffad40a5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad359e700 1 --2- 172.21.15.1:0/2683012112 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffad41523b0 0x7ffad40bf0a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad359e700 1 -- 172.21.15.1:0/2683012112 >> 172.21.15.1:0/2683012112 conn(0x7ffad4062f90 msgr2=0x7ffad40c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:23.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.701+0000 7ffad359e700 1 -- 172.21.15.1:0/2683012112 shutdown_connections 2023-11-15T01:22:23.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.702+0000 7ffad359e700 1 -- 172.21.15.1:0/2683012112 wait complete. 2023-11-15T01:22:23.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.703+0000 7ffad359e700 1 Processor -- start 2023-11-15T01:22:23.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.703+0000 7ffad359e700 1 -- start start 2023-11-15T01:22:23.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.703+0000 7ffad359e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffad40bf590 0x7ffad414e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.703+0000 7ffad359e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffad4151fd0 0x7ffad40aa640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.703+0000 7ffad359e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffad41523b0 0x7ffad40aab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.703+0000 7ffad359e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad40ab020 con 0x7ffad40bf590 2023-11-15T01:22:23.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.703+0000 7ffad359e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad4156450 con 0x7ffad41523b0 2023-11-15T01:22:23.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.703+0000 7ffad359e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad4155e40 con 0x7ffad4151fd0 2023-11-15T01:22:23.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.703+0000 7ffad259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffad40bf590 0x7ffad414e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.703+0000 7ffad259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffad40bf590 0x7ffad414e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44172/0 (socket says 172.21.15.1:44172) 2023-11-15T01:22:23.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.703+0000 7ffad259c700 1 -- 172.21.15.1:0/3929306518 learned_addr learned my addr 172.21.15.1:0/3929306518 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:23.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.704+0000 7ffad1d9b700 1 --2- 172.21.15.1:0/3929306518 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffad4151fd0 0x7ffad40aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.704+0000 7ffad2d9d700 1 --2- 172.21.15.1:0/3929306518 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffad41523b0 0x7ffad40aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.704+0000 7ffad259c700 1 -- 172.21.15.1:0/3929306518 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffad4151fd0 msgr2=0x7ffad40aa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.704+0000 7ffad259c700 1 --2- 172.21.15.1:0/3929306518 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffad4151fd0 0x7ffad40aa640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.704+0000 7ffad259c700 1 -- 172.21.15.1:0/3929306518 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffad41523b0 msgr2=0x7ffad40aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.704+0000 7ffad259c700 1 --2- 172.21.15.1:0/3929306518 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffad41523b0 0x7ffad40aab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.704+0000 7ffad259c700 1 -- 172.21.15.1:0/3929306518 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac4009370 con 0x7ffad40bf590 2023-11-15T01:22:23.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.704+0000 7ffad259c700 1 --2- 172.21.15.1:0/3929306518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffad40bf590 0x7ffad414e920 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7ffac400ea20 tx=0x7ffac40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:23.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.704+0000 7ffac27fc700 1 -- 172.21.15.1:0/3929306518 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400ee60 con 0x7ffad40bf590 2023-11-15T01:22:23.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.704+0000 7ffac27fc700 1 -- 172.21.15.1:0/3929306518 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac400c850 con 0x7ffad40bf590 2023-11-15T01:22:23.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.704+0000 7ffac27fc700 1 -- 172.21.15.1:0/3929306518 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400cbd0 con 0x7ffad40bf590 2023-11-15T01:22:23.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.704+0000 7ffad359e700 1 -- 172.21.15.1:0/3929306518 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac80092a0 con 0x7ffad40bf590 2023-11-15T01:22:23.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.704+0000 7ffad359e700 1 -- 172.21.15.1:0/3929306518 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad41560e0 con 0x7ffad40bf590 2023-11-15T01:22:23.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.705+0000 7ffad359e700 1 -- 172.21.15.1:0/3929306518 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad4155a00 con 0x7ffad40bf590 2023-11-15T01:22:23.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.705+0000 7ffac27fc700 1 -- 172.21.15.1:0/3929306518 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ffac401b400 con 0x7ffad40bf590 2023-11-15T01:22:23.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.706+0000 7ffac27fc700 1 --2- 172.21.15.1:0/3929306518 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ffab405f150 0x7ffab4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:23.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.706+0000 7ffac27fc700 1 -- 172.21.15.1:0/3929306518 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffac407a740 con 0x7ffad40bf590 2023-11-15T01:22:23.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.706+0000 7ffad1d9b700 1 --2- 172.21.15.1:0/3929306518 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ffab405f150 0x7ffab4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:23.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.706+0000 7ffad1d9b700 1 --2- 172.21.15.1:0/3929306518 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ffab405f150 0x7ffab4061610 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7ffac8009760 tx=0x7ffac8017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:23.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.710+0000 7ffac27fc700 1 -- 172.21.15.1:0/3929306518 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ffac404b9b0 con 0x7ffad40bf590 2023-11-15T01:22:23.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.885+0000 7ffad359e700 1 -- 172.21.15.1:0/3929306518 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffad40475e0 con 0x7ffad40bf590 2023-11-15T01:22:23.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.886+0000 7ffac27fc700 1 -- 172.21.15.1:0/3929306518 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16893 (secure 0 0 0) 0x7ffac4016020 con 0x7ffad40bf590 2023-11-15T01:22:23.888 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:23.888 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":33,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:22:23.228573+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:22:21.423841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-15T01:22:22.202076+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:22:23.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.888+0000 7ffad359e700 1 -- 172.21.15.1:0/3929306518 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ffab405f150 msgr2=0x7ffab4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.888+0000 7ffad359e700 1 --2- 172.21.15.1:0/3929306518 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ffab405f150 0x7ffab4061610 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7ffac8009760 tx=0x7ffac8017000).stop 2023-11-15T01:22:23.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.888+0000 7ffad359e700 1 -- 172.21.15.1:0/3929306518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffad40bf590 msgr2=0x7ffad414e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:23.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.888+0000 7ffad359e700 1 --2- 172.21.15.1:0/3929306518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffad40bf590 0x7ffad414e920 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7ffac400ea20 tx=0x7ffac40090f0).stop 2023-11-15T01:22:23.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.888+0000 7ffad359e700 1 -- 172.21.15.1:0/3929306518 shutdown_connections 2023-11-15T01:22:23.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.888+0000 7ffad359e700 1 --2- 172.21.15.1:0/3929306518 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ffab405f150 0x7ffab4061610 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.888+0000 7ffad359e700 1 --2- 172.21.15.1:0/3929306518 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffad41523b0 0x7ffad40aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.888+0000 7ffad359e700 1 --2- 172.21.15.1:0/3929306518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffad40bf590 0x7ffad414e920 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.888+0000 7ffad359e700 1 --2- 172.21.15.1:0/3929306518 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffad4151fd0 0x7ffad40aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.888+0000 7ffad359e700 1 -- 172.21.15.1:0/3929306518 >> 172.21.15.1:0/3929306518 conn(0x7ffad4062f90 msgr2=0x7ffad40c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.888+0000 7ffad359e700 1 -- 172.21.15.1:0/3929306518 shutdown_connections 2023-11-15T01:22:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:23.888+0000 7ffad359e700 1 -- 172.21.15.1:0/3929306518 wait complete. 2023-11-15T01:22:23.901 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-15T01:22:24.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.021+0000 7fcfb2e07700 1 Processor -- start 2023-11-15T01:22:24.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.021+0000 7fcfb2e07700 1 -- start start 2023-11-15T01:22:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.022+0000 7fcfb2e07700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcfac14ebd0 0x7fcfac137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.022+0000 7fcfb2e07700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfac154ce0 con 0x7fcfac066f80 2023-11-15T01:22:24.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.022+0000 7fcfb2e07700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfac154fc0 con 0x7fcfac137030 2023-11-15T01:22:24.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.022+0000 7fcfb2e07700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfac137900 con 0x7fcfac14ebd0 2023-11-15T01:22:24.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.022+0000 7fcfb13a4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcfac14ebd0 0x7fcfac137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:24.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.022+0000 7fcfabfff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fcfac066f80 0x7fcfac14e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49136/0 (socket says 172.21.15.1:49136) 2023-11-15T01:22:24.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.022+0000 7fcfabfff700 1 -- 172.21.15.1:0/1822937721 learned_addr learned my addr 172.21.15.1:0/1822937721 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:24.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.023+0000 7fcfb13a4700 1 -- 172.21.15.1:0/1822937721 >> v1:172.21.15.141:6789/0 conn(0x7fcfac137030 legacy=0x7fcfac066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:24.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.023+0000 7fcfb13a4700 1 -- 172.21.15.1:0/1822937721 >> v1:172.21.15.1:6789/0 conn(0x7fcfac066f80 legacy=0x7fcfac14e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:24.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.023+0000 7fcfb13a4700 1 -- 172.21.15.1:0/1822937721 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac1552a0 con 0x7fcfac14ebd0 2023-11-15T01:22:24.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.023+0000 7fcfb13a4700 1 --2- 172.21.15.1:0/1822937721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfac14ebd0 0x7fcfac137410 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fcf9c009760 tx=0x7fcf9c009060).ready entity=mon.0 client_cookie=71f89cd1aa1e4635 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:24.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.023+0000 7fcfab7fe700 1 -- 172.21.15.1:0/1822937721 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c00b580 con 0x7fcfac14ebd0 2023-11-15T01:22:24.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.023+0000 7fcfab7fe700 1 -- 172.21.15.1:0/1822937721 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c00b6e0 con 0x7fcfac14ebd0 2023-11-15T01:22:24.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.023+0000 7fcfab7fe700 1 -- 172.21.15.1:0/1822937721 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c00ba60 con 0x7fcfac14ebd0 2023-11-15T01:22:24.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.023+0000 7fcfb2e07700 1 -- 172.21.15.1:0/1822937721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfac14ebd0 msgr2=0x7fcfac137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:24.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.023+0000 7fcfb2e07700 1 --2- 172.21.15.1:0/1822937721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfac14ebd0 0x7fcfac137410 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fcf9c009760 tx=0x7fcf9c009060).stop 2023-11-15T01:22:24.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.023+0000 7fcfb2e07700 1 -- 172.21.15.1:0/1822937721 shutdown_connections 2023-11-15T01:22:24.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.023+0000 7fcfb2e07700 1 --2- 172.21.15.1:0/1822937721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfac14ebd0 0x7fcfac137410 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:24.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.023+0000 7fcfb2e07700 1 -- 172.21.15.1:0/1822937721 >> 172.21.15.1:0/1822937721 conn(0x7fcfac063280 msgr2=0x7fcfac0c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:24.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.023+0000 7fcfb2e07700 1 -- 172.21.15.1:0/1822937721 shutdown_connections 2023-11-15T01:22:24.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.024+0000 7fcfb2e07700 1 -- 172.21.15.1:0/1822937721 wait complete. 2023-11-15T01:22:24.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.025+0000 7fcfb2e07700 1 Processor -- start 2023-11-15T01:22:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.025+0000 7fcfb2e07700 1 -- start start 2023-11-15T01:22:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.025+0000 7fcfb2e07700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfac066f80 0x7fcfac0ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.025+0000 7fcfb2e07700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfac137030 0x7fcfac14ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.025+0000 7fcfb2e07700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfac14ebd0 0x7fcfac1504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.025+0000 7fcfb2e07700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac0ae230 con 0x7fcfac066f80 2023-11-15T01:22:24.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.025+0000 7fcfb2e07700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac151760 con 0x7fcfac14ebd0 2023-11-15T01:22:24.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.025+0000 7fcfb2e07700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac150b50 con 0x7fcfac137030 2023-11-15T01:22:24.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfb0ba3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfac066f80 0x7fcfac0ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:24.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfb0ba3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfac066f80 0x7fcfac0ac070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44184/0 (socket says 172.21.15.1:44184) 2023-11-15T01:22:24.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfb0ba3700 1 -- 172.21.15.1:0/3186978821 learned_addr learned my addr 172.21.15.1:0/3186978821 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:24.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfb13a4700 1 --2- 172.21.15.1:0/3186978821 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfac14ebd0 0x7fcfac1504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:24.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfabfff700 1 --2- 172.21.15.1:0/3186978821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfac137030 0x7fcfac14ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:24.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfb0ba3700 1 -- 172.21.15.1:0/3186978821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfac137030 msgr2=0x7fcfac14ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:24.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfb0ba3700 1 --2- 172.21.15.1:0/3186978821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfac137030 0x7fcfac14ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:24.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfb0ba3700 1 -- 172.21.15.1:0/3186978821 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfac14ebd0 msgr2=0x7fcfac1504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:24.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfb0ba3700 1 --2- 172.21.15.1:0/3186978821 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfac14ebd0 0x7fcfac1504d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:24.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfb0ba3700 1 -- 172.21.15.1:0/3186978821 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c0092a0 con 0x7fcfac066f80 2023-11-15T01:22:24.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfabfff700 1 --2- 172.21.15.1:0/3186978821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfac137030 0x7fcfac14ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:24.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfb0ba3700 1 --2- 172.21.15.1:0/3186978821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfac066f80 0x7fcfac0ac070 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fcfa400c840 tx=0x7fcfa4001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:24.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfa8ff9700 1 -- 172.21.15.1:0/3186978821 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4006a20 con 0x7fcfac066f80 2023-11-15T01:22:24.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfa8ff9700 1 -- 172.21.15.1:0/3186978821 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa4006b80 con 0x7fcfac066f80 2023-11-15T01:22:24.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfa8ff9700 1 -- 172.21.15.1:0/3186978821 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4007020 con 0x7fcfac066f80 2023-11-15T01:22:24.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfb2e07700 1 -- 172.21.15.1:0/3186978821 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfac150e30 con 0x7fcfac066f80 2023-11-15T01:22:24.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.026+0000 7fcfb2e07700 1 -- 172.21.15.1:0/3186978821 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfac1513f0 con 0x7fcfac066f80 2023-11-15T01:22:24.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.027+0000 7fcfb2e07700 1 -- 172.21.15.1:0/3186978821 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfac06c7e0 con 0x7fcfac066f80 2023-11-15T01:22:24.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.028+0000 7fcfa8ff9700 1 -- 172.21.15.1:0/3186978821 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcfa40073d0 con 0x7fcfac066f80 2023-11-15T01:22:24.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.028+0000 7fcfa8ff9700 1 --2- 172.21.15.1:0/3186978821 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf8c05f150 0x7fcf8c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:24.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.028+0000 7fcfa8ff9700 1 -- 172.21.15.1:0/3186978821 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcfa4079a60 con 0x7fcfac066f80 2023-11-15T01:22:24.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.028+0000 7fcfabfff700 1 --2- 172.21.15.1:0/3186978821 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf8c05f150 0x7fcf8c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:24.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.029+0000 7fcfabfff700 1 --2- 172.21.15.1:0/3186978821 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf8c05f150 0x7fcf8c061610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fcfac064b10 tx=0x7fcf94009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:24.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.032+0000 7fcfa8ff9700 1 -- 172.21.15.1:0/3186978821 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcfa4047af0 con 0x7fcfac066f80 2023-11-15T01:22:24.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:24.250+0000 7fcfb2e07700 1 -- 172.21.15.1:0/3186978821 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcfac0c9610 con 0x7fcfac066f80 2023-11-15T01:22:25.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.232+0000 7fcfa8ff9700 1 -- 172.21.15.1:0/3186978821 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcfa404ad30 con 0x7fcfac066f80 2023-11-15T01:22:25.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.235+0000 7fcfb2e07700 1 -- 172.21.15.1:0/3186978821 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf8c05f150 msgr2=0x7fcf8c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:25.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.235+0000 7fcfb2e07700 1 --2- 172.21.15.1:0/3186978821 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf8c05f150 0x7fcf8c061610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fcfac064b10 tx=0x7fcf94009040).stop 2023-11-15T01:22:25.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.235+0000 7fcfb2e07700 1 -- 172.21.15.1:0/3186978821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfac066f80 msgr2=0x7fcfac0ac070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:25.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.235+0000 7fcfb2e07700 1 --2- 172.21.15.1:0/3186978821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfac066f80 0x7fcfac0ac070 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fcfa400c840 tx=0x7fcfa4001660).stop 2023-11-15T01:22:25.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.235+0000 7fcfb2e07700 1 -- 172.21.15.1:0/3186978821 shutdown_connections 2023-11-15T01:22:25.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.235+0000 7fcfb2e07700 1 --2- 172.21.15.1:0/3186978821 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf8c05f150 0x7fcf8c061610 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:25.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.235+0000 7fcfb2e07700 1 --2- 172.21.15.1:0/3186978821 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfac14ebd0 0x7fcfac1504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:25.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.235+0000 7fcfb2e07700 1 --2- 172.21.15.1:0/3186978821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfac066f80 0x7fcfac0ac070 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:25.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.235+0000 7fcfb2e07700 1 --2- 172.21.15.1:0/3186978821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfac137030 0x7fcfac14ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.235+0000 7fcfb2e07700 1 -- 172.21.15.1:0/3186978821 >> 172.21.15.1:0/3186978821 conn(0x7fcfac063280 msgr2=0x7fcfac0c59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.235+0000 7fcfb2e07700 1 -- 172.21.15.1:0/3186978821 shutdown_connections 2023-11-15T01:22:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.235+0000 7fcfb2e07700 1 -- 172.21.15.1:0/3186978821 wait complete. 2023-11-15T01:22:25.251 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-15T01:22:25.252 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-15T01:22:25.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.378+0000 7ff51962e700 1 Processor -- start 2023-11-15T01:22:25.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.378+0000 7ff51962e700 1 -- start start 2023-11-15T01:22:25.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.379+0000 7ff51962e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff5140c6650 0x7ff5140aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:25.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.379+0000 7ff51962e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5140ca050 con 0x7ff514154480 2023-11-15T01:22:25.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.379+0000 7ff51962e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5140c9440 con 0x7ff5141540a0 2023-11-15T01:22:25.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.379+0000 7ff51962e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5140c9720 con 0x7ff5140c6650 2023-11-15T01:22:25.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.379+0000 7ff5137fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff5140c6650 0x7ff5140aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:25.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.379+0000 7ff5127fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff514154480 0x7ff5140c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49150/0 (socket says 172.21.15.1:49150) 2023-11-15T01:22:25.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.379+0000 7ff5137fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff5140c6650 0x7ff5140aaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44192/0 (socket says 172.21.15.1:44192) 2023-11-15T01:22:25.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.379+0000 7ff5127fc700 1 -- 172.21.15.1:0/2331580137 learned_addr learned my addr 172.21.15.1:0/2331580137 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:25.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.379+0000 7ff5137fe700 1 -- 172.21.15.1:0/2331580137 >> v1:172.21.15.141:6789/0 conn(0x7ff5141540a0 legacy=0x7ff5140ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:25.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.379+0000 7ff5137fe700 1 -- 172.21.15.1:0/2331580137 >> v1:172.21.15.1:6789/0 conn(0x7ff514154480 legacy=0x7ff5140c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:25.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.379+0000 7ff511ffb700 1 -- 172.21.15.1:0/2331580137 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314573354 0 0) 0x7ff5140ca050 con 0x7ff514154480 2023-11-15T01:22:25.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.379+0000 7ff5137fe700 1 -- 172.21.15.1:0/2331580137 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5140c9a00 con 0x7ff5140c6650 2023-11-15T01:22:25.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.379+0000 7ff5137fe700 1 --2- 172.21.15.1:0/2331580137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5140c6650 0x7ff5140aaf40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7ff50c009760 tx=0x7ff50c009060).ready entity=mon.0 client_cookie=957c1500b49ffa2b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:25.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.379+0000 7ff511ffb700 1 -- 172.21.15.1:0/2331580137 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c00b580 con 0x7ff5140c6650 2023-11-15T01:22:25.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.380+0000 7ff511ffb700 1 -- 172.21.15.1:0/2331580137 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c00b6e0 con 0x7ff5140c6650 2023-11-15T01:22:25.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.380+0000 7ff511ffb700 1 -- 172.21.15.1:0/2331580137 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c00ba60 con 0x7ff5140c6650 2023-11-15T01:22:25.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.380+0000 7ff51962e700 1 -- 172.21.15.1:0/2331580137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5140c6650 msgr2=0x7ff5140aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:25.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.380+0000 7ff51962e700 1 --2- 172.21.15.1:0/2331580137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5140c6650 0x7ff5140aaf40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7ff50c009760 tx=0x7ff50c009060).stop 2023-11-15T01:22:25.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.380+0000 7ff51962e700 1 -- 172.21.15.1:0/2331580137 shutdown_connections 2023-11-15T01:22:25.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.380+0000 7ff51962e700 1 --2- 172.21.15.1:0/2331580137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5140c6650 0x7ff5140aaf40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:25.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.380+0000 7ff51962e700 1 -- 172.21.15.1:0/2331580137 >> 172.21.15.1:0/2331580137 conn(0x7ff514064a70 msgr2=0x7ff514064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:25.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.380+0000 7ff51962e700 1 -- 172.21.15.1:0/2331580137 shutdown_connections 2023-11-15T01:22:25.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.380+0000 7ff51962e700 1 -- 172.21.15.1:0/2331580137 wait complete. 2023-11-15T01:22:25.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.381+0000 7ff51962e700 1 Processor -- start 2023-11-15T01:22:25.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.381+0000 7ff51962e700 1 -- start start 2023-11-15T01:22:25.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.382+0000 7ff51962e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5140c6650 0x7ff5140ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:25.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.382+0000 7ff51962e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5141540a0 0x7ff5140c0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:25.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.382+0000 7ff51962e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff514154480 0x7ff51415a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:25.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.382+0000 7ff51962e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51415a370 con 0x7ff514154480 2023-11-15T01:22:25.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.382+0000 7ff51962e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140ad200 con 0x7ff5140c6650 2023-11-15T01:22:25.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.382+0000 7ff51962e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff514159d20 con 0x7ff5141540a0 2023-11-15T01:22:25.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.382+0000 7ff5137fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff514154480 0x7ff51415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:25.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.382+0000 7ff5137fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff514154480 0x7ff51415a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44194/0 (socket says 172.21.15.1:44194) 2023-11-15T01:22:25.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.382+0000 7ff5137fe700 1 -- 172.21.15.1:0/279632587 learned_addr learned my addr 172.21.15.1:0/279632587 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:25.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.382+0000 7ff5127fc700 1 --2- 172.21.15.1:0/279632587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5141540a0 0x7ff5140c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:25.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.382+0000 7ff512ffd700 1 --2- 172.21.15.1:0/279632587 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5140c6650 0x7ff5140ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:25.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.382+0000 7ff5137fe700 1 -- 172.21.15.1:0/279632587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5141540a0 msgr2=0x7ff5140c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:25.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.382+0000 7ff5137fe700 1 --2- 172.21.15.1:0/279632587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5141540a0 0x7ff5140c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:25.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.383+0000 7ff5137fe700 1 -- 172.21.15.1:0/279632587 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5140c6650 msgr2=0x7ff5140ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:25.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.383+0000 7ff5137fe700 1 --2- 172.21.15.1:0/279632587 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5140c6650 0x7ff5140ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:25.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.383+0000 7ff5137fe700 1 -- 172.21.15.1:0/279632587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c0092a0 con 0x7ff514154480 2023-11-15T01:22:25.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.383+0000 7ff5137fe700 1 --2- 172.21.15.1:0/279632587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff514154480 0x7ff51415a800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7ff5140c2070 tx=0x7ff50c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:25.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.383+0000 7ff50affd700 1 -- 172.21.15.1:0/279632587 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c00ba60 con 0x7ff514154480 2023-11-15T01:22:25.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.383+0000 7ff50affd700 1 -- 172.21.15.1:0/279632587 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c01b410 con 0x7ff514154480 2023-11-15T01:22:25.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.383+0000 7ff51962e700 1 -- 172.21.15.1:0/279632587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51415a000 con 0x7ff514154480 2023-11-15T01:22:25.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.383+0000 7ff50affd700 1 -- 172.21.15.1:0/279632587 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c01b790 con 0x7ff514154480 2023-11-15T01:22:25.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.383+0000 7ff51962e700 1 -- 172.21.15.1:0/279632587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5140ae570 con 0x7ff514154480 2023-11-15T01:22:25.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.384+0000 7ff51962e700 1 -- 172.21.15.1:0/279632587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51406c7e0 con 0x7ff514154480 2023-11-15T01:22:25.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.384+0000 7ff50affd700 1 -- 172.21.15.1:0/279632587 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff50c01bbc0 con 0x7ff514154480 2023-11-15T01:22:25.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.384+0000 7ff50affd700 1 --2- 172.21.15.1:0/279632587 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff4f405f150 0x7ff4f4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:25.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.385+0000 7ff50affd700 1 -- 172.21.15.1:0/279632587 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff50c07c130 con 0x7ff514154480 2023-11-15T01:22:25.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.385+0000 7ff512ffd700 1 --2- 172.21.15.1:0/279632587 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff4f405f150 0x7ff4f4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:25.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.385+0000 7ff512ffd700 1 --2- 172.21.15.1:0/279632587 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff4f405f150 0x7ff4f4061610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7ff504003e70 tx=0x7ff504009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:25.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.389+0000 7ff50affd700 1 -- 172.21.15.1:0/279632587 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff50c04d400 con 0x7ff514154480 2023-11-15T01:22:25.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:25.606+0000 7ff51962e700 1 -- 172.21.15.1:0/279632587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff5140c9ce0 con 0x7ff514154480 2023-11-15T01:22:26.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.238+0000 7ff50affd700 1 -- 172.21.15.1:0/279632587 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff50c006b30 con 0x7ff514154480 2023-11-15T01:22:26.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.240+0000 7ff51962e700 1 -- 172.21.15.1:0/279632587 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff4f405f150 msgr2=0x7ff4f4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:26.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.240+0000 7ff51962e700 1 --2- 172.21.15.1:0/279632587 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff4f405f150 0x7ff4f4061610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7ff504003e70 tx=0x7ff504009040).stop 2023-11-15T01:22:26.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.240+0000 7ff51962e700 1 -- 172.21.15.1:0/279632587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff514154480 msgr2=0x7ff51415a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:26.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.240+0000 7ff51962e700 1 --2- 172.21.15.1:0/279632587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff514154480 0x7ff51415a800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7ff5140c2070 tx=0x7ff50c017000).stop 2023-11-15T01:22:26.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.240+0000 7ff51962e700 1 -- 172.21.15.1:0/279632587 shutdown_connections 2023-11-15T01:22:26.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.240+0000 7ff51962e700 1 --2- 172.21.15.1:0/279632587 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff4f405f150 0x7ff4f4061610 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.240+0000 7ff51962e700 1 --2- 172.21.15.1:0/279632587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff514154480 0x7ff51415a800 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.240+0000 7ff51962e700 1 --2- 172.21.15.1:0/279632587 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5140c6650 0x7ff5140ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.240+0000 7ff51962e700 1 --2- 172.21.15.1:0/279632587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5141540a0 0x7ff5140c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.240+0000 7ff51962e700 1 -- 172.21.15.1:0/279632587 >> 172.21.15.1:0/279632587 conn(0x7ff514064a70 msgr2=0x7ff5140aa0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:26.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.240+0000 7ff51962e700 1 -- 172.21.15.1:0/279632587 shutdown_connections 2023-11-15T01:22:26.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.240+0000 7ff51962e700 1 -- 172.21.15.1:0/279632587 wait complete. 2023-11-15T01:22:26.257 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-15T01:22:26.257 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:22:26.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.382+0000 7f0e1f878700 1 Processor -- start 2023-11-15T01:22:26.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.382+0000 7f0e1f878700 1 -- start start 2023-11-15T01:22:26.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e1f878700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e18154150 0x7f0e18154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:26.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e1f878700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0e180ab1a0 0x7f0e18158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:26.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e1f878700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e180c06f0 con 0x7f0e180aa060 2023-11-15T01:22:26.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e1f878700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e180c09d0 con 0x7f0e180ab1a0 2023-11-15T01:22:26.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e1f878700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18158820 con 0x7f0e18154150 2023-11-15T01:22:26.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e1ce13700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0e180ab1a0 0x7f0e18158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:26.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e1ce13700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0e180ab1a0 0x7f0e18158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44206/0 (socket says 172.21.15.1:44206) 2023-11-15T01:22:26.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e1ce13700 1 -- 172.21.15.1:0/1703753578 learned_addr learned my addr 172.21.15.1:0/1703753578 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:26.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e1de15700 1 --1- 172.21.15.1:0/1703753578 >> v1:172.21.15.1:6789/0 conn(0x7f0e180aa060 0x7f0e180c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49162/0 (socket says 172.21.15.1:49162) 2023-11-15T01:22:26.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e1d614700 1 --2- 172.21.15.1:0/1703753578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e18154150 0x7f0e18154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:26.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e1ce13700 1 -- 172.21.15.1:0/1703753578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e18154150 msgr2=0x7f0e18154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:26.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e1ce13700 1 --2- 172.21.15.1:0/1703753578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e18154150 0x7f0e18154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e1ce13700 1 -- 172.21.15.1:0/1703753578 >> v1:172.21.15.1:6789/0 conn(0x7f0e180aa060 legacy=0x7f0e180c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:26.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e1ce13700 1 -- 172.21.15.1:0/1703753578 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e18158b00 con 0x7f0e180ab1a0 2023-11-15T01:22:26.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e0ffff700 1 -- 172.21.15.1:0/1703753578 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090144414 0 0) 0x7f0e180c06f0 con 0x7f0e180aa060 2023-11-15T01:22:26.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.383+0000 7f0e1ce13700 1 --2- 172.21.15.1:0/1703753578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e180ab1a0 0x7f0e18158040 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f0e08006fd0 tx=0x7f0e080090f0).ready entity=mon.0 client_cookie=528c428ea29b83f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:26.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.384+0000 7f0e0ffff700 1 -- 172.21.15.1:0/1703753578 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0800b600 con 0x7f0e180ab1a0 2023-11-15T01:22:26.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.384+0000 7f0e0ffff700 1 -- 172.21.15.1:0/1703753578 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0800b760 con 0x7f0e180ab1a0 2023-11-15T01:22:26.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.384+0000 7f0e0ffff700 1 -- 172.21.15.1:0/1703753578 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0800bb00 con 0x7f0e180ab1a0 2023-11-15T01:22:26.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.384+0000 7f0e1f878700 1 -- 172.21.15.1:0/1703753578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e180ab1a0 msgr2=0x7f0e18158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:26.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.384+0000 7f0e1f878700 1 --2- 172.21.15.1:0/1703753578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e180ab1a0 0x7f0e18158040 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f0e08006fd0 tx=0x7f0e080090f0).stop 2023-11-15T01:22:26.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.384+0000 7f0e1f878700 1 -- 172.21.15.1:0/1703753578 shutdown_connections 2023-11-15T01:22:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.384+0000 7f0e1f878700 1 --2- 172.21.15.1:0/1703753578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e18154150 0x7f0e18154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.384+0000 7f0e1f878700 1 --2- 172.21.15.1:0/1703753578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e180ab1a0 0x7f0e18158040 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.384+0000 7f0e1f878700 1 -- 172.21.15.1:0/1703753578 >> 172.21.15.1:0/1703753578 conn(0x7f0e18064aa0 msgr2=0x7f0e18064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.384+0000 7f0e1f878700 1 -- 172.21.15.1:0/1703753578 shutdown_connections 2023-11-15T01:22:26.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.384+0000 7f0e1f878700 1 -- 172.21.15.1:0/1703753578 wait complete. 2023-11-15T01:22:26.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.385+0000 7f0e1f878700 1 Processor -- start 2023-11-15T01:22:26.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.385+0000 7f0e1f878700 1 -- start start 2023-11-15T01:22:26.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.386+0000 7f0e1f878700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e180aa060 0x7f0e18151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:26.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.386+0000 7f0e1f878700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e180ab1a0 0x7f0e180c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:26.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.386+0000 7f0e1f878700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e18154150 0x7f0e18154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:26.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.386+0000 7f0e1f878700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180cb480 con 0x7f0e180aa060 2023-11-15T01:22:26.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.386+0000 7f0e1f878700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18152340 con 0x7f0e180ab1a0 2023-11-15T01:22:26.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.386+0000 7f0e1f878700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180ca870 con 0x7f0e18154150 2023-11-15T01:22:26.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.386+0000 7f0e1d614700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e180aa060 0x7f0e18151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:26.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.386+0000 7f0e1d614700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e180aa060 0x7f0e18151e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44218/0 (socket says 172.21.15.1:44218) 2023-11-15T01:22:26.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.386+0000 7f0e1d614700 1 -- 172.21.15.1:0/3628339965 learned_addr learned my addr 172.21.15.1:0/3628339965 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:26.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.387+0000 7f0e1de15700 1 --2- 172.21.15.1:0/3628339965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e18154150 0x7f0e18154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:26.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.387+0000 7f0e1d614700 1 -- 172.21.15.1:0/3628339965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e18154150 msgr2=0x7f0e18154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:26.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.387+0000 7f0e1ce13700 1 --2- 172.21.15.1:0/3628339965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e180ab1a0 0x7f0e180c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:26.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.387+0000 7f0e1d614700 1 --2- 172.21.15.1:0/3628339965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e18154150 0x7f0e18154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.387+0000 7f0e1d614700 1 -- 172.21.15.1:0/3628339965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e180ab1a0 msgr2=0x7f0e180c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:26.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.387+0000 7f0e1d614700 1 --2- 172.21.15.1:0/3628339965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e180ab1a0 0x7f0e180c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.387+0000 7f0e1d614700 1 -- 172.21.15.1:0/3628339965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e08009370 con 0x7f0e180aa060 2023-11-15T01:22:26.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.387+0000 7f0e1d614700 1 --2- 172.21.15.1:0/3628339965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e180aa060 0x7f0e18151e50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f0e1400d890 tx=0x7f0e14008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:26.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.387+0000 7f0e0d7fa700 1 -- 172.21.15.1:0/3628339965 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e140125f0 con 0x7f0e180aa060 2023-11-15T01:22:26.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.387+0000 7f0e0d7fa700 1 -- 172.21.15.1:0/3628339965 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e14012750 con 0x7f0e180aa060 2023-11-15T01:22:26.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.387+0000 7f0e1f878700 1 -- 172.21.15.1:0/3628339965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e180cab50 con 0x7f0e180aa060 2023-11-15T01:22:26.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.387+0000 7f0e0d7fa700 1 -- 172.21.15.1:0/3628339965 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14012ad0 con 0x7f0e180aa060 2023-11-15T01:22:26.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.387+0000 7f0e1f878700 1 -- 172.21.15.1:0/3628339965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e180cb110 con 0x7f0e180aa060 2023-11-15T01:22:26.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.388+0000 7f0e1f878700 1 -- 172.21.15.1:0/3628339965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1806c7e0 con 0x7f0e180aa060 2023-11-15T01:22:26.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.388+0000 7f0e0d7fa700 1 -- 172.21.15.1:0/3628339965 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0e14013480 con 0x7f0e180aa060 2023-11-15T01:22:26.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.389+0000 7f0e0d7fa700 1 --2- 172.21.15.1:0/3628339965 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0dfc05f150 0x7f0dfc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:26.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.389+0000 7f0e0d7fa700 1 -- 172.21.15.1:0/3628339965 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0e14079f40 con 0x7f0e180aa060 2023-11-15T01:22:26.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.389+0000 7f0e1ce13700 1 --2- 172.21.15.1:0/3628339965 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0dfc05f150 0x7f0dfc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:26.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.389+0000 7f0e1ce13700 1 --2- 172.21.15.1:0/3628339965 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0dfc05f150 0x7f0dfc061610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f0e08006fd0 tx=0x7f0e08017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:26.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.393+0000 7f0e0d7fa700 1 -- 172.21.15.1:0/3628339965 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0e1404b1b0 con 0x7f0e180aa060 2023-11-15T01:22:26.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.609+0000 7f0e1f878700 1 -- 172.21.15.1:0/3628339965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e18158de0 con 0x7f0e180aa060 2023-11-15T01:22:26.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.609+0000 7f0e0d7fa700 1 -- 172.21.15.1:0/3628339965 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4486 (secure 0 0 0) 0x7f0e1404e7d0 con 0x7f0e180aa060 2023-11-15T01:22:26.611 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:26.612 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1019024578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1019024578},{"type":"v1","addr":"172.21.15.1:6835","nonce":1019024578}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4622,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/571718542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":571718542},{"type":"v1","addr":"172.21.15.141:6837","nonce":571718542}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/4111687819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":4111687819},{"type":"v1","addr":"172.21.15.141:6836","nonce":4111687819}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:22:23.228899+0000","modified":"2023-11-15T01:22:26.233026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6834/3374581715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3374581715},{"type":"v1","addr":"172.21.15.1:6834","nonce":3374581715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-11-15T01:22:26.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.611+0000 7f0e1f878700 1 -- 172.21.15.1:0/3628339965 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0dfc05f150 msgr2=0x7f0dfc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:26.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.611+0000 7f0e1f878700 1 --2- 172.21.15.1:0/3628339965 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0dfc05f150 0x7f0dfc061610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f0e08006fd0 tx=0x7f0e08017000).stop 2023-11-15T01:22:26.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.611+0000 7f0e1f878700 1 -- 172.21.15.1:0/3628339965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e180aa060 msgr2=0x7f0e18151e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:26.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.611+0000 7f0e1f878700 1 --2- 172.21.15.1:0/3628339965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e180aa060 0x7f0e18151e50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f0e1400d890 tx=0x7f0e14008040).stop 2023-11-15T01:22:26.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.611+0000 7f0e1f878700 1 -- 172.21.15.1:0/3628339965 shutdown_connections 2023-11-15T01:22:26.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.611+0000 7f0e1f878700 1 --2- 172.21.15.1:0/3628339965 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0dfc05f150 0x7f0dfc061610 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.611+0000 7f0e1f878700 1 --2- 172.21.15.1:0/3628339965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e18154150 0x7f0e18154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.611+0000 7f0e1f878700 1 --2- 172.21.15.1:0/3628339965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e180aa060 0x7f0e18151e50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.611+0000 7f0e1f878700 1 --2- 172.21.15.1:0/3628339965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e180ab1a0 0x7f0e180c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.611+0000 7f0e1f878700 1 -- 172.21.15.1:0/3628339965 >> 172.21.15.1:0/3628339965 conn(0x7f0e18064aa0 msgr2=0x7f0e180ad350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:26.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.612+0000 7f0e1f878700 1 -- 172.21.15.1:0/3628339965 shutdown_connections 2023-11-15T01:22:26.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.612+0000 7f0e1f878700 1 -- 172.21.15.1:0/3628339965 wait complete. 2023-11-15T01:22:26.616 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 15 2023-11-15T01:22:26.625 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:22:26.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.742+0000 7fd33e58a700 1 Processor -- start 2023-11-15T01:22:26.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.742+0000 7fd33e58a700 1 -- start start 2023-11-15T01:22:26.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.743+0000 7fd33e58a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd338069bb0 0x7fd3380c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:26.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.743+0000 7fd33e58a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33806a190 con 0x7fd3380bc890 2023-11-15T01:22:26.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.743+0000 7fd33e58a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33806bac0 con 0x7fd3380bc4b0 2023-11-15T01:22:26.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.743+0000 7fd33e58a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3380628c0 con 0x7fd338069bb0 2023-11-15T01:22:26.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.743+0000 7fd33cd87700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd338069bb0 0x7fd3380c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:26.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.743+0000 7fd33cd87700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd338069bb0 0x7fd3380c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44222/0 (socket says 172.21.15.1:44222) 2023-11-15T01:22:26.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.743+0000 7fd33cd87700 1 -- 172.21.15.1:0/1483358143 learned_addr learned my addr 172.21.15.1:0/1483358143 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:26.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.743+0000 7fd33cd87700 1 -- 172.21.15.1:0/1483358143 >> v1:172.21.15.141:6789/0 conn(0x7fd3380bc4b0 legacy=0x7fd338063680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:26.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.743+0000 7fd33cd87700 1 -- 172.21.15.1:0/1483358143 >> v1:172.21.15.1:6789/0 conn(0x7fd3380bc890 legacy=0x7fd338152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:26.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.743+0000 7fd337fff700 1 -- 172.21.15.1:0/1483358143 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402408269 0 0) 0x7fd33806a190 con 0x7fd3380bc890 2023-11-15T01:22:26.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.743+0000 7fd33cd87700 1 -- 172.21.15.1:0/1483358143 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd338062ba0 con 0x7fd338069bb0 2023-11-15T01:22:26.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.744+0000 7fd33cd87700 1 --2- 172.21.15.1:0/1483358143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd338069bb0 0x7fd3380c45d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fd32c006fd0 tx=0x7fd32c0090f0).ready entity=mon.0 client_cookie=f169cf346da18c71 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:26.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.744+0000 7fd337fff700 1 -- 172.21.15.1:0/1483358143 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c00b600 con 0x7fd338069bb0 2023-11-15T01:22:26.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.744+0000 7fd337fff700 1 -- 172.21.15.1:0/1483358143 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c00b760 con 0x7fd338069bb0 2023-11-15T01:22:26.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.744+0000 7fd337fff700 1 -- 172.21.15.1:0/1483358143 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c00bae0 con 0x7fd338069bb0 2023-11-15T01:22:26.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.744+0000 7fd33e58a700 1 -- 172.21.15.1:0/1483358143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd338069bb0 msgr2=0x7fd3380c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:26.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.744+0000 7fd33e58a700 1 --2- 172.21.15.1:0/1483358143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd338069bb0 0x7fd3380c45d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fd32c006fd0 tx=0x7fd32c0090f0).stop 2023-11-15T01:22:26.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.744+0000 7fd33e58a700 1 -- 172.21.15.1:0/1483358143 shutdown_connections 2023-11-15T01:22:26.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.744+0000 7fd33e58a700 1 --2- 172.21.15.1:0/1483358143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd338069bb0 0x7fd3380c45d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.744+0000 7fd33e58a700 1 -- 172.21.15.1:0/1483358143 >> 172.21.15.1:0/1483358143 conn(0x7fd3380c7e00 msgr2=0x7fd3380c3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:26.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.744+0000 7fd33e58a700 1 -- 172.21.15.1:0/1483358143 shutdown_connections 2023-11-15T01:22:26.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.744+0000 7fd33e58a700 1 -- 172.21.15.1:0/1483358143 wait complete. 2023-11-15T01:22:26.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.745+0000 7fd33e58a700 1 Processor -- start 2023-11-15T01:22:26.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.745+0000 7fd33e58a700 1 -- start start 2023-11-15T01:22:26.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.746+0000 7fd33e58a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd338069bb0 0x7fd338164f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:26.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.746+0000 7fd33e58a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3380bc4b0 0x7fd338167d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:26.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.746+0000 7fd33e58a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3380bc890 0x7fd3380c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:26.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.746+0000 7fd33e58a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd338169440 con 0x7fd338069bb0 2023-11-15T01:22:26.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.746+0000 7fd33e58a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3381536f0 con 0x7fd3380bc4b0 2023-11-15T01:22:26.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.746+0000 7fd33e58a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3381688c0 con 0x7fd3380bc890 2023-11-15T01:22:26.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.746+0000 7fd33d588700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd338069bb0 0x7fd338164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:26.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.746+0000 7fd33d588700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd338069bb0 0x7fd338164f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44230/0 (socket says 172.21.15.1:44230) 2023-11-15T01:22:26.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.746+0000 7fd33d588700 1 -- 172.21.15.1:0/655680890 learned_addr learned my addr 172.21.15.1:0/655680890 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:26.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.747+0000 7fd33d588700 1 -- 172.21.15.1:0/655680890 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3380bc890 msgr2=0x7fd3380c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:26.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.747+0000 7fd33d588700 1 --2- 172.21.15.1:0/655680890 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3380bc890 0x7fd3380c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:26.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.747+0000 7fd33d588700 1 -- 172.21.15.1:0/655680890 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3380bc4b0 msgr2=0x7fd338167d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:26.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.747+0000 7fd33cd87700 1 --2- 172.21.15.1:0/655680890 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3380bc4b0 0x7fd338167d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:26.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.747+0000 7fd33d588700 1 --2- 172.21.15.1:0/655680890 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3380bc4b0 0x7fd338167d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.747+0000 7fd33d588700 1 -- 172.21.15.1:0/655680890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c009370 con 0x7fd338069bb0 2023-11-15T01:22:26.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.747+0000 7fd33d588700 1 --2- 172.21.15.1:0/655680890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd338069bb0 0x7fd338164f30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fd32800c840 tx=0x7fd328001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:26.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.747+0000 7fd3357fa700 1 -- 172.21.15.1:0/655680890 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328006a20 con 0x7fd338069bb0 2023-11-15T01:22:26.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.747+0000 7fd3357fa700 1 -- 172.21.15.1:0/655680890 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd328006b80 con 0x7fd338069bb0 2023-11-15T01:22:26.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.747+0000 7fd33e58a700 1 -- 172.21.15.1:0/655680890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd338168ba0 con 0x7fd338069bb0 2023-11-15T01:22:26.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.747+0000 7fd3357fa700 1 -- 172.21.15.1:0/655680890 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328007020 con 0x7fd338069bb0 2023-11-15T01:22:26.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.747+0000 7fd33e58a700 1 -- 172.21.15.1:0/655680890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd338169160 con 0x7fd338069bb0 2023-11-15T01:22:26.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.748+0000 7fd33e58a700 1 -- 172.21.15.1:0/655680890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3380475e0 con 0x7fd338069bb0 2023-11-15T01:22:26.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.748+0000 7fd3357fa700 1 -- 172.21.15.1:0/655680890 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd328007410 con 0x7fd338069bb0 2023-11-15T01:22:26.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.749+0000 7fd3357fa700 1 --2- 172.21.15.1:0/655680890 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd32405f180 0x7fd324061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:26.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.749+0000 7fd3357fa700 1 -- 172.21.15.1:0/655680890 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd328079920 con 0x7fd338069bb0 2023-11-15T01:22:26.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.749+0000 7fd33cd87700 1 --2- 172.21.15.1:0/655680890 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd32405f180 0x7fd324061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:26.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.749+0000 7fd33cd87700 1 --2- 172.21.15.1:0/655680890 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd32405f180 0x7fd324061640 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fd33814f480 tx=0x7fd32c017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:26.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.753+0000 7fd3357fa700 1 -- 172.21.15.1:0/655680890 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd328048af0 con 0x7fd338069bb0 2023-11-15T01:22:26.824 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-11-15T01:22:26.822+0000 7fe1873d9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T01:22:26.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.926+0000 7fd33e58a700 1 -- 172.21.15.1:0/655680890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3380c8210 con 0x7fd338069bb0 2023-11-15T01:22:26.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.927+0000 7fd3357fa700 1 -- 172.21.15.1:0/655680890 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16880 (secure 0 0 0) 0x7fd32804abf0 con 0x7fd338069bb0 2023-11-15T01:22:26.929 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:26.929 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":34,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:22:24.230197+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:22:21.423841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-15T01:22:22.202076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:22:26.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.929+0000 7fd33e58a700 1 -- 172.21.15.1:0/655680890 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd32405f180 msgr2=0x7fd324061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:26.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.929+0000 7fd33e58a700 1 --2- 172.21.15.1:0/655680890 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd32405f180 0x7fd324061640 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fd33814f480 tx=0x7fd32c017000).stop 2023-11-15T01:22:26.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.929+0000 7fd33e58a700 1 -- 172.21.15.1:0/655680890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd338069bb0 msgr2=0x7fd338164f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:26.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.929+0000 7fd33e58a700 1 --2- 172.21.15.1:0/655680890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd338069bb0 0x7fd338164f30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fd32800c840 tx=0x7fd328001660).stop 2023-11-15T01:22:26.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.929+0000 7fd33e58a700 1 -- 172.21.15.1:0/655680890 shutdown_connections 2023-11-15T01:22:26.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.929+0000 7fd33e58a700 1 --2- 172.21.15.1:0/655680890 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd32405f180 0x7fd324061640 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.929+0000 7fd33e58a700 1 --2- 172.21.15.1:0/655680890 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3380bc890 0x7fd3380c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:26.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.929+0000 7fd33e58a700 1 --2- 172.21.15.1:0/655680890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd338069bb0 0x7fd338164f30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.929+0000 7fd33e58a700 1 --2- 172.21.15.1:0/655680890 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3380bc4b0 0x7fd338167d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:26.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.929+0000 7fd33e58a700 1 -- 172.21.15.1:0/655680890 >> 172.21.15.1:0/655680890 conn(0x7fd3380c7e00 msgr2=0x7fd338063580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:26.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.929+0000 7fd33e58a700 1 -- 172.21.15.1:0/655680890 shutdown_connections 2023-11-15T01:22:26.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:26.929+0000 7fd33e58a700 1 -- 172.21.15.1:0/655680890 wait complete. 2023-11-15T01:22:26.943 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-15T01:22:26.943 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:22:27.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.060+0000 7f840a491700 1 Processor -- start 2023-11-15T01:22:27.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.060+0000 7f840a491700 1 -- start start 2023-11-15T01:22:27.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.061+0000 7f840a491700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8404154150 0x7f8404154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.061+0000 7f840a491700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84040c06f0 con 0x7f84040aa060 2023-11-15T01:22:27.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.061+0000 7f840a491700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84040c09d0 con 0x7f84040ab1a0 2023-11-15T01:22:27.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.061+0000 7f840a491700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8404158820 con 0x7f8404154150 2023-11-15T01:22:27.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.061+0000 7f8408a2e700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f84040aa060 0x7f84040c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49170/0 (socket says 172.21.15.1:49170) 2023-11-15T01:22:27.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.061+0000 7f8408a2e700 1 -- 172.21.15.1:0/1941780981 learned_addr learned my addr 172.21.15.1:0/1941780981 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:27.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.061+0000 7f8403fff700 1 --2- 172.21.15.1:0/1941780981 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8404154150 0x7f8404154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.061+0000 7f8402ffd700 1 -- 172.21.15.1:0/1941780981 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099148513 0 0) 0x7f84040c06f0 con 0x7f84040aa060 2023-11-15T01:22:27.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.062+0000 7f8402ffd700 1 -- 172.21.15.1:0/1941780981 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83f00033f0 con 0x7f84040aa060 2023-11-15T01:22:27.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.062+0000 7f8402ffd700 1 -- 172.21.15.1:0/1941780981 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997967832 0 0) 0x7f84040c09d0 con 0x7f84040ab1a0 2023-11-15T01:22:27.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.062+0000 7f8402ffd700 1 -- 172.21.15.1:0/1941780981 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84040c06f0 con 0x7f84040ab1a0 2023-11-15T01:22:27.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.062+0000 7f8403fff700 1 -- 172.21.15.1:0/1941780981 >> v1:172.21.15.141:6789/0 conn(0x7f84040ab1a0 legacy=0x7f8404158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.062+0000 7f8403fff700 1 -- 172.21.15.1:0/1941780981 >> v1:172.21.15.1:6789/0 conn(0x7f84040aa060 legacy=0x7f84040c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.062+0000 7f8403fff700 1 -- 172.21.15.1:0/1941780981 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8404158b00 con 0x7f8404154150 2023-11-15T01:22:27.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.062+0000 7f8403fff700 1 --2- 172.21.15.1:0/1941780981 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8404154150 0x7f8404154530 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f83f4009790 tx=0x7f83f4009060).ready entity=mon.2 client_cookie=8e3df619d2dacef7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:27.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.062+0000 7f8402ffd700 1 -- 172.21.15.1:0/1941780981 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f40090d0 con 0x7f8404154150 2023-11-15T01:22:27.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.062+0000 7f8402ffd700 1 -- 172.21.15.1:0/1941780981 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f400d4a0 con 0x7f8404154150 2023-11-15T01:22:27.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.062+0000 7f8402ffd700 1 -- 172.21.15.1:0/1941780981 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f400d820 con 0x7f8404154150 2023-11-15T01:22:27.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.062+0000 7f840a491700 1 -- 172.21.15.1:0/1941780981 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8404154150 msgr2=0x7f8404154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.062+0000 7f840a491700 1 --2- 172.21.15.1:0/1941780981 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8404154150 0x7f8404154530 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f83f4009790 tx=0x7f83f4009060).stop 2023-11-15T01:22:27.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.063+0000 7f840a491700 1 -- 172.21.15.1:0/1941780981 shutdown_connections 2023-11-15T01:22:27.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.063+0000 7f840a491700 1 --2- 172.21.15.1:0/1941780981 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8404154150 0x7f8404154530 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.063+0000 7f840a491700 1 -- 172.21.15.1:0/1941780981 >> 172.21.15.1:0/1941780981 conn(0x7f8404064aa0 msgr2=0x7f8404064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:27.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.063+0000 7f840a491700 1 -- 172.21.15.1:0/1941780981 shutdown_connections 2023-11-15T01:22:27.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.063+0000 7f840a491700 1 -- 172.21.15.1:0/1941780981 wait complete. 2023-11-15T01:22:27.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.064+0000 7f840a491700 1 Processor -- start 2023-11-15T01:22:27.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.064+0000 7f840a491700 1 -- start start 2023-11-15T01:22:27.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f840a491700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84040aa060 0x7f8404144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f840a491700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84040ab1a0 0x7f84040c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f840a491700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8404154150 0x7f84040639b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f840a491700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84040c49a0 con 0x7f8404154150 2023-11-15T01:22:27.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f840a491700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84040c22e0 con 0x7f84040aa060 2023-11-15T01:22:27.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f840a491700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84040c25c0 con 0x7f84040ab1a0 2023-11-15T01:22:27.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f8408a2e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8404154150 0x7f84040639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f8408a2e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8404154150 0x7f84040639b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44234/0 (socket says 172.21.15.1:44234) 2023-11-15T01:22:27.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f8408a2e700 1 -- 172.21.15.1:0/482409592 learned_addr learned my addr 172.21.15.1:0/482409592 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:27.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f8403fff700 1 --2- 172.21.15.1:0/482409592 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84040aa060 0x7f8404144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f84037fe700 1 --2- 172.21.15.1:0/482409592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84040ab1a0 0x7f84040c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f8408a2e700 1 -- 172.21.15.1:0/482409592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84040ab1a0 msgr2=0x7f84040c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f8408a2e700 1 --2- 172.21.15.1:0/482409592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84040ab1a0 0x7f84040c30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f8408a2e700 1 -- 172.21.15.1:0/482409592 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84040aa060 msgr2=0x7f8404144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f8408a2e700 1 --2- 172.21.15.1:0/482409592 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84040aa060 0x7f8404144b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f8408a2e700 1 -- 172.21.15.1:0/482409592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f40092a0 con 0x7f8404154150 2023-11-15T01:22:27.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f8408a2e700 1 --2- 172.21.15.1:0/482409592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8404154150 0x7f84040639b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f83fc00c790 tx=0x7f83fc007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:27.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f83fbfff700 1 -- 172.21.15.1:0/482409592 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc005d30 con 0x7f8404154150 2023-11-15T01:22:27.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f83fbfff700 1 -- 172.21.15.1:0/482409592 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc005e90 con 0x7f8404154150 2023-11-15T01:22:27.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f840a491700 1 -- 172.21.15.1:0/482409592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84040c28a0 con 0x7f8404154150 2023-11-15T01:22:27.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f83fbfff700 1 -- 172.21.15.1:0/482409592 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc007320 con 0x7f8404154150 2023-11-15T01:22:27.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.065+0000 7f840a491700 1 -- 172.21.15.1:0/482409592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8404063ea0 con 0x7f8404154150 2023-11-15T01:22:27.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.066+0000 7f840a491700 1 -- 172.21.15.1:0/482409592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84040c2dc0 con 0x7f8404154150 2023-11-15T01:22:27.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.067+0000 7f83fbfff700 1 -- 172.21.15.1:0/482409592 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f83fc007750 con 0x7f8404154150 2023-11-15T01:22:27.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.067+0000 7f83fbfff700 1 --2- 172.21.15.1:0/482409592 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f83e405f150 0x7f83e4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.067+0000 7f83fbfff700 1 -- 172.21.15.1:0/482409592 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f83fc07a070 con 0x7f8404154150 2023-11-15T01:22:27.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.067+0000 7f8403fff700 1 --2- 172.21.15.1:0/482409592 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f83e405f150 0x7f83e4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.068+0000 7f8403fff700 1 --2- 172.21.15.1:0/482409592 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f83e405f150 0x7f83e4061610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f83f4006d30 tx=0x7f83f4016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:27.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.071+0000 7f83fbfff700 1 -- 172.21.15.1:0/482409592 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f84040c2dc0 con 0x7f8404154150 2023-11-15T01:22:27.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.239+0000 7f840a491700 1 -- 172.21.15.1:0/482409592 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84040c2dc0 con 0x7f83e405f150 2023-11-15T01:22:27.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.249+0000 7f83fbfff700 1 -- 172.21.15.1:0/482409592 <== mgr.4103 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336425 (secure 0 0 0) 0x7f84040c2dc0 con 0x7f83e405f150 2023-11-15T01:22:27.255 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:27.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.253+0000 7f840a491700 1 -- 172.21.15.1:0/482409592 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f83e405f150 msgr2=0x7f83e4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.253+0000 7f840a491700 1 --2- 172.21.15.1:0/482409592 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f83e405f150 0x7f83e4061610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f83f4006d30 tx=0x7f83f4016000).stop 2023-11-15T01:22:27.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.253+0000 7f840a491700 1 -- 172.21.15.1:0/482409592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8404154150 msgr2=0x7f84040639b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.253+0000 7f840a491700 1 --2- 172.21.15.1:0/482409592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8404154150 0x7f84040639b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f83fc00c790 tx=0x7f83fc007f90).stop 2023-11-15T01:22:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.253+0000 7f840a491700 1 -- 172.21.15.1:0/482409592 shutdown_connections 2023-11-15T01:22:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.253+0000 7f840a491700 1 --2- 172.21.15.1:0/482409592 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f83e405f150 0x7f83e4061610 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.253+0000 7f840a491700 1 --2- 172.21.15.1:0/482409592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8404154150 0x7f84040639b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.253+0000 7f840a491700 1 --2- 172.21.15.1:0/482409592 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84040aa060 0x7f8404144b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.253+0000 7f840a491700 1 --2- 172.21.15.1:0/482409592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84040ab1a0 0x7f84040c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.253+0000 7f840a491700 1 -- 172.21.15.1:0/482409592 >> 172.21.15.1:0/482409592 conn(0x7f8404064aa0 msgr2=0x7f8404152dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:27.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.253+0000 7f840a491700 1 -- 172.21.15.1:0/482409592 shutdown_connections 2023-11-15T01:22:27.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.253+0000 7f840a491700 1 -- 172.21.15.1:0/482409592 wait complete. 2023-11-15T01:22:27.261 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:22:27.266 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-11-15T01:22:25.770014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379668,"kb_used_data":2900,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595052,"statfs":{"total":773094113280,"available":770657333248,"internally_reserved":0,"allocated":2969600,"data_stored":1190180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4305,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.586238"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.249131+0000","last_change":"2023-11-15T01:22:23.249131+0000","last_active":"2023-11-15T01:22:23.249131+0000","last_peered":"2023-11-15T01:22:23.249131+0000","last_clean":"2023-11-15T01:22:23.249131+0000","last_became_active":"2023-11-15T01:22:23.248749+0000","last_became_peered":"2023-11-15T01:22:23.248749+0000","last_unstale":"2023-11-15T01:22:23.249131+0000","last_undegraded":"2023-11-15T01:22:23.249131+0000","last_fullsized":"2023-11-15T01:22:23.249131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.260560+0000","last_change":"2023-11-15T01:22:22.855504+0000","last_active":"2023-11-15T01:22:23.260560+0000","last_peered":"2023-11-15T01:22:23.260560+0000","last_clean":"2023-11-15T01:22:23.260560+0000","last_became_active":"2023-11-15T01:22:22.855237+0000","last_became_peered":"2023-11-15T01:22:22.855237+0000","last_unstale":"2023-11-15T01:22:23.260560+0000","last_undegraded":"2023-11-15T01:22:23.260560+0000","last_fullsized":"2023-11-15T01:22:23.260560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.249909+0000","last_change":"2023-11-15T01:22:23.249909+0000","last_active":"2023-11-15T01:22:23.249909+0000","last_peered":"2023-11-15T01:22:23.249909+0000","last_clean":"2023-11-15T01:22:23.249909+0000","last_became_active":"2023-11-15T01:22:23.249658+0000","last_became_peered":"2023-11-15T01:22:23.249658+0000","last_unstale":"2023-11-15T01:22:23.249909+0000","last_undegraded":"2023-11-15T01:22:23.249909+0000","last_fullsized":"2023-11-15T01:22:23.249909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.861893+0000","last_change":"2023-11-15T01:22:22.855496+0000","last_active":"2023-11-15T01:22:22.861893+0000","last_peered":"2023-11-15T01:22:22.861893+0000","last_clean":"2023-11-15T01:22:22.861893+0000","last_became_active":"2023-11-15T01:22:22.855201+0000","last_became_peered":"2023-11-15T01:22:22.855201+0000","last_unstale":"2023-11-15T01:22:22.861893+0000","last_undegraded":"2023-11-15T01:22:22.861893+0000","last_fullsized":"2023-11-15T01:22:22.861893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.247429+0000","last_change":"2023-11-15T01:22:23.247429+0000","last_active":"2023-11-15T01:22:23.247429+0000","last_peered":"2023-11-15T01:22:23.247429+0000","last_clean":"2023-11-15T01:22:23.247429+0000","last_became_active":"2023-11-15T01:22:23.246708+0000","last_became_peered":"2023-11-15T01:22:23.246708+0000","last_unstale":"2023-11-15T01:22:23.247429+0000","last_undegraded":"2023-11-15T01:22:23.247429+0000","last_fullsized":"2023-11-15T01:22:23.247429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.859730+0000","last_change":"2023-11-15T01:22:22.856919+0000","last_active":"2023-11-15T01:22:22.859730+0000","last_peered":"2023-11-15T01:22:22.859730+0000","last_clean":"2023-11-15T01:22:22.859730+0000","last_became_active":"2023-11-15T01:22:22.856116+0000","last_became_peered":"2023-11-15T01:22:22.856116+0000","last_unstale":"2023-11-15T01:22:22.859730+0000","last_undegraded":"2023-11-15T01:22:22.859730+0000","last_fullsized":"2023-11-15T01:22:22.859730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.246191+0000","last_change":"2023-11-15T01:22:23.246191+0000","last_active":"2023-11-15T01:22:23.246191+0000","last_peered":"2023-11-15T01:22:23.246191+0000","last_clean":"2023-11-15T01:22:23.246191+0000","last_became_active":"2023-11-15T01:22:23.245910+0000","last_became_peered":"2023-11-15T01:22:23.245910+0000","last_unstale":"2023-11-15T01:22:23.246191+0000","last_undegraded":"2023-11-15T01:22:23.246191+0000","last_fullsized":"2023-11-15T01:22:23.246191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.254430+0000","last_change":"2023-11-15T01:22:22.863799+0000","last_active":"2023-11-15T01:22:23.254430+0000","last_peered":"2023-11-15T01:22:23.254430+0000","last_clean":"2023-11-15T01:22:23.254430+0000","last_became_active":"2023-11-15T01:22:22.863304+0000","last_became_peered":"2023-11-15T01:22:22.863304+0000","last_unstale":"2023-11-15T01:22:23.254430+0000","last_undegraded":"2023-11-15T01:22:23.254430+0000","last_fullsized":"2023-11-15T01:22:23.254430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.259140+0000","last_change":"2023-11-15T01:22:23.259140+0000","last_active":"2023-11-15T01:22:23.259140+0000","last_peered":"2023-11-15T01:22:23.259140+0000","last_clean":"2023-11-15T01:22:23.259140+0000","last_became_active":"2023-11-15T01:22:23.258882+0000","last_became_peered":"2023-11-15T01:22:23.258882+0000","last_unstale":"2023-11-15T01:22:23.259140+0000","last_undegraded":"2023-11-15T01:22:23.259140+0000","last_fullsized":"2023-11-15T01:22:23.259140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.237361+0000","last_change":"2023-11-15T01:22:22.859168+0000","last_active":"2023-11-15T01:22:23.237361+0000","last_peered":"2023-11-15T01:22:23.237361+0000","last_clean":"2023-11-15T01:22:23.237361+0000","last_became_active":"2023-11-15T01:22:22.853049+0000","last_became_peered":"2023-11-15T01:22:22.853049+0000","last_unstale":"2023-11-15T01:22:23.237361+0000","last_undegraded":"2023-11-15T01:22:23.237361+0000","last_fullsized":"2023-11-15T01:22:23.237361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250699+0000","last_change":"2023-11-15T01:22:23.250699+0000","last_active":"2023-11-15T01:22:23.250699+0000","last_peered":"2023-11-15T01:22:23.250699+0000","last_clean":"2023-11-15T01:22:23.250699+0000","last_became_active":"2023-11-15T01:22:23.250407+0000","last_became_peered":"2023-11-15T01:22:23.250407+0000","last_unstale":"2023-11-15T01:22:23.250699+0000","last_undegraded":"2023-11-15T01:22:23.250699+0000","last_fullsized":"2023-11-15T01:22:23.250699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.244505+0000","last_change":"2023-11-15T01:22:22.849529+0000","last_active":"2023-11-15T01:22:23.244505+0000","last_peered":"2023-11-15T01:22:23.244505+0000","last_clean":"2023-11-15T01:22:23.244505+0000","last_became_active":"2023-11-15T01:22:22.849183+0000","last_became_peered":"2023-11-15T01:22:22.849183+0000","last_unstale":"2023-11-15T01:22:23.244505+0000","last_undegraded":"2023-11-15T01:22:23.244505+0000","last_fullsized":"2023-11-15T01:22:23.244505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252015+0000","last_change":"2023-11-15T01:22:23.252015+0000","last_active":"2023-11-15T01:22:23.252015+0000","last_peered":"2023-11-15T01:22:23.252015+0000","last_clean":"2023-11-15T01:22:23.252015+0000","last_became_active":"2023-11-15T01:22:23.251749+0000","last_became_peered":"2023-11-15T01:22:23.251749+0000","last_unstale":"2023-11-15T01:22:23.252015+0000","last_undegraded":"2023-11-15T01:22:23.252015+0000","last_fullsized":"2023-11-15T01:22:23.252015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864945+0000","last_change":"2023-11-15T01:22:22.861481+0000","last_active":"2023-11-15T01:22:22.864945+0000","last_peered":"2023-11-15T01:22:22.864945+0000","last_clean":"2023-11-15T01:22:22.864945+0000","last_became_active":"2023-11-15T01:22:22.861201+0000","last_became_peered":"2023-11-15T01:22:22.861201+0000","last_unstale":"2023-11-15T01:22:22.864945+0000","last_undegraded":"2023-11-15T01:22:22.864945+0000","last_fullsized":"2023-11-15T01:22:22.864945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.251282+0000","last_change":"2023-11-15T01:22:23.251282+0000","last_active":"2023-11-15T01:22:23.251282+0000","last_peered":"2023-11-15T01:22:23.251282+0000","last_clean":"2023-11-15T01:22:23.251282+0000","last_became_active":"2023-11-15T01:22:23.249864+0000","last_became_peered":"2023-11-15T01:22:23.249864+0000","last_unstale":"2023-11-15T01:22:23.251282+0000","last_undegraded":"2023-11-15T01:22:23.251282+0000","last_fullsized":"2023-11-15T01:22:23.251282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.867862+0000","last_change":"2023-11-15T01:22:22.864952+0000","last_active":"2023-11-15T01:22:22.867862+0000","last_peered":"2023-11-15T01:22:22.867862+0000","last_clean":"2023-11-15T01:22:22.867862+0000","last_became_active":"2023-11-15T01:22:22.864376+0000","last_became_peered":"2023-11-15T01:22:22.864376+0000","last_unstale":"2023-11-15T01:22:22.867862+0000","last_undegraded":"2023-11-15T01:22:22.867862+0000","last_fullsized":"2023-11-15T01:22:22.867862+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250652+0000","last_change":"2023-11-15T01:22:23.250652+0000","last_active":"2023-11-15T01:22:23.250652+0000","last_peered":"2023-11-15T01:22:23.250652+0000","last_clean":"2023-11-15T01:22:23.250652+0000","last_became_active":"2023-11-15T01:22:23.250373+0000","last_became_peered":"2023-11-15T01:22:23.250373+0000","last_unstale":"2023-11-15T01:22:23.250652+0000","last_undegraded":"2023-11-15T01:22:23.250652+0000","last_fullsized":"2023-11-15T01:22:23.250652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.861803+0000","last_change":"2023-11-15T01:22:22.854212+0000","last_active":"2023-11-15T01:22:22.861803+0000","last_peered":"2023-11-15T01:22:22.861803+0000","last_clean":"2023-11-15T01:22:22.861803+0000","last_became_active":"2023-11-15T01:22:22.853967+0000","last_became_peered":"2023-11-15T01:22:22.853967+0000","last_unstale":"2023-11-15T01:22:22.861803+0000","last_undegraded":"2023-11-15T01:22:22.861803+0000","last_fullsized":"2023-11-15T01:22:22.861803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.246858+0000","last_change":"2023-11-15T01:22:23.246858+0000","last_active":"2023-11-15T01:22:23.246858+0000","last_peered":"2023-11-15T01:22:23.246858+0000","last_clean":"2023-11-15T01:22:23.246858+0000","last_became_active":"2023-11-15T01:22:23.246499+0000","last_became_peered":"2023-11-15T01:22:23.246499+0000","last_unstale":"2023-11-15T01:22:23.246858+0000","last_undegraded":"2023-11-15T01:22:23.246858+0000","last_fullsized":"2023-11-15T01:22:23.246858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864985+0000","last_change":"2023-11-15T01:22:22.862638+0000","last_active":"2023-11-15T01:22:22.864985+0000","last_peered":"2023-11-15T01:22:22.864985+0000","last_clean":"2023-11-15T01:22:22.864985+0000","last_became_active":"2023-11-15T01:22:22.862303+0000","last_became_peered":"2023-11-15T01:22:22.862303+0000","last_unstale":"2023-11-15T01:22:22.864985+0000","last_undegraded":"2023-11-15T01:22:22.864985+0000","last_fullsized":"2023-11-15T01:22:22.864985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.257314+0000","last_change":"2023-11-15T01:22:23.257314+0000","last_active":"2023-11-15T01:22:23.257314+0000","last_peered":"2023-11-15T01:22:23.257314+0000","last_clean":"2023-11-15T01:22:23.257314+0000","last_became_active":"2023-11-15T01:22:23.256853+0000","last_became_peered":"2023-11-15T01:22:23.256853+0000","last_unstale":"2023-11-15T01:22:23.257314+0000","last_undegraded":"2023-11-15T01:22:23.257314+0000","last_fullsized":"2023-11-15T01:22:23.257314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864988+0000","last_change":"2023-11-15T01:22:22.863062+0000","last_active":"2023-11-15T01:22:22.864988+0000","last_peered":"2023-11-15T01:22:22.864988+0000","last_clean":"2023-11-15T01:22:22.864988+0000","last_became_active":"2023-11-15T01:22:22.862772+0000","last_became_peered":"2023-11-15T01:22:22.862772+0000","last_unstale":"2023-11-15T01:22:22.864988+0000","last_undegraded":"2023-11-15T01:22:22.864988+0000","last_fullsized":"2023-11-15T01:22:22.864988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.258016+0000","last_change":"2023-11-15T01:22:23.258016+0000","last_active":"2023-11-15T01:22:23.258016+0000","last_peered":"2023-11-15T01:22:23.258016+0000","last_clean":"2023-11-15T01:22:23.258016+0000","last_became_active":"2023-11-15T01:22:23.257706+0000","last_became_peered":"2023-11-15T01:22:23.257706+0000","last_unstale":"2023-11-15T01:22:23.258016+0000","last_undegraded":"2023-11-15T01:22:23.258016+0000","last_fullsized":"2023-11-15T01:22:23.258016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.260792+0000","last_change":"2023-11-15T01:22:22.856610+0000","last_active":"2023-11-15T01:22:23.260792+0000","last_peered":"2023-11-15T01:22:23.260792+0000","last_clean":"2023-11-15T01:22:23.260792+0000","last_became_active":"2023-11-15T01:22:22.856319+0000","last_became_peered":"2023-11-15T01:22:22.856319+0000","last_unstale":"2023-11-15T01:22:23.260792+0000","last_undegraded":"2023-11-15T01:22:23.260792+0000","last_fullsized":"2023-11-15T01:22:23.260792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.258494+0000","last_change":"2023-11-15T01:22:23.258494+0000","last_active":"2023-11-15T01:22:23.258494+0000","last_peered":"2023-11-15T01:22:23.258494+0000","last_clean":"2023-11-15T01:22:23.258494+0000","last_became_active":"2023-11-15T01:22:23.258149+0000","last_became_peered":"2023-11-15T01:22:23.258149+0000","last_unstale":"2023-11-15T01:22:23.258494+0000","last_undegraded":"2023-11-15T01:22:23.258494+0000","last_fullsized":"2023-11-15T01:22:23.258494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.237482+0000","last_change":"2023-11-15T01:22:22.858945+0000","last_active":"2023-11-15T01:22:23.237482+0000","last_peered":"2023-11-15T01:22:23.237482+0000","last_clean":"2023-11-15T01:22:23.237482+0000","last_became_active":"2023-11-15T01:22:22.852883+0000","last_became_peered":"2023-11-15T01:22:22.852883+0000","last_unstale":"2023-11-15T01:22:23.237482+0000","last_undegraded":"2023-11-15T01:22:23.237482+0000","last_fullsized":"2023-11-15T01:22:23.237482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252243+0000","last_change":"2023-11-15T01:22:23.252243+0000","last_active":"2023-11-15T01:22:23.252243+0000","last_peered":"2023-11-15T01:22:23.252243+0000","last_clean":"2023-11-15T01:22:23.252243+0000","last_became_active":"2023-11-15T01:22:23.251916+0000","last_became_peered":"2023-11-15T01:22:23.251916+0000","last_unstale":"2023-11-15T01:22:23.252243+0000","last_undegraded":"2023-11-15T01:22:23.252243+0000","last_fullsized":"2023-11-15T01:22:23.252243+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.857864+0000","last_change":"2023-11-15T01:22:22.850227+0000","last_active":"2023-11-15T01:22:22.857864+0000","last_peered":"2023-11-15T01:22:22.857864+0000","last_clean":"2023-11-15T01:22:22.857864+0000","last_became_active":"2023-11-15T01:22:22.849865+0000","last_became_peered":"2023-11-15T01:22:22.849865+0000","last_unstale":"2023-11-15T01:22:22.857864+0000","last_undegraded":"2023-11-15T01:22:22.857864+0000","last_fullsized":"2023-11-15T01:22:22.857864+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.249650+0000","last_change":"2023-11-15T01:22:23.249650+0000","last_active":"2023-11-15T01:22:23.249650+0000","last_peered":"2023-11-15T01:22:23.249650+0000","last_clean":"2023-11-15T01:22:23.249650+0000","last_became_active":"2023-11-15T01:22:23.249048+0000","last_became_peered":"2023-11-15T01:22:23.249048+0000","last_unstale":"2023-11-15T01:22:23.249650+0000","last_undegraded":"2023-11-15T01:22:23.249650+0000","last_fullsized":"2023-11-15T01:22:23.249650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.857355+0000","last_change":"2023-11-15T01:22:22.850775+0000","last_active":"2023-11-15T01:22:22.857355+0000","last_peered":"2023-11-15T01:22:22.857355+0000","last_clean":"2023-11-15T01:22:22.857355+0000","last_became_active":"2023-11-15T01:22:22.850477+0000","last_became_peered":"2023-11-15T01:22:22.850477+0000","last_unstale":"2023-11-15T01:22:22.857355+0000","last_undegraded":"2023-11-15T01:22:22.857355+0000","last_fullsized":"2023-11-15T01:22:22.857355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.256643+0000","last_change":"2023-11-15T01:22:23.256643+0000","last_active":"2023-11-15T01:22:23.256643+0000","last_peered":"2023-11-15T01:22:23.256643+0000","last_clean":"2023-11-15T01:22:23.256643+0000","last_became_active":"2023-11-15T01:22:23.254895+0000","last_became_peered":"2023-11-15T01:22:23.254895+0000","last_unstale":"2023-11-15T01:22:23.256643+0000","last_undegraded":"2023-11-15T01:22:23.256643+0000","last_fullsized":"2023-11-15T01:22:23.256643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.259035+0000","last_change":"2023-11-15T01:22:22.864812+0000","last_active":"2023-11-15T01:22:23.259035+0000","last_peered":"2023-11-15T01:22:23.259035+0000","last_clean":"2023-11-15T01:22:23.259035+0000","last_became_active":"2023-11-15T01:22:22.864086+0000","last_became_peered":"2023-11-15T01:22:22.864086+0000","last_unstale":"2023-11-15T01:22:23.259035+0000","last_undegraded":"2023-11-15T01:22:23.259035+0000","last_fullsized":"2023-11-15T01:22:23.259035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.240728+0000","last_change":"2023-11-15T01:22:23.240728+0000","last_active":"2023-11-15T01:22:23.240728+0000","last_peered":"2023-11-15T01:22:23.240728+0000","last_clean":"2023-11-15T01:22:23.240728+0000","last_became_active":"2023-11-15T01:22:23.240450+0000","last_became_peered":"2023-11-15T01:22:23.240450+0000","last_unstale":"2023-11-15T01:22:23.240728+0000","last_undegraded":"2023-11-15T01:22:23.240728+0000","last_fullsized":"2023-11-15T01:22:23.240728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864270+0000","last_change":"2023-11-15T01:22:22.859015+0000","last_active":"2023-11-15T01:22:22.864270+0000","last_peered":"2023-11-15T01:22:22.864270+0000","last_clean":"2023-11-15T01:22:22.864270+0000","last_became_active":"2023-11-15T01:22:22.858667+0000","last_became_peered":"2023-11-15T01:22:22.858667+0000","last_unstale":"2023-11-15T01:22:22.864270+0000","last_undegraded":"2023-11-15T01:22:22.864270+0000","last_fullsized":"2023-11-15T01:22:22.864270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.255885+0000","last_change":"2023-11-15T01:22:23.255885+0000","last_active":"2023-11-15T01:22:23.255885+0000","last_peered":"2023-11-15T01:22:23.255885+0000","last_clean":"2023-11-15T01:22:23.255885+0000","last_became_active":"2023-11-15T01:22:23.255686+0000","last_became_peered":"2023-11-15T01:22:23.255686+0000","last_unstale":"2023-11-15T01:22:23.255885+0000","last_undegraded":"2023-11-15T01:22:23.255885+0000","last_fullsized":"2023-11-15T01:22:23.255885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.861868+0000","last_change":"2023-11-15T01:22:22.854587+0000","last_active":"2023-11-15T01:22:22.861868+0000","last_peered":"2023-11-15T01:22:22.861868+0000","last_clean":"2023-11-15T01:22:22.861868+0000","last_became_active":"2023-11-15T01:22:22.852487+0000","last_became_peered":"2023-11-15T01:22:22.852487+0000","last_unstale":"2023-11-15T01:22:22.861868+0000","last_undegraded":"2023-11-15T01:22:22.861868+0000","last_fullsized":"2023-11-15T01:22:22.861868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.245429+0000","last_change":"2023-11-15T01:22:23.245429+0000","last_active":"2023-11-15T01:22:23.245429+0000","last_peered":"2023-11-15T01:22:23.245429+0000","last_clean":"2023-11-15T01:22:23.245429+0000","last_became_active":"2023-11-15T01:22:23.245126+0000","last_became_peered":"2023-11-15T01:22:23.245126+0000","last_unstale":"2023-11-15T01:22:23.245429+0000","last_undegraded":"2023-11-15T01:22:23.245429+0000","last_fullsized":"2023-11-15T01:22:23.245429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.244614+0000","last_change":"2023-11-15T01:22:22.856575+0000","last_active":"2023-11-15T01:22:23.244614+0000","last_peered":"2023-11-15T01:22:23.244614+0000","last_clean":"2023-11-15T01:22:23.244614+0000","last_became_active":"2023-11-15T01:22:22.856252+0000","last_became_peered":"2023-11-15T01:22:22.856252+0000","last_unstale":"2023-11-15T01:22:23.244614+0000","last_undegraded":"2023-11-15T01:22:23.244614+0000","last_fullsized":"2023-11-15T01:22:23.244614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.260138+0000","last_change":"2023-11-15T01:22:23.260138+0000","last_active":"2023-11-15T01:22:23.260138+0000","last_peered":"2023-11-15T01:22:23.260138+0000","last_clean":"2023-11-15T01:22:23.260138+0000","last_became_active":"2023-11-15T01:22:23.259879+0000","last_became_peered":"2023-11-15T01:22:23.259879+0000","last_unstale":"2023-11-15T01:22:23.260138+0000","last_undegraded":"2023-11-15T01:22:23.260138+0000","last_fullsized":"2023-11-15T01:22:23.260138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.859806+0000","last_change":"2023-11-15T01:22:22.857204+0000","last_active":"2023-11-15T01:22:22.859806+0000","last_peered":"2023-11-15T01:22:22.859806+0000","last_clean":"2023-11-15T01:22:22.859806+0000","last_became_active":"2023-11-15T01:22:22.856918+0000","last_became_peered":"2023-11-15T01:22:22.856918+0000","last_unstale":"2023-11-15T01:22:22.859806+0000","last_undegraded":"2023-11-15T01:22:22.859806+0000","last_fullsized":"2023-11-15T01:22:22.859806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.255451+0000","last_change":"2023-11-15T01:22:23.255451+0000","last_active":"2023-11-15T01:22:23.255451+0000","last_peered":"2023-11-15T01:22:23.255451+0000","last_clean":"2023-11-15T01:22:23.255451+0000","last_became_active":"2023-11-15T01:22:23.255180+0000","last_became_peered":"2023-11-15T01:22:23.255180+0000","last_unstale":"2023-11-15T01:22:23.255451+0000","last_undegraded":"2023-11-15T01:22:23.255451+0000","last_fullsized":"2023-11-15T01:22:23.255451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.234387+0000","last_change":"2023-11-15T01:22:22.856122+0000","last_active":"2023-11-15T01:22:23.234387+0000","last_peered":"2023-11-15T01:22:23.234387+0000","last_clean":"2023-11-15T01:22:23.234387+0000","last_became_active":"2023-11-15T01:22:22.855817+0000","last_became_peered":"2023-11-15T01:22:22.855817+0000","last_unstale":"2023-11-15T01:22:23.234387+0000","last_undegraded":"2023-11-15T01:22:23.234387+0000","last_fullsized":"2023-11-15T01:22:23.234387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.256880+0000","last_change":"2023-11-15T01:22:23.256880+0000","last_active":"2023-11-15T01:22:23.256880+0000","last_peered":"2023-11-15T01:22:23.256880+0000","last_clean":"2023-11-15T01:22:23.256880+0000","last_became_active":"2023-11-15T01:22:23.256610+0000","last_became_peered":"2023-11-15T01:22:23.256610+0000","last_unstale":"2023-11-15T01:22:23.256880+0000","last_undegraded":"2023-11-15T01:22:23.256880+0000","last_fullsized":"2023-11-15T01:22:23.256880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864871+0000","last_change":"2023-11-15T01:22:22.860644+0000","last_active":"2023-11-15T01:22:22.864871+0000","last_peered":"2023-11-15T01:22:22.864871+0000","last_clean":"2023-11-15T01:22:22.864871+0000","last_became_active":"2023-11-15T01:22:22.860380+0000","last_became_peered":"2023-11-15T01:22:22.860380+0000","last_unstale":"2023-11-15T01:22:22.864871+0000","last_undegraded":"2023-11-15T01:22:22.864871+0000","last_fullsized":"2023-11-15T01:22:22.864871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252708+0000","last_change":"2023-11-15T01:22:23.252708+0000","last_active":"2023-11-15T01:22:23.252708+0000","last_peered":"2023-11-15T01:22:23.252708+0000","last_clean":"2023-11-15T01:22:23.252708+0000","last_became_active":"2023-11-15T01:22:23.252028+0000","last_became_peered":"2023-11-15T01:22:23.252028+0000","last_unstale":"2023-11-15T01:22:23.252708+0000","last_undegraded":"2023-11-15T01:22:23.252708+0000","last_fullsized":"2023-11-15T01:22:23.252708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.866459+0000","last_change":"2023-11-15T01:22:22.861716+0000","last_active":"2023-11-15T01:22:22.866459+0000","last_peered":"2023-11-15T01:22:22.866459+0000","last_clean":"2023-11-15T01:22:22.866459+0000","last_became_active":"2023-11-15T01:22:22.861411+0000","last_became_peered":"2023-11-15T01:22:22.861411+0000","last_unstale":"2023-11-15T01:22:22.866459+0000","last_undegraded":"2023-11-15T01:22:22.866459+0000","last_fullsized":"2023-11-15T01:22:22.866459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.256837+0000","last_change":"2023-11-15T01:22:23.256837+0000","last_active":"2023-11-15T01:22:23.256837+0000","last_peered":"2023-11-15T01:22:23.256837+0000","last_clean":"2023-11-15T01:22:23.256837+0000","last_became_active":"2023-11-15T01:22:23.255297+0000","last_became_peered":"2023-11-15T01:22:23.255297+0000","last_unstale":"2023-11-15T01:22:23.256837+0000","last_undegraded":"2023-11-15T01:22:23.256837+0000","last_fullsized":"2023-11-15T01:22:23.256837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.857431+0000","last_change":"2023-11-15T01:22:22.850408+0000","last_active":"2023-11-15T01:22:22.857431+0000","last_peered":"2023-11-15T01:22:22.857431+0000","last_clean":"2023-11-15T01:22:22.857431+0000","last_became_active":"2023-11-15T01:22:22.850145+0000","last_became_peered":"2023-11-15T01:22:22.850145+0000","last_unstale":"2023-11-15T01:22:22.857431+0000","last_undegraded":"2023-11-15T01:22:22.857431+0000","last_fullsized":"2023-11-15T01:22:22.857431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250645+0000","last_change":"2023-11-15T01:22:23.250645+0000","last_active":"2023-11-15T01:22:23.250645+0000","last_peered":"2023-11-15T01:22:23.250645+0000","last_clean":"2023-11-15T01:22:23.250645+0000","last_became_active":"2023-11-15T01:22:23.250352+0000","last_became_peered":"2023-11-15T01:22:23.250352+0000","last_unstale":"2023-11-15T01:22:23.250645+0000","last_undegraded":"2023-11-15T01:22:23.250645+0000","last_fullsized":"2023-11-15T01:22:23.250645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864564+0000","last_change":"2023-11-15T01:22:22.861001+0000","last_active":"2023-11-15T01:22:22.864564+0000","last_peered":"2023-11-15T01:22:22.864564+0000","last_clean":"2023-11-15T01:22:22.864564+0000","last_became_active":"2023-11-15T01:22:22.860334+0000","last_became_peered":"2023-11-15T01:22:22.860334+0000","last_unstale":"2023-11-15T01:22:22.864564+0000","last_undegraded":"2023-11-15T01:22:22.864564+0000","last_fullsized":"2023-11-15T01:22:22.864564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250310+0000","last_change":"2023-11-15T01:22:23.250310+0000","last_active":"2023-11-15T01:22:23.250310+0000","last_peered":"2023-11-15T01:22:23.250310+0000","last_clean":"2023-11-15T01:22:23.250310+0000","last_became_active":"2023-11-15T01:22:23.250050+0000","last_became_peered":"2023-11-15T01:22:23.250050+0000","last_unstale":"2023-11-15T01:22:23.250310+0000","last_undegraded":"2023-11-15T01:22:23.250310+0000","last_fullsized":"2023-11-15T01:22:23.250310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864775+0000","last_change":"2023-11-15T01:22:22.863095+0000","last_active":"2023-11-15T01:22:22.864775+0000","last_peered":"2023-11-15T01:22:22.864775+0000","last_clean":"2023-11-15T01:22:22.864775+0000","last_became_active":"2023-11-15T01:22:22.862813+0000","last_became_peered":"2023-11-15T01:22:22.862813+0000","last_unstale":"2023-11-15T01:22:22.864775+0000","last_undegraded":"2023-11-15T01:22:22.864775+0000","last_fullsized":"2023-11-15T01:22:22.864775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.259070+0000","last_change":"2023-11-15T01:22:23.259070+0000","last_active":"2023-11-15T01:22:23.259070+0000","last_peered":"2023-11-15T01:22:23.259070+0000","last_clean":"2023-11-15T01:22:23.259070+0000","last_became_active":"2023-11-15T01:22:23.258785+0000","last_became_peered":"2023-11-15T01:22:23.258785+0000","last_unstale":"2023-11-15T01:22:23.259070+0000","last_undegraded":"2023-11-15T01:22:23.259070+0000","last_fullsized":"2023-11-15T01:22:23.259070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.865500+0000","last_change":"2023-11-15T01:22:22.864210+0000","last_active":"2023-11-15T01:22:22.865500+0000","last_peered":"2023-11-15T01:22:22.865500+0000","last_clean":"2023-11-15T01:22:22.865500+0000","last_became_active":"2023-11-15T01:22:22.863141+0000","last_became_peered":"2023-11-15T01:22:22.863141+0000","last_unstale":"2023-11-15T01:22:22.865500+0000","last_undegraded":"2023-11-15T01:22:22.865500+0000","last_fullsized":"2023-11-15T01:22:22.865500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.242986+0000","last_change":"2023-11-15T01:22:23.242986+0000","last_active":"2023-11-15T01:22:23.242986+0000","last_peered":"2023-11-15T01:22:23.242986+0000","last_clean":"2023-11-15T01:22:23.242986+0000","last_became_active":"2023-11-15T01:22:23.242624+0000","last_became_peered":"2023-11-15T01:22:23.242624+0000","last_unstale":"2023-11-15T01:22:23.242986+0000","last_undegraded":"2023-11-15T01:22:23.242986+0000","last_fullsized":"2023-11-15T01:22:23.242986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.858506+0000","last_change":"2023-11-15T01:22:22.853874+0000","last_active":"2023-11-15T01:22:22.858506+0000","last_peered":"2023-11-15T01:22:22.858506+0000","last_clean":"2023-11-15T01:22:22.858506+0000","last_became_active":"2023-11-15T01:22:22.853533+0000","last_became_peered":"2023-11-15T01:22:22.853533+0000","last_unstale":"2023-11-15T01:22:22.858506+0000","last_undegraded":"2023-11-15T01:22:22.858506+0000","last_fullsized":"2023-11-15T01:22:22.858506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250338+0000","last_change":"2023-11-15T01:22:23.250338+0000","last_active":"2023-11-15T01:22:23.250338+0000","last_peered":"2023-11-15T01:22:23.250338+0000","last_clean":"2023-11-15T01:22:23.250338+0000","last_became_active":"2023-11-15T01:22:23.250007+0000","last_became_peered":"2023-11-15T01:22:23.250007+0000","last_unstale":"2023-11-15T01:22:23.250338+0000","last_undegraded":"2023-11-15T01:22:23.250338+0000","last_fullsized":"2023-11-15T01:22:23.250338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864905+0000","last_change":"2023-11-15T01:22:22.860800+0000","last_active":"2023-11-15T01:22:22.864905+0000","last_peered":"2023-11-15T01:22:22.864905+0000","last_clean":"2023-11-15T01:22:22.864905+0000","last_became_active":"2023-11-15T01:22:22.860461+0000","last_became_peered":"2023-11-15T01:22:22.860461+0000","last_unstale":"2023-11-15T01:22:22.864905+0000","last_undegraded":"2023-11-15T01:22:22.864905+0000","last_fullsized":"2023-11-15T01:22:22.864905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250699+0000","last_change":"2023-11-15T01:22:23.250699+0000","last_active":"2023-11-15T01:22:23.250699+0000","last_peered":"2023-11-15T01:22:23.250699+0000","last_clean":"2023-11-15T01:22:23.250699+0000","last_became_active":"2023-11-15T01:22:23.250415+0000","last_became_peered":"2023-11-15T01:22:23.250415+0000","last_unstale":"2023-11-15T01:22:23.250699+0000","last_undegraded":"2023-11-15T01:22:23.250699+0000","last_fullsized":"2023-11-15T01:22:23.250699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864097+0000","last_change":"2023-11-15T01:22:22.859092+0000","last_active":"2023-11-15T01:22:22.864097+0000","last_peered":"2023-11-15T01:22:22.864097+0000","last_clean":"2023-11-15T01:22:22.864097+0000","last_became_active":"2023-11-15T01:22:22.858800+0000","last_became_peered":"2023-11-15T01:22:22.858800+0000","last_unstale":"2023-11-15T01:22:22.864097+0000","last_undegraded":"2023-11-15T01:22:22.864097+0000","last_fullsized":"2023-11-15T01:22:22.864097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.245277+0000","last_change":"2023-11-15T01:22:23.245277+0000","last_active":"2023-11-15T01:22:23.245277+0000","last_peered":"2023-11-15T01:22:23.245277+0000","last_clean":"2023-11-15T01:22:23.245277+0000","last_became_active":"2023-11-15T01:22:23.245047+0000","last_became_peered":"2023-11-15T01:22:23.245047+0000","last_unstale":"2023-11-15T01:22:23.245277+0000","last_undegraded":"2023-11-15T01:22:23.245277+0000","last_fullsized":"2023-11-15T01:22:23.245277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.857936+0000","last_change":"2023-11-15T01:22:22.850923+0000","last_active":"2023-11-15T01:22:22.857936+0000","last_peered":"2023-11-15T01:22:22.857936+0000","last_clean":"2023-11-15T01:22:22.857936+0000","last_became_active":"2023-11-15T01:22:22.850039+0000","last_became_peered":"2023-11-15T01:22:22.850039+0000","last_unstale":"2023-11-15T01:22:22.857936+0000","last_undegraded":"2023-11-15T01:22:22.857936+0000","last_fullsized":"2023-11-15T01:22:22.857936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.242504+0000","last_change":"2023-11-15T01:22:23.242504+0000","last_active":"2023-11-15T01:22:23.242504+0000","last_peered":"2023-11-15T01:22:23.242504+0000","last_clean":"2023-11-15T01:22:23.242504+0000","last_became_active":"2023-11-15T01:22:23.241791+0000","last_became_peered":"2023-11-15T01:22:23.241791+0000","last_unstale":"2023-11-15T01:22:23.242504+0000","last_undegraded":"2023-11-15T01:22:23.242504+0000","last_fullsized":"2023-11-15T01:22:23.242504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.866365+0000","last_change":"2023-11-15T01:22:22.864626+0000","last_active":"2023-11-15T01:22:22.866365+0000","last_peered":"2023-11-15T01:22:22.866365+0000","last_clean":"2023-11-15T01:22:22.866365+0000","last_became_active":"2023-11-15T01:22:22.863503+0000","last_became_peered":"2023-11-15T01:22:22.863503+0000","last_unstale":"2023-11-15T01:22:22.866365+0000","last_undegraded":"2023-11-15T01:22:22.866365+0000","last_fullsized":"2023-11-15T01:22:22.866365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.258642+0000","last_change":"2023-11-15T01:22:23.258642+0000","last_active":"2023-11-15T01:22:23.258642+0000","last_peered":"2023-11-15T01:22:23.258642+0000","last_clean":"2023-11-15T01:22:23.258642+0000","last_became_active":"2023-11-15T01:22:23.258243+0000","last_became_peered":"2023-11-15T01:22:23.258243+0000","last_unstale":"2023-11-15T01:22:23.258642+0000","last_undegraded":"2023-11-15T01:22:23.258642+0000","last_fullsized":"2023-11-15T01:22:23.258642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.235726+0000","last_change":"2023-11-15T01:22:22.850263+0000","last_active":"2023-11-15T01:22:23.235726+0000","last_peered":"2023-11-15T01:22:23.235726+0000","last_clean":"2023-11-15T01:22:23.235726+0000","last_became_active":"2023-11-15T01:22:22.849706+0000","last_became_peered":"2023-11-15T01:22:22.849706+0000","last_unstale":"2023-11-15T01:22:23.235726+0000","last_undegraded":"2023-11-15T01:22:23.235726+0000","last_fullsized":"2023-11-15T01:22:23.235726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.260521+0000","last_change":"2023-11-15T01:22:23.260521+0000","last_active":"2023-11-15T01:22:23.260521+0000","last_peered":"2023-11-15T01:22:23.260521+0000","last_clean":"2023-11-15T01:22:23.260521+0000","last_became_active":"2023-11-15T01:22:23.260250+0000","last_became_peered":"2023-11-15T01:22:23.260250+0000","last_unstale":"2023-11-15T01:22:23.260521+0000","last_undegraded":"2023-11-15T01:22:23.260521+0000","last_fullsized":"2023-11-15T01:22:23.260521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.233876+0000","last_change":"2023-11-15T01:22:22.868957+0000","last_active":"2023-11-15T01:22:23.233876+0000","last_peered":"2023-11-15T01:22:23.233876+0000","last_clean":"2023-11-15T01:22:23.233876+0000","last_became_active":"2023-11-15T01:22:22.868690+0000","last_became_peered":"2023-11-15T01:22:22.868690+0000","last_unstale":"2023-11-15T01:22:23.233876+0000","last_undegraded":"2023-11-15T01:22:23.233876+0000","last_fullsized":"2023-11-15T01:22:23.233876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252989+0000","last_change":"2023-11-15T01:22:23.252989+0000","last_active":"2023-11-15T01:22:23.252989+0000","last_peered":"2023-11-15T01:22:23.252989+0000","last_clean":"2023-11-15T01:22:23.252989+0000","last_became_active":"2023-11-15T01:22:23.249062+0000","last_became_peered":"2023-11-15T01:22:23.249062+0000","last_unstale":"2023-11-15T01:22:23.252989+0000","last_undegraded":"2023-11-15T01:22:23.252989+0000","last_fullsized":"2023-11-15T01:22:23.252989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.254485+0000","last_change":"2023-11-15T01:22:22.864997+0000","last_active":"2023-11-15T01:22:23.254485+0000","last_peered":"2023-11-15T01:22:23.254485+0000","last_clean":"2023-11-15T01:22:23.254485+0000","last_became_active":"2023-11-15T01:22:22.863783+0000","last_became_peered":"2023-11-15T01:22:22.863783+0000","last_unstale":"2023-11-15T01:22:23.254485+0000","last_undegraded":"2023-11-15T01:22:23.254485+0000","last_fullsized":"2023-11-15T01:22:23.254485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.254922+0000","last_change":"2023-11-15T01:22:23.254922+0000","last_active":"2023-11-15T01:22:23.254922+0000","last_peered":"2023-11-15T01:22:23.254922+0000","last_clean":"2023-11-15T01:22:23.254922+0000","last_became_active":"2023-11-15T01:22:23.254674+0000","last_became_peered":"2023-11-15T01:22:23.254674+0000","last_unstale":"2023-11-15T01:22:23.254922+0000","last_undegraded":"2023-11-15T01:22:23.254922+0000","last_fullsized":"2023-11-15T01:22:23.254922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.862185+0000","last_change":"2023-11-15T01:22:22.856888+0000","last_active":"2023-11-15T01:22:22.862185+0000","last_peered":"2023-11-15T01:22:22.862185+0000","last_clean":"2023-11-15T01:22:22.862185+0000","last_became_active":"2023-11-15T01:22:22.856591+0000","last_became_peered":"2023-11-15T01:22:22.856591+0000","last_unstale":"2023-11-15T01:22:22.862185+0000","last_undegraded":"2023-11-15T01:22:22.862185+0000","last_fullsized":"2023-11-15T01:22:22.862185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.240904+0000","last_change":"2023-11-15T01:22:23.240904+0000","last_active":"2023-11-15T01:22:23.240904+0000","last_peered":"2023-11-15T01:22:23.240904+0000","last_clean":"2023-11-15T01:22:23.240904+0000","last_became_active":"2023-11-15T01:22:23.240662+0000","last_became_peered":"2023-11-15T01:22:23.240662+0000","last_unstale":"2023-11-15T01:22:23.240904+0000","last_undegraded":"2023-11-15T01:22:23.240904+0000","last_fullsized":"2023-11-15T01:22:23.240904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.858345+0000","last_change":"2023-11-15T01:22:22.854484+0000","last_active":"2023-11-15T01:22:22.858345+0000","last_peered":"2023-11-15T01:22:22.858345+0000","last_clean":"2023-11-15T01:22:22.858345+0000","last_became_active":"2023-11-15T01:22:22.854138+0000","last_became_peered":"2023-11-15T01:22:22.854138+0000","last_unstale":"2023-11-15T01:22:22.858345+0000","last_undegraded":"2023-11-15T01:22:22.858345+0000","last_fullsized":"2023-11-15T01:22:22.858345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.242198+0000","last_change":"2023-11-15T01:22:23.242198+0000","last_active":"2023-11-15T01:22:23.242198+0000","last_peered":"2023-11-15T01:22:23.242198+0000","last_clean":"2023-11-15T01:22:23.242198+0000","last_became_active":"2023-11-15T01:22:23.241751+0000","last_became_peered":"2023-11-15T01:22:23.241751+0000","last_unstale":"2023-11-15T01:22:23.242198+0000","last_undegraded":"2023-11-15T01:22:23.242198+0000","last_fullsized":"2023-11-15T01:22:23.242198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864912+0000","last_change":"2023-11-15T01:22:22.862973+0000","last_active":"2023-11-15T01:22:22.864912+0000","last_peered":"2023-11-15T01:22:22.864912+0000","last_clean":"2023-11-15T01:22:22.864912+0000","last_became_active":"2023-11-15T01:22:22.862675+0000","last_became_peered":"2023-11-15T01:22:22.862675+0000","last_unstale":"2023-11-15T01:22:22.864912+0000","last_undegraded":"2023-11-15T01:22:22.864912+0000","last_fullsized":"2023-11-15T01:22:22.864912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.257575+0000","last_change":"2023-11-15T01:22:23.257575+0000","last_active":"2023-11-15T01:22:23.257575+0000","last_peered":"2023-11-15T01:22:23.257575+0000","last_clean":"2023-11-15T01:22:23.257575+0000","last_became_active":"2023-11-15T01:22:23.257221+0000","last_became_peered":"2023-11-15T01:22:23.257221+0000","last_unstale":"2023-11-15T01:22:23.257575+0000","last_undegraded":"2023-11-15T01:22:23.257575+0000","last_fullsized":"2023-11-15T01:22:23.257575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.862142+0000","last_change":"2023-11-15T01:22:22.859522+0000","last_active":"2023-11-15T01:22:22.862142+0000","last_peered":"2023-11-15T01:22:22.862142+0000","last_clean":"2023-11-15T01:22:22.862142+0000","last_became_active":"2023-11-15T01:22:22.858921+0000","last_became_peered":"2023-11-15T01:22:22.858921+0000","last_unstale":"2023-11-15T01:22:22.862142+0000","last_undegraded":"2023-11-15T01:22:22.862142+0000","last_fullsized":"2023-11-15T01:22:22.862142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.248806+0000","last_change":"2023-11-15T01:22:23.248806+0000","last_active":"2023-11-15T01:22:23.248806+0000","last_peered":"2023-11-15T01:22:23.248806+0000","last_clean":"2023-11-15T01:22:23.248806+0000","last_became_active":"2023-11-15T01:22:23.248585+0000","last_became_peered":"2023-11-15T01:22:23.248585+0000","last_unstale":"2023-11-15T01:22:23.248806+0000","last_undegraded":"2023-11-15T01:22:23.248806+0000","last_fullsized":"2023-11-15T01:22:23.248806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.861861+0000","last_change":"2023-11-15T01:22:22.849188+0000","last_active":"2023-11-15T01:22:22.861861+0000","last_peered":"2023-11-15T01:22:22.861861+0000","last_clean":"2023-11-15T01:22:22.861861+0000","last_became_active":"2023-11-15T01:22:22.848954+0000","last_became_peered":"2023-11-15T01:22:22.848954+0000","last_unstale":"2023-11-15T01:22:22.861861+0000","last_undegraded":"2023-11-15T01:22:22.861861+0000","last_fullsized":"2023-11-15T01:22:22.861861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.248977+0000","last_change":"2023-11-15T01:22:23.248977+0000","last_active":"2023-11-15T01:22:23.248977+0000","last_peered":"2023-11-15T01:22:23.248977+0000","last_clean":"2023-11-15T01:22:23.248977+0000","last_became_active":"2023-11-15T01:22:23.248455+0000","last_became_peered":"2023-11-15T01:22:23.248455+0000","last_unstale":"2023-11-15T01:22:23.248977+0000","last_undegraded":"2023-11-15T01:22:23.248977+0000","last_fullsized":"2023-11-15T01:22:23.248977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.861997+0000","last_change":"2023-11-15T01:22:22.853999+0000","last_active":"2023-11-15T01:22:22.861997+0000","last_peered":"2023-11-15T01:22:22.861997+0000","last_clean":"2023-11-15T01:22:22.861997+0000","last_became_active":"2023-11-15T01:22:22.852575+0000","last_became_peered":"2023-11-15T01:22:22.852575+0000","last_unstale":"2023-11-15T01:22:22.861997+0000","last_undegraded":"2023-11-15T01:22:22.861997+0000","last_fullsized":"2023-11-15T01:22:22.861997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252446+0000","last_change":"2023-11-15T01:22:23.252446+0000","last_active":"2023-11-15T01:22:23.252446+0000","last_peered":"2023-11-15T01:22:23.252446+0000","last_clean":"2023-11-15T01:22:23.252446+0000","last_became_active":"2023-11-15T01:22:23.252073+0000","last_became_peered":"2023-11-15T01:22:23.252073+0000","last_unstale":"2023-11-15T01:22:23.252446+0000","last_undegraded":"2023-11-15T01:22:23.252446+0000","last_fullsized":"2023-11-15T01:22:23.252446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.859086+0000","last_change":"2023-11-15T01:22:22.856676+0000","last_active":"2023-11-15T01:22:22.859086+0000","last_peered":"2023-11-15T01:22:22.859086+0000","last_clean":"2023-11-15T01:22:22.859086+0000","last_became_active":"2023-11-15T01:22:22.856241+0000","last_became_peered":"2023-11-15T01:22:22.856241+0000","last_unstale":"2023-11-15T01:22:22.859086+0000","last_undegraded":"2023-11-15T01:22:22.859086+0000","last_fullsized":"2023-11-15T01:22:22.859086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.243725+0000","last_change":"2023-11-15T01:22:23.243725+0000","last_active":"2023-11-15T01:22:23.243725+0000","last_peered":"2023-11-15T01:22:23.243725+0000","last_clean":"2023-11-15T01:22:23.243725+0000","last_became_active":"2023-11-15T01:22:23.243441+0000","last_became_peered":"2023-11-15T01:22:23.243441+0000","last_unstale":"2023-11-15T01:22:23.243725+0000","last_undegraded":"2023-11-15T01:22:23.243725+0000","last_fullsized":"2023-11-15T01:22:23.243725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.261293+0000","last_change":"2023-11-15T01:22:22.855829+0000","last_active":"2023-11-15T01:22:23.261293+0000","last_peered":"2023-11-15T01:22:23.261293+0000","last_clean":"2023-11-15T01:22:23.261293+0000","last_became_active":"2023-11-15T01:22:22.855452+0000","last_became_peered":"2023-11-15T01:22:22.855452+0000","last_unstale":"2023-11-15T01:22:23.261293+0000","last_undegraded":"2023-11-15T01:22:23.261293+0000","last_fullsized":"2023-11-15T01:22:23.261293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250439+0000","last_change":"2023-11-15T01:22:23.250439+0000","last_active":"2023-11-15T01:22:23.250439+0000","last_peered":"2023-11-15T01:22:23.250439+0000","last_clean":"2023-11-15T01:22:23.250439+0000","last_became_active":"2023-11-15T01:22:23.250185+0000","last_became_peered":"2023-11-15T01:22:23.250185+0000","last_unstale":"2023-11-15T01:22:23.250439+0000","last_undegraded":"2023-11-15T01:22:23.250439+0000","last_fullsized":"2023-11-15T01:22:23.250439+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.253398+0000","last_change":"2023-11-15T01:22:22.860433+0000","last_active":"2023-11-15T01:22:23.253398+0000","last_peered":"2023-11-15T01:22:23.253398+0000","last_clean":"2023-11-15T01:22:23.253398+0000","last_became_active":"2023-11-15T01:22:22.860101+0000","last_became_peered":"2023-11-15T01:22:22.860101+0000","last_unstale":"2023-11-15T01:22:23.253398+0000","last_undegraded":"2023-11-15T01:22:23.253398+0000","last_fullsized":"2023-11-15T01:22:23.253398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.245424+0000","last_change":"2023-11-15T01:22:23.245424+0000","last_active":"2023-11-15T01:22:23.245424+0000","last_peered":"2023-11-15T01:22:23.245424+0000","last_clean":"2023-11-15T01:22:23.245424+0000","last_became_active":"2023-11-15T01:22:23.245185+0000","last_became_peered":"2023-11-15T01:22:23.245185+0000","last_unstale":"2023-11-15T01:22:23.245424+0000","last_undegraded":"2023-11-15T01:22:23.245424+0000","last_fullsized":"2023-11-15T01:22:23.245424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.246945+0000","last_change":"2023-11-15T01:22:22.855825+0000","last_active":"2023-11-15T01:22:23.246945+0000","last_peered":"2023-11-15T01:22:23.246945+0000","last_clean":"2023-11-15T01:22:23.246945+0000","last_became_active":"2023-11-15T01:22:22.855563+0000","last_became_peered":"2023-11-15T01:22:22.855563+0000","last_unstale":"2023-11-15T01:22:23.246945+0000","last_undegraded":"2023-11-15T01:22:23.246945+0000","last_fullsized":"2023-11-15T01:22:23.246945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.247654+0000","last_change":"2023-11-15T01:22:23.247654+0000","last_active":"2023-11-15T01:22:23.247654+0000","last_peered":"2023-11-15T01:22:23.247654+0000","last_clean":"2023-11-15T01:22:23.247654+0000","last_became_active":"2023-11-15T01:22:23.244713+0000","last_became_peered":"2023-11-15T01:22:23.244713+0000","last_unstale":"2023-11-15T01:22:23.247654+0000","last_undegraded":"2023-11-15T01:22:23.247654+0000","last_fullsized":"2023-11-15T01:22:23.247654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864924+0000","last_change":"2023-11-15T01:22:22.862286+0000","last_active":"2023-11-15T01:22:22.864924+0000","last_peered":"2023-11-15T01:22:22.864924+0000","last_clean":"2023-11-15T01:22:22.864924+0000","last_became_active":"2023-11-15T01:22:22.861590+0000","last_became_peered":"2023-11-15T01:22:22.861590+0000","last_unstale":"2023-11-15T01:22:22.864924+0000","last_undegraded":"2023-11-15T01:22:22.864924+0000","last_fullsized":"2023-11-15T01:22:22.864924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.251058+0000","last_change":"2023-11-15T01:22:23.251058+0000","last_active":"2023-11-15T01:22:23.251058+0000","last_peered":"2023-11-15T01:22:23.251058+0000","last_clean":"2023-11-15T01:22:23.251058+0000","last_became_active":"2023-11-15T01:22:23.250721+0000","last_became_peered":"2023-11-15T01:22:23.250721+0000","last_unstale":"2023-11-15T01:22:23.251058+0000","last_undegraded":"2023-11-15T01:22:23.251058+0000","last_fullsized":"2023-11-15T01:22:23.251058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.857956+0000","last_change":"2023-11-15T01:22:22.851075+0000","last_active":"2023-11-15T01:22:22.857956+0000","last_peered":"2023-11-15T01:22:22.857956+0000","last_clean":"2023-11-15T01:22:22.857956+0000","last_became_active":"2023-11-15T01:22:22.850640+0000","last_became_peered":"2023-11-15T01:22:22.850640+0000","last_unstale":"2023-11-15T01:22:22.857956+0000","last_undegraded":"2023-11-15T01:22:22.857956+0000","last_fullsized":"2023-11-15T01:22:22.857956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.247079+0000","last_change":"2023-11-15T01:22:23.247079+0000","last_active":"2023-11-15T01:22:23.247079+0000","last_peered":"2023-11-15T01:22:23.247079+0000","last_clean":"2023-11-15T01:22:23.247079+0000","last_became_active":"2023-11-15T01:22:23.246655+0000","last_became_peered":"2023-11-15T01:22:23.246655+0000","last_unstale":"2023-11-15T01:22:23.247079+0000","last_undegraded":"2023-11-15T01:22:23.247079+0000","last_fullsized":"2023-11-15T01:22:23.247079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.255158+0000","last_change":"2023-11-15T01:22:22.864803+0000","last_active":"2023-11-15T01:22:23.255158+0000","last_peered":"2023-11-15T01:22:23.255158+0000","last_clean":"2023-11-15T01:22:23.255158+0000","last_became_active":"2023-11-15T01:22:22.863803+0000","last_became_peered":"2023-11-15T01:22:22.863803+0000","last_unstale":"2023-11-15T01:22:23.255158+0000","last_undegraded":"2023-11-15T01:22:23.255158+0000","last_fullsized":"2023-11-15T01:22:23.255158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.254689+0000","last_change":"2023-11-15T01:22:23.254689+0000","last_active":"2023-11-15T01:22:23.254689+0000","last_peered":"2023-11-15T01:22:23.254689+0000","last_clean":"2023-11-15T01:22:23.254689+0000","last_became_active":"2023-11-15T01:22:23.254407+0000","last_became_peered":"2023-11-15T01:22:23.254407+0000","last_unstale":"2023-11-15T01:22:23.254689+0000","last_undegraded":"2023-11-15T01:22:23.254689+0000","last_fullsized":"2023-11-15T01:22:23.254689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.246204+0000","last_change":"2023-11-15T01:22:22.858691+0000","last_active":"2023-11-15T01:22:23.246204+0000","last_peered":"2023-11-15T01:22:23.246204+0000","last_clean":"2023-11-15T01:22:23.246204+0000","last_became_active":"2023-11-15T01:22:22.858440+0000","last_became_peered":"2023-11-15T01:22:22.858440+0000","last_unstale":"2023-11-15T01:22:23.246204+0000","last_undegraded":"2023-11-15T01:22:23.246204+0000","last_fullsized":"2023-11-15T01:22:23.246204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252434+0000","last_change":"2023-11-15T01:22:23.252434+0000","last_active":"2023-11-15T01:22:23.252434+0000","last_peered":"2023-11-15T01:22:23.252434+0000","last_clean":"2023-11-15T01:22:23.252434+0000","last_became_active":"2023-11-15T01:22:23.252108+0000","last_became_peered":"2023-11-15T01:22:23.252108+0000","last_unstale":"2023-11-15T01:22:23.252434+0000","last_undegraded":"2023-11-15T01:22:23.252434+0000","last_fullsized":"2023-11-15T01:22:23.252434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.258201+0000","last_change":"2023-11-15T01:22:22.857639+0000","last_active":"2023-11-15T01:22:23.258201+0000","last_peered":"2023-11-15T01:22:23.258201+0000","last_clean":"2023-11-15T01:22:23.258201+0000","last_became_active":"2023-11-15T01:22:22.856846+0000","last_became_peered":"2023-11-15T01:22:22.856846+0000","last_unstale":"2023-11-15T01:22:23.258201+0000","last_undegraded":"2023-11-15T01:22:23.258201+0000","last_fullsized":"2023-11-15T01:22:23.258201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.242928+0000","last_change":"2023-11-15T01:22:23.242928+0000","last_active":"2023-11-15T01:22:23.242928+0000","last_peered":"2023-11-15T01:22:23.242928+0000","last_clean":"2023-11-15T01:22:23.242928+0000","last_became_active":"2023-11-15T01:22:23.242624+0000","last_became_peered":"2023-11-15T01:22:23.242624+0000","last_unstale":"2023-11-15T01:22:23.242928+0000","last_undegraded":"2023-11-15T01:22:23.242928+0000","last_fullsized":"2023-11-15T01:22:23.242928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.860934+0000","last_change":"2023-11-15T01:22:22.860124+0000","last_active":"2023-11-15T01:22:22.860934+0000","last_peered":"2023-11-15T01:22:22.860934+0000","last_clean":"2023-11-15T01:22:22.860934+0000","last_became_active":"2023-11-15T01:22:22.859840+0000","last_became_peered":"2023-11-15T01:22:22.859840+0000","last_unstale":"2023-11-15T01:22:22.860934+0000","last_undegraded":"2023-11-15T01:22:22.860934+0000","last_fullsized":"2023-11-15T01:22:22.860934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250406+0000","last_change":"2023-11-15T01:22:23.250406+0000","last_active":"2023-11-15T01:22:23.250406+0000","last_peered":"2023-11-15T01:22:23.250406+0000","last_clean":"2023-11-15T01:22:23.250406+0000","last_became_active":"2023-11-15T01:22:23.250089+0000","last_became_peered":"2023-11-15T01:22:23.250089+0000","last_unstale":"2023-11-15T01:22:23.250406+0000","last_undegraded":"2023-11-15T01:22:23.250406+0000","last_fullsized":"2023-11-15T01:22:23.250406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.865064+0000","last_change":"2023-11-15T01:22:22.863613+0000","last_active":"2023-11-15T01:22:22.865064+0000","last_peered":"2023-11-15T01:22:22.865064+0000","last_clean":"2023-11-15T01:22:22.865064+0000","last_became_active":"2023-11-15T01:22:22.862979+0000","last_became_peered":"2023-11-15T01:22:22.862979+0000","last_unstale":"2023-11-15T01:22:22.865064+0000","last_undegraded":"2023-11-15T01:22:22.865064+0000","last_fullsized":"2023-11-15T01:22:22.865064+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250991+0000","last_change":"2023-11-15T01:22:23.250991+0000","last_active":"2023-11-15T01:22:23.250991+0000","last_peered":"2023-11-15T01:22:23.250991+0000","last_clean":"2023-11-15T01:22:23.250991+0000","last_became_active":"2023-11-15T01:22:23.250700+0000","last_became_peered":"2023-11-15T01:22:23.250700+0000","last_unstale":"2023-11-15T01:22:23.250991+0000","last_undegraded":"2023-11-15T01:22:23.250991+0000","last_fullsized":"2023-11-15T01:22:23.250991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.237584+0000","last_change":"2023-11-15T01:22:22.859353+0000","last_active":"2023-11-15T01:22:23.237584+0000","last_peered":"2023-11-15T01:22:23.237584+0000","last_clean":"2023-11-15T01:22:23.237584+0000","last_became_active":"2023-11-15T01:22:22.854953+0000","last_became_peered":"2023-11-15T01:22:22.854953+0000","last_unstale":"2023-11-15T01:22:23.237584+0000","last_undegraded":"2023-11-15T01:22:23.237584+0000","last_fullsized":"2023-11-15T01:22:23.237584+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.249203+0000","last_change":"2023-11-15T01:22:23.249203+0000","last_active":"2023-11-15T01:22:23.249203+0000","last_peered":"2023-11-15T01:22:23.249203+0000","last_clean":"2023-11-15T01:22:23.249203+0000","last_became_active":"2023-11-15T01:22:23.248905+0000","last_became_peered":"2023-11-15T01:22:23.248905+0000","last_unstale":"2023-11-15T01:22:23.249203+0000","last_undegraded":"2023-11-15T01:22:23.249203+0000","last_fullsized":"2023-11-15T01:22:23.249203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.859695+0000","last_change":"2023-11-15T01:22:22.854376+0000","last_active":"2023-11-15T01:22:22.859695+0000","last_peered":"2023-11-15T01:22:22.859695+0000","last_clean":"2023-11-15T01:22:22.859695+0000","last_became_active":"2023-11-15T01:22:22.853983+0000","last_became_peered":"2023-11-15T01:22:22.853983+0000","last_unstale":"2023-11-15T01:22:22.859695+0000","last_undegraded":"2023-11-15T01:22:22.859695+0000","last_fullsized":"2023-11-15T01:22:22.859695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.249693+0000","last_change":"2023-11-15T01:22:23.249693+0000","last_active":"2023-11-15T01:22:23.249693+0000","last_peered":"2023-11-15T01:22:23.249693+0000","last_clean":"2023-11-15T01:22:23.249693+0000","last_became_active":"2023-11-15T01:22:23.249377+0000","last_became_peered":"2023-11-15T01:22:23.249377+0000","last_unstale":"2023-11-15T01:22:23.249693+0000","last_undegraded":"2023-11-15T01:22:23.249693+0000","last_fullsized":"2023-11-15T01:22:23.249693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864971+0000","last_change":"2023-11-15T01:22:22.861527+0000","last_active":"2023-11-15T01:22:22.864971+0000","last_peered":"2023-11-15T01:22:22.864971+0000","last_clean":"2023-11-15T01:22:22.864971+0000","last_became_active":"2023-11-15T01:22:22.861229+0000","last_became_peered":"2023-11-15T01:22:22.861229+0000","last_unstale":"2023-11-15T01:22:22.864971+0000","last_undegraded":"2023-11-15T01:22:22.864971+0000","last_fullsized":"2023-11-15T01:22:22.864971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.248367+0000","last_change":"2023-11-15T01:22:23.248367+0000","last_active":"2023-11-15T01:22:23.248367+0000","last_peered":"2023-11-15T01:22:23.248367+0000","last_clean":"2023-11-15T01:22:23.248367+0000","last_became_active":"2023-11-15T01:22:23.247767+0000","last_became_peered":"2023-11-15T01:22:23.247767+0000","last_unstale":"2023-11-15T01:22:23.248367+0000","last_undegraded":"2023-11-15T01:22:23.248367+0000","last_fullsized":"2023-11-15T01:22:23.248367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.860641+0000","last_change":"2023-11-15T01:22:22.858215+0000","last_active":"2023-11-15T01:22:22.860641+0000","last_peered":"2023-11-15T01:22:22.860641+0000","last_clean":"2023-11-15T01:22:22.860641+0000","last_became_active":"2023-11-15T01:22:22.857784+0000","last_became_peered":"2023-11-15T01:22:22.857784+0000","last_unstale":"2023-11-15T01:22:22.860641+0000","last_undegraded":"2023-11-15T01:22:22.860641+0000","last_fullsized":"2023-11-15T01:22:22.860641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252357+0000","last_change":"2023-11-15T01:22:23.252357+0000","last_active":"2023-11-15T01:22:23.252357+0000","last_peered":"2023-11-15T01:22:23.252357+0000","last_clean":"2023-11-15T01:22:23.252357+0000","last_became_active":"2023-11-15T01:22:23.252119+0000","last_became_peered":"2023-11-15T01:22:23.252119+0000","last_unstale":"2023-11-15T01:22:23.252357+0000","last_undegraded":"2023-11-15T01:22:23.252357+0000","last_fullsized":"2023-11-15T01:22:23.252357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.857385+0000","last_change":"2023-11-15T01:22:22.852312+0000","last_active":"2023-11-15T01:22:22.857385+0000","last_peered":"2023-11-15T01:22:22.857385+0000","last_clean":"2023-11-15T01:22:22.857385+0000","last_became_active":"2023-11-15T01:22:22.851932+0000","last_became_peered":"2023-11-15T01:22:22.851932+0000","last_unstale":"2023-11-15T01:22:22.857385+0000","last_undegraded":"2023-11-15T01:22:22.857385+0000","last_fullsized":"2023-11-15T01:22:22.857385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.852235+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:22:22.852235+0000","last_peered":"2023-11-15T01:22:22.852235+0000","last_clean":"2023-11-15T01:22:22.852235+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:22:22.852235+0000","last_undegraded":"2023-11-15T01:22:22.852235+0000","last_fullsized":"2023-11-15T01:22:22.852235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.247647+0000","last_change":"2023-11-15T01:22:23.247647+0000","last_active":"2023-11-15T01:22:23.247647+0000","last_peered":"2023-11-15T01:22:23.247647+0000","last_clean":"2023-11-15T01:22:23.247647+0000","last_became_active":"2023-11-15T01:22:23.247130+0000","last_became_peered":"2023-11-15T01:22:23.247130+0000","last_unstale":"2023-11-15T01:22:23.247647+0000","last_undegraded":"2023-11-15T01:22:23.247647+0000","last_fullsized":"2023-11-15T01:22:23.247647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.857725+0000","last_change":"2023-11-15T01:22:22.854426+0000","last_active":"2023-11-15T01:22:22.857725+0000","last_peered":"2023-11-15T01:22:22.857725+0000","last_clean":"2023-11-15T01:22:22.857725+0000","last_became_active":"2023-11-15T01:22:22.854126+0000","last_became_peered":"2023-11-15T01:22:22.854126+0000","last_unstale":"2023-11-15T01:22:22.857725+0000","last_undegraded":"2023-11-15T01:22:22.857725+0000","last_fullsized":"2023-11-15T01:22:22.857725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.847042+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:22:22.847042+0000","last_peered":"2023-11-15T01:22:22.847042+0000","last_clean":"2023-11-15T01:22:22.847042+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:22:22.847042+0000","last_undegraded":"2023-11-15T01:22:22.847042+0000","last_fullsized":"2023-11-15T01:22:22.847042+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252306+0000","last_change":"2023-11-15T01:22:23.252306+0000","last_active":"2023-11-15T01:22:23.252306+0000","last_peered":"2023-11-15T01:22:23.252306+0000","last_clean":"2023-11-15T01:22:23.252306+0000","last_became_active":"2023-11-15T01:22:23.251745+0000","last_became_peered":"2023-11-15T01:22:23.251745+0000","last_unstale":"2023-11-15T01:22:23.252306+0000","last_undegraded":"2023-11-15T01:22:23.252306+0000","last_fullsized":"2023-11-15T01:22:23.252306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.859777+0000","last_change":"2023-11-15T01:22:22.856524+0000","last_active":"2023-11-15T01:22:22.859777+0000","last_peered":"2023-11-15T01:22:22.859777+0000","last_clean":"2023-11-15T01:22:22.859777+0000","last_became_active":"2023-11-15T01:22:22.856273+0000","last_became_peered":"2023-11-15T01:22:22.856273+0000","last_unstale":"2023-11-15T01:22:22.859777+0000","last_undegraded":"2023-11-15T01:22:22.859777+0000","last_fullsized":"2023-11-15T01:22:22.859777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.839858+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:22:22.839858+0000","last_peered":"2023-11-15T01:22:22.839858+0000","last_clean":"2023-11-15T01:22:22.839858+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:22:22.839858+0000","last_undegraded":"2023-11-15T01:22:22.839858+0000","last_fullsized":"2023-11-15T01:22:22.839858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.255180+0000","last_change":"2023-11-15T01:22:23.255180+0000","last_active":"2023-11-15T01:22:23.255180+0000","last_peered":"2023-11-15T01:22:23.255180+0000","last_clean":"2023-11-15T01:22:23.255180+0000","last_became_active":"2023-11-15T01:22:23.254809+0000","last_became_peered":"2023-11-15T01:22:23.254809+0000","last_unstale":"2023-11-15T01:22:23.255180+0000","last_undegraded":"2023-11-15T01:22:23.255180+0000","last_fullsized":"2023-11-15T01:22:23.255180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864305+0000","last_change":"2023-11-15T01:22:22.860789+0000","last_active":"2023-11-15T01:22:22.864305+0000","last_peered":"2023-11-15T01:22:22.864305+0000","last_clean":"2023-11-15T01:22:22.864305+0000","last_became_active":"2023-11-15T01:22:22.860399+0000","last_became_peered":"2023-11-15T01:22:22.860399+0000","last_unstale":"2023-11-15T01:22:22.864305+0000","last_undegraded":"2023-11-15T01:22:22.864305+0000","last_fullsized":"2023-11-15T01:22:22.864305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.848458+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:22:22.848458+0000","last_peered":"2023-11-15T01:22:22.848458+0000","last_clean":"2023-11-15T01:22:22.848458+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:22:22.848458+0000","last_undegraded":"2023-11-15T01:22:22.848458+0000","last_fullsized":"2023-11-15T01:22:22.848458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.852806+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:22:22.852806+0000","last_peered":"2023-11-15T01:22:22.852806+0000","last_clean":"2023-11-15T01:22:22.852806+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:22:22.852806+0000","last_undegraded":"2023-11-15T01:22:22.852806+0000","last_fullsized":"2023-11-15T01:22:22.852806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.259259+0000","last_change":"2023-11-15T01:22:23.259259+0000","last_active":"2023-11-15T01:22:23.259259+0000","last_peered":"2023-11-15T01:22:23.259259+0000","last_clean":"2023-11-15T01:22:23.259259+0000","last_became_active":"2023-11-15T01:22:23.258815+0000","last_became_peered":"2023-11-15T01:22:23.258815+0000","last_unstale":"2023-11-15T01:22:23.259259+0000","last_undegraded":"2023-11-15T01:22:23.259259+0000","last_fullsized":"2023-11-15T01:22:23.259259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.260826+0000","last_change":"2023-11-15T01:22:22.855525+0000","last_active":"2023-11-15T01:22:23.260826+0000","last_peered":"2023-11-15T01:22:23.260826+0000","last_clean":"2023-11-15T01:22:23.260826+0000","last_became_active":"2023-11-15T01:22:22.855169+0000","last_became_peered":"2023-11-15T01:22:22.855169+0000","last_unstale":"2023-11-15T01:22:23.260826+0000","last_undegraded":"2023-11-15T01:22:23.260826+0000","last_fullsized":"2023-11-15T01:22:23.260826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.853242+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:22:22.853242+0000","last_peered":"2023-11-15T01:22:22.853242+0000","last_clean":"2023-11-15T01:22:22.853242+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:22:22.853242+0000","last_undegraded":"2023-11-15T01:22:22.853242+0000","last_fullsized":"2023-11-15T01:22:22.853242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.248763+0000","last_change":"2023-11-15T01:22:23.248763+0000","last_active":"2023-11-15T01:22:23.248763+0000","last_peered":"2023-11-15T01:22:23.248763+0000","last_clean":"2023-11-15T01:22:23.248763+0000","last_became_active":"2023-11-15T01:22:23.248460+0000","last_became_peered":"2023-11-15T01:22:23.248460+0000","last_unstale":"2023-11-15T01:22:23.248763+0000","last_undegraded":"2023-11-15T01:22:23.248763+0000","last_fullsized":"2023-11-15T01:22:23.248763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.860204+0000","last_change":"2023-11-15T01:22:22.857436+0000","last_active":"2023-11-15T01:22:22.860204+0000","last_peered":"2023-11-15T01:22:22.860204+0000","last_clean":"2023-11-15T01:22:22.860204+0000","last_became_active":"2023-11-15T01:22:22.857169+0000","last_became_peered":"2023-11-15T01:22:22.857169+0000","last_unstale":"2023-11-15T01:22:22.860204+0000","last_undegraded":"2023-11-15T01:22:22.860204+0000","last_fullsized":"2023-11-15T01:22:22.860204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.852932+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:22:22.852932+0000","last_peered":"2023-11-15T01:22:22.852932+0000","last_clean":"2023-11-15T01:22:22.852932+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:22:22.852932+0000","last_undegraded":"2023-11-15T01:22:22.852932+0000","last_fullsized":"2023-11-15T01:22:22.852932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.247488+0000","last_change":"2023-11-15T01:22:23.247488+0000","last_active":"2023-11-15T01:22:23.247488+0000","last_peered":"2023-11-15T01:22:23.247488+0000","last_clean":"2023-11-15T01:22:23.247488+0000","last_became_active":"2023-11-15T01:22:23.247200+0000","last_became_peered":"2023-11-15T01:22:23.247200+0000","last_unstale":"2023-11-15T01:22:23.247488+0000","last_undegraded":"2023-11-15T01:22:23.247488+0000","last_fullsized":"2023-11-15T01:22:23.247488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.862202+0000","last_change":"2023-11-15T01:22:22.856687+0000","last_active":"2023-11-15T01:22:22.862202+0000","last_peered":"2023-11-15T01:22:22.862202+0000","last_clean":"2023-11-15T01:22:22.862202+0000","last_became_active":"2023-11-15T01:22:22.856399+0000","last_became_peered":"2023-11-15T01:22:22.856399+0000","last_unstale":"2023-11-15T01:22:22.862202+0000","last_undegraded":"2023-11-15T01:22:22.862202+0000","last_fullsized":"2023-11-15T01:22:22.862202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.852866+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:22:22.852866+0000","last_peered":"2023-11-15T01:22:22.852866+0000","last_clean":"2023-11-15T01:22:22.852866+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:22:22.852866+0000","last_undegraded":"2023-11-15T01:22:22.852866+0000","last_fullsized":"2023-11-15T01:22:22.852866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.251934+0000","last_change":"2023-11-15T01:22:23.251934+0000","last_active":"2023-11-15T01:22:23.251934+0000","last_peered":"2023-11-15T01:22:23.251934+0000","last_clean":"2023-11-15T01:22:23.251934+0000","last_became_active":"2023-11-15T01:22:23.251661+0000","last_became_peered":"2023-11-15T01:22:23.251661+0000","last_unstale":"2023-11-15T01:22:23.251934+0000","last_undegraded":"2023-11-15T01:22:23.251934+0000","last_fullsized":"2023-11-15T01:22:23.251934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.862185+0000","last_change":"2023-11-15T01:22:22.855742+0000","last_active":"2023-11-15T01:22:22.862185+0000","last_peered":"2023-11-15T01:22:22.862185+0000","last_clean":"2023-11-15T01:22:22.862185+0000","last_became_active":"2023-11-15T01:22:22.855463+0000","last_became_peered":"2023-11-15T01:22:22.855463+0000","last_unstale":"2023-11-15T01:22:22.862185+0000","last_undegraded":"2023-11-15T01:22:22.862185+0000","last_fullsized":"2023-11-15T01:22:22.862185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.844080+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:22:22.844080+0000","last_peered":"2023-11-15T01:22:22.844080+0000","last_clean":"2023-11-15T01:22:22.844080+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:22:22.844080+0000","last_undegraded":"2023-11-15T01:22:22.844080+0000","last_fullsized":"2023-11-15T01:22:22.844080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":152644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":144821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":152160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":376832,"data_stored":152034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":372736,"data_stored":152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":348160,"data_stored":138142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":144821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":153558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:22:27.276 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:22:27.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.423+0000 7f979a5cf700 1 Processor -- start 2023-11-15T01:22:27.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.423+0000 7f979a5cf700 1 -- start start 2023-11-15T01:22:27.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.424+0000 7f979a5cf700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f97940ab1a0 0x7f9794154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.424+0000 7f979a5cf700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97940c06f0 con 0x7f9794154150 2023-11-15T01:22:27.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.424+0000 7f979a5cf700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97940c09d0 con 0x7f97940aa060 2023-11-15T01:22:27.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.424+0000 7f979a5cf700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9794158820 con 0x7f97940ab1a0 2023-11-15T01:22:27.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.424+0000 7f97937fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f97940ab1a0 0x7f9794154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.424+0000 7f97937fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f97940ab1a0 0x7f9794154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44240/0 (socket says 172.21.15.1:44240) 2023-11-15T01:22:27.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.424+0000 7f9793fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9794154150 0x7f9794158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49186/0 (socket says 172.21.15.1:49186) 2023-11-15T01:22:27.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.424+0000 7f97937fe700 1 -- 172.21.15.1:0/2522052162 learned_addr learned my addr 172.21.15.1:0/2522052162 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:27.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.424+0000 7f97937fe700 1 -- 172.21.15.1:0/2522052162 >> v1:172.21.15.141:6789/0 conn(0x7f97940aa060 legacy=0x7f97940c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.424+0000 7f97937fe700 1 -- 172.21.15.1:0/2522052162 >> v1:172.21.15.1:6789/0 conn(0x7f9794154150 legacy=0x7f9794158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.424+0000 7f9792ffd700 1 -- 172.21.15.1:0/2522052162 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209859818 0 0) 0x7f97940c06f0 con 0x7f9794154150 2023-11-15T01:22:27.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.424+0000 7f97937fe700 1 -- 172.21.15.1:0/2522052162 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9794158b00 con 0x7f97940ab1a0 2023-11-15T01:22:27.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.424+0000 7f97937fe700 1 --2- 172.21.15.1:0/2522052162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97940ab1a0 0x7f9794154530 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f9784006fd0 tx=0x7f97840090f0).ready entity=mon.0 client_cookie=88a9440c1ec22731 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:27.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.424+0000 7f9792ffd700 1 -- 172.21.15.1:0/2522052162 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978400b600 con 0x7f97940ab1a0 2023-11-15T01:22:27.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.425+0000 7f9792ffd700 1 -- 172.21.15.1:0/2522052162 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978400b760 con 0x7f97940ab1a0 2023-11-15T01:22:27.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.425+0000 7f9792ffd700 1 -- 172.21.15.1:0/2522052162 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978400bb00 con 0x7f97940ab1a0 2023-11-15T01:22:27.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.425+0000 7f979a5cf700 1 -- 172.21.15.1:0/2522052162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97940ab1a0 msgr2=0x7f9794154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.425+0000 7f979a5cf700 1 --2- 172.21.15.1:0/2522052162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97940ab1a0 0x7f9794154530 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f9784006fd0 tx=0x7f97840090f0).stop 2023-11-15T01:22:27.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.425+0000 7f979a5cf700 1 -- 172.21.15.1:0/2522052162 shutdown_connections 2023-11-15T01:22:27.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.425+0000 7f979a5cf700 1 --2- 172.21.15.1:0/2522052162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97940ab1a0 0x7f9794154530 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.425+0000 7f979a5cf700 1 -- 172.21.15.1:0/2522052162 >> 172.21.15.1:0/2522052162 conn(0x7f9794064aa0 msgr2=0x7f9794064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:27.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.425+0000 7f979a5cf700 1 -- 172.21.15.1:0/2522052162 shutdown_connections 2023-11-15T01:22:27.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.425+0000 7f979a5cf700 1 -- 172.21.15.1:0/2522052162 wait complete. 2023-11-15T01:22:27.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.426+0000 7f979a5cf700 1 Processor -- start 2023-11-15T01:22:27.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.426+0000 7f979a5cf700 1 -- start start 2023-11-15T01:22:27.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.427+0000 7f979a5cf700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97940aa060 0x7f9794144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.427+0000 7f979a5cf700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97940ab1a0 0x7f97940c3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.427+0000 7f979a5cf700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9794154150 0x7f9794156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.427+0000 7f979a5cf700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9794145130 con 0x7f97940aa060 2023-11-15T01:22:27.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.427+0000 7f979a5cf700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97940c3bf0 con 0x7f97940ab1a0 2023-11-15T01:22:27.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.427+0000 7f979a5cf700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97940c3ed0 con 0x7f9794154150 2023-11-15T01:22:27.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.427+0000 7f9793fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97940aa060 0x7f9794144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.427+0000 7f9793fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97940aa060 0x7f9794144c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44242/0 (socket says 172.21.15.1:44242) 2023-11-15T01:22:27.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.427+0000 7f9793fff700 1 -- 172.21.15.1:0/4042027286 learned_addr learned my addr 172.21.15.1:0/4042027286 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:27.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.428+0000 7f9793fff700 1 -- 172.21.15.1:0/4042027286 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9794154150 msgr2=0x7f9794156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.428+0000 7f9793fff700 1 --2- 172.21.15.1:0/4042027286 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9794154150 0x7f9794156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:27.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.428+0000 7f97937fe700 1 --2- 172.21.15.1:0/4042027286 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97940ab1a0 0x7f97940c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.428+0000 7f9793fff700 1 -- 172.21.15.1:0/4042027286 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97940ab1a0 msgr2=0x7f97940c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.428+0000 7f9793fff700 1 --2- 172.21.15.1:0/4042027286 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97940ab1a0 0x7f97940c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.428+0000 7f9793fff700 1 -- 172.21.15.1:0/4042027286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9784009370 con 0x7f97940aa060 2023-11-15T01:22:27.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.428+0000 7f97937fe700 1 --2- 172.21.15.1:0/4042027286 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97940ab1a0 0x7f97940c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:27.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.428+0000 7f9793fff700 1 --2- 172.21.15.1:0/4042027286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97940aa060 0x7f9794144c40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f978800c490 tx=0x7f9788007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:27.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.428+0000 7f977bfff700 1 -- 172.21.15.1:0/4042027286 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880072e0 con 0x7f97940aa060 2023-11-15T01:22:27.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.428+0000 7f977bfff700 1 -- 172.21.15.1:0/4042027286 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9788007440 con 0x7f97940aa060 2023-11-15T01:22:27.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.428+0000 7f979a5cf700 1 -- 172.21.15.1:0/4042027286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97940c41b0 con 0x7f97940aa060 2023-11-15T01:22:27.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.428+0000 7f977bfff700 1 -- 172.21.15.1:0/4042027286 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788005930 con 0x7f97940aa060 2023-11-15T01:22:27.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.428+0000 7f979a5cf700 1 -- 172.21.15.1:0/4042027286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97940c4770 con 0x7f97940aa060 2023-11-15T01:22:27.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.429+0000 7f979a5cf700 1 -- 172.21.15.1:0/4042027286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97940c4990 con 0x7f97940aa060 2023-11-15T01:22:27.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.429+0000 7f977bfff700 1 -- 172.21.15.1:0/4042027286 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9788005d20 con 0x7f97940aa060 2023-11-15T01:22:27.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.430+0000 7f977bfff700 1 --2- 172.21.15.1:0/4042027286 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f978005f120 0x7f97800615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.430+0000 7f977bfff700 1 -- 172.21.15.1:0/4042027286 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9788079a70 con 0x7f97940aa060 2023-11-15T01:22:27.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.430+0000 7f97937fe700 1 --2- 172.21.15.1:0/4042027286 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f978005f120 0x7f97800615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.430+0000 7f97937fe700 1 --2- 172.21.15.1:0/4042027286 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f978005f120 0x7f97800615e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f9784006cc0 tx=0x7f9784017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:27.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.434+0000 7f977bfff700 1 -- 172.21.15.1:0/4042027286 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f978804ad40 con 0x7f97940aa060 2023-11-15T01:22:27.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.605+0000 7f979a5cf700 1 -- 172.21.15.1:0/4042027286 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9794158de0 con 0x7f978005f120 2023-11-15T01:22:27.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.615+0000 7f977bfff700 1 -- 172.21.15.1:0/4042027286 <== mgr.4103 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336425 (secure 0 0 0) 0x7f9794158de0 con 0x7f978005f120 2023-11-15T01:22:27.620 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:27.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.618+0000 7f979a5cf700 1 -- 172.21.15.1:0/4042027286 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f978005f120 msgr2=0x7f97800615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.618+0000 7f979a5cf700 1 --2- 172.21.15.1:0/4042027286 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f978005f120 0x7f97800615e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f9784006cc0 tx=0x7f9784017000).stop 2023-11-15T01:22:27.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.618+0000 7f979a5cf700 1 -- 172.21.15.1:0/4042027286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97940aa060 msgr2=0x7f9794144c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.618+0000 7f979a5cf700 1 --2- 172.21.15.1:0/4042027286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97940aa060 0x7f9794144c40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f978800c490 tx=0x7f9788007de0).stop 2023-11-15T01:22:27.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.618+0000 7f979a5cf700 1 -- 172.21.15.1:0/4042027286 shutdown_connections 2023-11-15T01:22:27.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.618+0000 7f979a5cf700 1 --2- 172.21.15.1:0/4042027286 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f978005f120 0x7f97800615e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.618+0000 7f979a5cf700 1 --2- 172.21.15.1:0/4042027286 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9794154150 0x7f9794156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:27.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.618+0000 7f979a5cf700 1 --2- 172.21.15.1:0/4042027286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97940aa060 0x7f9794144c40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.618+0000 7f979a5cf700 1 --2- 172.21.15.1:0/4042027286 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97940ab1a0 0x7f97940c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.618+0000 7f979a5cf700 1 -- 172.21.15.1:0/4042027286 >> 172.21.15.1:0/4042027286 conn(0x7f9794064aa0 msgr2=0x7f9794063fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:27.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.618+0000 7f979a5cf700 1 -- 172.21.15.1:0/4042027286 shutdown_connections 2023-11-15T01:22:27.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.618+0000 7f979a5cf700 1 -- 172.21.15.1:0/4042027286 wait complete. 2023-11-15T01:22:27.625 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:22:27.631 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-11-15T01:22:25.770014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379668,"kb_used_data":2900,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595052,"statfs":{"total":773094113280,"available":770657333248,"internally_reserved":0,"allocated":2969600,"data_stored":1190180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4305,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.586238"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.249131+0000","last_change":"2023-11-15T01:22:23.249131+0000","last_active":"2023-11-15T01:22:23.249131+0000","last_peered":"2023-11-15T01:22:23.249131+0000","last_clean":"2023-11-15T01:22:23.249131+0000","last_became_active":"2023-11-15T01:22:23.248749+0000","last_became_peered":"2023-11-15T01:22:23.248749+0000","last_unstale":"2023-11-15T01:22:23.249131+0000","last_undegraded":"2023-11-15T01:22:23.249131+0000","last_fullsized":"2023-11-15T01:22:23.249131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.260560+0000","last_change":"2023-11-15T01:22:22.855504+0000","last_active":"2023-11-15T01:22:23.260560+0000","last_peered":"2023-11-15T01:22:23.260560+0000","last_clean":"2023-11-15T01:22:23.260560+0000","last_became_active":"2023-11-15T01:22:22.855237+0000","last_became_peered":"2023-11-15T01:22:22.855237+0000","last_unstale":"2023-11-15T01:22:23.260560+0000","last_undegraded":"2023-11-15T01:22:23.260560+0000","last_fullsized":"2023-11-15T01:22:23.260560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.249909+0000","last_change":"2023-11-15T01:22:23.249909+0000","last_active":"2023-11-15T01:22:23.249909+0000","last_peered":"2023-11-15T01:22:23.249909+0000","last_clean":"2023-11-15T01:22:23.249909+0000","last_became_active":"2023-11-15T01:22:23.249658+0000","last_became_peered":"2023-11-15T01:22:23.249658+0000","last_unstale":"2023-11-15T01:22:23.249909+0000","last_undegraded":"2023-11-15T01:22:23.249909+0000","last_fullsized":"2023-11-15T01:22:23.249909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.861893+0000","last_change":"2023-11-15T01:22:22.855496+0000","last_active":"2023-11-15T01:22:22.861893+0000","last_peered":"2023-11-15T01:22:22.861893+0000","last_clean":"2023-11-15T01:22:22.861893+0000","last_became_active":"2023-11-15T01:22:22.855201+0000","last_became_peered":"2023-11-15T01:22:22.855201+0000","last_unstale":"2023-11-15T01:22:22.861893+0000","last_undegraded":"2023-11-15T01:22:22.861893+0000","last_fullsized":"2023-11-15T01:22:22.861893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.247429+0000","last_change":"2023-11-15T01:22:23.247429+0000","last_active":"2023-11-15T01:22:23.247429+0000","last_peered":"2023-11-15T01:22:23.247429+0000","last_clean":"2023-11-15T01:22:23.247429+0000","last_became_active":"2023-11-15T01:22:23.246708+0000","last_became_peered":"2023-11-15T01:22:23.246708+0000","last_unstale":"2023-11-15T01:22:23.247429+0000","last_undegraded":"2023-11-15T01:22:23.247429+0000","last_fullsized":"2023-11-15T01:22:23.247429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.859730+0000","last_change":"2023-11-15T01:22:22.856919+0000","last_active":"2023-11-15T01:22:22.859730+0000","last_peered":"2023-11-15T01:22:22.859730+0000","last_clean":"2023-11-15T01:22:22.859730+0000","last_became_active":"2023-11-15T01:22:22.856116+0000","last_became_peered":"2023-11-15T01:22:22.856116+0000","last_unstale":"2023-11-15T01:22:22.859730+0000","last_undegraded":"2023-11-15T01:22:22.859730+0000","last_fullsized":"2023-11-15T01:22:22.859730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.246191+0000","last_change":"2023-11-15T01:22:23.246191+0000","last_active":"2023-11-15T01:22:23.246191+0000","last_peered":"2023-11-15T01:22:23.246191+0000","last_clean":"2023-11-15T01:22:23.246191+0000","last_became_active":"2023-11-15T01:22:23.245910+0000","last_became_peered":"2023-11-15T01:22:23.245910+0000","last_unstale":"2023-11-15T01:22:23.246191+0000","last_undegraded":"2023-11-15T01:22:23.246191+0000","last_fullsized":"2023-11-15T01:22:23.246191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.254430+0000","last_change":"2023-11-15T01:22:22.863799+0000","last_active":"2023-11-15T01:22:23.254430+0000","last_peered":"2023-11-15T01:22:23.254430+0000","last_clean":"2023-11-15T01:22:23.254430+0000","last_became_active":"2023-11-15T01:22:22.863304+0000","last_became_peered":"2023-11-15T01:22:22.863304+0000","last_unstale":"2023-11-15T01:22:23.254430+0000","last_undegraded":"2023-11-15T01:22:23.254430+0000","last_fullsized":"2023-11-15T01:22:23.254430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.259140+0000","last_change":"2023-11-15T01:22:23.259140+0000","last_active":"2023-11-15T01:22:23.259140+0000","last_peered":"2023-11-15T01:22:23.259140+0000","last_clean":"2023-11-15T01:22:23.259140+0000","last_became_active":"2023-11-15T01:22:23.258882+0000","last_became_peered":"2023-11-15T01:22:23.258882+0000","last_unstale":"2023-11-15T01:22:23.259140+0000","last_undegraded":"2023-11-15T01:22:23.259140+0000","last_fullsized":"2023-11-15T01:22:23.259140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.237361+0000","last_change":"2023-11-15T01:22:22.859168+0000","last_active":"2023-11-15T01:22:23.237361+0000","last_peered":"2023-11-15T01:22:23.237361+0000","last_clean":"2023-11-15T01:22:23.237361+0000","last_became_active":"2023-11-15T01:22:22.853049+0000","last_became_peered":"2023-11-15T01:22:22.853049+0000","last_unstale":"2023-11-15T01:22:23.237361+0000","last_undegraded":"2023-11-15T01:22:23.237361+0000","last_fullsized":"2023-11-15T01:22:23.237361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250699+0000","last_change":"2023-11-15T01:22:23.250699+0000","last_active":"2023-11-15T01:22:23.250699+0000","last_peered":"2023-11-15T01:22:23.250699+0000","last_clean":"2023-11-15T01:22:23.250699+0000","last_became_active":"2023-11-15T01:22:23.250407+0000","last_became_peered":"2023-11-15T01:22:23.250407+0000","last_unstale":"2023-11-15T01:22:23.250699+0000","last_undegraded":"2023-11-15T01:22:23.250699+0000","last_fullsized":"2023-11-15T01:22:23.250699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.244505+0000","last_change":"2023-11-15T01:22:22.849529+0000","last_active":"2023-11-15T01:22:23.244505+0000","last_peered":"2023-11-15T01:22:23.244505+0000","last_clean":"2023-11-15T01:22:23.244505+0000","last_became_active":"2023-11-15T01:22:22.849183+0000","last_became_peered":"2023-11-15T01:22:22.849183+0000","last_unstale":"2023-11-15T01:22:23.244505+0000","last_undegraded":"2023-11-15T01:22:23.244505+0000","last_fullsized":"2023-11-15T01:22:23.244505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252015+0000","last_change":"2023-11-15T01:22:23.252015+0000","last_active":"2023-11-15T01:22:23.252015+0000","last_peered":"2023-11-15T01:22:23.252015+0000","last_clean":"2023-11-15T01:22:23.252015+0000","last_became_active":"2023-11-15T01:22:23.251749+0000","last_became_peered":"2023-11-15T01:22:23.251749+0000","last_unstale":"2023-11-15T01:22:23.252015+0000","last_undegraded":"2023-11-15T01:22:23.252015+0000","last_fullsized":"2023-11-15T01:22:23.252015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864945+0000","last_change":"2023-11-15T01:22:22.861481+0000","last_active":"2023-11-15T01:22:22.864945+0000","last_peered":"2023-11-15T01:22:22.864945+0000","last_clean":"2023-11-15T01:22:22.864945+0000","last_became_active":"2023-11-15T01:22:22.861201+0000","last_became_peered":"2023-11-15T01:22:22.861201+0000","last_unstale":"2023-11-15T01:22:22.864945+0000","last_undegraded":"2023-11-15T01:22:22.864945+0000","last_fullsized":"2023-11-15T01:22:22.864945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.251282+0000","last_change":"2023-11-15T01:22:23.251282+0000","last_active":"2023-11-15T01:22:23.251282+0000","last_peered":"2023-11-15T01:22:23.251282+0000","last_clean":"2023-11-15T01:22:23.251282+0000","last_became_active":"2023-11-15T01:22:23.249864+0000","last_became_peered":"2023-11-15T01:22:23.249864+0000","last_unstale":"2023-11-15T01:22:23.251282+0000","last_undegraded":"2023-11-15T01:22:23.251282+0000","last_fullsized":"2023-11-15T01:22:23.251282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.867862+0000","last_change":"2023-11-15T01:22:22.864952+0000","last_active":"2023-11-15T01:22:22.867862+0000","last_peered":"2023-11-15T01:22:22.867862+0000","last_clean":"2023-11-15T01:22:22.867862+0000","last_became_active":"2023-11-15T01:22:22.864376+0000","last_became_peered":"2023-11-15T01:22:22.864376+0000","last_unstale":"2023-11-15T01:22:22.867862+0000","last_undegraded":"2023-11-15T01:22:22.867862+0000","last_fullsized":"2023-11-15T01:22:22.867862+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250652+0000","last_change":"2023-11-15T01:22:23.250652+0000","last_active":"2023-11-15T01:22:23.250652+0000","last_peered":"2023-11-15T01:22:23.250652+0000","last_clean":"2023-11-15T01:22:23.250652+0000","last_became_active":"2023-11-15T01:22:23.250373+0000","last_became_peered":"2023-11-15T01:22:23.250373+0000","last_unstale":"2023-11-15T01:22:23.250652+0000","last_undegraded":"2023-11-15T01:22:23.250652+0000","last_fullsized":"2023-11-15T01:22:23.250652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.861803+0000","last_change":"2023-11-15T01:22:22.854212+0000","last_active":"2023-11-15T01:22:22.861803+0000","last_peered":"2023-11-15T01:22:22.861803+0000","last_clean":"2023-11-15T01:22:22.861803+0000","last_became_active":"2023-11-15T01:22:22.853967+0000","last_became_peered":"2023-11-15T01:22:22.853967+0000","last_unstale":"2023-11-15T01:22:22.861803+0000","last_undegraded":"2023-11-15T01:22:22.861803+0000","last_fullsized":"2023-11-15T01:22:22.861803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.246858+0000","last_change":"2023-11-15T01:22:23.246858+0000","last_active":"2023-11-15T01:22:23.246858+0000","last_peered":"2023-11-15T01:22:23.246858+0000","last_clean":"2023-11-15T01:22:23.246858+0000","last_became_active":"2023-11-15T01:22:23.246499+0000","last_became_peered":"2023-11-15T01:22:23.246499+0000","last_unstale":"2023-11-15T01:22:23.246858+0000","last_undegraded":"2023-11-15T01:22:23.246858+0000","last_fullsized":"2023-11-15T01:22:23.246858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864985+0000","last_change":"2023-11-15T01:22:22.862638+0000","last_active":"2023-11-15T01:22:22.864985+0000","last_peered":"2023-11-15T01:22:22.864985+0000","last_clean":"2023-11-15T01:22:22.864985+0000","last_became_active":"2023-11-15T01:22:22.862303+0000","last_became_peered":"2023-11-15T01:22:22.862303+0000","last_unstale":"2023-11-15T01:22:22.864985+0000","last_undegraded":"2023-11-15T01:22:22.864985+0000","last_fullsized":"2023-11-15T01:22:22.864985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.257314+0000","last_change":"2023-11-15T01:22:23.257314+0000","last_active":"2023-11-15T01:22:23.257314+0000","last_peered":"2023-11-15T01:22:23.257314+0000","last_clean":"2023-11-15T01:22:23.257314+0000","last_became_active":"2023-11-15T01:22:23.256853+0000","last_became_peered":"2023-11-15T01:22:23.256853+0000","last_unstale":"2023-11-15T01:22:23.257314+0000","last_undegraded":"2023-11-15T01:22:23.257314+0000","last_fullsized":"2023-11-15T01:22:23.257314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864988+0000","last_change":"2023-11-15T01:22:22.863062+0000","last_active":"2023-11-15T01:22:22.864988+0000","last_peered":"2023-11-15T01:22:22.864988+0000","last_clean":"2023-11-15T01:22:22.864988+0000","last_became_active":"2023-11-15T01:22:22.862772+0000","last_became_peered":"2023-11-15T01:22:22.862772+0000","last_unstale":"2023-11-15T01:22:22.864988+0000","last_undegraded":"2023-11-15T01:22:22.864988+0000","last_fullsized":"2023-11-15T01:22:22.864988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.258016+0000","last_change":"2023-11-15T01:22:23.258016+0000","last_active":"2023-11-15T01:22:23.258016+0000","last_peered":"2023-11-15T01:22:23.258016+0000","last_clean":"2023-11-15T01:22:23.258016+0000","last_became_active":"2023-11-15T01:22:23.257706+0000","last_became_peered":"2023-11-15T01:22:23.257706+0000","last_unstale":"2023-11-15T01:22:23.258016+0000","last_undegraded":"2023-11-15T01:22:23.258016+0000","last_fullsized":"2023-11-15T01:22:23.258016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.260792+0000","last_change":"2023-11-15T01:22:22.856610+0000","last_active":"2023-11-15T01:22:23.260792+0000","last_peered":"2023-11-15T01:22:23.260792+0000","last_clean":"2023-11-15T01:22:23.260792+0000","last_became_active":"2023-11-15T01:22:22.856319+0000","last_became_peered":"2023-11-15T01:22:22.856319+0000","last_unstale":"2023-11-15T01:22:23.260792+0000","last_undegraded":"2023-11-15T01:22:23.260792+0000","last_fullsized":"2023-11-15T01:22:23.260792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.258494+0000","last_change":"2023-11-15T01:22:23.258494+0000","last_active":"2023-11-15T01:22:23.258494+0000","last_peered":"2023-11-15T01:22:23.258494+0000","last_clean":"2023-11-15T01:22:23.258494+0000","last_became_active":"2023-11-15T01:22:23.258149+0000","last_became_peered":"2023-11-15T01:22:23.258149+0000","last_unstale":"2023-11-15T01:22:23.258494+0000","last_undegraded":"2023-11-15T01:22:23.258494+0000","last_fullsized":"2023-11-15T01:22:23.258494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.237482+0000","last_change":"2023-11-15T01:22:22.858945+0000","last_active":"2023-11-15T01:22:23.237482+0000","last_peered":"2023-11-15T01:22:23.237482+0000","last_clean":"2023-11-15T01:22:23.237482+0000","last_became_active":"2023-11-15T01:22:22.852883+0000","last_became_peered":"2023-11-15T01:22:22.852883+0000","last_unstale":"2023-11-15T01:22:23.237482+0000","last_undegraded":"2023-11-15T01:22:23.237482+0000","last_fullsized":"2023-11-15T01:22:23.237482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252243+0000","last_change":"2023-11-15T01:22:23.252243+0000","last_active":"2023-11-15T01:22:23.252243+0000","last_peered":"2023-11-15T01:22:23.252243+0000","last_clean":"2023-11-15T01:22:23.252243+0000","last_became_active":"2023-11-15T01:22:23.251916+0000","last_became_peered":"2023-11-15T01:22:23.251916+0000","last_unstale":"2023-11-15T01:22:23.252243+0000","last_undegraded":"2023-11-15T01:22:23.252243+0000","last_fullsized":"2023-11-15T01:22:23.252243+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.857864+0000","last_change":"2023-11-15T01:22:22.850227+0000","last_active":"2023-11-15T01:22:22.857864+0000","last_peered":"2023-11-15T01:22:22.857864+0000","last_clean":"2023-11-15T01:22:22.857864+0000","last_became_active":"2023-11-15T01:22:22.849865+0000","last_became_peered":"2023-11-15T01:22:22.849865+0000","last_unstale":"2023-11-15T01:22:22.857864+0000","last_undegraded":"2023-11-15T01:22:22.857864+0000","last_fullsized":"2023-11-15T01:22:22.857864+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.249650+0000","last_change":"2023-11-15T01:22:23.249650+0000","last_active":"2023-11-15T01:22:23.249650+0000","last_peered":"2023-11-15T01:22:23.249650+0000","last_clean":"2023-11-15T01:22:23.249650+0000","last_became_active":"2023-11-15T01:22:23.249048+0000","last_became_peered":"2023-11-15T01:22:23.249048+0000","last_unstale":"2023-11-15T01:22:23.249650+0000","last_undegraded":"2023-11-15T01:22:23.249650+0000","last_fullsized":"2023-11-15T01:22:23.249650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.857355+0000","last_change":"2023-11-15T01:22:22.850775+0000","last_active":"2023-11-15T01:22:22.857355+0000","last_peered":"2023-11-15T01:22:22.857355+0000","last_clean":"2023-11-15T01:22:22.857355+0000","last_became_active":"2023-11-15T01:22:22.850477+0000","last_became_peered":"2023-11-15T01:22:22.850477+0000","last_unstale":"2023-11-15T01:22:22.857355+0000","last_undegraded":"2023-11-15T01:22:22.857355+0000","last_fullsized":"2023-11-15T01:22:22.857355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.256643+0000","last_change":"2023-11-15T01:22:23.256643+0000","last_active":"2023-11-15T01:22:23.256643+0000","last_peered":"2023-11-15T01:22:23.256643+0000","last_clean":"2023-11-15T01:22:23.256643+0000","last_became_active":"2023-11-15T01:22:23.254895+0000","last_became_peered":"2023-11-15T01:22:23.254895+0000","last_unstale":"2023-11-15T01:22:23.256643+0000","last_undegraded":"2023-11-15T01:22:23.256643+0000","last_fullsized":"2023-11-15T01:22:23.256643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.259035+0000","last_change":"2023-11-15T01:22:22.864812+0000","last_active":"2023-11-15T01:22:23.259035+0000","last_peered":"2023-11-15T01:22:23.259035+0000","last_clean":"2023-11-15T01:22:23.259035+0000","last_became_active":"2023-11-15T01:22:22.864086+0000","last_became_peered":"2023-11-15T01:22:22.864086+0000","last_unstale":"2023-11-15T01:22:23.259035+0000","last_undegraded":"2023-11-15T01:22:23.259035+0000","last_fullsized":"2023-11-15T01:22:23.259035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.240728+0000","last_change":"2023-11-15T01:22:23.240728+0000","last_active":"2023-11-15T01:22:23.240728+0000","last_peered":"2023-11-15T01:22:23.240728+0000","last_clean":"2023-11-15T01:22:23.240728+0000","last_became_active":"2023-11-15T01:22:23.240450+0000","last_became_peered":"2023-11-15T01:22:23.240450+0000","last_unstale":"2023-11-15T01:22:23.240728+0000","last_undegraded":"2023-11-15T01:22:23.240728+0000","last_fullsized":"2023-11-15T01:22:23.240728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864270+0000","last_change":"2023-11-15T01:22:22.859015+0000","last_active":"2023-11-15T01:22:22.864270+0000","last_peered":"2023-11-15T01:22:22.864270+0000","last_clean":"2023-11-15T01:22:22.864270+0000","last_became_active":"2023-11-15T01:22:22.858667+0000","last_became_peered":"2023-11-15T01:22:22.858667+0000","last_unstale":"2023-11-15T01:22:22.864270+0000","last_undegraded":"2023-11-15T01:22:22.864270+0000","last_fullsized":"2023-11-15T01:22:22.864270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.255885+0000","last_change":"2023-11-15T01:22:23.255885+0000","last_active":"2023-11-15T01:22:23.255885+0000","last_peered":"2023-11-15T01:22:23.255885+0000","last_clean":"2023-11-15T01:22:23.255885+0000","last_became_active":"2023-11-15T01:22:23.255686+0000","last_became_peered":"2023-11-15T01:22:23.255686+0000","last_unstale":"2023-11-15T01:22:23.255885+0000","last_undegraded":"2023-11-15T01:22:23.255885+0000","last_fullsized":"2023-11-15T01:22:23.255885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.861868+0000","last_change":"2023-11-15T01:22:22.854587+0000","last_active":"2023-11-15T01:22:22.861868+0000","last_peered":"2023-11-15T01:22:22.861868+0000","last_clean":"2023-11-15T01:22:22.861868+0000","last_became_active":"2023-11-15T01:22:22.852487+0000","last_became_peered":"2023-11-15T01:22:22.852487+0000","last_unstale":"2023-11-15T01:22:22.861868+0000","last_undegraded":"2023-11-15T01:22:22.861868+0000","last_fullsized":"2023-11-15T01:22:22.861868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.245429+0000","last_change":"2023-11-15T01:22:23.245429+0000","last_active":"2023-11-15T01:22:23.245429+0000","last_peered":"2023-11-15T01:22:23.245429+0000","last_clean":"2023-11-15T01:22:23.245429+0000","last_became_active":"2023-11-15T01:22:23.245126+0000","last_became_peered":"2023-11-15T01:22:23.245126+0000","last_unstale":"2023-11-15T01:22:23.245429+0000","last_undegraded":"2023-11-15T01:22:23.245429+0000","last_fullsized":"2023-11-15T01:22:23.245429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.244614+0000","last_change":"2023-11-15T01:22:22.856575+0000","last_active":"2023-11-15T01:22:23.244614+0000","last_peered":"2023-11-15T01:22:23.244614+0000","last_clean":"2023-11-15T01:22:23.244614+0000","last_became_active":"2023-11-15T01:22:22.856252+0000","last_became_peered":"2023-11-15T01:22:22.856252+0000","last_unstale":"2023-11-15T01:22:23.244614+0000","last_undegraded":"2023-11-15T01:22:23.244614+0000","last_fullsized":"2023-11-15T01:22:23.244614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.260138+0000","last_change":"2023-11-15T01:22:23.260138+0000","last_active":"2023-11-15T01:22:23.260138+0000","last_peered":"2023-11-15T01:22:23.260138+0000","last_clean":"2023-11-15T01:22:23.260138+0000","last_became_active":"2023-11-15T01:22:23.259879+0000","last_became_peered":"2023-11-15T01:22:23.259879+0000","last_unstale":"2023-11-15T01:22:23.260138+0000","last_undegraded":"2023-11-15T01:22:23.260138+0000","last_fullsized":"2023-11-15T01:22:23.260138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.859806+0000","last_change":"2023-11-15T01:22:22.857204+0000","last_active":"2023-11-15T01:22:22.859806+0000","last_peered":"2023-11-15T01:22:22.859806+0000","last_clean":"2023-11-15T01:22:22.859806+0000","last_became_active":"2023-11-15T01:22:22.856918+0000","last_became_peered":"2023-11-15T01:22:22.856918+0000","last_unstale":"2023-11-15T01:22:22.859806+0000","last_undegraded":"2023-11-15T01:22:22.859806+0000","last_fullsized":"2023-11-15T01:22:22.859806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.255451+0000","last_change":"2023-11-15T01:22:23.255451+0000","last_active":"2023-11-15T01:22:23.255451+0000","last_peered":"2023-11-15T01:22:23.255451+0000","last_clean":"2023-11-15T01:22:23.255451+0000","last_became_active":"2023-11-15T01:22:23.255180+0000","last_became_peered":"2023-11-15T01:22:23.255180+0000","last_unstale":"2023-11-15T01:22:23.255451+0000","last_undegraded":"2023-11-15T01:22:23.255451+0000","last_fullsized":"2023-11-15T01:22:23.255451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.234387+0000","last_change":"2023-11-15T01:22:22.856122+0000","last_active":"2023-11-15T01:22:23.234387+0000","last_peered":"2023-11-15T01:22:23.234387+0000","last_clean":"2023-11-15T01:22:23.234387+0000","last_became_active":"2023-11-15T01:22:22.855817+0000","last_became_peered":"2023-11-15T01:22:22.855817+0000","last_unstale":"2023-11-15T01:22:23.234387+0000","last_undegraded":"2023-11-15T01:22:23.234387+0000","last_fullsized":"2023-11-15T01:22:23.234387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.256880+0000","last_change":"2023-11-15T01:22:23.256880+0000","last_active":"2023-11-15T01:22:23.256880+0000","last_peered":"2023-11-15T01:22:23.256880+0000","last_clean":"2023-11-15T01:22:23.256880+0000","last_became_active":"2023-11-15T01:22:23.256610+0000","last_became_peered":"2023-11-15T01:22:23.256610+0000","last_unstale":"2023-11-15T01:22:23.256880+0000","last_undegraded":"2023-11-15T01:22:23.256880+0000","last_fullsized":"2023-11-15T01:22:23.256880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864871+0000","last_change":"2023-11-15T01:22:22.860644+0000","last_active":"2023-11-15T01:22:22.864871+0000","last_peered":"2023-11-15T01:22:22.864871+0000","last_clean":"2023-11-15T01:22:22.864871+0000","last_became_active":"2023-11-15T01:22:22.860380+0000","last_became_peered":"2023-11-15T01:22:22.860380+0000","last_unstale":"2023-11-15T01:22:22.864871+0000","last_undegraded":"2023-11-15T01:22:22.864871+0000","last_fullsized":"2023-11-15T01:22:22.864871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252708+0000","last_change":"2023-11-15T01:22:23.252708+0000","last_active":"2023-11-15T01:22:23.252708+0000","last_peered":"2023-11-15T01:22:23.252708+0000","last_clean":"2023-11-15T01:22:23.252708+0000","last_became_active":"2023-11-15T01:22:23.252028+0000","last_became_peered":"2023-11-15T01:22:23.252028+0000","last_unstale":"2023-11-15T01:22:23.252708+0000","last_undegraded":"2023-11-15T01:22:23.252708+0000","last_fullsized":"2023-11-15T01:22:23.252708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.866459+0000","last_change":"2023-11-15T01:22:22.861716+0000","last_active":"2023-11-15T01:22:22.866459+0000","last_peered":"2023-11-15T01:22:22.866459+0000","last_clean":"2023-11-15T01:22:22.866459+0000","last_became_active":"2023-11-15T01:22:22.861411+0000","last_became_peered":"2023-11-15T01:22:22.861411+0000","last_unstale":"2023-11-15T01:22:22.866459+0000","last_undegraded":"2023-11-15T01:22:22.866459+0000","last_fullsized":"2023-11-15T01:22:22.866459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.256837+0000","last_change":"2023-11-15T01:22:23.256837+0000","last_active":"2023-11-15T01:22:23.256837+0000","last_peered":"2023-11-15T01:22:23.256837+0000","last_clean":"2023-11-15T01:22:23.256837+0000","last_became_active":"2023-11-15T01:22:23.255297+0000","last_became_peered":"2023-11-15T01:22:23.255297+0000","last_unstale":"2023-11-15T01:22:23.256837+0000","last_undegraded":"2023-11-15T01:22:23.256837+0000","last_fullsized":"2023-11-15T01:22:23.256837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.857431+0000","last_change":"2023-11-15T01:22:22.850408+0000","last_active":"2023-11-15T01:22:22.857431+0000","last_peered":"2023-11-15T01:22:22.857431+0000","last_clean":"2023-11-15T01:22:22.857431+0000","last_became_active":"2023-11-15T01:22:22.850145+0000","last_became_peered":"2023-11-15T01:22:22.850145+0000","last_unstale":"2023-11-15T01:22:22.857431+0000","last_undegraded":"2023-11-15T01:22:22.857431+0000","last_fullsized":"2023-11-15T01:22:22.857431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250645+0000","last_change":"2023-11-15T01:22:23.250645+0000","last_active":"2023-11-15T01:22:23.250645+0000","last_peered":"2023-11-15T01:22:23.250645+0000","last_clean":"2023-11-15T01:22:23.250645+0000","last_became_active":"2023-11-15T01:22:23.250352+0000","last_became_peered":"2023-11-15T01:22:23.250352+0000","last_unstale":"2023-11-15T01:22:23.250645+0000","last_undegraded":"2023-11-15T01:22:23.250645+0000","last_fullsized":"2023-11-15T01:22:23.250645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864564+0000","last_change":"2023-11-15T01:22:22.861001+0000","last_active":"2023-11-15T01:22:22.864564+0000","last_peered":"2023-11-15T01:22:22.864564+0000","last_clean":"2023-11-15T01:22:22.864564+0000","last_became_active":"2023-11-15T01:22:22.860334+0000","last_became_peered":"2023-11-15T01:22:22.860334+0000","last_unstale":"2023-11-15T01:22:22.864564+0000","last_undegraded":"2023-11-15T01:22:22.864564+0000","last_fullsized":"2023-11-15T01:22:22.864564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250310+0000","last_change":"2023-11-15T01:22:23.250310+0000","last_active":"2023-11-15T01:22:23.250310+0000","last_peered":"2023-11-15T01:22:23.250310+0000","last_clean":"2023-11-15T01:22:23.250310+0000","last_became_active":"2023-11-15T01:22:23.250050+0000","last_became_peered":"2023-11-15T01:22:23.250050+0000","last_unstale":"2023-11-15T01:22:23.250310+0000","last_undegraded":"2023-11-15T01:22:23.250310+0000","last_fullsized":"2023-11-15T01:22:23.250310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864775+0000","last_change":"2023-11-15T01:22:22.863095+0000","last_active":"2023-11-15T01:22:22.864775+0000","last_peered":"2023-11-15T01:22:22.864775+0000","last_clean":"2023-11-15T01:22:22.864775+0000","last_became_active":"2023-11-15T01:22:22.862813+0000","last_became_peered":"2023-11-15T01:22:22.862813+0000","last_unstale":"2023-11-15T01:22:22.864775+0000","last_undegraded":"2023-11-15T01:22:22.864775+0000","last_fullsized":"2023-11-15T01:22:22.864775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.259070+0000","last_change":"2023-11-15T01:22:23.259070+0000","last_active":"2023-11-15T01:22:23.259070+0000","last_peered":"2023-11-15T01:22:23.259070+0000","last_clean":"2023-11-15T01:22:23.259070+0000","last_became_active":"2023-11-15T01:22:23.258785+0000","last_became_peered":"2023-11-15T01:22:23.258785+0000","last_unstale":"2023-11-15T01:22:23.259070+0000","last_undegraded":"2023-11-15T01:22:23.259070+0000","last_fullsized":"2023-11-15T01:22:23.259070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.865500+0000","last_change":"2023-11-15T01:22:22.864210+0000","last_active":"2023-11-15T01:22:22.865500+0000","last_peered":"2023-11-15T01:22:22.865500+0000","last_clean":"2023-11-15T01:22:22.865500+0000","last_became_active":"2023-11-15T01:22:22.863141+0000","last_became_peered":"2023-11-15T01:22:22.863141+0000","last_unstale":"2023-11-15T01:22:22.865500+0000","last_undegraded":"2023-11-15T01:22:22.865500+0000","last_fullsized":"2023-11-15T01:22:22.865500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.242986+0000","last_change":"2023-11-15T01:22:23.242986+0000","last_active":"2023-11-15T01:22:23.242986+0000","last_peered":"2023-11-15T01:22:23.242986+0000","last_clean":"2023-11-15T01:22:23.242986+0000","last_became_active":"2023-11-15T01:22:23.242624+0000","last_became_peered":"2023-11-15T01:22:23.242624+0000","last_unstale":"2023-11-15T01:22:23.242986+0000","last_undegraded":"2023-11-15T01:22:23.242986+0000","last_fullsized":"2023-11-15T01:22:23.242986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.858506+0000","last_change":"2023-11-15T01:22:22.853874+0000","last_active":"2023-11-15T01:22:22.858506+0000","last_peered":"2023-11-15T01:22:22.858506+0000","last_clean":"2023-11-15T01:22:22.858506+0000","last_became_active":"2023-11-15T01:22:22.853533+0000","last_became_peered":"2023-11-15T01:22:22.853533+0000","last_unstale":"2023-11-15T01:22:22.858506+0000","last_undegraded":"2023-11-15T01:22:22.858506+0000","last_fullsized":"2023-11-15T01:22:22.858506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250338+0000","last_change":"2023-11-15T01:22:23.250338+0000","last_active":"2023-11-15T01:22:23.250338+0000","last_peered":"2023-11-15T01:22:23.250338+0000","last_clean":"2023-11-15T01:22:23.250338+0000","last_became_active":"2023-11-15T01:22:23.250007+0000","last_became_peered":"2023-11-15T01:22:23.250007+0000","last_unstale":"2023-11-15T01:22:23.250338+0000","last_undegraded":"2023-11-15T01:22:23.250338+0000","last_fullsized":"2023-11-15T01:22:23.250338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864905+0000","last_change":"2023-11-15T01:22:22.860800+0000","last_active":"2023-11-15T01:22:22.864905+0000","last_peered":"2023-11-15T01:22:22.864905+0000","last_clean":"2023-11-15T01:22:22.864905+0000","last_became_active":"2023-11-15T01:22:22.860461+0000","last_became_peered":"2023-11-15T01:22:22.860461+0000","last_unstale":"2023-11-15T01:22:22.864905+0000","last_undegraded":"2023-11-15T01:22:22.864905+0000","last_fullsized":"2023-11-15T01:22:22.864905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250699+0000","last_change":"2023-11-15T01:22:23.250699+0000","last_active":"2023-11-15T01:22:23.250699+0000","last_peered":"2023-11-15T01:22:23.250699+0000","last_clean":"2023-11-15T01:22:23.250699+0000","last_became_active":"2023-11-15T01:22:23.250415+0000","last_became_peered":"2023-11-15T01:22:23.250415+0000","last_unstale":"2023-11-15T01:22:23.250699+0000","last_undegraded":"2023-11-15T01:22:23.250699+0000","last_fullsized":"2023-11-15T01:22:23.250699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864097+0000","last_change":"2023-11-15T01:22:22.859092+0000","last_active":"2023-11-15T01:22:22.864097+0000","last_peered":"2023-11-15T01:22:22.864097+0000","last_clean":"2023-11-15T01:22:22.864097+0000","last_became_active":"2023-11-15T01:22:22.858800+0000","last_became_peered":"2023-11-15T01:22:22.858800+0000","last_unstale":"2023-11-15T01:22:22.864097+0000","last_undegraded":"2023-11-15T01:22:22.864097+0000","last_fullsized":"2023-11-15T01:22:22.864097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.245277+0000","last_change":"2023-11-15T01:22:23.245277+0000","last_active":"2023-11-15T01:22:23.245277+0000","last_peered":"2023-11-15T01:22:23.245277+0000","last_clean":"2023-11-15T01:22:23.245277+0000","last_became_active":"2023-11-15T01:22:23.245047+0000","last_became_peered":"2023-11-15T01:22:23.245047+0000","last_unstale":"2023-11-15T01:22:23.245277+0000","last_undegraded":"2023-11-15T01:22:23.245277+0000","last_fullsized":"2023-11-15T01:22:23.245277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.857936+0000","last_change":"2023-11-15T01:22:22.850923+0000","last_active":"2023-11-15T01:22:22.857936+0000","last_peered":"2023-11-15T01:22:22.857936+0000","last_clean":"2023-11-15T01:22:22.857936+0000","last_became_active":"2023-11-15T01:22:22.850039+0000","last_became_peered":"2023-11-15T01:22:22.850039+0000","last_unstale":"2023-11-15T01:22:22.857936+0000","last_undegraded":"2023-11-15T01:22:22.857936+0000","last_fullsized":"2023-11-15T01:22:22.857936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.242504+0000","last_change":"2023-11-15T01:22:23.242504+0000","last_active":"2023-11-15T01:22:23.242504+0000","last_peered":"2023-11-15T01:22:23.242504+0000","last_clean":"2023-11-15T01:22:23.242504+0000","last_became_active":"2023-11-15T01:22:23.241791+0000","last_became_peered":"2023-11-15T01:22:23.241791+0000","last_unstale":"2023-11-15T01:22:23.242504+0000","last_undegraded":"2023-11-15T01:22:23.242504+0000","last_fullsized":"2023-11-15T01:22:23.242504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.866365+0000","last_change":"2023-11-15T01:22:22.864626+0000","last_active":"2023-11-15T01:22:22.866365+0000","last_peered":"2023-11-15T01:22:22.866365+0000","last_clean":"2023-11-15T01:22:22.866365+0000","last_became_active":"2023-11-15T01:22:22.863503+0000","last_became_peered":"2023-11-15T01:22:22.863503+0000","last_unstale":"2023-11-15T01:22:22.866365+0000","last_undegraded":"2023-11-15T01:22:22.866365+0000","last_fullsized":"2023-11-15T01:22:22.866365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.258642+0000","last_change":"2023-11-15T01:22:23.258642+0000","last_active":"2023-11-15T01:22:23.258642+0000","last_peered":"2023-11-15T01:22:23.258642+0000","last_clean":"2023-11-15T01:22:23.258642+0000","last_became_active":"2023-11-15T01:22:23.258243+0000","last_became_peered":"2023-11-15T01:22:23.258243+0000","last_unstale":"2023-11-15T01:22:23.258642+0000","last_undegraded":"2023-11-15T01:22:23.258642+0000","last_fullsized":"2023-11-15T01:22:23.258642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.235726+0000","last_change":"2023-11-15T01:22:22.850263+0000","last_active":"2023-11-15T01:22:23.235726+0000","last_peered":"2023-11-15T01:22:23.235726+0000","last_clean":"2023-11-15T01:22:23.235726+0000","last_became_active":"2023-11-15T01:22:22.849706+0000","last_became_peered":"2023-11-15T01:22:22.849706+0000","last_unstale":"2023-11-15T01:22:23.235726+0000","last_undegraded":"2023-11-15T01:22:23.235726+0000","last_fullsized":"2023-11-15T01:22:23.235726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.260521+0000","last_change":"2023-11-15T01:22:23.260521+0000","last_active":"2023-11-15T01:22:23.260521+0000","last_peered":"2023-11-15T01:22:23.260521+0000","last_clean":"2023-11-15T01:22:23.260521+0000","last_became_active":"2023-11-15T01:22:23.260250+0000","last_became_peered":"2023-11-15T01:22:23.260250+0000","last_unstale":"2023-11-15T01:22:23.260521+0000","last_undegraded":"2023-11-15T01:22:23.260521+0000","last_fullsized":"2023-11-15T01:22:23.260521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.233876+0000","last_change":"2023-11-15T01:22:22.868957+0000","last_active":"2023-11-15T01:22:23.233876+0000","last_peered":"2023-11-15T01:22:23.233876+0000","last_clean":"2023-11-15T01:22:23.233876+0000","last_became_active":"2023-11-15T01:22:22.868690+0000","last_became_peered":"2023-11-15T01:22:22.868690+0000","last_unstale":"2023-11-15T01:22:23.233876+0000","last_undegraded":"2023-11-15T01:22:23.233876+0000","last_fullsized":"2023-11-15T01:22:23.233876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252989+0000","last_change":"2023-11-15T01:22:23.252989+0000","last_active":"2023-11-15T01:22:23.252989+0000","last_peered":"2023-11-15T01:22:23.252989+0000","last_clean":"2023-11-15T01:22:23.252989+0000","last_became_active":"2023-11-15T01:22:23.249062+0000","last_became_peered":"2023-11-15T01:22:23.249062+0000","last_unstale":"2023-11-15T01:22:23.252989+0000","last_undegraded":"2023-11-15T01:22:23.252989+0000","last_fullsized":"2023-11-15T01:22:23.252989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.254485+0000","last_change":"2023-11-15T01:22:22.864997+0000","last_active":"2023-11-15T01:22:23.254485+0000","last_peered":"2023-11-15T01:22:23.254485+0000","last_clean":"2023-11-15T01:22:23.254485+0000","last_became_active":"2023-11-15T01:22:22.863783+0000","last_became_peered":"2023-11-15T01:22:22.863783+0000","last_unstale":"2023-11-15T01:22:23.254485+0000","last_undegraded":"2023-11-15T01:22:23.254485+0000","last_fullsized":"2023-11-15T01:22:23.254485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.254922+0000","last_change":"2023-11-15T01:22:23.254922+0000","last_active":"2023-11-15T01:22:23.254922+0000","last_peered":"2023-11-15T01:22:23.254922+0000","last_clean":"2023-11-15T01:22:23.254922+0000","last_became_active":"2023-11-15T01:22:23.254674+0000","last_became_peered":"2023-11-15T01:22:23.254674+0000","last_unstale":"2023-11-15T01:22:23.254922+0000","last_undegraded":"2023-11-15T01:22:23.254922+0000","last_fullsized":"2023-11-15T01:22:23.254922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.862185+0000","last_change":"2023-11-15T01:22:22.856888+0000","last_active":"2023-11-15T01:22:22.862185+0000","last_peered":"2023-11-15T01:22:22.862185+0000","last_clean":"2023-11-15T01:22:22.862185+0000","last_became_active":"2023-11-15T01:22:22.856591+0000","last_became_peered":"2023-11-15T01:22:22.856591+0000","last_unstale":"2023-11-15T01:22:22.862185+0000","last_undegraded":"2023-11-15T01:22:22.862185+0000","last_fullsized":"2023-11-15T01:22:22.862185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.240904+0000","last_change":"2023-11-15T01:22:23.240904+0000","last_active":"2023-11-15T01:22:23.240904+0000","last_peered":"2023-11-15T01:22:23.240904+0000","last_clean":"2023-11-15T01:22:23.240904+0000","last_became_active":"2023-11-15T01:22:23.240662+0000","last_became_peered":"2023-11-15T01:22:23.240662+0000","last_unstale":"2023-11-15T01:22:23.240904+0000","last_undegraded":"2023-11-15T01:22:23.240904+0000","last_fullsized":"2023-11-15T01:22:23.240904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.858345+0000","last_change":"2023-11-15T01:22:22.854484+0000","last_active":"2023-11-15T01:22:22.858345+0000","last_peered":"2023-11-15T01:22:22.858345+0000","last_clean":"2023-11-15T01:22:22.858345+0000","last_became_active":"2023-11-15T01:22:22.854138+0000","last_became_peered":"2023-11-15T01:22:22.854138+0000","last_unstale":"2023-11-15T01:22:22.858345+0000","last_undegraded":"2023-11-15T01:22:22.858345+0000","last_fullsized":"2023-11-15T01:22:22.858345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.242198+0000","last_change":"2023-11-15T01:22:23.242198+0000","last_active":"2023-11-15T01:22:23.242198+0000","last_peered":"2023-11-15T01:22:23.242198+0000","last_clean":"2023-11-15T01:22:23.242198+0000","last_became_active":"2023-11-15T01:22:23.241751+0000","last_became_peered":"2023-11-15T01:22:23.241751+0000","last_unstale":"2023-11-15T01:22:23.242198+0000","last_undegraded":"2023-11-15T01:22:23.242198+0000","last_fullsized":"2023-11-15T01:22:23.242198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864912+0000","last_change":"2023-11-15T01:22:22.862973+0000","last_active":"2023-11-15T01:22:22.864912+0000","last_peered":"2023-11-15T01:22:22.864912+0000","last_clean":"2023-11-15T01:22:22.864912+0000","last_became_active":"2023-11-15T01:22:22.862675+0000","last_became_peered":"2023-11-15T01:22:22.862675+0000","last_unstale":"2023-11-15T01:22:22.864912+0000","last_undegraded":"2023-11-15T01:22:22.864912+0000","last_fullsized":"2023-11-15T01:22:22.864912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.257575+0000","last_change":"2023-11-15T01:22:23.257575+0000","last_active":"2023-11-15T01:22:23.257575+0000","last_peered":"2023-11-15T01:22:23.257575+0000","last_clean":"2023-11-15T01:22:23.257575+0000","last_became_active":"2023-11-15T01:22:23.257221+0000","last_became_peered":"2023-11-15T01:22:23.257221+0000","last_unstale":"2023-11-15T01:22:23.257575+0000","last_undegraded":"2023-11-15T01:22:23.257575+0000","last_fullsized":"2023-11-15T01:22:23.257575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.862142+0000","last_change":"2023-11-15T01:22:22.859522+0000","last_active":"2023-11-15T01:22:22.862142+0000","last_peered":"2023-11-15T01:22:22.862142+0000","last_clean":"2023-11-15T01:22:22.862142+0000","last_became_active":"2023-11-15T01:22:22.858921+0000","last_became_peered":"2023-11-15T01:22:22.858921+0000","last_unstale":"2023-11-15T01:22:22.862142+0000","last_undegraded":"2023-11-15T01:22:22.862142+0000","last_fullsized":"2023-11-15T01:22:22.862142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.248806+0000","last_change":"2023-11-15T01:22:23.248806+0000","last_active":"2023-11-15T01:22:23.248806+0000","last_peered":"2023-11-15T01:22:23.248806+0000","last_clean":"2023-11-15T01:22:23.248806+0000","last_became_active":"2023-11-15T01:22:23.248585+0000","last_became_peered":"2023-11-15T01:22:23.248585+0000","last_unstale":"2023-11-15T01:22:23.248806+0000","last_undegraded":"2023-11-15T01:22:23.248806+0000","last_fullsized":"2023-11-15T01:22:23.248806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.861861+0000","last_change":"2023-11-15T01:22:22.849188+0000","last_active":"2023-11-15T01:22:22.861861+0000","last_peered":"2023-11-15T01:22:22.861861+0000","last_clean":"2023-11-15T01:22:22.861861+0000","last_became_active":"2023-11-15T01:22:22.848954+0000","last_became_peered":"2023-11-15T01:22:22.848954+0000","last_unstale":"2023-11-15T01:22:22.861861+0000","last_undegraded":"2023-11-15T01:22:22.861861+0000","last_fullsized":"2023-11-15T01:22:22.861861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.248977+0000","last_change":"2023-11-15T01:22:23.248977+0000","last_active":"2023-11-15T01:22:23.248977+0000","last_peered":"2023-11-15T01:22:23.248977+0000","last_clean":"2023-11-15T01:22:23.248977+0000","last_became_active":"2023-11-15T01:22:23.248455+0000","last_became_peered":"2023-11-15T01:22:23.248455+0000","last_unstale":"2023-11-15T01:22:23.248977+0000","last_undegraded":"2023-11-15T01:22:23.248977+0000","last_fullsized":"2023-11-15T01:22:23.248977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.861997+0000","last_change":"2023-11-15T01:22:22.853999+0000","last_active":"2023-11-15T01:22:22.861997+0000","last_peered":"2023-11-15T01:22:22.861997+0000","last_clean":"2023-11-15T01:22:22.861997+0000","last_became_active":"2023-11-15T01:22:22.852575+0000","last_became_peered":"2023-11-15T01:22:22.852575+0000","last_unstale":"2023-11-15T01:22:22.861997+0000","last_undegraded":"2023-11-15T01:22:22.861997+0000","last_fullsized":"2023-11-15T01:22:22.861997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252446+0000","last_change":"2023-11-15T01:22:23.252446+0000","last_active":"2023-11-15T01:22:23.252446+0000","last_peered":"2023-11-15T01:22:23.252446+0000","last_clean":"2023-11-15T01:22:23.252446+0000","last_became_active":"2023-11-15T01:22:23.252073+0000","last_became_peered":"2023-11-15T01:22:23.252073+0000","last_unstale":"2023-11-15T01:22:23.252446+0000","last_undegraded":"2023-11-15T01:22:23.252446+0000","last_fullsized":"2023-11-15T01:22:23.252446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.859086+0000","last_change":"2023-11-15T01:22:22.856676+0000","last_active":"2023-11-15T01:22:22.859086+0000","last_peered":"2023-11-15T01:22:22.859086+0000","last_clean":"2023-11-15T01:22:22.859086+0000","last_became_active":"2023-11-15T01:22:22.856241+0000","last_became_peered":"2023-11-15T01:22:22.856241+0000","last_unstale":"2023-11-15T01:22:22.859086+0000","last_undegraded":"2023-11-15T01:22:22.859086+0000","last_fullsized":"2023-11-15T01:22:22.859086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.243725+0000","last_change":"2023-11-15T01:22:23.243725+0000","last_active":"2023-11-15T01:22:23.243725+0000","last_peered":"2023-11-15T01:22:23.243725+0000","last_clean":"2023-11-15T01:22:23.243725+0000","last_became_active":"2023-11-15T01:22:23.243441+0000","last_became_peered":"2023-11-15T01:22:23.243441+0000","last_unstale":"2023-11-15T01:22:23.243725+0000","last_undegraded":"2023-11-15T01:22:23.243725+0000","last_fullsized":"2023-11-15T01:22:23.243725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.261293+0000","last_change":"2023-11-15T01:22:22.855829+0000","last_active":"2023-11-15T01:22:23.261293+0000","last_peered":"2023-11-15T01:22:23.261293+0000","last_clean":"2023-11-15T01:22:23.261293+0000","last_became_active":"2023-11-15T01:22:22.855452+0000","last_became_peered":"2023-11-15T01:22:22.855452+0000","last_unstale":"2023-11-15T01:22:23.261293+0000","last_undegraded":"2023-11-15T01:22:23.261293+0000","last_fullsized":"2023-11-15T01:22:23.261293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250439+0000","last_change":"2023-11-15T01:22:23.250439+0000","last_active":"2023-11-15T01:22:23.250439+0000","last_peered":"2023-11-15T01:22:23.250439+0000","last_clean":"2023-11-15T01:22:23.250439+0000","last_became_active":"2023-11-15T01:22:23.250185+0000","last_became_peered":"2023-11-15T01:22:23.250185+0000","last_unstale":"2023-11-15T01:22:23.250439+0000","last_undegraded":"2023-11-15T01:22:23.250439+0000","last_fullsized":"2023-11-15T01:22:23.250439+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.253398+0000","last_change":"2023-11-15T01:22:22.860433+0000","last_active":"2023-11-15T01:22:23.253398+0000","last_peered":"2023-11-15T01:22:23.253398+0000","last_clean":"2023-11-15T01:22:23.253398+0000","last_became_active":"2023-11-15T01:22:22.860101+0000","last_became_peered":"2023-11-15T01:22:22.860101+0000","last_unstale":"2023-11-15T01:22:23.253398+0000","last_undegraded":"2023-11-15T01:22:23.253398+0000","last_fullsized":"2023-11-15T01:22:23.253398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.245424+0000","last_change":"2023-11-15T01:22:23.245424+0000","last_active":"2023-11-15T01:22:23.245424+0000","last_peered":"2023-11-15T01:22:23.245424+0000","last_clean":"2023-11-15T01:22:23.245424+0000","last_became_active":"2023-11-15T01:22:23.245185+0000","last_became_peered":"2023-11-15T01:22:23.245185+0000","last_unstale":"2023-11-15T01:22:23.245424+0000","last_undegraded":"2023-11-15T01:22:23.245424+0000","last_fullsized":"2023-11-15T01:22:23.245424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.246945+0000","last_change":"2023-11-15T01:22:22.855825+0000","last_active":"2023-11-15T01:22:23.246945+0000","last_peered":"2023-11-15T01:22:23.246945+0000","last_clean":"2023-11-15T01:22:23.246945+0000","last_became_active":"2023-11-15T01:22:22.855563+0000","last_became_peered":"2023-11-15T01:22:22.855563+0000","last_unstale":"2023-11-15T01:22:23.246945+0000","last_undegraded":"2023-11-15T01:22:23.246945+0000","last_fullsized":"2023-11-15T01:22:23.246945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.247654+0000","last_change":"2023-11-15T01:22:23.247654+0000","last_active":"2023-11-15T01:22:23.247654+0000","last_peered":"2023-11-15T01:22:23.247654+0000","last_clean":"2023-11-15T01:22:23.247654+0000","last_became_active":"2023-11-15T01:22:23.244713+0000","last_became_peered":"2023-11-15T01:22:23.244713+0000","last_unstale":"2023-11-15T01:22:23.247654+0000","last_undegraded":"2023-11-15T01:22:23.247654+0000","last_fullsized":"2023-11-15T01:22:23.247654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864924+0000","last_change":"2023-11-15T01:22:22.862286+0000","last_active":"2023-11-15T01:22:22.864924+0000","last_peered":"2023-11-15T01:22:22.864924+0000","last_clean":"2023-11-15T01:22:22.864924+0000","last_became_active":"2023-11-15T01:22:22.861590+0000","last_became_peered":"2023-11-15T01:22:22.861590+0000","last_unstale":"2023-11-15T01:22:22.864924+0000","last_undegraded":"2023-11-15T01:22:22.864924+0000","last_fullsized":"2023-11-15T01:22:22.864924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.251058+0000","last_change":"2023-11-15T01:22:23.251058+0000","last_active":"2023-11-15T01:22:23.251058+0000","last_peered":"2023-11-15T01:22:23.251058+0000","last_clean":"2023-11-15T01:22:23.251058+0000","last_became_active":"2023-11-15T01:22:23.250721+0000","last_became_peered":"2023-11-15T01:22:23.250721+0000","last_unstale":"2023-11-15T01:22:23.251058+0000","last_undegraded":"2023-11-15T01:22:23.251058+0000","last_fullsized":"2023-11-15T01:22:23.251058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.857956+0000","last_change":"2023-11-15T01:22:22.851075+0000","last_active":"2023-11-15T01:22:22.857956+0000","last_peered":"2023-11-15T01:22:22.857956+0000","last_clean":"2023-11-15T01:22:22.857956+0000","last_became_active":"2023-11-15T01:22:22.850640+0000","last_became_peered":"2023-11-15T01:22:22.850640+0000","last_unstale":"2023-11-15T01:22:22.857956+0000","last_undegraded":"2023-11-15T01:22:22.857956+0000","last_fullsized":"2023-11-15T01:22:22.857956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.247079+0000","last_change":"2023-11-15T01:22:23.247079+0000","last_active":"2023-11-15T01:22:23.247079+0000","last_peered":"2023-11-15T01:22:23.247079+0000","last_clean":"2023-11-15T01:22:23.247079+0000","last_became_active":"2023-11-15T01:22:23.246655+0000","last_became_peered":"2023-11-15T01:22:23.246655+0000","last_unstale":"2023-11-15T01:22:23.247079+0000","last_undegraded":"2023-11-15T01:22:23.247079+0000","last_fullsized":"2023-11-15T01:22:23.247079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.255158+0000","last_change":"2023-11-15T01:22:22.864803+0000","last_active":"2023-11-15T01:22:23.255158+0000","last_peered":"2023-11-15T01:22:23.255158+0000","last_clean":"2023-11-15T01:22:23.255158+0000","last_became_active":"2023-11-15T01:22:22.863803+0000","last_became_peered":"2023-11-15T01:22:22.863803+0000","last_unstale":"2023-11-15T01:22:23.255158+0000","last_undegraded":"2023-11-15T01:22:23.255158+0000","last_fullsized":"2023-11-15T01:22:23.255158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.254689+0000","last_change":"2023-11-15T01:22:23.254689+0000","last_active":"2023-11-15T01:22:23.254689+0000","last_peered":"2023-11-15T01:22:23.254689+0000","last_clean":"2023-11-15T01:22:23.254689+0000","last_became_active":"2023-11-15T01:22:23.254407+0000","last_became_peered":"2023-11-15T01:22:23.254407+0000","last_unstale":"2023-11-15T01:22:23.254689+0000","last_undegraded":"2023-11-15T01:22:23.254689+0000","last_fullsized":"2023-11-15T01:22:23.254689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.246204+0000","last_change":"2023-11-15T01:22:22.858691+0000","last_active":"2023-11-15T01:22:23.246204+0000","last_peered":"2023-11-15T01:22:23.246204+0000","last_clean":"2023-11-15T01:22:23.246204+0000","last_became_active":"2023-11-15T01:22:22.858440+0000","last_became_peered":"2023-11-15T01:22:22.858440+0000","last_unstale":"2023-11-15T01:22:23.246204+0000","last_undegraded":"2023-11-15T01:22:23.246204+0000","last_fullsized":"2023-11-15T01:22:23.246204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252434+0000","last_change":"2023-11-15T01:22:23.252434+0000","last_active":"2023-11-15T01:22:23.252434+0000","last_peered":"2023-11-15T01:22:23.252434+0000","last_clean":"2023-11-15T01:22:23.252434+0000","last_became_active":"2023-11-15T01:22:23.252108+0000","last_became_peered":"2023-11-15T01:22:23.252108+0000","last_unstale":"2023-11-15T01:22:23.252434+0000","last_undegraded":"2023-11-15T01:22:23.252434+0000","last_fullsized":"2023-11-15T01:22:23.252434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.258201+0000","last_change":"2023-11-15T01:22:22.857639+0000","last_active":"2023-11-15T01:22:23.258201+0000","last_peered":"2023-11-15T01:22:23.258201+0000","last_clean":"2023-11-15T01:22:23.258201+0000","last_became_active":"2023-11-15T01:22:22.856846+0000","last_became_peered":"2023-11-15T01:22:22.856846+0000","last_unstale":"2023-11-15T01:22:23.258201+0000","last_undegraded":"2023-11-15T01:22:23.258201+0000","last_fullsized":"2023-11-15T01:22:23.258201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.242928+0000","last_change":"2023-11-15T01:22:23.242928+0000","last_active":"2023-11-15T01:22:23.242928+0000","last_peered":"2023-11-15T01:22:23.242928+0000","last_clean":"2023-11-15T01:22:23.242928+0000","last_became_active":"2023-11-15T01:22:23.242624+0000","last_became_peered":"2023-11-15T01:22:23.242624+0000","last_unstale":"2023-11-15T01:22:23.242928+0000","last_undegraded":"2023-11-15T01:22:23.242928+0000","last_fullsized":"2023-11-15T01:22:23.242928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.860934+0000","last_change":"2023-11-15T01:22:22.860124+0000","last_active":"2023-11-15T01:22:22.860934+0000","last_peered":"2023-11-15T01:22:22.860934+0000","last_clean":"2023-11-15T01:22:22.860934+0000","last_became_active":"2023-11-15T01:22:22.859840+0000","last_became_peered":"2023-11-15T01:22:22.859840+0000","last_unstale":"2023-11-15T01:22:22.860934+0000","last_undegraded":"2023-11-15T01:22:22.860934+0000","last_fullsized":"2023-11-15T01:22:22.860934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250406+0000","last_change":"2023-11-15T01:22:23.250406+0000","last_active":"2023-11-15T01:22:23.250406+0000","last_peered":"2023-11-15T01:22:23.250406+0000","last_clean":"2023-11-15T01:22:23.250406+0000","last_became_active":"2023-11-15T01:22:23.250089+0000","last_became_peered":"2023-11-15T01:22:23.250089+0000","last_unstale":"2023-11-15T01:22:23.250406+0000","last_undegraded":"2023-11-15T01:22:23.250406+0000","last_fullsized":"2023-11-15T01:22:23.250406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.865064+0000","last_change":"2023-11-15T01:22:22.863613+0000","last_active":"2023-11-15T01:22:22.865064+0000","last_peered":"2023-11-15T01:22:22.865064+0000","last_clean":"2023-11-15T01:22:22.865064+0000","last_became_active":"2023-11-15T01:22:22.862979+0000","last_became_peered":"2023-11-15T01:22:22.862979+0000","last_unstale":"2023-11-15T01:22:22.865064+0000","last_undegraded":"2023-11-15T01:22:22.865064+0000","last_fullsized":"2023-11-15T01:22:22.865064+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.250991+0000","last_change":"2023-11-15T01:22:23.250991+0000","last_active":"2023-11-15T01:22:23.250991+0000","last_peered":"2023-11-15T01:22:23.250991+0000","last_clean":"2023-11-15T01:22:23.250991+0000","last_became_active":"2023-11-15T01:22:23.250700+0000","last_became_peered":"2023-11-15T01:22:23.250700+0000","last_unstale":"2023-11-15T01:22:23.250991+0000","last_undegraded":"2023-11-15T01:22:23.250991+0000","last_fullsized":"2023-11-15T01:22:23.250991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.237584+0000","last_change":"2023-11-15T01:22:22.859353+0000","last_active":"2023-11-15T01:22:23.237584+0000","last_peered":"2023-11-15T01:22:23.237584+0000","last_clean":"2023-11-15T01:22:23.237584+0000","last_became_active":"2023-11-15T01:22:22.854953+0000","last_became_peered":"2023-11-15T01:22:22.854953+0000","last_unstale":"2023-11-15T01:22:23.237584+0000","last_undegraded":"2023-11-15T01:22:23.237584+0000","last_fullsized":"2023-11-15T01:22:23.237584+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.249203+0000","last_change":"2023-11-15T01:22:23.249203+0000","last_active":"2023-11-15T01:22:23.249203+0000","last_peered":"2023-11-15T01:22:23.249203+0000","last_clean":"2023-11-15T01:22:23.249203+0000","last_became_active":"2023-11-15T01:22:23.248905+0000","last_became_peered":"2023-11-15T01:22:23.248905+0000","last_unstale":"2023-11-15T01:22:23.249203+0000","last_undegraded":"2023-11-15T01:22:23.249203+0000","last_fullsized":"2023-11-15T01:22:23.249203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.859695+0000","last_change":"2023-11-15T01:22:22.854376+0000","last_active":"2023-11-15T01:22:22.859695+0000","last_peered":"2023-11-15T01:22:22.859695+0000","last_clean":"2023-11-15T01:22:22.859695+0000","last_became_active":"2023-11-15T01:22:22.853983+0000","last_became_peered":"2023-11-15T01:22:22.853983+0000","last_unstale":"2023-11-15T01:22:22.859695+0000","last_undegraded":"2023-11-15T01:22:22.859695+0000","last_fullsized":"2023-11-15T01:22:22.859695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.249693+0000","last_change":"2023-11-15T01:22:23.249693+0000","last_active":"2023-11-15T01:22:23.249693+0000","last_peered":"2023-11-15T01:22:23.249693+0000","last_clean":"2023-11-15T01:22:23.249693+0000","last_became_active":"2023-11-15T01:22:23.249377+0000","last_became_peered":"2023-11-15T01:22:23.249377+0000","last_unstale":"2023-11-15T01:22:23.249693+0000","last_undegraded":"2023-11-15T01:22:23.249693+0000","last_fullsized":"2023-11-15T01:22:23.249693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864971+0000","last_change":"2023-11-15T01:22:22.861527+0000","last_active":"2023-11-15T01:22:22.864971+0000","last_peered":"2023-11-15T01:22:22.864971+0000","last_clean":"2023-11-15T01:22:22.864971+0000","last_became_active":"2023-11-15T01:22:22.861229+0000","last_became_peered":"2023-11-15T01:22:22.861229+0000","last_unstale":"2023-11-15T01:22:22.864971+0000","last_undegraded":"2023-11-15T01:22:22.864971+0000","last_fullsized":"2023-11-15T01:22:22.864971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.248367+0000","last_change":"2023-11-15T01:22:23.248367+0000","last_active":"2023-11-15T01:22:23.248367+0000","last_peered":"2023-11-15T01:22:23.248367+0000","last_clean":"2023-11-15T01:22:23.248367+0000","last_became_active":"2023-11-15T01:22:23.247767+0000","last_became_peered":"2023-11-15T01:22:23.247767+0000","last_unstale":"2023-11-15T01:22:23.248367+0000","last_undegraded":"2023-11-15T01:22:23.248367+0000","last_fullsized":"2023-11-15T01:22:23.248367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.860641+0000","last_change":"2023-11-15T01:22:22.858215+0000","last_active":"2023-11-15T01:22:22.860641+0000","last_peered":"2023-11-15T01:22:22.860641+0000","last_clean":"2023-11-15T01:22:22.860641+0000","last_became_active":"2023-11-15T01:22:22.857784+0000","last_became_peered":"2023-11-15T01:22:22.857784+0000","last_unstale":"2023-11-15T01:22:22.860641+0000","last_undegraded":"2023-11-15T01:22:22.860641+0000","last_fullsized":"2023-11-15T01:22:22.860641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252357+0000","last_change":"2023-11-15T01:22:23.252357+0000","last_active":"2023-11-15T01:22:23.252357+0000","last_peered":"2023-11-15T01:22:23.252357+0000","last_clean":"2023-11-15T01:22:23.252357+0000","last_became_active":"2023-11-15T01:22:23.252119+0000","last_became_peered":"2023-11-15T01:22:23.252119+0000","last_unstale":"2023-11-15T01:22:23.252357+0000","last_undegraded":"2023-11-15T01:22:23.252357+0000","last_fullsized":"2023-11-15T01:22:23.252357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.857385+0000","last_change":"2023-11-15T01:22:22.852312+0000","last_active":"2023-11-15T01:22:22.857385+0000","last_peered":"2023-11-15T01:22:22.857385+0000","last_clean":"2023-11-15T01:22:22.857385+0000","last_became_active":"2023-11-15T01:22:22.851932+0000","last_became_peered":"2023-11-15T01:22:22.851932+0000","last_unstale":"2023-11-15T01:22:22.857385+0000","last_undegraded":"2023-11-15T01:22:22.857385+0000","last_fullsized":"2023-11-15T01:22:22.857385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.852235+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:22:22.852235+0000","last_peered":"2023-11-15T01:22:22.852235+0000","last_clean":"2023-11-15T01:22:22.852235+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:22:22.852235+0000","last_undegraded":"2023-11-15T01:22:22.852235+0000","last_fullsized":"2023-11-15T01:22:22.852235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.247647+0000","last_change":"2023-11-15T01:22:23.247647+0000","last_active":"2023-11-15T01:22:23.247647+0000","last_peered":"2023-11-15T01:22:23.247647+0000","last_clean":"2023-11-15T01:22:23.247647+0000","last_became_active":"2023-11-15T01:22:23.247130+0000","last_became_peered":"2023-11-15T01:22:23.247130+0000","last_unstale":"2023-11-15T01:22:23.247647+0000","last_undegraded":"2023-11-15T01:22:23.247647+0000","last_fullsized":"2023-11-15T01:22:23.247647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.857725+0000","last_change":"2023-11-15T01:22:22.854426+0000","last_active":"2023-11-15T01:22:22.857725+0000","last_peered":"2023-11-15T01:22:22.857725+0000","last_clean":"2023-11-15T01:22:22.857725+0000","last_became_active":"2023-11-15T01:22:22.854126+0000","last_became_peered":"2023-11-15T01:22:22.854126+0000","last_unstale":"2023-11-15T01:22:22.857725+0000","last_undegraded":"2023-11-15T01:22:22.857725+0000","last_fullsized":"2023-11-15T01:22:22.857725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.847042+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:22:22.847042+0000","last_peered":"2023-11-15T01:22:22.847042+0000","last_clean":"2023-11-15T01:22:22.847042+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:22:22.847042+0000","last_undegraded":"2023-11-15T01:22:22.847042+0000","last_fullsized":"2023-11-15T01:22:22.847042+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.252306+0000","last_change":"2023-11-15T01:22:23.252306+0000","last_active":"2023-11-15T01:22:23.252306+0000","last_peered":"2023-11-15T01:22:23.252306+0000","last_clean":"2023-11-15T01:22:23.252306+0000","last_became_active":"2023-11-15T01:22:23.251745+0000","last_became_peered":"2023-11-15T01:22:23.251745+0000","last_unstale":"2023-11-15T01:22:23.252306+0000","last_undegraded":"2023-11-15T01:22:23.252306+0000","last_fullsized":"2023-11-15T01:22:23.252306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.859777+0000","last_change":"2023-11-15T01:22:22.856524+0000","last_active":"2023-11-15T01:22:22.859777+0000","last_peered":"2023-11-15T01:22:22.859777+0000","last_clean":"2023-11-15T01:22:22.859777+0000","last_became_active":"2023-11-15T01:22:22.856273+0000","last_became_peered":"2023-11-15T01:22:22.856273+0000","last_unstale":"2023-11-15T01:22:22.859777+0000","last_undegraded":"2023-11-15T01:22:22.859777+0000","last_fullsized":"2023-11-15T01:22:22.859777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.839858+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:22:22.839858+0000","last_peered":"2023-11-15T01:22:22.839858+0000","last_clean":"2023-11-15T01:22:22.839858+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:22:22.839858+0000","last_undegraded":"2023-11-15T01:22:22.839858+0000","last_fullsized":"2023-11-15T01:22:22.839858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.255180+0000","last_change":"2023-11-15T01:22:23.255180+0000","last_active":"2023-11-15T01:22:23.255180+0000","last_peered":"2023-11-15T01:22:23.255180+0000","last_clean":"2023-11-15T01:22:23.255180+0000","last_became_active":"2023-11-15T01:22:23.254809+0000","last_became_peered":"2023-11-15T01:22:23.254809+0000","last_unstale":"2023-11-15T01:22:23.255180+0000","last_undegraded":"2023-11-15T01:22:23.255180+0000","last_fullsized":"2023-11-15T01:22:23.255180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.864305+0000","last_change":"2023-11-15T01:22:22.860789+0000","last_active":"2023-11-15T01:22:22.864305+0000","last_peered":"2023-11-15T01:22:22.864305+0000","last_clean":"2023-11-15T01:22:22.864305+0000","last_became_active":"2023-11-15T01:22:22.860399+0000","last_became_peered":"2023-11-15T01:22:22.860399+0000","last_unstale":"2023-11-15T01:22:22.864305+0000","last_undegraded":"2023-11-15T01:22:22.864305+0000","last_fullsized":"2023-11-15T01:22:22.864305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.848458+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:22:22.848458+0000","last_peered":"2023-11-15T01:22:22.848458+0000","last_clean":"2023-11-15T01:22:22.848458+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:22:22.848458+0000","last_undegraded":"2023-11-15T01:22:22.848458+0000","last_fullsized":"2023-11-15T01:22:22.848458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.852806+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:22:22.852806+0000","last_peered":"2023-11-15T01:22:22.852806+0000","last_clean":"2023-11-15T01:22:22.852806+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:22:22.852806+0000","last_undegraded":"2023-11-15T01:22:22.852806+0000","last_fullsized":"2023-11-15T01:22:22.852806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.259259+0000","last_change":"2023-11-15T01:22:23.259259+0000","last_active":"2023-11-15T01:22:23.259259+0000","last_peered":"2023-11-15T01:22:23.259259+0000","last_clean":"2023-11-15T01:22:23.259259+0000","last_became_active":"2023-11-15T01:22:23.258815+0000","last_became_peered":"2023-11-15T01:22:23.258815+0000","last_unstale":"2023-11-15T01:22:23.259259+0000","last_undegraded":"2023-11-15T01:22:23.259259+0000","last_fullsized":"2023-11-15T01:22:23.259259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.260826+0000","last_change":"2023-11-15T01:22:22.855525+0000","last_active":"2023-11-15T01:22:23.260826+0000","last_peered":"2023-11-15T01:22:23.260826+0000","last_clean":"2023-11-15T01:22:23.260826+0000","last_became_active":"2023-11-15T01:22:22.855169+0000","last_became_peered":"2023-11-15T01:22:22.855169+0000","last_unstale":"2023-11-15T01:22:23.260826+0000","last_undegraded":"2023-11-15T01:22:23.260826+0000","last_fullsized":"2023-11-15T01:22:23.260826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.853242+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:22:22.853242+0000","last_peered":"2023-11-15T01:22:22.853242+0000","last_clean":"2023-11-15T01:22:22.853242+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:22:22.853242+0000","last_undegraded":"2023-11-15T01:22:22.853242+0000","last_fullsized":"2023-11-15T01:22:22.853242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.248763+0000","last_change":"2023-11-15T01:22:23.248763+0000","last_active":"2023-11-15T01:22:23.248763+0000","last_peered":"2023-11-15T01:22:23.248763+0000","last_clean":"2023-11-15T01:22:23.248763+0000","last_became_active":"2023-11-15T01:22:23.248460+0000","last_became_peered":"2023-11-15T01:22:23.248460+0000","last_unstale":"2023-11-15T01:22:23.248763+0000","last_undegraded":"2023-11-15T01:22:23.248763+0000","last_fullsized":"2023-11-15T01:22:23.248763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.860204+0000","last_change":"2023-11-15T01:22:22.857436+0000","last_active":"2023-11-15T01:22:22.860204+0000","last_peered":"2023-11-15T01:22:22.860204+0000","last_clean":"2023-11-15T01:22:22.860204+0000","last_became_active":"2023-11-15T01:22:22.857169+0000","last_became_peered":"2023-11-15T01:22:22.857169+0000","last_unstale":"2023-11-15T01:22:22.860204+0000","last_undegraded":"2023-11-15T01:22:22.860204+0000","last_fullsized":"2023-11-15T01:22:22.860204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.852932+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:22:22.852932+0000","last_peered":"2023-11-15T01:22:22.852932+0000","last_clean":"2023-11-15T01:22:22.852932+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:22:22.852932+0000","last_undegraded":"2023-11-15T01:22:22.852932+0000","last_fullsized":"2023-11-15T01:22:22.852932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.247488+0000","last_change":"2023-11-15T01:22:23.247488+0000","last_active":"2023-11-15T01:22:23.247488+0000","last_peered":"2023-11-15T01:22:23.247488+0000","last_clean":"2023-11-15T01:22:23.247488+0000","last_became_active":"2023-11-15T01:22:23.247200+0000","last_became_peered":"2023-11-15T01:22:23.247200+0000","last_unstale":"2023-11-15T01:22:23.247488+0000","last_undegraded":"2023-11-15T01:22:23.247488+0000","last_fullsized":"2023-11-15T01:22:23.247488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.862202+0000","last_change":"2023-11-15T01:22:22.856687+0000","last_active":"2023-11-15T01:22:22.862202+0000","last_peered":"2023-11-15T01:22:22.862202+0000","last_clean":"2023-11-15T01:22:22.862202+0000","last_became_active":"2023-11-15T01:22:22.856399+0000","last_became_peered":"2023-11-15T01:22:22.856399+0000","last_unstale":"2023-11-15T01:22:22.862202+0000","last_undegraded":"2023-11-15T01:22:22.862202+0000","last_fullsized":"2023-11-15T01:22:22.862202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.852866+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:22:22.852866+0000","last_peered":"2023-11-15T01:22:22.852866+0000","last_clean":"2023-11-15T01:22:22.852866+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:22:22.852866+0000","last_undegraded":"2023-11-15T01:22:22.852866+0000","last_fullsized":"2023-11-15T01:22:22.852866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-15T01:22:23.251934+0000","last_change":"2023-11-15T01:22:23.251934+0000","last_active":"2023-11-15T01:22:23.251934+0000","last_peered":"2023-11-15T01:22:23.251934+0000","last_clean":"2023-11-15T01:22:23.251934+0000","last_became_active":"2023-11-15T01:22:23.251661+0000","last_became_peered":"2023-11-15T01:22:23.251661+0000","last_unstale":"2023-11-15T01:22:23.251934+0000","last_undegraded":"2023-11-15T01:22:23.251934+0000","last_fullsized":"2023-11-15T01:22:23.251934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:22.832379+0000","last_clean_scrub_stamp":"2023-11-15T01:22:22.832379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.862185+0000","last_change":"2023-11-15T01:22:22.855742+0000","last_active":"2023-11-15T01:22:22.862185+0000","last_peered":"2023-11-15T01:22:22.862185+0000","last_clean":"2023-11-15T01:22:22.862185+0000","last_became_active":"2023-11-15T01:22:22.855463+0000","last_became_peered":"2023-11-15T01:22:22.855463+0000","last_unstale":"2023-11-15T01:22:22.862185+0000","last_undegraded":"2023-11-15T01:22:22.862185+0000","last_fullsized":"2023-11-15T01:22:22.862185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:22:21.827381+0000","last_clean_scrub_stamp":"2023-11-15T01:22:21.827381+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-15T01:22:22.844080+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:22:22.844080+0000","last_peered":"2023-11-15T01:22:22.844080+0000","last_clean":"2023-11-15T01:22:22.844080+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:22:22.844080+0000","last_undegraded":"2023-11-15T01:22:22.844080+0000","last_fullsized":"2023-11-15T01:22:22.844080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":152644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":144821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":152160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":376832,"data_stored":152034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":372736,"data_stored":152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":348160,"data_stored":138142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":144821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":153558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:22:27.638 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-15T01:22:27.638 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-15T01:22:27.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.795+0000 7f9f91288700 1 Processor -- start 2023-11-15T01:22:27.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.795+0000 7f9f91288700 1 -- start start 2023-11-15T01:22:27.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.795+0000 7f9f91288700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f8c1540a0 0x7f9f8c0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.795+0000 7f9f91288700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8c0ca050 con 0x7f9f8c154480 2023-11-15T01:22:27.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f91288700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8c0c9440 con 0x7f9f8c0c6650 2023-11-15T01:22:27.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f91288700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0c9720 con 0x7f9f8c1540a0 2023-11-15T01:22:27.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f827fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9f8c154480 0x7f9f8c0c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:43892/0 (socket says 172.21.15.1:43892) 2023-11-15T01:22:27.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f827fc700 1 -- 172.21.15.1:0/1547948877 learned_addr learned my addr 172.21.15.1:0/1547948877 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:27.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8affd700 1 --2- 172.21.15.1:0/1547948877 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f8c1540a0 0x7f9f8c0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029534939 0 0) 0x7f9f8c0ca050 con 0x7f9f8c154480 2023-11-15T01:22:27.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f780033f0 con 0x7f9f8c154480 2023-11-15T01:22:27.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058346213 0 0) 0x7f9f8c0c9440 con 0x7f9f8c0c6650 2023-11-15T01:22:27.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f8c0ca050 con 0x7f9f8c0c6650 2023-11-15T01:22:27.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 199226494 0 0) 0x7f9f780033f0 con 0x7f9f8c154480 2023-11-15T01:22:27.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f8c1540a0 msgr2=0x7f9f8c0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:27.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 --2- 172.21.15.1:0/1547948877 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f8c1540a0 0x7f9f8c0ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 >> v1:172.21.15.141:6789/0 conn(0x7f9f8c0c6650 legacy=0x7f9f8c0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c0c9a00 con 0x7f9f8c154480 2023-11-15T01:22:27.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f9f74001470 con 0x7f9f8c154480 2023-11-15T01:22:27.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 >> v1:172.21.15.1:6789/0 conn(0x7f9f8c154480 legacy=0x7f9f8c0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 --2- 172.21.15.1:0/1547948877 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f78003aa0 0x7f9f78003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 --2- 172.21.15.1:0/1547948877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f78004690 0x7f9f78004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 --2- 172.21.15.1:0/1547948877 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f78005000 0x7f9f7800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0c9720 con 0x7f9f78004690 2023-11-15T01:22:27.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7800bdd0 con 0x7f9f78005000 2023-11-15T01:22:27.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7800bf90 con 0x7f9f78003aa0 2023-11-15T01:22:27.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f8affd700 1 --2- 172.21.15.1:0/1547948877 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f8c1540a0 0x7f9f8c0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:27.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.796+0000 7f9f827fc700 1 --2- 172.21.15.1:0/1547948877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f78004690 0x7f9f78004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.797+0000 7f9f8b7fe700 1 --2- 172.21.15.1:0/1547948877 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f78005000 0x7f9f7800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.797+0000 7f9f8affd700 1 --2- 172.21.15.1:0/1547948877 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f78003aa0 0x7f9f78003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.797+0000 7f9f827fc700 1 -- 172.21.15.1:0/1547948877 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f78003aa0 msgr2=0x7f9f78003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:27.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.797+0000 7f9f827fc700 1 --2- 172.21.15.1:0/1547948877 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f78003aa0 0x7f9f78003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.797+0000 7f9f827fc700 1 -- 172.21.15.1:0/1547948877 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f78005000 msgr2=0x7f9f7800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:27.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.797+0000 7f9f827fc700 1 --2- 172.21.15.1:0/1547948877 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f78005000 0x7f9f7800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.797+0000 7f9f827fc700 1 -- 172.21.15.1:0/1547948877 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f780033f0 con 0x7f9f78004690 2023-11-15T01:22:27.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.797+0000 7f9f8affd700 1 --2- 172.21.15.1:0/1547948877 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f78003aa0 0x7f9f78003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:27.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.797+0000 7f9f827fc700 1 --2- 172.21.15.1:0/1547948877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f78004690 0x7f9f78004b10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f9f7400c160 tx=0x7f9f74001e10).ready entity=mon.0 client_cookie=7fb66119be6a2ac3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:27.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.797+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7400c9d0 con 0x7f9f78004690 2023-11-15T01:22:27.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.797+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7400cb30 con 0x7f9f78004690 2023-11-15T01:22:27.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.797+0000 7f9f8a7fc700 1 -- 172.21.15.1:0/1547948877 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f740070d0 con 0x7f9f78004690 2023-11-15T01:22:27.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.797+0000 7f9f91288700 1 -- 172.21.15.1:0/1547948877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f78004690 msgr2=0x7f9f78004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.797+0000 7f9f91288700 1 --2- 172.21.15.1:0/1547948877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f78004690 0x7f9f78004b10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f9f7400c160 tx=0x7f9f74001e10).stop 2023-11-15T01:22:27.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.797+0000 7f9f8b7fe700 1 -- 172.21.15.1:0/1547948877 reap_dead start 2023-11-15T01:22:27.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.798+0000 7f9f91288700 1 -- 172.21.15.1:0/1547948877 shutdown_connections 2023-11-15T01:22:27.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.798+0000 7f9f91288700 1 -- 172.21.15.1:0/1547948877 >> 172.21.15.1:0/1547948877 conn(0x7f9f8c064a70 msgr2=0x7f9f8c064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:27.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.798+0000 7f9f91288700 1 -- 172.21.15.1:0/1547948877 shutdown_connections 2023-11-15T01:22:27.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.798+0000 7f9f91288700 1 -- 172.21.15.1:0/1547948877 wait complete. 2023-11-15T01:22:27.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.799+0000 7f9f91288700 1 Processor -- start 2023-11-15T01:22:27.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.799+0000 7f9f91288700 1 -- start start 2023-11-15T01:22:27.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f91288700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f78004690 0x7f9f8c0b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f91288700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f8c0ae2b0 0x7f9f8c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f91288700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f8c0ae730 0x7f9f8c0b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f91288700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c159810 con 0x7f9f8c0ae730 2023-11-15T01:22:27.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f91288700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0c2a10 con 0x7f9f78004690 2023-11-15T01:22:27.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f91288700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c159530 con 0x7f9f8c0ae2b0 2023-11-15T01:22:27.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f8b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f8c0ae730 0x7f9f8c0b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f8b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f8c0ae730 0x7f9f8c0b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54734/0 (socket says 172.21.15.1:54734) 2023-11-15T01:22:27.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f8b7fe700 1 -- 172.21.15.1:0/1364438780 learned_addr learned my addr 172.21.15.1:0/1364438780 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:27.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f8affd700 1 --2- 172.21.15.1:0/1364438780 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f78004690 0x7f9f8c0b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f827fc700 1 --2- 172.21.15.1:0/1364438780 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f8c0ae2b0 0x7f9f8c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f8b7fe700 1 -- 172.21.15.1:0/1364438780 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f8c0ae2b0 msgr2=0x7f9f8c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f8b7fe700 1 --2- 172.21.15.1:0/1364438780 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f8c0ae2b0 0x7f9f8c0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f8b7fe700 1 -- 172.21.15.1:0/1364438780 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f78004690 msgr2=0x7f9f8c0b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:27.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f8b7fe700 1 --2- 172.21.15.1:0/1364438780 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f78004690 0x7f9f8c0b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:27.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f8b7fe700 1 -- 172.21.15.1:0/1364438780 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c0c23c0 con 0x7f9f8c0ae730 2023-11-15T01:22:27.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f8affd700 1 --2- 172.21.15.1:0/1364438780 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f78004690 0x7f9f8c0b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:27.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f8b7fe700 1 --2- 172.21.15.1:0/1364438780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f8c0ae730 0x7f9f8c0b0370 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f9f8c084910 tx=0x7f9f84007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:27.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f837fe700 1 -- 172.21.15.1:0/1364438780 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84002ea0 con 0x7f9f8c0ae730 2023-11-15T01:22:27.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f837fe700 1 -- 172.21.15.1:0/1364438780 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84004110 con 0x7f9f8c0ae730 2023-11-15T01:22:27.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f91288700 1 -- 172.21.15.1:0/1364438780 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8c0c26a0 con 0x7f9f8c0ae730 2023-11-15T01:22:27.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f837fe700 1 -- 172.21.15.1:0/1364438780 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84006e60 con 0x7f9f8c0ae730 2023-11-15T01:22:27.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.800+0000 7f9f91288700 1 -- 172.21.15.1:0/1364438780 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8c0c2ea0 con 0x7f9f8c0ae730 2023-11-15T01:22:27.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.801+0000 7f9f91288700 1 -- 172.21.15.1:0/1364438780 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8c06c7e0 con 0x7f9f8c0ae730 2023-11-15T01:22:27.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.802+0000 7f9f837fe700 1 -- 172.21.15.1:0/1364438780 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9f8400c7e0 con 0x7f9f8c0ae730 2023-11-15T01:22:27.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.802+0000 7f9f837fe700 1 --2- 172.21.15.1:0/1364438780 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9f6c05f180 0x7f9f6c061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:27.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.802+0000 7f9f837fe700 1 -- 172.21.15.1:0/1364438780 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9f84079b80 con 0x7f9f8c0ae730 2023-11-15T01:22:27.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.802+0000 7f9f8affd700 1 --2- 172.21.15.1:0/1364438780 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9f6c05f180 0x7f9f6c061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:27.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.803+0000 7f9f8affd700 1 --2- 172.21.15.1:0/1364438780 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9f6c05f180 0x7f9f6c061640 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f9f7c006be0 tx=0x7f9f7c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:27.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:27.806+0000 7f9f837fe700 1 -- 172.21.15.1:0/1364438780 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9f8404ae50 con 0x7f9f8c0ae730 2023-11-15T01:22:28.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.047+0000 7f9f91288700 1 -- 172.21.15.1:0/1364438780 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9f8c0c2b50 con 0x7f9f8c0ae730 2023-11-15T01:22:28.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.050+0000 7f9f837fe700 1 -- 172.21.15.1:0/1364438780 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9f8401a030 con 0x7f9f8c0ae730 2023-11-15T01:22:28.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.052+0000 7f9f91288700 1 -- 172.21.15.1:0/1364438780 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9f6c05f180 msgr2=0x7f9f6c061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:28.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.052+0000 7f9f91288700 1 --2- 172.21.15.1:0/1364438780 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9f6c05f180 0x7f9f6c061640 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f9f7c006be0 tx=0x7f9f7c008040).stop 2023-11-15T01:22:28.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.052+0000 7f9f91288700 1 -- 172.21.15.1:0/1364438780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f8c0ae730 msgr2=0x7f9f8c0b0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:28.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.052+0000 7f9f91288700 1 --2- 172.21.15.1:0/1364438780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f8c0ae730 0x7f9f8c0b0370 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f9f8c084910 tx=0x7f9f84007f30).stop 2023-11-15T01:22:28.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.052+0000 7f9f91288700 1 -- 172.21.15.1:0/1364438780 shutdown_connections 2023-11-15T01:22:28.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.052+0000 7f9f91288700 1 --2- 172.21.15.1:0/1364438780 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9f6c05f180 0x7f9f6c061640 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.052+0000 7f9f91288700 1 --2- 172.21.15.1:0/1364438780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f8c0ae730 0x7f9f8c0b0370 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.052+0000 7f9f91288700 1 --2- 172.21.15.1:0/1364438780 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f78004690 0x7f9f8c0b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.052+0000 7f9f91288700 1 --2- 172.21.15.1:0/1364438780 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f8c0ae2b0 0x7f9f8c0afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.052+0000 7f9f91288700 1 -- 172.21.15.1:0/1364438780 >> 172.21.15.1:0/1364438780 conn(0x7f9f8c064a70 msgr2=0x7f9f8c0ab460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:28.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.052+0000 7f9f91288700 1 -- 172.21.15.1:0/1364438780 shutdown_connections 2023-11-15T01:22:28.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.052+0000 7f9f91288700 1 -- 172.21.15.1:0/1364438780 wait complete. 2023-11-15T01:22:28.056 INFO:teuthology.orchestra.run.smithi001.stderr:updated caps for client.0 2023-11-15T01:22:28.066 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:22:28.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.182+0000 7f2283496700 1 Processor -- start 2023-11-15T01:22:28.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.182+0000 7f2283496700 1 -- start start 2023-11-15T01:22:28.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.183+0000 7f2283496700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f227c154150 0x7f227c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.183+0000 7f2283496700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f227c0aa060 0x7f227c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.183+0000 7f2283496700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227c0c06f0 con 0x7f227c0ab1a0 2023-11-15T01:22:28.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.183+0000 7f2283496700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c0c09d0 con 0x7f227c154150 2023-11-15T01:22:28.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.183+0000 7f2283496700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c158820 con 0x7f227c0aa060 2023-11-15T01:22:28.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.183+0000 7f2281232700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f227c154150 0x7f227c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.183+0000 7f2280a31700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f227c0ab1a0 0x7f227c158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:43908/0 (socket says 172.21.15.1:43908) 2023-11-15T01:22:28.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.183+0000 7f2281232700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f227c154150 0x7f227c154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54746/0 (socket says 172.21.15.1:54746) 2023-11-15T01:22:28.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.183+0000 7f2280a31700 1 -- 172.21.15.1:0/3118898096 learned_addr learned my addr 172.21.15.1:0/3118898096 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:28.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.184+0000 7f2281a33700 1 --2- 172.21.15.1:0/3118898096 >> v2:172.21.15.141:3300/0 conn(0x7f227c0aa060 0x7f227c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.184+0000 7f2281232700 1 -- 172.21.15.1:0/3118898096 >> v2:172.21.15.141:3300/0 conn(0x7f227c0aa060 msgr2=0x7f227c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:28.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.184+0000 7f2281232700 1 --2- 172.21.15.1:0/3118898096 >> v2:172.21.15.141:3300/0 conn(0x7f227c0aa060 0x7f227c0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.184+0000 7f2281232700 1 -- 172.21.15.1:0/3118898096 >> v1:172.21.15.1:6789/0 conn(0x7f227c0ab1a0 legacy=0x7f227c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:28.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.184+0000 7f2281232700 1 -- 172.21.15.1:0/3118898096 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c158b00 con 0x7f227c154150 2023-11-15T01:22:28.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.184+0000 7f2273fff700 1 -- 172.21.15.1:0/3118898096 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626336623 0 0) 0x7f227c0c06f0 con 0x7f227c0ab1a0 2023-11-15T01:22:28.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.184+0000 7f2281232700 1 --2- 172.21.15.1:0/3118898096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f227c154150 0x7f227c154530 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f227c157f80 tx=0x7f2278009060).ready entity=mon.0 client_cookie=ac98df541e7b4883 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:28.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.184+0000 7f2273fff700 1 -- 172.21.15.1:0/3118898096 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780090d0 con 0x7f227c154150 2023-11-15T01:22:28.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.184+0000 7f2273fff700 1 -- 172.21.15.1:0/3118898096 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227800b580 con 0x7f227c154150 2023-11-15T01:22:28.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.184+0000 7f2273fff700 1 -- 172.21.15.1:0/3118898096 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227800b900 con 0x7f227c154150 2023-11-15T01:22:28.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.184+0000 7f2283496700 1 -- 172.21.15.1:0/3118898096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f227c154150 msgr2=0x7f227c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:28.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.184+0000 7f2283496700 1 --2- 172.21.15.1:0/3118898096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f227c154150 0x7f227c154530 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f227c157f80 tx=0x7f2278009060).stop 2023-11-15T01:22:28.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.185+0000 7f2283496700 1 -- 172.21.15.1:0/3118898096 shutdown_connections 2023-11-15T01:22:28.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.185+0000 7f2283496700 1 --2- 172.21.15.1:0/3118898096 >> v2:172.21.15.141:3300/0 conn(0x7f227c0aa060 0x7f227c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.185+0000 7f2283496700 1 --2- 172.21.15.1:0/3118898096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f227c154150 0x7f227c154530 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.185+0000 7f2283496700 1 -- 172.21.15.1:0/3118898096 >> 172.21.15.1:0/3118898096 conn(0x7f227c064aa0 msgr2=0x7f227c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:28.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.185+0000 7f2283496700 1 -- 172.21.15.1:0/3118898096 shutdown_connections 2023-11-15T01:22:28.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.185+0000 7f2283496700 1 -- 172.21.15.1:0/3118898096 wait complete. 2023-11-15T01:22:28.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.186+0000 7f2283496700 1 Processor -- start 2023-11-15T01:22:28.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.186+0000 7f2283496700 1 -- start start 2023-11-15T01:22:28.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2283496700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f227c0aa060 0x7f227c0ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2283496700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f227c0ab1a0 0x7f227c155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2283496700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f227c154150 0x7f227c147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2283496700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c0ae520 con 0x7f227c0aa060 2023-11-15T01:22:28.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2283496700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c0af340 con 0x7f227c154150 2023-11-15T01:22:28.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2283496700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c155a40 con 0x7f227c0ab1a0 2023-11-15T01:22:28.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2281232700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f227c0aa060 0x7f227c0ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2281232700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f227c0aa060 0x7f227c0ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54756/0 (socket says 172.21.15.1:54756) 2023-11-15T01:22:28.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2281232700 1 -- 172.21.15.1:0/832098032 learned_addr learned my addr 172.21.15.1:0/832098032 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:28.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2281a33700 1 --2- 172.21.15.1:0/832098032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f227c154150 0x7f227c147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2280a31700 1 --2- 172.21.15.1:0/832098032 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f227c0ab1a0 0x7f227c155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2281232700 1 -- 172.21.15.1:0/832098032 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f227c0ab1a0 msgr2=0x7f227c155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:28.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2281232700 1 --2- 172.21.15.1:0/832098032 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f227c0ab1a0 0x7f227c155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2281232700 1 -- 172.21.15.1:0/832098032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f227c154150 msgr2=0x7f227c147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:28.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2281232700 1 --2- 172.21.15.1:0/832098032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f227c154150 0x7f227c147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2281232700 1 -- 172.21.15.1:0/832098032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22780092a0 con 0x7f227c0aa060 2023-11-15T01:22:28.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2280a31700 1 --2- 172.21.15.1:0/832098032 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f227c0ab1a0 0x7f227c155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:28.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2281232700 1 --2- 172.21.15.1:0/832098032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f227c0aa060 0x7f227c0ae030 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f2278009fd0 tx=0x7f2278017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:28.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f22717fa700 1 -- 172.21.15.1:0/832098032 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227800b900 con 0x7f227c0aa060 2023-11-15T01:22:28.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f22717fa700 1 -- 172.21.15.1:0/832098032 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2278000c90 con 0x7f227c0aa060 2023-11-15T01:22:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2283496700 1 -- 172.21.15.1:0/832098032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c0ae730 con 0x7f227c0aa060 2023-11-15T01:22:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f22717fa700 1 -- 172.21.15.1:0/832098032 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227800bed0 con 0x7f227c0aa060 2023-11-15T01:22:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.187+0000 7f2283496700 1 -- 172.21.15.1:0/832098032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c0aecf0 con 0x7f227c0aa060 2023-11-15T01:22:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.188+0000 7f2283496700 1 -- 172.21.15.1:0/832098032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c06c7e0 con 0x7f227c0aa060 2023-11-15T01:22:28.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.189+0000 7f22717fa700 1 -- 172.21.15.1:0/832098032 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f227801b650 con 0x7f227c0aa060 2023-11-15T01:22:28.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.189+0000 7f22717fa700 1 --2- 172.21.15.1:0/832098032 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f226005f150 0x7f2260061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.189+0000 7f22717fa700 1 -- 172.21.15.1:0/832098032 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f227807b890 con 0x7f227c0aa060 2023-11-15T01:22:28.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.189+0000 7f2280a31700 1 --2- 172.21.15.1:0/832098032 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f226005f150 0x7f2260061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.190+0000 7f2280a31700 1 --2- 172.21.15.1:0/832098032 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f226005f150 0x7f2260061610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f226c007fd0 tx=0x7f226c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:28.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.193+0000 7f22717fa700 1 -- 172.21.15.1:0/832098032 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f227804cb60 con 0x7f227c0aa060 2023-11-15T01:22:28.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.411+0000 7f2283496700 1 -- 172.21.15.1:0/832098032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f227c0af620 con 0x7f227c0aa060 2023-11-15T01:22:28.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.412+0000 7f22717fa700 1 -- 172.21.15.1:0/832098032 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4486 (secure 0 0 0) 0x7f2278028020 con 0x7f227c0aa060 2023-11-15T01:22:28.414 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:22:28.414 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1019024578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1019024578},{"type":"v1","addr":"172.21.15.1:6835","nonce":1019024578}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4622,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/571718542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":571718542},{"type":"v1","addr":"172.21.15.141:6837","nonce":571718542}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/4111687819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":4111687819},{"type":"v1","addr":"172.21.15.141:6836","nonce":4111687819}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:22:23.228899+0000","modified":"2023-11-15T01:22:26.233026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6834/3374581715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3374581715},{"type":"v1","addr":"172.21.15.1:6834","nonce":3374581715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-11-15T01:22:28.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.414+0000 7f2283496700 1 -- 172.21.15.1:0/832098032 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f226005f150 msgr2=0x7f2260061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:28.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.414+0000 7f2283496700 1 --2- 172.21.15.1:0/832098032 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f226005f150 0x7f2260061610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f226c007fd0 tx=0x7f226c009040).stop 2023-11-15T01:22:28.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.414+0000 7f2283496700 1 -- 172.21.15.1:0/832098032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f227c0aa060 msgr2=0x7f227c0ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:28.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.414+0000 7f2283496700 1 --2- 172.21.15.1:0/832098032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f227c0aa060 0x7f227c0ae030 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f2278009fd0 tx=0x7f2278017000).stop 2023-11-15T01:22:28.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.414+0000 7f2283496700 1 -- 172.21.15.1:0/832098032 shutdown_connections 2023-11-15T01:22:28.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.414+0000 7f2283496700 1 --2- 172.21.15.1:0/832098032 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f226005f150 0x7f2260061610 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.414+0000 7f2283496700 1 --2- 172.21.15.1:0/832098032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f227c154150 0x7f227c147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.414+0000 7f2283496700 1 --2- 172.21.15.1:0/832098032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f227c0aa060 0x7f227c0ae030 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.414+0000 7f2283496700 1 --2- 172.21.15.1:0/832098032 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f227c0ab1a0 0x7f227c155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.414+0000 7f2283496700 1 -- 172.21.15.1:0/832098032 >> 172.21.15.1:0/832098032 conn(0x7f227c064aa0 msgr2=0x7f227c0ac8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:28.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.414+0000 7f2283496700 1 -- 172.21.15.1:0/832098032 shutdown_connections 2023-11-15T01:22:28.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.414+0000 7f2283496700 1 -- 172.21.15.1:0/832098032 wait complete. 2023-11-15T01:22:28.418 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 15 2023-11-15T01:22:28.830 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-15T01:22:23.228899+0000', 'modified': '2023-11-15T01:22:26.233026+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4995}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4995': {'gid': 4995, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.1:6834/3374581715', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6832', 'nonce': 3374581715}, {'type': 'v1', 'addr': '172.21.15.1:6834', 'nonce': 3374581715}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-15T01:22:28.831 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-15T01:22:28.832 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-15T01:22:28.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.953+0000 7f3d2d0c0700 1 Processor -- start 2023-11-15T01:22:28.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.953+0000 7f3d2d0c0700 1 -- start start 2023-11-15T01:22:28.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d2d0c0700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3d28154250 0x7f3d28154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d2d0c0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3d280c6110 0x7f3d280c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d2d0c0700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d28158ff0 con 0x7f3d280a9ff0 2023-11-15T01:22:28.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d2d0c0700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d28158100 con 0x7f3d280c6110 2023-11-15T01:22:28.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d2d0c0700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d281583e0 con 0x7f3d28154250 2023-11-15T01:22:28.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d2659c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3d280c6110 0x7f3d280c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d2759e700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3d280a9ff0 0x7f3d28063510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:43910/0 (socket says 172.21.15.1:43910) 2023-11-15T01:22:28.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d2759e700 1 -- 172.21.15.1:0/1797979325 learned_addr learned my addr 172.21.15.1:0/1797979325 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:28.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d26d9d700 1 --2- 172.21.15.1:0/1797979325 >> v2:172.21.15.141:3300/0 conn(0x7f3d28154250 0x7f3d28154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d2659c700 1 -- 172.21.15.1:0/1797979325 >> v2:172.21.15.141:3300/0 conn(0x7f3d28154250 msgr2=0x7f3d28154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:28.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d2659c700 1 --2- 172.21.15.1:0/1797979325 >> v2:172.21.15.141:3300/0 conn(0x7f3d28154250 0x7f3d28154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d2659c700 1 -- 172.21.15.1:0/1797979325 >> v1:172.21.15.1:6789/0 conn(0x7f3d280a9ff0 legacy=0x7f3d28063510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:28.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d2659c700 1 -- 172.21.15.1:0/1797979325 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d281586c0 con 0x7f3d280c6110 2023-11-15T01:22:28.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d25d9b700 1 -- 172.21.15.1:0/1797979325 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798140808 0 0) 0x7f3d28158ff0 con 0x7f3d280a9ff0 2023-11-15T01:22:28.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d2659c700 1 --2- 172.21.15.1:0/1797979325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d280c6110 0x7f3d280c6590 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f3d28062cb0 tx=0x7f3d1c009060).ready entity=mon.0 client_cookie=34e513c983588e4d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:28.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d25d9b700 1 -- 172.21.15.1:0/1797979325 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c00b580 con 0x7f3d280c6110 2023-11-15T01:22:28.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d25d9b700 1 -- 172.21.15.1:0/1797979325 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c00b6e0 con 0x7f3d280c6110 2023-11-15T01:22:28.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.954+0000 7f3d25d9b700 1 -- 172.21.15.1:0/1797979325 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c00ba60 con 0x7f3d280c6110 2023-11-15T01:22:28.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.955+0000 7f3d2d0c0700 1 -- 172.21.15.1:0/1797979325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d280c6110 msgr2=0x7f3d280c6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:28.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.955+0000 7f3d2d0c0700 1 --2- 172.21.15.1:0/1797979325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d280c6110 0x7f3d280c6590 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f3d28062cb0 tx=0x7f3d1c009060).stop 2023-11-15T01:22:28.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.955+0000 7f3d2d0c0700 1 -- 172.21.15.1:0/1797979325 shutdown_connections 2023-11-15T01:22:28.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.955+0000 7f3d2d0c0700 1 --2- 172.21.15.1:0/1797979325 >> v2:172.21.15.141:3300/0 conn(0x7f3d28154250 0x7f3d28154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.955+0000 7f3d2d0c0700 1 --2- 172.21.15.1:0/1797979325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d280c6110 0x7f3d280c6590 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.955+0000 7f3d2d0c0700 1 -- 172.21.15.1:0/1797979325 >> 172.21.15.1:0/1797979325 conn(0x7f3d280c7b20 msgr2=0x7f3d280c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:28.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.955+0000 7f3d2d0c0700 1 -- 172.21.15.1:0/1797979325 shutdown_connections 2023-11-15T01:22:28.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.955+0000 7f3d2d0c0700 1 -- 172.21.15.1:0/1797979325 wait complete. 2023-11-15T01:22:28.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.956+0000 7f3d2d0c0700 1 Processor -- start 2023-11-15T01:22:28.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.956+0000 7f3d2d0c0700 1 -- start start 2023-11-15T01:22:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d2d0c0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3d280a9ff0 0x7f3d280afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d2d0c0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d280c6110 0x7f3d28147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d2d0c0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d28154250 0x7f3d280ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d2d0c0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d28154fb0 con 0x7f3d28154250 2023-11-15T01:22:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d2d0c0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d280aff80 con 0x7f3d280a9ff0 2023-11-15T01:22:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d2d0c0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d28148350 con 0x7f3d280c6110 2023-11-15T01:22:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d2759e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d28154250 0x7f3d280ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d2759e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d28154250 0x7f3d280ad120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54772/0 (socket says 172.21.15.1:54772) 2023-11-15T01:22:28.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d2759e700 1 -- 172.21.15.1:0/3983528091 learned_addr learned my addr 172.21.15.1:0/3983528091 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:28.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d26d9d700 1 --2- 172.21.15.1:0/3983528091 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3d280a9ff0 0x7f3d280afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d2659c700 1 --2- 172.21.15.1:0/3983528091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d280c6110 0x7f3d28147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d2759e700 1 -- 172.21.15.1:0/3983528091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d280c6110 msgr2=0x7f3d28147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:28.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d2759e700 1 --2- 172.21.15.1:0/3983528091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d280c6110 0x7f3d28147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d2759e700 1 -- 172.21.15.1:0/3983528091 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3d280a9ff0 msgr2=0x7f3d280afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:28.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d2759e700 1 --2- 172.21.15.1:0/3983528091 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3d280a9ff0 0x7f3d280afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.957+0000 7f3d2759e700 1 -- 172.21.15.1:0/3983528091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c0092a0 con 0x7f3d28154250 2023-11-15T01:22:28.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.958+0000 7f3d2759e700 1 --2- 172.21.15.1:0/3983528091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d28154250 0x7f3d280ad120 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f3d2000c840 tx=0x7f3d20007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:28.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.958+0000 7f3d0effd700 1 -- 172.21.15.1:0/3983528091 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20005d30 con 0x7f3d28154250 2023-11-15T01:22:28.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.958+0000 7f3d0effd700 1 -- 172.21.15.1:0/3983528091 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d20005e90 con 0x7f3d28154250 2023-11-15T01:22:28.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.958+0000 7f3d0effd700 1 -- 172.21.15.1:0/3983528091 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20007320 con 0x7f3d28154250 2023-11-15T01:22:28.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.958+0000 7f3d2d0c0700 1 -- 172.21.15.1:0/3983528091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d280c2670 con 0x7f3d28154250 2023-11-15T01:22:28.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.958+0000 7f3d2d0c0700 1 -- 172.21.15.1:0/3983528091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d280c2c30 con 0x7f3d28154250 2023-11-15T01:22:28.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.959+0000 7f3d0effd700 1 -- 172.21.15.1:0/3983528091 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3d20007710 con 0x7f3d28154250 2023-11-15T01:22:28.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.959+0000 7f3d0effd700 1 --2- 172.21.15.1:0/3983528091 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3d1405f150 0x7f3d14061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.959+0000 7f3d0effd700 1 -- 172.21.15.1:0/3983528091 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3d2007a0e0 con 0x7f3d28154250 2023-11-15T01:22:28.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.960+0000 7f3d26d9d700 1 --2- 172.21.15.1:0/3983528091 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3d1405f150 0x7f3d14061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.960+0000 7f3d26d9d700 1 --2- 172.21.15.1:0/3983528091 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3d1405f150 0x7f3d14061610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3d1800bb10 tx=0x7f3d18008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:28.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.961+0000 7f3d3ea59b80 1 Processor -- start 2023-11-15T01:22:28.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.962+0000 7f3d3ea59b80 1 -- start start 2023-11-15T01:22:28.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.962+0000 7f3d3ea59b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c3f0e40 0x56379c65cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.962+0000 7f3d3ea59b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c67dea0 0x56379c6347c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.962+0000 7f3d3ea59b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c62f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.962+0000 7f3d3ea59b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379c5fa060 con 0x56379c634cb0 2023-11-15T01:22:28.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.962+0000 7f3d3ea59b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379c5711f0 con 0x56379c3f0e40 2023-11-15T01:22:28.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.963+0000 7f3d3ea59b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x56379c586440 con 0x56379c67dea0 2023-11-15T01:22:28.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.963+0000 7f3d2759e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c62f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.963+0000 7f3d2759e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c62f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54788/0 (socket says 172.21.15.1:54788) 2023-11-15T01:22:28.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.963+0000 7f3d2759e700 1 -- 172.21.15.1:0/1151788762 learned_addr learned my addr 172.21.15.1:0/1151788762 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:28.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.963+0000 7f3d26d9d700 1 --2- 172.21.15.1:0/1151788762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c3f0e40 0x56379c65cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.963+0000 7f3d2659c700 1 --2- 172.21.15.1:0/1151788762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c67dea0 0x56379c6347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.963+0000 7f3d2759e700 1 -- 172.21.15.1:0/1151788762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c67dea0 msgr2=0x56379c6347c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:28.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.963+0000 7f3d2759e700 1 --2- 172.21.15.1:0/1151788762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c67dea0 0x56379c6347c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.963+0000 7f3d2759e700 1 -- 172.21.15.1:0/1151788762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c3f0e40 msgr2=0x56379c65cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:28.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.963+0000 7f3d2759e700 1 --2- 172.21.15.1:0/1151788762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c3f0e40 0x56379c65cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.963+0000 7f3d2759e700 1 -- 172.21.15.1:0/1151788762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56379c57f620 con 0x56379c634cb0 2023-11-15T01:22:28.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.963+0000 7f3d2759e700 1 --2- 172.21.15.1:0/1151788762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c62f600 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f3d2004eee0 tx=0x7f3d2000f000).ready entity=mon.0 client_cookie=baafaa6e5b009c20 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:28.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.963+0000 7f3d07fff700 1 -- 172.21.15.1:0/1151788762 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2004f010 con 0x56379c634cb0 2023-11-15T01:22:28.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.963+0000 7f3d07fff700 1 -- 172.21.15.1:0/1151788762 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2004d410 con 0x56379c634cb0 2023-11-15T01:22:28.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.963+0000 7f3d07fff700 1 -- 172.21.15.1:0/1151788762 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20077eb0 con 0x56379c634cb0 2023-11-15T01:22:28.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.964+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/1151788762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 msgr2=0x56379c62f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:28.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.964+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/1151788762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c62f600 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f3d2004eee0 tx=0x7f3d2000f000).stop 2023-11-15T01:22:28.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.964+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/1151788762 shutdown_connections 2023-11-15T01:22:28.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.964+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/1151788762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c62f600 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.964+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/1151788762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c3f0e40 0x56379c65cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.964+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/1151788762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c67dea0 0x56379c6347c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.964+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/1151788762 >> 172.21.15.1:0/1151788762 conn(0x56379c49e4a0 msgr2=0x56379c67d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:28.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.964+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/1151788762 shutdown_connections 2023-11-15T01:22:28.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.964+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/1151788762 wait complete. 2023-11-15T01:22:28.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.965+0000 7f3d3ea59b80 1 -- start start 2023-11-15T01:22:28.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.965+0000 7f3d3ea59b80 1 Processor -- start 2023-11-15T01:22:28.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d3ea59b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c3f0e40 0x56379c65f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d3ea59b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c677660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d3ea59b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c67dea0 0x56379c65c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d3ea59b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379c586580 con 0x56379c634cb0 2023-11-15T01:22:28.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d3ea59b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379c586800 con 0x56379c3f0e40 2023-11-15T01:22:28.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d3ea59b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x56379c551e10 con 0x56379c67dea0 2023-11-15T01:22:28.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d3ea59b80 10 client.0 ll_register_callbacks cb 0x56379c5f4460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:22:28.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d2659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c677660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d2659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c677660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54800/0 (socket says 172.21.15.1:54800) 2023-11-15T01:22:28.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d2659c700 1 -- 172.21.15.1:0/215645594 learned_addr learned my addr 172.21.15.1:0/215645594 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:28.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d2759e700 1 --2- 172.21.15.1:0/215645594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c67dea0 0x56379c65c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d26d9d700 1 --2- 172.21.15.1:0/215645594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c3f0e40 0x56379c65f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d2659c700 1 -- 172.21.15.1:0/215645594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c67dea0 msgr2=0x56379c65c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:28.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d2659c700 1 --2- 172.21.15.1:0/215645594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c67dea0 0x56379c65c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d2659c700 1 -- 172.21.15.1:0/215645594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c3f0e40 msgr2=0x56379c65f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:28.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d2659c700 1 --2- 172.21.15.1:0/215645594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c3f0e40 0x56379c65f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d2659c700 1 -- 172.21.15.1:0/215645594 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d280c2c30 con 0x56379c634cb0 2023-11-15T01:22:28.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d2659c700 1 --2- 172.21.15.1:0/215645594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c677660 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f3d1c000bc0 tx=0x7f3d1c017000).ready entity=mon.0 client_cookie=577634bc4529144d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:28.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d057fa700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:22:28.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d057fa700 1 -- 172.21.15.1:0/215645594 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c021070 con 0x56379c634cb0 2023-11-15T01:22:28.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d057fa700 1 -- 172.21.15.1:0/215645594 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3d1c01b6f0 con 0x56379c634cb0 2023-11-15T01:22:28.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.966+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/215645594 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56379c628720 con 0x56379c634cb0 2023-11-15T01:22:28.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.967+0000 7f3d057fa700 1 -- 172.21.15.1:0/215645594 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d1c01bac0 con 0x56379c634cb0 2023-11-15T01:22:28.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.967+0000 7f3d3ea59b80 10 client.5190 fetch_fsmap learned FSMap version 15 2023-11-15T01:22:28.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.967+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/215645594 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56379c57a9c0 con 0x56379c634cb0 2023-11-15T01:22:28.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.967+0000 7f3d057fa700 1 -- 172.21.15.1:0/215645594 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56379c628720 con 0x56379c634cb0 2023-11-15T01:22:28.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.967+0000 7f3d057fa700 1 -- 172.21.15.1:0/215645594 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3d1c009810 con 0x56379c634cb0 2023-11-15T01:22:28.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.967+0000 7f3d3ea59b80 10 client.5190 fetch_fsmap finished waiting for FSMap version 15 2023-11-15T01:22:28.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.967+0000 7f3d3ea59b80 10 client.5190 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-15T01:22:28.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.967+0000 7f3d3ea59b80 20 client.5190 populate_metadata read hostname 'smithi001' 2023-11-15T01:22:28.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.967+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/215645594 >> [v2:172.21.15.1:6832/3374581715,v1:172.21.15.1:6834/3374581715] conn(0x56379c68c7b0 0x56379c68cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:28.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.967+0000 7f3d3ea59b80 4 client.5190 mds_command: new command op to 4995 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-15T01:22:28.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.967+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/215645594 --> [v2:172.21.15.1:6832/3374581715,v1:172.21.15.1:6834/3374581715] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56379c3ecca0 con 0x56379c68c7b0 2023-11-15T01:22:28.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.967+0000 7f3d26d9d700 1 --2- 172.21.15.1:0/215645594 >> [v2:172.21.15.1:6832/3374581715,v1:172.21.15.1:6834/3374581715] conn(0x56379c68c7b0 0x56379c68cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:28.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.967+0000 7f3d26d9d700 1 --2- 172.21.15.1:0/215645594 >> [v2:172.21.15.1:6832/3374581715,v1:172.21.15.1:6834/3374581715] conn(0x56379c68c7b0 0x56379c68cb90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2d3721ae482c77f9 server_cookie=1fd6abcc8df7f292 in_seq=0 out_seq=0 2023-11-15T01:22:28.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.967+0000 7f3d057fa700 10 client.5190 ms_handle_connect on v2:172.21.15.1:6832/3374581715 2023-11-15T01:22:28.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.968+0000 7f3d057fa700 1 -- 172.21.15.1:0/215645594 <== mds.0 v2:172.21.15.1:6832/3374581715 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x56379c3ecca0 con 0x56379c68c7b0 2023-11-15T01:22:28.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.968+0000 7f3d057fa700 10 client.5190 handle_command_reply: tid=0 2023-11-15T01:22:28.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.968+0000 7f3d3ea59b80 1 client.5190 shutdown 2023-11-15T01:22:28.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.968+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/215645594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 msgr2=0x56379c677660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:28.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.968+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/215645594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c677660 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f3d1c000bc0 tx=0x7f3d1c017000).stop 2023-11-15T01:22:28.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.968+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/215645594 shutdown_connections 2023-11-15T01:22:28.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.968+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/215645594 >> [v2:172.21.15.1:6832/3374581715,v1:172.21.15.1:6834/3374581715] conn(0x56379c68c7b0 0x56379c68cb90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.968+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/215645594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c67dea0 0x56379c65c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.968+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/215645594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c3f0e40 0x56379c65f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.968+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/215645594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c677660 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:28.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.968+0000 7f3d057fa700 0 client.5190 ms_handle_reset on v2:172.21.15.1:6832/3374581715 2023-11-15T01:22:28.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.968+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/215645594 >> 172.21.15.1:0/215645594 conn(0x56379c49e4a0 msgr2=0x56379c635aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:28.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.968+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/215645594 shutdown_connections 2023-11-15T01:22:28.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.968+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/215645594 wait complete. 2023-11-15T01:22:28.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.968+0000 7f3d3ea59b80 20 client.5190 trim_cache size 0 max 16384 2023-11-15T01:22:29.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.985+0000 7f3d3ea59b80 1 Processor -- start 2023-11-15T01:22:29.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.985+0000 7f3d3ea59b80 1 -- start start 2023-11-15T01:22:29.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.985+0000 7f3d3ea59b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c3f0e40 0x56379c674110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:29.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.985+0000 7f3d3ea59b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c68b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:29.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.985+0000 7f3d3ea59b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c67dea0 0x56379c692bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:29.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.985+0000 7f3d3ea59b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379c679ae0 con 0x56379c634cb0 2023-11-15T01:22:29.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.985+0000 7f3d3ea59b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379c677780 con 0x56379c67dea0 2023-11-15T01:22:29.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.985+0000 7f3d3ea59b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x56379c630c50 con 0x56379c3f0e40 2023-11-15T01:22:29.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.986+0000 7f3d2659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c68b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:29.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.986+0000 7f3d2659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c68b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54804/0 (socket says 172.21.15.1:54804) 2023-11-15T01:22:29.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.986+0000 7f3d2659c700 1 -- 172.21.15.1:0/1527806070 learned_addr learned my addr 172.21.15.1:0/1527806070 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:29.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.986+0000 7f3d26d9d700 1 --2- 172.21.15.1:0/1527806070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c3f0e40 0x56379c674110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:29.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.986+0000 7f3d2759e700 1 --2- 172.21.15.1:0/1527806070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c67dea0 0x56379c692bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:29.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.986+0000 7f3d2659c700 1 -- 172.21.15.1:0/1527806070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c3f0e40 msgr2=0x56379c674110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:29.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.986+0000 7f3d2659c700 1 --2- 172.21.15.1:0/1527806070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c3f0e40 0x56379c674110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.986+0000 7f3d2659c700 1 -- 172.21.15.1:0/1527806070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c67dea0 msgr2=0x56379c692bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:29.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.986+0000 7f3d2659c700 1 --2- 172.21.15.1:0/1527806070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c67dea0 0x56379c692bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.986+0000 7f3d2659c700 1 -- 172.21.15.1:0/1527806070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56379c628340 con 0x56379c634cb0 2023-11-15T01:22:29.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.986+0000 7f3d2659c700 1 --2- 172.21.15.1:0/1527806070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c68b8d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f3d1c00b210 tx=0x7f3d1c021000).ready entity=mon.0 client_cookie=22e0f86534242345 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:29.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.986+0000 7f3d0cbcf700 1 -- 172.21.15.1:0/1527806070 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c000bf0 con 0x56379c634cb0 2023-11-15T01:22:29.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.986+0000 7f3d0cbcf700 1 -- 172.21.15.1:0/1527806070 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c01b6f0 con 0x56379c634cb0 2023-11-15T01:22:29.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.986+0000 7f3d0cbcf700 1 -- 172.21.15.1:0/1527806070 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c009810 con 0x56379c634cb0 2023-11-15T01:22:29.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.987+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/1527806070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 msgr2=0x56379c68b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:29.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.987+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/1527806070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c68b8d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f3d1c00b210 tx=0x7f3d1c021000).stop 2023-11-15T01:22:29.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.987+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/1527806070 shutdown_connections 2023-11-15T01:22:29.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.987+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/1527806070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c67dea0 0x56379c692bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.987+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/1527806070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c3f0e40 0x56379c674110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.987+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/1527806070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c634cb0 0x56379c68b8d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.987+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/1527806070 >> 172.21.15.1:0/1527806070 conn(0x56379c49e4a0 msgr2=0x56379c65f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:29.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.987+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/1527806070 shutdown_connections 2023-11-15T01:22:29.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.987+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/1527806070 wait complete. 2023-11-15T01:22:29.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.987+0000 7f3d3ea59b80 1 -- start start 2023-11-15T01:22:29.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.987+0000 7f3d3ea59b80 1 Processor -- start 2023-11-15T01:22:29.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.988+0000 7f3d3ea59b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c3f0e40 0x56379c6de420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:29.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.988+0000 7f3d3ea59b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c634cb0 0x56379c62f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:29.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.988+0000 7f3d3ea59b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c67dea0 0x56379c65fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:29.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.988+0000 7f3d3ea59b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379c6df050 con 0x56379c67dea0 2023-11-15T01:22:29.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.988+0000 7f3d3ea59b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379c62e920 con 0x56379c634cb0 2023-11-15T01:22:29.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.988+0000 7f3d3ea59b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x56379c6628d0 con 0x56379c3f0e40 2023-11-15T01:22:29.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.988+0000 7f3d3ea59b80 10 client.0 ll_register_callbacks cb 0x56379c5f4460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:22:29.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.988+0000 7f3d2759e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c67dea0 0x56379c65fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:29.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.988+0000 7f3d2759e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c67dea0 0x56379c65fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54816/0 (socket says 172.21.15.1:54816) 2023-11-15T01:22:29.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.988+0000 7f3d2759e700 1 -- 172.21.15.1:0/4189758423 learned_addr learned my addr 172.21.15.1:0/4189758423 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:29.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d2659c700 1 --2- 172.21.15.1:0/4189758423 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c634cb0 0x56379c62f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:29.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d26d9d700 1 --2- 172.21.15.1:0/4189758423 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c3f0e40 0x56379c6de420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:29.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d2759e700 1 -- 172.21.15.1:0/4189758423 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c3f0e40 msgr2=0x56379c6de420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:29.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d2759e700 1 --2- 172.21.15.1:0/4189758423 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c3f0e40 0x56379c6de420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d2759e700 1 -- 172.21.15.1:0/4189758423 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c634cb0 msgr2=0x56379c62f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:29.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d2759e700 1 --2- 172.21.15.1:0/4189758423 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c634cb0 0x56379c62f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d2759e700 1 -- 172.21.15.1:0/4189758423 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56379c57a9c0 con 0x56379c67dea0 2023-11-15T01:22:29.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d26d9d700 1 --2- 172.21.15.1:0/4189758423 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c3f0e40 0x56379c6de420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:29.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d2759e700 1 --2- 172.21.15.1:0/4189758423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c67dea0 0x56379c65fa70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f3d2004ed70 tx=0x7f3d20058000).ready entity=mon.0 client_cookie=5cc4d6668a9dd2e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:29.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d057fa700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:22:29.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d057fa700 1 -- 172.21.15.1:0/4189758423 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20064070 con 0x56379c67dea0 2023-11-15T01:22:29.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d057fa700 1 -- 172.21.15.1:0/4189758423 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3d2004f010 con 0x56379c67dea0 2023-11-15T01:22:29.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/4189758423 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3d2004d410 con 0x56379c67dea0 2023-11-15T01:22:29.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d057fa700 1 -- 172.21.15.1:0/4189758423 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d20077eb0 con 0x56379c67dea0 2023-11-15T01:22:29.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d3ea59b80 10 client.5196 fetch_fsmap learned FSMap version 15 2023-11-15T01:22:29.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/4189758423 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56379c65c380 con 0x56379c67dea0 2023-11-15T01:22:29.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d057fa700 1 -- 172.21.15.1:0/4189758423 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2004d410 con 0x56379c67dea0 2023-11-15T01:22:29.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d057fa700 1 -- 172.21.15.1:0/4189758423 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3d2005b070 con 0x56379c67dea0 2023-11-15T01:22:29.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d3ea59b80 10 client.5196 fetch_fsmap finished waiting for FSMap version 15 2023-11-15T01:22:29.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d3ea59b80 10 client.5196 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-15T01:22:29.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d3ea59b80 20 client.5196 populate_metadata read hostname 'smithi001' 2023-11-15T01:22:29.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/4189758423 >> [v2:172.21.15.1:6832/3374581715,v1:172.21.15.1:6834/3374581715] conn(0x56379c660080 0x56379c662d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:29.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d3ea59b80 4 client.5196 mds_command: new command op to 4995 tid=0[{"prefix": "status"}] 2023-11-15T01:22:29.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.989+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/4189758423 --> [v2:172.21.15.1:6832/3374581715,v1:172.21.15.1:6834/3374581715] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56379c423ca0 con 0x56379c660080 2023-11-15T01:22:29.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d26d9d700 1 --2- 172.21.15.1:0/4189758423 >> [v2:172.21.15.1:6832/3374581715,v1:172.21.15.1:6834/3374581715] conn(0x56379c660080 0x56379c662d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:29.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d26d9d700 1 --2- 172.21.15.1:0/4189758423 >> [v2:172.21.15.1:6832/3374581715,v1:172.21.15.1:6834/3374581715] conn(0x56379c660080 0x56379c662d60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f4a05c73c5ade298 server_cookie=705ae3f07cebb083 in_seq=0 out_seq=0 2023-11-15T01:22:29.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d057fa700 10 client.5196 ms_handle_connect on v2:172.21.15.1:6832/3374581715 2023-11-15T01:22:29.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d057fa700 1 -- 172.21.15.1:0/4189758423 <== mds.0 v2:172.21.15.1:6832/3374581715 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56379c423ca0 con 0x56379c660080 2023-11-15T01:22:29.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d057fa700 10 client.5196 handle_command_reply: tid=0 2023-11-15T01:22:29.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d3ea59b80 1 client.5196 shutdown 2023-11-15T01:22:29.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/4189758423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c67dea0 msgr2=0x56379c65fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:29.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/4189758423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c67dea0 0x56379c65fa70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f3d2004ed70 tx=0x7f3d20058000).stop 2023-11-15T01:22:29.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/4189758423 shutdown_connections 2023-11-15T01:22:29.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/4189758423 >> [v2:172.21.15.1:6832/3374581715,v1:172.21.15.1:6834/3374581715] conn(0x56379c660080 0x56379c662d60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/4189758423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56379c67dea0 0x56379c65fa70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/4189758423 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56379c3f0e40 0x56379c6de420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d3ea59b80 1 --2- 172.21.15.1:0/4189758423 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56379c634cb0 0x56379c62f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d057fa700 0 client.5196 ms_handle_reset on v2:172.21.15.1:6832/3374581715 2023-11-15T01:22:29.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/4189758423 >> 172.21.15.1:0/4189758423 conn(0x56379c49e4a0 msgr2=0x56379c659e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:29.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/4189758423 shutdown_connections 2023-11-15T01:22:29.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d3ea59b80 1 -- 172.21.15.1:0/4189758423 wait complete. 2023-11-15T01:22:29.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.990+0000 7f3d3ea59b80 20 client.5196 trim_cache size 0 max 16384 2023-11-15T01:22:29.021 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T01:22:29.022 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "32ffb44b-12dc-4e79-bad7-24a9692dabf6", 2023-11-15T01:22:29.022 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2023-11-15T01:22:29.022 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 4995, 2023-11-15T01:22:29.022 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2023-11-15T01:22:29.023 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2023-11-15T01:22:29.023 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2023-11-15T01:22:29.023 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 5.7611594090000002, 2023-11-15T01:22:29.023 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 15, 2023-11-15T01:22:29.023 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 34, 2023-11-15T01:22:29.023 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 34, 2023-11-15T01:22:29.024 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 13.011863848999999 2023-11-15T01:22:29.024 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T01:22:29.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.991+0000 7f3d2d0c0700 1 -- 172.21.15.1:0/3983528091 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3d1405f150 msgr2=0x7f3d14061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:29.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.991+0000 7f3d2d0c0700 1 --2- 172.21.15.1:0/3983528091 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3d1405f150 0x7f3d14061610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3d1800bb10 tx=0x7f3d18008040).stop 2023-11-15T01:22:29.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.991+0000 7f3d2d0c0700 1 -- 172.21.15.1:0/3983528091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d28154250 msgr2=0x7f3d280ad120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:29.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.991+0000 7f3d2d0c0700 1 --2- 172.21.15.1:0/3983528091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d28154250 0x7f3d280ad120 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f3d2000c840 tx=0x7f3d20007f90).stop 2023-11-15T01:22:29.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.991+0000 7f3d2d0c0700 1 -- 172.21.15.1:0/3983528091 shutdown_connections 2023-11-15T01:22:29.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.991+0000 7f3d2d0c0700 1 --2- 172.21.15.1:0/3983528091 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3d1405f150 0x7f3d14061610 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.991+0000 7f3d2d0c0700 1 --2- 172.21.15.1:0/3983528091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d28154250 0x7f3d280ad120 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.991+0000 7f3d2d0c0700 1 --2- 172.21.15.1:0/3983528091 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3d280a9ff0 0x7f3d280afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.991+0000 7f3d2d0c0700 1 --2- 172.21.15.1:0/3983528091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d280c6110 0x7f3d28147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.991+0000 7f3d2d0c0700 1 -- 172.21.15.1:0/3983528091 >> 172.21.15.1:0/3983528091 conn(0x7f3d280c7b20 msgr2=0x7f3d280c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:29.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.991+0000 7f3d2d0c0700 1 -- 172.21.15.1:0/3983528091 shutdown_connections 2023-11-15T01:22:29.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:28.991+0000 7f3d2d0c0700 1 -- 172.21.15.1:0/3983528091 wait complete. 2023-11-15T01:22:29.028 DEBUG:teuthology.orchestra.run.smithi001:> ceph fs ls 2023-11-15T01:22:29.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.132+0000 7f0e2d2b1700 1 Processor -- start 2023-11-15T01:22:29.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.132+0000 7f0e2d2b1700 1 -- start start 2023-11-15T01:22:29.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.133+0000 7f0e2d2b1700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0e28158380 0x7f0e280c6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:29.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.133+0000 7f0e2d2b1700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0e280c6b40 0x7f0e280c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:29.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.133+0000 7f0e2d2b1700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e280c12a0 con 0x7f0e28157fa0 2023-11-15T01:22:29.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.133+0000 7f0e2d2b1700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e281587e0 con 0x7f0e280c6b40 2023-11-15T01:22:29.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.133+0000 7f0e2d2b1700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e280c1730 con 0x7f0e28158380 2023-11-15T01:22:29.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.133+0000 7f0e2cab0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0e280c6b40 0x7f0e280c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:29.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.133+0000 7f0e27fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0e28157fa0 0x7f0e280bfe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:43918/0 (socket says 172.21.15.1:43918) 2023-11-15T01:22:29.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.133+0000 7f0e2cab0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0e280c6b40 0x7f0e280c6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54818/0 (socket says 172.21.15.1:54818) 2023-11-15T01:22:29.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.133+0000 7f0e27fff700 1 -- 172.21.15.1:0/4294157199 learned_addr learned my addr 172.21.15.1:0/4294157199 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:29.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.133+0000 7f0e277fe700 1 --2- 172.21.15.1:0/4294157199 >> v2:172.21.15.141:3300/0 conn(0x7f0e28158380 0x7f0e280c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:29.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.133+0000 7f0e2cab0700 1 -- 172.21.15.1:0/4294157199 >> v2:172.21.15.141:3300/0 conn(0x7f0e28158380 msgr2=0x7f0e280c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:29.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.133+0000 7f0e2cab0700 1 --2- 172.21.15.1:0/4294157199 >> v2:172.21.15.141:3300/0 conn(0x7f0e28158380 0x7f0e280c6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.133+0000 7f0e2cab0700 1 -- 172.21.15.1:0/4294157199 >> v1:172.21.15.1:6789/0 conn(0x7f0e28157fa0 legacy=0x7f0e280bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:29.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.133+0000 7f0e2cab0700 1 -- 172.21.15.1:0/4294157199 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e280c0690 con 0x7f0e280c6b40 2023-11-15T01:22:29.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.133+0000 7f0e2cab0700 1 --2- 172.21.15.1:0/4294157199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e280c6b40 0x7f0e280c6fb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f0e28065510 tx=0x7f0e20009780).ready entity=mon.0 client_cookie=4d70992000e8f948 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:29.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.134+0000 7f0e26ffd700 1 -- 172.21.15.1:0/4294157199 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2000e070 con 0x7f0e280c6b40 2023-11-15T01:22:29.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.134+0000 7f0e26ffd700 1 -- 172.21.15.1:0/4294157199 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2000bc30 con 0x7f0e280c6b40 2023-11-15T01:22:29.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.134+0000 7f0e26ffd700 1 -- 172.21.15.1:0/4294157199 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20012410 con 0x7f0e280c6b40 2023-11-15T01:22:29.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.134+0000 7f0e2d2b1700 1 -- 172.21.15.1:0/4294157199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e280c6b40 msgr2=0x7f0e280c6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:29.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.134+0000 7f0e2d2b1700 1 --2- 172.21.15.1:0/4294157199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e280c6b40 0x7f0e280c6fb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f0e28065510 tx=0x7f0e20009780).stop 2023-11-15T01:22:29.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.134+0000 7f0e2d2b1700 1 -- 172.21.15.1:0/4294157199 shutdown_connections 2023-11-15T01:22:29.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.134+0000 7f0e2d2b1700 1 --2- 172.21.15.1:0/4294157199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e280c6b40 0x7f0e280c6fb0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.134+0000 7f0e2d2b1700 1 --2- 172.21.15.1:0/4294157199 >> v2:172.21.15.141:3300/0 conn(0x7f0e28158380 0x7f0e280c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.134+0000 7f0e2d2b1700 1 -- 172.21.15.1:0/4294157199 >> 172.21.15.1:0/4294157199 conn(0x7f0e280c79a0 msgr2=0x7f0e280c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:29.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.134+0000 7f0e2d2b1700 1 -- 172.21.15.1:0/4294157199 shutdown_connections 2023-11-15T01:22:29.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.134+0000 7f0e2d2b1700 1 -- 172.21.15.1:0/4294157199 wait complete. 2023-11-15T01:22:29.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.135+0000 7f0e2d2b1700 1 Processor -- start 2023-11-15T01:22:29.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.135+0000 7f0e2d2b1700 1 -- start start 2023-11-15T01:22:29.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.136+0000 7f0e2d2b1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e280c6b40 0x7f0e280c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:29.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.136+0000 7f0e2d2b1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e28157fa0 0x7f0e280ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:29.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.136+0000 7f0e2d2b1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e28158380 0x7f0e2814dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:29.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.136+0000 7f0e2d2b1700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280af960 con 0x7f0e28158380 2023-11-15T01:22:29.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.136+0000 7f0e2d2b1700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280aed50 con 0x7f0e280c6b40 2023-11-15T01:22:29.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.136+0000 7f0e2d2b1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280af030 con 0x7f0e28157fa0 2023-11-15T01:22:29.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.136+0000 7f0e2cab0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e28158380 0x7f0e2814dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:29.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.136+0000 7f0e2cab0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e28158380 0x7f0e2814dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54828/0 (socket says 172.21.15.1:54828) 2023-11-15T01:22:29.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.136+0000 7f0e2cab0700 1 -- 172.21.15.1:0/3901615426 learned_addr learned my addr 172.21.15.1:0/3901615426 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:29.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.137+0000 7f0e277fe700 1 --2- 172.21.15.1:0/3901615426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e28157fa0 0x7f0e280ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:29.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.137+0000 7f0e27fff700 1 --2- 172.21.15.1:0/3901615426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e280c6b40 0x7f0e280c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:29.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.137+0000 7f0e2cab0700 1 -- 172.21.15.1:0/3901615426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e28157fa0 msgr2=0x7f0e280ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:29.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.137+0000 7f0e2cab0700 1 --2- 172.21.15.1:0/3901615426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e28157fa0 0x7f0e280ae520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.137+0000 7f0e2cab0700 1 -- 172.21.15.1:0/3901615426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e280c6b40 msgr2=0x7f0e280c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:29.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.137+0000 7f0e2cab0700 1 --2- 172.21.15.1:0/3901615426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e280c6b40 0x7f0e280c4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.137+0000 7f0e2cab0700 1 -- 172.21.15.1:0/3901615426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e20009a20 con 0x7f0e28158380 2023-11-15T01:22:29.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.137+0000 7f0e27fff700 1 --2- 172.21.15.1:0/3901615426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e280c6b40 0x7f0e280c4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:29.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.137+0000 7f0e2cab0700 1 --2- 172.21.15.1:0/3901615426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e28158380 0x7f0e2814dc40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f0e280cae60 tx=0x7f0e20009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:29.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.137+0000 7f0e1ffff700 1 -- 172.21.15.1:0/3901615426 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20011750 con 0x7f0e28158380 2023-11-15T01:22:29.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.137+0000 7f0e1ffff700 1 -- 172.21.15.1:0/3901615426 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e200118b0 con 0x7f0e28158380 2023-11-15T01:22:29.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.137+0000 7f0e2d2b1700 1 -- 172.21.15.1:0/3901615426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e280af310 con 0x7f0e28158380 2023-11-15T01:22:29.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.137+0000 7f0e1ffff700 1 -- 172.21.15.1:0/3901615426 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20011c70 con 0x7f0e28158380 2023-11-15T01:22:29.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.137+0000 7f0e2d2b1700 1 -- 172.21.15.1:0/3901615426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e280aea10 con 0x7f0e28158380 2023-11-15T01:22:29.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.138+0000 7f0e2d2b1700 1 -- 172.21.15.1:0/3901615426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e2805ec60 con 0x7f0e28158380 2023-11-15T01:22:29.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.138+0000 7f0e1ffff700 1 -- 172.21.15.1:0/3901615426 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0e20003040 con 0x7f0e28158380 2023-11-15T01:22:29.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.139+0000 7f0e1ffff700 1 --2- 172.21.15.1:0/3901615426 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0e0805f150 0x7f0e08061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:29.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.139+0000 7f0e1ffff700 1 -- 172.21.15.1:0/3901615426 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0e2007c130 con 0x7f0e28158380 2023-11-15T01:22:29.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.139+0000 7f0e27fff700 1 --2- 172.21.15.1:0/3901615426 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0e0805f150 0x7f0e08061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:29.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.139+0000 7f0e27fff700 1 --2- 172.21.15.1:0/3901615426 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0e0805f150 0x7f0e08061610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f0e100016b0 tx=0x7f0e10009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:29.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.143+0000 7f0e1ffff700 1 -- 172.21.15.1:0/3901615426 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0e2004d400 con 0x7f0e28158380 2023-11-15T01:22:29.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.362+0000 7f0e2d2b1700 1 -- 172.21.15.1:0/3901615426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0e280c0970 con 0x7f0e28158380 2023-11-15T01:22:29.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.362+0000 7f0e1ffff700 1 -- 172.21.15.1:0/3901615426 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0e20050a20 con 0x7f0e28158380 2023-11-15T01:22:29.364 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-15T01:22:29.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.364+0000 7f0e2d2b1700 1 -- 172.21.15.1:0/3901615426 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0e0805f150 msgr2=0x7f0e08061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:29.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.364+0000 7f0e2d2b1700 1 --2- 172.21.15.1:0/3901615426 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0e0805f150 0x7f0e08061610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f0e100016b0 tx=0x7f0e10009040).stop 2023-11-15T01:22:29.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.364+0000 7f0e2d2b1700 1 -- 172.21.15.1:0/3901615426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e28158380 msgr2=0x7f0e2814dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:29.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.364+0000 7f0e2d2b1700 1 --2- 172.21.15.1:0/3901615426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e28158380 0x7f0e2814dc40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f0e280cae60 tx=0x7f0e20009780).stop 2023-11-15T01:22:29.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.364+0000 7f0e2d2b1700 1 -- 172.21.15.1:0/3901615426 shutdown_connections 2023-11-15T01:22:29.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.364+0000 7f0e2d2b1700 1 --2- 172.21.15.1:0/3901615426 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0e0805f150 0x7f0e08061610 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.364+0000 7f0e2d2b1700 1 --2- 172.21.15.1:0/3901615426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e28158380 0x7f0e2814dc40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.364+0000 7f0e2d2b1700 1 --2- 172.21.15.1:0/3901615426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e280c6b40 0x7f0e280c4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.364+0000 7f0e2d2b1700 1 --2- 172.21.15.1:0/3901615426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e28157fa0 0x7f0e280ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.364+0000 7f0e2d2b1700 1 -- 172.21.15.1:0/3901615426 >> 172.21.15.1:0/3901615426 conn(0x7f0e280c79a0 msgr2=0x7f0e280c7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.364+0000 7f0e2d2b1700 1 -- 172.21.15.1:0/3901615426 shutdown_connections 2023-11-15T01:22:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:29.364+0000 7f0e2d2b1700 1 -- 172.21.15.1:0/3901615426 wait complete. 2023-11-15T01:22:29.376 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-15T01:22:29.377 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-15T01:22:29.377 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-11-15T01:22:29.377 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-15T01:22:29.378 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-15T01:22:29.378 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-15T01:22:29.378 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-15T01:22:29.379 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-15T01:22:29.379 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T01:22:29.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:22:29.380 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-11-15T01:22:29.395 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:22:29.395 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T01:22:29.396 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T01:22:29.396 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:22:29.396 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-11-15T01:22:29.396 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:22:29.396 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:22:29.397 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-11-15T01:22:29.397 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-11-15T01:22:29.397 INFO:teuthology.orchestra.run.smithi001.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-15T01:22:29.397 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:22:29.397 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-11-15T01:22:29.397 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-15T01:22:29.398 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42456sec preferred_lft 42456sec 2023-11-15T01:22:29.398 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2023-11-15T01:22:29.398 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:22:29.398 INFO:teuthology.orchestra.run.smithi001.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:22:29.398 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-11-15T01:22:29.399 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-11-15T01:22:29.399 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:22:29.399 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:22:29.399 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-11-15T01:22:29.399 INFO:teuthology.orchestra.run.smithi001.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-15T01:22:29.400 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:22:29.400 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-15T01:22:29.400 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:22:29.400 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::74ff:4aff:fef6:c8f5/64 scope link 2023-11-15T01:22:29.400 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:22:29.400 INFO:teuthology.orchestra.run.smithi001.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:22:29.401 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-15T01:22:29.401 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::10ca:5cff:fe8a:9a23/64 scope link 2023-11-15T01:22:29.401 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:22:29.401 INFO:teuthology.orchestra.run.smithi001.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:22:29.401 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 92:7a:64:05:0f:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-15T01:22:29.401 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::907a:64ff:fe05:f37/64 scope link 2023-11-15T01:22:29.402 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:22:29.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:22:29.402 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-15T01:22:29.459 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-11-15T01:22:29.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:22:29.461 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-11-15T01:22:29.516 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-11-15T01:22:29.516 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-15T01:22:29.517 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-15T01:22:29.517 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-15T01:22:29.517 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-15T01:22:29.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:22:29.518 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:22:29.518 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:22:29.519 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-15T01:22:29.519 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-15T01:22:29.519 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-15T01:22:29.520 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:22:29.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:22:29.618 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T01:22:29.633 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-15T01:22:29.633 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-15T01:22:29.634 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T01:22:29.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:22:29.635 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2023-11-15T01:22:29.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:22:29.699 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-15T01:22:29.754 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-15T01:22:29.755 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:22:29.835 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:22:29.835 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:22:29.860 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:22:29.860 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:22:29.862 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-15T01:22:29.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:22:29.863 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-15T01:22:29.928 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-15T01:22:30.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.086+0000 7f2fcb774700 1 Processor -- start 2023-11-15T01:22:30.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.086+0000 7f2fcb774700 1 -- start start 2023-11-15T01:22:30.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fcb774700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fc40c6620 0x7f2fc4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fcb774700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc40c06f0 con 0x7f2fc4154150 2023-11-15T01:22:30.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fcb774700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc40c09d0 con 0x7f2fc40ab1a0 2023-11-15T01:22:30.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fcb774700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc4158820 con 0x7f2fc40c6620 2023-11-15T01:22:30.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fc9510700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2fc4154150 0x7f2fc4158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:43934/0 (socket says 172.21.15.1:43934) 2023-11-15T01:22:30.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fc9510700 1 -- 172.21.15.1:0/3490889116 learned_addr learned my addr 172.21.15.1:0/3490889116 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:30.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fbbfff700 1 -- 172.21.15.1:0/3490889116 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608429348 0 0) 0x7f2fc40c06f0 con 0x7f2fc4154150 2023-11-15T01:22:30.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fc9d11700 1 --2- 172.21.15.1:0/3490889116 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fc40c6620 0x7f2fc4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fbbfff700 1 -- 172.21.15.1:0/3490889116 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb00033f0 con 0x7f2fc4154150 2023-11-15T01:22:30.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fbbfff700 1 -- 172.21.15.1:0/3490889116 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 87206488 0 0) 0x7f2fb00033f0 con 0x7f2fc4154150 2023-11-15T01:22:30.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fbbfff700 1 -- 172.21.15.1:0/3490889116 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fc40c6620 msgr2=0x7f2fc4154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:30.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fbbfff700 1 --2- 172.21.15.1:0/3490889116 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fc40c6620 0x7f2fc4154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:30.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fbbfff700 1 -- 172.21.15.1:0/3490889116 >> v1:172.21.15.141:6789/0 conn(0x7f2fc40ab1a0 legacy=0x7f2fc40c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:30.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fbbfff700 1 -- 172.21.15.1:0/3490889116 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc4158b00 con 0x7f2fc4154150 2023-11-15T01:22:30.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fbbfff700 1 -- 172.21.15.1:0/3490889116 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f2fc0001470 con 0x7f2fc4154150 2023-11-15T01:22:30.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fbbfff700 1 -- 172.21.15.1:0/3490889116 >> v1:172.21.15.1:6789/0 conn(0x7f2fc4154150 legacy=0x7f2fc4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:30.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.087+0000 7f2fbbfff700 1 --2- 172.21.15.1:0/3490889116 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fb0003910 0x7f2fb0003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fbbfff700 1 --2- 172.21.15.1:0/3490889116 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fc40c6620 0x7f2fb0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fbbfff700 1 --2- 172.21.15.1:0/3490889116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fb0004b80 0x7f2fb0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fbbfff700 1 -- 172.21.15.1:0/3490889116 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc4158820 con 0x7f2fb0004b80 2023-11-15T01:22:30.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fbbfff700 1 -- 172.21.15.1:0/3490889116 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb000b990 con 0x7f2fb0003910 2023-11-15T01:22:30.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fbbfff700 1 -- 172.21.15.1:0/3490889116 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb000bb50 con 0x7f2fc40c6620 2023-11-15T01:22:30.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fc9d11700 1 --2- 172.21.15.1:0/3490889116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fb0004b80 0x7f2fb0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fc9510700 1 --2- 172.21.15.1:0/3490889116 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fb0003910 0x7f2fb0003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fc8d0f700 1 --2- 172.21.15.1:0/3490889116 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fc40c6620 0x7f2fb0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fc9d11700 1 -- 172.21.15.1:0/3490889116 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fc40c6620 msgr2=0x7f2fb0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:30.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fc9d11700 1 --2- 172.21.15.1:0/3490889116 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fc40c6620 0x7f2fb0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:30.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fc9d11700 1 -- 172.21.15.1:0/3490889116 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fb0003910 msgr2=0x7f2fb0003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:30.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fc9d11700 1 --2- 172.21.15.1:0/3490889116 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fb0003910 0x7f2fb0003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:30.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fc9d11700 1 -- 172.21.15.1:0/3490889116 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00033f0 con 0x7f2fb0004b80 2023-11-15T01:22:30.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fc9d11700 1 --2- 172.21.15.1:0/3490889116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fb0004b80 0x7f2fb0005000 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f2fc40c5930 tx=0x7f2fbc00b040).ready entity=mon.0 client_cookie=427a4569c8de57c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:30.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fbbfff700 1 -- 172.21.15.1:0/3490889116 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc009ac0 con 0x7f2fb0004b80 2023-11-15T01:22:30.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fbbfff700 1 -- 172.21.15.1:0/3490889116 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc00f040 con 0x7f2fb0004b80 2023-11-15T01:22:30.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.088+0000 7f2fbbfff700 1 -- 172.21.15.1:0/3490889116 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00ec10 con 0x7f2fb0004b80 2023-11-15T01:22:30.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.089+0000 7f2fcb774700 1 -- 172.21.15.1:0/3490889116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fb0004b80 msgr2=0x7f2fb0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:30.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.089+0000 7f2fcb774700 1 --2- 172.21.15.1:0/3490889116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fb0004b80 0x7f2fb0005000 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f2fc40c5930 tx=0x7f2fbc00b040).stop 2023-11-15T01:22:30.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.089+0000 7f2fc9d11700 1 -- 172.21.15.1:0/3490889116 reap_dead start 2023-11-15T01:22:30.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.089+0000 7f2fcb774700 1 -- 172.21.15.1:0/3490889116 shutdown_connections 2023-11-15T01:22:30.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.089+0000 7f2fcb774700 1 -- 172.21.15.1:0/3490889116 >> 172.21.15.1:0/3490889116 conn(0x7f2fc4064aa0 msgr2=0x7f2fc4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:30.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.089+0000 7f2fcb774700 1 -- 172.21.15.1:0/3490889116 shutdown_connections 2023-11-15T01:22:30.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.089+0000 7f2fcb774700 1 -- 172.21.15.1:0/3490889116 wait complete. 2023-11-15T01:22:30.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.090+0000 7f2fcb774700 1 Processor -- start 2023-11-15T01:22:30.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.090+0000 7f2fcb774700 1 -- start start 2023-11-15T01:22:30.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fcb774700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fc414fbe0 0x7f2fc4157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fcb774700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc414ffc0 0x7f2fc4154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fcb774700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fc40cae40 0x7f2fc40cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fcb774700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40c8eb0 con 0x7f2fc414fbe0 2023-11-15T01:22:30.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fcb774700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc4155430 con 0x7f2fc414ffc0 2023-11-15T01:22:30.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fcb774700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40cb7b0 con 0x7f2fc40cae40 2023-11-15T01:22:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fc9510700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fc414fbe0 0x7f2fc4157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fc9510700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fc414fbe0 0x7f2fc4157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54838/0 (socket says 172.21.15.1:54838) 2023-11-15T01:22:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fc9510700 1 -- 172.21.15.1:0/2054782975 learned_addr learned my addr 172.21.15.1:0/2054782975 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fc8d0f700 1 --2- 172.21.15.1:0/2054782975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc414ffc0 0x7f2fc4154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fc9d11700 1 --2- 172.21.15.1:0/2054782975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fc40cae40 0x7f2fc40cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fc9510700 1 -- 172.21.15.1:0/2054782975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fc40cae40 msgr2=0x7f2fc40cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fc9510700 1 --2- 172.21.15.1:0/2054782975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fc40cae40 0x7f2fc40cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fc9510700 1 -- 172.21.15.1:0/2054782975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc414ffc0 msgr2=0x7f2fc4154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fc9510700 1 --2- 172.21.15.1:0/2054782975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc414ffc0 0x7f2fc4154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fc9510700 1 -- 172.21.15.1:0/2054782975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc41556c0 con 0x7f2fc414fbe0 2023-11-15T01:22:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.091+0000 7f2fc9510700 1 --2- 172.21.15.1:0/2054782975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fc414fbe0 0x7f2fc4157010 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f2fc0004ad0 tx=0x7f2fc0001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.092+0000 7f2fb97fa700 1 -- 172.21.15.1:0/2054782975 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0001440 con 0x7f2fc414fbe0 2023-11-15T01:22:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.092+0000 7f2fb97fa700 1 -- 172.21.15.1:0/2054782975 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc0000f50 con 0x7f2fc414fbe0 2023-11-15T01:22:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.092+0000 7f2fcb774700 1 -- 172.21.15.1:0/2054782975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc41559a0 con 0x7f2fc414fbe0 2023-11-15T01:22:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.092+0000 7f2fb97fa700 1 -- 172.21.15.1:0/2054782975 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000f8d0 con 0x7f2fc414fbe0 2023-11-15T01:22:30.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.092+0000 7f2fcb774700 1 -- 172.21.15.1:0/2054782975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc4155f60 con 0x7f2fc414fbe0 2023-11-15T01:22:30.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.093+0000 7f2fcb774700 1 -- 172.21.15.1:0/2054782975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc41538a0 con 0x7f2fc414fbe0 2023-11-15T01:22:30.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.093+0000 7f2fb97fa700 1 -- 172.21.15.1:0/2054782975 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2fc001d3b0 con 0x7f2fc414fbe0 2023-11-15T01:22:30.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.093+0000 7f2fb97fa700 1 --2- 172.21.15.1:0/2054782975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2fa805f180 0x7f2fa8061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.093+0000 7f2fb97fa700 1 -- 172.21.15.1:0/2054782975 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2fc0079d40 con 0x7f2fc414fbe0 2023-11-15T01:22:30.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.094+0000 7f2fc8d0f700 1 --2- 172.21.15.1:0/2054782975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2fa805f180 0x7f2fa8061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.094+0000 7f2fc8d0f700 1 --2- 172.21.15.1:0/2054782975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2fa805f180 0x7f2fa8061640 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f2fc40ad4a0 tx=0x7f2fb4007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:30.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.098+0000 7f2fb97fa700 1 -- 172.21.15.1:0/2054782975 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2fc004afb0 con 0x7f2fc414fbe0 2023-11-15T01:22:30.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.298+0000 7f2fcb774700 1 -- 172.21.15.1:0/2054782975 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fc40c8ff0 con 0x7f2fa805f180 2023-11-15T01:22:30.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.300+0000 7f2fb97fa700 1 -- 172.21.15.1:0/2054782975 <== mgr.4103 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2fb40036b0 con 0x7f2fa805f180 2023-11-15T01:22:30.302 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T01:22:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:22:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephfs" 2023-11-15T01:22:30.302 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:22:30.303 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T01:22:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.302+0000 7f2fcb774700 1 -- 172.21.15.1:0/2054782975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2fa805f180 msgr2=0x7f2fa8061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.302+0000 7f2fcb774700 1 --2- 172.21.15.1:0/2054782975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2fa805f180 0x7f2fa8061640 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f2fc40ad4a0 tx=0x7f2fb4007b90).stop 2023-11-15T01:22:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.302+0000 7f2fcb774700 1 -- 172.21.15.1:0/2054782975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fc414fbe0 msgr2=0x7f2fc4157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.302+0000 7f2fcb774700 1 --2- 172.21.15.1:0/2054782975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fc414fbe0 0x7f2fc4157010 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f2fc0004ad0 tx=0x7f2fc0001e70).stop 2023-11-15T01:22:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.302+0000 7f2fcb774700 1 -- 172.21.15.1:0/2054782975 shutdown_connections 2023-11-15T01:22:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.302+0000 7f2fcb774700 1 --2- 172.21.15.1:0/2054782975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2fa805f180 0x7f2fa8061640 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.302+0000 7f2fcb774700 1 --2- 172.21.15.1:0/2054782975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fc40cae40 0x7f2fc40cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.302+0000 7f2fcb774700 1 --2- 172.21.15.1:0/2054782975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fc414fbe0 0x7f2fc4157010 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:30.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.302+0000 7f2fcb774700 1 --2- 172.21.15.1:0/2054782975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fc414ffc0 0x7f2fc4154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:30.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.302+0000 7f2fcb774700 1 -- 172.21.15.1:0/2054782975 >> 172.21.15.1:0/2054782975 conn(0x7f2fc4064aa0 msgr2=0x7f2fc4063460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:30.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.302+0000 7f2fcb774700 1 -- 172.21.15.1:0/2054782975 shutdown_connections 2023-11-15T01:22:30.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.302+0000 7f2fcb774700 1 -- 172.21.15.1:0/2054782975 wait complete. 2023-11-15T01:22:30.316 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-15T01:22:30.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.434+0000 7f557aa43700 1 Processor -- start 2023-11-15T01:22:30.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.434+0000 7f557aa43700 1 -- start start 2023-11-15T01:22:30.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.435+0000 7f557aa43700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f55740c3e30 0x7f55740c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.435+0000 7f557aa43700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557406a020 con 0x7f5574154bf0 2023-11-15T01:22:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.435+0000 7f557aa43700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5574155320 con 0x7f5574069ba0 2023-11-15T01:22:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.435+0000 7f557aa43700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5574155bc0 con 0x7f55740c3e30 2023-11-15T01:22:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.435+0000 7f5578fe0700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5574154bf0 0x7f557413a550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:43938/0 (socket says 172.21.15.1:43938) 2023-11-15T01:22:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.435+0000 7f5578fe0700 1 -- 172.21.15.1:0/1524452603 learned_addr learned my addr 172.21.15.1:0/1524452603 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5573fff700 1 --2- 172.21.15.1:0/1524452603 >> v2:172.21.15.141:3300/0 conn(0x7f55740c3e30 0x7f55740c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5572ffd700 1 -- 172.21.15.1:0/1524452603 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050594906 0 0) 0x7f557406a020 con 0x7f5574154bf0 2023-11-15T01:22:30.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5572ffd700 1 -- 172.21.15.1:0/1524452603 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55600033f0 con 0x7f5574154bf0 2023-11-15T01:22:30.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5572ffd700 1 -- 172.21.15.1:0/1524452603 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2834307976 0 0) 0x7f55600033f0 con 0x7f5574154bf0 2023-11-15T01:22:30.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5572ffd700 1 -- 172.21.15.1:0/1524452603 >> v2:172.21.15.141:3300/0 conn(0x7f55740c3e30 msgr2=0x7f55740c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:30.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5572ffd700 1 --2- 172.21.15.1:0/1524452603 >> v2:172.21.15.141:3300/0 conn(0x7f55740c3e30 0x7f55740c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:30.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5572ffd700 1 -- 172.21.15.1:0/1524452603 >> v1:172.21.15.141:6789/0 conn(0x7f5574069ba0 legacy=0x7f5574066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:30.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5572ffd700 1 -- 172.21.15.1:0/1524452603 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5574155600 con 0x7f5574154bf0 2023-11-15T01:22:30.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5572ffd700 1 -- 172.21.15.1:0/1524452603 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f556c0017f0 con 0x7f5574154bf0 2023-11-15T01:22:30.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5572ffd700 1 -- 172.21.15.1:0/1524452603 >> v1:172.21.15.1:6789/0 conn(0x7f5574154bf0 legacy=0x7f557413a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:30.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5572ffd700 1 --2- 172.21.15.1:0/1524452603 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55600038e0 0x7f5560003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5572ffd700 1 --2- 172.21.15.1:0/1524452603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5560004690 0x7f5560004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5572ffd700 1 --2- 172.21.15.1:0/1524452603 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5560005000 0x7f556000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5572ffd700 1 -- 172.21.15.1:0/1524452603 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5574155bc0 con 0x7f5560004690 2023-11-15T01:22:30.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5572ffd700 1 -- 172.21.15.1:0/1524452603 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556000beb0 con 0x7f5560005000 2023-11-15T01:22:30.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5572ffd700 1 -- 172.21.15.1:0/1524452603 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556000c070 con 0x7f55600038e0 2023-11-15T01:22:30.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f55737fe700 1 --2- 172.21.15.1:0/1524452603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5560004690 0x7f5560004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5578fe0700 1 --2- 172.21.15.1:0/1524452603 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5560005000 0x7f556000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5573fff700 1 --2- 172.21.15.1:0/1524452603 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55600038e0 0x7f5560003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f55737fe700 1 -- 172.21.15.1:0/1524452603 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55600038e0 msgr2=0x7f5560003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:30.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f55737fe700 1 --2- 172.21.15.1:0/1524452603 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55600038e0 0x7f5560003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:30.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f55737fe700 1 -- 172.21.15.1:0/1524452603 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5560005000 msgr2=0x7f556000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:30.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f55737fe700 1 --2- 172.21.15.1:0/1524452603 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5560005000 0x7f556000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:30.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f55737fe700 1 -- 172.21.15.1:0/1524452603 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600033f0 con 0x7f5560004690 2023-11-15T01:22:30.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.436+0000 7f5578fe0700 1 -- 172.21.15.1:0/1524452603 reap_dead start 2023-11-15T01:22:30.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.437+0000 7f55737fe700 1 --2- 172.21.15.1:0/1524452603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5560004690 0x7f5560004b10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f5564001730 tx=0x7f5564007bb0).ready entity=mon.0 client_cookie=7952a06a59faa2fa server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.437+0000 7f5572ffd700 1 -- 172.21.15.1:0/1524452603 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564007020 con 0x7f5560004690 2023-11-15T01:22:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.437+0000 7f5572ffd700 1 -- 172.21.15.1:0/1524452603 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5564007180 con 0x7f5560004690 2023-11-15T01:22:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.437+0000 7f5572ffd700 1 -- 172.21.15.1:0/1524452603 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564007520 con 0x7f5560004690 2023-11-15T01:22:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.437+0000 7f557aa43700 1 -- 172.21.15.1:0/1524452603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5560004690 msgr2=0x7f5560004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.437+0000 7f557aa43700 1 --2- 172.21.15.1:0/1524452603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5560004690 0x7f5560004b10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f5564001730 tx=0x7f5564007bb0).stop 2023-11-15T01:22:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.437+0000 7f557aa43700 1 -- 172.21.15.1:0/1524452603 shutdown_connections 2023-11-15T01:22:30.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.437+0000 7f557aa43700 1 --2- 172.21.15.1:0/1524452603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5560004690 0x7f5560004b10 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:30.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.437+0000 7f557aa43700 1 -- 172.21.15.1:0/1524452603 >> 172.21.15.1:0/1524452603 conn(0x7f55740c7dc0 msgr2=0x7f55740c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:30.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.437+0000 7f557aa43700 1 -- 172.21.15.1:0/1524452603 shutdown_connections 2023-11-15T01:22:30.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.437+0000 7f557aa43700 1 -- 172.21.15.1:0/1524452603 wait complete. 2023-11-15T01:22:30.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.438+0000 7f557aa43700 1 Processor -- start 2023-11-15T01:22:30.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.439+0000 7f557aa43700 1 -- start start 2023-11-15T01:22:30.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.439+0000 7f557aa43700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5560004690 0x7f55741686d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.439+0000 7f557aa43700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5574138cf0 0x7f55740a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.439+0000 7f557aa43700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55740a58e0 0x7f55740627b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.439+0000 7f557aa43700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55740a4f60 con 0x7f55740a58e0 2023-11-15T01:22:30.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.439+0000 7f557aa43700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5574168bc0 con 0x7f5560004690 2023-11-15T01:22:30.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.439+0000 7f557aa43700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55740a6fb0 con 0x7f5574138cf0 2023-11-15T01:22:30.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.439+0000 7f5578fe0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55740a58e0 0x7f55740627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.439+0000 7f5578fe0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55740a58e0 0x7f55740627b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54858/0 (socket says 172.21.15.1:54858) 2023-11-15T01:22:30.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f5578fe0700 1 -- 172.21.15.1:0/1990271194 learned_addr learned my addr 172.21.15.1:0/1990271194 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:30.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f55737fe700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5574138cf0 0x7f55740a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f5573fff700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5560004690 0x7f55741686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f5578fe0700 1 -- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5574138cf0 msgr2=0x7f55740a53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:30.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f5578fe0700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5574138cf0 0x7f55740a53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:30.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f5578fe0700 1 -- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5560004690 msgr2=0x7f55741686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:30.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f5578fe0700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5560004690 0x7f55741686d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:30.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f5578fe0700 1 -- 172.21.15.1:0/1990271194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55740a7290 con 0x7f55740a58e0 2023-11-15T01:22:30.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f5573fff700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5560004690 0x7f55741686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:30.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f55737fe700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5574138cf0 0x7f55740a53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:30.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f5578fe0700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55740a58e0 0x7f55740627b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f55741516a0 tx=0x7f556c0017f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:30.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f556bfff700 1 -- 172.21.15.1:0/1990271194 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c00f970 con 0x7f55740a58e0 2023-11-15T01:22:30.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f556bfff700 1 -- 172.21.15.1:0/1990271194 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556c00fad0 con 0x7f55740a58e0 2023-11-15T01:22:30.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f557aa43700 1 -- 172.21.15.1:0/1990271194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55740a4910 con 0x7f55740a58e0 2023-11-15T01:22:30.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f556bfff700 1 -- 172.21.15.1:0/1990271194 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c00fe70 con 0x7f55740a58e0 2023-11-15T01:22:30.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.440+0000 7f557aa43700 1 -- 172.21.15.1:0/1990271194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55740adbb0 con 0x7f55740a58e0 2023-11-15T01:22:30.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.441+0000 7f557aa43700 1 -- 172.21.15.1:0/1990271194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55740a4db0 con 0x7f55740a58e0 2023-11-15T01:22:30.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.441+0000 7f556bfff700 1 -- 172.21.15.1:0/1990271194 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f556c012560 con 0x7f55740a58e0 2023-11-15T01:22:30.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.442+0000 7f556bfff700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f555405f150 0x7f5554061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:30.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.442+0000 7f556bfff700 1 -- 172.21.15.1:0/1990271194 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f556c079f00 con 0x7f55740a58e0 2023-11-15T01:22:30.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.442+0000 7f5573fff700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f555405f150 0x7f5554061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:30.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.442+0000 7f5573fff700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f555405f150 0x7f5554061610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f555c006d80 tx=0x7f555c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:30.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.446+0000 7f556bfff700 1 -- 172.21.15.1:0/1990271194 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f556c04b170 con 0x7f55740a58e0 2023-11-15T01:22:30.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:30.664+0000 7f557aa43700 1 -- 172.21.15.1:0/1990271194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f557406c7e0 con 0x7f55740a58e0 2023-11-15T01:22:31.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.259+0000 7f556bfff700 1 -- 172.21.15.1:0/1990271194 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 5) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f556c077cd0 con 0x7f55740a58e0 2023-11-15T01:22:31.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.260+0000 7f556bfff700 1 -- 172.21.15.1:0/1990271194 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v5) v1 ==== 92+0+0 (secure 0 0 0) 0x7f556c072a70 con 0x7f55740a58e0 2023-11-15T01:22:31.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.262+0000 7f557aa43700 1 -- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f555405f150 msgr2=0x7f5554061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:31.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.262+0000 7f557aa43700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f555405f150 0x7f5554061610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f555c006d80 tx=0x7f555c008040).stop 2023-11-15T01:22:31.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.262+0000 7f557aa43700 1 -- 172.21.15.1:0/1990271194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55740a58e0 msgr2=0x7f55740627b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:31.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.262+0000 7f557aa43700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55740a58e0 0x7f55740627b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f55741516a0 tx=0x7f556c0017f0).stop 2023-11-15T01:22:31.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.262+0000 7f557aa43700 1 -- 172.21.15.1:0/1990271194 shutdown_connections 2023-11-15T01:22:31.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.262+0000 7f557aa43700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f555405f150 0x7f5554061610 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.262+0000 7f557aa43700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55740a58e0 0x7f55740627b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.262+0000 7f557aa43700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5560004690 0x7f55741686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.262+0000 7f557aa43700 1 --2- 172.21.15.1:0/1990271194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5574138cf0 0x7f55740a53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.263+0000 7f557aa43700 1 -- 172.21.15.1:0/1990271194 >> 172.21.15.1:0/1990271194 conn(0x7f55740c7dc0 msgr2=0x7f55740c2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:31.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.263+0000 7f557aa43700 1 -- 172.21.15.1:0/1990271194 shutdown_connections 2023-11-15T01:22:31.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.263+0000 7f557aa43700 1 -- 172.21.15.1:0/1990271194 wait complete. 2023-11-15T01:22:31.278 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-15T01:22:31.405 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:31.404+0000 7f8f3f336680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:22:31.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.404+0000 7f77edafd700 1 Processor -- start 2023-11-15T01:22:31.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.404+0000 7f77edafd700 1 -- start start 2023-11-15T01:22:31.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.404+0000 7f77edafd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f77e81540a0 0x7f77e80ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:31.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.404+0000 7f77edafd700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f77e80c6650 0x7f77e80ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:31.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.404+0000 7f77edafd700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e80ca050 con 0x7f77e8154480 2023-11-15T01:22:31.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.405+0000 7f77edafd700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e80c9440 con 0x7f77e81540a0 2023-11-15T01:22:31.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.405+0000 7f77edafd700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e80c9720 con 0x7f77e80c6650 2023-11-15T01:22:31.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.405+0000 7f77e77fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f77e81540a0 0x7f77e80ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:31.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.405+0000 7f77e77fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f77e81540a0 0x7f77e80ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54878/0 (socket says 172.21.15.1:54878) 2023-11-15T01:22:31.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.405+0000 7f77e77fe700 1 -- 172.21.15.1:0/2361980293 learned_addr learned my addr 172.21.15.1:0/2361980293 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:31.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.405+0000 7f77e7fff700 1 --2- 172.21.15.1:0/2361980293 >> v2:172.21.15.141:3300/0 conn(0x7f77e80c6650 0x7f77e80ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:31.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.405+0000 7f77e77fe700 1 -- 172.21.15.1:0/2361980293 >> v2:172.21.15.141:3300/0 conn(0x7f77e80c6650 msgr2=0x7f77e80ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:31.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.405+0000 7f77e77fe700 1 --2- 172.21.15.1:0/2361980293 >> v2:172.21.15.141:3300/0 conn(0x7f77e80c6650 0x7f77e80ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.405+0000 7f77e77fe700 1 -- 172.21.15.1:0/2361980293 >> v1:172.21.15.141:6789/0 conn(0x7f77e8154480 legacy=0x7f77e80c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:31.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.405+0000 7f77e77fe700 1 -- 172.21.15.1:0/2361980293 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e80c9a00 con 0x7f77e81540a0 2023-11-15T01:22:31.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.405+0000 7f77e77fe700 1 --2- 172.21.15.1:0/2361980293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e81540a0 0x7f77e80ca4e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f77e8084220 tx=0x7f77d80090f0).ready entity=mon.0 client_cookie=c4b9749ec44c2b98 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:31.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.405+0000 7f77e6ffd700 1 -- 172.21.15.1:0/2361980293 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d800b520 con 0x7f77e81540a0 2023-11-15T01:22:31.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.405+0000 7f77e6ffd700 1 -- 172.21.15.1:0/2361980293 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d800b680 con 0x7f77e81540a0 2023-11-15T01:22:31.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.405+0000 7f77e6ffd700 1 -- 172.21.15.1:0/2361980293 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d800ba00 con 0x7f77e81540a0 2023-11-15T01:22:31.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.406+0000 7f77edafd700 1 -- 172.21.15.1:0/2361980293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e81540a0 msgr2=0x7f77e80ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:31.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.406+0000 7f77edafd700 1 --2- 172.21.15.1:0/2361980293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e81540a0 0x7f77e80ca4e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f77e8084220 tx=0x7f77d80090f0).stop 2023-11-15T01:22:31.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.406+0000 7f77edafd700 1 -- 172.21.15.1:0/2361980293 shutdown_connections 2023-11-15T01:22:31.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.406+0000 7f77edafd700 1 --2- 172.21.15.1:0/2361980293 >> v2:172.21.15.141:3300/0 conn(0x7f77e80c6650 0x7f77e80ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.406+0000 7f77edafd700 1 --2- 172.21.15.1:0/2361980293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e81540a0 0x7f77e80ca4e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.406+0000 7f77edafd700 1 -- 172.21.15.1:0/2361980293 >> 172.21.15.1:0/2361980293 conn(0x7f77e8064a70 msgr2=0x7f77e8064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:31.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.406+0000 7f77edafd700 1 -- 172.21.15.1:0/2361980293 shutdown_connections 2023-11-15T01:22:31.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.406+0000 7f77edafd700 1 -- 172.21.15.1:0/2361980293 wait complete. 2023-11-15T01:22:31.413 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:31.406+0000 7f10b0156680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:22:31.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.407+0000 7f77edafd700 1 Processor -- start 2023-11-15T01:22:31.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.407+0000 7f77edafd700 1 -- start start 2023-11-15T01:22:31.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.408+0000 7f77edafd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77e80c6650 0x7f77e8158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:31.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.408+0000 7f77edafd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77e81540a0 0x7f77e81591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:31.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.408+0000 7f77edafd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8154480 0x7f77e80ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:31.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.408+0000 7f77edafd700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e8158df0 con 0x7f77e8154480 2023-11-15T01:22:31.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.408+0000 7f77edafd700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e8159e30 con 0x7f77e80c6650 2023-11-15T01:22:31.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.408+0000 7f77edafd700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e8157e80 con 0x7f77e81540a0 2023-11-15T01:22:31.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.408+0000 7f77e7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8154480 0x7f77e80ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:31.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.408+0000 7f77e77fe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77e80c6650 0x7f77e8158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:31.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.408+0000 7f77deffd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77e81540a0 0x7f77e81591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:31.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.408+0000 7f77e7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8154480 0x7f77e80ab180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54892/0 (socket says 172.21.15.1:54892) 2023-11-15T01:22:31.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.408+0000 7f77e7fff700 1 -- 172.21.15.1:0/1572193139 learned_addr learned my addr 172.21.15.1:0/1572193139 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:31.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.408+0000 7f77e77fe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77e80c6650 0x7f77e8158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:50300/0 (socket says 172.21.15.1:50300) 2023-11-15T01:22:31.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.409+0000 7f77e7fff700 1 -- 172.21.15.1:0/1572193139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77e81540a0 msgr2=0x7f77e81591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:31.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.409+0000 7f77e7fff700 1 --2- 172.21.15.1:0/1572193139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77e81540a0 0x7f77e81591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.409+0000 7f77e7fff700 1 -- 172.21.15.1:0/1572193139 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77e80c6650 msgr2=0x7f77e8158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:31.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.409+0000 7f77e7fff700 1 --2- 172.21.15.1:0/1572193139 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77e80c6650 0x7f77e8158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.409+0000 7f77e7fff700 1 -- 172.21.15.1:0/1572193139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8009370 con 0x7f77e8154480 2023-11-15T01:22:31.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.409+0000 7f77e77fe700 1 --2- 172.21.15.1:0/1572193139 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77e80c6650 0x7f77e8158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:31.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.409+0000 7f77e7fff700 1 --2- 172.21.15.1:0/1572193139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8154480 0x7f77e80ab180 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f77e0009ec0 tx=0x7f77e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:31.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.409+0000 7f77dffff700 1 -- 172.21.15.1:0/1572193139 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e000cb70 con 0x7f77e8154480 2023-11-15T01:22:31.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.409+0000 7f77dffff700 1 -- 172.21.15.1:0/1572193139 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e000f040 con 0x7f77e8154480 2023-11-15T01:22:31.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.409+0000 7f77dffff700 1 -- 172.21.15.1:0/1572193139 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0013400 con 0x7f77e8154480 2023-11-15T01:22:31.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.409+0000 7f77edafd700 1 -- 172.21.15.1:0/1572193139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e8150310 con 0x7f77e8154480 2023-11-15T01:22:31.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.409+0000 7f77edafd700 1 -- 172.21.15.1:0/1572193139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e8158400 con 0x7f77e8154480 2023-11-15T01:22:31.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.410+0000 7f77edafd700 1 -- 172.21.15.1:0/1572193139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e80c4500 con 0x7f77e8154480 2023-11-15T01:22:31.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.411+0000 7f77dffff700 1 -- 172.21.15.1:0/1572193139 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f77e0013770 con 0x7f77e8154480 2023-11-15T01:22:31.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.411+0000 7f77dffff700 1 --2- 172.21.15.1:0/1572193139 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f77c805f1a0 0x7f77c8061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:31.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.411+0000 7f77dffff700 1 -- 172.21.15.1:0/1572193139 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f77e007aa50 con 0x7f77e8154480 2023-11-15T01:22:31.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.411+0000 7f77e77fe700 1 -- 172.21.15.1:0/1572193139 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f77c805f1a0 msgr2=0x7f77c8061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:22:31.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.411+0000 7f77e77fe700 1 --2- 172.21.15.1:0/1572193139 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f77c805f1a0 0x7f77c8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:22:31.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.415+0000 7f77dffff700 1 -- 172.21.15.1:0/1572193139 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f77e004bd20 con 0x7f77e8154480 2023-11-15T01:22:31.469 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:31.468+0000 7f8f3f336680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:22:31.476 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:31.474+0000 7f10b0156680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:22:31.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.588+0000 7f77edafd700 1 -- 172.21.15.1:0/1572193139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f77e8158590 con 0x7f77e8154480 2023-11-15T01:22:31.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.592+0000 7f77dffff700 1 -- 172.21.15.1:0/1572193139 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v3)=0 v3) v1 ==== 138+0+0 (secure 0 0 0) 0x7f77e004f340 con 0x7f77e8154480 2023-11-15T01:22:31.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.593+0000 7f77edafd700 1 -- 172.21.15.1:0/1572193139 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f77c805f1a0 msgr2=0x7f77c8061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:22:31.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.593+0000 7f77edafd700 1 --2- 172.21.15.1:0/1572193139 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f77c805f1a0 0x7f77c8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:31.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.594+0000 7f77edafd700 1 -- 172.21.15.1:0/1572193139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8154480 msgr2=0x7f77e80ab180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:31.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.594+0000 7f77edafd700 1 --2- 172.21.15.1:0/1572193139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8154480 0x7f77e80ab180 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f77e0009ec0 tx=0x7f77e000b040).stop 2023-11-15T01:22:31.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.594+0000 7f77edafd700 1 -- 172.21.15.1:0/1572193139 shutdown_connections 2023-11-15T01:22:31.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.594+0000 7f77edafd700 1 --2- 172.21.15.1:0/1572193139 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f77c805f1a0 0x7f77c8061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:31.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.594+0000 7f77edafd700 1 --2- 172.21.15.1:0/1572193139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77e8154480 0x7f77e80ab180 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.594+0000 7f77edafd700 1 --2- 172.21.15.1:0/1572193139 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77e80c6650 0x7f77e8158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.594+0000 7f77edafd700 1 --2- 172.21.15.1:0/1572193139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77e81540a0 0x7f77e81591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.594+0000 7f77edafd700 1 -- 172.21.15.1:0/1572193139 >> 172.21.15.1:0/1572193139 conn(0x7f77e8064a70 msgr2=0x7f77e80aca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:31.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.594+0000 7f77edafd700 1 -- 172.21.15.1:0/1572193139 shutdown_connections 2023-11-15T01:22:31.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.594+0000 7f77edafd700 1 -- 172.21.15.1:0/1572193139 wait complete. 2023-11-15T01:22:31.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:22:31.609 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-15T01:22:31.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:22:31.628 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-11-15T01:22:31.685 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-11-15T01:22:31.743 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:31.741+0000 7f8f3f336680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:22:31.768 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:31.767+0000 7f10b0156680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:22:31.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.848+0000 7f873bd01700 1 Processor -- start 2023-11-15T01:22:31.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.849+0000 7f873bd01700 1 -- start start 2023-11-15T01:22:31.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f873bd01700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8734062d50 0x7f87340c5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:31.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f873bd01700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87340c5e20 0x7f873413a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:31.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f873bd01700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873406a610 con 0x7f8734062970 2023-11-15T01:22:31.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f873bd01700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87340c2ae0 con 0x7f8734062d50 2023-11-15T01:22:31.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f873bd01700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8734065790 con 0x7f87340c5e20 2023-11-15T01:22:31.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8739a9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8734062970 0x7f87340c23d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:43954/0 (socket says 172.21.15.1:43954) 2023-11-15T01:22:31.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8739a9d700 1 -- 172.21.15.1:0/3193003910 learned_addr learned my addr 172.21.15.1:0/3193003910 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:31.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f873929c700 1 --2- 172.21.15.1:0/3193003910 >> v2:172.21.15.141:3300/0 conn(0x7f8734062d50 0x7f87340c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:31.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f873a29e700 1 --2- 172.21.15.1:0/3193003910 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87340c5e20 0x7f873413a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:31.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 -- 172.21.15.1:0/3193003910 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180518731 0 0) 0x7f873406a610 con 0x7f8734062970 2023-11-15T01:22:31.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 -- 172.21.15.1:0/3193003910 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87200033f0 con 0x7f8734062970 2023-11-15T01:22:31.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 -- 172.21.15.1:0/3193003910 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 609495055 0 0) 0x7f87200033f0 con 0x7f8734062970 2023-11-15T01:22:31.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 -- 172.21.15.1:0/3193003910 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87340c5e20 msgr2=0x7f873413a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:31.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 --2- 172.21.15.1:0/3193003910 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87340c5e20 0x7f873413a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 -- 172.21.15.1:0/3193003910 >> v2:172.21.15.141:3300/0 conn(0x7f8734062d50 msgr2=0x7f87340c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:31.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 --2- 172.21.15.1:0/3193003910 >> v2:172.21.15.141:3300/0 conn(0x7f8734062d50 0x7f87340c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 -- 172.21.15.1:0/3193003910 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8734065a30 con 0x7f8734062970 2023-11-15T01:22:31.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 -- 172.21.15.1:0/3193003910 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f8730001470 con 0x7f8734062970 2023-11-15T01:22:31.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 -- 172.21.15.1:0/3193003910 >> v1:172.21.15.1:6789/0 conn(0x7f8734062970 legacy=0x7f87340c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:31.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 --2- 172.21.15.1:0/3193003910 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87200038e0 0x7f8720003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:31.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 --2- 172.21.15.1:0/3193003910 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8720004690 0x7f8720004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:31.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 --2- 172.21.15.1:0/3193003910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8720005000 0x7f872000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:31.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 -- 172.21.15.1:0/3193003910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87340c2ae0 con 0x7f8720005000 2023-11-15T01:22:31.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 -- 172.21.15.1:0/3193003910 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8734065790 con 0x7f87200038e0 2023-11-15T01:22:31.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.850+0000 7f8738a9b700 1 -- 172.21.15.1:0/3193003910 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872000bdd0 con 0x7f8720004690 2023-11-15T01:22:31.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.851+0000 7f873929c700 1 --2- 172.21.15.1:0/3193003910 >> v2:172.21.15.141:3300/0 conn(0x7f8734062d50 0x7f87340c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:31.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.851+0000 7f873a29e700 1 --2- 172.21.15.1:0/3193003910 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87340c5e20 0x7f873413a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:31.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.851+0000 7f8739a9d700 1 --2- 172.21.15.1:0/3193003910 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87200038e0 0x7f8720003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:31.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.851+0000 7f873a29e700 1 --2- 172.21.15.1:0/3193003910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8720005000 0x7f872000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:31.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.851+0000 7f873929c700 1 --2- 172.21.15.1:0/3193003910 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8720004690 0x7f8720004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:31.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.851+0000 7f8739a9d700 1 -- 172.21.15.1:0/3193003910 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8720004690 msgr2=0x7f8720004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:31.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.851+0000 7f8739a9d700 1 --2- 172.21.15.1:0/3193003910 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8720004690 0x7f8720004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.851+0000 7f8739a9d700 1 -- 172.21.15.1:0/3193003910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8720005000 msgr2=0x7f872000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:31.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.851+0000 7f8739a9d700 1 --2- 172.21.15.1:0/3193003910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8720005000 0x7f872000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.851+0000 7f8739a9d700 1 -- 172.21.15.1:0/3193003910 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87200033f0 con 0x7f87200038e0 2023-11-15T01:22:31.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.851+0000 7f873a29e700 1 --2- 172.21.15.1:0/3193003910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8720005000 0x7f872000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:31.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.851+0000 7f8739a9d700 1 --2- 172.21.15.1:0/3193003910 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87200038e0 0x7f8720003d00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f873000c210 tx=0x7f87340c6fb0).ready entity=mon.1 client_cookie=ff44d67283a6ae39 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:31.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.851+0000 7f8738a9b700 1 -- 172.21.15.1:0/3193003910 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730007a60 con 0x7f87200038e0 2023-11-15T01:22:31.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.851+0000 7f8738a9b700 1 -- 172.21.15.1:0/3193003910 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873000cae0 con 0x7f87200038e0 2023-11-15T01:22:31.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.851+0000 7f8738a9b700 1 -- 172.21.15.1:0/3193003910 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873000ce60 con 0x7f87200038e0 2023-11-15T01:22:31.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.852+0000 7f873bd01700 1 -- 172.21.15.1:0/3193003910 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87200038e0 msgr2=0x7f8720003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:31.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.852+0000 7f873bd01700 1 --2- 172.21.15.1:0/3193003910 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87200038e0 0x7f8720003d00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f873000c210 tx=0x7f87340c6fb0).stop 2023-11-15T01:22:31.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.852+0000 7f873a29e700 1 -- 172.21.15.1:0/3193003910 reap_dead start 2023-11-15T01:22:31.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.852+0000 7f873bd01700 1 -- 172.21.15.1:0/3193003910 shutdown_connections 2023-11-15T01:22:31.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.852+0000 7f873bd01700 1 -- 172.21.15.1:0/3193003910 >> 172.21.15.1:0/3193003910 conn(0x7f87340c7dd0 msgr2=0x7f87340c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:31.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.852+0000 7f873bd01700 1 -- 172.21.15.1:0/3193003910 shutdown_connections 2023-11-15T01:22:31.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.852+0000 7f873bd01700 1 -- 172.21.15.1:0/3193003910 wait complete. 2023-11-15T01:22:31.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.853+0000 7f873bd01700 1 Processor -- start 2023-11-15T01:22:31.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.853+0000 7f873bd01700 1 -- start start 2023-11-15T01:22:31.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.854+0000 7f873bd01700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87200038e0 0x7f873414d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:31.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.854+0000 7f873bd01700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87340c2c60 0x7f87340c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:31.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.854+0000 7f873bd01700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8734164b80 0x7f8734164fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:31.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.854+0000 7f873bd01700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873414d710 con 0x7f8734164b80 2023-11-15T01:22:31.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.854+0000 7f873bd01700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87340c30f0 con 0x7f87340c2c60 2023-11-15T01:22:31.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.854+0000 7f873bd01700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87340c33d0 con 0x7f87200038e0 2023-11-15T01:22:31.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.854+0000 7f873a29e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8734164b80 0x7f8734164fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:31.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.854+0000 7f8739a9d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87200038e0 0x7f873414d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:31.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.854+0000 7f873929c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87340c2c60 0x7f87340c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:31.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.854+0000 7f8739a9d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87200038e0 0x7f873414d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:46444/0 (socket says 172.21.15.1:46444) 2023-11-15T01:22:31.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.854+0000 7f873a29e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8734164b80 0x7f8734164fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54912/0 (socket says 172.21.15.1:54912) 2023-11-15T01:22:31.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.854+0000 7f8739a9d700 1 -- 172.21.15.1:0/1924818847 learned_addr learned my addr 172.21.15.1:0/1924818847 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:31.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.854+0000 7f873929c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87340c2c60 0x7f87340c44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:50336/0 (socket says 172.21.15.1:50336) 2023-11-15T01:22:31.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.855+0000 7f8739a9d700 1 -- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87340c2c60 msgr2=0x7f87340c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:31.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.855+0000 7f8739a9d700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87340c2c60 0x7f87340c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.855+0000 7f8739a9d700 1 -- 172.21.15.1:0/1924818847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8734164b80 msgr2=0x7f8734164fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:31.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.855+0000 7f8739a9d700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8734164b80 0x7f8734164fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:31.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.855+0000 7f8739a9d700 1 -- 172.21.15.1:0/1924818847 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87340c36b0 con 0x7f87200038e0 2023-11-15T01:22:31.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.855+0000 7f873a29e700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8734164b80 0x7f8734164fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:31.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.855+0000 7f8739a9d700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87200038e0 0x7f873414d220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f873000cab0 tx=0x7f8730015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:31.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.855+0000 7f8729ffb700 1 -- 172.21.15.1:0/1924818847 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730001710 con 0x7f87200038e0 2023-11-15T01:22:31.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.855+0000 7f8729ffb700 1 -- 172.21.15.1:0/1924818847 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87300046b0 con 0x7f87200038e0 2023-11-15T01:22:31.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.855+0000 7f873bd01700 1 -- 172.21.15.1:0/1924818847 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87340c3990 con 0x7f87200038e0 2023-11-15T01:22:31.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.855+0000 7f8729ffb700 1 -- 172.21.15.1:0/1924818847 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730004a30 con 0x7f87200038e0 2023-11-15T01:22:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.855+0000 7f873bd01700 1 -- 172.21.15.1:0/1924818847 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87340c49a0 con 0x7f87200038e0 2023-11-15T01:22:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.856+0000 7f873bd01700 1 -- 172.21.15.1:0/1924818847 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8734168300 con 0x7f87200038e0 2023-11-15T01:22:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.856+0000 7f8729ffb700 1 -- 172.21.15.1:0/1924818847 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 5) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f8730020450 con 0x7f87200038e0 2023-11-15T01:22:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.857+0000 7f8729ffb700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 0x7f8718061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.857+0000 7f8729ffb700 1 -- 172.21.15.1:0/1924818847 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f873007b4a0 con 0x7f87200038e0 2023-11-15T01:22:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.857+0000 7f873929c700 1 -- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 msgr2=0x7f8718061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:22:31.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.857+0000 7f873929c700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 0x7f8718061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:22:31.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:31.861+0000 7f8729ffb700 1 -- 172.21.15.1:0/1924818847 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f873004c710 con 0x7f87200038e0 2023-11-15T01:22:32.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:32.058+0000 7f873929c700 1 -- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 msgr2=0x7f8718061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:22:32.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:32.058+0000 7f873929c700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 0x7f8718061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:22:32.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:32.062+0000 7f873bd01700 1 -- 172.21.15.1:0/1924818847 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f87341684b0 con 0x7f871805f1a0 2023-11-15T01:22:32.354 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:32.354+0000 7f8f3f336680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:22:32.426 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:32.425+0000 7f8f3f336680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:22:32.440 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:32.439+0000 7f10b0156680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:22:32.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:32.459+0000 7f873929c700 1 -- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 msgr2=0x7f8718061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:22:32.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:32.459+0000 7f873929c700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 0x7f8718061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-15T01:22:32.509 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:32.507+0000 7f10b0156680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:22:32.611 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:32.610+0000 7f8f3f336680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:22:32.702 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:32.701+0000 7f10b0156680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:22:33.029 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:33.028+0000 7f8f3f336680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:22:33.130 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:33.130+0000 7f8f3f336680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:22:33.141 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:33.139+0000 7f10b0156680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:22:33.249 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:33.248+0000 7f10b0156680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:22:33.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:33.260+0000 7f873929c700 1 -- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 msgr2=0x7f8718061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:22:33.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:33.260+0000 7f873929c700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 0x7f8718061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-15T01:22:33.282 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:33.282+0000 7f8f3f336680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:22:33.357 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:33.356+0000 7f8f3f336680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:22:33.407 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:33.406+0000 7f10b0156680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:22:33.423 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:33.422+0000 7f8f3f336680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:22:33.486 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:33.484+0000 7f10b0156680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:22:33.555 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:33.554+0000 7f10b0156680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:22:33.679 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:33.678+0000 7f8f3f336680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:22:33.828 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:33.827+0000 7f10b0156680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:22:33.863 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:33.862+0000 7f8f3f336680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:22:34.033 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:34.032+0000 7f10b0156680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:22:34.509 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:34.509+0000 7f8f3f336680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:22:34.577 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:34.576+0000 7f8f3f336680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:22:34.652 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:34.651+0000 7f8f3f336680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:22:34.729 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:34.728+0000 7f10b0156680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:22:34.797 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:34.796+0000 7f8f3f336680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:22:34.800 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:34.799+0000 7f10b0156680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:22:34.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:34.861+0000 7f873929c700 1 -- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 msgr2=0x7f8718061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:22:34.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:34.861+0000 7f873929c700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 0x7f8718061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-15T01:22:34.866 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:34.865+0000 7f8f3f336680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:22:34.877 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:34.876+0000 7f10b0156680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:22:34.980 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:34.979+0000 7f8f3f336680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:22:35.029 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:35.027+0000 7f10b0156680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:22:35.086 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:35.086+0000 7f8f3f336680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:22:35.101 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:35.099+0000 7f10b0156680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:22:35.220 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:35.219+0000 7f10b0156680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:22:35.332 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:35.331+0000 7f10b0156680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:22:35.377 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:35.376+0000 7f8f3f336680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:22:35.447 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:35.446+0000 7f8f3f336680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:22:35.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:35.470+0000 7f8729ffb700 1 -- 172.21.15.1:0/1924818847 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mgrmap(e 6) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f8730079270 con 0x7f87200038e0 2023-11-15T01:22:35.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:35.471+0000 7f8729ffb700 1 -- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 msgr2=0x7f8718061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:22:35.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:35.471+0000 7f8729ffb700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 0x7f8718061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:35.534 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:35.533+0000 7f8eb6ac1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:22:35.535 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:35.533+0000 7f8eb6ac1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:22:35.535 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:35.533+0000 7f8eb6ac1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:22:35.535 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:35.533+0000 7f8eb6ac1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:22:35.535 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:35.533+0000 7f8eb6ac1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:22:35.536 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:35.533+0000 7f8eb3abb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:22:35.536 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:35.533+0000 7f8eb3abb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:22:35.536 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:35.533+0000 7f8eb3abb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:22:35.536 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:35.533+0000 7f8eb3abb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:22:35.537 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:22:35.533+0000 7f8eb3abb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:22:35.638 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:35.637+0000 7f10b0156680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:22:35.712 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:22:35.711+0000 7f10b0156680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:22:36.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.468+0000 7f8729ffb700 1 -- 172.21.15.1:0/1924818847 <== mon.2 v2:172.21.15.141:3301/0 8 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f87300795f0 con 0x7f87200038e0 2023-11-15T01:22:36.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.469+0000 7f8729ffb700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 0x7f87180615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:36.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.469+0000 7f8729ffb700 1 -- 172.21.15.1:0/1924818847 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f87341684b0 con 0x7f871805f1a0 2023-11-15T01:22:36.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.469+0000 7f873929c700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 0x7f87180615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:36.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.471+0000 7f873929c700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 0x7f87180615e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f87340c1dd0 tx=0x7f8724009060).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:36.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.499+0000 7f8729ffb700 1 -- 172.21.15.1:0/1924818847 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f87341684b0 con 0x7f871805f1a0 2023-11-15T01:22:36.501 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path /snap_test_dir1/dir0 2023-11-15T01:22:36.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.501+0000 7f873bd01700 1 -- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 msgr2=0x7f87180615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:36.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.501+0000 7f873bd01700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 0x7f87180615e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f87340c1dd0 tx=0x7f8724009060).stop 2023-11-15T01:22:36.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.501+0000 7f873bd01700 1 -- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87200038e0 msgr2=0x7f873414d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:36.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.501+0000 7f873bd01700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87200038e0 0x7f873414d220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f873000cab0 tx=0x7f8730015000).stop 2023-11-15T01:22:36.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.501+0000 7f873bd01700 1 -- 172.21.15.1:0/1924818847 shutdown_connections 2023-11-15T01:22:36.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.501+0000 7f873bd01700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f871805f1a0 0x7f87180615e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:36.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.501+0000 7f873bd01700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8734164b80 0x7f8734164fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:36.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.501+0000 7f873bd01700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87200038e0 0x7f873414d220 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:36.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.501+0000 7f873bd01700 1 --2- 172.21.15.1:0/1924818847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87340c2c60 0x7f87340c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:36.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.501+0000 7f873bd01700 1 -- 172.21.15.1:0/1924818847 >> 172.21.15.1:0/1924818847 conn(0x7f87340c7dd0 msgr2=0x7f8734066410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:36.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.501+0000 7f873bd01700 1 -- 172.21.15.1:0/1924818847 shutdown_connections 2023-11-15T01:22:36.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.501+0000 7f873bd01700 1 -- 172.21.15.1:0/1924818847 wait complete. 2023-11-15T01:22:36.516 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-11-15T01:22:36.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:22:36.516 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-11-15T01:22:36.573 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-11-15T01:22:36.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.735+0000 7fe2092b7700 1 Processor -- start 2023-11-15T01:22:36.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.736+0000 7fe2092b7700 1 -- start start 2023-11-15T01:22:36.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.736+0000 7fe2092b7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2040c53b0 0x7fe2040c3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:36.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.736+0000 7fe2092b7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe204064660 0x7fe204064ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:36.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.736+0000 7fe2092b7700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2040835c0 con 0x7fe2040c7f50 2023-11-15T01:22:36.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.736+0000 7fe2092b7700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2040c3a00 con 0x7fe204064660 2023-11-15T01:22:36.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.736+0000 7fe2092b7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2040c5790 con 0x7fe2040c53b0 2023-11-15T01:22:36.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.737+0000 7fe2037fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe204064660 0x7fe204064ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.737+0000 7fe202ffd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2040c53b0 0x7fe2040c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.737+0000 7fe2027fc700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fe2040c7f50 0x7fe2040c83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:33828/0 (socket says 172.21.15.1:33828) 2023-11-15T01:22:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.737+0000 7fe2027fc700 1 -- 172.21.15.1:0/2572780682 learned_addr learned my addr 172.21.15.1:0/2572780682 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.737+0000 7fe2037fe700 1 -- 172.21.15.1:0/2572780682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2040c53b0 msgr2=0x7fe2040c3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.737+0000 7fe2037fe700 1 --2- 172.21.15.1:0/2572780682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2040c53b0 0x7fe2040c3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:36.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.737+0000 7fe2037fe700 1 -- 172.21.15.1:0/2572780682 >> v1:172.21.15.141:6789/0 conn(0x7fe2040c7f50 legacy=0x7fe2040c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:36.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.737+0000 7fe2037fe700 1 -- 172.21.15.1:0/2572780682 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2040c6eb0 con 0x7fe204064660 2023-11-15T01:22:36.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.737+0000 7fe201ffb700 1 -- 172.21.15.1:0/2572780682 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827986764 0 0) 0x7fe2040835c0 con 0x7fe2040c7f50 2023-11-15T01:22:36.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.737+0000 7fe2037fe700 1 --2- 172.21.15.1:0/2572780682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe204064660 0x7fe204064ad0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fe1f4009e60 tx=0x7fe1f4009780).ready entity=mon.1 client_cookie=746d2f6906d42f05 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:36.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.737+0000 7fe201ffb700 1 -- 172.21.15.1:0/2572780682 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400e070 con 0x7fe204064660 2023-11-15T01:22:36.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.737+0000 7fe201ffb700 1 -- 172.21.15.1:0/2572780682 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f400bbf0 con 0x7fe204064660 2023-11-15T01:22:36.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.737+0000 7fe201ffb700 1 -- 172.21.15.1:0/2572780682 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4012410 con 0x7fe204064660 2023-11-15T01:22:36.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.738+0000 7fe2092b7700 1 -- 172.21.15.1:0/2572780682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe204064660 msgr2=0x7fe204064ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:36.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.738+0000 7fe2092b7700 1 --2- 172.21.15.1:0/2572780682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe204064660 0x7fe204064ad0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fe1f4009e60 tx=0x7fe1f4009780).stop 2023-11-15T01:22:36.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.738+0000 7fe2092b7700 1 -- 172.21.15.1:0/2572780682 shutdown_connections 2023-11-15T01:22:36.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.738+0000 7fe2092b7700 1 --2- 172.21.15.1:0/2572780682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe204064660 0x7fe204064ad0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.738+0000 7fe2092b7700 1 --2- 172.21.15.1:0/2572780682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2040c53b0 0x7fe2040c3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.738+0000 7fe2092b7700 1 -- 172.21.15.1:0/2572780682 >> 172.21.15.1:0/2572780682 conn(0x7fe204082f90 msgr2=0x7fe2040c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.738+0000 7fe2092b7700 1 -- 172.21.15.1:0/2572780682 shutdown_connections 2023-11-15T01:22:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.738+0000 7fe2092b7700 1 -- 172.21.15.1:0/2572780682 wait complete. 2023-11-15T01:22:36.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.739+0000 7fe2092b7700 1 Processor -- start 2023-11-15T01:22:36.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.739+0000 7fe2092b7700 1 -- start start 2023-11-15T01:22:36.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2092b7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe204064660 0x7fe204155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:36.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2092b7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2040c53b0 0x7fe204150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:36.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2092b7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2040c7f50 0x7fe204150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:36.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2092b7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe204155ab0 con 0x7fe2040c7f50 2023-11-15T01:22:36.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2092b7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe204154ea0 con 0x7fe2040c53b0 2023-11-15T01:22:36.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2092b7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe204155180 con 0x7fe204064660 2023-11-15T01:22:36.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2037fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2040c7f50 0x7fe204150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:36.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2037fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2040c7f50 0x7fe204150a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54916/0 (socket says 172.21.15.1:54916) 2023-11-15T01:22:36.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2037fe700 1 -- 172.21.15.1:0/3623161365 learned_addr learned my addr 172.21.15.1:0/3623161365 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:36.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2027fc700 1 --2- 172.21.15.1:0/3623161365 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2040c53b0 0x7fe204150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:36.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe202ffd700 1 --2- 172.21.15.1:0/3623161365 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe204064660 0x7fe204155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:36.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2037fe700 1 -- 172.21.15.1:0/3623161365 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe204064660 msgr2=0x7fe204155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:36.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2037fe700 1 --2- 172.21.15.1:0/3623161365 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe204064660 0x7fe204155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:36.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2037fe700 1 -- 172.21.15.1:0/3623161365 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2040c53b0 msgr2=0x7fe204150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:36.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2037fe700 1 --2- 172.21.15.1:0/3623161365 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2040c53b0 0x7fe204150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:36.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2037fe700 1 -- 172.21.15.1:0/3623161365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f4009a20 con 0x7fe2040c7f50 2023-11-15T01:22:36.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2027fc700 1 --2- 172.21.15.1:0/3623161365 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2040c53b0 0x7fe204150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:36.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.740+0000 7fe2037fe700 1 --2- 172.21.15.1:0/3623161365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2040c7f50 0x7fe204150a80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fe1f400b6c0 tx=0x7fe1f4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:36.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.741+0000 7fe1faffd700 1 -- 172.21.15.1:0/3623161365 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f401d630 con 0x7fe2040c7f50 2023-11-15T01:22:36.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.741+0000 7fe1faffd700 1 -- 172.21.15.1:0/3623161365 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f401d790 con 0x7fe2040c7f50 2023-11-15T01:22:36.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.741+0000 7fe2092b7700 1 -- 172.21.15.1:0/3623161365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe204155460 con 0x7fe2040c7f50 2023-11-15T01:22:36.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.741+0000 7fe1faffd700 1 -- 172.21.15.1:0/3623161365 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f401db50 con 0x7fe2040c7f50 2023-11-15T01:22:36.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.741+0000 7fe2092b7700 1 -- 172.21.15.1:0/3623161365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2040acdc0 con 0x7fe2040c7f50 2023-11-15T01:22:36.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.742+0000 7fe2092b7700 1 -- 172.21.15.1:0/3623161365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe204155c20 con 0x7fe2040c7f50 2023-11-15T01:22:36.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.742+0000 7fe1faffd700 1 -- 172.21.15.1:0/3623161365 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fe1f4003040 con 0x7fe2040c7f50 2023-11-15T01:22:36.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.742+0000 7fe1faffd700 1 --2- 172.21.15.1:0/3623161365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe1e405f080 0x7fe1e4061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:36.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.742+0000 7fe1faffd700 1 -- 172.21.15.1:0/3623161365 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fe1f407be80 con 0x7fe2040c7f50 2023-11-15T01:22:36.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.743+0000 7fe202ffd700 1 --2- 172.21.15.1:0/3623161365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe1e405f080 0x7fe1e4061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:36.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.743+0000 7fe202ffd700 1 --2- 172.21.15.1:0/3623161365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe1e405f080 0x7fe1e4061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe1fc006fd0 tx=0x7fe1fc006f40).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:36.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.747+0000 7fe1faffd700 1 -- 172.21.15.1:0/3623161365 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe1f404d270 con 0x7fe2040c7f50 2023-11-15T01:22:36.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.943+0000 7fe2092b7700 1 -- 172.21.15.1:0/3623161365 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2040c7190 con 0x7fe1e405f080 2023-11-15T01:22:36.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.948+0000 7fe1faffd700 1 -- 172.21.15.1:0/3623161365 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe2040c7190 con 0x7fe1e405f080 2023-11-15T01:22:36.950 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path /snap_test_dir1/dir1 2023-11-15T01:22:36.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.950+0000 7fe2092b7700 1 -- 172.21.15.1:0/3623161365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe1e405f080 msgr2=0x7fe1e4061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:36.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.950+0000 7fe2092b7700 1 --2- 172.21.15.1:0/3623161365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe1e405f080 0x7fe1e4061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe1fc006fd0 tx=0x7fe1fc006f40).stop 2023-11-15T01:22:36.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.950+0000 7fe2092b7700 1 -- 172.21.15.1:0/3623161365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2040c7f50 msgr2=0x7fe204150a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:36.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.950+0000 7fe2092b7700 1 --2- 172.21.15.1:0/3623161365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2040c7f50 0x7fe204150a80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fe1f400b6c0 tx=0x7fe1f4009780).stop 2023-11-15T01:22:36.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.950+0000 7fe2092b7700 1 -- 172.21.15.1:0/3623161365 shutdown_connections 2023-11-15T01:22:36.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.950+0000 7fe2092b7700 1 --2- 172.21.15.1:0/3623161365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe1e405f080 0x7fe1e4061540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:36.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.950+0000 7fe2092b7700 1 --2- 172.21.15.1:0/3623161365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2040c7f50 0x7fe204150a80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:36.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.950+0000 7fe2092b7700 1 --2- 172.21.15.1:0/3623161365 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe204064660 0x7fe204155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:36.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.950+0000 7fe2092b7700 1 --2- 172.21.15.1:0/3623161365 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2040c53b0 0x7fe204150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:36.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.950+0000 7fe2092b7700 1 -- 172.21.15.1:0/3623161365 >> 172.21.15.1:0/3623161365 conn(0x7fe204082f90 msgr2=0x7fe2040bde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:36.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.950+0000 7fe2092b7700 1 -- 172.21.15.1:0/3623161365 shutdown_connections 2023-11-15T01:22:36.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:36.950+0000 7fe2092b7700 1 -- 172.21.15.1:0/3623161365 wait complete. 2023-11-15T01:22:36.963 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-11-15T01:22:36.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:22:36.964 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-11-15T01:22:36.982 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-11-15T01:22:37.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.142+0000 7f53ab66c700 1 Processor -- start 2023-11-15T01:22:37.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.143+0000 7f53ab66c700 1 -- start start 2023-11-15T01:22:37.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.143+0000 7f53ab66c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f53a4157660 0x7f53a4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.143+0000 7f53ab66c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f53a40c1cb0 0x7f53a40c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.143+0000 7f53ab66c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a40c1820 con 0x7f53a40c6770 2023-11-15T01:22:37.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.143+0000 7f53ab66c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a40c7540 con 0x7f53a40c1cb0 2023-11-15T01:22:37.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.144+0000 7f53ab66c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a40c0c30 con 0x7f53a4157660 2023-11-15T01:22:37.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.144+0000 7f53a8c07700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f53a40c1cb0 0x7f53a40c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.144+0000 7f53a9c09700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f53a40c6770 0x7f53a40aa060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:43968/0 (socket says 172.21.15.1:43968) 2023-11-15T01:22:37.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.144+0000 7f53a9c09700 1 -- 172.21.15.1:0/3346182877 learned_addr learned my addr 172.21.15.1:0/3346182877 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:37.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.144+0000 7f53a9408700 1 --2- 172.21.15.1:0/3346182877 >> v2:172.21.15.141:3300/0 conn(0x7f53a4157660 0x7f53a4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.144+0000 7f53a3fff700 1 -- 172.21.15.1:0/3346182877 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069757648 0 0) 0x7f53a40c1820 con 0x7f53a40c6770 2023-11-15T01:22:37.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.144+0000 7f53a3fff700 1 -- 172.21.15.1:0/3346182877 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f538c0033f0 con 0x7f53a40c6770 2023-11-15T01:22:37.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.144+0000 7f53a8c07700 1 -- 172.21.15.1:0/3346182877 >> v2:172.21.15.141:3300/0 conn(0x7f53a4157660 msgr2=0x7f53a4157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:37.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.144+0000 7f53a8c07700 1 --2- 172.21.15.1:0/3346182877 >> v2:172.21.15.141:3300/0 conn(0x7f53a4157660 0x7f53a4157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.144+0000 7f53a8c07700 1 -- 172.21.15.1:0/3346182877 >> v1:172.21.15.1:6789/0 conn(0x7f53a40c6770 legacy=0x7f53a40aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.144+0000 7f53a8c07700 1 -- 172.21.15.1:0/3346182877 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a40c0ef0 con 0x7f53a40c1cb0 2023-11-15T01:22:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.144+0000 7f53a8c07700 1 --2- 172.21.15.1:0/3346182877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a40c1cb0 0x7f53a40c6280 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f53a40cc160 tx=0x7f5398009060).ready entity=mon.0 client_cookie=c1252376d5e53a5c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.144+0000 7f53a3fff700 1 -- 172.21.15.1:0/3346182877 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53980090d0 con 0x7f53a40c1cb0 2023-11-15T01:22:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.144+0000 7f53a3fff700 1 -- 172.21.15.1:0/3346182877 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539800d4a0 con 0x7f53a40c1cb0 2023-11-15T01:22:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.144+0000 7f53a3fff700 1 -- 172.21.15.1:0/3346182877 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539800d820 con 0x7f53a40c1cb0 2023-11-15T01:22:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.145+0000 7f53ab66c700 1 -- 172.21.15.1:0/3346182877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a40c1cb0 msgr2=0x7f53a40c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.145+0000 7f53ab66c700 1 --2- 172.21.15.1:0/3346182877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a40c1cb0 0x7f53a40c6280 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f53a40cc160 tx=0x7f5398009060).stop 2023-11-15T01:22:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.145+0000 7f53ab66c700 1 -- 172.21.15.1:0/3346182877 shutdown_connections 2023-11-15T01:22:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.145+0000 7f53ab66c700 1 --2- 172.21.15.1:0/3346182877 >> v2:172.21.15.141:3300/0 conn(0x7f53a4157660 0x7f53a4157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.145+0000 7f53ab66c700 1 --2- 172.21.15.1:0/3346182877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a40c1cb0 0x7f53a40c6280 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.145+0000 7f53ab66c700 1 -- 172.21.15.1:0/3346182877 >> 172.21.15.1:0/3346182877 conn(0x7f53a4064aa0 msgr2=0x7f53a4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:37.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.145+0000 7f53ab66c700 1 -- 172.21.15.1:0/3346182877 shutdown_connections 2023-11-15T01:22:37.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.145+0000 7f53ab66c700 1 -- 172.21.15.1:0/3346182877 wait complete. 2023-11-15T01:22:37.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.146+0000 7f53ab66c700 1 Processor -- start 2023-11-15T01:22:37.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.146+0000 7f53ab66c700 1 -- start start 2023-11-15T01:22:37.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53ab66c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a40c1cb0 0x7f53a4138c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53ab66c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f53a40c6770 0x7f53a40b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53ab66c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53a4157660 0x7f53a40ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53ab66c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40c2d60 con 0x7f53a40c1cb0 2023-11-15T01:22:37.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53ab66c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40c3040 con 0x7f53a40c6770 2023-11-15T01:22:37.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53ab66c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40c3320 con 0x7f53a4157660 2023-11-15T01:22:37.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53a9408700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a40c1cb0 0x7f53a4138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53a9408700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a40c1cb0 0x7f53a4138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54926/0 (socket says 172.21.15.1:54926) 2023-11-15T01:22:37.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53a9408700 1 -- 172.21.15.1:0/1834478594 learned_addr learned my addr 172.21.15.1:0/1834478594 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:37.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53a8c07700 1 --2- 172.21.15.1:0/1834478594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f53a40c6770 0x7f53a40b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53a9c09700 1 --2- 172.21.15.1:0/1834478594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53a4157660 0x7f53a40ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53a9408700 1 -- 172.21.15.1:0/1834478594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53a4157660 msgr2=0x7f53a40ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53a9408700 1 --2- 172.21.15.1:0/1834478594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53a4157660 0x7f53a40ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53a9408700 1 -- 172.21.15.1:0/1834478594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f53a40c6770 msgr2=0x7f53a40b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53a9408700 1 --2- 172.21.15.1:0/1834478594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f53a40c6770 0x7f53a40b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53a9408700 1 -- 172.21.15.1:0/1834478594 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53980092a0 con 0x7f53a40c1cb0 2023-11-15T01:22:37.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.147+0000 7f53a9408700 1 --2- 172.21.15.1:0/1834478594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a40c1cb0 0x7f53a4138c00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f539c00e900 tx=0x7f539c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:37.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.148+0000 7f53a17fa700 1 -- 172.21.15.1:0/1834478594 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c012600 con 0x7f53a40c1cb0 2023-11-15T01:22:37.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.148+0000 7f53a17fa700 1 -- 172.21.15.1:0/1834478594 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c012760 con 0x7f53a40c1cb0 2023-11-15T01:22:37.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.148+0000 7f53a17fa700 1 -- 172.21.15.1:0/1834478594 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c012ae0 con 0x7f53a40c1cb0 2023-11-15T01:22:37.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.148+0000 7f53ab66c700 1 -- 172.21.15.1:0/1834478594 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a40c3600 con 0x7f53a40c1cb0 2023-11-15T01:22:37.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.148+0000 7f53ab66c700 1 -- 172.21.15.1:0/1834478594 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a41390f0 con 0x7f53a40c1cb0 2023-11-15T01:22:37.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.149+0000 7f53a17fa700 1 -- 172.21.15.1:0/1834478594 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f539c01b400 con 0x7f53a40c1cb0 2023-11-15T01:22:37.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.149+0000 7f53ab66c700 1 -- 172.21.15.1:0/1834478594 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a406c7e0 con 0x7f53a40c1cb0 2023-11-15T01:22:37.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.149+0000 7f53a17fa700 1 --2- 172.21.15.1:0/1834478594 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f539005f080 0x7f5390061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.149+0000 7f53a17fa700 1 -- 172.21.15.1:0/1834478594 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f539c07a370 con 0x7f53a40c1cb0 2023-11-15T01:22:37.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.149+0000 7f53a8c07700 1 --2- 172.21.15.1:0/1834478594 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f539005f080 0x7f5390061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.150+0000 7f53a8c07700 1 --2- 172.21.15.1:0/1834478594 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f539005f080 0x7f5390061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f539800d260 tx=0x7f5398016000).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:37.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.153+0000 7f53a17fa700 1 -- 172.21.15.1:0/1834478594 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f539c04b700 con 0x7f53a40c1cb0 2023-11-15T01:22:37.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.349+0000 7f53ab66c700 1 -- 172.21.15.1:0/1834478594 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f53a40c11d0 con 0x7f539005f080 2023-11-15T01:22:37.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.353+0000 7f53a17fa700 1 -- 172.21.15.1:0/1834478594 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f53a40c11d0 con 0x7f539005f080 2023-11-15T01:22:37.355 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path /snap_test_dir1/dir2 2023-11-15T01:22:37.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.355+0000 7f53ab66c700 1 -- 172.21.15.1:0/1834478594 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f539005f080 msgr2=0x7f5390061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.355+0000 7f53ab66c700 1 --2- 172.21.15.1:0/1834478594 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f539005f080 0x7f5390061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f539800d260 tx=0x7f5398016000).stop 2023-11-15T01:22:37.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.355+0000 7f53ab66c700 1 -- 172.21.15.1:0/1834478594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a40c1cb0 msgr2=0x7f53a4138c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.355+0000 7f53ab66c700 1 --2- 172.21.15.1:0/1834478594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a40c1cb0 0x7f53a4138c00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f539c00e900 tx=0x7f539c009060).stop 2023-11-15T01:22:37.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.355+0000 7f53ab66c700 1 -- 172.21.15.1:0/1834478594 shutdown_connections 2023-11-15T01:22:37.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.355+0000 7f53ab66c700 1 --2- 172.21.15.1:0/1834478594 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f539005f080 0x7f5390061540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.355+0000 7f53ab66c700 1 --2- 172.21.15.1:0/1834478594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53a4157660 0x7f53a40ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.355+0000 7f53ab66c700 1 --2- 172.21.15.1:0/1834478594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53a40c1cb0 0x7f53a4138c00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.355+0000 7f53ab66c700 1 --2- 172.21.15.1:0/1834478594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f53a40c6770 0x7f53a40b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.355+0000 7f53ab66c700 1 -- 172.21.15.1:0/1834478594 >> 172.21.15.1:0/1834478594 conn(0x7f53a4064aa0 msgr2=0x7f53a40c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:37.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.355+0000 7f53ab66c700 1 -- 172.21.15.1:0/1834478594 shutdown_connections 2023-11-15T01:22:37.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.355+0000 7f53ab66c700 1 -- 172.21.15.1:0/1834478594 wait complete. 2023-11-15T01:22:37.368 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-11-15T01:22:37.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:22:37.369 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-11-15T01:22:37.386 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-11-15T01:22:37.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.549+0000 7f29e9b2d700 1 Processor -- start 2023-11-15T01:22:37.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.549+0000 7f29e9b2d700 1 -- start start 2023-11-15T01:22:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.550+0000 7f29e9b2d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f29e414b350 0x7f29e40c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.550+0000 7f29e9b2d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29e414b730 0x7f29e4154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.550+0000 7f29e9b2d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e41580d0 con 0x7f29e40aa040 2023-11-15T01:22:37.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.550+0000 7f29e9b2d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e4155000 con 0x7f29e414b350 2023-11-15T01:22:37.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.550+0000 7f29e9b2d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e41552e0 con 0x7f29e414b730 2023-11-15T01:22:37.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.550+0000 7f29e37fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f29e414b350 0x7f29e40c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.550+0000 7f29e3fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f29e40aa040 0x7f29e4158560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:43974/0 (socket says 172.21.15.1:43974) 2023-11-15T01:22:37.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.550+0000 7f29e3fff700 1 -- 172.21.15.1:0/2036574575 learned_addr learned my addr 172.21.15.1:0/2036574575 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:37.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.550+0000 7f29e2ffd700 1 --2- 172.21.15.1:0/2036574575 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29e414b730 0x7f29e4154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.550+0000 7f29e37fe700 1 -- 172.21.15.1:0/2036574575 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29e414b730 msgr2=0x7f29e4154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:37.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.550+0000 7f29e37fe700 1 --2- 172.21.15.1:0/2036574575 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29e414b730 0x7f29e4154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.550+0000 7f29e37fe700 1 -- 172.21.15.1:0/2036574575 >> v1:172.21.15.1:6789/0 conn(0x7f29e40aa040 legacy=0x7f29e4158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.550+0000 7f29e27fc700 1 -- 172.21.15.1:0/2036574575 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843602107 0 0) 0x7f29e41580d0 con 0x7f29e40aa040 2023-11-15T01:22:37.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.550+0000 7f29e37fe700 1 -- 172.21.15.1:0/2036574575 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e41555c0 con 0x7f29e414b350 2023-11-15T01:22:37.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.551+0000 7f29e37fe700 1 --2- 172.21.15.1:0/2036574575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e414b350 0x7f29e40c8290 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f29d4009760 tx=0x7f29d4009060).ready entity=mon.0 client_cookie=cfbcf7983f55bf83 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:37.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.551+0000 7f29e27fc700 1 -- 172.21.15.1:0/2036574575 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d400b580 con 0x7f29e414b350 2023-11-15T01:22:37.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.551+0000 7f29e27fc700 1 -- 172.21.15.1:0/2036574575 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d400b6e0 con 0x7f29e414b350 2023-11-15T01:22:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.551+0000 7f29e27fc700 1 -- 172.21.15.1:0/2036574575 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d400ba60 con 0x7f29e414b350 2023-11-15T01:22:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.551+0000 7f29e9b2d700 1 -- 172.21.15.1:0/2036574575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e414b350 msgr2=0x7f29e40c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.551+0000 7f29e9b2d700 1 --2- 172.21.15.1:0/2036574575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e414b350 0x7f29e40c8290 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f29d4009760 tx=0x7f29d4009060).stop 2023-11-15T01:22:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.551+0000 7f29e9b2d700 1 -- 172.21.15.1:0/2036574575 shutdown_connections 2023-11-15T01:22:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.551+0000 7f29e9b2d700 1 --2- 172.21.15.1:0/2036574575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e414b350 0x7f29e40c8290 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.551+0000 7f29e9b2d700 1 --2- 172.21.15.1:0/2036574575 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29e414b730 0x7f29e4154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.551+0000 7f29e9b2d700 1 -- 172.21.15.1:0/2036574575 >> 172.21.15.1:0/2036574575 conn(0x7f29e4069ee0 msgr2=0x7f29e406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.551+0000 7f29e9b2d700 1 -- 172.21.15.1:0/2036574575 shutdown_connections 2023-11-15T01:22:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.551+0000 7f29e9b2d700 1 -- 172.21.15.1:0/2036574575 wait complete. 2023-11-15T01:22:37.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.552+0000 7f29e9b2d700 1 Processor -- start 2023-11-15T01:22:37.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.553+0000 7f29e9b2d700 1 -- start start 2023-11-15T01:22:37.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.553+0000 7f29e9b2d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29e40aa040 0x7f29e413fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.553+0000 7f29e9b2d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e414b350 0x7f29e40c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.553+0000 7f29e9b2d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29e414b730 0x7f29e40c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.553+0000 7f29e9b2d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e414dc90 con 0x7f29e414b350 2023-11-15T01:22:37.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.553+0000 7f29e9b2d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e40ae550 con 0x7f29e414b730 2023-11-15T01:22:37.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.553+0000 7f29e9b2d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e414e4f0 con 0x7f29e40aa040 2023-11-15T01:22:37.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.553+0000 7f29e2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e414b350 0x7f29e40c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.553+0000 7f29e2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e414b350 0x7f29e40c2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54934/0 (socket says 172.21.15.1:54934) 2023-11-15T01:22:37.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.553+0000 7f29e2ffd700 1 -- 172.21.15.1:0/3495782559 learned_addr learned my addr 172.21.15.1:0/3495782559 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:37.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.554+0000 7f29e37fe700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29e40aa040 0x7f29e413fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.554+0000 7f29e3fff700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29e414b730 0x7f29e40c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.554+0000 7f29e2ffd700 1 -- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29e40aa040 msgr2=0x7f29e413fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.554+0000 7f29e2ffd700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29e40aa040 0x7f29e413fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.554+0000 7f29e2ffd700 1 -- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29e414b730 msgr2=0x7f29e40c3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.554+0000 7f29e2ffd700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29e414b730 0x7f29e40c3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.554+0000 7f29e2ffd700 1 -- 172.21.15.1:0/3495782559 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40092a0 con 0x7f29e414b350 2023-11-15T01:22:37.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.554+0000 7f29e37fe700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29e40aa040 0x7f29e413fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:37.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.554+0000 7f29e3fff700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29e414b730 0x7f29e40c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:37.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.554+0000 7f29e2ffd700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e414b350 0x7f29e40c2d20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f29d800d8c0 tx=0x7f29d8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:37.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.554+0000 7f29cb7fe700 1 -- 172.21.15.1:0/3495782559 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d80095b0 con 0x7f29e414b350 2023-11-15T01:22:37.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.554+0000 7f29cb7fe700 1 -- 172.21.15.1:0/3495782559 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d8009710 con 0x7f29e414b350 2023-11-15T01:22:37.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.554+0000 7f29e9b2d700 1 -- 172.21.15.1:0/3495782559 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e41400a0 con 0x7f29e414b350 2023-11-15T01:22:37.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.554+0000 7f29cb7fe700 1 -- 172.21.15.1:0/3495782559 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d8009a90 con 0x7f29e414b350 2023-11-15T01:22:37.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.554+0000 7f29e9b2d700 1 -- 172.21.15.1:0/3495782559 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e414d9b0 con 0x7f29e414b350 2023-11-15T01:22:37.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.555+0000 7f29e9b2d700 1 -- 172.21.15.1:0/3495782559 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e406c7e0 con 0x7f29e414b350 2023-11-15T01:22:37.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.555+0000 7f29cb7fe700 1 -- 172.21.15.1:0/3495782559 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f29d8013480 con 0x7f29e414b350 2023-11-15T01:22:37.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.556+0000 7f29cb7fe700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f29d005f080 0x7f29d0061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.556+0000 7f29cb7fe700 1 -- 172.21.15.1:0/3495782559 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f29d807a220 con 0x7f29e414b350 2023-11-15T01:22:37.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.556+0000 7f29e37fe700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f29d005f080 0x7f29d0061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.556+0000 7f29e37fe700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f29d005f080 0x7f29d0061540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f29d400b340 tx=0x7f29d4017000).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:37.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.560+0000 7f29cb7fe700 1 -- 172.21.15.1:0/3495782559 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f29d804b5b0 con 0x7f29e414b350 2023-11-15T01:22:37.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.757+0000 7f29e9b2d700 1 -- 172.21.15.1:0/3495782559 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f29e406abc0 con 0x7f29d005f080 2023-11-15T01:22:37.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.762+0000 7f29cb7fe700 1 -- 172.21.15.1:0/3495782559 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f29e406abc0 con 0x7f29d005f080 2023-11-15T01:22:37.763 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path /snap_test_dir1/dir3 2023-11-15T01:22:37.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.763+0000 7f29e9b2d700 1 -- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f29d005f080 msgr2=0x7f29d0061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.763+0000 7f29e9b2d700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f29d005f080 0x7f29d0061540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f29d400b340 tx=0x7f29d4017000).stop 2023-11-15T01:22:37.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.763+0000 7f29e9b2d700 1 -- 172.21.15.1:0/3495782559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e414b350 msgr2=0x7f29e40c2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.763+0000 7f29e9b2d700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e414b350 0x7f29e40c2d20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f29d800d8c0 tx=0x7f29d8008040).stop 2023-11-15T01:22:37.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.763+0000 7f29e9b2d700 1 -- 172.21.15.1:0/3495782559 shutdown_connections 2023-11-15T01:22:37.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.763+0000 7f29e9b2d700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f29d005f080 0x7f29d0061540 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.763+0000 7f29e9b2d700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29e414b730 0x7f29e40c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.763+0000 7f29e9b2d700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29e40aa040 0x7f29e413fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.763+0000 7f29e9b2d700 1 --2- 172.21.15.1:0/3495782559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e414b350 0x7f29e40c2d20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.763+0000 7f29e9b2d700 1 -- 172.21.15.1:0/3495782559 >> 172.21.15.1:0/3495782559 conn(0x7f29e4069ee0 msgr2=0x7f29e414ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:37.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.763+0000 7f29e9b2d700 1 -- 172.21.15.1:0/3495782559 shutdown_connections 2023-11-15T01:22:37.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.763+0000 7f29e9b2d700 1 -- 172.21.15.1:0/3495782559 wait complete. 2023-11-15T01:22:37.777 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-11-15T01:22:37.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:22:37.778 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-11-15T01:22:37.794 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-11-15T01:22:37.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.955+0000 7fd5012a9700 1 Processor -- start 2023-11-15T01:22:37.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.955+0000 7fd5012a9700 1 -- start start 2023-11-15T01:22:37.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.956+0000 7fd5012a9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4fc157660 0x7fd4fc157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.956+0000 7fd5012a9700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4fc0c1820 con 0x7fd4fc0aa060 2023-11-15T01:22:37.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.956+0000 7fd5012a9700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4fc0c0c30 con 0x7fd4fc0c1cb0 2023-11-15T01:22:37.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.956+0000 7fd5012a9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0c7540 con 0x7fd4fc157660 2023-11-15T01:22:37.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.956+0000 7fd4fb7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd4fc0aa060 0x7fd4fc0ab190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45644/0 (socket says 172.21.15.1:45644) 2023-11-15T01:22:37.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.956+0000 7fd4fb7fe700 1 -- 172.21.15.1:0/1733481062 learned_addr learned my addr 172.21.15.1:0/1733481062 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:37.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4f9ffb700 1 -- 172.21.15.1:0/1733481062 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825085930 0 0) 0x7fd4fc0c1820 con 0x7fd4fc0aa060 2023-11-15T01:22:37.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4f9ffb700 1 -- 172.21.15.1:0/1733481062 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e80033f0 con 0x7fd4fc0aa060 2023-11-15T01:22:37.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4faffd700 1 --2- 172.21.15.1:0/1733481062 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4fc157660 0x7fd4fc157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4f9ffb700 1 -- 172.21.15.1:0/1733481062 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3781435254 0 0) 0x7fd4e80033f0 con 0x7fd4fc0aa060 2023-11-15T01:22:37.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4f9ffb700 1 -- 172.21.15.1:0/1733481062 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4fc157660 msgr2=0x7fd4fc157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:37.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4f9ffb700 1 --2- 172.21.15.1:0/1733481062 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4fc157660 0x7fd4fc157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4f9ffb700 1 -- 172.21.15.1:0/1733481062 >> v1:172.21.15.141:6789/0 conn(0x7fd4fc0c1cb0 legacy=0x7fd4fc0c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4f9ffb700 1 -- 172.21.15.1:0/1733481062 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc0c0ef0 con 0x7fd4fc0aa060 2023-11-15T01:22:37.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4f9ffb700 1 -- 172.21.15.1:0/1733481062 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fd4f4001470 con 0x7fd4fc0aa060 2023-11-15T01:22:37.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4f9ffb700 1 -- 172.21.15.1:0/1733481062 >> v1:172.21.15.1:6789/0 conn(0x7fd4fc0aa060 legacy=0x7fd4fc0ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4f9ffb700 1 --2- 172.21.15.1:0/1733481062 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4e8003910 0x7fd4e8003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4f9ffb700 1 --2- 172.21.15.1:0/1733481062 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4fc157660 0x7fd4e8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4f9ffb700 1 --2- 172.21.15.1:0/1733481062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4e8004b80 0x7fd4e8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4f9ffb700 1 -- 172.21.15.1:0/1733481062 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e800b990 con 0x7fd4e8004b80 2023-11-15T01:22:37.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4f9ffb700 1 -- 172.21.15.1:0/1733481062 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e800bad0 con 0x7fd4e8003910 2023-11-15T01:22:37.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4f9ffb700 1 -- 172.21.15.1:0/1733481062 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e800bc40 con 0x7fd4fc157660 2023-11-15T01:22:37.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4fb7fe700 1 --2- 172.21.15.1:0/1733481062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4e8004b80 0x7fd4e8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4faffd700 1 --2- 172.21.15.1:0/1733481062 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4e8003910 0x7fd4e8003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4fa7fc700 1 --2- 172.21.15.1:0/1733481062 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4fc157660 0x7fd4e8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4fb7fe700 1 -- 172.21.15.1:0/1733481062 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4fc157660 msgr2=0x7fd4e8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:37.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4fb7fe700 1 --2- 172.21.15.1:0/1733481062 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4fc157660 0x7fd4e8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4fb7fe700 1 -- 172.21.15.1:0/1733481062 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4e8003910 msgr2=0x7fd4e8003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:37.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4fb7fe700 1 --2- 172.21.15.1:0/1733481062 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4e8003910 0x7fd4e8003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4fb7fe700 1 -- 172.21.15.1:0/1733481062 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e80033f0 con 0x7fd4e8004b80 2023-11-15T01:22:37.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4fa7fc700 1 --2- 172.21.15.1:0/1733481062 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4fc157660 0x7fd4e8004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:37.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.957+0000 7fd4fb7fe700 1 --2- 172.21.15.1:0/1733481062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4e8004b80 0x7fd4e8005000 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fd4f400c190 tx=0x7fd4f4001e70).ready entity=mon.0 client_cookie=3b2f19e5b5deee7e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:37.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.958+0000 7fd4f9ffb700 1 -- 172.21.15.1:0/1733481062 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4007a40 con 0x7fd4e8004b80 2023-11-15T01:22:37.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.958+0000 7fd4f9ffb700 1 -- 172.21.15.1:0/1733481062 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f400cac0 con 0x7fd4e8004b80 2023-11-15T01:22:37.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.958+0000 7fd4f9ffb700 1 -- 172.21.15.1:0/1733481062 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400ce40 con 0x7fd4e8004b80 2023-11-15T01:22:37.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.958+0000 7fd5012a9700 1 -- 172.21.15.1:0/1733481062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4e8004b80 msgr2=0x7fd4e8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.958+0000 7fd5012a9700 1 --2- 172.21.15.1:0/1733481062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4e8004b80 0x7fd4e8005000 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fd4f400c190 tx=0x7fd4f4001e70).stop 2023-11-15T01:22:37.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.958+0000 7fd4fb7fe700 1 -- 172.21.15.1:0/1733481062 reap_dead start 2023-11-15T01:22:37.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.958+0000 7fd5012a9700 1 -- 172.21.15.1:0/1733481062 shutdown_connections 2023-11-15T01:22:37.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.958+0000 7fd5012a9700 1 -- 172.21.15.1:0/1733481062 >> 172.21.15.1:0/1733481062 conn(0x7fd4fc064aa0 msgr2=0x7fd4fc064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:37.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.958+0000 7fd5012a9700 1 -- 172.21.15.1:0/1733481062 shutdown_connections 2023-11-15T01:22:37.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.958+0000 7fd5012a9700 1 -- 172.21.15.1:0/1733481062 wait complete. 2023-11-15T01:22:37.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.959+0000 7fd5012a9700 1 Processor -- start 2023-11-15T01:22:37.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.960+0000 7fd5012a9700 1 -- start start 2023-11-15T01:22:37.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.960+0000 7fd5012a9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4e8004b80 0x7fd4fc0c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.960+0000 7fd5012a9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4fc0af820 0x7fd4fc0afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.960+0000 7fd5012a9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4fc0b0170 0x7fd4fc0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.960+0000 7fd5012a9700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0b1210 con 0x7fd4e8004b80 2023-11-15T01:22:37.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.960+0000 7fd5012a9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0b0600 con 0x7fd4fc0b0170 2023-11-15T01:22:37.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.960+0000 7fd5012a9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0b08e0 con 0x7fd4fc0af820 2023-11-15T01:22:37.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.960+0000 7fd4faffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4e8004b80 0x7fd4fc0c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.960+0000 7fd4faffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4e8004b80 0x7fd4fc0c4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49886/0 (socket says 172.21.15.1:49886) 2023-11-15T01:22:37.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.960+0000 7fd4faffd700 1 -- 172.21.15.1:0/1703005783 learned_addr learned my addr 172.21.15.1:0/1703005783 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:37.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.960+0000 7fd4fb7fe700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4fc0b0170 0x7fd4fc0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.960+0000 7fd4fa7fc700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4fc0af820 0x7fd4fc0afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.961+0000 7fd4faffd700 1 -- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4fc0af820 msgr2=0x7fd4fc0afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.961+0000 7fd4faffd700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4fc0af820 0x7fd4fc0afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.961+0000 7fd4faffd700 1 -- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4fc0b0170 msgr2=0x7fd4fc0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:37.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.961+0000 7fd4faffd700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4fc0b0170 0x7fd4fc0c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:37.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.961+0000 7fd4faffd700 1 -- 172.21.15.1:0/1703005783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc0b0bc0 con 0x7fd4e8004b80 2023-11-15T01:22:37.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.961+0000 7fd4fb7fe700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4fc0b0170 0x7fd4fc0c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:37.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.961+0000 7fd4fa7fc700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4fc0af820 0x7fd4fc0afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:37.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.961+0000 7fd4faffd700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4e8004b80 0x7fd4fc0c4060 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fd4ec011f00 tx=0x7fd4ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:37.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.961+0000 7fd4f2ffd700 1 -- 172.21.15.1:0/1703005783 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec00e040 con 0x7fd4e8004b80 2023-11-15T01:22:37.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.961+0000 7fd4f2ffd700 1 -- 172.21.15.1:0/1703005783 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec00f040 con 0x7fd4e8004b80 2023-11-15T01:22:37.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.961+0000 7fd5012a9700 1 -- 172.21.15.1:0/1703005783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc0b0ea0 con 0x7fd4e8004b80 2023-11-15T01:22:37.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.961+0000 7fd4f2ffd700 1 -- 172.21.15.1:0/1703005783 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec015450 con 0x7fd4e8004b80 2023-11-15T01:22:37.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.961+0000 7fd5012a9700 1 -- 172.21.15.1:0/1703005783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc0c2990 con 0x7fd4e8004b80 2023-11-15T01:22:37.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.962+0000 7fd5012a9700 1 -- 172.21.15.1:0/1703005783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc06c7e0 con 0x7fd4e8004b80 2023-11-15T01:22:37.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.962+0000 7fd4f2ffd700 1 -- 172.21.15.1:0/1703005783 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fd4ec015880 con 0x7fd4e8004b80 2023-11-15T01:22:37.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.963+0000 7fd4f2ffd700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd4dc05f0b0 0x7fd4dc061570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:37.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.963+0000 7fd4f2ffd700 1 -- 172.21.15.1:0/1703005783 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fd4ec07b120 con 0x7fd4e8004b80 2023-11-15T01:22:37.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.963+0000 7fd4fa7fc700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd4dc05f0b0 0x7fd4dc061570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:37.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.964+0000 7fd4fa7fc700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd4dc05f0b0 0x7fd4dc061570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd4e40010e0 tx=0x7fd4e4009040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:37.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:37.967+0000 7fd4f2ffd700 1 -- 172.21.15.1:0/1703005783 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd4ec04c510 con 0x7fd4e8004b80 2023-11-15T01:22:38.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.164+0000 7fd5012a9700 1 -- 172.21.15.1:0/1703005783 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4fc05f8b0 con 0x7fd4dc05f0b0 2023-11-15T01:22:38.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.169+0000 7fd4f2ffd700 1 -- 172.21.15.1:0/1703005783 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fd4fc05f8b0 con 0x7fd4dc05f0b0 2023-11-15T01:22:38.170 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path /snap_test_dir1/dir4 2023-11-15T01:22:38.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.170+0000 7fd5012a9700 1 -- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd4dc05f0b0 msgr2=0x7fd4dc061570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:38.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.170+0000 7fd5012a9700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd4dc05f0b0 0x7fd4dc061570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd4e40010e0 tx=0x7fd4e4009040).stop 2023-11-15T01:22:38.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.170+0000 7fd5012a9700 1 -- 172.21.15.1:0/1703005783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4e8004b80 msgr2=0x7fd4fc0c4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:38.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.170+0000 7fd5012a9700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4e8004b80 0x7fd4fc0c4060 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fd4ec011f00 tx=0x7fd4ec00b040).stop 2023-11-15T01:22:38.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.170+0000 7fd5012a9700 1 -- 172.21.15.1:0/1703005783 shutdown_connections 2023-11-15T01:22:38.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.170+0000 7fd5012a9700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd4dc05f0b0 0x7fd4dc061570 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.170+0000 7fd5012a9700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4fc0b0170 0x7fd4fc0c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.170+0000 7fd5012a9700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4e8004b80 0x7fd4fc0c4060 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.170+0000 7fd5012a9700 1 --2- 172.21.15.1:0/1703005783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4fc0af820 0x7fd4fc0afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.170+0000 7fd5012a9700 1 -- 172.21.15.1:0/1703005783 >> 172.21.15.1:0/1703005783 conn(0x7fd4fc064aa0 msgr2=0x7fd4fc0ca660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:38.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.171+0000 7fd5012a9700 1 -- 172.21.15.1:0/1703005783 shutdown_connections 2023-11-15T01:22:38.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.171+0000 7fd5012a9700 1 -- 172.21.15.1:0/1703005783 wait complete. 2023-11-15T01:22:38.184 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-11-15T01:22:38.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:22:38.185 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-11-15T01:22:38.201 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-11-15T01:22:38.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.362+0000 7f4be4819700 1 Processor -- start 2023-11-15T01:22:38.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.362+0000 7f4be4819700 1 -- start start 2023-11-15T01:22:38.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.362+0000 7f4be4819700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4be0063b50 0x7f4be00aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:38.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.362+0000 7f4be4819700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4be0155610 0x7f4be015df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:38.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.362+0000 7f4be4819700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be01548f0 con 0x7f4be00ca5d0 2023-11-15T01:22:38.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.362+0000 7f4be4819700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be00aaa50 con 0x7f4be0155610 2023-11-15T01:22:38.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.362+0000 7f4be4819700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be00aa4f0 con 0x7f4be0063b50 2023-11-15T01:22:38.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.363+0000 7f4bdf59e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4be0155610 0x7f4be015df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:38.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.363+0000 7f4bdf59e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4be0155610 0x7f4be015df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49902/0 (socket says 172.21.15.1:49902) 2023-11-15T01:22:38.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.363+0000 7f4bdf59e700 1 -- 172.21.15.1:0/1552075192 learned_addr learned my addr 172.21.15.1:0/1552075192 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:38.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.363+0000 7f4bde59c700 1 --2- 172.21.15.1:0/1552075192 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4be0063b50 0x7f4be00aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:38.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.363+0000 7f4bdf59e700 1 -- 172.21.15.1:0/1552075192 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4be0063b50 msgr2=0x7f4be00aa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:38.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.363+0000 7f4bdf59e700 1 --2- 172.21.15.1:0/1552075192 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4be0063b50 0x7f4be00aa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.363+0000 7f4bdf59e700 1 -- 172.21.15.1:0/1552075192 >> v1:172.21.15.141:6789/0 conn(0x7f4be00ca5d0 legacy=0x7f4be0063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:38.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.363+0000 7f4bdf59e700 1 -- 172.21.15.1:0/1552075192 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be00aa770 con 0x7f4be0155610 2023-11-15T01:22:38.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.363+0000 7f4bde59c700 1 --2- 172.21.15.1:0/1552075192 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4be0063b50 0x7f4be00aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:38.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.363+0000 7f4bdf59e700 1 --2- 172.21.15.1:0/1552075192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4be0155610 0x7f4be015df20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f4bd0009f50 tx=0x7f4bd0009840).ready entity=mon.0 client_cookie=f553797da150248e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:38.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.363+0000 7f4bddd9b700 1 -- 172.21.15.1:0/1552075192 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000e070 con 0x7f4be0155610 2023-11-15T01:22:38.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.363+0000 7f4bddd9b700 1 -- 172.21.15.1:0/1552075192 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd000ba30 con 0x7f4be0155610 2023-11-15T01:22:38.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.363+0000 7f4bddd9b700 1 -- 172.21.15.1:0/1552075192 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000bdb0 con 0x7f4be0155610 2023-11-15T01:22:38.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.364+0000 7f4be4819700 1 -- 172.21.15.1:0/1552075192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4be0155610 msgr2=0x7f4be015df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:38.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.364+0000 7f4be4819700 1 --2- 172.21.15.1:0/1552075192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4be0155610 0x7f4be015df20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f4bd0009f50 tx=0x7f4bd0009840).stop 2023-11-15T01:22:38.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.364+0000 7f4be4819700 1 -- 172.21.15.1:0/1552075192 shutdown_connections 2023-11-15T01:22:38.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.364+0000 7f4be4819700 1 --2- 172.21.15.1:0/1552075192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4be0155610 0x7f4be015df20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.364+0000 7f4be4819700 1 --2- 172.21.15.1:0/1552075192 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4be0063b50 0x7f4be00aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.364+0000 7f4be4819700 1 -- 172.21.15.1:0/1552075192 >> 172.21.15.1:0/1552075192 conn(0x7f4be006a9b0 msgr2=0x7f4be00cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:38.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.364+0000 7f4be4819700 1 -- 172.21.15.1:0/1552075192 shutdown_connections 2023-11-15T01:22:38.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.364+0000 7f4be4819700 1 -- 172.21.15.1:0/1552075192 wait complete. 2023-11-15T01:22:38.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.365+0000 7f4be4819700 1 Processor -- start 2023-11-15T01:22:38.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.365+0000 7f4be4819700 1 -- start start 2023-11-15T01:22:38.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4be4819700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4be0063b50 0x7f4be0150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:38.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4be4819700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4be00ca5d0 0x7f4be0158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:38.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4be4819700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4be0155610 0x7f4be0159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:38.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4be4819700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be0159870 con 0x7f4be0063b50 2023-11-15T01:22:38.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4be4819700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be00ae0b0 con 0x7f4be00ca5d0 2023-11-15T01:22:38.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4be4819700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be00ae390 con 0x7f4be0155610 2023-11-15T01:22:38.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4bded9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4be0063b50 0x7f4be0150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:38.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4bded9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4be0063b50 0x7f4be0150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49904/0 (socket says 172.21.15.1:49904) 2023-11-15T01:22:38.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4bded9d700 1 -- 172.21.15.1:0/2599356121 learned_addr learned my addr 172.21.15.1:0/2599356121 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:38.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4bdf59e700 1 --2- 172.21.15.1:0/2599356121 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4be0155610 0x7f4be0159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:38.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4bde59c700 1 --2- 172.21.15.1:0/2599356121 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4be00ca5d0 0x7f4be0158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:38.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4bded9d700 1 -- 172.21.15.1:0/2599356121 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4be0155610 msgr2=0x7f4be0159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:38.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4bded9d700 1 --2- 172.21.15.1:0/2599356121 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4be0155610 0x7f4be0159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4bded9d700 1 -- 172.21.15.1:0/2599356121 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4be00ca5d0 msgr2=0x7f4be0158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:38.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4bded9d700 1 --2- 172.21.15.1:0/2599356121 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4be00ca5d0 0x7f4be0158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4bded9d700 1 -- 172.21.15.1:0/2599356121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd0009ae0 con 0x7f4be0063b50 2023-11-15T01:22:38.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.366+0000 7f4bded9d700 1 --2- 172.21.15.1:0/2599356121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4be0063b50 0x7f4be0150380 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f4bd800c440 tx=0x7f4bd8007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:38.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.367+0000 7f4bd6ffd700 1 -- 172.21.15.1:0/2599356121 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8012400 con 0x7f4be0063b50 2023-11-15T01:22:38.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.367+0000 7f4bd6ffd700 1 -- 172.21.15.1:0/2599356121 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd8012580 con 0x7f4be0063b50 2023-11-15T01:22:38.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.367+0000 7f4be4819700 1 -- 172.21.15.1:0/2599356121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be00ae670 con 0x7f4be0063b50 2023-11-15T01:22:38.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.367+0000 7f4bd6ffd700 1 -- 172.21.15.1:0/2599356121 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8012940 con 0x7f4be0063b50 2023-11-15T01:22:38.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.367+0000 7f4be4819700 1 -- 172.21.15.1:0/2599356121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be00aec30 con 0x7f4be0063b50 2023-11-15T01:22:38.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.368+0000 7f4be4819700 1 -- 172.21.15.1:0/2599356121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be00475e0 con 0x7f4be0063b50 2023-11-15T01:22:38.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.368+0000 7f4bd6ffd700 1 -- 172.21.15.1:0/2599356121 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f4bd8012d30 con 0x7f4be0063b50 2023-11-15T01:22:38.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.368+0000 7f4bd6ffd700 1 --2- 172.21.15.1:0/2599356121 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4bc005f080 0x7f4bc0061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:38.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.368+0000 7f4bd6ffd700 1 -- 172.21.15.1:0/2599356121 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f4bd80794b0 con 0x7f4be0063b50 2023-11-15T01:22:38.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.369+0000 7f4bde59c700 1 --2- 172.21.15.1:0/2599356121 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4bc005f080 0x7f4bc0061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:38.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.369+0000 7f4bde59c700 1 --2- 172.21.15.1:0/2599356121 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4bc005f080 0x7f4bc0061540 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4be0063920 tx=0x7f4bc8008040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:38.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.373+0000 7f4bd6ffd700 1 -- 172.21.15.1:0/2599356121 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4bd8048af0 con 0x7f4be0063b50 2023-11-15T01:22:38.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.473+0000 7f4bd6ffd700 1 -- 172.21.15.1:0/2599356121 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f4bd80773a0 con 0x7f4be0063b50 2023-11-15T01:22:38.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.573+0000 7f4be4819700 1 -- 172.21.15.1:0/2599356121 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4be0060900 con 0x7f4bc005f080 2023-11-15T01:22:38.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.578+0000 7f4bd6ffd700 1 -- 172.21.15.1:0/2599356121 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f4be0060900 con 0x7f4bc005f080 2023-11-15T01:22:38.580 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path /snap_test_dir1/dir5 2023-11-15T01:22:38.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.580+0000 7f4be4819700 1 -- 172.21.15.1:0/2599356121 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4bc005f080 msgr2=0x7f4bc0061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:38.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.580+0000 7f4be4819700 1 --2- 172.21.15.1:0/2599356121 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4bc005f080 0x7f4bc0061540 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4be0063920 tx=0x7f4bc8008040).stop 2023-11-15T01:22:38.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.580+0000 7f4be4819700 1 -- 172.21.15.1:0/2599356121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4be0063b50 msgr2=0x7f4be0150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:38.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.580+0000 7f4be4819700 1 --2- 172.21.15.1:0/2599356121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4be0063b50 0x7f4be0150380 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f4bd800c440 tx=0x7f4bd8007de0).stop 2023-11-15T01:22:38.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.580+0000 7f4be4819700 1 -- 172.21.15.1:0/2599356121 shutdown_connections 2023-11-15T01:22:38.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.580+0000 7f4be4819700 1 --2- 172.21.15.1:0/2599356121 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4bc005f080 0x7f4bc0061540 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.580+0000 7f4be4819700 1 --2- 172.21.15.1:0/2599356121 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4be0155610 0x7f4be0159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.580+0000 7f4be4819700 1 --2- 172.21.15.1:0/2599356121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4be0063b50 0x7f4be0150380 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.580+0000 7f4be4819700 1 --2- 172.21.15.1:0/2599356121 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4be00ca5d0 0x7f4be0158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.580+0000 7f4be4819700 1 -- 172.21.15.1:0/2599356121 >> 172.21.15.1:0/2599356121 conn(0x7f4be006a9b0 msgr2=0x7f4be0156d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:38.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.580+0000 7f4be4819700 1 -- 172.21.15.1:0/2599356121 shutdown_connections 2023-11-15T01:22:38.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.580+0000 7f4be4819700 1 -- 172.21.15.1:0/2599356121 wait complete. 2023-11-15T01:22:38.593 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-11-15T01:22:38.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:22:38.594 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-11-15T01:22:38.611 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-11-15T01:22:38.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.773+0000 7fbf640c2700 1 Processor -- start 2023-11-15T01:22:38.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.773+0000 7fbf640c2700 1 -- start start 2023-11-15T01:22:38.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf640c2700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbf5c0c6620 0x7fbf5c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:38.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf640c2700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5c0c06f0 con 0x7fbf5c0ab1a0 2023-11-15T01:22:38.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf640c2700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5c0c09d0 con 0x7fbf5c154150 2023-11-15T01:22:38.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf640c2700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf5c158820 con 0x7fbf5c0c6620 2023-11-15T01:22:38.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf6165d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fbf5c0ab1a0 0x7fbf5c0c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45658/0 (socket says 172.21.15.1:45658) 2023-11-15T01:22:38.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf6165d700 1 -- 172.21.15.1:0/560279278 learned_addr learned my addr 172.21.15.1:0/560279278 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf6265f700 1 --2- 172.21.15.1:0/560279278 >> v2:172.21.15.141:3300/0 conn(0x7fbf5c0c6620 0x7fbf5c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf60e5c700 1 -- 172.21.15.1:0/560279278 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426120905 0 0) 0x7fbf5c0c06f0 con 0x7fbf5c0ab1a0 2023-11-15T01:22:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf60e5c700 1 -- 172.21.15.1:0/560279278 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf440033f0 con 0x7fbf5c0ab1a0 2023-11-15T01:22:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf60e5c700 1 -- 172.21.15.1:0/560279278 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 779983948 0 0) 0x7fbf440033f0 con 0x7fbf5c0ab1a0 2023-11-15T01:22:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf60e5c700 1 -- 172.21.15.1:0/560279278 >> v2:172.21.15.141:3300/0 conn(0x7fbf5c0c6620 msgr2=0x7fbf5c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:38.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf60e5c700 1 --2- 172.21.15.1:0/560279278 >> v2:172.21.15.141:3300/0 conn(0x7fbf5c0c6620 0x7fbf5c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf60e5c700 1 -- 172.21.15.1:0/560279278 >> v1:172.21.15.141:6789/0 conn(0x7fbf5c154150 legacy=0x7fbf5c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:38.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf60e5c700 1 -- 172.21.15.1:0/560279278 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c158b00 con 0x7fbf5c0ab1a0 2023-11-15T01:22:38.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf60e5c700 1 -- 172.21.15.1:0/560279278 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fbf50001470 con 0x7fbf5c0ab1a0 2023-11-15T01:22:38.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf60e5c700 1 -- 172.21.15.1:0/560279278 >> v1:172.21.15.1:6789/0 conn(0x7fbf5c0ab1a0 legacy=0x7fbf5c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:38.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf60e5c700 1 --2- 172.21.15.1:0/560279278 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf440038e0 0x7fbf44003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:38.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf60e5c700 1 --2- 172.21.15.1:0/560279278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf44004690 0x7fbf44004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:38.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.774+0000 7fbf60e5c700 1 --2- 172.21.15.1:0/560279278 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf44005000 0x7fbf4400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:38.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf60e5c700 1 -- 172.21.15.1:0/560279278 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c158820 con 0x7fbf44004690 2023-11-15T01:22:38.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf60e5c700 1 -- 172.21.15.1:0/560279278 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4400bf30 con 0x7fbf440038e0 2023-11-15T01:22:38.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf60e5c700 1 -- 172.21.15.1:0/560279278 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4400c0f0 con 0x7fbf44005000 2023-11-15T01:22:38.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf6165d700 1 --2- 172.21.15.1:0/560279278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf44004690 0x7fbf44004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:38.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf61e5e700 1 --2- 172.21.15.1:0/560279278 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf440038e0 0x7fbf44003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:38.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf6265f700 1 --2- 172.21.15.1:0/560279278 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf44005000 0x7fbf4400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:38.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf6165d700 1 -- 172.21.15.1:0/560279278 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf44005000 msgr2=0x7fbf4400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:38.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf6165d700 1 --2- 172.21.15.1:0/560279278 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf44005000 0x7fbf4400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf6165d700 1 -- 172.21.15.1:0/560279278 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf440038e0 msgr2=0x7fbf44003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:38.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf6165d700 1 --2- 172.21.15.1:0/560279278 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf440038e0 0x7fbf44003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf6165d700 1 -- 172.21.15.1:0/560279278 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf440033f0 con 0x7fbf44004690 2023-11-15T01:22:38.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf6265f700 1 --2- 172.21.15.1:0/560279278 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf44005000 0x7fbf4400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:38.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf6265f700 1 -- 172.21.15.1:0/560279278 reap_dead start 2023-11-15T01:22:38.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf6165d700 1 --2- 172.21.15.1:0/560279278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf44004690 0x7fbf44004b10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fbf5000c110 tx=0x7fbf5c0c0940).ready entity=mon.0 client_cookie=8fb8082d3763c2f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:38.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf60e5c700 1 -- 172.21.15.1:0/560279278 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf500079b0 con 0x7fbf44004690 2023-11-15T01:22:38.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf60e5c700 1 -- 172.21.15.1:0/560279278 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5000ca40 con 0x7fbf44004690 2023-11-15T01:22:38.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.775+0000 7fbf60e5c700 1 -- 172.21.15.1:0/560279278 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5000cde0 con 0x7fbf44004690 2023-11-15T01:22:38.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.776+0000 7fbf640c2700 1 -- 172.21.15.1:0/560279278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf44004690 msgr2=0x7fbf44004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:38.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.776+0000 7fbf640c2700 1 --2- 172.21.15.1:0/560279278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf44004690 0x7fbf44004b10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fbf5000c110 tx=0x7fbf5c0c0940).stop 2023-11-15T01:22:38.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.776+0000 7fbf640c2700 1 -- 172.21.15.1:0/560279278 shutdown_connections 2023-11-15T01:22:38.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.776+0000 7fbf640c2700 1 --2- 172.21.15.1:0/560279278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf44004690 0x7fbf44004b10 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.776+0000 7fbf640c2700 1 -- 172.21.15.1:0/560279278 >> 172.21.15.1:0/560279278 conn(0x7fbf5c064aa0 msgr2=0x7fbf5c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:38.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.776+0000 7fbf640c2700 1 -- 172.21.15.1:0/560279278 shutdown_connections 2023-11-15T01:22:38.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.776+0000 7fbf640c2700 1 -- 172.21.15.1:0/560279278 wait complete. 2023-11-15T01:22:38.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.777+0000 7fbf640c2700 1 Processor -- start 2023-11-15T01:22:38.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.777+0000 7fbf640c2700 1 -- start start 2023-11-15T01:22:38.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf640c2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf44004690 0x7fbf5c164940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:38.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf640c2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf5c150550 0x7fbf5c1509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:38.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf640c2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf5c0ab7a0 0x7fbf5c0abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:38.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf640c2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c150ec0 con 0x7fbf44004690 2023-11-15T01:22:38.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf640c2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0ac4d0 con 0x7fbf5c150550 2023-11-15T01:22:38.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf640c2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0ac7b0 con 0x7fbf5c0ab7a0 2023-11-15T01:22:38.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf61e5e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf44004690 0x7fbf5c164940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:38.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf61e5e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf44004690 0x7fbf5c164940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49926/0 (socket says 172.21.15.1:49926) 2023-11-15T01:22:38.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf61e5e700 1 -- 172.21.15.1:0/3375721232 learned_addr learned my addr 172.21.15.1:0/3375721232 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:38.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf6265f700 1 --2- 172.21.15.1:0/3375721232 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf5c0ab7a0 0x7fbf5c0abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:38.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf6165d700 1 --2- 172.21.15.1:0/3375721232 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf5c150550 0x7fbf5c1509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:38.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf61e5e700 1 -- 172.21.15.1:0/3375721232 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf5c0ab7a0 msgr2=0x7fbf5c0abc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:38.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf61e5e700 1 --2- 172.21.15.1:0/3375721232 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf5c0ab7a0 0x7fbf5c0abc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf61e5e700 1 -- 172.21.15.1:0/3375721232 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf5c150550 msgr2=0x7fbf5c1509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:38.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf61e5e700 1 --2- 172.21.15.1:0/3375721232 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf5c150550 0x7fbf5c1509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf61e5e700 1 -- 172.21.15.1:0/3375721232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c0aca90 con 0x7fbf44004690 2023-11-15T01:22:38.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf6165d700 1 --2- 172.21.15.1:0/3375721232 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf5c150550 0x7fbf5c1509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:38.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf61e5e700 1 --2- 172.21.15.1:0/3375721232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf44004690 0x7fbf5c164940 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fbf4c00eb60 tx=0x7fbf4c007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:38.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf59ffb700 1 -- 172.21.15.1:0/3375721232 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c00c780 con 0x7fbf44004690 2023-11-15T01:22:38.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.778+0000 7fbf59ffb700 1 -- 172.21.15.1:0/3375721232 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c00c8e0 con 0x7fbf44004690 2023-11-15T01:22:38.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.779+0000 7fbf59ffb700 1 -- 172.21.15.1:0/3375721232 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c00cc80 con 0x7fbf44004690 2023-11-15T01:22:38.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.779+0000 7fbf640c2700 1 -- 172.21.15.1:0/3375721232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5c0acd70 con 0x7fbf44004690 2023-11-15T01:22:38.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.779+0000 7fbf640c2700 1 -- 172.21.15.1:0/3375721232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5c0ac0f0 con 0x7fbf44004690 2023-11-15T01:22:38.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.780+0000 7fbf640c2700 1 -- 172.21.15.1:0/3375721232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5c06c7e0 con 0x7fbf44004690 2023-11-15T01:22:38.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.780+0000 7fbf59ffb700 1 -- 172.21.15.1:0/3375721232 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7fbf4c01d460 con 0x7fbf44004690 2023-11-15T01:22:38.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.780+0000 7fbf59ffb700 1 --2- 172.21.15.1:0/3375721232 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf4805f350 0x7fbf48061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:38.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.780+0000 7fbf59ffb700 1 -- 172.21.15.1:0/3375721232 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fbf4c07a9e0 con 0x7fbf44004690 2023-11-15T01:22:38.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.780+0000 7fbf6165d700 1 --2- 172.21.15.1:0/3375721232 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf4805f350 0x7fbf48061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:38.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.781+0000 7fbf6165d700 1 --2- 172.21.15.1:0/3375721232 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf4805f350 0x7fbf48061810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fbf50001ed0 tx=0x7fbf50015000).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:38.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.784+0000 7fbf59ffb700 1 -- 172.21.15.1:0/3375721232 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbf4c04b9a0 con 0x7fbf44004690 2023-11-15T01:22:38.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.985+0000 7fbf640c2700 1 -- 172.21.15.1:0/3375721232 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf5c165100 con 0x7fbf4805f350 2023-11-15T01:22:38.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.990+0000 7fbf59ffb700 1 -- 172.21.15.1:0/3375721232 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fbf5c165100 con 0x7fbf4805f350 2023-11-15T01:22:38.991 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path /snap_test_dir1/dir6 2023-11-15T01:22:38.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.991+0000 7fbf640c2700 1 -- 172.21.15.1:0/3375721232 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf4805f350 msgr2=0x7fbf48061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:38.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.991+0000 7fbf640c2700 1 --2- 172.21.15.1:0/3375721232 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf4805f350 0x7fbf48061810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fbf50001ed0 tx=0x7fbf50015000).stop 2023-11-15T01:22:38.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.992+0000 7fbf640c2700 1 -- 172.21.15.1:0/3375721232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf44004690 msgr2=0x7fbf5c164940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:38.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.992+0000 7fbf640c2700 1 --2- 172.21.15.1:0/3375721232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf44004690 0x7fbf5c164940 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fbf4c00eb60 tx=0x7fbf4c007f30).stop 2023-11-15T01:22:38.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.992+0000 7fbf640c2700 1 -- 172.21.15.1:0/3375721232 shutdown_connections 2023-11-15T01:22:38.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.992+0000 7fbf640c2700 1 --2- 172.21.15.1:0/3375721232 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf4805f350 0x7fbf48061810 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.992+0000 7fbf640c2700 1 --2- 172.21.15.1:0/3375721232 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf5c0ab7a0 0x7fbf5c0abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.992+0000 7fbf640c2700 1 --2- 172.21.15.1:0/3375721232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf44004690 0x7fbf5c164940 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.992+0000 7fbf640c2700 1 --2- 172.21.15.1:0/3375721232 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf5c150550 0x7fbf5c1509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:38.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.992+0000 7fbf640c2700 1 -- 172.21.15.1:0/3375721232 >> 172.21.15.1:0/3375721232 conn(0x7fbf5c064aa0 msgr2=0x7fbf5c0c98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:38.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.992+0000 7fbf640c2700 1 -- 172.21.15.1:0/3375721232 shutdown_connections 2023-11-15T01:22:38.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:38.992+0000 7fbf640c2700 1 -- 172.21.15.1:0/3375721232 wait complete. 2023-11-15T01:22:39.005 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-11-15T01:22:39.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:22:39.006 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-11-15T01:22:39.023 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-11-15T01:22:39.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.184+0000 7fe17db86700 1 Processor -- start 2023-11-15T01:22:39.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.184+0000 7fe17db86700 1 -- start start 2023-11-15T01:22:39.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.185+0000 7fe17db86700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe178154150 0x7fe178154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:39.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.185+0000 7fe17db86700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe1780aa060 0x7fe1780c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:39.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.185+0000 7fe17db86700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1780c06f0 con 0x7fe1780ab1a0 2023-11-15T01:22:39.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.185+0000 7fe17db86700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1780c09d0 con 0x7fe1780aa060 2023-11-15T01:22:39.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.185+0000 7fe17db86700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe178158820 con 0x7fe178154150 2023-11-15T01:22:39.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.185+0000 7fe177fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe1780aa060 0x7fe1780c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:39.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.185+0000 7fe177fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe1780aa060 0x7fe1780c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49938/0 (socket says 172.21.15.1:49938) 2023-11-15T01:22:39.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.185+0000 7fe177fff700 1 -- 172.21.15.1:0/2329355582 learned_addr learned my addr 172.21.15.1:0/2329355582 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:39.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.185+0000 7fe1777fe700 1 --2- 172.21.15.1:0/2329355582 >> v2:172.21.15.141:3300/0 conn(0x7fe178154150 0x7fe178154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:39.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.185+0000 7fe177fff700 1 -- 172.21.15.1:0/2329355582 >> v2:172.21.15.141:3300/0 conn(0x7fe178154150 msgr2=0x7fe178154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:39.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.185+0000 7fe177fff700 1 --2- 172.21.15.1:0/2329355582 >> v2:172.21.15.141:3300/0 conn(0x7fe178154150 0x7fe178154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.185+0000 7fe177fff700 1 -- 172.21.15.1:0/2329355582 >> v1:172.21.15.141:6789/0 conn(0x7fe1780ab1a0 legacy=0x7fe178158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:39.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.185+0000 7fe177fff700 1 -- 172.21.15.1:0/2329355582 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178158b00 con 0x7fe1780aa060 2023-11-15T01:22:39.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.185+0000 7fe177fff700 1 --2- 172.21.15.1:0/2329355582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1780aa060 0x7fe1780c5f10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fe17806bfb0 tx=0x7fe170009840).ready entity=mon.0 client_cookie=13188a8413f9eb65 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:39.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.186+0000 7fe1767fc700 1 -- 172.21.15.1:0/2329355582 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17000e070 con 0x7fe1780aa060 2023-11-15T01:22:39.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.186+0000 7fe1767fc700 1 -- 172.21.15.1:0/2329355582 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17000ba20 con 0x7fe1780aa060 2023-11-15T01:22:39.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.186+0000 7fe1767fc700 1 -- 172.21.15.1:0/2329355582 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17000bda0 con 0x7fe1780aa060 2023-11-15T01:22:39.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.186+0000 7fe17db86700 1 -- 172.21.15.1:0/2329355582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1780aa060 msgr2=0x7fe1780c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:39.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.186+0000 7fe17db86700 1 --2- 172.21.15.1:0/2329355582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1780aa060 0x7fe1780c5f10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fe17806bfb0 tx=0x7fe170009840).stop 2023-11-15T01:22:39.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.186+0000 7fe17db86700 1 -- 172.21.15.1:0/2329355582 shutdown_connections 2023-11-15T01:22:39.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.186+0000 7fe17db86700 1 --2- 172.21.15.1:0/2329355582 >> v2:172.21.15.141:3300/0 conn(0x7fe178154150 0x7fe178154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.186+0000 7fe17db86700 1 --2- 172.21.15.1:0/2329355582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1780aa060 0x7fe1780c5f10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.186+0000 7fe17db86700 1 -- 172.21.15.1:0/2329355582 >> 172.21.15.1:0/2329355582 conn(0x7fe178064aa0 msgr2=0x7fe178064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:39.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.186+0000 7fe17db86700 1 -- 172.21.15.1:0/2329355582 shutdown_connections 2023-11-15T01:22:39.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.186+0000 7fe17db86700 1 -- 172.21.15.1:0/2329355582 wait complete. 2023-11-15T01:22:39.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.187+0000 7fe17db86700 1 Processor -- start 2023-11-15T01:22:39.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.187+0000 7fe17db86700 1 -- start start 2023-11-15T01:22:39.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.188+0000 7fe17db86700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1780aa060 0x7fe178149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:39.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.188+0000 7fe17db86700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1780ab1a0 0x7fe17814b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:39.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.188+0000 7fe17db86700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe178154150 0x7fe1781568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:39.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.188+0000 7fe17db86700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17814ab70 con 0x7fe1780ab1a0 2023-11-15T01:22:39.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.188+0000 7fe17db86700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe178155b10 con 0x7fe178154150 2023-11-15T01:22:39.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.188+0000 7fe17db86700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17814a520 con 0x7fe1780aa060 2023-11-15T01:22:39.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.188+0000 7fe176ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1780ab1a0 0x7fe17814b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:39.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.188+0000 7fe176ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1780ab1a0 0x7fe17814b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49946/0 (socket says 172.21.15.1:49946) 2023-11-15T01:22:39.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.188+0000 7fe176ffd700 1 -- 172.21.15.1:0/96815514 learned_addr learned my addr 172.21.15.1:0/96815514 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:39.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.188+0000 7fe177fff700 1 --2- 172.21.15.1:0/96815514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe178154150 0x7fe1781568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:39.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.188+0000 7fe1777fe700 1 --2- 172.21.15.1:0/96815514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1780aa060 0x7fe178149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:39.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.189+0000 7fe176ffd700 1 -- 172.21.15.1:0/96815514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1780aa060 msgr2=0x7fe178149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.189+0000 7fe176ffd700 1 --2- 172.21.15.1:0/96815514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1780aa060 0x7fe178149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.189+0000 7fe176ffd700 1 -- 172.21.15.1:0/96815514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe178154150 msgr2=0x7fe1781568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.189+0000 7fe176ffd700 1 --2- 172.21.15.1:0/96815514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe178154150 0x7fe1781568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.189+0000 7fe176ffd700 1 -- 172.21.15.1:0/96815514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe170009ae0 con 0x7fe1780ab1a0 2023-11-15T01:22:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.189+0000 7fe176ffd700 1 --2- 172.21.15.1:0/96815514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1780ab1a0 0x7fe17814b000 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fe16c00c4c0 tx=0x7fe16c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.189+0000 7fe15f7fe700 1 -- 172.21.15.1:0/96815514 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c007020 con 0x7fe1780ab1a0 2023-11-15T01:22:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.189+0000 7fe15f7fe700 1 -- 172.21.15.1:0/96815514 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c001e90 con 0x7fe1780ab1a0 2023-11-15T01:22:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.189+0000 7fe15f7fe700 1 -- 172.21.15.1:0/96815514 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0073b0 con 0x7fe1780ab1a0 2023-11-15T01:22:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.189+0000 7fe17db86700 1 -- 172.21.15.1:0/96815514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17814a800 con 0x7fe1780ab1a0 2023-11-15T01:22:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.189+0000 7fe17db86700 1 -- 172.21.15.1:0/96815514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17814b4f0 con 0x7fe1780ab1a0 2023-11-15T01:22:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.190+0000 7fe17db86700 1 -- 172.21.15.1:0/96815514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17814a380 con 0x7fe1780ab1a0 2023-11-15T01:22:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.190+0000 7fe15f7fe700 1 -- 172.21.15.1:0/96815514 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7fe16c0068b0 con 0x7fe1780ab1a0 2023-11-15T01:22:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.191+0000 7fe15f7fe700 1 --2- 172.21.15.1:0/96815514 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe16405f350 0x7fe164061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.191+0000 7fe15f7fe700 1 -- 172.21.15.1:0/96815514 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fe16c079fa0 con 0x7fe1780ab1a0 2023-11-15T01:22:39.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.191+0000 7fe1777fe700 1 --2- 172.21.15.1:0/96815514 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe16405f350 0x7fe164061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:39.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.191+0000 7fe1777fe700 1 --2- 172.21.15.1:0/96815514 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe16405f350 0x7fe164061810 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe168006d80 tx=0x7fe168008040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:39.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.195+0000 7fe15f7fe700 1 -- 172.21.15.1:0/96815514 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe17814a380 con 0x7fe1780ab1a0 2023-11-15T01:22:39.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.397+0000 7fe17db86700 1 -- 172.21.15.1:0/96815514 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe17814a380 con 0x7fe16405f350 2023-11-15T01:22:39.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.402+0000 7fe15f7fe700 1 -- 172.21.15.1:0/96815514 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe17814a380 con 0x7fe16405f350 2023-11-15T01:22:39.403 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path /snap_test_dir1/dir7 2023-11-15T01:22:39.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.403+0000 7fe17db86700 1 -- 172.21.15.1:0/96815514 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe16405f350 msgr2=0x7fe164061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:39.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.403+0000 7fe17db86700 1 --2- 172.21.15.1:0/96815514 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe16405f350 0x7fe164061810 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe168006d80 tx=0x7fe168008040).stop 2023-11-15T01:22:39.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.403+0000 7fe17db86700 1 -- 172.21.15.1:0/96815514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1780ab1a0 msgr2=0x7fe17814b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:39.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.403+0000 7fe17db86700 1 --2- 172.21.15.1:0/96815514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1780ab1a0 0x7fe17814b000 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fe16c00c4c0 tx=0x7fe16c007e00).stop 2023-11-15T01:22:39.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.403+0000 7fe17db86700 1 -- 172.21.15.1:0/96815514 shutdown_connections 2023-11-15T01:22:39.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.403+0000 7fe17db86700 1 --2- 172.21.15.1:0/96815514 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe16405f350 0x7fe164061810 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.403+0000 7fe17db86700 1 --2- 172.21.15.1:0/96815514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe178154150 0x7fe1781568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.403+0000 7fe17db86700 1 --2- 172.21.15.1:0/96815514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1780aa060 0x7fe178149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.403+0000 7fe17db86700 1 --2- 172.21.15.1:0/96815514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1780ab1a0 0x7fe17814b000 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.403+0000 7fe17db86700 1 -- 172.21.15.1:0/96815514 >> 172.21.15.1:0/96815514 conn(0x7fe178064aa0 msgr2=0x7fe1780c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.403+0000 7fe17db86700 1 -- 172.21.15.1:0/96815514 shutdown_connections 2023-11-15T01:22:39.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.403+0000 7fe17db86700 1 -- 172.21.15.1:0/96815514 wait complete. 2023-11-15T01:22:39.417 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-11-15T01:22:39.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:22:39.418 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-11-15T01:22:39.435 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-11-15T01:22:39.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.597+0000 7f9259af6700 1 Processor -- start 2023-11-15T01:22:39.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.597+0000 7f9259af6700 1 -- start start 2023-11-15T01:22:39.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9259af6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92540ada30 0x7f92540c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:39.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9259af6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f92540ca400 0x7f92540c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:39.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9259af6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f92540c65b0 0x7f9254063510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:39.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9259af6700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9254154850 con 0x7f92540ca400 2023-11-15T01:22:39.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9259af6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92540caee0 con 0x7f92540c65b0 2023-11-15T01:22:39.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9259af6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92540ca920 con 0x7f92540ada30 2023-11-15T01:22:39.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9253fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f92540ca400 0x7f92540c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:39.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9253fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f92540ca400 0x7f92540c60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49952/0 (socket says 172.21.15.1:49952) 2023-11-15T01:22:39.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9253fff700 1 -- 172.21.15.1:0/3389095257 learned_addr learned my addr 172.21.15.1:0/3389095257 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:39.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f92592f5700 1 --2- 172.21.15.1:0/3389095257 >> v2:172.21.15.141:3300/0 conn(0x7f92540c65b0 0x7f9254063510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:39.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9258af4700 1 --2- 172.21.15.1:0/3389095257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92540ada30 0x7f92540c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:39.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9253fff700 1 -- 172.21.15.1:0/3389095257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92540ada30 msgr2=0x7f92540c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:39.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9253fff700 1 --2- 172.21.15.1:0/3389095257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92540ada30 0x7f92540c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9253fff700 1 -- 172.21.15.1:0/3389095257 >> v2:172.21.15.141:3300/0 conn(0x7f92540c65b0 msgr2=0x7f9254063510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:39.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9253fff700 1 --2- 172.21.15.1:0/3389095257 >> v2:172.21.15.141:3300/0 conn(0x7f92540c65b0 0x7f9254063510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9253fff700 1 -- 172.21.15.1:0/3389095257 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92540cac00 con 0x7f92540ca400 2023-11-15T01:22:39.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f92592f5700 1 --2- 172.21.15.1:0/3389095257 >> v2:172.21.15.141:3300/0 conn(0x7f92540c65b0 0x7f9254063510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:39.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9258af4700 1 --2- 172.21.15.1:0/3389095257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92540ada30 0x7f92540c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:39.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.598+0000 7f9253fff700 1 --2- 172.21.15.1:0/3389095257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92540ca400 0x7f92540c60c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f925405f210 tx=0x7f92400090f0).ready entity=mon.0 client_cookie=f29792372fa633df server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:39.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.599+0000 7f92537fe700 1 -- 172.21.15.1:0/3389095257 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000b600 con 0x7f92540ca400 2023-11-15T01:22:39.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.599+0000 7f92537fe700 1 -- 172.21.15.1:0/3389095257 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924000b760 con 0x7f92540ca400 2023-11-15T01:22:39.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.599+0000 7f92537fe700 1 -- 172.21.15.1:0/3389095257 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000bae0 con 0x7f92540ca400 2023-11-15T01:22:39.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.599+0000 7f9259af6700 1 -- 172.21.15.1:0/3389095257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92540ca400 msgr2=0x7f92540c60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:39.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.599+0000 7f9259af6700 1 --2- 172.21.15.1:0/3389095257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92540ca400 0x7f92540c60c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f925405f210 tx=0x7f92400090f0).stop 2023-11-15T01:22:39.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.599+0000 7f9259af6700 1 -- 172.21.15.1:0/3389095257 shutdown_connections 2023-11-15T01:22:39.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.599+0000 7f9259af6700 1 --2- 172.21.15.1:0/3389095257 >> v2:172.21.15.141:3300/0 conn(0x7f92540c65b0 0x7f9254063510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.599+0000 7f9259af6700 1 --2- 172.21.15.1:0/3389095257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92540ada30 0x7f92540c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.599+0000 7f9259af6700 1 --2- 172.21.15.1:0/3389095257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92540ca400 0x7f92540c60c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.599+0000 7f9259af6700 1 -- 172.21.15.1:0/3389095257 >> 172.21.15.1:0/3389095257 conn(0x7f9254064a60 msgr2=0x7f9254064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:39.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.599+0000 7f9259af6700 1 -- 172.21.15.1:0/3389095257 shutdown_connections 2023-11-15T01:22:39.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.599+0000 7f9259af6700 1 -- 172.21.15.1:0/3389095257 wait complete. 2023-11-15T01:22:39.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.600+0000 7f9259af6700 1 Processor -- start 2023-11-15T01:22:39.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.600+0000 7f9259af6700 1 -- start start 2023-11-15T01:22:39.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.601+0000 7f9259af6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92540ada30 0x7f92540ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:39.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.601+0000 7f9259af6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92540c65b0 0x7f92541553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:39.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.601+0000 7f9259af6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92540ca400 0x7f92541506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:39.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.601+0000 7f9259af6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92540aeae0 con 0x7f92540ca400 2023-11-15T01:22:39.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.601+0000 7f9259af6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92540c3180 con 0x7f92540c65b0 2023-11-15T01:22:39.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.601+0000 7f9259af6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92540c2570 con 0x7f92540ada30 2023-11-15T01:22:39.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.601+0000 7f92592f5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92540ca400 0x7f92541506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:39.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.601+0000 7f92592f5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92540ca400 0x7f92541506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49964/0 (socket says 172.21.15.1:49964) 2023-11-15T01:22:39.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.601+0000 7f92592f5700 1 -- 172.21.15.1:0/3275897804 learned_addr learned my addr 172.21.15.1:0/3275897804 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:39.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.601+0000 7f9253fff700 1 --2- 172.21.15.1:0/3275897804 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92540c65b0 0x7f92541553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:39.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.601+0000 7f9258af4700 1 --2- 172.21.15.1:0/3275897804 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92540ada30 0x7f92540ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:39.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.602+0000 7f92592f5700 1 -- 172.21.15.1:0/3275897804 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92540ada30 msgr2=0x7f92540ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:39.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.602+0000 7f92592f5700 1 --2- 172.21.15.1:0/3275897804 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92540ada30 0x7f92540ae5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.602+0000 7f92592f5700 1 -- 172.21.15.1:0/3275897804 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92540c65b0 msgr2=0x7f92541553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:39.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.602+0000 7f92592f5700 1 --2- 172.21.15.1:0/3275897804 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92540c65b0 0x7f92541553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.602+0000 7f92592f5700 1 -- 172.21.15.1:0/3275897804 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9240009370 con 0x7f92540ca400 2023-11-15T01:22:39.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.602+0000 7f92592f5700 1 --2- 172.21.15.1:0/3275897804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92540ca400 0x7f92541506b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f924c00a380 tx=0x7f924c007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:39.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.602+0000 7f9250ff9700 1 -- 172.21.15.1:0/3275897804 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c016470 con 0x7f92540ca400 2023-11-15T01:22:39.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.602+0000 7f9250ff9700 1 -- 172.21.15.1:0/3275897804 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c0165d0 con 0x7f92540ca400 2023-11-15T01:22:39.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.602+0000 7f9250ff9700 1 -- 172.21.15.1:0/3275897804 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c016950 con 0x7f92540ca400 2023-11-15T01:22:39.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.602+0000 7f9259af6700 1 -- 172.21.15.1:0/3275897804 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92540c2850 con 0x7f92540ca400 2023-11-15T01:22:39.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.602+0000 7f9259af6700 1 -- 172.21.15.1:0/3275897804 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92540c2e10 con 0x7f92540ca400 2023-11-15T01:22:39.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.603+0000 7f9259af6700 1 -- 172.21.15.1:0/3275897804 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92540475e0 con 0x7f92540ca400 2023-11-15T01:22:39.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.603+0000 7f9250ff9700 1 -- 172.21.15.1:0/3275897804 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f924c013070 con 0x7f92540ca400 2023-11-15T01:22:39.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.604+0000 7f9250ff9700 1 --2- 172.21.15.1:0/3275897804 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f923805f350 0x7f9238061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:39.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.604+0000 7f9250ff9700 1 -- 172.21.15.1:0/3275897804 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f924c07b260 con 0x7f92540ca400 2023-11-15T01:22:39.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.604+0000 7f9258af4700 1 --2- 172.21.15.1:0/3275897804 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f923805f350 0x7f9238061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:39.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.604+0000 7f9258af4700 1 --2- 172.21.15.1:0/3275897804 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f923805f350 0x7f9238061810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f924800abb0 tx=0x7f9248008040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:39.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.608+0000 7f9250ff9700 1 -- 172.21.15.1:0/3275897804 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f924c04c280 con 0x7f92540ca400 2023-11-15T01:22:39.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.806+0000 7f9259af6700 1 -- 172.21.15.1:0/3275897804 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f92540ab240 con 0x7f923805f350 2023-11-15T01:22:39.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.811+0000 7f9250ff9700 1 -- 172.21.15.1:0/3275897804 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f92540ab240 con 0x7f923805f350 2023-11-15T01:22:39.813 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path /snap_test_dir1/dir8 2023-11-15T01:22:39.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.813+0000 7f9259af6700 1 -- 172.21.15.1:0/3275897804 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f923805f350 msgr2=0x7f9238061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:39.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.813+0000 7f9259af6700 1 --2- 172.21.15.1:0/3275897804 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f923805f350 0x7f9238061810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f924800abb0 tx=0x7f9248008040).stop 2023-11-15T01:22:39.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.813+0000 7f9259af6700 1 -- 172.21.15.1:0/3275897804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92540ca400 msgr2=0x7f92541506b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:39.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.813+0000 7f9259af6700 1 --2- 172.21.15.1:0/3275897804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92540ca400 0x7f92541506b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f924c00a380 tx=0x7f924c007900).stop 2023-11-15T01:22:39.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.813+0000 7f9259af6700 1 -- 172.21.15.1:0/3275897804 shutdown_connections 2023-11-15T01:22:39.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.813+0000 7f9259af6700 1 --2- 172.21.15.1:0/3275897804 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f923805f350 0x7f9238061810 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.813+0000 7f9259af6700 1 --2- 172.21.15.1:0/3275897804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92540ca400 0x7f92541506b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.813+0000 7f9259af6700 1 --2- 172.21.15.1:0/3275897804 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92540ada30 0x7f92540ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.813+0000 7f9259af6700 1 --2- 172.21.15.1:0/3275897804 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92540c65b0 0x7f92541553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:39.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.813+0000 7f9259af6700 1 -- 172.21.15.1:0/3275897804 >> 172.21.15.1:0/3275897804 conn(0x7f9254064a60 msgr2=0x7f92540ab940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:39.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.813+0000 7f9259af6700 1 -- 172.21.15.1:0/3275897804 shutdown_connections 2023-11-15T01:22:39.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:39.813+0000 7f9259af6700 1 -- 172.21.15.1:0/3275897804 wait complete. 2023-11-15T01:22:39.826 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-11-15T01:22:39.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:22:39.827 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-11-15T01:22:39.844 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-11-15T01:22:40.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.005+0000 7f4c9e005700 1 Processor -- start 2023-11-15T01:22:40.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.005+0000 7f4c9e005700 1 -- start start 2023-11-15T01:22:40.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.006+0000 7f4c9e005700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c980c60c0 0x7f4c980c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.006+0000 7f4c9e005700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4c980aba40 0x7f4c980abed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.006+0000 7f4c9e005700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c980caee0 con 0x7f4c980ada30 2023-11-15T01:22:40.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.006+0000 7f4c9e005700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c98154850 con 0x7f4c980aba40 2023-11-15T01:22:40.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.006+0000 7f4c9e005700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c980ca920 con 0x7f4c980c60c0 2023-11-15T01:22:40.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.006+0000 7f4c9d804700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4c980aba40 0x7f4c980abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.006+0000 7f4c9d804700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4c980aba40 0x7f4c980abed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49980/0 (socket says 172.21.15.1:49980) 2023-11-15T01:22:40.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.006+0000 7f4c9d804700 1 -- 172.21.15.1:0/4129673790 learned_addr learned my addr 172.21.15.1:0/4129673790 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:40.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.006+0000 7f4c9d003700 1 --1- 172.21.15.1:0/4129673790 >> v1:172.21.15.141:6789/0 conn(0x7f4c980ada30 0x7f4c980c9f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:42016/0 (socket says 172.21.15.1:42016) 2023-11-15T01:22:40.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.006+0000 7f4c9c802700 1 --2- 172.21.15.1:0/4129673790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c980c60c0 0x7f4c980c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.007+0000 7f4c9d804700 1 -- 172.21.15.1:0/4129673790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c980c60c0 msgr2=0x7f4c980c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:40.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.007+0000 7f4c9d804700 1 --2- 172.21.15.1:0/4129673790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c980c60c0 0x7f4c980c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.007+0000 7f4c9d804700 1 -- 172.21.15.1:0/4129673790 >> v1:172.21.15.141:6789/0 conn(0x7f4c980ada30 legacy=0x7f4c980c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.007+0000 7f4c8ffff700 1 -- 172.21.15.1:0/4129673790 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994686481 0 0) 0x7f4c980caee0 con 0x7f4c980ada30 2023-11-15T01:22:40.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.007+0000 7f4c9d804700 1 -- 172.21.15.1:0/4129673790 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c980cac00 con 0x7f4c980aba40 2023-11-15T01:22:40.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.007+0000 7f4c9d804700 1 --2- 172.21.15.1:0/4129673790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c980aba40 0x7f4c980abed0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f4c90009f20 tx=0x7f4c90009840).ready entity=mon.0 client_cookie=1362bb84a07f5756 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:40.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.007+0000 7f4c8ffff700 1 -- 172.21.15.1:0/4129673790 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000e070 con 0x7f4c980aba40 2023-11-15T01:22:40.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.007+0000 7f4c8ffff700 1 -- 172.21.15.1:0/4129673790 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9000b9d0 con 0x7f4c980aba40 2023-11-15T01:22:40.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.007+0000 7f4c8ffff700 1 -- 172.21.15.1:0/4129673790 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000bd50 con 0x7f4c980aba40 2023-11-15T01:22:40.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.008+0000 7f4c9e005700 1 -- 172.21.15.1:0/4129673790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c980aba40 msgr2=0x7f4c980abed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.008+0000 7f4c9e005700 1 --2- 172.21.15.1:0/4129673790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c980aba40 0x7f4c980abed0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f4c90009f20 tx=0x7f4c90009840).stop 2023-11-15T01:22:40.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.008+0000 7f4c9e005700 1 -- 172.21.15.1:0/4129673790 shutdown_connections 2023-11-15T01:22:40.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.008+0000 7f4c9e005700 1 --2- 172.21.15.1:0/4129673790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c980aba40 0x7f4c980abed0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.008+0000 7f4c9e005700 1 --2- 172.21.15.1:0/4129673790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c980c60c0 0x7f4c980c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.008+0000 7f4c9e005700 1 -- 172.21.15.1:0/4129673790 >> 172.21.15.1:0/4129673790 conn(0x7f4c98064a60 msgr2=0x7f4c98064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:40.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.008+0000 7f4c9e005700 1 -- 172.21.15.1:0/4129673790 shutdown_connections 2023-11-15T01:22:40.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.008+0000 7f4c9e005700 1 -- 172.21.15.1:0/4129673790 wait complete. 2023-11-15T01:22:40.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.009+0000 7f4c9e005700 1 Processor -- start 2023-11-15T01:22:40.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.009+0000 7f4c9e005700 1 -- start start 2023-11-15T01:22:40.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9e005700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c980aba40 0x7f4c98164410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9e005700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4c980ada30 0x7f4c9814a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9e005700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c980c60c0 0x7f4c98150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9e005700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c98154990 con 0x7f4c980aba40 2023-11-15T01:22:40.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9e005700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9814b170 con 0x7f4c980ada30 2023-11-15T01:22:40.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9e005700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c98150b60 con 0x7f4c980c60c0 2023-11-15T01:22:40.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9d003700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c980aba40 0x7f4c98164410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9d003700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c980aba40 0x7f4c98164410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49988/0 (socket says 172.21.15.1:49988) 2023-11-15T01:22:40.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9d003700 1 -- 172.21.15.1:0/781891785 learned_addr learned my addr 172.21.15.1:0/781891785 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:40.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9d804700 1 --2- 172.21.15.1:0/781891785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c980c60c0 0x7f4c98150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9c802700 1 --2- 172.21.15.1:0/781891785 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4c980ada30 0x7f4c9814a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9d003700 1 -- 172.21.15.1:0/781891785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c980c60c0 msgr2=0x7f4c98150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9d003700 1 --2- 172.21.15.1:0/781891785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c980c60c0 0x7f4c98150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9d003700 1 -- 172.21.15.1:0/781891785 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4c980ada30 msgr2=0x7f4c9814a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9d003700 1 --2- 172.21.15.1:0/781891785 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4c980ada30 0x7f4c9814a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9d003700 1 -- 172.21.15.1:0/781891785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c90009ae0 con 0x7f4c980aba40 2023-11-15T01:22:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.010+0000 7f4c9d003700 1 --2- 172.21.15.1:0/781891785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c980aba40 0x7f4c98164410 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f4c9400c560 tx=0x7f4c94007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.011+0000 7f4c8d7fa700 1 -- 172.21.15.1:0/781891785 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c940072e0 con 0x7f4c980aba40 2023-11-15T01:22:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.011+0000 7f4c8d7fa700 1 -- 172.21.15.1:0/781891785 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c94007440 con 0x7f4c980aba40 2023-11-15T01:22:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.011+0000 7f4c8d7fa700 1 -- 172.21.15.1:0/781891785 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c940058f0 con 0x7f4c980aba40 2023-11-15T01:22:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.011+0000 7f4c9e005700 1 -- 172.21.15.1:0/781891785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c981649b0 con 0x7f4c980aba40 2023-11-15T01:22:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.011+0000 7f4c9e005700 1 -- 172.21.15.1:0/781891785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c98164f70 con 0x7f4c980aba40 2023-11-15T01:22:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.012+0000 7f4c9e005700 1 -- 172.21.15.1:0/781891785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c980475e0 con 0x7f4c980aba40 2023-11-15T01:22:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.012+0000 7f4c8d7fa700 1 -- 172.21.15.1:0/781891785 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f4c94005ce0 con 0x7f4c980aba40 2023-11-15T01:22:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.012+0000 7f4c8d7fa700 1 --2- 172.21.15.1:0/781891785 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4c7c05f350 0x7f4c7c061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.012+0000 7f4c8d7fa700 1 -- 172.21.15.1:0/781891785 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f4c94079c90 con 0x7f4c980aba40 2023-11-15T01:22:40.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.013+0000 7f4c9c802700 1 --2- 172.21.15.1:0/781891785 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4c7c05f350 0x7f4c7c061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.013+0000 7f4c9c802700 1 --2- 172.21.15.1:0/781891785 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4c7c05f350 0x7f4c7c061810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4c88009b90 tx=0x7f4c88009060).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:40.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.017+0000 7f4c8d7fa700 1 -- 172.21.15.1:0/781891785 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4c9404acb0 con 0x7f4c980aba40 2023-11-15T01:22:40.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.213+0000 7f4c9e005700 1 -- 172.21.15.1:0/781891785 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c980ab240 con 0x7f4c7c05f350 2023-11-15T01:22:40.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.218+0000 7f4c8d7fa700 1 -- 172.21.15.1:0/781891785 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f4c980ab240 con 0x7f4c7c05f350 2023-11-15T01:22:40.219 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path /snap_test_dir1/dir9 2023-11-15T01:22:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.220+0000 7f4c9e005700 1 -- 172.21.15.1:0/781891785 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4c7c05f350 msgr2=0x7f4c7c061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.220+0000 7f4c9e005700 1 --2- 172.21.15.1:0/781891785 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4c7c05f350 0x7f4c7c061810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4c88009b90 tx=0x7f4c88009060).stop 2023-11-15T01:22:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.220+0000 7f4c9e005700 1 -- 172.21.15.1:0/781891785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c980aba40 msgr2=0x7f4c98164410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.220+0000 7f4c9e005700 1 --2- 172.21.15.1:0/781891785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c980aba40 0x7f4c98164410 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f4c9400c560 tx=0x7f4c94007c90).stop 2023-11-15T01:22:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.220+0000 7f4c9e005700 1 -- 172.21.15.1:0/781891785 shutdown_connections 2023-11-15T01:22:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.220+0000 7f4c9e005700 1 --2- 172.21.15.1:0/781891785 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4c7c05f350 0x7f4c7c061810 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.220+0000 7f4c9e005700 1 --2- 172.21.15.1:0/781891785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c980c60c0 0x7f4c98150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.220+0000 7f4c9e005700 1 --2- 172.21.15.1:0/781891785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c980aba40 0x7f4c98164410 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.220+0000 7f4c9e005700 1 --2- 172.21.15.1:0/781891785 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4c980ada30 0x7f4c9814a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.220+0000 7f4c9e005700 1 -- 172.21.15.1:0/781891785 >> 172.21.15.1:0/781891785 conn(0x7f4c98064a60 msgr2=0x7f4c98153b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.220+0000 7f4c9e005700 1 -- 172.21.15.1:0/781891785 shutdown_connections 2023-11-15T01:22:40.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.220+0000 7f4c9e005700 1 -- 172.21.15.1:0/781891785 wait complete. 2023-11-15T01:22:40.233 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-11-15T01:22:40.234 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-11-15T01:22:40.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.355+0000 7f75216ba700 1 Processor -- start 2023-11-15T01:22:40.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.355+0000 7f75216ba700 1 -- start start 2023-11-15T01:22:40.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.356+0000 7f75216ba700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f751c0c3510 0x7f751c0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.356+0000 7f75216ba700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c064660 0x7f751c064ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.356+0000 7f75216ba700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751c0c39a0 con 0x7f751c0c53b0 2023-11-15T01:22:40.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.356+0000 7f75216ba700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751c0835c0 con 0x7f751c0c3510 2023-11-15T01:22:40.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.356+0000 7f75216ba700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0c5790 con 0x7f751c064660 2023-11-15T01:22:40.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.356+0000 7f751affd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f751c0c53b0 0x7f751c0c7f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45670/0 (socket says 172.21.15.1:45670) 2023-11-15T01:22:40.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.356+0000 7f751affd700 1 -- 172.21.15.1:0/688467019 learned_addr learned my addr 172.21.15.1:0/688467019 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:40.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f751a7fc700 1 --2- 172.21.15.1:0/688467019 >> v2:172.21.15.141:3300/0 conn(0x7f751c0c3510 0x7f751c0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f751b7fe700 1 --2- 172.21.15.1:0/688467019 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c064660 0x7f751c064ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 -- 172.21.15.1:0/688467019 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033974386 0 0) 0x7f751c0c39a0 con 0x7f751c0c53b0 2023-11-15T01:22:40.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 -- 172.21.15.1:0/688467019 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75080033f0 con 0x7f751c0c53b0 2023-11-15T01:22:40.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 -- 172.21.15.1:0/688467019 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4624702 0 0) 0x7f75080033f0 con 0x7f751c0c53b0 2023-11-15T01:22:40.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 -- 172.21.15.1:0/688467019 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c064660 msgr2=0x7f751c064ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:40.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 --2- 172.21.15.1:0/688467019 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c064660 0x7f751c064ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 -- 172.21.15.1:0/688467019 >> v2:172.21.15.141:3300/0 conn(0x7f751c0c3510 msgr2=0x7f751c0c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:40.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 --2- 172.21.15.1:0/688467019 >> v2:172.21.15.141:3300/0 conn(0x7f751c0c3510 0x7f751c0c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 -- 172.21.15.1:0/688467019 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c0c6eb0 con 0x7f751c0c53b0 2023-11-15T01:22:40.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 -- 172.21.15.1:0/688467019 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f750c0015f0 con 0x7f751c0c53b0 2023-11-15T01:22:40.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 -- 172.21.15.1:0/688467019 >> v1:172.21.15.1:6789/0 conn(0x7f751c0c53b0 legacy=0x7f751c0c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 --2- 172.21.15.1:0/688467019 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75080038e0 0x7f7508003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 --2- 172.21.15.1:0/688467019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7508004690 0x7f7508004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 --2- 172.21.15.1:0/688467019 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c064660 0x7f7508005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 -- 172.21.15.1:0/688467019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0835c0 con 0x7f7508004690 2023-11-15T01:22:40.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 -- 172.21.15.1:0/688467019 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0c5790 con 0x7f75080038e0 2023-11-15T01:22:40.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f7519ffb700 1 -- 172.21.15.1:0/688467019 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750800b8e0 con 0x7f751c064660 2023-11-15T01:22:40.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f751a7fc700 1 --2- 172.21.15.1:0/688467019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7508004690 0x7f7508004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f751affd700 1 --2- 172.21.15.1:0/688467019 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75080038e0 0x7f7508003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f751b7fe700 1 --2- 172.21.15.1:0/688467019 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c064660 0x7f7508005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f751a7fc700 1 -- 172.21.15.1:0/688467019 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c064660 msgr2=0x7f7508005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:40.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f751a7fc700 1 --2- 172.21.15.1:0/688467019 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c064660 0x7f7508005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f751a7fc700 1 -- 172.21.15.1:0/688467019 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75080038e0 msgr2=0x7f7508003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:40.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f751a7fc700 1 --2- 172.21.15.1:0/688467019 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75080038e0 0x7f7508003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f751a7fc700 1 -- 172.21.15.1:0/688467019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75080033f0 con 0x7f7508004690 2023-11-15T01:22:40.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.357+0000 7f751a7fc700 1 --2- 172.21.15.1:0/688467019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7508004690 0x7f7508004b10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f7504009a80 tx=0x7f7504009060).ready entity=mon.0 client_cookie=12b57bfac6e79c66 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:40.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.358+0000 7f7519ffb700 1 -- 172.21.15.1:0/688467019 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504009430 con 0x7f7508004690 2023-11-15T01:22:40.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.358+0000 7f7519ffb700 1 -- 172.21.15.1:0/688467019 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750400e640 con 0x7f7508004690 2023-11-15T01:22:40.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.358+0000 7f7519ffb700 1 -- 172.21.15.1:0/688467019 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750400e9c0 con 0x7f7508004690 2023-11-15T01:22:40.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.358+0000 7f75216ba700 1 -- 172.21.15.1:0/688467019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7508004690 msgr2=0x7f7508004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.358+0000 7f75216ba700 1 --2- 172.21.15.1:0/688467019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7508004690 0x7f7508004b10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f7504009a80 tx=0x7f7504009060).stop 2023-11-15T01:22:40.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.358+0000 7f751b7fe700 1 -- 172.21.15.1:0/688467019 reap_dead start 2023-11-15T01:22:40.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.358+0000 7f75216ba700 1 -- 172.21.15.1:0/688467019 shutdown_connections 2023-11-15T01:22:40.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.358+0000 7f75216ba700 1 -- 172.21.15.1:0/688467019 >> 172.21.15.1:0/688467019 conn(0x7f751c082f90 msgr2=0x7f751c0c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:40.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.358+0000 7f75216ba700 1 -- 172.21.15.1:0/688467019 shutdown_connections 2023-11-15T01:22:40.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.358+0000 7f75216ba700 1 -- 172.21.15.1:0/688467019 wait complete. 2023-11-15T01:22:40.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.359+0000 7f75216ba700 1 Processor -- start 2023-11-15T01:22:40.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.359+0000 7f75216ba700 1 -- start start 2023-11-15T01:22:40.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.360+0000 7f75216ba700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7508004690 0x7f751c0abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.360+0000 7f75216ba700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c148cf0 0x7f751c0c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.360+0000 7f75216ba700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f751c0c2160 0x7f751c0a94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.360+0000 7f75216ba700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0c0230 con 0x7f7508004690 2023-11-15T01:22:40.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.360+0000 7f75216ba700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0c04d0 con 0x7f751c0c2160 2023-11-15T01:22:40.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.360+0000 7f75216ba700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0c07b0 con 0x7f751c148cf0 2023-11-15T01:22:40.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.360+0000 7f751affd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7508004690 0x7f751c0abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.360+0000 7f751affd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7508004690 0x7f751c0abfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49998/0 (socket says 172.21.15.1:49998) 2023-11-15T01:22:40.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.360+0000 7f751affd700 1 -- 172.21.15.1:0/860046846 learned_addr learned my addr 172.21.15.1:0/860046846 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:40.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.361+0000 7f751affd700 1 -- 172.21.15.1:0/860046846 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c148cf0 msgr2=0x7f751c0c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.361+0000 7f751a7fc700 1 --2- 172.21.15.1:0/860046846 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c148cf0 0x7f751c0c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.361+0000 7f751b7fe700 1 --2- 172.21.15.1:0/860046846 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f751c0c2160 0x7f751c0a94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.361+0000 7f751affd700 1 --2- 172.21.15.1:0/860046846 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c148cf0 0x7f751c0c1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.361+0000 7f751affd700 1 -- 172.21.15.1:0/860046846 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f751c0c2160 msgr2=0x7f751c0a94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.361+0000 7f751affd700 1 --2- 172.21.15.1:0/860046846 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f751c0c2160 0x7f751c0a94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.361+0000 7f751affd700 1 -- 172.21.15.1:0/860046846 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c0c1750 con 0x7f7508004690 2023-11-15T01:22:40.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.361+0000 7f751affd700 1 --2- 172.21.15.1:0/860046846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7508004690 0x7f751c0abfa0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f750c001150 tx=0x7f750c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:40.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.361+0000 7f7512ffd700 1 -- 172.21.15.1:0/860046846 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c0070d0 con 0x7f7508004690 2023-11-15T01:22:40.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.361+0000 7f7512ffd700 1 -- 172.21.15.1:0/860046846 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c007230 con 0x7f7508004690 2023-11-15T01:22:40.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.361+0000 7f75216ba700 1 -- 172.21.15.1:0/860046846 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751c149170 con 0x7f7508004690 2023-11-15T01:22:40.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.361+0000 7f7512ffd700 1 -- 172.21.15.1:0/860046846 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c005880 con 0x7f7508004690 2023-11-15T01:22:40.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.361+0000 7f75216ba700 1 -- 172.21.15.1:0/860046846 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751c0a9b90 con 0x7f7508004690 2023-11-15T01:22:40.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.362+0000 7f75216ba700 1 -- 172.21.15.1:0/860046846 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751c0c2540 con 0x7f7508004690 2023-11-15T01:22:40.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.362+0000 7f7512ffd700 1 -- 172.21.15.1:0/860046846 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f750c005bf0 con 0x7f7508004690 2023-11-15T01:22:40.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.362+0000 7f7512ffd700 1 --2- 172.21.15.1:0/860046846 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f74fc05f350 0x7f74fc061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.363+0000 7f7512ffd700 1 -- 172.21.15.1:0/860046846 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f750c079f90 con 0x7f7508004690 2023-11-15T01:22:40.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.363+0000 7f751a7fc700 1 --2- 172.21.15.1:0/860046846 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f74fc05f350 0x7f74fc061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.363+0000 7f751a7fc700 1 --2- 172.21.15.1:0/860046846 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f74fc05f350 0x7f74fc061810 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f751c0c93d0 tx=0x7f750401a000).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:40.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.367+0000 7f7512ffd700 1 -- 172.21.15.1:0/860046846 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f750c049af0 con 0x7f7508004690 2023-11-15T01:22:40.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.565+0000 7f75216ba700 1 -- 172.21.15.1:0/860046846 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f751c0c1590 con 0x7f74fc05f350 2023-11-15T01:22:40.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.570+0000 7f7512ffd700 1 -- 172.21.15.1:0/860046846 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f751c0c1590 con 0x7f74fc05f350 2023-11-15T01:22:40.572 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-11-15T01:22:40.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.572+0000 7f75216ba700 1 -- 172.21.15.1:0/860046846 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f74fc05f350 msgr2=0x7f74fc061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.572+0000 7f75216ba700 1 --2- 172.21.15.1:0/860046846 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f74fc05f350 0x7f74fc061810 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f751c0c93d0 tx=0x7f750401a000).stop 2023-11-15T01:22:40.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.572+0000 7f75216ba700 1 -- 172.21.15.1:0/860046846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7508004690 msgr2=0x7f751c0abfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.572+0000 7f75216ba700 1 --2- 172.21.15.1:0/860046846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7508004690 0x7f751c0abfa0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f750c001150 tx=0x7f750c009040).stop 2023-11-15T01:22:40.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.572+0000 7f75216ba700 1 -- 172.21.15.1:0/860046846 shutdown_connections 2023-11-15T01:22:40.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.572+0000 7f75216ba700 1 --2- 172.21.15.1:0/860046846 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f74fc05f350 0x7f74fc061810 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.572+0000 7f75216ba700 1 --2- 172.21.15.1:0/860046846 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f751c0c2160 0x7f751c0a94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.572+0000 7f75216ba700 1 --2- 172.21.15.1:0/860046846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7508004690 0x7f751c0abfa0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.572+0000 7f75216ba700 1 --2- 172.21.15.1:0/860046846 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c148cf0 0x7f751c0c1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.572+0000 7f75216ba700 1 -- 172.21.15.1:0/860046846 >> 172.21.15.1:0/860046846 conn(0x7f751c082f90 msgr2=0x7f751c0a7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:40.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.572+0000 7f75216ba700 1 -- 172.21.15.1:0/860046846 shutdown_connections 2023-11-15T01:22:40.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.572+0000 7f75216ba700 1 -- 172.21.15.1:0/860046846 wait complete. 2023-11-15T01:22:40.585 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-11-15T01:22:40.586 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-11-15T01:22:40.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.708+0000 7fb91880d700 1 Processor -- start 2023-11-15T01:22:40.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.708+0000 7fb91880d700 1 -- start start 2023-11-15T01:22:40.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb91880d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb914155610 0x7fb9140aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb91880d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9141548f0 con 0x7fb9140ca5d0 2023-11-15T01:22:40.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb91880d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9140aa4f0 con 0x7fb914063b50 2023-11-15T01:22:40.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb91880d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9140aaa50 con 0x7fb914155610 2023-11-15T01:22:40.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb913fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb914155610 0x7fb9140aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb913fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb914155610 0x7fb9140aa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50006/0 (socket says 172.21.15.1:50006) 2023-11-15T01:22:40.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb9137fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb9140ca5d0 0x7fb914063440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45676/0 (socket says 172.21.15.1:45676) 2023-11-15T01:22:40.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb913fff700 1 -- 172.21.15.1:0/1297952933 learned_addr learned my addr 172.21.15.1:0/1297952933 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:40.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb913fff700 1 -- 172.21.15.1:0/1297952933 >> v1:172.21.15.141:6789/0 conn(0x7fb914063b50 legacy=0x7fb91415bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:40.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb913fff700 1 -- 172.21.15.1:0/1297952933 >> v1:172.21.15.1:6789/0 conn(0x7fb9140ca5d0 legacy=0x7fb914063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb9127fc700 1 -- 172.21.15.1:0/1297952933 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739644696 0 0) 0x7fb904001110 con 0x7fb9140ca5d0 2023-11-15T01:22:40.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb913fff700 1 -- 172.21.15.1:0/1297952933 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9140aa770 con 0x7fb914155610 2023-11-15T01:22:40.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb913fff700 1 --2- 172.21.15.1:0/1297952933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb914155610 0x7fb9140aa000 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fb90c009f20 tx=0x7fb90c009840).ready entity=mon.0 client_cookie=5afbf4953afe97a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:40.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb9127fc700 1 -- 172.21.15.1:0/1297952933 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c00e070 con 0x7fb914155610 2023-11-15T01:22:40.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb9127fc700 1 -- 172.21.15.1:0/1297952933 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c00ba40 con 0x7fb914155610 2023-11-15T01:22:40.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.709+0000 7fb9127fc700 1 -- 172.21.15.1:0/1297952933 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c00bdc0 con 0x7fb914155610 2023-11-15T01:22:40.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.710+0000 7fb91880d700 1 -- 172.21.15.1:0/1297952933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb914155610 msgr2=0x7fb9140aa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.710+0000 7fb91880d700 1 --2- 172.21.15.1:0/1297952933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb914155610 0x7fb9140aa000 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fb90c009f20 tx=0x7fb90c009840).stop 2023-11-15T01:22:40.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.710+0000 7fb91880d700 1 -- 172.21.15.1:0/1297952933 shutdown_connections 2023-11-15T01:22:40.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.710+0000 7fb91880d700 1 --2- 172.21.15.1:0/1297952933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb914155610 0x7fb9140aa000 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.710+0000 7fb91880d700 1 -- 172.21.15.1:0/1297952933 >> 172.21.15.1:0/1297952933 conn(0x7fb91406a9b0 msgr2=0x7fb9140cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:40.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.710+0000 7fb91880d700 1 -- 172.21.15.1:0/1297952933 shutdown_connections 2023-11-15T01:22:40.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.710+0000 7fb91880d700 1 -- 172.21.15.1:0/1297952933 wait complete. 2023-11-15T01:22:40.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.711+0000 7fb91880d700 1 Processor -- start 2023-11-15T01:22:40.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.711+0000 7fb91880d700 1 -- start start 2023-11-15T01:22:40.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb91880d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb914063b50 0x7fb9140a9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb91880d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9140ca5d0 0x7fb9140afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb91880d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb914155610 0x7fb9140aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb91880d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9140b0a60 con 0x7fb914155610 2023-11-15T01:22:40.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb91880d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9140c3350 con 0x7fb9140ca5d0 2023-11-15T01:22:40.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb91880d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9140b0780 con 0x7fb914063b50 2023-11-15T01:22:40.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb913fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb914155610 0x7fb9140aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb913fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb914155610 0x7fb9140aff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50020/0 (socket says 172.21.15.1:50020) 2023-11-15T01:22:40.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb913fff700 1 -- 172.21.15.1:0/1336256094 learned_addr learned my addr 172.21.15.1:0/1336256094 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:40.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb9137fe700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb914063b50 0x7fb9140a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb913fff700 1 -- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb914063b50 msgr2=0x7fb9140a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb912ffd700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9140ca5d0 0x7fb9140afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb913fff700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb914063b50 0x7fb9140a9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb913fff700 1 -- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9140ca5d0 msgr2=0x7fb9140afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb913fff700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9140ca5d0 0x7fb9140afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb913fff700 1 -- 172.21.15.1:0/1336256094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c009ae0 con 0x7fb914155610 2023-11-15T01:22:40.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb912ffd700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9140ca5d0 0x7fb9140afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:40.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb9137fe700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb914063b50 0x7fb9140a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:40.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.712+0000 7fb913fff700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb914155610 0x7fb9140aff50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fb90c00b9f0 tx=0x7fb90c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:40.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.713+0000 7fb8fb7fe700 1 -- 172.21.15.1:0/1336256094 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c00bdc0 con 0x7fb914155610 2023-11-15T01:22:40.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.713+0000 7fb8fb7fe700 1 -- 172.21.15.1:0/1336256094 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c01c400 con 0x7fb914155610 2023-11-15T01:22:40.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.713+0000 7fb8fb7fe700 1 -- 172.21.15.1:0/1336256094 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c01c780 con 0x7fb914155610 2023-11-15T01:22:40.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.713+0000 7fb91880d700 1 -- 172.21.15.1:0/1336256094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9140c2d00 con 0x7fb914155610 2023-11-15T01:22:40.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.713+0000 7fb91880d700 1 -- 172.21.15.1:0/1336256094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9140b0440 con 0x7fb914155610 2023-11-15T01:22:40.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.714+0000 7fb91880d700 1 -- 172.21.15.1:0/1336256094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9140c2b60 con 0x7fb914155610 2023-11-15T01:22:40.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.714+0000 7fb8fb7fe700 1 -- 172.21.15.1:0/1336256094 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7fb90c01cb30 con 0x7fb914155610 2023-11-15T01:22:40.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.714+0000 7fb8fb7fe700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb90005f350 0x7fb900061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:40.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.714+0000 7fb8fb7fe700 1 -- 172.21.15.1:0/1336256094 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fb90c07c1f0 con 0x7fb914155610 2023-11-15T01:22:40.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.715+0000 7fb9137fe700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb90005f350 0x7fb900061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:40.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.715+0000 7fb9137fe700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb90005f350 0x7fb900061810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb904001740 tx=0x7fb904009040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:40.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.719+0000 7fb8fb7fe700 1 -- 172.21.15.1:0/1336256094 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb9140c2b60 con 0x7fb914155610 2023-11-15T01:22:40.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.919+0000 7fb91880d700 1 -- 172.21.15.1:0/1336256094 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9140c2b60 con 0x7fb90005f350 2023-11-15T01:22:40.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.924+0000 7fb8fb7fe700 1 -- 172.21.15.1:0/1336256094 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fb9140c2b60 con 0x7fb90005f350 2023-11-15T01:22:40.926 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-11-15T01:22:40.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.926+0000 7fb91880d700 1 -- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb90005f350 msgr2=0x7fb900061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.926+0000 7fb91880d700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb90005f350 0x7fb900061810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb904001740 tx=0x7fb904009040).stop 2023-11-15T01:22:40.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.926+0000 7fb91880d700 1 -- 172.21.15.1:0/1336256094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb914155610 msgr2=0x7fb9140aff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:40.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.926+0000 7fb91880d700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb914155610 0x7fb9140aff50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fb90c00b9f0 tx=0x7fb90c009840).stop 2023-11-15T01:22:40.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.926+0000 7fb91880d700 1 -- 172.21.15.1:0/1336256094 shutdown_connections 2023-11-15T01:22:40.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.926+0000 7fb91880d700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb90005f350 0x7fb900061810 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.926+0000 7fb91880d700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb914155610 0x7fb9140aff50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.926+0000 7fb91880d700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb914063b50 0x7fb9140a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.926+0000 7fb91880d700 1 --2- 172.21.15.1:0/1336256094 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9140ca5d0 0x7fb9140afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:40.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.926+0000 7fb91880d700 1 -- 172.21.15.1:0/1336256094 >> 172.21.15.1:0/1336256094 conn(0x7fb91406a9b0 msgr2=0x7fb9140ad1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:40.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.926+0000 7fb91880d700 1 -- 172.21.15.1:0/1336256094 shutdown_connections 2023-11-15T01:22:40.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:40.926+0000 7fb91880d700 1 -- 172.21.15.1:0/1336256094 wait complete. 2023-11-15T01:22:40.940 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-11-15T01:22:40.940 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-11-15T01:22:41.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.062+0000 7f6f2e656700 1 Processor -- start 2023-11-15T01:22:41.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.062+0000 7f6f2e656700 1 -- start start 2023-11-15T01:22:41.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.063+0000 7f6f2e656700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f28157660 0x7f6f28157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.063+0000 7f6f2e656700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6f280aa060 0x7f6f280aa510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.063+0000 7f6f2e656700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f280aaa00 con 0x7f6f280c1cb0 2023-11-15T01:22:41.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.063+0000 7f6f2e656700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f280c7540 con 0x7f6f280aa060 2023-11-15T01:22:41.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.063+0000 7f6f2e656700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f280c1820 con 0x7f6f28157660 2023-11-15T01:22:41.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.063+0000 7f6f2cbf3700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6f280aa060 0x7f6f280aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.063+0000 7f6f27fff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f28157660 0x7f6f28157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.063+0000 7f6f277fe700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f6f280c1cb0 0x7f6f280c6280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:42028/0 (socket says 172.21.15.1:42028) 2023-11-15T01:22:41.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.063+0000 7f6f277fe700 1 -- 172.21.15.1:0/1238689355 learned_addr learned my addr 172.21.15.1:0/1238689355 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:41.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.064+0000 7f6f2cbf3700 1 -- 172.21.15.1:0/1238689355 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f28157660 msgr2=0x7f6f28157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:41.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.064+0000 7f6f2cbf3700 1 --2- 172.21.15.1:0/1238689355 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f28157660 0x7f6f28157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.064+0000 7f6f2cbf3700 1 -- 172.21.15.1:0/1238689355 >> v1:172.21.15.141:6789/0 conn(0x7f6f280c1cb0 legacy=0x7f6f280c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.064+0000 7f6f26ffd700 1 -- 172.21.15.1:0/1238689355 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176396103 0 0) 0x7f6f10001110 con 0x7f6f280c1cb0 2023-11-15T01:22:41.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.064+0000 7f6f2cbf3700 1 -- 172.21.15.1:0/1238689355 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f280c0c30 con 0x7f6f280aa060 2023-11-15T01:22:41.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.064+0000 7f6f27fff700 1 --2- 172.21.15.1:0/1238689355 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f28157660 0x7f6f28157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:41.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.064+0000 7f6f2cbf3700 1 --2- 172.21.15.1:0/1238689355 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f280aa060 0x7f6f280aa510 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f6f20009e60 tx=0x7f6f20009780).ready entity=mon.1 client_cookie=184ad8f3d2a7ed1a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:41.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.064+0000 7f6f26ffd700 1 -- 172.21.15.1:0/1238689355 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2000e070 con 0x7f6f280aa060 2023-11-15T01:22:41.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.064+0000 7f6f26ffd700 1 -- 172.21.15.1:0/1238689355 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2000bb60 con 0x7f6f280aa060 2023-11-15T01:22:41.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.064+0000 7f6f26ffd700 1 -- 172.21.15.1:0/1238689355 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20012410 con 0x7f6f280aa060 2023-11-15T01:22:41.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.064+0000 7f6f2e656700 1 -- 172.21.15.1:0/1238689355 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f280aa060 msgr2=0x7f6f280aa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.065+0000 7f6f2e656700 1 --2- 172.21.15.1:0/1238689355 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f280aa060 0x7f6f280aa510 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f6f20009e60 tx=0x7f6f20009780).stop 2023-11-15T01:22:41.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.065+0000 7f6f2e656700 1 -- 172.21.15.1:0/1238689355 shutdown_connections 2023-11-15T01:22:41.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.065+0000 7f6f2e656700 1 --2- 172.21.15.1:0/1238689355 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f280aa060 0x7f6f280aa510 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.065+0000 7f6f2e656700 1 --2- 172.21.15.1:0/1238689355 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f28157660 0x7f6f28157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.065+0000 7f6f2e656700 1 -- 172.21.15.1:0/1238689355 >> 172.21.15.1:0/1238689355 conn(0x7f6f28064aa0 msgr2=0x7f6f28064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:41.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.065+0000 7f6f2e656700 1 -- 172.21.15.1:0/1238689355 shutdown_connections 2023-11-15T01:22:41.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.065+0000 7f6f2e656700 1 -- 172.21.15.1:0/1238689355 wait complete. 2023-11-15T01:22:41.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.066+0000 7f6f2e656700 1 Processor -- start 2023-11-15T01:22:41.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.066+0000 7f6f2e656700 1 -- start start 2023-11-15T01:22:41.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f2e656700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f280aa060 0x7f6f280cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f2e656700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f280c1cb0 0x7f6f28149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f2e656700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f28157660 0x7f6f280c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f2e656700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f280cb040 con 0x7f6f28157660 2023-11-15T01:22:41.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f2e656700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2814a390 con 0x7f6f280c1cb0 2023-11-15T01:22:41.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f2e656700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f280ca430 con 0x7f6f280aa060 2023-11-15T01:22:41.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f2cbf3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f28157660 0x7f6f280c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f2cbf3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f28157660 0x7f6f280c2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50034/0 (socket says 172.21.15.1:50034) 2023-11-15T01:22:41.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f2cbf3700 1 -- 172.21.15.1:0/1922203250 learned_addr learned my addr 172.21.15.1:0/1922203250 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:41.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f27fff700 1 --2- 172.21.15.1:0/1922203250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f280aa060 0x7f6f280cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f277fe700 1 --2- 172.21.15.1:0/1922203250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f280c1cb0 0x7f6f28149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f2cbf3700 1 -- 172.21.15.1:0/1922203250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f280aa060 msgr2=0x7f6f280cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f2cbf3700 1 --2- 172.21.15.1:0/1922203250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f280aa060 0x7f6f280cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f2cbf3700 1 -- 172.21.15.1:0/1922203250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f280c1cb0 msgr2=0x7f6f28149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f2cbf3700 1 --2- 172.21.15.1:0/1922203250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f280c1cb0 0x7f6f28149ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f2cbf3700 1 -- 172.21.15.1:0/1922203250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f180092a0 con 0x7f6f28157660 2023-11-15T01:22:41.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.067+0000 7f6f2cbf3700 1 --2- 172.21.15.1:0/1922203250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f28157660 0x7f6f280c2aa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f6f2000b6c0 tx=0x7f6f20009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:41.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.068+0000 7f6f1ffff700 1 -- 172.21.15.1:0/1922203250 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2000b6f0 con 0x7f6f28157660 2023-11-15T01:22:41.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.068+0000 7f6f1ffff700 1 -- 172.21.15.1:0/1922203250 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f20007000 con 0x7f6f28157660 2023-11-15T01:22:41.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.068+0000 7f6f2e656700 1 -- 172.21.15.1:0/1922203250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f20009a20 con 0x7f6f28157660 2023-11-15T01:22:41.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.068+0000 7f6f1ffff700 1 -- 172.21.15.1:0/1922203250 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2001d860 con 0x7f6f28157660 2023-11-15T01:22:41.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.068+0000 7f6f2e656700 1 -- 172.21.15.1:0/1922203250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f280ca9f0 con 0x7f6f28157660 2023-11-15T01:22:41.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.069+0000 7f6f2e656700 1 -- 172.21.15.1:0/1922203250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f280cb1f0 con 0x7f6f28157660 2023-11-15T01:22:41.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.069+0000 7f6f1ffff700 1 -- 172.21.15.1:0/1922203250 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f6f20003040 con 0x7f6f28157660 2023-11-15T01:22:41.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.069+0000 7f6f1ffff700 1 --2- 172.21.15.1:0/1922203250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f0805f350 0x7f6f08061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.069+0000 7f6f1ffff700 1 -- 172.21.15.1:0/1922203250 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f6f2007c3e0 con 0x7f6f28157660 2023-11-15T01:22:41.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.070+0000 7f6f27fff700 1 --2- 172.21.15.1:0/1922203250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f0805f350 0x7f6f08061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.070+0000 7f6f27fff700 1 --2- 172.21.15.1:0/1922203250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f0805f350 0x7f6f08061810 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f6f18009d20 tx=0x7f6f18009060).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:41.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.074+0000 7f6f1ffff700 1 -- 172.21.15.1:0/1922203250 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6f280cb1f0 con 0x7f6f28157660 2023-11-15T01:22:41.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.273+0000 7f6f2e656700 1 -- 172.21.15.1:0/1922203250 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f280cb180 con 0x7f6f0805f350 2023-11-15T01:22:41.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.277+0000 7f6f1ffff700 1 -- 172.21.15.1:0/1922203250 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f6f280cb180 con 0x7f6f0805f350 2023-11-15T01:22:41.279 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-11-15T01:22:41.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.279+0000 7f6f2e656700 1 -- 172.21.15.1:0/1922203250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f0805f350 msgr2=0x7f6f08061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.279+0000 7f6f2e656700 1 --2- 172.21.15.1:0/1922203250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f0805f350 0x7f6f08061810 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f6f18009d20 tx=0x7f6f18009060).stop 2023-11-15T01:22:41.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.279+0000 7f6f2e656700 1 -- 172.21.15.1:0/1922203250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f28157660 msgr2=0x7f6f280c2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.279+0000 7f6f2e656700 1 --2- 172.21.15.1:0/1922203250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f28157660 0x7f6f280c2aa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f6f2000b6c0 tx=0x7f6f20009780).stop 2023-11-15T01:22:41.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.279+0000 7f6f2e656700 1 -- 172.21.15.1:0/1922203250 shutdown_connections 2023-11-15T01:22:41.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.279+0000 7f6f2e656700 1 --2- 172.21.15.1:0/1922203250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f0805f350 0x7f6f08061810 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.279+0000 7f6f2e656700 1 --2- 172.21.15.1:0/1922203250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f28157660 0x7f6f280c2aa0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.279+0000 7f6f2e656700 1 --2- 172.21.15.1:0/1922203250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f280aa060 0x7f6f280cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.279+0000 7f6f2e656700 1 --2- 172.21.15.1:0/1922203250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f280c1cb0 0x7f6f28149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.279+0000 7f6f2e656700 1 -- 172.21.15.1:0/1922203250 >> 172.21.15.1:0/1922203250 conn(0x7f6f28064aa0 msgr2=0x7f6f281542c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:41.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.279+0000 7f6f2e656700 1 -- 172.21.15.1:0/1922203250 shutdown_connections 2023-11-15T01:22:41.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.279+0000 7f6f2e656700 1 -- 172.21.15.1:0/1922203250 wait complete. 2023-11-15T01:22:41.293 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-11-15T01:22:41.293 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-11-15T01:22:41.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.415+0000 7f2d51356700 1 Processor -- start 2023-11-15T01:22:41.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.415+0000 7f2d51356700 1 -- start start 2023-11-15T01:22:41.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.416+0000 7f2d51356700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2d4c0ca5d0 0x7f2d4c0aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.416+0000 7f2d51356700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d4c063b50 0x7f2d4c15df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.416+0000 7f2d51356700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4c1548f0 con 0x7f2d4c155610 2023-11-15T01:22:41.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.416+0000 7f2d51356700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4c0aaa50 con 0x7f2d4c0ca5d0 2023-11-15T01:22:41.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.416+0000 7f2d51356700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c0aa4f0 con 0x7f2d4c063b50 2023-11-15T01:22:41.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.416+0000 7f2d50b55700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d4c063b50 0x7f2d4c15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.416+0000 7f2d4bfff700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2d4c0ca5d0 0x7f2d4c0aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.416+0000 7f2d50b55700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d4c063b50 0x7f2d4c15df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:58646/0 (socket says 172.21.15.1:58646) 2023-11-15T01:22:41.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.416+0000 7f2d4b7fe700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f2d4c155610 0x7f2d4c063440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:42042/0 (socket says 172.21.15.1:42042) 2023-11-15T01:22:41.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.416+0000 7f2d4bfff700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2d4c0ca5d0 0x7f2d4c0aa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:37670/0 (socket says 172.21.15.1:37670) 2023-11-15T01:22:41.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.416+0000 7f2d50b55700 1 -- 172.21.15.1:0/1473174963 learned_addr learned my addr 172.21.15.1:0/1473174963 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:41.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.417+0000 7f2d4affd700 1 -- 172.21.15.1:0/1473174963 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257624378 0 0) 0x7f2d3c001110 con 0x7f2d4c155610 2023-11-15T01:22:41.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.417+0000 7f2d4affd700 1 -- 172.21.15.1:0/1473174963 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d340033f0 con 0x7f2d4c155610 2023-11-15T01:22:41.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.417+0000 7f2d50b55700 1 -- 172.21.15.1:0/1473174963 >> v2:172.21.15.141:3300/0 conn(0x7f2d4c0ca5d0 msgr2=0x7f2d4c0aa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:41.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.417+0000 7f2d50b55700 1 --2- 172.21.15.1:0/1473174963 >> v2:172.21.15.141:3300/0 conn(0x7f2d4c0ca5d0 0x7f2d4c0aa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.417+0000 7f2d50b55700 1 -- 172.21.15.1:0/1473174963 >> v1:172.21.15.141:6789/0 conn(0x7f2d4c155610 legacy=0x7f2d4c063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.417+0000 7f2d50b55700 1 -- 172.21.15.1:0/1473174963 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c0aa770 con 0x7f2d4c063b50 2023-11-15T01:22:41.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.417+0000 7f2d4bfff700 1 --2- 172.21.15.1:0/1473174963 >> v2:172.21.15.141:3300/0 conn(0x7f2d4c0ca5d0 0x7f2d4c0aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:22:41.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.417+0000 7f2d50b55700 1 --2- 172.21.15.1:0/1473174963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d4c063b50 0x7f2d4c15df20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2d44009f20 tx=0x7f2d44009840).ready entity=mon.2 client_cookie=fd20dc537c42406b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:41.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.417+0000 7f2d4affd700 1 -- 172.21.15.1:0/1473174963 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400e070 con 0x7f2d4c063b50 2023-11-15T01:22:41.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.417+0000 7f2d4affd700 1 -- 172.21.15.1:0/1473174963 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4400b970 con 0x7f2d4c063b50 2023-11-15T01:22:41.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.417+0000 7f2d4affd700 1 -- 172.21.15.1:0/1473174963 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400bcf0 con 0x7f2d4c063b50 2023-11-15T01:22:41.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.417+0000 7f2d51356700 1 -- 172.21.15.1:0/1473174963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d4c063b50 msgr2=0x7f2d4c15df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.417+0000 7f2d51356700 1 --2- 172.21.15.1:0/1473174963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d4c063b50 0x7f2d4c15df20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2d44009f20 tx=0x7f2d44009840).stop 2023-11-15T01:22:41.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.418+0000 7f2d51356700 1 -- 172.21.15.1:0/1473174963 shutdown_connections 2023-11-15T01:22:41.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.418+0000 7f2d51356700 1 --2- 172.21.15.1:0/1473174963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d4c063b50 0x7f2d4c15df20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.418+0000 7f2d51356700 1 --2- 172.21.15.1:0/1473174963 >> v2:172.21.15.141:3300/0 conn(0x7f2d4c0ca5d0 0x7f2d4c0aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.418+0000 7f2d51356700 1 -- 172.21.15.1:0/1473174963 >> 172.21.15.1:0/1473174963 conn(0x7f2d4c06a9b0 msgr2=0x7f2d4c0cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:41.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.418+0000 7f2d51356700 1 -- 172.21.15.1:0/1473174963 shutdown_connections 2023-11-15T01:22:41.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.418+0000 7f2d51356700 1 -- 172.21.15.1:0/1473174963 wait complete. 2023-11-15T01:22:41.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.419+0000 7f2d51356700 1 Processor -- start 2023-11-15T01:22:41.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.419+0000 7f2d51356700 1 -- start start 2023-11-15T01:22:41.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d51356700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d4c063b50 0x7f2d4c143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d51356700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d4c0ca5d0 0x7f2d4c0ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d51356700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d4c155610 0x7f2d4c0acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d51356700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c0acfc0 con 0x7f2d4c155610 2023-11-15T01:22:41.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d51356700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c1597c0 con 0x7f2d4c063b50 2023-11-15T01:22:41.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d51356700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c158bb0 con 0x7f2d4c0ca5d0 2023-11-15T01:22:41.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d50b55700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d4c155610 0x7f2d4c0acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d50b55700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d4c155610 0x7f2d4c0acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50042/0 (socket says 172.21.15.1:50042) 2023-11-15T01:22:41.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d50b55700 1 -- 172.21.15.1:0/2171573977 learned_addr learned my addr 172.21.15.1:0/2171573977 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:41.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d4b7fe700 1 --2- 172.21.15.1:0/2171573977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d4c0ca5d0 0x7f2d4c0ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d4bfff700 1 --2- 172.21.15.1:0/2171573977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d4c063b50 0x7f2d4c143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d50b55700 1 -- 172.21.15.1:0/2171573977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d4c0ca5d0 msgr2=0x7f2d4c0ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d50b55700 1 --2- 172.21.15.1:0/2171573977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d4c0ca5d0 0x7f2d4c0ac5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d50b55700 1 -- 172.21.15.1:0/2171573977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d4c063b50 msgr2=0x7f2d4c143b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d50b55700 1 --2- 172.21.15.1:0/2171573977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d4c063b50 0x7f2d4c143b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d50b55700 1 -- 172.21.15.1:0/2171573977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d400092a0 con 0x7f2d4c155610 2023-11-15T01:22:41.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d4b7fe700 1 --2- 172.21.15.1:0/2171573977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d4c0ca5d0 0x7f2d4c0ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d50b55700 1 --2- 172.21.15.1:0/2171573977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d4c155610 0x7f2d4c0acad0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f2d44010000 tx=0x7f2d4c0aa660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d33fff700 1 -- 172.21.15.1:0/2171573977 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400bee0 con 0x7f2d4c155610 2023-11-15T01:22:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d33fff700 1 -- 172.21.15.1:0/2171573977 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d440092e0 con 0x7f2d4c155610 2023-11-15T01:22:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d51356700 1 -- 172.21.15.1:0/2171573977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d44009ae0 con 0x7f2d4c155610 2023-11-15T01:22:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d33fff700 1 -- 172.21.15.1:0/2171573977 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4401e6c0 con 0x7f2d4c155610 2023-11-15T01:22:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.420+0000 7f2d51356700 1 -- 172.21.15.1:0/2171573977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4c159170 con 0x7f2d4c155610 2023-11-15T01:22:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.422+0000 7f2d51356700 1 -- 172.21.15.1:0/2171573977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4c159970 con 0x7f2d4c155610 2023-11-15T01:22:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.422+0000 7f2d33fff700 1 -- 172.21.15.1:0/2171573977 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f2d44003040 con 0x7f2d4c155610 2023-11-15T01:22:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.422+0000 7f2d33fff700 1 --2- 172.21.15.1:0/2171573977 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2d3805f350 0x7f2d38061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.422+0000 7f2d33fff700 1 -- 172.21.15.1:0/2171573977 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f2d4407bb80 con 0x7f2d4c155610 2023-11-15T01:22:41.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.422+0000 7f2d4bfff700 1 --2- 172.21.15.1:0/2171573977 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2d3805f350 0x7f2d38061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.423+0000 7f2d4bfff700 1 --2- 172.21.15.1:0/2171573977 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2d3805f350 0x7f2d38061810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2d40006d80 tx=0x7f2d40008040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:41.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.427+0000 7f2d33fff700 1 -- 172.21.15.1:0/2171573977 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2d4c159970 con 0x7f2d4c155610 2023-11-15T01:22:41.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.627+0000 7f2d51356700 1 -- 172.21.15.1:0/2171573977 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d4c159930 con 0x7f2d3805f350 2023-11-15T01:22:41.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.633+0000 7f2d33fff700 1 -- 172.21.15.1:0/2171573977 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f2d4c159930 con 0x7f2d3805f350 2023-11-15T01:22:41.634 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-11-15T01:22:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.634+0000 7f2d51356700 1 -- 172.21.15.1:0/2171573977 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2d3805f350 msgr2=0x7f2d38061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.634+0000 7f2d51356700 1 --2- 172.21.15.1:0/2171573977 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2d3805f350 0x7f2d38061810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2d40006d80 tx=0x7f2d40008040).stop 2023-11-15T01:22:41.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.634+0000 7f2d51356700 1 -- 172.21.15.1:0/2171573977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d4c155610 msgr2=0x7f2d4c0acad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.634+0000 7f2d51356700 1 --2- 172.21.15.1:0/2171573977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d4c155610 0x7f2d4c0acad0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f2d44010000 tx=0x7f2d4c0aa660).stop 2023-11-15T01:22:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.634+0000 7f2d51356700 1 -- 172.21.15.1:0/2171573977 shutdown_connections 2023-11-15T01:22:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.634+0000 7f2d51356700 1 --2- 172.21.15.1:0/2171573977 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2d3805f350 0x7f2d38061810 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.634+0000 7f2d51356700 1 --2- 172.21.15.1:0/2171573977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d4c155610 0x7f2d4c0acad0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.634+0000 7f2d51356700 1 --2- 172.21.15.1:0/2171573977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d4c063b50 0x7f2d4c143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.634+0000 7f2d51356700 1 --2- 172.21.15.1:0/2171573977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d4c0ca5d0 0x7f2d4c0ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.634+0000 7f2d51356700 1 -- 172.21.15.1:0/2171573977 >> 172.21.15.1:0/2171573977 conn(0x7f2d4c06a9b0 msgr2=0x7f2d4c0c7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.634+0000 7f2d51356700 1 -- 172.21.15.1:0/2171573977 shutdown_connections 2023-11-15T01:22:41.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.634+0000 7f2d51356700 1 -- 172.21.15.1:0/2171573977 wait complete. 2023-11-15T01:22:41.648 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-11-15T01:22:41.648 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-11-15T01:22:41.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.771+0000 7f929b30d700 1 Processor -- start 2023-11-15T01:22:41.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.771+0000 7f929b30d700 1 -- start start 2023-11-15T01:22:41.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.772+0000 7f929b30d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9294158c70 0x7f92940c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.772+0000 7f929b30d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92941580d0 con 0x7f929414b350 2023-11-15T01:22:41.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.772+0000 7f929b30d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9294155000 con 0x7f92940aa750 2023-11-15T01:22:41.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.772+0000 7f929b30d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92941552e0 con 0x7f9294158c70 2023-11-15T01:22:41.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.772+0000 7f92998aa700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9294158c70 0x7f92940c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.772+0000 7f92990a9700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f929414b350 0x7f92940aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45682/0 (socket says 172.21.15.1:45682) 2023-11-15T01:22:41.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.772+0000 7f92990a9700 1 -- 172.21.15.1:0/339996222 learned_addr learned my addr 172.21.15.1:0/339996222 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:41.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.772+0000 7f92998aa700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9294158c70 0x7f92940c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50052/0 (socket says 172.21.15.1:50052) 2023-11-15T01:22:41.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.772+0000 7f92998aa700 1 -- 172.21.15.1:0/339996222 >> v1:172.21.15.141:6789/0 conn(0x7f92940aa750 legacy=0x7f9294158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:41.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.772+0000 7f92998aa700 1 -- 172.21.15.1:0/339996222 >> v1:172.21.15.1:6789/0 conn(0x7f929414b350 legacy=0x7f92940aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.772+0000 7f9293fff700 1 -- 172.21.15.1:0/339996222 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573028991 0 0) 0x7f92941580d0 con 0x7f929414b350 2023-11-15T01:22:41.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.772+0000 7f92998aa700 1 -- 172.21.15.1:0/339996222 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92941555c0 con 0x7f9294158c70 2023-11-15T01:22:41.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.773+0000 7f92998aa700 1 --2- 172.21.15.1:0/339996222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9294158c70 0x7f92940c8290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f9284009e60 tx=0x7f9284009780).ready entity=mon.0 client_cookie=f6ddf5f471090589 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:41.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.773+0000 7f9293fff700 1 -- 172.21.15.1:0/339996222 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928400e070 con 0x7f9294158c70 2023-11-15T01:22:41.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.773+0000 7f9293fff700 1 -- 172.21.15.1:0/339996222 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928400bbf0 con 0x7f9294158c70 2023-11-15T01:22:41.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.773+0000 7f9293fff700 1 -- 172.21.15.1:0/339996222 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284012410 con 0x7f9294158c70 2023-11-15T01:22:41.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.773+0000 7f929b30d700 1 -- 172.21.15.1:0/339996222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9294158c70 msgr2=0x7f92940c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.773+0000 7f929b30d700 1 --2- 172.21.15.1:0/339996222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9294158c70 0x7f92940c8290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f9284009e60 tx=0x7f9284009780).stop 2023-11-15T01:22:41.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.773+0000 7f929b30d700 1 -- 172.21.15.1:0/339996222 shutdown_connections 2023-11-15T01:22:41.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.773+0000 7f929b30d700 1 --2- 172.21.15.1:0/339996222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9294158c70 0x7f92940c8290 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.773+0000 7f929b30d700 1 -- 172.21.15.1:0/339996222 >> 172.21.15.1:0/339996222 conn(0x7f9294069ee0 msgr2=0x7f929406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:41.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.773+0000 7f929b30d700 1 -- 172.21.15.1:0/339996222 shutdown_connections 2023-11-15T01:22:41.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.773+0000 7f929b30d700 1 -- 172.21.15.1:0/339996222 wait complete. 2023-11-15T01:22:41.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.774+0000 7f929b30d700 1 Processor -- start 2023-11-15T01:22:41.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.774+0000 7f929b30d700 1 -- start start 2023-11-15T01:22:41.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.775+0000 7f929b30d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92940aa750 0x7f929414e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.775+0000 7f929b30d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929414b350 0x7f92940c1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.775+0000 7f929b30d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9294158c70 0x7f92940c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.775+0000 7f929b30d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92940af770 con 0x7f92940aa750 2023-11-15T01:22:41.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.775+0000 7f929b30d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929414e540 con 0x7f9294158c70 2023-11-15T01:22:41.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.775+0000 7f929b30d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92940aeb60 con 0x7f929414b350 2023-11-15T01:22:41.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.775+0000 7f92990a9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92940aa750 0x7f929414e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.775+0000 7f92990a9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92940aa750 0x7f929414e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50056/0 (socket says 172.21.15.1:50056) 2023-11-15T01:22:41.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.775+0000 7f92990a9700 1 -- 172.21.15.1:0/148082194 learned_addr learned my addr 172.21.15.1:0/148082194 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:41.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.776+0000 7f92988a8700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929414b350 0x7f92940c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.776+0000 7f92998aa700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9294158c70 0x7f92940c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.776+0000 7f92990a9700 1 -- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929414b350 msgr2=0x7f92940c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.776+0000 7f92990a9700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929414b350 0x7f92940c1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.776+0000 7f92990a9700 1 -- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9294158c70 msgr2=0x7f92940c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.776+0000 7f92990a9700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9294158c70 0x7f92940c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.776+0000 7f92990a9700 1 -- 172.21.15.1:0/148082194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284009a20 con 0x7f92940aa750 2023-11-15T01:22:41.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.776+0000 7f92998aa700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9294158c70 0x7f92940c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:41.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.776+0000 7f92988a8700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929414b350 0x7f92940c1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:41.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.776+0000 7f92990a9700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92940aa750 0x7f929414e050 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f928c00c4e0 tx=0x7f928c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:41.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.776+0000 7f92917fa700 1 -- 172.21.15.1:0/148082194 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c0072e0 con 0x7f92940aa750 2023-11-15T01:22:41.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.776+0000 7f92917fa700 1 -- 172.21.15.1:0/148082194 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928c007440 con 0x7f92940aa750 2023-11-15T01:22:41.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.776+0000 7f929b30d700 1 -- 172.21.15.1:0/148082194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92940aee40 con 0x7f92940aa750 2023-11-15T01:22:41.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.776+0000 7f92917fa700 1 -- 172.21.15.1:0/148082194 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c0057a0 con 0x7f92940aa750 2023-11-15T01:22:41.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.776+0000 7f929b30d700 1 -- 172.21.15.1:0/148082194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92940af400 con 0x7f92940aa750 2023-11-15T01:22:41.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.777+0000 7f929b30d700 1 -- 172.21.15.1:0/148082194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929406c7e0 con 0x7f92940aa750 2023-11-15T01:22:41.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.777+0000 7f92917fa700 1 -- 172.21.15.1:0/148082194 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f928c005bd0 con 0x7f92940aa750 2023-11-15T01:22:41.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.778+0000 7f92917fa700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f928005f350 0x7f9280061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:41.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.778+0000 7f92917fa700 1 -- 172.21.15.1:0/148082194 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f928c079ee0 con 0x7f92940aa750 2023-11-15T01:22:41.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.778+0000 7f92988a8700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f928005f350 0x7f9280061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:41.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.778+0000 7f92988a8700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f928005f350 0x7f9280061810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f92940c53a0 tx=0x7f9288009040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:41.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.782+0000 7f92917fa700 1 -- 172.21.15.1:0/148082194 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f928c04af00 con 0x7f92940aa750 2023-11-15T01:22:41.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.982+0000 7f929b30d700 1 -- 172.21.15.1:0/148082194 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f92940af8b0 con 0x7f928005f350 2023-11-15T01:22:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.987+0000 7f92917fa700 1 -- 172.21.15.1:0/148082194 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f9288002330 con 0x7f928005f350 2023-11-15T01:22:41.989 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-11-15T01:22:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.989+0000 7f929b30d700 1 -- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f928005f350 msgr2=0x7f9280061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.989+0000 7f929b30d700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f928005f350 0x7f9280061810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f92940c53a0 tx=0x7f9288009040).stop 2023-11-15T01:22:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.989+0000 7f929b30d700 1 -- 172.21.15.1:0/148082194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92940aa750 msgr2=0x7f929414e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.989+0000 7f929b30d700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92940aa750 0x7f929414e050 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f928c00c4e0 tx=0x7f928c007c70).stop 2023-11-15T01:22:41.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.989+0000 7f929b30d700 1 -- 172.21.15.1:0/148082194 shutdown_connections 2023-11-15T01:22:41.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.989+0000 7f929b30d700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f928005f350 0x7f9280061810 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.989+0000 7f929b30d700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9294158c70 0x7f92940c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.989+0000 7f929b30d700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92940aa750 0x7f929414e050 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.989+0000 7f929b30d700 1 --2- 172.21.15.1:0/148082194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929414b350 0x7f92940c1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:41.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.989+0000 7f929b30d700 1 -- 172.21.15.1:0/148082194 >> 172.21.15.1:0/148082194 conn(0x7f9294069ee0 msgr2=0x7f9294154820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:41.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.989+0000 7f929b30d700 1 -- 172.21.15.1:0/148082194 shutdown_connections 2023-11-15T01:22:41.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:41.989+0000 7f929b30d700 1 -- 172.21.15.1:0/148082194 wait complete. 2023-11-15T01:22:42.002 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-11-15T01:22:42.003 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-11-15T01:22:42.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.124+0000 7f0280fb5700 1 Processor -- start 2023-11-15T01:22:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.124+0000 7f0280fb5700 1 -- start start 2023-11-15T01:22:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.125+0000 7f0280fb5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f027c14b350 0x7f027c0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.125+0000 7f0280fb5700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027c1580d0 con 0x7f027c14b730 2023-11-15T01:22:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.125+0000 7f0280fb5700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027c155000 con 0x7f027c0aa750 2023-11-15T01:22:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.125+0000 7f0280fb5700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f027c1552e0 con 0x7f027c14b350 2023-11-15T01:22:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.125+0000 7f0279d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f027c14b730 0x7f027c0aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45686/0 (socket says 172.21.15.1:45686) 2023-11-15T01:22:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.125+0000 7f0279d9b700 1 -- 172.21.15.1:0/3391260425 learned_addr learned my addr 172.21.15.1:0/3391260425 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:22:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.125+0000 7f027a59c700 1 --2- 172.21.15.1:0/3391260425 >> v2:172.21.15.1:3300/0 conn(0x7f027c14b350 0x7f027c0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.125+0000 7f027a59c700 1 -- 172.21.15.1:0/3391260425 >> v1:172.21.15.141:6789/0 conn(0x7f027c0aa750 legacy=0x7f027c158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.125+0000 7f027959a700 1 -- 172.21.15.1:0/3391260425 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492805704 0 0) 0x7f027c1580d0 con 0x7f027c14b730 2023-11-15T01:22:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.125+0000 7f027a59c700 1 -- 172.21.15.1:0/3391260425 >> v1:172.21.15.1:6789/0 conn(0x7f027c14b730 legacy=0x7f027c0aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.125+0000 7f027a59c700 1 -- 172.21.15.1:0/3391260425 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c1555c0 con 0x7f027c14b350 2023-11-15T01:22:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.126+0000 7f027a59c700 1 --2- 172.21.15.1:0/3391260425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c14b350 0x7f027c0c8290 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f0274009760 tx=0x7f0274009060).ready entity=mon.0 client_cookie=8aeab624430f6c71 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.126+0000 7f027959a700 1 -- 172.21.15.1:0/3391260425 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027400b580 con 0x7f027c14b350 2023-11-15T01:22:42.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.126+0000 7f027959a700 1 -- 172.21.15.1:0/3391260425 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027400b6e0 con 0x7f027c14b350 2023-11-15T01:22:42.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.126+0000 7f027959a700 1 -- 172.21.15.1:0/3391260425 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027400ba60 con 0x7f027c14b350 2023-11-15T01:22:42.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.126+0000 7f0280fb5700 1 -- 172.21.15.1:0/3391260425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c14b350 msgr2=0x7f027c0c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:42.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.126+0000 7f0280fb5700 1 --2- 172.21.15.1:0/3391260425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c14b350 0x7f027c0c8290 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f0274009760 tx=0x7f0274009060).stop 2023-11-15T01:22:42.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.126+0000 7f0280fb5700 1 -- 172.21.15.1:0/3391260425 shutdown_connections 2023-11-15T01:22:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.126+0000 7f0280fb5700 1 --2- 172.21.15.1:0/3391260425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c14b350 0x7f027c0c8290 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.126+0000 7f0280fb5700 1 -- 172.21.15.1:0/3391260425 >> 172.21.15.1:0/3391260425 conn(0x7f027c069ee0 msgr2=0x7f027c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.126+0000 7f0280fb5700 1 -- 172.21.15.1:0/3391260425 shutdown_connections 2023-11-15T01:22:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.126+0000 7f0280fb5700 1 -- 172.21.15.1:0/3391260425 wait complete. 2023-11-15T01:22:42.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.127+0000 7f0280fb5700 1 Processor -- start 2023-11-15T01:22:42.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.127+0000 7f0280fb5700 1 -- start start 2023-11-15T01:22:42.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.128+0000 7f0280fb5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f027c0aa750 0x7f027c0c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.128+0000 7f0280fb5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f027c14b350 0x7f027c146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.128+0000 7f0280fb5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c14b730 0x7f027c0c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.128+0000 7f0280fb5700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c147820 con 0x7f027c14b730 2023-11-15T01:22:42.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.128+0000 7f0280fb5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0b06a0 con 0x7f027c14b350 2023-11-15T01:22:42.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.128+0000 7f0280fb5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0b0980 con 0x7f027c0aa750 2023-11-15T01:22:42.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.128+0000 7f027ad9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c14b730 0x7f027c0c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.128+0000 7f027ad9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c14b730 0x7f027c0c2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50064/0 (socket says 172.21.15.1:50064) 2023-11-15T01:22:42.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.128+0000 7f027ad9d700 1 -- 172.21.15.1:0/1744990139 learned_addr learned my addr 172.21.15.1:0/1744990139 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:42.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.129+0000 7f027a59c700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f027c0aa750 0x7f027c0c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.129+0000 7f0279d9b700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f027c14b350 0x7f027c146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.129+0000 7f027ad9d700 1 -- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f027c0aa750 msgr2=0x7f027c0c2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:42.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.129+0000 7f027ad9d700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f027c0aa750 0x7f027c0c2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.129+0000 7f027ad9d700 1 -- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f027c14b350 msgr2=0x7f027c146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:42.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.129+0000 7f027ad9d700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f027c14b350 0x7f027c146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.129+0000 7f027ad9d700 1 -- 172.21.15.1:0/1744990139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740092a0 con 0x7f027c14b730 2023-11-15T01:22:42.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.129+0000 7f027a59c700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f027c0aa750 0x7f027c0c2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:42.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.129+0000 7f0279d9b700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f027c14b350 0x7f027c146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:42.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.129+0000 7f027ad9d700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c14b730 0x7f027c0c2b10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f026c00c7c0 tx=0x7f026c001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:42.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.129+0000 7f02727fc700 1 -- 172.21.15.1:0/1744990139 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c010510 con 0x7f027c14b730 2023-11-15T01:22:42.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.129+0000 7f02727fc700 1 -- 172.21.15.1:0/1744990139 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026c010670 con 0x7f027c14b730 2023-11-15T01:22:42.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.129+0000 7f02727fc700 1 -- 172.21.15.1:0/1744990139 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c0109f0 con 0x7f027c14b730 2023-11-15T01:22:42.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.129+0000 7f0280fb5700 1 -- 172.21.15.1:0/1744990139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027c0b0c60 con 0x7f027c14b730 2023-11-15T01:22:42.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.129+0000 7f0280fb5700 1 -- 172.21.15.1:0/1744990139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027c0b02f0 con 0x7f027c14b730 2023-11-15T01:22:42.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.130+0000 7f0280fb5700 1 -- 172.21.15.1:0/1744990139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027c06c7e0 con 0x7f027c14b730 2023-11-15T01:22:42.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.130+0000 7f02727fc700 1 -- 172.21.15.1:0/1744990139 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f026c01b400 con 0x7f027c14b730 2023-11-15T01:22:42.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.131+0000 7f02727fc700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f025c05f350 0x7f025c061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.131+0000 7f02727fc700 1 -- 172.21.15.1:0/1744990139 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f026c07a3b0 con 0x7f027c14b730 2023-11-15T01:22:42.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.131+0000 7f027a59c700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f025c05f350 0x7f025c061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.131+0000 7f027a59c700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f025c05f350 0x7f025c061810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f027400b340 tx=0x7f0274017000).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:42.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.135+0000 7f02727fc700 1 -- 172.21.15.1:0/1744990139 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f026c04b370 con 0x7f027c14b730 2023-11-15T01:22:42.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.338+0000 7f0280fb5700 1 -- 172.21.15.1:0/1744990139 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f027c05f8b0 con 0x7f025c05f350 2023-11-15T01:22:42.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.342+0000 7f02727fc700 1 -- 172.21.15.1:0/1744990139 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f027c05f8b0 con 0x7f025c05f350 2023-11-15T01:22:42.344 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-11-15T01:22:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.344+0000 7f0280fb5700 1 -- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f025c05f350 msgr2=0x7f025c061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.344+0000 7f0280fb5700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f025c05f350 0x7f025c061810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f027400b340 tx=0x7f0274017000).stop 2023-11-15T01:22:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.344+0000 7f0280fb5700 1 -- 172.21.15.1:0/1744990139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c14b730 msgr2=0x7f027c0c2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.344+0000 7f0280fb5700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c14b730 0x7f027c0c2b10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f026c00c7c0 tx=0x7f026c001560).stop 2023-11-15T01:22:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.344+0000 7f0280fb5700 1 -- 172.21.15.1:0/1744990139 shutdown_connections 2023-11-15T01:22:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.344+0000 7f0280fb5700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f025c05f350 0x7f025c061810 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.344+0000 7f0280fb5700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c14b730 0x7f027c0c2b10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.344+0000 7f0280fb5700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f027c0aa750 0x7f027c0c2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.344+0000 7f0280fb5700 1 --2- 172.21.15.1:0/1744990139 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f027c14b350 0x7f027c146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.344+0000 7f0280fb5700 1 -- 172.21.15.1:0/1744990139 >> 172.21.15.1:0/1744990139 conn(0x7f027c069ee0 msgr2=0x7f027c0ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:42.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.344+0000 7f0280fb5700 1 -- 172.21.15.1:0/1744990139 shutdown_connections 2023-11-15T01:22:42.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.344+0000 7f0280fb5700 1 -- 172.21.15.1:0/1744990139 wait complete. 2023-11-15T01:22:42.357 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-11-15T01:22:42.357 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-11-15T01:22:42.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.479+0000 7f382b59e700 1 Processor -- start 2023-11-15T01:22:42.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.479+0000 7f382b59e700 1 -- start start 2023-11-15T01:22:42.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.480+0000 7f382b59e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f382c0ca5d0 0x7f382c0aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.480+0000 7f382b59e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f382c155610 0x7f382c063440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.480+0000 7f382b59e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382c1548f0 con 0x7f382c063930 2023-11-15T01:22:42.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.480+0000 7f382b59e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c0aaa50 con 0x7f382c0ca5d0 2023-11-15T01:22:42.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.480+0000 7f382b59e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c0aa4f0 con 0x7f382c155610 2023-11-15T01:22:42.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.480+0000 7f382a59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f382c0ca5d0 0x7f382c0aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.480+0000 7f382a59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f382c0ca5d0 0x7f382c0aa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50066/0 (socket says 172.21.15.1:50066) 2023-11-15T01:22:42.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.480+0000 7f382a59c700 1 -- 172.21.15.1:0/3820547828 learned_addr learned my addr 172.21.15.1:0/3820547828 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:42.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.480+0000 7f3829d9b700 1 --2- 172.21.15.1:0/3820547828 >> v2:172.21.15.141:3300/0 conn(0x7f382c155610 0x7f382c063440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.480+0000 7f382a59c700 1 -- 172.21.15.1:0/3820547828 >> v2:172.21.15.141:3300/0 conn(0x7f382c155610 msgr2=0x7f382c063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:42.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.480+0000 7f382a59c700 1 --2- 172.21.15.1:0/3820547828 >> v2:172.21.15.141:3300/0 conn(0x7f382c155610 0x7f382c063440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.480+0000 7f382a59c700 1 -- 172.21.15.1:0/3820547828 >> v1:172.21.15.141:6789/0 conn(0x7f382c063930 legacy=0x7f382c0c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:42.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.480+0000 7f382a59c700 1 -- 172.21.15.1:0/3820547828 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c063d50 con 0x7f382c0ca5d0 2023-11-15T01:22:42.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.480+0000 7f382a59c700 1 --2- 172.21.15.1:0/3820547828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f382c0ca5d0 0x7f382c0aa000 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f382c05f2d0 tx=0x7f381c0090f0).ready entity=mon.0 client_cookie=25369236ae98d0b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:42.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.481+0000 7f382959a700 1 -- 172.21.15.1:0/3820547828 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c00b600 con 0x7f382c0ca5d0 2023-11-15T01:22:42.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.481+0000 7f382959a700 1 -- 172.21.15.1:0/3820547828 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c00b760 con 0x7f382c0ca5d0 2023-11-15T01:22:42.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.481+0000 7f382959a700 1 -- 172.21.15.1:0/3820547828 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c00bae0 con 0x7f382c0ca5d0 2023-11-15T01:22:42.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.481+0000 7f382b59e700 1 -- 172.21.15.1:0/3820547828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f382c0ca5d0 msgr2=0x7f382c0aa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:42.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.481+0000 7f382b59e700 1 --2- 172.21.15.1:0/3820547828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f382c0ca5d0 0x7f382c0aa000 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f382c05f2d0 tx=0x7f381c0090f0).stop 2023-11-15T01:22:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.481+0000 7f382b59e700 1 -- 172.21.15.1:0/3820547828 shutdown_connections 2023-11-15T01:22:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.481+0000 7f382b59e700 1 --2- 172.21.15.1:0/3820547828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f382c0ca5d0 0x7f382c0aa000 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.481+0000 7f382b59e700 1 --2- 172.21.15.1:0/3820547828 >> v2:172.21.15.141:3300/0 conn(0x7f382c155610 0x7f382c063440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.481+0000 7f382b59e700 1 -- 172.21.15.1:0/3820547828 >> 172.21.15.1:0/3820547828 conn(0x7f382c06a9b0 msgr2=0x7f382c0cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.481+0000 7f382b59e700 1 -- 172.21.15.1:0/3820547828 shutdown_connections 2023-11-15T01:22:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.481+0000 7f382b59e700 1 -- 172.21.15.1:0/3820547828 wait complete. 2023-11-15T01:22:42.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.482+0000 7f382b59e700 1 Processor -- start 2023-11-15T01:22:42.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.482+0000 7f382b59e700 1 -- start start 2023-11-15T01:22:42.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f382b59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f382c063930 0x7f382c144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f382b59e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f382c0ca5d0 0x7f382c0ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f382b59e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f382c155610 0x7f382c0ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f382b59e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0af0f0 con 0x7f382c063930 2023-11-15T01:22:42.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f382b59e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0ab630 con 0x7f382c0ca5d0 2023-11-15T01:22:42.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f382b59e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0aeb30 con 0x7f382c155610 2023-11-15T01:22:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f382a59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f382c063930 0x7f382c144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f382a59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f382c063930 0x7f382c144d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50076/0 (socket says 172.21.15.1:50076) 2023-11-15T01:22:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f382a59c700 1 -- 172.21.15.1:0/3205402417 learned_addr learned my addr 172.21.15.1:0/3205402417 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f3829d9b700 1 --2- 172.21.15.1:0/3205402417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f382c0ca5d0 0x7f382c0ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f382a59c700 1 -- 172.21.15.1:0/3205402417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f382c155610 msgr2=0x7f382c0ae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:42.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f382ad9d700 1 --2- 172.21.15.1:0/3205402417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f382c155610 0x7f382c0ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f382a59c700 1 --2- 172.21.15.1:0/3205402417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f382c155610 0x7f382c0ae5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f382a59c700 1 -- 172.21.15.1:0/3205402417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f382c0ca5d0 msgr2=0x7f382c0ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:42.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f382a59c700 1 --2- 172.21.15.1:0/3205402417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f382c0ca5d0 0x7f382c0ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.483+0000 7f382a59c700 1 -- 172.21.15.1:0/3205402417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c009370 con 0x7f382c063930 2023-11-15T01:22:42.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.484+0000 7f3829d9b700 1 --2- 172.21.15.1:0/3205402417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f382c0ca5d0 0x7f382c0ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:42.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.484+0000 7f382a59c700 1 --2- 172.21.15.1:0/3205402417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f382c063930 0x7f382c144d30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f382c05f470 tx=0x7f381c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:42.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.484+0000 7f381a7fc700 1 -- 172.21.15.1:0/3205402417 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c00b8d0 con 0x7f382c063930 2023-11-15T01:22:42.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.484+0000 7f381a7fc700 1 -- 172.21.15.1:0/3205402417 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c00ba30 con 0x7f382c063930 2023-11-15T01:22:42.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.484+0000 7f382b59e700 1 -- 172.21.15.1:0/3205402417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382c0aee10 con 0x7f382c063930 2023-11-15T01:22:42.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.484+0000 7f381a7fc700 1 -- 172.21.15.1:0/3205402417 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c01c670 con 0x7f382c063930 2023-11-15T01:22:42.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.484+0000 7f382b59e700 1 -- 172.21.15.1:0/3205402417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c0c2c20 con 0x7f382c063930 2023-11-15T01:22:42.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.485+0000 7f382b59e700 1 -- 172.21.15.1:0/3205402417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c0475e0 con 0x7f382c063930 2023-11-15T01:22:42.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.485+0000 7f381a7fc700 1 -- 172.21.15.1:0/3205402417 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f381c01ca20 con 0x7f382c063930 2023-11-15T01:22:42.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.485+0000 7f381a7fc700 1 --2- 172.21.15.1:0/3205402417 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f380c05f350 0x7f380c061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.486+0000 7f381a7fc700 1 -- 172.21.15.1:0/3205402417 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f381c07bdf0 con 0x7f382c063930 2023-11-15T01:22:42.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.486+0000 7f3829d9b700 1 --2- 172.21.15.1:0/3205402417 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f380c05f350 0x7f380c061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.486+0000 7f3829d9b700 1 --2- 172.21.15.1:0/3205402417 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f380c05f350 0x7f380c061810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f382c0af2c0 tx=0x7f3820008040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:42.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.490+0000 7f381a7fc700 1 -- 172.21.15.1:0/3205402417 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f381c04ce10 con 0x7f382c063930 2023-11-15T01:22:42.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.692+0000 7f382b59e700 1 -- 172.21.15.1:0/3205402417 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f382c0b10e0 con 0x7f380c05f350 2023-11-15T01:22:42.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.697+0000 7f381a7fc700 1 -- 172.21.15.1:0/3205402417 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f382c0b10e0 con 0x7f380c05f350 2023-11-15T01:22:42.699 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-11-15T01:22:42.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.698+0000 7f382b59e700 1 -- 172.21.15.1:0/3205402417 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f380c05f350 msgr2=0x7f380c061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:42.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.698+0000 7f382b59e700 1 --2- 172.21.15.1:0/3205402417 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f380c05f350 0x7f380c061810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f382c0af2c0 tx=0x7f3820008040).stop 2023-11-15T01:22:42.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.698+0000 7f382b59e700 1 -- 172.21.15.1:0/3205402417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f382c063930 msgr2=0x7f382c144d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:42.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.698+0000 7f382b59e700 1 --2- 172.21.15.1:0/3205402417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f382c063930 0x7f382c144d30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f382c05f470 tx=0x7f381c017000).stop 2023-11-15T01:22:42.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.698+0000 7f382b59e700 1 -- 172.21.15.1:0/3205402417 shutdown_connections 2023-11-15T01:22:42.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.698+0000 7f382b59e700 1 --2- 172.21.15.1:0/3205402417 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f380c05f350 0x7f380c061810 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.698+0000 7f382b59e700 1 --2- 172.21.15.1:0/3205402417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f382c155610 0x7f382c0ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.698+0000 7f382b59e700 1 --2- 172.21.15.1:0/3205402417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f382c063930 0x7f382c144d30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.698+0000 7f382b59e700 1 --2- 172.21.15.1:0/3205402417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f382c0ca5d0 0x7f382c0ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.698+0000 7f382b59e700 1 -- 172.21.15.1:0/3205402417 >> 172.21.15.1:0/3205402417 conn(0x7f382c06a9b0 msgr2=0x7f382c156ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:42.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.698+0000 7f382b59e700 1 -- 172.21.15.1:0/3205402417 shutdown_connections 2023-11-15T01:22:42.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.698+0000 7f382b59e700 1 -- 172.21.15.1:0/3205402417 wait complete. 2023-11-15T01:22:42.711 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-11-15T01:22:42.712 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-11-15T01:22:42.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.833+0000 7f6b29ffc700 1 Processor -- start 2023-11-15T01:22:42.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.834+0000 7f6b29ffc700 1 -- start start 2023-11-15T01:22:42.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.834+0000 7f6b29ffc700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6b2414b350 0x7f6b240c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.834+0000 7f6b29ffc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6b240aa750 0x7f6b24154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.834+0000 7f6b29ffc700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b241580d0 con 0x7f6b2414b730 2023-11-15T01:22:42.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.834+0000 7f6b29ffc700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b24155000 con 0x7f6b240aa750 2023-11-15T01:22:42.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.834+0000 7f6b29ffc700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b241552e0 con 0x7f6b2414b350 2023-11-15T01:22:42.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.834+0000 7f6b23fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6b240aa750 0x7f6b24154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.835+0000 7f6b23fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6b240aa750 0x7f6b24154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50088/0 (socket says 172.21.15.1:50088) 2023-11-15T01:22:42.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.835+0000 7f6b23fff700 1 -- 172.21.15.1:0/450204634 learned_addr learned my addr 172.21.15.1:0/450204634 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:42.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.835+0000 7f6b237fe700 1 --2- 172.21.15.1:0/450204634 >> v2:172.21.15.141:3300/0 conn(0x7f6b2414b350 0x7f6b240c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.835+0000 7f6b23fff700 1 -- 172.21.15.1:0/450204634 >> v2:172.21.15.141:3300/0 conn(0x7f6b2414b350 msgr2=0x7f6b240c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:42.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.835+0000 7f6b23fff700 1 --2- 172.21.15.1:0/450204634 >> v2:172.21.15.141:3300/0 conn(0x7f6b2414b350 0x7f6b240c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.835+0000 7f6b23fff700 1 -- 172.21.15.1:0/450204634 >> v1:172.21.15.141:6789/0 conn(0x7f6b2414b730 legacy=0x7f6b240aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:42.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.835+0000 7f6b23fff700 1 -- 172.21.15.1:0/450204634 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b241555c0 con 0x7f6b240aa750 2023-11-15T01:22:42.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.835+0000 7f6b23fff700 1 --2- 172.21.15.1:0/450204634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b240aa750 0x7f6b24154a10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f6b24062ba0 tx=0x7f6b1c009840).ready entity=mon.0 client_cookie=13f31e63acd40960 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:42.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.835+0000 7f6b227fc700 1 -- 172.21.15.1:0/450204634 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c00e070 con 0x7f6b240aa750 2023-11-15T01:22:42.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.835+0000 7f6b227fc700 1 -- 172.21.15.1:0/450204634 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c00ba10 con 0x7f6b240aa750 2023-11-15T01:22:42.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.835+0000 7f6b227fc700 1 -- 172.21.15.1:0/450204634 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c00bd90 con 0x7f6b240aa750 2023-11-15T01:22:42.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.836+0000 7f6b29ffc700 1 -- 172.21.15.1:0/450204634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b240aa750 msgr2=0x7f6b24154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:42.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.836+0000 7f6b29ffc700 1 --2- 172.21.15.1:0/450204634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b240aa750 0x7f6b24154a10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f6b24062ba0 tx=0x7f6b1c009840).stop 2023-11-15T01:22:42.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.836+0000 7f6b29ffc700 1 -- 172.21.15.1:0/450204634 shutdown_connections 2023-11-15T01:22:42.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.836+0000 7f6b29ffc700 1 --2- 172.21.15.1:0/450204634 >> v2:172.21.15.141:3300/0 conn(0x7f6b2414b350 0x7f6b240c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.836+0000 7f6b29ffc700 1 --2- 172.21.15.1:0/450204634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b240aa750 0x7f6b24154a10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.836+0000 7f6b29ffc700 1 -- 172.21.15.1:0/450204634 >> 172.21.15.1:0/450204634 conn(0x7f6b24069ee0 msgr2=0x7f6b2406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:42.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.836+0000 7f6b29ffc700 1 -- 172.21.15.1:0/450204634 shutdown_connections 2023-11-15T01:22:42.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.836+0000 7f6b29ffc700 1 -- 172.21.15.1:0/450204634 wait complete. 2023-11-15T01:22:42.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.837+0000 7f6b29ffc700 1 Processor -- start 2023-11-15T01:22:42.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.837+0000 7f6b29ffc700 1 -- start start 2023-11-15T01:22:42.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b29ffc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b240aa750 0x7f6b240c3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b29ffc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b2414b350 0x7f6b24164bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b29ffc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2414b730 0x7f6b240a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b29ffc700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b240aff90 con 0x7f6b2414b730 2023-11-15T01:22:42.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b29ffc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b241650c0 con 0x7f6b2414b350 2023-11-15T01:22:42.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b29ffc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b240c3cb0 con 0x7f6b240aa750 2023-11-15T01:22:42.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b23fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2414b730 0x7f6b240a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b23fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2414b730 0x7f6b240a9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50104/0 (socket says 172.21.15.1:50104) 2023-11-15T01:22:42.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b23fff700 1 -- 172.21.15.1:0/2133815091 learned_addr learned my addr 172.21.15.1:0/2133815091 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:42.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b22ffd700 1 --2- 172.21.15.1:0/2133815091 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b2414b350 0x7f6b24164bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b237fe700 1 --2- 172.21.15.1:0/2133815091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b240aa750 0x7f6b240c3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b23fff700 1 -- 172.21.15.1:0/2133815091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b240aa750 msgr2=0x7f6b240c3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:42.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b23fff700 1 --2- 172.21.15.1:0/2133815091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b240aa750 0x7f6b240c3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b23fff700 1 -- 172.21.15.1:0/2133815091 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b2414b350 msgr2=0x7f6b24164bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:42.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b23fff700 1 --2- 172.21.15.1:0/2133815091 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b2414b350 0x7f6b24164bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:42.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b23fff700 1 -- 172.21.15.1:0/2133815091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c009ae0 con 0x7f6b2414b730 2023-11-15T01:22:42.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b237fe700 1 --2- 172.21.15.1:0/2133815091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b240aa750 0x7f6b240c3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:22:42.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.838+0000 7f6b23fff700 1 --2- 172.21.15.1:0/2133815091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2414b730 0x7f6b240a9690 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f6b1c010000 tx=0x7f6b1c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:42.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.839+0000 7f6b0b7fe700 1 -- 172.21.15.1:0/2133815091 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0092e0 con 0x7f6b2414b730 2023-11-15T01:22:42.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.839+0000 7f6b0b7fe700 1 -- 172.21.15.1:0/2133815091 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c01d410 con 0x7f6b2414b730 2023-11-15T01:22:42.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.839+0000 7f6b29ffc700 1 -- 172.21.15.1:0/2133815091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b240a9b80 con 0x7f6b2414b730 2023-11-15T01:22:42.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.839+0000 7f6b0b7fe700 1 -- 172.21.15.1:0/2133815091 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c01d790 con 0x7f6b2414b730 2023-11-15T01:22:42.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.839+0000 7f6b29ffc700 1 -- 172.21.15.1:0/2133815091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b240c39d0 con 0x7f6b2414b730 2023-11-15T01:22:42.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.840+0000 7f6b29ffc700 1 -- 172.21.15.1:0/2133815091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b240b0140 con 0x7f6b2414b730 2023-11-15T01:22:42.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.840+0000 7f6b0b7fe700 1 -- 172.21.15.1:0/2133815091 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f6b1c01db00 con 0x7f6b2414b730 2023-11-15T01:22:42.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.840+0000 7f6b0b7fe700 1 --2- 172.21.15.1:0/2133815091 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b1005f350 0x7f6b10061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:42.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.840+0000 7f6b0b7fe700 1 -- 172.21.15.1:0/2133815091 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f6b1c07c250 con 0x7f6b2414b730 2023-11-15T01:22:42.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.841+0000 7f6b237fe700 1 --2- 172.21.15.1:0/2133815091 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b1005f350 0x7f6b10061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:42.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.841+0000 7f6b237fe700 1 --2- 172.21.15.1:0/2133815091 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b1005f350 0x7f6b10061810 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6b1400bb60 tx=0x7f6b14008040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:42.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:42.845+0000 7f6b0b7fe700 1 -- 172.21.15.1:0/2133815091 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6b1c04d210 con 0x7f6b2414b730 2023-11-15T01:22:43.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.042+0000 7f6b29ffc700 1 -- 172.21.15.1:0/2133815091 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b240b0140 con 0x7f6b1005f350 2023-11-15T01:22:43.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.046+0000 7f6b0b7fe700 1 -- 172.21.15.1:0/2133815091 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f6b240b0140 con 0x7f6b1005f350 2023-11-15T01:22:43.048 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-11-15T01:22:43.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.048+0000 7f6b29ffc700 1 -- 172.21.15.1:0/2133815091 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b1005f350 msgr2=0x7f6b10061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:43.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.048+0000 7f6b29ffc700 1 --2- 172.21.15.1:0/2133815091 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b1005f350 0x7f6b10061810 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6b1400bb60 tx=0x7f6b14008040).stop 2023-11-15T01:22:43.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.048+0000 7f6b29ffc700 1 -- 172.21.15.1:0/2133815091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2414b730 msgr2=0x7f6b240a9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:43.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.048+0000 7f6b29ffc700 1 --2- 172.21.15.1:0/2133815091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2414b730 0x7f6b240a9690 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f6b1c010000 tx=0x7f6b1c009840).stop 2023-11-15T01:22:43.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.048+0000 7f6b29ffc700 1 -- 172.21.15.1:0/2133815091 shutdown_connections 2023-11-15T01:22:43.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.048+0000 7f6b29ffc700 1 --2- 172.21.15.1:0/2133815091 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b1005f350 0x7f6b10061810 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.048+0000 7f6b29ffc700 1 --2- 172.21.15.1:0/2133815091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2414b730 0x7f6b240a9690 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.048+0000 7f6b29ffc700 1 --2- 172.21.15.1:0/2133815091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b240aa750 0x7f6b240c3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.048+0000 7f6b29ffc700 1 --2- 172.21.15.1:0/2133815091 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b2414b350 0x7f6b24164bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.048+0000 7f6b29ffc700 1 -- 172.21.15.1:0/2133815091 >> 172.21.15.1:0/2133815091 conn(0x7f6b24069ee0 msgr2=0x7f6b24063480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:43.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.048+0000 7f6b29ffc700 1 -- 172.21.15.1:0/2133815091 shutdown_connections 2023-11-15T01:22:43.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.048+0000 7f6b29ffc700 1 -- 172.21.15.1:0/2133815091 wait complete. 2023-11-15T01:22:43.062 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-11-15T01:22:43.062 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-11-15T01:22:43.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.184+0000 7f14c10a9700 1 Processor -- start 2023-11-15T01:22:43.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.184+0000 7f14c10a9700 1 -- start start 2023-11-15T01:22:43.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.185+0000 7f14c10a9700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f14bc0c3510 0x7f14bc0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:43.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.185+0000 7f14c10a9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14bc064660 0x7f14bc064ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:43.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.185+0000 7f14c10a9700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14bc0c39a0 con 0x7f14bc0c53b0 2023-11-15T01:22:43.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.185+0000 7f14c10a9700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14bc0835c0 con 0x7f14bc0c3510 2023-11-15T01:22:43.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.185+0000 7f14c10a9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0c5790 con 0x7f14bc064660 2023-11-15T01:22:43.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.185+0000 7f14ba59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f14bc0c3510 0x7f14bc0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:43.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.185+0000 7f14ba59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f14bc0c3510 0x7f14bc0c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50114/0 (socket says 172.21.15.1:50114) 2023-11-15T01:22:43.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.185+0000 7f14ba59c700 1 -- 172.21.15.1:0/2556395955 learned_addr learned my addr 172.21.15.1:0/2556395955 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:43.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14bb59e700 1 --2- 172.21.15.1:0/2556395955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14bc064660 0x7f14bc064ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:43.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14ba59c700 1 -- 172.21.15.1:0/2556395955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14bc064660 msgr2=0x7f14bc064ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:43.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14ba59c700 1 --2- 172.21.15.1:0/2556395955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14bc064660 0x7f14bc064ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14ba59c700 1 -- 172.21.15.1:0/2556395955 >> v1:172.21.15.141:6789/0 conn(0x7f14bc0c53b0 legacy=0x7f14bc0c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:43.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14ba59c700 1 -- 172.21.15.1:0/2556395955 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc0c6eb0 con 0x7f14bc0c3510 2023-11-15T01:22:43.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14ba59c700 1 --2- 172.21.15.1:0/2556395955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14bc0c3510 0x7f14bc0c8660 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f14a4006fd0 tx=0x7f14a40090f0).ready entity=mon.0 client_cookie=59436c974e13a1f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:43.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14b9d9b700 1 -- 172.21.15.1:0/2556395955 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a400b690 con 0x7f14bc0c3510 2023-11-15T01:22:43.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14b9d9b700 1 -- 172.21.15.1:0/2556395955 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a400b7f0 con 0x7f14bc0c3510 2023-11-15T01:22:43.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14b9d9b700 1 -- 172.21.15.1:0/2556395955 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a400bb70 con 0x7f14bc0c3510 2023-11-15T01:22:43.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14c10a9700 1 -- 172.21.15.1:0/2556395955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14bc0c3510 msgr2=0x7f14bc0c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:43.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14c10a9700 1 --2- 172.21.15.1:0/2556395955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14bc0c3510 0x7f14bc0c8660 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f14a4006fd0 tx=0x7f14a40090f0).stop 2023-11-15T01:22:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14c10a9700 1 -- 172.21.15.1:0/2556395955 shutdown_connections 2023-11-15T01:22:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14c10a9700 1 --2- 172.21.15.1:0/2556395955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14bc064660 0x7f14bc064ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14c10a9700 1 --2- 172.21.15.1:0/2556395955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14bc0c3510 0x7f14bc0c8660 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14c10a9700 1 -- 172.21.15.1:0/2556395955 >> 172.21.15.1:0/2556395955 conn(0x7f14bc082f90 msgr2=0x7f14bc0c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14c10a9700 1 -- 172.21.15.1:0/2556395955 shutdown_connections 2023-11-15T01:22:43.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.186+0000 7f14c10a9700 1 -- 172.21.15.1:0/2556395955 wait complete. 2023-11-15T01:22:43.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.188+0000 7f14c10a9700 1 Processor -- start 2023-11-15T01:22:43.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.188+0000 7f14c10a9700 1 -- start start 2023-11-15T01:22:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.188+0000 7f14c10a9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14bc064660 0x7f14bc0c1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.188+0000 7f14c10a9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14bc0c3510 0x7f14bc0a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.188+0000 7f14c10a9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14bc0c53b0 0x7f14bc140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.188+0000 7f14c10a9700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0ac8a0 con 0x7f14bc0c3510 2023-11-15T01:22:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.188+0000 7f14c10a9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0c2350 con 0x7f14bc0c53b0 2023-11-15T01:22:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.188+0000 7f14c10a9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0a9ec0 con 0x7f14bc064660 2023-11-15T01:22:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14ba59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14bc0c3510 0x7f14bc0a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14ba59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14bc0c3510 0x7f14bc0a8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50118/0 (socket says 172.21.15.1:50118) 2023-11-15T01:22:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14ba59c700 1 -- 172.21.15.1:0/4228478417 learned_addr learned my addr 172.21.15.1:0/4228478417 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14ba59c700 1 -- 172.21.15.1:0/4228478417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14bc064660 msgr2=0x7f14bc0c1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14ba59c700 1 --2- 172.21.15.1:0/4228478417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14bc064660 0x7f14bc0c1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14ba59c700 1 -- 172.21.15.1:0/4228478417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14bc0c53b0 msgr2=0x7f14bc140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14bb59e700 1 --2- 172.21.15.1:0/4228478417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14bc0c53b0 0x7f14bc140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14ba59c700 1 --2- 172.21.15.1:0/4228478417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14bc0c53b0 0x7f14bc140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14ba59c700 1 -- 172.21.15.1:0/4228478417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a4009370 con 0x7f14bc0c3510 2023-11-15T01:22:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14bb59e700 1 --2- 172.21.15.1:0/4228478417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14bc0c53b0 0x7f14bc140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:22:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14ba59c700 1 --2- 172.21.15.1:0/4228478417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14bc0c3510 0x7f14bc0a8ee0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f14a40092f0 tx=0x7f14a4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14b2ffd700 1 -- 172.21.15.1:0/4228478417 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a400bb70 con 0x7f14bc0c3510 2023-11-15T01:22:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14b2ffd700 1 -- 172.21.15.1:0/4228478417 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4000c90 con 0x7f14bc0c3510 2023-11-15T01:22:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14c10a9700 1 -- 172.21.15.1:0/4228478417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14bc0acb40 con 0x7f14bc0c3510 2023-11-15T01:22:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14b2ffd700 1 -- 172.21.15.1:0/4228478417 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a401c670 con 0x7f14bc0c3510 2023-11-15T01:22:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.189+0000 7f14c10a9700 1 -- 172.21.15.1:0/4228478417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc0a93d0 con 0x7f14bc0c3510 2023-11-15T01:22:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.190+0000 7f14c10a9700 1 -- 172.21.15.1:0/4228478417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14bc06c7e0 con 0x7f14bc0c3510 2023-11-15T01:22:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.191+0000 7f14b2ffd700 1 -- 172.21.15.1:0/4228478417 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f14a401c9e0 con 0x7f14bc0c3510 2023-11-15T01:22:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.191+0000 7f14b2ffd700 1 --2- 172.21.15.1:0/4228478417 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f149c05f350 0x7f149c061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.191+0000 7f14b2ffd700 1 -- 172.21.15.1:0/4228478417 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f14a407c350 con 0x7f14bc0c3510 2023-11-15T01:22:43.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.191+0000 7f14bad9d700 1 --2- 172.21.15.1:0/4228478417 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f149c05f350 0x7f149c061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.192+0000 7f14bad9d700 1 --2- 172.21.15.1:0/4228478417 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f149c05f350 0x7f149c061810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f14b4000c00 tx=0x7f14b4007960).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.195+0000 7f14b2ffd700 1 -- 172.21.15.1:0/4228478417 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f14a4050da0 con 0x7f14bc0c3510 2023-11-15T01:22:43.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.397+0000 7f14c10a9700 1 -- 172.21.15.1:0/4228478417 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f14bc0c7190 con 0x7f149c05f350 2023-11-15T01:22:43.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.401+0000 7f14b2ffd700 1 -- 172.21.15.1:0/4228478417 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f14bc0c7190 con 0x7f149c05f350 2023-11-15T01:22:43.403 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-11-15T01:22:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.403+0000 7f14c10a9700 1 -- 172.21.15.1:0/4228478417 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f149c05f350 msgr2=0x7f149c061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.403+0000 7f14c10a9700 1 --2- 172.21.15.1:0/4228478417 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f149c05f350 0x7f149c061810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f14b4000c00 tx=0x7f14b4007960).stop 2023-11-15T01:22:43.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.403+0000 7f14c10a9700 1 -- 172.21.15.1:0/4228478417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14bc0c3510 msgr2=0x7f14bc0a8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:43.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.403+0000 7f14c10a9700 1 --2- 172.21.15.1:0/4228478417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14bc0c3510 0x7f14bc0a8ee0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f14a40092f0 tx=0x7f14a4017000).stop 2023-11-15T01:22:43.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.403+0000 7f14c10a9700 1 -- 172.21.15.1:0/4228478417 shutdown_connections 2023-11-15T01:22:43.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.403+0000 7f14c10a9700 1 --2- 172.21.15.1:0/4228478417 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f149c05f350 0x7f149c061810 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.403+0000 7f14c10a9700 1 --2- 172.21.15.1:0/4228478417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14bc0c53b0 0x7f14bc140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.403+0000 7f14c10a9700 1 --2- 172.21.15.1:0/4228478417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14bc064660 0x7f14bc0c1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:22:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.403+0000 7f14c10a9700 1 --2- 172.21.15.1:0/4228478417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14bc0c3510 0x7f14bc0a8ee0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.403+0000 7f14c10a9700 1 -- 172.21.15.1:0/4228478417 >> 172.21.15.1:0/4228478417 conn(0x7f14bc082f90 msgr2=0x7f14bc0c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.403+0000 7f14c10a9700 1 -- 172.21.15.1:0/4228478417 shutdown_connections 2023-11-15T01:22:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.404+0000 7f14c10a9700 1 -- 172.21.15.1:0/4228478417 wait complete. 2023-11-15T01:22:43.417 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-11-15T01:22:43.417 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-11-15T01:22:43.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.539+0000 7f8eb328c700 1 Processor -- start 2023-11-15T01:22:43.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.539+0000 7f8eb328c700 1 -- start start 2023-11-15T01:22:43.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.540+0000 7f8eb328c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8eac155790 0x7f8eac0a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:43.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.540+0000 7f8eb328c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8eac0a6190 0x7f8eac0c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:43.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.540+0000 7f8eb328c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eac0c7ae0 con 0x7f8eac0833a0 2023-11-15T01:22:43.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.540+0000 7f8eb328c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eac066210 con 0x7f8eac155790 2023-11-15T01:22:43.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.540+0000 7f8eb328c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eac0c77b0 con 0x7f8eac0a6190 2023-11-15T01:22:43.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.540+0000 7f8eb1028700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8eac155790 0x7f8eac0a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:43.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.541+0000 7f8eb1028700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8eac155790 0x7f8eac0a5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50128/0 (socket says 172.21.15.1:50128) 2023-11-15T01:22:43.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.541+0000 7f8eb1028700 1 -- 172.21.15.1:0/4091624286 learned_addr learned my addr 172.21.15.1:0/4091624286 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:43.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.541+0000 7f8eb0827700 1 --2- 172.21.15.1:0/4091624286 >> v2:172.21.15.141:3300/0 conn(0x7f8eac0a6190 0x7f8eac0c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:43.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.541+0000 7f8eb1028700 1 -- 172.21.15.1:0/4091624286 >> v2:172.21.15.141:3300/0 conn(0x7f8eac0a6190 msgr2=0x7f8eac0c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:22:43.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.541+0000 7f8eb1028700 1 --2- 172.21.15.1:0/4091624286 >> v2:172.21.15.141:3300/0 conn(0x7f8eac0a6190 0x7f8eac0c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.541+0000 7f8eb1028700 1 -- 172.21.15.1:0/4091624286 >> v1:172.21.15.141:6789/0 conn(0x7f8eac0833a0 legacy=0x7f8eac0c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:43.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.541+0000 7f8eb1028700 1 -- 172.21.15.1:0/4091624286 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac0c4c50 con 0x7f8eac155790 2023-11-15T01:22:43.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.541+0000 7f8eb1028700 1 --2- 172.21.15.1:0/4091624286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8eac155790 0x7f8eac0a5ca0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f8eac0692b0 tx=0x7f8ea4009060).ready entity=mon.0 client_cookie=9854ed177de487a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:43.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.541+0000 7f8eabfff700 1 -- 172.21.15.1:0/4091624286 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4005880 con 0x7f8eac155790 2023-11-15T01:22:43.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.541+0000 7f8eabfff700 1 -- 172.21.15.1:0/4091624286 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea40059e0 con 0x7f8eac155790 2023-11-15T01:22:43.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.541+0000 7f8eabfff700 1 -- 172.21.15.1:0/4091624286 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4005d60 con 0x7f8eac155790 2023-11-15T01:22:43.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.542+0000 7f8eb328c700 1 -- 172.21.15.1:0/4091624286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8eac155790 msgr2=0x7f8eac0a5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:43.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.542+0000 7f8eb328c700 1 --2- 172.21.15.1:0/4091624286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8eac155790 0x7f8eac0a5ca0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f8eac0692b0 tx=0x7f8ea4009060).stop 2023-11-15T01:22:43.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.542+0000 7f8eb328c700 1 -- 172.21.15.1:0/4091624286 shutdown_connections 2023-11-15T01:22:43.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.542+0000 7f8eb328c700 1 --2- 172.21.15.1:0/4091624286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8eac155790 0x7f8eac0a5ca0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.542+0000 7f8eb328c700 1 --2- 172.21.15.1:0/4091624286 >> v2:172.21.15.141:3300/0 conn(0x7f8eac0a6190 0x7f8eac0c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.542+0000 7f8eb328c700 1 -- 172.21.15.1:0/4091624286 >> 172.21.15.1:0/4091624286 conn(0x7f8eac082f90 msgr2=0x7f8eac0c8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:43.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.542+0000 7f8eb328c700 1 -- 172.21.15.1:0/4091624286 shutdown_connections 2023-11-15T01:22:43.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.542+0000 7f8eb328c700 1 -- 172.21.15.1:0/4091624286 wait complete. 2023-11-15T01:22:43.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.543+0000 7f8eb328c700 1 Processor -- start 2023-11-15T01:22:43.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.543+0000 7f8eb328c700 1 -- start start 2023-11-15T01:22:43.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb328c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8eac0833a0 0x7f8eac13f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:43.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb328c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8eac0a6190 0x7f8eac067800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:43.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb328c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8eac155790 0x7f8eac067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:43.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb328c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac163340 con 0x7f8eac155790 2023-11-15T01:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb328c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac0681e0 con 0x7f8eac0833a0 2023-11-15T01:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb328c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac0ade20 con 0x7f8eac0a6190 2023-11-15T01:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb1829700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8eac155790 0x7f8eac067cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb1829700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8eac155790 0x7f8eac067cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50132/0 (socket says 172.21.15.1:50132) 2023-11-15T01:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb1028700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8eac0833a0 0x7f8eac13f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb1829700 1 -- 172.21.15.1:0/3510739611 learned_addr learned my addr 172.21.15.1:0/3510739611 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb0827700 1 --2- 172.21.15.1:0/3510739611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8eac0a6190 0x7f8eac067800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb1829700 1 -- 172.21.15.1:0/3510739611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8eac0a6190 msgr2=0x7f8eac067800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb1829700 1 --2- 172.21.15.1:0/3510739611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8eac0a6190 0x7f8eac067800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb1829700 1 -- 172.21.15.1:0/3510739611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8eac0833a0 msgr2=0x7f8eac13f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:43.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb1829700 1 --2- 172.21.15.1:0/3510739611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8eac0833a0 0x7f8eac13f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb1829700 1 -- 172.21.15.1:0/3510739611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4009300 con 0x7f8eac155790 2023-11-15T01:22:43.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.544+0000 7f8eb1829700 1 --2- 172.21.15.1:0/3510739611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8eac155790 0x7f8eac067cf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f8e9c002230 tx=0x7f8e9c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:43.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.545+0000 7f8ea97fa700 1 -- 172.21.15.1:0/3510739611 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c00e4a0 con 0x7f8eac155790 2023-11-15T01:22:43.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.545+0000 7f8ea97fa700 1 -- 172.21.15.1:0/3510739611 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c00e600 con 0x7f8eac155790 2023-11-15T01:22:43.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.545+0000 7f8ea97fa700 1 -- 172.21.15.1:0/3510739611 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c00e980 con 0x7f8eac155790 2023-11-15T01:22:43.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.545+0000 7f8eb328c700 1 -- 172.21.15.1:0/3510739611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eac0ae980 con 0x7f8eac155790 2023-11-15T01:22:43.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.545+0000 7f8eb328c700 1 -- 172.21.15.1:0/3510739611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eac0ae330 con 0x7f8eac155790 2023-11-15T01:22:43.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.546+0000 7f8eb328c700 1 -- 172.21.15.1:0/3510739611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac0aeb10 con 0x7f8eac155790 2023-11-15T01:22:43.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.546+0000 7f8ea97fa700 1 -- 172.21.15.1:0/3510739611 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f8e9c01b3b0 con 0x7f8eac155790 2023-11-15T01:22:43.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.546+0000 7f8ea97fa700 1 --2- 172.21.15.1:0/3510739611 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e9805f350 0x7f8e98061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:22:43.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.547+0000 7f8ea97fa700 1 -- 172.21.15.1:0/3510739611 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f8e9c079ba0 con 0x7f8eac155790 2023-11-15T01:22:43.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.547+0000 7f8eb1028700 1 --2- 172.21.15.1:0/3510739611 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e9805f350 0x7f8e98061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:22:43.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.547+0000 7f8eb1028700 1 --2- 172.21.15.1:0/3510739611 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e9805f350 0x7f8e98061810 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8ea4009fd0 tx=0x7f8ea4016000).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:22:43.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.551+0000 7f8ea97fa700 1 -- 172.21.15.1:0/3510739611 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8e9c048af0 con 0x7f8eac155790 2023-11-15T01:22:43.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.752+0000 7f8eb328c700 1 -- 172.21.15.1:0/3510739611 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8eac0c4f30 con 0x7f8e9805f350 2023-11-15T01:22:43.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.757+0000 7f8ea97fa700 1 -- 172.21.15.1:0/3510739611 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f8eac0c4f30 con 0x7f8e9805f350 2023-11-15T01:22:43.758 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-11-15T01:22:43.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.758+0000 7f8eb328c700 1 -- 172.21.15.1:0/3510739611 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e9805f350 msgr2=0x7f8e98061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:43.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.758+0000 7f8eb328c700 1 --2- 172.21.15.1:0/3510739611 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e9805f350 0x7f8e98061810 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8ea4009fd0 tx=0x7f8ea4016000).stop 2023-11-15T01:22:43.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.758+0000 7f8eb328c700 1 -- 172.21.15.1:0/3510739611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8eac155790 msgr2=0x7f8eac067cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:22:43.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.758+0000 7f8eb328c700 1 --2- 172.21.15.1:0/3510739611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8eac155790 0x7f8eac067cf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f8e9c002230 tx=0x7f8e9c0015e0).stop 2023-11-15T01:22:43.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.759+0000 7f8eb328c700 1 -- 172.21.15.1:0/3510739611 shutdown_connections 2023-11-15T01:22:43.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.759+0000 7f8eb328c700 1 --2- 172.21.15.1:0/3510739611 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e9805f350 0x7f8e98061810 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.759+0000 7f8eb328c700 1 --2- 172.21.15.1:0/3510739611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8eac155790 0x7f8eac067cf0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.759+0000 7f8eb328c700 1 --2- 172.21.15.1:0/3510739611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8eac0833a0 0x7f8eac13f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.759+0000 7f8eb328c700 1 --2- 172.21.15.1:0/3510739611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8eac0a6190 0x7f8eac067800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:22:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.759+0000 7f8eb328c700 1 -- 172.21.15.1:0/3510739611 >> 172.21.15.1:0/3510739611 conn(0x7f8eac082f90 msgr2=0x7f8eac0c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:22:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.759+0000 7f8eb328c700 1 -- 172.21.15.1:0/3510739611 shutdown_connections 2023-11-15T01:22:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:22:43.759+0000 7f8eb328c700 1 -- 172.21.15.1:0/3510739611 wait complete. 2023-11-15T01:22:43.772 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-11-15T01:22:45.053 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:22:45.056 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:23:00.053 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:23:00.052+0000 7f8ea329a700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:23:00.053 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:23:00.052+0000 7f8ea329a700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:23:00.054 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:23:00.052+0000 7f8ea329a700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:23:00.054 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:23:00.052+0000 7f8ea329a700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:23:00.055 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:23:00.052+0000 7f8ea329a700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:23:15.118 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:23:15.122 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:23:45.188 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:23:45.192 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:24:15.259 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:24:15.261 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:24:45.329 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:24:45.332 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:25:15.426 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:25:15.430 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:25:45.496 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:25:45.500 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:26:15.575 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:26:15.578 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:26:45.639 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:26:45.642 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:27:15.735 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:27:15.738 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:27:45.806 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:27:45.809 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:28:15.878 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:28:15.882 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:28:45.961 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:28:45.964 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:29:16.015 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:29:16.018 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:29:46.071 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:29:46.075 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:30:16.168 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:30:16.171 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:30:46.272 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:30:46.275 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:31:16.364 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:31:16.368 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:31:46.449 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:31:46.452 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:32:16.511 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:32:16.515 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:32:46.574 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:32:46.577 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:33:16.645 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:33:16.648 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:33:18.774 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-11-15T01:33:18.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.912+0000 7f365b4d2700 1 Processor -- start 2023-11-15T01:33:18.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.912+0000 7f365b4d2700 1 -- start start 2023-11-15T01:33:18.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.913+0000 7f365b4d2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36540aa750 0x7f36540c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:18.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.913+0000 7f365b4d2700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f365414b730 0x7f3654154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:18.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.913+0000 7f365b4d2700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36541580d0 con 0x7f365414b350 2023-11-15T01:33:18.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.913+0000 7f365b4d2700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3654155000 con 0x7f365414b730 2023-11-15T01:33:18.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.913+0000 7f365b4d2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36541552e0 con 0x7f36540aa750 2023-11-15T01:33:18.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.913+0000 7f365926e700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f365414b350 0x7f36540aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48192/0 (socket says 172.21.15.1:48192) 2023-11-15T01:33:18.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.913+0000 7f365926e700 1 -- 172.21.15.1:0/689171973 learned_addr learned my addr 172.21.15.1:0/689171973 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:18.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.914+0000 7f3659a6f700 1 --2- 172.21.15.1:0/689171973 >> v2:172.21.15.141:3300/0 conn(0x7f365414b730 0x7f3654154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:18.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.914+0000 7f3658a6d700 1 --2- 172.21.15.1:0/689171973 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36540aa750 0x7f36540c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:18.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.914+0000 7f3653fff700 1 -- 172.21.15.1:0/689171973 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358314847 0 0) 0x7f36541580d0 con 0x7f365414b350 2023-11-15T01:33:18.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.914+0000 7f3653fff700 1 -- 172.21.15.1:0/689171973 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f363c0033f0 con 0x7f365414b350 2023-11-15T01:33:18.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.914+0000 7f3658a6d700 1 -- 172.21.15.1:0/689171973 >> v2:172.21.15.141:3300/0 conn(0x7f365414b730 msgr2=0x7f3654154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:18.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.914+0000 7f3658a6d700 1 --2- 172.21.15.1:0/689171973 >> v2:172.21.15.141:3300/0 conn(0x7f365414b730 0x7f3654154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:18.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.914+0000 7f3658a6d700 1 -- 172.21.15.1:0/689171973 >> v1:172.21.15.1:6789/0 conn(0x7f365414b350 legacy=0x7f36540aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:18.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.914+0000 7f3658a6d700 1 -- 172.21.15.1:0/689171973 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36541555c0 con 0x7f36540aa750 2023-11-15T01:33:18.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.914+0000 7f3659a6f700 1 --2- 172.21.15.1:0/689171973 >> v2:172.21.15.141:3300/0 conn(0x7f365414b730 0x7f3654154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:18.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.914+0000 7f3658a6d700 1 --2- 172.21.15.1:0/689171973 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36540aa750 0x7f36540c8290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3648009760 tx=0x7f3648009060).ready entity=mon.2 client_cookie=ca90b242990f30b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:18.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.914+0000 7f3653fff700 1 -- 172.21.15.1:0/689171973 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364800d4a0 con 0x7f36540aa750 2023-11-15T01:33:18.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.914+0000 7f3653fff700 1 -- 172.21.15.1:0/689171973 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364800d600 con 0x7f36540aa750 2023-11-15T01:33:18.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.914+0000 7f3653fff700 1 -- 172.21.15.1:0/689171973 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364800d980 con 0x7f36540aa750 2023-11-15T01:33:18.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.915+0000 7f365b4d2700 1 -- 172.21.15.1:0/689171973 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36540aa750 msgr2=0x7f36540c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:18.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.915+0000 7f365b4d2700 1 --2- 172.21.15.1:0/689171973 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36540aa750 0x7f36540c8290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3648009760 tx=0x7f3648009060).stop 2023-11-15T01:33:18.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.915+0000 7f365b4d2700 1 -- 172.21.15.1:0/689171973 shutdown_connections 2023-11-15T01:33:18.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.915+0000 7f365b4d2700 1 --2- 172.21.15.1:0/689171973 >> v2:172.21.15.141:3300/0 conn(0x7f365414b730 0x7f3654154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:18.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.915+0000 7f365b4d2700 1 --2- 172.21.15.1:0/689171973 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36540aa750 0x7f36540c8290 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:18.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.915+0000 7f365b4d2700 1 -- 172.21.15.1:0/689171973 >> 172.21.15.1:0/689171973 conn(0x7f3654069ee0 msgr2=0x7f365406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:18.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.915+0000 7f365b4d2700 1 -- 172.21.15.1:0/689171973 shutdown_connections 2023-11-15T01:33:18.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.915+0000 7f365b4d2700 1 -- 172.21.15.1:0/689171973 wait complete. 2023-11-15T01:33:18.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.916+0000 7f365b4d2700 1 Processor -- start 2023-11-15T01:33:18.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.916+0000 7f365b4d2700 1 -- start start 2023-11-15T01:33:18.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.917+0000 7f365b4d2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36540aa750 0x7f365414e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:18.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.917+0000 7f365b4d2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f365414b350 0x7f36540ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:18.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.917+0000 7f365b4d2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f365414b730 0x7f36540ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:18.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.917+0000 7f365b4d2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36541494d0 con 0x7f365414b730 2023-11-15T01:33:18.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.917+0000 7f365b4d2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36540abb80 con 0x7f36540aa750 2023-11-15T01:33:18.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.917+0000 7f365b4d2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36540abe60 con 0x7f365414b350 2023-11-15T01:33:18.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.917+0000 7f3659a6f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f365414b730 0x7f36540ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:18.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.917+0000 7f3659a6f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f365414b730 0x7f36540ab5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49744/0 (socket says 172.21.15.1:49744) 2023-11-15T01:33:18.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.917+0000 7f3659a6f700 1 -- 172.21.15.1:0/2041927144 learned_addr learned my addr 172.21.15.1:0/2041927144 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:18.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.917+0000 7f365926e700 1 --2- 172.21.15.1:0/2041927144 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36540aa750 0x7f365414e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:18.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.917+0000 7f3658a6d700 1 --2- 172.21.15.1:0/2041927144 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f365414b350 0x7f36540ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:18.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.918+0000 7f3659a6f700 1 -- 172.21.15.1:0/2041927144 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f365414b350 msgr2=0x7f36540ab0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:18.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.918+0000 7f3659a6f700 1 --2- 172.21.15.1:0/2041927144 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f365414b350 0x7f36540ab0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:18.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.918+0000 7f3659a6f700 1 -- 172.21.15.1:0/2041927144 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36540aa750 msgr2=0x7f365414e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:18.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.918+0000 7f3659a6f700 1 --2- 172.21.15.1:0/2041927144 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36540aa750 0x7f365414e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:18.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.918+0000 7f3659a6f700 1 -- 172.21.15.1:0/2041927144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3644009a20 con 0x7f365414b730 2023-11-15T01:33:18.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.918+0000 7f3659a6f700 1 --2- 172.21.15.1:0/2041927144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f365414b730 0x7f36540ab5b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f3644009ec0 tx=0x7f364400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:18.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.918+0000 7f36517fa700 1 -- 172.21.15.1:0/2041927144 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364400cb70 con 0x7f365414b730 2023-11-15T01:33:18.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.918+0000 7f36517fa700 1 -- 172.21.15.1:0/2041927144 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364400f040 con 0x7f365414b730 2023-11-15T01:33:18.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.918+0000 7f36517fa700 1 -- 172.21.15.1:0/2041927144 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644013400 con 0x7f365414b730 2023-11-15T01:33:18.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.918+0000 7f365b4d2700 1 -- 172.21.15.1:0/2041927144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36480092a0 con 0x7f365414b730 2023-11-15T01:33:18.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.918+0000 7f365b4d2700 1 -- 172.21.15.1:0/2041927144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36540ac420 con 0x7f365414b730 2023-11-15T01:33:18.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.919+0000 7f365b4d2700 1 -- 172.21.15.1:0/2041927144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36540aca70 con 0x7f365414b730 2023-11-15T01:33:18.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.919+0000 7f36517fa700 1 -- 172.21.15.1:0/2041927144 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f36440137b0 con 0x7f365414b730 2023-11-15T01:33:18.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.920+0000 7f36517fa700 1 --2- 172.21.15.1:0/2041927144 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f364005f2c0 0x7f3640061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:18.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.920+0000 7f36517fa700 1 -- 172.21.15.1:0/2041927144 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f364407ad60 con 0x7f365414b730 2023-11-15T01:33:18.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.920+0000 7f365926e700 1 --2- 172.21.15.1:0/2041927144 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f364005f2c0 0x7f3640061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:18.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.920+0000 7f365926e700 1 --2- 172.21.15.1:0/2041927144 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f364005f2c0 0x7f3640061780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f364c005750 tx=0x7f364c009040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:18.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:18.924+0000 7f36517fa700 1 -- 172.21.15.1:0/2041927144 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f364404bde0 con 0x7f365414b730 2023-11-15T01:33:19.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.127+0000 7f365b4d2700 1 -- 172.21.15.1:0/2041927144 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f365406c7e0 con 0x7f364005f2c0 2023-11-15T01:33:19.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.132+0000 7f36517fa700 1 -- 172.21.15.1:0/2041927144 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f365406c7e0 con 0x7f364005f2c0 2023-11-15T01:33:19.132 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-11-15T01:33:19.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.134+0000 7f365b4d2700 1 -- 172.21.15.1:0/2041927144 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f364005f2c0 msgr2=0x7f3640061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.134+0000 7f365b4d2700 1 --2- 172.21.15.1:0/2041927144 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f364005f2c0 0x7f3640061780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f364c005750 tx=0x7f364c009040).stop 2023-11-15T01:33:19.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.134+0000 7f365b4d2700 1 -- 172.21.15.1:0/2041927144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f365414b730 msgr2=0x7f36540ab5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.134+0000 7f365b4d2700 1 --2- 172.21.15.1:0/2041927144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f365414b730 0x7f36540ab5b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f3644009ec0 tx=0x7f364400b040).stop 2023-11-15T01:33:19.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.134+0000 7f365b4d2700 1 -- 172.21.15.1:0/2041927144 shutdown_connections 2023-11-15T01:33:19.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.134+0000 7f365b4d2700 1 --2- 172.21.15.1:0/2041927144 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f364005f2c0 0x7f3640061780 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.134+0000 7f365b4d2700 1 --2- 172.21.15.1:0/2041927144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f365414b730 0x7f36540ab5b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.134+0000 7f365b4d2700 1 --2- 172.21.15.1:0/2041927144 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36540aa750 0x7f365414e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.134+0000 7f365b4d2700 1 --2- 172.21.15.1:0/2041927144 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f365414b350 0x7f36540ab0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.134+0000 7f365b4d2700 1 -- 172.21.15.1:0/2041927144 >> 172.21.15.1:0/2041927144 conn(0x7f3654069ee0 msgr2=0x7f3654155800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:19.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.134+0000 7f365b4d2700 1 -- 172.21.15.1:0/2041927144 shutdown_connections 2023-11-15T01:33:19.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.134+0000 7f365b4d2700 1 -- 172.21.15.1:0/2041927144 wait complete. 2023-11-15T01:33:19.146 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-11-15T01:33:19.146 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-11-15T01:33:19.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.270+0000 7fef0759e700 1 Processor -- start 2023-11-15T01:33:19.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.270+0000 7fef0759e700 1 -- start start 2023-11-15T01:33:19.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.271+0000 7fef0759e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef08063b50 0x7fef080aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.271+0000 7fef0759e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fef08155610 0x7fef0815df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.271+0000 7fef0759e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef081548f0 con 0x7fef080ca5d0 2023-11-15T01:33:19.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.271+0000 7fef0759e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef080aaa50 con 0x7fef08155610 2023-11-15T01:33:19.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.271+0000 7fef0759e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef080aa4f0 con 0x7fef08063b50 2023-11-15T01:33:19.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.271+0000 7fef06d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fef08155610 0x7fef0815df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.271+0000 7fef06d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fef08155610 0x7fef0815df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49748/0 (socket says 172.21.15.1:49748) 2023-11-15T01:33:19.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.271+0000 7fef0659c700 1 --1- 172.21.15.1:0/1020266083 >> v1:172.21.15.1:6789/0 conn(0x7fef080ca5d0 0x7fef08063440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48196/0 (socket says 172.21.15.1:48196) 2023-11-15T01:33:19.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.271+0000 7fef06d9d700 1 -- 172.21.15.1:0/1020266083 learned_addr learned my addr 172.21.15.1:0/1020266083 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:19.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.271+0000 7fef05d9b700 1 --2- 172.21.15.1:0/1020266083 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef08063b50 0x7fef080aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.271+0000 7fef06d9d700 1 -- 172.21.15.1:0/1020266083 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef08063b50 msgr2=0x7fef080aa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:19.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.271+0000 7fef06d9d700 1 --2- 172.21.15.1:0/1020266083 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef08063b50 0x7fef080aa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.271+0000 7fef06d9d700 1 -- 172.21.15.1:0/1020266083 >> v1:172.21.15.1:6789/0 conn(0x7fef080ca5d0 legacy=0x7fef08063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.271+0000 7fef0559a700 1 -- 172.21.15.1:0/1020266083 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463128280 0 0) 0x7feef8001110 con 0x7fef080ca5d0 2023-11-15T01:33:19.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.272+0000 7fef06d9d700 1 -- 172.21.15.1:0/1020266083 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef080aa770 con 0x7fef08155610 2023-11-15T01:33:19.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.272+0000 7fef06d9d700 1 --2- 172.21.15.1:0/1020266083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef08155610 0x7fef0815df20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fef00009f50 tx=0x7fef00009840).ready entity=mon.0 client_cookie=11ea2aca81965210 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:19.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.272+0000 7fef0559a700 1 -- 172.21.15.1:0/1020266083 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0000e070 con 0x7fef08155610 2023-11-15T01:33:19.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.272+0000 7fef0559a700 1 -- 172.21.15.1:0/1020266083 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0000b9c0 con 0x7fef08155610 2023-11-15T01:33:19.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.272+0000 7fef0559a700 1 -- 172.21.15.1:0/1020266083 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0000bd40 con 0x7fef08155610 2023-11-15T01:33:19.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.272+0000 7fef0759e700 1 -- 172.21.15.1:0/1020266083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef08155610 msgr2=0x7fef0815df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.272+0000 7fef0759e700 1 --2- 172.21.15.1:0/1020266083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef08155610 0x7fef0815df20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fef00009f50 tx=0x7fef00009840).stop 2023-11-15T01:33:19.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.272+0000 7fef0759e700 1 -- 172.21.15.1:0/1020266083 shutdown_connections 2023-11-15T01:33:19.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.272+0000 7fef0759e700 1 --2- 172.21.15.1:0/1020266083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef08155610 0x7fef0815df20 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.272+0000 7fef0759e700 1 --2- 172.21.15.1:0/1020266083 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef08063b50 0x7fef080aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.272+0000 7fef0759e700 1 -- 172.21.15.1:0/1020266083 >> 172.21.15.1:0/1020266083 conn(0x7fef0806a9b0 msgr2=0x7fef080cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:19.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.272+0000 7fef0759e700 1 -- 172.21.15.1:0/1020266083 shutdown_connections 2023-11-15T01:33:19.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.272+0000 7fef0759e700 1 -- 172.21.15.1:0/1020266083 wait complete. 2023-11-15T01:33:19.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.274+0000 7fef0759e700 1 Processor -- start 2023-11-15T01:33:19.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.274+0000 7fef0759e700 1 -- start start 2023-11-15T01:33:19.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.274+0000 7fef0759e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef08063b50 0x7fef08164f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.274+0000 7fef0759e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef080ca5d0 0x7fef08150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.274+0000 7fef0759e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef08155610 0x7fef080a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.274+0000 7fef0759e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef080b0c60 con 0x7fef080ca5d0 2023-11-15T01:33:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.274+0000 7fef0759e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef080afc50 con 0x7fef08155610 2023-11-15T01:33:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.274+0000 7fef0759e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef080b07d0 con 0x7fef08063b50 2023-11-15T01:33:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.274+0000 7fef05d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef080ca5d0 0x7fef08150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.274+0000 7fef05d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef080ca5d0 0x7fef08150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49754/0 (socket says 172.21.15.1:49754) 2023-11-15T01:33:19.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.274+0000 7fef05d9b700 1 -- 172.21.15.1:0/3466627441 learned_addr learned my addr 172.21.15.1:0/3466627441 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:19.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.275+0000 7fef0659c700 1 --2- 172.21.15.1:0/3466627441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef08063b50 0x7fef08164f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.275+0000 7fef06d9d700 1 --2- 172.21.15.1:0/3466627441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef08155610 0x7fef080a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.275+0000 7fef05d9b700 1 -- 172.21.15.1:0/3466627441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef08063b50 msgr2=0x7fef08164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.275+0000 7fef05d9b700 1 --2- 172.21.15.1:0/3466627441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef08063b50 0x7fef08164f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.275+0000 7fef05d9b700 1 -- 172.21.15.1:0/3466627441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef08155610 msgr2=0x7fef080a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.275+0000 7fef05d9b700 1 --2- 172.21.15.1:0/3466627441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef08155610 0x7fef080a98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.275+0000 7fef05d9b700 1 -- 172.21.15.1:0/3466627441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef00009ae0 con 0x7fef080ca5d0 2023-11-15T01:33:19.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.275+0000 7fef05d9b700 1 --2- 172.21.15.1:0/3466627441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef080ca5d0 0x7fef08150980 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7feefc00e930 tx=0x7feefc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:19.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.275+0000 7feef67fc700 1 -- 172.21.15.1:0/3466627441 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc00eed0 con 0x7fef080ca5d0 2023-11-15T01:33:19.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.275+0000 7feef67fc700 1 -- 172.21.15.1:0/3466627441 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc0094d0 con 0x7fef080ca5d0 2023-11-15T01:33:19.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.275+0000 7fef0759e700 1 -- 172.21.15.1:0/3466627441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef08150e70 con 0x7fef080ca5d0 2023-11-15T01:33:19.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.275+0000 7feef67fc700 1 -- 172.21.15.1:0/3466627441 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc00ca60 con 0x7fef080ca5d0 2023-11-15T01:33:19.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.275+0000 7fef0759e700 1 -- 172.21.15.1:0/3466627441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef080b0180 con 0x7fef080ca5d0 2023-11-15T01:33:19.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.276+0000 7fef0759e700 1 -- 172.21.15.1:0/3466627441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef080c5dd0 con 0x7fef080ca5d0 2023-11-15T01:33:19.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.276+0000 7feef67fc700 1 -- 172.21.15.1:0/3466627441 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7feefc01b400 con 0x7fef080ca5d0 2023-11-15T01:33:19.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.277+0000 7feef67fc700 1 --2- 172.21.15.1:0/3466627441 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feee805f310 0x7feee80617d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.277+0000 7feef67fc700 1 -- 172.21.15.1:0/3466627441 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7feefc07a930 con 0x7fef080ca5d0 2023-11-15T01:33:19.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.277+0000 7fef0659c700 1 --2- 172.21.15.1:0/3466627441 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feee805f310 0x7feee80617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.277+0000 7fef0659c700 1 --2- 172.21.15.1:0/3466627441 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feee805f310 0x7feee80617d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fef08157e10 tx=0x7feef8007180).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:19.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.281+0000 7feef67fc700 1 -- 172.21.15.1:0/3466627441 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7feefc04ba10 con 0x7fef080ca5d0 2023-11-15T01:33:19.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.480+0000 7fef0759e700 1 -- 172.21.15.1:0/3466627441 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fef080b0910 con 0x7feee805f310 2023-11-15T01:33:19.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.485+0000 7feef67fc700 1 -- 172.21.15.1:0/3466627441 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fef080b0910 con 0x7feee805f310 2023-11-15T01:33:19.486 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-11-15T01:33:19.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.486+0000 7fef0759e700 1 -- 172.21.15.1:0/3466627441 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feee805f310 msgr2=0x7feee80617d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.486+0000 7fef0759e700 1 --2- 172.21.15.1:0/3466627441 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feee805f310 0x7feee80617d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fef08157e10 tx=0x7feef8007180).stop 2023-11-15T01:33:19.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.486+0000 7fef0759e700 1 -- 172.21.15.1:0/3466627441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef080ca5d0 msgr2=0x7fef08150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.486+0000 7fef0759e700 1 --2- 172.21.15.1:0/3466627441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef080ca5d0 0x7fef08150980 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7feefc00e930 tx=0x7feefc009060).stop 2023-11-15T01:33:19.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.486+0000 7fef0759e700 1 -- 172.21.15.1:0/3466627441 shutdown_connections 2023-11-15T01:33:19.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.486+0000 7fef0759e700 1 --2- 172.21.15.1:0/3466627441 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feee805f310 0x7feee80617d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.486+0000 7fef0759e700 1 --2- 172.21.15.1:0/3466627441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef08155610 0x7fef080a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.486+0000 7fef0759e700 1 --2- 172.21.15.1:0/3466627441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef08063b50 0x7fef08164f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.487+0000 7fef0759e700 1 --2- 172.21.15.1:0/3466627441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef080ca5d0 0x7fef08150980 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.487+0000 7fef0759e700 1 -- 172.21.15.1:0/3466627441 >> 172.21.15.1:0/3466627441 conn(0x7fef0806a9b0 msgr2=0x7fef081534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:19.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.487+0000 7fef0759e700 1 -- 172.21.15.1:0/3466627441 shutdown_connections 2023-11-15T01:33:19.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.487+0000 7fef0759e700 1 -- 172.21.15.1:0/3466627441 wait complete. 2023-11-15T01:33:19.498 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-11-15T01:33:19.499 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-11-15T01:33:19.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.621+0000 7fd628c8b700 1 Processor -- start 2023-11-15T01:33:19.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.621+0000 7fd628c8b700 1 -- start start 2023-11-15T01:33:19.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd628c8b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd624063b50 0x7fd6240aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd628c8b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6241548f0 con 0x7fd624155610 2023-11-15T01:33:19.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd628c8b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6240aa4f0 con 0x7fd6240ca5d0 2023-11-15T01:33:19.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd628c8b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240aaa50 con 0x7fd624063b50 2023-11-15T01:33:19.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd623fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd624155610 0x7fd62415df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48206/0 (socket says 172.21.15.1:48206) 2023-11-15T01:33:19.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd623fff700 1 -- 172.21.15.1:0/2056744038 learned_addr learned my addr 172.21.15.1:0/2056744038 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:19.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd622ffd700 1 --2- 172.21.15.1:0/2056744038 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd624063b50 0x7fd6240aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418485996 0 0) 0x7fd61c001490 con 0x7fd624155610 2023-11-15T01:33:19.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd60c0033f0 con 0x7fd624155610 2023-11-15T01:33:19.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450988973 0 0) 0x7fd6240aa4f0 con 0x7fd6240ca5d0 2023-11-15T01:33:19.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd61c001490 con 0x7fd6240ca5d0 2023-11-15T01:33:19.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3683382595 0 0) 0x7fd60c0033f0 con 0x7fd624155610 2023-11-15T01:33:19.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd624063b50 msgr2=0x7fd6240aa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:19.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd6227fc700 1 --2- 172.21.15.1:0/2056744038 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd624063b50 0x7fd6240aa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 >> v1:172.21.15.141:6789/0 conn(0x7fd6240ca5d0 legacy=0x7fd624063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6240aa770 con 0x7fd624155610 2023-11-15T01:33:19.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.622+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fd61c001980 con 0x7fd624155610 2023-11-15T01:33:19.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 >> v1:172.21.15.1:6789/0 conn(0x7fd624155610 legacy=0x7fd62415df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd6227fc700 1 --2- 172.21.15.1:0/2056744038 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd624063b50 0x7fd60c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd6227fc700 1 --2- 172.21.15.1:0/2056744038 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd60c003fb0 0x7fd60c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd6227fc700 1 --2- 172.21.15.1:0/2056744038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c004b80 0x7fd60c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240aaa50 con 0x7fd60c004b80 2023-11-15T01:33:19.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c00b990 con 0x7fd60c003fb0 2023-11-15T01:33:19.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c00bb50 con 0x7fd624063b50 2023-11-15T01:33:19.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd623fff700 1 --2- 172.21.15.1:0/2056744038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c004b80 0x7fd60c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd622ffd700 1 --2- 172.21.15.1:0/2056744038 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd60c003fb0 0x7fd60c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd6237fe700 1 --2- 172.21.15.1:0/2056744038 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd624063b50 0x7fd60c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd623fff700 1 -- 172.21.15.1:0/2056744038 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd624063b50 msgr2=0x7fd60c003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:19.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd623fff700 1 --2- 172.21.15.1:0/2056744038 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd624063b50 0x7fd60c003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd623fff700 1 -- 172.21.15.1:0/2056744038 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd60c003fb0 msgr2=0x7fd60c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:19.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd623fff700 1 --2- 172.21.15.1:0/2056744038 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd60c003fb0 0x7fd60c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd623fff700 1 -- 172.21.15.1:0/2056744038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c0033f0 con 0x7fd60c004b80 2023-11-15T01:33:19.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd623fff700 1 --2- 172.21.15.1:0/2056744038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c004b80 0x7fd60c005000 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fd624065aa0 tx=0x7fd61c007c00).ready entity=mon.0 client_cookie=2fc6cfb20bc0d3c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:19.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c005b20 con 0x7fd60c004b80 2023-11-15T01:33:19.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c005c80 con 0x7fd60c004b80 2023-11-15T01:33:19.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.623+0000 7fd6227fc700 1 -- 172.21.15.1:0/2056744038 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c007110 con 0x7fd60c004b80 2023-11-15T01:33:19.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.624+0000 7fd628c8b700 1 -- 172.21.15.1:0/2056744038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c004b80 msgr2=0x7fd60c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.624+0000 7fd628c8b700 1 --2- 172.21.15.1:0/2056744038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c004b80 0x7fd60c005000 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fd624065aa0 tx=0x7fd61c007c00).stop 2023-11-15T01:33:19.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.624+0000 7fd623fff700 1 -- 172.21.15.1:0/2056744038 reap_dead start 2023-11-15T01:33:19.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.624+0000 7fd628c8b700 1 -- 172.21.15.1:0/2056744038 shutdown_connections 2023-11-15T01:33:19.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.624+0000 7fd628c8b700 1 -- 172.21.15.1:0/2056744038 >> 172.21.15.1:0/2056744038 conn(0x7fd62406a9b0 msgr2=0x7fd6240cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:19.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.624+0000 7fd628c8b700 1 -- 172.21.15.1:0/2056744038 shutdown_connections 2023-11-15T01:33:19.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.624+0000 7fd628c8b700 1 -- 172.21.15.1:0/2056744038 wait complete. 2023-11-15T01:33:19.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.625+0000 7fd628c8b700 1 Processor -- start 2023-11-15T01:33:19.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.625+0000 7fd628c8b700 1 -- start start 2023-11-15T01:33:19.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd628c8b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c004b80 0x7fd6240b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd628c8b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd624143c90 0x7fd6240c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd628c8b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd624157070 0x7fd6241574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd628c8b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd624144110 con 0x7fd60c004b80 2023-11-15T01:33:19.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd628c8b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6241579c0 con 0x7fd624143c90 2023-11-15T01:33:19.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd628c8b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6241655c0 con 0x7fd624157070 2023-11-15T01:33:19.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd6237fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c004b80 0x7fd6240b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd6237fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c004b80 0x7fd6240b0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49766/0 (socket says 172.21.15.1:49766) 2023-11-15T01:33:19.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd6237fe700 1 -- 172.21.15.1:0/2039358808 learned_addr learned my addr 172.21.15.1:0/2039358808 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:19.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd623fff700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd624157070 0x7fd6241574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd622ffd700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd624143c90 0x7fd6240c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd6237fe700 1 -- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd624157070 msgr2=0x7fd6241574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd6237fe700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd624157070 0x7fd6241574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd6237fe700 1 -- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd624143c90 msgr2=0x7fd6240c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd6237fe700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd624143c90 0x7fd6240c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd6237fe700 1 -- 172.21.15.1:0/2039358808 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd624165880 con 0x7fd60c004b80 2023-11-15T01:33:19.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd623fff700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd624157070 0x7fd6241574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:19.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd622ffd700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd624143c90 0x7fd6240c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:19.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.626+0000 7fd6237fe700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c004b80 0x7fd6240b0af0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fd614002a00 tx=0x7fd614007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:19.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.627+0000 7fd60b7fe700 1 -- 172.21.15.1:0/2039358808 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61400f8d0 con 0x7fd60c004b80 2023-11-15T01:33:19.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.627+0000 7fd60b7fe700 1 -- 172.21.15.1:0/2039358808 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61400fa30 con 0x7fd60c004b80 2023-11-15T01:33:19.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.627+0000 7fd628c8b700 1 -- 172.21.15.1:0/2039358808 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd624165b60 con 0x7fd60c004b80 2023-11-15T01:33:19.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.627+0000 7fd60b7fe700 1 -- 172.21.15.1:0/2039358808 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61400fdd0 con 0x7fd60c004b80 2023-11-15T01:33:19.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.627+0000 7fd628c8b700 1 -- 172.21.15.1:0/2039358808 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6240c83c0 con 0x7fd60c004b80 2023-11-15T01:33:19.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.628+0000 7fd628c8b700 1 -- 172.21.15.1:0/2039358808 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd624166060 con 0x7fd60c004b80 2023-11-15T01:33:19.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.628+0000 7fd60b7fe700 1 -- 172.21.15.1:0/2039358808 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fd61401d3b0 con 0x7fd60c004b80 2023-11-15T01:33:19.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.628+0000 7fd60b7fe700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd61005f2c0 0x7fd610061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.628+0000 7fd60b7fe700 1 -- 172.21.15.1:0/2039358808 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fd61407a670 con 0x7fd60c004b80 2023-11-15T01:33:19.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.629+0000 7fd622ffd700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd61005f2c0 0x7fd610061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.629+0000 7fd622ffd700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd61005f2c0 0x7fd610061780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd618006d30 tx=0x7fd618008040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:19.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.633+0000 7fd60b7fe700 1 -- 172.21.15.1:0/2039358808 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd61404b690 con 0x7fd60c004b80 2023-11-15T01:33:19.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.835+0000 7fd628c8b700 1 -- 172.21.15.1:0/2039358808 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6240475e0 con 0x7fd61005f2c0 2023-11-15T01:33:19.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.839+0000 7fd60b7fe700 1 -- 172.21.15.1:0/2039358808 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd6240475e0 con 0x7fd61005f2c0 2023-11-15T01:33:19.840 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-11-15T01:33:19.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.841+0000 7fd628c8b700 1 -- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd61005f2c0 msgr2=0x7fd610061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.841+0000 7fd628c8b700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd61005f2c0 0x7fd610061780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd618006d30 tx=0x7fd618008040).stop 2023-11-15T01:33:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.841+0000 7fd628c8b700 1 -- 172.21.15.1:0/2039358808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c004b80 msgr2=0x7fd6240b0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.841+0000 7fd628c8b700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c004b80 0x7fd6240b0af0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fd614002a00 tx=0x7fd614007bb0).stop 2023-11-15T01:33:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.841+0000 7fd628c8b700 1 -- 172.21.15.1:0/2039358808 shutdown_connections 2023-11-15T01:33:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.841+0000 7fd628c8b700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd61005f2c0 0x7fd610061780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.841+0000 7fd628c8b700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd624157070 0x7fd6241574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.841+0000 7fd628c8b700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c004b80 0x7fd6240b0af0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.841+0000 7fd628c8b700 1 --2- 172.21.15.1:0/2039358808 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd624143c90 0x7fd6240c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.841+0000 7fd628c8b700 1 -- 172.21.15.1:0/2039358808 >> 172.21.15.1:0/2039358808 conn(0x7fd62406a9b0 msgr2=0x7fd62405e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.841+0000 7fd628c8b700 1 -- 172.21.15.1:0/2039358808 shutdown_connections 2023-11-15T01:33:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.841+0000 7fd628c8b700 1 -- 172.21.15.1:0/2039358808 wait complete. 2023-11-15T01:33:19.853 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-11-15T01:33:19.854 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-11-15T01:33:19.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.975+0000 7f8d9e160700 1 Processor -- start 2023-11-15T01:33:19.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.975+0000 7f8d9e160700 1 -- start start 2023-11-15T01:33:19.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.976+0000 7f8d9e160700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8d980aa750 0x7f8d980c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.976+0000 7f8d9e160700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8d9814b730 0x7f8d98154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.976+0000 7f8d9e160700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d981580d0 con 0x7f8d9814b350 2023-11-15T01:33:19.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.976+0000 7f8d9e160700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d98155000 con 0x7f8d9814b730 2023-11-15T01:33:19.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.976+0000 7f8d9e160700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d981552e0 con 0x7f8d980aa750 2023-11-15T01:33:19.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.976+0000 7f8d97fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8d9814b730 0x7f8d98154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.976+0000 7f8d97fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8d9814b730 0x7f8d98154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49780/0 (socket says 172.21.15.1:49780) 2023-11-15T01:33:19.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.976+0000 7f8d97fff700 1 -- 172.21.15.1:0/3204541015 learned_addr learned my addr 172.21.15.1:0/3204541015 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:19.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.976+0000 7f8d96ffd700 1 --2- 172.21.15.1:0/3204541015 >> v2:172.21.15.141:3300/0 conn(0x7f8d980aa750 0x7f8d980c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.976+0000 7f8d97fff700 1 -- 172.21.15.1:0/3204541015 >> v2:172.21.15.141:3300/0 conn(0x7f8d980aa750 msgr2=0x7f8d980c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:19.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.976+0000 7f8d97fff700 1 --2- 172.21.15.1:0/3204541015 >> v2:172.21.15.141:3300/0 conn(0x7f8d980aa750 0x7f8d980c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.976+0000 7f8d97fff700 1 -- 172.21.15.1:0/3204541015 >> v1:172.21.15.141:6789/0 conn(0x7f8d9814b350 legacy=0x7f8d980aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.976+0000 7f8d97fff700 1 -- 172.21.15.1:0/3204541015 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d981555c0 con 0x7f8d9814b730 2023-11-15T01:33:19.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.977+0000 7f8d97fff700 1 --2- 172.21.15.1:0/3204541015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9814b730 0x7f8d98154a10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f8d980b13b0 tx=0x7f8d90009840).ready entity=mon.0 client_cookie=be66868b807f1751 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:19.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.977+0000 7f8d967fc700 1 -- 172.21.15.1:0/3204541015 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9000e070 con 0x7f8d9814b730 2023-11-15T01:33:19.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.977+0000 7f8d967fc700 1 -- 172.21.15.1:0/3204541015 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9000ba50 con 0x7f8d9814b730 2023-11-15T01:33:19.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.977+0000 7f8d967fc700 1 -- 172.21.15.1:0/3204541015 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9000bdd0 con 0x7f8d9814b730 2023-11-15T01:33:19.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.977+0000 7f8d9e160700 1 -- 172.21.15.1:0/3204541015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9814b730 msgr2=0x7f8d98154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.977+0000 7f8d9e160700 1 --2- 172.21.15.1:0/3204541015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9814b730 0x7f8d98154a10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f8d980b13b0 tx=0x7f8d90009840).stop 2023-11-15T01:33:19.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.977+0000 7f8d9e160700 1 -- 172.21.15.1:0/3204541015 shutdown_connections 2023-11-15T01:33:19.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.977+0000 7f8d9e160700 1 --2- 172.21.15.1:0/3204541015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9814b730 0x7f8d98154a10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.977+0000 7f8d9e160700 1 --2- 172.21.15.1:0/3204541015 >> v2:172.21.15.141:3300/0 conn(0x7f8d980aa750 0x7f8d980c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.977+0000 7f8d9e160700 1 -- 172.21.15.1:0/3204541015 >> 172.21.15.1:0/3204541015 conn(0x7f8d98069ee0 msgr2=0x7f8d9806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:19.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.977+0000 7f8d9e160700 1 -- 172.21.15.1:0/3204541015 shutdown_connections 2023-11-15T01:33:19.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.977+0000 7f8d9e160700 1 -- 172.21.15.1:0/3204541015 wait complete. 2023-11-15T01:33:19.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.979+0000 7f8d9e160700 1 Processor -- start 2023-11-15T01:33:19.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.979+0000 7f8d9e160700 1 -- start start 2023-11-15T01:33:19.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.979+0000 7f8d9e160700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d980aa750 0x7f8d9814e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.979+0000 7f8d9e160700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8d9814b350 0x7f8d98165830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.979+0000 7f8d9e160700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9814b730 0x7f8d980ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.979+0000 7f8d9e160700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980ac260 con 0x7f8d9814b730 2023-11-15T01:33:19.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.979+0000 7f8d9e160700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d981474b0 con 0x7f8d9814b350 2023-11-15T01:33:19.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.979+0000 7f8d9e160700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980ad070 con 0x7f8d980aa750 2023-11-15T01:33:19.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d97fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9814b730 0x7f8d980ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d97fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9814b730 0x7f8d980ab0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49784/0 (socket says 172.21.15.1:49784) 2023-11-15T01:33:19.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d97fff700 1 -- 172.21.15.1:0/3848707265 learned_addr learned my addr 172.21.15.1:0/3848707265 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:19.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d96ffd700 1 --2- 172.21.15.1:0/3848707265 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8d9814b350 0x7f8d98165830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d977fe700 1 --2- 172.21.15.1:0/3848707265 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d980aa750 0x7f8d9814e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d97fff700 1 -- 172.21.15.1:0/3848707265 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d980aa750 msgr2=0x7f8d9814e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d97fff700 1 --2- 172.21.15.1:0/3848707265 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d980aa750 0x7f8d9814e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d97fff700 1 -- 172.21.15.1:0/3848707265 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8d9814b350 msgr2=0x7f8d98165830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d97fff700 1 --2- 172.21.15.1:0/3848707265 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8d9814b350 0x7f8d98165830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d97fff700 1 -- 172.21.15.1:0/3848707265 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d90009ae0 con 0x7f8d9814b730 2023-11-15T01:33:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d977fe700 1 --2- 172.21.15.1:0/3848707265 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d980aa750 0x7f8d9814e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d97fff700 1 --2- 172.21.15.1:0/3848707265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9814b730 0x7f8d980ab0c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f8d9000b9b0 tx=0x7f8d90009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d7f7fe700 1 -- 172.21.15.1:0/3848707265 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90009500 con 0x7f8d9814b730 2023-11-15T01:33:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d7f7fe700 1 -- 172.21.15.1:0/3848707265 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9000bdd0 con 0x7f8d9814b730 2023-11-15T01:33:19.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d9e160700 1 -- 172.21.15.1:0/3848707265 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d980c3390 con 0x7f8d9814b730 2023-11-15T01:33:19.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d7f7fe700 1 -- 172.21.15.1:0/3848707265 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9001c610 con 0x7f8d9814b730 2023-11-15T01:33:19.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.980+0000 7f8d9e160700 1 -- 172.21.15.1:0/3848707265 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d980c3660 con 0x7f8d9814b730 2023-11-15T01:33:19.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.981+0000 7f8d9e160700 1 -- 172.21.15.1:0/3848707265 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9806c7e0 con 0x7f8d9814b730 2023-11-15T01:33:19.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.982+0000 7f8d7f7fe700 1 -- 172.21.15.1:0/3848707265 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f8d9001ca40 con 0x7f8d9814b730 2023-11-15T01:33:19.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.982+0000 7f8d7f7fe700 1 --2- 172.21.15.1:0/3848707265 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8d8405f290 0x7f8d84061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:19.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.982+0000 7f8d7f7fe700 1 -- 172.21.15.1:0/3848707265 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f8d9007bf60 con 0x7f8d9814b730 2023-11-15T01:33:19.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.982+0000 7f8d977fe700 1 --2- 172.21.15.1:0/3848707265 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8d8405f290 0x7f8d84061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:19.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.983+0000 7f8d977fe700 1 --2- 172.21.15.1:0/3848707265 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8d8405f290 0x7f8d84061750 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8d88001710 tx=0x7f8d88009040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:19.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:19.986+0000 7f8d7f7fe700 1 -- 172.21.15.1:0/3848707265 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8d9004cf00 con 0x7f8d9814b730 2023-11-15T01:33:20.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.186+0000 7f8d9e160700 1 -- 172.21.15.1:0/3848707265 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d980c5140 con 0x7f8d8405f290 2023-11-15T01:33:20.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.191+0000 7f8d7f7fe700 1 -- 172.21.15.1:0/3848707265 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f8d980c5140 con 0x7f8d8405f290 2023-11-15T01:33:20.192 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-11-15T01:33:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.193+0000 7f8d9e160700 1 -- 172.21.15.1:0/3848707265 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8d8405f290 msgr2=0x7f8d84061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.193+0000 7f8d9e160700 1 --2- 172.21.15.1:0/3848707265 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8d8405f290 0x7f8d84061750 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8d88001710 tx=0x7f8d88009040).stop 2023-11-15T01:33:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.193+0000 7f8d9e160700 1 -- 172.21.15.1:0/3848707265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9814b730 msgr2=0x7f8d980ab0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:20.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.193+0000 7f8d9e160700 1 --2- 172.21.15.1:0/3848707265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9814b730 0x7f8d980ab0c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f8d9000b9b0 tx=0x7f8d90009840).stop 2023-11-15T01:33:20.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.193+0000 7f8d9e160700 1 -- 172.21.15.1:0/3848707265 shutdown_connections 2023-11-15T01:33:20.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.193+0000 7f8d9e160700 1 --2- 172.21.15.1:0/3848707265 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8d8405f290 0x7f8d84061750 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.193+0000 7f8d9e160700 1 --2- 172.21.15.1:0/3848707265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9814b730 0x7f8d980ab0c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.193+0000 7f8d9e160700 1 --2- 172.21.15.1:0/3848707265 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d980aa750 0x7f8d9814e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.193+0000 7f8d9e160700 1 --2- 172.21.15.1:0/3848707265 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8d9814b350 0x7f8d98165830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.193+0000 7f8d9e160700 1 -- 172.21.15.1:0/3848707265 >> 172.21.15.1:0/3848707265 conn(0x7f8d98069ee0 msgr2=0x7f8d98149b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:20.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.193+0000 7f8d9e160700 1 -- 172.21.15.1:0/3848707265 shutdown_connections 2023-11-15T01:33:20.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.193+0000 7f8d9e160700 1 -- 172.21.15.1:0/3848707265 wait complete. 2023-11-15T01:33:20.205 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-11-15T01:33:20.206 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-11-15T01:33:20.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.328+0000 7f470d906700 1 Processor -- start 2023-11-15T01:33:20.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.328+0000 7f470d906700 1 -- start start 2023-11-15T01:33:20.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.329+0000 7f470d906700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4708063b50 0x7f47080aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:20.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.329+0000 7f470d906700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47081548f0 con 0x7f47080ca5d0 2023-11-15T01:33:20.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.329+0000 7f470d906700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47080aa4f0 con 0x7f4708155610 2023-11-15T01:33:20.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.329+0000 7f470d906700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47080aaa50 con 0x7f4708063b50 2023-11-15T01:33:20.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.329+0000 7f4707fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4708063b50 0x7f47080aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:20.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.329+0000 7f4707fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4708063b50 0x7f47080aa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49796/0 (socket says 172.21.15.1:49796) 2023-11-15T01:33:20.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.329+0000 7f4707fff700 1 -- 172.21.15.1:0/4078775116 learned_addr learned my addr 172.21.15.1:0/4078775116 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:20.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.329+0000 7f470c904700 1 --1- 172.21.15.1:0/4078775116 >> v1:172.21.15.1:6789/0 conn(0x7f47080ca5d0 0x7f4708063440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48210/0 (socket says 172.21.15.1:48210) 2023-11-15T01:33:20.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.329+0000 7f4707fff700 1 -- 172.21.15.1:0/4078775116 >> v1:172.21.15.141:6789/0 conn(0x7f4708155610 legacy=0x7f470815df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:20.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.329+0000 7f4707fff700 1 -- 172.21.15.1:0/4078775116 >> v1:172.21.15.1:6789/0 conn(0x7f47080ca5d0 legacy=0x7f4708063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:20.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.329+0000 7f4707fff700 1 -- 172.21.15.1:0/4078775116 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47080aa770 con 0x7f4708063b50 2023-11-15T01:33:20.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.329+0000 7f47077fe700 1 -- 172.21.15.1:0/4078775116 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897256507 0 0) 0x7f46fc001110 con 0x7f47080ca5d0 2023-11-15T01:33:20.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.329+0000 7f4707fff700 1 --2- 172.21.15.1:0/4078775116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4708063b50 0x7f47080aa000 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f46f4006fd0 tx=0x7f46f40090f0).ready entity=mon.0 client_cookie=90edb18f8694222f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:20.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.330+0000 7f47077fe700 1 -- 172.21.15.1:0/4078775116 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f400b600 con 0x7f4708063b50 2023-11-15T01:33:20.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.330+0000 7f47077fe700 1 -- 172.21.15.1:0/4078775116 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f400b760 con 0x7f4708063b50 2023-11-15T01:33:20.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.330+0000 7f47077fe700 1 -- 172.21.15.1:0/4078775116 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f400bae0 con 0x7f4708063b50 2023-11-15T01:33:20.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.330+0000 7f470d906700 1 -- 172.21.15.1:0/4078775116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4708063b50 msgr2=0x7f47080aa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:20.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.330+0000 7f470d906700 1 --2- 172.21.15.1:0/4078775116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4708063b50 0x7f47080aa000 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f46f4006fd0 tx=0x7f46f40090f0).stop 2023-11-15T01:33:20.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.330+0000 7f470d906700 1 -- 172.21.15.1:0/4078775116 shutdown_connections 2023-11-15T01:33:20.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.330+0000 7f470d906700 1 --2- 172.21.15.1:0/4078775116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4708063b50 0x7f47080aa000 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.330+0000 7f470d906700 1 -- 172.21.15.1:0/4078775116 >> 172.21.15.1:0/4078775116 conn(0x7f470806a9b0 msgr2=0x7f47080cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:20.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.330+0000 7f470d906700 1 -- 172.21.15.1:0/4078775116 shutdown_connections 2023-11-15T01:33:20.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.330+0000 7f470d906700 1 -- 172.21.15.1:0/4078775116 wait complete. 2023-11-15T01:33:20.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.331+0000 7f470d906700 1 Processor -- start 2023-11-15T01:33:20.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.331+0000 7f470d906700 1 -- start start 2023-11-15T01:33:20.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.332+0000 7f470d906700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4708063b50 0x7f4708150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:20.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.332+0000 7f470d906700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47080ca5d0 0x7f47080c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:20.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.332+0000 7f470d906700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4708155610 0x7f47080c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:20.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.332+0000 7f470d906700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47080c84b0 con 0x7f47080ca5d0 2023-11-15T01:33:20.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.332+0000 7f470d906700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47080c33a0 con 0x7f4708063b50 2023-11-15T01:33:20.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.332+0000 7f470d906700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47080aee50 con 0x7f4708155610 2023-11-15T01:33:20.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.332+0000 7f4707fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47080ca5d0 0x7f47080c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:20.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.332+0000 7f4707fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47080ca5d0 0x7f47080c7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49808/0 (socket says 172.21.15.1:49808) 2023-11-15T01:33:20.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.332+0000 7f4707fff700 1 -- 172.21.15.1:0/2951942800 learned_addr learned my addr 172.21.15.1:0/2951942800 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:20.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.332+0000 7f470c904700 1 --2- 172.21.15.1:0/2951942800 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4708063b50 0x7f4708150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:20.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.332+0000 7f470d105700 1 --2- 172.21.15.1:0/2951942800 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4708155610 0x7f47080c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:20.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.332+0000 7f4707fff700 1 -- 172.21.15.1:0/2951942800 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4708155610 msgr2=0x7f47080c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.332+0000 7f4707fff700 1 --2- 172.21.15.1:0/2951942800 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4708155610 0x7f47080c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.332+0000 7f4707fff700 1 -- 172.21.15.1:0/2951942800 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4708063b50 msgr2=0x7f4708150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.332+0000 7f4707fff700 1 --2- 172.21.15.1:0/2951942800 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4708063b50 0x7f4708150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.333+0000 7f4707fff700 1 -- 172.21.15.1:0/2951942800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f4009370 con 0x7f47080ca5d0 2023-11-15T01:33:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.333+0000 7f470d105700 1 --2- 172.21.15.1:0/2951942800 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4708155610 0x7f47080c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.333+0000 7f4707fff700 1 --2- 172.21.15.1:0/2951942800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47080ca5d0 0x7f47080c7ad0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f470805f470 tx=0x7f46f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:20.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.333+0000 7f4704ff9700 1 -- 172.21.15.1:0/2951942800 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f400bae0 con 0x7f47080ca5d0 2023-11-15T01:33:20.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.333+0000 7f4704ff9700 1 -- 172.21.15.1:0/2951942800 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f4000c90 con 0x7f47080ca5d0 2023-11-15T01:33:20.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.333+0000 7f470d906700 1 -- 172.21.15.1:0/2951942800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47080af130 con 0x7f47080ca5d0 2023-11-15T01:33:20.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.333+0000 7f4704ff9700 1 -- 172.21.15.1:0/2951942800 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f401c650 con 0x7f47080ca5d0 2023-11-15T01:33:20.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.333+0000 7f470d906700 1 -- 172.21.15.1:0/2951942800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4708164fe0 con 0x7f47080ca5d0 2023-11-15T01:33:20.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.334+0000 7f470d906700 1 -- 172.21.15.1:0/2951942800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47080af650 con 0x7f47080ca5d0 2023-11-15T01:33:20.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.334+0000 7f4704ff9700 1 -- 172.21.15.1:0/2951942800 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f46f401ca00 con 0x7f47080ca5d0 2023-11-15T01:33:20.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.334+0000 7f4704ff9700 1 --2- 172.21.15.1:0/2951942800 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f46ec05f2c0 0x7f46ec061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:20.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.334+0000 7f4704ff9700 1 -- 172.21.15.1:0/2951942800 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f46f407c200 con 0x7f47080ca5d0 2023-11-15T01:33:20.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.335+0000 7f470c904700 1 --2- 172.21.15.1:0/2951942800 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f46ec05f2c0 0x7f46ec061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:20.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.335+0000 7f470c904700 1 --2- 172.21.15.1:0/2951942800 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f46ec05f2c0 0x7f46ec061780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f46fc000c00 tx=0x7f46fc0079f0).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:20.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.339+0000 7f4704ff9700 1 -- 172.21.15.1:0/2951942800 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f47080af650 con 0x7f47080ca5d0 2023-11-15T01:33:20.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.536+0000 7f470d906700 1 -- 172.21.15.1:0/2951942800 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f47081651d0 con 0x7f46ec05f2c0 2023-11-15T01:33:20.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.541+0000 7f4704ff9700 1 -- 172.21.15.1:0/2951942800 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f47081651d0 con 0x7f46ec05f2c0 2023-11-15T01:33:20.541 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-11-15T01:33:20.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.543+0000 7f470d906700 1 -- 172.21.15.1:0/2951942800 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f46ec05f2c0 msgr2=0x7f46ec061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:20.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.543+0000 7f470d906700 1 --2- 172.21.15.1:0/2951942800 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f46ec05f2c0 0x7f46ec061780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f46fc000c00 tx=0x7f46fc0079f0).stop 2023-11-15T01:33:20.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.543+0000 7f470d906700 1 -- 172.21.15.1:0/2951942800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47080ca5d0 msgr2=0x7f47080c7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:20.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.543+0000 7f470d906700 1 --2- 172.21.15.1:0/2951942800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47080ca5d0 0x7f47080c7ad0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f470805f470 tx=0x7f46f4017000).stop 2023-11-15T01:33:20.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.543+0000 7f470d906700 1 -- 172.21.15.1:0/2951942800 shutdown_connections 2023-11-15T01:33:20.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.543+0000 7f470d906700 1 --2- 172.21.15.1:0/2951942800 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f46ec05f2c0 0x7f46ec061780 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.543+0000 7f470d906700 1 --2- 172.21.15.1:0/2951942800 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4708155610 0x7f47080c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.543+0000 7f470d906700 1 --2- 172.21.15.1:0/2951942800 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4708063b50 0x7f4708150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.543+0000 7f470d906700 1 --2- 172.21.15.1:0/2951942800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47080ca5d0 0x7f47080c7ad0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.543+0000 7f470d906700 1 -- 172.21.15.1:0/2951942800 >> 172.21.15.1:0/2951942800 conn(0x7f470806a9b0 msgr2=0x7f4708155cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:20.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.543+0000 7f470d906700 1 -- 172.21.15.1:0/2951942800 shutdown_connections 2023-11-15T01:33:20.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.543+0000 7f470d906700 1 -- 172.21.15.1:0/2951942800 wait complete. 2023-11-15T01:33:20.555 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-11-15T01:33:20.556 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-11-15T01:33:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.678+0000 7f2c8f163700 1 Processor -- start 2023-11-15T01:33:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.678+0000 7f2c8f163700 1 -- start start 2023-11-15T01:33:20.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.679+0000 7f2c8f163700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2c8814b350 0x7f2c880c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:20.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.679+0000 7f2c8f163700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2c8814b730 0x7f2c88154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:20.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.679+0000 7f2c8f163700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c880aa040 0x7f2c880aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:20.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.679+0000 7f2c8f163700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c880aa9e0 con 0x7f2c8814b350 2023-11-15T01:33:20.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.679+0000 7f2c8f163700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c881580d0 con 0x7f2c8814b730 2023-11-15T01:33:20.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.679+0000 7f2c8f163700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c88155000 con 0x7f2c880aa040 2023-11-15T01:33:20.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.679+0000 7f2c8ceff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2c8814b350 0x7f2c880c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:20.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.679+0000 7f2c8ceff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2c8814b350 0x7f2c880c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49816/0 (socket says 172.21.15.1:49816) 2023-11-15T01:33:20.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.679+0000 7f2c8ceff700 1 -- 172.21.15.1:0/545419079 learned_addr learned my addr 172.21.15.1:0/545419079 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:20.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.680+0000 7f2c87fff700 1 --2- 172.21.15.1:0/545419079 >> v2:172.21.15.141:3300/0 conn(0x7f2c8814b730 0x7f2c88154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:20.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.680+0000 7f2c8d700700 1 --2- 172.21.15.1:0/545419079 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c880aa040 0x7f2c880aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:20.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.680+0000 7f2c8ceff700 1 -- 172.21.15.1:0/545419079 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c880aa040 msgr2=0x7f2c880aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:20.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.680+0000 7f2c8ceff700 1 --2- 172.21.15.1:0/545419079 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c880aa040 0x7f2c880aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.680+0000 7f2c8ceff700 1 -- 172.21.15.1:0/545419079 >> v2:172.21.15.141:3300/0 conn(0x7f2c8814b730 msgr2=0x7f2c88154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:20.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.680+0000 7f2c8ceff700 1 --2- 172.21.15.1:0/545419079 >> v2:172.21.15.141:3300/0 conn(0x7f2c8814b730 0x7f2c88154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.680+0000 7f2c8ceff700 1 -- 172.21.15.1:0/545419079 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c881552e0 con 0x7f2c8814b350 2023-11-15T01:33:20.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.680+0000 7f2c87fff700 1 --2- 172.21.15.1:0/545419079 >> v2:172.21.15.141:3300/0 conn(0x7f2c8814b730 0x7f2c88154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:20.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.680+0000 7f2c8ceff700 1 --2- 172.21.15.1:0/545419079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c8814b350 0x7f2c880c8290 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f2c880c8780 tx=0x7f2c800090f0).ready entity=mon.0 client_cookie=ce29b62e704bd8e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:20.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.680+0000 7f2c877fe700 1 -- 172.21.15.1:0/545419079 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8000b600 con 0x7f2c8814b350 2023-11-15T01:33:20.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.680+0000 7f2c877fe700 1 -- 172.21.15.1:0/545419079 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8000b760 con 0x7f2c8814b350 2023-11-15T01:33:20.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.680+0000 7f2c877fe700 1 -- 172.21.15.1:0/545419079 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8000bae0 con 0x7f2c8814b350 2023-11-15T01:33:20.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.681+0000 7f2c8f163700 1 -- 172.21.15.1:0/545419079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c8814b350 msgr2=0x7f2c880c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:20.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.681+0000 7f2c8f163700 1 --2- 172.21.15.1:0/545419079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c8814b350 0x7f2c880c8290 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f2c880c8780 tx=0x7f2c800090f0).stop 2023-11-15T01:33:20.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.681+0000 7f2c8f163700 1 -- 172.21.15.1:0/545419079 shutdown_connections 2023-11-15T01:33:20.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.681+0000 7f2c8f163700 1 --2- 172.21.15.1:0/545419079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c8814b350 0x7f2c880c8290 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.681+0000 7f2c8f163700 1 --2- 172.21.15.1:0/545419079 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c880aa040 0x7f2c880aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.681+0000 7f2c8f163700 1 --2- 172.21.15.1:0/545419079 >> v2:172.21.15.141:3300/0 conn(0x7f2c8814b730 0x7f2c88154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.681+0000 7f2c8f163700 1 -- 172.21.15.1:0/545419079 >> 172.21.15.1:0/545419079 conn(0x7f2c88069ee0 msgr2=0x7f2c8806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:20.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.681+0000 7f2c8f163700 1 -- 172.21.15.1:0/545419079 shutdown_connections 2023-11-15T01:33:20.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.681+0000 7f2c8f163700 1 -- 172.21.15.1:0/545419079 wait complete. 2023-11-15T01:33:20.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.682+0000 7f2c8f163700 1 Processor -- start 2023-11-15T01:33:20.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.682+0000 7f2c8f163700 1 -- start start 2023-11-15T01:33:20.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8f163700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c880aa040 0x7f2c88143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:20.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8f163700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c8814b350 0x7f2c880c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:20.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8f163700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c8814b730 0x7f2c88167f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:20.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8f163700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c880ab550 con 0x7f2c880aa040 2023-11-15T01:33:20.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8f163700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c88143510 con 0x7f2c8814b730 2023-11-15T01:33:20.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8f163700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c880c2c50 con 0x7f2c8814b350 2023-11-15T01:33:20.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8ceff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c880aa040 0x7f2c88143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:20.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8ceff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c880aa040 0x7f2c88143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49818/0 (socket says 172.21.15.1:49818) 2023-11-15T01:33:20.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8ceff700 1 -- 172.21.15.1:0/2498614322 learned_addr learned my addr 172.21.15.1:0/2498614322 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:20.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c87fff700 1 --2- 172.21.15.1:0/2498614322 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c8814b350 0x7f2c880c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:20.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8d700700 1 --2- 172.21.15.1:0/2498614322 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c8814b730 0x7f2c88167f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:20.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8ceff700 1 -- 172.21.15.1:0/2498614322 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c8814b350 msgr2=0x7f2c880c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:20.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8ceff700 1 --2- 172.21.15.1:0/2498614322 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c8814b350 0x7f2c880c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8ceff700 1 -- 172.21.15.1:0/2498614322 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c8814b730 msgr2=0x7f2c88167f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:20.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8ceff700 1 --2- 172.21.15.1:0/2498614322 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c8814b730 0x7f2c88167f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8ceff700 1 -- 172.21.15.1:0/2498614322 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c80009370 con 0x7f2c880aa040 2023-11-15T01:33:20.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c8ceff700 1 --2- 172.21.15.1:0/2498614322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c880aa040 0x7f2c88143020 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f2c88083e50 tx=0x7f2c80017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:20.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.683+0000 7f2c84ff9700 1 -- 172.21.15.1:0/2498614322 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8000b8d0 con 0x7f2c880aa040 2023-11-15T01:33:20.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.684+0000 7f2c84ff9700 1 -- 172.21.15.1:0/2498614322 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8000ba30 con 0x7f2c880aa040 2023-11-15T01:33:20.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.684+0000 7f2c8f163700 1 -- 172.21.15.1:0/2498614322 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c880c2ef0 con 0x7f2c880aa040 2023-11-15T01:33:20.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.684+0000 7f2c84ff9700 1 -- 172.21.15.1:0/2498614322 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8001c670 con 0x7f2c880aa040 2023-11-15T01:33:20.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.684+0000 7f2c8f163700 1 -- 172.21.15.1:0/2498614322 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c880ab1e0 con 0x7f2c880aa040 2023-11-15T01:33:20.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.685+0000 7f2c8f163700 1 -- 172.21.15.1:0/2498614322 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c8806c7e0 con 0x7f2c880aa040 2023-11-15T01:33:20.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.685+0000 7f2c84ff9700 1 -- 172.21.15.1:0/2498614322 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f2c8001caa0 con 0x7f2c880aa040 2023-11-15T01:33:20.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.685+0000 7f2c84ff9700 1 --2- 172.21.15.1:0/2498614322 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2c6805f2c0 0x7f2c68061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:20.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.685+0000 7f2c84ff9700 1 -- 172.21.15.1:0/2498614322 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f2c8007bd30 con 0x7f2c880aa040 2023-11-15T01:33:20.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.685+0000 7f2c87fff700 1 --2- 172.21.15.1:0/2498614322 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2c6805f2c0 0x7f2c68061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:20.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.686+0000 7f2c87fff700 1 --2- 172.21.15.1:0/2498614322 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2c6805f2c0 0x7f2c68061780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2c88149a30 tx=0x7f2c780099d0).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:20.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.689+0000 7f2c84ff9700 1 -- 172.21.15.1:0/2498614322 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2c8004cdb0 con 0x7f2c880aa040 2023-11-15T01:33:20.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.891+0000 7f2c8f163700 1 -- 172.21.15.1:0/2498614322 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c880c1120 con 0x7f2c6805f2c0 2023-11-15T01:33:20.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.896+0000 7f2c84ff9700 1 -- 172.21.15.1:0/2498614322 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f2c880c1120 con 0x7f2c6805f2c0 2023-11-15T01:33:20.896 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-11-15T01:33:20.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.898+0000 7f2c8f163700 1 -- 172.21.15.1:0/2498614322 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2c6805f2c0 msgr2=0x7f2c68061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:20.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.898+0000 7f2c8f163700 1 --2- 172.21.15.1:0/2498614322 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2c6805f2c0 0x7f2c68061780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2c88149a30 tx=0x7f2c780099d0).stop 2023-11-15T01:33:20.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.898+0000 7f2c8f163700 1 -- 172.21.15.1:0/2498614322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c880aa040 msgr2=0x7f2c88143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:20.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.898+0000 7f2c8f163700 1 --2- 172.21.15.1:0/2498614322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c880aa040 0x7f2c88143020 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f2c88083e50 tx=0x7f2c80017000).stop 2023-11-15T01:33:20.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.898+0000 7f2c8f163700 1 -- 172.21.15.1:0/2498614322 shutdown_connections 2023-11-15T01:33:20.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.898+0000 7f2c8f163700 1 --2- 172.21.15.1:0/2498614322 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2c6805f2c0 0x7f2c68061780 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.898+0000 7f2c8f163700 1 --2- 172.21.15.1:0/2498614322 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c8814b730 0x7f2c88167f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.898+0000 7f2c8f163700 1 --2- 172.21.15.1:0/2498614322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c880aa040 0x7f2c88143020 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.898+0000 7f2c8f163700 1 --2- 172.21.15.1:0/2498614322 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c8814b350 0x7f2c880c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:20.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.898+0000 7f2c8f163700 1 -- 172.21.15.1:0/2498614322 >> 172.21.15.1:0/2498614322 conn(0x7f2c88069ee0 msgr2=0x7f2c880c1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:20.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.898+0000 7f2c8f163700 1 -- 172.21.15.1:0/2498614322 shutdown_connections 2023-11-15T01:33:20.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:20.898+0000 7f2c8f163700 1 -- 172.21.15.1:0/2498614322 wait complete. 2023-11-15T01:33:20.910 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-11-15T01:33:20.911 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-11-15T01:33:21.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.033+0000 7fbf8463b700 1 Processor -- start 2023-11-15T01:33:21.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.033+0000 7fbf8463b700 1 -- start start 2023-11-15T01:33:21.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.034+0000 7fbf8463b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbf7c0ab1a0 0x7fbf7c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.034+0000 7fbf8463b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c0c06f0 con 0x7fbf7c154150 2023-11-15T01:33:21.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.034+0000 7fbf8463b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c0c09d0 con 0x7fbf7c0aa060 2023-11-15T01:33:21.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.034+0000 7fbf8463b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf7c158820 con 0x7fbf7c0ab1a0 2023-11-15T01:33:21.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.034+0000 7fbf81bd6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbf7c0ab1a0 0x7fbf7c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.034+0000 7fbf81bd6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbf7c0ab1a0 0x7fbf7c154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49826/0 (socket says 172.21.15.1:49826) 2023-11-15T01:33:21.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.034+0000 7fbf81bd6700 1 -- 172.21.15.1:0/249147532 learned_addr learned my addr 172.21.15.1:0/249147532 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:21.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.034+0000 7fbf823d7700 1 --1- 172.21.15.1:0/249147532 >> v1:172.21.15.1:6789/0 conn(0x7fbf7c154150 0x7fbf7c158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48212/0 (socket says 172.21.15.1:48212) 2023-11-15T01:33:21.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.035+0000 7fbf81bd6700 1 -- 172.21.15.1:0/249147532 >> v1:172.21.15.141:6789/0 conn(0x7fbf7c0aa060 legacy=0x7fbf7c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:21.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.035+0000 7fbf81bd6700 1 -- 172.21.15.1:0/249147532 >> v1:172.21.15.1:6789/0 conn(0x7fbf7c154150 legacy=0x7fbf7c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.035+0000 7fbf813d5700 1 -- 172.21.15.1:0/249147532 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157866854 0 0) 0x7fbf7c0c06f0 con 0x7fbf7c154150 2023-11-15T01:33:21.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.035+0000 7fbf81bd6700 1 -- 172.21.15.1:0/249147532 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c158b00 con 0x7fbf7c0ab1a0 2023-11-15T01:33:21.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.035+0000 7fbf81bd6700 1 --2- 172.21.15.1:0/249147532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf7c0ab1a0 0x7fbf7c154530 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fbf70006fd0 tx=0x7fbf700090f0).ready entity=mon.0 client_cookie=6c37331c071dd157 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:21.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.035+0000 7fbf813d5700 1 -- 172.21.15.1:0/249147532 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7000b600 con 0x7fbf7c0ab1a0 2023-11-15T01:33:21.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.035+0000 7fbf813d5700 1 -- 172.21.15.1:0/249147532 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7000b760 con 0x7fbf7c0ab1a0 2023-11-15T01:33:21.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.035+0000 7fbf813d5700 1 -- 172.21.15.1:0/249147532 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7000bb00 con 0x7fbf7c0ab1a0 2023-11-15T01:33:21.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.035+0000 7fbf8463b700 1 -- 172.21.15.1:0/249147532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf7c0ab1a0 msgr2=0x7fbf7c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.035+0000 7fbf8463b700 1 --2- 172.21.15.1:0/249147532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf7c0ab1a0 0x7fbf7c154530 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fbf70006fd0 tx=0x7fbf700090f0).stop 2023-11-15T01:33:21.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.036+0000 7fbf8463b700 1 -- 172.21.15.1:0/249147532 shutdown_connections 2023-11-15T01:33:21.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.036+0000 7fbf8463b700 1 --2- 172.21.15.1:0/249147532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf7c0ab1a0 0x7fbf7c154530 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.036+0000 7fbf8463b700 1 -- 172.21.15.1:0/249147532 >> 172.21.15.1:0/249147532 conn(0x7fbf7c064aa0 msgr2=0x7fbf7c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:21.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.036+0000 7fbf8463b700 1 -- 172.21.15.1:0/249147532 shutdown_connections 2023-11-15T01:33:21.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.036+0000 7fbf8463b700 1 -- 172.21.15.1:0/249147532 wait complete. 2023-11-15T01:33:21.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.037+0000 7fbf8463b700 1 Processor -- start 2023-11-15T01:33:21.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.037+0000 7fbf8463b700 1 -- start start 2023-11-15T01:33:21.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf8463b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf7c0aa060 0x7fbf7c0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf8463b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf7c0ab1a0 0x7fbf7c143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf8463b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf7c154150 0x7fbf7c152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf8463b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c1563b0 con 0x7fbf7c154150 2023-11-15T01:33:21.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf8463b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c14efd0 con 0x7fbf7c0aa060 2023-11-15T01:33:21.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf8463b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c154f40 con 0x7fbf7c0ab1a0 2023-11-15T01:33:21.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf82bd8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf7c154150 0x7fbf7c152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf82bd8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf7c154150 0x7fbf7c152730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49828/0 (socket says 172.21.15.1:49828) 2023-11-15T01:33:21.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf82bd8700 1 -- 172.21.15.1:0/934911369 learned_addr learned my addr 172.21.15.1:0/934911369 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:21.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf823d7700 1 --2- 172.21.15.1:0/934911369 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf7c0aa060 0x7fbf7c0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf81bd6700 1 --2- 172.21.15.1:0/934911369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf7c0ab1a0 0x7fbf7c143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf82bd8700 1 -- 172.21.15.1:0/934911369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf7c0ab1a0 msgr2=0x7fbf7c143b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf82bd8700 1 --2- 172.21.15.1:0/934911369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf7c0ab1a0 0x7fbf7c143b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf82bd8700 1 -- 172.21.15.1:0/934911369 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf7c0aa060 msgr2=0x7fbf7c0ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf82bd8700 1 --2- 172.21.15.1:0/934911369 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf7c0aa060 0x7fbf7c0ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf82bd8700 1 -- 172.21.15.1:0/934911369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf70009370 con 0x7fbf7c154150 2023-11-15T01:33:21.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf81bd6700 1 --2- 172.21.15.1:0/934911369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf7c0ab1a0 0x7fbf7c143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:21.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf82bd8700 1 --2- 172.21.15.1:0/934911369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf7c154150 0x7fbf7c152730 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fbf6c002230 tx=0x7fbf6c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:21.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf7a7fc700 1 -- 172.21.15.1:0/934911369 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c010510 con 0x7fbf7c154150 2023-11-15T01:33:21.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf7a7fc700 1 -- 172.21.15.1:0/934911369 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6c010670 con 0x7fbf7c154150 2023-11-15T01:33:21.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf8463b700 1 -- 172.21.15.1:0/934911369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf7c155220 con 0x7fbf7c154150 2023-11-15T01:33:21.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf7a7fc700 1 -- 172.21.15.1:0/934911369 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c0109f0 con 0x7fbf7c154150 2023-11-15T01:33:21.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.038+0000 7fbf8463b700 1 -- 172.21.15.1:0/934911369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7c1557e0 con 0x7fbf7c154150 2023-11-15T01:33:21.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.039+0000 7fbf8463b700 1 -- 172.21.15.1:0/934911369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7c156520 con 0x7fbf7c154150 2023-11-15T01:33:21.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.040+0000 7fbf7a7fc700 1 -- 172.21.15.1:0/934911369 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fbf6c01b400 con 0x7fbf7c154150 2023-11-15T01:33:21.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.040+0000 7fbf7a7fc700 1 --2- 172.21.15.1:0/934911369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf6805f290 0x7fbf68061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.040+0000 7fbf7a7fc700 1 -- 172.21.15.1:0/934911369 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fbf6c07a290 con 0x7fbf7c154150 2023-11-15T01:33:21.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.040+0000 7fbf823d7700 1 --2- 172.21.15.1:0/934911369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf6805f290 0x7fbf68061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.041+0000 7fbf823d7700 1 --2- 172.21.15.1:0/934911369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf6805f290 0x7fbf68061750 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fbf74007fd0 tx=0x7fbf74007d50).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:21.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.044+0000 7fbf7a7fc700 1 -- 172.21.15.1:0/934911369 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbf6c04b2b0 con 0x7fbf7c154150 2023-11-15T01:33:21.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.243+0000 7fbf8463b700 1 -- 172.21.15.1:0/934911369 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf7c158de0 con 0x7fbf6805f290 2023-11-15T01:33:21.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.247+0000 7fbf7a7fc700 1 -- 172.21.15.1:0/934911369 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fbf7c158de0 con 0x7fbf6805f290 2023-11-15T01:33:21.248 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-11-15T01:33:21.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.249+0000 7fbf8463b700 1 -- 172.21.15.1:0/934911369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf6805f290 msgr2=0x7fbf68061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.249+0000 7fbf8463b700 1 --2- 172.21.15.1:0/934911369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf6805f290 0x7fbf68061750 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fbf74007fd0 tx=0x7fbf74007d50).stop 2023-11-15T01:33:21.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.249+0000 7fbf8463b700 1 -- 172.21.15.1:0/934911369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf7c154150 msgr2=0x7fbf7c152730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.249+0000 7fbf8463b700 1 --2- 172.21.15.1:0/934911369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf7c154150 0x7fbf7c152730 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fbf6c002230 tx=0x7fbf6c0015e0).stop 2023-11-15T01:33:21.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.249+0000 7fbf8463b700 1 -- 172.21.15.1:0/934911369 shutdown_connections 2023-11-15T01:33:21.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.249+0000 7fbf8463b700 1 --2- 172.21.15.1:0/934911369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbf6805f290 0x7fbf68061750 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.249+0000 7fbf8463b700 1 --2- 172.21.15.1:0/934911369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf7c154150 0x7fbf7c152730 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.249+0000 7fbf8463b700 1 --2- 172.21.15.1:0/934911369 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf7c0aa060 0x7fbf7c0ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.249+0000 7fbf8463b700 1 --2- 172.21.15.1:0/934911369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf7c0ab1a0 0x7fbf7c143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.249+0000 7fbf8463b700 1 -- 172.21.15.1:0/934911369 >> 172.21.15.1:0/934911369 conn(0x7fbf7c064aa0 msgr2=0x7fbf7c0c9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:21.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.249+0000 7fbf8463b700 1 -- 172.21.15.1:0/934911369 shutdown_connections 2023-11-15T01:33:21.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.249+0000 7fbf8463b700 1 -- 172.21.15.1:0/934911369 wait complete. 2023-11-15T01:33:21.261 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-11-15T01:33:21.261 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-11-15T01:33:21.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.383+0000 7f222553d700 1 Processor -- start 2023-11-15T01:33:21.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.383+0000 7f222553d700 1 -- start start 2023-11-15T01:33:21.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.384+0000 7f222553d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22200c53b0 0x7f22200c3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.384+0000 7f222553d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f22200c7f50 0x7f22200c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.384+0000 7f222553d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22200835c0 con 0x7f22200c88a0 2023-11-15T01:33:21.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.384+0000 7f222553d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22200c3a00 con 0x7f22200c7f50 2023-11-15T01:33:21.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.384+0000 7f222553d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22200c5790 con 0x7f22200c53b0 2023-11-15T01:33:21.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.384+0000 7f221f7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f22200c88a0 0x7f22200bde70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48224/0 (socket says 172.21.15.1:48224) 2023-11-15T01:33:21.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.384+0000 7f221f7fe700 1 -- 172.21.15.1:0/286969318 learned_addr learned my addr 172.21.15.1:0/286969318 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:21.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.384+0000 7f221effd700 1 --2- 172.21.15.1:0/286969318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22200c53b0 0x7f22200c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.384+0000 7f221dffb700 1 -- 172.21.15.1:0/286969318 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576137931 0 0) 0x7f22200835c0 con 0x7f22200c88a0 2023-11-15T01:33:21.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.384+0000 7f221e7fc700 1 --2- 172.21.15.1:0/286969318 >> v2:172.21.15.141:3300/0 conn(0x7f22200c7f50 0x7f22200c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.384+0000 7f221dffb700 1 -- 172.21.15.1:0/286969318 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f220c0033f0 con 0x7f22200c88a0 2023-11-15T01:33:21.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221dffb700 1 -- 172.21.15.1:0/286969318 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3796115905 0 0) 0x7f220c0033f0 con 0x7f22200c88a0 2023-11-15T01:33:21.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221dffb700 1 -- 172.21.15.1:0/286969318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22200c53b0 msgr2=0x7f22200c3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:21.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221dffb700 1 --2- 172.21.15.1:0/286969318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22200c53b0 0x7f22200c3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221dffb700 1 -- 172.21.15.1:0/286969318 >> v2:172.21.15.141:3300/0 conn(0x7f22200c7f50 msgr2=0x7f22200c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:21.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221dffb700 1 --2- 172.21.15.1:0/286969318 >> v2:172.21.15.141:3300/0 conn(0x7f22200c7f50 0x7f22200c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221dffb700 1 -- 172.21.15.1:0/286969318 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22200c6eb0 con 0x7f22200c88a0 2023-11-15T01:33:21.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221dffb700 1 -- 172.21.15.1:0/286969318 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f22100017f0 con 0x7f22200c88a0 2023-11-15T01:33:21.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221dffb700 1 -- 172.21.15.1:0/286969318 >> v1:172.21.15.1:6789/0 conn(0x7f22200c88a0 legacy=0x7f22200bde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221dffb700 1 --2- 172.21.15.1:0/286969318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f220c0038e0 0x7f220c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221dffb700 1 --2- 172.21.15.1:0/286969318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f220c004690 0x7f220c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221dffb700 1 --2- 172.21.15.1:0/286969318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22200c53b0 0x7f220c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221dffb700 1 -- 172.21.15.1:0/286969318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22200c3a00 con 0x7f220c0038e0 2023-11-15T01:33:21.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221dffb700 1 -- 172.21.15.1:0/286969318 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22200c5790 con 0x7f220c004690 2023-11-15T01:33:21.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221dffb700 1 -- 172.21.15.1:0/286969318 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c00b8e0 con 0x7f22200c53b0 2023-11-15T01:33:21.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221effd700 1 --2- 172.21.15.1:0/286969318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f220c0038e0 0x7f220c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221e7fc700 1 --2- 172.21.15.1:0/286969318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f220c004690 0x7f220c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221f7fe700 1 --2- 172.21.15.1:0/286969318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22200c53b0 0x7f220c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221effd700 1 -- 172.21.15.1:0/286969318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22200c53b0 msgr2=0x7f220c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:21.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221effd700 1 --2- 172.21.15.1:0/286969318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22200c53b0 0x7f220c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221effd700 1 -- 172.21.15.1:0/286969318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f220c004690 msgr2=0x7f220c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:21.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221effd700 1 --2- 172.21.15.1:0/286969318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f220c004690 0x7f220c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221effd700 1 -- 172.21.15.1:0/286969318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c0033f0 con 0x7f220c0038e0 2023-11-15T01:33:21.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.385+0000 7f221effd700 1 --2- 172.21.15.1:0/286969318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f220c0038e0 0x7f220c003d00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f2218006fd0 tx=0x7f2218006f40).ready entity=mon.0 client_cookie=9f872291c3c32362 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:21.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.386+0000 7f221dffb700 1 -- 172.21.15.1:0/286969318 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2218009e90 con 0x7f220c0038e0 2023-11-15T01:33:21.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.386+0000 7f221dffb700 1 -- 172.21.15.1:0/286969318 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2218009430 con 0x7f220c0038e0 2023-11-15T01:33:21.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.386+0000 7f221dffb700 1 -- 172.21.15.1:0/286969318 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221800e850 con 0x7f220c0038e0 2023-11-15T01:33:21.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.386+0000 7f222553d700 1 -- 172.21.15.1:0/286969318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f220c0038e0 msgr2=0x7f220c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.386+0000 7f222553d700 1 --2- 172.21.15.1:0/286969318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f220c0038e0 0x7f220c003d00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f2218006fd0 tx=0x7f2218006f40).stop 2023-11-15T01:33:21.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.386+0000 7f221f7fe700 1 -- 172.21.15.1:0/286969318 reap_dead start 2023-11-15T01:33:21.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.386+0000 7f222553d700 1 -- 172.21.15.1:0/286969318 shutdown_connections 2023-11-15T01:33:21.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.386+0000 7f222553d700 1 -- 172.21.15.1:0/286969318 >> 172.21.15.1:0/286969318 conn(0x7f2220082f90 msgr2=0x7f22200c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:21.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.386+0000 7f222553d700 1 -- 172.21.15.1:0/286969318 shutdown_connections 2023-11-15T01:33:21.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.386+0000 7f222553d700 1 -- 172.21.15.1:0/286969318 wait complete. 2023-11-15T01:33:21.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.387+0000 7f222553d700 1 Processor -- start 2023-11-15T01:33:21.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.387+0000 7f222553d700 1 -- start start 2023-11-15T01:33:21.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.388+0000 7f222553d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22201529c0 0x7f22200ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.388+0000 7f222553d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2220153210 0x7f2220066de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.388+0000 7f222553d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22200672d0 0x7f2220167bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.388+0000 7f222553d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2220152da0 con 0x7f2220153210 2023-11-15T01:33:21.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.388+0000 7f222553d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22200aeb80 con 0x7f22201529c0 2023-11-15T01:33:21.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.388+0000 7f222553d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2220067750 con 0x7f22200672d0 2023-11-15T01:33:21.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.388+0000 7f221e7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2220153210 0x7f2220066de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.388+0000 7f221e7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2220153210 0x7f2220066de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49838/0 (socket says 172.21.15.1:49838) 2023-11-15T01:33:21.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.388+0000 7f221e7fc700 1 -- 172.21.15.1:0/3073963351 learned_addr learned my addr 172.21.15.1:0/3073963351 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:21.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.388+0000 7f221f7fe700 1 --2- 172.21.15.1:0/3073963351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22200672d0 0x7f2220167bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.388+0000 7f221effd700 1 --2- 172.21.15.1:0/3073963351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22201529c0 0x7f22200ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.389+0000 7f221e7fc700 1 -- 172.21.15.1:0/3073963351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22200672d0 msgr2=0x7f2220167bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.389+0000 7f221e7fc700 1 --2- 172.21.15.1:0/3073963351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22200672d0 0x7f2220167bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.389+0000 7f221e7fc700 1 -- 172.21.15.1:0/3073963351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22201529c0 msgr2=0x7f22200ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.389+0000 7f221e7fc700 1 --2- 172.21.15.1:0/3073963351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22201529c0 0x7f22200ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.389+0000 7f221e7fc700 1 -- 172.21.15.1:0/3073963351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22200adf70 con 0x7f2220153210 2023-11-15T01:33:21.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.389+0000 7f221e7fc700 1 --2- 172.21.15.1:0/3073963351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2220153210 0x7f2220066de0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f2208011a50 tx=0x7f2208009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:21.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.389+0000 7f2216ffd700 1 -- 172.21.15.1:0/3073963351 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208011e90 con 0x7f2220153210 2023-11-15T01:33:21.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.389+0000 7f2216ffd700 1 -- 172.21.15.1:0/3073963351 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220800f8e0 con 0x7f2220153210 2023-11-15T01:33:21.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.389+0000 7f222553d700 1 -- 172.21.15.1:0/3073963351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22200ae250 con 0x7f2220153210 2023-11-15T01:33:21.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.389+0000 7f2216ffd700 1 -- 172.21.15.1:0/3073963351 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220800fc60 con 0x7f2220153210 2023-11-15T01:33:21.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.389+0000 7f222553d700 1 -- 172.21.15.1:0/3073963351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22200ae810 con 0x7f2220153210 2023-11-15T01:33:21.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.390+0000 7f222553d700 1 -- 172.21.15.1:0/3073963351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22200aed30 con 0x7f2220153210 2023-11-15T01:33:21.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.390+0000 7f2216ffd700 1 -- 172.21.15.1:0/3073963351 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f2208014650 con 0x7f2220153210 2023-11-15T01:33:21.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.391+0000 7f2216ffd700 1 --2- 172.21.15.1:0/3073963351 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f220005f2c0 0x7f2200061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.391+0000 7f2216ffd700 1 -- 172.21.15.1:0/3073963351 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f220807ac00 con 0x7f2220153210 2023-11-15T01:33:21.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.391+0000 7f221effd700 1 --2- 172.21.15.1:0/3073963351 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f220005f2c0 0x7f2200061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.391+0000 7f221effd700 1 --2- 172.21.15.1:0/3073963351 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f220005f2c0 0x7f2200061780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f222006a2f0 tx=0x7f221801a000).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:21.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.395+0000 7f2216ffd700 1 -- 172.21.15.1:0/3073963351 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f22200aed30 con 0x7f2220153210 2023-11-15T01:33:21.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.595+0000 7f222553d700 1 -- 172.21.15.1:0/3073963351 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f22200aed30 con 0x7f220005f2c0 2023-11-15T01:33:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.599+0000 7f2216ffd700 1 -- 172.21.15.1:0/3073963351 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f22200aed30 con 0x7f220005f2c0 2023-11-15T01:33:21.599 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-11-15T01:33:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.601+0000 7f222553d700 1 -- 172.21.15.1:0/3073963351 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f220005f2c0 msgr2=0x7f2200061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.601+0000 7f222553d700 1 --2- 172.21.15.1:0/3073963351 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f220005f2c0 0x7f2200061780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f222006a2f0 tx=0x7f221801a000).stop 2023-11-15T01:33:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.601+0000 7f222553d700 1 -- 172.21.15.1:0/3073963351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2220153210 msgr2=0x7f2220066de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.601+0000 7f222553d700 1 --2- 172.21.15.1:0/3073963351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2220153210 0x7f2220066de0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f2208011a50 tx=0x7f2208009060).stop 2023-11-15T01:33:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.601+0000 7f222553d700 1 -- 172.21.15.1:0/3073963351 shutdown_connections 2023-11-15T01:33:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.601+0000 7f222553d700 1 --2- 172.21.15.1:0/3073963351 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f220005f2c0 0x7f2200061780 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.601+0000 7f222553d700 1 --2- 172.21.15.1:0/3073963351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22200672d0 0x7f2220167bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.601+0000 7f222553d700 1 --2- 172.21.15.1:0/3073963351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22201529c0 0x7f22200ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.601+0000 7f222553d700 1 --2- 172.21.15.1:0/3073963351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2220153210 0x7f2220066de0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.601+0000 7f222553d700 1 -- 172.21.15.1:0/3073963351 >> 172.21.15.1:0/3073963351 conn(0x7f2220082f90 msgr2=0x7f22200644d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:21.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.601+0000 7f222553d700 1 -- 172.21.15.1:0/3073963351 shutdown_connections 2023-11-15T01:33:21.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.601+0000 7f222553d700 1 -- 172.21.15.1:0/3073963351 wait complete. 2023-11-15T01:33:21.613 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-11-15T01:33:21.613 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-11-15T01:33:21.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.736+0000 7fc6c7274700 1 Processor -- start 2023-11-15T01:33:21.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.736+0000 7fc6c7274700 1 -- start start 2023-11-15T01:33:21.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.737+0000 7fc6c7274700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc6c0154150 0x7fc6c0154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.737+0000 7fc6c7274700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c00c06f0 con 0x7fc6c00ab1a0 2023-11-15T01:33:21.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.737+0000 7fc6c7274700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c00c09d0 con 0x7fc6c00aa060 2023-11-15T01:33:21.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.737+0000 7fc6c7274700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c0158820 con 0x7fc6c0154150 2023-11-15T01:33:21.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.737+0000 7fc6c480f700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc6c00ab1a0 0x7fc6c0158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48236/0 (socket says 172.21.15.1:48236) 2023-11-15T01:33:21.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.737+0000 7fc6c480f700 1 -- 172.21.15.1:0/3793530423 learned_addr learned my addr 172.21.15.1:0/3793530423 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:21.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.737+0000 7fc6c5010700 1 --2- 172.21.15.1:0/3793530423 >> v2:172.21.15.141:3300/0 conn(0x7fc6c0154150 0x7fc6c0154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.737+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502870852 0 0) 0x7fc6c00c06f0 con 0x7fc6c00ab1a0 2023-11-15T01:33:21.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.737+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a80033f0 con 0x7fc6c00ab1a0 2023-11-15T01:33:21.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929463543 0 0) 0x7fc6c00c09d0 con 0x7fc6c00aa060 2023-11-15T01:33:21.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6c00c06f0 con 0x7fc6c00aa060 2023-11-15T01:33:21.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3443060923 0 0) 0x7fc6a80033f0 con 0x7fc6c00ab1a0 2023-11-15T01:33:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 >> v2:172.21.15.141:3300/0 conn(0x7fc6c0154150 msgr2=0x7fc6c0154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6bffff700 1 --2- 172.21.15.1:0/3793530423 >> v2:172.21.15.141:3300/0 conn(0x7fc6c0154150 0x7fc6c0154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 >> v1:172.21.15.141:6789/0 conn(0x7fc6c00aa060 legacy=0x7fc6c00c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c0158b00 con 0x7fc6c00ab1a0 2023-11-15T01:33:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fc6b4001470 con 0x7fc6c00ab1a0 2023-11-15T01:33:21.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6c5010700 1 --2- 172.21.15.1:0/3793530423 >> v2:172.21.15.141:3300/0 conn(0x7fc6c0154150 0x7fc6c0154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:21.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 >> v1:172.21.15.1:6789/0 conn(0x7fc6c00ab1a0 legacy=0x7fc6c0158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6bffff700 1 --2- 172.21.15.1:0/3793530423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6a8003a70 0x7fc6a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6bffff700 1 --2- 172.21.15.1:0/3793530423 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a8004690 0x7fc6a8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6bffff700 1 --2- 172.21.15.1:0/3793530423 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a8005050 0x7fc6a800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0158820 con 0x7fc6a8003a70 2023-11-15T01:33:21.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a800bfc0 con 0x7fc6a8004690 2023-11-15T01:33:21.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a800c180 con 0x7fc6a8005050 2023-11-15T01:33:21.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6c5010700 1 --2- 172.21.15.1:0/3793530423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6a8003a70 0x7fc6a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6c480f700 1 --2- 172.21.15.1:0/3793530423 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a8004690 0x7fc6a8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6c5811700 1 --2- 172.21.15.1:0/3793530423 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a8005050 0x7fc6a800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6c5010700 1 -- 172.21.15.1:0/3793530423 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a8005050 msgr2=0x7fc6a800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:21.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6c5010700 1 --2- 172.21.15.1:0/3793530423 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a8005050 0x7fc6a800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6c5010700 1 -- 172.21.15.1:0/3793530423 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a8004690 msgr2=0x7fc6a8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:21.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6c5010700 1 --2- 172.21.15.1:0/3793530423 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a8004690 0x7fc6a8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6c5010700 1 -- 172.21.15.1:0/3793530423 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a80033f0 con 0x7fc6a8003a70 2023-11-15T01:33:21.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6c5811700 1 --2- 172.21.15.1:0/3793530423 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a8005050 0x7fc6a800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:21.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6c5811700 1 -- 172.21.15.1:0/3793530423 reap_dead start 2023-11-15T01:33:21.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.738+0000 7fc6c5010700 1 --2- 172.21.15.1:0/3793530423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6a8003a70 0x7fc6a8003e70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fc6b800e3c0 tx=0x7fc6b800b040).ready entity=mon.0 client_cookie=f777e36a620b0c43 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:21.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.739+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8009c50 con 0x7fc6a8003a70 2023-11-15T01:33:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.739+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b800f040 con 0x7fc6a8003a70 2023-11-15T01:33:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.739+0000 7fc6bffff700 1 -- 172.21.15.1:0/3793530423 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b800ee80 con 0x7fc6a8003a70 2023-11-15T01:33:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.739+0000 7fc6c7274700 1 -- 172.21.15.1:0/3793530423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6a8003a70 msgr2=0x7fc6a8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.739+0000 7fc6c7274700 1 --2- 172.21.15.1:0/3793530423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6a8003a70 0x7fc6a8003e70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fc6b800e3c0 tx=0x7fc6b800b040).stop 2023-11-15T01:33:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.739+0000 7fc6c7274700 1 -- 172.21.15.1:0/3793530423 shutdown_connections 2023-11-15T01:33:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.739+0000 7fc6c7274700 1 --2- 172.21.15.1:0/3793530423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6a8003a70 0x7fc6a8003e70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.739+0000 7fc6c7274700 1 -- 172.21.15.1:0/3793530423 >> 172.21.15.1:0/3793530423 conn(0x7fc6c0064aa0 msgr2=0x7fc6c0064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.739+0000 7fc6c7274700 1 -- 172.21.15.1:0/3793530423 shutdown_connections 2023-11-15T01:33:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.739+0000 7fc6c7274700 1 -- 172.21.15.1:0/3793530423 wait complete. 2023-11-15T01:33:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.740+0000 7fc6c7274700 1 Processor -- start 2023-11-15T01:33:21.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.740+0000 7fc6c7274700 1 -- start start 2023-11-15T01:33:21.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.741+0000 7fc6c7274700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6a8003a70 0x7fc6c00b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.741+0000 7fc6c7274700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6c00b0260 0x7fc6c014dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.741+0000 7fc6c7274700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6c00accd0 0x7fc6c00ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.741+0000 7fc6c7274700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0157900 con 0x7fc6a8003a70 2023-11-15T01:33:21.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.741+0000 7fc6c7274700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00b11f0 con 0x7fc6c00accd0 2023-11-15T01:33:21.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.741+0000 7fc6c7274700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00c2c10 con 0x7fc6c00b0260 2023-11-15T01:33:21.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.741+0000 7fc6c5010700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6a8003a70 0x7fc6c00b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.741+0000 7fc6c5010700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6a8003a70 0x7fc6c00b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49852/0 (socket says 172.21.15.1:49852) 2023-11-15T01:33:21.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.741+0000 7fc6c5010700 1 -- 172.21.15.1:0/2096914558 learned_addr learned my addr 172.21.15.1:0/2096914558 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:21.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.742+0000 7fc6c480f700 1 --2- 172.21.15.1:0/2096914558 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6c00b0260 0x7fc6c014dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.742+0000 7fc6c5811700 1 --2- 172.21.15.1:0/2096914558 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6c00accd0 0x7fc6c00ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.742+0000 7fc6c5010700 1 -- 172.21.15.1:0/2096914558 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6c00b0260 msgr2=0x7fc6c014dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.742+0000 7fc6c5010700 1 --2- 172.21.15.1:0/2096914558 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6c00b0260 0x7fc6c014dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.742+0000 7fc6c5010700 1 -- 172.21.15.1:0/2096914558 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6c00accd0 msgr2=0x7fc6c00ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.742+0000 7fc6c5010700 1 --2- 172.21.15.1:0/2096914558 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6c00accd0 0x7fc6c00ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.742+0000 7fc6c5010700 1 -- 172.21.15.1:0/2096914558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c00b0f90 con 0x7fc6a8003a70 2023-11-15T01:33:21.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.742+0000 7fc6c5811700 1 --2- 172.21.15.1:0/2096914558 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6c00accd0 0x7fc6c00ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:21.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.742+0000 7fc6c5010700 1 --2- 172.21.15.1:0/2096914558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6a8003a70 0x7fc6c00b0aa0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fc6b8013940 tx=0x7fc6b801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:21.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.742+0000 7fc6bd7fa700 1 -- 172.21.15.1:0/2096914558 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8013e90 con 0x7fc6a8003a70 2023-11-15T01:33:21.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.742+0000 7fc6bd7fa700 1 -- 172.21.15.1:0/2096914558 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b8023070 con 0x7fc6a8003a70 2023-11-15T01:33:21.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.742+0000 7fc6c7274700 1 -- 172.21.15.1:0/2096914558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c00ad640 con 0x7fc6a8003a70 2023-11-15T01:33:21.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.742+0000 7fc6bd7fa700 1 -- 172.21.15.1:0/2096914558 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b801c450 con 0x7fc6a8003a70 2023-11-15T01:33:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.742+0000 7fc6c7274700 1 -- 172.21.15.1:0/2096914558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c00c22e0 con 0x7fc6a8003a70 2023-11-15T01:33:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.743+0000 7fc6c7274700 1 -- 172.21.15.1:0/2096914558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c006c7e0 con 0x7fc6a8003a70 2023-11-15T01:33:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.743+0000 7fc6bd7fa700 1 -- 172.21.15.1:0/2096914558 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fc6b8003040 con 0x7fc6a8003a70 2023-11-15T01:33:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.744+0000 7fc6bd7fa700 1 --2- 172.21.15.1:0/2096914558 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc6ac05f2c0 0x7fc6ac061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.744+0000 7fc6bd7fa700 1 -- 172.21.15.1:0/2096914558 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fc6b807c640 con 0x7fc6a8003a70 2023-11-15T01:33:21.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.744+0000 7fc6c480f700 1 --2- 172.21.15.1:0/2096914558 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc6ac05f2c0 0x7fc6ac061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:21.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.744+0000 7fc6c480f700 1 --2- 172.21.15.1:0/2096914558 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc6ac05f2c0 0x7fc6ac061780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc6b40015a0 tx=0x7fc6b4009040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:21.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.748+0000 7fc6bd7fa700 1 -- 172.21.15.1:0/2096914558 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc6b804d6c0 con 0x7fc6a8003a70 2023-11-15T01:33:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.946+0000 7fc6c7274700 1 -- 172.21.15.1:0/2096914558 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6c0158de0 con 0x7fc6ac05f2c0 2023-11-15T01:33:21.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.950+0000 7fc6bd7fa700 1 -- 172.21.15.1:0/2096914558 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc6c0158de0 con 0x7fc6ac05f2c0 2023-11-15T01:33:21.951 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-11-15T01:33:21.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.952+0000 7fc6c7274700 1 -- 172.21.15.1:0/2096914558 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc6ac05f2c0 msgr2=0x7fc6ac061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.952+0000 7fc6c7274700 1 --2- 172.21.15.1:0/2096914558 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc6ac05f2c0 0x7fc6ac061780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc6b40015a0 tx=0x7fc6b4009040).stop 2023-11-15T01:33:21.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.952+0000 7fc6c7274700 1 -- 172.21.15.1:0/2096914558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6a8003a70 msgr2=0x7fc6c00b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:21.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.952+0000 7fc6c7274700 1 --2- 172.21.15.1:0/2096914558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6a8003a70 0x7fc6c00b0aa0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fc6b8013940 tx=0x7fc6b801a000).stop 2023-11-15T01:33:21.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.952+0000 7fc6c7274700 1 -- 172.21.15.1:0/2096914558 shutdown_connections 2023-11-15T01:33:21.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.952+0000 7fc6c7274700 1 --2- 172.21.15.1:0/2096914558 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc6ac05f2c0 0x7fc6ac061780 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.952+0000 7fc6c7274700 1 --2- 172.21.15.1:0/2096914558 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6c00accd0 0x7fc6c00ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.952+0000 7fc6c7274700 1 --2- 172.21.15.1:0/2096914558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6a8003a70 0x7fc6c00b0aa0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.952+0000 7fc6c7274700 1 --2- 172.21.15.1:0/2096914558 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6c00b0260 0x7fc6c014dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:21.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.952+0000 7fc6c7274700 1 -- 172.21.15.1:0/2096914558 >> 172.21.15.1:0/2096914558 conn(0x7fc6c0064aa0 msgr2=0x7fc6c014e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:21.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.952+0000 7fc6c7274700 1 -- 172.21.15.1:0/2096914558 shutdown_connections 2023-11-15T01:33:21.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:21.952+0000 7fc6c7274700 1 -- 172.21.15.1:0/2096914558 wait complete. 2023-11-15T01:33:21.964 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-11-15T01:33:21.965 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-11-15T01:33:22.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.087+0000 7f66a2ce5700 1 Processor -- start 2023-11-15T01:33:22.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.088+0000 7f66a2ce5700 1 -- start start 2023-11-15T01:33:22.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.088+0000 7f66a2ce5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f669c0c4320 0x7f669c0c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.088+0000 7f66a2ce5700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c0c3e90 con 0x7f669c069b30 2023-11-15T01:33:22.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.088+0000 7f66a2ce5700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c0c3560 con 0x7f669c069750 2023-11-15T01:33:22.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.088+0000 7f66a2ce5700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c0c2a40 con 0x7f669c0c4320 2023-11-15T01:33:22.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.089+0000 7f669bfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f669c0c4320 0x7f669c0c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.089+0000 7f669bfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f669c0c4320 0x7f669c0c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49858/0 (socket says 172.21.15.1:49858) 2023-11-15T01:33:22.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.089+0000 7f669bfff700 1 -- 172.21.15.1:0/3656695498 learned_addr learned my addr 172.21.15.1:0/3656695498 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:22.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.089+0000 7f66a1282700 1 --1- 172.21.15.1:0/3656695498 >> v1:172.21.15.1:6789/0 conn(0x7f669c069b30 0x7f669c13a290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48246/0 (socket says 172.21.15.1:48246) 2023-11-15T01:33:22.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.089+0000 7f669bfff700 1 -- 172.21.15.1:0/3656695498 >> v1:172.21.15.141:6789/0 conn(0x7f669c069750 legacy=0x7f669c0c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:22.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.089+0000 7f669bfff700 1 -- 172.21.15.1:0/3656695498 >> v1:172.21.15.1:6789/0 conn(0x7f669c069b30 legacy=0x7f669c13a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.089+0000 7f669bfff700 1 -- 172.21.15.1:0/3656695498 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c0c3840 con 0x7f669c0c4320 2023-11-15T01:33:22.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.089+0000 7f669b7fe700 1 -- 172.21.15.1:0/3656695498 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485366575 0 0) 0x7f669c0c3e90 con 0x7f669c069b30 2023-11-15T01:33:22.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.089+0000 7f669bfff700 1 --2- 172.21.15.1:0/3656695498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c0c4320 0x7f669c0c7260 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f668c006fd0 tx=0x7f668c0090f0).ready entity=mon.0 client_cookie=7b25885ecda3cf06 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:22.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.089+0000 7f669b7fe700 1 -- 172.21.15.1:0/3656695498 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c00b600 con 0x7f669c0c4320 2023-11-15T01:33:22.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.089+0000 7f669b7fe700 1 -- 172.21.15.1:0/3656695498 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c00b760 con 0x7f669c0c4320 2023-11-15T01:33:22.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.089+0000 7f669b7fe700 1 -- 172.21.15.1:0/3656695498 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c00bae0 con 0x7f669c0c4320 2023-11-15T01:33:22.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.090+0000 7f66a2ce5700 1 -- 172.21.15.1:0/3656695498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c0c4320 msgr2=0x7f669c0c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.090+0000 7f66a2ce5700 1 --2- 172.21.15.1:0/3656695498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c0c4320 0x7f669c0c7260 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f668c006fd0 tx=0x7f668c0090f0).stop 2023-11-15T01:33:22.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.090+0000 7f66a2ce5700 1 -- 172.21.15.1:0/3656695498 shutdown_connections 2023-11-15T01:33:22.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.090+0000 7f66a2ce5700 1 --2- 172.21.15.1:0/3656695498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c0c4320 0x7f669c0c7260 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.090+0000 7f66a2ce5700 1 -- 172.21.15.1:0/3656695498 >> 172.21.15.1:0/3656695498 conn(0x7f669c0c7dd0 msgr2=0x7f669c0c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:22.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.090+0000 7f66a2ce5700 1 -- 172.21.15.1:0/3656695498 shutdown_connections 2023-11-15T01:33:22.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.090+0000 7f66a2ce5700 1 -- 172.21.15.1:0/3656695498 wait complete. 2023-11-15T01:33:22.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.091+0000 7f66a2ce5700 1 Processor -- start 2023-11-15T01:33:22.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.091+0000 7f66a2ce5700 1 -- start start 2023-11-15T01:33:22.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a2ce5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f669c069750 0x7f669c0ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a2ce5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f669c069b30 0x7f669c138310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a2ce5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c0c4320 0x7f669c161520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a2ce5700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0adb30 con 0x7f669c0c4320 2023-11-15T01:33:22.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a2ce5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0ac650 con 0x7f669c069b30 2023-11-15T01:33:22.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a2ce5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0acf20 con 0x7f669c069750 2023-11-15T01:33:22.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a1282700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c0c4320 0x7f669c161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a1282700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c0c4320 0x7f669c161520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49872/0 (socket says 172.21.15.1:49872) 2023-11-15T01:33:22.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a1282700 1 -- 172.21.15.1:0/4108128040 learned_addr learned my addr 172.21.15.1:0/4108128040 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:22.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a0a81700 1 --2- 172.21.15.1:0/4108128040 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f669c069750 0x7f669c0ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f669bfff700 1 --2- 172.21.15.1:0/4108128040 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f669c069b30 0x7f669c138310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a1282700 1 -- 172.21.15.1:0/4108128040 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f669c069750 msgr2=0x7f669c0ac980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a1282700 1 --2- 172.21.15.1:0/4108128040 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f669c069750 0x7f669c0ac980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a1282700 1 -- 172.21.15.1:0/4108128040 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f669c069b30 msgr2=0x7f669c138310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a1282700 1 --2- 172.21.15.1:0/4108128040 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f669c069b30 0x7f669c138310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a1282700 1 -- 172.21.15.1:0/4108128040 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c009370 con 0x7f669c0c4320 2023-11-15T01:33:22.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.092+0000 7f66a1282700 1 --2- 172.21.15.1:0/4108128040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c0c4320 0x7f669c161520 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f669400ed80 tx=0x7f6694001b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:22.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.093+0000 7f6698ff9700 1 -- 172.21.15.1:0/4108128040 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400ca80 con 0x7f669c0c4320 2023-11-15T01:33:22.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.093+0000 7f6698ff9700 1 -- 172.21.15.1:0/4108128040 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400cbe0 con 0x7f669c0c4320 2023-11-15T01:33:22.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.093+0000 7f66a2ce5700 1 -- 172.21.15.1:0/4108128040 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669c0ad200 con 0x7f669c0c4320 2023-11-15T01:33:22.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.093+0000 7f6698ff9700 1 -- 172.21.15.1:0/4108128040 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694009110 con 0x7f669c0c4320 2023-11-15T01:33:22.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.093+0000 7f66a2ce5700 1 -- 172.21.15.1:0/4108128040 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c0ad7c0 con 0x7f669c0c4320 2023-11-15T01:33:22.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.094+0000 7f66a2ce5700 1 -- 172.21.15.1:0/4108128040 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669c0beee0 con 0x7f669c0c4320 2023-11-15T01:33:22.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.094+0000 7f6698ff9700 1 -- 172.21.15.1:0/4108128040 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f6694009500 con 0x7f669c0c4320 2023-11-15T01:33:22.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.094+0000 7f6698ff9700 1 --2- 172.21.15.1:0/4108128040 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f667c05f2c0 0x7f667c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.094+0000 7f6698ff9700 1 -- 172.21.15.1:0/4108128040 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f669407cd80 con 0x7f669c0c4320 2023-11-15T01:33:22.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.095+0000 7f66a0a81700 1 --2- 172.21.15.1:0/4108128040 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f667c05f2c0 0x7f667c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.095+0000 7f66a0a81700 1 --2- 172.21.15.1:0/4108128040 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f667c05f2c0 0x7f667c061780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6684003900 tx=0x7f6684007d40).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:22.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.098+0000 7f6698ff9700 1 -- 172.21.15.1:0/4108128040 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f669c0beee0 con 0x7f669c0c4320 2023-11-15T01:33:22.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.297+0000 7f66a2ce5700 1 -- 172.21.15.1:0/4108128040 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f669c0beee0 con 0x7f667c05f2c0 2023-11-15T01:33:22.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.301+0000 7f6698ff9700 1 -- 172.21.15.1:0/4108128040 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f669c0beee0 con 0x7f667c05f2c0 2023-11-15T01:33:22.302 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-11-15T01:33:22.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.303+0000 7f66a2ce5700 1 -- 172.21.15.1:0/4108128040 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f667c05f2c0 msgr2=0x7f667c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.303+0000 7f66a2ce5700 1 --2- 172.21.15.1:0/4108128040 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f667c05f2c0 0x7f667c061780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6684003900 tx=0x7f6684007d40).stop 2023-11-15T01:33:22.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.303+0000 7f66a2ce5700 1 -- 172.21.15.1:0/4108128040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c0c4320 msgr2=0x7f669c161520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.303+0000 7f66a2ce5700 1 --2- 172.21.15.1:0/4108128040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c0c4320 0x7f669c161520 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f669400ed80 tx=0x7f6694001b10).stop 2023-11-15T01:33:22.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.303+0000 7f66a2ce5700 1 -- 172.21.15.1:0/4108128040 shutdown_connections 2023-11-15T01:33:22.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.303+0000 7f66a2ce5700 1 --2- 172.21.15.1:0/4108128040 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f667c05f2c0 0x7f667c061780 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.303+0000 7f66a2ce5700 1 --2- 172.21.15.1:0/4108128040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c0c4320 0x7f669c161520 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.303+0000 7f66a2ce5700 1 --2- 172.21.15.1:0/4108128040 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f669c069750 0x7f669c0ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.303+0000 7f66a2ce5700 1 --2- 172.21.15.1:0/4108128040 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f669c069b30 0x7f669c138310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.303+0000 7f66a2ce5700 1 -- 172.21.15.1:0/4108128040 >> 172.21.15.1:0/4108128040 conn(0x7f669c0c7dd0 msgr2=0x7f669c139600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:22.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.303+0000 7f66a2ce5700 1 -- 172.21.15.1:0/4108128040 shutdown_connections 2023-11-15T01:33:22.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.303+0000 7f66a2ce5700 1 -- 172.21.15.1:0/4108128040 wait complete. 2023-11-15T01:33:22.316 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-11-15T01:33:22.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:22.317 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-11-15T01:33:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:22.337 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:22.337 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:22.337 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:22.337 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-15-01_23_00_UTC', 'scheduled-2023-11-15-01_24_00_UTC', 'scheduled-2023-11-15-01_25_00_UTC', 'scheduled-2023-11-15-01_26_00_UTC', 'scheduled-2023-11-15-01_27_00_UTC', 'scheduled-2023-11-15-01_28_00_UTC', 'scheduled-2023-11-15-01_29_00_UTC', 'scheduled-2023-11-15-01_30_00_UTC', 'scheduled-2023-11-15-01_31_00_UTC', 'scheduled-2023-11-15-01_32_00_UTC', 'scheduled-2023-11-15-01_33_00_UTC'] 2023-11-15T01:33:22.338 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-11-15T01:33:22.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.495+0000 7fec2c6c5700 1 Processor -- start 2023-11-15T01:33:22.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.495+0000 7fec2c6c5700 1 -- start start 2023-11-15T01:33:22.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.496+0000 7fec2c6c5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec240c1cb0 0x7fec24157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.496+0000 7fec2c6c5700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec240c1820 con 0x7fec24157660 2023-11-15T01:33:22.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.496+0000 7fec2c6c5700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec240c0c30 con 0x7fec240aa060 2023-11-15T01:33:22.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.496+0000 7fec2c6c5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec240c7540 con 0x7fec240c1cb0 2023-11-15T01:33:22.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.496+0000 7fec2a461700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fec24157660 0x7fec240c6280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48262/0 (socket says 172.21.15.1:48262) 2023-11-15T01:33:22.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.496+0000 7fec2a461700 1 -- 172.21.15.1:0/2903026974 learned_addr learned my addr 172.21.15.1:0/2903026974 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:22.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2945f700 1 -- 172.21.15.1:0/2903026974 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20518663 0 0) 0x7fec240c1820 con 0x7fec24157660 2023-11-15T01:33:22.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2945f700 1 -- 172.21.15.1:0/2903026974 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec0c0033f0 con 0x7fec24157660 2023-11-15T01:33:22.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec29c60700 1 --2- 172.21.15.1:0/2903026974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec240c1cb0 0x7fec24157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2945f700 1 -- 172.21.15.1:0/2903026974 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1219438119 0 0) 0x7fec0c0033f0 con 0x7fec24157660 2023-11-15T01:33:22.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2945f700 1 -- 172.21.15.1:0/2903026974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec240c1cb0 msgr2=0x7fec24157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:22.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2945f700 1 --2- 172.21.15.1:0/2903026974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec240c1cb0 0x7fec24157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2945f700 1 -- 172.21.15.1:0/2903026974 >> v1:172.21.15.141:6789/0 conn(0x7fec240aa060 legacy=0x7fec240ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2945f700 1 -- 172.21.15.1:0/2903026974 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec240c0ef0 con 0x7fec24157660 2023-11-15T01:33:22.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2945f700 1 -- 172.21.15.1:0/2903026974 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fec1c001470 con 0x7fec24157660 2023-11-15T01:33:22.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2945f700 1 -- 172.21.15.1:0/2903026974 >> v1:172.21.15.1:6789/0 conn(0x7fec24157660 legacy=0x7fec240c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2945f700 1 --2- 172.21.15.1:0/2903026974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec240c1cb0 0x7fec0c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2945f700 1 --2- 172.21.15.1:0/2903026974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec0c003e00 0x7fec0c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2945f700 1 --2- 172.21.15.1:0/2903026974 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec0c004b80 0x7fec0c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2945f700 1 -- 172.21.15.1:0/2903026974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c00b990 con 0x7fec0c003e00 2023-11-15T01:33:22.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2945f700 1 -- 172.21.15.1:0/2903026974 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c00bad0 con 0x7fec0c004b80 2023-11-15T01:33:22.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2945f700 1 -- 172.21.15.1:0/2903026974 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c00bc90 con 0x7fec240c1cb0 2023-11-15T01:33:22.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec29c60700 1 --2- 172.21.15.1:0/2903026974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec0c003e00 0x7fec0c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2a461700 1 --2- 172.21.15.1:0/2903026974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec240c1cb0 0x7fec0c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.497+0000 7fec2ac62700 1 --2- 172.21.15.1:0/2903026974 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec0c004b80 0x7fec0c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.498+0000 7fec29c60700 1 -- 172.21.15.1:0/2903026974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec240c1cb0 msgr2=0x7fec0c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:22.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.498+0000 7fec29c60700 1 --2- 172.21.15.1:0/2903026974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec240c1cb0 0x7fec0c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.498+0000 7fec29c60700 1 -- 172.21.15.1:0/2903026974 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec0c004b80 msgr2=0x7fec0c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:22.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.498+0000 7fec29c60700 1 --2- 172.21.15.1:0/2903026974 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec0c004b80 0x7fec0c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.498+0000 7fec29c60700 1 -- 172.21.15.1:0/2903026974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0033f0 con 0x7fec0c003e00 2023-11-15T01:33:22.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.498+0000 7fec29c60700 1 --2- 172.21.15.1:0/2903026974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec0c003e00 0x7fec0c004690 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fec18009a80 tx=0x7fec18009060).ready entity=mon.0 client_cookie=c654b2292ba9d6c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:22.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.498+0000 7fec2945f700 1 -- 172.21.15.1:0/2903026974 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18009430 con 0x7fec0c003e00 2023-11-15T01:33:22.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.498+0000 7fec2945f700 1 -- 172.21.15.1:0/2903026974 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1800e640 con 0x7fec0c003e00 2023-11-15T01:33:22.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.498+0000 7fec2945f700 1 -- 172.21.15.1:0/2903026974 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1800e9e0 con 0x7fec0c003e00 2023-11-15T01:33:22.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.498+0000 7fec2c6c5700 1 -- 172.21.15.1:0/2903026974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec0c003e00 msgr2=0x7fec0c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.498+0000 7fec2c6c5700 1 --2- 172.21.15.1:0/2903026974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec0c003e00 0x7fec0c004690 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fec18009a80 tx=0x7fec18009060).stop 2023-11-15T01:33:22.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.498+0000 7fec2ac62700 1 -- 172.21.15.1:0/2903026974 reap_dead start 2023-11-15T01:33:22.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.498+0000 7fec2c6c5700 1 -- 172.21.15.1:0/2903026974 shutdown_connections 2023-11-15T01:33:22.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.498+0000 7fec2c6c5700 1 -- 172.21.15.1:0/2903026974 >> 172.21.15.1:0/2903026974 conn(0x7fec24064aa0 msgr2=0x7fec24064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:22.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.499+0000 7fec2c6c5700 1 -- 172.21.15.1:0/2903026974 shutdown_connections 2023-11-15T01:33:22.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.499+0000 7fec2c6c5700 1 -- 172.21.15.1:0/2903026974 wait complete. 2023-11-15T01:33:22.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.500+0000 7fec2c6c5700 1 Processor -- start 2023-11-15T01:33:22.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.500+0000 7fec2c6c5700 1 -- start start 2023-11-15T01:33:22.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.500+0000 7fec2c6c5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec0c003e00 0x7fec240acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.500+0000 7fec2c6c5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec2414c8f0 0x7fec24158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.500+0000 7fec2c6c5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec24153680 0x7fec24153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.500+0000 7fec2c6c5700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2415a0b0 con 0x7fec2414c8f0 2023-11-15T01:33:22.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.500+0000 7fec2c6c5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2414d1b0 con 0x7fec24153680 2023-11-15T01:33:22.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.500+0000 7fec2c6c5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec240b0160 con 0x7fec0c003e00 2023-11-15T01:33:22.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec29c60700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec2414c8f0 0x7fec24158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec29c60700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec2414c8f0 0x7fec24158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49886/0 (socket says 172.21.15.1:49886) 2023-11-15T01:33:22.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec29c60700 1 -- 172.21.15.1:0/1494782869 learned_addr learned my addr 172.21.15.1:0/1494782869 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:22.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec2a461700 1 --2- 172.21.15.1:0/1494782869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec0c003e00 0x7fec240acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec2ac62700 1 --2- 172.21.15.1:0/1494782869 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec24153680 0x7fec24153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec29c60700 1 -- 172.21.15.1:0/1494782869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec0c003e00 msgr2=0x7fec240acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec29c60700 1 --2- 172.21.15.1:0/1494782869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec0c003e00 0x7fec240acaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec29c60700 1 -- 172.21.15.1:0/1494782869 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec24153680 msgr2=0x7fec24153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec29c60700 1 --2- 172.21.15.1:0/1494782869 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec24153680 0x7fec24153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec29c60700 1 -- 172.21.15.1:0/1494782869 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec24153ff0 con 0x7fec2414c8f0 2023-11-15T01:33:22.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec29c60700 1 --2- 172.21.15.1:0/1494782869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec2414c8f0 0x7fec24158c40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fec18006f70 tx=0x7fec1801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:22.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec227fc700 1 -- 172.21.15.1:0/1494782869 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18020070 con 0x7fec2414c8f0 2023-11-15T01:33:22.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec227fc700 1 -- 172.21.15.1:0/1494782869 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec18009ec0 con 0x7fec2414c8f0 2023-11-15T01:33:22.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec2c6c5700 1 -- 172.21.15.1:0/1494782869 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec240afe30 con 0x7fec2414c8f0 2023-11-15T01:33:22.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec227fc700 1 -- 172.21.15.1:0/1494782869 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18024410 con 0x7fec2414c8f0 2023-11-15T01:33:22.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.501+0000 7fec2c6c5700 1 -- 172.21.15.1:0/1494782869 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec240ae150 con 0x7fec2414c8f0 2023-11-15T01:33:22.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.502+0000 7fec2c6c5700 1 -- 172.21.15.1:0/1494782869 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2406c7e0 con 0x7fec2414c8f0 2023-11-15T01:33:22.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.503+0000 7fec227fc700 1 -- 172.21.15.1:0/1494782869 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fec180123f0 con 0x7fec2414c8f0 2023-11-15T01:33:22.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.503+0000 7fec227fc700 1 --2- 172.21.15.1:0/1494782869 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec1005f2c0 0x7fec10061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.503+0000 7fec227fc700 1 -- 172.21.15.1:0/1494782869 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fec1807ba50 con 0x7fec2414c8f0 2023-11-15T01:33:22.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.503+0000 7fec2a461700 1 --2- 172.21.15.1:0/1494782869 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec1005f2c0 0x7fec10061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.504+0000 7fec2a461700 1 --2- 172.21.15.1:0/1494782869 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec1005f2c0 0x7fec10061780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fec1c001120 tx=0x7fec1c001e70).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:22.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.507+0000 7fec227fc700 1 -- 172.21.15.1:0/1494782869 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fec1804ca70 con 0x7fec2414c8f0 2023-11-15T01:33:22.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.706+0000 7fec2c6c5700 1 -- 172.21.15.1:0/1494782869 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec240ae850 con 0x7fec1005f2c0 2023-11-15T01:33:22.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.708+0000 7fec227fc700 1 -- 172.21.15.1:0/1494782869 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fec240ae850 con 0x7fec1005f2c0 2023-11-15T01:33:22.709 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:22.709 INFO:teuthology.orchestra.run.smithi001.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:36", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:22.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.710+0000 7fec2c6c5700 1 -- 172.21.15.1:0/1494782869 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec1005f2c0 msgr2=0x7fec10061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.710+0000 7fec2c6c5700 1 --2- 172.21.15.1:0/1494782869 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec1005f2c0 0x7fec10061780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fec1c001120 tx=0x7fec1c001e70).stop 2023-11-15T01:33:22.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.710+0000 7fec2c6c5700 1 -- 172.21.15.1:0/1494782869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec2414c8f0 msgr2=0x7fec24158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.710+0000 7fec2c6c5700 1 --2- 172.21.15.1:0/1494782869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec2414c8f0 0x7fec24158c40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fec18006f70 tx=0x7fec1801a000).stop 2023-11-15T01:33:22.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.710+0000 7fec2c6c5700 1 -- 172.21.15.1:0/1494782869 shutdown_connections 2023-11-15T01:33:22.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.710+0000 7fec2c6c5700 1 --2- 172.21.15.1:0/1494782869 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec1005f2c0 0x7fec10061780 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.710+0000 7fec2c6c5700 1 --2- 172.21.15.1:0/1494782869 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec24153680 0x7fec24153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.710+0000 7fec2c6c5700 1 --2- 172.21.15.1:0/1494782869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec0c003e00 0x7fec240acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.710+0000 7fec2c6c5700 1 --2- 172.21.15.1:0/1494782869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec2414c8f0 0x7fec24158c40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.710+0000 7fec2c6c5700 1 -- 172.21.15.1:0/1494782869 >> 172.21.15.1:0/1494782869 conn(0x7fec24064aa0 msgr2=0x7fec241547e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:22.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.710+0000 7fec2c6c5700 1 -- 172.21.15.1:0/1494782869 shutdown_connections 2023-11-15T01:33:22.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.710+0000 7fec2c6c5700 1 -- 172.21.15.1:0/1494782869 wait complete. 2023-11-15T01:33:22.722 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:36", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:22.723 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-11-15T00:00:00', 'created': '2023-11-15T01:22:36', 'first': '2023-11-15T01:23:00', 'last': '2023-11-15T01:33:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-15T01:33:22.723 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-15T01:33:22.723 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-15T01:33:22.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:22.724 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-11-15T01:33:22.741 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:22.741 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:22.741 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:22.741 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:22.741 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:22.742 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:22.742 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:22.742 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:22.742 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:22.742 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:22.743 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:22.743 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-15-01_23_00_UTC', 'scheduled-2023-11-15-01_24_00_UTC', 'scheduled-2023-11-15-01_25_00_UTC', 'scheduled-2023-11-15-01_26_00_UTC', 'scheduled-2023-11-15-01_27_00_UTC', 'scheduled-2023-11-15-01_28_00_UTC', 'scheduled-2023-11-15-01_29_00_UTC', 'scheduled-2023-11-15-01_30_00_UTC', 'scheduled-2023-11-15-01_31_00_UTC', 'scheduled-2023-11-15-01_32_00_UTC', 'scheduled-2023-11-15-01_33_00_UTC'] 2023-11-15T01:33:22.743 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-11-15T01:33:22.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.902+0000 7f1706887700 1 Processor -- start 2023-11-15T01:33:22.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.902+0000 7f1706887700 1 -- start start 2023-11-15T01:33:22.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.903+0000 7f1706887700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f17000ca5d0 0x7f17000aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.903+0000 7f1706887700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1700155610 0x7f1700063440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.903+0000 7f1706887700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1700063930 0x7f17000c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.903+0000 7f1706887700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17000aaa50 con 0x7f17000ca5d0 2023-11-15T01:33:22.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.903+0000 7f1706887700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17001548f0 con 0x7f1700155610 2023-11-15T01:33:22.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.903+0000 7f1706887700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17000aa4f0 con 0x7f1700063930 2023-11-15T01:33:22.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.903+0000 7f1705885700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f17000ca5d0 0x7f17000aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.903+0000 7f1705885700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f17000ca5d0 0x7f17000aa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49900/0 (socket says 172.21.15.1:49900) 2023-11-15T01:33:22.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.903+0000 7f1705885700 1 -- 172.21.15.1:0/2521925016 learned_addr learned my addr 172.21.15.1:0/2521925016 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:22.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.903+0000 7f1705084700 1 --2- 172.21.15.1:0/2521925016 >> v2:172.21.15.141:3300/0 conn(0x7f1700155610 0x7f1700063440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.903+0000 7f1706086700 1 --2- 172.21.15.1:0/2521925016 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1700063930 0x7f17000c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.903+0000 7f1705885700 1 -- 172.21.15.1:0/2521925016 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1700063930 msgr2=0x7f17000c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:22.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.903+0000 7f1705885700 1 --2- 172.21.15.1:0/2521925016 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1700063930 0x7f17000c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1705885700 1 -- 172.21.15.1:0/2521925016 >> v2:172.21.15.141:3300/0 conn(0x7f1700155610 msgr2=0x7f1700063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:22.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1705885700 1 --2- 172.21.15.1:0/2521925016 >> v2:172.21.15.141:3300/0 conn(0x7f1700155610 0x7f1700063440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1705885700 1 -- 172.21.15.1:0/2521925016 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700063da0 con 0x7f17000ca5d0 2023-11-15T01:33:22.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1705885700 1 --2- 172.21.15.1:0/2521925016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17000ca5d0 0x7f17000aa000 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f170005f2d0 tx=0x7f16f8009840).ready entity=mon.0 client_cookie=61e3f24b70e21755 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:22.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1704883700 1 -- 172.21.15.1:0/2521925016 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800e070 con 0x7f17000ca5d0 2023-11-15T01:33:22.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1704883700 1 -- 172.21.15.1:0/2521925016 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f800b970 con 0x7f17000ca5d0 2023-11-15T01:33:22.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1704883700 1 -- 172.21.15.1:0/2521925016 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800bcf0 con 0x7f17000ca5d0 2023-11-15T01:33:22.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1706887700 1 -- 172.21.15.1:0/2521925016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17000ca5d0 msgr2=0x7f17000aa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1706887700 1 --2- 172.21.15.1:0/2521925016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17000ca5d0 0x7f17000aa000 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f170005f2d0 tx=0x7f16f8009840).stop 2023-11-15T01:33:22.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1706887700 1 -- 172.21.15.1:0/2521925016 shutdown_connections 2023-11-15T01:33:22.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1706887700 1 --2- 172.21.15.1:0/2521925016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17000ca5d0 0x7f17000aa000 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1706887700 1 --2- 172.21.15.1:0/2521925016 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1700063930 0x7f17000c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1706887700 1 --2- 172.21.15.1:0/2521925016 >> v2:172.21.15.141:3300/0 conn(0x7f1700155610 0x7f1700063440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1706887700 1 -- 172.21.15.1:0/2521925016 >> 172.21.15.1:0/2521925016 conn(0x7f170006a9b0 msgr2=0x7f17000cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:22.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1706887700 1 -- 172.21.15.1:0/2521925016 shutdown_connections 2023-11-15T01:33:22.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.904+0000 7f1706887700 1 -- 172.21.15.1:0/2521925016 wait complete. 2023-11-15T01:33:22.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.906+0000 7f1706887700 1 Processor -- start 2023-11-15T01:33:22.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.906+0000 7f1706887700 1 -- start start 2023-11-15T01:33:22.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.906+0000 7f1706887700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1700063930 0x7f1700151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.906+0000 7f1706887700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17000ca5d0 0x7f1700143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.906+0000 7f1706887700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1700155610 0x7f17000c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.906+0000 7f1706887700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17000c9130 con 0x7f1700155610 2023-11-15T01:33:22.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.906+0000 7f1706887700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17001645e0 con 0x7f17000ca5d0 2023-11-15T01:33:22.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.906+0000 7f1706887700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1700165140 con 0x7f1700063930 2023-11-15T01:33:22.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.906+0000 7f1706086700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1700155610 0x7f17000c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.906+0000 7f1706086700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1700155610 0x7f17000c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49904/0 (socket says 172.21.15.1:49904) 2023-11-15T01:33:22.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.906+0000 7f1706086700 1 -- 172.21.15.1:0/4025503309 learned_addr learned my addr 172.21.15.1:0/4025503309 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:22.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.907+0000 7f1705885700 1 --2- 172.21.15.1:0/4025503309 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1700063930 0x7f1700151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.907+0000 7f1705084700 1 --2- 172.21.15.1:0/4025503309 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17000ca5d0 0x7f1700143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.907+0000 7f1706086700 1 -- 172.21.15.1:0/4025503309 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1700063930 msgr2=0x7f1700151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.907+0000 7f1706086700 1 --2- 172.21.15.1:0/4025503309 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1700063930 0x7f1700151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.907+0000 7f1706086700 1 -- 172.21.15.1:0/4025503309 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17000ca5d0 msgr2=0x7f1700143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:22.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.907+0000 7f1706086700 1 --2- 172.21.15.1:0/4025503309 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17000ca5d0 0x7f1700143d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:22.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.907+0000 7f1706086700 1 -- 172.21.15.1:0/4025503309 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f8009ae0 con 0x7f1700155610 2023-11-15T01:33:22.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.907+0000 7f1706086700 1 --2- 172.21.15.1:0/4025503309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1700155610 0x7f17000c8920 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f16f000e900 tx=0x7f16f0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:22.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.907+0000 7f16fdffb700 1 -- 172.21.15.1:0/4025503309 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0012600 con 0x7f1700155610 2023-11-15T01:33:22.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.907+0000 7f16fdffb700 1 -- 172.21.15.1:0/4025503309 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f0012760 con 0x7f1700155610 2023-11-15T01:33:22.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.907+0000 7f1706887700 1 -- 172.21.15.1:0/4025503309 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17001655d0 con 0x7f1700155610 2023-11-15T01:33:22.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.907+0000 7f16fdffb700 1 -- 172.21.15.1:0/4025503309 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0012ae0 con 0x7f1700155610 2023-11-15T01:33:22.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.907+0000 7f1706887700 1 -- 172.21.15.1:0/4025503309 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1700164af0 con 0x7f1700155610 2023-11-15T01:33:22.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.908+0000 7f1706887700 1 -- 172.21.15.1:0/4025503309 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17000475e0 con 0x7f1700155610 2023-11-15T01:33:22.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.909+0000 7f16fdffb700 1 -- 172.21.15.1:0/4025503309 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f16f001b400 con 0x7f1700155610 2023-11-15T01:33:22.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.909+0000 7f16fdffb700 1 --2- 172.21.15.1:0/4025503309 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f16ec05f290 0x7f16ec061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:22.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.909+0000 7f16fdffb700 1 -- 172.21.15.1:0/4025503309 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f16f007a720 con 0x7f1700155610 2023-11-15T01:33:22.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.909+0000 7f1705885700 1 --2- 172.21.15.1:0/4025503309 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f16ec05f290 0x7f16ec061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:22.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.909+0000 7f1705885700 1 --2- 172.21.15.1:0/4025503309 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f16ec05f290 0x7f16ec061750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f16f8009880 tx=0x7f17000aa660).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:22.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:22.913+0000 7f16fdffb700 1 -- 172.21.15.1:0/4025503309 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f16f004b740 con 0x7f1700155610 2023-11-15T01:33:23.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.109+0000 7f1706887700 1 -- 172.21.15.1:0/4025503309 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17000aa770 con 0x7f16ec05f290 2023-11-15T01:33:23.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.111+0000 7f16fdffb700 1 -- 172.21.15.1:0/4025503309 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f17000aa770 con 0x7f16ec05f290 2023-11-15T01:33:23.112 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:23.112 INFO:teuthology.orchestra.run.smithi001.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:36", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.113+0000 7f1706887700 1 -- 172.21.15.1:0/4025503309 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f16ec05f290 msgr2=0x7f16ec061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.113+0000 7f1706887700 1 --2- 172.21.15.1:0/4025503309 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f16ec05f290 0x7f16ec061750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f16f8009880 tx=0x7f17000aa660).stop 2023-11-15T01:33:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.113+0000 7f1706887700 1 -- 172.21.15.1:0/4025503309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1700155610 msgr2=0x7f17000c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:23.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.113+0000 7f1706887700 1 --2- 172.21.15.1:0/4025503309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1700155610 0x7f17000c8920 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f16f000e900 tx=0x7f16f0009060).stop 2023-11-15T01:33:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.113+0000 7f1706887700 1 -- 172.21.15.1:0/4025503309 shutdown_connections 2023-11-15T01:33:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.113+0000 7f1706887700 1 --2- 172.21.15.1:0/4025503309 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f16ec05f290 0x7f16ec061750 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.113+0000 7f1706887700 1 --2- 172.21.15.1:0/4025503309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1700155610 0x7f17000c8920 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.113+0000 7f1706887700 1 --2- 172.21.15.1:0/4025503309 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1700063930 0x7f1700151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.113+0000 7f1706887700 1 --2- 172.21.15.1:0/4025503309 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17000ca5d0 0x7f1700143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.113+0000 7f1706887700 1 -- 172.21.15.1:0/4025503309 >> 172.21.15.1:0/4025503309 conn(0x7f170006a9b0 msgr2=0x7f17001564c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:23.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.113+0000 7f1706887700 1 -- 172.21.15.1:0/4025503309 shutdown_connections 2023-11-15T01:33:23.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.113+0000 7f1706887700 1 -- 172.21.15.1:0/4025503309 wait complete. 2023-11-15T01:33:23.125 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:36", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:23.125 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-11-15T00:00:00', 'created': '2023-11-15T01:22:36', 'first': '2023-11-15T01:23:00', 'last': '2023-11-15T01:33:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-15T01:33:23.126 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-15T01:33:23.126 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-15T01:33:23.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:23.127 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-11-15T01:33:23.144 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:23.144 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:23.144 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:23.144 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:23.144 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:23.145 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:23.145 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:23.145 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:23.145 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:23.145 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:23.146 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:23.146 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-15-01_23_00_UTC', 'scheduled-2023-11-15-01_24_00_UTC', 'scheduled-2023-11-15-01_25_00_UTC', 'scheduled-2023-11-15-01_26_00_UTC', 'scheduled-2023-11-15-01_27_00_UTC', 'scheduled-2023-11-15-01_28_00_UTC', 'scheduled-2023-11-15-01_29_00_UTC', 'scheduled-2023-11-15-01_30_00_UTC', 'scheduled-2023-11-15-01_31_00_UTC', 'scheduled-2023-11-15-01_32_00_UTC', 'scheduled-2023-11-15-01_33_00_UTC'] 2023-11-15T01:33:23.146 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-11-15T01:33:23.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.305+0000 7fee5870a700 1 Processor -- start 2023-11-15T01:33:23.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.305+0000 7fee5870a700 1 -- start start 2023-11-15T01:33:23.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.306+0000 7fee5870a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee500833a0 0x7fee500bee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:23.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.306+0000 7fee5870a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fee500bf350 0x7fee500c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:23.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.306+0000 7fee5870a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee500c7ae0 con 0x7fee50155790 2023-11-15T01:33:23.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.306+0000 7fee5870a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee50066210 con 0x7fee500bf350 2023-11-15T01:33:23.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.306+0000 7fee5870a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee500a63b0 con 0x7fee500833a0 2023-11-15T01:33:23.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.306+0000 7fee56ca7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fee500bf350 0x7fee500c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:23.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.306+0000 7fee56ca7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fee500bf350 0x7fee500c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49910/0 (socket says 172.21.15.1:49910) 2023-11-15T01:33:23.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.306+0000 7fee56ca7700 1 -- 172.21.15.1:0/2769747860 learned_addr learned my addr 172.21.15.1:0/2769747860 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:23.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.307+0000 7fee55ca5700 1 --2- 172.21.15.1:0/2769747860 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee500833a0 0x7fee500bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:23.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.307+0000 7fee56ca7700 1 -- 172.21.15.1:0/2769747860 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee500833a0 msgr2=0x7fee500bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:23.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.307+0000 7fee56ca7700 1 --2- 172.21.15.1:0/2769747860 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee500833a0 0x7fee500bee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.307+0000 7fee56ca7700 1 -- 172.21.15.1:0/2769747860 >> v1:172.21.15.141:6789/0 conn(0x7fee50155790 legacy=0x7fee500a5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:23.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.307+0000 7fee56ca7700 1 -- 172.21.15.1:0/2769747860 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500c77b0 con 0x7fee500bf350 2023-11-15T01:33:23.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.307+0000 7fee56ca7700 1 --2- 172.21.15.1:0/2769747860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee500bf350 0x7fee500c3fe0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fee48006fd0 tx=0x7fee480090f0).ready entity=mon.0 client_cookie=4d2ed710c798f209 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:23.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.307+0000 7fee554a4700 1 -- 172.21.15.1:0/2769747860 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4800b600 con 0x7fee500bf350 2023-11-15T01:33:23.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.307+0000 7fee554a4700 1 -- 172.21.15.1:0/2769747860 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4800b760 con 0x7fee500bf350 2023-11-15T01:33:23.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.307+0000 7fee554a4700 1 -- 172.21.15.1:0/2769747860 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4800bae0 con 0x7fee500bf350 2023-11-15T01:33:23.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.307+0000 7fee5870a700 1 -- 172.21.15.1:0/2769747860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee500bf350 msgr2=0x7fee500c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:23.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.307+0000 7fee5870a700 1 --2- 172.21.15.1:0/2769747860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee500bf350 0x7fee500c3fe0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fee48006fd0 tx=0x7fee480090f0).stop 2023-11-15T01:33:23.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.308+0000 7fee5870a700 1 -- 172.21.15.1:0/2769747860 shutdown_connections 2023-11-15T01:33:23.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.308+0000 7fee5870a700 1 --2- 172.21.15.1:0/2769747860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee500bf350 0x7fee500c3fe0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.308+0000 7fee5870a700 1 --2- 172.21.15.1:0/2769747860 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee500833a0 0x7fee500bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.308+0000 7fee5870a700 1 -- 172.21.15.1:0/2769747860 >> 172.21.15.1:0/2769747860 conn(0x7fee50082f90 msgr2=0x7fee500c8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:23.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.308+0000 7fee5870a700 1 -- 172.21.15.1:0/2769747860 shutdown_connections 2023-11-15T01:33:23.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.308+0000 7fee5870a700 1 -- 172.21.15.1:0/2769747860 wait complete. 2023-11-15T01:33:23.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.309+0000 7fee5870a700 1 Processor -- start 2023-11-15T01:33:23.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.309+0000 7fee5870a700 1 -- start start 2023-11-15T01:33:23.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.309+0000 7fee5870a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee500833a0 0x7fee500bff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:23.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.309+0000 7fee5870a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee50155790 0x7fee50162b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:23.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.309+0000 7fee5870a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee50092cd0 0x7fee500adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:23.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee5870a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee50164300 con 0x7fee50155790 2023-11-15T01:33:23.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee5870a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee50163410 con 0x7fee500833a0 2023-11-15T01:33:23.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee5870a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee501636f0 con 0x7fee50092cd0 2023-11-15T01:33:23.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee55ca5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee50155790 0x7fee50162b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:23.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee55ca5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee50155790 0x7fee50162b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49914/0 (socket says 172.21.15.1:49914) 2023-11-15T01:33:23.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee55ca5700 1 -- 172.21.15.1:0/3528515650 learned_addr learned my addr 172.21.15.1:0/3528515650 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:23.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee564a6700 1 --2- 172.21.15.1:0/3528515650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee500833a0 0x7fee500bff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:23.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee56ca7700 1 --2- 172.21.15.1:0/3528515650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee50092cd0 0x7fee500adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:23.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee55ca5700 1 -- 172.21.15.1:0/3528515650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee50092cd0 msgr2=0x7fee500adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:23.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee55ca5700 1 --2- 172.21.15.1:0/3528515650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee50092cd0 0x7fee500adff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee55ca5700 1 -- 172.21.15.1:0/3528515650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee500833a0 msgr2=0x7fee500bff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:23.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee55ca5700 1 --2- 172.21.15.1:0/3528515650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee500833a0 0x7fee500bff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee55ca5700 1 -- 172.21.15.1:0/3528515650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee48009370 con 0x7fee50155790 2023-11-15T01:33:23.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee55ca5700 1 --2- 172.21.15.1:0/3528515650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee50155790 0x7fee50162b80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fee4400d860 tx=0x7fee44008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:23.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee4e7fc700 1 -- 172.21.15.1:0/3528515650 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44011590 con 0x7fee50155790 2023-11-15T01:33:23.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee4e7fc700 1 -- 172.21.15.1:0/3528515650 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee440116f0 con 0x7fee50155790 2023-11-15T01:33:23.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee5870a700 1 -- 172.21.15.1:0/3528515650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee501639d0 con 0x7fee50155790 2023-11-15T01:33:23.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee4e7fc700 1 -- 172.21.15.1:0/3528515650 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44011a70 con 0x7fee50155790 2023-11-15T01:33:23.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.310+0000 7fee5870a700 1 -- 172.21.15.1:0/3528515650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee50163f90 con 0x7fee50155790 2023-11-15T01:33:23.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.311+0000 7fee5870a700 1 -- 172.21.15.1:0/3528515650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee500c6b40 con 0x7fee50155790 2023-11-15T01:33:23.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.312+0000 7fee4e7fc700 1 -- 172.21.15.1:0/3528515650 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fee4401c460 con 0x7fee50155790 2023-11-15T01:33:23.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.312+0000 7fee4e7fc700 1 --2- 172.21.15.1:0/3528515650 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fee3c05f2c0 0x7fee3c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:23.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.312+0000 7fee4e7fc700 1 -- 172.21.15.1:0/3528515650 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fee4407a490 con 0x7fee50155790 2023-11-15T01:33:23.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.312+0000 7fee564a6700 1 --2- 172.21.15.1:0/3528515650 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fee3c05f2c0 0x7fee3c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:23.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.313+0000 7fee564a6700 1 --2- 172.21.15.1:0/3528515650 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fee3c05f2c0 0x7fee3c061780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fee40007fd0 tx=0x7fee40001530).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:23.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.316+0000 7fee4e7fc700 1 -- 172.21.15.1:0/3528515650 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fee4404b4b0 con 0x7fee50155790 2023-11-15T01:33:23.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.517+0000 7fee5870a700 1 -- 172.21.15.1:0/3528515650 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fee50164440 con 0x7fee3c05f2c0 2023-11-15T01:33:23.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.519+0000 7fee4e7fc700 1 -- 172.21.15.1:0/3528515650 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fee50164440 con 0x7fee3c05f2c0 2023-11-15T01:33:23.520 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:23.520 INFO:teuthology.orchestra.run.smithi001.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:37", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:23.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.521+0000 7fee5870a700 1 -- 172.21.15.1:0/3528515650 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fee3c05f2c0 msgr2=0x7fee3c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:23.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.521+0000 7fee5870a700 1 --2- 172.21.15.1:0/3528515650 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fee3c05f2c0 0x7fee3c061780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fee40007fd0 tx=0x7fee40001530).stop 2023-11-15T01:33:23.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.521+0000 7fee5870a700 1 -- 172.21.15.1:0/3528515650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee50155790 msgr2=0x7fee50162b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:23.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.521+0000 7fee5870a700 1 --2- 172.21.15.1:0/3528515650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee50155790 0x7fee50162b80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fee4400d860 tx=0x7fee44008040).stop 2023-11-15T01:33:23.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.521+0000 7fee5870a700 1 -- 172.21.15.1:0/3528515650 shutdown_connections 2023-11-15T01:33:23.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.521+0000 7fee5870a700 1 --2- 172.21.15.1:0/3528515650 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fee3c05f2c0 0x7fee3c061780 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.521+0000 7fee5870a700 1 --2- 172.21.15.1:0/3528515650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee50092cd0 0x7fee500adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.521+0000 7fee5870a700 1 --2- 172.21.15.1:0/3528515650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee500833a0 0x7fee500bff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.521+0000 7fee5870a700 1 --2- 172.21.15.1:0/3528515650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee50155790 0x7fee50162b80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.521+0000 7fee5870a700 1 -- 172.21.15.1:0/3528515650 >> 172.21.15.1:0/3528515650 conn(0x7fee50082f90 msgr2=0x7fee50152190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:23.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.521+0000 7fee5870a700 1 -- 172.21.15.1:0/3528515650 shutdown_connections 2023-11-15T01:33:23.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.521+0000 7fee5870a700 1 -- 172.21.15.1:0/3528515650 wait complete. 2023-11-15T01:33:23.533 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:37", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:23.534 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-11-15T00:00:00', 'created': '2023-11-15T01:22:37', 'first': '2023-11-15T01:23:00', 'last': '2023-11-15T01:33:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-15T01:33:23.534 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-15T01:33:23.534 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-15T01:33:23.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:23.535 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-11-15T01:33:23.551 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:23.552 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:23.552 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:23.552 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:23.552 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:23.552 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:23.553 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:23.553 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:23.553 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:23.553 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:23.553 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:23.554 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-15-01_23_00_UTC', 'scheduled-2023-11-15-01_24_00_UTC', 'scheduled-2023-11-15-01_25_00_UTC', 'scheduled-2023-11-15-01_26_00_UTC', 'scheduled-2023-11-15-01_27_00_UTC', 'scheduled-2023-11-15-01_28_00_UTC', 'scheduled-2023-11-15-01_29_00_UTC', 'scheduled-2023-11-15-01_30_00_UTC', 'scheduled-2023-11-15-01_31_00_UTC', 'scheduled-2023-11-15-01_32_00_UTC', 'scheduled-2023-11-15-01_33_00_UTC'] 2023-11-15T01:33:23.554 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-11-15T01:33:23.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.714+0000 7eff55e2f700 1 Processor -- start 2023-11-15T01:33:23.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.714+0000 7eff55e2f700 1 -- start start 2023-11-15T01:33:23.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.715+0000 7eff55e2f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff5014b350 0x7eff500c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:23.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.715+0000 7eff55e2f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7eff500aa750 0x7eff50154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:23.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.715+0000 7eff55e2f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff501580d0 con 0x7eff5014b730 2023-11-15T01:33:23.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.715+0000 7eff55e2f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff50155000 con 0x7eff500aa750 2023-11-15T01:33:23.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.715+0000 7eff55e2f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff501552e0 con 0x7eff5014b350 2023-11-15T01:33:23.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.715+0000 7eff4ffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7eff500aa750 0x7eff50154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:23.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.715+0000 7eff4effd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7eff5014b730 0x7eff500aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48264/0 (socket says 172.21.15.1:48264) 2023-11-15T01:33:23.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.715+0000 7eff4effd700 1 -- 172.21.15.1:0/3033670312 learned_addr learned my addr 172.21.15.1:0/3033670312 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:23.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.716+0000 7eff4f7fe700 1 --2- 172.21.15.1:0/3033670312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff5014b350 0x7eff500c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:23.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.716+0000 7eff4ffff700 1 -- 172.21.15.1:0/3033670312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff5014b350 msgr2=0x7eff500c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:23.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.716+0000 7eff4ffff700 1 --2- 172.21.15.1:0/3033670312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff5014b350 0x7eff500c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.716+0000 7eff4ffff700 1 -- 172.21.15.1:0/3033670312 >> v1:172.21.15.1:6789/0 conn(0x7eff5014b730 legacy=0x7eff500aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:23.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.716+0000 7eff4ffff700 1 -- 172.21.15.1:0/3033670312 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff501555c0 con 0x7eff500aa750 2023-11-15T01:33:23.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.716+0000 7eff4ffff700 1 --2- 172.21.15.1:0/3033670312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff500aa750 0x7eff50154a10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7eff48009e60 tx=0x7eff48009780).ready entity=mon.0 client_cookie=aaf2d82baed37b9d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:23.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.716+0000 7eff4e7fc700 1 -- 172.21.15.1:0/3033670312 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4800e070 con 0x7eff500aa750 2023-11-15T01:33:23.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.716+0000 7eff4e7fc700 1 -- 172.21.15.1:0/3033670312 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4800bc30 con 0x7eff500aa750 2023-11-15T01:33:23.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.716+0000 7eff4e7fc700 1 -- 172.21.15.1:0/3033670312 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48012410 con 0x7eff500aa750 2023-11-15T01:33:23.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.716+0000 7eff55e2f700 1 -- 172.21.15.1:0/3033670312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff500aa750 msgr2=0x7eff50154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:23.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.716+0000 7eff55e2f700 1 --2- 172.21.15.1:0/3033670312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff500aa750 0x7eff50154a10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7eff48009e60 tx=0x7eff48009780).stop 2023-11-15T01:33:23.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.717+0000 7eff55e2f700 1 -- 172.21.15.1:0/3033670312 shutdown_connections 2023-11-15T01:33:23.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.717+0000 7eff55e2f700 1 --2- 172.21.15.1:0/3033670312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff500aa750 0x7eff50154a10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.717+0000 7eff55e2f700 1 --2- 172.21.15.1:0/3033670312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff5014b350 0x7eff500c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.717+0000 7eff55e2f700 1 -- 172.21.15.1:0/3033670312 >> 172.21.15.1:0/3033670312 conn(0x7eff50069ee0 msgr2=0x7eff5006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:23.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.717+0000 7eff55e2f700 1 -- 172.21.15.1:0/3033670312 shutdown_connections 2023-11-15T01:33:23.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.717+0000 7eff55e2f700 1 -- 172.21.15.1:0/3033670312 wait complete. 2023-11-15T01:33:23.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.718+0000 7eff55e2f700 1 Processor -- start 2023-11-15T01:33:23.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.718+0000 7eff55e2f700 1 -- start start 2023-11-15T01:33:23.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff55e2f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff500aa750 0x7eff50148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:23.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff55e2f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff5014b350 0x7eff500ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:23.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff55e2f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff5014b730 0x7eff50140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:23.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff55e2f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff50168b60 con 0x7eff5014b730 2023-11-15T01:33:23.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff55e2f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff500aed40 con 0x7eff5014b350 2023-11-15T01:33:23.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff55e2f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff50167fe0 con 0x7eff500aa750 2023-11-15T01:33:23.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff4ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff5014b730 0x7eff50140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:23.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff4ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff5014b730 0x7eff50140370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49930/0 (socket says 172.21.15.1:49930) 2023-11-15T01:33:23.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff4ffff700 1 -- 172.21.15.1:0/1046735936 learned_addr learned my addr 172.21.15.1:0/1046735936 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:23.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff4effd700 1 --2- 172.21.15.1:0/1046735936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff5014b350 0x7eff500ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:23.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff4f7fe700 1 --2- 172.21.15.1:0/1046735936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff500aa750 0x7eff50148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:23.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff4ffff700 1 -- 172.21.15.1:0/1046735936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff500aa750 msgr2=0x7eff50148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:23.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff4ffff700 1 --2- 172.21.15.1:0/1046735936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff500aa750 0x7eff50148100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff4ffff700 1 -- 172.21.15.1:0/1046735936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff5014b350 msgr2=0x7eff500ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:23.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff4ffff700 1 --2- 172.21.15.1:0/1046735936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff5014b350 0x7eff500ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff4ffff700 1 -- 172.21.15.1:0/1046735936 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff48009a20 con 0x7eff5014b730 2023-11-15T01:33:23.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff4effd700 1 --2- 172.21.15.1:0/1046735936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff5014b350 0x7eff500ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:23.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff4ffff700 1 --2- 172.21.15.1:0/1046735936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff5014b730 0x7eff50140370 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7eff50083e50 tx=0x7eff48009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:23.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff377fe700 1 -- 172.21.15.1:0/1046735936 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff480117d0 con 0x7eff5014b730 2023-11-15T01:33:23.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff377fe700 1 -- 172.21.15.1:0/1046735936 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff48011930 con 0x7eff5014b730 2023-11-15T01:33:23.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff55e2f700 1 -- 172.21.15.1:0/1046735936 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff501682c0 con 0x7eff5014b730 2023-11-15T01:33:23.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff377fe700 1 -- 172.21.15.1:0/1046735936 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48011cf0 con 0x7eff5014b730 2023-11-15T01:33:23.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.719+0000 7eff55e2f700 1 -- 172.21.15.1:0/1046735936 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff50168880 con 0x7eff5014b730 2023-11-15T01:33:23.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.720+0000 7eff55e2f700 1 -- 172.21.15.1:0/1046735936 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5006c7e0 con 0x7eff5014b730 2023-11-15T01:33:23.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.721+0000 7eff377fe700 1 -- 172.21.15.1:0/1046735936 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7eff48003040 con 0x7eff5014b730 2023-11-15T01:33:23.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.721+0000 7eff377fe700 1 --2- 172.21.15.1:0/1046735936 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7eff3c05f2c0 0x7eff3c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:23.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.721+0000 7eff377fe700 1 -- 172.21.15.1:0/1046735936 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7eff4807c590 con 0x7eff5014b730 2023-11-15T01:33:23.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.721+0000 7eff4f7fe700 1 --2- 172.21.15.1:0/1046735936 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7eff3c05f2c0 0x7eff3c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:23.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.722+0000 7eff4f7fe700 1 --2- 172.21.15.1:0/1046735936 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7eff3c05f2c0 0x7eff3c061780 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7eff40006fd0 tx=0x7eff40008040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:23.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.725+0000 7eff377fe700 1 -- 172.21.15.1:0/1046735936 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7eff4804d610 con 0x7eff5014b730 2023-11-15T01:33:23.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.922+0000 7eff55e2f700 1 -- 172.21.15.1:0/1046735936 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff5005f8b0 con 0x7eff3c05f2c0 2023-11-15T01:33:23.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.923+0000 7eff377fe700 1 -- 172.21.15.1:0/1046735936 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7eff5005f8b0 con 0x7eff3c05f2c0 2023-11-15T01:33:23.924 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:23.924 INFO:teuthology.orchestra.run.smithi001.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:37", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:23.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.925+0000 7eff55e2f700 1 -- 172.21.15.1:0/1046735936 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7eff3c05f2c0 msgr2=0x7eff3c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:23.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.925+0000 7eff55e2f700 1 --2- 172.21.15.1:0/1046735936 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7eff3c05f2c0 0x7eff3c061780 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7eff40006fd0 tx=0x7eff40008040).stop 2023-11-15T01:33:23.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.925+0000 7eff55e2f700 1 -- 172.21.15.1:0/1046735936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff5014b730 msgr2=0x7eff50140370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:23.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.925+0000 7eff55e2f700 1 --2- 172.21.15.1:0/1046735936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff5014b730 0x7eff50140370 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7eff50083e50 tx=0x7eff48009780).stop 2023-11-15T01:33:23.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.925+0000 7eff55e2f700 1 -- 172.21.15.1:0/1046735936 shutdown_connections 2023-11-15T01:33:23.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.925+0000 7eff55e2f700 1 --2- 172.21.15.1:0/1046735936 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7eff3c05f2c0 0x7eff3c061780 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.925+0000 7eff55e2f700 1 --2- 172.21.15.1:0/1046735936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff5014b730 0x7eff50140370 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.925+0000 7eff55e2f700 1 --2- 172.21.15.1:0/1046735936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff500aa750 0x7eff50148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.925+0000 7eff55e2f700 1 --2- 172.21.15.1:0/1046735936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff5014b350 0x7eff500ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:23.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.925+0000 7eff55e2f700 1 -- 172.21.15.1:0/1046735936 >> 172.21.15.1:0/1046735936 conn(0x7eff50069ee0 msgr2=0x7eff5014a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:23.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.925+0000 7eff55e2f700 1 -- 172.21.15.1:0/1046735936 shutdown_connections 2023-11-15T01:33:23.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:23.925+0000 7eff55e2f700 1 -- 172.21.15.1:0/1046735936 wait complete. 2023-11-15T01:33:23.937 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:37", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:23.938 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-11-15T00:00:00', 'created': '2023-11-15T01:22:37', 'first': '2023-11-15T01:23:00', 'last': '2023-11-15T01:33:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-15T01:33:23.938 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-15T01:33:23.939 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-15T01:33:23.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:23.939 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-11-15T01:33:23.956 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:23.957 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:23.957 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:23.957 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:23.957 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:23.958 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:23.958 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:23.958 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:23.958 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:23.958 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:23.959 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:23.959 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-15-01_23_00_UTC', 'scheduled-2023-11-15-01_24_00_UTC', 'scheduled-2023-11-15-01_25_00_UTC', 'scheduled-2023-11-15-01_26_00_UTC', 'scheduled-2023-11-15-01_27_00_UTC', 'scheduled-2023-11-15-01_28_00_UTC', 'scheduled-2023-11-15-01_29_00_UTC', 'scheduled-2023-11-15-01_30_00_UTC', 'scheduled-2023-11-15-01_31_00_UTC', 'scheduled-2023-11-15-01_32_00_UTC', 'scheduled-2023-11-15-01_33_00_UTC'] 2023-11-15T01:33:23.959 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-11-15T01:33:24.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.120+0000 7f93e228c700 1 Processor -- start 2023-11-15T01:33:24.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.120+0000 7f93e228c700 1 -- start start 2023-11-15T01:33:24.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93e228c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93dc0c53b0 0x7f93dc0c3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93e228c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f93dc0c7f50 0x7f93dc0c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93e228c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93dc0835c0 con 0x7f93dc0c88a0 2023-11-15T01:33:24.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93e228c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93dc0c3a00 con 0x7f93dc0c7f50 2023-11-15T01:33:24.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93e228c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc0c5790 con 0x7f93dc0c53b0 2023-11-15T01:33:24.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93db7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f93dc0c7f50 0x7f93dc0c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93e0829700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f93dc0c88a0 0x7f93dc0bde70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48268/0 (socket says 172.21.15.1:48268) 2023-11-15T01:33:24.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93e0829700 1 -- 172.21.15.1:0/2572555477 learned_addr learned my addr 172.21.15.1:0/2572555477 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:24.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93db7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f93dc0c7f50 0x7f93dc0c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49938/0 (socket says 172.21.15.1:49938) 2023-11-15T01:33:24.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93db7fe700 1 -- 172.21.15.1:0/2572555477 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93dc0c53b0 msgr2=0x7f93dc0c3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:24.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93dbfff700 1 --2- 172.21.15.1:0/2572555477 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93dc0c53b0 0x7f93dc0c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93db7fe700 1 --2- 172.21.15.1:0/2572555477 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93dc0c53b0 0x7f93dc0c3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93daffd700 1 -- 172.21.15.1:0/2572555477 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471124370 0 0) 0x7f93dc0835c0 con 0x7f93dc0c88a0 2023-11-15T01:33:24.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93db7fe700 1 -- 172.21.15.1:0/2572555477 >> v1:172.21.15.1:6789/0 conn(0x7f93dc0c88a0 legacy=0x7f93dc0bde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93db7fe700 1 -- 172.21.15.1:0/2572555477 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc0c6eb0 con 0x7f93dc0c7f50 2023-11-15T01:33:24.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93dbfff700 1 --2- 172.21.15.1:0/2572555477 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93dc0c53b0 0x7f93dc0c3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:24.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.121+0000 7f93db7fe700 1 --2- 172.21.15.1:0/2572555477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc0c7f50 0x7f93dc0c83b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f93d0009760 tx=0x7f93d0009060).ready entity=mon.0 client_cookie=ce7bd0080b419e9a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:24.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.122+0000 7f93daffd700 1 -- 172.21.15.1:0/2572555477 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d000b610 con 0x7f93dc0c7f50 2023-11-15T01:33:24.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.122+0000 7f93daffd700 1 -- 172.21.15.1:0/2572555477 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d000b770 con 0x7f93dc0c7f50 2023-11-15T01:33:24.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.122+0000 7f93daffd700 1 -- 172.21.15.1:0/2572555477 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d000baf0 con 0x7f93dc0c7f50 2023-11-15T01:33:24.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.122+0000 7f93e228c700 1 -- 172.21.15.1:0/2572555477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc0c7f50 msgr2=0x7f93dc0c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.122+0000 7f93e228c700 1 --2- 172.21.15.1:0/2572555477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc0c7f50 0x7f93dc0c83b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f93d0009760 tx=0x7f93d0009060).stop 2023-11-15T01:33:24.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.122+0000 7f93e228c700 1 -- 172.21.15.1:0/2572555477 shutdown_connections 2023-11-15T01:33:24.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.122+0000 7f93e228c700 1 --2- 172.21.15.1:0/2572555477 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93dc0c53b0 0x7f93dc0c3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.122+0000 7f93e228c700 1 --2- 172.21.15.1:0/2572555477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc0c7f50 0x7f93dc0c83b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.122+0000 7f93e228c700 1 -- 172.21.15.1:0/2572555477 >> 172.21.15.1:0/2572555477 conn(0x7f93dc082f90 msgr2=0x7f93dc0c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:24.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.122+0000 7f93e228c700 1 -- 172.21.15.1:0/2572555477 shutdown_connections 2023-11-15T01:33:24.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.122+0000 7f93e228c700 1 -- 172.21.15.1:0/2572555477 wait complete. 2023-11-15T01:33:24.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.123+0000 7f93e228c700 1 Processor -- start 2023-11-15T01:33:24.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.124+0000 7f93e228c700 1 -- start start 2023-11-15T01:33:24.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.124+0000 7f93e228c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93dc0c53b0 0x7f93dc148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.124+0000 7f93e228c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc0c7f50 0x7f93dc0c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.124+0000 7f93e228c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93dc0c88a0 0x7f93dc0c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.124+0000 7f93e228c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc0a9d30 con 0x7f93dc0c7f50 2023-11-15T01:33:24.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.124+0000 7f93e228c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc0c29f0 con 0x7f93dc0c53b0 2023-11-15T01:33:24.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.124+0000 7f93e228c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc0c2cd0 con 0x7f93dc0c88a0 2023-11-15T01:33:24.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.124+0000 7f93db7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc0c7f50 0x7f93dc0c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.124+0000 7f93db7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc0c7f50 0x7f93dc0c1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49940/0 (socket says 172.21.15.1:49940) 2023-11-15T01:33:24.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.124+0000 7f93db7fe700 1 -- 172.21.15.1:0/1662034537 learned_addr learned my addr 172.21.15.1:0/1662034537 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:24.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.125+0000 7f93e0829700 1 --2- 172.21.15.1:0/1662034537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93dc0c88a0 0x7f93dc0c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.125+0000 7f93db7fe700 1 -- 172.21.15.1:0/1662034537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93dc0c88a0 msgr2=0x7f93dc0c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.125+0000 7f93dbfff700 1 --2- 172.21.15.1:0/1662034537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93dc0c53b0 0x7f93dc148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.125+0000 7f93db7fe700 1 --2- 172.21.15.1:0/1662034537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93dc0c88a0 0x7f93dc0c23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.125+0000 7f93db7fe700 1 -- 172.21.15.1:0/1662034537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93dc0c53b0 msgr2=0x7f93dc148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.125+0000 7f93db7fe700 1 --2- 172.21.15.1:0/1662034537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93dc0c53b0 0x7f93dc148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.125+0000 7f93db7fe700 1 -- 172.21.15.1:0/1662034537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d00092a0 con 0x7f93dc0c7f50 2023-11-15T01:33:24.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.125+0000 7f93e0829700 1 --2- 172.21.15.1:0/1662034537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93dc0c88a0 0x7f93dc0c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:24.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.125+0000 7f93db7fe700 1 --2- 172.21.15.1:0/1662034537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc0c7f50 0x7f93dc0c1ec0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f93d0011000 tx=0x7f93d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:24.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.125+0000 7f93c3fff700 1 -- 172.21.15.1:0/1662034537 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0020070 con 0x7f93dc0c7f50 2023-11-15T01:33:24.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.125+0000 7f93c3fff700 1 -- 172.21.15.1:0/1662034537 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d0000c90 con 0x7f93dc0c7f50 2023-11-15T01:33:24.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.125+0000 7f93e228c700 1 -- 172.21.15.1:0/1662034537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93dc0c2fb0 con 0x7f93dc0c7f50 2023-11-15T01:33:24.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.125+0000 7f93c3fff700 1 -- 172.21.15.1:0/1662034537 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d000baf0 con 0x7f93dc0c7f50 2023-11-15T01:33:24.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.125+0000 7f93e228c700 1 -- 172.21.15.1:0/1662034537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93dc1492b0 con 0x7f93dc0c7f50 2023-11-15T01:33:24.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.126+0000 7f93e228c700 1 -- 172.21.15.1:0/1662034537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93dc0a9ea0 con 0x7f93dc0c7f50 2023-11-15T01:33:24.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.126+0000 7f93c3fff700 1 -- 172.21.15.1:0/1662034537 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f93d001b8f0 con 0x7f93dc0c7f50 2023-11-15T01:33:24.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.127+0000 7f93c3fff700 1 --2- 172.21.15.1:0/1662034537 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f93c805f2c0 0x7f93c8061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.127+0000 7f93c3fff700 1 -- 172.21.15.1:0/1662034537 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f93d007bb70 con 0x7f93dc0c7f50 2023-11-15T01:33:24.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.127+0000 7f93dbfff700 1 --2- 172.21.15.1:0/1662034537 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f93c805f2c0 0x7f93c8061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.127+0000 7f93dbfff700 1 --2- 172.21.15.1:0/1662034537 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f93c805f2c0 0x7f93c8061780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f93cc006fd0 tx=0x7f93cc008040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:24.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.131+0000 7f93c3fff700 1 -- 172.21.15.1:0/1662034537 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f93d004ccb0 con 0x7f93dc0c7f50 2023-11-15T01:33:24.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.328+0000 7f93e228c700 1 -- 172.21.15.1:0/1662034537 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93dc06c7e0 con 0x7f93c805f2c0 2023-11-15T01:33:24.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.330+0000 7f93c3fff700 1 -- 172.21.15.1:0/1662034537 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f93dc06c7e0 con 0x7f93c805f2c0 2023-11-15T01:33:24.330 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:24.330 INFO:teuthology.orchestra.run.smithi001.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:38", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:24.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.331+0000 7f93e228c700 1 -- 172.21.15.1:0/1662034537 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f93c805f2c0 msgr2=0x7f93c8061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.331+0000 7f93e228c700 1 --2- 172.21.15.1:0/1662034537 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f93c805f2c0 0x7f93c8061780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f93cc006fd0 tx=0x7f93cc008040).stop 2023-11-15T01:33:24.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.331+0000 7f93e228c700 1 -- 172.21.15.1:0/1662034537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc0c7f50 msgr2=0x7f93dc0c1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.331+0000 7f93e228c700 1 --2- 172.21.15.1:0/1662034537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc0c7f50 0x7f93dc0c1ec0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f93d0011000 tx=0x7f93d0017000).stop 2023-11-15T01:33:24.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.331+0000 7f93e228c700 1 -- 172.21.15.1:0/1662034537 shutdown_connections 2023-11-15T01:33:24.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.331+0000 7f93e228c700 1 --2- 172.21.15.1:0/1662034537 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f93c805f2c0 0x7f93c8061780 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.331+0000 7f93e228c700 1 --2- 172.21.15.1:0/1662034537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93dc0c88a0 0x7f93dc0c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.331+0000 7f93e228c700 1 --2- 172.21.15.1:0/1662034537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93dc0c53b0 0x7f93dc148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.331+0000 7f93e228c700 1 --2- 172.21.15.1:0/1662034537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc0c7f50 0x7f93dc0c1ec0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.331+0000 7f93e228c700 1 -- 172.21.15.1:0/1662034537 >> 172.21.15.1:0/1662034537 conn(0x7f93dc082f90 msgr2=0x7f93dc0c59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:24.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.332+0000 7f93e228c700 1 -- 172.21.15.1:0/1662034537 shutdown_connections 2023-11-15T01:33:24.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.332+0000 7f93e228c700 1 -- 172.21.15.1:0/1662034537 wait complete. 2023-11-15T01:33:24.344 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:38", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:24.344 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-11-15T00:00:00', 'created': '2023-11-15T01:22:38', 'first': '2023-11-15T01:23:00', 'last': '2023-11-15T01:33:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-15T01:33:24.344 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-15T01:33:24.345 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-15T01:33:24.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:24.345 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-11-15T01:33:24.362 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:24.362 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:24.363 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:24.363 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:24.363 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:24.363 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:24.364 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:24.364 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:24.364 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:24.364 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:24.364 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:24.365 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-15-01_23_00_UTC', 'scheduled-2023-11-15-01_24_00_UTC', 'scheduled-2023-11-15-01_25_00_UTC', 'scheduled-2023-11-15-01_26_00_UTC', 'scheduled-2023-11-15-01_27_00_UTC', 'scheduled-2023-11-15-01_28_00_UTC', 'scheduled-2023-11-15-01_29_00_UTC', 'scheduled-2023-11-15-01_30_00_UTC', 'scheduled-2023-11-15-01_31_00_UTC', 'scheduled-2023-11-15-01_32_00_UTC', 'scheduled-2023-11-15-01_33_00_UTC'] 2023-11-15T01:33:24.365 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-11-15T01:33:24.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.523+0000 7fd7dfdc3700 1 Processor -- start 2023-11-15T01:33:24.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.523+0000 7fd7dfdc3700 1 -- start start 2023-11-15T01:33:24.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.524+0000 7fd7dfdc3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7d814b350 0x7fd7d80c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.524+0000 7fd7dfdc3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd7d814b730 0x7fd7d8154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.524+0000 7fd7dfdc3700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d81580d0 con 0x7fd7d80aa040 2023-11-15T01:33:24.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.524+0000 7fd7dfdc3700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d8155000 con 0x7fd7d814b730 2023-11-15T01:33:24.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.524+0000 7fd7dfdc3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d81552e0 con 0x7fd7d814b350 2023-11-15T01:33:24.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.524+0000 7fd7dd35e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd7d814b730 0x7fd7d8154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.524+0000 7fd7de360700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd7d80aa040 0x7fd7d8158560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48284/0 (socket says 172.21.15.1:48284) 2023-11-15T01:33:24.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.524+0000 7fd7de360700 1 -- 172.21.15.1:0/1975341245 learned_addr learned my addr 172.21.15.1:0/1975341245 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:24.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.524+0000 7fd7ddb5f700 1 --2- 172.21.15.1:0/1975341245 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7d814b350 0x7fd7d80c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.524+0000 7fd7dd35e700 1 -- 172.21.15.1:0/1975341245 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7d814b350 msgr2=0x7fd7d80c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:24.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.524+0000 7fd7dd35e700 1 --2- 172.21.15.1:0/1975341245 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7d814b350 0x7fd7d80c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.524+0000 7fd7dd35e700 1 -- 172.21.15.1:0/1975341245 >> v1:172.21.15.1:6789/0 conn(0x7fd7d80aa040 legacy=0x7fd7d8158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.524+0000 7fd7dcb5d700 1 -- 172.21.15.1:0/1975341245 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884695269 0 0) 0x7fd7d81580d0 con 0x7fd7d80aa040 2023-11-15T01:33:24.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.524+0000 7fd7dd35e700 1 -- 172.21.15.1:0/1975341245 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d81555c0 con 0x7fd7d814b730 2023-11-15T01:33:24.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.525+0000 7fd7dd35e700 1 --2- 172.21.15.1:0/1975341245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d814b730 0x7fd7d8154a10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fd7cc009760 tx=0x7fd7cc009060).ready entity=mon.0 client_cookie=92d308736e55ee09 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:24.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.525+0000 7fd7dcb5d700 1 -- 172.21.15.1:0/1975341245 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc00b580 con 0x7fd7d814b730 2023-11-15T01:33:24.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.525+0000 7fd7dcb5d700 1 -- 172.21.15.1:0/1975341245 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc00b6e0 con 0x7fd7d814b730 2023-11-15T01:33:24.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.525+0000 7fd7dcb5d700 1 -- 172.21.15.1:0/1975341245 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc00ba60 con 0x7fd7d814b730 2023-11-15T01:33:24.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.525+0000 7fd7dfdc3700 1 -- 172.21.15.1:0/1975341245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d814b730 msgr2=0x7fd7d8154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.525+0000 7fd7dfdc3700 1 --2- 172.21.15.1:0/1975341245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d814b730 0x7fd7d8154a10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fd7cc009760 tx=0x7fd7cc009060).stop 2023-11-15T01:33:24.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.525+0000 7fd7dfdc3700 1 -- 172.21.15.1:0/1975341245 shutdown_connections 2023-11-15T01:33:24.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.525+0000 7fd7dfdc3700 1 --2- 172.21.15.1:0/1975341245 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7d814b350 0x7fd7d80c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.525+0000 7fd7dfdc3700 1 --2- 172.21.15.1:0/1975341245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d814b730 0x7fd7d8154a10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.525+0000 7fd7dfdc3700 1 -- 172.21.15.1:0/1975341245 >> 172.21.15.1:0/1975341245 conn(0x7fd7d8069ee0 msgr2=0x7fd7d806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:24.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.525+0000 7fd7dfdc3700 1 -- 172.21.15.1:0/1975341245 shutdown_connections 2023-11-15T01:33:24.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.525+0000 7fd7dfdc3700 1 -- 172.21.15.1:0/1975341245 wait complete. 2023-11-15T01:33:24.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.526+0000 7fd7dfdc3700 1 Processor -- start 2023-11-15T01:33:24.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.526+0000 7fd7dfdc3700 1 -- start start 2023-11-15T01:33:24.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.527+0000 7fd7dfdc3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7d80aa040 0x7fd7d814a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.527+0000 7fd7dfdc3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d814b350 0x7fd7d80c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.527+0000 7fd7dfdc3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7d814b730 0x7fd7d80c2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.527+0000 7fd7dfdc3700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80c2b80 con 0x7fd7d814b350 2023-11-15T01:33:24.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.527+0000 7fd7dfdc3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80afcf0 con 0x7fd7d80aa040 2023-11-15T01:33:24.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.527+0000 7fd7dfdc3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80af0e0 con 0x7fd7d814b730 2023-11-15T01:33:24.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.527+0000 7fd7dd35e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d814b350 0x7fd7d80c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.527+0000 7fd7dd35e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d814b350 0x7fd7d80c21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49954/0 (socket says 172.21.15.1:49954) 2023-11-15T01:33:24.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.527+0000 7fd7dd35e700 1 -- 172.21.15.1:0/3401884280 learned_addr learned my addr 172.21.15.1:0/3401884280 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:24.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.527+0000 7fd7ddb5f700 1 --2- 172.21.15.1:0/3401884280 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7d80aa040 0x7fd7d814a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.527+0000 7fd7de360700 1 --2- 172.21.15.1:0/3401884280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7d814b730 0x7fd7d80c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.528+0000 7fd7dd35e700 1 -- 172.21.15.1:0/3401884280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7d814b730 msgr2=0x7fd7d80c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.528+0000 7fd7dd35e700 1 --2- 172.21.15.1:0/3401884280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7d814b730 0x7fd7d80c2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.528+0000 7fd7dd35e700 1 -- 172.21.15.1:0/3401884280 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7d80aa040 msgr2=0x7fd7d814a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.528+0000 7fd7dd35e700 1 --2- 172.21.15.1:0/3401884280 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7d80aa040 0x7fd7d814a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.528+0000 7fd7dd35e700 1 -- 172.21.15.1:0/3401884280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc0092a0 con 0x7fd7d814b350 2023-11-15T01:33:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.528+0000 7fd7de360700 1 --2- 172.21.15.1:0/3401884280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7d814b730 0x7fd7d80c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.528+0000 7fd7dd35e700 1 --2- 172.21.15.1:0/3401884280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d814b350 0x7fd7d80c21a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fd7cc011000 tx=0x7fd7cc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.528+0000 7fd7d5ffb700 1 -- 172.21.15.1:0/3401884280 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc000bc0 con 0x7fd7d814b350 2023-11-15T01:33:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.528+0000 7fd7d5ffb700 1 -- 172.21.15.1:0/3401884280 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc00b850 con 0x7fd7d814b350 2023-11-15T01:33:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.528+0000 7fd7dfdc3700 1 -- 172.21.15.1:0/3401884280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d80af3c0 con 0x7fd7d814b350 2023-11-15T01:33:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.528+0000 7fd7d5ffb700 1 -- 172.21.15.1:0/3401884280 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc000d20 con 0x7fd7d814b350 2023-11-15T01:33:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.528+0000 7fd7dfdc3700 1 -- 172.21.15.1:0/3401884280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d80af980 con 0x7fd7d814b350 2023-11-15T01:33:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.529+0000 7fd7dfdc3700 1 -- 172.21.15.1:0/3401884280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d806c7e0 con 0x7fd7d814b350 2023-11-15T01:33:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.529+0000 7fd7d5ffb700 1 -- 172.21.15.1:0/3401884280 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fd7cc01b930 con 0x7fd7d814b350 2023-11-15T01:33:24.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.530+0000 7fd7d5ffb700 1 --2- 172.21.15.1:0/3401884280 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd7c405f2c0 0x7fd7c4061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.530+0000 7fd7d5ffb700 1 -- 172.21.15.1:0/3401884280 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fd7cc07bfd0 con 0x7fd7d814b350 2023-11-15T01:33:24.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.530+0000 7fd7ddb5f700 1 --2- 172.21.15.1:0/3401884280 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd7c405f2c0 0x7fd7c4061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.530+0000 7fd7ddb5f700 1 --2- 172.21.15.1:0/3401884280 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd7c405f2c0 0x7fd7c4061780 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd7c8009fd0 tx=0x7fd7c8009880).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:24.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.534+0000 7fd7d5ffb700 1 -- 172.21.15.1:0/3401884280 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd7cc04d050 con 0x7fd7d814b350 2023-11-15T01:33:24.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.735+0000 7fd7dfdc3700 1 -- 172.21.15.1:0/3401884280 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7d8155890 con 0x7fd7c405f2c0 2023-11-15T01:33:24.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.736+0000 7fd7d5ffb700 1 -- 172.21.15.1:0/3401884280 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fd7d8155890 con 0x7fd7c405f2c0 2023-11-15T01:33:24.738 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:24.738 INFO:teuthology.orchestra.run.smithi001.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:38", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:24.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.738+0000 7fd7dfdc3700 1 -- 172.21.15.1:0/3401884280 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd7c405f2c0 msgr2=0x7fd7c4061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.738+0000 7fd7dfdc3700 1 --2- 172.21.15.1:0/3401884280 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd7c405f2c0 0x7fd7c4061780 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd7c8009fd0 tx=0x7fd7c8009880).stop 2023-11-15T01:33:24.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.738+0000 7fd7dfdc3700 1 -- 172.21.15.1:0/3401884280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d814b350 msgr2=0x7fd7d80c21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.738+0000 7fd7dfdc3700 1 --2- 172.21.15.1:0/3401884280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d814b350 0x7fd7d80c21a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fd7cc011000 tx=0x7fd7cc017000).stop 2023-11-15T01:33:24.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.738+0000 7fd7dfdc3700 1 -- 172.21.15.1:0/3401884280 shutdown_connections 2023-11-15T01:33:24.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.738+0000 7fd7dfdc3700 1 --2- 172.21.15.1:0/3401884280 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd7c405f2c0 0x7fd7c4061780 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.738+0000 7fd7dfdc3700 1 --2- 172.21.15.1:0/3401884280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7d814b730 0x7fd7d80c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.738+0000 7fd7dfdc3700 1 --2- 172.21.15.1:0/3401884280 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7d80aa040 0x7fd7d814a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.738+0000 7fd7dfdc3700 1 --2- 172.21.15.1:0/3401884280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d814b350 0x7fd7d80c21a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.738+0000 7fd7dfdc3700 1 -- 172.21.15.1:0/3401884280 >> 172.21.15.1:0/3401884280 conn(0x7fd7d8069ee0 msgr2=0x7fd7d8156ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:24.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.738+0000 7fd7dfdc3700 1 -- 172.21.15.1:0/3401884280 shutdown_connections 2023-11-15T01:33:24.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.738+0000 7fd7dfdc3700 1 -- 172.21.15.1:0/3401884280 wait complete. 2023-11-15T01:33:24.750 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:38", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:24.751 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-11-15T00:00:00', 'created': '2023-11-15T01:22:38', 'first': '2023-11-15T01:23:00', 'last': '2023-11-15T01:33:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-15T01:33:24.751 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-15T01:33:24.751 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-15T01:33:24.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:24.752 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-11-15T01:33:24.769 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:24.769 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:24.769 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:24.770 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:24.770 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:24.770 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:24.770 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:24.770 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:24.771 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:24.771 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:24.771 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:24.771 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-15-01_23_00_UTC', 'scheduled-2023-11-15-01_24_00_UTC', 'scheduled-2023-11-15-01_25_00_UTC', 'scheduled-2023-11-15-01_26_00_UTC', 'scheduled-2023-11-15-01_27_00_UTC', 'scheduled-2023-11-15-01_28_00_UTC', 'scheduled-2023-11-15-01_29_00_UTC', 'scheduled-2023-11-15-01_30_00_UTC', 'scheduled-2023-11-15-01_31_00_UTC', 'scheduled-2023-11-15-01_32_00_UTC', 'scheduled-2023-11-15-01_33_00_UTC'] 2023-11-15T01:33:24.772 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-11-15T01:33:24.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.929+0000 7f7fe642b700 1 Processor -- start 2023-11-15T01:33:24.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.929+0000 7f7fe642b700 1 -- start start 2023-11-15T01:33:24.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.930+0000 7f7fe642b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7fe00aa750 0x7f7fe00c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.930+0000 7f7fe642b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7fe014b730 0x7f7fe0154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.930+0000 7f7fe642b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe01580d0 con 0x7f7fe014b350 2023-11-15T01:33:24.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.930+0000 7f7fe642b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe0155000 con 0x7f7fe014b730 2023-11-15T01:33:24.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.930+0000 7f7fe642b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe01552e0 con 0x7f7fe00aa750 2023-11-15T01:33:24.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.930+0000 7f7fe49c8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7fe014b730 0x7f7fe0154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.930+0000 7f7fdffff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7fe014b350 0x7f7fe00aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48296/0 (socket says 172.21.15.1:48296) 2023-11-15T01:33:24.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.930+0000 7f7fdffff700 1 -- 172.21.15.1:0/3180976533 learned_addr learned my addr 172.21.15.1:0/3180976533 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:24.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.930+0000 7f7fdf7fe700 1 --2- 172.21.15.1:0/3180976533 >> v2:172.21.15.141:3300/0 conn(0x7f7fe00aa750 0x7f7fe00c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.930+0000 7f7fe49c8700 1 -- 172.21.15.1:0/3180976533 >> v2:172.21.15.141:3300/0 conn(0x7f7fe00aa750 msgr2=0x7f7fe00c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:24.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.930+0000 7f7fe49c8700 1 --2- 172.21.15.1:0/3180976533 >> v2:172.21.15.141:3300/0 conn(0x7f7fe00aa750 0x7f7fe00c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.930+0000 7f7fe49c8700 1 -- 172.21.15.1:0/3180976533 >> v1:172.21.15.1:6789/0 conn(0x7f7fe014b350 legacy=0x7f7fe00aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.930+0000 7f7fe49c8700 1 -- 172.21.15.1:0/3180976533 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe01555c0 con 0x7f7fe014b730 2023-11-15T01:33:24.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.930+0000 7f7fdf7fe700 1 --2- 172.21.15.1:0/3180976533 >> v2:172.21.15.141:3300/0 conn(0x7f7fe00aa750 0x7f7fe00c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:24.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.931+0000 7f7fe49c8700 1 --2- 172.21.15.1:0/3180976533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe014b730 0x7f7fe0154a10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f7fe00b13b0 tx=0x7f7fd8009780).ready entity=mon.0 client_cookie=417b722e991e16b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:24.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.931+0000 7f7fdeffd700 1 -- 172.21.15.1:0/3180976533 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800e070 con 0x7f7fe014b730 2023-11-15T01:33:24.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.931+0000 7f7fdeffd700 1 -- 172.21.15.1:0/3180976533 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd800bc30 con 0x7f7fe014b730 2023-11-15T01:33:24.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.931+0000 7f7fdeffd700 1 -- 172.21.15.1:0/3180976533 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8012410 con 0x7f7fe014b730 2023-11-15T01:33:24.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.931+0000 7f7fe642b700 1 -- 172.21.15.1:0/3180976533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe014b730 msgr2=0x7f7fe0154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.931+0000 7f7fe642b700 1 --2- 172.21.15.1:0/3180976533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe014b730 0x7f7fe0154a10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f7fe00b13b0 tx=0x7f7fd8009780).stop 2023-11-15T01:33:24.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.931+0000 7f7fe642b700 1 -- 172.21.15.1:0/3180976533 shutdown_connections 2023-11-15T01:33:24.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.931+0000 7f7fe642b700 1 --2- 172.21.15.1:0/3180976533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe014b730 0x7f7fe0154a10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.931+0000 7f7fe642b700 1 --2- 172.21.15.1:0/3180976533 >> v2:172.21.15.141:3300/0 conn(0x7f7fe00aa750 0x7f7fe00c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.931+0000 7f7fe642b700 1 -- 172.21.15.1:0/3180976533 >> 172.21.15.1:0/3180976533 conn(0x7f7fe0069ee0 msgr2=0x7f7fe006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.931+0000 7f7fe642b700 1 -- 172.21.15.1:0/3180976533 shutdown_connections 2023-11-15T01:33:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.931+0000 7f7fe642b700 1 -- 172.21.15.1:0/3180976533 wait complete. 2023-11-15T01:33:24.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.932+0000 7f7fe642b700 1 Processor -- start 2023-11-15T01:33:24.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.933+0000 7f7fe642b700 1 -- start start 2023-11-15T01:33:24.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.933+0000 7f7fe642b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe00aa750 0x7f7fe0148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.933+0000 7f7fe642b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fe014b350 0x7f7fe00c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.933+0000 7f7fe642b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fe014b730 0x7f7fe00ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.933+0000 7f7fe642b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe01492f0 con 0x7f7fe00aa750 2023-11-15T01:33:24.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.933+0000 7f7fe642b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe00c2690 con 0x7f7fe014b350 2023-11-15T01:33:24.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.933+0000 7f7fe642b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe014d960 con 0x7f7fe014b730 2023-11-15T01:33:24.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.933+0000 7f7fdffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe00aa750 0x7f7fe0148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.933+0000 7f7fdffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe00aa750 0x7f7fe0148e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49966/0 (socket says 172.21.15.1:49966) 2023-11-15T01:33:24.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.933+0000 7f7fdffff700 1 -- 172.21.15.1:0/3818708922 learned_addr learned my addr 172.21.15.1:0/3818708922 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:24.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.934+0000 7f7fe49c8700 1 --2- 172.21.15.1:0/3818708922 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fe014b730 0x7f7fe00ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.934+0000 7f7fdf7fe700 1 --2- 172.21.15.1:0/3818708922 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fe014b350 0x7f7fe00c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.934+0000 7f7fdffff700 1 -- 172.21.15.1:0/3818708922 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fe014b730 msgr2=0x7f7fe00ab590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.934+0000 7f7fdffff700 1 --2- 172.21.15.1:0/3818708922 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fe014b730 0x7f7fe00ab590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.934+0000 7f7fdffff700 1 -- 172.21.15.1:0/3818708922 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fe014b350 msgr2=0x7f7fe00c21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:24.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.934+0000 7f7fdffff700 1 --2- 172.21.15.1:0/3818708922 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fe014b350 0x7f7fe00c21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:24.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.934+0000 7f7fdffff700 1 -- 172.21.15.1:0/3818708922 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd8009a20 con 0x7f7fe00aa750 2023-11-15T01:33:24.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.934+0000 7f7fdf7fe700 1 --2- 172.21.15.1:0/3818708922 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fe014b350 0x7f7fe00c21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:24.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.934+0000 7f7fdffff700 1 --2- 172.21.15.1:0/3818708922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe00aa750 0x7f7fe0148e00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f7fd0007fd0 tx=0x7f7fd0007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:24.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.934+0000 7f7fc7fff700 1 -- 172.21.15.1:0/3818708922 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00072e0 con 0x7f7fe00aa750 2023-11-15T01:33:24.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.934+0000 7f7fc7fff700 1 -- 172.21.15.1:0/3818708922 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd0007440 con 0x7f7fe00aa750 2023-11-15T01:33:24.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.934+0000 7f7fe642b700 1 -- 172.21.15.1:0/3818708922 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe00af830 con 0x7f7fe00aa750 2023-11-15T01:33:24.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.934+0000 7f7fc7fff700 1 -- 172.21.15.1:0/3818708922 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00057a0 con 0x7f7fe00aa750 2023-11-15T01:33:24.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.934+0000 7f7fe642b700 1 -- 172.21.15.1:0/3818708922 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe014d310 con 0x7f7fe00aa750 2023-11-15T01:33:24.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.935+0000 7f7fe642b700 1 -- 172.21.15.1:0/3818708922 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe006c7e0 con 0x7f7fe00aa750 2023-11-15T01:33:24.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.935+0000 7f7fc7fff700 1 -- 172.21.15.1:0/3818708922 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f7fd0005bd0 con 0x7f7fe00aa750 2023-11-15T01:33:24.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.936+0000 7f7fc7fff700 1 --2- 172.21.15.1:0/3818708922 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7fcc05f2c0 0x7f7fcc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:24.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.936+0000 7f7fc7fff700 1 -- 172.21.15.1:0/3818708922 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f7fd00798a0 con 0x7f7fe00aa750 2023-11-15T01:33:24.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.936+0000 7f7fdf7fe700 1 --2- 172.21.15.1:0/3818708922 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7fcc05f2c0 0x7f7fcc061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:24.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.936+0000 7f7fdf7fe700 1 --2- 172.21.15.1:0/3818708922 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7fcc05f2c0 0x7f7fcc061780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f7fe00aced0 tx=0x7f7fd4008040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:24.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:24.940+0000 7f7fc7fff700 1 -- 172.21.15.1:0/3818708922 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7fd004a920 con 0x7f7fe00aa750 2023-11-15T01:33:25.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.137+0000 7f7fe642b700 1 -- 172.21.15.1:0/3818708922 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7fe00c61c0 con 0x7f7fcc05f2c0 2023-11-15T01:33:25.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.139+0000 7f7fc7fff700 1 -- 172.21.15.1:0/3818708922 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f7fe00c61c0 con 0x7f7fcc05f2c0 2023-11-15T01:33:25.139 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:25.140 INFO:teuthology.orchestra.run.smithi001.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:38", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:25.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.141+0000 7f7fe642b700 1 -- 172.21.15.1:0/3818708922 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7fcc05f2c0 msgr2=0x7f7fcc061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:25.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.141+0000 7f7fe642b700 1 --2- 172.21.15.1:0/3818708922 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7fcc05f2c0 0x7f7fcc061780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f7fe00aced0 tx=0x7f7fd4008040).stop 2023-11-15T01:33:25.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.141+0000 7f7fe642b700 1 -- 172.21.15.1:0/3818708922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe00aa750 msgr2=0x7f7fe0148e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:25.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.141+0000 7f7fe642b700 1 --2- 172.21.15.1:0/3818708922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe00aa750 0x7f7fe0148e00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f7fd0007fd0 tx=0x7f7fd0007df0).stop 2023-11-15T01:33:25.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.141+0000 7f7fe642b700 1 -- 172.21.15.1:0/3818708922 shutdown_connections 2023-11-15T01:33:25.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.141+0000 7f7fe642b700 1 --2- 172.21.15.1:0/3818708922 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7fcc05f2c0 0x7f7fcc061780 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.141+0000 7f7fe642b700 1 --2- 172.21.15.1:0/3818708922 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fe014b730 0x7f7fe00ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.141+0000 7f7fe642b700 1 --2- 172.21.15.1:0/3818708922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fe00aa750 0x7f7fe0148e00 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.141+0000 7f7fe642b700 1 --2- 172.21.15.1:0/3818708922 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fe014b350 0x7f7fe00c21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.141+0000 7f7fe642b700 1 -- 172.21.15.1:0/3818708922 >> 172.21.15.1:0/3818708922 conn(0x7f7fe0069ee0 msgr2=0x7f7fe00c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:25.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.141+0000 7f7fe642b700 1 -- 172.21.15.1:0/3818708922 shutdown_connections 2023-11-15T01:33:25.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.141+0000 7f7fe642b700 1 -- 172.21.15.1:0/3818708922 wait complete. 2023-11-15T01:33:25.153 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:38", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:25.153 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-11-15T00:00:00', 'created': '2023-11-15T01:22:38', 'first': '2023-11-15T01:23:00', 'last': '2023-11-15T01:33:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-15T01:33:25.154 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-15T01:33:25.154 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-15T01:33:25.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:25.155 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-11-15T01:33:25.172 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:25.172 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:25.172 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:25.172 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:25.173 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:25.173 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:25.173 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:25.173 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:25.173 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:25.174 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:25.174 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:25.174 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-15-01_23_00_UTC', 'scheduled-2023-11-15-01_24_00_UTC', 'scheduled-2023-11-15-01_25_00_UTC', 'scheduled-2023-11-15-01_26_00_UTC', 'scheduled-2023-11-15-01_27_00_UTC', 'scheduled-2023-11-15-01_28_00_UTC', 'scheduled-2023-11-15-01_29_00_UTC', 'scheduled-2023-11-15-01_30_00_UTC', 'scheduled-2023-11-15-01_31_00_UTC', 'scheduled-2023-11-15-01_32_00_UTC', 'scheduled-2023-11-15-01_33_00_UTC'] 2023-11-15T01:33:25.174 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-11-15T01:33:25.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.333+0000 7f66651c5700 1 Processor -- start 2023-11-15T01:33:25.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.333+0000 7f66651c5700 1 -- start start 2023-11-15T01:33:25.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.334+0000 7f66651c5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f66600ada30 0x7f66600c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:25.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.334+0000 7f66651c5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66600ca400 0x7f66600c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:25.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.334+0000 7f66651c5700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66600caee0 con 0x7f66600c65b0 2023-11-15T01:33:25.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.334+0000 7f66651c5700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6660154850 con 0x7f66600ada30 2023-11-15T01:33:25.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.334+0000 7f66651c5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66600ca920 con 0x7f66600ca400 2023-11-15T01:33:25.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.334+0000 7f66649c4700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f66600c65b0 0x7f6660063510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48302/0 (socket says 172.21.15.1:48302) 2023-11-15T01:33:25.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.334+0000 7f665ffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f66600ada30 0x7f66600c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:25.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.334+0000 7f66649c4700 1 -- 172.21.15.1:0/3630338090 learned_addr learned my addr 172.21.15.1:0/3630338090 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:25.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.334+0000 7f665f7fe700 1 --2- 172.21.15.1:0/3630338090 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66600ca400 0x7f66600c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:25.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.334+0000 7f665ffff700 1 -- 172.21.15.1:0/3630338090 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66600ca400 msgr2=0x7f66600c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:25.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.334+0000 7f665ffff700 1 --2- 172.21.15.1:0/3630338090 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66600ca400 0x7f66600c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.334+0000 7f665ffff700 1 -- 172.21.15.1:0/3630338090 >> v1:172.21.15.1:6789/0 conn(0x7f66600c65b0 legacy=0x7f6660063510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:25.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.334+0000 7f665ffff700 1 -- 172.21.15.1:0/3630338090 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66600cac00 con 0x7f66600ada30 2023-11-15T01:33:25.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.334+0000 7f665f7fe700 1 --2- 172.21.15.1:0/3630338090 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66600ca400 0x7f66600c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:25.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.334+0000 7f665ffff700 1 --2- 172.21.15.1:0/3630338090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600ada30 0x7f66600c9f10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f6648009760 tx=0x7f6648009060).ready entity=mon.0 client_cookie=9a17d6e93de0059a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:25.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.335+0000 7f665effd700 1 -- 172.21.15.1:0/3630338090 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664800b580 con 0x7f66600ada30 2023-11-15T01:33:25.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.335+0000 7f665effd700 1 -- 172.21.15.1:0/3630338090 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664800b6e0 con 0x7f66600ada30 2023-11-15T01:33:25.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.335+0000 7f665effd700 1 -- 172.21.15.1:0/3630338090 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664800ba60 con 0x7f66600ada30 2023-11-15T01:33:25.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.335+0000 7f66651c5700 1 -- 172.21.15.1:0/3630338090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600ada30 msgr2=0x7f66600c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:25.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.335+0000 7f66651c5700 1 --2- 172.21.15.1:0/3630338090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600ada30 0x7f66600c9f10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f6648009760 tx=0x7f6648009060).stop 2023-11-15T01:33:25.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.335+0000 7f66651c5700 1 -- 172.21.15.1:0/3630338090 shutdown_connections 2023-11-15T01:33:25.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.335+0000 7f66651c5700 1 --2- 172.21.15.1:0/3630338090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600ada30 0x7f66600c9f10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.335+0000 7f66651c5700 1 --2- 172.21.15.1:0/3630338090 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66600ca400 0x7f66600c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.335+0000 7f66651c5700 1 -- 172.21.15.1:0/3630338090 >> 172.21.15.1:0/3630338090 conn(0x7f6660064a60 msgr2=0x7f6660064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:25.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.335+0000 7f66651c5700 1 -- 172.21.15.1:0/3630338090 shutdown_connections 2023-11-15T01:33:25.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.335+0000 7f66651c5700 1 -- 172.21.15.1:0/3630338090 wait complete. 2023-11-15T01:33:25.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.336+0000 7f66651c5700 1 Processor -- start 2023-11-15T01:33:25.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.336+0000 7f66651c5700 1 -- start start 2023-11-15T01:33:25.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.337+0000 7f66651c5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600ada30 0x7f6660154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:25.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.337+0000 7f66651c5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66600c65b0 0x7f6660148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:25.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.337+0000 7f66651c5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66600ca400 0x7f66600c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:25.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.337+0000 7f66651c5700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6660155b80 con 0x7f66600ada30 2023-11-15T01:33:25.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.337+0000 7f66651c5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66600c47e0 con 0x7f66600ca400 2023-11-15T01:33:25.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.337+0000 7f66651c5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6660154f70 con 0x7f66600c65b0 2023-11-15T01:33:25.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.337+0000 7f665ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600ada30 0x7f6660154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:25.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.337+0000 7f665ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600ada30 0x7f6660154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49990/0 (socket says 172.21.15.1:49990) 2023-11-15T01:33:25.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.337+0000 7f665ffff700 1 -- 172.21.15.1:0/3420677365 learned_addr learned my addr 172.21.15.1:0/3420677365 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:25.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.337+0000 7f665f7fe700 1 --2- 172.21.15.1:0/3420677365 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66600c65b0 0x7f6660148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:25.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.337+0000 7f66649c4700 1 --2- 172.21.15.1:0/3420677365 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66600ca400 0x7f66600c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:25.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.338+0000 7f665ffff700 1 -- 172.21.15.1:0/3420677365 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66600c65b0 msgr2=0x7f6660148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:25.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.338+0000 7f665ffff700 1 --2- 172.21.15.1:0/3420677365 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66600c65b0 0x7f6660148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.338+0000 7f665ffff700 1 -- 172.21.15.1:0/3420677365 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66600ca400 msgr2=0x7f66600c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:25.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.338+0000 7f665ffff700 1 --2- 172.21.15.1:0/3420677365 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66600ca400 0x7f66600c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.338+0000 7f665ffff700 1 -- 172.21.15.1:0/3420677365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66480092a0 con 0x7f66600ada30 2023-11-15T01:33:25.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.338+0000 7f66649c4700 1 --2- 172.21.15.1:0/3420677365 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66600ca400 0x7f66600c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:25.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.338+0000 7f665ffff700 1 --2- 172.21.15.1:0/3420677365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600ada30 0x7f6660154990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f66600c2140 tx=0x7f6648017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:25.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.338+0000 7f6657fff700 1 -- 172.21.15.1:0/3420677365 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664800b850 con 0x7f66600ada30 2023-11-15T01:33:25.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.338+0000 7f6657fff700 1 -- 172.21.15.1:0/3420677365 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664800b9b0 con 0x7f66600ada30 2023-11-15T01:33:25.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.338+0000 7f66651c5700 1 -- 172.21.15.1:0/3420677365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6660155250 con 0x7f66600ada30 2023-11-15T01:33:25.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.338+0000 7f6657fff700 1 -- 172.21.15.1:0/3420677365 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664801b660 con 0x7f66600ada30 2023-11-15T01:33:25.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.338+0000 7f66651c5700 1 -- 172.21.15.1:0/3420677365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6660155810 con 0x7f66600ada30 2023-11-15T01:33:25.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.339+0000 7f66651c5700 1 -- 172.21.15.1:0/3420677365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66601559d0 con 0x7f66600ada30 2023-11-15T01:33:25.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.339+0000 7f6657fff700 1 -- 172.21.15.1:0/3420677365 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f664801ba90 con 0x7f66600ada30 2023-11-15T01:33:25.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.340+0000 7f6657fff700 1 --2- 172.21.15.1:0/3420677365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f664005f2c0 0x7f6640061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:25.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.340+0000 7f6657fff700 1 -- 172.21.15.1:0/3420677365 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f664807b990 con 0x7f66600ada30 2023-11-15T01:33:25.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.340+0000 7f665f7fe700 1 --2- 172.21.15.1:0/3420677365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f664005f2c0 0x7f6640061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:25.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.340+0000 7f665f7fe700 1 --2- 172.21.15.1:0/3420677365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f664005f2c0 0x7f6640061780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6660152e80 tx=0x7f6650008040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:25.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.344+0000 7f6657fff700 1 -- 172.21.15.1:0/3420677365 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f664804ca10 con 0x7f66600ada30 2023-11-15T01:33:25.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.542+0000 7f66651c5700 1 -- 172.21.15.1:0/3420677365 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6660155cc0 con 0x7f664005f2c0 2023-11-15T01:33:25.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.544+0000 7f6657fff700 1 -- 172.21.15.1:0/3420677365 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f665000b800 con 0x7f664005f2c0 2023-11-15T01:33:25.545 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:25.545 INFO:teuthology.orchestra.run.smithi001.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:39", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:25.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.546+0000 7f66651c5700 1 -- 172.21.15.1:0/3420677365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f664005f2c0 msgr2=0x7f6640061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:25.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.546+0000 7f66651c5700 1 --2- 172.21.15.1:0/3420677365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f664005f2c0 0x7f6640061780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6660152e80 tx=0x7f6650008040).stop 2023-11-15T01:33:25.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.546+0000 7f66651c5700 1 -- 172.21.15.1:0/3420677365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600ada30 msgr2=0x7f6660154990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:25.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.546+0000 7f66651c5700 1 --2- 172.21.15.1:0/3420677365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600ada30 0x7f6660154990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f66600c2140 tx=0x7f6648017000).stop 2023-11-15T01:33:25.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.546+0000 7f66651c5700 1 -- 172.21.15.1:0/3420677365 shutdown_connections 2023-11-15T01:33:25.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.546+0000 7f66651c5700 1 --2- 172.21.15.1:0/3420677365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f664005f2c0 0x7f6640061780 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.546+0000 7f66651c5700 1 --2- 172.21.15.1:0/3420677365 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66600ca400 0x7f66600c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.546+0000 7f66651c5700 1 --2- 172.21.15.1:0/3420677365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600ada30 0x7f6660154990 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.546+0000 7f66651c5700 1 --2- 172.21.15.1:0/3420677365 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66600c65b0 0x7f6660148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.546+0000 7f66651c5700 1 -- 172.21.15.1:0/3420677365 >> 172.21.15.1:0/3420677365 conn(0x7f6660064a60 msgr2=0x7f666015a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:25.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.546+0000 7f66651c5700 1 -- 172.21.15.1:0/3420677365 shutdown_connections 2023-11-15T01:33:25.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.546+0000 7f66651c5700 1 -- 172.21.15.1:0/3420677365 wait complete. 2023-11-15T01:33:25.558 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:39", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:25.559 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-11-15T00:00:00', 'created': '2023-11-15T01:22:39', 'first': '2023-11-15T01:23:00', 'last': '2023-11-15T01:33:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-15T01:33:25.559 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-15T01:33:25.559 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-15T01:33:25.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:25.560 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-11-15T01:33:25.577 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:25.577 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:25.578 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:25.578 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:25.578 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:25.578 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:25.578 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:25.579 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:25.579 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:25.579 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:25.579 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:25.580 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-15-01_23_00_UTC', 'scheduled-2023-11-15-01_24_00_UTC', 'scheduled-2023-11-15-01_25_00_UTC', 'scheduled-2023-11-15-01_26_00_UTC', 'scheduled-2023-11-15-01_27_00_UTC', 'scheduled-2023-11-15-01_28_00_UTC', 'scheduled-2023-11-15-01_29_00_UTC', 'scheduled-2023-11-15-01_30_00_UTC', 'scheduled-2023-11-15-01_31_00_UTC', 'scheduled-2023-11-15-01_32_00_UTC', 'scheduled-2023-11-15-01_33_00_UTC'] 2023-11-15T01:33:25.580 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-11-15T01:33:25.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.739+0000 7f1b9b2b5700 1 Processor -- start 2023-11-15T01:33:25.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.739+0000 7f1b9b2b5700 1 -- start start 2023-11-15T01:33:25.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.740+0000 7f1b9b2b5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1b94137210 0x7f1b941552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:25.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.740+0000 7f1b9b2b5700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1b94066850 0x7f1b94066d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:25.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.740+0000 7f1b9b2b5700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b940671f0 con 0x7f1b941375f0 2023-11-15T01:33:25.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.740+0000 7f1b9b2b5700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b94158330 con 0x7f1b94137210 2023-11-15T01:33:25.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.740+0000 7f1b9b2b5700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b94158610 con 0x7f1b94066850 2023-11-15T01:33:25.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.740+0000 7f1b9a2b3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1b94137210 0x7f1b941552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:25.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.740+0000 7f1b9a2b3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1b94137210 0x7f1b941552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50006/0 (socket says 172.21.15.1:50006) 2023-11-15T01:33:25.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.740+0000 7f1b9a2b3700 1 -- 172.21.15.1:0/482979063 learned_addr learned my addr 172.21.15.1:0/482979063 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:25.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.740+0000 7f1b9aab4700 1 --2- 172.21.15.1:0/482979063 >> v2:172.21.15.141:3300/0 conn(0x7f1b94066850 0x7f1b94066d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:25.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.740+0000 7f1b9a2b3700 1 -- 172.21.15.1:0/482979063 >> v2:172.21.15.141:3300/0 conn(0x7f1b94066850 msgr2=0x7f1b94066d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:25.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.740+0000 7f1b9a2b3700 1 --2- 172.21.15.1:0/482979063 >> v2:172.21.15.141:3300/0 conn(0x7f1b94066850 0x7f1b94066d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.740+0000 7f1b9a2b3700 1 -- 172.21.15.1:0/482979063 >> v1:172.21.15.141:6789/0 conn(0x7f1b941375f0 legacy=0x7f1b9414e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:25.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.740+0000 7f1b9a2b3700 1 -- 172.21.15.1:0/482979063 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b941588f0 con 0x7f1b94137210 2023-11-15T01:33:25.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.740+0000 7f1b9aab4700 1 --2- 172.21.15.1:0/482979063 >> v2:172.21.15.141:3300/0 conn(0x7f1b94066850 0x7f1b94066d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:25.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.740+0000 7f1b9a2b3700 1 --2- 172.21.15.1:0/482979063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b94137210 0x7f1b941552a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f1b940c34b0 tx=0x7f1b8c0090f0).ready entity=mon.0 client_cookie=3cb34d4ecc648766 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:25.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.741+0000 7f1b992b1700 1 -- 172.21.15.1:0/482979063 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00b600 con 0x7f1b94137210 2023-11-15T01:33:25.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.741+0000 7f1b992b1700 1 -- 172.21.15.1:0/482979063 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00b760 con 0x7f1b94137210 2023-11-15T01:33:25.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.741+0000 7f1b992b1700 1 -- 172.21.15.1:0/482979063 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00bae0 con 0x7f1b94137210 2023-11-15T01:33:25.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.741+0000 7f1b9b2b5700 1 -- 172.21.15.1:0/482979063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b94137210 msgr2=0x7f1b941552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:25.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.741+0000 7f1b9b2b5700 1 --2- 172.21.15.1:0/482979063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b94137210 0x7f1b941552a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f1b940c34b0 tx=0x7f1b8c0090f0).stop 2023-11-15T01:33:25.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.741+0000 7f1b9b2b5700 1 -- 172.21.15.1:0/482979063 shutdown_connections 2023-11-15T01:33:25.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.741+0000 7f1b9b2b5700 1 --2- 172.21.15.1:0/482979063 >> v2:172.21.15.141:3300/0 conn(0x7f1b94066850 0x7f1b94066d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.741+0000 7f1b9b2b5700 1 --2- 172.21.15.1:0/482979063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b94137210 0x7f1b941552a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.741+0000 7f1b9b2b5700 1 -- 172.21.15.1:0/482979063 >> 172.21.15.1:0/482979063 conn(0x7f1b94063280 msgr2=0x7f1b940c8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:25.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.741+0000 7f1b9b2b5700 1 -- 172.21.15.1:0/482979063 shutdown_connections 2023-11-15T01:33:25.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.741+0000 7f1b9b2b5700 1 -- 172.21.15.1:0/482979063 wait complete. 2023-11-15T01:33:25.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.742+0000 7f1b9b2b5700 1 Processor -- start 2023-11-15T01:33:25.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.742+0000 7f1b9b2b5700 1 -- start start 2023-11-15T01:33:25.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.743+0000 7f1b9b2b5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b94066850 0x7f1b9416c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:25.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.743+0000 7f1b9b2b5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b94137210 0x7f1b941368f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:25.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.743+0000 7f1b9b2b5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b941375f0 0x7f1b940c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:25.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.743+0000 7f1b9b2b5700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b940c0d30 con 0x7f1b94066850 2023-11-15T01:33:25.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.743+0000 7f1b9b2b5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b940c29f0 con 0x7f1b94137210 2023-11-15T01:33:25.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.743+0000 7f1b9b2b5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b940c1de0 con 0x7f1b941375f0 2023-11-15T01:33:25.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.743+0000 7f1b9a2b3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b94066850 0x7f1b9416c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:25.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.743+0000 7f1b9a2b3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b94066850 0x7f1b9416c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50010/0 (socket says 172.21.15.1:50010) 2023-11-15T01:33:25.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.743+0000 7f1b9a2b3700 1 -- 172.21.15.1:0/1478974276 learned_addr learned my addr 172.21.15.1:0/1478974276 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:25.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.743+0000 7f1b9a2b3700 1 -- 172.21.15.1:0/1478974276 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b941375f0 msgr2=0x7f1b940c1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:25.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.743+0000 7f1b9a2b3700 1 --2- 172.21.15.1:0/1478974276 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b941375f0 0x7f1b940c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:25.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.743+0000 7f1b99ab2700 1 --2- 172.21.15.1:0/1478974276 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b94137210 0x7f1b941368f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:25.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.743+0000 7f1b9a2b3700 1 -- 172.21.15.1:0/1478974276 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b94137210 msgr2=0x7f1b941368f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:25.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.744+0000 7f1b9a2b3700 1 --2- 172.21.15.1:0/1478974276 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b94137210 0x7f1b941368f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.744+0000 7f1b9a2b3700 1 -- 172.21.15.1:0/1478974276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c009370 con 0x7f1b94066850 2023-11-15T01:33:25.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.744+0000 7f1b99ab2700 1 --2- 172.21.15.1:0/1478974276 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b94137210 0x7f1b941368f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:25.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.744+0000 7f1b9a2b3700 1 --2- 172.21.15.1:0/1478974276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b94066850 0x7f1b9416c6e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f1b940636c0 tx=0x7f1b8c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:25.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.744+0000 7f1b927fc700 1 -- 172.21.15.1:0/1478974276 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00bea0 con 0x7f1b94066850 2023-11-15T01:33:25.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.744+0000 7f1b927fc700 1 -- 172.21.15.1:0/1478974276 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00b8d0 con 0x7f1b94066850 2023-11-15T01:33:25.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.744+0000 7f1b9b2b5700 1 -- 172.21.15.1:0/1478974276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b940c20c0 con 0x7f1b94066850 2023-11-15T01:33:25.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.744+0000 7f1b927fc700 1 -- 172.21.15.1:0/1478974276 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00ba80 con 0x7f1b94066850 2023-11-15T01:33:25.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.744+0000 7f1b9b2b5700 1 -- 172.21.15.1:0/1478974276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b940c2680 con 0x7f1b94066850 2023-11-15T01:33:25.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.745+0000 7f1b9b2b5700 1 -- 172.21.15.1:0/1478974276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b940475e0 con 0x7f1b94066850 2023-11-15T01:33:25.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.745+0000 7f1b927fc700 1 -- 172.21.15.1:0/1478974276 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f1b8c021020 con 0x7f1b94066850 2023-11-15T01:33:25.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.746+0000 7f1b927fc700 1 --2- 172.21.15.1:0/1478974276 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b8005f2c0 0x7f1b80061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:25.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.746+0000 7f1b927fc700 1 -- 172.21.15.1:0/1478974276 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f1b8c07be50 con 0x7f1b94066850 2023-11-15T01:33:25.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.746+0000 7f1b99ab2700 1 --2- 172.21.15.1:0/1478974276 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b8005f2c0 0x7f1b80061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:25.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.746+0000 7f1b99ab2700 1 --2- 172.21.15.1:0/1478974276 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b8005f2c0 0x7f1b80061780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f1b940c6450 tx=0x7f1b88009040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:25.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.750+0000 7f1b927fc700 1 -- 172.21.15.1:0/1478974276 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1b8c04cf10 con 0x7f1b94066850 2023-11-15T01:33:25.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.949+0000 7f1b9b2b5700 1 -- 172.21.15.1:0/1478974276 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b940c2d80 con 0x7f1b8005f2c0 2023-11-15T01:33:25.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.951+0000 7f1b927fc700 1 -- 172.21.15.1:0/1478974276 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f1b940c2d80 con 0x7f1b8005f2c0 2023-11-15T01:33:25.951 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:25.952 INFO:teuthology.orchestra.run.smithi001.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:39", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:25.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.953+0000 7f1b9b2b5700 1 -- 172.21.15.1:0/1478974276 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b8005f2c0 msgr2=0x7f1b80061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:25.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.953+0000 7f1b9b2b5700 1 --2- 172.21.15.1:0/1478974276 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b8005f2c0 0x7f1b80061780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f1b940c6450 tx=0x7f1b88009040).stop 2023-11-15T01:33:25.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.953+0000 7f1b9b2b5700 1 -- 172.21.15.1:0/1478974276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b94066850 msgr2=0x7f1b9416c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:25.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.953+0000 7f1b9b2b5700 1 --2- 172.21.15.1:0/1478974276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b94066850 0x7f1b9416c6e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f1b940636c0 tx=0x7f1b8c017000).stop 2023-11-15T01:33:25.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.953+0000 7f1b9b2b5700 1 -- 172.21.15.1:0/1478974276 shutdown_connections 2023-11-15T01:33:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.953+0000 7f1b9b2b5700 1 --2- 172.21.15.1:0/1478974276 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b8005f2c0 0x7f1b80061780 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.953+0000 7f1b9b2b5700 1 --2- 172.21.15.1:0/1478974276 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b941375f0 0x7f1b940c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.953+0000 7f1b9b2b5700 1 --2- 172.21.15.1:0/1478974276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b94066850 0x7f1b9416c6e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.953+0000 7f1b9b2b5700 1 --2- 172.21.15.1:0/1478974276 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b94137210 0x7f1b941368f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.953+0000 7f1b9b2b5700 1 -- 172.21.15.1:0/1478974276 >> 172.21.15.1:0/1478974276 conn(0x7f1b94063280 msgr2=0x7f1b94155070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:25.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.953+0000 7f1b9b2b5700 1 -- 172.21.15.1:0/1478974276 shutdown_connections 2023-11-15T01:33:25.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:25.953+0000 7f1b9b2b5700 1 -- 172.21.15.1:0/1478974276 wait complete. 2023-11-15T01:33:25.965 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:39", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:25.966 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-11-15T00:00:00', 'created': '2023-11-15T01:22:39', 'first': '2023-11-15T01:23:00', 'last': '2023-11-15T01:33:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-15T01:33:25.966 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-15T01:33:25.967 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-15T01:33:25.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:25.971 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-11-15T01:33:25.988 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:25.988 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:25.989 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:25.989 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:25.989 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:25.989 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:25.990 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:25.990 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:25.990 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:25.990 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:25.990 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:25.991 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-15-01_23_00_UTC', 'scheduled-2023-11-15-01_24_00_UTC', 'scheduled-2023-11-15-01_25_00_UTC', 'scheduled-2023-11-15-01_26_00_UTC', 'scheduled-2023-11-15-01_27_00_UTC', 'scheduled-2023-11-15-01_28_00_UTC', 'scheduled-2023-11-15-01_29_00_UTC', 'scheduled-2023-11-15-01_30_00_UTC', 'scheduled-2023-11-15-01_31_00_UTC', 'scheduled-2023-11-15-01_32_00_UTC', 'scheduled-2023-11-15-01_33_00_UTC'] 2023-11-15T01:33:25.991 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-11-15T01:33:26.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.151+0000 7f79b318f700 1 Processor -- start 2023-11-15T01:33:26.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.151+0000 7f79b318f700 1 -- start start 2023-11-15T01:33:26.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b318f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79ac0ca5d0 0x7f79ac0aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:26.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b318f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ac1548f0 con 0x7f79ac155610 2023-11-15T01:33:26.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b318f700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ac0aa4f0 con 0x7f79ac063b50 2023-11-15T01:33:26.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b318f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0aaa50 con 0x7f79ac0ca5d0 2023-11-15T01:33:26.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b198c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f79ac155610 0x7f79ac063440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48306/0 (socket says 172.21.15.1:48306) 2023-11-15T01:33:26.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b198c700 1 -- 172.21.15.1:0/2363602524 learned_addr learned my addr 172.21.15.1:0/2363602524 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:26.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b218d700 1 --2- 172.21.15.1:0/2363602524 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79ac0ca5d0 0x7f79ac0aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:26.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413156064 0 0) 0x7f79a0001110 con 0x7f79ac155610 2023-11-15T01:33:26.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79940033f0 con 0x7f79ac155610 2023-11-15T01:33:26.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702068925 0 0) 0x7f79ac0aa4f0 con 0x7f79ac063b50 2023-11-15T01:33:26.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79a0001110 con 0x7f79ac063b50 2023-11-15T01:33:26.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 100223916 0 0) 0x7f79940033f0 con 0x7f79ac155610 2023-11-15T01:33:26.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79ac0ca5d0 msgr2=0x7f79ac0aa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:26.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b118b700 1 --2- 172.21.15.1:0/2363602524 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79ac0ca5d0 0x7f79ac0aa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 >> v1:172.21.15.141:6789/0 conn(0x7f79ac063b50 legacy=0x7f79ac15df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:26.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.152+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac0aa770 con 0x7f79ac155610 2023-11-15T01:33:26.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f79a0001600 con 0x7f79ac155610 2023-11-15T01:33:26.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 >> v1:172.21.15.1:6789/0 conn(0x7f79ac155610 legacy=0x7f79ac063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:26.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b118b700 1 --2- 172.21.15.1:0/2363602524 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79ac0ca5d0 0x7f7994003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:26.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b118b700 1 --2- 172.21.15.1:0/2363602524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7994004000 0x7f7994004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:26.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b118b700 1 --2- 172.21.15.1:0/2363602524 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7994004b80 0x7f7994005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:26.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0aaa50 con 0x7f7994004000 2023-11-15T01:33:26.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799400b9c0 con 0x7f7994004b80 2023-11-15T01:33:26.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799400bb80 con 0x7f79ac0ca5d0 2023-11-15T01:33:26.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b198c700 1 --2- 172.21.15.1:0/2363602524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7994004000 0x7f7994004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:26.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b218d700 1 --2- 172.21.15.1:0/2363602524 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79ac0ca5d0 0x7f7994003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:26.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b298e700 1 --2- 172.21.15.1:0/2363602524 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7994004b80 0x7f7994005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:26.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b198c700 1 -- 172.21.15.1:0/2363602524 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79ac0ca5d0 msgr2=0x7f7994003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:26.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b198c700 1 --2- 172.21.15.1:0/2363602524 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79ac0ca5d0 0x7f7994003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b198c700 1 -- 172.21.15.1:0/2363602524 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7994004b80 msgr2=0x7f7994005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:26.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b198c700 1 --2- 172.21.15.1:0/2363602524 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7994004b80 0x7f7994005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b198c700 1 -- 172.21.15.1:0/2363602524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79940033f0 con 0x7f7994004000 2023-11-15T01:33:26.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b198c700 1 --2- 172.21.15.1:0/2363602524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7994004000 0x7f7994004690 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f79ac05f2d0 tx=0x7f79ac0c9ca0).ready entity=mon.0 client_cookie=71631a15fd0088e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:26.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a000ca40 con 0x7f7994004000 2023-11-15T01:33:26.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a000cba0 con 0x7f7994004000 2023-11-15T01:33:26.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.153+0000 7f79b118b700 1 -- 172.21.15.1:0/2363602524 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a00070d0 con 0x7f7994004000 2023-11-15T01:33:26.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.154+0000 7f79b318f700 1 -- 172.21.15.1:0/2363602524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7994004000 msgr2=0x7f7994004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:26.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.154+0000 7f79b318f700 1 --2- 172.21.15.1:0/2363602524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7994004000 0x7f7994004690 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f79ac05f2d0 tx=0x7f79ac0c9ca0).stop 2023-11-15T01:33:26.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.154+0000 7f79b298e700 1 -- 172.21.15.1:0/2363602524 reap_dead start 2023-11-15T01:33:26.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.154+0000 7f79b318f700 1 -- 172.21.15.1:0/2363602524 shutdown_connections 2023-11-15T01:33:26.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.154+0000 7f79b318f700 1 -- 172.21.15.1:0/2363602524 >> 172.21.15.1:0/2363602524 conn(0x7f79ac06a9b0 msgr2=0x7f79ac0cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:26.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.154+0000 7f79b318f700 1 -- 172.21.15.1:0/2363602524 shutdown_connections 2023-11-15T01:33:26.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.154+0000 7f79b318f700 1 -- 172.21.15.1:0/2363602524 wait complete. 2023-11-15T01:33:26.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.155+0000 7f79b318f700 1 Processor -- start 2023-11-15T01:33:26.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.155+0000 7f79b318f700 1 -- start start 2023-11-15T01:33:26.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b318f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7994004000 0x7f79ac141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:26.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b318f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ac0b0370 0x7f79ac0b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:26.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b318f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f79ac0c2fb0 0x7f79ac0c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:26.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b318f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac14a2b0 con 0x7f79ac0b0370 2023-11-15T01:33:26.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b318f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0afee0 con 0x7f79ac0c2fb0 2023-11-15T01:33:26.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b318f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0af2d0 con 0x7f7994004000 2023-11-15T01:33:26.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b198c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ac0b0370 0x7f79ac0b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:26.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b198c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ac0b0370 0x7f79ac0b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50026/0 (socket says 172.21.15.1:50026) 2023-11-15T01:33:26.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b198c700 1 -- 172.21.15.1:0/3528683245 learned_addr learned my addr 172.21.15.1:0/3528683245 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:26.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b218d700 1 --2- 172.21.15.1:0/3528683245 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7994004000 0x7f79ac141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:26.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b298e700 1 --2- 172.21.15.1:0/3528683245 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f79ac0c2fb0 0x7f79ac0c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:26.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b198c700 1 -- 172.21.15.1:0/3528683245 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7994004000 msgr2=0x7f79ac141dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:26.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b198c700 1 --2- 172.21.15.1:0/3528683245 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7994004000 0x7f79ac141dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b198c700 1 -- 172.21.15.1:0/3528683245 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f79ac0c2fb0 msgr2=0x7f79ac0c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:26.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b198c700 1 --2- 172.21.15.1:0/3528683245 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f79ac0c2fb0 0x7f79ac0c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b198c700 1 -- 172.21.15.1:0/3528683245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac0af5b0 con 0x7f79ac0b0370 2023-11-15T01:33:26.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.156+0000 7f79b298e700 1 --2- 172.21.15.1:0/3528683245 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f79ac0c2fb0 0x7f79ac0c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:26.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.157+0000 7f79b198c700 1 --2- 172.21.15.1:0/3528683245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ac0b0370 0x7f79ac0b07f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f799400b990 tx=0x7f79a0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:26.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.157+0000 7f79aa7fc700 1 -- 172.21.15.1:0/3528683245 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a00018b0 con 0x7f79ac0b0370 2023-11-15T01:33:26.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.157+0000 7f79aa7fc700 1 -- 172.21.15.1:0/3528683245 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a0001bf0 con 0x7f79ac0b0370 2023-11-15T01:33:26.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.157+0000 7f79aa7fc700 1 -- 172.21.15.1:0/3528683245 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0007440 con 0x7f79ac0b0370 2023-11-15T01:33:26.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.157+0000 7f79b318f700 1 -- 172.21.15.1:0/3528683245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ac0af890 con 0x7f79ac0b0370 2023-11-15T01:33:26.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.157+0000 7f79b318f700 1 -- 172.21.15.1:0/3528683245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ac1422c0 con 0x7f79ac0b0370 2023-11-15T01:33:26.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.158+0000 7f79b318f700 1 -- 172.21.15.1:0/3528683245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ac0afd30 con 0x7f79ac0b0370 2023-11-15T01:33:26.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.158+0000 7f79aa7fc700 1 -- 172.21.15.1:0/3528683245 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f79a0013450 con 0x7f79ac0b0370 2023-11-15T01:33:26.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.158+0000 7f79aa7fc700 1 --2- 172.21.15.1:0/3528683245 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f799805f2c0 0x7f7998061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:26.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.159+0000 7f79aa7fc700 1 -- 172.21.15.1:0/3528683245 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f79a007b0a0 con 0x7f79ac0b0370 2023-11-15T01:33:26.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.159+0000 7f79b218d700 1 --2- 172.21.15.1:0/3528683245 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f799805f2c0 0x7f7998061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:26.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.159+0000 7f79b218d700 1 --2- 172.21.15.1:0/3528683245 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f799805f2c0 0x7f7998061780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f799c009fd0 tx=0x7f799c00b040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:26.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.163+0000 7f79aa7fc700 1 -- 172.21.15.1:0/3528683245 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f79a004c0c0 con 0x7f79ac0b0370 2023-11-15T01:33:26.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.364+0000 7f79b318f700 1 -- 172.21.15.1:0/3528683245 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79ac1548f0 con 0x7f799805f2c0 2023-11-15T01:33:26.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.366+0000 7f79aa7fc700 1 -- 172.21.15.1:0/3528683245 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f79ac1548f0 con 0x7f799805f2c0 2023-11-15T01:33:26.367 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:26.367 INFO:teuthology.orchestra.run.smithi001.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:40", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:26.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.368+0000 7f79b318f700 1 -- 172.21.15.1:0/3528683245 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f799805f2c0 msgr2=0x7f7998061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:26.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.368+0000 7f79b318f700 1 --2- 172.21.15.1:0/3528683245 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f799805f2c0 0x7f7998061780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f799c009fd0 tx=0x7f799c00b040).stop 2023-11-15T01:33:26.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.368+0000 7f79b318f700 1 -- 172.21.15.1:0/3528683245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ac0b0370 msgr2=0x7f79ac0b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:26.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.368+0000 7f79b318f700 1 --2- 172.21.15.1:0/3528683245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ac0b0370 0x7f79ac0b07f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f799400b990 tx=0x7f79a0015000).stop 2023-11-15T01:33:26.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.368+0000 7f79b318f700 1 -- 172.21.15.1:0/3528683245 shutdown_connections 2023-11-15T01:33:26.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.368+0000 7f79b318f700 1 --2- 172.21.15.1:0/3528683245 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f799805f2c0 0x7f7998061780 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.368+0000 7f79b318f700 1 --2- 172.21.15.1:0/3528683245 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f79ac0c2fb0 0x7f79ac0c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.368+0000 7f79b318f700 1 --2- 172.21.15.1:0/3528683245 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7994004000 0x7f79ac141dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.368+0000 7f79b318f700 1 --2- 172.21.15.1:0/3528683245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79ac0b0370 0x7f79ac0b07f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.368+0000 7f79b318f700 1 -- 172.21.15.1:0/3528683245 >> 172.21.15.1:0/3528683245 conn(0x7f79ac06a9b0 msgr2=0x7f79ac151c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:26.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.368+0000 7f79b318f700 1 -- 172.21.15.1:0/3528683245 shutdown_connections 2023-11-15T01:33:26.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.368+0000 7f79b318f700 1 -- 172.21.15.1:0/3528683245 wait complete. 2023-11-15T01:33:26.382 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:22:40", "first": "2023-11-15T01:23:00", "last": "2023-11-15T01:33:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-11-15T01:33:26.382 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-11-15T00:00:00', 'created': '2023-11-15T01:22:40', 'first': '2023-11-15T01:23:00', 'last': '2023-11-15T01:33:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-11-15T01:33:26.383 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-15T01:33:26.383 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-15T01:33:26.383 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-11-15T01:33:26.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.506+0000 7f1b3b8af700 1 Processor -- start 2023-11-15T01:33:26.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.506+0000 7f1b3b8af700 1 -- start start 2023-11-15T01:33:26.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.507+0000 7f1b3b8af700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1b3414b350 0x7f1b340c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:26.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.507+0000 7f1b3b8af700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b3414b730 0x7f1b34154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:26.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.507+0000 7f1b3b8af700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b341580d0 con 0x7f1b340aa040 2023-11-15T01:33:26.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.507+0000 7f1b3b8af700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b34155000 con 0x7f1b3414b350 2023-11-15T01:33:26.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.507+0000 7f1b3b8af700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b341552e0 con 0x7f1b3414b730 2023-11-15T01:33:26.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.507+0000 7f1b3964b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1b3414b350 0x7f1b340c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:26.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.507+0000 7f1b3964b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1b3414b350 0x7f1b340c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50030/0 (socket says 172.21.15.1:50030) 2023-11-15T01:33:26.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.507+0000 7f1b3964b700 1 -- 172.21.15.1:0/52970908 learned_addr learned my addr 172.21.15.1:0/52970908 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:26.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.507+0000 7f1b38e4a700 1 --2- 172.21.15.1:0/52970908 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b3414b730 0x7f1b34154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:26.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.507+0000 7f1b3964b700 1 -- 172.21.15.1:0/52970908 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b3414b730 msgr2=0x7f1b34154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:26.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.507+0000 7f1b3964b700 1 --2- 172.21.15.1:0/52970908 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b3414b730 0x7f1b34154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.507+0000 7f1b3964b700 1 -- 172.21.15.1:0/52970908 >> v1:172.21.15.141:6789/0 conn(0x7f1b340aa040 legacy=0x7f1b34158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:26.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.507+0000 7f1b3964b700 1 -- 172.21.15.1:0/52970908 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b341555c0 con 0x7f1b3414b350 2023-11-15T01:33:26.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.507+0000 7f1b3964b700 1 --2- 172.21.15.1:0/52970908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b3414b350 0x7f1b340c8290 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f1b2c009f20 tx=0x7f1b2c009840).ready entity=mon.0 client_cookie=46ccb191b60a17c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:26.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.508+0000 7f1b33fff700 1 -- 172.21.15.1:0/52970908 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c00e070 con 0x7f1b3414b350 2023-11-15T01:33:26.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.508+0000 7f1b33fff700 1 -- 172.21.15.1:0/52970908 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c00b9d0 con 0x7f1b3414b350 2023-11-15T01:33:26.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.508+0000 7f1b33fff700 1 -- 172.21.15.1:0/52970908 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c00bd50 con 0x7f1b3414b350 2023-11-15T01:33:26.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.508+0000 7f1b3b8af700 1 -- 172.21.15.1:0/52970908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b3414b350 msgr2=0x7f1b340c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:26.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.508+0000 7f1b3b8af700 1 --2- 172.21.15.1:0/52970908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b3414b350 0x7f1b340c8290 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f1b2c009f20 tx=0x7f1b2c009840).stop 2023-11-15T01:33:26.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.508+0000 7f1b3b8af700 1 -- 172.21.15.1:0/52970908 shutdown_connections 2023-11-15T01:33:26.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.508+0000 7f1b3b8af700 1 --2- 172.21.15.1:0/52970908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b3414b350 0x7f1b340c8290 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.508+0000 7f1b3b8af700 1 --2- 172.21.15.1:0/52970908 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b3414b730 0x7f1b34154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.508+0000 7f1b3b8af700 1 -- 172.21.15.1:0/52970908 >> 172.21.15.1:0/52970908 conn(0x7f1b34069ee0 msgr2=0x7f1b3406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:26.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.508+0000 7f1b3b8af700 1 -- 172.21.15.1:0/52970908 shutdown_connections 2023-11-15T01:33:26.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.508+0000 7f1b3b8af700 1 -- 172.21.15.1:0/52970908 wait complete. 2023-11-15T01:33:26.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.509+0000 7f1b3b8af700 1 Processor -- start 2023-11-15T01:33:26.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.509+0000 7f1b3b8af700 1 -- start start 2023-11-15T01:33:26.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.510+0000 7f1b3b8af700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340aa040 0x7f1b34149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.510+0000 7f1b3b8af700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b3414b730 0x7f1b340ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.510+0000 7f1b3b8af700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b3414a270 0x7f1b340ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.510+0000 7f1b3b8af700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b340b0730 con 0x7f1b340aa040 2023-11-15T01:33:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.510+0000 7f1b3b8af700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b340caa70 con 0x7f1b3414a270 2023-11-15T01:33:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.510+0000 7f1b3b8af700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3414c640 con 0x7f1b3414b730 2023-11-15T01:33:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.510+0000 7f1b3964b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340aa040 0x7f1b34149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.510+0000 7f1b3964b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340aa040 0x7f1b34149d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50036/0 (socket says 172.21.15.1:50036) 2023-11-15T01:33:26.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.510+0000 7f1b3964b700 1 -- 172.21.15.1:0/3114388691 learned_addr learned my addr 172.21.15.1:0/3114388691 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:26.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.511+0000 7f1b38e4a700 1 --2- 172.21.15.1:0/3114388691 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b3414b730 0x7f1b340ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:26.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.511+0000 7f1b39e4c700 1 --2- 172.21.15.1:0/3114388691 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b3414a270 0x7f1b340ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:26.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.511+0000 7f1b3964b700 1 -- 172.21.15.1:0/3114388691 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b3414b730 msgr2=0x7f1b340ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:26.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.511+0000 7f1b3964b700 1 --2- 172.21.15.1:0/3114388691 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b3414b730 0x7f1b340ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.511+0000 7f1b3964b700 1 -- 172.21.15.1:0/3114388691 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b3414a270 msgr2=0x7f1b340ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.511+0000 7f1b3964b700 1 --2- 172.21.15.1:0/3114388691 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b3414a270 0x7f1b340ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.511+0000 7f1b3964b700 1 -- 172.21.15.1:0/3114388691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c009ae0 con 0x7f1b340aa040 2023-11-15T01:33:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.511+0000 7f1b39e4c700 1 --2- 172.21.15.1:0/3114388691 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b3414a270 0x7f1b340ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.511+0000 7f1b3964b700 1 --2- 172.21.15.1:0/3114388691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340aa040 0x7f1b34149d80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f1b2c00b610 tx=0x7f1b2c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.511+0000 7f1b317fa700 1 -- 172.21.15.1:0/3114388691 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c00b640 con 0x7f1b340aa040 2023-11-15T01:33:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.511+0000 7f1b317fa700 1 -- 172.21.15.1:0/3114388691 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c00bb40 con 0x7f1b340aa040 2023-11-15T01:33:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.511+0000 7f1b317fa700 1 -- 172.21.15.1:0/3114388691 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c01e6a0 con 0x7f1b340aa040 2023-11-15T01:33:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.511+0000 7f1b3b8af700 1 -- 172.21.15.1:0/3114388691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3414bd10 con 0x7f1b340aa040 2023-11-15T01:33:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.511+0000 7f1b3b8af700 1 -- 172.21.15.1:0/3114388691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3414c2d0 con 0x7f1b340aa040 2023-11-15T01:33:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.512+0000 7f1b3b8af700 1 -- 172.21.15.1:0/3114388691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3406c7e0 con 0x7f1b340aa040 2023-11-15T01:33:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.512+0000 7f1b317fa700 1 -- 172.21.15.1:0/3114388691 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f1b2c003040 con 0x7f1b340aa040 2023-11-15T01:33:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.513+0000 7f1b317fa700 1 --2- 172.21.15.1:0/3114388691 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b2005f2c0 0x7f1b20061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.513+0000 7f1b317fa700 1 -- 172.21.15.1:0/3114388691 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f1b2c07b8f0 con 0x7f1b340aa040 2023-11-15T01:33:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.513+0000 7f1b38e4a700 1 --2- 172.21.15.1:0/3114388691 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b2005f2c0 0x7f1b20061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.513+0000 7f1b38e4a700 1 --2- 172.21.15.1:0/3114388691 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b2005f2c0 0x7f1b20061780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1b340c14f0 tx=0x7f1b28009060).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.517+0000 7f1b317fa700 1 -- 172.21.15.1:0/3114388691 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1b2c04c970 con 0x7f1b340aa040 2023-11-15T01:33:26.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.714+0000 7f1b3b8af700 1 -- 172.21.15.1:0/3114388691 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b340c61c0 con 0x7f1b2005f2c0 2023-11-15T01:33:26.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.719+0000 7f1b317fa700 1 -- 172.21.15.1:0/3114388691 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f1b340c61c0 con 0x7f1b2005f2c0 2023-11-15T01:33:26.719 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-11-15T01:33:26.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.721+0000 7f1b3b8af700 1 -- 172.21.15.1:0/3114388691 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b2005f2c0 msgr2=0x7f1b20061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:26.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.721+0000 7f1b3b8af700 1 --2- 172.21.15.1:0/3114388691 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b2005f2c0 0x7f1b20061780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1b340c14f0 tx=0x7f1b28009060).stop 2023-11-15T01:33:26.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.721+0000 7f1b3b8af700 1 -- 172.21.15.1:0/3114388691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340aa040 msgr2=0x7f1b34149d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:26.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.721+0000 7f1b3b8af700 1 --2- 172.21.15.1:0/3114388691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340aa040 0x7f1b34149d80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f1b2c00b610 tx=0x7f1b2c009840).stop 2023-11-15T01:33:26.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.721+0000 7f1b3b8af700 1 -- 172.21.15.1:0/3114388691 shutdown_connections 2023-11-15T01:33:26.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.721+0000 7f1b3b8af700 1 --2- 172.21.15.1:0/3114388691 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b2005f2c0 0x7f1b20061780 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.721+0000 7f1b3b8af700 1 --2- 172.21.15.1:0/3114388691 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b3414a270 0x7f1b340ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.721+0000 7f1b3b8af700 1 --2- 172.21.15.1:0/3114388691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340aa040 0x7f1b34149d80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.721+0000 7f1b3b8af700 1 --2- 172.21.15.1:0/3114388691 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b3414b730 0x7f1b340ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:26.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.721+0000 7f1b3b8af700 1 -- 172.21.15.1:0/3114388691 >> 172.21.15.1:0/3114388691 conn(0x7f1b34069ee0 msgr2=0x7f1b34156f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:26.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.721+0000 7f1b3b8af700 1 -- 172.21.15.1:0/3114388691 shutdown_connections 2023-11-15T01:33:26.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:26.721+0000 7f1b3b8af700 1 -- 172.21.15.1:0/3114388691 wait complete. 2023-11-15T01:33:26.733 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-11-15T01:33:26.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:26.734 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-11-15T01:33:26.750 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:26.750 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:26.750 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:26.751 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:26.751 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:26.751 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:26.751 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:26.752 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:26.752 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:26.752 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:26.752 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:26.753 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:26.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:26.753 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_23_00_UTC) 2023-11-15T01:33:26.811 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:26.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:26.812 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_24_00_UTC) 2023-11-15T01:33:26.875 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:26.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:26.876 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_25_00_UTC) 2023-11-15T01:33:26.939 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:26.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:26.940 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_26_00_UTC) 2023-11-15T01:33:27.001 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:27.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:27.002 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_27_00_UTC) 2023-11-15T01:33:27.064 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:27.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:27.064 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_28_00_UTC) 2023-11-15T01:33:27.126 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:27.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:27.127 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_29_00_UTC) 2023-11-15T01:33:27.186 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:27.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:27.187 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_30_00_UTC) 2023-11-15T01:33:27.247 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:27.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:27.248 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_31_00_UTC) 2023-11-15T01:33:27.307 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:27.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:27.308 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_32_00_UTC) 2023-11-15T01:33:27.367 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:27.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:27.368 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-11-15-01_33_00_UTC) 2023-11-15T01:33:27.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:27.428 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-11-15T01:33:27.486 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-11-15T01:33:27.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.648+0000 7f707bb1f700 1 Processor -- start 2023-11-15T01:33:27.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.648+0000 7f707bb1f700 1 -- start start 2023-11-15T01:33:27.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.649+0000 7f707bb1f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f707414b350 0x7f70740c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:27.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.649+0000 7f707bb1f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f707414b730 0x7f7074154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:27.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.649+0000 7f707bb1f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70740aa040 0x7f70740aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:27.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.649+0000 7f707bb1f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70740aa9e0 con 0x7f707414b350 2023-11-15T01:33:27.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.649+0000 7f707bb1f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70741580d0 con 0x7f707414b730 2023-11-15T01:33:27.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.649+0000 7f707bb1f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7074155000 con 0x7f70740aa040 2023-11-15T01:33:27.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.649+0000 7f70798bb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f707414b350 0x7f70740c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:27.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.649+0000 7f70798bb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f707414b350 0x7f70740c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59914/0 (socket says 172.21.15.1:59914) 2023-11-15T01:33:27.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.649+0000 7f70798bb700 1 -- 172.21.15.1:0/1548032672 learned_addr learned my addr 172.21.15.1:0/1548032672 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:27.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.650+0000 7f70790ba700 1 --2- 172.21.15.1:0/1548032672 >> v2:172.21.15.141:3300/0 conn(0x7f707414b730 0x7f7074154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:27.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.650+0000 7f707a0bc700 1 --2- 172.21.15.1:0/1548032672 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70740aa040 0x7f70740aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:27.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.650+0000 7f70798bb700 1 -- 172.21.15.1:0/1548032672 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70740aa040 msgr2=0x7f70740aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:27.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.650+0000 7f70798bb700 1 --2- 172.21.15.1:0/1548032672 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70740aa040 0x7f70740aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:27.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.650+0000 7f70798bb700 1 -- 172.21.15.1:0/1548032672 >> v2:172.21.15.141:3300/0 conn(0x7f707414b730 msgr2=0x7f7074154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:27.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.650+0000 7f70798bb700 1 --2- 172.21.15.1:0/1548032672 >> v2:172.21.15.141:3300/0 conn(0x7f707414b730 0x7f7074154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:27.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.650+0000 7f70798bb700 1 -- 172.21.15.1:0/1548032672 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70741552e0 con 0x7f707414b350 2023-11-15T01:33:27.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.650+0000 7f70798bb700 1 --2- 172.21.15.1:0/1548032672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707414b350 0x7f70740c8290 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f70740c8780 tx=0x7f7064009840).ready entity=mon.0 client_cookie=2d6836817404b7cf server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:27.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.650+0000 7f70788b9700 1 -- 172.21.15.1:0/1548032672 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706400e070 con 0x7f707414b350 2023-11-15T01:33:27.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.650+0000 7f70788b9700 1 -- 172.21.15.1:0/1548032672 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706400b970 con 0x7f707414b350 2023-11-15T01:33:27.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.650+0000 7f70788b9700 1 -- 172.21.15.1:0/1548032672 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706400bcf0 con 0x7f707414b350 2023-11-15T01:33:27.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.651+0000 7f707bb1f700 1 -- 172.21.15.1:0/1548032672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707414b350 msgr2=0x7f70740c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:27.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.651+0000 7f707bb1f700 1 --2- 172.21.15.1:0/1548032672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707414b350 0x7f70740c8290 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f70740c8780 tx=0x7f7064009840).stop 2023-11-15T01:33:27.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.651+0000 7f707bb1f700 1 -- 172.21.15.1:0/1548032672 shutdown_connections 2023-11-15T01:33:27.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.651+0000 7f707bb1f700 1 --2- 172.21.15.1:0/1548032672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707414b350 0x7f70740c8290 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:27.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.651+0000 7f707bb1f700 1 --2- 172.21.15.1:0/1548032672 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70740aa040 0x7f70740aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:27.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.651+0000 7f707bb1f700 1 --2- 172.21.15.1:0/1548032672 >> v2:172.21.15.141:3300/0 conn(0x7f707414b730 0x7f7074154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:27.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.651+0000 7f707bb1f700 1 -- 172.21.15.1:0/1548032672 >> 172.21.15.1:0/1548032672 conn(0x7f7074069ee0 msgr2=0x7f707406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:27.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.651+0000 7f707bb1f700 1 -- 172.21.15.1:0/1548032672 shutdown_connections 2023-11-15T01:33:27.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.651+0000 7f707bb1f700 1 -- 172.21.15.1:0/1548032672 wait complete. 2023-11-15T01:33:27.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.652+0000 7f707bb1f700 1 Processor -- start 2023-11-15T01:33:27.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.652+0000 7f707bb1f700 1 -- start start 2023-11-15T01:33:27.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707bb1f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70740aa040 0x7f70740c1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:27.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707bb1f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f707414b350 0x7f7074142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:27.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707bb1f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707414b730 0x7f707414d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:27.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707bb1f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70741474c0 con 0x7f707414b730 2023-11-15T01:33:27.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707bb1f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7074146c00 con 0x7f707414b350 2023-11-15T01:33:27.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707bb1f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7074146e70 con 0x7f70740aa040 2023-11-15T01:33:27.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707a0bc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707414b730 0x7f707414d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:27.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707a0bc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707414b730 0x7f707414d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59916/0 (socket says 172.21.15.1:59916) 2023-11-15T01:33:27.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707a0bc700 1 -- 172.21.15.1:0/727878785 learned_addr learned my addr 172.21.15.1:0/727878785 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:27.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f70790ba700 1 --2- 172.21.15.1:0/727878785 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f707414b350 0x7f7074142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:27.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f70798bb700 1 --2- 172.21.15.1:0/727878785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70740aa040 0x7f70740c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:27.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707a0bc700 1 -- 172.21.15.1:0/727878785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70740aa040 msgr2=0x7f70740c1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:27.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707a0bc700 1 --2- 172.21.15.1:0/727878785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70740aa040 0x7f70740c1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:27.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707a0bc700 1 -- 172.21.15.1:0/727878785 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f707414b350 msgr2=0x7f7074142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:27.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707a0bc700 1 --2- 172.21.15.1:0/727878785 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f707414b350 0x7f7074142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:27.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707a0bc700 1 -- 172.21.15.1:0/727878785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7064009ae0 con 0x7f707414b730 2023-11-15T01:33:27.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707a0bc700 1 --2- 172.21.15.1:0/727878785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707414b730 0x7f707414d990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f706c00e930 tx=0x7f706c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:27.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f7071ffb700 1 -- 172.21.15.1:0/727878785 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c0093b0 con 0x7f707414b730 2023-11-15T01:33:27.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f7071ffb700 1 -- 172.21.15.1:0/727878785 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c00c640 con 0x7f707414b730 2023-11-15T01:33:27.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f7071ffb700 1 -- 172.21.15.1:0/727878785 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c00c9c0 con 0x7f707414b730 2023-11-15T01:33:27.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.653+0000 7f707bb1f700 1 -- 172.21.15.1:0/727878785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7074147150 con 0x7f707414b730 2023-11-15T01:33:27.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.654+0000 7f707bb1f700 1 -- 172.21.15.1:0/727878785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7074143060 con 0x7f707414b730 2023-11-15T01:33:27.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.654+0000 7f707bb1f700 1 -- 172.21.15.1:0/727878785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7074147670 con 0x7f707414b730 2023-11-15T01:33:27.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.655+0000 7f7071ffb700 1 -- 172.21.15.1:0/727878785 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f706c01b400 con 0x7f707414b730 2023-11-15T01:33:27.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.655+0000 7f7071ffb700 1 --2- 172.21.15.1:0/727878785 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f706005f2c0 0x7f7060061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:27.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.655+0000 7f7071ffb700 1 -- 172.21.15.1:0/727878785 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f706c07a830 con 0x7f707414b730 2023-11-15T01:33:27.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.655+0000 7f70798bb700 1 --2- 172.21.15.1:0/727878785 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f706005f2c0 0x7f7060061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:27.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.656+0000 7f70798bb700 1 --2- 172.21.15.1:0/727878785 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f706005f2c0 0x7f7060061780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f706400b940 tx=0x7f7064009840).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:27.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.659+0000 7f7071ffb700 1 -- 172.21.15.1:0/727878785 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7074147670 con 0x7f707414b730 2023-11-15T01:33:27.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.857+0000 7f707bb1f700 1 -- 172.21.15.1:0/727878785 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7074147600 con 0x7f706005f2c0 2023-11-15T01:33:27.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.861+0000 7f7071ffb700 1 -- 172.21.15.1:0/727878785 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f7074147600 con 0x7f706005f2c0 2023-11-15T01:33:27.862 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-11-15T01:33:27.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.863+0000 7f707bb1f700 1 -- 172.21.15.1:0/727878785 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f706005f2c0 msgr2=0x7f7060061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:27.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.863+0000 7f707bb1f700 1 --2- 172.21.15.1:0/727878785 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f706005f2c0 0x7f7060061780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f706400b940 tx=0x7f7064009840).stop 2023-11-15T01:33:27.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.863+0000 7f707bb1f700 1 -- 172.21.15.1:0/727878785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707414b730 msgr2=0x7f707414d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:27.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.863+0000 7f707bb1f700 1 --2- 172.21.15.1:0/727878785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707414b730 0x7f707414d990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f706c00e930 tx=0x7f706c009060).stop 2023-11-15T01:33:27.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.863+0000 7f707bb1f700 1 -- 172.21.15.1:0/727878785 shutdown_connections 2023-11-15T01:33:27.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.863+0000 7f707bb1f700 1 --2- 172.21.15.1:0/727878785 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f706005f2c0 0x7f7060061780 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:27.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.863+0000 7f707bb1f700 1 --2- 172.21.15.1:0/727878785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707414b730 0x7f707414d990 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:27.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.863+0000 7f707bb1f700 1 --2- 172.21.15.1:0/727878785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70740aa040 0x7f70740c1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:27.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.863+0000 7f707bb1f700 1 --2- 172.21.15.1:0/727878785 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f707414b350 0x7f7074142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:27.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.863+0000 7f707bb1f700 1 -- 172.21.15.1:0/727878785 >> 172.21.15.1:0/727878785 conn(0x7f7074069ee0 msgr2=0x7f7074149770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:27.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.864+0000 7f707bb1f700 1 -- 172.21.15.1:0/727878785 shutdown_connections 2023-11-15T01:33:27.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:27.864+0000 7f707bb1f700 1 -- 172.21.15.1:0/727878785 wait complete. 2023-11-15T01:33:27.875 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-11-15T01:33:27.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:27.876 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-11-15T01:33:27.892 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:27.893 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:27.893 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:27.893 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:27.893 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:27.893 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:27.894 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:27.894 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:27.894 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:27.894 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:27.894 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:27.895 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:27.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:27.895 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_23_00_UTC) 2023-11-15T01:33:27.955 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:27.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:27.955 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_24_00_UTC) 2023-11-15T01:33:28.016 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:28.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:28.016 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_25_00_UTC) 2023-11-15T01:33:28.077 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:28.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:28.078 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_26_00_UTC) 2023-11-15T01:33:28.137 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:28.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:28.138 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_27_00_UTC) 2023-11-15T01:33:28.198 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:28.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:28.199 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_28_00_UTC) 2023-11-15T01:33:28.258 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:28.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:28.259 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_29_00_UTC) 2023-11-15T01:33:28.319 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:28.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:28.320 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_30_00_UTC) 2023-11-15T01:33:28.380 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:28.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:28.381 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_31_00_UTC) 2023-11-15T01:33:28.440 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:28.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:28.441 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_32_00_UTC) 2023-11-15T01:33:28.502 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:28.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:28.503 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-11-15-01_33_00_UTC) 2023-11-15T01:33:28.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:28.563 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-11-15T01:33:28.621 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-11-15T01:33:28.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.784+0000 7fe0adada700 1 Processor -- start 2023-11-15T01:33:28.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.784+0000 7fe0adada700 1 -- start start 2023-11-15T01:33:28.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.785+0000 7fe0adada700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe0a8155790 0x7fe0a80a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:28.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.785+0000 7fe0adada700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe0a80a6190 0x7fe0a80c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:28.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.785+0000 7fe0adada700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0a80833a0 0x7fe0a80c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:28.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.785+0000 7fe0adada700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a8066210 con 0x7fe0a8155790 2023-11-15T01:33:28.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.785+0000 7fe0adada700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a80c7ae0 con 0x7fe0a80a6190 2023-11-15T01:33:28.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.785+0000 7fe0adada700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80c49c0 con 0x7fe0a80833a0 2023-11-15T01:33:28.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.785+0000 7fe0a77fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe0a8155790 0x7fe0a80a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:28.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.785+0000 7fe0a77fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe0a8155790 0x7fe0a80a5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59926/0 (socket says 172.21.15.1:59926) 2023-11-15T01:33:28.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.785+0000 7fe0a77fe700 1 -- 172.21.15.1:0/2520154593 learned_addr learned my addr 172.21.15.1:0/2520154593 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:28.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.785+0000 7fe0a6ffd700 1 --2- 172.21.15.1:0/2520154593 >> v2:172.21.15.141:3300/0 conn(0x7fe0a80a6190 0x7fe0a80c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:28.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.785+0000 7fe0a7fff700 1 --2- 172.21.15.1:0/2520154593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0a80833a0 0x7fe0a80c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:28.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0a77fe700 1 -- 172.21.15.1:0/2520154593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0a80833a0 msgr2=0x7fe0a80c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:28.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0a77fe700 1 --2- 172.21.15.1:0/2520154593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0a80833a0 0x7fe0a80c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:28.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0a77fe700 1 -- 172.21.15.1:0/2520154593 >> v2:172.21.15.141:3300/0 conn(0x7fe0a80a6190 msgr2=0x7fe0a80c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:28.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0a77fe700 1 --2- 172.21.15.1:0/2520154593 >> v2:172.21.15.141:3300/0 conn(0x7fe0a80a6190 0x7fe0a80c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:28.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0a77fe700 1 -- 172.21.15.1:0/2520154593 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a80c77b0 con 0x7fe0a8155790 2023-11-15T01:33:28.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0a7fff700 1 --2- 172.21.15.1:0/2520154593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0a80833a0 0x7fe0a80c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:28.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0a77fe700 1 --2- 172.21.15.1:0/2520154593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0a8155790 0x7fe0a80a5ca0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fe0a80692b0 tx=0x7fe098009060).ready entity=mon.0 client_cookie=b241fb91cad1323e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:28.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0a67fc700 1 -- 172.21.15.1:0/2520154593 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098005880 con 0x7fe0a8155790 2023-11-15T01:33:28.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0a67fc700 1 -- 172.21.15.1:0/2520154593 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0980059e0 con 0x7fe0a8155790 2023-11-15T01:33:28.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0a67fc700 1 -- 172.21.15.1:0/2520154593 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098005d60 con 0x7fe0a8155790 2023-11-15T01:33:28.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0adada700 1 -- 172.21.15.1:0/2520154593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0a8155790 msgr2=0x7fe0a80a5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:28.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0adada700 1 --2- 172.21.15.1:0/2520154593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0a8155790 0x7fe0a80a5ca0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fe0a80692b0 tx=0x7fe098009060).stop 2023-11-15T01:33:28.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0adada700 1 -- 172.21.15.1:0/2520154593 shutdown_connections 2023-11-15T01:33:28.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0adada700 1 --2- 172.21.15.1:0/2520154593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0a8155790 0x7fe0a80a5ca0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:28.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0adada700 1 --2- 172.21.15.1:0/2520154593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0a80833a0 0x7fe0a80c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:28.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0adada700 1 --2- 172.21.15.1:0/2520154593 >> v2:172.21.15.141:3300/0 conn(0x7fe0a80a6190 0x7fe0a80c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:28.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.786+0000 7fe0adada700 1 -- 172.21.15.1:0/2520154593 >> 172.21.15.1:0/2520154593 conn(0x7fe0a8082f90 msgr2=0x7fe0a80c8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:28.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.787+0000 7fe0adada700 1 -- 172.21.15.1:0/2520154593 shutdown_connections 2023-11-15T01:33:28.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.787+0000 7fe0adada700 1 -- 172.21.15.1:0/2520154593 wait complete. 2023-11-15T01:33:28.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.788+0000 7fe0adada700 1 Processor -- start 2023-11-15T01:33:28.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.788+0000 7fe0adada700 1 -- start start 2023-11-15T01:33:28.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0adada700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0a80833a0 0x7fe0a81517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:28.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0adada700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0a80a6190 0x7fe0a8094130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:28.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0adada700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0a8155790 0x7fe0a80ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:28.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0adada700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a8093090 con 0x7fe0a80a6190 2023-11-15T01:33:28.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0adada700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a8093370 con 0x7fe0a8155790 2023-11-15T01:33:28.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0adada700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a8093650 con 0x7fe0a80833a0 2023-11-15T01:33:28.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0a6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0a80a6190 0x7fe0a8094130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:28.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0a6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0a80a6190 0x7fe0a8094130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59938/0 (socket says 172.21.15.1:59938) 2023-11-15T01:33:28.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0a6ffd700 1 -- 172.21.15.1:0/3536010752 learned_addr learned my addr 172.21.15.1:0/3536010752 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:28.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0a7fff700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0a8155790 0x7fe0a80ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:28.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0a77fe700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0a80833a0 0x7fe0a81517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:28.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0a6ffd700 1 -- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0a80833a0 msgr2=0x7fe0a81517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:28.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0a6ffd700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0a80833a0 0x7fe0a81517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:28.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0a6ffd700 1 -- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0a8155790 msgr2=0x7fe0a80ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:28.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0a6ffd700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0a8155790 0x7fe0a80ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:28.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0a6ffd700 1 -- 172.21.15.1:0/3536010752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098009300 con 0x7fe0a80a6190 2023-11-15T01:33:28.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0a7fff700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0a8155790 0x7fe0a80ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:28.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0a77fe700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0a80833a0 0x7fe0a81517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:28.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0a6ffd700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0a80a6190 0x7fe0a8094130 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fe09c00e900 tx=0x7fe09c006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:28.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe08f7fe700 1 -- 172.21.15.1:0/3536010752 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c00c640 con 0x7fe0a80a6190 2023-11-15T01:33:28.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe08f7fe700 1 -- 172.21.15.1:0/3536010752 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c00c7a0 con 0x7fe0a80a6190 2023-11-15T01:33:28.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0adada700 1 -- 172.21.15.1:0/3536010752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a8093930 con 0x7fe0a80a6190 2023-11-15T01:33:28.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe08f7fe700 1 -- 172.21.15.1:0/3536010752 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c00cb20 con 0x7fe0a80a6190 2023-11-15T01:33:28.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.789+0000 7fe0adada700 1 -- 172.21.15.1:0/3536010752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a8092cd0 con 0x7fe0a80a6190 2023-11-15T01:33:28.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.790+0000 7fe0adada700 1 -- 172.21.15.1:0/3536010752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a806c7e0 con 0x7fe0a80a6190 2023-11-15T01:33:28.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.791+0000 7fe08f7fe700 1 -- 172.21.15.1:0/3536010752 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fe09c01b400 con 0x7fe0a80a6190 2023-11-15T01:33:28.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.791+0000 7fe08f7fe700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe09405f290 0x7fe094061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:28.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.791+0000 7fe08f7fe700 1 -- 172.21.15.1:0/3536010752 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fe09c07a8f0 con 0x7fe0a80a6190 2023-11-15T01:33:28.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.791+0000 7fe0a77fe700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe09405f290 0x7fe094061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:28.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.792+0000 7fe0a77fe700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe09405f290 0x7fe094061750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fe09800b340 tx=0x7fe098016000).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:28.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.795+0000 7fe08f7fe700 1 -- 172.21.15.1:0/3536010752 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe09c04b910 con 0x7fe0a80a6190 2023-11-15T01:33:28.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.994+0000 7fe0adada700 1 -- 172.21.15.1:0/3536010752 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0a805f8b0 con 0x7fe09405f290 2023-11-15T01:33:28.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:28.998+0000 7fe08f7fe700 1 -- 172.21.15.1:0/3536010752 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fe0a805f8b0 con 0x7fe09405f290 2023-11-15T01:33:28.999 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-11-15T01:33:29.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.000+0000 7fe0adada700 1 -- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe09405f290 msgr2=0x7fe094061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:29.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.000+0000 7fe0adada700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe09405f290 0x7fe094061750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fe09800b340 tx=0x7fe098016000).stop 2023-11-15T01:33:29.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.000+0000 7fe0adada700 1 -- 172.21.15.1:0/3536010752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0a80a6190 msgr2=0x7fe0a8094130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:29.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.000+0000 7fe0adada700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0a80a6190 0x7fe0a8094130 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fe09c00e900 tx=0x7fe09c006f40).stop 2023-11-15T01:33:29.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.000+0000 7fe0adada700 1 -- 172.21.15.1:0/3536010752 shutdown_connections 2023-11-15T01:33:29.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.000+0000 7fe0adada700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe09405f290 0x7fe094061750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:29.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.000+0000 7fe0adada700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0a8155790 0x7fe0a80ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:29.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.000+0000 7fe0adada700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0a80833a0 0x7fe0a81517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:29.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.000+0000 7fe0adada700 1 --2- 172.21.15.1:0/3536010752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0a80a6190 0x7fe0a8094130 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:29.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.000+0000 7fe0adada700 1 -- 172.21.15.1:0/3536010752 >> 172.21.15.1:0/3536010752 conn(0x7fe0a8082f90 msgr2=0x7fe0a8066b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:29.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.000+0000 7fe0adada700 1 -- 172.21.15.1:0/3536010752 shutdown_connections 2023-11-15T01:33:29.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.000+0000 7fe0adada700 1 -- 172.21.15.1:0/3536010752 wait complete. 2023-11-15T01:33:29.012 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-11-15T01:33:29.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:29.013 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-11-15T01:33:29.030 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:29.030 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:29.030 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:29.030 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:29.031 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:29.031 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:29.031 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:29.031 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:29.031 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:29.032 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:29.032 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:29.032 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:29.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:29.033 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_23_00_UTC) 2023-11-15T01:33:29.091 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:29.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:29.092 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_24_00_UTC) 2023-11-15T01:33:29.152 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:29.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:29.153 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_25_00_UTC) 2023-11-15T01:33:29.212 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:29.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:29.213 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_26_00_UTC) 2023-11-15T01:33:29.273 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:29.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:29.274 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_27_00_UTC) 2023-11-15T01:33:29.334 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:29.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:29.335 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_28_00_UTC) 2023-11-15T01:33:29.396 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:29.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:29.397 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_29_00_UTC) 2023-11-15T01:33:29.456 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:29.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:29.457 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_30_00_UTC) 2023-11-15T01:33:29.517 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:29.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:29.518 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_31_00_UTC) 2023-11-15T01:33:29.578 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:29.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:29.579 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_32_00_UTC) 2023-11-15T01:33:29.639 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:29.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:29.640 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-11-15-01_33_00_UTC) 2023-11-15T01:33:29.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:29.701 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-11-15T01:33:29.759 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-11-15T01:33:29.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.920+0000 7f977887b700 1 Processor -- start 2023-11-15T01:33:29.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.920+0000 7f977887b700 1 -- start start 2023-11-15T01:33:29.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.921+0000 7f977887b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9774157660 0x7f9774157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:29.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.921+0000 7f977887b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97740c1cb0 0x7f97740c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:29.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.921+0000 7f977887b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f97740c6770 0x7f97740aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:29.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.921+0000 7f977887b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97740c7540 con 0x7f97740c6770 2023-11-15T01:33:29.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.921+0000 7f977887b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97740c1820 con 0x7f9774157660 2023-11-15T01:33:29.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.921+0000 7f977887b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97740c0c30 con 0x7f97740c1cb0 2023-11-15T01:33:29.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.921+0000 7f9772d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f97740c6770 0x7f97740aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:29.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.921+0000 7f9772d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f97740c6770 0x7f97740aa060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59950/0 (socket says 172.21.15.1:59950) 2023-11-15T01:33:29.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.921+0000 7f9772d9d700 1 -- 172.21.15.1:0/1103100785 learned_addr learned my addr 172.21.15.1:0/1103100785 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:29.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.922+0000 7f977259c700 1 --2- 172.21.15.1:0/1103100785 >> v2:172.21.15.141:3300/0 conn(0x7f9774157660 0x7f9774157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:29.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.922+0000 7f9771d9b700 1 --2- 172.21.15.1:0/1103100785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97740c1cb0 0x7f97740c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:29.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.922+0000 7f9772d9d700 1 -- 172.21.15.1:0/1103100785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97740c1cb0 msgr2=0x7f97740c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:29.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.922+0000 7f9772d9d700 1 --2- 172.21.15.1:0/1103100785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97740c1cb0 0x7f97740c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:29.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.922+0000 7f9772d9d700 1 -- 172.21.15.1:0/1103100785 >> v2:172.21.15.141:3300/0 conn(0x7f9774157660 msgr2=0x7f9774157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:29.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.922+0000 7f9772d9d700 1 --2- 172.21.15.1:0/1103100785 >> v2:172.21.15.141:3300/0 conn(0x7f9774157660 0x7f9774157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:29.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.922+0000 7f9772d9d700 1 -- 172.21.15.1:0/1103100785 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97740c0ef0 con 0x7f97740c6770 2023-11-15T01:33:29.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.922+0000 7f9772d9d700 1 --2- 172.21.15.1:0/1103100785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97740c6770 0x7f97740aa060 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f97740cc160 tx=0x7f9764009840).ready entity=mon.0 client_cookie=36275e884cc1e7ce server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:29.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.922+0000 7f977159a700 1 -- 172.21.15.1:0/1103100785 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976400e070 con 0x7f97740c6770 2023-11-15T01:33:29.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.922+0000 7f977159a700 1 -- 172.21.15.1:0/1103100785 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976400ba50 con 0x7f97740c6770 2023-11-15T01:33:29.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.922+0000 7f977159a700 1 -- 172.21.15.1:0/1103100785 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976400bdd0 con 0x7f97740c6770 2023-11-15T01:33:29.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.923+0000 7f977887b700 1 -- 172.21.15.1:0/1103100785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97740c6770 msgr2=0x7f97740aa060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:29.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.923+0000 7f977887b700 1 --2- 172.21.15.1:0/1103100785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97740c6770 0x7f97740aa060 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f97740cc160 tx=0x7f9764009840).stop 2023-11-15T01:33:29.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.923+0000 7f977887b700 1 -- 172.21.15.1:0/1103100785 shutdown_connections 2023-11-15T01:33:29.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.923+0000 7f977887b700 1 --2- 172.21.15.1:0/1103100785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97740c6770 0x7f97740aa060 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:29.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.923+0000 7f977887b700 1 --2- 172.21.15.1:0/1103100785 >> v2:172.21.15.141:3300/0 conn(0x7f9774157660 0x7f9774157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:29.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.923+0000 7f977887b700 1 --2- 172.21.15.1:0/1103100785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97740c1cb0 0x7f97740c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:29.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.923+0000 7f977887b700 1 -- 172.21.15.1:0/1103100785 >> 172.21.15.1:0/1103100785 conn(0x7f9774064aa0 msgr2=0x7f9774064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:29.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.923+0000 7f977887b700 1 -- 172.21.15.1:0/1103100785 shutdown_connections 2023-11-15T01:33:29.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.923+0000 7f977887b700 1 -- 172.21.15.1:0/1103100785 wait complete. 2023-11-15T01:33:29.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.924+0000 7f977887b700 1 Processor -- start 2023-11-15T01:33:29.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.924+0000 7f977887b700 1 -- start start 2023-11-15T01:33:29.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f977887b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97740c1cb0 0x7f97740b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:29.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f977887b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97740c6770 0x7f9774151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:29.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f977887b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9774157660 0x7f97740af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:29.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f977887b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97740c3cf0 con 0x7f9774157660 2023-11-15T01:33:29.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f977887b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97740ae850 con 0x7f97740c1cb0 2023-11-15T01:33:29.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f977887b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97740c3a10 con 0x7f97740c6770 2023-11-15T01:33:29.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f9772d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9774157660 0x7f97740af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:29.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f9772d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9774157660 0x7f97740af8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59952/0 (socket says 172.21.15.1:59952) 2023-11-15T01:33:29.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f9772d9d700 1 -- 172.21.15.1:0/1710906906 learned_addr learned my addr 172.21.15.1:0/1710906906 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:29.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f977259c700 1 --2- 172.21.15.1:0/1710906906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97740c1cb0 0x7f97740b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:29.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f9771d9b700 1 --2- 172.21.15.1:0/1710906906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97740c6770 0x7f9774151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:29.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f9772d9d700 1 -- 172.21.15.1:0/1710906906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97740c6770 msgr2=0x7f9774151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:29.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f9772d9d700 1 --2- 172.21.15.1:0/1710906906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97740c6770 0x7f9774151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:29.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f9772d9d700 1 -- 172.21.15.1:0/1710906906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97740c1cb0 msgr2=0x7f97740b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:29.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f9772d9d700 1 --2- 172.21.15.1:0/1710906906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97740c1cb0 0x7f97740b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:29.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f9772d9d700 1 -- 172.21.15.1:0/1710906906 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9764009ae0 con 0x7f9774157660 2023-11-15T01:33:29.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f9772d9d700 1 --2- 172.21.15.1:0/1710906906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9774157660 0x7f97740af8d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f9764009fd0 tx=0x7f9764009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:29.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f976a7fc700 1 -- 172.21.15.1:0/1710906906 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640092e0 con 0x7f9774157660 2023-11-15T01:33:29.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f976a7fc700 1 -- 172.21.15.1:0/1710906906 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764007080 con 0x7f9774157660 2023-11-15T01:33:29.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f977887b700 1 -- 172.21.15.1:0/1710906906 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97740ae200 con 0x7f9774157660 2023-11-15T01:33:29.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f976a7fc700 1 -- 172.21.15.1:0/1710906906 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976401e6a0 con 0x7f9774157660 2023-11-15T01:33:29.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.925+0000 7f977887b700 1 -- 172.21.15.1:0/1710906906 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9774152160 con 0x7f9774157660 2023-11-15T01:33:29.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.927+0000 7f977887b700 1 -- 172.21.15.1:0/1710906906 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97740ae9c0 con 0x7f9774157660 2023-11-15T01:33:29.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.927+0000 7f976a7fc700 1 -- 172.21.15.1:0/1710906906 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f9764003040 con 0x7f9774157660 2023-11-15T01:33:29.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.927+0000 7f976a7fc700 1 --2- 172.21.15.1:0/1710906906 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f975405f290 0x7f9754061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:29.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.927+0000 7f976a7fc700 1 -- 172.21.15.1:0/1710906906 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f976407b850 con 0x7f9774157660 2023-11-15T01:33:29.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.927+0000 7f977259c700 1 --2- 172.21.15.1:0/1710906906 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f975405f290 0x7f9754061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:29.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.928+0000 7f977259c700 1 --2- 172.21.15.1:0/1710906906 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f975405f290 0x7f9754061750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f977415a5e0 tx=0x7f976c008040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:29.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:29.931+0000 7f976a7fc700 1 -- 172.21.15.1:0/1710906906 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f976404c980 con 0x7f9774157660 2023-11-15T01:33:30.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:30.131+0000 7f977887b700 1 -- 172.21.15.1:0/1710906906 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f977406c7e0 con 0x7f975405f290 2023-11-15T01:33:30.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:30.135+0000 7f976a7fc700 1 -- 172.21.15.1:0/1710906906 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f977406c7e0 con 0x7f975405f290 2023-11-15T01:33:30.135 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-11-15T01:33:30.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:30.137+0000 7f977887b700 1 -- 172.21.15.1:0/1710906906 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f975405f290 msgr2=0x7f9754061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:30.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:30.137+0000 7f977887b700 1 --2- 172.21.15.1:0/1710906906 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f975405f290 0x7f9754061750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f977415a5e0 tx=0x7f976c008040).stop 2023-11-15T01:33:30.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:30.137+0000 7f977887b700 1 -- 172.21.15.1:0/1710906906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9774157660 msgr2=0x7f97740af8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:30.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:30.137+0000 7f977887b700 1 --2- 172.21.15.1:0/1710906906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9774157660 0x7f97740af8d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f9764009fd0 tx=0x7f9764009840).stop 2023-11-15T01:33:30.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:30.137+0000 7f977887b700 1 -- 172.21.15.1:0/1710906906 shutdown_connections 2023-11-15T01:33:30.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:30.137+0000 7f977887b700 1 --2- 172.21.15.1:0/1710906906 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f975405f290 0x7f9754061750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:30.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:30.137+0000 7f977887b700 1 --2- 172.21.15.1:0/1710906906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9774157660 0x7f97740af8d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:30.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:30.137+0000 7f977887b700 1 --2- 172.21.15.1:0/1710906906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97740c1cb0 0x7f97740b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:30.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:30.137+0000 7f977887b700 1 --2- 172.21.15.1:0/1710906906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97740c6770 0x7f9774151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:30.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:30.137+0000 7f977887b700 1 -- 172.21.15.1:0/1710906906 >> 172.21.15.1:0/1710906906 conn(0x7f9774064aa0 msgr2=0x7f97740abf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:30.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:30.137+0000 7f977887b700 1 -- 172.21.15.1:0/1710906906 shutdown_connections 2023-11-15T01:33:30.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:30.137+0000 7f977887b700 1 -- 172.21.15.1:0/1710906906 wait complete. 2023-11-15T01:33:30.149 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-11-15T01:33:30.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:30.150 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-11-15T01:33:30.166 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:30.167 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:30.167 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:30.167 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:30.167 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:30.168 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:30.168 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:30.168 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:30.168 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:30.168 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:30.168 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:30.169 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:30.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:30.170 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_23_00_UTC) 2023-11-15T01:33:30.229 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:30.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:30.230 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_24_00_UTC) 2023-11-15T01:33:30.291 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:30.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:30.292 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_25_00_UTC) 2023-11-15T01:33:30.352 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:30.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:30.353 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_26_00_UTC) 2023-11-15T01:33:30.413 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:30.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:30.414 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_27_00_UTC) 2023-11-15T01:33:30.474 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:30.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:30.474 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_28_00_UTC) 2023-11-15T01:33:30.535 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:30.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:30.536 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_29_00_UTC) 2023-11-15T01:33:30.596 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:30.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:30.596 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_30_00_UTC) 2023-11-15T01:33:30.658 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:30.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:30.659 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_31_00_UTC) 2023-11-15T01:33:30.720 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:30.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:30.721 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_32_00_UTC) 2023-11-15T01:33:30.781 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:30.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:30.782 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-11-15-01_33_00_UTC) 2023-11-15T01:33:30.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:30.842 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-11-15T01:33:30.902 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-11-15T01:33:31.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.065+0000 7fc9d5ea9700 1 Processor -- start 2023-11-15T01:33:31.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.065+0000 7fc9d5ea9700 1 -- start start 2023-11-15T01:33:31.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.066+0000 7fc9d5ea9700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc9d0153aa0 0x7fc9d00c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:31.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.066+0000 7fc9d5ea9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9d0153e80 0x7fc9d0069d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:31.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.066+0000 7fc9d5ea9700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d00c6160 con 0x7fc9d006a200 2023-11-15T01:33:31.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.066+0000 7fc9d5ea9700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d00c5550 con 0x7fc9d0153aa0 2023-11-15T01:33:31.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.066+0000 7fc9d5ea9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00c5830 con 0x7fc9d0153e80 2023-11-15T01:33:31.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.066+0000 7fc9cf7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc9d0153aa0 0x7fc9d00c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:31.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.066+0000 7fc9cf7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc9d0153aa0 0x7fc9d00c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59958/0 (socket says 172.21.15.1:59958) 2023-11-15T01:33:31.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.066+0000 7fc9cf7fe700 1 -- 172.21.15.1:0/2141721248 learned_addr learned my addr 172.21.15.1:0/2141721248 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:31.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.066+0000 7fc9ceffd700 1 --2- 172.21.15.1:0/2141721248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9d0153e80 0x7fc9d0069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:31.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.066+0000 7fc9cf7fe700 1 -- 172.21.15.1:0/2141721248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9d0153e80 msgr2=0x7fc9d0069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:31.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.066+0000 7fc9cf7fe700 1 --2- 172.21.15.1:0/2141721248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9d0153e80 0x7fc9d0069d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:31.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.066+0000 7fc9cf7fe700 1 -- 172.21.15.1:0/2141721248 >> v1:172.21.15.141:6789/0 conn(0x7fc9d006a200 legacy=0x7fc9d00c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:31.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.067+0000 7fc9cf7fe700 1 -- 172.21.15.1:0/2141721248 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d00c5b10 con 0x7fc9d0153aa0 2023-11-15T01:33:31.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.067+0000 7fc9cf7fe700 1 --2- 172.21.15.1:0/2141721248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d0153aa0 0x7fc9d00c65f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fc9c0006fd0 tx=0x7fc9c00090f0).ready entity=mon.0 client_cookie=322b6d76b9924029 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:31.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.067+0000 7fc9ce7fc700 1 -- 172.21.15.1:0/2141721248 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000b600 con 0x7fc9d0153aa0 2023-11-15T01:33:31.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.067+0000 7fc9ce7fc700 1 -- 172.21.15.1:0/2141721248 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c000b760 con 0x7fc9d0153aa0 2023-11-15T01:33:31.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.067+0000 7fc9ce7fc700 1 -- 172.21.15.1:0/2141721248 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000bae0 con 0x7fc9d0153aa0 2023-11-15T01:33:31.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.067+0000 7fc9d5ea9700 1 -- 172.21.15.1:0/2141721248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d0153aa0 msgr2=0x7fc9d00c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:31.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.067+0000 7fc9d5ea9700 1 --2- 172.21.15.1:0/2141721248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d0153aa0 0x7fc9d00c65f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fc9c0006fd0 tx=0x7fc9c00090f0).stop 2023-11-15T01:33:31.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.067+0000 7fc9d5ea9700 1 -- 172.21.15.1:0/2141721248 shutdown_connections 2023-11-15T01:33:31.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.067+0000 7fc9d5ea9700 1 --2- 172.21.15.1:0/2141721248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d0153aa0 0x7fc9d00c65f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:31.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.067+0000 7fc9d5ea9700 1 --2- 172.21.15.1:0/2141721248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9d0153e80 0x7fc9d0069d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:31.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.067+0000 7fc9d5ea9700 1 -- 172.21.15.1:0/2141721248 >> 172.21.15.1:0/2141721248 conn(0x7fc9d0063280 msgr2=0x7fc9d00c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.067+0000 7fc9d5ea9700 1 -- 172.21.15.1:0/2141721248 shutdown_connections 2023-11-15T01:33:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.067+0000 7fc9d5ea9700 1 -- 172.21.15.1:0/2141721248 wait complete. 2023-11-15T01:33:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.069+0000 7fc9d5ea9700 1 Processor -- start 2023-11-15T01:33:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.069+0000 7fc9d5ea9700 1 -- start start 2023-11-15T01:33:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.069+0000 7fc9d5ea9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9d006a200 0x7fc9d00ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.069+0000 7fc9d5ea9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9d0153aa0 0x7fc9d00a66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.069+0000 7fc9d5ea9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d0153e80 0x7fc9d00c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.069+0000 7fc9d5ea9700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00a86f0 con 0x7fc9d0153e80 2023-11-15T01:33:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.069+0000 7fc9d5ea9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d0164a00 con 0x7fc9d006a200 2023-11-15T01:33:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.069+0000 7fc9d5ea9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00a9e60 con 0x7fc9d0153aa0 2023-11-15T01:33:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9cffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d0153e80 0x7fc9d00c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9ceffd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9d0153aa0 0x7fc9d00a66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9cffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d0153e80 0x7fc9d00c04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59968/0 (socket says 172.21.15.1:59968) 2023-11-15T01:33:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9cffff700 1 -- 172.21.15.1:0/2740685173 learned_addr learned my addr 172.21.15.1:0/2740685173 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9ceffd700 1 --2- 172.21.15.1:0/2740685173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9d0153aa0 0x7fc9d00a66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:56844/0 (socket says 172.21.15.1:56844) 2023-11-15T01:33:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9cf7fe700 1 --2- 172.21.15.1:0/2740685173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9d006a200 0x7fc9d00ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:31.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9cffff700 1 -- 172.21.15.1:0/2740685173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9d0153aa0 msgr2=0x7fc9d00a66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:31.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9cffff700 1 --2- 172.21.15.1:0/2740685173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9d0153aa0 0x7fc9d00a66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:31.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9cffff700 1 -- 172.21.15.1:0/2740685173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9d006a200 msgr2=0x7fc9d00ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:31.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9cffff700 1 --2- 172.21.15.1:0/2740685173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9d006a200 0x7fc9d00ac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:31.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9cffff700 1 -- 172.21.15.1:0/2740685173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0009370 con 0x7fc9d0153e80 2023-11-15T01:33:31.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9cffff700 1 --2- 172.21.15.1:0/2740685173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d0153e80 0x7fc9d00c04e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fc9c8002230 tx=0x7fc9c80015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:31.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9b77fe700 1 -- 172.21.15.1:0/2740685173 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800e4a0 con 0x7fc9d0153e80 2023-11-15T01:33:31.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9b77fe700 1 -- 172.21.15.1:0/2740685173 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c800e600 con 0x7fc9d0153e80 2023-11-15T01:33:31.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9d5ea9700 1 -- 172.21.15.1:0/2740685173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d00a7b70 con 0x7fc9d0153e80 2023-11-15T01:33:31.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9b77fe700 1 -- 172.21.15.1:0/2740685173 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800e980 con 0x7fc9d0153e80 2023-11-15T01:33:31.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.070+0000 7fc9d5ea9700 1 -- 172.21.15.1:0/2740685173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d00a8130 con 0x7fc9d0153e80 2023-11-15T01:33:31.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.071+0000 7fc9d5ea9700 1 -- 172.21.15.1:0/2740685173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d0164b70 con 0x7fc9d0153e80 2023-11-15T01:33:31.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.072+0000 7fc9b77fe700 1 -- 172.21.15.1:0/2740685173 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fc9c800ed30 con 0x7fc9d0153e80 2023-11-15T01:33:31.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.072+0000 7fc9b77fe700 1 --2- 172.21.15.1:0/2740685173 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9bc05f2c0 0x7fc9bc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:31.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.072+0000 7fc9b77fe700 1 -- 172.21.15.1:0/2740685173 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fc9c8079a70 con 0x7fc9d0153e80 2023-11-15T01:33:31.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.072+0000 7fc9cf7fe700 1 --2- 172.21.15.1:0/2740685173 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9bc05f2c0 0x7fc9bc061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:31.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.073+0000 7fc9cf7fe700 1 --2- 172.21.15.1:0/2740685173 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9bc05f2c0 0x7fc9bc061780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fc9c0009130 tx=0x7fc9c0017000).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:31.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.076+0000 7fc9b77fe700 1 -- 172.21.15.1:0/2740685173 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc9c8048af0 con 0x7fc9d0153e80 2023-11-15T01:33:31.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.352+0000 7fc9d5ea9700 1 -- 172.21.15.1:0/2740685173 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9d006c7e0 con 0x7fc9bc05f2c0 2023-11-15T01:33:31.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.356+0000 7fc9b77fe700 1 -- 172.21.15.1:0/2740685173 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fc9d006c7e0 con 0x7fc9bc05f2c0 2023-11-15T01:33:31.356 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-11-15T01:33:31.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.358+0000 7fc9d5ea9700 1 -- 172.21.15.1:0/2740685173 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9bc05f2c0 msgr2=0x7fc9bc061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:31.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.358+0000 7fc9d5ea9700 1 --2- 172.21.15.1:0/2740685173 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9bc05f2c0 0x7fc9bc061780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fc9c0009130 tx=0x7fc9c0017000).stop 2023-11-15T01:33:31.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.358+0000 7fc9d5ea9700 1 -- 172.21.15.1:0/2740685173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d0153e80 msgr2=0x7fc9d00c04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:31.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.358+0000 7fc9d5ea9700 1 --2- 172.21.15.1:0/2740685173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d0153e80 0x7fc9d00c04e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fc9c8002230 tx=0x7fc9c80015e0).stop 2023-11-15T01:33:31.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.358+0000 7fc9d5ea9700 1 -- 172.21.15.1:0/2740685173 shutdown_connections 2023-11-15T01:33:31.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.358+0000 7fc9d5ea9700 1 --2- 172.21.15.1:0/2740685173 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9bc05f2c0 0x7fc9bc061780 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:31.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.358+0000 7fc9d5ea9700 1 --2- 172.21.15.1:0/2740685173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d0153e80 0x7fc9d00c04e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:31.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.358+0000 7fc9d5ea9700 1 --2- 172.21.15.1:0/2740685173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9d006a200 0x7fc9d00ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:31.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.358+0000 7fc9d5ea9700 1 --2- 172.21.15.1:0/2740685173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9d0153aa0 0x7fc9d00a66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:31.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.358+0000 7fc9d5ea9700 1 -- 172.21.15.1:0/2740685173 >> 172.21.15.1:0/2740685173 conn(0x7fc9d0063280 msgr2=0x7fc9d00c1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:31.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.358+0000 7fc9d5ea9700 1 -- 172.21.15.1:0/2740685173 shutdown_connections 2023-11-15T01:33:31.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:31.358+0000 7fc9d5ea9700 1 -- 172.21.15.1:0/2740685173 wait complete. 2023-11-15T01:33:31.370 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-11-15T01:33:31.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:31.372 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-11-15T01:33:31.389 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:31.390 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:31.390 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:31.391 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:31.391 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:31.392 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:31.392 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:31.392 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:31.393 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:31.393 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:31.393 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:31.394 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:31.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:31.395 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_23_00_UTC) 2023-11-15T01:33:31.456 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:31.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:31.457 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_24_00_UTC) 2023-11-15T01:33:31.526 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:31.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:31.527 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_25_00_UTC) 2023-11-15T01:33:31.586 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:31.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:31.587 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_26_00_UTC) 2023-11-15T01:33:31.647 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:31.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:31.648 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_27_00_UTC) 2023-11-15T01:33:31.708 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:31.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:31.708 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_28_00_UTC) 2023-11-15T01:33:31.781 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:31.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:31.782 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_29_00_UTC) 2023-11-15T01:33:31.856 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:31.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:31.857 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_30_00_UTC) 2023-11-15T01:33:31.917 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:31.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:31.919 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_31_00_UTC) 2023-11-15T01:33:31.979 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:31.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:31.980 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_32_00_UTC) 2023-11-15T01:33:32.052 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:32.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:32.053 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-11-15-01_33_00_UTC) 2023-11-15T01:33:32.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:32.126 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-11-15T01:33:32.184 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-11-15T01:33:32.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.347+0000 7f117ba80700 1 Processor -- start 2023-11-15T01:33:32.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.347+0000 7f117ba80700 1 -- start start 2023-11-15T01:33:32.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.348+0000 7f117ba80700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1174062970 0x7f1174062d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:32.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.348+0000 7f117ba80700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117406a610 con 0x7f11740c2850 2023-11-15T01:33:32.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.348+0000 7f117ba80700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1174065790 con 0x7f11740c23d0 2023-11-15T01:33:32.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.348+0000 7f117ba80700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1174065a30 con 0x7f1174062970 2023-11-15T01:33:32.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.348+0000 7f117a01d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f11740c2850 0x7f117413a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57288/0 (socket says 172.21.15.1:57288) 2023-11-15T01:33:32.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.348+0000 7f117a01d700 1 -- 172.21.15.1:0/3435133638 learned_addr learned my addr 172.21.15.1:0/3435133638 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:32.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.348+0000 7f117981c700 1 --2- 172.21.15.1:0/3435133638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1174062970 0x7f1174062d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:32.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.348+0000 7f117881a700 1 -- 172.21.15.1:0/3435133638 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064378770 0 0) 0x7f117406a610 con 0x7f11740c2850 2023-11-15T01:33:32.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.349+0000 7f117881a700 1 -- 172.21.15.1:0/3435133638 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f115c0033f0 con 0x7f11740c2850 2023-11-15T01:33:32.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.349+0000 7f117881a700 1 -- 172.21.15.1:0/3435133638 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522842268 0 0) 0x7f1174065790 con 0x7f11740c23d0 2023-11-15T01:33:32.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.349+0000 7f117881a700 1 -- 172.21.15.1:0/3435133638 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f117406a610 con 0x7f11740c23d0 2023-11-15T01:33:32.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.349+0000 7f117981c700 1 -- 172.21.15.1:0/3435133638 >> v1:172.21.15.141:6789/0 conn(0x7f11740c23d0 legacy=0x7f11740c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:32.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.349+0000 7f117981c700 1 -- 172.21.15.1:0/3435133638 >> v1:172.21.15.1:6789/0 conn(0x7f11740c2850 legacy=0x7f117413a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:32.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.349+0000 7f117981c700 1 -- 172.21.15.1:0/3435133638 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1174065d10 con 0x7f1174062970 2023-11-15T01:33:32.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.349+0000 7f117981c700 1 --2- 172.21.15.1:0/3435133638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1174062970 0x7f1174062d50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f116c009e90 tx=0x7f116c009780).ready entity=mon.2 client_cookie=eeee6b4c91d6f0d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:32.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.349+0000 7f117881a700 1 -- 172.21.15.1:0/3435133638 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c00e070 con 0x7f1174062970 2023-11-15T01:33:32.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.349+0000 7f117881a700 1 -- 172.21.15.1:0/3435133638 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c00bab0 con 0x7f1174062970 2023-11-15T01:33:32.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.349+0000 7f117881a700 1 -- 172.21.15.1:0/3435133638 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c00be30 con 0x7f1174062970 2023-11-15T01:33:32.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.350+0000 7f117ba80700 1 -- 172.21.15.1:0/3435133638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1174062970 msgr2=0x7f1174062d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:32.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.350+0000 7f117ba80700 1 --2- 172.21.15.1:0/3435133638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1174062970 0x7f1174062d50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f116c009e90 tx=0x7f116c009780).stop 2023-11-15T01:33:32.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.350+0000 7f117ba80700 1 -- 172.21.15.1:0/3435133638 shutdown_connections 2023-11-15T01:33:32.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.350+0000 7f117ba80700 1 --2- 172.21.15.1:0/3435133638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1174062970 0x7f1174062d50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:32.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.350+0000 7f117ba80700 1 -- 172.21.15.1:0/3435133638 >> 172.21.15.1:0/3435133638 conn(0x7f11740c7dd0 msgr2=0x7f11740c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:32.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.350+0000 7f117ba80700 1 -- 172.21.15.1:0/3435133638 shutdown_connections 2023-11-15T01:33:32.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.350+0000 7f117ba80700 1 -- 172.21.15.1:0/3435133638 wait complete. 2023-11-15T01:33:32.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.351+0000 7f117ba80700 1 Processor -- start 2023-11-15T01:33:32.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.351+0000 7f117ba80700 1 -- start start 2023-11-15T01:33:32.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.351+0000 7f117ba80700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1174062970 0x7f1174146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:32.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.351+0000 7f117ba80700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11740c23d0 0x7f1174157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:32.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.351+0000 7f117ba80700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11740c2850 0x7f1174157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:32.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.351+0000 7f117ba80700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11740c0b50 con 0x7f11740c23d0 2023-11-15T01:33:32.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f117ba80700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1174146fd0 con 0x7f1174062970 2023-11-15T01:33:32.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f117ba80700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1174158200 con 0x7f11740c2850 2023-11-15T01:33:32.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f117901b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11740c23d0 0x7f1174157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:32.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f117901b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11740c23d0 0x7f1174157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59984/0 (socket says 172.21.15.1:59984) 2023-11-15T01:33:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f117901b700 1 -- 172.21.15.1:0/2125808676 learned_addr learned my addr 172.21.15.1:0/2125808676 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f117981c700 1 --2- 172.21.15.1:0/2125808676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1174062970 0x7f1174146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f117a01d700 1 --2- 172.21.15.1:0/2125808676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11740c2850 0x7f1174157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:32.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f117901b700 1 -- 172.21.15.1:0/2125808676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11740c2850 msgr2=0x7f1174157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:32.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f117901b700 1 --2- 172.21.15.1:0/2125808676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11740c2850 0x7f1174157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:32.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f117901b700 1 -- 172.21.15.1:0/2125808676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1174062970 msgr2=0x7f1174146ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:32.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f117901b700 1 --2- 172.21.15.1:0/2125808676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1174062970 0x7f1174146ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:32.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f117901b700 1 -- 172.21.15.1:0/2125808676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c009a20 con 0x7f11740c23d0 2023-11-15T01:33:32.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f117901b700 1 --2- 172.21.15.1:0/2125808676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11740c23d0 0x7f1174157650 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f116800c4c0 tx=0x7f1168007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:32.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f1171ffb700 1 -- 172.21.15.1:0/2125808676 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116800ce10 con 0x7f11740c23d0 2023-11-15T01:33:32.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f1171ffb700 1 -- 172.21.15.1:0/2125808676 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116800f470 con 0x7f11740c23d0 2023-11-15T01:33:32.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f117ba80700 1 -- 172.21.15.1:0/2125808676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11741584e0 con 0x7f11740c23d0 2023-11-15T01:33:32.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.352+0000 7f1171ffb700 1 -- 172.21.15.1:0/2125808676 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116800f830 con 0x7f11740c23d0 2023-11-15T01:33:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.353+0000 7f117ba80700 1 -- 172.21.15.1:0/2125808676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1174164730 con 0x7f11740c23d0 2023-11-15T01:33:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.354+0000 7f117ba80700 1 -- 172.21.15.1:0/2125808676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1174164950 con 0x7f11740c23d0 2023-11-15T01:33:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.354+0000 7f1171ffb700 1 -- 172.21.15.1:0/2125808676 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f116800fc20 con 0x7f11740c23d0 2023-11-15T01:33:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.354+0000 7f1171ffb700 1 --2- 172.21.15.1:0/2125808676 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f116005f2c0 0x7f1160061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.354+0000 7f1171ffb700 1 -- 172.21.15.1:0/2125808676 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6906+0+0 (secure 0 0 0) 0x7f1168079ab0 con 0x7f11740c23d0 2023-11-15T01:33:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.354+0000 7f117981c700 1 --2- 172.21.15.1:0/2125808676 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f116005f2c0 0x7f1160061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.355+0000 7f117981c700 1 --2- 172.21.15.1:0/2125808676 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f116005f2c0 0x7f1160061780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f116c009460 tx=0x7f117406a7a0).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.358+0000 7f1171ffb700 1 -- 172.21.15.1:0/2125808676 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1168048af0 con 0x7f11740c23d0 2023-11-15T01:33:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.558+0000 7f117ba80700 1 -- 172.21.15.1:0/2125808676 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1174164560 con 0x7f116005f2c0 2023-11-15T01:33:32.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.563+0000 7f1171ffb700 1 -- 172.21.15.1:0/2125808676 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f1174164560 con 0x7f116005f2c0 2023-11-15T01:33:32.563 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-11-15T01:33:32.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.564+0000 7f117ba80700 1 -- 172.21.15.1:0/2125808676 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f116005f2c0 msgr2=0x7f1160061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:32.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.565+0000 7f117ba80700 1 --2- 172.21.15.1:0/2125808676 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f116005f2c0 0x7f1160061780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f116c009460 tx=0x7f117406a7a0).stop 2023-11-15T01:33:32.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.565+0000 7f117ba80700 1 -- 172.21.15.1:0/2125808676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11740c23d0 msgr2=0x7f1174157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:32.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.565+0000 7f117ba80700 1 --2- 172.21.15.1:0/2125808676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11740c23d0 0x7f1174157650 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f116800c4c0 tx=0x7f1168007c10).stop 2023-11-15T01:33:32.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.565+0000 7f117ba80700 1 -- 172.21.15.1:0/2125808676 shutdown_connections 2023-11-15T01:33:32.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.565+0000 7f117ba80700 1 --2- 172.21.15.1:0/2125808676 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f116005f2c0 0x7f1160061780 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:32.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.565+0000 7f117ba80700 1 --2- 172.21.15.1:0/2125808676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11740c2850 0x7f1174157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:32.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.565+0000 7f117ba80700 1 --2- 172.21.15.1:0/2125808676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1174062970 0x7f1174146ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:32.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.565+0000 7f117ba80700 1 --2- 172.21.15.1:0/2125808676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11740c23d0 0x7f1174157650 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:32.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.565+0000 7f117ba80700 1 -- 172.21.15.1:0/2125808676 >> 172.21.15.1:0/2125808676 conn(0x7f11740c7dd0 msgr2=0x7f11740c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:32.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.565+0000 7f117ba80700 1 -- 172.21.15.1:0/2125808676 shutdown_connections 2023-11-15T01:33:32.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:32.565+0000 7f117ba80700 1 -- 172.21.15.1:0/2125808676 wait complete. 2023-11-15T01:33:32.577 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-11-15T01:33:32.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:32.577 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-11-15T01:33:32.594 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:32.595 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:32.595 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:32.595 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:32.595 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:32.596 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:32.596 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:32.596 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:32.596 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:32.596 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:32.597 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:32.597 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:32.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:32.598 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_23_00_UTC) 2023-11-15T01:33:32.660 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:32.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:32.661 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_24_00_UTC) 2023-11-15T01:33:32.721 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:32.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:32.722 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_25_00_UTC) 2023-11-15T01:33:32.782 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:32.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:32.783 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_26_00_UTC) 2023-11-15T01:33:32.843 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:32.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:32.844 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_27_00_UTC) 2023-11-15T01:33:32.904 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:32.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:32.905 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_28_00_UTC) 2023-11-15T01:33:32.965 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:32.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:32.966 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_29_00_UTC) 2023-11-15T01:33:33.026 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:33.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:33.027 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_30_00_UTC) 2023-11-15T01:33:33.088 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:33.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:33.089 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_31_00_UTC) 2023-11-15T01:33:33.164 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:33.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:33.165 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_32_00_UTC) 2023-11-15T01:33:33.226 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:33.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:33.227 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-11-15-01_33_00_UTC) 2023-11-15T01:33:33.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:33.288 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-11-15T01:33:33.345 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-11-15T01:33:33.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.519+0000 7f6fdef50700 1 Processor -- start 2023-11-15T01:33:33.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.519+0000 7f6fdef50700 1 -- start start 2023-11-15T01:33:33.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdef50700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6fd81521a0 0x7f6fd8152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:33.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdef50700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fd80bcd20 0x7f6fd80aa130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:33.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdef50700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6fd80aa620 0x7f6fd80627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:33.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdef50700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd8156e70 con 0x7f6fd81521a0 2023-11-15T01:33:33.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdef50700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd8156260 con 0x7f6fd80aa620 2023-11-15T01:33:33.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdef50700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd8156540 con 0x7f6fd80bcd20 2023-11-15T01:33:33.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdccec700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6fd81521a0 0x7f6fd8152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:33.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdccec700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6fd81521a0 0x7f6fd8152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59996/0 (socket says 172.21.15.1:59996) 2023-11-15T01:33:33.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdccec700 1 -- 172.21.15.1:0/2557061495 learned_addr learned my addr 172.21.15.1:0/2557061495 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:33.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdd4ed700 1 --2- 172.21.15.1:0/2557061495 >> v2:172.21.15.141:3300/0 conn(0x7f6fd80aa620 0x7f6fd80627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:33.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fd7fff700 1 --2- 172.21.15.1:0/2557061495 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fd80bcd20 0x7f6fd80aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:33.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdccec700 1 -- 172.21.15.1:0/2557061495 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fd80bcd20 msgr2=0x7f6fd80aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:33.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdccec700 1 --2- 172.21.15.1:0/2557061495 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fd80bcd20 0x7f6fd80aa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:33.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdccec700 1 -- 172.21.15.1:0/2557061495 >> v2:172.21.15.141:3300/0 conn(0x7f6fd80aa620 msgr2=0x7f6fd80627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:33.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdccec700 1 --2- 172.21.15.1:0/2557061495 >> v2:172.21.15.141:3300/0 conn(0x7f6fd80aa620 0x7f6fd80627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:33.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdccec700 1 -- 172.21.15.1:0/2557061495 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd8156820 con 0x7f6fd81521a0 2023-11-15T01:33:33.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdd4ed700 1 --2- 172.21.15.1:0/2557061495 >> v2:172.21.15.141:3300/0 conn(0x7f6fd80aa620 0x7f6fd80627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:33.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.520+0000 7f6fdccec700 1 --2- 172.21.15.1:0/2557061495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd81521a0 0x7f6fd8152580 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f6fd806c390 tx=0x7f6fd0009840).ready entity=mon.0 client_cookie=a6f06686c5f72ece server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:33.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.521+0000 7f6fd77fe700 1 -- 172.21.15.1:0/2557061495 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd000e070 con 0x7f6fd81521a0 2023-11-15T01:33:33.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.521+0000 7f6fd77fe700 1 -- 172.21.15.1:0/2557061495 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd000ba50 con 0x7f6fd81521a0 2023-11-15T01:33:33.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.521+0000 7f6fd77fe700 1 -- 172.21.15.1:0/2557061495 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd000bdd0 con 0x7f6fd81521a0 2023-11-15T01:33:33.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.521+0000 7f6fdef50700 1 -- 172.21.15.1:0/2557061495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd81521a0 msgr2=0x7f6fd8152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:33.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.521+0000 7f6fdef50700 1 --2- 172.21.15.1:0/2557061495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd81521a0 0x7f6fd8152580 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f6fd806c390 tx=0x7f6fd0009840).stop 2023-11-15T01:33:33.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.521+0000 7f6fdef50700 1 -- 172.21.15.1:0/2557061495 shutdown_connections 2023-11-15T01:33:33.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.521+0000 7f6fdef50700 1 --2- 172.21.15.1:0/2557061495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd81521a0 0x7f6fd8152580 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:33.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.521+0000 7f6fdef50700 1 --2- 172.21.15.1:0/2557061495 >> v2:172.21.15.141:3300/0 conn(0x7f6fd80aa620 0x7f6fd80627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:33.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.521+0000 7f6fdef50700 1 --2- 172.21.15.1:0/2557061495 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fd80bcd20 0x7f6fd80aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:33.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.521+0000 7f6fdef50700 1 -- 172.21.15.1:0/2557061495 >> 172.21.15.1:0/2557061495 conn(0x7f6fd80c7dc0 msgr2=0x7f6fd80c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:33.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.521+0000 7f6fdef50700 1 -- 172.21.15.1:0/2557061495 shutdown_connections 2023-11-15T01:33:33.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.521+0000 7f6fdef50700 1 -- 172.21.15.1:0/2557061495 wait complete. 2023-11-15T01:33:33.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.522+0000 7f6fdef50700 1 Processor -- start 2023-11-15T01:33:33.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.522+0000 7f6fdef50700 1 -- start start 2023-11-15T01:33:33.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.523+0000 7f6fdef50700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fd80aa620 0x7f6fd80bf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:33.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.523+0000 7f6fdef50700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fd80bcd20 0x7f6fd80c1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:33.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.523+0000 7f6fdef50700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd81521a0 0x7f6fd80aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:33.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.523+0000 7f6fdef50700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80bfe40 con 0x7f6fd81521a0 2023-11-15T01:33:33.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.523+0000 7f6fdef50700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd8148c10 con 0x7f6fd80bcd20 2023-11-15T01:33:33.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.523+0000 7f6fdef50700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd81494b0 con 0x7f6fd80aa620 2023-11-15T01:33:33.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.523+0000 7f6fdd4ed700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd81521a0 0x7f6fd80aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:33.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.523+0000 7f6fdd4ed700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd81521a0 0x7f6fd80aad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60000/0 (socket says 172.21.15.1:60000) 2023-11-15T01:33:33.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.523+0000 7f6fdd4ed700 1 -- 172.21.15.1:0/2117160432 learned_addr learned my addr 172.21.15.1:0/2117160432 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:33.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.523+0000 7f6fd7fff700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fd80bcd20 0x7f6fd80c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:33.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.523+0000 7f6fdccec700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fd80aa620 0x7f6fd80bf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:33.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.524+0000 7f6fdd4ed700 1 -- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fd80aa620 msgr2=0x7f6fd80bf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:33.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.524+0000 7f6fdd4ed700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fd80aa620 0x7f6fd80bf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:33.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.524+0000 7f6fdd4ed700 1 -- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fd80bcd20 msgr2=0x7f6fd80c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:33.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.524+0000 7f6fdd4ed700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fd80bcd20 0x7f6fd80c1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:33.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.524+0000 7f6fdd4ed700 1 -- 172.21.15.1:0/2117160432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd0009ae0 con 0x7f6fd81521a0 2023-11-15T01:33:33.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.524+0000 7f6fd7fff700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fd80bcd20 0x7f6fd80c1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:33.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.524+0000 7f6fdccec700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fd80aa620 0x7f6fd80bf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:33.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.524+0000 7f6fdd4ed700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd81521a0 0x7f6fd80aad50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f6fc800d860 tx=0x7f6fc8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:33.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.524+0000 7f6fd4ff9700 1 -- 172.21.15.1:0/2117160432 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc80125f0 con 0x7f6fd81521a0 2023-11-15T01:33:33.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.524+0000 7f6fd4ff9700 1 -- 172.21.15.1:0/2117160432 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc8012750 con 0x7f6fd81521a0 2023-11-15T01:33:33.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.524+0000 7f6fd4ff9700 1 -- 172.21.15.1:0/2117160432 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8012af0 con 0x7f6fd81521a0 2023-11-15T01:33:33.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.524+0000 7f6fdef50700 1 -- 172.21.15.1:0/2117160432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd80c1850 con 0x7f6fd81521a0 2023-11-15T01:33:33.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.524+0000 7f6fdef50700 1 -- 172.21.15.1:0/2117160432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd80c1ad0 con 0x7f6fd81521a0 2023-11-15T01:33:33.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.525+0000 7f6fdef50700 1 -- 172.21.15.1:0/2117160432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd806c7e0 con 0x7f6fd81521a0 2023-11-15T01:33:33.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.525+0000 7f6fd4ff9700 1 -- 172.21.15.1:0/2117160432 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f6fc8013480 con 0x7f6fd81521a0 2023-11-15T01:33:33.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.525+0000 7f6fd4ff9700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6fc405f2c0 0x7f6fc4061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:33.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.526+0000 7f6fd4ff9700 1 -- 172.21.15.1:0/2117160432 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 7018+0+0 (secure 0 0 0) 0x7f6fc807a5b0 con 0x7f6fd81521a0 2023-11-15T01:33:33.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.526+0000 7f6fdccec700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6fc405f2c0 0x7f6fc4061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:33.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.526+0000 7f6fdccec700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6fc405f2c0 0x7f6fc4061780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6fd806c390 tx=0x7f6fd0009840).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:33.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.530+0000 7f6fd4ff9700 1 -- 172.21.15.1:0/2117160432 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6fc804b320 con 0x7f6fd81521a0 2023-11-15T01:33:33.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.727+0000 7f6fdef50700 1 -- 172.21.15.1:0/2117160432 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fd8149660 con 0x7f6fc405f2c0 2023-11-15T01:33:33.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.731+0000 7f6fd4ff9700 1 -- 172.21.15.1:0/2117160432 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f6fd8149660 con 0x7f6fc405f2c0 2023-11-15T01:33:33.731 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-11-15T01:33:33.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.733+0000 7f6fdef50700 1 -- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6fc405f2c0 msgr2=0x7f6fc4061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:33.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.733+0000 7f6fdef50700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6fc405f2c0 0x7f6fc4061780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6fd806c390 tx=0x7f6fd0009840).stop 2023-11-15T01:33:33.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.733+0000 7f6fdef50700 1 -- 172.21.15.1:0/2117160432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd81521a0 msgr2=0x7f6fd80aad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:33.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.733+0000 7f6fdef50700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd81521a0 0x7f6fd80aad50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f6fc800d860 tx=0x7f6fc8008040).stop 2023-11-15T01:33:33.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.733+0000 7f6fdef50700 1 -- 172.21.15.1:0/2117160432 shutdown_connections 2023-11-15T01:33:33.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.733+0000 7f6fdef50700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6fc405f2c0 0x7f6fc4061780 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:33.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.733+0000 7f6fdef50700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd81521a0 0x7f6fd80aad50 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:33.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.733+0000 7f6fdef50700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fd80aa620 0x7f6fd80bf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:33.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.733+0000 7f6fdef50700 1 --2- 172.21.15.1:0/2117160432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fd80bcd20 0x7f6fd80c1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:33.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.733+0000 7f6fdef50700 1 -- 172.21.15.1:0/2117160432 >> 172.21.15.1:0/2117160432 conn(0x7f6fd80c7dc0 msgr2=0x7f6fd80c2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:33.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.733+0000 7f6fdef50700 1 -- 172.21.15.1:0/2117160432 shutdown_connections 2023-11-15T01:33:33.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:33.733+0000 7f6fdef50700 1 -- 172.21.15.1:0/2117160432 wait complete. 2023-11-15T01:33:33.745 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-11-15T01:33:33.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:33.746 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-11-15T01:33:33.762 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:33.762 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:33.763 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:33.763 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:33.763 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:33.763 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:33.763 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:33.764 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:33.764 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:33.764 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:33.764 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:33.764 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:33.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:33.765 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_23_00_UTC) 2023-11-15T01:33:33.825 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:33.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:33.826 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_24_00_UTC) 2023-11-15T01:33:33.886 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:33.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:33.886 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_25_00_UTC) 2023-11-15T01:33:33.947 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:33.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:33.947 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_26_00_UTC) 2023-11-15T01:33:34.009 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:34.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:34.010 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_27_00_UTC) 2023-11-15T01:33:34.073 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:34.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:34.074 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_28_00_UTC) 2023-11-15T01:33:34.158 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:34.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:34.159 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_29_00_UTC) 2023-11-15T01:33:34.219 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:34.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:34.220 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_30_00_UTC) 2023-11-15T01:33:34.280 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:34.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:34.281 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_31_00_UTC) 2023-11-15T01:33:34.342 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:34.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:34.343 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_32_00_UTC) 2023-11-15T01:33:34.405 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:34.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:34.406 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-11-15-01_33_00_UTC) 2023-11-15T01:33:34.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:34.470 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-11-15T01:33:34.529 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-11-15T01:33:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.692+0000 7efff8e5b700 1 Processor -- start 2023-11-15T01:33:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.692+0000 7efff8e5b700 1 -- start start 2023-11-15T01:33:34.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.692+0000 7efff8e5b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efff40c1cb0 0x7efff4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:34.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff8e5b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efff40aa060 0x7efff40aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:34.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff8e5b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff40c1820 con 0x7efff4157660 2023-11-15T01:33:34.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff8e5b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff40c7540 con 0x7efff40aa060 2023-11-15T01:33:34.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff8e5b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff40aa9e0 con 0x7efff40c1cb0 2023-11-15T01:33:34.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff259c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7efff4157660 0x7efff40c6280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57296/0 (socket says 172.21.15.1:57296) 2023-11-15T01:33:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff259c700 1 -- 172.21.15.1:0/599575136 learned_addr learned my addr 172.21.15.1:0/599575136 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 -- 172.21.15.1:0/599575136 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92903671 0 0) 0x7efff40c1820 con 0x7efff4157660 2023-11-15T01:33:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff1d9b700 1 --2- 172.21.15.1:0/599575136 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efff40c1cb0 0x7efff4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 -- 172.21.15.1:0/599575136 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe00033f0 con 0x7efff4157660 2023-11-15T01:33:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff2d9d700 1 --2- 172.21.15.1:0/599575136 >> v2:172.21.15.141:3300/0 conn(0x7efff40aa060 0x7efff40aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 -- 172.21.15.1:0/599575136 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1022523304 0 0) 0x7effe00033f0 con 0x7efff4157660 2023-11-15T01:33:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 -- 172.21.15.1:0/599575136 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efff40c1cb0 msgr2=0x7efff4157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 --2- 172.21.15.1:0/599575136 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efff40c1cb0 0x7efff4157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 -- 172.21.15.1:0/599575136 >> v2:172.21.15.141:3300/0 conn(0x7efff40aa060 msgr2=0x7efff40aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 --2- 172.21.15.1:0/599575136 >> v2:172.21.15.141:3300/0 conn(0x7efff40aa060 0x7efff40aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 -- 172.21.15.1:0/599575136 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff40c0c30 con 0x7efff4157660 2023-11-15T01:33:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 -- 172.21.15.1:0/599575136 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7effec001470 con 0x7efff4157660 2023-11-15T01:33:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 -- 172.21.15.1:0/599575136 >> v1:172.21.15.1:6789/0 conn(0x7efff4157660 legacy=0x7efff40c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 --2- 172.21.15.1:0/599575136 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe00038e0 0x7effe0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 --2- 172.21.15.1:0/599575136 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7effe0004690 0x7effe0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 --2- 172.21.15.1:0/599575136 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efff40c1cb0 0x7effe0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 -- 172.21.15.1:0/599575136 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff40aa9e0 con 0x7effe00038e0 2023-11-15T01:33:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 -- 172.21.15.1:0/599575136 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe000b8e0 con 0x7effe0004690 2023-11-15T01:33:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff159a700 1 -- 172.21.15.1:0/599575136 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe000ba20 con 0x7efff40c1cb0 2023-11-15T01:33:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.693+0000 7efff259c700 1 --2- 172.21.15.1:0/599575136 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe00038e0 0x7effe0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:34.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.694+0000 7efff1d9b700 1 --2- 172.21.15.1:0/599575136 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7effe0004690 0x7effe0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:34.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.694+0000 7efff2d9d700 1 --2- 172.21.15.1:0/599575136 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efff40c1cb0 0x7effe0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:34.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.694+0000 7efff259c700 1 -- 172.21.15.1:0/599575136 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efff40c1cb0 msgr2=0x7effe0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:34.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.694+0000 7efff259c700 1 --2- 172.21.15.1:0/599575136 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efff40c1cb0 0x7effe0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:34.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.694+0000 7efff259c700 1 -- 172.21.15.1:0/599575136 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7effe0004690 msgr2=0x7effe0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:34.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.694+0000 7efff259c700 1 --2- 172.21.15.1:0/599575136 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7effe0004690 0x7effe0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:34.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.694+0000 7efff259c700 1 -- 172.21.15.1:0/599575136 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe00033f0 con 0x7effe00038e0 2023-11-15T01:33:34.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.694+0000 7efff259c700 1 --2- 172.21.15.1:0/599575136 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe00038e0 0x7effe0003d00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7effec00c210 tx=0x7effec001e90).ready entity=mon.0 client_cookie=1b3c922ede50ac2d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:34.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.694+0000 7efff159a700 1 -- 172.21.15.1:0/599575136 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec007a60 con 0x7effe00038e0 2023-11-15T01:33:34.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.694+0000 7efff159a700 1 -- 172.21.15.1:0/599575136 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec00cae0 con 0x7effe00038e0 2023-11-15T01:33:34.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.694+0000 7efff159a700 1 -- 172.21.15.1:0/599575136 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec00ce60 con 0x7effe00038e0 2023-11-15T01:33:34.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.695+0000 7efff8e5b700 1 -- 172.21.15.1:0/599575136 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe00038e0 msgr2=0x7effe0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:34.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.695+0000 7efff8e5b700 1 --2- 172.21.15.1:0/599575136 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe00038e0 0x7effe0003d00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7effec00c210 tx=0x7effec001e90).stop 2023-11-15T01:33:34.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.695+0000 7efff2d9d700 1 -- 172.21.15.1:0/599575136 reap_dead start 2023-11-15T01:33:34.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.695+0000 7efff8e5b700 1 -- 172.21.15.1:0/599575136 shutdown_connections 2023-11-15T01:33:34.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.695+0000 7efff8e5b700 1 -- 172.21.15.1:0/599575136 >> 172.21.15.1:0/599575136 conn(0x7efff4064aa0 msgr2=0x7efff4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:34.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.695+0000 7efff8e5b700 1 -- 172.21.15.1:0/599575136 shutdown_connections 2023-11-15T01:33:34.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.695+0000 7efff8e5b700 1 -- 172.21.15.1:0/599575136 wait complete. 2023-11-15T01:33:34.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.696+0000 7efff8e5b700 1 Processor -- start 2023-11-15T01:33:34.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.696+0000 7efff8e5b700 1 -- start start 2023-11-15T01:33:34.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff8e5b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe00038e0 0x7efff40c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:34.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff8e5b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efff40c31f0 0x7efff413fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:34.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff8e5b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efff40c4ae0 0x7efff4157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:34.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff8e5b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff40c4650 con 0x7effe00038e0 2023-11-15T01:33:34.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff8e5b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff40c3a40 con 0x7efff40c31f0 2023-11-15T01:33:34.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff8e5b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff40c3d20 con 0x7efff40c4ae0 2023-11-15T01:33:34.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe00038e0 0x7efff40c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:34.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe00038e0 0x7efff40c2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60020/0 (socket says 172.21.15.1:60020) 2023-11-15T01:33:34.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff259c700 1 -- 172.21.15.1:0/211258684 learned_addr learned my addr 172.21.15.1:0/211258684 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:34.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff1d9b700 1 --2- 172.21.15.1:0/211258684 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efff40c31f0 0x7efff413fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:34.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff2d9d700 1 --2- 172.21.15.1:0/211258684 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efff40c4ae0 0x7efff4157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:34.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff259c700 1 -- 172.21.15.1:0/211258684 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efff40c4ae0 msgr2=0x7efff4157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:34.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff259c700 1 --2- 172.21.15.1:0/211258684 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efff40c4ae0 0x7efff4157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:34.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff259c700 1 -- 172.21.15.1:0/211258684 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efff40c31f0 msgr2=0x7efff413fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:34.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff259c700 1 --2- 172.21.15.1:0/211258684 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efff40c31f0 0x7efff413fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:34.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff259c700 1 -- 172.21.15.1:0/211258684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff40c4000 con 0x7effe00038e0 2023-11-15T01:33:34.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff259c700 1 --2- 172.21.15.1:0/211258684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe00038e0 0x7efff40c2c90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7effec001120 tx=0x7effec015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:34.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7effea7fc700 1 -- 172.21.15.1:0/211258684 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec0075c0 con 0x7effe00038e0 2023-11-15T01:33:34.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7effea7fc700 1 -- 172.21.15.1:0/211258684 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec007720 con 0x7effe00038e0 2023-11-15T01:33:34.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff8e5b700 1 -- 172.21.15.1:0/211258684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff40c42e0 con 0x7effe00038e0 2023-11-15T01:33:34.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7effea7fc700 1 -- 172.21.15.1:0/211258684 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec004900 con 0x7effe00038e0 2023-11-15T01:33:34.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.697+0000 7efff8e5b700 1 -- 172.21.15.1:0/211258684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff40c3670 con 0x7effe00038e0 2023-11-15T01:33:34.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.698+0000 7efff8e5b700 1 -- 172.21.15.1:0/211258684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff40c4930 con 0x7effe00038e0 2023-11-15T01:33:34.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.699+0000 7effea7fc700 1 -- 172.21.15.1:0/211258684 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7effec004c70 con 0x7effe00038e0 2023-11-15T01:33:34.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.699+0000 7effea7fc700 1 --2- 172.21.15.1:0/211258684 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7effd405f2f0 0x7effd40617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:34.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.699+0000 7effea7fc700 1 -- 172.21.15.1:0/211258684 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7034+0+0 (secure 0 0 0) 0x7effec07b8d0 con 0x7effe00038e0 2023-11-15T01:33:34.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.699+0000 7efff1d9b700 1 --2- 172.21.15.1:0/211258684 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7effd405f2f0 0x7effd40617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:34.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.700+0000 7efff1d9b700 1 --2- 172.21.15.1:0/211258684 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7effd405f2f0 0x7effd40617b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7efff40c5360 tx=0x7effdc009060).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:34.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.703+0000 7effea7fc700 1 -- 172.21.15.1:0/211258684 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7effec04c690 con 0x7effe00038e0 2023-11-15T01:33:34.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.902+0000 7efff8e5b700 1 -- 172.21.15.1:0/211258684 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efff40c4790 con 0x7effd405f2f0 2023-11-15T01:33:34.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.906+0000 7effea7fc700 1 -- 172.21.15.1:0/211258684 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7effdc019070 con 0x7effd405f2f0 2023-11-15T01:33:34.906 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-11-15T01:33:34.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.908+0000 7efff8e5b700 1 -- 172.21.15.1:0/211258684 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7effd405f2f0 msgr2=0x7effd40617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:34.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.908+0000 7efff8e5b700 1 --2- 172.21.15.1:0/211258684 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7effd405f2f0 0x7effd40617b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7efff40c5360 tx=0x7effdc009060).stop 2023-11-15T01:33:34.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.908+0000 7efff8e5b700 1 -- 172.21.15.1:0/211258684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe00038e0 msgr2=0x7efff40c2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:34.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.908+0000 7efff8e5b700 1 --2- 172.21.15.1:0/211258684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe00038e0 0x7efff40c2c90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7effec001120 tx=0x7effec015000).stop 2023-11-15T01:33:34.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.908+0000 7efff8e5b700 1 -- 172.21.15.1:0/211258684 shutdown_connections 2023-11-15T01:33:34.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.908+0000 7efff8e5b700 1 --2- 172.21.15.1:0/211258684 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7effd405f2f0 0x7effd40617b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:34.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.908+0000 7efff8e5b700 1 --2- 172.21.15.1:0/211258684 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efff40c4ae0 0x7efff4157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:34.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.908+0000 7efff8e5b700 1 --2- 172.21.15.1:0/211258684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe00038e0 0x7efff40c2c90 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:34.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.908+0000 7efff8e5b700 1 --2- 172.21.15.1:0/211258684 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efff40c31f0 0x7efff413fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:34.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.908+0000 7efff8e5b700 1 -- 172.21.15.1:0/211258684 >> 172.21.15.1:0/211258684 conn(0x7efff4064aa0 msgr2=0x7efff4155870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:34.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.908+0000 7efff8e5b700 1 -- 172.21.15.1:0/211258684 shutdown_connections 2023-11-15T01:33:34.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:34.908+0000 7efff8e5b700 1 -- 172.21.15.1:0/211258684 wait complete. 2023-11-15T01:33:34.920 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-11-15T01:33:34.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:34.921 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-11-15T01:33:34.937 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:34.938 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:34.938 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:34.938 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:34.938 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:34.939 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:34.939 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:34.939 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:34.939 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:34.939 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:34.940 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:34.940 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:34.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:34.941 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_23_00_UTC) 2023-11-15T01:33:35.001 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:35.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:35.002 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_24_00_UTC) 2023-11-15T01:33:35.070 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:35.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:35.071 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_25_00_UTC) 2023-11-15T01:33:35.188 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:35.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:35.189 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_26_00_UTC) 2023-11-15T01:33:35.210 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:35.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:35.211 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_27_00_UTC) 2023-11-15T01:33:35.298 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:35.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:35.298 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_28_00_UTC) 2023-11-15T01:33:35.320 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:35.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:35.321 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_29_00_UTC) 2023-11-15T01:33:35.382 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:35.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:35.383 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_30_00_UTC) 2023-11-15T01:33:35.444 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:35.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:35.445 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_31_00_UTC) 2023-11-15T01:33:35.505 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:35.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:35.506 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_32_00_UTC) 2023-11-15T01:33:35.566 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:35.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:35.567 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-11-15-01_33_00_UTC) 2023-11-15T01:33:35.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:35.628 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-11-15T01:33:35.686 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-11-15T01:33:35.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.849+0000 7fbdad6d2700 1 Processor -- start 2023-11-15T01:33:35.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.849+0000 7fbdad6d2700 1 -- start start 2023-11-15T01:33:35.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.850+0000 7fbdad6d2700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbda814b350 0x7fbda80c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:35.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.850+0000 7fbdad6d2700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda81580d0 con 0x7fbda80aa750 2023-11-15T01:33:35.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.850+0000 7fbdad6d2700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda8155000 con 0x7fbda814b730 2023-11-15T01:33:35.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.850+0000 7fbdad6d2700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda81552e0 con 0x7fbda814b350 2023-11-15T01:33:35.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.850+0000 7fbda77fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fbda80aa750 0x7fbda8158560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57304/0 (socket says 172.21.15.1:57304) 2023-11-15T01:33:35.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.850+0000 7fbda77fe700 1 -- 172.21.15.1:0/1189730074 learned_addr learned my addr 172.21.15.1:0/1189730074 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:35.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.850+0000 7fbda6ffd700 1 --2- 172.21.15.1:0/1189730074 >> v2:172.21.15.141:3300/0 conn(0x7fbda814b350 0x7fbda80c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:35.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.850+0000 7fbda5ffb700 1 -- 172.21.15.1:0/1189730074 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261842593 0 0) 0x7fbda81580d0 con 0x7fbda80aa750 2023-11-15T01:33:35.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda5ffb700 1 -- 172.21.15.1:0/1189730074 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd940033f0 con 0x7fbda80aa750 2023-11-15T01:33:35.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda5ffb700 1 -- 172.21.15.1:0/1189730074 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1909315888 0 0) 0x7fbd940033f0 con 0x7fbda80aa750 2023-11-15T01:33:35.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda5ffb700 1 -- 172.21.15.1:0/1189730074 >> v2:172.21.15.141:3300/0 conn(0x7fbda814b350 msgr2=0x7fbda80c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:35.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda5ffb700 1 --2- 172.21.15.1:0/1189730074 >> v2:172.21.15.141:3300/0 conn(0x7fbda814b350 0x7fbda80c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:35.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda5ffb700 1 -- 172.21.15.1:0/1189730074 >> v1:172.21.15.141:6789/0 conn(0x7fbda814b730 legacy=0x7fbda80aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:35.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda5ffb700 1 -- 172.21.15.1:0/1189730074 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda81555c0 con 0x7fbda80aa750 2023-11-15T01:33:35.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda5ffb700 1 -- 172.21.15.1:0/1189730074 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fbda0001470 con 0x7fbda80aa750 2023-11-15T01:33:35.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda5ffb700 1 -- 172.21.15.1:0/1189730074 >> v1:172.21.15.1:6789/0 conn(0x7fbda80aa750 legacy=0x7fbda8158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:35.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda5ffb700 1 --2- 172.21.15.1:0/1189730074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940038e0 0x7fbd94003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:35.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda5ffb700 1 --2- 172.21.15.1:0/1189730074 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd94004690 0x7fbd94004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:35.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda5ffb700 1 --2- 172.21.15.1:0/1189730074 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd94005000 0x7fbd9400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:35.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda5ffb700 1 -- 172.21.15.1:0/1189730074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda81552e0 con 0x7fbd940038e0 2023-11-15T01:33:35.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda5ffb700 1 -- 172.21.15.1:0/1189730074 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9400bf60 con 0x7fbd94004690 2023-11-15T01:33:35.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda5ffb700 1 -- 172.21.15.1:0/1189730074 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9400c0f0 con 0x7fbd94005000 2023-11-15T01:33:35.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda6ffd700 1 --2- 172.21.15.1:0/1189730074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940038e0 0x7fbd94003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:35.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda67fc700 1 --2- 172.21.15.1:0/1189730074 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd94004690 0x7fbd94004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:35.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda77fe700 1 --2- 172.21.15.1:0/1189730074 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd94005000 0x7fbd9400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:35.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda6ffd700 1 -- 172.21.15.1:0/1189730074 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd94005000 msgr2=0x7fbd9400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:35.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda6ffd700 1 --2- 172.21.15.1:0/1189730074 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd94005000 0x7fbd9400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:35.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda6ffd700 1 -- 172.21.15.1:0/1189730074 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd94004690 msgr2=0x7fbd94004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:35.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda6ffd700 1 --2- 172.21.15.1:0/1189730074 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd94004690 0x7fbd94004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:35.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda6ffd700 1 -- 172.21.15.1:0/1189730074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd940033f0 con 0x7fbd940038e0 2023-11-15T01:33:35.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda77fe700 1 -- 172.21.15.1:0/1189730074 reap_dead start 2023-11-15T01:33:35.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda67fc700 1 --2- 172.21.15.1:0/1189730074 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd94004690 0x7fbd94004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:35.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.851+0000 7fbda6ffd700 1 --2- 172.21.15.1:0/1189730074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940038e0 0x7fbd94003d00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fbd9800e210 tx=0x7fbd9800b040).ready entity=mon.0 client_cookie=8211eca0c546d8db server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:35.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.852+0000 7fbda5ffb700 1 -- 172.21.15.1:0/1189730074 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98009ac0 con 0x7fbd940038e0 2023-11-15T01:33:35.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.852+0000 7fbda5ffb700 1 -- 172.21.15.1:0/1189730074 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9800f040 con 0x7fbd940038e0 2023-11-15T01:33:35.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.852+0000 7fbda5ffb700 1 -- 172.21.15.1:0/1189730074 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9800ecd0 con 0x7fbd940038e0 2023-11-15T01:33:35.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.852+0000 7fbdad6d2700 1 -- 172.21.15.1:0/1189730074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940038e0 msgr2=0x7fbd94003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:35.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.852+0000 7fbdad6d2700 1 --2- 172.21.15.1:0/1189730074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940038e0 0x7fbd94003d00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fbd9800e210 tx=0x7fbd9800b040).stop 2023-11-15T01:33:35.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.852+0000 7fbdad6d2700 1 -- 172.21.15.1:0/1189730074 shutdown_connections 2023-11-15T01:33:35.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.852+0000 7fbdad6d2700 1 --2- 172.21.15.1:0/1189730074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940038e0 0x7fbd94003d00 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:35.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.852+0000 7fbdad6d2700 1 -- 172.21.15.1:0/1189730074 >> 172.21.15.1:0/1189730074 conn(0x7fbda8069ee0 msgr2=0x7fbda806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:35.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.852+0000 7fbdad6d2700 1 -- 172.21.15.1:0/1189730074 shutdown_connections 2023-11-15T01:33:35.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.852+0000 7fbdad6d2700 1 -- 172.21.15.1:0/1189730074 wait complete. 2023-11-15T01:33:35.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.853+0000 7fbdad6d2700 1 Processor -- start 2023-11-15T01:33:35.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.853+0000 7fbdad6d2700 1 -- start start 2023-11-15T01:33:35.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.854+0000 7fbdad6d2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940038e0 0x7fbda80b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:35.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.854+0000 7fbdad6d2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbda814de60 0x7fbda8142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:35.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.854+0000 7fbdad6d2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbda814a5d0 0x7fbda814aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:35.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.854+0000 7fbdad6d2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80b10f0 con 0x7fbd940038e0 2023-11-15T01:33:35.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.854+0000 7fbdad6d2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80ae810 con 0x7fbda814de60 2023-11-15T01:33:35.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.854+0000 7fbdad6d2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda814af40 con 0x7fbda814a5d0 2023-11-15T01:33:35.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.854+0000 7fbda6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940038e0 0x7fbda80b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:35.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.854+0000 7fbda6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940038e0 0x7fbda80b0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60038/0 (socket says 172.21.15.1:60038) 2023-11-15T01:33:35.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.854+0000 7fbda6ffd700 1 -- 172.21.15.1:0/2387710011 learned_addr learned my addr 172.21.15.1:0/2387710011 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:35.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.854+0000 7fbda77fe700 1 --2- 172.21.15.1:0/2387710011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbda814a5d0 0x7fbda814aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:35.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.854+0000 7fbda67fc700 1 --2- 172.21.15.1:0/2387710011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbda814de60 0x7fbda8142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:35.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.854+0000 7fbda6ffd700 1 -- 172.21.15.1:0/2387710011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbda814a5d0 msgr2=0x7fbda814aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:35.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.854+0000 7fbda6ffd700 1 --2- 172.21.15.1:0/2387710011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbda814a5d0 0x7fbda814aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:35.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.855+0000 7fbda6ffd700 1 -- 172.21.15.1:0/2387710011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbda814de60 msgr2=0x7fbda8142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:35.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.855+0000 7fbda6ffd700 1 --2- 172.21.15.1:0/2387710011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbda814de60 0x7fbda8142b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:35.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.855+0000 7fbda6ffd700 1 -- 172.21.15.1:0/2387710011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80b0e10 con 0x7fbd940038e0 2023-11-15T01:33:35.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.855+0000 7fbda6ffd700 1 --2- 172.21.15.1:0/2387710011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940038e0 0x7fbda80b0800 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fbd98013fb0 tx=0x7fbd9801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:35.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.855+0000 7fbd9effd700 1 -- 172.21.15.1:0/2387710011 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9800ecd0 con 0x7fbd940038e0 2023-11-15T01:33:35.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.855+0000 7fbd9effd700 1 -- 172.21.15.1:0/2387710011 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd98027420 con 0x7fbd940038e0 2023-11-15T01:33:35.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.855+0000 7fbdad6d2700 1 -- 172.21.15.1:0/2387710011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda80ae1c0 con 0x7fbd940038e0 2023-11-15T01:33:35.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.855+0000 7fbd9effd700 1 -- 172.21.15.1:0/2387710011 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd980275d0 con 0x7fbd940038e0 2023-11-15T01:33:35.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.855+0000 7fbdad6d2700 1 -- 172.21.15.1:0/2387710011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda8143040 con 0x7fbd940038e0 2023-11-15T01:33:35.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.856+0000 7fbdad6d2700 1 -- 172.21.15.1:0/2387710011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda806c7e0 con 0x7fbd940038e0 2023-11-15T01:33:35.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.856+0000 7fbd9effd700 1 -- 172.21.15.1:0/2387710011 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fbd98024020 con 0x7fbd940038e0 2023-11-15T01:33:35.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.856+0000 7fbd9effd700 1 --2- 172.21.15.1:0/2387710011 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbd8805f2c0 0x7fbd88061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:35.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.857+0000 7fbd9effd700 1 -- 172.21.15.1:0/2387710011 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7018+0+0 (secure 0 0 0) 0x7fbd9807c520 con 0x7fbd940038e0 2023-11-15T01:33:35.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.857+0000 7fbda67fc700 1 --2- 172.21.15.1:0/2387710011 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbd8805f2c0 0x7fbd88061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:35.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.857+0000 7fbda67fc700 1 --2- 172.21.15.1:0/2387710011 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbd8805f2c0 0x7fbd88061780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fbd90007a40 tx=0x7fbd90009040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:35.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:35.861+0000 7fbd9effd700 1 -- 172.21.15.1:0/2387710011 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbd9804d2f0 con 0x7fbd940038e0 2023-11-15T01:33:36.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:36.059+0000 7fbdad6d2700 1 -- 172.21.15.1:0/2387710011 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbda805f8b0 con 0x7fbd8805f2c0 2023-11-15T01:33:36.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:36.063+0000 7fbd9effd700 1 -- 172.21.15.1:0/2387710011 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fbda805f8b0 con 0x7fbd8805f2c0 2023-11-15T01:33:36.064 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-11-15T01:33:36.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:36.065+0000 7fbdad6d2700 1 -- 172.21.15.1:0/2387710011 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbd8805f2c0 msgr2=0x7fbd88061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:36.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:36.065+0000 7fbdad6d2700 1 --2- 172.21.15.1:0/2387710011 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbd8805f2c0 0x7fbd88061780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fbd90007a40 tx=0x7fbd90009040).stop 2023-11-15T01:33:36.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:36.065+0000 7fbdad6d2700 1 -- 172.21.15.1:0/2387710011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940038e0 msgr2=0x7fbda80b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:36.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:36.065+0000 7fbdad6d2700 1 --2- 172.21.15.1:0/2387710011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940038e0 0x7fbda80b0800 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fbd98013fb0 tx=0x7fbd9801a000).stop 2023-11-15T01:33:36.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:36.065+0000 7fbdad6d2700 1 -- 172.21.15.1:0/2387710011 shutdown_connections 2023-11-15T01:33:36.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:36.065+0000 7fbdad6d2700 1 --2- 172.21.15.1:0/2387710011 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbd8805f2c0 0x7fbd88061780 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:36.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:36.065+0000 7fbdad6d2700 1 --2- 172.21.15.1:0/2387710011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbda814a5d0 0x7fbda814aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:36.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:36.065+0000 7fbdad6d2700 1 --2- 172.21.15.1:0/2387710011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940038e0 0x7fbda80b0800 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:36.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:36.065+0000 7fbdad6d2700 1 --2- 172.21.15.1:0/2387710011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbda814de60 0x7fbda8142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:36.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:36.065+0000 7fbdad6d2700 1 -- 172.21.15.1:0/2387710011 >> 172.21.15.1:0/2387710011 conn(0x7fbda8069ee0 msgr2=0x7fbda80a9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:36.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:36.065+0000 7fbdad6d2700 1 -- 172.21.15.1:0/2387710011 shutdown_connections 2023-11-15T01:33:36.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:36.065+0000 7fbdad6d2700 1 -- 172.21.15.1:0/2387710011 wait complete. 2023-11-15T01:33:36.077 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-11-15T01:33:36.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:36.078 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-11-15T01:33:36.094 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:36.095 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:36.095 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:36.095 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:36.095 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:36.096 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:36.096 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:36.096 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:36.096 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:36.096 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:36.097 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:36.097 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:36.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:36.098 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_23_00_UTC) 2023-11-15T01:33:36.187 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:36.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:36.188 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_24_00_UTC) 2023-11-15T01:33:36.221 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:36.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:36.222 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_25_00_UTC) 2023-11-15T01:33:36.283 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:36.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:36.284 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_26_00_UTC) 2023-11-15T01:33:36.349 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:36.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:36.350 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_27_00_UTC) 2023-11-15T01:33:36.429 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:36.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:36.430 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_28_00_UTC) 2023-11-15T01:33:36.490 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:36.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:36.491 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_29_00_UTC) 2023-11-15T01:33:36.551 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:36.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:36.552 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_30_00_UTC) 2023-11-15T01:33:36.612 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:36.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:36.613 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_31_00_UTC) 2023-11-15T01:33:36.673 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:36.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:36.674 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_32_00_UTC) 2023-11-15T01:33:36.734 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:36.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:36.735 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-11-15-01_33_00_UTC) 2023-11-15T01:33:36.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:36.800 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-11-15T01:33:36.858 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-11-15T01:33:37.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.020+0000 7f9872f4c700 1 Processor -- start 2023-11-15T01:33:37.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.020+0000 7f9872f4c700 1 -- start start 2023-11-15T01:33:37.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9872f4c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f986c0ada30 0x7f986c0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:37.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9872f4c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f986c0c67d0 0x7f986c0aba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:37.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9872f4c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c0caee0 con 0x7f986c0ca400 2023-11-15T01:33:37.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9872f4c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c154850 con 0x7f986c0ada30 2023-11-15T01:33:37.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9872f4c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c0ca920 con 0x7f986c0c67d0 2023-11-15T01:33:37.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9871f4a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f986c0ada30 0x7f986c0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:37.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9871f4a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f986c0ada30 0x7f986c0c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60054/0 (socket says 172.21.15.1:60054) 2023-11-15T01:33:37.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9871f4a700 1 -- 172.21.15.1:0/1098271378 learned_addr learned my addr 172.21.15.1:0/1098271378 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:37.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f987274b700 1 --2- 172.21.15.1:0/1098271378 >> v2:172.21.15.141:3300/0 conn(0x7f986c0c67d0 0x7f986c0aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:37.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9871f4a700 1 -- 172.21.15.1:0/1098271378 >> v2:172.21.15.141:3300/0 conn(0x7f986c0c67d0 msgr2=0x7f986c0aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:37.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9871f4a700 1 --2- 172.21.15.1:0/1098271378 >> v2:172.21.15.141:3300/0 conn(0x7f986c0c67d0 0x7f986c0aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:37.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9871f4a700 1 -- 172.21.15.1:0/1098271378 >> v1:172.21.15.1:6789/0 conn(0x7f986c0ca400 legacy=0x7f986c0c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:37.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9871f4a700 1 -- 172.21.15.1:0/1098271378 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c0cac00 con 0x7f986c0ada30 2023-11-15T01:33:37.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9870f48700 1 -- 172.21.15.1:0/1098271378 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878619836 0 0) 0x7f986c0caee0 con 0x7f986c0ca400 2023-11-15T01:33:37.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9871f4a700 1 --2- 172.21.15.1:0/1098271378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f986c0ada30 0x7f986c0c9f10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f986c0c5dc0 tx=0x7f985c009840).ready entity=mon.0 client_cookie=3e1c5df678490fc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:37.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9870f48700 1 -- 172.21.15.1:0/1098271378 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c00e070 con 0x7f986c0ada30 2023-11-15T01:33:37.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9870f48700 1 -- 172.21.15.1:0/1098271378 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c00ba50 con 0x7f986c0ada30 2023-11-15T01:33:37.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.021+0000 7f9870f48700 1 -- 172.21.15.1:0/1098271378 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c00bdd0 con 0x7f986c0ada30 2023-11-15T01:33:37.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.022+0000 7f9872f4c700 1 -- 172.21.15.1:0/1098271378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f986c0ada30 msgr2=0x7f986c0c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:37.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.022+0000 7f9872f4c700 1 --2- 172.21.15.1:0/1098271378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f986c0ada30 0x7f986c0c9f10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f986c0c5dc0 tx=0x7f985c009840).stop 2023-11-15T01:33:37.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.022+0000 7f9872f4c700 1 -- 172.21.15.1:0/1098271378 shutdown_connections 2023-11-15T01:33:37.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.022+0000 7f9872f4c700 1 --2- 172.21.15.1:0/1098271378 >> v2:172.21.15.141:3300/0 conn(0x7f986c0c67d0 0x7f986c0aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:37.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.022+0000 7f9872f4c700 1 --2- 172.21.15.1:0/1098271378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f986c0ada30 0x7f986c0c9f10 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:37.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.022+0000 7f9872f4c700 1 -- 172.21.15.1:0/1098271378 >> 172.21.15.1:0/1098271378 conn(0x7f986c064a60 msgr2=0x7f986c064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:37.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.022+0000 7f9872f4c700 1 -- 172.21.15.1:0/1098271378 shutdown_connections 2023-11-15T01:33:37.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.022+0000 7f9872f4c700 1 -- 172.21.15.1:0/1098271378 wait complete. 2023-11-15T01:33:37.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.023+0000 7f9872f4c700 1 Processor -- start 2023-11-15T01:33:37.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.023+0000 7f9872f4c700 1 -- start start 2023-11-15T01:33:37.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f9872f4c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f986c0ada30 0x7f986c0a9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:37.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f9872f4c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f986c0c67d0 0x7f986c0aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:37.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f9872f4c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f986c0ca400 0x7f986c167d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:37.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f9872f4c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0ae1c0 con 0x7f986c0ca400 2023-11-15T01:33:37.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f9872f4c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c168850 con 0x7f986c0c67d0 2023-11-15T01:33:37.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f9872f4c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c168b30 con 0x7f986c0ada30 2023-11-15T01:33:37.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f987274b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f986c0ca400 0x7f986c167d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:37.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f987274b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f986c0ca400 0x7f986c167d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60064/0 (socket says 172.21.15.1:60064) 2023-11-15T01:33:37.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f9871f4a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f986c0ada30 0x7f986c0a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:37.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f9871749700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f986c0c67d0 0x7f986c0aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:37.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f987274b700 1 -- 172.21.15.1:0/418967892 learned_addr learned my addr 172.21.15.1:0/418967892 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:37.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f987274b700 1 -- 172.21.15.1:0/418967892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f986c0ada30 msgr2=0x7f986c0a9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:37.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f987274b700 1 --2- 172.21.15.1:0/418967892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f986c0ada30 0x7f986c0a9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:37.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f987274b700 1 -- 172.21.15.1:0/418967892 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f986c0c67d0 msgr2=0x7f986c0aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:37.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f987274b700 1 --2- 172.21.15.1:0/418967892 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f986c0c67d0 0x7f986c0aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:37.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.024+0000 7f987274b700 1 -- 172.21.15.1:0/418967892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c009ae0 con 0x7f986c0ca400 2023-11-15T01:33:37.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.025+0000 7f987274b700 1 --2- 172.21.15.1:0/418967892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f986c0ca400 0x7f986c167d90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f986400d890 tx=0x7f9864008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:37.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.025+0000 7f9869ffb700 1 -- 172.21.15.1:0/418967892 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9864011590 con 0x7f986c0ca400 2023-11-15T01:33:37.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.025+0000 7f9869ffb700 1 -- 172.21.15.1:0/418967892 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98640116f0 con 0x7f986c0ca400 2023-11-15T01:33:37.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.025+0000 7f9869ffb700 1 -- 172.21.15.1:0/418967892 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9864011a70 con 0x7f986c0ca400 2023-11-15T01:33:37.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.025+0000 7f9872f4c700 1 -- 172.21.15.1:0/418967892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c0ae410 con 0x7f986c0ca400 2023-11-15T01:33:37.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.025+0000 7f9872f4c700 1 -- 172.21.15.1:0/418967892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c0a99f0 con 0x7f986c0ca400 2023-11-15T01:33:37.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.026+0000 7f9872f4c700 1 -- 172.21.15.1:0/418967892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986c0ca240 con 0x7f986c0ca400 2023-11-15T01:33:37.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.026+0000 7f9869ffb700 1 -- 172.21.15.1:0/418967892 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f9864012420 con 0x7f986c0ca400 2023-11-15T01:33:37.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.027+0000 7f9869ffb700 1 --2- 172.21.15.1:0/418967892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f985805f2c0 0x7f9858061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:37.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.027+0000 7f9869ffb700 1 -- 172.21.15.1:0/418967892 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7018+0+0 (secure 0 0 0) 0x7f986407a070 con 0x7f986c0ca400 2023-11-15T01:33:37.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.027+0000 7f9871f4a700 1 --2- 172.21.15.1:0/418967892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f985805f2c0 0x7f9858061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:37.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.027+0000 7f9871f4a700 1 --2- 172.21.15.1:0/418967892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f985805f2c0 0x7f9858061780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f985c00ba20 tx=0x7f985c009840).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:37.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.031+0000 7f9869ffb700 1 -- 172.21.15.1:0/418967892 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f986404ae90 con 0x7f986c0ca400 2023-11-15T01:33:37.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.238+0000 7f9872f4c700 1 -- 172.21.15.1:0/418967892 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f986c0ae930 con 0x7f985805f2c0 2023-11-15T01:33:37.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.243+0000 7f9869ffb700 1 -- 172.21.15.1:0/418967892 <== mgr.4754 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f986c0ae930 con 0x7f985805f2c0 2023-11-15T01:33:37.244 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-11-15T01:33:37.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.246+0000 7f9872f4c700 1 -- 172.21.15.1:0/418967892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f985805f2c0 msgr2=0x7f9858061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:37.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.246+0000 7f9872f4c700 1 --2- 172.21.15.1:0/418967892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f985805f2c0 0x7f9858061780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f985c00ba20 tx=0x7f985c009840).stop 2023-11-15T01:33:37.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.246+0000 7f9872f4c700 1 -- 172.21.15.1:0/418967892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f986c0ca400 msgr2=0x7f986c167d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:37.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.246+0000 7f9872f4c700 1 --2- 172.21.15.1:0/418967892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f986c0ca400 0x7f986c167d90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f986400d890 tx=0x7f9864008040).stop 2023-11-15T01:33:37.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.246+0000 7f9872f4c700 1 -- 172.21.15.1:0/418967892 shutdown_connections 2023-11-15T01:33:37.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.246+0000 7f9872f4c700 1 --2- 172.21.15.1:0/418967892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f985805f2c0 0x7f9858061780 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:37.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.246+0000 7f9872f4c700 1 --2- 172.21.15.1:0/418967892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f986c0ca400 0x7f986c167d90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:37.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.246+0000 7f9872f4c700 1 --2- 172.21.15.1:0/418967892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f986c0ada30 0x7f986c0a9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:37.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.246+0000 7f9872f4c700 1 --2- 172.21.15.1:0/418967892 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f986c0c67d0 0x7f986c0aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:37.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.246+0000 7f9872f4c700 1 -- 172.21.15.1:0/418967892 >> 172.21.15.1:0/418967892 conn(0x7f986c064a60 msgr2=0x7f986c0c0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:37.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.246+0000 7f9872f4c700 1 -- 172.21.15.1:0/418967892 shutdown_connections 2023-11-15T01:33:37.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:37.246+0000 7f9872f4c700 1 -- 172.21.15.1:0/418967892 wait complete. 2023-11-15T01:33:37.258 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-11-15T01:33:37.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:37.259 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-11-15T01:33:37.275 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:37.276 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:37.276 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:37.276 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:37.276 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:37.276 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:37.277 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:37.277 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:37.277 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:37.277 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:37.278 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:37.278 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_23_00_UTC 2023-11-15T01:33:37.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:37.279 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_23_00_UTC) 2023-11-15T01:33:37.344 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_24_00_UTC 2023-11-15T01:33:37.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:37.345 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_24_00_UTC) 2023-11-15T01:33:37.405 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_25_00_UTC 2023-11-15T01:33:37.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:37.406 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_25_00_UTC) 2023-11-15T01:33:37.471 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_26_00_UTC 2023-11-15T01:33:37.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:37.472 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_26_00_UTC) 2023-11-15T01:33:37.535 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_27_00_UTC 2023-11-15T01:33:37.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:37.536 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_27_00_UTC) 2023-11-15T01:33:37.600 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_28_00_UTC 2023-11-15T01:33:37.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:37.601 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_28_00_UTC) 2023-11-15T01:33:37.662 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_29_00_UTC 2023-11-15T01:33:37.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:37.663 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_29_00_UTC) 2023-11-15T01:33:37.725 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_30_00_UTC 2023-11-15T01:33:37.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:37.726 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_30_00_UTC) 2023-11-15T01:33:37.787 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_31_00_UTC 2023-11-15T01:33:37.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:37.788 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_31_00_UTC) 2023-11-15T01:33:37.849 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_32_00_UTC 2023-11-15T01:33:37.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:37.850 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_32_00_UTC) 2023-11-15T01:33:37.911 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_33_00_UTC 2023-11-15T01:33:37.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:37.912 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-11-15-01_33_00_UTC) 2023-11-15T01:33:37.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:37.972 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-11-15T01:33:38.030 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-15T01:33:38.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.205+0000 7efe78875700 1 Processor -- start 2023-11-15T01:33:38.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.205+0000 7efe78875700 1 -- start start 2023-11-15T01:33:38.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.206+0000 7efe78875700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efe741540a0 0x7efe740ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.206+0000 7efe78875700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efe74154480 0x7efe740ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.206+0000 7efe78875700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe740ca050 con 0x7efe740c5f40 2023-11-15T01:33:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.206+0000 7efe78875700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe740c9440 con 0x7efe74154480 2023-11-15T01:33:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.206+0000 7efe78875700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe740c9720 con 0x7efe741540a0 2023-11-15T01:33:38.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.206+0000 7efe71d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efe74154480 0x7efe740ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:38.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.207+0000 7efe72d9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7efe740c5f40 0x7efe740aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44964/0 (socket says 172.21.15.1:44964) 2023-11-15T01:33:38.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.207+0000 7efe71d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efe74154480 0x7efe740ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37992/0 (socket says 172.21.15.1:37992) 2023-11-15T01:33:38.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.207+0000 7efe72d9d700 1 -- 172.21.15.1:0/1683251231 learned_addr learned my addr 172.21.15.1:0/1683251231 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:38.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.207+0000 7efe7259c700 1 --2- 172.21.15.1:0/1683251231 >> v2:172.21.15.141:3300/0 conn(0x7efe741540a0 0x7efe740ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:38.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.207+0000 7efe71d9b700 1 -- 172.21.15.1:0/1683251231 >> v2:172.21.15.141:3300/0 conn(0x7efe741540a0 msgr2=0x7efe740ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:38.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.207+0000 7efe71d9b700 1 --2- 172.21.15.1:0/1683251231 >> v2:172.21.15.141:3300/0 conn(0x7efe741540a0 0x7efe740ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:38.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.207+0000 7efe71d9b700 1 -- 172.21.15.1:0/1683251231 >> v1:172.21.15.1:6789/0 conn(0x7efe740c5f40 legacy=0x7efe740aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:38.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.207+0000 7efe71d9b700 1 -- 172.21.15.1:0/1683251231 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe740c9a00 con 0x7efe74154480 2023-11-15T01:33:38.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.207+0000 7efe7159a700 1 -- 172.21.15.1:0/1683251231 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622373563 0 0) 0x7efe740ca050 con 0x7efe740c5f40 2023-11-15T01:33:38.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.207+0000 7efe7259c700 1 --2- 172.21.15.1:0/1683251231 >> v2:172.21.15.141:3300/0 conn(0x7efe741540a0 0x7efe740ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:38.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.207+0000 7efe71d9b700 1 --2- 172.21.15.1:0/1683251231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe74154480 0x7efe740ca9d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7efe7405ff40 tx=0x7efe68009060).ready entity=mon.0 client_cookie=e2a3776f29620db2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:38.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.207+0000 7efe7159a700 1 -- 172.21.15.1:0/1683251231 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6800b580 con 0x7efe74154480 2023-11-15T01:33:38.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.207+0000 7efe7159a700 1 -- 172.21.15.1:0/1683251231 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6800b6e0 con 0x7efe74154480 2023-11-15T01:33:38.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.207+0000 7efe7159a700 1 -- 172.21.15.1:0/1683251231 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6800ba60 con 0x7efe74154480 2023-11-15T01:33:38.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.208+0000 7efe78875700 1 -- 172.21.15.1:0/1683251231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe74154480 msgr2=0x7efe740ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:38.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.208+0000 7efe78875700 1 --2- 172.21.15.1:0/1683251231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe74154480 0x7efe740ca9d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7efe7405ff40 tx=0x7efe68009060).stop 2023-11-15T01:33:38.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.208+0000 7efe78875700 1 -- 172.21.15.1:0/1683251231 shutdown_connections 2023-11-15T01:33:38.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.208+0000 7efe78875700 1 --2- 172.21.15.1:0/1683251231 >> v2:172.21.15.141:3300/0 conn(0x7efe741540a0 0x7efe740ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:38.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.208+0000 7efe78875700 1 --2- 172.21.15.1:0/1683251231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe74154480 0x7efe740ca9d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:38.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.208+0000 7efe78875700 1 -- 172.21.15.1:0/1683251231 >> 172.21.15.1:0/1683251231 conn(0x7efe74064a70 msgr2=0x7efe74064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:38.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.208+0000 7efe78875700 1 -- 172.21.15.1:0/1683251231 shutdown_connections 2023-11-15T01:33:38.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.208+0000 7efe78875700 1 -- 172.21.15.1:0/1683251231 wait complete. 2023-11-15T01:33:38.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.209+0000 7efe78875700 1 Processor -- start 2023-11-15T01:33:38.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.209+0000 7efe78875700 1 -- start start 2023-11-15T01:33:38.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe78875700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe740c5f40 0x7efe741482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:38.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe78875700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe741540a0 0x7efe741487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe78875700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe74154480 0x7efe74156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe78875700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe741595e0 con 0x7efe741540a0 2023-11-15T01:33:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe78875700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe74165900 con 0x7efe74154480 2023-11-15T01:33:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe78875700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe74158cb0 con 0x7efe740c5f40 2023-11-15T01:33:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe71d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe741540a0 0x7efe741487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe71d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe741540a0 0x7efe741487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38008/0 (socket says 172.21.15.1:38008) 2023-11-15T01:33:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe71d9b700 1 -- 172.21.15.1:0/311317747 learned_addr learned my addr 172.21.15.1:0/311317747 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe72d9d700 1 --2- 172.21.15.1:0/311317747 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe74154480 0x7efe74156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe7259c700 1 --2- 172.21.15.1:0/311317747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe740c5f40 0x7efe741482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe71d9b700 1 -- 172.21.15.1:0/311317747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe740c5f40 msgr2=0x7efe741482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe71d9b700 1 --2- 172.21.15.1:0/311317747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe740c5f40 0x7efe741482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:38.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe71d9b700 1 -- 172.21.15.1:0/311317747 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe74154480 msgr2=0x7efe74156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:38.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe71d9b700 1 --2- 172.21.15.1:0/311317747 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe74154480 0x7efe74156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:38.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe71d9b700 1 -- 172.21.15.1:0/311317747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe680092a0 con 0x7efe741540a0 2023-11-15T01:33:38.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe71d9b700 1 --2- 172.21.15.1:0/311317747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe741540a0 0x7efe741487e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7efe68009e80 tx=0x7efe68017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:38.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe627fc700 1 -- 172.21.15.1:0/311317747 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6800b850 con 0x7efe741540a0 2023-11-15T01:33:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe627fc700 1 -- 172.21.15.1:0/311317747 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6800b9b0 con 0x7efe741540a0 2023-11-15T01:33:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe627fc700 1 -- 172.21.15.1:0/311317747 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6801b640 con 0x7efe741540a0 2023-11-15T01:33:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.210+0000 7efe78875700 1 -- 172.21.15.1:0/311317747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe74158f90 con 0x7efe741540a0 2023-11-15T01:33:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.211+0000 7efe78875700 1 -- 172.21.15.1:0/311317747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe74159a70 con 0x7efe741540a0 2023-11-15T01:33:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.211+0000 7efe78875700 1 -- 172.21.15.1:0/311317747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7406c7e0 con 0x7efe741540a0 2023-11-15T01:33:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.212+0000 7efe627fc700 1 -- 172.21.15.1:0/311317747 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7efe6801b9f0 con 0x7efe741540a0 2023-11-15T01:33:38.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.212+0000 7efe627fc700 1 --2- 172.21.15.1:0/311317747 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efe5405f2c0 0x7efe54061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:38.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.212+0000 7efe627fc700 1 -- 172.21.15.1:0/311317747 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6730+0+0 (secure 0 0 0) 0x7efe6807c0a0 con 0x7efe741540a0 2023-11-15T01:33:38.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.212+0000 7efe7259c700 1 --2- 172.21.15.1:0/311317747 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efe5405f2c0 0x7efe54061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:38.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.213+0000 7efe7259c700 1 --2- 172.21.15.1:0/311317747 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efe5405f2c0 0x7efe54061780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7efe74167f40 tx=0x7efe64008040).ready entity=mgr.4754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:38.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.216+0000 7efe627fc700 1 -- 172.21.15.1:0/311317747 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efe6804cf90 con 0x7efe741540a0 2023-11-15T01:33:38.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:38.435+0000 7efe78875700 1 -- 172.21.15.1:0/311317747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7efe740c9ce0 con 0x7efe741540a0 2023-11-15T01:33:39.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.132+0000 7efe627fc700 1 -- 172.21.15.1:0/311317747 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7efe68079a90 con 0x7efe741540a0 2023-11-15T01:33:39.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.133+0000 7efe627fc700 1 -- 172.21.15.1:0/311317747 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v11) v1 ==== 93+0+0 (secure 0 0 0) 0x7efe680421a0 con 0x7efe741540a0 2023-11-15T01:33:39.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.135+0000 7efe78875700 1 -- 172.21.15.1:0/311317747 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efe5405f2c0 msgr2=0x7efe54061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:39.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.135+0000 7efe78875700 1 --2- 172.21.15.1:0/311317747 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efe5405f2c0 0x7efe54061780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7efe74167f40 tx=0x7efe64008040).stop 2023-11-15T01:33:39.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.135+0000 7efe78875700 1 -- 172.21.15.1:0/311317747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe741540a0 msgr2=0x7efe741487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.135+0000 7efe78875700 1 --2- 172.21.15.1:0/311317747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe741540a0 0x7efe741487e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7efe68009e80 tx=0x7efe68017000).stop 2023-11-15T01:33:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.135+0000 7efe78875700 1 -- 172.21.15.1:0/311317747 shutdown_connections 2023-11-15T01:33:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.135+0000 7efe78875700 1 --2- 172.21.15.1:0/311317747 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efe5405f2c0 0x7efe54061780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.135+0000 7efe78875700 1 --2- 172.21.15.1:0/311317747 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe74154480 0x7efe74156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.135+0000 7efe78875700 1 --2- 172.21.15.1:0/311317747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe740c5f40 0x7efe741482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.135+0000 7efe78875700 1 --2- 172.21.15.1:0/311317747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe741540a0 0x7efe741487e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.135+0000 7efe78875700 1 -- 172.21.15.1:0/311317747 >> 172.21.15.1:0/311317747 conn(0x7efe74064a70 msgr2=0x7efe740c0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.136+0000 7efe78875700 1 -- 172.21.15.1:0/311317747 shutdown_connections 2023-11-15T01:33:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.136+0000 7efe78875700 1 -- 172.21.15.1:0/311317747 wait complete. 2023-11-15T01:33:39.151 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T01:33:39.152 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:33:39.202 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:33:39.242 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T01:33:39.243 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-15T01:33:39.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:33:39.243 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-15T01:33:39.279 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:39.279+0000 7efec695e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:33:39.286 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:39.285+0000 7fae2002a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:33:39.290 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T01:33:39.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:33:39.291 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-15T01:33:39.346 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:33:39.353 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:39.353+0000 7efec695e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:33:39.358 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:39.357+0000 7fae2002a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:33:39.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.477+0000 7f59b61bb700 1 Processor -- start 2023-11-15T01:33:39.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.477+0000 7f59b61bb700 1 -- start start 2023-11-15T01:33:39.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.478+0000 7f59b61bb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59b00833a0 0x7f59b00a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:39.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.478+0000 7f59b61bb700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b00a85e0 con 0x7f59b0154450 2023-11-15T01:33:39.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.478+0000 7f59b61bb700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b0065660 con 0x7f59b00be520 2023-11-15T01:33:39.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.478+0000 7f59b61bb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b0065940 con 0x7f59b00833a0 2023-11-15T01:33:39.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.478+0000 7f59af7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f59b0154450 0x7f59b00bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44978/0 (socket says 172.21.15.1:44978) 2023-11-15T01:33:39.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.478+0000 7f59af7fe700 1 -- 172.21.15.1:0/1312046740 learned_addr learned my addr 172.21.15.1:0/1312046740 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:39.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.478+0000 7f59aeffd700 1 --2- 172.21.15.1:0/1312046740 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59b00833a0 0x7f59b00a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:39.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.478+0000 7f59ae7fc700 1 -- 172.21.15.1:0/1312046740 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020026921 0 0) 0x7f59b00a85e0 con 0x7f59b0154450 2023-11-15T01:33:39.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.478+0000 7f59ae7fc700 1 -- 172.21.15.1:0/1312046740 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f599c0033f0 con 0x7f59b0154450 2023-11-15T01:33:39.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.478+0000 7f59ae7fc700 1 -- 172.21.15.1:0/1312046740 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960597639 0 0) 0x7f59b0065660 con 0x7f59b00be520 2023-11-15T01:33:39.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.478+0000 7f59ae7fc700 1 -- 172.21.15.1:0/1312046740 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b00a85e0 con 0x7f59b00be520 2023-11-15T01:33:39.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.478+0000 7f59aeffd700 1 -- 172.21.15.1:0/1312046740 >> v1:172.21.15.141:6789/0 conn(0x7f59b00be520 legacy=0x7f59b00c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:39.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.478+0000 7f59aeffd700 1 -- 172.21.15.1:0/1312046740 >> v1:172.21.15.1:6789/0 conn(0x7f59b0154450 legacy=0x7f59b00bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:39.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.478+0000 7f59aeffd700 1 -- 172.21.15.1:0/1312046740 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b00c6f50 con 0x7f59b00833a0 2023-11-15T01:33:39.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.479+0000 7f59aeffd700 1 --2- 172.21.15.1:0/1312046740 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59b00833a0 0x7f59b00a7ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f59a0009790 tx=0x7f59a0009060).ready entity=mon.2 client_cookie=f397efbd299ccfa2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:39.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.479+0000 7f59ae7fc700 1 -- 172.21.15.1:0/1312046740 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a000f510 con 0x7f59b00833a0 2023-11-15T01:33:39.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.479+0000 7f59ae7fc700 1 -- 172.21.15.1:0/1312046740 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a000f670 con 0x7f59b00833a0 2023-11-15T01:33:39.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.479+0000 7f59ae7fc700 1 -- 172.21.15.1:0/1312046740 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a000f9f0 con 0x7f59b00833a0 2023-11-15T01:33:39.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.479+0000 7f59b61bb700 1 -- 172.21.15.1:0/1312046740 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59b00833a0 msgr2=0x7f59b00a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:39.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.479+0000 7f59b61bb700 1 --2- 172.21.15.1:0/1312046740 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59b00833a0 0x7f59b00a7ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f59a0009790 tx=0x7f59a0009060).stop 2023-11-15T01:33:39.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.479+0000 7f59b61bb700 1 -- 172.21.15.1:0/1312046740 shutdown_connections 2023-11-15T01:33:39.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.479+0000 7f59b61bb700 1 --2- 172.21.15.1:0/1312046740 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59b00833a0 0x7f59b00a7ef0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:39.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.479+0000 7f59b61bb700 1 -- 172.21.15.1:0/1312046740 >> 172.21.15.1:0/1312046740 conn(0x7f59b0082f90 msgr2=0x7f59b00c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:39.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.479+0000 7f59b61bb700 1 -- 172.21.15.1:0/1312046740 shutdown_connections 2023-11-15T01:33:39.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.479+0000 7f59b61bb700 1 -- 172.21.15.1:0/1312046740 wait complete. 2023-11-15T01:33:39.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.481+0000 7f59b61bb700 1 Processor -- start 2023-11-15T01:33:39.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.481+0000 7f59b61bb700 1 -- start start 2023-11-15T01:33:39.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.481+0000 7f59b61bb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f59b00833a0 0x7f59b01655d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:39.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.481+0000 7f59b61bb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59b00be520 0x7f59b0167210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:39.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.481+0000 7f59b61bb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59b0154450 0x7f59b0164e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:39.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.481+0000 7f59b61bb700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00a9940 con 0x7f59b00be520 2023-11-15T01:33:39.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.481+0000 7f59b61bb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b0165ac0 con 0x7f59b00833a0 2023-11-15T01:33:39.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.481+0000 7f59b61bb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00a8d30 con 0x7f59b0154450 2023-11-15T01:33:39.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59aeffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59b00be520 0x7f59b0167210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:39.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59aeffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59b00be520 0x7f59b0167210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38018/0 (socket says 172.21.15.1:38018) 2023-11-15T01:33:39.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59aeffd700 1 -- 172.21.15.1:0/3645933942 learned_addr learned my addr 172.21.15.1:0/3645933942 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:39.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59af7fe700 1 --2- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f59b00833a0 0x7f59b01655d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:39.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59affff700 1 --2- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59b0154450 0x7f59b0164e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:39.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59aeffd700 1 -- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59b0154450 msgr2=0x7f59b0164e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:39.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59aeffd700 1 --2- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59b0154450 0x7f59b0164e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:39.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59aeffd700 1 -- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f59b00833a0 msgr2=0x7f59b01655d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:39.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59aeffd700 1 --2- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f59b00833a0 0x7f59b01655d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:39.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59aeffd700 1 -- 172.21.15.1:0/3645933942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00092a0 con 0x7f59b00be520 2023-11-15T01:33:39.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59aeffd700 1 --2- 172.21.15.1:0/3645933942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59b00be520 0x7f59b0167210 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f59b00665a0 tx=0x7f59a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:39.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59a77fe700 1 -- 172.21.15.1:0/3645933942 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a000fe80 con 0x7f59b00be520 2023-11-15T01:33:39.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59a77fe700 1 -- 172.21.15.1:0/3645933942 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a000f7e0 con 0x7f59b00be520 2023-11-15T01:33:39.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59b61bb700 1 -- 172.21.15.1:0/3645933942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b00a9010 con 0x7f59b00be520 2023-11-15T01:33:39.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59a77fe700 1 -- 172.21.15.1:0/3645933942 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a001b670 con 0x7f59b00be520 2023-11-15T01:33:39.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.482+0000 7f59b61bb700 1 -- 172.21.15.1:0/3645933942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b00a95d0 con 0x7f59b00be520 2023-11-15T01:33:39.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.483+0000 7f59b61bb700 1 -- 172.21.15.1:0/3645933942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b00a9760 con 0x7f59b00be520 2023-11-15T01:33:39.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.484+0000 7f59a77fe700 1 -- 172.21.15.1:0/3645933942 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f59a001b9e0 con 0x7f59b00be520 2023-11-15T01:33:39.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.484+0000 7f59a77fe700 1 --2- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f599005f270 0x7f5990061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:39.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.484+0000 7f59a77fe700 1 -- 172.21.15.1:0/3645933942 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7302+0+0 (secure 0 0 0) 0x7f59a007bf20 con 0x7f59b00be520 2023-11-15T01:33:39.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.484+0000 7f59af7fe700 1 -- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f599005f270 msgr2=0x7f5990061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:39.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.484+0000 7f59af7fe700 1 --2- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f599005f270 0x7f5990061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:33:39.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.488+0000 7f59a77fe700 1 -- 172.21.15.1:0/3645933942 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f59a004cb10 con 0x7f59b00be520 2023-11-15T01:33:39.639 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:39.638+0000 7efec695e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:33:39.670 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:39.668+0000 7fae2002a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:33:39.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.685+0000 7f59af7fe700 1 -- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f599005f270 msgr2=0x7f5990061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:39.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.685+0000 7f59af7fe700 1 --2- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f599005f270 0x7f5990061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:33:39.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.739+0000 7f59b61bb700 1 -- 172.21.15.1:0/3645933942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59b006c7e0 con 0x7f59b00be520 2023-11-15T01:33:39.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.739+0000 7f59a77fe700 1 -- 172.21.15.1:0/3645933942 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4486 (secure 0 0 0) 0x7f59a0050130 con 0x7f59b00be520 2023-11-15T01:33:39.741 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:39.741 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1019024578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1019024578},{"type":"v1","addr":"172.21.15.1:6835","nonce":1019024578}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4622,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/571718542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":571718542},{"type":"v1","addr":"172.21.15.141:6837","nonce":571718542}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/4111687819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":4111687819},{"type":"v1","addr":"172.21.15.141:6836","nonce":4111687819}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:22:23.228899+0000","modified":"2023-11-15T01:22:26.233026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6834/3374581715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3374581715},{"type":"v1","addr":"172.21.15.1:6834","nonce":3374581715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-11-15T01:33:39.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.741+0000 7f59b61bb700 1 -- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f599005f270 msgr2=0x7f5990061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:33:39.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.741+0000 7f59b61bb700 1 --2- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f599005f270 0x7f5990061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:39.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.741+0000 7f59b61bb700 1 -- 172.21.15.1:0/3645933942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59b00be520 msgr2=0x7f59b0167210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:39.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.741+0000 7f59b61bb700 1 --2- 172.21.15.1:0/3645933942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59b00be520 0x7f59b0167210 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f59b00665a0 tx=0x7f59a0017000).stop 2023-11-15T01:33:39.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.741+0000 7f59b61bb700 1 -- 172.21.15.1:0/3645933942 shutdown_connections 2023-11-15T01:33:39.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.741+0000 7f59b61bb700 1 --2- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f599005f270 0x7f5990061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:39.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.741+0000 7f59b61bb700 1 --2- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59b0154450 0x7f59b0164e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:39.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.741+0000 7f59b61bb700 1 --2- 172.21.15.1:0/3645933942 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f59b00833a0 0x7f59b01655d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:39.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.741+0000 7f59b61bb700 1 --2- 172.21.15.1:0/3645933942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59b00be520 0x7f59b0167210 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:39.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.741+0000 7f59b61bb700 1 -- 172.21.15.1:0/3645933942 >> 172.21.15.1:0/3645933942 conn(0x7f59b0082f90 msgr2=0x7f59b00a7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:39.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.741+0000 7f59b61bb700 1 -- 172.21.15.1:0/3645933942 shutdown_connections 2023-11-15T01:33:39.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.741+0000 7f59b61bb700 1 -- 172.21.15.1:0/3645933942 wait complete. 2023-11-15T01:33:39.746 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 15 2023-11-15T01:33:39.755 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:33:39.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.874+0000 7f5d54ba3700 1 Processor -- start 2023-11-15T01:33:39.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.874+0000 7f5d54ba3700 1 -- start start 2023-11-15T01:33:39.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.875+0000 7f5d54ba3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d500ad370 0x7f5d500aa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:39.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.875+0000 7f5d54ba3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5d500aab30 0x7f5d500627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:39.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.875+0000 7f5d54ba3700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d500acee0 con 0x7f5d50155610 2023-11-15T01:33:39.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.875+0000 7f5d54ba3700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d50069820 con 0x7f5d500aab30 2023-11-15T01:33:39.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.875+0000 7f5d54ba3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500ac890 con 0x7f5d500ad370 2023-11-15T01:33:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.876+0000 7f5d4ed9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5d500aab30 0x7f5d500627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.876+0000 7f5d4ed9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5d500aab30 0x7f5d500627b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38026/0 (socket says 172.21.15.1:38026) 2023-11-15T01:33:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.876+0000 7f5d4ed9d700 1 -- 172.21.15.1:0/1989607857 learned_addr learned my addr 172.21.15.1:0/1989607857 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.876+0000 7f5d4dd9b700 1 --2- 172.21.15.1:0/1989607857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d500ad370 0x7f5d500aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.876+0000 7f5d4ed9d700 1 -- 172.21.15.1:0/1989607857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d500ad370 msgr2=0x7f5d500aa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.876+0000 7f5d4ed9d700 1 --2- 172.21.15.1:0/1989607857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d500ad370 0x7f5d500aa640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.876+0000 7f5d4ed9d700 1 -- 172.21.15.1:0/1989607857 >> v1:172.21.15.141:6789/0 conn(0x7f5d50155610 legacy=0x7f5d50068dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.876+0000 7f5d4ed9d700 1 -- 172.21.15.1:0/1989607857 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d500acb70 con 0x7f5d500aab30 2023-11-15T01:33:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.876+0000 7f5d4dd9b700 1 --2- 172.21.15.1:0/1989607857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d500ad370 0x7f5d500aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.876+0000 7f5d4ed9d700 1 --2- 172.21.15.1:0/1989607857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d500aab30 0x7f5d500627b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f5d48009f20 tx=0x7f5d48009840).ready entity=mon.0 client_cookie=6b1725aeccfae608 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:39.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.876+0000 7f5d4d59a700 1 -- 172.21.15.1:0/1989607857 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4800e070 con 0x7f5d500aab30 2023-11-15T01:33:39.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.876+0000 7f5d4d59a700 1 -- 172.21.15.1:0/1989607857 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4800ba80 con 0x7f5d500aab30 2023-11-15T01:33:39.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.876+0000 7f5d4d59a700 1 -- 172.21.15.1:0/1989607857 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4800be00 con 0x7f5d500aab30 2023-11-15T01:33:39.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.877+0000 7f5d54ba3700 1 -- 172.21.15.1:0/1989607857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d500aab30 msgr2=0x7f5d500627b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:39.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.877+0000 7f5d54ba3700 1 --2- 172.21.15.1:0/1989607857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d500aab30 0x7f5d500627b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f5d48009f20 tx=0x7f5d48009840).stop 2023-11-15T01:33:39.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.877+0000 7f5d54ba3700 1 -- 172.21.15.1:0/1989607857 shutdown_connections 2023-11-15T01:33:39.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.877+0000 7f5d54ba3700 1 --2- 172.21.15.1:0/1989607857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d500aab30 0x7f5d500627b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:39.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.877+0000 7f5d54ba3700 1 --2- 172.21.15.1:0/1989607857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d500ad370 0x7f5d500aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:39.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.877+0000 7f5d54ba3700 1 -- 172.21.15.1:0/1989607857 >> 172.21.15.1:0/1989607857 conn(0x7f5d500c74f0 msgr2=0x7f5d500c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:39.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.877+0000 7f5d54ba3700 1 -- 172.21.15.1:0/1989607857 shutdown_connections 2023-11-15T01:33:39.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.877+0000 7f5d54ba3700 1 -- 172.21.15.1:0/1989607857 wait complete. 2023-11-15T01:33:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.878+0000 7f5d54ba3700 1 Processor -- start 2023-11-15T01:33:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.878+0000 7f5d54ba3700 1 -- start start 2023-11-15T01:33:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d54ba3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d500aab30 0x7f5d50141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d54ba3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d500ad370 0x7f5d50150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d54ba3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d50155610 0x7f5d500c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d54ba3700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d50141f00 con 0x7f5d50155610 2023-11-15T01:33:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d54ba3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500beb80 con 0x7f5d500ad370 2023-11-15T01:33:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d54ba3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500bee60 con 0x7f5d500aab30 2023-11-15T01:33:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d4ed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d50155610 0x7f5d500c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d4ed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d50155610 0x7f5d500c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38040/0 (socket says 172.21.15.1:38040) 2023-11-15T01:33:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d4ed9d700 1 -- 172.21.15.1:0/4200052735 learned_addr learned my addr 172.21.15.1:0/4200052735 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d4e59c700 1 --2- 172.21.15.1:0/4200052735 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d500aab30 0x7f5d50141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d4dd9b700 1 --2- 172.21.15.1:0/4200052735 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d500ad370 0x7f5d50150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d4ed9d700 1 -- 172.21.15.1:0/4200052735 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d500aab30 msgr2=0x7f5d50141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d4ed9d700 1 --2- 172.21.15.1:0/4200052735 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d500aab30 0x7f5d50141a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d4ed9d700 1 -- 172.21.15.1:0/4200052735 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d500ad370 msgr2=0x7f5d50150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d4ed9d700 1 --2- 172.21.15.1:0/4200052735 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d500ad370 0x7f5d50150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:39.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d4ed9d700 1 -- 172.21.15.1:0/4200052735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d48009ae0 con 0x7f5d50155610 2023-11-15T01:33:39.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d4ed9d700 1 --2- 172.21.15.1:0/4200052735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d50155610 0x7f5d500c5890 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f5d4800b6c0 tx=0x7f5d48009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:39.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.879+0000 7f5d467fc700 1 -- 172.21.15.1:0/4200052735 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d480092e0 con 0x7f5d50155610 2023-11-15T01:33:39.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.880+0000 7f5d467fc700 1 -- 172.21.15.1:0/4200052735 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4801d410 con 0x7f5d50155610 2023-11-15T01:33:39.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.880+0000 7f5d54ba3700 1 -- 172.21.15.1:0/4200052735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d500bf140 con 0x7f5d50155610 2023-11-15T01:33:39.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.880+0000 7f5d467fc700 1 -- 172.21.15.1:0/4200052735 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4801d7d0 con 0x7f5d50155610 2023-11-15T01:33:39.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.880+0000 7f5d54ba3700 1 -- 172.21.15.1:0/4200052735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d500bf700 con 0x7f5d50155610 2023-11-15T01:33:39.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.881+0000 7f5d54ba3700 1 -- 172.21.15.1:0/4200052735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5006c7e0 con 0x7f5d50155610 2023-11-15T01:33:39.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.881+0000 7f5d467fc700 1 -- 172.21.15.1:0/4200052735 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f5d4801dbc0 con 0x7f5d50155610 2023-11-15T01:33:39.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.881+0000 7f5d467fc700 1 --2- 172.21.15.1:0/4200052735 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5d3005f270 0x7f5d30061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:39.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.881+0000 7f5d467fc700 1 -- 172.21.15.1:0/4200052735 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7302+0+0 (secure 0 0 0) 0x7f5d4807c3c0 con 0x7f5d50155610 2023-11-15T01:33:39.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.881+0000 7f5d4e59c700 1 -- 172.21.15.1:0/4200052735 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5d3005f270 msgr2=0x7f5d30061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:39.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.881+0000 7f5d4e59c700 1 --2- 172.21.15.1:0/4200052735 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5d3005f270 0x7f5d30061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:33:39.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:39.885+0000 7f5d467fc700 1 -- 172.21.15.1:0/4200052735 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5d4804d070 con 0x7f5d50155610 2023-11-15T01:33:40.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.060+0000 7f5d54ba3700 1 -- 172.21.15.1:0/4200052735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d500694e0 con 0x7f5d50155610 2023-11-15T01:33:40.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.061+0000 7f5d467fc700 1 -- 172.21.15.1:0/4200052735 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18685 (secure 0 0 0) 0x7f5d48050690 con 0x7f5d50155610 2023-11-15T01:33:40.063 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:40.063 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":46,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:33:38.782100+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:22:21.423841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-15T01:22:22.202076+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":46,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2f","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:6833/90546":"2023-11-16T01:22:35.460446+0000","172.21.15.141:6832/90546":"2023-11-16T01:22:35.460446+0000","172.21.15.141:0/1004848049":"2023-11-16T01:22:35.460446+0000","172.21.15.141:0/3577504655":"2023-11-16T01:22:35.460446+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":199,"length":22}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":9,"length":1},{"begin":19,"length":1},{"begin":30,"length":1},{"begin":40,"length":1},{"begin":50,"length":1},{"begin":60,"length":1},{"begin":70,"length":1},{"begin":80,"length":1},{"begin":90,"length":1},{"begin":101,"length":1},{"begin":107,"length":1},{"begin":210,"length":11}]}],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":3},{"begin":6,"length":3},{"begin":10,"length":5},{"begin":16,"length":3},{"begin":20,"length":6},{"begin":27,"length":3},{"begin":31,"length":5},{"begin":37,"length":3},{"begin":41,"length":5},{"begin":47,"length":3},{"begin":51,"length":5},{"begin":57,"length":3},{"begin":61,"length":5},{"begin":67,"length":3},{"begin":71,"length":5},{"begin":77,"length":3},{"begin":81,"length":5},{"begin":87,"length":3},{"begin":91,"length":6},{"begin":98,"length":3},{"begin":102,"length":2},{"begin":105,"length":2},{"begin":108,"length":3},{"begin":112,"length":87}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:33:40.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.063+0000 7f5d54ba3700 1 -- 172.21.15.1:0/4200052735 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5d3005f270 msgr2=0x7f5d30061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:33:40.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.063+0000 7f5d54ba3700 1 --2- 172.21.15.1:0/4200052735 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5d3005f270 0x7f5d30061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:40.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.063+0000 7f5d54ba3700 1 -- 172.21.15.1:0/4200052735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d50155610 msgr2=0x7f5d500c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.063+0000 7f5d54ba3700 1 --2- 172.21.15.1:0/4200052735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d50155610 0x7f5d500c5890 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f5d4800b6c0 tx=0x7f5d48009840).stop 2023-11-15T01:33:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.063+0000 7f5d54ba3700 1 -- 172.21.15.1:0/4200052735 shutdown_connections 2023-11-15T01:33:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.063+0000 7f5d54ba3700 1 --2- 172.21.15.1:0/4200052735 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5d3005f270 0x7f5d30061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.063+0000 7f5d54ba3700 1 --2- 172.21.15.1:0/4200052735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d50155610 0x7f5d500c5890 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.063+0000 7f5d54ba3700 1 --2- 172.21.15.1:0/4200052735 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d500aab30 0x7f5d50141a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.063+0000 7f5d54ba3700 1 --2- 172.21.15.1:0/4200052735 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d500ad370 0x7f5d50150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.063+0000 7f5d54ba3700 1 -- 172.21.15.1:0/4200052735 >> 172.21.15.1:0/4200052735 conn(0x7f5d500c74f0 msgr2=0x7f5d50151ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:40.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.063+0000 7f5d54ba3700 1 -- 172.21.15.1:0/4200052735 shutdown_connections 2023-11-15T01:33:40.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.063+0000 7f5d54ba3700 1 -- 172.21.15.1:0/4200052735 wait complete. 2023-11-15T01:33:40.078 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T01:22:21.423841+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T01:22:22.202076+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 220, 'snap_epoch': 46, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T01:33:40.079 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:33:40.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.201+0000 7feaa4575700 1 Processor -- start 2023-11-15T01:33:40.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.201+0000 7feaa4575700 1 -- start start 2023-11-15T01:33:40.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.202+0000 7feaa4575700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea9c154480 0x7fea9c0c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.202+0000 7feaa4575700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c0ca050 con 0x7fea9c0c6430 2023-11-15T01:33:40.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.202+0000 7feaa4575700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c0c68c0 con 0x7fea9c1540a0 2023-11-15T01:33:40.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.202+0000 7feaa4575700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0c9440 con 0x7fea9c154480 2023-11-15T01:33:40.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.202+0000 7feaa2b12700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fea9c0c6430 0x7fea9c0aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44988/0 (socket says 172.21.15.1:44988) 2023-11-15T01:33:40.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.202+0000 7feaa2b12700 1 -- 172.21.15.1:0/1458593489 learned_addr learned my addr 172.21.15.1:0/1458593489 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:40.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa1b10700 1 --2- 172.21.15.1:0/1458593489 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea9c154480 0x7fea9c0c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272874736 0 0) 0x7fea9c0ca050 con 0x7fea9c0c6430 2023-11-15T01:33:40.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea880033f0 con 0x7fea9c0c6430 2023-11-15T01:33:40.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35321971 0 0) 0x7fea9c0c68c0 con 0x7fea9c1540a0 2023-11-15T01:33:40.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea9c0ca050 con 0x7fea9c1540a0 2023-11-15T01:33:40.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2002363394 0 0) 0x7fea880033f0 con 0x7fea9c0c6430 2023-11-15T01:33:40.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea9c154480 msgr2=0x7fea9c0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:40.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 --2- 172.21.15.1:0/1458593489 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea9c154480 0x7fea9c0c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 >> v1:172.21.15.141:6789/0 conn(0x7fea9c1540a0 legacy=0x7fea9c0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c0c9720 con 0x7fea9c0c6430 2023-11-15T01:33:40.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fea940017f0 con 0x7fea9c0c6430 2023-11-15T01:33:40.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 >> v1:172.21.15.1:6789/0 conn(0x7fea9c0c6430 legacy=0x7fea9c0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 --2- 172.21.15.1:0/1458593489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea88003aa0 0x7fea88003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 --2- 172.21.15.1:0/1458593489 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea9c154480 0x7fea88004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 --2- 172.21.15.1:0/1458593489 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea88004b80 0x7fea88005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0c9440 con 0x7fea88003aa0 2023-11-15T01:33:40.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8800b9c0 con 0x7fea88004b80 2023-11-15T01:33:40.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8800bb80 con 0x7fea9c154480 2023-11-15T01:33:40.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa2311700 1 --2- 172.21.15.1:0/1458593489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea88003aa0 0x7fea88003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa1b10700 1 --2- 172.21.15.1:0/1458593489 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea9c154480 0x7fea88004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.203+0000 7feaa2b12700 1 --2- 172.21.15.1:0/1458593489 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea88004b80 0x7fea88005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.204+0000 7feaa2311700 1 -- 172.21.15.1:0/1458593489 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea9c154480 msgr2=0x7fea88004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:40.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.204+0000 7feaa2311700 1 --2- 172.21.15.1:0/1458593489 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea9c154480 0x7fea88004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.204+0000 7feaa2311700 1 -- 172.21.15.1:0/1458593489 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea88004b80 msgr2=0x7fea88005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:40.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.204+0000 7feaa2311700 1 --2- 172.21.15.1:0/1458593489 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea88004b80 0x7fea88005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.204+0000 7feaa2311700 1 -- 172.21.15.1:0/1458593489 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea880033f0 con 0x7fea88003aa0 2023-11-15T01:33:40.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.204+0000 7feaa2311700 1 --2- 172.21.15.1:0/1458593489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea88003aa0 0x7fea88003ea0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fea90001860 tx=0x7fea90007bb0).ready entity=mon.0 client_cookie=36bdbd3eeab0aca9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:40.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.204+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90007020 con 0x7fea88003aa0 2023-11-15T01:33:40.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.204+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea90007180 con 0x7fea88003aa0 2023-11-15T01:33:40.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.204+0000 7feaa130f700 1 -- 172.21.15.1:0/1458593489 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90007500 con 0x7fea88003aa0 2023-11-15T01:33:40.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.205+0000 7feaa4575700 1 -- 172.21.15.1:0/1458593489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea88003aa0 msgr2=0x7fea88003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.205+0000 7feaa4575700 1 --2- 172.21.15.1:0/1458593489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea88003aa0 0x7fea88003ea0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fea90001860 tx=0x7fea90007bb0).stop 2023-11-15T01:33:40.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.205+0000 7feaa2b12700 1 -- 172.21.15.1:0/1458593489 reap_dead start 2023-11-15T01:33:40.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.205+0000 7feaa4575700 1 -- 172.21.15.1:0/1458593489 shutdown_connections 2023-11-15T01:33:40.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.205+0000 7feaa4575700 1 -- 172.21.15.1:0/1458593489 >> 172.21.15.1:0/1458593489 conn(0x7fea9c064a70 msgr2=0x7fea9c064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:40.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.205+0000 7feaa4575700 1 -- 172.21.15.1:0/1458593489 shutdown_connections 2023-11-15T01:33:40.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.205+0000 7feaa4575700 1 -- 172.21.15.1:0/1458593489 wait complete. 2023-11-15T01:33:40.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.206+0000 7feaa4575700 1 Processor -- start 2023-11-15T01:33:40.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.206+0000 7feaa4575700 1 -- start start 2023-11-15T01:33:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa4575700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea88003aa0 0x7fea9c1670f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa4575700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea9c0c4a80 0x7fea9c0c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa4575700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea9c1524d0 0x7fea9c152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa4575700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0c3660 con 0x7fea9c1524d0 2023-11-15T01:33:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa4575700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c152e20 con 0x7fea88003aa0 2023-11-15T01:33:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa4575700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0c2770 con 0x7fea9c0c4a80 2023-11-15T01:33:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa2b12700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea9c1524d0 0x7fea9c152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa2b12700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea9c1524d0 0x7fea9c152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38066/0 (socket says 172.21.15.1:38066) 2023-11-15T01:33:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa2b12700 1 -- 172.21.15.1:0/3546288856 learned_addr learned my addr 172.21.15.1:0/3546288856 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa2311700 1 --2- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea88003aa0 0x7fea9c1670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa1b10700 1 --2- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea9c0c4a80 0x7fea9c0c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa2b12700 1 -- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea9c0c4a80 msgr2=0x7fea9c0c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa2b12700 1 --2- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea9c0c4a80 0x7fea9c0c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa2b12700 1 -- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea88003aa0 msgr2=0x7fea9c1670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa2b12700 1 --2- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea88003aa0 0x7fea9c1670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa2b12700 1 -- 172.21.15.1:0/3546288856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c0c2a50 con 0x7fea9c1524d0 2023-11-15T01:33:40.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.207+0000 7feaa2b12700 1 --2- 172.21.15.1:0/3546288856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea9c1524d0 0x7fea9c152930 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fea94000f80 tx=0x7fea94007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:40.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.208+0000 7fea8e7fc700 1 -- 172.21.15.1:0/3546288856 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9400f690 con 0x7fea9c1524d0 2023-11-15T01:33:40.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.208+0000 7fea8e7fc700 1 -- 172.21.15.1:0/3546288856 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9400f7f0 con 0x7fea9c1524d0 2023-11-15T01:33:40.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.208+0000 7feaa4575700 1 -- 172.21.15.1:0/3546288856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c0c2d30 con 0x7fea9c1524d0 2023-11-15T01:33:40.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.208+0000 7fea8e7fc700 1 -- 172.21.15.1:0/3546288856 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9400fb90 con 0x7fea9c1524d0 2023-11-15T01:33:40.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.208+0000 7feaa4575700 1 -- 172.21.15.1:0/3546288856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c0c32f0 con 0x7fea9c1524d0 2023-11-15T01:33:40.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.209+0000 7feaa4575700 1 -- 172.21.15.1:0/3546288856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9c06c7e0 con 0x7fea9c1524d0 2023-11-15T01:33:40.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.209+0000 7fea8e7fc700 1 -- 172.21.15.1:0/3546288856 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fea9401d3b0 con 0x7fea9c1524d0 2023-11-15T01:33:40.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.209+0000 7fea8e7fc700 1 --2- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fea8005f270 0x7fea80061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.209+0000 7feaa2311700 1 -- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fea8005f270 msgr2=0x7fea80061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:40.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.209+0000 7fea8e7fc700 1 -- 172.21.15.1:0/3546288856 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7302+0+0 (secure 0 0 0) 0x7fea9407a3e0 con 0x7fea9c1524d0 2023-11-15T01:33:40.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.209+0000 7feaa2311700 1 --2- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fea8005f270 0x7fea80061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:33:40.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.217+0000 7fea8e7fc700 1 -- 172.21.15.1:0/3546288856 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fea9404b030 con 0x7fea9c1524d0 2023-11-15T01:33:40.259 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:40.257+0000 7efec695e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:33:40.330 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:40.329+0000 7efec695e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:33:40.356 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:40.355+0000 7fae2002a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:33:40.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.410+0000 7feaa2311700 1 -- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fea8005f270 msgr2=0x7fea80061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:40.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.410+0000 7feaa2311700 1 --2- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fea8005f270 0x7fea80061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:33:40.427 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:40.426+0000 7fae2002a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:33:40.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.436+0000 7feaa4575700 1 -- 172.21.15.1:0/3546288856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fea9c0c9a00 con 0x7fea9c1524d0 2023-11-15T01:33:40.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.437+0000 7fea8e7fc700 1 -- 172.21.15.1:0/3546288856 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v46) v1 ==== 110+0+10 (secure 0 0 0) 0x7fea94019070 con 0x7fea9c1524d0 2023-11-15T01:33:40.438 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:33:40.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.439+0000 7feaa4575700 1 -- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fea8005f270 msgr2=0x7fea80061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:33:40.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.439+0000 7feaa4575700 1 --2- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fea8005f270 0x7fea80061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:40.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.439+0000 7feaa4575700 1 -- 172.21.15.1:0/3546288856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea9c1524d0 msgr2=0x7fea9c152930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.439+0000 7feaa4575700 1 --2- 172.21.15.1:0/3546288856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea9c1524d0 0x7fea9c152930 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fea94000f80 tx=0x7fea94007f20).stop 2023-11-15T01:33:40.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.439+0000 7feaa4575700 1 -- 172.21.15.1:0/3546288856 shutdown_connections 2023-11-15T01:33:40.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.439+0000 7feaa4575700 1 --2- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fea8005f270 0x7fea80061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:40.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.439+0000 7feaa4575700 1 --2- 172.21.15.1:0/3546288856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea9c1524d0 0x7fea9c152930 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.439+0000 7feaa4575700 1 --2- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea88003aa0 0x7fea9c1670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.439+0000 7feaa4575700 1 --2- 172.21.15.1:0/3546288856 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea9c0c4a80 0x7fea9c0c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.439+0000 7feaa4575700 1 -- 172.21.15.1:0/3546288856 >> 172.21.15.1:0/3546288856 conn(0x7fea9c064a70 msgr2=0x7fea9c0ad170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:40.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.439+0000 7feaa4575700 1 -- 172.21.15.1:0/3546288856 shutdown_connections 2023-11-15T01:33:40.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.439+0000 7feaa4575700 1 -- 172.21.15.1:0/3546288856 wait complete. 2023-11-15T01:33:40.452 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:33:40.517 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:40.515+0000 7efec695e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:33:40.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.584+0000 7f3e322d6700 1 Processor -- start 2023-11-15T01:33:40.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.584+0000 7f3e322d6700 1 -- start start 2023-11-15T01:33:40.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.585+0000 7f3e322d6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3e2c0c5900 0x7f3e2c069620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.585+0000 7f3e322d6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2c06a810 con 0x7f3e2c13a980 2023-11-15T01:33:40.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.585+0000 7f3e322d6700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2c13ad60 con 0x7f3e2c0bcd20 2023-11-15T01:33:40.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.585+0000 7f3e322d6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2c069c00 con 0x7f3e2c0c5900 2023-11-15T01:33:40.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.585+0000 7f3e2bfff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3e2c13a980 0x7f3e2c0c1c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44992/0 (socket says 172.21.15.1:44992) 2023-11-15T01:33:40.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.585+0000 7f3e2bfff700 1 -- 172.21.15.1:0/2714650625 learned_addr learned my addr 172.21.15.1:0/2714650625 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:40.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.585+0000 7f3e2b7fe700 1 --2- 172.21.15.1:0/2714650625 >> v2:172.21.15.141:3300/0 conn(0x7f3e2c0c5900 0x7f3e2c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.585+0000 7f3e2affd700 1 -- 172.21.15.1:0/2714650625 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621736201 0 0) 0x7f3e2c06a810 con 0x7f3e2c13a980 2023-11-15T01:33:40.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.585+0000 7f3e2affd700 1 -- 172.21.15.1:0/2714650625 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e180033f0 con 0x7f3e2c13a980 2023-11-15T01:33:40.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.585+0000 7f3e2b7fe700 1 -- 172.21.15.1:0/2714650625 >> v1:172.21.15.141:6789/0 conn(0x7f3e2c0bcd20 legacy=0x7f3e2c0bd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:40.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.585+0000 7f3e2b7fe700 1 -- 172.21.15.1:0/2714650625 >> v1:172.21.15.1:6789/0 conn(0x7f3e2c13a980 legacy=0x7f3e2c0c1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.585+0000 7f3e2b7fe700 1 -- 172.21.15.1:0/2714650625 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c069ee0 con 0x7f3e2c0c5900 2023-11-15T01:33:40.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.586+0000 7f3e2b7fe700 1 --2- 172.21.15.1:0/2714650625 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e2c0c5900 0x7f3e2c069620 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f3e1c009760 tx=0x7f3e1c009060).ready entity=mon.1 client_cookie=a8a3d8951733943e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:40.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.586+0000 7f3e2affd700 1 -- 172.21.15.1:0/2714650625 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00f6b0 con 0x7f3e2c0c5900 2023-11-15T01:33:40.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.588+0000 7f3e2affd700 1 -- 172.21.15.1:0/2714650625 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c00f810 con 0x7f3e2c0c5900 2023-11-15T01:33:40.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.588+0000 7f3e2affd700 1 -- 172.21.15.1:0/2714650625 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00fb90 con 0x7f3e2c0c5900 2023-11-15T01:33:40.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.588+0000 7f3e322d6700 1 -- 172.21.15.1:0/2714650625 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e2c0c5900 msgr2=0x7f3e2c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.588+0000 7f3e322d6700 1 --2- 172.21.15.1:0/2714650625 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e2c0c5900 0x7f3e2c069620 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f3e1c009760 tx=0x7f3e1c009060).stop 2023-11-15T01:33:40.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.589+0000 7f3e322d6700 1 -- 172.21.15.1:0/2714650625 shutdown_connections 2023-11-15T01:33:40.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.589+0000 7f3e322d6700 1 --2- 172.21.15.1:0/2714650625 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e2c0c5900 0x7f3e2c069620 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.589+0000 7f3e322d6700 1 -- 172.21.15.1:0/2714650625 >> 172.21.15.1:0/2714650625 conn(0x7f3e2c063280 msgr2=0x7f3e2c0c6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:40.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.589+0000 7f3e322d6700 1 -- 172.21.15.1:0/2714650625 shutdown_connections 2023-11-15T01:33:40.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.589+0000 7f3e322d6700 1 -- 172.21.15.1:0/2714650625 wait complete. 2023-11-15T01:33:40.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.590+0000 7f3e322d6700 1 Processor -- start 2023-11-15T01:33:40.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.590+0000 7f3e322d6700 1 -- start start 2023-11-15T01:33:40.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e322d6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e2c0bcd20 0x7f3e2c139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e322d6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e2c0c5900 0x7f3e2c0a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e322d6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e2c13a980 0x7f3e2c0bdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e322d6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c139830 con 0x7f3e2c0bcd20 2023-11-15T01:33:40.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e322d6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c136b90 con 0x7f3e2c13a980 2023-11-15T01:33:40.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e322d6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c0be8d0 con 0x7f3e2c0c5900 2023-11-15T01:33:40.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e2bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e2c0bcd20 0x7f3e2c139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e2bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e2c0bcd20 0x7f3e2c139cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38068/0 (socket says 172.21.15.1:38068) 2023-11-15T01:33:40.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e2bfff700 1 -- 172.21.15.1:0/2277166254 learned_addr learned my addr 172.21.15.1:0/2277166254 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:40.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e30873700 1 --2- 172.21.15.1:0/2277166254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e2c13a980 0x7f3e2c0bdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e2b7fe700 1 --2- 172.21.15.1:0/2277166254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e2c0c5900 0x7f3e2c0a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e2bfff700 1 -- 172.21.15.1:0/2277166254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e2c0c5900 msgr2=0x7f3e2c0a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e2bfff700 1 --2- 172.21.15.1:0/2277166254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e2c0c5900 0x7f3e2c0a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e2bfff700 1 -- 172.21.15.1:0/2277166254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e2c13a980 msgr2=0x7f3e2c0bdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e2bfff700 1 --2- 172.21.15.1:0/2277166254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e2c13a980 0x7f3e2c0bdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e2bfff700 1 -- 172.21.15.1:0/2277166254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c0092a0 con 0x7f3e2c0bcd20 2023-11-15T01:33:40.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e2bfff700 1 --2- 172.21.15.1:0/2277166254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e2c0bcd20 0x7f3e2c139cc0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f3e1400c440 tx=0x7f3e14007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:40.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e23fff700 1 -- 172.21.15.1:0/2277166254 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e140070d0 con 0x7f3e2c0bcd20 2023-11-15T01:33:40.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e23fff700 1 -- 172.21.15.1:0/2277166254 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e14007230 con 0x7f3e2c0bcd20 2023-11-15T01:33:40.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e322d6700 1 -- 172.21.15.1:0/2277166254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2c0bebb0 con 0x7f3e2c0bcd20 2023-11-15T01:33:40.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e23fff700 1 -- 172.21.15.1:0/2277166254 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e140075d0 con 0x7f3e2c0bcd20 2023-11-15T01:33:40.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.591+0000 7f3e322d6700 1 -- 172.21.15.1:0/2277166254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2c139170 con 0x7f3e2c0bcd20 2023-11-15T01:33:40.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.593+0000 7f3e322d6700 1 -- 172.21.15.1:0/2277166254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2c06c7e0 con 0x7f3e2c0bcd20 2023-11-15T01:33:40.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.593+0000 7f3e23fff700 1 -- 172.21.15.1:0/2277166254 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f3e140059b0 con 0x7f3e2c0bcd20 2023-11-15T01:33:40.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.593+0000 7f3e23fff700 1 --2- 172.21.15.1:0/2277166254 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e0c05f270 0x7f3e0c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.593+0000 7f3e23fff700 1 -- 172.21.15.1:0/2277166254 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7302+0+0 (secure 0 0 0) 0x7f3e14079e60 con 0x7f3e2c0bcd20 2023-11-15T01:33:40.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.593+0000 7f3e2b7fe700 1 -- 172.21.15.1:0/2277166254 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e0c05f270 msgr2=0x7f3e0c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:40.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.593+0000 7f3e2b7fe700 1 --2- 172.21.15.1:0/2277166254 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e0c05f270 0x7f3e0c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:33:40.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.597+0000 7f3e23fff700 1 -- 172.21.15.1:0/2277166254 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3e1404ab10 con 0x7f3e2c0bcd20 2023-11-15T01:33:40.636 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:40.634+0000 7fae2002a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:33:40.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.772+0000 7f3e322d6700 1 -- 172.21.15.1:0/2277166254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3e2c06a1c0 con 0x7f3e2c0bcd20 2023-11-15T01:33:40.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.773+0000 7f3e23fff700 1 -- 172.21.15.1:0/2277166254 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3e14018030 con 0x7f3e2c0bcd20 2023-11-15T01:33:40.775 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:33:40.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.775+0000 7f3e322d6700 1 -- 172.21.15.1:0/2277166254 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e0c05f270 msgr2=0x7f3e0c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:33:40.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.775+0000 7f3e322d6700 1 --2- 172.21.15.1:0/2277166254 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e0c05f270 0x7f3e0c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:40.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.775+0000 7f3e322d6700 1 -- 172.21.15.1:0/2277166254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e2c0bcd20 msgr2=0x7f3e2c139cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.775+0000 7f3e322d6700 1 --2- 172.21.15.1:0/2277166254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e2c0bcd20 0x7f3e2c139cc0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f3e1400c440 tx=0x7f3e14007c70).stop 2023-11-15T01:33:40.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.775+0000 7f3e322d6700 1 -- 172.21.15.1:0/2277166254 shutdown_connections 2023-11-15T01:33:40.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.775+0000 7f3e322d6700 1 --2- 172.21.15.1:0/2277166254 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e0c05f270 0x7f3e0c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:40.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.775+0000 7f3e322d6700 1 --2- 172.21.15.1:0/2277166254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e2c13a980 0x7f3e2c0bdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.775+0000 7f3e322d6700 1 --2- 172.21.15.1:0/2277166254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e2c0bcd20 0x7f3e2c139cc0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.775+0000 7f3e322d6700 1 --2- 172.21.15.1:0/2277166254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e2c0c5900 0x7f3e2c0a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.775+0000 7f3e322d6700 1 -- 172.21.15.1:0/2277166254 >> 172.21.15.1:0/2277166254 conn(0x7f3e2c063280 msgr2=0x7f3e2c0abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:40.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.775+0000 7f3e322d6700 1 -- 172.21.15.1:0/2277166254 shutdown_connections 2023-11-15T01:33:40.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.775+0000 7f3e322d6700 1 -- 172.21.15.1:0/2277166254 wait complete. 2023-11-15T01:33:40.788 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T01:33:40.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.913+0000 7fe20abe6700 1 Processor -- start 2023-11-15T01:33:40.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.913+0000 7fe20abe6700 1 -- start start 2023-11-15T01:33:40.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.914+0000 7fe20abe6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe20414eae0 0x7fe204151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.914+0000 7fe20abe6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2040c6450 0x7fe2040c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.914+0000 7fe20abe6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2040c2650 con 0x7fe2040c5fa0 2023-11-15T01:33:40.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.914+0000 7fe20abe6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2041559d0 con 0x7fe20414eae0 2023-11-15T01:33:40.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.914+0000 7fe20abe6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2040c68c0 con 0x7fe2040c6450 2023-11-15T01:33:40.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.914+0000 7fe2093e3700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe2040c5fa0 0x7fe2040c4ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45002/0 (socket says 172.21.15.1:45002) 2023-11-15T01:33:40.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.914+0000 7fe2093e3700 1 -- 172.21.15.1:0/158251582 learned_addr learned my addr 172.21.15.1:0/158251582 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:40.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.914+0000 7fe209be4700 1 --2- 172.21.15.1:0/158251582 >> v2:172.21.15.141:3300/0 conn(0x7fe20414eae0 0x7fe204151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.914+0000 7fe20a3e5700 1 --2- 172.21.15.1:0/158251582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2040c6450 0x7fe2040c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.914+0000 7fe208be2700 1 -- 172.21.15.1:0/158251582 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267370555 0 0) 0x7fe2040c2650 con 0x7fe2040c5fa0 2023-11-15T01:33:40.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.914+0000 7fe208be2700 1 -- 172.21.15.1:0/158251582 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1f00033f0 con 0x7fe2040c5fa0 2023-11-15T01:33:40.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.914+0000 7fe208be2700 1 -- 172.21.15.1:0/158251582 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2494319410 0 0) 0x7fe1f00033f0 con 0x7fe2040c5fa0 2023-11-15T01:33:40.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 -- 172.21.15.1:0/158251582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2040c6450 msgr2=0x7fe2040c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:40.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 --2- 172.21.15.1:0/158251582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2040c6450 0x7fe2040c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 -- 172.21.15.1:0/158251582 >> v2:172.21.15.141:3300/0 conn(0x7fe20414eae0 msgr2=0x7fe204151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:40.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 --2- 172.21.15.1:0/158251582 >> v2:172.21.15.141:3300/0 conn(0x7fe20414eae0 0x7fe204151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 -- 172.21.15.1:0/158251582 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20414eec0 con 0x7fe2040c5fa0 2023-11-15T01:33:40.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 -- 172.21.15.1:0/158251582 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fe1f4001470 con 0x7fe2040c5fa0 2023-11-15T01:33:40.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe209be4700 1 --2- 172.21.15.1:0/158251582 >> v2:172.21.15.141:3300/0 conn(0x7fe20414eae0 0x7fe204151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:40.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe20a3e5700 1 --2- 172.21.15.1:0/158251582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2040c6450 0x7fe2040c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:40.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 -- 172.21.15.1:0/158251582 >> v1:172.21.15.1:6789/0 conn(0x7fe2040c5fa0 legacy=0x7fe2040c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 --2- 172.21.15.1:0/158251582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2040c6450 0x7fe1f00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 --2- 172.21.15.1:0/158251582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1f0003dd0 0x7fe1f0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 --2- 172.21.15.1:0/158251582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe1f0004b80 0x7fe1f0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 -- 172.21.15.1:0/158251582 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2041559d0 con 0x7fe1f0003dd0 2023-11-15T01:33:40.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 -- 172.21.15.1:0/158251582 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2040c68c0 con 0x7fe1f0004b80 2023-11-15T01:33:40.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 -- 172.21.15.1:0/158251582 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f000b8e0 con 0x7fe2040c6450 2023-11-15T01:33:40.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe2093e3700 1 --2- 172.21.15.1:0/158251582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1f0003dd0 0x7fe1f0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe209be4700 1 --2- 172.21.15.1:0/158251582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2040c6450 0x7fe1f00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe20a3e5700 1 --2- 172.21.15.1:0/158251582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe1f0004b80 0x7fe1f0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe2093e3700 1 -- 172.21.15.1:0/158251582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2040c6450 msgr2=0x7fe1f00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:40.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe2093e3700 1 --2- 172.21.15.1:0/158251582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2040c6450 0x7fe1f00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe2093e3700 1 -- 172.21.15.1:0/158251582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe1f0004b80 msgr2=0x7fe1f0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:40.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe2093e3700 1 --2- 172.21.15.1:0/158251582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe1f0004b80 0x7fe1f0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe2093e3700 1 -- 172.21.15.1:0/158251582 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc009a20 con 0x7fe1f0003dd0 2023-11-15T01:33:40.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe209be4700 1 --2- 172.21.15.1:0/158251582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2040c6450 0x7fe1f00038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:40.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe2093e3700 1 --2- 172.21.15.1:0/158251582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1f0003dd0 0x7fe1f0004690 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fe1f400c210 tx=0x7fe1f4001e90).ready entity=mon.0 client_cookie=ac0a21f3ea506a31 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:40.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 -- 172.21.15.1:0/158251582 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4007a60 con 0x7fe1f0003dd0 2023-11-15T01:33:40.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 -- 172.21.15.1:0/158251582 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f400cae0 con 0x7fe1f0003dd0 2023-11-15T01:33:40.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.915+0000 7fe208be2700 1 -- 172.21.15.1:0/158251582 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400ce80 con 0x7fe1f0003dd0 2023-11-15T01:33:40.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.916+0000 7fe20abe6700 1 -- 172.21.15.1:0/158251582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1f0003dd0 msgr2=0x7fe1f0004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.916+0000 7fe20abe6700 1 --2- 172.21.15.1:0/158251582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1f0003dd0 0x7fe1f0004690 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fe1f400c210 tx=0x7fe1f4001e90).stop 2023-11-15T01:33:40.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.916+0000 7fe20a3e5700 1 -- 172.21.15.1:0/158251582 reap_dead start 2023-11-15T01:33:40.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.916+0000 7fe20abe6700 1 -- 172.21.15.1:0/158251582 shutdown_connections 2023-11-15T01:33:40.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.916+0000 7fe20abe6700 1 -- 172.21.15.1:0/158251582 >> 172.21.15.1:0/158251582 conn(0x7fe2040c3e30 msgr2=0x7fe2040c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:40.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.916+0000 7fe20abe6700 1 -- 172.21.15.1:0/158251582 shutdown_connections 2023-11-15T01:33:40.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.916+0000 7fe20abe6700 1 -- 172.21.15.1:0/158251582 wait complete. 2023-11-15T01:33:40.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.917+0000 7fe20abe6700 1 Processor -- start 2023-11-15T01:33:40.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.917+0000 7fe20abe6700 1 -- start start 2023-11-15T01:33:40.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.918+0000 7fe20abe6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1f0003dd0 0x7fe2040befb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.918+0000 7fe20abe6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2041642b0 0x7fe2041680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.918+0000 7fe20abe6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe204164730 0x7fe2041685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.918+0000 7fe20abe6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2040beb90 con 0x7fe2041642b0 2023-11-15T01:33:40.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.918+0000 7fe20abe6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe204168ac0 con 0x7fe204164730 2023-11-15T01:33:40.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.918+0000 7fe20abe6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2040a9cd0 con 0x7fe1f0003dd0 2023-11-15T01:33:40.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.918+0000 7fe2093e3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2041642b0 0x7fe2041680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.918+0000 7fe2093e3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2041642b0 0x7fe2041680e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38088/0 (socket says 172.21.15.1:38088) 2023-11-15T01:33:40.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.918+0000 7fe2093e3700 1 -- 172.21.15.1:0/2252561099 learned_addr learned my addr 172.21.15.1:0/2252561099 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:40.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.918+0000 7fe209be4700 1 --2- 172.21.15.1:0/2252561099 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1f0003dd0 0x7fe2040befb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.918+0000 7fe20a3e5700 1 --2- 172.21.15.1:0/2252561099 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe204164730 0x7fe2041685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:40.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.919+0000 7fe2093e3700 1 -- 172.21.15.1:0/2252561099 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1f0003dd0 msgr2=0x7fe2040befb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.919+0000 7fe2093e3700 1 --2- 172.21.15.1:0/2252561099 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1f0003dd0 0x7fe2040befb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.919+0000 7fe2093e3700 1 -- 172.21.15.1:0/2252561099 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe204164730 msgr2=0x7fe2041685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:40.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.919+0000 7fe2093e3700 1 --2- 172.21.15.1:0/2252561099 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe204164730 0x7fe2041685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:40.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.919+0000 7fe2093e3700 1 -- 172.21.15.1:0/2252561099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe204168ca0 con 0x7fe2041642b0 2023-11-15T01:33:40.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.919+0000 7fe2093e3700 1 --2- 172.21.15.1:0/2252561099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2041642b0 0x7fe2041680e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fe1f0004560 tx=0x7fe1f4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:40.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.919+0000 7fe1f9ffb700 1 -- 172.21.15.1:0/2252561099 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4007a60 con 0x7fe2041642b0 2023-11-15T01:33:40.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.919+0000 7fe1f9ffb700 1 -- 172.21.15.1:0/2252561099 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f40074f0 con 0x7fe2041642b0 2023-11-15T01:33:40.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.919+0000 7fe20abe6700 1 -- 172.21.15.1:0/2252561099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe204168f80 con 0x7fe2041642b0 2023-11-15T01:33:40.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.919+0000 7fe1f9ffb700 1 -- 172.21.15.1:0/2252561099 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f40046b0 con 0x7fe2041642b0 2023-11-15T01:33:40.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.919+0000 7fe20abe6700 1 -- 172.21.15.1:0/2252561099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2040be7b0 con 0x7fe2041642b0 2023-11-15T01:33:40.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.920+0000 7fe20abe6700 1 -- 172.21.15.1:0/2252561099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2040475e0 con 0x7fe2041642b0 2023-11-15T01:33:40.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.920+0000 7fe1f9ffb700 1 -- 172.21.15.1:0/2252561099 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fe1f4004a20 con 0x7fe2041642b0 2023-11-15T01:33:40.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.921+0000 7fe1f9ffb700 1 --2- 172.21.15.1:0/2252561099 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe1e805f2a0 0x7fe1e8061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:40.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.921+0000 7fe1f9ffb700 1 -- 172.21.15.1:0/2252561099 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7302+0+0 (secure 0 0 0) 0x7fe1f4019020 con 0x7fe2041642b0 2023-11-15T01:33:40.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.921+0000 7fe209be4700 1 -- 172.21.15.1:0/2252561099 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe1e805f2a0 msgr2=0x7fe1e8061760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:40.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.921+0000 7fe209be4700 1 --2- 172.21.15.1:0/2252561099 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe1e805f2a0 0x7fe1e8061760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:33:40.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:40.925+0000 7fe1f9ffb700 1 -- 172.21.15.1:0/2252561099 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe1f404c880 con 0x7fe2041642b0 2023-11-15T01:33:40.937 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:40.935+0000 7efec695e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:33:41.040 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:41.038+0000 7efec695e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:33:41.086 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:41.085+0000 7fae2002a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:33:41.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.098+0000 7fe20abe6700 1 -- 172.21.15.1:0/2252561099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe204154e50 con 0x7fe2041642b0 2023-11-15T01:33:41.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.098+0000 7fe1f9ffb700 1 -- 172.21.15.1:0/2252561099 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1f404fea0 con 0x7fe2041642b0 2023-11-15T01:33:41.100 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:33:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.100+0000 7fe20abe6700 1 -- 172.21.15.1:0/2252561099 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe1e805f2a0 msgr2=0x7fe1e8061760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:33:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.100+0000 7fe20abe6700 1 --2- 172.21.15.1:0/2252561099 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe1e805f2a0 0x7fe1e8061760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.100+0000 7fe20abe6700 1 -- 172.21.15.1:0/2252561099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2041642b0 msgr2=0x7fe2041680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.100+0000 7fe20abe6700 1 --2- 172.21.15.1:0/2252561099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2041642b0 0x7fe2041680e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fe1f0004560 tx=0x7fe1f4015000).stop 2023-11-15T01:33:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.100+0000 7fe20abe6700 1 -- 172.21.15.1:0/2252561099 shutdown_connections 2023-11-15T01:33:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.100+0000 7fe20abe6700 1 --2- 172.21.15.1:0/2252561099 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe1e805f2a0 0x7fe1e8061760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.100+0000 7fe20abe6700 1 --2- 172.21.15.1:0/2252561099 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe204164730 0x7fe2041685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.100+0000 7fe20abe6700 1 --2- 172.21.15.1:0/2252561099 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1f0003dd0 0x7fe2040befb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.100+0000 7fe20abe6700 1 --2- 172.21.15.1:0/2252561099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2041642b0 0x7fe2041680e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.100+0000 7fe20abe6700 1 -- 172.21.15.1:0/2252561099 >> 172.21.15.1:0/2252561099 conn(0x7fe2040c3e30 msgr2=0x7fe2040654e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.100+0000 7fe20abe6700 1 -- 172.21.15.1:0/2252561099 shutdown_connections 2023-11-15T01:33:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.100+0000 7fe20abe6700 1 -- 172.21.15.1:0/2252561099 wait complete. 2023-11-15T01:33:41.117 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T01:33:41.196 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:41.194+0000 7efec695e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:33:41.203 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:41.202+0000 7fae2002a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:33:41.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.242+0000 7f9326c19700 1 Processor -- start 2023-11-15T01:33:41.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.242+0000 7f9326c19700 1 -- start start 2023-11-15T01:33:41.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9326c19700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f93200c50b0 0x7f93200c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9326c19700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f93200bc410 0x7f93200bd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9326c19700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93200c1990 0x7f93200637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9326c19700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93200bd820 con 0x7f93200c50b0 2023-11-15T01:33:41.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9326c19700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932006bb50 con 0x7f93200bc410 2023-11-15T01:33:41.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9326c19700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93200627b0 con 0x7f93200c1990 2023-11-15T01:33:41.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9325c17700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f93200c50b0 0x7f93200c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9325c17700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f93200c50b0 0x7f93200c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38098/0 (socket says 172.21.15.1:38098) 2023-11-15T01:33:41.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9325c17700 1 -- 172.21.15.1:0/3620108010 learned_addr learned my addr 172.21.15.1:0/3620108010 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:41.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9326418700 1 --2- 172.21.15.1:0/3620108010 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93200c1990 0x7f93200637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9325416700 1 --2- 172.21.15.1:0/3620108010 >> v2:172.21.15.141:3300/0 conn(0x7f93200bc410 0x7f93200bd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9325c17700 1 -- 172.21.15.1:0/3620108010 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93200c1990 msgr2=0x7f93200637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:41.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9325c17700 1 --2- 172.21.15.1:0/3620108010 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93200c1990 0x7f93200637c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9325c17700 1 -- 172.21.15.1:0/3620108010 >> v2:172.21.15.141:3300/0 conn(0x7f93200bc410 msgr2=0x7f93200bd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:41.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9325c17700 1 --2- 172.21.15.1:0/3620108010 >> v2:172.21.15.141:3300/0 conn(0x7f93200bc410 0x7f93200bd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.243+0000 7f9325c17700 1 -- 172.21.15.1:0/3620108010 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9320062a00 con 0x7f93200c50b0 2023-11-15T01:33:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.244+0000 7f9325c17700 1 --2- 172.21.15.1:0/3620108010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93200c50b0 0x7f93200c5490 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f93200ad560 tx=0x7f93100090f0).ready entity=mon.0 client_cookie=32a4083f93a39819 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.244+0000 7f9324c15700 1 -- 172.21.15.1:0/3620108010 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931000f510 con 0x7f93200c50b0 2023-11-15T01:33:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.244+0000 7f9324c15700 1 -- 172.21.15.1:0/3620108010 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931000f670 con 0x7f93200c50b0 2023-11-15T01:33:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.244+0000 7f9324c15700 1 -- 172.21.15.1:0/3620108010 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931000fa10 con 0x7f93200c50b0 2023-11-15T01:33:41.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.244+0000 7f9326c19700 1 -- 172.21.15.1:0/3620108010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93200c50b0 msgr2=0x7f93200c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:41.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.244+0000 7f9326c19700 1 --2- 172.21.15.1:0/3620108010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93200c50b0 0x7f93200c5490 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f93200ad560 tx=0x7f93100090f0).stop 2023-11-15T01:33:41.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.244+0000 7f9326c19700 1 -- 172.21.15.1:0/3620108010 shutdown_connections 2023-11-15T01:33:41.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.244+0000 7f9326c19700 1 --2- 172.21.15.1:0/3620108010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93200c50b0 0x7f93200c5490 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.244+0000 7f9326c19700 1 --2- 172.21.15.1:0/3620108010 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93200c1990 0x7f93200637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.244+0000 7f9326c19700 1 --2- 172.21.15.1:0/3620108010 >> v2:172.21.15.141:3300/0 conn(0x7f93200bc410 0x7f93200bd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.244+0000 7f9326c19700 1 -- 172.21.15.1:0/3620108010 >> 172.21.15.1:0/3620108010 conn(0x7f93200c3e30 msgr2=0x7f93200c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:41.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.244+0000 7f9326c19700 1 -- 172.21.15.1:0/3620108010 shutdown_connections 2023-11-15T01:33:41.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.244+0000 7f9326c19700 1 -- 172.21.15.1:0/3620108010 wait complete. 2023-11-15T01:33:41.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.245+0000 7f9326c19700 1 Processor -- start 2023-11-15T01:33:41.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.246+0000 7f9326c19700 1 -- start start 2023-11-15T01:33:41.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.246+0000 7f9326c19700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93200bc410 0x7f93200a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.246+0000 7f9326c19700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93200c1990 0x7f93200ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.246+0000 7f9326c19700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93200c50b0 0x7f93200a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.246+0000 7f9326c19700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93200ab080 con 0x7f93200c1990 2023-11-15T01:33:41.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.246+0000 7f9326c19700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93200aa470 con 0x7f93200c50b0 2023-11-15T01:33:41.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.246+0000 7f9326c19700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93200aa750 con 0x7f93200bc410 2023-11-15T01:33:41.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.246+0000 7f9325416700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93200c1990 0x7f93200ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.246+0000 7f9325416700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93200c1990 0x7f93200ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38112/0 (socket says 172.21.15.1:38112) 2023-11-15T01:33:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.246+0000 7f9325416700 1 -- 172.21.15.1:0/912169550 learned_addr learned my addr 172.21.15.1:0/912169550 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.246+0000 7f9325c17700 1 --2- 172.21.15.1:0/912169550 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93200bc410 0x7f93200a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.247+0000 7f9326418700 1 --2- 172.21.15.1:0/912169550 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93200c50b0 0x7f93200a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.247+0000 7f9325416700 1 -- 172.21.15.1:0/912169550 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93200bc410 msgr2=0x7f93200a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:41.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.247+0000 7f9325416700 1 --2- 172.21.15.1:0/912169550 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93200bc410 0x7f93200a9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.247+0000 7f9325416700 1 -- 172.21.15.1:0/912169550 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93200c50b0 msgr2=0x7f93200a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:41.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.247+0000 7f9325416700 1 --2- 172.21.15.1:0/912169550 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93200c50b0 0x7f93200a55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.247+0000 7f9325416700 1 -- 172.21.15.1:0/912169550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9310009370 con 0x7f93200c1990 2023-11-15T01:33:41.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.247+0000 7f9326418700 1 --2- 172.21.15.1:0/912169550 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93200c50b0 0x7f93200a55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:41.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.247+0000 7f9325416700 1 --2- 172.21.15.1:0/912169550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93200c1990 0x7f93200ab510 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f931c00e8d0 tx=0x7f931c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:41.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.247+0000 7f9315ffb700 1 -- 172.21.15.1:0/912169550 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c009390 con 0x7f93200c1990 2023-11-15T01:33:41.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.247+0000 7f9315ffb700 1 -- 172.21.15.1:0/912169550 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c012600 con 0x7f93200c1990 2023-11-15T01:33:41.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.247+0000 7f9326c19700 1 -- 172.21.15.1:0/912169550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93200aaa30 con 0x7f93200c1990 2023-11-15T01:33:41.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.247+0000 7f9315ffb700 1 -- 172.21.15.1:0/912169550 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c012980 con 0x7f93200c1990 2023-11-15T01:33:41.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.247+0000 7f9326c19700 1 -- 172.21.15.1:0/912169550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93200ac9c0 con 0x7f93200c1990 2023-11-15T01:33:41.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.248+0000 7f9326c19700 1 -- 172.21.15.1:0/912169550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93200475e0 con 0x7f93200c1990 2023-11-15T01:33:41.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.248+0000 7f9315ffb700 1 -- 172.21.15.1:0/912169550 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f931c012d30 con 0x7f93200c1990 2023-11-15T01:33:41.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.249+0000 7f9315ffb700 1 --2- 172.21.15.1:0/912169550 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f930405f270 0x7f9304061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.249+0000 7f9315ffb700 1 -- 172.21.15.1:0/912169550 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6762+0+0 (secure 0 0 0) 0x7f931c07a920 con 0x7f93200c1990 2023-11-15T01:33:41.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.249+0000 7f9325c17700 1 -- 172.21.15.1:0/912169550 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f930405f270 msgr2=0x7f9304061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:41.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.249+0000 7f9325c17700 1 --2- 172.21.15.1:0/912169550 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f930405f270 0x7f9304061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:33:41.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.253+0000 7f9315ffb700 1 -- 172.21.15.1:0/912169550 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f931c04b7f0 con 0x7f93200c1990 2023-11-15T01:33:41.270 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:41.269+0000 7efec695e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:33:41.337 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:41.335+0000 7efec695e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:33:41.364 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:41.363+0000 7fae2002a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:33:41.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.426+0000 7f9326c19700 1 -- 172.21.15.1:0/912169550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f93200ab1c0 con 0x7f93200c1990 2023-11-15T01:33:41.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.427+0000 7f9315ffb700 1 -- 172.21.15.1:0/912169550 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f931c016070 con 0x7f93200c1990 2023-11-15T01:33:41.429 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:33:41.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.429+0000 7f9326c19700 1 -- 172.21.15.1:0/912169550 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f930405f270 msgr2=0x7f9304061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:33:41.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.429+0000 7f9326c19700 1 --2- 172.21.15.1:0/912169550 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f930405f270 0x7f9304061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:41.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.429+0000 7f9326c19700 1 -- 172.21.15.1:0/912169550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93200c1990 msgr2=0x7f93200ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:41.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.429+0000 7f9326c19700 1 --2- 172.21.15.1:0/912169550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93200c1990 0x7f93200ab510 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f931c00e8d0 tx=0x7f931c009060).stop 2023-11-15T01:33:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.429+0000 7f9326c19700 1 -- 172.21.15.1:0/912169550 shutdown_connections 2023-11-15T01:33:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.429+0000 7f9326c19700 1 --2- 172.21.15.1:0/912169550 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f930405f270 0x7f9304061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.429+0000 7f9326c19700 1 --2- 172.21.15.1:0/912169550 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93200c50b0 0x7f93200a55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.429+0000 7f9326c19700 1 --2- 172.21.15.1:0/912169550 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93200bc410 0x7f93200a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.429+0000 7f9326c19700 1 --2- 172.21.15.1:0/912169550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93200c1990 0x7f93200ab510 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.429+0000 7f9326c19700 1 -- 172.21.15.1:0/912169550 >> 172.21.15.1:0/912169550 conn(0x7f93200c3e30 msgr2=0x7f9320065ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.429+0000 7f9326c19700 1 -- 172.21.15.1:0/912169550 shutdown_connections 2023-11-15T01:33:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.429+0000 7f9326c19700 1 -- 172.21.15.1:0/912169550 wait complete. 2023-11-15T01:33:41.443 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:33:41.444 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:41.443+0000 7fae2002a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:33:41.517 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:41.516+0000 7fae2002a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:33:41.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.567+0000 7fc836350700 1 Processor -- start 2023-11-15T01:33:41.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.567+0000 7fc836350700 1 -- start start 2023-11-15T01:33:41.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.568+0000 7fc836350700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc830154180 0x7fc830158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.568+0000 7fc836350700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc830154560 0x7fc830063bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.568+0000 7fc836350700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc830064e80 con 0x7fc8300aa640 2023-11-15T01:33:41.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.568+0000 7fc836350700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8301585e0 con 0x7fc830154560 2023-11-15T01:33:41.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.568+0000 7fc836350700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8301588c0 con 0x7fc830154180 2023-11-15T01:33:41.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.568+0000 7fc82f7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc830154560 0x7fc830063bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.568+0000 7fc82f7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc830154560 0x7fc830063bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38122/0 (socket says 172.21.15.1:38122) 2023-11-15T01:33:41.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.568+0000 7fc82f7fe700 1 -- 172.21.15.1:0/813049366 learned_addr learned my addr 172.21.15.1:0/813049366 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:41.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.568+0000 7fc82ffff700 1 --2- 172.21.15.1:0/813049366 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc830154180 0x7fc830158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.568+0000 7fc82f7fe700 1 -- 172.21.15.1:0/813049366 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc830154180 msgr2=0x7fc830158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:41.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.568+0000 7fc82f7fe700 1 --2- 172.21.15.1:0/813049366 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc830154180 0x7fc830158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.568+0000 7fc82effd700 1 -- 172.21.15.1:0/813049366 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265045929 0 0) 0x7fc830064e80 con 0x7fc8300aa640 2023-11-15T01:33:41.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.568+0000 7fc82f7fe700 1 -- 172.21.15.1:0/813049366 >> v1:172.21.15.141:6789/0 conn(0x7fc8300aa640 legacy=0x7fc8300c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:41.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.568+0000 7fc82f7fe700 1 -- 172.21.15.1:0/813049366 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc830158ba0 con 0x7fc830154560 2023-11-15T01:33:41.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.568+0000 7fc82ffff700 1 --2- 172.21.15.1:0/813049366 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc830154180 0x7fc830158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:41.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.569+0000 7fc82f7fe700 1 --2- 172.21.15.1:0/813049366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc830154560 0x7fc830063bf0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fc818006fd0 tx=0x7fc8180090f0).ready entity=mon.0 client_cookie=eac4bc1489209e60 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:41.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.569+0000 7fc82effd700 1 -- 172.21.15.1:0/813049366 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81800b580 con 0x7fc830154560 2023-11-15T01:33:41.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.569+0000 7fc82effd700 1 -- 172.21.15.1:0/813049366 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81800b6e0 con 0x7fc830154560 2023-11-15T01:33:41.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.569+0000 7fc82effd700 1 -- 172.21.15.1:0/813049366 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81800ba60 con 0x7fc830154560 2023-11-15T01:33:41.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.569+0000 7fc836350700 1 -- 172.21.15.1:0/813049366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc830154560 msgr2=0x7fc830063bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:41.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.569+0000 7fc836350700 1 --2- 172.21.15.1:0/813049366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc830154560 0x7fc830063bf0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fc818006fd0 tx=0x7fc8180090f0).stop 2023-11-15T01:33:41.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.569+0000 7fc836350700 1 -- 172.21.15.1:0/813049366 shutdown_connections 2023-11-15T01:33:41.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.569+0000 7fc836350700 1 --2- 172.21.15.1:0/813049366 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc830154180 0x7fc830158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.569+0000 7fc836350700 1 --2- 172.21.15.1:0/813049366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc830154560 0x7fc830063bf0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.569+0000 7fc836350700 1 -- 172.21.15.1:0/813049366 >> 172.21.15.1:0/813049366 conn(0x7fc8300c74f0 msgr2=0x7fc8300c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:41.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.569+0000 7fc836350700 1 -- 172.21.15.1:0/813049366 shutdown_connections 2023-11-15T01:33:41.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.569+0000 7fc836350700 1 -- 172.21.15.1:0/813049366 wait complete. 2023-11-15T01:33:41.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.571+0000 7fc836350700 1 Processor -- start 2023-11-15T01:33:41.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.571+0000 7fc836350700 1 -- start start 2023-11-15T01:33:41.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.571+0000 7fc836350700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8300aa640 0x7fc8300a7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.571+0000 7fc836350700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc830154180 0x7fc830164eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc836350700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc830154560 0x7fc8301549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc836350700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc830155a00 con 0x7fc830154180 2023-11-15T01:33:41.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc836350700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc830156700 con 0x7fc8300aa640 2023-11-15T01:33:41.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc836350700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc830154e90 con 0x7fc830154560 2023-11-15T01:33:41.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc82f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc830154180 0x7fc830164eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc82f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc830154180 0x7fc830164eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38138/0 (socket says 172.21.15.1:38138) 2023-11-15T01:33:41.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc82f7fe700 1 -- 172.21.15.1:0/1911435533 learned_addr learned my addr 172.21.15.1:0/1911435533 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:41.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc82ffff700 1 --2- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8300aa640 0x7fc8300a7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc8348ed700 1 --2- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc830154560 0x7fc8301549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc82f7fe700 1 -- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc830154560 msgr2=0x7fc8301549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:41.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc82f7fe700 1 --2- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc830154560 0x7fc8301549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc82f7fe700 1 -- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8300aa640 msgr2=0x7fc8300a7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:41.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc82f7fe700 1 --2- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8300aa640 0x7fc8300a7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc82f7fe700 1 -- 172.21.15.1:0/1911435533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8200092a0 con 0x7fc830154180 2023-11-15T01:33:41.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc82f7fe700 1 --2- 172.21.15.1:0/1911435533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc830154180 0x7fc830164eb0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fc818011000 tx=0x7fc818017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:41.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc827fff700 1 -- 172.21.15.1:0/1911435533 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818000bc0 con 0x7fc830154180 2023-11-15T01:33:41.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc827fff700 1 -- 172.21.15.1:0/1911435533 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81800b850 con 0x7fc830154180 2023-11-15T01:33:41.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc827fff700 1 -- 172.21.15.1:0/1911435533 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818000d20 con 0x7fc830154180 2023-11-15T01:33:41.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc836350700 1 -- 172.21.15.1:0/1911435533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc818009370 con 0x7fc830154180 2023-11-15T01:33:41.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.572+0000 7fc836350700 1 -- 172.21.15.1:0/1911435533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc830155440 con 0x7fc830154180 2023-11-15T01:33:41.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.573+0000 7fc836350700 1 -- 172.21.15.1:0/1911435533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8301564d0 con 0x7fc830154180 2023-11-15T01:33:41.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.574+0000 7fc827fff700 1 -- 172.21.15.1:0/1911435533 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fc81801ca90 con 0x7fc830154180 2023-11-15T01:33:41.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.574+0000 7fc827fff700 1 --2- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc81005f270 0x7fc810061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.574+0000 7fc827fff700 1 -- 172.21.15.1:0/1911435533 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6762+0+0 (secure 0 0 0) 0x7fc81807bf70 con 0x7fc830154180 2023-11-15T01:33:41.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.574+0000 7fc82ffff700 1 -- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc81005f270 msgr2=0x7fc810061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:41.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.574+0000 7fc82ffff700 1 --2- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc81005f270 0x7fc810061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:33:41.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.579+0000 7fc827fff700 1 -- 172.21.15.1:0/1911435533 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc81804ce40 con 0x7fc830154180 2023-11-15T01:33:41.600 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:41.598+0000 7efec695e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:33:41.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.775+0000 7fc82ffff700 1 -- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc81005f270 msgr2=0x7fc810061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:41.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.775+0000 7fc82ffff700 1 --2- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc81005f270 0x7fc810061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:33:41.785 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:41.784+0000 7efec695e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:33:41.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.796+0000 7fc836350700 1 -- 172.21.15.1:0/1911435533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc830156890 con 0x7fc830154180 2023-11-15T01:33:41.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.796+0000 7fc827fff700 1 -- 172.21.15.1:0/1911435533 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4486 (secure 0 0 0) 0x7fc818020070 con 0x7fc830154180 2023-11-15T01:33:41.798 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:41.798 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1019024578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1019024578},{"type":"v1","addr":"172.21.15.1:6835","nonce":1019024578}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4622,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/571718542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":571718542},{"type":"v1","addr":"172.21.15.141:6837","nonce":571718542}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/4111687819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":4111687819},{"type":"v1","addr":"172.21.15.141:6836","nonce":4111687819}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:22:23.228899+0000","modified":"2023-11-15T01:22:26.233026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6834/3374581715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3374581715},{"type":"v1","addr":"172.21.15.1:6834","nonce":3374581715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-11-15T01:33:41.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.798+0000 7fc836350700 1 -- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc81005f270 msgr2=0x7fc810061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:33:41.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.798+0000 7fc836350700 1 --2- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc81005f270 0x7fc810061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:41.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.798+0000 7fc836350700 1 -- 172.21.15.1:0/1911435533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc830154180 msgr2=0x7fc830164eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:41.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.798+0000 7fc836350700 1 --2- 172.21.15.1:0/1911435533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc830154180 0x7fc830164eb0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fc818011000 tx=0x7fc818017000).stop 2023-11-15T01:33:41.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.798+0000 7fc836350700 1 -- 172.21.15.1:0/1911435533 shutdown_connections 2023-11-15T01:33:41.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.798+0000 7fc836350700 1 --2- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc81005f270 0x7fc810061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:41.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.798+0000 7fc836350700 1 --2- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc830154560 0x7fc8301549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.798+0000 7fc836350700 1 --2- 172.21.15.1:0/1911435533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8300aa640 0x7fc8300a7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.798+0000 7fc836350700 1 --2- 172.21.15.1:0/1911435533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc830154180 0x7fc830164eb0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.798+0000 7fc836350700 1 -- 172.21.15.1:0/1911435533 >> 172.21.15.1:0/1911435533 conn(0x7fc8300c74f0 msgr2=0x7fc8300ad040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:41.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.798+0000 7fc836350700 1 -- 172.21.15.1:0/1911435533 shutdown_connections 2023-11-15T01:33:41.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.798+0000 7fc836350700 1 -- 172.21.15.1:0/1911435533 wait complete. 2023-11-15T01:33:41.802 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 15 2023-11-15T01:33:41.803 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:41.802+0000 7fae2002a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:33:41.812 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:33:41.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.933+0000 7efee0236700 1 Processor -- start 2023-11-15T01:33:41.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.934+0000 7efee0236700 1 -- start start 2023-11-15T01:33:41.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.934+0000 7efee0236700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efed8154450 0x7efed80a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.934+0000 7efee0236700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efed80be520 0x7efed8154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.934+0000 7efee0236700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed80a85e0 con 0x7efed80833a0 2023-11-15T01:33:41.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.934+0000 7efee0236700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed8065940 con 0x7efed8154450 2023-11-15T01:33:41.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.934+0000 7efee0236700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed8065660 con 0x7efed80be520 2023-11-15T01:33:41.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efede7d3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efed80be520 0x7efed8154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efeddfd2700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efed8154450 0x7efed80a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efedd7d1700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7efed80833a0 0x7efed80bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:38788/0 (socket says 172.21.15.1:38788) 2023-11-15T01:33:41.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efeddfd2700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efed8154450 0x7efed80a7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:34144/0 (socket says 172.21.15.1:34144) 2023-11-15T01:33:41.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efedd7d1700 1 -- 172.21.15.1:0/2112949139 learned_addr learned my addr 172.21.15.1:0/2112949139 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:41.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efede7d3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efed80be520 0x7efed8154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:44482/0 (socket says 172.21.15.1:44482) 2023-11-15T01:33:41.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efeddfd2700 1 -- 172.21.15.1:0/2112949139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efed80be520 msgr2=0x7efed8154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:41.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efeddfd2700 1 --2- 172.21.15.1:0/2112949139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efed80be520 0x7efed8154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efeddfd2700 1 -- 172.21.15.1:0/2112949139 >> v1:172.21.15.141:6789/0 conn(0x7efed80833a0 legacy=0x7efed80bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:41.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efedcfd0700 1 -- 172.21.15.1:0/2112949139 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435993602 0 0) 0x7efed80a85e0 con 0x7efed80833a0 2023-11-15T01:33:41.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efeddfd2700 1 -- 172.21.15.1:0/2112949139 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed80c6f50 con 0x7efed8154450 2023-11-15T01:33:41.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efede7d3700 1 --2- 172.21.15.1:0/2112949139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efed80be520 0x7efed8154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:41.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efeddfd2700 1 --2- 172.21.15.1:0/2112949139 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efed8154450 0x7efed80a7ef0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7efec8006fd0 tx=0x7efec8006f40).ready entity=mon.1 client_cookie=a469cb3529939228 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:41.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efedcfd0700 1 -- 172.21.15.1:0/2112949139 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8005880 con 0x7efed8154450 2023-11-15T01:33:41.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efedcfd0700 1 -- 172.21.15.1:0/2112949139 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec80059e0 con 0x7efed8154450 2023-11-15T01:33:41.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.935+0000 7efedcfd0700 1 -- 172.21.15.1:0/2112949139 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8005d60 con 0x7efed8154450 2023-11-15T01:33:41.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.936+0000 7efee0236700 1 -- 172.21.15.1:0/2112949139 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efed8154450 msgr2=0x7efed80a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:41.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.936+0000 7efee0236700 1 --2- 172.21.15.1:0/2112949139 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efed8154450 0x7efed80a7ef0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7efec8006fd0 tx=0x7efec8006f40).stop 2023-11-15T01:33:41.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.936+0000 7efee0236700 1 -- 172.21.15.1:0/2112949139 shutdown_connections 2023-11-15T01:33:41.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.936+0000 7efee0236700 1 --2- 172.21.15.1:0/2112949139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efed80be520 0x7efed8154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.936+0000 7efee0236700 1 --2- 172.21.15.1:0/2112949139 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efed8154450 0x7efed80a7ef0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.936+0000 7efee0236700 1 -- 172.21.15.1:0/2112949139 >> 172.21.15.1:0/2112949139 conn(0x7efed8082f90 msgr2=0x7efed80c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:41.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.936+0000 7efee0236700 1 -- 172.21.15.1:0/2112949139 shutdown_connections 2023-11-15T01:33:41.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.936+0000 7efee0236700 1 -- 172.21.15.1:0/2112949139 wait complete. 2023-11-15T01:33:41.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.938+0000 7efee0236700 1 Processor -- start 2023-11-15T01:33:41.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.938+0000 7efee0236700 1 -- start start 2023-11-15T01:33:41.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.938+0000 7efee0236700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efed80833a0 0x7efed80ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.938+0000 7efee0236700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efed80be520 0x7efed8150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.938+0000 7efee0236700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efed8154450 0x7efed80acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.938+0000 7efee0236700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed80aed00 con 0x7efed80be520 2023-11-15T01:33:41.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.938+0000 7efee0236700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed80ad770 con 0x7efed80833a0 2023-11-15T01:33:41.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.938+0000 7efee0236700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80ada50 con 0x7efed8154450 2023-11-15T01:33:41.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efedd7d1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efed80be520 0x7efed8150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efede7d3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efed8154450 0x7efed80acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efeddfd2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efed80833a0 0x7efed80ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:41.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efedd7d1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efed80be520 0x7efed8150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38150/0 (socket says 172.21.15.1:38150) 2023-11-15T01:33:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efede7d3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efed8154450 0x7efed80acf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:44490/0 (socket says 172.21.15.1:44490) 2023-11-15T01:33:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efedd7d1700 1 -- 172.21.15.1:0/2957811994 learned_addr learned my addr 172.21.15.1:0/2957811994 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efeddfd2700 1 -- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efed8154450 msgr2=0x7efed80acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efeddfd2700 1 --2- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efed8154450 0x7efed80acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efeddfd2700 1 -- 172.21.15.1:0/2957811994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efed80be520 msgr2=0x7efed8150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efeddfd2700 1 --2- 172.21.15.1:0/2957811994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efed80be520 0x7efed8150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efeddfd2700 1 -- 172.21.15.1:0/2957811994 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed0009a20 con 0x7efed80833a0 2023-11-15T01:33:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efedd7d1700 1 --2- 172.21.15.1:0/2957811994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efed80be520 0x7efed8150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efede7d3700 1 --2- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efed8154450 0x7efed80acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:41.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efeddfd2700 1 --2- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efed80833a0 0x7efed80ae810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7efed8158220 tx=0x7efec8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:41.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efecdffb700 1 -- 172.21.15.1:0/2957811994 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec800f720 con 0x7efed80833a0 2023-11-15T01:33:41.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efecdffb700 1 -- 172.21.15.1:0/2957811994 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec800f8a0 con 0x7efed80833a0 2023-11-15T01:33:41.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efee0236700 1 -- 172.21.15.1:0/2957811994 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec8009250 con 0x7efed80833a0 2023-11-15T01:33:41.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.939+0000 7efecdffb700 1 -- 172.21.15.1:0/2957811994 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec800fc60 con 0x7efed80833a0 2023-11-15T01:33:41.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.940+0000 7efee0236700 1 -- 172.21.15.1:0/2957811994 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed80ae010 con 0x7efed80833a0 2023-11-15T01:33:41.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.941+0000 7efecdffb700 1 -- 172.21.15.1:0/2957811994 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7efec8011650 con 0x7efed80833a0 2023-11-15T01:33:41.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.941+0000 7efee0236700 1 -- 172.21.15.1:0/2957811994 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed80ae660 con 0x7efed80833a0 2023-11-15T01:33:41.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.941+0000 7efecdffb700 1 --2- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efebc05f270 0x7efebc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:41.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.941+0000 7efecdffb700 1 -- 172.21.15.1:0/2957811994 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6762+0+0 (secure 0 0 0) 0x7efec807bbe0 con 0x7efed80833a0 2023-11-15T01:33:41.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.941+0000 7efedd7d1700 1 -- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efebc05f270 msgr2=0x7efebc061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:41.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.941+0000 7efedd7d1700 1 --2- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efebc05f270 0x7efebc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:33:41.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:41.946+0000 7efecdffb700 1 -- 172.21.15.1:0/2957811994 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efec804ca50 con 0x7efed80833a0 2023-11-15T01:33:42.013 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:42.011+0000 7fae2002a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:33:42.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.142+0000 7efedd7d1700 1 -- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efebc05f270 msgr2=0x7efebc061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:42.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.142+0000 7efedd7d1700 1 --2- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efebc05f270 0x7efebc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:33:42.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.152+0000 7efee0236700 1 -- 172.21.15.1:0/2957811994 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efed80adb90 con 0x7efed80833a0 2023-11-15T01:33:42.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.153+0000 7efecdffb700 1 -- 172.21.15.1:0/2957811994 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+17870 (secure 0 0 0) 0x7efed80adb90 con 0x7efed80833a0 2023-11-15T01:33:42.155 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:42.155 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":47,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:33:41.131534+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:22:21.423841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-15T01:22:22.202076+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":47,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2f","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:6833/90546":"2023-11-16T01:22:35.460446+0000","172.21.15.141:6832/90546":"2023-11-16T01:22:35.460446+0000","172.21.15.141:0/1004848049":"2023-11-16T01:22:35.460446+0000","172.21.15.141:0/3577504655":"2023-11-16T01:22:35.460446+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:33:42.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.155+0000 7efee0236700 1 -- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efebc05f270 msgr2=0x7efebc061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:33:42.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.155+0000 7efee0236700 1 --2- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efebc05f270 0x7efebc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:42.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.155+0000 7efee0236700 1 -- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efed80833a0 msgr2=0x7efed80ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:42.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.155+0000 7efee0236700 1 --2- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efed80833a0 0x7efed80ae810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7efed8158220 tx=0x7efec8016000).stop 2023-11-15T01:33:42.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.155+0000 7efee0236700 1 -- 172.21.15.1:0/2957811994 shutdown_connections 2023-11-15T01:33:42.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.155+0000 7efee0236700 1 --2- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efebc05f270 0x7efebc061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:42.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.155+0000 7efee0236700 1 --2- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efed8154450 0x7efed80acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.155+0000 7efee0236700 1 --2- 172.21.15.1:0/2957811994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efed80833a0 0x7efed80ae810 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.155+0000 7efee0236700 1 --2- 172.21.15.1:0/2957811994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efed80be520 0x7efed8150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.155+0000 7efee0236700 1 -- 172.21.15.1:0/2957811994 >> 172.21.15.1:0/2957811994 conn(0x7efed8082f90 msgr2=0x7efed80be950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:42.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.156+0000 7efee0236700 1 -- 172.21.15.1:0/2957811994 shutdown_connections 2023-11-15T01:33:42.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.156+0000 7efee0236700 1 -- 172.21.15.1:0/2957811994 wait complete. 2023-11-15T01:33:42.170 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-15T01:33:42.170 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:33:42.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.289+0000 7f99add1f700 1 Processor -- start 2023-11-15T01:33:42.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.289+0000 7f99add1f700 1 -- start start 2023-11-15T01:33:42.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.290+0000 7f99add1f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f99a80ab1a0 0x7f99a8154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:42.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.290+0000 7f99add1f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a80c06f0 con 0x7f99a8154150 2023-11-15T01:33:42.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.290+0000 7f99add1f700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a80c09d0 con 0x7f99a80aa060 2023-11-15T01:33:42.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.290+0000 7f99add1f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a8158820 con 0x7f99a80ab1a0 2023-11-15T01:33:42.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.290+0000 7f99a6ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f99a80ab1a0 0x7f99a8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:42.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.290+0000 7f99a6ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f99a80ab1a0 0x7f99a8154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38166/0 (socket says 172.21.15.1:38166) 2023-11-15T01:33:42.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.290+0000 7f99a6ffd700 1 -- 172.21.15.1:0/1220211303 learned_addr learned my addr 172.21.15.1:0/1220211303 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:42.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.290+0000 7f99a77fe700 1 --1- 172.21.15.1:0/1220211303 >> v1:172.21.15.1:6789/0 conn(0x7f99a8154150 0x7f99a8158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45012/0 (socket says 172.21.15.1:45012) 2023-11-15T01:33:42.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.291+0000 7f99a6ffd700 1 -- 172.21.15.1:0/1220211303 >> v1:172.21.15.141:6789/0 conn(0x7f99a80aa060 legacy=0x7f99a80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.291+0000 7f99a6ffd700 1 -- 172.21.15.1:0/1220211303 >> v1:172.21.15.1:6789/0 conn(0x7f99a8154150 legacy=0x7f99a8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.291+0000 7f99a67fc700 1 -- 172.21.15.1:0/1220211303 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613719552 0 0) 0x7f99a80c06f0 con 0x7f99a8154150 2023-11-15T01:33:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.291+0000 7f99a6ffd700 1 -- 172.21.15.1:0/1220211303 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a8158b00 con 0x7f99a80ab1a0 2023-11-15T01:33:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.291+0000 7f99a6ffd700 1 --2- 172.21.15.1:0/1220211303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99a80ab1a0 0x7f99a8154530 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f9998006fd0 tx=0x7f99980090f0).ready entity=mon.0 client_cookie=a890ba0c490ca590 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.291+0000 7f99a67fc700 1 -- 172.21.15.1:0/1220211303 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999800b600 con 0x7f99a80ab1a0 2023-11-15T01:33:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.291+0000 7f99a67fc700 1 -- 172.21.15.1:0/1220211303 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999800b760 con 0x7f99a80ab1a0 2023-11-15T01:33:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.291+0000 7f99a67fc700 1 -- 172.21.15.1:0/1220211303 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999800bb00 con 0x7f99a80ab1a0 2023-11-15T01:33:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.291+0000 7f99add1f700 1 -- 172.21.15.1:0/1220211303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99a80ab1a0 msgr2=0x7f99a8154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.291+0000 7f99add1f700 1 --2- 172.21.15.1:0/1220211303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99a80ab1a0 0x7f99a8154530 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f9998006fd0 tx=0x7f99980090f0).stop 2023-11-15T01:33:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.291+0000 7f99add1f700 1 -- 172.21.15.1:0/1220211303 shutdown_connections 2023-11-15T01:33:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.291+0000 7f99add1f700 1 --2- 172.21.15.1:0/1220211303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99a80ab1a0 0x7f99a8154530 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.291+0000 7f99add1f700 1 -- 172.21.15.1:0/1220211303 >> 172.21.15.1:0/1220211303 conn(0x7f99a8064aa0 msgr2=0x7f99a8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.291+0000 7f99add1f700 1 -- 172.21.15.1:0/1220211303 shutdown_connections 2023-11-15T01:33:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.291+0000 7f99add1f700 1 -- 172.21.15.1:0/1220211303 wait complete. 2023-11-15T01:33:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.293+0000 7f99add1f700 1 Processor -- start 2023-11-15T01:33:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.293+0000 7f99add1f700 1 -- start start 2023-11-15T01:33:42.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.293+0000 7f99add1f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99a80aa060 0x7f99a8144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:42.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.293+0000 7f99add1f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99a80ab1a0 0x7f99a80c3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:42.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.293+0000 7f99add1f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99a8154150 0x7f99a8156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:42.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.293+0000 7f99add1f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a8145130 con 0x7f99a80ab1a0 2023-11-15T01:33:42.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.293+0000 7f99add1f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a80c3bf0 con 0x7f99a8154150 2023-11-15T01:33:42.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.293+0000 7f99add1f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a80c3ed0 con 0x7f99a80aa060 2023-11-15T01:33:42.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f99a6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99a80ab1a0 0x7f99a80c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:42.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f99a6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99a80ab1a0 0x7f99a80c3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38168/0 (socket says 172.21.15.1:38168) 2023-11-15T01:33:42.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f99a6ffd700 1 -- 172.21.15.1:0/415072287 learned_addr learned my addr 172.21.15.1:0/415072287 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:42.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f99a77fe700 1 --2- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99a80aa060 0x7f99a8144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:42.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f99a7fff700 1 --2- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99a8154150 0x7f99a8156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f99a6ffd700 1 -- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99a80aa060 msgr2=0x7f99a8144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f99a6ffd700 1 --2- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99a80aa060 0x7f99a8144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f99a6ffd700 1 -- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99a8154150 msgr2=0x7f99a8156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f99a6ffd700 1 --2- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99a8154150 0x7f99a8156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f99a6ffd700 1 -- 172.21.15.1:0/415072287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9998009370 con 0x7f99a80ab1a0 2023-11-15T01:33:42.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f99a6ffd700 1 --2- 172.21.15.1:0/415072287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99a80ab1a0 0x7f99a80c3270 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f99a8062af0 tx=0x7f9998017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:42.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f999f7fe700 1 -- 172.21.15.1:0/415072287 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999800bec0 con 0x7f99a80ab1a0 2023-11-15T01:33:42.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f999f7fe700 1 -- 172.21.15.1:0/415072287 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999800b8d0 con 0x7f99a80ab1a0 2023-11-15T01:33:42.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f999f7fe700 1 -- 172.21.15.1:0/415072287 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998024470 con 0x7f99a80ab1a0 2023-11-15T01:33:42.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f99add1f700 1 -- 172.21.15.1:0/415072287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a80c41b0 con 0x7f99a80ab1a0 2023-11-15T01:33:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.294+0000 7f99add1f700 1 -- 172.21.15.1:0/415072287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a80c4770 con 0x7f99a80ab1a0 2023-11-15T01:33:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.295+0000 7f99add1f700 1 -- 172.21.15.1:0/415072287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a80c4ae0 con 0x7f99a80ab1a0 2023-11-15T01:33:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.296+0000 7f999f7fe700 1 -- 172.21.15.1:0/415072287 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f9998021070 con 0x7f99a80ab1a0 2023-11-15T01:33:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.296+0000 7f999f7fe700 1 --2- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f998805f240 0x7f9988061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.296+0000 7f99a77fe700 1 -- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f998805f240 msgr2=0x7f9988061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.296+0000 7f999f7fe700 1 -- 172.21.15.1:0/415072287 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6762+0+0 (secure 0 0 0) 0x7f999807c170 con 0x7f99a80ab1a0 2023-11-15T01:33:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.296+0000 7f99a77fe700 1 --2- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f998805f240 0x7f9988061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:33:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.304+0000 7f999f7fe700 1 -- 172.21.15.1:0/415072287 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f999804d040 con 0x7f99a80ab1a0 2023-11-15T01:33:42.437 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:42.435+0000 7efec695e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:33:42.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.497+0000 7f99a77fe700 1 -- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f998805f240 msgr2=0x7f9988061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:42.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.497+0000 7f99a77fe700 1 --2- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f998805f240 0x7f9988061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:33:42.504 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:42.502+0000 7efec695e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:33:42.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.522+0000 7f99add1f700 1 -- 172.21.15.1:0/415072287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99a80c4900 con 0x7f99a80ab1a0 2023-11-15T01:33:42.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.523+0000 7f999f7fe700 1 -- 172.21.15.1:0/415072287 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4486 (secure 0 0 0) 0x7f9998029020 con 0x7f99a80ab1a0 2023-11-15T01:33:42.525 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:42.525 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1019024578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1019024578},{"type":"v1","addr":"172.21.15.1:6835","nonce":1019024578}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4622,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/571718542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":571718542},{"type":"v1","addr":"172.21.15.141:6837","nonce":571718542}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/4111687819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":4111687819},{"type":"v1","addr":"172.21.15.141:6836","nonce":4111687819}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:22:23.228899+0000","modified":"2023-11-15T01:22:26.233026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6834/3374581715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3374581715},{"type":"v1","addr":"172.21.15.1:6834","nonce":3374581715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-11-15T01:33:42.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.525+0000 7f99add1f700 1 -- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f998805f240 msgr2=0x7f9988061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:33:42.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.525+0000 7f99add1f700 1 --2- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f998805f240 0x7f9988061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:42.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.525+0000 7f99add1f700 1 -- 172.21.15.1:0/415072287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99a80ab1a0 msgr2=0x7f99a80c3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:42.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.525+0000 7f99add1f700 1 --2- 172.21.15.1:0/415072287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99a80ab1a0 0x7f99a80c3270 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f99a8062af0 tx=0x7f9998017000).stop 2023-11-15T01:33:42.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.525+0000 7f99add1f700 1 -- 172.21.15.1:0/415072287 shutdown_connections 2023-11-15T01:33:42.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.525+0000 7f99add1f700 1 --2- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f998805f240 0x7f9988061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:42.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.525+0000 7f99add1f700 1 --2- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99a8154150 0x7f99a8156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.525+0000 7f99add1f700 1 --2- 172.21.15.1:0/415072287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99a80aa060 0x7f99a8144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.525+0000 7f99add1f700 1 --2- 172.21.15.1:0/415072287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99a80ab1a0 0x7f99a80c3270 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.525+0000 7f99add1f700 1 -- 172.21.15.1:0/415072287 >> 172.21.15.1:0/415072287 conn(0x7f99a8064aa0 msgr2=0x7f99a8063fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:42.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.525+0000 7f99add1f700 1 -- 172.21.15.1:0/415072287 shutdown_connections 2023-11-15T01:33:42.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.525+0000 7f99add1f700 1 -- 172.21.15.1:0/415072287 wait complete. 2023-11-15T01:33:42.530 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 15 2023-11-15T01:33:42.539 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:33:42.579 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:42.577+0000 7efec695e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:33:42.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.662+0000 7fb67d77f700 1 Processor -- start 2023-11-15T01:33:42.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.662+0000 7fb67d77f700 1 -- start start 2023-11-15T01:33:42.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.663+0000 7fb67d77f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb678154150 0x7fb678154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:42.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.663+0000 7fb67d77f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb6780ab1a0 0x7fb678158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:42.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.663+0000 7fb67d77f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6780c06f0 con 0x7fb6780aa060 2023-11-15T01:33:42.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.663+0000 7fb67d77f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6780c09d0 con 0x7fb678154150 2023-11-15T01:33:42.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.663+0000 7fb67d77f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb678158820 con 0x7fb6780ab1a0 2023-11-15T01:33:42.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.663+0000 7fb676ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb678154150 0x7fb678154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:42.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.663+0000 7fb676ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb678154150 0x7fb678154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38182/0 (socket says 172.21.15.1:38182) 2023-11-15T01:33:42.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.663+0000 7fb676ffd700 1 -- 172.21.15.1:0/263597669 learned_addr learned my addr 172.21.15.1:0/263597669 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:42.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.663+0000 7fb6777fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb6780aa060 0x7fb6780c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45026/0 (socket says 172.21.15.1:45026) 2023-11-15T01:33:42.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.663+0000 7fb6767fc700 1 --2- 172.21.15.1:0/263597669 >> v2:172.21.15.141:3300/0 conn(0x7fb6780ab1a0 0x7fb678158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:42.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.663+0000 7fb676ffd700 1 -- 172.21.15.1:0/263597669 >> v2:172.21.15.141:3300/0 conn(0x7fb6780ab1a0 msgr2=0x7fb678158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:42.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.663+0000 7fb676ffd700 1 --2- 172.21.15.1:0/263597669 >> v2:172.21.15.141:3300/0 conn(0x7fb6780ab1a0 0x7fb678158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.663+0000 7fb676ffd700 1 -- 172.21.15.1:0/263597669 >> v1:172.21.15.1:6789/0 conn(0x7fb6780aa060 legacy=0x7fb6780c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:42.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.663+0000 7fb675ffb700 1 -- 172.21.15.1:0/263597669 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913794841 0 0) 0x7fb6780c06f0 con 0x7fb6780aa060 2023-11-15T01:33:42.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.663+0000 7fb676ffd700 1 -- 172.21.15.1:0/263597669 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb678158b00 con 0x7fb678154150 2023-11-15T01:33:42.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.664+0000 7fb676ffd700 1 --2- 172.21.15.1:0/263597669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb678154150 0x7fb678154530 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fb6780c0270 tx=0x7fb66c0090f0).ready entity=mon.0 client_cookie=f1602077766a52c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:42.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.664+0000 7fb675ffb700 1 -- 172.21.15.1:0/263597669 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c00b520 con 0x7fb678154150 2023-11-15T01:33:42.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.664+0000 7fb675ffb700 1 -- 172.21.15.1:0/263597669 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66c00b680 con 0x7fb678154150 2023-11-15T01:33:42.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.664+0000 7fb675ffb700 1 -- 172.21.15.1:0/263597669 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c00ba20 con 0x7fb678154150 2023-11-15T01:33:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.664+0000 7fb67d77f700 1 -- 172.21.15.1:0/263597669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb678154150 msgr2=0x7fb678154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.664+0000 7fb67d77f700 1 --2- 172.21.15.1:0/263597669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb678154150 0x7fb678154530 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fb6780c0270 tx=0x7fb66c0090f0).stop 2023-11-15T01:33:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.664+0000 7fb67d77f700 1 -- 172.21.15.1:0/263597669 shutdown_connections 2023-11-15T01:33:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.664+0000 7fb67d77f700 1 --2- 172.21.15.1:0/263597669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb678154150 0x7fb678154530 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.664+0000 7fb67d77f700 1 --2- 172.21.15.1:0/263597669 >> v2:172.21.15.141:3300/0 conn(0x7fb6780ab1a0 0x7fb678158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.664+0000 7fb67d77f700 1 -- 172.21.15.1:0/263597669 >> 172.21.15.1:0/263597669 conn(0x7fb678064aa0 msgr2=0x7fb678064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.664+0000 7fb67d77f700 1 -- 172.21.15.1:0/263597669 shutdown_connections 2023-11-15T01:33:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.664+0000 7fb67d77f700 1 -- 172.21.15.1:0/263597669 wait complete. 2023-11-15T01:33:42.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.666+0000 7fb67d77f700 1 Processor -- start 2023-11-15T01:33:42.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.666+0000 7fb67d77f700 1 -- start start 2023-11-15T01:33:42.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.666+0000 7fb67d77f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6780aa060 0x7fb678140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:42.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.666+0000 7fb67d77f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6780ab1a0 0x7fb6780ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:42.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.666+0000 7fb67d77f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb678154150 0x7fb6780abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:42.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.666+0000 7fb67d77f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780afca0 con 0x7fb6780ab1a0 2023-11-15T01:33:42.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.666+0000 7fb67d77f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780af390 con 0x7fb678154150 2023-11-15T01:33:42.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.666+0000 7fb67d77f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67814d130 con 0x7fb6780aa060 2023-11-15T01:33:42.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb6767fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6780ab1a0 0x7fb6780ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:42.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb6767fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6780ab1a0 0x7fb6780ab600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38194/0 (socket says 172.21.15.1:38194) 2023-11-15T01:33:42.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb6767fc700 1 -- 172.21.15.1:0/2273222051 learned_addr learned my addr 172.21.15.1:0/2273222051 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:42.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb6777fe700 1 --2- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb678154150 0x7fb6780abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:42.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb676ffd700 1 --2- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6780aa060 0x7fb678140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:42.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb6767fc700 1 -- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6780aa060 msgr2=0x7fb678140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:42.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb6767fc700 1 --2- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6780aa060 0x7fb678140cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb6767fc700 1 -- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb678154150 msgr2=0x7fb6780abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:42.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb6767fc700 1 --2- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb678154150 0x7fb6780abaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb6767fc700 1 -- 172.21.15.1:0/2273222051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c009370 con 0x7fb6780ab1a0 2023-11-15T01:33:42.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb6767fc700 1 --2- 172.21.15.1:0/2273222051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6780ab1a0 0x7fb6780ab600 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fb66800e950 tx=0x7fb668009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:42.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb65effd700 1 -- 172.21.15.1:0/2273222051 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668012600 con 0x7fb6780ab1a0 2023-11-15T01:33:42.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb65effd700 1 -- 172.21.15.1:0/2273222051 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb668012760 con 0x7fb6780ab1a0 2023-11-15T01:33:42.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb67d77f700 1 -- 172.21.15.1:0/2273222051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6780af650 con 0x7fb6780ab1a0 2023-11-15T01:33:42.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb65effd700 1 -- 172.21.15.1:0/2273222051 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668012ae0 con 0x7fb6780ab1a0 2023-11-15T01:33:42.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.667+0000 7fb67d77f700 1 -- 172.21.15.1:0/2273222051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6781411e0 con 0x7fb6780ab1a0 2023-11-15T01:33:42.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.668+0000 7fb67d77f700 1 -- 172.21.15.1:0/2273222051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6780afe50 con 0x7fb6780ab1a0 2023-11-15T01:33:42.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.669+0000 7fb65effd700 1 -- 172.21.15.1:0/2273222051 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fb66801b400 con 0x7fb6780ab1a0 2023-11-15T01:33:42.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.669+0000 7fb65effd700 1 --2- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb66405f270 0x7fb664061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:42.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.669+0000 7fb65effd700 1 -- 172.21.15.1:0/2273222051 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6762+0+0 (secure 0 0 0) 0x7fb66807ab00 con 0x7fb6780ab1a0 2023-11-15T01:33:42.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.669+0000 7fb676ffd700 1 -- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb66405f270 msgr2=0x7fb664061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:42.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.669+0000 7fb676ffd700 1 --2- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb66405f270 0x7fb664061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:33:42.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.673+0000 7fb65effd700 1 -- 172.21.15.1:0/2273222051 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb6780afe50 con 0x7fb6780ab1a0 2023-11-15T01:33:42.719 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:42.718+0000 7fae2002a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:33:42.724 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:42.723+0000 7efec695e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:33:42.792 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:42.791+0000 7fae2002a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:33:42.794 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:42.793+0000 7efec695e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:33:42.871 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:42.870+0000 7fae2002a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:33:42.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.870+0000 7fb676ffd700 1 -- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb66405f270 msgr2=0x7fb664061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:42.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.870+0000 7fb676ffd700 1 --2- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb66405f270 0x7fb664061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:33:42.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.894+0000 7fb67d77f700 1 -- 172.21.15.1:0/2273222051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb67806c7e0 con 0x7fb6780ab1a0 2023-11-15T01:33:42.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.894+0000 7fb65effd700 1 -- 172.21.15.1:0/2273222051 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4486 (secure 0 0 0) 0x7fb668016020 con 0x7fb6780ab1a0 2023-11-15T01:33:42.896 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:42.896 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1019024578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1019024578},{"type":"v1","addr":"172.21.15.1:6835","nonce":1019024578}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4622,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/571718542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":571718542},{"type":"v1","addr":"172.21.15.141:6837","nonce":571718542}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/4111687819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":4111687819},{"type":"v1","addr":"172.21.15.141:6836","nonce":4111687819}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:22:23.228899+0000","modified":"2023-11-15T01:22:26.233026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6834/3374581715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3374581715},{"type":"v1","addr":"172.21.15.1:6834","nonce":3374581715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-11-15T01:33:42.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.896+0000 7fb67d77f700 1 -- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb66405f270 msgr2=0x7fb664061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:33:42.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.896+0000 7fb67d77f700 1 --2- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb66405f270 0x7fb664061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:42.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.896+0000 7fb67d77f700 1 -- 172.21.15.1:0/2273222051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6780ab1a0 msgr2=0x7fb6780ab600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:42.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.896+0000 7fb67d77f700 1 --2- 172.21.15.1:0/2273222051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6780ab1a0 0x7fb6780ab600 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fb66800e950 tx=0x7fb668009060).stop 2023-11-15T01:33:42.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.896+0000 7fb67d77f700 1 -- 172.21.15.1:0/2273222051 shutdown_connections 2023-11-15T01:33:42.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.896+0000 7fb67d77f700 1 --2- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb66405f270 0x7fb664061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:42.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.896+0000 7fb67d77f700 1 --2- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb678154150 0x7fb6780abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.896+0000 7fb67d77f700 1 --2- 172.21.15.1:0/2273222051 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb6780aa060 0x7fb678140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.896+0000 7fb67d77f700 1 --2- 172.21.15.1:0/2273222051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6780ab1a0 0x7fb6780ab600 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.896+0000 7fb67d77f700 1 -- 172.21.15.1:0/2273222051 >> 172.21.15.1:0/2273222051 conn(0x7fb678064aa0 msgr2=0x7fb67814d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.896+0000 7fb67d77f700 1 -- 172.21.15.1:0/2273222051 shutdown_connections 2023-11-15T01:33:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:42.897+0000 7fb67d77f700 1 -- 172.21.15.1:0/2273222051 wait complete. 2023-11-15T01:33:42.901 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 15 2023-11-15T01:33:42.910 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:33:42.911 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:42.909+0000 7efec695e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:33:43.016 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:43.014+0000 7efec695e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:33:43.029 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:43.028+0000 7fae2002a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:33:43.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.029+0000 7f0a51500700 1 Processor -- start 2023-11-15T01:33:43.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.029+0000 7f0a51500700 1 -- start start 2023-11-15T01:33:43.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.030+0000 7f0a51500700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a4c0ab1a0 0x7f0a4c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:43.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.030+0000 7f0a51500700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0a4c0aa060 0x7f0a4c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:43.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.030+0000 7f0a51500700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a4c0c06f0 con 0x7f0a4c154150 2023-11-15T01:33:43.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.030+0000 7f0a51500700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4c0c09d0 con 0x7f0a4c0aa060 2023-11-15T01:33:43.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.030+0000 7f0a51500700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c158820 con 0x7f0a4c0ab1a0 2023-11-15T01:33:43.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.030+0000 7f0a4a7fc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a4c0ab1a0 0x7f0a4c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:43.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.030+0000 7f0a4b7fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0a4c0aa060 0x7f0a4c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:43.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.030+0000 7f0a4affd700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f0a4c154150 0x7f0a4c158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:38794/0 (socket says 172.21.15.1:38794) 2023-11-15T01:33:43.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.030+0000 7f0a4affd700 1 -- 172.21.15.1:0/3419895872 learned_addr learned my addr 172.21.15.1:0/3419895872 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:43.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.031+0000 7f0a4a7fc700 1 -- 172.21.15.1:0/3419895872 >> v2:172.21.15.141:3300/0 conn(0x7f0a4c0aa060 msgr2=0x7f0a4c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:43.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.031+0000 7f0a4a7fc700 1 --2- 172.21.15.1:0/3419895872 >> v2:172.21.15.141:3300/0 conn(0x7f0a4c0aa060 0x7f0a4c0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:43.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.031+0000 7f0a4a7fc700 1 -- 172.21.15.1:0/3419895872 >> v1:172.21.15.141:6789/0 conn(0x7f0a4c154150 legacy=0x7f0a4c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:43.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.031+0000 7f0a4a7fc700 1 -- 172.21.15.1:0/3419895872 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c158b00 con 0x7f0a4c0ab1a0 2023-11-15T01:33:43.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.031+0000 7f0a49ffb700 1 -- 172.21.15.1:0/3419895872 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799738732 0 0) 0x7f0a4c0c06f0 con 0x7f0a4c154150 2023-11-15T01:33:43.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.031+0000 7f0a4b7fe700 1 --2- 172.21.15.1:0/3419895872 >> v2:172.21.15.141:3300/0 conn(0x7f0a4c0aa060 0x7f0a4c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:43.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.031+0000 7f0a4a7fc700 1 --2- 172.21.15.1:0/3419895872 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a4c0ab1a0 0x7f0a4c154530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f0a3c009760 tx=0x7f0a3c009060).ready entity=mon.2 client_cookie=3c5b987d51830dfd server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:43.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.031+0000 7f0a49ffb700 1 -- 172.21.15.1:0/3419895872 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c0090d0 con 0x7f0a4c0ab1a0 2023-11-15T01:33:43.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.031+0000 7f0a49ffb700 1 -- 172.21.15.1:0/3419895872 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c00f510 con 0x7f0a4c0ab1a0 2023-11-15T01:33:43.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.031+0000 7f0a49ffb700 1 -- 172.21.15.1:0/3419895872 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c00f890 con 0x7f0a4c0ab1a0 2023-11-15T01:33:43.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.031+0000 7f0a51500700 1 -- 172.21.15.1:0/3419895872 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a4c0ab1a0 msgr2=0x7f0a4c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:43.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.031+0000 7f0a51500700 1 --2- 172.21.15.1:0/3419895872 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a4c0ab1a0 0x7f0a4c154530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f0a3c009760 tx=0x7f0a3c009060).stop 2023-11-15T01:33:43.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.032+0000 7f0a51500700 1 -- 172.21.15.1:0/3419895872 shutdown_connections 2023-11-15T01:33:43.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.032+0000 7f0a51500700 1 --2- 172.21.15.1:0/3419895872 >> v2:172.21.15.141:3300/0 conn(0x7f0a4c0aa060 0x7f0a4c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:43.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.032+0000 7f0a51500700 1 --2- 172.21.15.1:0/3419895872 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a4c0ab1a0 0x7f0a4c154530 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:43.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.032+0000 7f0a51500700 1 -- 172.21.15.1:0/3419895872 >> 172.21.15.1:0/3419895872 conn(0x7f0a4c064aa0 msgr2=0x7f0a4c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:43.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.032+0000 7f0a51500700 1 -- 172.21.15.1:0/3419895872 shutdown_connections 2023-11-15T01:33:43.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.032+0000 7f0a51500700 1 -- 172.21.15.1:0/3419895872 wait complete. 2023-11-15T01:33:43.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.033+0000 7f0a51500700 1 Processor -- start 2023-11-15T01:33:43.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.033+0000 7f0a51500700 1 -- start start 2023-11-15T01:33:43.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a51500700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0a4c0aa060 0x7f0a4c14ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:43.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a51500700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a4c0ab1a0 0x7f0a4c0c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:43.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a51500700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a4c154150 0x7f0a4c0c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:43.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a51500700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c0c2520 con 0x7f0a4c0ab1a0 2023-11-15T01:33:43.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a51500700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c0c2800 con 0x7f0a4c0aa060 2023-11-15T01:33:43.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a51500700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c0c2ae0 con 0x7f0a4c154150 2023-11-15T01:33:43.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a4a7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a4c0ab1a0 0x7f0a4c0c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:43.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a4a7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a4c0ab1a0 0x7f0a4c0c35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38208/0 (socket says 172.21.15.1:38208) 2023-11-15T01:33:43.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a4affd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0a4c0aa060 0x7f0a4c14ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:43.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a4a7fc700 1 -- 172.21.15.1:0/314260520 learned_addr learned my addr 172.21.15.1:0/314260520 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:43.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a4b7fe700 1 --2- 172.21.15.1:0/314260520 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a4c154150 0x7f0a4c0c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:43.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a4affd700 1 -- 172.21.15.1:0/314260520 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a4c154150 msgr2=0x7f0a4c0c3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:43.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a4affd700 1 --2- 172.21.15.1:0/314260520 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a4c154150 0x7f0a4c0c3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:43.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a4affd700 1 -- 172.21.15.1:0/314260520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a4c0ab1a0 msgr2=0x7f0a4c0c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:43.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a4affd700 1 --2- 172.21.15.1:0/314260520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a4c0ab1a0 0x7f0a4c0c35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:43.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a4affd700 1 -- 172.21.15.1:0/314260520 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a44009a20 con 0x7f0a4c0aa060 2023-11-15T01:33:43.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a4b7fe700 1 --2- 172.21.15.1:0/314260520 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a4c154150 0x7f0a4c0c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:43.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a4a7fc700 1 --2- 172.21.15.1:0/314260520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a4c0ab1a0 0x7f0a4c0c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:43.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.034+0000 7f0a4affd700 1 --2- 172.21.15.1:0/314260520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0a4c0aa060 0x7f0a4c14ddf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f0a3400c490 tx=0x7f0a34007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:43.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.035+0000 7f0a42ffd700 1 -- 172.21.15.1:0/314260520 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a340070d0 con 0x7f0a4c0aa060 2023-11-15T01:33:43.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.035+0000 7f0a42ffd700 1 -- 172.21.15.1:0/314260520 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a34007230 con 0x7f0a4c0aa060 2023-11-15T01:33:43.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.035+0000 7f0a51500700 1 -- 172.21.15.1:0/314260520 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c0092a0 con 0x7f0a4c0aa060 2023-11-15T01:33:43.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.035+0000 7f0a42ffd700 1 -- 172.21.15.1:0/314260520 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a340075b0 con 0x7f0a4c0aa060 2023-11-15T01:33:43.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.035+0000 7f0a51500700 1 -- 172.21.15.1:0/314260520 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c0c30a0 con 0x7f0a4c0aa060 2023-11-15T01:33:43.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.036+0000 7f0a51500700 1 -- 172.21.15.1:0/314260520 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4c0c32c0 con 0x7f0a4c0aa060 2023-11-15T01:33:43.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.036+0000 7f0a42ffd700 1 -- 172.21.15.1:0/314260520 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f0a34005bc0 con 0x7f0a4c0aa060 2023-11-15T01:33:43.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.037+0000 7f0a42ffd700 1 --2- 172.21.15.1:0/314260520 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a2c05f270 0x7f0a2c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:43.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.037+0000 7f0a4a7fc700 1 -- 172.21.15.1:0/314260520 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a2c05f270 msgr2=0x7f0a2c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:43.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.037+0000 7f0a42ffd700 1 -- 172.21.15.1:0/314260520 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6762+0+0 (secure 0 0 0) 0x7f0a34079e20 con 0x7f0a4c0aa060 2023-11-15T01:33:43.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.037+0000 7f0a4a7fc700 1 --2- 172.21.15.1:0/314260520 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a2c05f270 0x7f0a2c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:33:43.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.041+0000 7f0a42ffd700 1 -- 172.21.15.1:0/314260520 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0a3404acf0 con 0x7f0a4c0aa060 2023-11-15T01:33:43.106 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:43.104+0000 7fae2002a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:33:43.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.216+0000 7f0a51500700 1 -- 172.21.15.1:0/314260520 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a4c06c7e0 con 0x7f0a4c0aa060 2023-11-15T01:33:43.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.218+0000 7f0a42ffd700 1 -- 172.21.15.1:0/314260520 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+17870 (secure 0 0 0) 0x7f0a3404e310 con 0x7f0a4c0aa060 2023-11-15T01:33:43.220 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:43.220 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":47,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:33:41.131534+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:22:21.423841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-15T01:22:22.202076+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":47,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2f","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:6833/90546":"2023-11-16T01:22:35.460446+0000","172.21.15.141:6832/90546":"2023-11-16T01:22:35.460446+0000","172.21.15.141:0/1004848049":"2023-11-16T01:22:35.460446+0000","172.21.15.141:0/3577504655":"2023-11-16T01:22:35.460446+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":111,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:33:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.220+0000 7f0a51500700 1 -- 172.21.15.1:0/314260520 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a2c05f270 msgr2=0x7f0a2c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:33:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.220+0000 7f0a51500700 1 --2- 172.21.15.1:0/314260520 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a2c05f270 0x7f0a2c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.220+0000 7f0a51500700 1 -- 172.21.15.1:0/314260520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0a4c0aa060 msgr2=0x7f0a4c14ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.220+0000 7f0a51500700 1 --2- 172.21.15.1:0/314260520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0a4c0aa060 0x7f0a4c14ddf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f0a3400c490 tx=0x7f0a34007dd0).stop 2023-11-15T01:33:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.220+0000 7f0a51500700 1 -- 172.21.15.1:0/314260520 shutdown_connections 2023-11-15T01:33:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.220+0000 7f0a51500700 1 --2- 172.21.15.1:0/314260520 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a2c05f270 0x7f0a2c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.220+0000 7f0a51500700 1 --2- 172.21.15.1:0/314260520 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a4c154150 0x7f0a4c0c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.220+0000 7f0a51500700 1 --2- 172.21.15.1:0/314260520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0a4c0aa060 0x7f0a4c14ddf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:43.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.220+0000 7f0a51500700 1 --2- 172.21.15.1:0/314260520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a4c0ab1a0 0x7f0a4c0c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:43.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.220+0000 7f0a51500700 1 -- 172.21.15.1:0/314260520 >> 172.21.15.1:0/314260520 conn(0x7f0a4c064aa0 msgr2=0x7f0a4c063460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:43.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.220+0000 7f0a51500700 1 -- 172.21.15.1:0/314260520 shutdown_connections 2023-11-15T01:33:43.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.220+0000 7f0a51500700 1 -- 172.21.15.1:0/314260520 wait complete. 2023-11-15T01:33:43.228 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:43.227+0000 7fae2002a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:33:43.235 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-15T01:33:43.312 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:43.310+0000 7efec695e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:33:43.347 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:43.346+0000 7fae2002a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:33:43.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.356+0000 7f8a84d18700 1 Processor -- start 2023-11-15T01:33:43.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.356+0000 7f8a84d18700 1 -- start start 2023-11-15T01:33:43.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.357+0000 7f8a84d18700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8a800c6520 0x7f8a80154af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:43.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.357+0000 7f8a84d18700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8a800c6900 0x7f8a800aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:43.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.357+0000 7f8a84d18700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a801582b0 con 0x7f8a800c97b0 2023-11-15T01:33:43.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.357+0000 7f8a84d18700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a80155b10 con 0x7f8a800c6520 2023-11-15T01:33:43.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.357+0000 7f8a84d18700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a80154fe0 con 0x7f8a800c6900 2023-11-15T01:33:43.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.357+0000 7f8a7e59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8a800c6520 0x7f8a80154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:43.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.357+0000 7f8a7ed9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8a800c97b0 0x7f8a80158740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45032/0 (socket says 172.21.15.1:45032) 2023-11-15T01:33:43.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.357+0000 7f8a7ed9d700 1 -- 172.21.15.1:0/1158243423 learned_addr learned my addr 172.21.15.1:0/1158243423 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:43.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.357+0000 7f8a7e59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8a800c6520 0x7f8a80154af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38210/0 (socket says 172.21.15.1:38210) 2023-11-15T01:33:43.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.358+0000 7f8a7dd9b700 1 --2- 172.21.15.1:0/1158243423 >> v2:172.21.15.141:3300/0 conn(0x7f8a800c6900 0x7f8a800aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:43.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.358+0000 7f8a7e59c700 1 -- 172.21.15.1:0/1158243423 >> v2:172.21.15.141:3300/0 conn(0x7f8a800c6900 msgr2=0x7f8a800aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:43.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.358+0000 7f8a7e59c700 1 --2- 172.21.15.1:0/1158243423 >> v2:172.21.15.141:3300/0 conn(0x7f8a800c6900 0x7f8a800aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.358+0000 7f8a7e59c700 1 -- 172.21.15.1:0/1158243423 >> v1:172.21.15.1:6789/0 conn(0x7f8a800c97b0 legacy=0x7f8a80158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.358+0000 7f8a7d59a700 1 -- 172.21.15.1:0/1158243423 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734352846 0 0) 0x7f8a801582b0 con 0x7f8a800c97b0 2023-11-15T01:33:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.358+0000 7f8a7e59c700 1 -- 172.21.15.1:0/1158243423 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a800aa910 con 0x7f8a800c6520 2023-11-15T01:33:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.358+0000 7f8a7e59c700 1 --2- 172.21.15.1:0/1158243423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a800c6520 0x7f8a80154af0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f8a800c55f0 tx=0x7f8a70009060).ready entity=mon.0 client_cookie=42d4b2ce28fc64c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.358+0000 7f8a7d59a700 1 -- 172.21.15.1:0/1158243423 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000f510 con 0x7f8a800c6520 2023-11-15T01:33:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.358+0000 7f8a7d59a700 1 -- 172.21.15.1:0/1158243423 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7000f670 con 0x7f8a800c6520 2023-11-15T01:33:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.358+0000 7f8a7d59a700 1 -- 172.21.15.1:0/1158243423 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000f9f0 con 0x7f8a800c6520 2023-11-15T01:33:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.359+0000 7f8a84d18700 1 -- 172.21.15.1:0/1158243423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a800c6520 msgr2=0x7f8a80154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.359+0000 7f8a84d18700 1 --2- 172.21.15.1:0/1158243423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a800c6520 0x7f8a80154af0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f8a800c55f0 tx=0x7f8a70009060).stop 2023-11-15T01:33:43.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.359+0000 7f8a84d18700 1 -- 172.21.15.1:0/1158243423 shutdown_connections 2023-11-15T01:33:43.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.359+0000 7f8a84d18700 1 --2- 172.21.15.1:0/1158243423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a800c6520 0x7f8a80154af0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:43.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.359+0000 7f8a84d18700 1 --2- 172.21.15.1:0/1158243423 >> v2:172.21.15.141:3300/0 conn(0x7f8a800c6900 0x7f8a800aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:43.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.359+0000 7f8a84d18700 1 -- 172.21.15.1:0/1158243423 >> 172.21.15.1:0/1158243423 conn(0x7f8a800cb060 msgr2=0x7f8a800cb470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:43.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.359+0000 7f8a84d18700 1 -- 172.21.15.1:0/1158243423 shutdown_connections 2023-11-15T01:33:43.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.359+0000 7f8a84d18700 1 -- 172.21.15.1:0/1158243423 wait complete. 2023-11-15T01:33:43.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.360+0000 7f8a84d18700 1 Processor -- start 2023-11-15T01:33:43.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.360+0000 7f8a84d18700 1 -- start start 2023-11-15T01:33:43.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a84d18700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a800c6520 0x7f8a800aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:43.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a84d18700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a800c6900 0x7f8a80151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:43.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a84d18700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a800c97b0 0x7f8a80152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:43.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a84d18700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a800af420 con 0x7f8a800c6520 2023-11-15T01:33:43.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a84d18700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a800af6f0 con 0x7f8a800c97b0 2023-11-15T01:33:43.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a84d18700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a800af9d0 con 0x7f8a800c6900 2023-11-15T01:33:43.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a7e59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a800c6520 0x7f8a800aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:43.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a7e59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a800c6520 0x7f8a800aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38214/0 (socket says 172.21.15.1:38214) 2023-11-15T01:33:43.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a7e59c700 1 -- 172.21.15.1:0/1851313289 learned_addr learned my addr 172.21.15.1:0/1851313289 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:43.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a7dd9b700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a800c6900 0x7f8a80151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:43.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a7ed9d700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a800c97b0 0x7f8a80152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:43.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a7e59c700 1 -- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a800c6900 msgr2=0x7f8a80151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:43.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a7e59c700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a800c6900 0x7f8a80151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:43.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a7e59c700 1 -- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a800c97b0 msgr2=0x7f8a80152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:43.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a7e59c700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a800c97b0 0x7f8a80152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:43.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a7e59c700 1 -- 172.21.15.1:0/1851313289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a700092a0 con 0x7f8a800c6520 2023-11-15T01:33:43.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.361+0000 7f8a7e59c700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a800c6520 0x7f8a800aef30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f8a70009dd0 tx=0x7f8a70017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:43.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.362+0000 7f8a6e7fc700 1 -- 172.21.15.1:0/1851313289 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000f7e0 con 0x7f8a800c6520 2023-11-15T01:33:43.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.362+0000 7f8a6e7fc700 1 -- 172.21.15.1:0/1851313289 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7000f940 con 0x7f8a800c6520 2023-11-15T01:33:43.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.362+0000 7f8a84d18700 1 -- 172.21.15.1:0/1851313289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a800afcb0 con 0x7f8a800c6520 2023-11-15T01:33:43.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.362+0000 7f8a6e7fc700 1 -- 172.21.15.1:0/1851313289 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7001b660 con 0x7f8a800c6520 2023-11-15T01:33:43.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.362+0000 7f8a84d18700 1 -- 172.21.15.1:0/1851313289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a80164b00 con 0x7f8a800c6520 2023-11-15T01:33:43.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.363+0000 7f8a84d18700 1 -- 172.21.15.1:0/1851313289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a8006c7e0 con 0x7f8a800c6520 2023-11-15T01:33:43.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.363+0000 7f8a6e7fc700 1 -- 172.21.15.1:0/1851313289 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f8a7001ba10 con 0x7f8a800c6520 2023-11-15T01:33:43.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.364+0000 7f8a6e7fc700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a6005f270 0x7f8a60061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:43.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.364+0000 7f8a6e7fc700 1 -- 172.21.15.1:0/1851313289 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6762+0+0 (secure 0 0 0) 0x7f8a7007bfe0 con 0x7f8a800c6520 2023-11-15T01:33:43.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.364+0000 7f8a7dd9b700 1 -- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a6005f270 msgr2=0x7f8a60061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:33:43.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.364+0000 7f8a7dd9b700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a6005f270 0x7f8a60061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:33:43.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.368+0000 7f8a6e7fc700 1 -- 172.21.15.1:0/1851313289 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8a7004ceb0 con 0x7f8a800c6520 2023-11-15T01:33:43.382 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:43.381+0000 7efec695e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:33:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.402+0000 7f8a6e7fc700 1 -- 172.21.15.1:0/1851313289 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 12) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f8a700799b0 con 0x7f8a800c6520 2023-11-15T01:33:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.403+0000 7f8a6e7fc700 1 -- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a6005f270 msgr2=0x7f8a60061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:33:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.403+0000 7f8a6e7fc700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a6005f270 0x7f8a60061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:43.459 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:43.457+0000 7efe400ed700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:33:43.460 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:43.457+0000 7efe400ed700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:33:43.460 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:43.457+0000 7efe400ed700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:33:43.460 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:43.457+0000 7efe400ed700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:33:43.461 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:43.457+0000 7efe400ed700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:33:43.461 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:43.458+0000 7efe440f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:33:43.461 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:43.458+0000 7efe440f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:33:43.462 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:43.458+0000 7efe440f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:33:43.462 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:43.458+0000 7efe440f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:33:43.462 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:33:43.458+0000 7efe440f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:33:43.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:43.594+0000 7f8a84d18700 1 -- 172.21.15.1:0/1851313289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8a80155820 con 0x7f8a800c6520 2023-11-15T01:33:43.659 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:43.658+0000 7fae2002a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:33:43.732 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:33:43.731+0000 7fae2002a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:33:44.399 INFO:tasks.ceph.mon.a.smithi001.stderr:2023-11-15T01:33:44.398+0000 7f8072214700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-15T01:33:44.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.406+0000 7f8a6e7fc700 1 -- 172.21.15.1:0/1851313289 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 13) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f8a70079d30 con 0x7f8a800c6520 2023-11-15T01:33:44.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.407+0000 7f8a6e7fc700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a6005f270 0x7f8a600616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:44.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.407+0000 7f8a7dd9b700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a6005f270 0x7f8a600616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:44.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.410+0000 7f8a7dd9b700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a6005f270 0x7f8a600616b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f8a80158080 tx=0x7f8a74009060).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:44.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.414+0000 7f8a6e7fc700 1 -- 172.21.15.1:0/1851313289 <== mon.0 v2:172.21.15.1:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8a7004dec0 con 0x7f8a800c6520 2023-11-15T01:33:44.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.416+0000 7f8a84d18700 1 -- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a6005f270 msgr2=0x7f8a600616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:44.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.416+0000 7f8a84d18700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a6005f270 0x7f8a600616b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f8a80158080 tx=0x7f8a74009060).stop 2023-11-15T01:33:44.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.416+0000 7f8a84d18700 1 -- 172.21.15.1:0/1851313289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a800c6520 msgr2=0x7f8a800aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:44.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.416+0000 7f8a84d18700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a800c6520 0x7f8a800aef30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f8a70009dd0 tx=0x7f8a70017000).stop 2023-11-15T01:33:44.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.416+0000 7f8a84d18700 1 -- 172.21.15.1:0/1851313289 shutdown_connections 2023-11-15T01:33:44.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.416+0000 7f8a84d18700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a6005f270 0x7f8a600616b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:44.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.416+0000 7f8a84d18700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a800c97b0 0x7f8a80152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:44.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.416+0000 7f8a84d18700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a800c6520 0x7f8a800aef30 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:44.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.416+0000 7f8a84d18700 1 --2- 172.21.15.1:0/1851313289 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a800c6900 0x7f8a80151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:44.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.416+0000 7f8a84d18700 1 -- 172.21.15.1:0/1851313289 >> 172.21.15.1:0/1851313289 conn(0x7f8a800cb060 msgr2=0x7f8a800c0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:44.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.416+0000 7f8a84d18700 1 -- 172.21.15.1:0/1851313289 shutdown_connections 2023-11-15T01:33:44.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.417+0000 7f8a84d18700 1 -- 172.21.15.1:0/1851313289 wait complete. 2023-11-15T01:33:44.421 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-15T01:33:44.434 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-15T01:33:44.451 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T01:33:44.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.561+0000 7fecadead700 1 Processor -- start 2023-11-15T01:33:44.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.561+0000 7fecadead700 1 -- start start 2023-11-15T01:33:44.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7fecadead700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7feca81540a0 0x7feca80ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:44.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7fecadead700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feca8154480 0x7feca80ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:44.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7fecadead700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feca80c5f40 0x7feca80c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:44.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7fecadead700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca80ca050 con 0x7feca80c5f40 2023-11-15T01:33:44.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7fecadead700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca80c68c0 con 0x7feca81540a0 2023-11-15T01:33:44.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7fecadead700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca80c9440 con 0x7feca8154480 2023-11-15T01:33:44.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7feca7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feca80c5f40 0x7feca80c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:44.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7feca7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feca80c5f40 0x7feca80c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38232/0 (socket says 172.21.15.1:38232) 2023-11-15T01:33:44.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7feca7fff700 1 -- 172.21.15.1:0/1163469983 learned_addr learned my addr 172.21.15.1:0/1163469983 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:44.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7feca77fe700 1 --2- 172.21.15.1:0/1163469983 >> v2:172.21.15.141:3300/0 conn(0x7feca81540a0 0x7feca80ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:44.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7feca6ffd700 1 --2- 172.21.15.1:0/1163469983 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feca8154480 0x7feca80ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:44.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7feca7fff700 1 -- 172.21.15.1:0/1163469983 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feca8154480 msgr2=0x7feca80ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:44.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7feca7fff700 1 --2- 172.21.15.1:0/1163469983 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feca8154480 0x7feca80ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:44.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7feca7fff700 1 -- 172.21.15.1:0/1163469983 >> v2:172.21.15.141:3300/0 conn(0x7feca81540a0 msgr2=0x7feca80ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:44.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7feca7fff700 1 --2- 172.21.15.1:0/1163469983 >> v2:172.21.15.141:3300/0 conn(0x7feca81540a0 0x7feca80ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:44.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7feca7fff700 1 -- 172.21.15.1:0/1163469983 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca80c9720 con 0x7feca80c5f40 2023-11-15T01:33:44.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7feca7fff700 1 --2- 172.21.15.1:0/1163469983 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feca80c5f40 0x7feca80c63d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7feca805ff40 tx=0x7feca0009840).ready entity=mon.0 client_cookie=e8fb5c1578cb5fd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:44.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.562+0000 7feca67fc700 1 -- 172.21.15.1:0/1163469983 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca000e070 con 0x7feca80c5f40 2023-11-15T01:33:44.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.563+0000 7feca67fc700 1 -- 172.21.15.1:0/1163469983 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca000ba50 con 0x7feca80c5f40 2023-11-15T01:33:44.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.563+0000 7feca67fc700 1 -- 172.21.15.1:0/1163469983 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca000bdd0 con 0x7feca80c5f40 2023-11-15T01:33:44.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.563+0000 7fecadead700 1 -- 172.21.15.1:0/1163469983 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feca80c5f40 msgr2=0x7feca80c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:44.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.563+0000 7fecadead700 1 --2- 172.21.15.1:0/1163469983 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feca80c5f40 0x7feca80c63d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7feca805ff40 tx=0x7feca0009840).stop 2023-11-15T01:33:44.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.563+0000 7fecadead700 1 -- 172.21.15.1:0/1163469983 shutdown_connections 2023-11-15T01:33:44.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.563+0000 7fecadead700 1 --2- 172.21.15.1:0/1163469983 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feca80c5f40 0x7feca80c63d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:44.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.563+0000 7fecadead700 1 --2- 172.21.15.1:0/1163469983 >> v2:172.21.15.141:3300/0 conn(0x7feca81540a0 0x7feca80ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:44.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.563+0000 7fecadead700 1 --2- 172.21.15.1:0/1163469983 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feca8154480 0x7feca80ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:44.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.563+0000 7fecadead700 1 -- 172.21.15.1:0/1163469983 >> 172.21.15.1:0/1163469983 conn(0x7feca8064a70 msgr2=0x7feca8064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:44.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.563+0000 7fecadead700 1 -- 172.21.15.1:0/1163469983 shutdown_connections 2023-11-15T01:33:44.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.563+0000 7fecadead700 1 -- 172.21.15.1:0/1163469983 wait complete. 2023-11-15T01:33:44.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.564+0000 7fecadead700 1 Processor -- start 2023-11-15T01:33:44.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.564+0000 7fecadead700 1 -- start start 2023-11-15T01:33:44.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7fecadead700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feca80c5f40 0x7feca8147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:44.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7fecadead700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feca81540a0 0x7feca8147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:44.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7fecadead700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feca8154480 0x7feca80ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:44.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7fecadead700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca80c4ad0 con 0x7feca8154480 2023-11-15T01:33:44.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7fecadead700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca8147540 con 0x7feca80c5f40 2023-11-15T01:33:44.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7fecadead700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca80c3ec0 con 0x7feca81540a0 2023-11-15T01:33:44.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7feca7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feca8154480 0x7feca80ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:44.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7feca7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feca8154480 0x7feca80ae520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38236/0 (socket says 172.21.15.1:38236) 2023-11-15T01:33:44.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7feca7fff700 1 -- 172.21.15.1:0/3368364468 learned_addr learned my addr 172.21.15.1:0/3368364468 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:44.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7feca6ffd700 1 --2- 172.21.15.1:0/3368364468 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feca81540a0 0x7feca8147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:44.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7feca77fe700 1 --2- 172.21.15.1:0/3368364468 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feca80c5f40 0x7feca8147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:44.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7feca7fff700 1 -- 172.21.15.1:0/3368364468 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feca81540a0 msgr2=0x7feca8147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:44.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7feca7fff700 1 --2- 172.21.15.1:0/3368364468 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feca81540a0 0x7feca8147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:44.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7feca7fff700 1 -- 172.21.15.1:0/3368364468 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feca80c5f40 msgr2=0x7feca8147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:44.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7feca7fff700 1 --2- 172.21.15.1:0/3368364468 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feca80c5f40 0x7feca8147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:44.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.565+0000 7feca7fff700 1 -- 172.21.15.1:0/3368364468 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca0009ae0 con 0x7feca8154480 2023-11-15T01:33:44.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.566+0000 7feca7fff700 1 --2- 172.21.15.1:0/3368364468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feca8154480 0x7feca80ae520 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7feca0013f80 tx=0x7feca0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:44.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.566+0000 7fec8f7fe700 1 -- 172.21.15.1:0/3368364468 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca000bdd0 con 0x7feca8154480 2023-11-15T01:33:44.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.566+0000 7fec8f7fe700 1 -- 172.21.15.1:0/3368364468 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca001d460 con 0x7feca8154480 2023-11-15T01:33:44.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.566+0000 7fecadead700 1 -- 172.21.15.1:0/3368364468 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca80c41a0 con 0x7feca8154480 2023-11-15T01:33:44.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.566+0000 7fec8f7fe700 1 -- 172.21.15.1:0/3368364468 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca001d820 con 0x7feca8154480 2023-11-15T01:33:44.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.566+0000 7fecadead700 1 -- 172.21.15.1:0/3368364468 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca80c4760 con 0x7feca8154480 2023-11-15T01:33:44.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.567+0000 7fecadead700 1 -- 172.21.15.1:0/3368364468 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca80ac140 con 0x7feca8154480 2023-11-15T01:33:44.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.567+0000 7fec8f7fe700 1 -- 172.21.15.1:0/3368364468 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) v1 ==== 75340+0+0 (secure 0 0 0) 0x7feca0003040 con 0x7feca8154480 2023-11-15T01:33:44.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.568+0000 7fec8f7fe700 1 --2- 172.21.15.1:0/3368364468 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec9405f030 0x7fec940614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:44.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.568+0000 7fec8f7fe700 1 -- 172.21.15.1:0/3368364468 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6976+0+0 (secure 0 0 0) 0x7feca007b890 con 0x7feca8154480 2023-11-15T01:33:44.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.568+0000 7feca77fe700 1 --2- 172.21.15.1:0/3368364468 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec9405f030 0x7fec940614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:44.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.568+0000 7feca77fe700 1 --2- 172.21.15.1:0/3368364468 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec9405f030 0x7fec940614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fec98006fd0 tx=0x7fec98008040).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:44.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.572+0000 7fec8f7fe700 1 -- 172.21.15.1:0/3368364468 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7feca004c8f0 con 0x7feca8154480 2023-11-15T01:33:44.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:44.789+0000 7fecadead700 1 -- 172.21.15.1:0/3368364468 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7feca80c4c10 con 0x7feca8154480 2023-11-15T01:33:45.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.416+0000 7fec8f7fe700 1 -- 172.21.15.1:0/3368364468 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7feca80c4c10 con 0x7feca8154480 2023-11-15T01:33:45.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.419+0000 7fecadead700 1 -- 172.21.15.1:0/3368364468 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec9405f030 msgr2=0x7fec940614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:45.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.419+0000 7fecadead700 1 --2- 172.21.15.1:0/3368364468 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec9405f030 0x7fec940614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fec98006fd0 tx=0x7fec98008040).stop 2023-11-15T01:33:45.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.419+0000 7fecadead700 1 -- 172.21.15.1:0/3368364468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feca8154480 msgr2=0x7feca80ae520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:45.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.419+0000 7fecadead700 1 --2- 172.21.15.1:0/3368364468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feca8154480 0x7feca80ae520 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7feca0013f80 tx=0x7feca0009840).stop 2023-11-15T01:33:45.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.419+0000 7fecadead700 1 -- 172.21.15.1:0/3368364468 shutdown_connections 2023-11-15T01:33:45.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.419+0000 7fecadead700 1 --2- 172.21.15.1:0/3368364468 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec9405f030 0x7fec940614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:45.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.419+0000 7fecadead700 1 --2- 172.21.15.1:0/3368364468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feca8154480 0x7feca80ae520 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:45.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.419+0000 7fecadead700 1 --2- 172.21.15.1:0/3368364468 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feca80c5f40 0x7feca8147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:45.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.419+0000 7fecadead700 1 --2- 172.21.15.1:0/3368364468 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feca81540a0 0x7feca8147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:45.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.419+0000 7fecadead700 1 -- 172.21.15.1:0/3368364468 >> 172.21.15.1:0/3368364468 conn(0x7feca8064a70 msgr2=0x7feca80aba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:45.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.419+0000 7fecadead700 1 -- 172.21.15.1:0/3368364468 shutdown_connections 2023-11-15T01:33:45.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.419+0000 7fecadead700 1 -- 172.21.15.1:0/3368364468 wait complete. 2023-11-15T01:33:45.436 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-15T01:33:45.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.604+0000 7ff7d46f8700 1 Processor -- start 2023-11-15T01:33:45.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.604+0000 7ff7d46f8700 1 -- start start 2023-11-15T01:33:45.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.605+0000 7ff7d46f8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff7cc14b350 0x7ff7cc0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:45.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.605+0000 7ff7d46f8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7cc0aa750 0x7ff7cc154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:45.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.605+0000 7ff7d46f8700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc1580d0 con 0x7ff7cc14b730 2023-11-15T01:33:45.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.605+0000 7ff7d46f8700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc155000 con 0x7ff7cc14b350 2023-11-15T01:33:45.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.605+0000 7ff7d46f8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc1552e0 con 0x7ff7cc0aa750 2023-11-15T01:33:45.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.606+0000 7ff7d2494700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff7cc14b350 0x7ff7cc0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:45.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.606+0000 7ff7d2494700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff7cc14b350 0x7ff7cc0c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38248/0 (socket says 172.21.15.1:38248) 2023-11-15T01:33:45.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.606+0000 7ff7d2494700 1 -- 172.21.15.1:0/4293150096 learned_addr learned my addr 172.21.15.1:0/4293150096 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:45.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.606+0000 7ff7d2c95700 1 --2- 172.21.15.1:0/4293150096 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7cc0aa750 0x7ff7cc154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:45.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.606+0000 7ff7d2494700 1 -- 172.21.15.1:0/4293150096 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7cc0aa750 msgr2=0x7ff7cc154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:45.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.606+0000 7ff7d2494700 1 --2- 172.21.15.1:0/4293150096 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7cc0aa750 0x7ff7cc154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:45.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.606+0000 7ff7d2494700 1 -- 172.21.15.1:0/4293150096 >> v1:172.21.15.141:6789/0 conn(0x7ff7cc14b730 legacy=0x7ff7cc0aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:45.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.606+0000 7ff7d2494700 1 -- 172.21.15.1:0/4293150096 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc1555c0 con 0x7ff7cc14b350 2023-11-15T01:33:45.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.606+0000 7ff7d2494700 1 --2- 172.21.15.1:0/4293150096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7cc14b350 0x7ff7cc0c8290 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7ff7c4009f20 tx=0x7ff7c4009840).ready entity=mon.0 client_cookie=98b9df4ec302620a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:45.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.606+0000 7ff7d1492700 1 -- 172.21.15.1:0/4293150096 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400e070 con 0x7ff7cc14b350 2023-11-15T01:33:45.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.606+0000 7ff7d1492700 1 -- 172.21.15.1:0/4293150096 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c400ba80 con 0x7ff7cc14b350 2023-11-15T01:33:45.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.606+0000 7ff7d1492700 1 -- 172.21.15.1:0/4293150096 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400be00 con 0x7ff7cc14b350 2023-11-15T01:33:45.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.607+0000 7ff7d46f8700 1 -- 172.21.15.1:0/4293150096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7cc14b350 msgr2=0x7ff7cc0c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:45.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.607+0000 7ff7d46f8700 1 --2- 172.21.15.1:0/4293150096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7cc14b350 0x7ff7cc0c8290 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7ff7c4009f20 tx=0x7ff7c4009840).stop 2023-11-15T01:33:45.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.607+0000 7ff7d46f8700 1 -- 172.21.15.1:0/4293150096 shutdown_connections 2023-11-15T01:33:45.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.607+0000 7ff7d46f8700 1 --2- 172.21.15.1:0/4293150096 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7cc0aa750 0x7ff7cc154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:45.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.607+0000 7ff7d46f8700 1 --2- 172.21.15.1:0/4293150096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7cc14b350 0x7ff7cc0c8290 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:45.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.607+0000 7ff7d46f8700 1 -- 172.21.15.1:0/4293150096 >> 172.21.15.1:0/4293150096 conn(0x7ff7cc069ee0 msgr2=0x7ff7cc06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:45.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.607+0000 7ff7d46f8700 1 -- 172.21.15.1:0/4293150096 shutdown_connections 2023-11-15T01:33:45.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.607+0000 7ff7d46f8700 1 -- 172.21.15.1:0/4293150096 wait complete. 2023-11-15T01:33:45.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.608+0000 7ff7d46f8700 1 Processor -- start 2023-11-15T01:33:45.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.608+0000 7ff7d46f8700 1 -- start start 2023-11-15T01:33:45.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d46f8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7cc0aa750 0x7ff7cc0c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:45.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d46f8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff7cc14b350 0x7ff7cc0c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:45.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d46f8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7cc14b730 0x7ff7cc141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:45.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d46f8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0cad00 con 0x7ff7cc0aa750 2023-11-15T01:33:45.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d46f8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0c5020 con 0x7ff7cc14b350 2023-11-15T01:33:45.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d46f8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0c99c0 con 0x7ff7cc14b730 2023-11-15T01:33:45.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d2494700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7cc0aa750 0x7ff7cc0c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:45.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d2494700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7cc0aa750 0x7ff7cc0c4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38254/0 (socket says 172.21.15.1:38254) 2023-11-15T01:33:45.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d2494700 1 -- 172.21.15.1:0/1019786840 learned_addr learned my addr 172.21.15.1:0/1019786840 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:45.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d1c93700 1 --2- 172.21.15.1:0/1019786840 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff7cc14b350 0x7ff7cc0c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:45.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d2c95700 1 --2- 172.21.15.1:0/1019786840 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7cc14b730 0x7ff7cc141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:45.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d2494700 1 -- 172.21.15.1:0/1019786840 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7cc14b730 msgr2=0x7ff7cc141d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:45.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d2494700 1 --2- 172.21.15.1:0/1019786840 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7cc14b730 0x7ff7cc141d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:45.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d2494700 1 -- 172.21.15.1:0/1019786840 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff7cc14b350 msgr2=0x7ff7cc0c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:45.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d2494700 1 --2- 172.21.15.1:0/1019786840 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff7cc14b350 0x7ff7cc0c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:45.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d2494700 1 -- 172.21.15.1:0/1019786840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4009ae0 con 0x7ff7cc0aa750 2023-11-15T01:33:45.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d2494700 1 --2- 172.21.15.1:0/1019786840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7cc0aa750 0x7ff7cc0c4b30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7ff7cc062ca0 tx=0x7ff7c4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:45.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7ca7fc700 1 -- 172.21.15.1:0/1019786840 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40092e0 con 0x7ff7cc0aa750 2023-11-15T01:33:45.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7ca7fc700 1 -- 172.21.15.1:0/1019786840 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c4013b70 con 0x7ff7cc0aa750 2023-11-15T01:33:45.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7ca7fc700 1 -- 172.21.15.1:0/1019786840 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c401e470 con 0x7ff7cc0aa750 2023-11-15T01:33:45.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.609+0000 7ff7d46f8700 1 -- 172.21.15.1:0/1019786840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc0ca340 con 0x7ff7cc0aa750 2023-11-15T01:33:45.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.610+0000 7ff7d46f8700 1 -- 172.21.15.1:0/1019786840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc0c9090 con 0x7ff7cc0aa750 2023-11-15T01:33:45.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.611+0000 7ff7d46f8700 1 -- 172.21.15.1:0/1019786840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc0c9ca0 con 0x7ff7cc0aa750 2023-11-15T01:33:45.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.611+0000 7ff7ca7fc700 1 -- 172.21.15.1:0/1019786840 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) v1 ==== 75340+0+0 (secure 0 0 0) 0x7ff7c4003040 con 0x7ff7cc0aa750 2023-11-15T01:33:45.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.611+0000 7ff7ca7fc700 1 --2- 172.21.15.1:0/1019786840 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff7b805f030 0x7ff7b80614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:45.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.611+0000 7ff7ca7fc700 1 -- 172.21.15.1:0/1019786840 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6976+0+0 (secure 0 0 0) 0x7ff7c407b530 con 0x7ff7cc0aa750 2023-11-15T01:33:45.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.611+0000 7ff7d1c93700 1 --2- 172.21.15.1:0/1019786840 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff7b805f030 0x7ff7b80614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:45.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.612+0000 7ff7d1c93700 1 --2- 172.21.15.1:0/1019786840 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff7b805f030 0x7ff7b80614f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff7cc0ad220 tx=0x7ff7c0007d40).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:45.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.616+0000 7ff7ca7fc700 1 -- 172.21.15.1:0/1019786840 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff7c404c730 con 0x7ff7cc0aa750 2023-11-15T01:33:45.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:45.788+0000 7ff7d46f8700 1 -- 172.21.15.1:0/1019786840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff7cc06c7e0 con 0x7ff7cc0aa750 2023-11-15T01:33:46.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.153+0000 7ff7ca7fc700 1 -- 172.21.15.1:0/1019786840 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff7c4079180 con 0x7ff7cc0aa750 2023-11-15T01:33:46.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.420+0000 7ff7ca7fc700 1 -- 172.21.15.1:0/1019786840 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff7c4041ab0 con 0x7ff7cc0aa750 2023-11-15T01:33:46.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.423+0000 7ff7d46f8700 1 -- 172.21.15.1:0/1019786840 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff7b805f030 msgr2=0x7ff7b80614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:46.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.423+0000 7ff7d46f8700 1 --2- 172.21.15.1:0/1019786840 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff7b805f030 0x7ff7b80614f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff7cc0ad220 tx=0x7ff7c0007d40).stop 2023-11-15T01:33:46.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.423+0000 7ff7d46f8700 1 -- 172.21.15.1:0/1019786840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7cc0aa750 msgr2=0x7ff7cc0c4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:46.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.423+0000 7ff7d46f8700 1 --2- 172.21.15.1:0/1019786840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7cc0aa750 0x7ff7cc0c4b30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7ff7cc062ca0 tx=0x7ff7c4009840).stop 2023-11-15T01:33:46.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.423+0000 7ff7d46f8700 1 -- 172.21.15.1:0/1019786840 shutdown_connections 2023-11-15T01:33:46.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.423+0000 7ff7d46f8700 1 --2- 172.21.15.1:0/1019786840 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff7b805f030 0x7ff7b80614f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:46.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.423+0000 7ff7d46f8700 1 --2- 172.21.15.1:0/1019786840 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7cc14b730 0x7ff7cc141d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:46.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.423+0000 7ff7d46f8700 1 --2- 172.21.15.1:0/1019786840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7cc0aa750 0x7ff7cc0c4b30 secure :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0x7ff7cc062ca0 tx=0x7ff7c4009840).stop 2023-11-15T01:33:46.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.423+0000 7ff7d46f8700 1 --2- 172.21.15.1:0/1019786840 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff7cc14b350 0x7ff7cc0c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:46.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.423+0000 7ff7d46f8700 1 -- 172.21.15.1:0/1019786840 >> 172.21.15.1:0/1019786840 conn(0x7ff7cc069ee0 msgr2=0x7ff7cc143b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:46.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.424+0000 7ff7d46f8700 1 -- 172.21.15.1:0/1019786840 shutdown_connections 2023-11-15T01:33:46.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.424+0000 7ff7d46f8700 1 -- 172.21.15.1:0/1019786840 wait complete. 2023-11-15T01:33:46.429 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2023-11-15T01:33:46.440 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-15T01:33:46.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.566+0000 7f36c382f700 1 Processor -- start 2023-11-15T01:33:46.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.566+0000 7f36c382f700 1 -- start start 2023-11-15T01:33:46.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.567+0000 7f36c382f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f36bc0c1cb0 0x7f36bc157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:46.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.567+0000 7f36c382f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f36bc0aa060 0x7f36bc0aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:46.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.567+0000 7f36c382f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36bc0c1820 con 0x7f36bc157660 2023-11-15T01:33:46.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.567+0000 7f36c382f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36bc0c7540 con 0x7f36bc0aa060 2023-11-15T01:33:46.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.567+0000 7f36c382f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36bc0aa9e0 con 0x7f36bc0c1cb0 2023-11-15T01:33:46.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.567+0000 7f36c1dcc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f36bc0aa060 0x7f36bc0aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:46.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.567+0000 7f36c15cb700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f36bc157660 0x7f36bc0c6280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45034/0 (socket says 172.21.15.1:45034) 2023-11-15T01:33:46.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.567+0000 7f36c15cb700 1 -- 172.21.15.1:0/943995485 learned_addr learned my addr 172.21.15.1:0/943995485 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:46.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.567+0000 7f36c0dca700 1 --2- 172.21.15.1:0/943995485 >> v2:172.21.15.141:3300/0 conn(0x7f36bc0c1cb0 0x7f36bc157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:46.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.567+0000 7f36c1dcc700 1 -- 172.21.15.1:0/943995485 >> v2:172.21.15.141:3300/0 conn(0x7f36bc0c1cb0 msgr2=0x7f36bc157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:46.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.567+0000 7f36c1dcc700 1 --2- 172.21.15.1:0/943995485 >> v2:172.21.15.141:3300/0 conn(0x7f36bc0c1cb0 0x7f36bc157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:46.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36c1dcc700 1 -- 172.21.15.1:0/943995485 >> v1:172.21.15.1:6789/0 conn(0x7f36bc157660 legacy=0x7f36bc0c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:46.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36bbfff700 1 -- 172.21.15.1:0/943995485 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171808874 0 0) 0x7f36bc0c1820 con 0x7f36bc157660 2023-11-15T01:33:46.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36c1dcc700 1 -- 172.21.15.1:0/943995485 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc0c0c30 con 0x7f36bc0aa060 2023-11-15T01:33:46.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36c0dca700 1 --2- 172.21.15.1:0/943995485 >> v2:172.21.15.141:3300/0 conn(0x7f36bc0c1cb0 0x7f36bc157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36c1dcc700 1 --2- 172.21.15.1:0/943995485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36bc0aa060 0x7f36bc0aa4f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f36bc084720 tx=0x7f36ac009780).ready entity=mon.0 client_cookie=e8789a6e69e6f009 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36bbfff700 1 -- 172.21.15.1:0/943995485 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00e070 con 0x7f36bc0aa060 2023-11-15T01:33:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36bbfff700 1 -- 172.21.15.1:0/943995485 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac00bc30 con 0x7f36bc0aa060 2023-11-15T01:33:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36bbfff700 1 -- 172.21.15.1:0/943995485 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac012410 con 0x7f36bc0aa060 2023-11-15T01:33:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36c382f700 1 -- 172.21.15.1:0/943995485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36bc0aa060 msgr2=0x7f36bc0aa4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:46.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36c382f700 1 --2- 172.21.15.1:0/943995485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36bc0aa060 0x7f36bc0aa4f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f36bc084720 tx=0x7f36ac009780).stop 2023-11-15T01:33:46.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36c382f700 1 -- 172.21.15.1:0/943995485 shutdown_connections 2023-11-15T01:33:46.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36c382f700 1 --2- 172.21.15.1:0/943995485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36bc0aa060 0x7f36bc0aa4f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:46.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36c382f700 1 --2- 172.21.15.1:0/943995485 >> v2:172.21.15.141:3300/0 conn(0x7f36bc0c1cb0 0x7f36bc157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:46.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36c382f700 1 -- 172.21.15.1:0/943995485 >> 172.21.15.1:0/943995485 conn(0x7f36bc064aa0 msgr2=0x7f36bc064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:46.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36c382f700 1 -- 172.21.15.1:0/943995485 shutdown_connections 2023-11-15T01:33:46.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.568+0000 7f36c382f700 1 -- 172.21.15.1:0/943995485 wait complete. 2023-11-15T01:33:46.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.569+0000 7f36c382f700 1 Processor -- start 2023-11-15T01:33:46.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.569+0000 7f36c382f700 1 -- start start 2023-11-15T01:33:46.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.570+0000 7f36c382f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36bc0aa060 0x7f36bc0c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:46.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.570+0000 7f36c382f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36bc0c1cb0 0x7f36bc164840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:46.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.570+0000 7f36c382f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36bc157660 0x7f36bc1611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:46.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.570+0000 7f36c382f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc0c42b0 con 0x7f36bc0c1cb0 2023-11-15T01:33:46.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.570+0000 7f36c382f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc0c50b0 con 0x7f36bc157660 2023-11-15T01:33:46.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.570+0000 7f36c382f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc167230 con 0x7f36bc0aa060 2023-11-15T01:33:46.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.570+0000 7f36c0dca700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36bc0c1cb0 0x7f36bc164840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:46.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.571+0000 7f36c0dca700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36bc0c1cb0 0x7f36bc164840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38260/0 (socket says 172.21.15.1:38260) 2023-11-15T01:33:46.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.571+0000 7f36c0dca700 1 -- 172.21.15.1:0/2753982675 learned_addr learned my addr 172.21.15.1:0/2753982675 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:46.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.571+0000 7f36c1dcc700 1 --2- 172.21.15.1:0/2753982675 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36bc157660 0x7f36bc1611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:46.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.571+0000 7f36c15cb700 1 --2- 172.21.15.1:0/2753982675 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36bc0aa060 0x7f36bc0c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:46.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.571+0000 7f36c0dca700 1 -- 172.21.15.1:0/2753982675 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36bc0aa060 msgr2=0x7f36bc0c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:46.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.571+0000 7f36c0dca700 1 --2- 172.21.15.1:0/2753982675 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36bc0aa060 0x7f36bc0c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:46.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.571+0000 7f36c0dca700 1 -- 172.21.15.1:0/2753982675 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36bc157660 msgr2=0x7f36bc1611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:46.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.571+0000 7f36c0dca700 1 --2- 172.21.15.1:0/2753982675 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36bc157660 0x7f36bc1611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:46.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.571+0000 7f36c0dca700 1 -- 172.21.15.1:0/2753982675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac009a20 con 0x7f36bc0c1cb0 2023-11-15T01:33:46.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.571+0000 7f36c0dca700 1 --2- 172.21.15.1:0/2753982675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36bc0c1cb0 0x7f36bc164840 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f36b000c8b0 tx=0x7f36b0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:46.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.571+0000 7f36b97fa700 1 -- 172.21.15.1:0/2753982675 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b0010580 con 0x7f36bc0c1cb0 2023-11-15T01:33:46.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.571+0000 7f36b97fa700 1 -- 172.21.15.1:0/2753982675 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b00106e0 con 0x7f36bc0c1cb0 2023-11-15T01:33:46.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.571+0000 7f36c382f700 1 -- 172.21.15.1:0/2753982675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36bc0c44a0 con 0x7f36bc0c1cb0 2023-11-15T01:33:46.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.571+0000 7f36b97fa700 1 -- 172.21.15.1:0/2753982675 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b0010a60 con 0x7f36bc0c1cb0 2023-11-15T01:33:46.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.571+0000 7f36c382f700 1 -- 172.21.15.1:0/2753982675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36bc0c4a60 con 0x7f36bc0c1cb0 2023-11-15T01:33:46.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.572+0000 7f36c382f700 1 -- 172.21.15.1:0/2753982675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36bc06c7e0 con 0x7f36bc0c1cb0 2023-11-15T01:33:46.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.573+0000 7f36b97fa700 1 -- 172.21.15.1:0/2753982675 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f36b001b460 con 0x7f36bc0c1cb0 2023-11-15T01:33:46.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.573+0000 7f36b97fa700 1 --2- 172.21.15.1:0/2753982675 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f36a805f270 0x7f36a8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:46.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.573+0000 7f36b97fa700 1 -- 172.21.15.1:0/2753982675 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6538+0+0 (secure 0 0 0) 0x7f36b007a3e0 con 0x7f36bc0c1cb0 2023-11-15T01:33:46.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.573+0000 7f36c15cb700 1 --2- 172.21.15.1:0/2753982675 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f36a805f270 0x7f36a8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:46.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.573+0000 7f36c15cb700 1 --2- 172.21.15.1:0/2753982675 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f36a805f270 0x7f36a8061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f36b4007fd0 tx=0x7f36b4007dd0).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:46.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.577+0000 7f36b97fa700 1 -- 172.21.15.1:0/2753982675 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f36b004b330 con 0x7f36bc0c1cb0 2023-11-15T01:33:46.717 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:33:46.720 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:33:46.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:46.761+0000 7f36c382f700 1 -- 172.21.15.1:0/2753982675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f36bc05f8b0 con 0x7f36bc0c1cb0 2023-11-15T01:33:47.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.421+0000 7f36b97fa700 1 -- 172.21.15.1:0/2753982675 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 169+0+0 (secure 0 0 0) 0x7f36b004e950 con 0x7f36bc0c1cb0 2023-11-15T01:33:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.425+0000 7f36c382f700 1 -- 172.21.15.1:0/2753982675 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f36a805f270 msgr2=0x7f36a8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.425+0000 7f36c382f700 1 --2- 172.21.15.1:0/2753982675 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f36a805f270 0x7f36a8061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f36b4007fd0 tx=0x7f36b4007dd0).stop 2023-11-15T01:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.425+0000 7f36c382f700 1 -- 172.21.15.1:0/2753982675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36bc0c1cb0 msgr2=0x7f36bc164840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.425+0000 7f36c382f700 1 --2- 172.21.15.1:0/2753982675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36bc0c1cb0 0x7f36bc164840 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f36b000c8b0 tx=0x7f36b0008040).stop 2023-11-15T01:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.425+0000 7f36c382f700 1 -- 172.21.15.1:0/2753982675 shutdown_connections 2023-11-15T01:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.425+0000 7f36c382f700 1 --2- 172.21.15.1:0/2753982675 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f36a805f270 0x7f36a8061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.425+0000 7f36c382f700 1 --2- 172.21.15.1:0/2753982675 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36bc157660 0x7f36bc1611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.425+0000 7f36c382f700 1 --2- 172.21.15.1:0/2753982675 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36bc0aa060 0x7f36bc0c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.425+0000 7f36c382f700 1 --2- 172.21.15.1:0/2753982675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36bc0c1cb0 0x7f36bc164840 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.425+0000 7f36c382f700 1 -- 172.21.15.1:0/2753982675 >> 172.21.15.1:0/2753982675 conn(0x7f36bc064aa0 msgr2=0x7f36bc155570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:47.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.425+0000 7f36c382f700 1 -- 172.21.15.1:0/2753982675 shutdown_connections 2023-11-15T01:33:47.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.425+0000 7f36c382f700 1 -- 172.21.15.1:0/2753982675 wait complete. 2023-11-15T01:33:47.429 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2023-11-15T01:33:47.441 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-15T01:33:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.566+0000 7f9b2a08f700 1 Processor -- start 2023-11-15T01:33:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.566+0000 7f9b2a08f700 1 -- start start 2023-11-15T01:33:47.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.567+0000 7f9b2a08f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9b24137030 0x7f9b24137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:47.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.567+0000 7f9b2a08f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b24158d90 con 0x7f9b24066f80 2023-11-15T01:33:47.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.567+0000 7f9b2a08f700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b24154ce0 con 0x7f9b241588e0 2023-11-15T01:33:47.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.567+0000 7f9b2a08f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b24137900 con 0x7f9b24137030 2023-11-15T01:33:47.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.567+0000 7f9b23fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9b24066f80 0x7f9b2414e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45042/0 (socket says 172.21.15.1:45042) 2023-11-15T01:33:47.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.567+0000 7f9b23fff700 1 -- 172.21.15.1:0/3936008022 learned_addr learned my addr 172.21.15.1:0/3936008022 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:47.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.567+0000 7f9b227fc700 1 -- 172.21.15.1:0/3936008022 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986862388 0 0) 0x7f9b24158d90 con 0x7f9b24066f80 2023-11-15T01:33:47.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.567+0000 7f9b237fe700 1 --2- 172.21.15.1:0/3936008022 >> v2:172.21.15.141:3300/0 conn(0x7f9b24137030 0x7f9b24137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:47.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.567+0000 7f9b227fc700 1 -- 172.21.15.1:0/3936008022 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b0c0033f0 con 0x7f9b24066f80 2023-11-15T01:33:47.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.567+0000 7f9b227fc700 1 -- 172.21.15.1:0/3936008022 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2120684696 0 0) 0x7f9b0c0033f0 con 0x7f9b24066f80 2023-11-15T01:33:47.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.567+0000 7f9b227fc700 1 -- 172.21.15.1:0/3936008022 >> v2:172.21.15.141:3300/0 conn(0x7f9b24137030 msgr2=0x7f9b24137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:47.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.567+0000 7f9b227fc700 1 --2- 172.21.15.1:0/3936008022 >> v2:172.21.15.141:3300/0 conn(0x7f9b24137030 0x7f9b24137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.567+0000 7f9b227fc700 1 -- 172.21.15.1:0/3936008022 >> v1:172.21.15.141:6789/0 conn(0x7f9b241588e0 legacy=0x7f9b24066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:47.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.567+0000 7f9b227fc700 1 -- 172.21.15.1:0/3936008022 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b24154fc0 con 0x7f9b24066f80 2023-11-15T01:33:47.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.567+0000 7f9b227fc700 1 -- 172.21.15.1:0/3936008022 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f9b1c0017f0 con 0x7f9b24066f80 2023-11-15T01:33:47.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b227fc700 1 -- 172.21.15.1:0/3936008022 >> v1:172.21.15.1:6789/0 conn(0x7f9b24066f80 legacy=0x7f9b2414e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:47.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b227fc700 1 --2- 172.21.15.1:0/3936008022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b0c0038e0 0x7f9b0c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:47.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b227fc700 1 --2- 172.21.15.1:0/3936008022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b0c004690 0x7f9b0c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:47.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b227fc700 1 --2- 172.21.15.1:0/3936008022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b0c005000 0x7f9b0c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:47.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b227fc700 1 -- 172.21.15.1:0/3936008022 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b24137900 con 0x7f9b0c005000 2023-11-15T01:33:47.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b227fc700 1 -- 172.21.15.1:0/3936008022 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c00bf60 con 0x7f9b0c004690 2023-11-15T01:33:47.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b227fc700 1 -- 172.21.15.1:0/3936008022 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c00c0f0 con 0x7f9b0c0038e0 2023-11-15T01:33:47.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b23fff700 1 --2- 172.21.15.1:0/3936008022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b0c005000 0x7f9b0c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:47.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b237fe700 1 --2- 172.21.15.1:0/3936008022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b0c0038e0 0x7f9b0c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:47.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b22ffd700 1 --2- 172.21.15.1:0/3936008022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b0c004690 0x7f9b0c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:47.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b23fff700 1 -- 172.21.15.1:0/3936008022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b0c0038e0 msgr2=0x7f9b0c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:47.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b23fff700 1 --2- 172.21.15.1:0/3936008022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b0c0038e0 0x7f9b0c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b23fff700 1 -- 172.21.15.1:0/3936008022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b0c004690 msgr2=0x7f9b0c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:47.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b23fff700 1 --2- 172.21.15.1:0/3936008022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b0c004690 0x7f9b0c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b23fff700 1 -- 172.21.15.1:0/3936008022 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0c0033f0 con 0x7f9b0c005000 2023-11-15T01:33:47.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b23fff700 1 -- 172.21.15.1:0/3936008022 reap_dead start 2023-11-15T01:33:47.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b23fff700 1 --2- 172.21.15.1:0/3936008022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b0c005000 0x7f9b0c00b8e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f9b1c00c480 tx=0x7f9b1c00c790).ready entity=mon.0 client_cookie=9f36bb9287d0e05a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:47.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b227fc700 1 -- 172.21.15.1:0/3936008022 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c002030 con 0x7f9b0c005000 2023-11-15T01:33:47.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b227fc700 1 -- 172.21.15.1:0/3936008022 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c00ce20 con 0x7f9b0c005000 2023-11-15T01:33:47.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.568+0000 7f9b227fc700 1 -- 172.21.15.1:0/3936008022 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c005d30 con 0x7f9b0c005000 2023-11-15T01:33:47.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.569+0000 7f9b2a08f700 1 -- 172.21.15.1:0/3936008022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b0c005000 msgr2=0x7f9b0c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:47.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.569+0000 7f9b2a08f700 1 --2- 172.21.15.1:0/3936008022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b0c005000 0x7f9b0c00b8e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f9b1c00c480 tx=0x7f9b1c00c790).stop 2023-11-15T01:33:47.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.569+0000 7f9b2a08f700 1 -- 172.21.15.1:0/3936008022 shutdown_connections 2023-11-15T01:33:47.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.569+0000 7f9b2a08f700 1 --2- 172.21.15.1:0/3936008022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b0c005000 0x7f9b0c00b8e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.569+0000 7f9b2a08f700 1 -- 172.21.15.1:0/3936008022 >> 172.21.15.1:0/3936008022 conn(0x7f9b24063280 msgr2=0x7f9b240c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:47.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.569+0000 7f9b2a08f700 1 -- 172.21.15.1:0/3936008022 shutdown_connections 2023-11-15T01:33:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.569+0000 7f9b2a08f700 1 -- 172.21.15.1:0/3936008022 wait complete. 2023-11-15T01:33:47.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.570+0000 7f9b2a08f700 1 Processor -- start 2023-11-15T01:33:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.570+0000 7f9b2a08f700 1 -- start start 2023-11-15T01:33:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b2a08f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b0c005000 0x7f9b2413a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b2a08f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b241644d0 0x7f9b241364e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b2a08f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b2413a870 0x7f9b241369d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:47.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b2a08f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b24136ec0 con 0x7f9b0c005000 2023-11-15T01:33:47.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b2a08f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240ae780 con 0x7f9b241644d0 2023-11-15T01:33:47.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b2a08f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b24137d40 con 0x7f9b2413a870 2023-11-15T01:33:47.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b237fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b0c005000 0x7f9b2413a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:47.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b237fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b0c005000 0x7f9b2413a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38268/0 (socket says 172.21.15.1:38268) 2023-11-15T01:33:47.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b237fe700 1 -- 172.21.15.1:0/2869699957 learned_addr learned my addr 172.21.15.1:0/2869699957 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:47.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b22ffd700 1 --2- 172.21.15.1:0/2869699957 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b241644d0 0x7f9b241364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:47.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b23fff700 1 --2- 172.21.15.1:0/2869699957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b2413a870 0x7f9b241369d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:47.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b237fe700 1 -- 172.21.15.1:0/2869699957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b2413a870 msgr2=0x7f9b241369d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:47.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b237fe700 1 --2- 172.21.15.1:0/2869699957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b2413a870 0x7f9b241369d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b237fe700 1 -- 172.21.15.1:0/2869699957 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b241644d0 msgr2=0x7f9b241364e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:47.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b237fe700 1 --2- 172.21.15.1:0/2869699957 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b241644d0 0x7f9b241364e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b237fe700 1 -- 172.21.15.1:0/2869699957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b24138020 con 0x7f9b0c005000 2023-11-15T01:33:47.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b22ffd700 1 --2- 172.21.15.1:0/2869699957 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b241644d0 0x7f9b241364e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:47.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.571+0000 7f9b237fe700 1 --2- 172.21.15.1:0/2869699957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b0c005000 0x7f9b2413a380 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f9b14006940 tx=0x7f9b14009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:47.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.572+0000 7f9b0b7fe700 1 -- 172.21.15.1:0/2869699957 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14011ed0 con 0x7f9b0c005000 2023-11-15T01:33:47.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.572+0000 7f9b0b7fe700 1 -- 172.21.15.1:0/2869699957 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1400f940 con 0x7f9b0c005000 2023-11-15T01:33:47.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.572+0000 7f9b2a08f700 1 -- 172.21.15.1:0/2869699957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b24138300 con 0x7f9b0c005000 2023-11-15T01:33:47.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.572+0000 7f9b0b7fe700 1 -- 172.21.15.1:0/2869699957 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400fd00 con 0x7f9b0c005000 2023-11-15T01:33:47.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.572+0000 7f9b2a08f700 1 -- 172.21.15.1:0/2869699957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b240ada50 con 0x7f9b0c005000 2023-11-15T01:33:47.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.573+0000 7f9b2a08f700 1 -- 172.21.15.1:0/2869699957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2405f960 con 0x7f9b0c005000 2023-11-15T01:33:47.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.573+0000 7f9b0b7fe700 1 -- 172.21.15.1:0/2869699957 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9b14014650 con 0x7f9b0c005000 2023-11-15T01:33:47.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.573+0000 7f9b0b7fe700 1 --2- 172.21.15.1:0/2869699957 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b1005f270 0x7f9b10061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:47.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.573+0000 7f9b0b7fe700 1 -- 172.21.15.1:0/2869699957 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6095+0+0 (secure 0 0 0) 0x7f9b1407ac70 con 0x7f9b0c005000 2023-11-15T01:33:47.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.574+0000 7f9b22ffd700 1 --2- 172.21.15.1:0/2869699957 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b1005f270 0x7f9b10061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:47.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.574+0000 7f9b22ffd700 1 --2- 172.21.15.1:0/2869699957 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b1005f270 0x7f9b10061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9b241518e0 tx=0x7f9b18009040).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:47.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.577+0000 7f9b0b7fe700 1 -- 172.21.15.1:0/2869699957 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9b2405f960 con 0x7f9b0c005000 2023-11-15T01:33:47.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.754+0000 7f9b2a08f700 1 -- 172.21.15.1:0/2869699957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9b24138950 con 0x7f9b0c005000 2023-11-15T01:33:47.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.757+0000 7f9b0b7fe700 1 -- 172.21.15.1:0/2869699957 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v4) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9b14022070 con 0x7f9b0c005000 2023-11-15T01:33:47.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.759+0000 7f9b2a08f700 1 -- 172.21.15.1:0/2869699957 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b1005f270 msgr2=0x7f9b10061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:47.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.759+0000 7f9b2a08f700 1 --2- 172.21.15.1:0/2869699957 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b1005f270 0x7f9b10061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9b241518e0 tx=0x7f9b18009040).stop 2023-11-15T01:33:47.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.759+0000 7f9b2a08f700 1 -- 172.21.15.1:0/2869699957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b0c005000 msgr2=0x7f9b2413a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:47.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.759+0000 7f9b2a08f700 1 --2- 172.21.15.1:0/2869699957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b0c005000 0x7f9b2413a380 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f9b14006940 tx=0x7f9b14009060).stop 2023-11-15T01:33:47.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.759+0000 7f9b2a08f700 1 -- 172.21.15.1:0/2869699957 shutdown_connections 2023-11-15T01:33:47.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.759+0000 7f9b2a08f700 1 --2- 172.21.15.1:0/2869699957 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b1005f270 0x7f9b10061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.759+0000 7f9b2a08f700 1 --2- 172.21.15.1:0/2869699957 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b2413a870 0x7f9b241369d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.759+0000 7f9b2a08f700 1 --2- 172.21.15.1:0/2869699957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b0c005000 0x7f9b2413a380 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.759+0000 7f9b2a08f700 1 --2- 172.21.15.1:0/2869699957 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b241644d0 0x7f9b241364e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.759+0000 7f9b2a08f700 1 -- 172.21.15.1:0/2869699957 >> 172.21.15.1:0/2869699957 conn(0x7f9b24063280 msgr2=0x7f9b240bed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:47.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.759+0000 7f9b2a08f700 1 -- 172.21.15.1:0/2869699957 shutdown_connections 2023-11-15T01:33:47.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.759+0000 7f9b2a08f700 1 -- 172.21.15.1:0/2869699957 wait complete. 2023-11-15T01:33:47.774 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-15T01:33:47.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.892+0000 7f362d2a0700 1 Processor -- start 2023-11-15T01:33:47.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.892+0000 7f362d2a0700 1 -- start start 2023-11-15T01:33:47.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.893+0000 7f362d2a0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f36281540a0 0x7f36280ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:47.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.893+0000 7f362d2a0700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f36280c6650 0x7f36280ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:47.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.893+0000 7f362d2a0700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36280ca050 con 0x7f3628154480 2023-11-15T01:33:47.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.893+0000 7f362d2a0700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36280c9440 con 0x7f36281540a0 2023-11-15T01:33:47.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.893+0000 7f362d2a0700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36280c9720 con 0x7f36280c6650 2023-11-15T01:33:47.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.893+0000 7f3626ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f36281540a0 0x7f36280ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:47.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.893+0000 7f3626ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f36281540a0 0x7f36280ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48628/0 (socket says 172.21.15.1:48628) 2023-11-15T01:33:47.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.893+0000 7f3626ffd700 1 -- 172.21.15.1:0/2737826835 learned_addr learned my addr 172.21.15.1:0/2737826835 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:47.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.894+0000 7f36277fe700 1 --2- 172.21.15.1:0/2737826835 >> v2:172.21.15.141:3300/0 conn(0x7f36280c6650 0x7f36280ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.894+0000 7f3626ffd700 1 -- 172.21.15.1:0/2737826835 >> v2:172.21.15.141:3300/0 conn(0x7f36280c6650 msgr2=0x7f36280ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.894+0000 7f3626ffd700 1 --2- 172.21.15.1:0/2737826835 >> v2:172.21.15.141:3300/0 conn(0x7f36280c6650 0x7f36280ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.894+0000 7f3626ffd700 1 -- 172.21.15.1:0/2737826835 >> v1:172.21.15.141:6789/0 conn(0x7f3628154480 legacy=0x7f36280c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.894+0000 7f3626ffd700 1 -- 172.21.15.1:0/2737826835 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36280c9a00 con 0x7f36281540a0 2023-11-15T01:33:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.894+0000 7f3626ffd700 1 --2- 172.21.15.1:0/2737826835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36281540a0 0x7f36280ca4e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f3628084220 tx=0x7f3620009840).ready entity=mon.0 client_cookie=d1b5174ec949916f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:47.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.894+0000 7f3625ffb700 1 -- 172.21.15.1:0/2737826835 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362000e070 con 0x7f36281540a0 2023-11-15T01:33:47.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.894+0000 7f3625ffb700 1 -- 172.21.15.1:0/2737826835 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362000ba10 con 0x7f36281540a0 2023-11-15T01:33:47.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.894+0000 7f3625ffb700 1 -- 172.21.15.1:0/2737826835 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362000bd90 con 0x7f36281540a0 2023-11-15T01:33:47.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.894+0000 7f362d2a0700 1 -- 172.21.15.1:0/2737826835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36281540a0 msgr2=0x7f36280ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:47.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.894+0000 7f362d2a0700 1 --2- 172.21.15.1:0/2737826835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36281540a0 0x7f36280ca4e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f3628084220 tx=0x7f3620009840).stop 2023-11-15T01:33:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.894+0000 7f362d2a0700 1 -- 172.21.15.1:0/2737826835 shutdown_connections 2023-11-15T01:33:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.894+0000 7f362d2a0700 1 --2- 172.21.15.1:0/2737826835 >> v2:172.21.15.141:3300/0 conn(0x7f36280c6650 0x7f36280ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.894+0000 7f362d2a0700 1 --2- 172.21.15.1:0/2737826835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36281540a0 0x7f36280ca4e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.894+0000 7f362d2a0700 1 -- 172.21.15.1:0/2737826835 >> 172.21.15.1:0/2737826835 conn(0x7f3628064a70 msgr2=0x7f3628064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.895+0000 7f362d2a0700 1 -- 172.21.15.1:0/2737826835 shutdown_connections 2023-11-15T01:33:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.895+0000 7f362d2a0700 1 -- 172.21.15.1:0/2737826835 wait complete. 2023-11-15T01:33:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.896+0000 7f362d2a0700 1 Processor -- start 2023-11-15T01:33:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.896+0000 7f362d2a0700 1 -- start start 2023-11-15T01:33:47.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.896+0000 7f362d2a0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36280c6650 0x7f3628150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:47.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f362d2a0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36281540a0 0x7f362814e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:47.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f362d2a0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3628154480 0x7f36280a95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:47.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f362d2a0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3628150bb0 con 0x7f3628154480 2023-11-15T01:33:47.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f362d2a0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3628150e90 con 0x7f36281540a0 2023-11-15T01:33:47.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f362d2a0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3628151170 con 0x7f36280c6650 2023-11-15T01:33:47.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f36277fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3628154480 0x7f36280a95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:47.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f36277fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3628154480 0x7f36280a95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48632/0 (socket says 172.21.15.1:48632) 2023-11-15T01:33:47.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f36277fe700 1 -- 172.21.15.1:0/1566676293 learned_addr learned my addr 172.21.15.1:0/1566676293 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:47.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f36267fc700 1 --2- 172.21.15.1:0/1566676293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36281540a0 0x7f362814e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:47.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f36277fe700 1 -- 172.21.15.1:0/1566676293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36280c6650 msgr2=0x7f3628150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:47.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f36277fe700 1 --2- 172.21.15.1:0/1566676293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36280c6650 0x7f3628150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:47.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f36277fe700 1 -- 172.21.15.1:0/1566676293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36281540a0 msgr2=0x7f362814e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:47.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f36277fe700 1 --2- 172.21.15.1:0/1566676293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36281540a0 0x7f362814e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:47.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f36277fe700 1 -- 172.21.15.1:0/1566676293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620009ae0 con 0x7f3628154480 2023-11-15T01:33:47.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f36267fc700 1 --2- 172.21.15.1:0/1566676293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36281540a0 0x7f362814e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:47.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f36277fe700 1 --2- 172.21.15.1:0/1566676293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3628154480 0x7f36280a95a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f361800d640 tx=0x7f3618008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:47.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f361effd700 1 -- 172.21.15.1:0/1566676293 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618011590 con 0x7f3628154480 2023-11-15T01:33:47.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f361effd700 1 -- 172.21.15.1:0/1566676293 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36180116f0 con 0x7f3628154480 2023-11-15T01:33:47.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f362d2a0700 1 -- 172.21.15.1:0/1566676293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3628151450 con 0x7f3628154480 2023-11-15T01:33:47.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f361effd700 1 -- 172.21.15.1:0/1566676293 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618011a70 con 0x7f3628154480 2023-11-15T01:33:47.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.897+0000 7f362d2a0700 1 -- 172.21.15.1:0/1566676293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3628150850 con 0x7f3628154480 2023-11-15T01:33:47.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.898+0000 7f362d2a0700 1 -- 172.21.15.1:0/1566676293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362806c7e0 con 0x7f3628154480 2023-11-15T01:33:47.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.899+0000 7f361effd700 1 -- 172.21.15.1:0/1566676293 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3618012420 con 0x7f3628154480 2023-11-15T01:33:47.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.899+0000 7f361effd700 1 --2- 172.21.15.1:0/1566676293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f360805f270 0x7f3608061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.899+0000 7f361effd700 1 -- 172.21.15.1:0/1566676293 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6095+0+0 (secure 0 0 0) 0x7f3618079db0 con 0x7f3628154480 2023-11-15T01:33:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.899+0000 7f3626ffd700 1 --2- 172.21.15.1:0/1566676293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f360805f270 0x7f3608061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.900+0000 7f3626ffd700 1 --2- 172.21.15.1:0/1566676293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f360805f270 0x7f3608061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f362000b9e0 tx=0x7f3620009840).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:47.903+0000 7f361effd700 1 -- 172.21.15.1:0/1566676293 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f361804aec0 con 0x7f3628154480 2023-11-15T01:33:48.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.082+0000 7f362d2a0700 1 -- 172.21.15.1:0/1566676293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f36280c9ce0 con 0x7f3628154480 2023-11-15T01:33:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.086+0000 7f361effd700 1 -- 172.21.15.1:0/1566676293 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v5) v1 ==== 120+0+0 (secure 0 0 0) 0x7f3618011e60 con 0x7f3628154480 2023-11-15T01:33:48.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.088+0000 7f362d2a0700 1 -- 172.21.15.1:0/1566676293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f360805f270 msgr2=0x7f3608061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:48.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.088+0000 7f362d2a0700 1 --2- 172.21.15.1:0/1566676293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f360805f270 0x7f3608061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f362000b9e0 tx=0x7f3620009840).stop 2023-11-15T01:33:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.088+0000 7f362d2a0700 1 -- 172.21.15.1:0/1566676293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3628154480 msgr2=0x7f36280a95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.088+0000 7f362d2a0700 1 --2- 172.21.15.1:0/1566676293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3628154480 0x7f36280a95a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f361800d640 tx=0x7f3618008040).stop 2023-11-15T01:33:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.088+0000 7f362d2a0700 1 -- 172.21.15.1:0/1566676293 shutdown_connections 2023-11-15T01:33:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.088+0000 7f362d2a0700 1 --2- 172.21.15.1:0/1566676293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f360805f270 0x7f3608061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.088+0000 7f362d2a0700 1 --2- 172.21.15.1:0/1566676293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3628154480 0x7f36280a95a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:48.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.088+0000 7f362d2a0700 1 --2- 172.21.15.1:0/1566676293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36280c6650 0x7f3628150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:48.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.088+0000 7f362d2a0700 1 --2- 172.21.15.1:0/1566676293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36281540a0 0x7f362814e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:48.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.088+0000 7f362d2a0700 1 -- 172.21.15.1:0/1566676293 >> 172.21.15.1:0/1566676293 conn(0x7f3628064a70 msgr2=0x7f36280abcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:48.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.088+0000 7f362d2a0700 1 -- 172.21.15.1:0/1566676293 shutdown_connections 2023-11-15T01:33:48.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.088+0000 7f362d2a0700 1 -- 172.21.15.1:0/1566676293 wait complete. 2023-11-15T01:33:48.102 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-11-15T01:33:48.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.219+0000 7fc81b19a700 1 Processor -- start 2023-11-15T01:33:48.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.219+0000 7fc81b19a700 1 -- start start 2023-11-15T01:33:48.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.220+0000 7fc81b19a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8140ab1a0 0x7fc814154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:48.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.220+0000 7fc81b19a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8140c06f0 con 0x7fc8140aa060 2023-11-15T01:33:48.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.220+0000 7fc81b19a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8140c09d0 con 0x7fc814154150 2023-11-15T01:33:48.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.220+0000 7fc81b19a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc814158820 con 0x7fc8140ab1a0 2023-11-15T01:33:48.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.220+0000 7fc819737700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc8140aa060 0x7fc8140c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38230/0 (socket says 172.21.15.1:38230) 2023-11-15T01:33:48.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.220+0000 7fc819737700 1 -- 172.21.15.1:0/3383042473 learned_addr learned my addr 172.21.15.1:0/3383042473 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:48.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.220+0000 7fc813fff700 1 --2- 172.21.15.1:0/3383042473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8140ab1a0 0x7fc814154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:48.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.220+0000 7fc8137fe700 1 -- 172.21.15.1:0/3383042473 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314886519 0 0) 0x7fc8140c06f0 con 0x7fc8140aa060 2023-11-15T01:33:48.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.220+0000 7fc8137fe700 1 -- 172.21.15.1:0/3383042473 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8000033f0 con 0x7fc8140aa060 2023-11-15T01:33:48.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.220+0000 7fc8137fe700 1 -- 172.21.15.1:0/3383042473 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 827478249 0 0) 0x7fc8000033f0 con 0x7fc8140aa060 2023-11-15T01:33:48.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.220+0000 7fc8137fe700 1 -- 172.21.15.1:0/3383042473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8140ab1a0 msgr2=0x7fc814154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:48.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.220+0000 7fc8137fe700 1 --2- 172.21.15.1:0/3383042473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8140ab1a0 0x7fc814154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:48.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.220+0000 7fc8137fe700 1 -- 172.21.15.1:0/3383042473 >> v1:172.21.15.141:6789/0 conn(0x7fc814154150 legacy=0x7fc814158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:48.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc8137fe700 1 -- 172.21.15.1:0/3383042473 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc814158b00 con 0x7fc8140aa060 2023-11-15T01:33:48.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc8137fe700 1 -- 172.21.15.1:0/3383042473 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fc80c001470 con 0x7fc8140aa060 2023-11-15T01:33:48.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc8137fe700 1 -- 172.21.15.1:0/3383042473 >> v1:172.21.15.1:6789/0 conn(0x7fc8140aa060 legacy=0x7fc8140c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:48.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc8137fe700 1 --2- 172.21.15.1:0/3383042473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8140ab1a0 0x7fc800003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:48.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc8137fe700 1 --2- 172.21.15.1:0/3383042473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc800003e40 0x7fc800004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:48.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc8137fe700 1 --2- 172.21.15.1:0/3383042473 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc800004b80 0x7fc800005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:48.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc8137fe700 1 -- 172.21.15.1:0/3383042473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc814158820 con 0x7fc800003e40 2023-11-15T01:33:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc8137fe700 1 -- 172.21.15.1:0/3383042473 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80000ba10 con 0x7fc800004b80 2023-11-15T01:33:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc8137fe700 1 -- 172.21.15.1:0/3383042473 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80000bbd0 con 0x7fc8140ab1a0 2023-11-15T01:33:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc813fff700 1 --2- 172.21.15.1:0/3383042473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc800003e40 0x7fc800004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc818f36700 1 --2- 172.21.15.1:0/3383042473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8140ab1a0 0x7fc800003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc819737700 1 --2- 172.21.15.1:0/3383042473 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc800004b80 0x7fc800005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc813fff700 1 -- 172.21.15.1:0/3383042473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8140ab1a0 msgr2=0x7fc800003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc813fff700 1 --2- 172.21.15.1:0/3383042473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8140ab1a0 0x7fc800003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc813fff700 1 -- 172.21.15.1:0/3383042473 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc800004b80 msgr2=0x7fc800005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc813fff700 1 --2- 172.21.15.1:0/3383042473 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc800004b80 0x7fc800005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc813fff700 1 -- 172.21.15.1:0/3383042473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8000033f0 con 0x7fc800003e40 2023-11-15T01:33:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc813fff700 1 --2- 172.21.15.1:0/3383042473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc800003e40 0x7fc800004690 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fc80400e210 tx=0x7fc80400b040).ready entity=mon.0 client_cookie=38a0bfe9a0acf507 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc8137fe700 1 -- 172.21.15.1:0/3383042473 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804009ac0 con 0x7fc800003e40 2023-11-15T01:33:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc8137fe700 1 -- 172.21.15.1:0/3383042473 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80400f040 con 0x7fc800003e40 2023-11-15T01:33:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.221+0000 7fc8137fe700 1 -- 172.21.15.1:0/3383042473 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80400ecd0 con 0x7fc800003e40 2023-11-15T01:33:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.222+0000 7fc81b19a700 1 -- 172.21.15.1:0/3383042473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc800003e40 msgr2=0x7fc800004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.222+0000 7fc81b19a700 1 --2- 172.21.15.1:0/3383042473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc800003e40 0x7fc800004690 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fc80400e210 tx=0x7fc80400b040).stop 2023-11-15T01:33:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.222+0000 7fc819737700 1 -- 172.21.15.1:0/3383042473 reap_dead start 2023-11-15T01:33:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.222+0000 7fc81b19a700 1 -- 172.21.15.1:0/3383042473 shutdown_connections 2023-11-15T01:33:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.222+0000 7fc81b19a700 1 -- 172.21.15.1:0/3383042473 >> 172.21.15.1:0/3383042473 conn(0x7fc814064aa0 msgr2=0x7fc814064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.222+0000 7fc81b19a700 1 -- 172.21.15.1:0/3383042473 shutdown_connections 2023-11-15T01:33:48.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.222+0000 7fc81b19a700 1 -- 172.21.15.1:0/3383042473 wait complete. 2023-11-15T01:33:48.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.223+0000 7fc81b19a700 1 Processor -- start 2023-11-15T01:33:48.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.223+0000 7fc81b19a700 1 -- start start 2023-11-15T01:33:48.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc81b19a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc800003e40 0x7fc8140ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:48.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc81b19a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8141509c0 0x7fc814152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:48.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc81b19a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8141646c0 0x7fc814164b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:48.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc81b19a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc814152c70 con 0x7fc8141509c0 2023-11-15T01:33:48.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc81b19a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc814152f50 con 0x7fc8141646c0 2023-11-15T01:33:48.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc81b19a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc814153230 con 0x7fc800003e40 2023-11-15T01:33:48.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc813fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8141509c0 0x7fc814152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:48.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc813fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8141509c0 0x7fc814152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48640/0 (socket says 172.21.15.1:48640) 2023-11-15T01:33:48.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc813fff700 1 -- 172.21.15.1:0/3170903854 learned_addr learned my addr 172.21.15.1:0/3170903854 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:48.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc819737700 1 --2- 172.21.15.1:0/3170903854 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8141646c0 0x7fc814164b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:48.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc818f36700 1 --2- 172.21.15.1:0/3170903854 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc800003e40 0x7fc8140ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:48.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc813fff700 1 -- 172.21.15.1:0/3170903854 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc800003e40 msgr2=0x7fc8140ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:48.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc813fff700 1 --2- 172.21.15.1:0/3170903854 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc800003e40 0x7fc8140ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:48.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc813fff700 1 -- 172.21.15.1:0/3170903854 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8141646c0 msgr2=0x7fc814164b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:48.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc813fff700 1 --2- 172.21.15.1:0/3170903854 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8141646c0 0x7fc814164b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:48.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc813fff700 1 -- 172.21.15.1:0/3170903854 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc814153510 con 0x7fc8141509c0 2023-11-15T01:33:48.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.224+0000 7fc813fff700 1 --2- 172.21.15.1:0/3170903854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8141509c0 0x7fc814152360 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fc80000b9e0 tx=0x7fc80401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:48.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.225+0000 7fc810ff9700 1 -- 172.21.15.1:0/3170903854 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804013c10 con 0x7fc8141509c0 2023-11-15T01:33:48.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.225+0000 7fc810ff9700 1 -- 172.21.15.1:0/3170903854 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc804013d70 con 0x7fc8141509c0 2023-11-15T01:33:48.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.225+0000 7fc81b19a700 1 -- 172.21.15.1:0/3170903854 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc814165030 con 0x7fc8141509c0 2023-11-15T01:33:48.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.225+0000 7fc810ff9700 1 -- 172.21.15.1:0/3170903854 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804027420 con 0x7fc8141509c0 2023-11-15T01:33:48.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.225+0000 7fc81b19a700 1 -- 172.21.15.1:0/3170903854 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc814152850 con 0x7fc8141509c0 2023-11-15T01:33:48.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.226+0000 7fc81b19a700 1 -- 172.21.15.1:0/3170903854 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81406c7e0 con 0x7fc8141509c0 2023-11-15T01:33:48.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.226+0000 7fc810ff9700 1 -- 172.21.15.1:0/3170903854 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc804024020 con 0x7fc8141509c0 2023-11-15T01:33:48.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.226+0000 7fc810ff9700 1 --2- 172.21.15.1:0/3170903854 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc7f405f270 0x7fc7f4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:48.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.226+0000 7fc810ff9700 1 -- 172.21.15.1:0/3170903854 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6095+0+0 (secure 0 0 0) 0x7fc80407c1e0 con 0x7fc8141509c0 2023-11-15T01:33:48.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.226+0000 7fc818f36700 1 --2- 172.21.15.1:0/3170903854 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc7f405f270 0x7fc7f4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:48.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.227+0000 7fc818f36700 1 --2- 172.21.15.1:0/3170903854 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc7f405f270 0x7fc7f4061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc7fc000c00 tx=0x7fc7fc007bb0).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:48.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.231+0000 7fc810ff9700 1 -- 172.21.15.1:0/3170903854 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc80404d350 con 0x7fc8141509c0 2023-11-15T01:33:48.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:48.473+0000 7fc81b19a700 1 -- 172.21.15.1:0/3170903854 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7fc81405f8b0 con 0x7fc8141509c0 2023-11-15T01:33:49.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.423+0000 7fc810ff9700 1 -- 172.21.15.1:0/3170903854 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v433) v1 ==== 158+0+0 (secure 0 0 0) 0x7fc80402c020 con 0x7fc8141509c0 2023-11-15T01:33:49.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.425+0000 7fc81b19a700 1 -- 172.21.15.1:0/3170903854 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc7f405f270 msgr2=0x7fc7f4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:49.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.425+0000 7fc81b19a700 1 --2- 172.21.15.1:0/3170903854 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc7f405f270 0x7fc7f4061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc7fc000c00 tx=0x7fc7fc007bb0).stop 2023-11-15T01:33:49.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.425+0000 7fc81b19a700 1 -- 172.21.15.1:0/3170903854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8141509c0 msgr2=0x7fc814152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:49.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.425+0000 7fc81b19a700 1 --2- 172.21.15.1:0/3170903854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8141509c0 0x7fc814152360 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fc80000b9e0 tx=0x7fc80401a000).stop 2023-11-15T01:33:49.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.425+0000 7fc81b19a700 1 -- 172.21.15.1:0/3170903854 shutdown_connections 2023-11-15T01:33:49.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.425+0000 7fc81b19a700 1 --2- 172.21.15.1:0/3170903854 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc7f405f270 0x7fc7f4061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:49.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.425+0000 7fc81b19a700 1 --2- 172.21.15.1:0/3170903854 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8141646c0 0x7fc814164b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:49.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.425+0000 7fc81b19a700 1 --2- 172.21.15.1:0/3170903854 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc800003e40 0x7fc8140ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:49.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.425+0000 7fc81b19a700 1 --2- 172.21.15.1:0/3170903854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8141509c0 0x7fc814152360 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:49.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.425+0000 7fc81b19a700 1 -- 172.21.15.1:0/3170903854 >> 172.21.15.1:0/3170903854 conn(0x7fc814064aa0 msgr2=0x7fc8140aba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:49.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.426+0000 7fc81b19a700 1 -- 172.21.15.1:0/3170903854 shutdown_connections 2023-11-15T01:33:49.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.426+0000 7fc81b19a700 1 -- 172.21.15.1:0/3170903854 wait complete. 2023-11-15T01:33:49.442 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-11-15T01:33:49.443 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-11-15T01:33:49.443 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-15T01:33:49.443 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-11-15T01:33:49.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.567+0000 7f76d8418700 1 Processor -- start 2023-11-15T01:33:49.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.567+0000 7f76d8418700 1 -- start start 2023-11-15T01:33:49.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.568+0000 7f76d8418700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f76d0154150 0x7f76d0154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:49.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.568+0000 7f76d8418700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76d00aa060 0x7f76d00c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:49.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.568+0000 7f76d8418700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d00c06f0 con 0x7f76d00ab1a0 2023-11-15T01:33:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.568+0000 7f76d8418700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d00c09d0 con 0x7f76d0154150 2023-11-15T01:33:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.568+0000 7f76d8418700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d0158820 con 0x7f76d00aa060 2023-11-15T01:33:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.568+0000 7f76d59b3700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f76d00ab1a0 0x7f76d0158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38238/0 (socket says 172.21.15.1:38238) 2023-11-15T01:33:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.568+0000 7f76d59b3700 1 -- 172.21.15.1:0/2870591227 learned_addr learned my addr 172.21.15.1:0/2870591227 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:49.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.568+0000 7f76d61b4700 1 --2- 172.21.15.1:0/2870591227 >> v2:172.21.15.141:3300/0 conn(0x7f76d0154150 0x7f76d0154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.568+0000 7f76d69b5700 1 --2- 172.21.15.1:0/2870591227 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76d00aa060 0x7f76d00c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 -- 172.21.15.1:0/2870591227 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937863085 0 0) 0x7f76d00c06f0 con 0x7f76d00ab1a0 2023-11-15T01:33:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 -- 172.21.15.1:0/2870591227 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76b80033f0 con 0x7f76d00ab1a0 2023-11-15T01:33:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 -- 172.21.15.1:0/2870591227 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3324138791 0 0) 0x7f76b80033f0 con 0x7f76d00ab1a0 2023-11-15T01:33:49.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 -- 172.21.15.1:0/2870591227 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76d00aa060 msgr2=0x7f76d00c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 --2- 172.21.15.1:0/2870591227 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76d00aa060 0x7f76d00c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 -- 172.21.15.1:0/2870591227 >> v2:172.21.15.141:3300/0 conn(0x7f76d0154150 msgr2=0x7f76d0154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 --2- 172.21.15.1:0/2870591227 >> v2:172.21.15.141:3300/0 conn(0x7f76d0154150 0x7f76d0154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 -- 172.21.15.1:0/2870591227 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d0158b00 con 0x7f76d00ab1a0 2023-11-15T01:33:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 -- 172.21.15.1:0/2870591227 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f76c4001470 con 0x7f76d00ab1a0 2023-11-15T01:33:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d61b4700 1 --2- 172.21.15.1:0/2870591227 >> v2:172.21.15.141:3300/0 conn(0x7f76d0154150 0x7f76d0154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 -- 172.21.15.1:0/2870591227 >> v1:172.21.15.1:6789/0 conn(0x7f76d00ab1a0 legacy=0x7f76d0158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 --2- 172.21.15.1:0/2870591227 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76b80038e0 0x7f76b8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 --2- 172.21.15.1:0/2870591227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76b8004690 0x7f76b8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 --2- 172.21.15.1:0/2870591227 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76d00aa060 0x7f76b8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 -- 172.21.15.1:0/2870591227 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d00c09d0 con 0x7f76b8004690 2023-11-15T01:33:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 -- 172.21.15.1:0/2870591227 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d0158820 con 0x7f76b80038e0 2023-11-15T01:33:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d51b2700 1 -- 172.21.15.1:0/2870591227 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b800b8e0 con 0x7f76d00aa060 2023-11-15T01:33:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d59b3700 1 --2- 172.21.15.1:0/2870591227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76b8004690 0x7f76b8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d61b4700 1 --2- 172.21.15.1:0/2870591227 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76b80038e0 0x7f76b8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d69b5700 1 --2- 172.21.15.1:0/2870591227 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76d00aa060 0x7f76b8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d59b3700 1 -- 172.21.15.1:0/2870591227 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76d00aa060 msgr2=0x7f76b8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d59b3700 1 --2- 172.21.15.1:0/2870591227 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76d00aa060 0x7f76b8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:49.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d59b3700 1 -- 172.21.15.1:0/2870591227 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76b80038e0 msgr2=0x7f76b8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:49.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d59b3700 1 --2- 172.21.15.1:0/2870591227 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76b80038e0 0x7f76b8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:49.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d59b3700 1 -- 172.21.15.1:0/2870591227 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b80033f0 con 0x7f76b8004690 2023-11-15T01:33:49.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.569+0000 7f76d59b3700 1 --2- 172.21.15.1:0/2870591227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76b8004690 0x7f76b8004b10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f76c400c240 tx=0x7f76c4001e90).ready entity=mon.0 client_cookie=1d6cee3cbf667478 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:49.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.570+0000 7f76d51b2700 1 -- 172.21.15.1:0/2870591227 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4007a60 con 0x7f76b8004690 2023-11-15T01:33:49.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.570+0000 7f76d51b2700 1 -- 172.21.15.1:0/2870591227 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c400cad0 con 0x7f76b8004690 2023-11-15T01:33:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.570+0000 7f76d51b2700 1 -- 172.21.15.1:0/2870591227 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c400ce70 con 0x7f76b8004690 2023-11-15T01:33:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.570+0000 7f76d8418700 1 -- 172.21.15.1:0/2870591227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76b8004690 msgr2=0x7f76b8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.570+0000 7f76d8418700 1 --2- 172.21.15.1:0/2870591227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76b8004690 0x7f76b8004b10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f76c400c240 tx=0x7f76c4001e90).stop 2023-11-15T01:33:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.570+0000 7f76d69b5700 1 -- 172.21.15.1:0/2870591227 reap_dead start 2023-11-15T01:33:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.570+0000 7f76d8418700 1 -- 172.21.15.1:0/2870591227 shutdown_connections 2023-11-15T01:33:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.570+0000 7f76d8418700 1 -- 172.21.15.1:0/2870591227 >> 172.21.15.1:0/2870591227 conn(0x7f76d0064aa0 msgr2=0x7f76d0064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.570+0000 7f76d8418700 1 -- 172.21.15.1:0/2870591227 shutdown_connections 2023-11-15T01:33:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.570+0000 7f76d8418700 1 -- 172.21.15.1:0/2870591227 wait complete. 2023-11-15T01:33:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.571+0000 7f76d8418700 1 Processor -- start 2023-11-15T01:33:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.571+0000 7f76d8418700 1 -- start start 2023-11-15T01:33:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.572+0000 7f76d8418700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76b8004690 0x7f76d0146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.572+0000 7f76d8418700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76d00c8eb0 0x7f76d014bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.572+0000 7f76d59b3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76d00c8eb0 0x7f76d014bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.572+0000 7f76d8418700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76d00c9330 0x7f76d014c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.572+0000 7f76d8418700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d014c670 con 0x7f76d00c8eb0 2023-11-15T01:33:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.572+0000 7f76d8418700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d0147400 con 0x7f76b8004690 2023-11-15T01:33:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.572+0000 7f76d8418700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d00ca4a0 con 0x7f76d00c9330 2023-11-15T01:33:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.572+0000 7f76d59b3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76d00c8eb0 0x7f76d014bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48668/0 (socket says 172.21.15.1:48668) 2023-11-15T01:33:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.572+0000 7f76d59b3700 1 -- 172.21.15.1:0/883727196 learned_addr learned my addr 172.21.15.1:0/883727196 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.573+0000 7f76d61b4700 1 --2- 172.21.15.1:0/883727196 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76b8004690 0x7f76d0146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:49.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.573+0000 7f76d59b3700 1 -- 172.21.15.1:0/883727196 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76d00c9330 msgr2=0x7f76d014c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:49.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.573+0000 7f76d59b3700 1 --2- 172.21.15.1:0/883727196 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76d00c9330 0x7f76d014c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:49.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.573+0000 7f76d59b3700 1 -- 172.21.15.1:0/883727196 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76b8004690 msgr2=0x7f76d0146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:49.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.573+0000 7f76d59b3700 1 --2- 172.21.15.1:0/883727196 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76b8004690 0x7f76d0146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:49.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.573+0000 7f76d59b3700 1 -- 172.21.15.1:0/883727196 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d00c9890 con 0x7f76d00c8eb0 2023-11-15T01:33:49.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.573+0000 7f76d59b3700 1 --2- 172.21.15.1:0/883727196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76d00c8eb0 0x7f76d014bc90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f76c400c830 tx=0x7f76c4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:49.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.573+0000 7f76ce7fc700 1 -- 172.21.15.1:0/883727196 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c40075c0 con 0x7f76d00c8eb0 2023-11-15T01:33:49.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.573+0000 7f76ce7fc700 1 -- 172.21.15.1:0/883727196 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c4007720 con 0x7f76d00c8eb0 2023-11-15T01:33:49.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.573+0000 7f76d8418700 1 -- 172.21.15.1:0/883727196 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d00c9b70 con 0x7f76d00c8eb0 2023-11-15T01:33:49.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.573+0000 7f76ce7fc700 1 -- 172.21.15.1:0/883727196 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4004900 con 0x7f76d00c8eb0 2023-11-15T01:33:49.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.573+0000 7f76d8418700 1 -- 172.21.15.1:0/883727196 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d00ca130 con 0x7f76d00c8eb0 2023-11-15T01:33:49.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.574+0000 7f76d8418700 1 -- 172.21.15.1:0/883727196 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d014c670 con 0x7f76d00c8eb0 2023-11-15T01:33:49.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.574+0000 7f76ce7fc700 1 -- 172.21.15.1:0/883727196 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f76c4004c70 con 0x7f76d00c8eb0 2023-11-15T01:33:49.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.575+0000 7f76ce7fc700 1 --2- 172.21.15.1:0/883727196 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f76bc05f270 0x7f76bc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:49.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.575+0000 7f76ce7fc700 1 -- 172.21.15.1:0/883727196 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6095+0+0 (secure 0 0 0) 0x7f76c4019020 con 0x7f76d00c8eb0 2023-11-15T01:33:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.575+0000 7f76d61b4700 1 --2- 172.21.15.1:0/883727196 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f76bc05f270 0x7f76bc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.575+0000 7f76d61b4700 1 --2- 172.21.15.1:0/883727196 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f76bc05f270 0x7f76bc061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f76c8006d80 tx=0x7f76c8008040).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.579+0000 7f76ce7fc700 1 -- 172.21.15.1:0/883727196 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f76d014c670 con 0x7f76d00c8eb0 2023-11-15T01:33:49.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:49.820+0000 7f76d8418700 1 -- 172.21.15.1:0/883727196 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f76d00ca2f0 con 0x7f76d00c8eb0 2023-11-15T01:33:50.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.424+0000 7f76ce7fc700 1 -- 172.21.15.1:0/883727196 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v434) v1 ==== 157+0+0 (secure 0 0 0) 0x7f76c404c690 con 0x7f76d00c8eb0 2023-11-15T01:33:50.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.426+0000 7f76d8418700 1 -- 172.21.15.1:0/883727196 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f76bc05f270 msgr2=0x7f76bc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:50.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.426+0000 7f76d8418700 1 --2- 172.21.15.1:0/883727196 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f76bc05f270 0x7f76bc061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f76c8006d80 tx=0x7f76c8008040).stop 2023-11-15T01:33:50.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.426+0000 7f76d8418700 1 -- 172.21.15.1:0/883727196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76d00c8eb0 msgr2=0x7f76d014bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:50.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.426+0000 7f76d8418700 1 --2- 172.21.15.1:0/883727196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76d00c8eb0 0x7f76d014bc90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f76c400c830 tx=0x7f76c4015000).stop 2023-11-15T01:33:50.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.426+0000 7f76d8418700 1 -- 172.21.15.1:0/883727196 shutdown_connections 2023-11-15T01:33:50.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.426+0000 7f76d8418700 1 --2- 172.21.15.1:0/883727196 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f76bc05f270 0x7f76bc061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:50.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.426+0000 7f76d8418700 1 --2- 172.21.15.1:0/883727196 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76d00c9330 0x7f76d014c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:50.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.426+0000 7f76d8418700 1 --2- 172.21.15.1:0/883727196 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76b8004690 0x7f76d0146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:50.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.426+0000 7f76d8418700 1 --2- 172.21.15.1:0/883727196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76d00c8eb0 0x7f76d014bc90 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:50.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.426+0000 7f76d8418700 1 -- 172.21.15.1:0/883727196 >> 172.21.15.1:0/883727196 conn(0x7f76d0064aa0 msgr2=0x7f76d014e210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:50.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.426+0000 7f76d8418700 1 -- 172.21.15.1:0/883727196 shutdown_connections 2023-11-15T01:33:50.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.426+0000 7f76d8418700 1 -- 172.21.15.1:0/883727196 wait complete. 2023-11-15T01:33:50.441 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-15T01:33:50.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.567+0000 7fd5c4e33700 1 Processor -- start 2023-11-15T01:33:50.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.567+0000 7fd5c4e33700 1 -- start start 2023-11-15T01:33:50.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.568+0000 7fd5c4e33700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd5c01540a0 0x7fd5c00ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:50.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.568+0000 7fd5c4e33700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c00ca050 con 0x7fd5c00c6650 2023-11-15T01:33:50.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.568+0000 7fd5c4e33700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c00c9440 con 0x7fd5c0154480 2023-11-15T01:33:50.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.568+0000 7fd5c4e33700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c00c9720 con 0x7fd5c01540a0 2023-11-15T01:33:50.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.568+0000 7fd5bed9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd5c00c6650 0x7fd5c00aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38250/0 (socket says 172.21.15.1:38250) 2023-11-15T01:33:50.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.568+0000 7fd5bed9d700 1 -- 172.21.15.1:0/2433204538 learned_addr learned my addr 172.21.15.1:0/2433204538 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:50.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.568+0000 7fd5be59c700 1 --2- 172.21.15.1:0/2433204538 >> v2:172.21.15.141:3300/0 conn(0x7fd5c01540a0 0x7fd5c00ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:50.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.569+0000 7fd5bd59a700 1 -- 172.21.15.1:0/2433204538 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764269554 0 0) 0x7fd5c00ca050 con 0x7fd5c00c6650 2023-11-15T01:33:50.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.569+0000 7fd5bd59a700 1 -- 172.21.15.1:0/2433204538 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5ac0033f0 con 0x7fd5c00c6650 2023-11-15T01:33:50.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.569+0000 7fd5bd59a700 1 -- 172.21.15.1:0/2433204538 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586921866 0 0) 0x7fd5c00c9440 con 0x7fd5c0154480 2023-11-15T01:33:50.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.569+0000 7fd5bd59a700 1 -- 172.21.15.1:0/2433204538 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5c00ca050 con 0x7fd5c0154480 2023-11-15T01:33:50.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.569+0000 7fd5be59c700 1 -- 172.21.15.1:0/2433204538 >> v1:172.21.15.141:6789/0 conn(0x7fd5c0154480 legacy=0x7fd5c00c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:50.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.569+0000 7fd5be59c700 1 -- 172.21.15.1:0/2433204538 >> v1:172.21.15.1:6789/0 conn(0x7fd5c00c6650 legacy=0x7fd5c00aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:50.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.569+0000 7fd5bd59a700 1 -- 172.21.15.1:0/2433204538 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 594778814 0 0) 0x7fd5ac0033f0 con 0x7fd5c00c6650 2023-11-15T01:33:50.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.569+0000 7fd5be59c700 1 -- 172.21.15.1:0/2433204538 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c00c9a00 con 0x7fd5c01540a0 2023-11-15T01:33:50.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.569+0000 7fd5be59c700 1 --2- 172.21.15.1:0/2433204538 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5c01540a0 0x7fd5c00ca4e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fd5b8009760 tx=0x7fd5b8009060).ready entity=mon.1 client_cookie=1964383e1fc09944 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:50.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.569+0000 7fd5bd59a700 1 -- 172.21.15.1:0/2433204538 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00017f0 con 0x7fd5c01540a0 2023-11-15T01:33:50.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.569+0000 7fd5bd59a700 1 -- 172.21.15.1:0/2433204538 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b8011400 con 0x7fd5c01540a0 2023-11-15T01:33:50.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.569+0000 7fd5bd59a700 1 -- 172.21.15.1:0/2433204538 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8011780 con 0x7fd5c01540a0 2023-11-15T01:33:50.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.570+0000 7fd5c4e33700 1 -- 172.21.15.1:0/2433204538 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5c01540a0 msgr2=0x7fd5c00ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:50.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.570+0000 7fd5c4e33700 1 --2- 172.21.15.1:0/2433204538 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5c01540a0 0x7fd5c00ca4e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fd5b8009760 tx=0x7fd5b8009060).stop 2023-11-15T01:33:50.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.570+0000 7fd5c4e33700 1 -- 172.21.15.1:0/2433204538 shutdown_connections 2023-11-15T01:33:50.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.570+0000 7fd5c4e33700 1 --2- 172.21.15.1:0/2433204538 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5c01540a0 0x7fd5c00ca4e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:50.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.570+0000 7fd5c4e33700 1 -- 172.21.15.1:0/2433204538 >> 172.21.15.1:0/2433204538 conn(0x7fd5c0064a70 msgr2=0x7fd5c0064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:50.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.570+0000 7fd5c4e33700 1 -- 172.21.15.1:0/2433204538 shutdown_connections 2023-11-15T01:33:50.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.570+0000 7fd5c4e33700 1 -- 172.21.15.1:0/2433204538 wait complete. 2023-11-15T01:33:50.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.571+0000 7fd5c4e33700 1 Processor -- start 2023-11-15T01:33:50.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.571+0000 7fd5c4e33700 1 -- start start 2023-11-15T01:33:50.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5c4e33700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c00c6650 0x7fd5c00aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:50.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5c4e33700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5c01540a0 0x7fd5c0064e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:50.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5c4e33700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5c0154480 0x7fd5c0065340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:50.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5c4e33700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c0065830 con 0x7fd5c00c6650 2023-11-15T01:33:50.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5c4e33700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c00a2f00 con 0x7fd5c0154480 2023-11-15T01:33:50.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5c4e33700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c00a22f0 con 0x7fd5c01540a0 2023-11-15T01:33:50.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5be59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c00c6650 0x7fd5c00aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:50.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5be59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c00c6650 0x7fd5c00aeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48684/0 (socket says 172.21.15.1:48684) 2023-11-15T01:33:50.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5be59c700 1 -- 172.21.15.1:0/2232616059 learned_addr learned my addr 172.21.15.1:0/2232616059 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:50.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5be59c700 1 -- 172.21.15.1:0/2232616059 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5c01540a0 msgr2=0x7fd5c0064e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:50.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5be59c700 1 --2- 172.21.15.1:0/2232616059 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5c01540a0 0x7fd5c0064e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:50.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5bed9d700 1 --2- 172.21.15.1:0/2232616059 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5c0154480 0x7fd5c0065340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:50.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5be59c700 1 -- 172.21.15.1:0/2232616059 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5c0154480 msgr2=0x7fd5c0065340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:50.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5be59c700 1 --2- 172.21.15.1:0/2232616059 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5c0154480 0x7fd5c0065340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:50.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5be59c700 1 -- 172.21.15.1:0/2232616059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b80092a0 con 0x7fd5c00c6650 2023-11-15T01:33:50.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5bed9d700 1 --2- 172.21.15.1:0/2232616059 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5c0154480 0x7fd5c0065340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:50.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5be59c700 1 --2- 172.21.15.1:0/2232616059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c00c6650 0x7fd5c00aeb00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fd5b8011880 tx=0x7fd5b8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:50.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.572+0000 7fd5b67fc700 1 -- 172.21.15.1:0/2232616059 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8010920 con 0x7fd5c00c6650 2023-11-15T01:33:50.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.573+0000 7fd5b67fc700 1 -- 172.21.15.1:0/2232616059 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b8010a80 con 0x7fd5c00c6650 2023-11-15T01:33:50.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.573+0000 7fd5c4e33700 1 -- 172.21.15.1:0/2232616059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c00a25d0 con 0x7fd5c00c6650 2023-11-15T01:33:50.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.573+0000 7fd5b67fc700 1 -- 172.21.15.1:0/2232616059 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8010e00 con 0x7fd5c00c6650 2023-11-15T01:33:50.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.573+0000 7fd5c4e33700 1 -- 172.21.15.1:0/2232616059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c00a2b90 con 0x7fd5c00c6650 2023-11-15T01:33:50.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.574+0000 7fd5c4e33700 1 -- 172.21.15.1:0/2232616059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c006c7e0 con 0x7fd5c00c6650 2023-11-15T01:33:50.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.574+0000 7fd5b67fc700 1 -- 172.21.15.1:0/2232616059 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd5b8018070 con 0x7fd5c00c6650 2023-11-15T01:33:50.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.574+0000 7fd5b67fc700 1 --2- 172.21.15.1:0/2232616059 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd5a005f240 0x7fd5a0061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:50.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.574+0000 7fd5b67fc700 1 -- 172.21.15.1:0/2232616059 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6095+0+0 (secure 0 0 0) 0x7fd5b807bc80 con 0x7fd5c00c6650 2023-11-15T01:33:50.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.574+0000 7fd5bdd9b700 1 --2- 172.21.15.1:0/2232616059 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd5a005f240 0x7fd5a0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:50.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.575+0000 7fd5bdd9b700 1 --2- 172.21.15.1:0/2232616059 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd5a005f240 0x7fd5a0061700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fd5a8000c00 tx=0x7fd5a8007830).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:50.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.578+0000 7fd5b67fc700 1 -- 172.21.15.1:0/2232616059 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd5b804cdf0 con 0x7fd5c00c6650 2023-11-15T01:33:50.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.753+0000 7fd5c4e33700 1 -- 172.21.15.1:0/2232616059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd5c00c9ce0 con 0x7fd5c00c6650 2023-11-15T01:33:50.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.757+0000 7fd5b67fc700 1 -- 172.21.15.1:0/2232616059 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd5b8006c50 con 0x7fd5c00c6650 2023-11-15T01:33:50.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.759+0000 7fd5c4e33700 1 -- 172.21.15.1:0/2232616059 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd5a005f240 msgr2=0x7fd5a0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:50.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.759+0000 7fd5c4e33700 1 --2- 172.21.15.1:0/2232616059 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd5a005f240 0x7fd5a0061700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fd5a8000c00 tx=0x7fd5a8007830).stop 2023-11-15T01:33:50.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.759+0000 7fd5c4e33700 1 -- 172.21.15.1:0/2232616059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c00c6650 msgr2=0x7fd5c00aeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:50.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.759+0000 7fd5c4e33700 1 --2- 172.21.15.1:0/2232616059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c00c6650 0x7fd5c00aeb00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fd5b8011880 tx=0x7fd5b8016000).stop 2023-11-15T01:33:50.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.759+0000 7fd5c4e33700 1 -- 172.21.15.1:0/2232616059 shutdown_connections 2023-11-15T01:33:50.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.759+0000 7fd5c4e33700 1 --2- 172.21.15.1:0/2232616059 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd5a005f240 0x7fd5a0061700 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:50.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.759+0000 7fd5c4e33700 1 --2- 172.21.15.1:0/2232616059 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5c0154480 0x7fd5c0065340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:50.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.759+0000 7fd5c4e33700 1 --2- 172.21.15.1:0/2232616059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c00c6650 0x7fd5c00aeb00 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:50.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.759+0000 7fd5c4e33700 1 --2- 172.21.15.1:0/2232616059 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5c01540a0 0x7fd5c0064e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:33:50.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.759+0000 7fd5c4e33700 1 -- 172.21.15.1:0/2232616059 >> 172.21.15.1:0/2232616059 conn(0x7fd5c0064a70 msgr2=0x7fd5c00c1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:50.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.759+0000 7fd5c4e33700 1 -- 172.21.15.1:0/2232616059 shutdown_connections 2023-11-15T01:33:50.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.759+0000 7fd5c4e33700 1 -- 172.21.15.1:0/2232616059 wait complete. 2023-11-15T01:33:50.772 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T01:33:50.773 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:33:50.811 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:33:50.853 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T01:33:50.854 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-15T01:33:50.854 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:33:50.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.971+0000 7f2699f87700 1 Processor -- start 2023-11-15T01:33:50.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.972+0000 7f2699f87700 1 -- start start 2023-11-15T01:33:50.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.972+0000 7f2699f87700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2694155790 0x7f26940a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:50.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.972+0000 7f2699f87700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26940a61b0 0x7f26940bee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:50.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.972+0000 7f2699f87700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2694083630 con 0x7f2694155b70 2023-11-15T01:33:50.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.972+0000 7f2699f87700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26940c5420 con 0x7f2694155790 2023-11-15T01:33:50.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.972+0000 7f2699f87700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26940c7c90 con 0x7f26940a61b0 2023-11-15T01:33:50.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f2692ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2694155b70 0x7f26940c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38252/0 (socket says 172.21.15.1:38252) 2023-11-15T01:33:50.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f2692ffd700 1 -- 172.21.15.1:0/2785804185 learned_addr learned my addr 172.21.15.1:0/2785804185 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:50.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26937fe700 1 --2- 172.21.15.1:0/2785804185 >> v2:172.21.15.141:3300/0 conn(0x7f2694155790 0x7f26940a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:50.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f2693fff700 1 --2- 172.21.15.1:0/2785804185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26940a61b0 0x7f26940bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:50.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 -- 172.21.15.1:0/2785804185 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842277881 0 0) 0x7f2694083630 con 0x7f2694155b70 2023-11-15T01:33:50.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 -- 172.21.15.1:0/2785804185 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f267c0033f0 con 0x7f2694155b70 2023-11-15T01:33:50.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 -- 172.21.15.1:0/2785804185 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4266258616 0 0) 0x7f267c0033f0 con 0x7f2694155b70 2023-11-15T01:33:50.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 -- 172.21.15.1:0/2785804185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26940a61b0 msgr2=0x7f26940bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:50.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 --2- 172.21.15.1:0/2785804185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26940a61b0 0x7f26940bee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:50.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 -- 172.21.15.1:0/2785804185 >> v2:172.21.15.141:3300/0 conn(0x7f2694155790 msgr2=0x7f26940a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:50.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 --2- 172.21.15.1:0/2785804185 >> v2:172.21.15.141:3300/0 conn(0x7f2694155790 0x7f26940a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:50.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 -- 172.21.15.1:0/2785804185 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26940c7960 con 0x7f2694155b70 2023-11-15T01:33:50.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 -- 172.21.15.1:0/2785804185 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f2688001470 con 0x7f2694155b70 2023-11-15T01:33:50.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 -- 172.21.15.1:0/2785804185 >> v1:172.21.15.1:6789/0 conn(0x7f2694155b70 legacy=0x7f26940c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:50.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 --2- 172.21.15.1:0/2785804185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f267c0038e0 0x7f267c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:50.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 --2- 172.21.15.1:0/2785804185 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f267c004690 0x7f267c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:50.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 --2- 172.21.15.1:0/2785804185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f267c005000 0x7f267c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:50.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 -- 172.21.15.1:0/2785804185 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26940c5420 con 0x7f267c005000 2023-11-15T01:33:50.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 -- 172.21.15.1:0/2785804185 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26940c7c90 con 0x7f267c004690 2023-11-15T01:33:50.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26927fc700 1 -- 172.21.15.1:0/2785804185 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c00bdd0 con 0x7f267c0038e0 2023-11-15T01:33:50.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f26937fe700 1 --2- 172.21.15.1:0/2785804185 >> v2:172.21.15.141:3300/0 conn(0x7f2694155790 0x7f26940a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:50.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f2693fff700 1 --2- 172.21.15.1:0/2785804185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26940a61b0 0x7f26940bee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:50.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.973+0000 7f2693fff700 1 --2- 172.21.15.1:0/2785804185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f267c005000 0x7f267c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:50.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.974+0000 7f2692ffd700 1 --2- 172.21.15.1:0/2785804185 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f267c004690 0x7f267c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:50.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.974+0000 7f26937fe700 1 --2- 172.21.15.1:0/2785804185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f267c0038e0 0x7f267c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:50.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.974+0000 7f2693fff700 1 -- 172.21.15.1:0/2785804185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f267c0038e0 msgr2=0x7f267c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:50.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.974+0000 7f2693fff700 1 --2- 172.21.15.1:0/2785804185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f267c0038e0 0x7f267c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:50.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.974+0000 7f2693fff700 1 -- 172.21.15.1:0/2785804185 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f267c004690 msgr2=0x7f267c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:50.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.974+0000 7f2693fff700 1 --2- 172.21.15.1:0/2785804185 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f267c004690 0x7f267c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:50.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.974+0000 7f2693fff700 1 -- 172.21.15.1:0/2785804185 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c0033f0 con 0x7f267c005000 2023-11-15T01:33:50.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.974+0000 7f2693fff700 1 --2- 172.21.15.1:0/2785804185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f267c005000 0x7f267c00b8e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f26940a6600 tx=0x7f268c00b040).ready entity=mon.0 client_cookie=9baedc577b51739 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:50.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.974+0000 7f26927fc700 1 -- 172.21.15.1:0/2785804185 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c00eaa0 con 0x7f267c005000 2023-11-15T01:33:50.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.974+0000 7f26927fc700 1 -- 172.21.15.1:0/2785804185 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268c00f040 con 0x7f267c005000 2023-11-15T01:33:50.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.974+0000 7f26927fc700 1 -- 172.21.15.1:0/2785804185 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c00ee30 con 0x7f267c005000 2023-11-15T01:33:50.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.974+0000 7f2699f87700 1 -- 172.21.15.1:0/2785804185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f267c005000 msgr2=0x7f267c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:50.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.974+0000 7f2699f87700 1 --2- 172.21.15.1:0/2785804185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f267c005000 0x7f267c00b8e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f26940a6600 tx=0x7f268c00b040).stop 2023-11-15T01:33:50.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.974+0000 7f2693fff700 1 -- 172.21.15.1:0/2785804185 reap_dead start 2023-11-15T01:33:50.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.975+0000 7f2699f87700 1 -- 172.21.15.1:0/2785804185 shutdown_connections 2023-11-15T01:33:50.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.975+0000 7f2699f87700 1 -- 172.21.15.1:0/2785804185 >> 172.21.15.1:0/2785804185 conn(0x7f2694082f90 msgr2=0x7f26940c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:50.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.975+0000 7f2699f87700 1 -- 172.21.15.1:0/2785804185 shutdown_connections 2023-11-15T01:33:50.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.975+0000 7f2699f87700 1 -- 172.21.15.1:0/2785804185 wait complete. 2023-11-15T01:33:50.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.976+0000 7f2699f87700 1 Processor -- start 2023-11-15T01:33:50.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.976+0000 7f2699f87700 1 -- start start 2023-11-15T01:33:50.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f2699f87700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2694165b60 0x7f2694165f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:50.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f2699f87700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26940acff0 0x7f26940a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:50.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f2699f87700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26940ad470 0x7f26940a9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:50.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f2699f87700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26940aa0a0 con 0x7f2694165b60 2023-11-15T01:33:50.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f2699f87700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2694166830 con 0x7f26940acff0 2023-11-15T01:33:50.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f2699f87700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26940acb60 con 0x7f26940ad470 2023-11-15T01:33:50.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f26937fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2694165b60 0x7f2694165f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:50.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f26937fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2694165b60 0x7f2694165f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48716/0 (socket says 172.21.15.1:48716) 2023-11-15T01:33:50.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f26937fe700 1 -- 172.21.15.1:0/965866442 learned_addr learned my addr 172.21.15.1:0/965866442 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:50.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f2692ffd700 1 --2- 172.21.15.1:0/965866442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26940acff0 0x7f26940a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:50.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f2693fff700 1 --2- 172.21.15.1:0/965866442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26940ad470 0x7f26940a9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:50.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f26937fe700 1 -- 172.21.15.1:0/965866442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26940ad470 msgr2=0x7f26940a9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:50.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f26937fe700 1 --2- 172.21.15.1:0/965866442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26940ad470 0x7f26940a9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:50.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f26937fe700 1 -- 172.21.15.1:0/965866442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26940acff0 msgr2=0x7f26940a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:50.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f26937fe700 1 --2- 172.21.15.1:0/965866442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26940acff0 0x7f26940a96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:50.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f26937fe700 1 -- 172.21.15.1:0/965866442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26940abf90 con 0x7f2694165b60 2023-11-15T01:33:50.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f26937fe700 1 --2- 172.21.15.1:0/965866442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2694165b60 0x7f2694165f40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f2684011b20 tx=0x7f2684006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:50.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f267b7fe700 1 -- 172.21.15.1:0/965866442 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26840096f0 con 0x7f2694165b60 2023-11-15T01:33:50.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f267b7fe700 1 -- 172.21.15.1:0/965866442 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268400fa10 con 0x7f2694165b60 2023-11-15T01:33:50.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f2699f87700 1 -- 172.21.15.1:0/965866442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26940ac230 con 0x7f2694165b60 2023-11-15T01:33:50.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f267b7fe700 1 -- 172.21.15.1:0/965866442 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268400fd90 con 0x7f2694165b60 2023-11-15T01:33:50.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.977+0000 7f2699f87700 1 -- 172.21.15.1:0/965866442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26940ac7f0 con 0x7f2694165b60 2023-11-15T01:33:50.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.978+0000 7f2699f87700 1 -- 172.21.15.1:0/965866442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26940c3550 con 0x7f2694165b60 2023-11-15T01:33:50.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.979+0000 7f267b7fe700 1 -- 172.21.15.1:0/965866442 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2684014650 con 0x7f2694165b60 2023-11-15T01:33:50.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.979+0000 7f267b7fe700 1 --2- 172.21.15.1:0/965866442 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f268005f270 0x7f2680061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:50.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.979+0000 7f267b7fe700 1 -- 172.21.15.1:0/965866442 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6095+0+0 (secure 0 0 0) 0x7f268407b120 con 0x7f2694165b60 2023-11-15T01:33:50.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.979+0000 7f2692ffd700 1 --2- 172.21.15.1:0/965866442 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f268005f270 0x7f2680061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:50.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.980+0000 7f2692ffd700 1 --2- 172.21.15.1:0/965866442 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f268005f270 0x7f2680061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f26940ae8c0 tx=0x7f2688001e90).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:50.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:50.983+0000 7f267b7fe700 1 -- 172.21.15.1:0/965866442 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f268404c290 con 0x7f2694165b60 2023-11-15T01:33:51.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.197+0000 7f2699f87700 1 -- 172.21.15.1:0/965866442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f269406c7e0 con 0x7f2694165b60 2023-11-15T01:33:51.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.197+0000 7f267b7fe700 1 -- 172.21.15.1:0/965866442 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f268404f8b0 con 0x7f2694165b60 2023-11-15T01:33:51.200 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:51.200 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1019024578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1019024578},{"type":"v1","addr":"172.21.15.1:6835","nonce":1019024578}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4622,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/571718542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":571718542},{"type":"v1","addr":"172.21.15.141:6837","nonce":571718542}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/4111687819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":4111687819},{"type":"v1","addr":"172.21.15.141:6836","nonce":4111687819}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5724,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2560203259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2560203259},{"type":"v1","addr":"172.21.15.1:6834","nonce":2560203259}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[]} 2023-11-15T01:33:51.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.199+0000 7f2699f87700 1 -- 172.21.15.1:0/965866442 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f268005f270 msgr2=0x7f2680061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:51.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.199+0000 7f2699f87700 1 --2- 172.21.15.1:0/965866442 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f268005f270 0x7f2680061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f26940ae8c0 tx=0x7f2688001e90).stop 2023-11-15T01:33:51.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.199+0000 7f2699f87700 1 -- 172.21.15.1:0/965866442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2694165b60 msgr2=0x7f2694165f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:51.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.199+0000 7f2699f87700 1 --2- 172.21.15.1:0/965866442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2694165b60 0x7f2694165f40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f2684011b20 tx=0x7f2684006f40).stop 2023-11-15T01:33:51.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.199+0000 7f2699f87700 1 -- 172.21.15.1:0/965866442 shutdown_connections 2023-11-15T01:33:51.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.199+0000 7f2699f87700 1 --2- 172.21.15.1:0/965866442 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f268005f270 0x7f2680061730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:51.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.199+0000 7f2699f87700 1 --2- 172.21.15.1:0/965866442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26940ad470 0x7f26940a9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:51.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.199+0000 7f2699f87700 1 --2- 172.21.15.1:0/965866442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2694165b60 0x7f2694165f40 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:51.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.199+0000 7f2699f87700 1 --2- 172.21.15.1:0/965866442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26940acff0 0x7f26940a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:51.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.199+0000 7f2699f87700 1 -- 172.21.15.1:0/965866442 >> 172.21.15.1:0/965866442 conn(0x7f2694082f90 msgr2=0x7f2694067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:51.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.199+0000 7f2699f87700 1 -- 172.21.15.1:0/965866442 shutdown_connections 2023-11-15T01:33:51.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.199+0000 7f2699f87700 1 -- 172.21.15.1:0/965866442 wait complete. 2023-11-15T01:33:51.204 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 17 2023-11-15T01:33:51.213 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-15T01:33:51.214 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-15T01:33:51.214 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-15T01:33:51.215 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:33:51.215 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-15T01:33:51.216 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-15T01:33:51.216 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-15T01:33:51.217 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:33:51.217 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-15T01:33:51.217 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-15T01:33:51.218 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-15T01:33:51.218 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:33:51.218 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-15T01:33:51.219 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-15T01:33:51.219 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-15T01:33:51.219 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:33:51.223 INFO:tasks.ceph.mds.a:Stopped 2023-11-15T01:33:51.223 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-15T01:33:51.226 INFO:tasks.ceph.mds.c:Stopped 2023-11-15T01:33:51.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-15T01:33:51.229 INFO:tasks.ceph.mds.b:Stopped 2023-11-15T01:33:51.229 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-15T01:33:51.230 INFO:tasks.ceph.mds.d:Stopped 2023-11-15T01:33:51.231 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-15T01:33:51.268 INFO:tasks.ceph.mds.a:Started 2023-11-15T01:33:51.269 DEBUG:teuthology.parallel:result is None 2023-11-15T01:33:51.271 INFO:tasks.ceph.mds.c:Started 2023-11-15T01:33:51.272 DEBUG:teuthology.parallel:result is None 2023-11-15T01:33:51.273 INFO:tasks.ceph.mds.b:Started 2023-11-15T01:33:51.274 INFO:tasks.ceph.mds.d:Started 2023-11-15T01:33:51.274 DEBUG:teuthology.parallel:result is None 2023-11-15T01:33:51.275 DEBUG:teuthology.parallel:result is None 2023-11-15T01:33:51.276 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-15T01:33:51.342 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T01:33:51.343 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-11-15T01:33:51.352 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-15T01:33:51.353 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T01:33:51.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.407+0000 7fb5c1a86700 1 Processor -- start 2023-11-15T01:33:51.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.407+0000 7fb5c1a86700 1 -- start start 2023-11-15T01:33:51.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.408+0000 7fb5c1a86700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc155530 0x7fb5bc0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:51.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.408+0000 7fb5c1a86700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb5bc0c98b0 0x7fb5bc0c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:51.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.408+0000 7fb5c1a86700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5bc0c7980 con 0x7fb5bc151e10 2023-11-15T01:33:51.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.408+0000 7fb5c1a86700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5bc0ca210 con 0x7fb5bc0c98b0 2023-11-15T01:33:51.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.408+0000 7fb5c1a86700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc0aa890 con 0x7fb5bc155530 2023-11-15T01:33:51.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.408+0000 7fb5c0a84700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb5bc151e10 0x7fb5bc0aa0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38272/0 (socket says 172.21.15.1:38272) 2023-11-15T01:33:51.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.408+0000 7fb5c0a84700 1 -- 172.21.15.1:0/2183185660 learned_addr learned my addr 172.21.15.1:0/2183185660 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:51.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.408+0000 7fb5bbfff700 1 --2- 172.21.15.1:0/2183185660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc155530 0x7fb5bc0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:51.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.408+0000 7fb5c1285700 1 --2- 172.21.15.1:0/2183185660 >> v2:172.21.15.141:3300/0 conn(0x7fb5bc0c98b0 0x7fb5bc0c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:51.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.408+0000 7fb5bb7fe700 1 -- 172.21.15.1:0/2183185660 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429275840 0 0) 0x7fb5bc0c7980 con 0x7fb5bc151e10 2023-11-15T01:33:51.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.408+0000 7fb5bb7fe700 1 -- 172.21.15.1:0/2183185660 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5ac0033f0 con 0x7fb5bc151e10 2023-11-15T01:33:51.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.408+0000 7fb5c1285700 1 -- 172.21.15.1:0/2183185660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc155530 msgr2=0x7fb5bc0c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:51.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.408+0000 7fb5c1285700 1 --2- 172.21.15.1:0/2183185660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc155530 0x7fb5bc0c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:51.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.408+0000 7fb5c1285700 1 -- 172.21.15.1:0/2183185660 >> v1:172.21.15.1:6789/0 conn(0x7fb5bc151e10 legacy=0x7fb5bc0aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:51.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.408+0000 7fb5bb7fe700 1 -- 172.21.15.1:0/2183185660 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3492058934 0 0) 0x7fb5ac0033f0 con 0x7fb5bc151e10 2023-11-15T01:33:51.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.409+0000 7fb5c1285700 1 -- 172.21.15.1:0/2183185660 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc0c7bd0 con 0x7fb5bc0c98b0 2023-11-15T01:33:51.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.409+0000 7fb5c1285700 1 --2- 172.21.15.1:0/2183185660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5bc0c98b0 0x7fb5bc0c9d20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fb5b4009e60 tx=0x7fb5b4009780).ready entity=mon.1 client_cookie=a75e4ecba397a231 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:51.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.409+0000 7fb5bb7fe700 1 -- 172.21.15.1:0/2183185660 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b400e070 con 0x7fb5bc0c98b0 2023-11-15T01:33:51.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.409+0000 7fb5bb7fe700 1 -- 172.21.15.1:0/2183185660 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b400bab0 con 0x7fb5bc0c98b0 2023-11-15T01:33:51.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.409+0000 7fb5bb7fe700 1 -- 172.21.15.1:0/2183185660 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b400be30 con 0x7fb5bc0c98b0 2023-11-15T01:33:51.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.409+0000 7fb5c1a86700 1 -- 172.21.15.1:0/2183185660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5bc0c98b0 msgr2=0x7fb5bc0c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:51.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.409+0000 7fb5c1a86700 1 --2- 172.21.15.1:0/2183185660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5bc0c98b0 0x7fb5bc0c9d20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fb5b4009e60 tx=0x7fb5b4009780).stop 2023-11-15T01:33:51.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.409+0000 7fb5c1a86700 1 -- 172.21.15.1:0/2183185660 shutdown_connections 2023-11-15T01:33:51.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.409+0000 7fb5c1a86700 1 --2- 172.21.15.1:0/2183185660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5bc0c98b0 0x7fb5bc0c9d20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:51.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.409+0000 7fb5c1a86700 1 --2- 172.21.15.1:0/2183185660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc155530 0x7fb5bc0c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:51.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.409+0000 7fb5c1a86700 1 -- 172.21.15.1:0/2183185660 >> 172.21.15.1:0/2183185660 conn(0x7fb5bc0947e0 msgr2=0x7fb5bc06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.409+0000 7fb5c1a86700 1 -- 172.21.15.1:0/2183185660 shutdown_connections 2023-11-15T01:33:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.409+0000 7fb5c1a86700 1 -- 172.21.15.1:0/2183185660 wait complete. 2023-11-15T01:33:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.411+0000 7fb5c1a86700 1 Processor -- start 2023-11-15T01:33:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.411+0000 7fb5c1a86700 1 -- start start 2023-11-15T01:33:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.411+0000 7fb5c1a86700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc0c98b0 0x7fb5bc163640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c1a86700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5bc151e10 0x7fb5bc0c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:51.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c1a86700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc155530 0x7fb5bc0c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:51.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c1a86700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc0c7160 con 0x7fb5bc155530 2023-11-15T01:33:51.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c1a86700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc0a8e70 con 0x7fb5bc151e10 2023-11-15T01:33:51.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c1a86700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc0a99f0 con 0x7fb5bc0c98b0 2023-11-15T01:33:51.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c1285700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc155530 0x7fb5bc0c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c0a84700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc0c98b0 0x7fb5bc163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c0a84700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc0c98b0 0x7fb5bc163640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:53968/0 (socket says 172.21.15.1:53968) 2023-11-15T01:33:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5bbfff700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5bc151e10 0x7fb5bc0c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c0a84700 1 -- 172.21.15.1:0/3654580023 learned_addr learned my addr 172.21.15.1:0/3654580023 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c1285700 1 -- 172.21.15.1:0/3654580023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc0c98b0 msgr2=0x7fb5bc163640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c1285700 1 --2- 172.21.15.1:0/3654580023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc0c98b0 0x7fb5bc163640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c1285700 1 -- 172.21.15.1:0/3654580023 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5bc151e10 msgr2=0x7fb5bc0c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c1285700 1 --2- 172.21.15.1:0/3654580023 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5bc151e10 0x7fb5bc0c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c1285700 1 -- 172.21.15.1:0/3654580023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b4009a20 con 0x7fb5bc155530 2023-11-15T01:33:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c1285700 1 --2- 172.21.15.1:0/3654580023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc155530 0x7fb5bc0c6c70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fb5b4014000 tx=0x7fb5b4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:51.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5b8ff9700 1 -- 172.21.15.1:0/3654580023 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4009440 con 0x7fb5bc155530 2023-11-15T01:33:51.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5b8ff9700 1 -- 172.21.15.1:0/3654580023 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b4012e30 con 0x7fb5bc155530 2023-11-15T01:33:51.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c1a86700 1 -- 172.21.15.1:0/3654580023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5bc0a9e80 con 0x7fb5bc155530 2023-11-15T01:33:51.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5b8ff9700 1 -- 172.21.15.1:0/3654580023 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b401d880 con 0x7fb5bc155530 2023-11-15T01:33:51.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.412+0000 7fb5c1a86700 1 -- 172.21.15.1:0/3654580023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc0a93a0 con 0x7fb5bc155530 2023-11-15T01:33:51.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.413+0000 7fb5c1a86700 1 -- 172.21.15.1:0/3654580023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5bc0a9b60 con 0x7fb5bc155530 2023-11-15T01:33:51.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.414+0000 7fb5b8ff9700 1 -- 172.21.15.1:0/3654580023 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb5b401dc70 con 0x7fb5bc155530 2023-11-15T01:33:51.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.415+0000 7fb5b8ff9700 1 --2- 172.21.15.1:0/3654580023 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb5a005f270 0x7fb5a0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:51.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.415+0000 7fb5b8ff9700 1 -- 172.21.15.1:0/3654580023 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6095+0+0 (secure 0 0 0) 0x7fb5b407c9e0 con 0x7fb5bc155530 2023-11-15T01:33:51.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.415+0000 7fb5c0a84700 1 --2- 172.21.15.1:0/3654580023 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb5a005f270 0x7fb5a0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:51.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.415+0000 7fb5c0a84700 1 --2- 172.21.15.1:0/3654580023 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb5a005f270 0x7fb5a0061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb5b0007810 tx=0x7fb5b0007a30).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:51.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.418+0000 7fb5b8ff9700 1 -- 172.21.15.1:0/3654580023 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb5b404dc10 con 0x7fb5bc155530 2023-11-15T01:33:51.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:51.608+0000 7fb5c1a86700 1 -- 172.21.15.1:0/3654580023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb5bc0475e0 con 0x7fb5bc155530 2023-11-15T01:33:52.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.430+0000 7fb5b8ff9700 1 -- 172.21.15.1:0/3654580023 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v57) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb5b4051230 con 0x7fb5bc155530 2023-11-15T01:33:52.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.432+0000 7fb5c1a86700 1 -- 172.21.15.1:0/3654580023 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb5a005f270 msgr2=0x7fb5a0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:52.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.432+0000 7fb5c1a86700 1 --2- 172.21.15.1:0/3654580023 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb5a005f270 0x7fb5a0061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb5b0007810 tx=0x7fb5b0007a30).stop 2023-11-15T01:33:52.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.432+0000 7fb5c1a86700 1 -- 172.21.15.1:0/3654580023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc155530 msgr2=0x7fb5bc0c6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:52.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.432+0000 7fb5c1a86700 1 --2- 172.21.15.1:0/3654580023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc155530 0x7fb5bc0c6c70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fb5b4014000 tx=0x7fb5b4009780).stop 2023-11-15T01:33:52.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.432+0000 7fb5c1a86700 1 -- 172.21.15.1:0/3654580023 shutdown_connections 2023-11-15T01:33:52.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.432+0000 7fb5c1a86700 1 --2- 172.21.15.1:0/3654580023 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb5a005f270 0x7fb5a0061730 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:52.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.432+0000 7fb5c1a86700 1 --2- 172.21.15.1:0/3654580023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5bc155530 0x7fb5bc0c6c70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:52.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.432+0000 7fb5c1a86700 1 --2- 172.21.15.1:0/3654580023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5bc0c98b0 0x7fb5bc163640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:52.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.432+0000 7fb5c1a86700 1 --2- 172.21.15.1:0/3654580023 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5bc151e10 0x7fb5bc0c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:52.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.432+0000 7fb5c1a86700 1 -- 172.21.15.1:0/3654580023 >> 172.21.15.1:0/3654580023 conn(0x7fb5bc0947e0 msgr2=0x7fb5bc150260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:52.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.432+0000 7fb5c1a86700 1 -- 172.21.15.1:0/3654580023 shutdown_connections 2023-11-15T01:33:52.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.433+0000 7fb5c1a86700 1 -- 172.21.15.1:0/3654580023 wait complete. 2023-11-15T01:33:52.450 INFO:teuthology.orchestra.run.smithi001.stderr: removed all blocklist entries 2023-11-15T01:33:52.451 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-15T01:33:52.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.574+0000 7f896e20c700 1 Processor -- start 2023-11-15T01:33:52.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.574+0000 7f896e20c700 1 -- start start 2023-11-15T01:33:52.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.574+0000 7f896e20c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8968150840 0x7f8968150c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:52.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.574+0000 7f896e20c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f896806a3a0 0x7f89680c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:52.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.574+0000 7f896e20c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89680c28d0 con 0x7f8968069f40 2023-11-15T01:33:52.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.574+0000 7f896e20c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8968069ab0 con 0x7f896806a3a0 2023-11-15T01:33:52.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.574+0000 7f896e20c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8968068ea0 con 0x7f8968150840 2023-11-15T01:33:52.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f8966ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8968069f40 0x7f89680bcd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38274/0 (socket says 172.21.15.1:38274) 2023-11-15T01:33:52.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f8966ffd700 1 -- 172.21.15.1:0/1156907537 learned_addr learned my addr 172.21.15.1:0/1156907537 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:52.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 -- 172.21.15.1:0/1156907537 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673695722 0 0) 0x7f89680c28d0 con 0x7f8968069f40 2023-11-15T01:33:52.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 -- 172.21.15.1:0/1156907537 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89540033f0 con 0x7f8968069f40 2023-11-15T01:33:52.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89677fe700 1 --2- 172.21.15.1:0/1156907537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8968150840 0x7f8968150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:52.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f8967fff700 1 --2- 172.21.15.1:0/1156907537 >> v2:172.21.15.141:3300/0 conn(0x7f896806a3a0 0x7f89680c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:52.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 -- 172.21.15.1:0/1156907537 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 820889478 0 0) 0x7f89540033f0 con 0x7f8968069f40 2023-11-15T01:33:52.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 -- 172.21.15.1:0/1156907537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8968150840 msgr2=0x7f8968150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:52.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 --2- 172.21.15.1:0/1156907537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8968150840 0x7f8968150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:52.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 -- 172.21.15.1:0/1156907537 >> v2:172.21.15.141:3300/0 conn(0x7f896806a3a0 msgr2=0x7f89680c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:52.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 --2- 172.21.15.1:0/1156907537 >> v2:172.21.15.141:3300/0 conn(0x7f896806a3a0 0x7f89680c1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:52.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 -- 172.21.15.1:0/1156907537 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8968069180 con 0x7f8968069f40 2023-11-15T01:33:52.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 -- 172.21.15.1:0/1156907537 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f8950001470 con 0x7f8968069f40 2023-11-15T01:33:52.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 -- 172.21.15.1:0/1156907537 >> v1:172.21.15.1:6789/0 conn(0x7f8968069f40 legacy=0x7f89680bcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 --2- 172.21.15.1:0/1156907537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8968150840 0x7f89540038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 --2- 172.21.15.1:0/1156907537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8954003e10 0x7f8954004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 --2- 172.21.15.1:0/1156907537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8954004b80 0x7f8954005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 -- 172.21.15.1:0/1156907537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8968069ab0 con 0x7f8954003e10 2023-11-15T01:33:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 -- 172.21.15.1:0/1156907537 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8968068ea0 con 0x7f8954004b80 2023-11-15T01:33:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f89667fc700 1 -- 172.21.15.1:0/1156907537 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895400b8e0 con 0x7f8968150840 2023-11-15T01:33:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.575+0000 7f8966ffd700 1 --2- 172.21.15.1:0/1156907537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8954003e10 0x7f8954004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.576+0000 7f89677fe700 1 --2- 172.21.15.1:0/1156907537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8968150840 0x7f89540038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.576+0000 7f8967fff700 1 --2- 172.21.15.1:0/1156907537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8954004b80 0x7f8954005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.576+0000 7f8966ffd700 1 -- 172.21.15.1:0/1156907537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8968150840 msgr2=0x7f89540038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.576+0000 7f8966ffd700 1 --2- 172.21.15.1:0/1156907537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8968150840 0x7f89540038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.576+0000 7f8966ffd700 1 -- 172.21.15.1:0/1156907537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8954004b80 msgr2=0x7f8954005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.576+0000 7f8966ffd700 1 --2- 172.21.15.1:0/1156907537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8954004b80 0x7f8954005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.576+0000 7f8966ffd700 1 -- 172.21.15.1:0/1156907537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89540033f0 con 0x7f8954003e10 2023-11-15T01:33:52.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.576+0000 7f8966ffd700 1 --2- 172.21.15.1:0/1156907537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8954003e10 0x7f8954004690 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f895000c210 tx=0x7f8968069bf0).ready entity=mon.0 client_cookie=f231ee8d8f8527f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:52.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.576+0000 7f89667fc700 1 -- 172.21.15.1:0/1156907537 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950007a60 con 0x7f8954003e10 2023-11-15T01:33:52.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.576+0000 7f89667fc700 1 -- 172.21.15.1:0/1156907537 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895000caa0 con 0x7f8954003e10 2023-11-15T01:33:52.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.576+0000 7f89667fc700 1 -- 172.21.15.1:0/1156907537 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000ce20 con 0x7f8954003e10 2023-11-15T01:33:52.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.576+0000 7f896e20c700 1 -- 172.21.15.1:0/1156907537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8954003e10 msgr2=0x7f8954004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:52.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.576+0000 7f896e20c700 1 --2- 172.21.15.1:0/1156907537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8954003e10 0x7f8954004690 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f895000c210 tx=0x7f8968069bf0).stop 2023-11-15T01:33:52.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.576+0000 7f8967fff700 1 -- 172.21.15.1:0/1156907537 reap_dead start 2023-11-15T01:33:52.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.577+0000 7f896e20c700 1 -- 172.21.15.1:0/1156907537 shutdown_connections 2023-11-15T01:33:52.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.577+0000 7f896e20c700 1 -- 172.21.15.1:0/1156907537 >> 172.21.15.1:0/1156907537 conn(0x7f89680627b0 msgr2=0x7f8968062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:52.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.577+0000 7f896e20c700 1 -- 172.21.15.1:0/1156907537 shutdown_connections 2023-11-15T01:33:52.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.577+0000 7f896e20c700 1 -- 172.21.15.1:0/1156907537 wait complete. 2023-11-15T01:33:52.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.578+0000 7f896e20c700 1 Processor -- start 2023-11-15T01:33:52.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.578+0000 7f896e20c700 1 -- start start 2023-11-15T01:33:52.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f896e20c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8954003e10 0x7f89680a8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:52.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f896e20c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f896813d870 0x7f89680c0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:52.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f896e20c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f89680c0900 0x7f8968148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f896e20c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89680a90d0 con 0x7f8954003e10 2023-11-15T01:33:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f896e20c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89680a8750 con 0x7f896813d870 2023-11-15T01:33:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f896e20c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89680a7b40 con 0x7f89680c0900 2023-11-15T01:33:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f89677fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8954003e10 0x7f89680a8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f89677fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8954003e10 0x7f89680a8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48774/0 (socket says 172.21.15.1:48774) 2023-11-15T01:33:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f89677fe700 1 -- 172.21.15.1:0/3101609399 learned_addr learned my addr 172.21.15.1:0/3101609399 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f8967fff700 1 --2- 172.21.15.1:0/3101609399 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f89680c0900 0x7f8968148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f8966ffd700 1 --2- 172.21.15.1:0/3101609399 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f896813d870 0x7f89680c0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f89677fe700 1 -- 172.21.15.1:0/3101609399 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f89680c0900 msgr2=0x7f8968148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f89677fe700 1 --2- 172.21.15.1:0/3101609399 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f89680c0900 0x7f8968148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:52.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f89677fe700 1 -- 172.21.15.1:0/3101609399 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f896813d870 msgr2=0x7f89680c0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:52.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f89677fe700 1 --2- 172.21.15.1:0/3101609399 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f896813d870 0x7f89680c0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:52.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f89677fe700 1 -- 172.21.15.1:0/3101609399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89680a7e20 con 0x7f8954003e10 2023-11-15T01:33:52.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f8967fff700 1 --2- 172.21.15.1:0/3101609399 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f89680c0900 0x7f8968148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:52.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f89677fe700 1 --2- 172.21.15.1:0/3101609399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8954003e10 0x7f89680a8be0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f89580119f0 tx=0x7f8958006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:52.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f895f7fe700 1 -- 172.21.15.1:0/3101609399 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8958005a90 con 0x7f8954003e10 2023-11-15T01:33:52.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f895f7fe700 1 -- 172.21.15.1:0/3101609399 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8958005bf0 con 0x7f8954003e10 2023-11-15T01:33:52.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f895f7fe700 1 -- 172.21.15.1:0/3101609399 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8958006030 con 0x7f8954003e10 2023-11-15T01:33:52.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.579+0000 7f896e20c700 1 -- 172.21.15.1:0/3101609399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89680a8100 con 0x7f8954003e10 2023-11-15T01:33:52.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.580+0000 7f896e20c700 1 -- 172.21.15.1:0/3101609399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89680a76f0 con 0x7f8954003e10 2023-11-15T01:33:52.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.581+0000 7f896e20c700 1 -- 172.21.15.1:0/3101609399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89680a8a30 con 0x7f8954003e10 2023-11-15T01:33:52.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.581+0000 7f895f7fe700 1 -- 172.21.15.1:0/3101609399 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8958006420 con 0x7f8954003e10 2023-11-15T01:33:52.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.581+0000 7f895f7fe700 1 --2- 172.21.15.1:0/3101609399 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f894805f270 0x7f8948061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:52.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.581+0000 7f895f7fe700 1 -- 172.21.15.1:0/3101609399 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5665+0+0 (secure 0 0 0) 0x7f895807aca0 con 0x7f8954003e10 2023-11-15T01:33:52.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.581+0000 7f8966ffd700 1 --2- 172.21.15.1:0/3101609399 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f894805f270 0x7f8948061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:52.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.582+0000 7f8966ffd700 1 --2- 172.21.15.1:0/3101609399 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f894805f270 0x7f8948061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f89680a9320 tx=0x7f8950015000).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:52.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.585+0000 7f895f7fe700 1 -- 172.21.15.1:0/3101609399 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f895804c060 con 0x7f8954003e10 2023-11-15T01:33:52.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.822+0000 7f896e20c700 1 -- 172.21.15.1:0/3101609399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f896806c7e0 con 0x7f8954003e10 2023-11-15T01:33:52.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.823+0000 7f895f7fe700 1 -- 172.21.15.1:0/3101609399 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f895804f680 con 0x7f8954003e10 2023-11-15T01:33:52.825 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:52.826 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T01:33:52.826 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_dump": [ 2023-11-15T01:33:52.826 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.827 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.a", 2023-11-15T01:33:52.827 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlmtf5GBAA2CojasXoquGQ9L5rKjVwTQ==", 2023-11-15T01:33:52.827 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.827 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:33:52.827 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:33:52.828 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:33:52.828 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:33:52.828 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.828 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.829 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.829 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.b", 2023-11-15T01:33:52.829 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl/Y5mJBAAz7iLl3kBJ8kSsyTetTZByw==", 2023-11-15T01:33:52.829 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.829 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:33:52.829 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:33:52.830 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:33:52.830 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:33:52.830 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.830 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.831 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.831 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.c", 2023-11-15T01:33:52.831 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlWTrwHxAAqLVpwNca0vAXUBFnWUN3pg==", 2023-11-15T01:33:52.831 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.831 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:33:52.832 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:33:52.832 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:33:52.832 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:33:52.832 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.833 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.833 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.834 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.d", 2023-11-15T01:33:52.834 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlVwUnKxAAhx2/mX1ljgQwJLagVpmZIA==", 2023-11-15T01:33:52.834 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.835 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:33:52.835 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:33:52.835 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:33:52.836 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:33:52.836 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.836 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.836 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.837 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.0", 2023-11-15T01:33:52.837 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDxHFRlII6rERAA/kvPPhTPHHy6pu5wSPsR/A==", 2023-11-15T01:33:52.837 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.838 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:33:52.838 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:33:52.838 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:33:52.838 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.839 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.839 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.839 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.1", 2023-11-15T01:33:52.839 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD0HFRlPkstEBAAqx31fnNonRCVh98eY6qbxQ==", 2023-11-15T01:33:52.840 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.840 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:33:52.840 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:33:52.840 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:33:52.840 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.841 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.841 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.841 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.2", 2023-11-15T01:33:52.842 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD3HFRl8e3nDRAAKigcbIo0/BFo0Qi6rV+amQ==", 2023-11-15T01:33:52.842 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.842 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:33:52.842 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:33:52.843 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:33:52.843 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.843 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.844 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.844 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.3", 2023-11-15T01:33:52.845 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD6HFRlbwDTCxAAkWv04RyNqW4p8pOqvYCS3A==", 2023-11-15T01:33:52.845 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.845 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:33:52.846 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:33:52.846 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:33:52.846 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.847 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.847 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.847 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.4", 2023-11-15T01:33:52.847 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAAHVRlTQihDxAA/HcZbSytP9qD5PsTjvJBoA==", 2023-11-15T01:33:52.848 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.848 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:33:52.848 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:33:52.849 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:33:52.849 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.849 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.849 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.849 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.5", 2023-11-15T01:33:52.850 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQADHVRlQ2hjDRAAFiI+hKubCPcZ/1AJVu1fvQ==", 2023-11-15T01:33:52.850 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.850 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:33:52.850 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:33:52.850 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:33:52.851 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.851 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.851 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.851 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.6", 2023-11-15T01:33:52.851 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAGHVRl/KEbCxAAmKTnRU4m4qNzX+SVcFY+Qw==", 2023-11-15T01:33:52.852 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.852 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:33:52.852 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:33:52.852 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:33:52.853 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.853 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.853 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.854 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.7", 2023-11-15T01:33:52.854 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAJHVRl4wOFCBAAAiGT4UPE5vSb2LjqgGgGFw==", 2023-11-15T01:33:52.854 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.855 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:33:52.855 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:33:52.856 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:33:52.856 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.856 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.857 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.857 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.0", 2023-11-15T01:33:52.857 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl2hkHLxAAxQE/Cslig6gmXR/xcVlRuw==", 2023-11-15T01:33:52.858 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.858 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:33:52.858 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow r", 2023-11-15T01:33:52.858 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-15T01:33:52.859 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.859 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.859 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.860 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.1", 2023-11-15T01:33:52.860 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRltolkNxAAXmQ4yXOlavwqKq2jFKwsYQ==", 2023-11-15T01:33:52.860 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.860 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:33:52.860 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:33:52.860 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:33:52.861 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:33:52.861 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.861 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.861 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.861 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.2", 2023-11-15T01:33:52.862 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlFrJvNBAAH97x7ERzuzpWrUALO+HvpA==", 2023-11-15T01:33:52.862 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.862 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:33:52.862 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:33:52.862 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:33:52.863 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:33:52.863 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.863 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.863 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.863 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.3", 2023-11-15T01:33:52.864 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDwHFRlko0ZARAA2RqeRJGwWns00DeWgd/9hA==", 2023-11-15T01:33:52.864 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.864 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:33:52.864 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:33:52.864 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:33:52.864 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:33:52.865 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.865 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.865 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.865 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.admin", 2023-11-15T01:33:52.865 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDuHFRlxIQDORAALrVIyQoaVSADkyv9yzMaZw==", 2023-11-15T01:33:52.866 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.866 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:33:52.866 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:33:52.866 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:33:52.866 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:33:52.867 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.867 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.867 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.867 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.x", 2023-11-15T01:33:52.867 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlnyjlFRAAjJwtxkAvJ0ZGmvOOawQseQ==", 2023-11-15T01:33:52.868 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.868 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:33:52.868 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T01:33:52.868 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:33:52.868 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.869 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:52.869 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:52.869 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.y", 2023-11-15T01:33:52.870 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl8nW3ERAA4CJQt/ZEZCJ9UaRRuEHfzw==", 2023-11-15T01:33:52.870 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:33:52.870 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:33:52.870 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T01:33:52.870 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:33:52.871 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.871 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:52.871 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2023-11-15T01:33:52.871 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T01:33:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.825+0000 7f896e20c700 1 -- 172.21.15.1:0/3101609399 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f894805f270 msgr2=0x7f8948061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.825+0000 7f896e20c700 1 --2- 172.21.15.1:0/3101609399 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f894805f270 0x7f8948061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f89680a9320 tx=0x7f8950015000).stop 2023-11-15T01:33:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.825+0000 7f896e20c700 1 -- 172.21.15.1:0/3101609399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8954003e10 msgr2=0x7f89680a8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.825+0000 7f896e20c700 1 --2- 172.21.15.1:0/3101609399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8954003e10 0x7f89680a8be0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f89580119f0 tx=0x7f8958006f40).stop 2023-11-15T01:33:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.825+0000 7f896e20c700 1 -- 172.21.15.1:0/3101609399 shutdown_connections 2023-11-15T01:33:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.825+0000 7f896e20c700 1 --2- 172.21.15.1:0/3101609399 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f894805f270 0x7f8948061730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.825+0000 7f896e20c700 1 --2- 172.21.15.1:0/3101609399 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f89680c0900 0x7f8968148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.825+0000 7f896e20c700 1 --2- 172.21.15.1:0/3101609399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8954003e10 0x7f89680a8be0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.825+0000 7f896e20c700 1 --2- 172.21.15.1:0/3101609399 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f896813d870 0x7f89680c0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.825+0000 7f896e20c700 1 -- 172.21.15.1:0/3101609399 >> 172.21.15.1:0/3101609399 conn(0x7f89680627b0 msgr2=0x7f89680c5570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.825+0000 7f896e20c700 1 -- 172.21.15.1:0/3101609399 shutdown_connections 2023-11-15T01:33:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.825+0000 7f896e20c700 1 -- 172.21.15.1:0/3101609399 wait complete. 2023-11-15T01:33:52.876 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:33:52.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.993+0000 7f67b2059700 1 Processor -- start 2023-11-15T01:33:52.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.993+0000 7f67b2059700 1 -- start start 2023-11-15T01:33:52.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67b2059700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f67ac0ab1a0 0x7f67ac154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:52.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67b2059700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f67ac0aa060 0x7f67ac0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:52.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67b2059700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67ac0c06f0 con 0x7f67ac154150 2023-11-15T01:33:52.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67b2059700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ac0c09d0 con 0x7f67ac0aa060 2023-11-15T01:33:52.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67b2059700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac158820 con 0x7f67ac0ab1a0 2023-11-15T01:33:52.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67ab7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f67ac154150 0x7f67ac158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38284/0 (socket says 172.21.15.1:38284) 2023-11-15T01:33:52.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67abfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f67ac0aa060 0x7f67ac0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:52.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67ab7fe700 1 -- 172.21.15.1:0/746777377 learned_addr learned my addr 172.21.15.1:0/746777377 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:52.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67aaffd700 1 --2- 172.21.15.1:0/746777377 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f67ac0ab1a0 0x7f67ac154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:52.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67abfff700 1 -- 172.21.15.1:0/746777377 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f67ac0ab1a0 msgr2=0x7f67ac154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:52.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67abfff700 1 --2- 172.21.15.1:0/746777377 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f67ac0ab1a0 0x7f67ac154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67abfff700 1 -- 172.21.15.1:0/746777377 >> v1:172.21.15.1:6789/0 conn(0x7f67ac154150 legacy=0x7f67ac158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67aa7fc700 1 -- 172.21.15.1:0/746777377 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069619496 0 0) 0x7f67ac0c06f0 con 0x7f67ac154150 2023-11-15T01:33:53.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67abfff700 1 -- 172.21.15.1:0/746777377 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac158b00 con 0x7f67ac0aa060 2023-11-15T01:33:53.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67abfff700 1 --2- 172.21.15.1:0/746777377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67ac0aa060 0x7f67ac0c5f10 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f67a4009e60 tx=0x7f67a4009780).ready entity=mon.0 client_cookie=d3f209701ece7444 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:53.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.994+0000 7f67aa7fc700 1 -- 172.21.15.1:0/746777377 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a400e070 con 0x7f67ac0aa060 2023-11-15T01:33:53.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.995+0000 7f67aa7fc700 1 -- 172.21.15.1:0/746777377 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a400bb60 con 0x7f67ac0aa060 2023-11-15T01:33:53.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.995+0000 7f67aa7fc700 1 -- 172.21.15.1:0/746777377 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a4012410 con 0x7f67ac0aa060 2023-11-15T01:33:53.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.995+0000 7f67b2059700 1 -- 172.21.15.1:0/746777377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67ac0aa060 msgr2=0x7f67ac0c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.995+0000 7f67b2059700 1 --2- 172.21.15.1:0/746777377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67ac0aa060 0x7f67ac0c5f10 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f67a4009e60 tx=0x7f67a4009780).stop 2023-11-15T01:33:53.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.995+0000 7f67b2059700 1 -- 172.21.15.1:0/746777377 shutdown_connections 2023-11-15T01:33:53.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.995+0000 7f67b2059700 1 --2- 172.21.15.1:0/746777377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67ac0aa060 0x7f67ac0c5f10 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.995+0000 7f67b2059700 1 --2- 172.21.15.1:0/746777377 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f67ac0ab1a0 0x7f67ac154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.995+0000 7f67b2059700 1 -- 172.21.15.1:0/746777377 >> 172.21.15.1:0/746777377 conn(0x7f67ac064aa0 msgr2=0x7f67ac064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:53.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.995+0000 7f67b2059700 1 -- 172.21.15.1:0/746777377 shutdown_connections 2023-11-15T01:33:53.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.995+0000 7f67b2059700 1 -- 172.21.15.1:0/746777377 wait complete. 2023-11-15T01:33:53.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.996+0000 7f67b2059700 1 Processor -- start 2023-11-15T01:33:53.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.996+0000 7f67b2059700 1 -- start start 2023-11-15T01:33:53.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.997+0000 7f67b2059700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f67ac0aa060 0x7f67ac152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.997+0000 7f67b2059700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67ac0ab1a0 0x7f67ac0cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.997+0000 7f67b2059700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac154150 0x7f67ac1505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.997+0000 7f67b2059700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac1679c0 con 0x7f67ac0ab1a0 2023-11-15T01:33:53.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.997+0000 7f67b2059700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac0af8c0 con 0x7f67ac154150 2023-11-15T01:33:53.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.997+0000 7f67b2059700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac150ab0 con 0x7f67ac0aa060 2023-11-15T01:33:53.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.997+0000 7f67aaffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67ac0ab1a0 0x7f67ac0cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.997+0000 7f67aaffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67ac0ab1a0 0x7f67ac0cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48800/0 (socket says 172.21.15.1:48800) 2023-11-15T01:33:53.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.997+0000 7f67aaffd700 1 -- 172.21.15.1:0/2243768556 learned_addr learned my addr 172.21.15.1:0/2243768556 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:53.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.997+0000 7f67ab7fe700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f67ac0aa060 0x7f67ac152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.997+0000 7f67abfff700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac154150 0x7f67ac1505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.998+0000 7f67aaffd700 1 -- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f67ac0aa060 msgr2=0x7f67ac152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.998+0000 7f67aaffd700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f67ac0aa060 0x7f67ac152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.998+0000 7f67aaffd700 1 -- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac154150 msgr2=0x7f67ac1505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.998+0000 7f67aaffd700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac154150 0x7f67ac1505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.998+0000 7f67aaffd700 1 -- 172.21.15.1:0/2243768556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a4009a20 con 0x7f67ac0ab1a0 2023-11-15T01:33:53.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.998+0000 7f67abfff700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac154150 0x7f67ac1505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:53.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.998+0000 7f67ab7fe700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f67ac0aa060 0x7f67ac152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:53.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.998+0000 7f67aaffd700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67ac0ab1a0 0x7f67ac0cb0e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f67a000e960 tx=0x7f67a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:53.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.998+0000 7f67937fe700 1 -- 172.21.15.1:0/2243768556 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a000c850 con 0x7f67ac0ab1a0 2023-11-15T01:33:53.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.998+0000 7f67937fe700 1 -- 172.21.15.1:0/2243768556 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a000c9b0 con 0x7f67ac0ab1a0 2023-11-15T01:33:53.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.998+0000 7f67b2059700 1 -- 172.21.15.1:0/2243768556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ac0cb790 con 0x7f67ac0ab1a0 2023-11-15T01:33:53.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.998+0000 7f67937fe700 1 -- 172.21.15.1:0/2243768556 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a000cd30 con 0x7f67ac0ab1a0 2023-11-15T01:33:53.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.998+0000 7f67b2059700 1 -- 172.21.15.1:0/2243768556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ac0af550 con 0x7f67ac0ab1a0 2023-11-15T01:33:53.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.999+0000 7f67b2059700 1 -- 172.21.15.1:0/2243768556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ac06c7e0 con 0x7f67ac0ab1a0 2023-11-15T01:33:53.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:52.999+0000 7f67937fe700 1 -- 172.21.15.1:0/2243768556 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f67a0012600 con 0x7f67ac0ab1a0 2023-11-15T01:33:53.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.000+0000 7f67937fe700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f679805f270 0x7f6798061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.000+0000 7f67937fe700 1 -- 172.21.15.1:0/2243768556 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5665+0+0 (secure 0 0 0) 0x7f67a007a7b0 con 0x7f67ac0ab1a0 2023-11-15T01:33:53.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.000+0000 7f67ab7fe700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f679805f270 0x7f6798061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.000+0000 7f67ab7fe700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f679805f270 0x7f6798061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f679c001710 tx=0x7f679c009040).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:53.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.004+0000 7f67937fe700 1 -- 172.21.15.1:0/2243768556 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f67a004bac0 con 0x7f67ac0ab1a0 2023-11-15T01:33:53.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.178+0000 7f67b2059700 1 -- 172.21.15.1:0/2243768556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67ac158de0 con 0x7f67ac0ab1a0 2023-11-15T01:33:53.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.179+0000 7f67937fe700 1 -- 172.21.15.1:0/2243768556 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+14264 (secure 0 0 0) 0x7f67a004f0e0 con 0x7f67ac0ab1a0 2023-11-15T01:33:53.180 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:53.180 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":57,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:33:52.425386+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:33:53.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.181+0000 7f67b2059700 1 -- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f679805f270 msgr2=0x7f6798061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.181+0000 7f67b2059700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f679805f270 0x7f6798061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f679c001710 tx=0x7f679c009040).stop 2023-11-15T01:33:53.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.181+0000 7f67b2059700 1 -- 172.21.15.1:0/2243768556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67ac0ab1a0 msgr2=0x7f67ac0cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.181+0000 7f67b2059700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67ac0ab1a0 0x7f67ac0cb0e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f67a000e960 tx=0x7f67a0009060).stop 2023-11-15T01:33:53.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.181+0000 7f67b2059700 1 -- 172.21.15.1:0/2243768556 shutdown_connections 2023-11-15T01:33:53.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.181+0000 7f67b2059700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f679805f270 0x7f6798061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.181+0000 7f67b2059700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67ac154150 0x7f67ac1505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.181+0000 7f67b2059700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f67ac0aa060 0x7f67ac152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.181+0000 7f67b2059700 1 --2- 172.21.15.1:0/2243768556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67ac0ab1a0 0x7f67ac0cb0e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.181+0000 7f67b2059700 1 -- 172.21.15.1:0/2243768556 >> 172.21.15.1:0/2243768556 conn(0x7f67ac064aa0 msgr2=0x7f67ac0acfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:53.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.181+0000 7f67b2059700 1 -- 172.21.15.1:0/2243768556 shutdown_connections 2023-11-15T01:33:53.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.181+0000 7f67b2059700 1 -- 172.21.15.1:0/2243768556 wait complete. 2023-11-15T01:33:53.194 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-15T01:33:53.195 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:33:53.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.315+0000 7fcf765ad700 1 Processor -- start 2023-11-15T01:33:53.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.315+0000 7fcf765ad700 1 -- start start 2023-11-15T01:33:53.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.315+0000 7fcf765ad700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcf70154480 0x7fcf700c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf765ad700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fcf700c6430 0x7fcf700aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf765ad700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf700ca050 con 0x7fcf701540a0 2023-11-15T01:33:53.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf765ad700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf700c68c0 con 0x7fcf70154480 2023-11-15T01:33:53.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf765ad700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf700c9440 con 0x7fcf700c6430 2023-11-15T01:33:53.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf6f7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcf70154480 0x7fcf700c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf6ffff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fcf701540a0 0x7fcf700ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38294/0 (socket says 172.21.15.1:38294) 2023-11-15T01:33:53.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf6ffff700 1 -- 172.21.15.1:0/1050506620 learned_addr learned my addr 172.21.15.1:0/1050506620 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:53.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf74b4a700 1 --2- 172.21.15.1:0/1050506620 >> v2:172.21.15.141:3300/0 conn(0x7fcf700c6430 0x7fcf700aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf6f7fe700 1 -- 172.21.15.1:0/1050506620 >> v2:172.21.15.141:3300/0 conn(0x7fcf700c6430 msgr2=0x7fcf700aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:53.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf6f7fe700 1 --2- 172.21.15.1:0/1050506620 >> v2:172.21.15.141:3300/0 conn(0x7fcf700c6430 0x7fcf700aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf6f7fe700 1 -- 172.21.15.1:0/1050506620 >> v1:172.21.15.1:6789/0 conn(0x7fcf701540a0 legacy=0x7fcf700ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf6f7fe700 1 -- 172.21.15.1:0/1050506620 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf700c9720 con 0x7fcf70154480 2023-11-15T01:33:53.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf6effd700 1 -- 172.21.15.1:0/1050506620 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753430428 0 0) 0x7fcf700ca050 con 0x7fcf701540a0 2023-11-15T01:33:53.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf74b4a700 1 --2- 172.21.15.1:0/1050506620 >> v2:172.21.15.141:3300/0 conn(0x7fcf700c6430 0x7fcf700aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:53.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf6f7fe700 1 --2- 172.21.15.1:0/1050506620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf70154480 0x7fcf700c5f40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fcf700aab60 tx=0x7fcf64009060).ready entity=mon.0 client_cookie=4af45af935310a75 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf6effd700 1 -- 172.21.15.1:0/1050506620 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6400b580 con 0x7fcf70154480 2023-11-15T01:33:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf6effd700 1 -- 172.21.15.1:0/1050506620 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6400b6e0 con 0x7fcf70154480 2023-11-15T01:33:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.316+0000 7fcf6effd700 1 -- 172.21.15.1:0/1050506620 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6400ba60 con 0x7fcf70154480 2023-11-15T01:33:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.317+0000 7fcf765ad700 1 -- 172.21.15.1:0/1050506620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf70154480 msgr2=0x7fcf700c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.317+0000 7fcf765ad700 1 --2- 172.21.15.1:0/1050506620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf70154480 0x7fcf700c5f40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fcf700aab60 tx=0x7fcf64009060).stop 2023-11-15T01:33:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.317+0000 7fcf765ad700 1 -- 172.21.15.1:0/1050506620 shutdown_connections 2023-11-15T01:33:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.317+0000 7fcf765ad700 1 --2- 172.21.15.1:0/1050506620 >> v2:172.21.15.141:3300/0 conn(0x7fcf700c6430 0x7fcf700aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.317+0000 7fcf765ad700 1 --2- 172.21.15.1:0/1050506620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf70154480 0x7fcf700c5f40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.317+0000 7fcf765ad700 1 -- 172.21.15.1:0/1050506620 >> 172.21.15.1:0/1050506620 conn(0x7fcf70064a70 msgr2=0x7fcf70064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.317+0000 7fcf765ad700 1 -- 172.21.15.1:0/1050506620 shutdown_connections 2023-11-15T01:33:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.317+0000 7fcf765ad700 1 -- 172.21.15.1:0/1050506620 wait complete. 2023-11-15T01:33:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.318+0000 7fcf765ad700 1 Processor -- start 2023-11-15T01:33:53.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.318+0000 7fcf765ad700 1 -- start start 2023-11-15T01:33:53.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf765ad700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf700c6430 0x7fcf70158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf765ad700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf701540a0 0x7fcf70154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf765ad700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf70154480 0x7fcf7014cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf765ad700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf70155d50 con 0x7fcf70154480 2023-11-15T01:33:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf765ad700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf70155a00 con 0x7fcf701540a0 2023-11-15T01:33:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf765ad700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf70154e50 con 0x7fcf700c6430 2023-11-15T01:33:53.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf74b4a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf70154480 0x7fcf7014cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf74b4a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf70154480 0x7fcf7014cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48806/0 (socket says 172.21.15.1:48806) 2023-11-15T01:33:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf74b4a700 1 -- 172.21.15.1:0/1062233094 learned_addr learned my addr 172.21.15.1:0/1062233094 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf6ffff700 1 --2- 172.21.15.1:0/1062233094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf700c6430 0x7fcf70158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf6f7fe700 1 --2- 172.21.15.1:0/1062233094 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf701540a0 0x7fcf70154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf74b4a700 1 -- 172.21.15.1:0/1062233094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf700c6430 msgr2=0x7fcf70158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf74b4a700 1 --2- 172.21.15.1:0/1062233094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf700c6430 0x7fcf70158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf74b4a700 1 -- 172.21.15.1:0/1062233094 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf701540a0 msgr2=0x7fcf70154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf74b4a700 1 --2- 172.21.15.1:0/1062233094 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf701540a0 0x7fcf70154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf74b4a700 1 -- 172.21.15.1:0/1062233094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf640092a0 con 0x7fcf70154480 2023-11-15T01:33:53.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.319+0000 7fcf74b4a700 1 --2- 172.21.15.1:0/1062233094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf70154480 0x7fcf7014cc70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fcf6800a380 tx=0x7fcf68007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:53.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.320+0000 7fcf57fff700 1 -- 172.21.15.1:0/1062233094 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68016470 con 0x7fcf70154480 2023-11-15T01:33:53.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.320+0000 7fcf57fff700 1 -- 172.21.15.1:0/1062233094 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf680165d0 con 0x7fcf70154480 2023-11-15T01:33:53.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.320+0000 7fcf57fff700 1 -- 172.21.15.1:0/1062233094 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68016950 con 0x7fcf70154480 2023-11-15T01:33:53.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.320+0000 7fcf765ad700 1 -- 172.21.15.1:0/1062233094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf70155120 con 0x7fcf70154480 2023-11-15T01:33:53.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.320+0000 7fcf765ad700 1 -- 172.21.15.1:0/1062233094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf701556e0 con 0x7fcf70154480 2023-11-15T01:33:53.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.321+0000 7fcf765ad700 1 -- 172.21.15.1:0/1062233094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf70155f00 con 0x7fcf70154480 2023-11-15T01:33:53.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.321+0000 7fcf57fff700 1 -- 172.21.15.1:0/1062233094 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcf68013070 con 0x7fcf70154480 2023-11-15T01:33:53.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.321+0000 7fcf57fff700 1 --2- 172.21.15.1:0/1062233094 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf5c05f270 0x7fcf5c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.321+0000 7fcf57fff700 1 -- 172.21.15.1:0/1062233094 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5665+0+0 (secure 0 0 0) 0x7fcf6807ae40 con 0x7fcf70154480 2023-11-15T01:33:53.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.322+0000 7fcf6ffff700 1 --2- 172.21.15.1:0/1062233094 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf5c05f270 0x7fcf5c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.322+0000 7fcf6ffff700 1 --2- 172.21.15.1:0/1062233094 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf5c05f270 0x7fcf5c061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fcf600011e0 tx=0x7fcf60007bb0).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:53.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.326+0000 7fcf57fff700 1 -- 172.21.15.1:0/1062233094 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcf6804c150 con 0x7fcf70154480 2023-11-15T01:33:53.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.498+0000 7fcf765ad700 1 -- 172.21.15.1:0/1062233094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcf7006c7e0 con 0x7fcf70154480 2023-11-15T01:33:53.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.498+0000 7fcf57fff700 1 -- 172.21.15.1:0/1062233094 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v57) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcf6804f770 con 0x7fcf70154480 2023-11-15T01:33:53.500 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:33:53.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.500+0000 7fcf765ad700 1 -- 172.21.15.1:0/1062233094 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf5c05f270 msgr2=0x7fcf5c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.500+0000 7fcf765ad700 1 --2- 172.21.15.1:0/1062233094 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf5c05f270 0x7fcf5c061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fcf600011e0 tx=0x7fcf60007bb0).stop 2023-11-15T01:33:53.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.500+0000 7fcf765ad700 1 -- 172.21.15.1:0/1062233094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf70154480 msgr2=0x7fcf7014cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.500+0000 7fcf765ad700 1 --2- 172.21.15.1:0/1062233094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf70154480 0x7fcf7014cc70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fcf6800a380 tx=0x7fcf68007900).stop 2023-11-15T01:33:53.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.500+0000 7fcf765ad700 1 -- 172.21.15.1:0/1062233094 shutdown_connections 2023-11-15T01:33:53.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.500+0000 7fcf765ad700 1 --2- 172.21.15.1:0/1062233094 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf5c05f270 0x7fcf5c061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.500+0000 7fcf765ad700 1 --2- 172.21.15.1:0/1062233094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf70154480 0x7fcf7014cc70 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.500+0000 7fcf765ad700 1 --2- 172.21.15.1:0/1062233094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf700c6430 0x7fcf70158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.500+0000 7fcf765ad700 1 --2- 172.21.15.1:0/1062233094 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf701540a0 0x7fcf70154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.500+0000 7fcf765ad700 1 -- 172.21.15.1:0/1062233094 >> 172.21.15.1:0/1062233094 conn(0x7fcf70064a70 msgr2=0x7fcf7014d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:53.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.500+0000 7fcf765ad700 1 -- 172.21.15.1:0/1062233094 shutdown_connections 2023-11-15T01:33:53.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.500+0000 7fcf765ad700 1 -- 172.21.15.1:0/1062233094 wait complete. 2023-11-15T01:33:53.513 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:33:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.633+0000 7fccd97ae700 1 Processor -- start 2023-11-15T01:33:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.633+0000 7fccd97ae700 1 -- start start 2023-11-15T01:33:53.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.634+0000 7fccd97ae700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fccd40c6650 0x7fccd40aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.634+0000 7fccd97ae700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd40ca050 con 0x7fccd41540a0 2023-11-15T01:33:53.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.634+0000 7fccd97ae700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd40c9440 con 0x7fccd4154480 2023-11-15T01:33:53.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.634+0000 7fccd97ae700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd40c9720 con 0x7fccd40c6650 2023-11-15T01:33:53.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.634+0000 7fccd2ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fccd41540a0 0x7fccd40ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38310/0 (socket says 172.21.15.1:38310) 2023-11-15T01:33:53.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.634+0000 7fccd2ffd700 1 -- 172.21.15.1:0/2889890088 learned_addr learned my addr 172.21.15.1:0/2889890088 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:53.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.634+0000 7fccd37fe700 1 --2- 172.21.15.1:0/2889890088 >> v2:172.21.15.141:3300/0 conn(0x7fccd40c6650 0x7fccd40aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.634+0000 7fccd1ffb700 1 -- 172.21.15.1:0/2889890088 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613201959 0 0) 0x7fccd40ca050 con 0x7fccd41540a0 2023-11-15T01:33:53.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd1ffb700 1 -- 172.21.15.1:0/2889890088 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc00033f0 con 0x7fccd41540a0 2023-11-15T01:33:53.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd1ffb700 1 -- 172.21.15.1:0/2889890088 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1624069555 0 0) 0x7fccc00033f0 con 0x7fccd41540a0 2023-11-15T01:33:53.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd1ffb700 1 -- 172.21.15.1:0/2889890088 >> v2:172.21.15.141:3300/0 conn(0x7fccd40c6650 msgr2=0x7fccd40aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:53.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd1ffb700 1 --2- 172.21.15.1:0/2889890088 >> v2:172.21.15.141:3300/0 conn(0x7fccd40c6650 0x7fccd40aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd1ffb700 1 -- 172.21.15.1:0/2889890088 >> v1:172.21.15.141:6789/0 conn(0x7fccd4154480 legacy=0x7fccd40c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd1ffb700 1 -- 172.21.15.1:0/2889890088 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40c9a00 con 0x7fccd41540a0 2023-11-15T01:33:53.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd1ffb700 1 -- 172.21.15.1:0/2889890088 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fccc40017f0 con 0x7fccd41540a0 2023-11-15T01:33:53.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd1ffb700 1 -- 172.21.15.1:0/2889890088 >> v1:172.21.15.1:6789/0 conn(0x7fccd41540a0 legacy=0x7fccd40ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd1ffb700 1 --2- 172.21.15.1:0/2889890088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc00038e0 0x7fccc0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd1ffb700 1 --2- 172.21.15.1:0/2889890088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fccc0004690 0x7fccc0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd1ffb700 1 --2- 172.21.15.1:0/2889890088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fccc0005000 0x7fccc000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd1ffb700 1 -- 172.21.15.1:0/2889890088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40c9720 con 0x7fccc00038e0 2023-11-15T01:33:53.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd1ffb700 1 -- 172.21.15.1:0/2889890088 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc000beb0 con 0x7fccc0004690 2023-11-15T01:33:53.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd1ffb700 1 -- 172.21.15.1:0/2889890088 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc000c070 con 0x7fccc0005000 2023-11-15T01:33:53.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd2ffd700 1 --2- 172.21.15.1:0/2889890088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc00038e0 0x7fccc0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd27fc700 1 --2- 172.21.15.1:0/2889890088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fccc0004690 0x7fccc0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd37fe700 1 --2- 172.21.15.1:0/2889890088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fccc0005000 0x7fccc000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd2ffd700 1 -- 172.21.15.1:0/2889890088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fccc0005000 msgr2=0x7fccc000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:53.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd2ffd700 1 --2- 172.21.15.1:0/2889890088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fccc0005000 0x7fccc000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd2ffd700 1 -- 172.21.15.1:0/2889890088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fccc0004690 msgr2=0x7fccc0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:53.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd2ffd700 1 --2- 172.21.15.1:0/2889890088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fccc0004690 0x7fccc0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd2ffd700 1 -- 172.21.15.1:0/2889890088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00033f0 con 0x7fccc00038e0 2023-11-15T01:33:53.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.635+0000 7fccd37fe700 1 -- 172.21.15.1:0/2889890088 reap_dead start 2023-11-15T01:33:53.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.636+0000 7fccd2ffd700 1 --2- 172.21.15.1:0/2889890088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc00038e0 0x7fccc0003d00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fccc400c480 tx=0x7fccc400c790).ready entity=mon.0 client_cookie=60264eace556ae3b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:53.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.636+0000 7fccd1ffb700 1 -- 172.21.15.1:0/2889890088 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc4002030 con 0x7fccc00038e0 2023-11-15T01:33:53.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.636+0000 7fccd1ffb700 1 -- 172.21.15.1:0/2889890088 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc400ce20 con 0x7fccc00038e0 2023-11-15T01:33:53.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.636+0000 7fccd1ffb700 1 -- 172.21.15.1:0/2889890088 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc4005d30 con 0x7fccc00038e0 2023-11-15T01:33:53.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.636+0000 7fccd97ae700 1 -- 172.21.15.1:0/2889890088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc00038e0 msgr2=0x7fccc0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.636+0000 7fccd97ae700 1 --2- 172.21.15.1:0/2889890088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc00038e0 0x7fccc0003d00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fccc400c480 tx=0x7fccc400c790).stop 2023-11-15T01:33:53.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.636+0000 7fccd97ae700 1 -- 172.21.15.1:0/2889890088 shutdown_connections 2023-11-15T01:33:53.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.636+0000 7fccd97ae700 1 --2- 172.21.15.1:0/2889890088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc00038e0 0x7fccc0003d00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.636+0000 7fccd97ae700 1 -- 172.21.15.1:0/2889890088 >> 172.21.15.1:0/2889890088 conn(0x7fccd4064a70 msgr2=0x7fccd4064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:53.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.636+0000 7fccd97ae700 1 -- 172.21.15.1:0/2889890088 shutdown_connections 2023-11-15T01:33:53.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.636+0000 7fccd97ae700 1 -- 172.21.15.1:0/2889890088 wait complete. 2023-11-15T01:33:53.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.637+0000 7fccd97ae700 1 Processor -- start 2023-11-15T01:33:53.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.638+0000 7fccd97ae700 1 -- start start 2023-11-15T01:33:53.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.638+0000 7fccd97ae700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc00038e0 0x7fccd40b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.638+0000 7fccd97ae700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fccd415abc0 0x7fccd4158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.638+0000 7fccd97ae700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fccd40ac6e0 0x7fccd40acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.638+0000 7fccd97ae700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40ae060 con 0x7fccc00038e0 2023-11-15T01:33:53.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.638+0000 7fccd97ae700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40ae2d0 con 0x7fccd415abc0 2023-11-15T01:33:53.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.638+0000 7fccd97ae700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40ad050 con 0x7fccd40ac6e0 2023-11-15T01:33:53.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.638+0000 7fccd2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc00038e0 0x7fccd40b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.638+0000 7fccd2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc00038e0 0x7fccd40b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48824/0 (socket says 172.21.15.1:48824) 2023-11-15T01:33:53.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.638+0000 7fccd2ffd700 1 -- 172.21.15.1:0/3472614303 learned_addr learned my addr 172.21.15.1:0/3472614303 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:53.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.639+0000 7fccd37fe700 1 --2- 172.21.15.1:0/3472614303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fccd40ac6e0 0x7fccd40acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.639+0000 7fccd2ffd700 1 -- 172.21.15.1:0/3472614303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fccd40ac6e0 msgr2=0x7fccd40acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.639+0000 7fccd2ffd700 1 --2- 172.21.15.1:0/3472614303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fccd40ac6e0 0x7fccd40acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.639+0000 7fccd2ffd700 1 -- 172.21.15.1:0/3472614303 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fccd415abc0 msgr2=0x7fccd4158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.639+0000 7fccd27fc700 1 --2- 172.21.15.1:0/3472614303 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fccd415abc0 0x7fccd4158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.639+0000 7fccd2ffd700 1 --2- 172.21.15.1:0/3472614303 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fccd415abc0 0x7fccd4158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.639+0000 7fccd2ffd700 1 -- 172.21.15.1:0/3472614303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd4159700 con 0x7fccc00038e0 2023-11-15T01:33:53.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.639+0000 7fccd37fe700 1 --2- 172.21.15.1:0/3472614303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fccd40ac6e0 0x7fccd40acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:53.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.639+0000 7fccd2ffd700 1 --2- 172.21.15.1:0/3472614303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc00038e0 0x7fccd40b0320 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fccc000be80 tx=0x7fccc4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:53.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.639+0000 7fcccaffd700 1 -- 172.21.15.1:0/3472614303 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc40074f0 con 0x7fccc00038e0 2023-11-15T01:33:53.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.639+0000 7fcccaffd700 1 -- 172.21.15.1:0/3472614303 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc4007650 con 0x7fccc00038e0 2023-11-15T01:33:53.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.639+0000 7fccd97ae700 1 -- 172.21.15.1:0/3472614303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd41599e0 con 0x7fccc00038e0 2023-11-15T01:33:53.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.639+0000 7fcccaffd700 1 -- 172.21.15.1:0/3472614303 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc4007a10 con 0x7fccc00038e0 2023-11-15T01:33:53.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.639+0000 7fccd97ae700 1 -- 172.21.15.1:0/3472614303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd40b0810 con 0x7fccc00038e0 2023-11-15T01:33:53.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.640+0000 7fccd97ae700 1 -- 172.21.15.1:0/3472614303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd40ae060 con 0x7fccc00038e0 2023-11-15T01:33:53.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.640+0000 7fcccaffd700 1 -- 172.21.15.1:0/3472614303 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fccc4020690 con 0x7fccc00038e0 2023-11-15T01:33:53.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.641+0000 7fcccaffd700 1 --2- 172.21.15.1:0/3472614303 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fccb405f2a0 0x7fccb4061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.641+0000 7fcccaffd700 1 -- 172.21.15.1:0/3472614303 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5665+0+0 (secure 0 0 0) 0x7fccc407b330 con 0x7fccc00038e0 2023-11-15T01:33:53.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.641+0000 7fccd27fc700 1 --2- 172.21.15.1:0/3472614303 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fccb405f2a0 0x7fccb4061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.641+0000 7fccd27fc700 1 --2- 172.21.15.1:0/3472614303 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fccb405f2a0 0x7fccb4061760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fccbc000c00 tx=0x7fccbc009040).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:53.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.645+0000 7fcccaffd700 1 -- 172.21.15.1:0/3472614303 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fccc404c640 con 0x7fccc00038e0 2023-11-15T01:33:53.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.816+0000 7fccd97ae700 1 -- 172.21.15.1:0/3472614303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fccd406c7e0 con 0x7fccc00038e0 2023-11-15T01:33:53.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.816+0000 7fcccaffd700 1 -- 172.21.15.1:0/3472614303 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7fccc404fc60 con 0x7fccc00038e0 2023-11-15T01:33:53.818 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:33:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.818+0000 7fccd97ae700 1 -- 172.21.15.1:0/3472614303 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fccb405f2a0 msgr2=0x7fccb4061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.818+0000 7fccd97ae700 1 --2- 172.21.15.1:0/3472614303 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fccb405f2a0 0x7fccb4061760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fccbc000c00 tx=0x7fccbc009040).stop 2023-11-15T01:33:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.818+0000 7fccd97ae700 1 -- 172.21.15.1:0/3472614303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc00038e0 msgr2=0x7fccd40b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.818+0000 7fccd97ae700 1 --2- 172.21.15.1:0/3472614303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc00038e0 0x7fccd40b0320 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fccc000be80 tx=0x7fccc4015000).stop 2023-11-15T01:33:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.818+0000 7fccd97ae700 1 -- 172.21.15.1:0/3472614303 shutdown_connections 2023-11-15T01:33:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.818+0000 7fccd97ae700 1 --2- 172.21.15.1:0/3472614303 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fccb405f2a0 0x7fccb4061760 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.818+0000 7fccd97ae700 1 --2- 172.21.15.1:0/3472614303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fccd40ac6e0 0x7fccd40acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.818+0000 7fccd97ae700 1 --2- 172.21.15.1:0/3472614303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc00038e0 0x7fccd40b0320 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.818+0000 7fccd97ae700 1 --2- 172.21.15.1:0/3472614303 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fccd415abc0 0x7fccd4158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.818+0000 7fccd97ae700 1 -- 172.21.15.1:0/3472614303 >> 172.21.15.1:0/3472614303 conn(0x7fccd4064a70 msgr2=0x7fccd40abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:53.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.818+0000 7fccd97ae700 1 -- 172.21.15.1:0/3472614303 shutdown_connections 2023-11-15T01:33:53.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.818+0000 7fccd97ae700 1 -- 172.21.15.1:0/3472614303 wait complete. 2023-11-15T01:33:53.832 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-15T01:33:53.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.949+0000 7f172e08b700 1 Processor -- start 2023-11-15T01:33:53.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.949+0000 7f172e08b700 1 -- start start 2023-11-15T01:33:53.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.950+0000 7f172e08b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1728151e10 0x7f1728155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.950+0000 7f172e08b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f17280c86b0 0x7f17280aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.950+0000 7f172e08b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17280c7980 con 0x7f17280c98b0 2023-11-15T01:33:53.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.950+0000 7f172e08b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17280c8b10 con 0x7f17280c86b0 2023-11-15T01:33:53.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.950+0000 7f172e08b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17280aa5c0 con 0x7f1728151e10 2023-11-15T01:33:53.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.950+0000 7f172c888700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f17280c86b0 0x7f17280aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.950+0000 7f172d88a700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f17280c98b0 0x7f17280c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38318/0 (socket says 172.21.15.1:38318) 2023-11-15T01:33:53.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.950+0000 7f172d88a700 1 -- 172.21.15.1:0/176416634 learned_addr learned my addr 172.21.15.1:0/176416634 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:53.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.950+0000 7f172d089700 1 --2- 172.21.15.1:0/176416634 >> v2:172.21.15.141:3300/0 conn(0x7f1728151e10 0x7f1728155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.950+0000 7f172c888700 1 -- 172.21.15.1:0/176416634 >> v2:172.21.15.141:3300/0 conn(0x7f1728151e10 msgr2=0x7f1728155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:53.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.950+0000 7f172c888700 1 --2- 172.21.15.1:0/176416634 >> v2:172.21.15.141:3300/0 conn(0x7f1728151e10 0x7f1728155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.950+0000 7f172c888700 1 -- 172.21.15.1:0/176416634 >> v1:172.21.15.1:6789/0 conn(0x7f17280c98b0 legacy=0x7f17280c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.950+0000 7f172c888700 1 -- 172.21.15.1:0/176416634 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17280aa890 con 0x7f17280c86b0 2023-11-15T01:33:53.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.950+0000 7f171ffff700 1 -- 172.21.15.1:0/176416634 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438776124 0 0) 0x7f17280c7980 con 0x7f17280c98b0 2023-11-15T01:33:53.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.950+0000 7f172c888700 1 --2- 172.21.15.1:0/176416634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17280c86b0 0x7f17280aa0d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f1728084780 tx=0x7f1718009060).ready entity=mon.0 client_cookie=dcd0b9012304b1ed server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:53.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.951+0000 7f171ffff700 1 -- 172.21.15.1:0/176416634 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171800b580 con 0x7f17280c86b0 2023-11-15T01:33:53.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.951+0000 7f171ffff700 1 -- 172.21.15.1:0/176416634 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171800b6e0 con 0x7f17280c86b0 2023-11-15T01:33:53.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.951+0000 7f171ffff700 1 -- 172.21.15.1:0/176416634 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171800ba60 con 0x7f17280c86b0 2023-11-15T01:33:53.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.951+0000 7f172e08b700 1 -- 172.21.15.1:0/176416634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17280c86b0 msgr2=0x7f17280aa0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.951+0000 7f172e08b700 1 --2- 172.21.15.1:0/176416634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17280c86b0 0x7f17280aa0d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f1728084780 tx=0x7f1718009060).stop 2023-11-15T01:33:53.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.951+0000 7f172e08b700 1 -- 172.21.15.1:0/176416634 shutdown_connections 2023-11-15T01:33:53.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.951+0000 7f172e08b700 1 --2- 172.21.15.1:0/176416634 >> v2:172.21.15.141:3300/0 conn(0x7f1728151e10 0x7f1728155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.951+0000 7f172e08b700 1 --2- 172.21.15.1:0/176416634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17280c86b0 0x7f17280aa0d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.951+0000 7f172e08b700 1 -- 172.21.15.1:0/176416634 >> 172.21.15.1:0/176416634 conn(0x7f17280947e0 msgr2=0x7f172806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:53.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.951+0000 7f172e08b700 1 -- 172.21.15.1:0/176416634 shutdown_connections 2023-11-15T01:33:53.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.951+0000 7f172e08b700 1 -- 172.21.15.1:0/176416634 wait complete. 2023-11-15T01:33:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.952+0000 7f172e08b700 1 Processor -- start 2023-11-15T01:33:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.952+0000 7f172e08b700 1 -- start start 2023-11-15T01:33:53.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.953+0000 7f172e08b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17280c86b0 0x7f172813ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.953+0000 7f172e08b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17280c98b0 0x7f1728064720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.953+0000 7f172e08b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1728151e10 0x7f1728064c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.953+0000 7f172e08b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280aaed0 con 0x7f17280c86b0 2023-11-15T01:33:53.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.953+0000 7f172e08b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1728065100 con 0x7f17280c98b0 2023-11-15T01:33:53.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.953+0000 7f172e08b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17280ab0b0 con 0x7f1728151e10 2023-11-15T01:33:53.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.953+0000 7f172d089700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17280c86b0 0x7f172813ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.953+0000 7f172d089700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17280c86b0 0x7f172813ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48848/0 (socket says 172.21.15.1:48848) 2023-11-15T01:33:53.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.953+0000 7f172d089700 1 -- 172.21.15.1:0/1613327304 learned_addr learned my addr 172.21.15.1:0/1613327304 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:53.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.954+0000 7f172d88a700 1 --2- 172.21.15.1:0/1613327304 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1728151e10 0x7f1728064c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.954+0000 7f172d089700 1 -- 172.21.15.1:0/1613327304 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1728151e10 msgr2=0x7f1728064c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.954+0000 7f172d089700 1 --2- 172.21.15.1:0/1613327304 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1728151e10 0x7f1728064c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.954+0000 7f172c888700 1 --2- 172.21.15.1:0/1613327304 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17280c98b0 0x7f1728064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.954+0000 7f172d089700 1 -- 172.21.15.1:0/1613327304 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17280c98b0 msgr2=0x7f1728064720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:53.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.954+0000 7f172d089700 1 --2- 172.21.15.1:0/1613327304 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17280c98b0 0x7f1728064720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:53.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.954+0000 7f172d089700 1 -- 172.21.15.1:0/1613327304 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17180092a0 con 0x7f17280c86b0 2023-11-15T01:33:53.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.954+0000 7f172d089700 1 --2- 172.21.15.1:0/1613327304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17280c86b0 0x7f172813ac10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f172400d890 tx=0x7f1724008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:53.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.954+0000 7f171d7fa700 1 -- 172.21.15.1:0/1613327304 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17240125f0 con 0x7f17280c86b0 2023-11-15T01:33:53.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.954+0000 7f171d7fa700 1 -- 172.21.15.1:0/1613327304 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1724012750 con 0x7f17280c86b0 2023-11-15T01:33:53.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.954+0000 7f172e08b700 1 -- 172.21.15.1:0/1613327304 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17280ab390 con 0x7f17280c86b0 2023-11-15T01:33:53.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.954+0000 7f171d7fa700 1 -- 172.21.15.1:0/1613327304 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724012ad0 con 0x7f17280c86b0 2023-11-15T01:33:53.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.954+0000 7f172e08b700 1 -- 172.21.15.1:0/1613327304 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17280ab950 con 0x7f17280c86b0 2023-11-15T01:33:53.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.955+0000 7f172e08b700 1 -- 172.21.15.1:0/1613327304 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1728155130 con 0x7f17280c86b0 2023-11-15T01:33:53.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.955+0000 7f171d7fa700 1 -- 172.21.15.1:0/1613327304 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1724013480 con 0x7f17280c86b0 2023-11-15T01:33:53.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.956+0000 7f171d7fa700 1 --2- 172.21.15.1:0/1613327304 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f170c05f2a0 0x7f170c061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:53.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.956+0000 7f171d7fa700 1 -- 172.21.15.1:0/1613327304 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5665+0+0 (secure 0 0 0) 0x7f1724079f20 con 0x7f17280c86b0 2023-11-15T01:33:53.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.956+0000 7f172c888700 1 --2- 172.21.15.1:0/1613327304 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f170c05f2a0 0x7f170c061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:53.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.956+0000 7f172c888700 1 --2- 172.21.15.1:0/1613327304 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f170c05f2a0 0x7f170c061760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1728065280 tx=0x7f1718017000).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:53.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:53.960+0000 7f171d7fa700 1 -- 172.21.15.1:0/1613327304 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f172404b1d0 con 0x7f17280c86b0 2023-11-15T01:33:54.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.135+0000 7f172e08b700 1 -- 172.21.15.1:0/1613327304 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f17280475e0 con 0x7f17280c86b0 2023-11-15T01:33:54.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.135+0000 7f171d7fa700 1 -- 172.21.15.1:0/1613327304 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v57) v1 ==== 84+0+143 (secure 0 0 0) 0x7f172404e7f0 con 0x7f17280c86b0 2023-11-15T01:33:54.138 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:54.138 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T01:33:54.138 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:54.139 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2023-11-15T01:33:54.139 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "device_health_metrics" 2023-11-15T01:33:54.139 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:33:54.139 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:33:54.140 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 2, 2023-11-15T01:33:54.140 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "rbd" 2023-11-15T01:33:54.140 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:33:54.140 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T01:33:54.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.137+0000 7f172e08b700 1 -- 172.21.15.1:0/1613327304 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f170c05f2a0 msgr2=0x7f170c061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:54.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.137+0000 7f172e08b700 1 --2- 172.21.15.1:0/1613327304 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f170c05f2a0 0x7f170c061760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1728065280 tx=0x7f1718017000).stop 2023-11-15T01:33:54.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.137+0000 7f172e08b700 1 -- 172.21.15.1:0/1613327304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17280c86b0 msgr2=0x7f172813ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:54.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.137+0000 7f172e08b700 1 --2- 172.21.15.1:0/1613327304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17280c86b0 0x7f172813ac10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f172400d890 tx=0x7f1724008040).stop 2023-11-15T01:33:54.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.137+0000 7f172e08b700 1 -- 172.21.15.1:0/1613327304 shutdown_connections 2023-11-15T01:33:54.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.137+0000 7f172e08b700 1 --2- 172.21.15.1:0/1613327304 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f170c05f2a0 0x7f170c061760 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:54.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.137+0000 7f172e08b700 1 --2- 172.21.15.1:0/1613327304 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1728151e10 0x7f1728064c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:54.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.137+0000 7f172e08b700 1 --2- 172.21.15.1:0/1613327304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17280c86b0 0x7f172813ac10 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:54.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.137+0000 7f172e08b700 1 --2- 172.21.15.1:0/1613327304 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17280c98b0 0x7f1728064720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:54.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.137+0000 7f172e08b700 1 -- 172.21.15.1:0/1613327304 >> 172.21.15.1:0/1613327304 conn(0x7f17280947e0 msgr2=0x7f17280a9020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:54.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.137+0000 7f172e08b700 1 -- 172.21.15.1:0/1613327304 shutdown_connections 2023-11-15T01:33:54.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.137+0000 7f172e08b700 1 -- 172.21.15.1:0/1613327304 wait complete. 2023-11-15T01:33:54.151 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-15T01:33:54.151 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-15T01:33:54.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.272+0000 7fedabf9e700 1 Processor -- start 2023-11-15T01:33:54.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.273+0000 7fedabf9e700 1 -- start start 2023-11-15T01:33:54.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.273+0000 7fedabf9e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7feda4153aa0 0x7feda40c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:54.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.273+0000 7fedabf9e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feda4153e80 0x7feda4069d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:54.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.273+0000 7fedabf9e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda40c6160 con 0x7feda406a200 2023-11-15T01:33:54.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.273+0000 7fedabf9e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda40c5550 con 0x7feda4153aa0 2023-11-15T01:33:54.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.273+0000 7fedabf9e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda40c5830 con 0x7feda4153e80 2023-11-15T01:33:54.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.274+0000 7feda9539700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feda4153e80 0x7feda4069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:54.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.274+0000 7feda9d3a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7feda4153aa0 0x7feda40c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:54.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.274+0000 7feda9d3a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7feda4153aa0 0x7feda40c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:56184/0 (socket says 172.21.15.1:56184) 2023-11-15T01:33:54.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.274+0000 7fedaa53b700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7feda406a200 0x7feda40c1930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:57206/0 (socket says 172.21.15.1:57206) 2023-11-15T01:33:54.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.274+0000 7feda9d3a700 1 -- 172.21.15.1:0/2858804673 learned_addr learned my addr 172.21.15.1:0/2858804673 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:54.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.274+0000 7feda9539700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feda4153e80 0x7feda4069d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:54070/0 (socket says 172.21.15.1:54070) 2023-11-15T01:33:54.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.274+0000 7feda9d3a700 1 -- 172.21.15.1:0/2858804673 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feda4153e80 msgr2=0x7feda4069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:54.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.274+0000 7feda9d3a700 1 --2- 172.21.15.1:0/2858804673 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feda4153e80 0x7feda4069d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:54.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.274+0000 7feda9d3a700 1 -- 172.21.15.1:0/2858804673 >> v1:172.21.15.141:6789/0 conn(0x7feda406a200 legacy=0x7feda40c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:54.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.274+0000 7feda9d3a700 1 -- 172.21.15.1:0/2858804673 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda40c5b10 con 0x7feda4153aa0 2023-11-15T01:33:54.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.274+0000 7feda8d38700 1 -- 172.21.15.1:0/2858804673 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13432490 0 0) 0x7feda40c6160 con 0x7feda406a200 2023-11-15T01:33:54.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.274+0000 7feda9d3a700 1 --2- 172.21.15.1:0/2858804673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feda4153aa0 0x7feda40c65f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fed94009f20 tx=0x7fed94009840).ready entity=mon.1 client_cookie=354b713582bdd3ee server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:54.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.274+0000 7feda8d38700 1 -- 172.21.15.1:0/2858804673 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400e070 con 0x7feda4153aa0 2023-11-15T01:33:54.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.274+0000 7feda8d38700 1 -- 172.21.15.1:0/2858804673 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400b9d0 con 0x7feda4153aa0 2023-11-15T01:33:54.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.275+0000 7feda8d38700 1 -- 172.21.15.1:0/2858804673 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400bd50 con 0x7feda4153aa0 2023-11-15T01:33:54.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.275+0000 7fedabf9e700 1 -- 172.21.15.1:0/2858804673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feda4153aa0 msgr2=0x7feda40c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:54.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.275+0000 7fedabf9e700 1 --2- 172.21.15.1:0/2858804673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feda4153aa0 0x7feda40c65f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fed94009f20 tx=0x7fed94009840).stop 2023-11-15T01:33:54.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.275+0000 7fedabf9e700 1 -- 172.21.15.1:0/2858804673 shutdown_connections 2023-11-15T01:33:54.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.275+0000 7fedabf9e700 1 --2- 172.21.15.1:0/2858804673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feda4153aa0 0x7feda40c65f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:54.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.275+0000 7fedabf9e700 1 --2- 172.21.15.1:0/2858804673 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feda4153e80 0x7feda4069d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:54.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.275+0000 7fedabf9e700 1 -- 172.21.15.1:0/2858804673 >> 172.21.15.1:0/2858804673 conn(0x7feda4063280 msgr2=0x7feda40c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:54.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.275+0000 7fedabf9e700 1 -- 172.21.15.1:0/2858804673 shutdown_connections 2023-11-15T01:33:54.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.275+0000 7fedabf9e700 1 -- 172.21.15.1:0/2858804673 wait complete. 2023-11-15T01:33:54.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.276+0000 7fedabf9e700 1 Processor -- start 2023-11-15T01:33:54.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.276+0000 7fedabf9e700 1 -- start start 2023-11-15T01:33:54.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7fedabf9e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feda406a200 0x7feda4143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:54.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7fedabf9e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feda4153aa0 0x7feda40a7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:54.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7fedabf9e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feda4153e80 0x7feda40a8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:54.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7fedabf9e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda4144030 con 0x7feda4153e80 2023-11-15T01:33:54.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7fedabf9e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda40bea10 con 0x7feda406a200 2023-11-15T01:33:54.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7fedabf9e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda40bde00 con 0x7feda4153aa0 2023-11-15T01:33:54.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7fedaa53b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feda4153e80 0x7feda40a8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:54.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7fedaa53b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feda4153e80 0x7feda40a8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48858/0 (socket says 172.21.15.1:48858) 2023-11-15T01:33:54.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7fedaa53b700 1 -- 172.21.15.1:0/4015097191 learned_addr learned my addr 172.21.15.1:0/4015097191 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:54.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7feda9d3a700 1 --2- 172.21.15.1:0/4015097191 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feda406a200 0x7feda4143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:54.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7feda9539700 1 --2- 172.21.15.1:0/4015097191 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feda4153aa0 0x7feda40a7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:54.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7fedaa53b700 1 -- 172.21.15.1:0/4015097191 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feda4153aa0 msgr2=0x7feda40a7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:54.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7fedaa53b700 1 --2- 172.21.15.1:0/4015097191 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feda4153aa0 0x7feda40a7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:54.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7fedaa53b700 1 -- 172.21.15.1:0/4015097191 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feda406a200 msgr2=0x7feda4143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:54.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7fedaa53b700 1 --2- 172.21.15.1:0/4015097191 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feda406a200 0x7feda4143b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:54.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7fedaa53b700 1 -- 172.21.15.1:0/4015097191 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed94009ae0 con 0x7feda4153e80 2023-11-15T01:33:54.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.277+0000 7fedaa53b700 1 --2- 172.21.15.1:0/4015097191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feda4153e80 0x7feda40a8410 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fed9c00c460 tx=0x7fed9c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:54.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.278+0000 7feda1ffb700 1 -- 172.21.15.1:0/4015097191 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c0070d0 con 0x7feda4153e80 2023-11-15T01:33:54.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.278+0000 7feda1ffb700 1 -- 172.21.15.1:0/4015097191 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c007230 con 0x7feda4153e80 2023-11-15T01:33:54.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.278+0000 7fedabf9e700 1 -- 172.21.15.1:0/4015097191 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda40be0e0 con 0x7feda4153e80 2023-11-15T01:33:54.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.278+0000 7feda1ffb700 1 -- 172.21.15.1:0/4015097191 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c0056e0 con 0x7feda4153e80 2023-11-15T01:33:54.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.278+0000 7fedabf9e700 1 -- 172.21.15.1:0/4015097191 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda40be6a0 con 0x7feda4153e80 2023-11-15T01:33:54.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.279+0000 7fedabf9e700 1 -- 172.21.15.1:0/4015097191 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda40bebc0 con 0x7feda4153e80 2023-11-15T01:33:54.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.279+0000 7feda1ffb700 1 -- 172.21.15.1:0/4015097191 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fed9c005a50 con 0x7feda4153e80 2023-11-15T01:33:54.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.279+0000 7feda1ffb700 1 --2- 172.21.15.1:0/4015097191 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed9005f270 0x7fed90061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:54.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.280+0000 7feda1ffb700 1 -- 172.21.15.1:0/4015097191 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5665+0+0 (secure 0 0 0) 0x7fed9c0798b0 con 0x7feda4153e80 2023-11-15T01:33:54.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.280+0000 7feda9d3a700 1 --2- 172.21.15.1:0/4015097191 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed9005f270 0x7fed90061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:54.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.280+0000 7feda9d3a700 1 --2- 172.21.15.1:0/4015097191 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed9005f270 0x7fed90061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fed9400b9a0 tx=0x7fed94009840).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:54.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.284+0000 7feda1ffb700 1 -- 172.21.15.1:0/4015097191 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7feda40bebc0 con 0x7feda4153e80 2023-11-15T01:33:54.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:54.457+0000 7fedabf9e700 1 -- 172.21.15.1:0/4015097191 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7feda40bed80 con 0x7feda4153e80 2023-11-15T01:33:55.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.444+0000 7feda1ffb700 1 -- 172.21.15.1:0/4015097191 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v58) v1 ==== 152+0+0 (secure 0 0 0) 0x7fed9c018030 con 0x7feda4153e80 2023-11-15T01:33:55.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.451+0000 7fedabf9e700 1 -- 172.21.15.1:0/4015097191 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed9005f270 msgr2=0x7fed90061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:55.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.451+0000 7fedabf9e700 1 --2- 172.21.15.1:0/4015097191 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed9005f270 0x7fed90061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fed9400b9a0 tx=0x7fed94009840).stop 2023-11-15T01:33:55.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.451+0000 7fedabf9e700 1 -- 172.21.15.1:0/4015097191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feda4153e80 msgr2=0x7feda40a8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:55.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.451+0000 7fedabf9e700 1 --2- 172.21.15.1:0/4015097191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feda4153e80 0x7feda40a8410 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fed9c00c460 tx=0x7fed9c007e10).stop 2023-11-15T01:33:55.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.451+0000 7fedabf9e700 1 -- 172.21.15.1:0/4015097191 shutdown_connections 2023-11-15T01:33:55.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.451+0000 7fedabf9e700 1 --2- 172.21.15.1:0/4015097191 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed9005f270 0x7fed90061730 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0x7fed9400b9a0 tx=0x7fed94009840).stop 2023-11-15T01:33:55.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.451+0000 7fedabf9e700 1 --2- 172.21.15.1:0/4015097191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feda4153e80 0x7feda40a8410 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:55.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.451+0000 7fedabf9e700 1 --2- 172.21.15.1:0/4015097191 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feda406a200 0x7feda4143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:55.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.451+0000 7fedabf9e700 1 --2- 172.21.15.1:0/4015097191 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feda4153aa0 0x7feda40a7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:55.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.451+0000 7fedabf9e700 1 -- 172.21.15.1:0/4015097191 >> 172.21.15.1:0/4015097191 conn(0x7feda4063280 msgr2=0x7feda40c3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:55.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.452+0000 7fedabf9e700 1 -- 172.21.15.1:0/4015097191 shutdown_connections 2023-11-15T01:33:55.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.453+0000 7fedabf9e700 1 -- 172.21.15.1:0/4015097191 wait complete. 2023-11-15T01:33:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2023-11-15T01:33:55.471 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-15T01:33:55.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.601+0000 7f3349dec700 1 Processor -- start 2023-11-15T01:33:55.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.601+0000 7f3349dec700 1 -- start start 2023-11-15T01:33:55.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.602+0000 7f3349dec700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f33440c6650 0x7f33440aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:55.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.602+0000 7f3349dec700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33440ca050 con 0x7f3344154480 2023-11-15T01:33:55.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.602+0000 7f3349dec700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33440c9440 con 0x7f33441540a0 2023-11-15T01:33:55.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.602+0000 7f3349dec700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33440c9720 con 0x7f33440c6650 2023-11-15T01:33:55.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.602+0000 7f3343fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f33440c6650 0x7f33440aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:55.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.602+0000 7f3342ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3344154480 0x7f33440c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38326/0 (socket says 172.21.15.1:38326) 2023-11-15T01:33:55.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.602+0000 7f3342ffd700 1 -- 172.21.15.1:0/842736441 learned_addr learned my addr 172.21.15.1:0/842736441 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:55.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.602+0000 7f3343fff700 1 -- 172.21.15.1:0/842736441 >> v1:172.21.15.141:6789/0 conn(0x7f33441540a0 legacy=0x7f33440ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:55.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.602+0000 7f3343fff700 1 -- 172.21.15.1:0/842736441 >> v1:172.21.15.1:6789/0 conn(0x7f3344154480 legacy=0x7f33440c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:55.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.602+0000 7f33427fc700 1 -- 172.21.15.1:0/842736441 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019883580 0 0) 0x7f33440ca050 con 0x7f3344154480 2023-11-15T01:33:55.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.602+0000 7f3343fff700 1 -- 172.21.15.1:0/842736441 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440c9a00 con 0x7f33440c6650 2023-11-15T01:33:55.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.602+0000 7f3343fff700 1 --2- 172.21.15.1:0/842736441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33440c6650 0x7f33440aaf40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f333c009e60 tx=0x7f333c009780).ready entity=mon.0 client_cookie=de99e32e17bfebc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:55.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.603+0000 7f33427fc700 1 -- 172.21.15.1:0/842736441 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c00e070 con 0x7f33440c6650 2023-11-15T01:33:55.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.603+0000 7f33427fc700 1 -- 172.21.15.1:0/842736441 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333c00bc30 con 0x7f33440c6650 2023-11-15T01:33:55.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.603+0000 7f33427fc700 1 -- 172.21.15.1:0/842736441 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c012410 con 0x7f33440c6650 2023-11-15T01:33:55.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.603+0000 7f3349dec700 1 -- 172.21.15.1:0/842736441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33440c6650 msgr2=0x7f33440aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:55.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.603+0000 7f3349dec700 1 --2- 172.21.15.1:0/842736441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33440c6650 0x7f33440aaf40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f333c009e60 tx=0x7f333c009780).stop 2023-11-15T01:33:55.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.603+0000 7f3349dec700 1 -- 172.21.15.1:0/842736441 shutdown_connections 2023-11-15T01:33:55.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.603+0000 7f3349dec700 1 --2- 172.21.15.1:0/842736441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33440c6650 0x7f33440aaf40 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:55.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.603+0000 7f3349dec700 1 -- 172.21.15.1:0/842736441 >> 172.21.15.1:0/842736441 conn(0x7f3344064a70 msgr2=0x7f3344064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:55.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.603+0000 7f3349dec700 1 -- 172.21.15.1:0/842736441 shutdown_connections 2023-11-15T01:33:55.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.603+0000 7f3349dec700 1 -- 172.21.15.1:0/842736441 wait complete. 2023-11-15T01:33:55.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.604+0000 7f3349dec700 1 Processor -- start 2023-11-15T01:33:55.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.605+0000 7f3349dec700 1 -- start start 2023-11-15T01:33:55.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.605+0000 7f3349dec700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33440c6650 0x7f33441687c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:55.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.605+0000 7f3349dec700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33441540a0 0x7f33440aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:55.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.605+0000 7f3349dec700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3344154480 0x7f33440ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:55.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.605+0000 7f3349dec700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3344151200 con 0x7f33441540a0 2023-11-15T01:33:55.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.605+0000 7f3349dec700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33440ab970 con 0x7f33440c6650 2023-11-15T01:33:55.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.605+0000 7f3349dec700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33441505c0 con 0x7f3344154480 2023-11-15T01:33:55.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.605+0000 7f3342ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33441540a0 0x7f33440aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:55.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.605+0000 7f3342ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33441540a0 0x7f33440aaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48866/0 (socket says 172.21.15.1:48866) 2023-11-15T01:33:55.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.605+0000 7f3342ffd700 1 -- 172.21.15.1:0/1060145420 learned_addr learned my addr 172.21.15.1:0/1060145420 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:55.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.606+0000 7f33437fe700 1 --2- 172.21.15.1:0/1060145420 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33440c6650 0x7f33441687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:55.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.606+0000 7f3343fff700 1 --2- 172.21.15.1:0/1060145420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3344154480 0x7f33440ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:55.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.606+0000 7f3342ffd700 1 -- 172.21.15.1:0/1060145420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3344154480 msgr2=0x7f33440ab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:55.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.606+0000 7f3342ffd700 1 --2- 172.21.15.1:0/1060145420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3344154480 0x7f33440ab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:55.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.606+0000 7f3342ffd700 1 -- 172.21.15.1:0/1060145420 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33440c6650 msgr2=0x7f33441687c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:55.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.606+0000 7f3342ffd700 1 --2- 172.21.15.1:0/1060145420 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33440c6650 0x7f33441687c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:55.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.606+0000 7f3342ffd700 1 -- 172.21.15.1:0/1060145420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c009a20 con 0x7f33441540a0 2023-11-15T01:33:55.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.606+0000 7f3343fff700 1 --2- 172.21.15.1:0/1060145420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3344154480 0x7f33440ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:55.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.606+0000 7f3342ffd700 1 --2- 172.21.15.1:0/1060145420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33441540a0 0x7f33440aaf90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f333800c490 tx=0x7f3338007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:55.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.606+0000 7f332b7fe700 1 -- 172.21.15.1:0/1060145420 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333800ce40 con 0x7f33441540a0 2023-11-15T01:33:55.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.606+0000 7f332b7fe700 1 -- 172.21.15.1:0/1060145420 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33380072e0 con 0x7f33441540a0 2023-11-15T01:33:55.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.606+0000 7f3349dec700 1 -- 172.21.15.1:0/1060145420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3344150860 con 0x7f33441540a0 2023-11-15T01:33:55.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.606+0000 7f332b7fe700 1 -- 172.21.15.1:0/1060145420 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380057a0 con 0x7f33441540a0 2023-11-15T01:33:55.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.606+0000 7f3349dec700 1 -- 172.21.15.1:0/1060145420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3344150e20 con 0x7f33441540a0 2023-11-15T01:33:55.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.607+0000 7f3349dec700 1 -- 172.21.15.1:0/1060145420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3344151340 con 0x7f33441540a0 2023-11-15T01:33:55.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.608+0000 7f332b7fe700 1 -- 172.21.15.1:0/1060145420 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3338005bd0 con 0x7f33441540a0 2023-11-15T01:33:55.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.608+0000 7f332b7fe700 1 --2- 172.21.15.1:0/1060145420 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f333005f270 0x7f3330061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:55.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.608+0000 7f332b7fe700 1 -- 172.21.15.1:0/1060145420 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6035+0+0 (secure 0 0 0) 0x7f3338079a20 con 0x7f33441540a0 2023-11-15T01:33:55.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.608+0000 7f33437fe700 1 --2- 172.21.15.1:0/1060145420 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f333005f270 0x7f3330061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:55.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.608+0000 7f33437fe700 1 --2- 172.21.15.1:0/1060145420 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f333005f270 0x7f3330061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3334003900 tx=0x7f3334007d40).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:55.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.612+0000 7f332b7fe700 1 -- 172.21.15.1:0/1060145420 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f333804abc0 con 0x7f33441540a0 2023-11-15T01:33:55.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:55.784+0000 7f3349dec700 1 -- 172.21.15.1:0/1060145420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f334406c7e0 con 0x7f33441540a0 2023-11-15T01:33:56.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.448+0000 7f332b7fe700 1 -- 172.21.15.1:0/1060145420 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v59) v1 ==== 170+0+0 (secure 0 0 0) 0x7f333804e1e0 con 0x7f33441540a0 2023-11-15T01:33:56.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.453+0000 7f3349dec700 1 -- 172.21.15.1:0/1060145420 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f333005f270 msgr2=0x7f3330061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:56.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.453+0000 7f3349dec700 1 --2- 172.21.15.1:0/1060145420 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f333005f270 0x7f3330061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3334003900 tx=0x7f3334007d40).stop 2023-11-15T01:33:56.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.453+0000 7f3349dec700 1 -- 172.21.15.1:0/1060145420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33441540a0 msgr2=0x7f33440aaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:56.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.453+0000 7f3349dec700 1 --2- 172.21.15.1:0/1060145420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33441540a0 0x7f33440aaf90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f333800c490 tx=0x7f3338007e40).stop 2023-11-15T01:33:56.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.463+0000 7f3349dec700 1 -- 172.21.15.1:0/1060145420 shutdown_connections 2023-11-15T01:33:56.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.463+0000 7f3349dec700 1 --2- 172.21.15.1:0/1060145420 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f333005f270 0x7f3330061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:56.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.463+0000 7f3349dec700 1 --2- 172.21.15.1:0/1060145420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3344154480 0x7f33440ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:56.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.464+0000 7f3349dec700 1 --2- 172.21.15.1:0/1060145420 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33440c6650 0x7f33441687c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:56.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.464+0000 7f3349dec700 1 --2- 172.21.15.1:0/1060145420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33441540a0 0x7f33440aaf90 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:56.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.464+0000 7f3349dec700 1 -- 172.21.15.1:0/1060145420 >> 172.21.15.1:0/1060145420 conn(0x7f3344064a70 msgr2=0x7f334414e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:56.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.464+0000 7f3349dec700 1 -- 172.21.15.1:0/1060145420 shutdown_connections 2023-11-15T01:33:56.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.464+0000 7f3349dec700 1 -- 172.21.15.1:0/1060145420 wait complete. 2023-11-15T01:33:56.475 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2023-11-15T01:33:56.490 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-15T01:33:56.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.614+0000 7f4f6aec0700 1 Processor -- start 2023-11-15T01:33:56.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.614+0000 7f4f6aec0700 1 -- start start 2023-11-15T01:33:56.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f6aec0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f641540a0 0x7f4f640ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:56.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f6aec0700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f640ca050 con 0x7f4f640c6650 2023-11-15T01:33:56.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f6aec0700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f640c9440 con 0x7f4f64154480 2023-11-15T01:33:56.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f6aec0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640c9720 con 0x7f4f641540a0 2023-11-15T01:33:56.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f6945d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4f640c6650 0x7f4f640aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38334/0 (socket says 172.21.15.1:38334) 2023-11-15T01:33:56.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f6945d700 1 -- 172.21.15.1:0/3558856315 learned_addr learned my addr 172.21.15.1:0/3558856315 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:56.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f68c5c700 1 --2- 172.21.15.1:0/3558856315 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f641540a0 0x7f4f640ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:56.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637909387 0 0) 0x7f4f640ca050 con 0x7f4f640c6650 2023-11-15T01:33:56.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f500033f0 con 0x7f4f640c6650 2023-11-15T01:33:56.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338098500 0 0) 0x7f4f640c9440 con 0x7f4f64154480 2023-11-15T01:33:56.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f640ca050 con 0x7f4f64154480 2023-11-15T01:33:56.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1419973960 0 0) 0x7f4f500033f0 con 0x7f4f640c6650 2023-11-15T01:33:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f641540a0 msgr2=0x7f4f640ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 --2- 172.21.15.1:0/3558856315 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f641540a0 0x7f4f640ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 >> v1:172.21.15.141:6789/0 conn(0x7f4f64154480 legacy=0x7f4f640c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f640c9a00 con 0x7f4f640c6650 2023-11-15T01:33:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f4f4c001470 con 0x7f4f640c6650 2023-11-15T01:33:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f68c5c700 1 --2- 172.21.15.1:0/3558856315 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f641540a0 0x7f4f640ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 >> v1:172.21.15.1:6789/0 conn(0x7f4f640c6650 legacy=0x7f4f640aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 --2- 172.21.15.1:0/3558856315 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f50003aa0 0x7f4f50003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 --2- 172.21.15.1:0/3558856315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f50004690 0x7f4f50004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 --2- 172.21.15.1:0/3558856315 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f641540a0 0x7f4f50005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640c9720 con 0x7f4f50004690 2023-11-15T01:33:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5000b8e0 con 0x7f4f50003aa0 2023-11-15T01:33:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.615+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5000ba70 con 0x7f4f641540a0 2023-11-15T01:33:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.616+0000 7f4f63fff700 1 --2- 172.21.15.1:0/3558856315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f50004690 0x7f4f50004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.616+0000 7f4f68c5c700 1 --2- 172.21.15.1:0/3558856315 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f50003aa0 0x7f4f50003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.616+0000 7f4f6945d700 1 --2- 172.21.15.1:0/3558856315 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f641540a0 0x7f4f50005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.616+0000 7f4f63fff700 1 -- 172.21.15.1:0/3558856315 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f641540a0 msgr2=0x7f4f50005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.616+0000 7f4f63fff700 1 --2- 172.21.15.1:0/3558856315 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f641540a0 0x7f4f50005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.616+0000 7f4f63fff700 1 -- 172.21.15.1:0/3558856315 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f50003aa0 msgr2=0x7f4f50003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.616+0000 7f4f63fff700 1 --2- 172.21.15.1:0/3558856315 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f50003aa0 0x7f4f50003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.616+0000 7f4f63fff700 1 -- 172.21.15.1:0/3558856315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0092a0 con 0x7f4f50004690 2023-11-15T01:33:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.616+0000 7f4f63fff700 1 --2- 172.21.15.1:0/3558856315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f50004690 0x7f4f50004b10 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f4f54001f60 tx=0x7f4f54007f30).ready entity=mon.0 client_cookie=ec8ae32df269fa11 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.616+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f540020c0 con 0x7f4f50004690 2023-11-15T01:33:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.616+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f54006a20 con 0x7f4f50004690 2023-11-15T01:33:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.616+0000 7f4f637fe700 1 -- 172.21.15.1:0/3558856315 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54006dc0 con 0x7f4f50004690 2023-11-15T01:33:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.617+0000 7f4f6aec0700 1 -- 172.21.15.1:0/3558856315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f50004690 msgr2=0x7f4f50004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.617+0000 7f4f6aec0700 1 --2- 172.21.15.1:0/3558856315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f50004690 0x7f4f50004b10 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f4f54001f60 tx=0x7f4f54007f30).stop 2023-11-15T01:33:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.617+0000 7f4f6945d700 1 -- 172.21.15.1:0/3558856315 reap_dead start 2023-11-15T01:33:56.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.617+0000 7f4f6aec0700 1 -- 172.21.15.1:0/3558856315 shutdown_connections 2023-11-15T01:33:56.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.617+0000 7f4f6aec0700 1 -- 172.21.15.1:0/3558856315 >> 172.21.15.1:0/3558856315 conn(0x7f4f64064a70 msgr2=0x7f4f64064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:56.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.617+0000 7f4f6aec0700 1 -- 172.21.15.1:0/3558856315 shutdown_connections 2023-11-15T01:33:56.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.617+0000 7f4f6aec0700 1 -- 172.21.15.1:0/3558856315 wait complete. 2023-11-15T01:33:56.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.618+0000 7f4f6aec0700 1 Processor -- start 2023-11-15T01:33:56.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.618+0000 7f4f6aec0700 1 -- start start 2023-11-15T01:33:56.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f6aec0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f50004690 0x7f4f64157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:56.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f6aec0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f641595b0 0x7f4f640affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:56.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f6aec0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f64159a30 0x7f4f640b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:56.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f6aec0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640afb60 con 0x7f4f50004690 2023-11-15T01:33:56.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f6aec0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640b09a0 con 0x7f4f64159a30 2023-11-15T01:33:56.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f6aec0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640c2c40 con 0x7f4f641595b0 2023-11-15T01:33:56.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f68c5c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f50004690 0x7f4f64157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:56.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f68c5c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f50004690 0x7f4f64157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48884/0 (socket says 172.21.15.1:48884) 2023-11-15T01:33:56.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f68c5c700 1 -- 172.21.15.1:0/1643097485 learned_addr learned my addr 172.21.15.1:0/1643097485 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:56.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f63fff700 1 --2- 172.21.15.1:0/1643097485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f641595b0 0x7f4f640affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:56.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f6945d700 1 --2- 172.21.15.1:0/1643097485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f64159a30 0x7f4f640b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:56.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f68c5c700 1 -- 172.21.15.1:0/1643097485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f641595b0 msgr2=0x7f4f640affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:56.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f68c5c700 1 --2- 172.21.15.1:0/1643097485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f641595b0 0x7f4f640affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:56.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f68c5c700 1 -- 172.21.15.1:0/1643097485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f64159a30 msgr2=0x7f4f640b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:56.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f68c5c700 1 --2- 172.21.15.1:0/1643097485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f64159a30 0x7f4f640b04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:56.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f68c5c700 1 -- 172.21.15.1:0/1643097485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f640c2310 con 0x7f4f50004690 2023-11-15T01:33:56.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f63fff700 1 --2- 172.21.15.1:0/1643097485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f641595b0 0x7f4f640affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:56.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f68c5c700 1 --2- 172.21.15.1:0/1643097485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f50004690 0x7f4f64157750 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f4f5c011d40 tx=0x7f4f5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:56.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f60ff9700 1 -- 172.21.15.1:0/1643097485 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c00fac0 con 0x7f4f50004690 2023-11-15T01:33:56.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f60ff9700 1 -- 172.21.15.1:0/1643097485 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c00fc20 con 0x7f4f50004690 2023-11-15T01:33:56.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.619+0000 7f4f6aec0700 1 -- 172.21.15.1:0/1643097485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f640c25f0 con 0x7f4f50004690 2023-11-15T01:33:56.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.620+0000 7f4f60ff9700 1 -- 172.21.15.1:0/1643097485 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c014440 con 0x7f4f50004690 2023-11-15T01:33:56.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.620+0000 7f4f6aec0700 1 -- 172.21.15.1:0/1643097485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f64157c40 con 0x7f4f50004690 2023-11-15T01:33:56.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.621+0000 7f4f6aec0700 1 -- 172.21.15.1:0/1643097485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6406c7e0 con 0x7f4f50004690 2023-11-15T01:33:56.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.621+0000 7f4f60ff9700 1 -- 172.21.15.1:0/1643097485 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4f5c014a40 con 0x7f4f50004690 2023-11-15T01:33:56.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.621+0000 7f4f60ff9700 1 --2- 172.21.15.1:0/1643097485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f4405f270 0x7f4f44061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:56.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.621+0000 7f4f60ff9700 1 -- 172.21.15.1:0/1643097485 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f4f5c07b440 con 0x7f4f50004690 2023-11-15T01:33:56.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.622+0000 7f4f63fff700 1 --2- 172.21.15.1:0/1643097485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f4405f270 0x7f4f44061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:56.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.622+0000 7f4f63fff700 1 --2- 172.21.15.1:0/1643097485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f4405f270 0x7f4f44061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f4f640b1250 tx=0x7f4f54016000).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:56.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.626+0000 7f4f60ff9700 1 -- 172.21.15.1:0/1643097485 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4f5c04c460 con 0x7f4f50004690 2023-11-15T01:33:56.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.846+0000 7f4f6aec0700 1 -- 172.21.15.1:0/1643097485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4f640c9ce0 con 0x7f4f50004690 2023-11-15T01:33:56.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.851+0000 7f4f60ff9700 1 -- 172.21.15.1:0/1643097485 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v19) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4f5c0180c0 con 0x7f4f50004690 2023-11-15T01:33:56.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.862+0000 7f4f6aec0700 1 -- 172.21.15.1:0/1643097485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f4405f270 msgr2=0x7f4f44061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:56.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.862+0000 7f4f6aec0700 1 --2- 172.21.15.1:0/1643097485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f4405f270 0x7f4f44061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f4f640b1250 tx=0x7f4f54016000).stop 2023-11-15T01:33:56.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.862+0000 7f4f6aec0700 1 -- 172.21.15.1:0/1643097485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f50004690 msgr2=0x7f4f64157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:56.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.862+0000 7f4f6aec0700 1 --2- 172.21.15.1:0/1643097485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f50004690 0x7f4f64157750 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f4f5c011d40 tx=0x7f4f5c009060).stop 2023-11-15T01:33:56.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.864+0000 7f4f6aec0700 1 -- 172.21.15.1:0/1643097485 shutdown_connections 2023-11-15T01:33:56.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.864+0000 7f4f6aec0700 1 --2- 172.21.15.1:0/1643097485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f4405f270 0x7f4f44061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:56.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.864+0000 7f4f6aec0700 1 --2- 172.21.15.1:0/1643097485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f64159a30 0x7f4f640b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:56.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.864+0000 7f4f6aec0700 1 --2- 172.21.15.1:0/1643097485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f50004690 0x7f4f64157750 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:56.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.864+0000 7f4f6aec0700 1 --2- 172.21.15.1:0/1643097485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f641595b0 0x7f4f640affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:56.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.864+0000 7f4f6aec0700 1 -- 172.21.15.1:0/1643097485 >> 172.21.15.1:0/1643097485 conn(0x7f4f64064a70 msgr2=0x7f4f640ab6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:56.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.867+0000 7f4f6aec0700 1 -- 172.21.15.1:0/1643097485 shutdown_connections 2023-11-15T01:33:56.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:56.867+0000 7f4f6aec0700 1 -- 172.21.15.1:0/1643097485 wait complete. 2023-11-15T01:33:56.877 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 7 and data pool 8 2023-11-15T01:33:56.887 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:33:57.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.003+0000 7f13d723e700 1 Processor -- start 2023-11-15T01:33:57.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.004+0000 7f13d723e700 1 -- start start 2023-11-15T01:33:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.004+0000 7f13d723e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13d0154150 0x7f13d0154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.004+0000 7f13d723e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f13d00ab1a0 0x7f13d0158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.004+0000 7f13d723e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d00c06f0 con 0x7f13d00aa060 2023-11-15T01:33:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.004+0000 7f13d723e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d00c09d0 con 0x7f13d0154150 2023-11-15T01:33:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.004+0000 7f13d723e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d0158820 con 0x7f13d00ab1a0 2023-11-15T01:33:57.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.005+0000 7f13d4fda700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13d0154150 0x7f13d0154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.005+0000 7f13d4fda700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13d0154150 0x7f13d0154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48886/0 (socket says 172.21.15.1:48886) 2023-11-15T01:33:57.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.005+0000 7f13d4fda700 1 -- 172.21.15.1:0/477149347 learned_addr learned my addr 172.21.15.1:0/477149347 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:57.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.005+0000 7f13cffff700 1 --2- 172.21.15.1:0/477149347 >> v2:172.21.15.141:3300/0 conn(0x7f13d00ab1a0 0x7f13d0158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.005+0000 7f13d4fda700 1 -- 172.21.15.1:0/477149347 >> v2:172.21.15.141:3300/0 conn(0x7f13d00ab1a0 msgr2=0x7f13d0158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:57.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.005+0000 7f13d4fda700 1 --2- 172.21.15.1:0/477149347 >> v2:172.21.15.141:3300/0 conn(0x7f13d00ab1a0 0x7f13d0158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.005+0000 7f13d4fda700 1 -- 172.21.15.1:0/477149347 >> v1:172.21.15.141:6789/0 conn(0x7f13d00aa060 legacy=0x7f13d00c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.005+0000 7f13d4fda700 1 -- 172.21.15.1:0/477149347 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d0158b00 con 0x7f13d0154150 2023-11-15T01:33:57.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.005+0000 7f13d4fda700 1 --2- 172.21.15.1:0/477149347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13d0154150 0x7f13d0154530 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f13d00c0270 tx=0x7f13c80090f0).ready entity=mon.0 client_cookie=74f6507fda668538 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:57.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.005+0000 7f13cf7fe700 1 -- 172.21.15.1:0/477149347 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c800b520 con 0x7f13d0154150 2023-11-15T01:33:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.005+0000 7f13cf7fe700 1 -- 172.21.15.1:0/477149347 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c800b680 con 0x7f13d0154150 2023-11-15T01:33:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.005+0000 7f13cf7fe700 1 -- 172.21.15.1:0/477149347 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c800ba20 con 0x7f13d0154150 2023-11-15T01:33:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.006+0000 7f13d723e700 1 -- 172.21.15.1:0/477149347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13d0154150 msgr2=0x7f13d0154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.006+0000 7f13d723e700 1 --2- 172.21.15.1:0/477149347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13d0154150 0x7f13d0154530 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f13d00c0270 tx=0x7f13c80090f0).stop 2023-11-15T01:33:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.006+0000 7f13d723e700 1 -- 172.21.15.1:0/477149347 shutdown_connections 2023-11-15T01:33:57.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.006+0000 7f13d723e700 1 --2- 172.21.15.1:0/477149347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13d0154150 0x7f13d0154530 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.006+0000 7f13d723e700 1 --2- 172.21.15.1:0/477149347 >> v2:172.21.15.141:3300/0 conn(0x7f13d00ab1a0 0x7f13d0158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.006+0000 7f13d723e700 1 -- 172.21.15.1:0/477149347 >> 172.21.15.1:0/477149347 conn(0x7f13d0064aa0 msgr2=0x7f13d0064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:57.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.006+0000 7f13d723e700 1 -- 172.21.15.1:0/477149347 shutdown_connections 2023-11-15T01:33:57.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.006+0000 7f13d723e700 1 -- 172.21.15.1:0/477149347 wait complete. 2023-11-15T01:33:57.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.007+0000 7f13d723e700 1 Processor -- start 2023-11-15T01:33:57.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.007+0000 7f13d723e700 1 -- start start 2023-11-15T01:33:57.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13d723e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13d00aa060 0x7f13d00ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13d723e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13d00ab1a0 0x7f13d014ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13d723e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13d0154150 0x7f13d00afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13d723e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00aeae0 con 0x7f13d00ab1a0 2023-11-15T01:33:57.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13d723e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00aedc0 con 0x7f13d0154150 2023-11-15T01:33:57.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13d723e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00af0a0 con 0x7f13d00aa060 2023-11-15T01:33:57.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13cffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13d00ab1a0 0x7f13d014ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13cffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13d00ab1a0 0x7f13d014ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48900/0 (socket says 172.21.15.1:48900) 2023-11-15T01:33:57.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13cffff700 1 -- 172.21.15.1:0/686076773 learned_addr learned my addr 172.21.15.1:0/686076773 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:57.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13d4fda700 1 --2- 172.21.15.1:0/686076773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13d00aa060 0x7f13d00ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13d57db700 1 --2- 172.21.15.1:0/686076773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13d0154150 0x7f13d00afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13cffff700 1 -- 172.21.15.1:0/686076773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13d00aa060 msgr2=0x7f13d00ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13cffff700 1 --2- 172.21.15.1:0/686076773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13d00aa060 0x7f13d00ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13cffff700 1 -- 172.21.15.1:0/686076773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13d0154150 msgr2=0x7f13d00afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13cffff700 1 --2- 172.21.15.1:0/686076773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13d0154150 0x7f13d00afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13cffff700 1 -- 172.21.15.1:0/686076773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c8009370 con 0x7f13d00ab1a0 2023-11-15T01:33:57.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13d4fda700 1 --2- 172.21.15.1:0/686076773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13d00aa060 0x7f13d00ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:33:57.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.008+0000 7f13cffff700 1 --2- 172.21.15.1:0/686076773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13d00ab1a0 0x7f13d014ece0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f13c0009ef0 tx=0x7f13c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:57.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.009+0000 7f13ccff9700 1 -- 172.21.15.1:0/686076773 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c000cb70 con 0x7f13d00ab1a0 2023-11-15T01:33:57.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.009+0000 7f13ccff9700 1 -- 172.21.15.1:0/686076773 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c000f040 con 0x7f13d00ab1a0 2023-11-15T01:33:57.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.009+0000 7f13d723e700 1 -- 172.21.15.1:0/686076773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d00af380 con 0x7f13d00ab1a0 2023-11-15T01:33:57.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.009+0000 7f13ccff9700 1 -- 172.21.15.1:0/686076773 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c0013400 con 0x7f13d00ab1a0 2023-11-15T01:33:57.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.009+0000 7f13d723e700 1 -- 172.21.15.1:0/686076773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d014f1d0 con 0x7f13d00ab1a0 2023-11-15T01:33:57.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.010+0000 7f13d723e700 1 -- 172.21.15.1:0/686076773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d006c7e0 con 0x7f13d00ab1a0 2023-11-15T01:33:57.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.010+0000 7f13ccff9700 1 -- 172.21.15.1:0/686076773 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f13c0013770 con 0x7f13d00ab1a0 2023-11-15T01:33:57.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.010+0000 7f13ccff9700 1 --2- 172.21.15.1:0/686076773 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f270 0x7f13b0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.010+0000 7f13ccff9700 1 -- 172.21.15.1:0/686076773 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f13c007ad40 con 0x7f13d00ab1a0 2023-11-15T01:33:57.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.011+0000 7f13d4fda700 1 --2- 172.21.15.1:0/686076773 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f270 0x7f13b0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.011+0000 7f13d4fda700 1 --2- 172.21.15.1:0/686076773 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f270 0x7f13b0061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f13c800b2e0 tx=0x7f13c8017000).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:57.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.015+0000 7f13ccff9700 1 -- 172.21.15.1:0/686076773 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f13c007e030 con 0x7f13d00ab1a0 2023-11-15T01:33:57.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.188+0000 7f13d723e700 1 -- 172.21.15.1:0/686076773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13d00c02a0 con 0x7f13d00ab1a0 2023-11-15T01:33:57.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.189+0000 7f13ccff9700 1 -- 172.21.15.1:0/686076773 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+17493 (secure 0 0 0) 0x7f13c004bd00 con 0x7f13d00ab1a0 2023-11-15T01:33:57.191 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:57.191 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":60,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:33:56.847791+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:33:54.494299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-15T01:33:55.821335+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:33:57.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.191+0000 7f13d723e700 1 -- 172.21.15.1:0/686076773 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f270 msgr2=0x7f13b0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.191+0000 7f13d723e700 1 --2- 172.21.15.1:0/686076773 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f270 0x7f13b0061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f13c800b2e0 tx=0x7f13c8017000).stop 2023-11-15T01:33:57.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.191+0000 7f13d723e700 1 -- 172.21.15.1:0/686076773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13d00ab1a0 msgr2=0x7f13d014ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.191+0000 7f13d723e700 1 --2- 172.21.15.1:0/686076773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13d00ab1a0 0x7f13d014ece0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f13c0009ef0 tx=0x7f13c000b040).stop 2023-11-15T01:33:57.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.191+0000 7f13d723e700 1 -- 172.21.15.1:0/686076773 shutdown_connections 2023-11-15T01:33:57.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.191+0000 7f13d723e700 1 --2- 172.21.15.1:0/686076773 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f270 0x7f13b0061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.191+0000 7f13d723e700 1 --2- 172.21.15.1:0/686076773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13d0154150 0x7f13d00afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.191+0000 7f13d723e700 1 --2- 172.21.15.1:0/686076773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13d00aa060 0x7f13d00ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.191+0000 7f13d723e700 1 --2- 172.21.15.1:0/686076773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13d00ab1a0 0x7f13d014ece0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.191+0000 7f13d723e700 1 -- 172.21.15.1:0/686076773 >> 172.21.15.1:0/686076773 conn(0x7f13d0064aa0 msgr2=0x7f13d00ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:57.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.192+0000 7f13d723e700 1 -- 172.21.15.1:0/686076773 shutdown_connections 2023-11-15T01:33:57.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.192+0000 7f13d723e700 1 -- 172.21.15.1:0/686076773 wait complete. 2023-11-15T01:33:57.205 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:33:57.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.322+0000 7f53924dc700 1 Processor -- start 2023-11-15T01:33:57.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.323+0000 7f53924dc700 1 -- start start 2023-11-15T01:33:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.323+0000 7f53924dc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f538c154150 0x7f538c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.323+0000 7f53924dc700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f538c0ab1a0 0x7f538c158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.323+0000 7f53924dc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f538c0aa060 0x7f538c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.323+0000 7f53924dc700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538c0c06f0 con 0x7f538c0aa060 2023-11-15T01:33:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.323+0000 7f53924dc700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538c0c09d0 con 0x7f538c0ab1a0 2023-11-15T01:33:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.323+0000 7f53924dc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c158820 con 0x7f538c154150 2023-11-15T01:33:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.323+0000 7f5390a79700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f538c0aa060 0x7f538c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.324+0000 7f5390a79700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f538c0aa060 0x7f538c0c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48908/0 (socket says 172.21.15.1:48908) 2023-11-15T01:33:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.324+0000 7f5390a79700 1 -- 172.21.15.1:0/2394182437 learned_addr learned my addr 172.21.15.1:0/2394182437 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.324+0000 7f538bfff700 1 --2- 172.21.15.1:0/2394182437 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f538c154150 0x7f538c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.324+0000 7f538b7fe700 1 --2- 172.21.15.1:0/2394182437 >> v2:172.21.15.141:3300/0 conn(0x7f538c0ab1a0 0x7f538c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.324+0000 7f5390a79700 1 -- 172.21.15.1:0/2394182437 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f538c154150 msgr2=0x7f538c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.324+0000 7f5390a79700 1 --2- 172.21.15.1:0/2394182437 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f538c154150 0x7f538c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.324+0000 7f5390a79700 1 -- 172.21.15.1:0/2394182437 >> v2:172.21.15.141:3300/0 conn(0x7f538c0ab1a0 msgr2=0x7f538c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.324+0000 7f5390a79700 1 --2- 172.21.15.1:0/2394182437 >> v2:172.21.15.141:3300/0 conn(0x7f538c0ab1a0 0x7f538c158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.324+0000 7f5390a79700 1 -- 172.21.15.1:0/2394182437 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c158b00 con 0x7f538c0aa060 2023-11-15T01:33:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.324+0000 7f538bfff700 1 --2- 172.21.15.1:0/2394182437 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f538c154150 0x7f538c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.324+0000 7f538b7fe700 1 --2- 172.21.15.1:0/2394182437 >> v2:172.21.15.141:3300/0 conn(0x7f538c0ab1a0 0x7f538c158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:33:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.324+0000 7f5390a79700 1 --2- 172.21.15.1:0/2394182437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f538c0aa060 0x7f538c0c5f10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f538c0cc110 tx=0x7f5384009840).ready entity=mon.0 client_cookie=96dd56dedf7471f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.324+0000 7f538affd700 1 -- 172.21.15.1:0/2394182437 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538400e070 con 0x7f538c0aa060 2023-11-15T01:33:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.324+0000 7f538affd700 1 -- 172.21.15.1:0/2394182437 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538400ba50 con 0x7f538c0aa060 2023-11-15T01:33:57.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.324+0000 7f538affd700 1 -- 172.21.15.1:0/2394182437 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538400bdd0 con 0x7f538c0aa060 2023-11-15T01:33:57.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.325+0000 7f53924dc700 1 -- 172.21.15.1:0/2394182437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f538c0aa060 msgr2=0x7f538c0c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.325+0000 7f53924dc700 1 --2- 172.21.15.1:0/2394182437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f538c0aa060 0x7f538c0c5f10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f538c0cc110 tx=0x7f5384009840).stop 2023-11-15T01:33:57.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.325+0000 7f53924dc700 1 -- 172.21.15.1:0/2394182437 shutdown_connections 2023-11-15T01:33:57.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.325+0000 7f53924dc700 1 --2- 172.21.15.1:0/2394182437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f538c0aa060 0x7f538c0c5f10 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.325+0000 7f53924dc700 1 --2- 172.21.15.1:0/2394182437 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f538c154150 0x7f538c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.325+0000 7f53924dc700 1 --2- 172.21.15.1:0/2394182437 >> v2:172.21.15.141:3300/0 conn(0x7f538c0ab1a0 0x7f538c158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.325+0000 7f53924dc700 1 -- 172.21.15.1:0/2394182437 >> 172.21.15.1:0/2394182437 conn(0x7f538c064aa0 msgr2=0x7f538c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:57.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.325+0000 7f53924dc700 1 -- 172.21.15.1:0/2394182437 shutdown_connections 2023-11-15T01:33:57.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.325+0000 7f53924dc700 1 -- 172.21.15.1:0/2394182437 wait complete. 2023-11-15T01:33:57.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.326+0000 7f53924dc700 1 Processor -- start 2023-11-15T01:33:57.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.326+0000 7f53924dc700 1 -- start start 2023-11-15T01:33:57.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f53924dc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f538c0aa060 0x7f538c145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f53924dc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f538c0ab1a0 0x7f538c0cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f53924dc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f538c154150 0x7f538c156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f53924dc700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c146330 con 0x7f538c0aa060 2023-11-15T01:33:57.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f53924dc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c0cb750 con 0x7f538c154150 2023-11-15T01:33:57.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f53924dc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c0ca350 con 0x7f538c0ab1a0 2023-11-15T01:33:57.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f538bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f538c0aa060 0x7f538c145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f538bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f538c0aa060 0x7f538c145e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48918/0 (socket says 172.21.15.1:48918) 2023-11-15T01:33:57.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f538bfff700 1 -- 172.21.15.1:0/363875883 learned_addr learned my addr 172.21.15.1:0/363875883 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:57.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f538b7fe700 1 --2- 172.21.15.1:0/363875883 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f538c0ab1a0 0x7f538c0cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f5390a79700 1 --2- 172.21.15.1:0/363875883 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f538c154150 0x7f538c156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f538bfff700 1 -- 172.21.15.1:0/363875883 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f538c0ab1a0 msgr2=0x7f538c0cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f538bfff700 1 --2- 172.21.15.1:0/363875883 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f538c0ab1a0 0x7f538c0cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f538bfff700 1 -- 172.21.15.1:0/363875883 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f538c154150 msgr2=0x7f538c156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f538bfff700 1 --2- 172.21.15.1:0/363875883 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f538c154150 0x7f538c156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f538bfff700 1 -- 172.21.15.1:0/363875883 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5384009ae0 con 0x7f538c0aa060 2023-11-15T01:33:57.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f538bfff700 1 --2- 172.21.15.1:0/363875883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f538c0aa060 0x7f538c145e40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f537400d890 tx=0x7f5374008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:57.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.327+0000 7f5383fff700 1 -- 172.21.15.1:0/363875883 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374011590 con 0x7f538c0aa060 2023-11-15T01:33:57.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.328+0000 7f5383fff700 1 -- 172.21.15.1:0/363875883 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53740116f0 con 0x7f538c0aa060 2023-11-15T01:33:57.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.328+0000 7f53924dc700 1 -- 172.21.15.1:0/363875883 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538c157240 con 0x7f538c0aa060 2023-11-15T01:33:57.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.328+0000 7f5383fff700 1 -- 172.21.15.1:0/363875883 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374011a70 con 0x7f538c0aa060 2023-11-15T01:33:57.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.328+0000 7f53924dc700 1 -- 172.21.15.1:0/363875883 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538c0c9a40 con 0x7f538c0aa060 2023-11-15T01:33:57.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.329+0000 7f53924dc700 1 -- 172.21.15.1:0/363875883 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538c0ca630 con 0x7f538c0aa060 2023-11-15T01:33:57.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.329+0000 7f5383fff700 1 -- 172.21.15.1:0/363875883 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5374012420 con 0x7f538c0aa060 2023-11-15T01:33:57.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.329+0000 7f5383fff700 1 --2- 172.21.15.1:0/363875883 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f536c05f270 0x7f536c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.329+0000 7f5383fff700 1 -- 172.21.15.1:0/363875883 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f5374079e50 con 0x7f538c0aa060 2023-11-15T01:33:57.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.329+0000 7f538b7fe700 1 --2- 172.21.15.1:0/363875883 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f536c05f270 0x7f536c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.330+0000 7f538b7fe700 1 --2- 172.21.15.1:0/363875883 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f536c05f270 0x7f536c061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f538c060950 tx=0x7f537c008040).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:57.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.333+0000 7f5383fff700 1 -- 172.21.15.1:0/363875883 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f537404adb0 con 0x7f538c0aa060 2023-11-15T01:33:57.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.508+0000 7f53924dc700 1 -- 172.21.15.1:0/363875883 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f538c158de0 con 0x7f538c0aa060 2023-11-15T01:33:57.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.508+0000 7f5383fff700 1 -- 172.21.15.1:0/363875883 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+17493 (secure 0 0 0) 0x7f537404e3d0 con 0x7f538c0aa060 2023-11-15T01:33:57.511 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:33:57.511 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":60,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:33:56.847791+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:33:54.494299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-15T01:33:55.821335+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:33:57.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.510+0000 7f53924dc700 1 -- 172.21.15.1:0/363875883 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f536c05f270 msgr2=0x7f536c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.510+0000 7f53924dc700 1 --2- 172.21.15.1:0/363875883 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f536c05f270 0x7f536c061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f538c060950 tx=0x7f537c008040).stop 2023-11-15T01:33:57.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.510+0000 7f53924dc700 1 -- 172.21.15.1:0/363875883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f538c0aa060 msgr2=0x7f538c145e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.510+0000 7f53924dc700 1 --2- 172.21.15.1:0/363875883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f538c0aa060 0x7f538c145e40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f537400d890 tx=0x7f5374008040).stop 2023-11-15T01:33:57.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.510+0000 7f53924dc700 1 -- 172.21.15.1:0/363875883 shutdown_connections 2023-11-15T01:33:57.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.510+0000 7f53924dc700 1 --2- 172.21.15.1:0/363875883 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f536c05f270 0x7f536c061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.510+0000 7f53924dc700 1 --2- 172.21.15.1:0/363875883 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f538c154150 0x7f538c156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.510+0000 7f53924dc700 1 --2- 172.21.15.1:0/363875883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f538c0aa060 0x7f538c145e40 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.510+0000 7f53924dc700 1 --2- 172.21.15.1:0/363875883 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f538c0ab1a0 0x7f538c0cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.510+0000 7f53924dc700 1 -- 172.21.15.1:0/363875883 >> 172.21.15.1:0/363875883 conn(0x7f538c064aa0 msgr2=0x7f538c14fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:57.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.510+0000 7f53924dc700 1 -- 172.21.15.1:0/363875883 shutdown_connections 2023-11-15T01:33:57.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.510+0000 7f53924dc700 1 -- 172.21.15.1:0/363875883 wait complete. 2023-11-15T01:33:57.524 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-15T01:33:57.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.644+0000 7f4f09eac700 1 Processor -- start 2023-11-15T01:33:57.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.644+0000 7f4f09eac700 1 -- start start 2023-11-15T01:33:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.645+0000 7f4f09eac700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f041540a0 0x7f4f040ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.645+0000 7f4f09eac700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f040ca050 con 0x7f4f040c6650 2023-11-15T01:33:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.645+0000 7f4f09eac700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f040c9440 con 0x7f4f04154480 2023-11-15T01:33:57.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.645+0000 7f4f09eac700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f040c9720 con 0x7f4f041540a0 2023-11-15T01:33:57.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.645+0000 7f4f03fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4f040c6650 0x7f4f040aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58790/0 (socket says 172.21.15.1:58790) 2023-11-15T01:33:57.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.645+0000 7f4f03fff700 1 -- 172.21.15.1:0/3138390805 learned_addr learned my addr 172.21.15.1:0/3138390805 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:33:57.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f037fe700 1 --2- 172.21.15.1:0/3138390805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f041540a0 0x7f4f040ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f027fc700 1 -- 172.21.15.1:0/3138390805 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064385814 0 0) 0x7f4f040ca050 con 0x7f4f040c6650 2023-11-15T01:33:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f027fc700 1 -- 172.21.15.1:0/3138390805 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef00033f0 con 0x7f4f040c6650 2023-11-15T01:33:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f027fc700 1 -- 172.21.15.1:0/3138390805 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3168534856 0 0) 0x7f4ef00033f0 con 0x7f4f040c6650 2023-11-15T01:33:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f027fc700 1 -- 172.21.15.1:0/3138390805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f041540a0 msgr2=0x7f4f040ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f027fc700 1 --2- 172.21.15.1:0/3138390805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f041540a0 0x7f4f040ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f027fc700 1 -- 172.21.15.1:0/3138390805 >> v1:172.21.15.141:6789/0 conn(0x7f4f04154480 legacy=0x7f4f040c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f027fc700 1 -- 172.21.15.1:0/3138390805 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f040c9a00 con 0x7f4f040c6650 2023-11-15T01:33:57.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f027fc700 1 -- 172.21.15.1:0/3138390805 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f4ef4001470 con 0x7f4f040c6650 2023-11-15T01:33:57.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f027fc700 1 -- 172.21.15.1:0/3138390805 >> v1:172.21.15.1:6789/0 conn(0x7f4f040c6650 legacy=0x7f4f040aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f027fc700 1 --2- 172.21.15.1:0/3138390805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ef0003910 0x7f4ef0003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f027fc700 1 --2- 172.21.15.1:0/3138390805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ef0004220 0x7f4ef00046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f027fc700 1 --2- 172.21.15.1:0/3138390805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f041540a0 0x7f4ef0004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f027fc700 1 -- 172.21.15.1:0/3138390805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f040c9720 con 0x7f4ef0004220 2023-11-15T01:33:57.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f027fc700 1 -- 172.21.15.1:0/3138390805 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef000b8e0 con 0x7f4ef0003910 2023-11-15T01:33:57.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f027fc700 1 -- 172.21.15.1:0/3138390805 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef000ba20 con 0x7f4f041540a0 2023-11-15T01:33:57.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f02ffd700 1 --2- 172.21.15.1:0/3138390805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ef0004220 0x7f4ef00046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f037fe700 1 --2- 172.21.15.1:0/3138390805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ef0003910 0x7f4ef0003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.646+0000 7f4f03fff700 1 --2- 172.21.15.1:0/3138390805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f041540a0 0x7f4ef0004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f02ffd700 1 -- 172.21.15.1:0/3138390805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f041540a0 msgr2=0x7f4ef0004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:57.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f02ffd700 1 --2- 172.21.15.1:0/3138390805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f041540a0 0x7f4ef0004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f02ffd700 1 -- 172.21.15.1:0/3138390805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ef0003910 msgr2=0x7f4ef0003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:57.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f02ffd700 1 --2- 172.21.15.1:0/3138390805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ef0003910 0x7f4ef0003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f02ffd700 1 -- 172.21.15.1:0/3138390805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef00033f0 con 0x7f4ef0004220 2023-11-15T01:33:57.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f02ffd700 1 --2- 172.21.15.1:0/3138390805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ef0004220 0x7f4ef00046d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f4eec0017f0 tx=0x7f4eec007b90).ready entity=mon.0 client_cookie=15b11847649df312 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:57.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f027fc700 1 -- 172.21.15.1:0/3138390805 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec007ea0 con 0x7f4ef0004220 2023-11-15T01:33:57.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f027fc700 1 -- 172.21.15.1:0/3138390805 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec012400 con 0x7f4ef0004220 2023-11-15T01:33:57.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f027fc700 1 -- 172.21.15.1:0/3138390805 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec012780 con 0x7f4ef0004220 2023-11-15T01:33:57.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f09eac700 1 -- 172.21.15.1:0/3138390805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ef0004220 msgr2=0x7f4ef00046d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f09eac700 1 --2- 172.21.15.1:0/3138390805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ef0004220 0x7f4ef00046d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f4eec0017f0 tx=0x7f4eec007b90).stop 2023-11-15T01:33:57.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f03fff700 1 -- 172.21.15.1:0/3138390805 reap_dead start 2023-11-15T01:33:57.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f09eac700 1 -- 172.21.15.1:0/3138390805 shutdown_connections 2023-11-15T01:33:57.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f09eac700 1 -- 172.21.15.1:0/3138390805 >> 172.21.15.1:0/3138390805 conn(0x7f4f04064a70 msgr2=0x7f4f04064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f09eac700 1 -- 172.21.15.1:0/3138390805 shutdown_connections 2023-11-15T01:33:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.647+0000 7f4f09eac700 1 -- 172.21.15.1:0/3138390805 wait complete. 2023-11-15T01:33:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.649+0000 7f4f09eac700 1 Processor -- start 2023-11-15T01:33:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.649+0000 7f4f09eac700 1 -- start start 2023-11-15T01:33:57.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.649+0000 7f4f09eac700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ef0004220 0x7f4f041642c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.649+0000 7f4f09eac700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f04158c70 0x7f4f04141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.649+0000 7f4f09eac700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f041569f0 0x7f4f040c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.649+0000 7f4f09eac700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f041647b0 con 0x7f4ef0004220 2023-11-15T01:33:57.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.649+0000 7f4f09eac700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f04165260 con 0x7f4f04158c70 2023-11-15T01:33:57.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.649+0000 7f4f09eac700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f040c0680 con 0x7f4f041569f0 2023-11-15T01:33:57.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4f037fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ef0004220 0x7f4f041642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4f037fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ef0004220 0x7f4f041642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50112/0 (socket says 172.21.15.1:50112) 2023-11-15T01:33:57.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4f037fe700 1 -- 172.21.15.1:0/636234006 learned_addr learned my addr 172.21.15.1:0/636234006 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:57.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4f02ffd700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f04158c70 0x7f4f04141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4f03fff700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f041569f0 0x7f4f040c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4f037fe700 1 -- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f041569f0 msgr2=0x7f4f040c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4f037fe700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f041569f0 0x7f4f040c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4f037fe700 1 -- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f04158c70 msgr2=0x7f4f04141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:57.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4f037fe700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f04158c70 0x7f4f04141ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:57.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4f037fe700 1 -- 172.21.15.1:0/636234006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f041590f0 con 0x7f4ef0004220 2023-11-15T01:33:57.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4f03fff700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f041569f0 0x7f4f040c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:57.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4f02ffd700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f04158c70 0x7f4f04141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:57.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4f037fe700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ef0004220 0x7f4f041642c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f4efc011f80 tx=0x7f4efc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:57.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4efb7fe700 1 -- 172.21.15.1:0/636234006 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc00e040 con 0x7f4ef0004220 2023-11-15T01:33:57.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4efb7fe700 1 -- 172.21.15.1:0/636234006 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc00f040 con 0x7f4ef0004220 2023-11-15T01:33:57.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4f09eac700 1 -- 172.21.15.1:0/636234006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f041649c0 con 0x7f4ef0004220 2023-11-15T01:33:57.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4efb7fe700 1 -- 172.21.15.1:0/636234006 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc009bf0 con 0x7f4ef0004220 2023-11-15T01:33:57.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.650+0000 7f4f09eac700 1 -- 172.21.15.1:0/636234006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f04164f80 con 0x7f4ef0004220 2023-11-15T01:33:57.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.651+0000 7f4f09eac700 1 -- 172.21.15.1:0/636234006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0406c7e0 con 0x7f4ef0004220 2023-11-15T01:33:57.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.651+0000 7f4efb7fe700 1 -- 172.21.15.1:0/636234006 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4efc015660 con 0x7f4ef0004220 2023-11-15T01:33:57.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.652+0000 7f4efb7fe700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4ee405f270 0x7f4ee4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:57.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.652+0000 7f4efb7fe700 1 -- 172.21.15.1:0/636234006 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f4efc07b560 con 0x7f4ef0004220 2023-11-15T01:33:57.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.652+0000 7f4f02ffd700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4ee405f270 0x7f4ee4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:57.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.652+0000 7f4f02ffd700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4ee405f270 0x7f4ee4061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f4eec0015b0 tx=0x7f4eec015000).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:57.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.656+0000 7f4efb7fe700 1 -- 172.21.15.1:0/636234006 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4efc04ff50 con 0x7f4ef0004220 2023-11-15T01:33:57.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:57.876+0000 7f4f09eac700 1 -- 172.21.15.1:0/636234006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4f040c9ce0 con 0x7f4ef0004220 2023-11-15T01:33:58.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:58.858+0000 7f4efb7fe700 1 -- 172.21.15.1:0/636234006 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4efc04fb40 con 0x7f4ef0004220 2023-11-15T01:33:58.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:58.861+0000 7f4f09eac700 1 -- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4ee405f270 msgr2=0x7f4ee4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:58.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:58.861+0000 7f4f09eac700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4ee405f270 0x7f4ee4061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f4eec0015b0 tx=0x7f4eec015000).stop 2023-11-15T01:33:58.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:58.861+0000 7f4f09eac700 1 -- 172.21.15.1:0/636234006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ef0004220 msgr2=0x7f4f041642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:58.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:58.861+0000 7f4f09eac700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ef0004220 0x7f4f041642c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f4efc011f80 tx=0x7f4efc00b040).stop 2023-11-15T01:33:58.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:58.861+0000 7f4f09eac700 1 -- 172.21.15.1:0/636234006 shutdown_connections 2023-11-15T01:33:58.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:58.861+0000 7f4f09eac700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4ee405f270 0x7f4ee4061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:58.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:58.861+0000 7f4f09eac700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f041569f0 0x7f4f040c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:58.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:58.861+0000 7f4f09eac700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ef0004220 0x7f4f041642c0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:58.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:58.861+0000 7f4f09eac700 1 --2- 172.21.15.1:0/636234006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f04158c70 0x7f4f04141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:58.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:58.861+0000 7f4f09eac700 1 -- 172.21.15.1:0/636234006 >> 172.21.15.1:0/636234006 conn(0x7f4f04064a70 msgr2=0x7f4f040ac2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:58.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:58.861+0000 7f4f09eac700 1 -- 172.21.15.1:0/636234006 shutdown_connections 2023-11-15T01:33:58.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:58.861+0000 7f4f09eac700 1 -- 172.21.15.1:0/636234006 wait complete. 2023-11-15T01:33:58.877 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-15T01:33:58.877 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-15T01:33:59.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.003+0000 7f632dc51700 1 Processor -- start 2023-11-15T01:33:59.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.003+0000 7f632dc51700 1 -- start start 2023-11-15T01:33:59.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.004+0000 7f632dc51700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6328062ec0 0x7f632814eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:59.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.004+0000 7f632dc51700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6328155370 0x7f63280c6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:59.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.004+0000 7f632dc51700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6328158e40 con 0x7f632814e6e0 2023-11-15T01:33:59.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.004+0000 7f632dc51700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6328158230 con 0x7f6328062ec0 2023-11-15T01:33:59.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.004+0000 7f632dc51700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6328158510 con 0x7f6328155370 2023-11-15T01:33:59.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.004+0000 7f6326ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6328062ec0 0x7f632814eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:59.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.004+0000 7f6326ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6328062ec0 0x7f632814eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50128/0 (socket says 172.21.15.1:50128) 2023-11-15T01:33:59.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.004+0000 7f6326ffd700 1 -- 172.21.15.1:0/1095704080 learned_addr learned my addr 172.21.15.1:0/1095704080 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:59.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.004+0000 7f6327fff700 1 --2- 172.21.15.1:0/1095704080 >> v2:172.21.15.141:3300/0 conn(0x7f6328155370 0x7f63280c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:59.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.004+0000 7f6326ffd700 1 -- 172.21.15.1:0/1095704080 >> v2:172.21.15.141:3300/0 conn(0x7f6328155370 msgr2=0x7f63280c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:59.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.004+0000 7f6326ffd700 1 --2- 172.21.15.1:0/1095704080 >> v2:172.21.15.141:3300/0 conn(0x7f6328155370 0x7f63280c6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:59.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.004+0000 7f6326ffd700 1 -- 172.21.15.1:0/1095704080 >> v1:172.21.15.141:6789/0 conn(0x7f632814e6e0 legacy=0x7f63280627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:33:59.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.004+0000 7f6326ffd700 1 -- 172.21.15.1:0/1095704080 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63281587f0 con 0x7f6328062ec0 2023-11-15T01:33:59.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.004+0000 7f6326ffd700 1 --2- 172.21.15.1:0/1095704080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6328062ec0 0x7f632814eac0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f632814efb0 tx=0x7f63100090f0).ready entity=mon.0 client_cookie=550f02cac4c60d87 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:59.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.004+0000 7f63267fc700 1 -- 172.21.15.1:0/1095704080 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631000b5a0 con 0x7f6328062ec0 2023-11-15T01:33:59.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.005+0000 7f63267fc700 1 -- 172.21.15.1:0/1095704080 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631000b700 con 0x7f6328062ec0 2023-11-15T01:33:59.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.005+0000 7f63267fc700 1 -- 172.21.15.1:0/1095704080 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631000ba80 con 0x7f6328062ec0 2023-11-15T01:33:59.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.005+0000 7f632dc51700 1 -- 172.21.15.1:0/1095704080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6328062ec0 msgr2=0x7f632814eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:59.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.005+0000 7f632dc51700 1 --2- 172.21.15.1:0/1095704080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6328062ec0 0x7f632814eac0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f632814efb0 tx=0x7f63100090f0).stop 2023-11-15T01:33:59.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.005+0000 7f632dc51700 1 -- 172.21.15.1:0/1095704080 shutdown_connections 2023-11-15T01:33:59.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.005+0000 7f632dc51700 1 --2- 172.21.15.1:0/1095704080 >> v2:172.21.15.141:3300/0 conn(0x7f6328155370 0x7f63280c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:59.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.005+0000 7f632dc51700 1 --2- 172.21.15.1:0/1095704080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6328062ec0 0x7f632814eac0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:59.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.005+0000 7f632dc51700 1 -- 172.21.15.1:0/1095704080 >> 172.21.15.1:0/1095704080 conn(0x7f63280c7dc0 msgr2=0x7f63280c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:59.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.005+0000 7f632dc51700 1 -- 172.21.15.1:0/1095704080 shutdown_connections 2023-11-15T01:33:59.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.005+0000 7f632dc51700 1 -- 172.21.15.1:0/1095704080 wait complete. 2023-11-15T01:33:59.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.006+0000 7f632dc51700 1 Processor -- start 2023-11-15T01:33:59.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.006+0000 7f632dc51700 1 -- start start 2023-11-15T01:33:59.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.007+0000 7f632dc51700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6328062ec0 0x7f63280a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:59.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.007+0000 7f632dc51700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f632814e6e0 0x7f6328138e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:59.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.007+0000 7f632dc51700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6328155370 0x7f6328067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:59.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.007+0000 7f632dc51700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280a6700 con 0x7f632814e6e0 2023-11-15T01:33:59.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.007+0000 7f632dc51700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632813c5f0 con 0x7f6328155370 2023-11-15T01:33:59.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.007+0000 7f632dc51700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632813c8d0 con 0x7f6328062ec0 2023-11-15T01:33:59.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.007+0000 7f6326ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f632814e6e0 0x7f6328138e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:59.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.007+0000 7f6326ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f632814e6e0 0x7f6328138e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50134/0 (socket says 172.21.15.1:50134) 2023-11-15T01:33:59.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.007+0000 7f6326ffd700 1 -- 172.21.15.1:0/567152866 learned_addr learned my addr 172.21.15.1:0/567152866 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:33:59.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.007+0000 7f6327fff700 1 --2- 172.21.15.1:0/567152866 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6328155370 0x7f6328067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:59.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.007+0000 7f63277fe700 1 --2- 172.21.15.1:0/567152866 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6328062ec0 0x7f63280a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:59.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.007+0000 7f6326ffd700 1 -- 172.21.15.1:0/567152866 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6328062ec0 msgr2=0x7f63280a6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:59.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.008+0000 7f6326ffd700 1 --2- 172.21.15.1:0/567152866 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6328062ec0 0x7f63280a6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:59.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.008+0000 7f6326ffd700 1 -- 172.21.15.1:0/567152866 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6328155370 msgr2=0x7f6328067270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:59.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.008+0000 7f6326ffd700 1 --2- 172.21.15.1:0/567152866 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6328155370 0x7f6328067270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:59.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.008+0000 7f6326ffd700 1 -- 172.21.15.1:0/567152866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6310009370 con 0x7f632814e6e0 2023-11-15T01:33:59.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.008+0000 7f6327fff700 1 --2- 172.21.15.1:0/567152866 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6328155370 0x7f6328067270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:33:59.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.008+0000 7f6326ffd700 1 --2- 172.21.15.1:0/567152866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f632814e6e0 0x7f6328138e90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f6310009130 tx=0x7f6310015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:59.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.008+0000 7f631f7fe700 1 -- 172.21.15.1:0/567152866 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631000ba80 con 0x7f632814e6e0 2023-11-15T01:33:59.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.008+0000 7f631f7fe700 1 -- 172.21.15.1:0/567152866 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6310000d10 con 0x7f632814e6e0 2023-11-15T01:33:59.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.008+0000 7f631f7fe700 1 -- 172.21.15.1:0/567152866 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631001c670 con 0x7f632814e6e0 2023-11-15T01:33:59.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.008+0000 7f632dc51700 1 -- 172.21.15.1:0/567152866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632813cbb0 con 0x7f632814e6e0 2023-11-15T01:33:59.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.008+0000 7f632dc51700 1 -- 172.21.15.1:0/567152866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632813d170 con 0x7f632814e6e0 2023-11-15T01:33:59.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.009+0000 7f632dc51700 1 -- 172.21.15.1:0/567152866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632813d390 con 0x7f632814e6e0 2023-11-15T01:33:59.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.009+0000 7f631f7fe700 1 -- 172.21.15.1:0/567152866 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f631001c9e0 con 0x7f632814e6e0 2023-11-15T01:33:59.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.009+0000 7f631f7fe700 1 --2- 172.21.15.1:0/567152866 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f630805f270 0x7f6308061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:33:59.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.010+0000 7f631f7fe700 1 -- 172.21.15.1:0/567152866 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f631007c3b0 con 0x7f632814e6e0 2023-11-15T01:33:59.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.010+0000 7f63277fe700 1 --2- 172.21.15.1:0/567152866 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f630805f270 0x7f6308061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:33:59.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.010+0000 7f63277fe700 1 --2- 172.21.15.1:0/567152866 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f630805f270 0x7f6308061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6318007fd0 tx=0x7f6318009040).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:33:59.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.014+0000 7f631f7fe700 1 -- 172.21.15.1:0/567152866 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f631004d370 con 0x7f632814e6e0 2023-11-15T01:33:59.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.228+0000 7f632dc51700 1 -- 172.21.15.1:0/567152866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f632806c7e0 con 0x7f632814e6e0 2023-11-15T01:33:59.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.863+0000 7f631f7fe700 1 -- 172.21.15.1:0/567152866 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7f631002a0c0 con 0x7f632814e6e0 2023-11-15T01:33:59.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.865+0000 7f632dc51700 1 -- 172.21.15.1:0/567152866 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f630805f270 msgr2=0x7f6308061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:59.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.865+0000 7f632dc51700 1 --2- 172.21.15.1:0/567152866 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f630805f270 0x7f6308061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6318007fd0 tx=0x7f6318009040).stop 2023-11-15T01:33:59.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.865+0000 7f632dc51700 1 -- 172.21.15.1:0/567152866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f632814e6e0 msgr2=0x7f6328138e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:33:59.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.865+0000 7f632dc51700 1 --2- 172.21.15.1:0/567152866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f632814e6e0 0x7f6328138e90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f6310009130 tx=0x7f6310015000).stop 2023-11-15T01:33:59.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.865+0000 7f632dc51700 1 -- 172.21.15.1:0/567152866 shutdown_connections 2023-11-15T01:33:59.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.865+0000 7f632dc51700 1 --2- 172.21.15.1:0/567152866 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f630805f270 0x7f6308061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:59.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.865+0000 7f632dc51700 1 --2- 172.21.15.1:0/567152866 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6328155370 0x7f6328067270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:59.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.865+0000 7f632dc51700 1 --2- 172.21.15.1:0/567152866 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6328062ec0 0x7f63280a6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:59.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.865+0000 7f632dc51700 1 --2- 172.21.15.1:0/567152866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f632814e6e0 0x7f6328138e90 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:33:59.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.865+0000 7f632dc51700 1 -- 172.21.15.1:0/567152866 >> 172.21.15.1:0/567152866 conn(0x7f63280c7dc0 msgr2=0x7f6328069610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:33:59.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.865+0000 7f632dc51700 1 -- 172.21.15.1:0/567152866 shutdown_connections 2023-11-15T01:33:59.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.866+0000 7f632dc51700 1 -- 172.21.15.1:0/567152866 wait complete. 2023-11-15T01:33:59.880 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-15T01:33:59.881 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:34:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.999+0000 7f0aa0f2f700 1 Processor -- start 2023-11-15T01:34:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:33:59.999+0000 7f0aa0f2f700 1 -- start start 2023-11-15T01:34:00.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0aa0f2f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0a9c0ab1a0 0x7f0a9c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0aa0f2f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0a9c0aa060 0x7f0a9c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0aa0f2f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9c0c06f0 con 0x7f0a9c154150 2023-11-15T01:34:00.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0aa0f2f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c0c09d0 con 0x7f0a9c0ab1a0 2023-11-15T01:34:00.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0aa0f2f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c158820 con 0x7f0a9c0aa060 2023-11-15T01:34:00.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0a99d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0a9c0ab1a0 0x7f0a9c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0a9a59c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0a9c154150 0x7f0a9c158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58794/0 (socket says 172.21.15.1:58794) 2023-11-15T01:34:00.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0a9a59c700 1 -- 172.21.15.1:0/3079164715 learned_addr learned my addr 172.21.15.1:0/3079164715 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:34:00.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0a9ad9d700 1 --2- 172.21.15.1:0/3079164715 >> v2:172.21.15.141:3300/0 conn(0x7f0a9c0aa060 0x7f0a9c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0a99d9b700 1 -- 172.21.15.1:0/3079164715 >> v2:172.21.15.141:3300/0 conn(0x7f0a9c0aa060 msgr2=0x7f0a9c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:00.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0a99d9b700 1 --2- 172.21.15.1:0/3079164715 >> v2:172.21.15.141:3300/0 conn(0x7f0a9c0aa060 0x7f0a9c0c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0a99d9b700 1 -- 172.21.15.1:0/3079164715 >> v1:172.21.15.1:6789/0 conn(0x7f0a9c154150 legacy=0x7f0a9c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0a99d9b700 1 -- 172.21.15.1:0/3079164715 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c158b00 con 0x7f0a9c0ab1a0 2023-11-15T01:34:00.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0a9959a700 1 -- 172.21.15.1:0/3079164715 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196360908 0 0) 0x7f0a9c0c06f0 con 0x7f0a9c154150 2023-11-15T01:34:00.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0a99d9b700 1 --2- 172.21.15.1:0/3079164715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a9c0ab1a0 0x7f0a9c154530 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f0a9c157f80 tx=0x7f0a84009060).ready entity=mon.0 client_cookie=60b15f66b718b28e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:00.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0a9959a700 1 -- 172.21.15.1:0/3079164715 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a840090d0 con 0x7f0a9c0ab1a0 2023-11-15T01:34:00.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0a9959a700 1 -- 172.21.15.1:0/3079164715 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8400b580 con 0x7f0a9c0ab1a0 2023-11-15T01:34:00.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.000+0000 7f0a9959a700 1 -- 172.21.15.1:0/3079164715 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8400b900 con 0x7f0a9c0ab1a0 2023-11-15T01:34:00.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.001+0000 7f0aa0f2f700 1 -- 172.21.15.1:0/3079164715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a9c0ab1a0 msgr2=0x7f0a9c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.001+0000 7f0aa0f2f700 1 --2- 172.21.15.1:0/3079164715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a9c0ab1a0 0x7f0a9c154530 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f0a9c157f80 tx=0x7f0a84009060).stop 2023-11-15T01:34:00.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.001+0000 7f0aa0f2f700 1 -- 172.21.15.1:0/3079164715 shutdown_connections 2023-11-15T01:34:00.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.001+0000 7f0aa0f2f700 1 --2- 172.21.15.1:0/3079164715 >> v2:172.21.15.141:3300/0 conn(0x7f0a9c0aa060 0x7f0a9c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.001+0000 7f0aa0f2f700 1 --2- 172.21.15.1:0/3079164715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a9c0ab1a0 0x7f0a9c154530 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.001+0000 7f0aa0f2f700 1 -- 172.21.15.1:0/3079164715 >> 172.21.15.1:0/3079164715 conn(0x7f0a9c064aa0 msgr2=0x7f0a9c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:00.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.001+0000 7f0aa0f2f700 1 -- 172.21.15.1:0/3079164715 shutdown_connections 2023-11-15T01:34:00.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.001+0000 7f0aa0f2f700 1 -- 172.21.15.1:0/3079164715 wait complete. 2023-11-15T01:34:00.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.002+0000 7f0aa0f2f700 1 Processor -- start 2023-11-15T01:34:00.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.002+0000 7f0aa0f2f700 1 -- start start 2023-11-15T01:34:00.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0aa0f2f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a9c0aa060 0x7f0a9c14df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0aa0f2f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0a9c0ab1a0 0x7f0a9c0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0aa0f2f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a9c154150 0x7f0a9c0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0aa0f2f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c14e470 con 0x7f0a9c0aa060 2023-11-15T01:34:00.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0aa0f2f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c0c8230 con 0x7f0a9c0ab1a0 2023-11-15T01:34:00.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0aa0f2f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c155ac0 con 0x7f0a9c154150 2023-11-15T01:34:00.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0a9a59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a9c0aa060 0x7f0a9c14df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0a9a59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a9c0aa060 0x7f0a9c14df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50150/0 (socket says 172.21.15.1:50150) 2023-11-15T01:34:00.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0a9a59c700 1 -- 172.21.15.1:0/2186586565 learned_addr learned my addr 172.21.15.1:0/2186586565 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:00.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0a9a59c700 1 -- 172.21.15.1:0/2186586565 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a9c154150 msgr2=0x7f0a9c0c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0a99d9b700 1 --2- 172.21.15.1:0/2186586565 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0a9c0ab1a0 0x7f0a9c0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0a9ad9d700 1 --2- 172.21.15.1:0/2186586565 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a9c154150 0x7f0a9c0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0a9a59c700 1 --2- 172.21.15.1:0/2186586565 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a9c154150 0x7f0a9c0c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0a9a59c700 1 -- 172.21.15.1:0/2186586565 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0a9c0ab1a0 msgr2=0x7f0a9c0c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0a9a59c700 1 --2- 172.21.15.1:0/2186586565 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0a9c0ab1a0 0x7f0a9c0c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.003+0000 7f0a9a59c700 1 -- 172.21.15.1:0/2186586565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840092a0 con 0x7f0a9c0aa060 2023-11-15T01:34:00.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.004+0000 7f0a9a59c700 1 --2- 172.21.15.1:0/2186586565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a9c0aa060 0x7f0a9c14df80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f0a8c00c460 tx=0x7f0a8c007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:00.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.004+0000 7f0a927fc700 1 -- 172.21.15.1:0/2186586565 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0072e0 con 0x7f0a9c0aa060 2023-11-15T01:34:00.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.004+0000 7f0a927fc700 1 -- 172.21.15.1:0/2186586565 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c007440 con 0x7f0a9c0aa060 2023-11-15T01:34:00.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.004+0000 7f0aa0f2f700 1 -- 172.21.15.1:0/2186586565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c0ae740 con 0x7f0a9c0aa060 2023-11-15T01:34:00.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.004+0000 7f0a927fc700 1 -- 172.21.15.1:0/2186586565 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0057a0 con 0x7f0a9c0aa060 2023-11-15T01:34:00.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.004+0000 7f0aa0f2f700 1 -- 172.21.15.1:0/2186586565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9c0ae0f0 con 0x7f0a9c0aa060 2023-11-15T01:34:00.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.005+0000 7f0aa0f2f700 1 -- 172.21.15.1:0/2186586565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9c06c7e0 con 0x7f0a9c0aa060 2023-11-15T01:34:00.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.005+0000 7f0a927fc700 1 -- 172.21.15.1:0/2186586565 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0a8c005b90 con 0x7f0a9c0aa060 2023-11-15T01:34:00.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.005+0000 7f0a927fc700 1 --2- 172.21.15.1:0/2186586565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a7c05f270 0x7f0a7c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.006+0000 7f0a927fc700 1 -- 172.21.15.1:0/2186586565 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f0a8c079dc0 con 0x7f0a9c0aa060 2023-11-15T01:34:00.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.006+0000 7f0a99d9b700 1 --2- 172.21.15.1:0/2186586565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a7c05f270 0x7f0a7c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.006+0000 7f0a99d9b700 1 --2- 172.21.15.1:0/2186586565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a7c05f270 0x7f0a7c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0a9c0c83f0 tx=0x7f0a84017000).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.010+0000 7f0a927fc700 1 -- 172.21.15.1:0/2186586565 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0a8c04ad80 con 0x7f0a9c0aa060 2023-11-15T01:34:00.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.227+0000 7f0aa0f2f700 1 -- 172.21.15.1:0/2186586565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a9c0c02a0 con 0x7f0a9c0aa060 2023-11-15T01:34:00.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.228+0000 7f0a927fc700 1 -- 172.21.15.1:0/2186586565 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f0a8c07b030 con 0x7f0a9c0aa060 2023-11-15T01:34:00.230 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:34:00.230 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2009331607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2009331607},{"type":"v1","addr":"172.21.15.141:6836","nonce":2009331607}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3766593810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3766593810},{"type":"v1","addr":"172.21.15.1:6834","nonce":3766593810}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3751372395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3751372395},{"type":"v1","addr":"172.21.15.1:6835","nonce":3751372395}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:33:56.848117+0000","modified":"2023-11-15T01:33:59.859174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5802":{"gid":5802,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/3696653258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3696653258},{"type":"v1","addr":"172.21.15.141:6837","nonce":3696653258}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-11-15T01:34:00.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.229+0000 7f0aa0f2f700 1 -- 172.21.15.1:0/2186586565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a7c05f270 msgr2=0x7f0a7c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.229+0000 7f0aa0f2f700 1 --2- 172.21.15.1:0/2186586565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a7c05f270 0x7f0a7c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0a9c0c83f0 tx=0x7f0a84017000).stop 2023-11-15T01:34:00.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.229+0000 7f0aa0f2f700 1 -- 172.21.15.1:0/2186586565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a9c0aa060 msgr2=0x7f0a9c14df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.229+0000 7f0aa0f2f700 1 --2- 172.21.15.1:0/2186586565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a9c0aa060 0x7f0a9c14df80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f0a8c00c460 tx=0x7f0a8c007e90).stop 2023-11-15T01:34:00.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.229+0000 7f0aa0f2f700 1 -- 172.21.15.1:0/2186586565 shutdown_connections 2023-11-15T01:34:00.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.229+0000 7f0aa0f2f700 1 --2- 172.21.15.1:0/2186586565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a7c05f270 0x7f0a7c061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.229+0000 7f0aa0f2f700 1 --2- 172.21.15.1:0/2186586565 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a9c154150 0x7f0a9c0c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.229+0000 7f0aa0f2f700 1 --2- 172.21.15.1:0/2186586565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a9c0aa060 0x7f0a9c14df80 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.229+0000 7f0aa0f2f700 1 --2- 172.21.15.1:0/2186586565 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0a9c0ab1a0 0x7f0a9c0c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.229+0000 7f0aa0f2f700 1 -- 172.21.15.1:0/2186586565 >> 172.21.15.1:0/2186586565 conn(0x7f0a9c064aa0 msgr2=0x7f0a9c0c5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:00.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.229+0000 7f0aa0f2f700 1 -- 172.21.15.1:0/2186586565 shutdown_connections 2023-11-15T01:34:00.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.229+0000 7f0aa0f2f700 1 -- 172.21.15.1:0/2186586565 wait complete. 2023-11-15T01:34:00.236 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 23 2023-11-15T01:34:00.243 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:34:00.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.360+0000 7f96ee7c9700 1 Processor -- start 2023-11-15T01:34:00.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.360+0000 7f96ee7c9700 1 -- start start 2023-11-15T01:34:00.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.361+0000 7f96ee7c9700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f96e8155530 0x7f96e80c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.361+0000 7f96ee7c9700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e80c7980 con 0x7f96e80c98b0 2023-11-15T01:34:00.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.361+0000 7f96ee7c9700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e80aa890 con 0x7f96e8151e10 2023-11-15T01:34:00.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.361+0000 7f96ee7c9700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e80c7bd0 con 0x7f96e8155530 2023-11-15T01:34:00.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.361+0000 7f96edfc8700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f96e80c98b0 0x7f96e80c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58810/0 (socket says 172.21.15.1:58810) 2023-11-15T01:34:00.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.361+0000 7f96edfc8700 1 -- 172.21.15.1:0/252621125 learned_addr learned my addr 172.21.15.1:0/252621125 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:34:00.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.361+0000 7f96ecfc6700 1 --2- 172.21.15.1:0/252621125 >> v2:172.21.15.141:3300/0 conn(0x7f96e8155530 0x7f96e80c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.361+0000 7f96dffff700 1 -- 172.21.15.1:0/252621125 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613474195 0 0) 0x7f96e80c7980 con 0x7f96e80c98b0 2023-11-15T01:34:00.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.361+0000 7f96dffff700 1 -- 172.21.15.1:0/252621125 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96d40033f0 con 0x7f96e80c98b0 2023-11-15T01:34:00.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.361+0000 7f96dffff700 1 -- 172.21.15.1:0/252621125 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1554846984 0 0) 0x7f96d40033f0 con 0x7f96e80c98b0 2023-11-15T01:34:00.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.362+0000 7f96ecfc6700 1 -- 172.21.15.1:0/252621125 >> v1:172.21.15.141:6789/0 conn(0x7f96e8151e10 legacy=0x7f96e80aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.362+0000 7f96ecfc6700 1 -- 172.21.15.1:0/252621125 >> v1:172.21.15.1:6789/0 conn(0x7f96e80c98b0 legacy=0x7f96e80c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.362+0000 7f96ecfc6700 1 -- 172.21.15.1:0/252621125 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e80c7eb0 con 0x7f96e8155530 2023-11-15T01:34:00.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.362+0000 7f96ecfc6700 1 --2- 172.21.15.1:0/252621125 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96e8155530 0x7f96e80c86b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f96d8009760 tx=0x7f96d8009060).ready entity=mon.1 client_cookie=7e0379c3b4524829 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:00.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.362+0000 7f96dffff700 1 -- 172.21.15.1:0/252621125 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00017f0 con 0x7f96e8155530 2023-11-15T01:34:00.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.362+0000 7f96dffff700 1 -- 172.21.15.1:0/252621125 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d8011400 con 0x7f96e8155530 2023-11-15T01:34:00.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.362+0000 7f96dffff700 1 -- 172.21.15.1:0/252621125 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8011780 con 0x7f96e8155530 2023-11-15T01:34:00.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.362+0000 7f96ee7c9700 1 -- 172.21.15.1:0/252621125 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96e8155530 msgr2=0x7f96e80c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.362+0000 7f96ee7c9700 1 --2- 172.21.15.1:0/252621125 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96e8155530 0x7f96e80c86b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f96d8009760 tx=0x7f96d8009060).stop 2023-11-15T01:34:00.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.362+0000 7f96ee7c9700 1 -- 172.21.15.1:0/252621125 shutdown_connections 2023-11-15T01:34:00.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.362+0000 7f96ee7c9700 1 --2- 172.21.15.1:0/252621125 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96e8155530 0x7f96e80c86b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.362+0000 7f96ee7c9700 1 -- 172.21.15.1:0/252621125 >> 172.21.15.1:0/252621125 conn(0x7f96e80947e0 msgr2=0x7f96e806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:00.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.362+0000 7f96ee7c9700 1 -- 172.21.15.1:0/252621125 shutdown_connections 2023-11-15T01:34:00.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.362+0000 7f96ee7c9700 1 -- 172.21.15.1:0/252621125 wait complete. 2023-11-15T01:34:00.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.364+0000 7f96ee7c9700 1 Processor -- start 2023-11-15T01:34:00.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.364+0000 7f96ee7c9700 1 -- start start 2023-11-15T01:34:00.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ee7c9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e80c98b0 0x7f96e8141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ee7c9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96e8151e10 0x7f96e814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ee7c9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96e8155530 0x7f96e8164170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ee7c9700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80aceb0 con 0x7f96e80c98b0 2023-11-15T01:34:00.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ee7c9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80ac2a0 con 0x7f96e8155530 2023-11-15T01:34:00.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ee7c9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80ac580 con 0x7f96e8151e10 2023-11-15T01:34:00.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ed7c7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e80c98b0 0x7f96e8141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ed7c7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e80c98b0 0x7f96e8141b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50160/0 (socket says 172.21.15.1:50160) 2023-11-15T01:34:00.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ed7c7700 1 -- 172.21.15.1:0/4279598931 learned_addr learned my addr 172.21.15.1:0/4279598931 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:00.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96edfc8700 1 --2- 172.21.15.1:0/4279598931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96e8155530 0x7f96e8164170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ecfc6700 1 --2- 172.21.15.1:0/4279598931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96e8151e10 0x7f96e814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ed7c7700 1 -- 172.21.15.1:0/4279598931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96e8151e10 msgr2=0x7f96e814dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ed7c7700 1 --2- 172.21.15.1:0/4279598931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96e8151e10 0x7f96e814dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ed7c7700 1 -- 172.21.15.1:0/4279598931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96e8155530 msgr2=0x7f96e8164170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ed7c7700 1 --2- 172.21.15.1:0/4279598931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96e8155530 0x7f96e8164170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ed7c7700 1 -- 172.21.15.1:0/4279598931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d80092a0 con 0x7f96e80c98b0 2023-11-15T01:34:00.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96edfc8700 1 --2- 172.21.15.1:0/4279598931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96e8155530 0x7f96e8164170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:34:00.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ed7c7700 1 --2- 172.21.15.1:0/4279598931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e80c98b0 0x7f96e8141b70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f96e400c4c0 tx=0x7f96e4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:00.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96dd7fa700 1 -- 172.21.15.1:0/4279598931 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4007020 con 0x7f96e80c98b0 2023-11-15T01:34:00.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96dd7fa700 1 -- 172.21.15.1:0/4279598931 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e4001e90 con 0x7f96e80c98b0 2023-11-15T01:34:00.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ee7c9700 1 -- 172.21.15.1:0/4279598931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e80ac860 con 0x7f96e80c98b0 2023-11-15T01:34:00.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96dd7fa700 1 -- 172.21.15.1:0/4279598931 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e40073b0 con 0x7f96e80c98b0 2023-11-15T01:34:00.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.365+0000 7f96ee7c9700 1 -- 172.21.15.1:0/4279598931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e80b1020 con 0x7f96e80c98b0 2023-11-15T01:34:00.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.366+0000 7f96ee7c9700 1 -- 172.21.15.1:0/4279598931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e80475e0 con 0x7f96e80c98b0 2023-11-15T01:34:00.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.367+0000 7f96dd7fa700 1 -- 172.21.15.1:0/4279598931 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f96e40068b0 con 0x7f96e80c98b0 2023-11-15T01:34:00.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.367+0000 7f96dd7fa700 1 --2- 172.21.15.1:0/4279598931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96cc05f270 0x7f96cc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.367+0000 7f96dd7fa700 1 -- 172.21.15.1:0/4279598931 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f96e4079ef0 con 0x7f96e80c98b0 2023-11-15T01:34:00.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.367+0000 7f96ecfc6700 1 --2- 172.21.15.1:0/4279598931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96cc05f270 0x7f96cc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.368+0000 7f96ecfc6700 1 --2- 172.21.15.1:0/4279598931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96cc05f270 0x7f96cc061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f96e8099010 tx=0x7f96d8014000).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:00.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.371+0000 7f96dd7fa700 1 -- 172.21.15.1:0/4279598931 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f96e404aeb0 con 0x7f96e80c98b0 2023-11-15T01:34:00.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.544+0000 7f96ee7c9700 1 -- 172.21.15.1:0/4279598931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96e8060900 con 0x7f96e80c98b0 2023-11-15T01:34:00.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.545+0000 7f96dd7fa700 1 -- 172.21.15.1:0/4279598931 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+17480 (secure 0 0 0) 0x7f96e404e4d0 con 0x7f96e80c98b0 2023-11-15T01:34:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:34:00.547 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":61,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:33:57.849586+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:33:54.494299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-15T01:33:55.821335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:34:00.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.547+0000 7f96ee7c9700 1 -- 172.21.15.1:0/4279598931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96cc05f270 msgr2=0x7f96cc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.547+0000 7f96ee7c9700 1 --2- 172.21.15.1:0/4279598931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96cc05f270 0x7f96cc061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f96e8099010 tx=0x7f96d8014000).stop 2023-11-15T01:34:00.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.547+0000 7f96ee7c9700 1 -- 172.21.15.1:0/4279598931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e80c98b0 msgr2=0x7f96e8141b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.547+0000 7f96ee7c9700 1 --2- 172.21.15.1:0/4279598931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e80c98b0 0x7f96e8141b70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f96e400c4c0 tx=0x7f96e4007e00).stop 2023-11-15T01:34:00.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.547+0000 7f96ee7c9700 1 -- 172.21.15.1:0/4279598931 shutdown_connections 2023-11-15T01:34:00.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.547+0000 7f96ee7c9700 1 --2- 172.21.15.1:0/4279598931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96cc05f270 0x7f96cc061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.547+0000 7f96ee7c9700 1 --2- 172.21.15.1:0/4279598931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96e8155530 0x7f96e8164170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.547+0000 7f96ee7c9700 1 --2- 172.21.15.1:0/4279598931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e80c98b0 0x7f96e8141b70 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.547+0000 7f96ee7c9700 1 --2- 172.21.15.1:0/4279598931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96e8151e10 0x7f96e814dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.547+0000 7f96ee7c9700 1 -- 172.21.15.1:0/4279598931 >> 172.21.15.1:0/4279598931 conn(0x7f96e80947e0 msgr2=0x7f96e8150480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:00.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.547+0000 7f96ee7c9700 1 -- 172.21.15.1:0/4279598931 shutdown_connections 2023-11-15T01:34:00.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.547+0000 7f96ee7c9700 1 -- 172.21.15.1:0/4279598931 wait complete. 2023-11-15T01:34:00.561 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-15T01:34:00.562 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:34:00.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.678+0000 7f2436b5f700 1 Processor -- start 2023-11-15T01:34:00.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.678+0000 7f2436b5f700 1 -- start start 2023-11-15T01:34:00.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.679+0000 7f2436b5f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2430154150 0x7f2430154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.679+0000 7f2436b5f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f24300ab1a0 0x7f2430158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.679+0000 7f2436b5f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24300c06f0 con 0x7f24300aa060 2023-11-15T01:34:00.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.679+0000 7f2436b5f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24300c09d0 con 0x7f24300ab1a0 2023-11-15T01:34:00.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.679+0000 7f2436b5f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2430158820 con 0x7f2430154150 2023-11-15T01:34:00.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.679+0000 7f242ffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f24300ab1a0 0x7f2430158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.679+0000 7f24350fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f24300aa060 0x7f24300c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58812/0 (socket says 172.21.15.1:58812) 2023-11-15T01:34:00.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.679+0000 7f24350fc700 1 -- 172.21.15.1:0/3559287304 learned_addr learned my addr 172.21.15.1:0/3559287304 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:34:00.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.679+0000 7f24348fb700 1 --2- 172.21.15.1:0/3559287304 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2430154150 0x7f2430154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.679+0000 7f242ffff700 1 -- 172.21.15.1:0/3559287304 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2430154150 msgr2=0x7f2430154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:00.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.679+0000 7f242ffff700 1 --2- 172.21.15.1:0/3559287304 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2430154150 0x7f2430154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.679+0000 7f242ffff700 1 -- 172.21.15.1:0/3559287304 >> v1:172.21.15.1:6789/0 conn(0x7f24300aa060 legacy=0x7f24300c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.679+0000 7f242ffff700 1 -- 172.21.15.1:0/3559287304 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2430158b00 con 0x7f24300ab1a0 2023-11-15T01:34:00.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.679+0000 7f242f7fe700 1 -- 172.21.15.1:0/3559287304 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225904814 0 0) 0x7f24300c06f0 con 0x7f24300aa060 2023-11-15T01:34:00.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.679+0000 7f242ffff700 1 --2- 172.21.15.1:0/3559287304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24300ab1a0 0x7f2430158040 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f241c009760 tx=0x7f241c009060).ready entity=mon.0 client_cookie=298f5c40dfa69bb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:00.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.680+0000 7f242f7fe700 1 -- 172.21.15.1:0/3559287304 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c0090d0 con 0x7f24300ab1a0 2023-11-15T01:34:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.680+0000 7f242f7fe700 1 -- 172.21.15.1:0/3559287304 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c00b580 con 0x7f24300ab1a0 2023-11-15T01:34:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.680+0000 7f242f7fe700 1 -- 172.21.15.1:0/3559287304 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c00b900 con 0x7f24300ab1a0 2023-11-15T01:34:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.680+0000 7f2436b5f700 1 -- 172.21.15.1:0/3559287304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24300ab1a0 msgr2=0x7f2430158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.680+0000 7f2436b5f700 1 --2- 172.21.15.1:0/3559287304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24300ab1a0 0x7f2430158040 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f241c009760 tx=0x7f241c009060).stop 2023-11-15T01:34:00.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.680+0000 7f2436b5f700 1 -- 172.21.15.1:0/3559287304 shutdown_connections 2023-11-15T01:34:00.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.680+0000 7f2436b5f700 1 --2- 172.21.15.1:0/3559287304 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2430154150 0x7f2430154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.680+0000 7f2436b5f700 1 --2- 172.21.15.1:0/3559287304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24300ab1a0 0x7f2430158040 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.680+0000 7f2436b5f700 1 -- 172.21.15.1:0/3559287304 >> 172.21.15.1:0/3559287304 conn(0x7f2430064aa0 msgr2=0x7f2430064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:00.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.680+0000 7f2436b5f700 1 -- 172.21.15.1:0/3559287304 shutdown_connections 2023-11-15T01:34:00.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.680+0000 7f2436b5f700 1 -- 172.21.15.1:0/3559287304 wait complete. 2023-11-15T01:34:00.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.681+0000 7f2436b5f700 1 Processor -- start 2023-11-15T01:34:00.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.681+0000 7f2436b5f700 1 -- start start 2023-11-15T01:34:00.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.682+0000 7f2436b5f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24300aa060 0x7f2430150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.682+0000 7f2436b5f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24300ab1a0 0x7f24300cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.682+0000 7f2436b5f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2430154150 0x7f243014d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.682+0000 7f2436b5f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24300c8f50 con 0x7f24300ab1a0 2023-11-15T01:34:00.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.682+0000 7f2436b5f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2430150b10 con 0x7f2430154150 2023-11-15T01:34:00.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.682+0000 7f2436b5f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2430156a90 con 0x7f24300aa060 2023-11-15T01:34:00.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.682+0000 7f242ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24300ab1a0 0x7f24300cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.682+0000 7f242ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24300ab1a0 0x7f24300cb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50188/0 (socket says 172.21.15.1:50188) 2023-11-15T01:34:00.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.682+0000 7f242ffff700 1 -- 172.21.15.1:0/2364787289 learned_addr learned my addr 172.21.15.1:0/2364787289 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:00.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.683+0000 7f24350fc700 1 --2- 172.21.15.1:0/2364787289 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2430154150 0x7f243014d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.683+0000 7f24348fb700 1 --2- 172.21.15.1:0/2364787289 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24300aa060 0x7f2430150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.683+0000 7f242ffff700 1 -- 172.21.15.1:0/2364787289 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24300aa060 msgr2=0x7f2430150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.683+0000 7f242ffff700 1 --2- 172.21.15.1:0/2364787289 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24300aa060 0x7f2430150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.683+0000 7f242ffff700 1 -- 172.21.15.1:0/2364787289 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2430154150 msgr2=0x7f243014d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.683+0000 7f242ffff700 1 --2- 172.21.15.1:0/2364787289 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2430154150 0x7f243014d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.683+0000 7f242ffff700 1 -- 172.21.15.1:0/2364787289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c0092a0 con 0x7f24300ab1a0 2023-11-15T01:34:00.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.683+0000 7f242ffff700 1 --2- 172.21.15.1:0/2364787289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24300ab1a0 0x7f24300cb110 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f241c011000 tx=0x7f241c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:00.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.683+0000 7f242cff9700 1 -- 172.21.15.1:0/2364787289 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c00b900 con 0x7f24300ab1a0 2023-11-15T01:34:00.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.683+0000 7f242cff9700 1 -- 172.21.15.1:0/2364787289 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c00bcc0 con 0x7f24300ab1a0 2023-11-15T01:34:00.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.683+0000 7f2436b5f700 1 -- 172.21.15.1:0/2364787289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24300c91c0 con 0x7f24300ab1a0 2023-11-15T01:34:00.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.683+0000 7f242cff9700 1 -- 172.21.15.1:0/2364787289 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c01b410 con 0x7f24300ab1a0 2023-11-15T01:34:00.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.683+0000 7f2436b5f700 1 -- 172.21.15.1:0/2364787289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2430156d70 con 0x7f24300ab1a0 2023-11-15T01:34:00.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.684+0000 7f2436b5f700 1 -- 172.21.15.1:0/2364787289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24300c96e0 con 0x7f24300ab1a0 2023-11-15T01:34:00.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.684+0000 7f242cff9700 1 -- 172.21.15.1:0/2364787289 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f241c01b840 con 0x7f24300ab1a0 2023-11-15T01:34:00.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.685+0000 7f242cff9700 1 --2- 172.21.15.1:0/2364787289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f241405f270 0x7f2414061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:00.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.685+0000 7f242cff9700 1 -- 172.21.15.1:0/2364787289 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f241c07c0b0 con 0x7f24300ab1a0 2023-11-15T01:34:00.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.685+0000 7f24348fb700 1 --2- 172.21.15.1:0/2364787289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f241405f270 0x7f2414061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:00.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.685+0000 7f24348fb700 1 --2- 172.21.15.1:0/2364787289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f241405f270 0x7f2414061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2424006fd0 tx=0x7f2424008040).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:00.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.689+0000 7f242cff9700 1 -- 172.21.15.1:0/2364787289 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f24300c96e0 con 0x7f24300ab1a0 2023-11-15T01:34:00.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.856+0000 7f2436b5f700 1 -- 172.21.15.1:0/2364787289 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24300c96e0 con 0x7f241405f270 2023-11-15T01:34:00.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.867+0000 7f242cff9700 1 -- 172.21.15.1:0/2364787289 <== mgr.5248 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+354902 (secure 0 0 0) 0x7f24300c96e0 con 0x7f241405f270 2023-11-15T01:34:00.876 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:34:00.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.871+0000 7f2436b5f700 1 -- 172.21.15.1:0/2364787289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f241405f270 msgr2=0x7f2414061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.871+0000 7f2436b5f700 1 --2- 172.21.15.1:0/2364787289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f241405f270 0x7f2414061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2424006fd0 tx=0x7f2424008040).stop 2023-11-15T01:34:00.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.871+0000 7f2436b5f700 1 -- 172.21.15.1:0/2364787289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24300ab1a0 msgr2=0x7f24300cb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:00.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.871+0000 7f2436b5f700 1 --2- 172.21.15.1:0/2364787289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24300ab1a0 0x7f24300cb110 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f241c011000 tx=0x7f241c017000).stop 2023-11-15T01:34:00.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.871+0000 7f2436b5f700 1 -- 172.21.15.1:0/2364787289 shutdown_connections 2023-11-15T01:34:00.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.871+0000 7f2436b5f700 1 --2- 172.21.15.1:0/2364787289 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f241405f270 0x7f2414061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.871+0000 7f2436b5f700 1 --2- 172.21.15.1:0/2364787289 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2430154150 0x7f243014d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.871+0000 7f2436b5f700 1 --2- 172.21.15.1:0/2364787289 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24300aa060 0x7f2430150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.871+0000 7f2436b5f700 1 --2- 172.21.15.1:0/2364787289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24300ab1a0 0x7f24300cb110 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:00.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.871+0000 7f2436b5f700 1 -- 172.21.15.1:0/2364787289 >> 172.21.15.1:0/2364787289 conn(0x7f2430064aa0 msgr2=0x7f243014fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:00.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.871+0000 7f2436b5f700 1 -- 172.21.15.1:0/2364787289 shutdown_connections 2023-11-15T01:34:00.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:00.871+0000 7f2436b5f700 1 -- 172.21.15.1:0/2364787289 wait complete. 2023-11-15T01:34:00.884 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:34:00.885 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T01:33:59.414897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":700,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":132,"acting":132,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2414996,"kb_used_data":5460,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752559724,"statfs":{"total":773094113280,"available":770621157376,"internally_reserved":0,"allocated":5591040,"data_stored":2681197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14987351,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-721,"num_write_kb":-15538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.003657"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874788+0000","last_change":"2023-11-15T01:33:56.871248+0000","last_active":"2023-11-15T01:33:56.874788+0000","last_peered":"2023-11-15T01:33:56.874788+0000","last_clean":"2023-11-15T01:33:56.874788+0000","last_became_active":"2023-11-15T01:33:56.870962+0000","last_became_peered":"2023-11-15T01:33:56.870962+0000","last_unstale":"2023-11-15T01:33:56.874788+0000","last_undegraded":"2023-11-15T01:33:56.874788+0000","last_fullsized":"2023-11-15T01:33:56.874788+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873367+0000","last_change":"2023-11-15T01:33:56.463682+0000","last_active":"2023-11-15T01:33:56.873367+0000","last_peered":"2023-11-15T01:33:56.873367+0000","last_clean":"2023-11-15T01:33:56.873367+0000","last_became_active":"2023-11-15T01:33:56.462962+0000","last_became_peered":"2023-11-15T01:33:56.462962+0000","last_unstale":"2023-11-15T01:33:56.873367+0000","last_undegraded":"2023-11-15T01:33:56.873367+0000","last_fullsized":"2023-11-15T01:33:56.873367+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.871536+0000","last_change":"2023-11-15T01:33:56.860607+0000","last_active":"2023-11-15T01:33:56.871536+0000","last_peered":"2023-11-15T01:33:56.871536+0000","last_clean":"2023-11-15T01:33:56.871536+0000","last_became_active":"2023-11-15T01:33:56.860324+0000","last_became_peered":"2023-11-15T01:33:56.860324+0000","last_unstale":"2023-11-15T01:33:56.871536+0000","last_undegraded":"2023-11-15T01:33:56.871536+0000","last_fullsized":"2023-11-15T01:33:56.871536+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.871676+0000","last_change":"2023-11-15T01:33:56.867922+0000","last_active":"2023-11-15T01:33:56.871676+0000","last_peered":"2023-11-15T01:33:56.871676+0000","last_clean":"2023-11-15T01:33:56.871676+0000","last_became_active":"2023-11-15T01:33:56.867634+0000","last_became_peered":"2023-11-15T01:33:56.867634+0000","last_unstale":"2023-11-15T01:33:56.871676+0000","last_undegraded":"2023-11-15T01:33:56.871676+0000","last_fullsized":"2023-11-15T01:33:56.871676+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875287+0000","last_change":"2023-11-15T01:33:56.474361+0000","last_active":"2023-11-15T01:33:56.875287+0000","last_peered":"2023-11-15T01:33:56.875287+0000","last_clean":"2023-11-15T01:33:56.875287+0000","last_became_active":"2023-11-15T01:33:56.473650+0000","last_became_peered":"2023-11-15T01:33:56.473650+0000","last_unstale":"2023-11-15T01:33:56.875287+0000","last_undegraded":"2023-11-15T01:33:56.875287+0000","last_fullsized":"2023-11-15T01:33:56.875287+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876605+0000","last_change":"2023-11-15T01:33:56.873376+0000","last_active":"2023-11-15T01:33:56.876605+0000","last_peered":"2023-11-15T01:33:56.876605+0000","last_clean":"2023-11-15T01:33:56.876605+0000","last_became_active":"2023-11-15T01:33:56.869197+0000","last_became_peered":"2023-11-15T01:33:56.869197+0000","last_unstale":"2023-11-15T01:33:56.876605+0000","last_undegraded":"2023-11-15T01:33:56.876605+0000","last_fullsized":"2023-11-15T01:33:56.876605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859475+0000","last_change":"2023-11-15T01:33:56.464147+0000","last_active":"2023-11-15T01:33:56.859475+0000","last_peered":"2023-11-15T01:33:56.859475+0000","last_clean":"2023-11-15T01:33:56.859475+0000","last_became_active":"2023-11-15T01:33:56.463540+0000","last_became_peered":"2023-11-15T01:33:56.463540+0000","last_unstale":"2023-11-15T01:33:56.859475+0000","last_undegraded":"2023-11-15T01:33:56.859475+0000","last_fullsized":"2023-11-15T01:33:56.859475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876546+0000","last_change":"2023-11-15T01:33:56.873610+0000","last_active":"2023-11-15T01:33:56.876546+0000","last_peered":"2023-11-15T01:33:56.876546+0000","last_clean":"2023-11-15T01:33:56.876546+0000","last_became_active":"2023-11-15T01:33:56.869058+0000","last_became_peered":"2023-11-15T01:33:56.869058+0000","last_unstale":"2023-11-15T01:33:56.876546+0000","last_undegraded":"2023-11-15T01:33:56.876546+0000","last_fullsized":"2023-11-15T01:33:56.876546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.862508+0000","last_change":"2023-11-15T01:33:56.478563+0000","last_active":"2023-11-15T01:33:56.862508+0000","last_peered":"2023-11-15T01:33:56.862508+0000","last_clean":"2023-11-15T01:33:56.862508+0000","last_became_active":"2023-11-15T01:33:56.478308+0000","last_became_peered":"2023-11-15T01:33:56.478308+0000","last_unstale":"2023-11-15T01:33:56.862508+0000","last_undegraded":"2023-11-15T01:33:56.862508+0000","last_fullsized":"2023-11-15T01:33:56.862508+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874632+0000","last_change":"2023-11-15T01:33:56.868848+0000","last_active":"2023-11-15T01:33:56.874632+0000","last_peered":"2023-11-15T01:33:56.874632+0000","last_clean":"2023-11-15T01:33:56.874632+0000","last_became_active":"2023-11-15T01:33:56.868579+0000","last_became_peered":"2023-11-15T01:33:56.868579+0000","last_unstale":"2023-11-15T01:33:56.874632+0000","last_undegraded":"2023-11-15T01:33:56.874632+0000","last_fullsized":"2023-11-15T01:33:56.874632+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860542+0000","last_change":"2023-11-15T01:33:56.464310+0000","last_active":"2023-11-15T01:33:56.860542+0000","last_peered":"2023-11-15T01:33:56.860542+0000","last_clean":"2023-11-15T01:33:56.860542+0000","last_became_active":"2023-11-15T01:33:56.462305+0000","last_became_peered":"2023-11-15T01:33:56.462305+0000","last_unstale":"2023-11-15T01:33:56.860542+0000","last_undegraded":"2023-11-15T01:33:56.860542+0000","last_fullsized":"2023-11-15T01:33:56.860542+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861447+0000","last_change":"2023-11-15T01:33:56.478453+0000","last_active":"2023-11-15T01:33:56.861447+0000","last_peered":"2023-11-15T01:33:56.861447+0000","last_clean":"2023-11-15T01:33:56.861447+0000","last_became_active":"2023-11-15T01:33:56.478179+0000","last_became_peered":"2023-11-15T01:33:56.478179+0000","last_unstale":"2023-11-15T01:33:56.861447+0000","last_undegraded":"2023-11-15T01:33:56.861447+0000","last_fullsized":"2023-11-15T01:33:56.861447+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875001+0000","last_change":"2023-11-15T01:33:56.482375+0000","last_active":"2023-11-15T01:33:56.875001+0000","last_peered":"2023-11-15T01:33:56.875001+0000","last_clean":"2023-11-15T01:33:56.875001+0000","last_became_active":"2023-11-15T01:33:56.481858+0000","last_became_peered":"2023-11-15T01:33:56.481858+0000","last_unstale":"2023-11-15T01:33:56.875001+0000","last_undegraded":"2023-11-15T01:33:56.875001+0000","last_fullsized":"2023-11-15T01:33:56.875001+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874619+0000","last_change":"2023-11-15T01:33:56.871814+0000","last_active":"2023-11-15T01:33:56.874619+0000","last_peered":"2023-11-15T01:33:56.874619+0000","last_clean":"2023-11-15T01:33:56.874619+0000","last_became_active":"2023-11-15T01:33:56.871595+0000","last_became_peered":"2023-11-15T01:33:56.871595+0000","last_unstale":"2023-11-15T01:33:56.874619+0000","last_undegraded":"2023-11-15T01:33:56.874619+0000","last_fullsized":"2023-11-15T01:33:56.874619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861088+0000","last_change":"2023-11-15T01:33:56.481949+0000","last_active":"2023-11-15T01:33:56.861088+0000","last_peered":"2023-11-15T01:33:56.861088+0000","last_clean":"2023-11-15T01:33:56.861088+0000","last_became_active":"2023-11-15T01:33:56.481665+0000","last_became_peered":"2023-11-15T01:33:56.481665+0000","last_unstale":"2023-11-15T01:33:56.861088+0000","last_undegraded":"2023-11-15T01:33:56.861088+0000","last_fullsized":"2023-11-15T01:33:56.861088+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851271+0000","last_change":"2023-11-15T01:33:56.470153+0000","last_active":"2023-11-15T01:33:56.851271+0000","last_peered":"2023-11-15T01:33:56.851271+0000","last_clean":"2023-11-15T01:33:56.851271+0000","last_became_active":"2023-11-15T01:33:56.469808+0000","last_became_peered":"2023-11-15T01:33:56.469808+0000","last_unstale":"2023-11-15T01:33:56.851271+0000","last_undegraded":"2023-11-15T01:33:56.851271+0000","last_fullsized":"2023-11-15T01:33:56.851271+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868562+0000","last_change":"2023-11-15T01:33:56.864069+0000","last_active":"2023-11-15T01:33:56.868562+0000","last_peered":"2023-11-15T01:33:56.868562+0000","last_clean":"2023-11-15T01:33:56.868562+0000","last_became_active":"2023-11-15T01:33:56.863785+0000","last_became_peered":"2023-11-15T01:33:56.863785+0000","last_unstale":"2023-11-15T01:33:56.868562+0000","last_undegraded":"2023-11-15T01:33:56.868562+0000","last_fullsized":"2023-11-15T01:33:56.868562+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874463+0000","last_change":"2023-11-15T01:33:56.867683+0000","last_active":"2023-11-15T01:33:56.874463+0000","last_peered":"2023-11-15T01:33:56.874463+0000","last_clean":"2023-11-15T01:33:56.874463+0000","last_became_active":"2023-11-15T01:33:56.867411+0000","last_became_peered":"2023-11-15T01:33:56.867411+0000","last_unstale":"2023-11-15T01:33:56.874463+0000","last_undegraded":"2023-11-15T01:33:56.874463+0000","last_fullsized":"2023-11-15T01:33:56.874463+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861967+0000","last_change":"2023-11-15T01:33:56.471011+0000","last_active":"2023-11-15T01:33:56.861967+0000","last_peered":"2023-11-15T01:33:56.861967+0000","last_clean":"2023-11-15T01:33:56.861967+0000","last_became_active":"2023-11-15T01:33:56.470697+0000","last_became_peered":"2023-11-15T01:33:56.470697+0000","last_unstale":"2023-11-15T01:33:56.861967+0000","last_undegraded":"2023-11-15T01:33:56.861967+0000","last_fullsized":"2023-11-15T01:33:56.861967+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873817+0000","last_change":"2023-11-15T01:33:56.475311+0000","last_active":"2023-11-15T01:33:56.873817+0000","last_peered":"2023-11-15T01:33:56.873817+0000","last_clean":"2023-11-15T01:33:56.873817+0000","last_became_active":"2023-11-15T01:33:56.475060+0000","last_became_peered":"2023-11-15T01:33:56.475060+0000","last_unstale":"2023-11-15T01:33:56.873817+0000","last_undegraded":"2023-11-15T01:33:56.873817+0000","last_fullsized":"2023-11-15T01:33:56.873817+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860992+0000","last_change":"2023-11-15T01:33:56.464027+0000","last_active":"2023-11-15T01:33:56.860992+0000","last_peered":"2023-11-15T01:33:56.860992+0000","last_clean":"2023-11-15T01:33:56.860992+0000","last_became_active":"2023-11-15T01:33:56.463227+0000","last_became_peered":"2023-11-15T01:33:56.463227+0000","last_unstale":"2023-11-15T01:33:56.860992+0000","last_undegraded":"2023-11-15T01:33:56.860992+0000","last_fullsized":"2023-11-15T01:33:56.860992+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875574+0000","last_change":"2023-11-15T01:33:56.872932+0000","last_active":"2023-11-15T01:33:56.875574+0000","last_peered":"2023-11-15T01:33:56.875574+0000","last_clean":"2023-11-15T01:33:56.875574+0000","last_became_active":"2023-11-15T01:33:56.872658+0000","last_became_peered":"2023-11-15T01:33:56.872658+0000","last_unstale":"2023-11-15T01:33:56.875574+0000","last_undegraded":"2023-11-15T01:33:56.875574+0000","last_fullsized":"2023-11-15T01:33:56.875574+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875262+0000","last_change":"2023-11-15T01:33:56.870228+0000","last_active":"2023-11-15T01:33:56.875262+0000","last_peered":"2023-11-15T01:33:56.875262+0000","last_clean":"2023-11-15T01:33:56.875262+0000","last_became_active":"2023-11-15T01:33:56.869836+0000","last_became_peered":"2023-11-15T01:33:56.869836+0000","last_unstale":"2023-11-15T01:33:56.875262+0000","last_undegraded":"2023-11-15T01:33:56.875262+0000","last_fullsized":"2023-11-15T01:33:56.875262+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868693+0000","last_change":"2023-11-15T01:33:56.862035+0000","last_active":"2023-11-15T01:33:56.868693+0000","last_peered":"2023-11-15T01:33:56.868693+0000","last_clean":"2023-11-15T01:33:56.868693+0000","last_became_active":"2023-11-15T01:33:56.861779+0000","last_became_peered":"2023-11-15T01:33:56.861779+0000","last_unstale":"2023-11-15T01:33:56.868693+0000","last_undegraded":"2023-11-15T01:33:56.868693+0000","last_fullsized":"2023-11-15T01:33:56.868693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.871737+0000","last_change":"2023-11-15T01:33:56.868549+0000","last_active":"2023-11-15T01:33:56.871737+0000","last_peered":"2023-11-15T01:33:56.871737+0000","last_clean":"2023-11-15T01:33:56.871737+0000","last_became_active":"2023-11-15T01:33:56.868252+0000","last_became_peered":"2023-11-15T01:33:56.868252+0000","last_unstale":"2023-11-15T01:33:56.871737+0000","last_undegraded":"2023-11-15T01:33:56.871737+0000","last_fullsized":"2023-11-15T01:33:56.871737+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.862190+0000","last_change":"2023-11-15T01:33:56.472202+0000","last_active":"2023-11-15T01:33:56.862190+0000","last_peered":"2023-11-15T01:33:56.862190+0000","last_clean":"2023-11-15T01:33:56.862190+0000","last_became_active":"2023-11-15T01:33:56.471917+0000","last_became_peered":"2023-11-15T01:33:56.471917+0000","last_unstale":"2023-11-15T01:33:56.862190+0000","last_undegraded":"2023-11-15T01:33:56.862190+0000","last_fullsized":"2023-11-15T01:33:56.862190+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.872641+0000","last_change":"2023-11-15T01:33:56.867048+0000","last_active":"2023-11-15T01:33:56.872641+0000","last_peered":"2023-11-15T01:33:56.872641+0000","last_clean":"2023-11-15T01:33:56.872641+0000","last_became_active":"2023-11-15T01:33:56.866783+0000","last_became_peered":"2023-11-15T01:33:56.866783+0000","last_unstale":"2023-11-15T01:33:56.872641+0000","last_undegraded":"2023-11-15T01:33:56.872641+0000","last_fullsized":"2023-11-15T01:33:56.872641+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874059+0000","last_change":"2023-11-15T01:33:56.866406+0000","last_active":"2023-11-15T01:33:56.874059+0000","last_peered":"2023-11-15T01:33:56.874059+0000","last_clean":"2023-11-15T01:33:56.874059+0000","last_became_active":"2023-11-15T01:33:56.866163+0000","last_became_peered":"2023-11-15T01:33:56.866163+0000","last_unstale":"2023-11-15T01:33:56.874059+0000","last_undegraded":"2023-11-15T01:33:56.874059+0000","last_fullsized":"2023-11-15T01:33:56.874059+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851225+0000","last_change":"2023-11-15T01:33:56.473005+0000","last_active":"2023-11-15T01:33:56.851225+0000","last_peered":"2023-11-15T01:33:56.851225+0000","last_clean":"2023-11-15T01:33:56.851225+0000","last_became_active":"2023-11-15T01:33:56.472763+0000","last_became_peered":"2023-11-15T01:33:56.472763+0000","last_unstale":"2023-11-15T01:33:56.851225+0000","last_undegraded":"2023-11-15T01:33:56.851225+0000","last_fullsized":"2023-11-15T01:33:56.851225+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875176+0000","last_change":"2023-11-15T01:33:56.866140+0000","last_active":"2023-11-15T01:33:56.875176+0000","last_peered":"2023-11-15T01:33:56.875176+0000","last_clean":"2023-11-15T01:33:56.875176+0000","last_became_active":"2023-11-15T01:33:56.865926+0000","last_became_peered":"2023-11-15T01:33:56.865926+0000","last_unstale":"2023-11-15T01:33:56.875176+0000","last_undegraded":"2023-11-15T01:33:56.875176+0000","last_fullsized":"2023-11-15T01:33:56.875176+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861741+0000","last_change":"2023-11-15T01:33:56.467225+0000","last_active":"2023-11-15T01:33:56.861741+0000","last_peered":"2023-11-15T01:33:56.861741+0000","last_clean":"2023-11-15T01:33:56.861741+0000","last_became_active":"2023-11-15T01:33:56.466935+0000","last_became_peered":"2023-11-15T01:33:56.466935+0000","last_unstale":"2023-11-15T01:33:56.861741+0000","last_undegraded":"2023-11-15T01:33:56.861741+0000","last_fullsized":"2023-11-15T01:33:56.861741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869183+0000","last_change":"2023-11-15T01:33:56.858217+0000","last_active":"2023-11-15T01:33:56.869183+0000","last_peered":"2023-11-15T01:33:56.869183+0000","last_clean":"2023-11-15T01:33:56.869183+0000","last_became_active":"2023-11-15T01:33:56.857955+0000","last_became_peered":"2023-11-15T01:33:56.857955+0000","last_unstale":"2023-11-15T01:33:56.869183+0000","last_undegraded":"2023-11-15T01:33:56.869183+0000","last_fullsized":"2023-11-15T01:33:56.869183+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859995+0000","last_change":"2023-11-15T01:33:56.456359+0000","last_active":"2023-11-15T01:33:56.859995+0000","last_peered":"2023-11-15T01:33:56.859995+0000","last_clean":"2023-11-15T01:33:56.859995+0000","last_became_active":"2023-11-15T01:33:56.456028+0000","last_became_peered":"2023-11-15T01:33:56.456028+0000","last_unstale":"2023-11-15T01:33:56.859995+0000","last_undegraded":"2023-11-15T01:33:56.859995+0000","last_fullsized":"2023-11-15T01:33:56.859995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875552+0000","last_change":"2023-11-15T01:33:56.872876+0000","last_active":"2023-11-15T01:33:56.875552+0000","last_peered":"2023-11-15T01:33:56.875552+0000","last_clean":"2023-11-15T01:33:56.875552+0000","last_became_active":"2023-11-15T01:33:56.872293+0000","last_became_peered":"2023-11-15T01:33:56.872293+0000","last_unstale":"2023-11-15T01:33:56.875552+0000","last_undegraded":"2023-11-15T01:33:56.875552+0000","last_fullsized":"2023-11-15T01:33:56.875552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859583+0000","last_change":"2023-11-15T01:33:56.463826+0000","last_active":"2023-11-15T01:33:56.859583+0000","last_peered":"2023-11-15T01:33:56.859583+0000","last_clean":"2023-11-15T01:33:56.859583+0000","last_became_active":"2023-11-15T01:33:56.463164+0000","last_became_peered":"2023-11-15T01:33:56.463164+0000","last_unstale":"2023-11-15T01:33:56.859583+0000","last_undegraded":"2023-11-15T01:33:56.859583+0000","last_fullsized":"2023-11-15T01:33:56.859583+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874768+0000","last_change":"2023-11-15T01:33:56.867465+0000","last_active":"2023-11-15T01:33:56.874768+0000","last_peered":"2023-11-15T01:33:56.874768+0000","last_clean":"2023-11-15T01:33:56.874768+0000","last_became_active":"2023-11-15T01:33:56.867152+0000","last_became_peered":"2023-11-15T01:33:56.867152+0000","last_unstale":"2023-11-15T01:33:56.874768+0000","last_undegraded":"2023-11-15T01:33:56.874768+0000","last_fullsized":"2023-11-15T01:33:56.874768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877547+0000","last_change":"2023-11-15T01:33:56.470412+0000","last_active":"2023-11-15T01:33:56.877547+0000","last_peered":"2023-11-15T01:33:56.877547+0000","last_clean":"2023-11-15T01:33:56.877547+0000","last_became_active":"2023-11-15T01:33:56.469983+0000","last_became_peered":"2023-11-15T01:33:56.469983+0000","last_unstale":"2023-11-15T01:33:56.877547+0000","last_undegraded":"2023-11-15T01:33:56.877547+0000","last_fullsized":"2023-11-15T01:33:56.877547+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.878036+0000","last_change":"2023-11-15T01:33:56.467785+0000","last_active":"2023-11-15T01:33:56.878036+0000","last_peered":"2023-11-15T01:33:56.878036+0000","last_clean":"2023-11-15T01:33:56.878036+0000","last_became_active":"2023-11-15T01:33:56.467489+0000","last_became_peered":"2023-11-15T01:33:56.467489+0000","last_unstale":"2023-11-15T01:33:56.878036+0000","last_undegraded":"2023-11-15T01:33:56.878036+0000","last_fullsized":"2023-11-15T01:33:56.878036+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874082+0000","last_change":"2023-11-15T01:33:56.867055+0000","last_active":"2023-11-15T01:33:56.874082+0000","last_peered":"2023-11-15T01:33:56.874082+0000","last_clean":"2023-11-15T01:33:56.874082+0000","last_became_active":"2023-11-15T01:33:56.865917+0000","last_became_peered":"2023-11-15T01:33:56.865917+0000","last_unstale":"2023-11-15T01:33:56.874082+0000","last_undegraded":"2023-11-15T01:33:56.874082+0000","last_fullsized":"2023-11-15T01:33:56.874082+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868778+0000","last_change":"2023-11-15T01:33:56.865296+0000","last_active":"2023-11-15T01:33:56.868778+0000","last_peered":"2023-11-15T01:33:56.868778+0000","last_clean":"2023-11-15T01:33:56.868778+0000","last_became_active":"2023-11-15T01:33:56.864996+0000","last_became_peered":"2023-11-15T01:33:56.864996+0000","last_unstale":"2023-11-15T01:33:56.868778+0000","last_undegraded":"2023-11-15T01:33:56.868778+0000","last_fullsized":"2023-11-15T01:33:56.868778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875197+0000","last_change":"2023-11-15T01:33:56.866585+0000","last_active":"2023-11-15T01:33:56.875197+0000","last_peered":"2023-11-15T01:33:56.875197+0000","last_clean":"2023-11-15T01:33:56.875197+0000","last_became_active":"2023-11-15T01:33:56.866281+0000","last_became_peered":"2023-11-15T01:33:56.866281+0000","last_unstale":"2023-11-15T01:33:56.875197+0000","last_undegraded":"2023-11-15T01:33:56.875197+0000","last_fullsized":"2023-11-15T01:33:56.875197+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876043+0000","last_change":"2023-11-15T01:33:56.470274+0000","last_active":"2023-11-15T01:33:56.876043+0000","last_peered":"2023-11-15T01:33:56.876043+0000","last_clean":"2023-11-15T01:33:56.876043+0000","last_became_active":"2023-11-15T01:33:56.469919+0000","last_became_peered":"2023-11-15T01:33:56.469919+0000","last_unstale":"2023-11-15T01:33:56.876043+0000","last_undegraded":"2023-11-15T01:33:56.876043+0000","last_fullsized":"2023-11-15T01:33:56.876043+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868787+0000","last_change":"2023-11-15T01:33:56.861760+0000","last_active":"2023-11-15T01:33:56.868787+0000","last_peered":"2023-11-15T01:33:56.868787+0000","last_clean":"2023-11-15T01:33:56.868787+0000","last_became_active":"2023-11-15T01:33:56.861490+0000","last_became_peered":"2023-11-15T01:33:56.861490+0000","last_unstale":"2023-11-15T01:33:56.868787+0000","last_undegraded":"2023-11-15T01:33:56.868787+0000","last_fullsized":"2023-11-15T01:33:56.868787+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875430+0000","last_change":"2023-11-15T01:33:56.468949+0000","last_active":"2023-11-15T01:33:56.875430+0000","last_peered":"2023-11-15T01:33:56.875430+0000","last_clean":"2023-11-15T01:33:56.875430+0000","last_became_active":"2023-11-15T01:33:56.468359+0000","last_became_peered":"2023-11-15T01:33:56.468359+0000","last_unstale":"2023-11-15T01:33:56.875430+0000","last_undegraded":"2023-11-15T01:33:56.875430+0000","last_fullsized":"2023-11-15T01:33:56.875430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870248+0000","last_change":"2023-11-15T01:33:56.466299+0000","last_active":"2023-11-15T01:33:56.870248+0000","last_peered":"2023-11-15T01:33:56.870248+0000","last_clean":"2023-11-15T01:33:56.870248+0000","last_became_active":"2023-11-15T01:33:56.465916+0000","last_became_peered":"2023-11-15T01:33:56.465916+0000","last_unstale":"2023-11-15T01:33:56.870248+0000","last_undegraded":"2023-11-15T01:33:56.870248+0000","last_fullsized":"2023-11-15T01:33:56.870248+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851553+0000","last_change":"2023-11-15T01:33:56.474219+0000","last_active":"2023-11-15T01:33:56.851553+0000","last_peered":"2023-11-15T01:33:56.851553+0000","last_clean":"2023-11-15T01:33:56.851553+0000","last_became_active":"2023-11-15T01:33:56.473738+0000","last_became_peered":"2023-11-15T01:33:56.473738+0000","last_unstale":"2023-11-15T01:33:56.851553+0000","last_undegraded":"2023-11-15T01:33:56.851553+0000","last_fullsized":"2023-11-15T01:33:56.851553+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877515+0000","last_change":"2023-11-15T01:33:56.867511+0000","last_active":"2023-11-15T01:33:56.877515+0000","last_peered":"2023-11-15T01:33:56.877515+0000","last_clean":"2023-11-15T01:33:56.877515+0000","last_became_active":"2023-11-15T01:33:56.867228+0000","last_became_peered":"2023-11-15T01:33:56.867228+0000","last_unstale":"2023-11-15T01:33:56.877515+0000","last_undegraded":"2023-11-15T01:33:56.877515+0000","last_fullsized":"2023-11-15T01:33:56.877515+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860126+0000","last_change":"2023-11-15T01:33:56.478983+0000","last_active":"2023-11-15T01:33:56.860126+0000","last_peered":"2023-11-15T01:33:56.860126+0000","last_clean":"2023-11-15T01:33:56.860126+0000","last_became_active":"2023-11-15T01:33:56.478740+0000","last_became_peered":"2023-11-15T01:33:56.478740+0000","last_unstale":"2023-11-15T01:33:56.860126+0000","last_undegraded":"2023-11-15T01:33:56.860126+0000","last_fullsized":"2023-11-15T01:33:56.860126+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861834+0000","last_change":"2023-11-15T01:33:56.468488+0000","last_active":"2023-11-15T01:33:56.861834+0000","last_peered":"2023-11-15T01:33:56.861834+0000","last_clean":"2023-11-15T01:33:56.861834+0000","last_became_active":"2023-11-15T01:33:56.468185+0000","last_became_peered":"2023-11-15T01:33:56.468185+0000","last_unstale":"2023-11-15T01:33:56.861834+0000","last_undegraded":"2023-11-15T01:33:56.861834+0000","last_fullsized":"2023-11-15T01:33:56.861834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877540+0000","last_change":"2023-11-15T01:33:56.871264+0000","last_active":"2023-11-15T01:33:56.877540+0000","last_peered":"2023-11-15T01:33:56.877540+0000","last_clean":"2023-11-15T01:33:56.877540+0000","last_became_active":"2023-11-15T01:33:56.870999+0000","last_became_peered":"2023-11-15T01:33:56.870999+0000","last_unstale":"2023-11-15T01:33:56.877540+0000","last_undegraded":"2023-11-15T01:33:56.877540+0000","last_fullsized":"2023-11-15T01:33:56.877540+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.751121+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:33:51.751121+0000","last_peered":"2023-11-15T01:33:51.751121+0000","last_clean":"2023-11-15T01:33:51.751121+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:33:51.751121+0000","last_undegraded":"2023-11-15T01:33:51.751121+0000","last_fullsized":"2023-11-15T01:33:51.751121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.750218+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:33:51.750218+0000","last_peered":"2023-11-15T01:33:51.750218+0000","last_clean":"2023-11-15T01:33:51.750218+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:33:51.750218+0000","last_undegraded":"2023-11-15T01:33:51.750218+0000","last_fullsized":"2023-11-15T01:33:51.750218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870739+0000","last_change":"2023-11-15T01:33:56.861357+0000","last_active":"2023-11-15T01:33:56.870739+0000","last_peered":"2023-11-15T01:33:56.870739+0000","last_clean":"2023-11-15T01:33:56.870739+0000","last_became_active":"2023-11-15T01:33:56.861060+0000","last_became_peered":"2023-11-15T01:33:56.861060+0000","last_unstale":"2023-11-15T01:33:56.870739+0000","last_undegraded":"2023-11-15T01:33:56.870739+0000","last_fullsized":"2023-11-15T01:33:56.870739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859580+0000","last_change":"2023-11-15T01:33:56.462711+0000","last_active":"2023-11-15T01:33:56.859580+0000","last_peered":"2023-11-15T01:33:56.859580+0000","last_clean":"2023-11-15T01:33:56.859580+0000","last_became_active":"2023-11-15T01:33:56.462463+0000","last_became_peered":"2023-11-15T01:33:56.462463+0000","last_unstale":"2023-11-15T01:33:56.859580+0000","last_undegraded":"2023-11-15T01:33:56.859580+0000","last_fullsized":"2023-11-15T01:33:56.859580+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.863559+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:33:56.863559+0000","last_peered":"2023-11-15T01:33:56.863559+0000","last_clean":"2023-11-15T01:33:56.863559+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:33:56.863559+0000","last_undegraded":"2023-11-15T01:33:56.863559+0000","last_fullsized":"2023-11-15T01:33:56.863559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860345+0000","last_change":"2023-11-15T01:33:56.467702+0000","last_active":"2023-11-15T01:33:56.860345+0000","last_peered":"2023-11-15T01:33:56.860345+0000","last_clean":"2023-11-15T01:33:56.860345+0000","last_became_active":"2023-11-15T01:33:56.467346+0000","last_became_peered":"2023-11-15T01:33:56.467346+0000","last_unstale":"2023-11-15T01:33:56.860345+0000","last_undegraded":"2023-11-15T01:33:56.860345+0000","last_fullsized":"2023-11-15T01:33:56.860345+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.750218+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:33:51.750218+0000","last_peered":"2023-11-15T01:33:51.750218+0000","last_clean":"2023-11-15T01:33:51.750218+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:33:51.750218+0000","last_undegraded":"2023-11-15T01:33:51.750218+0000","last_fullsized":"2023-11-15T01:33:51.750218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.750311+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:33:51.750311+0000","last_peered":"2023-11-15T01:33:51.750311+0000","last_clean":"2023-11-15T01:33:51.750311+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:33:51.750311+0000","last_undegraded":"2023-11-15T01:33:51.750311+0000","last_fullsized":"2023-11-15T01:33:51.750311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.750299+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:33:51.750299+0000","last_peered":"2023-11-15T01:33:51.750299+0000","last_clean":"2023-11-15T01:33:51.750299+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:33:51.750299+0000","last_undegraded":"2023-11-15T01:33:51.750299+0000","last_fullsized":"2023-11-15T01:33:51.750299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873538+0000","last_change":"2023-11-15T01:33:56.872687+0000","last_active":"2023-11-15T01:33:56.873538+0000","last_peered":"2023-11-15T01:33:56.873538+0000","last_clean":"2023-11-15T01:33:56.873538+0000","last_became_active":"2023-11-15T01:33:56.872163+0000","last_became_peered":"2023-11-15T01:33:56.872163+0000","last_unstale":"2023-11-15T01:33:56.873538+0000","last_undegraded":"2023-11-15T01:33:56.873538+0000","last_fullsized":"2023-11-15T01:33:56.873538+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.750298+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:33:51.750298+0000","last_peered":"2023-11-15T01:33:51.750298+0000","last_clean":"2023-11-15T01:33:51.750298+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:33:51.750298+0000","last_undegraded":"2023-11-15T01:33:51.750298+0000","last_fullsized":"2023-11-15T01:33:51.750298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873310+0000","last_change":"2023-11-15T01:33:56.865528+0000","last_active":"2023-11-15T01:33:56.873310+0000","last_peered":"2023-11-15T01:33:56.873310+0000","last_clean":"2023-11-15T01:33:56.873310+0000","last_became_active":"2023-11-15T01:33:56.865239+0000","last_became_peered":"2023-11-15T01:33:56.865239+0000","last_unstale":"2023-11-15T01:33:56.873310+0000","last_undegraded":"2023-11-15T01:33:56.873310+0000","last_fullsized":"2023-11-15T01:33:56.873310+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.852317+0000","last_change":"2023-11-15T01:33:56.470793+0000","last_active":"2023-11-15T01:33:56.852317+0000","last_peered":"2023-11-15T01:33:56.852317+0000","last_clean":"2023-11-15T01:33:56.852317+0000","last_became_active":"2023-11-15T01:33:56.469938+0000","last_became_peered":"2023-11-15T01:33:56.469938+0000","last_unstale":"2023-11-15T01:33:56.852317+0000","last_undegraded":"2023-11-15T01:33:56.852317+0000","last_fullsized":"2023-11-15T01:33:56.852317+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.751151+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:33:51.751151+0000","last_peered":"2023-11-15T01:33:51.751151+0000","last_clean":"2023-11-15T01:33:51.751151+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:33:51.751151+0000","last_undegraded":"2023-11-15T01:33:51.751151+0000","last_fullsized":"2023-11-15T01:33:51.751151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851763+0000","last_change":"2023-11-15T01:33:56.476704+0000","last_active":"2023-11-15T01:33:56.851763+0000","last_peered":"2023-11-15T01:33:56.851763+0000","last_clean":"2023-11-15T01:33:56.851763+0000","last_became_active":"2023-11-15T01:33:56.476357+0000","last_became_peered":"2023-11-15T01:33:56.476357+0000","last_unstale":"2023-11-15T01:33:56.851763+0000","last_undegraded":"2023-11-15T01:33:56.851763+0000","last_fullsized":"2023-11-15T01:33:56.851763+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.372385+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:33:51.372385+0000","last_peered":"2023-11-15T01:33:51.372385+0000","last_clean":"2023-11-15T01:33:51.372385+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:33:51.372385+0000","last_undegraded":"2023-11-15T01:33:51.372385+0000","last_fullsized":"2023-11-15T01:33:51.372385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":700,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":58,"acting":58,"num_store_stats":3},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574998,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.40400000000000003,"5min":0.38300000000000001,"15min":0.28199999999999997},"max":{"1min":0.69399999999999995,"5min":0.81499999999999995,"15min":0.82299999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58299999999999996,"15min":0.55900000000000005},"min":{"1min":0.44500000000000001,"5min":0.34499999999999997,"15min":0.31},"max":{"1min":0.72999999999999998,"5min":0.79500000000000004,"15min":0.83299999999999996},"last":0.59399999999999997}]},{"osd":1,"last update":"Wed Nov 15 01:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.77700000000000002},"last":0.505},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56499999999999995,"15min":0.54200000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68300000000000005,"5min":0.78000000000000003,"15min":0.81499999999999995},"last":0.58299999999999996}]},{"osd":2,"last update":"Wed Nov 15 01:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69399999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.58799999999999997},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.37},"max":{"1min":0.77700000000000002,"5min":0.82199999999999995,"15min":0.86299999999999999},"last":0.55800000000000005}]},{"osd":3,"last update":"Wed Nov 15 01:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.375},"max":{"1min":0.73799999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.50700000000000001,"5min":0.42099999999999999,"15min":0.371},"max":{"1min":0.76700000000000002,"5min":0.77600000000000002,"15min":0.81200000000000006},"last":0.48299999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45500000000000002,"15min":0.47099999999999997},"min":{"1min":0.30399999999999999,"5min":0.30299999999999999,"15min":0.29099999999999998},"max":{"1min":0.63200000000000001,"5min":0.68100000000000005,"15min":0.84499999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.68000000000000005,"5min":0.74399999999999999,"15min":0.83799999999999997},"last":0.35199999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48399999999999999,"15min":0.497},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.29999999999999999},"max":{"1min":0.58999999999999997,"5min":0.76600000000000001,"15min":0.77500000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.502},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.314},"max":{"1min":0.67400000000000004,"5min":0.748,"15min":0.78500000000000003},"last":0.33500000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.65400000000000003,"5min":0.78600000000000003,"15min":0.82299999999999995},"last":0.373},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52800000000000002,"15min":0.55200000000000005},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.31900000000000001},"max":{"1min":0.65500000000000003,"5min":0.76900000000000002,"15min":0.85099999999999998},"last":0.31900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574999,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301852,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069988,"statfs":{"total":96636764160,"available":96327667712,"internally_reserved":0,"allocated":675840,"data_stored":324221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.39800000000000002,"5min":0.34000000000000002,"15min":0.29199999999999998},"max":{"1min":0.63600000000000001,"5min":0.82399999999999995,"15min":0.94299999999999995},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55000000000000004,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.34499999999999997,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.75600000000000001,"15min":0.97799999999999998},"last":0.78000000000000003}]},{"osd":1,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.38700000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":1.0649999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57299999999999995,"15min":0.54700000000000004},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.84699999999999998,"15min":1.022},"last":0.76700000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.71999999999999997,"5min":0.84199999999999997,"15min":1.038},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70499999999999996,"5min":0.80700000000000005,"15min":0.995},"last":0.71099999999999997}]},{"osd":3,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.41299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.69399999999999995,"5min":0.91300000000000003,"15min":1.028},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68500000000000005,"5min":0.874,"15min":1.004},"last":0.69599999999999995}]},{"osd":4,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.314,"5min":0.31,"15min":0.26600000000000001},"max":{"1min":0.67900000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.25800000000000001},"max":{"1min":0.67500000000000004,"5min":0.68799999999999994,"15min":0.81799999999999995},"last":0.73299999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.312},"max":{"1min":0.68500000000000005,"5min":0.69799999999999995,"15min":0.74099999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.73799999999999999,"5min":0.79200000000000004,"15min":0.79900000000000004},"last":0.82599999999999996}]},{"osd":7,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.377,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":0.70499999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.41399999999999998,"15min":0.34000000000000002},"max":{"1min":0.72799999999999998,"5min":0.81299999999999994,"15min":1.0009999999999999},"last":0.81699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575000,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301852,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069988,"statfs":{"total":96636764160,"available":96327667712,"internally_reserved":0,"allocated":675840,"data_stored":324221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23999999999999999},"max":{"1min":0.54900000000000004,"5min":0.64500000000000002,"15min":0.77800000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41199999999999998,"15min":0.38500000000000001},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.247},"max":{"1min":0.55500000000000005,"5min":0.65600000000000003,"15min":0.73099999999999998},"last":0.32400000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.40400000000000003,"15min":0.38700000000000001},"min":{"1min":0.29299999999999998,"5min":0.27800000000000002,"15min":0.22600000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.69599999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45100000000000001,"15min":0.434},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.90000000000000002},"last":0.36799999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.502,"15min":0.48099999999999998},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.31},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":1.0009999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.48799999999999999,"15min":0.45600000000000002},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.28000000000000003},"max":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.75600000000000001},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79400000000000004,"5min":0.82299999999999995,"15min":0.89300000000000002},"last":0.501},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.65200000000000002,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":0.78200000000000003,"5min":0.88700000000000001,"15min":1.0509999999999999},"last":0.433}]},{"osd":5,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65000000000000002,"15min":0.626},"min":{"1min":0.432,"5min":0.40100000000000002,"15min":0.38500000000000001},"max":{"1min":0.78100000000000003,"5min":0.83399999999999996,"15min":0.92700000000000005},"last":0.62},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66000000000000003,"15min":0.63},"min":{"1min":0.46400000000000002,"5min":0.433,"15min":0.373},"max":{"1min":0.91700000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47299999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68600000000000005,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82199999999999995,"5min":0.90900000000000003,"15min":1.0029999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.67500000000000004},"min":{"1min":0.51300000000000001,"5min":0.45200000000000001,"15min":0.41199999999999998},"max":{"1min":0.90100000000000002,"5min":0.96599999999999997,"15min":0.996},"last":0.441}]},{"osd":7,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70599999999999996,"15min":0.68200000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88500000000000001,"5min":0.93899999999999995,"15min":1.25},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70399999999999996,"15min":0.67700000000000005},"min":{"1min":0.52200000000000002,"5min":0.495,"15min":0.46100000000000002},"max":{"1min":0.92200000000000004,"5min":0.96699999999999997,"15min":0.99199999999999999},"last":0.58699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301912,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069928,"statfs":{"total":96636764160,"available":96327606272,"internally_reserved":0,"allocated":737280,"data_stored":352714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.36199999999999999,"15min":0.35899999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.50700000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.41599999999999998,"15min":0.40200000000000002},"min":{"1min":0.26300000000000001,"5min":0.252,"15min":0.215},"max":{"1min":0.50600000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.33100000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.39400000000000002,"15min":0.378},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.505,"5min":0.60499999999999998,"15min":0.64200000000000002},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.42599999999999999,"15min":0.42999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.47399999999999998,"5min":0.68600000000000005,"15min":1.0429999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.42999999999999999,"15min":0.41899999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.22500000000000001},"max":{"1min":0.55700000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.311},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.45500000000000002,"15min":0.443},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27700000000000002},"max":{"1min":0.58399999999999996,"5min":0.73199999999999998,"15min":0.83399999999999996},"last":0.34399999999999997}]},{"osd":4,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78800000000000003,"5min":0.97799999999999998,"15min":1.454},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.442},"max":{"1min":0.79300000000000004,"5min":0.94999999999999996,"15min":1.147},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69399999999999995,"5min":1.01,"15min":1.079},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.624,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.73699999999999999,"5min":0.91400000000000003,"15min":1.1120000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":1.2529999999999999},"last":0.496},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.68999999999999995,"5min":1.042,"15min":1.206},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.78100000000000003,"5min":1.0620000000000001,"15min":1.2669999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68200000000000005,"15min":0.69799999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83299999999999996,"5min":0.99199999999999999,"15min":1.4119999999999999},"last":0.65300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065832,"statfs":{"total":96636764160,"available":96323411968,"internally_reserved":0,"allocated":737280,"data_stored":354124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36699999999999999,"15min":0.36199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.221},"max":{"1min":0.48599999999999999,"5min":0.60199999999999998,"15min":0.61899999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.40200000000000002,"15min":0.39400000000000002},"min":{"1min":0.28699999999999998,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.63700000000000001,"15min":0.67800000000000005},"last":0.35199999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":0.70999999999999996,"15min":0.75},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66300000000000003,"5min":0.73499999999999999,"15min":0.92000000000000004},"last":0.38500000000000001}]},{"osd":3,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45600000000000002,"15min":0.438},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.57999999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.42999999999999999},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.253},"max":{"1min":0.66700000000000004,"5min":0.68999999999999995,"15min":0.74199999999999999},"last":0.309}]},{"osd":4,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89000000000000001,"5min":0.90900000000000003,"15min":1.0800000000000001},"last":0.499},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.629,"15min":0.64600000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.95399999999999996,"15min":1.052},"last":0.49099999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.63800000000000001,"15min":0.64500000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.93000000000000005,"15min":0.998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63800000000000001,"15min":0.63600000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.85499999999999998,"5min":0.96099999999999997,"15min":1.1339999999999999},"last":0.436}]},{"osd":6,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65800000000000003,"15min":0.65900000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.91300000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.441,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84199999999999997,"5min":1.016,"15min":1.119},"last":0.47399999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.48399999999999999,"5min":0.45200000000000001,"15min":0.438},"max":{"1min":0.79700000000000004,"5min":1.03,"15min":1.103},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.68600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065832,"statfs":{"total":96636764160,"available":96323411968,"internally_reserved":0,"allocated":737280,"data_stored":353254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39200000000000002,"15min":0.36199999999999999},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.22600000000000001},"max":{"1min":0.53100000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.42199999999999999,"15min":0.38800000000000001},"min":{"1min":0.30299999999999999,"5min":0.29499999999999998,"15min":0.23200000000000001},"max":{"1min":0.54300000000000004,"5min":0.70499999999999996,"15min":0.70899999999999996},"last":0.27900000000000003}]},{"osd":1,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.41099999999999998,"15min":0.377},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.23599999999999999},"max":{"1min":0.59799999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.46500000000000002,"15min":0.441},"min":{"1min":0.372,"5min":0.29399999999999998,"15min":0.28999999999999998},"max":{"1min":0.621,"5min":0.747,"15min":0.80500000000000005},"last":0.33600000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.436},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.26900000000000002},"max":{"1min":0.58799999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.5,"15min":0.46300000000000002},"min":{"1min":0.38900000000000001,"5min":0.35999999999999999,"15min":0.26200000000000001},"max":{"1min":0.64500000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41999999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.42099999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.92600000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.44,"15min":0.39000000000000001},"max":{"1min":0.82699999999999996,"5min":1.036,"15min":1.0589999999999999},"last":0.40600000000000003}]},{"osd":5,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.64400000000000002},"min":{"1min":0.503,"5min":0.48399999999999999,"15min":0.41099999999999998},"max":{"1min":0.80600000000000005,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.44400000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86099999999999999,"5min":0.90100000000000002,"15min":0.95999999999999996},"last":0.41099999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.65200000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.42499999999999999},"max":{"1min":0.94299999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.67800000000000005},"min":{"1min":0.53500000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89600000000000002,"5min":1.0900000000000001,"15min":1.169},"last":0.44900000000000001}]},{"osd":7,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69199999999999995,"15min":0.67400000000000004},"min":{"1min":0.52600000000000002,"5min":0.48399999999999999,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":1.071,"15min":1.071},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.70599999999999996,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.97299999999999998,"5min":1.1319999999999999,"15min":1.1459999999999999},"last":0.45500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.55000000000000004},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.88,"15min":0.88},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.74399999999999999,"15min":0.78800000000000003},"last":0.56399999999999995}]},{"osd":1,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57999999999999996,"15min":0.56499999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":0.77500000000000002,"5min":1.087,"15min":1.087},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.80400000000000005,"15min":0.81000000000000005},"last":0.69399999999999995}]},{"osd":2,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":0.70899999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58199999999999996,"15min":0.58299999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66700000000000004}]},{"osd":3,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70099999999999996,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.749,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.502}]},{"osd":5,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.47599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.30399999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.80600000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47499999999999998,"15min":0.501},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":0.68000000000000005,"15min":0.85299999999999998},"last":0.46600000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47199999999999998,"15min":0.50700000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.84199999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.51100000000000001,"15min":0.54100000000000004},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":0.66500000000000004,"5min":0.77600000000000002,"15min":0.83199999999999996},"last":0.74399999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.50800000000000001,"15min":0.53600000000000003},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64300000000000002,"5min":0.873,"15min":0.873},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54800000000000004,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":0.74099999999999999,"5min":0.78400000000000003,"15min":0.90100000000000002},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301852,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069988,"statfs":{"total":96636764160,"available":96327667712,"internally_reserved":0,"allocated":675840,"data_stored":324221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.37,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.44800000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.74199999999999999,"15min":0.81200000000000006},"last":0.41199999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.55200000000000005},"min":{"1min":0.42899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70099999999999996,"5min":0.745,"15min":0.78200000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.40699999999999997,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.69299999999999995,"5min":0.73899999999999999,"15min":0.78000000000000003},"last":0.45300000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.318},"max":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.86199999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39200000000000002,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":1.103},"last":0.38}]},{"osd":3,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.52400000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.78100000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59099999999999997,"15min":0.60199999999999998},"min":{"1min":0.45800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73699999999999999,"5min":0.77300000000000002,"15min":1.127},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.44400000000000001,"15min":0.48299999999999998},"min":{"1min":0.33800000000000002,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.58399999999999996,"5min":0.70699999999999996,"15min":0.94399999999999995},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.54400000000000004},"min":{"1min":0.41399999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70799999999999996,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.54800000000000004}]},{"osd":6,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47099999999999997,"15min":0.502},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.32100000000000001},"max":{"1min":0.65200000000000002,"5min":0.755,"15min":1.0660000000000001},"last":0.441},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.49399999999999999,"15min":0.52400000000000002},"min":{"1min":0.38100000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.751,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.504,"15min":0.52200000000000002},"min":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.73599999999999999,"15min":0.97199999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.435,"5min":0.38300000000000001,"15min":0.33600000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":1.1499999999999999},"last":0.55800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:34:00.893 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:34:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.041+0000 7f9b96c89700 1 Processor -- start 2023-11-15T01:34:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.041+0000 7f9b96c89700 1 -- start start 2023-11-15T01:34:01.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.042+0000 7f9b96c89700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9b900629e0 0x7f9b900c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.042+0000 7f9b96c89700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b900c3400 0x7f9b900ab430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.042+0000 7f9b96c89700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b900a9f60 con 0x7f9b900ab920 2023-11-15T01:34:01.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.042+0000 7f9b96c89700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b900c3880 con 0x7f9b900629e0 2023-11-15T01:34:01.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.042+0000 7f9b96c89700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b90151700 con 0x7f9b900c3400 2023-11-15T01:34:01.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.042+0000 7f9b94a25700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9b900629e0 0x7f9b900c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.042+0000 7f9b95226700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9b900ab920 0x7f9b90064df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58828/0 (socket says 172.21.15.1:58828) 2023-11-15T01:34:01.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.042+0000 7f9b95226700 1 -- 172.21.15.1:0/502217544 learned_addr learned my addr 172.21.15.1:0/502217544 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:34:01.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.043+0000 7f9b8ffff700 1 --2- 172.21.15.1:0/502217544 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b900c3400 0x7f9b900ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.043+0000 7f9b94a25700 1 -- 172.21.15.1:0/502217544 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b900c3400 msgr2=0x7f9b900ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:01.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.043+0000 7f9b94a25700 1 --2- 172.21.15.1:0/502217544 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b900c3400 0x7f9b900ab430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.043+0000 7f9b94a25700 1 -- 172.21.15.1:0/502217544 >> v1:172.21.15.1:6789/0 conn(0x7f9b900ab920 legacy=0x7f9b90064df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.043+0000 7f9b8f7fe700 1 -- 172.21.15.1:0/502217544 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069092075 0 0) 0x7f9b900a9f60 con 0x7f9b900ab920 2023-11-15T01:34:01.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.043+0000 7f9b94a25700 1 -- 172.21.15.1:0/502217544 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b900c2a80 con 0x7f9b900629e0 2023-11-15T01:34:01.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.043+0000 7f9b8ffff700 1 --2- 172.21.15.1:0/502217544 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b900c3400 0x7f9b900ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:34:01.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.043+0000 7f9b94a25700 1 --2- 172.21.15.1:0/502217544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b900629e0 0x7f9b900c2f10 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f9b88009e60 tx=0x7f9b88009780).ready entity=mon.0 client_cookie=7b6dbe5ed6256b50 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:01.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.043+0000 7f9b8f7fe700 1 -- 172.21.15.1:0/502217544 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8800e070 con 0x7f9b900629e0 2023-11-15T01:34:01.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.043+0000 7f9b8f7fe700 1 -- 172.21.15.1:0/502217544 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8800bc30 con 0x7f9b900629e0 2023-11-15T01:34:01.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.043+0000 7f9b8f7fe700 1 -- 172.21.15.1:0/502217544 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b88012410 con 0x7f9b900629e0 2023-11-15T01:34:01.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.044+0000 7f9b96c89700 1 -- 172.21.15.1:0/502217544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b900629e0 msgr2=0x7f9b900c2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.044+0000 7f9b96c89700 1 --2- 172.21.15.1:0/502217544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b900629e0 0x7f9b900c2f10 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f9b88009e60 tx=0x7f9b88009780).stop 2023-11-15T01:34:01.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.044+0000 7f9b96c89700 1 -- 172.21.15.1:0/502217544 shutdown_connections 2023-11-15T01:34:01.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.044+0000 7f9b96c89700 1 --2- 172.21.15.1:0/502217544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b900629e0 0x7f9b900c2f10 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.044+0000 7f9b96c89700 1 --2- 172.21.15.1:0/502217544 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b900c3400 0x7f9b900ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.044+0000 7f9b96c89700 1 -- 172.21.15.1:0/502217544 >> 172.21.15.1:0/502217544 conn(0x7f9b900c74f0 msgr2=0x7f9b900c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:01.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.044+0000 7f9b96c89700 1 -- 172.21.15.1:0/502217544 shutdown_connections 2023-11-15T01:34:01.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.044+0000 7f9b96c89700 1 -- 172.21.15.1:0/502217544 wait complete. 2023-11-15T01:34:01.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.045+0000 7f9b96c89700 1 Processor -- start 2023-11-15T01:34:01.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.045+0000 7f9b96c89700 1 -- start start 2023-11-15T01:34:01.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b96c89700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b900629e0 0x7f9b9014dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b96c89700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b900ab920 0x7f9b900a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b96c89700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b900c3400 0x7f9b900a95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b96c89700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900a9ac0 con 0x7f9b900629e0 2023-11-15T01:34:01.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b96c89700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b90152f50 con 0x7f9b900ab920 2023-11-15T01:34:01.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b96c89700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900bd820 con 0x7f9b900c3400 2023-11-15T01:34:01.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b94a25700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b900629e0 0x7f9b9014dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b94a25700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b900629e0 0x7f9b9014dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50216/0 (socket says 172.21.15.1:50216) 2023-11-15T01:34:01.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b94a25700 1 -- 172.21.15.1:0/2986103845 learned_addr learned my addr 172.21.15.1:0/2986103845 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:01.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b94a25700 1 -- 172.21.15.1:0/2986103845 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b900c3400 msgr2=0x7f9b900a95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b8ffff700 1 --2- 172.21.15.1:0/2986103845 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b900ab920 0x7f9b900a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b94a25700 1 --2- 172.21.15.1:0/2986103845 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b900c3400 0x7f9b900a95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:34:01.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b94a25700 1 -- 172.21.15.1:0/2986103845 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b900ab920 msgr2=0x7f9b900a90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b94a25700 1 --2- 172.21.15.1:0/2986103845 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b900ab920 0x7f9b900a90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b94a25700 1 -- 172.21.15.1:0/2986103845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b88009a20 con 0x7f9b900629e0 2023-11-15T01:34:01.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b8ffff700 1 --2- 172.21.15.1:0/2986103845 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b900ab920 0x7f9b900a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:34:01.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b94a25700 1 --2- 172.21.15.1:0/2986103845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b900629e0 0x7f9b9014dc60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f9b8800b6c0 tx=0x7f9b88009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:01.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b8cff9700 1 -- 172.21.15.1:0/2986103845 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8801d630 con 0x7f9b900629e0 2023-11-15T01:34:01.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b8cff9700 1 -- 172.21.15.1:0/2986103845 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8801d790 con 0x7f9b900629e0 2023-11-15T01:34:01.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b8cff9700 1 -- 172.21.15.1:0/2986103845 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8801db10 con 0x7f9b900629e0 2023-11-15T01:34:01.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b96c89700 1 -- 172.21.15.1:0/2986103845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b900bdac0 con 0x7f9b900629e0 2023-11-15T01:34:01.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.046+0000 7f9b96c89700 1 -- 172.21.15.1:0/2986103845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b900be080 con 0x7f9b900629e0 2023-11-15T01:34:01.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.047+0000 7f9b96c89700 1 -- 172.21.15.1:0/2986103845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9006c7e0 con 0x7f9b900629e0 2023-11-15T01:34:01.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.048+0000 7f9b8cff9700 1 -- 172.21.15.1:0/2986103845 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9b88003040 con 0x7f9b900629e0 2023-11-15T01:34:01.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.048+0000 7f9b8cff9700 1 --2- 172.21.15.1:0/2986103845 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b7005f270 0x7f9b70061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.048+0000 7f9b8cff9700 1 -- 172.21.15.1:0/2986103845 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f9b8807c3a0 con 0x7f9b900629e0 2023-11-15T01:34:01.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.048+0000 7f9b8ffff700 1 --2- 172.21.15.1:0/2986103845 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b7005f270 0x7f9b70061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.049+0000 7f9b8ffff700 1 --2- 172.21.15.1:0/2986103845 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b7005f270 0x7f9b70061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f9b80006fd0 tx=0x7f9b80008040).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:01.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.052+0000 7f9b8cff9700 1 -- 172.21.15.1:0/2986103845 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9b8804d360 con 0x7f9b900629e0 2023-11-15T01:34:01.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.220+0000 7f9b96c89700 1 -- 172.21.15.1:0/2986103845 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b900c8350 con 0x7f9b7005f270 2023-11-15T01:34:01.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.230+0000 7f9b8cff9700 1 -- 172.21.15.1:0/2986103845 <== mgr.5248 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+354902 (secure 0 0 0) 0x7f9b900c8350 con 0x7f9b7005f270 2023-11-15T01:34:01.236 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:34:01.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.233+0000 7f9b96c89700 1 -- 172.21.15.1:0/2986103845 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b7005f270 msgr2=0x7f9b70061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.233+0000 7f9b96c89700 1 --2- 172.21.15.1:0/2986103845 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b7005f270 0x7f9b70061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f9b80006fd0 tx=0x7f9b80008040).stop 2023-11-15T01:34:01.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.233+0000 7f9b96c89700 1 -- 172.21.15.1:0/2986103845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b900629e0 msgr2=0x7f9b9014dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.233+0000 7f9b96c89700 1 --2- 172.21.15.1:0/2986103845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b900629e0 0x7f9b9014dc60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f9b8800b6c0 tx=0x7f9b88009780).stop 2023-11-15T01:34:01.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.234+0000 7f9b96c89700 1 -- 172.21.15.1:0/2986103845 shutdown_connections 2023-11-15T01:34:01.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.234+0000 7f9b96c89700 1 --2- 172.21.15.1:0/2986103845 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b7005f270 0x7f9b70061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.234+0000 7f9b96c89700 1 --2- 172.21.15.1:0/2986103845 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b900c3400 0x7f9b900a95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:34:01.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.234+0000 7f9b96c89700 1 --2- 172.21.15.1:0/2986103845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b900629e0 0x7f9b9014dc60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.234+0000 7f9b96c89700 1 --2- 172.21.15.1:0/2986103845 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b900ab920 0x7f9b900a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.234+0000 7f9b96c89700 1 -- 172.21.15.1:0/2986103845 >> 172.21.15.1:0/2986103845 conn(0x7f9b900c74f0 msgr2=0x7f9b90150580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:01.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.234+0000 7f9b96c89700 1 -- 172.21.15.1:0/2986103845 shutdown_connections 2023-11-15T01:34:01.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.234+0000 7f9b96c89700 1 -- 172.21.15.1:0/2986103845 wait complete. 2023-11-15T01:34:01.241 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:34:01.247 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T01:33:59.414897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":700,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":132,"acting":132,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2414996,"kb_used_data":5460,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752559724,"statfs":{"total":773094113280,"available":770621157376,"internally_reserved":0,"allocated":5591040,"data_stored":2681197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14987351,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-721,"num_write_kb":-15538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.003657"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874788+0000","last_change":"2023-11-15T01:33:56.871248+0000","last_active":"2023-11-15T01:33:56.874788+0000","last_peered":"2023-11-15T01:33:56.874788+0000","last_clean":"2023-11-15T01:33:56.874788+0000","last_became_active":"2023-11-15T01:33:56.870962+0000","last_became_peered":"2023-11-15T01:33:56.870962+0000","last_unstale":"2023-11-15T01:33:56.874788+0000","last_undegraded":"2023-11-15T01:33:56.874788+0000","last_fullsized":"2023-11-15T01:33:56.874788+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873367+0000","last_change":"2023-11-15T01:33:56.463682+0000","last_active":"2023-11-15T01:33:56.873367+0000","last_peered":"2023-11-15T01:33:56.873367+0000","last_clean":"2023-11-15T01:33:56.873367+0000","last_became_active":"2023-11-15T01:33:56.462962+0000","last_became_peered":"2023-11-15T01:33:56.462962+0000","last_unstale":"2023-11-15T01:33:56.873367+0000","last_undegraded":"2023-11-15T01:33:56.873367+0000","last_fullsized":"2023-11-15T01:33:56.873367+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.871536+0000","last_change":"2023-11-15T01:33:56.860607+0000","last_active":"2023-11-15T01:33:56.871536+0000","last_peered":"2023-11-15T01:33:56.871536+0000","last_clean":"2023-11-15T01:33:56.871536+0000","last_became_active":"2023-11-15T01:33:56.860324+0000","last_became_peered":"2023-11-15T01:33:56.860324+0000","last_unstale":"2023-11-15T01:33:56.871536+0000","last_undegraded":"2023-11-15T01:33:56.871536+0000","last_fullsized":"2023-11-15T01:33:56.871536+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.871676+0000","last_change":"2023-11-15T01:33:56.867922+0000","last_active":"2023-11-15T01:33:56.871676+0000","last_peered":"2023-11-15T01:33:56.871676+0000","last_clean":"2023-11-15T01:33:56.871676+0000","last_became_active":"2023-11-15T01:33:56.867634+0000","last_became_peered":"2023-11-15T01:33:56.867634+0000","last_unstale":"2023-11-15T01:33:56.871676+0000","last_undegraded":"2023-11-15T01:33:56.871676+0000","last_fullsized":"2023-11-15T01:33:56.871676+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875287+0000","last_change":"2023-11-15T01:33:56.474361+0000","last_active":"2023-11-15T01:33:56.875287+0000","last_peered":"2023-11-15T01:33:56.875287+0000","last_clean":"2023-11-15T01:33:56.875287+0000","last_became_active":"2023-11-15T01:33:56.473650+0000","last_became_peered":"2023-11-15T01:33:56.473650+0000","last_unstale":"2023-11-15T01:33:56.875287+0000","last_undegraded":"2023-11-15T01:33:56.875287+0000","last_fullsized":"2023-11-15T01:33:56.875287+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876605+0000","last_change":"2023-11-15T01:33:56.873376+0000","last_active":"2023-11-15T01:33:56.876605+0000","last_peered":"2023-11-15T01:33:56.876605+0000","last_clean":"2023-11-15T01:33:56.876605+0000","last_became_active":"2023-11-15T01:33:56.869197+0000","last_became_peered":"2023-11-15T01:33:56.869197+0000","last_unstale":"2023-11-15T01:33:56.876605+0000","last_undegraded":"2023-11-15T01:33:56.876605+0000","last_fullsized":"2023-11-15T01:33:56.876605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859475+0000","last_change":"2023-11-15T01:33:56.464147+0000","last_active":"2023-11-15T01:33:56.859475+0000","last_peered":"2023-11-15T01:33:56.859475+0000","last_clean":"2023-11-15T01:33:56.859475+0000","last_became_active":"2023-11-15T01:33:56.463540+0000","last_became_peered":"2023-11-15T01:33:56.463540+0000","last_unstale":"2023-11-15T01:33:56.859475+0000","last_undegraded":"2023-11-15T01:33:56.859475+0000","last_fullsized":"2023-11-15T01:33:56.859475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876546+0000","last_change":"2023-11-15T01:33:56.873610+0000","last_active":"2023-11-15T01:33:56.876546+0000","last_peered":"2023-11-15T01:33:56.876546+0000","last_clean":"2023-11-15T01:33:56.876546+0000","last_became_active":"2023-11-15T01:33:56.869058+0000","last_became_peered":"2023-11-15T01:33:56.869058+0000","last_unstale":"2023-11-15T01:33:56.876546+0000","last_undegraded":"2023-11-15T01:33:56.876546+0000","last_fullsized":"2023-11-15T01:33:56.876546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.862508+0000","last_change":"2023-11-15T01:33:56.478563+0000","last_active":"2023-11-15T01:33:56.862508+0000","last_peered":"2023-11-15T01:33:56.862508+0000","last_clean":"2023-11-15T01:33:56.862508+0000","last_became_active":"2023-11-15T01:33:56.478308+0000","last_became_peered":"2023-11-15T01:33:56.478308+0000","last_unstale":"2023-11-15T01:33:56.862508+0000","last_undegraded":"2023-11-15T01:33:56.862508+0000","last_fullsized":"2023-11-15T01:33:56.862508+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874632+0000","last_change":"2023-11-15T01:33:56.868848+0000","last_active":"2023-11-15T01:33:56.874632+0000","last_peered":"2023-11-15T01:33:56.874632+0000","last_clean":"2023-11-15T01:33:56.874632+0000","last_became_active":"2023-11-15T01:33:56.868579+0000","last_became_peered":"2023-11-15T01:33:56.868579+0000","last_unstale":"2023-11-15T01:33:56.874632+0000","last_undegraded":"2023-11-15T01:33:56.874632+0000","last_fullsized":"2023-11-15T01:33:56.874632+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860542+0000","last_change":"2023-11-15T01:33:56.464310+0000","last_active":"2023-11-15T01:33:56.860542+0000","last_peered":"2023-11-15T01:33:56.860542+0000","last_clean":"2023-11-15T01:33:56.860542+0000","last_became_active":"2023-11-15T01:33:56.462305+0000","last_became_peered":"2023-11-15T01:33:56.462305+0000","last_unstale":"2023-11-15T01:33:56.860542+0000","last_undegraded":"2023-11-15T01:33:56.860542+0000","last_fullsized":"2023-11-15T01:33:56.860542+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861447+0000","last_change":"2023-11-15T01:33:56.478453+0000","last_active":"2023-11-15T01:33:56.861447+0000","last_peered":"2023-11-15T01:33:56.861447+0000","last_clean":"2023-11-15T01:33:56.861447+0000","last_became_active":"2023-11-15T01:33:56.478179+0000","last_became_peered":"2023-11-15T01:33:56.478179+0000","last_unstale":"2023-11-15T01:33:56.861447+0000","last_undegraded":"2023-11-15T01:33:56.861447+0000","last_fullsized":"2023-11-15T01:33:56.861447+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875001+0000","last_change":"2023-11-15T01:33:56.482375+0000","last_active":"2023-11-15T01:33:56.875001+0000","last_peered":"2023-11-15T01:33:56.875001+0000","last_clean":"2023-11-15T01:33:56.875001+0000","last_became_active":"2023-11-15T01:33:56.481858+0000","last_became_peered":"2023-11-15T01:33:56.481858+0000","last_unstale":"2023-11-15T01:33:56.875001+0000","last_undegraded":"2023-11-15T01:33:56.875001+0000","last_fullsized":"2023-11-15T01:33:56.875001+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874619+0000","last_change":"2023-11-15T01:33:56.871814+0000","last_active":"2023-11-15T01:33:56.874619+0000","last_peered":"2023-11-15T01:33:56.874619+0000","last_clean":"2023-11-15T01:33:56.874619+0000","last_became_active":"2023-11-15T01:33:56.871595+0000","last_became_peered":"2023-11-15T01:33:56.871595+0000","last_unstale":"2023-11-15T01:33:56.874619+0000","last_undegraded":"2023-11-15T01:33:56.874619+0000","last_fullsized":"2023-11-15T01:33:56.874619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861088+0000","last_change":"2023-11-15T01:33:56.481949+0000","last_active":"2023-11-15T01:33:56.861088+0000","last_peered":"2023-11-15T01:33:56.861088+0000","last_clean":"2023-11-15T01:33:56.861088+0000","last_became_active":"2023-11-15T01:33:56.481665+0000","last_became_peered":"2023-11-15T01:33:56.481665+0000","last_unstale":"2023-11-15T01:33:56.861088+0000","last_undegraded":"2023-11-15T01:33:56.861088+0000","last_fullsized":"2023-11-15T01:33:56.861088+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851271+0000","last_change":"2023-11-15T01:33:56.470153+0000","last_active":"2023-11-15T01:33:56.851271+0000","last_peered":"2023-11-15T01:33:56.851271+0000","last_clean":"2023-11-15T01:33:56.851271+0000","last_became_active":"2023-11-15T01:33:56.469808+0000","last_became_peered":"2023-11-15T01:33:56.469808+0000","last_unstale":"2023-11-15T01:33:56.851271+0000","last_undegraded":"2023-11-15T01:33:56.851271+0000","last_fullsized":"2023-11-15T01:33:56.851271+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868562+0000","last_change":"2023-11-15T01:33:56.864069+0000","last_active":"2023-11-15T01:33:56.868562+0000","last_peered":"2023-11-15T01:33:56.868562+0000","last_clean":"2023-11-15T01:33:56.868562+0000","last_became_active":"2023-11-15T01:33:56.863785+0000","last_became_peered":"2023-11-15T01:33:56.863785+0000","last_unstale":"2023-11-15T01:33:56.868562+0000","last_undegraded":"2023-11-15T01:33:56.868562+0000","last_fullsized":"2023-11-15T01:33:56.868562+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874463+0000","last_change":"2023-11-15T01:33:56.867683+0000","last_active":"2023-11-15T01:33:56.874463+0000","last_peered":"2023-11-15T01:33:56.874463+0000","last_clean":"2023-11-15T01:33:56.874463+0000","last_became_active":"2023-11-15T01:33:56.867411+0000","last_became_peered":"2023-11-15T01:33:56.867411+0000","last_unstale":"2023-11-15T01:33:56.874463+0000","last_undegraded":"2023-11-15T01:33:56.874463+0000","last_fullsized":"2023-11-15T01:33:56.874463+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861967+0000","last_change":"2023-11-15T01:33:56.471011+0000","last_active":"2023-11-15T01:33:56.861967+0000","last_peered":"2023-11-15T01:33:56.861967+0000","last_clean":"2023-11-15T01:33:56.861967+0000","last_became_active":"2023-11-15T01:33:56.470697+0000","last_became_peered":"2023-11-15T01:33:56.470697+0000","last_unstale":"2023-11-15T01:33:56.861967+0000","last_undegraded":"2023-11-15T01:33:56.861967+0000","last_fullsized":"2023-11-15T01:33:56.861967+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873817+0000","last_change":"2023-11-15T01:33:56.475311+0000","last_active":"2023-11-15T01:33:56.873817+0000","last_peered":"2023-11-15T01:33:56.873817+0000","last_clean":"2023-11-15T01:33:56.873817+0000","last_became_active":"2023-11-15T01:33:56.475060+0000","last_became_peered":"2023-11-15T01:33:56.475060+0000","last_unstale":"2023-11-15T01:33:56.873817+0000","last_undegraded":"2023-11-15T01:33:56.873817+0000","last_fullsized":"2023-11-15T01:33:56.873817+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860992+0000","last_change":"2023-11-15T01:33:56.464027+0000","last_active":"2023-11-15T01:33:56.860992+0000","last_peered":"2023-11-15T01:33:56.860992+0000","last_clean":"2023-11-15T01:33:56.860992+0000","last_became_active":"2023-11-15T01:33:56.463227+0000","last_became_peered":"2023-11-15T01:33:56.463227+0000","last_unstale":"2023-11-15T01:33:56.860992+0000","last_undegraded":"2023-11-15T01:33:56.860992+0000","last_fullsized":"2023-11-15T01:33:56.860992+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875574+0000","last_change":"2023-11-15T01:33:56.872932+0000","last_active":"2023-11-15T01:33:56.875574+0000","last_peered":"2023-11-15T01:33:56.875574+0000","last_clean":"2023-11-15T01:33:56.875574+0000","last_became_active":"2023-11-15T01:33:56.872658+0000","last_became_peered":"2023-11-15T01:33:56.872658+0000","last_unstale":"2023-11-15T01:33:56.875574+0000","last_undegraded":"2023-11-15T01:33:56.875574+0000","last_fullsized":"2023-11-15T01:33:56.875574+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875262+0000","last_change":"2023-11-15T01:33:56.870228+0000","last_active":"2023-11-15T01:33:56.875262+0000","last_peered":"2023-11-15T01:33:56.875262+0000","last_clean":"2023-11-15T01:33:56.875262+0000","last_became_active":"2023-11-15T01:33:56.869836+0000","last_became_peered":"2023-11-15T01:33:56.869836+0000","last_unstale":"2023-11-15T01:33:56.875262+0000","last_undegraded":"2023-11-15T01:33:56.875262+0000","last_fullsized":"2023-11-15T01:33:56.875262+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868693+0000","last_change":"2023-11-15T01:33:56.862035+0000","last_active":"2023-11-15T01:33:56.868693+0000","last_peered":"2023-11-15T01:33:56.868693+0000","last_clean":"2023-11-15T01:33:56.868693+0000","last_became_active":"2023-11-15T01:33:56.861779+0000","last_became_peered":"2023-11-15T01:33:56.861779+0000","last_unstale":"2023-11-15T01:33:56.868693+0000","last_undegraded":"2023-11-15T01:33:56.868693+0000","last_fullsized":"2023-11-15T01:33:56.868693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.871737+0000","last_change":"2023-11-15T01:33:56.868549+0000","last_active":"2023-11-15T01:33:56.871737+0000","last_peered":"2023-11-15T01:33:56.871737+0000","last_clean":"2023-11-15T01:33:56.871737+0000","last_became_active":"2023-11-15T01:33:56.868252+0000","last_became_peered":"2023-11-15T01:33:56.868252+0000","last_unstale":"2023-11-15T01:33:56.871737+0000","last_undegraded":"2023-11-15T01:33:56.871737+0000","last_fullsized":"2023-11-15T01:33:56.871737+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.862190+0000","last_change":"2023-11-15T01:33:56.472202+0000","last_active":"2023-11-15T01:33:56.862190+0000","last_peered":"2023-11-15T01:33:56.862190+0000","last_clean":"2023-11-15T01:33:56.862190+0000","last_became_active":"2023-11-15T01:33:56.471917+0000","last_became_peered":"2023-11-15T01:33:56.471917+0000","last_unstale":"2023-11-15T01:33:56.862190+0000","last_undegraded":"2023-11-15T01:33:56.862190+0000","last_fullsized":"2023-11-15T01:33:56.862190+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.872641+0000","last_change":"2023-11-15T01:33:56.867048+0000","last_active":"2023-11-15T01:33:56.872641+0000","last_peered":"2023-11-15T01:33:56.872641+0000","last_clean":"2023-11-15T01:33:56.872641+0000","last_became_active":"2023-11-15T01:33:56.866783+0000","last_became_peered":"2023-11-15T01:33:56.866783+0000","last_unstale":"2023-11-15T01:33:56.872641+0000","last_undegraded":"2023-11-15T01:33:56.872641+0000","last_fullsized":"2023-11-15T01:33:56.872641+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874059+0000","last_change":"2023-11-15T01:33:56.866406+0000","last_active":"2023-11-15T01:33:56.874059+0000","last_peered":"2023-11-15T01:33:56.874059+0000","last_clean":"2023-11-15T01:33:56.874059+0000","last_became_active":"2023-11-15T01:33:56.866163+0000","last_became_peered":"2023-11-15T01:33:56.866163+0000","last_unstale":"2023-11-15T01:33:56.874059+0000","last_undegraded":"2023-11-15T01:33:56.874059+0000","last_fullsized":"2023-11-15T01:33:56.874059+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851225+0000","last_change":"2023-11-15T01:33:56.473005+0000","last_active":"2023-11-15T01:33:56.851225+0000","last_peered":"2023-11-15T01:33:56.851225+0000","last_clean":"2023-11-15T01:33:56.851225+0000","last_became_active":"2023-11-15T01:33:56.472763+0000","last_became_peered":"2023-11-15T01:33:56.472763+0000","last_unstale":"2023-11-15T01:33:56.851225+0000","last_undegraded":"2023-11-15T01:33:56.851225+0000","last_fullsized":"2023-11-15T01:33:56.851225+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875176+0000","last_change":"2023-11-15T01:33:56.866140+0000","last_active":"2023-11-15T01:33:56.875176+0000","last_peered":"2023-11-15T01:33:56.875176+0000","last_clean":"2023-11-15T01:33:56.875176+0000","last_became_active":"2023-11-15T01:33:56.865926+0000","last_became_peered":"2023-11-15T01:33:56.865926+0000","last_unstale":"2023-11-15T01:33:56.875176+0000","last_undegraded":"2023-11-15T01:33:56.875176+0000","last_fullsized":"2023-11-15T01:33:56.875176+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861741+0000","last_change":"2023-11-15T01:33:56.467225+0000","last_active":"2023-11-15T01:33:56.861741+0000","last_peered":"2023-11-15T01:33:56.861741+0000","last_clean":"2023-11-15T01:33:56.861741+0000","last_became_active":"2023-11-15T01:33:56.466935+0000","last_became_peered":"2023-11-15T01:33:56.466935+0000","last_unstale":"2023-11-15T01:33:56.861741+0000","last_undegraded":"2023-11-15T01:33:56.861741+0000","last_fullsized":"2023-11-15T01:33:56.861741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869183+0000","last_change":"2023-11-15T01:33:56.858217+0000","last_active":"2023-11-15T01:33:56.869183+0000","last_peered":"2023-11-15T01:33:56.869183+0000","last_clean":"2023-11-15T01:33:56.869183+0000","last_became_active":"2023-11-15T01:33:56.857955+0000","last_became_peered":"2023-11-15T01:33:56.857955+0000","last_unstale":"2023-11-15T01:33:56.869183+0000","last_undegraded":"2023-11-15T01:33:56.869183+0000","last_fullsized":"2023-11-15T01:33:56.869183+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859995+0000","last_change":"2023-11-15T01:33:56.456359+0000","last_active":"2023-11-15T01:33:56.859995+0000","last_peered":"2023-11-15T01:33:56.859995+0000","last_clean":"2023-11-15T01:33:56.859995+0000","last_became_active":"2023-11-15T01:33:56.456028+0000","last_became_peered":"2023-11-15T01:33:56.456028+0000","last_unstale":"2023-11-15T01:33:56.859995+0000","last_undegraded":"2023-11-15T01:33:56.859995+0000","last_fullsized":"2023-11-15T01:33:56.859995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875552+0000","last_change":"2023-11-15T01:33:56.872876+0000","last_active":"2023-11-15T01:33:56.875552+0000","last_peered":"2023-11-15T01:33:56.875552+0000","last_clean":"2023-11-15T01:33:56.875552+0000","last_became_active":"2023-11-15T01:33:56.872293+0000","last_became_peered":"2023-11-15T01:33:56.872293+0000","last_unstale":"2023-11-15T01:33:56.875552+0000","last_undegraded":"2023-11-15T01:33:56.875552+0000","last_fullsized":"2023-11-15T01:33:56.875552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859583+0000","last_change":"2023-11-15T01:33:56.463826+0000","last_active":"2023-11-15T01:33:56.859583+0000","last_peered":"2023-11-15T01:33:56.859583+0000","last_clean":"2023-11-15T01:33:56.859583+0000","last_became_active":"2023-11-15T01:33:56.463164+0000","last_became_peered":"2023-11-15T01:33:56.463164+0000","last_unstale":"2023-11-15T01:33:56.859583+0000","last_undegraded":"2023-11-15T01:33:56.859583+0000","last_fullsized":"2023-11-15T01:33:56.859583+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874768+0000","last_change":"2023-11-15T01:33:56.867465+0000","last_active":"2023-11-15T01:33:56.874768+0000","last_peered":"2023-11-15T01:33:56.874768+0000","last_clean":"2023-11-15T01:33:56.874768+0000","last_became_active":"2023-11-15T01:33:56.867152+0000","last_became_peered":"2023-11-15T01:33:56.867152+0000","last_unstale":"2023-11-15T01:33:56.874768+0000","last_undegraded":"2023-11-15T01:33:56.874768+0000","last_fullsized":"2023-11-15T01:33:56.874768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877547+0000","last_change":"2023-11-15T01:33:56.470412+0000","last_active":"2023-11-15T01:33:56.877547+0000","last_peered":"2023-11-15T01:33:56.877547+0000","last_clean":"2023-11-15T01:33:56.877547+0000","last_became_active":"2023-11-15T01:33:56.469983+0000","last_became_peered":"2023-11-15T01:33:56.469983+0000","last_unstale":"2023-11-15T01:33:56.877547+0000","last_undegraded":"2023-11-15T01:33:56.877547+0000","last_fullsized":"2023-11-15T01:33:56.877547+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.878036+0000","last_change":"2023-11-15T01:33:56.467785+0000","last_active":"2023-11-15T01:33:56.878036+0000","last_peered":"2023-11-15T01:33:56.878036+0000","last_clean":"2023-11-15T01:33:56.878036+0000","last_became_active":"2023-11-15T01:33:56.467489+0000","last_became_peered":"2023-11-15T01:33:56.467489+0000","last_unstale":"2023-11-15T01:33:56.878036+0000","last_undegraded":"2023-11-15T01:33:56.878036+0000","last_fullsized":"2023-11-15T01:33:56.878036+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874082+0000","last_change":"2023-11-15T01:33:56.867055+0000","last_active":"2023-11-15T01:33:56.874082+0000","last_peered":"2023-11-15T01:33:56.874082+0000","last_clean":"2023-11-15T01:33:56.874082+0000","last_became_active":"2023-11-15T01:33:56.865917+0000","last_became_peered":"2023-11-15T01:33:56.865917+0000","last_unstale":"2023-11-15T01:33:56.874082+0000","last_undegraded":"2023-11-15T01:33:56.874082+0000","last_fullsized":"2023-11-15T01:33:56.874082+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868778+0000","last_change":"2023-11-15T01:33:56.865296+0000","last_active":"2023-11-15T01:33:56.868778+0000","last_peered":"2023-11-15T01:33:56.868778+0000","last_clean":"2023-11-15T01:33:56.868778+0000","last_became_active":"2023-11-15T01:33:56.864996+0000","last_became_peered":"2023-11-15T01:33:56.864996+0000","last_unstale":"2023-11-15T01:33:56.868778+0000","last_undegraded":"2023-11-15T01:33:56.868778+0000","last_fullsized":"2023-11-15T01:33:56.868778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875197+0000","last_change":"2023-11-15T01:33:56.866585+0000","last_active":"2023-11-15T01:33:56.875197+0000","last_peered":"2023-11-15T01:33:56.875197+0000","last_clean":"2023-11-15T01:33:56.875197+0000","last_became_active":"2023-11-15T01:33:56.866281+0000","last_became_peered":"2023-11-15T01:33:56.866281+0000","last_unstale":"2023-11-15T01:33:56.875197+0000","last_undegraded":"2023-11-15T01:33:56.875197+0000","last_fullsized":"2023-11-15T01:33:56.875197+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876043+0000","last_change":"2023-11-15T01:33:56.470274+0000","last_active":"2023-11-15T01:33:56.876043+0000","last_peered":"2023-11-15T01:33:56.876043+0000","last_clean":"2023-11-15T01:33:56.876043+0000","last_became_active":"2023-11-15T01:33:56.469919+0000","last_became_peered":"2023-11-15T01:33:56.469919+0000","last_unstale":"2023-11-15T01:33:56.876043+0000","last_undegraded":"2023-11-15T01:33:56.876043+0000","last_fullsized":"2023-11-15T01:33:56.876043+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868787+0000","last_change":"2023-11-15T01:33:56.861760+0000","last_active":"2023-11-15T01:33:56.868787+0000","last_peered":"2023-11-15T01:33:56.868787+0000","last_clean":"2023-11-15T01:33:56.868787+0000","last_became_active":"2023-11-15T01:33:56.861490+0000","last_became_peered":"2023-11-15T01:33:56.861490+0000","last_unstale":"2023-11-15T01:33:56.868787+0000","last_undegraded":"2023-11-15T01:33:56.868787+0000","last_fullsized":"2023-11-15T01:33:56.868787+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875430+0000","last_change":"2023-11-15T01:33:56.468949+0000","last_active":"2023-11-15T01:33:56.875430+0000","last_peered":"2023-11-15T01:33:56.875430+0000","last_clean":"2023-11-15T01:33:56.875430+0000","last_became_active":"2023-11-15T01:33:56.468359+0000","last_became_peered":"2023-11-15T01:33:56.468359+0000","last_unstale":"2023-11-15T01:33:56.875430+0000","last_undegraded":"2023-11-15T01:33:56.875430+0000","last_fullsized":"2023-11-15T01:33:56.875430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870248+0000","last_change":"2023-11-15T01:33:56.466299+0000","last_active":"2023-11-15T01:33:56.870248+0000","last_peered":"2023-11-15T01:33:56.870248+0000","last_clean":"2023-11-15T01:33:56.870248+0000","last_became_active":"2023-11-15T01:33:56.465916+0000","last_became_peered":"2023-11-15T01:33:56.465916+0000","last_unstale":"2023-11-15T01:33:56.870248+0000","last_undegraded":"2023-11-15T01:33:56.870248+0000","last_fullsized":"2023-11-15T01:33:56.870248+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851553+0000","last_change":"2023-11-15T01:33:56.474219+0000","last_active":"2023-11-15T01:33:56.851553+0000","last_peered":"2023-11-15T01:33:56.851553+0000","last_clean":"2023-11-15T01:33:56.851553+0000","last_became_active":"2023-11-15T01:33:56.473738+0000","last_became_peered":"2023-11-15T01:33:56.473738+0000","last_unstale":"2023-11-15T01:33:56.851553+0000","last_undegraded":"2023-11-15T01:33:56.851553+0000","last_fullsized":"2023-11-15T01:33:56.851553+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877515+0000","last_change":"2023-11-15T01:33:56.867511+0000","last_active":"2023-11-15T01:33:56.877515+0000","last_peered":"2023-11-15T01:33:56.877515+0000","last_clean":"2023-11-15T01:33:56.877515+0000","last_became_active":"2023-11-15T01:33:56.867228+0000","last_became_peered":"2023-11-15T01:33:56.867228+0000","last_unstale":"2023-11-15T01:33:56.877515+0000","last_undegraded":"2023-11-15T01:33:56.877515+0000","last_fullsized":"2023-11-15T01:33:56.877515+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860126+0000","last_change":"2023-11-15T01:33:56.478983+0000","last_active":"2023-11-15T01:33:56.860126+0000","last_peered":"2023-11-15T01:33:56.860126+0000","last_clean":"2023-11-15T01:33:56.860126+0000","last_became_active":"2023-11-15T01:33:56.478740+0000","last_became_peered":"2023-11-15T01:33:56.478740+0000","last_unstale":"2023-11-15T01:33:56.860126+0000","last_undegraded":"2023-11-15T01:33:56.860126+0000","last_fullsized":"2023-11-15T01:33:56.860126+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861834+0000","last_change":"2023-11-15T01:33:56.468488+0000","last_active":"2023-11-15T01:33:56.861834+0000","last_peered":"2023-11-15T01:33:56.861834+0000","last_clean":"2023-11-15T01:33:56.861834+0000","last_became_active":"2023-11-15T01:33:56.468185+0000","last_became_peered":"2023-11-15T01:33:56.468185+0000","last_unstale":"2023-11-15T01:33:56.861834+0000","last_undegraded":"2023-11-15T01:33:56.861834+0000","last_fullsized":"2023-11-15T01:33:56.861834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877540+0000","last_change":"2023-11-15T01:33:56.871264+0000","last_active":"2023-11-15T01:33:56.877540+0000","last_peered":"2023-11-15T01:33:56.877540+0000","last_clean":"2023-11-15T01:33:56.877540+0000","last_became_active":"2023-11-15T01:33:56.870999+0000","last_became_peered":"2023-11-15T01:33:56.870999+0000","last_unstale":"2023-11-15T01:33:56.877540+0000","last_undegraded":"2023-11-15T01:33:56.877540+0000","last_fullsized":"2023-11-15T01:33:56.877540+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.751121+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:33:51.751121+0000","last_peered":"2023-11-15T01:33:51.751121+0000","last_clean":"2023-11-15T01:33:51.751121+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:33:51.751121+0000","last_undegraded":"2023-11-15T01:33:51.751121+0000","last_fullsized":"2023-11-15T01:33:51.751121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.750218+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:33:51.750218+0000","last_peered":"2023-11-15T01:33:51.750218+0000","last_clean":"2023-11-15T01:33:51.750218+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:33:51.750218+0000","last_undegraded":"2023-11-15T01:33:51.750218+0000","last_fullsized":"2023-11-15T01:33:51.750218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870739+0000","last_change":"2023-11-15T01:33:56.861357+0000","last_active":"2023-11-15T01:33:56.870739+0000","last_peered":"2023-11-15T01:33:56.870739+0000","last_clean":"2023-11-15T01:33:56.870739+0000","last_became_active":"2023-11-15T01:33:56.861060+0000","last_became_peered":"2023-11-15T01:33:56.861060+0000","last_unstale":"2023-11-15T01:33:56.870739+0000","last_undegraded":"2023-11-15T01:33:56.870739+0000","last_fullsized":"2023-11-15T01:33:56.870739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859580+0000","last_change":"2023-11-15T01:33:56.462711+0000","last_active":"2023-11-15T01:33:56.859580+0000","last_peered":"2023-11-15T01:33:56.859580+0000","last_clean":"2023-11-15T01:33:56.859580+0000","last_became_active":"2023-11-15T01:33:56.462463+0000","last_became_peered":"2023-11-15T01:33:56.462463+0000","last_unstale":"2023-11-15T01:33:56.859580+0000","last_undegraded":"2023-11-15T01:33:56.859580+0000","last_fullsized":"2023-11-15T01:33:56.859580+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.863559+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:33:56.863559+0000","last_peered":"2023-11-15T01:33:56.863559+0000","last_clean":"2023-11-15T01:33:56.863559+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:33:56.863559+0000","last_undegraded":"2023-11-15T01:33:56.863559+0000","last_fullsized":"2023-11-15T01:33:56.863559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860345+0000","last_change":"2023-11-15T01:33:56.467702+0000","last_active":"2023-11-15T01:33:56.860345+0000","last_peered":"2023-11-15T01:33:56.860345+0000","last_clean":"2023-11-15T01:33:56.860345+0000","last_became_active":"2023-11-15T01:33:56.467346+0000","last_became_peered":"2023-11-15T01:33:56.467346+0000","last_unstale":"2023-11-15T01:33:56.860345+0000","last_undegraded":"2023-11-15T01:33:56.860345+0000","last_fullsized":"2023-11-15T01:33:56.860345+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.750218+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:33:51.750218+0000","last_peered":"2023-11-15T01:33:51.750218+0000","last_clean":"2023-11-15T01:33:51.750218+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:33:51.750218+0000","last_undegraded":"2023-11-15T01:33:51.750218+0000","last_fullsized":"2023-11-15T01:33:51.750218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.750311+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:33:51.750311+0000","last_peered":"2023-11-15T01:33:51.750311+0000","last_clean":"2023-11-15T01:33:51.750311+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:33:51.750311+0000","last_undegraded":"2023-11-15T01:33:51.750311+0000","last_fullsized":"2023-11-15T01:33:51.750311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.750299+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:33:51.750299+0000","last_peered":"2023-11-15T01:33:51.750299+0000","last_clean":"2023-11-15T01:33:51.750299+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:33:51.750299+0000","last_undegraded":"2023-11-15T01:33:51.750299+0000","last_fullsized":"2023-11-15T01:33:51.750299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873538+0000","last_change":"2023-11-15T01:33:56.872687+0000","last_active":"2023-11-15T01:33:56.873538+0000","last_peered":"2023-11-15T01:33:56.873538+0000","last_clean":"2023-11-15T01:33:56.873538+0000","last_became_active":"2023-11-15T01:33:56.872163+0000","last_became_peered":"2023-11-15T01:33:56.872163+0000","last_unstale":"2023-11-15T01:33:56.873538+0000","last_undegraded":"2023-11-15T01:33:56.873538+0000","last_fullsized":"2023-11-15T01:33:56.873538+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:55.438893+0000","last_change":"2023-11-15T01:33:55.438893+0000","last_active":"2023-11-15T01:33:55.438893+0000","last_peered":"2023-11-15T01:33:55.438893+0000","last_clean":"2023-11-15T01:33:55.438893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:55.438893+0000","last_undegraded":"2023-11-15T01:33:55.438893+0000","last_fullsized":"2023-11-15T01:33:55.438893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.750298+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:33:51.750298+0000","last_peered":"2023-11-15T01:33:51.750298+0000","last_clean":"2023-11-15T01:33:51.750298+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:33:51.750298+0000","last_undegraded":"2023-11-15T01:33:51.750298+0000","last_fullsized":"2023-11-15T01:33:51.750298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873310+0000","last_change":"2023-11-15T01:33:56.865528+0000","last_active":"2023-11-15T01:33:56.873310+0000","last_peered":"2023-11-15T01:33:56.873310+0000","last_clean":"2023-11-15T01:33:56.873310+0000","last_became_active":"2023-11-15T01:33:56.865239+0000","last_became_peered":"2023-11-15T01:33:56.865239+0000","last_unstale":"2023-11-15T01:33:56.873310+0000","last_undegraded":"2023-11-15T01:33:56.873310+0000","last_fullsized":"2023-11-15T01:33:56.873310+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.852317+0000","last_change":"2023-11-15T01:33:56.470793+0000","last_active":"2023-11-15T01:33:56.852317+0000","last_peered":"2023-11-15T01:33:56.852317+0000","last_clean":"2023-11-15T01:33:56.852317+0000","last_became_active":"2023-11-15T01:33:56.469938+0000","last_became_peered":"2023-11-15T01:33:56.469938+0000","last_unstale":"2023-11-15T01:33:56.852317+0000","last_undegraded":"2023-11-15T01:33:56.852317+0000","last_fullsized":"2023-11-15T01:33:56.852317+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.751151+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:33:51.751151+0000","last_peered":"2023-11-15T01:33:51.751151+0000","last_clean":"2023-11-15T01:33:51.751151+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:33:51.751151+0000","last_undegraded":"2023-11-15T01:33:51.751151+0000","last_fullsized":"2023-11-15T01:33:51.751151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:33:56.443699+0000","last_change":"2023-11-15T01:33:56.443699+0000","last_active":"2023-11-15T01:33:56.443699+0000","last_peered":"2023-11-15T01:33:56.443699+0000","last_clean":"2023-11-15T01:33:56.443699+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:33:56.443699+0000","last_undegraded":"2023-11-15T01:33:56.443699+0000","last_fullsized":"2023-11-15T01:33:56.443699+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851763+0000","last_change":"2023-11-15T01:33:56.476704+0000","last_active":"2023-11-15T01:33:56.851763+0000","last_peered":"2023-11-15T01:33:56.851763+0000","last_clean":"2023-11-15T01:33:56.851763+0000","last_became_active":"2023-11-15T01:33:56.476357+0000","last_became_peered":"2023-11-15T01:33:56.476357+0000","last_unstale":"2023-11-15T01:33:56.851763+0000","last_undegraded":"2023-11-15T01:33:56.851763+0000","last_fullsized":"2023-11-15T01:33:56.851763+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-15T01:33:51.372385+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:33:51.372385+0000","last_peered":"2023-11-15T01:33:51.372385+0000","last_clean":"2023-11-15T01:33:51.372385+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:33:51.372385+0000","last_undegraded":"2023-11-15T01:33:51.372385+0000","last_fullsized":"2023-11-15T01:33:51.372385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":700,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":58,"acting":58,"num_store_stats":3},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574998,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.40400000000000003,"5min":0.38300000000000001,"15min":0.28199999999999997},"max":{"1min":0.69399999999999995,"5min":0.81499999999999995,"15min":0.82299999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58299999999999996,"15min":0.55900000000000005},"min":{"1min":0.44500000000000001,"5min":0.34499999999999997,"15min":0.31},"max":{"1min":0.72999999999999998,"5min":0.79500000000000004,"15min":0.83299999999999996},"last":0.59399999999999997}]},{"osd":1,"last update":"Wed Nov 15 01:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.77700000000000002},"last":0.505},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56499999999999995,"15min":0.54200000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68300000000000005,"5min":0.78000000000000003,"15min":0.81499999999999995},"last":0.58299999999999996}]},{"osd":2,"last update":"Wed Nov 15 01:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69399999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.58799999999999997},"min":{"1min":0.45600000000000002,"5min":0.40600000000000003,"15min":0.37},"max":{"1min":0.77700000000000002,"5min":0.82199999999999995,"15min":0.86299999999999999},"last":0.55800000000000005}]},{"osd":3,"last update":"Wed Nov 15 01:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.375},"max":{"1min":0.73799999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.50700000000000001,"5min":0.42099999999999999,"15min":0.371},"max":{"1min":0.76700000000000002,"5min":0.77600000000000002,"15min":0.81200000000000006},"last":0.48299999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45500000000000002,"15min":0.47099999999999997},"min":{"1min":0.30399999999999999,"5min":0.30299999999999999,"15min":0.29099999999999998},"max":{"1min":0.63200000000000001,"5min":0.68100000000000005,"15min":0.84499999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.68000000000000005,"5min":0.74399999999999999,"15min":0.83799999999999997},"last":0.35199999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48399999999999999,"15min":0.497},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.29999999999999999},"max":{"1min":0.58999999999999997,"5min":0.76600000000000001,"15min":0.77500000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.502},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.314},"max":{"1min":0.67400000000000004,"5min":0.748,"15min":0.78500000000000003},"last":0.33500000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.65400000000000003,"5min":0.78600000000000003,"15min":0.82299999999999995},"last":0.373},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52800000000000002,"15min":0.55200000000000005},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.31900000000000001},"max":{"1min":0.65500000000000003,"5min":0.76900000000000002,"15min":0.85099999999999998},"last":0.31900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574999,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301852,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069988,"statfs":{"total":96636764160,"available":96327667712,"internally_reserved":0,"allocated":675840,"data_stored":324221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.39800000000000002,"5min":0.34000000000000002,"15min":0.29199999999999998},"max":{"1min":0.63600000000000001,"5min":0.82399999999999995,"15min":0.94299999999999995},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55000000000000004,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.34499999999999997,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.75600000000000001,"15min":0.97799999999999998},"last":0.78000000000000003}]},{"osd":1,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.38700000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":1.0649999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57299999999999995,"15min":0.54700000000000004},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.84699999999999998,"15min":1.022},"last":0.76700000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.71999999999999997,"5min":0.84199999999999997,"15min":1.038},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70499999999999996,"5min":0.80700000000000005,"15min":0.995},"last":0.71099999999999997}]},{"osd":3,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.41299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.69399999999999995,"5min":0.91300000000000003,"15min":1.028},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68500000000000005,"5min":0.874,"15min":1.004},"last":0.69599999999999995}]},{"osd":4,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.314,"5min":0.31,"15min":0.26600000000000001},"max":{"1min":0.67900000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.25800000000000001},"max":{"1min":0.67500000000000004,"5min":0.68799999999999994,"15min":0.81799999999999995},"last":0.73299999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.312},"max":{"1min":0.68500000000000005,"5min":0.69799999999999995,"15min":0.74099999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.73799999999999999,"5min":0.79200000000000004,"15min":0.79900000000000004},"last":0.82599999999999996}]},{"osd":7,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.377,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":0.70499999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.41399999999999998,"15min":0.34000000000000002},"max":{"1min":0.72799999999999998,"5min":0.81299999999999994,"15min":1.0009999999999999},"last":0.81699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575000,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301852,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069988,"statfs":{"total":96636764160,"available":96327667712,"internally_reserved":0,"allocated":675840,"data_stored":324221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23999999999999999},"max":{"1min":0.54900000000000004,"5min":0.64500000000000002,"15min":0.77800000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41199999999999998,"15min":0.38500000000000001},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.247},"max":{"1min":0.55500000000000005,"5min":0.65600000000000003,"15min":0.73099999999999998},"last":0.32400000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.40400000000000003,"15min":0.38700000000000001},"min":{"1min":0.29299999999999998,"5min":0.27800000000000002,"15min":0.22600000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.69599999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45100000000000001,"15min":0.434},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.90000000000000002},"last":0.36799999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.502,"15min":0.48099999999999998},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.31},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":1.0009999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.48799999999999999,"15min":0.45600000000000002},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.28000000000000003},"max":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.75600000000000001},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79400000000000004,"5min":0.82299999999999995,"15min":0.89300000000000002},"last":0.501},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.65200000000000002,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":0.78200000000000003,"5min":0.88700000000000001,"15min":1.0509999999999999},"last":0.433}]},{"osd":5,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65000000000000002,"15min":0.626},"min":{"1min":0.432,"5min":0.40100000000000002,"15min":0.38500000000000001},"max":{"1min":0.78100000000000003,"5min":0.83399999999999996,"15min":0.92700000000000005},"last":0.62},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66000000000000003,"15min":0.63},"min":{"1min":0.46400000000000002,"5min":0.433,"15min":0.373},"max":{"1min":0.91700000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47299999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68600000000000005,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82199999999999995,"5min":0.90900000000000003,"15min":1.0029999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.67500000000000004},"min":{"1min":0.51300000000000001,"5min":0.45200000000000001,"15min":0.41199999999999998},"max":{"1min":0.90100000000000002,"5min":0.96599999999999997,"15min":0.996},"last":0.441}]},{"osd":7,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70599999999999996,"15min":0.68200000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88500000000000001,"5min":0.93899999999999995,"15min":1.25},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70399999999999996,"15min":0.67700000000000005},"min":{"1min":0.52200000000000002,"5min":0.495,"15min":0.46100000000000002},"max":{"1min":0.92200000000000004,"5min":0.96699999999999997,"15min":0.99199999999999999},"last":0.58699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301912,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069928,"statfs":{"total":96636764160,"available":96327606272,"internally_reserved":0,"allocated":737280,"data_stored":352714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.36199999999999999,"15min":0.35899999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.50700000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.41599999999999998,"15min":0.40200000000000002},"min":{"1min":0.26300000000000001,"5min":0.252,"15min":0.215},"max":{"1min":0.50600000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.33100000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.39400000000000002,"15min":0.378},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.505,"5min":0.60499999999999998,"15min":0.64200000000000002},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.42599999999999999,"15min":0.42999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.47399999999999998,"5min":0.68600000000000005,"15min":1.0429999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.42999999999999999,"15min":0.41899999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.22500000000000001},"max":{"1min":0.55700000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.311},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.45500000000000002,"15min":0.443},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27700000000000002},"max":{"1min":0.58399999999999996,"5min":0.73199999999999998,"15min":0.83399999999999996},"last":0.34399999999999997}]},{"osd":4,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78800000000000003,"5min":0.97799999999999998,"15min":1.454},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.442},"max":{"1min":0.79300000000000004,"5min":0.94999999999999996,"15min":1.147},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69399999999999995,"5min":1.01,"15min":1.079},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.624,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.73699999999999999,"5min":0.91400000000000003,"15min":1.1120000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":1.2529999999999999},"last":0.496},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.68999999999999995,"5min":1.042,"15min":1.206},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.78100000000000003,"5min":1.0620000000000001,"15min":1.2669999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68200000000000005,"15min":0.69799999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83299999999999996,"5min":0.99199999999999999,"15min":1.4119999999999999},"last":0.65300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065832,"statfs":{"total":96636764160,"available":96323411968,"internally_reserved":0,"allocated":737280,"data_stored":354124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36699999999999999,"15min":0.36199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.221},"max":{"1min":0.48599999999999999,"5min":0.60199999999999998,"15min":0.61899999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.40200000000000002,"15min":0.39400000000000002},"min":{"1min":0.28699999999999998,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.63700000000000001,"15min":0.67800000000000005},"last":0.35199999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":0.70999999999999996,"15min":0.75},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66300000000000003,"5min":0.73499999999999999,"15min":0.92000000000000004},"last":0.38500000000000001}]},{"osd":3,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45600000000000002,"15min":0.438},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.57999999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.42999999999999999},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.253},"max":{"1min":0.66700000000000004,"5min":0.68999999999999995,"15min":0.74199999999999999},"last":0.309}]},{"osd":4,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89000000000000001,"5min":0.90900000000000003,"15min":1.0800000000000001},"last":0.499},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.629,"15min":0.64600000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.95399999999999996,"15min":1.052},"last":0.49099999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.63800000000000001,"15min":0.64500000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.93000000000000005,"15min":0.998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63800000000000001,"15min":0.63600000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.85499999999999998,"5min":0.96099999999999997,"15min":1.1339999999999999},"last":0.436}]},{"osd":6,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65800000000000003,"15min":0.65900000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.91300000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.441,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84199999999999997,"5min":1.016,"15min":1.119},"last":0.47399999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.48399999999999999,"5min":0.45200000000000001,"15min":0.438},"max":{"1min":0.79700000000000004,"5min":1.03,"15min":1.103},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.68600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065832,"statfs":{"total":96636764160,"available":96323411968,"internally_reserved":0,"allocated":737280,"data_stored":353254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39200000000000002,"15min":0.36199999999999999},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.22600000000000001},"max":{"1min":0.53100000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.42199999999999999,"15min":0.38800000000000001},"min":{"1min":0.30299999999999999,"5min":0.29499999999999998,"15min":0.23200000000000001},"max":{"1min":0.54300000000000004,"5min":0.70499999999999996,"15min":0.70899999999999996},"last":0.27900000000000003}]},{"osd":1,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.41099999999999998,"15min":0.377},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.23599999999999999},"max":{"1min":0.59799999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.46500000000000002,"15min":0.441},"min":{"1min":0.372,"5min":0.29399999999999998,"15min":0.28999999999999998},"max":{"1min":0.621,"5min":0.747,"15min":0.80500000000000005},"last":0.33600000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.436},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.26900000000000002},"max":{"1min":0.58799999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.5,"15min":0.46300000000000002},"min":{"1min":0.38900000000000001,"5min":0.35999999999999999,"15min":0.26200000000000001},"max":{"1min":0.64500000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41999999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.42099999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.92600000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.44,"15min":0.39000000000000001},"max":{"1min":0.82699999999999996,"5min":1.036,"15min":1.0589999999999999},"last":0.40600000000000003}]},{"osd":5,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.64400000000000002},"min":{"1min":0.503,"5min":0.48399999999999999,"15min":0.41099999999999998},"max":{"1min":0.80600000000000005,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.44400000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86099999999999999,"5min":0.90100000000000002,"15min":0.95999999999999996},"last":0.41099999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.65200000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.42499999999999999},"max":{"1min":0.94299999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.67800000000000005},"min":{"1min":0.53500000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89600000000000002,"5min":1.0900000000000001,"15min":1.169},"last":0.44900000000000001}]},{"osd":7,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69199999999999995,"15min":0.67400000000000004},"min":{"1min":0.52600000000000002,"5min":0.48399999999999999,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":1.071,"15min":1.071},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.70599999999999996,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.97299999999999998,"5min":1.1319999999999999,"15min":1.1459999999999999},"last":0.45500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297756,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":675840,"data_stored":324221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.55000000000000004},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.88,"15min":0.88},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.74399999999999999,"15min":0.78800000000000003},"last":0.56399999999999995}]},{"osd":1,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57999999999999996,"15min":0.56499999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":0.77500000000000002,"5min":1.087,"15min":1.087},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.80400000000000005,"15min":0.81000000000000005},"last":0.69399999999999995}]},{"osd":2,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":0.70899999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58199999999999996,"15min":0.58299999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66700000000000004}]},{"osd":3,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70099999999999996,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.749,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.502}]},{"osd":5,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.47599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.30399999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.80600000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47499999999999998,"15min":0.501},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":0.68000000000000005,"15min":0.85299999999999998},"last":0.46600000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47199999999999998,"15min":0.50700000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.84199999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.51100000000000001,"15min":0.54100000000000004},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":0.66500000000000004,"5min":0.77600000000000002,"15min":0.83199999999999996},"last":0.74399999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.50800000000000001,"15min":0.53600000000000003},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64300000000000002,"5min":0.873,"15min":0.873},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54800000000000004,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":0.74099999999999999,"5min":0.78400000000000003,"15min":0.90100000000000002},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301852,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069988,"statfs":{"total":96636764160,"available":96327667712,"internally_reserved":0,"allocated":675840,"data_stored":324221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.37,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.44800000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.74199999999999999,"15min":0.81200000000000006},"last":0.41199999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.55200000000000005},"min":{"1min":0.42899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70099999999999996,"5min":0.745,"15min":0.78200000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.40699999999999997,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.69299999999999995,"5min":0.73899999999999999,"15min":0.78000000000000003},"last":0.45300000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.318},"max":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.86199999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39200000000000002,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":1.103},"last":0.38}]},{"osd":3,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.52400000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.78100000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59099999999999997,"15min":0.60199999999999998},"min":{"1min":0.45800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73699999999999999,"5min":0.77300000000000002,"15min":1.127},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.44400000000000001,"15min":0.48299999999999998},"min":{"1min":0.33800000000000002,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.58399999999999996,"5min":0.70699999999999996,"15min":0.94399999999999995},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.54400000000000004},"min":{"1min":0.41399999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70799999999999996,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.54800000000000004}]},{"osd":6,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47099999999999997,"15min":0.502},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.32100000000000001},"max":{"1min":0.65200000000000002,"5min":0.755,"15min":1.0660000000000001},"last":0.441},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.49399999999999999,"15min":0.52400000000000002},"min":{"1min":0.38100000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.751,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.504,"15min":0.52200000000000002},"min":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.73599999999999999,"15min":0.97199999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.435,"5min":0.38300000000000001,"15min":0.33600000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":1.1499999999999999},"last":0.55800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:34:01.255 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:34:01.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.404+0000 7fe432fe4700 1 Processor -- start 2023-11-15T01:34:01.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.404+0000 7fe432fe4700 1 -- start start 2023-11-15T01:34:01.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.405+0000 7fe432fe4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe42c0833a0 0x7fe42c0a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.405+0000 7fe432fe4700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c0a85e0 con 0x7fe42c154450 2023-11-15T01:34:01.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.405+0000 7fe432fe4700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c065660 con 0x7fe42c0be520 2023-11-15T01:34:01.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.405+0000 7fe432fe4700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42c065940 con 0x7fe42c0833a0 2023-11-15T01:34:01.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.405+0000 7fe42bfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe42c0833a0 0x7fe42c0a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.405+0000 7fe430d80700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe42c154450 0x7fe42c0bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58838/0 (socket says 172.21.15.1:58838) 2023-11-15T01:34:01.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.405+0000 7fe430d80700 1 -- 172.21.15.1:0/3017290471 learned_addr learned my addr 172.21.15.1:0/3017290471 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:34:01.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.405+0000 7fe42bfff700 1 -- 172.21.15.1:0/3017290471 >> v1:172.21.15.141:6789/0 conn(0x7fe42c0be520 legacy=0x7fe42c0c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:01.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.405+0000 7fe42b7fe700 1 -- 172.21.15.1:0/3017290471 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782333255 0 0) 0x7fe42c0a85e0 con 0x7fe42c154450 2023-11-15T01:34:01.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.405+0000 7fe42bfff700 1 -- 172.21.15.1:0/3017290471 >> v1:172.21.15.1:6789/0 conn(0x7fe42c154450 legacy=0x7fe42c0bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.405+0000 7fe42bfff700 1 -- 172.21.15.1:0/3017290471 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0c6f50 con 0x7fe42c0833a0 2023-11-15T01:34:01.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.405+0000 7fe42bfff700 1 --2- 172.21.15.1:0/3017290471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c0833a0 0x7fe42c0a7ef0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fe418009760 tx=0x7fe418009060).ready entity=mon.0 client_cookie=f8d47971279400af server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:01.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.406+0000 7fe42b7fe700 1 -- 172.21.15.1:0/3017290471 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41800b580 con 0x7fe42c0833a0 2023-11-15T01:34:01.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.406+0000 7fe42b7fe700 1 -- 172.21.15.1:0/3017290471 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41800b6e0 con 0x7fe42c0833a0 2023-11-15T01:34:01.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.406+0000 7fe42b7fe700 1 -- 172.21.15.1:0/3017290471 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41800ba60 con 0x7fe42c0833a0 2023-11-15T01:34:01.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.406+0000 7fe432fe4700 1 -- 172.21.15.1:0/3017290471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c0833a0 msgr2=0x7fe42c0a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.406+0000 7fe432fe4700 1 --2- 172.21.15.1:0/3017290471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c0833a0 0x7fe42c0a7ef0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fe418009760 tx=0x7fe418009060).stop 2023-11-15T01:34:01.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.406+0000 7fe432fe4700 1 -- 172.21.15.1:0/3017290471 shutdown_connections 2023-11-15T01:34:01.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.406+0000 7fe432fe4700 1 --2- 172.21.15.1:0/3017290471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c0833a0 0x7fe42c0a7ef0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.406+0000 7fe432fe4700 1 -- 172.21.15.1:0/3017290471 >> 172.21.15.1:0/3017290471 conn(0x7fe42c082f90 msgr2=0x7fe42c0c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:01.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.406+0000 7fe432fe4700 1 -- 172.21.15.1:0/3017290471 shutdown_connections 2023-11-15T01:34:01.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.406+0000 7fe432fe4700 1 -- 172.21.15.1:0/3017290471 wait complete. 2023-11-15T01:34:01.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.407+0000 7fe432fe4700 1 Processor -- start 2023-11-15T01:34:01.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.407+0000 7fe432fe4700 1 -- start start 2023-11-15T01:34:01.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.408+0000 7fe432fe4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe42c0833a0 0x7fe42c14f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.408+0000 7fe432fe4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c0be520 0x7fe42c14e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.408+0000 7fe432fe4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe42c154450 0x7fe42c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.408+0000 7fe432fe4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0ace30 con 0x7fe42c0be520 2023-11-15T01:34:01.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.408+0000 7fe432fe4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c1647e0 con 0x7fe42c0833a0 2023-11-15T01:34:01.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.408+0000 7fe432fe4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c164ac0 con 0x7fe42c154450 2023-11-15T01:34:01.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.408+0000 7fe42bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c0be520 0x7fe42c14e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.408+0000 7fe42bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c0be520 0x7fe42c14e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50224/0 (socket says 172.21.15.1:50224) 2023-11-15T01:34:01.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.408+0000 7fe42bfff700 1 -- 172.21.15.1:0/347631924 learned_addr learned my addr 172.21.15.1:0/347631924 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:01.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.408+0000 7fe430d80700 1 --2- 172.21.15.1:0/347631924 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe42c0833a0 0x7fe42c14f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.408+0000 7fe431581700 1 --2- 172.21.15.1:0/347631924 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe42c154450 0x7fe42c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.409+0000 7fe42bfff700 1 -- 172.21.15.1:0/347631924 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe42c154450 msgr2=0x7fe42c0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.409+0000 7fe42bfff700 1 --2- 172.21.15.1:0/347631924 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe42c154450 0x7fe42c0ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.409+0000 7fe42bfff700 1 -- 172.21.15.1:0/347631924 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe42c0833a0 msgr2=0x7fe42c14f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.409+0000 7fe42bfff700 1 --2- 172.21.15.1:0/347631924 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe42c0833a0 0x7fe42c14f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.409+0000 7fe42bfff700 1 -- 172.21.15.1:0/347631924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4180092a0 con 0x7fe42c0be520 2023-11-15T01:34:01.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.409+0000 7fe430d80700 1 --2- 172.21.15.1:0/347631924 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe42c0833a0 0x7fe42c14f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:34:01.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.409+0000 7fe42bfff700 1 --2- 172.21.15.1:0/347631924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c0be520 0x7fe42c14e510 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fe418009eb0 tx=0x7fe418017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:01.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.409+0000 7fe428ff9700 1 -- 172.21.15.1:0/347631924 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41800b850 con 0x7fe42c0be520 2023-11-15T01:34:01.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.409+0000 7fe428ff9700 1 -- 172.21.15.1:0/347631924 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41800b9b0 con 0x7fe42c0be520 2023-11-15T01:34:01.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.409+0000 7fe432fe4700 1 -- 172.21.15.1:0/347631924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c164da0 con 0x7fe42c0be520 2023-11-15T01:34:01.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.409+0000 7fe428ff9700 1 -- 172.21.15.1:0/347631924 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41801b660 con 0x7fe42c0be520 2023-11-15T01:34:01.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.409+0000 7fe432fe4700 1 -- 172.21.15.1:0/347631924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c14fab0 con 0x7fe42c0be520 2023-11-15T01:34:01.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.410+0000 7fe432fe4700 1 -- 172.21.15.1:0/347631924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42c0ad0d0 con 0x7fe42c0be520 2023-11-15T01:34:01.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.410+0000 7fe428ff9700 1 -- 172.21.15.1:0/347631924 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe41801ba50 con 0x7fe42c0be520 2023-11-15T01:34:01.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.411+0000 7fe428ff9700 1 --2- 172.21.15.1:0/347631924 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe41005f270 0x7fe410061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.411+0000 7fe428ff9700 1 -- 172.21.15.1:0/347631924 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7fe41807c1a0 con 0x7fe42c0be520 2023-11-15T01:34:01.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.411+0000 7fe430d80700 1 --2- 172.21.15.1:0/347631924 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe41005f270 0x7fe410061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.411+0000 7fe430d80700 1 --2- 172.21.15.1:0/347631924 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe41005f270 0x7fe410061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe420000c00 tx=0x7fe420009040).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:01.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.415+0000 7fe428ff9700 1 -- 172.21.15.1:0/347631924 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe41804d160 con 0x7fe42c0be520 2023-11-15T01:34:01.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.585+0000 7fe432fe4700 1 -- 172.21.15.1:0/347631924 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe42c065350 con 0x7fe41005f270 2023-11-15T01:34:01.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.595+0000 7fe428ff9700 1 -- 172.21.15.1:0/347631924 <== mgr.5248 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361237 (secure 0 0 0) 0x7fe42c065350 con 0x7fe41005f270 2023-11-15T01:34:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:34:01.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.598+0000 7fe432fe4700 1 -- 172.21.15.1:0/347631924 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe41005f270 msgr2=0x7fe410061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.598+0000 7fe432fe4700 1 --2- 172.21.15.1:0/347631924 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe41005f270 0x7fe410061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe420000c00 tx=0x7fe420009040).stop 2023-11-15T01:34:01.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.598+0000 7fe432fe4700 1 -- 172.21.15.1:0/347631924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c0be520 msgr2=0x7fe42c14e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.598+0000 7fe432fe4700 1 --2- 172.21.15.1:0/347631924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c0be520 0x7fe42c14e510 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fe418009eb0 tx=0x7fe418017000).stop 2023-11-15T01:34:01.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.598+0000 7fe432fe4700 1 -- 172.21.15.1:0/347631924 shutdown_connections 2023-11-15T01:34:01.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.599+0000 7fe432fe4700 1 --2- 172.21.15.1:0/347631924 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe41005f270 0x7fe410061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.599+0000 7fe432fe4700 1 --2- 172.21.15.1:0/347631924 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe42c154450 0x7fe42c0ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.599+0000 7fe432fe4700 1 --2- 172.21.15.1:0/347631924 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe42c0833a0 0x7fe42c14f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.599+0000 7fe432fe4700 1 --2- 172.21.15.1:0/347631924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c0be520 0x7fe42c14e510 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.599+0000 7fe432fe4700 1 -- 172.21.15.1:0/347631924 >> 172.21.15.1:0/347631924 conn(0x7fe42c082f90 msgr2=0x7fe42c0bde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:01.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.599+0000 7fe432fe4700 1 -- 172.21.15.1:0/347631924 shutdown_connections 2023-11-15T01:34:01.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.599+0000 7fe432fe4700 1 -- 172.21.15.1:0/347631924 wait complete. 2023-11-15T01:34:01.609 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:34:01.612 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T01:34:01.415476+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419360,"kb_used_data":5728,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752555360,"statfs":{"total":773094113280,"available":770616688640,"internally_reserved":0,"allocated":5865472,"data_stored":2825316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14985745,"num_objects":-14,"num_object_clones":0,"num_object_copies":-28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-695,"num_write_kb":-15534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.004236"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870192+0000","last_change":"2023-11-15T01:33:56.864024+0000","last_active":"2023-11-15T01:33:56.870192+0000","last_peered":"2023-11-15T01:33:56.870192+0000","last_clean":"2023-11-15T01:33:56.870192+0000","last_became_active":"2023-11-15T01:33:56.863711+0000","last_became_peered":"2023-11-15T01:33:56.863711+0000","last_unstale":"2023-11-15T01:33:56.870192+0000","last_undegraded":"2023-11-15T01:33:56.870192+0000","last_fullsized":"2023-11-15T01:33:56.870192+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"60'3","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874959+0000","last_change":"2023-11-15T01:33:56.471513+0000","last_active":"2023-11-15T01:33:56.874959+0000","last_peered":"2023-11-15T01:33:56.874959+0000","last_clean":"2023-11-15T01:33:56.874959+0000","last_became_active":"2023-11-15T01:33:56.471228+0000","last_became_peered":"2023-11-15T01:33:56.471228+0000","last_unstale":"2023-11-15T01:33:56.874959+0000","last_undegraded":"2023-11-15T01:33:56.874959+0000","last_fullsized":"2023-11-15T01:33:56.874959+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879382+0000","last_change":"2023-11-15T01:33:56.874430+0000","last_active":"2023-11-15T01:33:56.879382+0000","last_peered":"2023-11-15T01:33:56.879382+0000","last_clean":"2023-11-15T01:33:56.879382+0000","last_became_active":"2023-11-15T01:33:56.874133+0000","last_became_peered":"2023-11-15T01:33:56.874133+0000","last_unstale":"2023-11-15T01:33:56.879382+0000","last_undegraded":"2023-11-15T01:33:56.879382+0000","last_fullsized":"2023-11-15T01:33:56.879382+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.857602+0000","last_change":"2023-11-15T01:33:56.472997+0000","last_active":"2023-11-15T01:33:56.857602+0000","last_peered":"2023-11-15T01:33:56.857602+0000","last_clean":"2023-11-15T01:33:56.857602+0000","last_became_active":"2023-11-15T01:33:56.472655+0000","last_became_peered":"2023-11-15T01:33:56.472655+0000","last_unstale":"2023-11-15T01:33:56.857602+0000","last_undegraded":"2023-11-15T01:33:56.857602+0000","last_fullsized":"2023-11-15T01:33:56.857602+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874788+0000","last_change":"2023-11-15T01:33:56.871248+0000","last_active":"2023-11-15T01:33:56.874788+0000","last_peered":"2023-11-15T01:33:56.874788+0000","last_clean":"2023-11-15T01:33:56.874788+0000","last_became_active":"2023-11-15T01:33:56.870962+0000","last_became_peered":"2023-11-15T01:33:56.870962+0000","last_unstale":"2023-11-15T01:33:56.874788+0000","last_undegraded":"2023-11-15T01:33:56.874788+0000","last_fullsized":"2023-11-15T01:33:56.874788+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860652+0000","last_change":"2023-11-15T01:33:56.458291+0000","last_active":"2023-11-15T01:33:56.860652+0000","last_peered":"2023-11-15T01:33:56.860652+0000","last_clean":"2023-11-15T01:33:56.860652+0000","last_became_active":"2023-11-15T01:33:56.457983+0000","last_became_peered":"2023-11-15T01:33:56.457983+0000","last_unstale":"2023-11-15T01:33:56.860652+0000","last_undegraded":"2023-11-15T01:33:56.860652+0000","last_fullsized":"2023-11-15T01:33:56.860652+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876723+0000","last_change":"2023-11-15T01:33:56.870812+0000","last_active":"2023-11-15T01:33:56.876723+0000","last_peered":"2023-11-15T01:33:56.876723+0000","last_clean":"2023-11-15T01:33:56.876723+0000","last_became_active":"2023-11-15T01:33:56.870496+0000","last_became_peered":"2023-11-15T01:33:56.870496+0000","last_unstale":"2023-11-15T01:33:56.876723+0000","last_undegraded":"2023-11-15T01:33:56.876723+0000","last_fullsized":"2023-11-15T01:33:56.876723+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873367+0000","last_change":"2023-11-15T01:33:56.463682+0000","last_active":"2023-11-15T01:33:56.873367+0000","last_peered":"2023-11-15T01:33:56.873367+0000","last_clean":"2023-11-15T01:33:56.873367+0000","last_became_active":"2023-11-15T01:33:56.462962+0000","last_became_peered":"2023-11-15T01:33:56.462962+0000","last_unstale":"2023-11-15T01:33:56.873367+0000","last_undegraded":"2023-11-15T01:33:56.873367+0000","last_fullsized":"2023-11-15T01:33:56.873367+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.871536+0000","last_change":"2023-11-15T01:33:56.860607+0000","last_active":"2023-11-15T01:33:56.871536+0000","last_peered":"2023-11-15T01:33:56.871536+0000","last_clean":"2023-11-15T01:33:56.871536+0000","last_became_active":"2023-11-15T01:33:56.860324+0000","last_became_peered":"2023-11-15T01:33:56.860324+0000","last_unstale":"2023-11-15T01:33:56.871536+0000","last_undegraded":"2023-11-15T01:33:56.871536+0000","last_fullsized":"2023-11-15T01:33:56.871536+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869320+0000","last_change":"2023-11-15T01:33:56.473582+0000","last_active":"2023-11-15T01:33:56.869320+0000","last_peered":"2023-11-15T01:33:56.869320+0000","last_clean":"2023-11-15T01:33:56.869320+0000","last_became_active":"2023-11-15T01:33:56.473318+0000","last_became_peered":"2023-11-15T01:33:56.473318+0000","last_unstale":"2023-11-15T01:33:56.869320+0000","last_undegraded":"2023-11-15T01:33:56.869320+0000","last_fullsized":"2023-11-15T01:33:56.869320+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.871676+0000","last_change":"2023-11-15T01:33:56.867922+0000","last_active":"2023-11-15T01:33:56.871676+0000","last_peered":"2023-11-15T01:33:56.871676+0000","last_clean":"2023-11-15T01:33:56.871676+0000","last_became_active":"2023-11-15T01:33:56.867634+0000","last_became_peered":"2023-11-15T01:33:56.867634+0000","last_unstale":"2023-11-15T01:33:56.871676+0000","last_undegraded":"2023-11-15T01:33:56.871676+0000","last_fullsized":"2023-11-15T01:33:56.871676+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875287+0000","last_change":"2023-11-15T01:33:56.474361+0000","last_active":"2023-11-15T01:33:56.875287+0000","last_peered":"2023-11-15T01:33:56.875287+0000","last_clean":"2023-11-15T01:33:56.875287+0000","last_became_active":"2023-11-15T01:33:56.473650+0000","last_became_peered":"2023-11-15T01:33:56.473650+0000","last_unstale":"2023-11-15T01:33:56.875287+0000","last_undegraded":"2023-11-15T01:33:56.875287+0000","last_fullsized":"2023-11-15T01:33:56.875287+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.872019+0000","last_change":"2023-11-15T01:33:56.865614+0000","last_active":"2023-11-15T01:33:56.872019+0000","last_peered":"2023-11-15T01:33:56.872019+0000","last_clean":"2023-11-15T01:33:56.872019+0000","last_became_active":"2023-11-15T01:33:56.863615+0000","last_became_peered":"2023-11-15T01:33:56.863615+0000","last_unstale":"2023-11-15T01:33:56.872019+0000","last_undegraded":"2023-11-15T01:33:56.872019+0000","last_fullsized":"2023-11-15T01:33:56.872019+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.864948+0000","last_change":"2023-11-15T01:33:56.476363+0000","last_active":"2023-11-15T01:33:56.864948+0000","last_peered":"2023-11-15T01:33:56.864948+0000","last_clean":"2023-11-15T01:33:56.864948+0000","last_became_active":"2023-11-15T01:33:56.476127+0000","last_became_peered":"2023-11-15T01:33:56.476127+0000","last_unstale":"2023-11-15T01:33:56.864948+0000","last_undegraded":"2023-11-15T01:33:56.864948+0000","last_fullsized":"2023-11-15T01:33:56.864948+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876605+0000","last_change":"2023-11-15T01:33:56.873376+0000","last_active":"2023-11-15T01:33:56.876605+0000","last_peered":"2023-11-15T01:33:56.876605+0000","last_clean":"2023-11-15T01:33:56.876605+0000","last_became_active":"2023-11-15T01:33:56.869197+0000","last_became_peered":"2023-11-15T01:33:56.869197+0000","last_unstale":"2023-11-15T01:33:56.876605+0000","last_undegraded":"2023-11-15T01:33:56.876605+0000","last_fullsized":"2023-11-15T01:33:56.876605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859475+0000","last_change":"2023-11-15T01:33:56.464147+0000","last_active":"2023-11-15T01:33:56.859475+0000","last_peered":"2023-11-15T01:33:56.859475+0000","last_clean":"2023-11-15T01:33:56.859475+0000","last_became_active":"2023-11-15T01:33:56.463540+0000","last_became_peered":"2023-11-15T01:33:56.463540+0000","last_unstale":"2023-11-15T01:33:56.859475+0000","last_undegraded":"2023-11-15T01:33:56.859475+0000","last_fullsized":"2023-11-15T01:33:56.859475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876546+0000","last_change":"2023-11-15T01:33:56.873610+0000","last_active":"2023-11-15T01:33:56.876546+0000","last_peered":"2023-11-15T01:33:56.876546+0000","last_clean":"2023-11-15T01:33:56.876546+0000","last_became_active":"2023-11-15T01:33:56.869058+0000","last_became_peered":"2023-11-15T01:33:56.869058+0000","last_unstale":"2023-11-15T01:33:56.876546+0000","last_undegraded":"2023-11-15T01:33:56.876546+0000","last_fullsized":"2023-11-15T01:33:56.876546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.862508+0000","last_change":"2023-11-15T01:33:56.478563+0000","last_active":"2023-11-15T01:33:56.862508+0000","last_peered":"2023-11-15T01:33:56.862508+0000","last_clean":"2023-11-15T01:33:56.862508+0000","last_became_active":"2023-11-15T01:33:56.478308+0000","last_became_peered":"2023-11-15T01:33:56.478308+0000","last_unstale":"2023-11-15T01:33:56.862508+0000","last_undegraded":"2023-11-15T01:33:56.862508+0000","last_fullsized":"2023-11-15T01:33:56.862508+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874632+0000","last_change":"2023-11-15T01:33:56.868848+0000","last_active":"2023-11-15T01:33:56.874632+0000","last_peered":"2023-11-15T01:33:56.874632+0000","last_clean":"2023-11-15T01:33:56.874632+0000","last_became_active":"2023-11-15T01:33:56.868579+0000","last_became_peered":"2023-11-15T01:33:56.868579+0000","last_unstale":"2023-11-15T01:33:56.874632+0000","last_undegraded":"2023-11-15T01:33:56.874632+0000","last_fullsized":"2023-11-15T01:33:56.874632+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860542+0000","last_change":"2023-11-15T01:33:56.464310+0000","last_active":"2023-11-15T01:33:56.860542+0000","last_peered":"2023-11-15T01:33:56.860542+0000","last_clean":"2023-11-15T01:33:56.860542+0000","last_became_active":"2023-11-15T01:33:56.462305+0000","last_became_peered":"2023-11-15T01:33:56.462305+0000","last_unstale":"2023-11-15T01:33:56.860542+0000","last_undegraded":"2023-11-15T01:33:56.860542+0000","last_fullsized":"2023-11-15T01:33:56.860542+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.878535+0000","last_change":"2023-11-15T01:33:56.877038+0000","last_active":"2023-11-15T01:33:56.878535+0000","last_peered":"2023-11-15T01:33:56.878535+0000","last_clean":"2023-11-15T01:33:56.878535+0000","last_became_active":"2023-11-15T01:33:56.876699+0000","last_became_peered":"2023-11-15T01:33:56.876699+0000","last_unstale":"2023-11-15T01:33:56.878535+0000","last_undegraded":"2023-11-15T01:33:56.878535+0000","last_fullsized":"2023-11-15T01:33:56.878535+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861447+0000","last_change":"2023-11-15T01:33:56.478453+0000","last_active":"2023-11-15T01:33:56.861447+0000","last_peered":"2023-11-15T01:33:56.861447+0000","last_clean":"2023-11-15T01:33:56.861447+0000","last_became_active":"2023-11-15T01:33:56.478179+0000","last_became_peered":"2023-11-15T01:33:56.478179+0000","last_unstale":"2023-11-15T01:33:56.861447+0000","last_undegraded":"2023-11-15T01:33:56.861447+0000","last_fullsized":"2023-11-15T01:33:56.861447+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869347+0000","last_change":"2023-11-15T01:33:56.866129+0000","last_active":"2023-11-15T01:33:56.869347+0000","last_peered":"2023-11-15T01:33:56.869347+0000","last_clean":"2023-11-15T01:33:56.869347+0000","last_became_active":"2023-11-15T01:33:56.865835+0000","last_became_peered":"2023-11-15T01:33:56.865835+0000","last_unstale":"2023-11-15T01:33:56.869347+0000","last_undegraded":"2023-11-15T01:33:56.869347+0000","last_fullsized":"2023-11-15T01:33:56.869347+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877778+0000","last_change":"2023-11-15T01:33:56.468313+0000","last_active":"2023-11-15T01:33:56.877778+0000","last_peered":"2023-11-15T01:33:56.877778+0000","last_clean":"2023-11-15T01:33:56.877778+0000","last_became_active":"2023-11-15T01:33:56.467994+0000","last_became_peered":"2023-11-15T01:33:56.467994+0000","last_unstale":"2023-11-15T01:33:56.877778+0000","last_undegraded":"2023-11-15T01:33:56.877778+0000","last_fullsized":"2023-11-15T01:33:56.877778+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.881930+0000","last_change":"2023-11-15T01:33:56.878365+0000","last_active":"2023-11-15T01:33:56.881930+0000","last_peered":"2023-11-15T01:33:56.881930+0000","last_clean":"2023-11-15T01:33:56.881930+0000","last_became_active":"2023-11-15T01:33:56.878049+0000","last_became_peered":"2023-11-15T01:33:56.878049+0000","last_unstale":"2023-11-15T01:33:56.881930+0000","last_undegraded":"2023-11-15T01:33:56.881930+0000","last_fullsized":"2023-11-15T01:33:56.881930+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875001+0000","last_change":"2023-11-15T01:33:56.482375+0000","last_active":"2023-11-15T01:33:56.875001+0000","last_peered":"2023-11-15T01:33:56.875001+0000","last_clean":"2023-11-15T01:33:56.875001+0000","last_became_active":"2023-11-15T01:33:56.481858+0000","last_became_peered":"2023-11-15T01:33:56.481858+0000","last_unstale":"2023-11-15T01:33:56.875001+0000","last_undegraded":"2023-11-15T01:33:56.875001+0000","last_fullsized":"2023-11-15T01:33:56.875001+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874619+0000","last_change":"2023-11-15T01:33:56.871814+0000","last_active":"2023-11-15T01:33:56.874619+0000","last_peered":"2023-11-15T01:33:56.874619+0000","last_clean":"2023-11-15T01:33:56.874619+0000","last_became_active":"2023-11-15T01:33:56.871595+0000","last_became_peered":"2023-11-15T01:33:56.871595+0000","last_unstale":"2023-11-15T01:33:56.874619+0000","last_undegraded":"2023-11-15T01:33:56.874619+0000","last_fullsized":"2023-11-15T01:33:56.874619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861088+0000","last_change":"2023-11-15T01:33:56.481949+0000","last_active":"2023-11-15T01:33:56.861088+0000","last_peered":"2023-11-15T01:33:56.861088+0000","last_clean":"2023-11-15T01:33:56.861088+0000","last_became_active":"2023-11-15T01:33:56.481665+0000","last_became_peered":"2023-11-15T01:33:56.481665+0000","last_unstale":"2023-11-15T01:33:56.861088+0000","last_undegraded":"2023-11-15T01:33:56.861088+0000","last_fullsized":"2023-11-15T01:33:56.861088+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879524+0000","last_change":"2023-11-15T01:33:56.875960+0000","last_active":"2023-11-15T01:33:56.879524+0000","last_peered":"2023-11-15T01:33:56.879524+0000","last_clean":"2023-11-15T01:33:56.879524+0000","last_became_active":"2023-11-15T01:33:56.875475+0000","last_became_peered":"2023-11-15T01:33:56.875475+0000","last_unstale":"2023-11-15T01:33:56.879524+0000","last_undegraded":"2023-11-15T01:33:56.879524+0000","last_fullsized":"2023-11-15T01:33:56.879524+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851271+0000","last_change":"2023-11-15T01:33:56.470153+0000","last_active":"2023-11-15T01:33:56.851271+0000","last_peered":"2023-11-15T01:33:56.851271+0000","last_clean":"2023-11-15T01:33:56.851271+0000","last_became_active":"2023-11-15T01:33:56.469808+0000","last_became_peered":"2023-11-15T01:33:56.469808+0000","last_unstale":"2023-11-15T01:33:56.851271+0000","last_undegraded":"2023-11-15T01:33:56.851271+0000","last_fullsized":"2023-11-15T01:33:56.851271+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873830+0000","last_change":"2023-11-15T01:33:56.870218+0000","last_active":"2023-11-15T01:33:56.873830+0000","last_peered":"2023-11-15T01:33:56.873830+0000","last_clean":"2023-11-15T01:33:56.873830+0000","last_became_active":"2023-11-15T01:33:56.869901+0000","last_became_peered":"2023-11-15T01:33:56.869901+0000","last_unstale":"2023-11-15T01:33:56.873830+0000","last_undegraded":"2023-11-15T01:33:56.873830+0000","last_fullsized":"2023-11-15T01:33:56.873830+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879211+0000","last_change":"2023-11-15T01:33:56.478588+0000","last_active":"2023-11-15T01:33:56.879211+0000","last_peered":"2023-11-15T01:33:56.879211+0000","last_clean":"2023-11-15T01:33:56.879211+0000","last_became_active":"2023-11-15T01:33:56.478375+0000","last_became_peered":"2023-11-15T01:33:56.478375+0000","last_unstale":"2023-11-15T01:33:56.879211+0000","last_undegraded":"2023-11-15T01:33:56.879211+0000","last_fullsized":"2023-11-15T01:33:56.879211+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876152+0000","last_change":"2023-11-15T01:33:56.874699+0000","last_active":"2023-11-15T01:33:56.876152+0000","last_peered":"2023-11-15T01:33:56.876152+0000","last_clean":"2023-11-15T01:33:56.876152+0000","last_became_active":"2023-11-15T01:33:56.874306+0000","last_became_peered":"2023-11-15T01:33:56.874306+0000","last_unstale":"2023-11-15T01:33:56.876152+0000","last_undegraded":"2023-11-15T01:33:56.876152+0000","last_fullsized":"2023-11-15T01:33:56.876152+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860716+0000","last_change":"2023-11-15T01:33:56.459940+0000","last_active":"2023-11-15T01:33:56.860716+0000","last_peered":"2023-11-15T01:33:56.860716+0000","last_clean":"2023-11-15T01:33:56.860716+0000","last_became_active":"2023-11-15T01:33:56.459677+0000","last_became_peered":"2023-11-15T01:33:56.459677+0000","last_unstale":"2023-11-15T01:33:56.860716+0000","last_undegraded":"2023-11-15T01:33:56.860716+0000","last_fullsized":"2023-11-15T01:33:56.860716+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868562+0000","last_change":"2023-11-15T01:33:56.864069+0000","last_active":"2023-11-15T01:33:56.868562+0000","last_peered":"2023-11-15T01:33:56.868562+0000","last_clean":"2023-11-15T01:33:56.868562+0000","last_became_active":"2023-11-15T01:33:56.863785+0000","last_became_peered":"2023-11-15T01:33:56.863785+0000","last_unstale":"2023-11-15T01:33:56.868562+0000","last_undegraded":"2023-11-15T01:33:56.868562+0000","last_fullsized":"2023-11-15T01:33:56.868562+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860584+0000","last_change":"2023-11-15T01:33:56.470046+0000","last_active":"2023-11-15T01:33:56.860584+0000","last_peered":"2023-11-15T01:33:56.860584+0000","last_clean":"2023-11-15T01:33:56.860584+0000","last_became_active":"2023-11-15T01:33:56.469771+0000","last_became_peered":"2023-11-15T01:33:56.469771+0000","last_unstale":"2023-11-15T01:33:56.860584+0000","last_undegraded":"2023-11-15T01:33:56.860584+0000","last_fullsized":"2023-11-15T01:33:56.860584+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879425+0000","last_change":"2023-11-15T01:33:56.874927+0000","last_active":"2023-11-15T01:33:56.879425+0000","last_peered":"2023-11-15T01:33:56.879425+0000","last_clean":"2023-11-15T01:33:56.879425+0000","last_became_active":"2023-11-15T01:33:56.874683+0000","last_became_peered":"2023-11-15T01:33:56.874683+0000","last_unstale":"2023-11-15T01:33:56.879425+0000","last_undegraded":"2023-11-15T01:33:56.879425+0000","last_fullsized":"2023-11-15T01:33:56.879425+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.878673+0000","last_change":"2023-11-15T01:33:56.470434+0000","last_active":"2023-11-15T01:33:56.878673+0000","last_peered":"2023-11-15T01:33:56.878673+0000","last_clean":"2023-11-15T01:33:56.878673+0000","last_became_active":"2023-11-15T01:33:56.470134+0000","last_became_peered":"2023-11-15T01:33:56.470134+0000","last_unstale":"2023-11-15T01:33:56.878673+0000","last_undegraded":"2023-11-15T01:33:56.878673+0000","last_fullsized":"2023-11-15T01:33:56.878673+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874463+0000","last_change":"2023-11-15T01:33:56.867683+0000","last_active":"2023-11-15T01:33:56.874463+0000","last_peered":"2023-11-15T01:33:56.874463+0000","last_clean":"2023-11-15T01:33:56.874463+0000","last_became_active":"2023-11-15T01:33:56.867411+0000","last_became_peered":"2023-11-15T01:33:56.867411+0000","last_unstale":"2023-11-15T01:33:56.874463+0000","last_undegraded":"2023-11-15T01:33:56.874463+0000","last_fullsized":"2023-11-15T01:33:56.874463+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861967+0000","last_change":"2023-11-15T01:33:56.471011+0000","last_active":"2023-11-15T01:33:56.861967+0000","last_peered":"2023-11-15T01:33:56.861967+0000","last_clean":"2023-11-15T01:33:56.861967+0000","last_became_active":"2023-11-15T01:33:56.470697+0000","last_became_peered":"2023-11-15T01:33:56.470697+0000","last_unstale":"2023-11-15T01:33:56.861967+0000","last_undegraded":"2023-11-15T01:33:56.861967+0000","last_fullsized":"2023-11-15T01:33:56.861967+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879469+0000","last_change":"2023-11-15T01:33:56.876575+0000","last_active":"2023-11-15T01:33:56.879469+0000","last_peered":"2023-11-15T01:33:56.879469+0000","last_clean":"2023-11-15T01:33:56.879469+0000","last_became_active":"2023-11-15T01:33:56.876274+0000","last_became_peered":"2023-11-15T01:33:56.876274+0000","last_unstale":"2023-11-15T01:33:56.879469+0000","last_undegraded":"2023-11-15T01:33:56.879469+0000","last_fullsized":"2023-11-15T01:33:56.879469+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873817+0000","last_change":"2023-11-15T01:33:56.475311+0000","last_active":"2023-11-15T01:33:56.873817+0000","last_peered":"2023-11-15T01:33:56.873817+0000","last_clean":"2023-11-15T01:33:56.873817+0000","last_became_active":"2023-11-15T01:33:56.475060+0000","last_became_peered":"2023-11-15T01:33:56.475060+0000","last_unstale":"2023-11-15T01:33:56.873817+0000","last_undegraded":"2023-11-15T01:33:56.873817+0000","last_fullsized":"2023-11-15T01:33:56.873817+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877902+0000","last_change":"2023-11-15T01:33:56.872904+0000","last_active":"2023-11-15T01:33:56.877902+0000","last_peered":"2023-11-15T01:33:56.877902+0000","last_clean":"2023-11-15T01:33:56.877902+0000","last_became_active":"2023-11-15T01:33:56.872620+0000","last_became_peered":"2023-11-15T01:33:56.872620+0000","last_unstale":"2023-11-15T01:33:56.877902+0000","last_undegraded":"2023-11-15T01:33:56.877902+0000","last_fullsized":"2023-11-15T01:33:56.877902+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860992+0000","last_change":"2023-11-15T01:33:56.464027+0000","last_active":"2023-11-15T01:33:56.860992+0000","last_peered":"2023-11-15T01:33:56.860992+0000","last_clean":"2023-11-15T01:33:56.860992+0000","last_became_active":"2023-11-15T01:33:56.463227+0000","last_became_peered":"2023-11-15T01:33:56.463227+0000","last_unstale":"2023-11-15T01:33:56.860992+0000","last_undegraded":"2023-11-15T01:33:56.860992+0000","last_fullsized":"2023-11-15T01:33:56.860992+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875574+0000","last_change":"2023-11-15T01:33:56.872932+0000","last_active":"2023-11-15T01:33:56.875574+0000","last_peered":"2023-11-15T01:33:56.875574+0000","last_clean":"2023-11-15T01:33:56.875574+0000","last_became_active":"2023-11-15T01:33:56.872658+0000","last_became_peered":"2023-11-15T01:33:56.872658+0000","last_unstale":"2023-11-15T01:33:56.875574+0000","last_undegraded":"2023-11-15T01:33:56.875574+0000","last_fullsized":"2023-11-15T01:33:56.875574+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858111+0000","last_change":"2023-11-15T01:33:56.469707+0000","last_active":"2023-11-15T01:33:56.858111+0000","last_peered":"2023-11-15T01:33:56.858111+0000","last_clean":"2023-11-15T01:33:56.858111+0000","last_became_active":"2023-11-15T01:33:56.469412+0000","last_became_peered":"2023-11-15T01:33:56.469412+0000","last_unstale":"2023-11-15T01:33:56.858111+0000","last_undegraded":"2023-11-15T01:33:56.858111+0000","last_fullsized":"2023-11-15T01:33:56.858111+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875262+0000","last_change":"2023-11-15T01:33:56.870228+0000","last_active":"2023-11-15T01:33:56.875262+0000","last_peered":"2023-11-15T01:33:56.875262+0000","last_clean":"2023-11-15T01:33:56.875262+0000","last_became_active":"2023-11-15T01:33:56.869836+0000","last_became_peered":"2023-11-15T01:33:56.869836+0000","last_unstale":"2023-11-15T01:33:56.875262+0000","last_undegraded":"2023-11-15T01:33:56.875262+0000","last_fullsized":"2023-11-15T01:33:56.875262+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.857311+0000","last_change":"2023-11-15T01:33:56.467712+0000","last_active":"2023-11-15T01:33:56.857311+0000","last_peered":"2023-11-15T01:33:56.857311+0000","last_clean":"2023-11-15T01:33:56.857311+0000","last_became_active":"2023-11-15T01:33:56.467431+0000","last_became_peered":"2023-11-15T01:33:56.467431+0000","last_unstale":"2023-11-15T01:33:56.857311+0000","last_undegraded":"2023-11-15T01:33:56.857311+0000","last_fullsized":"2023-11-15T01:33:56.857311+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868693+0000","last_change":"2023-11-15T01:33:56.862035+0000","last_active":"2023-11-15T01:33:56.868693+0000","last_peered":"2023-11-15T01:33:56.868693+0000","last_clean":"2023-11-15T01:33:56.868693+0000","last_became_active":"2023-11-15T01:33:56.861779+0000","last_became_peered":"2023-11-15T01:33:56.861779+0000","last_unstale":"2023-11-15T01:33:56.868693+0000","last_undegraded":"2023-11-15T01:33:56.868693+0000","last_fullsized":"2023-11-15T01:33:56.868693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.857571+0000","last_change":"2023-11-15T01:33:56.473044+0000","last_active":"2023-11-15T01:33:56.857571+0000","last_peered":"2023-11-15T01:33:56.857571+0000","last_clean":"2023-11-15T01:33:56.857571+0000","last_became_active":"2023-11-15T01:33:56.472757+0000","last_became_peered":"2023-11-15T01:33:56.472757+0000","last_unstale":"2023-11-15T01:33:56.857571+0000","last_undegraded":"2023-11-15T01:33:56.857571+0000","last_fullsized":"2023-11-15T01:33:56.857571+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.871737+0000","last_change":"2023-11-15T01:33:56.868549+0000","last_active":"2023-11-15T01:33:56.871737+0000","last_peered":"2023-11-15T01:33:56.871737+0000","last_clean":"2023-11-15T01:33:56.871737+0000","last_became_active":"2023-11-15T01:33:56.868252+0000","last_became_peered":"2023-11-15T01:33:56.868252+0000","last_unstale":"2023-11-15T01:33:56.871737+0000","last_undegraded":"2023-11-15T01:33:56.871737+0000","last_fullsized":"2023-11-15T01:33:56.871737+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.862190+0000","last_change":"2023-11-15T01:33:56.472202+0000","last_active":"2023-11-15T01:33:56.862190+0000","last_peered":"2023-11-15T01:33:56.862190+0000","last_clean":"2023-11-15T01:33:56.862190+0000","last_became_active":"2023-11-15T01:33:56.471917+0000","last_became_peered":"2023-11-15T01:33:56.471917+0000","last_unstale":"2023-11-15T01:33:56.862190+0000","last_undegraded":"2023-11-15T01:33:56.862190+0000","last_fullsized":"2023-11-15T01:33:56.862190+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.872641+0000","last_change":"2023-11-15T01:33:56.867048+0000","last_active":"2023-11-15T01:33:56.872641+0000","last_peered":"2023-11-15T01:33:56.872641+0000","last_clean":"2023-11-15T01:33:56.872641+0000","last_became_active":"2023-11-15T01:33:56.866783+0000","last_became_peered":"2023-11-15T01:33:56.866783+0000","last_unstale":"2023-11-15T01:33:56.872641+0000","last_undegraded":"2023-11-15T01:33:56.872641+0000","last_fullsized":"2023-11-15T01:33:56.872641+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860780+0000","last_change":"2023-11-15T01:33:56.460695+0000","last_active":"2023-11-15T01:33:56.860780+0000","last_peered":"2023-11-15T01:33:56.860780+0000","last_clean":"2023-11-15T01:33:56.860780+0000","last_became_active":"2023-11-15T01:33:56.460393+0000","last_became_peered":"2023-11-15T01:33:56.460393+0000","last_unstale":"2023-11-15T01:33:56.860780+0000","last_undegraded":"2023-11-15T01:33:56.860780+0000","last_fullsized":"2023-11-15T01:33:56.860780+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875207+0000","last_change":"2023-11-15T01:33:56.872777+0000","last_active":"2023-11-15T01:33:56.875207+0000","last_peered":"2023-11-15T01:33:56.875207+0000","last_clean":"2023-11-15T01:33:56.875207+0000","last_became_active":"2023-11-15T01:33:56.872491+0000","last_became_peered":"2023-11-15T01:33:56.872491+0000","last_unstale":"2023-11-15T01:33:56.875207+0000","last_undegraded":"2023-11-15T01:33:56.875207+0000","last_fullsized":"2023-11-15T01:33:56.875207+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.855006+0000","last_change":"2023-11-15T01:33:56.467246+0000","last_active":"2023-11-15T01:33:56.855006+0000","last_peered":"2023-11-15T01:33:56.855006+0000","last_clean":"2023-11-15T01:33:56.855006+0000","last_became_active":"2023-11-15T01:33:56.466985+0000","last_became_peered":"2023-11-15T01:33:56.466985+0000","last_unstale":"2023-11-15T01:33:56.855006+0000","last_undegraded":"2023-11-15T01:33:56.855006+0000","last_fullsized":"2023-11-15T01:33:56.855006+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870299+0000","last_change":"2023-11-15T01:33:56.867697+0000","last_active":"2023-11-15T01:33:56.870299+0000","last_peered":"2023-11-15T01:33:56.870299+0000","last_clean":"2023-11-15T01:33:56.870299+0000","last_became_active":"2023-11-15T01:33:56.867397+0000","last_became_peered":"2023-11-15T01:33:56.867397+0000","last_unstale":"2023-11-15T01:33:56.870299+0000","last_undegraded":"2023-11-15T01:33:56.870299+0000","last_fullsized":"2023-11-15T01:33:56.870299+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858510+0000","last_change":"2023-11-15T01:33:56.473011+0000","last_active":"2023-11-15T01:33:56.858510+0000","last_peered":"2023-11-15T01:33:56.858510+0000","last_clean":"2023-11-15T01:33:56.858510+0000","last_became_active":"2023-11-15T01:33:56.472685+0000","last_became_peered":"2023-11-15T01:33:56.472685+0000","last_unstale":"2023-11-15T01:33:56.858510+0000","last_undegraded":"2023-11-15T01:33:56.858510+0000","last_fullsized":"2023-11-15T01:33:56.858510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874059+0000","last_change":"2023-11-15T01:33:56.866406+0000","last_active":"2023-11-15T01:33:56.874059+0000","last_peered":"2023-11-15T01:33:56.874059+0000","last_clean":"2023-11-15T01:33:56.874059+0000","last_became_active":"2023-11-15T01:33:56.866163+0000","last_became_peered":"2023-11-15T01:33:56.866163+0000","last_unstale":"2023-11-15T01:33:56.874059+0000","last_undegraded":"2023-11-15T01:33:56.874059+0000","last_fullsized":"2023-11-15T01:33:56.874059+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858827+0000","last_change":"2023-11-15T01:33:56.467547+0000","last_active":"2023-11-15T01:33:56.858827+0000","last_peered":"2023-11-15T01:33:56.858827+0000","last_clean":"2023-11-15T01:33:56.858827+0000","last_became_active":"2023-11-15T01:33:56.467250+0000","last_became_peered":"2023-11-15T01:33:56.467250+0000","last_unstale":"2023-11-15T01:33:56.858827+0000","last_undegraded":"2023-11-15T01:33:56.858827+0000","last_fullsized":"2023-11-15T01:33:56.858827+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879575+0000","last_change":"2023-11-15T01:33:56.876040+0000","last_active":"2023-11-15T01:33:56.879575+0000","last_peered":"2023-11-15T01:33:56.879575+0000","last_clean":"2023-11-15T01:33:56.879575+0000","last_became_active":"2023-11-15T01:33:56.875743+0000","last_became_peered":"2023-11-15T01:33:56.875743+0000","last_unstale":"2023-11-15T01:33:56.879575+0000","last_undegraded":"2023-11-15T01:33:56.879575+0000","last_fullsized":"2023-11-15T01:33:56.879575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851225+0000","last_change":"2023-11-15T01:33:56.473005+0000","last_active":"2023-11-15T01:33:56.851225+0000","last_peered":"2023-11-15T01:33:56.851225+0000","last_clean":"2023-11-15T01:33:56.851225+0000","last_became_active":"2023-11-15T01:33:56.472763+0000","last_became_peered":"2023-11-15T01:33:56.472763+0000","last_unstale":"2023-11-15T01:33:56.851225+0000","last_undegraded":"2023-11-15T01:33:56.851225+0000","last_fullsized":"2023-11-15T01:33:56.851225+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875176+0000","last_change":"2023-11-15T01:33:56.866140+0000","last_active":"2023-11-15T01:33:56.875176+0000","last_peered":"2023-11-15T01:33:56.875176+0000","last_clean":"2023-11-15T01:33:56.875176+0000","last_became_active":"2023-11-15T01:33:56.865926+0000","last_became_peered":"2023-11-15T01:33:56.865926+0000","last_unstale":"2023-11-15T01:33:56.875176+0000","last_undegraded":"2023-11-15T01:33:56.875176+0000","last_fullsized":"2023-11-15T01:33:56.875176+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861741+0000","last_change":"2023-11-15T01:33:56.467225+0000","last_active":"2023-11-15T01:33:56.861741+0000","last_peered":"2023-11-15T01:33:56.861741+0000","last_clean":"2023-11-15T01:33:56.861741+0000","last_became_active":"2023-11-15T01:33:56.466935+0000","last_became_peered":"2023-11-15T01:33:56.466935+0000","last_unstale":"2023-11-15T01:33:56.861741+0000","last_undegraded":"2023-11-15T01:33:56.861741+0000","last_fullsized":"2023-11-15T01:33:56.861741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879397+0000","last_change":"2023-11-15T01:33:56.874511+0000","last_active":"2023-11-15T01:33:56.879397+0000","last_peered":"2023-11-15T01:33:56.879397+0000","last_clean":"2023-11-15T01:33:56.879397+0000","last_became_active":"2023-11-15T01:33:56.873938+0000","last_became_peered":"2023-11-15T01:33:56.873938+0000","last_unstale":"2023-11-15T01:33:56.879397+0000","last_undegraded":"2023-11-15T01:33:56.879397+0000","last_fullsized":"2023-11-15T01:33:56.879397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869557+0000","last_change":"2023-11-15T01:33:56.462340+0000","last_active":"2023-11-15T01:33:56.869557+0000","last_peered":"2023-11-15T01:33:56.869557+0000","last_clean":"2023-11-15T01:33:56.869557+0000","last_became_active":"2023-11-15T01:33:56.462052+0000","last_became_peered":"2023-11-15T01:33:56.462052+0000","last_unstale":"2023-11-15T01:33:56.869557+0000","last_undegraded":"2023-11-15T01:33:56.869557+0000","last_fullsized":"2023-11-15T01:33:56.869557+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874960+0000","last_change":"2023-11-15T01:33:56.872849+0000","last_active":"2023-11-15T01:33:56.874960+0000","last_peered":"2023-11-15T01:33:56.874960+0000","last_clean":"2023-11-15T01:33:56.874960+0000","last_became_active":"2023-11-15T01:33:56.872524+0000","last_became_peered":"2023-11-15T01:33:56.872524+0000","last_unstale":"2023-11-15T01:33:56.874960+0000","last_undegraded":"2023-11-15T01:33:56.874960+0000","last_fullsized":"2023-11-15T01:33:56.874960+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869995+0000","last_change":"2023-11-15T01:33:56.471803+0000","last_active":"2023-11-15T01:33:56.869995+0000","last_peered":"2023-11-15T01:33:56.869995+0000","last_clean":"2023-11-15T01:33:56.869995+0000","last_became_active":"2023-11-15T01:33:56.471477+0000","last_became_peered":"2023-11-15T01:33:56.471477+0000","last_unstale":"2023-11-15T01:33:56.869995+0000","last_undegraded":"2023-11-15T01:33:56.869995+0000","last_fullsized":"2023-11-15T01:33:56.869995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870302+0000","last_change":"2023-11-15T01:33:56.867150+0000","last_active":"2023-11-15T01:33:56.870302+0000","last_peered":"2023-11-15T01:33:56.870302+0000","last_clean":"2023-11-15T01:33:56.870302+0000","last_became_active":"2023-11-15T01:33:56.866156+0000","last_became_peered":"2023-11-15T01:33:56.866156+0000","last_unstale":"2023-11-15T01:33:56.870302+0000","last_undegraded":"2023-11-15T01:33:56.870302+0000","last_fullsized":"2023-11-15T01:33:56.870302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873231+0000","last_change":"2023-11-15T01:33:56.479832+0000","last_active":"2023-11-15T01:33:56.873231+0000","last_peered":"2023-11-15T01:33:56.873231+0000","last_clean":"2023-11-15T01:33:56.873231+0000","last_became_active":"2023-11-15T01:33:56.479383+0000","last_became_peered":"2023-11-15T01:33:56.479383+0000","last_unstale":"2023-11-15T01:33:56.873231+0000","last_undegraded":"2023-11-15T01:33:56.873231+0000","last_fullsized":"2023-11-15T01:33:56.873231+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869183+0000","last_change":"2023-11-15T01:33:56.858217+0000","last_active":"2023-11-15T01:33:56.869183+0000","last_peered":"2023-11-15T01:33:56.869183+0000","last_clean":"2023-11-15T01:33:56.869183+0000","last_became_active":"2023-11-15T01:33:56.857955+0000","last_became_peered":"2023-11-15T01:33:56.857955+0000","last_unstale":"2023-11-15T01:33:56.869183+0000","last_undegraded":"2023-11-15T01:33:56.869183+0000","last_fullsized":"2023-11-15T01:33:56.869183+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.855126+0000","last_change":"2023-11-15T01:33:56.471717+0000","last_active":"2023-11-15T01:33:56.855126+0000","last_peered":"2023-11-15T01:33:56.855126+0000","last_clean":"2023-11-15T01:33:56.855126+0000","last_became_active":"2023-11-15T01:33:56.471483+0000","last_became_peered":"2023-11-15T01:33:56.471483+0000","last_unstale":"2023-11-15T01:33:56.855126+0000","last_undegraded":"2023-11-15T01:33:56.855126+0000","last_fullsized":"2023-11-15T01:33:56.855126+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873298+0000","last_change":"2023-11-15T01:33:56.869819+0000","last_active":"2023-11-15T01:33:56.873298+0000","last_peered":"2023-11-15T01:33:56.873298+0000","last_clean":"2023-11-15T01:33:56.873298+0000","last_became_active":"2023-11-15T01:33:56.869529+0000","last_became_peered":"2023-11-15T01:33:56.869529+0000","last_unstale":"2023-11-15T01:33:56.873298+0000","last_undegraded":"2023-11-15T01:33:56.873298+0000","last_fullsized":"2023-11-15T01:33:56.873298+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859995+0000","last_change":"2023-11-15T01:33:56.456359+0000","last_active":"2023-11-15T01:33:56.859995+0000","last_peered":"2023-11-15T01:33:56.859995+0000","last_clean":"2023-11-15T01:33:56.859995+0000","last_became_active":"2023-11-15T01:33:56.456028+0000","last_became_peered":"2023-11-15T01:33:56.456028+0000","last_unstale":"2023-11-15T01:33:56.859995+0000","last_undegraded":"2023-11-15T01:33:56.859995+0000","last_fullsized":"2023-11-15T01:33:56.859995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879584+0000","last_change":"2023-11-15T01:33:56.876486+0000","last_active":"2023-11-15T01:33:56.879584+0000","last_peered":"2023-11-15T01:33:56.879584+0000","last_clean":"2023-11-15T01:33:56.879584+0000","last_became_active":"2023-11-15T01:33:56.876185+0000","last_became_peered":"2023-11-15T01:33:56.876185+0000","last_unstale":"2023-11-15T01:33:56.879584+0000","last_undegraded":"2023-11-15T01:33:56.879584+0000","last_fullsized":"2023-11-15T01:33:56.879584+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858937+0000","last_change":"2023-11-15T01:33:56.461596+0000","last_active":"2023-11-15T01:33:56.858937+0000","last_peered":"2023-11-15T01:33:56.858937+0000","last_clean":"2023-11-15T01:33:56.858937+0000","last_became_active":"2023-11-15T01:33:56.461232+0000","last_became_peered":"2023-11-15T01:33:56.461232+0000","last_unstale":"2023-11-15T01:33:56.858937+0000","last_undegraded":"2023-11-15T01:33:56.858937+0000","last_fullsized":"2023-11-15T01:33:56.858937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875552+0000","last_change":"2023-11-15T01:33:56.872876+0000","last_active":"2023-11-15T01:33:56.875552+0000","last_peered":"2023-11-15T01:33:56.875552+0000","last_clean":"2023-11-15T01:33:56.875552+0000","last_became_active":"2023-11-15T01:33:56.872293+0000","last_became_peered":"2023-11-15T01:33:56.872293+0000","last_unstale":"2023-11-15T01:33:56.875552+0000","last_undegraded":"2023-11-15T01:33:56.875552+0000","last_fullsized":"2023-11-15T01:33:56.875552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858075+0000","last_change":"2023-11-15T01:33:56.469475+0000","last_active":"2023-11-15T01:33:56.858075+0000","last_peered":"2023-11-15T01:33:56.858075+0000","last_clean":"2023-11-15T01:33:56.858075+0000","last_became_active":"2023-11-15T01:33:56.469038+0000","last_became_peered":"2023-11-15T01:33:56.469038+0000","last_unstale":"2023-11-15T01:33:56.858075+0000","last_undegraded":"2023-11-15T01:33:56.858075+0000","last_fullsized":"2023-11-15T01:33:56.858075+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.881954+0000","last_change":"2023-11-15T01:33:56.879242+0000","last_active":"2023-11-15T01:33:56.881954+0000","last_peered":"2023-11-15T01:33:56.881954+0000","last_clean":"2023-11-15T01:33:56.881954+0000","last_became_active":"2023-11-15T01:33:56.878946+0000","last_became_peered":"2023-11-15T01:33:56.878946+0000","last_unstale":"2023-11-15T01:33:56.881954+0000","last_undegraded":"2023-11-15T01:33:56.881954+0000","last_fullsized":"2023-11-15T01:33:56.881954+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859583+0000","last_change":"2023-11-15T01:33:56.463826+0000","last_active":"2023-11-15T01:33:56.859583+0000","last_peered":"2023-11-15T01:33:56.859583+0000","last_clean":"2023-11-15T01:33:56.859583+0000","last_became_active":"2023-11-15T01:33:56.463164+0000","last_became_peered":"2023-11-15T01:33:56.463164+0000","last_unstale":"2023-11-15T01:33:56.859583+0000","last_undegraded":"2023-11-15T01:33:56.859583+0000","last_fullsized":"2023-11-15T01:33:56.859583+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873153+0000","last_change":"2023-11-15T01:33:56.869206+0000","last_active":"2023-11-15T01:33:56.873153+0000","last_peered":"2023-11-15T01:33:56.873153+0000","last_clean":"2023-11-15T01:33:56.873153+0000","last_became_active":"2023-11-15T01:33:56.868918+0000","last_became_peered":"2023-11-15T01:33:56.868918+0000","last_unstale":"2023-11-15T01:33:56.873153+0000","last_undegraded":"2023-11-15T01:33:56.873153+0000","last_fullsized":"2023-11-15T01:33:56.873153+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.867059+0000","last_change":"2023-11-15T01:33:56.468977+0000","last_active":"2023-11-15T01:33:56.867059+0000","last_peered":"2023-11-15T01:33:56.867059+0000","last_clean":"2023-11-15T01:33:56.867059+0000","last_became_active":"2023-11-15T01:33:56.468680+0000","last_became_peered":"2023-11-15T01:33:56.468680+0000","last_unstale":"2023-11-15T01:33:56.867059+0000","last_undegraded":"2023-11-15T01:33:56.867059+0000","last_fullsized":"2023-11-15T01:33:56.867059+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.863671+0000","last_change":"2023-11-15T01:33:56.860959+0000","last_active":"2023-11-15T01:33:56.863671+0000","last_peered":"2023-11-15T01:33:56.863671+0000","last_clean":"2023-11-15T01:33:56.863671+0000","last_became_active":"2023-11-15T01:33:56.860574+0000","last_became_peered":"2023-11-15T01:33:56.860574+0000","last_unstale":"2023-11-15T01:33:56.863671+0000","last_undegraded":"2023-11-15T01:33:56.863671+0000","last_fullsized":"2023-11-15T01:33:56.863671+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860693+0000","last_change":"2023-11-15T01:33:56.469708+0000","last_active":"2023-11-15T01:33:56.860693+0000","last_peered":"2023-11-15T01:33:56.860693+0000","last_clean":"2023-11-15T01:33:56.860693+0000","last_became_active":"2023-11-15T01:33:56.469428+0000","last_became_peered":"2023-11-15T01:33:56.469428+0000","last_unstale":"2023-11-15T01:33:56.860693+0000","last_undegraded":"2023-11-15T01:33:56.860693+0000","last_fullsized":"2023-11-15T01:33:56.860693+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874768+0000","last_change":"2023-11-15T01:33:56.867465+0000","last_active":"2023-11-15T01:33:56.874768+0000","last_peered":"2023-11-15T01:33:56.874768+0000","last_clean":"2023-11-15T01:33:56.874768+0000","last_became_active":"2023-11-15T01:33:56.867152+0000","last_became_peered":"2023-11-15T01:33:56.867152+0000","last_unstale":"2023-11-15T01:33:56.874768+0000","last_undegraded":"2023-11-15T01:33:56.874768+0000","last_fullsized":"2023-11-15T01:33:56.874768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"60'3","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879018+0000","last_change":"2023-11-15T01:33:56.476533+0000","last_active":"2023-11-15T01:33:56.879018+0000","last_peered":"2023-11-15T01:33:56.879018+0000","last_clean":"2023-11-15T01:33:56.879018+0000","last_became_active":"2023-11-15T01:33:56.476246+0000","last_became_peered":"2023-11-15T01:33:56.476246+0000","last_unstale":"2023-11-15T01:33:56.879018+0000","last_undegraded":"2023-11-15T01:33:56.879018+0000","last_fullsized":"2023-11-15T01:33:56.879018+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.872188+0000","last_change":"2023-11-15T01:33:56.868151+0000","last_active":"2023-11-15T01:33:56.872188+0000","last_peered":"2023-11-15T01:33:56.872188+0000","last_clean":"2023-11-15T01:33:56.872188+0000","last_became_active":"2023-11-15T01:33:56.867790+0000","last_became_peered":"2023-11-15T01:33:56.867790+0000","last_unstale":"2023-11-15T01:33:56.872188+0000","last_undegraded":"2023-11-15T01:33:56.872188+0000","last_fullsized":"2023-11-15T01:33:56.872188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877547+0000","last_change":"2023-11-15T01:33:56.470412+0000","last_active":"2023-11-15T01:33:56.877547+0000","last_peered":"2023-11-15T01:33:56.877547+0000","last_clean":"2023-11-15T01:33:56.877547+0000","last_became_active":"2023-11-15T01:33:56.469983+0000","last_became_peered":"2023-11-15T01:33:56.469983+0000","last_unstale":"2023-11-15T01:33:56.877547+0000","last_undegraded":"2023-11-15T01:33:56.877547+0000","last_fullsized":"2023-11-15T01:33:56.877547+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875421+0000","last_change":"2023-11-15T01:33:56.873025+0000","last_active":"2023-11-15T01:33:56.875421+0000","last_peered":"2023-11-15T01:33:56.875421+0000","last_clean":"2023-11-15T01:33:56.875421+0000","last_became_active":"2023-11-15T01:33:56.872590+0000","last_became_peered":"2023-11-15T01:33:56.872590+0000","last_unstale":"2023-11-15T01:33:56.875421+0000","last_undegraded":"2023-11-15T01:33:56.875421+0000","last_fullsized":"2023-11-15T01:33:56.875421+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.878036+0000","last_change":"2023-11-15T01:33:56.467785+0000","last_active":"2023-11-15T01:33:56.878036+0000","last_peered":"2023-11-15T01:33:56.878036+0000","last_clean":"2023-11-15T01:33:56.878036+0000","last_became_active":"2023-11-15T01:33:56.467489+0000","last_became_peered":"2023-11-15T01:33:56.467489+0000","last_unstale":"2023-11-15T01:33:56.878036+0000","last_undegraded":"2023-11-15T01:33:56.878036+0000","last_fullsized":"2023-11-15T01:33:56.878036+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874082+0000","last_change":"2023-11-15T01:33:56.867055+0000","last_active":"2023-11-15T01:33:56.874082+0000","last_peered":"2023-11-15T01:33:56.874082+0000","last_clean":"2023-11-15T01:33:56.874082+0000","last_became_active":"2023-11-15T01:33:56.865917+0000","last_became_peered":"2023-11-15T01:33:56.865917+0000","last_unstale":"2023-11-15T01:33:56.874082+0000","last_undegraded":"2023-11-15T01:33:56.874082+0000","last_fullsized":"2023-11-15T01:33:56.874082+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858274+0000","last_change":"2023-11-15T01:33:56.469022+0000","last_active":"2023-11-15T01:33:56.858274+0000","last_peered":"2023-11-15T01:33:56.858274+0000","last_clean":"2023-11-15T01:33:56.858274+0000","last_became_active":"2023-11-15T01:33:56.468713+0000","last_became_peered":"2023-11-15T01:33:56.468713+0000","last_unstale":"2023-11-15T01:33:56.858274+0000","last_undegraded":"2023-11-15T01:33:56.858274+0000","last_fullsized":"2023-11-15T01:33:56.858274+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868778+0000","last_change":"2023-11-15T01:33:56.865296+0000","last_active":"2023-11-15T01:33:56.868778+0000","last_peered":"2023-11-15T01:33:56.868778+0000","last_clean":"2023-11-15T01:33:56.868778+0000","last_became_active":"2023-11-15T01:33:56.864996+0000","last_became_peered":"2023-11-15T01:33:56.864996+0000","last_unstale":"2023-11-15T01:33:56.868778+0000","last_undegraded":"2023-11-15T01:33:56.868778+0000","last_fullsized":"2023-11-15T01:33:56.868778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.864452+0000","last_change":"2023-11-15T01:33:56.472655+0000","last_active":"2023-11-15T01:33:56.864452+0000","last_peered":"2023-11-15T01:33:56.864452+0000","last_clean":"2023-11-15T01:33:56.864452+0000","last_became_active":"2023-11-15T01:33:56.472369+0000","last_became_peered":"2023-11-15T01:33:56.472369+0000","last_unstale":"2023-11-15T01:33:56.864452+0000","last_undegraded":"2023-11-15T01:33:56.864452+0000","last_fullsized":"2023-11-15T01:33:56.864452+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875197+0000","last_change":"2023-11-15T01:33:56.866585+0000","last_active":"2023-11-15T01:33:56.875197+0000","last_peered":"2023-11-15T01:33:56.875197+0000","last_clean":"2023-11-15T01:33:56.875197+0000","last_became_active":"2023-11-15T01:33:56.866281+0000","last_became_peered":"2023-11-15T01:33:56.866281+0000","last_unstale":"2023-11-15T01:33:56.875197+0000","last_undegraded":"2023-11-15T01:33:56.875197+0000","last_fullsized":"2023-11-15T01:33:56.875197+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876043+0000","last_change":"2023-11-15T01:33:56.470274+0000","last_active":"2023-11-15T01:33:56.876043+0000","last_peered":"2023-11-15T01:33:56.876043+0000","last_clean":"2023-11-15T01:33:56.876043+0000","last_became_active":"2023-11-15T01:33:56.469919+0000","last_became_peered":"2023-11-15T01:33:56.469919+0000","last_unstale":"2023-11-15T01:33:56.876043+0000","last_undegraded":"2023-11-15T01:33:56.876043+0000","last_fullsized":"2023-11-15T01:33:56.876043+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868787+0000","last_change":"2023-11-15T01:33:56.861760+0000","last_active":"2023-11-15T01:33:56.868787+0000","last_peered":"2023-11-15T01:33:56.868787+0000","last_clean":"2023-11-15T01:33:56.868787+0000","last_became_active":"2023-11-15T01:33:56.861490+0000","last_became_peered":"2023-11-15T01:33:56.861490+0000","last_unstale":"2023-11-15T01:33:56.868787+0000","last_undegraded":"2023-11-15T01:33:56.868787+0000","last_fullsized":"2023-11-15T01:33:56.868787+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875430+0000","last_change":"2023-11-15T01:33:56.468949+0000","last_active":"2023-11-15T01:33:56.875430+0000","last_peered":"2023-11-15T01:33:56.875430+0000","last_clean":"2023-11-15T01:33:56.875430+0000","last_became_active":"2023-11-15T01:33:56.468359+0000","last_became_peered":"2023-11-15T01:33:56.468359+0000","last_unstale":"2023-11-15T01:33:56.875430+0000","last_undegraded":"2023-11-15T01:33:56.875430+0000","last_fullsized":"2023-11-15T01:33:56.875430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877434+0000","last_change":"2023-11-15T01:33:56.872116+0000","last_active":"2023-11-15T01:33:56.877434+0000","last_peered":"2023-11-15T01:33:56.877434+0000","last_clean":"2023-11-15T01:33:56.877434+0000","last_became_active":"2023-11-15T01:33:56.871846+0000","last_became_peered":"2023-11-15T01:33:56.871846+0000","last_unstale":"2023-11-15T01:33:56.877434+0000","last_undegraded":"2023-11-15T01:33:56.877434+0000","last_fullsized":"2023-11-15T01:33:56.877434+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870248+0000","last_change":"2023-11-15T01:33:56.466299+0000","last_active":"2023-11-15T01:33:56.870248+0000","last_peered":"2023-11-15T01:33:56.870248+0000","last_clean":"2023-11-15T01:33:56.870248+0000","last_became_active":"2023-11-15T01:33:56.465916+0000","last_became_peered":"2023-11-15T01:33:56.465916+0000","last_unstale":"2023-11-15T01:33:56.870248+0000","last_undegraded":"2023-11-15T01:33:56.870248+0000","last_fullsized":"2023-11-15T01:33:56.870248+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874692+0000","last_change":"2023-11-15T01:33:56.873782+0000","last_active":"2023-11-15T01:33:56.874692+0000","last_peered":"2023-11-15T01:33:56.874692+0000","last_clean":"2023-11-15T01:33:56.874692+0000","last_became_active":"2023-11-15T01:33:56.873501+0000","last_became_peered":"2023-11-15T01:33:56.873501+0000","last_unstale":"2023-11-15T01:33:56.874692+0000","last_undegraded":"2023-11-15T01:33:56.874692+0000","last_fullsized":"2023-11-15T01:33:56.874692+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858124+0000","last_change":"2023-11-15T01:33:56.473892+0000","last_active":"2023-11-15T01:33:56.858124+0000","last_peered":"2023-11-15T01:33:56.858124+0000","last_clean":"2023-11-15T01:33:56.858124+0000","last_became_active":"2023-11-15T01:33:56.473710+0000","last_became_peered":"2023-11-15T01:33:56.473710+0000","last_unstale":"2023-11-15T01:33:56.858124+0000","last_undegraded":"2023-11-15T01:33:56.858124+0000","last_fullsized":"2023-11-15T01:33:56.858124+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876700+0000","last_change":"2023-11-15T01:33:56.870602+0000","last_active":"2023-11-15T01:33:56.876700+0000","last_peered":"2023-11-15T01:33:56.876700+0000","last_clean":"2023-11-15T01:33:56.876700+0000","last_became_active":"2023-11-15T01:33:56.870368+0000","last_became_peered":"2023-11-15T01:33:56.870368+0000","last_unstale":"2023-11-15T01:33:56.876700+0000","last_undegraded":"2023-11-15T01:33:56.876700+0000","last_fullsized":"2023-11-15T01:33:56.876700+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858126+0000","last_change":"2023-11-15T01:33:56.471065+0000","last_active":"2023-11-15T01:33:56.858126+0000","last_peered":"2023-11-15T01:33:56.858126+0000","last_clean":"2023-11-15T01:33:56.858126+0000","last_became_active":"2023-11-15T01:33:56.470782+0000","last_became_peered":"2023-11-15T01:33:56.470782+0000","last_unstale":"2023-11-15T01:33:56.858126+0000","last_undegraded":"2023-11-15T01:33:56.858126+0000","last_fullsized":"2023-11-15T01:33:56.858126+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868575+0000","last_change":"2023-11-15T01:33:56.864580+0000","last_active":"2023-11-15T01:33:56.868575+0000","last_peered":"2023-11-15T01:33:56.868575+0000","last_clean":"2023-11-15T01:33:56.868575+0000","last_became_active":"2023-11-15T01:33:56.864319+0000","last_became_peered":"2023-11-15T01:33:56.864319+0000","last_unstale":"2023-11-15T01:33:56.868575+0000","last_undegraded":"2023-11-15T01:33:56.868575+0000","last_fullsized":"2023-11-15T01:33:56.868575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870318+0000","last_change":"2023-11-15T01:33:56.470098+0000","last_active":"2023-11-15T01:33:56.870318+0000","last_peered":"2023-11-15T01:33:56.870318+0000","last_clean":"2023-11-15T01:33:56.870318+0000","last_became_active":"2023-11-15T01:33:56.466313+0000","last_became_peered":"2023-11-15T01:33:56.466313+0000","last_unstale":"2023-11-15T01:33:56.870318+0000","last_undegraded":"2023-11-15T01:33:56.870318+0000","last_fullsized":"2023-11-15T01:33:56.870318+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.867806+0000","last_change":"2023-11-15T01:33:56.862031+0000","last_active":"2023-11-15T01:33:56.867806+0000","last_peered":"2023-11-15T01:33:56.867806+0000","last_clean":"2023-11-15T01:33:56.867806+0000","last_became_active":"2023-11-15T01:33:56.861772+0000","last_became_peered":"2023-11-15T01:33:56.861772+0000","last_unstale":"2023-11-15T01:33:56.867806+0000","last_undegraded":"2023-11-15T01:33:56.867806+0000","last_fullsized":"2023-11-15T01:33:56.867806+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851553+0000","last_change":"2023-11-15T01:33:56.474219+0000","last_active":"2023-11-15T01:33:56.851553+0000","last_peered":"2023-11-15T01:33:56.851553+0000","last_clean":"2023-11-15T01:33:56.851553+0000","last_became_active":"2023-11-15T01:33:56.473738+0000","last_became_peered":"2023-11-15T01:33:56.473738+0000","last_unstale":"2023-11-15T01:33:56.851553+0000","last_undegraded":"2023-11-15T01:33:56.851553+0000","last_fullsized":"2023-11-15T01:33:56.851553+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877515+0000","last_change":"2023-11-15T01:33:56.867511+0000","last_active":"2023-11-15T01:33:56.877515+0000","last_peered":"2023-11-15T01:33:56.877515+0000","last_clean":"2023-11-15T01:33:56.877515+0000","last_became_active":"2023-11-15T01:33:56.867228+0000","last_became_peered":"2023-11-15T01:33:56.867228+0000","last_unstale":"2023-11-15T01:33:56.877515+0000","last_undegraded":"2023-11-15T01:33:56.877515+0000","last_fullsized":"2023-11-15T01:33:56.877515+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860126+0000","last_change":"2023-11-15T01:33:56.478983+0000","last_active":"2023-11-15T01:33:56.860126+0000","last_peered":"2023-11-15T01:33:56.860126+0000","last_clean":"2023-11-15T01:33:56.860126+0000","last_became_active":"2023-11-15T01:33:56.478740+0000","last_became_peered":"2023-11-15T01:33:56.478740+0000","last_unstale":"2023-11-15T01:33:56.860126+0000","last_undegraded":"2023-11-15T01:33:56.860126+0000","last_fullsized":"2023-11-15T01:33:56.860126+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.878323+0000","last_change":"2023-11-15T01:33:56.874707+0000","last_active":"2023-11-15T01:33:56.878323+0000","last_peered":"2023-11-15T01:33:56.878323+0000","last_clean":"2023-11-15T01:33:56.878323+0000","last_became_active":"2023-11-15T01:33:56.874384+0000","last_became_peered":"2023-11-15T01:33:56.874384+0000","last_unstale":"2023-11-15T01:33:56.878323+0000","last_undegraded":"2023-11-15T01:33:56.878323+0000","last_fullsized":"2023-11-15T01:33:56.878323+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861834+0000","last_change":"2023-11-15T01:33:56.468488+0000","last_active":"2023-11-15T01:33:56.861834+0000","last_peered":"2023-11-15T01:33:56.861834+0000","last_clean":"2023-11-15T01:33:56.861834+0000","last_became_active":"2023-11-15T01:33:56.468185+0000","last_became_peered":"2023-11-15T01:33:56.468185+0000","last_unstale":"2023-11-15T01:33:56.861834+0000","last_undegraded":"2023-11-15T01:33:56.861834+0000","last_fullsized":"2023-11-15T01:33:56.861834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877540+0000","last_change":"2023-11-15T01:33:56.871264+0000","last_active":"2023-11-15T01:33:56.877540+0000","last_peered":"2023-11-15T01:33:56.877540+0000","last_clean":"2023-11-15T01:33:56.877540+0000","last_became_active":"2023-11-15T01:33:56.870999+0000","last_became_peered":"2023-11-15T01:33:56.870999+0000","last_unstale":"2023-11-15T01:33:56.877540+0000","last_undegraded":"2023-11-15T01:33:56.877540+0000","last_fullsized":"2023-11-15T01:33:56.877540+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858830+0000","last_change":"2023-11-15T01:33:56.471602+0000","last_active":"2023-11-15T01:33:56.858830+0000","last_peered":"2023-11-15T01:33:56.858830+0000","last_clean":"2023-11-15T01:33:56.858830+0000","last_became_active":"2023-11-15T01:33:56.471289+0000","last_became_peered":"2023-11-15T01:33:56.471289+0000","last_unstale":"2023-11-15T01:33:56.858830+0000","last_undegraded":"2023-11-15T01:33:56.858830+0000","last_fullsized":"2023-11-15T01:33:56.858830+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.856327+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:33:56.856327+0000","last_peered":"2023-11-15T01:33:56.856327+0000","last_clean":"2023-11-15T01:33:56.856327+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:33:56.856327+0000","last_undegraded":"2023-11-15T01:33:56.856327+0000","last_fullsized":"2023-11-15T01:33:56.856327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860918+0000","last_change":"2023-11-15T01:33:56.858629+0000","last_active":"2023-11-15T01:33:56.860918+0000","last_peered":"2023-11-15T01:33:56.860918+0000","last_clean":"2023-11-15T01:33:56.860918+0000","last_became_active":"2023-11-15T01:33:56.858315+0000","last_became_peered":"2023-11-15T01:33:56.858315+0000","last_unstale":"2023-11-15T01:33:56.860918+0000","last_undegraded":"2023-11-15T01:33:56.860918+0000","last_fullsized":"2023-11-15T01:33:56.860918+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879015+0000","last_change":"2023-11-15T01:33:56.470464+0000","last_active":"2023-11-15T01:33:56.879015+0000","last_peered":"2023-11-15T01:33:56.879015+0000","last_clean":"2023-11-15T01:33:56.879015+0000","last_became_active":"2023-11-15T01:33:56.470182+0000","last_became_peered":"2023-11-15T01:33:56.470182+0000","last_unstale":"2023-11-15T01:33:56.879015+0000","last_undegraded":"2023-11-15T01:33:56.879015+0000","last_fullsized":"2023-11-15T01:33:56.879015+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.854403+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:33:56.854403+0000","last_peered":"2023-11-15T01:33:56.854403+0000","last_clean":"2023-11-15T01:33:56.854403+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:33:56.854403+0000","last_undegraded":"2023-11-15T01:33:56.854403+0000","last_fullsized":"2023-11-15T01:33:56.854403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870739+0000","last_change":"2023-11-15T01:33:56.861357+0000","last_active":"2023-11-15T01:33:56.870739+0000","last_peered":"2023-11-15T01:33:56.870739+0000","last_clean":"2023-11-15T01:33:56.870739+0000","last_became_active":"2023-11-15T01:33:56.861060+0000","last_became_peered":"2023-11-15T01:33:56.861060+0000","last_unstale":"2023-11-15T01:33:56.870739+0000","last_undegraded":"2023-11-15T01:33:56.870739+0000","last_fullsized":"2023-11-15T01:33:56.870739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859580+0000","last_change":"2023-11-15T01:33:56.462711+0000","last_active":"2023-11-15T01:33:56.859580+0000","last_peered":"2023-11-15T01:33:56.859580+0000","last_clean":"2023-11-15T01:33:56.859580+0000","last_became_active":"2023-11-15T01:33:56.462463+0000","last_became_peered":"2023-11-15T01:33:56.462463+0000","last_unstale":"2023-11-15T01:33:56.859580+0000","last_undegraded":"2023-11-15T01:33:56.859580+0000","last_fullsized":"2023-11-15T01:33:56.859580+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.863559+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:33:56.863559+0000","last_peered":"2023-11-15T01:33:56.863559+0000","last_clean":"2023-11-15T01:33:56.863559+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:33:56.863559+0000","last_undegraded":"2023-11-15T01:33:56.863559+0000","last_fullsized":"2023-11-15T01:33:56.863559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.865232+0000","last_change":"2023-11-15T01:33:56.861471+0000","last_active":"2023-11-15T01:33:56.865232+0000","last_peered":"2023-11-15T01:33:56.865232+0000","last_clean":"2023-11-15T01:33:56.865232+0000","last_became_active":"2023-11-15T01:33:56.860124+0000","last_became_peered":"2023-11-15T01:33:56.860124+0000","last_unstale":"2023-11-15T01:33:56.865232+0000","last_undegraded":"2023-11-15T01:33:56.865232+0000","last_fullsized":"2023-11-15T01:33:56.865232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860345+0000","last_change":"2023-11-15T01:33:56.467702+0000","last_active":"2023-11-15T01:33:56.860345+0000","last_peered":"2023-11-15T01:33:56.860345+0000","last_clean":"2023-11-15T01:33:56.860345+0000","last_became_active":"2023-11-15T01:33:56.467346+0000","last_became_peered":"2023-11-15T01:33:56.467346+0000","last_unstale":"2023-11-15T01:33:56.860345+0000","last_undegraded":"2023-11-15T01:33:56.860345+0000","last_fullsized":"2023-11-15T01:33:56.860345+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.854655+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:33:56.854655+0000","last_peered":"2023-11-15T01:33:56.854655+0000","last_clean":"2023-11-15T01:33:56.854655+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:33:56.854655+0000","last_undegraded":"2023-11-15T01:33:56.854655+0000","last_fullsized":"2023-11-15T01:33:56.854655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.864776+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:33:56.864776+0000","last_peered":"2023-11-15T01:33:56.864776+0000","last_clean":"2023-11-15T01:33:56.864776+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:33:56.864776+0000","last_undegraded":"2023-11-15T01:33:56.864776+0000","last_fullsized":"2023-11-15T01:33:56.864776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877503+0000","last_change":"2023-11-15T01:33:56.872973+0000","last_active":"2023-11-15T01:33:56.877503+0000","last_peered":"2023-11-15T01:33:56.877503+0000","last_clean":"2023-11-15T01:33:56.877503+0000","last_became_active":"2023-11-15T01:33:56.872705+0000","last_became_peered":"2023-11-15T01:33:56.872705+0000","last_unstale":"2023-11-15T01:33:56.877503+0000","last_undegraded":"2023-11-15T01:33:56.877503+0000","last_fullsized":"2023-11-15T01:33:56.877503+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.867400+0000","last_change":"2023-11-15T01:33:56.470260+0000","last_active":"2023-11-15T01:33:56.867400+0000","last_peered":"2023-11-15T01:33:56.867400+0000","last_clean":"2023-11-15T01:33:56.867400+0000","last_became_active":"2023-11-15T01:33:56.469956+0000","last_became_peered":"2023-11-15T01:33:56.469956+0000","last_unstale":"2023-11-15T01:33:56.867400+0000","last_undegraded":"2023-11-15T01:33:56.867400+0000","last_fullsized":"2023-11-15T01:33:56.867400+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.864854+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:33:56.864854+0000","last_peered":"2023-11-15T01:33:56.864854+0000","last_clean":"2023-11-15T01:33:56.864854+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:33:56.864854+0000","last_undegraded":"2023-11-15T01:33:56.864854+0000","last_fullsized":"2023-11-15T01:33:56.864854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873538+0000","last_change":"2023-11-15T01:33:56.872687+0000","last_active":"2023-11-15T01:33:56.873538+0000","last_peered":"2023-11-15T01:33:56.873538+0000","last_clean":"2023-11-15T01:33:56.873538+0000","last_became_active":"2023-11-15T01:33:56.872163+0000","last_became_peered":"2023-11-15T01:33:56.872163+0000","last_unstale":"2023-11-15T01:33:56.873538+0000","last_undegraded":"2023-11-15T01:33:56.873538+0000","last_fullsized":"2023-11-15T01:33:56.873538+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.857883+0000","last_change":"2023-11-15T01:33:56.466600+0000","last_active":"2023-11-15T01:33:56.857883+0000","last_peered":"2023-11-15T01:33:56.857883+0000","last_clean":"2023-11-15T01:33:56.857883+0000","last_became_active":"2023-11-15T01:33:56.466275+0000","last_became_peered":"2023-11-15T01:33:56.466275+0000","last_unstale":"2023-11-15T01:33:56.857883+0000","last_undegraded":"2023-11-15T01:33:56.857883+0000","last_fullsized":"2023-11-15T01:33:56.857883+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.867431+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:33:56.867431+0000","last_peered":"2023-11-15T01:33:56.867431+0000","last_clean":"2023-11-15T01:33:56.867431+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:33:56.867431+0000","last_undegraded":"2023-11-15T01:33:56.867431+0000","last_fullsized":"2023-11-15T01:33:56.867431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873310+0000","last_change":"2023-11-15T01:33:56.865528+0000","last_active":"2023-11-15T01:33:56.873310+0000","last_peered":"2023-11-15T01:33:56.873310+0000","last_clean":"2023-11-15T01:33:56.873310+0000","last_became_active":"2023-11-15T01:33:56.865239+0000","last_became_peered":"2023-11-15T01:33:56.865239+0000","last_unstale":"2023-11-15T01:33:56.873310+0000","last_undegraded":"2023-11-15T01:33:56.873310+0000","last_fullsized":"2023-11-15T01:33:56.873310+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.852317+0000","last_change":"2023-11-15T01:33:56.470793+0000","last_active":"2023-11-15T01:33:56.852317+0000","last_peered":"2023-11-15T01:33:56.852317+0000","last_clean":"2023-11-15T01:33:56.852317+0000","last_became_active":"2023-11-15T01:33:56.469938+0000","last_became_peered":"2023-11-15T01:33:56.469938+0000","last_unstale":"2023-11-15T01:33:56.852317+0000","last_undegraded":"2023-11-15T01:33:56.852317+0000","last_fullsized":"2023-11-15T01:33:56.852317+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.857477+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:33:56.857477+0000","last_peered":"2023-11-15T01:33:56.857477+0000","last_clean":"2023-11-15T01:33:56.857477+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:33:56.857477+0000","last_undegraded":"2023-11-15T01:33:56.857477+0000","last_fullsized":"2023-11-15T01:33:56.857477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.881909+0000","last_change":"2023-11-15T01:33:56.877221+0000","last_active":"2023-11-15T01:33:56.881909+0000","last_peered":"2023-11-15T01:33:56.881909+0000","last_clean":"2023-11-15T01:33:56.881909+0000","last_became_active":"2023-11-15T01:33:56.876912+0000","last_became_peered":"2023-11-15T01:33:56.876912+0000","last_unstale":"2023-11-15T01:33:56.881909+0000","last_undegraded":"2023-11-15T01:33:56.881909+0000","last_fullsized":"2023-11-15T01:33:56.881909+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851763+0000","last_change":"2023-11-15T01:33:56.476704+0000","last_active":"2023-11-15T01:33:56.851763+0000","last_peered":"2023-11-15T01:33:56.851763+0000","last_clean":"2023-11-15T01:33:56.851763+0000","last_became_active":"2023-11-15T01:33:56.476357+0000","last_became_peered":"2023-11-15T01:33:56.476357+0000","last_unstale":"2023-11-15T01:33:56.851763+0000","last_undegraded":"2023-11-15T01:33:56.851763+0000","last_fullsized":"2023-11-15T01:33:56.851763+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859071+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:33:56.859071+0000","last_peered":"2023-11-15T01:33:56.859071+0000","last_clean":"2023-11-15T01:33:56.859071+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:33:56.859071+0000","last_undegraded":"2023-11-15T01:33:56.859071+0000","last_fullsized":"2023-11-15T01:33:56.859071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301912,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069928,"statfs":{"total":96636764160,"available":96327606272,"internally_reserved":0,"allocated":737280,"data_stored":353266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71199999999999997,"5min":0.81499999999999995,"15min":0.82299999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.67200000000000004,"5min":0.79500000000000004,"15min":0.83299999999999996},"last":0.64600000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77700000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.34399999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.65900000000000003,"5min":0.78000000000000003,"15min":0.81499999999999995},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.77800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68999999999999995,"5min":0.82199999999999995,"15min":0.86299999999999999},"last":0.68999999999999995}]},{"osd":3,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68400000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":0.81200000000000006},"last":0.47799999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.46999999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.84499999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.53000000000000003,"15min":0.54700000000000004},"min":{"1min":0.32500000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.83799999999999997},"last":0.56799999999999995}]},{"osd":5,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47499999999999998,"15min":0.49199999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.71999999999999997,"5min":0.76600000000000001,"15min":0.77500000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73899999999999999,"5min":0.748,"15min":0.78500000000000003},"last":0.49099999999999999}]},{"osd":6,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.36899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.54800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.755,"5min":0.76100000000000001,"15min":0.85099999999999998},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575000,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301904,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069936,"statfs":{"total":96636764160,"available":96327614464,"internally_reserved":0,"allocated":729088,"data_stored":352658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.39800000000000002,"5min":0.34000000000000002,"15min":0.29199999999999998},"max":{"1min":0.63600000000000001,"5min":0.82399999999999995,"15min":0.94299999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55000000000000004,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.34499999999999997,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.75600000000000001,"15min":0.97799999999999998},"last":0.40100000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.38700000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":1.0649999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57299999999999995,"15min":0.54700000000000004},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.84699999999999998,"15min":1.022},"last":0.48999999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.71999999999999997,"5min":0.84199999999999997,"15min":1.038},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70499999999999996,"5min":0.80700000000000005,"15min":0.995},"last":0.41499999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.41299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.69399999999999995,"5min":0.91300000000000003,"15min":1.028},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68500000000000005,"5min":0.874,"15min":1.004},"last":0.504}]},{"osd":4,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.314,"5min":0.31,"15min":0.26600000000000001},"max":{"1min":0.67900000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.25800000000000001},"max":{"1min":0.67500000000000004,"5min":0.68799999999999994,"15min":0.81799999999999995},"last":0.51200000000000001}]},{"osd":5,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.312},"max":{"1min":0.68500000000000005,"5min":0.69799999999999995,"15min":0.74099999999999999},"last":0.432},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.73799999999999999,"5min":0.79200000000000004,"15min":0.79900000000000004},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.377,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":0.70499999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.41399999999999998,"15min":0.34000000000000002},"max":{"1min":0.72799999999999998,"5min":0.81299999999999994,"15min":1.0009999999999999},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575001,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301904,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069936,"statfs":{"total":96636764160,"available":96327614464,"internally_reserved":0,"allocated":729088,"data_stored":352678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23999999999999999},"max":{"1min":0.54900000000000004,"5min":0.64500000000000002,"15min":0.77800000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41199999999999998,"15min":0.38500000000000001},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.247},"max":{"1min":0.55500000000000005,"5min":0.65600000000000003,"15min":0.73099999999999998},"last":0.307}]},{"osd":2,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.40400000000000003,"15min":0.38700000000000001},"min":{"1min":0.29299999999999998,"5min":0.27800000000000002,"15min":0.22600000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.69599999999999995},"last":0.318},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45100000000000001,"15min":0.434},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.90000000000000002},"last":0.39300000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.502,"15min":0.48099999999999998},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.31},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":1.0009999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.48799999999999999,"15min":0.45600000000000002},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.28000000000000003},"max":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.75600000000000001},"last":0.41699999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79400000000000004,"5min":0.82299999999999995,"15min":0.89300000000000002},"last":0.44},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.65200000000000002,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":0.78200000000000003,"5min":0.88700000000000001,"15min":1.0509999999999999},"last":0.68600000000000005}]},{"osd":5,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65000000000000002,"15min":0.626},"min":{"1min":0.432,"5min":0.40100000000000002,"15min":0.38500000000000001},"max":{"1min":0.78100000000000003,"5min":0.83399999999999996,"15min":0.92700000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66000000000000003,"15min":0.63},"min":{"1min":0.46400000000000002,"5min":0.433,"15min":0.373},"max":{"1min":0.91700000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56999999999999995}]},{"osd":6,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68600000000000005,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82199999999999995,"5min":0.90900000000000003,"15min":1.0029999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.67500000000000004},"min":{"1min":0.51300000000000001,"5min":0.45200000000000001,"15min":0.41199999999999998},"max":{"1min":0.90100000000000002,"5min":0.96599999999999997,"15min":0.996},"last":0.67200000000000004}]},{"osd":7,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70599999999999996,"15min":0.68200000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88500000000000001,"5min":0.93899999999999995,"15min":1.25},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70399999999999996,"15min":0.67700000000000005},"min":{"1min":0.52200000000000002,"5min":0.495,"15min":0.46100000000000002},"max":{"1min":0.92200000000000004,"5min":0.96699999999999997,"15min":0.99199999999999999},"last":0.59399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301912,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069928,"statfs":{"total":96636764160,"available":96327606272,"internally_reserved":0,"allocated":737280,"data_stored":352714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.36199999999999999,"15min":0.35899999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.50700000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.41599999999999998,"15min":0.40200000000000002},"min":{"1min":0.26300000000000001,"5min":0.252,"15min":0.215},"max":{"1min":0.50600000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.33100000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.39400000000000002,"15min":0.378},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.505,"5min":0.60499999999999998,"15min":0.64200000000000002},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.42599999999999999,"15min":0.42999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.47399999999999998,"5min":0.68600000000000005,"15min":1.0429999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.42999999999999999,"15min":0.41899999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.22500000000000001},"max":{"1min":0.55700000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.311},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.45500000000000002,"15min":0.443},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27700000000000002},"max":{"1min":0.58399999999999996,"5min":0.73199999999999998,"15min":0.83399999999999996},"last":0.34399999999999997}]},{"osd":4,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78800000000000003,"5min":0.97799999999999998,"15min":1.454},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.442},"max":{"1min":0.79300000000000004,"5min":0.94999999999999996,"15min":1.147},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69399999999999995,"5min":1.01,"15min":1.079},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.624,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.73699999999999999,"5min":0.91400000000000003,"15min":1.1120000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":1.2529999999999999},"last":0.496},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.68999999999999995,"5min":1.042,"15min":1.206},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.78100000000000003,"5min":1.0620000000000001,"15min":1.2669999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68200000000000005,"15min":0.69799999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83299999999999996,"5min":0.99199999999999999,"15min":1.4119999999999999},"last":0.65300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065832,"statfs":{"total":96636764160,"available":96323411968,"internally_reserved":0,"allocated":737280,"data_stored":354124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36699999999999999,"15min":0.36199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.221},"max":{"1min":0.48599999999999999,"5min":0.60199999999999998,"15min":0.61899999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.40200000000000002,"15min":0.39400000000000002},"min":{"1min":0.28699999999999998,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.63700000000000001,"15min":0.67800000000000005},"last":0.35199999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":0.70999999999999996,"15min":0.75},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66300000000000003,"5min":0.73499999999999999,"15min":0.92000000000000004},"last":0.38500000000000001}]},{"osd":3,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45600000000000002,"15min":0.438},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.57999999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.42999999999999999},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.253},"max":{"1min":0.66700000000000004,"5min":0.68999999999999995,"15min":0.74199999999999999},"last":0.309}]},{"osd":4,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89000000000000001,"5min":0.90900000000000003,"15min":1.0800000000000001},"last":0.499},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.629,"15min":0.64600000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.95399999999999996,"15min":1.052},"last":0.49099999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.63800000000000001,"15min":0.64500000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.93000000000000005,"15min":0.998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63800000000000001,"15min":0.63600000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.85499999999999998,"5min":0.96099999999999997,"15min":1.1339999999999999},"last":0.436}]},{"osd":6,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65800000000000003,"15min":0.65900000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.91300000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.441,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84199999999999997,"5min":1.016,"15min":1.119},"last":0.47399999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.48399999999999999,"5min":0.45200000000000001,"15min":0.438},"max":{"1min":0.79700000000000004,"5min":1.03,"15min":1.103},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.68600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065832,"statfs":{"total":96636764160,"available":96323411968,"internally_reserved":0,"allocated":737280,"data_stored":353254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39200000000000002,"15min":0.36199999999999999},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.22600000000000001},"max":{"1min":0.53100000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.42199999999999999,"15min":0.38800000000000001},"min":{"1min":0.30299999999999999,"5min":0.29499999999999998,"15min":0.23200000000000001},"max":{"1min":0.54300000000000004,"5min":0.70499999999999996,"15min":0.70899999999999996},"last":0.27900000000000003}]},{"osd":1,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.41099999999999998,"15min":0.377},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.23599999999999999},"max":{"1min":0.59799999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.46500000000000002,"15min":0.441},"min":{"1min":0.372,"5min":0.29399999999999998,"15min":0.28999999999999998},"max":{"1min":0.621,"5min":0.747,"15min":0.80500000000000005},"last":0.33600000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.436},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.26900000000000002},"max":{"1min":0.58799999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.5,"15min":0.46300000000000002},"min":{"1min":0.38900000000000001,"5min":0.35999999999999999,"15min":0.26200000000000001},"max":{"1min":0.64500000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41999999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.42099999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.92600000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.44,"15min":0.39000000000000001},"max":{"1min":0.82699999999999996,"5min":1.036,"15min":1.0589999999999999},"last":0.40600000000000003}]},{"osd":5,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.64400000000000002},"min":{"1min":0.503,"5min":0.48399999999999999,"15min":0.41099999999999998},"max":{"1min":0.80600000000000005,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.44400000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86099999999999999,"5min":0.90100000000000002,"15min":0.95999999999999996},"last":0.41099999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.65200000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.42499999999999999},"max":{"1min":0.94299999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.67800000000000005},"min":{"1min":0.53500000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89600000000000002,"5min":1.0900000000000001,"15min":1.169},"last":0.44900000000000001}]},{"osd":7,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69199999999999995,"15min":0.67400000000000004},"min":{"1min":0.52600000000000002,"5min":0.48399999999999999,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":1.071,"15min":1.071},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.70599999999999996,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.97299999999999998,"5min":1.1319999999999999,"15min":1.1459999999999999},"last":0.45500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":729088,"data_stored":353142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.55000000000000004},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.88,"15min":0.88},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.74399999999999999,"15min":0.78800000000000003},"last":0.41899999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57999999999999996,"15min":0.56499999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":0.77500000000000002,"5min":1.087,"15min":1.087},"last":0.63},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.80400000000000005,"15min":0.81000000000000005},"last":0.56599999999999995}]},{"osd":2,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":0.70899999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58199999999999996,"15min":0.58299999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47699999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70099999999999996,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.749,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.58799999999999997}]},{"osd":5,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.47599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.30399999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.80600000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47499999999999998,"15min":0.501},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":0.68000000000000005,"15min":0.85299999999999998},"last":0.46200000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47199999999999998,"15min":0.50700000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.84199999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.51100000000000001,"15min":0.54100000000000004},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":0.66500000000000004,"5min":0.77600000000000002,"15min":0.83199999999999996},"last":0.53000000000000003}]},{"osd":7,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.50800000000000001,"15min":0.53600000000000003},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64300000000000002,"5min":0.873,"15min":0.873},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54800000000000004,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":0.74099999999999999,"5min":0.78400000000000003,"15min":0.90100000000000002},"last":0.71899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574999,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301904,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069936,"statfs":{"total":96636764160,"available":96327614464,"internally_reserved":0,"allocated":729088,"data_stored":353480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72999999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.36199999999999999},"max":{"1min":0.68300000000000005,"5min":0.74199999999999999,"15min":0.81200000000000006},"last":0.54500000000000004}]},{"osd":1,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.62}]},{"osd":2,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.318},"max":{"1min":0.64400000000000002,"5min":0.72499999999999998,"15min":0.86199999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.34999999999999998},"max":{"1min":0.75600000000000001,"5min":0.77700000000000002,"15min":1.103},"last":0.65700000000000003}]},{"osd":3,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75,"5min":0.75800000000000001,"15min":0.78100000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.438,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1.127},"last":0.755}]},{"osd":4,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.47599999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64400000000000002,"5min":0.70699999999999996,"15min":0.94399999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67800000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.67800000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47699999999999998,"15min":0.497},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":1.0660000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.497,"5min":0.496,"15min":0.51800000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.70799999999999996}]},{"osd":7,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.499,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.68999999999999995,"5min":0.73599999999999999,"15min":0.97199999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":1.1499999999999999},"last":0.85799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:34:01.623 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-15T01:34:01.763 INFO:tasks.ceph.mds.d.smithi141.stderr:2023-11-15T01:34:01.763+0000 7ffa03824700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T01:34:01.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.767+0000 7f199c09b700 1 Processor -- start 2023-11-15T01:34:01.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.767+0000 7f199c09b700 1 -- start start 2023-11-15T01:34:01.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.768+0000 7f199c09b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1994154150 0x7f1994154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.768+0000 7f199c09b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19940ab1a0 0x7f1994158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.768+0000 7f199c09b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19940c06f0 con 0x7f19940aa060 2023-11-15T01:34:01.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.768+0000 7f199c09b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19940c09d0 con 0x7f1994154150 2023-11-15T01:34:01.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.768+0000 7f199c09b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1994158820 con 0x7f19940ab1a0 2023-11-15T01:34:01.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.769+0000 7f1999e37700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1994154150 0x7f1994154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.769+0000 7f1999636700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19940ab1a0 0x7f1994158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.769+0000 7f199a638700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f19940aa060 0x7f19940c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:33374/0 (socket says 172.21.15.1:33374) 2023-11-15T01:34:01.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.769+0000 7f199a638700 1 -- 172.21.15.1:0/1181461796 learned_addr learned my addr 172.21.15.1:0/1181461796 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:34:01.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.769+0000 7f1999e37700 1 -- 172.21.15.1:0/1181461796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19940ab1a0 msgr2=0x7f1994158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:01.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.769+0000 7f1999e37700 1 --2- 172.21.15.1:0/1181461796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19940ab1a0 0x7f1994158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.769+0000 7f1999e37700 1 -- 172.21.15.1:0/1181461796 >> v1:172.21.15.141:6789/0 conn(0x7f19940aa060 legacy=0x7f19940c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.769+0000 7f1999e37700 1 -- 172.21.15.1:0/1181461796 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1994158b00 con 0x7f1994154150 2023-11-15T01:34:01.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.769+0000 7f1999636700 1 --2- 172.21.15.1:0/1181461796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19940ab1a0 0x7f1994158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:34:01.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.769+0000 7f1999e37700 1 --2- 172.21.15.1:0/1181461796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1994154150 0x7f1994154530 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f198c009760 tx=0x7f198c009060).ready entity=mon.1 client_cookie=d4a39973aed42223 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:01.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.769+0000 7f1998e35700 1 -- 172.21.15.1:0/1181461796 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0090d0 con 0x7f1994154150 2023-11-15T01:34:01.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.769+0000 7f1998e35700 1 -- 172.21.15.1:0/1181461796 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c00f510 con 0x7f1994154150 2023-11-15T01:34:01.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.769+0000 7f1998e35700 1 -- 172.21.15.1:0/1181461796 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c00f890 con 0x7f1994154150 2023-11-15T01:34:01.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.770+0000 7f199c09b700 1 -- 172.21.15.1:0/1181461796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1994154150 msgr2=0x7f1994154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.770+0000 7f199c09b700 1 --2- 172.21.15.1:0/1181461796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1994154150 0x7f1994154530 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f198c009760 tx=0x7f198c009060).stop 2023-11-15T01:34:01.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.770+0000 7f199c09b700 1 -- 172.21.15.1:0/1181461796 shutdown_connections 2023-11-15T01:34:01.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.770+0000 7f199c09b700 1 --2- 172.21.15.1:0/1181461796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1994154150 0x7f1994154530 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.770+0000 7f199c09b700 1 --2- 172.21.15.1:0/1181461796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19940ab1a0 0x7f1994158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.770+0000 7f199c09b700 1 -- 172.21.15.1:0/1181461796 >> 172.21.15.1:0/1181461796 conn(0x7f1994064aa0 msgr2=0x7f1994064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:01.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.770+0000 7f199c09b700 1 -- 172.21.15.1:0/1181461796 shutdown_connections 2023-11-15T01:34:01.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.770+0000 7f199c09b700 1 -- 172.21.15.1:0/1181461796 wait complete. 2023-11-15T01:34:01.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.771+0000 7f199c09b700 1 Processor -- start 2023-11-15T01:34:01.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.771+0000 7f199c09b700 1 -- start start 2023-11-15T01:34:01.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f199c09b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19940aa060 0x7f19940c3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f199c09b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19940ab1a0 0x7f19940b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f199c09b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1994154150 0x7f1994152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f199c09b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19940c3760 con 0x7f19940ab1a0 2023-11-15T01:34:01.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f199c09b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19940b10b0 con 0x7f1994154150 2023-11-15T01:34:01.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f199c09b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19940c9780 con 0x7f19940aa060 2023-11-15T01:34:01.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f1999636700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19940ab1a0 0x7f19940b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f1999636700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19940ab1a0 0x7f19940b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50226/0 (socket says 172.21.15.1:50226) 2023-11-15T01:34:01.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f1999636700 1 -- 172.21.15.1:0/3781475292 learned_addr learned my addr 172.21.15.1:0/3781475292 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:01.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f1999e37700 1 --2- 172.21.15.1:0/3781475292 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19940aa060 0x7f19940c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f199a638700 1 --2- 172.21.15.1:0/3781475292 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1994154150 0x7f1994152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f1999636700 1 -- 172.21.15.1:0/3781475292 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19940aa060 msgr2=0x7f19940c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f1999636700 1 --2- 172.21.15.1:0/3781475292 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19940aa060 0x7f19940c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f1999636700 1 -- 172.21.15.1:0/3781475292 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1994154150 msgr2=0x7f1994152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:01.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f1999636700 1 --2- 172.21.15.1:0/3781475292 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1994154150 0x7f1994152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:01.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f1999636700 1 -- 172.21.15.1:0/3781475292 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19880092a0 con 0x7f19940ab1a0 2023-11-15T01:34:01.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.772+0000 7f1999636700 1 --2- 172.21.15.1:0/3781475292 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19940ab1a0 0x7f19940b0bc0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f198800ea50 tx=0x7f1988009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:01.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.773+0000 7f1991ffb700 1 -- 172.21.15.1:0/3781475292 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198800ee90 con 0x7f19940ab1a0 2023-11-15T01:34:01.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.773+0000 7f1991ffb700 1 -- 172.21.15.1:0/3781475292 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198800c7f0 con 0x7f19940ab1a0 2023-11-15T01:34:01.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.773+0000 7f199c09b700 1 -- 172.21.15.1:0/3781475292 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c0092a0 con 0x7f19940ab1a0 2023-11-15T01:34:01.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.773+0000 7f1991ffb700 1 -- 172.21.15.1:0/3781475292 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198800cb70 con 0x7f19940ab1a0 2023-11-15T01:34:01.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.773+0000 7f199c09b700 1 -- 172.21.15.1:0/3781475292 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19940c3f40 con 0x7f19940ab1a0 2023-11-15T01:34:01.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.774+0000 7f199c09b700 1 -- 172.21.15.1:0/3781475292 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199406c7e0 con 0x7f19940ab1a0 2023-11-15T01:34:01.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.774+0000 7f1991ffb700 1 -- 172.21.15.1:0/3781475292 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f198801b400 con 0x7f19940ab1a0 2023-11-15T01:34:01.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.775+0000 7f1991ffb700 1 --2- 172.21.15.1:0/3781475292 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f198005f270 0x7f1980061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:01.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.775+0000 7f1991ffb700 1 -- 172.21.15.1:0/3781475292 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f198807aaa0 con 0x7f19940ab1a0 2023-11-15T01:34:01.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.775+0000 7f1999e37700 1 --2- 172.21.15.1:0/3781475292 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f198005f270 0x7f1980061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:01.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.775+0000 7f1999e37700 1 --2- 172.21.15.1:0/3781475292 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f198005f270 0x7f1980061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f198c009760 tx=0x7f198c017000).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:01.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:01.779+0000 7f1991ffb700 1 -- 172.21.15.1:0/3781475292 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f198804b940 con 0x7f19940ab1a0 2023-11-15T01:34:02.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.020+0000 7f199c09b700 1 -- 172.21.15.1:0/3781475292 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f19940c02a0 con 0x7f19940ab1a0 2023-11-15T01:34:02.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.021+0000 7f1991ffb700 1 -- 172.21.15.1:0/3781475292 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3018 (secure 0 0 0) 0x7f198804ef60 con 0x7f19940ab1a0 2023-11-15T01:34:02.022 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:34:02.023 INFO:teuthology.orchestra.run.smithi001.stdout:{"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":763,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":61,"num_osds":8,"num_up_osds":8,"osd_up_since":1700011287,"num_in_osds":8,"osd_in_since":1700011281,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":2477424640,"bytes_avail":770616688640,"bytes_total":773094113280},"fsmap":{"epoch":23,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":5802}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-11-15T01:33:44.416494+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-15T01:34:02.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.022+0000 7f199c09b700 1 -- 172.21.15.1:0/3781475292 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f198005f270 msgr2=0x7f1980061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:02.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.022+0000 7f199c09b700 1 --2- 172.21.15.1:0/3781475292 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f198005f270 0x7f1980061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f198c009760 tx=0x7f198c017000).stop 2023-11-15T01:34:02.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.022+0000 7f199c09b700 1 -- 172.21.15.1:0/3781475292 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19940ab1a0 msgr2=0x7f19940b0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:02.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.022+0000 7f199c09b700 1 --2- 172.21.15.1:0/3781475292 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19940ab1a0 0x7f19940b0bc0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f198800ea50 tx=0x7f1988009060).stop 2023-11-15T01:34:02.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.022+0000 7f199c09b700 1 -- 172.21.15.1:0/3781475292 shutdown_connections 2023-11-15T01:34:02.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.022+0000 7f199c09b700 1 --2- 172.21.15.1:0/3781475292 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f198005f270 0x7f1980061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:02.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.022+0000 7f199c09b700 1 --2- 172.21.15.1:0/3781475292 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1994154150 0x7f1994152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:02.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.022+0000 7f199c09b700 1 --2- 172.21.15.1:0/3781475292 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19940aa060 0x7f19940c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:02.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.022+0000 7f199c09b700 1 --2- 172.21.15.1:0/3781475292 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19940ab1a0 0x7f19940b0bc0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:02.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.022+0000 7f199c09b700 1 -- 172.21.15.1:0/3781475292 >> 172.21.15.1:0/3781475292 conn(0x7f1994064aa0 msgr2=0x7f199414db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:02.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.022+0000 7f199c09b700 1 -- 172.21.15.1:0/3781475292 shutdown_connections 2023-11-15T01:34:02.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.022+0000 7f199c09b700 1 -- 172.21.15.1:0/3781475292 wait complete. 2023-11-15T01:34:02.036 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-15T01:34:02.036 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:34:02.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.153+0000 7f666525a700 1 Processor -- start 2023-11-15T01:34:02.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.153+0000 7f666525a700 1 -- start start 2023-11-15T01:34:02.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.154+0000 7f666525a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6660150840 0x7f6660150c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:02.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.154+0000 7f666525a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f66600bd420 0x7f66600c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:02.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.154+0000 7f666525a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66600c28d0 con 0x7f6660069f40 2023-11-15T01:34:02.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.154+0000 7f666525a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6660069ab0 con 0x7f66600bd420 2023-11-15T01:34:02.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.154+0000 7f666525a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6660068ea0 con 0x7f6660150840 2023-11-15T01:34:02.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.154+0000 7f665f59e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f66600bd420 0x7f66600c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:02.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.154+0000 7f665e59c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6660069f40 0x7f66600bcd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58842/0 (socket says 172.21.15.1:58842) 2023-11-15T01:34:02.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.154+0000 7f665e59c700 1 -- 172.21.15.1:0/1978458130 learned_addr learned my addr 172.21.15.1:0/1978458130 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:34:02.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.154+0000 7f665ed9d700 1 --2- 172.21.15.1:0/1978458130 >> v2:172.21.15.141:3300/0 conn(0x7f6660150840 0x7f6660150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:02.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.154+0000 7f665f59e700 1 -- 172.21.15.1:0/1978458130 >> v2:172.21.15.141:3300/0 conn(0x7f6660150840 msgr2=0x7f6660150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:02.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.154+0000 7f665f59e700 1 --2- 172.21.15.1:0/1978458130 >> v2:172.21.15.141:3300/0 conn(0x7f6660150840 0x7f6660150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:02.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.154+0000 7f665f59e700 1 -- 172.21.15.1:0/1978458130 >> v1:172.21.15.1:6789/0 conn(0x7f6660069f40 legacy=0x7f66600bcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:02.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.154+0000 7f665dd9b700 1 -- 172.21.15.1:0/1978458130 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801383437 0 0) 0x7f66600c28d0 con 0x7f6660069f40 2023-11-15T01:34:02.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.154+0000 7f665f59e700 1 -- 172.21.15.1:0/1978458130 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6660069180 con 0x7f66600bd420 2023-11-15T01:34:02.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.155+0000 7f665f59e700 1 --2- 172.21.15.1:0/1978458130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600bd420 0x7f66600c1a40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f66600662c0 tx=0x7f6650009780).ready entity=mon.0 client_cookie=1299d19716b72f61 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:02.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.155+0000 7f665dd9b700 1 -- 172.21.15.1:0/1978458130 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665000e070 con 0x7f66600bd420 2023-11-15T01:34:02.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.155+0000 7f665dd9b700 1 -- 172.21.15.1:0/1978458130 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665000bc30 con 0x7f66600bd420 2023-11-15T01:34:02.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.155+0000 7f665dd9b700 1 -- 172.21.15.1:0/1978458130 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6650012410 con 0x7f66600bd420 2023-11-15T01:34:02.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.155+0000 7f666525a700 1 -- 172.21.15.1:0/1978458130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600bd420 msgr2=0x7f66600c1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:02.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.155+0000 7f666525a700 1 --2- 172.21.15.1:0/1978458130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600bd420 0x7f66600c1a40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f66600662c0 tx=0x7f6650009780).stop 2023-11-15T01:34:02.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.155+0000 7f666525a700 1 -- 172.21.15.1:0/1978458130 shutdown_connections 2023-11-15T01:34:02.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.155+0000 7f666525a700 1 --2- 172.21.15.1:0/1978458130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600bd420 0x7f66600c1a40 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:02.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.155+0000 7f666525a700 1 --2- 172.21.15.1:0/1978458130 >> v2:172.21.15.141:3300/0 conn(0x7f6660150840 0x7f6660150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:02.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.155+0000 7f666525a700 1 -- 172.21.15.1:0/1978458130 >> 172.21.15.1:0/1978458130 conn(0x7f66600627b0 msgr2=0x7f6660062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:02.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.155+0000 7f666525a700 1 -- 172.21.15.1:0/1978458130 shutdown_connections 2023-11-15T01:34:02.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.155+0000 7f666525a700 1 -- 172.21.15.1:0/1978458130 wait complete. 2023-11-15T01:34:02.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.156+0000 7f666525a700 1 Processor -- start 2023-11-15T01:34:02.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.156+0000 7f666525a700 1 -- start start 2023-11-15T01:34:02.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.157+0000 7f666525a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6660069f40 0x7f6660152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:02.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.157+0000 7f666525a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600bd420 0x7f66601644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:02.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.157+0000 7f666525a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6660150840 0x7f66601430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:02.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.157+0000 7f666525a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6660164f30 con 0x7f66600bd420 2023-11-15T01:34:02.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.157+0000 7f666525a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6660165210 con 0x7f6660150840 2023-11-15T01:34:02.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.157+0000 7f666525a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6660152280 con 0x7f6660069f40 2023-11-15T01:34:02.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.157+0000 7f665e59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600bd420 0x7f66601644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:02.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.157+0000 7f665e59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600bd420 0x7f66601644e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50242/0 (socket says 172.21.15.1:50242) 2023-11-15T01:34:02.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.157+0000 7f665e59c700 1 -- 172.21.15.1:0/980056552 learned_addr learned my addr 172.21.15.1:0/980056552 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:02.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.157+0000 7f665ed9d700 1 --2- 172.21.15.1:0/980056552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6660069f40 0x7f6660152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:02.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.158+0000 7f665f59e700 1 --2- 172.21.15.1:0/980056552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6660150840 0x7f66601430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:02.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.158+0000 7f665e59c700 1 -- 172.21.15.1:0/980056552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6660069f40 msgr2=0x7f6660152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:02.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.158+0000 7f665e59c700 1 --2- 172.21.15.1:0/980056552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6660069f40 0x7f6660152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:02.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.158+0000 7f665e59c700 1 -- 172.21.15.1:0/980056552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6660150840 msgr2=0x7f66601430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:02.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.158+0000 7f665e59c700 1 --2- 172.21.15.1:0/980056552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6660150840 0x7f66601430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:02.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.158+0000 7f665e59c700 1 -- 172.21.15.1:0/980056552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6650009a20 con 0x7f66600bd420 2023-11-15T01:34:02.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.158+0000 7f665f59e700 1 --2- 172.21.15.1:0/980056552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6660150840 0x7f66601430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:34:02.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.158+0000 7f665e59c700 1 --2- 172.21.15.1:0/980056552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600bd420 0x7f66601644e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f664800c4e0 tx=0x7f6648007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:02.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.158+0000 7f6656ffd700 1 -- 172.21.15.1:0/980056552 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66480072e0 con 0x7f66600bd420 2023-11-15T01:34:02.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.158+0000 7f6656ffd700 1 -- 172.21.15.1:0/980056552 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6648007440 con 0x7f66600bd420 2023-11-15T01:34:02.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.158+0000 7f666525a700 1 -- 172.21.15.1:0/980056552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6660152560 con 0x7f66600bd420 2023-11-15T01:34:02.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.158+0000 7f6656ffd700 1 -- 172.21.15.1:0/980056552 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66480057a0 con 0x7f66600bd420 2023-11-15T01:34:02.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.158+0000 7f666525a700 1 -- 172.21.15.1:0/980056552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6660153e00 con 0x7f66600bd420 2023-11-15T01:34:02.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.159+0000 7f666525a700 1 -- 172.21.15.1:0/980056552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6660152780 con 0x7f66600bd420 2023-11-15T01:34:02.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.159+0000 7f6656ffd700 1 -- 172.21.15.1:0/980056552 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6648005bd0 con 0x7f66600bd420 2023-11-15T01:34:02.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.160+0000 7f6656ffd700 1 --2- 172.21.15.1:0/980056552 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f664005f2a0 0x7f6640061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:02.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.160+0000 7f6656ffd700 1 -- 172.21.15.1:0/980056552 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f6648079e60 con 0x7f66600bd420 2023-11-15T01:34:02.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.160+0000 7f665ed9d700 1 --2- 172.21.15.1:0/980056552 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f664005f2a0 0x7f6640061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:02.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.160+0000 7f665ed9d700 1 --2- 172.21.15.1:0/980056552 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f664005f2a0 0x7f6640061760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f66601491b0 tx=0x7f6658008040).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:02.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.164+0000 7f6656ffd700 1 -- 172.21.15.1:0/980056552 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f664804ae20 con 0x7f66600bd420 2023-11-15T01:34:02.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.334+0000 7f666525a700 1 -- 172.21.15.1:0/980056552 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6660152100 con 0x7f664005f2a0 2023-11-15T01:34:02.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.344+0000 7f6656ffd700 1 -- 172.21.15.1:0/980056552 <== mgr.5248 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361237 (secure 0 0 0) 0x7f6658005c90 con 0x7f664005f2a0 2023-11-15T01:34:02.350 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:34:02.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.348+0000 7f666525a700 1 -- 172.21.15.1:0/980056552 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f664005f2a0 msgr2=0x7f6640061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:02.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.348+0000 7f666525a700 1 --2- 172.21.15.1:0/980056552 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f664005f2a0 0x7f6640061760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f66601491b0 tx=0x7f6658008040).stop 2023-11-15T01:34:02.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.348+0000 7f666525a700 1 -- 172.21.15.1:0/980056552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600bd420 msgr2=0x7f66601644e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:02.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.348+0000 7f666525a700 1 --2- 172.21.15.1:0/980056552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600bd420 0x7f66601644e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f664800c4e0 tx=0x7f6648007c70).stop 2023-11-15T01:34:02.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.348+0000 7f666525a700 1 -- 172.21.15.1:0/980056552 shutdown_connections 2023-11-15T01:34:02.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.348+0000 7f666525a700 1 --2- 172.21.15.1:0/980056552 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f664005f2a0 0x7f6640061760 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:02.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.348+0000 7f666525a700 1 --2- 172.21.15.1:0/980056552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6660150840 0x7f66601430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:02.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.348+0000 7f666525a700 1 --2- 172.21.15.1:0/980056552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6660069f40 0x7f6660152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:02.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.348+0000 7f666525a700 1 --2- 172.21.15.1:0/980056552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66600bd420 0x7f66601644e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:02.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.348+0000 7f666525a700 1 -- 172.21.15.1:0/980056552 >> 172.21.15.1:0/980056552 conn(0x7f66600627b0 msgr2=0x7f6660154620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:02.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.348+0000 7f666525a700 1 -- 172.21.15.1:0/980056552 shutdown_connections 2023-11-15T01:34:02.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:02.348+0000 7f666525a700 1 -- 172.21.15.1:0/980056552 wait complete. 2023-11-15T01:34:02.356 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:34:02.361 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T01:34:01.415476+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419360,"kb_used_data":5728,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752555360,"statfs":{"total":773094113280,"available":770616688640,"internally_reserved":0,"allocated":5865472,"data_stored":2825316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14985745,"num_objects":-14,"num_object_clones":0,"num_object_copies":-28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-695,"num_write_kb":-15534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.004236"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870192+0000","last_change":"2023-11-15T01:33:56.864024+0000","last_active":"2023-11-15T01:33:56.870192+0000","last_peered":"2023-11-15T01:33:56.870192+0000","last_clean":"2023-11-15T01:33:56.870192+0000","last_became_active":"2023-11-15T01:33:56.863711+0000","last_became_peered":"2023-11-15T01:33:56.863711+0000","last_unstale":"2023-11-15T01:33:56.870192+0000","last_undegraded":"2023-11-15T01:33:56.870192+0000","last_fullsized":"2023-11-15T01:33:56.870192+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"60'3","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874959+0000","last_change":"2023-11-15T01:33:56.471513+0000","last_active":"2023-11-15T01:33:56.874959+0000","last_peered":"2023-11-15T01:33:56.874959+0000","last_clean":"2023-11-15T01:33:56.874959+0000","last_became_active":"2023-11-15T01:33:56.471228+0000","last_became_peered":"2023-11-15T01:33:56.471228+0000","last_unstale":"2023-11-15T01:33:56.874959+0000","last_undegraded":"2023-11-15T01:33:56.874959+0000","last_fullsized":"2023-11-15T01:33:56.874959+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879382+0000","last_change":"2023-11-15T01:33:56.874430+0000","last_active":"2023-11-15T01:33:56.879382+0000","last_peered":"2023-11-15T01:33:56.879382+0000","last_clean":"2023-11-15T01:33:56.879382+0000","last_became_active":"2023-11-15T01:33:56.874133+0000","last_became_peered":"2023-11-15T01:33:56.874133+0000","last_unstale":"2023-11-15T01:33:56.879382+0000","last_undegraded":"2023-11-15T01:33:56.879382+0000","last_fullsized":"2023-11-15T01:33:56.879382+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.857602+0000","last_change":"2023-11-15T01:33:56.472997+0000","last_active":"2023-11-15T01:33:56.857602+0000","last_peered":"2023-11-15T01:33:56.857602+0000","last_clean":"2023-11-15T01:33:56.857602+0000","last_became_active":"2023-11-15T01:33:56.472655+0000","last_became_peered":"2023-11-15T01:33:56.472655+0000","last_unstale":"2023-11-15T01:33:56.857602+0000","last_undegraded":"2023-11-15T01:33:56.857602+0000","last_fullsized":"2023-11-15T01:33:56.857602+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874788+0000","last_change":"2023-11-15T01:33:56.871248+0000","last_active":"2023-11-15T01:33:56.874788+0000","last_peered":"2023-11-15T01:33:56.874788+0000","last_clean":"2023-11-15T01:33:56.874788+0000","last_became_active":"2023-11-15T01:33:56.870962+0000","last_became_peered":"2023-11-15T01:33:56.870962+0000","last_unstale":"2023-11-15T01:33:56.874788+0000","last_undegraded":"2023-11-15T01:33:56.874788+0000","last_fullsized":"2023-11-15T01:33:56.874788+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860652+0000","last_change":"2023-11-15T01:33:56.458291+0000","last_active":"2023-11-15T01:33:56.860652+0000","last_peered":"2023-11-15T01:33:56.860652+0000","last_clean":"2023-11-15T01:33:56.860652+0000","last_became_active":"2023-11-15T01:33:56.457983+0000","last_became_peered":"2023-11-15T01:33:56.457983+0000","last_unstale":"2023-11-15T01:33:56.860652+0000","last_undegraded":"2023-11-15T01:33:56.860652+0000","last_fullsized":"2023-11-15T01:33:56.860652+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876723+0000","last_change":"2023-11-15T01:33:56.870812+0000","last_active":"2023-11-15T01:33:56.876723+0000","last_peered":"2023-11-15T01:33:56.876723+0000","last_clean":"2023-11-15T01:33:56.876723+0000","last_became_active":"2023-11-15T01:33:56.870496+0000","last_became_peered":"2023-11-15T01:33:56.870496+0000","last_unstale":"2023-11-15T01:33:56.876723+0000","last_undegraded":"2023-11-15T01:33:56.876723+0000","last_fullsized":"2023-11-15T01:33:56.876723+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873367+0000","last_change":"2023-11-15T01:33:56.463682+0000","last_active":"2023-11-15T01:33:56.873367+0000","last_peered":"2023-11-15T01:33:56.873367+0000","last_clean":"2023-11-15T01:33:56.873367+0000","last_became_active":"2023-11-15T01:33:56.462962+0000","last_became_peered":"2023-11-15T01:33:56.462962+0000","last_unstale":"2023-11-15T01:33:56.873367+0000","last_undegraded":"2023-11-15T01:33:56.873367+0000","last_fullsized":"2023-11-15T01:33:56.873367+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.871536+0000","last_change":"2023-11-15T01:33:56.860607+0000","last_active":"2023-11-15T01:33:56.871536+0000","last_peered":"2023-11-15T01:33:56.871536+0000","last_clean":"2023-11-15T01:33:56.871536+0000","last_became_active":"2023-11-15T01:33:56.860324+0000","last_became_peered":"2023-11-15T01:33:56.860324+0000","last_unstale":"2023-11-15T01:33:56.871536+0000","last_undegraded":"2023-11-15T01:33:56.871536+0000","last_fullsized":"2023-11-15T01:33:56.871536+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869320+0000","last_change":"2023-11-15T01:33:56.473582+0000","last_active":"2023-11-15T01:33:56.869320+0000","last_peered":"2023-11-15T01:33:56.869320+0000","last_clean":"2023-11-15T01:33:56.869320+0000","last_became_active":"2023-11-15T01:33:56.473318+0000","last_became_peered":"2023-11-15T01:33:56.473318+0000","last_unstale":"2023-11-15T01:33:56.869320+0000","last_undegraded":"2023-11-15T01:33:56.869320+0000","last_fullsized":"2023-11-15T01:33:56.869320+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.871676+0000","last_change":"2023-11-15T01:33:56.867922+0000","last_active":"2023-11-15T01:33:56.871676+0000","last_peered":"2023-11-15T01:33:56.871676+0000","last_clean":"2023-11-15T01:33:56.871676+0000","last_became_active":"2023-11-15T01:33:56.867634+0000","last_became_peered":"2023-11-15T01:33:56.867634+0000","last_unstale":"2023-11-15T01:33:56.871676+0000","last_undegraded":"2023-11-15T01:33:56.871676+0000","last_fullsized":"2023-11-15T01:33:56.871676+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875287+0000","last_change":"2023-11-15T01:33:56.474361+0000","last_active":"2023-11-15T01:33:56.875287+0000","last_peered":"2023-11-15T01:33:56.875287+0000","last_clean":"2023-11-15T01:33:56.875287+0000","last_became_active":"2023-11-15T01:33:56.473650+0000","last_became_peered":"2023-11-15T01:33:56.473650+0000","last_unstale":"2023-11-15T01:33:56.875287+0000","last_undegraded":"2023-11-15T01:33:56.875287+0000","last_fullsized":"2023-11-15T01:33:56.875287+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.872019+0000","last_change":"2023-11-15T01:33:56.865614+0000","last_active":"2023-11-15T01:33:56.872019+0000","last_peered":"2023-11-15T01:33:56.872019+0000","last_clean":"2023-11-15T01:33:56.872019+0000","last_became_active":"2023-11-15T01:33:56.863615+0000","last_became_peered":"2023-11-15T01:33:56.863615+0000","last_unstale":"2023-11-15T01:33:56.872019+0000","last_undegraded":"2023-11-15T01:33:56.872019+0000","last_fullsized":"2023-11-15T01:33:56.872019+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.864948+0000","last_change":"2023-11-15T01:33:56.476363+0000","last_active":"2023-11-15T01:33:56.864948+0000","last_peered":"2023-11-15T01:33:56.864948+0000","last_clean":"2023-11-15T01:33:56.864948+0000","last_became_active":"2023-11-15T01:33:56.476127+0000","last_became_peered":"2023-11-15T01:33:56.476127+0000","last_unstale":"2023-11-15T01:33:56.864948+0000","last_undegraded":"2023-11-15T01:33:56.864948+0000","last_fullsized":"2023-11-15T01:33:56.864948+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876605+0000","last_change":"2023-11-15T01:33:56.873376+0000","last_active":"2023-11-15T01:33:56.876605+0000","last_peered":"2023-11-15T01:33:56.876605+0000","last_clean":"2023-11-15T01:33:56.876605+0000","last_became_active":"2023-11-15T01:33:56.869197+0000","last_became_peered":"2023-11-15T01:33:56.869197+0000","last_unstale":"2023-11-15T01:33:56.876605+0000","last_undegraded":"2023-11-15T01:33:56.876605+0000","last_fullsized":"2023-11-15T01:33:56.876605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859475+0000","last_change":"2023-11-15T01:33:56.464147+0000","last_active":"2023-11-15T01:33:56.859475+0000","last_peered":"2023-11-15T01:33:56.859475+0000","last_clean":"2023-11-15T01:33:56.859475+0000","last_became_active":"2023-11-15T01:33:56.463540+0000","last_became_peered":"2023-11-15T01:33:56.463540+0000","last_unstale":"2023-11-15T01:33:56.859475+0000","last_undegraded":"2023-11-15T01:33:56.859475+0000","last_fullsized":"2023-11-15T01:33:56.859475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876546+0000","last_change":"2023-11-15T01:33:56.873610+0000","last_active":"2023-11-15T01:33:56.876546+0000","last_peered":"2023-11-15T01:33:56.876546+0000","last_clean":"2023-11-15T01:33:56.876546+0000","last_became_active":"2023-11-15T01:33:56.869058+0000","last_became_peered":"2023-11-15T01:33:56.869058+0000","last_unstale":"2023-11-15T01:33:56.876546+0000","last_undegraded":"2023-11-15T01:33:56.876546+0000","last_fullsized":"2023-11-15T01:33:56.876546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.862508+0000","last_change":"2023-11-15T01:33:56.478563+0000","last_active":"2023-11-15T01:33:56.862508+0000","last_peered":"2023-11-15T01:33:56.862508+0000","last_clean":"2023-11-15T01:33:56.862508+0000","last_became_active":"2023-11-15T01:33:56.478308+0000","last_became_peered":"2023-11-15T01:33:56.478308+0000","last_unstale":"2023-11-15T01:33:56.862508+0000","last_undegraded":"2023-11-15T01:33:56.862508+0000","last_fullsized":"2023-11-15T01:33:56.862508+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874632+0000","last_change":"2023-11-15T01:33:56.868848+0000","last_active":"2023-11-15T01:33:56.874632+0000","last_peered":"2023-11-15T01:33:56.874632+0000","last_clean":"2023-11-15T01:33:56.874632+0000","last_became_active":"2023-11-15T01:33:56.868579+0000","last_became_peered":"2023-11-15T01:33:56.868579+0000","last_unstale":"2023-11-15T01:33:56.874632+0000","last_undegraded":"2023-11-15T01:33:56.874632+0000","last_fullsized":"2023-11-15T01:33:56.874632+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860542+0000","last_change":"2023-11-15T01:33:56.464310+0000","last_active":"2023-11-15T01:33:56.860542+0000","last_peered":"2023-11-15T01:33:56.860542+0000","last_clean":"2023-11-15T01:33:56.860542+0000","last_became_active":"2023-11-15T01:33:56.462305+0000","last_became_peered":"2023-11-15T01:33:56.462305+0000","last_unstale":"2023-11-15T01:33:56.860542+0000","last_undegraded":"2023-11-15T01:33:56.860542+0000","last_fullsized":"2023-11-15T01:33:56.860542+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.878535+0000","last_change":"2023-11-15T01:33:56.877038+0000","last_active":"2023-11-15T01:33:56.878535+0000","last_peered":"2023-11-15T01:33:56.878535+0000","last_clean":"2023-11-15T01:33:56.878535+0000","last_became_active":"2023-11-15T01:33:56.876699+0000","last_became_peered":"2023-11-15T01:33:56.876699+0000","last_unstale":"2023-11-15T01:33:56.878535+0000","last_undegraded":"2023-11-15T01:33:56.878535+0000","last_fullsized":"2023-11-15T01:33:56.878535+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861447+0000","last_change":"2023-11-15T01:33:56.478453+0000","last_active":"2023-11-15T01:33:56.861447+0000","last_peered":"2023-11-15T01:33:56.861447+0000","last_clean":"2023-11-15T01:33:56.861447+0000","last_became_active":"2023-11-15T01:33:56.478179+0000","last_became_peered":"2023-11-15T01:33:56.478179+0000","last_unstale":"2023-11-15T01:33:56.861447+0000","last_undegraded":"2023-11-15T01:33:56.861447+0000","last_fullsized":"2023-11-15T01:33:56.861447+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869347+0000","last_change":"2023-11-15T01:33:56.866129+0000","last_active":"2023-11-15T01:33:56.869347+0000","last_peered":"2023-11-15T01:33:56.869347+0000","last_clean":"2023-11-15T01:33:56.869347+0000","last_became_active":"2023-11-15T01:33:56.865835+0000","last_became_peered":"2023-11-15T01:33:56.865835+0000","last_unstale":"2023-11-15T01:33:56.869347+0000","last_undegraded":"2023-11-15T01:33:56.869347+0000","last_fullsized":"2023-11-15T01:33:56.869347+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877778+0000","last_change":"2023-11-15T01:33:56.468313+0000","last_active":"2023-11-15T01:33:56.877778+0000","last_peered":"2023-11-15T01:33:56.877778+0000","last_clean":"2023-11-15T01:33:56.877778+0000","last_became_active":"2023-11-15T01:33:56.467994+0000","last_became_peered":"2023-11-15T01:33:56.467994+0000","last_unstale":"2023-11-15T01:33:56.877778+0000","last_undegraded":"2023-11-15T01:33:56.877778+0000","last_fullsized":"2023-11-15T01:33:56.877778+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.881930+0000","last_change":"2023-11-15T01:33:56.878365+0000","last_active":"2023-11-15T01:33:56.881930+0000","last_peered":"2023-11-15T01:33:56.881930+0000","last_clean":"2023-11-15T01:33:56.881930+0000","last_became_active":"2023-11-15T01:33:56.878049+0000","last_became_peered":"2023-11-15T01:33:56.878049+0000","last_unstale":"2023-11-15T01:33:56.881930+0000","last_undegraded":"2023-11-15T01:33:56.881930+0000","last_fullsized":"2023-11-15T01:33:56.881930+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875001+0000","last_change":"2023-11-15T01:33:56.482375+0000","last_active":"2023-11-15T01:33:56.875001+0000","last_peered":"2023-11-15T01:33:56.875001+0000","last_clean":"2023-11-15T01:33:56.875001+0000","last_became_active":"2023-11-15T01:33:56.481858+0000","last_became_peered":"2023-11-15T01:33:56.481858+0000","last_unstale":"2023-11-15T01:33:56.875001+0000","last_undegraded":"2023-11-15T01:33:56.875001+0000","last_fullsized":"2023-11-15T01:33:56.875001+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874619+0000","last_change":"2023-11-15T01:33:56.871814+0000","last_active":"2023-11-15T01:33:56.874619+0000","last_peered":"2023-11-15T01:33:56.874619+0000","last_clean":"2023-11-15T01:33:56.874619+0000","last_became_active":"2023-11-15T01:33:56.871595+0000","last_became_peered":"2023-11-15T01:33:56.871595+0000","last_unstale":"2023-11-15T01:33:56.874619+0000","last_undegraded":"2023-11-15T01:33:56.874619+0000","last_fullsized":"2023-11-15T01:33:56.874619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861088+0000","last_change":"2023-11-15T01:33:56.481949+0000","last_active":"2023-11-15T01:33:56.861088+0000","last_peered":"2023-11-15T01:33:56.861088+0000","last_clean":"2023-11-15T01:33:56.861088+0000","last_became_active":"2023-11-15T01:33:56.481665+0000","last_became_peered":"2023-11-15T01:33:56.481665+0000","last_unstale":"2023-11-15T01:33:56.861088+0000","last_undegraded":"2023-11-15T01:33:56.861088+0000","last_fullsized":"2023-11-15T01:33:56.861088+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879524+0000","last_change":"2023-11-15T01:33:56.875960+0000","last_active":"2023-11-15T01:33:56.879524+0000","last_peered":"2023-11-15T01:33:56.879524+0000","last_clean":"2023-11-15T01:33:56.879524+0000","last_became_active":"2023-11-15T01:33:56.875475+0000","last_became_peered":"2023-11-15T01:33:56.875475+0000","last_unstale":"2023-11-15T01:33:56.879524+0000","last_undegraded":"2023-11-15T01:33:56.879524+0000","last_fullsized":"2023-11-15T01:33:56.879524+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851271+0000","last_change":"2023-11-15T01:33:56.470153+0000","last_active":"2023-11-15T01:33:56.851271+0000","last_peered":"2023-11-15T01:33:56.851271+0000","last_clean":"2023-11-15T01:33:56.851271+0000","last_became_active":"2023-11-15T01:33:56.469808+0000","last_became_peered":"2023-11-15T01:33:56.469808+0000","last_unstale":"2023-11-15T01:33:56.851271+0000","last_undegraded":"2023-11-15T01:33:56.851271+0000","last_fullsized":"2023-11-15T01:33:56.851271+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873830+0000","last_change":"2023-11-15T01:33:56.870218+0000","last_active":"2023-11-15T01:33:56.873830+0000","last_peered":"2023-11-15T01:33:56.873830+0000","last_clean":"2023-11-15T01:33:56.873830+0000","last_became_active":"2023-11-15T01:33:56.869901+0000","last_became_peered":"2023-11-15T01:33:56.869901+0000","last_unstale":"2023-11-15T01:33:56.873830+0000","last_undegraded":"2023-11-15T01:33:56.873830+0000","last_fullsized":"2023-11-15T01:33:56.873830+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879211+0000","last_change":"2023-11-15T01:33:56.478588+0000","last_active":"2023-11-15T01:33:56.879211+0000","last_peered":"2023-11-15T01:33:56.879211+0000","last_clean":"2023-11-15T01:33:56.879211+0000","last_became_active":"2023-11-15T01:33:56.478375+0000","last_became_peered":"2023-11-15T01:33:56.478375+0000","last_unstale":"2023-11-15T01:33:56.879211+0000","last_undegraded":"2023-11-15T01:33:56.879211+0000","last_fullsized":"2023-11-15T01:33:56.879211+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876152+0000","last_change":"2023-11-15T01:33:56.874699+0000","last_active":"2023-11-15T01:33:56.876152+0000","last_peered":"2023-11-15T01:33:56.876152+0000","last_clean":"2023-11-15T01:33:56.876152+0000","last_became_active":"2023-11-15T01:33:56.874306+0000","last_became_peered":"2023-11-15T01:33:56.874306+0000","last_unstale":"2023-11-15T01:33:56.876152+0000","last_undegraded":"2023-11-15T01:33:56.876152+0000","last_fullsized":"2023-11-15T01:33:56.876152+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860716+0000","last_change":"2023-11-15T01:33:56.459940+0000","last_active":"2023-11-15T01:33:56.860716+0000","last_peered":"2023-11-15T01:33:56.860716+0000","last_clean":"2023-11-15T01:33:56.860716+0000","last_became_active":"2023-11-15T01:33:56.459677+0000","last_became_peered":"2023-11-15T01:33:56.459677+0000","last_unstale":"2023-11-15T01:33:56.860716+0000","last_undegraded":"2023-11-15T01:33:56.860716+0000","last_fullsized":"2023-11-15T01:33:56.860716+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868562+0000","last_change":"2023-11-15T01:33:56.864069+0000","last_active":"2023-11-15T01:33:56.868562+0000","last_peered":"2023-11-15T01:33:56.868562+0000","last_clean":"2023-11-15T01:33:56.868562+0000","last_became_active":"2023-11-15T01:33:56.863785+0000","last_became_peered":"2023-11-15T01:33:56.863785+0000","last_unstale":"2023-11-15T01:33:56.868562+0000","last_undegraded":"2023-11-15T01:33:56.868562+0000","last_fullsized":"2023-11-15T01:33:56.868562+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860584+0000","last_change":"2023-11-15T01:33:56.470046+0000","last_active":"2023-11-15T01:33:56.860584+0000","last_peered":"2023-11-15T01:33:56.860584+0000","last_clean":"2023-11-15T01:33:56.860584+0000","last_became_active":"2023-11-15T01:33:56.469771+0000","last_became_peered":"2023-11-15T01:33:56.469771+0000","last_unstale":"2023-11-15T01:33:56.860584+0000","last_undegraded":"2023-11-15T01:33:56.860584+0000","last_fullsized":"2023-11-15T01:33:56.860584+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879425+0000","last_change":"2023-11-15T01:33:56.874927+0000","last_active":"2023-11-15T01:33:56.879425+0000","last_peered":"2023-11-15T01:33:56.879425+0000","last_clean":"2023-11-15T01:33:56.879425+0000","last_became_active":"2023-11-15T01:33:56.874683+0000","last_became_peered":"2023-11-15T01:33:56.874683+0000","last_unstale":"2023-11-15T01:33:56.879425+0000","last_undegraded":"2023-11-15T01:33:56.879425+0000","last_fullsized":"2023-11-15T01:33:56.879425+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.878673+0000","last_change":"2023-11-15T01:33:56.470434+0000","last_active":"2023-11-15T01:33:56.878673+0000","last_peered":"2023-11-15T01:33:56.878673+0000","last_clean":"2023-11-15T01:33:56.878673+0000","last_became_active":"2023-11-15T01:33:56.470134+0000","last_became_peered":"2023-11-15T01:33:56.470134+0000","last_unstale":"2023-11-15T01:33:56.878673+0000","last_undegraded":"2023-11-15T01:33:56.878673+0000","last_fullsized":"2023-11-15T01:33:56.878673+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874463+0000","last_change":"2023-11-15T01:33:56.867683+0000","last_active":"2023-11-15T01:33:56.874463+0000","last_peered":"2023-11-15T01:33:56.874463+0000","last_clean":"2023-11-15T01:33:56.874463+0000","last_became_active":"2023-11-15T01:33:56.867411+0000","last_became_peered":"2023-11-15T01:33:56.867411+0000","last_unstale":"2023-11-15T01:33:56.874463+0000","last_undegraded":"2023-11-15T01:33:56.874463+0000","last_fullsized":"2023-11-15T01:33:56.874463+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861967+0000","last_change":"2023-11-15T01:33:56.471011+0000","last_active":"2023-11-15T01:33:56.861967+0000","last_peered":"2023-11-15T01:33:56.861967+0000","last_clean":"2023-11-15T01:33:56.861967+0000","last_became_active":"2023-11-15T01:33:56.470697+0000","last_became_peered":"2023-11-15T01:33:56.470697+0000","last_unstale":"2023-11-15T01:33:56.861967+0000","last_undegraded":"2023-11-15T01:33:56.861967+0000","last_fullsized":"2023-11-15T01:33:56.861967+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879469+0000","last_change":"2023-11-15T01:33:56.876575+0000","last_active":"2023-11-15T01:33:56.879469+0000","last_peered":"2023-11-15T01:33:56.879469+0000","last_clean":"2023-11-15T01:33:56.879469+0000","last_became_active":"2023-11-15T01:33:56.876274+0000","last_became_peered":"2023-11-15T01:33:56.876274+0000","last_unstale":"2023-11-15T01:33:56.879469+0000","last_undegraded":"2023-11-15T01:33:56.879469+0000","last_fullsized":"2023-11-15T01:33:56.879469+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873817+0000","last_change":"2023-11-15T01:33:56.475311+0000","last_active":"2023-11-15T01:33:56.873817+0000","last_peered":"2023-11-15T01:33:56.873817+0000","last_clean":"2023-11-15T01:33:56.873817+0000","last_became_active":"2023-11-15T01:33:56.475060+0000","last_became_peered":"2023-11-15T01:33:56.475060+0000","last_unstale":"2023-11-15T01:33:56.873817+0000","last_undegraded":"2023-11-15T01:33:56.873817+0000","last_fullsized":"2023-11-15T01:33:56.873817+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877902+0000","last_change":"2023-11-15T01:33:56.872904+0000","last_active":"2023-11-15T01:33:56.877902+0000","last_peered":"2023-11-15T01:33:56.877902+0000","last_clean":"2023-11-15T01:33:56.877902+0000","last_became_active":"2023-11-15T01:33:56.872620+0000","last_became_peered":"2023-11-15T01:33:56.872620+0000","last_unstale":"2023-11-15T01:33:56.877902+0000","last_undegraded":"2023-11-15T01:33:56.877902+0000","last_fullsized":"2023-11-15T01:33:56.877902+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860992+0000","last_change":"2023-11-15T01:33:56.464027+0000","last_active":"2023-11-15T01:33:56.860992+0000","last_peered":"2023-11-15T01:33:56.860992+0000","last_clean":"2023-11-15T01:33:56.860992+0000","last_became_active":"2023-11-15T01:33:56.463227+0000","last_became_peered":"2023-11-15T01:33:56.463227+0000","last_unstale":"2023-11-15T01:33:56.860992+0000","last_undegraded":"2023-11-15T01:33:56.860992+0000","last_fullsized":"2023-11-15T01:33:56.860992+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875574+0000","last_change":"2023-11-15T01:33:56.872932+0000","last_active":"2023-11-15T01:33:56.875574+0000","last_peered":"2023-11-15T01:33:56.875574+0000","last_clean":"2023-11-15T01:33:56.875574+0000","last_became_active":"2023-11-15T01:33:56.872658+0000","last_became_peered":"2023-11-15T01:33:56.872658+0000","last_unstale":"2023-11-15T01:33:56.875574+0000","last_undegraded":"2023-11-15T01:33:56.875574+0000","last_fullsized":"2023-11-15T01:33:56.875574+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858111+0000","last_change":"2023-11-15T01:33:56.469707+0000","last_active":"2023-11-15T01:33:56.858111+0000","last_peered":"2023-11-15T01:33:56.858111+0000","last_clean":"2023-11-15T01:33:56.858111+0000","last_became_active":"2023-11-15T01:33:56.469412+0000","last_became_peered":"2023-11-15T01:33:56.469412+0000","last_unstale":"2023-11-15T01:33:56.858111+0000","last_undegraded":"2023-11-15T01:33:56.858111+0000","last_fullsized":"2023-11-15T01:33:56.858111+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875262+0000","last_change":"2023-11-15T01:33:56.870228+0000","last_active":"2023-11-15T01:33:56.875262+0000","last_peered":"2023-11-15T01:33:56.875262+0000","last_clean":"2023-11-15T01:33:56.875262+0000","last_became_active":"2023-11-15T01:33:56.869836+0000","last_became_peered":"2023-11-15T01:33:56.869836+0000","last_unstale":"2023-11-15T01:33:56.875262+0000","last_undegraded":"2023-11-15T01:33:56.875262+0000","last_fullsized":"2023-11-15T01:33:56.875262+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.857311+0000","last_change":"2023-11-15T01:33:56.467712+0000","last_active":"2023-11-15T01:33:56.857311+0000","last_peered":"2023-11-15T01:33:56.857311+0000","last_clean":"2023-11-15T01:33:56.857311+0000","last_became_active":"2023-11-15T01:33:56.467431+0000","last_became_peered":"2023-11-15T01:33:56.467431+0000","last_unstale":"2023-11-15T01:33:56.857311+0000","last_undegraded":"2023-11-15T01:33:56.857311+0000","last_fullsized":"2023-11-15T01:33:56.857311+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868693+0000","last_change":"2023-11-15T01:33:56.862035+0000","last_active":"2023-11-15T01:33:56.868693+0000","last_peered":"2023-11-15T01:33:56.868693+0000","last_clean":"2023-11-15T01:33:56.868693+0000","last_became_active":"2023-11-15T01:33:56.861779+0000","last_became_peered":"2023-11-15T01:33:56.861779+0000","last_unstale":"2023-11-15T01:33:56.868693+0000","last_undegraded":"2023-11-15T01:33:56.868693+0000","last_fullsized":"2023-11-15T01:33:56.868693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.857571+0000","last_change":"2023-11-15T01:33:56.473044+0000","last_active":"2023-11-15T01:33:56.857571+0000","last_peered":"2023-11-15T01:33:56.857571+0000","last_clean":"2023-11-15T01:33:56.857571+0000","last_became_active":"2023-11-15T01:33:56.472757+0000","last_became_peered":"2023-11-15T01:33:56.472757+0000","last_unstale":"2023-11-15T01:33:56.857571+0000","last_undegraded":"2023-11-15T01:33:56.857571+0000","last_fullsized":"2023-11-15T01:33:56.857571+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.871737+0000","last_change":"2023-11-15T01:33:56.868549+0000","last_active":"2023-11-15T01:33:56.871737+0000","last_peered":"2023-11-15T01:33:56.871737+0000","last_clean":"2023-11-15T01:33:56.871737+0000","last_became_active":"2023-11-15T01:33:56.868252+0000","last_became_peered":"2023-11-15T01:33:56.868252+0000","last_unstale":"2023-11-15T01:33:56.871737+0000","last_undegraded":"2023-11-15T01:33:56.871737+0000","last_fullsized":"2023-11-15T01:33:56.871737+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.862190+0000","last_change":"2023-11-15T01:33:56.472202+0000","last_active":"2023-11-15T01:33:56.862190+0000","last_peered":"2023-11-15T01:33:56.862190+0000","last_clean":"2023-11-15T01:33:56.862190+0000","last_became_active":"2023-11-15T01:33:56.471917+0000","last_became_peered":"2023-11-15T01:33:56.471917+0000","last_unstale":"2023-11-15T01:33:56.862190+0000","last_undegraded":"2023-11-15T01:33:56.862190+0000","last_fullsized":"2023-11-15T01:33:56.862190+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.872641+0000","last_change":"2023-11-15T01:33:56.867048+0000","last_active":"2023-11-15T01:33:56.872641+0000","last_peered":"2023-11-15T01:33:56.872641+0000","last_clean":"2023-11-15T01:33:56.872641+0000","last_became_active":"2023-11-15T01:33:56.866783+0000","last_became_peered":"2023-11-15T01:33:56.866783+0000","last_unstale":"2023-11-15T01:33:56.872641+0000","last_undegraded":"2023-11-15T01:33:56.872641+0000","last_fullsized":"2023-11-15T01:33:56.872641+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860780+0000","last_change":"2023-11-15T01:33:56.460695+0000","last_active":"2023-11-15T01:33:56.860780+0000","last_peered":"2023-11-15T01:33:56.860780+0000","last_clean":"2023-11-15T01:33:56.860780+0000","last_became_active":"2023-11-15T01:33:56.460393+0000","last_became_peered":"2023-11-15T01:33:56.460393+0000","last_unstale":"2023-11-15T01:33:56.860780+0000","last_undegraded":"2023-11-15T01:33:56.860780+0000","last_fullsized":"2023-11-15T01:33:56.860780+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875207+0000","last_change":"2023-11-15T01:33:56.872777+0000","last_active":"2023-11-15T01:33:56.875207+0000","last_peered":"2023-11-15T01:33:56.875207+0000","last_clean":"2023-11-15T01:33:56.875207+0000","last_became_active":"2023-11-15T01:33:56.872491+0000","last_became_peered":"2023-11-15T01:33:56.872491+0000","last_unstale":"2023-11-15T01:33:56.875207+0000","last_undegraded":"2023-11-15T01:33:56.875207+0000","last_fullsized":"2023-11-15T01:33:56.875207+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.855006+0000","last_change":"2023-11-15T01:33:56.467246+0000","last_active":"2023-11-15T01:33:56.855006+0000","last_peered":"2023-11-15T01:33:56.855006+0000","last_clean":"2023-11-15T01:33:56.855006+0000","last_became_active":"2023-11-15T01:33:56.466985+0000","last_became_peered":"2023-11-15T01:33:56.466985+0000","last_unstale":"2023-11-15T01:33:56.855006+0000","last_undegraded":"2023-11-15T01:33:56.855006+0000","last_fullsized":"2023-11-15T01:33:56.855006+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870299+0000","last_change":"2023-11-15T01:33:56.867697+0000","last_active":"2023-11-15T01:33:56.870299+0000","last_peered":"2023-11-15T01:33:56.870299+0000","last_clean":"2023-11-15T01:33:56.870299+0000","last_became_active":"2023-11-15T01:33:56.867397+0000","last_became_peered":"2023-11-15T01:33:56.867397+0000","last_unstale":"2023-11-15T01:33:56.870299+0000","last_undegraded":"2023-11-15T01:33:56.870299+0000","last_fullsized":"2023-11-15T01:33:56.870299+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858510+0000","last_change":"2023-11-15T01:33:56.473011+0000","last_active":"2023-11-15T01:33:56.858510+0000","last_peered":"2023-11-15T01:33:56.858510+0000","last_clean":"2023-11-15T01:33:56.858510+0000","last_became_active":"2023-11-15T01:33:56.472685+0000","last_became_peered":"2023-11-15T01:33:56.472685+0000","last_unstale":"2023-11-15T01:33:56.858510+0000","last_undegraded":"2023-11-15T01:33:56.858510+0000","last_fullsized":"2023-11-15T01:33:56.858510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874059+0000","last_change":"2023-11-15T01:33:56.866406+0000","last_active":"2023-11-15T01:33:56.874059+0000","last_peered":"2023-11-15T01:33:56.874059+0000","last_clean":"2023-11-15T01:33:56.874059+0000","last_became_active":"2023-11-15T01:33:56.866163+0000","last_became_peered":"2023-11-15T01:33:56.866163+0000","last_unstale":"2023-11-15T01:33:56.874059+0000","last_undegraded":"2023-11-15T01:33:56.874059+0000","last_fullsized":"2023-11-15T01:33:56.874059+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858827+0000","last_change":"2023-11-15T01:33:56.467547+0000","last_active":"2023-11-15T01:33:56.858827+0000","last_peered":"2023-11-15T01:33:56.858827+0000","last_clean":"2023-11-15T01:33:56.858827+0000","last_became_active":"2023-11-15T01:33:56.467250+0000","last_became_peered":"2023-11-15T01:33:56.467250+0000","last_unstale":"2023-11-15T01:33:56.858827+0000","last_undegraded":"2023-11-15T01:33:56.858827+0000","last_fullsized":"2023-11-15T01:33:56.858827+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879575+0000","last_change":"2023-11-15T01:33:56.876040+0000","last_active":"2023-11-15T01:33:56.879575+0000","last_peered":"2023-11-15T01:33:56.879575+0000","last_clean":"2023-11-15T01:33:56.879575+0000","last_became_active":"2023-11-15T01:33:56.875743+0000","last_became_peered":"2023-11-15T01:33:56.875743+0000","last_unstale":"2023-11-15T01:33:56.879575+0000","last_undegraded":"2023-11-15T01:33:56.879575+0000","last_fullsized":"2023-11-15T01:33:56.879575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851225+0000","last_change":"2023-11-15T01:33:56.473005+0000","last_active":"2023-11-15T01:33:56.851225+0000","last_peered":"2023-11-15T01:33:56.851225+0000","last_clean":"2023-11-15T01:33:56.851225+0000","last_became_active":"2023-11-15T01:33:56.472763+0000","last_became_peered":"2023-11-15T01:33:56.472763+0000","last_unstale":"2023-11-15T01:33:56.851225+0000","last_undegraded":"2023-11-15T01:33:56.851225+0000","last_fullsized":"2023-11-15T01:33:56.851225+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875176+0000","last_change":"2023-11-15T01:33:56.866140+0000","last_active":"2023-11-15T01:33:56.875176+0000","last_peered":"2023-11-15T01:33:56.875176+0000","last_clean":"2023-11-15T01:33:56.875176+0000","last_became_active":"2023-11-15T01:33:56.865926+0000","last_became_peered":"2023-11-15T01:33:56.865926+0000","last_unstale":"2023-11-15T01:33:56.875176+0000","last_undegraded":"2023-11-15T01:33:56.875176+0000","last_fullsized":"2023-11-15T01:33:56.875176+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861741+0000","last_change":"2023-11-15T01:33:56.467225+0000","last_active":"2023-11-15T01:33:56.861741+0000","last_peered":"2023-11-15T01:33:56.861741+0000","last_clean":"2023-11-15T01:33:56.861741+0000","last_became_active":"2023-11-15T01:33:56.466935+0000","last_became_peered":"2023-11-15T01:33:56.466935+0000","last_unstale":"2023-11-15T01:33:56.861741+0000","last_undegraded":"2023-11-15T01:33:56.861741+0000","last_fullsized":"2023-11-15T01:33:56.861741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879397+0000","last_change":"2023-11-15T01:33:56.874511+0000","last_active":"2023-11-15T01:33:56.879397+0000","last_peered":"2023-11-15T01:33:56.879397+0000","last_clean":"2023-11-15T01:33:56.879397+0000","last_became_active":"2023-11-15T01:33:56.873938+0000","last_became_peered":"2023-11-15T01:33:56.873938+0000","last_unstale":"2023-11-15T01:33:56.879397+0000","last_undegraded":"2023-11-15T01:33:56.879397+0000","last_fullsized":"2023-11-15T01:33:56.879397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869557+0000","last_change":"2023-11-15T01:33:56.462340+0000","last_active":"2023-11-15T01:33:56.869557+0000","last_peered":"2023-11-15T01:33:56.869557+0000","last_clean":"2023-11-15T01:33:56.869557+0000","last_became_active":"2023-11-15T01:33:56.462052+0000","last_became_peered":"2023-11-15T01:33:56.462052+0000","last_unstale":"2023-11-15T01:33:56.869557+0000","last_undegraded":"2023-11-15T01:33:56.869557+0000","last_fullsized":"2023-11-15T01:33:56.869557+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874960+0000","last_change":"2023-11-15T01:33:56.872849+0000","last_active":"2023-11-15T01:33:56.874960+0000","last_peered":"2023-11-15T01:33:56.874960+0000","last_clean":"2023-11-15T01:33:56.874960+0000","last_became_active":"2023-11-15T01:33:56.872524+0000","last_became_peered":"2023-11-15T01:33:56.872524+0000","last_unstale":"2023-11-15T01:33:56.874960+0000","last_undegraded":"2023-11-15T01:33:56.874960+0000","last_fullsized":"2023-11-15T01:33:56.874960+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869995+0000","last_change":"2023-11-15T01:33:56.471803+0000","last_active":"2023-11-15T01:33:56.869995+0000","last_peered":"2023-11-15T01:33:56.869995+0000","last_clean":"2023-11-15T01:33:56.869995+0000","last_became_active":"2023-11-15T01:33:56.471477+0000","last_became_peered":"2023-11-15T01:33:56.471477+0000","last_unstale":"2023-11-15T01:33:56.869995+0000","last_undegraded":"2023-11-15T01:33:56.869995+0000","last_fullsized":"2023-11-15T01:33:56.869995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870302+0000","last_change":"2023-11-15T01:33:56.867150+0000","last_active":"2023-11-15T01:33:56.870302+0000","last_peered":"2023-11-15T01:33:56.870302+0000","last_clean":"2023-11-15T01:33:56.870302+0000","last_became_active":"2023-11-15T01:33:56.866156+0000","last_became_peered":"2023-11-15T01:33:56.866156+0000","last_unstale":"2023-11-15T01:33:56.870302+0000","last_undegraded":"2023-11-15T01:33:56.870302+0000","last_fullsized":"2023-11-15T01:33:56.870302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873231+0000","last_change":"2023-11-15T01:33:56.479832+0000","last_active":"2023-11-15T01:33:56.873231+0000","last_peered":"2023-11-15T01:33:56.873231+0000","last_clean":"2023-11-15T01:33:56.873231+0000","last_became_active":"2023-11-15T01:33:56.479383+0000","last_became_peered":"2023-11-15T01:33:56.479383+0000","last_unstale":"2023-11-15T01:33:56.873231+0000","last_undegraded":"2023-11-15T01:33:56.873231+0000","last_fullsized":"2023-11-15T01:33:56.873231+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869183+0000","last_change":"2023-11-15T01:33:56.858217+0000","last_active":"2023-11-15T01:33:56.869183+0000","last_peered":"2023-11-15T01:33:56.869183+0000","last_clean":"2023-11-15T01:33:56.869183+0000","last_became_active":"2023-11-15T01:33:56.857955+0000","last_became_peered":"2023-11-15T01:33:56.857955+0000","last_unstale":"2023-11-15T01:33:56.869183+0000","last_undegraded":"2023-11-15T01:33:56.869183+0000","last_fullsized":"2023-11-15T01:33:56.869183+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.855126+0000","last_change":"2023-11-15T01:33:56.471717+0000","last_active":"2023-11-15T01:33:56.855126+0000","last_peered":"2023-11-15T01:33:56.855126+0000","last_clean":"2023-11-15T01:33:56.855126+0000","last_became_active":"2023-11-15T01:33:56.471483+0000","last_became_peered":"2023-11-15T01:33:56.471483+0000","last_unstale":"2023-11-15T01:33:56.855126+0000","last_undegraded":"2023-11-15T01:33:56.855126+0000","last_fullsized":"2023-11-15T01:33:56.855126+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873298+0000","last_change":"2023-11-15T01:33:56.869819+0000","last_active":"2023-11-15T01:33:56.873298+0000","last_peered":"2023-11-15T01:33:56.873298+0000","last_clean":"2023-11-15T01:33:56.873298+0000","last_became_active":"2023-11-15T01:33:56.869529+0000","last_became_peered":"2023-11-15T01:33:56.869529+0000","last_unstale":"2023-11-15T01:33:56.873298+0000","last_undegraded":"2023-11-15T01:33:56.873298+0000","last_fullsized":"2023-11-15T01:33:56.873298+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859995+0000","last_change":"2023-11-15T01:33:56.456359+0000","last_active":"2023-11-15T01:33:56.859995+0000","last_peered":"2023-11-15T01:33:56.859995+0000","last_clean":"2023-11-15T01:33:56.859995+0000","last_became_active":"2023-11-15T01:33:56.456028+0000","last_became_peered":"2023-11-15T01:33:56.456028+0000","last_unstale":"2023-11-15T01:33:56.859995+0000","last_undegraded":"2023-11-15T01:33:56.859995+0000","last_fullsized":"2023-11-15T01:33:56.859995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879584+0000","last_change":"2023-11-15T01:33:56.876486+0000","last_active":"2023-11-15T01:33:56.879584+0000","last_peered":"2023-11-15T01:33:56.879584+0000","last_clean":"2023-11-15T01:33:56.879584+0000","last_became_active":"2023-11-15T01:33:56.876185+0000","last_became_peered":"2023-11-15T01:33:56.876185+0000","last_unstale":"2023-11-15T01:33:56.879584+0000","last_undegraded":"2023-11-15T01:33:56.879584+0000","last_fullsized":"2023-11-15T01:33:56.879584+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858937+0000","last_change":"2023-11-15T01:33:56.461596+0000","last_active":"2023-11-15T01:33:56.858937+0000","last_peered":"2023-11-15T01:33:56.858937+0000","last_clean":"2023-11-15T01:33:56.858937+0000","last_became_active":"2023-11-15T01:33:56.461232+0000","last_became_peered":"2023-11-15T01:33:56.461232+0000","last_unstale":"2023-11-15T01:33:56.858937+0000","last_undegraded":"2023-11-15T01:33:56.858937+0000","last_fullsized":"2023-11-15T01:33:56.858937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875552+0000","last_change":"2023-11-15T01:33:56.872876+0000","last_active":"2023-11-15T01:33:56.875552+0000","last_peered":"2023-11-15T01:33:56.875552+0000","last_clean":"2023-11-15T01:33:56.875552+0000","last_became_active":"2023-11-15T01:33:56.872293+0000","last_became_peered":"2023-11-15T01:33:56.872293+0000","last_unstale":"2023-11-15T01:33:56.875552+0000","last_undegraded":"2023-11-15T01:33:56.875552+0000","last_fullsized":"2023-11-15T01:33:56.875552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858075+0000","last_change":"2023-11-15T01:33:56.469475+0000","last_active":"2023-11-15T01:33:56.858075+0000","last_peered":"2023-11-15T01:33:56.858075+0000","last_clean":"2023-11-15T01:33:56.858075+0000","last_became_active":"2023-11-15T01:33:56.469038+0000","last_became_peered":"2023-11-15T01:33:56.469038+0000","last_unstale":"2023-11-15T01:33:56.858075+0000","last_undegraded":"2023-11-15T01:33:56.858075+0000","last_fullsized":"2023-11-15T01:33:56.858075+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.881954+0000","last_change":"2023-11-15T01:33:56.879242+0000","last_active":"2023-11-15T01:33:56.881954+0000","last_peered":"2023-11-15T01:33:56.881954+0000","last_clean":"2023-11-15T01:33:56.881954+0000","last_became_active":"2023-11-15T01:33:56.878946+0000","last_became_peered":"2023-11-15T01:33:56.878946+0000","last_unstale":"2023-11-15T01:33:56.881954+0000","last_undegraded":"2023-11-15T01:33:56.881954+0000","last_fullsized":"2023-11-15T01:33:56.881954+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859583+0000","last_change":"2023-11-15T01:33:56.463826+0000","last_active":"2023-11-15T01:33:56.859583+0000","last_peered":"2023-11-15T01:33:56.859583+0000","last_clean":"2023-11-15T01:33:56.859583+0000","last_became_active":"2023-11-15T01:33:56.463164+0000","last_became_peered":"2023-11-15T01:33:56.463164+0000","last_unstale":"2023-11-15T01:33:56.859583+0000","last_undegraded":"2023-11-15T01:33:56.859583+0000","last_fullsized":"2023-11-15T01:33:56.859583+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873153+0000","last_change":"2023-11-15T01:33:56.869206+0000","last_active":"2023-11-15T01:33:56.873153+0000","last_peered":"2023-11-15T01:33:56.873153+0000","last_clean":"2023-11-15T01:33:56.873153+0000","last_became_active":"2023-11-15T01:33:56.868918+0000","last_became_peered":"2023-11-15T01:33:56.868918+0000","last_unstale":"2023-11-15T01:33:56.873153+0000","last_undegraded":"2023-11-15T01:33:56.873153+0000","last_fullsized":"2023-11-15T01:33:56.873153+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.867059+0000","last_change":"2023-11-15T01:33:56.468977+0000","last_active":"2023-11-15T01:33:56.867059+0000","last_peered":"2023-11-15T01:33:56.867059+0000","last_clean":"2023-11-15T01:33:56.867059+0000","last_became_active":"2023-11-15T01:33:56.468680+0000","last_became_peered":"2023-11-15T01:33:56.468680+0000","last_unstale":"2023-11-15T01:33:56.867059+0000","last_undegraded":"2023-11-15T01:33:56.867059+0000","last_fullsized":"2023-11-15T01:33:56.867059+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.863671+0000","last_change":"2023-11-15T01:33:56.860959+0000","last_active":"2023-11-15T01:33:56.863671+0000","last_peered":"2023-11-15T01:33:56.863671+0000","last_clean":"2023-11-15T01:33:56.863671+0000","last_became_active":"2023-11-15T01:33:56.860574+0000","last_became_peered":"2023-11-15T01:33:56.860574+0000","last_unstale":"2023-11-15T01:33:56.863671+0000","last_undegraded":"2023-11-15T01:33:56.863671+0000","last_fullsized":"2023-11-15T01:33:56.863671+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860693+0000","last_change":"2023-11-15T01:33:56.469708+0000","last_active":"2023-11-15T01:33:56.860693+0000","last_peered":"2023-11-15T01:33:56.860693+0000","last_clean":"2023-11-15T01:33:56.860693+0000","last_became_active":"2023-11-15T01:33:56.469428+0000","last_became_peered":"2023-11-15T01:33:56.469428+0000","last_unstale":"2023-11-15T01:33:56.860693+0000","last_undegraded":"2023-11-15T01:33:56.860693+0000","last_fullsized":"2023-11-15T01:33:56.860693+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874768+0000","last_change":"2023-11-15T01:33:56.867465+0000","last_active":"2023-11-15T01:33:56.874768+0000","last_peered":"2023-11-15T01:33:56.874768+0000","last_clean":"2023-11-15T01:33:56.874768+0000","last_became_active":"2023-11-15T01:33:56.867152+0000","last_became_peered":"2023-11-15T01:33:56.867152+0000","last_unstale":"2023-11-15T01:33:56.874768+0000","last_undegraded":"2023-11-15T01:33:56.874768+0000","last_fullsized":"2023-11-15T01:33:56.874768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"60'3","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879018+0000","last_change":"2023-11-15T01:33:56.476533+0000","last_active":"2023-11-15T01:33:56.879018+0000","last_peered":"2023-11-15T01:33:56.879018+0000","last_clean":"2023-11-15T01:33:56.879018+0000","last_became_active":"2023-11-15T01:33:56.476246+0000","last_became_peered":"2023-11-15T01:33:56.476246+0000","last_unstale":"2023-11-15T01:33:56.879018+0000","last_undegraded":"2023-11-15T01:33:56.879018+0000","last_fullsized":"2023-11-15T01:33:56.879018+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.872188+0000","last_change":"2023-11-15T01:33:56.868151+0000","last_active":"2023-11-15T01:33:56.872188+0000","last_peered":"2023-11-15T01:33:56.872188+0000","last_clean":"2023-11-15T01:33:56.872188+0000","last_became_active":"2023-11-15T01:33:56.867790+0000","last_became_peered":"2023-11-15T01:33:56.867790+0000","last_unstale":"2023-11-15T01:33:56.872188+0000","last_undegraded":"2023-11-15T01:33:56.872188+0000","last_fullsized":"2023-11-15T01:33:56.872188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877547+0000","last_change":"2023-11-15T01:33:56.470412+0000","last_active":"2023-11-15T01:33:56.877547+0000","last_peered":"2023-11-15T01:33:56.877547+0000","last_clean":"2023-11-15T01:33:56.877547+0000","last_became_active":"2023-11-15T01:33:56.469983+0000","last_became_peered":"2023-11-15T01:33:56.469983+0000","last_unstale":"2023-11-15T01:33:56.877547+0000","last_undegraded":"2023-11-15T01:33:56.877547+0000","last_fullsized":"2023-11-15T01:33:56.877547+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875421+0000","last_change":"2023-11-15T01:33:56.873025+0000","last_active":"2023-11-15T01:33:56.875421+0000","last_peered":"2023-11-15T01:33:56.875421+0000","last_clean":"2023-11-15T01:33:56.875421+0000","last_became_active":"2023-11-15T01:33:56.872590+0000","last_became_peered":"2023-11-15T01:33:56.872590+0000","last_unstale":"2023-11-15T01:33:56.875421+0000","last_undegraded":"2023-11-15T01:33:56.875421+0000","last_fullsized":"2023-11-15T01:33:56.875421+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.878036+0000","last_change":"2023-11-15T01:33:56.467785+0000","last_active":"2023-11-15T01:33:56.878036+0000","last_peered":"2023-11-15T01:33:56.878036+0000","last_clean":"2023-11-15T01:33:56.878036+0000","last_became_active":"2023-11-15T01:33:56.467489+0000","last_became_peered":"2023-11-15T01:33:56.467489+0000","last_unstale":"2023-11-15T01:33:56.878036+0000","last_undegraded":"2023-11-15T01:33:56.878036+0000","last_fullsized":"2023-11-15T01:33:56.878036+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874082+0000","last_change":"2023-11-15T01:33:56.867055+0000","last_active":"2023-11-15T01:33:56.874082+0000","last_peered":"2023-11-15T01:33:56.874082+0000","last_clean":"2023-11-15T01:33:56.874082+0000","last_became_active":"2023-11-15T01:33:56.865917+0000","last_became_peered":"2023-11-15T01:33:56.865917+0000","last_unstale":"2023-11-15T01:33:56.874082+0000","last_undegraded":"2023-11-15T01:33:56.874082+0000","last_fullsized":"2023-11-15T01:33:56.874082+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858274+0000","last_change":"2023-11-15T01:33:56.469022+0000","last_active":"2023-11-15T01:33:56.858274+0000","last_peered":"2023-11-15T01:33:56.858274+0000","last_clean":"2023-11-15T01:33:56.858274+0000","last_became_active":"2023-11-15T01:33:56.468713+0000","last_became_peered":"2023-11-15T01:33:56.468713+0000","last_unstale":"2023-11-15T01:33:56.858274+0000","last_undegraded":"2023-11-15T01:33:56.858274+0000","last_fullsized":"2023-11-15T01:33:56.858274+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868778+0000","last_change":"2023-11-15T01:33:56.865296+0000","last_active":"2023-11-15T01:33:56.868778+0000","last_peered":"2023-11-15T01:33:56.868778+0000","last_clean":"2023-11-15T01:33:56.868778+0000","last_became_active":"2023-11-15T01:33:56.864996+0000","last_became_peered":"2023-11-15T01:33:56.864996+0000","last_unstale":"2023-11-15T01:33:56.868778+0000","last_undegraded":"2023-11-15T01:33:56.868778+0000","last_fullsized":"2023-11-15T01:33:56.868778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.864452+0000","last_change":"2023-11-15T01:33:56.472655+0000","last_active":"2023-11-15T01:33:56.864452+0000","last_peered":"2023-11-15T01:33:56.864452+0000","last_clean":"2023-11-15T01:33:56.864452+0000","last_became_active":"2023-11-15T01:33:56.472369+0000","last_became_peered":"2023-11-15T01:33:56.472369+0000","last_unstale":"2023-11-15T01:33:56.864452+0000","last_undegraded":"2023-11-15T01:33:56.864452+0000","last_fullsized":"2023-11-15T01:33:56.864452+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875197+0000","last_change":"2023-11-15T01:33:56.866585+0000","last_active":"2023-11-15T01:33:56.875197+0000","last_peered":"2023-11-15T01:33:56.875197+0000","last_clean":"2023-11-15T01:33:56.875197+0000","last_became_active":"2023-11-15T01:33:56.866281+0000","last_became_peered":"2023-11-15T01:33:56.866281+0000","last_unstale":"2023-11-15T01:33:56.875197+0000","last_undegraded":"2023-11-15T01:33:56.875197+0000","last_fullsized":"2023-11-15T01:33:56.875197+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876043+0000","last_change":"2023-11-15T01:33:56.470274+0000","last_active":"2023-11-15T01:33:56.876043+0000","last_peered":"2023-11-15T01:33:56.876043+0000","last_clean":"2023-11-15T01:33:56.876043+0000","last_became_active":"2023-11-15T01:33:56.469919+0000","last_became_peered":"2023-11-15T01:33:56.469919+0000","last_unstale":"2023-11-15T01:33:56.876043+0000","last_undegraded":"2023-11-15T01:33:56.876043+0000","last_fullsized":"2023-11-15T01:33:56.876043+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868787+0000","last_change":"2023-11-15T01:33:56.861760+0000","last_active":"2023-11-15T01:33:56.868787+0000","last_peered":"2023-11-15T01:33:56.868787+0000","last_clean":"2023-11-15T01:33:56.868787+0000","last_became_active":"2023-11-15T01:33:56.861490+0000","last_became_peered":"2023-11-15T01:33:56.861490+0000","last_unstale":"2023-11-15T01:33:56.868787+0000","last_undegraded":"2023-11-15T01:33:56.868787+0000","last_fullsized":"2023-11-15T01:33:56.868787+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875430+0000","last_change":"2023-11-15T01:33:56.468949+0000","last_active":"2023-11-15T01:33:56.875430+0000","last_peered":"2023-11-15T01:33:56.875430+0000","last_clean":"2023-11-15T01:33:56.875430+0000","last_became_active":"2023-11-15T01:33:56.468359+0000","last_became_peered":"2023-11-15T01:33:56.468359+0000","last_unstale":"2023-11-15T01:33:56.875430+0000","last_undegraded":"2023-11-15T01:33:56.875430+0000","last_fullsized":"2023-11-15T01:33:56.875430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877434+0000","last_change":"2023-11-15T01:33:56.872116+0000","last_active":"2023-11-15T01:33:56.877434+0000","last_peered":"2023-11-15T01:33:56.877434+0000","last_clean":"2023-11-15T01:33:56.877434+0000","last_became_active":"2023-11-15T01:33:56.871846+0000","last_became_peered":"2023-11-15T01:33:56.871846+0000","last_unstale":"2023-11-15T01:33:56.877434+0000","last_undegraded":"2023-11-15T01:33:56.877434+0000","last_fullsized":"2023-11-15T01:33:56.877434+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870248+0000","last_change":"2023-11-15T01:33:56.466299+0000","last_active":"2023-11-15T01:33:56.870248+0000","last_peered":"2023-11-15T01:33:56.870248+0000","last_clean":"2023-11-15T01:33:56.870248+0000","last_became_active":"2023-11-15T01:33:56.465916+0000","last_became_peered":"2023-11-15T01:33:56.465916+0000","last_unstale":"2023-11-15T01:33:56.870248+0000","last_undegraded":"2023-11-15T01:33:56.870248+0000","last_fullsized":"2023-11-15T01:33:56.870248+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874692+0000","last_change":"2023-11-15T01:33:56.873782+0000","last_active":"2023-11-15T01:33:56.874692+0000","last_peered":"2023-11-15T01:33:56.874692+0000","last_clean":"2023-11-15T01:33:56.874692+0000","last_became_active":"2023-11-15T01:33:56.873501+0000","last_became_peered":"2023-11-15T01:33:56.873501+0000","last_unstale":"2023-11-15T01:33:56.874692+0000","last_undegraded":"2023-11-15T01:33:56.874692+0000","last_fullsized":"2023-11-15T01:33:56.874692+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858124+0000","last_change":"2023-11-15T01:33:56.473892+0000","last_active":"2023-11-15T01:33:56.858124+0000","last_peered":"2023-11-15T01:33:56.858124+0000","last_clean":"2023-11-15T01:33:56.858124+0000","last_became_active":"2023-11-15T01:33:56.473710+0000","last_became_peered":"2023-11-15T01:33:56.473710+0000","last_unstale":"2023-11-15T01:33:56.858124+0000","last_undegraded":"2023-11-15T01:33:56.858124+0000","last_fullsized":"2023-11-15T01:33:56.858124+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876700+0000","last_change":"2023-11-15T01:33:56.870602+0000","last_active":"2023-11-15T01:33:56.876700+0000","last_peered":"2023-11-15T01:33:56.876700+0000","last_clean":"2023-11-15T01:33:56.876700+0000","last_became_active":"2023-11-15T01:33:56.870368+0000","last_became_peered":"2023-11-15T01:33:56.870368+0000","last_unstale":"2023-11-15T01:33:56.876700+0000","last_undegraded":"2023-11-15T01:33:56.876700+0000","last_fullsized":"2023-11-15T01:33:56.876700+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858126+0000","last_change":"2023-11-15T01:33:56.471065+0000","last_active":"2023-11-15T01:33:56.858126+0000","last_peered":"2023-11-15T01:33:56.858126+0000","last_clean":"2023-11-15T01:33:56.858126+0000","last_became_active":"2023-11-15T01:33:56.470782+0000","last_became_peered":"2023-11-15T01:33:56.470782+0000","last_unstale":"2023-11-15T01:33:56.858126+0000","last_undegraded":"2023-11-15T01:33:56.858126+0000","last_fullsized":"2023-11-15T01:33:56.858126+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868575+0000","last_change":"2023-11-15T01:33:56.864580+0000","last_active":"2023-11-15T01:33:56.868575+0000","last_peered":"2023-11-15T01:33:56.868575+0000","last_clean":"2023-11-15T01:33:56.868575+0000","last_became_active":"2023-11-15T01:33:56.864319+0000","last_became_peered":"2023-11-15T01:33:56.864319+0000","last_unstale":"2023-11-15T01:33:56.868575+0000","last_undegraded":"2023-11-15T01:33:56.868575+0000","last_fullsized":"2023-11-15T01:33:56.868575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870318+0000","last_change":"2023-11-15T01:33:56.470098+0000","last_active":"2023-11-15T01:33:56.870318+0000","last_peered":"2023-11-15T01:33:56.870318+0000","last_clean":"2023-11-15T01:33:56.870318+0000","last_became_active":"2023-11-15T01:33:56.466313+0000","last_became_peered":"2023-11-15T01:33:56.466313+0000","last_unstale":"2023-11-15T01:33:56.870318+0000","last_undegraded":"2023-11-15T01:33:56.870318+0000","last_fullsized":"2023-11-15T01:33:56.870318+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.867806+0000","last_change":"2023-11-15T01:33:56.862031+0000","last_active":"2023-11-15T01:33:56.867806+0000","last_peered":"2023-11-15T01:33:56.867806+0000","last_clean":"2023-11-15T01:33:56.867806+0000","last_became_active":"2023-11-15T01:33:56.861772+0000","last_became_peered":"2023-11-15T01:33:56.861772+0000","last_unstale":"2023-11-15T01:33:56.867806+0000","last_undegraded":"2023-11-15T01:33:56.867806+0000","last_fullsized":"2023-11-15T01:33:56.867806+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851553+0000","last_change":"2023-11-15T01:33:56.474219+0000","last_active":"2023-11-15T01:33:56.851553+0000","last_peered":"2023-11-15T01:33:56.851553+0000","last_clean":"2023-11-15T01:33:56.851553+0000","last_became_active":"2023-11-15T01:33:56.473738+0000","last_became_peered":"2023-11-15T01:33:56.473738+0000","last_unstale":"2023-11-15T01:33:56.851553+0000","last_undegraded":"2023-11-15T01:33:56.851553+0000","last_fullsized":"2023-11-15T01:33:56.851553+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877515+0000","last_change":"2023-11-15T01:33:56.867511+0000","last_active":"2023-11-15T01:33:56.877515+0000","last_peered":"2023-11-15T01:33:56.877515+0000","last_clean":"2023-11-15T01:33:56.877515+0000","last_became_active":"2023-11-15T01:33:56.867228+0000","last_became_peered":"2023-11-15T01:33:56.867228+0000","last_unstale":"2023-11-15T01:33:56.877515+0000","last_undegraded":"2023-11-15T01:33:56.877515+0000","last_fullsized":"2023-11-15T01:33:56.877515+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860126+0000","last_change":"2023-11-15T01:33:56.478983+0000","last_active":"2023-11-15T01:33:56.860126+0000","last_peered":"2023-11-15T01:33:56.860126+0000","last_clean":"2023-11-15T01:33:56.860126+0000","last_became_active":"2023-11-15T01:33:56.478740+0000","last_became_peered":"2023-11-15T01:33:56.478740+0000","last_unstale":"2023-11-15T01:33:56.860126+0000","last_undegraded":"2023-11-15T01:33:56.860126+0000","last_fullsized":"2023-11-15T01:33:56.860126+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.878323+0000","last_change":"2023-11-15T01:33:56.874707+0000","last_active":"2023-11-15T01:33:56.878323+0000","last_peered":"2023-11-15T01:33:56.878323+0000","last_clean":"2023-11-15T01:33:56.878323+0000","last_became_active":"2023-11-15T01:33:56.874384+0000","last_became_peered":"2023-11-15T01:33:56.874384+0000","last_unstale":"2023-11-15T01:33:56.878323+0000","last_undegraded":"2023-11-15T01:33:56.878323+0000","last_fullsized":"2023-11-15T01:33:56.878323+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861834+0000","last_change":"2023-11-15T01:33:56.468488+0000","last_active":"2023-11-15T01:33:56.861834+0000","last_peered":"2023-11-15T01:33:56.861834+0000","last_clean":"2023-11-15T01:33:56.861834+0000","last_became_active":"2023-11-15T01:33:56.468185+0000","last_became_peered":"2023-11-15T01:33:56.468185+0000","last_unstale":"2023-11-15T01:33:56.861834+0000","last_undegraded":"2023-11-15T01:33:56.861834+0000","last_fullsized":"2023-11-15T01:33:56.861834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877540+0000","last_change":"2023-11-15T01:33:56.871264+0000","last_active":"2023-11-15T01:33:56.877540+0000","last_peered":"2023-11-15T01:33:56.877540+0000","last_clean":"2023-11-15T01:33:56.877540+0000","last_became_active":"2023-11-15T01:33:56.870999+0000","last_became_peered":"2023-11-15T01:33:56.870999+0000","last_unstale":"2023-11-15T01:33:56.877540+0000","last_undegraded":"2023-11-15T01:33:56.877540+0000","last_fullsized":"2023-11-15T01:33:56.877540+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858830+0000","last_change":"2023-11-15T01:33:56.471602+0000","last_active":"2023-11-15T01:33:56.858830+0000","last_peered":"2023-11-15T01:33:56.858830+0000","last_clean":"2023-11-15T01:33:56.858830+0000","last_became_active":"2023-11-15T01:33:56.471289+0000","last_became_peered":"2023-11-15T01:33:56.471289+0000","last_unstale":"2023-11-15T01:33:56.858830+0000","last_undegraded":"2023-11-15T01:33:56.858830+0000","last_fullsized":"2023-11-15T01:33:56.858830+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.856327+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:33:56.856327+0000","last_peered":"2023-11-15T01:33:56.856327+0000","last_clean":"2023-11-15T01:33:56.856327+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:33:56.856327+0000","last_undegraded":"2023-11-15T01:33:56.856327+0000","last_fullsized":"2023-11-15T01:33:56.856327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860918+0000","last_change":"2023-11-15T01:33:56.858629+0000","last_active":"2023-11-15T01:33:56.860918+0000","last_peered":"2023-11-15T01:33:56.860918+0000","last_clean":"2023-11-15T01:33:56.860918+0000","last_became_active":"2023-11-15T01:33:56.858315+0000","last_became_peered":"2023-11-15T01:33:56.858315+0000","last_unstale":"2023-11-15T01:33:56.860918+0000","last_undegraded":"2023-11-15T01:33:56.860918+0000","last_fullsized":"2023-11-15T01:33:56.860918+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879015+0000","last_change":"2023-11-15T01:33:56.470464+0000","last_active":"2023-11-15T01:33:56.879015+0000","last_peered":"2023-11-15T01:33:56.879015+0000","last_clean":"2023-11-15T01:33:56.879015+0000","last_became_active":"2023-11-15T01:33:56.470182+0000","last_became_peered":"2023-11-15T01:33:56.470182+0000","last_unstale":"2023-11-15T01:33:56.879015+0000","last_undegraded":"2023-11-15T01:33:56.879015+0000","last_fullsized":"2023-11-15T01:33:56.879015+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.854403+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:33:56.854403+0000","last_peered":"2023-11-15T01:33:56.854403+0000","last_clean":"2023-11-15T01:33:56.854403+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:33:56.854403+0000","last_undegraded":"2023-11-15T01:33:56.854403+0000","last_fullsized":"2023-11-15T01:33:56.854403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870739+0000","last_change":"2023-11-15T01:33:56.861357+0000","last_active":"2023-11-15T01:33:56.870739+0000","last_peered":"2023-11-15T01:33:56.870739+0000","last_clean":"2023-11-15T01:33:56.870739+0000","last_became_active":"2023-11-15T01:33:56.861060+0000","last_became_peered":"2023-11-15T01:33:56.861060+0000","last_unstale":"2023-11-15T01:33:56.870739+0000","last_undegraded":"2023-11-15T01:33:56.870739+0000","last_fullsized":"2023-11-15T01:33:56.870739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859580+0000","last_change":"2023-11-15T01:33:56.462711+0000","last_active":"2023-11-15T01:33:56.859580+0000","last_peered":"2023-11-15T01:33:56.859580+0000","last_clean":"2023-11-15T01:33:56.859580+0000","last_became_active":"2023-11-15T01:33:56.462463+0000","last_became_peered":"2023-11-15T01:33:56.462463+0000","last_unstale":"2023-11-15T01:33:56.859580+0000","last_undegraded":"2023-11-15T01:33:56.859580+0000","last_fullsized":"2023-11-15T01:33:56.859580+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.863559+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:33:56.863559+0000","last_peered":"2023-11-15T01:33:56.863559+0000","last_clean":"2023-11-15T01:33:56.863559+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:33:56.863559+0000","last_undegraded":"2023-11-15T01:33:56.863559+0000","last_fullsized":"2023-11-15T01:33:56.863559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.865232+0000","last_change":"2023-11-15T01:33:56.861471+0000","last_active":"2023-11-15T01:33:56.865232+0000","last_peered":"2023-11-15T01:33:56.865232+0000","last_clean":"2023-11-15T01:33:56.865232+0000","last_became_active":"2023-11-15T01:33:56.860124+0000","last_became_peered":"2023-11-15T01:33:56.860124+0000","last_unstale":"2023-11-15T01:33:56.865232+0000","last_undegraded":"2023-11-15T01:33:56.865232+0000","last_fullsized":"2023-11-15T01:33:56.865232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860345+0000","last_change":"2023-11-15T01:33:56.467702+0000","last_active":"2023-11-15T01:33:56.860345+0000","last_peered":"2023-11-15T01:33:56.860345+0000","last_clean":"2023-11-15T01:33:56.860345+0000","last_became_active":"2023-11-15T01:33:56.467346+0000","last_became_peered":"2023-11-15T01:33:56.467346+0000","last_unstale":"2023-11-15T01:33:56.860345+0000","last_undegraded":"2023-11-15T01:33:56.860345+0000","last_fullsized":"2023-11-15T01:33:56.860345+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.854655+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:33:56.854655+0000","last_peered":"2023-11-15T01:33:56.854655+0000","last_clean":"2023-11-15T01:33:56.854655+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:33:56.854655+0000","last_undegraded":"2023-11-15T01:33:56.854655+0000","last_fullsized":"2023-11-15T01:33:56.854655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.864776+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:33:56.864776+0000","last_peered":"2023-11-15T01:33:56.864776+0000","last_clean":"2023-11-15T01:33:56.864776+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:33:56.864776+0000","last_undegraded":"2023-11-15T01:33:56.864776+0000","last_fullsized":"2023-11-15T01:33:56.864776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877503+0000","last_change":"2023-11-15T01:33:56.872973+0000","last_active":"2023-11-15T01:33:56.877503+0000","last_peered":"2023-11-15T01:33:56.877503+0000","last_clean":"2023-11-15T01:33:56.877503+0000","last_became_active":"2023-11-15T01:33:56.872705+0000","last_became_peered":"2023-11-15T01:33:56.872705+0000","last_unstale":"2023-11-15T01:33:56.877503+0000","last_undegraded":"2023-11-15T01:33:56.877503+0000","last_fullsized":"2023-11-15T01:33:56.877503+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.867400+0000","last_change":"2023-11-15T01:33:56.470260+0000","last_active":"2023-11-15T01:33:56.867400+0000","last_peered":"2023-11-15T01:33:56.867400+0000","last_clean":"2023-11-15T01:33:56.867400+0000","last_became_active":"2023-11-15T01:33:56.469956+0000","last_became_peered":"2023-11-15T01:33:56.469956+0000","last_unstale":"2023-11-15T01:33:56.867400+0000","last_undegraded":"2023-11-15T01:33:56.867400+0000","last_fullsized":"2023-11-15T01:33:56.867400+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.864854+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:33:56.864854+0000","last_peered":"2023-11-15T01:33:56.864854+0000","last_clean":"2023-11-15T01:33:56.864854+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:33:56.864854+0000","last_undegraded":"2023-11-15T01:33:56.864854+0000","last_fullsized":"2023-11-15T01:33:56.864854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873538+0000","last_change":"2023-11-15T01:33:56.872687+0000","last_active":"2023-11-15T01:33:56.873538+0000","last_peered":"2023-11-15T01:33:56.873538+0000","last_clean":"2023-11-15T01:33:56.873538+0000","last_became_active":"2023-11-15T01:33:56.872163+0000","last_became_peered":"2023-11-15T01:33:56.872163+0000","last_unstale":"2023-11-15T01:33:56.873538+0000","last_undegraded":"2023-11-15T01:33:56.873538+0000","last_fullsized":"2023-11-15T01:33:56.873538+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.857883+0000","last_change":"2023-11-15T01:33:56.466600+0000","last_active":"2023-11-15T01:33:56.857883+0000","last_peered":"2023-11-15T01:33:56.857883+0000","last_clean":"2023-11-15T01:33:56.857883+0000","last_became_active":"2023-11-15T01:33:56.466275+0000","last_became_peered":"2023-11-15T01:33:56.466275+0000","last_unstale":"2023-11-15T01:33:56.857883+0000","last_undegraded":"2023-11-15T01:33:56.857883+0000","last_fullsized":"2023-11-15T01:33:56.857883+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.867431+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:33:56.867431+0000","last_peered":"2023-11-15T01:33:56.867431+0000","last_clean":"2023-11-15T01:33:56.867431+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:33:56.867431+0000","last_undegraded":"2023-11-15T01:33:56.867431+0000","last_fullsized":"2023-11-15T01:33:56.867431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873310+0000","last_change":"2023-11-15T01:33:56.865528+0000","last_active":"2023-11-15T01:33:56.873310+0000","last_peered":"2023-11-15T01:33:56.873310+0000","last_clean":"2023-11-15T01:33:56.873310+0000","last_became_active":"2023-11-15T01:33:56.865239+0000","last_became_peered":"2023-11-15T01:33:56.865239+0000","last_unstale":"2023-11-15T01:33:56.873310+0000","last_undegraded":"2023-11-15T01:33:56.873310+0000","last_fullsized":"2023-11-15T01:33:56.873310+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.852317+0000","last_change":"2023-11-15T01:33:56.470793+0000","last_active":"2023-11-15T01:33:56.852317+0000","last_peered":"2023-11-15T01:33:56.852317+0000","last_clean":"2023-11-15T01:33:56.852317+0000","last_became_active":"2023-11-15T01:33:56.469938+0000","last_became_peered":"2023-11-15T01:33:56.469938+0000","last_unstale":"2023-11-15T01:33:56.852317+0000","last_undegraded":"2023-11-15T01:33:56.852317+0000","last_fullsized":"2023-11-15T01:33:56.852317+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.857477+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:33:56.857477+0000","last_peered":"2023-11-15T01:33:56.857477+0000","last_clean":"2023-11-15T01:33:56.857477+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:33:56.857477+0000","last_undegraded":"2023-11-15T01:33:56.857477+0000","last_fullsized":"2023-11-15T01:33:56.857477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.881909+0000","last_change":"2023-11-15T01:33:56.877221+0000","last_active":"2023-11-15T01:33:56.881909+0000","last_peered":"2023-11-15T01:33:56.881909+0000","last_clean":"2023-11-15T01:33:56.881909+0000","last_became_active":"2023-11-15T01:33:56.876912+0000","last_became_peered":"2023-11-15T01:33:56.876912+0000","last_unstale":"2023-11-15T01:33:56.881909+0000","last_undegraded":"2023-11-15T01:33:56.881909+0000","last_fullsized":"2023-11-15T01:33:56.881909+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851763+0000","last_change":"2023-11-15T01:33:56.476704+0000","last_active":"2023-11-15T01:33:56.851763+0000","last_peered":"2023-11-15T01:33:56.851763+0000","last_clean":"2023-11-15T01:33:56.851763+0000","last_became_active":"2023-11-15T01:33:56.476357+0000","last_became_peered":"2023-11-15T01:33:56.476357+0000","last_unstale":"2023-11-15T01:33:56.851763+0000","last_undegraded":"2023-11-15T01:33:56.851763+0000","last_fullsized":"2023-11-15T01:33:56.851763+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859071+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:33:56.859071+0000","last_peered":"2023-11-15T01:33:56.859071+0000","last_clean":"2023-11-15T01:33:56.859071+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:33:56.859071+0000","last_undegraded":"2023-11-15T01:33:56.859071+0000","last_fullsized":"2023-11-15T01:33:56.859071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301912,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069928,"statfs":{"total":96636764160,"available":96327606272,"internally_reserved":0,"allocated":737280,"data_stored":353266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71199999999999997,"5min":0.81499999999999995,"15min":0.82299999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.67200000000000004,"5min":0.79500000000000004,"15min":0.83299999999999996},"last":0.64600000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77700000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.34399999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.65900000000000003,"5min":0.78000000000000003,"15min":0.81499999999999995},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.77800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68999999999999995,"5min":0.82199999999999995,"15min":0.86299999999999999},"last":0.68999999999999995}]},{"osd":3,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68400000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":0.81200000000000006},"last":0.47799999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.46999999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.84499999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.53000000000000003,"15min":0.54700000000000004},"min":{"1min":0.32500000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.83799999999999997},"last":0.56799999999999995}]},{"osd":5,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47499999999999998,"15min":0.49199999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.71999999999999997,"5min":0.76600000000000001,"15min":0.77500000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73899999999999999,"5min":0.748,"15min":0.78500000000000003},"last":0.49099999999999999}]},{"osd":6,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.36899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.54800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.755,"5min":0.76100000000000001,"15min":0.85099999999999998},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575000,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301904,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069936,"statfs":{"total":96636764160,"available":96327614464,"internally_reserved":0,"allocated":729088,"data_stored":352658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.39800000000000002,"5min":0.34000000000000002,"15min":0.29199999999999998},"max":{"1min":0.63600000000000001,"5min":0.82399999999999995,"15min":0.94299999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55000000000000004,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.34499999999999997,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.75600000000000001,"15min":0.97799999999999998},"last":0.40100000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.38700000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":1.0649999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57299999999999995,"15min":0.54700000000000004},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.84699999999999998,"15min":1.022},"last":0.48999999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.71999999999999997,"5min":0.84199999999999997,"15min":1.038},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70499999999999996,"5min":0.80700000000000005,"15min":0.995},"last":0.41499999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.41299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.69399999999999995,"5min":0.91300000000000003,"15min":1.028},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68500000000000005,"5min":0.874,"15min":1.004},"last":0.504}]},{"osd":4,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.314,"5min":0.31,"15min":0.26600000000000001},"max":{"1min":0.67900000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.25800000000000001},"max":{"1min":0.67500000000000004,"5min":0.68799999999999994,"15min":0.81799999999999995},"last":0.51200000000000001}]},{"osd":5,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.312},"max":{"1min":0.68500000000000005,"5min":0.69799999999999995,"15min":0.74099999999999999},"last":0.432},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.73799999999999999,"5min":0.79200000000000004,"15min":0.79900000000000004},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.377,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":0.70499999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.41399999999999998,"15min":0.34000000000000002},"max":{"1min":0.72799999999999998,"5min":0.81299999999999994,"15min":1.0009999999999999},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575001,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301904,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069936,"statfs":{"total":96636764160,"available":96327614464,"internally_reserved":0,"allocated":729088,"data_stored":352678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23999999999999999},"max":{"1min":0.54900000000000004,"5min":0.64500000000000002,"15min":0.77800000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41199999999999998,"15min":0.38500000000000001},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.247},"max":{"1min":0.55500000000000005,"5min":0.65600000000000003,"15min":0.73099999999999998},"last":0.307}]},{"osd":2,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.40400000000000003,"15min":0.38700000000000001},"min":{"1min":0.29299999999999998,"5min":0.27800000000000002,"15min":0.22600000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.69599999999999995},"last":0.318},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45100000000000001,"15min":0.434},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.90000000000000002},"last":0.39300000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.502,"15min":0.48099999999999998},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.31},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":1.0009999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.48799999999999999,"15min":0.45600000000000002},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.28000000000000003},"max":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.75600000000000001},"last":0.41699999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79400000000000004,"5min":0.82299999999999995,"15min":0.89300000000000002},"last":0.44},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.65200000000000002,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":0.78200000000000003,"5min":0.88700000000000001,"15min":1.0509999999999999},"last":0.68600000000000005}]},{"osd":5,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65000000000000002,"15min":0.626},"min":{"1min":0.432,"5min":0.40100000000000002,"15min":0.38500000000000001},"max":{"1min":0.78100000000000003,"5min":0.83399999999999996,"15min":0.92700000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66000000000000003,"15min":0.63},"min":{"1min":0.46400000000000002,"5min":0.433,"15min":0.373},"max":{"1min":0.91700000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56999999999999995}]},{"osd":6,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68600000000000005,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82199999999999995,"5min":0.90900000000000003,"15min":1.0029999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.67500000000000004},"min":{"1min":0.51300000000000001,"5min":0.45200000000000001,"15min":0.41199999999999998},"max":{"1min":0.90100000000000002,"5min":0.96599999999999997,"15min":0.996},"last":0.67200000000000004}]},{"osd":7,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70599999999999996,"15min":0.68200000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88500000000000001,"5min":0.93899999999999995,"15min":1.25},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70399999999999996,"15min":0.67700000000000005},"min":{"1min":0.52200000000000002,"5min":0.495,"15min":0.46100000000000002},"max":{"1min":0.92200000000000004,"5min":0.96699999999999997,"15min":0.99199999999999999},"last":0.59399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301912,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069928,"statfs":{"total":96636764160,"available":96327606272,"internally_reserved":0,"allocated":737280,"data_stored":352714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.36199999999999999,"15min":0.35899999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.50700000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.41599999999999998,"15min":0.40200000000000002},"min":{"1min":0.26300000000000001,"5min":0.252,"15min":0.215},"max":{"1min":0.50600000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.33100000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.39400000000000002,"15min":0.378},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.505,"5min":0.60499999999999998,"15min":0.64200000000000002},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.42599999999999999,"15min":0.42999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.47399999999999998,"5min":0.68600000000000005,"15min":1.0429999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.42999999999999999,"15min":0.41899999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.22500000000000001},"max":{"1min":0.55700000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.311},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.45500000000000002,"15min":0.443},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27700000000000002},"max":{"1min":0.58399999999999996,"5min":0.73199999999999998,"15min":0.83399999999999996},"last":0.34399999999999997}]},{"osd":4,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78800000000000003,"5min":0.97799999999999998,"15min":1.454},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.442},"max":{"1min":0.79300000000000004,"5min":0.94999999999999996,"15min":1.147},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69399999999999995,"5min":1.01,"15min":1.079},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.624,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.73699999999999999,"5min":0.91400000000000003,"15min":1.1120000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":1.2529999999999999},"last":0.496},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.68999999999999995,"5min":1.042,"15min":1.206},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.78100000000000003,"5min":1.0620000000000001,"15min":1.2669999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68200000000000005,"15min":0.69799999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83299999999999996,"5min":0.99199999999999999,"15min":1.4119999999999999},"last":0.65300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065832,"statfs":{"total":96636764160,"available":96323411968,"internally_reserved":0,"allocated":737280,"data_stored":354124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36699999999999999,"15min":0.36199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.221},"max":{"1min":0.48599999999999999,"5min":0.60199999999999998,"15min":0.61899999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.40200000000000002,"15min":0.39400000000000002},"min":{"1min":0.28699999999999998,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.63700000000000001,"15min":0.67800000000000005},"last":0.35199999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":0.70999999999999996,"15min":0.75},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66300000000000003,"5min":0.73499999999999999,"15min":0.92000000000000004},"last":0.38500000000000001}]},{"osd":3,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45600000000000002,"15min":0.438},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.57999999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.42999999999999999},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.253},"max":{"1min":0.66700000000000004,"5min":0.68999999999999995,"15min":0.74199999999999999},"last":0.309}]},{"osd":4,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89000000000000001,"5min":0.90900000000000003,"15min":1.0800000000000001},"last":0.499},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.629,"15min":0.64600000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.95399999999999996,"15min":1.052},"last":0.49099999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.63800000000000001,"15min":0.64500000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.93000000000000005,"15min":0.998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63800000000000001,"15min":0.63600000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.85499999999999998,"5min":0.96099999999999997,"15min":1.1339999999999999},"last":0.436}]},{"osd":6,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65800000000000003,"15min":0.65900000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.91300000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.441,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84199999999999997,"5min":1.016,"15min":1.119},"last":0.47399999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.48399999999999999,"5min":0.45200000000000001,"15min":0.438},"max":{"1min":0.79700000000000004,"5min":1.03,"15min":1.103},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.68600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065832,"statfs":{"total":96636764160,"available":96323411968,"internally_reserved":0,"allocated":737280,"data_stored":353254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39200000000000002,"15min":0.36199999999999999},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.22600000000000001},"max":{"1min":0.53100000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.42199999999999999,"15min":0.38800000000000001},"min":{"1min":0.30299999999999999,"5min":0.29499999999999998,"15min":0.23200000000000001},"max":{"1min":0.54300000000000004,"5min":0.70499999999999996,"15min":0.70899999999999996},"last":0.27900000000000003}]},{"osd":1,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.41099999999999998,"15min":0.377},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.23599999999999999},"max":{"1min":0.59799999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.46500000000000002,"15min":0.441},"min":{"1min":0.372,"5min":0.29399999999999998,"15min":0.28999999999999998},"max":{"1min":0.621,"5min":0.747,"15min":0.80500000000000005},"last":0.33600000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46500000000000002,"15min":0.436},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.26900000000000002},"max":{"1min":0.58799999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.5,"15min":0.46300000000000002},"min":{"1min":0.38900000000000001,"5min":0.35999999999999999,"15min":0.26200000000000001},"max":{"1min":0.64500000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41999999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.42099999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.92600000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.44,"15min":0.39000000000000001},"max":{"1min":0.82699999999999996,"5min":1.036,"15min":1.0589999999999999},"last":0.40600000000000003}]},{"osd":5,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.64400000000000002},"min":{"1min":0.503,"5min":0.48399999999999999,"15min":0.41099999999999998},"max":{"1min":0.80600000000000005,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.44400000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86099999999999999,"5min":0.90100000000000002,"15min":0.95999999999999996},"last":0.41099999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.65200000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.42499999999999999},"max":{"1min":0.94299999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.67800000000000005},"min":{"1min":0.53500000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89600000000000002,"5min":1.0900000000000001,"15min":1.169},"last":0.44900000000000001}]},{"osd":7,"last update":"Wed Nov 15 01:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69199999999999995,"15min":0.67400000000000004},"min":{"1min":0.52600000000000002,"5min":0.48399999999999999,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":1.071,"15min":1.071},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.70599999999999996,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.97299999999999998,"5min":1.1319999999999999,"15min":1.1459999999999999},"last":0.45500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":729088,"data_stored":353142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.55000000000000004},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.88,"15min":0.88},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.74399999999999999,"15min":0.78800000000000003},"last":0.41899999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57999999999999996,"15min":0.56499999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":0.77500000000000002,"5min":1.087,"15min":1.087},"last":0.63},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.80400000000000005,"15min":0.81000000000000005},"last":0.56599999999999995}]},{"osd":2,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":0.70899999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58199999999999996,"15min":0.58299999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47699999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70099999999999996,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.749,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.58799999999999997}]},{"osd":5,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.47599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.30399999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.80600000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47499999999999998,"15min":0.501},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":0.68000000000000005,"15min":0.85299999999999998},"last":0.46200000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47199999999999998,"15min":0.50700000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.84199999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.51100000000000001,"15min":0.54100000000000004},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":0.66500000000000004,"5min":0.77600000000000002,"15min":0.83199999999999996},"last":0.53000000000000003}]},{"osd":7,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.50800000000000001,"15min":0.53600000000000003},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64300000000000002,"5min":0.873,"15min":0.873},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54800000000000004,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":0.74099999999999999,"5min":0.78400000000000003,"15min":0.90100000000000002},"last":0.71899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574999,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301904,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069936,"statfs":{"total":96636764160,"available":96327614464,"internally_reserved":0,"allocated":729088,"data_stored":353480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72999999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.36199999999999999},"max":{"1min":0.68300000000000005,"5min":0.74199999999999999,"15min":0.81200000000000006},"last":0.54500000000000004}]},{"osd":1,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.62}]},{"osd":2,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.318},"max":{"1min":0.64400000000000002,"5min":0.72499999999999998,"15min":0.86199999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.34999999999999998},"max":{"1min":0.75600000000000001,"5min":0.77700000000000002,"15min":1.103},"last":0.65700000000000003}]},{"osd":3,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75,"5min":0.75800000000000001,"15min":0.78100000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.438,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1.127},"last":0.755}]},{"osd":4,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.47599999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64400000000000002,"5min":0.70699999999999996,"15min":0.94399999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67800000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.67800000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47699999999999998,"15min":0.497},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":1.0660000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.497,"5min":0.496,"15min":0.51800000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.70799999999999996}]},{"osd":7,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.499,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.68999999999999995,"5min":0.73599999999999999,"15min":0.97199999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":1.1499999999999999},"last":0.85799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:34:05.370 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:34:05.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.502+0000 7fb1a08fa700 1 Processor -- start 2023-11-15T01:34:05.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.502+0000 7fb1a08fa700 1 -- start start 2023-11-15T01:34:05.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb1a08fa700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb19c154150 0x7fb19c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:05.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb1a08fa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb19c0ab1a0 0x7fb19c158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:05.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb1a08fa700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb19c0aa060 0x7fb19c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:05.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb1a08fa700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19c0c06f0 con 0x7fb19c0aa060 2023-11-15T01:34:05.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb1a08fa700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19c0c09d0 con 0x7fb19c154150 2023-11-15T01:34:05.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb1a08fa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c158820 con 0x7fb19c0ab1a0 2023-11-15T01:34:05.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb19ad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb19c0aa060 0x7fb19c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:05.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb19ad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb19c0aa060 0x7fb19c0c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50250/0 (socket says 172.21.15.1:50250) 2023-11-15T01:34:05.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb19ad9d700 1 -- 172.21.15.1:0/1790077421 learned_addr learned my addr 172.21.15.1:0/1790077421 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:05.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb199d9b700 1 --2- 172.21.15.1:0/1790077421 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb19c0ab1a0 0x7fb19c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:05.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb19a59c700 1 --2- 172.21.15.1:0/1790077421 >> v2:172.21.15.141:3300/0 conn(0x7fb19c154150 0x7fb19c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:05.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb19ad9d700 1 -- 172.21.15.1:0/1790077421 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb19c0ab1a0 msgr2=0x7fb19c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:05.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb19ad9d700 1 --2- 172.21.15.1:0/1790077421 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb19c0ab1a0 0x7fb19c158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb19ad9d700 1 -- 172.21.15.1:0/1790077421 >> v2:172.21.15.141:3300/0 conn(0x7fb19c154150 msgr2=0x7fb19c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:05.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb19ad9d700 1 --2- 172.21.15.1:0/1790077421 >> v2:172.21.15.141:3300/0 conn(0x7fb19c154150 0x7fb19c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb19ad9d700 1 -- 172.21.15.1:0/1790077421 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c158b00 con 0x7fb19c0aa060 2023-11-15T01:34:05.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.503+0000 7fb19ad9d700 1 --2- 172.21.15.1:0/1790077421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb19c0aa060 0x7fb19c0c5f10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fb19c06bfb0 tx=0x7fb194009840).ready entity=mon.0 client_cookie=8605dac93ca86e1e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:05.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.504+0000 7fb19959a700 1 -- 172.21.15.1:0/1790077421 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19400e070 con 0x7fb19c0aa060 2023-11-15T01:34:05.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.504+0000 7fb19959a700 1 -- 172.21.15.1:0/1790077421 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19400ba50 con 0x7fb19c0aa060 2023-11-15T01:34:05.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.504+0000 7fb19959a700 1 -- 172.21.15.1:0/1790077421 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19400bdd0 con 0x7fb19c0aa060 2023-11-15T01:34:05.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.504+0000 7fb1a08fa700 1 -- 172.21.15.1:0/1790077421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb19c0aa060 msgr2=0x7fb19c0c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:05.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.504+0000 7fb1a08fa700 1 --2- 172.21.15.1:0/1790077421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb19c0aa060 0x7fb19c0c5f10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fb19c06bfb0 tx=0x7fb194009840).stop 2023-11-15T01:34:05.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.504+0000 7fb1a08fa700 1 -- 172.21.15.1:0/1790077421 shutdown_connections 2023-11-15T01:34:05.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.504+0000 7fb1a08fa700 1 --2- 172.21.15.1:0/1790077421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb19c0aa060 0x7fb19c0c5f10 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.504+0000 7fb1a08fa700 1 --2- 172.21.15.1:0/1790077421 >> v2:172.21.15.141:3300/0 conn(0x7fb19c154150 0x7fb19c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.504+0000 7fb1a08fa700 1 --2- 172.21.15.1:0/1790077421 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb19c0ab1a0 0x7fb19c158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.504+0000 7fb1a08fa700 1 -- 172.21.15.1:0/1790077421 >> 172.21.15.1:0/1790077421 conn(0x7fb19c064aa0 msgr2=0x7fb19c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:05.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.504+0000 7fb1a08fa700 1 -- 172.21.15.1:0/1790077421 shutdown_connections 2023-11-15T01:34:05.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.504+0000 7fb1a08fa700 1 -- 172.21.15.1:0/1790077421 wait complete. 2023-11-15T01:34:05.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.505+0000 7fb1a08fa700 1 Processor -- start 2023-11-15T01:34:05.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.505+0000 7fb1a08fa700 1 -- start start 2023-11-15T01:34:05.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.506+0000 7fb1a08fa700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb19c0aa060 0x7fb19c156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:05.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.506+0000 7fb1a08fa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb19c0ab1a0 0x7fb19c164f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:05.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.506+0000 7fb1a08fa700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb19c154150 0x7fb19c163d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:05.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.506+0000 7fb1a08fa700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c14a410 con 0x7fb19c154150 2023-11-15T01:34:05.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.506+0000 7fb1a08fa700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c155060 con 0x7fb19c0aa060 2023-11-15T01:34:05.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.506+0000 7fb1a08fa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c164dd0 con 0x7fb19c0ab1a0 2023-11-15T01:34:05.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.506+0000 7fb19ad9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb19c154150 0x7fb19c163d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:05.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.506+0000 7fb19ad9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb19c154150 0x7fb19c163d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50260/0 (socket says 172.21.15.1:50260) 2023-11-15T01:34:05.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.506+0000 7fb19ad9d700 1 -- 172.21.15.1:0/748531277 learned_addr learned my addr 172.21.15.1:0/748531277 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:05.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.506+0000 7fb19a59c700 1 --2- 172.21.15.1:0/748531277 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb19c0aa060 0x7fb19c156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:05.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.506+0000 7fb199d9b700 1 --2- 172.21.15.1:0/748531277 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb19c0ab1a0 0x7fb19c164f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:05.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.507+0000 7fb19ad9d700 1 -- 172.21.15.1:0/748531277 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb19c0ab1a0 msgr2=0x7fb19c164f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:05.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.507+0000 7fb19ad9d700 1 --2- 172.21.15.1:0/748531277 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb19c0ab1a0 0x7fb19c164f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.507+0000 7fb19ad9d700 1 -- 172.21.15.1:0/748531277 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb19c0aa060 msgr2=0x7fb19c156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:05.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.507+0000 7fb19ad9d700 1 --2- 172.21.15.1:0/748531277 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb19c0aa060 0x7fb19c156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.507+0000 7fb19ad9d700 1 -- 172.21.15.1:0/748531277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb194009ae0 con 0x7fb19c154150 2023-11-15T01:34:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.507+0000 7fb19ad9d700 1 --2- 172.21.15.1:0/748531277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb19c154150 0x7fb19c163d70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fb19c062af0 tx=0x7fb194009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.507+0000 7fb18a7fc700 1 -- 172.21.15.1:0/748531277 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1940092e0 con 0x7fb19c154150 2023-11-15T01:34:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.507+0000 7fb18a7fc700 1 -- 172.21.15.1:0/748531277 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb194007080 con 0x7fb19c154150 2023-11-15T01:34:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.507+0000 7fb1a08fa700 1 -- 172.21.15.1:0/748531277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19c164810 con 0x7fb19c154150 2023-11-15T01:34:05.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.507+0000 7fb18a7fc700 1 -- 172.21.15.1:0/748531277 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19401e6a0 con 0x7fb19c154150 2023-11-15T01:34:05.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.507+0000 7fb1a08fa700 1 -- 172.21.15.1:0/748531277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19c154c80 con 0x7fb19c154150 2023-11-15T01:34:05.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.508+0000 7fb1a08fa700 1 -- 172.21.15.1:0/748531277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19c154ae0 con 0x7fb19c154150 2023-11-15T01:34:05.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.508+0000 7fb18a7fc700 1 -- 172.21.15.1:0/748531277 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb194003040 con 0x7fb19c154150 2023-11-15T01:34:05.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.509+0000 7fb18a7fc700 1 --2- 172.21.15.1:0/748531277 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb17c05f270 0x7fb17c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:05.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.509+0000 7fb18a7fc700 1 -- 172.21.15.1:0/748531277 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7fb19407ba30 con 0x7fb19c154150 2023-11-15T01:34:05.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.509+0000 7fb19a59c700 1 --2- 172.21.15.1:0/748531277 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb17c05f270 0x7fb17c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:05.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.509+0000 7fb19a59c700 1 --2- 172.21.15.1:0/748531277 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb17c05f270 0x7fb17c061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb18c00bb10 tx=0x7fb18c008040).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:05.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.513+0000 7fb18a7fc700 1 -- 172.21.15.1:0/748531277 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb19c154ae0 con 0x7fb19c154150 2023-11-15T01:34:05.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.682+0000 7fb1a08fa700 1 -- 172.21.15.1:0/748531277 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb19c154ae0 con 0x7fb17c05f270 2023-11-15T01:34:05.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.692+0000 7fb18a7fc700 1 -- 172.21.15.1:0/748531277 <== mgr.5248 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360999 (secure 0 0 0) 0x7fb19c154ae0 con 0x7fb17c05f270 2023-11-15T01:34:05.698 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:34:05.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.695+0000 7fb1a08fa700 1 -- 172.21.15.1:0/748531277 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb17c05f270 msgr2=0x7fb17c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:05.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.695+0000 7fb1a08fa700 1 --2- 172.21.15.1:0/748531277 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb17c05f270 0x7fb17c061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb18c00bb10 tx=0x7fb18c008040).stop 2023-11-15T01:34:05.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.695+0000 7fb1a08fa700 1 -- 172.21.15.1:0/748531277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb19c154150 msgr2=0x7fb19c163d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:05.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.695+0000 7fb1a08fa700 1 --2- 172.21.15.1:0/748531277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb19c154150 0x7fb19c163d70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fb19c062af0 tx=0x7fb194009840).stop 2023-11-15T01:34:05.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.695+0000 7fb1a08fa700 1 -- 172.21.15.1:0/748531277 shutdown_connections 2023-11-15T01:34:05.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.695+0000 7fb1a08fa700 1 --2- 172.21.15.1:0/748531277 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb17c05f270 0x7fb17c061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.695+0000 7fb1a08fa700 1 --2- 172.21.15.1:0/748531277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb19c154150 0x7fb19c163d70 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.695+0000 7fb1a08fa700 1 --2- 172.21.15.1:0/748531277 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb19c0aa060 0x7fb19c156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.695+0000 7fb1a08fa700 1 --2- 172.21.15.1:0/748531277 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb19c0ab1a0 0x7fb19c164f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.695+0000 7fb1a08fa700 1 -- 172.21.15.1:0/748531277 >> 172.21.15.1:0/748531277 conn(0x7fb19c064aa0 msgr2=0x7fb19c158070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:05.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.695+0000 7fb1a08fa700 1 -- 172.21.15.1:0/748531277 shutdown_connections 2023-11-15T01:34:05.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.695+0000 7fb1a08fa700 1 -- 172.21.15.1:0/748531277 wait complete. 2023-11-15T01:34:05.704 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:34:05.708 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-11-15T01:34:05.416650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419360,"kb_used_data":5728,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752555360,"statfs":{"total":773094113280,"available":770616688640,"internally_reserved":0,"allocated":5865472,"data_stored":2825316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14985745,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-694,"num_write_kb":-15534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.005411"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870192+0000","last_change":"2023-11-15T01:33:56.864024+0000","last_active":"2023-11-15T01:33:56.870192+0000","last_peered":"2023-11-15T01:33:56.870192+0000","last_clean":"2023-11-15T01:33:56.870192+0000","last_became_active":"2023-11-15T01:33:56.863711+0000","last_became_peered":"2023-11-15T01:33:56.863711+0000","last_unstale":"2023-11-15T01:33:56.870192+0000","last_undegraded":"2023-11-15T01:33:56.870192+0000","last_fullsized":"2023-11-15T01:33:56.870192+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"60'3","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874959+0000","last_change":"2023-11-15T01:33:56.471513+0000","last_active":"2023-11-15T01:33:56.874959+0000","last_peered":"2023-11-15T01:33:56.874959+0000","last_clean":"2023-11-15T01:33:56.874959+0000","last_became_active":"2023-11-15T01:33:56.471228+0000","last_became_peered":"2023-11-15T01:33:56.471228+0000","last_unstale":"2023-11-15T01:33:56.874959+0000","last_undegraded":"2023-11-15T01:33:56.874959+0000","last_fullsized":"2023-11-15T01:33:56.874959+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879382+0000","last_change":"2023-11-15T01:33:56.874430+0000","last_active":"2023-11-15T01:33:56.879382+0000","last_peered":"2023-11-15T01:33:56.879382+0000","last_clean":"2023-11-15T01:33:56.879382+0000","last_became_active":"2023-11-15T01:33:56.874133+0000","last_became_peered":"2023-11-15T01:33:56.874133+0000","last_unstale":"2023-11-15T01:33:56.879382+0000","last_undegraded":"2023-11-15T01:33:56.879382+0000","last_fullsized":"2023-11-15T01:33:56.879382+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.857602+0000","last_change":"2023-11-15T01:33:56.472997+0000","last_active":"2023-11-15T01:33:56.857602+0000","last_peered":"2023-11-15T01:33:56.857602+0000","last_clean":"2023-11-15T01:33:56.857602+0000","last_became_active":"2023-11-15T01:33:56.472655+0000","last_became_peered":"2023-11-15T01:33:56.472655+0000","last_unstale":"2023-11-15T01:33:56.857602+0000","last_undegraded":"2023-11-15T01:33:56.857602+0000","last_fullsized":"2023-11-15T01:33:56.857602+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874788+0000","last_change":"2023-11-15T01:33:56.871248+0000","last_active":"2023-11-15T01:33:56.874788+0000","last_peered":"2023-11-15T01:33:56.874788+0000","last_clean":"2023-11-15T01:33:56.874788+0000","last_became_active":"2023-11-15T01:33:56.870962+0000","last_became_peered":"2023-11-15T01:33:56.870962+0000","last_unstale":"2023-11-15T01:33:56.874788+0000","last_undegraded":"2023-11-15T01:33:56.874788+0000","last_fullsized":"2023-11-15T01:33:56.874788+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860652+0000","last_change":"2023-11-15T01:33:56.458291+0000","last_active":"2023-11-15T01:33:56.860652+0000","last_peered":"2023-11-15T01:33:56.860652+0000","last_clean":"2023-11-15T01:33:56.860652+0000","last_became_active":"2023-11-15T01:33:56.457983+0000","last_became_peered":"2023-11-15T01:33:56.457983+0000","last_unstale":"2023-11-15T01:33:56.860652+0000","last_undegraded":"2023-11-15T01:33:56.860652+0000","last_fullsized":"2023-11-15T01:33:56.860652+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876723+0000","last_change":"2023-11-15T01:33:56.870812+0000","last_active":"2023-11-15T01:33:56.876723+0000","last_peered":"2023-11-15T01:33:56.876723+0000","last_clean":"2023-11-15T01:33:56.876723+0000","last_became_active":"2023-11-15T01:33:56.870496+0000","last_became_peered":"2023-11-15T01:33:56.870496+0000","last_unstale":"2023-11-15T01:33:56.876723+0000","last_undegraded":"2023-11-15T01:33:56.876723+0000","last_fullsized":"2023-11-15T01:33:56.876723+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873367+0000","last_change":"2023-11-15T01:33:56.463682+0000","last_active":"2023-11-15T01:33:56.873367+0000","last_peered":"2023-11-15T01:33:56.873367+0000","last_clean":"2023-11-15T01:33:56.873367+0000","last_became_active":"2023-11-15T01:33:56.462962+0000","last_became_peered":"2023-11-15T01:33:56.462962+0000","last_unstale":"2023-11-15T01:33:56.873367+0000","last_undegraded":"2023-11-15T01:33:56.873367+0000","last_fullsized":"2023-11-15T01:33:56.873367+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.871536+0000","last_change":"2023-11-15T01:33:56.860607+0000","last_active":"2023-11-15T01:33:56.871536+0000","last_peered":"2023-11-15T01:33:56.871536+0000","last_clean":"2023-11-15T01:33:56.871536+0000","last_became_active":"2023-11-15T01:33:56.860324+0000","last_became_peered":"2023-11-15T01:33:56.860324+0000","last_unstale":"2023-11-15T01:33:56.871536+0000","last_undegraded":"2023-11-15T01:33:56.871536+0000","last_fullsized":"2023-11-15T01:33:56.871536+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869320+0000","last_change":"2023-11-15T01:33:56.473582+0000","last_active":"2023-11-15T01:33:56.869320+0000","last_peered":"2023-11-15T01:33:56.869320+0000","last_clean":"2023-11-15T01:33:56.869320+0000","last_became_active":"2023-11-15T01:33:56.473318+0000","last_became_peered":"2023-11-15T01:33:56.473318+0000","last_unstale":"2023-11-15T01:33:56.869320+0000","last_undegraded":"2023-11-15T01:33:56.869320+0000","last_fullsized":"2023-11-15T01:33:56.869320+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.871676+0000","last_change":"2023-11-15T01:33:56.867922+0000","last_active":"2023-11-15T01:33:56.871676+0000","last_peered":"2023-11-15T01:33:56.871676+0000","last_clean":"2023-11-15T01:33:56.871676+0000","last_became_active":"2023-11-15T01:33:56.867634+0000","last_became_peered":"2023-11-15T01:33:56.867634+0000","last_unstale":"2023-11-15T01:33:56.871676+0000","last_undegraded":"2023-11-15T01:33:56.871676+0000","last_fullsized":"2023-11-15T01:33:56.871676+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875287+0000","last_change":"2023-11-15T01:33:56.474361+0000","last_active":"2023-11-15T01:33:56.875287+0000","last_peered":"2023-11-15T01:33:56.875287+0000","last_clean":"2023-11-15T01:33:56.875287+0000","last_became_active":"2023-11-15T01:33:56.473650+0000","last_became_peered":"2023-11-15T01:33:56.473650+0000","last_unstale":"2023-11-15T01:33:56.875287+0000","last_undegraded":"2023-11-15T01:33:56.875287+0000","last_fullsized":"2023-11-15T01:33:56.875287+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.872019+0000","last_change":"2023-11-15T01:33:56.865614+0000","last_active":"2023-11-15T01:33:56.872019+0000","last_peered":"2023-11-15T01:33:56.872019+0000","last_clean":"2023-11-15T01:33:56.872019+0000","last_became_active":"2023-11-15T01:33:56.863615+0000","last_became_peered":"2023-11-15T01:33:56.863615+0000","last_unstale":"2023-11-15T01:33:56.872019+0000","last_undegraded":"2023-11-15T01:33:56.872019+0000","last_fullsized":"2023-11-15T01:33:56.872019+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.864948+0000","last_change":"2023-11-15T01:33:56.476363+0000","last_active":"2023-11-15T01:33:56.864948+0000","last_peered":"2023-11-15T01:33:56.864948+0000","last_clean":"2023-11-15T01:33:56.864948+0000","last_became_active":"2023-11-15T01:33:56.476127+0000","last_became_peered":"2023-11-15T01:33:56.476127+0000","last_unstale":"2023-11-15T01:33:56.864948+0000","last_undegraded":"2023-11-15T01:33:56.864948+0000","last_fullsized":"2023-11-15T01:33:56.864948+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876605+0000","last_change":"2023-11-15T01:33:56.873376+0000","last_active":"2023-11-15T01:33:56.876605+0000","last_peered":"2023-11-15T01:33:56.876605+0000","last_clean":"2023-11-15T01:33:56.876605+0000","last_became_active":"2023-11-15T01:33:56.869197+0000","last_became_peered":"2023-11-15T01:33:56.869197+0000","last_unstale":"2023-11-15T01:33:56.876605+0000","last_undegraded":"2023-11-15T01:33:56.876605+0000","last_fullsized":"2023-11-15T01:33:56.876605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859475+0000","last_change":"2023-11-15T01:33:56.464147+0000","last_active":"2023-11-15T01:33:56.859475+0000","last_peered":"2023-11-15T01:33:56.859475+0000","last_clean":"2023-11-15T01:33:56.859475+0000","last_became_active":"2023-11-15T01:33:56.463540+0000","last_became_peered":"2023-11-15T01:33:56.463540+0000","last_unstale":"2023-11-15T01:33:56.859475+0000","last_undegraded":"2023-11-15T01:33:56.859475+0000","last_fullsized":"2023-11-15T01:33:56.859475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876546+0000","last_change":"2023-11-15T01:33:56.873610+0000","last_active":"2023-11-15T01:33:56.876546+0000","last_peered":"2023-11-15T01:33:56.876546+0000","last_clean":"2023-11-15T01:33:56.876546+0000","last_became_active":"2023-11-15T01:33:56.869058+0000","last_became_peered":"2023-11-15T01:33:56.869058+0000","last_unstale":"2023-11-15T01:33:56.876546+0000","last_undegraded":"2023-11-15T01:33:56.876546+0000","last_fullsized":"2023-11-15T01:33:56.876546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.862508+0000","last_change":"2023-11-15T01:33:56.478563+0000","last_active":"2023-11-15T01:33:56.862508+0000","last_peered":"2023-11-15T01:33:56.862508+0000","last_clean":"2023-11-15T01:33:56.862508+0000","last_became_active":"2023-11-15T01:33:56.478308+0000","last_became_peered":"2023-11-15T01:33:56.478308+0000","last_unstale":"2023-11-15T01:33:56.862508+0000","last_undegraded":"2023-11-15T01:33:56.862508+0000","last_fullsized":"2023-11-15T01:33:56.862508+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874632+0000","last_change":"2023-11-15T01:33:56.868848+0000","last_active":"2023-11-15T01:33:56.874632+0000","last_peered":"2023-11-15T01:33:56.874632+0000","last_clean":"2023-11-15T01:33:56.874632+0000","last_became_active":"2023-11-15T01:33:56.868579+0000","last_became_peered":"2023-11-15T01:33:56.868579+0000","last_unstale":"2023-11-15T01:33:56.874632+0000","last_undegraded":"2023-11-15T01:33:56.874632+0000","last_fullsized":"2023-11-15T01:33:56.874632+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860542+0000","last_change":"2023-11-15T01:33:56.464310+0000","last_active":"2023-11-15T01:33:56.860542+0000","last_peered":"2023-11-15T01:33:56.860542+0000","last_clean":"2023-11-15T01:33:56.860542+0000","last_became_active":"2023-11-15T01:33:56.462305+0000","last_became_peered":"2023-11-15T01:33:56.462305+0000","last_unstale":"2023-11-15T01:33:56.860542+0000","last_undegraded":"2023-11-15T01:33:56.860542+0000","last_fullsized":"2023-11-15T01:33:56.860542+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.878535+0000","last_change":"2023-11-15T01:33:56.877038+0000","last_active":"2023-11-15T01:33:56.878535+0000","last_peered":"2023-11-15T01:33:56.878535+0000","last_clean":"2023-11-15T01:33:56.878535+0000","last_became_active":"2023-11-15T01:33:56.876699+0000","last_became_peered":"2023-11-15T01:33:56.876699+0000","last_unstale":"2023-11-15T01:33:56.878535+0000","last_undegraded":"2023-11-15T01:33:56.878535+0000","last_fullsized":"2023-11-15T01:33:56.878535+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861447+0000","last_change":"2023-11-15T01:33:56.478453+0000","last_active":"2023-11-15T01:33:56.861447+0000","last_peered":"2023-11-15T01:33:56.861447+0000","last_clean":"2023-11-15T01:33:56.861447+0000","last_became_active":"2023-11-15T01:33:56.478179+0000","last_became_peered":"2023-11-15T01:33:56.478179+0000","last_unstale":"2023-11-15T01:33:56.861447+0000","last_undegraded":"2023-11-15T01:33:56.861447+0000","last_fullsized":"2023-11-15T01:33:56.861447+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869347+0000","last_change":"2023-11-15T01:33:56.866129+0000","last_active":"2023-11-15T01:33:56.869347+0000","last_peered":"2023-11-15T01:33:56.869347+0000","last_clean":"2023-11-15T01:33:56.869347+0000","last_became_active":"2023-11-15T01:33:56.865835+0000","last_became_peered":"2023-11-15T01:33:56.865835+0000","last_unstale":"2023-11-15T01:33:56.869347+0000","last_undegraded":"2023-11-15T01:33:56.869347+0000","last_fullsized":"2023-11-15T01:33:56.869347+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877778+0000","last_change":"2023-11-15T01:33:56.468313+0000","last_active":"2023-11-15T01:33:56.877778+0000","last_peered":"2023-11-15T01:33:56.877778+0000","last_clean":"2023-11-15T01:33:56.877778+0000","last_became_active":"2023-11-15T01:33:56.467994+0000","last_became_peered":"2023-11-15T01:33:56.467994+0000","last_unstale":"2023-11-15T01:33:56.877778+0000","last_undegraded":"2023-11-15T01:33:56.877778+0000","last_fullsized":"2023-11-15T01:33:56.877778+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.881930+0000","last_change":"2023-11-15T01:33:56.878365+0000","last_active":"2023-11-15T01:33:56.881930+0000","last_peered":"2023-11-15T01:33:56.881930+0000","last_clean":"2023-11-15T01:33:56.881930+0000","last_became_active":"2023-11-15T01:33:56.878049+0000","last_became_peered":"2023-11-15T01:33:56.878049+0000","last_unstale":"2023-11-15T01:33:56.881930+0000","last_undegraded":"2023-11-15T01:33:56.881930+0000","last_fullsized":"2023-11-15T01:33:56.881930+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875001+0000","last_change":"2023-11-15T01:33:56.482375+0000","last_active":"2023-11-15T01:33:56.875001+0000","last_peered":"2023-11-15T01:33:56.875001+0000","last_clean":"2023-11-15T01:33:56.875001+0000","last_became_active":"2023-11-15T01:33:56.481858+0000","last_became_peered":"2023-11-15T01:33:56.481858+0000","last_unstale":"2023-11-15T01:33:56.875001+0000","last_undegraded":"2023-11-15T01:33:56.875001+0000","last_fullsized":"2023-11-15T01:33:56.875001+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874619+0000","last_change":"2023-11-15T01:33:56.871814+0000","last_active":"2023-11-15T01:33:56.874619+0000","last_peered":"2023-11-15T01:33:56.874619+0000","last_clean":"2023-11-15T01:33:56.874619+0000","last_became_active":"2023-11-15T01:33:56.871595+0000","last_became_peered":"2023-11-15T01:33:56.871595+0000","last_unstale":"2023-11-15T01:33:56.874619+0000","last_undegraded":"2023-11-15T01:33:56.874619+0000","last_fullsized":"2023-11-15T01:33:56.874619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861088+0000","last_change":"2023-11-15T01:33:56.481949+0000","last_active":"2023-11-15T01:33:56.861088+0000","last_peered":"2023-11-15T01:33:56.861088+0000","last_clean":"2023-11-15T01:33:56.861088+0000","last_became_active":"2023-11-15T01:33:56.481665+0000","last_became_peered":"2023-11-15T01:33:56.481665+0000","last_unstale":"2023-11-15T01:33:56.861088+0000","last_undegraded":"2023-11-15T01:33:56.861088+0000","last_fullsized":"2023-11-15T01:33:56.861088+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879524+0000","last_change":"2023-11-15T01:33:56.875960+0000","last_active":"2023-11-15T01:33:56.879524+0000","last_peered":"2023-11-15T01:33:56.879524+0000","last_clean":"2023-11-15T01:33:56.879524+0000","last_became_active":"2023-11-15T01:33:56.875475+0000","last_became_peered":"2023-11-15T01:33:56.875475+0000","last_unstale":"2023-11-15T01:33:56.879524+0000","last_undegraded":"2023-11-15T01:33:56.879524+0000","last_fullsized":"2023-11-15T01:33:56.879524+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851271+0000","last_change":"2023-11-15T01:33:56.470153+0000","last_active":"2023-11-15T01:33:56.851271+0000","last_peered":"2023-11-15T01:33:56.851271+0000","last_clean":"2023-11-15T01:33:56.851271+0000","last_became_active":"2023-11-15T01:33:56.469808+0000","last_became_peered":"2023-11-15T01:33:56.469808+0000","last_unstale":"2023-11-15T01:33:56.851271+0000","last_undegraded":"2023-11-15T01:33:56.851271+0000","last_fullsized":"2023-11-15T01:33:56.851271+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873830+0000","last_change":"2023-11-15T01:33:56.870218+0000","last_active":"2023-11-15T01:33:56.873830+0000","last_peered":"2023-11-15T01:33:56.873830+0000","last_clean":"2023-11-15T01:33:56.873830+0000","last_became_active":"2023-11-15T01:33:56.869901+0000","last_became_peered":"2023-11-15T01:33:56.869901+0000","last_unstale":"2023-11-15T01:33:56.873830+0000","last_undegraded":"2023-11-15T01:33:56.873830+0000","last_fullsized":"2023-11-15T01:33:56.873830+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879211+0000","last_change":"2023-11-15T01:33:56.478588+0000","last_active":"2023-11-15T01:33:56.879211+0000","last_peered":"2023-11-15T01:33:56.879211+0000","last_clean":"2023-11-15T01:33:56.879211+0000","last_became_active":"2023-11-15T01:33:56.478375+0000","last_became_peered":"2023-11-15T01:33:56.478375+0000","last_unstale":"2023-11-15T01:33:56.879211+0000","last_undegraded":"2023-11-15T01:33:56.879211+0000","last_fullsized":"2023-11-15T01:33:56.879211+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876152+0000","last_change":"2023-11-15T01:33:56.874699+0000","last_active":"2023-11-15T01:33:56.876152+0000","last_peered":"2023-11-15T01:33:56.876152+0000","last_clean":"2023-11-15T01:33:56.876152+0000","last_became_active":"2023-11-15T01:33:56.874306+0000","last_became_peered":"2023-11-15T01:33:56.874306+0000","last_unstale":"2023-11-15T01:33:56.876152+0000","last_undegraded":"2023-11-15T01:33:56.876152+0000","last_fullsized":"2023-11-15T01:33:56.876152+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860716+0000","last_change":"2023-11-15T01:33:56.459940+0000","last_active":"2023-11-15T01:33:56.860716+0000","last_peered":"2023-11-15T01:33:56.860716+0000","last_clean":"2023-11-15T01:33:56.860716+0000","last_became_active":"2023-11-15T01:33:56.459677+0000","last_became_peered":"2023-11-15T01:33:56.459677+0000","last_unstale":"2023-11-15T01:33:56.860716+0000","last_undegraded":"2023-11-15T01:33:56.860716+0000","last_fullsized":"2023-11-15T01:33:56.860716+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868562+0000","last_change":"2023-11-15T01:33:56.864069+0000","last_active":"2023-11-15T01:33:56.868562+0000","last_peered":"2023-11-15T01:33:56.868562+0000","last_clean":"2023-11-15T01:33:56.868562+0000","last_became_active":"2023-11-15T01:33:56.863785+0000","last_became_peered":"2023-11-15T01:33:56.863785+0000","last_unstale":"2023-11-15T01:33:56.868562+0000","last_undegraded":"2023-11-15T01:33:56.868562+0000","last_fullsized":"2023-11-15T01:33:56.868562+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860584+0000","last_change":"2023-11-15T01:33:56.470046+0000","last_active":"2023-11-15T01:33:56.860584+0000","last_peered":"2023-11-15T01:33:56.860584+0000","last_clean":"2023-11-15T01:33:56.860584+0000","last_became_active":"2023-11-15T01:33:56.469771+0000","last_became_peered":"2023-11-15T01:33:56.469771+0000","last_unstale":"2023-11-15T01:33:56.860584+0000","last_undegraded":"2023-11-15T01:33:56.860584+0000","last_fullsized":"2023-11-15T01:33:56.860584+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879425+0000","last_change":"2023-11-15T01:33:56.874927+0000","last_active":"2023-11-15T01:33:56.879425+0000","last_peered":"2023-11-15T01:33:56.879425+0000","last_clean":"2023-11-15T01:33:56.879425+0000","last_became_active":"2023-11-15T01:33:56.874683+0000","last_became_peered":"2023-11-15T01:33:56.874683+0000","last_unstale":"2023-11-15T01:33:56.879425+0000","last_undegraded":"2023-11-15T01:33:56.879425+0000","last_fullsized":"2023-11-15T01:33:56.879425+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.878673+0000","last_change":"2023-11-15T01:33:56.470434+0000","last_active":"2023-11-15T01:33:56.878673+0000","last_peered":"2023-11-15T01:33:56.878673+0000","last_clean":"2023-11-15T01:33:56.878673+0000","last_became_active":"2023-11-15T01:33:56.470134+0000","last_became_peered":"2023-11-15T01:33:56.470134+0000","last_unstale":"2023-11-15T01:33:56.878673+0000","last_undegraded":"2023-11-15T01:33:56.878673+0000","last_fullsized":"2023-11-15T01:33:56.878673+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874463+0000","last_change":"2023-11-15T01:33:56.867683+0000","last_active":"2023-11-15T01:33:56.874463+0000","last_peered":"2023-11-15T01:33:56.874463+0000","last_clean":"2023-11-15T01:33:56.874463+0000","last_became_active":"2023-11-15T01:33:56.867411+0000","last_became_peered":"2023-11-15T01:33:56.867411+0000","last_unstale":"2023-11-15T01:33:56.874463+0000","last_undegraded":"2023-11-15T01:33:56.874463+0000","last_fullsized":"2023-11-15T01:33:56.874463+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861967+0000","last_change":"2023-11-15T01:33:56.471011+0000","last_active":"2023-11-15T01:33:56.861967+0000","last_peered":"2023-11-15T01:33:56.861967+0000","last_clean":"2023-11-15T01:33:56.861967+0000","last_became_active":"2023-11-15T01:33:56.470697+0000","last_became_peered":"2023-11-15T01:33:56.470697+0000","last_unstale":"2023-11-15T01:33:56.861967+0000","last_undegraded":"2023-11-15T01:33:56.861967+0000","last_fullsized":"2023-11-15T01:33:56.861967+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879469+0000","last_change":"2023-11-15T01:33:56.876575+0000","last_active":"2023-11-15T01:33:56.879469+0000","last_peered":"2023-11-15T01:33:56.879469+0000","last_clean":"2023-11-15T01:33:56.879469+0000","last_became_active":"2023-11-15T01:33:56.876274+0000","last_became_peered":"2023-11-15T01:33:56.876274+0000","last_unstale":"2023-11-15T01:33:56.879469+0000","last_undegraded":"2023-11-15T01:33:56.879469+0000","last_fullsized":"2023-11-15T01:33:56.879469+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873817+0000","last_change":"2023-11-15T01:33:56.475311+0000","last_active":"2023-11-15T01:33:56.873817+0000","last_peered":"2023-11-15T01:33:56.873817+0000","last_clean":"2023-11-15T01:33:56.873817+0000","last_became_active":"2023-11-15T01:33:56.475060+0000","last_became_peered":"2023-11-15T01:33:56.475060+0000","last_unstale":"2023-11-15T01:33:56.873817+0000","last_undegraded":"2023-11-15T01:33:56.873817+0000","last_fullsized":"2023-11-15T01:33:56.873817+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877902+0000","last_change":"2023-11-15T01:33:56.872904+0000","last_active":"2023-11-15T01:33:56.877902+0000","last_peered":"2023-11-15T01:33:56.877902+0000","last_clean":"2023-11-15T01:33:56.877902+0000","last_became_active":"2023-11-15T01:33:56.872620+0000","last_became_peered":"2023-11-15T01:33:56.872620+0000","last_unstale":"2023-11-15T01:33:56.877902+0000","last_undegraded":"2023-11-15T01:33:56.877902+0000","last_fullsized":"2023-11-15T01:33:56.877902+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860992+0000","last_change":"2023-11-15T01:33:56.464027+0000","last_active":"2023-11-15T01:33:56.860992+0000","last_peered":"2023-11-15T01:33:56.860992+0000","last_clean":"2023-11-15T01:33:56.860992+0000","last_became_active":"2023-11-15T01:33:56.463227+0000","last_became_peered":"2023-11-15T01:33:56.463227+0000","last_unstale":"2023-11-15T01:33:56.860992+0000","last_undegraded":"2023-11-15T01:33:56.860992+0000","last_fullsized":"2023-11-15T01:33:56.860992+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875574+0000","last_change":"2023-11-15T01:33:56.872932+0000","last_active":"2023-11-15T01:33:56.875574+0000","last_peered":"2023-11-15T01:33:56.875574+0000","last_clean":"2023-11-15T01:33:56.875574+0000","last_became_active":"2023-11-15T01:33:56.872658+0000","last_became_peered":"2023-11-15T01:33:56.872658+0000","last_unstale":"2023-11-15T01:33:56.875574+0000","last_undegraded":"2023-11-15T01:33:56.875574+0000","last_fullsized":"2023-11-15T01:33:56.875574+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858111+0000","last_change":"2023-11-15T01:33:56.469707+0000","last_active":"2023-11-15T01:33:56.858111+0000","last_peered":"2023-11-15T01:33:56.858111+0000","last_clean":"2023-11-15T01:33:56.858111+0000","last_became_active":"2023-11-15T01:33:56.469412+0000","last_became_peered":"2023-11-15T01:33:56.469412+0000","last_unstale":"2023-11-15T01:33:56.858111+0000","last_undegraded":"2023-11-15T01:33:56.858111+0000","last_fullsized":"2023-11-15T01:33:56.858111+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875262+0000","last_change":"2023-11-15T01:33:56.870228+0000","last_active":"2023-11-15T01:33:56.875262+0000","last_peered":"2023-11-15T01:33:56.875262+0000","last_clean":"2023-11-15T01:33:56.875262+0000","last_became_active":"2023-11-15T01:33:56.869836+0000","last_became_peered":"2023-11-15T01:33:56.869836+0000","last_unstale":"2023-11-15T01:33:56.875262+0000","last_undegraded":"2023-11-15T01:33:56.875262+0000","last_fullsized":"2023-11-15T01:33:56.875262+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.857311+0000","last_change":"2023-11-15T01:33:56.467712+0000","last_active":"2023-11-15T01:33:56.857311+0000","last_peered":"2023-11-15T01:33:56.857311+0000","last_clean":"2023-11-15T01:33:56.857311+0000","last_became_active":"2023-11-15T01:33:56.467431+0000","last_became_peered":"2023-11-15T01:33:56.467431+0000","last_unstale":"2023-11-15T01:33:56.857311+0000","last_undegraded":"2023-11-15T01:33:56.857311+0000","last_fullsized":"2023-11-15T01:33:56.857311+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868693+0000","last_change":"2023-11-15T01:33:56.862035+0000","last_active":"2023-11-15T01:33:56.868693+0000","last_peered":"2023-11-15T01:33:56.868693+0000","last_clean":"2023-11-15T01:33:56.868693+0000","last_became_active":"2023-11-15T01:33:56.861779+0000","last_became_peered":"2023-11-15T01:33:56.861779+0000","last_unstale":"2023-11-15T01:33:56.868693+0000","last_undegraded":"2023-11-15T01:33:56.868693+0000","last_fullsized":"2023-11-15T01:33:56.868693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.857571+0000","last_change":"2023-11-15T01:33:56.473044+0000","last_active":"2023-11-15T01:33:56.857571+0000","last_peered":"2023-11-15T01:33:56.857571+0000","last_clean":"2023-11-15T01:33:56.857571+0000","last_became_active":"2023-11-15T01:33:56.472757+0000","last_became_peered":"2023-11-15T01:33:56.472757+0000","last_unstale":"2023-11-15T01:33:56.857571+0000","last_undegraded":"2023-11-15T01:33:56.857571+0000","last_fullsized":"2023-11-15T01:33:56.857571+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.871737+0000","last_change":"2023-11-15T01:33:56.868549+0000","last_active":"2023-11-15T01:33:56.871737+0000","last_peered":"2023-11-15T01:33:56.871737+0000","last_clean":"2023-11-15T01:33:56.871737+0000","last_became_active":"2023-11-15T01:33:56.868252+0000","last_became_peered":"2023-11-15T01:33:56.868252+0000","last_unstale":"2023-11-15T01:33:56.871737+0000","last_undegraded":"2023-11-15T01:33:56.871737+0000","last_fullsized":"2023-11-15T01:33:56.871737+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-15T01:33:57.857164+0000","last_change":"2023-11-15T01:33:56.472202+0000","last_active":"2023-11-15T01:33:57.857164+0000","last_peered":"2023-11-15T01:33:57.857164+0000","last_clean":"2023-11-15T01:33:57.857164+0000","last_became_active":"2023-11-15T01:33:56.471917+0000","last_became_peered":"2023-11-15T01:33:56.471917+0000","last_unstale":"2023-11-15T01:33:57.857164+0000","last_undegraded":"2023-11-15T01:33:57.857164+0000","last_fullsized":"2023-11-15T01:33:57.857164+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.872641+0000","last_change":"2023-11-15T01:33:56.867048+0000","last_active":"2023-11-15T01:33:56.872641+0000","last_peered":"2023-11-15T01:33:56.872641+0000","last_clean":"2023-11-15T01:33:56.872641+0000","last_became_active":"2023-11-15T01:33:56.866783+0000","last_became_peered":"2023-11-15T01:33:56.866783+0000","last_unstale":"2023-11-15T01:33:56.872641+0000","last_undegraded":"2023-11-15T01:33:56.872641+0000","last_fullsized":"2023-11-15T01:33:56.872641+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860780+0000","last_change":"2023-11-15T01:33:56.460695+0000","last_active":"2023-11-15T01:33:56.860780+0000","last_peered":"2023-11-15T01:33:56.860780+0000","last_clean":"2023-11-15T01:33:56.860780+0000","last_became_active":"2023-11-15T01:33:56.460393+0000","last_became_peered":"2023-11-15T01:33:56.460393+0000","last_unstale":"2023-11-15T01:33:56.860780+0000","last_undegraded":"2023-11-15T01:33:56.860780+0000","last_fullsized":"2023-11-15T01:33:56.860780+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875207+0000","last_change":"2023-11-15T01:33:56.872777+0000","last_active":"2023-11-15T01:33:56.875207+0000","last_peered":"2023-11-15T01:33:56.875207+0000","last_clean":"2023-11-15T01:33:56.875207+0000","last_became_active":"2023-11-15T01:33:56.872491+0000","last_became_peered":"2023-11-15T01:33:56.872491+0000","last_unstale":"2023-11-15T01:33:56.875207+0000","last_undegraded":"2023-11-15T01:33:56.875207+0000","last_fullsized":"2023-11-15T01:33:56.875207+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.855006+0000","last_change":"2023-11-15T01:33:56.467246+0000","last_active":"2023-11-15T01:33:56.855006+0000","last_peered":"2023-11-15T01:33:56.855006+0000","last_clean":"2023-11-15T01:33:56.855006+0000","last_became_active":"2023-11-15T01:33:56.466985+0000","last_became_peered":"2023-11-15T01:33:56.466985+0000","last_unstale":"2023-11-15T01:33:56.855006+0000","last_undegraded":"2023-11-15T01:33:56.855006+0000","last_fullsized":"2023-11-15T01:33:56.855006+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870299+0000","last_change":"2023-11-15T01:33:56.867697+0000","last_active":"2023-11-15T01:33:56.870299+0000","last_peered":"2023-11-15T01:33:56.870299+0000","last_clean":"2023-11-15T01:33:56.870299+0000","last_became_active":"2023-11-15T01:33:56.867397+0000","last_became_peered":"2023-11-15T01:33:56.867397+0000","last_unstale":"2023-11-15T01:33:56.870299+0000","last_undegraded":"2023-11-15T01:33:56.870299+0000","last_fullsized":"2023-11-15T01:33:56.870299+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858510+0000","last_change":"2023-11-15T01:33:56.473011+0000","last_active":"2023-11-15T01:33:56.858510+0000","last_peered":"2023-11-15T01:33:56.858510+0000","last_clean":"2023-11-15T01:33:56.858510+0000","last_became_active":"2023-11-15T01:33:56.472685+0000","last_became_peered":"2023-11-15T01:33:56.472685+0000","last_unstale":"2023-11-15T01:33:56.858510+0000","last_undegraded":"2023-11-15T01:33:56.858510+0000","last_fullsized":"2023-11-15T01:33:56.858510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874059+0000","last_change":"2023-11-15T01:33:56.866406+0000","last_active":"2023-11-15T01:33:56.874059+0000","last_peered":"2023-11-15T01:33:56.874059+0000","last_clean":"2023-11-15T01:33:56.874059+0000","last_became_active":"2023-11-15T01:33:56.866163+0000","last_became_peered":"2023-11-15T01:33:56.866163+0000","last_unstale":"2023-11-15T01:33:56.874059+0000","last_undegraded":"2023-11-15T01:33:56.874059+0000","last_fullsized":"2023-11-15T01:33:56.874059+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858827+0000","last_change":"2023-11-15T01:33:56.467547+0000","last_active":"2023-11-15T01:33:56.858827+0000","last_peered":"2023-11-15T01:33:56.858827+0000","last_clean":"2023-11-15T01:33:56.858827+0000","last_became_active":"2023-11-15T01:33:56.467250+0000","last_became_peered":"2023-11-15T01:33:56.467250+0000","last_unstale":"2023-11-15T01:33:56.858827+0000","last_undegraded":"2023-11-15T01:33:56.858827+0000","last_fullsized":"2023-11-15T01:33:56.858827+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879575+0000","last_change":"2023-11-15T01:33:56.876040+0000","last_active":"2023-11-15T01:33:56.879575+0000","last_peered":"2023-11-15T01:33:56.879575+0000","last_clean":"2023-11-15T01:33:56.879575+0000","last_became_active":"2023-11-15T01:33:56.875743+0000","last_became_peered":"2023-11-15T01:33:56.875743+0000","last_unstale":"2023-11-15T01:33:56.879575+0000","last_undegraded":"2023-11-15T01:33:56.879575+0000","last_fullsized":"2023-11-15T01:33:56.879575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851225+0000","last_change":"2023-11-15T01:33:56.473005+0000","last_active":"2023-11-15T01:33:56.851225+0000","last_peered":"2023-11-15T01:33:56.851225+0000","last_clean":"2023-11-15T01:33:56.851225+0000","last_became_active":"2023-11-15T01:33:56.472763+0000","last_became_peered":"2023-11-15T01:33:56.472763+0000","last_unstale":"2023-11-15T01:33:56.851225+0000","last_undegraded":"2023-11-15T01:33:56.851225+0000","last_fullsized":"2023-11-15T01:33:56.851225+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875176+0000","last_change":"2023-11-15T01:33:56.866140+0000","last_active":"2023-11-15T01:33:56.875176+0000","last_peered":"2023-11-15T01:33:56.875176+0000","last_clean":"2023-11-15T01:33:56.875176+0000","last_became_active":"2023-11-15T01:33:56.865926+0000","last_became_peered":"2023-11-15T01:33:56.865926+0000","last_unstale":"2023-11-15T01:33:56.875176+0000","last_undegraded":"2023-11-15T01:33:56.875176+0000","last_fullsized":"2023-11-15T01:33:56.875176+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861741+0000","last_change":"2023-11-15T01:33:56.467225+0000","last_active":"2023-11-15T01:33:56.861741+0000","last_peered":"2023-11-15T01:33:56.861741+0000","last_clean":"2023-11-15T01:33:56.861741+0000","last_became_active":"2023-11-15T01:33:56.466935+0000","last_became_peered":"2023-11-15T01:33:56.466935+0000","last_unstale":"2023-11-15T01:33:56.861741+0000","last_undegraded":"2023-11-15T01:33:56.861741+0000","last_fullsized":"2023-11-15T01:33:56.861741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879397+0000","last_change":"2023-11-15T01:33:56.874511+0000","last_active":"2023-11-15T01:33:56.879397+0000","last_peered":"2023-11-15T01:33:56.879397+0000","last_clean":"2023-11-15T01:33:56.879397+0000","last_became_active":"2023-11-15T01:33:56.873938+0000","last_became_peered":"2023-11-15T01:33:56.873938+0000","last_unstale":"2023-11-15T01:33:56.879397+0000","last_undegraded":"2023-11-15T01:33:56.879397+0000","last_fullsized":"2023-11-15T01:33:56.879397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869557+0000","last_change":"2023-11-15T01:33:56.462340+0000","last_active":"2023-11-15T01:33:56.869557+0000","last_peered":"2023-11-15T01:33:56.869557+0000","last_clean":"2023-11-15T01:33:56.869557+0000","last_became_active":"2023-11-15T01:33:56.462052+0000","last_became_peered":"2023-11-15T01:33:56.462052+0000","last_unstale":"2023-11-15T01:33:56.869557+0000","last_undegraded":"2023-11-15T01:33:56.869557+0000","last_fullsized":"2023-11-15T01:33:56.869557+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874960+0000","last_change":"2023-11-15T01:33:56.872849+0000","last_active":"2023-11-15T01:33:56.874960+0000","last_peered":"2023-11-15T01:33:56.874960+0000","last_clean":"2023-11-15T01:33:56.874960+0000","last_became_active":"2023-11-15T01:33:56.872524+0000","last_became_peered":"2023-11-15T01:33:56.872524+0000","last_unstale":"2023-11-15T01:33:56.874960+0000","last_undegraded":"2023-11-15T01:33:56.874960+0000","last_fullsized":"2023-11-15T01:33:56.874960+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869995+0000","last_change":"2023-11-15T01:33:56.471803+0000","last_active":"2023-11-15T01:33:56.869995+0000","last_peered":"2023-11-15T01:33:56.869995+0000","last_clean":"2023-11-15T01:33:56.869995+0000","last_became_active":"2023-11-15T01:33:56.471477+0000","last_became_peered":"2023-11-15T01:33:56.471477+0000","last_unstale":"2023-11-15T01:33:56.869995+0000","last_undegraded":"2023-11-15T01:33:56.869995+0000","last_fullsized":"2023-11-15T01:33:56.869995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870302+0000","last_change":"2023-11-15T01:33:56.867150+0000","last_active":"2023-11-15T01:33:56.870302+0000","last_peered":"2023-11-15T01:33:56.870302+0000","last_clean":"2023-11-15T01:33:56.870302+0000","last_became_active":"2023-11-15T01:33:56.866156+0000","last_became_peered":"2023-11-15T01:33:56.866156+0000","last_unstale":"2023-11-15T01:33:56.870302+0000","last_undegraded":"2023-11-15T01:33:56.870302+0000","last_fullsized":"2023-11-15T01:33:56.870302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873231+0000","last_change":"2023-11-15T01:33:56.479832+0000","last_active":"2023-11-15T01:33:56.873231+0000","last_peered":"2023-11-15T01:33:56.873231+0000","last_clean":"2023-11-15T01:33:56.873231+0000","last_became_active":"2023-11-15T01:33:56.479383+0000","last_became_peered":"2023-11-15T01:33:56.479383+0000","last_unstale":"2023-11-15T01:33:56.873231+0000","last_undegraded":"2023-11-15T01:33:56.873231+0000","last_fullsized":"2023-11-15T01:33:56.873231+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.869183+0000","last_change":"2023-11-15T01:33:56.858217+0000","last_active":"2023-11-15T01:33:56.869183+0000","last_peered":"2023-11-15T01:33:56.869183+0000","last_clean":"2023-11-15T01:33:56.869183+0000","last_became_active":"2023-11-15T01:33:56.857955+0000","last_became_peered":"2023-11-15T01:33:56.857955+0000","last_unstale":"2023-11-15T01:33:56.869183+0000","last_undegraded":"2023-11-15T01:33:56.869183+0000","last_fullsized":"2023-11-15T01:33:56.869183+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.855126+0000","last_change":"2023-11-15T01:33:56.471717+0000","last_active":"2023-11-15T01:33:56.855126+0000","last_peered":"2023-11-15T01:33:56.855126+0000","last_clean":"2023-11-15T01:33:56.855126+0000","last_became_active":"2023-11-15T01:33:56.471483+0000","last_became_peered":"2023-11-15T01:33:56.471483+0000","last_unstale":"2023-11-15T01:33:56.855126+0000","last_undegraded":"2023-11-15T01:33:56.855126+0000","last_fullsized":"2023-11-15T01:33:56.855126+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873298+0000","last_change":"2023-11-15T01:33:56.869819+0000","last_active":"2023-11-15T01:33:56.873298+0000","last_peered":"2023-11-15T01:33:56.873298+0000","last_clean":"2023-11-15T01:33:56.873298+0000","last_became_active":"2023-11-15T01:33:56.869529+0000","last_became_peered":"2023-11-15T01:33:56.869529+0000","last_unstale":"2023-11-15T01:33:56.873298+0000","last_undegraded":"2023-11-15T01:33:56.873298+0000","last_fullsized":"2023-11-15T01:33:56.873298+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859995+0000","last_change":"2023-11-15T01:33:56.456359+0000","last_active":"2023-11-15T01:33:56.859995+0000","last_peered":"2023-11-15T01:33:56.859995+0000","last_clean":"2023-11-15T01:33:56.859995+0000","last_became_active":"2023-11-15T01:33:56.456028+0000","last_became_peered":"2023-11-15T01:33:56.456028+0000","last_unstale":"2023-11-15T01:33:56.859995+0000","last_undegraded":"2023-11-15T01:33:56.859995+0000","last_fullsized":"2023-11-15T01:33:56.859995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879584+0000","last_change":"2023-11-15T01:33:56.876486+0000","last_active":"2023-11-15T01:33:56.879584+0000","last_peered":"2023-11-15T01:33:56.879584+0000","last_clean":"2023-11-15T01:33:56.879584+0000","last_became_active":"2023-11-15T01:33:56.876185+0000","last_became_peered":"2023-11-15T01:33:56.876185+0000","last_unstale":"2023-11-15T01:33:56.879584+0000","last_undegraded":"2023-11-15T01:33:56.879584+0000","last_fullsized":"2023-11-15T01:33:56.879584+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858937+0000","last_change":"2023-11-15T01:33:56.461596+0000","last_active":"2023-11-15T01:33:56.858937+0000","last_peered":"2023-11-15T01:33:56.858937+0000","last_clean":"2023-11-15T01:33:56.858937+0000","last_became_active":"2023-11-15T01:33:56.461232+0000","last_became_peered":"2023-11-15T01:33:56.461232+0000","last_unstale":"2023-11-15T01:33:56.858937+0000","last_undegraded":"2023-11-15T01:33:56.858937+0000","last_fullsized":"2023-11-15T01:33:56.858937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875552+0000","last_change":"2023-11-15T01:33:56.872876+0000","last_active":"2023-11-15T01:33:56.875552+0000","last_peered":"2023-11-15T01:33:56.875552+0000","last_clean":"2023-11-15T01:33:56.875552+0000","last_became_active":"2023-11-15T01:33:56.872293+0000","last_became_peered":"2023-11-15T01:33:56.872293+0000","last_unstale":"2023-11-15T01:33:56.875552+0000","last_undegraded":"2023-11-15T01:33:56.875552+0000","last_fullsized":"2023-11-15T01:33:56.875552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858075+0000","last_change":"2023-11-15T01:33:56.469475+0000","last_active":"2023-11-15T01:33:56.858075+0000","last_peered":"2023-11-15T01:33:56.858075+0000","last_clean":"2023-11-15T01:33:56.858075+0000","last_became_active":"2023-11-15T01:33:56.469038+0000","last_became_peered":"2023-11-15T01:33:56.469038+0000","last_unstale":"2023-11-15T01:33:56.858075+0000","last_undegraded":"2023-11-15T01:33:56.858075+0000","last_fullsized":"2023-11-15T01:33:56.858075+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.881954+0000","last_change":"2023-11-15T01:33:56.879242+0000","last_active":"2023-11-15T01:33:56.881954+0000","last_peered":"2023-11-15T01:33:56.881954+0000","last_clean":"2023-11-15T01:33:56.881954+0000","last_became_active":"2023-11-15T01:33:56.878946+0000","last_became_peered":"2023-11-15T01:33:56.878946+0000","last_unstale":"2023-11-15T01:33:56.881954+0000","last_undegraded":"2023-11-15T01:33:56.881954+0000","last_fullsized":"2023-11-15T01:33:56.881954+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859583+0000","last_change":"2023-11-15T01:33:56.463826+0000","last_active":"2023-11-15T01:33:56.859583+0000","last_peered":"2023-11-15T01:33:56.859583+0000","last_clean":"2023-11-15T01:33:56.859583+0000","last_became_active":"2023-11-15T01:33:56.463164+0000","last_became_peered":"2023-11-15T01:33:56.463164+0000","last_unstale":"2023-11-15T01:33:56.859583+0000","last_undegraded":"2023-11-15T01:33:56.859583+0000","last_fullsized":"2023-11-15T01:33:56.859583+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873153+0000","last_change":"2023-11-15T01:33:56.869206+0000","last_active":"2023-11-15T01:33:56.873153+0000","last_peered":"2023-11-15T01:33:56.873153+0000","last_clean":"2023-11-15T01:33:56.873153+0000","last_became_active":"2023-11-15T01:33:56.868918+0000","last_became_peered":"2023-11-15T01:33:56.868918+0000","last_unstale":"2023-11-15T01:33:56.873153+0000","last_undegraded":"2023-11-15T01:33:56.873153+0000","last_fullsized":"2023-11-15T01:33:56.873153+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.867059+0000","last_change":"2023-11-15T01:33:56.468977+0000","last_active":"2023-11-15T01:33:56.867059+0000","last_peered":"2023-11-15T01:33:56.867059+0000","last_clean":"2023-11-15T01:33:56.867059+0000","last_became_active":"2023-11-15T01:33:56.468680+0000","last_became_peered":"2023-11-15T01:33:56.468680+0000","last_unstale":"2023-11-15T01:33:56.867059+0000","last_undegraded":"2023-11-15T01:33:56.867059+0000","last_fullsized":"2023-11-15T01:33:56.867059+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.863671+0000","last_change":"2023-11-15T01:33:56.860959+0000","last_active":"2023-11-15T01:33:56.863671+0000","last_peered":"2023-11-15T01:33:56.863671+0000","last_clean":"2023-11-15T01:33:56.863671+0000","last_became_active":"2023-11-15T01:33:56.860574+0000","last_became_peered":"2023-11-15T01:33:56.860574+0000","last_unstale":"2023-11-15T01:33:56.863671+0000","last_undegraded":"2023-11-15T01:33:56.863671+0000","last_fullsized":"2023-11-15T01:33:56.863671+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860693+0000","last_change":"2023-11-15T01:33:56.469708+0000","last_active":"2023-11-15T01:33:56.860693+0000","last_peered":"2023-11-15T01:33:56.860693+0000","last_clean":"2023-11-15T01:33:56.860693+0000","last_became_active":"2023-11-15T01:33:56.469428+0000","last_became_peered":"2023-11-15T01:33:56.469428+0000","last_unstale":"2023-11-15T01:33:56.860693+0000","last_undegraded":"2023-11-15T01:33:56.860693+0000","last_fullsized":"2023-11-15T01:33:56.860693+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874768+0000","last_change":"2023-11-15T01:33:56.867465+0000","last_active":"2023-11-15T01:33:56.874768+0000","last_peered":"2023-11-15T01:33:56.874768+0000","last_clean":"2023-11-15T01:33:56.874768+0000","last_became_active":"2023-11-15T01:33:56.867152+0000","last_became_peered":"2023-11-15T01:33:56.867152+0000","last_unstale":"2023-11-15T01:33:56.874768+0000","last_undegraded":"2023-11-15T01:33:56.874768+0000","last_fullsized":"2023-11-15T01:33:56.874768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"60'3","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879018+0000","last_change":"2023-11-15T01:33:56.476533+0000","last_active":"2023-11-15T01:33:56.879018+0000","last_peered":"2023-11-15T01:33:56.879018+0000","last_clean":"2023-11-15T01:33:56.879018+0000","last_became_active":"2023-11-15T01:33:56.476246+0000","last_became_peered":"2023-11-15T01:33:56.476246+0000","last_unstale":"2023-11-15T01:33:56.879018+0000","last_undegraded":"2023-11-15T01:33:56.879018+0000","last_fullsized":"2023-11-15T01:33:56.879018+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.872188+0000","last_change":"2023-11-15T01:33:56.868151+0000","last_active":"2023-11-15T01:33:56.872188+0000","last_peered":"2023-11-15T01:33:56.872188+0000","last_clean":"2023-11-15T01:33:56.872188+0000","last_became_active":"2023-11-15T01:33:56.867790+0000","last_became_peered":"2023-11-15T01:33:56.867790+0000","last_unstale":"2023-11-15T01:33:56.872188+0000","last_undegraded":"2023-11-15T01:33:56.872188+0000","last_fullsized":"2023-11-15T01:33:56.872188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877547+0000","last_change":"2023-11-15T01:33:56.470412+0000","last_active":"2023-11-15T01:33:56.877547+0000","last_peered":"2023-11-15T01:33:56.877547+0000","last_clean":"2023-11-15T01:33:56.877547+0000","last_became_active":"2023-11-15T01:33:56.469983+0000","last_became_peered":"2023-11-15T01:33:56.469983+0000","last_unstale":"2023-11-15T01:33:56.877547+0000","last_undegraded":"2023-11-15T01:33:56.877547+0000","last_fullsized":"2023-11-15T01:33:56.877547+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875421+0000","last_change":"2023-11-15T01:33:56.873025+0000","last_active":"2023-11-15T01:33:56.875421+0000","last_peered":"2023-11-15T01:33:56.875421+0000","last_clean":"2023-11-15T01:33:56.875421+0000","last_became_active":"2023-11-15T01:33:56.872590+0000","last_became_peered":"2023-11-15T01:33:56.872590+0000","last_unstale":"2023-11-15T01:33:56.875421+0000","last_undegraded":"2023-11-15T01:33:56.875421+0000","last_fullsized":"2023-11-15T01:33:56.875421+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.878036+0000","last_change":"2023-11-15T01:33:56.467785+0000","last_active":"2023-11-15T01:33:56.878036+0000","last_peered":"2023-11-15T01:33:56.878036+0000","last_clean":"2023-11-15T01:33:56.878036+0000","last_became_active":"2023-11-15T01:33:56.467489+0000","last_became_peered":"2023-11-15T01:33:56.467489+0000","last_unstale":"2023-11-15T01:33:56.878036+0000","last_undegraded":"2023-11-15T01:33:56.878036+0000","last_fullsized":"2023-11-15T01:33:56.878036+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874082+0000","last_change":"2023-11-15T01:33:56.867055+0000","last_active":"2023-11-15T01:33:56.874082+0000","last_peered":"2023-11-15T01:33:56.874082+0000","last_clean":"2023-11-15T01:33:56.874082+0000","last_became_active":"2023-11-15T01:33:56.865917+0000","last_became_peered":"2023-11-15T01:33:56.865917+0000","last_unstale":"2023-11-15T01:33:56.874082+0000","last_undegraded":"2023-11-15T01:33:56.874082+0000","last_fullsized":"2023-11-15T01:33:56.874082+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858274+0000","last_change":"2023-11-15T01:33:56.469022+0000","last_active":"2023-11-15T01:33:56.858274+0000","last_peered":"2023-11-15T01:33:56.858274+0000","last_clean":"2023-11-15T01:33:56.858274+0000","last_became_active":"2023-11-15T01:33:56.468713+0000","last_became_peered":"2023-11-15T01:33:56.468713+0000","last_unstale":"2023-11-15T01:33:56.858274+0000","last_undegraded":"2023-11-15T01:33:56.858274+0000","last_fullsized":"2023-11-15T01:33:56.858274+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868778+0000","last_change":"2023-11-15T01:33:56.865296+0000","last_active":"2023-11-15T01:33:56.868778+0000","last_peered":"2023-11-15T01:33:56.868778+0000","last_clean":"2023-11-15T01:33:56.868778+0000","last_became_active":"2023-11-15T01:33:56.864996+0000","last_became_peered":"2023-11-15T01:33:56.864996+0000","last_unstale":"2023-11-15T01:33:56.868778+0000","last_undegraded":"2023-11-15T01:33:56.868778+0000","last_fullsized":"2023-11-15T01:33:56.868778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.864452+0000","last_change":"2023-11-15T01:33:56.472655+0000","last_active":"2023-11-15T01:33:56.864452+0000","last_peered":"2023-11-15T01:33:56.864452+0000","last_clean":"2023-11-15T01:33:56.864452+0000","last_became_active":"2023-11-15T01:33:56.472369+0000","last_became_peered":"2023-11-15T01:33:56.472369+0000","last_unstale":"2023-11-15T01:33:56.864452+0000","last_undegraded":"2023-11-15T01:33:56.864452+0000","last_fullsized":"2023-11-15T01:33:56.864452+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875197+0000","last_change":"2023-11-15T01:33:56.866585+0000","last_active":"2023-11-15T01:33:56.875197+0000","last_peered":"2023-11-15T01:33:56.875197+0000","last_clean":"2023-11-15T01:33:56.875197+0000","last_became_active":"2023-11-15T01:33:56.866281+0000","last_became_peered":"2023-11-15T01:33:56.866281+0000","last_unstale":"2023-11-15T01:33:56.875197+0000","last_undegraded":"2023-11-15T01:33:56.875197+0000","last_fullsized":"2023-11-15T01:33:56.875197+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876043+0000","last_change":"2023-11-15T01:33:56.470274+0000","last_active":"2023-11-15T01:33:56.876043+0000","last_peered":"2023-11-15T01:33:56.876043+0000","last_clean":"2023-11-15T01:33:56.876043+0000","last_became_active":"2023-11-15T01:33:56.469919+0000","last_became_peered":"2023-11-15T01:33:56.469919+0000","last_unstale":"2023-11-15T01:33:56.876043+0000","last_undegraded":"2023-11-15T01:33:56.876043+0000","last_fullsized":"2023-11-15T01:33:56.876043+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868787+0000","last_change":"2023-11-15T01:33:56.861760+0000","last_active":"2023-11-15T01:33:56.868787+0000","last_peered":"2023-11-15T01:33:56.868787+0000","last_clean":"2023-11-15T01:33:56.868787+0000","last_became_active":"2023-11-15T01:33:56.861490+0000","last_became_peered":"2023-11-15T01:33:56.861490+0000","last_unstale":"2023-11-15T01:33:56.868787+0000","last_undegraded":"2023-11-15T01:33:56.868787+0000","last_fullsized":"2023-11-15T01:33:56.868787+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.875430+0000","last_change":"2023-11-15T01:33:56.468949+0000","last_active":"2023-11-15T01:33:56.875430+0000","last_peered":"2023-11-15T01:33:56.875430+0000","last_clean":"2023-11-15T01:33:56.875430+0000","last_became_active":"2023-11-15T01:33:56.468359+0000","last_became_peered":"2023-11-15T01:33:56.468359+0000","last_unstale":"2023-11-15T01:33:56.875430+0000","last_undegraded":"2023-11-15T01:33:56.875430+0000","last_fullsized":"2023-11-15T01:33:56.875430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877434+0000","last_change":"2023-11-15T01:33:56.872116+0000","last_active":"2023-11-15T01:33:56.877434+0000","last_peered":"2023-11-15T01:33:56.877434+0000","last_clean":"2023-11-15T01:33:56.877434+0000","last_became_active":"2023-11-15T01:33:56.871846+0000","last_became_peered":"2023-11-15T01:33:56.871846+0000","last_unstale":"2023-11-15T01:33:56.877434+0000","last_undegraded":"2023-11-15T01:33:56.877434+0000","last_fullsized":"2023-11-15T01:33:56.877434+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870248+0000","last_change":"2023-11-15T01:33:56.466299+0000","last_active":"2023-11-15T01:33:56.870248+0000","last_peered":"2023-11-15T01:33:56.870248+0000","last_clean":"2023-11-15T01:33:56.870248+0000","last_became_active":"2023-11-15T01:33:56.465916+0000","last_became_peered":"2023-11-15T01:33:56.465916+0000","last_unstale":"2023-11-15T01:33:56.870248+0000","last_undegraded":"2023-11-15T01:33:56.870248+0000","last_fullsized":"2023-11-15T01:33:56.870248+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.874692+0000","last_change":"2023-11-15T01:33:56.873782+0000","last_active":"2023-11-15T01:33:56.874692+0000","last_peered":"2023-11-15T01:33:56.874692+0000","last_clean":"2023-11-15T01:33:56.874692+0000","last_became_active":"2023-11-15T01:33:56.873501+0000","last_became_peered":"2023-11-15T01:33:56.873501+0000","last_unstale":"2023-11-15T01:33:56.874692+0000","last_undegraded":"2023-11-15T01:33:56.874692+0000","last_fullsized":"2023-11-15T01:33:56.874692+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858124+0000","last_change":"2023-11-15T01:33:56.473892+0000","last_active":"2023-11-15T01:33:56.858124+0000","last_peered":"2023-11-15T01:33:56.858124+0000","last_clean":"2023-11-15T01:33:56.858124+0000","last_became_active":"2023-11-15T01:33:56.473710+0000","last_became_peered":"2023-11-15T01:33:56.473710+0000","last_unstale":"2023-11-15T01:33:56.858124+0000","last_undegraded":"2023-11-15T01:33:56.858124+0000","last_fullsized":"2023-11-15T01:33:56.858124+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.876700+0000","last_change":"2023-11-15T01:33:56.870602+0000","last_active":"2023-11-15T01:33:56.876700+0000","last_peered":"2023-11-15T01:33:56.876700+0000","last_clean":"2023-11-15T01:33:56.876700+0000","last_became_active":"2023-11-15T01:33:56.870368+0000","last_became_peered":"2023-11-15T01:33:56.870368+0000","last_unstale":"2023-11-15T01:33:56.876700+0000","last_undegraded":"2023-11-15T01:33:56.876700+0000","last_fullsized":"2023-11-15T01:33:56.876700+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858126+0000","last_change":"2023-11-15T01:33:56.471065+0000","last_active":"2023-11-15T01:33:56.858126+0000","last_peered":"2023-11-15T01:33:56.858126+0000","last_clean":"2023-11-15T01:33:56.858126+0000","last_became_active":"2023-11-15T01:33:56.470782+0000","last_became_peered":"2023-11-15T01:33:56.470782+0000","last_unstale":"2023-11-15T01:33:56.858126+0000","last_undegraded":"2023-11-15T01:33:56.858126+0000","last_fullsized":"2023-11-15T01:33:56.858126+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.868575+0000","last_change":"2023-11-15T01:33:56.864580+0000","last_active":"2023-11-15T01:33:56.868575+0000","last_peered":"2023-11-15T01:33:56.868575+0000","last_clean":"2023-11-15T01:33:56.868575+0000","last_became_active":"2023-11-15T01:33:56.864319+0000","last_became_peered":"2023-11-15T01:33:56.864319+0000","last_unstale":"2023-11-15T01:33:56.868575+0000","last_undegraded":"2023-11-15T01:33:56.868575+0000","last_fullsized":"2023-11-15T01:33:56.868575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870318+0000","last_change":"2023-11-15T01:33:56.470098+0000","last_active":"2023-11-15T01:33:56.870318+0000","last_peered":"2023-11-15T01:33:56.870318+0000","last_clean":"2023-11-15T01:33:56.870318+0000","last_became_active":"2023-11-15T01:33:56.466313+0000","last_became_peered":"2023-11-15T01:33:56.466313+0000","last_unstale":"2023-11-15T01:33:56.870318+0000","last_undegraded":"2023-11-15T01:33:56.870318+0000","last_fullsized":"2023-11-15T01:33:56.870318+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.867806+0000","last_change":"2023-11-15T01:33:56.862031+0000","last_active":"2023-11-15T01:33:56.867806+0000","last_peered":"2023-11-15T01:33:56.867806+0000","last_clean":"2023-11-15T01:33:56.867806+0000","last_became_active":"2023-11-15T01:33:56.861772+0000","last_became_peered":"2023-11-15T01:33:56.861772+0000","last_unstale":"2023-11-15T01:33:56.867806+0000","last_undegraded":"2023-11-15T01:33:56.867806+0000","last_fullsized":"2023-11-15T01:33:56.867806+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851553+0000","last_change":"2023-11-15T01:33:56.474219+0000","last_active":"2023-11-15T01:33:56.851553+0000","last_peered":"2023-11-15T01:33:56.851553+0000","last_clean":"2023-11-15T01:33:56.851553+0000","last_became_active":"2023-11-15T01:33:56.473738+0000","last_became_peered":"2023-11-15T01:33:56.473738+0000","last_unstale":"2023-11-15T01:33:56.851553+0000","last_undegraded":"2023-11-15T01:33:56.851553+0000","last_fullsized":"2023-11-15T01:33:56.851553+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877515+0000","last_change":"2023-11-15T01:33:56.867511+0000","last_active":"2023-11-15T01:33:56.877515+0000","last_peered":"2023-11-15T01:33:56.877515+0000","last_clean":"2023-11-15T01:33:56.877515+0000","last_became_active":"2023-11-15T01:33:56.867228+0000","last_became_peered":"2023-11-15T01:33:56.867228+0000","last_unstale":"2023-11-15T01:33:56.877515+0000","last_undegraded":"2023-11-15T01:33:56.877515+0000","last_fullsized":"2023-11-15T01:33:56.877515+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860126+0000","last_change":"2023-11-15T01:33:56.478983+0000","last_active":"2023-11-15T01:33:56.860126+0000","last_peered":"2023-11-15T01:33:56.860126+0000","last_clean":"2023-11-15T01:33:56.860126+0000","last_became_active":"2023-11-15T01:33:56.478740+0000","last_became_peered":"2023-11-15T01:33:56.478740+0000","last_unstale":"2023-11-15T01:33:56.860126+0000","last_undegraded":"2023-11-15T01:33:56.860126+0000","last_fullsized":"2023-11-15T01:33:56.860126+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.878323+0000","last_change":"2023-11-15T01:33:56.874707+0000","last_active":"2023-11-15T01:33:56.878323+0000","last_peered":"2023-11-15T01:33:56.878323+0000","last_clean":"2023-11-15T01:33:56.878323+0000","last_became_active":"2023-11-15T01:33:56.874384+0000","last_became_peered":"2023-11-15T01:33:56.874384+0000","last_unstale":"2023-11-15T01:33:56.878323+0000","last_undegraded":"2023-11-15T01:33:56.878323+0000","last_fullsized":"2023-11-15T01:33:56.878323+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.861834+0000","last_change":"2023-11-15T01:33:56.468488+0000","last_active":"2023-11-15T01:33:56.861834+0000","last_peered":"2023-11-15T01:33:56.861834+0000","last_clean":"2023-11-15T01:33:56.861834+0000","last_became_active":"2023-11-15T01:33:56.468185+0000","last_became_peered":"2023-11-15T01:33:56.468185+0000","last_unstale":"2023-11-15T01:33:56.861834+0000","last_undegraded":"2023-11-15T01:33:56.861834+0000","last_fullsized":"2023-11-15T01:33:56.861834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877540+0000","last_change":"2023-11-15T01:33:56.871264+0000","last_active":"2023-11-15T01:33:56.877540+0000","last_peered":"2023-11-15T01:33:56.877540+0000","last_clean":"2023-11-15T01:33:56.877540+0000","last_became_active":"2023-11-15T01:33:56.870999+0000","last_became_peered":"2023-11-15T01:33:56.870999+0000","last_unstale":"2023-11-15T01:33:56.877540+0000","last_undegraded":"2023-11-15T01:33:56.877540+0000","last_fullsized":"2023-11-15T01:33:56.877540+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.858830+0000","last_change":"2023-11-15T01:33:56.471602+0000","last_active":"2023-11-15T01:33:56.858830+0000","last_peered":"2023-11-15T01:33:56.858830+0000","last_clean":"2023-11-15T01:33:56.858830+0000","last_became_active":"2023-11-15T01:33:56.471289+0000","last_became_peered":"2023-11-15T01:33:56.471289+0000","last_unstale":"2023-11-15T01:33:56.858830+0000","last_undegraded":"2023-11-15T01:33:56.858830+0000","last_fullsized":"2023-11-15T01:33:56.858830+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.856327+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:33:56.856327+0000","last_peered":"2023-11-15T01:33:56.856327+0000","last_clean":"2023-11-15T01:33:56.856327+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:33:56.856327+0000","last_undegraded":"2023-11-15T01:33:56.856327+0000","last_fullsized":"2023-11-15T01:33:56.856327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860918+0000","last_change":"2023-11-15T01:33:56.858629+0000","last_active":"2023-11-15T01:33:56.860918+0000","last_peered":"2023-11-15T01:33:56.860918+0000","last_clean":"2023-11-15T01:33:56.860918+0000","last_became_active":"2023-11-15T01:33:56.858315+0000","last_became_peered":"2023-11-15T01:33:56.858315+0000","last_unstale":"2023-11-15T01:33:56.860918+0000","last_undegraded":"2023-11-15T01:33:56.860918+0000","last_fullsized":"2023-11-15T01:33:56.860918+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.879015+0000","last_change":"2023-11-15T01:33:56.470464+0000","last_active":"2023-11-15T01:33:56.879015+0000","last_peered":"2023-11-15T01:33:56.879015+0000","last_clean":"2023-11-15T01:33:56.879015+0000","last_became_active":"2023-11-15T01:33:56.470182+0000","last_became_peered":"2023-11-15T01:33:56.470182+0000","last_unstale":"2023-11-15T01:33:56.879015+0000","last_undegraded":"2023-11-15T01:33:56.879015+0000","last_fullsized":"2023-11-15T01:33:56.879015+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.854403+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:33:56.854403+0000","last_peered":"2023-11-15T01:33:56.854403+0000","last_clean":"2023-11-15T01:33:56.854403+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:33:56.854403+0000","last_undegraded":"2023-11-15T01:33:56.854403+0000","last_fullsized":"2023-11-15T01:33:56.854403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.870739+0000","last_change":"2023-11-15T01:33:56.861357+0000","last_active":"2023-11-15T01:33:56.870739+0000","last_peered":"2023-11-15T01:33:56.870739+0000","last_clean":"2023-11-15T01:33:56.870739+0000","last_became_active":"2023-11-15T01:33:56.861060+0000","last_became_peered":"2023-11-15T01:33:56.861060+0000","last_unstale":"2023-11-15T01:33:56.870739+0000","last_undegraded":"2023-11-15T01:33:56.870739+0000","last_fullsized":"2023-11-15T01:33:56.870739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859580+0000","last_change":"2023-11-15T01:33:56.462711+0000","last_active":"2023-11-15T01:33:56.859580+0000","last_peered":"2023-11-15T01:33:56.859580+0000","last_clean":"2023-11-15T01:33:56.859580+0000","last_became_active":"2023-11-15T01:33:56.462463+0000","last_became_peered":"2023-11-15T01:33:56.462463+0000","last_unstale":"2023-11-15T01:33:56.859580+0000","last_undegraded":"2023-11-15T01:33:56.859580+0000","last_fullsized":"2023-11-15T01:33:56.859580+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.863559+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:33:56.863559+0000","last_peered":"2023-11-15T01:33:56.863559+0000","last_clean":"2023-11-15T01:33:56.863559+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:33:56.863559+0000","last_undegraded":"2023-11-15T01:33:56.863559+0000","last_fullsized":"2023-11-15T01:33:56.863559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.865232+0000","last_change":"2023-11-15T01:33:56.861471+0000","last_active":"2023-11-15T01:33:56.865232+0000","last_peered":"2023-11-15T01:33:56.865232+0000","last_clean":"2023-11-15T01:33:56.865232+0000","last_became_active":"2023-11-15T01:33:56.860124+0000","last_became_peered":"2023-11-15T01:33:56.860124+0000","last_unstale":"2023-11-15T01:33:56.865232+0000","last_undegraded":"2023-11-15T01:33:56.865232+0000","last_fullsized":"2023-11-15T01:33:56.865232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.860345+0000","last_change":"2023-11-15T01:33:56.467702+0000","last_active":"2023-11-15T01:33:56.860345+0000","last_peered":"2023-11-15T01:33:56.860345+0000","last_clean":"2023-11-15T01:33:56.860345+0000","last_became_active":"2023-11-15T01:33:56.467346+0000","last_became_peered":"2023-11-15T01:33:56.467346+0000","last_unstale":"2023-11-15T01:33:56.860345+0000","last_undegraded":"2023-11-15T01:33:56.860345+0000","last_fullsized":"2023-11-15T01:33:56.860345+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.854655+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:33:56.854655+0000","last_peered":"2023-11-15T01:33:56.854655+0000","last_clean":"2023-11-15T01:33:56.854655+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:33:56.854655+0000","last_undegraded":"2023-11-15T01:33:56.854655+0000","last_fullsized":"2023-11-15T01:33:56.854655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.864776+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:33:56.864776+0000","last_peered":"2023-11-15T01:33:56.864776+0000","last_clean":"2023-11-15T01:33:56.864776+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:33:56.864776+0000","last_undegraded":"2023-11-15T01:33:56.864776+0000","last_fullsized":"2023-11-15T01:33:56.864776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.877503+0000","last_change":"2023-11-15T01:33:56.872973+0000","last_active":"2023-11-15T01:33:56.877503+0000","last_peered":"2023-11-15T01:33:56.877503+0000","last_clean":"2023-11-15T01:33:56.877503+0000","last_became_active":"2023-11-15T01:33:56.872705+0000","last_became_peered":"2023-11-15T01:33:56.872705+0000","last_unstale":"2023-11-15T01:33:56.877503+0000","last_undegraded":"2023-11-15T01:33:56.877503+0000","last_fullsized":"2023-11-15T01:33:56.877503+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.867400+0000","last_change":"2023-11-15T01:33:56.470260+0000","last_active":"2023-11-15T01:33:56.867400+0000","last_peered":"2023-11-15T01:33:56.867400+0000","last_clean":"2023-11-15T01:33:56.867400+0000","last_became_active":"2023-11-15T01:33:56.469956+0000","last_became_peered":"2023-11-15T01:33:56.469956+0000","last_unstale":"2023-11-15T01:33:56.867400+0000","last_undegraded":"2023-11-15T01:33:56.867400+0000","last_fullsized":"2023-11-15T01:33:56.867400+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.864854+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:33:56.864854+0000","last_peered":"2023-11-15T01:33:56.864854+0000","last_clean":"2023-11-15T01:33:56.864854+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:33:56.864854+0000","last_undegraded":"2023-11-15T01:33:56.864854+0000","last_fullsized":"2023-11-15T01:33:56.864854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873538+0000","last_change":"2023-11-15T01:33:56.872687+0000","last_active":"2023-11-15T01:33:56.873538+0000","last_peered":"2023-11-15T01:33:56.873538+0000","last_clean":"2023-11-15T01:33:56.873538+0000","last_became_active":"2023-11-15T01:33:56.872163+0000","last_became_peered":"2023-11-15T01:33:56.872163+0000","last_unstale":"2023-11-15T01:33:56.873538+0000","last_undegraded":"2023-11-15T01:33:56.873538+0000","last_fullsized":"2023-11-15T01:33:56.873538+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.857883+0000","last_change":"2023-11-15T01:33:56.466600+0000","last_active":"2023-11-15T01:33:56.857883+0000","last_peered":"2023-11-15T01:33:56.857883+0000","last_clean":"2023-11-15T01:33:56.857883+0000","last_became_active":"2023-11-15T01:33:56.466275+0000","last_became_peered":"2023-11-15T01:33:56.466275+0000","last_unstale":"2023-11-15T01:33:56.857883+0000","last_undegraded":"2023-11-15T01:33:56.857883+0000","last_fullsized":"2023-11-15T01:33:56.857883+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.867431+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:33:56.867431+0000","last_peered":"2023-11-15T01:33:56.867431+0000","last_clean":"2023-11-15T01:33:56.867431+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:33:56.867431+0000","last_undegraded":"2023-11-15T01:33:56.867431+0000","last_fullsized":"2023-11-15T01:33:56.867431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.873310+0000","last_change":"2023-11-15T01:33:56.865528+0000","last_active":"2023-11-15T01:33:56.873310+0000","last_peered":"2023-11-15T01:33:56.873310+0000","last_clean":"2023-11-15T01:33:56.873310+0000","last_became_active":"2023-11-15T01:33:56.865239+0000","last_became_peered":"2023-11-15T01:33:56.865239+0000","last_unstale":"2023-11-15T01:33:56.873310+0000","last_undegraded":"2023-11-15T01:33:56.873310+0000","last_fullsized":"2023-11-15T01:33:56.873310+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.852317+0000","last_change":"2023-11-15T01:33:56.470793+0000","last_active":"2023-11-15T01:33:56.852317+0000","last_peered":"2023-11-15T01:33:56.852317+0000","last_clean":"2023-11-15T01:33:56.852317+0000","last_became_active":"2023-11-15T01:33:56.469938+0000","last_became_peered":"2023-11-15T01:33:56.469938+0000","last_unstale":"2023-11-15T01:33:56.852317+0000","last_undegraded":"2023-11-15T01:33:56.852317+0000","last_fullsized":"2023-11-15T01:33:56.852317+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.857477+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:33:56.857477+0000","last_peered":"2023-11-15T01:33:56.857477+0000","last_clean":"2023-11-15T01:33:56.857477+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:33:56.857477+0000","last_undegraded":"2023-11-15T01:33:56.857477+0000","last_fullsized":"2023-11-15T01:33:56.857477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.881909+0000","last_change":"2023-11-15T01:33:56.877221+0000","last_active":"2023-11-15T01:33:56.881909+0000","last_peered":"2023-11-15T01:33:56.881909+0000","last_clean":"2023-11-15T01:33:56.881909+0000","last_became_active":"2023-11-15T01:33:56.876912+0000","last_became_peered":"2023-11-15T01:33:56.876912+0000","last_unstale":"2023-11-15T01:33:56.881909+0000","last_undegraded":"2023-11-15T01:33:56.881909+0000","last_fullsized":"2023-11-15T01:33:56.881909+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:56.443699+0000","last_clean_scrub_stamp":"2023-11-15T01:33:56.443699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.851763+0000","last_change":"2023-11-15T01:33:56.476704+0000","last_active":"2023-11-15T01:33:56.851763+0000","last_peered":"2023-11-15T01:33:56.851763+0000","last_clean":"2023-11-15T01:33:56.851763+0000","last_became_active":"2023-11-15T01:33:56.476357+0000","last_became_peered":"2023-11-15T01:33:56.476357+0000","last_unstale":"2023-11-15T01:33:56.851763+0000","last_undegraded":"2023-11-15T01:33:56.851763+0000","last_fullsized":"2023-11-15T01:33:56.851763+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:33:55.438893+0000","last_clean_scrub_stamp":"2023-11-15T01:33:55.438893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-15T01:33:56.859071+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:33:56.859071+0000","last_peered":"2023-11-15T01:33:56.859071+0000","last_clean":"2023-11-15T01:33:56.859071+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:33:56.859071+0000","last_undegraded":"2023-11-15T01:33:56.859071+0000","last_fullsized":"2023-11-15T01:33:56.859071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575000,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301912,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069928,"statfs":{"total":96636764160,"available":96327606272,"internally_reserved":0,"allocated":737280,"data_stored":353266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71199999999999997,"5min":0.81499999999999995,"15min":0.82299999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.67200000000000004,"5min":0.79500000000000004,"15min":0.83299999999999996},"last":0.60499999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77700000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.34399999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.65900000000000003,"5min":0.78000000000000003,"15min":0.81499999999999995},"last":0.58199999999999996}]},{"osd":2,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.77800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68999999999999995,"5min":0.82199999999999995,"15min":0.86299999999999999},"last":0.48299999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68400000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.622},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":0.81200000000000006},"last":0.57099999999999995}]},{"osd":4,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.46999999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.84499999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.53000000000000003,"15min":0.54700000000000004},"min":{"1min":0.32500000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.83799999999999997},"last":0.505}]},{"osd":5,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47499999999999998,"15min":0.49199999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.71999999999999997,"5min":0.76600000000000001,"15min":0.77500000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73899999999999999,"5min":0.748,"15min":0.78500000000000003},"last":0.52900000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.36899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.436},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.54800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.755,"5min":0.76100000000000001,"15min":0.85099999999999998},"last":0.44700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575001,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301904,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069936,"statfs":{"total":96636764160,"available":96327614464,"internally_reserved":0,"allocated":729088,"data_stored":352658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.39800000000000002,"5min":0.34000000000000002,"15min":0.29199999999999998},"max":{"1min":0.63600000000000001,"5min":0.82399999999999995,"15min":0.94299999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55000000000000004,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.34499999999999997,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.75600000000000001,"15min":0.97799999999999998},"last":0.502}]},{"osd":1,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.38700000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":1.0649999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57299999999999995,"15min":0.54700000000000004},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.84699999999999998,"15min":1.022},"last":0.48099999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.71999999999999997,"5min":0.84199999999999997,"15min":1.038},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70499999999999996,"5min":0.80700000000000005,"15min":0.995},"last":0.57199999999999995}]},{"osd":3,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.41299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.69399999999999995,"5min":0.91300000000000003,"15min":1.028},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68500000000000005,"5min":0.874,"15min":1.004},"last":0.51400000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.314,"5min":0.31,"15min":0.26600000000000001},"max":{"1min":0.67900000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.25800000000000001},"max":{"1min":0.67500000000000004,"5min":0.68799999999999994,"15min":0.81799999999999995},"last":0.41299999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.312},"max":{"1min":0.68500000000000005,"5min":0.69799999999999995,"15min":0.74099999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.73799999999999999,"5min":0.79200000000000004,"15min":0.79900000000000004},"last":0.42799999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.377,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":0.70499999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.379},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.41399999999999998,"15min":0.34000000000000002},"max":{"1min":0.72799999999999998,"5min":0.81299999999999994,"15min":1.0009999999999999},"last":0.443}]}]},{"osd":1,"up_from":13,"seq":55834575002,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301904,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069936,"statfs":{"total":96636764160,"available":96327614464,"internally_reserved":0,"allocated":729088,"data_stored":352678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23999999999999999},"max":{"1min":0.54900000000000004,"5min":0.64500000000000002,"15min":0.77800000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41199999999999998,"15min":0.38500000000000001},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.247},"max":{"1min":0.55500000000000005,"5min":0.65600000000000003,"15min":0.73099999999999998},"last":0.629}]},{"osd":2,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.40400000000000003,"15min":0.38700000000000001},"min":{"1min":0.29299999999999998,"5min":0.27800000000000002,"15min":0.22600000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.69599999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45100000000000001,"15min":0.434},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.90000000000000002},"last":0.55800000000000005}]},{"osd":3,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.502,"15min":0.48099999999999998},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.31},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":1.0009999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.48799999999999999,"15min":0.45600000000000002},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.28000000000000003},"max":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.75600000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79400000000000004,"5min":0.82299999999999995,"15min":0.89300000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.65200000000000002,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":0.78200000000000003,"5min":0.88700000000000001,"15min":1.0509999999999999},"last":0.73699999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65000000000000002,"15min":0.626},"min":{"1min":0.432,"5min":0.40100000000000002,"15min":0.38500000000000001},"max":{"1min":0.78100000000000003,"5min":0.83399999999999996,"15min":0.92700000000000005},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66000000000000003,"15min":0.63},"min":{"1min":0.46400000000000002,"5min":0.433,"15min":0.373},"max":{"1min":0.91700000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.85199999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68600000000000005,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82199999999999995,"5min":0.90900000000000003,"15min":1.0029999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.67500000000000004},"min":{"1min":0.51300000000000001,"5min":0.45200000000000001,"15min":0.41199999999999998},"max":{"1min":0.90100000000000002,"5min":0.96599999999999997,"15min":0.996},"last":0.94299999999999995}]},{"osd":7,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70599999999999996,"15min":0.68200000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88500000000000001,"5min":0.93899999999999995,"15min":1.25},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70399999999999996,"15min":0.67700000000000005},"min":{"1min":0.52200000000000002,"5min":0.495,"15min":0.46100000000000002},"max":{"1min":0.92200000000000004,"5min":0.96699999999999997,"15min":0.99199999999999999},"last":0.95999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575000,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301912,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069928,"statfs":{"total":96636764160,"available":96327606272,"internally_reserved":0,"allocated":737280,"data_stored":352714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.36199999999999999,"15min":0.35899999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.50700000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.41599999999999998,"15min":0.40200000000000002},"min":{"1min":0.26300000000000001,"5min":0.252,"15min":0.215},"max":{"1min":0.50600000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51600000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.39400000000000002,"15min":0.378},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.505,"5min":0.60499999999999998,"15min":0.64200000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.38,"5min":0.42599999999999999,"15min":0.42999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.47399999999999998,"5min":0.68600000000000005,"15min":1.0429999999999999},"last":0.55700000000000005}]},{"osd":3,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.42999999999999999,"15min":0.41899999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.22500000000000001},"max":{"1min":0.55700000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.5},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.45500000000000002,"15min":0.443},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27700000000000002},"max":{"1min":0.58399999999999996,"5min":0.73199999999999998,"15min":0.83399999999999996},"last":0.63200000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78800000000000003,"5min":0.97799999999999998,"15min":1.454},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.442},"max":{"1min":0.79300000000000004,"5min":0.94999999999999996,"15min":1.147},"last":0.67200000000000004}]},{"osd":5,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69399999999999995,"5min":1.01,"15min":1.079},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.624,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.73699999999999999,"5min":0.91400000000000003,"15min":1.1120000000000001},"last":0.76100000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":1.2529999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.68999999999999995,"5min":1.042,"15min":1.206},"last":0.81699999999999995}]},{"osd":7,"last update":"Wed Nov 15 01:33:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.78100000000000003,"5min":1.0620000000000001,"15min":1.2669999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68200000000000005,"15min":0.69799999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83299999999999996,"5min":0.99199999999999999,"15min":1.4119999999999999},"last":0.73599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575001,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065832,"statfs":{"total":96636764160,"available":96323411968,"internally_reserved":0,"allocated":737280,"data_stored":354124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36699999999999999,"15min":0.36199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.221},"max":{"1min":0.48599999999999999,"5min":0.60199999999999998,"15min":0.61899999999999999},"last":0.378},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.40200000000000002,"15min":0.39400000000000002},"min":{"1min":0.28699999999999998,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.63700000000000001,"15min":0.67800000000000005},"last":0.32100000000000001}]},{"osd":1,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":0.70999999999999996,"15min":0.75},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66300000000000003,"5min":0.73499999999999999,"15min":0.92000000000000004},"last":0.36099999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45600000000000002,"15min":0.438},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.57999999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.42999999999999999},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.253},"max":{"1min":0.66700000000000004,"5min":0.68999999999999995,"15min":0.74199999999999999},"last":0.40600000000000003}]},{"osd":4,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89000000000000001,"5min":0.90900000000000003,"15min":1.0800000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.629,"15min":0.64600000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.95399999999999996,"15min":1.052},"last":0.54200000000000004}]},{"osd":5,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.63800000000000001,"15min":0.64500000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.93000000000000005,"15min":0.998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63800000000000001,"15min":0.63600000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.85499999999999998,"5min":0.96099999999999997,"15min":1.1339999999999999},"last":0.42799999999999999}]},{"osd":6,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65800000000000003,"15min":0.65900000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.91300000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.441,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84199999999999997,"5min":1.016,"15min":1.119},"last":0.56699999999999995}]},{"osd":7,"last update":"Wed Nov 15 01:33:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.48399999999999999,"5min":0.45200000000000001,"15min":0.438},"max":{"1min":0.79700000000000004,"5min":1.03,"15min":1.103},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.68600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575002,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065832,"statfs":{"total":96636764160,"available":96323411968,"internally_reserved":0,"allocated":737280,"data_stored":353254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.379,"15min":0.36299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.22600000000000001},"max":{"1min":0.48599999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.40500000000000003,"15min":0.38800000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.23200000000000001},"max":{"1min":0.501,"5min":0.70499999999999996,"15min":0.70899999999999996},"last":0.58199999999999996}]},{"osd":1,"last update":"Wed Nov 15 01:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.39100000000000001,"15min":0.378},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":0.54400000000000004,"5min":0.71399999999999997,"15min":0.72899999999999998},"last":0.372},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.45100000000000001,"15min":0.441},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.60599999999999998,"5min":0.747,"15min":0.80500000000000005},"last":0.50800000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.44500000000000001,"15min":0.436},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.55800000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.48399999999999999,"15min":0.46600000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.26200000000000001},"max":{"1min":0.57599999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.56000000000000005}]},{"osd":4,"last update":"Wed Nov 15 01:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.628,"15min":0.626},"min":{"1min":0.439,"5min":0.439,"15min":0.42099999999999999},"max":{"1min":0.80200000000000005,"5min":0.91400000000000003,"15min":0.92600000000000005},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":1.036,"15min":1.0589999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Wed Nov 15 01:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.64500000000000002,"15min":0.64400000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.90600000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64500000000000002,"15min":0.64400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84199999999999997,"5min":0.90100000000000002,"15min":0.95999999999999996},"last":0.83199999999999996}]},{"osd":6,"last update":"Wed Nov 15 01:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65200000000000002,"15min":0.65100000000000002},"min":{"1min":0.44800000000000001,"5min":0.436,"15min":0.42499999999999999},"max":{"1min":0.754,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.67200000000000004,"15min":0.67700000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.86699999999999999,"5min":1.0900000000000001,"15min":1.169},"last":0.84199999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67500000000000004,"15min":0.67400000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85199999999999998,"5min":1.071,"15min":1.071},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.68200000000000005,"15min":0.69599999999999995},"min":{"1min":0.44400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.81499999999999995,"5min":1.1319999999999999,"15min":1.1459999999999999},"last":0.71199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575000,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":729088,"data_stored":353142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.55000000000000004},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.88,"15min":0.88},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.74399999999999999,"15min":0.78800000000000003},"last":0.503}]},{"osd":1,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57999999999999996,"15min":0.56499999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":0.77500000000000002,"5min":1.087,"15min":1.087},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.80400000000000005,"15min":0.81000000000000005},"last":0.44400000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":0.70899999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58199999999999996,"15min":0.58299999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.51900000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70099999999999996,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.749,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.47599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.30399999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.80600000000000005},"last":0.375},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47499999999999998,"15min":0.501},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":0.68000000000000005,"15min":0.85299999999999998},"last":0.46800000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47199999999999998,"15min":0.50700000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.84199999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.51100000000000001,"15min":0.54100000000000004},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":0.66500000000000004,"5min":0.77600000000000002,"15min":0.83199999999999996},"last":0.48299999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.50800000000000001,"15min":0.53600000000000003},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64300000000000002,"5min":0.873,"15min":0.873},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54800000000000004,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":0.74099999999999999,"5min":0.78400000000000003,"15min":0.90100000000000002},"last":0.54500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301904,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069936,"statfs":{"total":96636764160,"available":96327614464,"internally_reserved":0,"allocated":729088,"data_stored":353480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72999999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.36199999999999999},"max":{"1min":0.68300000000000005,"5min":0.74199999999999999,"15min":0.81200000000000006},"last":0.69299999999999995}]},{"osd":1,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.74099999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.318},"max":{"1min":0.64400000000000002,"5min":0.72499999999999998,"15min":0.86199999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.34999999999999998},"max":{"1min":0.75600000000000001,"5min":0.77700000000000002,"15min":1.103},"last":0.65300000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75,"5min":0.75800000000000001,"15min":0.78100000000000003},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.438,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1.127},"last":0.58399999999999996}]},{"osd":4,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.47599999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64400000000000002,"5min":0.70699999999999996,"15min":0.94399999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67800000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51300000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47699999999999998,"15min":0.497},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":1.0660000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.496,"15min":0.51800000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.46500000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:33:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.499,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.68999999999999995,"5min":0.73599999999999999,"15min":0.97199999999999998},"last":0.435},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":1.1499999999999999},"last":0.5}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:34:05.716 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-15T01:34:05.717 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-15T01:34:05.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.874+0000 7fa2e4279700 1 Processor -- start 2023-11-15T01:34:05.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.874+0000 7fa2e4279700 1 -- start start 2023-11-15T01:34:05.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.875+0000 7fa2e4279700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2dc1540a0 0x7fa2dc0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:05.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.875+0000 7fa2e4279700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa2dc154480 0x7fa2dc0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:05.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.875+0000 7fa2e4279700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2dc0ca050 con 0x7fa2dc0c5f40 2023-11-15T01:34:05.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.875+0000 7fa2e4279700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc0c9440 con 0x7fa2dc154480 2023-11-15T01:34:05.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.875+0000 7fa2e4279700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0c9720 con 0x7fa2dc1540a0 2023-11-15T01:34:05.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.875+0000 7fa2e1814700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa2dc154480 0x7fa2dc0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:05.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.875+0000 7fa2e1814700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa2dc154480 0x7fa2dc0ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50276/0 (socket says 172.21.15.1:50276) 2023-11-15T01:34:05.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.875+0000 7fa2e1814700 1 -- 172.21.15.1:0/3457918041 learned_addr learned my addr 172.21.15.1:0/3457918041 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:05.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.875+0000 7fa2e2015700 1 --2- 172.21.15.1:0/3457918041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2dc1540a0 0x7fa2dc0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:05.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.875+0000 7fa2e1814700 1 -- 172.21.15.1:0/3457918041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2dc1540a0 msgr2=0x7fa2dc0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:05.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.875+0000 7fa2e1814700 1 --2- 172.21.15.1:0/3457918041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2dc1540a0 0x7fa2dc0ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.875+0000 7fa2e1814700 1 -- 172.21.15.1:0/3457918041 >> v1:172.21.15.141:6789/0 conn(0x7fa2dc0c5f40 legacy=0x7fa2dc0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:05.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.875+0000 7fa2e1814700 1 -- 172.21.15.1:0/3457918041 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc0c9a00 con 0x7fa2dc154480 2023-11-15T01:34:05.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.875+0000 7fa2e2015700 1 --2- 172.21.15.1:0/3457918041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2dc1540a0 0x7fa2dc0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:34:05.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.876+0000 7fa2e1814700 1 --2- 172.21.15.1:0/3457918041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc154480 0x7fa2dc0ca9d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fa2cc006fd0 tx=0x7fa2cc0090f0).ready entity=mon.0 client_cookie=c66bba4d7b7cdeec server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:05.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.877+0000 7fa2e1013700 1 -- 172.21.15.1:0/3457918041 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00b580 con 0x7fa2dc154480 2023-11-15T01:34:05.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.877+0000 7fa2e1013700 1 -- 172.21.15.1:0/3457918041 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc00b6e0 con 0x7fa2dc154480 2023-11-15T01:34:05.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.877+0000 7fa2e1013700 1 -- 172.21.15.1:0/3457918041 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00ba60 con 0x7fa2dc154480 2023-11-15T01:34:05.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.878+0000 7fa2e4279700 1 -- 172.21.15.1:0/3457918041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc154480 msgr2=0x7fa2dc0ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:05.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.878+0000 7fa2e4279700 1 --2- 172.21.15.1:0/3457918041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc154480 0x7fa2dc0ca9d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fa2cc006fd0 tx=0x7fa2cc0090f0).stop 2023-11-15T01:34:05.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.878+0000 7fa2e4279700 1 -- 172.21.15.1:0/3457918041 shutdown_connections 2023-11-15T01:34:05.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.878+0000 7fa2e4279700 1 --2- 172.21.15.1:0/3457918041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2dc1540a0 0x7fa2dc0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.878+0000 7fa2e4279700 1 --2- 172.21.15.1:0/3457918041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc154480 0x7fa2dc0ca9d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.878+0000 7fa2e4279700 1 -- 172.21.15.1:0/3457918041 >> 172.21.15.1:0/3457918041 conn(0x7fa2dc064a70 msgr2=0x7fa2dc064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:05.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.878+0000 7fa2e4279700 1 -- 172.21.15.1:0/3457918041 shutdown_connections 2023-11-15T01:34:05.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.878+0000 7fa2e4279700 1 -- 172.21.15.1:0/3457918041 wait complete. 2023-11-15T01:34:05.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.879+0000 7fa2e4279700 1 Processor -- start 2023-11-15T01:34:05.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.879+0000 7fa2e4279700 1 -- start start 2023-11-15T01:34:05.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e4279700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc0c5f40 0x7fa2dc0a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:05.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e4279700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2dc1540a0 0x7fa2dc151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:05.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e4279700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2dc154480 0x7fa2dc145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:05.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e4279700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc1525b0 con 0x7fa2dc0c5f40 2023-11-15T01:34:05.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e4279700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc1519a0 con 0x7fa2dc154480 2023-11-15T01:34:05.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e4279700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc151c80 con 0x7fa2dc1540a0 2023-11-15T01:34:05.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e2015700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc0c5f40 0x7fa2dc0a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:05.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e2015700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc0c5f40 0x7fa2dc0a21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50288/0 (socket says 172.21.15.1:50288) 2023-11-15T01:34:05.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e2015700 1 -- 172.21.15.1:0/4101181680 learned_addr learned my addr 172.21.15.1:0/4101181680 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:05.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e2816700 1 --2- 172.21.15.1:0/4101181680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2dc154480 0x7fa2dc145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:05.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e1814700 1 --2- 172.21.15.1:0/4101181680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2dc1540a0 0x7fa2dc151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:05.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e2015700 1 -- 172.21.15.1:0/4101181680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2dc1540a0 msgr2=0x7fa2dc151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:05.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e2015700 1 --2- 172.21.15.1:0/4101181680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2dc1540a0 0x7fa2dc151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e2015700 1 -- 172.21.15.1:0/4101181680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2dc154480 msgr2=0x7fa2dc145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:05.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e2015700 1 --2- 172.21.15.1:0/4101181680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2dc154480 0x7fa2dc145200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:05.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e2015700 1 -- 172.21.15.1:0/4101181680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d80092a0 con 0x7fa2dc0c5f40 2023-11-15T01:34:05.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e1814700 1 --2- 172.21.15.1:0/4101181680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2dc1540a0 0x7fa2dc151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:34:05.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e2015700 1 --2- 172.21.15.1:0/4101181680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc0c5f40 0x7fa2dc0a21d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fa2d800e980 tx=0x7fa2d8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:05.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2d27fc700 1 -- 172.21.15.1:0/4101181680 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d800ee70 con 0x7fa2dc0c5f40 2023-11-15T01:34:05.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2d27fc700 1 -- 172.21.15.1:0/4101181680 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d800c850 con 0x7fa2dc0c5f40 2023-11-15T01:34:05.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e4279700 1 -- 172.21.15.1:0/4101181680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2cc009370 con 0x7fa2dc0c5f40 2023-11-15T01:34:05.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2d27fc700 1 -- 172.21.15.1:0/4101181680 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d800cbd0 con 0x7fa2dc0c5f40 2023-11-15T01:34:05.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.880+0000 7fa2e4279700 1 -- 172.21.15.1:0/4101181680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2dc152240 con 0x7fa2dc0c5f40 2023-11-15T01:34:05.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.881+0000 7fa2e4279700 1 -- 172.21.15.1:0/4101181680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2dc152890 con 0x7fa2dc0c5f40 2023-11-15T01:34:05.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.882+0000 7fa2d27fc700 1 -- 172.21.15.1:0/4101181680 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa2d801b400 con 0x7fa2dc0c5f40 2023-11-15T01:34:05.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.882+0000 7fa2d27fc700 1 --2- 172.21.15.1:0/4101181680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa2c005f270 0x7fa2c0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:05.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.882+0000 7fa2d27fc700 1 -- 172.21.15.1:0/4101181680 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7fa2d807aa50 con 0x7fa2dc0c5f40 2023-11-15T01:34:05.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.882+0000 7fa2e1814700 1 --2- 172.21.15.1:0/4101181680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa2c005f270 0x7fa2c0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:05.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.883+0000 7fa2e1814700 1 --2- 172.21.15.1:0/4101181680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa2c005f270 0x7fa2c0061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa2cc006fd0 tx=0x7fa2cc017000).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:05.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:05.886+0000 7fa2d27fc700 1 -- 172.21.15.1:0/4101181680 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa2d804b9b0 con 0x7fa2dc0c5f40 2023-11-15T01:34:06.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.127+0000 7fa2e4279700 1 -- 172.21.15.1:0/4101181680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa2dc06c7e0 con 0x7fa2dc0c5f40 2023-11-15T01:34:06.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.130+0000 7fa2d27fc700 1 -- 172.21.15.1:0/4101181680 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa2d804efd0 con 0x7fa2dc0c5f40 2023-11-15T01:34:06.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.132+0000 7fa2e4279700 1 -- 172.21.15.1:0/4101181680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa2c005f270 msgr2=0x7fa2c0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:06.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.132+0000 7fa2e4279700 1 --2- 172.21.15.1:0/4101181680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa2c005f270 0x7fa2c0061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa2cc006fd0 tx=0x7fa2cc017000).stop 2023-11-15T01:34:06.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.132+0000 7fa2e4279700 1 -- 172.21.15.1:0/4101181680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc0c5f40 msgr2=0x7fa2dc0a21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:06.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.132+0000 7fa2e4279700 1 --2- 172.21.15.1:0/4101181680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc0c5f40 0x7fa2dc0a21d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fa2d800e980 tx=0x7fa2d8009060).stop 2023-11-15T01:34:06.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.132+0000 7fa2e4279700 1 -- 172.21.15.1:0/4101181680 shutdown_connections 2023-11-15T01:34:06.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.132+0000 7fa2e4279700 1 --2- 172.21.15.1:0/4101181680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa2c005f270 0x7fa2c0061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:06.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.132+0000 7fa2e4279700 1 --2- 172.21.15.1:0/4101181680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2dc154480 0x7fa2dc145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:06.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.132+0000 7fa2e4279700 1 --2- 172.21.15.1:0/4101181680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc0c5f40 0x7fa2dc0a21d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:06.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.132+0000 7fa2e4279700 1 --2- 172.21.15.1:0/4101181680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2dc1540a0 0x7fa2dc151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:06.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.132+0000 7fa2e4279700 1 -- 172.21.15.1:0/4101181680 >> 172.21.15.1:0/4101181680 conn(0x7fa2dc064a70 msgr2=0x7fa2dc0ab6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:06.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.132+0000 7fa2e4279700 1 -- 172.21.15.1:0/4101181680 shutdown_connections 2023-11-15T01:34:06.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.132+0000 7fa2e4279700 1 -- 172.21.15.1:0/4101181680 wait complete. 2023-11-15T01:34:06.137 INFO:teuthology.orchestra.run.smithi001.stderr:updated caps for client.0 2023-11-15T01:34:06.146 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:34:06.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.263+0000 7fec4a1a6700 1 Processor -- start 2023-11-15T01:34:06.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.263+0000 7fec4a1a6700 1 -- start start 2023-11-15T01:34:06.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec4a1a6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fec44154150 0x7fec44154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:06.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec4a1a6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fec440ab1a0 0x7fec44158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:06.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec4a1a6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec440aa060 0x7fec440c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:06.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec4a1a6700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec440c06f0 con 0x7fec440ab1a0 2023-11-15T01:34:06.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec4a1a6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec440c09d0 con 0x7fec44154150 2023-11-15T01:34:06.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec4a1a6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec44158820 con 0x7fec440aa060 2023-11-15T01:34:06.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec42ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fec440ab1a0 0x7fec44158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:06.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec42ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fec440ab1a0 0x7fec44158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50304/0 (socket says 172.21.15.1:50304) 2023-11-15T01:34:06.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec42ffd700 1 -- 172.21.15.1:0/2684648428 learned_addr learned my addr 172.21.15.1:0/2684648428 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:06.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec43fff700 1 --2- 172.21.15.1:0/2684648428 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec440aa060 0x7fec440c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:06.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec437fe700 1 --2- 172.21.15.1:0/2684648428 >> v2:172.21.15.141:3300/0 conn(0x7fec44154150 0x7fec44154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:06.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec42ffd700 1 -- 172.21.15.1:0/2684648428 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec440aa060 msgr2=0x7fec440c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:06.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec42ffd700 1 --2- 172.21.15.1:0/2684648428 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec440aa060 0x7fec440c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:06.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec42ffd700 1 -- 172.21.15.1:0/2684648428 >> v2:172.21.15.141:3300/0 conn(0x7fec44154150 msgr2=0x7fec44154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:06.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec42ffd700 1 --2- 172.21.15.1:0/2684648428 >> v2:172.21.15.141:3300/0 conn(0x7fec44154150 0x7fec44154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:06.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec42ffd700 1 -- 172.21.15.1:0/2684648428 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec44158b00 con 0x7fec440ab1a0 2023-11-15T01:34:06.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec437fe700 1 --2- 172.21.15.1:0/2684648428 >> v2:172.21.15.141:3300/0 conn(0x7fec44154150 0x7fec44154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:34:06.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec42ffd700 1 --2- 172.21.15.1:0/2684648428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec440ab1a0 0x7fec44158040 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fec4406bfb0 tx=0x7fec340090f0).ready entity=mon.0 client_cookie=585e1aab32dad951 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:06.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.264+0000 7fec427fc700 1 -- 172.21.15.1:0/2684648428 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3400b520 con 0x7fec440ab1a0 2023-11-15T01:34:06.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.265+0000 7fec427fc700 1 -- 172.21.15.1:0/2684648428 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3400b680 con 0x7fec440ab1a0 2023-11-15T01:34:06.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.265+0000 7fec427fc700 1 -- 172.21.15.1:0/2684648428 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3400ba20 con 0x7fec440ab1a0 2023-11-15T01:34:06.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.265+0000 7fec4a1a6700 1 -- 172.21.15.1:0/2684648428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec440ab1a0 msgr2=0x7fec44158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:06.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.265+0000 7fec4a1a6700 1 --2- 172.21.15.1:0/2684648428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec440ab1a0 0x7fec44158040 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fec4406bfb0 tx=0x7fec340090f0).stop 2023-11-15T01:34:06.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.265+0000 7fec4a1a6700 1 -- 172.21.15.1:0/2684648428 shutdown_connections 2023-11-15T01:34:06.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.265+0000 7fec4a1a6700 1 --2- 172.21.15.1:0/2684648428 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec440aa060 0x7fec440c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:06.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.265+0000 7fec4a1a6700 1 --2- 172.21.15.1:0/2684648428 >> v2:172.21.15.141:3300/0 conn(0x7fec44154150 0x7fec44154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:06.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.265+0000 7fec4a1a6700 1 --2- 172.21.15.1:0/2684648428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec440ab1a0 0x7fec44158040 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:06.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.265+0000 7fec4a1a6700 1 -- 172.21.15.1:0/2684648428 >> 172.21.15.1:0/2684648428 conn(0x7fec44064aa0 msgr2=0x7fec44064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:06.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.265+0000 7fec4a1a6700 1 -- 172.21.15.1:0/2684648428 shutdown_connections 2023-11-15T01:34:06.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.265+0000 7fec4a1a6700 1 -- 172.21.15.1:0/2684648428 wait complete. 2023-11-15T01:34:06.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.266+0000 7fec4a1a6700 1 Processor -- start 2023-11-15T01:34:06.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.266+0000 7fec4a1a6700 1 -- start start 2023-11-15T01:34:06.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.267+0000 7fec4a1a6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec440aa060 0x7fec44147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:06.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.267+0000 7fec4a1a6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec440ab1a0 0x7fec44154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:06.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.267+0000 7fec4a1a6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec44154150 0x7fec44155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:06.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.267+0000 7fec4a1a6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec44156080 con 0x7fec440aa060 2023-11-15T01:34:06.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.267+0000 7fec4a1a6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec44148170 con 0x7fec440ab1a0 2023-11-15T01:34:06.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.267+0000 7fec4a1a6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec441557e0 con 0x7fec44154150 2023-11-15T01:34:06.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.267+0000 7fec437fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec440aa060 0x7fec44147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:06.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.267+0000 7fec437fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec440aa060 0x7fec44147c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50316/0 (socket says 172.21.15.1:50316) 2023-11-15T01:34:06.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.267+0000 7fec437fe700 1 -- 172.21.15.1:0/279370890 learned_addr learned my addr 172.21.15.1:0/279370890 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:06.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.267+0000 7fec43fff700 1 --2- 172.21.15.1:0/279370890 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec44154150 0x7fec44155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:06.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.267+0000 7fec42ffd700 1 --2- 172.21.15.1:0/279370890 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec440ab1a0 0x7fec44154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:06.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.267+0000 7fec437fe700 1 -- 172.21.15.1:0/279370890 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec44154150 msgr2=0x7fec44155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:06.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.267+0000 7fec437fe700 1 --2- 172.21.15.1:0/279370890 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec44154150 0x7fec44155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:06.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.267+0000 7fec437fe700 1 -- 172.21.15.1:0/279370890 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec440ab1a0 msgr2=0x7fec44154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:06.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.268+0000 7fec437fe700 1 --2- 172.21.15.1:0/279370890 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec440ab1a0 0x7fec44154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:06.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.268+0000 7fec437fe700 1 -- 172.21.15.1:0/279370890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec34009370 con 0x7fec440aa060 2023-11-15T01:34:06.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.268+0000 7fec437fe700 1 --2- 172.21.15.1:0/279370890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec440aa060 0x7fec44147c80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fec2c00d8c0 tx=0x7fec2c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:06.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.268+0000 7fec3b7fe700 1 -- 172.21.15.1:0/279370890 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c011590 con 0x7fec440aa060 2023-11-15T01:34:06.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.268+0000 7fec3b7fe700 1 -- 172.21.15.1:0/279370890 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2c0116f0 con 0x7fec440aa060 2023-11-15T01:34:06.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.268+0000 7fec4a1a6700 1 -- 172.21.15.1:0/279370890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec44155ac0 con 0x7fec440aa060 2023-11-15T01:34:06.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.268+0000 7fec3b7fe700 1 -- 172.21.15.1:0/279370890 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c011a70 con 0x7fec440aa060 2023-11-15T01:34:06.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.268+0000 7fec4a1a6700 1 -- 172.21.15.1:0/279370890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec440ca200 con 0x7fec440aa060 2023-11-15T01:34:06.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.269+0000 7fec4a1a6700 1 -- 172.21.15.1:0/279370890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4406c7e0 con 0x7fec440aa060 2023-11-15T01:34:06.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.269+0000 7fec3b7fe700 1 -- 172.21.15.1:0/279370890 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fec2c012420 con 0x7fec440aa060 2023-11-15T01:34:06.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.269+0000 7fec3b7fe700 1 --2- 172.21.15.1:0/279370890 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec2405f270 0x7fec24061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:06.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.270+0000 7fec3b7fe700 1 -- 172.21.15.1:0/279370890 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7fec2c079e80 con 0x7fec440aa060 2023-11-15T01:34:06.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.270+0000 7fec42ffd700 1 --2- 172.21.15.1:0/279370890 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec2405f270 0x7fec24061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:06.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.270+0000 7fec42ffd700 1 --2- 172.21.15.1:0/279370890 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec2405f270 0x7fec24061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fec3400b2e0 tx=0x7fec34017000).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:06.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.274+0000 7fec3b7fe700 1 -- 172.21.15.1:0/279370890 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fec2c04ade0 con 0x7fec440aa060 2023-11-15T01:34:06.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.488+0000 7fec4a1a6700 1 -- 172.21.15.1:0/279370890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec440ca570 con 0x7fec440aa060 2023-11-15T01:34:06.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.489+0000 7fec3b7fe700 1 -- 172.21.15.1:0/279370890 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7fec2c04e400 con 0x7fec440aa060 2023-11-15T01:34:06.491 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:34:06.491 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2009331607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2009331607},{"type":"v1","addr":"172.21.15.141:6836","nonce":2009331607}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3766593810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3766593810},{"type":"v1","addr":"172.21.15.1:6834","nonce":3766593810}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3751372395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3751372395},{"type":"v1","addr":"172.21.15.1:6835","nonce":3751372395}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:33:56.848117+0000","modified":"2023-11-15T01:33:59.859174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5802":{"gid":5802,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/3696653258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3696653258},{"type":"v1","addr":"172.21.15.141:6837","nonce":3696653258}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-11-15T01:34:06.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.491+0000 7fec4a1a6700 1 -- 172.21.15.1:0/279370890 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec2405f270 msgr2=0x7fec24061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:06.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.491+0000 7fec4a1a6700 1 --2- 172.21.15.1:0/279370890 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec2405f270 0x7fec24061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fec3400b2e0 tx=0x7fec34017000).stop 2023-11-15T01:34:06.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.491+0000 7fec4a1a6700 1 -- 172.21.15.1:0/279370890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec440aa060 msgr2=0x7fec44147c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:06.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.491+0000 7fec4a1a6700 1 --2- 172.21.15.1:0/279370890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec440aa060 0x7fec44147c80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fec2c00d8c0 tx=0x7fec2c008040).stop 2023-11-15T01:34:06.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.491+0000 7fec4a1a6700 1 -- 172.21.15.1:0/279370890 shutdown_connections 2023-11-15T01:34:06.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.491+0000 7fec4a1a6700 1 --2- 172.21.15.1:0/279370890 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fec2405f270 0x7fec24061730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:06.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.491+0000 7fec4a1a6700 1 --2- 172.21.15.1:0/279370890 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec44154150 0x7fec44155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:06.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.491+0000 7fec4a1a6700 1 --2- 172.21.15.1:0/279370890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec440aa060 0x7fec44147c80 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:06.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.491+0000 7fec4a1a6700 1 --2- 172.21.15.1:0/279370890 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec440ab1a0 0x7fec44154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:06.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.491+0000 7fec4a1a6700 1 -- 172.21.15.1:0/279370890 >> 172.21.15.1:0/279370890 conn(0x7fec44064aa0 msgr2=0x7fec441598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:06.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.491+0000 7fec4a1a6700 1 -- 172.21.15.1:0/279370890 shutdown_connections 2023-11-15T01:34:06.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:06.491+0000 7fec4a1a6700 1 -- 172.21.15.1:0/279370890 wait complete. 2023-11-15T01:34:06.495 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 23 2023-11-15T01:34:06.907 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-15T01:33:56.848117+0000', 'modified': '2023-11-15T01:33:59.859174+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5802}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5802': {'gid': 5802, 'name': 'd', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.141:6837/3696653258', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6835', 'nonce': 3696653258}, {'type': 'v1', 'addr': '172.21.15.141:6837', 'nonce': 3696653258}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-15T01:34:06.908 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-15T01:34:06.909 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-15T01:34:07.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.028+0000 7f15f609a700 1 Processor -- start 2023-11-15T01:34:07.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.028+0000 7f15f609a700 1 -- start start 2023-11-15T01:34:07.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.029+0000 7f15f609a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15f0151e10 0x7f15f0155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.029+0000 7f15f609a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f15f00c98b0 0x7f15f00c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.029+0000 7f15f609a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f00c7980 con 0x7f15f00c86b0 2023-11-15T01:34:07.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.029+0000 7f15f609a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f00c8b10 con 0x7f15f00c98b0 2023-11-15T01:34:07.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.029+0000 7f15f609a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00ca230 con 0x7f15f0151e10 2023-11-15T01:34:07.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.029+0000 7f15f5899700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f15f00c98b0 0x7f15f00c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.029+0000 7f15f4897700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f15f00c86b0 0x7f15f00aa0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58844/0 (socket says 172.21.15.1:58844) 2023-11-15T01:34:07.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.029+0000 7f15f4897700 1 -- 172.21.15.1:0/2641509959 learned_addr learned my addr 172.21.15.1:0/2641509959 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:34:07.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.029+0000 7f15f5098700 1 --2- 172.21.15.1:0/2641509959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15f0151e10 0x7f15f0155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.029+0000 7f15f5899700 1 -- 172.21.15.1:0/2641509959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15f0151e10 msgr2=0x7f15f0155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:07.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.029+0000 7f15f5899700 1 --2- 172.21.15.1:0/2641509959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15f0151e10 0x7f15f0155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.029+0000 7f15f5899700 1 -- 172.21.15.1:0/2641509959 >> v1:172.21.15.1:6789/0 conn(0x7f15f00c86b0 legacy=0x7f15f00aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.029+0000 7f15effff700 1 -- 172.21.15.1:0/2641509959 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873404507 0 0) 0x7f15f00c7980 con 0x7f15f00c86b0 2023-11-15T01:34:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.029+0000 7f15f5899700 1 -- 172.21.15.1:0/2641509959 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f00aa890 con 0x7f15f00c98b0 2023-11-15T01:34:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.029+0000 7f15f5899700 1 --2- 172.21.15.1:0/2641509959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15f00c98b0 0x7f15f00c9d40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f15e0009760 tx=0x7f15e0009060).ready entity=mon.0 client_cookie=4c98175ff7ee36ea server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.030+0000 7f15effff700 1 -- 172.21.15.1:0/2641509959 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e000b580 con 0x7f15f00c98b0 2023-11-15T01:34:07.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.030+0000 7f15effff700 1 -- 172.21.15.1:0/2641509959 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e000b6e0 con 0x7f15f00c98b0 2023-11-15T01:34:07.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.030+0000 7f15effff700 1 -- 172.21.15.1:0/2641509959 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e000ba60 con 0x7f15f00c98b0 2023-11-15T01:34:07.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.030+0000 7f15f609a700 1 -- 172.21.15.1:0/2641509959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15f00c98b0 msgr2=0x7f15f00c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.030+0000 7f15f609a700 1 --2- 172.21.15.1:0/2641509959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15f00c98b0 0x7f15f00c9d40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f15e0009760 tx=0x7f15e0009060).stop 2023-11-15T01:34:07.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.030+0000 7f15f609a700 1 -- 172.21.15.1:0/2641509959 shutdown_connections 2023-11-15T01:34:07.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.030+0000 7f15f609a700 1 --2- 172.21.15.1:0/2641509959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15f00c98b0 0x7f15f00c9d40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.030+0000 7f15f609a700 1 --2- 172.21.15.1:0/2641509959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15f0151e10 0x7f15f0155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.030+0000 7f15f609a700 1 -- 172.21.15.1:0/2641509959 >> 172.21.15.1:0/2641509959 conn(0x7f15f00947e0 msgr2=0x7f15f006a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:07.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.030+0000 7f15f609a700 1 -- 172.21.15.1:0/2641509959 shutdown_connections 2023-11-15T01:34:07.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.030+0000 7f15f609a700 1 -- 172.21.15.1:0/2641509959 wait complete. 2023-11-15T01:34:07.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.031+0000 7f15f609a700 1 Processor -- start 2023-11-15T01:34:07.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.031+0000 7f15f609a700 1 -- start start 2023-11-15T01:34:07.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.032+0000 7f15f609a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15f00c86b0 0x7f15f0155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.032+0000 7f15f609a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15f00c98b0 0x7f15f014ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.032+0000 7f15f609a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f15f0151e10 0x7f15f0152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.032+0000 7f15f609a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f0150480 con 0x7f15f00c86b0 2023-11-15T01:34:07.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.032+0000 7f15f609a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f0153750 con 0x7f15f0151e10 2023-11-15T01:34:07.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.032+0000 7f15f609a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f0153a30 con 0x7f15f00c98b0 2023-11-15T01:34:07.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.032+0000 7f15f5098700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15f00c86b0 0x7f15f0155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.032+0000 7f15f5098700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15f00c86b0 0x7f15f0155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50324/0 (socket says 172.21.15.1:50324) 2023-11-15T01:34:07.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.032+0000 7f15f5098700 1 -- 172.21.15.1:0/2400783813 learned_addr learned my addr 172.21.15.1:0/2400783813 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:07.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.033+0000 7f15f4897700 1 --2- 172.21.15.1:0/2400783813 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15f00c98b0 0x7f15f014ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.033+0000 7f15f5899700 1 --2- 172.21.15.1:0/2400783813 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f15f0151e10 0x7f15f0152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.033+0000 7f15f5098700 1 -- 172.21.15.1:0/2400783813 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15f00c98b0 msgr2=0x7f15f014ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.033+0000 7f15f5098700 1 --2- 172.21.15.1:0/2400783813 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15f00c98b0 0x7f15f014ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.033+0000 7f15f5098700 1 -- 172.21.15.1:0/2400783813 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f15f0151e10 msgr2=0x7f15f0152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.033+0000 7f15f5098700 1 --2- 172.21.15.1:0/2400783813 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f15f0151e10 0x7f15f0152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.033+0000 7f15f5098700 1 -- 172.21.15.1:0/2400783813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e00092a0 con 0x7f15f00c86b0 2023-11-15T01:34:07.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.033+0000 7f15f5098700 1 --2- 172.21.15.1:0/2400783813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15f00c86b0 0x7f15f0155480 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f15e800d890 tx=0x7f15e8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:07.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.033+0000 7f15ed7fa700 1 -- 172.21.15.1:0/2400783813 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e8011590 con 0x7f15f00c86b0 2023-11-15T01:34:07.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.033+0000 7f15ed7fa700 1 -- 172.21.15.1:0/2400783813 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e80116f0 con 0x7f15f00c86b0 2023-11-15T01:34:07.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.033+0000 7f15f609a700 1 -- 172.21.15.1:0/2400783813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f0153d10 con 0x7f15f00c86b0 2023-11-15T01:34:07.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.033+0000 7f15ed7fa700 1 -- 172.21.15.1:0/2400783813 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e8011a70 con 0x7f15f00c86b0 2023-11-15T01:34:07.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.033+0000 7f15f609a700 1 -- 172.21.15.1:0/2400783813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f0153430 con 0x7f15f00c86b0 2023-11-15T01:34:07.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.034+0000 7f15ed7fa700 1 -- 172.21.15.1:0/2400783813 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f15e8012420 con 0x7f15f00c86b0 2023-11-15T01:34:07.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.035+0000 7f15ed7fa700 1 --2- 172.21.15.1:0/2400783813 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f15dc05f270 0x7f15dc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.035+0000 7f15ed7fa700 1 -- 172.21.15.1:0/2400783813 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f15e8079ed0 con 0x7f15f00c86b0 2023-11-15T01:34:07.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.035+0000 7f15f4897700 1 --2- 172.21.15.1:0/2400783813 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f15dc05f270 0x7f15dc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.035+0000 7f15f4897700 1 --2- 172.21.15.1:0/2400783813 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f15dc05f270 0x7f15dc061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f15e4001560 tx=0x7f15e4007f30).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:07.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.037+0000 7f1608c95b80 1 Processor -- start 2023-11-15T01:34:07.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.037+0000 7f1608c95b80 1 -- start start 2023-11-15T01:34:07.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f1608c95b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130c948e40 0x56130cb8c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f1608c95b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbd54e0 0x56130cb8cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f1608c95b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130cbb4cf0 0x56130cb877e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f1608c95b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130cb52060 con 0x56130cbb4cf0 2023-11-15T01:34:07.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f1608c95b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130cac91f0 con 0x56130c948e40 2023-11-15T01:34:07.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f1608c95b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x56130cade440 con 0x56130cbd54e0 2023-11-15T01:34:07.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f15f5899700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130cbb4cf0 0x56130cb877e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f15f5899700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130cbb4cf0 0x56130cb877e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50338/0 (socket says 172.21.15.1:50338) 2023-11-15T01:34:07.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f15f5899700 1 -- 172.21.15.1:0/340231349 learned_addr learned my addr 172.21.15.1:0/340231349 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:07.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f15f5098700 1 --2- 172.21.15.1:0/340231349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130c948e40 0x56130cb8c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f15f4897700 1 --2- 172.21.15.1:0/340231349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbd54e0 0x56130cb8cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f15f5899700 1 -- 172.21.15.1:0/340231349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbd54e0 msgr2=0x56130cb8cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:07.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f15f5899700 1 --2- 172.21.15.1:0/340231349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbd54e0 0x56130cb8cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f15f5899700 1 -- 172.21.15.1:0/340231349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130c948e40 msgr2=0x56130cb8c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:07.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f15f5899700 1 --2- 172.21.15.1:0/340231349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130c948e40 0x56130cb8c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f15f5899700 1 -- 172.21.15.1:0/340231349 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56130cad7620 con 0x56130cbb4cf0 2023-11-15T01:34:07.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f15f5098700 1 --2- 172.21.15.1:0/340231349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130c948e40 0x56130cb8c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:34:07.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f15f5899700 1 --2- 172.21.15.1:0/340231349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130cbb4cf0 0x56130cb877e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f15f0084670 tx=0x7f15e0017000).ready entity=mon.0 client_cookie=8a26d15c4c5cf1d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:07.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.038+0000 7f15d67fc700 1 -- 172.21.15.1:0/340231349 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e000b850 con 0x56130cbb4cf0 2023-11-15T01:34:07.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.039+0000 7f15d67fc700 1 -- 172.21.15.1:0/340231349 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e000b9b0 con 0x56130cbb4cf0 2023-11-15T01:34:07.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.039+0000 7f15d67fc700 1 -- 172.21.15.1:0/340231349 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e0025640 con 0x56130cbb4cf0 2023-11-15T01:34:07.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.039+0000 7f1608c95b80 1 -- 172.21.15.1:0/340231349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130cbb4cf0 msgr2=0x56130cb877e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.039+0000 7f1608c95b80 1 --2- 172.21.15.1:0/340231349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130cbb4cf0 0x56130cb877e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f15f0084670 tx=0x7f15e0017000).stop 2023-11-15T01:34:07.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.039+0000 7f1608c95b80 1 -- 172.21.15.1:0/340231349 shutdown_connections 2023-11-15T01:34:07.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.039+0000 7f1608c95b80 1 --2- 172.21.15.1:0/340231349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130cbb4cf0 0x56130cb877e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.039+0000 7f1608c95b80 1 --2- 172.21.15.1:0/340231349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130c948e40 0x56130cb8c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.039+0000 7f1608c95b80 1 --2- 172.21.15.1:0/340231349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbd54e0 0x56130cb8cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.039+0000 7f1608c95b80 1 -- 172.21.15.1:0/340231349 >> 172.21.15.1:0/340231349 conn(0x56130c9f64a0 msgr2=0x56130cbd5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:07.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.039+0000 7f1608c95b80 1 -- 172.21.15.1:0/340231349 shutdown_connections 2023-11-15T01:34:07.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.039+0000 7f1608c95b80 1 -- 172.21.15.1:0/340231349 wait complete. 2023-11-15T01:34:07.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.040+0000 7f1608c95b80 1 -- start start 2023-11-15T01:34:07.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.040+0000 7f1608c95b80 1 Processor -- start 2023-11-15T01:34:07.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f1608c95b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130c948e40 0x56130cb87bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f1608c95b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130cbb4cf0 0x56130cbd49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f1608c95b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbd54e0 0x56130cbd3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f1608c95b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130cade580 con 0x56130c948e40 2023-11-15T01:34:07.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f1608c95b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130cade800 con 0x56130cbb4cf0 2023-11-15T01:34:07.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f1608c95b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x56130caa9e10 con 0x56130cbd54e0 2023-11-15T01:34:07.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f1608c95b80 10 client.0 ll_register_callbacks cb 0x56130cb4c640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:34:07.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f15f5098700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130c948e40 0x56130cb87bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f15f5098700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130c948e40 0x56130cb87bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50342/0 (socket says 172.21.15.1:50342) 2023-11-15T01:34:07.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f15f5098700 1 -- 172.21.15.1:0/3631700184 learned_addr learned my addr 172.21.15.1:0/3631700184 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:07.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f15f5899700 1 --2- 172.21.15.1:0/3631700184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbd54e0 0x56130cbd3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f15f4897700 1 --2- 172.21.15.1:0/3631700184 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130cbb4cf0 0x56130cbd49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f15f5098700 1 -- 172.21.15.1:0/3631700184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbd54e0 msgr2=0x56130cbd3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:07.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f15f5098700 1 --2- 172.21.15.1:0/3631700184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbd54e0 0x56130cbd3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f15f5098700 1 -- 172.21.15.1:0/3631700184 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130cbb4cf0 msgr2=0x56130cbd49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:07.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f15f5098700 1 --2- 172.21.15.1:0/3631700184 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130cbb4cf0 0x56130cbd49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f15f5098700 1 -- 172.21.15.1:0/3631700184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f00aa890 con 0x56130c948e40 2023-11-15T01:34:07.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f15f4897700 1 --2- 172.21.15.1:0/3631700184 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130cbb4cf0 0x56130cbd49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:34:07.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f15f5098700 1 --2- 172.21.15.1:0/3631700184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130c948e40 0x56130cb87bf0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f15e800b440 tx=0x7f15e8000bc0).ready entity=mon.0 client_cookie=ec9d7010f5dedcc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:07.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f15cf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:34:07.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f15cf7fe700 1 -- 172.21.15.1:0/3631700184 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e8059070 con 0x56130c948e40 2023-11-15T01:34:07.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f15cf7fe700 1 -- 172.21.15.1:0/3631700184 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f15e804cdd0 con 0x56130c948e40 2023-11-15T01:34:07.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.041+0000 7f1608c95b80 1 -- 172.21.15.1:0/3631700184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56130cb80720 con 0x56130c948e40 2023-11-15T01:34:07.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.042+0000 7f15cf7fe700 1 -- 172.21.15.1:0/3631700184 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15e804df20 con 0x56130c948e40 2023-11-15T01:34:07.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.042+0000 7f1608c95b80 10 client.5976 fetch_fsmap learned FSMap version 23 2023-11-15T01:34:07.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.042+0000 7f1608c95b80 1 -- 172.21.15.1:0/3631700184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x56130cad29c0 con 0x56130c948e40 2023-11-15T01:34:07.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.042+0000 7f15cf7fe700 1 -- 172.21.15.1:0/3631700184 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56130cb80720 con 0x56130c948e40 2023-11-15T01:34:07.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.042+0000 7f15cf7fe700 1 -- 172.21.15.1:0/3631700184 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f15e805c030 con 0x56130c948e40 2023-11-15T01:34:07.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.042+0000 7f1608c95b80 10 client.5976 fetch_fsmap finished waiting for FSMap version 23 2023-11-15T01:34:07.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.042+0000 7f1608c95b80 10 client.5976 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-15T01:34:07.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.042+0000 7f1608c95b80 20 client.5976 populate_metadata read hostname 'smithi001' 2023-11-15T01:34:07.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.042+0000 7f1608c95b80 1 --2- 172.21.15.1:0/3631700184 >> [v2:172.21.15.141:6835/3696653258,v1:172.21.15.141:6837/3696653258] conn(0x56130cbb0f90 0x56130cbb1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.042+0000 7f1608c95b80 4 client.5976 mds_command: new command op to 5802 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-15T01:34:07.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.042+0000 7f1608c95b80 1 -- 172.21.15.1:0/3631700184 --> [v2:172.21.15.141:6835/3696653258,v1:172.21.15.141:6837/3696653258] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56130c944ca0 con 0x56130cbb0f90 2023-11-15T01:34:07.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.042+0000 7f15f4897700 1 --2- 172.21.15.1:0/3631700184 >> [v2:172.21.15.141:6835/3696653258,v1:172.21.15.141:6837/3696653258] conn(0x56130cbb0f90 0x56130cbb1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.042+0000 7f15cf7fe700 10 client.5976 ms_handle_connect on v2:172.21.15.141:6835/3696653258 2023-11-15T01:34:07.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.042+0000 7f15f4897700 1 --2- 172.21.15.1:0/3631700184 >> [v2:172.21.15.141:6835/3696653258,v1:172.21.15.141:6837/3696653258] conn(0x56130cbb0f90 0x56130cbb1370 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e6dcdb5c401b3b89 server_cookie=c41826280a84d932 in_seq=0 out_seq=0 2023-11-15T01:34:07.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.043+0000 7f15cf7fe700 1 -- 172.21.15.1:0/3631700184 <== mds.0 v2:172.21.15.141:6835/3696653258 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x56130c944ca0 con 0x56130cbb0f90 2023-11-15T01:34:07.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.043+0000 7f15cf7fe700 10 client.5976 handle_command_reply: tid=0 2023-11-15T01:34:07.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.043+0000 7f1608c95b80 1 client.5976 shutdown 2023-11-15T01:34:07.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.043+0000 7f1608c95b80 1 -- 172.21.15.1:0/3631700184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130c948e40 msgr2=0x56130cb87bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.043+0000 7f1608c95b80 1 --2- 172.21.15.1:0/3631700184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130c948e40 0x56130cb87bf0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f15e800b440 tx=0x7f15e8000bc0).stop 2023-11-15T01:34:07.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.043+0000 7f1608c95b80 1 -- 172.21.15.1:0/3631700184 shutdown_connections 2023-11-15T01:34:07.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.043+0000 7f1608c95b80 1 --2- 172.21.15.1:0/3631700184 >> [v2:172.21.15.141:6835/3696653258,v1:172.21.15.141:6837/3696653258] conn(0x56130cbb0f90 0x56130cbb1370 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.043+0000 7f1608c95b80 1 --2- 172.21.15.1:0/3631700184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbd54e0 0x56130cbd3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.043+0000 7f1608c95b80 1 --2- 172.21.15.1:0/3631700184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130c948e40 0x56130cb87bf0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.043+0000 7f1608c95b80 1 --2- 172.21.15.1:0/3631700184 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130cbb4cf0 0x56130cbd49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.043+0000 7f15cf7fe700 0 client.5976 ms_handle_reset on v2:172.21.15.141:6835/3696653258 2023-11-15T01:34:07.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.043+0000 7f1608c95b80 1 -- 172.21.15.1:0/3631700184 >> 172.21.15.1:0/3631700184 conn(0x56130c9f64a0 msgr2=0x56130cb8a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:07.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.043+0000 7f1608c95b80 1 -- 172.21.15.1:0/3631700184 shutdown_connections 2023-11-15T01:34:07.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.043+0000 7f1608c95b80 1 -- 172.21.15.1:0/3631700184 wait complete. 2023-11-15T01:34:07.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.044+0000 7f1608c95b80 20 client.5976 trim_cache size 0 max 16384 2023-11-15T01:34:07.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.060+0000 7f1608c95b80 1 Processor -- start 2023-11-15T01:34:07.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.060+0000 7f1608c95b80 1 -- start start 2023-11-15T01:34:07.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f1608c95b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130c948e40 0x56130cb8d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f1608c95b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbb4cf0 0x56130cbb8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f1608c95b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130cbd54e0 0x56130cb87c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f1608c95b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130cbbba00 con 0x56130cbd54e0 2023-11-15T01:34:07.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f1608c95b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130cb8cad0 con 0x56130c948e40 2023-11-15T01:34:07.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f1608c95b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x56130cbd1b00 con 0x56130cbb4cf0 2023-11-15T01:34:07.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f15f5899700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130cbd54e0 0x56130cb87c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f15f5899700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130cbd54e0 0x56130cb87c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50352/0 (socket says 172.21.15.1:50352) 2023-11-15T01:34:07.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f15f5899700 1 -- 172.21.15.1:0/720315227 learned_addr learned my addr 172.21.15.1:0/720315227 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:07.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f15f4897700 1 --2- 172.21.15.1:0/720315227 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbb4cf0 0x56130cbb8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f15f5098700 1 --2- 172.21.15.1:0/720315227 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130c948e40 0x56130cb8d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f15f5899700 1 -- 172.21.15.1:0/720315227 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbb4cf0 msgr2=0x56130cbb8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:07.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f15f5899700 1 --2- 172.21.15.1:0/720315227 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbb4cf0 0x56130cbb8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f15f5899700 1 -- 172.21.15.1:0/720315227 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130c948e40 msgr2=0x56130cb8d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:07.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f15f5899700 1 --2- 172.21.15.1:0/720315227 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130c948e40 0x56130cb8d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f15f5899700 1 -- 172.21.15.1:0/720315227 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56130cad2710 con 0x56130cbd54e0 2023-11-15T01:34:07.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f15f5098700 1 --2- 172.21.15.1:0/720315227 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130c948e40 0x56130cb8d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:34:07.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.061+0000 7f15f5899700 1 --2- 172.21.15.1:0/720315227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130cbd54e0 0x56130cb87c00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f15e000b6b0 tx=0x7f15e001e040).ready entity=mon.0 client_cookie=f91861d7fb21a215 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:07.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.062+0000 7f15d6ffd700 1 -- 172.21.15.1:0/720315227 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e0006b30 con 0x56130cbd54e0 2023-11-15T01:34:07.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.062+0000 7f15d6ffd700 1 -- 172.21.15.1:0/720315227 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e002b040 con 0x56130cbd54e0 2023-11-15T01:34:07.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.062+0000 7f15d6ffd700 1 -- 172.21.15.1:0/720315227 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e0025640 con 0x56130cbd54e0 2023-11-15T01:34:07.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.062+0000 7f1608c95b80 1 -- 172.21.15.1:0/720315227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130cbd54e0 msgr2=0x56130cb87c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.062+0000 7f1608c95b80 1 --2- 172.21.15.1:0/720315227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130cbd54e0 0x56130cb87c00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f15e000b6b0 tx=0x7f15e001e040).stop 2023-11-15T01:34:07.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.062+0000 7f1608c95b80 1 -- 172.21.15.1:0/720315227 shutdown_connections 2023-11-15T01:34:07.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.062+0000 7f1608c95b80 1 --2- 172.21.15.1:0/720315227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130cbd54e0 0x56130cb87c00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.062+0000 7f1608c95b80 1 --2- 172.21.15.1:0/720315227 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130c948e40 0x56130cb8d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.062+0000 7f1608c95b80 1 --2- 172.21.15.1:0/720315227 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbb4cf0 0x56130cbb8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.062+0000 7f1608c95b80 1 -- 172.21.15.1:0/720315227 >> 172.21.15.1:0/720315227 conn(0x56130c9f64a0 msgr2=0x56130cbd5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:07.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.062+0000 7f1608c95b80 1 -- 172.21.15.1:0/720315227 shutdown_connections 2023-11-15T01:34:07.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.062+0000 7f1608c95b80 1 -- 172.21.15.1:0/720315227 wait complete. 2023-11-15T01:34:07.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.063+0000 7f1608c95b80 1 -- start start 2023-11-15T01:34:07.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.063+0000 7f1608c95b80 1 Processor -- start 2023-11-15T01:34:07.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f1608c95b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130c948e40 0x56130cb89530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f1608c95b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbb4cf0 0x56130cbbadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f1608c95b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130cbd54e0 0x56130cbbb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f1608c95b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130cc1e470 con 0x56130c948e40 2023-11-15T01:34:07.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f1608c95b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130cb84230 con 0x56130cbd54e0 2023-11-15T01:34:07.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f1608c95b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x56130cbbb7b0 con 0x56130cbb4cf0 2023-11-15T01:34:07.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f1608c95b80 10 client.0 ll_register_callbacks cb 0x56130cb4c640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:34:07.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15f5098700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130c948e40 0x56130cb89530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15f5098700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130c948e40 0x56130cb89530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50366/0 (socket says 172.21.15.1:50366) 2023-11-15T01:34:07.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15f5098700 1 -- 172.21.15.1:0/1863296300 learned_addr learned my addr 172.21.15.1:0/1863296300 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:07.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15f5899700 1 --2- 172.21.15.1:0/1863296300 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130cbd54e0 0x56130cbbb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15f4897700 1 --2- 172.21.15.1:0/1863296300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbb4cf0 0x56130cbbadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15f5098700 1 -- 172.21.15.1:0/1863296300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbb4cf0 msgr2=0x56130cbbadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:07.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15f5098700 1 --2- 172.21.15.1:0/1863296300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbb4cf0 0x56130cbbadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15f5098700 1 -- 172.21.15.1:0/1863296300 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130cbd54e0 msgr2=0x56130cbbb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:07.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15f5098700 1 --2- 172.21.15.1:0/1863296300 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130cbd54e0 0x56130cbbb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15f5098700 1 -- 172.21.15.1:0/1863296300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56130cad7620 con 0x56130c948e40 2023-11-15T01:34:07.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15f4897700 1 --2- 172.21.15.1:0/1863296300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbb4cf0 0x56130cbbadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:34:07.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15f5098700 1 --2- 172.21.15.1:0/1863296300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130c948e40 0x56130cb89530 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f15e804b370 tx=0x7f15e8057000).ready entity=mon.0 client_cookie=b6c8d6e31c070f4c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:07.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15cf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:34:07.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15cf7fe700 1 -- 172.21.15.1:0/1863296300 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e8059030 con 0x56130c948e40 2023-11-15T01:34:07.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15cf7fe700 1 -- 172.21.15.1:0/1863296300 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f15e804ce50 con 0x56130c948e40 2023-11-15T01:34:07.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f1608c95b80 1 -- 172.21.15.1:0/1863296300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15e000b9b0 con 0x56130c948e40 2023-11-15T01:34:07.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f15cf7fe700 1 -- 172.21.15.1:0/1863296300 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15e804a820 con 0x56130c948e40 2023-11-15T01:34:07.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f1608c95b80 10 client.5982 fetch_fsmap learned FSMap version 23 2023-11-15T01:34:07.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.064+0000 7f1608c95b80 1 -- 172.21.15.1:0/1863296300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x56130c949f80 con 0x56130c948e40 2023-11-15T01:34:07.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.065+0000 7f15cf7fe700 1 -- 172.21.15.1:0/1863296300 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e000b9b0 con 0x56130c948e40 2023-11-15T01:34:07.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.065+0000 7f15cf7fe700 1 -- 172.21.15.1:0/1863296300 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f15e805c040 con 0x56130c948e40 2023-11-15T01:34:07.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.065+0000 7f1608c95b80 10 client.5982 fetch_fsmap finished waiting for FSMap version 23 2023-11-15T01:34:07.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.065+0000 7f1608c95b80 10 client.5982 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-15T01:34:07.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.065+0000 7f1608c95b80 20 client.5982 populate_metadata read hostname 'smithi001' 2023-11-15T01:34:07.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.065+0000 7f1608c95b80 1 --2- 172.21.15.1:0/1863296300 >> [v2:172.21.15.141:6835/3696653258,v1:172.21.15.141:6837/3696653258] conn(0x56130cc1cd50 0x56130cc1d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.065+0000 7f1608c95b80 4 client.5982 mds_command: new command op to 5802 tid=0[{"prefix": "status"}] 2023-11-15T01:34:07.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.065+0000 7f1608c95b80 1 -- 172.21.15.1:0/1863296300 --> [v2:172.21.15.141:6835/3696653258,v1:172.21.15.141:6837/3696653258] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56130c97bca0 con 0x56130cc1cd50 2023-11-15T01:34:07.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.065+0000 7f15f4897700 1 --2- 172.21.15.1:0/1863296300 >> [v2:172.21.15.141:6835/3696653258,v1:172.21.15.141:6837/3696653258] conn(0x56130cc1cd50 0x56130cc1d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.065+0000 7f15cf7fe700 10 client.5982 ms_handle_connect on v2:172.21.15.141:6835/3696653258 2023-11-15T01:34:07.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.065+0000 7f15f4897700 1 --2- 172.21.15.1:0/1863296300 >> [v2:172.21.15.141:6835/3696653258,v1:172.21.15.141:6837/3696653258] conn(0x56130cc1cd50 0x56130cc1d360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=eec914c26bc34ecb server_cookie=f0751813ed2efa91 in_seq=0 out_seq=0 2023-11-15T01:34:07.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.065+0000 7f15cf7fe700 1 -- 172.21.15.1:0/1863296300 <== mds.0 v2:172.21.15.141:6835/3696653258 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56130c97bca0 con 0x56130cc1cd50 2023-11-15T01:34:07.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f15cf7fe700 10 client.5982 handle_command_reply: tid=0 2023-11-15T01:34:07.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f1608c95b80 1 client.5982 shutdown 2023-11-15T01:34:07.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f1608c95b80 1 -- 172.21.15.1:0/1863296300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130c948e40 msgr2=0x56130cb89530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f1608c95b80 1 --2- 172.21.15.1:0/1863296300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130c948e40 0x56130cb89530 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f15e804b370 tx=0x7f15e8057000).stop 2023-11-15T01:34:07.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f1608c95b80 1 -- 172.21.15.1:0/1863296300 shutdown_connections 2023-11-15T01:34:07.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f1608c95b80 1 --2- 172.21.15.1:0/1863296300 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56130cbd54e0 0x56130cbbb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f1608c95b80 1 --2- 172.21.15.1:0/1863296300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56130c948e40 0x56130cb89530 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f1608c95b80 1 --2- 172.21.15.1:0/1863296300 >> [v2:172.21.15.141:6835/3696653258,v1:172.21.15.141:6837/3696653258] conn(0x56130cc1cd50 0x56130cc1d360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f1608c95b80 1 --2- 172.21.15.1:0/1863296300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56130cbb4cf0 0x56130cbbadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f1608c95b80 1 -- 172.21.15.1:0/1863296300 >> 172.21.15.1:0/1863296300 conn(0x56130c9f64a0 msgr2=0x56130cbd5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f15cf7fe700 0 client.5982 ms_handle_reset on v2:172.21.15.141:6835/3696653258 2023-11-15T01:34:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f1608c95b80 1 -- 172.21.15.1:0/1863296300 shutdown_connections 2023-11-15T01:34:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f1608c95b80 1 -- 172.21.15.1:0/1863296300 wait complete. 2023-11-15T01:34:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f1608c95b80 20 client.5982 trim_cache size 0 max 16384 2023-11-15T01:34:07.102 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T01:34:07.102 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "32ffb44b-12dc-4e79-bad7-24a9692dabf6", 2023-11-15T01:34:07.102 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2023-11-15T01:34:07.103 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 5802, 2023-11-15T01:34:07.103 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2023-11-15T01:34:07.103 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2023-11-15T01:34:07.103 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2023-11-15T01:34:07.103 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 10.217501507, 2023-11-15T01:34:07.104 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 23, 2023-11-15T01:34:07.104 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 61, 2023-11-15T01:34:07.104 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 61, 2023-11-15T01:34:07.104 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 15.712396419999999 2023-11-15T01:34:07.105 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T01:34:07.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f15f609a700 1 -- 172.21.15.1:0/2400783813 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f15dc05f270 msgr2=0x7f15dc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f15f609a700 1 --2- 172.21.15.1:0/2400783813 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f15dc05f270 0x7f15dc061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f15e4001560 tx=0x7f15e4007f30).stop 2023-11-15T01:34:07.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f15f609a700 1 -- 172.21.15.1:0/2400783813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15f00c86b0 msgr2=0x7f15f0155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f15f609a700 1 --2- 172.21.15.1:0/2400783813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15f00c86b0 0x7f15f0155480 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f15e800d890 tx=0x7f15e8008040).stop 2023-11-15T01:34:07.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f15f609a700 1 -- 172.21.15.1:0/2400783813 shutdown_connections 2023-11-15T01:34:07.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f15f609a700 1 --2- 172.21.15.1:0/2400783813 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f15dc05f270 0x7f15dc061730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f15f609a700 1 --2- 172.21.15.1:0/2400783813 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f15f0151e10 0x7f15f0152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f15f609a700 1 --2- 172.21.15.1:0/2400783813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15f00c86b0 0x7f15f0155480 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f15f609a700 1 --2- 172.21.15.1:0/2400783813 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15f00c98b0 0x7f15f014ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f15f609a700 1 -- 172.21.15.1:0/2400783813 >> 172.21.15.1:0/2400783813 conn(0x7f15f00947e0 msgr2=0x7f15f00a7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:07.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.066+0000 7f15f609a700 1 -- 172.21.15.1:0/2400783813 shutdown_connections 2023-11-15T01:34:07.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.067+0000 7f15f609a700 1 -- 172.21.15.1:0/2400783813 wait complete. 2023-11-15T01:34:07.110 DEBUG:teuthology.orchestra.run.smithi001:> ceph fs ls 2023-11-15T01:34:07.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.213+0000 7fb7f359e700 1 Processor -- start 2023-11-15T01:34:07.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.213+0000 7fb7f359e700 1 -- start start 2023-11-15T01:34:07.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.214+0000 7fb7f359e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb7f41540d0 0x7fb7f4158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.214+0000 7fb7f359e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7f41544b0 0x7fb7f40c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.214+0000 7fb7f359e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f40c3ef0 con 0x7fb7f40c4da0 2023-11-15T01:34:07.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.214+0000 7fb7f359e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f40c55f0 con 0x7fb7f41540d0 2023-11-15T01:34:07.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.214+0000 7fb7f359e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40c35c0 con 0x7fb7f41544b0 2023-11-15T01:34:07.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.214+0000 7fb7f2d9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb7f40c4da0 0x7fb7f40642b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58848/0 (socket says 172.21.15.1:58848) 2023-11-15T01:34:07.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.214+0000 7fb7f2d9d700 1 -- 172.21.15.1:0/3461388419 learned_addr learned my addr 172.21.15.1:0/3461388419 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:34:07.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.214+0000 7fb7f1d9b700 1 --2- 172.21.15.1:0/3461388419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7f41544b0 0x7fb7f40c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.214+0000 7fb7f259c700 1 --2- 172.21.15.1:0/3461388419 >> v2:172.21.15.141:3300/0 conn(0x7fb7f41540d0 0x7fb7f4158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.214+0000 7fb7f159a700 1 -- 172.21.15.1:0/3461388419 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792875345 0 0) 0x7fb7f40c3ef0 con 0x7fb7f40c4da0 2023-11-15T01:34:07.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.214+0000 7fb7f159a700 1 -- 172.21.15.1:0/3461388419 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e00033f0 con 0x7fb7f40c4da0 2023-11-15T01:34:07.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f159a700 1 -- 172.21.15.1:0/3461388419 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4023613960 0 0) 0x7fb7e00033f0 con 0x7fb7f40c4da0 2023-11-15T01:34:07.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f159a700 1 -- 172.21.15.1:0/3461388419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7f41544b0 msgr2=0x7fb7f40c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:07.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f159a700 1 --2- 172.21.15.1:0/3461388419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7f41544b0 0x7fb7f40c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f159a700 1 -- 172.21.15.1:0/3461388419 >> v2:172.21.15.141:3300/0 conn(0x7fb7f41540d0 msgr2=0x7fb7f4158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:07.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f159a700 1 --2- 172.21.15.1:0/3461388419 >> v2:172.21.15.141:3300/0 conn(0x7fb7f41540d0 0x7fb7f4158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f159a700 1 -- 172.21.15.1:0/3461388419 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f40c38a0 con 0x7fb7f40c4da0 2023-11-15T01:34:07.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f159a700 1 -- 172.21.15.1:0/3461388419 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fb7ec001470 con 0x7fb7f40c4da0 2023-11-15T01:34:07.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f159a700 1 -- 172.21.15.1:0/3461388419 >> v1:172.21.15.1:6789/0 conn(0x7fb7f40c4da0 legacy=0x7fb7f40642b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f159a700 1 --2- 172.21.15.1:0/3461388419 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7e00038e0 0x7fb7e0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f159a700 1 --2- 172.21.15.1:0/3461388419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e0004690 0x7fb7e0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f159a700 1 --2- 172.21.15.1:0/3461388419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7f41544b0 0x7fb7e0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f159a700 1 -- 172.21.15.1:0/3461388419 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40c55f0 con 0x7fb7e0004690 2023-11-15T01:34:07.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f159a700 1 -- 172.21.15.1:0/3461388419 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40c35c0 con 0x7fb7e00038e0 2023-11-15T01:34:07.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f159a700 1 -- 172.21.15.1:0/3461388419 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e000b8e0 con 0x7fb7f41544b0 2023-11-15T01:34:07.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f1d9b700 1 --2- 172.21.15.1:0/3461388419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e0004690 0x7fb7e0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f259c700 1 --2- 172.21.15.1:0/3461388419 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7e00038e0 0x7fb7e0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f2d9d700 1 --2- 172.21.15.1:0/3461388419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7f41544b0 0x7fb7e0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f1d9b700 1 -- 172.21.15.1:0/3461388419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7f41544b0 msgr2=0x7fb7e0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:07.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f1d9b700 1 --2- 172.21.15.1:0/3461388419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7f41544b0 0x7fb7e0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f1d9b700 1 -- 172.21.15.1:0/3461388419 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7e00038e0 msgr2=0x7fb7e0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:07.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f1d9b700 1 --2- 172.21.15.1:0/3461388419 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7e00038e0 0x7fb7e0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f1d9b700 1 -- 172.21.15.1:0/3461388419 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e00033f0 con 0x7fb7e0004690 2023-11-15T01:34:07.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f259c700 1 --2- 172.21.15.1:0/3461388419 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7e00038e0 0x7fb7e0003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:34:07.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.215+0000 7fb7f1d9b700 1 --2- 172.21.15.1:0/3461388419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e0004690 0x7fb7e0004b10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fb7dc009a60 tx=0x7fb7dc009060).ready entity=mon.0 client_cookie=d9f0d7be3e08489c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:07.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.216+0000 7fb7f159a700 1 -- 172.21.15.1:0/3461388419 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc009ea0 con 0x7fb7e0004690 2023-11-15T01:34:07.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.216+0000 7fb7f159a700 1 -- 172.21.15.1:0/3461388419 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7dc009430 con 0x7fb7e0004690 2023-11-15T01:34:07.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.216+0000 7fb7f159a700 1 -- 172.21.15.1:0/3461388419 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc00e870 con 0x7fb7e0004690 2023-11-15T01:34:07.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.216+0000 7fb7f359e700 1 -- 172.21.15.1:0/3461388419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e0004690 msgr2=0x7fb7e0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.216+0000 7fb7f359e700 1 --2- 172.21.15.1:0/3461388419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e0004690 0x7fb7e0004b10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fb7dc009a60 tx=0x7fb7dc009060).stop 2023-11-15T01:34:07.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.216+0000 7fb7f2d9d700 1 -- 172.21.15.1:0/3461388419 reap_dead start 2023-11-15T01:34:07.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.216+0000 7fb7f359e700 1 -- 172.21.15.1:0/3461388419 shutdown_connections 2023-11-15T01:34:07.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.216+0000 7fb7f359e700 1 -- 172.21.15.1:0/3461388419 >> 172.21.15.1:0/3461388419 conn(0x7fb7f4067550 msgr2=0x7fb7f40c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:07.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.216+0000 7fb7f359e700 1 -- 172.21.15.1:0/3461388419 shutdown_connections 2023-11-15T01:34:07.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.216+0000 7fb7f359e700 1 -- 172.21.15.1:0/3461388419 wait complete. 2023-11-15T01:34:07.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.217+0000 7fb7f359e700 1 Processor -- start 2023-11-15T01:34:07.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.217+0000 7fb7f359e700 1 -- start start 2023-11-15T01:34:07.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.218+0000 7fb7f359e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e0004690 0x7fb7f40aea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.218+0000 7fb7f359e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7f4155d80 0x7fb7f40c2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.218+0000 7fb7f359e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7f40c2680 0x7fb7f40c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.218+0000 7fb7f359e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40ac410 con 0x7fb7e0004690 2023-11-15T01:34:07.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.218+0000 7fb7f359e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40ae580 con 0x7fb7f40c2680 2023-11-15T01:34:07.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.218+0000 7fb7f359e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40c2ae0 con 0x7fb7f4155d80 2023-11-15T01:34:07.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.218+0000 7fb7f259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e0004690 0x7fb7f40aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.218+0000 7fb7f259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e0004690 0x7fb7f40aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50388/0 (socket says 172.21.15.1:50388) 2023-11-15T01:34:07.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.218+0000 7fb7f259c700 1 -- 172.21.15.1:0/2821440704 learned_addr learned my addr 172.21.15.1:0/2821440704 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:07.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.218+0000 7fb7f1d9b700 1 --2- 172.21.15.1:0/2821440704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7f4155d80 0x7fb7f40c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.218+0000 7fb7f2d9d700 1 --2- 172.21.15.1:0/2821440704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7f40c2680 0x7fb7f40c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.219+0000 7fb7f259c700 1 -- 172.21.15.1:0/2821440704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7f4155d80 msgr2=0x7fb7f40c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.219+0000 7fb7f259c700 1 --2- 172.21.15.1:0/2821440704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7f4155d80 0x7fb7f40c2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.219+0000 7fb7f259c700 1 -- 172.21.15.1:0/2821440704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7f40c2680 msgr2=0x7fb7f40c0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.219+0000 7fb7f259c700 1 --2- 172.21.15.1:0/2821440704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7f40c2680 0x7fb7f40c0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.219+0000 7fb7f259c700 1 -- 172.21.15.1:0/2821440704 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f40ad970 con 0x7fb7e0004690 2023-11-15T01:34:07.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.219+0000 7fb7f259c700 1 --2- 172.21.15.1:0/2821440704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e0004690 0x7fb7f40aea10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fb7e400f330 tx=0x7fb7e400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:07.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.219+0000 7fb7ea7fc700 1 -- 172.21.15.1:0/2821440704 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400e040 con 0x7fb7e0004690 2023-11-15T01:34:07.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.219+0000 7fb7ea7fc700 1 -- 172.21.15.1:0/2821440704 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e400f040 con 0x7fb7e0004690 2023-11-15T01:34:07.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.219+0000 7fb7f359e700 1 -- 172.21.15.1:0/2821440704 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f40adc50 con 0x7fb7e0004690 2023-11-15T01:34:07.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.219+0000 7fb7ea7fc700 1 -- 172.21.15.1:0/2821440704 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4015660 con 0x7fb7e0004690 2023-11-15T01:34:07.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.219+0000 7fb7f359e700 1 -- 172.21.15.1:0/2821440704 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f40ae210 con 0x7fb7e0004690 2023-11-15T01:34:07.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.220+0000 7fb7f359e700 1 -- 172.21.15.1:0/2821440704 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f40ae860 con 0x7fb7e0004690 2023-11-15T01:34:07.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.220+0000 7fb7ea7fc700 1 -- 172.21.15.1:0/2821440704 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb7e4003020 con 0x7fb7e0004690 2023-11-15T01:34:07.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.221+0000 7fb7ea7fc700 1 --2- 172.21.15.1:0/2821440704 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb7d405f240 0x7fb7d4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:07.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.221+0000 7fb7ea7fc700 1 -- 172.21.15.1:0/2821440704 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7fb7e407b1f0 con 0x7fb7e0004690 2023-11-15T01:34:07.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.221+0000 7fb7f1d9b700 1 --2- 172.21.15.1:0/2821440704 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb7d405f240 0x7fb7d4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:07.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.221+0000 7fb7f1d9b700 1 --2- 172.21.15.1:0/2821440704 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb7d405f240 0x7fb7d4061700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb7f414c0b0 tx=0x7fb7dc01a000).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:07.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.225+0000 7fb7ea7fc700 1 -- 172.21.15.1:0/2821440704 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb7e404c1b0 con 0x7fb7e0004690 2023-11-15T01:34:07.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.443+0000 7fb7f359e700 1 -- 172.21.15.1:0/2821440704 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb7f40aef00 con 0x7fb7e0004690 2023-11-15T01:34:07.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.443+0000 7fb7ea7fc700 1 -- 172.21.15.1:0/2821440704 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb7e4019070 con 0x7fb7e0004690 2023-11-15T01:34:07.445 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-15T01:34:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.445+0000 7fb7f359e700 1 -- 172.21.15.1:0/2821440704 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb7d405f240 msgr2=0x7fb7d4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.445+0000 7fb7f359e700 1 --2- 172.21.15.1:0/2821440704 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb7d405f240 0x7fb7d4061700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb7f414c0b0 tx=0x7fb7dc01a000).stop 2023-11-15T01:34:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.445+0000 7fb7f359e700 1 -- 172.21.15.1:0/2821440704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e0004690 msgr2=0x7fb7f40aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.445+0000 7fb7f359e700 1 --2- 172.21.15.1:0/2821440704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e0004690 0x7fb7f40aea10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fb7e400f330 tx=0x7fb7e400b040).stop 2023-11-15T01:34:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.445+0000 7fb7f359e700 1 -- 172.21.15.1:0/2821440704 shutdown_connections 2023-11-15T01:34:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.445+0000 7fb7f359e700 1 --2- 172.21.15.1:0/2821440704 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb7d405f240 0x7fb7d4061700 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.445+0000 7fb7f359e700 1 --2- 172.21.15.1:0/2821440704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7f40c2680 0x7fb7f40c0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.445+0000 7fb7f359e700 1 --2- 172.21.15.1:0/2821440704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e0004690 0x7fb7f40aea10 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.445+0000 7fb7f359e700 1 --2- 172.21.15.1:0/2821440704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7f4155d80 0x7fb7f40c2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:07.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.446+0000 7fb7f359e700 1 -- 172.21.15.1:0/2821440704 >> 172.21.15.1:0/2821440704 conn(0x7fb7f4067550 msgr2=0x7fb7f40c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:07.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.446+0000 7fb7f359e700 1 -- 172.21.15.1:0/2821440704 shutdown_connections 2023-11-15T01:34:07.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:07.446+0000 7fb7f359e700 1 -- 172.21.15.1:0/2821440704 wait complete. 2023-11-15T01:34:07.458 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-15T01:34:07.458 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-15T01:34:07.459 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-11-15T01:34:07.459 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-15T01:34:07.459 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-15T01:34:07.460 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-15T01:34:07.460 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-15T01:34:07.460 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-15T01:34:07.461 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T01:34:07.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:34:07.462 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-11-15T01:34:07.477 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:34:07.477 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T01:34:07.478 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T01:34:07.478 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:34:07.478 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-11-15T01:34:07.479 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:34:07.479 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:34:07.479 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-11-15T01:34:07.480 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-11-15T01:34:07.480 INFO:teuthology.orchestra.run.smithi001.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-15T01:34:07.480 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:34:07.480 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-11-15T01:34:07.480 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-15T01:34:07.481 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 41758sec preferred_lft 41758sec 2023-11-15T01:34:07.481 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2023-11-15T01:34:07.482 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:34:07.482 INFO:teuthology.orchestra.run.smithi001.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:34:07.482 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-11-15T01:34:07.482 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-11-15T01:34:07.483 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:34:07.483 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:34:07.483 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-11-15T01:34:07.483 INFO:teuthology.orchestra.run.smithi001.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-15T01:34:07.483 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:34:07.484 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-15T01:34:07.484 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:34:07.484 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::74ff:4aff:fef6:c8f5/64 scope link 2023-11-15T01:34:07.484 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:34:07.485 INFO:teuthology.orchestra.run.smithi001.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:34:07.485 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-15T01:34:07.485 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::10ca:5cff:fe8a:9a23/64 scope link 2023-11-15T01:34:07.485 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:34:07.485 INFO:teuthology.orchestra.run.smithi001.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:34:07.486 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 92:7a:64:05:0f:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-15T01:34:07.486 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::907a:64ff:fe05:f37/64 scope link 2023-11-15T01:34:07.486 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:34:07.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:34:07.487 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-15T01:34:07.542 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-11-15T01:34:07.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:34:07.544 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-11-15T01:34:07.600 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-11-15T01:34:07.601 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-15T01:34:07.601 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-15T01:34:07.601 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-15T01:34:07.601 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-15T01:34:07.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:34:07.602 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:34:07.603 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:34:07.603 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-15T01:34:07.604 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-15T01:34:07.604 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-15T01:34:07.604 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:34:07.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:34:07.705 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T01:34:07.720 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-15T01:34:07.720 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-15T01:34:07.721 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T01:34:07.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:34:07.722 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2023-11-15T01:34:07.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:34:07.787 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-15T01:34:07.841 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-15T01:34:07.842 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:34:07.922 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:34:07.923 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:34:07.949 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:34:07.950 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:34:07.951 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-15T01:34:07.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:34:07.952 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-15T01:34:08.018 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-15T01:34:08.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.175+0000 7efc274c8700 1 Processor -- start 2023-11-15T01:34:08.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.175+0000 7efc274c8700 1 -- start start 2023-11-15T01:34:08.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.176+0000 7efc274c8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc20157dd0 0x7efc200657e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:08.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.176+0000 7efc274c8700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc20066a80 con 0x7efc20062ec0 2023-11-15T01:34:08.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.176+0000 7efc274c8700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc20066f10 con 0x7efc201579f0 2023-11-15T01:34:08.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.176+0000 7efc274c8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc20065e70 con 0x7efc20157dd0 2023-11-15T01:34:08.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.176+0000 7efc26cc7700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7efc20062ec0 0x7efc200a4870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49410/0 (socket says 172.21.15.1:49410) 2023-11-15T01:34:08.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.176+0000 7efc26cc7700 1 -- 172.21.15.1:0/908556184 learned_addr learned my addr 172.21.15.1:0/908556184 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:34:08.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.176+0000 7efc25cc5700 1 --2- 172.21.15.1:0/908556184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc20157dd0 0x7efc200657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:08.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.176+0000 7efc254c4700 1 -- 172.21.15.1:0/908556184 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739855538 0 0) 0x7efc20066a80 con 0x7efc20062ec0 2023-11-15T01:34:08.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.176+0000 7efc254c4700 1 -- 172.21.15.1:0/908556184 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc080033f0 con 0x7efc20062ec0 2023-11-15T01:34:08.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.176+0000 7efc254c4700 1 -- 172.21.15.1:0/908556184 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322863205 0 0) 0x7efc20066f10 con 0x7efc201579f0 2023-11-15T01:34:08.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.176+0000 7efc254c4700 1 -- 172.21.15.1:0/908556184 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc20066a80 con 0x7efc201579f0 2023-11-15T01:34:08.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.176+0000 7efc25cc5700 1 -- 172.21.15.1:0/908556184 >> v1:172.21.15.141:6789/0 conn(0x7efc201579f0 legacy=0x7efc200627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:08.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.176+0000 7efc25cc5700 1 -- 172.21.15.1:0/908556184 >> v1:172.21.15.1:6789/0 conn(0x7efc20062ec0 legacy=0x7efc200a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:08.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.176+0000 7efc25cc5700 1 -- 172.21.15.1:0/908556184 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc20066150 con 0x7efc20157dd0 2023-11-15T01:34:08.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.177+0000 7efc25cc5700 1 --2- 172.21.15.1:0/908556184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc20157dd0 0x7efc200657e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7efc14009790 tx=0x7efc14009060).ready entity=mon.2 client_cookie=52dd82a14de1c2c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:08.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.177+0000 7efc254c4700 1 -- 172.21.15.1:0/908556184 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1400f510 con 0x7efc20157dd0 2023-11-15T01:34:08.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.177+0000 7efc254c4700 1 -- 172.21.15.1:0/908556184 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1400f670 con 0x7efc20157dd0 2023-11-15T01:34:08.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.177+0000 7efc254c4700 1 -- 172.21.15.1:0/908556184 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1400f9f0 con 0x7efc20157dd0 2023-11-15T01:34:08.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.177+0000 7efc274c8700 1 -- 172.21.15.1:0/908556184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc20157dd0 msgr2=0x7efc200657e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:08.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.177+0000 7efc274c8700 1 --2- 172.21.15.1:0/908556184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc20157dd0 0x7efc200657e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7efc14009790 tx=0x7efc14009060).stop 2023-11-15T01:34:08.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.177+0000 7efc274c8700 1 -- 172.21.15.1:0/908556184 shutdown_connections 2023-11-15T01:34:08.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.177+0000 7efc274c8700 1 --2- 172.21.15.1:0/908556184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc20157dd0 0x7efc200657e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.177+0000 7efc274c8700 1 -- 172.21.15.1:0/908556184 >> 172.21.15.1:0/908556184 conn(0x7efc200c7c10 msgr2=0x7efc200c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:08.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.177+0000 7efc274c8700 1 -- 172.21.15.1:0/908556184 shutdown_connections 2023-11-15T01:34:08.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.177+0000 7efc274c8700 1 -- 172.21.15.1:0/908556184 wait complete. 2023-11-15T01:34:08.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.179+0000 7efc274c8700 1 Processor -- start 2023-11-15T01:34:08.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.179+0000 7efc274c8700 1 -- start start 2023-11-15T01:34:08.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.179+0000 7efc274c8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc20062ec0 0x7efc20158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:08.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.179+0000 7efc274c8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc201579f0 0x7efc200ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:08.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.179+0000 7efc274c8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc20157dd0 0x7efc200ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:08.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.179+0000 7efc274c8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc200ac520 con 0x7efc20157dd0 2023-11-15T01:34:08.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.179+0000 7efc274c8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc200ac800 con 0x7efc20062ec0 2023-11-15T01:34:08.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.179+0000 7efc274c8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc200acae0 con 0x7efc201579f0 2023-11-15T01:34:08.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.179+0000 7efc26cc7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc20157dd0 0x7efc200ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:08.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.179+0000 7efc26cc7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc20157dd0 0x7efc200ad7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51002/0 (socket says 172.21.15.1:51002) 2023-11-15T01:34:08.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.179+0000 7efc26cc7700 1 -- 172.21.15.1:0/1786601921 learned_addr learned my addr 172.21.15.1:0/1786601921 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:08.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.180+0000 7efc264c6700 1 --2- 172.21.15.1:0/1786601921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc20062ec0 0x7efc20158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:08.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.180+0000 7efc25cc5700 1 --2- 172.21.15.1:0/1786601921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc201579f0 0x7efc200ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:08.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.180+0000 7efc26cc7700 1 -- 172.21.15.1:0/1786601921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc201579f0 msgr2=0x7efc200ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:08.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.180+0000 7efc26cc7700 1 --2- 172.21.15.1:0/1786601921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc201579f0 0x7efc200ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.180+0000 7efc26cc7700 1 -- 172.21.15.1:0/1786601921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc20062ec0 msgr2=0x7efc20158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:08.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.180+0000 7efc26cc7700 1 --2- 172.21.15.1:0/1786601921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc20062ec0 0x7efc20158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.180+0000 7efc26cc7700 1 -- 172.21.15.1:0/1786601921 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc140092a0 con 0x7efc20157dd0 2023-11-15T01:34:08.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.180+0000 7efc25cc5700 1 --2- 172.21.15.1:0/1786601921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc201579f0 0x7efc200ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:34:08.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.180+0000 7efc26cc7700 1 --2- 172.21.15.1:0/1786601921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc20157dd0 0x7efc200ad7d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7efc1800c490 tx=0x7efc18007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:08.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.180+0000 7efc1e7fc700 1 -- 172.21.15.1:0/1786601921 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc180072e0 con 0x7efc20157dd0 2023-11-15T01:34:08.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.180+0000 7efc1e7fc700 1 -- 172.21.15.1:0/1786601921 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc18007440 con 0x7efc20157dd0 2023-11-15T01:34:08.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.180+0000 7efc274c8700 1 -- 172.21.15.1:0/1786601921 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc200acdc0 con 0x7efc20157dd0 2023-11-15T01:34:08.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.180+0000 7efc1e7fc700 1 -- 172.21.15.1:0/1786601921 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc180057a0 con 0x7efc20157dd0 2023-11-15T01:34:08.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.180+0000 7efc274c8700 1 -- 172.21.15.1:0/1786601921 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc200aae60 con 0x7efc20157dd0 2023-11-15T01:34:08.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.181+0000 7efc274c8700 1 -- 172.21.15.1:0/1786601921 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc200475e0 con 0x7efc20157dd0 2023-11-15T01:34:08.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.181+0000 7efc1e7fc700 1 -- 172.21.15.1:0/1786601921 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7efc18005b50 con 0x7efc20157dd0 2023-11-15T01:34:08.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.182+0000 7efc1e7fc700 1 --2- 172.21.15.1:0/1786601921 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efc0c05f2a0 0x7efc0c061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:08.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.182+0000 7efc1e7fc700 1 -- 172.21.15.1:0/1786601921 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7efc18079c30 con 0x7efc20157dd0 2023-11-15T01:34:08.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.182+0000 7efc264c6700 1 --2- 172.21.15.1:0/1786601921 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efc0c05f2a0 0x7efc0c061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:08.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.182+0000 7efc264c6700 1 --2- 172.21.15.1:0/1786601921 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efc0c05f2a0 0x7efc0c061760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7efc10003df0 tx=0x7efc10009040).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:08.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.186+0000 7efc1e7fc700 1 -- 172.21.15.1:0/1786601921 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efc1804abf0 con 0x7efc20157dd0 2023-11-15T01:34:08.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.385+0000 7efc274c8700 1 -- 172.21.15.1:0/1786601921 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7efc20155c50 con 0x7efc0c05f2a0 2023-11-15T01:34:08.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.387+0000 7efc1e7fc700 1 -- 172.21.15.1:0/1786601921 <== mgr.5248 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7efc20155c50 con 0x7efc0c05f2a0 2023-11-15T01:34:08.388 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T01:34:08.388 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:34:08.389 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephfs" 2023-11-15T01:34:08.389 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:34:08.389 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T01:34:08.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.389+0000 7efc274c8700 1 -- 172.21.15.1:0/1786601921 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efc0c05f2a0 msgr2=0x7efc0c061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:08.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.389+0000 7efc274c8700 1 --2- 172.21.15.1:0/1786601921 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efc0c05f2a0 0x7efc0c061760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7efc10003df0 tx=0x7efc10009040).stop 2023-11-15T01:34:08.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.389+0000 7efc274c8700 1 -- 172.21.15.1:0/1786601921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc20157dd0 msgr2=0x7efc200ad7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:08.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.389+0000 7efc274c8700 1 --2- 172.21.15.1:0/1786601921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc20157dd0 0x7efc200ad7d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7efc1800c490 tx=0x7efc18007c50).stop 2023-11-15T01:34:08.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.389+0000 7efc274c8700 1 -- 172.21.15.1:0/1786601921 shutdown_connections 2023-11-15T01:34:08.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.389+0000 7efc274c8700 1 --2- 172.21.15.1:0/1786601921 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efc0c05f2a0 0x7efc0c061760 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.389+0000 7efc274c8700 1 --2- 172.21.15.1:0/1786601921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc20157dd0 0x7efc200ad7d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.389+0000 7efc274c8700 1 --2- 172.21.15.1:0/1786601921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc20062ec0 0x7efc20158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.389+0000 7efc274c8700 1 --2- 172.21.15.1:0/1786601921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc201579f0 0x7efc200ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.389+0000 7efc274c8700 1 -- 172.21.15.1:0/1786601921 >> 172.21.15.1:0/1786601921 conn(0x7efc200c7c10 msgr2=0x7efc20156700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:08.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.389+0000 7efc274c8700 1 -- 172.21.15.1:0/1786601921 shutdown_connections 2023-11-15T01:34:08.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.389+0000 7efc274c8700 1 -- 172.21.15.1:0/1786601921 wait complete. 2023-11-15T01:34:08.402 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-15T01:34:08.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.521+0000 7f26ad32b700 1 Processor -- start 2023-11-15T01:34:08.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.521+0000 7f26ad32b700 1 -- start start 2023-11-15T01:34:08.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.522+0000 7f26ad32b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f26a80c3e30 0x7f26a80c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:08.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.522+0000 7f26ad32b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a806a020 con 0x7f26a8069ba0 2023-11-15T01:34:08.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.522+0000 7f26ad32b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a8155320 con 0x7f26a8154bf0 2023-11-15T01:34:08.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.522+0000 7f26ad32b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a8155bc0 con 0x7f26a80c3e30 2023-11-15T01:34:08.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.522+0000 7f26a67fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f26a8069ba0 0x7f26a8066cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49418/0 (socket says 172.21.15.1:49418) 2023-11-15T01:34:08.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.522+0000 7f26a67fc700 1 -- 172.21.15.1:0/100150367 learned_addr learned my addr 172.21.15.1:0/100150367 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:34:08.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a6ffd700 1 --2- 172.21.15.1:0/100150367 >> v2:172.21.15.141:3300/0 conn(0x7f26a80c3e30 0x7f26a80c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:08.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104439071 0 0) 0x7f26a806a020 con 0x7f26a8069ba0 2023-11-15T01:34:08.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26940033f0 con 0x7f26a8069ba0 2023-11-15T01:34:08.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642559120 0 0) 0x7f26a8155320 con 0x7f26a8154bf0 2023-11-15T01:34:08.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26a806a020 con 0x7f26a8154bf0 2023-11-15T01:34:08.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1953915440 0 0) 0x7f26940033f0 con 0x7f26a8069ba0 2023-11-15T01:34:08.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 >> v2:172.21.15.141:3300/0 conn(0x7f26a80c3e30 msgr2=0x7f26a80c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:08.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 --2- 172.21.15.1:0/100150367 >> v2:172.21.15.141:3300/0 conn(0x7f26a80c3e30 0x7f26a80c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 >> v1:172.21.15.141:6789/0 conn(0x7f26a8154bf0 legacy=0x7f26a813a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:08.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a8155600 con 0x7f26a8069ba0 2023-11-15T01:34:08.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f2690001470 con 0x7f26a8069ba0 2023-11-15T01:34:08.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 >> v1:172.21.15.1:6789/0 conn(0x7f26a8069ba0 legacy=0x7f26a8066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:08.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 --2- 172.21.15.1:0/100150367 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2694003a70 0x7f2694003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:08.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 --2- 172.21.15.1:0/100150367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2694004690 0x7f2694004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:08.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 --2- 172.21.15.1:0/100150367 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2694005000 0x7f269400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:08.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a8155bc0 con 0x7f2694004690 2023-11-15T01:34:08.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269400be80 con 0x7f2694005000 2023-11-15T01:34:08.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269400c040 con 0x7f2694003a70 2023-11-15T01:34:08.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a67fc700 1 --2- 172.21.15.1:0/100150367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2694004690 0x7f2694004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:08.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a77fe700 1 --2- 172.21.15.1:0/100150367 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2694005000 0x7f269400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:08.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a6ffd700 1 --2- 172.21.15.1:0/100150367 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2694003a70 0x7f2694003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:08.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.523+0000 7f26a67fc700 1 -- 172.21.15.1:0/100150367 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2694003a70 msgr2=0x7f2694003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:08.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26a67fc700 1 --2- 172.21.15.1:0/100150367 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2694003a70 0x7f2694003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26a67fc700 1 -- 172.21.15.1:0/100150367 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2694005000 msgr2=0x7f269400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:08.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26a67fc700 1 --2- 172.21.15.1:0/100150367 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2694005000 0x7f269400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26a67fc700 1 -- 172.21.15.1:0/100150367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26940033f0 con 0x7f2694004690 2023-11-15T01:34:08.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26a77fe700 1 -- 172.21.15.1:0/100150367 reap_dead start 2023-11-15T01:34:08.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26a67fc700 1 --2- 172.21.15.1:0/100150367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2694004690 0x7f2694004b10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f269000c0e0 tx=0x7f2690001e10).ready entity=mon.0 client_cookie=212dc58f0353edab server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:08.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690007940 con 0x7f2694004690 2023-11-15T01:34:08.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269000ca10 con 0x7f2694004690 2023-11-15T01:34:08.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26a5ffb700 1 -- 172.21.15.1:0/100150367 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269000cd90 con 0x7f2694004690 2023-11-15T01:34:08.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26ad32b700 1 -- 172.21.15.1:0/100150367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2694004690 msgr2=0x7f2694004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:08.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26ad32b700 1 --2- 172.21.15.1:0/100150367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2694004690 0x7f2694004b10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f269000c0e0 tx=0x7f2690001e10).stop 2023-11-15T01:34:08.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26ad32b700 1 -- 172.21.15.1:0/100150367 shutdown_connections 2023-11-15T01:34:08.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26ad32b700 1 --2- 172.21.15.1:0/100150367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2694004690 0x7f2694004b10 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26ad32b700 1 -- 172.21.15.1:0/100150367 >> 172.21.15.1:0/100150367 conn(0x7f26a80c7dc0 msgr2=0x7f26a80c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:08.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26ad32b700 1 -- 172.21.15.1:0/100150367 shutdown_connections 2023-11-15T01:34:08.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.524+0000 7f26ad32b700 1 -- 172.21.15.1:0/100150367 wait complete. 2023-11-15T01:34:08.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.526+0000 7f26ad32b700 1 Processor -- start 2023-11-15T01:34:08.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.526+0000 7f26ad32b700 1 -- start start 2023-11-15T01:34:08.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.526+0000 7f26ad32b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2694004690 0x7f26a81377c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:08.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.526+0000 7f26ad32b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a814f7e0 0x7f26a8154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:08.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.526+0000 7f26ad32b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26a80ad2e0 0x7f26a80ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:08.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.526+0000 7f26ad32b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a8137da0 con 0x7f26a814f7e0 2023-11-15T01:34:08.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.526+0000 7f26ad32b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80aa4f0 con 0x7f2694004690 2023-11-15T01:34:08.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.526+0000 7f26ad32b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80adc50 con 0x7f26a80ad2e0 2023-11-15T01:34:08.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.526+0000 7f26a67fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a814f7e0 0x7f26a8154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:08.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f26a67fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a814f7e0 0x7f26a8154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51010/0 (socket says 172.21.15.1:51010) 2023-11-15T01:34:08.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f26a67fc700 1 -- 172.21.15.1:0/1078287264 learned_addr learned my addr 172.21.15.1:0/1078287264 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:08.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f26a77fe700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26a80ad2e0 0x7f26a80ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:08.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f26a6ffd700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2694004690 0x7f26a81377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:08.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f26a67fc700 1 -- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26a80ad2e0 msgr2=0x7f26a80ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:08.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f26a67fc700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26a80ad2e0 0x7f26a80ad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f26a67fc700 1 -- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2694004690 msgr2=0x7f26a81377c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:08.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f26a67fc700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2694004690 0x7f26a81377c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f26a67fc700 1 -- 172.21.15.1:0/1078287264 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a80aa980 con 0x7f26a814f7e0 2023-11-15T01:34:08.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f26a77fe700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26a80ad2e0 0x7f26a80ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:34:08.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f26a6ffd700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2694004690 0x7f26a81377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:34:08.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f26a67fc700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a814f7e0 0x7f26a8154330 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f2690001060 tx=0x7f2690015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:08.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f269effd700 1 -- 172.21.15.1:0/1078287264 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26900074f0 con 0x7f26a814f7e0 2023-11-15T01:34:08.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f269effd700 1 -- 172.21.15.1:0/1078287264 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2690007650 con 0x7f26a814f7e0 2023-11-15T01:34:08.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f26ad32b700 1 -- 172.21.15.1:0/1078287264 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a814fc60 con 0x7f26a814f7e0 2023-11-15T01:34:08.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f269effd700 1 -- 172.21.15.1:0/1078287264 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26900048c0 con 0x7f26a814f7e0 2023-11-15T01:34:08.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.527+0000 7f26ad32b700 1 -- 172.21.15.1:0/1078287264 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a80a9bc0 con 0x7f26a814f7e0 2023-11-15T01:34:08.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.528+0000 7f26ad32b700 1 -- 172.21.15.1:0/1078287264 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a806c7e0 con 0x7f26a814f7e0 2023-11-15T01:34:08.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.529+0000 7f269effd700 1 -- 172.21.15.1:0/1078287264 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 14) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2690004cb0 con 0x7f26a814f7e0 2023-11-15T01:34:08.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.529+0000 7f269effd700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f268805f270 0x7f2688061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:08.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.529+0000 7f269effd700 1 -- 172.21.15.1:0/1078287264 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f269007b260 con 0x7f26a814f7e0 2023-11-15T01:34:08.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.529+0000 7f26a6ffd700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f268805f270 0x7f2688061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:08.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.530+0000 7f26a6ffd700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f268805f270 0x7f2688061730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f26a0006d80 tx=0x7f26a0008040).ready entity=mgr.5248 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:08.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.533+0000 7f269effd700 1 -- 172.21.15.1:0/1078287264 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f269004c220 con 0x7f26a814f7e0 2023-11-15T01:34:08.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.750+0000 7f26ad32b700 1 -- 172.21.15.1:0/1078287264 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f26a8137da0 con 0x7f26a814f7e0 2023-11-15T01:34:08.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.887+0000 7f269effd700 1 -- 172.21.15.1:0/1078287264 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 15) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f2690078d20 con 0x7f26a814f7e0 2023-11-15T01:34:08.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.888+0000 7f269effd700 1 -- 172.21.15.1:0/1078287264 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v15) v1 ==== 92+0+0 (secure 0 0 0) 0x7f26900412f0 con 0x7f26a814f7e0 2023-11-15T01:34:08.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.891+0000 7f26ad32b700 1 -- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f268805f270 msgr2=0x7f2688061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:08.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.891+0000 7f26ad32b700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f268805f270 0x7f2688061730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f26a0006d80 tx=0x7f26a0008040).stop 2023-11-15T01:34:08.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.891+0000 7f26ad32b700 1 -- 172.21.15.1:0/1078287264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a814f7e0 msgr2=0x7f26a8154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:08.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.891+0000 7f26ad32b700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a814f7e0 0x7f26a8154330 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f2690001060 tx=0x7f2690015000).stop 2023-11-15T01:34:08.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.891+0000 7f26ad32b700 1 -- 172.21.15.1:0/1078287264 shutdown_connections 2023-11-15T01:34:08.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.891+0000 7f26ad32b700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f268805f270 0x7f2688061730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.891+0000 7f26ad32b700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26a80ad2e0 0x7f26a80ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.891+0000 7f26ad32b700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2694004690 0x7f26a81377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.891+0000 7f26ad32b700 1 --2- 172.21.15.1:0/1078287264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26a814f7e0 0x7f26a8154330 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:08.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.891+0000 7f26ad32b700 1 -- 172.21.15.1:0/1078287264 >> 172.21.15.1:0/1078287264 conn(0x7f26a80c7dc0 msgr2=0x7f26a80c50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:08.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.891+0000 7f26ad32b700 1 -- 172.21.15.1:0/1078287264 shutdown_connections 2023-11-15T01:34:08.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:08.891+0000 7f26ad32b700 1 -- 172.21.15.1:0/1078287264 wait complete. 2023-11-15T01:34:08.909 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-15T01:34:09.034 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:09.033+0000 7f9bb120a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:34:09.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.033+0000 7fe4bc338700 1 Processor -- start 2023-11-15T01:34:09.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.033+0000 7fe4bc338700 1 -- start start 2023-11-15T01:34:09.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.034+0000 7fe4bc338700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe4b4154480 0x7fe4b40c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:09.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.034+0000 7fe4bc338700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4b40c6430 0x7fe4b40aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:09.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.034+0000 7fe4bc338700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b40ca050 con 0x7fe4b41540a0 2023-11-15T01:34:09.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.034+0000 7fe4bc338700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b40c68c0 con 0x7fe4b4154480 2023-11-15T01:34:09.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.034+0000 7fe4bc338700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b40c9440 con 0x7fe4b40c6430 2023-11-15T01:34:09.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.034+0000 7fe4b98d3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe4b4154480 0x7fe4b40c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:09.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.034+0000 7fe4b98d3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe4b4154480 0x7fe4b40c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51038/0 (socket says 172.21.15.1:51038) 2023-11-15T01:34:09.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.034+0000 7fe4b98d3700 1 -- 172.21.15.1:0/1202569154 learned_addr learned my addr 172.21.15.1:0/1202569154 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.034+0000 7fe4ba8d5700 1 --2- 172.21.15.1:0/1202569154 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4b40c6430 0x7fe4b40aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.034+0000 7fe4b98d3700 1 -- 172.21.15.1:0/1202569154 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4b40c6430 msgr2=0x7fe4b40aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.034+0000 7fe4b98d3700 1 --2- 172.21.15.1:0/1202569154 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4b40c6430 0x7fe4b40aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.034+0000 7fe4b98d3700 1 -- 172.21.15.1:0/1202569154 >> v1:172.21.15.141:6789/0 conn(0x7fe4b41540a0 legacy=0x7fe4b40ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.034+0000 7fe4b98d3700 1 -- 172.21.15.1:0/1202569154 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b40c9720 con 0x7fe4b4154480 2023-11-15T01:34:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.034+0000 7fe4ba8d5700 1 --2- 172.21.15.1:0/1202569154 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4b40c6430 0x7fe4b40aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:34:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.034+0000 7fe4b98d3700 1 --2- 172.21.15.1:0/1202569154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4b4154480 0x7fe4b40c5f40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fe4a4006fd0 tx=0x7fe4a40090f0).ready entity=mon.0 client_cookie=fd7b239248d015fe server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.035+0000 7fe4b90d2700 1 -- 172.21.15.1:0/1202569154 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a400b600 con 0x7fe4b4154480 2023-11-15T01:34:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.035+0000 7fe4b90d2700 1 -- 172.21.15.1:0/1202569154 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a400b760 con 0x7fe4b4154480 2023-11-15T01:34:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.035+0000 7fe4b90d2700 1 -- 172.21.15.1:0/1202569154 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a400bae0 con 0x7fe4b4154480 2023-11-15T01:34:09.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.035+0000 7fe4bc338700 1 -- 172.21.15.1:0/1202569154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4b4154480 msgr2=0x7fe4b40c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:09.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.035+0000 7fe4bc338700 1 --2- 172.21.15.1:0/1202569154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4b4154480 0x7fe4b40c5f40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fe4a4006fd0 tx=0x7fe4a40090f0).stop 2023-11-15T01:34:09.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.035+0000 7fe4bc338700 1 -- 172.21.15.1:0/1202569154 shutdown_connections 2023-11-15T01:34:09.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.035+0000 7fe4bc338700 1 --2- 172.21.15.1:0/1202569154 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4b40c6430 0x7fe4b40aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.035+0000 7fe4bc338700 1 --2- 172.21.15.1:0/1202569154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4b4154480 0x7fe4b40c5f40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.035+0000 7fe4bc338700 1 -- 172.21.15.1:0/1202569154 >> 172.21.15.1:0/1202569154 conn(0x7fe4b4064a70 msgr2=0x7fe4b4064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.035+0000 7fe4bc338700 1 -- 172.21.15.1:0/1202569154 shutdown_connections 2023-11-15T01:34:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.035+0000 7fe4bc338700 1 -- 172.21.15.1:0/1202569154 wait complete. 2023-11-15T01:34:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.036+0000 7fe4bc338700 1 Processor -- start 2023-11-15T01:34:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.036+0000 7fe4bc338700 1 -- start start 2023-11-15T01:34:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.037+0000 7fe4bc338700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4b40c6430 0x7fe4b4164ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.037+0000 7fe4bc338700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4b41540a0 0x7fe4b4151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.037+0000 7fe4bc338700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4b4154480 0x7fe4b40c1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.037+0000 7fe4bc338700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b41654e0 con 0x7fe4b40c6430 2023-11-15T01:34:09.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.037+0000 7fe4bc338700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b40ae460 con 0x7fe4b41540a0 2023-11-15T01:34:09.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.037+0000 7fe4bc338700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b40ae740 con 0x7fe4b4154480 2023-11-15T01:34:09.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.037+0000 7fe4ba0d4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4b40c6430 0x7fe4b4164ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:09.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.037+0000 7fe4ba0d4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4b40c6430 0x7fe4b4164ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51044/0 (socket says 172.21.15.1:51044) 2023-11-15T01:34:09.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.037+0000 7fe4ba0d4700 1 -- 172.21.15.1:0/3347428554 learned_addr learned my addr 172.21.15.1:0/3347428554 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:09.046 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:09.037+0000 7feccfa36680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:34:09.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.037+0000 7fe4b98d3700 1 --2- 172.21.15.1:0/3347428554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4b41540a0 0x7fe4b4151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:09.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.037+0000 7fe4ba8d5700 1 --2- 172.21.15.1:0/3347428554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4b4154480 0x7fe4b40c1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:09.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.038+0000 7fe4ba0d4700 1 -- 172.21.15.1:0/3347428554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4b4154480 msgr2=0x7fe4b40c1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:09.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.038+0000 7fe4ba0d4700 1 --2- 172.21.15.1:0/3347428554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4b4154480 0x7fe4b40c1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:09.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.038+0000 7fe4ba0d4700 1 -- 172.21.15.1:0/3347428554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4b41540a0 msgr2=0x7fe4b4151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:09.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.038+0000 7fe4ba0d4700 1 --2- 172.21.15.1:0/3347428554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4b41540a0 0x7fe4b4151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:09.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.038+0000 7fe4ba0d4700 1 -- 172.21.15.1:0/3347428554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a4009370 con 0x7fe4b40c6430 2023-11-15T01:34:09.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.038+0000 7fe4ba0d4700 1 --2- 172.21.15.1:0/3347428554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4b40c6430 0x7fe4b4164ff0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fe4b000c4c0 tx=0x7fe4b0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:09.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.038+0000 7fe4aa7fc700 1 -- 172.21.15.1:0/3347428554 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b000ce70 con 0x7fe4b40c6430 2023-11-15T01:34:09.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.038+0000 7fe4aa7fc700 1 -- 172.21.15.1:0/3347428554 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b0001e90 con 0x7fe4b40c6430 2023-11-15T01:34:09.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.038+0000 7fe4bc338700 1 -- 172.21.15.1:0/3347428554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b40aea20 con 0x7fe4b40c6430 2023-11-15T01:34:09.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.038+0000 7fe4aa7fc700 1 -- 172.21.15.1:0/3347428554 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0007250 con 0x7fe4b40c6430 2023-11-15T01:34:09.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.038+0000 7fe4bc338700 1 -- 172.21.15.1:0/3347428554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b414dbf0 con 0x7fe4b40c6430 2023-11-15T01:34:09.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.039+0000 7fe4bc338700 1 -- 172.21.15.1:0/3347428554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b406c7e0 con 0x7fe4b40c6430 2023-11-15T01:34:09.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.039+0000 7fe4aa7fc700 1 -- 172.21.15.1:0/3347428554 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fe4b00066a0 con 0x7fe4b40c6430 2023-11-15T01:34:09.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.040+0000 7fe4aa7fc700 1 --2- 172.21.15.1:0/3347428554 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe49805f2c0 0x7fe498061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:09.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.040+0000 7fe4aa7fc700 1 -- 172.21.15.1:0/3347428554 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7fe4b0079df0 con 0x7fe4b40c6430 2023-11-15T01:34:09.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.040+0000 7fe4b98d3700 1 -- 172.21.15.1:0/3347428554 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe49805f2c0 msgr2=0x7fe498061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:34:09.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.040+0000 7fe4b98d3700 1 --2- 172.21.15.1:0/3347428554 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe49805f2c0 0x7fe498061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:34:09.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.044+0000 7fe4aa7fc700 1 -- 172.21.15.1:0/3347428554 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe4b004adb0 con 0x7fe4b40c6430 2023-11-15T01:34:09.098 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:09.097+0000 7f9bb120a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:34:09.107 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:09.105+0000 7feccfa36680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:34:09.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.219+0000 7fe4bc338700 1 -- 172.21.15.1:0/3347428554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fe4b40af860 con 0x7fe4b40c6430 2023-11-15T01:34:09.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.222+0000 7fe4aa7fc700 1 -- 172.21.15.1:0/3347428554 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v7)=0 v7) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe4b004e3d0 con 0x7fe4b40c6430 2023-11-15T01:34:09.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.224+0000 7fe4bc338700 1 -- 172.21.15.1:0/3347428554 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe49805f2c0 msgr2=0x7fe498061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:34:09.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.224+0000 7fe4bc338700 1 --2- 172.21.15.1:0/3347428554 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe49805f2c0 0x7fe498061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:34:09.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.224+0000 7fe4bc338700 1 -- 172.21.15.1:0/3347428554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4b40c6430 msgr2=0x7fe4b4164ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:09.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.224+0000 7fe4bc338700 1 --2- 172.21.15.1:0/3347428554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4b40c6430 0x7fe4b4164ff0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fe4b000c4c0 tx=0x7fe4b0007e00).stop 2023-11-15T01:34:09.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.224+0000 7fe4bc338700 1 -- 172.21.15.1:0/3347428554 shutdown_connections 2023-11-15T01:34:09.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.224+0000 7fe4bc338700 1 --2- 172.21.15.1:0/3347428554 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe49805f2c0 0x7fe498061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:34:09.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.224+0000 7fe4bc338700 1 --2- 172.21.15.1:0/3347428554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4b4154480 0x7fe4b40c1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:09.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.224+0000 7fe4bc338700 1 --2- 172.21.15.1:0/3347428554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4b40c6430 0x7fe4b4164ff0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:09.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.224+0000 7fe4bc338700 1 --2- 172.21.15.1:0/3347428554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4b41540a0 0x7fe4b4151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:09.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.224+0000 7fe4bc338700 1 -- 172.21.15.1:0/3347428554 >> 172.21.15.1:0/3347428554 conn(0x7fe4b4064a70 msgr2=0x7fe4b41531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:09.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.224+0000 7fe4bc338700 1 -- 172.21.15.1:0/3347428554 shutdown_connections 2023-11-15T01:34:09.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.224+0000 7fe4bc338700 1 -- 172.21.15.1:0/3347428554 wait complete. 2023-11-15T01:34:09.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:09.238 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-15T01:34:09.259 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-11-15T01:34:09.372 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:09.371+0000 7f9bb120a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:34:09.400 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:09.399+0000 7feccfa36680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:34:09.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.422+0000 7facf2e5b700 1 Processor -- start 2023-11-15T01:34:09.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.422+0000 7facf2e5b700 1 -- start start 2023-11-15T01:34:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.423+0000 7facf2e5b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7facec157660 0x7facec157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.423+0000 7facf2e5b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7facec0aa060 0x7facec0aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.423+0000 7facf2e5b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facec0c1820 con 0x7facec0c1cb0 2023-11-15T01:34:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.423+0000 7facf2e5b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facec0c7540 con 0x7facec157660 2023-11-15T01:34:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.423+0000 7facf2e5b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facec0aa9e0 con 0x7facec0aa060 2023-11-15T01:34:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.423+0000 7facf0bf7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7facec157660 0x7facec157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.423+0000 7facf0bf7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7facec157660 0x7facec157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51056/0 (socket says 172.21.15.1:51056) 2023-11-15T01:34:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.423+0000 7facf0bf7700 1 -- 172.21.15.1:0/4279776789 learned_addr learned my addr 172.21.15.1:0/4279776789 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.423+0000 7facf13f8700 1 --2- 172.21.15.1:0/4279776789 >> v2:172.21.15.141:3300/0 conn(0x7facec0aa060 0x7facec0aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.423+0000 7facf0bf7700 1 -- 172.21.15.1:0/4279776789 >> v2:172.21.15.141:3300/0 conn(0x7facec0aa060 msgr2=0x7facec0aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.424+0000 7facf0bf7700 1 --2- 172.21.15.1:0/4279776789 >> v2:172.21.15.141:3300/0 conn(0x7facec0aa060 0x7facec0aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.424+0000 7facf0bf7700 1 -- 172.21.15.1:0/4279776789 >> v1:172.21.15.141:6789/0 conn(0x7facec0c1cb0 legacy=0x7facec0c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.424+0000 7facf0bf7700 1 -- 172.21.15.1:0/4279776789 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec0c0c30 con 0x7facec157660 2023-11-15T01:34:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.424+0000 7facf0bf7700 1 --2- 172.21.15.1:0/4279776789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facec157660 0x7facec157a40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7facec157f30 tx=0x7face00090f0).ready entity=mon.0 client_cookie=c909651beb77eccc server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.424+0000 7faceb7fe700 1 -- 172.21.15.1:0/4279776789 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face000b520 con 0x7facec157660 2023-11-15T01:34:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.424+0000 7faceb7fe700 1 -- 172.21.15.1:0/4279776789 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face000b680 con 0x7facec157660 2023-11-15T01:34:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.424+0000 7faceb7fe700 1 -- 172.21.15.1:0/4279776789 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face000ba20 con 0x7facec157660 2023-11-15T01:34:09.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.424+0000 7facf2e5b700 1 -- 172.21.15.1:0/4279776789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facec157660 msgr2=0x7facec157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:09.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.424+0000 7facf2e5b700 1 --2- 172.21.15.1:0/4279776789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facec157660 0x7facec157a40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7facec157f30 tx=0x7face00090f0).stop 2023-11-15T01:34:09.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.424+0000 7facf2e5b700 1 -- 172.21.15.1:0/4279776789 shutdown_connections 2023-11-15T01:34:09.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.424+0000 7facf2e5b700 1 --2- 172.21.15.1:0/4279776789 >> v2:172.21.15.141:3300/0 conn(0x7facec0aa060 0x7facec0aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:09.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.424+0000 7facf2e5b700 1 --2- 172.21.15.1:0/4279776789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facec157660 0x7facec157a40 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:09.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.425+0000 7facf2e5b700 1 -- 172.21.15.1:0/4279776789 >> 172.21.15.1:0/4279776789 conn(0x7facec064aa0 msgr2=0x7facec064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:09.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.425+0000 7facf2e5b700 1 -- 172.21.15.1:0/4279776789 shutdown_connections 2023-11-15T01:34:09.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.425+0000 7facf2e5b700 1 -- 172.21.15.1:0/4279776789 wait complete. 2023-11-15T01:34:09.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.426+0000 7facf2e5b700 1 Processor -- start 2023-11-15T01:34:09.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.426+0000 7facf2e5b700 1 -- start start 2023-11-15T01:34:09.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf2e5b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facec0aa060 0x7facec1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:09.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf2e5b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7facec0c1cb0 0x7facec0c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:09.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf2e5b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7facec157660 0x7facec0c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:09.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf2e5b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec152380 con 0x7facec0aa060 2023-11-15T01:34:09.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf2e5b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec0c5080 con 0x7facec0c1cb0 2023-11-15T01:34:09.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf2e5b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facec151770 con 0x7facec157660 2023-11-15T01:34:09.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf0bf7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facec0aa060 0x7facec1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:09.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf0bf7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facec0aa060 0x7facec1563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51058/0 (socket says 172.21.15.1:51058) 2023-11-15T01:34:09.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf0bf7700 1 -- 172.21.15.1:0/2665220287 learned_addr learned my addr 172.21.15.1:0/2665220287 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:09.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facebfff700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7facec0c1cb0 0x7facec0c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:09.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf13f8700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7facec157660 0x7facec0c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:09.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf0bf7700 1 -- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7facec157660 msgr2=0x7facec0c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:09.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf0bf7700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7facec157660 0x7facec0c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:09.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf0bf7700 1 -- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7facec0c1cb0 msgr2=0x7facec0c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:09.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf0bf7700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7facec0c1cb0 0x7facec0c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:09.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf0bf7700 1 -- 172.21.15.1:0/2665220287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face0009370 con 0x7facec0aa060 2023-11-15T01:34:09.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.427+0000 7facf0bf7700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facec0aa060 0x7facec1563b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7face0009170 tx=0x7face0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:09.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.428+0000 7face8ff9700 1 -- 172.21.15.1:0/2665220287 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face0006990 con 0x7facec0aa060 2023-11-15T01:34:09.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.428+0000 7face8ff9700 1 -- 172.21.15.1:0/2665220287 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face0000bc0 con 0x7facec0aa060 2023-11-15T01:34:09.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.428+0000 7facf2e5b700 1 -- 172.21.15.1:0/2665220287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facec151a50 con 0x7facec0aa060 2023-11-15T01:34:09.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.428+0000 7face8ff9700 1 -- 172.21.15.1:0/2665220287 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face001c420 con 0x7facec0aa060 2023-11-15T01:34:09.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.428+0000 7facf2e5b700 1 -- 172.21.15.1:0/2665220287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facec152010 con 0x7facec0aa060 2023-11-15T01:34:09.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.429+0000 7facf2e5b700 1 -- 172.21.15.1:0/2665220287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facec152660 con 0x7facec0aa060 2023-11-15T01:34:09.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.429+0000 7face8ff9700 1 -- 172.21.15.1:0/2665220287 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) v1 ==== 75565+0+0 (secure 0 0 0) 0x7face001c810 con 0x7facec0aa060 2023-11-15T01:34:09.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.429+0000 7face8ff9700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 0x7facd0061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:09.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.429+0000 7face8ff9700 1 -- 172.21.15.1:0/2665220287 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6517+0+0 (secure 0 0 0) 0x7face007c120 con 0x7facec0aa060 2023-11-15T01:34:09.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.429+0000 7facebfff700 1 -- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 msgr2=0x7facd0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:34:09.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.429+0000 7facebfff700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 0x7facd0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:34:09.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.434+0000 7face8ff9700 1 -- 172.21.15.1:0/2665220287 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7face004d0e0 con 0x7facec0aa060 2023-11-15T01:34:09.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.630+0000 7facebfff700 1 -- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 msgr2=0x7facd0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:34:09.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.630+0000 7facebfff700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 0x7facd0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:34:09.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:09.635+0000 7facf2e5b700 1 -- 172.21.15.1:0/2665220287 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7facec0c0ef0 con 0x7facd005f2c0 2023-11-15T01:34:09.984 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:09.983+0000 7f9bb120a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:34:10.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:10.031+0000 7facebfff700 1 -- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 msgr2=0x7facd0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:34:10.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:10.031+0000 7facebfff700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 0x7facd0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-15T01:34:10.056 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:10.055+0000 7f9bb120a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:34:10.067 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:10.066+0000 7feccfa36680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:34:10.136 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:10.135+0000 7feccfa36680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:34:10.241 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:10.241+0000 7f9bb120a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:34:10.330 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:10.329+0000 7feccfa36680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:34:10.660 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:10.660+0000 7f9bb120a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:34:10.764 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:10.763+0000 7f9bb120a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:34:10.770 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:10.768+0000 7feccfa36680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:34:10.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:10.832+0000 7facebfff700 1 -- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 msgr2=0x7facd0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:34:10.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:10.832+0000 7facebfff700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 0x7facd0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-15T01:34:10.879 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:10.877+0000 7feccfa36680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:34:10.916 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:10.915+0000 7f9bb120a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:34:10.989 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:10.989+0000 7f9bb120a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:34:11.037 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:11.036+0000 7feccfa36680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:34:11.056 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:11.055+0000 7f9bb120a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:34:11.115 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:11.114+0000 7feccfa36680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:34:11.185 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:11.184+0000 7feccfa36680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:34:11.313 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:11.313+0000 7f9bb120a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:34:11.458 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:11.457+0000 7feccfa36680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:34:11.495 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:11.495+0000 7f9bb120a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:34:11.647 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:11.646+0000 7feccfa36680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:34:12.143 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:12.142+0000 7f9bb120a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:34:12.211 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:12.210+0000 7f9bb120a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:34:12.284 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:12.284+0000 7f9bb120a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:34:12.334 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:12.333+0000 7feccfa36680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:34:12.405 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:12.404+0000 7feccfa36680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:34:12.430 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:12.429+0000 7f9bb120a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:34:12.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:12.434+0000 7facebfff700 1 -- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 msgr2=0x7facd0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:34:12.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:12.434+0000 7facebfff700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 0x7facd0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-15T01:34:12.485 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:12.484+0000 7feccfa36680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:34:12.502 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:12.501+0000 7f9bb120a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:34:12.616 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:12.616+0000 7f9bb120a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:34:12.638 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:12.637+0000 7feccfa36680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:34:12.711 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:12.709+0000 7feccfa36680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:34:12.723 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:12.722+0000 7f9bb120a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:34:12.831 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:12.830+0000 7feccfa36680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:34:12.946 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:12.944+0000 7feccfa36680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:34:13.014 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:13.013+0000 7f9bb120a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:34:13.084 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:13.083+0000 7f9bb120a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:34:13.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:13.103+0000 7face8ff9700 1 -- 172.21.15.1:0/2665220287 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 16) v1 ==== 75287+0+0 (secure 0 0 0) 0x7face0079be0 con 0x7facec0aa060 2023-11-15T01:34:13.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:13.103+0000 7face8ff9700 1 -- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 msgr2=0x7facd0061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:34:13.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:13.103+0000 7face8ff9700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 0x7facd0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:34:13.173 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:13.172+0000 7f9b28995700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:34:13.173 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:13.172+0000 7f9b28995700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:34:13.173 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:13.172+0000 7f9b28995700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:34:13.174 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:13.172+0000 7f9b28995700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:34:13.174 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:13.172+0000 7f9b28995700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:34:13.174 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:13.172+0000 7f9b2518e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:34:13.174 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:13.172+0000 7f9b2518e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:34:13.174 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:13.172+0000 7f9b2518e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:34:13.175 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:13.172+0000 7f9b2518e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:34:13.175 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:34:13.172+0000 7f9b2518e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:34:13.251 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:13.250+0000 7feccfa36680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:34:13.325 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:34:13.324+0000 7feccfa36680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:34:14.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.109+0000 7face8ff9700 1 -- 172.21.15.1:0/2665220287 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 17) v1 ==== 75357+0+0 (secure 0 0 0) 0x7face0079f60 con 0x7facec0aa060 2023-11-15T01:34:14.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.110+0000 7face8ff9700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 0x7facd0061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:14.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.110+0000 7face8ff9700 1 -- 172.21.15.1:0/2665220287 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7facec0c0ef0 con 0x7facd005f2c0 2023-11-15T01:34:14.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.112+0000 7facebfff700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 0x7facd0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:14.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.113+0000 7facebfff700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 0x7facd0061700 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7facec167b10 tx=0x7facd8000bc0).ready entity=mgr.5596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:14.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.125+0000 7face8ff9700 1 -- 172.21.15.1:0/2665220287 <== mgr.5596 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7facec0c0ef0 con 0x7facd005f2c0 2023-11-15T01:34:14.127 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path snap_test_dir1 2023-11-15T01:34:14.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.128+0000 7facf2e5b700 1 -- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 msgr2=0x7facd0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.128+0000 7facf2e5b700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 0x7facd0061700 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7facec167b10 tx=0x7facd8000bc0).stop 2023-11-15T01:34:14.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.128+0000 7facf2e5b700 1 -- 172.21.15.1:0/2665220287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facec0aa060 msgr2=0x7facec1563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.128+0000 7facf2e5b700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facec0aa060 0x7facec1563b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7face0009170 tx=0x7face0017000).stop 2023-11-15T01:34:14.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.128+0000 7facf2e5b700 1 -- 172.21.15.1:0/2665220287 shutdown_connections 2023-11-15T01:34:14.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.128+0000 7facf2e5b700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7facd005f2c0 0x7facd0061700 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.128+0000 7facf2e5b700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7facec157660 0x7facec0c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.128+0000 7facf2e5b700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facec0aa060 0x7facec1563b0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.128+0000 7facf2e5b700 1 --2- 172.21.15.1:0/2665220287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7facec0c1cb0 0x7facec0c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.128+0000 7facf2e5b700 1 -- 172.21.15.1:0/2665220287 >> 172.21.15.1:0/2665220287 conn(0x7facec064aa0 msgr2=0x7facec154f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:14.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.128+0000 7facf2e5b700 1 -- 172.21.15.1:0/2665220287 shutdown_connections 2023-11-15T01:34:14.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.128+0000 7facf2e5b700 1 -- 172.21.15.1:0/2665220287 wait complete. 2023-11-15T01:34:14.144 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-11-15T01:34:14.144 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-11-15T01:34:14.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.270+0000 7fb4f75c9700 1 Processor -- start 2023-11-15T01:34:14.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.271+0000 7fb4f75c9700 1 -- start start 2023-11-15T01:34:14.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.271+0000 7fb4f75c9700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb4f014b350 0x7fb4f00c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:14.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.271+0000 7fb4f75c9700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f01580d0 con 0x7fb4f014b730 2023-11-15T01:34:14.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.271+0000 7fb4f75c9700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f0155000 con 0x7fb4f00aa750 2023-11-15T01:34:14.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4f75c9700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f01552e0 con 0x7fb4f014b350 2023-11-15T01:34:14.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4f4b64700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb4f014b730 0x7fb4f00aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49432/0 (socket says 172.21.15.1:49432) 2023-11-15T01:34:14.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4f4b64700 1 -- 172.21.15.1:0/1787507074 learned_addr learned my addr 172.21.15.1:0/1787507074 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:34:14.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4f5365700 1 --2- 172.21.15.1:0/1787507074 >> v2:172.21.15.141:3300/0 conn(0x7fb4f014b350 0x7fb4f00c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:14.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134108071 0 0) 0x7fb4f01580d0 con 0x7fb4f014b730 2023-11-15T01:34:14.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4d80033f0 con 0x7fb4f014b730 2023-11-15T01:34:14.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382060654 0 0) 0x7fb4f0155000 con 0x7fb4f00aa750 2023-11-15T01:34:14.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4f01580d0 con 0x7fb4f00aa750 2023-11-15T01:34:14.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2217294233 0 0) 0x7fb4d80033f0 con 0x7fb4f014b730 2023-11-15T01:34:14.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 >> v2:172.21.15.141:3300/0 conn(0x7fb4f014b350 msgr2=0x7fb4f00c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:14.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 --2- 172.21.15.1:0/1787507074 >> v2:172.21.15.141:3300/0 conn(0x7fb4f014b350 0x7fb4f00c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 >> v1:172.21.15.141:6789/0 conn(0x7fb4f00aa750 legacy=0x7fb4f0158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f01555c0 con 0x7fb4f014b730 2023-11-15T01:34:14.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fb4e4001470 con 0x7fb4f014b730 2023-11-15T01:34:14.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 >> v1:172.21.15.1:6789/0 conn(0x7fb4f014b730 legacy=0x7fb4f00aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 --2- 172.21.15.1:0/1787507074 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4d8003a70 0x7fb4d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:14.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 --2- 172.21.15.1:0/1787507074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4d8004690 0x7fb4d8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:14.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 --2- 172.21.15.1:0/1787507074 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4d8005000 0x7fb4d800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:14.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f01552e0 con 0x7fb4d8004690 2023-11-15T01:34:14.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d800bf60 con 0x7fb4d8005000 2023-11-15T01:34:14.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d800c0d0 con 0x7fb4d8003a70 2023-11-15T01:34:14.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.272+0000 7fb4f4b64700 1 --2- 172.21.15.1:0/1787507074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4d8004690 0x7fb4d8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:14.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.273+0000 7fb4f5365700 1 --2- 172.21.15.1:0/1787507074 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4d8003a70 0x7fb4d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:14.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.273+0000 7fb4f5b66700 1 --2- 172.21.15.1:0/1787507074 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4d8005000 0x7fb4d800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:14.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.273+0000 7fb4f4b64700 1 -- 172.21.15.1:0/1787507074 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4d8003a70 msgr2=0x7fb4d8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:14.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.273+0000 7fb4f4b64700 1 --2- 172.21.15.1:0/1787507074 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4d8003a70 0x7fb4d8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.273+0000 7fb4f4b64700 1 -- 172.21.15.1:0/1787507074 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4d8005000 msgr2=0x7fb4d800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:34:14.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.273+0000 7fb4f4b64700 1 --2- 172.21.15.1:0/1787507074 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4d8005000 0x7fb4d800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.273+0000 7fb4f4b64700 1 -- 172.21.15.1:0/1787507074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d80033f0 con 0x7fb4d8004690 2023-11-15T01:34:14.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.273+0000 7fb4f5b66700 1 --2- 172.21.15.1:0/1787507074 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4d8005000 0x7fb4d800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:34:14.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.273+0000 7fb4f5b66700 1 -- 172.21.15.1:0/1787507074 reap_dead start 2023-11-15T01:34:14.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.273+0000 7fb4f4b64700 1 --2- 172.21.15.1:0/1787507074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4d8004690 0x7fb4d8004b10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fb4e400c190 tx=0x7fb4e4001e10).ready entity=mon.0 client_cookie=b4732d39197203c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:14.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.273+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e400ca00 con 0x7fb4d8004690 2023-11-15T01:34:14.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.273+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e400cb60 con 0x7fb4d8004690 2023-11-15T01:34:14.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.273+0000 7fb4effff700 1 -- 172.21.15.1:0/1787507074 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40070d0 con 0x7fb4d8004690 2023-11-15T01:34:14.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.273+0000 7fb4f75c9700 1 -- 172.21.15.1:0/1787507074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4d8004690 msgr2=0x7fb4d8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.273+0000 7fb4f75c9700 1 --2- 172.21.15.1:0/1787507074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4d8004690 0x7fb4d8004b10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fb4e400c190 tx=0x7fb4e4001e10).stop 2023-11-15T01:34:14.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.274+0000 7fb4f75c9700 1 -- 172.21.15.1:0/1787507074 shutdown_connections 2023-11-15T01:34:14.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.274+0000 7fb4f75c9700 1 --2- 172.21.15.1:0/1787507074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4d8004690 0x7fb4d8004b10 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.274+0000 7fb4f75c9700 1 -- 172.21.15.1:0/1787507074 >> 172.21.15.1:0/1787507074 conn(0x7fb4f0069ee0 msgr2=0x7fb4f006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:14.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.274+0000 7fb4f75c9700 1 -- 172.21.15.1:0/1787507074 shutdown_connections 2023-11-15T01:34:14.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.274+0000 7fb4f75c9700 1 -- 172.21.15.1:0/1787507074 wait complete. 2023-11-15T01:34:14.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.275+0000 7fb4f75c9700 1 Processor -- start 2023-11-15T01:34:14.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.275+0000 7fb4f75c9700 1 -- start start 2023-11-15T01:34:14.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f75c9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4d8004690 0x7fb4f014e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:14.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f75c9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4f00acc00 0x7fb4f00ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:14.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f75c9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4f014c610 0x7fb4f014ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:14.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f75c9700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f0168db0 con 0x7fb4f00acc00 2023-11-15T01:34:14.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f75c9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00ab6e0 con 0x7fb4f014c610 2023-11-15T01:34:14.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f75c9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00ab9c0 con 0x7fb4d8004690 2023-11-15T01:34:14.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f4b64700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4f00acc00 0x7fb4f00ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:14.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f4b64700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4f00acc00 0x7fb4f00ac1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51078/0 (socket says 172.21.15.1:51078) 2023-11-15T01:34:14.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f4b64700 1 -- 172.21.15.1:0/2189612732 learned_addr learned my addr 172.21.15.1:0/2189612732 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:14.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f5365700 1 --2- 172.21.15.1:0/2189612732 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4d8004690 0x7fb4f014e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:14.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f5b66700 1 --2- 172.21.15.1:0/2189612732 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4f014c610 0x7fb4f014ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:14.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f4b64700 1 -- 172.21.15.1:0/2189612732 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4d8004690 msgr2=0x7fb4f014e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f4b64700 1 --2- 172.21.15.1:0/2189612732 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4d8004690 0x7fb4f014e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f4b64700 1 -- 172.21.15.1:0/2189612732 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4f014c610 msgr2=0x7fb4f014ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f4b64700 1 --2- 172.21.15.1:0/2189612732 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4f014c610 0x7fb4f014ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f4b64700 1 -- 172.21.15.1:0/2189612732 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f00abca0 con 0x7fb4f00acc00 2023-11-15T01:34:14.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f4b64700 1 --2- 172.21.15.1:0/2189612732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4f00acc00 0x7fb4f00ac1c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fb4d80045c0 tx=0x7fb4e4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:14.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4ed7fa700 1 -- 172.21.15.1:0/2189612732 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4001370 con 0x7fb4f00acc00 2023-11-15T01:34:14.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4ed7fa700 1 -- 172.21.15.1:0/2189612732 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e40014d0 con 0x7fb4f00acc00 2023-11-15T01:34:14.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f75c9700 1 -- 172.21.15.1:0/2189612732 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f0168a00 con 0x7fb4f00acc00 2023-11-15T01:34:14.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4ed7fa700 1 -- 172.21.15.1:0/2189612732 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4004900 con 0x7fb4f00acc00 2023-11-15T01:34:14.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.276+0000 7fb4f75c9700 1 -- 172.21.15.1:0/2189612732 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f00c9ed0 con 0x7fb4f00acc00 2023-11-15T01:34:14.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.278+0000 7fb4f75c9700 1 -- 172.21.15.1:0/2189612732 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f00ab540 con 0x7fb4f00acc00 2023-11-15T01:34:14.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.278+0000 7fb4ed7fa700 1 -- 172.21.15.1:0/2189612732 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fb4e4004cf0 con 0x7fb4f00acc00 2023-11-15T01:34:14.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.278+0000 7fb4ed7fa700 1 --2- 172.21.15.1:0/2189612732 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb4dc05f0b0 0x7fb4dc061570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:14.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.278+0000 7fb4ed7fa700 1 -- 172.21.15.1:0/2189612732 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6775+0+0 (secure 0 0 0) 0x7fb4e407acb0 con 0x7fb4f00acc00 2023-11-15T01:34:14.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.278+0000 7fb4f5365700 1 --2- 172.21.15.1:0/2189612732 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb4dc05f0b0 0x7fb4dc061570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:14.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.279+0000 7fb4f5365700 1 --2- 172.21.15.1:0/2189612732 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb4dc05f0b0 0x7fb4dc061570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb4e8006d80 tx=0x7fb4e8009060).ready entity=mgr.5596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:14.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.282+0000 7fb4ed7fa700 1 -- 172.21.15.1:0/2189612732 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb4f00ab540 con 0x7fb4f00acc00 2023-11-15T01:34:14.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.480+0000 7fb4f75c9700 1 -- 172.21.15.1:0/2189612732 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4f00ab850 con 0x7fb4dc05f0b0 2023-11-15T01:34:14.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.485+0000 7fb4ed7fa700 1 -- 172.21.15.1:0/2189612732 <== mgr.5596 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb4f00ab850 con 0x7fb4dc05f0b0 2023-11-15T01:34:14.486 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path snap_test_dir1 2023-11-15T01:34:14.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.487+0000 7fb4f75c9700 1 -- 172.21.15.1:0/2189612732 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb4dc05f0b0 msgr2=0x7fb4dc061570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.487+0000 7fb4f75c9700 1 --2- 172.21.15.1:0/2189612732 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb4dc05f0b0 0x7fb4dc061570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb4e8006d80 tx=0x7fb4e8009060).stop 2023-11-15T01:34:14.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.487+0000 7fb4f75c9700 1 -- 172.21.15.1:0/2189612732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4f00acc00 msgr2=0x7fb4f00ac1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.487+0000 7fb4f75c9700 1 --2- 172.21.15.1:0/2189612732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4f00acc00 0x7fb4f00ac1c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fb4d80045c0 tx=0x7fb4e4015000).stop 2023-11-15T01:34:14.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.487+0000 7fb4f75c9700 1 -- 172.21.15.1:0/2189612732 shutdown_connections 2023-11-15T01:34:14.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.487+0000 7fb4f75c9700 1 --2- 172.21.15.1:0/2189612732 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb4dc05f0b0 0x7fb4dc061570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.487+0000 7fb4f75c9700 1 --2- 172.21.15.1:0/2189612732 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4f014c610 0x7fb4f014ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.487+0000 7fb4f75c9700 1 --2- 172.21.15.1:0/2189612732 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4d8004690 0x7fb4f014e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.487+0000 7fb4f75c9700 1 --2- 172.21.15.1:0/2189612732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4f00acc00 0x7fb4f00ac1c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.487+0000 7fb4f75c9700 1 -- 172.21.15.1:0/2189612732 >> 172.21.15.1:0/2189612732 conn(0x7fb4f0069ee0 msgr2=0x7fb4f014ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:14.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.487+0000 7fb4f75c9700 1 -- 172.21.15.1:0/2189612732 shutdown_connections 2023-11-15T01:34:14.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.487+0000 7fb4f75c9700 1 -- 172.21.15.1:0/2189612732 wait complete. 2023-11-15T01:34:14.500 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-11-15T01:34:14.501 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-11-15-01_35_00 in ~46s... 2023-11-15T01:34:14.501 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-11-15-01_36_00 in ~106s... 2023-11-15T01:34:14.501 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-11-15T01:34:14.502 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-11-15T01:34:14.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.622+0000 7f25abfff700 1 Processor -- start 2023-11-15T01:34:14.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.622+0000 7f25abfff700 1 -- start start 2023-11-15T01:34:14.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.623+0000 7f25abfff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f25ac0aca50 0x7f25ac15ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:14.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.623+0000 7f25abfff700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ac0caee0 con 0x7f25ac0ada30 2023-11-15T01:34:14.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.623+0000 7f25abfff700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ac0ca920 con 0x7f25ac0c60c0 2023-11-15T01:34:14.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.623+0000 7f25abfff700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac154850 con 0x7f25ac0aca50 2023-11-15T01:34:14.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.623+0000 7f25aaffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f25ac0ada30 0x7f25ac0c9f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49436/0 (socket says 172.21.15.1:49436) 2023-11-15T01:34:14.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.623+0000 7f25aaffd700 1 -- 172.21.15.1:0/4120964919 learned_addr learned my addr 172.21.15.1:0/4120964919 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:34:14.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.623+0000 7f25ab7fe700 1 --2- 172.21.15.1:0/4120964919 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f25ac0aca50 0x7f25ac15ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:14.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.623+0000 7f25a9ffb700 1 -- 172.21.15.1:0/4120964919 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004903324 0 0) 0x7f25ac0caee0 con 0x7f25ac0ada30 2023-11-15T01:34:14.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.623+0000 7f25a9ffb700 1 -- 172.21.15.1:0/4120964919 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25980033f0 con 0x7f25ac0ada30 2023-11-15T01:34:14.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.623+0000 7f25a9ffb700 1 -- 172.21.15.1:0/4120964919 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971656274 0 0) 0x7f25ac0ca920 con 0x7f25ac0c60c0 2023-11-15T01:34:14.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.623+0000 7f25a9ffb700 1 -- 172.21.15.1:0/4120964919 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25ac0caee0 con 0x7f25ac0c60c0 2023-11-15T01:34:14.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.623+0000 7f25ab7fe700 1 -- 172.21.15.1:0/4120964919 >> v1:172.21.15.141:6789/0 conn(0x7f25ac0c60c0 legacy=0x7f25ac0c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.623+0000 7f25ab7fe700 1 -- 172.21.15.1:0/4120964919 >> v1:172.21.15.1:6789/0 conn(0x7f25ac0ada30 legacy=0x7f25ac0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.623+0000 7f25ab7fe700 1 -- 172.21.15.1:0/4120964919 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac0cac00 con 0x7f25ac0aca50 2023-11-15T01:34:14.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.624+0000 7f25ab7fe700 1 --2- 172.21.15.1:0/4120964919 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f25ac0aca50 0x7f25ac15ef30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f259c009e90 tx=0x7f259c009780).ready entity=mon.2 client_cookie=74709365c3f98d2b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:14.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.624+0000 7f25a9ffb700 1 -- 172.21.15.1:0/4120964919 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c00e070 con 0x7f25ac0aca50 2023-11-15T01:34:14.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.624+0000 7f25a9ffb700 1 -- 172.21.15.1:0/4120964919 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c00bab0 con 0x7f25ac0aca50 2023-11-15T01:34:14.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.624+0000 7f25a9ffb700 1 -- 172.21.15.1:0/4120964919 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c00be30 con 0x7f25ac0aca50 2023-11-15T01:34:14.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.624+0000 7f25abfff700 1 -- 172.21.15.1:0/4120964919 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f25ac0aca50 msgr2=0x7f25ac15ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.624+0000 7f25abfff700 1 --2- 172.21.15.1:0/4120964919 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f25ac0aca50 0x7f25ac15ef30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f259c009e90 tx=0x7f259c009780).stop 2023-11-15T01:34:14.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.624+0000 7f25abfff700 1 -- 172.21.15.1:0/4120964919 shutdown_connections 2023-11-15T01:34:14.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.624+0000 7f25abfff700 1 --2- 172.21.15.1:0/4120964919 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f25ac0aca50 0x7f25ac15ef30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.624+0000 7f25abfff700 1 -- 172.21.15.1:0/4120964919 >> 172.21.15.1:0/4120964919 conn(0x7f25ac064a60 msgr2=0x7f25ac064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:14.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.624+0000 7f25abfff700 1 -- 172.21.15.1:0/4120964919 shutdown_connections 2023-11-15T01:34:14.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.624+0000 7f25abfff700 1 -- 172.21.15.1:0/4120964919 wait complete. 2023-11-15T01:34:14.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.626+0000 7f25abfff700 1 Processor -- start 2023-11-15T01:34:14.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.626+0000 7f25abfff700 1 -- start start 2023-11-15T01:34:14.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.626+0000 7f25abfff700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f25ac0aca50 0x7f25ac1558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:14.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.626+0000 7f25abfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25ac0ada30 0x7f25ac0c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:14.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.626+0000 7f25abfff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f25ac0c60c0 0x7f25ac14ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:14.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.626+0000 7f25abfff700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac154cf0 con 0x7f25ac0ada30 2023-11-15T01:34:14.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.626+0000 7f25abfff700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac0c4550 con 0x7f25ac0aca50 2023-11-15T01:34:14.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.626+0000 7f25abfff700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac0c36e0 con 0x7f25ac0c60c0 2023-11-15T01:34:14.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25aa7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25ac0ada30 0x7f25ac0c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:14.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25aa7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25ac0ada30 0x7f25ac0c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51092/0 (socket says 172.21.15.1:51092) 2023-11-15T01:34:14.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25aa7fc700 1 -- 172.21.15.1:0/88785936 learned_addr learned my addr 172.21.15.1:0/88785936 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:34:14.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25aaffd700 1 --2- 172.21.15.1:0/88785936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f25ac0aca50 0x7f25ac1558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:14.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25ab7fe700 1 --2- 172.21.15.1:0/88785936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f25ac0c60c0 0x7f25ac14ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:14.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25aa7fc700 1 -- 172.21.15.1:0/88785936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f25ac0c60c0 msgr2=0x7f25ac14ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25aa7fc700 1 --2- 172.21.15.1:0/88785936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f25ac0c60c0 0x7f25ac14ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25aa7fc700 1 -- 172.21.15.1:0/88785936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f25ac0aca50 msgr2=0x7f25ac1558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25aa7fc700 1 --2- 172.21.15.1:0/88785936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f25ac0aca50 0x7f25ac1558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25aa7fc700 1 -- 172.21.15.1:0/88785936 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c009a20 con 0x7f25ac0ada30 2023-11-15T01:34:14.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25aaffd700 1 --2- 172.21.15.1:0/88785936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f25ac0aca50 0x7f25ac1558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:34:14.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25aa7fc700 1 --2- 172.21.15.1:0/88785936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25ac0ada30 0x7f25ac0c31f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f259400c440 tx=0x7f2594007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:14.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25a2ffd700 1 -- 172.21.15.1:0/88785936 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259400f470 con 0x7f25ac0ada30 2023-11-15T01:34:14.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25a2ffd700 1 -- 172.21.15.1:0/88785936 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259400f5d0 con 0x7f25ac0ada30 2023-11-15T01:34:14.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25abfff700 1 -- 172.21.15.1:0/88785936 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ac14b320 con 0x7f25ac0ada30 2023-11-15T01:34:14.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25a2ffd700 1 -- 172.21.15.1:0/88785936 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259400f990 con 0x7f25ac0ada30 2023-11-15T01:34:14.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.627+0000 7f25abfff700 1 -- 172.21.15.1:0/88785936 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ac0c3c20 con 0x7f25ac0ada30 2023-11-15T01:34:14.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.628+0000 7f25abfff700 1 -- 172.21.15.1:0/88785936 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ac0c46c0 con 0x7f25ac0ada30 2023-11-15T01:34:14.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.629+0000 7f25a2ffd700 1 -- 172.21.15.1:0/88785936 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f259400fd00 con 0x7f25ac0ada30 2023-11-15T01:34:14.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.629+0000 7f25a2ffd700 1 --2- 172.21.15.1:0/88785936 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f258c05f080 0x7f258c061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:34:14.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.629+0000 7f25a2ffd700 1 -- 172.21.15.1:0/88785936 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f25940796e0 con 0x7f25ac0ada30 2023-11-15T01:34:14.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.629+0000 7f25aaffd700 1 --2- 172.21.15.1:0/88785936 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f258c05f080 0x7f258c061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:34:14.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.629+0000 7f25aaffd700 1 --2- 172.21.15.1:0/88785936 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f258c05f080 0x7f258c061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f25a4005750 tx=0x7f25a4009040).ready entity=mgr.5596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:34:14.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.633+0000 7f25a2ffd700 1 -- 172.21.15.1:0/88785936 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2594048af0 con 0x7f25ac0ada30 2023-11-15T01:34:14.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.834+0000 7f25abfff700 1 -- 172.21.15.1:0/88785936 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25ac0475e0 con 0x7f258c05f080 2023-11-15T01:34:14.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.837+0000 7f25a2ffd700 1 -- 172.21.15.1:0/88785936 <== mgr.5596 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7f25ac0475e0 con 0x7f258c05f080 2023-11-15T01:34:14.838 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:34:14.839 INFO:teuthology.orchestra.run.smithi001.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-11-15T01:34:14.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.839+0000 7f25abfff700 1 -- 172.21.15.1:0/88785936 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f258c05f080 msgr2=0x7f258c061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.839+0000 7f25abfff700 1 --2- 172.21.15.1:0/88785936 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f258c05f080 0x7f258c061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f25a4005750 tx=0x7f25a4009040).stop 2023-11-15T01:34:14.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.839+0000 7f25abfff700 1 -- 172.21.15.1:0/88785936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25ac0ada30 msgr2=0x7f25ac0c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:34:14.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.839+0000 7f25abfff700 1 --2- 172.21.15.1:0/88785936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25ac0ada30 0x7f25ac0c31f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f259400c440 tx=0x7f2594007c90).stop 2023-11-15T01:34:14.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.839+0000 7f25abfff700 1 -- 172.21.15.1:0/88785936 shutdown_connections 2023-11-15T01:34:14.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.839+0000 7f25abfff700 1 --2- 172.21.15.1:0/88785936 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f258c05f080 0x7f258c061540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.839+0000 7f25abfff700 1 --2- 172.21.15.1:0/88785936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f25ac0c60c0 0x7f25ac14ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.839+0000 7f25abfff700 1 --2- 172.21.15.1:0/88785936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f25ac0aca50 0x7f25ac1558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.839+0000 7f25abfff700 1 --2- 172.21.15.1:0/88785936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25ac0ada30 0x7f25ac0c31f0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:34:14.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.839+0000 7f25abfff700 1 -- 172.21.15.1:0/88785936 >> 172.21.15.1:0/88785936 conn(0x7f25ac064a60 msgr2=0x7f25ac153be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:34:14.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.839+0000 7f25abfff700 1 -- 172.21.15.1:0/88785936 shutdown_connections 2023-11-15T01:34:14.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:34:14.839+0000 7f25abfff700 1 -- 172.21.15.1:0/88785936 wait complete. 2023-11-15T01:34:14.853 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-11-15T01:34:14.854 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-11-15T01:34:14.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:14.854 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:15.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:15.872 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:16.789 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:34:16.792 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:34:16.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:16.894 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:17.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:17.916 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:18.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:18.937 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:19.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:19.959 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:20.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:20.981 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:22.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:22.002 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:23.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:23.024 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:24.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:24.046 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:25.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:25.068 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:26.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:26.090 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:27.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:27.111 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:28.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:28.133 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:29.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:29.154 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:30.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:30.176 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:31.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:31.198 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:32.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:32.220 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:33.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:33.240 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:34.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:34.261 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:35.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:35.284 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:36.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:36.308 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:37.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:37.329 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:38.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:38.355 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:39.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:39.377 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:40.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:40.398 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:41.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:41.420 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:42.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:42.442 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:43.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:43.462 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:44.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:44.484 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:45.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:45.505 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:46.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:46.527 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:46.860 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:34:46.863 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:34:47.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:47.548 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:48.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:48.571 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:49.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:49.592 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:50.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:50.614 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:51.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:51.635 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:52.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:52.657 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:53.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:53.678 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:54.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:54.700 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:55.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:55.721 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:56.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:56.743 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:57.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:57.765 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:58.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:58.787 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:34:59.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:34:59.809 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:00.490 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:35:00.489+0000 7f9b17973700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:35:00.490 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:35:00.489+0000 7f9b17973700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:35:00.490 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:35:00.489+0000 7f9b17973700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:35:00.491 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:35:00.489+0000 7f9b17973700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:35:00.491 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:35:00.489+0000 7f9b17973700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:35:00.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:00.830 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:00.849 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:00.850 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-11-15-01_35_00_UTC'] 2023-11-15T01:35:00.851 DEBUG:tasks.cephfs.test_snap_schedules:exec=1700012054.501035, now = 1700012100.8511796, timo = 46 2023-11-15T01:35:01.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:01.852 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:01.873 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:02.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:02.875 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:02.895 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:03.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:03.897 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:03.917 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:04.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:04.919 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:04.939 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:05.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:05.941 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:05.961 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:06.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:06.963 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:06.982 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:07.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:07.984 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:08.005 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:09.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:09.008 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:09.028 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:10.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:10.030 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:10.050 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:11.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:11.052 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:11.071 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:12.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:12.073 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:12.093 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:13.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:13.095 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:13.114 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:14.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:14.116 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:14.136 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:15.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:15.139 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:15.159 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:16.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:16.161 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:16.180 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:16.923 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:35:16.926 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:35:17.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:17.183 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:17.202 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:18.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:18.204 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:18.224 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:19.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:19.226 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:19.245 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:20.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:20.247 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:20.267 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:21.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:21.269 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:21.288 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:22.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:22.291 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:22.310 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:23.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:23.313 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:23.333 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:24.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:24.335 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:24.354 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:25.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:25.357 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:25.377 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:26.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:26.379 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:26.399 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:27.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:27.401 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:27.420 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:28.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:28.422 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:28.442 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:29.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:29.444 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:29.464 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:30.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:30.467 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:30.487 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:31.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:31.488 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:31.507 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:32.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:32.509 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:32.528 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:33.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:33.530 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:33.550 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:34.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:34.552 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:34.571 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:35.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:35.574 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:35.593 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:36.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:36.596 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:36.616 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:37.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:37.617 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:37.637 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:38.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:38.639 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:38.659 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:39.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:39.660 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:39.680 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:40.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:40.682 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:40.702 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:41.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:41.704 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:41.724 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:42.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:42.727 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:42.746 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:43.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:43.749 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:43.769 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:44.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:44.771 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:44.791 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:45.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:45.794 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:45.813 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:46.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:46.815 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:46.835 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:46.994 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:35:46.997 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:35:47.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:47.837 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:47.857 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:48.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:48.859 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:48.880 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:49.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:49.882 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:49.901 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:50.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:50.904 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:50.924 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:51.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:51.926 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:51.945 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:52.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:52.948 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:52.967 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:53.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:53.970 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:53.990 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:54.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:54.991 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:55.012 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:56.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:56.014 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:56.034 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:57.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:57.036 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:57.055 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:58.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:58.057 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:58.078 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:35:59.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:35:59.080 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:35:59.099 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:36:00.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:36:00.101 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:36:00.120 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:36:01.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:36:01.123 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:36:01.143 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:36:01.143 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_36_00_UTC 2023-11-15T01:36:01.143 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-11-15-01_36_00_UTC'] 2023-11-15T01:36:01.144 DEBUG:tasks.cephfs.test_snap_schedules:exec=1700012054.501035, now = 1700012161.1442196, timo = 106 2023-11-15T01:36:02.145 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-11-15T01:36:02.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.280+0000 7f60ca752700 1 Processor -- start 2023-11-15T01:36:02.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.280+0000 7f60ca752700 1 -- start start 2023-11-15T01:36:02.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.281+0000 7f60ca752700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60c40aa750 0x7f60c40c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:02.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.281+0000 7f60ca752700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c41580d0 con 0x7f60c414b730 2023-11-15T01:36:02.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.281+0000 7f60ca752700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c4155000 con 0x7f60c414b350 2023-11-15T01:36:02.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.281+0000 7f60ca752700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c41552e0 con 0x7f60c40aa750 2023-11-15T01:36:02.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.281+0000 7f60c8cef700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f60c414b730 0x7f60c4158560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34646/0 (socket says 172.21.15.1:34646) 2023-11-15T01:36:02.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.281+0000 7f60c8cef700 1 -- 172.21.15.1:0/2895964998 learned_addr learned my addr 172.21.15.1:0/2895964998 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:02.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c37fe700 1 --2- 172.21.15.1:0/2895964998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60c40aa750 0x7f60c40c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:02.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c2ffd700 1 -- 172.21.15.1:0/2895964998 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773599217 0 0) 0x7f60c41580d0 con 0x7f60c414b730 2023-11-15T01:36:02.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c2ffd700 1 -- 172.21.15.1:0/2895964998 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b00033f0 con 0x7f60c414b730 2023-11-15T01:36:02.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c2ffd700 1 -- 172.21.15.1:0/2895964998 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 518977929 0 0) 0x7f60b00033f0 con 0x7f60c414b730 2023-11-15T01:36:02.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c2ffd700 1 -- 172.21.15.1:0/2895964998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60c40aa750 msgr2=0x7f60c40c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:02.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c2ffd700 1 --2- 172.21.15.1:0/2895964998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60c40aa750 0x7f60c40c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:02.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c2ffd700 1 -- 172.21.15.1:0/2895964998 >> v1:172.21.15.141:6789/0 conn(0x7f60c414b350 legacy=0x7f60c40aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:02.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c2ffd700 1 -- 172.21.15.1:0/2895964998 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c41555c0 con 0x7f60c414b730 2023-11-15T01:36:02.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c2ffd700 1 -- 172.21.15.1:0/2895964998 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f60bc0017f0 con 0x7f60c414b730 2023-11-15T01:36:02.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c2ffd700 1 -- 172.21.15.1:0/2895964998 >> v1:172.21.15.1:6789/0 conn(0x7f60c414b730 legacy=0x7f60c4158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:02.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c2ffd700 1 --2- 172.21.15.1:0/2895964998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60b0003910 0x7f60b0003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:02.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c2ffd700 1 --2- 172.21.15.1:0/2895964998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b0004690 0x7f60b0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:02.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c2ffd700 1 --2- 172.21.15.1:0/2895964998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60c40aa750 0x7f60b0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:02.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c2ffd700 1 -- 172.21.15.1:0/2895964998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c41552e0 con 0x7f60b0004690 2023-11-15T01:36:02.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c2ffd700 1 -- 172.21.15.1:0/2895964998 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b000b8e0 con 0x7f60b0003910 2023-11-15T01:36:02.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c2ffd700 1 -- 172.21.15.1:0/2895964998 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b000ba50 con 0x7f60c40aa750 2023-11-15T01:36:02.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c37fe700 1 --2- 172.21.15.1:0/2895964998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b0004690 0x7f60b0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:02.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c3fff700 1 --2- 172.21.15.1:0/2895964998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60b0003910 0x7f60b0003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:02.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.282+0000 7f60c8cef700 1 --2- 172.21.15.1:0/2895964998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60c40aa750 0x7f60b0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:02.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.283+0000 7f60c37fe700 1 -- 172.21.15.1:0/2895964998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60c40aa750 msgr2=0x7f60b0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:02.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.283+0000 7f60c37fe700 1 --2- 172.21.15.1:0/2895964998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60c40aa750 0x7f60b0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:02.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.283+0000 7f60c37fe700 1 -- 172.21.15.1:0/2895964998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60b0003910 msgr2=0x7f60b0003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:02.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.283+0000 7f60c37fe700 1 --2- 172.21.15.1:0/2895964998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60b0003910 0x7f60b0003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:02.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.283+0000 7f60c37fe700 1 -- 172.21.15.1:0/2895964998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b00033f0 con 0x7f60b0004690 2023-11-15T01:36:02.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.283+0000 7f60c37fe700 1 --2- 172.21.15.1:0/2895964998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b0004690 0x7f60b0004b10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f60c40aab50 tx=0x7f60b4009060).ready entity=mon.0 client_cookie=f0a1e38be640336f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:02.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.283+0000 7f60c2ffd700 1 -- 172.21.15.1:0/2895964998 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4009430 con 0x7f60b0004690 2023-11-15T01:36:02.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.283+0000 7f60c2ffd700 1 -- 172.21.15.1:0/2895964998 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b4009e70 con 0x7f60b0004690 2023-11-15T01:36:02.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.283+0000 7f60c2ffd700 1 -- 172.21.15.1:0/2895964998 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b400e7f0 con 0x7f60b0004690 2023-11-15T01:36:02.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.283+0000 7f60ca752700 1 -- 172.21.15.1:0/2895964998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b0004690 msgr2=0x7f60b0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:02.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.283+0000 7f60ca752700 1 --2- 172.21.15.1:0/2895964998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b0004690 0x7f60b0004b10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f60c40aab50 tx=0x7f60b4009060).stop 2023-11-15T01:36:02.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.283+0000 7f60c8cef700 1 -- 172.21.15.1:0/2895964998 reap_dead start 2023-11-15T01:36:02.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.283+0000 7f60ca752700 1 -- 172.21.15.1:0/2895964998 shutdown_connections 2023-11-15T01:36:02.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.283+0000 7f60ca752700 1 -- 172.21.15.1:0/2895964998 >> 172.21.15.1:0/2895964998 conn(0x7f60c4069ee0 msgr2=0x7f60c406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:02.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.284+0000 7f60ca752700 1 -- 172.21.15.1:0/2895964998 shutdown_connections 2023-11-15T01:36:02.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.284+0000 7f60ca752700 1 -- 172.21.15.1:0/2895964998 wait complete. 2023-11-15T01:36:02.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.285+0000 7f60ca752700 1 Processor -- start 2023-11-15T01:36:02.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.285+0000 7f60ca752700 1 -- start start 2023-11-15T01:36:02.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60ca752700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b0004690 0x7f60c4148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:02.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60ca752700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60c4149370 0x7f60c41474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:02.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60ca752700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60c41479a0 0x7f60c4147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:02.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60ca752700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40ae090 con 0x7f60b0004690 2023-11-15T01:36:02.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60ca752700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40c2990 con 0x7f60c4149370 2023-11-15T01:36:02.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60ca752700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40c37d0 con 0x7f60c41479a0 2023-11-15T01:36:02.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60c3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b0004690 0x7f60c4148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:02.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60c3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b0004690 0x7f60c4148e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54006/0 (socket says 172.21.15.1:54006) 2023-11-15T01:36:02.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60c3fff700 1 -- 172.21.15.1:0/2340953685 learned_addr learned my addr 172.21.15.1:0/2340953685 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:02.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60c37fe700 1 --2- 172.21.15.1:0/2340953685 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60c4149370 0x7f60c41474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:02.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60c8cef700 1 --2- 172.21.15.1:0/2340953685 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60c41479a0 0x7f60c4147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:02.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60c3fff700 1 -- 172.21.15.1:0/2340953685 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60c41479a0 msgr2=0x7f60c4147e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:02.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60c3fff700 1 --2- 172.21.15.1:0/2340953685 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60c41479a0 0x7f60c4147e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:02.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60c3fff700 1 -- 172.21.15.1:0/2340953685 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60c4149370 msgr2=0x7f60c41474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:02.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60c3fff700 1 --2- 172.21.15.1:0/2340953685 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60c4149370 0x7f60c41474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:02.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60c3fff700 1 -- 172.21.15.1:0/2340953685 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c4148310 con 0x7f60b0004690 2023-11-15T01:36:02.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60c37fe700 1 --2- 172.21.15.1:0/2340953685 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60c4149370 0x7f60c41474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:02.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60c3fff700 1 --2- 172.21.15.1:0/2340953685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b0004690 0x7f60c4148e80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f60ac002a00 tx=0x7f60ac007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:02.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60bbfff700 1 -- 172.21.15.1:0/2340953685 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00f8d0 con 0x7f60b0004690 2023-11-15T01:36:02.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60bbfff700 1 -- 172.21.15.1:0/2340953685 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac00fa30 con 0x7f60b0004690 2023-11-15T01:36:02.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60ca752700 1 -- 172.21.15.1:0/2340953685 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c41471f0 con 0x7f60b0004690 2023-11-15T01:36:02.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60bbfff700 1 -- 172.21.15.1:0/2340953685 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00fdb0 con 0x7f60b0004690 2023-11-15T01:36:02.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.286+0000 7f60ca752700 1 -- 172.21.15.1:0/2340953685 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c40c2ea0 con 0x7f60b0004690 2023-11-15T01:36:02.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.288+0000 7f60ca752700 1 -- 172.21.15.1:0/2340953685 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c406c7e0 con 0x7f60b0004690 2023-11-15T01:36:02.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.288+0000 7f60bbfff700 1 -- 172.21.15.1:0/2340953685 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f60ac014660 con 0x7f60b0004690 2023-11-15T01:36:02.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.288+0000 7f60bbfff700 1 --2- 172.21.15.1:0/2340953685 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60a405f2f0 0x7f60a40617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:02.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.288+0000 7f60bbfff700 1 -- 172.21.15.1:0/2340953685 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6891+0+0 (secure 0 0 0) 0x7f60ac07a4f0 con 0x7f60b0004690 2023-11-15T01:36:02.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.289+0000 7f60c37fe700 1 --2- 172.21.15.1:0/2340953685 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60a405f2f0 0x7f60a40617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:02.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.289+0000 7f60c37fe700 1 --2- 172.21.15.1:0/2340953685 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60a405f2f0 0x7f60a40617b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f60c414ee10 tx=0x7f60b401a000).ready entity=mgr.5596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:02.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.292+0000 7f60bbfff700 1 -- 172.21.15.1:0/2340953685 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f60ac04aaf0 con 0x7f60b0004690 2023-11-15T01:36:02.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.492+0000 7f60ca752700 1 -- 172.21.15.1:0/2340953685 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f60c40c61c0 con 0x7f60a405f2f0 2023-11-15T01:36:02.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.497+0000 7f60bbfff700 1 -- 172.21.15.1:0/2340953685 <== mgr.5596 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f60c40c61c0 con 0x7f60a405f2f0 2023-11-15T01:36:02.497 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path snap_test_dir1 2023-11-15T01:36:02.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.498+0000 7f60ca752700 1 -- 172.21.15.1:0/2340953685 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60a405f2f0 msgr2=0x7f60a40617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:02.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.498+0000 7f60ca752700 1 --2- 172.21.15.1:0/2340953685 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60a405f2f0 0x7f60a40617b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f60c414ee10 tx=0x7f60b401a000).stop 2023-11-15T01:36:02.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.498+0000 7f60ca752700 1 -- 172.21.15.1:0/2340953685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b0004690 msgr2=0x7f60c4148e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:02.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.498+0000 7f60ca752700 1 --2- 172.21.15.1:0/2340953685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b0004690 0x7f60c4148e80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f60ac002a00 tx=0x7f60ac007b90).stop 2023-11-15T01:36:02.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.498+0000 7f60ca752700 1 -- 172.21.15.1:0/2340953685 shutdown_connections 2023-11-15T01:36:02.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.498+0000 7f60ca752700 1 --2- 172.21.15.1:0/2340953685 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60a405f2f0 0x7f60a40617b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:02.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.498+0000 7f60ca752700 1 --2- 172.21.15.1:0/2340953685 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60c41479a0 0x7f60c4147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:02.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.498+0000 7f60ca752700 1 --2- 172.21.15.1:0/2340953685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b0004690 0x7f60c4148e80 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:02.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.498+0000 7f60ca752700 1 --2- 172.21.15.1:0/2340953685 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60c4149370 0x7f60c41474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:02.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.498+0000 7f60ca752700 1 -- 172.21.15.1:0/2340953685 >> 172.21.15.1:0/2340953685 conn(0x7f60c4069ee0 msgr2=0x7f60c40c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:02.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.498+0000 7f60ca752700 1 -- 172.21.15.1:0/2340953685 shutdown_connections 2023-11-15T01:36:02.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.498+0000 7f60ca752700 1 -- 172.21.15.1:0/2340953685 wait complete. 2023-11-15T01:36:02.510 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-11-15T01:36:02.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:36:02.511 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:36:02.527 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:36:02.527 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_36_00_UTC 2023-11-15T01:36:02.528 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_35_00_UTC 2023-11-15T01:36:02.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:36:02.528 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_35_00_UTC) 2023-11-15T01:36:02.587 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_36_00_UTC 2023-11-15T01:36:02.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:36:02.589 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_36_00_UTC) 2023-11-15T01:36:02.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:36:02.648 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-11-15T01:36:02.707 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-15T01:36:02.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.865+0000 7f2e39068700 1 Processor -- start 2023-11-15T01:36:02.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.865+0000 7f2e39068700 1 -- start start 2023-11-15T01:36:02.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.866+0000 7f2e39068700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2e34137030 0x7f2e34137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:02.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.866+0000 7f2e39068700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2e341588e0 0x7f2e34066870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:02.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.866+0000 7f2e39068700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e340671b0 con 0x7f2e34066d60 2023-11-15T01:36:02.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.866+0000 7f2e39068700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e34137900 con 0x7f2e34137030 2023-11-15T01:36:02.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.866+0000 7f2e39068700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e34158d90 con 0x7f2e341588e0 2023-11-15T01:36:02.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.866+0000 7f2e32d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2e34137030 0x7f2e34137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:02.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.866+0000 7f2e32d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2e34137030 0x7f2e34137410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54018/0 (socket says 172.21.15.1:54018) 2023-11-15T01:36:02.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.866+0000 7f2e32d9d700 1 -- 172.21.15.1:0/4066579028 learned_addr learned my addr 172.21.15.1:0/4066579028 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:02.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.867+0000 7f2e32d9d700 1 -- 172.21.15.1:0/4066579028 >> v2:172.21.15.141:3300/0 conn(0x7f2e341588e0 msgr2=0x7f2e34066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:02.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.867+0000 7f2e3259c700 1 --2- 172.21.15.1:0/4066579028 >> v2:172.21.15.141:3300/0 conn(0x7f2e341588e0 0x7f2e34066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:02.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.867+0000 7f2e32d9d700 1 --2- 172.21.15.1:0/4066579028 >> v2:172.21.15.141:3300/0 conn(0x7f2e341588e0 0x7f2e34066870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:02.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.867+0000 7f2e32d9d700 1 -- 172.21.15.1:0/4066579028 >> v1:172.21.15.141:6789/0 conn(0x7f2e34066d60 legacy=0x7f2e3414e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:02.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.867+0000 7f2e32d9d700 1 -- 172.21.15.1:0/4066579028 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e34154ce0 con 0x7f2e34137030 2023-11-15T01:36:02.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.867+0000 7f2e3259c700 1 --2- 172.21.15.1:0/4066579028 >> v2:172.21.15.141:3300/0 conn(0x7f2e341588e0 0x7f2e34066870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:02.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.867+0000 7f2e32d9d700 1 --2- 172.21.15.1:0/4066579028 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e34137030 0x7f2e34137410 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f2e340c89d0 tx=0x7f2e24009840).ready entity=mon.0 client_cookie=dd0a8f3dcc5d9525 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:02.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.867+0000 7f2e31d9b700 1 -- 172.21.15.1:0/4066579028 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400e070 con 0x7f2e34137030 2023-11-15T01:36:02.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.867+0000 7f2e31d9b700 1 -- 172.21.15.1:0/4066579028 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2400ba10 con 0x7f2e34137030 2023-11-15T01:36:02.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.867+0000 7f2e31d9b700 1 -- 172.21.15.1:0/4066579028 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400bd90 con 0x7f2e34137030 2023-11-15T01:36:02.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.867+0000 7f2e39068700 1 -- 172.21.15.1:0/4066579028 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e34137030 msgr2=0x7f2e34137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:02.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.867+0000 7f2e39068700 1 --2- 172.21.15.1:0/4066579028 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e34137030 0x7f2e34137410 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f2e340c89d0 tx=0x7f2e24009840).stop 2023-11-15T01:36:02.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.868+0000 7f2e39068700 1 -- 172.21.15.1:0/4066579028 shutdown_connections 2023-11-15T01:36:02.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.868+0000 7f2e39068700 1 --2- 172.21.15.1:0/4066579028 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e34137030 0x7f2e34137410 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:02.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.868+0000 7f2e39068700 1 --2- 172.21.15.1:0/4066579028 >> v2:172.21.15.141:3300/0 conn(0x7f2e341588e0 0x7f2e34066870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:02.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.868+0000 7f2e39068700 1 -- 172.21.15.1:0/4066579028 >> 172.21.15.1:0/4066579028 conn(0x7f2e34063280 msgr2=0x7f2e340c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:02.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.868+0000 7f2e39068700 1 -- 172.21.15.1:0/4066579028 shutdown_connections 2023-11-15T01:36:02.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.868+0000 7f2e39068700 1 -- 172.21.15.1:0/4066579028 wait complete. 2023-11-15T01:36:02.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.869+0000 7f2e39068700 1 Processor -- start 2023-11-15T01:36:02.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.869+0000 7f2e39068700 1 -- start start 2023-11-15T01:36:02.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e39068700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e34066d60 0x7f2e34169400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:02.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e39068700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e34137030 0x7f2e340ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:02.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e39068700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e341588e0 0x7f2e341399a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:02.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e39068700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34137a70 con 0x7f2e341588e0 2023-11-15T01:36:02.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e39068700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e340ad7d0 con 0x7f2e34066d60 2023-11-15T01:36:02.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e39068700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34137d30 con 0x7f2e34137030 2023-11-15T01:36:02.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e3359e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e341588e0 0x7f2e341399a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:02.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e3359e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e341588e0 0x7f2e341399a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54028/0 (socket says 172.21.15.1:54028) 2023-11-15T01:36:02.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e3359e700 1 -- 172.21.15.1:0/1419666570 learned_addr learned my addr 172.21.15.1:0/1419666570 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:02.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e32d9d700 1 --2- 172.21.15.1:0/1419666570 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e34066d60 0x7f2e34169400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:02.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e3259c700 1 --2- 172.21.15.1:0/1419666570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e34137030 0x7f2e340ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:02.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e3359e700 1 -- 172.21.15.1:0/1419666570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e34137030 msgr2=0x7f2e340ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:02.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e3359e700 1 --2- 172.21.15.1:0/1419666570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e34137030 0x7f2e340ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:02.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e3359e700 1 -- 172.21.15.1:0/1419666570 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e34066d60 msgr2=0x7f2e34169400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:02.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e3359e700 1 --2- 172.21.15.1:0/1419666570 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e34066d60 0x7f2e34169400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:02.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e3359e700 1 -- 172.21.15.1:0/1419666570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e24009ae0 con 0x7f2e341588e0 2023-11-15T01:36:02.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.870+0000 7f2e3359e700 1 --2- 172.21.15.1:0/1419666570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e341588e0 0x7f2e341399a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f2e2c009470 tx=0x7f2e2c006ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:02.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.871+0000 7f2e2affd700 1 -- 172.21.15.1:0/1419666570 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c009e70 con 0x7f2e341588e0 2023-11-15T01:36:02.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.871+0000 7f2e2affd700 1 -- 172.21.15.1:0/1419666570 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2c013460 con 0x7f2e341588e0 2023-11-15T01:36:02.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.871+0000 7f2e39068700 1 -- 172.21.15.1:0/1419666570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e34138010 con 0x7f2e341588e0 2023-11-15T01:36:02.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.871+0000 7f2e2affd700 1 -- 172.21.15.1:0/1419666570 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c013820 con 0x7f2e341588e0 2023-11-15T01:36:02.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.871+0000 7f2e39068700 1 -- 172.21.15.1:0/1419666570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e341385d0 con 0x7f2e341588e0 2023-11-15T01:36:02.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.872+0000 7f2e39068700 1 -- 172.21.15.1:0/1419666570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e341387f0 con 0x7f2e341588e0 2023-11-15T01:36:02.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.872+0000 7f2e2affd700 1 -- 172.21.15.1:0/1419666570 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f2e2c013c10 con 0x7f2e341588e0 2023-11-15T01:36:02.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.872+0000 7f2e2affd700 1 --2- 172.21.15.1:0/1419666570 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2e1405f290 0x7f2e14061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:02.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.872+0000 7f2e2affd700 1 -- 172.21.15.1:0/1419666570 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6891+0+0 (secure 0 0 0) 0x7f2e2c079f40 con 0x7f2e341588e0 2023-11-15T01:36:02.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.873+0000 7f2e32d9d700 1 --2- 172.21.15.1:0/1419666570 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2e1405f290 0x7f2e14061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:02.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.873+0000 7f2e32d9d700 1 --2- 172.21.15.1:0/1419666570 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2e1405f290 0x7f2e14061750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2e2400b9e0 tx=0x7f2e24009840).ready entity=mgr.5596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:02.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:02.878+0000 7f2e2affd700 1 -- 172.21.15.1:0/1419666570 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2e2c04ad90 con 0x7f2e341588e0 2023-11-15T01:36:03.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:03.096+0000 7f2e39068700 1 -- 172.21.15.1:0/1419666570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f2e3406c7e0 con 0x7f2e341588e0 2023-11-15T01:36:03.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:03.881+0000 7f2e2affd700 1 -- 172.21.15.1:0/1419666570 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f2e2c077890 con 0x7f2e341588e0 2023-11-15T01:36:03.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:03.882+0000 7f2e2affd700 1 -- 172.21.15.1:0/1419666570 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v21) v1 ==== 93+0+0 (secure 0 0 0) 0x7f2e2c077440 con 0x7f2e341588e0 2023-11-15T01:36:03.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:03.885+0000 7f2e39068700 1 -- 172.21.15.1:0/1419666570 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2e1405f290 msgr2=0x7f2e14061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:03.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:03.885+0000 7f2e39068700 1 --2- 172.21.15.1:0/1419666570 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2e1405f290 0x7f2e14061750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2e2400b9e0 tx=0x7f2e24009840).stop 2023-11-15T01:36:03.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:03.885+0000 7f2e39068700 1 -- 172.21.15.1:0/1419666570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e341588e0 msgr2=0x7f2e341399a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:03.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:03.885+0000 7f2e39068700 1 --2- 172.21.15.1:0/1419666570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e341588e0 0x7f2e341399a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f2e2c009470 tx=0x7f2e2c006ea0).stop 2023-11-15T01:36:03.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:03.885+0000 7f2e39068700 1 -- 172.21.15.1:0/1419666570 shutdown_connections 2023-11-15T01:36:03.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:03.885+0000 7f2e39068700 1 --2- 172.21.15.1:0/1419666570 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2e1405f290 0x7f2e14061750 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:03.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:03.885+0000 7f2e39068700 1 --2- 172.21.15.1:0/1419666570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e341588e0 0x7f2e341399a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:03.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:03.885+0000 7f2e39068700 1 --2- 172.21.15.1:0/1419666570 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e34066d60 0x7f2e34169400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:03.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:03.885+0000 7f2e39068700 1 --2- 172.21.15.1:0/1419666570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e34137030 0x7f2e340ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:03.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:03.885+0000 7f2e39068700 1 -- 172.21.15.1:0/1419666570 >> 172.21.15.1:0/1419666570 conn(0x7f2e34063280 msgr2=0x7f2e34063aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:03.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:03.885+0000 7f2e39068700 1 -- 172.21.15.1:0/1419666570 shutdown_connections 2023-11-15T01:36:03.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:03.885+0000 7f2e39068700 1 -- 172.21.15.1:0/1419666570 wait complete. 2023-11-15T01:36:03.900 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T01:36:03.901 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:36:03.945 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:36:03.985 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T01:36:03.985 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-15T01:36:03.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:36:03.986 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-15T01:36:04.029 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:04.027+0000 7f02c10a9680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:36:04.031 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T01:36:04.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:36:04.031 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-15T01:36:04.033 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:04.033+0000 7f6515ce8680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:36:04.047 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:36:04.092 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:04.091+0000 7f02c10a9680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:36:04.099 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:04.099+0000 7f6515ce8680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:36:04.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.206+0000 7fb314c84700 1 Processor -- start 2023-11-15T01:36:04.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.206+0000 7fb314c84700 1 -- start start 2023-11-15T01:36:04.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.207+0000 7fb314c84700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb310154150 0x7fb310154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.207+0000 7fb314c84700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3100c06f0 con 0x7fb3100ab1a0 2023-11-15T01:36:04.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.207+0000 7fb314c84700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3100c09d0 con 0x7fb3100aa060 2023-11-15T01:36:04.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.207+0000 7fb314c84700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb310158820 con 0x7fb310154150 2023-11-15T01:36:04.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.207+0000 7fb30dd9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb3100ab1a0 0x7fb310158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34652/0 (socket says 172.21.15.1:34652) 2023-11-15T01:36:04.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.207+0000 7fb30dd9b700 1 -- 172.21.15.1:0/2652371729 learned_addr learned my addr 172.21.15.1:0/2652371729 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:04.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.208+0000 7fb30e59c700 1 --2- 172.21.15.1:0/2652371729 >> v2:172.21.15.141:3300/0 conn(0x7fb310154150 0x7fb310154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:04.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.208+0000 7fb30d59a700 1 -- 172.21.15.1:0/2652371729 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718569573 0 0) 0x7fb3100c06f0 con 0x7fb3100ab1a0 2023-11-15T01:36:04.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.208+0000 7fb30d59a700 1 -- 172.21.15.1:0/2652371729 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2f80033f0 con 0x7fb3100ab1a0 2023-11-15T01:36:04.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.208+0000 7fb30d59a700 1 -- 172.21.15.1:0/2652371729 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529504010 0 0) 0x7fb3100c09d0 con 0x7fb3100aa060 2023-11-15T01:36:04.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.208+0000 7fb30d59a700 1 -- 172.21.15.1:0/2652371729 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3100c06f0 con 0x7fb3100aa060 2023-11-15T01:36:04.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.208+0000 7fb30e59c700 1 -- 172.21.15.1:0/2652371729 >> v1:172.21.15.141:6789/0 conn(0x7fb3100aa060 legacy=0x7fb3100c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:04.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.208+0000 7fb30e59c700 1 -- 172.21.15.1:0/2652371729 >> v1:172.21.15.1:6789/0 conn(0x7fb3100ab1a0 legacy=0x7fb310158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:04.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.208+0000 7fb30e59c700 1 -- 172.21.15.1:0/2652371729 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb310158b00 con 0x7fb310154150 2023-11-15T01:36:04.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.208+0000 7fb30e59c700 1 --2- 172.21.15.1:0/2652371729 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb310154150 0x7fb310154530 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fb304009760 tx=0x7fb304009060).ready entity=mon.1 client_cookie=ae3e6bcdcf385378 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:04.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.208+0000 7fb30d59a700 1 -- 172.21.15.1:0/2652371729 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304009120 con 0x7fb310154150 2023-11-15T01:36:04.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.208+0000 7fb30d59a700 1 -- 172.21.15.1:0/2652371729 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30400d4a0 con 0x7fb310154150 2023-11-15T01:36:04.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.208+0000 7fb30d59a700 1 -- 172.21.15.1:0/2652371729 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30400d820 con 0x7fb310154150 2023-11-15T01:36:04.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.209+0000 7fb314c84700 1 -- 172.21.15.1:0/2652371729 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb310154150 msgr2=0x7fb310154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:04.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.209+0000 7fb314c84700 1 --2- 172.21.15.1:0/2652371729 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb310154150 0x7fb310154530 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fb304009760 tx=0x7fb304009060).stop 2023-11-15T01:36:04.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.209+0000 7fb314c84700 1 -- 172.21.15.1:0/2652371729 shutdown_connections 2023-11-15T01:36:04.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.209+0000 7fb314c84700 1 --2- 172.21.15.1:0/2652371729 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb310154150 0x7fb310154530 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.209+0000 7fb314c84700 1 -- 172.21.15.1:0/2652371729 >> 172.21.15.1:0/2652371729 conn(0x7fb310064aa0 msgr2=0x7fb310064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:04.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.209+0000 7fb314c84700 1 -- 172.21.15.1:0/2652371729 shutdown_connections 2023-11-15T01:36:04.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.209+0000 7fb314c84700 1 -- 172.21.15.1:0/2652371729 wait complete. 2023-11-15T01:36:04.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.210+0000 7fb314c84700 1 Processor -- start 2023-11-15T01:36:04.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.210+0000 7fb314c84700 1 -- start start 2023-11-15T01:36:04.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb314c84700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3100aa060 0x7fb310144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb314c84700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100ab1a0 0x7fb310157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb314c84700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb310154150 0x7fb310157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb314c84700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb310157a10 con 0x7fb3100ab1a0 2023-11-15T01:36:04.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb314c84700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3100aef20 con 0x7fb3100aa060 2023-11-15T01:36:04.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb314c84700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3100af200 con 0x7fb310154150 2023-11-15T01:36:04.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb30dd9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100ab1a0 0x7fb310157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:04.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb30dd9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100ab1a0 0x7fb310157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54042/0 (socket says 172.21.15.1:54042) 2023-11-15T01:36:04.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb30e59c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3100aa060 0x7fb310144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:04.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb30dd9b700 1 -- 172.21.15.1:0/726730850 learned_addr learned my addr 172.21.15.1:0/726730850 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:04.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb30ed9d700 1 --2- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb310154150 0x7fb310157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:04.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb30dd9b700 1 -- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb310154150 msgr2=0x7fb310157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:04.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb30dd9b700 1 --2- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb310154150 0x7fb310157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb30dd9b700 1 -- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3100aa060 msgr2=0x7fb310144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:04.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb30dd9b700 1 --2- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3100aa060 0x7fb310144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb30dd9b700 1 -- 172.21.15.1:0/726730850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3040092a0 con 0x7fb3100ab1a0 2023-11-15T01:36:04.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.211+0000 7fb30e59c700 1 --2- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3100aa060 0x7fb310144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:04.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.212+0000 7fb30dd9b700 1 --2- 172.21.15.1:0/726730850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100ab1a0 0x7fb310157030 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fb30000c560 tx=0x7fb300007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:04.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.212+0000 7fb2fe7fc700 1 -- 172.21.15.1:0/726730850 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30000ce70 con 0x7fb3100ab1a0 2023-11-15T01:36:04.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.212+0000 7fb2fe7fc700 1 -- 172.21.15.1:0/726730850 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3000072e0 con 0x7fb3100ab1a0 2023-11-15T01:36:04.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.212+0000 7fb314c84700 1 -- 172.21.15.1:0/726730850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3100af4e0 con 0x7fb3100ab1a0 2023-11-15T01:36:04.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.212+0000 7fb2fe7fc700 1 -- 172.21.15.1:0/726730850 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300007660 con 0x7fb3100ab1a0 2023-11-15T01:36:04.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.212+0000 7fb314c84700 1 -- 172.21.15.1:0/726730850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb310145090 con 0x7fb3100ab1a0 2023-11-15T01:36:04.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.213+0000 7fb314c84700 1 -- 172.21.15.1:0/726730850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb310154e40 con 0x7fb3100ab1a0 2023-11-15T01:36:04.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.214+0000 7fb2fe7fc700 1 -- 172.21.15.1:0/726730850 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fb3000059b0 con 0x7fb3100ab1a0 2023-11-15T01:36:04.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.214+0000 7fb2fe7fc700 1 --2- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb2f005f270 0x7fb2f0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.214+0000 7fb2fe7fc700 1 -- 172.21.15.1:0/726730850 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6891+0+0 (secure 0 0 0) 0x7fb300079cb0 con 0x7fb3100ab1a0 2023-11-15T01:36:04.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.214+0000 7fb30e59c700 1 -- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb2f005f270 msgr2=0x7fb2f0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:04.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.214+0000 7fb30e59c700 1 --2- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb2f005f270 0x7fb2f0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:04.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.218+0000 7fb2fe7fc700 1 -- 172.21.15.1:0/726730850 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb310154e40 con 0x7fb3100ab1a0 2023-11-15T01:36:04.366 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:04.364+0000 7f02c10a9680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:36:04.393 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:04.393+0000 7f6515ce8680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:36:04.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.415+0000 7fb30e59c700 1 -- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb2f005f270 msgr2=0x7fb2f0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:04.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.415+0000 7fb30e59c700 1 --2- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb2f005f270 0x7fb2f0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:36:04.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.438+0000 7fb314c84700 1 -- 172.21.15.1:0/726730850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb310154e40 con 0x7fb3100ab1a0 2023-11-15T01:36:04.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.438+0000 7fb2fe7fc700 1 -- 172.21.15.1:0/726730850 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7fb310154e40 con 0x7fb3100ab1a0 2023-11-15T01:36:04.439 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:04.439 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2009331607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2009331607},{"type":"v1","addr":"172.21.15.141:6836","nonce":2009331607}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3766593810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3766593810},{"type":"v1","addr":"172.21.15.1:6834","nonce":3766593810}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3751372395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3751372395},{"type":"v1","addr":"172.21.15.1:6835","nonce":3751372395}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:33:56.848117+0000","modified":"2023-11-15T01:33:59.859174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5802":{"gid":5802,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/3696653258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3696653258},{"type":"v1","addr":"172.21.15.141:6837","nonce":3696653258}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-11-15T01:36:04.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.440+0000 7fb314c84700 1 -- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb2f005f270 msgr2=0x7fb2f0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:04.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.440+0000 7fb314c84700 1 --2- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb2f005f270 0x7fb2f0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:04.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.440+0000 7fb314c84700 1 -- 172.21.15.1:0/726730850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100ab1a0 msgr2=0x7fb310157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:04.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.440+0000 7fb314c84700 1 --2- 172.21.15.1:0/726730850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100ab1a0 0x7fb310157030 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fb30000c560 tx=0x7fb300007d20).stop 2023-11-15T01:36:04.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.441+0000 7fb314c84700 1 -- 172.21.15.1:0/726730850 shutdown_connections 2023-11-15T01:36:04.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.441+0000 7fb314c84700 1 --2- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb2f005f270 0x7fb2f0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:04.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.441+0000 7fb314c84700 1 --2- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb310154150 0x7fb310157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.441+0000 7fb314c84700 1 --2- 172.21.15.1:0/726730850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3100aa060 0x7fb310144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.441+0000 7fb314c84700 1 --2- 172.21.15.1:0/726730850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100ab1a0 0x7fb310157030 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.441+0000 7fb314c84700 1 -- 172.21.15.1:0/726730850 >> 172.21.15.1:0/726730850 conn(0x7fb310064aa0 msgr2=0x7fb3100ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:04.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.441+0000 7fb314c84700 1 -- 172.21.15.1:0/726730850 shutdown_connections 2023-11-15T01:36:04.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.441+0000 7fb314c84700 1 -- 172.21.15.1:0/726730850 wait complete. 2023-11-15T01:36:04.444 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 23 2023-11-15T01:36:04.454 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:36:04.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.614+0000 7f32852a8700 1 Processor -- start 2023-11-15T01:36:04.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.614+0000 7f32852a8700 1 -- start start 2023-11-15T01:36:04.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.614+0000 7f32852a8700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3280154150 0x7f3280154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.614+0000 7f32852a8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32800ab1a0 0x7f3280158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.614+0000 7f32852a8700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32800c06f0 con 0x7f32800aa060 2023-11-15T01:36:04.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.614+0000 7f32852a8700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32800c09d0 con 0x7f3280154150 2023-11-15T01:36:04.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.614+0000 7f32852a8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3280158820 con 0x7f32800ab1a0 2023-11-15T01:36:04.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.615+0000 7f327e7fc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32800ab1a0 0x7f3280158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:04.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.615+0000 7f327effd700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3280154150 0x7f3280154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:04.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.615+0000 7f327e7fc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32800ab1a0 0x7f3280158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:49756/0 (socket says 172.21.15.1:49756) 2023-11-15T01:36:04.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.615+0000 7f327e7fc700 1 -- 172.21.15.1:0/2578587950 learned_addr learned my addr 172.21.15.1:0/2578587950 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:04.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.615+0000 7f327f7fe700 1 --1- 172.21.15.1:0/2578587950 >> v1:172.21.15.141:6789/0 conn(0x7f32800aa060 0x7f32800c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:40102/0 (socket says 172.21.15.1:40102) 2023-11-15T01:36:04.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.615+0000 7f327effd700 1 -- 172.21.15.1:0/2578587950 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32800ab1a0 msgr2=0x7f3280158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:04.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.615+0000 7f327effd700 1 --2- 172.21.15.1:0/2578587950 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32800ab1a0 0x7f3280158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.615+0000 7f327effd700 1 -- 172.21.15.1:0/2578587950 >> v1:172.21.15.141:6789/0 conn(0x7f32800aa060 legacy=0x7f32800c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:04.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.615+0000 7f327effd700 1 -- 172.21.15.1:0/2578587950 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3280158b00 con 0x7f3280154150 2023-11-15T01:36:04.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.615+0000 7f327dffb700 1 -- 172.21.15.1:0/2578587950 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494854531 0 0) 0x7f32800c06f0 con 0x7f32800aa060 2023-11-15T01:36:04.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.615+0000 7f327e7fc700 1 --2- 172.21.15.1:0/2578587950 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32800ab1a0 0x7f3280158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:04.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.615+0000 7f327effd700 1 --2- 172.21.15.1:0/2578587950 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3280154150 0x7f3280154530 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f3270009760 tx=0x7f3270009060).ready entity=mon.1 client_cookie=a4947b670e1416c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:04.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.615+0000 7f327dffb700 1 -- 172.21.15.1:0/2578587950 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32700090d0 con 0x7f3280154150 2023-11-15T01:36:04.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.615+0000 7f327dffb700 1 -- 172.21.15.1:0/2578587950 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327000f510 con 0x7f3280154150 2023-11-15T01:36:04.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.615+0000 7f327dffb700 1 -- 172.21.15.1:0/2578587950 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327000f890 con 0x7f3280154150 2023-11-15T01:36:04.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.616+0000 7f32852a8700 1 -- 172.21.15.1:0/2578587950 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3280154150 msgr2=0x7f3280154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:04.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.616+0000 7f32852a8700 1 --2- 172.21.15.1:0/2578587950 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3280154150 0x7f3280154530 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f3270009760 tx=0x7f3270009060).stop 2023-11-15T01:36:04.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.616+0000 7f32852a8700 1 -- 172.21.15.1:0/2578587950 shutdown_connections 2023-11-15T01:36:04.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.616+0000 7f32852a8700 1 --2- 172.21.15.1:0/2578587950 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3280154150 0x7f3280154530 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.616+0000 7f32852a8700 1 --2- 172.21.15.1:0/2578587950 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32800ab1a0 0x7f3280158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.616+0000 7f32852a8700 1 -- 172.21.15.1:0/2578587950 >> 172.21.15.1:0/2578587950 conn(0x7f3280064aa0 msgr2=0x7f3280064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:04.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.616+0000 7f32852a8700 1 -- 172.21.15.1:0/2578587950 shutdown_connections 2023-11-15T01:36:04.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.616+0000 7f32852a8700 1 -- 172.21.15.1:0/2578587950 wait complete. 2023-11-15T01:36:04.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.617+0000 7f32852a8700 1 Processor -- start 2023-11-15T01:36:04.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.617+0000 7f32852a8700 1 -- start start 2023-11-15T01:36:04.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f32852a8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32800aa060 0x7f32800c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f32852a8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32800ab1a0 0x7f328014b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f32852a8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3280154150 0x7f32800afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f32852a8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32800ca110 con 0x7f32800ab1a0 2023-11-15T01:36:04.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f32852a8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32800ca3f0 con 0x7f3280154150 2023-11-15T01:36:04.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f32852a8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32800ca6d0 con 0x7f32800aa060 2023-11-15T01:36:04.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f327e7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32800ab1a0 0x7f328014b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:04.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f327effd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32800aa060 0x7f32800c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:04.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f327e7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32800ab1a0 0x7f328014b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54044/0 (socket says 172.21.15.1:54044) 2023-11-15T01:36:04.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f327f7fe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3280154150 0x7f32800afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:04.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f327e7fc700 1 -- 172.21.15.1:0/1028092718 learned_addr learned my addr 172.21.15.1:0/1028092718 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:04.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f327e7fc700 1 -- 172.21.15.1:0/1028092718 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32800aa060 msgr2=0x7f32800c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:04.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f327e7fc700 1 --2- 172.21.15.1:0/1028092718 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32800aa060 0x7f32800c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f327e7fc700 1 -- 172.21.15.1:0/1028092718 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3280154150 msgr2=0x7f32800afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:04.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f327e7fc700 1 --2- 172.21.15.1:0/1028092718 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3280154150 0x7f32800afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f327e7fc700 1 -- 172.21.15.1:0/1028092718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3274009370 con 0x7f32800ab1a0 2023-11-15T01:36:04.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f327effd700 1 --2- 172.21.15.1:0/1028092718 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32800aa060 0x7f32800c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:04.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.618+0000 7f327f7fe700 1 --2- 172.21.15.1:0/1028092718 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3280154150 0x7f32800afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:04.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.619+0000 7f327e7fc700 1 --2- 172.21.15.1:0/1028092718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32800ab1a0 0x7f328014b6c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f327400ea20 tx=0x7f32740090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:04.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.619+0000 7f3266ffd700 1 -- 172.21.15.1:0/1028092718 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327400ee60 con 0x7f32800ab1a0 2023-11-15T01:36:04.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.619+0000 7f3266ffd700 1 -- 172.21.15.1:0/1028092718 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327400c850 con 0x7f32800ab1a0 2023-11-15T01:36:04.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.619+0000 7f32852a8700 1 -- 172.21.15.1:0/1028092718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32700092a0 con 0x7f32800ab1a0 2023-11-15T01:36:04.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.619+0000 7f3266ffd700 1 -- 172.21.15.1:0/1028092718 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327400cbd0 con 0x7f32800ab1a0 2023-11-15T01:36:04.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.619+0000 7f32852a8700 1 -- 172.21.15.1:0/1028092718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32800c28e0 con 0x7f32800ab1a0 2023-11-15T01:36:04.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.620+0000 7f32852a8700 1 -- 172.21.15.1:0/1028092718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32800c2b70 con 0x7f32800ab1a0 2023-11-15T01:36:04.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.620+0000 7f3266ffd700 1 -- 172.21.15.1:0/1028092718 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f327401b400 con 0x7f32800ab1a0 2023-11-15T01:36:04.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.621+0000 7f3266ffd700 1 --2- 172.21.15.1:0/1028092718 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f326c05f270 0x7f326c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.621+0000 7f3266ffd700 1 -- 172.21.15.1:0/1028092718 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6891+0+0 (secure 0 0 0) 0x7f327407abf0 con 0x7f32800ab1a0 2023-11-15T01:36:04.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.621+0000 7f327effd700 1 -- 172.21.15.1:0/1028092718 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f326c05f270 msgr2=0x7f326c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:04.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.621+0000 7f327effd700 1 --2- 172.21.15.1:0/1028092718 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f326c05f270 0x7f326c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:04.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.625+0000 7f3266ffd700 1 -- 172.21.15.1:0/1028092718 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f32800c2b70 con 0x7f32800ab1a0 2023-11-15T01:36:04.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.800+0000 7f32852a8700 1 -- 172.21.15.1:0/1028092718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32800c2b70 con 0x7f32800ab1a0 2023-11-15T01:36:04.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.801+0000 7f3266ffd700 1 -- 172.21.15.1:0/1028092718 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+18041 (secure 0 0 0) 0x7f32800c2b70 con 0x7f32800ab1a0 2023-11-15T01:36:04.802 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:04.802 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":64,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:35:14.889359+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:33:54.494299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-15T01:33:55.821335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"8.1a","mappings":[{"from":0,"to":1}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:6833/90546":"2023-11-16T01:34:13.098171+0000","172.21.15.141:6832/90546":"2023-11-16T01:34:13.098171+0000","172.21.15.141:0/319645857":"2023-11-16T01:34:13.098171+0000","172.21.15.141:0/380022886":"2023-11-16T01:34:13.098171+0000","172.21.15.141:0/3570210448":"2023-11-16T01:34:13.098171+0000","172.21.15.141:0/3619913227":"2023-11-16T01:34:13.098171+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:36:04.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.803+0000 7f32852a8700 1 -- 172.21.15.1:0/1028092718 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f326c05f270 msgr2=0x7f326c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:04.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.803+0000 7f32852a8700 1 --2- 172.21.15.1:0/1028092718 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f326c05f270 0x7f326c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:04.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.803+0000 7f32852a8700 1 -- 172.21.15.1:0/1028092718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32800ab1a0 msgr2=0x7f328014b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:04.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.803+0000 7f32852a8700 1 --2- 172.21.15.1:0/1028092718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32800ab1a0 0x7f328014b6c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f327400ea20 tx=0x7f32740090f0).stop 2023-11-15T01:36:04.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.803+0000 7f32852a8700 1 -- 172.21.15.1:0/1028092718 shutdown_connections 2023-11-15T01:36:04.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.803+0000 7f32852a8700 1 --2- 172.21.15.1:0/1028092718 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f326c05f270 0x7f326c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:04.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.803+0000 7f32852a8700 1 --2- 172.21.15.1:0/1028092718 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3280154150 0x7f32800afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.803+0000 7f32852a8700 1 --2- 172.21.15.1:0/1028092718 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32800aa060 0x7f32800c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.803+0000 7f32852a8700 1 --2- 172.21.15.1:0/1028092718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32800ab1a0 0x7f328014b6c0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.803+0000 7f32852a8700 1 -- 172.21.15.1:0/1028092718 >> 172.21.15.1:0/1028092718 conn(0x7f3280064aa0 msgr2=0x7f32800ac460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:04.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.803+0000 7f32852a8700 1 -- 172.21.15.1:0/1028092718 shutdown_connections 2023-11-15T01:36:04.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.803+0000 7f32852a8700 1 -- 172.21.15.1:0/1028092718 wait complete. 2023-11-15T01:36:04.816 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T01:33:54.494299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T01:33:55.821335+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T01:36:04.817 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:36:04.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.944+0000 7f35e0a3a700 1 Processor -- start 2023-11-15T01:36:04.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.944+0000 7f35e0a3a700 1 -- start start 2023-11-15T01:36:04.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35e0a3a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35dc1541d0 0x7f35dc1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35e0a3a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f35dc0c60d0 0x7f35dc0c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35e0a3a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f35dc0c7a60 0x7f35dc0c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35e0a3a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35dc158f40 con 0x7f35dc0c7a60 2023-11-15T01:36:04.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35e0a3a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35dc155830 con 0x7f35dc0c60d0 2023-11-15T01:36:04.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35e0a3a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0c83c0 con 0x7f35dc1541d0 2023-11-15T01:36:04.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35dbfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f35dc0c7a60 0x7f35dc0c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:04.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35dbfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f35dc0c7a60 0x7f35dc0c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54060/0 (socket says 172.21.15.1:54060) 2023-11-15T01:36:04.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35dbfff700 1 -- 172.21.15.1:0/3394238019 learned_addr learned my addr 172.21.15.1:0/3394238019 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:04.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35db7fe700 1 --2- 172.21.15.1:0/3394238019 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35dc1541d0 0x7f35dc1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:04.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35daffd700 1 --2- 172.21.15.1:0/3394238019 >> v2:172.21.15.141:3300/0 conn(0x7f35dc0c60d0 0x7f35dc0c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:04.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35dbfff700 1 -- 172.21.15.1:0/3394238019 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35dc1541d0 msgr2=0x7f35dc1545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:04.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35dbfff700 1 --2- 172.21.15.1:0/3394238019 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35dc1541d0 0x7f35dc1545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35dbfff700 1 -- 172.21.15.1:0/3394238019 >> v2:172.21.15.141:3300/0 conn(0x7f35dc0c60d0 msgr2=0x7f35dc0c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:04.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35dbfff700 1 --2- 172.21.15.1:0/3394238019 >> v2:172.21.15.141:3300/0 conn(0x7f35dc0c60d0 0x7f35dc0c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.945+0000 7f35dbfff700 1 -- 172.21.15.1:0/3394238019 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc154c20 con 0x7f35dc0c7a60 2023-11-15T01:36:04.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.946+0000 7f35dbfff700 1 --2- 172.21.15.1:0/3394238019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35dc0c7a60 0x7f35dc0c7ed0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f35dc0849a0 tx=0x7f35d4009840).ready entity=mon.0 client_cookie=4e68c65ac7cb3e55 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:04.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.946+0000 7f35da7fc700 1 -- 172.21.15.1:0/3394238019 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d400e070 con 0x7f35dc0c7a60 2023-11-15T01:36:04.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.946+0000 7f35da7fc700 1 -- 172.21.15.1:0/3394238019 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d400b970 con 0x7f35dc0c7a60 2023-11-15T01:36:04.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.946+0000 7f35da7fc700 1 -- 172.21.15.1:0/3394238019 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d400bcf0 con 0x7f35dc0c7a60 2023-11-15T01:36:04.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.946+0000 7f35e0a3a700 1 -- 172.21.15.1:0/3394238019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35dc0c7a60 msgr2=0x7f35dc0c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:04.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.946+0000 7f35e0a3a700 1 --2- 172.21.15.1:0/3394238019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35dc0c7a60 0x7f35dc0c7ed0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f35dc0849a0 tx=0x7f35d4009840).stop 2023-11-15T01:36:04.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.946+0000 7f35e0a3a700 1 -- 172.21.15.1:0/3394238019 shutdown_connections 2023-11-15T01:36:04.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.946+0000 7f35e0a3a700 1 --2- 172.21.15.1:0/3394238019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35dc0c7a60 0x7f35dc0c7ed0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.946+0000 7f35e0a3a700 1 --2- 172.21.15.1:0/3394238019 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35dc1541d0 0x7f35dc1545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.946+0000 7f35e0a3a700 1 --2- 172.21.15.1:0/3394238019 >> v2:172.21.15.141:3300/0 conn(0x7f35dc0c60d0 0x7f35dc0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.946+0000 7f35e0a3a700 1 -- 172.21.15.1:0/3394238019 >> 172.21.15.1:0/3394238019 conn(0x7f35dc069ee0 msgr2=0x7f35dc06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:04.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.946+0000 7f35e0a3a700 1 -- 172.21.15.1:0/3394238019 shutdown_connections 2023-11-15T01:36:04.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.946+0000 7f35e0a3a700 1 -- 172.21.15.1:0/3394238019 wait complete. 2023-11-15T01:36:04.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.948+0000 7f35e0a3a700 1 Processor -- start 2023-11-15T01:36:04.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.948+0000 7f35e0a3a700 1 -- start start 2023-11-15T01:36:04.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.948+0000 7f35e0a3a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35dc0c60d0 0x7f35dc0b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.948+0000 7f35e0a3a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35dc0c7a60 0x7f35dc0ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.948+0000 7f35e0a3a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35dc1541d0 0x7f35dc0ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.948+0000 7f35e0a3a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc151730 con 0x7f35dc0c60d0 2023-11-15T01:36:04.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.948+0000 7f35e0a3a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0aeb70 con 0x7f35dc1541d0 2023-11-15T01:36:04.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.948+0000 7f35e0a3a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0aee50 con 0x7f35dc0c7a60 2023-11-15T01:36:04.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.948+0000 7f35db7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35dc0c60d0 0x7f35dc0b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:04.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.949+0000 7f35db7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35dc0c60d0 0x7f35dc0b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54064/0 (socket says 172.21.15.1:54064) 2023-11-15T01:36:04.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.949+0000 7f35db7fe700 1 -- 172.21.15.1:0/2952042276 learned_addr learned my addr 172.21.15.1:0/2952042276 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:04.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.949+0000 7f35daffd700 1 --2- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35dc0c7a60 0x7f35dc0ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:04.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.949+0000 7f35dbfff700 1 --2- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35dc1541d0 0x7f35dc0ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:04.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.949+0000 7f35db7fe700 1 -- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35dc0c7a60 msgr2=0x7f35dc0ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:04.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.949+0000 7f35db7fe700 1 --2- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35dc0c7a60 0x7f35dc0ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.949+0000 7f35db7fe700 1 -- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35dc1541d0 msgr2=0x7f35dc0ae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:04.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.949+0000 7f35db7fe700 1 --2- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35dc1541d0 0x7f35dc0ae5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:04.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.949+0000 7f35db7fe700 1 -- 172.21.15.1:0/2952042276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d4009ae0 con 0x7f35dc0c60d0 2023-11-15T01:36:04.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.949+0000 7f35db7fe700 1 --2- 172.21.15.1:0/2952042276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35dc0c60d0 0x7f35dc0b0450 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f35cc00e900 tx=0x7f35cc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:04.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.949+0000 7f35c37fe700 1 -- 172.21.15.1:0/2952042276 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc012600 con 0x7f35dc0c60d0 2023-11-15T01:36:04.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.949+0000 7f35c37fe700 1 -- 172.21.15.1:0/2952042276 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc012760 con 0x7f35dc0c60d0 2023-11-15T01:36:04.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.949+0000 7f35c37fe700 1 -- 172.21.15.1:0/2952042276 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc012ae0 con 0x7f35dc0c60d0 2023-11-15T01:36:04.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.949+0000 7f35e0a3a700 1 -- 172.21.15.1:0/2952042276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35dc0af130 con 0x7f35dc0c60d0 2023-11-15T01:36:04.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.949+0000 7f35e0a3a700 1 -- 172.21.15.1:0/2952042276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35dc0af6f0 con 0x7f35dc0c60d0 2023-11-15T01:36:04.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.950+0000 7f35c37fe700 1 -- 172.21.15.1:0/2952042276 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f35cc01b400 con 0x7f35dc0c60d0 2023-11-15T01:36:04.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.951+0000 7f35e0a3a700 1 -- 172.21.15.1:0/2952042276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35dc0475e0 con 0x7f35dc0c60d0 2023-11-15T01:36:04.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.951+0000 7f35c37fe700 1 --2- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35c805f270 0x7f35c8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:04.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.951+0000 7f35daffd700 1 -- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35c805f270 msgr2=0x7f35c8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:04.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.951+0000 7f35c37fe700 1 -- 172.21.15.1:0/2952042276 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6891+0+0 (secure 0 0 0) 0x7f35cc07a9f0 con 0x7f35dc0c60d0 2023-11-15T01:36:04.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.951+0000 7f35daffd700 1 --2- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35c805f270 0x7f35c8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:04.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:04.955+0000 7f35c37fe700 1 -- 172.21.15.1:0/2952042276 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f35cc04b7e0 con 0x7f35dc0c60d0 2023-11-15T01:36:04.984 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:04.983+0000 7f02c10a9680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:36:05.057 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:05.056+0000 7f02c10a9680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:36:05.067 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:05.067+0000 7f6515ce8680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:36:05.139 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:05.138+0000 7f6515ce8680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:36:05.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.152+0000 7f35daffd700 1 -- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35c805f270 msgr2=0x7f35c8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:05.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.152+0000 7f35daffd700 1 --2- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35c805f270 0x7f35c8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:36:05.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.176+0000 7f35e0a3a700 1 -- 172.21.15.1:0/2952042276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f35dc154f00 con 0x7f35dc0c60d0 2023-11-15T01:36:05.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.176+0000 7f35c37fe700 1 -- 172.21.15.1:0/2952042276 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v64) v1 ==== 110+0+10 (secure 0 0 0) 0x7f35cc016020 con 0x7f35dc0c60d0 2023-11-15T01:36:05.177 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:36:05.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.179+0000 7f35e0a3a700 1 -- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35c805f270 msgr2=0x7f35c8061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:05.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.179+0000 7f35e0a3a700 1 --2- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35c805f270 0x7f35c8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:05.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.179+0000 7f35e0a3a700 1 -- 172.21.15.1:0/2952042276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35dc0c60d0 msgr2=0x7f35dc0b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.179+0000 7f35e0a3a700 1 --2- 172.21.15.1:0/2952042276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35dc0c60d0 0x7f35dc0b0450 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f35cc00e900 tx=0x7f35cc009060).stop 2023-11-15T01:36:05.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.179+0000 7f35e0a3a700 1 -- 172.21.15.1:0/2952042276 shutdown_connections 2023-11-15T01:36:05.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.179+0000 7f35e0a3a700 1 --2- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35c805f270 0x7f35c8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:05.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.179+0000 7f35e0a3a700 1 --2- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35dc1541d0 0x7f35dc0ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.179+0000 7f35e0a3a700 1 --2- 172.21.15.1:0/2952042276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35dc0c60d0 0x7f35dc0b0450 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.179+0000 7f35e0a3a700 1 --2- 172.21.15.1:0/2952042276 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35dc0c7a60 0x7f35dc0ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.180+0000 7f35e0a3a700 1 -- 172.21.15.1:0/2952042276 >> 172.21.15.1:0/2952042276 conn(0x7f35dc069ee0 msgr2=0x7f35dc1530d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:05.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.180+0000 7f35e0a3a700 1 -- 172.21.15.1:0/2952042276 shutdown_connections 2023-11-15T01:36:05.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.180+0000 7f35e0a3a700 1 -- 172.21.15.1:0/2952042276 wait complete. 2023-11-15T01:36:05.193 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:36:05.243 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:05.242+0000 7f02c10a9680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:36:05.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.317+0000 7f7578ea2700 1 Processor -- start 2023-11-15T01:36:05.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.317+0000 7f7578ea2700 1 -- start start 2023-11-15T01:36:05.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.318+0000 7f7578ea2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f75740bc410 0x7f75740c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.318+0000 7f7578ea2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75740bd330 0x7f75740637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.318+0000 7f7578ea2700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757406bb50 con 0x7f75740c50b0 2023-11-15T01:36:05.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.318+0000 7f7578ea2700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75740627b0 con 0x7f75740bc410 2023-11-15T01:36:05.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.318+0000 7f7578ea2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75740bd7c0 con 0x7f75740bd330 2023-11-15T01:36:05.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.318+0000 7f7572ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f75740bc410 0x7f75740c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:05.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.318+0000 7f75737fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f75740c50b0 0x7f75740c1990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34668/0 (socket says 172.21.15.1:34668) 2023-11-15T01:36:05.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.318+0000 7f75737fe700 1 -- 172.21.15.1:0/3164124642 learned_addr learned my addr 172.21.15.1:0/3164124642 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:05.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.318+0000 7f7573fff700 1 --2- 172.21.15.1:0/3164124642 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75740bd330 0x7f75740637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:05.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.318+0000 7f7572ffd700 1 -- 172.21.15.1:0/3164124642 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75740bd330 msgr2=0x7f75740637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:05.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.318+0000 7f7572ffd700 1 --2- 172.21.15.1:0/3164124642 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75740bd330 0x7f75740637c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.318+0000 7f7572ffd700 1 -- 172.21.15.1:0/3164124642 >> v1:172.21.15.1:6789/0 conn(0x7f75740c50b0 legacy=0x7f75740c1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.318+0000 7f7572ffd700 1 -- 172.21.15.1:0/3164124642 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7574062a00 con 0x7f75740bc410 2023-11-15T01:36:05.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.318+0000 7f75727fc700 1 -- 172.21.15.1:0/3164124642 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213733470 0 0) 0x7f757406bb50 con 0x7f75740c50b0 2023-11-15T01:36:05.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.318+0000 7f7573fff700 1 --2- 172.21.15.1:0/3164124642 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75740bd330 0x7f75740637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:05.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.319+0000 7f7572ffd700 1 --2- 172.21.15.1:0/3164124642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75740bc410 0x7f75740c5490 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f7564009760 tx=0x7f7564009060).ready entity=mon.0 client_cookie=79b51b075b306bc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:05.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.319+0000 7f75727fc700 1 -- 172.21.15.1:0/3164124642 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756400b580 con 0x7f75740bc410 2023-11-15T01:36:05.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.319+0000 7f75727fc700 1 -- 172.21.15.1:0/3164124642 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756400b6e0 con 0x7f75740bc410 2023-11-15T01:36:05.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.319+0000 7f75727fc700 1 -- 172.21.15.1:0/3164124642 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756400ba60 con 0x7f75740bc410 2023-11-15T01:36:05.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.319+0000 7f7578ea2700 1 -- 172.21.15.1:0/3164124642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75740bc410 msgr2=0x7f75740c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.319+0000 7f7578ea2700 1 --2- 172.21.15.1:0/3164124642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75740bc410 0x7f75740c5490 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f7564009760 tx=0x7f7564009060).stop 2023-11-15T01:36:05.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.319+0000 7f7578ea2700 1 -- 172.21.15.1:0/3164124642 shutdown_connections 2023-11-15T01:36:05.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.319+0000 7f7578ea2700 1 --2- 172.21.15.1:0/3164124642 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75740bd330 0x7f75740637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.319+0000 7f7578ea2700 1 --2- 172.21.15.1:0/3164124642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75740bc410 0x7f75740c5490 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.319+0000 7f7578ea2700 1 -- 172.21.15.1:0/3164124642 >> 172.21.15.1:0/3164124642 conn(0x7f75740c3e30 msgr2=0x7f75740c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:05.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.319+0000 7f7578ea2700 1 -- 172.21.15.1:0/3164124642 shutdown_connections 2023-11-15T01:36:05.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.319+0000 7f7578ea2700 1 -- 172.21.15.1:0/3164124642 wait complete. 2023-11-15T01:36:05.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.321+0000 7f7578ea2700 1 Processor -- start 2023-11-15T01:36:05.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.321+0000 7f7578ea2700 1 -- start start 2023-11-15T01:36:05.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.321+0000 7f7578ea2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75740bc410 0x7f75740c13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.321+0000 7f7578ea2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75740bd330 0x7f7574167d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.321+0000 7f7578ea2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75740c50b0 0x7f75740a7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.321+0000 7f7578ea2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75740a9970 con 0x7f75740bc410 2023-11-15T01:36:05.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.321+0000 7f7578ea2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7574168240 con 0x7f75740c50b0 2023-11-15T01:36:05.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.321+0000 7f7578ea2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75740a93b0 con 0x7f75740bd330 2023-11-15T01:36:05.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f75737fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75740bc410 0x7f75740c13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:05.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f75737fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75740bc410 0x7f75740c13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54076/0 (socket says 172.21.15.1:54076) 2023-11-15T01:36:05.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f75737fe700 1 -- 172.21.15.1:0/11123235 learned_addr learned my addr 172.21.15.1:0/11123235 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:05.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f7572ffd700 1 --2- 172.21.15.1:0/11123235 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75740bd330 0x7f7574167d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:05.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f7573fff700 1 --2- 172.21.15.1:0/11123235 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75740c50b0 0x7f75740a7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:05.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f75737fe700 1 -- 172.21.15.1:0/11123235 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75740bd330 msgr2=0x7f7574167d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f75737fe700 1 --2- 172.21.15.1:0/11123235 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75740bd330 0x7f7574167d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f75737fe700 1 -- 172.21.15.1:0/11123235 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75740c50b0 msgr2=0x7f75740a7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f75737fe700 1 --2- 172.21.15.1:0/11123235 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75740c50b0 0x7f75740a7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f75737fe700 1 -- 172.21.15.1:0/11123235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75640092a0 con 0x7f75740bc410 2023-11-15T01:36:05.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f75737fe700 1 --2- 172.21.15.1:0/11123235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75740bc410 0x7f75740c13c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f755c00c4e0 tx=0x7f755c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:05.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f756b7fe700 1 -- 172.21.15.1:0/11123235 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c00ce90 con 0x7f75740bc410 2023-11-15T01:36:05.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f756b7fe700 1 -- 172.21.15.1:0/11123235 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c0072e0 con 0x7f75740bc410 2023-11-15T01:36:05.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f7578ea2700 1 -- 172.21.15.1:0/11123235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75740a9690 con 0x7f75740bc410 2023-11-15T01:36:05.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f756b7fe700 1 -- 172.21.15.1:0/11123235 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c007660 con 0x7f75740bc410 2023-11-15T01:36:05.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.322+0000 7f7578ea2700 1 -- 172.21.15.1:0/11123235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75740a7150 con 0x7f75740bc410 2023-11-15T01:36:05.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.323+0000 7f756b7fe700 1 -- 172.21.15.1:0/11123235 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f755c0059b0 con 0x7f75740bc410 2023-11-15T01:36:05.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.324+0000 7f7578ea2700 1 -- 172.21.15.1:0/11123235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75740475e0 con 0x7f75740bc410 2023-11-15T01:36:05.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.324+0000 7f756b7fe700 1 --2- 172.21.15.1:0/11123235 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f755405f270 0x7f7554061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.324+0000 7f756b7fe700 1 -- 172.21.15.1:0/11123235 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6891+0+0 (secure 0 0 0) 0x7f755c079da0 con 0x7f75740bc410 2023-11-15T01:36:05.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.324+0000 7f7572ffd700 1 -- 172.21.15.1:0/11123235 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f755405f270 msgr2=0x7f7554061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:05.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.324+0000 7f7572ffd700 1 --2- 172.21.15.1:0/11123235 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f755405f270 0x7f7554061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:05.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.328+0000 7f756b7fe700 1 -- 172.21.15.1:0/11123235 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f755c04abf0 con 0x7f75740bc410 2023-11-15T01:36:05.339 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:05.339+0000 7f6515ce8680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:36:05.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.503+0000 7f7578ea2700 1 -- 172.21.15.1:0/11123235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7574062ce0 con 0x7f75740bc410 2023-11-15T01:36:05.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.503+0000 7f756b7fe700 1 -- 172.21.15.1:0/11123235 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7f755c04e210 con 0x7f75740bc410 2023-11-15T01:36:05.504 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:36:05.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.505+0000 7f7578ea2700 1 -- 172.21.15.1:0/11123235 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f755405f270 msgr2=0x7f7554061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:05.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.505+0000 7f7578ea2700 1 --2- 172.21.15.1:0/11123235 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f755405f270 0x7f7554061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:05.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.505+0000 7f7578ea2700 1 -- 172.21.15.1:0/11123235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75740bc410 msgr2=0x7f75740c13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.505+0000 7f7578ea2700 1 --2- 172.21.15.1:0/11123235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75740bc410 0x7f75740c13c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f755c00c4e0 tx=0x7f755c007c70).stop 2023-11-15T01:36:05.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.505+0000 7f7578ea2700 1 -- 172.21.15.1:0/11123235 shutdown_connections 2023-11-15T01:36:05.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.505+0000 7f7578ea2700 1 --2- 172.21.15.1:0/11123235 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f755405f270 0x7f7554061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:05.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.505+0000 7f7578ea2700 1 --2- 172.21.15.1:0/11123235 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75740c50b0 0x7f75740a7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.505+0000 7f7578ea2700 1 --2- 172.21.15.1:0/11123235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75740bc410 0x7f75740c13c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.505+0000 7f7578ea2700 1 --2- 172.21.15.1:0/11123235 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75740bd330 0x7f7574167d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.505+0000 7f7578ea2700 1 -- 172.21.15.1:0/11123235 >> 172.21.15.1:0/11123235 conn(0x7f75740c3e30 msgr2=0x7f7574065c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:05.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.505+0000 7f7578ea2700 1 -- 172.21.15.1:0/11123235 shutdown_connections 2023-11-15T01:36:05.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.505+0000 7f7578ea2700 1 -- 172.21.15.1:0/11123235 wait complete. 2023-11-15T01:36:05.517 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T01:36:05.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.642+0000 7f74b4a9d700 1 Processor -- start 2023-11-15T01:36:05.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.642+0000 7f74b4a9d700 1 -- start start 2023-11-15T01:36:05.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.643+0000 7f74b4a9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f74b00c8170 0x7f74b015f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.643+0000 7f74b4a9d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b0155830 con 0x7f74b01541d0 2023-11-15T01:36:05.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.643+0000 7f74b4a9d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b0154c20 con 0x7f74b01545b0 2023-11-15T01:36:05.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.643+0000 7f74b4a9d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b0158f40 con 0x7f74b00c8170 2023-11-15T01:36:05.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.643+0000 7f74affff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f74b00c8170 0x7f74b015f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:05.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.643+0000 7f74af7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f74b01541d0 0x7f74b00c60d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34672/0 (socket says 172.21.15.1:34672) 2023-11-15T01:36:05.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.643+0000 7f74af7fe700 1 -- 172.21.15.1:0/2461959257 learned_addr learned my addr 172.21.15.1:0/2461959257 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:05.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.643+0000 7f74affff700 1 -- 172.21.15.1:0/2461959257 >> v1:172.21.15.141:6789/0 conn(0x7f74b01545b0 legacy=0x7f74b00c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:05.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.643+0000 7f74affff700 1 -- 172.21.15.1:0/2461959257 >> v1:172.21.15.1:6789/0 conn(0x7f74b01541d0 legacy=0x7f74b00c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.643+0000 7f74affff700 1 -- 172.21.15.1:0/2461959257 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b0154f00 con 0x7f74b00c8170 2023-11-15T01:36:05.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.643+0000 7f74aeffd700 1 -- 172.21.15.1:0/2461959257 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488607953 0 0) 0x7f74b0155830 con 0x7f74b01541d0 2023-11-15T01:36:05.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.644+0000 7f74affff700 1 --2- 172.21.15.1:0/2461959257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74b00c8170 0x7f74b015f2d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f74a8009e60 tx=0x7f74a8009780).ready entity=mon.0 client_cookie=aa7ac51e9a5e5260 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:05.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.644+0000 7f74aeffd700 1 -- 172.21.15.1:0/2461959257 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a800e070 con 0x7f74b00c8170 2023-11-15T01:36:05.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.644+0000 7f74aeffd700 1 -- 172.21.15.1:0/2461959257 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a800bbf0 con 0x7f74b00c8170 2023-11-15T01:36:05.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.644+0000 7f74aeffd700 1 -- 172.21.15.1:0/2461959257 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8012410 con 0x7f74b00c8170 2023-11-15T01:36:05.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.644+0000 7f74b4a9d700 1 -- 172.21.15.1:0/2461959257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74b00c8170 msgr2=0x7f74b015f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.644+0000 7f74b4a9d700 1 --2- 172.21.15.1:0/2461959257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74b00c8170 0x7f74b015f2d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f74a8009e60 tx=0x7f74a8009780).stop 2023-11-15T01:36:05.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.644+0000 7f74b4a9d700 1 -- 172.21.15.1:0/2461959257 shutdown_connections 2023-11-15T01:36:05.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.644+0000 7f74b4a9d700 1 --2- 172.21.15.1:0/2461959257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74b00c8170 0x7f74b015f2d0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.645+0000 7f74b4a9d700 1 -- 172.21.15.1:0/2461959257 >> 172.21.15.1:0/2461959257 conn(0x7f74b0069ee0 msgr2=0x7f74b006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:05.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.645+0000 7f74b4a9d700 1 -- 172.21.15.1:0/2461959257 shutdown_connections 2023-11-15T01:36:05.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.645+0000 7f74b4a9d700 1 -- 172.21.15.1:0/2461959257 wait complete. 2023-11-15T01:36:05.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.646+0000 7f74b4a9d700 1 Processor -- start 2023-11-15T01:36:05.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.646+0000 7f74b4a9d700 1 -- start start 2023-11-15T01:36:05.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74b4a9d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74b00c8170 0x7f74b013ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74b4a9d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74b01541d0 0x7f74b00ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74b4a9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74b01545b0 0x7f74b00c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74b4a9d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b013f150 con 0x7f74b01545b0 2023-11-15T01:36:05.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74b4a9d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00af510 con 0x7f74b00c8170 2023-11-15T01:36:05.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74b4a9d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00ae900 con 0x7f74b01541d0 2023-11-15T01:36:05.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74affff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74b01545b0 0x7f74b00c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:05.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74affff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74b01545b0 0x7f74b00c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54096/0 (socket says 172.21.15.1:54096) 2023-11-15T01:36:05.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74affff700 1 -- 172.21.15.1:0/1386274498 learned_addr learned my addr 172.21.15.1:0/1386274498 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:05.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74a6ffd700 1 --2- 172.21.15.1:0/1386274498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74b01541d0 0x7f74b00ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:05.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74affff700 1 -- 172.21.15.1:0/1386274498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74b01541d0 msgr2=0x7f74b00ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74affff700 1 --2- 172.21.15.1:0/1386274498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74b01541d0 0x7f74b00ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74affff700 1 -- 172.21.15.1:0/1386274498 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74b00c8170 msgr2=0x7f74b013ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74affff700 1 --2- 172.21.15.1:0/1386274498 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74b00c8170 0x7f74b013ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:05.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74affff700 1 -- 172.21.15.1:0/1386274498 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8009a20 con 0x7f74b01545b0 2023-11-15T01:36:05.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74affff700 1 --2- 172.21.15.1:0/1386274498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74b01545b0 0x7f74b00c12a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f74a800b6c0 tx=0x7f74a8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:05.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74a7fff700 1 -- 172.21.15.1:0/1386274498 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8011750 con 0x7f74b01545b0 2023-11-15T01:36:05.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74a7fff700 1 -- 172.21.15.1:0/1386274498 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a80118b0 con 0x7f74b01545b0 2023-11-15T01:36:05.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74a7fff700 1 -- 172.21.15.1:0/1386274498 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8011c50 con 0x7f74b01545b0 2023-11-15T01:36:05.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.647+0000 7f74b4a9d700 1 -- 172.21.15.1:0/1386274498 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b00aebe0 con 0x7f74b01545b0 2023-11-15T01:36:05.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.648+0000 7f74b4a9d700 1 -- 172.21.15.1:0/1386274498 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b00af1a0 con 0x7f74b01545b0 2023-11-15T01:36:05.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.648+0000 7f74b4a9d700 1 -- 172.21.15.1:0/1386274498 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b00475e0 con 0x7f74b01545b0 2023-11-15T01:36:05.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.649+0000 7f74a7fff700 1 -- 172.21.15.1:0/1386274498 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f74a801d630 con 0x7f74b01545b0 2023-11-15T01:36:05.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.649+0000 7f74a7fff700 1 --2- 172.21.15.1:0/1386274498 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f749005f270 0x7f7490061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.649+0000 7f74a7fff700 1 -- 172.21.15.1:0/1386274498 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6891+0+0 (secure 0 0 0) 0x7f74a807c850 con 0x7f74b01545b0 2023-11-15T01:36:05.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.649+0000 7f74af7fe700 1 -- 172.21.15.1:0/1386274498 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f749005f270 msgr2=0x7f7490061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:05.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.649+0000 7f74af7fe700 1 --2- 172.21.15.1:0/1386274498 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f749005f270 0x7f7490061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:05.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.657+0000 7f74a7fff700 1 -- 172.21.15.1:0/1386274498 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f74a804d6a0 con 0x7f74b01545b0 2023-11-15T01:36:05.663 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:05.663+0000 7f02c10a9680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:36:05.767 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:05.766+0000 7f02c10a9680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:36:05.788 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:05.788+0000 7f6515ce8680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:36:05.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.831+0000 7f74b4a9d700 1 -- 172.21.15.1:0/1386274498 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74b00c9290 con 0x7f74b01545b0 2023-11-15T01:36:05.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.831+0000 7f74a7fff700 1 -- 172.21.15.1:0/1386274498 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74a8011db0 con 0x7f74b01545b0 2023-11-15T01:36:05.832 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:36:05.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.833+0000 7f74b4a9d700 1 -- 172.21.15.1:0/1386274498 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f749005f270 msgr2=0x7f7490061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:05.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.833+0000 7f74b4a9d700 1 --2- 172.21.15.1:0/1386274498 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f749005f270 0x7f7490061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:05.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.833+0000 7f74b4a9d700 1 -- 172.21.15.1:0/1386274498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74b01545b0 msgr2=0x7f74b00c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.833+0000 7f74b4a9d700 1 --2- 172.21.15.1:0/1386274498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74b01545b0 0x7f74b00c12a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f74a800b6c0 tx=0x7f74a8009780).stop 2023-11-15T01:36:05.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.833+0000 7f74b4a9d700 1 -- 172.21.15.1:0/1386274498 shutdown_connections 2023-11-15T01:36:05.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.833+0000 7f74b4a9d700 1 --2- 172.21.15.1:0/1386274498 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f749005f270 0x7f7490061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:05.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.833+0000 7f74b4a9d700 1 --2- 172.21.15.1:0/1386274498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74b01545b0 0x7f74b00c12a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.833+0000 7f74b4a9d700 1 --2- 172.21.15.1:0/1386274498 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74b00c8170 0x7f74b013ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:05.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.833+0000 7f74b4a9d700 1 --2- 172.21.15.1:0/1386274498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74b01541d0 0x7f74b00ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.833+0000 7f74b4a9d700 1 -- 172.21.15.1:0/1386274498 >> 172.21.15.1:0/1386274498 conn(0x7f74b0069ee0 msgr2=0x7f74b014eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:05.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.833+0000 7f74b4a9d700 1 -- 172.21.15.1:0/1386274498 shutdown_connections 2023-11-15T01:36:05.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.833+0000 7f74b4a9d700 1 -- 172.21.15.1:0/1386274498 wait complete. 2023-11-15T01:36:05.846 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T01:36:05.902 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:05.902+0000 7f6515ce8680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:36:05.919 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:05.918+0000 7f02c10a9680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:36:05.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.970+0000 7fbb50095700 1 Processor -- start 2023-11-15T01:36:05.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.970+0000 7fbb50095700 1 -- start start 2023-11-15T01:36:05.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.971+0000 7fbb50095700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbb481540a0 0x7fbb480ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.971+0000 7fbb50095700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb480ca050 con 0x7fbb480c6650 2023-11-15T01:36:05.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.971+0000 7fbb50095700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb480c9440 con 0x7fbb48154480 2023-11-15T01:36:05.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.971+0000 7fbb50095700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb480c9720 con 0x7fbb481540a0 2023-11-15T01:36:05.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.971+0000 7fbb4e632700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fbb480c6650 0x7fbb480aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34688/0 (socket says 172.21.15.1:34688) 2023-11-15T01:36:05.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.971+0000 7fbb4e632700 1 -- 172.21.15.1:0/1539203004 learned_addr learned my addr 172.21.15.1:0/1539203004 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:05.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.971+0000 7fbb4de31700 1 --2- 172.21.15.1:0/1539203004 >> v2:172.21.15.141:3300/0 conn(0x7fbb481540a0 0x7fbb480ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:05.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.971+0000 7fbb4ce2f700 1 -- 172.21.15.1:0/1539203004 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157877557 0 0) 0x7fbb480ca050 con 0x7fbb480c6650 2023-11-15T01:36:05.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.971+0000 7fbb4ce2f700 1 -- 172.21.15.1:0/1539203004 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb340033f0 con 0x7fbb480c6650 2023-11-15T01:36:05.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.971+0000 7fbb4ce2f700 1 -- 172.21.15.1:0/1539203004 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278812433 0 0) 0x7fbb480c9440 con 0x7fbb48154480 2023-11-15T01:36:05.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.971+0000 7fbb4ce2f700 1 -- 172.21.15.1:0/1539203004 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb480ca050 con 0x7fbb48154480 2023-11-15T01:36:05.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.971+0000 7fbb4de31700 1 -- 172.21.15.1:0/1539203004 >> v1:172.21.15.141:6789/0 conn(0x7fbb48154480 legacy=0x7fbb480c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.971+0000 7fbb4ce2f700 1 -- 172.21.15.1:0/1539203004 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3623814066 0 0) 0x7fbb340033f0 con 0x7fbb480c6650 2023-11-15T01:36:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.971+0000 7fbb4de31700 1 -- 172.21.15.1:0/1539203004 >> v1:172.21.15.1:6789/0 conn(0x7fbb480c6650 legacy=0x7fbb480aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.971+0000 7fbb4de31700 1 -- 172.21.15.1:0/1539203004 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb480c9a00 con 0x7fbb481540a0 2023-11-15T01:36:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.972+0000 7fbb4de31700 1 --2- 172.21.15.1:0/1539203004 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb481540a0 0x7fbb480ca4e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fbb44009760 tx=0x7fbb44009060).ready entity=mon.1 client_cookie=758f0b0fae042375 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.972+0000 7fbb4ce2f700 1 -- 172.21.15.1:0/1539203004 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb400017f0 con 0x7fbb481540a0 2023-11-15T01:36:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.972+0000 7fbb4ce2f700 1 -- 172.21.15.1:0/1539203004 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb44011400 con 0x7fbb481540a0 2023-11-15T01:36:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.972+0000 7fbb4ce2f700 1 -- 172.21.15.1:0/1539203004 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44011780 con 0x7fbb481540a0 2023-11-15T01:36:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.972+0000 7fbb50095700 1 -- 172.21.15.1:0/1539203004 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb481540a0 msgr2=0x7fbb480ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.972+0000 7fbb50095700 1 --2- 172.21.15.1:0/1539203004 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb481540a0 0x7fbb480ca4e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fbb44009760 tx=0x7fbb44009060).stop 2023-11-15T01:36:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.972+0000 7fbb50095700 1 -- 172.21.15.1:0/1539203004 shutdown_connections 2023-11-15T01:36:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.972+0000 7fbb50095700 1 --2- 172.21.15.1:0/1539203004 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb481540a0 0x7fbb480ca4e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.972+0000 7fbb50095700 1 -- 172.21.15.1:0/1539203004 >> 172.21.15.1:0/1539203004 conn(0x7fbb48064a70 msgr2=0x7fbb48064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.973+0000 7fbb50095700 1 -- 172.21.15.1:0/1539203004 shutdown_connections 2023-11-15T01:36:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.973+0000 7fbb50095700 1 -- 172.21.15.1:0/1539203004 wait complete. 2023-11-15T01:36:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.974+0000 7fbb50095700 1 Processor -- start 2023-11-15T01:36:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.974+0000 7fbb50095700 1 -- start start 2023-11-15T01:36:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.974+0000 7fbb50095700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb480c6650 0x7fbb48167310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb50095700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb481540a0 0x7fbb480b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb50095700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb48154480 0x7fbb480b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb50095700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb480b10b0 con 0x7fbb48154480 2023-11-15T01:36:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb50095700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb48142820 con 0x7fbb480c6650 2023-11-15T01:36:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb50095700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb481511d0 con 0x7fbb481540a0 2023-11-15T01:36:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb4e632700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb48154480 0x7fbb480b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb4e632700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb48154480 0x7fbb480b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54102/0 (socket says 172.21.15.1:54102) 2023-11-15T01:36:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb4e632700 1 -- 172.21.15.1:0/3064251266 learned_addr learned my addr 172.21.15.1:0/3064251266 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb4de31700 1 --2- 172.21.15.1:0/3064251266 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb480c6650 0x7fbb48167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb4d630700 1 --2- 172.21.15.1:0/3064251266 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb481540a0 0x7fbb480b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb4e632700 1 -- 172.21.15.1:0/3064251266 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb481540a0 msgr2=0x7fbb480b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb4e632700 1 --2- 172.21.15.1:0/3064251266 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb481540a0 0x7fbb480b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb4e632700 1 -- 172.21.15.1:0/3064251266 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb480c6650 msgr2=0x7fbb48167310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb4e632700 1 --2- 172.21.15.1:0/3064251266 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb480c6650 0x7fbb48167310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb4e632700 1 -- 172.21.15.1:0/3064251266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb440092a0 con 0x7fbb48154480 2023-11-15T01:36:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb4e632700 1 --2- 172.21.15.1:0/3064251266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb48154480 0x7fbb480b0bc0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fbb4000cb90 tx=0x7fbb40001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb3dffb700 1 -- 172.21.15.1:0/3064251266 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40004c40 con 0x7fbb48154480 2023-11-15T01:36:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb50095700 1 -- 172.21.15.1:0/3064251266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb481514b0 con 0x7fbb48154480 2023-11-15T01:36:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb3dffb700 1 -- 172.21.15.1:0/3064251266 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb40004da0 con 0x7fbb48154480 2023-11-15T01:36:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.975+0000 7fbb3dffb700 1 -- 172.21.15.1:0/3064251266 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb400073a0 con 0x7fbb48154480 2023-11-15T01:36:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.976+0000 7fbb50095700 1 -- 172.21.15.1:0/3064251266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb48151a70 con 0x7fbb48154480 2023-11-15T01:36:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.977+0000 7fbb50095700 1 -- 172.21.15.1:0/3064251266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb48165930 con 0x7fbb48154480 2023-11-15T01:36:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.977+0000 7fbb3dffb700 1 -- 172.21.15.1:0/3064251266 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fbb40007710 con 0x7fbb48154480 2023-11-15T01:36:05.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.977+0000 7fbb3dffb700 1 --2- 172.21.15.1:0/3064251266 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb2c05f240 0x7fbb2c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:05.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.977+0000 7fbb4de31700 1 -- 172.21.15.1:0/3064251266 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb2c05f240 msgr2=0x7fbb2c061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:05.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.977+0000 7fbb3dffb700 1 -- 172.21.15.1:0/3064251266 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6891+0+0 (secure 0 0 0) 0x7fbb4007a430 con 0x7fbb48154480 2023-11-15T01:36:05.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.977+0000 7fbb4de31700 1 --2- 172.21.15.1:0/3064251266 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb2c05f240 0x7fbb2c061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:05.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:05.982+0000 7fbb3dffb700 1 -- 172.21.15.1:0/3064251266 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbb48165930 con 0x7fbb48154480 2023-11-15T01:36:05.993 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:05.993+0000 7f02c10a9680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:36:06.060 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:06.059+0000 7f02c10a9680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:36:06.063 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:06.063+0000 7f6515ce8680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:36:06.143 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:06.143+0000 7f6515ce8680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:36:06.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.159+0000 7fbb50095700 1 -- 172.21.15.1:0/3064251266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb48165930 con 0x7fbb48154480 2023-11-15T01:36:06.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.160+0000 7fbb3dffb700 1 -- 172.21.15.1:0/3064251266 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb48165930 con 0x7fbb48154480 2023-11-15T01:36:06.160 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:36:06.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.162+0000 7fbb50095700 1 -- 172.21.15.1:0/3064251266 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb2c05f240 msgr2=0x7fbb2c061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:06.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.162+0000 7fbb50095700 1 --2- 172.21.15.1:0/3064251266 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb2c05f240 0x7fbb2c061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:06.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.162+0000 7fbb50095700 1 -- 172.21.15.1:0/3064251266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb48154480 msgr2=0x7fbb480b0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:06.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.162+0000 7fbb50095700 1 --2- 172.21.15.1:0/3064251266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb48154480 0x7fbb480b0bc0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fbb4000cb90 tx=0x7fbb40001e50).stop 2023-11-15T01:36:06.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.162+0000 7fbb50095700 1 -- 172.21.15.1:0/3064251266 shutdown_connections 2023-11-15T01:36:06.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.162+0000 7fbb50095700 1 --2- 172.21.15.1:0/3064251266 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb2c05f240 0x7fbb2c061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:06.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.162+0000 7fbb50095700 1 --2- 172.21.15.1:0/3064251266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb48154480 0x7fbb480b0bc0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.162+0000 7fbb50095700 1 --2- 172.21.15.1:0/3064251266 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb480c6650 0x7fbb48167310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.162+0000 7fbb50095700 1 --2- 172.21.15.1:0/3064251266 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb481540a0 0x7fbb480b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.162+0000 7fbb50095700 1 -- 172.21.15.1:0/3064251266 >> 172.21.15.1:0/3064251266 conn(0x7fbb48064a70 msgr2=0x7fbb480ab8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:06.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.162+0000 7fbb50095700 1 -- 172.21.15.1:0/3064251266 shutdown_connections 2023-11-15T01:36:06.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.162+0000 7fbb50095700 1 -- 172.21.15.1:0/3064251266 wait complete. 2023-11-15T01:36:06.175 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:36:06.217 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:06.217+0000 7f6515ce8680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:36:06.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.295+0000 7fefb7e85700 1 Processor -- start 2023-11-15T01:36:06.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.296+0000 7fefb7e85700 1 -- start start 2023-11-15T01:36:06.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.296+0000 7fefb7e85700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fefb0158000 0x7fefb0154560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:06.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.296+0000 7fefb7e85700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefb00aa640 0x7fefb00c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:06.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.296+0000 7fefb7e85700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb0064e80 con 0x7fefb0154180 2023-11-15T01:36:06.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.296+0000 7fefb7e85700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb01585e0 con 0x7fefb0158000 2023-11-15T01:36:06.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.296+0000 7fefb7e85700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb01588c0 con 0x7fefb00aa640 2023-11-15T01:36:06.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.297+0000 7fefb5420700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fefb0158000 0x7fefb0154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:06.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.297+0000 7fefb5420700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fefb0158000 0x7fefb0154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54114/0 (socket says 172.21.15.1:54114) 2023-11-15T01:36:06.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.297+0000 7fefb5420700 1 -- 172.21.15.1:0/3277720017 learned_addr learned my addr 172.21.15.1:0/3277720017 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:06.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.297+0000 7fefb6422700 1 --2- 172.21.15.1:0/3277720017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefb00aa640 0x7fefb00c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:06.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.297+0000 7fefb5420700 1 -- 172.21.15.1:0/3277720017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefb00aa640 msgr2=0x7fefb00c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:06.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.297+0000 7fefb5420700 1 --2- 172.21.15.1:0/3277720017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefb00aa640 0x7fefb00c1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.297+0000 7fefb5420700 1 -- 172.21.15.1:0/3277720017 >> v1:172.21.15.141:6789/0 conn(0x7fefb0154180 legacy=0x7fefb0063bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:06.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.297+0000 7fefb5420700 1 -- 172.21.15.1:0/3277720017 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb0158ba0 con 0x7fefb0158000 2023-11-15T01:36:06.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.297+0000 7fefb6422700 1 --2- 172.21.15.1:0/3277720017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefb00aa640 0x7fefb00c1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:06.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.297+0000 7fefb5420700 1 --2- 172.21.15.1:0/3277720017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fefb0158000 0x7fefb0154560 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fefa4006fd0 tx=0x7fefa40090f0).ready entity=mon.0 client_cookie=332b91a3161f39e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:06.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.297+0000 7fefb4c1f700 1 -- 172.21.15.1:0/3277720017 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa400b600 con 0x7fefb0158000 2023-11-15T01:36:06.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.297+0000 7fefb4c1f700 1 -- 172.21.15.1:0/3277720017 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa400b760 con 0x7fefb0158000 2023-11-15T01:36:06.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.297+0000 7fefb4c1f700 1 -- 172.21.15.1:0/3277720017 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa400bb00 con 0x7fefb0158000 2023-11-15T01:36:06.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.298+0000 7fefb7e85700 1 -- 172.21.15.1:0/3277720017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fefb0158000 msgr2=0x7fefb0154560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:06.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.298+0000 7fefb7e85700 1 --2- 172.21.15.1:0/3277720017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fefb0158000 0x7fefb0154560 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fefa4006fd0 tx=0x7fefa40090f0).stop 2023-11-15T01:36:06.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.298+0000 7fefb7e85700 1 -- 172.21.15.1:0/3277720017 shutdown_connections 2023-11-15T01:36:06.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.298+0000 7fefb7e85700 1 --2- 172.21.15.1:0/3277720017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefb00aa640 0x7fefb00c1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.298+0000 7fefb7e85700 1 --2- 172.21.15.1:0/3277720017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fefb0158000 0x7fefb0154560 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.298+0000 7fefb7e85700 1 -- 172.21.15.1:0/3277720017 >> 172.21.15.1:0/3277720017 conn(0x7fefb00c74f0 msgr2=0x7fefb00c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:06.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.298+0000 7fefb7e85700 1 -- 172.21.15.1:0/3277720017 shutdown_connections 2023-11-15T01:36:06.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.298+0000 7fefb7e85700 1 -- 172.21.15.1:0/3277720017 wait complete. 2023-11-15T01:36:06.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.299+0000 7fefb7e85700 1 Processor -- start 2023-11-15T01:36:06.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.299+0000 7fefb7e85700 1 -- start start 2023-11-15T01:36:06.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb7e85700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fefb00aa640 0x7fefb01574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:06.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb7e85700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefb0154180 0x7fefb00a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:06.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb7e85700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fefb0158000 0x7fefb00aca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:06.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb7e85700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb00a88c0 con 0x7fefb00aa640 2023-11-15T01:36:06.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb7e85700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb00a8ba0 con 0x7fefb0158000 2023-11-15T01:36:06.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb7e85700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb00a8e80 con 0x7fefb0154180 2023-11-15T01:36:06.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb5c21700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fefb00aa640 0x7fefb01574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:06.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb5c21700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fefb00aa640 0x7fefb01574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54128/0 (socket says 172.21.15.1:54128) 2023-11-15T01:36:06.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb5c21700 1 -- 172.21.15.1:0/3050950716 learned_addr learned my addr 172.21.15.1:0/3050950716 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:06.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb5420700 1 --2- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefb0154180 0x7fefb00a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:06.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb6422700 1 --2- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fefb0158000 0x7fefb00aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:06.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb5c21700 1 -- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefb0154180 msgr2=0x7fefb00a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:06.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb5c21700 1 --2- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefb0154180 0x7fefb00a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb5c21700 1 -- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fefb0158000 msgr2=0x7fefb00aca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:06.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb5c21700 1 --2- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fefb0158000 0x7fefb00aca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.300+0000 7fefb5c21700 1 -- 172.21.15.1:0/3050950716 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa4009370 con 0x7fefb00aa640 2023-11-15T01:36:06.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.301+0000 7fefb5c21700 1 --2- 172.21.15.1:0/3050950716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fefb00aa640 0x7fefb01574a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fefac00c440 tx=0x7fefac007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:06.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.301+0000 7fefa1ffb700 1 -- 172.21.15.1:0/3050950716 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac012400 con 0x7fefb00aa640 2023-11-15T01:36:06.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.301+0000 7fefb7e85700 1 -- 172.21.15.1:0/3050950716 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb00a9160 con 0x7fefb00aa640 2023-11-15T01:36:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.301+0000 7fefa1ffb700 1 -- 172.21.15.1:0/3050950716 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac012560 con 0x7fefb00aa640 2023-11-15T01:36:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.301+0000 7fefa1ffb700 1 -- 172.21.15.1:0/3050950716 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac012900 con 0x7fefb00aa640 2023-11-15T01:36:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.301+0000 7fefb7e85700 1 -- 172.21.15.1:0/3050950716 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb00a8550 con 0x7fefb00aa640 2023-11-15T01:36:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.302+0000 7fefa1ffb700 1 -- 172.21.15.1:0/3050950716 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fefac01b3b0 con 0x7fefb00aa640 2023-11-15T01:36:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.302+0000 7fefb7e85700 1 -- 172.21.15.1:0/3050950716 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb006c7e0 con 0x7fefb00aa640 2023-11-15T01:36:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.303+0000 7fefa1ffb700 1 --2- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fef9405f270 0x7fef94061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:06.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.303+0000 7fefa1ffb700 1 -- 172.21.15.1:0/3050950716 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6891+0+0 (secure 0 0 0) 0x7fefac079b40 con 0x7fefb00aa640 2023-11-15T01:36:06.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.303+0000 7fefb5420700 1 -- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fef9405f270 msgr2=0x7fef94061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:06.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.303+0000 7fefb5420700 1 --2- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fef9405f270 0x7fef94061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:06.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.307+0000 7fefa1ffb700 1 -- 172.21.15.1:0/3050950716 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fefac048af0 con 0x7fefb00aa640 2023-11-15T01:36:06.315 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:06.315+0000 7f02c10a9680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:36:06.498 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:06.498+0000 7f02c10a9680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:36:06.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.504+0000 7fefb5420700 1 -- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fef9405f270 msgr2=0x7fef94061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:06.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.504+0000 7fefb5420700 1 --2- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fef9405f270 0x7fef94061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:36:06.519 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:06.519+0000 7f6515ce8680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:36:06.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.555+0000 7fefb7e85700 1 -- 172.21.15.1:0/3050950716 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefb0158e80 con 0x7fefb00aa640 2023-11-15T01:36:06.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.555+0000 7fefa1ffb700 1 -- 172.21.15.1:0/3050950716 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7fefac017070 con 0x7fefb00aa640 2023-11-15T01:36:06.556 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:06.556 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2009331607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2009331607},{"type":"v1","addr":"172.21.15.141:6836","nonce":2009331607}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3766593810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3766593810},{"type":"v1","addr":"172.21.15.1:6834","nonce":3766593810}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3751372395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3751372395},{"type":"v1","addr":"172.21.15.1:6835","nonce":3751372395}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:33:56.848117+0000","modified":"2023-11-15T01:33:59.859174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5802":{"gid":5802,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/3696653258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3696653258},{"type":"v1","addr":"172.21.15.141:6837","nonce":3696653258}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-11-15T01:36:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.557+0000 7fefb7e85700 1 -- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fef9405f270 msgr2=0x7fef94061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.557+0000 7fefb7e85700 1 --2- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fef9405f270 0x7fef94061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:06.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.557+0000 7fefb7e85700 1 -- 172.21.15.1:0/3050950716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fefb00aa640 msgr2=0x7fefb01574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.557+0000 7fefb7e85700 1 --2- 172.21.15.1:0/3050950716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fefb00aa640 0x7fefb01574a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fefac00c440 tx=0x7fefac007dc0).stop 2023-11-15T01:36:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.557+0000 7fefb7e85700 1 -- 172.21.15.1:0/3050950716 shutdown_connections 2023-11-15T01:36:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.557+0000 7fefb7e85700 1 --2- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fef9405f270 0x7fef94061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:06.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.557+0000 7fefb7e85700 1 --2- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fefb0158000 0x7fefb00aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.557+0000 7fefb7e85700 1 --2- 172.21.15.1:0/3050950716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fefb00aa640 0x7fefb01574a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.557+0000 7fefb7e85700 1 --2- 172.21.15.1:0/3050950716 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefb0154180 0x7fefb00a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.557+0000 7fefb7e85700 1 -- 172.21.15.1:0/3050950716 >> 172.21.15.1:0/3050950716 conn(0x7fefb00c74f0 msgr2=0x7fefb0153540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:06.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.557+0000 7fefb7e85700 1 -- 172.21.15.1:0/3050950716 shutdown_connections 2023-11-15T01:36:06.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.557+0000 7fefb7e85700 1 -- 172.21.15.1:0/3050950716 wait complete. 2023-11-15T01:36:06.561 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 23 2023-11-15T01:36:06.570 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:36:06.711 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:06.711+0000 7f6515ce8680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:36:06.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.731+0000 7f3ab3962700 1 Processor -- start 2023-11-15T01:36:06.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.732+0000 7f3ab3962700 1 -- start start 2023-11-15T01:36:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3ab3962700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3aac154150 0x7f3aac154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3ab3962700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3aac0ab1a0 0x7f3aac158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3ab3962700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aac0c06f0 con 0x7f3aac0aa060 2023-11-15T01:36:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3ab3962700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aac0c09d0 con 0x7f3aac154150 2023-11-15T01:36:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3ab3962700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac158820 con 0x7f3aac0ab1a0 2023-11-15T01:36:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3ab16fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3aac154150 0x7f3aac154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3ab1eff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3aac0aa060 0x7f3aac0c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34696/0 (socket says 172.21.15.1:34696) 2023-11-15T01:36:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3ab1eff700 1 -- 172.21.15.1:0/2075409510 learned_addr learned my addr 172.21.15.1:0/2075409510 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:06.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3ab0efd700 1 --2- 172.21.15.1:0/2075409510 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3aac0ab1a0 0x7f3aac158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:06.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3ab16fe700 1 -- 172.21.15.1:0/2075409510 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3aac0ab1a0 msgr2=0x7f3aac158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:06.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3ab16fe700 1 --2- 172.21.15.1:0/2075409510 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3aac0ab1a0 0x7f3aac158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3ab16fe700 1 -- 172.21.15.1:0/2075409510 >> v1:172.21.15.1:6789/0 conn(0x7f3aac0aa060 legacy=0x7f3aac0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:06.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3aa3fff700 1 -- 172.21.15.1:0/2075409510 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208837375 0 0) 0x7f3aac0c06f0 con 0x7f3aac0aa060 2023-11-15T01:36:06.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3ab16fe700 1 -- 172.21.15.1:0/2075409510 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac158b00 con 0x7f3aac154150 2023-11-15T01:36:06.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3ab0efd700 1 --2- 172.21.15.1:0/2075409510 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3aac0ab1a0 0x7f3aac158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:06.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3ab16fe700 1 --2- 172.21.15.1:0/2075409510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac154150 0x7f3aac154530 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f3aa8009760 tx=0x7f3aa8009060).ready entity=mon.0 client_cookie=3d19ce02dde1d7d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:06.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3aa3fff700 1 -- 172.21.15.1:0/2075409510 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa80090d0 con 0x7f3aac154150 2023-11-15T01:36:06.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3aa3fff700 1 -- 172.21.15.1:0/2075409510 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa800b580 con 0x7f3aac154150 2023-11-15T01:36:06.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.733+0000 7f3aa3fff700 1 -- 172.21.15.1:0/2075409510 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa800b900 con 0x7f3aac154150 2023-11-15T01:36:06.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.734+0000 7f3ab3962700 1 -- 172.21.15.1:0/2075409510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac154150 msgr2=0x7f3aac154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:06.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.734+0000 7f3ab3962700 1 --2- 172.21.15.1:0/2075409510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac154150 0x7f3aac154530 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f3aa8009760 tx=0x7f3aa8009060).stop 2023-11-15T01:36:06.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.734+0000 7f3ab3962700 1 -- 172.21.15.1:0/2075409510 shutdown_connections 2023-11-15T01:36:06.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.734+0000 7f3ab3962700 1 --2- 172.21.15.1:0/2075409510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac154150 0x7f3aac154530 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.734+0000 7f3ab3962700 1 --2- 172.21.15.1:0/2075409510 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3aac0ab1a0 0x7f3aac158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.734+0000 7f3ab3962700 1 -- 172.21.15.1:0/2075409510 >> 172.21.15.1:0/2075409510 conn(0x7f3aac064aa0 msgr2=0x7f3aac064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:06.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.734+0000 7f3ab3962700 1 -- 172.21.15.1:0/2075409510 shutdown_connections 2023-11-15T01:36:06.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.734+0000 7f3ab3962700 1 -- 172.21.15.1:0/2075409510 wait complete. 2023-11-15T01:36:06.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.735+0000 7f3ab3962700 1 Processor -- start 2023-11-15T01:36:06.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.735+0000 7f3ab3962700 1 -- start start 2023-11-15T01:36:06.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.736+0000 7f3ab3962700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3aac0aa060 0x7f3aac0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:06.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.736+0000 7f3ab3962700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3aac0ab1a0 0x7f3aac147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:06.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.736+0000 7f3ab3962700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac154150 0x7f3aac0ac060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:06.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.736+0000 7f3ab3962700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac168250 con 0x7f3aac154150 2023-11-15T01:36:06.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.736+0000 7f3ab3962700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac1690b0 con 0x7f3aac0aa060 2023-11-15T01:36:06.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.736+0000 7f3ab3962700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac1684a0 con 0x7f3aac0ab1a0 2023-11-15T01:36:06.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.736+0000 7f3ab1eff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac154150 0x7f3aac0ac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:06.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.736+0000 7f3ab1eff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac154150 0x7f3aac0ac060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54150/0 (socket says 172.21.15.1:54150) 2023-11-15T01:36:06.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.736+0000 7f3ab1eff700 1 -- 172.21.15.1:0/4105369239 learned_addr learned my addr 172.21.15.1:0/4105369239 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:06.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.736+0000 7f3ab16fe700 1 --2- 172.21.15.1:0/4105369239 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3aac0aa060 0x7f3aac0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:06.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.736+0000 7f3ab0efd700 1 --2- 172.21.15.1:0/4105369239 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3aac0ab1a0 0x7f3aac147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:06.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.737+0000 7f3ab1eff700 1 -- 172.21.15.1:0/4105369239 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3aac0ab1a0 msgr2=0x7f3aac147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:06.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.737+0000 7f3ab1eff700 1 --2- 172.21.15.1:0/4105369239 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3aac0ab1a0 0x7f3aac147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.737+0000 7f3ab1eff700 1 -- 172.21.15.1:0/4105369239 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3aac0aa060 msgr2=0x7f3aac0cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:06.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.737+0000 7f3ab1eff700 1 --2- 172.21.15.1:0/4105369239 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3aac0aa060 0x7f3aac0cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.737+0000 7f3ab1eff700 1 -- 172.21.15.1:0/4105369239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa80092a0 con 0x7f3aac154150 2023-11-15T01:36:06.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.737+0000 7f3ab1eff700 1 --2- 172.21.15.1:0/4105369239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac154150 0x7f3aac0ac060 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f3aa400c790 tx=0x7f3aa4007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:06.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.737+0000 7f3aa17fa700 1 -- 172.21.15.1:0/4105369239 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4005d30 con 0x7f3aac154150 2023-11-15T01:36:06.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.737+0000 7f3aa17fa700 1 -- 172.21.15.1:0/4105369239 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa4005e90 con 0x7f3aac154150 2023-11-15T01:36:06.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.737+0000 7f3ab3962700 1 -- 172.21.15.1:0/4105369239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aac168780 con 0x7f3aac154150 2023-11-15T01:36:06.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.737+0000 7f3aa17fa700 1 -- 172.21.15.1:0/4105369239 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4007300 con 0x7f3aac154150 2023-11-15T01:36:06.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.737+0000 7f3ab3962700 1 -- 172.21.15.1:0/4105369239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aac168d40 con 0x7f3aac154150 2023-11-15T01:36:06.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.738+0000 7f3ab3962700 1 -- 172.21.15.1:0/4105369239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aac06c7e0 con 0x7f3aac154150 2023-11-15T01:36:06.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.738+0000 7f3aa17fa700 1 -- 172.21.15.1:0/4105369239 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f3aa40076f0 con 0x7f3aac154150 2023-11-15T01:36:06.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.739+0000 7f3aa17fa700 1 --2- 172.21.15.1:0/4105369239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3a9005f240 0x7f3a90061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:06.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.739+0000 7f3aa17fa700 1 -- 172.21.15.1:0/4105369239 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6891+0+0 (secure 0 0 0) 0x7f3aa407a120 con 0x7f3aac154150 2023-11-15T01:36:06.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.739+0000 7f3ab16fe700 1 -- 172.21.15.1:0/4105369239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3a9005f240 msgr2=0x7f3a90061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:06.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.739+0000 7f3ab16fe700 1 --2- 172.21.15.1:0/4105369239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3a9005f240 0x7f3a90061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:06.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.743+0000 7f3aa17fa700 1 -- 172.21.15.1:0/4105369239 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3aa404af70 con 0x7f3aac154150 2023-11-15T01:36:06.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.922+0000 7f3ab3962700 1 -- 172.21.15.1:0/4105369239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3aac158de0 con 0x7f3aac154150 2023-11-15T01:36:06.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.923+0000 7f3aa17fa700 1 -- 172.21.15.1:0/4105369239 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18150 (secure 0 0 0) 0x7f3aa4018020 con 0x7f3aac154150 2023-11-15T01:36:06.925 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:06.925 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":65,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:36:06.879175+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:33:54.494299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-15T01:33:55.821335+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":65,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"8.1a","mappings":[{"from":0,"to":1}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:6833/90546":"2023-11-16T01:34:13.098171+0000","172.21.15.141:6832/90546":"2023-11-16T01:34:13.098171+0000","172.21.15.141:0/319645857":"2023-11-16T01:34:13.098171+0000","172.21.15.141:0/380022886":"2023-11-16T01:34:13.098171+0000","172.21.15.141:0/3570210448":"2023-11-16T01:34:13.098171+0000","172.21.15.141:0/3619913227":"2023-11-16T01:34:13.098171+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:36:06.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.925+0000 7f3ab3962700 1 -- 172.21.15.1:0/4105369239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3a9005f240 msgr2=0x7f3a90061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:06.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.925+0000 7f3ab3962700 1 --2- 172.21.15.1:0/4105369239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3a9005f240 0x7f3a90061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:06.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.925+0000 7f3ab3962700 1 -- 172.21.15.1:0/4105369239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac154150 msgr2=0x7f3aac0ac060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:06.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.925+0000 7f3ab3962700 1 --2- 172.21.15.1:0/4105369239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac154150 0x7f3aac0ac060 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f3aa400c790 tx=0x7f3aa4007ef0).stop 2023-11-15T01:36:06.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.925+0000 7f3ab3962700 1 -- 172.21.15.1:0/4105369239 shutdown_connections 2023-11-15T01:36:06.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.925+0000 7f3ab3962700 1 --2- 172.21.15.1:0/4105369239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3a9005f240 0x7f3a90061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:06.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.925+0000 7f3ab3962700 1 --2- 172.21.15.1:0/4105369239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac154150 0x7f3aac0ac060 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.925+0000 7f3ab3962700 1 --2- 172.21.15.1:0/4105369239 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3aac0aa060 0x7f3aac0cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.925+0000 7f3ab3962700 1 --2- 172.21.15.1:0/4105369239 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3aac0ab1a0 0x7f3aac147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:06.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.925+0000 7f3ab3962700 1 -- 172.21.15.1:0/4105369239 >> 172.21.15.1:0/4105369239 conn(0x7f3aac064aa0 msgr2=0x7f3aac0acdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:06.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.925+0000 7f3ab3962700 1 -- 172.21.15.1:0/4105369239 shutdown_connections 2023-11-15T01:36:06.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:06.925+0000 7f3ab3962700 1 -- 172.21.15.1:0/4105369239 wait complete. 2023-11-15T01:36:06.939 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-15T01:36:06.939 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:36:07.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.062+0000 7f12c6e27700 1 Processor -- start 2023-11-15T01:36:07.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.062+0000 7f12c6e27700 1 -- start start 2023-11-15T01:36:07.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.063+0000 7f12c6e27700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f12c00bdfb0 0x7f12c00be390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.063+0000 7f12c6e27700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f12c00c6d10 0x7f12c00bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.063+0000 7f12c6e27700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12c00bd8f0 0x7f12c0154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.063+0000 7f12c6e27700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c00bccd0 con 0x7f12c00c6d10 2023-11-15T01:36:07.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.063+0000 7f12c6e27700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c00ad5e0 con 0x7f12c00bdfb0 2023-11-15T01:36:07.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.063+0000 7f12c6e27700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00ad8c0 con 0x7f12c00bd8f0 2023-11-15T01:36:07.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.063+0000 7f12bffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f12c00c6d10 0x7f12c00bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:07.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.063+0000 7f12bffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f12c00c6d10 0x7f12c00bd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54166/0 (socket says 172.21.15.1:54166) 2023-11-15T01:36:07.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.063+0000 7f12bffff700 1 -- 172.21.15.1:0/1468288011 learned_addr learned my addr 172.21.15.1:0/1468288011 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:07.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.064+0000 7f12c4bc3700 1 --2- 172.21.15.1:0/1468288011 >> v2:172.21.15.141:3300/0 conn(0x7f12c00bdfb0 0x7f12c00be390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:07.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.064+0000 7f12c53c4700 1 --2- 172.21.15.1:0/1468288011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12c00bd8f0 0x7f12c0154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:07.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.064+0000 7f12bffff700 1 -- 172.21.15.1:0/1468288011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12c00bd8f0 msgr2=0x7f12c0154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:07.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.064+0000 7f12bffff700 1 --2- 172.21.15.1:0/1468288011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12c00bd8f0 0x7f12c0154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.064+0000 7f12bffff700 1 -- 172.21.15.1:0/1468288011 >> v2:172.21.15.141:3300/0 conn(0x7f12c00bdfb0 msgr2=0x7f12c00be390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:07.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.064+0000 7f12bffff700 1 --2- 172.21.15.1:0/1468288011 >> v2:172.21.15.141:3300/0 conn(0x7f12c00bdfb0 0x7f12c00be390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.064+0000 7f12bffff700 1 -- 172.21.15.1:0/1468288011 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c00adba0 con 0x7f12c00c6d10 2023-11-15T01:36:07.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.064+0000 7f12c4bc3700 1 --2- 172.21.15.1:0/1468288011 >> v2:172.21.15.141:3300/0 conn(0x7f12c00bdfb0 0x7f12c00be390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:07.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.064+0000 7f12bffff700 1 --2- 172.21.15.1:0/1468288011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c00c6d10 0x7f12c00bd400 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f12c00690a0 tx=0x7f12ac0090f0).ready entity=mon.0 client_cookie=c539b9e30cd23f69 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:07.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.064+0000 7f12bf7fe700 1 -- 172.21.15.1:0/1468288011 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac00f6b0 con 0x7f12c00c6d10 2023-11-15T01:36:07.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.064+0000 7f12bf7fe700 1 -- 172.21.15.1:0/1468288011 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac00f810 con 0x7f12c00c6d10 2023-11-15T01:36:07.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.064+0000 7f12bf7fe700 1 -- 172.21.15.1:0/1468288011 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac00fb90 con 0x7f12c00c6d10 2023-11-15T01:36:07.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.064+0000 7f12c6e27700 1 -- 172.21.15.1:0/1468288011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c00c6d10 msgr2=0x7f12c00bd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:07.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.064+0000 7f12c6e27700 1 --2- 172.21.15.1:0/1468288011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c00c6d10 0x7f12c00bd400 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f12c00690a0 tx=0x7f12ac0090f0).stop 2023-11-15T01:36:07.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.065+0000 7f12c6e27700 1 -- 172.21.15.1:0/1468288011 shutdown_connections 2023-11-15T01:36:07.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.065+0000 7f12c6e27700 1 --2- 172.21.15.1:0/1468288011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12c00bd8f0 0x7f12c0154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.065+0000 7f12c6e27700 1 --2- 172.21.15.1:0/1468288011 >> v2:172.21.15.141:3300/0 conn(0x7f12c00bdfb0 0x7f12c00be390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.065+0000 7f12c6e27700 1 --2- 172.21.15.1:0/1468288011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c00c6d10 0x7f12c00bd400 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.065+0000 7f12c6e27700 1 -- 172.21.15.1:0/1468288011 >> 172.21.15.1:0/1468288011 conn(0x7f12c00c7d70 msgr2=0x7f12c00c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:07.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.065+0000 7f12c6e27700 1 -- 172.21.15.1:0/1468288011 shutdown_connections 2023-11-15T01:36:07.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.065+0000 7f12c6e27700 1 -- 172.21.15.1:0/1468288011 wait complete. 2023-11-15T01:36:07.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.066+0000 7f12c6e27700 1 Processor -- start 2023-11-15T01:36:07.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.066+0000 7f12c6e27700 1 -- start start 2023-11-15T01:36:07.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12c6e27700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12c00bd8f0 0x7f12c00aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12c6e27700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12c00bdfb0 0x7f12c014fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12c6e27700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c00c6d10 0x7f12c014ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12c6e27700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c0150450 con 0x7f12c00c6d10 2023-11-15T01:36:07.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12c6e27700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c0168650 con 0x7f12c00bd8f0 2023-11-15T01:36:07.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12c6e27700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00a6c30 con 0x7f12c00bdfb0 2023-11-15T01:36:07.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12c4bc3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12c00bd8f0 0x7f12c00aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:07.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12bffff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12c00bdfb0 0x7f12c014fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:07.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12c4bc3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12c00bd8f0 0x7f12c00aad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:42144/0 (socket says 172.21.15.1:42144) 2023-11-15T01:36:07.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12bffff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12c00bdfb0 0x7f12c014fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:49890/0 (socket says 172.21.15.1:49890) 2023-11-15T01:36:07.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12c4bc3700 1 -- 172.21.15.1:0/1774490645 learned_addr learned my addr 172.21.15.1:0/1774490645 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:07.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12c53c4700 1 --2- 172.21.15.1:0/1774490645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c00c6d10 0x7f12c014ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:07.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12bffff700 1 -- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12c00bd8f0 msgr2=0x7f12c00aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:07.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12bffff700 1 --2- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12c00bd8f0 0x7f12c00aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12bffff700 1 -- 172.21.15.1:0/1774490645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c00c6d10 msgr2=0x7f12c014ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:07.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12bffff700 1 --2- 172.21.15.1:0/1774490645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c00c6d10 0x7f12c014ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12bffff700 1 -- 172.21.15.1:0/1774490645 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac009370 con 0x7f12c00bdfb0 2023-11-15T01:36:07.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12c53c4700 1 --2- 172.21.15.1:0/1774490645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c00c6d10 0x7f12c014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:07.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12c4bc3700 1 --2- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12c00bd8f0 0x7f12c00aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:07.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.067+0000 7f12bffff700 1 --2- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12c00bdfb0 0x7f12c014fa70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f12c006a260 tx=0x7f12ac019000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:07.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.068+0000 7f12bcff9700 1 -- 172.21.15.1:0/1774490645 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac00e1d0 con 0x7f12c00bdfb0 2023-11-15T01:36:07.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.068+0000 7f12bcff9700 1 -- 172.21.15.1:0/1774490645 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac00f980 con 0x7f12c00bdfb0 2023-11-15T01:36:07.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.068+0000 7f12c6e27700 1 -- 172.21.15.1:0/1774490645 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c00a6ed0 con 0x7f12c00bdfb0 2023-11-15T01:36:07.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.068+0000 7f12bcff9700 1 -- 172.21.15.1:0/1774490645 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac0196a0 con 0x7f12c00bdfb0 2023-11-15T01:36:07.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.068+0000 7f12c6e27700 1 -- 172.21.15.1:0/1774490645 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c00acb00 con 0x7f12c00bdfb0 2023-11-15T01:36:07.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.069+0000 7f12c6e27700 1 -- 172.21.15.1:0/1774490645 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c0065eb0 con 0x7f12c00bdfb0 2023-11-15T01:36:07.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.069+0000 7f12bcff9700 1 -- 172.21.15.1:0/1774490645 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f12ac019a90 con 0x7f12c00bdfb0 2023-11-15T01:36:07.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.069+0000 7f12bcff9700 1 --2- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f12a405f240 0x7f12a4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.069+0000 7f12bcff9700 1 -- 172.21.15.1:0/1774490645 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6947+0+0 (secure 0 0 0) 0x7f12ac07ba70 con 0x7f12c00bdfb0 2023-11-15T01:36:07.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.069+0000 7f12c4bc3700 1 -- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f12a405f240 msgr2=0x7f12a4061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:07.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.069+0000 7f12c4bc3700 1 --2- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f12a405f240 0x7f12a4061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:07.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.074+0000 7f12bcff9700 1 -- 172.21.15.1:0/1774490645 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f12ac04c880 con 0x7f12c00bdfb0 2023-11-15T01:36:07.152 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:07.151+0000 7f02c10a9680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:36:07.219 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:07.218+0000 7f02c10a9680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:36:07.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.270+0000 7f12c4bc3700 1 -- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f12a405f240 msgr2=0x7f12a4061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:07.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.270+0000 7f12c4bc3700 1 --2- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f12a405f240 0x7f12a4061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:36:07.293 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:07.292+0000 7f02c10a9680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:36:07.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.296+0000 7f12c6e27700 1 -- 172.21.15.1:0/1774490645 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12c006c7e0 con 0x7f12c00bdfb0 2023-11-15T01:36:07.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.296+0000 7f12bcff9700 1 -- 172.21.15.1:0/1774490645 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f12ac028020 con 0x7f12c00bdfb0 2023-11-15T01:36:07.297 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:07.297 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2009331607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2009331607},{"type":"v1","addr":"172.21.15.141:6836","nonce":2009331607}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3766593810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3766593810},{"type":"v1","addr":"172.21.15.1:6834","nonce":3766593810}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3751372395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3751372395},{"type":"v1","addr":"172.21.15.1:6835","nonce":3751372395}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:33:56.848117+0000","modified":"2023-11-15T01:33:59.859174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5802":{"gid":5802,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/3696653258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3696653258},{"type":"v1","addr":"172.21.15.141:6837","nonce":3696653258}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-11-15T01:36:07.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.298+0000 7f12c6e27700 1 -- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f12a405f240 msgr2=0x7f12a4061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:07.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.298+0000 7f12c6e27700 1 --2- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f12a405f240 0x7f12a4061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:07.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.298+0000 7f12c6e27700 1 -- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12c00bdfb0 msgr2=0x7f12c014fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:07.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.298+0000 7f12c6e27700 1 --2- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12c00bdfb0 0x7f12c014fa70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f12c006a260 tx=0x7f12ac019000).stop 2023-11-15T01:36:07.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.298+0000 7f12c6e27700 1 -- 172.21.15.1:0/1774490645 shutdown_connections 2023-11-15T01:36:07.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.298+0000 7f12c6e27700 1 --2- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f12a405f240 0x7f12a4061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:07.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.298+0000 7f12c6e27700 1 --2- 172.21.15.1:0/1774490645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c00c6d10 0x7f12c014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.298+0000 7f12c6e27700 1 --2- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12c00bd8f0 0x7f12c00aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.298+0000 7f12c6e27700 1 --2- 172.21.15.1:0/1774490645 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12c00bdfb0 0x7f12c014fa70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.298+0000 7f12c6e27700 1 -- 172.21.15.1:0/1774490645 >> 172.21.15.1:0/1774490645 conn(0x7f12c00c7d70 msgr2=0x7f12c0066f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:07.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.298+0000 7f12c6e27700 1 -- 172.21.15.1:0/1774490645 shutdown_connections 2023-11-15T01:36:07.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.298+0000 7f12c6e27700 1 -- 172.21.15.1:0/1774490645 wait complete. 2023-11-15T01:36:07.303 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 23 2023-11-15T01:36:07.312 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:36:07.419 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:07.418+0000 7f6515ce8680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:36:07.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.433+0000 7f6830b61700 1 Processor -- start 2023-11-15T01:36:07.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.433+0000 7f6830b61700 1 -- start start 2023-11-15T01:36:07.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.434+0000 7f6830b61700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f682c0629e0 0x7f682c0c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.434+0000 7f6830b61700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f682c0abb40 0x7f682c064df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.434+0000 7f6830b61700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682c0a9f60 con 0x7f682c0c3400 2023-11-15T01:36:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.434+0000 7f6830b61700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f682c0c3880 con 0x7f682c0629e0 2023-11-15T01:36:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.434+0000 7f6830b61700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c151700 con 0x7f682c0abb40 2023-11-15T01:36:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.435+0000 7f6829d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f682c0c3400 0x7f682c0ab430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34702/0 (socket says 172.21.15.1:34702) 2023-11-15T01:36:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.435+0000 7f6829d9b700 1 -- 172.21.15.1:0/1925572165 learned_addr learned my addr 172.21.15.1:0/1925572165 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.435+0000 7f682a59c700 1 --2- 172.21.15.1:0/1925572165 >> v2:172.21.15.141:3300/0 conn(0x7f682c0629e0 0x7f682c0c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:07.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.435+0000 7f682ad9d700 1 --2- 172.21.15.1:0/1925572165 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f682c0abb40 0x7f682c064df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:07.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.435+0000 7f682959a700 1 -- 172.21.15.1:0/1925572165 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399354289 0 0) 0x7f682c0a9f60 con 0x7f682c0c3400 2023-11-15T01:36:07.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.435+0000 7f682959a700 1 -- 172.21.15.1:0/1925572165 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68140033f0 con 0x7f682c0c3400 2023-11-15T01:36:07.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.435+0000 7f682a59c700 1 -- 172.21.15.1:0/1925572165 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f682c0abb40 msgr2=0x7f682c064df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.435+0000 7f682a59c700 1 --2- 172.21.15.1:0/1925572165 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f682c0abb40 0x7f682c064df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.435+0000 7f682a59c700 1 -- 172.21.15.1:0/1925572165 >> v1:172.21.15.1:6789/0 conn(0x7f682c0c3400 legacy=0x7f682c0ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.435+0000 7f682a59c700 1 -- 172.21.15.1:0/1925572165 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c0c2a80 con 0x7f682c0629e0 2023-11-15T01:36:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.435+0000 7f682ad9d700 1 --2- 172.21.15.1:0/1925572165 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f682c0abb40 0x7f682c064df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.435+0000 7f682a59c700 1 --2- 172.21.15.1:0/1925572165 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f682c0629e0 0x7f682c0c2f10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f681c009760 tx=0x7f681c009060).ready entity=mon.1 client_cookie=404362488ec6caf9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.435+0000 7f682959a700 1 -- 172.21.15.1:0/1925572165 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c00d4a0 con 0x7f682c0629e0 2023-11-15T01:36:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.435+0000 7f682959a700 1 -- 172.21.15.1:0/1925572165 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c00d600 con 0x7f682c0629e0 2023-11-15T01:36:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.435+0000 7f682959a700 1 -- 172.21.15.1:0/1925572165 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c00d980 con 0x7f682c0629e0 2023-11-15T01:36:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.436+0000 7f6830b61700 1 -- 172.21.15.1:0/1925572165 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f682c0629e0 msgr2=0x7f682c0c2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.436+0000 7f6830b61700 1 --2- 172.21.15.1:0/1925572165 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f682c0629e0 0x7f682c0c2f10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f681c009760 tx=0x7f681c009060).stop 2023-11-15T01:36:07.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.436+0000 7f6830b61700 1 -- 172.21.15.1:0/1925572165 shutdown_connections 2023-11-15T01:36:07.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.436+0000 7f6830b61700 1 --2- 172.21.15.1:0/1925572165 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f682c0abb40 0x7f682c064df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.436+0000 7f6830b61700 1 --2- 172.21.15.1:0/1925572165 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f682c0629e0 0x7f682c0c2f10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.436+0000 7f6830b61700 1 -- 172.21.15.1:0/1925572165 >> 172.21.15.1:0/1925572165 conn(0x7f682c0c74f0 msgr2=0x7f682c0c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:07.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.436+0000 7f6830b61700 1 -- 172.21.15.1:0/1925572165 shutdown_connections 2023-11-15T01:36:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.436+0000 7f6830b61700 1 -- 172.21.15.1:0/1925572165 wait complete. 2023-11-15T01:36:07.443 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:07.436+0000 7f02c10a9680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:36:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.437+0000 7f6830b61700 1 Processor -- start 2023-11-15T01:36:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.437+0000 7f6830b61700 1 -- start start 2023-11-15T01:36:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.438+0000 7f6830b61700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f682c0629e0 0x7f682c0bf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.438+0000 7f6830b61700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f682c0c3400 0x7f682c154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.438+0000 7f6830b61700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f682c152530 0x7f682c064df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.438+0000 7f6830b61700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0bc8a0 con 0x7f682c0629e0 2023-11-15T01:36:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.438+0000 7f6830b61700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0bfba0 con 0x7f682c0c3400 2023-11-15T01:36:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.438+0000 7f6830b61700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0bfe80 con 0x7f682c152530 2023-11-15T01:36:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.438+0000 7f682a59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f682c0629e0 0x7f682c0bf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.438+0000 7f6829d9b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f682c0c3400 0x7f682c154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.438+0000 7f682ad9d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f682c152530 0x7f682c064df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.438+0000 7f682a59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f682c0629e0 0x7f682c0bf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54180/0 (socket says 172.21.15.1:54180) 2023-11-15T01:36:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.438+0000 7f682a59c700 1 -- 172.21.15.1:0/1312071176 learned_addr learned my addr 172.21.15.1:0/1312071176 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.438+0000 7f682ad9d700 1 --2- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f682c152530 0x7f682c064df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:49908/0 (socket says 172.21.15.1:49908) 2023-11-15T01:36:07.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.439+0000 7f682ad9d700 1 -- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f682c0c3400 msgr2=0x7f682c154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:07.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.439+0000 7f682ad9d700 1 --2- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f682c0c3400 0x7f682c154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.439+0000 7f682ad9d700 1 -- 172.21.15.1:0/1312071176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f682c0629e0 msgr2=0x7f682c0bf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:07.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.439+0000 7f682ad9d700 1 --2- 172.21.15.1:0/1312071176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f682c0629e0 0x7f682c0bf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.439+0000 7f682ad9d700 1 -- 172.21.15.1:0/1312071176 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6824009a20 con 0x7f682c152530 2023-11-15T01:36:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.439+0000 7f682ad9d700 1 --2- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f682c152530 0x7f682c064df0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f6824009ee0 tx=0x7f682400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.439+0000 7f681a7fc700 1 -- 172.21.15.1:0/1312071176 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682400cb70 con 0x7f682c152530 2023-11-15T01:36:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.439+0000 7f681a7fc700 1 -- 172.21.15.1:0/1312071176 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682400f040 con 0x7f682c152530 2023-11-15T01:36:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.439+0000 7f6830b61700 1 -- 172.21.15.1:0/1312071176 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681c0092a0 con 0x7f682c152530 2023-11-15T01:36:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.439+0000 7f681a7fc700 1 -- 172.21.15.1:0/1312071176 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824013400 con 0x7f682c152530 2023-11-15T01:36:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.439+0000 7f6830b61700 1 -- 172.21.15.1:0/1312071176 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682c0c0440 con 0x7f682c152530 2023-11-15T01:36:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.440+0000 7f6830b61700 1 -- 172.21.15.1:0/1312071176 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682c0bcac0 con 0x7f682c152530 2023-11-15T01:36:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.440+0000 7f681a7fc700 1 -- 172.21.15.1:0/1312071176 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f68240137f0 con 0x7f682c152530 2023-11-15T01:36:07.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.441+0000 7f681a7fc700 1 --2- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f680c05f270 0x7f680c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.441+0000 7f682a59c700 1 -- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f680c05f270 msgr2=0x7f680c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:07.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.441+0000 7f681a7fc700 1 -- 172.21.15.1:0/1312071176 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6947+0+0 (secure 0 0 0) 0x7f682407af10 con 0x7f682c152530 2023-11-15T01:36:07.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.441+0000 7f682a59c700 1 --2- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f680c05f270 0x7f680c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:07.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.445+0000 7f681a7fc700 1 -- 172.21.15.1:0/1312071176 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f682c0bcac0 con 0x7f682c152530 2023-11-15T01:36:07.493 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:07.493+0000 7f6515ce8680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:36:07.510 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:07.509+0000 7f02c10a9680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:36:07.574 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:07.574+0000 7f6515ce8680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:36:07.628 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:07.627+0000 7f02c10a9680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:36:07.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.642+0000 7f682a59c700 1 -- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f680c05f270 msgr2=0x7f680c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:07.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.642+0000 7f682a59c700 1 --2- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f680c05f270 0x7f680c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:36:07.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.670+0000 7f6830b61700 1 -- 172.21.15.1:0/1312071176 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f682c0bcac0 con 0x7f682c152530 2023-11-15T01:36:07.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.671+0000 7f681a7fc700 1 -- 172.21.15.1:0/1312071176 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f682c0bcac0 con 0x7f682c152530 2023-11-15T01:36:07.671 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:07.672 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2009331607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2009331607},{"type":"v1","addr":"172.21.15.141:6836","nonce":2009331607}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3766593810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3766593810},{"type":"v1","addr":"172.21.15.1:6834","nonce":3766593810}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3751372395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3751372395},{"type":"v1","addr":"172.21.15.1:6835","nonce":3751372395}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:33:56.848117+0000","modified":"2023-11-15T01:33:59.859174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5802":{"gid":5802,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/3696653258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3696653258},{"type":"v1","addr":"172.21.15.141:6837","nonce":3696653258}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-11-15T01:36:07.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.673+0000 7f6830b61700 1 -- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f680c05f270 msgr2=0x7f680c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:07.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.673+0000 7f6830b61700 1 --2- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f680c05f270 0x7f680c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:07.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.673+0000 7f6830b61700 1 -- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f682c152530 msgr2=0x7f682c064df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:07.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.673+0000 7f6830b61700 1 --2- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f682c152530 0x7f682c064df0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f6824009ee0 tx=0x7f682400b040).stop 2023-11-15T01:36:07.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.673+0000 7f6830b61700 1 -- 172.21.15.1:0/1312071176 shutdown_connections 2023-11-15T01:36:07.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.673+0000 7f6830b61700 1 --2- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f680c05f270 0x7f680c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:07.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.673+0000 7f6830b61700 1 --2- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f682c152530 0x7f682c064df0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.673+0000 7f6830b61700 1 --2- 172.21.15.1:0/1312071176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f682c0629e0 0x7f682c0bf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.673+0000 7f6830b61700 1 --2- 172.21.15.1:0/1312071176 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f682c0c3400 0x7f682c154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.673+0000 7f6830b61700 1 -- 172.21.15.1:0/1312071176 >> 172.21.15.1:0/1312071176 conn(0x7f682c0c74f0 msgr2=0x7f682c0acbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:07.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.673+0000 7f6830b61700 1 -- 172.21.15.1:0/1312071176 shutdown_connections 2023-11-15T01:36:07.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.673+0000 7f6830b61700 1 -- 172.21.15.1:0/1312071176 wait complete. 2023-11-15T01:36:07.676 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 23 2023-11-15T01:36:07.686 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:36:07.734 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:07.734+0000 7f6515ce8680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:36:07.735 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:07.735+0000 7f02c10a9680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:36:07.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.806+0000 7fd82d24e700 1 Processor -- start 2023-11-15T01:36:07.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.806+0000 7fd82d24e700 1 -- start start 2023-11-15T01:36:07.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.807+0000 7fd82d24e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd828154e70 0x7fd8281552c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.807+0000 7fd82d24e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8281557b0 con 0x7fd8280bdfb0 2023-11-15T01:36:07.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.807+0000 7fd82d24e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8280ad5e0 con 0x7fd8280be390 2023-11-15T01:36:07.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.807+0000 7fd82d24e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8280bccd0 con 0x7fd828154e70 2023-11-15T01:36:07.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.807+0000 7fd826d9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd8280bdfb0 0x7fd8280c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52962/0 (socket says 172.21.15.1:52962) 2023-11-15T01:36:07.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.807+0000 7fd826d9d700 1 -- 172.21.15.1:0/2573034549 learned_addr learned my addr 172.21.15.1:0/2573034549 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:07.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.808+0000 7fd82759e700 1 --2- 172.21.15.1:0/2573034549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd828154e70 0x7fd8281552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:07.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.808+0000 7fd825d9b700 1 -- 172.21.15.1:0/2573034549 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854442844 0 0) 0x7fd8281557b0 con 0x7fd8280bdfb0 2023-11-15T01:36:07.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.808+0000 7fd825d9b700 1 -- 172.21.15.1:0/2573034549 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8140033f0 con 0x7fd8280bdfb0 2023-11-15T01:36:07.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.808+0000 7fd825d9b700 1 -- 172.21.15.1:0/2573034549 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754961347 0 0) 0x7fd8280ad5e0 con 0x7fd8280be390 2023-11-15T01:36:07.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.808+0000 7fd825d9b700 1 -- 172.21.15.1:0/2573034549 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8281557b0 con 0x7fd8280be390 2023-11-15T01:36:07.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.808+0000 7fd82759e700 1 -- 172.21.15.1:0/2573034549 >> v1:172.21.15.141:6789/0 conn(0x7fd8280be390 legacy=0x7fd8280bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:07.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.808+0000 7fd82759e700 1 -- 172.21.15.1:0/2573034549 >> v1:172.21.15.1:6789/0 conn(0x7fd8280bdfb0 legacy=0x7fd8280c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:07.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.808+0000 7fd82759e700 1 -- 172.21.15.1:0/2573034549 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8280ad8c0 con 0x7fd828154e70 2023-11-15T01:36:07.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.808+0000 7fd82759e700 1 --2- 172.21.15.1:0/2573034549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd828154e70 0x7fd8281552c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd820009e90 tx=0x7fd820009780).ready entity=mon.2 client_cookie=2b52ee9b76133b30 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:07.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.808+0000 7fd825d9b700 1 -- 172.21.15.1:0/2573034549 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000e070 con 0x7fd828154e70 2023-11-15T01:36:07.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.808+0000 7fd825d9b700 1 -- 172.21.15.1:0/2573034549 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82000bab0 con 0x7fd828154e70 2023-11-15T01:36:07.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.808+0000 7fd825d9b700 1 -- 172.21.15.1:0/2573034549 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000be30 con 0x7fd828154e70 2023-11-15T01:36:07.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.809+0000 7fd82d24e700 1 -- 172.21.15.1:0/2573034549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd828154e70 msgr2=0x7fd8281552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:07.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.809+0000 7fd82d24e700 1 --2- 172.21.15.1:0/2573034549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd828154e70 0x7fd8281552c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd820009e90 tx=0x7fd820009780).stop 2023-11-15T01:36:07.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.809+0000 7fd82d24e700 1 -- 172.21.15.1:0/2573034549 shutdown_connections 2023-11-15T01:36:07.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.809+0000 7fd82d24e700 1 --2- 172.21.15.1:0/2573034549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd828154e70 0x7fd8281552c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.809+0000 7fd82d24e700 1 -- 172.21.15.1:0/2573034549 >> 172.21.15.1:0/2573034549 conn(0x7fd8280c7d70 msgr2=0x7fd8280c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:07.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.809+0000 7fd82d24e700 1 -- 172.21.15.1:0/2573034549 shutdown_connections 2023-11-15T01:36:07.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.809+0000 7fd82d24e700 1 -- 172.21.15.1:0/2573034549 wait complete. 2023-11-15T01:36:07.815 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:07.810+0000 7f6515ce8680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:36:07.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.810+0000 7fd82d24e700 1 Processor -- start 2023-11-15T01:36:07.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.810+0000 7fd82d24e700 1 -- start start 2023-11-15T01:36:07.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd82d24e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8280bdfb0 0x7fd8280ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd82d24e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8280be390 0x7fd82813dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd82d24e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd828154e70 0x7fd82814f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd82d24e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8280c5820 con 0x7fd828154e70 2023-11-15T01:36:07.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd82d24e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8280ace80 con 0x7fd8280be390 2023-11-15T01:36:07.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd82d24e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8280c52a0 con 0x7fd8280bdfb0 2023-11-15T01:36:07.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd82759e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd828154e70 0x7fd82814f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:07.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd82759e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd828154e70 0x7fd82814f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56292/0 (socket says 172.21.15.1:56292) 2023-11-15T01:36:07.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd82759e700 1 -- 172.21.15.1:0/3994413624 learned_addr learned my addr 172.21.15.1:0/3994413624 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:07.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd826d9d700 1 --2- 172.21.15.1:0/3994413624 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8280bdfb0 0x7fd8280ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:07.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd82659c700 1 --2- 172.21.15.1:0/3994413624 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8280be390 0x7fd82813dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:07.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd82759e700 1 -- 172.21.15.1:0/3994413624 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8280bdfb0 msgr2=0x7fd8280ac990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:07.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd82759e700 1 --2- 172.21.15.1:0/3994413624 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8280bdfb0 0x7fd8280ac990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd82759e700 1 -- 172.21.15.1:0/3994413624 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8280be390 msgr2=0x7fd82813dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:07.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd82759e700 1 --2- 172.21.15.1:0/3994413624 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8280be390 0x7fd82813dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.811+0000 7fd82759e700 1 -- 172.21.15.1:0/3994413624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd820009a20 con 0x7fd828154e70 2023-11-15T01:36:07.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.812+0000 7fd82759e700 1 --2- 172.21.15.1:0/3994413624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd828154e70 0x7fd82814f560 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fd828155fa0 tx=0x7fd820009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:07.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.812+0000 7fd81effd700 1 -- 172.21.15.1:0/3994413624 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82001d630 con 0x7fd828154e70 2023-11-15T01:36:07.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.812+0000 7fd81effd700 1 -- 172.21.15.1:0/3994413624 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82001d790 con 0x7fd828154e70 2023-11-15T01:36:07.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.812+0000 7fd82d24e700 1 -- 172.21.15.1:0/3994413624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8280c5540 con 0x7fd828154e70 2023-11-15T01:36:07.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.812+0000 7fd81effd700 1 -- 172.21.15.1:0/3994413624 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82001db50 con 0x7fd828154e70 2023-11-15T01:36:07.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.812+0000 7fd82d24e700 1 -- 172.21.15.1:0/3994413624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8280c4ec0 con 0x7fd828154e70 2023-11-15T01:36:07.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.813+0000 7fd82d24e700 1 -- 172.21.15.1:0/3994413624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd828143830 con 0x7fd828154e70 2023-11-15T01:36:07.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.813+0000 7fd81effd700 1 -- 172.21.15.1:0/3994413624 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fd820003040 con 0x7fd828154e70 2023-11-15T01:36:07.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.814+0000 7fd81effd700 1 --2- 172.21.15.1:0/3994413624 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd80805f270 0x7fd808061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:07.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.814+0000 7fd81effd700 1 -- 172.21.15.1:0/3994413624 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6947+0+0 (secure 0 0 0) 0x7fd82007c600 con 0x7fd828154e70 2023-11-15T01:36:07.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.814+0000 7fd826d9d700 1 -- 172.21.15.1:0/3994413624 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd80805f270 msgr2=0x7fd808061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:07.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.814+0000 7fd826d9d700 1 --2- 172.21.15.1:0/3994413624 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd80805f270 0x7fd808061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:07.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.818+0000 7fd81effd700 1 -- 172.21.15.1:0/3994413624 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd82004d410 con 0x7fd828154e70 2023-11-15T01:36:07.934 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:07.934+0000 7f6515ce8680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:36:07.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.992+0000 7fd82d24e700 1 -- 172.21.15.1:0/3994413624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd82806c7e0 con 0x7fd828154e70 2023-11-15T01:36:07.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.993+0000 7fd81effd700 1 -- 172.21.15.1:0/3994413624 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18150 (secure 0 0 0) 0x7fd820050a30 con 0x7fd828154e70 2023-11-15T01:36:07.994 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:07.994 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":65,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:36:06.879175+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:33:54.494299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-15T01:33:55.821335+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":65,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"8.1a","mappings":[{"from":0,"to":1}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:6833/90546":"2023-11-16T01:34:13.098171+0000","172.21.15.141:6832/90546":"2023-11-16T01:34:13.098171+0000","172.21.15.141:0/319645857":"2023-11-16T01:34:13.098171+0000","172.21.15.141:0/380022886":"2023-11-16T01:34:13.098171+0000","172.21.15.141:0/3570210448":"2023-11-16T01:34:13.098171+0000","172.21.15.141:0/3619913227":"2023-11-16T01:34:13.098171+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:36:07.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.995+0000 7fd82d24e700 1 -- 172.21.15.1:0/3994413624 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd80805f270 msgr2=0x7fd808061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:07.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.995+0000 7fd82d24e700 1 --2- 172.21.15.1:0/3994413624 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd80805f270 0x7fd808061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:07.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.995+0000 7fd82d24e700 1 -- 172.21.15.1:0/3994413624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd828154e70 msgr2=0x7fd82814f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:07.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.995+0000 7fd82d24e700 1 --2- 172.21.15.1:0/3994413624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd828154e70 0x7fd82814f560 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fd828155fa0 tx=0x7fd820009780).stop 2023-11-15T01:36:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.995+0000 7fd82d24e700 1 -- 172.21.15.1:0/3994413624 shutdown_connections 2023-11-15T01:36:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.995+0000 7fd82d24e700 1 --2- 172.21.15.1:0/3994413624 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd80805f270 0x7fd808061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.995+0000 7fd82d24e700 1 --2- 172.21.15.1:0/3994413624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd828154e70 0x7fd82814f560 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.995+0000 7fd82d24e700 1 --2- 172.21.15.1:0/3994413624 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8280bdfb0 0x7fd8280ac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.995+0000 7fd82d24e700 1 --2- 172.21.15.1:0/3994413624 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8280be390 0x7fd82813dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.995+0000 7fd82d24e700 1 -- 172.21.15.1:0/3994413624 >> 172.21.15.1:0/3994413624 conn(0x7fd8280c7d70 msgr2=0x7fd8280c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.995+0000 7fd82d24e700 1 -- 172.21.15.1:0/3994413624 shutdown_connections 2023-11-15T01:36:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:07.995+0000 7fd82d24e700 1 -- 172.21.15.1:0/3994413624 wait complete. 2023-11-15T01:36:08.008 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-15T01:36:08.027 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:08.027+0000 7f02c10a9680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:36:08.051 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:08.051+0000 7f6515ce8680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:36:08.097 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:08.096+0000 7f02c10a9680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:36:08.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.135+0000 7f3ac1a48700 1 Processor -- start 2023-11-15T01:36:08.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.135+0000 7f3ac1a48700 1 -- start start 2023-11-15T01:36:08.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.135+0000 7f3ac1a48700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3abc0ad370 0x7f3abc0aa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:08.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.135+0000 7f3ac1a48700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3abc0aab30 0x7f3abc0627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:08.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.135+0000 7f3ac1a48700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3abc0acee0 con 0x7f3abc155610 2023-11-15T01:36:08.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.135+0000 7f3ac1a48700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc069820 con 0x7f3abc0ad370 2023-11-15T01:36:08.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.135+0000 7f3ac1a48700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc0ac890 con 0x7f3abc0aab30 2023-11-15T01:36:08.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.136+0000 7f3aba7fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3abc0ad370 0x7f3abc0aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:08.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.136+0000 7f3aba7fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3abc0ad370 0x7f3abc0aa640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56308/0 (socket says 172.21.15.1:56308) 2023-11-15T01:36:08.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.136+0000 7f3aba7fc700 1 -- 172.21.15.1:0/3997785797 learned_addr learned my addr 172.21.15.1:0/3997785797 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:08.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.136+0000 7f3abaffd700 1 --1- 172.21.15.1:0/3997785797 >> v1:172.21.15.1:6789/0 conn(0x7f3abc155610 0x7f3abc068dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52966/0 (socket says 172.21.15.1:52966) 2023-11-15T01:36:08.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.136+0000 7f3abb7fe700 1 --2- 172.21.15.1:0/3997785797 >> v2:172.21.15.141:3300/0 conn(0x7f3abc0aab30 0x7f3abc0627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:08.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.136+0000 7f3ab9ffb700 1 -- 172.21.15.1:0/3997785797 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260416769 0 0) 0x7f3abc0acee0 con 0x7f3abc155610 2023-11-15T01:36:08.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.136+0000 7f3ab9ffb700 1 -- 172.21.15.1:0/3997785797 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aa40033f0 con 0x7f3abc155610 2023-11-15T01:36:08.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.136+0000 7f3aba7fc700 1 -- 172.21.15.1:0/3997785797 >> v2:172.21.15.141:3300/0 conn(0x7f3abc0aab30 msgr2=0x7f3abc0627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:08.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.136+0000 7f3aba7fc700 1 --2- 172.21.15.1:0/3997785797 >> v2:172.21.15.141:3300/0 conn(0x7f3abc0aab30 0x7f3abc0627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:08.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.136+0000 7f3aba7fc700 1 -- 172.21.15.1:0/3997785797 >> v1:172.21.15.1:6789/0 conn(0x7f3abc155610 legacy=0x7f3abc068dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:08.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.136+0000 7f3aba7fc700 1 -- 172.21.15.1:0/3997785797 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc0acb70 con 0x7f3abc0ad370 2023-11-15T01:36:08.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.136+0000 7f3aba7fc700 1 --2- 172.21.15.1:0/3997785797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc0ad370 0x7f3abc0aa640 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f3abc0ad7f0 tx=0x7f3aac0090f0).ready entity=mon.0 client_cookie=58b266826e07cacd server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:08.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.136+0000 7f3ab9ffb700 1 -- 172.21.15.1:0/3997785797 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac00b520 con 0x7f3abc0ad370 2023-11-15T01:36:08.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.136+0000 7f3ab9ffb700 1 -- 172.21.15.1:0/3997785797 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac00b680 con 0x7f3abc0ad370 2023-11-15T01:36:08.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.136+0000 7f3ab9ffb700 1 -- 172.21.15.1:0/3997785797 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac00ba00 con 0x7f3abc0ad370 2023-11-15T01:36:08.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.137+0000 7f3ac1a48700 1 -- 172.21.15.1:0/3997785797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc0ad370 msgr2=0x7f3abc0aa640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:08.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.137+0000 7f3ac1a48700 1 --2- 172.21.15.1:0/3997785797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc0ad370 0x7f3abc0aa640 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f3abc0ad7f0 tx=0x7f3aac0090f0).stop 2023-11-15T01:36:08.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.137+0000 7f3ac1a48700 1 -- 172.21.15.1:0/3997785797 shutdown_connections 2023-11-15T01:36:08.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.137+0000 7f3ac1a48700 1 --2- 172.21.15.1:0/3997785797 >> v2:172.21.15.141:3300/0 conn(0x7f3abc0aab30 0x7f3abc0627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:08.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.137+0000 7f3ac1a48700 1 --2- 172.21.15.1:0/3997785797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc0ad370 0x7f3abc0aa640 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:08.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.137+0000 7f3ac1a48700 1 -- 172.21.15.1:0/3997785797 >> 172.21.15.1:0/3997785797 conn(0x7f3abc0c74f0 msgr2=0x7f3abc0c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:08.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.137+0000 7f3ac1a48700 1 -- 172.21.15.1:0/3997785797 shutdown_connections 2023-11-15T01:36:08.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.137+0000 7f3ac1a48700 1 -- 172.21.15.1:0/3997785797 wait complete. 2023-11-15T01:36:08.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.138+0000 7f3ac1a48700 1 Processor -- start 2023-11-15T01:36:08.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.138+0000 7f3ac1a48700 1 -- start start 2023-11-15T01:36:08.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.139+0000 7f3ac1a48700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3abc0aab30 0x7f3abc0bf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:08.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.139+0000 7f3ac1a48700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc0ad370 0x7f3abc14dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:08.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.139+0000 7f3ac1a48700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3abc155610 0x7f3abc1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:08.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.139+0000 7f3ac1a48700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc0bfe70 con 0x7f3abc0ad370 2023-11-15T01:36:08.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.139+0000 7f3ac1a48700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc156b30 con 0x7f3abc155610 2023-11-15T01:36:08.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.139+0000 7f3ac1a48700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc156290 con 0x7f3abc0aab30 2023-11-15T01:36:08.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.139+0000 7f3aba7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc0ad370 0x7f3abc14dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:08.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.139+0000 7f3aba7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc0ad370 0x7f3abc14dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56316/0 (socket says 172.21.15.1:56316) 2023-11-15T01:36:08.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.139+0000 7f3aba7fc700 1 -- 172.21.15.1:0/2499821558 learned_addr learned my addr 172.21.15.1:0/2499821558 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:08.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.139+0000 7f3abb7fe700 1 --2- 172.21.15.1:0/2499821558 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3abc155610 0x7f3abc1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:08.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.139+0000 7f3abaffd700 1 --2- 172.21.15.1:0/2499821558 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3abc0aab30 0x7f3abc0bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:08.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.140+0000 7f3aba7fc700 1 -- 172.21.15.1:0/2499821558 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3abc0aab30 msgr2=0x7f3abc0bf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:08.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.140+0000 7f3aba7fc700 1 --2- 172.21.15.1:0/2499821558 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3abc0aab30 0x7f3abc0bf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:08.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.140+0000 7f3aba7fc700 1 -- 172.21.15.1:0/2499821558 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3abc155610 msgr2=0x7f3abc1559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:08.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.140+0000 7f3aba7fc700 1 --2- 172.21.15.1:0/2499821558 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3abc155610 0x7f3abc1559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:08.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.140+0000 7f3aba7fc700 1 -- 172.21.15.1:0/2499821558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac009370 con 0x7f3abc0ad370 2023-11-15T01:36:08.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.140+0000 7f3aba7fc700 1 --2- 172.21.15.1:0/2499821558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc0ad370 0x7f3abc14dcc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f3aac009130 tx=0x7f3aac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:08.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.140+0000 7f3aa2ffd700 1 -- 172.21.15.1:0/2499821558 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac000bc0 con 0x7f3abc0ad370 2023-11-15T01:36:08.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.140+0000 7f3aa2ffd700 1 -- 172.21.15.1:0/2499821558 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac00b7f0 con 0x7f3abc0ad370 2023-11-15T01:36:08.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.140+0000 7f3ac1a48700 1 -- 172.21.15.1:0/2499821558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3abc156570 con 0x7f3abc0ad370 2023-11-15T01:36:08.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.140+0000 7f3aa2ffd700 1 -- 172.21.15.1:0/2499821558 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac000d20 con 0x7f3abc0ad370 2023-11-15T01:36:08.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.140+0000 7f3ac1a48700 1 -- 172.21.15.1:0/2499821558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3abc14e1b0 con 0x7f3abc0ad370 2023-11-15T01:36:08.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.141+0000 7f3aa2ffd700 1 -- 172.21.15.1:0/2499821558 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 22) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f3aac01c880 con 0x7f3abc0ad370 2023-11-15T01:36:08.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.141+0000 7f3ac1a48700 1 -- 172.21.15.1:0/2499821558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3abc0bffe0 con 0x7f3abc0ad370 2023-11-15T01:36:08.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.142+0000 7f3aa2ffd700 1 -- 172.21.15.1:0/2499821558 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7091+0+0 (secure 0 0 0) 0x7f3aac07bf40 con 0x7f3abc0ad370 2023-11-15T01:36:08.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.146+0000 7f3aa2ffd700 1 -- 172.21.15.1:0/2499821558 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3aac04cfb0 con 0x7f3abc0ad370 2023-11-15T01:36:08.179 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:08.178+0000 7f023b039700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:08.179 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:08.178+0000 7f023b039700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:08.179 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:08.178+0000 7f023b039700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:08.179 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:08.178+0000 7f023b039700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:08.180 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:08.178+0000 7f023b039700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:08.180 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:08.178+0000 7f023e03f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:08.180 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:08.178+0000 7f023e03f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:08.180 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:08.178+0000 7f023e03f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:08.181 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:08.178+0000 7f023e03f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:08.181 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:08.178+0000 7f023e03f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:08.370 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:08.370+0000 7f6515ce8680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:36:08.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:08.375+0000 7f3ac1a48700 1 -- 172.21.15.1:0/2499821558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3abc06c7e0 con 0x7f3abc0ad370 2023-11-15T01:36:08.448 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:08.447+0000 7f6515ce8680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:36:09.114 INFO:tasks.ceph.mon.a.smithi001.stderr:2023-11-15T01:36:09.112+0000 7f8072214700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-15T01:36:09.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.115+0000 7f3aa2ffd700 1 -- 172.21.15.1:0/2499821558 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3aac02a070 con 0x7f3abc0ad370 2023-11-15T01:36:09.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.118+0000 7f3ac1a48700 1 -- 172.21.15.1:0/2499821558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc0ad370 msgr2=0x7f3abc14dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:09.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.118+0000 7f3ac1a48700 1 --2- 172.21.15.1:0/2499821558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc0ad370 0x7f3abc14dcc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f3aac009130 tx=0x7f3aac017000).stop 2023-11-15T01:36:09.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.118+0000 7f3ac1a48700 1 -- 172.21.15.1:0/2499821558 shutdown_connections 2023-11-15T01:36:09.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.118+0000 7f3ac1a48700 1 --2- 172.21.15.1:0/2499821558 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3abc155610 0x7f3abc1559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:09.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.118+0000 7f3ac1a48700 1 --2- 172.21.15.1:0/2499821558 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3abc0aab30 0x7f3abc0bf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:09.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.118+0000 7f3ac1a48700 1 --2- 172.21.15.1:0/2499821558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc0ad370 0x7f3abc14dcc0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:09.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.118+0000 7f3ac1a48700 1 -- 172.21.15.1:0/2499821558 >> 172.21.15.1:0/2499821558 conn(0x7f3abc0c74f0 msgr2=0x7f3abc0655d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:09.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.118+0000 7f3ac1a48700 1 -- 172.21.15.1:0/2499821558 shutdown_connections 2023-11-15T01:36:09.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.118+0000 7f3ac1a48700 1 -- 172.21.15.1:0/2499821558 wait complete. 2023-11-15T01:36:09.121 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-15T01:36:09.136 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-15T01:36:09.153 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T01:36:09.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.299+0000 7f0c1a1f5700 1 Processor -- start 2023-11-15T01:36:09.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.299+0000 7f0c1a1f5700 1 -- start start 2023-11-15T01:36:09.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.300+0000 7f0c1a1f5700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0c141541d0 0x7f0c141545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:09.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.300+0000 7f0c1a1f5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0c140c8170 0x7f0c140c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:09.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.300+0000 7f0c1a1f5700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c14155830 con 0x7f0c140c60d0 2023-11-15T01:36:09.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.300+0000 7f0c1a1f5700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c14158f40 con 0x7f0c140c8170 2023-11-15T01:36:09.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.300+0000 7f0c1a1f5700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c14154c20 con 0x7f0c141541d0 2023-11-15T01:36:09.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.300+0000 7f0c199f4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0c140c8170 0x7f0c140c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:09.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.300+0000 7f0c189f2700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0c140c60d0 0x7f0c140c7a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52980/0 (socket says 172.21.15.1:52980) 2023-11-15T01:36:09.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.300+0000 7f0c189f2700 1 -- 172.21.15.1:0/1766013638 learned_addr learned my addr 172.21.15.1:0/1766013638 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:09.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.300+0000 7f0c191f3700 1 --2- 172.21.15.1:0/1766013638 >> v2:172.21.15.141:3300/0 conn(0x7f0c141541d0 0x7f0c141545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:09.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.300+0000 7f0c199f4700 1 -- 172.21.15.1:0/1766013638 >> v2:172.21.15.141:3300/0 conn(0x7f0c141541d0 msgr2=0x7f0c141545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:09.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.300+0000 7f0c199f4700 1 --2- 172.21.15.1:0/1766013638 >> v2:172.21.15.141:3300/0 conn(0x7f0c141541d0 0x7f0c141545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:09.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.300+0000 7f0c199f4700 1 -- 172.21.15.1:0/1766013638 >> v1:172.21.15.1:6789/0 conn(0x7f0c140c60d0 legacy=0x7f0c140c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:09.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.300+0000 7f0c13fff700 1 -- 172.21.15.1:0/1766013638 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220704041 0 0) 0x7f0c14155830 con 0x7f0c140c60d0 2023-11-15T01:36:09.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.300+0000 7f0c199f4700 1 -- 172.21.15.1:0/1766013638 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c14154f00 con 0x7f0c140c8170 2023-11-15T01:36:09.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.301+0000 7f0c199f4700 1 --2- 172.21.15.1:0/1766013638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c140c8170 0x7f0c140c6550 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f0c140c2150 tx=0x7f0c04009780).ready entity=mon.0 client_cookie=f8caeb3c410bc653 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:09.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.301+0000 7f0c13fff700 1 -- 172.21.15.1:0/1766013638 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0400e070 con 0x7f0c140c8170 2023-11-15T01:36:09.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.301+0000 7f0c13fff700 1 -- 172.21.15.1:0/1766013638 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0400bc30 con 0x7f0c140c8170 2023-11-15T01:36:09.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.301+0000 7f0c13fff700 1 -- 172.21.15.1:0/1766013638 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04012410 con 0x7f0c140c8170 2023-11-15T01:36:09.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.301+0000 7f0c1a1f5700 1 -- 172.21.15.1:0/1766013638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c140c8170 msgr2=0x7f0c140c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:09.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.301+0000 7f0c1a1f5700 1 --2- 172.21.15.1:0/1766013638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c140c8170 0x7f0c140c6550 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f0c140c2150 tx=0x7f0c04009780).stop 2023-11-15T01:36:09.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.301+0000 7f0c1a1f5700 1 -- 172.21.15.1:0/1766013638 shutdown_connections 2023-11-15T01:36:09.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.301+0000 7f0c1a1f5700 1 --2- 172.21.15.1:0/1766013638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c140c8170 0x7f0c140c6550 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:09.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.301+0000 7f0c1a1f5700 1 --2- 172.21.15.1:0/1766013638 >> v2:172.21.15.141:3300/0 conn(0x7f0c141541d0 0x7f0c141545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:09.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.301+0000 7f0c1a1f5700 1 -- 172.21.15.1:0/1766013638 >> 172.21.15.1:0/1766013638 conn(0x7f0c14069ee0 msgr2=0x7f0c1406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:09.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.301+0000 7f0c1a1f5700 1 -- 172.21.15.1:0/1766013638 shutdown_connections 2023-11-15T01:36:09.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.301+0000 7f0c1a1f5700 1 -- 172.21.15.1:0/1766013638 wait complete. 2023-11-15T01:36:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.302+0000 7f0c1a1f5700 1 Processor -- start 2023-11-15T01:36:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.303+0000 7f0c1a1f5700 1 -- start start 2023-11-15T01:36:09.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.303+0000 7f0c1a1f5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c140c60d0 0x7f0c14153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:09.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.303+0000 7f0c1a1f5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c140c8170 0x7f0c14165fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:09.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.303+0000 7f0c1a1f5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c141541d0 0x7f0c140c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:09.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.303+0000 7f0c1a1f5700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c14165dd0 con 0x7f0c140c8170 2023-11-15T01:36:09.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.303+0000 7f0c1a1f5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c140c22f0 con 0x7f0c141541d0 2023-11-15T01:36:09.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.303+0000 7f0c1a1f5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c140c25d0 con 0x7f0c140c60d0 2023-11-15T01:36:09.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c189f2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c140c8170 0x7f0c14165fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:09.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c189f2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c140c8170 0x7f0c14165fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56340/0 (socket says 172.21.15.1:56340) 2023-11-15T01:36:09.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c189f2700 1 -- 172.21.15.1:0/2402913061 learned_addr learned my addr 172.21.15.1:0/2402913061 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:09.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c191f3700 1 --2- 172.21.15.1:0/2402913061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c140c60d0 0x7f0c14153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c199f4700 1 --2- 172.21.15.1:0/2402913061 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c141541d0 0x7f0c140c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c189f2700 1 -- 172.21.15.1:0/2402913061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c140c60d0 msgr2=0x7f0c14153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c189f2700 1 --2- 172.21.15.1:0/2402913061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c140c60d0 0x7f0c14153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c189f2700 1 -- 172.21.15.1:0/2402913061 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c141541d0 msgr2=0x7f0c140c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c189f2700 1 --2- 172.21.15.1:0/2402913061 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c141541d0 0x7f0c140c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c189f2700 1 -- 172.21.15.1:0/2402913061 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c04009a20 con 0x7f0c140c8170 2023-11-15T01:36:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c199f4700 1 --2- 172.21.15.1:0/2402913061 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c141541d0 0x7f0c140c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c189f2700 1 --2- 172.21.15.1:0/2402913061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c140c8170 0x7f0c14165fb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f0c0800c4e0 tx=0x7f0c08007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c117fa700 1 -- 172.21.15.1:0/2402913061 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c080072e0 con 0x7f0c140c8170 2023-11-15T01:36:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c117fa700 1 -- 172.21.15.1:0/2402913061 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c08007440 con 0x7f0c140c8170 2023-11-15T01:36:09.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c1a1f5700 1 -- 172.21.15.1:0/2402913061 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c140c28b0 con 0x7f0c140c8170 2023-11-15T01:36:09.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c117fa700 1 -- 172.21.15.1:0/2402913061 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c080057a0 con 0x7f0c140c8170 2023-11-15T01:36:09.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.304+0000 7f0c1a1f5700 1 -- 172.21.15.1:0/2402913061 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c141536f0 con 0x7f0c140c8170 2023-11-15T01:36:09.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.305+0000 7f0c1a1f5700 1 -- 172.21.15.1:0/2402913061 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c140475e0 con 0x7f0c140c8170 2023-11-15T01:36:09.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.305+0000 7f0c117fa700 1 -- 172.21.15.1:0/2402913061 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 23) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f0c08005bd0 con 0x7f0c140c8170 2023-11-15T01:36:09.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.306+0000 7f0c117fa700 1 --2- 172.21.15.1:0/2402913061 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0c0005f030 0x7f0c000614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:09.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.306+0000 7f0c117fa700 1 -- 172.21.15.1:0/2402913061 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7177+0+0 (secure 0 0 0) 0x7f0c08079d00 con 0x7f0c140c8170 2023-11-15T01:36:09.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.306+0000 7f0c191f3700 1 --2- 172.21.15.1:0/2402913061 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0c0005f030 0x7f0c000614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:09.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.306+0000 7f0c191f3700 1 --2- 172.21.15.1:0/2402913061 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0c0005f030 0x7f0c000614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f0c0c006fd0 tx=0x7f0c0c008040).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:09.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.310+0000 7f0c117fa700 1 -- 172.21.15.1:0/2402913061 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0c0807d030 con 0x7f0c140c8170 2023-11-15T01:36:09.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:09.528+0000 7f0c1a1f5700 1 -- 172.21.15.1:0/2402913061 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0c141551e0 con 0x7f0c140c8170 2023-11-15T01:36:10.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.124+0000 7f0c117fa700 1 -- 172.21.15.1:0/2402913061 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0c0804ad80 con 0x7f0c140c8170 2023-11-15T01:36:10.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.126+0000 7f0c1a1f5700 1 -- 172.21.15.1:0/2402913061 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0c0005f030 msgr2=0x7f0c000614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.126+0000 7f0c1a1f5700 1 --2- 172.21.15.1:0/2402913061 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0c0005f030 0x7f0c000614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f0c0c006fd0 tx=0x7f0c0c008040).stop 2023-11-15T01:36:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.126+0000 7f0c1a1f5700 1 -- 172.21.15.1:0/2402913061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c140c8170 msgr2=0x7f0c14165fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.126+0000 7f0c1a1f5700 1 --2- 172.21.15.1:0/2402913061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c140c8170 0x7f0c14165fb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f0c0800c4e0 tx=0x7f0c08007c70).stop 2023-11-15T01:36:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.126+0000 7f0c1a1f5700 1 -- 172.21.15.1:0/2402913061 shutdown_connections 2023-11-15T01:36:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.126+0000 7f0c1a1f5700 1 --2- 172.21.15.1:0/2402913061 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0c0005f030 0x7f0c000614f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:10.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.126+0000 7f0c1a1f5700 1 --2- 172.21.15.1:0/2402913061 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c141541d0 0x7f0c140c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:10.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.126+0000 7f0c1a1f5700 1 --2- 172.21.15.1:0/2402913061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c140c60d0 0x7f0c14153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:10.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.126+0000 7f0c1a1f5700 1 --2- 172.21.15.1:0/2402913061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c140c8170 0x7f0c14165fb0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:10.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.126+0000 7f0c1a1f5700 1 -- 172.21.15.1:0/2402913061 >> 172.21.15.1:0/2402913061 conn(0x7f0c14069ee0 msgr2=0x7f0c140ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:10.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.126+0000 7f0c1a1f5700 1 -- 172.21.15.1:0/2402913061 shutdown_connections 2023-11-15T01:36:10.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.126+0000 7f0c1a1f5700 1 -- 172.21.15.1:0/2402913061 wait complete. 2023-11-15T01:36:10.141 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-15T01:36:10.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.267+0000 7f31fe21a700 1 Processor -- start 2023-11-15T01:36:10.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.267+0000 7f31fe21a700 1 -- start start 2023-11-15T01:36:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.267+0000 7f31fe21a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31f80c3510 0x7f31f80c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.267+0000 7f31fe21a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f31f8064660 0x7f31f8064ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.267+0000 7f31fe21a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f80835c0 con 0x7f31f80c53b0 2023-11-15T01:36:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.267+0000 7f31fe21a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f80c3970 con 0x7f31f8064660 2023-11-15T01:36:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.267+0000 7f31fe21a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80c5790 con 0x7f31f80c3510 2023-11-15T01:36:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f77fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f31f80c53b0 0x7f31f80c7f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52984/0 (socket says 172.21.15.1:52984) 2023-11-15T01:36:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f77fe700 1 -- 172.21.15.1:0/1082966762 learned_addr learned my addr 172.21.15.1:0/1082966762 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 -- 172.21.15.1:0/1082966762 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589174142 0 0) 0x7f31f80835c0 con 0x7f31f80c53b0 2023-11-15T01:36:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f7fff700 1 --2- 172.21.15.1:0/1082966762 >> v2:172.21.15.141:3300/0 conn(0x7f31f8064660 0x7f31f8064ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f6ffd700 1 --2- 172.21.15.1:0/1082966762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31f80c3510 0x7f31f80c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 -- 172.21.15.1:0/1082966762 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e00033f0 con 0x7f31f80c53b0 2023-11-15T01:36:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 -- 172.21.15.1:0/1082966762 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3809384019 0 0) 0x7f31e00033f0 con 0x7f31f80c53b0 2023-11-15T01:36:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 -- 172.21.15.1:0/1082966762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31f80c3510 msgr2=0x7f31f80c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 --2- 172.21.15.1:0/1082966762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31f80c3510 0x7f31f80c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 -- 172.21.15.1:0/1082966762 >> v2:172.21.15.141:3300/0 conn(0x7f31f8064660 msgr2=0x7f31f8064ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 --2- 172.21.15.1:0/1082966762 >> v2:172.21.15.141:3300/0 conn(0x7f31f8064660 0x7f31f8064ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 -- 172.21.15.1:0/1082966762 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f80c6eb0 con 0x7f31f80c53b0 2023-11-15T01:36:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 -- 172.21.15.1:0/1082966762 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f31e80015f0 con 0x7f31f80c53b0 2023-11-15T01:36:10.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 -- 172.21.15.1:0/1082966762 >> v1:172.21.15.1:6789/0 conn(0x7f31f80c53b0 legacy=0x7f31f80c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:10.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 --2- 172.21.15.1:0/1082966762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00038e0 0x7f31e0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:10.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 --2- 172.21.15.1:0/1082966762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31f80c3510 0x7f31e0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:10.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 --2- 172.21.15.1:0/1082966762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31e0004b80 0x7f31e0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:10.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 -- 172.21.15.1:0/1082966762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80c3970 con 0x7f31e00038e0 2023-11-15T01:36:10.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 -- 172.21.15.1:0/1082966762 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80c5790 con 0x7f31e0004b80 2023-11-15T01:36:10.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f67fc700 1 -- 172.21.15.1:0/1082966762 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e000b8e0 con 0x7f31f80c3510 2023-11-15T01:36:10.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f77fe700 1 --2- 172.21.15.1:0/1082966762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00038e0 0x7f31e0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:10.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.268+0000 7f31f6ffd700 1 --2- 172.21.15.1:0/1082966762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31f80c3510 0x7f31e0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.269+0000 7f31f7fff700 1 --2- 172.21.15.1:0/1082966762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31e0004b80 0x7f31e0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.269+0000 7f31f77fe700 1 -- 172.21.15.1:0/1082966762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31f80c3510 msgr2=0x7f31e0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.269+0000 7f31f77fe700 1 --2- 172.21.15.1:0/1082966762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31f80c3510 0x7f31e0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.269+0000 7f31f77fe700 1 -- 172.21.15.1:0/1082966762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31e0004b80 msgr2=0x7f31e0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.269+0000 7f31f77fe700 1 --2- 172.21.15.1:0/1082966762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31e0004b80 0x7f31e0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:10.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.269+0000 7f31f77fe700 1 -- 172.21.15.1:0/1082966762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e00033f0 con 0x7f31e00038e0 2023-11-15T01:36:10.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.269+0000 7f31f77fe700 1 --2- 172.21.15.1:0/1082966762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00038e0 0x7f31e0003d00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f31e800c210 tx=0x7f31e80077a0).ready entity=mon.0 client_cookie=9a3941cfe13f2ec server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:10.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.269+0000 7f31f67fc700 1 -- 172.21.15.1:0/1082966762 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e80079d0 con 0x7f31e00038e0 2023-11-15T01:36:10.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.269+0000 7f31f67fc700 1 -- 172.21.15.1:0/1082966762 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e800cae0 con 0x7f31e00038e0 2023-11-15T01:36:10.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.269+0000 7f31f67fc700 1 -- 172.21.15.1:0/1082966762 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e800ce60 con 0x7f31e00038e0 2023-11-15T01:36:10.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.269+0000 7f31fe21a700 1 -- 172.21.15.1:0/1082966762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00038e0 msgr2=0x7f31e0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:10.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.269+0000 7f31fe21a700 1 --2- 172.21.15.1:0/1082966762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00038e0 0x7f31e0003d00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f31e800c210 tx=0x7f31e80077a0).stop 2023-11-15T01:36:10.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.269+0000 7f31f7fff700 1 -- 172.21.15.1:0/1082966762 reap_dead start 2023-11-15T01:36:10.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.270+0000 7f31fe21a700 1 -- 172.21.15.1:0/1082966762 shutdown_connections 2023-11-15T01:36:10.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.270+0000 7f31fe21a700 1 -- 172.21.15.1:0/1082966762 >> 172.21.15.1:0/1082966762 conn(0x7f31f8082f90 msgr2=0x7f31f80c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:10.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.270+0000 7f31fe21a700 1 -- 172.21.15.1:0/1082966762 shutdown_connections 2023-11-15T01:36:10.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.270+0000 7f31fe21a700 1 -- 172.21.15.1:0/1082966762 wait complete. 2023-11-15T01:36:10.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.271+0000 7f31fe21a700 1 Processor -- start 2023-11-15T01:36:10.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.271+0000 7f31fe21a700 1 -- start start 2023-11-15T01:36:10.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31fe21a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00038e0 0x7f31f815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:10.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31fe21a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31f815afe0 0x7f31f80a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:10.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31fe21a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31f80a8fa0 0x7f31f8153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:10.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31fe21a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80aac20 con 0x7f31e00038e0 2023-11-15T01:36:10.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31fe21a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80aaf00 con 0x7f31f815afe0 2023-11-15T01:36:10.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31fe21a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80ab1e0 con 0x7f31f80a8fa0 2023-11-15T01:36:10.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31f77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00038e0 0x7f31f815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:10.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31f77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00038e0 0x7f31f815aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56350/0 (socket says 172.21.15.1:56350) 2023-11-15T01:36:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31f77fe700 1 -- 172.21.15.1:0/1323518286 learned_addr learned my addr 172.21.15.1:0/1323518286 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31f6ffd700 1 --2- 172.21.15.1:0/1323518286 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31f815afe0 0x7f31f80a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31f7fff700 1 --2- 172.21.15.1:0/1323518286 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31f80a8fa0 0x7f31f8153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31f77fe700 1 -- 172.21.15.1:0/1323518286 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31f80a8fa0 msgr2=0x7f31f8153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31f77fe700 1 --2- 172.21.15.1:0/1323518286 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31f80a8fa0 0x7f31f8153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31f77fe700 1 -- 172.21.15.1:0/1323518286 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31f815afe0 msgr2=0x7f31f80a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31f77fe700 1 --2- 172.21.15.1:0/1323518286 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31f815afe0 0x7f31f80a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31f77fe700 1 -- 172.21.15.1:0/1323518286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f80ab4c0 con 0x7f31e00038e0 2023-11-15T01:36:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31f6ffd700 1 --2- 172.21.15.1:0/1323518286 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31f815afe0 0x7f31f80a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31f77fe700 1 --2- 172.21.15.1:0/1323518286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00038e0 0x7f31f815aaf0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f31e8000ef0 tx=0x7f31e8013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31df7fe700 1 -- 172.21.15.1:0/1323518286 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e80017d0 con 0x7f31e00038e0 2023-11-15T01:36:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31df7fe700 1 -- 172.21.15.1:0/1323518286 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e8001930 con 0x7f31e00038e0 2023-11-15T01:36:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31fe21a700 1 -- 172.21.15.1:0/1323518286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f80ab7a0 con 0x7f31e00038e0 2023-11-15T01:36:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31df7fe700 1 -- 172.21.15.1:0/1323518286 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8005880 con 0x7f31e00038e0 2023-11-15T01:36:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.272+0000 7f31fe21a700 1 -- 172.21.15.1:0/1323518286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f80aa890 con 0x7f31e00038e0 2023-11-15T01:36:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.273+0000 7f31fe21a700 1 -- 172.21.15.1:0/1323518286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f80ab960 con 0x7f31e00038e0 2023-11-15T01:36:10.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.274+0000 7f31df7fe700 1 -- 172.21.15.1:0/1323518286 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 23) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f31e8005c70 con 0x7f31e00038e0 2023-11-15T01:36:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.274+0000 7f31df7fe700 1 --2- 172.21.15.1:0/1323518286 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31e405f000 0x7f31e40614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.274+0000 7f31df7fe700 1 -- 172.21.15.1:0/1323518286 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 7177+0+0 (secure 0 0 0) 0x7f31e807abf0 con 0x7f31e00038e0 2023-11-15T01:36:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.274+0000 7f31f6ffd700 1 --2- 172.21.15.1:0/1323518286 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31e405f000 0x7f31e40614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.275+0000 7f31f6ffd700 1 --2- 172.21.15.1:0/1323518286 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31e405f000 0x7f31e40614c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f31f815b400 tx=0x7f31ec008040).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.278+0000 7f31df7fe700 1 -- 172.21.15.1:0/1323518286 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f31e804bc70 con 0x7f31e00038e0 2023-11-15T01:36:10.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:10.450+0000 7f31fe21a700 1 -- 172.21.15.1:0/1323518286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f31f80c4fc0 con 0x7f31e00038e0 2023-11-15T01:36:11.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.133+0000 7f31df7fe700 1 -- 172.21.15.1:0/1323518286 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f31e8078770 con 0x7f31e00038e0 2023-11-15T01:36:11.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.133+0000 7f31df7fe700 1 -- 172.21.15.1:0/1323518286 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) v1 ==== 181+0+0 (secure 0 0 0) 0x7f31e8074560 con 0x7f31e00038e0 2023-11-15T01:36:11.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.136+0000 7f31fe21a700 1 -- 172.21.15.1:0/1323518286 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31e405f000 msgr2=0x7f31e40614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:11.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.136+0000 7f31fe21a700 1 --2- 172.21.15.1:0/1323518286 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31e405f000 0x7f31e40614c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f31f815b400 tx=0x7f31ec008040).stop 2023-11-15T01:36:11.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.137+0000 7f31fe21a700 1 -- 172.21.15.1:0/1323518286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00038e0 msgr2=0x7f31f815aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:11.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.137+0000 7f31fe21a700 1 --2- 172.21.15.1:0/1323518286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00038e0 0x7f31f815aaf0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f31e8000ef0 tx=0x7f31e8013000).stop 2023-11-15T01:36:11.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.137+0000 7f31fe21a700 1 -- 172.21.15.1:0/1323518286 shutdown_connections 2023-11-15T01:36:11.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.137+0000 7f31fe21a700 1 --2- 172.21.15.1:0/1323518286 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31e405f000 0x7f31e40614c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:11.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.137+0000 7f31fe21a700 1 --2- 172.21.15.1:0/1323518286 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31f80a8fa0 0x7f31f8153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:11.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.137+0000 7f31fe21a700 1 --2- 172.21.15.1:0/1323518286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00038e0 0x7f31f815aaf0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:11.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.137+0000 7f31fe21a700 1 --2- 172.21.15.1:0/1323518286 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31f815afe0 0x7f31f80a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:11.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.137+0000 7f31fe21a700 1 -- 172.21.15.1:0/1323518286 >> 172.21.15.1:0/1323518286 conn(0x7f31f8082f90 msgr2=0x7f31f80c8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:11.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.137+0000 7f31fe21a700 1 -- 172.21.15.1:0/1323518286 shutdown_connections 2023-11-15T01:36:11.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.137+0000 7f31fe21a700 1 -- 172.21.15.1:0/1323518286 wait complete. 2023-11-15T01:36:11.141 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2023-11-15T01:36:11.155 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-15T01:36:11.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.291+0000 7fb85c945700 1 Processor -- start 2023-11-15T01:36:11.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.291+0000 7fb85c945700 1 -- start start 2023-11-15T01:36:11.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.292+0000 7fb85c945700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb8580ab1a0 0x7fb858154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:11.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.292+0000 7fb85c945700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8580aa060 0x7fb8580c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:11.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.292+0000 7fb85c945700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8580c06f0 con 0x7fb858154150 2023-11-15T01:36:11.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.292+0000 7fb85c945700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8580c09d0 con 0x7fb8580ab1a0 2023-11-15T01:36:11.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.292+0000 7fb85c945700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb858158820 con 0x7fb8580aa060 2023-11-15T01:36:11.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.292+0000 7fb855d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb8580ab1a0 0x7fb858154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:11.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.292+0000 7fb855d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb8580ab1a0 0x7fb858154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56358/0 (socket says 172.21.15.1:56358) 2023-11-15T01:36:11.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.292+0000 7fb855d9b700 1 -- 172.21.15.1:0/1311233301 learned_addr learned my addr 172.21.15.1:0/1311233301 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:11.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.292+0000 7fb856d9d700 1 --2- 172.21.15.1:0/1311233301 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8580aa060 0x7fb8580c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:11.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.292+0000 7fb855d9b700 1 -- 172.21.15.1:0/1311233301 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8580aa060 msgr2=0x7fb8580c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:11.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.292+0000 7fb855d9b700 1 --2- 172.21.15.1:0/1311233301 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8580aa060 0x7fb8580c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:11.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.292+0000 7fb855d9b700 1 -- 172.21.15.1:0/1311233301 >> v1:172.21.15.141:6789/0 conn(0x7fb858154150 legacy=0x7fb858158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:11.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.292+0000 7fb855d9b700 1 -- 172.21.15.1:0/1311233301 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858158b00 con 0x7fb8580ab1a0 2023-11-15T01:36:11.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.292+0000 7fb855d9b700 1 --2- 172.21.15.1:0/1311233301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8580ab1a0 0x7fb858154530 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fb84c006fd0 tx=0x7fb84c0090f0).ready entity=mon.0 client_cookie=e67793ff4f50033f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:11.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.293+0000 7fb85559a700 1 -- 172.21.15.1:0/1311233301 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00b600 con 0x7fb8580ab1a0 2023-11-15T01:36:11.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.293+0000 7fb85559a700 1 -- 172.21.15.1:0/1311233301 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c00b760 con 0x7fb8580ab1a0 2023-11-15T01:36:11.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.293+0000 7fb85559a700 1 -- 172.21.15.1:0/1311233301 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00bb00 con 0x7fb8580ab1a0 2023-11-15T01:36:11.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.293+0000 7fb85c945700 1 -- 172.21.15.1:0/1311233301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8580ab1a0 msgr2=0x7fb858154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:11.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.293+0000 7fb85c945700 1 --2- 172.21.15.1:0/1311233301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8580ab1a0 0x7fb858154530 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fb84c006fd0 tx=0x7fb84c0090f0).stop 2023-11-15T01:36:11.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.293+0000 7fb85c945700 1 -- 172.21.15.1:0/1311233301 shutdown_connections 2023-11-15T01:36:11.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.293+0000 7fb85c945700 1 --2- 172.21.15.1:0/1311233301 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8580aa060 0x7fb8580c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:11.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.293+0000 7fb85c945700 1 --2- 172.21.15.1:0/1311233301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8580ab1a0 0x7fb858154530 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:11.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.293+0000 7fb85c945700 1 -- 172.21.15.1:0/1311233301 >> 172.21.15.1:0/1311233301 conn(0x7fb858064aa0 msgr2=0x7fb858064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:11.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.293+0000 7fb85c945700 1 -- 172.21.15.1:0/1311233301 shutdown_connections 2023-11-15T01:36:11.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.293+0000 7fb85c945700 1 -- 172.21.15.1:0/1311233301 wait complete. 2023-11-15T01:36:11.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.294+0000 7fb85c945700 1 Processor -- start 2023-11-15T01:36:11.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.294+0000 7fb85c945700 1 -- start start 2023-11-15T01:36:11.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.295+0000 7fb85c945700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8580aa060 0x7fb8580b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:11.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.295+0000 7fb85c945700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8580ab1a0 0x7fb8580c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:11.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.295+0000 7fb85c945700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb858154150 0x7fb8580c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:11.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.295+0000 7fb85c945700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580c41b0 con 0x7fb8580ab1a0 2023-11-15T01:36:11.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.295+0000 7fb85c945700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580c35a0 con 0x7fb858154150 2023-11-15T01:36:11.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.295+0000 7fb85c945700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580c3880 con 0x7fb8580aa060 2023-11-15T01:36:11.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.295+0000 7fb855d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8580ab1a0 0x7fb8580c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:11.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.295+0000 7fb855d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8580ab1a0 0x7fb8580c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56364/0 (socket says 172.21.15.1:56364) 2023-11-15T01:36:11.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.295+0000 7fb855d9b700 1 -- 172.21.15.1:0/2880484361 learned_addr learned my addr 172.21.15.1:0/2880484361 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:11.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.296+0000 7fb856d9d700 1 --2- 172.21.15.1:0/2880484361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb858154150 0x7fb8580c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:11.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.296+0000 7fb85659c700 1 --2- 172.21.15.1:0/2880484361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8580aa060 0x7fb8580b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:11.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.296+0000 7fb855d9b700 1 -- 172.21.15.1:0/2880484361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8580aa060 msgr2=0x7fb8580b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:11.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.296+0000 7fb855d9b700 1 --2- 172.21.15.1:0/2880484361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8580aa060 0x7fb8580b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:11.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.296+0000 7fb855d9b700 1 -- 172.21.15.1:0/2880484361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb858154150 msgr2=0x7fb8580c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:11.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.296+0000 7fb855d9b700 1 --2- 172.21.15.1:0/2880484361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb858154150 0x7fb8580c2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:11.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.296+0000 7fb855d9b700 1 -- 172.21.15.1:0/2880484361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c009370 con 0x7fb8580ab1a0 2023-11-15T01:36:11.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.296+0000 7fb855d9b700 1 --2- 172.21.15.1:0/2880484361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8580ab1a0 0x7fb8580c2b00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fb858062af0 tx=0x7fb84c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:11.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.296+0000 7fb8467fc700 1 -- 172.21.15.1:0/2880484361 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00bec0 con 0x7fb8580ab1a0 2023-11-15T01:36:11.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.296+0000 7fb8467fc700 1 -- 172.21.15.1:0/2880484361 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c00b8d0 con 0x7fb8580ab1a0 2023-11-15T01:36:11.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.296+0000 7fb85c945700 1 -- 172.21.15.1:0/2880484361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8580c3b60 con 0x7fb8580ab1a0 2023-11-15T01:36:11.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.296+0000 7fb8467fc700 1 -- 172.21.15.1:0/2880484361 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c024470 con 0x7fb8580ab1a0 2023-11-15T01:36:11.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.296+0000 7fb85c945700 1 -- 172.21.15.1:0/2880484361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8580ca050 con 0x7fb8580ab1a0 2023-11-15T01:36:11.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.297+0000 7fb85c945700 1 -- 172.21.15.1:0/2880484361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8580c4000 con 0x7fb8580ab1a0 2023-11-15T01:36:11.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.297+0000 7fb8467fc700 1 -- 172.21.15.1:0/2880484361 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb84c021070 con 0x7fb8580ab1a0 2023-11-15T01:36:11.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.298+0000 7fb8467fc700 1 --2- 172.21.15.1:0/2880484361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb83805f270 0x7fb838061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:11.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.298+0000 7fb8467fc700 1 -- 172.21.15.1:0/2880484361 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6681+0+0 (secure 0 0 0) 0x7fb84c07c0e0 con 0x7fb8580ab1a0 2023-11-15T01:36:11.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.298+0000 7fb85659c700 1 --2- 172.21.15.1:0/2880484361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb83805f270 0x7fb838061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:11.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.298+0000 7fb85659c700 1 --2- 172.21.15.1:0/2880484361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb83805f270 0x7fb838061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fb848003630 tx=0x7fb848009040).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:11.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.302+0000 7fb8467fc700 1 -- 172.21.15.1:0/2880484361 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb84c04d000 con 0x7fb8580ab1a0 2023-11-15T01:36:11.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:11.473+0000 7fb85c945700 1 -- 172.21.15.1:0/2880484361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb85806c7e0 con 0x7fb8580ab1a0 2023-11-15T01:36:12.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.142+0000 7fb8467fc700 1 -- 172.21.15.1:0/2880484361 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v70) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb84c050620 con 0x7fb8580ab1a0 2023-11-15T01:36:12.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.148+0000 7fb85c945700 1 -- 172.21.15.1:0/2880484361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb83805f270 msgr2=0x7fb838061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.148+0000 7fb85c945700 1 --2- 172.21.15.1:0/2880484361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb83805f270 0x7fb838061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fb848003630 tx=0x7fb848009040).stop 2023-11-15T01:36:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.148+0000 7fb85c945700 1 -- 172.21.15.1:0/2880484361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8580ab1a0 msgr2=0x7fb8580c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.148+0000 7fb85c945700 1 --2- 172.21.15.1:0/2880484361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8580ab1a0 0x7fb8580c2b00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fb858062af0 tx=0x7fb84c017000).stop 2023-11-15T01:36:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.148+0000 7fb85c945700 1 -- 172.21.15.1:0/2880484361 shutdown_connections 2023-11-15T01:36:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.148+0000 7fb85c945700 1 --2- 172.21.15.1:0/2880484361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb83805f270 0x7fb838061730 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.148+0000 7fb85c945700 1 --2- 172.21.15.1:0/2880484361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb858154150 0x7fb8580c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.148+0000 7fb85c945700 1 --2- 172.21.15.1:0/2880484361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8580aa060 0x7fb8580b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.148+0000 7fb85c945700 1 --2- 172.21.15.1:0/2880484361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8580ab1a0 0x7fb8580c2b00 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.148+0000 7fb85c945700 1 -- 172.21.15.1:0/2880484361 >> 172.21.15.1:0/2880484361 conn(0x7fb858064aa0 msgr2=0x7fb858152e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:12.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.148+0000 7fb85c945700 1 -- 172.21.15.1:0/2880484361 shutdown_connections 2023-11-15T01:36:12.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.148+0000 7fb85c945700 1 -- 172.21.15.1:0/2880484361 wait complete. 2023-11-15T01:36:12.152 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2023-11-15T01:36:12.164 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-15T01:36:12.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.292+0000 7f17089bf700 1 Processor -- start 2023-11-15T01:36:12.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.292+0000 7f17089bf700 1 -- start start 2023-11-15T01:36:12.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.293+0000 7f17089bf700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f17040c4210 0x7f1704069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.293+0000 7f17089bf700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1704155320 con 0x7f17040c3e30 2023-11-15T01:36:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.293+0000 7f17089bf700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1704155600 con 0x7f1704154bf0 2023-11-15T01:36:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.293+0000 7f17089bf700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1704155bc0 con 0x7f17040c4210 2023-11-15T01:36:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.294+0000 7f1701d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f17040c4210 0x7f1704069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.294+0000 7f170259c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f17040c3e30 0x7f1704066cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52992/0 (socket says 172.21.15.1:52992) 2023-11-15T01:36:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.294+0000 7f170259c700 1 -- 172.21.15.1:0/1413511395 learned_addr learned my addr 172.21.15.1:0/1413511395 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:12.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.294+0000 7f1701d9b700 1 -- 172.21.15.1:0/1413511395 >> v1:172.21.15.141:6789/0 conn(0x7f1704154bf0 legacy=0x7f170413a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:12.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.294+0000 7f1701d9b700 1 -- 172.21.15.1:0/1413511395 >> v1:172.21.15.1:6789/0 conn(0x7f17040c3e30 legacy=0x7f1704066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.294+0000 7f1701d9b700 1 -- 172.21.15.1:0/1413511395 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17041558e0 con 0x7f17040c4210 2023-11-15T01:36:12.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.294+0000 7f1701d9b700 1 --2- 172.21.15.1:0/1413511395 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17040c4210 0x7f1704069ba0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f16ec009760 tx=0x7f16ec009060).ready entity=mon.0 client_cookie=499fa9777be07529 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:12.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.294+0000 7f170159a700 1 -- 172.21.15.1:0/1413511395 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00b520 con 0x7f17040c4210 2023-11-15T01:36:12.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.294+0000 7f170159a700 1 -- 172.21.15.1:0/1413511395 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec00b680 con 0x7f17040c4210 2023-11-15T01:36:12.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.294+0000 7f170159a700 1 -- 172.21.15.1:0/1413511395 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00ba00 con 0x7f17040c4210 2023-11-15T01:36:12.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.295+0000 7f17089bf700 1 -- 172.21.15.1:0/1413511395 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17040c4210 msgr2=0x7f1704069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.295+0000 7f17089bf700 1 --2- 172.21.15.1:0/1413511395 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17040c4210 0x7f1704069ba0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f16ec009760 tx=0x7f16ec009060).stop 2023-11-15T01:36:12.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.295+0000 7f17089bf700 1 -- 172.21.15.1:0/1413511395 shutdown_connections 2023-11-15T01:36:12.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.295+0000 7f17089bf700 1 --2- 172.21.15.1:0/1413511395 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17040c4210 0x7f1704069ba0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.295+0000 7f17089bf700 1 -- 172.21.15.1:0/1413511395 >> 172.21.15.1:0/1413511395 conn(0x7f17040c7dc0 msgr2=0x7f17040c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:12.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.295+0000 7f17089bf700 1 -- 172.21.15.1:0/1413511395 shutdown_connections 2023-11-15T01:36:12.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.295+0000 7f17089bf700 1 -- 172.21.15.1:0/1413511395 wait complete. 2023-11-15T01:36:12.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.296+0000 7f17089bf700 1 Processor -- start 2023-11-15T01:36:12.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.296+0000 7f17089bf700 1 -- start start 2023-11-15T01:36:12.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f17089bf700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17040c3e30 0x7f1704152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f17089bf700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17040c4210 0x7f1704165880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f17089bf700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1704154bf0 0x7f17040a9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f17089bf700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170406a090 con 0x7f17040c3e30 2023-11-15T01:36:12.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f17089bf700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1704165d70 con 0x7f1704154bf0 2023-11-15T01:36:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f17089bf700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17041653f0 con 0x7f17040c4210 2023-11-15T01:36:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f170259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17040c3e30 0x7f1704152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f170259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17040c3e30 0x7f1704152b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56390/0 (socket says 172.21.15.1:56390) 2023-11-15T01:36:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f170259c700 1 -- 172.21.15.1:0/1002555689 learned_addr learned my addr 172.21.15.1:0/1002555689 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f1701d9b700 1 --2- 172.21.15.1:0/1002555689 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17040c4210 0x7f1704165880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f1702d9d700 1 --2- 172.21.15.1:0/1002555689 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1704154bf0 0x7f17040a9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f170259c700 1 -- 172.21.15.1:0/1002555689 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17040c4210 msgr2=0x7f1704165880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f170259c700 1 --2- 172.21.15.1:0/1002555689 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17040c4210 0x7f1704165880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f170259c700 1 -- 172.21.15.1:0/1002555689 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1704154bf0 msgr2=0x7f17040a9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f170259c700 1 --2- 172.21.15.1:0/1002555689 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1704154bf0 0x7f17040a9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f170259c700 1 -- 172.21.15.1:0/1002555689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec0092a0 con 0x7f17040c3e30 2023-11-15T01:36:12.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f1702d9d700 1 --2- 172.21.15.1:0/1002555689 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1704154bf0 0x7f17040a9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:12.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f170259c700 1 --2- 172.21.15.1:0/1002555689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17040c3e30 0x7f1704152b10 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f16f4001eb0 tx=0x7f16f4007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:12.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.297+0000 7f16fa7fc700 1 -- 172.21.15.1:0/1002555689 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f400ce40 con 0x7f17040c3e30 2023-11-15T01:36:12.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.298+0000 7f16fa7fc700 1 -- 172.21.15.1:0/1002555689 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f40072e0 con 0x7f17040c3e30 2023-11-15T01:36:12.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.298+0000 7f17089bf700 1 -- 172.21.15.1:0/1002555689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17040aa1d0 con 0x7f17040c3e30 2023-11-15T01:36:12.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.298+0000 7f16fa7fc700 1 -- 172.21.15.1:0/1002555689 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f40057a0 con 0x7f17040c3e30 2023-11-15T01:36:12.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.298+0000 7f17089bf700 1 -- 172.21.15.1:0/1002555689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17040aa780 con 0x7f17040c3e30 2023-11-15T01:36:12.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.299+0000 7f17089bf700 1 -- 172.21.15.1:0/1002555689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170406c7e0 con 0x7f17040c3e30 2023-11-15T01:36:12.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.299+0000 7f16fa7fc700 1 -- 172.21.15.1:0/1002555689 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f16f4005b50 con 0x7f17040c3e30 2023-11-15T01:36:12.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.299+0000 7f16fa7fc700 1 --2- 172.21.15.1:0/1002555689 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f16e405f2a0 0x7f16e4061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.299+0000 7f16fa7fc700 1 -- 172.21.15.1:0/1002555689 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f16f4079bd0 con 0x7f17040c3e30 2023-11-15T01:36:12.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.299+0000 7f1701d9b700 1 --2- 172.21.15.1:0/1002555689 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f16e405f2a0 0x7f16e4061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.300+0000 7f1701d9b700 1 --2- 172.21.15.1:0/1002555689 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f16e405f2a0 0x7f16e4061760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f16ec00b2e0 tx=0x7f16ec017000).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:12.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.303+0000 7f16fa7fc700 1 -- 172.21.15.1:0/1002555689 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f16f404acc0 con 0x7f17040c3e30 2023-11-15T01:36:12.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.478+0000 7f17089bf700 1 -- 172.21.15.1:0/1002555689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1704151480 con 0x7f17040c3e30 2023-11-15T01:36:12.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.481+0000 7f16fa7fc700 1 -- 172.21.15.1:0/1002555689 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f16f4018070 con 0x7f17040c3e30 2023-11-15T01:36:12.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.483+0000 7f17089bf700 1 -- 172.21.15.1:0/1002555689 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f16e405f2a0 msgr2=0x7f16e4061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.483+0000 7f17089bf700 1 --2- 172.21.15.1:0/1002555689 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f16e405f2a0 0x7f16e4061760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f16ec00b2e0 tx=0x7f16ec017000).stop 2023-11-15T01:36:12.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.483+0000 7f17089bf700 1 -- 172.21.15.1:0/1002555689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17040c3e30 msgr2=0x7f1704152b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.483+0000 7f17089bf700 1 --2- 172.21.15.1:0/1002555689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17040c3e30 0x7f1704152b10 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f16f4001eb0 tx=0x7f16f4007e50).stop 2023-11-15T01:36:12.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.483+0000 7f17089bf700 1 -- 172.21.15.1:0/1002555689 shutdown_connections 2023-11-15T01:36:12.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.483+0000 7f17089bf700 1 --2- 172.21.15.1:0/1002555689 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f16e405f2a0 0x7f16e4061760 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.483+0000 7f17089bf700 1 --2- 172.21.15.1:0/1002555689 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1704154bf0 0x7f17040a9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.483+0000 7f17089bf700 1 --2- 172.21.15.1:0/1002555689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17040c3e30 0x7f1704152b10 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.483+0000 7f17089bf700 1 --2- 172.21.15.1:0/1002555689 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17040c4210 0x7f1704165880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.483+0000 7f17089bf700 1 -- 172.21.15.1:0/1002555689 >> 172.21.15.1:0/1002555689 conn(0x7f17040c7dc0 msgr2=0x7f17040c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:12.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.483+0000 7f17089bf700 1 -- 172.21.15.1:0/1002555689 shutdown_connections 2023-11-15T01:36:12.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.483+0000 7f17089bf700 1 -- 172.21.15.1:0/1002555689 wait complete. 2023-11-15T01:36:12.497 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-15T01:36:12.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.614+0000 7f495ca18700 1 Processor -- start 2023-11-15T01:36:12.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.614+0000 7f495ca18700 1 -- start start 2023-11-15T01:36:12.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.615+0000 7f495ca18700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f49581540a0 0x7f49580ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.615+0000 7f495ca18700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49580c6650 0x7f49580ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.615+0000 7f495ca18700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49580ca050 con 0x7f4958154480 2023-11-15T01:36:12.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.615+0000 7f495ca18700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49580c9440 con 0x7f49581540a0 2023-11-15T01:36:12.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.615+0000 7f495ca18700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49580c9720 con 0x7f49580c6650 2023-11-15T01:36:12.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.616+0000 7f495659c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f49581540a0 0x7f49580ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.616+0000 7f495659c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f49581540a0 0x7f49580ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56394/0 (socket says 172.21.15.1:56394) 2023-11-15T01:36:12.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.616+0000 7f495659c700 1 -- 172.21.15.1:0/3014987193 learned_addr learned my addr 172.21.15.1:0/3014987193 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:12.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.616+0000 7f4956d9d700 1 --2- 172.21.15.1:0/3014987193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49580c6650 0x7f49580ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.616+0000 7f495659c700 1 -- 172.21.15.1:0/3014987193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49580c6650 msgr2=0x7f49580ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:12.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.616+0000 7f495659c700 1 --2- 172.21.15.1:0/3014987193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49580c6650 0x7f49580ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.616+0000 7f495659c700 1 -- 172.21.15.1:0/3014987193 >> v1:172.21.15.141:6789/0 conn(0x7f4958154480 legacy=0x7f49580c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.616+0000 7f495659c700 1 -- 172.21.15.1:0/3014987193 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49580c9a00 con 0x7f49581540a0 2023-11-15T01:36:12.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.616+0000 7f495659c700 1 --2- 172.21.15.1:0/3014987193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49581540a0 0x7f49580ca4e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f4950006fd0 tx=0x7f49500090f0).ready entity=mon.0 client_cookie=b6f63ee4e560260f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:12.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.616+0000 7f495559a700 1 -- 172.21.15.1:0/3014987193 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495000b580 con 0x7f49581540a0 2023-11-15T01:36:12.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.616+0000 7f495559a700 1 -- 172.21.15.1:0/3014987193 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495000b6e0 con 0x7f49581540a0 2023-11-15T01:36:12.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.616+0000 7f495559a700 1 -- 172.21.15.1:0/3014987193 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495000ba60 con 0x7f49581540a0 2023-11-15T01:36:12.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.617+0000 7f495ca18700 1 -- 172.21.15.1:0/3014987193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49581540a0 msgr2=0x7f49580ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.617+0000 7f495ca18700 1 --2- 172.21.15.1:0/3014987193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49581540a0 0x7f49580ca4e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f4950006fd0 tx=0x7f49500090f0).stop 2023-11-15T01:36:12.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.617+0000 7f495ca18700 1 -- 172.21.15.1:0/3014987193 shutdown_connections 2023-11-15T01:36:12.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.617+0000 7f495ca18700 1 --2- 172.21.15.1:0/3014987193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49580c6650 0x7f49580ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.617+0000 7f495ca18700 1 --2- 172.21.15.1:0/3014987193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49581540a0 0x7f49580ca4e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.617+0000 7f495ca18700 1 -- 172.21.15.1:0/3014987193 >> 172.21.15.1:0/3014987193 conn(0x7f4958064a70 msgr2=0x7f4958064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:12.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.617+0000 7f495ca18700 1 -- 172.21.15.1:0/3014987193 shutdown_connections 2023-11-15T01:36:12.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.617+0000 7f495ca18700 1 -- 172.21.15.1:0/3014987193 wait complete. 2023-11-15T01:36:12.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.618+0000 7f495ca18700 1 Processor -- start 2023-11-15T01:36:12.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.618+0000 7f495ca18700 1 -- start start 2023-11-15T01:36:12.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f495ca18700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49580c6650 0x7f49581508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f495ca18700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49581540a0 0x7f495814ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f495ca18700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4958154480 0x7f49580cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f495ca18700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4958164740 con 0x7f4958154480 2023-11-15T01:36:12.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f495ca18700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4958150de0 con 0x7f49580c6650 2023-11-15T01:36:12.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f495ca18700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49581510b0 con 0x7f49581540a0 2023-11-15T01:36:12.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f4956d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4958154480 0x7f49580cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f4956d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4958154480 0x7f49580cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56408/0 (socket says 172.21.15.1:56408) 2023-11-15T01:36:12.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f4956d9d700 1 -- 172.21.15.1:0/1722688447 learned_addr learned my addr 172.21.15.1:0/1722688447 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:12.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f495659c700 1 --2- 172.21.15.1:0/1722688447 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49580c6650 0x7f49581508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f4955d9b700 1 --2- 172.21.15.1:0/1722688447 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49581540a0 0x7f495814ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f4956d9d700 1 -- 172.21.15.1:0/1722688447 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49581540a0 msgr2=0x7f495814ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f4956d9d700 1 --2- 172.21.15.1:0/1722688447 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49581540a0 0x7f495814ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f4956d9d700 1 -- 172.21.15.1:0/1722688447 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49580c6650 msgr2=0x7f49581508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f4956d9d700 1 --2- 172.21.15.1:0/1722688447 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49580c6650 0x7f49581508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f4956d9d700 1 -- 172.21.15.1:0/1722688447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4950009370 con 0x7f4958154480 2023-11-15T01:36:12.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.619+0000 7f4956d9d700 1 --2- 172.21.15.1:0/1722688447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4958154480 0x7f49580cb0b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f4948009ef0 tx=0x7f494800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:12.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.620+0000 7f494e7fc700 1 -- 172.21.15.1:0/1722688447 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494800cb70 con 0x7f4958154480 2023-11-15T01:36:12.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.620+0000 7f494e7fc700 1 -- 172.21.15.1:0/1722688447 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494800f040 con 0x7f4958154480 2023-11-15T01:36:12.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.620+0000 7f495ca18700 1 -- 172.21.15.1:0/1722688447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4958151390 con 0x7f4958154480 2023-11-15T01:36:12.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.620+0000 7f494e7fc700 1 -- 172.21.15.1:0/1722688447 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948013400 con 0x7f4958154480 2023-11-15T01:36:12.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.620+0000 7f495ca18700 1 -- 172.21.15.1:0/1722688447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4958151950 con 0x7f4958154480 2023-11-15T01:36:12.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.621+0000 7f495ca18700 1 -- 172.21.15.1:0/1722688447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f495806c7e0 con 0x7f4958154480 2023-11-15T01:36:12.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.621+0000 7f494e7fc700 1 -- 172.21.15.1:0/1722688447 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f49480137b0 con 0x7f4958154480 2023-11-15T01:36:12.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.621+0000 7f494e7fc700 1 --2- 172.21.15.1:0/1722688447 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f493805f270 0x7f4938061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.621+0000 7f494e7fc700 1 -- 172.21.15.1:0/1722688447 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f494807ac60 con 0x7f4958154480 2023-11-15T01:36:12.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.622+0000 7f495659c700 1 --2- 172.21.15.1:0/1722688447 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f493805f270 0x7f4938061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.622+0000 7f495659c700 1 --2- 172.21.15.1:0/1722688447 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f493805f270 0x7f4938061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4950009fd0 tx=0x7f4950017000).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:12.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.625+0000 7f494e7fc700 1 -- 172.21.15.1:0/1722688447 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f494804bd50 con 0x7f4958154480 2023-11-15T01:36:12.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.801+0000 7f495ca18700 1 -- 172.21.15.1:0/1722688447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f49580c9ce0 con 0x7f4958154480 2023-11-15T01:36:12.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.804+0000 7f494e7fc700 1 -- 172.21.15.1:0/1722688447 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v9) v1 ==== 120+0+0 (secure 0 0 0) 0x7f494804f370 con 0x7f4958154480 2023-11-15T01:36:12.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.806+0000 7f495ca18700 1 -- 172.21.15.1:0/1722688447 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f493805f270 msgr2=0x7f4938061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.806+0000 7f495ca18700 1 --2- 172.21.15.1:0/1722688447 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f493805f270 0x7f4938061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4950009fd0 tx=0x7f4950017000).stop 2023-11-15T01:36:12.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.806+0000 7f495ca18700 1 -- 172.21.15.1:0/1722688447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4958154480 msgr2=0x7f49580cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.806+0000 7f495ca18700 1 --2- 172.21.15.1:0/1722688447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4958154480 0x7f49580cb0b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f4948009ef0 tx=0x7f494800b040).stop 2023-11-15T01:36:12.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.807+0000 7f495ca18700 1 -- 172.21.15.1:0/1722688447 shutdown_connections 2023-11-15T01:36:12.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.807+0000 7f495ca18700 1 --2- 172.21.15.1:0/1722688447 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f493805f270 0x7f4938061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.807+0000 7f495ca18700 1 --2- 172.21.15.1:0/1722688447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4958154480 0x7f49580cb0b0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.807+0000 7f495ca18700 1 --2- 172.21.15.1:0/1722688447 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49580c6650 0x7f49581508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.807+0000 7f495ca18700 1 --2- 172.21.15.1:0/1722688447 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49581540a0 0x7f495814ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.807+0000 7f495ca18700 1 -- 172.21.15.1:0/1722688447 >> 172.21.15.1:0/1722688447 conn(0x7f4958064a70 msgr2=0x7f49580c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:12.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.807+0000 7f495ca18700 1 -- 172.21.15.1:0/1722688447 shutdown_connections 2023-11-15T01:36:12.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.807+0000 7f495ca18700 1 -- 172.21.15.1:0/1722688447 wait complete. 2023-11-15T01:36:12.820 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-11-15T01:36:12.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.938+0000 7fa3bdedc700 1 Processor -- start 2023-11-15T01:36:12.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.938+0000 7fa3bdedc700 1 -- start start 2023-11-15T01:36:12.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.939+0000 7fa3bdedc700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa3b80833a0 0x7fa3b80a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.939+0000 7fa3bdedc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa3b80be520 0x7fa3b8154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.939+0000 7fa3bdedc700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b80a85e0 con 0x7fa3b8154450 2023-11-15T01:36:12.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.939+0000 7fa3bdedc700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b8065940 con 0x7fa3b80be520 2023-11-15T01:36:12.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.939+0000 7fa3bdedc700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b8065660 con 0x7fa3b80833a0 2023-11-15T01:36:12.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.939+0000 7fa3b7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa3b80be520 0x7fa3b8154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.939+0000 7fa3b7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa3b80be520 0x7fa3b8154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56412/0 (socket says 172.21.15.1:56412) 2023-11-15T01:36:12.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.939+0000 7fa3b7fff700 1 -- 172.21.15.1:0/949862938 learned_addr learned my addr 172.21.15.1:0/949862938 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:12.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.939+0000 7fa3b6ffd700 1 --2- 172.21.15.1:0/949862938 >> v2:172.21.15.141:3300/0 conn(0x7fa3b80833a0 0x7fa3b80a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.940+0000 7fa3b7fff700 1 -- 172.21.15.1:0/949862938 >> v2:172.21.15.141:3300/0 conn(0x7fa3b80833a0 msgr2=0x7fa3b80a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:12.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.940+0000 7fa3b7fff700 1 --2- 172.21.15.1:0/949862938 >> v2:172.21.15.141:3300/0 conn(0x7fa3b80833a0 0x7fa3b80a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.940+0000 7fa3b7fff700 1 -- 172.21.15.1:0/949862938 >> v1:172.21.15.141:6789/0 conn(0x7fa3b8154450 legacy=0x7fa3b80bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.940+0000 7fa3b7fff700 1 -- 172.21.15.1:0/949862938 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b80c6f50 con 0x7fa3b80be520 2023-11-15T01:36:12.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.940+0000 7fa3b7fff700 1 --2- 172.21.15.1:0/949862938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b80be520 0x7fa3b8154830 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fa3b8158220 tx=0x7fa3b0009840).ready entity=mon.0 client_cookie=f728c65d4f4eff30 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:12.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.940+0000 7fa3b67fc700 1 -- 172.21.15.1:0/949862938 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b000e070 con 0x7fa3b80be520 2023-11-15T01:36:12.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.940+0000 7fa3b67fc700 1 -- 172.21.15.1:0/949862938 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b000ba20 con 0x7fa3b80be520 2023-11-15T01:36:12.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.940+0000 7fa3b67fc700 1 -- 172.21.15.1:0/949862938 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b000bda0 con 0x7fa3b80be520 2023-11-15T01:36:12.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.940+0000 7fa3bdedc700 1 -- 172.21.15.1:0/949862938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b80be520 msgr2=0x7fa3b8154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.940+0000 7fa3bdedc700 1 --2- 172.21.15.1:0/949862938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b80be520 0x7fa3b8154830 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fa3b8158220 tx=0x7fa3b0009840).stop 2023-11-15T01:36:12.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.940+0000 7fa3bdedc700 1 -- 172.21.15.1:0/949862938 shutdown_connections 2023-11-15T01:36:12.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.940+0000 7fa3bdedc700 1 --2- 172.21.15.1:0/949862938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b80be520 0x7fa3b8154830 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.940+0000 7fa3bdedc700 1 --2- 172.21.15.1:0/949862938 >> v2:172.21.15.141:3300/0 conn(0x7fa3b80833a0 0x7fa3b80a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.940+0000 7fa3bdedc700 1 -- 172.21.15.1:0/949862938 >> 172.21.15.1:0/949862938 conn(0x7fa3b8082f90 msgr2=0x7fa3b80c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:12.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.940+0000 7fa3bdedc700 1 -- 172.21.15.1:0/949862938 shutdown_connections 2023-11-15T01:36:12.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.941+0000 7fa3bdedc700 1 -- 172.21.15.1:0/949862938 wait complete. 2023-11-15T01:36:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.942+0000 7fa3bdedc700 1 Processor -- start 2023-11-15T01:36:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.942+0000 7fa3bdedc700 1 -- start start 2023-11-15T01:36:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.942+0000 7fa3bdedc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3b80833a0 0x7fa3b8163c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3bdedc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3b80be520 0x7fa3b80a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3bdedc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8154450 0x7fa3b8159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3bdedc700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b81640f0 con 0x7fa3b8154450 2023-11-15T01:36:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3bdedc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b8151d50 con 0x7fa3b80833a0 2023-11-15T01:36:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3bdedc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80ac9a0 con 0x7fa3b80be520 2023-11-15T01:36:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3b7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8154450 0x7fa3b8159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3b7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8154450 0x7fa3b8159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56416/0 (socket says 172.21.15.1:56416) 2023-11-15T01:36:12.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3b7fff700 1 -- 172.21.15.1:0/3811738251 learned_addr learned my addr 172.21.15.1:0/3811738251 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:12.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3b6ffd700 1 --2- 172.21.15.1:0/3811738251 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3b80be520 0x7fa3b80a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3b77fe700 1 --2- 172.21.15.1:0/3811738251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3b80833a0 0x7fa3b8163c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3b7fff700 1 -- 172.21.15.1:0/3811738251 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3b80be520 msgr2=0x7fa3b80a66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3b7fff700 1 --2- 172.21.15.1:0/3811738251 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3b80be520 0x7fa3b80a66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3b7fff700 1 -- 172.21.15.1:0/3811738251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3b80833a0 msgr2=0x7fa3b8163c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:12.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3b7fff700 1 --2- 172.21.15.1:0/3811738251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3b80833a0 0x7fa3b8163c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:12.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3b7fff700 1 -- 172.21.15.1:0/3811738251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0009ae0 con 0x7fa3b8154450 2023-11-15T01:36:12.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3b77fe700 1 --2- 172.21.15.1:0/3811738251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3b80833a0 0x7fa3b8163c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:12.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3b7fff700 1 --2- 172.21.15.1:0/3811738251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8154450 0x7fa3b8159220 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fa3b80665a0 tx=0x7fa3b0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:12.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa39f7fe700 1 -- 172.21.15.1:0/3811738251 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b00092e0 con 0x7fa3b8154450 2023-11-15T01:36:12.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa39f7fe700 1 -- 172.21.15.1:0/3811738251 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b001e470 con 0x7fa3b8154450 2023-11-15T01:36:12.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3bdedc700 1 -- 172.21.15.1:0/3811738251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b80a6b90 con 0x7fa3b8154450 2023-11-15T01:36:12.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa39f7fe700 1 -- 172.21.15.1:0/3811738251 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b001e830 con 0x7fa3b8154450 2023-11-15T01:36:12.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.943+0000 7fa3bdedc700 1 -- 172.21.15.1:0/3811738251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b8151420 con 0x7fa3b8154450 2023-11-15T01:36:12.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.944+0000 7fa3bdedc700 1 -- 172.21.15.1:0/3811738251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b80acb60 con 0x7fa3b8154450 2023-11-15T01:36:12.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.945+0000 7fa39f7fe700 1 -- 172.21.15.1:0/3811738251 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa3b0003040 con 0x7fa3b8154450 2023-11-15T01:36:12.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.945+0000 7fa39f7fe700 1 --2- 172.21.15.1:0/3811738251 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa3a405f270 0x7fa3a4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:12.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.945+0000 7fa39f7fe700 1 -- 172.21.15.1:0/3811738251 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6209+0+0 (secure 0 0 0) 0x7fa3b007b880 con 0x7fa3b8154450 2023-11-15T01:36:12.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.945+0000 7fa3b77fe700 1 --2- 172.21.15.1:0/3811738251 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa3a405f270 0x7fa3a4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:12.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.946+0000 7fa3b77fe700 1 --2- 172.21.15.1:0/3811738251 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa3a405f270 0x7fa3a4061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa3a80016d0 tx=0x7fa3a8009040).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:12.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:12.949+0000 7fa39f7fe700 1 -- 172.21.15.1:0/3811738251 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa3b004ca20 con 0x7fa3b8154450 2023-11-15T01:36:13.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:13.194+0000 7fa3bdedc700 1 -- 172.21.15.1:0/3811738251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7fa3b8065350 con 0x7fa3b8154450 2023-11-15T01:36:14.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.144+0000 7fa39f7fe700 1 -- 172.21.15.1:0/3811738251 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v522) v1 ==== 154+0+0 (secure 0 0 0) 0x7fa3b0023070 con 0x7fa3b8154450 2023-11-15T01:36:14.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.147+0000 7fa3bdedc700 1 -- 172.21.15.1:0/3811738251 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa3a405f270 msgr2=0x7fa3a4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:14.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.147+0000 7fa3bdedc700 1 --2- 172.21.15.1:0/3811738251 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa3a405f270 0x7fa3a4061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa3a80016d0 tx=0x7fa3a8009040).stop 2023-11-15T01:36:14.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.147+0000 7fa3bdedc700 1 -- 172.21.15.1:0/3811738251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8154450 msgr2=0x7fa3b8159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:14.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.147+0000 7fa3bdedc700 1 --2- 172.21.15.1:0/3811738251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8154450 0x7fa3b8159220 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fa3b80665a0 tx=0x7fa3b0009840).stop 2023-11-15T01:36:14.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.147+0000 7fa3bdedc700 1 -- 172.21.15.1:0/3811738251 shutdown_connections 2023-11-15T01:36:14.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.147+0000 7fa3bdedc700 1 --2- 172.21.15.1:0/3811738251 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa3a405f270 0x7fa3a4061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:14.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.147+0000 7fa3bdedc700 1 --2- 172.21.15.1:0/3811738251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3b8154450 0x7fa3b8159220 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:14.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.147+0000 7fa3bdedc700 1 --2- 172.21.15.1:0/3811738251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3b80833a0 0x7fa3b8163c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:14.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.147+0000 7fa3bdedc700 1 --2- 172.21.15.1:0/3811738251 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3b80be520 0x7fa3b80a66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:14.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.147+0000 7fa3bdedc700 1 -- 172.21.15.1:0/3811738251 >> 172.21.15.1:0/3811738251 conn(0x7fa3b8082f90 msgr2=0x7fa3b80bde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:14.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.148+0000 7fa3bdedc700 1 -- 172.21.15.1:0/3811738251 shutdown_connections 2023-11-15T01:36:14.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.148+0000 7fa3bdedc700 1 -- 172.21.15.1:0/3811738251 wait complete. 2023-11-15T01:36:14.163 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-11-15T01:36:14.164 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-11-15T01:36:14.164 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-15T01:36:14.165 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-11-15T01:36:14.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.288+0000 7fab35684700 1 Processor -- start 2023-11-15T01:36:14.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.288+0000 7fab35684700 1 -- start start 2023-11-15T01:36:14.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.289+0000 7fab35684700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fab30151e10 0x7fab30155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:14.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.289+0000 7fab35684700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fab300c86b0 0x7fab300aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:14.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.289+0000 7fab35684700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab300c98b0 0x7fab300c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:14.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.289+0000 7fab35684700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab300c7980 con 0x7fab30151e10 2023-11-15T01:36:14.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.289+0000 7fab35684700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab300c8b10 con 0x7fab300c86b0 2023-11-15T01:36:14.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.289+0000 7fab35684700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab300ca1f0 con 0x7fab300c98b0 2023-11-15T01:36:14.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.289+0000 7fab2ffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fab30151e10 0x7fab30155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:14.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.289+0000 7fab2ffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fab30151e10 0x7fab30155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56420/0 (socket says 172.21.15.1:56420) 2023-11-15T01:36:14.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.289+0000 7fab2ffff700 1 -- 172.21.15.1:0/4127349634 learned_addr learned my addr 172.21.15.1:0/4127349634 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:14.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.289+0000 7fab2f7fe700 1 --2- 172.21.15.1:0/4127349634 >> v2:172.21.15.141:3300/0 conn(0x7fab300c86b0 0x7fab300aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:14.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.290+0000 7fab34e83700 1 --2- 172.21.15.1:0/4127349634 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab300c98b0 0x7fab300c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:14.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.290+0000 7fab2ffff700 1 -- 172.21.15.1:0/4127349634 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab300c98b0 msgr2=0x7fab300c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:14.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.290+0000 7fab2ffff700 1 --2- 172.21.15.1:0/4127349634 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab300c98b0 0x7fab300c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:14.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.290+0000 7fab2ffff700 1 -- 172.21.15.1:0/4127349634 >> v2:172.21.15.141:3300/0 conn(0x7fab300c86b0 msgr2=0x7fab300aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:14.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.290+0000 7fab2ffff700 1 --2- 172.21.15.1:0/4127349634 >> v2:172.21.15.141:3300/0 conn(0x7fab300c86b0 0x7fab300aa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:14.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.290+0000 7fab2ffff700 1 -- 172.21.15.1:0/4127349634 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab300aa5c0 con 0x7fab30151e10 2023-11-15T01:36:14.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.290+0000 7fab2ffff700 1 --2- 172.21.15.1:0/4127349634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab30151e10 0x7fab30155530 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fab30157e90 tx=0x7fab180090f0).ready entity=mon.0 client_cookie=de01517ed918ffec server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:14.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.290+0000 7fab2effd700 1 -- 172.21.15.1:0/4127349634 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1800f510 con 0x7fab30151e10 2023-11-15T01:36:14.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.290+0000 7fab2effd700 1 -- 172.21.15.1:0/4127349634 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1800f670 con 0x7fab30151e10 2023-11-15T01:36:14.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.290+0000 7fab2effd700 1 -- 172.21.15.1:0/4127349634 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1800fa10 con 0x7fab30151e10 2023-11-15T01:36:14.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.290+0000 7fab35684700 1 -- 172.21.15.1:0/4127349634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab30151e10 msgr2=0x7fab30155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:14.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.291+0000 7fab35684700 1 --2- 172.21.15.1:0/4127349634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab30151e10 0x7fab30155530 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fab30157e90 tx=0x7fab180090f0).stop 2023-11-15T01:36:14.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.291+0000 7fab35684700 1 -- 172.21.15.1:0/4127349634 shutdown_connections 2023-11-15T01:36:14.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.291+0000 7fab35684700 1 --2- 172.21.15.1:0/4127349634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab30151e10 0x7fab30155530 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:14.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.291+0000 7fab35684700 1 --2- 172.21.15.1:0/4127349634 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab300c98b0 0x7fab300c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:14.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.291+0000 7fab35684700 1 --2- 172.21.15.1:0/4127349634 >> v2:172.21.15.141:3300/0 conn(0x7fab300c86b0 0x7fab300aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:14.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.291+0000 7fab35684700 1 -- 172.21.15.1:0/4127349634 >> 172.21.15.1:0/4127349634 conn(0x7fab300947e0 msgr2=0x7fab3006a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:14.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.291+0000 7fab35684700 1 -- 172.21.15.1:0/4127349634 shutdown_connections 2023-11-15T01:36:14.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.291+0000 7fab35684700 1 -- 172.21.15.1:0/4127349634 wait complete. 2023-11-15T01:36:14.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.292+0000 7fab35684700 1 Processor -- start 2023-11-15T01:36:14.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.292+0000 7fab35684700 1 -- start start 2023-11-15T01:36:14.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab35684700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab300c86b0 0x7fab301539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:14.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab35684700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab300c98b0 0x7fab301682b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:14.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab35684700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab30151e10 0x7fab300abf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:14.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab35684700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab301550e0 con 0x7fab300c98b0 2023-11-15T01:36:14.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab35684700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab301687a0 con 0x7fab300c86b0 2023-11-15T01:36:14.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab35684700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab30153f80 con 0x7fab30151e10 2023-11-15T01:36:14.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab2f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab300c98b0 0x7fab301682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:14.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab2f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab300c98b0 0x7fab301682b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56422/0 (socket says 172.21.15.1:56422) 2023-11-15T01:36:14.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab2f7fe700 1 -- 172.21.15.1:0/4268555791 learned_addr learned my addr 172.21.15.1:0/4268555791 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:14.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab2ffff700 1 --2- 172.21.15.1:0/4268555791 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab300c86b0 0x7fab301539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:14.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab34e83700 1 --2- 172.21.15.1:0/4268555791 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab30151e10 0x7fab300abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:14.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab2f7fe700 1 -- 172.21.15.1:0/4268555791 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab30151e10 msgr2=0x7fab300abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:14.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab2f7fe700 1 --2- 172.21.15.1:0/4268555791 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab30151e10 0x7fab300abf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab2f7fe700 1 -- 172.21.15.1:0/4268555791 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab300c86b0 msgr2=0x7fab301539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab2f7fe700 1 --2- 172.21.15.1:0/4268555791 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab300c86b0 0x7fab301539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab2f7fe700 1 -- 172.21.15.1:0/4268555791 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab18009370 con 0x7fab300c98b0 2023-11-15T01:36:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.293+0000 7fab2f7fe700 1 --2- 172.21.15.1:0/4268555791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab300c98b0 0x7fab301682b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fab2000e900 tx=0x7fab20009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.294+0000 7fab27fff700 1 -- 172.21.15.1:0/4268555791 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20012600 con 0x7fab300c98b0 2023-11-15T01:36:14.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.294+0000 7fab27fff700 1 -- 172.21.15.1:0/4268555791 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab20012760 con 0x7fab300c98b0 2023-11-15T01:36:14.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.294+0000 7fab35684700 1 -- 172.21.15.1:0/4268555791 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab30154260 con 0x7fab300c98b0 2023-11-15T01:36:14.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.294+0000 7fab27fff700 1 -- 172.21.15.1:0/4268555791 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20012ae0 con 0x7fab300c98b0 2023-11-15T01:36:14.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.294+0000 7fab35684700 1 -- 172.21.15.1:0/4268555791 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab30154820 con 0x7fab300c98b0 2023-11-15T01:36:14.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.295+0000 7fab35684700 1 -- 172.21.15.1:0/4268555791 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab30150170 con 0x7fab300c98b0 2023-11-15T01:36:14.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.295+0000 7fab27fff700 1 -- 172.21.15.1:0/4268555791 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fab2001b400 con 0x7fab300c98b0 2023-11-15T01:36:14.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.295+0000 7fab27fff700 1 --2- 172.21.15.1:0/4268555791 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fab1005f270 0x7fab10061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:14.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.295+0000 7fab27fff700 1 -- 172.21.15.1:0/4268555791 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6209+0+0 (secure 0 0 0) 0x7fab2007a6e0 con 0x7fab300c98b0 2023-11-15T01:36:14.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.295+0000 7fab2ffff700 1 --2- 172.21.15.1:0/4268555791 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fab1005f270 0x7fab10061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:14.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.296+0000 7fab2ffff700 1 --2- 172.21.15.1:0/4268555791 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fab1005f270 0x7fab10061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fab30157e90 tx=0x7fab18017000).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:14.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.300+0000 7fab27fff700 1 -- 172.21.15.1:0/4268555791 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fab2004b770 con 0x7fab300c98b0 2023-11-15T01:36:14.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:14.540+0000 7fab35684700 1 -- 172.21.15.1:0/4268555791 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7fab300475e0 con 0x7fab300c98b0 2023-11-15T01:36:15.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.146+0000 7fab27fff700 1 -- 172.21.15.1:0/4268555791 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v523) v1 ==== 159+0+0 (secure 0 0 0) 0x7fab2004ed90 con 0x7fab300c98b0 2023-11-15T01:36:15.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.148+0000 7fab35684700 1 -- 172.21.15.1:0/4268555791 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fab1005f270 msgr2=0x7fab10061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:15.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.148+0000 7fab35684700 1 --2- 172.21.15.1:0/4268555791 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fab1005f270 0x7fab10061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fab30157e90 tx=0x7fab18017000).stop 2023-11-15T01:36:15.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.148+0000 7fab35684700 1 -- 172.21.15.1:0/4268555791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab300c98b0 msgr2=0x7fab301682b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.148+0000 7fab35684700 1 --2- 172.21.15.1:0/4268555791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab300c98b0 0x7fab301682b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fab2000e900 tx=0x7fab20009060).stop 2023-11-15T01:36:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.148+0000 7fab35684700 1 -- 172.21.15.1:0/4268555791 shutdown_connections 2023-11-15T01:36:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.148+0000 7fab35684700 1 --2- 172.21.15.1:0/4268555791 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fab1005f270 0x7fab10061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.148+0000 7fab35684700 1 --2- 172.21.15.1:0/4268555791 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab30151e10 0x7fab300abf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.148+0000 7fab35684700 1 --2- 172.21.15.1:0/4268555791 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab300c86b0 0x7fab301539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.148+0000 7fab35684700 1 --2- 172.21.15.1:0/4268555791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab300c98b0 0x7fab301682b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.148+0000 7fab35684700 1 -- 172.21.15.1:0/4268555791 >> 172.21.15.1:0/4268555791 conn(0x7fab300947e0 msgr2=0x7fab300a8750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:15.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.148+0000 7fab35684700 1 -- 172.21.15.1:0/4268555791 shutdown_connections 2023-11-15T01:36:15.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.148+0000 7fab35684700 1 -- 172.21.15.1:0/4268555791 wait complete. 2023-11-15T01:36:15.164 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-15T01:36:15.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.290+0000 7fef3297e700 1 Processor -- start 2023-11-15T01:36:15.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.290+0000 7fef3297e700 1 -- start start 2023-11-15T01:36:15.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.291+0000 7fef3297e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fef2c1540a0 0x7fef2c0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:15.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.291+0000 7fef3297e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fef2c0c6650 0x7fef2c0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:15.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.291+0000 7fef3297e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef2c0ca050 con 0x7fef2c154480 2023-11-15T01:36:15.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.291+0000 7fef3297e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2c0c9440 con 0x7fef2c0c6650 2023-11-15T01:36:15.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.291+0000 7fef3297e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2c0c9720 con 0x7fef2c1540a0 2023-11-15T01:36:15.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.291+0000 7fef30f1b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fef2c0c6650 0x7fef2c0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:15.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.291+0000 7fef30f1b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fef2c0c6650 0x7fef2c0ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56428/0 (socket says 172.21.15.1:56428) 2023-11-15T01:36:15.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.291+0000 7fef30f1b700 1 -- 172.21.15.1:0/1336149592 learned_addr learned my addr 172.21.15.1:0/1336149592 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:15.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.291+0000 7fef2bfff700 1 --2- 172.21.15.1:0/1336149592 >> v2:172.21.15.141:3300/0 conn(0x7fef2c1540a0 0x7fef2c0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:15.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.291+0000 7fef30f1b700 1 -- 172.21.15.1:0/1336149592 >> v2:172.21.15.141:3300/0 conn(0x7fef2c1540a0 msgr2=0x7fef2c0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:15.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.291+0000 7fef30f1b700 1 --2- 172.21.15.1:0/1336149592 >> v2:172.21.15.141:3300/0 conn(0x7fef2c1540a0 0x7fef2c0ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.291+0000 7fef30f1b700 1 -- 172.21.15.1:0/1336149592 >> v1:172.21.15.141:6789/0 conn(0x7fef2c154480 legacy=0x7fef2c0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:15.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.291+0000 7fef30f1b700 1 -- 172.21.15.1:0/1336149592 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c0c9a00 con 0x7fef2c0c6650 2023-11-15T01:36:15.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.292+0000 7fef30f1b700 1 --2- 172.21.15.1:0/1336149592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef2c0c6650 0x7fef2c0ca9d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fef2c05ff40 tx=0x7fef24009840).ready entity=mon.0 client_cookie=8206f229a3ef8d6a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:15.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.292+0000 7fef2affd700 1 -- 172.21.15.1:0/1336149592 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2400e070 con 0x7fef2c0c6650 2023-11-15T01:36:15.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.292+0000 7fef2affd700 1 -- 172.21.15.1:0/1336149592 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2400ba20 con 0x7fef2c0c6650 2023-11-15T01:36:15.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.292+0000 7fef2affd700 1 -- 172.21.15.1:0/1336149592 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2400bda0 con 0x7fef2c0c6650 2023-11-15T01:36:15.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.292+0000 7fef3297e700 1 -- 172.21.15.1:0/1336149592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef2c0c6650 msgr2=0x7fef2c0ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:15.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.292+0000 7fef3297e700 1 --2- 172.21.15.1:0/1336149592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef2c0c6650 0x7fef2c0ca9d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fef2c05ff40 tx=0x7fef24009840).stop 2023-11-15T01:36:15.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.292+0000 7fef3297e700 1 -- 172.21.15.1:0/1336149592 shutdown_connections 2023-11-15T01:36:15.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.292+0000 7fef3297e700 1 --2- 172.21.15.1:0/1336149592 >> v2:172.21.15.141:3300/0 conn(0x7fef2c1540a0 0x7fef2c0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.292+0000 7fef3297e700 1 --2- 172.21.15.1:0/1336149592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef2c0c6650 0x7fef2c0ca9d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.292+0000 7fef3297e700 1 -- 172.21.15.1:0/1336149592 >> 172.21.15.1:0/1336149592 conn(0x7fef2c064a70 msgr2=0x7fef2c064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:15.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.292+0000 7fef3297e700 1 -- 172.21.15.1:0/1336149592 shutdown_connections 2023-11-15T01:36:15.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.292+0000 7fef3297e700 1 -- 172.21.15.1:0/1336149592 wait complete. 2023-11-15T01:36:15.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.293+0000 7fef3297e700 1 Processor -- start 2023-11-15T01:36:15.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.294+0000 7fef3297e700 1 -- start start 2023-11-15T01:36:15.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.294+0000 7fef3297e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef2c0c6650 0x7fef2c142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:15.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.294+0000 7fef3297e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef2c1540a0 0x7fef2c158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:15.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.294+0000 7fef3297e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef2c154480 0x7fef2c0b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:15.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.294+0000 7fef3297e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c155a40 con 0x7fef2c1540a0 2023-11-15T01:36:15.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.294+0000 7fef3297e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c154e30 con 0x7fef2c0c6650 2023-11-15T01:36:15.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.294+0000 7fef3297e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c155110 con 0x7fef2c154480 2023-11-15T01:36:15.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.294+0000 7fef2b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef2c1540a0 0x7fef2c158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:15.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.295+0000 7fef2b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef2c1540a0 0x7fef2c158750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56442/0 (socket says 172.21.15.1:56442) 2023-11-15T01:36:15.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.295+0000 7fef2b7fe700 1 -- 172.21.15.1:0/351058380 learned_addr learned my addr 172.21.15.1:0/351058380 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:15.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.295+0000 7fef2bfff700 1 --2- 172.21.15.1:0/351058380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef2c0c6650 0x7fef2c142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:15.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.295+0000 7fef2b7fe700 1 -- 172.21.15.1:0/351058380 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef2c154480 msgr2=0x7fef2c0b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:15.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.295+0000 7fef2b7fe700 1 --2- 172.21.15.1:0/351058380 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef2c154480 0x7fef2c0b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:15.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.295+0000 7fef2b7fe700 1 -- 172.21.15.1:0/351058380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef2c0c6650 msgr2=0x7fef2c142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:15.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.295+0000 7fef2b7fe700 1 --2- 172.21.15.1:0/351058380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef2c0c6650 0x7fef2c142b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.295+0000 7fef2b7fe700 1 -- 172.21.15.1:0/351058380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef24009ae0 con 0x7fef2c1540a0 2023-11-15T01:36:15.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.295+0000 7fef2b7fe700 1 --2- 172.21.15.1:0/351058380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef2c1540a0 0x7fef2c158750 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7fef1400c440 tx=0x7fef14007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:15.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.295+0000 7fef23fff700 1 -- 172.21.15.1:0/351058380 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14007020 con 0x7fef2c1540a0 2023-11-15T01:36:15.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.295+0000 7fef23fff700 1 -- 172.21.15.1:0/351058380 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef14007180 con 0x7fef2c1540a0 2023-11-15T01:36:15.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.295+0000 7fef23fff700 1 -- 172.21.15.1:0/351058380 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14007520 con 0x7fef2c1540a0 2023-11-15T01:36:15.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.295+0000 7fef3297e700 1 -- 172.21.15.1:0/351058380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c1553f0 con 0x7fef2c1540a0 2023-11-15T01:36:15.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.295+0000 7fef3297e700 1 -- 172.21.15.1:0/351058380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c143030 con 0x7fef2c1540a0 2023-11-15T01:36:15.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.296+0000 7fef3297e700 1 -- 172.21.15.1:0/351058380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2c155bb0 con 0x7fef2c1540a0 2023-11-15T01:36:15.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.296+0000 7fef23fff700 1 -- 172.21.15.1:0/351058380 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fef140068b0 con 0x7fef2c1540a0 2023-11-15T01:36:15.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.297+0000 7fef23fff700 1 --2- 172.21.15.1:0/351058380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fef0c05f270 0x7fef0c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:15.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.297+0000 7fef23fff700 1 -- 172.21.15.1:0/351058380 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6209+0+0 (secure 0 0 0) 0x7fef140797b0 con 0x7fef2c1540a0 2023-11-15T01:36:15.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.297+0000 7fef2bfff700 1 --2- 172.21.15.1:0/351058380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fef0c05f270 0x7fef0c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:15.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.297+0000 7fef2bfff700 1 --2- 172.21.15.1:0/351058380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fef0c05f270 0x7fef0c061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fef1c009270 tx=0x7fef1c008040).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:15.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.301+0000 7fef23fff700 1 -- 172.21.15.1:0/351058380 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fef14047af0 con 0x7fef2c1540a0 2023-11-15T01:36:15.473 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.472+0000 7fef3297e700 1 -- 172.21.15.1:0/351058380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fef2c06c7e0 con 0x7fef2c1540a0 2023-11-15T01:36:15.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.475+0000 7fef23fff700 1 -- 172.21.15.1:0/351058380 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fef1404a8a0 con 0x7fef2c1540a0 2023-11-15T01:36:15.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.477+0000 7fef3297e700 1 -- 172.21.15.1:0/351058380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fef0c05f270 msgr2=0x7fef0c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:15.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.477+0000 7fef3297e700 1 --2- 172.21.15.1:0/351058380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fef0c05f270 0x7fef0c061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fef1c009270 tx=0x7fef1c008040).stop 2023-11-15T01:36:15.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.477+0000 7fef3297e700 1 -- 172.21.15.1:0/351058380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef2c1540a0 msgr2=0x7fef2c158750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:15.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.477+0000 7fef3297e700 1 --2- 172.21.15.1:0/351058380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef2c1540a0 0x7fef2c158750 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7fef1400c440 tx=0x7fef14007e00).stop 2023-11-15T01:36:15.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.477+0000 7fef3297e700 1 -- 172.21.15.1:0/351058380 shutdown_connections 2023-11-15T01:36:15.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.477+0000 7fef3297e700 1 --2- 172.21.15.1:0/351058380 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fef0c05f270 0x7fef0c061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.477+0000 7fef3297e700 1 --2- 172.21.15.1:0/351058380 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef2c154480 0x7fef2c0b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:15.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.477+0000 7fef3297e700 1 --2- 172.21.15.1:0/351058380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef2c0c6650 0x7fef2c142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.477+0000 7fef3297e700 1 --2- 172.21.15.1:0/351058380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef2c1540a0 0x7fef2c158750 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.477+0000 7fef3297e700 1 -- 172.21.15.1:0/351058380 >> 172.21.15.1:0/351058380 conn(0x7fef2c064a70 msgr2=0x7fef2c064e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:15.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.477+0000 7fef3297e700 1 -- 172.21.15.1:0/351058380 shutdown_connections 2023-11-15T01:36:15.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.477+0000 7fef3297e700 1 -- 172.21.15.1:0/351058380 wait complete. 2023-11-15T01:36:15.491 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T01:36:15.491 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:36:15.530 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:36:15.583 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T01:36:15.583 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-15T01:36:15.584 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:36:15.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.700+0000 7f2b318f7700 1 Processor -- start 2023-11-15T01:36:15.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.700+0000 7f2b318f7700 1 -- start start 2023-11-15T01:36:15.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.701+0000 7f2b318f7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2b2c154150 0x7f2b2c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:15.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.701+0000 7f2b318f7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2b2c0ab1a0 0x7f2b2c158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:15.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.701+0000 7f2b318f7700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2c0c06f0 con 0x7f2b2c0aa060 2023-11-15T01:36:15.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.701+0000 7f2b318f7700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2c0c09d0 con 0x7f2b2c154150 2023-11-15T01:36:15.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.701+0000 7f2b318f7700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2c158820 con 0x7f2b2c0ab1a0 2023-11-15T01:36:15.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.701+0000 7f2b2affd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2b2c154150 0x7f2b2c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:15.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.701+0000 7f2b2affd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2b2c154150 0x7f2b2c154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56444/0 (socket says 172.21.15.1:56444) 2023-11-15T01:36:15.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.701+0000 7f2b2affd700 1 -- 172.21.15.1:0/3188882501 learned_addr learned my addr 172.21.15.1:0/3188882501 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:15.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.701+0000 7f2b2a7fc700 1 --2- 172.21.15.1:0/3188882501 >> v2:172.21.15.141:3300/0 conn(0x7f2b2c0ab1a0 0x7f2b2c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:15.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.701+0000 7f2b2affd700 1 -- 172.21.15.1:0/3188882501 >> v2:172.21.15.141:3300/0 conn(0x7f2b2c0ab1a0 msgr2=0x7f2b2c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:15.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.701+0000 7f2b2affd700 1 --2- 172.21.15.1:0/3188882501 >> v2:172.21.15.141:3300/0 conn(0x7f2b2c0ab1a0 0x7f2b2c158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.701+0000 7f2b2affd700 1 -- 172.21.15.1:0/3188882501 >> v1:172.21.15.141:6789/0 conn(0x7f2b2c0aa060 legacy=0x7f2b2c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:15.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.701+0000 7f2b2affd700 1 -- 172.21.15.1:0/3188882501 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c158b00 con 0x7f2b2c154150 2023-11-15T01:36:15.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.701+0000 7f2b2a7fc700 1 --2- 172.21.15.1:0/3188882501 >> v2:172.21.15.141:3300/0 conn(0x7f2b2c0ab1a0 0x7f2b2c158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:15.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.702+0000 7f2b2affd700 1 --2- 172.21.15.1:0/3188882501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b2c154150 0x7f2b2c154530 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f2b2c0c0270 tx=0x7f2b240090f0).ready entity=mon.0 client_cookie=71d00a7c5b827a7a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:15.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.702+0000 7f2b29ffb700 1 -- 172.21.15.1:0/3188882501 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400b5a0 con 0x7f2b2c154150 2023-11-15T01:36:15.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.702+0000 7f2b29ffb700 1 -- 172.21.15.1:0/3188882501 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2400b700 con 0x7f2b2c154150 2023-11-15T01:36:15.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.702+0000 7f2b29ffb700 1 -- 172.21.15.1:0/3188882501 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400baa0 con 0x7f2b2c154150 2023-11-15T01:36:15.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.702+0000 7f2b318f7700 1 -- 172.21.15.1:0/3188882501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b2c154150 msgr2=0x7f2b2c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:15.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.702+0000 7f2b318f7700 1 --2- 172.21.15.1:0/3188882501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b2c154150 0x7f2b2c154530 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f2b2c0c0270 tx=0x7f2b240090f0).stop 2023-11-15T01:36:15.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.702+0000 7f2b318f7700 1 -- 172.21.15.1:0/3188882501 shutdown_connections 2023-11-15T01:36:15.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.702+0000 7f2b318f7700 1 --2- 172.21.15.1:0/3188882501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b2c154150 0x7f2b2c154530 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.702+0000 7f2b318f7700 1 --2- 172.21.15.1:0/3188882501 >> v2:172.21.15.141:3300/0 conn(0x7f2b2c0ab1a0 0x7f2b2c158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.702+0000 7f2b318f7700 1 -- 172.21.15.1:0/3188882501 >> 172.21.15.1:0/3188882501 conn(0x7f2b2c064aa0 msgr2=0x7f2b2c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:15.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.702+0000 7f2b318f7700 1 -- 172.21.15.1:0/3188882501 shutdown_connections 2023-11-15T01:36:15.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.702+0000 7f2b318f7700 1 -- 172.21.15.1:0/3188882501 wait complete. 2023-11-15T01:36:15.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.704+0000 7f2b318f7700 1 Processor -- start 2023-11-15T01:36:15.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.704+0000 7f2b318f7700 1 -- start start 2023-11-15T01:36:15.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.704+0000 7f2b318f7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b2c0aa060 0x7f2b2c0ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:15.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.704+0000 7f2b318f7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b2c0ab1a0 0x7f2b2c144440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:15.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.704+0000 7f2b318f7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b2c154150 0x7f2b2c156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.704+0000 7f2b318f7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c0ae520 con 0x7f2b2c154150 2023-11-15T01:36:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.704+0000 7f2b318f7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c168ce0 con 0x7f2b2c0ab1a0 2023-11-15T01:36:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.704+0000 7f2b318f7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c144930 con 0x7f2b2c0aa060 2023-11-15T01:36:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.704+0000 7f2b2b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b2c154150 0x7f2b2c156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.705+0000 7f2b2b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b2c154150 0x7f2b2c156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56454/0 (socket says 172.21.15.1:56454) 2023-11-15T01:36:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.705+0000 7f2b2b7fe700 1 -- 172.21.15.1:0/2777073312 learned_addr learned my addr 172.21.15.1:0/2777073312 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.705+0000 7f2b2affd700 1 --2- 172.21.15.1:0/2777073312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b2c0aa060 0x7f2b2c0ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.705+0000 7f2b2a7fc700 1 --2- 172.21.15.1:0/2777073312 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b2c0ab1a0 0x7f2b2c144440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.705+0000 7f2b2b7fe700 1 -- 172.21.15.1:0/2777073312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b2c0aa060 msgr2=0x7f2b2c0ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.705+0000 7f2b2b7fe700 1 --2- 172.21.15.1:0/2777073312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b2c0aa060 0x7f2b2c0ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.705+0000 7f2b2b7fe700 1 -- 172.21.15.1:0/2777073312 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b2c0ab1a0 msgr2=0x7f2b2c144440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.705+0000 7f2b2b7fe700 1 --2- 172.21.15.1:0/2777073312 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b2c0ab1a0 0x7f2b2c144440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.705+0000 7f2b2b7fe700 1 -- 172.21.15.1:0/2777073312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24009370 con 0x7f2b2c154150 2023-11-15T01:36:15.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.705+0000 7f2b2b7fe700 1 --2- 172.21.15.1:0/2777073312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b2c154150 0x7f2b2c156ca0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f2b1c00c810 tx=0x7f2b1c002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:15.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.705+0000 7f2b22ffd700 1 -- 172.21.15.1:0/2777073312 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c010510 con 0x7f2b2c154150 2023-11-15T01:36:15.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.705+0000 7f2b22ffd700 1 -- 172.21.15.1:0/2777073312 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1c010690 con 0x7f2b2c154150 2023-11-15T01:36:15.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.705+0000 7f2b318f7700 1 -- 172.21.15.1:0/2777073312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2c1680d0 con 0x7f2b2c154150 2023-11-15T01:36:15.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.705+0000 7f2b22ffd700 1 -- 172.21.15.1:0/2777073312 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c010a50 con 0x7f2b2c154150 2023-11-15T01:36:15.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.705+0000 7f2b318f7700 1 -- 172.21.15.1:0/2777073312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2c168690 con 0x7f2b2c154150 2023-11-15T01:36:15.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.706+0000 7f2b318f7700 1 -- 172.21.15.1:0/2777073312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2c06c7e0 con 0x7f2b2c154150 2023-11-15T01:36:15.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.707+0000 7f2b22ffd700 1 -- 172.21.15.1:0/2777073312 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2b1c012440 con 0x7f2b2c154150 2023-11-15T01:36:15.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.707+0000 7f2b22ffd700 1 --2- 172.21.15.1:0/2777073312 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2b0c05f270 0x7f2b0c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:15.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.707+0000 7f2b22ffd700 1 -- 172.21.15.1:0/2777073312 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f2b1c079ce0 con 0x7f2b2c154150 2023-11-15T01:36:15.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.707+0000 7f2b2affd700 1 --2- 172.21.15.1:0/2777073312 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2b0c05f270 0x7f2b0c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:15.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.708+0000 7f2b2affd700 1 --2- 172.21.15.1:0/2777073312 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2b0c05f270 0x7f2b0c061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f2b24009130 tx=0x7f2b24015000).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:15.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.711+0000 7f2b22ffd700 1 -- 172.21.15.1:0/2777073312 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2b1c048af0 con 0x7f2b2c154150 2023-11-15T01:36:15.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.925+0000 7f2b318f7700 1 -- 172.21.15.1:0/2777073312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b2c164780 con 0x7f2b2c154150 2023-11-15T01:36:15.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.926+0000 7f2b22ffd700 1 -- 172.21.15.1:0/2777073312 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f2b2c164780 con 0x7f2b2c154150 2023-11-15T01:36:15.928 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:15.928 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2009331607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2009331607},{"type":"v1","addr":"172.21.15.141:6836","nonce":2009331607}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5785,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/1420062353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1420062353},{"type":"v1","addr":"172.21.15.141:6837","nonce":1420062353}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3766593810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3766593810},{"type":"v1","addr":"172.21.15.1:6834","nonce":3766593810}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3751372395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3751372395},{"type":"v1","addr":"172.21.15.1:6835","nonce":3751372395}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-11-15T01:36:15.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.928+0000 7f2b318f7700 1 -- 172.21.15.1:0/2777073312 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2b0c05f270 msgr2=0x7f2b0c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:15.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.928+0000 7f2b318f7700 1 --2- 172.21.15.1:0/2777073312 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2b0c05f270 0x7f2b0c061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f2b24009130 tx=0x7f2b24015000).stop 2023-11-15T01:36:15.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.928+0000 7f2b318f7700 1 -- 172.21.15.1:0/2777073312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b2c154150 msgr2=0x7f2b2c156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:15.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.928+0000 7f2b318f7700 1 --2- 172.21.15.1:0/2777073312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b2c154150 0x7f2b2c156ca0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f2b1c00c810 tx=0x7f2b1c002560).stop 2023-11-15T01:36:15.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.928+0000 7f2b318f7700 1 -- 172.21.15.1:0/2777073312 shutdown_connections 2023-11-15T01:36:15.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.928+0000 7f2b318f7700 1 --2- 172.21.15.1:0/2777073312 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2b0c05f270 0x7f2b0c061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.928+0000 7f2b318f7700 1 --2- 172.21.15.1:0/2777073312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b2c154150 0x7f2b2c156ca0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.928+0000 7f2b318f7700 1 --2- 172.21.15.1:0/2777073312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b2c0aa060 0x7f2b2c0ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.928+0000 7f2b318f7700 1 --2- 172.21.15.1:0/2777073312 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b2c0ab1a0 0x7f2b2c144440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:15.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.928+0000 7f2b318f7700 1 -- 172.21.15.1:0/2777073312 >> 172.21.15.1:0/2777073312 conn(0x7f2b2c064aa0 msgr2=0x7f2b2c0acc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:15.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.928+0000 7f2b318f7700 1 -- 172.21.15.1:0/2777073312 shutdown_connections 2023-11-15T01:36:15.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:15.928+0000 7f2b318f7700 1 -- 172.21.15.1:0/2777073312 wait complete. 2023-11-15T01:36:15.932 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2023-11-15T01:36:15.941 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-15T01:36:15.942 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-15T01:36:15.942 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-15T01:36:15.942 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:36:15.943 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-15T01:36:15.943 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-15T01:36:15.943 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-15T01:36:15.943 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:36:15.944 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-15T01:36:15.944 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-15T01:36:15.944 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-15T01:36:15.944 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:36:15.945 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-15T01:36:15.945 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-15T01:36:15.946 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-15T01:36:15.946 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:36:15.951 INFO:tasks.ceph.mds.a:Stopped 2023-11-15T01:36:15.951 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-15T01:36:15.952 INFO:tasks.ceph.mds.c:Stopped 2023-11-15T01:36:15.953 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-15T01:36:15.955 INFO:tasks.ceph.mds.b:Stopped 2023-11-15T01:36:15.956 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-15T01:36:15.957 INFO:tasks.ceph.mds.d:Stopped 2023-11-15T01:36:15.957 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-15T01:36:15.993 INFO:tasks.ceph.mds.a:Started 2023-11-15T01:36:15.994 DEBUG:teuthology.parallel:result is None 2023-11-15T01:36:15.995 INFO:tasks.ceph.mds.c:Started 2023-11-15T01:36:15.995 DEBUG:teuthology.parallel:result is None 2023-11-15T01:36:15.998 INFO:tasks.ceph.mds.b:Started 2023-11-15T01:36:15.998 DEBUG:teuthology.parallel:result is None 2023-11-15T01:36:15.999 INFO:tasks.ceph.mds.d:Started 2023-11-15T01:36:15.999 DEBUG:teuthology.parallel:result is None 2023-11-15T01:36:16.000 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-15T01:36:16.069 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T01:36:16.069 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-11-15T01:36:16.081 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-15T01:36:16.081 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T01:36:16.082 INFO:tasks.ceph.mds.b.smithi141.stderr:2023-11-15T01:36:16.081+0000 7f5651bc8700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-11-15T01:36:16.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.126+0000 7f6ec150a700 1 Processor -- start 2023-11-15T01:36:16.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.126+0000 7f6ec150a700 1 -- start start 2023-11-15T01:36:16.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.127+0000 7f6ec150a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ebc0be390 0x7f6ebc0bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:16.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.127+0000 7f6ec150a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6ebc0bd8f0 0x7f6ebc154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:16.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.127+0000 7f6ec150a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ebc0ad5e0 con 0x7f6ebc0bdfb0 2023-11-15T01:36:16.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.127+0000 7f6ec150a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ebc0bccd0 con 0x7f6ebc0bd8f0 2023-11-15T01:36:16.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.127+0000 7f6ec150a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0ad8c0 con 0x7f6ebc0be390 2023-11-15T01:36:16.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.128+0000 7f6ebb7fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6ebc0bd8f0 0x7f6ebc154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:16.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.128+0000 7f6eba7fc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ebc0be390 0x7f6ebc0bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:16.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.128+0000 7f6ebb7fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6ebc0bd8f0 0x7f6ebc154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:42054/0 (socket says 172.21.15.1:42054) 2023-11-15T01:36:16.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.128+0000 7f6eba7fc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ebc0be390 0x7f6ebc0bd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:34194/0 (socket says 172.21.15.1:34194) 2023-11-15T01:36:16.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.128+0000 7f6ebb7fe700 1 -- 172.21.15.1:0/3040816639 learned_addr learned my addr 172.21.15.1:0/3040816639 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:16.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.128+0000 7f6ebaffd700 1 --1- 172.21.15.1:0/3040816639 >> v1:172.21.15.141:6789/0 conn(0x7f6ebc0bdfb0 0x7f6ebc0c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:54266/0 (socket says 172.21.15.1:54266) 2023-11-15T01:36:16.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.128+0000 7f6eba7fc700 1 -- 172.21.15.1:0/3040816639 >> v2:172.21.15.141:3300/0 conn(0x7f6ebc0bd8f0 msgr2=0x7f6ebc154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:16.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.128+0000 7f6eba7fc700 1 --2- 172.21.15.1:0/3040816639 >> v2:172.21.15.141:3300/0 conn(0x7f6ebc0bd8f0 0x7f6ebc154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:16.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.128+0000 7f6eba7fc700 1 -- 172.21.15.1:0/3040816639 >> v1:172.21.15.141:6789/0 conn(0x7f6ebc0bdfb0 legacy=0x7f6ebc0c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:16.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.128+0000 7f6eba7fc700 1 -- 172.21.15.1:0/3040816639 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc0adba0 con 0x7f6ebc0be390 2023-11-15T01:36:16.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.128+0000 7f6ebb7fe700 1 --2- 172.21.15.1:0/3040816639 >> v2:172.21.15.141:3300/0 conn(0x7f6ebc0bd8f0 0x7f6ebc154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:16.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.128+0000 7f6eba7fc700 1 --2- 172.21.15.1:0/3040816639 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ebc0be390 0x7f6ebc0bd400 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f6eac009760 tx=0x7f6eac009060).ready entity=mon.2 client_cookie=5075447543ef4398 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:16.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.128+0000 7f6eb9ffb700 1 -- 172.21.15.1:0/3040816639 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00f510 con 0x7f6ebc0be390 2023-11-15T01:36:16.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.128+0000 7f6eb9ffb700 1 -- 172.21.15.1:0/3040816639 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac00f670 con 0x7f6ebc0be390 2023-11-15T01:36:16.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.128+0000 7f6eb9ffb700 1 -- 172.21.15.1:0/3040816639 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00f9f0 con 0x7f6ebc0be390 2023-11-15T01:36:16.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.129+0000 7f6ec150a700 1 -- 172.21.15.1:0/3040816639 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ebc0be390 msgr2=0x7f6ebc0bd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:16.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.129+0000 7f6ec150a700 1 --2- 172.21.15.1:0/3040816639 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ebc0be390 0x7f6ebc0bd400 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f6eac009760 tx=0x7f6eac009060).stop 2023-11-15T01:36:16.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.129+0000 7f6ec150a700 1 -- 172.21.15.1:0/3040816639 shutdown_connections 2023-11-15T01:36:16.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.129+0000 7f6ec150a700 1 --2- 172.21.15.1:0/3040816639 >> v2:172.21.15.141:3300/0 conn(0x7f6ebc0bd8f0 0x7f6ebc154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:16.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.129+0000 7f6ec150a700 1 --2- 172.21.15.1:0/3040816639 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ebc0be390 0x7f6ebc0bd400 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:16.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.129+0000 7f6ec150a700 1 -- 172.21.15.1:0/3040816639 >> 172.21.15.1:0/3040816639 conn(0x7f6ebc0c7d70 msgr2=0x7f6ebc0c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:16.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.129+0000 7f6ec150a700 1 -- 172.21.15.1:0/3040816639 shutdown_connections 2023-11-15T01:36:16.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.129+0000 7f6ec150a700 1 -- 172.21.15.1:0/3040816639 wait complete. 2023-11-15T01:36:16.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.130+0000 7f6ec150a700 1 Processor -- start 2023-11-15T01:36:16.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.130+0000 7f6ec150a700 1 -- start start 2023-11-15T01:36:16.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ec150a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ebc0bd8f0 0x7f6ebc148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:16.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ec150a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ebc0bdfb0 0x7f6ebc0beef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:16.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ec150a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ebc0be390 0x7f6ebc14f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:16.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ec150a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc149440 con 0x7f6ebc0be390 2023-11-15T01:36:16.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ec150a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0aa370 con 0x7f6ebc0bdfb0 2023-11-15T01:36:16.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ec150a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc14df60 con 0x7f6ebc0bd8f0 2023-11-15T01:36:16.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ebb7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ebc0be390 0x7f6ebc14f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:16.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ebb7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ebc0be390 0x7f6ebc14f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56486/0 (socket says 172.21.15.1:56486) 2023-11-15T01:36:16.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ebb7fe700 1 -- 172.21.15.1:0/1533262766 learned_addr learned my addr 172.21.15.1:0/1533262766 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:16.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6eba7fc700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ebc0bdfb0 0x7f6ebc0beef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:16.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ebaffd700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ebc0bd8f0 0x7f6ebc148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:16.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ebb7fe700 1 -- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ebc0bd8f0 msgr2=0x7f6ebc148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:16.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ebb7fe700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ebc0bd8f0 0x7f6ebc148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:16.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ebb7fe700 1 -- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ebc0bdfb0 msgr2=0x7f6ebc0beef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:16.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ebb7fe700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ebc0bdfb0 0x7f6ebc0beef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:16.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ebb7fe700 1 -- 172.21.15.1:0/1533262766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb4009ae0 con 0x7f6ebc0be390 2023-11-15T01:36:16.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ebaffd700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ebc0bd8f0 0x7f6ebc148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:16.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6eba7fc700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ebc0bdfb0 0x7f6ebc0beef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:16.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.131+0000 7f6ebb7fe700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ebc0be390 0x7f6ebc14f2e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f6eb4009fa0 tx=0x7f6eb400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:16.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.132+0000 7f6ea2ffd700 1 -- 172.21.15.1:0/1533262766 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb400caf0 con 0x7f6ebc0be390 2023-11-15T01:36:16.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.132+0000 7f6ea2ffd700 1 -- 172.21.15.1:0/1533262766 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb400f040 con 0x7f6ebc0be390 2023-11-15T01:36:16.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.132+0000 7f6ec150a700 1 -- 172.21.15.1:0/1533262766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac0092a0 con 0x7f6ebc0be390 2023-11-15T01:36:16.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.132+0000 7f6ea2ffd700 1 -- 172.21.15.1:0/1533262766 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb400ce60 con 0x7f6ebc0be390 2023-11-15T01:36:16.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.132+0000 7f6ec150a700 1 -- 172.21.15.1:0/1533262766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ebc14e520 con 0x7f6ebc0be390 2023-11-15T01:36:16.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.133+0000 7f6ec150a700 1 -- 172.21.15.1:0/1533262766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ebc06c7e0 con 0x7f6ebc0be390 2023-11-15T01:36:16.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.133+0000 7f6ea2ffd700 1 -- 172.21.15.1:0/1533262766 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6eb4007400 con 0x7f6ebc0be390 2023-11-15T01:36:16.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.133+0000 7f6ea2ffd700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ea805f270 0x7f6ea8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:16.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.133+0000 7f6ea2ffd700 1 -- 172.21.15.1:0/1533262766 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f6eb407a4b0 con 0x7f6ebc0be390 2023-11-15T01:36:16.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.134+0000 7f6ebaffd700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ea805f270 0x7f6ea8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:16.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.134+0000 7f6ebaffd700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ea805f270 0x7f6ea8061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f6eb00076b0 tx=0x7f6eb0007c00).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:16.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.137+0000 7f6ea2ffd700 1 -- 172.21.15.1:0/1533262766 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6eb404aaf0 con 0x7f6ebc0be390 2023-11-15T01:36:16.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:16.325+0000 7f6ec150a700 1 -- 172.21.15.1:0/1533262766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6ebc06a530 con 0x7f6ebc0be390 2023-11-15T01:36:17.084 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:36:17.087 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:36:17.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.152+0000 7f6ea2ffd700 1 -- 172.21.15.1:0/1533262766 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6eb404b5f0 con 0x7f6ebc0be390 2023-11-15T01:36:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.154+0000 7f6ec150a700 1 -- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ea805f270 msgr2=0x7f6ea8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.154+0000 7f6ec150a700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ea805f270 0x7f6ea8061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f6eb00076b0 tx=0x7f6eb0007c00).stop 2023-11-15T01:36:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.154+0000 7f6ec150a700 1 -- 172.21.15.1:0/1533262766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ebc0be390 msgr2=0x7f6ebc14f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.154+0000 7f6ec150a700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ebc0be390 0x7f6ebc14f2e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f6eb4009fa0 tx=0x7f6eb400b040).stop 2023-11-15T01:36:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.154+0000 7f6ec150a700 1 -- 172.21.15.1:0/1533262766 shutdown_connections 2023-11-15T01:36:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.154+0000 7f6ec150a700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ea805f270 0x7f6ea8061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.154+0000 7f6ec150a700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ebc0be390 0x7f6ebc14f2e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.154+0000 7f6ec150a700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ebc0bd8f0 0x7f6ebc148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.154+0000 7f6ec150a700 1 --2- 172.21.15.1:0/1533262766 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ebc0bdfb0 0x7f6ebc0beef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.154+0000 7f6ec150a700 1 -- 172.21.15.1:0/1533262766 >> 172.21.15.1:0/1533262766 conn(0x7f6ebc0c7d70 msgr2=0x7f6ebc0662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.154+0000 7f6ec150a700 1 -- 172.21.15.1:0/1533262766 shutdown_connections 2023-11-15T01:36:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.154+0000 7f6ec150a700 1 -- 172.21.15.1:0/1533262766 wait complete. 2023-11-15T01:36:17.159 INFO:teuthology.orchestra.run.smithi001.stderr: removed all blocklist entries 2023-11-15T01:36:17.170 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-15T01:36:17.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.331+0000 7ff08e096700 1 Processor -- start 2023-11-15T01:36:17.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.331+0000 7ff08e096700 1 -- start start 2023-11-15T01:36:17.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.331+0000 7ff08e096700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff088158000 0x7ff088154560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:17.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.331+0000 7ff08e096700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff0880aa640 0x7ff0880c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:17.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff08e096700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff088064e80 con 0x7ff088154180 2023-11-15T01:36:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff08e096700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0881585e0 con 0x7ff0880aa640 2023-11-15T01:36:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff08e096700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0881588c0 con 0x7ff088158000 2023-11-15T01:36:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0877fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff088154180 0x7ff088063bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53016/0 (socket says 172.21.15.1:53016) 2023-11-15T01:36:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0877fe700 1 -- 172.21.15.1:0/2367578587 learned_addr learned my addr 172.21.15.1:0/2367578587 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff086ffd700 1 --2- 172.21.15.1:0/2367578587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff088158000 0x7ff088154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff087fff700 1 --2- 172.21.15.1:0/2367578587 >> v2:172.21.15.141:3300/0 conn(0x7ff0880aa640 0x7ff0880c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 -- 172.21.15.1:0/2367578587 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141313417 0 0) 0x7ff088064e80 con 0x7ff088154180 2023-11-15T01:36:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 -- 172.21.15.1:0/2367578587 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0700033f0 con 0x7ff088154180 2023-11-15T01:36:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 -- 172.21.15.1:0/2367578587 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1024872702 0 0) 0x7ff0700033f0 con 0x7ff088154180 2023-11-15T01:36:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 -- 172.21.15.1:0/2367578587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff088158000 msgr2=0x7ff088154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 --2- 172.21.15.1:0/2367578587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff088158000 0x7ff088154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 -- 172.21.15.1:0/2367578587 >> v2:172.21.15.141:3300/0 conn(0x7ff0880aa640 msgr2=0x7ff0880c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 --2- 172.21.15.1:0/2367578587 >> v2:172.21.15.141:3300/0 conn(0x7ff0880aa640 0x7ff0880c1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 -- 172.21.15.1:0/2367578587 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088158ba0 con 0x7ff088154180 2023-11-15T01:36:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 -- 172.21.15.1:0/2367578587 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7ff078001470 con 0x7ff088154180 2023-11-15T01:36:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 -- 172.21.15.1:0/2367578587 >> v1:172.21.15.1:6789/0 conn(0x7ff088154180 legacy=0x7ff088063bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 --2- 172.21.15.1:0/2367578587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff088158000 0x7ff0700038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 --2- 172.21.15.1:0/2367578587 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff070003e10 0x7ff070004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 --2- 172.21.15.1:0/2367578587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff070004b80 0x7ff070005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 -- 172.21.15.1:0/2367578587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0881585e0 con 0x7ff070004b80 2023-11-15T01:36:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 -- 172.21.15.1:0/2367578587 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0881588c0 con 0x7ff070003e10 2023-11-15T01:36:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.332+0000 7ff0867fc700 1 -- 172.21.15.1:0/2367578587 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07000b8e0 con 0x7ff088158000 2023-11-15T01:36:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff087fff700 1 --2- 172.21.15.1:0/2367578587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff070004b80 0x7ff070005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff0877fe700 1 --2- 172.21.15.1:0/2367578587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff088158000 0x7ff0700038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff086ffd700 1 --2- 172.21.15.1:0/2367578587 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff070003e10 0x7ff070004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff087fff700 1 -- 172.21.15.1:0/2367578587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff088158000 msgr2=0x7ff0700038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff087fff700 1 --2- 172.21.15.1:0/2367578587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff088158000 0x7ff0700038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff087fff700 1 -- 172.21.15.1:0/2367578587 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff070003e10 msgr2=0x7ff070004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff087fff700 1 --2- 172.21.15.1:0/2367578587 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff070003e10 0x7ff070004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff087fff700 1 -- 172.21.15.1:0/2367578587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0700033f0 con 0x7ff070004b80 2023-11-15T01:36:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff086ffd700 1 --2- 172.21.15.1:0/2367578587 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff070003e10 0x7ff070004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff087fff700 1 --2- 172.21.15.1:0/2367578587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff070004b80 0x7ff070005000 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7ff08000e240 tx=0x7ff08000b040).ready entity=mon.0 client_cookie=5877fb7a785fc241 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff0867fc700 1 -- 172.21.15.1:0/2367578587 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080009ac0 con 0x7ff070004b80 2023-11-15T01:36:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff0867fc700 1 -- 172.21.15.1:0/2367578587 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08000f040 con 0x7ff070004b80 2023-11-15T01:36:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff0867fc700 1 -- 172.21.15.1:0/2367578587 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08000ed00 con 0x7ff070004b80 2023-11-15T01:36:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff08e096700 1 -- 172.21.15.1:0/2367578587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff070004b80 msgr2=0x7ff070005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff08e096700 1 --2- 172.21.15.1:0/2367578587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff070004b80 0x7ff070005000 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7ff08000e240 tx=0x7ff08000b040).stop 2023-11-15T01:36:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.333+0000 7ff087fff700 1 -- 172.21.15.1:0/2367578587 reap_dead start 2023-11-15T01:36:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.334+0000 7ff08e096700 1 -- 172.21.15.1:0/2367578587 shutdown_connections 2023-11-15T01:36:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.334+0000 7ff08e096700 1 -- 172.21.15.1:0/2367578587 >> 172.21.15.1:0/2367578587 conn(0x7ff0880c74f0 msgr2=0x7ff0880c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.334+0000 7ff08e096700 1 -- 172.21.15.1:0/2367578587 shutdown_connections 2023-11-15T01:36:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.334+0000 7ff08e096700 1 -- 172.21.15.1:0/2367578587 wait complete. 2023-11-15T01:36:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.335+0000 7ff08e096700 1 Processor -- start 2023-11-15T01:36:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.335+0000 7ff08e096700 1 -- start start 2023-11-15T01:36:17.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff08e096700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff088167a50 0x7ff0881564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:17.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff08e096700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff088151aa0 0x7ff088167e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:17.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff08e096700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff088168320 0x7ff0880a6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:17.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff08e096700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff088156d10 con 0x7ff088168320 2023-11-15T01:36:17.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff08e096700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff088156ff0 con 0x7ff088167a50 2023-11-15T01:36:17.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff08e096700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0881572d0 con 0x7ff088151aa0 2023-11-15T01:36:17.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff087fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff088168320 0x7ff0880a6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:17.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff087fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff088168320 0x7ff0880a6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56500/0 (socket says 172.21.15.1:56500) 2023-11-15T01:36:17.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff087fff700 1 -- 172.21.15.1:0/1504919295 learned_addr learned my addr 172.21.15.1:0/1504919295 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:17.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff0877fe700 1 --2- 172.21.15.1:0/1504919295 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff088167a50 0x7ff0881564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:17.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff086ffd700 1 --2- 172.21.15.1:0/1504919295 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff088151aa0 0x7ff088167e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:17.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff087fff700 1 -- 172.21.15.1:0/1504919295 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff088151aa0 msgr2=0x7ff088167e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:17.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff087fff700 1 --2- 172.21.15.1:0/1504919295 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff088151aa0 0x7ff088167e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff087fff700 1 -- 172.21.15.1:0/1504919295 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff088167a50 msgr2=0x7ff0881564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff087fff700 1 --2- 172.21.15.1:0/1504919295 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff088167a50 0x7ff0881564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff087fff700 1 -- 172.21.15.1:0/1504919295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0880a4930 con 0x7ff088168320 2023-11-15T01:36:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff0877fe700 1 --2- 172.21.15.1:0/1504919295 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff088167a50 0x7ff0881564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff087fff700 1 --2- 172.21.15.1:0/1504919295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff088168320 0x7ff0880a6bc0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7ff080014000 tx=0x7ff08001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff06f7fe700 1 -- 172.21.15.1:0/1504919295 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080021030 con 0x7ff088168320 2023-11-15T01:36:17.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff06f7fe700 1 -- 172.21.15.1:0/1504919295 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff080009ac0 con 0x7ff088168320 2023-11-15T01:36:17.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff06f7fe700 1 -- 172.21.15.1:0/1504919295 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08001d650 con 0x7ff088168320 2023-11-15T01:36:17.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff08e096700 1 -- 172.21.15.1:0/1504919295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0880a4c10 con 0x7ff088168320 2023-11-15T01:36:17.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.336+0000 7ff08e096700 1 -- 172.21.15.1:0/1504919295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0881687a0 con 0x7ff088168320 2023-11-15T01:36:17.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.337+0000 7ff08e096700 1 -- 172.21.15.1:0/1504919295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08806c7e0 con 0x7ff088168320 2023-11-15T01:36:17.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.338+0000 7ff06f7fe700 1 -- 172.21.15.1:0/1504919295 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff080024070 con 0x7ff088168320 2023-11-15T01:36:17.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.338+0000 7ff06f7fe700 1 --2- 172.21.15.1:0/1504919295 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff07405f270 0x7ff074061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:17.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.338+0000 7ff06f7fe700 1 -- 172.21.15.1:0/1504919295 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5693+0+0 (secure 0 0 0) 0x7ff080022070 con 0x7ff088168320 2023-11-15T01:36:17.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.338+0000 7ff0877fe700 1 --2- 172.21.15.1:0/1504919295 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff07405f270 0x7ff074061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:17.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.338+0000 7ff0877fe700 1 --2- 172.21.15.1:0/1504919295 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff07405f270 0x7ff074061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff078000e10 tx=0x7ff078009040).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:17.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.342+0000 7ff06f7fe700 1 -- 172.21.15.1:0/1504919295 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff08004ca20 con 0x7ff088168320 2023-11-15T01:36:17.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.582+0000 7ff08e096700 1 -- 172.21.15.1:0/1504919295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff088158e80 con 0x7ff088168320 2023-11-15T01:36:17.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.583+0000 7ff06f7fe700 1 -- 172.21.15.1:0/1504919295 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff080050040 con 0x7ff088168320 2023-11-15T01:36:17.585 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:17.585 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T01:36:17.585 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_dump": [ 2023-11-15T01:36:17.585 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.586 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.a", 2023-11-15T01:36:17.586 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlmtf5GBAA2CojasXoquGQ9L5rKjVwTQ==", 2023-11-15T01:36:17.586 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.586 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:17.586 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:36:17.587 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:36:17.587 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:17.587 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.588 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.588 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.588 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.b", 2023-11-15T01:36:17.588 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl/Y5mJBAAz7iLl3kBJ8kSsyTetTZByw==", 2023-11-15T01:36:17.588 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.589 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:17.589 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:36:17.589 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:36:17.589 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:17.589 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.590 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.590 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.590 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.c", 2023-11-15T01:36:17.590 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlWTrwHxAAqLVpwNca0vAXUBFnWUN3pg==", 2023-11-15T01:36:17.591 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.591 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:17.591 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:36:17.591 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:36:17.591 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:17.591 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.592 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.592 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.592 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.d", 2023-11-15T01:36:17.592 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlVwUnKxAAhx2/mX1ljgQwJLagVpmZIA==", 2023-11-15T01:36:17.592 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.593 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:17.593 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:36:17.593 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:36:17.593 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:17.593 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.594 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.594 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.0", 2023-11-15T01:36:17.594 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDxHFRlII6rERAA/kvPPhTPHHy6pu5wSPsR/A==", 2023-11-15T01:36:17.594 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.594 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:17.595 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:17.595 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:17.595 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.595 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.595 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.595 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.1", 2023-11-15T01:36:17.596 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD0HFRlPkstEBAAqx31fnNonRCVh98eY6qbxQ==", 2023-11-15T01:36:17.596 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.596 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:17.596 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:17.596 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:17.597 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.597 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.597 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.2", 2023-11-15T01:36:17.598 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD3HFRl8e3nDRAAKigcbIo0/BFo0Qi6rV+amQ==", 2023-11-15T01:36:17.598 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.598 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:17.598 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:17.598 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:17.599 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.599 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.599 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.3", 2023-11-15T01:36:17.599 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD6HFRlbwDTCxAAkWv04RyNqW4p8pOqvYCS3A==", 2023-11-15T01:36:17.600 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.600 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:17.600 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:17.600 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:17.600 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.601 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.601 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.601 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.4", 2023-11-15T01:36:17.601 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAAHVRlTQihDxAA/HcZbSytP9qD5PsTjvJBoA==", 2023-11-15T01:36:17.601 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.601 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:17.602 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:17.602 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:17.602 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.603 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.603 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.5", 2023-11-15T01:36:17.603 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQADHVRlQ2hjDRAAFiI+hKubCPcZ/1AJVu1fvQ==", 2023-11-15T01:36:17.603 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.603 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:17.603 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:17.604 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:17.604 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.604 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.604 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.604 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.6", 2023-11-15T01:36:17.605 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAGHVRl/KEbCxAAmKTnRU4m4qNzX+SVcFY+Qw==", 2023-11-15T01:36:17.605 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.605 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:17.605 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:17.605 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:17.606 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.606 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.606 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.606 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.7", 2023-11-15T01:36:17.607 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAJHVRl4wOFCBAAAiGT4UPE5vSb2LjqgGgGFw==", 2023-11-15T01:36:17.607 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.607 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:17.607 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:17.607 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:17.608 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.608 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.608 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.608 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.0", 2023-11-15T01:36:17.609 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl2hkHLxAAxQE/Cslig6gmXR/xcVlRuw==", 2023-11-15T01:36:17.609 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.609 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:17.609 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow r", 2023-11-15T01:36:17.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-15T01:36:17.610 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.610 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.610 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.610 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.1", 2023-11-15T01:36:17.611 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRltolkNxAAXmQ4yXOlavwqKq2jFKwsYQ==", 2023-11-15T01:36:17.611 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.611 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:17.611 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:36:17.611 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:36:17.612 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:36:17.612 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.612 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.612 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.2", 2023-11-15T01:36:17.613 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlFrJvNBAAH97x7ERzuzpWrUALO+HvpA==", 2023-11-15T01:36:17.613 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.613 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:17.613 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:36:17.613 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:36:17.613 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:36:17.614 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.614 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.614 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.3", 2023-11-15T01:36:17.614 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDwHFRlko0ZARAA2RqeRJGwWns00DeWgd/9hA==", 2023-11-15T01:36:17.615 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.615 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:17.615 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:36:17.615 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:36:17.615 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:36:17.616 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.616 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.616 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.616 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.admin", 2023-11-15T01:36:17.616 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDuHFRlxIQDORAALrVIyQoaVSADkyv9yzMaZw==", 2023-11-15T01:36:17.617 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.617 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:36:17.617 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:36:17.617 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:36:17.617 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:17.618 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.618 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.618 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.618 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.x", 2023-11-15T01:36:17.619 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlnyjlFRAAjJwtxkAvJ0ZGmvOOawQseQ==", 2023-11-15T01:36:17.619 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.619 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:36:17.619 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T01:36:17.619 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:17.620 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.620 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:17.620 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:17.620 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.y", 2023-11-15T01:36:17.620 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl8nW3ERAA4CJQt/ZEZCJ9UaRRuEHfzw==", 2023-11-15T01:36:17.621 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:17.621 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:36:17.621 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T01:36:17.621 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:17.622 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.622 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:17.622 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2023-11-15T01:36:17.622 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T01:36:17.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.584+0000 7ff08e096700 1 -- 172.21.15.1:0/1504919295 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff07405f270 msgr2=0x7ff074061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:17.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.584+0000 7ff08e096700 1 --2- 172.21.15.1:0/1504919295 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff07405f270 0x7ff074061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff078000e10 tx=0x7ff078009040).stop 2023-11-15T01:36:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.584+0000 7ff08e096700 1 -- 172.21.15.1:0/1504919295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff088168320 msgr2=0x7ff0880a6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.584+0000 7ff08e096700 1 --2- 172.21.15.1:0/1504919295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff088168320 0x7ff0880a6bc0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7ff080014000 tx=0x7ff08001a000).stop 2023-11-15T01:36:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.584+0000 7ff08e096700 1 -- 172.21.15.1:0/1504919295 shutdown_connections 2023-11-15T01:36:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.584+0000 7ff08e096700 1 --2- 172.21.15.1:0/1504919295 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff07405f270 0x7ff074061730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.584+0000 7ff08e096700 1 --2- 172.21.15.1:0/1504919295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff088168320 0x7ff0880a6bc0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.584+0000 7ff08e096700 1 --2- 172.21.15.1:0/1504919295 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff088167a50 0x7ff0881564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.584+0000 7ff08e096700 1 --2- 172.21.15.1:0/1504919295 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff088151aa0 0x7ff088167e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.585+0000 7ff08e096700 1 -- 172.21.15.1:0/1504919295 >> 172.21.15.1:0/1504919295 conn(0x7ff0880c74f0 msgr2=0x7ff0880ad000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:17.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.585+0000 7ff08e096700 1 -- 172.21.15.1:0/1504919295 shutdown_connections 2023-11-15T01:36:17.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.585+0000 7ff08e096700 1 -- 172.21.15.1:0/1504919295 wait complete. 2023-11-15T01:36:17.627 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:36:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.744+0000 7f6ecbb0c700 1 Processor -- start 2023-11-15T01:36:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.745+0000 7f6ecbb0c700 1 -- start start 2023-11-15T01:36:17.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.745+0000 7f6ecbb0c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6ec40c6620 0x7f6ec4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:17.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.745+0000 7f6ecbb0c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec40c06f0 con 0x7f6ec40ab1a0 2023-11-15T01:36:17.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.745+0000 7f6ecbb0c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec40c09d0 con 0x7f6ec4154150 2023-11-15T01:36:17.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.746+0000 7f6ecbb0c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec4158820 con 0x7f6ec40c6620 2023-11-15T01:36:17.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.746+0000 7f6ec90a7700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6ec40ab1a0 0x7f6ec40c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39028/0 (socket says 172.21.15.1:39028) 2023-11-15T01:36:17.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.746+0000 7f6ec90a7700 1 -- 172.21.15.1:0/2390382985 learned_addr learned my addr 172.21.15.1:0/2390382985 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:17.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.746+0000 7f6eca0a9700 1 --2- 172.21.15.1:0/2390382985 >> v2:172.21.15.141:3300/0 conn(0x7f6ec40c6620 0x7f6ec4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:17.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.746+0000 7f6ec88a6700 1 -- 172.21.15.1:0/2390382985 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358298543 0 0) 0x7f6ec40c06f0 con 0x7f6ec40ab1a0 2023-11-15T01:36:17.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.746+0000 7f6ec88a6700 1 -- 172.21.15.1:0/2390382985 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eac0033f0 con 0x7f6ec40ab1a0 2023-11-15T01:36:17.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.746+0000 7f6eca0a9700 1 -- 172.21.15.1:0/2390382985 >> v1:172.21.15.141:6789/0 conn(0x7f6ec4154150 legacy=0x7f6ec4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:17.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.746+0000 7f6eca0a9700 1 -- 172.21.15.1:0/2390382985 >> v1:172.21.15.1:6789/0 conn(0x7f6ec40ab1a0 legacy=0x7f6ec40c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:17.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.746+0000 7f6eca0a9700 1 -- 172.21.15.1:0/2390382985 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec4158b00 con 0x7f6ec40c6620 2023-11-15T01:36:17.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.746+0000 7f6eca0a9700 1 --2- 172.21.15.1:0/2390382985 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec40c6620 0x7f6ec4154530 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f6eb4009760 tx=0x7f6eb4009060).ready entity=mon.1 client_cookie=bf7ead5e2d584a6f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:17.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.746+0000 7f6ec88a6700 1 -- 172.21.15.1:0/2390382985 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb40090d0 con 0x7f6ec40c6620 2023-11-15T01:36:17.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.746+0000 7f6ec88a6700 1 -- 172.21.15.1:0/2390382985 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb400f510 con 0x7f6ec40c6620 2023-11-15T01:36:17.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.746+0000 7f6ec88a6700 1 -- 172.21.15.1:0/2390382985 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb400f890 con 0x7f6ec40c6620 2023-11-15T01:36:17.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.747+0000 7f6ecbb0c700 1 -- 172.21.15.1:0/2390382985 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec40c6620 msgr2=0x7f6ec4154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:17.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.747+0000 7f6ecbb0c700 1 --2- 172.21.15.1:0/2390382985 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec40c6620 0x7f6ec4154530 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f6eb4009760 tx=0x7f6eb4009060).stop 2023-11-15T01:36:17.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.747+0000 7f6ecbb0c700 1 -- 172.21.15.1:0/2390382985 shutdown_connections 2023-11-15T01:36:17.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.747+0000 7f6ecbb0c700 1 --2- 172.21.15.1:0/2390382985 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec40c6620 0x7f6ec4154530 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.747+0000 7f6ecbb0c700 1 -- 172.21.15.1:0/2390382985 >> 172.21.15.1:0/2390382985 conn(0x7f6ec4064aa0 msgr2=0x7f6ec4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:17.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.747+0000 7f6ecbb0c700 1 -- 172.21.15.1:0/2390382985 shutdown_connections 2023-11-15T01:36:17.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.747+0000 7f6ecbb0c700 1 -- 172.21.15.1:0/2390382985 wait complete. 2023-11-15T01:36:17.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.748+0000 7f6ecbb0c700 1 Processor -- start 2023-11-15T01:36:17.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.748+0000 7f6ecbb0c700 1 -- start start 2023-11-15T01:36:17.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6ecbb0c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec40ab1a0 0x7f6ec41479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:17.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6ecbb0c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ec40c6620 0x7f6ec40ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:17.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6ecbb0c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec4154150 0x7f6ec40acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:17.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6ecbb0c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec40ad020 con 0x7f6ec40c6620 2023-11-15T01:36:17.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6ecbb0c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec40af630 con 0x7f6ec4154150 2023-11-15T01:36:17.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6ecbb0c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec41559e0 con 0x7f6ec40ab1a0 2023-11-15T01:36:17.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6ec90a7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ec40c6620 0x7f6ec40ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:17.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6ec90a7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ec40c6620 0x7f6ec40ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49148/0 (socket says 172.21.15.1:49148) 2023-11-15T01:36:17.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6ec90a7700 1 -- 172.21.15.1:0/989485569 learned_addr learned my addr 172.21.15.1:0/989485569 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:17.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6ec98a8700 1 --2- 172.21.15.1:0/989485569 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec40ab1a0 0x7f6ec41479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:17.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6eca0a9700 1 --2- 172.21.15.1:0/989485569 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec4154150 0x7f6ec40acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:17.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6ec90a7700 1 -- 172.21.15.1:0/989485569 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec40ab1a0 msgr2=0x7f6ec41479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:17.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6ec90a7700 1 --2- 172.21.15.1:0/989485569 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec40ab1a0 0x7f6ec41479f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6ec90a7700 1 -- 172.21.15.1:0/989485569 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec4154150 msgr2=0x7f6ec40acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:17.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6ec90a7700 1 --2- 172.21.15.1:0/989485569 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec4154150 0x7f6ec40acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.749+0000 7f6ec90a7700 1 -- 172.21.15.1:0/989485569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb40092a0 con 0x7f6ec40c6620 2023-11-15T01:36:17.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.750+0000 7f6ec90a7700 1 --2- 172.21.15.1:0/989485569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ec40c6620 0x7f6ec40ac640 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f6eb800c590 tx=0x7f6eb8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:17.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.750+0000 7f6ec1ffb700 1 -- 172.21.15.1:0/989485569 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb80072e0 con 0x7f6ec40c6620 2023-11-15T01:36:17.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.750+0000 7f6ec1ffb700 1 -- 172.21.15.1:0/989485569 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8007440 con 0x7f6ec40c6620 2023-11-15T01:36:17.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.750+0000 7f6ec1ffb700 1 -- 172.21.15.1:0/989485569 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb80057a0 con 0x7f6ec40c6620 2023-11-15T01:36:17.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.750+0000 7f6ecbb0c700 1 -- 172.21.15.1:0/989485569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec4155cc0 con 0x7f6ec40c6620 2023-11-15T01:36:17.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.750+0000 7f6ecbb0c700 1 -- 172.21.15.1:0/989485569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec4156280 con 0x7f6ec40c6620 2023-11-15T01:36:17.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.751+0000 7f6ecbb0c700 1 -- 172.21.15.1:0/989485569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec406c7e0 con 0x7f6ec40c6620 2023-11-15T01:36:17.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.751+0000 7f6ec1ffb700 1 -- 172.21.15.1:0/989485569 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6eb8005bd0 con 0x7f6ec40c6620 2023-11-15T01:36:17.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.751+0000 7f6ec1ffb700 1 --2- 172.21.15.1:0/989485569 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6eb005f270 0x7f6eb0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:17.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.752+0000 7f6ec1ffb700 1 -- 172.21.15.1:0/989485569 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5693+0+0 (secure 0 0 0) 0x7f6eb80799e0 con 0x7f6ec40c6620 2023-11-15T01:36:17.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.752+0000 7f6ec98a8700 1 --2- 172.21.15.1:0/989485569 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6eb005f270 0x7f6eb0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:17.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.752+0000 7f6ec98a8700 1 --2- 172.21.15.1:0/989485569 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6eb005f270 0x7f6eb0061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6ebc004290 tx=0x7f6ebc0014c0).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:17.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.756+0000 7f6ec1ffb700 1 -- 172.21.15.1:0/989485569 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6eb804ace0 con 0x7f6ec40c6620 2023-11-15T01:36:17.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.930+0000 7f6ecbb0c700 1 -- 172.21.15.1:0/989485569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ec40c1c50 con 0x7f6ec40c6620 2023-11-15T01:36:17.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.931+0000 7f6ec1ffb700 1 -- 172.21.15.1:0/989485569 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+14308 (secure 0 0 0) 0x7f6eb804e300 con 0x7f6ec40c6620 2023-11-15T01:36:17.932 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:17.933 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":75,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:36:17.147341+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:36:17.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.932+0000 7f6ecbb0c700 1 -- 172.21.15.1:0/989485569 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6eb005f270 msgr2=0x7f6eb0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:17.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.932+0000 7f6ecbb0c700 1 --2- 172.21.15.1:0/989485569 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6eb005f270 0x7f6eb0061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6ebc004290 tx=0x7f6ebc0014c0).stop 2023-11-15T01:36:17.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.932+0000 7f6ecbb0c700 1 -- 172.21.15.1:0/989485569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ec40c6620 msgr2=0x7f6ec40ac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:17.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.932+0000 7f6ecbb0c700 1 --2- 172.21.15.1:0/989485569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ec40c6620 0x7f6ec40ac640 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f6eb800c590 tx=0x7f6eb8007c80).stop 2023-11-15T01:36:17.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.933+0000 7f6ecbb0c700 1 -- 172.21.15.1:0/989485569 shutdown_connections 2023-11-15T01:36:17.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.933+0000 7f6ecbb0c700 1 --2- 172.21.15.1:0/989485569 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6eb005f270 0x7f6eb0061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.933+0000 7f6ecbb0c700 1 --2- 172.21.15.1:0/989485569 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec4154150 0x7f6ec40acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.933+0000 7f6ecbb0c700 1 --2- 172.21.15.1:0/989485569 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec40ab1a0 0x7f6ec41479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.933+0000 7f6ecbb0c700 1 --2- 172.21.15.1:0/989485569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ec40c6620 0x7f6ec40ac640 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:17.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.933+0000 7f6ecbb0c700 1 -- 172.21.15.1:0/989485569 >> 172.21.15.1:0/989485569 conn(0x7f6ec4064aa0 msgr2=0x7f6ec414e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:17.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.933+0000 7f6ecbb0c700 1 -- 172.21.15.1:0/989485569 shutdown_connections 2023-11-15T01:36:17.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:17.933+0000 7f6ecbb0c700 1 -- 172.21.15.1:0/989485569 wait complete. 2023-11-15T01:36:17.946 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-15T01:36:17.947 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:36:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.066+0000 7fd897868700 1 Processor -- start 2023-11-15T01:36:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.067+0000 7fd897868700 1 -- start start 2023-11-15T01:36:18.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.067+0000 7fd897868700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd890154480 0x7fd8900c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.067+0000 7fd897868700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8900c6430 0x7fd8900aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.068+0000 7fd897868700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8900ca050 con 0x7fd8901540a0 2023-11-15T01:36:18.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.068+0000 7fd897868700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8900c68c0 con 0x7fd890154480 2023-11-15T01:36:18.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.068+0000 7fd897868700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8900c9440 con 0x7fd8900c6430 2023-11-15T01:36:18.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.068+0000 7fd895e05700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8900c6430 0x7fd8900aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.068+0000 7fd895604700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fd8901540a0 0x7fd8900ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:56386/0 (socket says 172.21.15.1:56386) 2023-11-15T01:36:18.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.068+0000 7fd895604700 1 -- 172.21.15.1:0/1950362138 learned_addr learned my addr 172.21.15.1:0/1950362138 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:18.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.068+0000 7fd894e03700 1 --2- 172.21.15.1:0/1950362138 >> v2:172.21.15.141:3300/0 conn(0x7fd890154480 0x7fd8900c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.068+0000 7fd894e03700 1 -- 172.21.15.1:0/1950362138 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8900c6430 msgr2=0x7fd8900aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:18.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.068+0000 7fd894e03700 1 --2- 172.21.15.1:0/1950362138 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8900c6430 0x7fd8900aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.068+0000 7fd894e03700 1 -- 172.21.15.1:0/1950362138 >> v1:172.21.15.141:6789/0 conn(0x7fd8901540a0 legacy=0x7fd8900ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.068+0000 7fd894e03700 1 -- 172.21.15.1:0/1950362138 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8900c9720 con 0x7fd890154480 2023-11-15T01:36:18.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.068+0000 7fd88ffff700 1 -- 172.21.15.1:0/1950362138 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986552476 0 0) 0x7fd8900ca050 con 0x7fd8901540a0 2023-11-15T01:36:18.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.068+0000 7fd894e03700 1 --2- 172.21.15.1:0/1950362138 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd890154480 0x7fd8900c5f40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fd884009760 tx=0x7fd884009060).ready entity=mon.1 client_cookie=1866410160d2e99d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:18.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.068+0000 7fd88ffff700 1 -- 172.21.15.1:0/1950362138 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88400f510 con 0x7fd890154480 2023-11-15T01:36:18.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.069+0000 7fd88ffff700 1 -- 172.21.15.1:0/1950362138 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88400f670 con 0x7fd890154480 2023-11-15T01:36:18.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.069+0000 7fd88ffff700 1 -- 172.21.15.1:0/1950362138 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88400f9f0 con 0x7fd890154480 2023-11-15T01:36:18.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.069+0000 7fd897868700 1 -- 172.21.15.1:0/1950362138 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd890154480 msgr2=0x7fd8900c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.069+0000 7fd897868700 1 --2- 172.21.15.1:0/1950362138 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd890154480 0x7fd8900c5f40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fd884009760 tx=0x7fd884009060).stop 2023-11-15T01:36:18.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.069+0000 7fd897868700 1 -- 172.21.15.1:0/1950362138 shutdown_connections 2023-11-15T01:36:18.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.069+0000 7fd897868700 1 --2- 172.21.15.1:0/1950362138 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8900c6430 0x7fd8900aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.069+0000 7fd897868700 1 --2- 172.21.15.1:0/1950362138 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd890154480 0x7fd8900c5f40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.069+0000 7fd897868700 1 -- 172.21.15.1:0/1950362138 >> 172.21.15.1:0/1950362138 conn(0x7fd890064a70 msgr2=0x7fd890064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:18.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.069+0000 7fd897868700 1 -- 172.21.15.1:0/1950362138 shutdown_connections 2023-11-15T01:36:18.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.069+0000 7fd897868700 1 -- 172.21.15.1:0/1950362138 wait complete. 2023-11-15T01:36:18.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.070+0000 7fd897868700 1 Processor -- start 2023-11-15T01:36:18.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.070+0000 7fd897868700 1 -- start start 2023-11-15T01:36:18.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.071+0000 7fd897868700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8900c6430 0x7fd890152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.071+0000 7fd897868700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8901540a0 0x7fd8900aa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.071+0000 7fd897868700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd890154480 0x7fd8900b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.071+0000 7fd897868700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd890152930 con 0x7fd890154480 2023-11-15T01:36:18.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.071+0000 7fd897868700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd890168530 con 0x7fd8901540a0 2023-11-15T01:36:18.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.071+0000 7fd897868700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd890152650 con 0x7fd8900c6430 2023-11-15T01:36:18.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.071+0000 7fd895e05700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd890154480 0x7fd8900b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.071+0000 7fd895e05700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd890154480 0x7fd8900b0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49160/0 (socket says 172.21.15.1:49160) 2023-11-15T01:36:18.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.071+0000 7fd895e05700 1 -- 172.21.15.1:0/792046344 learned_addr learned my addr 172.21.15.1:0/792046344 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:18.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.072+0000 7fd895604700 1 --2- 172.21.15.1:0/792046344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8900c6430 0x7fd890152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.072+0000 7fd894e03700 1 --2- 172.21.15.1:0/792046344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8901540a0 0x7fd8900aa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.072+0000 7fd895e05700 1 -- 172.21.15.1:0/792046344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8900c6430 msgr2=0x7fd890152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.072+0000 7fd895e05700 1 --2- 172.21.15.1:0/792046344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8900c6430 0x7fd890152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.072+0000 7fd895e05700 1 -- 172.21.15.1:0/792046344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8901540a0 msgr2=0x7fd8900aa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.072+0000 7fd895e05700 1 --2- 172.21.15.1:0/792046344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8901540a0 0x7fd8900aa0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.072+0000 7fd895e05700 1 -- 172.21.15.1:0/792046344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8840092a0 con 0x7fd890154480 2023-11-15T01:36:18.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.072+0000 7fd895e05700 1 --2- 172.21.15.1:0/792046344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd890154480 0x7fd8900b0890 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fd880009e90 tx=0x7fd88000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:18.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.072+0000 7fd88d7fa700 1 -- 172.21.15.1:0/792046344 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88000caa0 con 0x7fd890154480 2023-11-15T01:36:18.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.072+0000 7fd88d7fa700 1 -- 172.21.15.1:0/792046344 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88000f040 con 0x7fd890154480 2023-11-15T01:36:18.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.072+0000 7fd897868700 1 -- 172.21.15.1:0/792046344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd890167ee0 con 0x7fd890154480 2023-11-15T01:36:18.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.072+0000 7fd88d7fa700 1 -- 172.21.15.1:0/792046344 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88000ce10 con 0x7fd890154480 2023-11-15T01:36:18.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.072+0000 7fd897868700 1 -- 172.21.15.1:0/792046344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8900aa590 con 0x7fd890154480 2023-11-15T01:36:18.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.073+0000 7fd897868700 1 -- 172.21.15.1:0/792046344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd890167d40 con 0x7fd890154480 2023-11-15T01:36:18.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.074+0000 7fd88d7fa700 1 -- 172.21.15.1:0/792046344 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd880013610 con 0x7fd890154480 2023-11-15T01:36:18.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.074+0000 7fd88d7fa700 1 --2- 172.21.15.1:0/792046344 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd87c05f2a0 0x7fd87c061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.074+0000 7fd88d7fa700 1 -- 172.21.15.1:0/792046344 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5693+0+0 (secure 0 0 0) 0x7fd88007a9d0 con 0x7fd890154480 2023-11-15T01:36:18.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.074+0000 7fd895604700 1 --2- 172.21.15.1:0/792046344 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd87c05f2a0 0x7fd87c061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.075+0000 7fd895604700 1 --2- 172.21.15.1:0/792046344 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd87c05f2a0 0x7fd87c061760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd8880011e0 tx=0x7fd888007bb0).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:18.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.078+0000 7fd88d7fa700 1 -- 172.21.15.1:0/792046344 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd890167d40 con 0x7fd890154480 2023-11-15T01:36:18.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.251+0000 7fd897868700 1 -- 172.21.15.1:0/792046344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd890167d40 con 0x7fd890154480 2023-11-15T01:36:18.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.251+0000 7fd88d7fa700 1 -- 172.21.15.1:0/792046344 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v75) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd890167d40 con 0x7fd890154480 2023-11-15T01:36:18.253 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:36:18.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.253+0000 7fd897868700 1 -- 172.21.15.1:0/792046344 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd87c05f2a0 msgr2=0x7fd87c061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.253+0000 7fd897868700 1 --2- 172.21.15.1:0/792046344 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd87c05f2a0 0x7fd87c061760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd8880011e0 tx=0x7fd888007bb0).stop 2023-11-15T01:36:18.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.253+0000 7fd897868700 1 -- 172.21.15.1:0/792046344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd890154480 msgr2=0x7fd8900b0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.253+0000 7fd897868700 1 --2- 172.21.15.1:0/792046344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd890154480 0x7fd8900b0890 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fd880009e90 tx=0x7fd88000b040).stop 2023-11-15T01:36:18.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.253+0000 7fd897868700 1 -- 172.21.15.1:0/792046344 shutdown_connections 2023-11-15T01:36:18.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.253+0000 7fd897868700 1 --2- 172.21.15.1:0/792046344 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd87c05f2a0 0x7fd87c061760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.253+0000 7fd897868700 1 --2- 172.21.15.1:0/792046344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd890154480 0x7fd8900b0890 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.253+0000 7fd897868700 1 --2- 172.21.15.1:0/792046344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8900c6430 0x7fd890152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.253+0000 7fd897868700 1 --2- 172.21.15.1:0/792046344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8901540a0 0x7fd8900aa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.253+0000 7fd897868700 1 -- 172.21.15.1:0/792046344 >> 172.21.15.1:0/792046344 conn(0x7fd890064a70 msgr2=0x7fd890063730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:18.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.254+0000 7fd897868700 1 -- 172.21.15.1:0/792046344 shutdown_connections 2023-11-15T01:36:18.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.254+0000 7fd897868700 1 -- 172.21.15.1:0/792046344 wait complete. 2023-11-15T01:36:18.267 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:36:18.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.387+0000 7f98b98cc700 1 Processor -- start 2023-11-15T01:36:18.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.387+0000 7f98b98cc700 1 -- start start 2023-11-15T01:36:18.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b98cc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98b4066f80 0x7f98b4137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b98cc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f98b41588e0 0x7f98b414e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b98cc700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b4154ce0 con 0x7f98b4137030 2023-11-15T01:36:18.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b98cc700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b4137900 con 0x7f98b41588e0 2023-11-15T01:36:18.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b98cc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b4154fc0 con 0x7f98b4066f80 2023-11-15T01:36:18.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b37fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f98b41588e0 0x7f98b414e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b2ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f98b4137030 0x7f98b4066870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39044/0 (socket says 172.21.15.1:39044) 2023-11-15T01:36:18.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b2ffd700 1 -- 172.21.15.1:0/692820335 learned_addr learned my addr 172.21.15.1:0/692820335 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:18.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b27fc700 1 --2- 172.21.15.1:0/692820335 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98b4066f80 0x7f98b4137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b37fe700 1 -- 172.21.15.1:0/692820335 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98b4066f80 msgr2=0x7f98b4137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:18.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b37fe700 1 --2- 172.21.15.1:0/692820335 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98b4066f80 0x7f98b4137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b37fe700 1 -- 172.21.15.1:0/692820335 >> v1:172.21.15.1:6789/0 conn(0x7f98b4137030 legacy=0x7f98b4066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b1ffb700 1 -- 172.21.15.1:0/692820335 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314775857 0 0) 0x7f98b4154ce0 con 0x7f98b4137030 2023-11-15T01:36:18.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b37fe700 1 -- 172.21.15.1:0/692820335 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b41552a0 con 0x7f98b41588e0 2023-11-15T01:36:18.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b27fc700 1 --2- 172.21.15.1:0/692820335 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98b4066f80 0x7f98b4137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:18.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b37fe700 1 --2- 172.21.15.1:0/692820335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98b41588e0 0x7f98b414e4c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f98a4009760 tx=0x7f98a4009060).ready entity=mon.0 client_cookie=6e9f86a19c0348e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:18.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b1ffb700 1 -- 172.21.15.1:0/692820335 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a400b580 con 0x7f98b41588e0 2023-11-15T01:36:18.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b1ffb700 1 -- 172.21.15.1:0/692820335 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a400b6e0 con 0x7f98b41588e0 2023-11-15T01:36:18.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.388+0000 7f98b1ffb700 1 -- 172.21.15.1:0/692820335 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a400ba60 con 0x7f98b41588e0 2023-11-15T01:36:18.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.389+0000 7f98b98cc700 1 -- 172.21.15.1:0/692820335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98b41588e0 msgr2=0x7f98b414e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.389+0000 7f98b98cc700 1 --2- 172.21.15.1:0/692820335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98b41588e0 0x7f98b414e4c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f98a4009760 tx=0x7f98a4009060).stop 2023-11-15T01:36:18.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.389+0000 7f98b98cc700 1 -- 172.21.15.1:0/692820335 shutdown_connections 2023-11-15T01:36:18.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.389+0000 7f98b98cc700 1 --2- 172.21.15.1:0/692820335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98b41588e0 0x7f98b414e4c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.389+0000 7f98b98cc700 1 --2- 172.21.15.1:0/692820335 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98b4066f80 0x7f98b4137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.389+0000 7f98b98cc700 1 -- 172.21.15.1:0/692820335 >> 172.21.15.1:0/692820335 conn(0x7f98b4063280 msgr2=0x7f98b40c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:18.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.389+0000 7f98b98cc700 1 -- 172.21.15.1:0/692820335 shutdown_connections 2023-11-15T01:36:18.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.389+0000 7f98b98cc700 1 -- 172.21.15.1:0/692820335 wait complete. 2023-11-15T01:36:18.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.390+0000 7f98b98cc700 1 Processor -- start 2023-11-15T01:36:18.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.390+0000 7f98b98cc700 1 -- start start 2023-11-15T01:36:18.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b98cc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98b4066f80 0x7f98b4152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b98cc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98b4137030 0x7f98b4156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b98cc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98b41588e0 0x7f98b4156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b98cc700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b41574c0 con 0x7f98b4066f80 2023-11-15T01:36:18.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b98cc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b40c4190 con 0x7f98b4137030 2023-11-15T01:36:18.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b98cc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b40c3d00 con 0x7f98b41588e0 2023-11-15T01:36:18.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98b4066f80 0x7f98b4152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98b4066f80 0x7f98b4152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49178/0 (socket says 172.21.15.1:49178) 2023-11-15T01:36:18.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b2ffd700 1 -- 172.21.15.1:0/395415935 learned_addr learned my addr 172.21.15.1:0/395415935 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:18.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b37fe700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98b41588e0 0x7f98b4156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b27fc700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98b4137030 0x7f98b4156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b2ffd700 1 -- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98b41588e0 msgr2=0x7f98b4156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b2ffd700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98b41588e0 0x7f98b4156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b2ffd700 1 -- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98b4137030 msgr2=0x7f98b4156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b2ffd700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98b4137030 0x7f98b4156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b2ffd700 1 -- 172.21.15.1:0/395415935 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a40092a0 con 0x7f98b4066f80 2023-11-15T01:36:18.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b37fe700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98b41588e0 0x7f98b4156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:18.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b27fc700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98b4137030 0x7f98b4156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:18.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.391+0000 7f98b2ffd700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98b4066f80 0x7f98b4152d40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f98ac00c990 tx=0x7f98ac001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:18.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.392+0000 7f98aaffd700 1 -- 172.21.15.1:0/395415935 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac005d30 con 0x7f98b4066f80 2023-11-15T01:36:18.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.392+0000 7f98aaffd700 1 -- 172.21.15.1:0/395415935 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac005e90 con 0x7f98b4066f80 2023-11-15T01:36:18.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.392+0000 7f98b98cc700 1 -- 172.21.15.1:0/395415935 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b40c30f0 con 0x7f98b4066f80 2023-11-15T01:36:18.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.392+0000 7f98aaffd700 1 -- 172.21.15.1:0/395415935 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac007320 con 0x7f98b4066f80 2023-11-15T01:36:18.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.392+0000 7f98b98cc700 1 -- 172.21.15.1:0/395415935 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b40c3480 con 0x7f98b4066f80 2023-11-15T01:36:18.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.393+0000 7f98b98cc700 1 -- 172.21.15.1:0/395415935 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b406c7e0 con 0x7f98b4066f80 2023-11-15T01:36:18.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.393+0000 7f98aaffd700 1 -- 172.21.15.1:0/395415935 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f98ac007710 con 0x7f98b4066f80 2023-11-15T01:36:18.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.393+0000 7f98aaffd700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f989405f270 0x7f9894061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.393+0000 7f98aaffd700 1 -- 172.21.15.1:0/395415935 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5693+0+0 (secure 0 0 0) 0x7f98ac07a3c0 con 0x7f98b4066f80 2023-11-15T01:36:18.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.394+0000 7f98b27fc700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f989405f270 0x7f9894061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.394+0000 7f98b27fc700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f989405f270 0x7f9894061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f989c006fd0 tx=0x7f989c008040).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:18.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.398+0000 7f98aaffd700 1 -- 172.21.15.1:0/395415935 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f98ac04b6c0 con 0x7f98b4066f80 2023-11-15T01:36:18.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.568+0000 7f98b98cc700 1 -- 172.21.15.1:0/395415935 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f98b40c3a50 con 0x7f98b4066f80 2023-11-15T01:36:18.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.569+0000 7f98aaffd700 1 -- 172.21.15.1:0/395415935 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v75) v1 ==== 92+0+10 (secure 0 0 0) 0x7f98ac04ece0 con 0x7f98b4066f80 2023-11-15T01:36:18.571 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:36:18.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.571+0000 7f98b98cc700 1 -- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f989405f270 msgr2=0x7f9894061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.571+0000 7f98b98cc700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f989405f270 0x7f9894061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f989c006fd0 tx=0x7f989c008040).stop 2023-11-15T01:36:18.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.571+0000 7f98b98cc700 1 -- 172.21.15.1:0/395415935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98b4066f80 msgr2=0x7f98b4152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.571+0000 7f98b98cc700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98b4066f80 0x7f98b4152d40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f98ac00c990 tx=0x7f98ac001630).stop 2023-11-15T01:36:18.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.571+0000 7f98b98cc700 1 -- 172.21.15.1:0/395415935 shutdown_connections 2023-11-15T01:36:18.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.571+0000 7f98b98cc700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f989405f270 0x7f9894061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.571+0000 7f98b98cc700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98b41588e0 0x7f98b4156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.571+0000 7f98b98cc700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98b4066f80 0x7f98b4152d40 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.571+0000 7f98b98cc700 1 --2- 172.21.15.1:0/395415935 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98b4137030 0x7f98b4156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.571+0000 7f98b98cc700 1 -- 172.21.15.1:0/395415935 >> 172.21.15.1:0/395415935 conn(0x7f98b4063280 msgr2=0x7f98b4063f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:18.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.571+0000 7f98b98cc700 1 -- 172.21.15.1:0/395415935 shutdown_connections 2023-11-15T01:36:18.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.571+0000 7f98b98cc700 1 -- 172.21.15.1:0/395415935 wait complete. 2023-11-15T01:36:18.584 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-15T01:36:18.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.701+0000 7f772f6ca700 1 Processor -- start 2023-11-15T01:36:18.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.701+0000 7f772f6ca700 1 -- start start 2023-11-15T01:36:18.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.702+0000 7f772f6ca700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7728154150 0x7f7728154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.702+0000 7f772f6ca700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f77280aa060 0x7f77280c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.702+0000 7f772f6ca700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77280c06f0 con 0x7f77280ab1a0 2023-11-15T01:36:18.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.702+0000 7f772f6ca700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77280c09d0 con 0x7f77280aa060 2023-11-15T01:36:18.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.702+0000 7f772f6ca700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7728158820 con 0x7f7728154150 2023-11-15T01:36:18.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.702+0000 7f772dc67700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f77280aa060 0x7f77280c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.703+0000 7f772d466700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7728154150 0x7f7728154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.703+0000 7f772dc67700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f77280aa060 0x7f77280c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:56930/0 (socket says 172.21.15.1:56930) 2023-11-15T01:36:18.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.703+0000 7f772dc67700 1 -- 172.21.15.1:0/3304279272 learned_addr learned my addr 172.21.15.1:0/3304279272 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:18.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.703+0000 7f772d466700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7728154150 0x7f7728154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:37472/0 (socket says 172.21.15.1:37472) 2023-11-15T01:36:18.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.703+0000 7f772d466700 1 -- 172.21.15.1:0/3304279272 >> v2:172.21.15.141:3300/0 conn(0x7f77280aa060 msgr2=0x7f77280c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:18.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.703+0000 7f772d466700 1 --2- 172.21.15.1:0/3304279272 >> v2:172.21.15.141:3300/0 conn(0x7f77280aa060 0x7f77280c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.703+0000 7f772d466700 1 -- 172.21.15.1:0/3304279272 >> v1:172.21.15.141:6789/0 conn(0x7f77280ab1a0 legacy=0x7f7728158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.703+0000 7f772d466700 1 -- 172.21.15.1:0/3304279272 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7728158b00 con 0x7f7728154150 2023-11-15T01:36:18.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.703+0000 7f772d466700 1 --2- 172.21.15.1:0/3304279272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7728154150 0x7f7728154530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f7720009760 tx=0x7f7720009060).ready entity=mon.2 client_cookie=649e72cfaa8f0def server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:18.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.703+0000 7f7727fff700 1 -- 172.21.15.1:0/3304279272 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77200090d0 con 0x7f7728154150 2023-11-15T01:36:18.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.703+0000 7f7727fff700 1 -- 172.21.15.1:0/3304279272 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772000f510 con 0x7f7728154150 2023-11-15T01:36:18.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.703+0000 7f7727fff700 1 -- 172.21.15.1:0/3304279272 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772000f890 con 0x7f7728154150 2023-11-15T01:36:18.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.704+0000 7f772f6ca700 1 -- 172.21.15.1:0/3304279272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7728154150 msgr2=0x7f7728154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.704+0000 7f772f6ca700 1 --2- 172.21.15.1:0/3304279272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7728154150 0x7f7728154530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f7720009760 tx=0x7f7720009060).stop 2023-11-15T01:36:18.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.704+0000 7f772f6ca700 1 -- 172.21.15.1:0/3304279272 shutdown_connections 2023-11-15T01:36:18.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.704+0000 7f772f6ca700 1 --2- 172.21.15.1:0/3304279272 >> v2:172.21.15.141:3300/0 conn(0x7f77280aa060 0x7f77280c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.704+0000 7f772f6ca700 1 --2- 172.21.15.1:0/3304279272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7728154150 0x7f7728154530 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.704+0000 7f772f6ca700 1 -- 172.21.15.1:0/3304279272 >> 172.21.15.1:0/3304279272 conn(0x7f7728064aa0 msgr2=0x7f7728064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:18.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.704+0000 7f772f6ca700 1 -- 172.21.15.1:0/3304279272 shutdown_connections 2023-11-15T01:36:18.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.704+0000 7f772f6ca700 1 -- 172.21.15.1:0/3304279272 wait complete. 2023-11-15T01:36:18.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.705+0000 7f772f6ca700 1 Processor -- start 2023-11-15T01:36:18.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.705+0000 7f772f6ca700 1 -- start start 2023-11-15T01:36:18.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772f6ca700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77280aa060 0x7f77281531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772f6ca700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77280ab1a0 0x7f77280aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772f6ca700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77280abf40 0x7f7728165580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772f6ca700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77280c3a10 con 0x7f77280aa060 2023-11-15T01:36:18.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772f6ca700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77281650f0 con 0x7f77280abf40 2023-11-15T01:36:18.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772f6ca700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77280c5190 con 0x7f77280ab1a0 2023-11-15T01:36:18.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772d466700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77280aa060 0x7f77281531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772d466700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77280aa060 0x7f77281531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49180/0 (socket says 172.21.15.1:49180) 2023-11-15T01:36:18.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772d466700 1 -- 172.21.15.1:0/3549130293 learned_addr learned my addr 172.21.15.1:0/3549130293 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:18.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772dc67700 1 --2- 172.21.15.1:0/3549130293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77280abf40 0x7f7728165580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772cc65700 1 --2- 172.21.15.1:0/3549130293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77280ab1a0 0x7f77280aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772d466700 1 -- 172.21.15.1:0/3549130293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77280ab1a0 msgr2=0x7f77280aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772d466700 1 --2- 172.21.15.1:0/3549130293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77280ab1a0 0x7f77280aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772d466700 1 -- 172.21.15.1:0/3549130293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77280abf40 msgr2=0x7f7728165580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772d466700 1 --2- 172.21.15.1:0/3549130293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77280abf40 0x7f7728165580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772d466700 1 -- 172.21.15.1:0/3549130293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77200092a0 con 0x7f77280aa060 2023-11-15T01:36:18.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.706+0000 7f772dc67700 1 --2- 172.21.15.1:0/3549130293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77280abf40 0x7f7728165580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:18.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.707+0000 7f772d466700 1 --2- 172.21.15.1:0/3549130293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77280aa060 0x7f77281531a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f7728158960 tx=0x7f7720017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:18.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.707+0000 7f77257fa700 1 -- 172.21.15.1:0/3549130293 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772000fc90 con 0x7f77280aa060 2023-11-15T01:36:18.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.707+0000 7f77257fa700 1 -- 172.21.15.1:0/3549130293 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772000fdf0 con 0x7f77280aa060 2023-11-15T01:36:18.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.707+0000 7f772f6ca700 1 -- 172.21.15.1:0/3549130293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77280c3170 con 0x7f77280aa060 2023-11-15T01:36:18.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.707+0000 7f77257fa700 1 -- 172.21.15.1:0/3549130293 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772000f8d0 con 0x7f77280aa060 2023-11-15T01:36:18.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.707+0000 7f772f6ca700 1 -- 172.21.15.1:0/3549130293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77280c3730 con 0x7f77280aa060 2023-11-15T01:36:18.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.708+0000 7f772f6ca700 1 -- 172.21.15.1:0/3549130293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77281653d0 con 0x7f77280aa060 2023-11-15T01:36:18.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.708+0000 7f77257fa700 1 -- 172.21.15.1:0/3549130293 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f772001b620 con 0x7f77280aa060 2023-11-15T01:36:18.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.709+0000 7f77257fa700 1 --2- 172.21.15.1:0/3549130293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f771405f1e0 0x7f77140616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:18.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.709+0000 7f77257fa700 1 -- 172.21.15.1:0/3549130293 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5693+0+0 (secure 0 0 0) 0x7f772007bb50 con 0x7f77280aa060 2023-11-15T01:36:18.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.709+0000 7f772cc65700 1 --2- 172.21.15.1:0/3549130293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f771405f1e0 0x7f77140616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:18.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.709+0000 7f772cc65700 1 --2- 172.21.15.1:0/3549130293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f771405f1e0 0x7f77140616a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f77280ad190 tx=0x7f771c007d40).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:18.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.713+0000 7f77257fa700 1 -- 172.21.15.1:0/3549130293 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f772004cd30 con 0x7f77280aa060 2023-11-15T01:36:18.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.889+0000 7f772f6ca700 1 -- 172.21.15.1:0/3549130293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f772806c7e0 con 0x7f77280aa060 2023-11-15T01:36:18.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.890+0000 7f77257fa700 1 -- 172.21.15.1:0/3549130293 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) v1 ==== 84+0+143 (secure 0 0 0) 0x7f7720050350 con 0x7f77280aa060 2023-11-15T01:36:18.891 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:18.892 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T01:36:18.892 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:18.892 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2023-11-15T01:36:18.892 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "device_health_metrics" 2023-11-15T01:36:18.892 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:18.893 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:18.893 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 2, 2023-11-15T01:36:18.893 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "rbd" 2023-11-15T01:36:18.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:18.894 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T01:36:18.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.891+0000 7f772f6ca700 1 -- 172.21.15.1:0/3549130293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f771405f1e0 msgr2=0x7f77140616a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.891+0000 7f772f6ca700 1 --2- 172.21.15.1:0/3549130293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f771405f1e0 0x7f77140616a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f77280ad190 tx=0x7f771c007d40).stop 2023-11-15T01:36:18.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.891+0000 7f772f6ca700 1 -- 172.21.15.1:0/3549130293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77280aa060 msgr2=0x7f77281531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:18.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.891+0000 7f772f6ca700 1 --2- 172.21.15.1:0/3549130293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77280aa060 0x7f77281531a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f7728158960 tx=0x7f7720017000).stop 2023-11-15T01:36:18.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.891+0000 7f772f6ca700 1 -- 172.21.15.1:0/3549130293 shutdown_connections 2023-11-15T01:36:18.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.891+0000 7f772f6ca700 1 --2- 172.21.15.1:0/3549130293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f771405f1e0 0x7f77140616a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.891+0000 7f772f6ca700 1 --2- 172.21.15.1:0/3549130293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77280abf40 0x7f7728165580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.891+0000 7f772f6ca700 1 --2- 172.21.15.1:0/3549130293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77280aa060 0x7f77281531a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.891+0000 7f772f6ca700 1 --2- 172.21.15.1:0/3549130293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77280ab1a0 0x7f77280aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:18.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.891+0000 7f772f6ca700 1 -- 172.21.15.1:0/3549130293 >> 172.21.15.1:0/3549130293 conn(0x7f7728064aa0 msgr2=0x7f77280c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:18.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.891+0000 7f772f6ca700 1 -- 172.21.15.1:0/3549130293 shutdown_connections 2023-11-15T01:36:18.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:18.891+0000 7f772f6ca700 1 -- 172.21.15.1:0/3549130293 wait complete. 2023-11-15T01:36:18.905 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-15T01:36:18.905 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-15T01:36:19.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.027+0000 7f4b51365700 1 Processor -- start 2023-11-15T01:36:19.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.027+0000 7f4b51365700 1 -- start start 2023-11-15T01:36:19.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.027+0000 7f4b51365700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b4c157660 0x7f4b4c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:19.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.028+0000 7f4b51365700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c0c1820 con 0x7f4b4c0aa060 2023-11-15T01:36:19.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.028+0000 7f4b51365700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c0c0c30 con 0x7f4b4c0c1cb0 2023-11-15T01:36:19.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.028+0000 7f4b51365700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c7540 con 0x7f4b4c157660 2023-11-15T01:36:19.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.028+0000 7f4b4b7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4b4c0aa060 0x7f4b4c0ab190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39056/0 (socket says 172.21.15.1:39056) 2023-11-15T01:36:19.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.028+0000 7f4b4b7fe700 1 -- 172.21.15.1:0/1619388509 learned_addr learned my addr 172.21.15.1:0/1619388509 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:19.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.028+0000 7f4b4affd700 1 --2- 172.21.15.1:0/1619388509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b4c157660 0x7f4b4c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:19.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.028+0000 7f4b49ffb700 1 -- 172.21.15.1:0/1619388509 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960567858 0 0) 0x7f4b4c0c1820 con 0x7f4b4c0aa060 2023-11-15T01:36:19.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.028+0000 7f4b49ffb700 1 -- 172.21.15.1:0/1619388509 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b340033f0 con 0x7f4b4c0aa060 2023-11-15T01:36:19.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.028+0000 7f4b49ffb700 1 -- 172.21.15.1:0/1619388509 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346359260 0 0) 0x7f4b4c0c0c30 con 0x7f4b4c0c1cb0 2023-11-15T01:36:19.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.028+0000 7f4b49ffb700 1 -- 172.21.15.1:0/1619388509 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b4c0c1820 con 0x7f4b4c0c1cb0 2023-11-15T01:36:19.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.028+0000 7f4b4affd700 1 -- 172.21.15.1:0/1619388509 >> v1:172.21.15.141:6789/0 conn(0x7f4b4c0c1cb0 legacy=0x7f4b4c0c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:19.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.028+0000 7f4b4affd700 1 -- 172.21.15.1:0/1619388509 >> v1:172.21.15.1:6789/0 conn(0x7f4b4c0aa060 legacy=0x7f4b4c0ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.028+0000 7f4b49ffb700 1 -- 172.21.15.1:0/1619388509 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2874408049 0 0) 0x7f4b340033f0 con 0x7f4b4c0aa060 2023-11-15T01:36:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.028+0000 7f4b4affd700 1 -- 172.21.15.1:0/1619388509 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0c0ef0 con 0x7f4b4c157660 2023-11-15T01:36:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.028+0000 7f4b4affd700 1 --2- 172.21.15.1:0/1619388509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b4c157660 0x7f4b4c157a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f4b3c009e90 tx=0x7f4b3c009780).ready entity=mon.2 client_cookie=7924459e941dffd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.029+0000 7f4b49ffb700 1 -- 172.21.15.1:0/1619388509 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c00e070 con 0x7f4b4c157660 2023-11-15T01:36:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.029+0000 7f4b49ffb700 1 -- 172.21.15.1:0/1619388509 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c00b7a0 con 0x7f4b4c157660 2023-11-15T01:36:19.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.029+0000 7f4b49ffb700 1 -- 172.21.15.1:0/1619388509 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44001470 con 0x7f4b4c157660 2023-11-15T01:36:19.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.029+0000 7f4b51365700 1 -- 172.21.15.1:0/1619388509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b4c157660 msgr2=0x7f4b4c157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:19.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.029+0000 7f4b51365700 1 --2- 172.21.15.1:0/1619388509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b4c157660 0x7f4b4c157a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f4b3c009e90 tx=0x7f4b3c009780).stop 2023-11-15T01:36:19.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.029+0000 7f4b51365700 1 -- 172.21.15.1:0/1619388509 shutdown_connections 2023-11-15T01:36:19.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.029+0000 7f4b51365700 1 --2- 172.21.15.1:0/1619388509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b4c157660 0x7f4b4c157a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:19.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.029+0000 7f4b51365700 1 -- 172.21.15.1:0/1619388509 >> 172.21.15.1:0/1619388509 conn(0x7f4b4c064aa0 msgr2=0x7f4b4c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:19.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.029+0000 7f4b51365700 1 -- 172.21.15.1:0/1619388509 shutdown_connections 2023-11-15T01:36:19.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.029+0000 7f4b51365700 1 -- 172.21.15.1:0/1619388509 wait complete. 2023-11-15T01:36:19.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.030+0000 7f4b51365700 1 Processor -- start 2023-11-15T01:36:19.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.030+0000 7f4b51365700 1 -- start start 2023-11-15T01:36:19.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.031+0000 7f4b51365700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b4c0aa060 0x7f4b4c1508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:19.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.031+0000 7f4b51365700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b4c0c1cb0 0x7f4b4c155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:19.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.031+0000 7f4b51365700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b4c157660 0x7f4b4c155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:19.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.031+0000 7f4b51365700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c156300 con 0x7f4b4c157660 2023-11-15T01:36:19.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.031+0000 7f4b51365700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c150de0 con 0x7f4b4c0c1cb0 2023-11-15T01:36:19.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.031+0000 7f4b51365700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c2260 con 0x7f4b4c0aa060 2023-11-15T01:36:19.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.031+0000 7f4b4b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b4c157660 0x7f4b4c155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:19.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.031+0000 7f4b4b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b4c157660 0x7f4b4c155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49186/0 (socket says 172.21.15.1:49186) 2023-11-15T01:36:19.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.031+0000 7f4b4b7fe700 1 -- 172.21.15.1:0/1220302293 learned_addr learned my addr 172.21.15.1:0/1220302293 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:19.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.031+0000 7f4b4affd700 1 --2- 172.21.15.1:0/1220302293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b4c0aa060 0x7f4b4c1508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:19.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.031+0000 7f4b4a7fc700 1 --2- 172.21.15.1:0/1220302293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b4c0c1cb0 0x7f4b4c155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:19.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.032+0000 7f4b4b7fe700 1 -- 172.21.15.1:0/1220302293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b4c0aa060 msgr2=0x7f4b4c1508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:19.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.032+0000 7f4b4b7fe700 1 --2- 172.21.15.1:0/1220302293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b4c0aa060 0x7f4b4c1508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:19.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.032+0000 7f4b4b7fe700 1 -- 172.21.15.1:0/1220302293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b4c0c1cb0 msgr2=0x7f4b4c155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:19.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.032+0000 7f4b4b7fe700 1 --2- 172.21.15.1:0/1220302293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b4c0c1cb0 0x7f4b4c155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:19.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.032+0000 7f4b4b7fe700 1 -- 172.21.15.1:0/1220302293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c009a20 con 0x7f4b4c157660 2023-11-15T01:36:19.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.032+0000 7f4b4a7fc700 1 --2- 172.21.15.1:0/1220302293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b4c0c1cb0 0x7f4b4c155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:19.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.032+0000 7f4b4b7fe700 1 --2- 172.21.15.1:0/1220302293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b4c157660 0x7f4b4c155e10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f4b4400c790 tx=0x7f4b44001b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:19.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.032+0000 7f4b32ffd700 1 -- 172.21.15.1:0/1220302293 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44007170 con 0x7f4b4c157660 2023-11-15T01:36:19.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.032+0000 7f4b32ffd700 1 -- 172.21.15.1:0/1220302293 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b440072d0 con 0x7f4b4c157660 2023-11-15T01:36:19.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.032+0000 7f4b51365700 1 -- 172.21.15.1:0/1220302293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c0c2540 con 0x7f4b4c157660 2023-11-15T01:36:19.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.032+0000 7f4b32ffd700 1 -- 172.21.15.1:0/1220302293 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440048c0 con 0x7f4b4c157660 2023-11-15T01:36:19.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.032+0000 7f4b51365700 1 -- 172.21.15.1:0/1220302293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c0c2b00 con 0x7f4b4c157660 2023-11-15T01:36:19.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.033+0000 7f4b51365700 1 -- 172.21.15.1:0/1220302293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c06c7e0 con 0x7f4b4c157660 2023-11-15T01:36:19.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.033+0000 7f4b32ffd700 1 -- 172.21.15.1:0/1220302293 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4b44004cf0 con 0x7f4b4c157660 2023-11-15T01:36:19.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.034+0000 7f4b32ffd700 1 --2- 172.21.15.1:0/1220302293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4b3805f270 0x7f4b38061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:19.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.034+0000 7f4b32ffd700 1 -- 172.21.15.1:0/1220302293 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5693+0+0 (secure 0 0 0) 0x7f4b44079d90 con 0x7f4b4c157660 2023-11-15T01:36:19.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.034+0000 7f4b4affd700 1 --2- 172.21.15.1:0/1220302293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4b3805f270 0x7f4b38061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:19.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.034+0000 7f4b4affd700 1 --2- 172.21.15.1:0/1220302293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4b3805f270 0x7f4b38061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f4b4c0b13a0 tx=0x7f4b3c009780).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:19.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.038+0000 7f4b32ffd700 1 -- 172.21.15.1:0/1220302293 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4b4404b090 con 0x7f4b4c157660 2023-11-15T01:36:19.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:19.211+0000 7f4b51365700 1 -- 172.21.15.1:0/1220302293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f4b4c05f8b0 con 0x7f4b4c157660 2023-11-15T01:36:20.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.165+0000 7f4b32ffd700 1 -- 172.21.15.1:0/1220302293 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) v1 ==== 152+0+0 (secure 0 0 0) 0x7f4b4404e6b0 con 0x7f4b4c157660 2023-11-15T01:36:20.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.169+0000 7f4b51365700 1 -- 172.21.15.1:0/1220302293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4b3805f270 msgr2=0x7f4b38061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:20.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.169+0000 7f4b51365700 1 --2- 172.21.15.1:0/1220302293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4b3805f270 0x7f4b38061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f4b4c0b13a0 tx=0x7f4b3c009780).stop 2023-11-15T01:36:20.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.169+0000 7f4b51365700 1 -- 172.21.15.1:0/1220302293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b4c157660 msgr2=0x7f4b4c155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:20.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.169+0000 7f4b51365700 1 --2- 172.21.15.1:0/1220302293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b4c157660 0x7f4b4c155e10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f4b4400c790 tx=0x7f4b44001b00).stop 2023-11-15T01:36:20.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.170+0000 7f4b51365700 1 -- 172.21.15.1:0/1220302293 shutdown_connections 2023-11-15T01:36:20.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.170+0000 7f4b51365700 1 --2- 172.21.15.1:0/1220302293 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4b3805f270 0x7f4b38061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:20.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.170+0000 7f4b51365700 1 --2- 172.21.15.1:0/1220302293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b4c157660 0x7f4b4c155e10 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:20.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.170+0000 7f4b51365700 1 --2- 172.21.15.1:0/1220302293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b4c0aa060 0x7f4b4c1508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:20.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.170+0000 7f4b51365700 1 --2- 172.21.15.1:0/1220302293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b4c0c1cb0 0x7f4b4c155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:20.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.170+0000 7f4b51365700 1 -- 172.21.15.1:0/1220302293 >> 172.21.15.1:0/1220302293 conn(0x7f4b4c064aa0 msgr2=0x7f4b4c154d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:20.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.171+0000 7f4b51365700 1 -- 172.21.15.1:0/1220302293 shutdown_connections 2023-11-15T01:36:20.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.173+0000 7f4b51365700 1 -- 172.21.15.1:0/1220302293 wait complete. 2023-11-15T01:36:20.178 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2023-11-15T01:36:20.192 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-15T01:36:20.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.323+0000 7ff88d927700 1 Processor -- start 2023-11-15T01:36:20.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.323+0000 7ff88d927700 1 -- start start 2023-11-15T01:36:20.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff88d927700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff888154480 0x7ff8880c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:20.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff88d927700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff8880c6430 0x7ff8880aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:20.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff88d927700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8880ca050 con 0x7ff8881540a0 2023-11-15T01:36:20.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff88d927700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8880c68c0 con 0x7ff8880c6430 2023-11-15T01:36:20.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff88d927700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8880c9440 con 0x7ff888154480 2023-11-15T01:36:20.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff886ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff8881540a0 0x7ff8880ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39068/0 (socket says 172.21.15.1:39068) 2023-11-15T01:36:20.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff886ffd700 1 -- 172.21.15.1:0/809573654 learned_addr learned my addr 172.21.15.1:0/809573654 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:20.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff8877fe700 1 --2- 172.21.15.1:0/809573654 >> v2:172.21.15.1:3300/0 conn(0x7ff8880c6430 0x7ff8880aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:20.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff8867fc700 1 --2- 172.21.15.1:0/809573654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff888154480 0x7ff8880c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:20.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff8877fe700 1 -- 172.21.15.1:0/809573654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff888154480 msgr2=0x7ff8880c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:20.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff8877fe700 1 --2- 172.21.15.1:0/809573654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff888154480 0x7ff8880c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:20.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff8877fe700 1 -- 172.21.15.1:0/809573654 >> v1:172.21.15.1:6789/0 conn(0x7ff8881540a0 legacy=0x7ff8880ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:20.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff8877fe700 1 -- 172.21.15.1:0/809573654 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8880c9720 con 0x7ff8880c6430 2023-11-15T01:36:20.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff885ffb700 1 -- 172.21.15.1:0/809573654 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052028072 0 0) 0x7ff8880ca050 con 0x7ff8881540a0 2023-11-15T01:36:20.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff8877fe700 1 --2- 172.21.15.1:0/809573654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8880c6430 0x7ff8880aaf40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7ff880009e60 tx=0x7ff880009780).ready entity=mon.0 client_cookie=7ca17d7fa9e88f16 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:20.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.324+0000 7ff885ffb700 1 -- 172.21.15.1:0/809573654 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88000e070 con 0x7ff8880c6430 2023-11-15T01:36:20.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.325+0000 7ff885ffb700 1 -- 172.21.15.1:0/809573654 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88000bb60 con 0x7ff8880c6430 2023-11-15T01:36:20.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.325+0000 7ff885ffb700 1 -- 172.21.15.1:0/809573654 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880012410 con 0x7ff8880c6430 2023-11-15T01:36:20.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.325+0000 7ff88d927700 1 -- 172.21.15.1:0/809573654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8880c6430 msgr2=0x7ff8880aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:20.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.325+0000 7ff88d927700 1 --2- 172.21.15.1:0/809573654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8880c6430 0x7ff8880aaf40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7ff880009e60 tx=0x7ff880009780).stop 2023-11-15T01:36:20.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.325+0000 7ff88d927700 1 -- 172.21.15.1:0/809573654 shutdown_connections 2023-11-15T01:36:20.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.325+0000 7ff88d927700 1 --2- 172.21.15.1:0/809573654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8880c6430 0x7ff8880aaf40 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:20.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.325+0000 7ff88d927700 1 --2- 172.21.15.1:0/809573654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff888154480 0x7ff8880c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:20.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.325+0000 7ff88d927700 1 -- 172.21.15.1:0/809573654 >> 172.21.15.1:0/809573654 conn(0x7ff888064a70 msgr2=0x7ff888064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:20.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.325+0000 7ff88d927700 1 -- 172.21.15.1:0/809573654 shutdown_connections 2023-11-15T01:36:20.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.325+0000 7ff88d927700 1 -- 172.21.15.1:0/809573654 wait complete. 2023-11-15T01:36:20.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.326+0000 7ff88d927700 1 Processor -- start 2023-11-15T01:36:20.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.326+0000 7ff88d927700 1 -- start start 2023-11-15T01:36:20.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.327+0000 7ff88d927700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8880c6430 0x7ff88814ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:20.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.327+0000 7ff88d927700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8881540a0 0x7ff88814b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:20.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.327+0000 7ff88d927700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888154480 0x7ff8880b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:20.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.327+0000 7ff88d927700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff888167610 con 0x7ff888154480 2023-11-15T01:36:20.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.327+0000 7ff88d927700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff888168190 con 0x7ff8880c6430 2023-11-15T01:36:20.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.327+0000 7ff88d927700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff888167860 con 0x7ff8881540a0 2023-11-15T01:36:20.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.327+0000 7ff8877fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888154480 0x7ff8880b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:20.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.327+0000 7ff8877fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888154480 0x7ff8880b09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49204/0 (socket says 172.21.15.1:49204) 2023-11-15T01:36:20.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.327+0000 7ff8877fe700 1 -- 172.21.15.1:0/247448383 learned_addr learned my addr 172.21.15.1:0/247448383 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:20.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.327+0000 7ff886ffd700 1 --2- 172.21.15.1:0/247448383 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8880c6430 0x7ff88814ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:20.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.327+0000 7ff8867fc700 1 --2- 172.21.15.1:0/247448383 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8881540a0 0x7ff88814b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:20.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.328+0000 7ff8877fe700 1 -- 172.21.15.1:0/247448383 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8881540a0 msgr2=0x7ff88814b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:20.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.328+0000 7ff8877fe700 1 --2- 172.21.15.1:0/247448383 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8881540a0 0x7ff88814b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:20.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.328+0000 7ff8877fe700 1 -- 172.21.15.1:0/247448383 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8880c6430 msgr2=0x7ff88814ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:20.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.328+0000 7ff8877fe700 1 --2- 172.21.15.1:0/247448383 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8880c6430 0x7ff88814ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:20.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.328+0000 7ff8877fe700 1 -- 172.21.15.1:0/247448383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff880009a20 con 0x7ff888154480 2023-11-15T01:36:20.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.328+0000 7ff8877fe700 1 --2- 172.21.15.1:0/247448383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888154480 0x7ff8880b09a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7ff88000b6c0 tx=0x7ff880009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:20.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.328+0000 7ff86effd700 1 -- 172.21.15.1:0/247448383 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880012410 con 0x7ff888154480 2023-11-15T01:36:20.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.328+0000 7ff86effd700 1 -- 172.21.15.1:0/247448383 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88001d630 con 0x7ff888154480 2023-11-15T01:36:20.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.328+0000 7ff86effd700 1 -- 172.21.15.1:0/247448383 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88001d9f0 con 0x7ff888154480 2023-11-15T01:36:20.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.328+0000 7ff88d927700 1 -- 172.21.15.1:0/247448383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff888167b40 con 0x7ff888154480 2023-11-15T01:36:20.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.328+0000 7ff88d927700 1 -- 172.21.15.1:0/247448383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88814b810 con 0x7ff888154480 2023-11-15T01:36:20.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.329+0000 7ff88d927700 1 -- 172.21.15.1:0/247448383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff888168300 con 0x7ff888154480 2023-11-15T01:36:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.330+0000 7ff86effd700 1 -- 172.21.15.1:0/247448383 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff880026410 con 0x7ff888154480 2023-11-15T01:36:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.330+0000 7ff86effd700 1 --2- 172.21.15.1:0/247448383 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff87405f240 0x7ff874061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.330+0000 7ff86effd700 1 -- 172.21.15.1:0/247448383 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6063+0+0 (secure 0 0 0) 0x7ff88007c1b0 con 0x7ff888154480 2023-11-15T01:36:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.330+0000 7ff886ffd700 1 --2- 172.21.15.1:0/247448383 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff87405f240 0x7ff874061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.331+0000 7ff886ffd700 1 --2- 172.21.15.1:0/247448383 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff87405f240 0x7ff874061700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff8880ae560 tx=0x7ff878007bb0).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:20.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.335+0000 7ff86effd700 1 -- 172.21.15.1:0/247448383 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff880050dd0 con 0x7ff888154480 2023-11-15T01:36:20.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:20.507+0000 7ff88d927700 1 -- 172.21.15.1:0/247448383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff88806c7e0 con 0x7ff888154480 2023-11-15T01:36:21.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.172+0000 7ff86effd700 1 -- 172.21.15.1:0/247448383 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff8800509c0 con 0x7ff888154480 2023-11-15T01:36:21.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.196+0000 7ff88d927700 1 -- 172.21.15.1:0/247448383 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff87405f240 msgr2=0x7ff874061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:21.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.196+0000 7ff88d927700 1 --2- 172.21.15.1:0/247448383 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff87405f240 0x7ff874061700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff8880ae560 tx=0x7ff878007bb0).stop 2023-11-15T01:36:21.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.196+0000 7ff88d927700 1 -- 172.21.15.1:0/247448383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888154480 msgr2=0x7ff8880b09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:21.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.196+0000 7ff88d927700 1 --2- 172.21.15.1:0/247448383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888154480 0x7ff8880b09a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7ff88000b6c0 tx=0x7ff880009780).stop 2023-11-15T01:36:21.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.197+0000 7ff88d927700 1 -- 172.21.15.1:0/247448383 shutdown_connections 2023-11-15T01:36:21.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.197+0000 7ff88d927700 1 --2- 172.21.15.1:0/247448383 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff87405f240 0x7ff874061700 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.197+0000 7ff88d927700 1 --2- 172.21.15.1:0/247448383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888154480 0x7ff8880b09a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.197+0000 7ff88d927700 1 --2- 172.21.15.1:0/247448383 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8880c6430 0x7ff88814ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.197+0000 7ff88d927700 1 --2- 172.21.15.1:0/247448383 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8881540a0 0x7ff88814b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.197+0000 7ff88d927700 1 -- 172.21.15.1:0/247448383 >> 172.21.15.1:0/247448383 conn(0x7ff888064a70 msgr2=0x7ff888064e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:21.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.197+0000 7ff88d927700 1 -- 172.21.15.1:0/247448383 shutdown_connections 2023-11-15T01:36:21.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.197+0000 7ff88d927700 1 -- 172.21.15.1:0/247448383 wait complete. 2023-11-15T01:36:21.201 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2023-11-15T01:36:21.212 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-15T01:36:21.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.335+0000 7fd55eddb700 1 Processor -- start 2023-11-15T01:36:21.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.335+0000 7fd55eddb700 1 -- start start 2023-11-15T01:36:21.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.336+0000 7fd55eddb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd5581541d0 0x7fd5581545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:21.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.336+0000 7fd55eddb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5580c60d0 0x7fd5580c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:21.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.336+0000 7fd55eddb700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd558155830 con 0x7fd5580c7a60 2023-11-15T01:36:21.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.336+0000 7fd55eddb700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd558158f40 con 0x7fd5581541d0 2023-11-15T01:36:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.336+0000 7fd55eddb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd558154c20 con 0x7fd5580c60d0 2023-11-15T01:36:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.336+0000 7fd55ddd9700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd5581541d0 0x7fd5581545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.336+0000 7fd55ddd9700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd5581541d0 0x7fd5581545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49212/0 (socket says 172.21.15.1:49212) 2023-11-15T01:36:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.336+0000 7fd55ddd9700 1 -- 172.21.15.1:0/1347741327 learned_addr learned my addr 172.21.15.1:0/1347741327 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.336+0000 7fd55d5d8700 1 --2- 172.21.15.1:0/1347741327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5580c60d0 0x7fd5580c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.336+0000 7fd55ddd9700 1 -- 172.21.15.1:0/1347741327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5580c60d0 msgr2=0x7fd5580c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.336+0000 7fd55ddd9700 1 --2- 172.21.15.1:0/1347741327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5580c60d0 0x7fd5580c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.336+0000 7fd55ddd9700 1 -- 172.21.15.1:0/1347741327 >> v1:172.21.15.141:6789/0 conn(0x7fd5580c7a60 legacy=0x7fd5580c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.336+0000 7fd55ddd9700 1 -- 172.21.15.1:0/1347741327 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd558154f00 con 0x7fd5581541d0 2023-11-15T01:36:21.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.336+0000 7fd55ddd9700 1 --2- 172.21.15.1:0/1347741327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5581541d0 0x7fd5581545b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7fd554006fd0 tx=0x7fd5540090f0).ready entity=mon.0 client_cookie=723df882bc169c4c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:21.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.337+0000 7fd55cdd7700 1 -- 172.21.15.1:0/1347741327 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55400b580 con 0x7fd5581541d0 2023-11-15T01:36:21.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.337+0000 7fd55cdd7700 1 -- 172.21.15.1:0/1347741327 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55400b6e0 con 0x7fd5581541d0 2023-11-15T01:36:21.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.337+0000 7fd55cdd7700 1 -- 172.21.15.1:0/1347741327 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55400ba60 con 0x7fd5581541d0 2023-11-15T01:36:21.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.337+0000 7fd55eddb700 1 -- 172.21.15.1:0/1347741327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5581541d0 msgr2=0x7fd5581545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:21.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.337+0000 7fd55eddb700 1 --2- 172.21.15.1:0/1347741327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5581541d0 0x7fd5581545b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7fd554006fd0 tx=0x7fd5540090f0).stop 2023-11-15T01:36:21.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.337+0000 7fd55eddb700 1 -- 172.21.15.1:0/1347741327 shutdown_connections 2023-11-15T01:36:21.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.337+0000 7fd55eddb700 1 --2- 172.21.15.1:0/1347741327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5581541d0 0x7fd5581545b0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.337+0000 7fd55eddb700 1 --2- 172.21.15.1:0/1347741327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5580c60d0 0x7fd5580c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.337+0000 7fd55eddb700 1 -- 172.21.15.1:0/1347741327 >> 172.21.15.1:0/1347741327 conn(0x7fd558069ee0 msgr2=0x7fd55806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:21.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.337+0000 7fd55eddb700 1 -- 172.21.15.1:0/1347741327 shutdown_connections 2023-11-15T01:36:21.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.337+0000 7fd55eddb700 1 -- 172.21.15.1:0/1347741327 wait complete. 2023-11-15T01:36:21.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.338+0000 7fd55eddb700 1 Processor -- start 2023-11-15T01:36:21.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.339+0000 7fd55eddb700 1 -- start start 2023-11-15T01:36:21.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.339+0000 7fd55eddb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5580c60d0 0x7fd558140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:21.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.339+0000 7fd55eddb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5580c7a60 0x7fd5580c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:21.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.339+0000 7fd55eddb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5581541d0 0x7fd5580c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:21.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.339+0000 7fd55eddb700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd558141170 con 0x7fd5581541d0 2023-11-15T01:36:21.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.339+0000 7fd55eddb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5580c4cf0 con 0x7fd5580c7a60 2023-11-15T01:36:21.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.339+0000 7fd55eddb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5580ae9c0 con 0x7fd5580c60d0 2023-11-15T01:36:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.339+0000 7fd55e5da700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5581541d0 0x7fd5580c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.339+0000 7fd55e5da700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5581541d0 0x7fd5580c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49228/0 (socket says 172.21.15.1:49228) 2023-11-15T01:36:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.339+0000 7fd55e5da700 1 -- 172.21.15.1:0/2292102531 learned_addr learned my addr 172.21.15.1:0/2292102531 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.340+0000 7fd55ddd9700 1 --2- 172.21.15.1:0/2292102531 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5580c60d0 0x7fd558140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.340+0000 7fd55d5d8700 1 --2- 172.21.15.1:0/2292102531 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5580c7a60 0x7fd5580c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:21.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.340+0000 7fd55e5da700 1 -- 172.21.15.1:0/2292102531 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5580c60d0 msgr2=0x7fd558140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:21.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.340+0000 7fd55e5da700 1 --2- 172.21.15.1:0/2292102531 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5580c60d0 0x7fd558140c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.340+0000 7fd55e5da700 1 -- 172.21.15.1:0/2292102531 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5580c7a60 msgr2=0x7fd5580c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:21.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.340+0000 7fd55e5da700 1 --2- 172.21.15.1:0/2292102531 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5580c7a60 0x7fd5580c4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.340+0000 7fd55e5da700 1 -- 172.21.15.1:0/2292102531 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd554009370 con 0x7fd5581541d0 2023-11-15T01:36:21.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.340+0000 7fd55e5da700 1 --2- 172.21.15.1:0/2292102531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5581541d0 0x7fd5580c4800 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fd550002230 tx=0x7fd5500015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:21.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.340+0000 7fd54dffb700 1 -- 172.21.15.1:0/2292102531 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550010510 con 0x7fd5581541d0 2023-11-15T01:36:21.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.340+0000 7fd54dffb700 1 -- 172.21.15.1:0/2292102531 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd550010670 con 0x7fd5581541d0 2023-11-15T01:36:21.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.340+0000 7fd55eddb700 1 -- 172.21.15.1:0/2292102531 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5580ae0b0 con 0x7fd5581541d0 2023-11-15T01:36:21.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.340+0000 7fd54dffb700 1 -- 172.21.15.1:0/2292102531 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5500109f0 con 0x7fd5581541d0 2023-11-15T01:36:21.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.340+0000 7fd55eddb700 1 -- 172.21.15.1:0/2292102531 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5580ae370 con 0x7fd5581541d0 2023-11-15T01:36:21.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.341+0000 7fd55eddb700 1 -- 172.21.15.1:0/2292102531 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5580aeb30 con 0x7fd5581541d0 2023-11-15T01:36:21.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.342+0000 7fd54dffb700 1 -- 172.21.15.1:0/2292102531 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd55001b400 con 0x7fd5581541d0 2023-11-15T01:36:21.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.342+0000 7fd54dffb700 1 --2- 172.21.15.1:0/2292102531 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd53c05f240 0x7fd53c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:21.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.342+0000 7fd54dffb700 1 -- 172.21.15.1:0/2292102531 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6445+0+0 (secure 0 0 0) 0x7fd55007aaa0 con 0x7fd5581541d0 2023-11-15T01:36:21.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.342+0000 7fd55ddd9700 1 --2- 172.21.15.1:0/2292102531 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd53c05f240 0x7fd53c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:21.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.343+0000 7fd55ddd9700 1 --2- 172.21.15.1:0/2292102531 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd53c05f240 0x7fd53c061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd554009fd0 tx=0x7fd554017000).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:21.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.347+0000 7fd54dffb700 1 -- 172.21.15.1:0/2292102531 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd55004b2b0 con 0x7fd5581541d0 2023-11-15T01:36:21.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.562+0000 7fd55eddb700 1 -- 172.21.15.1:0/2292102531 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd5580475e0 con 0x7fd5581541d0 2023-11-15T01:36:21.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.567+0000 7fd54dffb700 1 -- 172.21.15.1:0/2292102531 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v27) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd55004e8d0 con 0x7fd5581541d0 2023-11-15T01:36:21.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.571+0000 7fd55eddb700 1 -- 172.21.15.1:0/2292102531 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd53c05f240 msgr2=0x7fd53c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:21.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.571+0000 7fd55eddb700 1 --2- 172.21.15.1:0/2292102531 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd53c05f240 0x7fd53c061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd554009fd0 tx=0x7fd554017000).stop 2023-11-15T01:36:21.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.571+0000 7fd55eddb700 1 -- 172.21.15.1:0/2292102531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5581541d0 msgr2=0x7fd5580c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:21.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.571+0000 7fd55eddb700 1 --2- 172.21.15.1:0/2292102531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5581541d0 0x7fd5580c4800 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fd550002230 tx=0x7fd5500015e0).stop 2023-11-15T01:36:21.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.572+0000 7fd55eddb700 1 -- 172.21.15.1:0/2292102531 shutdown_connections 2023-11-15T01:36:21.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.572+0000 7fd55eddb700 1 --2- 172.21.15.1:0/2292102531 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd53c05f240 0x7fd53c061700 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.572+0000 7fd55eddb700 1 --2- 172.21.15.1:0/2292102531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5581541d0 0x7fd5580c4800 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.572+0000 7fd55eddb700 1 --2- 172.21.15.1:0/2292102531 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5580c60d0 0x7fd558140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.572+0000 7fd55eddb700 1 --2- 172.21.15.1:0/2292102531 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5580c7a60 0x7fd5580c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.572+0000 7fd55eddb700 1 -- 172.21.15.1:0/2292102531 >> 172.21.15.1:0/2292102531 conn(0x7fd558069ee0 msgr2=0x7fd5580c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:21.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.574+0000 7fd55eddb700 1 -- 172.21.15.1:0/2292102531 shutdown_connections 2023-11-15T01:36:21.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.575+0000 7fd55eddb700 1 -- 172.21.15.1:0/2292102531 wait complete. 2023-11-15T01:36:21.589 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 9 and data pool 10 2023-11-15T01:36:21.600 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:36:21.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.716+0000 7f914cf2e700 1 Processor -- start 2023-11-15T01:36:21.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.716+0000 7f914cf2e700 1 -- start start 2023-11-15T01:36:21.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.717+0000 7f914cf2e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91480ab1a0 0x7f9148154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:21.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.717+0000 7f914cf2e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f91480aa060 0x7f91480c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:21.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.717+0000 7f914cf2e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91480c06f0 con 0x7f9148154150 2023-11-15T01:36:21.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.717+0000 7f914cf2e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91480c09d0 con 0x7f91480aa060 2023-11-15T01:36:21.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.717+0000 7f914cf2e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9148158820 con 0x7f91480ab1a0 2023-11-15T01:36:21.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.718+0000 7f9145d9b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91480ab1a0 0x7f9148154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:21.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.718+0000 7f9146d9d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f91480aa060 0x7f91480c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:21.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.718+0000 7f9145d9b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91480ab1a0 0x7f9148154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:37560/0 (socket says 172.21.15.1:37560) 2023-11-15T01:36:21.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.718+0000 7f9145d9b700 1 -- 172.21.15.1:0/3578280459 learned_addr learned my addr 172.21.15.1:0/3578280459 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:21.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.718+0000 7f914659c700 1 --1- 172.21.15.1:0/3578280459 >> v1:172.21.15.141:6789/0 conn(0x7f9148154150 0x7f9148158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:56418/0 (socket says 172.21.15.1:56418) 2023-11-15T01:36:21.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.718+0000 7f9145d9b700 1 -- 172.21.15.1:0/3578280459 >> v2:172.21.15.141:3300/0 conn(0x7f91480aa060 msgr2=0x7f91480c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:21.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.718+0000 7f9145d9b700 1 --2- 172.21.15.1:0/3578280459 >> v2:172.21.15.141:3300/0 conn(0x7f91480aa060 0x7f91480c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.718+0000 7f9145d9b700 1 -- 172.21.15.1:0/3578280459 >> v1:172.21.15.141:6789/0 conn(0x7f9148154150 legacy=0x7f9148158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.718+0000 7f9145d9b700 1 -- 172.21.15.1:0/3578280459 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9148158b00 con 0x7f91480ab1a0 2023-11-15T01:36:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.718+0000 7f9145d9b700 1 --2- 172.21.15.1:0/3578280459 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91480ab1a0 0x7f9148154530 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f9130006fd0 tx=0x7f91300090f0).ready entity=mon.2 client_cookie=1d160e9bb1da6c95 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.718+0000 7f914559a700 1 -- 172.21.15.1:0/3578280459 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913000b580 con 0x7f91480ab1a0 2023-11-15T01:36:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.718+0000 7f914559a700 1 -- 172.21.15.1:0/3578280459 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913000b6e0 con 0x7f91480ab1a0 2023-11-15T01:36:21.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.718+0000 7f914559a700 1 -- 172.21.15.1:0/3578280459 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913000ba80 con 0x7f91480ab1a0 2023-11-15T01:36:21.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.719+0000 7f914cf2e700 1 -- 172.21.15.1:0/3578280459 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91480ab1a0 msgr2=0x7f9148154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:21.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.719+0000 7f914cf2e700 1 --2- 172.21.15.1:0/3578280459 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91480ab1a0 0x7f9148154530 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f9130006fd0 tx=0x7f91300090f0).stop 2023-11-15T01:36:21.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.719+0000 7f914cf2e700 1 -- 172.21.15.1:0/3578280459 shutdown_connections 2023-11-15T01:36:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.719+0000 7f914cf2e700 1 --2- 172.21.15.1:0/3578280459 >> v2:172.21.15.141:3300/0 conn(0x7f91480aa060 0x7f91480c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.719+0000 7f914cf2e700 1 --2- 172.21.15.1:0/3578280459 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91480ab1a0 0x7f9148154530 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.719+0000 7f914cf2e700 1 -- 172.21.15.1:0/3578280459 >> 172.21.15.1:0/3578280459 conn(0x7f9148064aa0 msgr2=0x7f9148064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.719+0000 7f914cf2e700 1 -- 172.21.15.1:0/3578280459 shutdown_connections 2023-11-15T01:36:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.719+0000 7f914cf2e700 1 -- 172.21.15.1:0/3578280459 wait complete. 2023-11-15T01:36:21.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.720+0000 7f914cf2e700 1 Processor -- start 2023-11-15T01:36:21.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.720+0000 7f914cf2e700 1 -- start start 2023-11-15T01:36:21.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f914cf2e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91480aa060 0x7f9148144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:21.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f914cf2e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91480ab1a0 0x7f9148155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:21.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f914cf2e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9148154150 0x7f91480ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:21.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f914cf2e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9148156da0 con 0x7f9148154150 2023-11-15T01:36:21.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f914cf2e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9148155eb0 con 0x7f91480aa060 2023-11-15T01:36:21.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f914cf2e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9148156190 con 0x7f91480ab1a0 2023-11-15T01:36:21.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f914659c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91480aa060 0x7f9148144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:21.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f9145d9b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91480ab1a0 0x7f9148155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:21.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f9146d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9148154150 0x7f91480ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:21.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f9145d9b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91480ab1a0 0x7f9148155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:37576/0 (socket says 172.21.15.1:37576) 2023-11-15T01:36:21.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f9145d9b700 1 -- 172.21.15.1:0/1798837807 learned_addr learned my addr 172.21.15.1:0/1798837807 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:21.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f914659c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91480aa060 0x7f9148144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:56976/0 (socket says 172.21.15.1:56976) 2023-11-15T01:36:21.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f9146d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9148154150 0x7f91480ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49234/0 (socket says 172.21.15.1:49234) 2023-11-15T01:36:21.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f914659c700 1 -- 172.21.15.1:0/1798837807 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91480ab1a0 msgr2=0x7f9148155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:21.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f914659c700 1 --2- 172.21.15.1:0/1798837807 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91480ab1a0 0x7f9148155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f914659c700 1 -- 172.21.15.1:0/1798837807 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9148154150 msgr2=0x7f91480ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:21.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f914659c700 1 --2- 172.21.15.1:0/1798837807 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9148154150 0x7f91480ac590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f914659c700 1 -- 172.21.15.1:0/1798837807 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9130009370 con 0x7f91480aa060 2023-11-15T01:36:21.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f9146d9d700 1 --2- 172.21.15.1:0/1798837807 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9148154150 0x7f91480ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:21.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.721+0000 7f914659c700 1 --2- 172.21.15.1:0/1798837807 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91480aa060 0x7f9148144670 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f914000c7c0 tx=0x7f91400014c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:21.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.722+0000 7f913e7fc700 1 -- 172.21.15.1:0/1798837807 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140005c70 con 0x7f91480aa060 2023-11-15T01:36:21.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.722+0000 7f913e7fc700 1 -- 172.21.15.1:0/1798837807 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9140005dd0 con 0x7f91480aa060 2023-11-15T01:36:21.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.722+0000 7f913e7fc700 1 -- 172.21.15.1:0/1798837807 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91400072e0 con 0x7f91480aa060 2023-11-15T01:36:21.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.722+0000 7f914cf2e700 1 -- 172.21.15.1:0/1798837807 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9148156470 con 0x7f91480aa060 2023-11-15T01:36:21.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.722+0000 7f914cf2e700 1 -- 172.21.15.1:0/1798837807 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9148156a30 con 0x7f91480aa060 2023-11-15T01:36:21.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.723+0000 7f914cf2e700 1 -- 172.21.15.1:0/1798837807 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914806c7e0 con 0x7f91480aa060 2023-11-15T01:36:21.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.723+0000 7f913e7fc700 1 -- 172.21.15.1:0/1798837807 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9140007710 con 0x7f91480aa060 2023-11-15T01:36:21.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.723+0000 7f913e7fc700 1 --2- 172.21.15.1:0/1798837807 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f912805f270 0x7f9128061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:21.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.723+0000 7f913e7fc700 1 -- 172.21.15.1:0/1798837807 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f9140079dd0 con 0x7f91480aa060 2023-11-15T01:36:21.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.724+0000 7f9145d9b700 1 --2- 172.21.15.1:0/1798837807 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f912805f270 0x7f9128061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:21.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.724+0000 7f9145d9b700 1 --2- 172.21.15.1:0/1798837807 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f912805f270 0x7f9128061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f91481489d0 tx=0x7f9130017000).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:21.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.728+0000 7f913e7fc700 1 -- 172.21.15.1:0/1798837807 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f914004ad70 con 0x7f91480aa060 2023-11-15T01:36:21.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.901+0000 7f914cf2e700 1 -- 172.21.15.1:0/1798837807 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9148158de0 con 0x7f91480aa060 2023-11-15T01:36:21.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.902+0000 7f913e7fc700 1 -- 172.21.15.1:0/1798837807 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+17539 (secure 0 0 0) 0x7f914004e390 con 0x7f91480aa060 2023-11-15T01:36:21.904 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:21.904 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":78,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:36:21.563904+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:36:19.249413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-15T01:36:20.544874+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:36:21.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.904+0000 7f914cf2e700 1 -- 172.21.15.1:0/1798837807 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f912805f270 msgr2=0x7f9128061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:21.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.904+0000 7f914cf2e700 1 --2- 172.21.15.1:0/1798837807 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f912805f270 0x7f9128061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f91481489d0 tx=0x7f9130017000).stop 2023-11-15T01:36:21.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.904+0000 7f914cf2e700 1 -- 172.21.15.1:0/1798837807 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91480aa060 msgr2=0x7f9148144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:21.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.904+0000 7f914cf2e700 1 --2- 172.21.15.1:0/1798837807 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91480aa060 0x7f9148144670 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f914000c7c0 tx=0x7f91400014c0).stop 2023-11-15T01:36:21.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.904+0000 7f914cf2e700 1 -- 172.21.15.1:0/1798837807 shutdown_connections 2023-11-15T01:36:21.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.904+0000 7f914cf2e700 1 --2- 172.21.15.1:0/1798837807 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f912805f270 0x7f9128061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.904+0000 7f914cf2e700 1 --2- 172.21.15.1:0/1798837807 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9148154150 0x7f91480ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.904+0000 7f914cf2e700 1 --2- 172.21.15.1:0/1798837807 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91480aa060 0x7f9148144670 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.904+0000 7f914cf2e700 1 --2- 172.21.15.1:0/1798837807 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f91480ab1a0 0x7f9148155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:21.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.904+0000 7f914cf2e700 1 -- 172.21.15.1:0/1798837807 >> 172.21.15.1:0/1798837807 conn(0x7f9148064aa0 msgr2=0x7f91480c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:21.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.904+0000 7f914cf2e700 1 -- 172.21.15.1:0/1798837807 shutdown_connections 2023-11-15T01:36:21.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:21.904+0000 7f914cf2e700 1 -- 172.21.15.1:0/1798837807 wait complete. 2023-11-15T01:36:21.917 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:36:22.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.034+0000 7f812ac5d700 1 Processor -- start 2023-11-15T01:36:22.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.034+0000 7f812ac5d700 1 -- start start 2023-11-15T01:36:22.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.035+0000 7f812ac5d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8124151e10 0x7f8124155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:22.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.035+0000 7f812ac5d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f81240c86b0 0x7f81240aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:22.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.035+0000 7f812ac5d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81240c7980 con 0x7f81240c98b0 2023-11-15T01:36:22.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.035+0000 7f812ac5d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81240c8b10 con 0x7f81240c86b0 2023-11-15T01:36:22.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.035+0000 7f812ac5d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81240aa5c0 con 0x7f8124151e10 2023-11-15T01:36:22.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.035+0000 7f812945a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f81240c86b0 0x7f81240aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:22.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.035+0000 7f812945a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f81240c86b0 0x7f81240aa0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49240/0 (socket says 172.21.15.1:49240) 2023-11-15T01:36:22.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.035+0000 7f812945a700 1 -- 172.21.15.1:0/3744287105 learned_addr learned my addr 172.21.15.1:0/3744287105 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:22.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.035+0000 7f8129c5b700 1 --2- 172.21.15.1:0/3744287105 >> v2:172.21.15.141:3300/0 conn(0x7f8124151e10 0x7f8124155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:22.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.035+0000 7f812945a700 1 -- 172.21.15.1:0/3744287105 >> v2:172.21.15.141:3300/0 conn(0x7f8124151e10 msgr2=0x7f8124155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:22.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.035+0000 7f812945a700 1 --2- 172.21.15.1:0/3744287105 >> v2:172.21.15.141:3300/0 conn(0x7f8124151e10 0x7f8124155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.035+0000 7f812945a700 1 -- 172.21.15.1:0/3744287105 >> v1:172.21.15.141:6789/0 conn(0x7f81240c98b0 legacy=0x7f81240c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:22.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.035+0000 7f812945a700 1 -- 172.21.15.1:0/3744287105 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81240aa890 con 0x7f81240c86b0 2023-11-15T01:36:22.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.035+0000 7f8129c5b700 1 --2- 172.21.15.1:0/3744287105 >> v2:172.21.15.141:3300/0 conn(0x7f8124151e10 0x7f8124155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:22.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.036+0000 7f812945a700 1 --2- 172.21.15.1:0/3744287105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81240c86b0 0x7f81240aa0d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f8124084780 tx=0x7f81180090f0).ready entity=mon.0 client_cookie=1270ba90840e33d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:22.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.036+0000 7f8128c59700 1 -- 172.21.15.1:0/3744287105 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811800b600 con 0x7f81240c86b0 2023-11-15T01:36:22.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.036+0000 7f8128c59700 1 -- 172.21.15.1:0/3744287105 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811800b760 con 0x7f81240c86b0 2023-11-15T01:36:22.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.036+0000 7f8128c59700 1 -- 172.21.15.1:0/3744287105 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811800bae0 con 0x7f81240c86b0 2023-11-15T01:36:22.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.036+0000 7f812ac5d700 1 -- 172.21.15.1:0/3744287105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81240c86b0 msgr2=0x7f81240aa0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:22.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.036+0000 7f812ac5d700 1 --2- 172.21.15.1:0/3744287105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81240c86b0 0x7f81240aa0d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f8124084780 tx=0x7f81180090f0).stop 2023-11-15T01:36:22.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.036+0000 7f812ac5d700 1 -- 172.21.15.1:0/3744287105 shutdown_connections 2023-11-15T01:36:22.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.036+0000 7f812ac5d700 1 --2- 172.21.15.1:0/3744287105 >> v2:172.21.15.141:3300/0 conn(0x7f8124151e10 0x7f8124155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.036+0000 7f812ac5d700 1 --2- 172.21.15.1:0/3744287105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81240c86b0 0x7f81240aa0d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.036+0000 7f812ac5d700 1 -- 172.21.15.1:0/3744287105 >> 172.21.15.1:0/3744287105 conn(0x7f81240947e0 msgr2=0x7f812406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:22.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.036+0000 7f812ac5d700 1 -- 172.21.15.1:0/3744287105 shutdown_connections 2023-11-15T01:36:22.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.036+0000 7f812ac5d700 1 -- 172.21.15.1:0/3744287105 wait complete. 2023-11-15T01:36:22.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.037+0000 7f812ac5d700 1 Processor -- start 2023-11-15T01:36:22.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.038+0000 7f812ac5d700 1 -- start start 2023-11-15T01:36:22.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.038+0000 7f812ac5d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81240c86b0 0x7f81240aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:22.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.038+0000 7f812ac5d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81240c98b0 0x7f81240b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:22.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.038+0000 7f812ac5d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8124151e10 0x7f8124064720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:22.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.038+0000 7f812ac5d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81240abe60 con 0x7f81240c98b0 2023-11-15T01:36:22.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.038+0000 7f812ac5d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81240ab1e0 con 0x7f81240c86b0 2023-11-15T01:36:22.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.038+0000 7f812ac5d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81240ab4c0 con 0x7f8124151e10 2023-11-15T01:36:22.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.038+0000 7f812945a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81240c98b0 0x7f81240b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:22.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.038+0000 7f812945a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81240c98b0 0x7f81240b0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49252/0 (socket says 172.21.15.1:49252) 2023-11-15T01:36:22.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.038+0000 7f812945a700 1 -- 172.21.15.1:0/2308536239 learned_addr learned my addr 172.21.15.1:0/2308536239 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:22.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.039+0000 7f8129c5b700 1 --2- 172.21.15.1:0/2308536239 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81240c86b0 0x7f81240aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:22.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.039+0000 7f812a45c700 1 --2- 172.21.15.1:0/2308536239 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8124151e10 0x7f8124064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:22.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.039+0000 7f812945a700 1 -- 172.21.15.1:0/2308536239 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8124151e10 msgr2=0x7f8124064720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:22.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.039+0000 7f812945a700 1 --2- 172.21.15.1:0/2308536239 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8124151e10 0x7f8124064720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.039+0000 7f812945a700 1 -- 172.21.15.1:0/2308536239 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81240c86b0 msgr2=0x7f81240aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:22.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.039+0000 7f812945a700 1 --2- 172.21.15.1:0/2308536239 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81240c86b0 0x7f81240aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.039+0000 7f812945a700 1 -- 172.21.15.1:0/2308536239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8118009370 con 0x7f81240c98b0 2023-11-15T01:36:22.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.039+0000 7f8129c5b700 1 --2- 172.21.15.1:0/2308536239 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81240c86b0 0x7f81240aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:22.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.039+0000 7f812945a700 1 --2- 172.21.15.1:0/2308536239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81240c98b0 0x7f81240b0280 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f8118009fd0 tx=0x7f8118017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:22.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.039+0000 7f8121ffb700 1 -- 172.21.15.1:0/2308536239 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811800b8d0 con 0x7f81240c98b0 2023-11-15T01:36:22.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.039+0000 7f8121ffb700 1 -- 172.21.15.1:0/2308536239 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811800ba30 con 0x7f81240c98b0 2023-11-15T01:36:22.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.039+0000 7f812ac5d700 1 -- 172.21.15.1:0/2308536239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81240ab7a0 con 0x7f81240c98b0 2023-11-15T01:36:22.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.039+0000 7f8121ffb700 1 -- 172.21.15.1:0/2308536239 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811801b660 con 0x7f81240c98b0 2023-11-15T01:36:22.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.039+0000 7f812ac5d700 1 -- 172.21.15.1:0/2308536239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81240b0770 con 0x7f81240c98b0 2023-11-15T01:36:22.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.040+0000 7f812ac5d700 1 -- 172.21.15.1:0/2308536239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81240abfa0 con 0x7f81240c98b0 2023-11-15T01:36:22.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.041+0000 7f8121ffb700 1 -- 172.21.15.1:0/2308536239 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f811801ba10 con 0x7f81240c98b0 2023-11-15T01:36:22.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.041+0000 7f8121ffb700 1 --2- 172.21.15.1:0/2308536239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f811005f270 0x7f8110061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:22.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.041+0000 7f8121ffb700 1 -- 172.21.15.1:0/2308536239 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f811807b9c0 con 0x7f81240c98b0 2023-11-15T01:36:22.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.042+0000 7f8129c5b700 1 --2- 172.21.15.1:0/2308536239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f811005f270 0x7f8110061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:22.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.042+0000 7f8129c5b700 1 --2- 172.21.15.1:0/2308536239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f811005f270 0x7f8110061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f811c006d80 tx=0x7f811c008040).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:22.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.045+0000 7f8121ffb700 1 -- 172.21.15.1:0/2308536239 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f811804ca20 con 0x7f81240c98b0 2023-11-15T01:36:22.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.218+0000 7f812ac5d700 1 -- 172.21.15.1:0/2308536239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81240475e0 con 0x7f81240c98b0 2023-11-15T01:36:22.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.219+0000 7f8121ffb700 1 -- 172.21.15.1:0/2308536239 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+17539 (secure 0 0 0) 0x7f811801f090 con 0x7f81240c98b0 2023-11-15T01:36:22.221 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:22.221 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":78,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:36:21.563904+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:36:19.249413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-15T01:36:20.544874+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:36:22.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.221+0000 7f812ac5d700 1 -- 172.21.15.1:0/2308536239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f811005f270 msgr2=0x7f8110061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:22.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.221+0000 7f812ac5d700 1 --2- 172.21.15.1:0/2308536239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f811005f270 0x7f8110061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f811c006d80 tx=0x7f811c008040).stop 2023-11-15T01:36:22.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.221+0000 7f812ac5d700 1 -- 172.21.15.1:0/2308536239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81240c98b0 msgr2=0x7f81240b0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:22.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.221+0000 7f812ac5d700 1 --2- 172.21.15.1:0/2308536239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81240c98b0 0x7f81240b0280 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f8118009fd0 tx=0x7f8118017000).stop 2023-11-15T01:36:22.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.221+0000 7f812ac5d700 1 -- 172.21.15.1:0/2308536239 shutdown_connections 2023-11-15T01:36:22.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.221+0000 7f812ac5d700 1 --2- 172.21.15.1:0/2308536239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f811005f270 0x7f8110061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.221+0000 7f812ac5d700 1 --2- 172.21.15.1:0/2308536239 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8124151e10 0x7f8124064720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.221+0000 7f812ac5d700 1 --2- 172.21.15.1:0/2308536239 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81240c86b0 0x7f81240aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.221+0000 7f812ac5d700 1 --2- 172.21.15.1:0/2308536239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81240c98b0 0x7f81240b0280 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.221+0000 7f812ac5d700 1 -- 172.21.15.1:0/2308536239 >> 172.21.15.1:0/2308536239 conn(0x7f81240947e0 msgr2=0x7f812414fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.221+0000 7f812ac5d700 1 -- 172.21.15.1:0/2308536239 shutdown_connections 2023-11-15T01:36:22.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.221+0000 7f812ac5d700 1 -- 172.21.15.1:0/2308536239 wait complete. 2023-11-15T01:36:22.235 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-15T01:36:22.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.355+0000 7f231d342700 1 Processor -- start 2023-11-15T01:36:22.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.355+0000 7f231d342700 1 -- start start 2023-11-15T01:36:22.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f231d342700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23180ad790 0x7f23181555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:22.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f231d342700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2318158150 0x7f23180c7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:22.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f231d342700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f23180c7e70 0x7f2318063550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:22.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f231d342700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23180c6440 con 0x7f23180c7e70 2023-11-15T01:36:22.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f231d342700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23180c9210 con 0x7f2318158150 2023-11-15T01:36:22.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f231d342700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2318155ab0 con 0x7f23180ad790 2023-11-15T01:36:22.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f23177fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f23180c7e70 0x7f2318063550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:22.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f23177fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f23180c7e70 0x7f2318063550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49262/0 (socket says 172.21.15.1:49262) 2023-11-15T01:36:22.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f23177fe700 1 -- 172.21.15.1:0/4131103861 learned_addr learned my addr 172.21.15.1:0/4131103861 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:22.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f23167fc700 1 --2- 172.21.15.1:0/4131103861 >> v2:172.21.15.141:3300/0 conn(0x7f2318158150 0x7f23180c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:22.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f2316ffd700 1 --2- 172.21.15.1:0/4131103861 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23180ad790 0x7f23181555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:22.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f23177fe700 1 -- 172.21.15.1:0/4131103861 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23180ad790 msgr2=0x7f23181555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:22.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f23177fe700 1 --2- 172.21.15.1:0/4131103861 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23180ad790 0x7f23181555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f23177fe700 1 -- 172.21.15.1:0/4131103861 >> v2:172.21.15.141:3300/0 conn(0x7f2318158150 msgr2=0x7f23180c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:22.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f23177fe700 1 --2- 172.21.15.1:0/4131103861 >> v2:172.21.15.141:3300/0 conn(0x7f2318158150 0x7f23180c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f23177fe700 1 -- 172.21.15.1:0/4131103861 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318158650 con 0x7f23180c7e70 2023-11-15T01:36:22.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f23177fe700 1 --2- 172.21.15.1:0/4131103861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23180c7e70 0x7f2318063550 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f23180c20c0 tx=0x7f2308009840).ready entity=mon.0 client_cookie=e5f9d5fd52bc102a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:22.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f2315ffb700 1 -- 172.21.15.1:0/4131103861 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800e070 con 0x7f23180c7e70 2023-11-15T01:36:22.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f2315ffb700 1 -- 172.21.15.1:0/4131103861 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230800b970 con 0x7f23180c7e70 2023-11-15T01:36:22.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.356+0000 7f2315ffb700 1 -- 172.21.15.1:0/4131103861 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800bcf0 con 0x7f23180c7e70 2023-11-15T01:36:22.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.357+0000 7f231d342700 1 -- 172.21.15.1:0/4131103861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23180c7e70 msgr2=0x7f2318063550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:22.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.357+0000 7f231d342700 1 --2- 172.21.15.1:0/4131103861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23180c7e70 0x7f2318063550 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f23180c20c0 tx=0x7f2308009840).stop 2023-11-15T01:36:22.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.357+0000 7f231d342700 1 -- 172.21.15.1:0/4131103861 shutdown_connections 2023-11-15T01:36:22.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.357+0000 7f231d342700 1 --2- 172.21.15.1:0/4131103861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23180c7e70 0x7f2318063550 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.357+0000 7f231d342700 1 --2- 172.21.15.1:0/4131103861 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23180ad790 0x7f23181555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.357+0000 7f231d342700 1 --2- 172.21.15.1:0/4131103861 >> v2:172.21.15.141:3300/0 conn(0x7f2318158150 0x7f23180c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.357+0000 7f231d342700 1 -- 172.21.15.1:0/4131103861 >> 172.21.15.1:0/4131103861 conn(0x7f2318064a90 msgr2=0x7f2318064ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:22.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.357+0000 7f231d342700 1 -- 172.21.15.1:0/4131103861 shutdown_connections 2023-11-15T01:36:22.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.357+0000 7f231d342700 1 -- 172.21.15.1:0/4131103861 wait complete. 2023-11-15T01:36:22.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.358+0000 7f231d342700 1 Processor -- start 2023-11-15T01:36:22.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.358+0000 7f231d342700 1 -- start start 2023-11-15T01:36:22.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.359+0000 7f231d342700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23180ad790 0x7f23180c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:22.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.359+0000 7f231d342700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23180c7e70 0x7f23180c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:22.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.359+0000 7f231d342700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2318158150 0x7f23180ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:22.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.359+0000 7f231d342700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180aec40 con 0x7f23180c7e70 2023-11-15T01:36:22.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.359+0000 7f231d342700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180aa7f0 con 0x7f2318158150 2023-11-15T01:36:22.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.359+0000 7f231d342700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23180b0920 con 0x7f23180ad790 2023-11-15T01:36:22.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.359+0000 7f23167fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23180c7e70 0x7f23180c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:22.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.359+0000 7f23167fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23180c7e70 0x7f23180c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49270/0 (socket says 172.21.15.1:49270) 2023-11-15T01:36:22.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.359+0000 7f23167fc700 1 -- 172.21.15.1:0/202956682 learned_addr learned my addr 172.21.15.1:0/202956682 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:22.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.359+0000 7f23177fe700 1 --2- 172.21.15.1:0/202956682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2318158150 0x7f23180ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:22.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.359+0000 7f2316ffd700 1 --2- 172.21.15.1:0/202956682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23180ad790 0x7f23180c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:22.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.359+0000 7f23167fc700 1 -- 172.21.15.1:0/202956682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23180ad790 msgr2=0x7f23180c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:22.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.359+0000 7f23167fc700 1 --2- 172.21.15.1:0/202956682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23180ad790 0x7f23180c4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.359+0000 7f23167fc700 1 -- 172.21.15.1:0/202956682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2318158150 msgr2=0x7f23180ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:22.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.359+0000 7f23167fc700 1 --2- 172.21.15.1:0/202956682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2318158150 0x7f23180ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:22.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.360+0000 7f23167fc700 1 -- 172.21.15.1:0/202956682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308009ae0 con 0x7f23180c7e70 2023-11-15T01:36:22.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.360+0000 7f23177fe700 1 --2- 172.21.15.1:0/202956682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2318158150 0x7f23180ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:22.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.360+0000 7f23167fc700 1 --2- 172.21.15.1:0/202956682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23180c7e70 0x7f23180c4280 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f2300009fd0 tx=0x7f2300009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:22.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.360+0000 7f230effd700 1 -- 172.21.15.1:0/202956682 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230000c6a0 con 0x7f23180c7e70 2023-11-15T01:36:22.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.360+0000 7f230effd700 1 -- 172.21.15.1:0/202956682 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230000c800 con 0x7f23180c7e70 2023-11-15T01:36:22.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.360+0000 7f231d342700 1 -- 172.21.15.1:0/202956682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23180b0c00 con 0x7f23180c7e70 2023-11-15T01:36:22.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.360+0000 7f230effd700 1 -- 172.21.15.1:0/202956682 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230000cb80 con 0x7f23180c7e70 2023-11-15T01:36:22.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.360+0000 7f231d342700 1 -- 172.21.15.1:0/202956682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23180c4f90 con 0x7f23180c7e70 2023-11-15T01:36:22.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.361+0000 7f231d342700 1 -- 172.21.15.1:0/202956682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23180aedf0 con 0x7f23180c7e70 2023-11-15T01:36:22.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.361+0000 7f230effd700 1 -- 172.21.15.1:0/202956682 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f230001b400 con 0x7f23180c7e70 2023-11-15T01:36:22.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.362+0000 7f230effd700 1 --2- 172.21.15.1:0/202956682 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f22f805f270 0x7f22f8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:22.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.362+0000 7f230effd700 1 -- 172.21.15.1:0/202956682 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f230007aa30 con 0x7f23180c7e70 2023-11-15T01:36:22.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.362+0000 7f2316ffd700 1 --2- 172.21.15.1:0/202956682 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f22f805f270 0x7f22f8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:22.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.362+0000 7f2316ffd700 1 --2- 172.21.15.1:0/202956682 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f22f805f270 0x7f22f8061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2310006d80 tx=0x7f2310008040).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:22.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.366+0000 7f230effd700 1 -- 172.21.15.1:0/202956682 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f23180aedf0 con 0x7f23180c7e70 2023-11-15T01:36:22.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:22.586+0000 7f231d342700 1 -- 172.21.15.1:0/202956682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f23180475e0 con 0x7f23180c7e70 2023-11-15T01:36:23.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.580+0000 7f230effd700 1 -- 172.21.15.1:0/202956682 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7f230004ba20 con 0x7f23180c7e70 2023-11-15T01:36:23.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.582+0000 7f231d342700 1 -- 172.21.15.1:0/202956682 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f22f805f270 msgr2=0x7f22f8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:23.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.582+0000 7f231d342700 1 --2- 172.21.15.1:0/202956682 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f22f805f270 0x7f22f8061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2310006d80 tx=0x7f2310008040).stop 2023-11-15T01:36:23.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.582+0000 7f231d342700 1 -- 172.21.15.1:0/202956682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23180c7e70 msgr2=0x7f23180c4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:23.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.582+0000 7f231d342700 1 --2- 172.21.15.1:0/202956682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23180c7e70 0x7f23180c4280 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f2300009fd0 tx=0x7f2300009060).stop 2023-11-15T01:36:23.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.582+0000 7f231d342700 1 -- 172.21.15.1:0/202956682 shutdown_connections 2023-11-15T01:36:23.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.582+0000 7f231d342700 1 --2- 172.21.15.1:0/202956682 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f22f805f270 0x7f22f8061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:23.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.582+0000 7f231d342700 1 --2- 172.21.15.1:0/202956682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2318158150 0x7f23180ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:23.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.582+0000 7f231d342700 1 --2- 172.21.15.1:0/202956682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23180ad790 0x7f23180c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:23.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.582+0000 7f231d342700 1 --2- 172.21.15.1:0/202956682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23180c7e70 0x7f23180c4280 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:23.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.582+0000 7f231d342700 1 -- 172.21.15.1:0/202956682 >> 172.21.15.1:0/202956682 conn(0x7f2318064a90 msgr2=0x7f2318151ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:23.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.582+0000 7f231d342700 1 -- 172.21.15.1:0/202956682 shutdown_connections 2023-11-15T01:36:23.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.582+0000 7f231d342700 1 -- 172.21.15.1:0/202956682 wait complete. 2023-11-15T01:36:23.598 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-15T01:36:23.599 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-15T01:36:23.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.726+0000 7f2350b36700 1 Processor -- start 2023-11-15T01:36:23.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.726+0000 7f2350b36700 1 -- start start 2023-11-15T01:36:23.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.727+0000 7f2350b36700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f234c154480 0x7f234c0c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:23.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.727+0000 7f2350b36700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f234c0c6430 0x7f234c0aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:23.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.728+0000 7f2350b36700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234c0ca050 con 0x7f234c1540a0 2023-11-15T01:36:23.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.728+0000 7f2350b36700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234c0c68c0 con 0x7f234c0c6430 2023-11-15T01:36:23.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.728+0000 7f2350b36700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c0c9440 con 0x7f234c154480 2023-11-15T01:36:23.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.728+0000 7f234ad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f234c0c6430 0x7f234c0aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:23.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.728+0000 7f234ad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f234c0c6430 0x7f234c0aaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49286/0 (socket says 172.21.15.1:49286) 2023-11-15T01:36:23.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.728+0000 7f234ad9d700 1 -- 172.21.15.1:0/3314362130 learned_addr learned my addr 172.21.15.1:0/3314362130 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:23.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.728+0000 7f2349d9b700 1 --2- 172.21.15.1:0/3314362130 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f234c154480 0x7f234c0c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:23.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.728+0000 7f234ad9d700 1 -- 172.21.15.1:0/3314362130 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f234c154480 msgr2=0x7f234c0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:23.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.728+0000 7f234ad9d700 1 --2- 172.21.15.1:0/3314362130 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f234c154480 0x7f234c0c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:23.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.728+0000 7f234ad9d700 1 -- 172.21.15.1:0/3314362130 >> v1:172.21.15.141:6789/0 conn(0x7f234c1540a0 legacy=0x7f234c0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:23.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.728+0000 7f234ad9d700 1 -- 172.21.15.1:0/3314362130 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c0c9720 con 0x7f234c0c6430 2023-11-15T01:36:23.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.728+0000 7f234ad9d700 1 --2- 172.21.15.1:0/3314362130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f234c0c6430 0x7f234c0aaf40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f2344009f20 tx=0x7f2344009840).ready entity=mon.0 client_cookie=243b007daa4f053d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:23.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.728+0000 7f234959a700 1 -- 172.21.15.1:0/3314362130 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234400e070 con 0x7f234c0c6430 2023-11-15T01:36:23.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.728+0000 7f234959a700 1 -- 172.21.15.1:0/3314362130 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234400ba40 con 0x7f234c0c6430 2023-11-15T01:36:23.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.728+0000 7f234959a700 1 -- 172.21.15.1:0/3314362130 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234400bdc0 con 0x7f234c0c6430 2023-11-15T01:36:23.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.729+0000 7f2350b36700 1 -- 172.21.15.1:0/3314362130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f234c0c6430 msgr2=0x7f234c0aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:23.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.729+0000 7f2350b36700 1 --2- 172.21.15.1:0/3314362130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f234c0c6430 0x7f234c0aaf40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f2344009f20 tx=0x7f2344009840).stop 2023-11-15T01:36:23.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.729+0000 7f2350b36700 1 -- 172.21.15.1:0/3314362130 shutdown_connections 2023-11-15T01:36:23.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.729+0000 7f2350b36700 1 --2- 172.21.15.1:0/3314362130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f234c0c6430 0x7f234c0aaf40 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:23.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.729+0000 7f2350b36700 1 --2- 172.21.15.1:0/3314362130 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f234c154480 0x7f234c0c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:23.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.729+0000 7f2350b36700 1 -- 172.21.15.1:0/3314362130 >> 172.21.15.1:0/3314362130 conn(0x7f234c064a70 msgr2=0x7f234c064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:23.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.729+0000 7f2350b36700 1 -- 172.21.15.1:0/3314362130 shutdown_connections 2023-11-15T01:36:23.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.729+0000 7f2350b36700 1 -- 172.21.15.1:0/3314362130 wait complete. 2023-11-15T01:36:23.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.730+0000 7f2350b36700 1 Processor -- start 2023-11-15T01:36:23.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.730+0000 7f2350b36700 1 -- start start 2023-11-15T01:36:23.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f2350b36700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f234c0c6430 0x7f234c0b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:23.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f2350b36700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f234c1540a0 0x7f234c14c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:23.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f2350b36700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f234c154480 0x7f234c0ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:23.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f2350b36700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c0b01d0 con 0x7f234c0c6430 2023-11-15T01:36:23.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f2350b36700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c0aea70 con 0x7f234c154480 2023-11-15T01:36:23.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f2350b36700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c0aed30 con 0x7f234c1540a0 2023-11-15T01:36:23.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f234a59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f234c0c6430 0x7f234c0b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:23.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f234a59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f234c0c6430 0x7f234c0b0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49288/0 (socket says 172.21.15.1:49288) 2023-11-15T01:36:23.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f234a59c700 1 -- 172.21.15.1:0/3813043565 learned_addr learned my addr 172.21.15.1:0/3813043565 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:23.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f234ad9d700 1 --2- 172.21.15.1:0/3813043565 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f234c154480 0x7f234c0ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:23.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f2349d9b700 1 --2- 172.21.15.1:0/3813043565 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f234c1540a0 0x7f234c14c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:23.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f234a59c700 1 -- 172.21.15.1:0/3813043565 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f234c1540a0 msgr2=0x7f234c14c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:23.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f234a59c700 1 --2- 172.21.15.1:0/3813043565 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f234c1540a0 0x7f234c14c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:23.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f234a59c700 1 -- 172.21.15.1:0/3813043565 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f234c154480 msgr2=0x7f234c0ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:23.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f234a59c700 1 --2- 172.21.15.1:0/3813043565 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f234c154480 0x7f234c0ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:23.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f234a59c700 1 -- 172.21.15.1:0/3813043565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2344009ae0 con 0x7f234c0c6430 2023-11-15T01:36:23.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.731+0000 7f234a59c700 1 --2- 172.21.15.1:0/3813043565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f234c0c6430 0x7f234c0b0c20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f233c00c440 tx=0x7f233c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:23.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.732+0000 7f233a7fc700 1 -- 172.21.15.1:0/3813043565 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c012400 con 0x7f234c0c6430 2023-11-15T01:36:23.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.732+0000 7f233a7fc700 1 -- 172.21.15.1:0/3813043565 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c012580 con 0x7f234c0c6430 2023-11-15T01:36:23.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.732+0000 7f2350b36700 1 -- 172.21.15.1:0/3813043565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234c0b0420 con 0x7f234c0c6430 2023-11-15T01:36:23.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.732+0000 7f233a7fc700 1 -- 172.21.15.1:0/3813043565 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c012940 con 0x7f234c0c6430 2023-11-15T01:36:23.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.732+0000 7f2350b36700 1 -- 172.21.15.1:0/3813043565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234c14ce20 con 0x7f234c0c6430 2023-11-15T01:36:23.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.733+0000 7f2350b36700 1 -- 172.21.15.1:0/3813043565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234c06c7e0 con 0x7f234c0c6430 2023-11-15T01:36:23.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.733+0000 7f233a7fc700 1 -- 172.21.15.1:0/3813043565 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f233c012d30 con 0x7f234c0c6430 2023-11-15T01:36:23.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.733+0000 7f233a7fc700 1 --2- 172.21.15.1:0/3813043565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f232c05f2a0 0x7f232c061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:23.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.733+0000 7f233a7fc700 1 -- 172.21.15.1:0/3813043565 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f233c0798f0 con 0x7f234c0c6430 2023-11-15T01:36:23.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.734+0000 7f2349d9b700 1 --2- 172.21.15.1:0/3813043565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f232c05f2a0 0x7f232c061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:23.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.734+0000 7f2349d9b700 1 --2- 172.21.15.1:0/3813043565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f232c05f2a0 0x7f232c061760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f234c0ac140 tx=0x7f2340008040).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:23.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.737+0000 7f233a7fc700 1 -- 172.21.15.1:0/3813043565 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f233c048af0 con 0x7f234c0c6430 2023-11-15T01:36:23.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:23.956+0000 7f2350b36700 1 -- 172.21.15.1:0/3813043565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f234c0c9a00 con 0x7f234c0c6430 2023-11-15T01:36:24.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.822+0000 7f233a7fc700 1 -- 172.21.15.1:0/3813043565 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f233c04a940 con 0x7f234c0c6430 2023-11-15T01:36:24.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.824+0000 7f2350b36700 1 -- 172.21.15.1:0/3813043565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f232c05f2a0 msgr2=0x7f232c061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:24.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.824+0000 7f2350b36700 1 --2- 172.21.15.1:0/3813043565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f232c05f2a0 0x7f232c061760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f234c0ac140 tx=0x7f2340008040).stop 2023-11-15T01:36:24.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.824+0000 7f2350b36700 1 -- 172.21.15.1:0/3813043565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f234c0c6430 msgr2=0x7f234c0b0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.824+0000 7f2350b36700 1 --2- 172.21.15.1:0/3813043565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f234c0c6430 0x7f234c0b0c20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f233c00c440 tx=0x7f233c007de0).stop 2023-11-15T01:36:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.824+0000 7f2350b36700 1 -- 172.21.15.1:0/3813043565 shutdown_connections 2023-11-15T01:36:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.824+0000 7f2350b36700 1 --2- 172.21.15.1:0/3813043565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f232c05f2a0 0x7f232c061760 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.824+0000 7f2350b36700 1 --2- 172.21.15.1:0/3813043565 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f234c154480 0x7f234c0ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.824+0000 7f2350b36700 1 --2- 172.21.15.1:0/3813043565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f234c0c6430 0x7f234c0b0c20 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.824+0000 7f2350b36700 1 --2- 172.21.15.1:0/3813043565 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f234c1540a0 0x7f234c14c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.824+0000 7f2350b36700 1 -- 172.21.15.1:0/3813043565 >> 172.21.15.1:0/3813043565 conn(0x7f234c064a70 msgr2=0x7f234c0ab8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.824+0000 7f2350b36700 1 -- 172.21.15.1:0/3813043565 shutdown_connections 2023-11-15T01:36:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.824+0000 7f2350b36700 1 -- 172.21.15.1:0/3813043565 wait complete. 2023-11-15T01:36:24.840 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-15T01:36:24.841 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:36:24.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.965+0000 7fafb1d9e700 1 Processor -- start 2023-11-15T01:36:24.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.965+0000 7fafb1d9e700 1 -- start start 2023-11-15T01:36:24.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.966+0000 7fafb1d9e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafac151e10 0x7fafac155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:24.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.966+0000 7fafb1d9e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fafac0c86b0 0x7fafac0aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:24.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.966+0000 7fafb1d9e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafac0c7980 con 0x7fafac0c98b0 2023-11-15T01:36:24.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.966+0000 7fafb1d9e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafac0c8b10 con 0x7fafac0c86b0 2023-11-15T01:36:24.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.966+0000 7fafb1d9e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0aa5c0 con 0x7fafac151e10 2023-11-15T01:36:24.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.966+0000 7fafabfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fafac0c86b0 0x7fafac0aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:24.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.966+0000 7fafabfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fafac0c86b0 0x7fafac0aa0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49304/0 (socket says 172.21.15.1:49304) 2023-11-15T01:36:24.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.966+0000 7fafabfff700 1 -- 172.21.15.1:0/2273584558 learned_addr learned my addr 172.21.15.1:0/2273584558 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.966+0000 7fafb0d9c700 1 --2- 172.21.15.1:0/2273584558 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafac151e10 0x7fafac155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafabfff700 1 -- 172.21.15.1:0/2273584558 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafac151e10 msgr2=0x7fafac155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafabfff700 1 --2- 172.21.15.1:0/2273584558 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafac151e10 0x7fafac155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafabfff700 1 -- 172.21.15.1:0/2273584558 >> v1:172.21.15.141:6789/0 conn(0x7fafac0c98b0 legacy=0x7fafac0c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafabfff700 1 -- 172.21.15.1:0/2273584558 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0aa890 con 0x7fafac0c86b0 2023-11-15T01:36:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafabfff700 1 --2- 172.21.15.1:0/2273584558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafac0c86b0 0x7fafac0aa0d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7faf94006fd0 tx=0x7faf940090f0).ready entity=mon.0 client_cookie=31494df1c21413cf server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafab7fe700 1 -- 172.21.15.1:0/2273584558 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9400b600 con 0x7fafac0c86b0 2023-11-15T01:36:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafab7fe700 1 -- 172.21.15.1:0/2273584558 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9400b760 con 0x7fafac0c86b0 2023-11-15T01:36:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafab7fe700 1 -- 172.21.15.1:0/2273584558 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9400bae0 con 0x7fafac0c86b0 2023-11-15T01:36:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafb1d9e700 1 -- 172.21.15.1:0/2273584558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafac0c86b0 msgr2=0x7fafac0aa0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafb1d9e700 1 --2- 172.21.15.1:0/2273584558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafac0c86b0 0x7fafac0aa0d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7faf94006fd0 tx=0x7faf940090f0).stop 2023-11-15T01:36:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafb1d9e700 1 -- 172.21.15.1:0/2273584558 shutdown_connections 2023-11-15T01:36:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafb1d9e700 1 --2- 172.21.15.1:0/2273584558 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafac151e10 0x7fafac155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafb1d9e700 1 --2- 172.21.15.1:0/2273584558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafac0c86b0 0x7fafac0aa0d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:24.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafb1d9e700 1 -- 172.21.15.1:0/2273584558 >> 172.21.15.1:0/2273584558 conn(0x7fafac0947e0 msgr2=0x7fafac06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:24.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafb1d9e700 1 -- 172.21.15.1:0/2273584558 shutdown_connections 2023-11-15T01:36:24.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.967+0000 7fafb1d9e700 1 -- 172.21.15.1:0/2273584558 wait complete. 2023-11-15T01:36:24.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.969+0000 7fafb1d9e700 1 Processor -- start 2023-11-15T01:36:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.969+0000 7fafb1d9e700 1 -- start start 2023-11-15T01:36:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.969+0000 7fafb1d9e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fafac0c86b0 0x7fafac0ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.969+0000 7fafb1d9e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafac0c98b0 0x7fafac164110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.969+0000 7fafb1d9e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafac151e10 0x7fafac150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafb1d9e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0adb80 con 0x7fafac151e10 2023-11-15T01:36:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafb1d9e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac153cc0 con 0x7fafac0c86b0 2023-11-15T01:36:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafb1d9e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac153fa0 con 0x7fafac0c98b0 2023-11-15T01:36:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafb159d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafac151e10 0x7fafac150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafb159d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafac151e10 0x7fafac150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49320/0 (socket says 172.21.15.1:49320) 2023-11-15T01:36:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafb159d700 1 -- 172.21.15.1:0/2616550443 learned_addr learned my addr 172.21.15.1:0/2616550443 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafb0d9c700 1 --2- 172.21.15.1:0/2616550443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fafac0c86b0 0x7fafac0ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafabfff700 1 --2- 172.21.15.1:0/2616550443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafac0c98b0 0x7fafac164110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafb159d700 1 -- 172.21.15.1:0/2616550443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafac0c98b0 msgr2=0x7fafac164110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafb159d700 1 --2- 172.21.15.1:0/2616550443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafac0c98b0 0x7fafac164110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafb159d700 1 -- 172.21.15.1:0/2616550443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fafac0c86b0 msgr2=0x7fafac0ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafb159d700 1 --2- 172.21.15.1:0/2616550443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fafac0c86b0 0x7fafac0ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafb159d700 1 -- 172.21.15.1:0/2616550443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf94009370 con 0x7fafac151e10 2023-11-15T01:36:24.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafb159d700 1 --2- 172.21.15.1:0/2616550443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafac151e10 0x7fafac150cd0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7faf9c00c440 tx=0x7faf9c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:24.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafa8ff9700 1 -- 172.21.15.1:0/2616550443 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c0123f0 con 0x7fafac151e10 2023-11-15T01:36:24.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafa8ff9700 1 -- 172.21.15.1:0/2616550443 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c001e90 con 0x7fafac151e10 2023-11-15T01:36:24.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafb1d9e700 1 -- 172.21.15.1:0/2616550443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafac154280 con 0x7fafac151e10 2023-11-15T01:36:24.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafa8ff9700 1 -- 172.21.15.1:0/2616550443 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c012760 con 0x7fafac151e10 2023-11-15T01:36:24.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.970+0000 7fafb1d9e700 1 -- 172.21.15.1:0/2616550443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafac0ad030 con 0x7fafac151e10 2023-11-15T01:36:24.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.971+0000 7fafb1d9e700 1 -- 172.21.15.1:0/2616550443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafac0475e0 con 0x7fafac151e10 2023-11-15T01:36:24.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.972+0000 7fafa8ff9700 1 -- 172.21.15.1:0/2616550443 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7faf9c012b50 con 0x7fafac151e10 2023-11-15T01:36:24.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.972+0000 7fafa8ff9700 1 --2- 172.21.15.1:0/2616550443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faf8c05f270 0x7faf8c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:24.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.972+0000 7fafa8ff9700 1 -- 172.21.15.1:0/2616550443 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6545+0+0 (secure 0 0 0) 0x7faf9c079880 con 0x7fafac151e10 2023-11-15T01:36:24.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.972+0000 7fafb0d9c700 1 --2- 172.21.15.1:0/2616550443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faf8c05f270 0x7faf8c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:24.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.973+0000 7fafb0d9c700 1 --2- 172.21.15.1:0/2616550443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faf8c05f270 0x7faf8c061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fafac167690 tx=0x7fafa40097e0).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:24.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:24.976+0000 7fafa8ff9700 1 -- 172.21.15.1:0/2616550443 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7faf9c047af0 con 0x7fafac151e10 2023-11-15T01:36:25.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.193+0000 7fafb1d9e700 1 -- 172.21.15.1:0/2616550443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fafac0c7bd0 con 0x7fafac151e10 2023-11-15T01:36:25.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.193+0000 7fafa8ff9700 1 -- 172.21.15.1:0/2616550443 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4487 (secure 0 0 0) 0x7faf9c04a820 con 0x7fafac151e10 2023-11-15T01:36:25.195 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:25.195 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/246517652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":246517652},{"type":"v1","addr":"172.21.15.141:6836","nonce":246517652}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5857,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3341576602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3341576602},{"type":"v1","addr":"172.21.15.141:6837","nonce":3341576602}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2509339424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2509339424},{"type":"v1","addr":"172.21.15.1:6834","nonce":2509339424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:36:21.564233+0000","modified":"2023-11-15T01:36:24.818307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3051659352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3051659352},{"type":"v1","addr":"172.21.15.1:6835","nonce":3051659352}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-11-15T01:36:25.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.195+0000 7fafb1d9e700 1 -- 172.21.15.1:0/2616550443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faf8c05f270 msgr2=0x7faf8c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:25.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.195+0000 7fafb1d9e700 1 --2- 172.21.15.1:0/2616550443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faf8c05f270 0x7faf8c061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fafac167690 tx=0x7fafa40097e0).stop 2023-11-15T01:36:25.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.195+0000 7fafb1d9e700 1 -- 172.21.15.1:0/2616550443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafac151e10 msgr2=0x7fafac150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:25.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.195+0000 7fafb1d9e700 1 --2- 172.21.15.1:0/2616550443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafac151e10 0x7fafac150cd0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7faf9c00c440 tx=0x7faf9c007d70).stop 2023-11-15T01:36:25.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.195+0000 7fafb1d9e700 1 -- 172.21.15.1:0/2616550443 shutdown_connections 2023-11-15T01:36:25.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.195+0000 7fafb1d9e700 1 --2- 172.21.15.1:0/2616550443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faf8c05f270 0x7faf8c061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.195+0000 7fafb1d9e700 1 --2- 172.21.15.1:0/2616550443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafac151e10 0x7fafac150cd0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.195+0000 7fafb1d9e700 1 --2- 172.21.15.1:0/2616550443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fafac0c86b0 0x7fafac0ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.195+0000 7fafb1d9e700 1 --2- 172.21.15.1:0/2616550443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafac0c98b0 0x7fafac164110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.195+0000 7fafb1d9e700 1 -- 172.21.15.1:0/2616550443 >> 172.21.15.1:0/2616550443 conn(0x7fafac0947e0 msgr2=0x7fafac0635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.195+0000 7fafb1d9e700 1 -- 172.21.15.1:0/2616550443 shutdown_connections 2023-11-15T01:36:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.195+0000 7fafb1d9e700 1 -- 172.21.15.1:0/2616550443 wait complete. 2023-11-15T01:36:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 31 2023-11-15T01:36:25.208 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:36:25.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.325+0000 7f2caa76b700 1 Processor -- start 2023-11-15T01:36:25.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.325+0000 7f2caa76b700 1 -- start start 2023-11-15T01:36:25.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2caa76b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca4154150 0x7f2ca4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:25.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2caa76b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2ca40ab1a0 0x7f2ca4158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:25.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2caa76b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca40c06f0 con 0x7f2ca40aa060 2023-11-15T01:36:25.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2caa76b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca40c09d0 con 0x7f2ca40ab1a0 2023-11-15T01:36:25.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2caa76b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca4158820 con 0x7f2ca4154150 2023-11-15T01:36:25.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2ca37fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2ca40ab1a0 0x7f2ca4158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:25.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2ca37fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2ca40ab1a0 0x7f2ca4158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49330/0 (socket says 172.21.15.1:49330) 2023-11-15T01:36:25.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2ca37fe700 1 -- 172.21.15.1:0/536896548 learned_addr learned my addr 172.21.15.1:0/536896548 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:25.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2ca3fff700 1 --2- 172.21.15.1:0/536896548 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca4154150 0x7f2ca4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:25.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2ca37fe700 1 -- 172.21.15.1:0/536896548 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca4154150 msgr2=0x7f2ca4154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:25.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2ca37fe700 1 --2- 172.21.15.1:0/536896548 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca4154150 0x7f2ca4154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2ca37fe700 1 -- 172.21.15.1:0/536896548 >> v1:172.21.15.141:6789/0 conn(0x7f2ca40aa060 legacy=0x7f2ca40c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:25.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2ca37fe700 1 -- 172.21.15.1:0/536896548 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca4158b00 con 0x7f2ca40ab1a0 2023-11-15T01:36:25.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2ca37fe700 1 --2- 172.21.15.1:0/536896548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca40ab1a0 0x7f2ca4158040 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f2c98006fd0 tx=0x7f2c980090f0).ready entity=mon.0 client_cookie=5459a89e43353670 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:25.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2ca2ffd700 1 -- 172.21.15.1:0/536896548 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800b600 con 0x7f2ca40ab1a0 2023-11-15T01:36:25.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2ca2ffd700 1 -- 172.21.15.1:0/536896548 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9800b760 con 0x7f2ca40ab1a0 2023-11-15T01:36:25.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.326+0000 7f2ca2ffd700 1 -- 172.21.15.1:0/536896548 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800bb00 con 0x7f2ca40ab1a0 2023-11-15T01:36:25.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.327+0000 7f2caa76b700 1 -- 172.21.15.1:0/536896548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca40ab1a0 msgr2=0x7f2ca4158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:25.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.327+0000 7f2caa76b700 1 --2- 172.21.15.1:0/536896548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca40ab1a0 0x7f2ca4158040 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f2c98006fd0 tx=0x7f2c980090f0).stop 2023-11-15T01:36:25.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.327+0000 7f2caa76b700 1 -- 172.21.15.1:0/536896548 shutdown_connections 2023-11-15T01:36:25.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.327+0000 7f2caa76b700 1 --2- 172.21.15.1:0/536896548 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca4154150 0x7f2ca4154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.327+0000 7f2caa76b700 1 --2- 172.21.15.1:0/536896548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca40ab1a0 0x7f2ca4158040 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.327+0000 7f2caa76b700 1 -- 172.21.15.1:0/536896548 >> 172.21.15.1:0/536896548 conn(0x7f2ca4064aa0 msgr2=0x7f2ca4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:25.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.327+0000 7f2caa76b700 1 -- 172.21.15.1:0/536896548 shutdown_connections 2023-11-15T01:36:25.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.327+0000 7f2caa76b700 1 -- 172.21.15.1:0/536896548 wait complete. 2023-11-15T01:36:25.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.328+0000 7f2caa76b700 1 Processor -- start 2023-11-15T01:36:25.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.328+0000 7f2caa76b700 1 -- start start 2023-11-15T01:36:25.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2caa76b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ca40aa060 0x7f2ca413f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:25.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2caa76b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca40ab1a0 0x7f2ca40c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:25.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2caa76b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca4154150 0x7f2ca4157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:25.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2caa76b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca4156ae0 con 0x7f2ca4154150 2023-11-15T01:36:25.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2caa76b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca4156dc0 con 0x7f2ca40aa060 2023-11-15T01:36:25.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2caa76b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca41561f0 con 0x7f2ca40ab1a0 2023-11-15T01:36:25.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2ca8d08700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca4154150 0x7f2ca4157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:25.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2ca8d08700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca4154150 0x7f2ca4157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49346/0 (socket says 172.21.15.1:49346) 2023-11-15T01:36:25.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2ca8d08700 1 -- 172.21.15.1:0/3346781567 learned_addr learned my addr 172.21.15.1:0/3346781567 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:25.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2ca3fff700 1 --2- 172.21.15.1:0/3346781567 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ca40aa060 0x7f2ca413f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:25.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2ca37fe700 1 --2- 172.21.15.1:0/3346781567 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca40ab1a0 0x7f2ca40c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:25.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2ca8d08700 1 -- 172.21.15.1:0/3346781567 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca40ab1a0 msgr2=0x7f2ca40c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:25.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2ca8d08700 1 --2- 172.21.15.1:0/3346781567 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca40ab1a0 0x7f2ca40c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2ca8d08700 1 -- 172.21.15.1:0/3346781567 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ca40aa060 msgr2=0x7f2ca413f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:25.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2ca8d08700 1 --2- 172.21.15.1:0/3346781567 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ca40aa060 0x7f2ca413f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.329+0000 7f2ca8d08700 1 -- 172.21.15.1:0/3346781567 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c98009370 con 0x7f2ca4154150 2023-11-15T01:36:25.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.330+0000 7f2ca8d08700 1 --2- 172.21.15.1:0/3346781567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca4154150 0x7f2ca4157250 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f2c9c00c810 tx=0x7f2c9c002530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:25.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.330+0000 7f2c8bfff700 1 -- 172.21.15.1:0/3346781567 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c00e4a0 con 0x7f2ca4154150 2023-11-15T01:36:25.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.330+0000 7f2c8bfff700 1 -- 172.21.15.1:0/3346781567 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c00e620 con 0x7f2ca4154150 2023-11-15T01:36:25.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.330+0000 7f2caa76b700 1 -- 172.21.15.1:0/3346781567 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca4156490 con 0x7f2ca4154150 2023-11-15T01:36:25.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.330+0000 7f2c8bfff700 1 -- 172.21.15.1:0/3346781567 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c00e9e0 con 0x7f2ca4154150 2023-11-15T01:36:25.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.330+0000 7f2caa76b700 1 -- 172.21.15.1:0/3346781567 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca413fee0 con 0x7f2ca4154150 2023-11-15T01:36:25.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.331+0000 7f2caa76b700 1 -- 172.21.15.1:0/3346781567 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca4156f30 con 0x7f2ca4154150 2023-11-15T01:36:25.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.331+0000 7f2c8bfff700 1 -- 172.21.15.1:0/3346781567 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2c9c012400 con 0x7f2ca4154150 2023-11-15T01:36:25.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.332+0000 7f2c8bfff700 1 --2- 172.21.15.1:0/3346781567 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2c9005f270 0x7f2c90061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:25.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.332+0000 7f2c8bfff700 1 -- 172.21.15.1:0/3346781567 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f2c9c079ba0 con 0x7f2ca4154150 2023-11-15T01:36:25.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.332+0000 7f2ca3fff700 1 --2- 172.21.15.1:0/3346781567 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2c9005f270 0x7f2c90061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:25.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.332+0000 7f2ca3fff700 1 --2- 172.21.15.1:0/3346781567 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2c9005f270 0x7f2c90061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2ca41560e0 tx=0x7f2c94008040).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:25.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.336+0000 7f2c8bfff700 1 -- 172.21.15.1:0/3346781567 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2c9c048af0 con 0x7f2ca4154150 2023-11-15T01:36:25.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.508+0000 7f2caa76b700 1 -- 172.21.15.1:0/3346781567 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ca4158de0 con 0x7f2ca4154150 2023-11-15T01:36:25.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.509+0000 7f2c8bfff700 1 -- 172.21.15.1:0/3346781567 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+17526 (secure 0 0 0) 0x7f2c9c017030 con 0x7f2ca4154150 2023-11-15T01:36:25.511 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:25.511 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":79,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:36:22.565816+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:36:19.249413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-15T01:36:20.544874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:36:25.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.511+0000 7f2caa76b700 1 -- 172.21.15.1:0/3346781567 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2c9005f270 msgr2=0x7f2c90061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:25.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.511+0000 7f2caa76b700 1 --2- 172.21.15.1:0/3346781567 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2c9005f270 0x7f2c90061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2ca41560e0 tx=0x7f2c94008040).stop 2023-11-15T01:36:25.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.511+0000 7f2caa76b700 1 -- 172.21.15.1:0/3346781567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca4154150 msgr2=0x7f2ca4157250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:25.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.511+0000 7f2caa76b700 1 --2- 172.21.15.1:0/3346781567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca4154150 0x7f2ca4157250 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f2c9c00c810 tx=0x7f2c9c002530).stop 2023-11-15T01:36:25.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.511+0000 7f2caa76b700 1 -- 172.21.15.1:0/3346781567 shutdown_connections 2023-11-15T01:36:25.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.511+0000 7f2caa76b700 1 --2- 172.21.15.1:0/3346781567 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2c9005f270 0x7f2c90061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.511+0000 7f2caa76b700 1 --2- 172.21.15.1:0/3346781567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca4154150 0x7f2ca4157250 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.511+0000 7f2caa76b700 1 --2- 172.21.15.1:0/3346781567 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ca40aa060 0x7f2ca413f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.511+0000 7f2caa76b700 1 --2- 172.21.15.1:0/3346781567 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca40ab1a0 0x7f2ca40c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.511+0000 7f2caa76b700 1 -- 172.21.15.1:0/3346781567 >> 172.21.15.1:0/3346781567 conn(0x7f2ca4064aa0 msgr2=0x7f2ca414eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:25.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.511+0000 7f2caa76b700 1 -- 172.21.15.1:0/3346781567 shutdown_connections 2023-11-15T01:36:25.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.511+0000 7f2caa76b700 1 -- 172.21.15.1:0/3346781567 wait complete. 2023-11-15T01:36:25.525 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-15T01:36:25.525 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:36:25.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.642+0000 7fc92441b700 1 Processor -- start 2023-11-15T01:36:25.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.642+0000 7fc92441b700 1 -- start start 2023-11-15T01:36:25.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.643+0000 7fc92441b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc91c154150 0x7fc91c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:25.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.643+0000 7fc92441b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91c0c06f0 con 0x7fc91c0aa060 2023-11-15T01:36:25.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.643+0000 7fc92441b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91c0c09d0 con 0x7fc91c0ab1a0 2023-11-15T01:36:25.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.643+0000 7fc92441b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91c158820 con 0x7fc91c154150 2023-11-15T01:36:25.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.643+0000 7fc9221b7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc91c154150 0x7fc91c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:25.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.643+0000 7fc9229b8700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc91c0aa060 0x7fc91c0c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39080/0 (socket says 172.21.15.1:39080) 2023-11-15T01:36:25.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.643+0000 7fc9221b7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc91c154150 0x7fc91c154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49360/0 (socket says 172.21.15.1:49360) 2023-11-15T01:36:25.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.643+0000 7fc9229b8700 1 -- 172.21.15.1:0/2872098600 learned_addr learned my addr 172.21.15.1:0/2872098600 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:25.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.644+0000 7fc9221b7700 1 -- 172.21.15.1:0/2872098600 >> v1:172.21.15.141:6789/0 conn(0x7fc91c0ab1a0 legacy=0x7fc91c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:25.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.644+0000 7fc9221b7700 1 -- 172.21.15.1:0/2872098600 >> v1:172.21.15.1:6789/0 conn(0x7fc91c0aa060 legacy=0x7fc91c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:25.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.644+0000 7fc9221b7700 1 -- 172.21.15.1:0/2872098600 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c158b00 con 0x7fc91c154150 2023-11-15T01:36:25.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.644+0000 7fc9221b7700 1 --2- 172.21.15.1:0/2872098600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c154150 0x7fc91c154530 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fc914009760 tx=0x7fc914009060).ready entity=mon.0 client_cookie=3a21b5ad8db70b94 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:25.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.644+0000 7fc9211b5700 1 -- 172.21.15.1:0/2872098600 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9140090d0 con 0x7fc91c154150 2023-11-15T01:36:25.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.644+0000 7fc9211b5700 1 -- 172.21.15.1:0/2872098600 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91400b520 con 0x7fc91c154150 2023-11-15T01:36:25.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.644+0000 7fc9211b5700 1 -- 172.21.15.1:0/2872098600 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91400b8a0 con 0x7fc91c154150 2023-11-15T01:36:25.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.644+0000 7fc92441b700 1 -- 172.21.15.1:0/2872098600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c154150 msgr2=0x7fc91c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:25.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.644+0000 7fc92441b700 1 --2- 172.21.15.1:0/2872098600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c154150 0x7fc91c154530 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fc914009760 tx=0x7fc914009060).stop 2023-11-15T01:36:25.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.644+0000 7fc92441b700 1 -- 172.21.15.1:0/2872098600 shutdown_connections 2023-11-15T01:36:25.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.644+0000 7fc92441b700 1 --2- 172.21.15.1:0/2872098600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c154150 0x7fc91c154530 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.644+0000 7fc92441b700 1 -- 172.21.15.1:0/2872098600 >> 172.21.15.1:0/2872098600 conn(0x7fc91c064aa0 msgr2=0x7fc91c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:25.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.645+0000 7fc92441b700 1 -- 172.21.15.1:0/2872098600 shutdown_connections 2023-11-15T01:36:25.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.645+0000 7fc92441b700 1 -- 172.21.15.1:0/2872098600 wait complete. 2023-11-15T01:36:25.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.646+0000 7fc92441b700 1 Processor -- start 2023-11-15T01:36:25.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.646+0000 7fc92441b700 1 -- start start 2023-11-15T01:36:25.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.646+0000 7fc92441b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c0aa060 0x7fc91c155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:25.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.646+0000 7fc92441b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc91c0ab1a0 0x7fc91c157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:25.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.646+0000 7fc92441b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc91c154150 0x7fc91c0c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:25.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.646+0000 7fc92441b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c165400 con 0x7fc91c0aa060 2023-11-15T01:36:25.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.646+0000 7fc92441b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c157a00 con 0x7fc91c0ab1a0 2023-11-15T01:36:25.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.646+0000 7fc92441b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c1592d0 con 0x7fc91c154150 2023-11-15T01:36:25.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.646+0000 7fc9221b7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c0aa060 0x7fc91c155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:25.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.646+0000 7fc9221b7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c0aa060 0x7fc91c155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49372/0 (socket says 172.21.15.1:49372) 2023-11-15T01:36:25.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.647+0000 7fc9221b7700 1 -- 172.21.15.1:0/1540272599 learned_addr learned my addr 172.21.15.1:0/1540272599 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:25.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.647+0000 7fc9221b7700 1 -- 172.21.15.1:0/1540272599 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc91c154150 msgr2=0x7fc91c0c2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:25.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.647+0000 7fc9221b7700 1 --2- 172.21.15.1:0/1540272599 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc91c154150 0x7fc91c0c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:25.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.647+0000 7fc9221b7700 1 -- 172.21.15.1:0/1540272599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc91c0ab1a0 msgr2=0x7fc91c157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:25.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.647+0000 7fc9219b6700 1 --2- 172.21.15.1:0/1540272599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc91c0ab1a0 0x7fc91c157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:25.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.647+0000 7fc9221b7700 1 --2- 172.21.15.1:0/1540272599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc91c0ab1a0 0x7fc91c157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.647+0000 7fc9221b7700 1 -- 172.21.15.1:0/1540272599 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9140092a0 con 0x7fc91c0aa060 2023-11-15T01:36:25.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.647+0000 7fc9221b7700 1 --2- 172.21.15.1:0/1540272599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c0aa060 0x7fc91c155850 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fc914009eb0 tx=0x7fc914017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:25.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.647+0000 7fc91a7fc700 1 -- 172.21.15.1:0/1540272599 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91400bca0 con 0x7fc91c0aa060 2023-11-15T01:36:25.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.647+0000 7fc91a7fc700 1 -- 172.21.15.1:0/1540272599 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91400be00 con 0x7fc91c0aa060 2023-11-15T01:36:25.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.647+0000 7fc92441b700 1 -- 172.21.15.1:0/1540272599 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91c165120 con 0x7fc91c0aa060 2023-11-15T01:36:25.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.647+0000 7fc91a7fc700 1 -- 172.21.15.1:0/1540272599 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91401b670 con 0x7fc91c0aa060 2023-11-15T01:36:25.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.647+0000 7fc92441b700 1 -- 172.21.15.1:0/1540272599 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91c159870 con 0x7fc91c0aa060 2023-11-15T01:36:25.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.648+0000 7fc92441b700 1 -- 172.21.15.1:0/1540272599 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91c159a60 con 0x7fc91c0aa060 2023-11-15T01:36:25.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.649+0000 7fc91a7fc700 1 -- 172.21.15.1:0/1540272599 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc91401ba20 con 0x7fc91c0aa060 2023-11-15T01:36:25.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.649+0000 7fc91a7fc700 1 --2- 172.21.15.1:0/1540272599 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc90805f270 0x7fc908061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:25.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.649+0000 7fc91a7fc700 1 -- 172.21.15.1:0/1540272599 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fc91407be20 con 0x7fc91c0aa060 2023-11-15T01:36:25.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.649+0000 7fc9219b6700 1 --2- 172.21.15.1:0/1540272599 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc90805f270 0x7fc908061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:25.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.650+0000 7fc9219b6700 1 --2- 172.21.15.1:0/1540272599 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc90805f270 0x7fc908061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc910007fd0 tx=0x7fc910009040).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:25.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.653+0000 7fc91a7fc700 1 -- 172.21.15.1:0/1540272599 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc91404cdc0 con 0x7fc91c0aa060 2023-11-15T01:36:25.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.826+0000 7fc92441b700 1 -- 172.21.15.1:0/1540272599 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc91c06c7e0 con 0x7fc90805f270 2023-11-15T01:36:25.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.838+0000 7fc91a7fc700 1 -- 172.21.15.1:0/1540272599 <== mgr.5686 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361070 (secure 0 0 0) 0x7fc91c06c7e0 con 0x7fc90805f270 2023-11-15T01:36:25.843 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:25.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.841+0000 7fc92441b700 1 -- 172.21.15.1:0/1540272599 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc90805f270 msgr2=0x7fc908061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:25.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.841+0000 7fc92441b700 1 --2- 172.21.15.1:0/1540272599 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc90805f270 0x7fc908061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc910007fd0 tx=0x7fc910009040).stop 2023-11-15T01:36:25.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.841+0000 7fc92441b700 1 -- 172.21.15.1:0/1540272599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c0aa060 msgr2=0x7fc91c155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:25.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.841+0000 7fc92441b700 1 --2- 172.21.15.1:0/1540272599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c0aa060 0x7fc91c155850 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fc914009eb0 tx=0x7fc914017000).stop 2023-11-15T01:36:25.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.842+0000 7fc92441b700 1 -- 172.21.15.1:0/1540272599 shutdown_connections 2023-11-15T01:36:25.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.842+0000 7fc92441b700 1 --2- 172.21.15.1:0/1540272599 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc90805f270 0x7fc908061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.842+0000 7fc92441b700 1 --2- 172.21.15.1:0/1540272599 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc91c154150 0x7fc91c0c2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:25.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.842+0000 7fc92441b700 1 --2- 172.21.15.1:0/1540272599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c0aa060 0x7fc91c155850 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.842+0000 7fc92441b700 1 --2- 172.21.15.1:0/1540272599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc91c0ab1a0 0x7fc91c157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:25.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.842+0000 7fc92441b700 1 -- 172.21.15.1:0/1540272599 >> 172.21.15.1:0/1540272599 conn(0x7fc91c064aa0 msgr2=0x7fc91c0c7850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:25.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.842+0000 7fc92441b700 1 -- 172.21.15.1:0/1540272599 shutdown_connections 2023-11-15T01:36:25.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:25.842+0000 7fc92441b700 1 -- 172.21.15.1:0/1540272599 wait complete. 2023-11-15T01:36:25.848 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:36:25.855 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T01:36:24.132518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":255,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2425224,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752549496,"statfs":{"total":773094113280,"available":770610683904,"internally_reserved":0,"allocated":7675904,"data_stored":3825668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28927,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-83,"num_write_kb":-68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.999350"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.585016+0000","last_change":"2023-11-15T01:36:21.577952+0000","last_active":"2023-11-15T01:36:21.585016+0000","last_peered":"2023-11-15T01:36:21.585016+0000","last_clean":"2023-11-15T01:36:21.585016+0000","last_became_active":"2023-11-15T01:36:21.577642+0000","last_became_peered":"2023-11-15T01:36:21.577642+0000","last_unstale":"2023-11-15T01:36:21.585016+0000","last_undegraded":"2023-11-15T01:36:21.585016+0000","last_fullsized":"2023-11-15T01:36:21.585016+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"78'3","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.586949+0000","last_change":"2023-11-15T01:36:21.189361+0000","last_active":"2023-11-15T01:36:21.586949+0000","last_peered":"2023-11-15T01:36:21.586949+0000","last_clean":"2023-11-15T01:36:21.586949+0000","last_became_active":"2023-11-15T01:36:21.189085+0000","last_became_peered":"2023-11-15T01:36:21.189085+0000","last_unstale":"2023-11-15T01:36:21.586949+0000","last_undegraded":"2023-11-15T01:36:21.586949+0000","last_fullsized":"2023-11-15T01:36:21.586949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596493+0000","last_change":"2023-11-15T01:36:21.592851+0000","last_active":"2023-11-15T01:36:21.596493+0000","last_peered":"2023-11-15T01:36:21.596493+0000","last_clean":"2023-11-15T01:36:21.596493+0000","last_became_active":"2023-11-15T01:36:21.592467+0000","last_became_peered":"2023-11-15T01:36:21.592467+0000","last_unstale":"2023-11-15T01:36:21.596493+0000","last_undegraded":"2023-11-15T01:36:21.596493+0000","last_fullsized":"2023-11-15T01:36:21.596493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.573851+0000","last_change":"2023-11-15T01:36:21.190521+0000","last_active":"2023-11-15T01:36:21.573851+0000","last_peered":"2023-11-15T01:36:21.573851+0000","last_clean":"2023-11-15T01:36:21.573851+0000","last_became_active":"2023-11-15T01:36:21.190264+0000","last_became_peered":"2023-11-15T01:36:21.190264+0000","last_unstale":"2023-11-15T01:36:21.573851+0000","last_undegraded":"2023-11-15T01:36:21.573851+0000","last_fullsized":"2023-11-15T01:36:21.573851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.586502+0000","last_change":"2023-11-15T01:36:21.583461+0000","last_active":"2023-11-15T01:36:21.586502+0000","last_peered":"2023-11-15T01:36:21.586502+0000","last_clean":"2023-11-15T01:36:21.586502+0000","last_became_active":"2023-11-15T01:36:21.583195+0000","last_became_peered":"2023-11-15T01:36:21.583195+0000","last_unstale":"2023-11-15T01:36:21.586502+0000","last_undegraded":"2023-11-15T01:36:21.586502+0000","last_fullsized":"2023-11-15T01:36:21.586502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.579772+0000","last_change":"2023-11-15T01:36:21.196597+0000","last_active":"2023-11-15T01:36:21.579772+0000","last_peered":"2023-11-15T01:36:21.579772+0000","last_clean":"2023-11-15T01:36:21.579772+0000","last_became_active":"2023-11-15T01:36:21.196162+0000","last_became_peered":"2023-11-15T01:36:21.196162+0000","last_unstale":"2023-11-15T01:36:21.579772+0000","last_undegraded":"2023-11-15T01:36:21.579772+0000","last_fullsized":"2023-11-15T01:36:21.579772+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.587490+0000","last_change":"2023-11-15T01:36:21.585298+0000","last_active":"2023-11-15T01:36:21.587490+0000","last_peered":"2023-11-15T01:36:21.587490+0000","last_clean":"2023-11-15T01:36:21.587490+0000","last_became_active":"2023-11-15T01:36:21.584988+0000","last_became_peered":"2023-11-15T01:36:21.584988+0000","last_unstale":"2023-11-15T01:36:21.587490+0000","last_undegraded":"2023-11-15T01:36:21.587490+0000","last_fullsized":"2023-11-15T01:36:21.587490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.586215+0000","last_change":"2023-11-15T01:36:21.180135+0000","last_active":"2023-11-15T01:36:21.586215+0000","last_peered":"2023-11-15T01:36:21.586215+0000","last_clean":"2023-11-15T01:36:21.586215+0000","last_became_active":"2023-11-15T01:36:21.179829+0000","last_became_peered":"2023-11-15T01:36:21.179829+0000","last_unstale":"2023-11-15T01:36:21.586215+0000","last_undegraded":"2023-11-15T01:36:21.586215+0000","last_fullsized":"2023-11-15T01:36:21.586215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596483+0000","last_change":"2023-11-15T01:36:21.592715+0000","last_active":"2023-11-15T01:36:21.596483+0000","last_peered":"2023-11-15T01:36:21.596483+0000","last_clean":"2023-11-15T01:36:21.596483+0000","last_became_active":"2023-11-15T01:36:21.592449+0000","last_became_peered":"2023-11-15T01:36:21.592449+0000","last_unstale":"2023-11-15T01:36:21.596483+0000","last_undegraded":"2023-11-15T01:36:21.596483+0000","last_fullsized":"2023-11-15T01:36:21.596483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.574141+0000","last_change":"2023-11-15T01:36:21.179667+0000","last_active":"2023-11-15T01:36:21.574141+0000","last_peered":"2023-11-15T01:36:21.574141+0000","last_clean":"2023-11-15T01:36:21.574141+0000","last_became_active":"2023-11-15T01:36:21.179363+0000","last_became_peered":"2023-11-15T01:36:21.179363+0000","last_unstale":"2023-11-15T01:36:21.574141+0000","last_undegraded":"2023-11-15T01:36:21.574141+0000","last_fullsized":"2023-11-15T01:36:21.574141+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.590066+0000","last_change":"2023-11-15T01:36:21.588254+0000","last_active":"2023-11-15T01:36:21.590066+0000","last_peered":"2023-11-15T01:36:21.590066+0000","last_clean":"2023-11-15T01:36:21.590066+0000","last_became_active":"2023-11-15T01:36:21.588001+0000","last_became_peered":"2023-11-15T01:36:21.588001+0000","last_unstale":"2023-11-15T01:36:21.590066+0000","last_undegraded":"2023-11-15T01:36:21.590066+0000","last_fullsized":"2023-11-15T01:36:21.590066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.589380+0000","last_change":"2023-11-15T01:36:21.198201+0000","last_active":"2023-11-15T01:36:21.589380+0000","last_peered":"2023-11-15T01:36:21.589380+0000","last_clean":"2023-11-15T01:36:21.589380+0000","last_became_active":"2023-11-15T01:36:21.197870+0000","last_became_peered":"2023-11-15T01:36:21.197870+0000","last_unstale":"2023-11-15T01:36:21.589380+0000","last_undegraded":"2023-11-15T01:36:21.589380+0000","last_fullsized":"2023-11-15T01:36:21.589380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.594263+0000","last_change":"2023-11-15T01:36:21.592705+0000","last_active":"2023-11-15T01:36:21.594263+0000","last_peered":"2023-11-15T01:36:21.594263+0000","last_clean":"2023-11-15T01:36:21.594263+0000","last_became_active":"2023-11-15T01:36:21.592416+0000","last_became_peered":"2023-11-15T01:36:21.592416+0000","last_unstale":"2023-11-15T01:36:21.594263+0000","last_undegraded":"2023-11-15T01:36:21.594263+0000","last_fullsized":"2023-11-15T01:36:21.594263+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.569412+0000","last_change":"2023-11-15T01:36:21.193010+0000","last_active":"2023-11-15T01:36:21.569412+0000","last_peered":"2023-11-15T01:36:21.569412+0000","last_clean":"2023-11-15T01:36:21.569412+0000","last_became_active":"2023-11-15T01:36:21.192692+0000","last_became_peered":"2023-11-15T01:36:21.192692+0000","last_unstale":"2023-11-15T01:36:21.569412+0000","last_undegraded":"2023-11-15T01:36:21.569412+0000","last_fullsized":"2023-11-15T01:36:21.569412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.579914+0000","last_change":"2023-11-15T01:36:21.576214+0000","last_active":"2023-11-15T01:36:21.579914+0000","last_peered":"2023-11-15T01:36:21.579914+0000","last_clean":"2023-11-15T01:36:21.579914+0000","last_became_active":"2023-11-15T01:36:21.575857+0000","last_became_peered":"2023-11-15T01:36:21.575857+0000","last_unstale":"2023-11-15T01:36:21.579914+0000","last_undegraded":"2023-11-15T01:36:21.579914+0000","last_fullsized":"2023-11-15T01:36:21.579914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.570615+0000","last_change":"2023-11-15T01:36:21.194268+0000","last_active":"2023-11-15T01:36:21.570615+0000","last_peered":"2023-11-15T01:36:21.570615+0000","last_clean":"2023-11-15T01:36:21.570615+0000","last_became_active":"2023-11-15T01:36:21.193949+0000","last_became_peered":"2023-11-15T01:36:21.193949+0000","last_unstale":"2023-11-15T01:36:21.570615+0000","last_undegraded":"2023-11-15T01:36:21.570615+0000","last_fullsized":"2023-11-15T01:36:21.570615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596425+0000","last_change":"2023-11-15T01:36:21.590998+0000","last_active":"2023-11-15T01:36:21.596425+0000","last_peered":"2023-11-15T01:36:21.596425+0000","last_clean":"2023-11-15T01:36:21.596425+0000","last_became_active":"2023-11-15T01:36:21.590122+0000","last_became_peered":"2023-11-15T01:36:21.590122+0000","last_unstale":"2023-11-15T01:36:21.596425+0000","last_undegraded":"2023-11-15T01:36:21.596425+0000","last_fullsized":"2023-11-15T01:36:21.596425+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.569524+0000","last_change":"2023-11-15T01:36:21.191907+0000","last_active":"2023-11-15T01:36:21.569524+0000","last_peered":"2023-11-15T01:36:21.569524+0000","last_clean":"2023-11-15T01:36:21.569524+0000","last_became_active":"2023-11-15T01:36:21.191599+0000","last_became_peered":"2023-11-15T01:36:21.191599+0000","last_unstale":"2023-11-15T01:36:21.569524+0000","last_undegraded":"2023-11-15T01:36:21.569524+0000","last_fullsized":"2023-11-15T01:36:21.569524+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.590784+0000","last_change":"2023-11-15T01:36:21.581416+0000","last_active":"2023-11-15T01:36:21.590784+0000","last_peered":"2023-11-15T01:36:21.590784+0000","last_clean":"2023-11-15T01:36:21.590784+0000","last_became_active":"2023-11-15T01:36:21.581128+0000","last_became_peered":"2023-11-15T01:36:21.581128+0000","last_unstale":"2023-11-15T01:36:21.590784+0000","last_undegraded":"2023-11-15T01:36:21.590784+0000","last_fullsized":"2023-11-15T01:36:21.590784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576653+0000","last_change":"2023-11-15T01:36:21.195223+0000","last_active":"2023-11-15T01:36:21.576653+0000","last_peered":"2023-11-15T01:36:21.576653+0000","last_clean":"2023-11-15T01:36:21.576653+0000","last_became_active":"2023-11-15T01:36:21.193578+0000","last_became_peered":"2023-11-15T01:36:21.193578+0000","last_unstale":"2023-11-15T01:36:21.576653+0000","last_undegraded":"2023-11-15T01:36:21.576653+0000","last_fullsized":"2023-11-15T01:36:21.576653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596175+0000","last_change":"2023-11-15T01:36:21.590141+0000","last_active":"2023-11-15T01:36:21.596175+0000","last_peered":"2023-11-15T01:36:21.596175+0000","last_clean":"2023-11-15T01:36:21.596175+0000","last_became_active":"2023-11-15T01:36:21.589830+0000","last_became_peered":"2023-11-15T01:36:21.589830+0000","last_unstale":"2023-11-15T01:36:21.596175+0000","last_undegraded":"2023-11-15T01:36:21.596175+0000","last_fullsized":"2023-11-15T01:36:21.596175+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576632+0000","last_change":"2023-11-15T01:36:21.188318+0000","last_active":"2023-11-15T01:36:21.576632+0000","last_peered":"2023-11-15T01:36:21.576632+0000","last_clean":"2023-11-15T01:36:21.576632+0000","last_became_active":"2023-11-15T01:36:21.187983+0000","last_became_peered":"2023-11-15T01:36:21.187983+0000","last_unstale":"2023-11-15T01:36:21.576632+0000","last_undegraded":"2023-11-15T01:36:21.576632+0000","last_fullsized":"2023-11-15T01:36:21.576632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596320+0000","last_change":"2023-11-15T01:36:21.591795+0000","last_active":"2023-11-15T01:36:21.596320+0000","last_peered":"2023-11-15T01:36:21.596320+0000","last_clean":"2023-11-15T01:36:21.596320+0000","last_became_active":"2023-11-15T01:36:21.591260+0000","last_became_peered":"2023-11-15T01:36:21.591260+0000","last_unstale":"2023-11-15T01:36:21.596320+0000","last_undegraded":"2023-11-15T01:36:21.596320+0000","last_fullsized":"2023-11-15T01:36:21.596320+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596707+0000","last_change":"2023-11-15T01:36:21.186350+0000","last_active":"2023-11-15T01:36:21.596707+0000","last_peered":"2023-11-15T01:36:21.596707+0000","last_clean":"2023-11-15T01:36:21.596707+0000","last_became_active":"2023-11-15T01:36:21.186080+0000","last_became_peered":"2023-11-15T01:36:21.186080+0000","last_unstale":"2023-11-15T01:36:21.596707+0000","last_undegraded":"2023-11-15T01:36:21.596707+0000","last_fullsized":"2023-11-15T01:36:21.596707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.585538+0000","last_change":"2023-11-15T01:36:21.584732+0000","last_active":"2023-11-15T01:36:21.585538+0000","last_peered":"2023-11-15T01:36:21.585538+0000","last_clean":"2023-11-15T01:36:21.585538+0000","last_became_active":"2023-11-15T01:36:21.584252+0000","last_became_peered":"2023-11-15T01:36:21.584252+0000","last_unstale":"2023-11-15T01:36:21.585538+0000","last_undegraded":"2023-11-15T01:36:21.585538+0000","last_fullsized":"2023-11-15T01:36:21.585538+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593547+0000","last_change":"2023-11-15T01:36:21.183748+0000","last_active":"2023-11-15T01:36:21.593547+0000","last_peered":"2023-11-15T01:36:21.593547+0000","last_clean":"2023-11-15T01:36:21.593547+0000","last_became_active":"2023-11-15T01:36:21.183490+0000","last_became_peered":"2023-11-15T01:36:21.183490+0000","last_unstale":"2023-11-15T01:36:21.593547+0000","last_undegraded":"2023-11-15T01:36:21.593547+0000","last_fullsized":"2023-11-15T01:36:21.593547+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596191+0000","last_change":"2023-11-15T01:36:21.590665+0000","last_active":"2023-11-15T01:36:21.596191+0000","last_peered":"2023-11-15T01:36:21.596191+0000","last_clean":"2023-11-15T01:36:21.596191+0000","last_became_active":"2023-11-15T01:36:21.590412+0000","last_became_peered":"2023-11-15T01:36:21.590412+0000","last_unstale":"2023-11-15T01:36:21.596191+0000","last_undegraded":"2023-11-15T01:36:21.596191+0000","last_fullsized":"2023-11-15T01:36:21.596191+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.569136+0000","last_change":"2023-11-15T01:36:21.191900+0000","last_active":"2023-11-15T01:36:21.569136+0000","last_peered":"2023-11-15T01:36:21.569136+0000","last_clean":"2023-11-15T01:36:21.569136+0000","last_became_active":"2023-11-15T01:36:21.191579+0000","last_became_peered":"2023-11-15T01:36:21.191579+0000","last_unstale":"2023-11-15T01:36:21.569136+0000","last_undegraded":"2023-11-15T01:36:21.569136+0000","last_fullsized":"2023-11-15T01:36:21.569136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596167+0000","last_change":"2023-11-15T01:36:21.590001+0000","last_active":"2023-11-15T01:36:21.596167+0000","last_peered":"2023-11-15T01:36:21.596167+0000","last_clean":"2023-11-15T01:36:21.596167+0000","last_became_active":"2023-11-15T01:36:21.589426+0000","last_became_peered":"2023-11-15T01:36:21.589426+0000","last_unstale":"2023-11-15T01:36:21.596167+0000","last_undegraded":"2023-11-15T01:36:21.596167+0000","last_fullsized":"2023-11-15T01:36:21.596167+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.569541+0000","last_change":"2023-11-15T01:36:21.192752+0000","last_active":"2023-11-15T01:36:21.569541+0000","last_peered":"2023-11-15T01:36:21.569541+0000","last_clean":"2023-11-15T01:36:21.569541+0000","last_became_active":"2023-11-15T01:36:21.192475+0000","last_became_peered":"2023-11-15T01:36:21.192475+0000","last_unstale":"2023-11-15T01:36:21.569541+0000","last_undegraded":"2023-11-15T01:36:21.569541+0000","last_fullsized":"2023-11-15T01:36:21.569541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.590936+0000","last_change":"2023-11-15T01:36:21.586527+0000","last_active":"2023-11-15T01:36:21.590936+0000","last_peered":"2023-11-15T01:36:21.590936+0000","last_clean":"2023-11-15T01:36:21.590936+0000","last_became_active":"2023-11-15T01:36:21.586222+0000","last_became_peered":"2023-11-15T01:36:21.586222+0000","last_unstale":"2023-11-15T01:36:21.590936+0000","last_undegraded":"2023-11-15T01:36:21.590936+0000","last_fullsized":"2023-11-15T01:36:21.590936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593861+0000","last_change":"2023-11-15T01:36:21.193767+0000","last_active":"2023-11-15T01:36:21.593861+0000","last_peered":"2023-11-15T01:36:21.593861+0000","last_clean":"2023-11-15T01:36:21.593861+0000","last_became_active":"2023-11-15T01:36:21.192597+0000","last_became_peered":"2023-11-15T01:36:21.192597+0000","last_unstale":"2023-11-15T01:36:21.593861+0000","last_undegraded":"2023-11-15T01:36:21.593861+0000","last_fullsized":"2023-11-15T01:36:21.593861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.583061+0000","last_change":"2023-11-15T01:36:21.581594+0000","last_active":"2023-11-15T01:36:21.583061+0000","last_peered":"2023-11-15T01:36:21.583061+0000","last_clean":"2023-11-15T01:36:21.583061+0000","last_became_active":"2023-11-15T01:36:21.581298+0000","last_became_peered":"2023-11-15T01:36:21.581298+0000","last_unstale":"2023-11-15T01:36:21.583061+0000","last_undegraded":"2023-11-15T01:36:21.583061+0000","last_fullsized":"2023-11-15T01:36:21.583061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576657+0000","last_change":"2023-11-15T01:36:21.184696+0000","last_active":"2023-11-15T01:36:21.576657+0000","last_peered":"2023-11-15T01:36:21.576657+0000","last_clean":"2023-11-15T01:36:21.576657+0000","last_became_active":"2023-11-15T01:36:21.184418+0000","last_became_peered":"2023-11-15T01:36:21.184418+0000","last_unstale":"2023-11-15T01:36:21.576657+0000","last_undegraded":"2023-11-15T01:36:21.576657+0000","last_fullsized":"2023-11-15T01:36:21.576657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588407+0000","last_change":"2023-11-15T01:36:21.585820+0000","last_active":"2023-11-15T01:36:21.588407+0000","last_peered":"2023-11-15T01:36:21.588407+0000","last_clean":"2023-11-15T01:36:21.588407+0000","last_became_active":"2023-11-15T01:36:21.585529+0000","last_became_peered":"2023-11-15T01:36:21.585529+0000","last_unstale":"2023-11-15T01:36:21.588407+0000","last_undegraded":"2023-11-15T01:36:21.588407+0000","last_fullsized":"2023-11-15T01:36:21.588407+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.583795+0000","last_change":"2023-11-15T01:36:21.194729+0000","last_active":"2023-11-15T01:36:21.583795+0000","last_peered":"2023-11-15T01:36:21.583795+0000","last_clean":"2023-11-15T01:36:21.583795+0000","last_became_active":"2023-11-15T01:36:21.194456+0000","last_became_peered":"2023-11-15T01:36:21.194456+0000","last_unstale":"2023-11-15T01:36:21.583795+0000","last_undegraded":"2023-11-15T01:36:21.583795+0000","last_fullsized":"2023-11-15T01:36:21.583795+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.592438+0000","last_change":"2023-11-15T01:36:21.584707+0000","last_active":"2023-11-15T01:36:21.592438+0000","last_peered":"2023-11-15T01:36:21.592438+0000","last_clean":"2023-11-15T01:36:21.592438+0000","last_became_active":"2023-11-15T01:36:21.584054+0000","last_became_peered":"2023-11-15T01:36:21.584054+0000","last_unstale":"2023-11-15T01:36:21.592438+0000","last_undegraded":"2023-11-15T01:36:21.592438+0000","last_fullsized":"2023-11-15T01:36:21.592438+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.581436+0000","last_change":"2023-11-15T01:36:21.188671+0000","last_active":"2023-11-15T01:36:21.581436+0000","last_peered":"2023-11-15T01:36:21.581436+0000","last_clean":"2023-11-15T01:36:21.581436+0000","last_became_active":"2023-11-15T01:36:21.188375+0000","last_became_peered":"2023-11-15T01:36:21.188375+0000","last_unstale":"2023-11-15T01:36:21.581436+0000","last_undegraded":"2023-11-15T01:36:21.581436+0000","last_fullsized":"2023-11-15T01:36:21.581436+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.594465+0000","last_change":"2023-11-15T01:36:21.591728+0000","last_active":"2023-11-15T01:36:21.594465+0000","last_peered":"2023-11-15T01:36:21.594465+0000","last_clean":"2023-11-15T01:36:21.594465+0000","last_became_active":"2023-11-15T01:36:21.591439+0000","last_became_peered":"2023-11-15T01:36:21.591439+0000","last_unstale":"2023-11-15T01:36:21.594465+0000","last_undegraded":"2023-11-15T01:36:21.594465+0000","last_fullsized":"2023-11-15T01:36:21.594465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.573775+0000","last_change":"2023-11-15T01:36:21.182628+0000","last_active":"2023-11-15T01:36:21.573775+0000","last_peered":"2023-11-15T01:36:21.573775+0000","last_clean":"2023-11-15T01:36:21.573775+0000","last_became_active":"2023-11-15T01:36:21.182383+0000","last_became_peered":"2023-11-15T01:36:21.182383+0000","last_unstale":"2023-11-15T01:36:21.573775+0000","last_undegraded":"2023-11-15T01:36:21.573775+0000","last_fullsized":"2023-11-15T01:36:21.573775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596541+0000","last_change":"2023-11-15T01:36:21.594134+0000","last_active":"2023-11-15T01:36:21.596541+0000","last_peered":"2023-11-15T01:36:21.596541+0000","last_clean":"2023-11-15T01:36:21.596541+0000","last_became_active":"2023-11-15T01:36:21.593876+0000","last_became_peered":"2023-11-15T01:36:21.593876+0000","last_unstale":"2023-11-15T01:36:21.596541+0000","last_undegraded":"2023-11-15T01:36:21.596541+0000","last_fullsized":"2023-11-15T01:36:21.596541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.589574+0000","last_change":"2023-11-15T01:36:21.194631+0000","last_active":"2023-11-15T01:36:21.589574+0000","last_peered":"2023-11-15T01:36:21.589574+0000","last_clean":"2023-11-15T01:36:21.589574+0000","last_became_active":"2023-11-15T01:36:21.194305+0000","last_became_peered":"2023-11-15T01:36:21.194305+0000","last_unstale":"2023-11-15T01:36:21.589574+0000","last_undegraded":"2023-11-15T01:36:21.589574+0000","last_fullsized":"2023-11-15T01:36:21.589574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.589399+0000","last_change":"2023-11-15T01:36:21.588292+0000","last_active":"2023-11-15T01:36:21.589399+0000","last_peered":"2023-11-15T01:36:21.589399+0000","last_clean":"2023-11-15T01:36:21.589399+0000","last_became_active":"2023-11-15T01:36:21.588004+0000","last_became_peered":"2023-11-15T01:36:21.588004+0000","last_unstale":"2023-11-15T01:36:21.589399+0000","last_undegraded":"2023-11-15T01:36:21.589399+0000","last_fullsized":"2023-11-15T01:36:21.589399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.573498+0000","last_change":"2023-11-15T01:36:21.195997+0000","last_active":"2023-11-15T01:36:21.573498+0000","last_peered":"2023-11-15T01:36:21.573498+0000","last_clean":"2023-11-15T01:36:21.573498+0000","last_became_active":"2023-11-15T01:36:21.195526+0000","last_became_peered":"2023-11-15T01:36:21.195526+0000","last_unstale":"2023-11-15T01:36:21.573498+0000","last_undegraded":"2023-11-15T01:36:21.573498+0000","last_fullsized":"2023-11-15T01:36:21.573498+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.589790+0000","last_change":"2023-11-15T01:36:21.589087+0000","last_active":"2023-11-15T01:36:21.589790+0000","last_peered":"2023-11-15T01:36:21.589790+0000","last_clean":"2023-11-15T01:36:21.589790+0000","last_became_active":"2023-11-15T01:36:21.588824+0000","last_became_peered":"2023-11-15T01:36:21.588824+0000","last_unstale":"2023-11-15T01:36:21.589790+0000","last_undegraded":"2023-11-15T01:36:21.589790+0000","last_fullsized":"2023-11-15T01:36:21.589790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.577641+0000","last_change":"2023-11-15T01:36:21.199200+0000","last_active":"2023-11-15T01:36:21.577641+0000","last_peered":"2023-11-15T01:36:21.577641+0000","last_clean":"2023-11-15T01:36:21.577641+0000","last_became_active":"2023-11-15T01:36:21.198968+0000","last_became_peered":"2023-11-15T01:36:21.198968+0000","last_unstale":"2023-11-15T01:36:21.577641+0000","last_undegraded":"2023-11-15T01:36:21.577641+0000","last_fullsized":"2023-11-15T01:36:21.577641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588304+0000","last_change":"2023-11-15T01:36:21.585086+0000","last_active":"2023-11-15T01:36:21.588304+0000","last_peered":"2023-11-15T01:36:21.588304+0000","last_clean":"2023-11-15T01:36:21.588304+0000","last_became_active":"2023-11-15T01:36:21.584815+0000","last_became_peered":"2023-11-15T01:36:21.584815+0000","last_unstale":"2023-11-15T01:36:21.588304+0000","last_undegraded":"2023-11-15T01:36:21.588304+0000","last_fullsized":"2023-11-15T01:36:21.588304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.571036+0000","last_change":"2023-11-15T01:36:21.189088+0000","last_active":"2023-11-15T01:36:21.571036+0000","last_peered":"2023-11-15T01:36:21.571036+0000","last_clean":"2023-11-15T01:36:21.571036+0000","last_became_active":"2023-11-15T01:36:21.188753+0000","last_became_peered":"2023-11-15T01:36:21.188753+0000","last_unstale":"2023-11-15T01:36:21.571036+0000","last_undegraded":"2023-11-15T01:36:21.571036+0000","last_fullsized":"2023-11-15T01:36:21.571036+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.591689+0000","last_change":"2023-11-15T01:36:21.589043+0000","last_active":"2023-11-15T01:36:21.591689+0000","last_peered":"2023-11-15T01:36:21.591689+0000","last_clean":"2023-11-15T01:36:21.591689+0000","last_became_active":"2023-11-15T01:36:21.588768+0000","last_became_peered":"2023-11-15T01:36:21.588768+0000","last_unstale":"2023-11-15T01:36:21.591689+0000","last_undegraded":"2023-11-15T01:36:21.591689+0000","last_fullsized":"2023-11-15T01:36:21.591689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.569023+0000","last_change":"2023-11-15T01:36:21.191104+0000","last_active":"2023-11-15T01:36:21.569023+0000","last_peered":"2023-11-15T01:36:21.569023+0000","last_clean":"2023-11-15T01:36:21.569023+0000","last_became_active":"2023-11-15T01:36:21.190850+0000","last_became_peered":"2023-11-15T01:36:21.190850+0000","last_unstale":"2023-11-15T01:36:21.569023+0000","last_undegraded":"2023-11-15T01:36:21.569023+0000","last_fullsized":"2023-11-15T01:36:21.569023+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.592442+0000","last_change":"2023-11-15T01:36:21.585735+0000","last_active":"2023-11-15T01:36:21.592442+0000","last_peered":"2023-11-15T01:36:21.592442+0000","last_clean":"2023-11-15T01:36:21.592442+0000","last_became_active":"2023-11-15T01:36:21.585422+0000","last_became_peered":"2023-11-15T01:36:21.585422+0000","last_unstale":"2023-11-15T01:36:21.592442+0000","last_undegraded":"2023-11-15T01:36:21.592442+0000","last_fullsized":"2023-11-15T01:36:21.592442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.578901+0000","last_change":"2023-11-15T01:36:21.193558+0000","last_active":"2023-11-15T01:36:21.578901+0000","last_peered":"2023-11-15T01:36:21.578901+0000","last_clean":"2023-11-15T01:36:21.578901+0000","last_became_active":"2023-11-15T01:36:21.193221+0000","last_became_peered":"2023-11-15T01:36:21.193221+0000","last_unstale":"2023-11-15T01:36:21.578901+0000","last_undegraded":"2023-11-15T01:36:21.578901+0000","last_fullsized":"2023-11-15T01:36:21.578901+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.591007+0000","last_change":"2023-11-15T01:36:21.586649+0000","last_active":"2023-11-15T01:36:21.591007+0000","last_peered":"2023-11-15T01:36:21.591007+0000","last_clean":"2023-11-15T01:36:21.591007+0000","last_became_active":"2023-11-15T01:36:21.586016+0000","last_became_peered":"2023-11-15T01:36:21.586016+0000","last_unstale":"2023-11-15T01:36:21.591007+0000","last_undegraded":"2023-11-15T01:36:21.591007+0000","last_fullsized":"2023-11-15T01:36:21.591007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.575675+0000","last_change":"2023-11-15T01:36:21.193265+0000","last_active":"2023-11-15T01:36:21.575675+0000","last_peered":"2023-11-15T01:36:21.575675+0000","last_clean":"2023-11-15T01:36:21.575675+0000","last_became_active":"2023-11-15T01:36:21.192977+0000","last_became_peered":"2023-11-15T01:36:21.192977+0000","last_unstale":"2023-11-15T01:36:21.575675+0000","last_undegraded":"2023-11-15T01:36:21.575675+0000","last_fullsized":"2023-11-15T01:36:21.575675+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.595903+0000","last_change":"2023-11-15T01:36:21.588513+0000","last_active":"2023-11-15T01:36:21.595903+0000","last_peered":"2023-11-15T01:36:21.595903+0000","last_clean":"2023-11-15T01:36:21.595903+0000","last_became_active":"2023-11-15T01:36:21.588184+0000","last_became_peered":"2023-11-15T01:36:21.588184+0000","last_unstale":"2023-11-15T01:36:21.595903+0000","last_undegraded":"2023-11-15T01:36:21.595903+0000","last_fullsized":"2023-11-15T01:36:21.595903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.568587+0000","last_change":"2023-11-15T01:36:21.179701+0000","last_active":"2023-11-15T01:36:21.568587+0000","last_peered":"2023-11-15T01:36:21.568587+0000","last_clean":"2023-11-15T01:36:21.568587+0000","last_became_active":"2023-11-15T01:36:21.179412+0000","last_became_peered":"2023-11-15T01:36:21.179412+0000","last_unstale":"2023-11-15T01:36:21.568587+0000","last_undegraded":"2023-11-15T01:36:21.568587+0000","last_fullsized":"2023-11-15T01:36:21.568587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593344+0000","last_change":"2023-11-15T01:36:21.590787+0000","last_active":"2023-11-15T01:36:21.593344+0000","last_peered":"2023-11-15T01:36:21.593344+0000","last_clean":"2023-11-15T01:36:21.593344+0000","last_became_active":"2023-11-15T01:36:21.589847+0000","last_became_peered":"2023-11-15T01:36:21.589847+0000","last_unstale":"2023-11-15T01:36:21.593344+0000","last_undegraded":"2023-11-15T01:36:21.593344+0000","last_fullsized":"2023-11-15T01:36:21.593344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.573728+0000","last_change":"2023-11-15T01:36:21.194774+0000","last_active":"2023-11-15T01:36:21.573728+0000","last_peered":"2023-11-15T01:36:21.573728+0000","last_clean":"2023-11-15T01:36:21.573728+0000","last_became_active":"2023-11-15T01:36:21.194480+0000","last_became_peered":"2023-11-15T01:36:21.194480+0000","last_unstale":"2023-11-15T01:36:21.573728+0000","last_undegraded":"2023-11-15T01:36:21.573728+0000","last_fullsized":"2023-11-15T01:36:21.573728+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.592479+0000","last_change":"2023-11-15T01:36:21.585921+0000","last_active":"2023-11-15T01:36:21.592479+0000","last_peered":"2023-11-15T01:36:21.592479+0000","last_clean":"2023-11-15T01:36:21.592479+0000","last_became_active":"2023-11-15T01:36:21.585650+0000","last_became_peered":"2023-11-15T01:36:21.585650+0000","last_unstale":"2023-11-15T01:36:21.592479+0000","last_undegraded":"2023-11-15T01:36:21.592479+0000","last_fullsized":"2023-11-15T01:36:21.592479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.578276+0000","last_change":"2023-11-15T01:36:21.196469+0000","last_active":"2023-11-15T01:36:21.578276+0000","last_peered":"2023-11-15T01:36:21.578276+0000","last_clean":"2023-11-15T01:36:21.578276+0000","last_became_active":"2023-11-15T01:36:21.196183+0000","last_became_peered":"2023-11-15T01:36:21.196183+0000","last_unstale":"2023-11-15T01:36:21.578276+0000","last_undegraded":"2023-11-15T01:36:21.578276+0000","last_fullsized":"2023-11-15T01:36:21.578276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596409+0000","last_change":"2023-11-15T01:36:21.590906+0000","last_active":"2023-11-15T01:36:21.596409+0000","last_peered":"2023-11-15T01:36:21.596409+0000","last_clean":"2023-11-15T01:36:21.596409+0000","last_became_active":"2023-11-15T01:36:21.590606+0000","last_became_peered":"2023-11-15T01:36:21.590606+0000","last_unstale":"2023-11-15T01:36:21.596409+0000","last_undegraded":"2023-11-15T01:36:21.596409+0000","last_fullsized":"2023-11-15T01:36:21.596409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.568006+0000","last_change":"2023-11-15T01:36:21.191248+0000","last_active":"2023-11-15T01:36:21.568006+0000","last_peered":"2023-11-15T01:36:21.568006+0000","last_clean":"2023-11-15T01:36:21.568006+0000","last_became_active":"2023-11-15T01:36:21.190942+0000","last_became_peered":"2023-11-15T01:36:21.190942+0000","last_unstale":"2023-11-15T01:36:21.568006+0000","last_undegraded":"2023-11-15T01:36:21.568006+0000","last_fullsized":"2023-11-15T01:36:21.568006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596332+0000","last_change":"2023-11-15T01:36:21.592379+0000","last_active":"2023-11-15T01:36:21.596332+0000","last_peered":"2023-11-15T01:36:21.596332+0000","last_clean":"2023-11-15T01:36:21.596332+0000","last_became_active":"2023-11-15T01:36:21.592112+0000","last_became_peered":"2023-11-15T01:36:21.592112+0000","last_unstale":"2023-11-15T01:36:21.596332+0000","last_undegraded":"2023-11-15T01:36:21.596332+0000","last_fullsized":"2023-11-15T01:36:21.596332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576369+0000","last_change":"2023-11-15T01:36:21.188207+0000","last_active":"2023-11-15T01:36:21.576369+0000","last_peered":"2023-11-15T01:36:21.576369+0000","last_clean":"2023-11-15T01:36:21.576369+0000","last_became_active":"2023-11-15T01:36:21.187789+0000","last_became_peered":"2023-11-15T01:36:21.187789+0000","last_unstale":"2023-11-15T01:36:21.576369+0000","last_undegraded":"2023-11-15T01:36:21.576369+0000","last_fullsized":"2023-11-15T01:36:21.576369+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588638+0000","last_change":"2023-11-15T01:36:21.581906+0000","last_active":"2023-11-15T01:36:21.588638+0000","last_peered":"2023-11-15T01:36:21.588638+0000","last_clean":"2023-11-15T01:36:21.588638+0000","last_became_active":"2023-11-15T01:36:21.581585+0000","last_became_peered":"2023-11-15T01:36:21.581585+0000","last_unstale":"2023-11-15T01:36:21.588638+0000","last_undegraded":"2023-11-15T01:36:21.588638+0000","last_fullsized":"2023-11-15T01:36:21.588638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.591143+0000","last_change":"2023-11-15T01:36:21.196191+0000","last_active":"2023-11-15T01:36:21.591143+0000","last_peered":"2023-11-15T01:36:21.591143+0000","last_clean":"2023-11-15T01:36:21.591143+0000","last_became_active":"2023-11-15T01:36:21.195772+0000","last_became_peered":"2023-11-15T01:36:21.195772+0000","last_unstale":"2023-11-15T01:36:21.591143+0000","last_undegraded":"2023-11-15T01:36:21.591143+0000","last_fullsized":"2023-11-15T01:36:21.591143+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.584884+0000","last_change":"2023-11-15T01:36:21.577758+0000","last_active":"2023-11-15T01:36:21.584884+0000","last_peered":"2023-11-15T01:36:21.584884+0000","last_clean":"2023-11-15T01:36:21.584884+0000","last_became_active":"2023-11-15T01:36:21.577428+0000","last_became_peered":"2023-11-15T01:36:21.577428+0000","last_unstale":"2023-11-15T01:36:21.584884+0000","last_undegraded":"2023-11-15T01:36:21.584884+0000","last_fullsized":"2023-11-15T01:36:21.584884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593419+0000","last_change":"2023-11-15T01:36:21.187500+0000","last_active":"2023-11-15T01:36:21.593419+0000","last_peered":"2023-11-15T01:36:21.593419+0000","last_clean":"2023-11-15T01:36:21.593419+0000","last_became_active":"2023-11-15T01:36:21.187195+0000","last_became_peered":"2023-11-15T01:36:21.187195+0000","last_unstale":"2023-11-15T01:36:21.593419+0000","last_undegraded":"2023-11-15T01:36:21.593419+0000","last_fullsized":"2023-11-15T01:36:21.593419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593353+0000","last_change":"2023-11-15T01:36:21.589588+0000","last_active":"2023-11-15T01:36:21.593353+0000","last_peered":"2023-11-15T01:36:21.593353+0000","last_clean":"2023-11-15T01:36:21.593353+0000","last_became_active":"2023-11-15T01:36:21.588906+0000","last_became_peered":"2023-11-15T01:36:21.588906+0000","last_unstale":"2023-11-15T01:36:21.593353+0000","last_undegraded":"2023-11-15T01:36:21.593353+0000","last_fullsized":"2023-11-15T01:36:21.593353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.591533+0000","last_change":"2023-11-15T01:36:21.189825+0000","last_active":"2023-11-15T01:36:21.591533+0000","last_peered":"2023-11-15T01:36:21.591533+0000","last_clean":"2023-11-15T01:36:21.591533+0000","last_became_active":"2023-11-15T01:36:21.189532+0000","last_became_peered":"2023-11-15T01:36:21.189532+0000","last_unstale":"2023-11-15T01:36:21.591533+0000","last_undegraded":"2023-11-15T01:36:21.591533+0000","last_fullsized":"2023-11-15T01:36:21.591533+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596111+0000","last_change":"2023-11-15T01:36:21.589815+0000","last_active":"2023-11-15T01:36:21.596111+0000","last_peered":"2023-11-15T01:36:21.596111+0000","last_clean":"2023-11-15T01:36:21.596111+0000","last_became_active":"2023-11-15T01:36:21.589479+0000","last_became_peered":"2023-11-15T01:36:21.589479+0000","last_unstale":"2023-11-15T01:36:21.596111+0000","last_undegraded":"2023-11-15T01:36:21.596111+0000","last_fullsized":"2023-11-15T01:36:21.596111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.575643+0000","last_change":"2023-11-15T01:36:21.189557+0000","last_active":"2023-11-15T01:36:21.575643+0000","last_peered":"2023-11-15T01:36:21.575643+0000","last_clean":"2023-11-15T01:36:21.575643+0000","last_became_active":"2023-11-15T01:36:21.189024+0000","last_became_peered":"2023-11-15T01:36:21.189024+0000","last_unstale":"2023-11-15T01:36:21.575643+0000","last_undegraded":"2023-11-15T01:36:21.575643+0000","last_fullsized":"2023-11-15T01:36:21.575643+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.584889+0000","last_change":"2023-11-15T01:36:21.583940+0000","last_active":"2023-11-15T01:36:21.584889+0000","last_peered":"2023-11-15T01:36:21.584889+0000","last_clean":"2023-11-15T01:36:21.584889+0000","last_became_active":"2023-11-15T01:36:21.581369+0000","last_became_peered":"2023-11-15T01:36:21.581369+0000","last_unstale":"2023-11-15T01:36:21.584889+0000","last_undegraded":"2023-11-15T01:36:21.584889+0000","last_fullsized":"2023-11-15T01:36:21.584889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.573715+0000","last_change":"2023-11-15T01:36:21.187848+0000","last_active":"2023-11-15T01:36:21.573715+0000","last_peered":"2023-11-15T01:36:21.573715+0000","last_clean":"2023-11-15T01:36:21.573715+0000","last_became_active":"2023-11-15T01:36:21.187570+0000","last_became_peered":"2023-11-15T01:36:21.187570+0000","last_unstale":"2023-11-15T01:36:21.573715+0000","last_undegraded":"2023-11-15T01:36:21.573715+0000","last_fullsized":"2023-11-15T01:36:21.573715+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.587453+0000","last_change":"2023-11-15T01:36:21.585829+0000","last_active":"2023-11-15T01:36:21.587453+0000","last_peered":"2023-11-15T01:36:21.587453+0000","last_clean":"2023-11-15T01:36:21.587453+0000","last_became_active":"2023-11-15T01:36:21.585515+0000","last_became_peered":"2023-11-15T01:36:21.585515+0000","last_unstale":"2023-11-15T01:36:21.587453+0000","last_undegraded":"2023-11-15T01:36:21.587453+0000","last_fullsized":"2023-11-15T01:36:21.587453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.572304+0000","last_change":"2023-11-15T01:36:21.195820+0000","last_active":"2023-11-15T01:36:21.572304+0000","last_peered":"2023-11-15T01:36:21.572304+0000","last_clean":"2023-11-15T01:36:21.572304+0000","last_became_active":"2023-11-15T01:36:21.195149+0000","last_became_peered":"2023-11-15T01:36:21.195149+0000","last_unstale":"2023-11-15T01:36:21.572304+0000","last_undegraded":"2023-11-15T01:36:21.572304+0000","last_fullsized":"2023-11-15T01:36:21.572304+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588776+0000","last_change":"2023-11-15T01:36:21.586810+0000","last_active":"2023-11-15T01:36:21.588776+0000","last_peered":"2023-11-15T01:36:21.588776+0000","last_clean":"2023-11-15T01:36:21.588776+0000","last_became_active":"2023-11-15T01:36:21.586537+0000","last_became_peered":"2023-11-15T01:36:21.586537+0000","last_unstale":"2023-11-15T01:36:21.588776+0000","last_undegraded":"2023-11-15T01:36:21.588776+0000","last_fullsized":"2023-11-15T01:36:21.588776+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.572582+0000","last_change":"2023-11-15T01:36:21.183827+0000","last_active":"2023-11-15T01:36:21.572582+0000","last_peered":"2023-11-15T01:36:21.572582+0000","last_clean":"2023-11-15T01:36:21.572582+0000","last_became_active":"2023-11-15T01:36:21.183532+0000","last_became_peered":"2023-11-15T01:36:21.183532+0000","last_unstale":"2023-11-15T01:36:21.572582+0000","last_undegraded":"2023-11-15T01:36:21.572582+0000","last_fullsized":"2023-11-15T01:36:21.572582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.587043+0000","last_change":"2023-11-15T01:36:21.586055+0000","last_active":"2023-11-15T01:36:21.587043+0000","last_peered":"2023-11-15T01:36:21.587043+0000","last_clean":"2023-11-15T01:36:21.587043+0000","last_became_active":"2023-11-15T01:36:21.585801+0000","last_became_peered":"2023-11-15T01:36:21.585801+0000","last_unstale":"2023-11-15T01:36:21.587043+0000","last_undegraded":"2023-11-15T01:36:21.587043+0000","last_fullsized":"2023-11-15T01:36:21.587043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.571142+0000","last_change":"2023-11-15T01:36:21.190487+0000","last_active":"2023-11-15T01:36:21.571142+0000","last_peered":"2023-11-15T01:36:21.571142+0000","last_clean":"2023-11-15T01:36:21.571142+0000","last_became_active":"2023-11-15T01:36:21.190206+0000","last_became_peered":"2023-11-15T01:36:21.190206+0000","last_unstale":"2023-11-15T01:36:21.571142+0000","last_undegraded":"2023-11-15T01:36:21.571142+0000","last_fullsized":"2023-11-15T01:36:21.571142+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588067+0000","last_change":"2023-11-15T01:36:21.586184+0000","last_active":"2023-11-15T01:36:21.588067+0000","last_peered":"2023-11-15T01:36:21.588067+0000","last_clean":"2023-11-15T01:36:21.588067+0000","last_became_active":"2023-11-15T01:36:21.585922+0000","last_became_peered":"2023-11-15T01:36:21.585922+0000","last_unstale":"2023-11-15T01:36:21.588067+0000","last_undegraded":"2023-11-15T01:36:21.588067+0000","last_fullsized":"2023-11-15T01:36:21.588067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.579974+0000","last_change":"2023-11-15T01:36:21.195408+0000","last_active":"2023-11-15T01:36:21.579974+0000","last_peered":"2023-11-15T01:36:21.579974+0000","last_clean":"2023-11-15T01:36:21.579974+0000","last_became_active":"2023-11-15T01:36:21.195062+0000","last_became_peered":"2023-11-15T01:36:21.195062+0000","last_unstale":"2023-11-15T01:36:21.579974+0000","last_undegraded":"2023-11-15T01:36:21.579974+0000","last_fullsized":"2023-11-15T01:36:21.579974+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.584127+0000","last_change":"2023-11-15T01:36:21.583281+0000","last_active":"2023-11-15T01:36:21.584127+0000","last_peered":"2023-11-15T01:36:21.584127+0000","last_clean":"2023-11-15T01:36:21.584127+0000","last_became_active":"2023-11-15T01:36:21.582985+0000","last_became_peered":"2023-11-15T01:36:21.582985+0000","last_unstale":"2023-11-15T01:36:21.584127+0000","last_undegraded":"2023-11-15T01:36:21.584127+0000","last_fullsized":"2023-11-15T01:36:21.584127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.570422+0000","last_change":"2023-11-15T01:36:21.193011+0000","last_active":"2023-11-15T01:36:21.570422+0000","last_peered":"2023-11-15T01:36:21.570422+0000","last_clean":"2023-11-15T01:36:21.570422+0000","last_became_active":"2023-11-15T01:36:21.192717+0000","last_became_peered":"2023-11-15T01:36:21.192717+0000","last_unstale":"2023-11-15T01:36:21.570422+0000","last_undegraded":"2023-11-15T01:36:21.570422+0000","last_fullsized":"2023-11-15T01:36:21.570422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588608+0000","last_change":"2023-11-15T01:36:21.585080+0000","last_active":"2023-11-15T01:36:21.588608+0000","last_peered":"2023-11-15T01:36:21.588608+0000","last_clean":"2023-11-15T01:36:21.588608+0000","last_became_active":"2023-11-15T01:36:21.584792+0000","last_became_peered":"2023-11-15T01:36:21.584792+0000","last_unstale":"2023-11-15T01:36:21.588608+0000","last_undegraded":"2023-11-15T01:36:21.588608+0000","last_fullsized":"2023-11-15T01:36:21.588608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"78'3","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.589599+0000","last_change":"2023-11-15T01:36:21.197175+0000","last_active":"2023-11-15T01:36:21.589599+0000","last_peered":"2023-11-15T01:36:21.589599+0000","last_clean":"2023-11-15T01:36:21.589599+0000","last_became_active":"2023-11-15T01:36:21.196944+0000","last_became_peered":"2023-11-15T01:36:21.196944+0000","last_unstale":"2023-11-15T01:36:21.589599+0000","last_undegraded":"2023-11-15T01:36:21.589599+0000","last_fullsized":"2023-11-15T01:36:21.589599+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.590806+0000","last_change":"2023-11-15T01:36:21.582353+0000","last_active":"2023-11-15T01:36:21.590806+0000","last_peered":"2023-11-15T01:36:21.590806+0000","last_clean":"2023-11-15T01:36:21.590806+0000","last_became_active":"2023-11-15T01:36:21.582026+0000","last_became_peered":"2023-11-15T01:36:21.582026+0000","last_unstale":"2023-11-15T01:36:21.590806+0000","last_undegraded":"2023-11-15T01:36:21.590806+0000","last_fullsized":"2023-11-15T01:36:21.590806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593012+0000","last_change":"2023-11-15T01:36:21.197131+0000","last_active":"2023-11-15T01:36:21.593012+0000","last_peered":"2023-11-15T01:36:21.593012+0000","last_clean":"2023-11-15T01:36:21.593012+0000","last_became_active":"2023-11-15T01:36:21.196857+0000","last_became_peered":"2023-11-15T01:36:21.196857+0000","last_unstale":"2023-11-15T01:36:21.593012+0000","last_undegraded":"2023-11-15T01:36:21.593012+0000","last_fullsized":"2023-11-15T01:36:21.593012+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593106+0000","last_change":"2023-11-15T01:36:21.588966+0000","last_active":"2023-11-15T01:36:21.593106+0000","last_peered":"2023-11-15T01:36:21.593106+0000","last_clean":"2023-11-15T01:36:21.593106+0000","last_became_active":"2023-11-15T01:36:21.588693+0000","last_became_peered":"2023-11-15T01:36:21.588693+0000","last_unstale":"2023-11-15T01:36:21.593106+0000","last_undegraded":"2023-11-15T01:36:21.593106+0000","last_fullsized":"2023-11-15T01:36:21.593106+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.589786+0000","last_change":"2023-11-15T01:36:21.193355+0000","last_active":"2023-11-15T01:36:21.589786+0000","last_peered":"2023-11-15T01:36:21.589786+0000","last_clean":"2023-11-15T01:36:21.589786+0000","last_became_active":"2023-11-15T01:36:21.193060+0000","last_became_peered":"2023-11-15T01:36:21.193060+0000","last_unstale":"2023-11-15T01:36:21.589786+0000","last_undegraded":"2023-11-15T01:36:21.589786+0000","last_fullsized":"2023-11-15T01:36:21.589786+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.584597+0000","last_change":"2023-11-15T01:36:21.580996+0000","last_active":"2023-11-15T01:36:21.584597+0000","last_peered":"2023-11-15T01:36:21.584597+0000","last_clean":"2023-11-15T01:36:21.584597+0000","last_became_active":"2023-11-15T01:36:21.580636+0000","last_became_peered":"2023-11-15T01:36:21.580636+0000","last_unstale":"2023-11-15T01:36:21.584597+0000","last_undegraded":"2023-11-15T01:36:21.584597+0000","last_fullsized":"2023-11-15T01:36:21.584597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576091+0000","last_change":"2023-11-15T01:36:21.189747+0000","last_active":"2023-11-15T01:36:21.576091+0000","last_peered":"2023-11-15T01:36:21.576091+0000","last_clean":"2023-11-15T01:36:21.576091+0000","last_became_active":"2023-11-15T01:36:21.189275+0000","last_became_peered":"2023-11-15T01:36:21.189275+0000","last_unstale":"2023-11-15T01:36:21.576091+0000","last_undegraded":"2023-11-15T01:36:21.576091+0000","last_fullsized":"2023-11-15T01:36:21.576091+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588752+0000","last_change":"2023-11-15T01:36:21.582970+0000","last_active":"2023-11-15T01:36:21.588752+0000","last_peered":"2023-11-15T01:36:21.588752+0000","last_clean":"2023-11-15T01:36:21.588752+0000","last_became_active":"2023-11-15T01:36:21.582546+0000","last_became_peered":"2023-11-15T01:36:21.582546+0000","last_unstale":"2023-11-15T01:36:21.588752+0000","last_undegraded":"2023-11-15T01:36:21.588752+0000","last_fullsized":"2023-11-15T01:36:21.588752+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.577746+0000","last_change":"2023-11-15T01:36:21.199293+0000","last_active":"2023-11-15T01:36:21.577746+0000","last_peered":"2023-11-15T01:36:21.577746+0000","last_clean":"2023-11-15T01:36:21.577746+0000","last_became_active":"2023-11-15T01:36:21.198988+0000","last_became_peered":"2023-11-15T01:36:21.198988+0000","last_unstale":"2023-11-15T01:36:21.577746+0000","last_undegraded":"2023-11-15T01:36:21.577746+0000","last_fullsized":"2023-11-15T01:36:21.577746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.591876+0000","last_change":"2023-11-15T01:36:21.591050+0000","last_active":"2023-11-15T01:36:21.591876+0000","last_peered":"2023-11-15T01:36:21.591876+0000","last_clean":"2023-11-15T01:36:21.591876+0000","last_became_active":"2023-11-15T01:36:21.590426+0000","last_became_peered":"2023-11-15T01:36:21.590426+0000","last_unstale":"2023-11-15T01:36:21.591876+0000","last_undegraded":"2023-11-15T01:36:21.591876+0000","last_fullsized":"2023-11-15T01:36:21.591876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.591986+0000","last_change":"2023-11-15T01:36:21.192463+0000","last_active":"2023-11-15T01:36:21.591986+0000","last_peered":"2023-11-15T01:36:21.591986+0000","last_clean":"2023-11-15T01:36:21.591986+0000","last_became_active":"2023-11-15T01:36:21.192145+0000","last_became_peered":"2023-11-15T01:36:21.192145+0000","last_unstale":"2023-11-15T01:36:21.591986+0000","last_undegraded":"2023-11-15T01:36:21.591986+0000","last_fullsized":"2023-11-15T01:36:21.591986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.594369+0000","last_change":"2023-11-15T01:36:21.593125+0000","last_active":"2023-11-15T01:36:21.594369+0000","last_peered":"2023-11-15T01:36:21.594369+0000","last_clean":"2023-11-15T01:36:21.594369+0000","last_became_active":"2023-11-15T01:36:21.592851+0000","last_became_peered":"2023-11-15T01:36:21.592851+0000","last_unstale":"2023-11-15T01:36:21.594369+0000","last_undegraded":"2023-11-15T01:36:21.594369+0000","last_fullsized":"2023-11-15T01:36:21.594369+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.590436+0000","last_change":"2023-11-15T01:36:21.186459+0000","last_active":"2023-11-15T01:36:21.590436+0000","last_peered":"2023-11-15T01:36:21.590436+0000","last_clean":"2023-11-15T01:36:21.590436+0000","last_became_active":"2023-11-15T01:36:21.186131+0000","last_became_peered":"2023-11-15T01:36:21.186131+0000","last_unstale":"2023-11-15T01:36:21.590436+0000","last_undegraded":"2023-11-15T01:36:21.590436+0000","last_fullsized":"2023-11-15T01:36:21.590436+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.584582+0000","last_change":"2023-11-15T01:36:21.579446+0000","last_active":"2023-11-15T01:36:21.584582+0000","last_peered":"2023-11-15T01:36:21.584582+0000","last_clean":"2023-11-15T01:36:21.584582+0000","last_became_active":"2023-11-15T01:36:21.575715+0000","last_became_peered":"2023-11-15T01:36:21.575715+0000","last_unstale":"2023-11-15T01:36:21.584582+0000","last_undegraded":"2023-11-15T01:36:21.584582+0000","last_fullsized":"2023-11-15T01:36:21.584582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.578999+0000","last_change":"2023-11-15T01:36:21.180234+0000","last_active":"2023-11-15T01:36:21.578999+0000","last_peered":"2023-11-15T01:36:21.578999+0000","last_clean":"2023-11-15T01:36:21.578999+0000","last_became_active":"2023-11-15T01:36:21.179966+0000","last_became_peered":"2023-11-15T01:36:21.179966+0000","last_unstale":"2023-11-15T01:36:21.578999+0000","last_undegraded":"2023-11-15T01:36:21.578999+0000","last_fullsized":"2023-11-15T01:36:21.578999+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.587537+0000","last_change":"2023-11-15T01:36:21.583753+0000","last_active":"2023-11-15T01:36:21.587537+0000","last_peered":"2023-11-15T01:36:21.587537+0000","last_clean":"2023-11-15T01:36:21.587537+0000","last_became_active":"2023-11-15T01:36:21.583352+0000","last_became_peered":"2023-11-15T01:36:21.583352+0000","last_unstale":"2023-11-15T01:36:21.587537+0000","last_undegraded":"2023-11-15T01:36:21.587537+0000","last_fullsized":"2023-11-15T01:36:21.587537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.575871+0000","last_change":"2023-11-15T01:36:21.186859+0000","last_active":"2023-11-15T01:36:21.575871+0000","last_peered":"2023-11-15T01:36:21.575871+0000","last_clean":"2023-11-15T01:36:21.575871+0000","last_became_active":"2023-11-15T01:36:21.186313+0000","last_became_peered":"2023-11-15T01:36:21.186313+0000","last_unstale":"2023-11-15T01:36:21.575871+0000","last_undegraded":"2023-11-15T01:36:21.575871+0000","last_fullsized":"2023-11-15T01:36:21.575871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588159+0000","last_change":"2023-11-15T01:36:21.582161+0000","last_active":"2023-11-15T01:36:21.588159+0000","last_peered":"2023-11-15T01:36:21.588159+0000","last_clean":"2023-11-15T01:36:21.588159+0000","last_became_active":"2023-11-15T01:36:21.581931+0000","last_became_peered":"2023-11-15T01:36:21.581931+0000","last_unstale":"2023-11-15T01:36:21.588159+0000","last_undegraded":"2023-11-15T01:36:21.588159+0000","last_fullsized":"2023-11-15T01:36:21.588159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.577040+0000","last_change":"2023-11-15T01:36:21.197725+0000","last_active":"2023-11-15T01:36:21.577040+0000","last_peered":"2023-11-15T01:36:21.577040+0000","last_clean":"2023-11-15T01:36:21.577040+0000","last_became_active":"2023-11-15T01:36:21.197036+0000","last_became_peered":"2023-11-15T01:36:21.197036+0000","last_unstale":"2023-11-15T01:36:21.577040+0000","last_undegraded":"2023-11-15T01:36:21.577040+0000","last_fullsized":"2023-11-15T01:36:21.577040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588448+0000","last_change":"2023-11-15T01:36:21.584509+0000","last_active":"2023-11-15T01:36:21.588448+0000","last_peered":"2023-11-15T01:36:21.588448+0000","last_clean":"2023-11-15T01:36:21.588448+0000","last_became_active":"2023-11-15T01:36:21.582942+0000","last_became_peered":"2023-11-15T01:36:21.582942+0000","last_unstale":"2023-11-15T01:36:21.588448+0000","last_undegraded":"2023-11-15T01:36:21.588448+0000","last_fullsized":"2023-11-15T01:36:21.588448+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.579880+0000","last_change":"2023-11-15T01:36:21.198137+0000","last_active":"2023-11-15T01:36:21.579880+0000","last_peered":"2023-11-15T01:36:21.579880+0000","last_clean":"2023-11-15T01:36:21.579880+0000","last_became_active":"2023-11-15T01:36:21.197914+0000","last_became_peered":"2023-11-15T01:36:21.197914+0000","last_unstale":"2023-11-15T01:36:21.579880+0000","last_undegraded":"2023-11-15T01:36:21.579880+0000","last_fullsized":"2023-11-15T01:36:21.579880+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593048+0000","last_change":"2023-11-15T01:36:21.588289+0000","last_active":"2023-11-15T01:36:21.593048+0000","last_peered":"2023-11-15T01:36:21.593048+0000","last_clean":"2023-11-15T01:36:21.593048+0000","last_became_active":"2023-11-15T01:36:21.588008+0000","last_became_peered":"2023-11-15T01:36:21.588008+0000","last_unstale":"2023-11-15T01:36:21.593048+0000","last_undegraded":"2023-11-15T01:36:21.593048+0000","last_fullsized":"2023-11-15T01:36:21.593048+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.573581+0000","last_change":"2023-11-15T01:36:21.191068+0000","last_active":"2023-11-15T01:36:21.573581+0000","last_peered":"2023-11-15T01:36:21.573581+0000","last_clean":"2023-11-15T01:36:21.573581+0000","last_became_active":"2023-11-15T01:36:21.190792+0000","last_became_peered":"2023-11-15T01:36:21.190792+0000","last_unstale":"2023-11-15T01:36:21.573581+0000","last_undegraded":"2023-11-15T01:36:21.573581+0000","last_fullsized":"2023-11-15T01:36:21.573581+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.587463+0000","last_change":"2023-11-15T01:36:21.585649+0000","last_active":"2023-11-15T01:36:21.587463+0000","last_peered":"2023-11-15T01:36:21.587463+0000","last_clean":"2023-11-15T01:36:21.587463+0000","last_became_active":"2023-11-15T01:36:21.585246+0000","last_became_peered":"2023-11-15T01:36:21.585246+0000","last_unstale":"2023-11-15T01:36:21.587463+0000","last_undegraded":"2023-11-15T01:36:21.587463+0000","last_fullsized":"2023-11-15T01:36:21.587463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.572664+0000","last_change":"2023-11-15T01:36:21.183301+0000","last_active":"2023-11-15T01:36:21.572664+0000","last_peered":"2023-11-15T01:36:21.572664+0000","last_clean":"2023-11-15T01:36:21.572664+0000","last_became_active":"2023-11-15T01:36:21.183025+0000","last_became_peered":"2023-11-15T01:36:21.183025+0000","last_unstale":"2023-11-15T01:36:21.572664+0000","last_undegraded":"2023-11-15T01:36:21.572664+0000","last_fullsized":"2023-11-15T01:36:21.572664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.585306+0000","last_change":"2023-11-15T01:36:21.584556+0000","last_active":"2023-11-15T01:36:21.585306+0000","last_peered":"2023-11-15T01:36:21.585306+0000","last_clean":"2023-11-15T01:36:21.585306+0000","last_became_active":"2023-11-15T01:36:21.584215+0000","last_became_peered":"2023-11-15T01:36:21.584215+0000","last_unstale":"2023-11-15T01:36:21.585306+0000","last_undegraded":"2023-11-15T01:36:21.585306+0000","last_fullsized":"2023-11-15T01:36:21.585306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576048+0000","last_change":"2023-11-15T01:36:21.190215+0000","last_active":"2023-11-15T01:36:21.576048+0000","last_peered":"2023-11-15T01:36:21.576048+0000","last_clean":"2023-11-15T01:36:21.576048+0000","last_became_active":"2023-11-15T01:36:21.189941+0000","last_became_peered":"2023-11-15T01:36:21.189941+0000","last_unstale":"2023-11-15T01:36:21.576048+0000","last_undegraded":"2023-11-15T01:36:21.576048+0000","last_fullsized":"2023-11-15T01:36:21.576048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596278+0000","last_change":"2023-11-15T01:36:21.591596+0000","last_active":"2023-11-15T01:36:21.596278+0000","last_peered":"2023-11-15T01:36:21.596278+0000","last_clean":"2023-11-15T01:36:21.596278+0000","last_became_active":"2023-11-15T01:36:21.591273+0000","last_became_peered":"2023-11-15T01:36:21.591273+0000","last_unstale":"2023-11-15T01:36:21.596278+0000","last_undegraded":"2023-11-15T01:36:21.596278+0000","last_fullsized":"2023-11-15T01:36:21.596278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.584744+0000","last_change":"2023-11-15T01:36:21.192295+0000","last_active":"2023-11-15T01:36:21.584744+0000","last_peered":"2023-11-15T01:36:21.584744+0000","last_clean":"2023-11-15T01:36:21.584744+0000","last_became_active":"2023-11-15T01:36:21.192060+0000","last_became_peered":"2023-11-15T01:36:21.192060+0000","last_unstale":"2023-11-15T01:36:21.584744+0000","last_undegraded":"2023-11-15T01:36:21.584744+0000","last_fullsized":"2023-11-15T01:36:21.584744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576943+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:36:21.576943+0000","last_peered":"2023-11-15T01:36:21.576943+0000","last_clean":"2023-11-15T01:36:21.576943+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:36:21.576943+0000","last_undegraded":"2023-11-15T01:36:21.576943+0000","last_fullsized":"2023-11-15T01:36:21.576943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588732+0000","last_change":"2023-11-15T01:36:21.581777+0000","last_active":"2023-11-15T01:36:21.588732+0000","last_peered":"2023-11-15T01:36:21.588732+0000","last_clean":"2023-11-15T01:36:21.588732+0000","last_became_active":"2023-11-15T01:36:21.581444+0000","last_became_peered":"2023-11-15T01:36:21.581444+0000","last_unstale":"2023-11-15T01:36:21.588732+0000","last_undegraded":"2023-11-15T01:36:21.588732+0000","last_fullsized":"2023-11-15T01:36:21.588732+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.574565+0000","last_change":"2023-11-15T01:36:21.192478+0000","last_active":"2023-11-15T01:36:21.574565+0000","last_peered":"2023-11-15T01:36:21.574565+0000","last_clean":"2023-11-15T01:36:21.574565+0000","last_became_active":"2023-11-15T01:36:21.192184+0000","last_became_peered":"2023-11-15T01:36:21.192184+0000","last_unstale":"2023-11-15T01:36:21.574565+0000","last_undegraded":"2023-11-15T01:36:21.574565+0000","last_fullsized":"2023-11-15T01:36:21.574565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576269+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:36:21.576269+0000","last_peered":"2023-11-15T01:36:21.576269+0000","last_clean":"2023-11-15T01:36:21.576269+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:36:21.576269+0000","last_undegraded":"2023-11-15T01:36:21.576269+0000","last_fullsized":"2023-11-15T01:36:21.576269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588467+0000","last_change":"2023-11-15T01:36:21.586123+0000","last_active":"2023-11-15T01:36:21.588467+0000","last_peered":"2023-11-15T01:36:21.588467+0000","last_clean":"2023-11-15T01:36:21.588467+0000","last_became_active":"2023-11-15T01:36:21.585800+0000","last_became_peered":"2023-11-15T01:36:21.585800+0000","last_unstale":"2023-11-15T01:36:21.588467+0000","last_undegraded":"2023-11-15T01:36:21.588467+0000","last_fullsized":"2023-11-15T01:36:21.588467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576190+0000","last_change":"2023-11-15T01:36:21.189558+0000","last_active":"2023-11-15T01:36:21.576190+0000","last_peered":"2023-11-15T01:36:21.576190+0000","last_clean":"2023-11-15T01:36:21.576190+0000","last_became_active":"2023-11-15T01:36:21.188934+0000","last_became_peered":"2023-11-15T01:36:21.188934+0000","last_unstale":"2023-11-15T01:36:21.576190+0000","last_undegraded":"2023-11-15T01:36:21.576190+0000","last_fullsized":"2023-11-15T01:36:21.576190+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.568087+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:36:21.568087+0000","last_peered":"2023-11-15T01:36:21.568087+0000","last_clean":"2023-11-15T01:36:21.568087+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:36:21.568087+0000","last_undegraded":"2023-11-15T01:36:21.568087+0000","last_fullsized":"2023-11-15T01:36:21.568087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588109+0000","last_change":"2023-11-15T01:36:21.581736+0000","last_active":"2023-11-15T01:36:21.588109+0000","last_peered":"2023-11-15T01:36:21.588109+0000","last_clean":"2023-11-15T01:36:21.588109+0000","last_became_active":"2023-11-15T01:36:21.581413+0000","last_became_peered":"2023-11-15T01:36:21.581413+0000","last_unstale":"2023-11-15T01:36:21.588109+0000","last_undegraded":"2023-11-15T01:36:21.588109+0000","last_fullsized":"2023-11-15T01:36:21.588109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.570716+0000","last_change":"2023-11-15T01:36:21.190496+0000","last_active":"2023-11-15T01:36:21.570716+0000","last_peered":"2023-11-15T01:36:21.570716+0000","last_clean":"2023-11-15T01:36:21.570716+0000","last_became_active":"2023-11-15T01:36:21.190114+0000","last_became_peered":"2023-11-15T01:36:21.190114+0000","last_unstale":"2023-11-15T01:36:21.570716+0000","last_undegraded":"2023-11-15T01:36:21.570716+0000","last_fullsized":"2023-11-15T01:36:21.570716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576384+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:36:21.576384+0000","last_peered":"2023-11-15T01:36:21.576384+0000","last_clean":"2023-11-15T01:36:21.576384+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:36:21.576384+0000","last_undegraded":"2023-11-15T01:36:21.576384+0000","last_fullsized":"2023-11-15T01:36:21.576384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.583124+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:36:21.583124+0000","last_peered":"2023-11-15T01:36:21.583124+0000","last_clean":"2023-11-15T01:36:21.583124+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:36:21.583124+0000","last_undegraded":"2023-11-15T01:36:21.583124+0000","last_fullsized":"2023-11-15T01:36:21.583124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593323+0000","last_change":"2023-11-15T01:36:21.590631+0000","last_active":"2023-11-15T01:36:21.593323+0000","last_peered":"2023-11-15T01:36:21.593323+0000","last_clean":"2023-11-15T01:36:21.593323+0000","last_became_active":"2023-11-15T01:36:21.589440+0000","last_became_peered":"2023-11-15T01:36:21.589440+0000","last_unstale":"2023-11-15T01:36:21.593323+0000","last_undegraded":"2023-11-15T01:36:21.593323+0000","last_fullsized":"2023-11-15T01:36:21.593323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.592052+0000","last_change":"2023-11-15T01:36:21.194817+0000","last_active":"2023-11-15T01:36:21.592052+0000","last_peered":"2023-11-15T01:36:21.592052+0000","last_clean":"2023-11-15T01:36:21.592052+0000","last_became_active":"2023-11-15T01:36:21.193564+0000","last_became_peered":"2023-11-15T01:36:21.193564+0000","last_unstale":"2023-11-15T01:36:21.592052+0000","last_undegraded":"2023-11-15T01:36:21.592052+0000","last_fullsized":"2023-11-15T01:36:21.592052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.583213+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:36:21.583213+0000","last_peered":"2023-11-15T01:36:21.583213+0000","last_clean":"2023-11-15T01:36:21.583213+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:36:21.583213+0000","last_undegraded":"2023-11-15T01:36:21.583213+0000","last_fullsized":"2023-11-15T01:36:21.583213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.579399+0000","last_change":"2023-11-15T01:36:21.576052+0000","last_active":"2023-11-15T01:36:21.579399+0000","last_peered":"2023-11-15T01:36:21.579399+0000","last_clean":"2023-11-15T01:36:21.579399+0000","last_became_active":"2023-11-15T01:36:21.575768+0000","last_became_peered":"2023-11-15T01:36:21.575768+0000","last_unstale":"2023-11-15T01:36:21.579399+0000","last_undegraded":"2023-11-15T01:36:21.579399+0000","last_fullsized":"2023-11-15T01:36:21.579399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593514+0000","last_change":"2023-11-15T01:36:21.196469+0000","last_active":"2023-11-15T01:36:21.593514+0000","last_peered":"2023-11-15T01:36:21.593514+0000","last_clean":"2023-11-15T01:36:21.593514+0000","last_became_active":"2023-11-15T01:36:21.196211+0000","last_became_peered":"2023-11-15T01:36:21.196211+0000","last_unstale":"2023-11-15T01:36:21.593514+0000","last_undegraded":"2023-11-15T01:36:21.593514+0000","last_fullsized":"2023-11-15T01:36:21.593514+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.580170+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:36:21.580170+0000","last_peered":"2023-11-15T01:36:21.580170+0000","last_clean":"2023-11-15T01:36:21.580170+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:36:21.580170+0000","last_undegraded":"2023-11-15T01:36:21.580170+0000","last_fullsized":"2023-11-15T01:36:21.580170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.584803+0000","last_change":"2023-11-15T01:36:21.575267+0000","last_active":"2023-11-15T01:36:21.584803+0000","last_peered":"2023-11-15T01:36:21.584803+0000","last_clean":"2023-11-15T01:36:21.584803+0000","last_became_active":"2023-11-15T01:36:21.574952+0000","last_became_peered":"2023-11-15T01:36:21.574952+0000","last_unstale":"2023-11-15T01:36:21.584803+0000","last_undegraded":"2023-11-15T01:36:21.584803+0000","last_fullsized":"2023-11-15T01:36:21.584803+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.579910+0000","last_change":"2023-11-15T01:36:21.198294+0000","last_active":"2023-11-15T01:36:21.579910+0000","last_peered":"2023-11-15T01:36:21.579910+0000","last_clean":"2023-11-15T01:36:21.579910+0000","last_became_active":"2023-11-15T01:36:21.198002+0000","last_became_peered":"2023-11-15T01:36:21.198002+0000","last_unstale":"2023-11-15T01:36:21.579910+0000","last_undegraded":"2023-11-15T01:36:21.579910+0000","last_fullsized":"2023-11-15T01:36:21.579910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576733+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:36:21.576733+0000","last_peered":"2023-11-15T01:36:21.576733+0000","last_clean":"2023-11-15T01:36:21.576733+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:36:21.576733+0000","last_undegraded":"2023-11-15T01:36:21.576733+0000","last_fullsized":"2023-11-15T01:36:21.576733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588190+0000","last_change":"2023-11-15T01:36:21.582715+0000","last_active":"2023-11-15T01:36:21.588190+0000","last_peered":"2023-11-15T01:36:21.588190+0000","last_clean":"2023-11-15T01:36:21.588190+0000","last_became_active":"2023-11-15T01:36:21.582418+0000","last_became_peered":"2023-11-15T01:36:21.582418+0000","last_unstale":"2023-11-15T01:36:21.588190+0000","last_undegraded":"2023-11-15T01:36:21.588190+0000","last_fullsized":"2023-11-15T01:36:21.588190+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.573871+0000","last_change":"2023-11-15T01:36:21.194150+0000","last_active":"2023-11-15T01:36:21.573871+0000","last_peered":"2023-11-15T01:36:21.573871+0000","last_clean":"2023-11-15T01:36:21.573871+0000","last_became_active":"2023-11-15T01:36:21.193042+0000","last_became_peered":"2023-11-15T01:36:21.193042+0000","last_unstale":"2023-11-15T01:36:21.573871+0000","last_undegraded":"2023-11-15T01:36:21.573871+0000","last_fullsized":"2023-11-15T01:36:21.573871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.571043+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:36:21.571043+0000","last_peered":"2023-11-15T01:36:21.571043+0000","last_clean":"2023-11-15T01:36:21.571043+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:36:21.571043+0000","last_undegraded":"2023-11-15T01:36:21.571043+0000","last_fullsized":"2023-11-15T01:36:21.571043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575026,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302136,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069704,"statfs":{"total":96636764160,"available":96327376896,"internally_reserved":0,"allocated":966656,"data_stored":480430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.34799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70299999999999996,"5min":0.71199999999999997,"15min":0.82299999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.41699999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.83299999999999996},"last":0.67900000000000005}]},{"osd":1,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72099999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.40400000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.81499999999999995},"last":0.58599999999999997}]},{"osd":2,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.39500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73799999999999999,"5min":0.77800000000000002,"15min":0.82599999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.46100000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.86299999999999999},"last":0.629}]},{"osd":3,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.47299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.73399999999999999,"5min":0.80700000000000005,"15min":0.85999999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.501,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79000000000000004,"5min":0.79700000000000004,"15min":0.81200000000000006},"last":0.56599999999999995}]},{"osd":4,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45300000000000001,"15min":0.46600000000000003},"min":{"1min":0.31,"5min":0.247,"15min":0.247},"max":{"1min":0.624,"5min":0.69999999999999996,"15min":0.84499999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.40400000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.83799999999999997},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47499999999999998,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.77500000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.497,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.78500000000000003},"last":0.64000000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.38400000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.752,"5min":0.755,"15min":0.85099999999999998},"last":0.73999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575027,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302128,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069712,"statfs":{"total":96636764160,"available":96327385088,"internally_reserved":0,"allocated":958464,"data_stored":479448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.29199999999999998},"max":{"1min":0.74299999999999999,"5min":0.83499999999999996,"15min":0.94299999999999995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.312},"max":{"1min":0.74199999999999999,"5min":0.89000000000000001,"15min":0.97799999999999998},"last":0.38100000000000001}]},{"osd":1,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32200000000000001},"max":{"1min":0.71199999999999997,"5min":0.79000000000000004,"15min":1.0649999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56799999999999995,"15min":0.55900000000000005},"min":{"1min":0.38700000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78800000000000003,"5min":0.84699999999999998,"15min":1.022},"last":0.53300000000000003}]},{"osd":2,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.69599999999999995,"5min":0.79100000000000004,"15min":1.038},"last":0.374},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.38600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77300000000000002,"5min":0.81799999999999995,"15min":0.995},"last":0.443}]},{"osd":3,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.379,"5min":0.307,"15min":0.307},"max":{"1min":0.753,"5min":0.91300000000000003,"15min":1.028},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.48999999999999999,"5min":0.41699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80500000000000005,"5min":0.874,"15min":1.004},"last":0.43099999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45400000000000001,"15min":0.45200000000000001},"min":{"1min":0.308,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.39800000000000002,"5min":0.33100000000000002,"15min":0.25800000000000001},"max":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.81799999999999995},"last":0.48299999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.315,"15min":0.312},"max":{"1min":0.625,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.40500000000000003,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.76900000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.50600000000000001,"15min":0.503},"min":{"1min":0.33200000000000002,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":0.72099999999999997,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.41399999999999998,"15min":0.34000000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.0009999999999999},"last":0.46800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575028,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302128,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069712,"statfs":{"total":96636764160,"available":96327385088,"internally_reserved":0,"allocated":958464,"data_stored":473042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.373,"15min":0.375},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.23999999999999999},"max":{"1min":0.56599999999999995,"5min":0.73699999999999999,"15min":0.77800000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.39600000000000002},"min":{"1min":0.29399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.61199999999999999,"5min":0.65900000000000003,"15min":0.73099999999999998},"last":0.28699999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.38600000000000001,"15min":0.38800000000000001},"min":{"1min":0.28999999999999998,"5min":0.26900000000000002,"15min":0.22600000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.69599999999999995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.432,"15min":0.437},"min":{"1min":0.34300000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64800000000000002,"5min":0.69299999999999995,"15min":0.90000000000000002},"last":0.30399999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.49099999999999999},"min":{"1min":0.44800000000000001,"5min":0.35199999999999998,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":1.0009999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.46800000000000003},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.28000000000000003},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.75600000000000001},"last":0.33200000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.41599999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.439,"5min":0.433,"15min":0.42299999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.0509999999999999},"last":0.41999999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.38},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.45200000000000001,"5min":0.40400000000000003,"15min":0.373},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.42799999999999999}]},{"osd":6,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.52200000000000002,"5min":0.441,"15min":0.42799999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42699999999999999,"5min":0.41999999999999998,"15min":0.41199999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.996},"last":0.51500000000000001}]},{"osd":7,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.54500000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.25},"last":0.505},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.46100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575026,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302112,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069728,"statfs":{"total":96636764160,"available":96327401472,"internally_reserved":0,"allocated":942080,"data_stored":472286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38,"15min":0.37},"min":{"1min":0.28499999999999998,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51100000000000001,"5min":2.024,"15min":2.024},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.438,"15min":0.41499999999999998},"min":{"1min":0.32800000000000001,"5min":0.252,"15min":0.215},"max":{"1min":0.60099999999999998,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.312}]},{"osd":2,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.40500000000000003,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.54200000000000004,"5min":1.768,"15min":1.768},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.35799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61699999999999999,"5min":1.982,"15min":1.982},"last":0.36399999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.433},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.22500000000000001},"max":{"1min":0.63100000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46500000000000002,"15min":0.45400000000000001},"min":{"1min":0.33300000000000002,"5min":0.28100000000000003,"15min":0.27700000000000002},"max":{"1min":0.66700000000000004,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.34699999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42199999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80500000000000005,"5min":0.97799999999999998,"15min":1.454},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.65500000000000003},"min":{"1min":0.55500000000000005,"5min":0.45900000000000002,"15min":0.442},"max":{"1min":0.78800000000000003,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.61199999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82399999999999995,"5min":1.881,"15min":1.881},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.46100000000000002,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.86599999999999999,"5min":0.91400000000000003,"15min":1.1120000000000001},"last":0.55000000000000004}]},{"osd":6,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.46800000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83399999999999996,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52600000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.874,"5min":1.917,"15min":1.917},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70099999999999996,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.91300000000000003,"5min":1.843,"15min":1.843},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68500000000000005,"15min":0.69399999999999995},"min":{"1min":0.54100000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90600000000000003,"5min":0.95299999999999996,"15min":1.4119999999999999},"last":0.64600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575027,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306228,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065612,"statfs":{"total":96636764160,"available":96323186688,"internally_reserved":0,"allocated":962560,"data_stored":480038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36799999999999999},"min":{"1min":0.27800000000000002,"5min":0.23999999999999999,"15min":0.221},"max":{"1min":0.50600000000000001,"5min":0.56100000000000005,"15min":0.61899999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.40500000000000003,"15min":0.40300000000000002},"min":{"1min":0.31900000000000001,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.63900000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.33100000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.378,"15min":0.38},"min":{"1min":0.29399999999999998,"5min":0.24399999999999999,"15min":0.222},"max":{"1min":0.55600000000000005,"5min":0.70999999999999996,"15min":0.75},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.44700000000000001,"15min":0.442},"min":{"1min":0.32300000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63900000000000001,"5min":0.73499999999999999,"15min":0.92000000000000004},"last":0.40899999999999997}]},{"osd":3,"last update":"Wed Nov 15 01:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.314,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.66200000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.44800000000000001,"15min":0.439},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.253},"max":{"1min":0.59199999999999997,"5min":0.66700000000000004,"15min":0.74199999999999999},"last":0.42399999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.47099999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0800000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.40899999999999997,"15min":0.39200000000000002},"max":{"1min":0.91100000000000003,"5min":0.95399999999999996,"15min":1.052},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed Nov 15 01:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.63800000000000001,"15min":0.64900000000000002},"min":{"1min":0.497,"5min":0.375,"15min":0.375},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.627,"15min":0.64200000000000002},"min":{"1min":0.54400000000000004,"5min":0.316,"15min":0.316},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.1339999999999999},"last":0.55600000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65100000000000002,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66600000000000004,"15min":0.67600000000000005},"min":{"1min":0.53800000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.119},"last":0.47099999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.51700000000000002,"5min":0.45100000000000001,"15min":0.438},"max":{"1min":1.079,"5min":1.079,"15min":1.103},"last":0.44},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.69399999999999995},"min":{"1min":0.57499999999999996,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.97899999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.51200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575028,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306228,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065612,"statfs":{"total":96636764160,"available":96323186688,"internally_reserved":0,"allocated":962560,"data_stored":480038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.374,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.22600000000000001},"max":{"1min":0.53400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.311},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.23200000000000001},"max":{"1min":0.60699999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.32300000000000001}]},{"osd":1,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":0.56599999999999995,"5min":0.64700000000000002,"15min":0.72899999999999998},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.29199999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72499999999999998,"5min":0.747,"15min":0.80500000000000005},"last":0.373}]},{"osd":2,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44500000000000001,"15min":0.44600000000000001},"min":{"1min":0.33700000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.69199999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.34599999999999997}]},{"osd":4,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.39000000000000001},"max":{"1min":0.89200000000000002,"5min":1.0169999999999999,"15min":1.0589999999999999},"last":0.434}]},{"osd":5,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.436,"5min":0.377,"15min":0.377},"max":{"1min":0.92000000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.501},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.45500000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82999999999999996,"5min":0.90100000000000002,"15min":0.95999999999999996},"last":0.41899999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64000000000000001,"15min":0.65000000000000002},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84899999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.67600000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95799999999999996,"5min":1.0900000000000001,"15min":1.169},"last":0.46899999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.65600000000000003,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0429999999999999,"5min":1.071,"15min":1.071},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.69299999999999995},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.996,"5min":1.1319999999999999,"15min":1.1459999999999999},"last":0.47699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575026,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302132,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069708,"statfs":{"total":96636764160,"available":96327380992,"internally_reserved":0,"allocated":962560,"data_stored":480058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.751,"5min":0.88,"15min":0.88},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55000000000000004}]},{"osd":1,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.30499999999999999},"max":{"1min":0.81499999999999995,"5min":1.087,"15min":1.087},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.46100000000000002,"5min":0.35499999999999998,"15min":0.34699999999999998},"max":{"1min":0.74399999999999999,"5min":0.80200000000000005,"15min":0.81000000000000005},"last":0.60499999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.47799999999999998,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":0.77300000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.42899999999999999,"5min":0.34699999999999998,"15min":0.33100000000000002},"max":{"1min":0.78300000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56399999999999995}]},{"osd":3,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.46700000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75700000000000001,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45800000000000002,"15min":0.47099999999999997},"min":{"1min":0.34100000000000003,"5min":0.30499999999999999,"15min":0.30399999999999999},"max":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":0.80600000000000005},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47699999999999998,"15min":0.49399999999999999},"min":{"1min":0.378,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65400000000000003,"5min":0.752,"15min":0.85299999999999998},"last":0.59399999999999997}]},{"osd":6,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48199999999999998,"15min":0.498},"min":{"1min":0.38300000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78500000000000003,"5min":0.79000000000000004,"15min":0.84199999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.33700000000000002,"15min":0.33500000000000002},"max":{"1min":0.82999999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.626}]},{"osd":7,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.53000000000000003},"min":{"1min":0.41799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.873},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77600000000000002,"5min":0.78400000000000003,"15min":0.90100000000000002},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575026,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302132,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069708,"statfs":{"total":96636764160,"available":96327380992,"internally_reserved":0,"allocated":962560,"data_stored":480328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.42299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45900000000000002,"5min":0.375,"15min":0.36199999999999999},"max":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.81200000000000006},"last":0.78600000000000003}]},{"osd":1,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71499999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.497,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.67400000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.70199999999999996}]},{"osd":2,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.34899999999999998,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.86199999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.44,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.75800000000000001,"5min":0.77700000000000002,"15min":1.103},"last":0.72699999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.46500000000000002,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.59499999999999997},"min":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71999999999999997,"5min":0.80700000000000005,"15min":1.127},"last":0.86899999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42799999999999999,"15min":0.45900000000000002},"min":{"1min":0.30299999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.94399999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.50800000000000001,"15min":0.52800000000000002},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.65600000000000003,"5min":0.71599999999999997,"15min":0.80900000000000005},"last":0.88300000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.46100000000000002,"15min":0.48099999999999998},"min":{"1min":0.33700000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64800000000000002,"5min":0.83099999999999996,"15min":1.0660000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.46400000000000002,"15min":0.499},"min":{"1min":0.33700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.70599999999999996,"5min":0.751,"15min":0.76600000000000001},"last":0.81200000000000006}]},{"osd":7,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47699999999999998,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.97199999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55800000000000005,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.71799999999999997,"5min":0.85799999999999998,"15min":1.1499999999999999},"last":0.82399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:36:25.862 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:36:26.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.011+0000 7f2cdccf6700 1 Processor -- start 2023-11-15T01:36:26.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.011+0000 7f2cdccf6700 1 -- start start 2023-11-15T01:36:26.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.012+0000 7f2cdccf6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2cd8155790 0x7f2cd80a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.012+0000 7f2cdccf6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2cd8155b70 0x7f2cd80c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.012+0000 7f2cdccf6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2cd80a61b0 0x7f2cd80c8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.012+0000 7f2cdccf6700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd80c5420 con 0x7f2cd8155790 2023-11-15T01:36:26.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.012+0000 7f2cdccf6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd8083630 con 0x7f2cd80a61b0 2023-11-15T01:36:26.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.012+0000 7f2cdccf6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd80c7c90 con 0x7f2cd8155b70 2023-11-15T01:36:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.013+0000 7f2cd659c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2cd8155790 0x7f2cd80a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.013+0000 7f2cd659c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2cd8155790 0x7f2cd80a5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49378/0 (socket says 172.21.15.1:49378) 2023-11-15T01:36:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.013+0000 7f2cd659c700 1 -- 172.21.15.1:0/4004582181 learned_addr learned my addr 172.21.15.1:0/4004582181 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.013+0000 7f2cd659c700 1 -- 172.21.15.1:0/4004582181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2cd8155b70 msgr2=0x7f2cd80c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.013+0000 7f2cd659c700 1 --2- 172.21.15.1:0/4004582181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2cd8155b70 0x7f2cd80c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:26.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.013+0000 7f2cd659c700 1 -- 172.21.15.1:0/4004582181 >> v2:172.21.15.141:3300/0 conn(0x7f2cd80a61b0 msgr2=0x7f2cd80c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:26.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.013+0000 7f2cd659c700 1 --2- 172.21.15.1:0/4004582181 >> v2:172.21.15.141:3300/0 conn(0x7f2cd80a61b0 0x7f2cd80c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:26.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.013+0000 7f2cd659c700 1 -- 172.21.15.1:0/4004582181 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd80c8b00 con 0x7f2cd8155790 2023-11-15T01:36:26.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.013+0000 7f2cd659c700 1 --2- 172.21.15.1:0/4004582181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cd8155790 0x7f2cd80a5cc0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f2cd80c9b30 tx=0x7f2cd0009060).ready entity=mon.0 client_cookie=e2f8557aaf8a1fdc server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:26.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.013+0000 7f2cd559a700 1 -- 172.21.15.1:0/4004582181 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0005880 con 0x7f2cd8155790 2023-11-15T01:36:26.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.013+0000 7f2cd559a700 1 -- 172.21.15.1:0/4004582181 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd00059e0 con 0x7f2cd8155790 2023-11-15T01:36:26.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.013+0000 7f2cd559a700 1 -- 172.21.15.1:0/4004582181 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0005d60 con 0x7f2cd8155790 2023-11-15T01:36:26.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.014+0000 7f2cdccf6700 1 -- 172.21.15.1:0/4004582181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cd8155790 msgr2=0x7f2cd80a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.014+0000 7f2cdccf6700 1 --2- 172.21.15.1:0/4004582181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cd8155790 0x7f2cd80a5cc0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f2cd80c9b30 tx=0x7f2cd0009060).stop 2023-11-15T01:36:26.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.014+0000 7f2cdccf6700 1 -- 172.21.15.1:0/4004582181 shutdown_connections 2023-11-15T01:36:26.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.014+0000 7f2cdccf6700 1 --2- 172.21.15.1:0/4004582181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cd8155790 0x7f2cd80a5cc0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.014+0000 7f2cdccf6700 1 --2- 172.21.15.1:0/4004582181 >> v2:172.21.15.141:3300/0 conn(0x7f2cd80a61b0 0x7f2cd80c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:26.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.014+0000 7f2cdccf6700 1 --2- 172.21.15.1:0/4004582181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2cd8155b70 0x7f2cd80c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:26.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.014+0000 7f2cdccf6700 1 -- 172.21.15.1:0/4004582181 >> 172.21.15.1:0/4004582181 conn(0x7f2cd8082f90 msgr2=0x7f2cd80c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:26.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.014+0000 7f2cdccf6700 1 -- 172.21.15.1:0/4004582181 shutdown_connections 2023-11-15T01:36:26.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.014+0000 7f2cdccf6700 1 -- 172.21.15.1:0/4004582181 wait complete. 2023-11-15T01:36:26.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.015+0000 7f2cdccf6700 1 Processor -- start 2023-11-15T01:36:26.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.015+0000 7f2cdccf6700 1 -- start start 2023-11-15T01:36:26.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cdccf6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2cd80a61b0 0x7f2cd8153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cdccf6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2cd8155790 0x7f2cd814c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cdccf6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cd8155b70 0x7f2cd814d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cdccf6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd814cb20 con 0x7f2cd8155b70 2023-11-15T01:36:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cdccf6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd80c0760 con 0x7f2cd80a61b0 2023-11-15T01:36:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cdccf6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd814dba0 con 0x7f2cd8155790 2023-11-15T01:36:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cd6d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cd8155b70 0x7f2cd814d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cd6d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cd8155b70 0x7f2cd814d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49392/0 (socket says 172.21.15.1:49392) 2023-11-15T01:36:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cd6d9d700 1 -- 172.21.15.1:0/2236193443 learned_addr learned my addr 172.21.15.1:0/2236193443 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cd659c700 1 --2- 172.21.15.1:0/2236193443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2cd80a61b0 0x7f2cd8153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cd5d9b700 1 --2- 172.21.15.1:0/2236193443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2cd8155790 0x7f2cd814c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cd6d9d700 1 -- 172.21.15.1:0/2236193443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2cd8155790 msgr2=0x7f2cd814c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cd6d9d700 1 --2- 172.21.15.1:0/2236193443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2cd8155790 0x7f2cd814c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cd6d9d700 1 -- 172.21.15.1:0/2236193443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2cd80a61b0 msgr2=0x7f2cd8153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cd6d9d700 1 --2- 172.21.15.1:0/2236193443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2cd80a61b0 0x7f2cd8153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cd6d9d700 1 -- 172.21.15.1:0/2236193443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd0009300 con 0x7f2cd8155b70 2023-11-15T01:36:26.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cd6d9d700 1 --2- 172.21.15.1:0/2236193443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cd8155b70 0x7f2cd814d1a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f2cc800bb30 tx=0x7f2cc80097e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:26.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.016+0000 7f2cce7fc700 1 -- 172.21.15.1:0/2236193443 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc800c7c0 con 0x7f2cd8155b70 2023-11-15T01:36:26.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.017+0000 7f2cce7fc700 1 -- 172.21.15.1:0/2236193443 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc800c960 con 0x7f2cd8155b70 2023-11-15T01:36:26.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.017+0000 7f2cce7fc700 1 -- 172.21.15.1:0/2236193443 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc800cb10 con 0x7f2cd8155b70 2023-11-15T01:36:26.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.017+0000 7f2cdccf6700 1 -- 172.21.15.1:0/2236193443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd814de80 con 0x7f2cd8155b70 2023-11-15T01:36:26.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.017+0000 7f2cdccf6700 1 -- 172.21.15.1:0/2236193443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd80c03f0 con 0x7f2cd8155b70 2023-11-15T01:36:26.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.018+0000 7f2cdccf6700 1 -- 172.21.15.1:0/2236193443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd80c08d0 con 0x7f2cd8155b70 2023-11-15T01:36:26.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.018+0000 7f2cce7fc700 1 -- 172.21.15.1:0/2236193443 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2cc8012020 con 0x7f2cd8155b70 2023-11-15T01:36:26.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.018+0000 7f2cce7fc700 1 --2- 172.21.15.1:0/2236193443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2cb805f270 0x7f2cb8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.018+0000 7f2cce7fc700 1 -- 172.21.15.1:0/2236193443 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f2cc807a2d0 con 0x7f2cd8155b70 2023-11-15T01:36:26.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.019+0000 7f2cd659c700 1 --2- 172.21.15.1:0/2236193443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2cb805f270 0x7f2cb8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.019+0000 7f2cd659c700 1 --2- 172.21.15.1:0/2236193443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2cb805f270 0x7f2cb8061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2cd000b3c0 tx=0x7f2cd0016000).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:26.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.023+0000 7f2cce7fc700 1 -- 172.21.15.1:0/2236193443 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2cc804b320 con 0x7f2cd8155b70 2023-11-15T01:36:26.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.191+0000 7f2cdccf6700 1 -- 172.21.15.1:0/2236193443 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2cd805f8b0 con 0x7f2cb805f270 2023-11-15T01:36:26.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.202+0000 7f2cce7fc700 1 -- 172.21.15.1:0/2236193443 <== mgr.5686 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361070 (secure 0 0 0) 0x7f2cd805f8b0 con 0x7f2cb805f270 2023-11-15T01:36:26.207 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:26.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.205+0000 7f2cdccf6700 1 -- 172.21.15.1:0/2236193443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2cb805f270 msgr2=0x7f2cb8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.205+0000 7f2cdccf6700 1 --2- 172.21.15.1:0/2236193443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2cb805f270 0x7f2cb8061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2cd000b3c0 tx=0x7f2cd0016000).stop 2023-11-15T01:36:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.205+0000 7f2cdccf6700 1 -- 172.21.15.1:0/2236193443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cd8155b70 msgr2=0x7f2cd814d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.205+0000 7f2cdccf6700 1 --2- 172.21.15.1:0/2236193443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cd8155b70 0x7f2cd814d1a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f2cc800bb30 tx=0x7f2cc80097e0).stop 2023-11-15T01:36:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.205+0000 7f2cdccf6700 1 -- 172.21.15.1:0/2236193443 shutdown_connections 2023-11-15T01:36:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.205+0000 7f2cdccf6700 1 --2- 172.21.15.1:0/2236193443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2cb805f270 0x7f2cb8061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.205+0000 7f2cdccf6700 1 --2- 172.21.15.1:0/2236193443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cd8155b70 0x7f2cd814d1a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.205+0000 7f2cdccf6700 1 --2- 172.21.15.1:0/2236193443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2cd80a61b0 0x7f2cd8153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.205+0000 7f2cdccf6700 1 --2- 172.21.15.1:0/2236193443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2cd8155790 0x7f2cd814c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.205+0000 7f2cdccf6700 1 -- 172.21.15.1:0/2236193443 >> 172.21.15.1:0/2236193443 conn(0x7f2cd8082f90 msgr2=0x7f2cd80bf150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.205+0000 7f2cdccf6700 1 -- 172.21.15.1:0/2236193443 shutdown_connections 2023-11-15T01:36:26.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.205+0000 7f2cdccf6700 1 -- 172.21.15.1:0/2236193443 wait complete. 2023-11-15T01:36:26.212 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:36:26.218 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T01:36:26.133122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":255,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2425224,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752549496,"statfs":{"total":773094113280,"available":770610683904,"internally_reserved":0,"allocated":7675904,"data_stored":3825668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28927,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-83,"num_write_kb":-68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.999954"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.585016+0000","last_change":"2023-11-15T01:36:21.577952+0000","last_active":"2023-11-15T01:36:21.585016+0000","last_peered":"2023-11-15T01:36:21.585016+0000","last_clean":"2023-11-15T01:36:21.585016+0000","last_became_active":"2023-11-15T01:36:21.577642+0000","last_became_peered":"2023-11-15T01:36:21.577642+0000","last_unstale":"2023-11-15T01:36:21.585016+0000","last_undegraded":"2023-11-15T01:36:21.585016+0000","last_fullsized":"2023-11-15T01:36:21.585016+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"78'3","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.586949+0000","last_change":"2023-11-15T01:36:21.189361+0000","last_active":"2023-11-15T01:36:21.586949+0000","last_peered":"2023-11-15T01:36:21.586949+0000","last_clean":"2023-11-15T01:36:21.586949+0000","last_became_active":"2023-11-15T01:36:21.189085+0000","last_became_peered":"2023-11-15T01:36:21.189085+0000","last_unstale":"2023-11-15T01:36:21.586949+0000","last_undegraded":"2023-11-15T01:36:21.586949+0000","last_fullsized":"2023-11-15T01:36:21.586949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596493+0000","last_change":"2023-11-15T01:36:21.592851+0000","last_active":"2023-11-15T01:36:21.596493+0000","last_peered":"2023-11-15T01:36:21.596493+0000","last_clean":"2023-11-15T01:36:21.596493+0000","last_became_active":"2023-11-15T01:36:21.592467+0000","last_became_peered":"2023-11-15T01:36:21.592467+0000","last_unstale":"2023-11-15T01:36:21.596493+0000","last_undegraded":"2023-11-15T01:36:21.596493+0000","last_fullsized":"2023-11-15T01:36:21.596493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.573851+0000","last_change":"2023-11-15T01:36:21.190521+0000","last_active":"2023-11-15T01:36:21.573851+0000","last_peered":"2023-11-15T01:36:21.573851+0000","last_clean":"2023-11-15T01:36:21.573851+0000","last_became_active":"2023-11-15T01:36:21.190264+0000","last_became_peered":"2023-11-15T01:36:21.190264+0000","last_unstale":"2023-11-15T01:36:21.573851+0000","last_undegraded":"2023-11-15T01:36:21.573851+0000","last_fullsized":"2023-11-15T01:36:21.573851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.586502+0000","last_change":"2023-11-15T01:36:21.583461+0000","last_active":"2023-11-15T01:36:21.586502+0000","last_peered":"2023-11-15T01:36:21.586502+0000","last_clean":"2023-11-15T01:36:21.586502+0000","last_became_active":"2023-11-15T01:36:21.583195+0000","last_became_peered":"2023-11-15T01:36:21.583195+0000","last_unstale":"2023-11-15T01:36:21.586502+0000","last_undegraded":"2023-11-15T01:36:21.586502+0000","last_fullsized":"2023-11-15T01:36:21.586502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.579772+0000","last_change":"2023-11-15T01:36:21.196597+0000","last_active":"2023-11-15T01:36:21.579772+0000","last_peered":"2023-11-15T01:36:21.579772+0000","last_clean":"2023-11-15T01:36:21.579772+0000","last_became_active":"2023-11-15T01:36:21.196162+0000","last_became_peered":"2023-11-15T01:36:21.196162+0000","last_unstale":"2023-11-15T01:36:21.579772+0000","last_undegraded":"2023-11-15T01:36:21.579772+0000","last_fullsized":"2023-11-15T01:36:21.579772+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.587490+0000","last_change":"2023-11-15T01:36:21.585298+0000","last_active":"2023-11-15T01:36:21.587490+0000","last_peered":"2023-11-15T01:36:21.587490+0000","last_clean":"2023-11-15T01:36:21.587490+0000","last_became_active":"2023-11-15T01:36:21.584988+0000","last_became_peered":"2023-11-15T01:36:21.584988+0000","last_unstale":"2023-11-15T01:36:21.587490+0000","last_undegraded":"2023-11-15T01:36:21.587490+0000","last_fullsized":"2023-11-15T01:36:21.587490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.586215+0000","last_change":"2023-11-15T01:36:21.180135+0000","last_active":"2023-11-15T01:36:21.586215+0000","last_peered":"2023-11-15T01:36:21.586215+0000","last_clean":"2023-11-15T01:36:21.586215+0000","last_became_active":"2023-11-15T01:36:21.179829+0000","last_became_peered":"2023-11-15T01:36:21.179829+0000","last_unstale":"2023-11-15T01:36:21.586215+0000","last_undegraded":"2023-11-15T01:36:21.586215+0000","last_fullsized":"2023-11-15T01:36:21.586215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596483+0000","last_change":"2023-11-15T01:36:21.592715+0000","last_active":"2023-11-15T01:36:21.596483+0000","last_peered":"2023-11-15T01:36:21.596483+0000","last_clean":"2023-11-15T01:36:21.596483+0000","last_became_active":"2023-11-15T01:36:21.592449+0000","last_became_peered":"2023-11-15T01:36:21.592449+0000","last_unstale":"2023-11-15T01:36:21.596483+0000","last_undegraded":"2023-11-15T01:36:21.596483+0000","last_fullsized":"2023-11-15T01:36:21.596483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.574141+0000","last_change":"2023-11-15T01:36:21.179667+0000","last_active":"2023-11-15T01:36:21.574141+0000","last_peered":"2023-11-15T01:36:21.574141+0000","last_clean":"2023-11-15T01:36:21.574141+0000","last_became_active":"2023-11-15T01:36:21.179363+0000","last_became_peered":"2023-11-15T01:36:21.179363+0000","last_unstale":"2023-11-15T01:36:21.574141+0000","last_undegraded":"2023-11-15T01:36:21.574141+0000","last_fullsized":"2023-11-15T01:36:21.574141+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.590066+0000","last_change":"2023-11-15T01:36:21.588254+0000","last_active":"2023-11-15T01:36:21.590066+0000","last_peered":"2023-11-15T01:36:21.590066+0000","last_clean":"2023-11-15T01:36:21.590066+0000","last_became_active":"2023-11-15T01:36:21.588001+0000","last_became_peered":"2023-11-15T01:36:21.588001+0000","last_unstale":"2023-11-15T01:36:21.590066+0000","last_undegraded":"2023-11-15T01:36:21.590066+0000","last_fullsized":"2023-11-15T01:36:21.590066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.589380+0000","last_change":"2023-11-15T01:36:21.198201+0000","last_active":"2023-11-15T01:36:21.589380+0000","last_peered":"2023-11-15T01:36:21.589380+0000","last_clean":"2023-11-15T01:36:21.589380+0000","last_became_active":"2023-11-15T01:36:21.197870+0000","last_became_peered":"2023-11-15T01:36:21.197870+0000","last_unstale":"2023-11-15T01:36:21.589380+0000","last_undegraded":"2023-11-15T01:36:21.589380+0000","last_fullsized":"2023-11-15T01:36:21.589380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.594263+0000","last_change":"2023-11-15T01:36:21.592705+0000","last_active":"2023-11-15T01:36:21.594263+0000","last_peered":"2023-11-15T01:36:21.594263+0000","last_clean":"2023-11-15T01:36:21.594263+0000","last_became_active":"2023-11-15T01:36:21.592416+0000","last_became_peered":"2023-11-15T01:36:21.592416+0000","last_unstale":"2023-11-15T01:36:21.594263+0000","last_undegraded":"2023-11-15T01:36:21.594263+0000","last_fullsized":"2023-11-15T01:36:21.594263+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.569412+0000","last_change":"2023-11-15T01:36:21.193010+0000","last_active":"2023-11-15T01:36:21.569412+0000","last_peered":"2023-11-15T01:36:21.569412+0000","last_clean":"2023-11-15T01:36:21.569412+0000","last_became_active":"2023-11-15T01:36:21.192692+0000","last_became_peered":"2023-11-15T01:36:21.192692+0000","last_unstale":"2023-11-15T01:36:21.569412+0000","last_undegraded":"2023-11-15T01:36:21.569412+0000","last_fullsized":"2023-11-15T01:36:21.569412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.579914+0000","last_change":"2023-11-15T01:36:21.576214+0000","last_active":"2023-11-15T01:36:21.579914+0000","last_peered":"2023-11-15T01:36:21.579914+0000","last_clean":"2023-11-15T01:36:21.579914+0000","last_became_active":"2023-11-15T01:36:21.575857+0000","last_became_peered":"2023-11-15T01:36:21.575857+0000","last_unstale":"2023-11-15T01:36:21.579914+0000","last_undegraded":"2023-11-15T01:36:21.579914+0000","last_fullsized":"2023-11-15T01:36:21.579914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.570615+0000","last_change":"2023-11-15T01:36:21.194268+0000","last_active":"2023-11-15T01:36:21.570615+0000","last_peered":"2023-11-15T01:36:21.570615+0000","last_clean":"2023-11-15T01:36:21.570615+0000","last_became_active":"2023-11-15T01:36:21.193949+0000","last_became_peered":"2023-11-15T01:36:21.193949+0000","last_unstale":"2023-11-15T01:36:21.570615+0000","last_undegraded":"2023-11-15T01:36:21.570615+0000","last_fullsized":"2023-11-15T01:36:21.570615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596425+0000","last_change":"2023-11-15T01:36:21.590998+0000","last_active":"2023-11-15T01:36:21.596425+0000","last_peered":"2023-11-15T01:36:21.596425+0000","last_clean":"2023-11-15T01:36:21.596425+0000","last_became_active":"2023-11-15T01:36:21.590122+0000","last_became_peered":"2023-11-15T01:36:21.590122+0000","last_unstale":"2023-11-15T01:36:21.596425+0000","last_undegraded":"2023-11-15T01:36:21.596425+0000","last_fullsized":"2023-11-15T01:36:21.596425+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.569524+0000","last_change":"2023-11-15T01:36:21.191907+0000","last_active":"2023-11-15T01:36:21.569524+0000","last_peered":"2023-11-15T01:36:21.569524+0000","last_clean":"2023-11-15T01:36:21.569524+0000","last_became_active":"2023-11-15T01:36:21.191599+0000","last_became_peered":"2023-11-15T01:36:21.191599+0000","last_unstale":"2023-11-15T01:36:21.569524+0000","last_undegraded":"2023-11-15T01:36:21.569524+0000","last_fullsized":"2023-11-15T01:36:21.569524+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.590784+0000","last_change":"2023-11-15T01:36:21.581416+0000","last_active":"2023-11-15T01:36:21.590784+0000","last_peered":"2023-11-15T01:36:21.590784+0000","last_clean":"2023-11-15T01:36:21.590784+0000","last_became_active":"2023-11-15T01:36:21.581128+0000","last_became_peered":"2023-11-15T01:36:21.581128+0000","last_unstale":"2023-11-15T01:36:21.590784+0000","last_undegraded":"2023-11-15T01:36:21.590784+0000","last_fullsized":"2023-11-15T01:36:21.590784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576653+0000","last_change":"2023-11-15T01:36:21.195223+0000","last_active":"2023-11-15T01:36:21.576653+0000","last_peered":"2023-11-15T01:36:21.576653+0000","last_clean":"2023-11-15T01:36:21.576653+0000","last_became_active":"2023-11-15T01:36:21.193578+0000","last_became_peered":"2023-11-15T01:36:21.193578+0000","last_unstale":"2023-11-15T01:36:21.576653+0000","last_undegraded":"2023-11-15T01:36:21.576653+0000","last_fullsized":"2023-11-15T01:36:21.576653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596175+0000","last_change":"2023-11-15T01:36:21.590141+0000","last_active":"2023-11-15T01:36:21.596175+0000","last_peered":"2023-11-15T01:36:21.596175+0000","last_clean":"2023-11-15T01:36:21.596175+0000","last_became_active":"2023-11-15T01:36:21.589830+0000","last_became_peered":"2023-11-15T01:36:21.589830+0000","last_unstale":"2023-11-15T01:36:21.596175+0000","last_undegraded":"2023-11-15T01:36:21.596175+0000","last_fullsized":"2023-11-15T01:36:21.596175+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576632+0000","last_change":"2023-11-15T01:36:21.188318+0000","last_active":"2023-11-15T01:36:21.576632+0000","last_peered":"2023-11-15T01:36:21.576632+0000","last_clean":"2023-11-15T01:36:21.576632+0000","last_became_active":"2023-11-15T01:36:21.187983+0000","last_became_peered":"2023-11-15T01:36:21.187983+0000","last_unstale":"2023-11-15T01:36:21.576632+0000","last_undegraded":"2023-11-15T01:36:21.576632+0000","last_fullsized":"2023-11-15T01:36:21.576632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596320+0000","last_change":"2023-11-15T01:36:21.591795+0000","last_active":"2023-11-15T01:36:21.596320+0000","last_peered":"2023-11-15T01:36:21.596320+0000","last_clean":"2023-11-15T01:36:21.596320+0000","last_became_active":"2023-11-15T01:36:21.591260+0000","last_became_peered":"2023-11-15T01:36:21.591260+0000","last_unstale":"2023-11-15T01:36:21.596320+0000","last_undegraded":"2023-11-15T01:36:21.596320+0000","last_fullsized":"2023-11-15T01:36:21.596320+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596707+0000","last_change":"2023-11-15T01:36:21.186350+0000","last_active":"2023-11-15T01:36:21.596707+0000","last_peered":"2023-11-15T01:36:21.596707+0000","last_clean":"2023-11-15T01:36:21.596707+0000","last_became_active":"2023-11-15T01:36:21.186080+0000","last_became_peered":"2023-11-15T01:36:21.186080+0000","last_unstale":"2023-11-15T01:36:21.596707+0000","last_undegraded":"2023-11-15T01:36:21.596707+0000","last_fullsized":"2023-11-15T01:36:21.596707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.585538+0000","last_change":"2023-11-15T01:36:21.584732+0000","last_active":"2023-11-15T01:36:21.585538+0000","last_peered":"2023-11-15T01:36:21.585538+0000","last_clean":"2023-11-15T01:36:21.585538+0000","last_became_active":"2023-11-15T01:36:21.584252+0000","last_became_peered":"2023-11-15T01:36:21.584252+0000","last_unstale":"2023-11-15T01:36:21.585538+0000","last_undegraded":"2023-11-15T01:36:21.585538+0000","last_fullsized":"2023-11-15T01:36:21.585538+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593547+0000","last_change":"2023-11-15T01:36:21.183748+0000","last_active":"2023-11-15T01:36:21.593547+0000","last_peered":"2023-11-15T01:36:21.593547+0000","last_clean":"2023-11-15T01:36:21.593547+0000","last_became_active":"2023-11-15T01:36:21.183490+0000","last_became_peered":"2023-11-15T01:36:21.183490+0000","last_unstale":"2023-11-15T01:36:21.593547+0000","last_undegraded":"2023-11-15T01:36:21.593547+0000","last_fullsized":"2023-11-15T01:36:21.593547+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596191+0000","last_change":"2023-11-15T01:36:21.590665+0000","last_active":"2023-11-15T01:36:21.596191+0000","last_peered":"2023-11-15T01:36:21.596191+0000","last_clean":"2023-11-15T01:36:21.596191+0000","last_became_active":"2023-11-15T01:36:21.590412+0000","last_became_peered":"2023-11-15T01:36:21.590412+0000","last_unstale":"2023-11-15T01:36:21.596191+0000","last_undegraded":"2023-11-15T01:36:21.596191+0000","last_fullsized":"2023-11-15T01:36:21.596191+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.569136+0000","last_change":"2023-11-15T01:36:21.191900+0000","last_active":"2023-11-15T01:36:21.569136+0000","last_peered":"2023-11-15T01:36:21.569136+0000","last_clean":"2023-11-15T01:36:21.569136+0000","last_became_active":"2023-11-15T01:36:21.191579+0000","last_became_peered":"2023-11-15T01:36:21.191579+0000","last_unstale":"2023-11-15T01:36:21.569136+0000","last_undegraded":"2023-11-15T01:36:21.569136+0000","last_fullsized":"2023-11-15T01:36:21.569136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596167+0000","last_change":"2023-11-15T01:36:21.590001+0000","last_active":"2023-11-15T01:36:21.596167+0000","last_peered":"2023-11-15T01:36:21.596167+0000","last_clean":"2023-11-15T01:36:21.596167+0000","last_became_active":"2023-11-15T01:36:21.589426+0000","last_became_peered":"2023-11-15T01:36:21.589426+0000","last_unstale":"2023-11-15T01:36:21.596167+0000","last_undegraded":"2023-11-15T01:36:21.596167+0000","last_fullsized":"2023-11-15T01:36:21.596167+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.569541+0000","last_change":"2023-11-15T01:36:21.192752+0000","last_active":"2023-11-15T01:36:21.569541+0000","last_peered":"2023-11-15T01:36:21.569541+0000","last_clean":"2023-11-15T01:36:21.569541+0000","last_became_active":"2023-11-15T01:36:21.192475+0000","last_became_peered":"2023-11-15T01:36:21.192475+0000","last_unstale":"2023-11-15T01:36:21.569541+0000","last_undegraded":"2023-11-15T01:36:21.569541+0000","last_fullsized":"2023-11-15T01:36:21.569541+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.590936+0000","last_change":"2023-11-15T01:36:21.586527+0000","last_active":"2023-11-15T01:36:21.590936+0000","last_peered":"2023-11-15T01:36:21.590936+0000","last_clean":"2023-11-15T01:36:21.590936+0000","last_became_active":"2023-11-15T01:36:21.586222+0000","last_became_peered":"2023-11-15T01:36:21.586222+0000","last_unstale":"2023-11-15T01:36:21.590936+0000","last_undegraded":"2023-11-15T01:36:21.590936+0000","last_fullsized":"2023-11-15T01:36:21.590936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593861+0000","last_change":"2023-11-15T01:36:21.193767+0000","last_active":"2023-11-15T01:36:21.593861+0000","last_peered":"2023-11-15T01:36:21.593861+0000","last_clean":"2023-11-15T01:36:21.593861+0000","last_became_active":"2023-11-15T01:36:21.192597+0000","last_became_peered":"2023-11-15T01:36:21.192597+0000","last_unstale":"2023-11-15T01:36:21.593861+0000","last_undegraded":"2023-11-15T01:36:21.593861+0000","last_fullsized":"2023-11-15T01:36:21.593861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.583061+0000","last_change":"2023-11-15T01:36:21.581594+0000","last_active":"2023-11-15T01:36:21.583061+0000","last_peered":"2023-11-15T01:36:21.583061+0000","last_clean":"2023-11-15T01:36:21.583061+0000","last_became_active":"2023-11-15T01:36:21.581298+0000","last_became_peered":"2023-11-15T01:36:21.581298+0000","last_unstale":"2023-11-15T01:36:21.583061+0000","last_undegraded":"2023-11-15T01:36:21.583061+0000","last_fullsized":"2023-11-15T01:36:21.583061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576657+0000","last_change":"2023-11-15T01:36:21.184696+0000","last_active":"2023-11-15T01:36:21.576657+0000","last_peered":"2023-11-15T01:36:21.576657+0000","last_clean":"2023-11-15T01:36:21.576657+0000","last_became_active":"2023-11-15T01:36:21.184418+0000","last_became_peered":"2023-11-15T01:36:21.184418+0000","last_unstale":"2023-11-15T01:36:21.576657+0000","last_undegraded":"2023-11-15T01:36:21.576657+0000","last_fullsized":"2023-11-15T01:36:21.576657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588407+0000","last_change":"2023-11-15T01:36:21.585820+0000","last_active":"2023-11-15T01:36:21.588407+0000","last_peered":"2023-11-15T01:36:21.588407+0000","last_clean":"2023-11-15T01:36:21.588407+0000","last_became_active":"2023-11-15T01:36:21.585529+0000","last_became_peered":"2023-11-15T01:36:21.585529+0000","last_unstale":"2023-11-15T01:36:21.588407+0000","last_undegraded":"2023-11-15T01:36:21.588407+0000","last_fullsized":"2023-11-15T01:36:21.588407+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.583795+0000","last_change":"2023-11-15T01:36:21.194729+0000","last_active":"2023-11-15T01:36:21.583795+0000","last_peered":"2023-11-15T01:36:21.583795+0000","last_clean":"2023-11-15T01:36:21.583795+0000","last_became_active":"2023-11-15T01:36:21.194456+0000","last_became_peered":"2023-11-15T01:36:21.194456+0000","last_unstale":"2023-11-15T01:36:21.583795+0000","last_undegraded":"2023-11-15T01:36:21.583795+0000","last_fullsized":"2023-11-15T01:36:21.583795+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.592438+0000","last_change":"2023-11-15T01:36:21.584707+0000","last_active":"2023-11-15T01:36:21.592438+0000","last_peered":"2023-11-15T01:36:21.592438+0000","last_clean":"2023-11-15T01:36:21.592438+0000","last_became_active":"2023-11-15T01:36:21.584054+0000","last_became_peered":"2023-11-15T01:36:21.584054+0000","last_unstale":"2023-11-15T01:36:21.592438+0000","last_undegraded":"2023-11-15T01:36:21.592438+0000","last_fullsized":"2023-11-15T01:36:21.592438+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.581436+0000","last_change":"2023-11-15T01:36:21.188671+0000","last_active":"2023-11-15T01:36:21.581436+0000","last_peered":"2023-11-15T01:36:21.581436+0000","last_clean":"2023-11-15T01:36:21.581436+0000","last_became_active":"2023-11-15T01:36:21.188375+0000","last_became_peered":"2023-11-15T01:36:21.188375+0000","last_unstale":"2023-11-15T01:36:21.581436+0000","last_undegraded":"2023-11-15T01:36:21.581436+0000","last_fullsized":"2023-11-15T01:36:21.581436+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.594465+0000","last_change":"2023-11-15T01:36:21.591728+0000","last_active":"2023-11-15T01:36:21.594465+0000","last_peered":"2023-11-15T01:36:21.594465+0000","last_clean":"2023-11-15T01:36:21.594465+0000","last_became_active":"2023-11-15T01:36:21.591439+0000","last_became_peered":"2023-11-15T01:36:21.591439+0000","last_unstale":"2023-11-15T01:36:21.594465+0000","last_undegraded":"2023-11-15T01:36:21.594465+0000","last_fullsized":"2023-11-15T01:36:21.594465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.573775+0000","last_change":"2023-11-15T01:36:21.182628+0000","last_active":"2023-11-15T01:36:21.573775+0000","last_peered":"2023-11-15T01:36:21.573775+0000","last_clean":"2023-11-15T01:36:21.573775+0000","last_became_active":"2023-11-15T01:36:21.182383+0000","last_became_peered":"2023-11-15T01:36:21.182383+0000","last_unstale":"2023-11-15T01:36:21.573775+0000","last_undegraded":"2023-11-15T01:36:21.573775+0000","last_fullsized":"2023-11-15T01:36:21.573775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596541+0000","last_change":"2023-11-15T01:36:21.594134+0000","last_active":"2023-11-15T01:36:21.596541+0000","last_peered":"2023-11-15T01:36:21.596541+0000","last_clean":"2023-11-15T01:36:21.596541+0000","last_became_active":"2023-11-15T01:36:21.593876+0000","last_became_peered":"2023-11-15T01:36:21.593876+0000","last_unstale":"2023-11-15T01:36:21.596541+0000","last_undegraded":"2023-11-15T01:36:21.596541+0000","last_fullsized":"2023-11-15T01:36:21.596541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.589574+0000","last_change":"2023-11-15T01:36:21.194631+0000","last_active":"2023-11-15T01:36:21.589574+0000","last_peered":"2023-11-15T01:36:21.589574+0000","last_clean":"2023-11-15T01:36:21.589574+0000","last_became_active":"2023-11-15T01:36:21.194305+0000","last_became_peered":"2023-11-15T01:36:21.194305+0000","last_unstale":"2023-11-15T01:36:21.589574+0000","last_undegraded":"2023-11-15T01:36:21.589574+0000","last_fullsized":"2023-11-15T01:36:21.589574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.589399+0000","last_change":"2023-11-15T01:36:21.588292+0000","last_active":"2023-11-15T01:36:21.589399+0000","last_peered":"2023-11-15T01:36:21.589399+0000","last_clean":"2023-11-15T01:36:21.589399+0000","last_became_active":"2023-11-15T01:36:21.588004+0000","last_became_peered":"2023-11-15T01:36:21.588004+0000","last_unstale":"2023-11-15T01:36:21.589399+0000","last_undegraded":"2023-11-15T01:36:21.589399+0000","last_fullsized":"2023-11-15T01:36:21.589399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.573498+0000","last_change":"2023-11-15T01:36:21.195997+0000","last_active":"2023-11-15T01:36:21.573498+0000","last_peered":"2023-11-15T01:36:21.573498+0000","last_clean":"2023-11-15T01:36:21.573498+0000","last_became_active":"2023-11-15T01:36:21.195526+0000","last_became_peered":"2023-11-15T01:36:21.195526+0000","last_unstale":"2023-11-15T01:36:21.573498+0000","last_undegraded":"2023-11-15T01:36:21.573498+0000","last_fullsized":"2023-11-15T01:36:21.573498+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.589790+0000","last_change":"2023-11-15T01:36:21.589087+0000","last_active":"2023-11-15T01:36:21.589790+0000","last_peered":"2023-11-15T01:36:21.589790+0000","last_clean":"2023-11-15T01:36:21.589790+0000","last_became_active":"2023-11-15T01:36:21.588824+0000","last_became_peered":"2023-11-15T01:36:21.588824+0000","last_unstale":"2023-11-15T01:36:21.589790+0000","last_undegraded":"2023-11-15T01:36:21.589790+0000","last_fullsized":"2023-11-15T01:36:21.589790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.577641+0000","last_change":"2023-11-15T01:36:21.199200+0000","last_active":"2023-11-15T01:36:21.577641+0000","last_peered":"2023-11-15T01:36:21.577641+0000","last_clean":"2023-11-15T01:36:21.577641+0000","last_became_active":"2023-11-15T01:36:21.198968+0000","last_became_peered":"2023-11-15T01:36:21.198968+0000","last_unstale":"2023-11-15T01:36:21.577641+0000","last_undegraded":"2023-11-15T01:36:21.577641+0000","last_fullsized":"2023-11-15T01:36:21.577641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588304+0000","last_change":"2023-11-15T01:36:21.585086+0000","last_active":"2023-11-15T01:36:21.588304+0000","last_peered":"2023-11-15T01:36:21.588304+0000","last_clean":"2023-11-15T01:36:21.588304+0000","last_became_active":"2023-11-15T01:36:21.584815+0000","last_became_peered":"2023-11-15T01:36:21.584815+0000","last_unstale":"2023-11-15T01:36:21.588304+0000","last_undegraded":"2023-11-15T01:36:21.588304+0000","last_fullsized":"2023-11-15T01:36:21.588304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.571036+0000","last_change":"2023-11-15T01:36:21.189088+0000","last_active":"2023-11-15T01:36:21.571036+0000","last_peered":"2023-11-15T01:36:21.571036+0000","last_clean":"2023-11-15T01:36:21.571036+0000","last_became_active":"2023-11-15T01:36:21.188753+0000","last_became_peered":"2023-11-15T01:36:21.188753+0000","last_unstale":"2023-11-15T01:36:21.571036+0000","last_undegraded":"2023-11-15T01:36:21.571036+0000","last_fullsized":"2023-11-15T01:36:21.571036+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.591689+0000","last_change":"2023-11-15T01:36:21.589043+0000","last_active":"2023-11-15T01:36:21.591689+0000","last_peered":"2023-11-15T01:36:21.591689+0000","last_clean":"2023-11-15T01:36:21.591689+0000","last_became_active":"2023-11-15T01:36:21.588768+0000","last_became_peered":"2023-11-15T01:36:21.588768+0000","last_unstale":"2023-11-15T01:36:21.591689+0000","last_undegraded":"2023-11-15T01:36:21.591689+0000","last_fullsized":"2023-11-15T01:36:21.591689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.569023+0000","last_change":"2023-11-15T01:36:21.191104+0000","last_active":"2023-11-15T01:36:21.569023+0000","last_peered":"2023-11-15T01:36:21.569023+0000","last_clean":"2023-11-15T01:36:21.569023+0000","last_became_active":"2023-11-15T01:36:21.190850+0000","last_became_peered":"2023-11-15T01:36:21.190850+0000","last_unstale":"2023-11-15T01:36:21.569023+0000","last_undegraded":"2023-11-15T01:36:21.569023+0000","last_fullsized":"2023-11-15T01:36:21.569023+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.592442+0000","last_change":"2023-11-15T01:36:21.585735+0000","last_active":"2023-11-15T01:36:21.592442+0000","last_peered":"2023-11-15T01:36:21.592442+0000","last_clean":"2023-11-15T01:36:21.592442+0000","last_became_active":"2023-11-15T01:36:21.585422+0000","last_became_peered":"2023-11-15T01:36:21.585422+0000","last_unstale":"2023-11-15T01:36:21.592442+0000","last_undegraded":"2023-11-15T01:36:21.592442+0000","last_fullsized":"2023-11-15T01:36:21.592442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.578901+0000","last_change":"2023-11-15T01:36:21.193558+0000","last_active":"2023-11-15T01:36:21.578901+0000","last_peered":"2023-11-15T01:36:21.578901+0000","last_clean":"2023-11-15T01:36:21.578901+0000","last_became_active":"2023-11-15T01:36:21.193221+0000","last_became_peered":"2023-11-15T01:36:21.193221+0000","last_unstale":"2023-11-15T01:36:21.578901+0000","last_undegraded":"2023-11-15T01:36:21.578901+0000","last_fullsized":"2023-11-15T01:36:21.578901+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.591007+0000","last_change":"2023-11-15T01:36:21.586649+0000","last_active":"2023-11-15T01:36:21.591007+0000","last_peered":"2023-11-15T01:36:21.591007+0000","last_clean":"2023-11-15T01:36:21.591007+0000","last_became_active":"2023-11-15T01:36:21.586016+0000","last_became_peered":"2023-11-15T01:36:21.586016+0000","last_unstale":"2023-11-15T01:36:21.591007+0000","last_undegraded":"2023-11-15T01:36:21.591007+0000","last_fullsized":"2023-11-15T01:36:21.591007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.575675+0000","last_change":"2023-11-15T01:36:21.193265+0000","last_active":"2023-11-15T01:36:21.575675+0000","last_peered":"2023-11-15T01:36:21.575675+0000","last_clean":"2023-11-15T01:36:21.575675+0000","last_became_active":"2023-11-15T01:36:21.192977+0000","last_became_peered":"2023-11-15T01:36:21.192977+0000","last_unstale":"2023-11-15T01:36:21.575675+0000","last_undegraded":"2023-11-15T01:36:21.575675+0000","last_fullsized":"2023-11-15T01:36:21.575675+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.595903+0000","last_change":"2023-11-15T01:36:21.588513+0000","last_active":"2023-11-15T01:36:21.595903+0000","last_peered":"2023-11-15T01:36:21.595903+0000","last_clean":"2023-11-15T01:36:21.595903+0000","last_became_active":"2023-11-15T01:36:21.588184+0000","last_became_peered":"2023-11-15T01:36:21.588184+0000","last_unstale":"2023-11-15T01:36:21.595903+0000","last_undegraded":"2023-11-15T01:36:21.595903+0000","last_fullsized":"2023-11-15T01:36:21.595903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.568587+0000","last_change":"2023-11-15T01:36:21.179701+0000","last_active":"2023-11-15T01:36:21.568587+0000","last_peered":"2023-11-15T01:36:21.568587+0000","last_clean":"2023-11-15T01:36:21.568587+0000","last_became_active":"2023-11-15T01:36:21.179412+0000","last_became_peered":"2023-11-15T01:36:21.179412+0000","last_unstale":"2023-11-15T01:36:21.568587+0000","last_undegraded":"2023-11-15T01:36:21.568587+0000","last_fullsized":"2023-11-15T01:36:21.568587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593344+0000","last_change":"2023-11-15T01:36:21.590787+0000","last_active":"2023-11-15T01:36:21.593344+0000","last_peered":"2023-11-15T01:36:21.593344+0000","last_clean":"2023-11-15T01:36:21.593344+0000","last_became_active":"2023-11-15T01:36:21.589847+0000","last_became_peered":"2023-11-15T01:36:21.589847+0000","last_unstale":"2023-11-15T01:36:21.593344+0000","last_undegraded":"2023-11-15T01:36:21.593344+0000","last_fullsized":"2023-11-15T01:36:21.593344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.573728+0000","last_change":"2023-11-15T01:36:21.194774+0000","last_active":"2023-11-15T01:36:21.573728+0000","last_peered":"2023-11-15T01:36:21.573728+0000","last_clean":"2023-11-15T01:36:21.573728+0000","last_became_active":"2023-11-15T01:36:21.194480+0000","last_became_peered":"2023-11-15T01:36:21.194480+0000","last_unstale":"2023-11-15T01:36:21.573728+0000","last_undegraded":"2023-11-15T01:36:21.573728+0000","last_fullsized":"2023-11-15T01:36:21.573728+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.592479+0000","last_change":"2023-11-15T01:36:21.585921+0000","last_active":"2023-11-15T01:36:21.592479+0000","last_peered":"2023-11-15T01:36:21.592479+0000","last_clean":"2023-11-15T01:36:21.592479+0000","last_became_active":"2023-11-15T01:36:21.585650+0000","last_became_peered":"2023-11-15T01:36:21.585650+0000","last_unstale":"2023-11-15T01:36:21.592479+0000","last_undegraded":"2023-11-15T01:36:21.592479+0000","last_fullsized":"2023-11-15T01:36:21.592479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.578276+0000","last_change":"2023-11-15T01:36:21.196469+0000","last_active":"2023-11-15T01:36:21.578276+0000","last_peered":"2023-11-15T01:36:21.578276+0000","last_clean":"2023-11-15T01:36:21.578276+0000","last_became_active":"2023-11-15T01:36:21.196183+0000","last_became_peered":"2023-11-15T01:36:21.196183+0000","last_unstale":"2023-11-15T01:36:21.578276+0000","last_undegraded":"2023-11-15T01:36:21.578276+0000","last_fullsized":"2023-11-15T01:36:21.578276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596409+0000","last_change":"2023-11-15T01:36:21.590906+0000","last_active":"2023-11-15T01:36:21.596409+0000","last_peered":"2023-11-15T01:36:21.596409+0000","last_clean":"2023-11-15T01:36:21.596409+0000","last_became_active":"2023-11-15T01:36:21.590606+0000","last_became_peered":"2023-11-15T01:36:21.590606+0000","last_unstale":"2023-11-15T01:36:21.596409+0000","last_undegraded":"2023-11-15T01:36:21.596409+0000","last_fullsized":"2023-11-15T01:36:21.596409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.568006+0000","last_change":"2023-11-15T01:36:21.191248+0000","last_active":"2023-11-15T01:36:21.568006+0000","last_peered":"2023-11-15T01:36:21.568006+0000","last_clean":"2023-11-15T01:36:21.568006+0000","last_became_active":"2023-11-15T01:36:21.190942+0000","last_became_peered":"2023-11-15T01:36:21.190942+0000","last_unstale":"2023-11-15T01:36:21.568006+0000","last_undegraded":"2023-11-15T01:36:21.568006+0000","last_fullsized":"2023-11-15T01:36:21.568006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596332+0000","last_change":"2023-11-15T01:36:21.592379+0000","last_active":"2023-11-15T01:36:21.596332+0000","last_peered":"2023-11-15T01:36:21.596332+0000","last_clean":"2023-11-15T01:36:21.596332+0000","last_became_active":"2023-11-15T01:36:21.592112+0000","last_became_peered":"2023-11-15T01:36:21.592112+0000","last_unstale":"2023-11-15T01:36:21.596332+0000","last_undegraded":"2023-11-15T01:36:21.596332+0000","last_fullsized":"2023-11-15T01:36:21.596332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576369+0000","last_change":"2023-11-15T01:36:21.188207+0000","last_active":"2023-11-15T01:36:21.576369+0000","last_peered":"2023-11-15T01:36:21.576369+0000","last_clean":"2023-11-15T01:36:21.576369+0000","last_became_active":"2023-11-15T01:36:21.187789+0000","last_became_peered":"2023-11-15T01:36:21.187789+0000","last_unstale":"2023-11-15T01:36:21.576369+0000","last_undegraded":"2023-11-15T01:36:21.576369+0000","last_fullsized":"2023-11-15T01:36:21.576369+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588638+0000","last_change":"2023-11-15T01:36:21.581906+0000","last_active":"2023-11-15T01:36:21.588638+0000","last_peered":"2023-11-15T01:36:21.588638+0000","last_clean":"2023-11-15T01:36:21.588638+0000","last_became_active":"2023-11-15T01:36:21.581585+0000","last_became_peered":"2023-11-15T01:36:21.581585+0000","last_unstale":"2023-11-15T01:36:21.588638+0000","last_undegraded":"2023-11-15T01:36:21.588638+0000","last_fullsized":"2023-11-15T01:36:21.588638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.591143+0000","last_change":"2023-11-15T01:36:21.196191+0000","last_active":"2023-11-15T01:36:21.591143+0000","last_peered":"2023-11-15T01:36:21.591143+0000","last_clean":"2023-11-15T01:36:21.591143+0000","last_became_active":"2023-11-15T01:36:21.195772+0000","last_became_peered":"2023-11-15T01:36:21.195772+0000","last_unstale":"2023-11-15T01:36:21.591143+0000","last_undegraded":"2023-11-15T01:36:21.591143+0000","last_fullsized":"2023-11-15T01:36:21.591143+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.584884+0000","last_change":"2023-11-15T01:36:21.577758+0000","last_active":"2023-11-15T01:36:21.584884+0000","last_peered":"2023-11-15T01:36:21.584884+0000","last_clean":"2023-11-15T01:36:21.584884+0000","last_became_active":"2023-11-15T01:36:21.577428+0000","last_became_peered":"2023-11-15T01:36:21.577428+0000","last_unstale":"2023-11-15T01:36:21.584884+0000","last_undegraded":"2023-11-15T01:36:21.584884+0000","last_fullsized":"2023-11-15T01:36:21.584884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593419+0000","last_change":"2023-11-15T01:36:21.187500+0000","last_active":"2023-11-15T01:36:21.593419+0000","last_peered":"2023-11-15T01:36:21.593419+0000","last_clean":"2023-11-15T01:36:21.593419+0000","last_became_active":"2023-11-15T01:36:21.187195+0000","last_became_peered":"2023-11-15T01:36:21.187195+0000","last_unstale":"2023-11-15T01:36:21.593419+0000","last_undegraded":"2023-11-15T01:36:21.593419+0000","last_fullsized":"2023-11-15T01:36:21.593419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593353+0000","last_change":"2023-11-15T01:36:21.589588+0000","last_active":"2023-11-15T01:36:21.593353+0000","last_peered":"2023-11-15T01:36:21.593353+0000","last_clean":"2023-11-15T01:36:21.593353+0000","last_became_active":"2023-11-15T01:36:21.588906+0000","last_became_peered":"2023-11-15T01:36:21.588906+0000","last_unstale":"2023-11-15T01:36:21.593353+0000","last_undegraded":"2023-11-15T01:36:21.593353+0000","last_fullsized":"2023-11-15T01:36:21.593353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.591533+0000","last_change":"2023-11-15T01:36:21.189825+0000","last_active":"2023-11-15T01:36:21.591533+0000","last_peered":"2023-11-15T01:36:21.591533+0000","last_clean":"2023-11-15T01:36:21.591533+0000","last_became_active":"2023-11-15T01:36:21.189532+0000","last_became_peered":"2023-11-15T01:36:21.189532+0000","last_unstale":"2023-11-15T01:36:21.591533+0000","last_undegraded":"2023-11-15T01:36:21.591533+0000","last_fullsized":"2023-11-15T01:36:21.591533+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596111+0000","last_change":"2023-11-15T01:36:21.589815+0000","last_active":"2023-11-15T01:36:21.596111+0000","last_peered":"2023-11-15T01:36:21.596111+0000","last_clean":"2023-11-15T01:36:21.596111+0000","last_became_active":"2023-11-15T01:36:21.589479+0000","last_became_peered":"2023-11-15T01:36:21.589479+0000","last_unstale":"2023-11-15T01:36:21.596111+0000","last_undegraded":"2023-11-15T01:36:21.596111+0000","last_fullsized":"2023-11-15T01:36:21.596111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.575643+0000","last_change":"2023-11-15T01:36:21.189557+0000","last_active":"2023-11-15T01:36:21.575643+0000","last_peered":"2023-11-15T01:36:21.575643+0000","last_clean":"2023-11-15T01:36:21.575643+0000","last_became_active":"2023-11-15T01:36:21.189024+0000","last_became_peered":"2023-11-15T01:36:21.189024+0000","last_unstale":"2023-11-15T01:36:21.575643+0000","last_undegraded":"2023-11-15T01:36:21.575643+0000","last_fullsized":"2023-11-15T01:36:21.575643+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.584889+0000","last_change":"2023-11-15T01:36:21.583940+0000","last_active":"2023-11-15T01:36:21.584889+0000","last_peered":"2023-11-15T01:36:21.584889+0000","last_clean":"2023-11-15T01:36:21.584889+0000","last_became_active":"2023-11-15T01:36:21.581369+0000","last_became_peered":"2023-11-15T01:36:21.581369+0000","last_unstale":"2023-11-15T01:36:21.584889+0000","last_undegraded":"2023-11-15T01:36:21.584889+0000","last_fullsized":"2023-11-15T01:36:21.584889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.573715+0000","last_change":"2023-11-15T01:36:21.187848+0000","last_active":"2023-11-15T01:36:21.573715+0000","last_peered":"2023-11-15T01:36:21.573715+0000","last_clean":"2023-11-15T01:36:21.573715+0000","last_became_active":"2023-11-15T01:36:21.187570+0000","last_became_peered":"2023-11-15T01:36:21.187570+0000","last_unstale":"2023-11-15T01:36:21.573715+0000","last_undegraded":"2023-11-15T01:36:21.573715+0000","last_fullsized":"2023-11-15T01:36:21.573715+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.587453+0000","last_change":"2023-11-15T01:36:21.585829+0000","last_active":"2023-11-15T01:36:21.587453+0000","last_peered":"2023-11-15T01:36:21.587453+0000","last_clean":"2023-11-15T01:36:21.587453+0000","last_became_active":"2023-11-15T01:36:21.585515+0000","last_became_peered":"2023-11-15T01:36:21.585515+0000","last_unstale":"2023-11-15T01:36:21.587453+0000","last_undegraded":"2023-11-15T01:36:21.587453+0000","last_fullsized":"2023-11-15T01:36:21.587453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.572304+0000","last_change":"2023-11-15T01:36:21.195820+0000","last_active":"2023-11-15T01:36:21.572304+0000","last_peered":"2023-11-15T01:36:21.572304+0000","last_clean":"2023-11-15T01:36:21.572304+0000","last_became_active":"2023-11-15T01:36:21.195149+0000","last_became_peered":"2023-11-15T01:36:21.195149+0000","last_unstale":"2023-11-15T01:36:21.572304+0000","last_undegraded":"2023-11-15T01:36:21.572304+0000","last_fullsized":"2023-11-15T01:36:21.572304+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588776+0000","last_change":"2023-11-15T01:36:21.586810+0000","last_active":"2023-11-15T01:36:21.588776+0000","last_peered":"2023-11-15T01:36:21.588776+0000","last_clean":"2023-11-15T01:36:21.588776+0000","last_became_active":"2023-11-15T01:36:21.586537+0000","last_became_peered":"2023-11-15T01:36:21.586537+0000","last_unstale":"2023-11-15T01:36:21.588776+0000","last_undegraded":"2023-11-15T01:36:21.588776+0000","last_fullsized":"2023-11-15T01:36:21.588776+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.572582+0000","last_change":"2023-11-15T01:36:21.183827+0000","last_active":"2023-11-15T01:36:21.572582+0000","last_peered":"2023-11-15T01:36:21.572582+0000","last_clean":"2023-11-15T01:36:21.572582+0000","last_became_active":"2023-11-15T01:36:21.183532+0000","last_became_peered":"2023-11-15T01:36:21.183532+0000","last_unstale":"2023-11-15T01:36:21.572582+0000","last_undegraded":"2023-11-15T01:36:21.572582+0000","last_fullsized":"2023-11-15T01:36:21.572582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.587043+0000","last_change":"2023-11-15T01:36:21.586055+0000","last_active":"2023-11-15T01:36:21.587043+0000","last_peered":"2023-11-15T01:36:21.587043+0000","last_clean":"2023-11-15T01:36:21.587043+0000","last_became_active":"2023-11-15T01:36:21.585801+0000","last_became_peered":"2023-11-15T01:36:21.585801+0000","last_unstale":"2023-11-15T01:36:21.587043+0000","last_undegraded":"2023-11-15T01:36:21.587043+0000","last_fullsized":"2023-11-15T01:36:21.587043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.571142+0000","last_change":"2023-11-15T01:36:21.190487+0000","last_active":"2023-11-15T01:36:21.571142+0000","last_peered":"2023-11-15T01:36:21.571142+0000","last_clean":"2023-11-15T01:36:21.571142+0000","last_became_active":"2023-11-15T01:36:21.190206+0000","last_became_peered":"2023-11-15T01:36:21.190206+0000","last_unstale":"2023-11-15T01:36:21.571142+0000","last_undegraded":"2023-11-15T01:36:21.571142+0000","last_fullsized":"2023-11-15T01:36:21.571142+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588067+0000","last_change":"2023-11-15T01:36:21.586184+0000","last_active":"2023-11-15T01:36:21.588067+0000","last_peered":"2023-11-15T01:36:21.588067+0000","last_clean":"2023-11-15T01:36:21.588067+0000","last_became_active":"2023-11-15T01:36:21.585922+0000","last_became_peered":"2023-11-15T01:36:21.585922+0000","last_unstale":"2023-11-15T01:36:21.588067+0000","last_undegraded":"2023-11-15T01:36:21.588067+0000","last_fullsized":"2023-11-15T01:36:21.588067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.579974+0000","last_change":"2023-11-15T01:36:21.195408+0000","last_active":"2023-11-15T01:36:21.579974+0000","last_peered":"2023-11-15T01:36:21.579974+0000","last_clean":"2023-11-15T01:36:21.579974+0000","last_became_active":"2023-11-15T01:36:21.195062+0000","last_became_peered":"2023-11-15T01:36:21.195062+0000","last_unstale":"2023-11-15T01:36:21.579974+0000","last_undegraded":"2023-11-15T01:36:21.579974+0000","last_fullsized":"2023-11-15T01:36:21.579974+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.584127+0000","last_change":"2023-11-15T01:36:21.583281+0000","last_active":"2023-11-15T01:36:21.584127+0000","last_peered":"2023-11-15T01:36:21.584127+0000","last_clean":"2023-11-15T01:36:21.584127+0000","last_became_active":"2023-11-15T01:36:21.582985+0000","last_became_peered":"2023-11-15T01:36:21.582985+0000","last_unstale":"2023-11-15T01:36:21.584127+0000","last_undegraded":"2023-11-15T01:36:21.584127+0000","last_fullsized":"2023-11-15T01:36:21.584127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.570422+0000","last_change":"2023-11-15T01:36:21.193011+0000","last_active":"2023-11-15T01:36:21.570422+0000","last_peered":"2023-11-15T01:36:21.570422+0000","last_clean":"2023-11-15T01:36:21.570422+0000","last_became_active":"2023-11-15T01:36:21.192717+0000","last_became_peered":"2023-11-15T01:36:21.192717+0000","last_unstale":"2023-11-15T01:36:21.570422+0000","last_undegraded":"2023-11-15T01:36:21.570422+0000","last_fullsized":"2023-11-15T01:36:21.570422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588608+0000","last_change":"2023-11-15T01:36:21.585080+0000","last_active":"2023-11-15T01:36:21.588608+0000","last_peered":"2023-11-15T01:36:21.588608+0000","last_clean":"2023-11-15T01:36:21.588608+0000","last_became_active":"2023-11-15T01:36:21.584792+0000","last_became_peered":"2023-11-15T01:36:21.584792+0000","last_unstale":"2023-11-15T01:36:21.588608+0000","last_undegraded":"2023-11-15T01:36:21.588608+0000","last_fullsized":"2023-11-15T01:36:21.588608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"78'3","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.589599+0000","last_change":"2023-11-15T01:36:21.197175+0000","last_active":"2023-11-15T01:36:21.589599+0000","last_peered":"2023-11-15T01:36:21.589599+0000","last_clean":"2023-11-15T01:36:21.589599+0000","last_became_active":"2023-11-15T01:36:21.196944+0000","last_became_peered":"2023-11-15T01:36:21.196944+0000","last_unstale":"2023-11-15T01:36:21.589599+0000","last_undegraded":"2023-11-15T01:36:21.589599+0000","last_fullsized":"2023-11-15T01:36:21.589599+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.590806+0000","last_change":"2023-11-15T01:36:21.582353+0000","last_active":"2023-11-15T01:36:21.590806+0000","last_peered":"2023-11-15T01:36:21.590806+0000","last_clean":"2023-11-15T01:36:21.590806+0000","last_became_active":"2023-11-15T01:36:21.582026+0000","last_became_peered":"2023-11-15T01:36:21.582026+0000","last_unstale":"2023-11-15T01:36:21.590806+0000","last_undegraded":"2023-11-15T01:36:21.590806+0000","last_fullsized":"2023-11-15T01:36:21.590806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593012+0000","last_change":"2023-11-15T01:36:21.197131+0000","last_active":"2023-11-15T01:36:21.593012+0000","last_peered":"2023-11-15T01:36:21.593012+0000","last_clean":"2023-11-15T01:36:21.593012+0000","last_became_active":"2023-11-15T01:36:21.196857+0000","last_became_peered":"2023-11-15T01:36:21.196857+0000","last_unstale":"2023-11-15T01:36:21.593012+0000","last_undegraded":"2023-11-15T01:36:21.593012+0000","last_fullsized":"2023-11-15T01:36:21.593012+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593106+0000","last_change":"2023-11-15T01:36:21.588966+0000","last_active":"2023-11-15T01:36:21.593106+0000","last_peered":"2023-11-15T01:36:21.593106+0000","last_clean":"2023-11-15T01:36:21.593106+0000","last_became_active":"2023-11-15T01:36:21.588693+0000","last_became_peered":"2023-11-15T01:36:21.588693+0000","last_unstale":"2023-11-15T01:36:21.593106+0000","last_undegraded":"2023-11-15T01:36:21.593106+0000","last_fullsized":"2023-11-15T01:36:21.593106+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.589786+0000","last_change":"2023-11-15T01:36:21.193355+0000","last_active":"2023-11-15T01:36:21.589786+0000","last_peered":"2023-11-15T01:36:21.589786+0000","last_clean":"2023-11-15T01:36:21.589786+0000","last_became_active":"2023-11-15T01:36:21.193060+0000","last_became_peered":"2023-11-15T01:36:21.193060+0000","last_unstale":"2023-11-15T01:36:21.589786+0000","last_undegraded":"2023-11-15T01:36:21.589786+0000","last_fullsized":"2023-11-15T01:36:21.589786+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.584597+0000","last_change":"2023-11-15T01:36:21.580996+0000","last_active":"2023-11-15T01:36:21.584597+0000","last_peered":"2023-11-15T01:36:21.584597+0000","last_clean":"2023-11-15T01:36:21.584597+0000","last_became_active":"2023-11-15T01:36:21.580636+0000","last_became_peered":"2023-11-15T01:36:21.580636+0000","last_unstale":"2023-11-15T01:36:21.584597+0000","last_undegraded":"2023-11-15T01:36:21.584597+0000","last_fullsized":"2023-11-15T01:36:21.584597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576091+0000","last_change":"2023-11-15T01:36:21.189747+0000","last_active":"2023-11-15T01:36:21.576091+0000","last_peered":"2023-11-15T01:36:21.576091+0000","last_clean":"2023-11-15T01:36:21.576091+0000","last_became_active":"2023-11-15T01:36:21.189275+0000","last_became_peered":"2023-11-15T01:36:21.189275+0000","last_unstale":"2023-11-15T01:36:21.576091+0000","last_undegraded":"2023-11-15T01:36:21.576091+0000","last_fullsized":"2023-11-15T01:36:21.576091+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588752+0000","last_change":"2023-11-15T01:36:21.582970+0000","last_active":"2023-11-15T01:36:21.588752+0000","last_peered":"2023-11-15T01:36:21.588752+0000","last_clean":"2023-11-15T01:36:21.588752+0000","last_became_active":"2023-11-15T01:36:21.582546+0000","last_became_peered":"2023-11-15T01:36:21.582546+0000","last_unstale":"2023-11-15T01:36:21.588752+0000","last_undegraded":"2023-11-15T01:36:21.588752+0000","last_fullsized":"2023-11-15T01:36:21.588752+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.577746+0000","last_change":"2023-11-15T01:36:21.199293+0000","last_active":"2023-11-15T01:36:21.577746+0000","last_peered":"2023-11-15T01:36:21.577746+0000","last_clean":"2023-11-15T01:36:21.577746+0000","last_became_active":"2023-11-15T01:36:21.198988+0000","last_became_peered":"2023-11-15T01:36:21.198988+0000","last_unstale":"2023-11-15T01:36:21.577746+0000","last_undegraded":"2023-11-15T01:36:21.577746+0000","last_fullsized":"2023-11-15T01:36:21.577746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.591876+0000","last_change":"2023-11-15T01:36:21.591050+0000","last_active":"2023-11-15T01:36:21.591876+0000","last_peered":"2023-11-15T01:36:21.591876+0000","last_clean":"2023-11-15T01:36:21.591876+0000","last_became_active":"2023-11-15T01:36:21.590426+0000","last_became_peered":"2023-11-15T01:36:21.590426+0000","last_unstale":"2023-11-15T01:36:21.591876+0000","last_undegraded":"2023-11-15T01:36:21.591876+0000","last_fullsized":"2023-11-15T01:36:21.591876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.591986+0000","last_change":"2023-11-15T01:36:21.192463+0000","last_active":"2023-11-15T01:36:21.591986+0000","last_peered":"2023-11-15T01:36:21.591986+0000","last_clean":"2023-11-15T01:36:21.591986+0000","last_became_active":"2023-11-15T01:36:21.192145+0000","last_became_peered":"2023-11-15T01:36:21.192145+0000","last_unstale":"2023-11-15T01:36:21.591986+0000","last_undegraded":"2023-11-15T01:36:21.591986+0000","last_fullsized":"2023-11-15T01:36:21.591986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.594369+0000","last_change":"2023-11-15T01:36:21.593125+0000","last_active":"2023-11-15T01:36:21.594369+0000","last_peered":"2023-11-15T01:36:21.594369+0000","last_clean":"2023-11-15T01:36:21.594369+0000","last_became_active":"2023-11-15T01:36:21.592851+0000","last_became_peered":"2023-11-15T01:36:21.592851+0000","last_unstale":"2023-11-15T01:36:21.594369+0000","last_undegraded":"2023-11-15T01:36:21.594369+0000","last_fullsized":"2023-11-15T01:36:21.594369+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.590436+0000","last_change":"2023-11-15T01:36:21.186459+0000","last_active":"2023-11-15T01:36:21.590436+0000","last_peered":"2023-11-15T01:36:21.590436+0000","last_clean":"2023-11-15T01:36:21.590436+0000","last_became_active":"2023-11-15T01:36:21.186131+0000","last_became_peered":"2023-11-15T01:36:21.186131+0000","last_unstale":"2023-11-15T01:36:21.590436+0000","last_undegraded":"2023-11-15T01:36:21.590436+0000","last_fullsized":"2023-11-15T01:36:21.590436+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.584582+0000","last_change":"2023-11-15T01:36:21.579446+0000","last_active":"2023-11-15T01:36:21.584582+0000","last_peered":"2023-11-15T01:36:21.584582+0000","last_clean":"2023-11-15T01:36:21.584582+0000","last_became_active":"2023-11-15T01:36:21.575715+0000","last_became_peered":"2023-11-15T01:36:21.575715+0000","last_unstale":"2023-11-15T01:36:21.584582+0000","last_undegraded":"2023-11-15T01:36:21.584582+0000","last_fullsized":"2023-11-15T01:36:21.584582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.578999+0000","last_change":"2023-11-15T01:36:21.180234+0000","last_active":"2023-11-15T01:36:21.578999+0000","last_peered":"2023-11-15T01:36:21.578999+0000","last_clean":"2023-11-15T01:36:21.578999+0000","last_became_active":"2023-11-15T01:36:21.179966+0000","last_became_peered":"2023-11-15T01:36:21.179966+0000","last_unstale":"2023-11-15T01:36:21.578999+0000","last_undegraded":"2023-11-15T01:36:21.578999+0000","last_fullsized":"2023-11-15T01:36:21.578999+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.587537+0000","last_change":"2023-11-15T01:36:21.583753+0000","last_active":"2023-11-15T01:36:21.587537+0000","last_peered":"2023-11-15T01:36:21.587537+0000","last_clean":"2023-11-15T01:36:21.587537+0000","last_became_active":"2023-11-15T01:36:21.583352+0000","last_became_peered":"2023-11-15T01:36:21.583352+0000","last_unstale":"2023-11-15T01:36:21.587537+0000","last_undegraded":"2023-11-15T01:36:21.587537+0000","last_fullsized":"2023-11-15T01:36:21.587537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.575871+0000","last_change":"2023-11-15T01:36:21.186859+0000","last_active":"2023-11-15T01:36:21.575871+0000","last_peered":"2023-11-15T01:36:21.575871+0000","last_clean":"2023-11-15T01:36:21.575871+0000","last_became_active":"2023-11-15T01:36:21.186313+0000","last_became_peered":"2023-11-15T01:36:21.186313+0000","last_unstale":"2023-11-15T01:36:21.575871+0000","last_undegraded":"2023-11-15T01:36:21.575871+0000","last_fullsized":"2023-11-15T01:36:21.575871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588159+0000","last_change":"2023-11-15T01:36:21.582161+0000","last_active":"2023-11-15T01:36:21.588159+0000","last_peered":"2023-11-15T01:36:21.588159+0000","last_clean":"2023-11-15T01:36:21.588159+0000","last_became_active":"2023-11-15T01:36:21.581931+0000","last_became_peered":"2023-11-15T01:36:21.581931+0000","last_unstale":"2023-11-15T01:36:21.588159+0000","last_undegraded":"2023-11-15T01:36:21.588159+0000","last_fullsized":"2023-11-15T01:36:21.588159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.577040+0000","last_change":"2023-11-15T01:36:21.197725+0000","last_active":"2023-11-15T01:36:21.577040+0000","last_peered":"2023-11-15T01:36:21.577040+0000","last_clean":"2023-11-15T01:36:21.577040+0000","last_became_active":"2023-11-15T01:36:21.197036+0000","last_became_peered":"2023-11-15T01:36:21.197036+0000","last_unstale":"2023-11-15T01:36:21.577040+0000","last_undegraded":"2023-11-15T01:36:21.577040+0000","last_fullsized":"2023-11-15T01:36:21.577040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588448+0000","last_change":"2023-11-15T01:36:21.584509+0000","last_active":"2023-11-15T01:36:21.588448+0000","last_peered":"2023-11-15T01:36:21.588448+0000","last_clean":"2023-11-15T01:36:21.588448+0000","last_became_active":"2023-11-15T01:36:21.582942+0000","last_became_peered":"2023-11-15T01:36:21.582942+0000","last_unstale":"2023-11-15T01:36:21.588448+0000","last_undegraded":"2023-11-15T01:36:21.588448+0000","last_fullsized":"2023-11-15T01:36:21.588448+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.579880+0000","last_change":"2023-11-15T01:36:21.198137+0000","last_active":"2023-11-15T01:36:21.579880+0000","last_peered":"2023-11-15T01:36:21.579880+0000","last_clean":"2023-11-15T01:36:21.579880+0000","last_became_active":"2023-11-15T01:36:21.197914+0000","last_became_peered":"2023-11-15T01:36:21.197914+0000","last_unstale":"2023-11-15T01:36:21.579880+0000","last_undegraded":"2023-11-15T01:36:21.579880+0000","last_fullsized":"2023-11-15T01:36:21.579880+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593048+0000","last_change":"2023-11-15T01:36:21.588289+0000","last_active":"2023-11-15T01:36:21.593048+0000","last_peered":"2023-11-15T01:36:21.593048+0000","last_clean":"2023-11-15T01:36:21.593048+0000","last_became_active":"2023-11-15T01:36:21.588008+0000","last_became_peered":"2023-11-15T01:36:21.588008+0000","last_unstale":"2023-11-15T01:36:21.593048+0000","last_undegraded":"2023-11-15T01:36:21.593048+0000","last_fullsized":"2023-11-15T01:36:21.593048+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.573581+0000","last_change":"2023-11-15T01:36:21.191068+0000","last_active":"2023-11-15T01:36:21.573581+0000","last_peered":"2023-11-15T01:36:21.573581+0000","last_clean":"2023-11-15T01:36:21.573581+0000","last_became_active":"2023-11-15T01:36:21.190792+0000","last_became_peered":"2023-11-15T01:36:21.190792+0000","last_unstale":"2023-11-15T01:36:21.573581+0000","last_undegraded":"2023-11-15T01:36:21.573581+0000","last_fullsized":"2023-11-15T01:36:21.573581+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.587463+0000","last_change":"2023-11-15T01:36:21.585649+0000","last_active":"2023-11-15T01:36:21.587463+0000","last_peered":"2023-11-15T01:36:21.587463+0000","last_clean":"2023-11-15T01:36:21.587463+0000","last_became_active":"2023-11-15T01:36:21.585246+0000","last_became_peered":"2023-11-15T01:36:21.585246+0000","last_unstale":"2023-11-15T01:36:21.587463+0000","last_undegraded":"2023-11-15T01:36:21.587463+0000","last_fullsized":"2023-11-15T01:36:21.587463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.572664+0000","last_change":"2023-11-15T01:36:21.183301+0000","last_active":"2023-11-15T01:36:21.572664+0000","last_peered":"2023-11-15T01:36:21.572664+0000","last_clean":"2023-11-15T01:36:21.572664+0000","last_became_active":"2023-11-15T01:36:21.183025+0000","last_became_peered":"2023-11-15T01:36:21.183025+0000","last_unstale":"2023-11-15T01:36:21.572664+0000","last_undegraded":"2023-11-15T01:36:21.572664+0000","last_fullsized":"2023-11-15T01:36:21.572664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.585306+0000","last_change":"2023-11-15T01:36:21.584556+0000","last_active":"2023-11-15T01:36:21.585306+0000","last_peered":"2023-11-15T01:36:21.585306+0000","last_clean":"2023-11-15T01:36:21.585306+0000","last_became_active":"2023-11-15T01:36:21.584215+0000","last_became_peered":"2023-11-15T01:36:21.584215+0000","last_unstale":"2023-11-15T01:36:21.585306+0000","last_undegraded":"2023-11-15T01:36:21.585306+0000","last_fullsized":"2023-11-15T01:36:21.585306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576048+0000","last_change":"2023-11-15T01:36:21.190215+0000","last_active":"2023-11-15T01:36:21.576048+0000","last_peered":"2023-11-15T01:36:21.576048+0000","last_clean":"2023-11-15T01:36:21.576048+0000","last_became_active":"2023-11-15T01:36:21.189941+0000","last_became_peered":"2023-11-15T01:36:21.189941+0000","last_unstale":"2023-11-15T01:36:21.576048+0000","last_undegraded":"2023-11-15T01:36:21.576048+0000","last_fullsized":"2023-11-15T01:36:21.576048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.596278+0000","last_change":"2023-11-15T01:36:21.591596+0000","last_active":"2023-11-15T01:36:21.596278+0000","last_peered":"2023-11-15T01:36:21.596278+0000","last_clean":"2023-11-15T01:36:21.596278+0000","last_became_active":"2023-11-15T01:36:21.591273+0000","last_became_peered":"2023-11-15T01:36:21.591273+0000","last_unstale":"2023-11-15T01:36:21.596278+0000","last_undegraded":"2023-11-15T01:36:21.596278+0000","last_fullsized":"2023-11-15T01:36:21.596278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.584744+0000","last_change":"2023-11-15T01:36:21.192295+0000","last_active":"2023-11-15T01:36:21.584744+0000","last_peered":"2023-11-15T01:36:21.584744+0000","last_clean":"2023-11-15T01:36:21.584744+0000","last_became_active":"2023-11-15T01:36:21.192060+0000","last_became_peered":"2023-11-15T01:36:21.192060+0000","last_unstale":"2023-11-15T01:36:21.584744+0000","last_undegraded":"2023-11-15T01:36:21.584744+0000","last_fullsized":"2023-11-15T01:36:21.584744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576943+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:36:21.576943+0000","last_peered":"2023-11-15T01:36:21.576943+0000","last_clean":"2023-11-15T01:36:21.576943+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:36:21.576943+0000","last_undegraded":"2023-11-15T01:36:21.576943+0000","last_fullsized":"2023-11-15T01:36:21.576943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588732+0000","last_change":"2023-11-15T01:36:21.581777+0000","last_active":"2023-11-15T01:36:21.588732+0000","last_peered":"2023-11-15T01:36:21.588732+0000","last_clean":"2023-11-15T01:36:21.588732+0000","last_became_active":"2023-11-15T01:36:21.581444+0000","last_became_peered":"2023-11-15T01:36:21.581444+0000","last_unstale":"2023-11-15T01:36:21.588732+0000","last_undegraded":"2023-11-15T01:36:21.588732+0000","last_fullsized":"2023-11-15T01:36:21.588732+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.574565+0000","last_change":"2023-11-15T01:36:21.192478+0000","last_active":"2023-11-15T01:36:21.574565+0000","last_peered":"2023-11-15T01:36:21.574565+0000","last_clean":"2023-11-15T01:36:21.574565+0000","last_became_active":"2023-11-15T01:36:21.192184+0000","last_became_peered":"2023-11-15T01:36:21.192184+0000","last_unstale":"2023-11-15T01:36:21.574565+0000","last_undegraded":"2023-11-15T01:36:21.574565+0000","last_fullsized":"2023-11-15T01:36:21.574565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576269+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:36:21.576269+0000","last_peered":"2023-11-15T01:36:21.576269+0000","last_clean":"2023-11-15T01:36:21.576269+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:36:21.576269+0000","last_undegraded":"2023-11-15T01:36:21.576269+0000","last_fullsized":"2023-11-15T01:36:21.576269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588467+0000","last_change":"2023-11-15T01:36:21.586123+0000","last_active":"2023-11-15T01:36:21.588467+0000","last_peered":"2023-11-15T01:36:21.588467+0000","last_clean":"2023-11-15T01:36:21.588467+0000","last_became_active":"2023-11-15T01:36:21.585800+0000","last_became_peered":"2023-11-15T01:36:21.585800+0000","last_unstale":"2023-11-15T01:36:21.588467+0000","last_undegraded":"2023-11-15T01:36:21.588467+0000","last_fullsized":"2023-11-15T01:36:21.588467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576190+0000","last_change":"2023-11-15T01:36:21.189558+0000","last_active":"2023-11-15T01:36:21.576190+0000","last_peered":"2023-11-15T01:36:21.576190+0000","last_clean":"2023-11-15T01:36:21.576190+0000","last_became_active":"2023-11-15T01:36:21.188934+0000","last_became_peered":"2023-11-15T01:36:21.188934+0000","last_unstale":"2023-11-15T01:36:21.576190+0000","last_undegraded":"2023-11-15T01:36:21.576190+0000","last_fullsized":"2023-11-15T01:36:21.576190+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.568087+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:36:21.568087+0000","last_peered":"2023-11-15T01:36:21.568087+0000","last_clean":"2023-11-15T01:36:21.568087+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:36:21.568087+0000","last_undegraded":"2023-11-15T01:36:21.568087+0000","last_fullsized":"2023-11-15T01:36:21.568087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588109+0000","last_change":"2023-11-15T01:36:21.581736+0000","last_active":"2023-11-15T01:36:21.588109+0000","last_peered":"2023-11-15T01:36:21.588109+0000","last_clean":"2023-11-15T01:36:21.588109+0000","last_became_active":"2023-11-15T01:36:21.581413+0000","last_became_peered":"2023-11-15T01:36:21.581413+0000","last_unstale":"2023-11-15T01:36:21.588109+0000","last_undegraded":"2023-11-15T01:36:21.588109+0000","last_fullsized":"2023-11-15T01:36:21.588109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.570716+0000","last_change":"2023-11-15T01:36:21.190496+0000","last_active":"2023-11-15T01:36:21.570716+0000","last_peered":"2023-11-15T01:36:21.570716+0000","last_clean":"2023-11-15T01:36:21.570716+0000","last_became_active":"2023-11-15T01:36:21.190114+0000","last_became_peered":"2023-11-15T01:36:21.190114+0000","last_unstale":"2023-11-15T01:36:21.570716+0000","last_undegraded":"2023-11-15T01:36:21.570716+0000","last_fullsized":"2023-11-15T01:36:21.570716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576384+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:36:21.576384+0000","last_peered":"2023-11-15T01:36:21.576384+0000","last_clean":"2023-11-15T01:36:21.576384+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:36:21.576384+0000","last_undegraded":"2023-11-15T01:36:21.576384+0000","last_fullsized":"2023-11-15T01:36:21.576384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.583124+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:36:21.583124+0000","last_peered":"2023-11-15T01:36:21.583124+0000","last_clean":"2023-11-15T01:36:21.583124+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:36:21.583124+0000","last_undegraded":"2023-11-15T01:36:21.583124+0000","last_fullsized":"2023-11-15T01:36:21.583124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593323+0000","last_change":"2023-11-15T01:36:21.590631+0000","last_active":"2023-11-15T01:36:21.593323+0000","last_peered":"2023-11-15T01:36:21.593323+0000","last_clean":"2023-11-15T01:36:21.593323+0000","last_became_active":"2023-11-15T01:36:21.589440+0000","last_became_peered":"2023-11-15T01:36:21.589440+0000","last_unstale":"2023-11-15T01:36:21.593323+0000","last_undegraded":"2023-11-15T01:36:21.593323+0000","last_fullsized":"2023-11-15T01:36:21.593323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.592052+0000","last_change":"2023-11-15T01:36:21.194817+0000","last_active":"2023-11-15T01:36:21.592052+0000","last_peered":"2023-11-15T01:36:21.592052+0000","last_clean":"2023-11-15T01:36:21.592052+0000","last_became_active":"2023-11-15T01:36:21.193564+0000","last_became_peered":"2023-11-15T01:36:21.193564+0000","last_unstale":"2023-11-15T01:36:21.592052+0000","last_undegraded":"2023-11-15T01:36:21.592052+0000","last_fullsized":"2023-11-15T01:36:21.592052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.583213+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:36:21.583213+0000","last_peered":"2023-11-15T01:36:21.583213+0000","last_clean":"2023-11-15T01:36:21.583213+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:36:21.583213+0000","last_undegraded":"2023-11-15T01:36:21.583213+0000","last_fullsized":"2023-11-15T01:36:21.583213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.579399+0000","last_change":"2023-11-15T01:36:21.576052+0000","last_active":"2023-11-15T01:36:21.579399+0000","last_peered":"2023-11-15T01:36:21.579399+0000","last_clean":"2023-11-15T01:36:21.579399+0000","last_became_active":"2023-11-15T01:36:21.575768+0000","last_became_peered":"2023-11-15T01:36:21.575768+0000","last_unstale":"2023-11-15T01:36:21.579399+0000","last_undegraded":"2023-11-15T01:36:21.579399+0000","last_fullsized":"2023-11-15T01:36:21.579399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.593514+0000","last_change":"2023-11-15T01:36:21.196469+0000","last_active":"2023-11-15T01:36:21.593514+0000","last_peered":"2023-11-15T01:36:21.593514+0000","last_clean":"2023-11-15T01:36:21.593514+0000","last_became_active":"2023-11-15T01:36:21.196211+0000","last_became_peered":"2023-11-15T01:36:21.196211+0000","last_unstale":"2023-11-15T01:36:21.593514+0000","last_undegraded":"2023-11-15T01:36:21.593514+0000","last_fullsized":"2023-11-15T01:36:21.593514+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.580170+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:36:21.580170+0000","last_peered":"2023-11-15T01:36:21.580170+0000","last_clean":"2023-11-15T01:36:21.580170+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:36:21.580170+0000","last_undegraded":"2023-11-15T01:36:21.580170+0000","last_fullsized":"2023-11-15T01:36:21.580170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.584803+0000","last_change":"2023-11-15T01:36:21.575267+0000","last_active":"2023-11-15T01:36:21.584803+0000","last_peered":"2023-11-15T01:36:21.584803+0000","last_clean":"2023-11-15T01:36:21.584803+0000","last_became_active":"2023-11-15T01:36:21.574952+0000","last_became_peered":"2023-11-15T01:36:21.574952+0000","last_unstale":"2023-11-15T01:36:21.584803+0000","last_undegraded":"2023-11-15T01:36:21.584803+0000","last_fullsized":"2023-11-15T01:36:21.584803+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.579910+0000","last_change":"2023-11-15T01:36:21.198294+0000","last_active":"2023-11-15T01:36:21.579910+0000","last_peered":"2023-11-15T01:36:21.579910+0000","last_clean":"2023-11-15T01:36:21.579910+0000","last_became_active":"2023-11-15T01:36:21.198002+0000","last_became_peered":"2023-11-15T01:36:21.198002+0000","last_unstale":"2023-11-15T01:36:21.579910+0000","last_undegraded":"2023-11-15T01:36:21.579910+0000","last_fullsized":"2023-11-15T01:36:21.579910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.576733+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:36:21.576733+0000","last_peered":"2023-11-15T01:36:21.576733+0000","last_clean":"2023-11-15T01:36:21.576733+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:36:21.576733+0000","last_undegraded":"2023-11-15T01:36:21.576733+0000","last_fullsized":"2023-11-15T01:36:21.576733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.588190+0000","last_change":"2023-11-15T01:36:21.582715+0000","last_active":"2023-11-15T01:36:21.588190+0000","last_peered":"2023-11-15T01:36:21.588190+0000","last_clean":"2023-11-15T01:36:21.588190+0000","last_became_active":"2023-11-15T01:36:21.582418+0000","last_became_peered":"2023-11-15T01:36:21.582418+0000","last_unstale":"2023-11-15T01:36:21.588190+0000","last_undegraded":"2023-11-15T01:36:21.588190+0000","last_fullsized":"2023-11-15T01:36:21.588190+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:21.165110+0000","last_clean_scrub_stamp":"2023-11-15T01:36:21.165110+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.573871+0000","last_change":"2023-11-15T01:36:21.194150+0000","last_active":"2023-11-15T01:36:21.573871+0000","last_peered":"2023-11-15T01:36:21.573871+0000","last_clean":"2023-11-15T01:36:21.573871+0000","last_became_active":"2023-11-15T01:36:21.193042+0000","last_became_peered":"2023-11-15T01:36:21.193042+0000","last_unstale":"2023-11-15T01:36:21.573871+0000","last_undegraded":"2023-11-15T01:36:21.573871+0000","last_fullsized":"2023-11-15T01:36:21.573871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:20.159658+0000","last_clean_scrub_stamp":"2023-11-15T01:36:20.159658+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-15T01:36:21.571043+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:36:21.571043+0000","last_peered":"2023-11-15T01:36:21.571043+0000","last_clean":"2023-11-15T01:36:21.571043+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:36:21.571043+0000","last_undegraded":"2023-11-15T01:36:21.571043+0000","last_fullsized":"2023-11-15T01:36:21.571043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575026,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302136,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069704,"statfs":{"total":96636764160,"available":96327376896,"internally_reserved":0,"allocated":966656,"data_stored":480430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.34799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70299999999999996,"5min":0.71199999999999997,"15min":0.82299999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.41699999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.83299999999999996},"last":0.67900000000000005}]},{"osd":1,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72099999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.40400000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.81499999999999995},"last":0.58599999999999997}]},{"osd":2,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.39500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73799999999999999,"5min":0.77800000000000002,"15min":0.82599999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.46100000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.86299999999999999},"last":0.629}]},{"osd":3,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.47299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.73399999999999999,"5min":0.80700000000000005,"15min":0.85999999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.501,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79000000000000004,"5min":0.79700000000000004,"15min":0.81200000000000006},"last":0.56599999999999995}]},{"osd":4,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45300000000000001,"15min":0.46600000000000003},"min":{"1min":0.31,"5min":0.247,"15min":0.247},"max":{"1min":0.624,"5min":0.69999999999999996,"15min":0.84499999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.40400000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.83799999999999997},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47499999999999998,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.77500000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.497,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.78500000000000003},"last":0.64000000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.38400000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.752,"5min":0.755,"15min":0.85099999999999998},"last":0.73999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575027,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302128,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069712,"statfs":{"total":96636764160,"available":96327385088,"internally_reserved":0,"allocated":958464,"data_stored":479448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.29199999999999998},"max":{"1min":0.74299999999999999,"5min":0.83499999999999996,"15min":0.94299999999999995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.312},"max":{"1min":0.74199999999999999,"5min":0.89000000000000001,"15min":0.97799999999999998},"last":0.38100000000000001}]},{"osd":1,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32200000000000001},"max":{"1min":0.71199999999999997,"5min":0.79000000000000004,"15min":1.0649999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56799999999999995,"15min":0.55900000000000005},"min":{"1min":0.38700000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78800000000000003,"5min":0.84699999999999998,"15min":1.022},"last":0.53300000000000003}]},{"osd":2,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.69599999999999995,"5min":0.79100000000000004,"15min":1.038},"last":0.374},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.38600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77300000000000002,"5min":0.81799999999999995,"15min":0.995},"last":0.443}]},{"osd":3,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.379,"5min":0.307,"15min":0.307},"max":{"1min":0.753,"5min":0.91300000000000003,"15min":1.028},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.48999999999999999,"5min":0.41699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80500000000000005,"5min":0.874,"15min":1.004},"last":0.43099999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45400000000000001,"15min":0.45200000000000001},"min":{"1min":0.308,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.39800000000000002,"5min":0.33100000000000002,"15min":0.25800000000000001},"max":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.81799999999999995},"last":0.48299999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.315,"15min":0.312},"max":{"1min":0.625,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.40500000000000003,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.76900000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.50600000000000001,"15min":0.503},"min":{"1min":0.33200000000000002,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":0.72099999999999997,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.41399999999999998,"15min":0.34000000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.0009999999999999},"last":0.46800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575028,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302128,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069712,"statfs":{"total":96636764160,"available":96327385088,"internally_reserved":0,"allocated":958464,"data_stored":473042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.373,"15min":0.375},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.23999999999999999},"max":{"1min":0.56599999999999995,"5min":0.73699999999999999,"15min":0.77800000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.39600000000000002},"min":{"1min":0.29399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.61199999999999999,"5min":0.65900000000000003,"15min":0.73099999999999998},"last":0.28699999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.38600000000000001,"15min":0.38800000000000001},"min":{"1min":0.28999999999999998,"5min":0.26900000000000002,"15min":0.22600000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.69599999999999995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.432,"15min":0.437},"min":{"1min":0.34300000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64800000000000002,"5min":0.69299999999999995,"15min":0.90000000000000002},"last":0.30399999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.49099999999999999},"min":{"1min":0.44800000000000001,"5min":0.35199999999999998,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":1.0009999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.46800000000000003},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.28000000000000003},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.75600000000000001},"last":0.33200000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.41599999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.439,"5min":0.433,"15min":0.42299999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.0509999999999999},"last":0.41999999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.38},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.45200000000000001,"5min":0.40400000000000003,"15min":0.373},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.42799999999999999}]},{"osd":6,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.52200000000000002,"5min":0.441,"15min":0.42799999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42699999999999999,"5min":0.41999999999999998,"15min":0.41199999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.996},"last":0.51500000000000001}]},{"osd":7,"last update":"Wed Nov 15 01:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.54500000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.25},"last":0.505},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.46100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575026,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302112,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069728,"statfs":{"total":96636764160,"available":96327401472,"internally_reserved":0,"allocated":942080,"data_stored":472286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38,"15min":0.37},"min":{"1min":0.28499999999999998,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51100000000000001,"5min":2.024,"15min":2.024},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.438,"15min":0.41499999999999998},"min":{"1min":0.32800000000000001,"5min":0.252,"15min":0.215},"max":{"1min":0.60099999999999998,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.312}]},{"osd":2,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.40500000000000003,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.54200000000000004,"5min":1.768,"15min":1.768},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.35799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61699999999999999,"5min":1.982,"15min":1.982},"last":0.36399999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.433},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.22500000000000001},"max":{"1min":0.63100000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46500000000000002,"15min":0.45400000000000001},"min":{"1min":0.33300000000000002,"5min":0.28100000000000003,"15min":0.27700000000000002},"max":{"1min":0.66700000000000004,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.34699999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42199999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80500000000000005,"5min":0.97799999999999998,"15min":1.454},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.65500000000000003},"min":{"1min":0.55500000000000005,"5min":0.45900000000000002,"15min":0.442},"max":{"1min":0.78800000000000003,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.61199999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82399999999999995,"5min":1.881,"15min":1.881},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.46100000000000002,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.86599999999999999,"5min":0.91400000000000003,"15min":1.1120000000000001},"last":0.55000000000000004}]},{"osd":6,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.46800000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83399999999999996,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52600000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.874,"5min":1.917,"15min":1.917},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70099999999999996,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.91300000000000003,"5min":1.843,"15min":1.843},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68500000000000005,"15min":0.69399999999999995},"min":{"1min":0.54100000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90600000000000003,"5min":0.95299999999999996,"15min":1.4119999999999999},"last":0.64600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575027,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306228,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065612,"statfs":{"total":96636764160,"available":96323186688,"internally_reserved":0,"allocated":962560,"data_stored":480038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36799999999999999},"min":{"1min":0.27800000000000002,"5min":0.23999999999999999,"15min":0.221},"max":{"1min":0.50600000000000001,"5min":0.56100000000000005,"15min":0.61899999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.40500000000000003,"15min":0.40300000000000002},"min":{"1min":0.31900000000000001,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.63900000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.33100000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.378,"15min":0.38},"min":{"1min":0.29399999999999998,"5min":0.24399999999999999,"15min":0.222},"max":{"1min":0.55600000000000005,"5min":0.70999999999999996,"15min":0.75},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.44700000000000001,"15min":0.442},"min":{"1min":0.32300000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63900000000000001,"5min":0.73499999999999999,"15min":0.92000000000000004},"last":0.40899999999999997}]},{"osd":3,"last update":"Wed Nov 15 01:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.314,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.66200000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.44800000000000001,"15min":0.439},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.253},"max":{"1min":0.59199999999999997,"5min":0.66700000000000004,"15min":0.74199999999999999},"last":0.42399999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.47099999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0800000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.40899999999999997,"15min":0.39200000000000002},"max":{"1min":0.91100000000000003,"5min":0.95399999999999996,"15min":1.052},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed Nov 15 01:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.63800000000000001,"15min":0.64900000000000002},"min":{"1min":0.497,"5min":0.375,"15min":0.375},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.627,"15min":0.64200000000000002},"min":{"1min":0.54400000000000004,"5min":0.316,"15min":0.316},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.1339999999999999},"last":0.55600000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65100000000000002,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66600000000000004,"15min":0.67600000000000005},"min":{"1min":0.53800000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.119},"last":0.47099999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.51700000000000002,"5min":0.45100000000000001,"15min":0.438},"max":{"1min":1.079,"5min":1.079,"15min":1.103},"last":0.44},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.69399999999999995},"min":{"1min":0.57499999999999996,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.97899999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.51200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575028,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306228,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065612,"statfs":{"total":96636764160,"available":96323186688,"internally_reserved":0,"allocated":962560,"data_stored":480038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.374,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.22600000000000001},"max":{"1min":0.53400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.311},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.23200000000000001},"max":{"1min":0.60699999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.32300000000000001}]},{"osd":1,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":0.56599999999999995,"5min":0.64700000000000002,"15min":0.72899999999999998},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.29199999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72499999999999998,"5min":0.747,"15min":0.80500000000000005},"last":0.373}]},{"osd":2,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44500000000000001,"15min":0.44600000000000001},"min":{"1min":0.33700000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.69199999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.34599999999999997}]},{"osd":4,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.39000000000000001},"max":{"1min":0.89200000000000002,"5min":1.0169999999999999,"15min":1.0589999999999999},"last":0.434}]},{"osd":5,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.436,"5min":0.377,"15min":0.377},"max":{"1min":0.92000000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.501},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.45500000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82999999999999996,"5min":0.90100000000000002,"15min":0.95999999999999996},"last":0.41899999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64000000000000001,"15min":0.65000000000000002},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84899999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.67600000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95799999999999996,"5min":1.0900000000000001,"15min":1.169},"last":0.46899999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.65600000000000003,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0429999999999999,"5min":1.071,"15min":1.071},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.69299999999999995},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.996,"5min":1.1319999999999999,"15min":1.1459999999999999},"last":0.47699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575026,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302132,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069708,"statfs":{"total":96636764160,"available":96327380992,"internally_reserved":0,"allocated":962560,"data_stored":480058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.751,"5min":0.88,"15min":0.88},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55000000000000004}]},{"osd":1,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.30499999999999999},"max":{"1min":0.81499999999999995,"5min":1.087,"15min":1.087},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.46100000000000002,"5min":0.35499999999999998,"15min":0.34699999999999998},"max":{"1min":0.74399999999999999,"5min":0.80200000000000005,"15min":0.81000000000000005},"last":0.60499999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.47799999999999998,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":0.77300000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.42899999999999999,"5min":0.34699999999999998,"15min":0.33100000000000002},"max":{"1min":0.78300000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56399999999999995}]},{"osd":3,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.46700000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75700000000000001,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45800000000000002,"15min":0.47099999999999997},"min":{"1min":0.34100000000000003,"5min":0.30499999999999999,"15min":0.30399999999999999},"max":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":0.80600000000000005},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47699999999999998,"15min":0.49399999999999999},"min":{"1min":0.378,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65400000000000003,"5min":0.752,"15min":0.85299999999999998},"last":0.59399999999999997}]},{"osd":6,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48199999999999998,"15min":0.498},"min":{"1min":0.38300000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78500000000000003,"5min":0.79000000000000004,"15min":0.84199999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.33700000000000002,"15min":0.33500000000000002},"max":{"1min":0.82999999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.626}]},{"osd":7,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.53000000000000003},"min":{"1min":0.41799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.873},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77600000000000002,"5min":0.78400000000000003,"15min":0.90100000000000002},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575026,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302132,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069708,"statfs":{"total":96636764160,"available":96327380992,"internally_reserved":0,"allocated":962560,"data_stored":480328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.42299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45900000000000002,"5min":0.375,"15min":0.36199999999999999},"max":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.81200000000000006},"last":0.78600000000000003}]},{"osd":1,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71499999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.497,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.67400000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.70199999999999996}]},{"osd":2,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.34899999999999998,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.86199999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.44,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.75800000000000001,"5min":0.77700000000000002,"15min":1.103},"last":0.72699999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.46500000000000002,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.59499999999999997},"min":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71999999999999997,"5min":0.80700000000000005,"15min":1.127},"last":0.86899999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42799999999999999,"15min":0.45900000000000002},"min":{"1min":0.30299999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.94399999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.50800000000000001,"15min":0.52800000000000002},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.65600000000000003,"5min":0.71599999999999997,"15min":0.80900000000000005},"last":0.88300000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.46100000000000002,"15min":0.48099999999999998},"min":{"1min":0.33700000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64800000000000002,"5min":0.83099999999999996,"15min":1.0660000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.46400000000000002,"15min":0.499},"min":{"1min":0.33700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.70599999999999996,"5min":0.751,"15min":0.76600000000000001},"last":0.81200000000000006}]},{"osd":7,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47699999999999998,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.97199999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55800000000000005,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.71799999999999997,"5min":0.85799999999999998,"15min":1.1499999999999999},"last":0.82399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:36:26.225 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-15T01:36:26.225 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-15T01:36:26.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.382+0000 7f6ee7f24700 1 Processor -- start 2023-11-15T01:36:26.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.383+0000 7f6ee7f24700 1 -- start start 2023-11-15T01:36:26.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.383+0000 7f6ee7f24700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6ee0137030 0x7f6ee0137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.383+0000 7f6ee7f24700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6ee01588e0 0x7f6ee0066870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.383+0000 7f6ee7f24700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee00671b0 con 0x7f6ee0066d60 2023-11-15T01:36:26.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.383+0000 7f6ee7f24700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee0137900 con 0x7f6ee01588e0 2023-11-15T01:36:26.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.383+0000 7f6ee7f24700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee0158d90 con 0x7f6ee0137030 2023-11-15T01:36:26.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.384+0000 7f6ee64c1700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6ee0066d60 0x7f6ee014e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39092/0 (socket says 172.21.15.1:39092) 2023-11-15T01:36:26.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.384+0000 7f6ee64c1700 1 -- 172.21.15.1:0/3874958745 learned_addr learned my addr 172.21.15.1:0/3874958745 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:26.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.384+0000 7f6ee54bf700 1 --2- 172.21.15.1:0/3874958745 >> v2:172.21.15.1:3300/0 conn(0x7f6ee01588e0 0x7f6ee0066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.384+0000 7f6ee5cc0700 1 --2- 172.21.15.1:0/3874958745 >> v2:172.21.15.141:3300/0 conn(0x7f6ee0137030 0x7f6ee0137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.384+0000 7f6ee4cbe700 1 -- 172.21.15.1:0/3874958745 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057324946 0 0) 0x7f6ee00671b0 con 0x7f6ee0066d60 2023-11-15T01:36:26.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.384+0000 7f6ee4cbe700 1 -- 172.21.15.1:0/3874958745 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ec80033f0 con 0x7f6ee0066d60 2023-11-15T01:36:26.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.384+0000 7f6ee54bf700 1 -- 172.21.15.1:0/3874958745 >> v2:172.21.15.141:3300/0 conn(0x7f6ee0137030 msgr2=0x7f6ee0137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:26.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.384+0000 7f6ee54bf700 1 --2- 172.21.15.1:0/3874958745 >> v2:172.21.15.141:3300/0 conn(0x7f6ee0137030 0x7f6ee0137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.384+0000 7f6ee54bf700 1 -- 172.21.15.1:0/3874958745 >> v1:172.21.15.1:6789/0 conn(0x7f6ee0066d60 legacy=0x7f6ee014e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.384+0000 7f6ee54bf700 1 -- 172.21.15.1:0/3874958745 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee0154ce0 con 0x7f6ee01588e0 2023-11-15T01:36:26.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.384+0000 7f6ee54bf700 1 --2- 172.21.15.1:0/3874958745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee01588e0 0x7f6ee0066870 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f6ee0063690 tx=0x7f6ed4009060).ready entity=mon.0 client_cookie=afec6eb1d6ffd719 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:26.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.384+0000 7f6ee4cbe700 1 -- 172.21.15.1:0/3874958745 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400f510 con 0x7f6ee01588e0 2023-11-15T01:36:26.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.384+0000 7f6ee4cbe700 1 -- 172.21.15.1:0/3874958745 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed400f670 con 0x7f6ee01588e0 2023-11-15T01:36:26.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.384+0000 7f6ee4cbe700 1 -- 172.21.15.1:0/3874958745 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400f9f0 con 0x7f6ee01588e0 2023-11-15T01:36:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.385+0000 7f6ee7f24700 1 -- 172.21.15.1:0/3874958745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee01588e0 msgr2=0x7f6ee0066870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.385+0000 7f6ee7f24700 1 --2- 172.21.15.1:0/3874958745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee01588e0 0x7f6ee0066870 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f6ee0063690 tx=0x7f6ed4009060).stop 2023-11-15T01:36:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.385+0000 7f6ee7f24700 1 -- 172.21.15.1:0/3874958745 shutdown_connections 2023-11-15T01:36:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.385+0000 7f6ee7f24700 1 --2- 172.21.15.1:0/3874958745 >> v2:172.21.15.141:3300/0 conn(0x7f6ee0137030 0x7f6ee0137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.385+0000 7f6ee7f24700 1 --2- 172.21.15.1:0/3874958745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee01588e0 0x7f6ee0066870 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.385+0000 7f6ee7f24700 1 -- 172.21.15.1:0/3874958745 >> 172.21.15.1:0/3874958745 conn(0x7f6ee0063280 msgr2=0x7f6ee00c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:26.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.385+0000 7f6ee7f24700 1 -- 172.21.15.1:0/3874958745 shutdown_connections 2023-11-15T01:36:26.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.385+0000 7f6ee7f24700 1 -- 172.21.15.1:0/3874958745 wait complete. 2023-11-15T01:36:26.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.386+0000 7f6ee7f24700 1 Processor -- start 2023-11-15T01:36:26.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.386+0000 7f6ee7f24700 1 -- start start 2023-11-15T01:36:26.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee7f24700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee0066d60 0x7f6ee01657e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee7f24700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee0137030 0x7f6ee0156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee7f24700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee01588e0 0x7f6ee01571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee7f24700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee01576e0 con 0x7f6ee01588e0 2023-11-15T01:36:26.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee7f24700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee0165dc0 con 0x7f6ee0066d60 2023-11-15T01:36:26.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee7f24700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee01389a0 con 0x7f6ee0137030 2023-11-15T01:36:26.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee64c1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee01588e0 0x7f6ee01571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee64c1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee01588e0 0x7f6ee01571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49412/0 (socket says 172.21.15.1:49412) 2023-11-15T01:36:26.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee64c1700 1 -- 172.21.15.1:0/3739564959 learned_addr learned my addr 172.21.15.1:0/3739564959 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:26.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee5cc0700 1 --2- 172.21.15.1:0/3739564959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee0066d60 0x7f6ee01657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee54bf700 1 --2- 172.21.15.1:0/3739564959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee0137030 0x7f6ee0156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee64c1700 1 -- 172.21.15.1:0/3739564959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee0137030 msgr2=0x7f6ee0156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee64c1700 1 --2- 172.21.15.1:0/3739564959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee0137030 0x7f6ee0156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee64c1700 1 -- 172.21.15.1:0/3739564959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee0066d60 msgr2=0x7f6ee01657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee64c1700 1 --2- 172.21.15.1:0/3739564959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee0066d60 0x7f6ee01657e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee64c1700 1 -- 172.21.15.1:0/3739564959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed40092a0 con 0x7f6ee01588e0 2023-11-15T01:36:26.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee54bf700 1 --2- 172.21.15.1:0/3739564959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee0137030 0x7f6ee0156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:26.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6ee64c1700 1 --2- 172.21.15.1:0/3739564959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee01588e0 0x7f6ee01571f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f6ed0005ad0 tx=0x7f6ed00015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:26.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.387+0000 7f6eddffb700 1 -- 172.21.15.1:0/3739564959 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0005d30 con 0x7f6ee01588e0 2023-11-15T01:36:26.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.388+0000 7f6eddffb700 1 -- 172.21.15.1:0/3739564959 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed0005e90 con 0x7f6ee01588e0 2023-11-15T01:36:26.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.388+0000 7f6ee7f24700 1 -- 172.21.15.1:0/3739564959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee0138c80 con 0x7f6ee01588e0 2023-11-15T01:36:26.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.388+0000 7f6eddffb700 1 -- 172.21.15.1:0/3739564959 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0007320 con 0x7f6ee01588e0 2023-11-15T01:36:26.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.388+0000 7f6ee7f24700 1 -- 172.21.15.1:0/3739564959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee0139240 con 0x7f6ee01588e0 2023-11-15T01:36:26.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.389+0000 7f6ee7f24700 1 -- 172.21.15.1:0/3739564959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee0165f70 con 0x7f6ee01588e0 2023-11-15T01:36:26.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.389+0000 7f6eddffb700 1 -- 172.21.15.1:0/3739564959 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6ed0007710 con 0x7f6ee01588e0 2023-11-15T01:36:26.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.389+0000 7f6eddffb700 1 --2- 172.21.15.1:0/3739564959 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ecc05f270 0x7f6ecc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.389+0000 7f6eddffb700 1 -- 172.21.15.1:0/3739564959 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f6ed007a500 con 0x7f6ee01588e0 2023-11-15T01:36:26.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.390+0000 7f6ee5cc0700 1 --2- 172.21.15.1:0/3739564959 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ecc05f270 0x7f6ecc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.390+0000 7f6ee5cc0700 1 --2- 172.21.15.1:0/3739564959 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ecc05f270 0x7f6ecc061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6ed800bbc0 tx=0x7f6ed8008040).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:26.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.393+0000 7f6eddffb700 1 -- 172.21.15.1:0/3739564959 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6ee0165f70 con 0x7f6ee01588e0 2023-11-15T01:36:26.482 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-11-15T01:36:26.480+0000 7f2dd4a43700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T01:36:26.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.634+0000 7f6ee7f24700 1 -- 172.21.15.1:0/3739564959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6ee0165f70 con 0x7f6ee01588e0 2023-11-15T01:36:26.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.637+0000 7f6eddffb700 1 -- 172.21.15.1:0/3739564959 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6ee0165f70 con 0x7f6ee01588e0 2023-11-15T01:36:26.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.639+0000 7f6ee7f24700 1 -- 172.21.15.1:0/3739564959 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ecc05f270 msgr2=0x7f6ecc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.639+0000 7f6ee7f24700 1 --2- 172.21.15.1:0/3739564959 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ecc05f270 0x7f6ecc061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6ed800bbc0 tx=0x7f6ed8008040).stop 2023-11-15T01:36:26.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.639+0000 7f6ee7f24700 1 -- 172.21.15.1:0/3739564959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee01588e0 msgr2=0x7f6ee01571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.639+0000 7f6ee7f24700 1 --2- 172.21.15.1:0/3739564959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee01588e0 0x7f6ee01571f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f6ed0005ad0 tx=0x7f6ed00015b0).stop 2023-11-15T01:36:26.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.639+0000 7f6ee7f24700 1 -- 172.21.15.1:0/3739564959 shutdown_connections 2023-11-15T01:36:26.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.639+0000 7f6ee7f24700 1 --2- 172.21.15.1:0/3739564959 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ecc05f270 0x7f6ecc061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.639+0000 7f6ee7f24700 1 --2- 172.21.15.1:0/3739564959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee01588e0 0x7f6ee01571f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.639+0000 7f6ee7f24700 1 --2- 172.21.15.1:0/3739564959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee0066d60 0x7f6ee01657e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.639+0000 7f6ee7f24700 1 --2- 172.21.15.1:0/3739564959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee0137030 0x7f6ee0156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.639+0000 7f6ee7f24700 1 -- 172.21.15.1:0/3739564959 >> 172.21.15.1:0/3739564959 conn(0x7f6ee0063280 msgr2=0x7f6ee0151d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:26.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.639+0000 7f6ee7f24700 1 -- 172.21.15.1:0/3739564959 shutdown_connections 2023-11-15T01:36:26.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.639+0000 7f6ee7f24700 1 -- 172.21.15.1:0/3739564959 wait complete. 2023-11-15T01:36:26.643 INFO:teuthology.orchestra.run.smithi001.stderr:updated caps for client.0 2023-11-15T01:36:26.652 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:36:26.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.768+0000 7f302bb43700 1 Processor -- start 2023-11-15T01:36:26.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.769+0000 7f302bb43700 1 -- start start 2023-11-15T01:36:26.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.769+0000 7f302bb43700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3024154150 0x7f3024154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.769+0000 7f302bb43700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30240c06f0 con 0x7f30240aa060 2023-11-15T01:36:26.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.770+0000 7f302bb43700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30240c09d0 con 0x7f30240ab1a0 2023-11-15T01:36:26.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.770+0000 7f302bb43700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3024158820 con 0x7f3024154150 2023-11-15T01:36:26.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.770+0000 7f30298df700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3024154150 0x7f3024154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.770+0000 7f302a0e0700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f30240aa060 0x7f30240c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39094/0 (socket says 172.21.15.1:39094) 2023-11-15T01:36:26.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.770+0000 7f302a0e0700 1 -- 172.21.15.1:0/3430469395 learned_addr learned my addr 172.21.15.1:0/3430469395 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:26.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.770+0000 7f30298df700 1 -- 172.21.15.1:0/3430469395 >> v1:172.21.15.141:6789/0 conn(0x7f30240ab1a0 legacy=0x7f3024158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.770+0000 7f30298df700 1 -- 172.21.15.1:0/3430469395 >> v1:172.21.15.1:6789/0 conn(0x7f30240aa060 legacy=0x7f30240c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.770+0000 7f30288dd700 1 -- 172.21.15.1:0/3430469395 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875959597 0 0) 0x7f30240c06f0 con 0x7f30240aa060 2023-11-15T01:36:26.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.770+0000 7f30298df700 1 -- 172.21.15.1:0/3430469395 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3024158b00 con 0x7f3024154150 2023-11-15T01:36:26.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.770+0000 7f30298df700 1 --2- 172.21.15.1:0/3430469395 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3024154150 0x7f3024154530 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f301c009760 tx=0x7f301c009060).ready entity=mon.0 client_cookie=32b719445adc129f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:26.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.770+0000 7f30288dd700 1 -- 172.21.15.1:0/3430469395 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c009120 con 0x7f3024154150 2023-11-15T01:36:26.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.770+0000 7f30288dd700 1 -- 172.21.15.1:0/3430469395 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c00b580 con 0x7f3024154150 2023-11-15T01:36:26.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.770+0000 7f30288dd700 1 -- 172.21.15.1:0/3430469395 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c00b900 con 0x7f3024154150 2023-11-15T01:36:26.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.771+0000 7f302bb43700 1 -- 172.21.15.1:0/3430469395 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3024154150 msgr2=0x7f3024154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.771+0000 7f302bb43700 1 --2- 172.21.15.1:0/3430469395 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3024154150 0x7f3024154530 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f301c009760 tx=0x7f301c009060).stop 2023-11-15T01:36:26.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.771+0000 7f302bb43700 1 -- 172.21.15.1:0/3430469395 shutdown_connections 2023-11-15T01:36:26.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.771+0000 7f302bb43700 1 --2- 172.21.15.1:0/3430469395 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3024154150 0x7f3024154530 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.771+0000 7f302bb43700 1 -- 172.21.15.1:0/3430469395 >> 172.21.15.1:0/3430469395 conn(0x7f3024064aa0 msgr2=0x7f3024064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:26.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.771+0000 7f302bb43700 1 -- 172.21.15.1:0/3430469395 shutdown_connections 2023-11-15T01:36:26.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.771+0000 7f302bb43700 1 -- 172.21.15.1:0/3430469395 wait complete. 2023-11-15T01:36:26.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.772+0000 7f302bb43700 1 Processor -- start 2023-11-15T01:36:26.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.772+0000 7f302bb43700 1 -- start start 2023-11-15T01:36:26.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f302bb43700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30240aa060 0x7f3024144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f302bb43700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30240ab1a0 0x7f3024156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f302bb43700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3024154150 0x7f3024156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f302bb43700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3024156f30 con 0x7f30240ab1a0 2023-11-15T01:36:26.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f302bb43700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30240c24b0 con 0x7f3024154150 2023-11-15T01:36:26.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f302bb43700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30240aea10 con 0x7f30240aa060 2023-11-15T01:36:26.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f30290de700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30240ab1a0 0x7f3024156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f30290de700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30240ab1a0 0x7f3024156550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49434/0 (socket says 172.21.15.1:49434) 2023-11-15T01:36:26.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f30290de700 1 -- 172.21.15.1:0/446544892 learned_addr learned my addr 172.21.15.1:0/446544892 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:26.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f302a0e0700 1 --2- 172.21.15.1:0/446544892 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3024154150 0x7f3024156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f30298df700 1 --2- 172.21.15.1:0/446544892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30240aa060 0x7f3024144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f30290de700 1 -- 172.21.15.1:0/446544892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30240aa060 msgr2=0x7f3024144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f30290de700 1 --2- 172.21.15.1:0/446544892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30240aa060 0x7f3024144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f30290de700 1 -- 172.21.15.1:0/446544892 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3024154150 msgr2=0x7f3024156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:26.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f30290de700 1 --2- 172.21.15.1:0/446544892 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3024154150 0x7f3024156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:26.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f30290de700 1 -- 172.21.15.1:0/446544892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c0092a0 con 0x7f30240ab1a0 2023-11-15T01:36:26.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.773+0000 7f30290de700 1 --2- 172.21.15.1:0/446544892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30240ab1a0 0x7f3024156550 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f301800c4c0 tx=0x7f3018007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:26.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.774+0000 7f3021ffb700 1 -- 172.21.15.1:0/446544892 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301800ce70 con 0x7f30240ab1a0 2023-11-15T01:36:26.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.774+0000 7f3021ffb700 1 -- 172.21.15.1:0/446544892 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3018001e90 con 0x7f30240ab1a0 2023-11-15T01:36:26.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.774+0000 7f302bb43700 1 -- 172.21.15.1:0/446544892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3024155740 con 0x7f30240ab1a0 2023-11-15T01:36:26.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.774+0000 7f3021ffb700 1 -- 172.21.15.1:0/446544892 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3018007250 con 0x7f30240ab1a0 2023-11-15T01:36:26.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.774+0000 7f302bb43700 1 -- 172.21.15.1:0/446544892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3024155d00 con 0x7f30240ab1a0 2023-11-15T01:36:26.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.775+0000 7f302bb43700 1 -- 172.21.15.1:0/446544892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302406c7e0 con 0x7f30240ab1a0 2023-11-15T01:36:26.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.775+0000 7f3021ffb700 1 -- 172.21.15.1:0/446544892 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f30180066a0 con 0x7f30240ab1a0 2023-11-15T01:36:26.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.776+0000 7f3021ffb700 1 --2- 172.21.15.1:0/446544892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f301005f270 0x7f3010061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:26.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.776+0000 7f3021ffb700 1 -- 172.21.15.1:0/446544892 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f3018079e20 con 0x7f30240ab1a0 2023-11-15T01:36:26.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.776+0000 7f30298df700 1 --2- 172.21.15.1:0/446544892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f301005f270 0x7f3010061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:26.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.776+0000 7f30298df700 1 --2- 172.21.15.1:0/446544892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f301005f270 0x7f3010061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f301c00b340 tx=0x7f301c017000).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:26.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.780+0000 7f3021ffb700 1 -- 172.21.15.1:0/446544892 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f301804adc0 con 0x7f30240ab1a0 2023-11-15T01:36:26.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.998+0000 7f302bb43700 1 -- 172.21.15.1:0/446544892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30240c5a50 con 0x7f30240ab1a0 2023-11-15T01:36:27.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:26.999+0000 7f3021ffb700 1 -- 172.21.15.1:0/446544892 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4487 (secure 0 0 0) 0x7f301804e3e0 con 0x7f30240ab1a0 2023-11-15T01:36:27.000 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:27.000 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/246517652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":246517652},{"type":"v1","addr":"172.21.15.141:6836","nonce":246517652}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5857,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3341576602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3341576602},{"type":"v1","addr":"172.21.15.141:6837","nonce":3341576602}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2509339424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2509339424},{"type":"v1","addr":"172.21.15.1:6834","nonce":2509339424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:36:21.564233+0000","modified":"2023-11-15T01:36:24.818307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3051659352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3051659352},{"type":"v1","addr":"172.21.15.1:6835","nonce":3051659352}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-11-15T01:36:27.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.000+0000 7f302bb43700 1 -- 172.21.15.1:0/446544892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f301005f270 msgr2=0x7f3010061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.000+0000 7f302bb43700 1 --2- 172.21.15.1:0/446544892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f301005f270 0x7f3010061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f301c00b340 tx=0x7f301c017000).stop 2023-11-15T01:36:27.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.000+0000 7f302bb43700 1 -- 172.21.15.1:0/446544892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30240ab1a0 msgr2=0x7f3024156550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.000+0000 7f302bb43700 1 --2- 172.21.15.1:0/446544892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30240ab1a0 0x7f3024156550 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f301800c4c0 tx=0x7f3018007e00).stop 2023-11-15T01:36:27.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.000+0000 7f302bb43700 1 -- 172.21.15.1:0/446544892 shutdown_connections 2023-11-15T01:36:27.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.000+0000 7f302bb43700 1 --2- 172.21.15.1:0/446544892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f301005f270 0x7f3010061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.000+0000 7f302bb43700 1 --2- 172.21.15.1:0/446544892 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3024154150 0x7f3024156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.000+0000 7f302bb43700 1 --2- 172.21.15.1:0/446544892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30240aa060 0x7f3024144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.000+0000 7f302bb43700 1 --2- 172.21.15.1:0/446544892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30240ab1a0 0x7f3024156550 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.000+0000 7f302bb43700 1 -- 172.21.15.1:0/446544892 >> 172.21.15.1:0/446544892 conn(0x7f3024064aa0 msgr2=0x7f3024152de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:27.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.000+0000 7f302bb43700 1 -- 172.21.15.1:0/446544892 shutdown_connections 2023-11-15T01:36:27.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.000+0000 7f302bb43700 1 -- 172.21.15.1:0/446544892 wait complete. 2023-11-15T01:36:27.004 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 31 2023-11-15T01:36:27.416 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-15T01:36:21.564233+0000', 'modified': '2023-11-15T01:36:24.818307+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6285': {'gid': 6285, 'name': 'a', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.1:6835/3051659352', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6833', 'nonce': 3051659352}, {'type': 'v1', 'addr': '172.21.15.1:6835', 'nonce': 3051659352}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-15T01:36:27.416 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-15T01:36:27.417 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-15T01:36:27.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.538+0000 7f8822bb6700 1 Processor -- start 2023-11-15T01:36:27.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.539+0000 7f8822bb6700 1 -- start start 2023-11-15T01:36:27.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.539+0000 7f8822bb6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f881c0c6a30 0x7f881c1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.539+0000 7f8822bb6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f881c0c4f60 0x7f881c0bf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.539+0000 7f8822bb6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881c0bef30 con 0x7f881c152110 2023-11-15T01:36:27.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.539+0000 7f8822bb6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881c0a6330 con 0x7f881c0c4f60 2023-11-15T01:36:27.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.539+0000 7f8822bb6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c0c7f90 con 0x7f881c0c6a30 2023-11-15T01:36:27.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.539+0000 7f8820952700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f881c152110 0x7f881c0a5c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39098/0 (socket says 172.21.15.1:39098) 2023-11-15T01:36:27.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.540+0000 7f8820952700 1 -- 172.21.15.1:0/2100062034 learned_addr learned my addr 172.21.15.1:0/2100062034 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:27.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.540+0000 7f8821153700 1 --2- 172.21.15.1:0/2100062034 >> v2:172.21.15.141:3300/0 conn(0x7f881c0c4f60 0x7f881c0bf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.540+0000 7f881bfff700 1 --2- 172.21.15.1:0/2100062034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f881c0c6a30 0x7f881c1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.540+0000 7f881b7fe700 1 -- 172.21.15.1:0/2100062034 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660746543 0 0) 0x7f881c0bef30 con 0x7f881c152110 2023-11-15T01:36:27.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.540+0000 7f881b7fe700 1 -- 172.21.15.1:0/2100062034 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88080033f0 con 0x7f881c152110 2023-11-15T01:36:27.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.540+0000 7f881bfff700 1 -- 172.21.15.1:0/2100062034 >> v2:172.21.15.141:3300/0 conn(0x7f881c0c4f60 msgr2=0x7f881c0bf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:27.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.540+0000 7f881bfff700 1 --2- 172.21.15.1:0/2100062034 >> v2:172.21.15.141:3300/0 conn(0x7f881c0c4f60 0x7f881c0bf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.540+0000 7f881bfff700 1 -- 172.21.15.1:0/2100062034 >> v1:172.21.15.1:6789/0 conn(0x7f881c152110 legacy=0x7f881c0a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.540+0000 7f881b7fe700 1 -- 172.21.15.1:0/2100062034 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1970462080 0 0) 0x7f88080033f0 con 0x7f881c152110 2023-11-15T01:36:27.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.540+0000 7f881bfff700 1 -- 172.21.15.1:0/2100062034 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c0be8e0 con 0x7f881c0c6a30 2023-11-15T01:36:27.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.540+0000 7f881bfff700 1 --2- 172.21.15.1:0/2100062034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f881c0c6a30 0x7f881c1524f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f880c009760 tx=0x7f880c009060).ready entity=mon.2 client_cookie=8d16f77b0949d6d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:27.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.540+0000 7f881b7fe700 1 -- 172.21.15.1:0/2100062034 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140017f0 con 0x7f881c0c6a30 2023-11-15T01:36:27.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.540+0000 7f881b7fe700 1 -- 172.21.15.1:0/2100062034 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c011400 con 0x7f881c0c6a30 2023-11-15T01:36:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.540+0000 7f881b7fe700 1 -- 172.21.15.1:0/2100062034 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c011780 con 0x7f881c0c6a30 2023-11-15T01:36:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.541+0000 7f8822bb6700 1 -- 172.21.15.1:0/2100062034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f881c0c6a30 msgr2=0x7f881c1524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.541+0000 7f8822bb6700 1 --2- 172.21.15.1:0/2100062034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f881c0c6a30 0x7f881c1524f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f880c009760 tx=0x7f880c009060).stop 2023-11-15T01:36:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.541+0000 7f8822bb6700 1 -- 172.21.15.1:0/2100062034 shutdown_connections 2023-11-15T01:36:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.541+0000 7f8822bb6700 1 --2- 172.21.15.1:0/2100062034 >> v2:172.21.15.141:3300/0 conn(0x7f881c0c4f60 0x7f881c0bf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.541+0000 7f8822bb6700 1 --2- 172.21.15.1:0/2100062034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f881c0c6a30 0x7f881c1524f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.541+0000 7f8822bb6700 1 -- 172.21.15.1:0/2100062034 >> 172.21.15.1:0/2100062034 conn(0x7f881c082f90 msgr2=0x7f881c0c8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.541+0000 7f8822bb6700 1 -- 172.21.15.1:0/2100062034 shutdown_connections 2023-11-15T01:36:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.541+0000 7f8822bb6700 1 -- 172.21.15.1:0/2100062034 wait complete. 2023-11-15T01:36:27.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.542+0000 7f8822bb6700 1 Processor -- start 2023-11-15T01:36:27.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.542+0000 7f8822bb6700 1 -- start start 2023-11-15T01:36:27.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8822bb6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f881c0c4f60 0x7f881c0654b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8822bb6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f881c0c6a30 0x7f881c14ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8822bb6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f881c152110 0x7f881c163f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8822bb6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c14d1e0 con 0x7f881c0c4f60 2023-11-15T01:36:27.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8822bb6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c0638c0 con 0x7f881c0c6a30 2023-11-15T01:36:27.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8822bb6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c164770 con 0x7f881c152110 2023-11-15T01:36:27.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8820952700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f881c0c4f60 0x7f881c0654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8820952700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f881c0c4f60 0x7f881c0654b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49438/0 (socket says 172.21.15.1:49438) 2023-11-15T01:36:27.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8820952700 1 -- 172.21.15.1:0/3212736460 learned_addr learned my addr 172.21.15.1:0/3212736460 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:27.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8821153700 1 --2- 172.21.15.1:0/3212736460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f881c152110 0x7f881c163f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f881bfff700 1 --2- 172.21.15.1:0/3212736460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f881c0c6a30 0x7f881c14ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8820952700 1 -- 172.21.15.1:0/3212736460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f881c152110 msgr2=0x7f881c163f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8820952700 1 --2- 172.21.15.1:0/3212736460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f881c152110 0x7f881c163f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8820952700 1 -- 172.21.15.1:0/3212736460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f881c0c6a30 msgr2=0x7f881c14ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8820952700 1 --2- 172.21.15.1:0/3212736460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f881c0c6a30 0x7f881c14ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8820952700 1 -- 172.21.15.1:0/3212736460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c0092a0 con 0x7f881c0c4f60 2023-11-15T01:36:27.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.543+0000 7f8820952700 1 --2- 172.21.15.1:0/3212736460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f881c0c4f60 0x7f881c0654b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f881400cb10 tx=0x7f8814001e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:27.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.544+0000 7f8818ff9700 1 -- 172.21.15.1:0/3212736460 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8814004c40 con 0x7f881c0c4f60 2023-11-15T01:36:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.544+0000 7f8818ff9700 1 -- 172.21.15.1:0/3212736460 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8814004dc0 con 0x7f881c0c4f60 2023-11-15T01:36:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.544+0000 7f8822bb6700 1 -- 172.21.15.1:0/3212736460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c164a50 con 0x7f881c0c4f60 2023-11-15T01:36:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.544+0000 7f8818ff9700 1 -- 172.21.15.1:0/3212736460 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140073c0 con 0x7f881c0c4f60 2023-11-15T01:36:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.544+0000 7f8822bb6700 1 -- 172.21.15.1:0/3212736460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c063b10 con 0x7f881c0c4f60 2023-11-15T01:36:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.545+0000 7f8818ff9700 1 -- 172.21.15.1:0/3212736460 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8814007730 con 0x7f881c0c4f60 2023-11-15T01:36:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.545+0000 7f8818ff9700 1 --2- 172.21.15.1:0/3212736460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f87fc05f270 0x7f87fc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.545+0000 7f8818ff9700 1 -- 172.21.15.1:0/3212736460 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f881407a380 con 0x7f881c0c4f60 2023-11-15T01:36:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.546+0000 7f881bfff700 1 --2- 172.21.15.1:0/3212736460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f87fc05f270 0x7f87fc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.546+0000 7f881bfff700 1 --2- 172.21.15.1:0/3212736460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f87fc05f270 0x7f87fc061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f880c009760 tx=0x7f880c016000).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:27.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.547+0000 7f883454fb80 1 Processor -- start 2023-11-15T01:36:27.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.547+0000 7f883454fb80 1 -- start start 2023-11-15T01:36:27.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.548+0000 7f883454fb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563337dcbe40 0x563338037d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.548+0000 7f883454fb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563338058ea0 0x56333800f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.548+0000 7f883454fb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56333800fcb0 0x56333800a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.548+0000 7f883454fb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x563337fd5060 con 0x563338058ea0 2023-11-15T01:36:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.548+0000 7f883454fb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x563337f4c1f0 con 0x563337dcbe40 2023-11-15T01:36:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.548+0000 7f883454fb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x563337f61440 con 0x56333800fcb0 2023-11-15T01:36:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.548+0000 7f881bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563338058ea0 0x56333800f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.548+0000 7f881bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563338058ea0 0x56333800f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49440/0 (socket says 172.21.15.1:49440) 2023-11-15T01:36:27.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.548+0000 7f881bfff700 1 -- 172.21.15.1:0/20567360 learned_addr learned my addr 172.21.15.1:0/20567360 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:27.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.548+0000 7f8820952700 1 --2- 172.21.15.1:0/20567360 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563337dcbe40 0x563338037d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.548+0000 7f8821153700 1 --2- 172.21.15.1:0/20567360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56333800fcb0 0x56333800a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.549+0000 7f881bfff700 1 -- 172.21.15.1:0/20567360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56333800fcb0 msgr2=0x56333800a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.549+0000 7f881bfff700 1 --2- 172.21.15.1:0/20567360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56333800fcb0 0x56333800a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.549+0000 7f881bfff700 1 -- 172.21.15.1:0/20567360 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563337dcbe40 msgr2=0x563338037d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.549+0000 7f881bfff700 1 --2- 172.21.15.1:0/20567360 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563337dcbe40 0x563338037d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.549+0000 7f881bfff700 1 -- 172.21.15.1:0/20567360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563337f5a620 con 0x563338058ea0 2023-11-15T01:36:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.549+0000 7f881bfff700 1 --2- 172.21.15.1:0/20567360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563338058ea0 0x56333800f7c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f881c0c80d0 tx=0x7f880c020070).ready entity=mon.0 client_cookie=705dfb9412e93049 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:27.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.549+0000 7f8811ffb700 1 -- 172.21.15.1:0/20567360 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c01e410 con 0x563338058ea0 2023-11-15T01:36:27.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.549+0000 7f8811ffb700 1 -- 172.21.15.1:0/20567360 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c01e570 con 0x563338058ea0 2023-11-15T01:36:27.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.549+0000 7f8811ffb700 1 -- 172.21.15.1:0/20567360 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c01e910 con 0x563338058ea0 2023-11-15T01:36:27.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.549+0000 7f883454fb80 1 -- 172.21.15.1:0/20567360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563338058ea0 msgr2=0x56333800f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.549+0000 7f883454fb80 1 --2- 172.21.15.1:0/20567360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563338058ea0 0x56333800f7c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f881c0c80d0 tx=0x7f880c020070).stop 2023-11-15T01:36:27.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.550+0000 7f883454fb80 1 -- 172.21.15.1:0/20567360 shutdown_connections 2023-11-15T01:36:27.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.550+0000 7f883454fb80 1 --2- 172.21.15.1:0/20567360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56333800fcb0 0x56333800a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.550+0000 7f883454fb80 1 --2- 172.21.15.1:0/20567360 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563337dcbe40 0x563338037d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.550+0000 7f883454fb80 1 --2- 172.21.15.1:0/20567360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563338058ea0 0x56333800f7c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.550+0000 7f883454fb80 1 -- 172.21.15.1:0/20567360 >> 172.21.15.1:0/20567360 conn(0x563337e794a0 msgr2=0x563338058790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:27.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.550+0000 7f883454fb80 1 -- 172.21.15.1:0/20567360 shutdown_connections 2023-11-15T01:36:27.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.550+0000 7f883454fb80 1 -- 172.21.15.1:0/20567360 wait complete. 2023-11-15T01:36:27.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.550+0000 7f883454fb80 1 -- start start 2023-11-15T01:36:27.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.550+0000 7f883454fb80 1 Processor -- start 2023-11-15T01:36:27.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.551+0000 7f883454fb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563337dcbe40 0x563338063bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.551+0000 7f883454fb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x5633380640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.551+0000 7f883454fb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563338058ea0 0x56333803dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.551+0000 7f883454fb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x563337f61580 con 0x56333800fcb0 2023-11-15T01:36:27.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.551+0000 7f883454fb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x563337f61800 con 0x563337dcbe40 2023-11-15T01:36:27.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.551+0000 7f883454fb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x563337f2ce10 con 0x563338058ea0 2023-11-15T01:36:27.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.551+0000 7f883454fb80 10 client.0 ll_register_callbacks cb 0x563337fcf460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:36:27.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.551+0000 7f881bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x5633380640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.551+0000 7f881bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x5633380640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49454/0 (socket says 172.21.15.1:49454) 2023-11-15T01:36:27.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.551+0000 7f881bfff700 1 -- 172.21.15.1:0/288500745 learned_addr learned my addr 172.21.15.1:0/288500745 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:27.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.551+0000 7f8820952700 1 --2- 172.21.15.1:0/288500745 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563337dcbe40 0x563338063bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f8821153700 1 --2- 172.21.15.1:0/288500745 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563338058ea0 0x56333803dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f881bfff700 1 -- 172.21.15.1:0/288500745 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563338058ea0 msgr2=0x56333803dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:27.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f881bfff700 1 --2- 172.21.15.1:0/288500745 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563338058ea0 0x56333803dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f881bfff700 1 -- 172.21.15.1:0/288500745 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563337dcbe40 msgr2=0x563338063bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:27.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f881bfff700 1 --2- 172.21.15.1:0/288500745 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563337dcbe40 0x563338063bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f881bfff700 1 -- 172.21.15.1:0/288500745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c0be8e0 con 0x56333800fcb0 2023-11-15T01:36:27.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f881bfff700 1 --2- 172.21.15.1:0/288500745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x5633380640e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f880c009d50 tx=0x7f880c029000).ready entity=mon.0 client_cookie=85cc4a1036f5ed69 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:27.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f87faffd700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:36:27.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f87faffd700 1 -- 172.21.15.1:0/288500745 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c035030 con 0x56333800fcb0 2023-11-15T01:36:27.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f87faffd700 1 -- 172.21.15.1:0/288500745 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f880c036070 con 0x56333800fcb0 2023-11-15T01:36:27.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f883454fb80 1 -- 172.21.15.1:0/288500745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563338003720 con 0x56333800fcb0 2023-11-15T01:36:27.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f87faffd700 1 -- 172.21.15.1:0/288500745 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f880c031850 con 0x56333800fcb0 2023-11-15T01:36:27.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f883454fb80 10 client.6426 fetch_fsmap learned FSMap version 31 2023-11-15T01:36:27.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f883454fb80 1 -- 172.21.15.1:0/288500745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x563337f559c0 con 0x56333800fcb0 2023-11-15T01:36:27.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f87faffd700 1 -- 172.21.15.1:0/288500745 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563338003720 con 0x56333800fcb0 2023-11-15T01:36:27.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f87faffd700 1 -- 172.21.15.1:0/288500745 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f880c039d20 con 0x56333800fcb0 2023-11-15T01:36:27.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f883454fb80 10 client.6426 fetch_fsmap finished waiting for FSMap version 31 2023-11-15T01:36:27.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f883454fb80 10 client.6426 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-15T01:36:27.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f883454fb80 20 client.6426 populate_metadata read hostname 'smithi001' 2023-11-15T01:36:27.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f883454fb80 1 --2- 172.21.15.1:0/288500745 >> [v2:172.21.15.1:6833/3051659352,v1:172.21.15.1:6835/3051659352] conn(0x56333804fa50 0x56333804fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f883454fb80 4 client.6426 mds_command: new command op to 6285 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-15T01:36:27.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.552+0000 7f883454fb80 1 -- 172.21.15.1:0/288500745 --> [v2:172.21.15.1:6833/3051659352,v1:172.21.15.1:6835/3051659352] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563337dc7ca0 con 0x56333804fa50 2023-11-15T01:36:27.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.553+0000 7f8820952700 1 --2- 172.21.15.1:0/288500745 >> [v2:172.21.15.1:6833/3051659352,v1:172.21.15.1:6835/3051659352] conn(0x56333804fa50 0x56333804fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.553+0000 7f87faffd700 10 client.6426 ms_handle_connect on v2:172.21.15.1:6833/3051659352 2023-11-15T01:36:27.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.553+0000 7f8820952700 1 --2- 172.21.15.1:0/288500745 >> [v2:172.21.15.1:6833/3051659352,v1:172.21.15.1:6835/3051659352] conn(0x56333804fa50 0x56333804fe30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ded56f67a1b7e120 server_cookie=2765bd2ef338684c in_seq=0 out_seq=0 2023-11-15T01:36:27.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.553+0000 7f87faffd700 1 -- 172.21.15.1:0/288500745 <== mds.0 v2:172.21.15.1:6833/3051659352 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x563337dc7ca0 con 0x56333804fa50 2023-11-15T01:36:27.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.553+0000 7f87faffd700 10 client.6426 handle_command_reply: tid=0 2023-11-15T01:36:27.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.553+0000 7f883454fb80 1 client.6426 shutdown 2023-11-15T01:36:27.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.554+0000 7f883454fb80 1 -- 172.21.15.1:0/288500745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 msgr2=0x5633380640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.554+0000 7f883454fb80 1 --2- 172.21.15.1:0/288500745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x5633380640e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f880c009d50 tx=0x7f880c029000).stop 2023-11-15T01:36:27.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.554+0000 7f883454fb80 1 -- 172.21.15.1:0/288500745 shutdown_connections 2023-11-15T01:36:27.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.554+0000 7f883454fb80 1 --2- 172.21.15.1:0/288500745 >> [v2:172.21.15.1:6833/3051659352,v1:172.21.15.1:6835/3051659352] conn(0x56333804fa50 0x56333804fe30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.554+0000 7f883454fb80 1 --2- 172.21.15.1:0/288500745 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563338058ea0 0x56333803dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.554+0000 7f883454fb80 1 --2- 172.21.15.1:0/288500745 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563337dcbe40 0x563338063bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.554+0000 7f883454fb80 1 --2- 172.21.15.1:0/288500745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x5633380640e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.554+0000 7f883454fb80 1 -- 172.21.15.1:0/288500745 >> 172.21.15.1:0/288500745 conn(0x563337e794a0 msgr2=0x563338010110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:27.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.554+0000 7f87faffd700 0 client.6426 ms_handle_reset on v2:172.21.15.1:6833/3051659352 2023-11-15T01:36:27.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.554+0000 7f883454fb80 1 -- 172.21.15.1:0/288500745 shutdown_connections 2023-11-15T01:36:27.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.554+0000 7f883454fb80 1 -- 172.21.15.1:0/288500745 wait complete. 2023-11-15T01:36:27.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.554+0000 7f883454fb80 20 client.6426 trim_cache size 0 max 16384 2023-11-15T01:36:27.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.571+0000 7f883454fb80 1 Processor -- start 2023-11-15T01:36:27.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.571+0000 7f883454fb80 1 -- start start 2023-11-15T01:36:27.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.571+0000 7f883454fb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563337dcbe40 0x563338011db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.571+0000 7f883454fb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x56333800bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.571+0000 7f883454fb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563338058ea0 0x56333800e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.571+0000 7f883454fb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x56333800ca70 con 0x56333800fcb0 2023-11-15T01:36:27.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.571+0000 7f883454fb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x563337f4d0d0 con 0x563338058ea0 2023-11-15T01:36:27.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.571+0000 7f883454fb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x563338012400 con 0x563337dcbe40 2023-11-15T01:36:27.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.571+0000 7f881bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x56333800bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.571+0000 7f881bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x56333800bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49464/0 (socket says 172.21.15.1:49464) 2023-11-15T01:36:27.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.571+0000 7f881bfff700 1 -- 172.21.15.1:0/1802744272 learned_addr learned my addr 172.21.15.1:0/1802744272 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:27.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.572+0000 7f8821153700 1 --2- 172.21.15.1:0/1802744272 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563338058ea0 0x56333800e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.572+0000 7f881bfff700 1 -- 172.21.15.1:0/1802744272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563337dcbe40 msgr2=0x563338011db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:27.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.572+0000 7f8820952700 1 --2- 172.21.15.1:0/1802744272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563337dcbe40 0x563338011db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.572+0000 7f881bfff700 1 --2- 172.21.15.1:0/1802744272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563337dcbe40 0x563338011db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.572+0000 7f881bfff700 1 -- 172.21.15.1:0/1802744272 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563338058ea0 msgr2=0x56333800e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:27.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.572+0000 7f881bfff700 1 --2- 172.21.15.1:0/1802744272 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563338058ea0 0x56333800e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.572+0000 7f881bfff700 1 -- 172.21.15.1:0/1802744272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563337f55710 con 0x56333800fcb0 2023-11-15T01:36:27.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.572+0000 7f8820952700 1 --2- 172.21.15.1:0/1802744272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563337dcbe40 0x563338011db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:27.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.572+0000 7f8821153700 1 --2- 172.21.15.1:0/1802744272 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563338058ea0 0x56333800e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:27.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.572+0000 7f881bfff700 1 --2- 172.21.15.1:0/1802744272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x56333800bba0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f880c012fb0 tx=0x7f880c033070).ready entity=mon.0 client_cookie=9a925a8892a46f0d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:27.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.572+0000 7f88127fc700 1 -- 172.21.15.1:0/1802744272 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c035070 con 0x56333800fcb0 2023-11-15T01:36:27.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.572+0000 7f88127fc700 1 -- 172.21.15.1:0/1802744272 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c031850 con 0x56333800fcb0 2023-11-15T01:36:27.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.572+0000 7f88127fc700 1 -- 172.21.15.1:0/1802744272 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c03a610 con 0x56333800fcb0 2023-11-15T01:36:27.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.572+0000 7f883454fb80 1 -- 172.21.15.1:0/1802744272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 msgr2=0x56333800bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.572+0000 7f883454fb80 1 --2- 172.21.15.1:0/1802744272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x56333800bba0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f880c012fb0 tx=0x7f880c033070).stop 2023-11-15T01:36:27.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.573+0000 7f883454fb80 1 -- 172.21.15.1:0/1802744272 shutdown_connections 2023-11-15T01:36:27.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.573+0000 7f883454fb80 1 --2- 172.21.15.1:0/1802744272 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563338058ea0 0x56333800e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.573+0000 7f883454fb80 1 --2- 172.21.15.1:0/1802744272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563337dcbe40 0x563338011db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.573+0000 7f883454fb80 1 --2- 172.21.15.1:0/1802744272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x56333800bba0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.573+0000 7f883454fb80 1 -- 172.21.15.1:0/1802744272 >> 172.21.15.1:0/1802744272 conn(0x563337e794a0 msgr2=0x563338009670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:27.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.573+0000 7f883454fb80 1 -- 172.21.15.1:0/1802744272 shutdown_connections 2023-11-15T01:36:27.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.573+0000 7f883454fb80 1 -- 172.21.15.1:0/1802744272 wait complete. 2023-11-15T01:36:27.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.573+0000 7f883454fb80 1 -- start start 2023-11-15T01:36:27.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.573+0000 7f883454fb80 1 Processor -- start 2023-11-15T01:36:27.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.574+0000 7f883454fb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563337dcbe40 0x563338056e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.574+0000 7f883454fb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x563338056240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.574+0000 7f883454fb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563338058ea0 0x563338009670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.574+0000 7f883454fb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633380569b0 con 0x56333800fcb0 2023-11-15T01:36:27.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.574+0000 7f883454fb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633380371b0 con 0x563338058ea0 2023-11-15T01:36:27.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.574+0000 7f883454fb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x563338056730 con 0x563337dcbe40 2023-11-15T01:36:27.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.574+0000 7f883454fb80 10 client.0 ll_register_callbacks cb 0x563337fcf460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:36:27.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.574+0000 7f881bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x563338056240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.574+0000 7f881bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x563338056240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49470/0 (socket says 172.21.15.1:49470) 2023-11-15T01:36:27.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.574+0000 7f881bfff700 1 -- 172.21.15.1:0/2604886187 learned_addr learned my addr 172.21.15.1:0/2604886187 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:27.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.574+0000 7f8820952700 1 --2- 172.21.15.1:0/2604886187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563337dcbe40 0x563338056e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.574+0000 7f8821153700 1 --2- 172.21.15.1:0/2604886187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563338058ea0 0x563338009670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f881bfff700 1 -- 172.21.15.1:0/2604886187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563337dcbe40 msgr2=0x563338056e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:27.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f881bfff700 1 --2- 172.21.15.1:0/2604886187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563337dcbe40 0x563338056e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f881bfff700 1 -- 172.21.15.1:0/2604886187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563338058ea0 msgr2=0x563338009670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:27.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f881bfff700 1 --2- 172.21.15.1:0/2604886187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563338058ea0 0x563338009670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f881bfff700 1 -- 172.21.15.1:0/2604886187 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563337f559c0 con 0x56333800fcb0 2023-11-15T01:36:27.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f881bfff700 1 --2- 172.21.15.1:0/2604886187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x563338056240 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f880c012fb0 tx=0x7f880c02a070).ready entity=mon.0 client_cookie=f28fad9ea3641642 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:27.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f87faffd700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:36:27.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f87faffd700 1 -- 172.21.15.1:0/2604886187 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c035040 con 0x56333800fcb0 2023-11-15T01:36:27.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f87faffd700 1 -- 172.21.15.1:0/2604886187 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f880c03ac10 con 0x56333800fcb0 2023-11-15T01:36:27.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f883454fb80 1 -- 172.21.15.1:0/2604886187 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f880c01e570 con 0x56333800fcb0 2023-11-15T01:36:27.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f87faffd700 1 -- 172.21.15.1:0/2604886187 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f880c028400 con 0x56333800fcb0 2023-11-15T01:36:27.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f883454fb80 10 client.6432 fetch_fsmap learned FSMap version 31 2023-11-15T01:36:27.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f883454fb80 1 -- 172.21.15.1:0/2604886187 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x563337dccf80 con 0x56333800fcb0 2023-11-15T01:36:27.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f87faffd700 1 -- 172.21.15.1:0/2604886187 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c01e570 con 0x56333800fcb0 2023-11-15T01:36:27.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f87faffd700 1 -- 172.21.15.1:0/2604886187 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f880c02f070 con 0x56333800fcb0 2023-11-15T01:36:27.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f883454fb80 10 client.6432 fetch_fsmap finished waiting for FSMap version 31 2023-11-15T01:36:27.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f883454fb80 10 client.6432 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-15T01:36:27.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f883454fb80 20 client.6432 populate_metadata read hostname 'smithi001' 2023-11-15T01:36:27.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f883454fb80 1 --2- 172.21.15.1:0/2604886187 >> [v2:172.21.15.1:6833/3051659352,v1:172.21.15.1:6835/3051659352] conn(0x563338063360 0x563338063740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f883454fb80 4 client.6432 mds_command: new command op to 6285 tid=0[{"prefix": "status"}] 2023-11-15T01:36:27.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f883454fb80 1 -- 172.21.15.1:0/2604886187 --> [v2:172.21.15.1:6833/3051659352,v1:172.21.15.1:6835/3051659352] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563337dfeca0 con 0x563338063360 2023-11-15T01:36:27.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.575+0000 7f8820952700 1 --2- 172.21.15.1:0/2604886187 >> [v2:172.21.15.1:6833/3051659352,v1:172.21.15.1:6835/3051659352] conn(0x563338063360 0x563338063740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f87faffd700 10 client.6432 ms_handle_connect on v2:172.21.15.1:6833/3051659352 2023-11-15T01:36:27.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f8820952700 1 --2- 172.21.15.1:0/2604886187 >> [v2:172.21.15.1:6833/3051659352,v1:172.21.15.1:6835/3051659352] conn(0x563338063360 0x563338063740 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fa76853b8c73c8bf server_cookie=5b6e743973686981 in_seq=0 out_seq=0 2023-11-15T01:36:27.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f87faffd700 1 -- 172.21.15.1:0/2604886187 <== mds.0 v2:172.21.15.1:6833/3051659352 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x563337dfeca0 con 0x563338063360 2023-11-15T01:36:27.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f87faffd700 10 client.6432 handle_command_reply: tid=0 2023-11-15T01:36:27.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f883454fb80 1 client.6432 shutdown 2023-11-15T01:36:27.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f883454fb80 1 -- 172.21.15.1:0/2604886187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 msgr2=0x563338056240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f883454fb80 1 --2- 172.21.15.1:0/2604886187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x563338056240 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f880c012fb0 tx=0x7f880c02a070).stop 2023-11-15T01:36:27.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f883454fb80 1 -- 172.21.15.1:0/2604886187 shutdown_connections 2023-11-15T01:36:27.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f883454fb80 1 --2- 172.21.15.1:0/2604886187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x563338058ea0 0x563338009670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f883454fb80 1 --2- 172.21.15.1:0/2604886187 >> [v2:172.21.15.1:6833/3051659352,v1:172.21.15.1:6835/3051659352] conn(0x563338063360 0x563338063740 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f883454fb80 1 --2- 172.21.15.1:0/2604886187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x563337dcbe40 0x563338056e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f87faffd700 0 client.6432 ms_handle_reset on v2:172.21.15.1:6833/3051659352 2023-11-15T01:36:27.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f883454fb80 1 --2- 172.21.15.1:0/2604886187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56333800fcb0 0x563338056240 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f883454fb80 1 -- 172.21.15.1:0/2604886187 >> 172.21.15.1:0/2604886187 conn(0x563337e794a0 msgr2=0x563338010090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:27.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f883454fb80 1 -- 172.21.15.1:0/2604886187 shutdown_connections 2023-11-15T01:36:27.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f883454fb80 1 -- 172.21.15.1:0/2604886187 wait complete. 2023-11-15T01:36:27.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.576+0000 7f883454fb80 20 client.6432 trim_cache size 0 max 16384 2023-11-15T01:36:27.607 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T01:36:27.607 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "32ffb44b-12dc-4e79-bad7-24a9692dabf6", 2023-11-15T01:36:27.607 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2023-11-15T01:36:27.608 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 6285, 2023-11-15T01:36:27.608 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2023-11-15T01:36:27.608 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2023-11-15T01:36:27.608 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2023-11-15T01:36:27.608 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 6.0117665029999996, 2023-11-15T01:36:27.609 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 31, 2023-11-15T01:36:27.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 79, 2023-11-15T01:36:27.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 79, 2023-11-15T01:36:27.609 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 11.506419011 2023-11-15T01:36:27.609 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T01:36:27.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.577+0000 7f8822bb6700 1 -- 172.21.15.1:0/3212736460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f87fc05f270 msgr2=0x7f87fc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.577+0000 7f8822bb6700 1 --2- 172.21.15.1:0/3212736460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f87fc05f270 0x7f87fc061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f880c009760 tx=0x7f880c016000).stop 2023-11-15T01:36:27.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.577+0000 7f8822bb6700 1 -- 172.21.15.1:0/3212736460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f881c0c4f60 msgr2=0x7f881c0654b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.577+0000 7f8822bb6700 1 --2- 172.21.15.1:0/3212736460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f881c0c4f60 0x7f881c0654b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f881400cb10 tx=0x7f8814001e30).stop 2023-11-15T01:36:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.577+0000 7f8822bb6700 1 -- 172.21.15.1:0/3212736460 shutdown_connections 2023-11-15T01:36:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.577+0000 7f8822bb6700 1 --2- 172.21.15.1:0/3212736460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f87fc05f270 0x7f87fc061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.577+0000 7f8822bb6700 1 --2- 172.21.15.1:0/3212736460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f881c152110 0x7f881c163f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.577+0000 7f8822bb6700 1 --2- 172.21.15.1:0/3212736460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f881c0c4f60 0x7f881c0654b0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.577+0000 7f8822bb6700 1 --2- 172.21.15.1:0/3212736460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f881c0c6a30 0x7f881c14ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.577+0000 7f8822bb6700 1 -- 172.21.15.1:0/3212736460 >> 172.21.15.1:0/3212736460 conn(0x7f881c082f90 msgr2=0x7f881c14e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.577+0000 7f8822bb6700 1 -- 172.21.15.1:0/3212736460 shutdown_connections 2023-11-15T01:36:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.577+0000 7f8822bb6700 1 -- 172.21.15.1:0/3212736460 wait complete. 2023-11-15T01:36:27.614 DEBUG:teuthology.orchestra.run.smithi001:> ceph fs ls 2023-11-15T01:36:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.718+0000 7f5748e76700 1 Processor -- start 2023-11-15T01:36:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.718+0000 7f5748e76700 1 -- start start 2023-11-15T01:36:27.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f5748e76700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5744154410 0x7f57440ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f5748e76700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744062c10 0x7f57440ab580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f5748e76700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5744158150 con 0x7f5744063140 2023-11-15T01:36:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f5748e76700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5744063670 con 0x7f5744154410 2023-11-15T01:36:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f5748e76700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5744063950 con 0x7f5744062c10 2023-11-15T01:36:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f5742d9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5744063140 0x7f57441585e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:35118/0 (socket says 172.21.15.1:35118) 2023-11-15T01:36:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f5742d9d700 1 -- 172.21.15.1:0/323895678 learned_addr learned my addr 172.21.15.1:0/323895678 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:27.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f5741d9b700 1 --2- 172.21.15.1:0/323895678 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744062c10 0x7f57440ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f574259c700 1 --2- 172.21.15.1:0/323895678 >> v2:172.21.15.141:3300/0 conn(0x7f5744154410 0x7f57440ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f574159a700 1 -- 172.21.15.1:0/323895678 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267650090 0 0) 0x7f5744158150 con 0x7f5744063140 2023-11-15T01:36:27.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f574159a700 1 -- 172.21.15.1:0/323895678 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f572c0033f0 con 0x7f5744063140 2023-11-15T01:36:27.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f574159a700 1 -- 172.21.15.1:0/323895678 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3774686447 0 0) 0x7f572c0033f0 con 0x7f5744063140 2023-11-15T01:36:27.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f574159a700 1 -- 172.21.15.1:0/323895678 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744062c10 msgr2=0x7f57440ab580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:27.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f574159a700 1 --2- 172.21.15.1:0/323895678 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744062c10 0x7f57440ab580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f574159a700 1 -- 172.21.15.1:0/323895678 >> v2:172.21.15.141:3300/0 conn(0x7f5744154410 msgr2=0x7f57440ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:27.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f574159a700 1 --2- 172.21.15.1:0/323895678 >> v2:172.21.15.141:3300/0 conn(0x7f5744154410 0x7f57440ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f574159a700 1 -- 172.21.15.1:0/323895678 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5744063c30 con 0x7f5744063140 2023-11-15T01:36:27.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.719+0000 7f574159a700 1 -- 172.21.15.1:0/323895678 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f573c0017f0 con 0x7f5744063140 2023-11-15T01:36:27.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f574159a700 1 -- 172.21.15.1:0/323895678 >> v1:172.21.15.1:6789/0 conn(0x7f5744063140 legacy=0x7f57441585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f574159a700 1 --2- 172.21.15.1:0/323895678 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744062c10 0x7f572c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f574159a700 1 --2- 172.21.15.1:0/323895678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f572c003e10 0x7f572c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f574159a700 1 --2- 172.21.15.1:0/323895678 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f572c004b80 0x7f572c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f574159a700 1 -- 172.21.15.1:0/323895678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5744063670 con 0x7f572c003e10 2023-11-15T01:36:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f574159a700 1 -- 172.21.15.1:0/323895678 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5744063950 con 0x7f572c004b80 2023-11-15T01:36:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f574159a700 1 -- 172.21.15.1:0/323895678 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c00b8e0 con 0x7f5744062c10 2023-11-15T01:36:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f5741d9b700 1 --2- 172.21.15.1:0/323895678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f572c003e10 0x7f572c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f574259c700 1 --2- 172.21.15.1:0/323895678 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744062c10 0x7f572c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f5742d9d700 1 --2- 172.21.15.1:0/323895678 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f572c004b80 0x7f572c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f5741d9b700 1 -- 172.21.15.1:0/323895678 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744062c10 msgr2=0x7f572c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f5741d9b700 1 --2- 172.21.15.1:0/323895678 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744062c10 0x7f572c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f5741d9b700 1 -- 172.21.15.1:0/323895678 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f572c004b80 msgr2=0x7f572c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f5741d9b700 1 --2- 172.21.15.1:0/323895678 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f572c004b80 0x7f572c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f5741d9b700 1 -- 172.21.15.1:0/323895678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c0033f0 con 0x7f572c003e10 2023-11-15T01:36:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f5741d9b700 1 --2- 172.21.15.1:0/323895678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f572c003e10 0x7f572c004690 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f5738009a90 tx=0x7f5738009060).ready entity=mon.0 client_cookie=140ad45f55ce9851 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f574159a700 1 -- 172.21.15.1:0/323895678 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5738009430 con 0x7f572c003e10 2023-11-15T01:36:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f574159a700 1 -- 172.21.15.1:0/323895678 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573800e640 con 0x7f572c003e10 2023-11-15T01:36:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.720+0000 7f574159a700 1 -- 172.21.15.1:0/323895678 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573800e9c0 con 0x7f572c003e10 2023-11-15T01:36:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.721+0000 7f5748e76700 1 -- 172.21.15.1:0/323895678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f572c003e10 msgr2=0x7f572c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.721+0000 7f5748e76700 1 --2- 172.21.15.1:0/323895678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f572c003e10 0x7f572c004690 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f5738009a90 tx=0x7f5738009060).stop 2023-11-15T01:36:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.721+0000 7f5742d9d700 1 -- 172.21.15.1:0/323895678 reap_dead start 2023-11-15T01:36:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.721+0000 7f5748e76700 1 -- 172.21.15.1:0/323895678 shutdown_connections 2023-11-15T01:36:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.721+0000 7f5748e76700 1 -- 172.21.15.1:0/323895678 >> 172.21.15.1:0/323895678 conn(0x7f57440cbbd0 msgr2=0x7f57440c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.721+0000 7f5748e76700 1 -- 172.21.15.1:0/323895678 shutdown_connections 2023-11-15T01:36:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.721+0000 7f5748e76700 1 -- 172.21.15.1:0/323895678 wait complete. 2023-11-15T01:36:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.722+0000 7f5748e76700 1 Processor -- start 2023-11-15T01:36:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.722+0000 7f5748e76700 1 -- start start 2023-11-15T01:36:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f5748e76700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f572c003e10 0x7f5744148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f5748e76700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159530 0x7f57440aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f5748e76700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5744156b60 0x7f5744156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f5748e76700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5744168830 con 0x7f572c003e10 2023-11-15T01:36:27.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f5748e76700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5744167c20 con 0x7f5744156b60 2023-11-15T01:36:27.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f5748e76700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5744167f00 con 0x7f5744159530 2023-11-15T01:36:27.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f574259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f572c003e10 0x7f5744148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f574259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f572c003e10 0x7f5744148ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60642/0 (socket says 172.21.15.1:60642) 2023-11-15T01:36:27.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f574259c700 1 -- 172.21.15.1:0/1190337797 learned_addr learned my addr 172.21.15.1:0/1190337797 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f5741d9b700 1 --2- 172.21.15.1:0/1190337797 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159530 0x7f57440aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f5742d9d700 1 --2- 172.21.15.1:0/1190337797 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5744156b60 0x7f5744156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f574259c700 1 -- 172.21.15.1:0/1190337797 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159530 msgr2=0x7f57440aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f574259c700 1 --2- 172.21.15.1:0/1190337797 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159530 0x7f57440aed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f574259c700 1 -- 172.21.15.1:0/1190337797 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5744156b60 msgr2=0x7f5744156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f574259c700 1 --2- 172.21.15.1:0/1190337797 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5744156b60 0x7f5744156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f574259c700 1 -- 172.21.15.1:0/1190337797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57441681e0 con 0x7f572c003e10 2023-11-15T01:36:27.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f574259c700 1 --2- 172.21.15.1:0/1190337797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f572c003e10 0x7f5744148ca0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f57340119f0 tx=0x7f5734009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:27.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.723+0000 7f57327fc700 1 -- 172.21.15.1:0/1190337797 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573400f790 con 0x7f572c003e10 2023-11-15T01:36:27.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.724+0000 7f57327fc700 1 -- 172.21.15.1:0/1190337797 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573400f8f0 con 0x7f572c003e10 2023-11-15T01:36:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.724+0000 7f5748e76700 1 -- 172.21.15.1:0/1190337797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57441684c0 con 0x7f572c003e10 2023-11-15T01:36:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.724+0000 7f57327fc700 1 -- 172.21.15.1:0/1190337797 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573400fc70 con 0x7f572c003e10 2023-11-15T01:36:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.724+0000 7f5748e76700 1 -- 172.21.15.1:0/1190337797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57440b0fb0 con 0x7f572c003e10 2023-11-15T01:36:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.724+0000 7f5748e76700 1 -- 172.21.15.1:0/1190337797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57440475e0 con 0x7f572c003e10 2023-11-15T01:36:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.725+0000 7f57327fc700 1 -- 172.21.15.1:0/1190337797 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5734014650 con 0x7f572c003e10 2023-11-15T01:36:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.725+0000 7f57327fc700 1 --2- 172.21.15.1:0/1190337797 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f572405f270 0x7f5724061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.725+0000 7f57327fc700 1 -- 172.21.15.1:0/1190337797 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f573407b090 con 0x7f572c003e10 2023-11-15T01:36:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.725+0000 7f5741d9b700 1 --2- 172.21.15.1:0/1190337797 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f572405f270 0x7f5724061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.726+0000 7f5741d9b700 1 --2- 172.21.15.1:0/1190337797 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f572405f270 0x7f5724061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f5744084660 tx=0x7f573801a000).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.729+0000 7f57327fc700 1 -- 172.21.15.1:0/1190337797 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f573404c030 con 0x7f572c003e10 2023-11-15T01:36:27.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.950+0000 7f5748e76700 1 -- 172.21.15.1:0/1190337797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5744063f10 con 0x7f572c003e10 2023-11-15T01:36:27.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.950+0000 7f57327fc700 1 -- 172.21.15.1:0/1190337797 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f573404f650 con 0x7f572c003e10 2023-11-15T01:36:27.952 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-15T01:36:27.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.952+0000 7f5748e76700 1 -- 172.21.15.1:0/1190337797 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f572405f270 msgr2=0x7f5724061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.952+0000 7f5748e76700 1 --2- 172.21.15.1:0/1190337797 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f572405f270 0x7f5724061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f5744084660 tx=0x7f573801a000).stop 2023-11-15T01:36:27.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.952+0000 7f5748e76700 1 -- 172.21.15.1:0/1190337797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f572c003e10 msgr2=0x7f5744148ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:27.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.952+0000 7f5748e76700 1 --2- 172.21.15.1:0/1190337797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f572c003e10 0x7f5744148ca0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f57340119f0 tx=0x7f5734009060).stop 2023-11-15T01:36:27.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.952+0000 7f5748e76700 1 -- 172.21.15.1:0/1190337797 shutdown_connections 2023-11-15T01:36:27.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.952+0000 7f5748e76700 1 --2- 172.21.15.1:0/1190337797 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f572405f270 0x7f5724061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.952+0000 7f5748e76700 1 --2- 172.21.15.1:0/1190337797 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5744156b60 0x7f5744156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.952+0000 7f5748e76700 1 --2- 172.21.15.1:0/1190337797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f572c003e10 0x7f5744148ca0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.952+0000 7f5748e76700 1 --2- 172.21.15.1:0/1190337797 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159530 0x7f57440aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:27.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.952+0000 7f5748e76700 1 -- 172.21.15.1:0/1190337797 >> 172.21.15.1:0/1190337797 conn(0x7f57440cbbd0 msgr2=0x7f57440ac530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:27.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.952+0000 7f5748e76700 1 -- 172.21.15.1:0/1190337797 shutdown_connections 2023-11-15T01:36:27.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:27.952+0000 7f5748e76700 1 -- 172.21.15.1:0/1190337797 wait complete. 2023-11-15T01:36:27.964 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-15T01:36:27.964 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-15T01:36:27.965 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-11-15T01:36:27.965 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-15T01:36:27.965 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-15T01:36:27.966 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-15T01:36:27.966 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-15T01:36:27.966 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-15T01:36:27.967 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T01:36:27.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:36:27.967 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-11-15T01:36:27.983 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:36:27.983 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T01:36:27.983 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T01:36:27.983 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:36:27.983 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-11-15T01:36:27.984 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:36:27.984 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:36:27.984 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-11-15T01:36:27.984 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-11-15T01:36:27.984 INFO:teuthology.orchestra.run.smithi001.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-15T01:36:27.985 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:36:27.985 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-11-15T01:36:27.985 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-15T01:36:27.985 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 41617sec preferred_lft 41617sec 2023-11-15T01:36:27.985 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2023-11-15T01:36:27.985 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:36:27.986 INFO:teuthology.orchestra.run.smithi001.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:36:27.986 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-11-15T01:36:27.986 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-11-15T01:36:27.986 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:36:27.986 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:36:27.986 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-11-15T01:36:27.987 INFO:teuthology.orchestra.run.smithi001.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-15T01:36:27.987 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:36:27.987 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-15T01:36:27.987 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:36:27.987 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::74ff:4aff:fef6:c8f5/64 scope link 2023-11-15T01:36:27.987 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:36:27.988 INFO:teuthology.orchestra.run.smithi001.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:36:27.988 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-15T01:36:27.988 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::10ca:5cff:fe8a:9a23/64 scope link 2023-11-15T01:36:27.988 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:36:27.988 INFO:teuthology.orchestra.run.smithi001.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:36:27.989 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 92:7a:64:05:0f:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-15T01:36:27.989 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::907a:64ff:fe05:f37/64 scope link 2023-11-15T01:36:27.989 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:36:27.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:36:27.990 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-15T01:36:28.046 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-11-15T01:36:28.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:36:28.048 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-11-15T01:36:28.104 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-11-15T01:36:28.105 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-15T01:36:28.105 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-15T01:36:28.105 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-15T01:36:28.105 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-15T01:36:28.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:36:28.106 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:36:28.106 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:36:28.107 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-15T01:36:28.107 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-15T01:36:28.107 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-15T01:36:28.108 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:36:28.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:36:28.207 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T01:36:28.222 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-15T01:36:28.223 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-15T01:36:28.223 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T01:36:28.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:36:28.224 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2023-11-15T01:36:28.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:36:28.288 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-15T01:36:28.344 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-15T01:36:28.345 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:36:28.425 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:36:28.425 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:36:28.449 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:36:28.449 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:36:28.452 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-15T01:36:28.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:36:28.452 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-15T01:36:28.517 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-15T01:36:28.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.675+0000 7feb40e71700 1 Processor -- start 2023-11-15T01:36:28.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.675+0000 7feb40e71700 1 -- start start 2023-11-15T01:36:28.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.676+0000 7feb40e71700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feb3c154250 0x7feb3c154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:28.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.676+0000 7feb40e71700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0aa700 0x7feb3c0c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:28.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.676+0000 7feb40e71700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3c158ff0 con 0x7feb3c0c6110 2023-11-15T01:36:28.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.676+0000 7feb40e71700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c158100 con 0x7feb3c154250 2023-11-15T01:36:28.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.676+0000 7feb40e71700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c1583e0 con 0x7feb3c0aa700 2023-11-15T01:36:28.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.676+0000 7feb3a59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feb3c154250 0x7feb3c154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:28.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.676+0000 7feb3a59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feb3c154250 0x7feb3c154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60646/0 (socket says 172.21.15.1:60646) 2023-11-15T01:36:28.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.676+0000 7feb3a59c700 1 -- 172.21.15.1:0/1545789715 learned_addr learned my addr 172.21.15.1:0/1545789715 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:28.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.676+0000 7feb3ad9d700 1 --2- 172.21.15.1:0/1545789715 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0aa700 0x7feb3c0c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:28.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.676+0000 7feb3a59c700 1 -- 172.21.15.1:0/1545789715 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0aa700 msgr2=0x7feb3c0c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:28.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.676+0000 7feb3a59c700 1 --2- 172.21.15.1:0/1545789715 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0aa700 0x7feb3c0c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:28.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.676+0000 7feb3a59c700 1 -- 172.21.15.1:0/1545789715 >> v1:172.21.15.141:6789/0 conn(0x7feb3c0c6110 legacy=0x7feb3c0a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:28.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.676+0000 7feb3a59c700 1 -- 172.21.15.1:0/1545789715 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c1586c0 con 0x7feb3c154250 2023-11-15T01:36:28.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.676+0000 7feb3a59c700 1 --2- 172.21.15.1:0/1545789715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c154250 0x7feb3c154630 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7feb2c006fd0 tx=0x7feb2c0090f0).ready entity=mon.0 client_cookie=38b4d183eb7bd99f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:28.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.677+0000 7feb3959a700 1 -- 172.21.15.1:0/1545789715 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c00b580 con 0x7feb3c154250 2023-11-15T01:36:28.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.677+0000 7feb3959a700 1 -- 172.21.15.1:0/1545789715 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2c00b6e0 con 0x7feb3c154250 2023-11-15T01:36:28.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.677+0000 7feb3959a700 1 -- 172.21.15.1:0/1545789715 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c00ba60 con 0x7feb3c154250 2023-11-15T01:36:28.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.677+0000 7feb40e71700 1 -- 172.21.15.1:0/1545789715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c154250 msgr2=0x7feb3c154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:28.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.677+0000 7feb40e71700 1 --2- 172.21.15.1:0/1545789715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c154250 0x7feb3c154630 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7feb2c006fd0 tx=0x7feb2c0090f0).stop 2023-11-15T01:36:28.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.677+0000 7feb40e71700 1 -- 172.21.15.1:0/1545789715 shutdown_connections 2023-11-15T01:36:28.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.677+0000 7feb40e71700 1 --2- 172.21.15.1:0/1545789715 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0aa700 0x7feb3c0c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:28.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.677+0000 7feb40e71700 1 --2- 172.21.15.1:0/1545789715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c154250 0x7feb3c154630 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:28.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.677+0000 7feb40e71700 1 -- 172.21.15.1:0/1545789715 >> 172.21.15.1:0/1545789715 conn(0x7feb3c0c7b20 msgr2=0x7feb3c0c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:28.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.677+0000 7feb40e71700 1 -- 172.21.15.1:0/1545789715 shutdown_connections 2023-11-15T01:36:28.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.677+0000 7feb40e71700 1 -- 172.21.15.1:0/1545789715 wait complete. 2023-11-15T01:36:28.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.678+0000 7feb40e71700 1 Processor -- start 2023-11-15T01:36:28.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.678+0000 7feb40e71700 1 -- start start 2023-11-15T01:36:28.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.679+0000 7feb40e71700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c0aa700 0x7feb3c154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:28.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.679+0000 7feb40e71700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0c6110 0x7feb3c14d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:28.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.679+0000 7feb40e71700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb3c154250 0x7feb3c0c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:28.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.679+0000 7feb40e71700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c1554f0 con 0x7feb3c0aa700 2023-11-15T01:36:28.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.679+0000 7feb40e71700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0ae650 con 0x7feb3c154250 2023-11-15T01:36:28.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.679+0000 7feb40e71700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c154f30 con 0x7feb3c0c6110 2023-11-15T01:36:28.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.679+0000 7feb3a59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c0aa700 0x7feb3c154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:28.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.679+0000 7feb3a59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c0aa700 0x7feb3c154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60652/0 (socket says 172.21.15.1:60652) 2023-11-15T01:36:28.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.679+0000 7feb3a59c700 1 -- 172.21.15.1:0/771174975 learned_addr learned my addr 172.21.15.1:0/771174975 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:28.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.679+0000 7feb3ad9d700 1 --2- 172.21.15.1:0/771174975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb3c154250 0x7feb3c0c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:28.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.679+0000 7feb39d9b700 1 --2- 172.21.15.1:0/771174975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0c6110 0x7feb3c14d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:28.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.680+0000 7feb3a59c700 1 -- 172.21.15.1:0/771174975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0c6110 msgr2=0x7feb3c14d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:28.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.680+0000 7feb3a59c700 1 --2- 172.21.15.1:0/771174975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0c6110 0x7feb3c14d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:28.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.680+0000 7feb3a59c700 1 -- 172.21.15.1:0/771174975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb3c154250 msgr2=0x7feb3c0c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:28.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.680+0000 7feb3a59c700 1 --2- 172.21.15.1:0/771174975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb3c154250 0x7feb3c0c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:28.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.680+0000 7feb3a59c700 1 -- 172.21.15.1:0/771174975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c009370 con 0x7feb3c0aa700 2023-11-15T01:36:28.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.680+0000 7feb3a59c700 1 --2- 172.21.15.1:0/771174975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c0aa700 0x7feb3c154630 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7feb3c0c2080 tx=0x7feb2c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:28.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.680+0000 7feb2a7fc700 1 -- 172.21.15.1:0/771174975 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c00b850 con 0x7feb3c0aa700 2023-11-15T01:36:28.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.680+0000 7feb2a7fc700 1 -- 172.21.15.1:0/771174975 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2c00b9b0 con 0x7feb3c0aa700 2023-11-15T01:36:28.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.680+0000 7feb40e71700 1 -- 172.21.15.1:0/771174975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3c155210 con 0x7feb3c0aa700 2023-11-15T01:36:28.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.680+0000 7feb2a7fc700 1 -- 172.21.15.1:0/771174975 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c01d680 con 0x7feb3c0aa700 2023-11-15T01:36:28.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.680+0000 7feb40e71700 1 -- 172.21.15.1:0/771174975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3c154b20 con 0x7feb3c0aa700 2023-11-15T01:36:28.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.681+0000 7feb40e71700 1 -- 172.21.15.1:0/771174975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c06c7e0 con 0x7feb3c0aa700 2023-11-15T01:36:28.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.681+0000 7feb2a7fc700 1 -- 172.21.15.1:0/771174975 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7feb2c01d9f0 con 0x7feb3c0aa700 2023-11-15T01:36:28.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.682+0000 7feb2a7fc700 1 --2- 172.21.15.1:0/771174975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feb1c05f270 0x7feb1c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:28.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.682+0000 7feb2a7fc700 1 -- 172.21.15.1:0/771174975 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6545+0+0 (secure 0 0 0) 0x7feb2c07c1a0 con 0x7feb3c0aa700 2023-11-15T01:36:28.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.682+0000 7feb39d9b700 1 --2- 172.21.15.1:0/771174975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feb1c05f270 0x7feb1c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:28.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.682+0000 7feb39d9b700 1 --2- 172.21.15.1:0/771174975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feb1c05f270 0x7feb1c061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7feb3c157600 tx=0x7feb30009040).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:28.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.686+0000 7feb2a7fc700 1 -- 172.21.15.1:0/771174975 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7feb2c04d0b0 con 0x7feb3c0aa700 2023-11-15T01:36:28.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.887+0000 7feb40e71700 1 -- 172.21.15.1:0/771174975 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7feb3c1589a0 con 0x7feb1c05f270 2023-11-15T01:36:28.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.889+0000 7feb2a7fc700 1 -- 172.21.15.1:0/771174975 <== mgr.5686 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7feb3c1589a0 con 0x7feb1c05f270 2023-11-15T01:36:28.890 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T01:36:28.890 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:28.891 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephfs" 2023-11-15T01:36:28.891 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:28.891 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T01:36:28.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.891+0000 7feb40e71700 1 -- 172.21.15.1:0/771174975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feb1c05f270 msgr2=0x7feb1c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:28.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.891+0000 7feb40e71700 1 --2- 172.21.15.1:0/771174975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feb1c05f270 0x7feb1c061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7feb3c157600 tx=0x7feb30009040).stop 2023-11-15T01:36:28.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.891+0000 7feb40e71700 1 -- 172.21.15.1:0/771174975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c0aa700 msgr2=0x7feb3c154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:28.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.891+0000 7feb40e71700 1 --2- 172.21.15.1:0/771174975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c0aa700 0x7feb3c154630 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7feb3c0c2080 tx=0x7feb2c017000).stop 2023-11-15T01:36:28.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.891+0000 7feb40e71700 1 -- 172.21.15.1:0/771174975 shutdown_connections 2023-11-15T01:36:28.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.891+0000 7feb40e71700 1 --2- 172.21.15.1:0/771174975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feb1c05f270 0x7feb1c061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:28.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.891+0000 7feb40e71700 1 --2- 172.21.15.1:0/771174975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb3c154250 0x7feb3c0c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:28.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.891+0000 7feb40e71700 1 --2- 172.21.15.1:0/771174975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c0aa700 0x7feb3c154630 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:28.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.891+0000 7feb40e71700 1 --2- 172.21.15.1:0/771174975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0c6110 0x7feb3c14d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:28.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.891+0000 7feb40e71700 1 -- 172.21.15.1:0/771174975 >> 172.21.15.1:0/771174975 conn(0x7feb3c0c7b20 msgr2=0x7feb3c0c0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:28.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.891+0000 7feb40e71700 1 -- 172.21.15.1:0/771174975 shutdown_connections 2023-11-15T01:36:28.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:28.891+0000 7feb40e71700 1 -- 172.21.15.1:0/771174975 wait complete. 2023-11-15T01:36:28.904 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-15T01:36:29.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.023+0000 7f8a3b1b0700 1 Processor -- start 2023-11-15T01:36:29.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.023+0000 7f8a3b1b0700 1 -- start start 2023-11-15T01:36:29.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.024+0000 7f8a3b1b0700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8a341540a0 0x7f8a340ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:29.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.024+0000 7f8a3b1b0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a34154480 0x7f8a340ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:29.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.024+0000 7f8a3b1b0700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a340ca050 con 0x7f8a340c5f40 2023-11-15T01:36:29.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.024+0000 7f8a3b1b0700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a340c9440 con 0x7f8a341540a0 2023-11-15T01:36:29.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.024+0000 7f8a3b1b0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a340c9720 con 0x7f8a34154480 2023-11-15T01:36:29.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.024+0000 7f8a38f4c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8a341540a0 0x7f8a340ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:29.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.024+0000 7f8a38f4c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8a341540a0 0x7f8a340ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:60382/0 (socket says 172.21.15.1:60382) 2023-11-15T01:36:29.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.024+0000 7f8a38f4c700 1 -- 172.21.15.1:0/3408309170 learned_addr learned my addr 172.21.15.1:0/3408309170 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:29.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.024+0000 7f8a33fff700 1 --2- 172.21.15.1:0/3408309170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a34154480 0x7f8a340ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:29.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.025+0000 7f8a38f4c700 1 -- 172.21.15.1:0/3408309170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a34154480 msgr2=0x7f8a340ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:29.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.025+0000 7f8a38f4c700 1 --2- 172.21.15.1:0/3408309170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a34154480 0x7f8a340ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:29.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.025+0000 7f8a38f4c700 1 -- 172.21.15.1:0/3408309170 >> v1:172.21.15.141:6789/0 conn(0x7f8a340c5f40 legacy=0x7f8a340aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:29.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.025+0000 7f8a38f4c700 1 -- 172.21.15.1:0/3408309170 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a340c9a00 con 0x7f8a341540a0 2023-11-15T01:36:29.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.025+0000 7f8a33fff700 1 --2- 172.21.15.1:0/3408309170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a34154480 0x7f8a340ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:29.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.025+0000 7f8a38f4c700 1 --2- 172.21.15.1:0/3408309170 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a341540a0 0x7f8a340ca4e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f8a2c009f20 tx=0x7f8a2c009840).ready entity=mon.1 client_cookie=c2efb0490082af3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:29.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.025+0000 7f8a337fe700 1 -- 172.21.15.1:0/3408309170 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00e070 con 0x7f8a341540a0 2023-11-15T01:36:29.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.025+0000 7f8a337fe700 1 -- 172.21.15.1:0/3408309170 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c00b9d0 con 0x7f8a341540a0 2023-11-15T01:36:29.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.025+0000 7f8a337fe700 1 -- 172.21.15.1:0/3408309170 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00bd50 con 0x7f8a341540a0 2023-11-15T01:36:29.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.025+0000 7f8a3b1b0700 1 -- 172.21.15.1:0/3408309170 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a341540a0 msgr2=0x7f8a340ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:29.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.025+0000 7f8a3b1b0700 1 --2- 172.21.15.1:0/3408309170 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a341540a0 0x7f8a340ca4e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f8a2c009f20 tx=0x7f8a2c009840).stop 2023-11-15T01:36:29.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.026+0000 7f8a3b1b0700 1 -- 172.21.15.1:0/3408309170 shutdown_connections 2023-11-15T01:36:29.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.026+0000 7f8a3b1b0700 1 --2- 172.21.15.1:0/3408309170 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a341540a0 0x7f8a340ca4e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:29.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.026+0000 7f8a3b1b0700 1 --2- 172.21.15.1:0/3408309170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a34154480 0x7f8a340ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:29.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.026+0000 7f8a3b1b0700 1 -- 172.21.15.1:0/3408309170 >> 172.21.15.1:0/3408309170 conn(0x7f8a34064a70 msgr2=0x7f8a34064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:29.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.026+0000 7f8a3b1b0700 1 -- 172.21.15.1:0/3408309170 shutdown_connections 2023-11-15T01:36:29.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.026+0000 7f8a3b1b0700 1 -- 172.21.15.1:0/3408309170 wait complete. 2023-11-15T01:36:29.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.027+0000 7f8a3b1b0700 1 Processor -- start 2023-11-15T01:36:29.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.027+0000 7f8a3b1b0700 1 -- start start 2023-11-15T01:36:29.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a3b1b0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a340c5f40 0x7f8a340b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:29.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a3b1b0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a341540a0 0x7f8a340a9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:29.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a3b1b0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a34154480 0x7f8a34151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:29.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a3b1b0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3414f500 con 0x7f8a340c5f40 2023-11-15T01:36:29.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a3b1b0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a340aff40 con 0x7f8a341540a0 2023-11-15T01:36:29.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a3b1b0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a340af050 con 0x7f8a34154480 2023-11-15T01:36:29.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a38f4c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a340c5f40 0x7f8a340b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:29.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a38f4c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a340c5f40 0x7f8a340b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60658/0 (socket says 172.21.15.1:60658) 2023-11-15T01:36:29.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a38f4c700 1 -- 172.21.15.1:0/57822356 learned_addr learned my addr 172.21.15.1:0/57822356 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:29.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a33fff700 1 --2- 172.21.15.1:0/57822356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a341540a0 0x7f8a340a9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:29.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a3974d700 1 --2- 172.21.15.1:0/57822356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a34154480 0x7f8a34151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:29.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a38f4c700 1 -- 172.21.15.1:0/57822356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a34154480 msgr2=0x7f8a34151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:29.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a38f4c700 1 --2- 172.21.15.1:0/57822356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a34154480 0x7f8a34151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:29.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a38f4c700 1 -- 172.21.15.1:0/57822356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a341540a0 msgr2=0x7f8a340a9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:29.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a38f4c700 1 --2- 172.21.15.1:0/57822356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a341540a0 0x7f8a340a9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:29.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a38f4c700 1 -- 172.21.15.1:0/57822356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a240092a0 con 0x7f8a340c5f40 2023-11-15T01:36:29.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a38f4c700 1 --2- 172.21.15.1:0/57822356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a340c5f40 0x7f8a340b03d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f8a2c00b610 tx=0x7f8a2c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:29.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a30ff9700 1 -- 172.21.15.1:0/57822356 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0092e0 con 0x7f8a340c5f40 2023-11-15T01:36:29.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a30ff9700 1 -- 172.21.15.1:0/57822356 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c00bb40 con 0x7f8a340c5f40 2023-11-15T01:36:29.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a3b1b0700 1 -- 172.21.15.1:0/57822356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2c009ae0 con 0x7f8a340c5f40 2023-11-15T01:36:29.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.028+0000 7f8a30ff9700 1 -- 172.21.15.1:0/57822356 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c01d410 con 0x7f8a340c5f40 2023-11-15T01:36:29.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.029+0000 7f8a3b1b0700 1 -- 172.21.15.1:0/57822356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a340af610 con 0x7f8a340c5f40 2023-11-15T01:36:29.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.030+0000 7f8a3b1b0700 1 -- 172.21.15.1:0/57822356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3406c7e0 con 0x7f8a340c5f40 2023-11-15T01:36:29.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.030+0000 7f8a30ff9700 1 -- 172.21.15.1:0/57822356 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8a2c01d7c0 con 0x7f8a340c5f40 2023-11-15T01:36:29.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.030+0000 7f8a30ff9700 1 --2- 172.21.15.1:0/57822356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a1405f270 0x7f8a14061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:29.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.030+0000 7f8a30ff9700 1 -- 172.21.15.1:0/57822356 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f8a2c07beb0 con 0x7f8a340c5f40 2023-11-15T01:36:29.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.030+0000 7f8a33fff700 1 --2- 172.21.15.1:0/57822356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a1405f270 0x7f8a14061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:29.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.031+0000 7f8a33fff700 1 --2- 172.21.15.1:0/57822356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a1405f270 0x7f8a14061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8a340a1ec0 tx=0x7f8a24009060).ready entity=mgr.5686 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:29.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.034+0000 7f8a30ff9700 1 -- 172.21.15.1:0/57822356 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8a2c04cf10 con 0x7f8a340c5f40 2023-11-15T01:36:29.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.259+0000 7f8a3b1b0700 1 -- 172.21.15.1:0/57822356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f8a340b0220 con 0x7f8a340c5f40 2023-11-15T01:36:29.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.837+0000 7f8a30ff9700 1 -- 172.21.15.1:0/57822356 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 25) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f8a2c079a10 con 0x7f8a340c5f40 2023-11-15T01:36:29.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.837+0000 7f8a30ff9700 1 -- 172.21.15.1:0/57822356 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v25) v1 ==== 92+0+0 (secure 0 0 0) 0x7f8a2c042810 con 0x7f8a340c5f40 2023-11-15T01:36:29.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.840+0000 7f8a3b1b0700 1 -- 172.21.15.1:0/57822356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a1405f270 msgr2=0x7f8a14061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:29.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.840+0000 7f8a3b1b0700 1 --2- 172.21.15.1:0/57822356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a1405f270 0x7f8a14061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8a340a1ec0 tx=0x7f8a24009060).stop 2023-11-15T01:36:29.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.840+0000 7f8a3b1b0700 1 -- 172.21.15.1:0/57822356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a340c5f40 msgr2=0x7f8a340b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:29.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.840+0000 7f8a3b1b0700 1 --2- 172.21.15.1:0/57822356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a340c5f40 0x7f8a340b03d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f8a2c00b610 tx=0x7f8a2c009840).stop 2023-11-15T01:36:29.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.840+0000 7f8a3b1b0700 1 -- 172.21.15.1:0/57822356 shutdown_connections 2023-11-15T01:36:29.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.840+0000 7f8a3b1b0700 1 --2- 172.21.15.1:0/57822356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8a1405f270 0x7f8a14061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:29.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.840+0000 7f8a3b1b0700 1 --2- 172.21.15.1:0/57822356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a34154480 0x7f8a34151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:29.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.840+0000 7f8a3b1b0700 1 --2- 172.21.15.1:0/57822356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a340c5f40 0x7f8a340b03d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:29.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.840+0000 7f8a3b1b0700 1 --2- 172.21.15.1:0/57822356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a341540a0 0x7f8a340a9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:29.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.840+0000 7f8a3b1b0700 1 -- 172.21.15.1:0/57822356 >> 172.21.15.1:0/57822356 conn(0x7f8a34064a70 msgr2=0x7f8a340c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:29.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.840+0000 7f8a3b1b0700 1 -- 172.21.15.1:0/57822356 shutdown_connections 2023-11-15T01:36:29.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.840+0000 7f8a3b1b0700 1 -- 172.21.15.1:0/57822356 wait complete. 2023-11-15T01:36:29.856 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-15T01:36:29.982 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:29.981+0000 7f9288c70680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:36:29.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.981+0000 7fd19706d700 1 Processor -- start 2023-11-15T01:36:29.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.981+0000 7fd19706d700 1 -- start start 2023-11-15T01:36:29.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.982+0000 7fd19706d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd1901541d0 0x7fd1901545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:29.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.982+0000 7fd19706d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1900c8170 0x7fd1900c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:29.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.982+0000 7fd19706d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd190155830 con 0x7fd1900c60d0 2023-11-15T01:36:29.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.982+0000 7fd19706d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd190158f40 con 0x7fd1901541d0 2023-11-15T01:36:29.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.982+0000 7fd19706d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd190154c20 con 0x7fd1900c8170 2023-11-15T01:36:29.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.982+0000 7fd19586a700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd1900c60d0 0x7fd1900c7a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:35132/0 (socket says 172.21.15.1:35132) 2023-11-15T01:36:29.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.982+0000 7fd19586a700 1 -- 172.21.15.1:0/951278473 learned_addr learned my addr 172.21.15.1:0/951278473 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:29.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.982+0000 7fd19686c700 1 --2- 172.21.15.1:0/951278473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1900c8170 0x7fd1900c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:29.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.982+0000 7fd19606b700 1 --2- 172.21.15.1:0/951278473 >> v2:172.21.15.141:3300/0 conn(0x7fd1901541d0 0x7fd1901545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:29.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.982+0000 7fd195069700 1 -- 172.21.15.1:0/951278473 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416869722 0 0) 0x7fd190155830 con 0x7fd1900c60d0 2023-11-15T01:36:29.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.982+0000 7fd195069700 1 -- 172.21.15.1:0/951278473 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd17c0033f0 con 0x7fd1900c60d0 2023-11-15T01:36:29.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.983+0000 7fd19686c700 1 -- 172.21.15.1:0/951278473 >> v2:172.21.15.141:3300/0 conn(0x7fd1901541d0 msgr2=0x7fd1901545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:29.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.983+0000 7fd19686c700 1 --2- 172.21.15.1:0/951278473 >> v2:172.21.15.141:3300/0 conn(0x7fd1901541d0 0x7fd1901545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:29.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.983+0000 7fd19686c700 1 -- 172.21.15.1:0/951278473 >> v1:172.21.15.1:6789/0 conn(0x7fd1900c60d0 legacy=0x7fd1900c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:29.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.983+0000 7fd19686c700 1 -- 172.21.15.1:0/951278473 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd190154f00 con 0x7fd1900c8170 2023-11-15T01:36:29.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.983+0000 7fd19686c700 1 --2- 172.21.15.1:0/951278473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1900c8170 0x7fd1900c6550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fd188009e60 tx=0x7fd188009780).ready entity=mon.2 client_cookie=d7c83992d55a4b52 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:29.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.983+0000 7fd195069700 1 -- 172.21.15.1:0/951278473 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18800e070 con 0x7fd1900c8170 2023-11-15T01:36:29.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.983+0000 7fd195069700 1 -- 172.21.15.1:0/951278473 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18800bab0 con 0x7fd1900c8170 2023-11-15T01:36:29.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.983+0000 7fd195069700 1 -- 172.21.15.1:0/951278473 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18800be30 con 0x7fd1900c8170 2023-11-15T01:36:29.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.983+0000 7fd19706d700 1 -- 172.21.15.1:0/951278473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1900c8170 msgr2=0x7fd1900c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:29.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.983+0000 7fd19706d700 1 --2- 172.21.15.1:0/951278473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1900c8170 0x7fd1900c6550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fd188009e60 tx=0x7fd188009780).stop 2023-11-15T01:36:29.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.984+0000 7fd19706d700 1 -- 172.21.15.1:0/951278473 shutdown_connections 2023-11-15T01:36:29.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.984+0000 7fd19706d700 1 --2- 172.21.15.1:0/951278473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1900c8170 0x7fd1900c6550 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:29.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.984+0000 7fd19706d700 1 --2- 172.21.15.1:0/951278473 >> v2:172.21.15.141:3300/0 conn(0x7fd1901541d0 0x7fd1901545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:29.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.984+0000 7fd19706d700 1 -- 172.21.15.1:0/951278473 >> 172.21.15.1:0/951278473 conn(0x7fd190069ee0 msgr2=0x7fd19006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:29.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.984+0000 7fd19706d700 1 -- 172.21.15.1:0/951278473 shutdown_connections 2023-11-15T01:36:29.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.984+0000 7fd19706d700 1 -- 172.21.15.1:0/951278473 wait complete. 2023-11-15T01:36:29.990 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:29.984+0000 7fb7602bd680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:36:29.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.985+0000 7fd19706d700 1 Processor -- start 2023-11-15T01:36:29.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.985+0000 7fd19706d700 1 -- start start 2023-11-15T01:36:29.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.985+0000 7fd19706d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1900c60d0 0x7fd19014b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:29.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.985+0000 7fd19706d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1900c8170 0x7fd1900c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:29.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.985+0000 7fd19706d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1901541d0 0x7fd1900c3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:29.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.985+0000 7fd19706d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1901589e0 con 0x7fd1901541d0 2023-11-15T01:36:29.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.985+0000 7fd19706d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1900aceb0 con 0x7fd1900c60d0 2023-11-15T01:36:29.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.985+0000 7fd19706d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1900c28b0 con 0x7fd1900c8170 2023-11-15T01:36:29.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd19686c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1901541d0 0x7fd1900c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:29.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd19686c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1901541d0 0x7fd1900c3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60700/0 (socket says 172.21.15.1:60700) 2023-11-15T01:36:29.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd19686c700 1 -- 172.21.15.1:0/2765779239 learned_addr learned my addr 172.21.15.1:0/2765779239 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd19586a700 1 --2- 172.21.15.1:0/2765779239 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1900c8170 0x7fd1900c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd19606b700 1 --2- 172.21.15.1:0/2765779239 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1900c60d0 0x7fd19014b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd19586a700 1 -- 172.21.15.1:0/2765779239 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1900c60d0 msgr2=0x7fd19014b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd19586a700 1 --2- 172.21.15.1:0/2765779239 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1900c60d0 0x7fd19014b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd19586a700 1 -- 172.21.15.1:0/2765779239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1901541d0 msgr2=0x7fd1900c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd19586a700 1 --2- 172.21.15.1:0/2765779239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1901541d0 0x7fd1900c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd19586a700 1 -- 172.21.15.1:0/2765779239 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd188009a20 con 0x7fd1900c8170 2023-11-15T01:36:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd19686c700 1 --2- 172.21.15.1:0/2765779239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1901541d0 0x7fd1900c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd19586a700 1 --2- 172.21.15.1:0/2765779239 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1900c8170 0x7fd1900c2d40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fd18c001ed0 tx=0x7fd18c007bd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd1827fc700 1 -- 172.21.15.1:0/2765779239 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c0070d0 con 0x7fd1900c8170 2023-11-15T01:36:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd1827fc700 1 -- 172.21.15.1:0/2765779239 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c007230 con 0x7fd1900c8170 2023-11-15T01:36:29.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd1827fc700 1 -- 172.21.15.1:0/2765779239 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c0075f0 con 0x7fd1900c8170 2023-11-15T01:36:29.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd19706d700 1 -- 172.21.15.1:0/2765779239 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1900ac2c0 con 0x7fd1900c8170 2023-11-15T01:36:29.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.986+0000 7fd19706d700 1 -- 172.21.15.1:0/2765779239 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1900c2260 con 0x7fd1900c8170 2023-11-15T01:36:29.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.987+0000 7fd19706d700 1 -- 172.21.15.1:0/2765779239 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd190158d70 con 0x7fd1900c8170 2023-11-15T01:36:29.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.988+0000 7fd1827fc700 1 -- 172.21.15.1:0/2765779239 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 25) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fd18c0059b0 con 0x7fd1900c8170 2023-11-15T01:36:29.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.988+0000 7fd1827fc700 1 --2- 172.21.15.1:0/2765779239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd17405f2c0 0x7fd174061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:29.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.988+0000 7fd1827fc700 1 -- 172.21.15.1:0/2765779239 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fd18c079be0 con 0x7fd1900c8170 2023-11-15T01:36:29.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.988+0000 7fd19606b700 1 -- 172.21.15.1:0/2765779239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd17405f2c0 msgr2=0x7fd174061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:29.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.988+0000 7fd19606b700 1 --2- 172.21.15.1:0/2765779239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd17405f2c0 0x7fd174061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:29.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:29.992+0000 7fd1827fc700 1 -- 172.21.15.1:0/2765779239 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd18c04ab80 con 0x7fd1900c8170 2023-11-15T01:36:30.046 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:30.045+0000 7f9288c70680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:36:30.053 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:30.051+0000 7fb7602bd680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:36:30.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.169+0000 7fd19706d700 1 -- 172.21.15.1:0/2765779239 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fd1900475e0 con 0x7fd1900c8170 2023-11-15T01:36:30.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.174+0000 7fd1827fc700 1 -- 172.21.15.1:0/2765779239 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd18c04e1a0 con 0x7fd1900c8170 2023-11-15T01:36:30.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.176+0000 7fd19706d700 1 -- 172.21.15.1:0/2765779239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd17405f2c0 msgr2=0x7fd174061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:30.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.176+0000 7fd19706d700 1 --2- 172.21.15.1:0/2765779239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd17405f2c0 0x7fd174061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:30.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.176+0000 7fd19706d700 1 -- 172.21.15.1:0/2765779239 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1900c8170 msgr2=0x7fd1900c2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:30.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.176+0000 7fd19706d700 1 --2- 172.21.15.1:0/2765779239 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1900c8170 0x7fd1900c2d40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fd18c001ed0 tx=0x7fd18c007bd0).stop 2023-11-15T01:36:30.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.177+0000 7fd19706d700 1 -- 172.21.15.1:0/2765779239 shutdown_connections 2023-11-15T01:36:30.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.177+0000 7fd19706d700 1 --2- 172.21.15.1:0/2765779239 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd17405f2c0 0x7fd174061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:30.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.177+0000 7fd19706d700 1 --2- 172.21.15.1:0/2765779239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1901541d0 0x7fd1900c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:30.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.177+0000 7fd19706d700 1 --2- 172.21.15.1:0/2765779239 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1900c60d0 0x7fd19014b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:30.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.177+0000 7fd19706d700 1 --2- 172.21.15.1:0/2765779239 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1900c8170 0x7fd1900c2d40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:30.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.177+0000 7fd19706d700 1 -- 172.21.15.1:0/2765779239 >> 172.21.15.1:0/2765779239 conn(0x7fd190069ee0 msgr2=0x7fd1900cb560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:30.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.177+0000 7fd19706d700 1 -- 172.21.15.1:0/2765779239 shutdown_connections 2023-11-15T01:36:30.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.177+0000 7fd19706d700 1 -- 172.21.15.1:0/2765779239 wait complete. 2023-11-15T01:36:30.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:36:30.190 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-15T01:36:30.210 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-11-15T01:36:30.321 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:30.320+0000 7f9288c70680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:36:30.343 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:30.342+0000 7fb7602bd680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:36:30.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.372+0000 7fd00851a700 1 Processor -- start 2023-11-15T01:36:30.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.372+0000 7fd00851a700 1 -- start start 2023-11-15T01:36:30.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.373+0000 7fd00851a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd000157660 0x7fd000157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:30.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.373+0000 7fd00851a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0000c1cb0 0x7fd0000c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:30.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.373+0000 7fd00851a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0000c1820 con 0x7fd0000c6770 2023-11-15T01:36:30.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.373+0000 7fd00851a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0000c7540 con 0x7fd000157660 2023-11-15T01:36:30.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.373+0000 7fd00851a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000c0c30 con 0x7fd0000c1cb0 2023-11-15T01:36:30.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.373+0000 7fd006ab7700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd0000c6770 0x7fd0000aa060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:35146/0 (socket says 172.21.15.1:35146) 2023-11-15T01:36:30.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.373+0000 7fd006ab7700 1 -- 172.21.15.1:0/1940331494 learned_addr learned my addr 172.21.15.1:0/1940331494 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:30.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.373+0000 7fd0062b6700 1 --2- 172.21.15.1:0/1940331494 >> v2:172.21.15.141:3300/0 conn(0x7fd000157660 0x7fd000157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:30.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.373+0000 7fd005ab5700 1 --2- 172.21.15.1:0/1940331494 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0000c1cb0 0x7fd0000c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:30.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 -- 172.21.15.1:0/1940331494 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497177947 0 0) 0x7fd0000c1820 con 0x7fd0000c6770 2023-11-15T01:36:30.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 -- 172.21.15.1:0/1940331494 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfec0033f0 con 0x7fd0000c6770 2023-11-15T01:36:30.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 -- 172.21.15.1:0/1940331494 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3086916513 0 0) 0x7fcfec0033f0 con 0x7fd0000c6770 2023-11-15T01:36:30.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 -- 172.21.15.1:0/1940331494 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0000c1cb0 msgr2=0x7fd0000c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:30.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 --2- 172.21.15.1:0/1940331494 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0000c1cb0 0x7fd0000c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:30.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 -- 172.21.15.1:0/1940331494 >> v2:172.21.15.141:3300/0 conn(0x7fd000157660 msgr2=0x7fd000157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 --2- 172.21.15.1:0/1940331494 >> v2:172.21.15.141:3300/0 conn(0x7fd000157660 0x7fd000157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 -- 172.21.15.1:0/1940331494 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0000c0ef0 con 0x7fd0000c6770 2023-11-15T01:36:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 -- 172.21.15.1:0/1940331494 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fcff80017f0 con 0x7fd0000c6770 2023-11-15T01:36:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 -- 172.21.15.1:0/1940331494 >> v1:172.21.15.1:6789/0 conn(0x7fd0000c6770 legacy=0x7fd0000aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 --2- 172.21.15.1:0/1940331494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfec0038e0 0x7fcfec003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:30.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 --2- 172.21.15.1:0/1940331494 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfec004690 0x7fcfec004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:30.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 --2- 172.21.15.1:0/1940331494 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0000c1cb0 0x7fcfec005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:30.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 -- 172.21.15.1:0/1940331494 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000c0c30 con 0x7fcfec0038e0 2023-11-15T01:36:30.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 -- 172.21.15.1:0/1940331494 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec00b8e0 con 0x7fcfec004690 2023-11-15T01:36:30.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0052b4700 1 -- 172.21.15.1:0/1940331494 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec00ba20 con 0x7fd0000c1cb0 2023-11-15T01:36:30.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0062b6700 1 --2- 172.21.15.1:0/1940331494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfec0038e0 0x7fcfec003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:30.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd005ab5700 1 --2- 172.21.15.1:0/1940331494 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfec004690 0x7fcfec004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:30.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd006ab7700 1 --2- 172.21.15.1:0/1940331494 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0000c1cb0 0x7fcfec005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:30.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0062b6700 1 -- 172.21.15.1:0/1940331494 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0000c1cb0 msgr2=0x7fcfec005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:30.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0062b6700 1 --2- 172.21.15.1:0/1940331494 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0000c1cb0 0x7fcfec005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:30.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0062b6700 1 -- 172.21.15.1:0/1940331494 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfec004690 msgr2=0x7fcfec004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:30.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0062b6700 1 --2- 172.21.15.1:0/1940331494 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfec004690 0x7fcfec004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:30.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd0062b6700 1 -- 172.21.15.1:0/1940331494 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec0033f0 con 0x7fcfec0038e0 2023-11-15T01:36:30.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd005ab5700 1 --2- 172.21.15.1:0/1940331494 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfec004690 0x7fcfec004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:30.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.374+0000 7fd006ab7700 1 --2- 172.21.15.1:0/1940331494 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0000c1cb0 0x7fcfec005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:30.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.375+0000 7fd0062b6700 1 --2- 172.21.15.1:0/1940331494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfec0038e0 0x7fcfec003d00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fcff0009a80 tx=0x7fcff0009060).ready entity=mon.0 client_cookie=6f8036c9571aad5d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:30.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.375+0000 7fd0052b4700 1 -- 172.21.15.1:0/1940331494 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0009430 con 0x7fcfec0038e0 2023-11-15T01:36:30.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.375+0000 7fd0052b4700 1 -- 172.21.15.1:0/1940331494 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff000e640 con 0x7fcfec0038e0 2023-11-15T01:36:30.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.375+0000 7fd0052b4700 1 -- 172.21.15.1:0/1940331494 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000e9c0 con 0x7fcfec0038e0 2023-11-15T01:36:30.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.375+0000 7fd00851a700 1 -- 172.21.15.1:0/1940331494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfec0038e0 msgr2=0x7fcfec003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:30.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.375+0000 7fd00851a700 1 --2- 172.21.15.1:0/1940331494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfec0038e0 0x7fcfec003d00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fcff0009a80 tx=0x7fcff0009060).stop 2023-11-15T01:36:30.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.375+0000 7fd006ab7700 1 -- 172.21.15.1:0/1940331494 reap_dead start 2023-11-15T01:36:30.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.375+0000 7fd00851a700 1 -- 172.21.15.1:0/1940331494 shutdown_connections 2023-11-15T01:36:30.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.375+0000 7fd00851a700 1 -- 172.21.15.1:0/1940331494 >> 172.21.15.1:0/1940331494 conn(0x7fd000064aa0 msgr2=0x7fd000064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:30.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.375+0000 7fd00851a700 1 -- 172.21.15.1:0/1940331494 shutdown_connections 2023-11-15T01:36:30.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.375+0000 7fd00851a700 1 -- 172.21.15.1:0/1940331494 wait complete. 2023-11-15T01:36:30.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.377+0000 7fd00851a700 1 Processor -- start 2023-11-15T01:36:30.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.377+0000 7fd00851a700 1 -- start start 2023-11-15T01:36:30.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.377+0000 7fd00851a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfec0038e0 0x7fd000152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:30.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.377+0000 7fd00851a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd000164620 0x7fd000164aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:30.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.377+0000 7fd00851a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0000c4480 0x7fd0000c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:30.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.377+0000 7fd00851a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000c4dd0 con 0x7fcfec0038e0 2023-11-15T01:36:30.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.377+0000 7fd00851a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000c3ff0 con 0x7fd000164620 2023-11-15T01:36:30.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.377+0000 7fd00851a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd000158d60 con 0x7fd0000c4480 2023-11-15T01:36:30.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.377+0000 7fd0062b6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfec0038e0 0x7fd000152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:30.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.377+0000 7fd0062b6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfec0038e0 0x7fd000152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60720/0 (socket says 172.21.15.1:60720) 2023-11-15T01:36:30.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.377+0000 7fd0062b6700 1 -- 172.21.15.1:0/858570256 learned_addr learned my addr 172.21.15.1:0/858570256 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:30.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.378+0000 7fd005ab5700 1 --2- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd000164620 0x7fd000164aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:30.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.378+0000 7fd006ab7700 1 --2- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0000c4480 0x7fd0000c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:30.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.378+0000 7fd0062b6700 1 -- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0000c4480 msgr2=0x7fd0000c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:30.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.378+0000 7fd0062b6700 1 --2- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0000c4480 0x7fd0000c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:30.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.378+0000 7fd0062b6700 1 -- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd000164620 msgr2=0x7fd000164aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:30.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.378+0000 7fd0062b6700 1 --2- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd000164620 0x7fd000164aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:30.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.378+0000 7fd0062b6700 1 -- 172.21.15.1:0/858570256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd000152d60 con 0x7fcfec0038e0 2023-11-15T01:36:30.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.378+0000 7fd0062b6700 1 --2- 172.21.15.1:0/858570256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfec0038e0 0x7fd000152870 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7fcfec0055c0 tx=0x7fcff001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:30.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.378+0000 7fcff67fc700 1 -- 172.21.15.1:0/858570256 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0009ec0 con 0x7fcfec0038e0 2023-11-15T01:36:30.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.378+0000 7fcff67fc700 1 -- 172.21.15.1:0/858570256 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff000ed30 con 0x7fcfec0038e0 2023-11-15T01:36:30.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.378+0000 7fd00851a700 1 -- 172.21.15.1:0/858570256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0000c33e0 con 0x7fcfec0038e0 2023-11-15T01:36:30.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.378+0000 7fcff67fc700 1 -- 172.21.15.1:0/858570256 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000eea0 con 0x7fcfec0038e0 2023-11-15T01:36:30.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.378+0000 7fd00851a700 1 -- 172.21.15.1:0/858570256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0000c39a0 con 0x7fcfec0038e0 2023-11-15T01:36:30.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.379+0000 7fd00851a700 1 -- 172.21.15.1:0/858570256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00006c7e0 con 0x7fcfec0038e0 2023-11-15T01:36:30.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.380+0000 7fcff67fc700 1 -- 172.21.15.1:0/858570256 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 25) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fcff002f440 con 0x7fcfec0038e0 2023-11-15T01:36:30.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.380+0000 7fcff67fc700 1 --2- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 0x7fcfe4061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:30.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.380+0000 7fcff67fc700 1 -- 172.21.15.1:0/858570256 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fcff007c4f0 con 0x7fcfec0038e0 2023-11-15T01:36:30.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.380+0000 7fd005ab5700 1 -- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 msgr2=0x7fcfe4061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:30.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.380+0000 7fd005ab5700 1 --2- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 0x7fcfe4061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:30.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.384+0000 7fcff67fc700 1 -- 172.21.15.1:0/858570256 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcff004d530 con 0x7fcfec0038e0 2023-11-15T01:36:30.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.581+0000 7fd005ab5700 1 -- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 msgr2=0x7fcfe4061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:30.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.581+0000 7fd005ab5700 1 --2- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 0x7fcfe4061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:36:30.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.584+0000 7fd00851a700 1 -- 172.21.15.1:0/858570256 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0000c11d0 con 0x7fcfe405f2c0 2023-11-15T01:36:30.932 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:30.931+0000 7f9288c70680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:36:30.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.982+0000 7fd005ab5700 1 -- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 msgr2=0x7fcfe4061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:30.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:30.982+0000 7fd005ab5700 1 --2- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 0x7fcfe4061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-15T01:36:31.004 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:31.003+0000 7f9288c70680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:36:31.009 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:31.008+0000 7fb7602bd680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:36:31.077 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:31.076+0000 7fb7602bd680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:36:31.191 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:31.190+0000 7f9288c70680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:36:31.271 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:31.270+0000 7fb7602bd680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:36:31.611 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:31.610+0000 7f9288c70680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:36:31.710 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:31.709+0000 7fb7602bd680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:36:31.713 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:31.713+0000 7f9288c70680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:36:31.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:31.783+0000 7fd005ab5700 1 -- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 msgr2=0x7fcfe4061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:31.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:31.783+0000 7fd005ab5700 1 --2- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 0x7fcfe4061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-15T01:36:31.820 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:31.818+0000 7fb7602bd680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:36:31.865 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:31.865+0000 7f9288c70680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:36:31.940 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:31.940+0000 7f9288c70680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:36:31.979 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:31.978+0000 7fb7602bd680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:36:32.007 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:32.006+0000 7f9288c70680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:36:32.057 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:32.056+0000 7fb7602bd680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:36:32.128 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:32.126+0000 7fb7602bd680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:36:32.275 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:32.262+0000 7f9288c70680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:36:32.403 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:32.402+0000 7fb7602bd680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:36:32.447 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:32.446+0000 7f9288c70680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:36:32.594 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:32.593+0000 7fb7602bd680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:36:33.093 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:33.093+0000 7f9288c70680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:36:33.162 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:33.161+0000 7f9288c70680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:36:33.238 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:33.235+0000 7f9288c70680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:36:33.276 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:33.275+0000 7fb7602bd680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:36:33.347 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:33.346+0000 7fb7602bd680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:36:33.381 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:33.380+0000 7f9288c70680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:36:33.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:33.384+0000 7fd005ab5700 1 -- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 msgr2=0x7fcfe4061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:33.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:33.384+0000 7fd005ab5700 1 --2- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 0x7fcfe4061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-15T01:36:33.425 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:33.424+0000 7fb7602bd680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:36:33.451 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:33.450+0000 7f9288c70680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:36:33.566 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:33.566+0000 7f9288c70680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:36:33.577 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:33.576+0000 7fb7602bd680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:36:33.651 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:33.649+0000 7fb7602bd680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:36:33.673 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:33.673+0000 7f9288c70680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:36:33.771 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:33.770+0000 7fb7602bd680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:36:33.884 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:33.883+0000 7fb7602bd680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:36:33.965 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:33.964+0000 7f9288c70680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:36:34.035 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:34.034+0000 7f9288c70680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:36:34.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:34.054+0000 7fcff67fc700 1 -- 172.21.15.1:0/858570256 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 26) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fcff007a050 con 0x7fcfec0038e0 2023-11-15T01:36:34.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:34.054+0000 7fcff67fc700 1 -- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 msgr2=0x7fcfe4061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:34.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:34.054+0000 7fcff67fc700 1 --2- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 0x7fcfe4061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:34.116 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:34.115+0000 7f92003fb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:34.116 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:34.115+0000 7f92003fb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:34.116 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:34.115+0000 7f92003fb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:34.117 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:34.115+0000 7f92003fb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:34.117 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:34.115+0000 7f92003fb700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:34.117 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:34.115+0000 7f91fd3f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:34.117 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:34.115+0000 7f91fd3f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:34.118 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:34.115+0000 7f91fd3f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:34.118 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:34.115+0000 7f91fd3f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:34.118 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:34.115+0000 7f91fd3f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:34.191 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:34.190+0000 7fb7602bd680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:36:34.265 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:34.263+0000 7fb7602bd680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:36:35.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.060+0000 7fcff67fc700 1 -- 172.21.15.1:0/858570256 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 27) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fcff007a3d0 con 0x7fcfec0038e0 2023-11-15T01:36:35.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.060+0000 7fcff67fc700 1 --2- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 0x7fcfe4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:35.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.060+0000 7fcff67fc700 1 -- 172.21.15.1:0/858570256 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0000c11d0 con 0x7fcfe405f2c0 2023-11-15T01:36:35.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.060+0000 7fd005ab5700 1 --2- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 0x7fcfe4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:35.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.061+0000 7fd005ab5700 1 --2- 172.21.15.1:0/858570256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfe405f2c0 0x7fcfe4061700 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fcffc006d80 tx=0x7fcffc009060).ready entity=mgr.5576 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:35.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.064+0000 7fcff67fc700 1 -- 172.21.15.1:0/858570256 <== mgr.5576 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fd0000c11d0 con 0x7fcfe405f2c0 2023-11-15T01:36:35.067 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:35.064+0000 7f9207409700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-11-15T01:36:35.068 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-11-15T01:36:35.071 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-11-15T01:36:35.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:36:35.074 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-11-15T01:36:35.094 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-15T01:36:35.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.256+0000 7f777ff06700 1 Processor -- start 2023-11-15T01:36:35.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.256+0000 7f777ff06700 1 -- start start 2023-11-15T01:36:35.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.257+0000 7f777ff06700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f777814e6e0 0x7f777814eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:35.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.257+0000 7f777ff06700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7778062ec0 0x7f77780c6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:35.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.257+0000 7f777ff06700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7778158e40 con 0x7f7778155370 2023-11-15T01:36:35.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.257+0000 7f777ff06700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7778158230 con 0x7f7778062ec0 2023-11-15T01:36:35.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.257+0000 7f777ff06700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7778158510 con 0x7f777814e6e0 2023-11-15T01:36:35.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.257+0000 7f777e4a3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7778062ec0 0x7f77780c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:35.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.257+0000 7f777d4a1700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7778155370 0x7f77780627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:35162/0 (socket says 172.21.15.1:35162) 2023-11-15T01:36:35.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.257+0000 7f777d4a1700 1 -- 172.21.15.1:0/24756123 learned_addr learned my addr 172.21.15.1:0/24756123 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:35.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.257+0000 7f777dca2700 1 --2- 172.21.15.1:0/24756123 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f777814e6e0 0x7f777814eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:35.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.258+0000 7f777e4a3700 1 -- 172.21.15.1:0/24756123 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f777814e6e0 msgr2=0x7f777814eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:35.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.258+0000 7f777e4a3700 1 --2- 172.21.15.1:0/24756123 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f777814e6e0 0x7f777814eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:35.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.258+0000 7f777e4a3700 1 -- 172.21.15.1:0/24756123 >> v1:172.21.15.1:6789/0 conn(0x7f7778155370 legacy=0x7f77780627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:35.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.258+0000 7f777cca0700 1 -- 172.21.15.1:0/24756123 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863584986 0 0) 0x7f7778158e40 con 0x7f7778155370 2023-11-15T01:36:35.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.258+0000 7f777e4a3700 1 -- 172.21.15.1:0/24756123 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77781587f0 con 0x7f7778062ec0 2023-11-15T01:36:35.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.258+0000 7f777e4a3700 1 --2- 172.21.15.1:0/24756123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7778062ec0 0x7f77780c6480 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f7770009760 tx=0x7f7770009060).ready entity=mon.0 client_cookie=9770c8b97d535901 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:35.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.258+0000 7f777cca0700 1 -- 172.21.15.1:0/24756123 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777000f510 con 0x7f7778062ec0 2023-11-15T01:36:35.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.258+0000 7f777cca0700 1 -- 172.21.15.1:0/24756123 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777000f670 con 0x7f7778062ec0 2023-11-15T01:36:35.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.258+0000 7f777cca0700 1 -- 172.21.15.1:0/24756123 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777000f9f0 con 0x7f7778062ec0 2023-11-15T01:36:35.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.258+0000 7f777ff06700 1 -- 172.21.15.1:0/24756123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7778062ec0 msgr2=0x7f77780c6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:35.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.258+0000 7f777ff06700 1 --2- 172.21.15.1:0/24756123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7778062ec0 0x7f77780c6480 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f7770009760 tx=0x7f7770009060).stop 2023-11-15T01:36:35.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.258+0000 7f777ff06700 1 -- 172.21.15.1:0/24756123 shutdown_connections 2023-11-15T01:36:35.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.259+0000 7f777ff06700 1 --2- 172.21.15.1:0/24756123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7778062ec0 0x7f77780c6480 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:35.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.259+0000 7f777ff06700 1 --2- 172.21.15.1:0/24756123 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f777814e6e0 0x7f777814eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:35.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.259+0000 7f777ff06700 1 -- 172.21.15.1:0/24756123 >> 172.21.15.1:0/24756123 conn(0x7f77780c7dc0 msgr2=0x7f77780c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:35.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.259+0000 7f777ff06700 1 -- 172.21.15.1:0/24756123 shutdown_connections 2023-11-15T01:36:35.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.259+0000 7f777ff06700 1 -- 172.21.15.1:0/24756123 wait complete. 2023-11-15T01:36:35.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.260+0000 7f777ff06700 1 Processor -- start 2023-11-15T01:36:35.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.260+0000 7f777ff06700 1 -- start start 2023-11-15T01:36:35.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777ff06700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7778062ec0 0x7f77781399e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:35.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777ff06700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f777814e6e0 0x7f77780a82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:35.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777ff06700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7778155370 0x7f77780a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:35.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777ff06700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7778139ed0 con 0x7f7778155370 2023-11-15T01:36:35.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777ff06700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77780abc90 con 0x7f7778062ec0 2023-11-15T01:36:35.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777ff06700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77780ab960 con 0x7f777814e6e0 2023-11-15T01:36:35.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777e4a3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7778155370 0x7f77780a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:35.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777e4a3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7778155370 0x7f77780a64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60740/0 (socket says 172.21.15.1:60740) 2023-11-15T01:36:35.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777e4a3700 1 -- 172.21.15.1:0/3832193656 learned_addr learned my addr 172.21.15.1:0/3832193656 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:35.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777d4a1700 1 --2- 172.21.15.1:0/3832193656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f777814e6e0 0x7f77780a82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:35.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777dca2700 1 --2- 172.21.15.1:0/3832193656 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7778062ec0 0x7f77781399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:35.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777e4a3700 1 -- 172.21.15.1:0/3832193656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f777814e6e0 msgr2=0x7f77780a82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:35.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777e4a3700 1 --2- 172.21.15.1:0/3832193656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f777814e6e0 0x7f77780a82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:35.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777e4a3700 1 -- 172.21.15.1:0/3832193656 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7778062ec0 msgr2=0x7f77781399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:35.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777e4a3700 1 --2- 172.21.15.1:0/3832193656 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7778062ec0 0x7f77781399e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:35.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777e4a3700 1 -- 172.21.15.1:0/3832193656 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77700092a0 con 0x7f7778155370 2023-11-15T01:36:35.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777d4a1700 1 --2- 172.21.15.1:0/3832193656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f777814e6e0 0x7f77780a82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:35.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777e4a3700 1 --2- 172.21.15.1:0/3832193656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7778155370 0x7f77780a64a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f77780bed30 tx=0x7f7770017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:35.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f7775ffb700 1 -- 172.21.15.1:0/3832193656 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777000f9f0 con 0x7f7778155370 2023-11-15T01:36:35.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f7775ffb700 1 -- 172.21.15.1:0/3832193656 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777001b410 con 0x7f7778155370 2023-11-15T01:36:35.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f777ff06700 1 -- 172.21.15.1:0/3832193656 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77780a8bc0 con 0x7f7778155370 2023-11-15T01:36:35.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.261+0000 7f7775ffb700 1 -- 172.21.15.1:0/3832193656 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777001b7d0 con 0x7f7778155370 2023-11-15T01:36:35.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.262+0000 7f777ff06700 1 -- 172.21.15.1:0/3832193656 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77780a9180 con 0x7f7778155370 2023-11-15T01:36:35.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.262+0000 7f777ff06700 1 -- 172.21.15.1:0/3832193656 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777806c7e0 con 0x7f7778155370 2023-11-15T01:36:35.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.263+0000 7f7775ffb700 1 -- 172.21.15.1:0/3832193656 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 27) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f777001bb80 con 0x7f7778155370 2023-11-15T01:36:35.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.263+0000 7f7775ffb700 1 --2- 172.21.15.1:0/3832193656 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f776405f080 0x7f7764061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:35.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.263+0000 7f7775ffb700 1 -- 172.21.15.1:0/3832193656 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f777007bfc0 con 0x7f7778155370 2023-11-15T01:36:35.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.263+0000 7f777dca2700 1 --2- 172.21.15.1:0/3832193656 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f776405f080 0x7f7764061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:35.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.264+0000 7f777dca2700 1 --2- 172.21.15.1:0/3832193656 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f776405f080 0x7f7764061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f77680076c0 tx=0x7f776800b040).ready entity=mgr.5576 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:35.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.268+0000 7f7775ffb700 1 -- 172.21.15.1:0/3832193656 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f777004d1b0 con 0x7f7778155370 2023-11-15T01:36:35.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:35.489+0000 7f777ff06700 1 -- 172.21.15.1:0/3832193656 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f77780abdd0 con 0x7f7778155370 2023-11-15T01:36:36.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.063+0000 7f7775ffb700 1 -- 172.21.15.1:0/3832193656 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 28) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f7770079cb0 con 0x7f7778155370 2023-11-15T01:36:36.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.065+0000 7f7775ffb700 1 -- 172.21.15.1:0/3832193656 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v28) v1 ==== 93+0+0 (secure 0 0 0) 0x7f7770042780 con 0x7f7778155370 2023-11-15T01:36:36.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.067+0000 7f777ff06700 1 -- 172.21.15.1:0/3832193656 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f776405f080 msgr2=0x7f7764061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:36.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.067+0000 7f777ff06700 1 --2- 172.21.15.1:0/3832193656 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f776405f080 0x7f7764061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f77680076c0 tx=0x7f776800b040).stop 2023-11-15T01:36:36.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.067+0000 7f777ff06700 1 -- 172.21.15.1:0/3832193656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7778155370 msgr2=0x7f77780a64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:36.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.067+0000 7f777ff06700 1 --2- 172.21.15.1:0/3832193656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7778155370 0x7f77780a64a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f77780bed30 tx=0x7f7770017000).stop 2023-11-15T01:36:36.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.067+0000 7f777ff06700 1 -- 172.21.15.1:0/3832193656 shutdown_connections 2023-11-15T01:36:36.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.067+0000 7f777ff06700 1 --2- 172.21.15.1:0/3832193656 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f776405f080 0x7f7764061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.067+0000 7f777ff06700 1 --2- 172.21.15.1:0/3832193656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7778155370 0x7f77780a64a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.067+0000 7f777ff06700 1 --2- 172.21.15.1:0/3832193656 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7778062ec0 0x7f77781399e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.067+0000 7f777ff06700 1 --2- 172.21.15.1:0/3832193656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f777814e6e0 0x7f77780a82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.067+0000 7f777ff06700 1 -- 172.21.15.1:0/3832193656 >> 172.21.15.1:0/3832193656 conn(0x7f77780c7dc0 msgr2=0x7f77780627b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:36.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.067+0000 7f777ff06700 1 -- 172.21.15.1:0/3832193656 shutdown_connections 2023-11-15T01:36:36.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.067+0000 7f777ff06700 1 -- 172.21.15.1:0/3832193656 wait complete. 2023-11-15T01:36:36.086 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T01:36:36.086 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:36:36.123 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:36:36.163 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T01:36:36.164 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-15T01:36:36.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:36:36.165 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-15T01:36:36.202 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T01:36:36.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:36:36.203 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-15T01:36:36.217 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:36.216+0000 7f79780df680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:36:36.218 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:36.217+0000 7f427ac4d680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:36:36.231 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:36:36.279 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:36.279+0000 7f427ac4d680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:36:36.283 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:36.282+0000 7f79780df680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:36:36.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.392+0000 7f9b91b60700 1 Processor -- start 2023-11-15T01:36:36.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.392+0000 7f9b91b60700 1 -- start start 2023-11-15T01:36:36.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b91b60700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9b8c154150 0x7f9b8c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:36.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b91b60700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9b8c0aa060 0x7f9b8c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:36.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b91b60700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8c0c06f0 con 0x7f9b8c0ab1a0 2023-11-15T01:36:36.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b91b60700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8c0c09d0 con 0x7f9b8c154150 2023-11-15T01:36:36.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b91b60700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8c158820 con 0x7f9b8c0aa060 2023-11-15T01:36:36.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b8b7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9b8c154150 0x7f9b8c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:36.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b8b7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9b8c154150 0x7f9b8c154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60760/0 (socket says 172.21.15.1:60760) 2023-11-15T01:36:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b8b7fe700 1 -- 172.21.15.1:0/2381753825 learned_addr learned my addr 172.21.15.1:0/2381753825 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b8bfff700 1 --2- 172.21.15.1:0/2381753825 >> v2:172.21.15.141:3300/0 conn(0x7f9b8c0aa060 0x7f9b8c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b8b7fe700 1 -- 172.21.15.1:0/2381753825 >> v2:172.21.15.141:3300/0 conn(0x7f9b8c0aa060 msgr2=0x7f9b8c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b8b7fe700 1 --2- 172.21.15.1:0/2381753825 >> v2:172.21.15.141:3300/0 conn(0x7f9b8c0aa060 0x7f9b8c0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b8b7fe700 1 -- 172.21.15.1:0/2381753825 >> v1:172.21.15.141:6789/0 conn(0x7f9b8c0ab1a0 legacy=0x7f9b8c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b8b7fe700 1 -- 172.21.15.1:0/2381753825 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c158b00 con 0x7f9b8c154150 2023-11-15T01:36:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b8b7fe700 1 --2- 172.21.15.1:0/2381753825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b8c154150 0x7f9b8c154530 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f9b8c157f80 tx=0x7f9b7c0090f0).ready entity=mon.0 client_cookie=2448cc67bda4b4ef server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b8affd700 1 -- 172.21.15.1:0/2381753825 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00b520 con 0x7f9b8c154150 2023-11-15T01:36:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b8affd700 1 -- 172.21.15.1:0/2381753825 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c00b680 con 0x7f9b8c154150 2023-11-15T01:36:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.393+0000 7f9b8affd700 1 -- 172.21.15.1:0/2381753825 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00ba20 con 0x7f9b8c154150 2023-11-15T01:36:36.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.394+0000 7f9b91b60700 1 -- 172.21.15.1:0/2381753825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b8c154150 msgr2=0x7f9b8c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:36.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.394+0000 7f9b91b60700 1 --2- 172.21.15.1:0/2381753825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b8c154150 0x7f9b8c154530 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f9b8c157f80 tx=0x7f9b7c0090f0).stop 2023-11-15T01:36:36.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.394+0000 7f9b91b60700 1 -- 172.21.15.1:0/2381753825 shutdown_connections 2023-11-15T01:36:36.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.394+0000 7f9b91b60700 1 --2- 172.21.15.1:0/2381753825 >> v2:172.21.15.141:3300/0 conn(0x7f9b8c0aa060 0x7f9b8c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.394+0000 7f9b91b60700 1 --2- 172.21.15.1:0/2381753825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b8c154150 0x7f9b8c154530 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.394+0000 7f9b91b60700 1 -- 172.21.15.1:0/2381753825 >> 172.21.15.1:0/2381753825 conn(0x7f9b8c064aa0 msgr2=0x7f9b8c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.394+0000 7f9b91b60700 1 -- 172.21.15.1:0/2381753825 shutdown_connections 2023-11-15T01:36:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.394+0000 7f9b91b60700 1 -- 172.21.15.1:0/2381753825 wait complete. 2023-11-15T01:36:36.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.395+0000 7f9b91b60700 1 Processor -- start 2023-11-15T01:36:36.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.395+0000 7f9b91b60700 1 -- start start 2023-11-15T01:36:36.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.396+0000 7f9b91b60700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b8c0aa060 0x7f9b8c0c2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:36.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.396+0000 7f9b91b60700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b8c0ab1a0 0x7f9b8c0ab640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:36.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.396+0000 7f9b91b60700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b8c154150 0x7f9b8c0abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:36.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.396+0000 7f9b91b60700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c0ac020 con 0x7f9b8c154150 2023-11-15T01:36:36.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.396+0000 7f9b91b60700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c151780 con 0x7f9b8c0aa060 2023-11-15T01:36:36.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.396+0000 7f9b91b60700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c14fc80 con 0x7f9b8c0ab1a0 2023-11-15T01:36:36.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.396+0000 7f9b8bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b8c154150 0x7f9b8c0abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:36.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.396+0000 7f9b8bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b8c154150 0x7f9b8c0abb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60762/0 (socket says 172.21.15.1:60762) 2023-11-15T01:36:36.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.396+0000 7f9b8bfff700 1 -- 172.21.15.1:0/1658554382 learned_addr learned my addr 172.21.15.1:0/1658554382 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:36.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.396+0000 7f9b8b7fe700 1 --2- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b8c0aa060 0x7f9b8c0c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:36.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.397+0000 7f9b82ffd700 1 --2- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b8c0ab1a0 0x7f9b8c0ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:36.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.397+0000 7f9b8bfff700 1 -- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b8c0ab1a0 msgr2=0x7f9b8c0ab640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:36.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.397+0000 7f9b8bfff700 1 --2- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b8c0ab1a0 0x7f9b8c0ab640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.397+0000 7f9b8bfff700 1 -- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b8c0aa060 msgr2=0x7f9b8c0c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:36.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.397+0000 7f9b8bfff700 1 --2- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b8c0aa060 0x7f9b8c0c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.397+0000 7f9b8bfff700 1 -- 172.21.15.1:0/1658554382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c009370 con 0x7f9b8c154150 2023-11-15T01:36:36.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.397+0000 7f9b8b7fe700 1 --2- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b8c0aa060 0x7f9b8c0c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:36.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.397+0000 7f9b8bfff700 1 --2- 172.21.15.1:0/1658554382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b8c154150 0x7f9b8c0abb30 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f9b84009ec0 tx=0x7f9b8400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:36.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.397+0000 7f9b83fff700 1 -- 172.21.15.1:0/1658554382 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8400cb10 con 0x7f9b8c154150 2023-11-15T01:36:36.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.397+0000 7f9b83fff700 1 -- 172.21.15.1:0/1658554382 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8400f040 con 0x7f9b8c154150 2023-11-15T01:36:36.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.397+0000 7f9b91b60700 1 -- 172.21.15.1:0/1658554382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8c0c3a40 con 0x7f9b8c154150 2023-11-15T01:36:36.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.397+0000 7f9b83fff700 1 -- 172.21.15.1:0/1658554382 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8400ce80 con 0x7f9b8c154150 2023-11-15T01:36:36.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.397+0000 7f9b91b60700 1 -- 172.21.15.1:0/1658554382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8c0c4000 con 0x7f9b8c154150 2023-11-15T01:36:36.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.398+0000 7f9b91b60700 1 -- 172.21.15.1:0/1658554382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8c151930 con 0x7f9b8c154150 2023-11-15T01:36:36.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.399+0000 7f9b83fff700 1 -- 172.21.15.1:0/1658554382 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 28) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f9b84013610 con 0x7f9b8c154150 2023-11-15T01:36:36.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.400+0000 7f9b83fff700 1 --2- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b6c05f030 0x7f9b6c0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:36.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.400+0000 7f9b8b7fe700 1 -- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b6c05f030 msgr2=0x7f9b6c0614f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:36.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.400+0000 7f9b83fff700 1 -- 172.21.15.1:0/1658554382 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f9b8407a950 con 0x7f9b8c154150 2023-11-15T01:36:36.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.400+0000 7f9b8b7fe700 1 --2- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b6c05f030 0x7f9b6c0614f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:36.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.404+0000 7f9b83fff700 1 -- 172.21.15.1:0/1658554382 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9b8c151930 con 0x7f9b8c154150 2023-11-15T01:36:36.553 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:36.553+0000 7f427ac4d680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:36:36.577 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:36.576+0000 7f79780df680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:36:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.601+0000 7f9b8b7fe700 1 -- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b6c05f030 msgr2=0x7f9b6c0614f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.601+0000 7f9b8b7fe700 1 --2- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b6c05f030 0x7f9b6c0614f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:36:36.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.623+0000 7f9b91b60700 1 -- 172.21.15.1:0/1658554382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b8c151930 con 0x7f9b8c154150 2023-11-15T01:36:36.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.623+0000 7f9b83fff700 1 -- 172.21.15.1:0/1658554382 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4487 (secure 0 0 0) 0x7f9b8c151930 con 0x7f9b8c154150 2023-11-15T01:36:36.625 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:36.625 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/246517652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":246517652},{"type":"v1","addr":"172.21.15.141:6836","nonce":246517652}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5857,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3341576602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3341576602},{"type":"v1","addr":"172.21.15.141:6837","nonce":3341576602}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2509339424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2509339424},{"type":"v1","addr":"172.21.15.1:6834","nonce":2509339424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:36:21.564233+0000","modified":"2023-11-15T01:36:24.818307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3051659352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3051659352},{"type":"v1","addr":"172.21.15.1:6835","nonce":3051659352}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-11-15T01:36:36.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.625+0000 7f9b91b60700 1 -- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b6c05f030 msgr2=0x7f9b6c0614f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:36.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.625+0000 7f9b91b60700 1 --2- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b6c05f030 0x7f9b6c0614f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:36.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.625+0000 7f9b91b60700 1 -- 172.21.15.1:0/1658554382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b8c154150 msgr2=0x7f9b8c0abb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:36.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.625+0000 7f9b91b60700 1 --2- 172.21.15.1:0/1658554382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b8c154150 0x7f9b8c0abb30 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f9b84009ec0 tx=0x7f9b8400b040).stop 2023-11-15T01:36:36.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.625+0000 7f9b91b60700 1 -- 172.21.15.1:0/1658554382 shutdown_connections 2023-11-15T01:36:36.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.625+0000 7f9b91b60700 1 --2- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9b6c05f030 0x7f9b6c0614f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:36.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.625+0000 7f9b91b60700 1 --2- 172.21.15.1:0/1658554382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b8c154150 0x7f9b8c0abb30 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.625+0000 7f9b91b60700 1 --2- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9b8c0aa060 0x7f9b8c0c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.625+0000 7f9b91b60700 1 --2- 172.21.15.1:0/1658554382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9b8c0ab1a0 0x7f9b8c0ab640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.625+0000 7f9b91b60700 1 -- 172.21.15.1:0/1658554382 >> 172.21.15.1:0/1658554382 conn(0x7f9b8c064aa0 msgr2=0x7f9b8c0c7850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.626+0000 7f9b91b60700 1 -- 172.21.15.1:0/1658554382 shutdown_connections 2023-11-15T01:36:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.626+0000 7f9b91b60700 1 -- 172.21.15.1:0/1658554382 wait complete. 2023-11-15T01:36:36.630 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 31 2023-11-15T01:36:36.640 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:36:36.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.797+0000 7fdfed826700 1 Processor -- start 2023-11-15T01:36:36.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.797+0000 7fdfed826700 1 -- start start 2023-11-15T01:36:36.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.798+0000 7fdfed826700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdfe8151e10 0x7fdfe8155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:36.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.798+0000 7fdfed826700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdfe80c86b0 0x7fdfe80aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:36.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.798+0000 7fdfed826700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe80c7980 con 0x7fdfe80c98b0 2023-11-15T01:36:36.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.798+0000 7fdfed826700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe80c8b10 con 0x7fdfe80c86b0 2023-11-15T01:36:36.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.798+0000 7fdfed826700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe80aa5c0 con 0x7fdfe8151e10 2023-11-15T01:36:36.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.798+0000 7fdfe7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdfe80c86b0 0x7fdfe80aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:36.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.798+0000 7fdfe7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdfe80c86b0 0x7fdfe80aa0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60764/0 (socket says 172.21.15.1:60764) 2023-11-15T01:36:36.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.798+0000 7fdfe7fff700 1 -- 172.21.15.1:0/2943114123 learned_addr learned my addr 172.21.15.1:0/2943114123 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:36.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.798+0000 7fdfec824700 1 --2- 172.21.15.1:0/2943114123 >> v2:172.21.15.141:3300/0 conn(0x7fdfe8151e10 0x7fdfe8155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:36.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.798+0000 7fdfe7fff700 1 -- 172.21.15.1:0/2943114123 >> v2:172.21.15.141:3300/0 conn(0x7fdfe8151e10 msgr2=0x7fdfe8155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:36.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.798+0000 7fdfe7fff700 1 --2- 172.21.15.1:0/2943114123 >> v2:172.21.15.141:3300/0 conn(0x7fdfe8151e10 0x7fdfe8155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.798+0000 7fdfe7fff700 1 -- 172.21.15.1:0/2943114123 >> v1:172.21.15.141:6789/0 conn(0x7fdfe80c98b0 legacy=0x7fdfe80c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:36.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.798+0000 7fdfe7fff700 1 -- 172.21.15.1:0/2943114123 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe80aa890 con 0x7fdfe80c86b0 2023-11-15T01:36:36.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.798+0000 7fdfec824700 1 --2- 172.21.15.1:0/2943114123 >> v2:172.21.15.141:3300/0 conn(0x7fdfe8151e10 0x7fdfe8155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:36.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.799+0000 7fdfe7fff700 1 --2- 172.21.15.1:0/2943114123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfe80c86b0 0x7fdfe80aa0d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7fdfe8084780 tx=0x7fdfd40090f0).ready entity=mon.0 client_cookie=9652346f849a9c77 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:36.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.799+0000 7fdfe77fe700 1 -- 172.21.15.1:0/2943114123 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd400b600 con 0x7fdfe80c86b0 2023-11-15T01:36:36.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.799+0000 7fdfe77fe700 1 -- 172.21.15.1:0/2943114123 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd400b760 con 0x7fdfe80c86b0 2023-11-15T01:36:36.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.799+0000 7fdfe77fe700 1 -- 172.21.15.1:0/2943114123 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd400bae0 con 0x7fdfe80c86b0 2023-11-15T01:36:36.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.799+0000 7fdfed826700 1 -- 172.21.15.1:0/2943114123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfe80c86b0 msgr2=0x7fdfe80aa0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:36.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.799+0000 7fdfed826700 1 --2- 172.21.15.1:0/2943114123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfe80c86b0 0x7fdfe80aa0d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7fdfe8084780 tx=0x7fdfd40090f0).stop 2023-11-15T01:36:36.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.799+0000 7fdfed826700 1 -- 172.21.15.1:0/2943114123 shutdown_connections 2023-11-15T01:36:36.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.799+0000 7fdfed826700 1 --2- 172.21.15.1:0/2943114123 >> v2:172.21.15.141:3300/0 conn(0x7fdfe8151e10 0x7fdfe8155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.799+0000 7fdfed826700 1 --2- 172.21.15.1:0/2943114123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfe80c86b0 0x7fdfe80aa0d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.799+0000 7fdfed826700 1 -- 172.21.15.1:0/2943114123 >> 172.21.15.1:0/2943114123 conn(0x7fdfe80947e0 msgr2=0x7fdfe806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:36.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.799+0000 7fdfed826700 1 -- 172.21.15.1:0/2943114123 shutdown_connections 2023-11-15T01:36:36.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.799+0000 7fdfed826700 1 -- 172.21.15.1:0/2943114123 wait complete. 2023-11-15T01:36:36.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.800+0000 7fdfed826700 1 Processor -- start 2023-11-15T01:36:36.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.801+0000 7fdfed826700 1 -- start start 2023-11-15T01:36:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.801+0000 7fdfed826700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfe80c86b0 0x7fdfe80aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.801+0000 7fdfed826700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfe80c98b0 0x7fdfe80b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.801+0000 7fdfed826700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfe8151e10 0x7fdfe8064720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.801+0000 7fdfed826700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe80abe60 con 0x7fdfe8151e10 2023-11-15T01:36:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.801+0000 7fdfed826700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe80ab1e0 con 0x7fdfe80c98b0 2023-11-15T01:36:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.801+0000 7fdfed826700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe80ab4c0 con 0x7fdfe80c86b0 2023-11-15T01:36:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfed025700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfe8151e10 0x7fdfe8064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:36.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfed025700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfe8151e10 0x7fdfe8064720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60766/0 (socket says 172.21.15.1:60766) 2023-11-15T01:36:36.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfed025700 1 -- 172.21.15.1:0/1358360126 learned_addr learned my addr 172.21.15.1:0/1358360126 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:36.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfe7fff700 1 --2- 172.21.15.1:0/1358360126 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfe80c98b0 0x7fdfe80b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:36.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfec824700 1 --2- 172.21.15.1:0/1358360126 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfe80c86b0 0x7fdfe80aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfed025700 1 -- 172.21.15.1:0/1358360126 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfe80c86b0 msgr2=0x7fdfe80aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfed025700 1 --2- 172.21.15.1:0/1358360126 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfe80c86b0 0x7fdfe80aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfed025700 1 -- 172.21.15.1:0/1358360126 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfe80c98b0 msgr2=0x7fdfe80b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfed025700 1 --2- 172.21.15.1:0/1358360126 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfe80c98b0 0x7fdfe80b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfed025700 1 -- 172.21.15.1:0/1358360126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd4009370 con 0x7fdfe8151e10 2023-11-15T01:36:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfe7fff700 1 --2- 172.21.15.1:0/1358360126 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfe80c98b0 0x7fdfe80b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfed025700 1 --2- 172.21.15.1:0/1358360126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfe8151e10 0x7fdfe8064720 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7fdfe0002230 tx=0x7fdfe00015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfe4ff9700 1 -- 172.21.15.1:0/1358360126 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe000e4a0 con 0x7fdfe8151e10 2023-11-15T01:36:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfe4ff9700 1 -- 172.21.15.1:0/1358360126 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe000e600 con 0x7fdfe8151e10 2023-11-15T01:36:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfe4ff9700 1 -- 172.21.15.1:0/1358360126 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe000e980 con 0x7fdfe8151e10 2023-11-15T01:36:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfed826700 1 -- 172.21.15.1:0/1358360126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe80ab7a0 con 0x7fdfe8151e10 2023-11-15T01:36:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.802+0000 7fdfed826700 1 -- 172.21.15.1:0/1358360126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe80b0770 con 0x7fdfe8151e10 2023-11-15T01:36:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.803+0000 7fdfed826700 1 -- 172.21.15.1:0/1358360126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe80475e0 con 0x7fdfe8151e10 2023-11-15T01:36:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.804+0000 7fdfe4ff9700 1 -- 172.21.15.1:0/1358360126 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 28) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fdfe001b3b0 con 0x7fdfe8151e10 2023-11-15T01:36:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.804+0000 7fdfe4ff9700 1 --2- 172.21.15.1:0/1358360126 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdfcc05f030 0x7fdfcc0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.804+0000 7fdfe4ff9700 1 -- 172.21.15.1:0/1358360126 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fdfe00798e0 con 0x7fdfe8151e10 2023-11-15T01:36:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.804+0000 7fdfec824700 1 -- 172.21.15.1:0/1358360126 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdfcc05f030 msgr2=0x7fdfcc0614f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.804+0000 7fdfec824700 1 --2- 172.21.15.1:0/1358360126 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdfcc05f030 0x7fdfcc0614f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:36.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.810+0000 7fdfe4ff9700 1 -- 172.21.15.1:0/1358360126 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdfe0048af0 con 0x7fdfe8151e10 2023-11-15T01:36:36.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.984+0000 7fdfed826700 1 -- 172.21.15.1:0/1358360126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfe80c7bd0 con 0x7fdfe8151e10 2023-11-15T01:36:36.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.986+0000 7fdfe4ff9700 1 -- 172.21.15.1:0/1358360126 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+17898 (secure 0 0 0) 0x7fdfe004ab20 con 0x7fdfe8151e10 2023-11-15T01:36:36.988 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:36.988 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:36:34.049350+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:36:19.249413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-15T01:36:20.544874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/2815631318":"2023-11-16T01:36:34.049309+0000","172.21.15.141:0/3992492485":"2023-11-16T01:36:34.049309+0000","172.21.15.141:6833/90546":"2023-11-16T01:36:34.049309+0000","172.21.15.141:6832/90546":"2023-11-16T01:36:34.049309+0000","172.21.15.141:0/619934892":"2023-11-16T01:36:34.049309+0000","172.21.15.141:0/3354476443":"2023-11-16T01:36:34.049309+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:36:36.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.988+0000 7fdfed826700 1 -- 172.21.15.1:0/1358360126 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdfcc05f030 msgr2=0x7fdfcc0614f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:36.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.988+0000 7fdfed826700 1 --2- 172.21.15.1:0/1358360126 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdfcc05f030 0x7fdfcc0614f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:36.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.988+0000 7fdfed826700 1 -- 172.21.15.1:0/1358360126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfe8151e10 msgr2=0x7fdfe8064720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:36.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.988+0000 7fdfed826700 1 --2- 172.21.15.1:0/1358360126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfe8151e10 0x7fdfe8064720 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7fdfe0002230 tx=0x7fdfe00015e0).stop 2023-11-15T01:36:36.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.988+0000 7fdfed826700 1 -- 172.21.15.1:0/1358360126 shutdown_connections 2023-11-15T01:36:36.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.988+0000 7fdfed826700 1 --2- 172.21.15.1:0/1358360126 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdfcc05f030 0x7fdfcc0614f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:36.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.988+0000 7fdfed826700 1 --2- 172.21.15.1:0/1358360126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfe8151e10 0x7fdfe8064720 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.988+0000 7fdfed826700 1 --2- 172.21.15.1:0/1358360126 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfe80c86b0 0x7fdfe80aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.988+0000 7fdfed826700 1 --2- 172.21.15.1:0/1358360126 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfe80c98b0 0x7fdfe80b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:36.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.988+0000 7fdfed826700 1 -- 172.21.15.1:0/1358360126 >> 172.21.15.1:0/1358360126 conn(0x7fdfe80947e0 msgr2=0x7fdfe814fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:36.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.988+0000 7fdfed826700 1 -- 172.21.15.1:0/1358360126 shutdown_connections 2023-11-15T01:36:36.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:36.988+0000 7fdfed826700 1 -- 172.21.15.1:0/1358360126 wait complete. 2023-11-15T01:36:37.002 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T01:36:19.249413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T01:36:20.544874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T01:36:37.003 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:36:37.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.130+0000 7fc4d21b2700 1 Processor -- start 2023-11-15T01:36:37.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.130+0000 7fc4d21b2700 1 -- start start 2023-11-15T01:36:37.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.131+0000 7fc4d21b2700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc4cc0bcbf0 0x7fc4cc062910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.131+0000 7fc4d21b2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4cc062e00 0x7fc4cc0c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.131+0000 7fc4d21b2700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4cc0c5480 con 0x7fc4cc14e960 2023-11-15T01:36:37.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.131+0000 7fc4d21b2700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4cc0636e0 con 0x7fc4cc0bcbf0 2023-11-15T01:36:37.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.131+0000 7fc4d21b2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc0639c0 con 0x7fc4cc062e00 2023-11-15T01:36:37.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.132+0000 7fc4cbfff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4cc062e00 0x7fc4cc0c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:37.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.132+0000 7fc4c2ffd700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc4cc0bcbf0 0x7fc4cc062910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:37.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.132+0000 7fc4c2ffd700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc4cc0bcbf0 0x7fc4cc062910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:60552/0 (socket says 172.21.15.1:60552) 2023-11-15T01:36:37.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.132+0000 7fc4cbfff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4cc062e00 0x7fc4cc0c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:44164/0 (socket says 172.21.15.1:44164) 2023-11-15T01:36:37.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.132+0000 7fc4c2ffd700 1 -- 172.21.15.1:0/279194787 learned_addr learned my addr 172.21.15.1:0/279194787 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:37.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.132+0000 7fc4cbfff700 1 -- 172.21.15.1:0/279194787 >> v2:172.21.15.141:3300/0 conn(0x7fc4cc0bcbf0 msgr2=0x7fc4cc062910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:37.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.132+0000 7fc4cbfff700 1 --2- 172.21.15.1:0/279194787 >> v2:172.21.15.141:3300/0 conn(0x7fc4cc0bcbf0 0x7fc4cc062910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.132+0000 7fc4cbfff700 1 -- 172.21.15.1:0/279194787 >> v1:172.21.15.141:6789/0 conn(0x7fc4cc14e960 legacy=0x7fc4cc0bc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:37.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.132+0000 7fc4cbfff700 1 -- 172.21.15.1:0/279194787 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc063ca0 con 0x7fc4cc062e00 2023-11-15T01:36:37.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.132+0000 7fc4cbfff700 1 --2- 172.21.15.1:0/279194787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4cc062e00 0x7fc4cc0c5910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc4c4009e60 tx=0x7fc4c4009780).ready entity=mon.2 client_cookie=d55c5af3ef400ea server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:37.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.133+0000 7fc4caffd700 1 -- 172.21.15.1:0/279194787 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c400e070 con 0x7fc4cc062e00 2023-11-15T01:36:37.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.133+0000 7fc4caffd700 1 -- 172.21.15.1:0/279194787 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c400bb60 con 0x7fc4cc062e00 2023-11-15T01:36:37.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.133+0000 7fc4caffd700 1 -- 172.21.15.1:0/279194787 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4012410 con 0x7fc4cc062e00 2023-11-15T01:36:37.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.133+0000 7fc4d21b2700 1 -- 172.21.15.1:0/279194787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4cc062e00 msgr2=0x7fc4cc0c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:37.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.133+0000 7fc4d21b2700 1 --2- 172.21.15.1:0/279194787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4cc062e00 0x7fc4cc0c5910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc4c4009e60 tx=0x7fc4c4009780).stop 2023-11-15T01:36:37.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.133+0000 7fc4d21b2700 1 -- 172.21.15.1:0/279194787 shutdown_connections 2023-11-15T01:36:37.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.133+0000 7fc4d21b2700 1 --2- 172.21.15.1:0/279194787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4cc062e00 0x7fc4cc0c5910 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.133+0000 7fc4d21b2700 1 --2- 172.21.15.1:0/279194787 >> v2:172.21.15.141:3300/0 conn(0x7fc4cc0bcbf0 0x7fc4cc062910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.133+0000 7fc4d21b2700 1 -- 172.21.15.1:0/279194787 >> 172.21.15.1:0/279194787 conn(0x7fc4cc0c8050 msgr2=0x7fc4cc0c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:37.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.133+0000 7fc4d21b2700 1 -- 172.21.15.1:0/279194787 shutdown_connections 2023-11-15T01:36:37.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.133+0000 7fc4d21b2700 1 -- 172.21.15.1:0/279194787 wait complete. 2023-11-15T01:36:37.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.134+0000 7fc4d21b2700 1 Processor -- start 2023-11-15T01:36:37.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.135+0000 7fc4d21b2700 1 -- start start 2023-11-15T01:36:37.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.135+0000 7fc4d21b2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4cc062e00 0x7fc4cc0c0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.135+0000 7fc4d21b2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4cc0bcbf0 0x7fc4cc13c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.135+0000 7fc4d21b2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4cc14e960 0x7fc4cc0a55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.135+0000 7fc4d21b2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc13ddb0 con 0x7fc4cc062e00 2023-11-15T01:36:37.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.135+0000 7fc4d21b2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc13d920 con 0x7fc4cc0bcbf0 2023-11-15T01:36:37.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.135+0000 7fc4d21b2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc0c0670 con 0x7fc4cc14e960 2023-11-15T01:36:37.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.135+0000 7fc4cb7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4cc062e00 0x7fc4cc0c0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:37.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.136+0000 7fc4cb7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4cc062e00 0x7fc4cc0c0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60774/0 (socket says 172.21.15.1:60774) 2023-11-15T01:36:37.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.136+0000 7fc4cb7fe700 1 -- 172.21.15.1:0/2594765987 learned_addr learned my addr 172.21.15.1:0/2594765987 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:37.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.136+0000 7fc4c2ffd700 1 --2- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4cc0bcbf0 0x7fc4cc13c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:37.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.136+0000 7fc4cbfff700 1 --2- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4cc14e960 0x7fc4cc0a55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:37.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.136+0000 7fc4cb7fe700 1 -- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4cc14e960 msgr2=0x7fc4cc0a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:37.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.136+0000 7fc4cb7fe700 1 --2- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4cc14e960 0x7fc4cc0a55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.136+0000 7fc4cb7fe700 1 -- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4cc0bcbf0 msgr2=0x7fc4cc13c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:37.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.136+0000 7fc4cb7fe700 1 --2- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4cc0bcbf0 0x7fc4cc13c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.136+0000 7fc4cb7fe700 1 -- 172.21.15.1:0/2594765987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c4009a20 con 0x7fc4cc062e00 2023-11-15T01:36:37.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.136+0000 7fc4cb7fe700 1 --2- 172.21.15.1:0/2594765987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4cc062e00 0x7fc4cc0c0180 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fc4bc00c4c0 tx=0x7fc4bc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:37.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.136+0000 7fc4c3fff700 1 -- 172.21.15.1:0/2594765987 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00ce70 con 0x7fc4cc062e00 2023-11-15T01:36:37.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.136+0000 7fc4c3fff700 1 -- 172.21.15.1:0/2594765987 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc001e90 con 0x7fc4cc062e00 2023-11-15T01:36:37.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.136+0000 7fc4d21b2700 1 -- 172.21.15.1:0/2594765987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4cc13ca90 con 0x7fc4cc062e00 2023-11-15T01:36:37.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.136+0000 7fc4c3fff700 1 -- 172.21.15.1:0/2594765987 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc007250 con 0x7fc4cc062e00 2023-11-15T01:36:37.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.136+0000 7fc4d21b2700 1 -- 172.21.15.1:0/2594765987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4cc13cd10 con 0x7fc4cc062e00 2023-11-15T01:36:37.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.137+0000 7fc4d21b2700 1 -- 172.21.15.1:0/2594765987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4cc13dc00 con 0x7fc4cc062e00 2023-11-15T01:36:37.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.137+0000 7fc4c3fff700 1 -- 172.21.15.1:0/2594765987 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fc4bc0066a0 con 0x7fc4cc062e00 2023-11-15T01:36:37.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.138+0000 7fc4c3fff700 1 --2- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc4ac05f300 0x7fc4ac0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.138+0000 7fc4c3fff700 1 -- 172.21.15.1:0/2594765987 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fc4bc079ff0 con 0x7fc4cc062e00 2023-11-15T01:36:37.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.138+0000 7fc4c2ffd700 1 -- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc4ac05f300 msgr2=0x7fc4ac0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:37.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.138+0000 7fc4c2ffd700 1 --2- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc4ac05f300 0x7fc4ac0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:37.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.142+0000 7fc4c3fff700 1 -- 172.21.15.1:0/2594765987 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc4bc04ae10 con 0x7fc4cc062e00 2023-11-15T01:36:37.168 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:37.168+0000 7f427ac4d680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:36:37.243 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:37.242+0000 7f427ac4d680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:36:37.252 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:37.251+0000 7f79780df680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:36:37.322 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:37.320+0000 7f79780df680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:36:37.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.339+0000 7fc4c2ffd700 1 -- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc4ac05f300 msgr2=0x7fc4ac0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:37.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.339+0000 7fc4c2ffd700 1 --2- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc4ac05f300 0x7fc4ac0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:36:37.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.363+0000 7fc4d21b2700 1 -- 172.21.15.1:0/2594765987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc4cc06c7e0 con 0x7fc4cc062e00 2023-11-15T01:36:37.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.363+0000 7fc4c3fff700 1 -- 172.21.15.1:0/2594765987 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v80) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc4bc04e430 con 0x7fc4cc062e00 2023-11-15T01:36:37.365 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:36:37.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.365+0000 7fc4d21b2700 1 -- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc4ac05f300 msgr2=0x7fc4ac0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:37.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.365+0000 7fc4d21b2700 1 --2- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc4ac05f300 0x7fc4ac0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:37.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.365+0000 7fc4d21b2700 1 -- 172.21.15.1:0/2594765987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4cc062e00 msgr2=0x7fc4cc0c0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:37.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.365+0000 7fc4d21b2700 1 --2- 172.21.15.1:0/2594765987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4cc062e00 0x7fc4cc0c0180 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fc4bc00c4c0 tx=0x7fc4bc007e00).stop 2023-11-15T01:36:37.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.365+0000 7fc4d21b2700 1 -- 172.21.15.1:0/2594765987 shutdown_connections 2023-11-15T01:36:37.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.365+0000 7fc4d21b2700 1 --2- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc4ac05f300 0x7fc4ac0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:37.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.365+0000 7fc4d21b2700 1 --2- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4cc14e960 0x7fc4cc0a55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.365+0000 7fc4d21b2700 1 --2- 172.21.15.1:0/2594765987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4cc062e00 0x7fc4cc0c0180 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.365+0000 7fc4d21b2700 1 --2- 172.21.15.1:0/2594765987 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4cc0bcbf0 0x7fc4cc13c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.365+0000 7fc4d21b2700 1 -- 172.21.15.1:0/2594765987 >> 172.21.15.1:0/2594765987 conn(0x7fc4cc0c8050 msgr2=0x7fc4cc0c6030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:37.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.365+0000 7fc4d21b2700 1 -- 172.21.15.1:0/2594765987 shutdown_connections 2023-11-15T01:36:37.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.365+0000 7fc4d21b2700 1 -- 172.21.15.1:0/2594765987 wait complete. 2023-11-15T01:36:37.380 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:36:37.429 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:37.428+0000 7f427ac4d680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:36:37.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.502+0000 7f4f8ca1e700 1 Processor -- start 2023-11-15T01:36:37.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.502+0000 7f4f8ca1e700 1 -- start start 2023-11-15T01:36:37.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.503+0000 7f4f8ca1e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f8814ec30 0x7f4f880638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.503+0000 7f4f8ca1e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4f881553c0 0x7f4f880c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.503+0000 7f4f8ca1e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f880c3e30 con 0x7f4f88063db0 2023-11-15T01:36:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.503+0000 7f4f8ca1e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f880c5640 con 0x7f4f881553c0 2023-11-15T01:36:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.503+0000 7f4f8ca1e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f880c3590 con 0x7f4f8814ec30 2023-11-15T01:36:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.504+0000 7f4f8659c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f8814ec30 0x7f4f880638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.504+0000 7f4f86d9d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4f881553c0 0x7f4f880c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.504+0000 7f4f86d9d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4f881553c0 0x7f4f880c5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:60566/0 (socket says 172.21.15.1:60566) 2023-11-15T01:36:37.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.504+0000 7f4f8659c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f8814ec30 0x7f4f880638c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:44182/0 (socket says 172.21.15.1:44182) 2023-11-15T01:36:37.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.504+0000 7f4f85d9b700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f4f88063db0 0x7f4f88154cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:35150/0 (socket says 172.21.15.1:35150) 2023-11-15T01:36:37.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.504+0000 7f4f86d9d700 1 -- 172.21.15.1:0/4230984220 learned_addr learned my addr 172.21.15.1:0/4230984220 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:37.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.504+0000 7f4f8659c700 1 -- 172.21.15.1:0/4230984220 >> v2:172.21.15.141:3300/0 conn(0x7f4f881553c0 msgr2=0x7f4f880c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:37.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.504+0000 7f4f8659c700 1 --2- 172.21.15.1:0/4230984220 >> v2:172.21.15.141:3300/0 conn(0x7f4f881553c0 0x7f4f880c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.504+0000 7f4f8659c700 1 -- 172.21.15.1:0/4230984220 >> v1:172.21.15.141:6789/0 conn(0x7f4f88063db0 legacy=0x7f4f88154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:37.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.504+0000 7f4f8659c700 1 -- 172.21.15.1:0/4230984220 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f880c3870 con 0x7f4f8814ec30 2023-11-15T01:36:37.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.504+0000 7f4f8659c700 1 --2- 172.21.15.1:0/4230984220 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f8814ec30 0x7f4f880638c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4f80009760 tx=0x7f4f80009060).ready entity=mon.2 client_cookie=8191ec071ff81f79 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:37.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.504+0000 7f4f8559a700 1 -- 172.21.15.1:0/4230984220 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8000f510 con 0x7f4f8814ec30 2023-11-15T01:36:37.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.504+0000 7f4f8559a700 1 -- 172.21.15.1:0/4230984220 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8000f670 con 0x7f4f8814ec30 2023-11-15T01:36:37.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.504+0000 7f4f8559a700 1 -- 172.21.15.1:0/4230984220 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8000f9f0 con 0x7f4f8814ec30 2023-11-15T01:36:37.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.505+0000 7f4f8ca1e700 1 -- 172.21.15.1:0/4230984220 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f8814ec30 msgr2=0x7f4f880638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:37.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.505+0000 7f4f8ca1e700 1 --2- 172.21.15.1:0/4230984220 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f8814ec30 0x7f4f880638c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4f80009760 tx=0x7f4f80009060).stop 2023-11-15T01:36:37.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.505+0000 7f4f8ca1e700 1 -- 172.21.15.1:0/4230984220 shutdown_connections 2023-11-15T01:36:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.505+0000 7f4f8ca1e700 1 --2- 172.21.15.1:0/4230984220 >> v2:172.21.15.141:3300/0 conn(0x7f4f881553c0 0x7f4f880c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.505+0000 7f4f8ca1e700 1 --2- 172.21.15.1:0/4230984220 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f8814ec30 0x7f4f880638c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.505+0000 7f4f8ca1e700 1 -- 172.21.15.1:0/4230984220 >> 172.21.15.1:0/4230984220 conn(0x7f4f880c8050 msgr2=0x7f4f880c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.505+0000 7f4f8ca1e700 1 -- 172.21.15.1:0/4230984220 shutdown_connections 2023-11-15T01:36:37.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.505+0000 7f4f8ca1e700 1 -- 172.21.15.1:0/4230984220 wait complete. 2023-11-15T01:36:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.506+0000 7f4f8ca1e700 1 Processor -- start 2023-11-15T01:36:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.506+0000 7f4f8ca1e700 1 -- start start 2023-11-15T01:36:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f8ca1e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f88063db0 0x7f4f8814f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f8ca1e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f8814ec30 0x7f4f8814b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f8ca1e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f881553c0 0x7f4f880c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f8ca1e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f880a8d00 con 0x7f4f88063db0 2023-11-15T01:36:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f8ca1e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f88166d60 con 0x7f4f8814ec30 2023-11-15T01:36:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f8ca1e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f880a83d0 con 0x7f4f881553c0 2023-11-15T01:36:37.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f8659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f88063db0 0x7f4f8814f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:37.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f8659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f88063db0 0x7f4f8814f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60790/0 (socket says 172.21.15.1:60790) 2023-11-15T01:36:37.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f8659c700 1 -- 172.21.15.1:0/3721116841 learned_addr learned my addr 172.21.15.1:0/3721116841 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:37.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f85d9b700 1 --2- 172.21.15.1:0/3721116841 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f8814ec30 0x7f4f8814b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:37.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f86d9d700 1 --2- 172.21.15.1:0/3721116841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f881553c0 0x7f4f880c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:37.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f8659c700 1 -- 172.21.15.1:0/3721116841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f881553c0 msgr2=0x7f4f880c07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:37.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f8659c700 1 --2- 172.21.15.1:0/3721116841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f881553c0 0x7f4f880c07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f8659c700 1 -- 172.21.15.1:0/3721116841 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f8814ec30 msgr2=0x7f4f8814b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f8659c700 1 --2- 172.21.15.1:0/3721116841 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f8814ec30 0x7f4f8814b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.507+0000 7f4f8659c700 1 -- 172.21.15.1:0/3721116841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f800092a0 con 0x7f4f88063db0 2023-11-15T01:36:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.508+0000 7f4f8659c700 1 --2- 172.21.15.1:0/3721116841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f88063db0 0x7f4f8814f090 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f4f88068700 tx=0x7f4f80017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:37.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.508+0000 7f4f7e7fc700 1 -- 172.21.15.1:0/3721116841 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8000f7e0 con 0x7f4f88063db0 2023-11-15T01:36:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.508+0000 7f4f7e7fc700 1 -- 172.21.15.1:0/3721116841 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8000f980 con 0x7f4f88063db0 2023-11-15T01:36:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.508+0000 7f4f8ca1e700 1 -- 172.21.15.1:0/3721116841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f880a86b0 con 0x7f4f88063db0 2023-11-15T01:36:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.508+0000 7f4f7e7fc700 1 -- 172.21.15.1:0/3721116841 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8001b660 con 0x7f4f88063db0 2023-11-15T01:36:37.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.508+0000 7f4f8ca1e700 1 -- 172.21.15.1:0/3721116841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8814bd00 con 0x7f4f88063db0 2023-11-15T01:36:37.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.509+0000 7f4f8ca1e700 1 -- 172.21.15.1:0/3721116841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8806c7e0 con 0x7f4f88063db0 2023-11-15T01:36:37.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.509+0000 7f4f7e7fc700 1 -- 172.21.15.1:0/3721116841 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f4f8001b9d0 con 0x7f4f88063db0 2023-11-15T01:36:37.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.509+0000 7f4f7e7fc700 1 --2- 172.21.15.1:0/3721116841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f6805f300 0x7f4f680617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.510+0000 7f4f85d9b700 1 -- 172.21.15.1:0/3721116841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f6805f300 msgr2=0x7f4f680617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:37.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.510+0000 7f4f7e7fc700 1 -- 172.21.15.1:0/3721116841 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f4f8007bf00 con 0x7f4f88063db0 2023-11-15T01:36:37.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.510+0000 7f4f85d9b700 1 --2- 172.21.15.1:0/3721116841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f6805f300 0x7f4f680617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:37.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.514+0000 7f4f7e7fc700 1 -- 172.21.15.1:0/3721116841 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4f8004cd20 con 0x7f4f88063db0 2023-11-15T01:36:37.521 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:37.520+0000 7f79780df680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:36:37.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.689+0000 7f4f8ca1e700 1 -- 172.21.15.1:0/3721116841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4f880c3b50 con 0x7f4f88063db0 2023-11-15T01:36:37.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.690+0000 7f4f7e7fc700 1 -- 172.21.15.1:0/3721116841 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4f80029020 con 0x7f4f88063db0 2023-11-15T01:36:37.691 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:36:37.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.691+0000 7f4f8ca1e700 1 -- 172.21.15.1:0/3721116841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f6805f300 msgr2=0x7f4f680617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:37.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.691+0000 7f4f8ca1e700 1 --2- 172.21.15.1:0/3721116841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f6805f300 0x7f4f680617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:37.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.691+0000 7f4f8ca1e700 1 -- 172.21.15.1:0/3721116841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f88063db0 msgr2=0x7f4f8814f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:37.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.691+0000 7f4f8ca1e700 1 --2- 172.21.15.1:0/3721116841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f88063db0 0x7f4f8814f090 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f4f88068700 tx=0x7f4f80017000).stop 2023-11-15T01:36:37.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.691+0000 7f4f8ca1e700 1 -- 172.21.15.1:0/3721116841 shutdown_connections 2023-11-15T01:36:37.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.691+0000 7f4f8ca1e700 1 --2- 172.21.15.1:0/3721116841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4f6805f300 0x7f4f680617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:37.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.691+0000 7f4f8ca1e700 1 --2- 172.21.15.1:0/3721116841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f881553c0 0x7f4f880c07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.691+0000 7f4f8ca1e700 1 --2- 172.21.15.1:0/3721116841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f88063db0 0x7f4f8814f090 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.691+0000 7f4f8ca1e700 1 --2- 172.21.15.1:0/3721116841 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f8814ec30 0x7f4f8814b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.691+0000 7f4f8ca1e700 1 -- 172.21.15.1:0/3721116841 >> 172.21.15.1:0/3721116841 conn(0x7f4f880c8050 msgr2=0x7f4f880c2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.692+0000 7f4f8ca1e700 1 -- 172.21.15.1:0/3721116841 shutdown_connections 2023-11-15T01:36:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.692+0000 7f4f8ca1e700 1 -- 172.21.15.1:0/3721116841 wait complete. 2023-11-15T01:36:37.705 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T01:36:37.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.829+0000 7f893020d700 1 Processor -- start 2023-11-15T01:36:37.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.829+0000 7f893020d700 1 -- start start 2023-11-15T01:36:37.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.830+0000 7f893020d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f892813b990 0x7f89281568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.830+0000 7f893020d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f89280a8ab0 0x7f89280c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.830+0000 7f893020d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89280c7760 con 0x7f892813bd70 2023-11-15T01:36:37.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.830+0000 7f893020d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8928067340 con 0x7f89280a8ab0 2023-11-15T01:36:37.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.830+0000 7f893020d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8928067060 con 0x7f892813b990 2023-11-15T01:36:37.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.830+0000 7f892e7aa700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f89280a8ab0 0x7f89280c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:37.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.830+0000 7f892e7aa700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f89280a8ab0 0x7f89280c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35258/0 (socket says 172.21.15.1:35258) 2023-11-15T01:36:37.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.830+0000 7f892e7aa700 1 -- 172.21.15.1:0/1688357669 learned_addr learned my addr 172.21.15.1:0/1688357669 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:37.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.830+0000 7f892dfa9700 1 --2- 172.21.15.1:0/1688357669 >> v2:172.21.15.141:3300/0 conn(0x7f892813b990 0x7f89281568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:37.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.830+0000 7f892e7aa700 1 -- 172.21.15.1:0/1688357669 >> v2:172.21.15.141:3300/0 conn(0x7f892813b990 msgr2=0x7f89281568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:37.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.830+0000 7f892e7aa700 1 --2- 172.21.15.1:0/1688357669 >> v2:172.21.15.141:3300/0 conn(0x7f892813b990 0x7f89281568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.830+0000 7f892e7aa700 1 -- 172.21.15.1:0/1688357669 >> v1:172.21.15.141:6789/0 conn(0x7f892813bd70 legacy=0x7f8928066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:37.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.830+0000 7f892e7aa700 1 -- 172.21.15.1:0/1688357669 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89280c7110 con 0x7f89280a8ab0 2023-11-15T01:36:37.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.830+0000 7f892e7aa700 1 --2- 172.21.15.1:0/1688357669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89280a8ab0 0x7f89280c3500 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f89280636f0 tx=0x7f8920009840).ready entity=mon.0 client_cookie=be8c46365c7cffe6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:37.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.831+0000 7f892cfa7700 1 -- 172.21.15.1:0/1688357669 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892000e070 con 0x7f89280a8ab0 2023-11-15T01:36:37.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.831+0000 7f892cfa7700 1 -- 172.21.15.1:0/1688357669 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892000ba20 con 0x7f89280a8ab0 2023-11-15T01:36:37.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.831+0000 7f892cfa7700 1 -- 172.21.15.1:0/1688357669 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892000bda0 con 0x7f89280a8ab0 2023-11-15T01:36:37.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.831+0000 7f893020d700 1 -- 172.21.15.1:0/1688357669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89280a8ab0 msgr2=0x7f89280c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:37.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.831+0000 7f893020d700 1 --2- 172.21.15.1:0/1688357669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89280a8ab0 0x7f89280c3500 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f89280636f0 tx=0x7f8920009840).stop 2023-11-15T01:36:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.831+0000 7f893020d700 1 -- 172.21.15.1:0/1688357669 shutdown_connections 2023-11-15T01:36:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.831+0000 7f893020d700 1 --2- 172.21.15.1:0/1688357669 >> v2:172.21.15.141:3300/0 conn(0x7f892813b990 0x7f89281568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.831+0000 7f893020d700 1 --2- 172.21.15.1:0/1688357669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89280a8ab0 0x7f89280c3500 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.831+0000 7f893020d700 1 -- 172.21.15.1:0/1688357669 >> 172.21.15.1:0/1688357669 conn(0x7f8928063280 msgr2=0x7f89280c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.831+0000 7f893020d700 1 -- 172.21.15.1:0/1688357669 shutdown_connections 2023-11-15T01:36:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.831+0000 7f893020d700 1 -- 172.21.15.1:0/1688357669 wait complete. 2023-11-15T01:36:37.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.832+0000 7f893020d700 1 Processor -- start 2023-11-15T01:36:37.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.833+0000 7f893020d700 1 -- start start 2023-11-15T01:36:37.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.833+0000 7f893020d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89280a8ab0 0x7f8928138200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.833+0000 7f893020d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f892813b990 0x7f89280ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.833+0000 7f893020d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8928152840 0x7f8928152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.833+0000 7f893020d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89281531b0 con 0x7f89280a8ab0 2023-11-15T01:36:37.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.833+0000 7f893020d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89281386f0 con 0x7f8928152840 2023-11-15T01:36:37.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.833+0000 7f893020d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8928163400 con 0x7f892813b990 2023-11-15T01:36:37.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.833+0000 7f892dfa9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89280a8ab0 0x7f8928138200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:37.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.833+0000 7f892dfa9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89280a8ab0 0x7f8928138200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35262/0 (socket says 172.21.15.1:35262) 2023-11-15T01:36:37.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.833+0000 7f892dfa9700 1 -- 172.21.15.1:0/4196160763 learned_addr learned my addr 172.21.15.1:0/4196160763 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:37.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.834+0000 7f892e7aa700 1 --2- 172.21.15.1:0/4196160763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8928152840 0x7f8928152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:37.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.834+0000 7f892d7a8700 1 --2- 172.21.15.1:0/4196160763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f892813b990 0x7f89280ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:37.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.834+0000 7f892dfa9700 1 -- 172.21.15.1:0/4196160763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f892813b990 msgr2=0x7f89280ace50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:37.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.834+0000 7f892dfa9700 1 --2- 172.21.15.1:0/4196160763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f892813b990 0x7f89280ace50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.834+0000 7f892dfa9700 1 -- 172.21.15.1:0/4196160763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8928152840 msgr2=0x7f8928152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:37.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.834+0000 7f892dfa9700 1 --2- 172.21.15.1:0/4196160763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8928152840 0x7f8928152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:37.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.834+0000 7f892dfa9700 1 -- 172.21.15.1:0/4196160763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8920009ae0 con 0x7f89280a8ab0 2023-11-15T01:36:37.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.834+0000 7f892dfa9700 1 --2- 172.21.15.1:0/4196160763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89280a8ab0 0x7f8928138200 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f892400e930 tx=0x7f8924009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:37.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.834+0000 7f891dffb700 1 -- 172.21.15.1:0/4196160763 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924012600 con 0x7f89280a8ab0 2023-11-15T01:36:37.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.834+0000 7f891dffb700 1 -- 172.21.15.1:0/4196160763 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8924012760 con 0x7f89280a8ab0 2023-11-15T01:36:37.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.834+0000 7f891dffb700 1 -- 172.21.15.1:0/4196160763 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924012ae0 con 0x7f89280a8ab0 2023-11-15T01:36:37.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.834+0000 7f893020d700 1 -- 172.21.15.1:0/4196160763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8928153c20 con 0x7f89280a8ab0 2023-11-15T01:36:37.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.834+0000 7f893020d700 1 -- 172.21.15.1:0/4196160763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89281541e0 con 0x7f89280a8ab0 2023-11-15T01:36:37.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.836+0000 7f893020d700 1 -- 172.21.15.1:0/4196160763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8928154550 con 0x7f89280a8ab0 2023-11-15T01:36:37.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.836+0000 7f891dffb700 1 -- 172.21.15.1:0/4196160763 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f892401b400 con 0x7f89280a8ab0 2023-11-15T01:36:37.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.836+0000 7f891dffb700 1 --2- 172.21.15.1:0/4196160763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f890c05f300 0x7f890c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:37.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.836+0000 7f891dffb700 1 -- 172.21.15.1:0/4196160763 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f892407ab60 con 0x7f89280a8ab0 2023-11-15T01:36:37.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.836+0000 7f892d7a8700 1 -- 172.21.15.1:0/4196160763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f890c05f300 msgr2=0x7f890c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:37.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.836+0000 7f892d7a8700 1 --2- 172.21.15.1:0/4196160763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f890c05f300 0x7f890c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:37.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:37.840+0000 7f891dffb700 1 -- 172.21.15.1:0/4196160763 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f892404b920 con 0x7f89280a8ab0 2023-11-15T01:36:37.852 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:37.851+0000 7f427ac4d680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:36:37.954 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:37.954+0000 7f427ac4d680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:36:37.970 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:37.969+0000 7f79780df680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:36:38.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.013+0000 7f893020d700 1 -- 172.21.15.1:0/4196160763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8928153a80 con 0x7f89280a8ab0 2023-11-15T01:36:38.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.013+0000 7f891dffb700 1 -- 172.21.15.1:0/4196160763 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8928153a80 con 0x7f89280a8ab0 2023-11-15T01:36:38.015 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:36:38.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.015+0000 7f893020d700 1 -- 172.21.15.1:0/4196160763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f890c05f300 msgr2=0x7f890c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:38.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.015+0000 7f893020d700 1 --2- 172.21.15.1:0/4196160763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f890c05f300 0x7f890c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:38.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.015+0000 7f893020d700 1 -- 172.21.15.1:0/4196160763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89280a8ab0 msgr2=0x7f8928138200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:38.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.015+0000 7f893020d700 1 --2- 172.21.15.1:0/4196160763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89280a8ab0 0x7f8928138200 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f892400e930 tx=0x7f8924009060).stop 2023-11-15T01:36:38.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.015+0000 7f893020d700 1 -- 172.21.15.1:0/4196160763 shutdown_connections 2023-11-15T01:36:38.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.015+0000 7f893020d700 1 --2- 172.21.15.1:0/4196160763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f890c05f300 0x7f890c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:38.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.015+0000 7f893020d700 1 --2- 172.21.15.1:0/4196160763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8928152840 0x7f8928152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.015+0000 7f893020d700 1 --2- 172.21.15.1:0/4196160763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89280a8ab0 0x7f8928138200 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.015+0000 7f893020d700 1 --2- 172.21.15.1:0/4196160763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f892813b990 0x7f89280ace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.015+0000 7f893020d700 1 -- 172.21.15.1:0/4196160763 >> 172.21.15.1:0/4196160763 conn(0x7f8928063280 msgr2=0x7f89280aaea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:38.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.015+0000 7f893020d700 1 -- 172.21.15.1:0/4196160763 shutdown_connections 2023-11-15T01:36:38.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.016+0000 7f893020d700 1 -- 172.21.15.1:0/4196160763 wait complete. 2023-11-15T01:36:38.030 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T01:36:38.082 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:38.081+0000 7f79780df680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:36:38.108 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:38.107+0000 7f427ac4d680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:36:38.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.153+0000 7fcd04f9d700 1 Processor -- start 2023-11-15T01:36:38.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.153+0000 7fcd04f9d700 1 -- start start 2023-11-15T01:36:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fcd04f9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcd000bc410 0x7fcd000c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fcd04f9d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd000bd330 0x7fcd000637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fcd04f9d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0006bb50 con 0x7fcd000c50b0 2023-11-15T01:36:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fcd04f9d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd000627b0 con 0x7fcd000bc410 2023-11-15T01:36:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fcd04f9d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000bd7c0 con 0x7fcd000bd330 2023-11-15T01:36:38.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fccf7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcd000bc410 0x7fcd000c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:38.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fccf7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcd000bc410 0x7fcd000c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35268/0 (socket says 172.21.15.1:35268) 2023-11-15T01:36:38.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fccf7fff700 1 -- 172.21.15.1:0/3669788086 learned_addr learned my addr 172.21.15.1:0/3669788086 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:38.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fccfffff700 1 --2- 172.21.15.1:0/3669788086 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd000bd330 0x7fcd000637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:38.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fccf7fff700 1 -- 172.21.15.1:0/3669788086 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd000bd330 msgr2=0x7fcd000637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:38.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fccf7fff700 1 --2- 172.21.15.1:0/3669788086 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd000bd330 0x7fcd000637c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fccf7fff700 1 -- 172.21.15.1:0/3669788086 >> v1:172.21.15.141:6789/0 conn(0x7fcd000c50b0 legacy=0x7fcd000c1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:38.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fccf7fff700 1 -- 172.21.15.1:0/3669788086 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd00062a00 con 0x7fcd000bc410 2023-11-15T01:36:38.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fccfeffd700 1 -- 172.21.15.1:0/3669788086 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624676426 0 0) 0x7fcd0006bb50 con 0x7fcd000c50b0 2023-11-15T01:36:38.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fccf7fff700 1 --2- 172.21.15.1:0/3669788086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd000bc410 0x7fcd000c5490 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fcce8006fd0 tx=0x7fcce80090f0).ready entity=mon.0 client_cookie=9199fb5ae2249a33 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:38.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fccfeffd700 1 -- 172.21.15.1:0/3669788086 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce800b580 con 0x7fcd000bc410 2023-11-15T01:36:38.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.154+0000 7fccfeffd700 1 -- 172.21.15.1:0/3669788086 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce800b6e0 con 0x7fcd000bc410 2023-11-15T01:36:38.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.155+0000 7fccfeffd700 1 -- 172.21.15.1:0/3669788086 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce800ba60 con 0x7fcd000bc410 2023-11-15T01:36:38.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.155+0000 7fcd04f9d700 1 -- 172.21.15.1:0/3669788086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd000bc410 msgr2=0x7fcd000c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:38.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.155+0000 7fcd04f9d700 1 --2- 172.21.15.1:0/3669788086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd000bc410 0x7fcd000c5490 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fcce8006fd0 tx=0x7fcce80090f0).stop 2023-11-15T01:36:38.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.155+0000 7fcd04f9d700 1 -- 172.21.15.1:0/3669788086 shutdown_connections 2023-11-15T01:36:38.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.155+0000 7fcd04f9d700 1 --2- 172.21.15.1:0/3669788086 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd000bd330 0x7fcd000637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.155+0000 7fcd04f9d700 1 --2- 172.21.15.1:0/3669788086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd000bc410 0x7fcd000c5490 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.155+0000 7fcd04f9d700 1 -- 172.21.15.1:0/3669788086 >> 172.21.15.1:0/3669788086 conn(0x7fcd000c3e30 msgr2=0x7fcd000c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:38.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.155+0000 7fcd04f9d700 1 -- 172.21.15.1:0/3669788086 shutdown_connections 2023-11-15T01:36:38.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.155+0000 7fcd04f9d700 1 -- 172.21.15.1:0/3669788086 wait complete. 2023-11-15T01:36:38.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.156+0000 7fcd04f9d700 1 Processor -- start 2023-11-15T01:36:38.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.156+0000 7fcd04f9d700 1 -- start start 2023-11-15T01:36:38.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.157+0000 7fcd04f9d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd000bc410 0x7fcd0014aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.157+0000 7fcd04f9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd000bd330 0x7fcd0014a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.157+0000 7fcd04f9d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd000c50b0 0x7fcd0014d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.157+0000 7fcd04f9d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000a7d30 con 0x7fcd000bd330 2023-11-15T01:36:38.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.157+0000 7fcd04f9d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000a7fb0 con 0x7fcd000bc410 2023-11-15T01:36:38.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.157+0000 7fcd04f9d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000a8290 con 0x7fcd000c50b0 2023-11-15T01:36:38.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.157+0000 7fccf7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd000bd330 0x7fcd0014a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:38.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.157+0000 7fccf7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd000bd330 0x7fcd0014a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35272/0 (socket says 172.21.15.1:35272) 2023-11-15T01:36:38.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.157+0000 7fccf7fff700 1 -- 172.21.15.1:0/3448584863 learned_addr learned my addr 172.21.15.1:0/3448584863 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:38.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.157+0000 7fccfffff700 1 --2- 172.21.15.1:0/3448584863 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd000c50b0 0x7fcd0014d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:38.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.157+0000 7fccff7fe700 1 --2- 172.21.15.1:0/3448584863 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd000bc410 0x7fcd0014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:38.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.158+0000 7fccf7fff700 1 -- 172.21.15.1:0/3448584863 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd000c50b0 msgr2=0x7fcd0014d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:38.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.158+0000 7fccf7fff700 1 --2- 172.21.15.1:0/3448584863 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd000c50b0 0x7fcd0014d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.158+0000 7fccf7fff700 1 -- 172.21.15.1:0/3448584863 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd000bc410 msgr2=0x7fcd0014aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:38.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.158+0000 7fccf7fff700 1 --2- 172.21.15.1:0/3448584863 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd000bc410 0x7fcd0014aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.158+0000 7fccf7fff700 1 -- 172.21.15.1:0/3448584863 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce8009370 con 0x7fcd000bd330 2023-11-15T01:36:38.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.158+0000 7fccf7fff700 1 --2- 172.21.15.1:0/3448584863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd000bd330 0x7fcd0014a0e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fcce8009130 tx=0x7fcce8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:38.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.158+0000 7fccf77fe700 1 -- 172.21.15.1:0/3448584863 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8000bc0 con 0x7fcd000bd330 2023-11-15T01:36:38.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.158+0000 7fccf77fe700 1 -- 172.21.15.1:0/3448584863 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce800b850 con 0x7fcd000bd330 2023-11-15T01:36:38.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.158+0000 7fcd04f9d700 1 -- 172.21.15.1:0/3448584863 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd000a8570 con 0x7fcd000bd330 2023-11-15T01:36:38.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.158+0000 7fccf77fe700 1 -- 172.21.15.1:0/3448584863 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8000d20 con 0x7fcd000bd330 2023-11-15T01:36:38.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.158+0000 7fcd04f9d700 1 -- 172.21.15.1:0/3448584863 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd000a8b30 con 0x7fcd000bd330 2023-11-15T01:36:38.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.159+0000 7fcd04f9d700 1 -- 172.21.15.1:0/3448584863 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd000a8d20 con 0x7fcd000bd330 2023-11-15T01:36:38.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.160+0000 7fccf77fe700 1 -- 172.21.15.1:0/3448584863 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fcce801b8f0 con 0x7fcd000bd330 2023-11-15T01:36:38.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.160+0000 7fccf77fe700 1 --2- 172.21.15.1:0/3448584863 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcce005f300 0x7fcce00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.160+0000 7fccf77fe700 1 -- 172.21.15.1:0/3448584863 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fcce807bfa0 con 0x7fcd000bd330 2023-11-15T01:36:38.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.160+0000 7fccff7fe700 1 -- 172.21.15.1:0/3448584863 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcce005f300 msgr2=0x7fcce00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:38.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.160+0000 7fccff7fe700 1 --2- 172.21.15.1:0/3448584863 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcce005f300 0x7fcce00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:38.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.164+0000 7fccf77fe700 1 -- 172.21.15.1:0/3448584863 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcce804cd60 con 0x7fcd000bd330 2023-11-15T01:36:38.182 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:38.182+0000 7f427ac4d680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:36:38.244 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:38.243+0000 7f79780df680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:36:38.248 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:38.248+0000 7f427ac4d680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:36:38.322 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:38.321+0000 7f79780df680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:36:38.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.340+0000 7fcd04f9d700 1 -- 172.21.15.1:0/3448584863 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd000475e0 con 0x7fcd000bd330 2023-11-15T01:36:38.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.341+0000 7fccf77fe700 1 -- 172.21.15.1:0/3448584863 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcce801f020 con 0x7fcd000bd330 2023-11-15T01:36:38.343 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:36:38.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.343+0000 7fcd04f9d700 1 -- 172.21.15.1:0/3448584863 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcce005f300 msgr2=0x7fcce00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:38.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.343+0000 7fcd04f9d700 1 --2- 172.21.15.1:0/3448584863 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcce005f300 0x7fcce00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:38.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.343+0000 7fcd04f9d700 1 -- 172.21.15.1:0/3448584863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd000bd330 msgr2=0x7fcd0014a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:38.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.343+0000 7fcd04f9d700 1 --2- 172.21.15.1:0/3448584863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd000bd330 0x7fcd0014a0e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fcce8009130 tx=0x7fcce8017000).stop 2023-11-15T01:36:38.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.343+0000 7fcd04f9d700 1 -- 172.21.15.1:0/3448584863 shutdown_connections 2023-11-15T01:36:38.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.343+0000 7fcd04f9d700 1 --2- 172.21.15.1:0/3448584863 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcce005f300 0x7fcce00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:38.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.343+0000 7fcd04f9d700 1 --2- 172.21.15.1:0/3448584863 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd000c50b0 0x7fcd0014d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.343+0000 7fcd04f9d700 1 --2- 172.21.15.1:0/3448584863 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd000bc410 0x7fcd0014aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.343+0000 7fcd04f9d700 1 --2- 172.21.15.1:0/3448584863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd000bd330 0x7fcd0014a0e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.343+0000 7fcd04f9d700 1 -- 172.21.15.1:0/3448584863 >> 172.21.15.1:0/3448584863 conn(0x7fcd000c3e30 msgr2=0x7fcd00150a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:38.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.343+0000 7fcd04f9d700 1 -- 172.21.15.1:0/3448584863 shutdown_connections 2023-11-15T01:36:38.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.343+0000 7fcd04f9d700 1 -- 172.21.15.1:0/3448584863 wait complete. 2023-11-15T01:36:38.357 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:36:38.395 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:38.394+0000 7f79780df680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:36:38.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.475+0000 7fb1960e8700 1 Processor -- start 2023-11-15T01:36:38.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.475+0000 7fb1960e8700 1 -- start start 2023-11-15T01:36:38.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.476+0000 7fb1960e8700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb190150530 0x7fb190150910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.476+0000 7fb1960e8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb190063160 0x7fb1900c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.476+0000 7fb1960e8700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1900c2290 con 0x7fb1900c2720 2023-11-15T01:36:38.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.476+0000 7fb1960e8700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1900c3050 con 0x7fb190063160 2023-11-15T01:36:38.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.476+0000 7fb1960e8700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1900650f0 con 0x7fb190150530 2023-11-15T01:36:38.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.476+0000 7fb18ffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb190063160 0x7fb1900c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:38.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.476+0000 7fb18ffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb190063160 0x7fb1900c2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35274/0 (socket says 172.21.15.1:35274) 2023-11-15T01:36:38.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.476+0000 7fb18f7fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb190150530 0x7fb190150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:38.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.476+0000 7fb18ffff700 1 -- 172.21.15.1:0/2781255498 learned_addr learned my addr 172.21.15.1:0/2781255498 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:38.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.477+0000 7fb18ffff700 1 -- 172.21.15.1:0/2781255498 >> v2:172.21.15.141:3300/0 conn(0x7fb190150530 msgr2=0x7fb190150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:38.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.477+0000 7fb18ffff700 1 --2- 172.21.15.1:0/2781255498 >> v2:172.21.15.141:3300/0 conn(0x7fb190150530 0x7fb190150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.477+0000 7fb18ffff700 1 -- 172.21.15.1:0/2781255498 >> v1:172.21.15.141:6789/0 conn(0x7fb1900c2720 legacy=0x7fb190062a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.477+0000 7fb18ffff700 1 -- 172.21.15.1:0/2781255498 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1900635f0 con 0x7fb190063160 2023-11-15T01:36:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.477+0000 7fb18ffff700 1 --2- 172.21.15.1:0/2781255498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190063160 0x7fb1900c2b60 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fb1900c7400 tx=0x7fb188009840).ready entity=mon.0 client_cookie=312ce7e531a5ecef server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.477+0000 7fb18e7fc700 1 -- 172.21.15.1:0/2781255498 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18800e070 con 0x7fb190063160 2023-11-15T01:36:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.477+0000 7fb18e7fc700 1 -- 172.21.15.1:0/2781255498 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18800ba20 con 0x7fb190063160 2023-11-15T01:36:38.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.477+0000 7fb18e7fc700 1 -- 172.21.15.1:0/2781255498 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18800bda0 con 0x7fb190063160 2023-11-15T01:36:38.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.478+0000 7fb1960e8700 1 -- 172.21.15.1:0/2781255498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190063160 msgr2=0x7fb1900c2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:38.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.478+0000 7fb1960e8700 1 --2- 172.21.15.1:0/2781255498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190063160 0x7fb1900c2b60 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fb1900c7400 tx=0x7fb188009840).stop 2023-11-15T01:36:38.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.478+0000 7fb1960e8700 1 -- 172.21.15.1:0/2781255498 shutdown_connections 2023-11-15T01:36:38.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.478+0000 7fb1960e8700 1 --2- 172.21.15.1:0/2781255498 >> v2:172.21.15.141:3300/0 conn(0x7fb190150530 0x7fb190150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.478+0000 7fb1960e8700 1 --2- 172.21.15.1:0/2781255498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190063160 0x7fb1900c2b60 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.478+0000 7fb1960e8700 1 -- 172.21.15.1:0/2781255498 >> 172.21.15.1:0/2781255498 conn(0x7fb1900c74f0 msgr2=0x7fb1900c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:38.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.478+0000 7fb1960e8700 1 -- 172.21.15.1:0/2781255498 shutdown_connections 2023-11-15T01:36:38.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.478+0000 7fb1960e8700 1 -- 172.21.15.1:0/2781255498 wait complete. 2023-11-15T01:36:38.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.479+0000 7fb1960e8700 1 Processor -- start 2023-11-15T01:36:38.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.479+0000 7fb1960e8700 1 -- start start 2023-11-15T01:36:38.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb1960e8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1900c2720 0x7fb1900c0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb1960e8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190150530 0x7fb19014bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb1960e8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1900bd640 0x7fb1900be610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb1960e8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1900bb4a0 con 0x7fb190150530 2023-11-15T01:36:38.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb1960e8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1900c0fc0 con 0x7fb1900bd640 2023-11-15T01:36:38.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb1960e8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1900c0730 con 0x7fb1900c2720 2023-11-15T01:36:38.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb18effd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190150530 0x7fb19014bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:38.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb18effd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190150530 0x7fb19014bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35284/0 (socket says 172.21.15.1:35284) 2023-11-15T01:36:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb18effd700 1 -- 172.21.15.1:0/727820354 learned_addr learned my addr 172.21.15.1:0/727820354 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb18f7fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1900c2720 0x7fb1900c0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb18ffff700 1 --2- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1900bd640 0x7fb1900be610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb18effd700 1 -- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1900c2720 msgr2=0x7fb1900c0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb18effd700 1 --2- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1900c2720 0x7fb1900c0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb18effd700 1 -- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1900bd640 msgr2=0x7fb1900be610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:38.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb18effd700 1 --2- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1900bd640 0x7fb1900be610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb18effd700 1 -- 172.21.15.1:0/727820354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb188009ae0 con 0x7fb190150530 2023-11-15T01:36:38.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb18f7fe700 1 --2- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1900c2720 0x7fb1900c0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:38.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.480+0000 7fb18ffff700 1 --2- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1900bd640 0x7fb1900be610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:38.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.481+0000 7fb18effd700 1 --2- 172.21.15.1:0/727820354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190150530 0x7fb19014bd50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fb18400c4c0 tx=0x7fb184007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:38.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.481+0000 7fb1777fe700 1 -- 172.21.15.1:0/727820354 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18400ce70 con 0x7fb190150530 2023-11-15T01:36:38.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.481+0000 7fb1777fe700 1 -- 172.21.15.1:0/727820354 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb184001e90 con 0x7fb190150530 2023-11-15T01:36:38.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.481+0000 7fb1960e8700 1 -- 172.21.15.1:0/727820354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1900c0a00 con 0x7fb190150530 2023-11-15T01:36:38.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.481+0000 7fb1777fe700 1 -- 172.21.15.1:0/727820354 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184007250 con 0x7fb190150530 2023-11-15T01:36:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.481+0000 7fb1960e8700 1 -- 172.21.15.1:0/727820354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1900bb130 con 0x7fb190150530 2023-11-15T01:36:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.482+0000 7fb1777fe700 1 -- 172.21.15.1:0/727820354 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fb1840066a0 con 0x7fb190150530 2023-11-15T01:36:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.482+0000 7fb1960e8700 1 -- 172.21.15.1:0/727820354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19006c7e0 con 0x7fb190150530 2023-11-15T01:36:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.482+0000 7fb1777fe700 1 --2- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb17c05f300 0x7fb17c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.482+0000 7fb1777fe700 1 -- 172.21.15.1:0/727820354 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fb184079fe0 con 0x7fb190150530 2023-11-15T01:36:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.482+0000 7fb18f7fe700 1 -- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb17c05f300 msgr2=0x7fb17c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.482+0000 7fb18f7fe700 1 --2- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb17c05f300 0x7fb17c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.487+0000 7fb1777fe700 1 -- 172.21.15.1:0/727820354 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb18404ae00 con 0x7fb190150530 2023-11-15T01:36:38.503 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:38.503+0000 7f427ac4d680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:36:38.674 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:38.673+0000 7f79780df680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:36:38.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.683+0000 7fb18f7fe700 1 -- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb17c05f300 msgr2=0x7fb17c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:38.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.683+0000 7fb18f7fe700 1 --2- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb17c05f300 0x7fb17c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:36:38.686 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:38.685+0000 7f427ac4d680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:36:38.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.702+0000 7fb1960e8700 1 -- 172.21.15.1:0/727820354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1900bb5e0 con 0x7fb190150530 2023-11-15T01:36:38.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.703+0000 7fb1777fe700 1 -- 172.21.15.1:0/727820354 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4487 (secure 0 0 0) 0x7fb18404e420 con 0x7fb190150530 2023-11-15T01:36:38.704 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:38.704 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/246517652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":246517652},{"type":"v1","addr":"172.21.15.141:6836","nonce":246517652}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5857,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3341576602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3341576602},{"type":"v1","addr":"172.21.15.141:6837","nonce":3341576602}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2509339424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2509339424},{"type":"v1","addr":"172.21.15.1:6834","nonce":2509339424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:36:21.564233+0000","modified":"2023-11-15T01:36:24.818307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3051659352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3051659352},{"type":"v1","addr":"172.21.15.1:6835","nonce":3051659352}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-11-15T01:36:38.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.704+0000 7fb1960e8700 1 -- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb17c05f300 msgr2=0x7fb17c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:38.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.704+0000 7fb1960e8700 1 --2- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb17c05f300 0x7fb17c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:38.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.704+0000 7fb1960e8700 1 -- 172.21.15.1:0/727820354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190150530 msgr2=0x7fb19014bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:38.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.704+0000 7fb1960e8700 1 --2- 172.21.15.1:0/727820354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190150530 0x7fb19014bd50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fb18400c4c0 tx=0x7fb184007e00).stop 2023-11-15T01:36:38.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.704+0000 7fb1960e8700 1 -- 172.21.15.1:0/727820354 shutdown_connections 2023-11-15T01:36:38.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.704+0000 7fb1960e8700 1 --2- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb17c05f300 0x7fb17c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:38.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.704+0000 7fb1960e8700 1 --2- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1900bd640 0x7fb1900be610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.704+0000 7fb1960e8700 1 --2- 172.21.15.1:0/727820354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1900c2720 0x7fb1900c0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.704+0000 7fb1960e8700 1 --2- 172.21.15.1:0/727820354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190150530 0x7fb19014bd50 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.704+0000 7fb1960e8700 1 -- 172.21.15.1:0/727820354 >> 172.21.15.1:0/727820354 conn(0x7fb1900c74f0 msgr2=0x7fb190062a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:38.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.705+0000 7fb1960e8700 1 -- 172.21.15.1:0/727820354 shutdown_connections 2023-11-15T01:36:38.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.705+0000 7fb1960e8700 1 -- 172.21.15.1:0/727820354 wait complete. 2023-11-15T01:36:38.709 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 31 2023-11-15T01:36:38.718 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:36:38.867 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:38.866+0000 7f79780df680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:36:38.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.880+0000 7efd4ecb5700 1 Processor -- start 2023-11-15T01:36:38.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.880+0000 7efd4ecb5700 1 -- start start 2023-11-15T01:36:38.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.881+0000 7efd4ecb5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd48066a40 0x7efd48069460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.881+0000 7efd4ecb5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efd48069950 0x7efd48155260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.881+0000 7efd4ecb5700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd481528e0 con 0x7efd480c7350 2023-11-15T01:36:38.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.881+0000 7efd4ecb5700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd48069de0 con 0x7efd48069950 2023-11-15T01:36:38.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.881+0000 7efd4ecb5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd48066ec0 con 0x7efd48066a40 2023-11-15T01:36:38.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.881+0000 7efd4e4b4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efd48069950 0x7efd48155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:38.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.881+0000 7efd4e4b4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efd48069950 0x7efd48155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35292/0 (socket says 172.21.15.1:35292) 2023-11-15T01:36:38.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.882+0000 7efd4e4b4700 1 -- 172.21.15.1:0/531000547 learned_addr learned my addr 172.21.15.1:0/531000547 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:38.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.882+0000 7efd4d4b2700 1 --2- 172.21.15.1:0/531000547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd48066a40 0x7efd48069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:38.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.882+0000 7efd4e4b4700 1 -- 172.21.15.1:0/531000547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd48066a40 msgr2=0x7efd48069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:38.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.882+0000 7efd4e4b4700 1 --2- 172.21.15.1:0/531000547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd48066a40 0x7efd48069460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.882+0000 7efd4e4b4700 1 -- 172.21.15.1:0/531000547 >> v1:172.21.15.141:6789/0 conn(0x7efd480c7350 legacy=0x7efd48065560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:38.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.882+0000 7efd4e4b4700 1 -- 172.21.15.1:0/531000547 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48151d60 con 0x7efd48069950 2023-11-15T01:36:38.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.882+0000 7efd4e4b4700 1 --2- 172.21.15.1:0/531000547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd48069950 0x7efd48155260 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7efd4000d1a0 tx=0x7efd4000ba50).ready entity=mon.0 client_cookie=a113c8f52f90283c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:38.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.882+0000 7efd4ccb1700 1 -- 172.21.15.1:0/531000547 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40010070 con 0x7efd48069950 2023-11-15T01:36:38.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.882+0000 7efd4ccb1700 1 -- 172.21.15.1:0/531000547 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4000de10 con 0x7efd48069950 2023-11-15T01:36:38.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.882+0000 7efd4ccb1700 1 -- 172.21.15.1:0/531000547 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4000b2e0 con 0x7efd48069950 2023-11-15T01:36:38.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.883+0000 7efd4ecb5700 1 -- 172.21.15.1:0/531000547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd48069950 msgr2=0x7efd48155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:38.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.883+0000 7efd4ecb5700 1 --2- 172.21.15.1:0/531000547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd48069950 0x7efd48155260 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7efd4000d1a0 tx=0x7efd4000ba50).stop 2023-11-15T01:36:38.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.883+0000 7efd4ecb5700 1 -- 172.21.15.1:0/531000547 shutdown_connections 2023-11-15T01:36:38.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.883+0000 7efd4ecb5700 1 --2- 172.21.15.1:0/531000547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd48069950 0x7efd48155260 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.883+0000 7efd4ecb5700 1 --2- 172.21.15.1:0/531000547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd48066a40 0x7efd48069460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.883+0000 7efd4ecb5700 1 -- 172.21.15.1:0/531000547 >> 172.21.15.1:0/531000547 conn(0x7efd480c7c10 msgr2=0x7efd480c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:38.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.883+0000 7efd4ecb5700 1 -- 172.21.15.1:0/531000547 shutdown_connections 2023-11-15T01:36:38.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.883+0000 7efd4ecb5700 1 -- 172.21.15.1:0/531000547 wait complete. 2023-11-15T01:36:38.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.885+0000 7efd4ecb5700 1 Processor -- start 2023-11-15T01:36:38.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.885+0000 7efd4ecb5700 1 -- start start 2023-11-15T01:36:38.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4ecb5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd48066a40 0x7efd480a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4ecb5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efd48069950 0x7efd481391b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4ecb5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd480c7350 0x7efd48151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4ecb5700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd48139dd0 con 0x7efd48066a40 2023-11-15T01:36:38.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4ecb5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd48160e10 con 0x7efd48069950 2023-11-15T01:36:38.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4ecb5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd481610f0 con 0x7efd480c7350 2023-11-15T01:36:38.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4dcb3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd48066a40 0x7efd480a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:38.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4dcb3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd48066a40 0x7efd480a76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35304/0 (socket says 172.21.15.1:35304) 2023-11-15T01:36:38.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4dcb3700 1 -- 172.21.15.1:0/3639202208 learned_addr learned my addr 172.21.15.1:0/3639202208 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:38.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4d4b2700 1 --2- 172.21.15.1:0/3639202208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efd48069950 0x7efd481391b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:38.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4e4b4700 1 --2- 172.21.15.1:0/3639202208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd480c7350 0x7efd48151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:38.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4dcb3700 1 -- 172.21.15.1:0/3639202208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd480c7350 msgr2=0x7efd48151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:38.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4dcb3700 1 --2- 172.21.15.1:0/3639202208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd480c7350 0x7efd48151150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4dcb3700 1 -- 172.21.15.1:0/3639202208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efd48069950 msgr2=0x7efd481391b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:38.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4dcb3700 1 --2- 172.21.15.1:0/3639202208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efd48069950 0x7efd481391b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:38.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.886+0000 7efd4dcb3700 1 -- 172.21.15.1:0/3639202208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4000bcf0 con 0x7efd48066a40 2023-11-15T01:36:38.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.887+0000 7efd4dcb3700 1 --2- 172.21.15.1:0/3639202208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd48066a40 0x7efd480a76f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7efd3800c4c0 tx=0x7efd38007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:38.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.887+0000 7efd3dffb700 1 -- 172.21.15.1:0/3639202208 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3800ce70 con 0x7efd48066a40 2023-11-15T01:36:38.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.887+0000 7efd3dffb700 1 -- 172.21.15.1:0/3639202208 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd38001e90 con 0x7efd48066a40 2023-11-15T01:36:38.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.887+0000 7efd3dffb700 1 -- 172.21.15.1:0/3639202208 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38007250 con 0x7efd48066a40 2023-11-15T01:36:38.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.887+0000 7efd4ecb5700 1 -- 172.21.15.1:0/3639202208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd481613d0 con 0x7efd48066a40 2023-11-15T01:36:38.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.887+0000 7efd4ecb5700 1 -- 172.21.15.1:0/3639202208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd48161990 con 0x7efd48066a40 2023-11-15T01:36:38.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.888+0000 7efd4ecb5700 1 -- 172.21.15.1:0/3639202208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd480475e0 con 0x7efd48066a40 2023-11-15T01:36:38.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.888+0000 7efd3dffb700 1 -- 172.21.15.1:0/3639202208 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7efd380066a0 con 0x7efd48066a40 2023-11-15T01:36:38.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.889+0000 7efd3dffb700 1 --2- 172.21.15.1:0/3639202208 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efd2c05f300 0x7efd2c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:38.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.889+0000 7efd3dffb700 1 -- 172.21.15.1:0/3639202208 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6803+0+0 (secure 0 0 0) 0x7efd38079e80 con 0x7efd48066a40 2023-11-15T01:36:38.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.889+0000 7efd4d4b2700 1 -- 172.21.15.1:0/3639202208 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efd2c05f300 msgr2=0x7efd2c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:38.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.889+0000 7efd4d4b2700 1 --2- 172.21.15.1:0/3639202208 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efd2c05f300 0x7efd2c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:38.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:38.893+0000 7efd3dffb700 1 -- 172.21.15.1:0/3639202208 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efd3804aca0 con 0x7efd48066a40 2023-11-15T01:36:39.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.068+0000 7efd4ecb5700 1 -- 172.21.15.1:0/3639202208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd48152040 con 0x7efd48066a40 2023-11-15T01:36:39.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.070+0000 7efd3dffb700 1 -- 172.21.15.1:0/3639202208 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+17898 (secure 0 0 0) 0x7efd3804e2c0 con 0x7efd48066a40 2023-11-15T01:36:39.071 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:39.072 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:36:34.049350+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:36:19.249413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-15T01:36:20.544874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/2815631318":"2023-11-16T01:36:34.049309+0000","172.21.15.141:0/3992492485":"2023-11-16T01:36:34.049309+0000","172.21.15.141:6833/90546":"2023-11-16T01:36:34.049309+0000","172.21.15.141:6832/90546":"2023-11-16T01:36:34.049309+0000","172.21.15.141:0/619934892":"2023-11-16T01:36:34.049309+0000","172.21.15.141:0/3354476443":"2023-11-16T01:36:34.049309+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:36:39.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.072+0000 7efd4ecb5700 1 -- 172.21.15.1:0/3639202208 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efd2c05f300 msgr2=0x7efd2c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:39.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.072+0000 7efd4ecb5700 1 --2- 172.21.15.1:0/3639202208 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efd2c05f300 0x7efd2c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:39.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.072+0000 7efd4ecb5700 1 -- 172.21.15.1:0/3639202208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd48066a40 msgr2=0x7efd480a76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.072+0000 7efd4ecb5700 1 --2- 172.21.15.1:0/3639202208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd48066a40 0x7efd480a76f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7efd3800c4c0 tx=0x7efd38007e00).stop 2023-11-15T01:36:39.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.072+0000 7efd4ecb5700 1 -- 172.21.15.1:0/3639202208 shutdown_connections 2023-11-15T01:36:39.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.072+0000 7efd4ecb5700 1 --2- 172.21.15.1:0/3639202208 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efd2c05f300 0x7efd2c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:39.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.072+0000 7efd4ecb5700 1 --2- 172.21.15.1:0/3639202208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd480c7350 0x7efd48151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.072+0000 7efd4ecb5700 1 --2- 172.21.15.1:0/3639202208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd48066a40 0x7efd480a76f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.072+0000 7efd4ecb5700 1 --2- 172.21.15.1:0/3639202208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efd48069950 0x7efd481391b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.072+0000 7efd4ecb5700 1 -- 172.21.15.1:0/3639202208 >> 172.21.15.1:0/3639202208 conn(0x7efd480c7c10 msgr2=0x7efd480ad370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:39.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.072+0000 7efd4ecb5700 1 -- 172.21.15.1:0/3639202208 shutdown_connections 2023-11-15T01:36:39.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.072+0000 7efd4ecb5700 1 -- 172.21.15.1:0/3639202208 wait complete. 2023-11-15T01:36:39.086 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-15T01:36:39.087 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:36:39.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.206+0000 7f6b04d7e700 1 Processor -- start 2023-11-15T01:36:39.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.206+0000 7f6b04d7e700 1 -- start start 2023-11-15T01:36:39.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6b04d7e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b00155790 0x7f6b000a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6b04d7e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6b00155b70 0x7f6b000c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6b04d7e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b00083630 con 0x7f6b000a61b0 2023-11-15T01:36:39.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6b04d7e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b000c5420 con 0x7f6b00155b70 2023-11-15T01:36:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6b04d7e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b000c7c90 con 0x7f6b00155790 2023-11-15T01:36:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6afdd9b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6b00155b70 0x7f6b000c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6afe59c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b00155790 0x7f6b000a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6afe59c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b00155790 0x7f6b000a5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:46334/0 (socket says 172.21.15.1:46334) 2023-11-15T01:36:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6afdd9b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6b00155b70 0x7f6b000c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:51974/0 (socket says 172.21.15.1:51974) 2023-11-15T01:36:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6afe59c700 1 -- 172.21.15.1:0/1539279440 learned_addr learned my addr 172.21.15.1:0/1539279440 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:39.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6afe59c700 1 -- 172.21.15.1:0/1539279440 >> v2:172.21.15.141:3300/0 conn(0x7f6b00155b70 msgr2=0x7f6b000c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:39.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6afe59c700 1 --2- 172.21.15.1:0/1539279440 >> v2:172.21.15.141:3300/0 conn(0x7f6b00155b70 0x7f6b000c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6afe59c700 1 -- 172.21.15.1:0/1539279440 >> v1:172.21.15.141:6789/0 conn(0x7f6b000a61b0 legacy=0x7f6b000c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6afe59c700 1 -- 172.21.15.1:0/1539279440 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b000c7960 con 0x7f6b00155790 2023-11-15T01:36:39.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6afd59a700 1 -- 172.21.15.1:0/1539279440 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244249390 0 0) 0x7f6b00083630 con 0x7f6b000a61b0 2023-11-15T01:36:39.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.207+0000 7f6afdd9b700 1 --2- 172.21.15.1:0/1539279440 >> v2:172.21.15.141:3300/0 conn(0x7f6b00155b70 0x7f6b000c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:39.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.208+0000 7f6afe59c700 1 --2- 172.21.15.1:0/1539279440 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b00155790 0x7f6b000a5cc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6af0009810 tx=0x7f6af0009060).ready entity=mon.2 client_cookie=4366c7bd13ecbf5e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:39.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.208+0000 7f6afd59a700 1 -- 172.21.15.1:0/1539279440 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0005880 con 0x7f6b00155790 2023-11-15T01:36:39.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.208+0000 7f6afd59a700 1 -- 172.21.15.1:0/1539279440 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af00059e0 con 0x7f6b00155790 2023-11-15T01:36:39.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.208+0000 7f6afd59a700 1 -- 172.21.15.1:0/1539279440 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0005d60 con 0x7f6b00155790 2023-11-15T01:36:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.208+0000 7f6b04d7e700 1 -- 172.21.15.1:0/1539279440 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b00155790 msgr2=0x7f6b000a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.208+0000 7f6b04d7e700 1 --2- 172.21.15.1:0/1539279440 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b00155790 0x7f6b000a5cc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6af0009810 tx=0x7f6af0009060).stop 2023-11-15T01:36:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.208+0000 7f6b04d7e700 1 -- 172.21.15.1:0/1539279440 shutdown_connections 2023-11-15T01:36:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.208+0000 7f6b04d7e700 1 --2- 172.21.15.1:0/1539279440 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b00155790 0x7f6b000a5cc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.208+0000 7f6b04d7e700 1 --2- 172.21.15.1:0/1539279440 >> v2:172.21.15.141:3300/0 conn(0x7f6b00155b70 0x7f6b000c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.208+0000 7f6b04d7e700 1 -- 172.21.15.1:0/1539279440 >> 172.21.15.1:0/1539279440 conn(0x7f6b00082f90 msgr2=0x7f6b000c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:39.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.208+0000 7f6b04d7e700 1 -- 172.21.15.1:0/1539279440 shutdown_connections 2023-11-15T01:36:39.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.208+0000 7f6b04d7e700 1 -- 172.21.15.1:0/1539279440 wait complete. 2023-11-15T01:36:39.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.209+0000 7f6b04d7e700 1 Processor -- start 2023-11-15T01:36:39.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.210+0000 7f6b04d7e700 1 -- start start 2023-11-15T01:36:39.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.210+0000 7f6b04d7e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b000a61b0 0x7f6b001522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.210+0000 7f6b04d7e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b00155790 0x7f6b000c0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.210+0000 7f6b04d7e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b00155b70 0x7f6b000c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.210+0000 7f6b04d7e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b00156640 con 0x7f6b000a61b0 2023-11-15T01:36:39.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.210+0000 7f6b04d7e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b001589d0 con 0x7f6b00155790 2023-11-15T01:36:39.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.210+0000 7f6b04d7e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b000c1320 con 0x7f6b00155b70 2023-11-15T01:36:39.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.210+0000 7f6afe59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b000a61b0 0x7f6b001522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:39.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.210+0000 7f6afe59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b000a61b0 0x7f6b001522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35310/0 (socket says 172.21.15.1:35310) 2023-11-15T01:36:39.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.210+0000 7f6afe59c700 1 -- 172.21.15.1:0/4075347959 learned_addr learned my addr 172.21.15.1:0/4075347959 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:39.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.210+0000 7f6afed9d700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b00155b70 0x7f6b000c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:39.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.211+0000 7f6afdd9b700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b00155790 0x7f6b000c0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:39.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.211+0000 7f6afe59c700 1 -- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b00155b70 msgr2=0x7f6b000c0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.211+0000 7f6afe59c700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b00155b70 0x7f6b000c0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.211+0000 7f6afe59c700 1 -- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b00155790 msgr2=0x7f6b000c0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.211+0000 7f6afe59c700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b00155790 0x7f6b000c0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.211+0000 7f6afe59c700 1 -- 172.21.15.1:0/4075347959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af40092a0 con 0x7f6b000a61b0 2023-11-15T01:36:39.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.211+0000 7f6afed9d700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b00155b70 0x7f6b000c0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:39.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.211+0000 7f6afdd9b700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b00155790 0x7f6b000c0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:39.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.211+0000 7f6afe59c700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b000a61b0 0x7f6b001522c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f6af0009eb0 tx=0x7f6af0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:39.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.211+0000 7f6aee7fc700 1 -- 172.21.15.1:0/4075347959 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af000b580 con 0x7f6b000a61b0 2023-11-15T01:36:39.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.211+0000 7f6aee7fc700 1 -- 172.21.15.1:0/4075347959 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af000b6e0 con 0x7f6b000a61b0 2023-11-15T01:36:39.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.211+0000 7f6b04d7e700 1 -- 172.21.15.1:0/4075347959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af0009300 con 0x7f6b000a61b0 2023-11-15T01:36:39.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.211+0000 7f6aee7fc700 1 -- 172.21.15.1:0/4075347959 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af000ba60 con 0x7f6b000a61b0 2023-11-15T01:36:39.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.211+0000 7f6b04d7e700 1 -- 172.21.15.1:0/4075347959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b00155ff0 con 0x7f6b000a61b0 2023-11-15T01:36:39.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.213+0000 7f6b04d7e700 1 -- 172.21.15.1:0/4075347959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b0006c7e0 con 0x7f6b000a61b0 2023-11-15T01:36:39.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.213+0000 7f6aee7fc700 1 -- 172.21.15.1:0/4075347959 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f6af0018070 con 0x7f6b000a61b0 2023-11-15T01:36:39.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.213+0000 7f6aee7fc700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ae005f300 0x7f6ae00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.213+0000 7f6afdd9b700 1 -- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ae005f300 msgr2=0x7f6ae00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:39.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.213+0000 7f6aee7fc700 1 -- 172.21.15.1:0/4075347959 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f6af007b630 con 0x7f6b000a61b0 2023-11-15T01:36:39.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.213+0000 7f6afdd9b700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ae005f300 0x7f6ae00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:39.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.217+0000 7f6aee7fc700 1 -- 172.21.15.1:0/4075347959 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6af004c3f0 con 0x7f6b000a61b0 2023-11-15T01:36:39.337 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:39.335+0000 7f427ac4d680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:36:39.405 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:39.403+0000 7f427ac4d680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:36:39.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.414+0000 7f6afdd9b700 1 -- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ae005f300 msgr2=0x7f6ae00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:39.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.414+0000 7f6afdd9b700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ae005f300 0x7f6ae00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:36:39.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.438+0000 7f6b04d7e700 1 -- 172.21.15.1:0/4075347959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b0005f8b0 con 0x7f6b000a61b0 2023-11-15T01:36:39.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.438+0000 7f6aee7fc700 1 -- 172.21.15.1:0/4075347959 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4487 (secure 0 0 0) 0x7f6af004fa10 con 0x7f6b000a61b0 2023-11-15T01:36:39.440 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:39.440 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/246517652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":246517652},{"type":"v1","addr":"172.21.15.141:6836","nonce":246517652}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5857,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3341576602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3341576602},{"type":"v1","addr":"172.21.15.141:6837","nonce":3341576602}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2509339424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2509339424},{"type":"v1","addr":"172.21.15.1:6834","nonce":2509339424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:36:21.564233+0000","modified":"2023-11-15T01:36:24.818307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3051659352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3051659352},{"type":"v1","addr":"172.21.15.1:6835","nonce":3051659352}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-11-15T01:36:39.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.440+0000 7f6b04d7e700 1 -- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ae005f300 msgr2=0x7f6ae00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:39.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.440+0000 7f6b04d7e700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ae005f300 0x7f6ae00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:39.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.440+0000 7f6b04d7e700 1 -- 172.21.15.1:0/4075347959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b000a61b0 msgr2=0x7f6b001522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.440+0000 7f6b04d7e700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b000a61b0 0x7f6b001522c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f6af0009eb0 tx=0x7f6af0016000).stop 2023-11-15T01:36:39.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.440+0000 7f6b04d7e700 1 -- 172.21.15.1:0/4075347959 shutdown_connections 2023-11-15T01:36:39.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.440+0000 7f6b04d7e700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ae005f300 0x7f6ae00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:39.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.440+0000 7f6b04d7e700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b00155b70 0x7f6b000c0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.440+0000 7f6b04d7e700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b000a61b0 0x7f6b001522c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.440+0000 7f6b04d7e700 1 --2- 172.21.15.1:0/4075347959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b00155790 0x7f6b000c0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.440+0000 7f6b04d7e700 1 -- 172.21.15.1:0/4075347959 >> 172.21.15.1:0/4075347959 conn(0x7f6b00082f90 msgr2=0x7f6b000c3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:39.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.440+0000 7f6b04d7e700 1 -- 172.21.15.1:0/4075347959 shutdown_connections 2023-11-15T01:36:39.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.441+0000 7f6b04d7e700 1 -- 172.21.15.1:0/4075347959 wait complete. 2023-11-15T01:36:39.445 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 31 2023-11-15T01:36:39.455 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:36:39.479 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:39.478+0000 7f427ac4d680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:36:39.568 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:39.566+0000 7f79780df680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:36:39.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.575+0000 7efc08481700 1 Processor -- start 2023-11-15T01:36:39.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.575+0000 7efc08481700 1 -- start start 2023-11-15T01:36:39.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.576+0000 7efc08481700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc00154680 0x7efc00069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.576+0000 7efc08481700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efc000c70c0 0x7efc000bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.576+0000 7efc08481700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc000c3360 con 0x7efc000bccd0 2023-11-15T01:36:39.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.576+0000 7efc08481700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc000bd620 con 0x7efc000c70c0 2023-11-15T01:36:39.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.576+0000 7efc08481700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc000c2750 con 0x7efc00154680 2023-11-15T01:36:39.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.576+0000 7efc06a1e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efc000c70c0 0x7efc000bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:39.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.576+0000 7efc05a1c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7efc000bccd0 0x7efc000627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41566/0 (socket says 172.21.15.1:41566) 2023-11-15T01:36:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.576+0000 7efc06a1e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efc000c70c0 0x7efc000bd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35316/0 (socket says 172.21.15.1:35316) 2023-11-15T01:36:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.576+0000 7efc05a1c700 1 -- 172.21.15.1:0/322547419 learned_addr learned my addr 172.21.15.1:0/322547419 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.576+0000 7efc0621d700 1 --2- 172.21.15.1:0/322547419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc00154680 0x7efc00069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.577+0000 7efc06a1e700 1 -- 172.21.15.1:0/322547419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc00154680 msgr2=0x7efc00069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.577+0000 7efc06a1e700 1 --2- 172.21.15.1:0/322547419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc00154680 0x7efc00069fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.577+0000 7efc06a1e700 1 -- 172.21.15.1:0/322547419 >> v1:172.21.15.1:6789/0 conn(0x7efc000bccd0 legacy=0x7efc000627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.577+0000 7efc0521b700 1 -- 172.21.15.1:0/322547419 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148767594 0 0) 0x7efc000c3360 con 0x7efc000bccd0 2023-11-15T01:36:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.577+0000 7efc06a1e700 1 -- 172.21.15.1:0/322547419 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc000c2a30 con 0x7efc000c70c0 2023-11-15T01:36:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.577+0000 7efc06a1e700 1 --2- 172.21.15.1:0/322547419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc000c70c0 0x7efc000bd130 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7efbf8009e60 tx=0x7efbf8009780).ready entity=mon.0 client_cookie=aa5f50c085e29518 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.577+0000 7efc0521b700 1 -- 172.21.15.1:0/322547419 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf800e070 con 0x7efc000c70c0 2023-11-15T01:36:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.577+0000 7efc0521b700 1 -- 172.21.15.1:0/322547419 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf800bb60 con 0x7efc000c70c0 2023-11-15T01:36:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.577+0000 7efc0521b700 1 -- 172.21.15.1:0/322547419 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf8012410 con 0x7efc000c70c0 2023-11-15T01:36:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.578+0000 7efc08481700 1 -- 172.21.15.1:0/322547419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc000c70c0 msgr2=0x7efc000bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.578+0000 7efc08481700 1 --2- 172.21.15.1:0/322547419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc000c70c0 0x7efc000bd130 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7efbf8009e60 tx=0x7efbf8009780).stop 2023-11-15T01:36:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.578+0000 7efc08481700 1 -- 172.21.15.1:0/322547419 shutdown_connections 2023-11-15T01:36:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.578+0000 7efc08481700 1 --2- 172.21.15.1:0/322547419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc000c70c0 0x7efc000bd130 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.578+0000 7efc08481700 1 --2- 172.21.15.1:0/322547419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc00154680 0x7efc00069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.578+0000 7efc08481700 1 -- 172.21.15.1:0/322547419 >> 172.21.15.1:0/322547419 conn(0x7efc000c7d70 msgr2=0x7efc000c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.578+0000 7efc08481700 1 -- 172.21.15.1:0/322547419 shutdown_connections 2023-11-15T01:36:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.578+0000 7efc08481700 1 -- 172.21.15.1:0/322547419 wait complete. 2023-11-15T01:36:39.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.579+0000 7efc08481700 1 Processor -- start 2023-11-15T01:36:39.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.579+0000 7efc08481700 1 -- start start 2023-11-15T01:36:39.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc08481700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc000bccd0 0x7efc00145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc08481700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc000c70c0 0x7efc00152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc08481700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc00154680 0x7efc000a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc08481700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc000bfe20 con 0x7efc000c70c0 2023-11-15T01:36:39.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc08481700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc000bf2a0 con 0x7efc000bccd0 2023-11-15T01:36:39.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc08481700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc000bf580 con 0x7efc00154680 2023-11-15T01:36:39.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc05a1c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc000c70c0 0x7efc00152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:39.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc05a1c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc000c70c0 0x7efc00152e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35326/0 (socket says 172.21.15.1:35326) 2023-11-15T01:36:39.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc05a1c700 1 -- 172.21.15.1:0/1505527905 learned_addr learned my addr 172.21.15.1:0/1505527905 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:39.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc06a1e700 1 --2- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc00154680 0x7efc000a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:39.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc0621d700 1 --2- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc000bccd0 0x7efc00145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:39.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc05a1c700 1 -- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc00154680 msgr2=0x7efc000a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc05a1c700 1 --2- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc00154680 0x7efc000a4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc05a1c700 1 -- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc000bccd0 msgr2=0x7efc00145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc05a1c700 1 --2- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc000bccd0 0x7efc00145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc05a1c700 1 -- 172.21.15.1:0/1505527905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf8009a20 con 0x7efc000c70c0 2023-11-15T01:36:39.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.580+0000 7efc05a1c700 1 --2- 172.21.15.1:0/1505527905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc000c70c0 0x7efc00152e80 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7efbf000c4a0 tx=0x7efbf0007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:39.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.581+0000 7efbf67fc700 1 -- 172.21.15.1:0/1505527905 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf000ce50 con 0x7efc000c70c0 2023-11-15T01:36:39.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.581+0000 7efbf67fc700 1 -- 172.21.15.1:0/1505527905 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf00072e0 con 0x7efc000c70c0 2023-11-15T01:36:39.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.581+0000 7efc08481700 1 -- 172.21.15.1:0/1505527905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc000bf860 con 0x7efc000c70c0 2023-11-15T01:36:39.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.581+0000 7efbf67fc700 1 -- 172.21.15.1:0/1505527905 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0007660 con 0x7efc000c70c0 2023-11-15T01:36:39.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.581+0000 7efc08481700 1 -- 172.21.15.1:0/1505527905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc000bee10 con 0x7efc000c70c0 2023-11-15T01:36:39.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.582+0000 7efc08481700 1 -- 172.21.15.1:0/1505527905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0006c7e0 con 0x7efc000c70c0 2023-11-15T01:36:39.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.582+0000 7efbf67fc700 1 -- 172.21.15.1:0/1505527905 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7efbf00059b0 con 0x7efc000c70c0 2023-11-15T01:36:39.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.582+0000 7efbf67fc700 1 --2- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efbe405f300 0x7efbe40617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.582+0000 7efbf67fc700 1 -- 172.21.15.1:0/1505527905 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6803+0+0 (secure 0 0 0) 0x7efbf0079d40 con 0x7efc000c70c0 2023-11-15T01:36:39.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.582+0000 7efc0621d700 1 -- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efbe405f300 msgr2=0x7efbe40617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:39.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.582+0000 7efc0621d700 1 --2- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efbe405f300 0x7efbe40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:39.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.586+0000 7efbf67fc700 1 -- 172.21.15.1:0/1505527905 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efbf004ab60 con 0x7efc000c70c0 2023-11-15T01:36:39.627 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:39.625+0000 7f427ac4d680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:36:39.641 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:39.640+0000 7f79780df680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:36:39.697 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:39.695+0000 7f427ac4d680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:36:39.721 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:39.720+0000 7f79780df680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:36:39.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.783+0000 7efc0621d700 1 -- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efbe405f300 msgr2=0x7efbe40617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:39.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.783+0000 7efc0621d700 1 --2- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efbe405f300 0x7efbe40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:36:39.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.803+0000 7efc08481700 1 -- 172.21.15.1:0/1505527905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc000c2d10 con 0x7efc000c70c0 2023-11-15T01:36:39.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.803+0000 7efbf67fc700 1 -- 172.21.15.1:0/1505527905 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4487 (secure 0 0 0) 0x7efbf004e180 con 0x7efc000c70c0 2023-11-15T01:36:39.805 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:39.805 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/246517652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":246517652},{"type":"v1","addr":"172.21.15.141:6836","nonce":246517652}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5857,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3341576602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3341576602},{"type":"v1","addr":"172.21.15.141:6837","nonce":3341576602}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2509339424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2509339424},{"type":"v1","addr":"172.21.15.1:6834","nonce":2509339424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:36:21.564233+0000","modified":"2023-11-15T01:36:24.818307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3051659352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3051659352},{"type":"v1","addr":"172.21.15.1:6835","nonce":3051659352}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-11-15T01:36:39.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.805+0000 7efc08481700 1 -- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efbe405f300 msgr2=0x7efbe40617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:39.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.805+0000 7efc08481700 1 --2- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efbe405f300 0x7efbe40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:39.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.805+0000 7efc08481700 1 -- 172.21.15.1:0/1505527905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc000c70c0 msgr2=0x7efc00152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.805+0000 7efc08481700 1 --2- 172.21.15.1:0/1505527905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc000c70c0 0x7efc00152e80 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7efbf000c4a0 tx=0x7efbf0007c30).stop 2023-11-15T01:36:39.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.805+0000 7efc08481700 1 -- 172.21.15.1:0/1505527905 shutdown_connections 2023-11-15T01:36:39.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.805+0000 7efc08481700 1 --2- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efbe405f300 0x7efbe40617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:39.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.805+0000 7efc08481700 1 --2- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc00154680 0x7efc000a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.805+0000 7efc08481700 1 --2- 172.21.15.1:0/1505527905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc000bccd0 0x7efc00145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.805+0000 7efc08481700 1 --2- 172.21.15.1:0/1505527905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc000c70c0 0x7efc00152e80 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.805+0000 7efc08481700 1 -- 172.21.15.1:0/1505527905 >> 172.21.15.1:0/1505527905 conn(0x7efc000c7d70 msgr2=0x7efc001538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:39.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.805+0000 7efc08481700 1 -- 172.21.15.1:0/1505527905 shutdown_connections 2023-11-15T01:36:39.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.805+0000 7efc08481700 1 -- 172.21.15.1:0/1505527905 wait complete. 2023-11-15T01:36:39.809 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 31 2023-11-15T01:36:39.811 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:39.809+0000 7f427ac4d680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:36:39.819 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:36:39.877 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:39.876+0000 7f79780df680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:36:39.918 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:39.916+0000 7f427ac4d680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:36:39.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.937+0000 7fa145b7a700 1 Processor -- start 2023-11-15T01:36:39.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.938+0000 7fa145b7a700 1 -- start start 2023-11-15T01:36:39.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.938+0000 7fa145b7a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1400ab1a0 0x7fa140154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.938+0000 7fa145b7a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1400c06f0 con 0x7fa1400aa060 2023-11-15T01:36:39.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.938+0000 7fa145b7a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1400c09d0 con 0x7fa140154150 2023-11-15T01:36:39.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.938+0000 7fa145b7a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa140158820 con 0x7fa1400ab1a0 2023-11-15T01:36:39.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.938+0000 7fa13ffff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa1400aa060 0x7fa1400c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41576/0 (socket says 172.21.15.1:41576) 2023-11-15T01:36:39.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.939+0000 7fa13ffff700 1 -- 172.21.15.1:0/151735485 learned_addr learned my addr 172.21.15.1:0/151735485 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:39.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.939+0000 7fa13effd700 1 --2- 172.21.15.1:0/151735485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1400ab1a0 0x7fa140154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:39.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.939+0000 7fa13e7fc700 1 -- 172.21.15.1:0/151735485 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397757045 0 0) 0x7fa1400c06f0 con 0x7fa1400aa060 2023-11-15T01:36:39.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.939+0000 7fa13e7fc700 1 -- 172.21.15.1:0/151735485 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1280033f0 con 0x7fa1400aa060 2023-11-15T01:36:39.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.939+0000 7fa13e7fc700 1 -- 172.21.15.1:0/151735485 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763351457 0 0) 0x7fa1400c09d0 con 0x7fa140154150 2023-11-15T01:36:39.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.939+0000 7fa13e7fc700 1 -- 172.21.15.1:0/151735485 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1400c06f0 con 0x7fa140154150 2023-11-15T01:36:39.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.939+0000 7fa13effd700 1 -- 172.21.15.1:0/151735485 >> v1:172.21.15.141:6789/0 conn(0x7fa140154150 legacy=0x7fa140158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.939+0000 7fa13effd700 1 -- 172.21.15.1:0/151735485 >> v1:172.21.15.1:6789/0 conn(0x7fa1400aa060 legacy=0x7fa1400c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.939+0000 7fa13effd700 1 -- 172.21.15.1:0/151735485 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140158b00 con 0x7fa1400ab1a0 2023-11-15T01:36:39.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.939+0000 7fa13effd700 1 --2- 172.21.15.1:0/151735485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1400ab1a0 0x7fa140154530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fa134009790 tx=0x7fa134009060).ready entity=mon.2 client_cookie=d09d4897c9a02a6a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:39.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.939+0000 7fa13e7fc700 1 -- 172.21.15.1:0/151735485 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1340090d0 con 0x7fa1400ab1a0 2023-11-15T01:36:39.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.939+0000 7fa13e7fc700 1 -- 172.21.15.1:0/151735485 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13400f510 con 0x7fa1400ab1a0 2023-11-15T01:36:39.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.939+0000 7fa13e7fc700 1 -- 172.21.15.1:0/151735485 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13400f890 con 0x7fa1400ab1a0 2023-11-15T01:36:39.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.940+0000 7fa145b7a700 1 -- 172.21.15.1:0/151735485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1400ab1a0 msgr2=0x7fa140154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.940+0000 7fa145b7a700 1 --2- 172.21.15.1:0/151735485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1400ab1a0 0x7fa140154530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fa134009790 tx=0x7fa134009060).stop 2023-11-15T01:36:39.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.940+0000 7fa145b7a700 1 -- 172.21.15.1:0/151735485 shutdown_connections 2023-11-15T01:36:39.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.940+0000 7fa145b7a700 1 --2- 172.21.15.1:0/151735485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1400ab1a0 0x7fa140154530 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.940+0000 7fa145b7a700 1 -- 172.21.15.1:0/151735485 >> 172.21.15.1:0/151735485 conn(0x7fa140064aa0 msgr2=0x7fa140064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:39.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.940+0000 7fa145b7a700 1 -- 172.21.15.1:0/151735485 shutdown_connections 2023-11-15T01:36:39.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.940+0000 7fa145b7a700 1 -- 172.21.15.1:0/151735485 wait complete. 2023-11-15T01:36:39.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.941+0000 7fa145b7a700 1 Processor -- start 2023-11-15T01:36:39.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.941+0000 7fa145b7a700 1 -- start start 2023-11-15T01:36:39.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa145b7a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1400aa060 0x7fa140165500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa145b7a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1400ab1a0 0x7fa1401574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa145b7a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa140154150 0x7fa140150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa145b7a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa140157200 con 0x7fa1400ab1a0 2023-11-15T01:36:39.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa145b7a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1400ae030 con 0x7fa140154150 2023-11-15T01:36:39.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa145b7a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa140157990 con 0x7fa1400aa060 2023-11-15T01:36:39.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa13effd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1400ab1a0 0x7fa1401574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:39.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa13effd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1400ab1a0 0x7fa1401574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35334/0 (socket says 172.21.15.1:35334) 2023-11-15T01:36:39.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa13effd700 1 -- 172.21.15.1:0/2146021842 learned_addr learned my addr 172.21.15.1:0/2146021842 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:39.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa13f7fe700 1 --2- 172.21.15.1:0/2146021842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1400aa060 0x7fa140165500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:39.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa13ffff700 1 --2- 172.21.15.1:0/2146021842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa140154150 0x7fa140150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:39.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa13effd700 1 -- 172.21.15.1:0/2146021842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1400aa060 msgr2=0x7fa140165500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa13effd700 1 --2- 172.21.15.1:0/2146021842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1400aa060 0x7fa140165500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa13effd700 1 -- 172.21.15.1:0/2146021842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa140154150 msgr2=0x7fa140150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:39.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa13effd700 1 --2- 172.21.15.1:0/2146021842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa140154150 0x7fa140150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:39.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.942+0000 7fa13effd700 1 -- 172.21.15.1:0/2146021842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1340092a0 con 0x7fa1400ab1a0 2023-11-15T01:36:39.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.943+0000 7fa13effd700 1 --2- 172.21.15.1:0/2146021842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1400ab1a0 0x7fa1401574a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fa140062af0 tx=0x7fa134017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:39.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.943+0000 7fa1277fe700 1 -- 172.21.15.1:0/2146021842 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13400f890 con 0x7fa1400ab1a0 2023-11-15T01:36:39.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.943+0000 7fa1277fe700 1 -- 172.21.15.1:0/2146021842 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13400fc50 con 0x7fa1400ab1a0 2023-11-15T01:36:39.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.943+0000 7fa145b7a700 1 -- 172.21.15.1:0/2146021842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1401648a0 con 0x7fa1400ab1a0 2023-11-15T01:36:39.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.943+0000 7fa1277fe700 1 -- 172.21.15.1:0/2146021842 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13401b410 con 0x7fa1400ab1a0 2023-11-15T01:36:39.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.943+0000 7fa145b7a700 1 -- 172.21.15.1:0/2146021842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa140164e60 con 0x7fa1400ab1a0 2023-11-15T01:36:39.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.944+0000 7fa145b7a700 1 -- 172.21.15.1:0/2146021842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14006c7e0 con 0x7fa1400ab1a0 2023-11-15T01:36:39.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.944+0000 7fa1277fe700 1 -- 172.21.15.1:0/2146021842 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fa13401b780 con 0x7fa1400ab1a0 2023-11-15T01:36:39.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.944+0000 7fa1277fe700 1 --2- 172.21.15.1:0/2146021842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa12c05f300 0x7fa12c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:39.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.944+0000 7fa1277fe700 1 -- 172.21.15.1:0/2146021842 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fa13407bf60 con 0x7fa1400ab1a0 2023-11-15T01:36:39.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.944+0000 7fa13f7fe700 1 -- 172.21.15.1:0/2146021842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa12c05f300 msgr2=0x7fa12c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:39.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.944+0000 7fa13f7fe700 1 --2- 172.21.15.1:0/2146021842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa12c05f300 0x7fa12c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:39.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:39.948+0000 7fa1277fe700 1 -- 172.21.15.1:0/2146021842 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa1340aaaf0 con 0x7fa1400ab1a0 2023-11-15T01:36:39.954 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:39.952+0000 7f79780df680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:36:40.078 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:40.077+0000 7f79780df680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:36:40.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.126+0000 7fa145b7a700 1 -- 172.21.15.1:0/2146021842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa140158de0 con 0x7fa1400ab1a0 2023-11-15T01:36:40.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.127+0000 7fa1277fe700 1 -- 172.21.15.1:0/2146021842 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+17898 (secure 0 0 0) 0x7fa13404cd80 con 0x7fa1400ab1a0 2023-11-15T01:36:40.129 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:40.129 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:36:34.049350+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:36:19.249413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-15T01:36:20.544874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/2815631318":"2023-11-16T01:36:34.049309+0000","172.21.15.141:0/3992492485":"2023-11-16T01:36:34.049309+0000","172.21.15.141:6833/90546":"2023-11-16T01:36:34.049309+0000","172.21.15.141:6832/90546":"2023-11-16T01:36:34.049309+0000","172.21.15.141:0/619934892":"2023-11-16T01:36:34.049309+0000","172.21.15.141:0/3354476443":"2023-11-16T01:36:34.049309+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:36:40.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.129+0000 7fa145b7a700 1 -- 172.21.15.1:0/2146021842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa12c05f300 msgr2=0x7fa12c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:40.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.129+0000 7fa145b7a700 1 --2- 172.21.15.1:0/2146021842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa12c05f300 0x7fa12c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:40.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.129+0000 7fa145b7a700 1 -- 172.21.15.1:0/2146021842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1400ab1a0 msgr2=0x7fa1401574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:40.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.129+0000 7fa145b7a700 1 --2- 172.21.15.1:0/2146021842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1400ab1a0 0x7fa1401574a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fa140062af0 tx=0x7fa134017000).stop 2023-11-15T01:36:40.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.129+0000 7fa145b7a700 1 -- 172.21.15.1:0/2146021842 shutdown_connections 2023-11-15T01:36:40.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.129+0000 7fa145b7a700 1 --2- 172.21.15.1:0/2146021842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa12c05f300 0x7fa12c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:40.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.129+0000 7fa145b7a700 1 --2- 172.21.15.1:0/2146021842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa140154150 0x7fa140150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:40.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.129+0000 7fa145b7a700 1 --2- 172.21.15.1:0/2146021842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1400aa060 0x7fa140165500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:40.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.129+0000 7fa145b7a700 1 --2- 172.21.15.1:0/2146021842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1400ab1a0 0x7fa1401574a0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:40.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.129+0000 7fa145b7a700 1 -- 172.21.15.1:0/2146021842 >> 172.21.15.1:0/2146021842 conn(0x7fa140064aa0 msgr2=0x7fa1400ad5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:40.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.130+0000 7fa145b7a700 1 -- 172.21.15.1:0/2146021842 shutdown_connections 2023-11-15T01:36:40.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.130+0000 7fa145b7a700 1 -- 172.21.15.1:0/2146021842 wait complete. 2023-11-15T01:36:40.145 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-15T01:36:40.197 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:40.195+0000 7f79780df680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:36:40.209 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:40.208+0000 7f427ac4d680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:36:40.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.265+0000 7f0d9404e700 1 Processor -- start 2023-11-15T01:36:40.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.266+0000 7f0d9404e700 1 -- start start 2023-11-15T01:36:40.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.267+0000 7f0d9404e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0d8c0a8230 0x7f0d8c0c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:40.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.267+0000 7f0d9404e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0d8c0c39c0 0x7f0d8c0bf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:40.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.267+0000 7f0d9404e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8c0835e0 con 0x7f0d8c0bf500 2023-11-15T01:36:40.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.267+0000 7f0d9404e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8c0beb80 con 0x7f0d8c0a8230 2023-11-15T01:36:40.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.267+0000 7f0d9404e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8c0bdfb0 con 0x7f0d8c0c39c0 2023-11-15T01:36:40.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.267+0000 7f0d91dea700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0d8c0a8230 0x7f0d8c0c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:40.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.267+0000 7f0d91dea700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0d8c0a8230 0x7f0d8c0c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35346/0 (socket says 172.21.15.1:35346) 2023-11-15T01:36:40.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.267+0000 7f0d91dea700 1 -- 172.21.15.1:0/2463401217 learned_addr learned my addr 172.21.15.1:0/2463401217 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:40.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.267+0000 7f0d915e9700 1 --2- 172.21.15.1:0/2463401217 >> v2:172.21.15.141:3300/0 conn(0x7f0d8c0c39c0 0x7f0d8c0bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:40.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.267+0000 7f0d91dea700 1 -- 172.21.15.1:0/2463401217 >> v2:172.21.15.141:3300/0 conn(0x7f0d8c0c39c0 msgr2=0x7f0d8c0bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:40.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.267+0000 7f0d91dea700 1 --2- 172.21.15.1:0/2463401217 >> v2:172.21.15.141:3300/0 conn(0x7f0d8c0c39c0 0x7f0d8c0bf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:40.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.267+0000 7f0d91dea700 1 -- 172.21.15.1:0/2463401217 >> v1:172.21.15.141:6789/0 conn(0x7f0d8c0bf500 legacy=0x7f0d8c0638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:40.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.267+0000 7f0d91dea700 1 -- 172.21.15.1:0/2463401217 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c0be250 con 0x7f0d8c0a8230 2023-11-15T01:36:40.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.267+0000 7f0d915e9700 1 --2- 172.21.15.1:0/2463401217 >> v2:172.21.15.141:3300/0 conn(0x7f0d8c0c39c0 0x7f0d8c0bf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:40.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.267+0000 7f0d91dea700 1 --2- 172.21.15.1:0/2463401217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d8c0a8230 0x7f0d8c0c34d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f0d8c068d10 tx=0x7f0d800090f0).ready entity=mon.0 client_cookie=cad75202d1385cc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:40.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.268+0000 7f0d90de8700 1 -- 172.21.15.1:0/2463401217 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8000b600 con 0x7f0d8c0a8230 2023-11-15T01:36:40.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.268+0000 7f0d90de8700 1 -- 172.21.15.1:0/2463401217 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8000b760 con 0x7f0d8c0a8230 2023-11-15T01:36:40.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.268+0000 7f0d90de8700 1 -- 172.21.15.1:0/2463401217 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8000bae0 con 0x7f0d8c0a8230 2023-11-15T01:36:40.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.268+0000 7f0d9404e700 1 -- 172.21.15.1:0/2463401217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d8c0a8230 msgr2=0x7f0d8c0c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:40.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.268+0000 7f0d9404e700 1 --2- 172.21.15.1:0/2463401217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d8c0a8230 0x7f0d8c0c34d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f0d8c068d10 tx=0x7f0d800090f0).stop 2023-11-15T01:36:40.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.268+0000 7f0d9404e700 1 -- 172.21.15.1:0/2463401217 shutdown_connections 2023-11-15T01:36:40.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.268+0000 7f0d9404e700 1 --2- 172.21.15.1:0/2463401217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d8c0a8230 0x7f0d8c0c34d0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:40.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.268+0000 7f0d9404e700 1 --2- 172.21.15.1:0/2463401217 >> v2:172.21.15.141:3300/0 conn(0x7f0d8c0c39c0 0x7f0d8c0bf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:40.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.268+0000 7f0d9404e700 1 -- 172.21.15.1:0/2463401217 >> 172.21.15.1:0/2463401217 conn(0x7f0d8c082f90 msgr2=0x7f0d8c0c8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:40.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.268+0000 7f0d9404e700 1 -- 172.21.15.1:0/2463401217 shutdown_connections 2023-11-15T01:36:40.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.268+0000 7f0d9404e700 1 -- 172.21.15.1:0/2463401217 wait complete. 2023-11-15T01:36:40.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.270+0000 7f0d9404e700 1 Processor -- start 2023-11-15T01:36:40.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.270+0000 7f0d9404e700 1 -- start start 2023-11-15T01:36:40.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.270+0000 7f0d9404e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d8c0a8230 0x7f0d8c152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:40.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.270+0000 7f0d9404e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d8c0bf500 0x7f0d8c156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:40.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.270+0000 7f0d9404e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d8c0c39c0 0x7f0d8c154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:40.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.270+0000 7f0d9404e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c157ae0 con 0x7f0d8c0c39c0 2023-11-15T01:36:40.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.270+0000 7f0d9404e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0ac600 con 0x7f0d8c0a8230 2023-11-15T01:36:40.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.270+0000 7f0d9404e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c157800 con 0x7f0d8c0bf500 2023-11-15T01:36:40.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d925eb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d8c0c39c0 0x7f0d8c154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:40.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d91dea700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d8c0a8230 0x7f0d8c152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:40.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d915e9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d8c0bf500 0x7f0d8c156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:40.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d925eb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d8c0c39c0 0x7f0d8c154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35360/0 (socket says 172.21.15.1:35360) 2023-11-15T01:36:40.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d925eb700 1 -- 172.21.15.1:0/3770361361 learned_addr learned my addr 172.21.15.1:0/3770361361 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:40.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d925eb700 1 -- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d8c0bf500 msgr2=0x7f0d8c156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:40.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d925eb700 1 --2- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d8c0bf500 0x7f0d8c156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:40.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d925eb700 1 -- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d8c0a8230 msgr2=0x7f0d8c152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:40.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d925eb700 1 --2- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d8c0a8230 0x7f0d8c152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:40.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d925eb700 1 -- 172.21.15.1:0/3770361361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d80009370 con 0x7f0d8c0c39c0 2023-11-15T01:36:40.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d925eb700 1 --2- 172.21.15.1:0/3770361361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d8c0c39c0 0x7f0d8c154d80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f0d8400c790 tx=0x7f0d840015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:40.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d7dffb700 1 -- 172.21.15.1:0/3770361361 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8400e4a0 con 0x7f0d8c0c39c0 2023-11-15T01:36:40.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d7dffb700 1 -- 172.21.15.1:0/3770361361 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8400e600 con 0x7f0d8c0c39c0 2023-11-15T01:36:40.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d7dffb700 1 -- 172.21.15.1:0/3770361361 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8400e980 con 0x7f0d8c0c39c0 2023-11-15T01:36:40.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d9404e700 1 -- 172.21.15.1:0/3770361361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8c0abfb0 con 0x7f0d8c0c39c0 2023-11-15T01:36:40.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.271+0000 7f0d9404e700 1 -- 172.21.15.1:0/3770361361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8c1534b0 con 0x7f0d8c0c39c0 2023-11-15T01:36:40.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.272+0000 7f0d9404e700 1 -- 172.21.15.1:0/3770361361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8c0ac790 con 0x7f0d8c0c39c0 2023-11-15T01:36:40.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.273+0000 7f0d7dffb700 1 -- 172.21.15.1:0/3770361361 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 29) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f0d8401b3b0 con 0x7f0d8c0c39c0 2023-11-15T01:36:40.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.273+0000 7f0d7dffb700 1 --2- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d7005f2d0 0x7f0d70061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:40.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.273+0000 7f0d7dffb700 1 -- 172.21.15.1:0/3770361361 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f0d84079d30 con 0x7f0d8c0c39c0 2023-11-15T01:36:40.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.273+0000 7f0d91dea700 1 -- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d7005f2d0 msgr2=0x7f0d70061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:36:40.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.273+0000 7f0d91dea700 1 --2- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d7005f2d0 0x7f0d70061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:36:40.283 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:40.279+0000 7f427ac4d680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:36:40.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.278+0000 7f0d7dffb700 1 -- 172.21.15.1:0/3770361361 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0d84048af0 con 0x7f0d8c0c39c0 2023-11-15T01:36:40.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.300+0000 7f0d7dffb700 1 -- 172.21.15.1:0/3770361361 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 30) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f0d84077650 con 0x7f0d8c0c39c0 2023-11-15T01:36:40.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.300+0000 7f0d7dffb700 1 -- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d7005f2d0 msgr2=0x7f0d70061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:36:40.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.300+0000 7f0d7dffb700 1 --2- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d7005f2d0 0x7f0d70061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:40.359 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:40.356+0000 7f41f7be3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:40.359 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:40.356+0000 7f41f7be3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:40.359 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:40.356+0000 7f41f7be3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:40.359 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:40.356+0000 7f41f7be3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:40.359 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:40.356+0000 7f41f7be3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:40.360 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:40.357+0000 7f41f43dc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:40.360 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:40.357+0000 7f41f43dc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:40.360 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:40.357+0000 7f41f43dc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:40.360 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:40.357+0000 7f41f43dc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:40.360 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:36:40.357+0000 7f41f43dc700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:36:40.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:40.503+0000 7f0d9404e700 1 -- 172.21.15.1:0/3770361361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0d8c096d00 con 0x7f0d8c0c39c0 2023-11-15T01:36:40.507 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:40.506+0000 7f79780df680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:36:40.583 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:36:40.582+0000 7f79780df680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:36:41.075 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-11-15T01:36:41.074+0000 7f2dd123c700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-11-15T01:36:41.076 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-11-15T01:36:41.074+0000 7f2dd123c700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-11-15T01:36:41.076 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-11-15T01:36:41.074+0000 7f2dd123c700 -1 MDSIOContextBase: failed with -108, restarting... 2023-11-15T01:36:41.079 INFO:tasks.ceph.mds.a.smithi001.stderr: -2594> 2023-11-15T01:36:26.480+0000 7f2dd4a43700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T01:36:41.083 INFO:tasks.ceph.mds.a.smithi001.stderr: -4> 2023-11-15T01:36:41.074+0000 7f2dd123c700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-11-15T01:36:41.083 INFO:tasks.ceph.mds.a.smithi001.stderr: -3> 2023-11-15T01:36:41.074+0000 7f2dd123c700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-11-15T01:36:41.083 INFO:tasks.ceph.mds.a.smithi001.stderr: -1> 2023-11-15T01:36:41.074+0000 7f2dd123c700 -1 MDSIOContextBase: failed with -108, restarting... 2023-11-15T01:36:41.103 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T01:36:41.298 INFO:tasks.ceph.mon.a.smithi001.stderr:2023-11-15T01:36:41.297+0000 7f8072214700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-15T01:36:41.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.302+0000 7f0d7dffb700 1 -- 172.21.15.1:0/3770361361 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 31) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f0d8400ed70 con 0x7f0d8c0c39c0 2023-11-15T01:36:41.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.303+0000 7f0d7dffb700 1 --2- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d7005f2d0 0x7f0d70061710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:41.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.304+0000 7f0d91dea700 1 --2- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d7005f2d0 0x7f0d70061710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:41.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.307+0000 7f0d91dea700 1 --2- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d7005f2d0 0x7f0d70061710 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f0d8000b3c0 tx=0x7f0d80017000).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:41.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.309+0000 7f0d7dffb700 1 -- 172.21.15.1:0/3770361361 <== mon.0 v2:172.21.15.1:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0d8404bbb0 con 0x7f0d8c0c39c0 2023-11-15T01:36:41.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.311+0000 7f0d9404e700 1 -- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d7005f2d0 msgr2=0x7f0d70061710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:41.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.311+0000 7f0d9404e700 1 --2- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d7005f2d0 0x7f0d70061710 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f0d8000b3c0 tx=0x7f0d80017000).stop 2023-11-15T01:36:41.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.311+0000 7f0d9404e700 1 -- 172.21.15.1:0/3770361361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d8c0c39c0 msgr2=0x7f0d8c154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:41.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.311+0000 7f0d9404e700 1 --2- 172.21.15.1:0/3770361361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d8c0c39c0 0x7f0d8c154d80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f0d8400c790 tx=0x7f0d840015e0).stop 2023-11-15T01:36:41.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.311+0000 7f0d9404e700 1 -- 172.21.15.1:0/3770361361 shutdown_connections 2023-11-15T01:36:41.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.312+0000 7f0d9404e700 1 --2- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d7005f2d0 0x7f0d70061710 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:41.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.312+0000 7f0d9404e700 1 --2- 172.21.15.1:0/3770361361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d8c0c39c0 0x7f0d8c154d80 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:41.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.312+0000 7f0d9404e700 1 --2- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d8c0a8230 0x7f0d8c152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:41.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.312+0000 7f0d9404e700 1 --2- 172.21.15.1:0/3770361361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d8c0bf500 0x7f0d8c156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:41.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.312+0000 7f0d9404e700 1 -- 172.21.15.1:0/3770361361 >> 172.21.15.1:0/3770361361 conn(0x7f0d8c082f90 msgr2=0x7f0d8c0c8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:41.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.312+0000 7f0d9404e700 1 -- 172.21.15.1:0/3770361361 shutdown_connections 2023-11-15T01:36:41.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.312+0000 7f0d9404e700 1 -- 172.21.15.1:0/3770361361 wait complete. 2023-11-15T01:36:41.316 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-15T01:36:41.326 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-15T01:36:41.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.447+0000 7f9f5d749700 1 Processor -- start 2023-11-15T01:36:41.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.447+0000 7f9f5d749700 1 -- start start 2023-11-15T01:36:41.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.447+0000 7f9f5d749700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9f581540a0 0x7f9f580ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:41.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.447+0000 7f9f5d749700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f580ca050 con 0x7f9f580c6650 2023-11-15T01:36:41.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.447+0000 7f9f5d749700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f580c9440 con 0x7f9f58154480 2023-11-15T01:36:41.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.447+0000 7f9f5d749700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f580c9720 con 0x7f9f581540a0 2023-11-15T01:36:41.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.448+0000 7f9f577fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9f580c6650 0x7f9f580aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41582/0 (socket says 172.21.15.1:41582) 2023-11-15T01:36:41.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.448+0000 7f9f577fe700 1 -- 172.21.15.1:0/3251991525 learned_addr learned my addr 172.21.15.1:0/3251991525 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:41.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.448+0000 7f9f56ffd700 1 --2- 172.21.15.1:0/3251991525 >> v2:172.21.15.141:3300/0 conn(0x7f9f581540a0 0x7f9f580ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:41.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.448+0000 7f9f55ffb700 1 -- 172.21.15.1:0/3251991525 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934218732 0 0) 0x7f9f580ca050 con 0x7f9f580c6650 2023-11-15T01:36:41.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.448+0000 7f9f55ffb700 1 -- 172.21.15.1:0/3251991525 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f440033f0 con 0x7f9f580c6650 2023-11-15T01:36:41.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.448+0000 7f9f56ffd700 1 -- 172.21.15.1:0/3251991525 >> v1:172.21.15.141:6789/0 conn(0x7f9f58154480 legacy=0x7f9f580c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:41.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.448+0000 7f9f56ffd700 1 -- 172.21.15.1:0/3251991525 >> v1:172.21.15.1:6789/0 conn(0x7f9f580c6650 legacy=0x7f9f580aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:41.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.448+0000 7f9f56ffd700 1 -- 172.21.15.1:0/3251991525 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f580c9a00 con 0x7f9f581540a0 2023-11-15T01:36:41.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.448+0000 7f9f56ffd700 1 --2- 172.21.15.1:0/3251991525 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f581540a0 0x7f9f580ca4e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f9f50009760 tx=0x7f9f50009060).ready entity=mon.1 client_cookie=e136fa33bbf06689 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:41.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.448+0000 7f9f55ffb700 1 -- 172.21.15.1:0/3251991525 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5000f510 con 0x7f9f581540a0 2023-11-15T01:36:41.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.448+0000 7f9f55ffb700 1 -- 172.21.15.1:0/3251991525 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5000f670 con 0x7f9f581540a0 2023-11-15T01:36:41.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.448+0000 7f9f55ffb700 1 -- 172.21.15.1:0/3251991525 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5000f9f0 con 0x7f9f581540a0 2023-11-15T01:36:41.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.449+0000 7f9f5d749700 1 -- 172.21.15.1:0/3251991525 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f581540a0 msgr2=0x7f9f580ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:41.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.449+0000 7f9f5d749700 1 --2- 172.21.15.1:0/3251991525 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f581540a0 0x7f9f580ca4e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f9f50009760 tx=0x7f9f50009060).stop 2023-11-15T01:36:41.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.449+0000 7f9f5d749700 1 -- 172.21.15.1:0/3251991525 shutdown_connections 2023-11-15T01:36:41.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.449+0000 7f9f5d749700 1 --2- 172.21.15.1:0/3251991525 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f581540a0 0x7f9f580ca4e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:41.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.449+0000 7f9f5d749700 1 -- 172.21.15.1:0/3251991525 >> 172.21.15.1:0/3251991525 conn(0x7f9f58064a70 msgr2=0x7f9f58064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:41.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.449+0000 7f9f5d749700 1 -- 172.21.15.1:0/3251991525 shutdown_connections 2023-11-15T01:36:41.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.449+0000 7f9f5d749700 1 -- 172.21.15.1:0/3251991525 wait complete. 2023-11-15T01:36:41.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.450+0000 7f9f5d749700 1 Processor -- start 2023-11-15T01:36:41.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.450+0000 7f9f5d749700 1 -- start start 2023-11-15T01:36:41.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.451+0000 7f9f5d749700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f580c6650 0x7f9f581457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:41.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.451+0000 7f9f5d749700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f581540a0 0x7f9f58142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:41.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.451+0000 7f9f5d749700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f58154480 0x7f9f581439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:41.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.451+0000 7f9f5d749700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f58145340 con 0x7f9f581540a0 2023-11-15T01:36:41.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.451+0000 7f9f5d749700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f58144730 con 0x7f9f58154480 2023-11-15T01:36:41.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.451+0000 7f9f5d749700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f58144a10 con 0x7f9f580c6650 2023-11-15T01:36:41.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.451+0000 7f9f567fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f581540a0 0x7f9f58142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:41.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.451+0000 7f9f567fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f581540a0 0x7f9f58142450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35398/0 (socket says 172.21.15.1:35398) 2023-11-15T01:36:41.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.451+0000 7f9f567fc700 1 -- 172.21.15.1:0/3102400795 learned_addr learned my addr 172.21.15.1:0/3102400795 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:41.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.451+0000 7f9f56ffd700 1 --2- 172.21.15.1:0/3102400795 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f580c6650 0x7f9f581457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:41.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.451+0000 7f9f577fe700 1 --2- 172.21.15.1:0/3102400795 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f58154480 0x7f9f581439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:41.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.452+0000 7f9f567fc700 1 -- 172.21.15.1:0/3102400795 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f580c6650 msgr2=0x7f9f581457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:41.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.452+0000 7f9f567fc700 1 --2- 172.21.15.1:0/3102400795 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f580c6650 0x7f9f581457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:41.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.452+0000 7f9f567fc700 1 -- 172.21.15.1:0/3102400795 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f58154480 msgr2=0x7f9f581439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:41.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.452+0000 7f9f567fc700 1 --2- 172.21.15.1:0/3102400795 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f58154480 0x7f9f581439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:41.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.452+0000 7f9f567fc700 1 -- 172.21.15.1:0/3102400795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f500092a0 con 0x7f9f581540a0 2023-11-15T01:36:41.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.452+0000 7f9f567fc700 1 --2- 172.21.15.1:0/3102400795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f581540a0 0x7f9f58142450 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f9f4000c440 tx=0x7f9f40007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:41.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.452+0000 7f9f4effd700 1 -- 172.21.15.1:0/3102400795 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40007020 con 0x7f9f581540a0 2023-11-15T01:36:41.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.452+0000 7f9f4effd700 1 -- 172.21.15.1:0/3102400795 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f40007180 con 0x7f9f581540a0 2023-11-15T01:36:41.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.452+0000 7f9f5d749700 1 -- 172.21.15.1:0/3102400795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f58144cf0 con 0x7f9f581540a0 2023-11-15T01:36:41.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.452+0000 7f9f4effd700 1 -- 172.21.15.1:0/3102400795 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40007520 con 0x7f9f581540a0 2023-11-15T01:36:41.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.452+0000 7f9f5d749700 1 -- 172.21.15.1:0/3102400795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f58145cc0 con 0x7f9f581540a0 2023-11-15T01:36:41.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.453+0000 7f9f5d749700 1 -- 172.21.15.1:0/3102400795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5806c7e0 con 0x7f9f581540a0 2023-11-15T01:36:41.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.453+0000 7f9f4effd700 1 -- 172.21.15.1:0/3102400795 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 31) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f9f400068b0 con 0x7f9f581540a0 2023-11-15T01:36:41.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.454+0000 7f9f4effd700 1 --2- 172.21.15.1:0/3102400795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9f3805f030 0x7f9f380614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:41.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.454+0000 7f9f4effd700 1 -- 172.21.15.1:0/3102400795 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7104+0+0 (secure 0 0 0) 0x7f9f40079610 con 0x7f9f581540a0 2023-11-15T01:36:41.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.454+0000 7f9f56ffd700 1 --2- 172.21.15.1:0/3102400795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9f3805f030 0x7f9f380614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:41.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.454+0000 7f9f56ffd700 1 --2- 172.21.15.1:0/3102400795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9f3805f030 0x7f9f380614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9f50009760 tx=0x7f9f50017000).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:41.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.458+0000 7f9f4effd700 1 -- 172.21.15.1:0/3102400795 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9f40047af0 con 0x7f9f581540a0 2023-11-15T01:36:41.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:41.675+0000 7f9f5d749700 1 -- 172.21.15.1:0/3102400795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9f58145480 con 0x7f9f581540a0 2023-11-15T01:36:42.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.509+0000 7f9f4effd700 1 -- 172.21.15.1:0/3102400795 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9f4004a6e0 con 0x7f9f581540a0 2023-11-15T01:36:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.512+0000 7f9f5d749700 1 -- 172.21.15.1:0/3102400795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9f3805f030 msgr2=0x7f9f380614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.512+0000 7f9f5d749700 1 --2- 172.21.15.1:0/3102400795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9f3805f030 0x7f9f380614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9f50009760 tx=0x7f9f50017000).stop 2023-11-15T01:36:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.512+0000 7f9f5d749700 1 -- 172.21.15.1:0/3102400795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f581540a0 msgr2=0x7f9f58142450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.512+0000 7f9f5d749700 1 --2- 172.21.15.1:0/3102400795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f581540a0 0x7f9f58142450 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f9f4000c440 tx=0x7f9f40007e00).stop 2023-11-15T01:36:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.512+0000 7f9f5d749700 1 -- 172.21.15.1:0/3102400795 shutdown_connections 2023-11-15T01:36:42.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.512+0000 7f9f5d749700 1 --2- 172.21.15.1:0/3102400795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9f3805f030 0x7f9f380614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:42.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.512+0000 7f9f5d749700 1 --2- 172.21.15.1:0/3102400795 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9f58154480 0x7f9f581439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:42.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.512+0000 7f9f5d749700 1 --2- 172.21.15.1:0/3102400795 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9f580c6650 0x7f9f581457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:42.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.512+0000 7f9f5d749700 1 --2- 172.21.15.1:0/3102400795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f581540a0 0x7f9f58142450 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:42.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.512+0000 7f9f5d749700 1 -- 172.21.15.1:0/3102400795 >> 172.21.15.1:0/3102400795 conn(0x7f9f58064a70 msgr2=0x7f9f580ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:42.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.512+0000 7f9f5d749700 1 -- 172.21.15.1:0/3102400795 shutdown_connections 2023-11-15T01:36:42.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.512+0000 7f9f5d749700 1 -- 172.21.15.1:0/3102400795 wait complete. 2023-11-15T01:36:42.529 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-15T01:36:42.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.657+0000 7fe7844c7700 1 Processor -- start 2023-11-15T01:36:42.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.657+0000 7fe7844c7700 1 -- start start 2023-11-15T01:36:42.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.658+0000 7fe7844c7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe77c14b350 0x7fe77c0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:42.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.658+0000 7fe7844c7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe77c0aa750 0x7fe77c154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:42.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.658+0000 7fe7844c7700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe77c1580d0 con 0x7fe77c14b730 2023-11-15T01:36:42.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.658+0000 7fe7844c7700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c155000 con 0x7fe77c0aa750 2023-11-15T01:36:42.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.658+0000 7fe7844c7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c1552e0 con 0x7fe77c14b350 2023-11-15T01:36:42.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.659+0000 7fe781a62700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe77c14b730 0x7fe77c0aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41592/0 (socket says 172.21.15.1:41592) 2023-11-15T01:36:42.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.659+0000 7fe781a62700 1 -- 172.21.15.1:0/1179194888 learned_addr learned my addr 172.21.15.1:0/1179194888 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:42.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.659+0000 7fe782a64700 1 --2- 172.21.15.1:0/1179194888 >> v2:172.21.15.141:3300/0 conn(0x7fe77c0aa750 0x7fe77c154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:42.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.659+0000 7fe782263700 1 --2- 172.21.15.1:0/1179194888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe77c14b350 0x7fe77c0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:42.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.659+0000 7fe781261700 1 -- 172.21.15.1:0/1179194888 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154860291 0 0) 0x7fe77c1580d0 con 0x7fe77c14b730 2023-11-15T01:36:42.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.659+0000 7fe781261700 1 -- 172.21.15.1:0/1179194888 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7640033f0 con 0x7fe77c14b730 2023-11-15T01:36:42.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.659+0000 7fe782a64700 1 -- 172.21.15.1:0/1179194888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe77c14b350 msgr2=0x7fe77c0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:42.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.659+0000 7fe782a64700 1 --2- 172.21.15.1:0/1179194888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe77c14b350 0x7fe77c0c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:42.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.659+0000 7fe782a64700 1 -- 172.21.15.1:0/1179194888 >> v1:172.21.15.1:6789/0 conn(0x7fe77c14b730 legacy=0x7fe77c0aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:42.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.659+0000 7fe782a64700 1 -- 172.21.15.1:0/1179194888 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c1555c0 con 0x7fe77c0aa750 2023-11-15T01:36:42.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.659+0000 7fe782263700 1 --2- 172.21.15.1:0/1179194888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe77c14b350 0x7fe77c0c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:42.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.659+0000 7fe782a64700 1 --2- 172.21.15.1:0/1179194888 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe77c0aa750 0x7fe77c154a10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fe76c009e60 tx=0x7fe76c009780).ready entity=mon.1 client_cookie=6b1805863fc6e0d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:42.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.659+0000 7fe781261700 1 -- 172.21.15.1:0/1179194888 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c00e070 con 0x7fe77c0aa750 2023-11-15T01:36:42.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.659+0000 7fe781261700 1 -- 172.21.15.1:0/1179194888 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c00bab0 con 0x7fe77c0aa750 2023-11-15T01:36:42.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.659+0000 7fe781261700 1 -- 172.21.15.1:0/1179194888 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c00be30 con 0x7fe77c0aa750 2023-11-15T01:36:42.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.660+0000 7fe7844c7700 1 -- 172.21.15.1:0/1179194888 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe77c0aa750 msgr2=0x7fe77c154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:42.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.660+0000 7fe7844c7700 1 --2- 172.21.15.1:0/1179194888 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe77c0aa750 0x7fe77c154a10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fe76c009e60 tx=0x7fe76c009780).stop 2023-11-15T01:36:42.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.660+0000 7fe7844c7700 1 -- 172.21.15.1:0/1179194888 shutdown_connections 2023-11-15T01:36:42.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.660+0000 7fe7844c7700 1 --2- 172.21.15.1:0/1179194888 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe77c0aa750 0x7fe77c154a10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:42.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.660+0000 7fe7844c7700 1 --2- 172.21.15.1:0/1179194888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe77c14b350 0x7fe77c0c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:42.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.660+0000 7fe7844c7700 1 -- 172.21.15.1:0/1179194888 >> 172.21.15.1:0/1179194888 conn(0x7fe77c069ee0 msgr2=0x7fe77c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:42.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.660+0000 7fe7844c7700 1 -- 172.21.15.1:0/1179194888 shutdown_connections 2023-11-15T01:36:42.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.660+0000 7fe7844c7700 1 -- 172.21.15.1:0/1179194888 wait complete. 2023-11-15T01:36:42.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.661+0000 7fe7844c7700 1 Processor -- start 2023-11-15T01:36:42.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.661+0000 7fe7844c7700 1 -- start start 2023-11-15T01:36:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe7844c7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe77c0aa750 0x7fe77c0aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe7844c7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe77c14b350 0x7fe77c0b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe7844c7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c14b730 0x7fe77c0ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe7844c7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c1494d0 con 0x7fe77c14b730 2023-11-15T01:36:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe7844c7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0ae880 con 0x7fe77c0aa750 2023-11-15T01:36:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe7844c7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0b1150 con 0x7fe77c14b350 2023-11-15T01:36:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe782a64700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c14b730 0x7fe77c0ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe782a64700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c14b730 0x7fe77c0ac090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35402/0 (socket says 172.21.15.1:35402) 2023-11-15T01:36:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe782a64700 1 -- 172.21.15.1:0/2123300551 learned_addr learned my addr 172.21.15.1:0/2123300551 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe782263700 1 --2- 172.21.15.1:0/2123300551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe77c0aa750 0x7fe77c0aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:42.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe781a62700 1 --2- 172.21.15.1:0/2123300551 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe77c14b350 0x7fe77c0b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:42.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe782a64700 1 -- 172.21.15.1:0/2123300551 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe77c14b350 msgr2=0x7fe77c0b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:42.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe782a64700 1 --2- 172.21.15.1:0/2123300551 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe77c14b350 0x7fe77c0b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:42.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe782a64700 1 -- 172.21.15.1:0/2123300551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe77c0aa750 msgr2=0x7fe77c0aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:42.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe782a64700 1 --2- 172.21.15.1:0/2123300551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe77c0aa750 0x7fe77c0aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:42.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe782a64700 1 -- 172.21.15.1:0/2123300551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7740092a0 con 0x7fe77c14b730 2023-11-15T01:36:42.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.662+0000 7fe782263700 1 --2- 172.21.15.1:0/2123300551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe77c0aa750 0x7fe77c0aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:42.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.663+0000 7fe782a64700 1 --2- 172.21.15.1:0/2123300551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c14b730 0x7fe77c0ac090 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7fe77c083e50 tx=0x7fe76c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:42.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.663+0000 7fe77a7fc700 1 -- 172.21.15.1:0/2123300551 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c01d630 con 0x7fe77c14b730 2023-11-15T01:36:42.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.663+0000 7fe77a7fc700 1 -- 172.21.15.1:0/2123300551 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c01d790 con 0x7fe77c14b730 2023-11-15T01:36:42.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.663+0000 7fe7844c7700 1 -- 172.21.15.1:0/2123300551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76c009a20 con 0x7fe77c14b730 2023-11-15T01:36:42.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.663+0000 7fe77a7fc700 1 -- 172.21.15.1:0/2123300551 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c01db50 con 0x7fe77c14b730 2023-11-15T01:36:42.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.663+0000 7fe7844c7700 1 -- 172.21.15.1:0/2123300551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c0ae230 con 0x7fe77c14b730 2023-11-15T01:36:42.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.664+0000 7fe7844c7700 1 -- 172.21.15.1:0/2123300551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c0aea10 con 0x7fe77c14b730 2023-11-15T01:36:42.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.664+0000 7fe77a7fc700 1 -- 172.21.15.1:0/2123300551 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 31) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fe76c003040 con 0x7fe77c14b730 2023-11-15T01:36:42.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.664+0000 7fe77a7fc700 1 --2- 172.21.15.1:0/2123300551 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe76805f000 0x7fe7680614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:42.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.664+0000 7fe77a7fc700 1 -- 172.21.15.1:0/2123300551 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7104+0+0 (secure 0 0 0) 0x7fe76c07c150 con 0x7fe77c14b730 2023-11-15T01:36:42.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.665+0000 7fe782263700 1 --2- 172.21.15.1:0/2123300551 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe76805f000 0x7fe7680614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:42.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.665+0000 7fe782263700 1 --2- 172.21.15.1:0/2123300551 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe76805f000 0x7fe7680614c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe774009270 tx=0x7fe774008040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:42.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.668+0000 7fe77a7fc700 1 -- 172.21.15.1:0/2123300551 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe76c04d220 con 0x7fe77c14b730 2023-11-15T01:36:42.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:42.841+0000 7fe7844c7700 1 -- 172.21.15.1:0/2123300551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe77c06c7e0 con 0x7fe77c14b730 2023-11-15T01:36:43.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.084+0000 7fe77a7fc700 1 -- 172.21.15.1:0/2123300551 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe76c079d20 con 0x7fe77c14b730 2023-11-15T01:36:43.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.510+0000 7fe77a7fc700 1 -- 172.21.15.1:0/2123300551 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe76c042ed0 con 0x7fe77c14b730 2023-11-15T01:36:43.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.513+0000 7fe7844c7700 1 -- 172.21.15.1:0/2123300551 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe76805f000 msgr2=0x7fe7680614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:43.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.513+0000 7fe7844c7700 1 --2- 172.21.15.1:0/2123300551 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe76805f000 0x7fe7680614c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe774009270 tx=0x7fe774008040).stop 2023-11-15T01:36:43.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.513+0000 7fe7844c7700 1 -- 172.21.15.1:0/2123300551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c14b730 msgr2=0x7fe77c0ac090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:43.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.513+0000 7fe7844c7700 1 --2- 172.21.15.1:0/2123300551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c14b730 0x7fe77c0ac090 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7fe77c083e50 tx=0x7fe76c009780).stop 2023-11-15T01:36:43.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.513+0000 7fe7844c7700 1 -- 172.21.15.1:0/2123300551 shutdown_connections 2023-11-15T01:36:43.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.513+0000 7fe7844c7700 1 --2- 172.21.15.1:0/2123300551 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe76805f000 0x7fe7680614c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:43.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.513+0000 7fe7844c7700 1 --2- 172.21.15.1:0/2123300551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c14b730 0x7fe77c0ac090 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:43.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.513+0000 7fe7844c7700 1 --2- 172.21.15.1:0/2123300551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe77c0aa750 0x7fe77c0aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:43.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.513+0000 7fe7844c7700 1 --2- 172.21.15.1:0/2123300551 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe77c14b350 0x7fe77c0b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:43.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.513+0000 7fe7844c7700 1 -- 172.21.15.1:0/2123300551 >> 172.21.15.1:0/2123300551 conn(0x7fe77c069ee0 msgr2=0x7fe77c0c0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:43.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.513+0000 7fe7844c7700 1 -- 172.21.15.1:0/2123300551 shutdown_connections 2023-11-15T01:36:43.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.513+0000 7fe7844c7700 1 -- 172.21.15.1:0/2123300551 wait complete. 2023-11-15T01:36:43.517 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2023-11-15T01:36:43.530 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-15T01:36:43.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.651+0000 7f6cb593d700 1 Processor -- start 2023-11-15T01:36:43.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.651+0000 7f6cb593d700 1 -- start start 2023-11-15T01:36:43.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.652+0000 7f6cb593d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6cb00aa750 0x7f6cb00c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:43.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.652+0000 7f6cb593d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cb014b730 0x7f6cb0154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:43.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.652+0000 7f6cb593d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb01580d0 con 0x7f6cb014b350 2023-11-15T01:36:43.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.652+0000 7f6cb593d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb0155000 con 0x7f6cb00aa750 2023-11-15T01:36:43.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.652+0000 7f6cb593d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb01552e0 con 0x7f6cb014b730 2023-11-15T01:36:43.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6cae7fc700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6cb00aa750 0x7f6cb00c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:43.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6caf7fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cb014b730 0x7f6cb0154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:43.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6cae7fc700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6cb00aa750 0x7f6cb00c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:52096/0 (socket says 172.21.15.1:52096) 2023-11-15T01:36:43.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6caf7fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cb014b730 0x7f6cb0154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:46462/0 (socket says 172.21.15.1:46462) 2023-11-15T01:36:43.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6cae7fc700 1 -- 172.21.15.1:0/287535318 learned_addr learned my addr 172.21.15.1:0/287535318 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:43.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6caeffd700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f6cb014b350 0x7f6cb00aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:33520/0 (socket says 172.21.15.1:33520) 2023-11-15T01:36:43.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6cae7fc700 1 -- 172.21.15.1:0/287535318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cb014b730 msgr2=0x7f6cb0154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:43.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6cae7fc700 1 --2- 172.21.15.1:0/287535318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cb014b730 0x7f6cb0154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:43.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6cae7fc700 1 -- 172.21.15.1:0/287535318 >> v1:172.21.15.141:6789/0 conn(0x7f6cb014b350 legacy=0x7f6cb00aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:43.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6cae7fc700 1 -- 172.21.15.1:0/287535318 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb01555c0 con 0x7f6cb00aa750 2023-11-15T01:36:43.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6cadffb700 1 -- 172.21.15.1:0/287535318 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458467232 0 0) 0x7f6cb01580d0 con 0x7f6cb014b350 2023-11-15T01:36:43.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6caf7fe700 1 --2- 172.21.15.1:0/287535318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cb014b730 0x7f6cb0154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:43.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6cae7fc700 1 --2- 172.21.15.1:0/287535318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6cb00aa750 0x7f6cb00c8290 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f6c98006fd0 tx=0x7f6c980090f0).ready entity=mon.1 client_cookie=738c9f095c099404 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:43.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6cadffb700 1 -- 172.21.15.1:0/287535318 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800b580 con 0x7f6cb00aa750 2023-11-15T01:36:43.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6cadffb700 1 -- 172.21.15.1:0/287535318 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9800b6e0 con 0x7f6cb00aa750 2023-11-15T01:36:43.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.653+0000 7f6cadffb700 1 -- 172.21.15.1:0/287535318 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800ba60 con 0x7f6cb00aa750 2023-11-15T01:36:43.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.654+0000 7f6cb593d700 1 -- 172.21.15.1:0/287535318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6cb00aa750 msgr2=0x7f6cb00c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:43.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.654+0000 7f6cb593d700 1 --2- 172.21.15.1:0/287535318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6cb00aa750 0x7f6cb00c8290 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f6c98006fd0 tx=0x7f6c980090f0).stop 2023-11-15T01:36:43.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.654+0000 7f6cb593d700 1 -- 172.21.15.1:0/287535318 shutdown_connections 2023-11-15T01:36:43.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.654+0000 7f6cb593d700 1 --2- 172.21.15.1:0/287535318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cb014b730 0x7f6cb0154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:43.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.654+0000 7f6cb593d700 1 --2- 172.21.15.1:0/287535318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6cb00aa750 0x7f6cb00c8290 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:43.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.654+0000 7f6cb593d700 1 -- 172.21.15.1:0/287535318 >> 172.21.15.1:0/287535318 conn(0x7f6cb0069ee0 msgr2=0x7f6cb006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:43.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.654+0000 7f6cb593d700 1 -- 172.21.15.1:0/287535318 shutdown_connections 2023-11-15T01:36:43.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.654+0000 7f6cb593d700 1 -- 172.21.15.1:0/287535318 wait complete. 2023-11-15T01:36:43.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.655+0000 7f6cb593d700 1 Processor -- start 2023-11-15T01:36:43.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.655+0000 7f6cb593d700 1 -- start start 2023-11-15T01:36:43.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6cb593d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cb00aa750 0x7f6cb0148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:43.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6cb593d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6cb014b350 0x7f6cb00c1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:43.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6cb593d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cb014b730 0x7f6cb00b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:43.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6cb593d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb0165820 con 0x7f6cb014b730 2023-11-15T01:36:43.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6cb593d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb0149150 con 0x7f6cb014b350 2023-11-15T01:36:43.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6cb593d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb0164b50 con 0x7f6cb00aa750 2023-11-15T01:36:43.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6caf7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cb014b730 0x7f6cb00b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:43.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6caf7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cb014b730 0x7f6cb00b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35406/0 (socket says 172.21.15.1:35406) 2023-11-15T01:36:43.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6caf7fe700 1 -- 172.21.15.1:0/1812983047 learned_addr learned my addr 172.21.15.1:0/1812983047 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:43.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6cae7fc700 1 --2- 172.21.15.1:0/1812983047 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6cb014b350 0x7f6cb00c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:43.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6caeffd700 1 --2- 172.21.15.1:0/1812983047 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cb00aa750 0x7f6cb0148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:43.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6caf7fe700 1 -- 172.21.15.1:0/1812983047 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cb00aa750 msgr2=0x7f6cb0148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:43.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6caf7fe700 1 --2- 172.21.15.1:0/1812983047 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cb00aa750 0x7f6cb0148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:43.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6caf7fe700 1 -- 172.21.15.1:0/1812983047 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6cb014b350 msgr2=0x7f6cb00c1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:43.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6caf7fe700 1 --2- 172.21.15.1:0/1812983047 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6cb014b350 0x7f6cb00c1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:43.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.656+0000 7f6caf7fe700 1 -- 172.21.15.1:0/1812983047 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca80092a0 con 0x7f6cb014b730 2023-11-15T01:36:43.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.657+0000 7f6caf7fe700 1 --2- 172.21.15.1:0/1812983047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cb014b730 0x7f6cb00b0050 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f6ca800e950 tx=0x7f6ca8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:43.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.657+0000 7f6ca6ffd700 1 -- 172.21.15.1:0/1812983047 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8009580 con 0x7f6cb014b730 2023-11-15T01:36:43.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.657+0000 7f6ca6ffd700 1 -- 172.21.15.1:0/1812983047 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca8012600 con 0x7f6cb014b730 2023-11-15T01:36:43.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.657+0000 7f6cb593d700 1 -- 172.21.15.1:0/1812983047 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c98009370 con 0x7f6cb014b730 2023-11-15T01:36:43.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.657+0000 7f6ca6ffd700 1 -- 172.21.15.1:0/1812983047 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80129a0 con 0x7f6cb014b730 2023-11-15T01:36:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.657+0000 7f6cb593d700 1 -- 172.21.15.1:0/1812983047 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb0165110 con 0x7f6cb014b730 2023-11-15T01:36:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.658+0000 7f6cb593d700 1 -- 172.21.15.1:0/1812983047 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb006c7e0 con 0x7f6cb014b730 2023-11-15T01:36:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.658+0000 7f6ca6ffd700 1 -- 172.21.15.1:0/1812983047 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6ca8012d10 con 0x7f6cb014b730 2023-11-15T01:36:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.659+0000 7f6ca6ffd700 1 --2- 172.21.15.1:0/1812983047 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c9005f240 0x7f6c90061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.659+0000 7f6ca6ffd700 1 -- 172.21.15.1:0/1812983047 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f6ca807aad0 con 0x7f6cb014b730 2023-11-15T01:36:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.659+0000 7f6caeffd700 1 --2- 172.21.15.1:0/1812983047 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c9005f240 0x7f6c90061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.660+0000 7f6caeffd700 1 --2- 172.21.15.1:0/1812983047 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c9005f240 0x7f6c90061700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6ca0001560 tx=0x7f6ca0007f50).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.663+0000 7f6ca6ffd700 1 -- 172.21.15.1:0/1812983047 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6ca804ba00 con 0x7f6cb014b730 2023-11-15T01:36:43.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:43.837+0000 7f6cb593d700 1 -- 172.21.15.1:0/1812983047 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6cb005f8b0 con 0x7f6cb014b730 2023-11-15T01:36:44.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.824+0000 7f6ca6ffd700 1 -- 172.21.15.1:0/1812983047 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6ca8016070 con 0x7f6cb014b730 2023-11-15T01:36:44.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.827+0000 7f6cb593d700 1 -- 172.21.15.1:0/1812983047 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c9005f240 msgr2=0x7f6c90061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:44.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.827+0000 7f6cb593d700 1 --2- 172.21.15.1:0/1812983047 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c9005f240 0x7f6c90061700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6ca0001560 tx=0x7f6ca0007f50).stop 2023-11-15T01:36:44.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.827+0000 7f6cb593d700 1 -- 172.21.15.1:0/1812983047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cb014b730 msgr2=0x7f6cb00b0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:44.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.827+0000 7f6cb593d700 1 --2- 172.21.15.1:0/1812983047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cb014b730 0x7f6cb00b0050 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f6ca800e950 tx=0x7f6ca8009060).stop 2023-11-15T01:36:44.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.828+0000 7f6cb593d700 1 -- 172.21.15.1:0/1812983047 shutdown_connections 2023-11-15T01:36:44.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.828+0000 7f6cb593d700 1 --2- 172.21.15.1:0/1812983047 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6c9005f240 0x7f6c90061700 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:44.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.828+0000 7f6cb593d700 1 --2- 172.21.15.1:0/1812983047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cb014b730 0x7f6cb00b0050 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:44.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.828+0000 7f6cb593d700 1 --2- 172.21.15.1:0/1812983047 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cb00aa750 0x7f6cb0148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:44.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.828+0000 7f6cb593d700 1 --2- 172.21.15.1:0/1812983047 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6cb014b350 0x7f6cb00c1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:44.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.828+0000 7f6cb593d700 1 -- 172.21.15.1:0/1812983047 >> 172.21.15.1:0/1812983047 conn(0x7f6cb0069ee0 msgr2=0x7f6cb0155800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:44.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.828+0000 7f6cb593d700 1 -- 172.21.15.1:0/1812983047 shutdown_connections 2023-11-15T01:36:44.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.828+0000 7f6cb593d700 1 -- 172.21.15.1:0/1812983047 wait complete. 2023-11-15T01:36:44.832 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2023-11-15T01:36:44.843 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-15T01:36:44.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.967+0000 7f5e442db700 1 Processor -- start 2023-11-15T01:36:44.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.967+0000 7f5e442db700 1 -- start start 2023-11-15T01:36:44.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e442db700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5e3c062ec0 0x7f5e3c14eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:44.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e442db700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3c158e40 con 0x7f5e3c14e6e0 2023-11-15T01:36:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e442db700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3c158230 con 0x7f5e3c155370 2023-11-15T01:36:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e442db700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e3c158510 con 0x7f5e3c062ec0 2023-11-15T01:36:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e42077700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5e3c14e6e0 0x7f5e3c0627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41596/0 (socket says 172.21.15.1:41596) 2023-11-15T01:36:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e42077700 1 -- 172.21.15.1:0/1787586936 learned_addr learned my addr 172.21.15.1:0/1787586936 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e41876700 1 --2- 172.21.15.1:0/1787586936 >> v2:172.21.15.141:3300/0 conn(0x7f5e3c062ec0 0x7f5e3c14eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:44.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e41075700 1 -- 172.21.15.1:0/1787586936 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119351944 0 0) 0x7f5e3c158e40 con 0x7f5e3c14e6e0 2023-11-15T01:36:44.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e41075700 1 -- 172.21.15.1:0/1787586936 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e280033f0 con 0x7f5e3c14e6e0 2023-11-15T01:36:44.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e41075700 1 -- 172.21.15.1:0/1787586936 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3555480548 0 0) 0x7f5e280033f0 con 0x7f5e3c14e6e0 2023-11-15T01:36:44.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e41075700 1 -- 172.21.15.1:0/1787586936 >> v2:172.21.15.141:3300/0 conn(0x7f5e3c062ec0 msgr2=0x7f5e3c14eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:44.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e41075700 1 --2- 172.21.15.1:0/1787586936 >> v2:172.21.15.141:3300/0 conn(0x7f5e3c062ec0 0x7f5e3c14eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e41075700 1 -- 172.21.15.1:0/1787586936 >> v1:172.21.15.141:6789/0 conn(0x7f5e3c155370 legacy=0x7f5e3c0c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e41075700 1 -- 172.21.15.1:0/1787586936 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c1587f0 con 0x7f5e3c14e6e0 2023-11-15T01:36:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e41075700 1 -- 172.21.15.1:0/1787586936 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f5e38001470 con 0x7f5e3c14e6e0 2023-11-15T01:36:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e41075700 1 -- 172.21.15.1:0/1787586936 >> v1:172.21.15.1:6789/0 conn(0x7f5e3c14e6e0 legacy=0x7f5e3c0627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e41075700 1 --2- 172.21.15.1:0/1787586936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e280038e0 0x7f5e28003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e41075700 1 --2- 172.21.15.1:0/1787586936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e28004690 0x7f5e28004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e41075700 1 --2- 172.21.15.1:0/1787586936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28005000 0x7f5e2800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.968+0000 7f5e41075700 1 -- 172.21.15.1:0/1787586936 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c158510 con 0x7f5e28005000 2023-11-15T01:36:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e41075700 1 -- 172.21.15.1:0/1787586936 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2800beb0 con 0x7f5e28004690 2023-11-15T01:36:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e41075700 1 -- 172.21.15.1:0/1787586936 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2800c070 con 0x7f5e280038e0 2023-11-15T01:36:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e41876700 1 --2- 172.21.15.1:0/1787586936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e28004690 0x7f5e28004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e42878700 1 --2- 172.21.15.1:0/1787586936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28005000 0x7f5e2800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e42077700 1 --2- 172.21.15.1:0/1787586936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e280038e0 0x7f5e28003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e42878700 1 -- 172.21.15.1:0/1787586936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e280038e0 msgr2=0x7f5e28003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e42878700 1 --2- 172.21.15.1:0/1787586936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e280038e0 0x7f5e28003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e42878700 1 -- 172.21.15.1:0/1787586936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e28004690 msgr2=0x7f5e28004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e42878700 1 --2- 172.21.15.1:0/1787586936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e28004690 0x7f5e28004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e42878700 1 -- 172.21.15.1:0/1787586936 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e280033f0 con 0x7f5e28005000 2023-11-15T01:36:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e41876700 1 --2- 172.21.15.1:0/1787586936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e28004690 0x7f5e28004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e42878700 1 -- 172.21.15.1:0/1787586936 reap_dead start 2023-11-15T01:36:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e42878700 1 --2- 172.21.15.1:0/1787586936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28005000 0x7f5e2800b8e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f5e34001e30 tx=0x7f5e34007f30).ready entity=mon.0 client_cookie=6fed9fe87385edc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e41075700 1 -- 172.21.15.1:0/1787586936 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34006a20 con 0x7f5e28005000 2023-11-15T01:36:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e41075700 1 -- 172.21.15.1:0/1787586936 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e34006b80 con 0x7f5e28005000 2023-11-15T01:36:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.969+0000 7f5e41075700 1 -- 172.21.15.1:0/1787586936 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400c5d0 con 0x7f5e28005000 2023-11-15T01:36:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.970+0000 7f5e442db700 1 -- 172.21.15.1:0/1787586936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28005000 msgr2=0x7f5e2800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.970+0000 7f5e442db700 1 --2- 172.21.15.1:0/1787586936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28005000 0x7f5e2800b8e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f5e34001e30 tx=0x7f5e34007f30).stop 2023-11-15T01:36:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.970+0000 7f5e442db700 1 -- 172.21.15.1:0/1787586936 shutdown_connections 2023-11-15T01:36:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.970+0000 7f5e442db700 1 --2- 172.21.15.1:0/1787586936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e28005000 0x7f5e2800b8e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.970+0000 7f5e442db700 1 -- 172.21.15.1:0/1787586936 >> 172.21.15.1:0/1787586936 conn(0x7f5e3c0c7dc0 msgr2=0x7f5e3c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.970+0000 7f5e442db700 1 -- 172.21.15.1:0/1787586936 shutdown_connections 2023-11-15T01:36:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.970+0000 7f5e442db700 1 -- 172.21.15.1:0/1787586936 wait complete. 2023-11-15T01:36:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.971+0000 7f5e442db700 1 Processor -- start 2023-11-15T01:36:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.971+0000 7f5e442db700 1 -- start start 2023-11-15T01:36:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e442db700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e28005000 0x7f5e3c0675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e442db700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e3c139530 0x7f5e3c0a9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e442db700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e3c1399b0 0x7f5e3c0a9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e442db700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0a7c40 con 0x7f5e3c139530 2023-11-15T01:36:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e442db700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0a49d0 con 0x7f5e3c1399b0 2023-11-15T01:36:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e442db700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0a4cb0 con 0x7f5e28005000 2023-11-15T01:36:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e41876700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e3c139530 0x7f5e3c0a9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e41876700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e3c139530 0x7f5e3c0a9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35424/0 (socket says 172.21.15.1:35424) 2023-11-15T01:36:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e41876700 1 -- 172.21.15.1:0/893898021 learned_addr learned my addr 172.21.15.1:0/893898021 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e42077700 1 --2- 172.21.15.1:0/893898021 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e28005000 0x7f5e3c0675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e42878700 1 --2- 172.21.15.1:0/893898021 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e3c1399b0 0x7f5e3c0a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e41876700 1 -- 172.21.15.1:0/893898021 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e28005000 msgr2=0x7f5e3c0675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e41876700 1 --2- 172.21.15.1:0/893898021 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e28005000 0x7f5e3c0675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e41876700 1 -- 172.21.15.1:0/893898021 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e3c1399b0 msgr2=0x7f5e3c0a9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e41876700 1 --2- 172.21.15.1:0/893898021 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e3c1399b0 0x7f5e3c0a9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e41876700 1 -- 172.21.15.1:0/893898021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c0aa0c0 con 0x7f5e3c139530 2023-11-15T01:36:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e42878700 1 --2- 172.21.15.1:0/893898021 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e3c1399b0 0x7f5e3c0a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e41876700 1 --2- 172.21.15.1:0/893898021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e3c139530 0x7f5e3c0a9110 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f5e2c011b20 tx=0x7f5e2c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e327fc700 1 -- 172.21.15.1:0/893898021 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c00f9b0 con 0x7f5e3c139530 2023-11-15T01:36:44.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.972+0000 7f5e327fc700 1 -- 172.21.15.1:0/893898021 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c00fb10 con 0x7f5e3c139530 2023-11-15T01:36:44.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.973+0000 7f5e442db700 1 -- 172.21.15.1:0/893898021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3c0aa3a0 con 0x7f5e3c139530 2023-11-15T01:36:44.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.973+0000 7f5e327fc700 1 -- 172.21.15.1:0/893898021 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c00fe90 con 0x7f5e3c139530 2023-11-15T01:36:44.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.973+0000 7f5e442db700 1 -- 172.21.15.1:0/893898021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3c0a9af0 con 0x7f5e3c139530 2023-11-15T01:36:44.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.973+0000 7f5e442db700 1 -- 172.21.15.1:0/893898021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3c06c7e0 con 0x7f5e3c139530 2023-11-15T01:36:44.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.974+0000 7f5e327fc700 1 -- 172.21.15.1:0/893898021 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5e2c014650 con 0x7f5e3c139530 2023-11-15T01:36:44.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.974+0000 7f5e327fc700 1 --2- 172.21.15.1:0/893898021 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e2005f270 0x7f5e20061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:44.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.974+0000 7f5e327fc700 1 -- 172.21.15.1:0/893898021 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6252+0+0 (secure 0 0 0) 0x7f5e2c07b230 con 0x7f5e3c139530 2023-11-15T01:36:44.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.974+0000 7f5e42077700 1 --2- 172.21.15.1:0/893898021 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e2005f270 0x7f5e20061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:44.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.975+0000 7f5e42077700 1 --2- 172.21.15.1:0/893898021 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e2005f270 0x7f5e20061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5e38001ce0 tx=0x7f5e38009040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:44.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:44.978+0000 7f5e327fc700 1 -- 172.21.15.1:0/893898021 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5e2c04c300 con 0x7f5e3c139530 2023-11-15T01:36:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.154+0000 7f5e442db700 1 -- 172.21.15.1:0/893898021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5e3c0a4df0 con 0x7f5e3c139530 2023-11-15T01:36:45.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.157+0000 7f5e327fc700 1 -- 172.21.15.1:0/893898021 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5e2c04f920 con 0x7f5e3c139530 2023-11-15T01:36:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.159+0000 7f5e442db700 1 -- 172.21.15.1:0/893898021 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e2005f270 msgr2=0x7f5e20061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.159+0000 7f5e442db700 1 --2- 172.21.15.1:0/893898021 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e2005f270 0x7f5e20061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5e38001ce0 tx=0x7f5e38009040).stop 2023-11-15T01:36:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.159+0000 7f5e442db700 1 -- 172.21.15.1:0/893898021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e3c139530 msgr2=0x7f5e3c0a9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.159+0000 7f5e442db700 1 --2- 172.21.15.1:0/893898021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e3c139530 0x7f5e3c0a9110 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f5e2c011b20 tx=0x7f5e2c009060).stop 2023-11-15T01:36:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.159+0000 7f5e442db700 1 -- 172.21.15.1:0/893898021 shutdown_connections 2023-11-15T01:36:45.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.159+0000 7f5e442db700 1 --2- 172.21.15.1:0/893898021 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e2005f270 0x7f5e20061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.159+0000 7f5e442db700 1 --2- 172.21.15.1:0/893898021 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e3c1399b0 0x7f5e3c0a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.159+0000 7f5e442db700 1 --2- 172.21.15.1:0/893898021 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e28005000 0x7f5e3c0675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.159+0000 7f5e442db700 1 --2- 172.21.15.1:0/893898021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e3c139530 0x7f5e3c0a9110 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.159+0000 7f5e442db700 1 -- 172.21.15.1:0/893898021 >> 172.21.15.1:0/893898021 conn(0x7f5e3c0c7dc0 msgr2=0x7f5e3c155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:45.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.159+0000 7f5e442db700 1 -- 172.21.15.1:0/893898021 shutdown_connections 2023-11-15T01:36:45.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.159+0000 7f5e442db700 1 -- 172.21.15.1:0/893898021 wait complete. 2023-11-15T01:36:45.172 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-15T01:36:45.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.291+0000 7fa5d7dd4700 1 Processor -- start 2023-11-15T01:36:45.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.291+0000 7fa5d7dd4700 1 -- start start 2023-11-15T01:36:45.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d7dd4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa5d0154480 0x7fa5d00c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:45.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d7dd4700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d00ca050 con 0x7fa5d00c6430 2023-11-15T01:36:45.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d7dd4700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d00c68c0 con 0x7fa5d01540a0 2023-11-15T01:36:45.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d7dd4700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d00c9440 con 0x7fa5d0154480 2023-11-15T01:36:45.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d536f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa5d0154480 0x7fa5d00c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:45.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d6371700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa5d00c6430 0x7fa5d00aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41602/0 (socket says 172.21.15.1:41602) 2023-11-15T01:36:45.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d536f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa5d0154480 0x7fa5d00c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35428/0 (socket says 172.21.15.1:35428) 2023-11-15T01:36:45.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d6371700 1 -- 172.21.15.1:0/1532645930 learned_addr learned my addr 172.21.15.1:0/1532645930 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:45.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d536f700 1 -- 172.21.15.1:0/1532645930 >> v1:172.21.15.141:6789/0 conn(0x7fa5d01540a0 legacy=0x7fa5d00ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:45.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d536f700 1 -- 172.21.15.1:0/1532645930 >> v1:172.21.15.1:6789/0 conn(0x7fa5d00c6430 legacy=0x7fa5d00aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:45.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d4b6e700 1 -- 172.21.15.1:0/1532645930 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150476431 0 0) 0x7fa5d00ca050 con 0x7fa5d00c6430 2023-11-15T01:36:45.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d536f700 1 -- 172.21.15.1:0/1532645930 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d00c9720 con 0x7fa5d0154480 2023-11-15T01:36:45.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d536f700 1 --2- 172.21.15.1:0/1532645930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5d0154480 0x7fa5d00c5f40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fa5c4009760 tx=0x7fa5c4009060).ready entity=mon.0 client_cookie=85b1a92f0ef04944 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:45.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d4b6e700 1 -- 172.21.15.1:0/1532645930 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c400b520 con 0x7fa5d0154480 2023-11-15T01:36:45.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d4b6e700 1 -- 172.21.15.1:0/1532645930 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c400b680 con 0x7fa5d0154480 2023-11-15T01:36:45.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.292+0000 7fa5d4b6e700 1 -- 172.21.15.1:0/1532645930 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c400ba00 con 0x7fa5d0154480 2023-11-15T01:36:45.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.293+0000 7fa5d7dd4700 1 -- 172.21.15.1:0/1532645930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5d0154480 msgr2=0x7fa5d00c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:45.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.293+0000 7fa5d7dd4700 1 --2- 172.21.15.1:0/1532645930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5d0154480 0x7fa5d00c5f40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fa5c4009760 tx=0x7fa5c4009060).stop 2023-11-15T01:36:45.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.293+0000 7fa5d7dd4700 1 -- 172.21.15.1:0/1532645930 shutdown_connections 2023-11-15T01:36:45.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.293+0000 7fa5d7dd4700 1 --2- 172.21.15.1:0/1532645930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5d0154480 0x7fa5d00c5f40 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.293+0000 7fa5d7dd4700 1 -- 172.21.15.1:0/1532645930 >> 172.21.15.1:0/1532645930 conn(0x7fa5d0064a70 msgr2=0x7fa5d0064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:45.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.293+0000 7fa5d7dd4700 1 -- 172.21.15.1:0/1532645930 shutdown_connections 2023-11-15T01:36:45.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.293+0000 7fa5d7dd4700 1 -- 172.21.15.1:0/1532645930 wait complete. 2023-11-15T01:36:45.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.294+0000 7fa5d7dd4700 1 Processor -- start 2023-11-15T01:36:45.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.294+0000 7fa5d7dd4700 1 -- start start 2023-11-15T01:36:45.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.295+0000 7fa5d7dd4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5d00c6430 0x7fa5d014de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:45.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.295+0000 7fa5d7dd4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5d01540a0 0x7fa5d0151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:45.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.295+0000 7fa5d7dd4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5d0154480 0x7fa5d01521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:45.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.295+0000 7fa5d7dd4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d014e2f0 con 0x7fa5d0154480 2023-11-15T01:36:45.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.295+0000 7fa5d7dd4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0152770 con 0x7fa5d01540a0 2023-11-15T01:36:45.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.295+0000 7fa5d7dd4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0152a50 con 0x7fa5d00c6430 2023-11-15T01:36:45.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.295+0000 7fa5d6371700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5d0154480 0x7fa5d01521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:45.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.295+0000 7fa5d6371700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5d0154480 0x7fa5d01521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35430/0 (socket says 172.21.15.1:35430) 2023-11-15T01:36:45.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.295+0000 7fa5d6371700 1 -- 172.21.15.1:0/3182013233 learned_addr learned my addr 172.21.15.1:0/3182013233 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:45.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.295+0000 7fa5d5b70700 1 --2- 172.21.15.1:0/3182013233 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5d00c6430 0x7fa5d014de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:45.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.295+0000 7fa5d536f700 1 --2- 172.21.15.1:0/3182013233 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5d01540a0 0x7fa5d0151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:45.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.295+0000 7fa5d6371700 1 -- 172.21.15.1:0/3182013233 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5d00c6430 msgr2=0x7fa5d014de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:45.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.295+0000 7fa5d6371700 1 --2- 172.21.15.1:0/3182013233 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5d00c6430 0x7fa5d014de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.295+0000 7fa5d6371700 1 -- 172.21.15.1:0/3182013233 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5d01540a0 msgr2=0x7fa5d0151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:45.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.295+0000 7fa5d6371700 1 --2- 172.21.15.1:0/3182013233 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5d01540a0 0x7fa5d0151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.296+0000 7fa5d6371700 1 -- 172.21.15.1:0/3182013233 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c40092a0 con 0x7fa5d0154480 2023-11-15T01:36:45.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.296+0000 7fa5d6371700 1 --2- 172.21.15.1:0/3182013233 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5d0154480 0x7fa5d01521a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fa5c8001eb0 tx=0x7fa5c8007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:45.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.296+0000 7fa5cdffb700 1 -- 172.21.15.1:0/3182013233 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c80070d0 con 0x7fa5d0154480 2023-11-15T01:36:45.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.296+0000 7fa5cdffb700 1 -- 172.21.15.1:0/3182013233 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c8007230 con 0x7fa5d0154480 2023-11-15T01:36:45.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.296+0000 7fa5d7dd4700 1 -- 172.21.15.1:0/3182013233 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d00ae080 con 0x7fa5d0154480 2023-11-15T01:36:45.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.296+0000 7fa5cdffb700 1 -- 172.21.15.1:0/3182013233 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c80075f0 con 0x7fa5d0154480 2023-11-15T01:36:45.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.296+0000 7fa5d7dd4700 1 -- 172.21.15.1:0/3182013233 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d00ae640 con 0x7fa5d0154480 2023-11-15T01:36:45.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.297+0000 7fa5d7dd4700 1 -- 172.21.15.1:0/3182013233 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d00ae830 con 0x7fa5d0154480 2023-11-15T01:36:45.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.297+0000 7fa5cdffb700 1 -- 172.21.15.1:0/3182013233 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa5c80059b0 con 0x7fa5d0154480 2023-11-15T01:36:45.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.298+0000 7fa5cdffb700 1 --2- 172.21.15.1:0/3182013233 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa5bc05f240 0x7fa5bc061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:45.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.298+0000 7fa5cdffb700 1 -- 172.21.15.1:0/3182013233 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6252+0+0 (secure 0 0 0) 0x7fa5c8079a50 con 0x7fa5d0154480 2023-11-15T01:36:45.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.298+0000 7fa5d5b70700 1 --2- 172.21.15.1:0/3182013233 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa5bc05f240 0x7fa5bc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:45.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.298+0000 7fa5d5b70700 1 --2- 172.21.15.1:0/3182013233 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa5bc05f240 0x7fa5bc061700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa5c0006fd0 tx=0x7fa5c0008040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:45.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.302+0000 7fa5cdffb700 1 -- 172.21.15.1:0/3182013233 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa5c804ab20 con 0x7fa5d0154480 2023-11-15T01:36:45.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.482+0000 7fa5d7dd4700 1 -- 172.21.15.1:0/3182013233 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fa5d006c7e0 con 0x7fa5d0154480 2023-11-15T01:36:45.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.485+0000 7fa5cdffb700 1 -- 172.21.15.1:0/3182013233 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v13) v1 ==== 120+0+0 (secure 0 0 0) 0x7fa5c8079030 con 0x7fa5d0154480 2023-11-15T01:36:45.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.487+0000 7fa5d7dd4700 1 -- 172.21.15.1:0/3182013233 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa5bc05f240 msgr2=0x7fa5bc061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:45.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.487+0000 7fa5d7dd4700 1 --2- 172.21.15.1:0/3182013233 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa5bc05f240 0x7fa5bc061700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa5c0006fd0 tx=0x7fa5c0008040).stop 2023-11-15T01:36:45.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.487+0000 7fa5d7dd4700 1 -- 172.21.15.1:0/3182013233 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5d0154480 msgr2=0x7fa5d01521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:45.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.487+0000 7fa5d7dd4700 1 --2- 172.21.15.1:0/3182013233 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5d0154480 0x7fa5d01521a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fa5c8001eb0 tx=0x7fa5c8007bb0).stop 2023-11-15T01:36:45.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.487+0000 7fa5d7dd4700 1 -- 172.21.15.1:0/3182013233 shutdown_connections 2023-11-15T01:36:45.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.487+0000 7fa5d7dd4700 1 --2- 172.21.15.1:0/3182013233 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa5bc05f240 0x7fa5bc061700 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.487+0000 7fa5d7dd4700 1 --2- 172.21.15.1:0/3182013233 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5d0154480 0x7fa5d01521a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.487+0000 7fa5d7dd4700 1 --2- 172.21.15.1:0/3182013233 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5d00c6430 0x7fa5d014de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.487+0000 7fa5d7dd4700 1 --2- 172.21.15.1:0/3182013233 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5d01540a0 0x7fa5d0151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.487+0000 7fa5d7dd4700 1 -- 172.21.15.1:0/3182013233 >> 172.21.15.1:0/3182013233 conn(0x7fa5d0064a70 msgr2=0x7fa5d014eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:45.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.487+0000 7fa5d7dd4700 1 -- 172.21.15.1:0/3182013233 shutdown_connections 2023-11-15T01:36:45.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.487+0000 7fa5d7dd4700 1 -- 172.21.15.1:0/3182013233 wait complete. 2023-11-15T01:36:45.500 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-11-15T01:36:45.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.617+0000 7f7521a64700 1 Processor -- start 2023-11-15T01:36:45.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.617+0000 7f7521a64700 1 -- start start 2023-11-15T01:36:45.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.618+0000 7f7521a64700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f751c154150 0x7f751c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:45.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.618+0000 7f7521a64700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f751c0aa060 0x7f751c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:45.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.618+0000 7f7521a64700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751c0c06f0 con 0x7f751c0ab1a0 2023-11-15T01:36:45.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.618+0000 7f7521a64700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751c0c09d0 con 0x7f751c154150 2023-11-15T01:36:45.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.618+0000 7f7521a64700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751c158820 con 0x7f751c0aa060 2023-11-15T01:36:45.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.618+0000 7f751b7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f751c154150 0x7f751c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:45.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.618+0000 7f751b7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f751c154150 0x7f751c154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35442/0 (socket says 172.21.15.1:35442) 2023-11-15T01:36:45.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.618+0000 7f751b7fe700 1 -- 172.21.15.1:0/2658117079 learned_addr learned my addr 172.21.15.1:0/2658117079 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:45.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.618+0000 7f751bfff700 1 --2- 172.21.15.1:0/2658117079 >> v2:172.21.15.141:3300/0 conn(0x7f751c0aa060 0x7f751c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:45.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.618+0000 7f751b7fe700 1 -- 172.21.15.1:0/2658117079 >> v2:172.21.15.141:3300/0 conn(0x7f751c0aa060 msgr2=0x7f751c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:45.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.618+0000 7f751b7fe700 1 --2- 172.21.15.1:0/2658117079 >> v2:172.21.15.141:3300/0 conn(0x7f751c0aa060 0x7f751c0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.618+0000 7f751b7fe700 1 -- 172.21.15.1:0/2658117079 >> v1:172.21.15.141:6789/0 conn(0x7f751c0ab1a0 legacy=0x7f751c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:45.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.618+0000 7f751b7fe700 1 -- 172.21.15.1:0/2658117079 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c158b00 con 0x7f751c154150 2023-11-15T01:36:45.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.618+0000 7f751b7fe700 1 --2- 172.21.15.1:0/2658117079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c154150 0x7f751c154530 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f751c157f80 tx=0x7f750c0090f0).ready entity=mon.0 client_cookie=7c01b890b9f3545c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:45.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.619+0000 7f751a7fc700 1 -- 172.21.15.1:0/2658117079 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00b5a0 con 0x7f751c154150 2023-11-15T01:36:45.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.619+0000 7f751a7fc700 1 -- 172.21.15.1:0/2658117079 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c00b700 con 0x7f751c154150 2023-11-15T01:36:45.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.619+0000 7f751a7fc700 1 -- 172.21.15.1:0/2658117079 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00baa0 con 0x7f751c154150 2023-11-15T01:36:45.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.619+0000 7f7521a64700 1 -- 172.21.15.1:0/2658117079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c154150 msgr2=0x7f751c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:45.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.619+0000 7f7521a64700 1 --2- 172.21.15.1:0/2658117079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c154150 0x7f751c154530 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f751c157f80 tx=0x7f750c0090f0).stop 2023-11-15T01:36:45.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.619+0000 7f7521a64700 1 -- 172.21.15.1:0/2658117079 shutdown_connections 2023-11-15T01:36:45.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.619+0000 7f7521a64700 1 --2- 172.21.15.1:0/2658117079 >> v2:172.21.15.141:3300/0 conn(0x7f751c0aa060 0x7f751c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.619+0000 7f7521a64700 1 --2- 172.21.15.1:0/2658117079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c154150 0x7f751c154530 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.619+0000 7f7521a64700 1 -- 172.21.15.1:0/2658117079 >> 172.21.15.1:0/2658117079 conn(0x7f751c064aa0 msgr2=0x7f751c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:45.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.619+0000 7f7521a64700 1 -- 172.21.15.1:0/2658117079 shutdown_connections 2023-11-15T01:36:45.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.619+0000 7f7521a64700 1 -- 172.21.15.1:0/2658117079 wait complete. 2023-11-15T01:36:45.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.620+0000 7f7521a64700 1 Processor -- start 2023-11-15T01:36:45.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.620+0000 7f7521a64700 1 -- start start 2023-11-15T01:36:45.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.621+0000 7f7521a64700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c0aa060 0x7f751c0b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:45.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.621+0000 7f7521a64700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f751c0ab1a0 0x7f751c147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:45.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.621+0000 7f7521a64700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c154150 0x7f751c0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:45.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.621+0000 7f7521a64700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c1567c0 con 0x7f751c0aa060 2023-11-15T01:36:45.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.621+0000 7f7521a64700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0af570 con 0x7f751c0ab1a0 2023-11-15T01:36:45.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.621+0000 7f7521a64700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0af290 con 0x7f751c154150 2023-11-15T01:36:45.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.621+0000 7f751b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c0aa060 0x7f751c0b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:45.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.621+0000 7f751b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c0aa060 0x7f751c0b09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35452/0 (socket says 172.21.15.1:35452) 2023-11-15T01:36:45.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.621+0000 7f751b7fe700 1 -- 172.21.15.1:0/2695619663 learned_addr learned my addr 172.21.15.1:0/2695619663 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:45.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.622+0000 7f751affd700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f751c0ab1a0 0x7f751c147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:45.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.622+0000 7f751bfff700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c154150 0x7f751c0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:45.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.622+0000 7f751b7fe700 1 -- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c154150 msgr2=0x7f751c0aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:45.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.622+0000 7f751b7fe700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c154150 0x7f751c0aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.622+0000 7f751b7fe700 1 -- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f751c0ab1a0 msgr2=0x7f751c147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:45.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.622+0000 7f751b7fe700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f751c0ab1a0 0x7f751c147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:45.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.622+0000 7f751b7fe700 1 -- 172.21.15.1:0/2695619663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c009370 con 0x7f751c0aa060 2023-11-15T01:36:45.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.622+0000 7f751affd700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f751c0ab1a0 0x7f751c147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:45.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.622+0000 7f751bfff700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c154150 0x7f751c0aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:45.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.622+0000 7f751b7fe700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c0aa060 0x7f751c0b09f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f751c062af0 tx=0x7f750c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:45.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.622+0000 7f75037fe700 1 -- 172.21.15.1:0/2695619663 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00ba80 con 0x7f751c0aa060 2023-11-15T01:36:45.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.622+0000 7f75037fe700 1 -- 172.21.15.1:0/2695619663 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c000c90 con 0x7f751c0aa060 2023-11-15T01:36:45.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.622+0000 7f7521a64700 1 -- 172.21.15.1:0/2695619663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751c156170 con 0x7f751c0aa060 2023-11-15T01:36:45.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.622+0000 7f75037fe700 1 -- 172.21.15.1:0/2695619663 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c0246c0 con 0x7f751c0aa060 2023-11-15T01:36:45.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.622+0000 7f7521a64700 1 -- 172.21.15.1:0/2695619663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751c1483f0 con 0x7f751c0aa060 2023-11-15T01:36:45.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.623+0000 7f7521a64700 1 -- 172.21.15.1:0/2695619663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751c155fd0 con 0x7f751c0aa060 2023-11-15T01:36:45.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.623+0000 7f75037fe700 1 -- 172.21.15.1:0/2695619663 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f750c021070 con 0x7f751c0aa060 2023-11-15T01:36:45.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.624+0000 7f75037fe700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f750805f270 0x7f7508061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:45.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.624+0000 7f75037fe700 1 -- 172.21.15.1:0/2695619663 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6252+0+0 (secure 0 0 0) 0x7f750c07c190 con 0x7f751c0aa060 2023-11-15T01:36:45.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.624+0000 7f751affd700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f750805f270 0x7f7508061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:45.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.624+0000 7f751affd700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f750805f270 0x7f7508061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f751c153ac0 tx=0x7f7510009040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:45.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.628+0000 7f75037fe700 1 -- 172.21.15.1:0/2695619663 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f751c155fd0 con 0x7f751c0aa060 2023-11-15T01:36:45.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:45.869+0000 7f7521a64700 1 -- 172.21.15.1:0/2695619663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f751c155fd0 con 0x7f751c0aa060 2023-11-15T01:36:46.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.829+0000 7f75037fe700 1 -- 172.21.15.1:0/2695619663 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v550) v1 ==== 156+0+0 (secure 0 0 0) 0x7f751c155fd0 con 0x7f751c0aa060 2023-11-15T01:36:46.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.831+0000 7f7521a64700 1 -- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f750805f270 msgr2=0x7f7508061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:46.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.831+0000 7f7521a64700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f750805f270 0x7f7508061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f751c153ac0 tx=0x7f7510009040).stop 2023-11-15T01:36:46.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.831+0000 7f7521a64700 1 -- 172.21.15.1:0/2695619663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c0aa060 msgr2=0x7f751c0b09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:46.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.831+0000 7f7521a64700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c0aa060 0x7f751c0b09f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f751c062af0 tx=0x7f750c015000).stop 2023-11-15T01:36:46.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.831+0000 7f7521a64700 1 -- 172.21.15.1:0/2695619663 shutdown_connections 2023-11-15T01:36:46.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.831+0000 7f7521a64700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f750805f270 0x7f7508061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:46.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.831+0000 7f7521a64700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f751c154150 0x7f751c0aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:46.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.831+0000 7f7521a64700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c0aa060 0x7f751c0b09f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:46.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.831+0000 7f7521a64700 1 --2- 172.21.15.1:0/2695619663 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f751c0ab1a0 0x7f751c147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:46.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.831+0000 7f7521a64700 1 -- 172.21.15.1:0/2695619663 >> 172.21.15.1:0/2695619663 conn(0x7f751c064aa0 msgr2=0x7f751c0ac8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:46.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.831+0000 7f7521a64700 1 -- 172.21.15.1:0/2695619663 shutdown_connections 2023-11-15T01:36:46.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.831+0000 7f7521a64700 1 -- 172.21.15.1:0/2695619663 wait complete. 2023-11-15T01:36:46.848 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-11-15T01:36:46.848 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-11-15T01:36:46.848 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-15T01:36:46.849 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-11-15T01:36:46.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.972+0000 7f721ff04700 1 Processor -- start 2023-11-15T01:36:46.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.973+0000 7f721ff04700 1 -- start start 2023-11-15T01:36:46.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721ff04700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72180833a0 0x7f72180a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:46.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721ff04700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72180a85e0 con 0x7f72180be520 2023-11-15T01:36:46.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721ff04700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7218065660 con 0x7f7218154450 2023-11-15T01:36:46.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721ff04700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7218065940 con 0x7f72180833a0 2023-11-15T01:36:46.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721e4a1700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f72180be520 0x7f72180c7470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41614/0 (socket says 172.21.15.1:41614) 2023-11-15T01:36:46.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721e4a1700 1 -- 172.21.15.1:0/3855856426 learned_addr learned my addr 172.21.15.1:0/3855856426 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:46.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721cc9e700 1 -- 172.21.15.1:0/3855856426 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837698057 0 0) 0x7f72180a85e0 con 0x7f72180be520 2023-11-15T01:36:46.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721d49f700 1 --2- 172.21.15.1:0/3855856426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72180833a0 0x7f72180a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721cc9e700 1 -- 172.21.15.1:0/3855856426 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72040033f0 con 0x7f72180be520 2023-11-15T01:36:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721cc9e700 1 -- 172.21.15.1:0/3855856426 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4202783037 0 0) 0x7f72040033f0 con 0x7f72180be520 2023-11-15T01:36:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721cc9e700 1 -- 172.21.15.1:0/3855856426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72180833a0 msgr2=0x7f72180a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721cc9e700 1 --2- 172.21.15.1:0/3855856426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72180833a0 0x7f72180a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721cc9e700 1 -- 172.21.15.1:0/3855856426 >> v1:172.21.15.141:6789/0 conn(0x7f7218154450 legacy=0x7f72180bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:46.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721cc9e700 1 -- 172.21.15.1:0/3855856426 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72180c6f50 con 0x7f72180be520 2023-11-15T01:36:46.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721cc9e700 1 -- 172.21.15.1:0/3855856426 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f72100017f0 con 0x7f72180be520 2023-11-15T01:36:46.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721cc9e700 1 -- 172.21.15.1:0/3855856426 >> v1:172.21.15.1:6789/0 conn(0x7f72180be520 legacy=0x7f72180c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:46.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721cc9e700 1 --2- 172.21.15.1:0/3855856426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7204003910 0x7f7204003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:46.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721cc9e700 1 --2- 172.21.15.1:0/3855856426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72180833a0 0x7f7204004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:46.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721cc9e700 1 --2- 172.21.15.1:0/3855856426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7204004b80 0x7f7204005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:46.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721cc9e700 1 -- 172.21.15.1:0/3855856426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7218065940 con 0x7f7204004b80 2023-11-15T01:36:46.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721cc9e700 1 -- 172.21.15.1:0/3855856426 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720400b910 con 0x7f7204003910 2023-11-15T01:36:46.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.974+0000 7f721cc9e700 1 -- 172.21.15.1:0/3855856426 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720400bad0 con 0x7f72180833a0 2023-11-15T01:36:46.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.975+0000 7f721e4a1700 1 --2- 172.21.15.1:0/3855856426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7204004b80 0x7f7204005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.975+0000 7f721dca0700 1 --2- 172.21.15.1:0/3855856426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7204003910 0x7f7204003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.975+0000 7f721d49f700 1 --2- 172.21.15.1:0/3855856426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72180833a0 0x7f7204004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.975+0000 7f721e4a1700 1 -- 172.21.15.1:0/3855856426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72180833a0 msgr2=0x7f7204004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.975+0000 7f721e4a1700 1 --2- 172.21.15.1:0/3855856426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72180833a0 0x7f7204004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.975+0000 7f721e4a1700 1 -- 172.21.15.1:0/3855856426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7204003910 msgr2=0x7f7204003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:46.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.975+0000 7f721e4a1700 1 --2- 172.21.15.1:0/3855856426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7204003910 0x7f7204003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:46.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.975+0000 7f721e4a1700 1 -- 172.21.15.1:0/3855856426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72040033f0 con 0x7f7204004b80 2023-11-15T01:36:46.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.975+0000 7f721e4a1700 1 --2- 172.21.15.1:0/3855856426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7204004b80 0x7f7204005000 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f7218069390 tx=0x7f721000c730).ready entity=mon.0 client_cookie=d87f1acf1f795d0b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:46.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.975+0000 7f721cc9e700 1 -- 172.21.15.1:0/3855856426 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210002030 con 0x7f7204004b80 2023-11-15T01:36:46.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.975+0000 7f721cc9e700 1 -- 172.21.15.1:0/3855856426 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721000cdc0 con 0x7f7204004b80 2023-11-15T01:36:46.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.975+0000 7f721cc9e700 1 -- 172.21.15.1:0/3855856426 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210005d30 con 0x7f7204004b80 2023-11-15T01:36:46.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.976+0000 7f721ff04700 1 -- 172.21.15.1:0/3855856426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7204004b80 msgr2=0x7f7204005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:46.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.976+0000 7f721ff04700 1 --2- 172.21.15.1:0/3855856426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7204004b80 0x7f7204005000 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f7218069390 tx=0x7f721000c730).stop 2023-11-15T01:36:46.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.976+0000 7f721e4a1700 1 -- 172.21.15.1:0/3855856426 reap_dead start 2023-11-15T01:36:46.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.976+0000 7f721ff04700 1 -- 172.21.15.1:0/3855856426 shutdown_connections 2023-11-15T01:36:46.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.976+0000 7f721ff04700 1 -- 172.21.15.1:0/3855856426 >> 172.21.15.1:0/3855856426 conn(0x7f7218082f90 msgr2=0x7f72180c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:46.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.976+0000 7f721ff04700 1 -- 172.21.15.1:0/3855856426 shutdown_connections 2023-11-15T01:36:46.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.976+0000 7f721ff04700 1 -- 172.21.15.1:0/3855856426 wait complete. 2023-11-15T01:36:46.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.977+0000 7f721ff04700 1 Processor -- start 2023-11-15T01:36:46.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.977+0000 7f721ff04700 1 -- start start 2023-11-15T01:36:46.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721ff04700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7204004b80 0x7f72181651e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:46.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721ff04700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72180acad0 0x7f7218149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:46.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721ff04700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72180a6c90 0x7f72180a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:46.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721ff04700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72180aa410 con 0x7f7204004b80 2023-11-15T01:36:46.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721ff04700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72180a75c0 con 0x7f72180a6c90 2023-11-15T01:36:46.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721ff04700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72180a9de0 con 0x7f72180acad0 2023-11-15T01:36:46.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721dca0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7204004b80 0x7f72181651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:46.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721dca0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7204004b80 0x7f72181651e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35470/0 (socket says 172.21.15.1:35470) 2023-11-15T01:36:46.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721dca0700 1 -- 172.21.15.1:0/82152912 learned_addr learned my addr 172.21.15.1:0/82152912 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:46.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721e4a1700 1 --2- 172.21.15.1:0/82152912 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72180a6c90 0x7f72180a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:46.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721d49f700 1 --2- 172.21.15.1:0/82152912 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72180acad0 0x7f7218149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:46.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721dca0700 1 -- 172.21.15.1:0/82152912 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72180acad0 msgr2=0x7f7218149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:46.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721dca0700 1 --2- 172.21.15.1:0/82152912 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72180acad0 0x7f7218149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:46.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721dca0700 1 -- 172.21.15.1:0/82152912 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72180a6c90 msgr2=0x7f72180a70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:46.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721dca0700 1 --2- 172.21.15.1:0/82152912 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72180a6c90 0x7f72180a70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:46.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721dca0700 1 -- 172.21.15.1:0/82152912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72180ad2e0 con 0x7f7204004b80 2023-11-15T01:36:46.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721d49f700 1 --2- 172.21.15.1:0/82152912 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72180acad0 0x7f7218149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:46.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721dca0700 1 --2- 172.21.15.1:0/82152912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7204004b80 0x7f72181651e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f72140028b0 tx=0x7f7214007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:46.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f720dffb700 1 -- 172.21.15.1:0/82152912 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214007240 con 0x7f7204004b80 2023-11-15T01:36:46.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f720dffb700 1 -- 172.21.15.1:0/82152912 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72140073a0 con 0x7f7204004b80 2023-11-15T01:36:46.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f721ff04700 1 -- 172.21.15.1:0/82152912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72180ad5c0 con 0x7f7204004b80 2023-11-15T01:36:46.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.978+0000 7f720dffb700 1 -- 172.21.15.1:0/82152912 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72140066f0 con 0x7f7204004b80 2023-11-15T01:36:46.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.979+0000 7f721ff04700 1 -- 172.21.15.1:0/82152912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721814a200 con 0x7f7204004b80 2023-11-15T01:36:46.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.980+0000 7f721ff04700 1 -- 172.21.15.1:0/82152912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72180aa6f0 con 0x7f7204004b80 2023-11-15T01:36:46.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.980+0000 7f720dffb700 1 -- 172.21.15.1:0/82152912 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7214006a60 con 0x7f7204004b80 2023-11-15T01:36:46.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.980+0000 7f720dffb700 1 --2- 172.21.15.1:0/82152912 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71fc05f270 0x7f71fc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:46.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.980+0000 7f720dffb700 1 -- 172.21.15.1:0/82152912 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6252+0+0 (secure 0 0 0) 0x7f721407a6a0 con 0x7f7204004b80 2023-11-15T01:36:46.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.981+0000 7f721d49f700 1 --2- 172.21.15.1:0/82152912 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71fc05f270 0x7f71fc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:46.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.981+0000 7f721d49f700 1 --2- 172.21.15.1:0/82152912 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71fc05f270 0x7f71fc061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7208006d30 tx=0x7f7208008040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:46.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:46.984+0000 7f720dffb700 1 -- 172.21.15.1:0/82152912 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f721404b710 con 0x7f7204004b80 2023-11-15T01:36:47.153 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:36:47.155 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:36:47.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:47.226+0000 7f721ff04700 1 -- 172.21.15.1:0/82152912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f721806c7e0 con 0x7f7204004b80 2023-11-15T01:36:47.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:47.831+0000 7f720dffb700 1 -- 172.21.15.1:0/82152912 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v551) v1 ==== 169+0+0 (secure 0 0 0) 0x7f721404ed30 con 0x7f7204004b80 2023-11-15T01:36:47.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:47.833+0000 7f721ff04700 1 -- 172.21.15.1:0/82152912 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71fc05f270 msgr2=0x7f71fc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:47.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:47.833+0000 7f721ff04700 1 --2- 172.21.15.1:0/82152912 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71fc05f270 0x7f71fc061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7208006d30 tx=0x7f7208008040).stop 2023-11-15T01:36:47.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:47.833+0000 7f721ff04700 1 -- 172.21.15.1:0/82152912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7204004b80 msgr2=0x7f72181651e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:47.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:47.833+0000 7f721ff04700 1 --2- 172.21.15.1:0/82152912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7204004b80 0x7f72181651e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f72140028b0 tx=0x7f7214007c00).stop 2023-11-15T01:36:47.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:47.833+0000 7f721ff04700 1 -- 172.21.15.1:0/82152912 shutdown_connections 2023-11-15T01:36:47.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:47.833+0000 7f721ff04700 1 --2- 172.21.15.1:0/82152912 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71fc05f270 0x7f71fc061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:47.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:47.833+0000 7f721ff04700 1 --2- 172.21.15.1:0/82152912 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72180a6c90 0x7f72180a70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:47.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:47.833+0000 7f721ff04700 1 --2- 172.21.15.1:0/82152912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7204004b80 0x7f72181651e0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:47.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:47.833+0000 7f721ff04700 1 --2- 172.21.15.1:0/82152912 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72180acad0 0x7f7218149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:47.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:47.833+0000 7f721ff04700 1 -- 172.21.15.1:0/82152912 >> 172.21.15.1:0/82152912 conn(0x7f7218082f90 msgr2=0x7f72180c3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:47.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:47.833+0000 7f721ff04700 1 -- 172.21.15.1:0/82152912 shutdown_connections 2023-11-15T01:36:47.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:47.833+0000 7f721ff04700 1 -- 172.21.15.1:0/82152912 wait complete. 2023-11-15T01:36:47.848 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-15T01:36:48.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.012+0000 7f9d53325700 1 Processor -- start 2023-11-15T01:36:48.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.012+0000 7f9d53325700 1 -- start start 2023-11-15T01:36:48.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d53325700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d4c0bcbf0 0x7f9d4c062910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d53325700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4c0c5480 con 0x7f9d4c14e960 2023-11-15T01:36:48.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d53325700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4c0636e0 con 0x7f9d4c062e00 2023-11-15T01:36:48.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d53325700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c0639c0 con 0x7f9d4c0bcbf0 2023-11-15T01:36:48.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d510c1700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9d4c14e960 0x7f9d4c0bc4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39180/0 (socket says 172.21.15.1:39180) 2023-11-15T01:36:48.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d510c1700 1 -- 172.21.15.1:0/601412260 learned_addr learned my addr 172.21.15.1:0/601412260 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:48.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d508c0700 1 --2- 172.21.15.1:0/601412260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d4c0bcbf0 0x7f9d4c062910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949968024 0 0) 0x7f9d4c0c5480 con 0x7f9d4c14e960 2023-11-15T01:36:48.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d340033f0 con 0x7f9d4c14e960 2023-11-15T01:36:48.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331567828 0 0) 0x7f9d4c0636e0 con 0x7f9d4c062e00 2023-11-15T01:36:48.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d4c0c5480 con 0x7f9d4c062e00 2023-11-15T01:36:48.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4056555140 0 0) 0x7f9d340033f0 con 0x7f9d4c14e960 2023-11-15T01:36:48.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d4c0bcbf0 msgr2=0x7f9d4c062910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:48.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d4bfff700 1 --2- 172.21.15.1:0/601412260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d4c0bcbf0 0x7f9d4c062910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 >> v1:172.21.15.141:6789/0 conn(0x7f9d4c062e00 legacy=0x7f9d4c0c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c063ca0 con 0x7f9d4c14e960 2023-11-15T01:36:48.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f9d440017f0 con 0x7f9d4c14e960 2023-11-15T01:36:48.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 >> v1:172.21.15.1:6789/0 conn(0x7f9d4c14e960 legacy=0x7f9d4c0bc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d4bfff700 1 --2- 172.21.15.1:0/601412260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d34003aa0 0x7f9d34003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d4bfff700 1 --2- 172.21.15.1:0/601412260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d34004690 0x7f9d34004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.013+0000 7f9d4bfff700 1 --2- 172.21.15.1:0/601412260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d4c0bcbf0 0x7f9d34005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.014+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c0639c0 con 0x7f9d34004690 2023-11-15T01:36:48.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.014+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3400b990 con 0x7f9d34003aa0 2023-11-15T01:36:48.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.014+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3400bb20 con 0x7f9d4c0bcbf0 2023-11-15T01:36:48.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.014+0000 7f9d508c0700 1 --2- 172.21.15.1:0/601412260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d34004690 0x7f9d34004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.014+0000 7f9d510c1700 1 --2- 172.21.15.1:0/601412260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d34003aa0 0x7f9d34003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.014+0000 7f9d518c2700 1 --2- 172.21.15.1:0/601412260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d4c0bcbf0 0x7f9d34005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.014+0000 7f9d508c0700 1 -- 172.21.15.1:0/601412260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d4c0bcbf0 msgr2=0x7f9d34005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:48.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.014+0000 7f9d508c0700 1 --2- 172.21.15.1:0/601412260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d4c0bcbf0 0x7f9d34005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.014+0000 7f9d508c0700 1 -- 172.21.15.1:0/601412260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d34003aa0 msgr2=0x7f9d34003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:48.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.014+0000 7f9d508c0700 1 --2- 172.21.15.1:0/601412260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d34003aa0 0x7f9d34003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.014+0000 7f9d508c0700 1 -- 172.21.15.1:0/601412260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d340033f0 con 0x7f9d34004690 2023-11-15T01:36:48.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.014+0000 7f9d508c0700 1 --2- 172.21.15.1:0/601412260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d34004690 0x7f9d34004b10 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f9d40009a80 tx=0x7f9d40009060).ready entity=mon.0 client_cookie=e41c844107ef39e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:48.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.014+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40009430 con 0x7f9d34004690 2023-11-15T01:36:48.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.014+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4000e640 con 0x7f9d34004690 2023-11-15T01:36:48.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.014+0000 7f9d4bfff700 1 -- 172.21.15.1:0/601412260 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4000e9c0 con 0x7f9d34004690 2023-11-15T01:36:48.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.015+0000 7f9d53325700 1 -- 172.21.15.1:0/601412260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d34004690 msgr2=0x7f9d34004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.015+0000 7f9d53325700 1 --2- 172.21.15.1:0/601412260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d34004690 0x7f9d34004b10 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f9d40009a80 tx=0x7f9d40009060).stop 2023-11-15T01:36:48.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.015+0000 7f9d518c2700 1 -- 172.21.15.1:0/601412260 reap_dead start 2023-11-15T01:36:48.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.015+0000 7f9d53325700 1 -- 172.21.15.1:0/601412260 shutdown_connections 2023-11-15T01:36:48.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.015+0000 7f9d53325700 1 -- 172.21.15.1:0/601412260 >> 172.21.15.1:0/601412260 conn(0x7f9d4c0c8050 msgr2=0x7f9d4c0c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:48.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.015+0000 7f9d53325700 1 -- 172.21.15.1:0/601412260 shutdown_connections 2023-11-15T01:36:48.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.015+0000 7f9d53325700 1 -- 172.21.15.1:0/601412260 wait complete. 2023-11-15T01:36:48.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.016+0000 7f9d53325700 1 Processor -- start 2023-11-15T01:36:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.016+0000 7f9d53325700 1 -- start start 2023-11-15T01:36:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d53325700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d34004690 0x7f9d4c136630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d53325700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d4c15a930 0x7f9d4c165480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d53325700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d4c165970 0x7f9d4c165dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d53325700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c1665d0 con 0x7f9d34004690 2023-11-15T01:36:48.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d53325700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c137e10 con 0x7f9d4c165970 2023-11-15T01:36:48.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d53325700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c15ae70 con 0x7f9d4c15a930 2023-11-15T01:36:48.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d510c1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d34004690 0x7f9d4c136630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d510c1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d34004690 0x7f9d4c136630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57912/0 (socket says 172.21.15.1:57912) 2023-11-15T01:36:48.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d510c1700 1 -- 172.21.15.1:0/3578725472 learned_addr learned my addr 172.21.15.1:0/3578725472 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:48.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d508c0700 1 --2- 172.21.15.1:0/3578725472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d4c15a930 0x7f9d4c165480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d518c2700 1 --2- 172.21.15.1:0/3578725472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d4c165970 0x7f9d4c165dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d510c1700 1 -- 172.21.15.1:0/3578725472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d4c15a930 msgr2=0x7f9d4c165480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d510c1700 1 --2- 172.21.15.1:0/3578725472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d4c15a930 0x7f9d4c165480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d510c1700 1 -- 172.21.15.1:0/3578725472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d4c165970 msgr2=0x7f9d4c165dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d510c1700 1 --2- 172.21.15.1:0/3578725472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d4c165970 0x7f9d4c165dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d510c1700 1 -- 172.21.15.1:0/3578725472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c15b150 con 0x7f9d34004690 2023-11-15T01:36:48.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.017+0000 7f9d510c1700 1 --2- 172.21.15.1:0/3578725472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d34004690 0x7f9d4c136630 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f9d44007740 tx=0x7f9d44007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:48.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.018+0000 7f9d497fa700 1 -- 172.21.15.1:0/3578725472 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400f8d0 con 0x7f9d34004690 2023-11-15T01:36:48.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.018+0000 7f9d497fa700 1 -- 172.21.15.1:0/3578725472 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4400fa30 con 0x7f9d34004690 2023-11-15T01:36:48.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.018+0000 7f9d53325700 1 -- 172.21.15.1:0/3578725472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4c15b430 con 0x7f9d34004690 2023-11-15T01:36:48.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.018+0000 7f9d497fa700 1 -- 172.21.15.1:0/3578725472 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400fdb0 con 0x7f9d34004690 2023-11-15T01:36:48.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.018+0000 7f9d53325700 1 -- 172.21.15.1:0/3578725472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4c1662c0 con 0x7f9d34004690 2023-11-15T01:36:48.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.019+0000 7f9d53325700 1 -- 172.21.15.1:0/3578725472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4c06c7e0 con 0x7f9d34004690 2023-11-15T01:36:48.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.019+0000 7f9d497fa700 1 -- 172.21.15.1:0/3578725472 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9d44012560 con 0x7f9d34004690 2023-11-15T01:36:48.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.019+0000 7f9d497fa700 1 --2- 172.21.15.1:0/3578725472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d3805f270 0x7f9d38061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.020+0000 7f9d497fa700 1 -- 172.21.15.1:0/3578725472 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6252+0+0 (secure 0 0 0) 0x7f9d44079ef0 con 0x7f9d34004690 2023-11-15T01:36:48.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.020+0000 7f9d508c0700 1 --2- 172.21.15.1:0/3578725472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d3805f270 0x7f9d38061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.020+0000 7f9d508c0700 1 --2- 172.21.15.1:0/3578725472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d3805f270 0x7f9d38061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9d4c13a500 tx=0x7f9d4001a000).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:48.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.024+0000 7f9d497fa700 1 -- 172.21.15.1:0/3578725472 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9d4404b010 con 0x7f9d34004690 2023-11-15T01:36:48.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.199+0000 7f9d53325700 1 -- 172.21.15.1:0/3578725472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9d4c063f80 con 0x7f9d34004690 2023-11-15T01:36:48.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.202+0000 7f9d497fa700 1 -- 172.21.15.1:0/3578725472 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9d44019020 con 0x7f9d34004690 2023-11-15T01:36:48.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.204+0000 7f9d53325700 1 -- 172.21.15.1:0/3578725472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d3805f270 msgr2=0x7f9d38061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.204+0000 7f9d53325700 1 --2- 172.21.15.1:0/3578725472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d3805f270 0x7f9d38061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9d4c13a500 tx=0x7f9d4001a000).stop 2023-11-15T01:36:48.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.204+0000 7f9d53325700 1 -- 172.21.15.1:0/3578725472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d34004690 msgr2=0x7f9d4c136630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.204+0000 7f9d53325700 1 --2- 172.21.15.1:0/3578725472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d34004690 0x7f9d4c136630 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f9d44007740 tx=0x7f9d44007f40).stop 2023-11-15T01:36:48.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.204+0000 7f9d53325700 1 -- 172.21.15.1:0/3578725472 shutdown_connections 2023-11-15T01:36:48.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.204+0000 7f9d53325700 1 --2- 172.21.15.1:0/3578725472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d3805f270 0x7f9d38061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.204+0000 7f9d53325700 1 --2- 172.21.15.1:0/3578725472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d4c165970 0x7f9d4c165dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.204+0000 7f9d53325700 1 --2- 172.21.15.1:0/3578725472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d34004690 0x7f9d4c136630 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.204+0000 7f9d53325700 1 --2- 172.21.15.1:0/3578725472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d4c15a930 0x7f9d4c165480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.204+0000 7f9d53325700 1 -- 172.21.15.1:0/3578725472 >> 172.21.15.1:0/3578725472 conn(0x7f9d4c0c8050 msgr2=0x7f9d4c0a4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:48.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.204+0000 7f9d53325700 1 -- 172.21.15.1:0/3578725472 shutdown_connections 2023-11-15T01:36:48.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.204+0000 7f9d53325700 1 -- 172.21.15.1:0/3578725472 wait complete. 2023-11-15T01:36:48.217 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T01:36:48.217 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:36:48.257 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:36:48.307 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T01:36:48.307 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-15T01:36:48.308 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:36:48.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.424+0000 7f772c2a2700 1 Processor -- start 2023-11-15T01:36:48.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.424+0000 7f772c2a2700 1 -- start start 2023-11-15T01:36:48.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.425+0000 7f772c2a2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77240ab1a0 0x7f7724154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.425+0000 7f772c2a2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f77240aa060 0x7f77240c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.425+0000 7f772c2a2700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77240c06f0 con 0x7f7724154150 2023-11-15T01:36:48.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.425+0000 7f772c2a2700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77240c09d0 con 0x7f77240aa060 2023-11-15T01:36:48.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.425+0000 7f772c2a2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7724158820 con 0x7f77240ab1a0 2023-11-15T01:36:48.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.425+0000 7f772a83f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f77240aa060 0x7f77240c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.425+0000 7f772a03e700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7724154150 0x7f7724158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39182/0 (socket says 172.21.15.1:39182) 2023-11-15T01:36:48.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.425+0000 7f772a03e700 1 -- 172.21.15.1:0/2033164849 learned_addr learned my addr 172.21.15.1:0/2033164849 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:48.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.425+0000 7f772a83f700 1 -- 172.21.15.1:0/2033164849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77240ab1a0 msgr2=0x7f7724154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:48.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.425+0000 7f772a83f700 1 --2- 172.21.15.1:0/2033164849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77240ab1a0 0x7f7724154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:48.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.425+0000 7f772a83f700 1 -- 172.21.15.1:0/2033164849 >> v1:172.21.15.1:6789/0 conn(0x7f7724154150 legacy=0x7f7724158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.425+0000 7f772a83f700 1 -- 172.21.15.1:0/2033164849 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7724158b00 con 0x7f77240aa060 2023-11-15T01:36:48.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.425+0000 7f772903c700 1 -- 172.21.15.1:0/2033164849 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303689467 0 0) 0x7f77240c06f0 con 0x7f7724154150 2023-11-15T01:36:48.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.426+0000 7f772a83f700 1 --2- 172.21.15.1:0/2033164849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77240aa060 0x7f77240c5f10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f7714009e60 tx=0x7f7714009780).ready entity=mon.0 client_cookie=1278ddb930696c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:48.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.426+0000 7f772903c700 1 -- 172.21.15.1:0/2033164849 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771400e070 con 0x7f77240aa060 2023-11-15T01:36:48.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.426+0000 7f772903c700 1 -- 172.21.15.1:0/2033164849 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771400bc30 con 0x7f77240aa060 2023-11-15T01:36:48.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.426+0000 7f772903c700 1 -- 172.21.15.1:0/2033164849 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7714012410 con 0x7f77240aa060 2023-11-15T01:36:48.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.426+0000 7f772c2a2700 1 -- 172.21.15.1:0/2033164849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77240aa060 msgr2=0x7f77240c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.426+0000 7f772c2a2700 1 --2- 172.21.15.1:0/2033164849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77240aa060 0x7f77240c5f10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f7714009e60 tx=0x7f7714009780).stop 2023-11-15T01:36:48.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.426+0000 7f772c2a2700 1 -- 172.21.15.1:0/2033164849 shutdown_connections 2023-11-15T01:36:48.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.426+0000 7f772c2a2700 1 --2- 172.21.15.1:0/2033164849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77240aa060 0x7f77240c5f10 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.426+0000 7f772c2a2700 1 --2- 172.21.15.1:0/2033164849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77240ab1a0 0x7f7724154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:48.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.426+0000 7f772c2a2700 1 -- 172.21.15.1:0/2033164849 >> 172.21.15.1:0/2033164849 conn(0x7f7724064aa0 msgr2=0x7f7724064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:48.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.426+0000 7f772c2a2700 1 -- 172.21.15.1:0/2033164849 shutdown_connections 2023-11-15T01:36:48.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.426+0000 7f772c2a2700 1 -- 172.21.15.1:0/2033164849 wait complete. 2023-11-15T01:36:48.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.427+0000 7f772c2a2700 1 Processor -- start 2023-11-15T01:36:48.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.427+0000 7f772c2a2700 1 -- start start 2023-11-15T01:36:48.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.428+0000 7f772c2a2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77240aa060 0x7f77240c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.428+0000 7f772c2a2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77240ab1a0 0x7f7724163bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.428+0000 7f772c2a2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7724154150 0x7f77240c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.428+0000 7f772c2a2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7724154bd0 con 0x7f77240aa060 2023-11-15T01:36:48.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.428+0000 7f772c2a2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7724155750 con 0x7f77240ab1a0 2023-11-15T01:36:48.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.428+0000 7f772c2a2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77241640b0 con 0x7f7724154150 2023-11-15T01:36:48.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.428+0000 7f772a03e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77240aa060 0x7f77240c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.428+0000 7f772a03e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77240aa060 0x7f77240c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57926/0 (socket says 172.21.15.1:57926) 2023-11-15T01:36:48.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.428+0000 7f772a03e700 1 -- 172.21.15.1:0/484872974 learned_addr learned my addr 172.21.15.1:0/484872974 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:48.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.428+0000 7f772a83f700 1 --2- 172.21.15.1:0/484872974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7724154150 0x7f77240c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.428+0000 7f772983d700 1 --2- 172.21.15.1:0/484872974 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77240ab1a0 0x7f7724163bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.429+0000 7f772a03e700 1 -- 172.21.15.1:0/484872974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7724154150 msgr2=0x7f77240c4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.429+0000 7f772a03e700 1 --2- 172.21.15.1:0/484872974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7724154150 0x7f77240c4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.429+0000 7f772a03e700 1 -- 172.21.15.1:0/484872974 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77240ab1a0 msgr2=0x7f7724163bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.429+0000 7f772a03e700 1 --2- 172.21.15.1:0/484872974 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77240ab1a0 0x7f7724163bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.429+0000 7f772a03e700 1 -- 172.21.15.1:0/484872974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7714009a20 con 0x7f77240aa060 2023-11-15T01:36:48.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.429+0000 7f772a03e700 1 --2- 172.21.15.1:0/484872974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77240aa060 0x7f77240c91b0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f771c001eb0 tx=0x7f771c007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:48.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.429+0000 7f77227fc700 1 -- 172.21.15.1:0/484872974 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c0072e0 con 0x7f77240aa060 2023-11-15T01:36:48.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.429+0000 7f77227fc700 1 -- 172.21.15.1:0/484872974 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771c007440 con 0x7f77240aa060 2023-11-15T01:36:48.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.429+0000 7f772c2a2700 1 -- 172.21.15.1:0/484872974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7724154e20 con 0x7f77240aa060 2023-11-15T01:36:48.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.429+0000 7f77227fc700 1 -- 172.21.15.1:0/484872974 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c0057a0 con 0x7f77240aa060 2023-11-15T01:36:48.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.429+0000 7f772c2a2700 1 -- 172.21.15.1:0/484872974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77241553e0 con 0x7f77240aa060 2023-11-15T01:36:48.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.430+0000 7f772c2a2700 1 -- 172.21.15.1:0/484872974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772406c7e0 con 0x7f77240aa060 2023-11-15T01:36:48.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.430+0000 7f77227fc700 1 -- 172.21.15.1:0/484872974 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f771c005b90 con 0x7f77240aa060 2023-11-15T01:36:48.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.431+0000 7f77227fc700 1 --2- 172.21.15.1:0/484872974 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f771005f2a0 0x7f7710061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.431+0000 7f77227fc700 1 -- 172.21.15.1:0/484872974 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6252+0+0 (secure 0 0 0) 0x7f771c079c50 con 0x7f77240aa060 2023-11-15T01:36:48.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.431+0000 7f772983d700 1 --2- 172.21.15.1:0/484872974 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f771005f2a0 0x7f7710061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.431+0000 7f772983d700 1 --2- 172.21.15.1:0/484872974 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f771005f2a0 0x7f7710061760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7724154b60 tx=0x7f7718008040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:48.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.435+0000 7f77227fc700 1 -- 172.21.15.1:0/484872974 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f771c04ad20 con 0x7f77240aa060 2023-11-15T01:36:48.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.650+0000 7f772c2a2700 1 -- 172.21.15.1:0/484872974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7724158de0 con 0x7f77240aa060 2023-11-15T01:36:48.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.651+0000 7f77227fc700 1 -- 172.21.15.1:0/484872974 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f771c018030 con 0x7f77240aa060 2023-11-15T01:36:48.653 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:48.653 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5453,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/246517652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":246517652},{"type":"v1","addr":"172.21.15.141:6836","nonce":246517652}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5857,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3341576602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3341576602},{"type":"v1","addr":"172.21.15.141:6837","nonce":3341576602}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2509339424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2509339424},{"type":"v1","addr":"172.21.15.1:6834","nonce":2509339424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6627,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1634556207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1634556207},{"type":"v1","addr":"172.21.15.1:6835","nonce":1634556207}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[]} 2023-11-15T01:36:48.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.653+0000 7f772c2a2700 1 -- 172.21.15.1:0/484872974 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f771005f2a0 msgr2=0x7f7710061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.653+0000 7f772c2a2700 1 --2- 172.21.15.1:0/484872974 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f771005f2a0 0x7f7710061760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7724154b60 tx=0x7f7718008040).stop 2023-11-15T01:36:48.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.653+0000 7f772c2a2700 1 -- 172.21.15.1:0/484872974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77240aa060 msgr2=0x7f77240c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.653+0000 7f772c2a2700 1 --2- 172.21.15.1:0/484872974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77240aa060 0x7f77240c91b0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f771c001eb0 tx=0x7f771c007e90).stop 2023-11-15T01:36:48.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.653+0000 7f772c2a2700 1 -- 172.21.15.1:0/484872974 shutdown_connections 2023-11-15T01:36:48.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.653+0000 7f772c2a2700 1 --2- 172.21.15.1:0/484872974 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f771005f2a0 0x7f7710061760 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.653+0000 7f772c2a2700 1 --2- 172.21.15.1:0/484872974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7724154150 0x7f77240c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.653+0000 7f772c2a2700 1 --2- 172.21.15.1:0/484872974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77240aa060 0x7f77240c91b0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.653+0000 7f772c2a2700 1 --2- 172.21.15.1:0/484872974 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77240ab1a0 0x7f7724163bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.653+0000 7f772c2a2700 1 -- 172.21.15.1:0/484872974 >> 172.21.15.1:0/484872974 conn(0x7f7724064aa0 msgr2=0x7f77240c5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:48.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.653+0000 7f772c2a2700 1 -- 172.21.15.1:0/484872974 shutdown_connections 2023-11-15T01:36:48.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.653+0000 7f772c2a2700 1 -- 172.21.15.1:0/484872974 wait complete. 2023-11-15T01:36:48.657 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 33 2023-11-15T01:36:48.666 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-15T01:36:48.666 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-15T01:36:48.667 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-15T01:36:48.667 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:36:48.667 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-15T01:36:48.668 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-15T01:36:48.668 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-15T01:36:48.668 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:36:48.668 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-15T01:36:48.669 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-15T01:36:48.669 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-15T01:36:48.669 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:36:48.669 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-15T01:36:48.670 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-15T01:36:48.670 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-15T01:36:48.670 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:36:48.677 INFO:tasks.ceph.mds.a:Stopped 2023-11-15T01:36:48.678 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-15T01:36:48.678 INFO:tasks.ceph.mds.c:Stopped 2023-11-15T01:36:48.679 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-15T01:36:48.680 INFO:tasks.ceph.mds.b:Stopped 2023-11-15T01:36:48.680 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-15T01:36:48.681 INFO:tasks.ceph.mds.d:Stopped 2023-11-15T01:36:48.681 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-15T01:36:48.719 INFO:tasks.ceph.mds.a:Started 2023-11-15T01:36:48.719 DEBUG:teuthology.parallel:result is None 2023-11-15T01:36:48.720 INFO:tasks.ceph.mds.c:Started 2023-11-15T01:36:48.720 DEBUG:teuthology.parallel:result is None 2023-11-15T01:36:48.722 INFO:tasks.ceph.mds.b:Started 2023-11-15T01:36:48.723 DEBUG:teuthology.parallel:result is None 2023-11-15T01:36:48.723 INFO:tasks.ceph.mds.d:Started 2023-11-15T01:36:48.724 DEBUG:teuthology.parallel:result is None 2023-11-15T01:36:48.724 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-15T01:36:48.794 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-11-15T01:36:48.795 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T01:36:48.806 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-15T01:36:48.806 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T01:36:48.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.852+0000 7f971e4d2700 1 Processor -- start 2023-11-15T01:36:48.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.852+0000 7f971e4d2700 1 -- start start 2023-11-15T01:36:48.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.852+0000 7f971e4d2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9718154250 0x7f9718154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f971e4d2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97180c6110 0x7f97180c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f971e4d2700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9718158ff0 con 0x7f97180a9ff0 2023-11-15T01:36:48.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f971e4d2700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9718158100 con 0x7f9718154250 2023-11-15T01:36:48.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f971e4d2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97181583e0 con 0x7f97180c6110 2023-11-15T01:36:48.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f9717fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9718154250 0x7f9718154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f9717fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9718154250 0x7f9718154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57958/0 (socket says 172.21.15.1:57958) 2023-11-15T01:36:48.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f9717fff700 1 -- 172.21.15.1:0/2875506020 learned_addr learned my addr 172.21.15.1:0/2875506020 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:48.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f97177fe700 1 --2- 172.21.15.1:0/2875506020 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97180c6110 0x7f97180c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f9717fff700 1 -- 172.21.15.1:0/2875506020 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97180c6110 msgr2=0x7f97180c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:48.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f9717fff700 1 --2- 172.21.15.1:0/2875506020 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97180c6110 0x7f97180c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f9717fff700 1 -- 172.21.15.1:0/2875506020 >> v1:172.21.15.141:6789/0 conn(0x7f97180a9ff0 legacy=0x7f9718063510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f9716ffd700 1 -- 172.21.15.1:0/2875506020 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895227727 0 0) 0x7f9718158ff0 con 0x7f97180a9ff0 2023-11-15T01:36:48.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f9717fff700 1 -- 172.21.15.1:0/2875506020 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97181586c0 con 0x7f9718154250 2023-11-15T01:36:48.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f9717fff700 1 --2- 172.21.15.1:0/2875506020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9718154250 0x7f9718154630 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f9708006fd0 tx=0x7f97080090f0).ready entity=mon.0 client_cookie=caaa35522e7fc013 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:48.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f9716ffd700 1 -- 172.21.15.1:0/2875506020 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970800b580 con 0x7f9718154250 2023-11-15T01:36:48.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f9716ffd700 1 -- 172.21.15.1:0/2875506020 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970800b6e0 con 0x7f9718154250 2023-11-15T01:36:48.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.853+0000 7f9716ffd700 1 -- 172.21.15.1:0/2875506020 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970800ba60 con 0x7f9718154250 2023-11-15T01:36:48.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.854+0000 7f971e4d2700 1 -- 172.21.15.1:0/2875506020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9718154250 msgr2=0x7f9718154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.854+0000 7f971e4d2700 1 --2- 172.21.15.1:0/2875506020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9718154250 0x7f9718154630 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f9708006fd0 tx=0x7f97080090f0).stop 2023-11-15T01:36:48.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.854+0000 7f971e4d2700 1 -- 172.21.15.1:0/2875506020 shutdown_connections 2023-11-15T01:36:48.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.854+0000 7f971e4d2700 1 --2- 172.21.15.1:0/2875506020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9718154250 0x7f9718154630 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.854+0000 7f971e4d2700 1 --2- 172.21.15.1:0/2875506020 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97180c6110 0x7f97180c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.854+0000 7f971e4d2700 1 -- 172.21.15.1:0/2875506020 >> 172.21.15.1:0/2875506020 conn(0x7f97180c7b20 msgr2=0x7f97180c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:48.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.854+0000 7f971e4d2700 1 -- 172.21.15.1:0/2875506020 shutdown_connections 2023-11-15T01:36:48.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.854+0000 7f971e4d2700 1 -- 172.21.15.1:0/2875506020 wait complete. 2023-11-15T01:36:48.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.855+0000 7f971e4d2700 1 Processor -- start 2023-11-15T01:36:48.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.855+0000 7f971e4d2700 1 -- start start 2023-11-15T01:36:48.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f971e4d2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97180a9ff0 0x7f9718153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f971e4d2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97180c6110 0x7f97180c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f971e4d2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9718154250 0x7f971814cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f971e4d2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97180c3ab0 con 0x7f97180a9ff0 2023-11-15T01:36:48.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f971e4d2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97180c48e0 con 0x7f9718154250 2023-11-15T01:36:48.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f971e4d2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97180c4d70 con 0x7f97180c6110 2023-11-15T01:36:48.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f9717fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97180a9ff0 0x7f9718153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f9717fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97180a9ff0 0x7f9718153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57974/0 (socket says 172.21.15.1:57974) 2023-11-15T01:36:48.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f9717fff700 1 -- 172.21.15.1:0/2538810420 learned_addr learned my addr 172.21.15.1:0/2538810420 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:48.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f971ca6f700 1 --2- 172.21.15.1:0/2538810420 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9718154250 0x7f971814cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f97177fe700 1 --2- 172.21.15.1:0/2538810420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97180c6110 0x7f97180c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f9717fff700 1 -- 172.21.15.1:0/2538810420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97180c6110 msgr2=0x7f97180c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f9717fff700 1 --2- 172.21.15.1:0/2538810420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97180c6110 0x7f97180c35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f9717fff700 1 -- 172.21.15.1:0/2538810420 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9718154250 msgr2=0x7f971814cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:48.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f9717fff700 1 --2- 172.21.15.1:0/2538810420 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9718154250 0x7f971814cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:48.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.856+0000 7f9717fff700 1 -- 172.21.15.1:0/2538810420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9708009370 con 0x7f97180a9ff0 2023-11-15T01:36:48.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.857+0000 7f9717fff700 1 --2- 172.21.15.1:0/2538810420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97180a9ff0 0x7f9718153190 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f9708009fd0 tx=0x7f9708017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:48.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.857+0000 7f96fffff700 1 -- 172.21.15.1:0/2538810420 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708000bc0 con 0x7f97180a9ff0 2023-11-15T01:36:48.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.857+0000 7f96fffff700 1 -- 172.21.15.1:0/2538810420 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970800b850 con 0x7f97180a9ff0 2023-11-15T01:36:48.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.857+0000 7f971e4d2700 1 -- 172.21.15.1:0/2538810420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97180c3cd0 con 0x7f97180a9ff0 2023-11-15T01:36:48.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.857+0000 7f96fffff700 1 -- 172.21.15.1:0/2538810420 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708000d20 con 0x7f97180a9ff0 2023-11-15T01:36:48.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.857+0000 7f971e4d2700 1 -- 172.21.15.1:0/2538810420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97180c4290 con 0x7f97180a9ff0 2023-11-15T01:36:48.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.858+0000 7f971e4d2700 1 -- 172.21.15.1:0/2538810420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971806c7e0 con 0x7f97180a9ff0 2023-11-15T01:36:48.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.858+0000 7f96fffff700 1 -- 172.21.15.1:0/2538810420 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f970801bb00 con 0x7f97180a9ff0 2023-11-15T01:36:48.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.858+0000 7f96fffff700 1 --2- 172.21.15.1:0/2538810420 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f970405f270 0x7f9704061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:48.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.858+0000 7f96fffff700 1 -- 172.21.15.1:0/2538810420 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6252+0+0 (secure 0 0 0) 0x7f970807bd70 con 0x7f97180a9ff0 2023-11-15T01:36:48.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.859+0000 7f97177fe700 1 --2- 172.21.15.1:0/2538810420 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f970405f270 0x7f9704061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:48.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.859+0000 7f97177fe700 1 --2- 172.21.15.1:0/2538810420 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f970405f270 0x7f9704061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f971814e200 tx=0x7f970c009060).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:48.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:48.863+0000 7f96fffff700 1 -- 172.21.15.1:0/2538810420 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f970804ce40 con 0x7f97180a9ff0 2023-11-15T01:36:49.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.050+0000 7f971e4d2700 1 -- 172.21.15.1:0/2538810420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f97181589a0 con 0x7f97180a9ff0 2023-11-15T01:36:49.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.848+0000 7f96fffff700 1 -- 172.21.15.1:0/2538810420 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v90) v1 ==== 97+0+0 (secure 0 0 0) 0x7f970801bdb0 con 0x7f97180a9ff0 2023-11-15T01:36:49.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.850+0000 7f971e4d2700 1 -- 172.21.15.1:0/2538810420 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f970405f270 msgr2=0x7f9704061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:49.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.850+0000 7f971e4d2700 1 --2- 172.21.15.1:0/2538810420 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f970405f270 0x7f9704061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f971814e200 tx=0x7f970c009060).stop 2023-11-15T01:36:49.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.850+0000 7f971e4d2700 1 -- 172.21.15.1:0/2538810420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97180a9ff0 msgr2=0x7f9718153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:49.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.850+0000 7f971e4d2700 1 --2- 172.21.15.1:0/2538810420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97180a9ff0 0x7f9718153190 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f9708009fd0 tx=0x7f9708017000).stop 2023-11-15T01:36:49.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.850+0000 7f971e4d2700 1 -- 172.21.15.1:0/2538810420 shutdown_connections 2023-11-15T01:36:49.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.850+0000 7f971e4d2700 1 --2- 172.21.15.1:0/2538810420 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f970405f270 0x7f9704061730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:49.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.850+0000 7f971e4d2700 1 --2- 172.21.15.1:0/2538810420 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9718154250 0x7f971814cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:49.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.850+0000 7f971e4d2700 1 --2- 172.21.15.1:0/2538810420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97180a9ff0 0x7f9718153190 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:49.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.850+0000 7f971e4d2700 1 --2- 172.21.15.1:0/2538810420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97180c6110 0x7f97180c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:49.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.850+0000 7f971e4d2700 1 -- 172.21.15.1:0/2538810420 >> 172.21.15.1:0/2538810420 conn(0x7f97180c7b20 msgr2=0x7f9718063b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:49.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.851+0000 7f971e4d2700 1 -- 172.21.15.1:0/2538810420 shutdown_connections 2023-11-15T01:36:49.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.851+0000 7f971e4d2700 1 -- 172.21.15.1:0/2538810420 wait complete. 2023-11-15T01:36:49.855 INFO:teuthology.orchestra.run.smithi001.stderr: removed all blocklist entries 2023-11-15T01:36:49.866 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-15T01:36:49.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.987+0000 7f86cf074700 1 Processor -- start 2023-11-15T01:36:49.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.987+0000 7f86cf074700 1 -- start start 2023-11-15T01:36:49.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.988+0000 7f86cf074700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86c8155530 0x7f86c80c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:49.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.988+0000 7f86cf074700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f86c80c98b0 0x7f86c80c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:49.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.988+0000 7f86cf074700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c80c7980 con 0x7f86c8151e10 2023-11-15T01:36:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.988+0000 7f86cf074700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c80ca210 con 0x7f86c80c98b0 2023-11-15T01:36:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.988+0000 7f86cf074700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80aa890 con 0x7f86c8155530 2023-11-15T01:36:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.988+0000 7f86ce873700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f86c80c98b0 0x7f86c80c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.988+0000 7f86ce873700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f86c80c98b0 0x7f86c80c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57990/0 (socket says 172.21.15.1:57990) 2023-11-15T01:36:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.988+0000 7f86ce873700 1 -- 172.21.15.1:0/1819062970 learned_addr learned my addr 172.21.15.1:0/1819062970 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:49.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.988+0000 7f86cd871700 1 --2- 172.21.15.1:0/1819062970 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86c8155530 0x7f86c80c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:49.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.988+0000 7f86ce873700 1 -- 172.21.15.1:0/1819062970 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86c8155530 msgr2=0x7f86c80c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:49.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.988+0000 7f86ce873700 1 --2- 172.21.15.1:0/1819062970 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86c8155530 0x7f86c80c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:49.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.988+0000 7f86ce873700 1 -- 172.21.15.1:0/1819062970 >> v1:172.21.15.141:6789/0 conn(0x7f86c8151e10 legacy=0x7f86c80aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:49.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.988+0000 7f86ce873700 1 -- 172.21.15.1:0/1819062970 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c80c7bd0 con 0x7f86c80c98b0 2023-11-15T01:36:49.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.988+0000 7f86cd070700 1 -- 172.21.15.1:0/1819062970 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491153168 0 0) 0x7f86c80c7980 con 0x7f86c8151e10 2023-11-15T01:36:49.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.989+0000 7f86ce873700 1 --2- 172.21.15.1:0/1819062970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c80c98b0 0x7f86c80c9d20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f86b8006fd0 tx=0x7f86b80090f0).ready entity=mon.0 client_cookie=d8d6b82e0e543635 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:49.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.989+0000 7f86cd070700 1 -- 172.21.15.1:0/1819062970 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b800b580 con 0x7f86c80c98b0 2023-11-15T01:36:49.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.989+0000 7f86cd070700 1 -- 172.21.15.1:0/1819062970 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b800b6e0 con 0x7f86c80c98b0 2023-11-15T01:36:49.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.989+0000 7f86cd070700 1 -- 172.21.15.1:0/1819062970 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b800ba60 con 0x7f86c80c98b0 2023-11-15T01:36:49.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.989+0000 7f86cf074700 1 -- 172.21.15.1:0/1819062970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c80c98b0 msgr2=0x7f86c80c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:49.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.989+0000 7f86cf074700 1 --2- 172.21.15.1:0/1819062970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c80c98b0 0x7f86c80c9d20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f86b8006fd0 tx=0x7f86b80090f0).stop 2023-11-15T01:36:49.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.989+0000 7f86cf074700 1 -- 172.21.15.1:0/1819062970 shutdown_connections 2023-11-15T01:36:49.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.989+0000 7f86cf074700 1 --2- 172.21.15.1:0/1819062970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c80c98b0 0x7f86c80c9d20 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.989+0000 7f86cf074700 1 --2- 172.21.15.1:0/1819062970 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86c8155530 0x7f86c80c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.989+0000 7f86cf074700 1 -- 172.21.15.1:0/1819062970 >> 172.21.15.1:0/1819062970 conn(0x7f86c80947e0 msgr2=0x7f86c806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.989+0000 7f86cf074700 1 -- 172.21.15.1:0/1819062970 shutdown_connections 2023-11-15T01:36:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.989+0000 7f86cf074700 1 -- 172.21.15.1:0/1819062970 wait complete. 2023-11-15T01:36:49.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.990+0000 7f86cf074700 1 Processor -- start 2023-11-15T01:36:49.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.991+0000 7f86cf074700 1 -- start start 2023-11-15T01:36:50.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.991+0000 7f86cf074700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86c80c98b0 0x7f86c814ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.991+0000 7f86cf074700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8151e10 0x7f86c8157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.991+0000 7f86cf074700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86c8155530 0x7f86c81583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.991+0000 7f86cf074700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c8159640 con 0x7f86c8151e10 2023-11-15T01:36:50.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.991+0000 7f86cf074700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80ac370 con 0x7f86c8155530 2023-11-15T01:36:50.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.991+0000 7f86cf074700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c81671c0 con 0x7f86c80c98b0 2023-11-15T01:36:50.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.991+0000 7f86cd871700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8151e10 0x7f86c8157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.991+0000 7f86cd871700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8151e10 0x7f86c8157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58000/0 (socket says 172.21.15.1:58000) 2023-11-15T01:36:50.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.991+0000 7f86cd871700 1 -- 172.21.15.1:0/2171891081 learned_addr learned my addr 172.21.15.1:0/2171891081 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:50.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.992+0000 7f86ce072700 1 --2- 172.21.15.1:0/2171891081 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86c80c98b0 0x7f86c814ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.992+0000 7f86ce873700 1 --2- 172.21.15.1:0/2171891081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86c8155530 0x7f86c81583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.992+0000 7f86cd871700 1 -- 172.21.15.1:0/2171891081 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86c80c98b0 msgr2=0x7f86c814ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.992+0000 7f86cd871700 1 --2- 172.21.15.1:0/2171891081 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86c80c98b0 0x7f86c814ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.992+0000 7f86cd871700 1 -- 172.21.15.1:0/2171891081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86c8155530 msgr2=0x7f86c81583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.992+0000 7f86cd871700 1 --2- 172.21.15.1:0/2171891081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86c8155530 0x7f86c81583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.992+0000 7f86cd871700 1 -- 172.21.15.1:0/2171891081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b8009370 con 0x7f86c8151e10 2023-11-15T01:36:50.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.992+0000 7f86cd871700 1 --2- 172.21.15.1:0/2171891081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8151e10 0x7f86c8157ec0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f86bc00e900 tx=0x7f86bc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:50.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.992+0000 7f86c67fc700 1 -- 172.21.15.1:0/2171891081 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc00c640 con 0x7f86c8151e10 2023-11-15T01:36:50.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.992+0000 7f86c67fc700 1 -- 172.21.15.1:0/2171891081 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc00c7a0 con 0x7f86c8151e10 2023-11-15T01:36:50.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.992+0000 7f86cf074700 1 -- 172.21.15.1:0/2171891081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c8158a30 con 0x7f86c8151e10 2023-11-15T01:36:50.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.992+0000 7f86c67fc700 1 -- 172.21.15.1:0/2171891081 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc00cb20 con 0x7f86c8151e10 2023-11-15T01:36:50.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.992+0000 7f86cf074700 1 -- 172.21.15.1:0/2171891081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c8158ff0 con 0x7f86c8151e10 2023-11-15T01:36:50.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.993+0000 7f86cf074700 1 -- 172.21.15.1:0/2171891081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c80ac4e0 con 0x7f86c8151e10 2023-11-15T01:36:50.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.993+0000 7f86c67fc700 1 -- 172.21.15.1:0/2171891081 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f86bc01b400 con 0x7f86c8151e10 2023-11-15T01:36:50.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.994+0000 7f86c67fc700 1 --2- 172.21.15.1:0/2171891081 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f86b405f270 0x7f86b4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.994+0000 7f86c67fc700 1 -- 172.21.15.1:0/2171891081 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5693+0+0 (secure 0 0 0) 0x7f86bc07a6f0 con 0x7f86c8151e10 2023-11-15T01:36:50.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.994+0000 7f86ce072700 1 --2- 172.21.15.1:0/2171891081 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f86b405f270 0x7f86b4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.994+0000 7f86ce072700 1 --2- 172.21.15.1:0/2171891081 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f86b405f270 0x7f86b4061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f86c0001560 tx=0x7f86c0009040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:50.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:49.998+0000 7f86c67fc700 1 -- 172.21.15.1:0/2171891081 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f86c80ac4e0 con 0x7f86c8151e10 2023-11-15T01:36:50.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.238+0000 7f86cf074700 1 -- 172.21.15.1:0/2171891081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f86c80ac4e0 con 0x7f86c8151e10 2023-11-15T01:36:50.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.238+0000 7f86c67fc700 1 -- 172.21.15.1:0/2171891081 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f86c80ac4e0 con 0x7f86c8151e10 2023-11-15T01:36:50.240 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:50.240 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T01:36:50.241 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_dump": [ 2023-11-15T01:36:50.241 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.241 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.a", 2023-11-15T01:36:50.241 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlmtf5GBAA2CojasXoquGQ9L5rKjVwTQ==", 2023-11-15T01:36:50.242 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.242 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:50.242 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:36:50.242 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:36:50.243 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:50.243 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.243 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.243 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.243 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.b", 2023-11-15T01:36:50.244 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl/Y5mJBAAz7iLl3kBJ8kSsyTetTZByw==", 2023-11-15T01:36:50.244 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.244 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:50.244 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:36:50.245 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:36:50.245 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:50.245 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.245 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.246 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.246 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.c", 2023-11-15T01:36:50.246 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlWTrwHxAAqLVpwNca0vAXUBFnWUN3pg==", 2023-11-15T01:36:50.246 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.247 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:50.247 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:36:50.247 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:36:50.247 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:50.247 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.248 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.248 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.248 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.d", 2023-11-15T01:36:50.248 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlVwUnKxAAhx2/mX1ljgQwJLagVpmZIA==", 2023-11-15T01:36:50.249 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.249 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:50.249 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:36:50.249 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:36:50.250 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:50.250 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.250 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.250 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.251 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.0", 2023-11-15T01:36:50.251 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDxHFRlII6rERAA/kvPPhTPHHy6pu5wSPsR/A==", 2023-11-15T01:36:50.251 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.251 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:50.251 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:50.252 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:50.252 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.252 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.252 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.252 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.1", 2023-11-15T01:36:50.253 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD0HFRlPkstEBAAqx31fnNonRCVh98eY6qbxQ==", 2023-11-15T01:36:50.253 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.253 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:50.253 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:50.253 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:50.254 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.254 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.254 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.254 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.2", 2023-11-15T01:36:50.255 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD3HFRl8e3nDRAAKigcbIo0/BFo0Qi6rV+amQ==", 2023-11-15T01:36:50.255 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.255 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:50.255 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:50.255 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:50.256 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.256 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.256 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.256 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.3", 2023-11-15T01:36:50.256 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD6HFRlbwDTCxAAkWv04RyNqW4p8pOqvYCS3A==", 2023-11-15T01:36:50.257 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.257 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:50.257 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:50.257 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:50.257 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.258 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.258 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.258 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.4", 2023-11-15T01:36:50.258 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAAHVRlTQihDxAA/HcZbSytP9qD5PsTjvJBoA==", 2023-11-15T01:36:50.259 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.259 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:50.259 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:50.259 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:50.260 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.260 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.260 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.260 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.5", 2023-11-15T01:36:50.260 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQADHVRlQ2hjDRAAFiI+hKubCPcZ/1AJVu1fvQ==", 2023-11-15T01:36:50.261 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.261 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:50.261 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:50.261 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:50.262 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.262 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.262 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.262 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.6", 2023-11-15T01:36:50.263 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAGHVRl/KEbCxAAmKTnRU4m4qNzX+SVcFY+Qw==", 2023-11-15T01:36:50.263 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.263 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:50.263 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:50.263 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:50.264 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.264 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.264 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.264 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.7", 2023-11-15T01:36:50.265 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAJHVRl4wOFCBAAAiGT4UPE5vSb2LjqgGgGFw==", 2023-11-15T01:36:50.265 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.265 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:36:50.265 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:36:50.266 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:50.266 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.266 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.266 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.267 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.0", 2023-11-15T01:36:50.267 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl2hkHLxAAxQE/Cslig6gmXR/xcVlRuw==", 2023-11-15T01:36:50.267 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.267 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:50.267 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow r", 2023-11-15T01:36:50.268 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-15T01:36:50.268 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.268 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.268 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.269 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.1", 2023-11-15T01:36:50.269 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRltolkNxAAXmQ4yXOlavwqKq2jFKwsYQ==", 2023-11-15T01:36:50.269 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.269 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:50.270 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:36:50.270 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:36:50.270 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:36:50.270 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.270 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.271 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.271 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.2", 2023-11-15T01:36:50.271 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlFrJvNBAAH97x7ERzuzpWrUALO+HvpA==", 2023-11-15T01:36:50.271 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.272 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:50.272 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:36:50.272 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:36:50.272 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:36:50.273 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.273 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.273 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.273 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.3", 2023-11-15T01:36:50.273 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDwHFRlko0ZARAA2RqeRJGwWns00DeWgd/9hA==", 2023-11-15T01:36:50.274 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.274 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:36:50.274 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:36:50.274 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:36:50.275 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:36:50.275 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.275 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.275 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.275 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.admin", 2023-11-15T01:36:50.276 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDuHFRlxIQDORAALrVIyQoaVSADkyv9yzMaZw==", 2023-11-15T01:36:50.276 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.276 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:36:50.276 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:36:50.276 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:36:50.277 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:50.277 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.277 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.277 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.277 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.x", 2023-11-15T01:36:50.278 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlnyjlFRAAjJwtxkAvJ0ZGmvOOawQseQ==", 2023-11-15T01:36:50.278 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.278 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:36:50.278 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T01:36:50.279 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:50.279 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.279 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:50.279 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:50.279 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.y", 2023-11-15T01:36:50.280 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl8nW3ERAA4CJQt/ZEZCJ9UaRRuEHfzw==", 2023-11-15T01:36:50.280 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:36:50.280 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:36:50.280 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T01:36:50.280 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:36:50.281 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.281 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:50.281 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2023-11-15T01:36:50.281 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T01:36:50.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.240+0000 7f86cf074700 1 -- 172.21.15.1:0/2171891081 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f86b405f270 msgr2=0x7f86b4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.240+0000 7f86cf074700 1 --2- 172.21.15.1:0/2171891081 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f86b405f270 0x7f86b4061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f86c0001560 tx=0x7f86c0009040).stop 2023-11-15T01:36:50.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.240+0000 7f86cf074700 1 -- 172.21.15.1:0/2171891081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8151e10 msgr2=0x7f86c8157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.240+0000 7f86cf074700 1 --2- 172.21.15.1:0/2171891081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8151e10 0x7f86c8157ec0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f86bc00e900 tx=0x7f86bc009060).stop 2023-11-15T01:36:50.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.240+0000 7f86cf074700 1 -- 172.21.15.1:0/2171891081 shutdown_connections 2023-11-15T01:36:50.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.240+0000 7f86cf074700 1 --2- 172.21.15.1:0/2171891081 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f86b405f270 0x7f86b4061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.240+0000 7f86cf074700 1 --2- 172.21.15.1:0/2171891081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86c8155530 0x7f86c81583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.240+0000 7f86cf074700 1 --2- 172.21.15.1:0/2171891081 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86c80c98b0 0x7f86c814ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.240+0000 7f86cf074700 1 --2- 172.21.15.1:0/2171891081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8151e10 0x7f86c8157ec0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.240+0000 7f86cf074700 1 -- 172.21.15.1:0/2171891081 >> 172.21.15.1:0/2171891081 conn(0x7f86c80947e0 msgr2=0x7f86c8064840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.240+0000 7f86cf074700 1 -- 172.21.15.1:0/2171891081 shutdown_connections 2023-11-15T01:36:50.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.240+0000 7f86cf074700 1 -- 172.21.15.1:0/2171891081 wait complete. 2023-11-15T01:36:50.286 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:36:50.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.403+0000 7f8914b2d700 1 Processor -- start 2023-11-15T01:36:50.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.403+0000 7f8914b2d700 1 -- start start 2023-11-15T01:36:50.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.404+0000 7f8914b2d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f89100c6620 0x7f8910154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.404+0000 7f8914b2d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89100c06f0 con 0x7f89100ab1a0 2023-11-15T01:36:50.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.404+0000 7f8914b2d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89100c09d0 con 0x7f8910154150 2023-11-15T01:36:50.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.404+0000 7f8914b2d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8910158820 con 0x7f89100c6620 2023-11-15T01:36:50.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.404+0000 7f890dd9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f89100ab1a0 0x7f89100c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39204/0 (socket says 172.21.15.1:39204) 2023-11-15T01:36:50.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.404+0000 7f890dd9b700 1 -- 172.21.15.1:0/1792466248 learned_addr learned my addr 172.21.15.1:0/1792466248 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:50.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.404+0000 7f890ed9d700 1 --2- 172.21.15.1:0/1792466248 >> v2:172.21.15.141:3300/0 conn(0x7f89100c6620 0x7f8910154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.405+0000 7f890d59a700 1 -- 172.21.15.1:0/1792466248 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073109482 0 0) 0x7f89100c06f0 con 0x7f89100ab1a0 2023-11-15T01:36:50.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.405+0000 7f890d59a700 1 -- 172.21.15.1:0/1792466248 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88fc0033f0 con 0x7f89100ab1a0 2023-11-15T01:36:50.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.405+0000 7f890ed9d700 1 -- 172.21.15.1:0/1792466248 >> v1:172.21.15.141:6789/0 conn(0x7f8910154150 legacy=0x7f8910158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.405+0000 7f890ed9d700 1 -- 172.21.15.1:0/1792466248 >> v1:172.21.15.1:6789/0 conn(0x7f89100ab1a0 legacy=0x7f89100c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.405+0000 7f890ed9d700 1 -- 172.21.15.1:0/1792466248 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8910158b00 con 0x7f89100c6620 2023-11-15T01:36:50.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.405+0000 7f890ed9d700 1 --2- 172.21.15.1:0/1792466248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f89100c6620 0x7f8910154530 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f8908009760 tx=0x7f8908009060).ready entity=mon.1 client_cookie=201c5f7bcd10706f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:50.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.405+0000 7f890d59a700 1 -- 172.21.15.1:0/1792466248 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89080090d0 con 0x7f89100c6620 2023-11-15T01:36:50.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.405+0000 7f890d59a700 1 -- 172.21.15.1:0/1792466248 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890800f510 con 0x7f89100c6620 2023-11-15T01:36:50.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.405+0000 7f890d59a700 1 -- 172.21.15.1:0/1792466248 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890800f890 con 0x7f89100c6620 2023-11-15T01:36:50.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.405+0000 7f8914b2d700 1 -- 172.21.15.1:0/1792466248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f89100c6620 msgr2=0x7f8910154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.405+0000 7f8914b2d700 1 --2- 172.21.15.1:0/1792466248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f89100c6620 0x7f8910154530 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f8908009760 tx=0x7f8908009060).stop 2023-11-15T01:36:50.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.406+0000 7f8914b2d700 1 -- 172.21.15.1:0/1792466248 shutdown_connections 2023-11-15T01:36:50.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.406+0000 7f8914b2d700 1 --2- 172.21.15.1:0/1792466248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f89100c6620 0x7f8910154530 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.406+0000 7f8914b2d700 1 -- 172.21.15.1:0/1792466248 >> 172.21.15.1:0/1792466248 conn(0x7f8910064aa0 msgr2=0x7f8910064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:50.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.406+0000 7f8914b2d700 1 -- 172.21.15.1:0/1792466248 shutdown_connections 2023-11-15T01:36:50.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.406+0000 7f8914b2d700 1 -- 172.21.15.1:0/1792466248 wait complete. 2023-11-15T01:36:50.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.407+0000 7f8914b2d700 1 Processor -- start 2023-11-15T01:36:50.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.407+0000 7f8914b2d700 1 -- start start 2023-11-15T01:36:50.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.407+0000 7f8914b2d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f89100ab1a0 0x7f89100aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.407+0000 7f8914b2d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89100c6620 0x7f89100af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.407+0000 7f8914b2d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8910154150 0x7f8910146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.407+0000 7f8914b2d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89100af170 con 0x7f89100c6620 2023-11-15T01:36:50.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.407+0000 7f8914b2d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8910155280 con 0x7f89100ab1a0 2023-11-15T01:36:50.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.407+0000 7f8914b2d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89100aee90 con 0x7f8910154150 2023-11-15T01:36:50.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f890dd9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89100c6620 0x7f89100af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f890dd9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89100c6620 0x7f89100af480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58014/0 (socket says 172.21.15.1:58014) 2023-11-15T01:36:50.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f890dd9b700 1 -- 172.21.15.1:0/2717184919 learned_addr learned my addr 172.21.15.1:0/2717184919 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:50.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f890e59c700 1 --2- 172.21.15.1:0/2717184919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f89100ab1a0 0x7f89100aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f890ed9d700 1 --2- 172.21.15.1:0/2717184919 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8910154150 0x7f8910146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f890dd9b700 1 -- 172.21.15.1:0/2717184919 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8910154150 msgr2=0x7f8910146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f890dd9b700 1 --2- 172.21.15.1:0/2717184919 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8910154150 0x7f8910146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f890dd9b700 1 -- 172.21.15.1:0/2717184919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f89100ab1a0 msgr2=0x7f89100aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f890dd9b700 1 --2- 172.21.15.1:0/2717184919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f89100ab1a0 0x7f89100aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f890dd9b700 1 -- 172.21.15.1:0/2717184919 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89080092a0 con 0x7f89100c6620 2023-11-15T01:36:50.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f890dd9b700 1 --2- 172.21.15.1:0/2717184919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89100c6620 0x7f89100af480 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f88f800c590 tx=0x7f88f8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:50.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f89067fc700 1 -- 172.21.15.1:0/2717184919 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f8007e40 con 0x7f89100c6620 2023-11-15T01:36:50.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f89067fc700 1 -- 172.21.15.1:0/2717184919 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f80072e0 con 0x7f89100c6620 2023-11-15T01:36:50.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f89067fc700 1 -- 172.21.15.1:0/2717184919 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f80057a0 con 0x7f89100c6620 2023-11-15T01:36:50.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f8914b2d700 1 -- 172.21.15.1:0/2717184919 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8910154c30 con 0x7f89100c6620 2023-11-15T01:36:50.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.408+0000 7f8914b2d700 1 -- 172.21.15.1:0/2717184919 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89100af970 con 0x7f89100c6620 2023-11-15T01:36:50.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.409+0000 7f8914b2d700 1 -- 172.21.15.1:0/2717184919 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8910155430 con 0x7f89100c6620 2023-11-15T01:36:50.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.409+0000 7f89067fc700 1 -- 172.21.15.1:0/2717184919 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f88f8005b90 con 0x7f89100c6620 2023-11-15T01:36:50.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.410+0000 7f89067fc700 1 --2- 172.21.15.1:0/2717184919 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f88f005f2a0 0x7f88f0061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.410+0000 7f89067fc700 1 -- 172.21.15.1:0/2717184919 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5693+0+0 (secure 0 0 0) 0x7f88f8079ac0 con 0x7f89100c6620 2023-11-15T01:36:50.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.410+0000 7f890e59c700 1 --2- 172.21.15.1:0/2717184919 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f88f005f2a0 0x7f88f0061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.410+0000 7f890e59c700 1 --2- 172.21.15.1:0/2717184919 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f88f005f2a0 0x7f88f0061760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8900003dd0 tx=0x7f8900009040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:50.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.414+0000 7f89067fc700 1 -- 172.21.15.1:0/2717184919 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f88f804ae80 con 0x7f89100c6620 2023-11-15T01:36:50.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.587+0000 7f8914b2d700 1 -- 172.21.15.1:0/2717184919 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f891006c7e0 con 0x7f89100c6620 2023-11-15T01:36:50.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.588+0000 7f89067fc700 1 -- 172.21.15.1:0/2717184919 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+14309 (secure 0 0 0) 0x7f88f804e4a0 con 0x7f89100c6620 2023-11-15T01:36:50.590 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:50.590 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":90,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:36:49.842472+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:36:50.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.590+0000 7f8914b2d700 1 -- 172.21.15.1:0/2717184919 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f88f005f2a0 msgr2=0x7f88f0061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.590+0000 7f8914b2d700 1 --2- 172.21.15.1:0/2717184919 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f88f005f2a0 0x7f88f0061760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8900003dd0 tx=0x7f8900009040).stop 2023-11-15T01:36:50.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.590+0000 7f8914b2d700 1 -- 172.21.15.1:0/2717184919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89100c6620 msgr2=0x7f89100af480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.590+0000 7f8914b2d700 1 --2- 172.21.15.1:0/2717184919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89100c6620 0x7f89100af480 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f88f800c590 tx=0x7f88f8007c80).stop 2023-11-15T01:36:50.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.590+0000 7f8914b2d700 1 -- 172.21.15.1:0/2717184919 shutdown_connections 2023-11-15T01:36:50.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.590+0000 7f8914b2d700 1 --2- 172.21.15.1:0/2717184919 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f88f005f2a0 0x7f88f0061760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.590+0000 7f8914b2d700 1 --2- 172.21.15.1:0/2717184919 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8910154150 0x7f8910146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.590+0000 7f8914b2d700 1 --2- 172.21.15.1:0/2717184919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f89100ab1a0 0x7f89100aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.590+0000 7f8914b2d700 1 --2- 172.21.15.1:0/2717184919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89100c6620 0x7f89100af480 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.590+0000 7f8914b2d700 1 -- 172.21.15.1:0/2717184919 >> 172.21.15.1:0/2717184919 conn(0x7f8910064aa0 msgr2=0x7f89100c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:50.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.590+0000 7f8914b2d700 1 -- 172.21.15.1:0/2717184919 shutdown_connections 2023-11-15T01:36:50.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.590+0000 7f8914b2d700 1 -- 172.21.15.1:0/2717184919 wait complete. 2023-11-15T01:36:50.603 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-15T01:36:50.604 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:36:50.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.724+0000 7f3201bc0700 1 Processor -- start 2023-11-15T01:36:50.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.724+0000 7f3201bc0700 1 -- start start 2023-11-15T01:36:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.725+0000 7f3201bc0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31fc137030 0x7f31fc137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.725+0000 7f3201bc0700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f31fc066f80 0x7f31fc14e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.725+0000 7f3201bc0700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31fc154ce0 con 0x7f31fc1588e0 2023-11-15T01:36:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.725+0000 7f3201bc0700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31fc137900 con 0x7f31fc066f80 2023-11-15T01:36:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.725+0000 7f3201bc0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc154fc0 con 0x7f31fc137030 2023-11-15T01:36:50.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.725+0000 7f31faffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f31fc1588e0 0x7f31fc066870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39218/0 (socket says 172.21.15.1:39218) 2023-11-15T01:36:50.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.725+0000 7f31faffd700 1 -- 172.21.15.1:0/103347498 learned_addr learned my addr 172.21.15.1:0/103347498 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:50.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.725+0000 7f31fb7fe700 1 --2- 172.21.15.1:0/103347498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31fc137030 0x7f31fc137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.725+0000 7f31fbfff700 1 --2- 172.21.15.1:0/103347498 >> v2:172.21.15.141:3300/0 conn(0x7f31fc066f80 0x7f31fc14e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 -- 172.21.15.1:0/103347498 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615724732 0 0) 0x7f31fc154ce0 con 0x7f31fc1588e0 2023-11-15T01:36:50.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 -- 172.21.15.1:0/103347498 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e40033f0 con 0x7f31fc1588e0 2023-11-15T01:36:50.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 -- 172.21.15.1:0/103347498 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 404771430 0 0) 0x7f31e40033f0 con 0x7f31fc1588e0 2023-11-15T01:36:50.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 -- 172.21.15.1:0/103347498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31fc137030 msgr2=0x7f31fc137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:50.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 --2- 172.21.15.1:0/103347498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31fc137030 0x7f31fc137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 -- 172.21.15.1:0/103347498 >> v2:172.21.15.141:3300/0 conn(0x7f31fc066f80 msgr2=0x7f31fc14e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:50.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 --2- 172.21.15.1:0/103347498 >> v2:172.21.15.141:3300/0 conn(0x7f31fc066f80 0x7f31fc14e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 -- 172.21.15.1:0/103347498 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc1552a0 con 0x7f31fc1588e0 2023-11-15T01:36:50.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 -- 172.21.15.1:0/103347498 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f31f0001490 con 0x7f31fc1588e0 2023-11-15T01:36:50.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 -- 172.21.15.1:0/103347498 >> v1:172.21.15.1:6789/0 conn(0x7f31fc1588e0 legacy=0x7f31fc066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 --2- 172.21.15.1:0/103347498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e40038e0 0x7f31e4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 --2- 172.21.15.1:0/103347498 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31e4004690 0x7f31e4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 --2- 172.21.15.1:0/103347498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31fc137030 0x7f31e4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 -- 172.21.15.1:0/103347498 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc137900 con 0x7f31e40038e0 2023-11-15T01:36:50.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 -- 172.21.15.1:0/103347498 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc154fc0 con 0x7f31e4004690 2023-11-15T01:36:50.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fa7fc700 1 -- 172.21.15.1:0/103347498 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e400b8e0 con 0x7f31fc137030 2023-11-15T01:36:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fb7fe700 1 --2- 172.21.15.1:0/103347498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e40038e0 0x7f31e4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31faffd700 1 --2- 172.21.15.1:0/103347498 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31e4004690 0x7f31e4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fbfff700 1 --2- 172.21.15.1:0/103347498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31fc137030 0x7f31e4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fb7fe700 1 -- 172.21.15.1:0/103347498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31fc137030 msgr2=0x7f31e4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fb7fe700 1 --2- 172.21.15.1:0/103347498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31fc137030 0x7f31e4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fb7fe700 1 -- 172.21.15.1:0/103347498 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31e4004690 msgr2=0x7f31e4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fb7fe700 1 --2- 172.21.15.1:0/103347498 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31e4004690 0x7f31e4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fb7fe700 1 -- 172.21.15.1:0/103347498 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e40033f0 con 0x7f31e40038e0 2023-11-15T01:36:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fbfff700 1 --2- 172.21.15.1:0/103347498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31fc137030 0x7f31e4005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.726+0000 7f31fb7fe700 1 --2- 172.21.15.1:0/103347498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e40038e0 0x7f31e4003d00 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f31ec009a80 tx=0x7f31ec009060).ready entity=mon.0 client_cookie=e12cba637a5242b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.727+0000 7f31fa7fc700 1 -- 172.21.15.1:0/103347498 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec009430 con 0x7f31e40038e0 2023-11-15T01:36:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.727+0000 7f31fa7fc700 1 -- 172.21.15.1:0/103347498 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec00e640 con 0x7f31e40038e0 2023-11-15T01:36:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.727+0000 7f31fa7fc700 1 -- 172.21.15.1:0/103347498 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec00e9c0 con 0x7f31e40038e0 2023-11-15T01:36:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.727+0000 7f3201bc0700 1 -- 172.21.15.1:0/103347498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e40038e0 msgr2=0x7f31e4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.727+0000 7f3201bc0700 1 --2- 172.21.15.1:0/103347498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e40038e0 0x7f31e4003d00 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f31ec009a80 tx=0x7f31ec009060).stop 2023-11-15T01:36:50.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.727+0000 7f31fbfff700 1 -- 172.21.15.1:0/103347498 reap_dead start 2023-11-15T01:36:50.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.727+0000 7f3201bc0700 1 -- 172.21.15.1:0/103347498 shutdown_connections 2023-11-15T01:36:50.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.727+0000 7f3201bc0700 1 -- 172.21.15.1:0/103347498 >> 172.21.15.1:0/103347498 conn(0x7f31fc063280 msgr2=0x7f31fc0c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:50.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.727+0000 7f3201bc0700 1 -- 172.21.15.1:0/103347498 shutdown_connections 2023-11-15T01:36:50.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.727+0000 7f3201bc0700 1 -- 172.21.15.1:0/103347498 wait complete. 2023-11-15T01:36:50.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.728+0000 7f3201bc0700 1 Processor -- start 2023-11-15T01:36:50.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.728+0000 7f3201bc0700 1 -- start start 2023-11-15T01:36:50.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.729+0000 7f3201bc0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31e40038e0 0x7f31fc13a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.729+0000 7f3201bc0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31fc136770 0x7f31fc0c1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.729+0000 7f3201bc0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31fc136bf0 0x7f31fc0c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.729+0000 7f3201bc0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0c2270 con 0x7f31fc136bf0 2023-11-15T01:36:50.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.729+0000 7f3201bc0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0c0ce0 con 0x7f31fc136770 2023-11-15T01:36:50.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.729+0000 7f3201bc0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0c00d0 con 0x7f31e40038e0 2023-11-15T01:36:50.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.729+0000 7f31fbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31fc136bf0 0x7f31fc0c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.729+0000 7f31fbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31fc136bf0 0x7f31fc0c1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58022/0 (socket says 172.21.15.1:58022) 2023-11-15T01:36:50.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.729+0000 7f31fbfff700 1 -- 172.21.15.1:0/2175679920 learned_addr learned my addr 172.21.15.1:0/2175679920 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:50.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.729+0000 7f31faffd700 1 --2- 172.21.15.1:0/2175679920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31fc136770 0x7f31fc0c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.729+0000 7f31fb7fe700 1 --2- 172.21.15.1:0/2175679920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31e40038e0 0x7f31fc13a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.730+0000 7f31fbfff700 1 -- 172.21.15.1:0/2175679920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31e40038e0 msgr2=0x7f31fc13a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.730+0000 7f31fbfff700 1 --2- 172.21.15.1:0/2175679920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31e40038e0 0x7f31fc13a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.730+0000 7f31fbfff700 1 -- 172.21.15.1:0/2175679920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31fc136770 msgr2=0x7f31fc0c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.730+0000 7f31fbfff700 1 --2- 172.21.15.1:0/2175679920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31fc136770 0x7f31fc0c1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.730+0000 7f31fbfff700 1 -- 172.21.15.1:0/2175679920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc0c03b0 con 0x7f31fc136bf0 2023-11-15T01:36:50.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.730+0000 7f31fb7fe700 1 --2- 172.21.15.1:0/2175679920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31e40038e0 0x7f31fc13a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:50.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.730+0000 7f31fbfff700 1 --2- 172.21.15.1:0/2175679920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31fc136bf0 0x7f31fc0c1d80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f31fc068e10 tx=0x7f31f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:50.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.730+0000 7f31e37fe700 1 -- 172.21.15.1:0/2175679920 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f400e030 con 0x7f31fc136bf0 2023-11-15T01:36:50.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.730+0000 7f31e37fe700 1 -- 172.21.15.1:0/2175679920 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f400f040 con 0x7f31fc136bf0 2023-11-15T01:36:50.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.730+0000 7f3201bc0700 1 -- 172.21.15.1:0/2175679920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31fc0c0690 con 0x7f31fc136bf0 2023-11-15T01:36:50.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.730+0000 7f31e37fe700 1 -- 172.21.15.1:0/2175679920 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4010ea0 con 0x7f31fc136bf0 2023-11-15T01:36:50.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.730+0000 7f3201bc0700 1 -- 172.21.15.1:0/2175679920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31fc13a020 con 0x7f31fc136bf0 2023-11-15T01:36:50.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.731+0000 7f3201bc0700 1 -- 172.21.15.1:0/2175679920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31fc13a240 con 0x7f31fc136bf0 2023-11-15T01:36:50.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.731+0000 7f31e37fe700 1 -- 172.21.15.1:0/2175679920 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f31f4015690 con 0x7f31fc136bf0 2023-11-15T01:36:50.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.731+0000 7f31e37fe700 1 --2- 172.21.15.1:0/2175679920 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31e805f270 0x7f31e8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:50.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.732+0000 7f31e37fe700 1 -- 172.21.15.1:0/2175679920 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5693+0+0 (secure 0 0 0) 0x7f31f407a9c0 con 0x7f31fc136bf0 2023-11-15T01:36:50.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.732+0000 7f31fb7fe700 1 --2- 172.21.15.1:0/2175679920 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31e805f270 0x7f31e8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:50.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.732+0000 7f31fb7fe700 1 --2- 172.21.15.1:0/2175679920 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31e805f270 0x7f31e8061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f31fc139b50 tx=0x7f31ec01a000).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:50.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.736+0000 7f31e37fe700 1 -- 172.21.15.1:0/2175679920 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f31fc13a240 con 0x7f31fc136bf0 2023-11-15T01:36:50.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.910+0000 7f3201bc0700 1 -- 172.21.15.1:0/2175679920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f31fc13a240 con 0x7f31fc136bf0 2023-11-15T01:36:50.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.910+0000 7f31e37fe700 1 -- 172.21.15.1:0/2175679920 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v90) v1 ==== 110+0+10 (secure 0 0 0) 0x7f31fc13a240 con 0x7f31fc136bf0 2023-11-15T01:36:50.912 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:36:50.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.912+0000 7f3201bc0700 1 -- 172.21.15.1:0/2175679920 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31e805f270 msgr2=0x7f31e8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.912+0000 7f3201bc0700 1 --2- 172.21.15.1:0/2175679920 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31e805f270 0x7f31e8061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f31fc139b50 tx=0x7f31ec01a000).stop 2023-11-15T01:36:50.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.912+0000 7f3201bc0700 1 -- 172.21.15.1:0/2175679920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31fc136bf0 msgr2=0x7f31fc0c1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:50.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.912+0000 7f3201bc0700 1 --2- 172.21.15.1:0/2175679920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31fc136bf0 0x7f31fc0c1d80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f31fc068e10 tx=0x7f31f400b040).stop 2023-11-15T01:36:50.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.912+0000 7f3201bc0700 1 -- 172.21.15.1:0/2175679920 shutdown_connections 2023-11-15T01:36:50.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.912+0000 7f3201bc0700 1 --2- 172.21.15.1:0/2175679920 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31e805f270 0x7f31e8061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.912+0000 7f3201bc0700 1 --2- 172.21.15.1:0/2175679920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31fc136bf0 0x7f31fc0c1d80 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.912+0000 7f3201bc0700 1 --2- 172.21.15.1:0/2175679920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31e40038e0 0x7f31fc13a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.912+0000 7f3201bc0700 1 --2- 172.21.15.1:0/2175679920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31fc136770 0x7f31fc0c1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:50.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.912+0000 7f3201bc0700 1 -- 172.21.15.1:0/2175679920 >> 172.21.15.1:0/2175679920 conn(0x7f31fc063280 msgr2=0x7f31fc0bf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:50.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.912+0000 7f3201bc0700 1 -- 172.21.15.1:0/2175679920 shutdown_connections 2023-11-15T01:36:50.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:50.912+0000 7f3201bc0700 1 -- 172.21.15.1:0/2175679920 wait complete. 2023-11-15T01:36:50.925 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:36:51.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.044+0000 7f76542a4700 1 Processor -- start 2023-11-15T01:36:51.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.044+0000 7f76542a4700 1 -- start start 2023-11-15T01:36:51.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.045+0000 7f76542a4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f764c137030 0x7f764c137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.045+0000 7f76542a4700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c158d90 con 0x7f764c1588e0 2023-11-15T01:36:51.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.045+0000 7f76542a4700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c154ce0 con 0x7f764c066f80 2023-11-15T01:36:51.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.045+0000 7f76542a4700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764c137900 con 0x7f764c137030 2023-11-15T01:36:51.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.046+0000 7f7652040700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f764c137030 0x7f764c137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.046+0000 7f765183f700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f764c1588e0 0x7f764c066870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39220/0 (socket says 172.21.15.1:39220) 2023-11-15T01:36:51.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.046+0000 7f765183f700 1 -- 172.21.15.1:0/2954157648 learned_addr learned my addr 172.21.15.1:0/2954157648 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:51.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.046+0000 7f7652040700 1 -- 172.21.15.1:0/2954157648 >> v1:172.21.15.141:6789/0 conn(0x7f764c066f80 legacy=0x7f764c14e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.046+0000 7f7652040700 1 -- 172.21.15.1:0/2954157648 >> v1:172.21.15.1:6789/0 conn(0x7f764c1588e0 legacy=0x7f764c066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.046+0000 7f7652040700 1 -- 172.21.15.1:0/2954157648 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c154fc0 con 0x7f764c137030 2023-11-15T01:36:51.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.046+0000 7f765103e700 1 -- 172.21.15.1:0/2954157648 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822581197 0 0) 0x7f764c158d90 con 0x7f764c1588e0 2023-11-15T01:36:51.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.046+0000 7f7652040700 1 --2- 172.21.15.1:0/2954157648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f764c137030 0x7f764c137410 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f7644009e60 tx=0x7f7644009780).ready entity=mon.0 client_cookie=8cf484145e47078e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:51.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.046+0000 7f765103e700 1 -- 172.21.15.1:0/2954157648 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764400e070 con 0x7f764c137030 2023-11-15T01:36:51.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.046+0000 7f765103e700 1 -- 172.21.15.1:0/2954157648 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764400bc30 con 0x7f764c137030 2023-11-15T01:36:51.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.046+0000 7f765103e700 1 -- 172.21.15.1:0/2954157648 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644012410 con 0x7f764c137030 2023-11-15T01:36:51.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.047+0000 7f76542a4700 1 -- 172.21.15.1:0/2954157648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f764c137030 msgr2=0x7f764c137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.047+0000 7f76542a4700 1 --2- 172.21.15.1:0/2954157648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f764c137030 0x7f764c137410 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f7644009e60 tx=0x7f7644009780).stop 2023-11-15T01:36:51.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.047+0000 7f76542a4700 1 -- 172.21.15.1:0/2954157648 shutdown_connections 2023-11-15T01:36:51.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.047+0000 7f76542a4700 1 --2- 172.21.15.1:0/2954157648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f764c137030 0x7f764c137410 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.047+0000 7f76542a4700 1 -- 172.21.15.1:0/2954157648 >> 172.21.15.1:0/2954157648 conn(0x7f764c063280 msgr2=0x7f764c0c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:51.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.047+0000 7f76542a4700 1 -- 172.21.15.1:0/2954157648 shutdown_connections 2023-11-15T01:36:51.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.047+0000 7f76542a4700 1 -- 172.21.15.1:0/2954157648 wait complete. 2023-11-15T01:36:51.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.048+0000 7f76542a4700 1 Processor -- start 2023-11-15T01:36:51.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.048+0000 7f76542a4700 1 -- start start 2023-11-15T01:36:51.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f76542a4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f764c066f80 0x7f764c151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f76542a4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f764c137030 0x7f764c138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f76542a4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f764c1588e0 0x7f764c0be630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f76542a4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c138470 con 0x7f764c1588e0 2023-11-15T01:36:51.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f76542a4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c137e60 con 0x7f764c137030 2023-11-15T01:36:51.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f76542a4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c0adc60 con 0x7f764c066f80 2023-11-15T01:36:51.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f7652841700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f764c1588e0 0x7f764c0be630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f7652841700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f764c1588e0 0x7f764c0be630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58034/0 (socket says 172.21.15.1:58034) 2023-11-15T01:36:51.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f7652841700 1 -- 172.21.15.1:0/354647466 learned_addr learned my addr 172.21.15.1:0/354647466 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:51.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f765183f700 1 --2- 172.21.15.1:0/354647466 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f764c137030 0x7f764c138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f7652040700 1 --2- 172.21.15.1:0/354647466 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f764c066f80 0x7f764c151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f7652841700 1 -- 172.21.15.1:0/354647466 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f764c066f80 msgr2=0x7f764c151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f7652841700 1 --2- 172.21.15.1:0/354647466 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f764c066f80 0x7f764c151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f7652841700 1 -- 172.21.15.1:0/354647466 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f764c137030 msgr2=0x7f764c138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f7652841700 1 --2- 172.21.15.1:0/354647466 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f764c137030 0x7f764c138900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f7652841700 1 -- 172.21.15.1:0/354647466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7644009a20 con 0x7f764c1588e0 2023-11-15T01:36:51.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f7652841700 1 --2- 172.21.15.1:0/354647466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f764c1588e0 0x7f764c0be630 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f763c00c440 tx=0x7f763c007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:51.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f764a7fc700 1 -- 172.21.15.1:0/354647466 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0123f0 con 0x7f764c1588e0 2023-11-15T01:36:51.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f764a7fc700 1 -- 172.21.15.1:0/354647466 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c012550 con 0x7f764c1588e0 2023-11-15T01:36:51.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f764a7fc700 1 -- 172.21.15.1:0/354647466 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0128d0 con 0x7f764c1588e0 2023-11-15T01:36:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.049+0000 7f76542a4700 1 -- 172.21.15.1:0/354647466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764c138100 con 0x7f764c1588e0 2023-11-15T01:36:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.050+0000 7f76542a4700 1 -- 172.21.15.1:0/354647466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764c151500 con 0x7f764c1588e0 2023-11-15T01:36:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.050+0000 7f76542a4700 1 -- 172.21.15.1:0/354647466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764c151720 con 0x7f764c1588e0 2023-11-15T01:36:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.051+0000 7f764a7fc700 1 -- 172.21.15.1:0/354647466 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f763c012cc0 con 0x7f764c1588e0 2023-11-15T01:36:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.051+0000 7f764a7fc700 1 --2- 172.21.15.1:0/354647466 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f763805f240 0x7f7638061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.051+0000 7f764a7fc700 1 -- 172.21.15.1:0/354647466 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5693+0+0 (secure 0 0 0) 0x7f763c0795f0 con 0x7f764c1588e0 2023-11-15T01:36:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.051+0000 7f7652040700 1 --2- 172.21.15.1:0/354647466 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f763805f240 0x7f7638061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.052+0000 7f7652040700 1 --2- 172.21.15.1:0/354647466 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f763805f240 0x7f7638061700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f764400b9f0 tx=0x7f7644009780).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.055+0000 7f764a7fc700 1 -- 172.21.15.1:0/354647466 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f763c047af0 con 0x7f764c1588e0 2023-11-15T01:36:51.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.227+0000 7f76542a4700 1 -- 172.21.15.1:0/354647466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f764c066870 con 0x7f764c1588e0 2023-11-15T01:36:51.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.227+0000 7f764a7fc700 1 -- 172.21.15.1:0/354647466 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v90) v1 ==== 92+0+10 (secure 0 0 0) 0x7f763c04a8f0 con 0x7f764c1588e0 2023-11-15T01:36:51.230 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:36:51.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.229+0000 7f76542a4700 1 -- 172.21.15.1:0/354647466 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f763805f240 msgr2=0x7f7638061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.229+0000 7f76542a4700 1 --2- 172.21.15.1:0/354647466 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f763805f240 0x7f7638061700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f764400b9f0 tx=0x7f7644009780).stop 2023-11-15T01:36:51.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.229+0000 7f76542a4700 1 -- 172.21.15.1:0/354647466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f764c1588e0 msgr2=0x7f764c0be630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.229+0000 7f76542a4700 1 --2- 172.21.15.1:0/354647466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f764c1588e0 0x7f764c0be630 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f763c00c440 tx=0x7f763c007dd0).stop 2023-11-15T01:36:51.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.229+0000 7f76542a4700 1 -- 172.21.15.1:0/354647466 shutdown_connections 2023-11-15T01:36:51.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.229+0000 7f76542a4700 1 --2- 172.21.15.1:0/354647466 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f763805f240 0x7f7638061700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.229+0000 7f76542a4700 1 --2- 172.21.15.1:0/354647466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f764c1588e0 0x7f764c0be630 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.229+0000 7f76542a4700 1 --2- 172.21.15.1:0/354647466 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f764c066f80 0x7f764c151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.229+0000 7f76542a4700 1 --2- 172.21.15.1:0/354647466 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f764c137030 0x7f764c138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.229+0000 7f76542a4700 1 -- 172.21.15.1:0/354647466 >> 172.21.15.1:0/354647466 conn(0x7f764c063280 msgr2=0x7f764c064860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:51.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.229+0000 7f76542a4700 1 -- 172.21.15.1:0/354647466 shutdown_connections 2023-11-15T01:36:51.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.230+0000 7f76542a4700 1 -- 172.21.15.1:0/354647466 wait complete. 2023-11-15T01:36:51.243 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-15T01:36:51.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.360+0000 7f63d6c05700 1 Processor -- start 2023-11-15T01:36:51.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.360+0000 7f63d6c05700 1 -- start start 2023-11-15T01:36:51.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.361+0000 7f63d6c05700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f63d0154150 0x7f63d0154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.361+0000 7f63d6c05700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d00c06f0 con 0x7f63d00aa060 2023-11-15T01:36:51.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.361+0000 7f63d6c05700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d00c09d0 con 0x7f63d00ab1a0 2023-11-15T01:36:51.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.361+0000 7f63d6c05700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d0158820 con 0x7f63d0154150 2023-11-15T01:36:51.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.361+0000 7f63d51a2700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f63d00aa060 0x7f63d00c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39232/0 (socket says 172.21.15.1:39232) 2023-11-15T01:36:51.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.361+0000 7f63d51a2700 1 -- 172.21.15.1:0/2044377576 learned_addr learned my addr 172.21.15.1:0/2044377576 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:51.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.361+0000 7f63d49a1700 1 --2- 172.21.15.1:0/2044377576 >> v2:172.21.15.141:3300/0 conn(0x7f63d0154150 0x7f63d0154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.361+0000 7f63cf7fe700 1 -- 172.21.15.1:0/2044377576 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33132748 0 0) 0x7f63d00c06f0 con 0x7f63d00aa060 2023-11-15T01:36:51.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.361+0000 7f63cf7fe700 1 -- 172.21.15.1:0/2044377576 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63bc0033f0 con 0x7f63d00aa060 2023-11-15T01:36:51.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.361+0000 7f63cf7fe700 1 -- 172.21.15.1:0/2044377576 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 364472443 0 0) 0x7f63bc0033f0 con 0x7f63d00aa060 2023-11-15T01:36:51.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cf7fe700 1 -- 172.21.15.1:0/2044377576 >> v2:172.21.15.141:3300/0 conn(0x7f63d0154150 msgr2=0x7f63d0154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:51.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cf7fe700 1 --2- 172.21.15.1:0/2044377576 >> v2:172.21.15.141:3300/0 conn(0x7f63d0154150 0x7f63d0154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cf7fe700 1 -- 172.21.15.1:0/2044377576 >> v1:172.21.15.141:6789/0 conn(0x7f63d00ab1a0 legacy=0x7f63d0158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cf7fe700 1 -- 172.21.15.1:0/2044377576 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0158b00 con 0x7f63d00aa060 2023-11-15T01:36:51.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cf7fe700 1 -- 172.21.15.1:0/2044377576 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f63b8001470 con 0x7f63d00aa060 2023-11-15T01:36:51.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cf7fe700 1 -- 172.21.15.1:0/2044377576 >> v1:172.21.15.1:6789/0 conn(0x7f63d00aa060 legacy=0x7f63d00c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cf7fe700 1 --2- 172.21.15.1:0/2044377576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63bc0038e0 0x7f63bc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cf7fe700 1 --2- 172.21.15.1:0/2044377576 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63bc004690 0x7f63bc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cf7fe700 1 --2- 172.21.15.1:0/2044377576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63bc005050 0x7f63bc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cf7fe700 1 -- 172.21.15.1:0/2044377576 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0158820 con 0x7f63bc005050 2023-11-15T01:36:51.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cf7fe700 1 -- 172.21.15.1:0/2044377576 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc00bfe0 con 0x7f63bc0038e0 2023-11-15T01:36:51.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cf7fe700 1 -- 172.21.15.1:0/2044377576 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc00c1a0 con 0x7f63bc004690 2023-11-15T01:36:51.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63d51a2700 1 --2- 172.21.15.1:0/2044377576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63bc005050 0x7f63bc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63d49a1700 1 --2- 172.21.15.1:0/2044377576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63bc0038e0 0x7f63bc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cffff700 1 --2- 172.21.15.1:0/2044377576 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63bc004690 0x7f63bc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63d51a2700 1 -- 172.21.15.1:0/2044377576 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63bc004690 msgr2=0x7f63bc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:51.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63d51a2700 1 --2- 172.21.15.1:0/2044377576 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63bc004690 0x7f63bc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63d51a2700 1 -- 172.21.15.1:0/2044377576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63bc0038e0 msgr2=0x7f63bc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:51.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63d51a2700 1 --2- 172.21.15.1:0/2044377576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63bc0038e0 0x7f63bc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63d51a2700 1 -- 172.21.15.1:0/2044377576 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc0033f0 con 0x7f63bc005050 2023-11-15T01:36:51.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63d51a2700 1 -- 172.21.15.1:0/2044377576 reap_dead start 2023-11-15T01:36:51.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63d51a2700 1 --2- 172.21.15.1:0/2044377576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63bc005050 0x7f63bc00b8e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f63b800c160 tx=0x7f63b8001e50).ready entity=mon.0 client_cookie=826188b21926eabc server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:51.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cf7fe700 1 -- 172.21.15.1:0/2044377576 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8007a20 con 0x7f63bc005050 2023-11-15T01:36:51.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cf7fe700 1 -- 172.21.15.1:0/2044377576 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b800ca90 con 0x7f63bc005050 2023-11-15T01:36:51.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.362+0000 7f63cf7fe700 1 -- 172.21.15.1:0/2044377576 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b800ce10 con 0x7f63bc005050 2023-11-15T01:36:51.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.363+0000 7f63d6c05700 1 -- 172.21.15.1:0/2044377576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63bc005050 msgr2=0x7f63bc00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.363+0000 7f63d6c05700 1 --2- 172.21.15.1:0/2044377576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63bc005050 0x7f63bc00b8e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f63b800c160 tx=0x7f63b8001e50).stop 2023-11-15T01:36:51.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.363+0000 7f63d6c05700 1 -- 172.21.15.1:0/2044377576 shutdown_connections 2023-11-15T01:36:51.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.363+0000 7f63d6c05700 1 --2- 172.21.15.1:0/2044377576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63bc005050 0x7f63bc00b8e0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.363+0000 7f63d6c05700 1 -- 172.21.15.1:0/2044377576 >> 172.21.15.1:0/2044377576 conn(0x7f63d0064aa0 msgr2=0x7f63d0064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:51.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.363+0000 7f63d6c05700 1 -- 172.21.15.1:0/2044377576 shutdown_connections 2023-11-15T01:36:51.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.363+0000 7f63d6c05700 1 -- 172.21.15.1:0/2044377576 wait complete. 2023-11-15T01:36:51.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.364+0000 7f63d6c05700 1 Processor -- start 2023-11-15T01:36:51.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.364+0000 7f63d6c05700 1 -- start start 2023-11-15T01:36:51.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d6c05700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63bc005050 0x7f63d0156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d6c05700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63d01547a0 0x7f63d014d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d6c05700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63d0154c20 0x7f63d0149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d6c05700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00ab780 con 0x7f63d0154c20 2023-11-15T01:36:51.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d6c05700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0156990 con 0x7f63bc005050 2023-11-15T01:36:51.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d6c05700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0156c70 con 0x7f63d01547a0 2023-11-15T01:36:51.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d51a2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63d0154c20 0x7f63d0149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d51a2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63d0154c20 0x7f63d0149a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58050/0 (socket says 172.21.15.1:58050) 2023-11-15T01:36:51.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d51a2700 1 -- 172.21.15.1:0/2287574006 learned_addr learned my addr 172.21.15.1:0/2287574006 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:51.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d49a1700 1 --2- 172.21.15.1:0/2287574006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63bc005050 0x7f63d0156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63cffff700 1 --2- 172.21.15.1:0/2287574006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63d01547a0 0x7f63d014d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d51a2700 1 -- 172.21.15.1:0/2287574006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63d01547a0 msgr2=0x7f63d014d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d51a2700 1 --2- 172.21.15.1:0/2287574006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63d01547a0 0x7f63d014d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d51a2700 1 -- 172.21.15.1:0/2287574006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63bc005050 msgr2=0x7f63d0156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d51a2700 1 --2- 172.21.15.1:0/2287574006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63bc005050 0x7f63d0156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d51a2700 1 -- 172.21.15.1:0/2287574006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0156f50 con 0x7f63d0154c20 2023-11-15T01:36:51.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.365+0000 7f63d51a2700 1 --2- 172.21.15.1:0/2287574006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63d0154c20 0x7f63d0149a70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f63b8000c00 tx=0x7f63b8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:51.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.366+0000 7f63ccff9700 1 -- 172.21.15.1:0/2287574006 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8001430 con 0x7f63d0154c20 2023-11-15T01:36:51.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.366+0000 7f63ccff9700 1 -- 172.21.15.1:0/2287574006 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b80048c0 con 0x7f63d0154c20 2023-11-15T01:36:51.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.366+0000 7f63d6c05700 1 -- 172.21.15.1:0/2287574006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d0157230 con 0x7f63d0154c20 2023-11-15T01:36:51.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.366+0000 7f63ccff9700 1 -- 172.21.15.1:0/2287574006 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8004c60 con 0x7f63d0154c20 2023-11-15T01:36:51.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.366+0000 7f63d6c05700 1 -- 172.21.15.1:0/2287574006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d014d960 con 0x7f63d0154c20 2023-11-15T01:36:51.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.367+0000 7f63d6c05700 1 -- 172.21.15.1:0/2287574006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d00ab8f0 con 0x7f63d0154c20 2023-11-15T01:36:51.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.367+0000 7f63ccff9700 1 -- 172.21.15.1:0/2287574006 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f63b8013450 con 0x7f63d0154c20 2023-11-15T01:36:51.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.367+0000 7f63ccff9700 1 --2- 172.21.15.1:0/2287574006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f63b005f270 0x7f63b0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.368+0000 7f63ccff9700 1 -- 172.21.15.1:0/2287574006 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5693+0+0 (secure 0 0 0) 0x7f63b807ade0 con 0x7f63d0154c20 2023-11-15T01:36:51.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.368+0000 7f63d49a1700 1 --2- 172.21.15.1:0/2287574006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f63b005f270 0x7f63b0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.368+0000 7f63d49a1700 1 --2- 172.21.15.1:0/2287574006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f63b005f270 0x7f63b0061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f63d01561f0 tx=0x7f63c8009060).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:51.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.372+0000 7f63ccff9700 1 -- 172.21.15.1:0/2287574006 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f63d00ab8f0 con 0x7f63d0154c20 2023-11-15T01:36:51.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.547+0000 7f63d6c05700 1 -- 172.21.15.1:0/2287574006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f63d006c7e0 con 0x7f63d0154c20 2023-11-15T01:36:51.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.547+0000 7f63ccff9700 1 -- 172.21.15.1:0/2287574006 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v90) v1 ==== 84+0+143 (secure 0 0 0) 0x7f63b8025030 con 0x7f63d0154c20 2023-11-15T01:36:51.549 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:51.550 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T01:36:51.550 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:51.550 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2023-11-15T01:36:51.550 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "device_health_metrics" 2023-11-15T01:36:51.550 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:36:51.551 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:36:51.551 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 2, 2023-11-15T01:36:51.551 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "rbd" 2023-11-15T01:36:51.551 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:36:51.552 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T01:36:51.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.549+0000 7f63d6c05700 1 -- 172.21.15.1:0/2287574006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f63b005f270 msgr2=0x7f63b0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.549+0000 7f63d6c05700 1 --2- 172.21.15.1:0/2287574006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f63b005f270 0x7f63b0061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f63d01561f0 tx=0x7f63c8009060).stop 2023-11-15T01:36:51.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.549+0000 7f63d6c05700 1 -- 172.21.15.1:0/2287574006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63d0154c20 msgr2=0x7f63d0149a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.549+0000 7f63d6c05700 1 --2- 172.21.15.1:0/2287574006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63d0154c20 0x7f63d0149a70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f63b8000c00 tx=0x7f63b8015000).stop 2023-11-15T01:36:51.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.549+0000 7f63d6c05700 1 -- 172.21.15.1:0/2287574006 shutdown_connections 2023-11-15T01:36:51.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.549+0000 7f63d6c05700 1 --2- 172.21.15.1:0/2287574006 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f63b005f270 0x7f63b0061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.549+0000 7f63d6c05700 1 --2- 172.21.15.1:0/2287574006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63d0154c20 0x7f63d0149a70 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.549+0000 7f63d6c05700 1 --2- 172.21.15.1:0/2287574006 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63bc005050 0x7f63d0156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.549+0000 7f63d6c05700 1 --2- 172.21.15.1:0/2287574006 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63d01547a0 0x7f63d014d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.549+0000 7f63d6c05700 1 -- 172.21.15.1:0/2287574006 >> 172.21.15.1:0/2287574006 conn(0x7f63d0064aa0 msgr2=0x7f63d0063460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:51.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.550+0000 7f63d6c05700 1 -- 172.21.15.1:0/2287574006 shutdown_connections 2023-11-15T01:36:51.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.550+0000 7f63d6c05700 1 -- 172.21.15.1:0/2287574006 wait complete. 2023-11-15T01:36:51.563 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-15T01:36:51.563 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-15T01:36:51.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.685+0000 7fe369804700 1 Processor -- start 2023-11-15T01:36:51.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.685+0000 7fe369804700 1 -- start start 2023-11-15T01:36:51.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.686+0000 7fe369804700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe3640ada30 0x7fe3640c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.686+0000 7fe369804700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3640ca400 0x7fe3640c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.686+0000 7fe369804700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe3640c65b0 0x7fe364063510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.686+0000 7fe369804700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe364154850 con 0x7fe3640c65b0 2023-11-15T01:36:51.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.686+0000 7fe369804700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3640caee0 con 0x7fe3640ada30 2023-11-15T01:36:51.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.686+0000 7fe369804700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640ca920 con 0x7fe3640ca400 2023-11-15T01:36:51.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.686+0000 7fe369003700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe3640c65b0 0x7fe364063510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.686+0000 7fe369003700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe3640c65b0 0x7fe364063510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58060/0 (socket says 172.21.15.1:58060) 2023-11-15T01:36:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.686+0000 7fe369003700 1 -- 172.21.15.1:0/4179033993 learned_addr learned my addr 172.21.15.1:0/4179033993 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.686+0000 7fe363fff700 1 --2- 172.21.15.1:0/4179033993 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3640ca400 0x7fe3640c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.686+0000 7fe368802700 1 --2- 172.21.15.1:0/4179033993 >> v2:172.21.15.141:3300/0 conn(0x7fe3640ada30 0x7fe3640c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.687+0000 7fe369003700 1 -- 172.21.15.1:0/4179033993 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3640ca400 msgr2=0x7fe3640c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:51.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.687+0000 7fe369003700 1 --2- 172.21.15.1:0/4179033993 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3640ca400 0x7fe3640c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.687+0000 7fe369003700 1 -- 172.21.15.1:0/4179033993 >> v2:172.21.15.141:3300/0 conn(0x7fe3640ada30 msgr2=0x7fe3640c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:51.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.687+0000 7fe369003700 1 --2- 172.21.15.1:0/4179033993 >> v2:172.21.15.141:3300/0 conn(0x7fe3640ada30 0x7fe3640c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.687+0000 7fe369003700 1 -- 172.21.15.1:0/4179033993 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3640cac00 con 0x7fe3640c65b0 2023-11-15T01:36:51.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.687+0000 7fe369003700 1 --2- 172.21.15.1:0/4179033993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3640c65b0 0x7fe364063510 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7fe3640842d0 tx=0x7fe35c009840).ready entity=mon.0 client_cookie=8628f115bb3582a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:51.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.687+0000 7fe3637fe700 1 -- 172.21.15.1:0/4179033993 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c00e070 con 0x7fe3640c65b0 2023-11-15T01:36:51.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.687+0000 7fe3637fe700 1 -- 172.21.15.1:0/4179033993 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35c00ba20 con 0x7fe3640c65b0 2023-11-15T01:36:51.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.687+0000 7fe3637fe700 1 -- 172.21.15.1:0/4179033993 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c00bda0 con 0x7fe3640c65b0 2023-11-15T01:36:51.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.687+0000 7fe369804700 1 -- 172.21.15.1:0/4179033993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3640c65b0 msgr2=0x7fe364063510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.687+0000 7fe369804700 1 --2- 172.21.15.1:0/4179033993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3640c65b0 0x7fe364063510 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7fe3640842d0 tx=0x7fe35c009840).stop 2023-11-15T01:36:51.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.687+0000 7fe369804700 1 -- 172.21.15.1:0/4179033993 shutdown_connections 2023-11-15T01:36:51.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.687+0000 7fe369804700 1 --2- 172.21.15.1:0/4179033993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3640c65b0 0x7fe364063510 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.687+0000 7fe369804700 1 --2- 172.21.15.1:0/4179033993 >> v2:172.21.15.141:3300/0 conn(0x7fe3640ada30 0x7fe3640c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.687+0000 7fe369804700 1 --2- 172.21.15.1:0/4179033993 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3640ca400 0x7fe3640c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.688+0000 7fe369804700 1 -- 172.21.15.1:0/4179033993 >> 172.21.15.1:0/4179033993 conn(0x7fe364064a60 msgr2=0x7fe364064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:51.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.688+0000 7fe369804700 1 -- 172.21.15.1:0/4179033993 shutdown_connections 2023-11-15T01:36:51.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.688+0000 7fe369804700 1 -- 172.21.15.1:0/4179033993 wait complete. 2023-11-15T01:36:51.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.689+0000 7fe369804700 1 Processor -- start 2023-11-15T01:36:51.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.689+0000 7fe369804700 1 -- start start 2023-11-15T01:36:51.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe369804700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3640ada30 0x7fe3640c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe369804700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3640c65b0 0x7fe3640c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe369804700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3640ca400 0x7fe364149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe369804700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3641594e0 con 0x7fe3640ada30 2023-11-15T01:36:51.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe369804700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640c2a00 con 0x7fe3640ca400 2023-11-15T01:36:51.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe369804700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640c2ce0 con 0x7fe3640c65b0 2023-11-15T01:36:51.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe368802700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3640ada30 0x7fe3640c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe368802700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3640ada30 0x7fe3640c4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58064/0 (socket says 172.21.15.1:58064) 2023-11-15T01:36:51.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe368802700 1 -- 172.21.15.1:0/3029415248 learned_addr learned my addr 172.21.15.1:0/3029415248 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:51.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe363fff700 1 --2- 172.21.15.1:0/3029415248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3640c65b0 0x7fe3640c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe369003700 1 --2- 172.21.15.1:0/3029415248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3640ca400 0x7fe364149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe368802700 1 -- 172.21.15.1:0/3029415248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3640c65b0 msgr2=0x7fe3640c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe368802700 1 --2- 172.21.15.1:0/3029415248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3640c65b0 0x7fe3640c21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe368802700 1 -- 172.21.15.1:0/3029415248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3640ca400 msgr2=0x7fe364149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:51.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe368802700 1 --2- 172.21.15.1:0/3029415248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3640ca400 0x7fe364149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:51.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe368802700 1 -- 172.21.15.1:0/3029415248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c009ae0 con 0x7fe3640ada30 2023-11-15T01:36:51.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe368802700 1 --2- 172.21.15.1:0/3029415248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3640ada30 0x7fe3640c4dc0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fe35400d890 tx=0x7fe354008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:51.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe360ff9700 1 -- 172.21.15.1:0/3029415248 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3540125f0 con 0x7fe3640ada30 2023-11-15T01:36:51.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe360ff9700 1 -- 172.21.15.1:0/3029415248 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe354012750 con 0x7fe3640ada30 2023-11-15T01:36:51.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe369804700 1 -- 172.21.15.1:0/3029415248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe364159170 con 0x7fe3640ada30 2023-11-15T01:36:51.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.690+0000 7fe360ff9700 1 -- 172.21.15.1:0/3029415248 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354012ad0 con 0x7fe3640ada30 2023-11-15T01:36:51.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.691+0000 7fe369804700 1 -- 172.21.15.1:0/3029415248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe364149c20 con 0x7fe3640ada30 2023-11-15T01:36:51.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.692+0000 7fe369804700 1 -- 172.21.15.1:0/3029415248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3640aa7a0 con 0x7fe3640ada30 2023-11-15T01:36:51.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.692+0000 7fe360ff9700 1 -- 172.21.15.1:0/3029415248 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe354013480 con 0x7fe3640ada30 2023-11-15T01:36:51.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.692+0000 7fe360ff9700 1 --2- 172.21.15.1:0/3029415248 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe35005f240 0x7fe350061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:51.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.692+0000 7fe360ff9700 1 -- 172.21.15.1:0/3029415248 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5693+0+0 (secure 0 0 0) 0x7fe354079f60 con 0x7fe3640ada30 2023-11-15T01:36:51.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.692+0000 7fe363fff700 1 --2- 172.21.15.1:0/3029415248 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe35005f240 0x7fe350061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:51.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.693+0000 7fe363fff700 1 --2- 172.21.15.1:0/3029415248 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe35005f240 0x7fe350061700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe364152c20 tx=0x7fe358009060).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:51.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.696+0000 7fe360ff9700 1 -- 172.21.15.1:0/3029415248 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe3540a8af0 con 0x7fe3640ada30 2023-11-15T01:36:51.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:51.869+0000 7fe369804700 1 -- 172.21.15.1:0/3029415248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fe3640475e0 con 0x7fe3640ada30 2023-11-15T01:36:52.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:52.863+0000 7fe360ff9700 1 -- 172.21.15.1:0/3029415248 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v91) v1 ==== 152+0+0 (secure 0 0 0) 0x7fe35404b260 con 0x7fe3640ada30 2023-11-15T01:36:52.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:52.866+0000 7fe369804700 1 -- 172.21.15.1:0/3029415248 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe35005f240 msgr2=0x7fe350061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:52.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:52.866+0000 7fe369804700 1 --2- 172.21.15.1:0/3029415248 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe35005f240 0x7fe350061700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe364152c20 tx=0x7fe358009060).stop 2023-11-15T01:36:52.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:52.866+0000 7fe369804700 1 -- 172.21.15.1:0/3029415248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3640ada30 msgr2=0x7fe3640c4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:52.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:52.866+0000 7fe369804700 1 --2- 172.21.15.1:0/3029415248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3640ada30 0x7fe3640c4dc0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fe35400d890 tx=0x7fe354008040).stop 2023-11-15T01:36:52.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:52.866+0000 7fe369804700 1 -- 172.21.15.1:0/3029415248 shutdown_connections 2023-11-15T01:36:52.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:52.866+0000 7fe369804700 1 --2- 172.21.15.1:0/3029415248 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe35005f240 0x7fe350061700 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:52.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:52.866+0000 7fe369804700 1 --2- 172.21.15.1:0/3029415248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3640ca400 0x7fe364149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:52.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:52.866+0000 7fe369804700 1 --2- 172.21.15.1:0/3029415248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3640ada30 0x7fe3640c4dc0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:52.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:52.866+0000 7fe369804700 1 --2- 172.21.15.1:0/3029415248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3640c65b0 0x7fe3640c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:52.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:52.866+0000 7fe369804700 1 -- 172.21.15.1:0/3029415248 >> 172.21.15.1:0/3029415248 conn(0x7fe364064a60 msgr2=0x7fe3640c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:52.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:52.866+0000 7fe369804700 1 -- 172.21.15.1:0/3029415248 shutdown_connections 2023-11-15T01:36:52.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:52.866+0000 7fe369804700 1 -- 172.21.15.1:0/3029415248 wait complete. 2023-11-15T01:36:52.871 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2023-11-15T01:36:52.887 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-15T01:36:53.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.017+0000 7fe89c51f700 1 Processor -- start 2023-11-15T01:36:53.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.017+0000 7fe89c51f700 1 -- start start 2023-11-15T01:36:53.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89c51f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe8941540a0 0x7fe8940ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:53.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89c51f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8940ca050 con 0x7fe8940c6650 2023-11-15T01:36:53.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89c51f700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8940c9440 con 0x7fe894154480 2023-11-15T01:36:53.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89c51f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8940c9720 con 0x7fe8941540a0 2023-11-15T01:36:53.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89a2bb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe8941540a0 0x7fe8940ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:53.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89aabc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe8940c6650 0x7fe8940aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39248/0 (socket says 172.21.15.1:39248) 2023-11-15T01:36:53.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89a2bb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe8941540a0 0x7fe8940ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58074/0 (socket says 172.21.15.1:58074) 2023-11-15T01:36:53.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89aabc700 1 -- 172.21.15.1:0/3818262196 learned_addr learned my addr 172.21.15.1:0/3818262196 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:53.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89a2bb700 1 -- 172.21.15.1:0/3818262196 >> v1:172.21.15.141:6789/0 conn(0x7fe894154480 legacy=0x7fe8940c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:53.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89a2bb700 1 -- 172.21.15.1:0/3818262196 >> v1:172.21.15.1:6789/0 conn(0x7fe8940c6650 legacy=0x7fe8940aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:53.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe8992b9700 1 -- 172.21.15.1:0/3818262196 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240526151 0 0) 0x7fe8940ca050 con 0x7fe8940c6650 2023-11-15T01:36:53.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89a2bb700 1 -- 172.21.15.1:0/3818262196 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8940c9a00 con 0x7fe8941540a0 2023-11-15T01:36:53.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89a2bb700 1 --2- 172.21.15.1:0/3818262196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe8941540a0 0x7fe8940ca4e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fe890009760 tx=0x7fe890009060).ready entity=mon.0 client_cookie=bc93aeaf15171bdb server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:53.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe8992b9700 1 -- 172.21.15.1:0/3818262196 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89000b520 con 0x7fe8941540a0 2023-11-15T01:36:53.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe8992b9700 1 -- 172.21.15.1:0/3818262196 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89000b680 con 0x7fe8941540a0 2023-11-15T01:36:53.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe8992b9700 1 -- 172.21.15.1:0/3818262196 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89000ba00 con 0x7fe8941540a0 2023-11-15T01:36:53.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89c51f700 1 -- 172.21.15.1:0/3818262196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe8941540a0 msgr2=0x7fe8940ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:53.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89c51f700 1 --2- 172.21.15.1:0/3818262196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe8941540a0 0x7fe8940ca4e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fe890009760 tx=0x7fe890009060).stop 2023-11-15T01:36:53.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89c51f700 1 -- 172.21.15.1:0/3818262196 shutdown_connections 2023-11-15T01:36:53.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89c51f700 1 --2- 172.21.15.1:0/3818262196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe8941540a0 0x7fe8940ca4e0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:53.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89c51f700 1 -- 172.21.15.1:0/3818262196 >> 172.21.15.1:0/3818262196 conn(0x7fe894064a70 msgr2=0x7fe894064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:53.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89c51f700 1 -- 172.21.15.1:0/3818262196 shutdown_connections 2023-11-15T01:36:53.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.019+0000 7fe89c51f700 1 -- 172.21.15.1:0/3818262196 wait complete. 2023-11-15T01:36:53.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.020+0000 7fe89c51f700 1 Processor -- start 2023-11-15T01:36:53.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.020+0000 7fe89c51f700 1 -- start start 2023-11-15T01:36:53.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89c51f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe8940c6650 0x7fe8940af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:53.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89c51f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8941540a0 0x7fe8940afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:53.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89c51f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe894154480 0x7fe8940b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:53.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89c51f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8941660e0 con 0x7fe8940c6650 2023-11-15T01:36:53.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89c51f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940b0950 con 0x7fe894154480 2023-11-15T01:36:53.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89c51f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940b0c30 con 0x7fe8941540a0 2023-11-15T01:36:53.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89a2bb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe8940c6650 0x7fe8940af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:53.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89a2bb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe8940c6650 0x7fe8940af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58086/0 (socket says 172.21.15.1:58086) 2023-11-15T01:36:53.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89a2bb700 1 -- 172.21.15.1:0/4104768452 learned_addr learned my addr 172.21.15.1:0/4104768452 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:53.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe899aba700 1 --2- 172.21.15.1:0/4104768452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8941540a0 0x7fe8940afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:53.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89aabc700 1 --2- 172.21.15.1:0/4104768452 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe894154480 0x7fe8940b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:53.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89a2bb700 1 -- 172.21.15.1:0/4104768452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8941540a0 msgr2=0x7fe8940afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:53.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89a2bb700 1 --2- 172.21.15.1:0/4104768452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8941540a0 0x7fe8940afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:53.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89a2bb700 1 -- 172.21.15.1:0/4104768452 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe894154480 msgr2=0x7fe8940b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:53.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89a2bb700 1 --2- 172.21.15.1:0/4104768452 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe894154480 0x7fe8940b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:53.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89a2bb700 1 -- 172.21.15.1:0/4104768452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8900092a0 con 0x7fe8940c6650 2023-11-15T01:36:53.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.021+0000 7fe89aabc700 1 --2- 172.21.15.1:0/4104768452 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe894154480 0x7fe8940b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:53.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.022+0000 7fe89a2bb700 1 --2- 172.21.15.1:0/4104768452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe8940c6650 0x7fe8940af990 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fe890009eb0 tx=0x7fe890017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:53.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.022+0000 7fe88a7fc700 1 -- 172.21.15.1:0/4104768452 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89000b7f0 con 0x7fe8940c6650 2023-11-15T01:36:53.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.022+0000 7fe88a7fc700 1 -- 172.21.15.1:0/4104768452 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89000b950 con 0x7fe8940c6650 2023-11-15T01:36:53.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.022+0000 7fe89c51f700 1 -- 172.21.15.1:0/4104768452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe894165a90 con 0x7fe8940c6650 2023-11-15T01:36:53.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.022+0000 7fe88a7fc700 1 -- 172.21.15.1:0/4104768452 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89001b620 con 0x7fe8940c6650 2023-11-15T01:36:53.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.022+0000 7fe89c51f700 1 -- 172.21.15.1:0/4104768452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8941648c0 con 0x7fe8940c6650 2023-11-15T01:36:53.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.023+0000 7fe89c51f700 1 -- 172.21.15.1:0/4104768452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89406c7e0 con 0x7fe8940c6650 2023-11-15T01:36:53.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.023+0000 7fe88a7fc700 1 -- 172.21.15.1:0/4104768452 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe89001b9d0 con 0x7fe8940c6650 2023-11-15T01:36:53.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.023+0000 7fe88a7fc700 1 --2- 172.21.15.1:0/4104768452 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe87805f240 0x7fe878061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:53.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.023+0000 7fe88a7fc700 1 -- 172.21.15.1:0/4104768452 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fe89007c130 con 0x7fe8940c6650 2023-11-15T01:36:53.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.024+0000 7fe899aba700 1 --2- 172.21.15.1:0/4104768452 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe87805f240 0x7fe878061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:53.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.024+0000 7fe899aba700 1 --2- 172.21.15.1:0/4104768452 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe87805f240 0x7fe878061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fe894167df0 tx=0x7fe884008040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:53.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.028+0000 7fe88a7fc700 1 -- 172.21.15.1:0/4104768452 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe89004d200 con 0x7fe8940c6650 2023-11-15T01:36:53.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.203+0000 7fe89c51f700 1 -- 172.21.15.1:0/4104768452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe8940c9ce0 con 0x7fe8940c6650 2023-11-15T01:36:53.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.868+0000 7fe88a7fc700 1 -- 172.21.15.1:0/4104768452 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v92) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe890050820 con 0x7fe8940c6650 2023-11-15T01:36:53.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.875+0000 7fe89c51f700 1 -- 172.21.15.1:0/4104768452 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe87805f240 msgr2=0x7fe878061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:53.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.875+0000 7fe89c51f700 1 --2- 172.21.15.1:0/4104768452 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe87805f240 0x7fe878061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fe894167df0 tx=0x7fe884008040).stop 2023-11-15T01:36:53.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.875+0000 7fe89c51f700 1 -- 172.21.15.1:0/4104768452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe8940c6650 msgr2=0x7fe8940af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:53.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.875+0000 7fe89c51f700 1 --2- 172.21.15.1:0/4104768452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe8940c6650 0x7fe8940af990 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fe890009eb0 tx=0x7fe890017000).stop 2023-11-15T01:36:53.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.875+0000 7fe89c51f700 1 -- 172.21.15.1:0/4104768452 shutdown_connections 2023-11-15T01:36:53.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.875+0000 7fe89c51f700 1 --2- 172.21.15.1:0/4104768452 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe87805f240 0x7fe878061700 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:53.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.875+0000 7fe89c51f700 1 --2- 172.21.15.1:0/4104768452 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe894154480 0x7fe8940b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:53.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.875+0000 7fe89c51f700 1 --2- 172.21.15.1:0/4104768452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe8940c6650 0x7fe8940af990 secure :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0x7fe890009eb0 tx=0x7fe890017000).stop 2023-11-15T01:36:53.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.875+0000 7fe89c51f700 1 --2- 172.21.15.1:0/4104768452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8941540a0 0x7fe8940afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:53.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.875+0000 7fe89c51f700 1 -- 172.21.15.1:0/4104768452 >> 172.21.15.1:0/4104768452 conn(0x7fe894064a70 msgr2=0x7fe8940abb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:53.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.890+0000 7fe89c51f700 1 -- 172.21.15.1:0/4104768452 shutdown_connections 2023-11-15T01:36:53.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:53.891+0000 7fe89c51f700 1 -- 172.21.15.1:0/4104768452 wait complete. 2023-11-15T01:36:53.894 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2023-11-15T01:36:53.908 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-15T01:36:54.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.032+0000 7f166cee3700 1 Processor -- start 2023-11-15T01:36:54.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.032+0000 7f166cee3700 1 -- start start 2023-11-15T01:36:54.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.033+0000 7f166cee3700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f16681541d0 0x7f16681545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.033+0000 7f166cee3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f16680c60d0 0x7f16680c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.033+0000 7f166cee3700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1668155830 con 0x7f16680c7a60 2023-11-15T01:36:54.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.033+0000 7f166cee3700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1668158f40 con 0x7f16680c60d0 2023-11-15T01:36:54.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.033+0000 7f166cee3700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1668154c20 con 0x7f16681541d0 2023-11-15T01:36:54.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.033+0000 7f1666ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f16680c60d0 0x7f16680c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.033+0000 7f1667fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f16680c7a60 0x7f16680c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39262/0 (socket says 172.21.15.1:39262) 2023-11-15T01:36:54.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.033+0000 7f1666ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f16680c60d0 0x7f16680c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58092/0 (socket says 172.21.15.1:58092) 2023-11-15T01:36:54.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.033+0000 7f1667fff700 1 -- 172.21.15.1:0/4289729645 learned_addr learned my addr 172.21.15.1:0/4289729645 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:54.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.033+0000 7f1666ffd700 1 -- 172.21.15.1:0/4289729645 >> v2:172.21.15.141:3300/0 conn(0x7f16681541d0 msgr2=0x7f16681545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:54.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.033+0000 7f16677fe700 1 --2- 172.21.15.1:0/4289729645 >> v2:172.21.15.141:3300/0 conn(0x7f16681541d0 0x7f16681545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.033+0000 7f1666ffd700 1 --2- 172.21.15.1:0/4289729645 >> v2:172.21.15.141:3300/0 conn(0x7f16681541d0 0x7f16681545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.033+0000 7f16667fc700 1 -- 172.21.15.1:0/4289729645 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102303497 0 0) 0x7f1668155830 con 0x7f16680c7a60 2023-11-15T01:36:54.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.033+0000 7f1666ffd700 1 -- 172.21.15.1:0/4289729645 >> v1:172.21.15.1:6789/0 conn(0x7f16680c7a60 legacy=0x7f16680c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.033+0000 7f1666ffd700 1 -- 172.21.15.1:0/4289729645 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1668154f00 con 0x7f16680c60d0 2023-11-15T01:36:54.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.034+0000 7f1666ffd700 1 --2- 172.21.15.1:0/4289729645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16680c60d0 0x7f16680c6550 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f16680c2150 tx=0x7f165c009060).ready entity=mon.0 client_cookie=772e6eb236131998 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:54.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.034+0000 7f16667fc700 1 -- 172.21.15.1:0/4289729645 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c00b580 con 0x7f16680c60d0 2023-11-15T01:36:54.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.034+0000 7f16667fc700 1 -- 172.21.15.1:0/4289729645 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c00b6e0 con 0x7f16680c60d0 2023-11-15T01:36:54.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.034+0000 7f16667fc700 1 -- 172.21.15.1:0/4289729645 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c00ba60 con 0x7f16680c60d0 2023-11-15T01:36:54.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.034+0000 7f166cee3700 1 -- 172.21.15.1:0/4289729645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16680c60d0 msgr2=0x7f16680c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.034+0000 7f166cee3700 1 --2- 172.21.15.1:0/4289729645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16680c60d0 0x7f16680c6550 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f16680c2150 tx=0x7f165c009060).stop 2023-11-15T01:36:54.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.034+0000 7f166cee3700 1 -- 172.21.15.1:0/4289729645 shutdown_connections 2023-11-15T01:36:54.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.034+0000 7f166cee3700 1 --2- 172.21.15.1:0/4289729645 >> v2:172.21.15.141:3300/0 conn(0x7f16681541d0 0x7f16681545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.034+0000 7f166cee3700 1 --2- 172.21.15.1:0/4289729645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16680c60d0 0x7f16680c6550 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.034+0000 7f166cee3700 1 -- 172.21.15.1:0/4289729645 >> 172.21.15.1:0/4289729645 conn(0x7f1668069ee0 msgr2=0x7f166806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:54.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.034+0000 7f166cee3700 1 -- 172.21.15.1:0/4289729645 shutdown_connections 2023-11-15T01:36:54.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.034+0000 7f166cee3700 1 -- 172.21.15.1:0/4289729645 wait complete. 2023-11-15T01:36:54.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.036+0000 7f166cee3700 1 Processor -- start 2023-11-15T01:36:54.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.036+0000 7f166cee3700 1 -- start start 2023-11-15T01:36:54.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.036+0000 7f166cee3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16680c60d0 0x7f1668140850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.036+0000 7f166cee3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16680c7a60 0x7f16680b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.036+0000 7f166cee3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16681541d0 0x7f1668063550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.036+0000 7f166cee3700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1668165aa0 con 0x7f16680c60d0 2023-11-15T01:36:54.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.036+0000 7f166cee3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16680b10a0 con 0x7f16681541d0 2023-11-15T01:36:54.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.036+0000 7f166cee3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1668155b30 con 0x7f16680c7a60 2023-11-15T01:36:54.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.036+0000 7f16677fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16680c60d0 0x7f1668140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.036+0000 7f16677fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16680c60d0 0x7f1668140850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58094/0 (socket says 172.21.15.1:58094) 2023-11-15T01:36:54.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.036+0000 7f16677fe700 1 -- 172.21.15.1:0/3905260317 learned_addr learned my addr 172.21.15.1:0/3905260317 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:54.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.037+0000 7f1666ffd700 1 --2- 172.21.15.1:0/3905260317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16680c7a60 0x7f16680b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.037+0000 7f1667fff700 1 --2- 172.21.15.1:0/3905260317 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16681541d0 0x7f1668063550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.037+0000 7f16677fe700 1 -- 172.21.15.1:0/3905260317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16680c7a60 msgr2=0x7f16680b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.037+0000 7f16677fe700 1 --2- 172.21.15.1:0/3905260317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16680c7a60 0x7f16680b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.037+0000 7f16677fe700 1 -- 172.21.15.1:0/3905260317 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16681541d0 msgr2=0x7f1668063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.037+0000 7f16677fe700 1 --2- 172.21.15.1:0/3905260317 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16681541d0 0x7f1668063550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.037+0000 7f16677fe700 1 -- 172.21.15.1:0/3905260317 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c0092a0 con 0x7f16680c60d0 2023-11-15T01:36:54.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.037+0000 7f1667fff700 1 --2- 172.21.15.1:0/3905260317 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16681541d0 0x7f1668063550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:54.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.037+0000 7f16677fe700 1 --2- 172.21.15.1:0/3905260317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16680c60d0 0x7f1668140850 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f165800c650 tx=0x7f1658008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:54.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.037+0000 7f164f7fe700 1 -- 172.21.15.1:0/3905260317 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658010580 con 0x7f16680c60d0 2023-11-15T01:36:54.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.037+0000 7f164f7fe700 1 -- 172.21.15.1:0/3905260317 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16580106e0 con 0x7f16680c60d0 2023-11-15T01:36:54.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.037+0000 7f164f7fe700 1 -- 172.21.15.1:0/3905260317 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658010a60 con 0x7f16680c60d0 2023-11-15T01:36:54.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.037+0000 7f166cee3700 1 -- 172.21.15.1:0/3905260317 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1668155e10 con 0x7f16680c60d0 2023-11-15T01:36:54.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.037+0000 7f166cee3700 1 -- 172.21.15.1:0/3905260317 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16681563d0 con 0x7f16680c60d0 2023-11-15T01:36:54.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.038+0000 7f166cee3700 1 -- 172.21.15.1:0/3905260317 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16680475e0 con 0x7f16680c60d0 2023-11-15T01:36:54.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.039+0000 7f164f7fe700 1 -- 172.21.15.1:0/3905260317 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f165801b460 con 0x7f16680c60d0 2023-11-15T01:36:54.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.039+0000 7f164f7fe700 1 --2- 172.21.15.1:0/3905260317 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f165405f240 0x7f1654061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.039+0000 7f164f7fe700 1 -- 172.21.15.1:0/3905260317 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f165807a470 con 0x7f16680c60d0 2023-11-15T01:36:54.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.040+0000 7f1666ffd700 1 --2- 172.21.15.1:0/3905260317 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f165405f240 0x7f1654061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.040+0000 7f1666ffd700 1 --2- 172.21.15.1:0/3905260317 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f165405f240 0x7f1654061700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f165c009fd0 tx=0x7f165c017000).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:54.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.044+0000 7f164f7fe700 1 -- 172.21.15.1:0/3905260317 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f165804b420 con 0x7f16680c60d0 2023-11-15T01:36:54.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.261+0000 7f166cee3700 1 -- 172.21.15.1:0/3905260317 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f16681551e0 con 0x7f16680c60d0 2023-11-15T01:36:54.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.267+0000 7f164f7fe700 1 -- 172.21.15.1:0/3905260317 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v35) v1 ==== 174+0+0 (secure 0 0 0) 0x7f165804ea40 con 0x7f16680c60d0 2023-11-15T01:36:54.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.273+0000 7f166cee3700 1 -- 172.21.15.1:0/3905260317 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f165405f240 msgr2=0x7f1654061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.273+0000 7f166cee3700 1 --2- 172.21.15.1:0/3905260317 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f165405f240 0x7f1654061700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f165c009fd0 tx=0x7f165c017000).stop 2023-11-15T01:36:54.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.273+0000 7f166cee3700 1 -- 172.21.15.1:0/3905260317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16680c60d0 msgr2=0x7f1668140850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.273+0000 7f166cee3700 1 --2- 172.21.15.1:0/3905260317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16680c60d0 0x7f1668140850 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f165800c650 tx=0x7f1658008040).stop 2023-11-15T01:36:54.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.274+0000 7f166cee3700 1 -- 172.21.15.1:0/3905260317 shutdown_connections 2023-11-15T01:36:54.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.274+0000 7f166cee3700 1 --2- 172.21.15.1:0/3905260317 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f165405f240 0x7f1654061700 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.274+0000 7f166cee3700 1 --2- 172.21.15.1:0/3905260317 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16681541d0 0x7f1668063550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.274+0000 7f166cee3700 1 --2- 172.21.15.1:0/3905260317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16680c60d0 0x7f1668140850 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.274+0000 7f166cee3700 1 --2- 172.21.15.1:0/3905260317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16680c7a60 0x7f16680b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.274+0000 7f166cee3700 1 -- 172.21.15.1:0/3905260317 >> 172.21.15.1:0/3905260317 conn(0x7f1668069ee0 msgr2=0x7f16680c1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:54.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.274+0000 7f166cee3700 1 -- 172.21.15.1:0/3905260317 shutdown_connections 2023-11-15T01:36:54.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.274+0000 7f166cee3700 1 -- 172.21.15.1:0/3905260317 wait complete. 2023-11-15T01:36:54.280 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 11 and data pool 12 2023-11-15T01:36:54.301 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:36:54.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.419+0000 7f74ea888700 1 Processor -- start 2023-11-15T01:36:54.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.419+0000 7f74ea888700 1 -- start start 2023-11-15T01:36:54.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.420+0000 7f74ea888700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f74e4154150 0x7f74e4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.420+0000 7f74ea888700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f74e40aa060 0x7f74e40c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.420+0000 7f74ea888700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e40c06f0 con 0x7f74e40ab1a0 2023-11-15T01:36:54.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.420+0000 7f74ea888700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e40c09d0 con 0x7f74e40aa060 2023-11-15T01:36:54.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.420+0000 7f74ea888700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e4158820 con 0x7f74e4154150 2023-11-15T01:36:54.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.420+0000 7f74e8e25700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f74e40aa060 0x7f74e40c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.420+0000 7f74e8e25700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f74e40aa060 0x7f74e40c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58108/0 (socket says 172.21.15.1:58108) 2023-11-15T01:36:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.420+0000 7f74e8e25700 1 -- 172.21.15.1:0/1161235044 learned_addr learned my addr 172.21.15.1:0/1161235044 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.420+0000 7f74e3fff700 1 --2- 172.21.15.1:0/1161235044 >> v2:172.21.15.141:3300/0 conn(0x7f74e4154150 0x7f74e4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.420+0000 7f74e8e25700 1 -- 172.21.15.1:0/1161235044 >> v2:172.21.15.141:3300/0 conn(0x7f74e4154150 msgr2=0x7f74e4154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.420+0000 7f74e8e25700 1 --2- 172.21.15.1:0/1161235044 >> v2:172.21.15.141:3300/0 conn(0x7f74e4154150 0x7f74e4154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.420+0000 7f74e8e25700 1 -- 172.21.15.1:0/1161235044 >> v1:172.21.15.141:6789/0 conn(0x7f74e40ab1a0 legacy=0x7f74e4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.420+0000 7f74e8e25700 1 -- 172.21.15.1:0/1161235044 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e4158b00 con 0x7f74e40aa060 2023-11-15T01:36:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.420+0000 7f74e8e25700 1 --2- 172.21.15.1:0/1161235044 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40aa060 0x7f74e40c5f10 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f74e406bfb0 tx=0x7f74dc009840).ready entity=mon.0 client_cookie=cd8bca65f2fe16d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.420+0000 7f74e2ffd700 1 -- 172.21.15.1:0/1161235044 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc00e070 con 0x7f74e40aa060 2023-11-15T01:36:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.421+0000 7f74e2ffd700 1 -- 172.21.15.1:0/1161235044 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74dc00ba10 con 0x7f74e40aa060 2023-11-15T01:36:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.421+0000 7f74e2ffd700 1 -- 172.21.15.1:0/1161235044 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc00bd90 con 0x7f74e40aa060 2023-11-15T01:36:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.421+0000 7f74ea888700 1 -- 172.21.15.1:0/1161235044 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40aa060 msgr2=0x7f74e40c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.421+0000 7f74ea888700 1 --2- 172.21.15.1:0/1161235044 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40aa060 0x7f74e40c5f10 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f74e406bfb0 tx=0x7f74dc009840).stop 2023-11-15T01:36:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.421+0000 7f74ea888700 1 -- 172.21.15.1:0/1161235044 shutdown_connections 2023-11-15T01:36:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.421+0000 7f74ea888700 1 --2- 172.21.15.1:0/1161235044 >> v2:172.21.15.141:3300/0 conn(0x7f74e4154150 0x7f74e4154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.421+0000 7f74ea888700 1 --2- 172.21.15.1:0/1161235044 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40aa060 0x7f74e40c5f10 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.421+0000 7f74ea888700 1 -- 172.21.15.1:0/1161235044 >> 172.21.15.1:0/1161235044 conn(0x7f74e4064aa0 msgr2=0x7f74e4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.421+0000 7f74ea888700 1 -- 172.21.15.1:0/1161235044 shutdown_connections 2023-11-15T01:36:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.421+0000 7f74ea888700 1 -- 172.21.15.1:0/1161235044 wait complete. 2023-11-15T01:36:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.422+0000 7f74ea888700 1 Processor -- start 2023-11-15T01:36:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.422+0000 7f74ea888700 1 -- start start 2023-11-15T01:36:54.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74ea888700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40aa060 0x7f74e4156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74ea888700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74e40ab1a0 0x7f74e414cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74ea888700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74e4154150 0x7f74e40af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74ea888700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e40ae030 con 0x7f74e40aa060 2023-11-15T01:36:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74ea888700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e40ae310 con 0x7f74e40ab1a0 2023-11-15T01:36:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74ea888700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e40ae5f0 con 0x7f74e4154150 2023-11-15T01:36:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74e3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40aa060 0x7f74e4156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74e3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40aa060 0x7f74e4156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58124/0 (socket says 172.21.15.1:58124) 2023-11-15T01:36:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74e3fff700 1 -- 172.21.15.1:0/1691695232 learned_addr learned my addr 172.21.15.1:0/1691695232 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74e37fe700 1 --2- 172.21.15.1:0/1691695232 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74e40ab1a0 0x7f74e414cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74e8e25700 1 --2- 172.21.15.1:0/1691695232 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74e4154150 0x7f74e40af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74e3fff700 1 -- 172.21.15.1:0/1691695232 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74e4154150 msgr2=0x7f74e40af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74e3fff700 1 --2- 172.21.15.1:0/1691695232 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74e4154150 0x7f74e40af3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74e3fff700 1 -- 172.21.15.1:0/1691695232 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74e40ab1a0 msgr2=0x7f74e414cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74e3fff700 1 --2- 172.21.15.1:0/1691695232 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74e40ab1a0 0x7f74e414cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.423+0000 7f74e3fff700 1 -- 172.21.15.1:0/1691695232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc009ae0 con 0x7f74e40aa060 2023-11-15T01:36:54.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.424+0000 7f74e3fff700 1 --2- 172.21.15.1:0/1691695232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40aa060 0x7f74e4156ec0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f74d400c650 tx=0x7f74d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:54.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.424+0000 7f74cbfff700 1 -- 172.21.15.1:0/1691695232 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d4010580 con 0x7f74e40aa060 2023-11-15T01:36:54.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.424+0000 7f74cbfff700 1 -- 172.21.15.1:0/1691695232 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d40106e0 con 0x7f74e40aa060 2023-11-15T01:36:54.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.424+0000 7f74ea888700 1 -- 172.21.15.1:0/1691695232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e40ae8d0 con 0x7f74e40aa060 2023-11-15T01:36:54.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.424+0000 7f74cbfff700 1 -- 172.21.15.1:0/1691695232 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d4010a60 con 0x7f74e40aa060 2023-11-15T01:36:54.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.424+0000 7f74ea888700 1 -- 172.21.15.1:0/1691695232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e40aee90 con 0x7f74e40aa060 2023-11-15T01:36:54.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.425+0000 7f74ea888700 1 -- 172.21.15.1:0/1691695232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e406c7e0 con 0x7f74e40aa060 2023-11-15T01:36:54.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.425+0000 7f74cbfff700 1 -- 172.21.15.1:0/1691695232 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f74d401b460 con 0x7f74e40aa060 2023-11-15T01:36:54.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.426+0000 7f74cbfff700 1 --2- 172.21.15.1:0/1691695232 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f74d005f270 0x7f74d0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.426+0000 7f74cbfff700 1 -- 172.21.15.1:0/1691695232 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f74d407abe0 con 0x7f74e40aa060 2023-11-15T01:36:54.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.426+0000 7f74e37fe700 1 --2- 172.21.15.1:0/1691695232 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f74d005f270 0x7f74d0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.426+0000 7f74e37fe700 1 --2- 172.21.15.1:0/1691695232 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f74d005f270 0x7f74d0061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f74d800b890 tx=0x7f74d8008040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:54.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.430+0000 7f74cbfff700 1 -- 172.21.15.1:0/1691695232 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f74d404b3f0 con 0x7f74e40aa060 2023-11-15T01:36:54.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.600+0000 7f74ea888700 1 -- 172.21.15.1:0/1691695232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74e4158de0 con 0x7f74e40aa060 2023-11-15T01:36:54.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.601+0000 7f74cbfff700 1 -- 172.21.15.1:0/1691695232 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+17540 (secure 0 0 0) 0x7f74d404ea10 con 0x7f74e40aa060 2023-11-15T01:36:54.602 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:54.603 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":93,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:36:54.262000+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:36:51.906477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-11-15T01:36:53.240462+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:36:54.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.603+0000 7f74ea888700 1 -- 172.21.15.1:0/1691695232 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f74d005f270 msgr2=0x7f74d0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.603+0000 7f74ea888700 1 --2- 172.21.15.1:0/1691695232 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f74d005f270 0x7f74d0061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f74d800b890 tx=0x7f74d8008040).stop 2023-11-15T01:36:54.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.603+0000 7f74ea888700 1 -- 172.21.15.1:0/1691695232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40aa060 msgr2=0x7f74e4156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.603+0000 7f74ea888700 1 --2- 172.21.15.1:0/1691695232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40aa060 0x7f74e4156ec0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f74d400c650 tx=0x7f74d4008040).stop 2023-11-15T01:36:54.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.603+0000 7f74ea888700 1 -- 172.21.15.1:0/1691695232 shutdown_connections 2023-11-15T01:36:54.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.603+0000 7f74ea888700 1 --2- 172.21.15.1:0/1691695232 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f74d005f270 0x7f74d0061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.603+0000 7f74ea888700 1 --2- 172.21.15.1:0/1691695232 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74e4154150 0x7f74e40af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.603+0000 7f74ea888700 1 --2- 172.21.15.1:0/1691695232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40aa060 0x7f74e4156ec0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.603+0000 7f74ea888700 1 --2- 172.21.15.1:0/1691695232 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74e40ab1a0 0x7f74e414cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.604+0000 7f74ea888700 1 -- 172.21.15.1:0/1691695232 >> 172.21.15.1:0/1691695232 conn(0x7f74e4064aa0 msgr2=0x7f74e40ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:54.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.604+0000 7f74ea888700 1 -- 172.21.15.1:0/1691695232 shutdown_connections 2023-11-15T01:36:54.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.604+0000 7f74ea888700 1 -- 172.21.15.1:0/1691695232 wait complete. 2023-11-15T01:36:54.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:36:54.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.734+0000 7f6fbd05c700 1 Processor -- start 2023-11-15T01:36:54.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.734+0000 7f6fbd05c700 1 -- start start 2023-11-15T01:36:54.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.734+0000 7f6fbd05c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6fb80bcdd0 0x7f6fb81520d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.734+0000 7f6fbd05c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb8156000 con 0x7f6fb80c3850 2023-11-15T01:36:54.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.734+0000 7f6fbd05c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb81562e0 con 0x7f6fb80c3c30 2023-11-15T01:36:54.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.734+0000 7f6fbd05c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb81565c0 con 0x7f6fb80bcdd0 2023-11-15T01:36:54.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb6d9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6fb80c3850 0x7f6fb80a8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39266/0 (socket says 172.21.15.1:39266) 2023-11-15T01:36:54.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb6d9d700 1 -- 172.21.15.1:0/1305497389 learned_addr learned my addr 172.21.15.1:0/1305497389 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:54.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb759e700 1 --2- 172.21.15.1:0/1305497389 >> v2:172.21.15.141:3300/0 conn(0x7f6fb80bcdd0 0x7f6fb81520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb5d9b700 1 -- 172.21.15.1:0/1305497389 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972862674 0 0) 0x7f6fb8156000 con 0x7f6fb80c3850 2023-11-15T01:36:54.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb5d9b700 1 -- 172.21.15.1:0/1305497389 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fa40033f0 con 0x7f6fb80c3850 2023-11-15T01:36:54.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb5d9b700 1 -- 172.21.15.1:0/1305497389 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1950699237 0 0) 0x7f6fa40033f0 con 0x7f6fb80c3850 2023-11-15T01:36:54.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb5d9b700 1 -- 172.21.15.1:0/1305497389 >> v2:172.21.15.141:3300/0 conn(0x7f6fb80bcdd0 msgr2=0x7f6fb81520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:54.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb5d9b700 1 --2- 172.21.15.1:0/1305497389 >> v2:172.21.15.141:3300/0 conn(0x7f6fb80bcdd0 0x7f6fb81520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb5d9b700 1 -- 172.21.15.1:0/1305497389 >> v1:172.21.15.141:6789/0 conn(0x7f6fb80c3c30 legacy=0x7f6fb81519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb5d9b700 1 -- 172.21.15.1:0/1305497389 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb81568a0 con 0x7f6fb80c3850 2023-11-15T01:36:54.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb5d9b700 1 -- 172.21.15.1:0/1305497389 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f6fb00015f0 con 0x7f6fb80c3850 2023-11-15T01:36:54.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb5d9b700 1 -- 172.21.15.1:0/1305497389 >> v1:172.21.15.1:6789/0 conn(0x7f6fb80c3850 legacy=0x7f6fb80a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb5d9b700 1 --2- 172.21.15.1:0/1305497389 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fa40038e0 0x7f6fa4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb5d9b700 1 --2- 172.21.15.1:0/1305497389 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fa4004690 0x7f6fa4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb5d9b700 1 --2- 172.21.15.1:0/1305497389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fa4005000 0x7f6fa400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb5d9b700 1 -- 172.21.15.1:0/1305497389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb81565c0 con 0x7f6fa4005000 2023-11-15T01:36:54.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb5d9b700 1 -- 172.21.15.1:0/1305497389 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa400beb0 con 0x7f6fa40038e0 2023-11-15T01:36:54.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb5d9b700 1 -- 172.21.15.1:0/1305497389 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa400c070 con 0x7f6fa4004690 2023-11-15T01:36:54.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb759e700 1 --2- 172.21.15.1:0/1305497389 >> v2:172.21.15.141:3300/0 conn(0x7f6fb80bcdd0 0x7f6fb81520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:54.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb759e700 1 --2- 172.21.15.1:0/1305497389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fa4005000 0x7f6fa400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb6d9d700 1 --2- 172.21.15.1:0/1305497389 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fa40038e0 0x7f6fa4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.735+0000 7f6fb659c700 1 --2- 172.21.15.1:0/1305497389 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fa4004690 0x7f6fa4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fb759e700 1 -- 172.21.15.1:0/1305497389 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fa4004690 msgr2=0x7f6fa4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:54.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fb759e700 1 --2- 172.21.15.1:0/1305497389 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fa4004690 0x7f6fa4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fb759e700 1 -- 172.21.15.1:0/1305497389 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fa40038e0 msgr2=0x7f6fa4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:54.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fb759e700 1 --2- 172.21.15.1:0/1305497389 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fa40038e0 0x7f6fa4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fb759e700 1 -- 172.21.15.1:0/1305497389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa40033f0 con 0x7f6fa4005000 2023-11-15T01:36:54.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fb759e700 1 -- 172.21.15.1:0/1305497389 reap_dead start 2023-11-15T01:36:54.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fb759e700 1 --2- 172.21.15.1:0/1305497389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fa4005000 0x7f6fa400b8e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f6fa800e3c0 tx=0x7f6fa800b040).ready entity=mon.0 client_cookie=69f883ef4d5b2507 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:54.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fb5d9b700 1 -- 172.21.15.1:0/1305497389 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8009c50 con 0x7f6fa4005000 2023-11-15T01:36:54.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fb5d9b700 1 -- 172.21.15.1:0/1305497389 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa800f040 con 0x7f6fa4005000 2023-11-15T01:36:54.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fb5d9b700 1 -- 172.21.15.1:0/1305497389 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa800eea0 con 0x7f6fa4005000 2023-11-15T01:36:54.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fbd05c700 1 -- 172.21.15.1:0/1305497389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fa4005000 msgr2=0x7f6fa400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fbd05c700 1 --2- 172.21.15.1:0/1305497389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fa4005000 0x7f6fa400b8e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f6fa800e3c0 tx=0x7f6fa800b040).stop 2023-11-15T01:36:54.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fbd05c700 1 -- 172.21.15.1:0/1305497389 shutdown_connections 2023-11-15T01:36:54.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fbd05c700 1 --2- 172.21.15.1:0/1305497389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fa4005000 0x7f6fa400b8e0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fbd05c700 1 -- 172.21.15.1:0/1305497389 >> 172.21.15.1:0/1305497389 conn(0x7f6fb80627b0 msgr2=0x7f6fb8062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:54.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fbd05c700 1 -- 172.21.15.1:0/1305497389 shutdown_connections 2023-11-15T01:36:54.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.736+0000 7f6fbd05c700 1 -- 172.21.15.1:0/1305497389 wait complete. 2023-11-15T01:36:54.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.738+0000 7f6fbd05c700 1 Processor -- start 2023-11-15T01:36:54.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.738+0000 7f6fbd05c700 1 -- start start 2023-11-15T01:36:54.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.738+0000 7f6fbd05c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fa4005000 0x7f6fb81624a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.738+0000 7f6fbd05c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fb814a9f0 0x7f6fb80a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.738+0000 7f6fbd05c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fb80aa100 0x7f6fb814e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.738+0000 7f6fbd05c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80ab200 con 0x7f6fa4005000 2023-11-15T01:36:54.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.738+0000 7f6fbd05c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80aa5f0 con 0x7f6fb814a9f0 2023-11-15T01:36:54.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.738+0000 7f6fbd05c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80aa8d0 con 0x7f6fb80aa100 2023-11-15T01:36:54.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6fb6d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fa4005000 0x7f6fb81624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6fb6d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fa4005000 0x7f6fb81624a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58154/0 (socket says 172.21.15.1:58154) 2023-11-15T01:36:54.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6fb6d9d700 1 -- 172.21.15.1:0/1410809524 learned_addr learned my addr 172.21.15.1:0/1410809524 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:54.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6fb659c700 1 --2- 172.21.15.1:0/1410809524 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fb814a9f0 0x7f6fb80a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6fb759e700 1 --2- 172.21.15.1:0/1410809524 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fb80aa100 0x7f6fb814e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6fb6d9d700 1 -- 172.21.15.1:0/1410809524 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fb80aa100 msgr2=0x7f6fb814e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6fb6d9d700 1 --2- 172.21.15.1:0/1410809524 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fb80aa100 0x7f6fb814e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6fb6d9d700 1 -- 172.21.15.1:0/1410809524 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fb814a9f0 msgr2=0x7f6fb80a9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6fb6d9d700 1 --2- 172.21.15.1:0/1410809524 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fb814a9f0 0x7f6fb80a9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6fb6d9d700 1 -- 172.21.15.1:0/1410809524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb80aabb0 con 0x7f6fa4005000 2023-11-15T01:36:54.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6fb6d9d700 1 --2- 172.21.15.1:0/1410809524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fa4005000 0x7f6fb81624a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f6fb00078b0 tx=0x7f6fb0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:54.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6faeffd700 1 -- 172.21.15.1:0/1410809524 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb00070d0 con 0x7f6fa4005000 2023-11-15T01:36:54.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6faeffd700 1 -- 172.21.15.1:0/1410809524 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb0007230 con 0x7f6fa4005000 2023-11-15T01:36:54.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6fbd05c700 1 -- 172.21.15.1:0/1410809524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb80aae90 con 0x7f6fa4005000 2023-11-15T01:36:54.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6faeffd700 1 -- 172.21.15.1:0/1410809524 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0005880 con 0x7f6fa4005000 2023-11-15T01:36:54.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.739+0000 7f6fbd05c700 1 -- 172.21.15.1:0/1410809524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb8064df0 con 0x7f6fa4005000 2023-11-15T01:36:54.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.740+0000 7f6fbd05c700 1 -- 172.21.15.1:0/1410809524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb8064fe0 con 0x7f6fa4005000 2023-11-15T01:36:54.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.741+0000 7f6faeffd700 1 -- 172.21.15.1:0/1410809524 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6fb0005c30 con 0x7f6fa4005000 2023-11-15T01:36:54.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.741+0000 7f6faeffd700 1 --2- 172.21.15.1:0/1410809524 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f9805f270 0x7f6f98061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:54.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.741+0000 7f6faeffd700 1 -- 172.21.15.1:0/1410809524 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f6fb0079f10 con 0x7f6fa4005000 2023-11-15T01:36:54.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.741+0000 7f6fb659c700 1 --2- 172.21.15.1:0/1410809524 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f9805f270 0x7f6f98061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:54.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.742+0000 7f6fb659c700 1 --2- 172.21.15.1:0/1410809524 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f9805f270 0x7f6f98061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6fa0007fd0 tx=0x7f6fa0007bb0).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:54.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.745+0000 7f6faeffd700 1 -- 172.21.15.1:0/1410809524 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6fb0049af0 con 0x7f6fa4005000 2023-11-15T01:36:54.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.916+0000 7f6fbd05c700 1 -- 172.21.15.1:0/1410809524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fb806c7e0 con 0x7f6fa4005000 2023-11-15T01:36:54.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.917+0000 7f6faeffd700 1 -- 172.21.15.1:0/1410809524 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+17540 (secure 0 0 0) 0x7f6fb004af00 con 0x7f6fa4005000 2023-11-15T01:36:54.917 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:54.918 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":93,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:36:54.262000+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:36:51.906477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-11-15T01:36:53.240462+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:36:54.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.919+0000 7f6fbd05c700 1 -- 172.21.15.1:0/1410809524 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f9805f270 msgr2=0x7f6f98061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.919+0000 7f6fbd05c700 1 --2- 172.21.15.1:0/1410809524 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f9805f270 0x7f6f98061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6fa0007fd0 tx=0x7f6fa0007bb0).stop 2023-11-15T01:36:54.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.919+0000 7f6fbd05c700 1 -- 172.21.15.1:0/1410809524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fa4005000 msgr2=0x7f6fb81624a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:54.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.919+0000 7f6fbd05c700 1 --2- 172.21.15.1:0/1410809524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fa4005000 0x7f6fb81624a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f6fb00078b0 tx=0x7f6fb0009040).stop 2023-11-15T01:36:54.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.919+0000 7f6fbd05c700 1 -- 172.21.15.1:0/1410809524 shutdown_connections 2023-11-15T01:36:54.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.919+0000 7f6fbd05c700 1 --2- 172.21.15.1:0/1410809524 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6f9805f270 0x7f6f98061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.919+0000 7f6fbd05c700 1 --2- 172.21.15.1:0/1410809524 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fb80aa100 0x7f6fb814e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.919+0000 7f6fbd05c700 1 --2- 172.21.15.1:0/1410809524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fa4005000 0x7f6fb81624a0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.919+0000 7f6fbd05c700 1 --2- 172.21.15.1:0/1410809524 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fb814a9f0 0x7f6fb80a9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:54.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.919+0000 7f6fbd05c700 1 -- 172.21.15.1:0/1410809524 >> 172.21.15.1:0/1410809524 conn(0x7f6fb80627b0 msgr2=0x7f6fb814b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:54.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.919+0000 7f6fbd05c700 1 -- 172.21.15.1:0/1410809524 shutdown_connections 2023-11-15T01:36:54.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:54.919+0000 7f6fbd05c700 1 -- 172.21.15.1:0/1410809524 wait complete. 2023-11-15T01:36:54.932 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-15T01:36:55.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.052+0000 7fc4270a4700 1 Processor -- start 2023-11-15T01:36:55.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.052+0000 7fc4270a4700 1 -- start start 2023-11-15T01:36:55.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.053+0000 7fc4270a4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc4201540a0 0x7fc4200ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:55.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.053+0000 7fc4270a4700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4200ca050 con 0x7fc420154480 2023-11-15T01:36:55.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.053+0000 7fc4270a4700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4200c9440 con 0x7fc4200c6650 2023-11-15T01:36:55.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.053+0000 7fc4270a4700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4200c9720 con 0x7fc4201540a0 2023-11-15T01:36:55.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.053+0000 7fc424e40700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc4201540a0 0x7fc4200ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:55.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.053+0000 7fc424e40700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc4201540a0 0x7fc4200ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58158/0 (socket says 172.21.15.1:58158) 2023-11-15T01:36:55.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.053+0000 7fc41ffff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc420154480 0x7fc4200c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39276/0 (socket says 172.21.15.1:39276) 2023-11-15T01:36:55.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.053+0000 7fc424e40700 1 -- 172.21.15.1:0/775165680 learned_addr learned my addr 172.21.15.1:0/775165680 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:55.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.054+0000 7fc424e40700 1 -- 172.21.15.1:0/775165680 >> v1:172.21.15.141:6789/0 conn(0x7fc4200c6650 legacy=0x7fc4200aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:55.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.054+0000 7fc424e40700 1 -- 172.21.15.1:0/775165680 >> v1:172.21.15.1:6789/0 conn(0x7fc420154480 legacy=0x7fc4200c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:55.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.054+0000 7fc424e40700 1 -- 172.21.15.1:0/775165680 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4200c9a00 con 0x7fc4201540a0 2023-11-15T01:36:55.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.054+0000 7fc41f7fe700 1 -- 172.21.15.1:0/775165680 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381348214 0 0) 0x7fc4200ca050 con 0x7fc420154480 2023-11-15T01:36:55.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.054+0000 7fc424e40700 1 --2- 172.21.15.1:0/775165680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4201540a0 0x7fc4200ca4e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fc418006fd0 tx=0x7fc4180090f0).ready entity=mon.0 client_cookie=53a0204b9cd154b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:55.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.054+0000 7fc41f7fe700 1 -- 172.21.15.1:0/775165680 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41800b600 con 0x7fc4201540a0 2023-11-15T01:36:55.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.054+0000 7fc41f7fe700 1 -- 172.21.15.1:0/775165680 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41800b760 con 0x7fc4201540a0 2023-11-15T01:36:55.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.054+0000 7fc41f7fe700 1 -- 172.21.15.1:0/775165680 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41800bae0 con 0x7fc4201540a0 2023-11-15T01:36:55.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.054+0000 7fc4270a4700 1 -- 172.21.15.1:0/775165680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4201540a0 msgr2=0x7fc4200ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:55.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.054+0000 7fc4270a4700 1 --2- 172.21.15.1:0/775165680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4201540a0 0x7fc4200ca4e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fc418006fd0 tx=0x7fc4180090f0).stop 2023-11-15T01:36:55.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.055+0000 7fc4270a4700 1 -- 172.21.15.1:0/775165680 shutdown_connections 2023-11-15T01:36:55.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.055+0000 7fc4270a4700 1 --2- 172.21.15.1:0/775165680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4201540a0 0x7fc4200ca4e0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:55.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.055+0000 7fc4270a4700 1 -- 172.21.15.1:0/775165680 >> 172.21.15.1:0/775165680 conn(0x7fc420064a70 msgr2=0x7fc420064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:55.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.055+0000 7fc4270a4700 1 -- 172.21.15.1:0/775165680 shutdown_connections 2023-11-15T01:36:55.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.055+0000 7fc4270a4700 1 -- 172.21.15.1:0/775165680 wait complete. 2023-11-15T01:36:55.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.056+0000 7fc4270a4700 1 Processor -- start 2023-11-15T01:36:55.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.056+0000 7fc4270a4700 1 -- start start 2023-11-15T01:36:55.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc4270a4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4200c6650 0x7fc4200ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc4270a4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4201540a0 0x7fc42015a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc4270a4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc420154480 0x7fc42015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc4270a4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4200ae910 con 0x7fc4201540a0 2023-11-15T01:36:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc4270a4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42015ab90 con 0x7fc420154480 2023-11-15T01:36:55.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc4270a4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42014f160 con 0x7fc4200c6650 2023-11-15T01:36:55.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc41ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4201540a0 0x7fc42015a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:55.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc41ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4201540a0 0x7fc42015a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58164/0 (socket says 172.21.15.1:58164) 2023-11-15T01:36:55.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc41ffff700 1 -- 172.21.15.1:0/4036670931 learned_addr learned my addr 172.21.15.1:0/4036670931 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:55.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc41ffff700 1 -- 172.21.15.1:0/4036670931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4200c6650 msgr2=0x7fc4200ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:55.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc41ffff700 1 --2- 172.21.15.1:0/4036670931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4200c6650 0x7fc4200ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:55.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc425641700 1 --2- 172.21.15.1:0/4036670931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc420154480 0x7fc42015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:55.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc41ffff700 1 -- 172.21.15.1:0/4036670931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc420154480 msgr2=0x7fc42015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:55.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc41ffff700 1 --2- 172.21.15.1:0/4036670931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc420154480 0x7fc42015a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:55.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc41ffff700 1 -- 172.21.15.1:0/4036670931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc418009370 con 0x7fc4201540a0 2023-11-15T01:36:55.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc41ffff700 1 --2- 172.21.15.1:0/4036670931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4201540a0 0x7fc42015a1b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fc41000c7f0 tx=0x7fc410001580).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:55.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc41cff9700 1 -- 172.21.15.1:0/4036670931 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410005c70 con 0x7fc4201540a0 2023-11-15T01:36:55.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc41cff9700 1 -- 172.21.15.1:0/4036670931 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc410005df0 con 0x7fc4201540a0 2023-11-15T01:36:55.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc4270a4700 1 -- 172.21.15.1:0/4036670931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4201689a0 con 0x7fc4201540a0 2023-11-15T01:36:55.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc41cff9700 1 -- 172.21.15.1:0/4036670931 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410007360 con 0x7fc4201540a0 2023-11-15T01:36:55.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.057+0000 7fc4270a4700 1 -- 172.21.15.1:0/4036670931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4200ae6e0 con 0x7fc4201540a0 2023-11-15T01:36:55.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.059+0000 7fc4270a4700 1 -- 172.21.15.1:0/4036670931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42006c7e0 con 0x7fc4201540a0 2023-11-15T01:36:55.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.059+0000 7fc41cff9700 1 -- 172.21.15.1:0/4036670931 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc410007750 con 0x7fc4201540a0 2023-11-15T01:36:55.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.059+0000 7fc41cff9700 1 --2- 172.21.15.1:0/4036670931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc40005f270 0x7fc400061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:55.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.059+0000 7fc41cff9700 1 -- 172.21.15.1:0/4036670931 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fc41007a510 con 0x7fc4201540a0 2023-11-15T01:36:55.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.059+0000 7fc424e40700 1 --2- 172.21.15.1:0/4036670931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc40005f270 0x7fc400061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:55.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.060+0000 7fc424e40700 1 --2- 172.21.15.1:0/4036670931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc40005f270 0x7fc400061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc4200b1250 tx=0x7fc418017000).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:55.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.063+0000 7fc41cff9700 1 -- 172.21.15.1:0/4036670931 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc41004b4b0 con 0x7fc4201540a0 2023-11-15T01:36:55.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:55.280+0000 7fc4270a4700 1 -- 172.21.15.1:0/4036670931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc420168b30 con 0x7fc4201540a0 2023-11-15T01:36:56.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.274+0000 7fc41cff9700 1 -- 172.21.15.1:0/4036670931 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc410001610 con 0x7fc4201540a0 2023-11-15T01:36:56.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.277+0000 7fc4270a4700 1 -- 172.21.15.1:0/4036670931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc40005f270 msgr2=0x7fc400061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:56.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.277+0000 7fc4270a4700 1 --2- 172.21.15.1:0/4036670931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc40005f270 0x7fc400061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc4200b1250 tx=0x7fc418017000).stop 2023-11-15T01:36:56.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.277+0000 7fc4270a4700 1 -- 172.21.15.1:0/4036670931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4201540a0 msgr2=0x7fc42015a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:56.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.277+0000 7fc4270a4700 1 --2- 172.21.15.1:0/4036670931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4201540a0 0x7fc42015a1b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fc41000c7f0 tx=0x7fc410001580).stop 2023-11-15T01:36:56.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.277+0000 7fc4270a4700 1 -- 172.21.15.1:0/4036670931 shutdown_connections 2023-11-15T01:36:56.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.277+0000 7fc4270a4700 1 --2- 172.21.15.1:0/4036670931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc40005f270 0x7fc400061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:56.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.277+0000 7fc4270a4700 1 --2- 172.21.15.1:0/4036670931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc420154480 0x7fc42015a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:56.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.277+0000 7fc4270a4700 1 --2- 172.21.15.1:0/4036670931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4200c6650 0x7fc4200ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:56.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.277+0000 7fc4270a4700 1 --2- 172.21.15.1:0/4036670931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4201540a0 0x7fc42015a1b0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:56.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.277+0000 7fc4270a4700 1 -- 172.21.15.1:0/4036670931 >> 172.21.15.1:0/4036670931 conn(0x7fc420064a70 msgr2=0x7fc4200c10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:56.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.277+0000 7fc4270a4700 1 -- 172.21.15.1:0/4036670931 shutdown_connections 2023-11-15T01:36:56.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.277+0000 7fc4270a4700 1 -- 172.21.15.1:0/4036670931 wait complete. 2023-11-15T01:36:56.292 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-15T01:36:56.293 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-15T01:36:56.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.421+0000 7f6b34486700 1 Processor -- start 2023-11-15T01:36:56.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.421+0000 7f6b34486700 1 -- start start 2023-11-15T01:36:56.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.422+0000 7f6b34486700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6b2c154480 0x7f6b2c0c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:56.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.422+0000 7f6b34486700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2c0ca050 con 0x7f6b2c0c6430 2023-11-15T01:36:56.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.422+0000 7f6b34486700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2c0c68c0 con 0x7f6b2c1540a0 2023-11-15T01:36:56.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.422+0000 7f6b34486700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2c0c9440 con 0x7f6b2c154480 2023-11-15T01:36:56.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.422+0000 7f6b31a21700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6b2c154480 0x7f6b2c0c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:56.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.422+0000 7f6b32a23700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6b2c0c6430 0x7f6b2c0aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:39284/0 (socket says 172.21.15.1:39284) 2023-11-15T01:36:56.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.422+0000 7f6b32a23700 1 -- 172.21.15.1:0/3157208048 learned_addr learned my addr 172.21.15.1:0/3157208048 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:56.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.423+0000 7f6b31a21700 1 -- 172.21.15.1:0/3157208048 >> v1:172.21.15.141:6789/0 conn(0x7f6b2c1540a0 legacy=0x7f6b2c0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:56.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.423+0000 7f6b31a21700 1 -- 172.21.15.1:0/3157208048 >> v1:172.21.15.1:6789/0 conn(0x7f6b2c0c6430 legacy=0x7f6b2c0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:56.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.423+0000 7f6b31220700 1 -- 172.21.15.1:0/3157208048 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651659345 0 0) 0x7f6b2c0ca050 con 0x7f6b2c0c6430 2023-11-15T01:36:56.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.423+0000 7f6b31a21700 1 -- 172.21.15.1:0/3157208048 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c0c9720 con 0x7f6b2c154480 2023-11-15T01:36:56.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.423+0000 7f6b31a21700 1 --2- 172.21.15.1:0/3157208048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c154480 0x7f6b2c0c5f40 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f6b20009760 tx=0x7f6b20009060).ready entity=mon.0 client_cookie=1ef1e363b948484d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:56.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.423+0000 7f6b31220700 1 -- 172.21.15.1:0/3157208048 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000b580 con 0x7f6b2c154480 2023-11-15T01:36:56.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.423+0000 7f6b31220700 1 -- 172.21.15.1:0/3157208048 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2000b6e0 con 0x7f6b2c154480 2023-11-15T01:36:56.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.423+0000 7f6b31220700 1 -- 172.21.15.1:0/3157208048 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000ba60 con 0x7f6b2c154480 2023-11-15T01:36:56.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.423+0000 7f6b34486700 1 -- 172.21.15.1:0/3157208048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c154480 msgr2=0x7f6b2c0c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:56.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.423+0000 7f6b34486700 1 --2- 172.21.15.1:0/3157208048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c154480 0x7f6b2c0c5f40 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f6b20009760 tx=0x7f6b20009060).stop 2023-11-15T01:36:56.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.424+0000 7f6b34486700 1 -- 172.21.15.1:0/3157208048 shutdown_connections 2023-11-15T01:36:56.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.424+0000 7f6b34486700 1 --2- 172.21.15.1:0/3157208048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c154480 0x7f6b2c0c5f40 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:56.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.424+0000 7f6b34486700 1 -- 172.21.15.1:0/3157208048 >> 172.21.15.1:0/3157208048 conn(0x7f6b2c064a70 msgr2=0x7f6b2c064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:56.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.424+0000 7f6b34486700 1 -- 172.21.15.1:0/3157208048 shutdown_connections 2023-11-15T01:36:56.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.424+0000 7f6b34486700 1 -- 172.21.15.1:0/3157208048 wait complete. 2023-11-15T01:36:56.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.425+0000 7f6b34486700 1 Processor -- start 2023-11-15T01:36:56.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.425+0000 7f6b34486700 1 -- start start 2023-11-15T01:36:56.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.425+0000 7f6b34486700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c0c6430 0x7f6b2c1521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:56.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.425+0000 7f6b34486700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b2c1540a0 0x7f6b2c1651b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:56.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.425+0000 7f6b34486700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b2c154480 0x7f6b2c14ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:56.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.425+0000 7f6b34486700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c153440 con 0x7f6b2c0c6430 2023-11-15T01:36:56.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.425+0000 7f6b34486700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c158070 con 0x7f6b2c154480 2023-11-15T01:36:56.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.425+0000 7f6b34486700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c1656a0 con 0x7f6b2c1540a0 2023-11-15T01:36:56.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b32222700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c0c6430 0x7f6b2c1521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:56.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b32222700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c0c6430 0x7f6b2c1521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58186/0 (socket says 172.21.15.1:58186) 2023-11-15T01:36:56.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b32222700 1 -- 172.21.15.1:0/25151547 learned_addr learned my addr 172.21.15.1:0/25151547 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:56.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b32a23700 1 --2- 172.21.15.1:0/25151547 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b2c154480 0x7f6b2c14ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:56.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b31a21700 1 --2- 172.21.15.1:0/25151547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b2c1540a0 0x7f6b2c1651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:56.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b32222700 1 -- 172.21.15.1:0/25151547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b2c1540a0 msgr2=0x7f6b2c1651b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:56.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b32222700 1 --2- 172.21.15.1:0/25151547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b2c1540a0 0x7f6b2c1651b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:56.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b32222700 1 -- 172.21.15.1:0/25151547 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b2c154480 msgr2=0x7f6b2c14ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:56.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b32222700 1 --2- 172.21.15.1:0/25151547 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b2c154480 0x7f6b2c14ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:56.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b32222700 1 -- 172.21.15.1:0/25151547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b200092a0 con 0x7f6b2c0c6430 2023-11-15T01:36:56.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b31a21700 1 --2- 172.21.15.1:0/25151547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b2c1540a0 0x7f6b2c1651b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:56.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b32222700 1 --2- 172.21.15.1:0/25151547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c0c6430 0x7f6b2c1521d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f6b1c00c870 tx=0x7f6b1c001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:56.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b2a7fc700 1 -- 172.21.15.1:0/25151547 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c006a20 con 0x7f6b2c0c6430 2023-11-15T01:36:56.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b2a7fc700 1 -- 172.21.15.1:0/25151547 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c006b80 con 0x7f6b2c0c6430 2023-11-15T01:36:56.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b2a7fc700 1 -- 172.21.15.1:0/25151547 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c007020 con 0x7f6b2c0c6430 2023-11-15T01:36:56.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b34486700 1 -- 172.21.15.1:0/25151547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2c1527c0 con 0x7f6b2c0c6430 2023-11-15T01:36:56.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.426+0000 7f6b34486700 1 -- 172.21.15.1:0/25151547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2c152d80 con 0x7f6b2c0c6430 2023-11-15T01:36:56.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.427+0000 7f6b34486700 1 -- 172.21.15.1:0/25151547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2c06c7e0 con 0x7f6b2c0c6430 2023-11-15T01:36:56.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.427+0000 7f6b2a7fc700 1 -- 172.21.15.1:0/25151547 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6b1c0073d0 con 0x7f6b2c0c6430 2023-11-15T01:36:56.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.428+0000 7f6b2a7fc700 1 --2- 172.21.15.1:0/25151547 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b1805f270 0x7f6b18061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:56.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.428+0000 7f6b2a7fc700 1 -- 172.21.15.1:0/25151547 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f6b1c079cf0 con 0x7f6b2c0c6430 2023-11-15T01:36:56.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.428+0000 7f6b31a21700 1 --2- 172.21.15.1:0/25151547 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b1805f270 0x7f6b18061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:56.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.428+0000 7f6b31a21700 1 --2- 172.21.15.1:0/25151547 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b1805f270 0x7f6b18061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6b2c153eb0 tx=0x7f6b20017000).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:56.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.432+0000 7f6b2a7fc700 1 -- 172.21.15.1:0/25151547 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6b1c048af0 con 0x7f6b2c0c6430 2023-11-15T01:36:56.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:56.653+0000 7f6b34486700 1 -- 172.21.15.1:0/25151547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6b2c0c9a00 con 0x7f6b2c0c6430 2023-11-15T01:36:57.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.282+0000 7f6b2a7fc700 1 -- 172.21.15.1:0/25151547 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6b1c04ac90 con 0x7f6b2c0c6430 2023-11-15T01:36:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.285+0000 7f6b34486700 1 -- 172.21.15.1:0/25151547 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b1805f270 msgr2=0x7f6b18061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.285+0000 7f6b34486700 1 --2- 172.21.15.1:0/25151547 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b1805f270 0x7f6b18061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6b2c153eb0 tx=0x7f6b20017000).stop 2023-11-15T01:36:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.285+0000 7f6b34486700 1 -- 172.21.15.1:0/25151547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c0c6430 msgr2=0x7f6b2c1521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.285+0000 7f6b34486700 1 --2- 172.21.15.1:0/25151547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c0c6430 0x7f6b2c1521d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f6b1c00c870 tx=0x7f6b1c001660).stop 2023-11-15T01:36:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.285+0000 7f6b34486700 1 -- 172.21.15.1:0/25151547 shutdown_connections 2023-11-15T01:36:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.285+0000 7f6b34486700 1 --2- 172.21.15.1:0/25151547 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b1805f270 0x7f6b18061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.285+0000 7f6b34486700 1 --2- 172.21.15.1:0/25151547 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b2c154480 0x7f6b2c14ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.285+0000 7f6b34486700 1 --2- 172.21.15.1:0/25151547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c0c6430 0x7f6b2c1521d0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.285+0000 7f6b34486700 1 --2- 172.21.15.1:0/25151547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b2c1540a0 0x7f6b2c1651b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.285+0000 7f6b34486700 1 -- 172.21.15.1:0/25151547 >> 172.21.15.1:0/25151547 conn(0x7f6b2c064a70 msgr2=0x7f6b2c0ab6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:57.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.285+0000 7f6b34486700 1 -- 172.21.15.1:0/25151547 shutdown_connections 2023-11-15T01:36:57.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.285+0000 7f6b34486700 1 -- 172.21.15.1:0/25151547 wait complete. 2023-11-15T01:36:57.299 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-15T01:36:57.299 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:36:57.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.420+0000 7f7d1ccaf700 1 Processor -- start 2023-11-15T01:36:57.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.420+0000 7f7d1ccaf700 1 -- start start 2023-11-15T01:36:57.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.421+0000 7f7d1ccaf700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d180833a0 0x7f7d180a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:57.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.421+0000 7f7d1ccaf700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7d180be520 0x7f7d18154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:57.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.421+0000 7f7d1ccaf700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d180a85e0 con 0x7f7d18154450 2023-11-15T01:36:57.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.421+0000 7f7d1ccaf700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d18065940 con 0x7f7d180be520 2023-11-15T01:36:57.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.421+0000 7f7d1ccaf700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d18065660 con 0x7f7d180833a0 2023-11-15T01:36:57.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.421+0000 7f7d16d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7d180be520 0x7f7d18154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:57.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.421+0000 7f7d16d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7d180be520 0x7f7d18154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58190/0 (socket says 172.21.15.1:58190) 2023-11-15T01:36:57.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.421+0000 7f7d16d9d700 1 -- 172.21.15.1:0/4074371875 learned_addr learned my addr 172.21.15.1:0/4074371875 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:57.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.422+0000 7f7d15d9b700 1 --2- 172.21.15.1:0/4074371875 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d180833a0 0x7f7d180a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:57.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.422+0000 7f7d16d9d700 1 -- 172.21.15.1:0/4074371875 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d180833a0 msgr2=0x7f7d180a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:57.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.422+0000 7f7d16d9d700 1 --2- 172.21.15.1:0/4074371875 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d180833a0 0x7f7d180a7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.422+0000 7f7d16d9d700 1 -- 172.21.15.1:0/4074371875 >> v1:172.21.15.141:6789/0 conn(0x7f7d18154450 legacy=0x7f7d180bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:57.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.422+0000 7f7d16d9d700 1 -- 172.21.15.1:0/4074371875 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d180c6f50 con 0x7f7d180be520 2023-11-15T01:36:57.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.422+0000 7f7d16d9d700 1 --2- 172.21.15.1:0/4074371875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d180be520 0x7f7d18154830 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f7d08009f20 tx=0x7f7d08009840).ready entity=mon.0 client_cookie=a657f50697d1df32 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:57.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.422+0000 7f7d1559a700 1 -- 172.21.15.1:0/4074371875 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0800e070 con 0x7f7d180be520 2023-11-15T01:36:57.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.422+0000 7f7d1559a700 1 -- 172.21.15.1:0/4074371875 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0800ba40 con 0x7f7d180be520 2023-11-15T01:36:57.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.422+0000 7f7d1559a700 1 -- 172.21.15.1:0/4074371875 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0800bdc0 con 0x7f7d180be520 2023-11-15T01:36:57.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.422+0000 7f7d1ccaf700 1 -- 172.21.15.1:0/4074371875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d180be520 msgr2=0x7f7d18154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:57.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.422+0000 7f7d1ccaf700 1 --2- 172.21.15.1:0/4074371875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d180be520 0x7f7d18154830 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f7d08009f20 tx=0x7f7d08009840).stop 2023-11-15T01:36:57.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.423+0000 7f7d1ccaf700 1 -- 172.21.15.1:0/4074371875 shutdown_connections 2023-11-15T01:36:57.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.423+0000 7f7d1ccaf700 1 --2- 172.21.15.1:0/4074371875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d180be520 0x7f7d18154830 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.423+0000 7f7d1ccaf700 1 --2- 172.21.15.1:0/4074371875 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d180833a0 0x7f7d180a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.423+0000 7f7d1ccaf700 1 -- 172.21.15.1:0/4074371875 >> 172.21.15.1:0/4074371875 conn(0x7f7d18082f90 msgr2=0x7f7d180c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:57.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.423+0000 7f7d1ccaf700 1 -- 172.21.15.1:0/4074371875 shutdown_connections 2023-11-15T01:36:57.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.423+0000 7f7d1ccaf700 1 -- 172.21.15.1:0/4074371875 wait complete. 2023-11-15T01:36:57.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.424+0000 7f7d1ccaf700 1 Processor -- start 2023-11-15T01:36:57.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.424+0000 7f7d1ccaf700 1 -- start start 2023-11-15T01:36:57.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.424+0000 7f7d1ccaf700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d180833a0 0x7f7d1814dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:57.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.424+0000 7f7d1ccaf700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d180be520 0x7f7d180abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:57.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d1ccaf700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d18154450 0x7f7d180ac350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:57.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d1ccaf700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d18068440 con 0x7f7d180833a0 2023-11-15T01:36:57.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d1ccaf700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d180acd70 con 0x7f7d18154450 2023-11-15T01:36:57.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d1ccaf700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d180aa180 con 0x7f7d180be520 2023-11-15T01:36:57.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d1659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d180833a0 0x7f7d1814dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:57.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d1659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d180833a0 0x7f7d1814dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58198/0 (socket says 172.21.15.1:58198) 2023-11-15T01:36:57.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d1659c700 1 -- 172.21.15.1:0/1093744039 learned_addr learned my addr 172.21.15.1:0/1093744039 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:57.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d1659c700 1 -- 172.21.15.1:0/1093744039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d180be520 msgr2=0x7f7d180abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:57.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d1659c700 1 --2- 172.21.15.1:0/1093744039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d180be520 0x7f7d180abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:57.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d16d9d700 1 --2- 172.21.15.1:0/1093744039 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d18154450 0x7f7d180ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:57.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d1659c700 1 -- 172.21.15.1:0/1093744039 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d18154450 msgr2=0x7f7d180ac350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:57.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d1659c700 1 --2- 172.21.15.1:0/1093744039 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d18154450 0x7f7d180ac350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d1659c700 1 -- 172.21.15.1:0/1093744039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d08009ae0 con 0x7f7d180833a0 2023-11-15T01:36:57.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d1659c700 1 --2- 172.21.15.1:0/1093744039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d180833a0 0x7f7d1814dfc0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f7d1000b490 tx=0x7f7d10006f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:57.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d0e7fc700 1 -- 172.21.15.1:0/1093744039 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10012410 con 0x7f7d180833a0 2023-11-15T01:36:57.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d0e7fc700 1 -- 172.21.15.1:0/1093744039 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d100125b0 con 0x7f7d180833a0 2023-11-15T01:36:57.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d0e7fc700 1 -- 172.21.15.1:0/1093744039 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10012970 con 0x7f7d180833a0 2023-11-15T01:36:57.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d1ccaf700 1 -- 172.21.15.1:0/1093744039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d18164710 con 0x7f7d180833a0 2023-11-15T01:36:57.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.425+0000 7f7d1ccaf700 1 -- 172.21.15.1:0/1093744039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d180acb40 con 0x7f7d180833a0 2023-11-15T01:36:57.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.426+0000 7f7d1ccaf700 1 -- 172.21.15.1:0/1093744039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d180c9460 con 0x7f7d180833a0 2023-11-15T01:36:57.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.427+0000 7f7d0e7fc700 1 -- 172.21.15.1:0/1093744039 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7d10012d20 con 0x7f7d180833a0 2023-11-15T01:36:57.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.427+0000 7f7d0e7fc700 1 --2- 172.21.15.1:0/1093744039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7cf805f270 0x7f7cf8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:57.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.427+0000 7f7d0e7fc700 1 -- 172.21.15.1:0/1093744039 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f7d1007a290 con 0x7f7d180833a0 2023-11-15T01:36:57.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.427+0000 7f7d15d9b700 1 --2- 172.21.15.1:0/1093744039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7cf805f270 0x7f7cf8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:57.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.427+0000 7f7d15d9b700 1 --2- 172.21.15.1:0/1093744039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7cf805f270 0x7f7cf8061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7d18096cf0 tx=0x7f7d00008040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:57.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.431+0000 7f7d0e7fc700 1 -- 172.21.15.1:0/1093744039 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7d1004b230 con 0x7f7d180833a0 2023-11-15T01:36:57.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.645+0000 7f7d1ccaf700 1 -- 172.21.15.1:0/1093744039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d180c7370 con 0x7f7d180833a0 2023-11-15T01:36:57.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.645+0000 7f7d0e7fc700 1 -- 172.21.15.1:0/1093744039 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f7d1004e850 con 0x7f7d180833a0 2023-11-15T01:36:57.646 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:57.646 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2863729575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2863729575},{"type":"v1","addr":"172.21.15.141:6836","nonce":2863729575}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/4111210566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":4111210566},{"type":"v1","addr":"172.21.15.141:6837","nonce":4111210566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6696,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/4099031019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4099031019},{"type":"v1","addr":"172.21.15.1:6834","nonce":4099031019}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:36:54.262333+0000","modified":"2023-11-15T01:36:57.273246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6699":{"gid":6699,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/1737301018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1737301018},{"type":"v1","addr":"172.21.15.1:6835","nonce":1737301018}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-11-15T01:36:57.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.647+0000 7f7d1ccaf700 1 -- 172.21.15.1:0/1093744039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7cf805f270 msgr2=0x7f7cf8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:57.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.647+0000 7f7d1ccaf700 1 --2- 172.21.15.1:0/1093744039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7cf805f270 0x7f7cf8061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7d18096cf0 tx=0x7f7d00008040).stop 2023-11-15T01:36:57.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.647+0000 7f7d1ccaf700 1 -- 172.21.15.1:0/1093744039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d180833a0 msgr2=0x7f7d1814dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.647+0000 7f7d1ccaf700 1 --2- 172.21.15.1:0/1093744039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d180833a0 0x7f7d1814dfc0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f7d1000b490 tx=0x7f7d10006f10).stop 2023-11-15T01:36:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.647+0000 7f7d1ccaf700 1 -- 172.21.15.1:0/1093744039 shutdown_connections 2023-11-15T01:36:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.647+0000 7f7d1ccaf700 1 --2- 172.21.15.1:0/1093744039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7cf805f270 0x7f7cf8061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.647+0000 7f7d1ccaf700 1 --2- 172.21.15.1:0/1093744039 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d18154450 0x7f7d180ac350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.647+0000 7f7d1ccaf700 1 --2- 172.21.15.1:0/1093744039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d180833a0 0x7f7d1814dfc0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.647+0000 7f7d1ccaf700 1 --2- 172.21.15.1:0/1093744039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d180be520 0x7f7d180abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:36:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.647+0000 7f7d1ccaf700 1 -- 172.21.15.1:0/1093744039 >> 172.21.15.1:0/1093744039 conn(0x7f7d18082f90 msgr2=0x7f7d180c77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.647+0000 7f7d1ccaf700 1 -- 172.21.15.1:0/1093744039 shutdown_connections 2023-11-15T01:36:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.647+0000 7f7d1ccaf700 1 -- 172.21.15.1:0/1093744039 wait complete. 2023-11-15T01:36:57.651 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 39 2023-11-15T01:36:57.660 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:36:57.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.777+0000 7f5dd08a4700 1 Processor -- start 2023-11-15T01:36:57.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.777+0000 7f5dd08a4700 1 -- start start 2023-11-15T01:36:57.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dd08a4700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5dcc154150 0x7f5dcc154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:57.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dd08a4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dcc0ab1a0 0x7f5dcc158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:57.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dd08a4700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dcc0c06f0 con 0x7f5dcc0aa060 2023-11-15T01:36:57.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dd08a4700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dcc0c09d0 con 0x7f5dcc154150 2023-11-15T01:36:57.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dd08a4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc158820 con 0x7f5dcc0ab1a0 2023-11-15T01:36:57.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dcad9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5dcc0aa060 0x7f5dcc0c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:56258/0 (socket says 172.21.15.1:56258) 2023-11-15T01:36:57.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dcad9d700 1 -- 172.21.15.1:0/2882450857 learned_addr learned my addr 172.21.15.1:0/2882450857 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:57.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dca59c700 1 --2- 172.21.15.1:0/2882450857 >> v2:172.21.15.141:3300/0 conn(0x7f5dcc154150 0x7f5dcc154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:57.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dc9d9b700 1 --2- 172.21.15.1:0/2882450857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dcc0ab1a0 0x7f5dcc158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:57.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dc959a700 1 -- 172.21.15.1:0/2882450857 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342149786 0 0) 0x7f5dcc0c06f0 con 0x7f5dcc0aa060 2023-11-15T01:36:57.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dc959a700 1 -- 172.21.15.1:0/2882450857 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5db80033f0 con 0x7f5dcc0aa060 2023-11-15T01:36:57.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dc959a700 1 -- 172.21.15.1:0/2882450857 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1967204106 0 0) 0x7f5db80033f0 con 0x7f5dcc0aa060 2023-11-15T01:36:57.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dc959a700 1 -- 172.21.15.1:0/2882450857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dcc0ab1a0 msgr2=0x7f5dcc158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:57.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dc959a700 1 --2- 172.21.15.1:0/2882450857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dcc0ab1a0 0x7f5dcc158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dc959a700 1 -- 172.21.15.1:0/2882450857 >> v2:172.21.15.141:3300/0 conn(0x7f5dcc154150 msgr2=0x7f5dcc154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:57.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dc959a700 1 --2- 172.21.15.1:0/2882450857 >> v2:172.21.15.141:3300/0 conn(0x7f5dcc154150 0x7f5dcc154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dc959a700 1 -- 172.21.15.1:0/2882450857 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc158b00 con 0x7f5dcc0aa060 2023-11-15T01:36:57.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dc959a700 1 -- 172.21.15.1:0/2882450857 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f5dc40017f0 con 0x7f5dcc0aa060 2023-11-15T01:36:57.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dc959a700 1 -- 172.21.15.1:0/2882450857 >> v1:172.21.15.1:6789/0 conn(0x7f5dcc0aa060 legacy=0x7f5dcc0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:57.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.778+0000 7f5dc959a700 1 --2- 172.21.15.1:0/2882450857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db80038e0 0x7f5db8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:57.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dc959a700 1 --2- 172.21.15.1:0/2882450857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dcc0ab1a0 0x7f5db8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:57.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dc959a700 1 --2- 172.21.15.1:0/2882450857 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5db8004b80 0x7f5db8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:57.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dc959a700 1 -- 172.21.15.1:0/2882450857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc0c09d0 con 0x7f5db80038e0 2023-11-15T01:36:57.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dc959a700 1 -- 172.21.15.1:0/2882450857 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc158820 con 0x7f5db8004b80 2023-11-15T01:36:57.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dc959a700 1 -- 172.21.15.1:0/2882450857 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db800b8e0 con 0x7f5dcc0ab1a0 2023-11-15T01:36:57.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dca59c700 1 --2- 172.21.15.1:0/2882450857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db80038e0 0x7f5db8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:57.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dc9d9b700 1 --2- 172.21.15.1:0/2882450857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dcc0ab1a0 0x7f5db8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:57.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dcad9d700 1 --2- 172.21.15.1:0/2882450857 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5db8004b80 0x7f5db8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:57.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dca59c700 1 -- 172.21.15.1:0/2882450857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dcc0ab1a0 msgr2=0x7f5db8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:57.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dca59c700 1 --2- 172.21.15.1:0/2882450857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dcc0ab1a0 0x7f5db8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dca59c700 1 -- 172.21.15.1:0/2882450857 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5db8004b80 msgr2=0x7f5db8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:57.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dca59c700 1 --2- 172.21.15.1:0/2882450857 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5db8004b80 0x7f5db8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dca59c700 1 -- 172.21.15.1:0/2882450857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db80033f0 con 0x7f5db80038e0 2023-11-15T01:36:57.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dca59c700 1 --2- 172.21.15.1:0/2882450857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db80038e0 0x7f5db8003d00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f5dbc009a80 tx=0x7f5dbc009060).ready entity=mon.0 client_cookie=125f90c436b644c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:57.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dc959a700 1 -- 172.21.15.1:0/2882450857 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc009430 con 0x7f5db80038e0 2023-11-15T01:36:57.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dc959a700 1 -- 172.21.15.1:0/2882450857 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc00e640 con 0x7f5db80038e0 2023-11-15T01:36:57.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.779+0000 7f5dc959a700 1 -- 172.21.15.1:0/2882450857 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc00e9c0 con 0x7f5db80038e0 2023-11-15T01:36:57.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.780+0000 7f5dd08a4700 1 -- 172.21.15.1:0/2882450857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db80038e0 msgr2=0x7f5db8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:57.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.780+0000 7f5dd08a4700 1 --2- 172.21.15.1:0/2882450857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db80038e0 0x7f5db8003d00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f5dbc009a80 tx=0x7f5dbc009060).stop 2023-11-15T01:36:57.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.780+0000 7f5dcad9d700 1 -- 172.21.15.1:0/2882450857 reap_dead start 2023-11-15T01:36:57.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.780+0000 7f5dd08a4700 1 -- 172.21.15.1:0/2882450857 shutdown_connections 2023-11-15T01:36:57.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.780+0000 7f5dd08a4700 1 -- 172.21.15.1:0/2882450857 >> 172.21.15.1:0/2882450857 conn(0x7f5dcc064aa0 msgr2=0x7f5dcc064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:57.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.780+0000 7f5dd08a4700 1 -- 172.21.15.1:0/2882450857 shutdown_connections 2023-11-15T01:36:57.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.780+0000 7f5dd08a4700 1 -- 172.21.15.1:0/2882450857 wait complete. 2023-11-15T01:36:57.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.781+0000 7f5dd08a4700 1 Processor -- start 2023-11-15T01:36:57.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.781+0000 7f5dd08a4700 1 -- start start 2023-11-15T01:36:57.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dd08a4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db80038e0 0x7f5dcc141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:57.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dd08a4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dcc0ae050 0x7f5dcc0c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:57.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dd08a4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dcc0ae4d0 0x7f5dcc0c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:57.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dd08a4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc0c6610 con 0x7f5db80038e0 2023-11-15T01:36:57.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dd08a4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc155410 con 0x7f5dcc0ae4d0 2023-11-15T01:36:57.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dd08a4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc0b0820 con 0x7f5dcc0ae050 2023-11-15T01:36:57.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dca59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db80038e0 0x7f5dcc141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:57.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dca59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db80038e0 0x7f5dcc141e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53322/0 (socket says 172.21.15.1:53322) 2023-11-15T01:36:57.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dca59c700 1 -- 172.21.15.1:0/532616070 learned_addr learned my addr 172.21.15.1:0/532616070 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:57.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dcad9d700 1 --2- 172.21.15.1:0/532616070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dcc0ae4d0 0x7f5dcc0c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:57.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dc9d9b700 1 --2- 172.21.15.1:0/532616070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dcc0ae050 0x7f5dcc0c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:57.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dca59c700 1 -- 172.21.15.1:0/532616070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dcc0ae050 msgr2=0x7f5dcc0c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:57.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dca59c700 1 --2- 172.21.15.1:0/532616070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dcc0ae050 0x7f5dcc0c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dca59c700 1 -- 172.21.15.1:0/532616070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dcc0ae4d0 msgr2=0x7f5dcc0c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:57.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dca59c700 1 --2- 172.21.15.1:0/532616070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dcc0ae4d0 0x7f5dcc0c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dca59c700 1 -- 172.21.15.1:0/532616070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc0b0b00 con 0x7f5db80038e0 2023-11-15T01:36:57.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dc9d9b700 1 --2- 172.21.15.1:0/532616070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dcc0ae050 0x7f5dcc0c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:57.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dca59c700 1 --2- 172.21.15.1:0/532616070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db80038e0 0x7f5dcc141e70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f5db8004570 tx=0x7f5dbc01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:57.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dc27fc700 1 -- 172.21.15.1:0/532616070 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc00ed30 con 0x7f5db80038e0 2023-11-15T01:36:57.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dc27fc700 1 -- 172.21.15.1:0/532616070 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc00ee90 con 0x7f5db80038e0 2023-11-15T01:36:57.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dd08a4700 1 -- 172.21.15.1:0/532616070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dcc0b0de0 con 0x7f5db80038e0 2023-11-15T01:36:57.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.782+0000 7f5dc27fc700 1 -- 172.21.15.1:0/532616070 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc026440 con 0x7f5db80038e0 2023-11-15T01:36:57.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.783+0000 7f5dd08a4700 1 -- 172.21.15.1:0/532616070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dcc14e2a0 con 0x7f5db80038e0 2023-11-15T01:36:57.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.783+0000 7f5dd08a4700 1 -- 172.21.15.1:0/532616070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dcc05e8f0 con 0x7f5db80038e0 2023-11-15T01:36:57.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.784+0000 7f5dc27fc700 1 -- 172.21.15.1:0/532616070 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5dbc02f440 con 0x7f5db80038e0 2023-11-15T01:36:57.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.784+0000 7f5dc27fc700 1 --2- 172.21.15.1:0/532616070 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5dac05f270 0x7f5dac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:57.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.784+0000 7f5dc27fc700 1 -- 172.21.15.1:0/532616070 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f5dbc07c130 con 0x7f5db80038e0 2023-11-15T01:36:57.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.784+0000 7f5dc9d9b700 1 --2- 172.21.15.1:0/532616070 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5dac05f270 0x7f5dac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:57.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.785+0000 7f5dc9d9b700 1 --2- 172.21.15.1:0/532616070 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5dac05f270 0x7f5dac061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5dcc14d630 tx=0x7f5db4008040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:57.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.788+0000 7f5dc27fc700 1 -- 172.21.15.1:0/532616070 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5dbc04d070 con 0x7f5db80038e0 2023-11-15T01:36:57.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.961+0000 7f5dd08a4700 1 -- 172.21.15.1:0/532616070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dcc0b0fd0 con 0x7f5db80038e0 2023-11-15T01:36:57.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.962+0000 7f5dc27fc700 1 -- 172.21.15.1:0/532616070 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+17527 (secure 0 0 0) 0x7f5dbc016090 con 0x7f5db80038e0 2023-11-15T01:36:57.963 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:57.963 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":94,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:36:55.263979+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:36:51.906477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-11-15T01:36:53.240462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:36:57.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.964+0000 7f5dd08a4700 1 -- 172.21.15.1:0/532616070 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5dac05f270 msgr2=0x7f5dac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:57.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.964+0000 7f5dd08a4700 1 --2- 172.21.15.1:0/532616070 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5dac05f270 0x7f5dac061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5dcc14d630 tx=0x7f5db4008040).stop 2023-11-15T01:36:57.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.964+0000 7f5dd08a4700 1 -- 172.21.15.1:0/532616070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db80038e0 msgr2=0x7f5dcc141e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:57.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.964+0000 7f5dd08a4700 1 --2- 172.21.15.1:0/532616070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db80038e0 0x7f5dcc141e70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f5db8004570 tx=0x7f5dbc01a000).stop 2023-11-15T01:36:57.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.965+0000 7f5dd08a4700 1 -- 172.21.15.1:0/532616070 shutdown_connections 2023-11-15T01:36:57.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.965+0000 7f5dd08a4700 1 --2- 172.21.15.1:0/532616070 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5dac05f270 0x7f5dac061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.965+0000 7f5dd08a4700 1 --2- 172.21.15.1:0/532616070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dcc0ae4d0 0x7f5dcc0c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.965+0000 7f5dd08a4700 1 --2- 172.21.15.1:0/532616070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db80038e0 0x7f5dcc141e70 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.965+0000 7f5dd08a4700 1 --2- 172.21.15.1:0/532616070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dcc0ae050 0x7f5dcc0c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:57.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.965+0000 7f5dd08a4700 1 -- 172.21.15.1:0/532616070 >> 172.21.15.1:0/532616070 conn(0x7f5dcc064aa0 msgr2=0x7f5dcc0ac8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:57.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.965+0000 7f5dd08a4700 1 -- 172.21.15.1:0/532616070 shutdown_connections 2023-11-15T01:36:57.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:57.965+0000 7f5dd08a4700 1 -- 172.21.15.1:0/532616070 wait complete. 2023-11-15T01:36:57.977 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-15T01:36:57.978 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:36:58.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.096+0000 7f09fb59e700 1 Processor -- start 2023-11-15T01:36:58.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.096+0000 7f09fb59e700 1 -- start start 2023-11-15T01:36:58.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.097+0000 7f09fb59e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f09fc151e10 0x7f09fc155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.097+0000 7f09fb59e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f09fc0c98b0 0x7f09fc0c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.097+0000 7f09fb59e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc0c7980 con 0x7f09fc0c86b0 2023-11-15T01:36:58.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.097+0000 7f09fb59e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc0c8b10 con 0x7f09fc0c98b0 2023-11-15T01:36:58.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.097+0000 7f09fb59e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc0aa890 con 0x7f09fc151e10 2023-11-15T01:36:58.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.097+0000 7f09fad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f09fc0c98b0 0x7f09fc0c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.097+0000 7f09fad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f09fc0c98b0 0x7f09fc0c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53336/0 (socket says 172.21.15.1:53336) 2023-11-15T01:36:58.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.097+0000 7f09fad9d700 1 -- 172.21.15.1:0/3892850825 learned_addr learned my addr 172.21.15.1:0/3892850825 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:58.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.097+0000 7f09fa59c700 1 --2- 172.21.15.1:0/3892850825 >> v2:172.21.15.141:3300/0 conn(0x7f09fc151e10 0x7f09fc155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.097+0000 7f09fad9d700 1 -- 172.21.15.1:0/3892850825 >> v2:172.21.15.141:3300/0 conn(0x7f09fc151e10 msgr2=0x7f09fc155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:58.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.097+0000 7f09fad9d700 1 --2- 172.21.15.1:0/3892850825 >> v2:172.21.15.141:3300/0 conn(0x7f09fc151e10 0x7f09fc155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.097+0000 7f09fad9d700 1 -- 172.21.15.1:0/3892850825 >> v1:172.21.15.141:6789/0 conn(0x7f09fc0c86b0 legacy=0x7f09fc0aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.097+0000 7f09fad9d700 1 -- 172.21.15.1:0/3892850825 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc0c7bd0 con 0x7f09fc0c98b0 2023-11-15T01:36:58.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.097+0000 7f09fad9d700 1 --2- 172.21.15.1:0/3892850825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09fc0c98b0 0x7f09fc0c9cc0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f09fc084780 tx=0x7f09f4009840).ready entity=mon.0 client_cookie=4490e0a9f50452 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:58.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.098+0000 7f09f959a700 1 -- 172.21.15.1:0/3892850825 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f400e070 con 0x7f09fc0c98b0 2023-11-15T01:36:58.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.098+0000 7f09f959a700 1 -- 172.21.15.1:0/3892850825 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f400ba20 con 0x7f09fc0c98b0 2023-11-15T01:36:58.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.098+0000 7f09f959a700 1 -- 172.21.15.1:0/3892850825 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f400bda0 con 0x7f09fc0c98b0 2023-11-15T01:36:58.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.098+0000 7f09fb59e700 1 -- 172.21.15.1:0/3892850825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09fc0c98b0 msgr2=0x7f09fc0c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.098+0000 7f09fb59e700 1 --2- 172.21.15.1:0/3892850825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09fc0c98b0 0x7f09fc0c9cc0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f09fc084780 tx=0x7f09f4009840).stop 2023-11-15T01:36:58.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.098+0000 7f09fb59e700 1 -- 172.21.15.1:0/3892850825 shutdown_connections 2023-11-15T01:36:58.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.098+0000 7f09fb59e700 1 --2- 172.21.15.1:0/3892850825 >> v2:172.21.15.141:3300/0 conn(0x7f09fc151e10 0x7f09fc155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.098+0000 7f09fb59e700 1 --2- 172.21.15.1:0/3892850825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09fc0c98b0 0x7f09fc0c9cc0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.098+0000 7f09fb59e700 1 -- 172.21.15.1:0/3892850825 >> 172.21.15.1:0/3892850825 conn(0x7f09fc0947e0 msgr2=0x7f09fc06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:58.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.098+0000 7f09fb59e700 1 -- 172.21.15.1:0/3892850825 shutdown_connections 2023-11-15T01:36:58.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.098+0000 7f09fb59e700 1 -- 172.21.15.1:0/3892850825 wait complete. 2023-11-15T01:36:58.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.099+0000 7f09fb59e700 1 Processor -- start 2023-11-15T01:36:58.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.099+0000 7f09fb59e700 1 -- start start 2023-11-15T01:36:58.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.100+0000 7f09fb59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09fc0c86b0 0x7f09fc0ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.100+0000 7f09fb59e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09fc0c98b0 0x7f09fc0ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.100+0000 7f09fb59e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09fc151e10 0x7f09fc0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.100+0000 7f09fb59e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0aef10 con 0x7f09fc0c86b0 2023-11-15T01:36:58.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.100+0000 7f09fb59e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0a97a0 con 0x7f09fc151e10 2023-11-15T01:36:58.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.100+0000 7f09fb59e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0a8b90 con 0x7f09fc0c98b0 2023-11-15T01:36:58.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.100+0000 7f09fa59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09fc0c86b0 0x7f09fc0ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.100+0000 7f09fa59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09fc0c86b0 0x7f09fc0ad420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53346/0 (socket says 172.21.15.1:53346) 2023-11-15T01:36:58.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.100+0000 7f09fa59c700 1 -- 172.21.15.1:0/1223351354 learned_addr learned my addr 172.21.15.1:0/1223351354 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:58.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.100+0000 7f09fad9d700 1 --2- 172.21.15.1:0/1223351354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09fc151e10 0x7f09fc0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.100+0000 7f09f9d9b700 1 --2- 172.21.15.1:0/1223351354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09fc0c98b0 0x7f09fc0ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.100+0000 7f09fa59c700 1 -- 172.21.15.1:0/1223351354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09fc0c98b0 msgr2=0x7f09fc0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.101+0000 7f09fa59c700 1 --2- 172.21.15.1:0/1223351354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09fc0c98b0 0x7f09fc0ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.101+0000 7f09fa59c700 1 -- 172.21.15.1:0/1223351354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09fc151e10 msgr2=0x7f09fc0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.101+0000 7f09fa59c700 1 --2- 172.21.15.1:0/1223351354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09fc151e10 0x7f09fc0aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.101+0000 7f09fa59c700 1 -- 172.21.15.1:0/1223351354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f4009ae0 con 0x7f09fc0c86b0 2023-11-15T01:36:58.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.101+0000 7f09fad9d700 1 --2- 172.21.15.1:0/1223351354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09fc151e10 0x7f09fc0aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:58.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.101+0000 7f09fa59c700 1 --2- 172.21.15.1:0/1223351354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09fc0c86b0 0x7f09fc0ad420 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f09ec00e900 tx=0x7f09ec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:58.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.101+0000 7f09ea7fc700 1 -- 172.21.15.1:0/1223351354 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec00c640 con 0x7f09fc0c86b0 2023-11-15T01:36:58.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.101+0000 7f09ea7fc700 1 -- 172.21.15.1:0/1223351354 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec00c7a0 con 0x7f09fc0c86b0 2023-11-15T01:36:58.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.101+0000 7f09ea7fc700 1 -- 172.21.15.1:0/1223351354 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec00cb20 con 0x7f09fc0c86b0 2023-11-15T01:36:58.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.101+0000 7f09fb59e700 1 -- 172.21.15.1:0/1223351354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09fc0a8e70 con 0x7f09fc0c86b0 2023-11-15T01:36:58.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.101+0000 7f09fb59e700 1 -- 172.21.15.1:0/1223351354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc0a9430 con 0x7f09fc0c86b0 2023-11-15T01:36:58.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.102+0000 7f09fb59e700 1 -- 172.21.15.1:0/1223351354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09fc0475e0 con 0x7f09fc0c86b0 2023-11-15T01:36:58.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.102+0000 7f09ea7fc700 1 -- 172.21.15.1:0/1223351354 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f09ec01b400 con 0x7f09fc0c86b0 2023-11-15T01:36:58.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.102+0000 7f09ea7fc700 1 --2- 172.21.15.1:0/1223351354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f09dc05f270 0x7f09dc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.103+0000 7f09ea7fc700 1 -- 172.21.15.1:0/1223351354 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f09ec07a9b0 con 0x7f09fc0c86b0 2023-11-15T01:36:58.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.103+0000 7f09f9d9b700 1 --2- 172.21.15.1:0/1223351354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f09dc05f270 0x7f09dc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.103+0000 7f09f9d9b700 1 --2- 172.21.15.1:0/1223351354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f09dc05f270 0x7f09dc061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f09fc155330 tx=0x7f09f0009040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:58.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.107+0000 7f09ea7fc700 1 -- 172.21.15.1:0/1223351354 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f09ec04b8f0 con 0x7f09fc0c86b0 2023-11-15T01:36:58.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.276+0000 7f09fb59e700 1 -- 172.21.15.1:0/1223351354 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09fc0c7eb0 con 0x7f09dc05f270 2023-11-15T01:36:58.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.287+0000 7f09ea7fc700 1 -- 172.21.15.1:0/1223351354 <== mgr.5627 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360906 (secure 0 0 0) 0x7f09fc0c7eb0 con 0x7f09dc05f270 2023-11-15T01:36:58.292 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:58.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.291+0000 7f09fb59e700 1 -- 172.21.15.1:0/1223351354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f09dc05f270 msgr2=0x7f09dc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.291+0000 7f09fb59e700 1 --2- 172.21.15.1:0/1223351354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f09dc05f270 0x7f09dc061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f09fc155330 tx=0x7f09f0009040).stop 2023-11-15T01:36:58.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.291+0000 7f09fb59e700 1 -- 172.21.15.1:0/1223351354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09fc0c86b0 msgr2=0x7f09fc0ad420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.291+0000 7f09fb59e700 1 --2- 172.21.15.1:0/1223351354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09fc0c86b0 0x7f09fc0ad420 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f09ec00e900 tx=0x7f09ec009060).stop 2023-11-15T01:36:58.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.291+0000 7f09fb59e700 1 -- 172.21.15.1:0/1223351354 shutdown_connections 2023-11-15T01:36:58.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.291+0000 7f09fb59e700 1 --2- 172.21.15.1:0/1223351354 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f09dc05f270 0x7f09dc061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.291+0000 7f09fb59e700 1 --2- 172.21.15.1:0/1223351354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09fc151e10 0x7f09fc0aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.291+0000 7f09fb59e700 1 --2- 172.21.15.1:0/1223351354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09fc0c86b0 0x7f09fc0ad420 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.291+0000 7f09fb59e700 1 --2- 172.21.15.1:0/1223351354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09fc0c98b0 0x7f09fc0ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.291+0000 7f09fb59e700 1 -- 172.21.15.1:0/1223351354 >> 172.21.15.1:0/1223351354 conn(0x7f09fc0947e0 msgr2=0x7f09fc150d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:58.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.291+0000 7f09fb59e700 1 -- 172.21.15.1:0/1223351354 shutdown_connections 2023-11-15T01:36:58.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.291+0000 7f09fb59e700 1 -- 172.21.15.1:0/1223351354 wait complete. 2023-11-15T01:36:58.297 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:36:58.303 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T01:36:56.314457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2426728,"kb_used_data":9000,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752547992,"statfs":{"total":773094113280,"available":770609143808,"internally_reserved":0,"allocated":9216000,"data_stored":4662388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11233,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.204644"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290266+0000","last_change":"2023-11-15T01:36:54.282347+0000","last_active":"2023-11-15T01:36:54.290266+0000","last_peered":"2023-11-15T01:36:54.290266+0000","last_clean":"2023-11-15T01:36:54.290266+0000","last_became_active":"2023-11-15T01:36:54.282073+0000","last_became_peered":"2023-11-15T01:36:54.282073+0000","last_unstale":"2023-11-15T01:36:54.290266+0000","last_undegraded":"2023-11-15T01:36:54.290266+0000","last_fullsized":"2023-11-15T01:36:54.290266+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"93'3","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291636+0000","last_change":"2023-11-15T01:36:53.886207+0000","last_active":"2023-11-15T01:36:54.291636+0000","last_peered":"2023-11-15T01:36:54.291636+0000","last_clean":"2023-11-15T01:36:54.291636+0000","last_became_active":"2023-11-15T01:36:53.885900+0000","last_became_peered":"2023-11-15T01:36:53.885900+0000","last_unstale":"2023-11-15T01:36:54.291636+0000","last_undegraded":"2023-11-15T01:36:54.291636+0000","last_fullsized":"2023-11-15T01:36:54.291636+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285900+0000","last_change":"2023-11-15T01:36:54.283860+0000","last_active":"2023-11-15T01:36:54.285900+0000","last_peered":"2023-11-15T01:36:54.285900+0000","last_clean":"2023-11-15T01:36:54.285900+0000","last_became_active":"2023-11-15T01:36:54.283447+0000","last_became_peered":"2023-11-15T01:36:54.283447+0000","last_unstale":"2023-11-15T01:36:54.285900+0000","last_undegraded":"2023-11-15T01:36:54.285900+0000","last_fullsized":"2023-11-15T01:36:54.285900+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269219+0000","last_change":"2023-11-15T01:36:53.891475+0000","last_active":"2023-11-15T01:36:54.269219+0000","last_peered":"2023-11-15T01:36:54.269219+0000","last_clean":"2023-11-15T01:36:54.269219+0000","last_became_active":"2023-11-15T01:36:53.891188+0000","last_became_peered":"2023-11-15T01:36:53.891188+0000","last_unstale":"2023-11-15T01:36:54.269219+0000","last_undegraded":"2023-11-15T01:36:54.269219+0000","last_fullsized":"2023-11-15T01:36:54.269219+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290998+0000","last_change":"2023-11-15T01:36:54.288857+0000","last_active":"2023-11-15T01:36:54.290998+0000","last_peered":"2023-11-15T01:36:54.290998+0000","last_clean":"2023-11-15T01:36:54.290998+0000","last_became_active":"2023-11-15T01:36:54.287849+0000","last_became_peered":"2023-11-15T01:36:54.287849+0000","last_unstale":"2023-11-15T01:36:54.290998+0000","last_undegraded":"2023-11-15T01:36:54.290998+0000","last_fullsized":"2023-11-15T01:36:54.290998+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287448+0000","last_change":"2023-11-15T01:36:53.880199+0000","last_active":"2023-11-15T01:36:54.287448+0000","last_peered":"2023-11-15T01:36:54.287448+0000","last_clean":"2023-11-15T01:36:54.287448+0000","last_became_active":"2023-11-15T01:36:53.879794+0000","last_became_peered":"2023-11-15T01:36:53.879794+0000","last_unstale":"2023-11-15T01:36:54.287448+0000","last_undegraded":"2023-11-15T01:36:54.287448+0000","last_fullsized":"2023-11-15T01:36:54.287448+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291202+0000","last_change":"2023-11-15T01:36:54.289552+0000","last_active":"2023-11-15T01:36:54.291202+0000","last_peered":"2023-11-15T01:36:54.291202+0000","last_clean":"2023-11-15T01:36:54.291202+0000","last_became_active":"2023-11-15T01:36:54.285340+0000","last_became_peered":"2023-11-15T01:36:54.285340+0000","last_unstale":"2023-11-15T01:36:54.291202+0000","last_undegraded":"2023-11-15T01:36:54.291202+0000","last_fullsized":"2023-11-15T01:36:54.291202+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285842+0000","last_change":"2023-11-15T01:36:53.884903+0000","last_active":"2023-11-15T01:36:54.285842+0000","last_peered":"2023-11-15T01:36:54.285842+0000","last_clean":"2023-11-15T01:36:54.285842+0000","last_became_active":"2023-11-15T01:36:53.884613+0000","last_became_peered":"2023-11-15T01:36:53.884613+0000","last_unstale":"2023-11-15T01:36:54.285842+0000","last_undegraded":"2023-11-15T01:36:54.285842+0000","last_fullsized":"2023-11-15T01:36:54.285842+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.289197+0000","last_change":"2023-11-15T01:36:54.286008+0000","last_active":"2023-11-15T01:36:54.289197+0000","last_peered":"2023-11-15T01:36:54.289197+0000","last_clean":"2023-11-15T01:36:54.289197+0000","last_became_active":"2023-11-15T01:36:54.285698+0000","last_became_peered":"2023-11-15T01:36:54.285698+0000","last_unstale":"2023-11-15T01:36:54.289197+0000","last_undegraded":"2023-11-15T01:36:54.289197+0000","last_fullsized":"2023-11-15T01:36:54.289197+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285112+0000","last_change":"2023-11-15T01:36:53.885300+0000","last_active":"2023-11-15T01:36:54.285112+0000","last_peered":"2023-11-15T01:36:54.285112+0000","last_clean":"2023-11-15T01:36:54.285112+0000","last_became_active":"2023-11-15T01:36:53.884899+0000","last_became_peered":"2023-11-15T01:36:53.884899+0000","last_unstale":"2023-11-15T01:36:54.285112+0000","last_undegraded":"2023-11-15T01:36:54.285112+0000","last_fullsized":"2023-11-15T01:36:54.285112+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286597+0000","last_change":"2023-11-15T01:36:54.282918+0000","last_active":"2023-11-15T01:36:54.286597+0000","last_peered":"2023-11-15T01:36:54.286597+0000","last_clean":"2023-11-15T01:36:54.286597+0000","last_became_active":"2023-11-15T01:36:54.279420+0000","last_became_peered":"2023-11-15T01:36:54.279420+0000","last_unstale":"2023-11-15T01:36:54.286597+0000","last_undegraded":"2023-11-15T01:36:54.286597+0000","last_fullsized":"2023-11-15T01:36:54.286597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284891+0000","last_change":"2023-11-15T01:36:53.889515+0000","last_active":"2023-11-15T01:36:54.284891+0000","last_peered":"2023-11-15T01:36:54.284891+0000","last_clean":"2023-11-15T01:36:54.284891+0000","last_became_active":"2023-11-15T01:36:53.889219+0000","last_became_peered":"2023-11-15T01:36:53.889219+0000","last_unstale":"2023-11-15T01:36:54.284891+0000","last_undegraded":"2023-11-15T01:36:54.284891+0000","last_fullsized":"2023-11-15T01:36:54.284891+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285911+0000","last_change":"2023-11-15T01:36:54.279517+0000","last_active":"2023-11-15T01:36:54.285911+0000","last_peered":"2023-11-15T01:36:54.285911+0000","last_clean":"2023-11-15T01:36:54.285911+0000","last_became_active":"2023-11-15T01:36:54.279211+0000","last_became_peered":"2023-11-15T01:36:54.279211+0000","last_unstale":"2023-11-15T01:36:54.285911+0000","last_undegraded":"2023-11-15T01:36:54.285911+0000","last_fullsized":"2023-11-15T01:36:54.285911+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.279243+0000","last_change":"2023-11-15T01:36:53.886821+0000","last_active":"2023-11-15T01:36:54.279243+0000","last_peered":"2023-11-15T01:36:54.279243+0000","last_clean":"2023-11-15T01:36:54.279243+0000","last_became_active":"2023-11-15T01:36:53.886343+0000","last_became_peered":"2023-11-15T01:36:53.886343+0000","last_unstale":"2023-11-15T01:36:54.279243+0000","last_undegraded":"2023-11-15T01:36:54.279243+0000","last_fullsized":"2023-11-15T01:36:54.279243+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284532+0000","last_change":"2023-11-15T01:36:54.280666+0000","last_active":"2023-11-15T01:36:54.284532+0000","last_peered":"2023-11-15T01:36:54.284532+0000","last_clean":"2023-11-15T01:36:54.284532+0000","last_became_active":"2023-11-15T01:36:54.280388+0000","last_became_peered":"2023-11-15T01:36:54.280388+0000","last_unstale":"2023-11-15T01:36:54.284532+0000","last_undegraded":"2023-11-15T01:36:54.284532+0000","last_fullsized":"2023-11-15T01:36:54.284532+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269171+0000","last_change":"2023-11-15T01:36:53.889196+0000","last_active":"2023-11-15T01:36:54.269171+0000","last_peered":"2023-11-15T01:36:54.269171+0000","last_clean":"2023-11-15T01:36:54.269171+0000","last_became_active":"2023-11-15T01:36:53.888924+0000","last_became_peered":"2023-11-15T01:36:53.888924+0000","last_unstale":"2023-11-15T01:36:54.269171+0000","last_undegraded":"2023-11-15T01:36:54.269171+0000","last_fullsized":"2023-11-15T01:36:54.269171+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.283672+0000","last_change":"2023-11-15T01:36:54.282845+0000","last_active":"2023-11-15T01:36:54.283672+0000","last_peered":"2023-11-15T01:36:54.283672+0000","last_clean":"2023-11-15T01:36:54.283672+0000","last_became_active":"2023-11-15T01:36:54.282563+0000","last_became_peered":"2023-11-15T01:36:54.282563+0000","last_unstale":"2023-11-15T01:36:54.283672+0000","last_undegraded":"2023-11-15T01:36:54.283672+0000","last_fullsized":"2023-11-15T01:36:54.283672+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270732+0000","last_change":"2023-11-15T01:36:53.889042+0000","last_active":"2023-11-15T01:36:54.270732+0000","last_peered":"2023-11-15T01:36:54.270732+0000","last_clean":"2023-11-15T01:36:54.270732+0000","last_became_active":"2023-11-15T01:36:53.888667+0000","last_became_peered":"2023-11-15T01:36:53.888667+0000","last_unstale":"2023-11-15T01:36:54.270732+0000","last_undegraded":"2023-11-15T01:36:54.270732+0000","last_fullsized":"2023-11-15T01:36:54.270732+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285896+0000","last_change":"2023-11-15T01:36:54.279534+0000","last_active":"2023-11-15T01:36:54.285896+0000","last_peered":"2023-11-15T01:36:54.285896+0000","last_clean":"2023-11-15T01:36:54.285896+0000","last_became_active":"2023-11-15T01:36:54.279222+0000","last_became_peered":"2023-11-15T01:36:54.279222+0000","last_unstale":"2023-11-15T01:36:54.285896+0000","last_undegraded":"2023-11-15T01:36:54.285896+0000","last_fullsized":"2023-11-15T01:36:54.285896+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.273944+0000","last_change":"2023-11-15T01:36:53.884124+0000","last_active":"2023-11-15T01:36:54.273944+0000","last_peered":"2023-11-15T01:36:54.273944+0000","last_clean":"2023-11-15T01:36:54.273944+0000","last_became_active":"2023-11-15T01:36:53.883822+0000","last_became_peered":"2023-11-15T01:36:53.883822+0000","last_unstale":"2023-11-15T01:36:54.273944+0000","last_undegraded":"2023-11-15T01:36:54.273944+0000","last_fullsized":"2023-11-15T01:36:54.273944+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.289833+0000","last_change":"2023-11-15T01:36:54.288008+0000","last_active":"2023-11-15T01:36:54.289833+0000","last_peered":"2023-11-15T01:36:54.289833+0000","last_clean":"2023-11-15T01:36:54.289833+0000","last_became_active":"2023-11-15T01:36:54.287055+0000","last_became_peered":"2023-11-15T01:36:54.287055+0000","last_unstale":"2023-11-15T01:36:54.289833+0000","last_undegraded":"2023-11-15T01:36:54.289833+0000","last_fullsized":"2023-11-15T01:36:54.289833+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.272421+0000","last_change":"2023-11-15T01:36:53.889069+0000","last_active":"2023-11-15T01:36:54.272421+0000","last_peered":"2023-11-15T01:36:54.272421+0000","last_clean":"2023-11-15T01:36:54.272421+0000","last_became_active":"2023-11-15T01:36:53.888808+0000","last_became_peered":"2023-11-15T01:36:53.888808+0000","last_unstale":"2023-11-15T01:36:54.272421+0000","last_undegraded":"2023-11-15T01:36:54.272421+0000","last_fullsized":"2023-11-15T01:36:54.272421+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291648+0000","last_change":"2023-11-15T01:36:54.290805+0000","last_active":"2023-11-15T01:36:54.291648+0000","last_peered":"2023-11-15T01:36:54.291648+0000","last_clean":"2023-11-15T01:36:54.291648+0000","last_became_active":"2023-11-15T01:36:54.289932+0000","last_became_peered":"2023-11-15T01:36:54.289932+0000","last_unstale":"2023-11-15T01:36:54.291648+0000","last_undegraded":"2023-11-15T01:36:54.291648+0000","last_fullsized":"2023-11-15T01:36:54.291648+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.296673+0000","last_change":"2023-11-15T01:36:53.882772+0000","last_active":"2023-11-15T01:36:54.296673+0000","last_peered":"2023-11-15T01:36:54.296673+0000","last_clean":"2023-11-15T01:36:54.296673+0000","last_became_active":"2023-11-15T01:36:53.882233+0000","last_became_peered":"2023-11-15T01:36:53.882233+0000","last_unstale":"2023-11-15T01:36:54.296673+0000","last_undegraded":"2023-11-15T01:36:54.296673+0000","last_fullsized":"2023-11-15T01:36:54.296673+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.297568+0000","last_change":"2023-11-15T01:36:54.297045+0000","last_active":"2023-11-15T01:36:54.297568+0000","last_peered":"2023-11-15T01:36:54.297568+0000","last_clean":"2023-11-15T01:36:54.297568+0000","last_became_active":"2023-11-15T01:36:54.296792+0000","last_became_peered":"2023-11-15T01:36:54.296792+0000","last_unstale":"2023-11-15T01:36:54.297568+0000","last_undegraded":"2023-11-15T01:36:54.297568+0000","last_fullsized":"2023-11-15T01:36:54.297568+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.280380+0000","last_change":"2023-11-15T01:36:53.881311+0000","last_active":"2023-11-15T01:36:54.280380+0000","last_peered":"2023-11-15T01:36:54.280380+0000","last_clean":"2023-11-15T01:36:54.280380+0000","last_became_active":"2023-11-15T01:36:53.881044+0000","last_became_peered":"2023-11-15T01:36:53.881044+0000","last_unstale":"2023-11-15T01:36:54.280380+0000","last_undegraded":"2023-11-15T01:36:54.280380+0000","last_fullsized":"2023-11-15T01:36:54.280380+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.296218+0000","last_change":"2023-11-15T01:36:54.295456+0000","last_active":"2023-11-15T01:36:54.296218+0000","last_peered":"2023-11-15T01:36:54.296218+0000","last_clean":"2023-11-15T01:36:54.296218+0000","last_became_active":"2023-11-15T01:36:54.294904+0000","last_became_peered":"2023-11-15T01:36:54.294904+0000","last_unstale":"2023-11-15T01:36:54.296218+0000","last_undegraded":"2023-11-15T01:36:54.296218+0000","last_fullsized":"2023-11-15T01:36:54.296218+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.272426+0000","last_change":"2023-11-15T01:36:53.886059+0000","last_active":"2023-11-15T01:36:54.272426+0000","last_peered":"2023-11-15T01:36:54.272426+0000","last_clean":"2023-11-15T01:36:54.272426+0000","last_became_active":"2023-11-15T01:36:53.885735+0000","last_became_peered":"2023-11-15T01:36:53.885735+0000","last_unstale":"2023-11-15T01:36:54.272426+0000","last_undegraded":"2023-11-15T01:36:54.272426+0000","last_fullsized":"2023-11-15T01:36:54.272426+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286203+0000","last_change":"2023-11-15T01:36:54.281640+0000","last_active":"2023-11-15T01:36:54.286203+0000","last_peered":"2023-11-15T01:36:54.286203+0000","last_clean":"2023-11-15T01:36:54.286203+0000","last_became_active":"2023-11-15T01:36:54.281367+0000","last_became_peered":"2023-11-15T01:36:54.281367+0000","last_unstale":"2023-11-15T01:36:54.286203+0000","last_undegraded":"2023-11-15T01:36:54.286203+0000","last_fullsized":"2023-11-15T01:36:54.286203+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.266449+0000","last_change":"2023-11-15T01:36:53.890222+0000","last_active":"2023-11-15T01:36:54.266449+0000","last_peered":"2023-11-15T01:36:54.266449+0000","last_clean":"2023-11-15T01:36:54.266449+0000","last_became_active":"2023-11-15T01:36:53.889231+0000","last_became_peered":"2023-11-15T01:36:53.889231+0000","last_unstale":"2023-11-15T01:36:54.266449+0000","last_undegraded":"2023-11-15T01:36:54.266449+0000","last_fullsized":"2023-11-15T01:36:54.266449+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291018+0000","last_change":"2023-11-15T01:36:54.290365+0000","last_active":"2023-11-15T01:36:54.291018+0000","last_peered":"2023-11-15T01:36:54.291018+0000","last_clean":"2023-11-15T01:36:54.291018+0000","last_became_active":"2023-11-15T01:36:54.289897+0000","last_became_peered":"2023-11-15T01:36:54.289897+0000","last_unstale":"2023-11-15T01:36:54.291018+0000","last_undegraded":"2023-11-15T01:36:54.291018+0000","last_fullsized":"2023-11-15T01:36:54.291018+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284771+0000","last_change":"2023-11-15T01:36:53.889211+0000","last_active":"2023-11-15T01:36:54.284771+0000","last_peered":"2023-11-15T01:36:54.284771+0000","last_clean":"2023-11-15T01:36:54.284771+0000","last_became_active":"2023-11-15T01:36:53.888912+0000","last_became_peered":"2023-11-15T01:36:53.888912+0000","last_unstale":"2023-11-15T01:36:54.284771+0000","last_undegraded":"2023-11-15T01:36:54.284771+0000","last_fullsized":"2023-11-15T01:36:54.284771+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.295430+0000","last_change":"2023-11-15T01:36:54.293187+0000","last_active":"2023-11-15T01:36:54.295430+0000","last_peered":"2023-11-15T01:36:54.295430+0000","last_clean":"2023-11-15T01:36:54.295430+0000","last_became_active":"2023-11-15T01:36:54.292892+0000","last_became_peered":"2023-11-15T01:36:54.292892+0000","last_unstale":"2023-11-15T01:36:54.295430+0000","last_undegraded":"2023-11-15T01:36:54.295430+0000","last_fullsized":"2023-11-15T01:36:54.295430+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271679+0000","last_change":"2023-11-15T01:36:53.889227+0000","last_active":"2023-11-15T01:36:54.271679+0000","last_peered":"2023-11-15T01:36:54.271679+0000","last_clean":"2023-11-15T01:36:54.271679+0000","last_became_active":"2023-11-15T01:36:53.888810+0000","last_became_peered":"2023-11-15T01:36:53.888810+0000","last_unstale":"2023-11-15T01:36:54.271679+0000","last_undegraded":"2023-11-15T01:36:54.271679+0000","last_fullsized":"2023-11-15T01:36:54.271679+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287898+0000","last_change":"2023-11-15T01:36:54.287042+0000","last_active":"2023-11-15T01:36:54.287898+0000","last_peered":"2023-11-15T01:36:54.287898+0000","last_clean":"2023-11-15T01:36:54.287898+0000","last_became_active":"2023-11-15T01:36:54.286758+0000","last_became_peered":"2023-11-15T01:36:54.286758+0000","last_unstale":"2023-11-15T01:36:54.287898+0000","last_undegraded":"2023-11-15T01:36:54.287898+0000","last_fullsized":"2023-11-15T01:36:54.287898+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269854+0000","last_change":"2023-11-15T01:36:53.892220+0000","last_active":"2023-11-15T01:36:54.269854+0000","last_peered":"2023-11-15T01:36:54.269854+0000","last_clean":"2023-11-15T01:36:54.269854+0000","last_became_active":"2023-11-15T01:36:53.891920+0000","last_became_peered":"2023-11-15T01:36:53.891920+0000","last_unstale":"2023-11-15T01:36:54.269854+0000","last_undegraded":"2023-11-15T01:36:54.269854+0000","last_fullsized":"2023-11-15T01:36:54.269854+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291072+0000","last_change":"2023-11-15T01:36:54.289875+0000","last_active":"2023-11-15T01:36:54.291072+0000","last_peered":"2023-11-15T01:36:54.291072+0000","last_clean":"2023-11-15T01:36:54.291072+0000","last_became_active":"2023-11-15T01:36:54.289598+0000","last_became_peered":"2023-11-15T01:36:54.289598+0000","last_unstale":"2023-11-15T01:36:54.291072+0000","last_undegraded":"2023-11-15T01:36:54.291072+0000","last_fullsized":"2023-11-15T01:36:54.291072+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287371+0000","last_change":"2023-11-15T01:36:53.888740+0000","last_active":"2023-11-15T01:36:54.287371+0000","last_peered":"2023-11-15T01:36:54.287371+0000","last_clean":"2023-11-15T01:36:54.287371+0000","last_became_active":"2023-11-15T01:36:53.888166+0000","last_became_peered":"2023-11-15T01:36:53.888166+0000","last_unstale":"2023-11-15T01:36:54.287371+0000","last_undegraded":"2023-11-15T01:36:54.287371+0000","last_fullsized":"2023-11-15T01:36:54.287371+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284298+0000","last_change":"2023-11-15T01:36:54.281888+0000","last_active":"2023-11-15T01:36:54.284298+0000","last_peered":"2023-11-15T01:36:54.284298+0000","last_clean":"2023-11-15T01:36:54.284298+0000","last_became_active":"2023-11-15T01:36:54.281592+0000","last_became_peered":"2023-11-15T01:36:54.281592+0000","last_unstale":"2023-11-15T01:36:54.284298+0000","last_undegraded":"2023-11-15T01:36:54.284298+0000","last_fullsized":"2023-11-15T01:36:54.284298+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.267605+0000","last_change":"2023-11-15T01:36:53.883412+0000","last_active":"2023-11-15T01:36:54.267605+0000","last_peered":"2023-11-15T01:36:54.267605+0000","last_clean":"2023-11-15T01:36:54.267605+0000","last_became_active":"2023-11-15T01:36:53.883087+0000","last_became_peered":"2023-11-15T01:36:53.883087+0000","last_unstale":"2023-11-15T01:36:54.267605+0000","last_undegraded":"2023-11-15T01:36:54.267605+0000","last_fullsized":"2023-11-15T01:36:54.267605+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291060+0000","last_change":"2023-11-15T01:36:54.289221+0000","last_active":"2023-11-15T01:36:54.291060+0000","last_peered":"2023-11-15T01:36:54.291060+0000","last_clean":"2023-11-15T01:36:54.291060+0000","last_became_active":"2023-11-15T01:36:54.288813+0000","last_became_peered":"2023-11-15T01:36:54.288813+0000","last_unstale":"2023-11-15T01:36:54.291060+0000","last_undegraded":"2023-11-15T01:36:54.291060+0000","last_fullsized":"2023-11-15T01:36:54.291060+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.279362+0000","last_change":"2023-11-15T01:36:53.884216+0000","last_active":"2023-11-15T01:36:54.279362+0000","last_peered":"2023-11-15T01:36:54.279362+0000","last_clean":"2023-11-15T01:36:54.279362+0000","last_became_active":"2023-11-15T01:36:53.883877+0000","last_became_peered":"2023-11-15T01:36:53.883877+0000","last_unstale":"2023-11-15T01:36:54.279362+0000","last_undegraded":"2023-11-15T01:36:54.279362+0000","last_fullsized":"2023-11-15T01:36:54.279362+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.292132+0000","last_change":"2023-11-15T01:36:54.291610+0000","last_active":"2023-11-15T01:36:54.292132+0000","last_peered":"2023-11-15T01:36:54.292132+0000","last_clean":"2023-11-15T01:36:54.292132+0000","last_became_active":"2023-11-15T01:36:54.291311+0000","last_became_peered":"2023-11-15T01:36:54.291311+0000","last_unstale":"2023-11-15T01:36:54.292132+0000","last_undegraded":"2023-11-15T01:36:54.292132+0000","last_fullsized":"2023-11-15T01:36:54.292132+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.273597+0000","last_change":"2023-11-15T01:36:53.884348+0000","last_active":"2023-11-15T01:36:54.273597+0000","last_peered":"2023-11-15T01:36:54.273597+0000","last_clean":"2023-11-15T01:36:54.273597+0000","last_became_active":"2023-11-15T01:36:53.884008+0000","last_became_peered":"2023-11-15T01:36:53.884008+0000","last_unstale":"2023-11-15T01:36:54.273597+0000","last_undegraded":"2023-11-15T01:36:54.273597+0000","last_fullsized":"2023-11-15T01:36:54.273597+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286425+0000","last_change":"2023-11-15T01:36:54.281468+0000","last_active":"2023-11-15T01:36:54.286425+0000","last_peered":"2023-11-15T01:36:54.286425+0000","last_clean":"2023-11-15T01:36:54.286425+0000","last_became_active":"2023-11-15T01:36:54.281166+0000","last_became_peered":"2023-11-15T01:36:54.281166+0000","last_unstale":"2023-11-15T01:36:54.286425+0000","last_undegraded":"2023-11-15T01:36:54.286425+0000","last_fullsized":"2023-11-15T01:36:54.286425+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271214+0000","last_change":"2023-11-15T01:36:53.884263+0000","last_active":"2023-11-15T01:36:54.271214+0000","last_peered":"2023-11-15T01:36:54.271214+0000","last_clean":"2023-11-15T01:36:54.271214+0000","last_became_active":"2023-11-15T01:36:53.883955+0000","last_became_peered":"2023-11-15T01:36:53.883955+0000","last_unstale":"2023-11-15T01:36:54.271214+0000","last_undegraded":"2023-11-15T01:36:54.271214+0000","last_fullsized":"2023-11-15T01:36:54.271214+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290702+0000","last_change":"2023-11-15T01:36:54.283512+0000","last_active":"2023-11-15T01:36:54.290702+0000","last_peered":"2023-11-15T01:36:54.290702+0000","last_clean":"2023-11-15T01:36:54.290702+0000","last_became_active":"2023-11-15T01:36:54.283275+0000","last_became_peered":"2023-11-15T01:36:54.283275+0000","last_unstale":"2023-11-15T01:36:54.290702+0000","last_undegraded":"2023-11-15T01:36:54.290702+0000","last_fullsized":"2023-11-15T01:36:54.290702+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271669+0000","last_change":"2023-11-15T01:36:53.888205+0000","last_active":"2023-11-15T01:36:54.271669+0000","last_peered":"2023-11-15T01:36:54.271669+0000","last_clean":"2023-11-15T01:36:54.271669+0000","last_became_active":"2023-11-15T01:36:53.887901+0000","last_became_peered":"2023-11-15T01:36:53.887901+0000","last_unstale":"2023-11-15T01:36:54.271669+0000","last_undegraded":"2023-11-15T01:36:54.271669+0000","last_fullsized":"2023-11-15T01:36:54.271669+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.283363+0000","last_change":"2023-11-15T01:36:54.281461+0000","last_active":"2023-11-15T01:36:54.283363+0000","last_peered":"2023-11-15T01:36:54.283363+0000","last_clean":"2023-11-15T01:36:54.283363+0000","last_became_active":"2023-11-15T01:36:54.281175+0000","last_became_peered":"2023-11-15T01:36:54.281175+0000","last_unstale":"2023-11-15T01:36:54.283363+0000","last_undegraded":"2023-11-15T01:36:54.283363+0000","last_fullsized":"2023-11-15T01:36:54.283363+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.273333+0000","last_change":"2023-11-15T01:36:53.884211+0000","last_active":"2023-11-15T01:36:54.273333+0000","last_peered":"2023-11-15T01:36:54.273333+0000","last_clean":"2023-11-15T01:36:54.273333+0000","last_became_active":"2023-11-15T01:36:53.883917+0000","last_became_peered":"2023-11-15T01:36:53.883917+0000","last_unstale":"2023-11-15T01:36:54.273333+0000","last_undegraded":"2023-11-15T01:36:54.273333+0000","last_fullsized":"2023-11-15T01:36:54.273333+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286529+0000","last_change":"2023-11-15T01:36:54.282412+0000","last_active":"2023-11-15T01:36:54.286529+0000","last_peered":"2023-11-15T01:36:54.286529+0000","last_clean":"2023-11-15T01:36:54.286529+0000","last_became_active":"2023-11-15T01:36:54.282051+0000","last_became_peered":"2023-11-15T01:36:54.282051+0000","last_unstale":"2023-11-15T01:36:54.286529+0000","last_undegraded":"2023-11-15T01:36:54.286529+0000","last_fullsized":"2023-11-15T01:36:54.286529+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.274618+0000","last_change":"2023-11-15T01:36:53.894114+0000","last_active":"2023-11-15T01:36:54.274618+0000","last_peered":"2023-11-15T01:36:54.274618+0000","last_clean":"2023-11-15T01:36:54.274618+0000","last_became_active":"2023-11-15T01:36:53.893833+0000","last_became_peered":"2023-11-15T01:36:53.893833+0000","last_unstale":"2023-11-15T01:36:54.274618+0000","last_undegraded":"2023-11-15T01:36:54.274618+0000","last_fullsized":"2023-11-15T01:36:54.274618+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.283804+0000","last_change":"2023-11-15T01:36:54.280898+0000","last_active":"2023-11-15T01:36:54.283804+0000","last_peered":"2023-11-15T01:36:54.283804+0000","last_clean":"2023-11-15T01:36:54.283804+0000","last_became_active":"2023-11-15T01:36:54.280611+0000","last_became_peered":"2023-11-15T01:36:54.280611+0000","last_unstale":"2023-11-15T01:36:54.283804+0000","last_undegraded":"2023-11-15T01:36:54.283804+0000","last_fullsized":"2023-11-15T01:36:54.283804+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287492+0000","last_change":"2023-11-15T01:36:53.882268+0000","last_active":"2023-11-15T01:36:54.287492+0000","last_peered":"2023-11-15T01:36:54.287492+0000","last_clean":"2023-11-15T01:36:54.287492+0000","last_became_active":"2023-11-15T01:36:53.881979+0000","last_became_peered":"2023-11-15T01:36:53.881979+0000","last_unstale":"2023-11-15T01:36:54.287492+0000","last_undegraded":"2023-11-15T01:36:54.287492+0000","last_fullsized":"2023-11-15T01:36:54.287492+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.278814+0000","last_change":"2023-11-15T01:36:54.274384+0000","last_active":"2023-11-15T01:36:54.278814+0000","last_peered":"2023-11-15T01:36:54.278814+0000","last_clean":"2023-11-15T01:36:54.278814+0000","last_became_active":"2023-11-15T01:36:54.273445+0000","last_became_peered":"2023-11-15T01:36:54.273445+0000","last_unstale":"2023-11-15T01:36:54.278814+0000","last_undegraded":"2023-11-15T01:36:54.278814+0000","last_fullsized":"2023-11-15T01:36:54.278814+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.273258+0000","last_change":"2023-11-15T01:36:53.892145+0000","last_active":"2023-11-15T01:36:54.273258+0000","last_peered":"2023-11-15T01:36:54.273258+0000","last_clean":"2023-11-15T01:36:54.273258+0000","last_became_active":"2023-11-15T01:36:53.891844+0000","last_became_peered":"2023-11-15T01:36:53.891844+0000","last_unstale":"2023-11-15T01:36:54.273258+0000","last_undegraded":"2023-11-15T01:36:54.273258+0000","last_fullsized":"2023-11-15T01:36:54.273258+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291034+0000","last_change":"2023-11-15T01:36:54.289074+0000","last_active":"2023-11-15T01:36:54.291034+0000","last_peered":"2023-11-15T01:36:54.291034+0000","last_clean":"2023-11-15T01:36:54.291034+0000","last_became_active":"2023-11-15T01:36:54.288459+0000","last_became_peered":"2023-11-15T01:36:54.288459+0000","last_unstale":"2023-11-15T01:36:54.291034+0000","last_undegraded":"2023-11-15T01:36:54.291034+0000","last_fullsized":"2023-11-15T01:36:54.291034+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287132+0000","last_change":"2023-11-15T01:36:53.883037+0000","last_active":"2023-11-15T01:36:54.287132+0000","last_peered":"2023-11-15T01:36:54.287132+0000","last_clean":"2023-11-15T01:36:54.287132+0000","last_became_active":"2023-11-15T01:36:53.882747+0000","last_became_peered":"2023-11-15T01:36:53.882747+0000","last_unstale":"2023-11-15T01:36:54.287132+0000","last_undegraded":"2023-11-15T01:36:54.287132+0000","last_fullsized":"2023-11-15T01:36:54.287132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.288289+0000","last_change":"2023-11-15T01:36:54.287088+0000","last_active":"2023-11-15T01:36:54.288289+0000","last_peered":"2023-11-15T01:36:54.288289+0000","last_clean":"2023-11-15T01:36:54.288289+0000","last_became_active":"2023-11-15T01:36:54.286616+0000","last_became_peered":"2023-11-15T01:36:54.286616+0000","last_unstale":"2023-11-15T01:36:54.288289+0000","last_undegraded":"2023-11-15T01:36:54.288289+0000","last_fullsized":"2023-11-15T01:36:54.288289+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.272058+0000","last_change":"2023-11-15T01:36:53.893540+0000","last_active":"2023-11-15T01:36:54.272058+0000","last_peered":"2023-11-15T01:36:54.272058+0000","last_clean":"2023-11-15T01:36:54.272058+0000","last_became_active":"2023-11-15T01:36:53.893298+0000","last_became_peered":"2023-11-15T01:36:53.893298+0000","last_unstale":"2023-11-15T01:36:54.272058+0000","last_undegraded":"2023-11-15T01:36:54.272058+0000","last_fullsized":"2023-11-15T01:36:54.272058+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286223+0000","last_change":"2023-11-15T01:36:54.282896+0000","last_active":"2023-11-15T01:36:54.286223+0000","last_peered":"2023-11-15T01:36:54.286223+0000","last_clean":"2023-11-15T01:36:54.286223+0000","last_became_active":"2023-11-15T01:36:54.281854+0000","last_became_peered":"2023-11-15T01:36:54.281854+0000","last_unstale":"2023-11-15T01:36:54.286223+0000","last_undegraded":"2023-11-15T01:36:54.286223+0000","last_fullsized":"2023-11-15T01:36:54.286223+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.279337+0000","last_change":"2023-11-15T01:36:53.886621+0000","last_active":"2023-11-15T01:36:54.279337+0000","last_peered":"2023-11-15T01:36:54.279337+0000","last_clean":"2023-11-15T01:36:54.279337+0000","last_became_active":"2023-11-15T01:36:53.885945+0000","last_became_peered":"2023-11-15T01:36:53.885945+0000","last_unstale":"2023-11-15T01:36:54.279337+0000","last_undegraded":"2023-11-15T01:36:54.279337+0000","last_fullsized":"2023-11-15T01:36:54.279337+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.295460+0000","last_change":"2023-11-15T01:36:54.288865+0000","last_active":"2023-11-15T01:36:54.295460+0000","last_peered":"2023-11-15T01:36:54.295460+0000","last_clean":"2023-11-15T01:36:54.295460+0000","last_became_active":"2023-11-15T01:36:54.288593+0000","last_became_peered":"2023-11-15T01:36:54.288593+0000","last_unstale":"2023-11-15T01:36:54.295460+0000","last_undegraded":"2023-11-15T01:36:54.295460+0000","last_fullsized":"2023-11-15T01:36:54.295460+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269062+0000","last_change":"2023-11-15T01:36:53.888541+0000","last_active":"2023-11-15T01:36:54.269062+0000","last_peered":"2023-11-15T01:36:54.269062+0000","last_clean":"2023-11-15T01:36:54.269062+0000","last_became_active":"2023-11-15T01:36:53.888202+0000","last_became_peered":"2023-11-15T01:36:53.888202+0000","last_unstale":"2023-11-15T01:36:54.269062+0000","last_undegraded":"2023-11-15T01:36:54.269062+0000","last_fullsized":"2023-11-15T01:36:54.269062+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286067+0000","last_change":"2023-11-15T01:36:54.279187+0000","last_active":"2023-11-15T01:36:54.286067+0000","last_peered":"2023-11-15T01:36:54.286067+0000","last_clean":"2023-11-15T01:36:54.286067+0000","last_became_active":"2023-11-15T01:36:54.278905+0000","last_became_peered":"2023-11-15T01:36:54.278905+0000","last_unstale":"2023-11-15T01:36:54.286067+0000","last_undegraded":"2023-11-15T01:36:54.286067+0000","last_fullsized":"2023-11-15T01:36:54.286067+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.289485+0000","last_change":"2023-11-15T01:36:53.891252+0000","last_active":"2023-11-15T01:36:54.289485+0000","last_peered":"2023-11-15T01:36:54.289485+0000","last_clean":"2023-11-15T01:36:54.289485+0000","last_became_active":"2023-11-15T01:36:53.890675+0000","last_became_peered":"2023-11-15T01:36:53.890675+0000","last_unstale":"2023-11-15T01:36:54.289485+0000","last_undegraded":"2023-11-15T01:36:54.289485+0000","last_fullsized":"2023-11-15T01:36:54.289485+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.296463+0000","last_change":"2023-11-15T01:36:54.284667+0000","last_active":"2023-11-15T01:36:54.296463+0000","last_peered":"2023-11-15T01:36:54.296463+0000","last_clean":"2023-11-15T01:36:54.296463+0000","last_became_active":"2023-11-15T01:36:54.284367+0000","last_became_peered":"2023-11-15T01:36:54.284367+0000","last_unstale":"2023-11-15T01:36:54.296463+0000","last_undegraded":"2023-11-15T01:36:54.296463+0000","last_fullsized":"2023-11-15T01:36:54.296463+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.280815+0000","last_change":"2023-11-15T01:36:53.893610+0000","last_active":"2023-11-15T01:36:54.280815+0000","last_peered":"2023-11-15T01:36:54.280815+0000","last_clean":"2023-11-15T01:36:54.280815+0000","last_became_active":"2023-11-15T01:36:53.893305+0000","last_became_peered":"2023-11-15T01:36:53.893305+0000","last_unstale":"2023-11-15T01:36:54.280815+0000","last_undegraded":"2023-11-15T01:36:54.280815+0000","last_fullsized":"2023-11-15T01:36:54.280815+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290753+0000","last_change":"2023-11-15T01:36:54.289986+0000","last_active":"2023-11-15T01:36:54.290753+0000","last_peered":"2023-11-15T01:36:54.290753+0000","last_clean":"2023-11-15T01:36:54.290753+0000","last_became_active":"2023-11-15T01:36:54.289690+0000","last_became_peered":"2023-11-15T01:36:54.289690+0000","last_unstale":"2023-11-15T01:36:54.290753+0000","last_undegraded":"2023-11-15T01:36:54.290753+0000","last_fullsized":"2023-11-15T01:36:54.290753+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.295715+0000","last_change":"2023-11-15T01:36:53.887589+0000","last_active":"2023-11-15T01:36:54.295715+0000","last_peered":"2023-11-15T01:36:54.295715+0000","last_clean":"2023-11-15T01:36:54.295715+0000","last_became_active":"2023-11-15T01:36:53.887279+0000","last_became_peered":"2023-11-15T01:36:53.887279+0000","last_unstale":"2023-11-15T01:36:54.295715+0000","last_undegraded":"2023-11-15T01:36:54.295715+0000","last_fullsized":"2023-11-15T01:36:54.295715+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.283361+0000","last_change":"2023-11-15T01:36:54.281819+0000","last_active":"2023-11-15T01:36:54.283361+0000","last_peered":"2023-11-15T01:36:54.283361+0000","last_clean":"2023-11-15T01:36:54.283361+0000","last_became_active":"2023-11-15T01:36:54.281516+0000","last_became_peered":"2023-11-15T01:36:54.281516+0000","last_unstale":"2023-11-15T01:36:54.283361+0000","last_undegraded":"2023-11-15T01:36:54.283361+0000","last_fullsized":"2023-11-15T01:36:54.283361+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269430+0000","last_change":"2023-11-15T01:36:53.892952+0000","last_active":"2023-11-15T01:36:54.269430+0000","last_peered":"2023-11-15T01:36:54.269430+0000","last_clean":"2023-11-15T01:36:54.269430+0000","last_became_active":"2023-11-15T01:36:53.892100+0000","last_became_peered":"2023-11-15T01:36:53.892100+0000","last_unstale":"2023-11-15T01:36:54.269430+0000","last_undegraded":"2023-11-15T01:36:54.269430+0000","last_fullsized":"2023-11-15T01:36:54.269430+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286117+0000","last_change":"2023-11-15T01:36:54.279589+0000","last_active":"2023-11-15T01:36:54.286117+0000","last_peered":"2023-11-15T01:36:54.286117+0000","last_clean":"2023-11-15T01:36:54.286117+0000","last_became_active":"2023-11-15T01:36:54.279242+0000","last_became_peered":"2023-11-15T01:36:54.279242+0000","last_unstale":"2023-11-15T01:36:54.286117+0000","last_undegraded":"2023-11-15T01:36:54.286117+0000","last_fullsized":"2023-11-15T01:36:54.286117+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.273091+0000","last_change":"2023-11-15T01:36:53.887653+0000","last_active":"2023-11-15T01:36:54.273091+0000","last_peered":"2023-11-15T01:36:54.273091+0000","last_clean":"2023-11-15T01:36:54.273091+0000","last_became_active":"2023-11-15T01:36:53.883451+0000","last_became_peered":"2023-11-15T01:36:53.883451+0000","last_unstale":"2023-11-15T01:36:54.273091+0000","last_undegraded":"2023-11-15T01:36:54.273091+0000","last_fullsized":"2023-11-15T01:36:54.273091+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.296034+0000","last_change":"2023-11-15T01:36:54.295174+0000","last_active":"2023-11-15T01:36:54.296034+0000","last_peered":"2023-11-15T01:36:54.296034+0000","last_clean":"2023-11-15T01:36:54.296034+0000","last_became_active":"2023-11-15T01:36:54.294566+0000","last_became_peered":"2023-11-15T01:36:54.294566+0000","last_unstale":"2023-11-15T01:36:54.296034+0000","last_undegraded":"2023-11-15T01:36:54.296034+0000","last_fullsized":"2023-11-15T01:36:54.296034+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.272178+0000","last_change":"2023-11-15T01:36:53.888916+0000","last_active":"2023-11-15T01:36:54.272178+0000","last_peered":"2023-11-15T01:36:54.272178+0000","last_clean":"2023-11-15T01:36:54.272178+0000","last_became_active":"2023-11-15T01:36:53.888640+0000","last_became_peered":"2023-11-15T01:36:53.888640+0000","last_unstale":"2023-11-15T01:36:54.272178+0000","last_undegraded":"2023-11-15T01:36:54.272178+0000","last_fullsized":"2023-11-15T01:36:54.272178+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290774+0000","last_change":"2023-11-15T01:36:54.290023+0000","last_active":"2023-11-15T01:36:54.290774+0000","last_peered":"2023-11-15T01:36:54.290774+0000","last_clean":"2023-11-15T01:36:54.290774+0000","last_became_active":"2023-11-15T01:36:54.289752+0000","last_became_peered":"2023-11-15T01:36:54.289752+0000","last_unstale":"2023-11-15T01:36:54.290774+0000","last_undegraded":"2023-11-15T01:36:54.290774+0000","last_fullsized":"2023-11-15T01:36:54.290774+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.266554+0000","last_change":"2023-11-15T01:36:53.882475+0000","last_active":"2023-11-15T01:36:54.266554+0000","last_peered":"2023-11-15T01:36:54.266554+0000","last_clean":"2023-11-15T01:36:54.266554+0000","last_became_active":"2023-11-15T01:36:53.882148+0000","last_became_peered":"2023-11-15T01:36:53.882148+0000","last_unstale":"2023-11-15T01:36:54.266554+0000","last_undegraded":"2023-11-15T01:36:54.266554+0000","last_fullsized":"2023-11-15T01:36:54.266554+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285602+0000","last_change":"2023-11-15T01:36:54.284124+0000","last_active":"2023-11-15T01:36:54.285602+0000","last_peered":"2023-11-15T01:36:54.285602+0000","last_clean":"2023-11-15T01:36:54.285602+0000","last_became_active":"2023-11-15T01:36:54.283861+0000","last_became_peered":"2023-11-15T01:36:54.283861+0000","last_unstale":"2023-11-15T01:36:54.285602+0000","last_undegraded":"2023-11-15T01:36:54.285602+0000","last_fullsized":"2023-11-15T01:36:54.285602+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269915+0000","last_change":"2023-11-15T01:36:53.886731+0000","last_active":"2023-11-15T01:36:54.269915+0000","last_peered":"2023-11-15T01:36:54.269915+0000","last_clean":"2023-11-15T01:36:54.269915+0000","last_became_active":"2023-11-15T01:36:53.886460+0000","last_became_peered":"2023-11-15T01:36:53.886460+0000","last_unstale":"2023-11-15T01:36:54.269915+0000","last_undegraded":"2023-11-15T01:36:54.269915+0000","last_fullsized":"2023-11-15T01:36:54.269915+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.295408+0000","last_change":"2023-11-15T01:36:54.284273+0000","last_active":"2023-11-15T01:36:54.295408+0000","last_peered":"2023-11-15T01:36:54.295408+0000","last_clean":"2023-11-15T01:36:54.295408+0000","last_became_active":"2023-11-15T01:36:54.284001+0000","last_became_peered":"2023-11-15T01:36:54.284001+0000","last_unstale":"2023-11-15T01:36:54.295408+0000","last_undegraded":"2023-11-15T01:36:54.295408+0000","last_fullsized":"2023-11-15T01:36:54.295408+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271077+0000","last_change":"2023-11-15T01:36:53.894084+0000","last_active":"2023-11-15T01:36:54.271077+0000","last_peered":"2023-11-15T01:36:54.271077+0000","last_clean":"2023-11-15T01:36:54.271077+0000","last_became_active":"2023-11-15T01:36:53.893722+0000","last_became_peered":"2023-11-15T01:36:53.893722+0000","last_unstale":"2023-11-15T01:36:54.271077+0000","last_undegraded":"2023-11-15T01:36:54.271077+0000","last_fullsized":"2023-11-15T01:36:54.271077+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.289220+0000","last_change":"2023-11-15T01:36:54.286839+0000","last_active":"2023-11-15T01:36:54.289220+0000","last_peered":"2023-11-15T01:36:54.289220+0000","last_clean":"2023-11-15T01:36:54.289220+0000","last_became_active":"2023-11-15T01:36:54.286543+0000","last_became_peered":"2023-11-15T01:36:54.286543+0000","last_unstale":"2023-11-15T01:36:54.289220+0000","last_undegraded":"2023-11-15T01:36:54.289220+0000","last_fullsized":"2023-11-15T01:36:54.289220+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.274723+0000","last_change":"2023-11-15T01:36:53.883634+0000","last_active":"2023-11-15T01:36:54.274723+0000","last_peered":"2023-11-15T01:36:54.274723+0000","last_clean":"2023-11-15T01:36:54.274723+0000","last_became_active":"2023-11-15T01:36:53.883355+0000","last_became_peered":"2023-11-15T01:36:53.883355+0000","last_unstale":"2023-11-15T01:36:54.274723+0000","last_undegraded":"2023-11-15T01:36:54.274723+0000","last_fullsized":"2023-11-15T01:36:54.274723+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.289854+0000","last_change":"2023-11-15T01:36:54.288195+0000","last_active":"2023-11-15T01:36:54.289854+0000","last_peered":"2023-11-15T01:36:54.289854+0000","last_clean":"2023-11-15T01:36:54.289854+0000","last_became_active":"2023-11-15T01:36:54.287547+0000","last_became_peered":"2023-11-15T01:36:54.287547+0000","last_unstale":"2023-11-15T01:36:54.289854+0000","last_undegraded":"2023-11-15T01:36:54.289854+0000","last_fullsized":"2023-11-15T01:36:54.289854+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"93'3","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290682+0000","last_change":"2023-11-15T01:36:53.886811+0000","last_active":"2023-11-15T01:36:54.290682+0000","last_peered":"2023-11-15T01:36:54.290682+0000","last_clean":"2023-11-15T01:36:54.290682+0000","last_became_active":"2023-11-15T01:36:53.886510+0000","last_became_peered":"2023-11-15T01:36:53.886510+0000","last_unstale":"2023-11-15T01:36:54.290682+0000","last_undegraded":"2023-11-15T01:36:54.290682+0000","last_fullsized":"2023-11-15T01:36:54.290682+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286271+0000","last_change":"2023-11-15T01:36:54.281090+0000","last_active":"2023-11-15T01:36:54.286271+0000","last_peered":"2023-11-15T01:36:54.286271+0000","last_clean":"2023-11-15T01:36:54.286271+0000","last_became_active":"2023-11-15T01:36:54.279545+0000","last_became_peered":"2023-11-15T01:36:54.279545+0000","last_unstale":"2023-11-15T01:36:54.286271+0000","last_undegraded":"2023-11-15T01:36:54.286271+0000","last_fullsized":"2023-11-15T01:36:54.286271+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285081+0000","last_change":"2023-11-15T01:36:53.885770+0000","last_active":"2023-11-15T01:36:54.285081+0000","last_peered":"2023-11-15T01:36:54.285081+0000","last_clean":"2023-11-15T01:36:54.285081+0000","last_became_active":"2023-11-15T01:36:53.885479+0000","last_became_peered":"2023-11-15T01:36:53.885479+0000","last_unstale":"2023-11-15T01:36:54.285081+0000","last_undegraded":"2023-11-15T01:36:54.285081+0000","last_fullsized":"2023-11-15T01:36:54.285081+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291038+0000","last_change":"2023-11-15T01:36:54.290159+0000","last_active":"2023-11-15T01:36:54.291038+0000","last_peered":"2023-11-15T01:36:54.291038+0000","last_clean":"2023-11-15T01:36:54.291038+0000","last_became_active":"2023-11-15T01:36:54.289600+0000","last_became_peered":"2023-11-15T01:36:54.289600+0000","last_unstale":"2023-11-15T01:36:54.291038+0000","last_undegraded":"2023-11-15T01:36:54.291038+0000","last_fullsized":"2023-11-15T01:36:54.291038+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285894+0000","last_change":"2023-11-15T01:36:53.884977+0000","last_active":"2023-11-15T01:36:54.285894+0000","last_peered":"2023-11-15T01:36:54.285894+0000","last_clean":"2023-11-15T01:36:54.285894+0000","last_became_active":"2023-11-15T01:36:53.883488+0000","last_became_peered":"2023-11-15T01:36:53.883488+0000","last_unstale":"2023-11-15T01:36:54.285894+0000","last_undegraded":"2023-11-15T01:36:54.285894+0000","last_fullsized":"2023-11-15T01:36:54.285894+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284185+0000","last_change":"2023-11-15T01:36:54.279679+0000","last_active":"2023-11-15T01:36:54.284185+0000","last_peered":"2023-11-15T01:36:54.284185+0000","last_clean":"2023-11-15T01:36:54.284185+0000","last_became_active":"2023-11-15T01:36:54.279027+0000","last_became_peered":"2023-11-15T01:36:54.279027+0000","last_unstale":"2023-11-15T01:36:54.284185+0000","last_undegraded":"2023-11-15T01:36:54.284185+0000","last_fullsized":"2023-11-15T01:36:54.284185+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271058+0000","last_change":"2023-11-15T01:36:53.889534+0000","last_active":"2023-11-15T01:36:54.271058+0000","last_peered":"2023-11-15T01:36:54.271058+0000","last_clean":"2023-11-15T01:36:54.271058+0000","last_became_active":"2023-11-15T01:36:53.889254+0000","last_became_peered":"2023-11-15T01:36:53.889254+0000","last_unstale":"2023-11-15T01:36:54.271058+0000","last_undegraded":"2023-11-15T01:36:54.271058+0000","last_fullsized":"2023-11-15T01:36:54.271058+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.282522+0000","last_change":"2023-11-15T01:36:54.278184+0000","last_active":"2023-11-15T01:36:54.282522+0000","last_peered":"2023-11-15T01:36:54.282522+0000","last_clean":"2023-11-15T01:36:54.282522+0000","last_became_active":"2023-11-15T01:36:54.277936+0000","last_became_peered":"2023-11-15T01:36:54.277936+0000","last_unstale":"2023-11-15T01:36:54.282522+0000","last_undegraded":"2023-11-15T01:36:54.282522+0000","last_fullsized":"2023-11-15T01:36:54.282522+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270845+0000","last_change":"2023-11-15T01:36:53.889874+0000","last_active":"2023-11-15T01:36:54.270845+0000","last_peered":"2023-11-15T01:36:54.270845+0000","last_clean":"2023-11-15T01:36:54.270845+0000","last_became_active":"2023-11-15T01:36:53.889565+0000","last_became_peered":"2023-11-15T01:36:53.889565+0000","last_unstale":"2023-11-15T01:36:54.270845+0000","last_undegraded":"2023-11-15T01:36:54.270845+0000","last_fullsized":"2023-11-15T01:36:54.270845+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290806+0000","last_change":"2023-11-15T01:36:54.289928+0000","last_active":"2023-11-15T01:36:54.290806+0000","last_peered":"2023-11-15T01:36:54.290806+0000","last_clean":"2023-11-15T01:36:54.290806+0000","last_became_active":"2023-11-15T01:36:54.289665+0000","last_became_peered":"2023-11-15T01:36:54.289665+0000","last_unstale":"2023-11-15T01:36:54.290806+0000","last_undegraded":"2023-11-15T01:36:54.290806+0000","last_fullsized":"2023-11-15T01:36:54.290806+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.281013+0000","last_change":"2023-11-15T01:36:53.888557+0000","last_active":"2023-11-15T01:36:54.281013+0000","last_peered":"2023-11-15T01:36:54.281013+0000","last_clean":"2023-11-15T01:36:54.281013+0000","last_became_active":"2023-11-15T01:36:53.888276+0000","last_became_peered":"2023-11-15T01:36:53.888276+0000","last_unstale":"2023-11-15T01:36:54.281013+0000","last_undegraded":"2023-11-15T01:36:54.281013+0000","last_fullsized":"2023-11-15T01:36:54.281013+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284415+0000","last_change":"2023-11-15T01:36:54.282329+0000","last_active":"2023-11-15T01:36:54.284415+0000","last_peered":"2023-11-15T01:36:54.284415+0000","last_clean":"2023-11-15T01:36:54.284415+0000","last_became_active":"2023-11-15T01:36:54.280850+0000","last_became_peered":"2023-11-15T01:36:54.280850+0000","last_unstale":"2023-11-15T01:36:54.284415+0000","last_undegraded":"2023-11-15T01:36:54.284415+0000","last_fullsized":"2023-11-15T01:36:54.284415+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287232+0000","last_change":"2023-11-15T01:36:53.886347+0000","last_active":"2023-11-15T01:36:54.287232+0000","last_peered":"2023-11-15T01:36:54.287232+0000","last_clean":"2023-11-15T01:36:54.287232+0000","last_became_active":"2023-11-15T01:36:53.886079+0000","last_became_peered":"2023-11-15T01:36:53.886079+0000","last_unstale":"2023-11-15T01:36:54.287232+0000","last_undegraded":"2023-11-15T01:36:54.287232+0000","last_fullsized":"2023-11-15T01:36:54.287232+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.281878+0000","last_change":"2023-11-15T01:36:54.279150+0000","last_active":"2023-11-15T01:36:54.281878+0000","last_peered":"2023-11-15T01:36:54.281878+0000","last_clean":"2023-11-15T01:36:54.281878+0000","last_became_active":"2023-11-15T01:36:54.278827+0000","last_became_peered":"2023-11-15T01:36:54.278827+0000","last_unstale":"2023-11-15T01:36:54.281878+0000","last_undegraded":"2023-11-15T01:36:54.281878+0000","last_fullsized":"2023-11-15T01:36:54.281878+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270182+0000","last_change":"2023-11-15T01:36:53.887885+0000","last_active":"2023-11-15T01:36:54.270182+0000","last_peered":"2023-11-15T01:36:54.270182+0000","last_clean":"2023-11-15T01:36:54.270182+0000","last_became_active":"2023-11-15T01:36:53.887613+0000","last_became_peered":"2023-11-15T01:36:53.887613+0000","last_unstale":"2023-11-15T01:36:54.270182+0000","last_undegraded":"2023-11-15T01:36:54.270182+0000","last_fullsized":"2023-11-15T01:36:54.270182+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290279+0000","last_change":"2023-11-15T01:36:54.288235+0000","last_active":"2023-11-15T01:36:54.290279+0000","last_peered":"2023-11-15T01:36:54.290279+0000","last_clean":"2023-11-15T01:36:54.290279+0000","last_became_active":"2023-11-15T01:36:54.287954+0000","last_became_peered":"2023-11-15T01:36:54.287954+0000","last_unstale":"2023-11-15T01:36:54.290279+0000","last_undegraded":"2023-11-15T01:36:54.290279+0000","last_fullsized":"2023-11-15T01:36:54.290279+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271850+0000","last_change":"2023-11-15T01:36:53.884154+0000","last_active":"2023-11-15T01:36:54.271850+0000","last_peered":"2023-11-15T01:36:54.271850+0000","last_clean":"2023-11-15T01:36:54.271850+0000","last_became_active":"2023-11-15T01:36:53.883856+0000","last_became_peered":"2023-11-15T01:36:53.883856+0000","last_unstale":"2023-11-15T01:36:54.271850+0000","last_undegraded":"2023-11-15T01:36:54.271850+0000","last_fullsized":"2023-11-15T01:36:54.271850+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.295524+0000","last_change":"2023-11-15T01:36:54.283815+0000","last_active":"2023-11-15T01:36:54.295524+0000","last_peered":"2023-11-15T01:36:54.295524+0000","last_clean":"2023-11-15T01:36:54.295524+0000","last_became_active":"2023-11-15T01:36:54.283398+0000","last_became_peered":"2023-11-15T01:36:54.283398+0000","last_unstale":"2023-11-15T01:36:54.295524+0000","last_undegraded":"2023-11-15T01:36:54.295524+0000","last_fullsized":"2023-11-15T01:36:54.295524+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271051+0000","last_change":"2023-11-15T01:36:53.894062+0000","last_active":"2023-11-15T01:36:54.271051+0000","last_peered":"2023-11-15T01:36:54.271051+0000","last_clean":"2023-11-15T01:36:54.271051+0000","last_became_active":"2023-11-15T01:36:53.893544+0000","last_became_peered":"2023-11-15T01:36:53.893544+0000","last_unstale":"2023-11-15T01:36:54.271051+0000","last_undegraded":"2023-11-15T01:36:54.271051+0000","last_fullsized":"2023-11-15T01:36:54.271051+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290504+0000","last_change":"2023-11-15T01:36:54.288649+0000","last_active":"2023-11-15T01:36:54.290504+0000","last_peered":"2023-11-15T01:36:54.290504+0000","last_clean":"2023-11-15T01:36:54.290504+0000","last_became_active":"2023-11-15T01:36:54.288403+0000","last_became_peered":"2023-11-15T01:36:54.288403+0000","last_unstale":"2023-11-15T01:36:54.290504+0000","last_undegraded":"2023-11-15T01:36:54.290504+0000","last_fullsized":"2023-11-15T01:36:54.290504+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269099+0000","last_change":"2023-11-15T01:36:53.892212+0000","last_active":"2023-11-15T01:36:54.269099+0000","last_peered":"2023-11-15T01:36:54.269099+0000","last_clean":"2023-11-15T01:36:54.269099+0000","last_became_active":"2023-11-15T01:36:53.891926+0000","last_became_peered":"2023-11-15T01:36:53.891926+0000","last_unstale":"2023-11-15T01:36:54.269099+0000","last_undegraded":"2023-11-15T01:36:54.269099+0000","last_fullsized":"2023-11-15T01:36:54.269099+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285608+0000","last_change":"2023-11-15T01:36:54.284102+0000","last_active":"2023-11-15T01:36:54.285608+0000","last_peered":"2023-11-15T01:36:54.285608+0000","last_clean":"2023-11-15T01:36:54.285608+0000","last_became_active":"2023-11-15T01:36:54.283801+0000","last_became_peered":"2023-11-15T01:36:54.283801+0000","last_unstale":"2023-11-15T01:36:54.285608+0000","last_undegraded":"2023-11-15T01:36:54.285608+0000","last_fullsized":"2023-11-15T01:36:54.285608+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.272536+0000","last_change":"2023-11-15T01:36:53.891348+0000","last_active":"2023-11-15T01:36:54.272536+0000","last_peered":"2023-11-15T01:36:54.272536+0000","last_clean":"2023-11-15T01:36:54.272536+0000","last_became_active":"2023-11-15T01:36:53.891039+0000","last_became_peered":"2023-11-15T01:36:53.891039+0000","last_unstale":"2023-11-15T01:36:54.272536+0000","last_undegraded":"2023-11-15T01:36:54.272536+0000","last_fullsized":"2023-11-15T01:36:54.272536+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286099+0000","last_change":"2023-11-15T01:36:54.280100+0000","last_active":"2023-11-15T01:36:54.286099+0000","last_peered":"2023-11-15T01:36:54.286099+0000","last_clean":"2023-11-15T01:36:54.286099+0000","last_became_active":"2023-11-15T01:36:54.279846+0000","last_became_peered":"2023-11-15T01:36:54.279846+0000","last_unstale":"2023-11-15T01:36:54.286099+0000","last_undegraded":"2023-11-15T01:36:54.286099+0000","last_fullsized":"2023-11-15T01:36:54.286099+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.268620+0000","last_change":"2023-11-15T01:36:53.889694+0000","last_active":"2023-11-15T01:36:54.268620+0000","last_peered":"2023-11-15T01:36:54.268620+0000","last_clean":"2023-11-15T01:36:54.268620+0000","last_became_active":"2023-11-15T01:36:53.889467+0000","last_became_peered":"2023-11-15T01:36:53.889467+0000","last_unstale":"2023-11-15T01:36:54.268620+0000","last_undegraded":"2023-11-15T01:36:54.268620+0000","last_fullsized":"2023-11-15T01:36:54.268620+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286527+0000","last_change":"2023-11-15T01:36:54.282473+0000","last_active":"2023-11-15T01:36:54.286527+0000","last_peered":"2023-11-15T01:36:54.286527+0000","last_clean":"2023-11-15T01:36:54.286527+0000","last_became_active":"2023-11-15T01:36:54.282174+0000","last_became_peered":"2023-11-15T01:36:54.282174+0000","last_unstale":"2023-11-15T01:36:54.286527+0000","last_undegraded":"2023-11-15T01:36:54.286527+0000","last_fullsized":"2023-11-15T01:36:54.286527+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270885+0000","last_change":"2023-11-15T01:36:53.888485+0000","last_active":"2023-11-15T01:36:54.270885+0000","last_peered":"2023-11-15T01:36:54.270885+0000","last_clean":"2023-11-15T01:36:54.270885+0000","last_became_active":"2023-11-15T01:36:53.888173+0000","last_became_peered":"2023-11-15T01:36:53.888173+0000","last_unstale":"2023-11-15T01:36:54.270885+0000","last_undegraded":"2023-11-15T01:36:54.270885+0000","last_fullsized":"2023-11-15T01:36:54.270885+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290804+0000","last_change":"2023-11-15T01:36:54.283764+0000","last_active":"2023-11-15T01:36:54.290804+0000","last_peered":"2023-11-15T01:36:54.290804+0000","last_clean":"2023-11-15T01:36:54.290804+0000","last_became_active":"2023-11-15T01:36:54.283480+0000","last_became_peered":"2023-11-15T01:36:54.283480+0000","last_unstale":"2023-11-15T01:36:54.290804+0000","last_undegraded":"2023-11-15T01:36:54.290804+0000","last_fullsized":"2023-11-15T01:36:54.290804+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.274747+0000","last_change":"2023-11-15T01:36:53.883699+0000","last_active":"2023-11-15T01:36:54.274747+0000","last_peered":"2023-11-15T01:36:54.274747+0000","last_clean":"2023-11-15T01:36:54.274747+0000","last_became_active":"2023-11-15T01:36:53.883391+0000","last_became_peered":"2023-11-15T01:36:53.883391+0000","last_unstale":"2023-11-15T01:36:54.274747+0000","last_undegraded":"2023-11-15T01:36:54.274747+0000","last_fullsized":"2023-11-15T01:36:54.274747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270257+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:36:54.270257+0000","last_peered":"2023-11-15T01:36:54.270257+0000","last_clean":"2023-11-15T01:36:54.270257+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:36:54.270257+0000","last_undegraded":"2023-11-15T01:36:54.270257+0000","last_fullsized":"2023-11-15T01:36:54.270257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.296240+0000","last_change":"2023-11-15T01:36:54.294743+0000","last_active":"2023-11-15T01:36:54.296240+0000","last_peered":"2023-11-15T01:36:54.296240+0000","last_clean":"2023-11-15T01:36:54.296240+0000","last_became_active":"2023-11-15T01:36:54.294397+0000","last_became_peered":"2023-11-15T01:36:54.294397+0000","last_unstale":"2023-11-15T01:36:54.296240+0000","last_undegraded":"2023-11-15T01:36:54.296240+0000","last_fullsized":"2023-11-15T01:36:54.296240+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290530+0000","last_change":"2023-11-15T01:36:53.887568+0000","last_active":"2023-11-15T01:36:54.290530+0000","last_peered":"2023-11-15T01:36:54.290530+0000","last_clean":"2023-11-15T01:36:54.290530+0000","last_became_active":"2023-11-15T01:36:53.887245+0000","last_became_peered":"2023-11-15T01:36:53.887245+0000","last_unstale":"2023-11-15T01:36:54.290530+0000","last_undegraded":"2023-11-15T01:36:54.290530+0000","last_fullsized":"2023-11-15T01:36:54.290530+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.272262+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:36:54.272262+0000","last_peered":"2023-11-15T01:36:54.272262+0000","last_clean":"2023-11-15T01:36:54.272262+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:36:54.272262+0000","last_undegraded":"2023-11-15T01:36:54.272262+0000","last_fullsized":"2023-11-15T01:36:54.272262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.288581+0000","last_change":"2023-11-15T01:36:54.286189+0000","last_active":"2023-11-15T01:36:54.288581+0000","last_peered":"2023-11-15T01:36:54.288581+0000","last_clean":"2023-11-15T01:36:54.288581+0000","last_became_active":"2023-11-15T01:36:54.285937+0000","last_became_peered":"2023-11-15T01:36:54.285937+0000","last_unstale":"2023-11-15T01:36:54.288581+0000","last_undegraded":"2023-11-15T01:36:54.288581+0000","last_fullsized":"2023-11-15T01:36:54.288581+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286808+0000","last_change":"2023-11-15T01:36:53.883094+0000","last_active":"2023-11-15T01:36:54.286808+0000","last_peered":"2023-11-15T01:36:54.286808+0000","last_clean":"2023-11-15T01:36:54.286808+0000","last_became_active":"2023-11-15T01:36:53.882798+0000","last_became_peered":"2023-11-15T01:36:53.882798+0000","last_unstale":"2023-11-15T01:36:54.286808+0000","last_undegraded":"2023-11-15T01:36:54.286808+0000","last_fullsized":"2023-11-15T01:36:54.286808+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270926+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:36:54.270926+0000","last_peered":"2023-11-15T01:36:54.270926+0000","last_clean":"2023-11-15T01:36:54.270926+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:36:54.270926+0000","last_undegraded":"2023-11-15T01:36:54.270926+0000","last_fullsized":"2023-11-15T01:36:54.270926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284222+0000","last_change":"2023-11-15T01:36:54.280303+0000","last_active":"2023-11-15T01:36:54.284222+0000","last_peered":"2023-11-15T01:36:54.284222+0000","last_clean":"2023-11-15T01:36:54.284222+0000","last_became_active":"2023-11-15T01:36:54.279983+0000","last_became_peered":"2023-11-15T01:36:54.279983+0000","last_unstale":"2023-11-15T01:36:54.284222+0000","last_undegraded":"2023-11-15T01:36:54.284222+0000","last_fullsized":"2023-11-15T01:36:54.284222+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287246+0000","last_change":"2023-11-15T01:36:53.883826+0000","last_active":"2023-11-15T01:36:54.287246+0000","last_peered":"2023-11-15T01:36:54.287246+0000","last_clean":"2023-11-15T01:36:54.287246+0000","last_became_active":"2023-11-15T01:36:53.883518+0000","last_became_peered":"2023-11-15T01:36:53.883518+0000","last_unstale":"2023-11-15T01:36:54.287246+0000","last_undegraded":"2023-11-15T01:36:54.287246+0000","last_fullsized":"2023-11-15T01:36:54.287246+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.272992+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:36:54.272992+0000","last_peered":"2023-11-15T01:36:54.272992+0000","last_clean":"2023-11-15T01:36:54.272992+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:36:54.272992+0000","last_undegraded":"2023-11-15T01:36:54.272992+0000","last_fullsized":"2023-11-15T01:36:54.272992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":73,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271771+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:36:54.271771+0000","last_peered":"2023-11-15T01:36:54.271771+0000","last_clean":"2023-11-15T01:36:54.271771+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:36:54.271771+0000","last_undegraded":"2023-11-15T01:36:54.271771+0000","last_fullsized":"2023-11-15T01:36:54.271771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.295451+0000","last_change":"2023-11-15T01:36:54.281084+0000","last_active":"2023-11-15T01:36:54.295451+0000","last_peered":"2023-11-15T01:36:54.295451+0000","last_clean":"2023-11-15T01:36:54.295451+0000","last_became_active":"2023-11-15T01:36:54.280744+0000","last_became_peered":"2023-11-15T01:36:54.280744+0000","last_unstale":"2023-11-15T01:36:54.295451+0000","last_undegraded":"2023-11-15T01:36:54.295451+0000","last_fullsized":"2023-11-15T01:36:54.295451+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287040+0000","last_change":"2023-11-15T01:36:53.883685+0000","last_active":"2023-11-15T01:36:54.287040+0000","last_peered":"2023-11-15T01:36:54.287040+0000","last_clean":"2023-11-15T01:36:54.287040+0000","last_became_active":"2023-11-15T01:36:53.883373+0000","last_became_peered":"2023-11-15T01:36:53.883373+0000","last_unstale":"2023-11-15T01:36:54.287040+0000","last_undegraded":"2023-11-15T01:36:54.287040+0000","last_fullsized":"2023-11-15T01:36:54.287040+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":71,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271856+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:36:54.271856+0000","last_peered":"2023-11-15T01:36:54.271856+0000","last_clean":"2023-11-15T01:36:54.271856+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:36:54.271856+0000","last_undegraded":"2023-11-15T01:36:54.271856+0000","last_fullsized":"2023-11-15T01:36:54.271856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.294443+0000","last_change":"2023-11-15T01:36:54.292193+0000","last_active":"2023-11-15T01:36:54.294443+0000","last_peered":"2023-11-15T01:36:54.294443+0000","last_clean":"2023-11-15T01:36:54.294443+0000","last_became_active":"2023-11-15T01:36:54.291920+0000","last_became_peered":"2023-11-15T01:36:54.291920+0000","last_unstale":"2023-11-15T01:36:54.294443+0000","last_undegraded":"2023-11-15T01:36:54.294443+0000","last_fullsized":"2023-11-15T01:36:54.294443+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270176+0000","last_change":"2023-11-15T01:36:53.882588+0000","last_active":"2023-11-15T01:36:54.270176+0000","last_peered":"2023-11-15T01:36:54.270176+0000","last_clean":"2023-11-15T01:36:54.270176+0000","last_became_active":"2023-11-15T01:36:53.881836+0000","last_became_peered":"2023-11-15T01:36:53.881836+0000","last_unstale":"2023-11-15T01:36:54.270176+0000","last_undegraded":"2023-11-15T01:36:54.270176+0000","last_fullsized":"2023-11-15T01:36:54.270176+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271732+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:36:54.271732+0000","last_peered":"2023-11-15T01:36:54.271732+0000","last_clean":"2023-11-15T01:36:54.271732+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:36:54.271732+0000","last_undegraded":"2023-11-15T01:36:54.271732+0000","last_fullsized":"2023-11-15T01:36:54.271732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.294270+0000","last_change":"2023-11-15T01:36:54.292443+0000","last_active":"2023-11-15T01:36:54.294270+0000","last_peered":"2023-11-15T01:36:54.294270+0000","last_clean":"2023-11-15T01:36:54.294270+0000","last_became_active":"2023-11-15T01:36:54.292127+0000","last_became_peered":"2023-11-15T01:36:54.292127+0000","last_unstale":"2023-11-15T01:36:54.294270+0000","last_undegraded":"2023-11-15T01:36:54.294270+0000","last_fullsized":"2023-11-15T01:36:54.294270+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286488+0000","last_change":"2023-11-15T01:36:53.885980+0000","last_active":"2023-11-15T01:36:54.286488+0000","last_peered":"2023-11-15T01:36:54.286488+0000","last_clean":"2023-11-15T01:36:54.286488+0000","last_became_active":"2023-11-15T01:36:53.885504+0000","last_became_peered":"2023-11-15T01:36:53.885504+0000","last_unstale":"2023-11-15T01:36:54.286488+0000","last_undegraded":"2023-11-15T01:36:54.286488+0000","last_fullsized":"2023-11-15T01:36:54.286488+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269843+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:36:54.269843+0000","last_peered":"2023-11-15T01:36:54.269843+0000","last_clean":"2023-11-15T01:36:54.269843+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:36:54.269843+0000","last_undegraded":"2023-11-15T01:36:54.269843+0000","last_fullsized":"2023-11-15T01:36:54.269843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290341+0000","last_change":"2023-11-15T01:36:54.283373+0000","last_active":"2023-11-15T01:36:54.290341+0000","last_peered":"2023-11-15T01:36:54.290341+0000","last_clean":"2023-11-15T01:36:54.290341+0000","last_became_active":"2023-11-15T01:36:54.283101+0000","last_became_peered":"2023-11-15T01:36:54.283101+0000","last_unstale":"2023-11-15T01:36:54.290341+0000","last_undegraded":"2023-11-15T01:36:54.290341+0000","last_fullsized":"2023-11-15T01:36:54.290341+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284579+0000","last_change":"2023-11-15T01:36:53.887381+0000","last_active":"2023-11-15T01:36:54.284579+0000","last_peered":"2023-11-15T01:36:54.284579+0000","last_clean":"2023-11-15T01:36:54.284579+0000","last_became_active":"2023-11-15T01:36:53.887066+0000","last_became_peered":"2023-11-15T01:36:53.887066+0000","last_unstale":"2023-11-15T01:36:54.284579+0000","last_undegraded":"2023-11-15T01:36:54.284579+0000","last_fullsized":"2023-11-15T01:36:54.284579+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":83,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270008+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:36:54.270008+0000","last_peered":"2023-11-15T01:36:54.270008+0000","last_clean":"2023-11-15T01:36:54.270008+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:36:54.270008+0000","last_undegraded":"2023-11-15T01:36:54.270008+0000","last_fullsized":"2023-11-15T01:36:54.270008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575032,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302308,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069532,"statfs":{"total":96636764160,"available":96327200768,"internally_reserved":0,"allocated":1142784,"data_stored":577452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.34799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70299999999999996,"5min":0.71199999999999997,"15min":0.82299999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.41699999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.83299999999999996},"last":0.376}]},{"osd":1,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72099999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.437},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.40400000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.81499999999999995},"last":0.45100000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.39500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73799999999999999,"5min":0.77800000000000002,"15min":0.82599999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.46100000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.86299999999999999},"last":0.55400000000000005}]},{"osd":3,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.47299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.73399999999999999,"5min":0.80700000000000005,"15min":0.85999999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.501,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79000000000000004,"5min":0.79700000000000004,"15min":0.81200000000000006},"last":0.52700000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45300000000000001,"15min":0.46600000000000003},"min":{"1min":0.31,"5min":0.247,"15min":0.247},"max":{"1min":0.624,"5min":0.69999999999999996,"15min":0.84499999999999997},"last":0.503},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.40400000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.83799999999999997},"last":0.49399999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47499999999999998,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.77500000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.497,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.78500000000000003},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.38400000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.752,"5min":0.755,"15min":0.85099999999999998},"last":0.54900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575033,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":1159168,"data_stored":584718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.29199999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73299999999999998,"5min":0.89000000000000001,"15min":0.97799999999999998},"last":0.70999999999999996}]},{"osd":1,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54900000000000004,"15min":0.56299999999999994},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.0649999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.33100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.73499999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.75700000000000001,"5min":0.79100000000000004,"15min":1.038},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.77300000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.77100000000000002,"5min":0.85499999999999998,"15min":1.028},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35699999999999998},"max":{"1min":0.67100000000000004,"5min":0.874,"15min":1.004},"last":0.66500000000000004}]},{"osd":4,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44700000000000001,"15min":0.44800000000000001},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.68200000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.25800000000000001},"max":{"1min":0.65400000000000003,"5min":0.73299999999999998,"15min":0.81799999999999995},"last":0.5}]},{"osd":5,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63500000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.70999999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59199999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.496,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":0.64000000000000001,"5min":0.72099999999999997,"15min":0.86499999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.34000000000000002},"max":{"1min":0.67200000000000004,"5min":0.82399999999999995,"15min":1.0009999999999999},"last":0.61599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575034,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302328,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069512,"statfs":{"total":96636764160,"available":96327180288,"internally_reserved":0,"allocated":1163264,"data_stored":585078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.373,"15min":0.376},"min":{"1min":0.25,"5min":0.249,"15min":0.23999999999999999},"max":{"1min":0.59099999999999997,"5min":0.73699999999999999,"15min":0.77800000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.22600000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.499}]},{"osd":3,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.31},"max":{"1min":9.641,"5min":9.641,"15min":9.641},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.53800000000000003,"15min":0.496},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.28000000000000003},"max":{"1min":9.6199999999999992,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.53700000000000003}]},{"osd":4,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.68500000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.0509999999999999},"last":0.84199999999999997}]},{"osd":5,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71699999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.747},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.40400000000000003,"15min":0.373},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.46200000000000002,"5min":0.441,"15min":0.42799999999999999},"max":{"1min":0.77500000000000002,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.91100000000000003}]},{"osd":7,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0429999999999999,"5min":1.0509999999999999,"15min":1.25},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66800000000000004,"15min":0.68799999999999994},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81499999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.82099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575032,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":584004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38,"15min":0.37},"min":{"1min":0.28499999999999998,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51100000000000001,"5min":2.024,"15min":2.024},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.438,"15min":0.41499999999999998},"min":{"1min":0.32800000000000001,"5min":0.252,"15min":0.215},"max":{"1min":0.60099999999999998,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.35399999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.40500000000000003,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.54200000000000004,"5min":1.768,"15min":1.768},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.35799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61699999999999999,"5min":1.982,"15min":1.982},"last":0.437}]},{"osd":3,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.433},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.22500000000000001},"max":{"1min":0.63100000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46500000000000002,"15min":0.45400000000000001},"min":{"1min":0.33300000000000002,"5min":0.28100000000000003,"15min":0.27700000000000002},"max":{"1min":0.66700000000000004,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42199999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80500000000000005,"5min":0.97799999999999998,"15min":1.454},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.65500000000000003},"min":{"1min":0.55500000000000005,"5min":0.45900000000000002,"15min":0.442},"max":{"1min":0.78800000000000003,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.58299999999999996}]},{"osd":5,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82399999999999995,"5min":1.881,"15min":1.881},"last":0.495},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.46100000000000002,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.86599999999999999,"5min":0.91400000000000003,"15min":1.1120000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.46800000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83399999999999996,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52600000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.874,"5min":1.917,"15min":1.917},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70099999999999996,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.91300000000000003,"5min":1.843,"15min":1.843},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68500000000000005,"15min":0.69399999999999995},"min":{"1min":0.54100000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90600000000000003,"5min":0.95299999999999996,"15min":1.4119999999999999},"last":0.71799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575033,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306420,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065420,"statfs":{"total":96636764160,"available":96322990080,"internally_reserved":0,"allocated":1159168,"data_stored":585540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36499999999999999,"15min":0.36899999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52500000000000002,"5min":0.55100000000000005,"15min":0.61899999999999999},"last":0.374},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.39800000000000002,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.57699999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.222},"max":{"1min":0.745,"5min":0.745,"15min":0.75},"last":0.31},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.441,"15min":0.442},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.69799999999999995,"5min":0.73499999999999999,"15min":0.92000000000000004},"last":0.39000000000000001}]},{"osd":3,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.248},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45000000000000001,"15min":0.44400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.253},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59999999999999998,"15min":0.625},"min":{"1min":0.41299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92700000000000005,"5min":1.0549999999999999,"15min":1.0800000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.39200000000000002},"max":{"1min":0.872,"5min":0.91100000000000003,"15min":1.052},"last":0.67100000000000004}]},{"osd":5,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.627,"15min":0.64800000000000002},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.89400000000000002,"5min":1.032,"15min":1.032},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.64100000000000001},"min":{"1min":0.44700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.871,"5min":0.96699999999999997,"15min":1.1339999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.66300000000000003},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.876,"5min":1.002,"15min":1.0389999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.65300000000000002,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85699999999999998,"5min":1.0669999999999999,"15min":1.119},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.67700000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78300000000000003,"5min":1.079,"15min":1.103},"last":0.623},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67600000000000005,"15min":0.69499999999999995},"min":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.86599999999999999,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.69699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575034,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065432,"statfs":{"total":96636764160,"available":96323002368,"internally_reserved":0,"allocated":1146880,"data_stored":584004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.374,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.22600000000000001},"max":{"1min":0.53400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.23200000000000001},"max":{"1min":0.60699999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.307}]},{"osd":1,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":0.56599999999999995,"5min":0.64700000000000002,"15min":0.72899999999999998},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.29199999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72499999999999998,"5min":0.747,"15min":0.80500000000000005},"last":0.33000000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44500000000000001,"15min":0.44600000000000001},"min":{"1min":0.33700000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.377},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.69199999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41099999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.39000000000000001},"max":{"1min":0.89200000000000002,"5min":1.0169999999999999,"15min":1.0589999999999999},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.436,"5min":0.377,"15min":0.377},"max":{"1min":0.92000000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.45500000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82999999999999996,"5min":0.90100000000000002,"15min":0.95999999999999996},"last":0.40000000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64000000000000001,"15min":0.65000000000000002},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84899999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.67600000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95799999999999996,"5min":1.0900000000000001,"15min":1.169},"last":0.46000000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.65600000000000003,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0429999999999999,"5min":1.071,"15min":1.071},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.69299999999999995},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.996,"5min":1.1319999999999999,"15min":1.1459999999999999},"last":0.56100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575032,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":1159168,"data_stored":584682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.751,"5min":0.88,"15min":0.88},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39000000000000001}]},{"osd":1,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.30499999999999999},"max":{"1min":0.81499999999999995,"5min":1.087,"15min":1.087},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.46100000000000002,"5min":0.35499999999999998,"15min":0.34699999999999998},"max":{"1min":0.74399999999999999,"5min":0.80200000000000005,"15min":0.81000000000000005},"last":0.376}]},{"osd":2,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.47799999999999998,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":0.77300000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.42899999999999999,"5min":0.34699999999999998,"15min":0.33100000000000002},"max":{"1min":0.78300000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.46100000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.46700000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75700000000000001,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.435},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.44900000000000001}]},{"osd":5,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45800000000000002,"15min":0.47099999999999997},"min":{"1min":0.34100000000000003,"5min":0.30499999999999999,"15min":0.30399999999999999},"max":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":0.80600000000000005},"last":0.505},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47699999999999998,"15min":0.49399999999999999},"min":{"1min":0.378,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65400000000000003,"5min":0.752,"15min":0.85299999999999998},"last":0.52800000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48199999999999998,"15min":0.498},"min":{"1min":0.38300000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78500000000000003,"5min":0.79000000000000004,"15min":0.84199999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.33700000000000002,"15min":0.33500000000000002},"max":{"1min":0.82999999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.55600000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.53000000000000003},"min":{"1min":0.41799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.873},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77600000000000002,"5min":0.78400000000000003,"15min":0.90100000000000002},"last":0.51800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575032,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302304,"kb_used_data":1112,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069536,"statfs":{"total":96636764160,"available":96327204864,"internally_reserved":0,"allocated":1138688,"data_stored":576910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.42299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45900000000000002,"5min":0.375,"15min":0.36199999999999999},"max":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.81200000000000006},"last":0.52000000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71499999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.379},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.497,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.67400000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.501}]},{"osd":2,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.34899999999999998,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.86199999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.44,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.75800000000000001,"5min":0.77700000000000002,"15min":1.103},"last":0.441}]},{"osd":3,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.46500000000000002,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.59499999999999997},"min":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71999999999999997,"5min":0.80700000000000005,"15min":1.127},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42799999999999999,"15min":0.45900000000000002},"min":{"1min":0.30299999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.94399999999999995},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.50800000000000001,"15min":0.52800000000000002},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.65600000000000003,"5min":0.71599999999999997,"15min":0.80900000000000005},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.46100000000000002,"15min":0.48099999999999998},"min":{"1min":0.33700000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64800000000000002,"5min":0.83099999999999996,"15min":1.0660000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.46400000000000002,"15min":0.499},"min":{"1min":0.33700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.70599999999999996,"5min":0.751,"15min":0.76600000000000001},"last":0.54800000000000004}]},{"osd":7,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47699999999999998,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.97199999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55800000000000005,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.71799999999999997,"5min":0.85799999999999998,"15min":1.1499999999999999},"last":0.54400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:36:58.310 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:36:58.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.462+0000 7f43c261d700 1 Processor -- start 2023-11-15T01:36:58.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.462+0000 7f43c261d700 1 -- start start 2023-11-15T01:36:58.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.463+0000 7f43c261d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f43bc154150 0x7f43bc154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.463+0000 7f43c261d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f43bc0ab1a0 0x7f43bc158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.463+0000 7f43c261d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc0c06f0 con 0x7f43bc0aa060 2023-11-15T01:36:58.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.463+0000 7f43c261d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc0c09d0 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.463+0000 7f43c261d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc158820 con 0x7f43bc154150 2023-11-15T01:36:58.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.463+0000 7f43bb7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f43bc0ab1a0 0x7f43bc158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.463+0000 7f43bb7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f43bc0ab1a0 0x7f43bc158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53350/0 (socket says 172.21.15.1:53350) 2023-11-15T01:36:58.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.463+0000 7f43bb7fe700 1 -- 172.21.15.1:0/342957061 learned_addr learned my addr 172.21.15.1:0/342957061 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:58.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.463+0000 7f43bbfff700 1 --2- 172.21.15.1:0/342957061 >> v2:172.21.15.141:3300/0 conn(0x7f43bc154150 0x7f43bc154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.463+0000 7f43bb7fe700 1 -- 172.21.15.1:0/342957061 >> v2:172.21.15.141:3300/0 conn(0x7f43bc154150 msgr2=0x7f43bc154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:58.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.463+0000 7f43bb7fe700 1 --2- 172.21.15.1:0/342957061 >> v2:172.21.15.141:3300/0 conn(0x7f43bc154150 0x7f43bc154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.463+0000 7f43bb7fe700 1 -- 172.21.15.1:0/342957061 >> v1:172.21.15.141:6789/0 conn(0x7f43bc0aa060 legacy=0x7f43bc0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.464+0000 7f43bb7fe700 1 -- 172.21.15.1:0/342957061 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc158b00 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.464+0000 7f43bb7fe700 1 --2- 172.21.15.1:0/342957061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43bc0ab1a0 0x7f43bc158040 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f43bc06bfb0 tx=0x7f43b00090f0).ready entity=mon.0 client_cookie=7f50ddd82ee7b4ec server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:58.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.464+0000 7f43baffd700 1 -- 172.21.15.1:0/342957061 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b000b520 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.464+0000 7f43baffd700 1 -- 172.21.15.1:0/342957061 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b000b680 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.464+0000 7f43baffd700 1 -- 172.21.15.1:0/342957061 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b000ba20 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.464+0000 7f43c261d700 1 -- 172.21.15.1:0/342957061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43bc0ab1a0 msgr2=0x7f43bc158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.464+0000 7f43c261d700 1 --2- 172.21.15.1:0/342957061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43bc0ab1a0 0x7f43bc158040 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f43bc06bfb0 tx=0x7f43b00090f0).stop 2023-11-15T01:36:58.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.464+0000 7f43c261d700 1 -- 172.21.15.1:0/342957061 shutdown_connections 2023-11-15T01:36:58.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.464+0000 7f43c261d700 1 --2- 172.21.15.1:0/342957061 >> v2:172.21.15.141:3300/0 conn(0x7f43bc154150 0x7f43bc154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.464+0000 7f43c261d700 1 --2- 172.21.15.1:0/342957061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43bc0ab1a0 0x7f43bc158040 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.464+0000 7f43c261d700 1 -- 172.21.15.1:0/342957061 >> 172.21.15.1:0/342957061 conn(0x7f43bc064aa0 msgr2=0x7f43bc064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:58.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.464+0000 7f43c261d700 1 -- 172.21.15.1:0/342957061 shutdown_connections 2023-11-15T01:36:58.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.464+0000 7f43c261d700 1 -- 172.21.15.1:0/342957061 wait complete. 2023-11-15T01:36:58.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.465+0000 7f43c261d700 1 Processor -- start 2023-11-15T01:36:58.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.466+0000 7f43c261d700 1 -- start start 2023-11-15T01:36:58.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.466+0000 7f43c261d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43bc0aa060 0x7f43bc142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.466+0000 7f43c261d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43bc0ab1a0 0x7f43bc0b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.473 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.466+0000 7f43c261d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43bc154150 0x7f43bc0c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.473 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.466+0000 7f43c261d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0c36c0 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.473 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.466+0000 7f43c261d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0afd70 con 0x7f43bc0aa060 2023-11-15T01:36:58.473 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.466+0000 7f43c261d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc143110 con 0x7f43bc154150 2023-11-15T01:36:58.473 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43bb7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43bc0ab1a0 0x7f43bc0b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43bb7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43bc0ab1a0 0x7f43bc0b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53366/0 (socket says 172.21.15.1:53366) 2023-11-15T01:36:58.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43bb7fe700 1 -- 172.21.15.1:0/4289581746 learned_addr learned my addr 172.21.15.1:0/4289581746 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:58.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43bbfff700 1 --2- 172.21.15.1:0/4289581746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43bc0aa060 0x7f43bc142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43c0bba700 1 --2- 172.21.15.1:0/4289581746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43bc154150 0x7f43bc0c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43bb7fe700 1 -- 172.21.15.1:0/4289581746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43bc154150 msgr2=0x7f43bc0c2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43bb7fe700 1 --2- 172.21.15.1:0/4289581746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43bc154150 0x7f43bc0c2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43bb7fe700 1 -- 172.21.15.1:0/4289581746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43bc0aa060 msgr2=0x7f43bc142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43bb7fe700 1 --2- 172.21.15.1:0/4289581746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43bc0aa060 0x7f43bc142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43bb7fe700 1 -- 172.21.15.1:0/4289581746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b0009370 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43bbfff700 1 --2- 172.21.15.1:0/4289581746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43bc0aa060 0x7f43bc142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:58.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43bb7fe700 1 --2- 172.21.15.1:0/4289581746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43bc0ab1a0 0x7f43bc0b0200 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f43bc062af0 tx=0x7f43b0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:58.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43a3fff700 1 -- 172.21.15.1:0/4289581746 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b000beb0 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43a3fff700 1 -- 172.21.15.1:0/4289581746 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b000b7f0 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43a3fff700 1 -- 172.21.15.1:0/4289581746 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b001c420 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43c261d700 1 -- 172.21.15.1:0/4289581746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43bc14e440 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.467+0000 7f43c261d700 1 -- 172.21.15.1:0/4289581746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc0af720 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.468+0000 7f43c261d700 1 -- 172.21.15.1:0/4289581746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43bc06c7e0 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.469+0000 7f43a3fff700 1 -- 172.21.15.1:0/4289581746 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f43b001c810 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.469+0000 7f43a3fff700 1 --2- 172.21.15.1:0/4289581746 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f43a805f270 0x7f43a8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.469+0000 7f43a3fff700 1 -- 172.21.15.1:0/4289581746 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f43b007c280 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.469+0000 7f43bbfff700 1 --2- 172.21.15.1:0/4289581746 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f43a805f270 0x7f43a8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.470+0000 7f43bbfff700 1 --2- 172.21.15.1:0/4289581746 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f43a805f270 0x7f43a8061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f43ac006d80 tx=0x7f43ac008040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:58.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.473+0000 7f43a3fff700 1 -- 172.21.15.1:0/4289581746 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f43b004d220 con 0x7f43bc0ab1a0 2023-11-15T01:36:58.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.640+0000 7f43c261d700 1 -- 172.21.15.1:0/4289581746 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43bc158de0 con 0x7f43a805f270 2023-11-15T01:36:58.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.650+0000 7f43a3fff700 1 -- 172.21.15.1:0/4289581746 <== mgr.5627 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360906 (secure 0 0 0) 0x7f43bc158de0 con 0x7f43a805f270 2023-11-15T01:36:58.655 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:58.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.653+0000 7f43c261d700 1 -- 172.21.15.1:0/4289581746 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f43a805f270 msgr2=0x7f43a8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.653+0000 7f43c261d700 1 --2- 172.21.15.1:0/4289581746 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f43a805f270 0x7f43a8061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f43ac006d80 tx=0x7f43ac008040).stop 2023-11-15T01:36:58.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.654+0000 7f43c261d700 1 -- 172.21.15.1:0/4289581746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43bc0ab1a0 msgr2=0x7f43bc0b0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.654+0000 7f43c261d700 1 --2- 172.21.15.1:0/4289581746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43bc0ab1a0 0x7f43bc0b0200 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f43bc062af0 tx=0x7f43b0017000).stop 2023-11-15T01:36:58.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.654+0000 7f43c261d700 1 -- 172.21.15.1:0/4289581746 shutdown_connections 2023-11-15T01:36:58.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.654+0000 7f43c261d700 1 --2- 172.21.15.1:0/4289581746 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f43a805f270 0x7f43a8061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.654+0000 7f43c261d700 1 --2- 172.21.15.1:0/4289581746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43bc154150 0x7f43bc0c2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.654+0000 7f43c261d700 1 --2- 172.21.15.1:0/4289581746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43bc0aa060 0x7f43bc142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.654+0000 7f43c261d700 1 --2- 172.21.15.1:0/4289581746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43bc0ab1a0 0x7f43bc0b0200 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.654+0000 7f43c261d700 1 -- 172.21.15.1:0/4289581746 >> 172.21.15.1:0/4289581746 conn(0x7f43bc064aa0 msgr2=0x7f43bc14ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:58.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.654+0000 7f43c261d700 1 -- 172.21.15.1:0/4289581746 shutdown_connections 2023-11-15T01:36:58.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.654+0000 7f43c261d700 1 -- 172.21.15.1:0/4289581746 wait complete. 2023-11-15T01:36:58.661 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:36:58.666 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T01:36:58.314943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2426728,"kb_used_data":9000,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752547992,"statfs":{"total":773094113280,"available":770609143808,"internally_reserved":0,"allocated":9216000,"data_stored":4662388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11233,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-61,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.205130"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290266+0000","last_change":"2023-11-15T01:36:54.282347+0000","last_active":"2023-11-15T01:36:54.290266+0000","last_peered":"2023-11-15T01:36:54.290266+0000","last_clean":"2023-11-15T01:36:54.290266+0000","last_became_active":"2023-11-15T01:36:54.282073+0000","last_became_peered":"2023-11-15T01:36:54.282073+0000","last_unstale":"2023-11-15T01:36:54.290266+0000","last_undegraded":"2023-11-15T01:36:54.290266+0000","last_fullsized":"2023-11-15T01:36:54.290266+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"93'3","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291636+0000","last_change":"2023-11-15T01:36:53.886207+0000","last_active":"2023-11-15T01:36:54.291636+0000","last_peered":"2023-11-15T01:36:54.291636+0000","last_clean":"2023-11-15T01:36:54.291636+0000","last_became_active":"2023-11-15T01:36:53.885900+0000","last_became_peered":"2023-11-15T01:36:53.885900+0000","last_unstale":"2023-11-15T01:36:54.291636+0000","last_undegraded":"2023-11-15T01:36:54.291636+0000","last_fullsized":"2023-11-15T01:36:54.291636+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285900+0000","last_change":"2023-11-15T01:36:54.283860+0000","last_active":"2023-11-15T01:36:54.285900+0000","last_peered":"2023-11-15T01:36:54.285900+0000","last_clean":"2023-11-15T01:36:54.285900+0000","last_became_active":"2023-11-15T01:36:54.283447+0000","last_became_peered":"2023-11-15T01:36:54.283447+0000","last_unstale":"2023-11-15T01:36:54.285900+0000","last_undegraded":"2023-11-15T01:36:54.285900+0000","last_fullsized":"2023-11-15T01:36:54.285900+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269219+0000","last_change":"2023-11-15T01:36:53.891475+0000","last_active":"2023-11-15T01:36:54.269219+0000","last_peered":"2023-11-15T01:36:54.269219+0000","last_clean":"2023-11-15T01:36:54.269219+0000","last_became_active":"2023-11-15T01:36:53.891188+0000","last_became_peered":"2023-11-15T01:36:53.891188+0000","last_unstale":"2023-11-15T01:36:54.269219+0000","last_undegraded":"2023-11-15T01:36:54.269219+0000","last_fullsized":"2023-11-15T01:36:54.269219+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290998+0000","last_change":"2023-11-15T01:36:54.288857+0000","last_active":"2023-11-15T01:36:54.290998+0000","last_peered":"2023-11-15T01:36:54.290998+0000","last_clean":"2023-11-15T01:36:54.290998+0000","last_became_active":"2023-11-15T01:36:54.287849+0000","last_became_peered":"2023-11-15T01:36:54.287849+0000","last_unstale":"2023-11-15T01:36:54.290998+0000","last_undegraded":"2023-11-15T01:36:54.290998+0000","last_fullsized":"2023-11-15T01:36:54.290998+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287448+0000","last_change":"2023-11-15T01:36:53.880199+0000","last_active":"2023-11-15T01:36:54.287448+0000","last_peered":"2023-11-15T01:36:54.287448+0000","last_clean":"2023-11-15T01:36:54.287448+0000","last_became_active":"2023-11-15T01:36:53.879794+0000","last_became_peered":"2023-11-15T01:36:53.879794+0000","last_unstale":"2023-11-15T01:36:54.287448+0000","last_undegraded":"2023-11-15T01:36:54.287448+0000","last_fullsized":"2023-11-15T01:36:54.287448+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291202+0000","last_change":"2023-11-15T01:36:54.289552+0000","last_active":"2023-11-15T01:36:54.291202+0000","last_peered":"2023-11-15T01:36:54.291202+0000","last_clean":"2023-11-15T01:36:54.291202+0000","last_became_active":"2023-11-15T01:36:54.285340+0000","last_became_peered":"2023-11-15T01:36:54.285340+0000","last_unstale":"2023-11-15T01:36:54.291202+0000","last_undegraded":"2023-11-15T01:36:54.291202+0000","last_fullsized":"2023-11-15T01:36:54.291202+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285842+0000","last_change":"2023-11-15T01:36:53.884903+0000","last_active":"2023-11-15T01:36:54.285842+0000","last_peered":"2023-11-15T01:36:54.285842+0000","last_clean":"2023-11-15T01:36:54.285842+0000","last_became_active":"2023-11-15T01:36:53.884613+0000","last_became_peered":"2023-11-15T01:36:53.884613+0000","last_unstale":"2023-11-15T01:36:54.285842+0000","last_undegraded":"2023-11-15T01:36:54.285842+0000","last_fullsized":"2023-11-15T01:36:54.285842+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.289197+0000","last_change":"2023-11-15T01:36:54.286008+0000","last_active":"2023-11-15T01:36:54.289197+0000","last_peered":"2023-11-15T01:36:54.289197+0000","last_clean":"2023-11-15T01:36:54.289197+0000","last_became_active":"2023-11-15T01:36:54.285698+0000","last_became_peered":"2023-11-15T01:36:54.285698+0000","last_unstale":"2023-11-15T01:36:54.289197+0000","last_undegraded":"2023-11-15T01:36:54.289197+0000","last_fullsized":"2023-11-15T01:36:54.289197+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285112+0000","last_change":"2023-11-15T01:36:53.885300+0000","last_active":"2023-11-15T01:36:54.285112+0000","last_peered":"2023-11-15T01:36:54.285112+0000","last_clean":"2023-11-15T01:36:54.285112+0000","last_became_active":"2023-11-15T01:36:53.884899+0000","last_became_peered":"2023-11-15T01:36:53.884899+0000","last_unstale":"2023-11-15T01:36:54.285112+0000","last_undegraded":"2023-11-15T01:36:54.285112+0000","last_fullsized":"2023-11-15T01:36:54.285112+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286597+0000","last_change":"2023-11-15T01:36:54.282918+0000","last_active":"2023-11-15T01:36:54.286597+0000","last_peered":"2023-11-15T01:36:54.286597+0000","last_clean":"2023-11-15T01:36:54.286597+0000","last_became_active":"2023-11-15T01:36:54.279420+0000","last_became_peered":"2023-11-15T01:36:54.279420+0000","last_unstale":"2023-11-15T01:36:54.286597+0000","last_undegraded":"2023-11-15T01:36:54.286597+0000","last_fullsized":"2023-11-15T01:36:54.286597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284891+0000","last_change":"2023-11-15T01:36:53.889515+0000","last_active":"2023-11-15T01:36:54.284891+0000","last_peered":"2023-11-15T01:36:54.284891+0000","last_clean":"2023-11-15T01:36:54.284891+0000","last_became_active":"2023-11-15T01:36:53.889219+0000","last_became_peered":"2023-11-15T01:36:53.889219+0000","last_unstale":"2023-11-15T01:36:54.284891+0000","last_undegraded":"2023-11-15T01:36:54.284891+0000","last_fullsized":"2023-11-15T01:36:54.284891+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285911+0000","last_change":"2023-11-15T01:36:54.279517+0000","last_active":"2023-11-15T01:36:54.285911+0000","last_peered":"2023-11-15T01:36:54.285911+0000","last_clean":"2023-11-15T01:36:54.285911+0000","last_became_active":"2023-11-15T01:36:54.279211+0000","last_became_peered":"2023-11-15T01:36:54.279211+0000","last_unstale":"2023-11-15T01:36:54.285911+0000","last_undegraded":"2023-11-15T01:36:54.285911+0000","last_fullsized":"2023-11-15T01:36:54.285911+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.279243+0000","last_change":"2023-11-15T01:36:53.886821+0000","last_active":"2023-11-15T01:36:54.279243+0000","last_peered":"2023-11-15T01:36:54.279243+0000","last_clean":"2023-11-15T01:36:54.279243+0000","last_became_active":"2023-11-15T01:36:53.886343+0000","last_became_peered":"2023-11-15T01:36:53.886343+0000","last_unstale":"2023-11-15T01:36:54.279243+0000","last_undegraded":"2023-11-15T01:36:54.279243+0000","last_fullsized":"2023-11-15T01:36:54.279243+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284532+0000","last_change":"2023-11-15T01:36:54.280666+0000","last_active":"2023-11-15T01:36:54.284532+0000","last_peered":"2023-11-15T01:36:54.284532+0000","last_clean":"2023-11-15T01:36:54.284532+0000","last_became_active":"2023-11-15T01:36:54.280388+0000","last_became_peered":"2023-11-15T01:36:54.280388+0000","last_unstale":"2023-11-15T01:36:54.284532+0000","last_undegraded":"2023-11-15T01:36:54.284532+0000","last_fullsized":"2023-11-15T01:36:54.284532+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269171+0000","last_change":"2023-11-15T01:36:53.889196+0000","last_active":"2023-11-15T01:36:54.269171+0000","last_peered":"2023-11-15T01:36:54.269171+0000","last_clean":"2023-11-15T01:36:54.269171+0000","last_became_active":"2023-11-15T01:36:53.888924+0000","last_became_peered":"2023-11-15T01:36:53.888924+0000","last_unstale":"2023-11-15T01:36:54.269171+0000","last_undegraded":"2023-11-15T01:36:54.269171+0000","last_fullsized":"2023-11-15T01:36:54.269171+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.283672+0000","last_change":"2023-11-15T01:36:54.282845+0000","last_active":"2023-11-15T01:36:54.283672+0000","last_peered":"2023-11-15T01:36:54.283672+0000","last_clean":"2023-11-15T01:36:54.283672+0000","last_became_active":"2023-11-15T01:36:54.282563+0000","last_became_peered":"2023-11-15T01:36:54.282563+0000","last_unstale":"2023-11-15T01:36:54.283672+0000","last_undegraded":"2023-11-15T01:36:54.283672+0000","last_fullsized":"2023-11-15T01:36:54.283672+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270732+0000","last_change":"2023-11-15T01:36:53.889042+0000","last_active":"2023-11-15T01:36:54.270732+0000","last_peered":"2023-11-15T01:36:54.270732+0000","last_clean":"2023-11-15T01:36:54.270732+0000","last_became_active":"2023-11-15T01:36:53.888667+0000","last_became_peered":"2023-11-15T01:36:53.888667+0000","last_unstale":"2023-11-15T01:36:54.270732+0000","last_undegraded":"2023-11-15T01:36:54.270732+0000","last_fullsized":"2023-11-15T01:36:54.270732+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285896+0000","last_change":"2023-11-15T01:36:54.279534+0000","last_active":"2023-11-15T01:36:54.285896+0000","last_peered":"2023-11-15T01:36:54.285896+0000","last_clean":"2023-11-15T01:36:54.285896+0000","last_became_active":"2023-11-15T01:36:54.279222+0000","last_became_peered":"2023-11-15T01:36:54.279222+0000","last_unstale":"2023-11-15T01:36:54.285896+0000","last_undegraded":"2023-11-15T01:36:54.285896+0000","last_fullsized":"2023-11-15T01:36:54.285896+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.273944+0000","last_change":"2023-11-15T01:36:53.884124+0000","last_active":"2023-11-15T01:36:54.273944+0000","last_peered":"2023-11-15T01:36:54.273944+0000","last_clean":"2023-11-15T01:36:54.273944+0000","last_became_active":"2023-11-15T01:36:53.883822+0000","last_became_peered":"2023-11-15T01:36:53.883822+0000","last_unstale":"2023-11-15T01:36:54.273944+0000","last_undegraded":"2023-11-15T01:36:54.273944+0000","last_fullsized":"2023-11-15T01:36:54.273944+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.289833+0000","last_change":"2023-11-15T01:36:54.288008+0000","last_active":"2023-11-15T01:36:54.289833+0000","last_peered":"2023-11-15T01:36:54.289833+0000","last_clean":"2023-11-15T01:36:54.289833+0000","last_became_active":"2023-11-15T01:36:54.287055+0000","last_became_peered":"2023-11-15T01:36:54.287055+0000","last_unstale":"2023-11-15T01:36:54.289833+0000","last_undegraded":"2023-11-15T01:36:54.289833+0000","last_fullsized":"2023-11-15T01:36:54.289833+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.272421+0000","last_change":"2023-11-15T01:36:53.889069+0000","last_active":"2023-11-15T01:36:54.272421+0000","last_peered":"2023-11-15T01:36:54.272421+0000","last_clean":"2023-11-15T01:36:54.272421+0000","last_became_active":"2023-11-15T01:36:53.888808+0000","last_became_peered":"2023-11-15T01:36:53.888808+0000","last_unstale":"2023-11-15T01:36:54.272421+0000","last_undegraded":"2023-11-15T01:36:54.272421+0000","last_fullsized":"2023-11-15T01:36:54.272421+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291648+0000","last_change":"2023-11-15T01:36:54.290805+0000","last_active":"2023-11-15T01:36:54.291648+0000","last_peered":"2023-11-15T01:36:54.291648+0000","last_clean":"2023-11-15T01:36:54.291648+0000","last_became_active":"2023-11-15T01:36:54.289932+0000","last_became_peered":"2023-11-15T01:36:54.289932+0000","last_unstale":"2023-11-15T01:36:54.291648+0000","last_undegraded":"2023-11-15T01:36:54.291648+0000","last_fullsized":"2023-11-15T01:36:54.291648+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.296673+0000","last_change":"2023-11-15T01:36:53.882772+0000","last_active":"2023-11-15T01:36:54.296673+0000","last_peered":"2023-11-15T01:36:54.296673+0000","last_clean":"2023-11-15T01:36:54.296673+0000","last_became_active":"2023-11-15T01:36:53.882233+0000","last_became_peered":"2023-11-15T01:36:53.882233+0000","last_unstale":"2023-11-15T01:36:54.296673+0000","last_undegraded":"2023-11-15T01:36:54.296673+0000","last_fullsized":"2023-11-15T01:36:54.296673+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.297568+0000","last_change":"2023-11-15T01:36:54.297045+0000","last_active":"2023-11-15T01:36:54.297568+0000","last_peered":"2023-11-15T01:36:54.297568+0000","last_clean":"2023-11-15T01:36:54.297568+0000","last_became_active":"2023-11-15T01:36:54.296792+0000","last_became_peered":"2023-11-15T01:36:54.296792+0000","last_unstale":"2023-11-15T01:36:54.297568+0000","last_undegraded":"2023-11-15T01:36:54.297568+0000","last_fullsized":"2023-11-15T01:36:54.297568+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.280380+0000","last_change":"2023-11-15T01:36:53.881311+0000","last_active":"2023-11-15T01:36:54.280380+0000","last_peered":"2023-11-15T01:36:54.280380+0000","last_clean":"2023-11-15T01:36:54.280380+0000","last_became_active":"2023-11-15T01:36:53.881044+0000","last_became_peered":"2023-11-15T01:36:53.881044+0000","last_unstale":"2023-11-15T01:36:54.280380+0000","last_undegraded":"2023-11-15T01:36:54.280380+0000","last_fullsized":"2023-11-15T01:36:54.280380+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.296218+0000","last_change":"2023-11-15T01:36:54.295456+0000","last_active":"2023-11-15T01:36:54.296218+0000","last_peered":"2023-11-15T01:36:54.296218+0000","last_clean":"2023-11-15T01:36:54.296218+0000","last_became_active":"2023-11-15T01:36:54.294904+0000","last_became_peered":"2023-11-15T01:36:54.294904+0000","last_unstale":"2023-11-15T01:36:54.296218+0000","last_undegraded":"2023-11-15T01:36:54.296218+0000","last_fullsized":"2023-11-15T01:36:54.296218+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.272426+0000","last_change":"2023-11-15T01:36:53.886059+0000","last_active":"2023-11-15T01:36:54.272426+0000","last_peered":"2023-11-15T01:36:54.272426+0000","last_clean":"2023-11-15T01:36:54.272426+0000","last_became_active":"2023-11-15T01:36:53.885735+0000","last_became_peered":"2023-11-15T01:36:53.885735+0000","last_unstale":"2023-11-15T01:36:54.272426+0000","last_undegraded":"2023-11-15T01:36:54.272426+0000","last_fullsized":"2023-11-15T01:36:54.272426+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286203+0000","last_change":"2023-11-15T01:36:54.281640+0000","last_active":"2023-11-15T01:36:54.286203+0000","last_peered":"2023-11-15T01:36:54.286203+0000","last_clean":"2023-11-15T01:36:54.286203+0000","last_became_active":"2023-11-15T01:36:54.281367+0000","last_became_peered":"2023-11-15T01:36:54.281367+0000","last_unstale":"2023-11-15T01:36:54.286203+0000","last_undegraded":"2023-11-15T01:36:54.286203+0000","last_fullsized":"2023-11-15T01:36:54.286203+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.266449+0000","last_change":"2023-11-15T01:36:53.890222+0000","last_active":"2023-11-15T01:36:54.266449+0000","last_peered":"2023-11-15T01:36:54.266449+0000","last_clean":"2023-11-15T01:36:54.266449+0000","last_became_active":"2023-11-15T01:36:53.889231+0000","last_became_peered":"2023-11-15T01:36:53.889231+0000","last_unstale":"2023-11-15T01:36:54.266449+0000","last_undegraded":"2023-11-15T01:36:54.266449+0000","last_fullsized":"2023-11-15T01:36:54.266449+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291018+0000","last_change":"2023-11-15T01:36:54.290365+0000","last_active":"2023-11-15T01:36:54.291018+0000","last_peered":"2023-11-15T01:36:54.291018+0000","last_clean":"2023-11-15T01:36:54.291018+0000","last_became_active":"2023-11-15T01:36:54.289897+0000","last_became_peered":"2023-11-15T01:36:54.289897+0000","last_unstale":"2023-11-15T01:36:54.291018+0000","last_undegraded":"2023-11-15T01:36:54.291018+0000","last_fullsized":"2023-11-15T01:36:54.291018+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284771+0000","last_change":"2023-11-15T01:36:53.889211+0000","last_active":"2023-11-15T01:36:54.284771+0000","last_peered":"2023-11-15T01:36:54.284771+0000","last_clean":"2023-11-15T01:36:54.284771+0000","last_became_active":"2023-11-15T01:36:53.888912+0000","last_became_peered":"2023-11-15T01:36:53.888912+0000","last_unstale":"2023-11-15T01:36:54.284771+0000","last_undegraded":"2023-11-15T01:36:54.284771+0000","last_fullsized":"2023-11-15T01:36:54.284771+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.295430+0000","last_change":"2023-11-15T01:36:54.293187+0000","last_active":"2023-11-15T01:36:54.295430+0000","last_peered":"2023-11-15T01:36:54.295430+0000","last_clean":"2023-11-15T01:36:54.295430+0000","last_became_active":"2023-11-15T01:36:54.292892+0000","last_became_peered":"2023-11-15T01:36:54.292892+0000","last_unstale":"2023-11-15T01:36:54.295430+0000","last_undegraded":"2023-11-15T01:36:54.295430+0000","last_fullsized":"2023-11-15T01:36:54.295430+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271679+0000","last_change":"2023-11-15T01:36:53.889227+0000","last_active":"2023-11-15T01:36:54.271679+0000","last_peered":"2023-11-15T01:36:54.271679+0000","last_clean":"2023-11-15T01:36:54.271679+0000","last_became_active":"2023-11-15T01:36:53.888810+0000","last_became_peered":"2023-11-15T01:36:53.888810+0000","last_unstale":"2023-11-15T01:36:54.271679+0000","last_undegraded":"2023-11-15T01:36:54.271679+0000","last_fullsized":"2023-11-15T01:36:54.271679+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287898+0000","last_change":"2023-11-15T01:36:54.287042+0000","last_active":"2023-11-15T01:36:54.287898+0000","last_peered":"2023-11-15T01:36:54.287898+0000","last_clean":"2023-11-15T01:36:54.287898+0000","last_became_active":"2023-11-15T01:36:54.286758+0000","last_became_peered":"2023-11-15T01:36:54.286758+0000","last_unstale":"2023-11-15T01:36:54.287898+0000","last_undegraded":"2023-11-15T01:36:54.287898+0000","last_fullsized":"2023-11-15T01:36:54.287898+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269854+0000","last_change":"2023-11-15T01:36:53.892220+0000","last_active":"2023-11-15T01:36:54.269854+0000","last_peered":"2023-11-15T01:36:54.269854+0000","last_clean":"2023-11-15T01:36:54.269854+0000","last_became_active":"2023-11-15T01:36:53.891920+0000","last_became_peered":"2023-11-15T01:36:53.891920+0000","last_unstale":"2023-11-15T01:36:54.269854+0000","last_undegraded":"2023-11-15T01:36:54.269854+0000","last_fullsized":"2023-11-15T01:36:54.269854+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291072+0000","last_change":"2023-11-15T01:36:54.289875+0000","last_active":"2023-11-15T01:36:54.291072+0000","last_peered":"2023-11-15T01:36:54.291072+0000","last_clean":"2023-11-15T01:36:54.291072+0000","last_became_active":"2023-11-15T01:36:54.289598+0000","last_became_peered":"2023-11-15T01:36:54.289598+0000","last_unstale":"2023-11-15T01:36:54.291072+0000","last_undegraded":"2023-11-15T01:36:54.291072+0000","last_fullsized":"2023-11-15T01:36:54.291072+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287371+0000","last_change":"2023-11-15T01:36:53.888740+0000","last_active":"2023-11-15T01:36:54.287371+0000","last_peered":"2023-11-15T01:36:54.287371+0000","last_clean":"2023-11-15T01:36:54.287371+0000","last_became_active":"2023-11-15T01:36:53.888166+0000","last_became_peered":"2023-11-15T01:36:53.888166+0000","last_unstale":"2023-11-15T01:36:54.287371+0000","last_undegraded":"2023-11-15T01:36:54.287371+0000","last_fullsized":"2023-11-15T01:36:54.287371+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284298+0000","last_change":"2023-11-15T01:36:54.281888+0000","last_active":"2023-11-15T01:36:54.284298+0000","last_peered":"2023-11-15T01:36:54.284298+0000","last_clean":"2023-11-15T01:36:54.284298+0000","last_became_active":"2023-11-15T01:36:54.281592+0000","last_became_peered":"2023-11-15T01:36:54.281592+0000","last_unstale":"2023-11-15T01:36:54.284298+0000","last_undegraded":"2023-11-15T01:36:54.284298+0000","last_fullsized":"2023-11-15T01:36:54.284298+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.267605+0000","last_change":"2023-11-15T01:36:53.883412+0000","last_active":"2023-11-15T01:36:54.267605+0000","last_peered":"2023-11-15T01:36:54.267605+0000","last_clean":"2023-11-15T01:36:54.267605+0000","last_became_active":"2023-11-15T01:36:53.883087+0000","last_became_peered":"2023-11-15T01:36:53.883087+0000","last_unstale":"2023-11-15T01:36:54.267605+0000","last_undegraded":"2023-11-15T01:36:54.267605+0000","last_fullsized":"2023-11-15T01:36:54.267605+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291060+0000","last_change":"2023-11-15T01:36:54.289221+0000","last_active":"2023-11-15T01:36:54.291060+0000","last_peered":"2023-11-15T01:36:54.291060+0000","last_clean":"2023-11-15T01:36:54.291060+0000","last_became_active":"2023-11-15T01:36:54.288813+0000","last_became_peered":"2023-11-15T01:36:54.288813+0000","last_unstale":"2023-11-15T01:36:54.291060+0000","last_undegraded":"2023-11-15T01:36:54.291060+0000","last_fullsized":"2023-11-15T01:36:54.291060+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.279362+0000","last_change":"2023-11-15T01:36:53.884216+0000","last_active":"2023-11-15T01:36:54.279362+0000","last_peered":"2023-11-15T01:36:54.279362+0000","last_clean":"2023-11-15T01:36:54.279362+0000","last_became_active":"2023-11-15T01:36:53.883877+0000","last_became_peered":"2023-11-15T01:36:53.883877+0000","last_unstale":"2023-11-15T01:36:54.279362+0000","last_undegraded":"2023-11-15T01:36:54.279362+0000","last_fullsized":"2023-11-15T01:36:54.279362+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.292132+0000","last_change":"2023-11-15T01:36:54.291610+0000","last_active":"2023-11-15T01:36:54.292132+0000","last_peered":"2023-11-15T01:36:54.292132+0000","last_clean":"2023-11-15T01:36:54.292132+0000","last_became_active":"2023-11-15T01:36:54.291311+0000","last_became_peered":"2023-11-15T01:36:54.291311+0000","last_unstale":"2023-11-15T01:36:54.292132+0000","last_undegraded":"2023-11-15T01:36:54.292132+0000","last_fullsized":"2023-11-15T01:36:54.292132+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.273597+0000","last_change":"2023-11-15T01:36:53.884348+0000","last_active":"2023-11-15T01:36:54.273597+0000","last_peered":"2023-11-15T01:36:54.273597+0000","last_clean":"2023-11-15T01:36:54.273597+0000","last_became_active":"2023-11-15T01:36:53.884008+0000","last_became_peered":"2023-11-15T01:36:53.884008+0000","last_unstale":"2023-11-15T01:36:54.273597+0000","last_undegraded":"2023-11-15T01:36:54.273597+0000","last_fullsized":"2023-11-15T01:36:54.273597+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286425+0000","last_change":"2023-11-15T01:36:54.281468+0000","last_active":"2023-11-15T01:36:54.286425+0000","last_peered":"2023-11-15T01:36:54.286425+0000","last_clean":"2023-11-15T01:36:54.286425+0000","last_became_active":"2023-11-15T01:36:54.281166+0000","last_became_peered":"2023-11-15T01:36:54.281166+0000","last_unstale":"2023-11-15T01:36:54.286425+0000","last_undegraded":"2023-11-15T01:36:54.286425+0000","last_fullsized":"2023-11-15T01:36:54.286425+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271214+0000","last_change":"2023-11-15T01:36:53.884263+0000","last_active":"2023-11-15T01:36:54.271214+0000","last_peered":"2023-11-15T01:36:54.271214+0000","last_clean":"2023-11-15T01:36:54.271214+0000","last_became_active":"2023-11-15T01:36:53.883955+0000","last_became_peered":"2023-11-15T01:36:53.883955+0000","last_unstale":"2023-11-15T01:36:54.271214+0000","last_undegraded":"2023-11-15T01:36:54.271214+0000","last_fullsized":"2023-11-15T01:36:54.271214+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290702+0000","last_change":"2023-11-15T01:36:54.283512+0000","last_active":"2023-11-15T01:36:54.290702+0000","last_peered":"2023-11-15T01:36:54.290702+0000","last_clean":"2023-11-15T01:36:54.290702+0000","last_became_active":"2023-11-15T01:36:54.283275+0000","last_became_peered":"2023-11-15T01:36:54.283275+0000","last_unstale":"2023-11-15T01:36:54.290702+0000","last_undegraded":"2023-11-15T01:36:54.290702+0000","last_fullsized":"2023-11-15T01:36:54.290702+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271669+0000","last_change":"2023-11-15T01:36:53.888205+0000","last_active":"2023-11-15T01:36:54.271669+0000","last_peered":"2023-11-15T01:36:54.271669+0000","last_clean":"2023-11-15T01:36:54.271669+0000","last_became_active":"2023-11-15T01:36:53.887901+0000","last_became_peered":"2023-11-15T01:36:53.887901+0000","last_unstale":"2023-11-15T01:36:54.271669+0000","last_undegraded":"2023-11-15T01:36:54.271669+0000","last_fullsized":"2023-11-15T01:36:54.271669+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.283363+0000","last_change":"2023-11-15T01:36:54.281461+0000","last_active":"2023-11-15T01:36:54.283363+0000","last_peered":"2023-11-15T01:36:54.283363+0000","last_clean":"2023-11-15T01:36:54.283363+0000","last_became_active":"2023-11-15T01:36:54.281175+0000","last_became_peered":"2023-11-15T01:36:54.281175+0000","last_unstale":"2023-11-15T01:36:54.283363+0000","last_undegraded":"2023-11-15T01:36:54.283363+0000","last_fullsized":"2023-11-15T01:36:54.283363+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.273333+0000","last_change":"2023-11-15T01:36:53.884211+0000","last_active":"2023-11-15T01:36:54.273333+0000","last_peered":"2023-11-15T01:36:54.273333+0000","last_clean":"2023-11-15T01:36:54.273333+0000","last_became_active":"2023-11-15T01:36:53.883917+0000","last_became_peered":"2023-11-15T01:36:53.883917+0000","last_unstale":"2023-11-15T01:36:54.273333+0000","last_undegraded":"2023-11-15T01:36:54.273333+0000","last_fullsized":"2023-11-15T01:36:54.273333+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286529+0000","last_change":"2023-11-15T01:36:54.282412+0000","last_active":"2023-11-15T01:36:54.286529+0000","last_peered":"2023-11-15T01:36:54.286529+0000","last_clean":"2023-11-15T01:36:54.286529+0000","last_became_active":"2023-11-15T01:36:54.282051+0000","last_became_peered":"2023-11-15T01:36:54.282051+0000","last_unstale":"2023-11-15T01:36:54.286529+0000","last_undegraded":"2023-11-15T01:36:54.286529+0000","last_fullsized":"2023-11-15T01:36:54.286529+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.274618+0000","last_change":"2023-11-15T01:36:53.894114+0000","last_active":"2023-11-15T01:36:54.274618+0000","last_peered":"2023-11-15T01:36:54.274618+0000","last_clean":"2023-11-15T01:36:54.274618+0000","last_became_active":"2023-11-15T01:36:53.893833+0000","last_became_peered":"2023-11-15T01:36:53.893833+0000","last_unstale":"2023-11-15T01:36:54.274618+0000","last_undegraded":"2023-11-15T01:36:54.274618+0000","last_fullsized":"2023-11-15T01:36:54.274618+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.283804+0000","last_change":"2023-11-15T01:36:54.280898+0000","last_active":"2023-11-15T01:36:54.283804+0000","last_peered":"2023-11-15T01:36:54.283804+0000","last_clean":"2023-11-15T01:36:54.283804+0000","last_became_active":"2023-11-15T01:36:54.280611+0000","last_became_peered":"2023-11-15T01:36:54.280611+0000","last_unstale":"2023-11-15T01:36:54.283804+0000","last_undegraded":"2023-11-15T01:36:54.283804+0000","last_fullsized":"2023-11-15T01:36:54.283804+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287492+0000","last_change":"2023-11-15T01:36:53.882268+0000","last_active":"2023-11-15T01:36:54.287492+0000","last_peered":"2023-11-15T01:36:54.287492+0000","last_clean":"2023-11-15T01:36:54.287492+0000","last_became_active":"2023-11-15T01:36:53.881979+0000","last_became_peered":"2023-11-15T01:36:53.881979+0000","last_unstale":"2023-11-15T01:36:54.287492+0000","last_undegraded":"2023-11-15T01:36:54.287492+0000","last_fullsized":"2023-11-15T01:36:54.287492+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.278814+0000","last_change":"2023-11-15T01:36:54.274384+0000","last_active":"2023-11-15T01:36:54.278814+0000","last_peered":"2023-11-15T01:36:54.278814+0000","last_clean":"2023-11-15T01:36:54.278814+0000","last_became_active":"2023-11-15T01:36:54.273445+0000","last_became_peered":"2023-11-15T01:36:54.273445+0000","last_unstale":"2023-11-15T01:36:54.278814+0000","last_undegraded":"2023-11-15T01:36:54.278814+0000","last_fullsized":"2023-11-15T01:36:54.278814+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.273258+0000","last_change":"2023-11-15T01:36:53.892145+0000","last_active":"2023-11-15T01:36:54.273258+0000","last_peered":"2023-11-15T01:36:54.273258+0000","last_clean":"2023-11-15T01:36:54.273258+0000","last_became_active":"2023-11-15T01:36:53.891844+0000","last_became_peered":"2023-11-15T01:36:53.891844+0000","last_unstale":"2023-11-15T01:36:54.273258+0000","last_undegraded":"2023-11-15T01:36:54.273258+0000","last_fullsized":"2023-11-15T01:36:54.273258+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291034+0000","last_change":"2023-11-15T01:36:54.289074+0000","last_active":"2023-11-15T01:36:54.291034+0000","last_peered":"2023-11-15T01:36:54.291034+0000","last_clean":"2023-11-15T01:36:54.291034+0000","last_became_active":"2023-11-15T01:36:54.288459+0000","last_became_peered":"2023-11-15T01:36:54.288459+0000","last_unstale":"2023-11-15T01:36:54.291034+0000","last_undegraded":"2023-11-15T01:36:54.291034+0000","last_fullsized":"2023-11-15T01:36:54.291034+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287132+0000","last_change":"2023-11-15T01:36:53.883037+0000","last_active":"2023-11-15T01:36:54.287132+0000","last_peered":"2023-11-15T01:36:54.287132+0000","last_clean":"2023-11-15T01:36:54.287132+0000","last_became_active":"2023-11-15T01:36:53.882747+0000","last_became_peered":"2023-11-15T01:36:53.882747+0000","last_unstale":"2023-11-15T01:36:54.287132+0000","last_undegraded":"2023-11-15T01:36:54.287132+0000","last_fullsized":"2023-11-15T01:36:54.287132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.288289+0000","last_change":"2023-11-15T01:36:54.287088+0000","last_active":"2023-11-15T01:36:54.288289+0000","last_peered":"2023-11-15T01:36:54.288289+0000","last_clean":"2023-11-15T01:36:54.288289+0000","last_became_active":"2023-11-15T01:36:54.286616+0000","last_became_peered":"2023-11-15T01:36:54.286616+0000","last_unstale":"2023-11-15T01:36:54.288289+0000","last_undegraded":"2023-11-15T01:36:54.288289+0000","last_fullsized":"2023-11-15T01:36:54.288289+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.272058+0000","last_change":"2023-11-15T01:36:53.893540+0000","last_active":"2023-11-15T01:36:54.272058+0000","last_peered":"2023-11-15T01:36:54.272058+0000","last_clean":"2023-11-15T01:36:54.272058+0000","last_became_active":"2023-11-15T01:36:53.893298+0000","last_became_peered":"2023-11-15T01:36:53.893298+0000","last_unstale":"2023-11-15T01:36:54.272058+0000","last_undegraded":"2023-11-15T01:36:54.272058+0000","last_fullsized":"2023-11-15T01:36:54.272058+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286223+0000","last_change":"2023-11-15T01:36:54.282896+0000","last_active":"2023-11-15T01:36:54.286223+0000","last_peered":"2023-11-15T01:36:54.286223+0000","last_clean":"2023-11-15T01:36:54.286223+0000","last_became_active":"2023-11-15T01:36:54.281854+0000","last_became_peered":"2023-11-15T01:36:54.281854+0000","last_unstale":"2023-11-15T01:36:54.286223+0000","last_undegraded":"2023-11-15T01:36:54.286223+0000","last_fullsized":"2023-11-15T01:36:54.286223+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.279337+0000","last_change":"2023-11-15T01:36:53.886621+0000","last_active":"2023-11-15T01:36:54.279337+0000","last_peered":"2023-11-15T01:36:54.279337+0000","last_clean":"2023-11-15T01:36:54.279337+0000","last_became_active":"2023-11-15T01:36:53.885945+0000","last_became_peered":"2023-11-15T01:36:53.885945+0000","last_unstale":"2023-11-15T01:36:54.279337+0000","last_undegraded":"2023-11-15T01:36:54.279337+0000","last_fullsized":"2023-11-15T01:36:54.279337+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.295460+0000","last_change":"2023-11-15T01:36:54.288865+0000","last_active":"2023-11-15T01:36:54.295460+0000","last_peered":"2023-11-15T01:36:54.295460+0000","last_clean":"2023-11-15T01:36:54.295460+0000","last_became_active":"2023-11-15T01:36:54.288593+0000","last_became_peered":"2023-11-15T01:36:54.288593+0000","last_unstale":"2023-11-15T01:36:54.295460+0000","last_undegraded":"2023-11-15T01:36:54.295460+0000","last_fullsized":"2023-11-15T01:36:54.295460+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269062+0000","last_change":"2023-11-15T01:36:53.888541+0000","last_active":"2023-11-15T01:36:54.269062+0000","last_peered":"2023-11-15T01:36:54.269062+0000","last_clean":"2023-11-15T01:36:54.269062+0000","last_became_active":"2023-11-15T01:36:53.888202+0000","last_became_peered":"2023-11-15T01:36:53.888202+0000","last_unstale":"2023-11-15T01:36:54.269062+0000","last_undegraded":"2023-11-15T01:36:54.269062+0000","last_fullsized":"2023-11-15T01:36:54.269062+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286067+0000","last_change":"2023-11-15T01:36:54.279187+0000","last_active":"2023-11-15T01:36:54.286067+0000","last_peered":"2023-11-15T01:36:54.286067+0000","last_clean":"2023-11-15T01:36:54.286067+0000","last_became_active":"2023-11-15T01:36:54.278905+0000","last_became_peered":"2023-11-15T01:36:54.278905+0000","last_unstale":"2023-11-15T01:36:54.286067+0000","last_undegraded":"2023-11-15T01:36:54.286067+0000","last_fullsized":"2023-11-15T01:36:54.286067+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.289485+0000","last_change":"2023-11-15T01:36:53.891252+0000","last_active":"2023-11-15T01:36:54.289485+0000","last_peered":"2023-11-15T01:36:54.289485+0000","last_clean":"2023-11-15T01:36:54.289485+0000","last_became_active":"2023-11-15T01:36:53.890675+0000","last_became_peered":"2023-11-15T01:36:53.890675+0000","last_unstale":"2023-11-15T01:36:54.289485+0000","last_undegraded":"2023-11-15T01:36:54.289485+0000","last_fullsized":"2023-11-15T01:36:54.289485+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.296463+0000","last_change":"2023-11-15T01:36:54.284667+0000","last_active":"2023-11-15T01:36:54.296463+0000","last_peered":"2023-11-15T01:36:54.296463+0000","last_clean":"2023-11-15T01:36:54.296463+0000","last_became_active":"2023-11-15T01:36:54.284367+0000","last_became_peered":"2023-11-15T01:36:54.284367+0000","last_unstale":"2023-11-15T01:36:54.296463+0000","last_undegraded":"2023-11-15T01:36:54.296463+0000","last_fullsized":"2023-11-15T01:36:54.296463+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.280815+0000","last_change":"2023-11-15T01:36:53.893610+0000","last_active":"2023-11-15T01:36:54.280815+0000","last_peered":"2023-11-15T01:36:54.280815+0000","last_clean":"2023-11-15T01:36:54.280815+0000","last_became_active":"2023-11-15T01:36:53.893305+0000","last_became_peered":"2023-11-15T01:36:53.893305+0000","last_unstale":"2023-11-15T01:36:54.280815+0000","last_undegraded":"2023-11-15T01:36:54.280815+0000","last_fullsized":"2023-11-15T01:36:54.280815+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290753+0000","last_change":"2023-11-15T01:36:54.289986+0000","last_active":"2023-11-15T01:36:54.290753+0000","last_peered":"2023-11-15T01:36:54.290753+0000","last_clean":"2023-11-15T01:36:54.290753+0000","last_became_active":"2023-11-15T01:36:54.289690+0000","last_became_peered":"2023-11-15T01:36:54.289690+0000","last_unstale":"2023-11-15T01:36:54.290753+0000","last_undegraded":"2023-11-15T01:36:54.290753+0000","last_fullsized":"2023-11-15T01:36:54.290753+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.295715+0000","last_change":"2023-11-15T01:36:53.887589+0000","last_active":"2023-11-15T01:36:54.295715+0000","last_peered":"2023-11-15T01:36:54.295715+0000","last_clean":"2023-11-15T01:36:54.295715+0000","last_became_active":"2023-11-15T01:36:53.887279+0000","last_became_peered":"2023-11-15T01:36:53.887279+0000","last_unstale":"2023-11-15T01:36:54.295715+0000","last_undegraded":"2023-11-15T01:36:54.295715+0000","last_fullsized":"2023-11-15T01:36:54.295715+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.283361+0000","last_change":"2023-11-15T01:36:54.281819+0000","last_active":"2023-11-15T01:36:54.283361+0000","last_peered":"2023-11-15T01:36:54.283361+0000","last_clean":"2023-11-15T01:36:54.283361+0000","last_became_active":"2023-11-15T01:36:54.281516+0000","last_became_peered":"2023-11-15T01:36:54.281516+0000","last_unstale":"2023-11-15T01:36:54.283361+0000","last_undegraded":"2023-11-15T01:36:54.283361+0000","last_fullsized":"2023-11-15T01:36:54.283361+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269430+0000","last_change":"2023-11-15T01:36:53.892952+0000","last_active":"2023-11-15T01:36:54.269430+0000","last_peered":"2023-11-15T01:36:54.269430+0000","last_clean":"2023-11-15T01:36:54.269430+0000","last_became_active":"2023-11-15T01:36:53.892100+0000","last_became_peered":"2023-11-15T01:36:53.892100+0000","last_unstale":"2023-11-15T01:36:54.269430+0000","last_undegraded":"2023-11-15T01:36:54.269430+0000","last_fullsized":"2023-11-15T01:36:54.269430+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286117+0000","last_change":"2023-11-15T01:36:54.279589+0000","last_active":"2023-11-15T01:36:54.286117+0000","last_peered":"2023-11-15T01:36:54.286117+0000","last_clean":"2023-11-15T01:36:54.286117+0000","last_became_active":"2023-11-15T01:36:54.279242+0000","last_became_peered":"2023-11-15T01:36:54.279242+0000","last_unstale":"2023-11-15T01:36:54.286117+0000","last_undegraded":"2023-11-15T01:36:54.286117+0000","last_fullsized":"2023-11-15T01:36:54.286117+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.273091+0000","last_change":"2023-11-15T01:36:53.887653+0000","last_active":"2023-11-15T01:36:54.273091+0000","last_peered":"2023-11-15T01:36:54.273091+0000","last_clean":"2023-11-15T01:36:54.273091+0000","last_became_active":"2023-11-15T01:36:53.883451+0000","last_became_peered":"2023-11-15T01:36:53.883451+0000","last_unstale":"2023-11-15T01:36:54.273091+0000","last_undegraded":"2023-11-15T01:36:54.273091+0000","last_fullsized":"2023-11-15T01:36:54.273091+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.296034+0000","last_change":"2023-11-15T01:36:54.295174+0000","last_active":"2023-11-15T01:36:54.296034+0000","last_peered":"2023-11-15T01:36:54.296034+0000","last_clean":"2023-11-15T01:36:54.296034+0000","last_became_active":"2023-11-15T01:36:54.294566+0000","last_became_peered":"2023-11-15T01:36:54.294566+0000","last_unstale":"2023-11-15T01:36:54.296034+0000","last_undegraded":"2023-11-15T01:36:54.296034+0000","last_fullsized":"2023-11-15T01:36:54.296034+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.272178+0000","last_change":"2023-11-15T01:36:53.888916+0000","last_active":"2023-11-15T01:36:54.272178+0000","last_peered":"2023-11-15T01:36:54.272178+0000","last_clean":"2023-11-15T01:36:54.272178+0000","last_became_active":"2023-11-15T01:36:53.888640+0000","last_became_peered":"2023-11-15T01:36:53.888640+0000","last_unstale":"2023-11-15T01:36:54.272178+0000","last_undegraded":"2023-11-15T01:36:54.272178+0000","last_fullsized":"2023-11-15T01:36:54.272178+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290774+0000","last_change":"2023-11-15T01:36:54.290023+0000","last_active":"2023-11-15T01:36:54.290774+0000","last_peered":"2023-11-15T01:36:54.290774+0000","last_clean":"2023-11-15T01:36:54.290774+0000","last_became_active":"2023-11-15T01:36:54.289752+0000","last_became_peered":"2023-11-15T01:36:54.289752+0000","last_unstale":"2023-11-15T01:36:54.290774+0000","last_undegraded":"2023-11-15T01:36:54.290774+0000","last_fullsized":"2023-11-15T01:36:54.290774+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.266554+0000","last_change":"2023-11-15T01:36:53.882475+0000","last_active":"2023-11-15T01:36:54.266554+0000","last_peered":"2023-11-15T01:36:54.266554+0000","last_clean":"2023-11-15T01:36:54.266554+0000","last_became_active":"2023-11-15T01:36:53.882148+0000","last_became_peered":"2023-11-15T01:36:53.882148+0000","last_unstale":"2023-11-15T01:36:54.266554+0000","last_undegraded":"2023-11-15T01:36:54.266554+0000","last_fullsized":"2023-11-15T01:36:54.266554+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285602+0000","last_change":"2023-11-15T01:36:54.284124+0000","last_active":"2023-11-15T01:36:54.285602+0000","last_peered":"2023-11-15T01:36:54.285602+0000","last_clean":"2023-11-15T01:36:54.285602+0000","last_became_active":"2023-11-15T01:36:54.283861+0000","last_became_peered":"2023-11-15T01:36:54.283861+0000","last_unstale":"2023-11-15T01:36:54.285602+0000","last_undegraded":"2023-11-15T01:36:54.285602+0000","last_fullsized":"2023-11-15T01:36:54.285602+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269915+0000","last_change":"2023-11-15T01:36:53.886731+0000","last_active":"2023-11-15T01:36:54.269915+0000","last_peered":"2023-11-15T01:36:54.269915+0000","last_clean":"2023-11-15T01:36:54.269915+0000","last_became_active":"2023-11-15T01:36:53.886460+0000","last_became_peered":"2023-11-15T01:36:53.886460+0000","last_unstale":"2023-11-15T01:36:54.269915+0000","last_undegraded":"2023-11-15T01:36:54.269915+0000","last_fullsized":"2023-11-15T01:36:54.269915+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.295408+0000","last_change":"2023-11-15T01:36:54.284273+0000","last_active":"2023-11-15T01:36:54.295408+0000","last_peered":"2023-11-15T01:36:54.295408+0000","last_clean":"2023-11-15T01:36:54.295408+0000","last_became_active":"2023-11-15T01:36:54.284001+0000","last_became_peered":"2023-11-15T01:36:54.284001+0000","last_unstale":"2023-11-15T01:36:54.295408+0000","last_undegraded":"2023-11-15T01:36:54.295408+0000","last_fullsized":"2023-11-15T01:36:54.295408+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271077+0000","last_change":"2023-11-15T01:36:53.894084+0000","last_active":"2023-11-15T01:36:54.271077+0000","last_peered":"2023-11-15T01:36:54.271077+0000","last_clean":"2023-11-15T01:36:54.271077+0000","last_became_active":"2023-11-15T01:36:53.893722+0000","last_became_peered":"2023-11-15T01:36:53.893722+0000","last_unstale":"2023-11-15T01:36:54.271077+0000","last_undegraded":"2023-11-15T01:36:54.271077+0000","last_fullsized":"2023-11-15T01:36:54.271077+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.289220+0000","last_change":"2023-11-15T01:36:54.286839+0000","last_active":"2023-11-15T01:36:54.289220+0000","last_peered":"2023-11-15T01:36:54.289220+0000","last_clean":"2023-11-15T01:36:54.289220+0000","last_became_active":"2023-11-15T01:36:54.286543+0000","last_became_peered":"2023-11-15T01:36:54.286543+0000","last_unstale":"2023-11-15T01:36:54.289220+0000","last_undegraded":"2023-11-15T01:36:54.289220+0000","last_fullsized":"2023-11-15T01:36:54.289220+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.274723+0000","last_change":"2023-11-15T01:36:53.883634+0000","last_active":"2023-11-15T01:36:54.274723+0000","last_peered":"2023-11-15T01:36:54.274723+0000","last_clean":"2023-11-15T01:36:54.274723+0000","last_became_active":"2023-11-15T01:36:53.883355+0000","last_became_peered":"2023-11-15T01:36:53.883355+0000","last_unstale":"2023-11-15T01:36:54.274723+0000","last_undegraded":"2023-11-15T01:36:54.274723+0000","last_fullsized":"2023-11-15T01:36:54.274723+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.289854+0000","last_change":"2023-11-15T01:36:54.288195+0000","last_active":"2023-11-15T01:36:54.289854+0000","last_peered":"2023-11-15T01:36:54.289854+0000","last_clean":"2023-11-15T01:36:54.289854+0000","last_became_active":"2023-11-15T01:36:54.287547+0000","last_became_peered":"2023-11-15T01:36:54.287547+0000","last_unstale":"2023-11-15T01:36:54.289854+0000","last_undegraded":"2023-11-15T01:36:54.289854+0000","last_fullsized":"2023-11-15T01:36:54.289854+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"93'3","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290682+0000","last_change":"2023-11-15T01:36:53.886811+0000","last_active":"2023-11-15T01:36:54.290682+0000","last_peered":"2023-11-15T01:36:54.290682+0000","last_clean":"2023-11-15T01:36:54.290682+0000","last_became_active":"2023-11-15T01:36:53.886510+0000","last_became_peered":"2023-11-15T01:36:53.886510+0000","last_unstale":"2023-11-15T01:36:54.290682+0000","last_undegraded":"2023-11-15T01:36:54.290682+0000","last_fullsized":"2023-11-15T01:36:54.290682+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286271+0000","last_change":"2023-11-15T01:36:54.281090+0000","last_active":"2023-11-15T01:36:54.286271+0000","last_peered":"2023-11-15T01:36:54.286271+0000","last_clean":"2023-11-15T01:36:54.286271+0000","last_became_active":"2023-11-15T01:36:54.279545+0000","last_became_peered":"2023-11-15T01:36:54.279545+0000","last_unstale":"2023-11-15T01:36:54.286271+0000","last_undegraded":"2023-11-15T01:36:54.286271+0000","last_fullsized":"2023-11-15T01:36:54.286271+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285081+0000","last_change":"2023-11-15T01:36:53.885770+0000","last_active":"2023-11-15T01:36:54.285081+0000","last_peered":"2023-11-15T01:36:54.285081+0000","last_clean":"2023-11-15T01:36:54.285081+0000","last_became_active":"2023-11-15T01:36:53.885479+0000","last_became_peered":"2023-11-15T01:36:53.885479+0000","last_unstale":"2023-11-15T01:36:54.285081+0000","last_undegraded":"2023-11-15T01:36:54.285081+0000","last_fullsized":"2023-11-15T01:36:54.285081+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.291038+0000","last_change":"2023-11-15T01:36:54.290159+0000","last_active":"2023-11-15T01:36:54.291038+0000","last_peered":"2023-11-15T01:36:54.291038+0000","last_clean":"2023-11-15T01:36:54.291038+0000","last_became_active":"2023-11-15T01:36:54.289600+0000","last_became_peered":"2023-11-15T01:36:54.289600+0000","last_unstale":"2023-11-15T01:36:54.291038+0000","last_undegraded":"2023-11-15T01:36:54.291038+0000","last_fullsized":"2023-11-15T01:36:54.291038+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285894+0000","last_change":"2023-11-15T01:36:53.884977+0000","last_active":"2023-11-15T01:36:54.285894+0000","last_peered":"2023-11-15T01:36:54.285894+0000","last_clean":"2023-11-15T01:36:54.285894+0000","last_became_active":"2023-11-15T01:36:53.883488+0000","last_became_peered":"2023-11-15T01:36:53.883488+0000","last_unstale":"2023-11-15T01:36:54.285894+0000","last_undegraded":"2023-11-15T01:36:54.285894+0000","last_fullsized":"2023-11-15T01:36:54.285894+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284185+0000","last_change":"2023-11-15T01:36:54.279679+0000","last_active":"2023-11-15T01:36:54.284185+0000","last_peered":"2023-11-15T01:36:54.284185+0000","last_clean":"2023-11-15T01:36:54.284185+0000","last_became_active":"2023-11-15T01:36:54.279027+0000","last_became_peered":"2023-11-15T01:36:54.279027+0000","last_unstale":"2023-11-15T01:36:54.284185+0000","last_undegraded":"2023-11-15T01:36:54.284185+0000","last_fullsized":"2023-11-15T01:36:54.284185+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271058+0000","last_change":"2023-11-15T01:36:53.889534+0000","last_active":"2023-11-15T01:36:54.271058+0000","last_peered":"2023-11-15T01:36:54.271058+0000","last_clean":"2023-11-15T01:36:54.271058+0000","last_became_active":"2023-11-15T01:36:53.889254+0000","last_became_peered":"2023-11-15T01:36:53.889254+0000","last_unstale":"2023-11-15T01:36:54.271058+0000","last_undegraded":"2023-11-15T01:36:54.271058+0000","last_fullsized":"2023-11-15T01:36:54.271058+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.282522+0000","last_change":"2023-11-15T01:36:54.278184+0000","last_active":"2023-11-15T01:36:54.282522+0000","last_peered":"2023-11-15T01:36:54.282522+0000","last_clean":"2023-11-15T01:36:54.282522+0000","last_became_active":"2023-11-15T01:36:54.277936+0000","last_became_peered":"2023-11-15T01:36:54.277936+0000","last_unstale":"2023-11-15T01:36:54.282522+0000","last_undegraded":"2023-11-15T01:36:54.282522+0000","last_fullsized":"2023-11-15T01:36:54.282522+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270845+0000","last_change":"2023-11-15T01:36:53.889874+0000","last_active":"2023-11-15T01:36:54.270845+0000","last_peered":"2023-11-15T01:36:54.270845+0000","last_clean":"2023-11-15T01:36:54.270845+0000","last_became_active":"2023-11-15T01:36:53.889565+0000","last_became_peered":"2023-11-15T01:36:53.889565+0000","last_unstale":"2023-11-15T01:36:54.270845+0000","last_undegraded":"2023-11-15T01:36:54.270845+0000","last_fullsized":"2023-11-15T01:36:54.270845+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290806+0000","last_change":"2023-11-15T01:36:54.289928+0000","last_active":"2023-11-15T01:36:54.290806+0000","last_peered":"2023-11-15T01:36:54.290806+0000","last_clean":"2023-11-15T01:36:54.290806+0000","last_became_active":"2023-11-15T01:36:54.289665+0000","last_became_peered":"2023-11-15T01:36:54.289665+0000","last_unstale":"2023-11-15T01:36:54.290806+0000","last_undegraded":"2023-11-15T01:36:54.290806+0000","last_fullsized":"2023-11-15T01:36:54.290806+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.281013+0000","last_change":"2023-11-15T01:36:53.888557+0000","last_active":"2023-11-15T01:36:54.281013+0000","last_peered":"2023-11-15T01:36:54.281013+0000","last_clean":"2023-11-15T01:36:54.281013+0000","last_became_active":"2023-11-15T01:36:53.888276+0000","last_became_peered":"2023-11-15T01:36:53.888276+0000","last_unstale":"2023-11-15T01:36:54.281013+0000","last_undegraded":"2023-11-15T01:36:54.281013+0000","last_fullsized":"2023-11-15T01:36:54.281013+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284415+0000","last_change":"2023-11-15T01:36:54.282329+0000","last_active":"2023-11-15T01:36:54.284415+0000","last_peered":"2023-11-15T01:36:54.284415+0000","last_clean":"2023-11-15T01:36:54.284415+0000","last_became_active":"2023-11-15T01:36:54.280850+0000","last_became_peered":"2023-11-15T01:36:54.280850+0000","last_unstale":"2023-11-15T01:36:54.284415+0000","last_undegraded":"2023-11-15T01:36:54.284415+0000","last_fullsized":"2023-11-15T01:36:54.284415+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287232+0000","last_change":"2023-11-15T01:36:53.886347+0000","last_active":"2023-11-15T01:36:54.287232+0000","last_peered":"2023-11-15T01:36:54.287232+0000","last_clean":"2023-11-15T01:36:54.287232+0000","last_became_active":"2023-11-15T01:36:53.886079+0000","last_became_peered":"2023-11-15T01:36:53.886079+0000","last_unstale":"2023-11-15T01:36:54.287232+0000","last_undegraded":"2023-11-15T01:36:54.287232+0000","last_fullsized":"2023-11-15T01:36:54.287232+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.281878+0000","last_change":"2023-11-15T01:36:54.279150+0000","last_active":"2023-11-15T01:36:54.281878+0000","last_peered":"2023-11-15T01:36:54.281878+0000","last_clean":"2023-11-15T01:36:54.281878+0000","last_became_active":"2023-11-15T01:36:54.278827+0000","last_became_peered":"2023-11-15T01:36:54.278827+0000","last_unstale":"2023-11-15T01:36:54.281878+0000","last_undegraded":"2023-11-15T01:36:54.281878+0000","last_fullsized":"2023-11-15T01:36:54.281878+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270182+0000","last_change":"2023-11-15T01:36:53.887885+0000","last_active":"2023-11-15T01:36:54.270182+0000","last_peered":"2023-11-15T01:36:54.270182+0000","last_clean":"2023-11-15T01:36:54.270182+0000","last_became_active":"2023-11-15T01:36:53.887613+0000","last_became_peered":"2023-11-15T01:36:53.887613+0000","last_unstale":"2023-11-15T01:36:54.270182+0000","last_undegraded":"2023-11-15T01:36:54.270182+0000","last_fullsized":"2023-11-15T01:36:54.270182+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290279+0000","last_change":"2023-11-15T01:36:54.288235+0000","last_active":"2023-11-15T01:36:54.290279+0000","last_peered":"2023-11-15T01:36:54.290279+0000","last_clean":"2023-11-15T01:36:54.290279+0000","last_became_active":"2023-11-15T01:36:54.287954+0000","last_became_peered":"2023-11-15T01:36:54.287954+0000","last_unstale":"2023-11-15T01:36:54.290279+0000","last_undegraded":"2023-11-15T01:36:54.290279+0000","last_fullsized":"2023-11-15T01:36:54.290279+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271850+0000","last_change":"2023-11-15T01:36:53.884154+0000","last_active":"2023-11-15T01:36:54.271850+0000","last_peered":"2023-11-15T01:36:54.271850+0000","last_clean":"2023-11-15T01:36:54.271850+0000","last_became_active":"2023-11-15T01:36:53.883856+0000","last_became_peered":"2023-11-15T01:36:53.883856+0000","last_unstale":"2023-11-15T01:36:54.271850+0000","last_undegraded":"2023-11-15T01:36:54.271850+0000","last_fullsized":"2023-11-15T01:36:54.271850+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.295524+0000","last_change":"2023-11-15T01:36:54.283815+0000","last_active":"2023-11-15T01:36:54.295524+0000","last_peered":"2023-11-15T01:36:54.295524+0000","last_clean":"2023-11-15T01:36:54.295524+0000","last_became_active":"2023-11-15T01:36:54.283398+0000","last_became_peered":"2023-11-15T01:36:54.283398+0000","last_unstale":"2023-11-15T01:36:54.295524+0000","last_undegraded":"2023-11-15T01:36:54.295524+0000","last_fullsized":"2023-11-15T01:36:54.295524+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271051+0000","last_change":"2023-11-15T01:36:53.894062+0000","last_active":"2023-11-15T01:36:54.271051+0000","last_peered":"2023-11-15T01:36:54.271051+0000","last_clean":"2023-11-15T01:36:54.271051+0000","last_became_active":"2023-11-15T01:36:53.893544+0000","last_became_peered":"2023-11-15T01:36:53.893544+0000","last_unstale":"2023-11-15T01:36:54.271051+0000","last_undegraded":"2023-11-15T01:36:54.271051+0000","last_fullsized":"2023-11-15T01:36:54.271051+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290504+0000","last_change":"2023-11-15T01:36:54.288649+0000","last_active":"2023-11-15T01:36:54.290504+0000","last_peered":"2023-11-15T01:36:54.290504+0000","last_clean":"2023-11-15T01:36:54.290504+0000","last_became_active":"2023-11-15T01:36:54.288403+0000","last_became_peered":"2023-11-15T01:36:54.288403+0000","last_unstale":"2023-11-15T01:36:54.290504+0000","last_undegraded":"2023-11-15T01:36:54.290504+0000","last_fullsized":"2023-11-15T01:36:54.290504+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269099+0000","last_change":"2023-11-15T01:36:53.892212+0000","last_active":"2023-11-15T01:36:54.269099+0000","last_peered":"2023-11-15T01:36:54.269099+0000","last_clean":"2023-11-15T01:36:54.269099+0000","last_became_active":"2023-11-15T01:36:53.891926+0000","last_became_peered":"2023-11-15T01:36:53.891926+0000","last_unstale":"2023-11-15T01:36:54.269099+0000","last_undegraded":"2023-11-15T01:36:54.269099+0000","last_fullsized":"2023-11-15T01:36:54.269099+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.285608+0000","last_change":"2023-11-15T01:36:54.284102+0000","last_active":"2023-11-15T01:36:54.285608+0000","last_peered":"2023-11-15T01:36:54.285608+0000","last_clean":"2023-11-15T01:36:54.285608+0000","last_became_active":"2023-11-15T01:36:54.283801+0000","last_became_peered":"2023-11-15T01:36:54.283801+0000","last_unstale":"2023-11-15T01:36:54.285608+0000","last_undegraded":"2023-11-15T01:36:54.285608+0000","last_fullsized":"2023-11-15T01:36:54.285608+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.272536+0000","last_change":"2023-11-15T01:36:53.891348+0000","last_active":"2023-11-15T01:36:54.272536+0000","last_peered":"2023-11-15T01:36:54.272536+0000","last_clean":"2023-11-15T01:36:54.272536+0000","last_became_active":"2023-11-15T01:36:53.891039+0000","last_became_peered":"2023-11-15T01:36:53.891039+0000","last_unstale":"2023-11-15T01:36:54.272536+0000","last_undegraded":"2023-11-15T01:36:54.272536+0000","last_fullsized":"2023-11-15T01:36:54.272536+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286099+0000","last_change":"2023-11-15T01:36:54.280100+0000","last_active":"2023-11-15T01:36:54.286099+0000","last_peered":"2023-11-15T01:36:54.286099+0000","last_clean":"2023-11-15T01:36:54.286099+0000","last_became_active":"2023-11-15T01:36:54.279846+0000","last_became_peered":"2023-11-15T01:36:54.279846+0000","last_unstale":"2023-11-15T01:36:54.286099+0000","last_undegraded":"2023-11-15T01:36:54.286099+0000","last_fullsized":"2023-11-15T01:36:54.286099+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.268620+0000","last_change":"2023-11-15T01:36:53.889694+0000","last_active":"2023-11-15T01:36:54.268620+0000","last_peered":"2023-11-15T01:36:54.268620+0000","last_clean":"2023-11-15T01:36:54.268620+0000","last_became_active":"2023-11-15T01:36:53.889467+0000","last_became_peered":"2023-11-15T01:36:53.889467+0000","last_unstale":"2023-11-15T01:36:54.268620+0000","last_undegraded":"2023-11-15T01:36:54.268620+0000","last_fullsized":"2023-11-15T01:36:54.268620+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286527+0000","last_change":"2023-11-15T01:36:54.282473+0000","last_active":"2023-11-15T01:36:54.286527+0000","last_peered":"2023-11-15T01:36:54.286527+0000","last_clean":"2023-11-15T01:36:54.286527+0000","last_became_active":"2023-11-15T01:36:54.282174+0000","last_became_peered":"2023-11-15T01:36:54.282174+0000","last_unstale":"2023-11-15T01:36:54.286527+0000","last_undegraded":"2023-11-15T01:36:54.286527+0000","last_fullsized":"2023-11-15T01:36:54.286527+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270885+0000","last_change":"2023-11-15T01:36:53.888485+0000","last_active":"2023-11-15T01:36:54.270885+0000","last_peered":"2023-11-15T01:36:54.270885+0000","last_clean":"2023-11-15T01:36:54.270885+0000","last_became_active":"2023-11-15T01:36:53.888173+0000","last_became_peered":"2023-11-15T01:36:53.888173+0000","last_unstale":"2023-11-15T01:36:54.270885+0000","last_undegraded":"2023-11-15T01:36:54.270885+0000","last_fullsized":"2023-11-15T01:36:54.270885+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290804+0000","last_change":"2023-11-15T01:36:54.283764+0000","last_active":"2023-11-15T01:36:54.290804+0000","last_peered":"2023-11-15T01:36:54.290804+0000","last_clean":"2023-11-15T01:36:54.290804+0000","last_became_active":"2023-11-15T01:36:54.283480+0000","last_became_peered":"2023-11-15T01:36:54.283480+0000","last_unstale":"2023-11-15T01:36:54.290804+0000","last_undegraded":"2023-11-15T01:36:54.290804+0000","last_fullsized":"2023-11-15T01:36:54.290804+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.274747+0000","last_change":"2023-11-15T01:36:53.883699+0000","last_active":"2023-11-15T01:36:54.274747+0000","last_peered":"2023-11-15T01:36:54.274747+0000","last_clean":"2023-11-15T01:36:54.274747+0000","last_became_active":"2023-11-15T01:36:53.883391+0000","last_became_peered":"2023-11-15T01:36:53.883391+0000","last_unstale":"2023-11-15T01:36:54.274747+0000","last_undegraded":"2023-11-15T01:36:54.274747+0000","last_fullsized":"2023-11-15T01:36:54.274747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270257+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:36:54.270257+0000","last_peered":"2023-11-15T01:36:54.270257+0000","last_clean":"2023-11-15T01:36:54.270257+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:36:54.270257+0000","last_undegraded":"2023-11-15T01:36:54.270257+0000","last_fullsized":"2023-11-15T01:36:54.270257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.296240+0000","last_change":"2023-11-15T01:36:54.294743+0000","last_active":"2023-11-15T01:36:54.296240+0000","last_peered":"2023-11-15T01:36:54.296240+0000","last_clean":"2023-11-15T01:36:54.296240+0000","last_became_active":"2023-11-15T01:36:54.294397+0000","last_became_peered":"2023-11-15T01:36:54.294397+0000","last_unstale":"2023-11-15T01:36:54.296240+0000","last_undegraded":"2023-11-15T01:36:54.296240+0000","last_fullsized":"2023-11-15T01:36:54.296240+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290530+0000","last_change":"2023-11-15T01:36:53.887568+0000","last_active":"2023-11-15T01:36:54.290530+0000","last_peered":"2023-11-15T01:36:54.290530+0000","last_clean":"2023-11-15T01:36:54.290530+0000","last_became_active":"2023-11-15T01:36:53.887245+0000","last_became_peered":"2023-11-15T01:36:53.887245+0000","last_unstale":"2023-11-15T01:36:54.290530+0000","last_undegraded":"2023-11-15T01:36:54.290530+0000","last_fullsized":"2023-11-15T01:36:54.290530+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.272262+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:36:54.272262+0000","last_peered":"2023-11-15T01:36:54.272262+0000","last_clean":"2023-11-15T01:36:54.272262+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:36:54.272262+0000","last_undegraded":"2023-11-15T01:36:54.272262+0000","last_fullsized":"2023-11-15T01:36:54.272262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.288581+0000","last_change":"2023-11-15T01:36:54.286189+0000","last_active":"2023-11-15T01:36:54.288581+0000","last_peered":"2023-11-15T01:36:54.288581+0000","last_clean":"2023-11-15T01:36:54.288581+0000","last_became_active":"2023-11-15T01:36:54.285937+0000","last_became_peered":"2023-11-15T01:36:54.285937+0000","last_unstale":"2023-11-15T01:36:54.288581+0000","last_undegraded":"2023-11-15T01:36:54.288581+0000","last_fullsized":"2023-11-15T01:36:54.288581+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286808+0000","last_change":"2023-11-15T01:36:53.883094+0000","last_active":"2023-11-15T01:36:54.286808+0000","last_peered":"2023-11-15T01:36:54.286808+0000","last_clean":"2023-11-15T01:36:54.286808+0000","last_became_active":"2023-11-15T01:36:53.882798+0000","last_became_peered":"2023-11-15T01:36:53.882798+0000","last_unstale":"2023-11-15T01:36:54.286808+0000","last_undegraded":"2023-11-15T01:36:54.286808+0000","last_fullsized":"2023-11-15T01:36:54.286808+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270926+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:36:54.270926+0000","last_peered":"2023-11-15T01:36:54.270926+0000","last_clean":"2023-11-15T01:36:54.270926+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:36:54.270926+0000","last_undegraded":"2023-11-15T01:36:54.270926+0000","last_fullsized":"2023-11-15T01:36:54.270926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284222+0000","last_change":"2023-11-15T01:36:54.280303+0000","last_active":"2023-11-15T01:36:54.284222+0000","last_peered":"2023-11-15T01:36:54.284222+0000","last_clean":"2023-11-15T01:36:54.284222+0000","last_became_active":"2023-11-15T01:36:54.279983+0000","last_became_peered":"2023-11-15T01:36:54.279983+0000","last_unstale":"2023-11-15T01:36:54.284222+0000","last_undegraded":"2023-11-15T01:36:54.284222+0000","last_fullsized":"2023-11-15T01:36:54.284222+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287246+0000","last_change":"2023-11-15T01:36:53.883826+0000","last_active":"2023-11-15T01:36:54.287246+0000","last_peered":"2023-11-15T01:36:54.287246+0000","last_clean":"2023-11-15T01:36:54.287246+0000","last_became_active":"2023-11-15T01:36:53.883518+0000","last_became_peered":"2023-11-15T01:36:53.883518+0000","last_unstale":"2023-11-15T01:36:54.287246+0000","last_undegraded":"2023-11-15T01:36:54.287246+0000","last_fullsized":"2023-11-15T01:36:54.287246+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.272992+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:36:54.272992+0000","last_peered":"2023-11-15T01:36:54.272992+0000","last_clean":"2023-11-15T01:36:54.272992+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:36:54.272992+0000","last_undegraded":"2023-11-15T01:36:54.272992+0000","last_fullsized":"2023-11-15T01:36:54.272992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":73,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271771+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:36:54.271771+0000","last_peered":"2023-11-15T01:36:54.271771+0000","last_clean":"2023-11-15T01:36:54.271771+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:36:54.271771+0000","last_undegraded":"2023-11-15T01:36:54.271771+0000","last_fullsized":"2023-11-15T01:36:54.271771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.295451+0000","last_change":"2023-11-15T01:36:54.281084+0000","last_active":"2023-11-15T01:36:54.295451+0000","last_peered":"2023-11-15T01:36:54.295451+0000","last_clean":"2023-11-15T01:36:54.295451+0000","last_became_active":"2023-11-15T01:36:54.280744+0000","last_became_peered":"2023-11-15T01:36:54.280744+0000","last_unstale":"2023-11-15T01:36:54.295451+0000","last_undegraded":"2023-11-15T01:36:54.295451+0000","last_fullsized":"2023-11-15T01:36:54.295451+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.287040+0000","last_change":"2023-11-15T01:36:53.883685+0000","last_active":"2023-11-15T01:36:54.287040+0000","last_peered":"2023-11-15T01:36:54.287040+0000","last_clean":"2023-11-15T01:36:54.287040+0000","last_became_active":"2023-11-15T01:36:53.883373+0000","last_became_peered":"2023-11-15T01:36:53.883373+0000","last_unstale":"2023-11-15T01:36:54.287040+0000","last_undegraded":"2023-11-15T01:36:54.287040+0000","last_fullsized":"2023-11-15T01:36:54.287040+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":71,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271856+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:36:54.271856+0000","last_peered":"2023-11-15T01:36:54.271856+0000","last_clean":"2023-11-15T01:36:54.271856+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:36:54.271856+0000","last_undegraded":"2023-11-15T01:36:54.271856+0000","last_fullsized":"2023-11-15T01:36:54.271856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.294443+0000","last_change":"2023-11-15T01:36:54.292193+0000","last_active":"2023-11-15T01:36:54.294443+0000","last_peered":"2023-11-15T01:36:54.294443+0000","last_clean":"2023-11-15T01:36:54.294443+0000","last_became_active":"2023-11-15T01:36:54.291920+0000","last_became_peered":"2023-11-15T01:36:54.291920+0000","last_unstale":"2023-11-15T01:36:54.294443+0000","last_undegraded":"2023-11-15T01:36:54.294443+0000","last_fullsized":"2023-11-15T01:36:54.294443+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270176+0000","last_change":"2023-11-15T01:36:53.882588+0000","last_active":"2023-11-15T01:36:54.270176+0000","last_peered":"2023-11-15T01:36:54.270176+0000","last_clean":"2023-11-15T01:36:54.270176+0000","last_became_active":"2023-11-15T01:36:53.881836+0000","last_became_peered":"2023-11-15T01:36:53.881836+0000","last_unstale":"2023-11-15T01:36:54.270176+0000","last_undegraded":"2023-11-15T01:36:54.270176+0000","last_fullsized":"2023-11-15T01:36:54.270176+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.271732+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:36:54.271732+0000","last_peered":"2023-11-15T01:36:54.271732+0000","last_clean":"2023-11-15T01:36:54.271732+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:36:54.271732+0000","last_undegraded":"2023-11-15T01:36:54.271732+0000","last_fullsized":"2023-11-15T01:36:54.271732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.294270+0000","last_change":"2023-11-15T01:36:54.292443+0000","last_active":"2023-11-15T01:36:54.294270+0000","last_peered":"2023-11-15T01:36:54.294270+0000","last_clean":"2023-11-15T01:36:54.294270+0000","last_became_active":"2023-11-15T01:36:54.292127+0000","last_became_peered":"2023-11-15T01:36:54.292127+0000","last_unstale":"2023-11-15T01:36:54.294270+0000","last_undegraded":"2023-11-15T01:36:54.294270+0000","last_fullsized":"2023-11-15T01:36:54.294270+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.286488+0000","last_change":"2023-11-15T01:36:53.885980+0000","last_active":"2023-11-15T01:36:54.286488+0000","last_peered":"2023-11-15T01:36:54.286488+0000","last_clean":"2023-11-15T01:36:54.286488+0000","last_became_active":"2023-11-15T01:36:53.885504+0000","last_became_peered":"2023-11-15T01:36:53.885504+0000","last_unstale":"2023-11-15T01:36:54.286488+0000","last_undegraded":"2023-11-15T01:36:54.286488+0000","last_fullsized":"2023-11-15T01:36:54.286488+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.269843+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:36:54.269843+0000","last_peered":"2023-11-15T01:36:54.269843+0000","last_clean":"2023-11-15T01:36:54.269843+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:36:54.269843+0000","last_undegraded":"2023-11-15T01:36:54.269843+0000","last_fullsized":"2023-11-15T01:36:54.269843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.290341+0000","last_change":"2023-11-15T01:36:54.283373+0000","last_active":"2023-11-15T01:36:54.290341+0000","last_peered":"2023-11-15T01:36:54.290341+0000","last_clean":"2023-11-15T01:36:54.290341+0000","last_became_active":"2023-11-15T01:36:54.283101+0000","last_became_peered":"2023-11-15T01:36:54.283101+0000","last_unstale":"2023-11-15T01:36:54.290341+0000","last_undegraded":"2023-11-15T01:36:54.290341+0000","last_fullsized":"2023-11-15T01:36:54.290341+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:53.862583+0000","last_clean_scrub_stamp":"2023-11-15T01:36:53.862583+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.284579+0000","last_change":"2023-11-15T01:36:53.887381+0000","last_active":"2023-11-15T01:36:54.284579+0000","last_peered":"2023-11-15T01:36:54.284579+0000","last_clean":"2023-11-15T01:36:54.284579+0000","last_became_active":"2023-11-15T01:36:53.887066+0000","last_became_peered":"2023-11-15T01:36:53.887066+0000","last_unstale":"2023-11-15T01:36:54.284579+0000","last_undegraded":"2023-11-15T01:36:54.284579+0000","last_fullsized":"2023-11-15T01:36:54.284579+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:36:52.857422+0000","last_clean_scrub_stamp":"2023-11-15T01:36:52.857422+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":83,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-15T01:36:54.270008+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:36:54.270008+0000","last_peered":"2023-11-15T01:36:54.270008+0000","last_clean":"2023-11-15T01:36:54.270008+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:36:54.270008+0000","last_undegraded":"2023-11-15T01:36:54.270008+0000","last_fullsized":"2023-11-15T01:36:54.270008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575032,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302308,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069532,"statfs":{"total":96636764160,"available":96327200768,"internally_reserved":0,"allocated":1142784,"data_stored":577452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.34799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70299999999999996,"5min":0.71199999999999997,"15min":0.82299999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.41699999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.83299999999999996},"last":0.376}]},{"osd":1,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72099999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.437},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.40400000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.81499999999999995},"last":0.45100000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.39500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73799999999999999,"5min":0.77800000000000002,"15min":0.82599999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.46100000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.86299999999999999},"last":0.55400000000000005}]},{"osd":3,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.47299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.73399999999999999,"5min":0.80700000000000005,"15min":0.85999999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.501,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79000000000000004,"5min":0.79700000000000004,"15min":0.81200000000000006},"last":0.52700000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45300000000000001,"15min":0.46600000000000003},"min":{"1min":0.31,"5min":0.247,"15min":0.247},"max":{"1min":0.624,"5min":0.69999999999999996,"15min":0.84499999999999997},"last":0.503},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.40400000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.83799999999999997},"last":0.49399999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47499999999999998,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.77500000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.497,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.78500000000000003},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.38400000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.752,"5min":0.755,"15min":0.85099999999999998},"last":0.54900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575033,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":1159168,"data_stored":584718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.29199999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73299999999999998,"5min":0.89000000000000001,"15min":0.97799999999999998},"last":0.70999999999999996}]},{"osd":1,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54900000000000004,"15min":0.56299999999999994},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.0649999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.33100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.73499999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.75700000000000001,"5min":0.79100000000000004,"15min":1.038},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.77300000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.77100000000000002,"5min":0.85499999999999998,"15min":1.028},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35699999999999998},"max":{"1min":0.67100000000000004,"5min":0.874,"15min":1.004},"last":0.66500000000000004}]},{"osd":4,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44700000000000001,"15min":0.44800000000000001},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.68200000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.25800000000000001},"max":{"1min":0.65400000000000003,"5min":0.73299999999999998,"15min":0.81799999999999995},"last":0.5}]},{"osd":5,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63500000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.70999999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59199999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.496,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":0.64000000000000001,"5min":0.72099999999999997,"15min":0.86499999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.34000000000000002},"max":{"1min":0.67200000000000004,"5min":0.82399999999999995,"15min":1.0009999999999999},"last":0.61599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575034,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302328,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069512,"statfs":{"total":96636764160,"available":96327180288,"internally_reserved":0,"allocated":1163264,"data_stored":585078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.373,"15min":0.376},"min":{"1min":0.25,"5min":0.249,"15min":0.23999999999999999},"max":{"1min":0.59099999999999997,"5min":0.73699999999999999,"15min":0.77800000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.22600000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.499}]},{"osd":3,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.31},"max":{"1min":9.641,"5min":9.641,"15min":9.641},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.53800000000000003,"15min":0.496},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.28000000000000003},"max":{"1min":9.6199999999999992,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.53700000000000003}]},{"osd":4,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.68500000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.0509999999999999},"last":0.84199999999999997}]},{"osd":5,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71699999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.747},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.40400000000000003,"15min":0.373},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.46200000000000002,"5min":0.441,"15min":0.42799999999999999},"max":{"1min":0.77500000000000002,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.91100000000000003}]},{"osd":7,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0429999999999999,"5min":1.0509999999999999,"15min":1.25},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66800000000000004,"15min":0.68799999999999994},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81499999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.82099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575032,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":584004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38,"15min":0.37},"min":{"1min":0.28499999999999998,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51100000000000001,"5min":2.024,"15min":2.024},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.438,"15min":0.41499999999999998},"min":{"1min":0.32800000000000001,"5min":0.252,"15min":0.215},"max":{"1min":0.60099999999999998,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.35399999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.40500000000000003,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.54200000000000004,"5min":1.768,"15min":1.768},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.35799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61699999999999999,"5min":1.982,"15min":1.982},"last":0.437}]},{"osd":3,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.433},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.22500000000000001},"max":{"1min":0.63100000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46500000000000002,"15min":0.45400000000000001},"min":{"1min":0.33300000000000002,"5min":0.28100000000000003,"15min":0.27700000000000002},"max":{"1min":0.66700000000000004,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42199999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80500000000000005,"5min":0.97799999999999998,"15min":1.454},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.65500000000000003},"min":{"1min":0.55500000000000005,"5min":0.45900000000000002,"15min":0.442},"max":{"1min":0.78800000000000003,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.58299999999999996}]},{"osd":5,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82399999999999995,"5min":1.881,"15min":1.881},"last":0.495},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.46100000000000002,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.86599999999999999,"5min":0.91400000000000003,"15min":1.1120000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.46800000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83399999999999996,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.52600000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.874,"5min":1.917,"15min":1.917},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed Nov 15 01:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70099999999999996,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.91300000000000003,"5min":1.843,"15min":1.843},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68500000000000005,"15min":0.69399999999999995},"min":{"1min":0.54100000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90600000000000003,"5min":0.95299999999999996,"15min":1.4119999999999999},"last":0.71799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575033,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306420,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065420,"statfs":{"total":96636764160,"available":96322990080,"internally_reserved":0,"allocated":1159168,"data_stored":585540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36499999999999999,"15min":0.36899999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52500000000000002,"5min":0.55100000000000005,"15min":0.61899999999999999},"last":0.374},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.39800000000000002,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.57699999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.222},"max":{"1min":0.745,"5min":0.745,"15min":0.75},"last":0.31},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.441,"15min":0.442},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.69799999999999995,"5min":0.73499999999999999,"15min":0.92000000000000004},"last":0.39000000000000001}]},{"osd":3,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.248},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45000000000000001,"15min":0.44400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.253},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59999999999999998,"15min":0.625},"min":{"1min":0.41299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92700000000000005,"5min":1.0549999999999999,"15min":1.0800000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.39200000000000002},"max":{"1min":0.872,"5min":0.91100000000000003,"15min":1.052},"last":0.67100000000000004}]},{"osd":5,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.627,"15min":0.64800000000000002},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.89400000000000002,"5min":1.032,"15min":1.032},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.64100000000000001},"min":{"1min":0.44700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.871,"5min":0.96699999999999997,"15min":1.1339999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.66300000000000003},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.876,"5min":1.002,"15min":1.0389999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.65300000000000002,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85699999999999998,"5min":1.0669999999999999,"15min":1.119},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.67700000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78300000000000003,"5min":1.079,"15min":1.103},"last":0.623},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67600000000000005,"15min":0.69499999999999995},"min":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.86599999999999999,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.69699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575034,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306408,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065432,"statfs":{"total":96636764160,"available":96323002368,"internally_reserved":0,"allocated":1146880,"data_stored":584004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.374,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.22600000000000001},"max":{"1min":0.53400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.23200000000000001},"max":{"1min":0.60699999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.307}]},{"osd":1,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":0.56599999999999995,"5min":0.64700000000000002,"15min":0.72899999999999998},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.29199999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72499999999999998,"5min":0.747,"15min":0.80500000000000005},"last":0.33000000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44500000000000001,"15min":0.44600000000000001},"min":{"1min":0.33700000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.377},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.69199999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41099999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.39000000000000001},"max":{"1min":0.89200000000000002,"5min":1.0169999999999999,"15min":1.0589999999999999},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.436,"5min":0.377,"15min":0.377},"max":{"1min":0.92000000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.45500000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82999999999999996,"5min":0.90100000000000002,"15min":0.95999999999999996},"last":0.40000000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64000000000000001,"15min":0.65000000000000002},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84899999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.67600000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95799999999999996,"5min":1.0900000000000001,"15min":1.169},"last":0.46000000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.65600000000000003,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0429999999999999,"5min":1.071,"15min":1.071},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.69299999999999995},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.996,"5min":1.1319999999999999,"15min":1.1459999999999999},"last":0.56100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575032,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":1159168,"data_stored":584682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.751,"5min":0.88,"15min":0.88},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39000000000000001}]},{"osd":1,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.30499999999999999},"max":{"1min":0.81499999999999995,"5min":1.087,"15min":1.087},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.46100000000000002,"5min":0.35499999999999998,"15min":0.34699999999999998},"max":{"1min":0.74399999999999999,"5min":0.80200000000000005,"15min":0.81000000000000005},"last":0.376}]},{"osd":2,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.47799999999999998,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":0.77300000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.42899999999999999,"5min":0.34699999999999998,"15min":0.33100000000000002},"max":{"1min":0.78300000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.46100000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.46700000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75700000000000001,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.435},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.44900000000000001}]},{"osd":5,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45800000000000002,"15min":0.47099999999999997},"min":{"1min":0.34100000000000003,"5min":0.30499999999999999,"15min":0.30399999999999999},"max":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":0.80600000000000005},"last":0.505},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47699999999999998,"15min":0.49399999999999999},"min":{"1min":0.378,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65400000000000003,"5min":0.752,"15min":0.85299999999999998},"last":0.52800000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48199999999999998,"15min":0.498},"min":{"1min":0.38300000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78500000000000003,"5min":0.79000000000000004,"15min":0.84199999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.33700000000000002,"15min":0.33500000000000002},"max":{"1min":0.82999999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.55600000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.53000000000000003},"min":{"1min":0.41799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.873},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77600000000000002,"5min":0.78400000000000003,"15min":0.90100000000000002},"last":0.51800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575032,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302304,"kb_used_data":1112,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069536,"statfs":{"total":96636764160,"available":96327204864,"internally_reserved":0,"allocated":1138688,"data_stored":576910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.55100000000000005},"min":{"1min":0.42299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45900000000000002,"5min":0.375,"15min":0.36199999999999999},"max":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.81200000000000006},"last":0.52000000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71499999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.379},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.497,"5min":0.35099999999999998,"15min":0.33400000000000002},"max":{"1min":0.67400000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.501}]},{"osd":2,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.34899999999999998,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.86199999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.44,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.75800000000000001,"5min":0.77700000000000002,"15min":1.103},"last":0.441}]},{"osd":3,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.46500000000000002,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.59499999999999997},"min":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71999999999999997,"5min":0.80700000000000005,"15min":1.127},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42799999999999999,"15min":0.45900000000000002},"min":{"1min":0.30299999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.94399999999999995},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.50800000000000001,"15min":0.52800000000000002},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.65600000000000003,"5min":0.71599999999999997,"15min":0.80900000000000005},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.46100000000000002,"15min":0.48099999999999998},"min":{"1min":0.33700000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64800000000000002,"5min":0.83099999999999996,"15min":1.0660000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.46400000000000002,"15min":0.499},"min":{"1min":0.33700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.70599999999999996,"5min":0.751,"15min":0.76600000000000001},"last":0.54800000000000004}]},{"osd":7,"last update":"Wed Nov 15 01:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47699999999999998,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.97199999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55800000000000005,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.71799999999999997,"5min":0.85799999999999998,"15min":1.1499999999999999},"last":0.54400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:36:58.673 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-15T01:36:58.674 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-15T01:36:58.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.830+0000 7f38dffeb700 1 Processor -- start 2023-11-15T01:36:58.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.830+0000 7f38dffeb700 1 -- start start 2023-11-15T01:36:58.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.831+0000 7f38dffeb700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f38d8154480 0x7f38d80c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.831+0000 7f38dffeb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f38d80c6430 0x7f38d80aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.831+0000 7f38dffeb700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d80ca050 con 0x7f38d81540a0 2023-11-15T01:36:58.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.831+0000 7f38dffeb700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d80c68c0 con 0x7f38d8154480 2023-11-15T01:36:58.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.831+0000 7f38dffeb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80c9440 con 0x7f38d80c6430 2023-11-15T01:36:58.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38dd586700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f38d8154480 0x7f38d80c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38de588700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f38d80c6430 0x7f38d80aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38dd586700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f38d8154480 0x7f38d80c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:42062/0 (socket says 172.21.15.1:42062) 2023-11-15T01:36:58.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38de588700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f38d80c6430 0x7f38d80aaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:45144/0 (socket says 172.21.15.1:45144) 2023-11-15T01:36:58.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38dd586700 1 -- 172.21.15.1:0/1064875327 learned_addr learned my addr 172.21.15.1:0/1064875327 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:58.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38ddd87700 1 --1- 172.21.15.1:0/1064875327 >> v1:172.21.15.141:6789/0 conn(0x7f38d81540a0 0x7f38d80ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:59022/0 (socket says 172.21.15.1:59022) 2023-11-15T01:36:58.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38de588700 1 -- 172.21.15.1:0/1064875327 >> v2:172.21.15.141:3300/0 conn(0x7f38d8154480 msgr2=0x7f38d80c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:58.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38de588700 1 --2- 172.21.15.1:0/1064875327 >> v2:172.21.15.141:3300/0 conn(0x7f38d8154480 0x7f38d80c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38de588700 1 -- 172.21.15.1:0/1064875327 >> v1:172.21.15.141:6789/0 conn(0x7f38d81540a0 legacy=0x7f38d80ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38dcd85700 1 -- 172.21.15.1:0/1064875327 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118212440 0 0) 0x7f38d80ca050 con 0x7f38d81540a0 2023-11-15T01:36:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38de588700 1 -- 172.21.15.1:0/1064875327 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d80c9720 con 0x7f38d80c6430 2023-11-15T01:36:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38dd586700 1 --2- 172.21.15.1:0/1064875327 >> v2:172.21.15.141:3300/0 conn(0x7f38d8154480 0x7f38d80c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:36:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38de588700 1 --2- 172.21.15.1:0/1064875327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f38d80c6430 0x7f38d80aaf40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f38c8009e60 tx=0x7f38c8009780).ready entity=mon.2 client_cookie=ff32c88ec152fe3e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38dcd85700 1 -- 172.21.15.1:0/1064875327 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c800e070 con 0x7f38d80c6430 2023-11-15T01:36:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38dcd85700 1 -- 172.21.15.1:0/1064875327 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c800bb60 con 0x7f38d80c6430 2023-11-15T01:36:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.832+0000 7f38dcd85700 1 -- 172.21.15.1:0/1064875327 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c8012410 con 0x7f38d80c6430 2023-11-15T01:36:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.833+0000 7f38dffeb700 1 -- 172.21.15.1:0/1064875327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f38d80c6430 msgr2=0x7f38d80aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.833+0000 7f38dffeb700 1 --2- 172.21.15.1:0/1064875327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f38d80c6430 0x7f38d80aaf40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f38c8009e60 tx=0x7f38c8009780).stop 2023-11-15T01:36:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.833+0000 7f38dffeb700 1 -- 172.21.15.1:0/1064875327 shutdown_connections 2023-11-15T01:36:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.833+0000 7f38dffeb700 1 --2- 172.21.15.1:0/1064875327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f38d80c6430 0x7f38d80aaf40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.833+0000 7f38dffeb700 1 --2- 172.21.15.1:0/1064875327 >> v2:172.21.15.141:3300/0 conn(0x7f38d8154480 0x7f38d80c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.833+0000 7f38dffeb700 1 -- 172.21.15.1:0/1064875327 >> 172.21.15.1:0/1064875327 conn(0x7f38d8064a70 msgr2=0x7f38d8064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.833+0000 7f38dffeb700 1 -- 172.21.15.1:0/1064875327 shutdown_connections 2023-11-15T01:36:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.833+0000 7f38dffeb700 1 -- 172.21.15.1:0/1064875327 wait complete. 2023-11-15T01:36:58.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.834+0000 7f38dffeb700 1 Processor -- start 2023-11-15T01:36:58.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.834+0000 7f38dffeb700 1 -- start start 2023-11-15T01:36:58.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.835+0000 7f38dffeb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f38d80c6430 0x7f38d80b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.835+0000 7f38dffeb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f38d81540a0 0x7f38d80c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.835+0000 7f38dffeb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38d8154480 0x7f38d81644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.835+0000 7f38dffeb700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80c4fe0 con 0x7f38d8154480 2023-11-15T01:36:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.835+0000 7f38dffeb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d8149890 con 0x7f38d81540a0 2023-11-15T01:36:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.835+0000 7f38dffeb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80c3ac0 con 0x7f38d80c6430 2023-11-15T01:36:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.835+0000 7f38de588700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38d8154480 0x7f38d81644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.835+0000 7f38de588700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38d8154480 0x7f38d81644e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53370/0 (socket says 172.21.15.1:53370) 2023-11-15T01:36:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.835+0000 7f38de588700 1 -- 172.21.15.1:0/2194179467 learned_addr learned my addr 172.21.15.1:0/2194179467 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.835+0000 7f38dd586700 1 --2- 172.21.15.1:0/2194179467 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f38d81540a0 0x7f38d80c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.835+0000 7f38ddd87700 1 --2- 172.21.15.1:0/2194179467 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f38d80c6430 0x7f38d80b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.836+0000 7f38de588700 1 -- 172.21.15.1:0/2194179467 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f38d80c6430 msgr2=0x7f38d80b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.836+0000 7f38de588700 1 --2- 172.21.15.1:0/2194179467 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f38d80c6430 0x7f38d80b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.836+0000 7f38de588700 1 -- 172.21.15.1:0/2194179467 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f38d81540a0 msgr2=0x7f38d80c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.836+0000 7f38de588700 1 --2- 172.21.15.1:0/2194179467 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f38d81540a0 0x7f38d80c4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.836+0000 7f38de588700 1 -- 172.21.15.1:0/2194179467 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc009370 con 0x7f38d8154480 2023-11-15T01:36:58.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.836+0000 7f38de588700 1 --2- 172.21.15.1:0/2194179467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38d8154480 0x7f38d81644e0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f38c800b6c0 tx=0x7f38c8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.836+0000 7f38d5ffb700 1 -- 172.21.15.1:0/2194179467 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c8021070 con 0x7f38d8154480 2023-11-15T01:36:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.836+0000 7f38d5ffb700 1 -- 172.21.15.1:0/2194179467 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c801d630 con 0x7f38d8154480 2023-11-15T01:36:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.836+0000 7f38d5ffb700 1 -- 172.21.15.1:0/2194179467 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c8012410 con 0x7f38d8154480 2023-11-15T01:36:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.836+0000 7f38dffeb700 1 -- 172.21.15.1:0/2194179467 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c8009a20 con 0x7f38d8154480 2023-11-15T01:36:58.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.836+0000 7f38dffeb700 1 -- 172.21.15.1:0/2194179467 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d80c3220 con 0x7f38d8154480 2023-11-15T01:36:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.837+0000 7f38dffeb700 1 -- 172.21.15.1:0/2194179467 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d8149a00 con 0x7f38d8154480 2023-11-15T01:36:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.837+0000 7f38d5ffb700 1 -- 172.21.15.1:0/2194179467 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f38c8003040 con 0x7f38d8154480 2023-11-15T01:36:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.838+0000 7f38d5ffb700 1 --2- 172.21.15.1:0/2194179467 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f38c405f270 0x7f38c4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.838+0000 7f38d5ffb700 1 -- 172.21.15.1:0/2194179467 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f38c807c2a0 con 0x7f38d8154480 2023-11-15T01:36:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.838+0000 7f38ddd87700 1 --2- 172.21.15.1:0/2194179467 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f38c405f270 0x7f38c4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:58.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.838+0000 7f38ddd87700 1 --2- 172.21.15.1:0/2194179467 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f38c405f270 0x7f38c4061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f38d00011e0 tx=0x7f38d0007bd0).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:58.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:58.842+0000 7f38d5ffb700 1 -- 172.21.15.1:0/2194179467 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f38c8050d30 con 0x7f38d8154480 2023-11-15T01:36:59.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.081+0000 7f38dffeb700 1 -- 172.21.15.1:0/2194179467 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f38d806c7e0 con 0x7f38d8154480 2023-11-15T01:36:59.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.085+0000 7f38d5ffb700 1 -- 172.21.15.1:0/2194179467 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f38c8050920 con 0x7f38d8154480 2023-11-15T01:36:59.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.086+0000 7f38dffeb700 1 -- 172.21.15.1:0/2194179467 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f38c405f270 msgr2=0x7f38c4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:59.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.086+0000 7f38dffeb700 1 --2- 172.21.15.1:0/2194179467 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f38c405f270 0x7f38c4061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f38d00011e0 tx=0x7f38d0007bd0).stop 2023-11-15T01:36:59.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.086+0000 7f38dffeb700 1 -- 172.21.15.1:0/2194179467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38d8154480 msgr2=0x7f38d81644e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:59.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.086+0000 7f38dffeb700 1 --2- 172.21.15.1:0/2194179467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38d8154480 0x7f38d81644e0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f38c800b6c0 tx=0x7f38c8009780).stop 2023-11-15T01:36:59.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.086+0000 7f38dffeb700 1 -- 172.21.15.1:0/2194179467 shutdown_connections 2023-11-15T01:36:59.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.086+0000 7f38dffeb700 1 --2- 172.21.15.1:0/2194179467 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f38c405f270 0x7f38c4061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:59.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.086+0000 7f38dffeb700 1 --2- 172.21.15.1:0/2194179467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38d8154480 0x7f38d81644e0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:59.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.086+0000 7f38dffeb700 1 --2- 172.21.15.1:0/2194179467 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f38d80c6430 0x7f38d80b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:59.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.086+0000 7f38dffeb700 1 --2- 172.21.15.1:0/2194179467 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f38d81540a0 0x7f38d80c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:59.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.086+0000 7f38dffeb700 1 -- 172.21.15.1:0/2194179467 >> 172.21.15.1:0/2194179467 conn(0x7f38d8064a70 msgr2=0x7f38d814e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:59.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.087+0000 7f38dffeb700 1 -- 172.21.15.1:0/2194179467 shutdown_connections 2023-11-15T01:36:59.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.087+0000 7f38dffeb700 1 -- 172.21.15.1:0/2194179467 wait complete. 2023-11-15T01:36:59.090 INFO:teuthology.orchestra.run.smithi001.stderr:updated caps for client.0 2023-11-15T01:36:59.099 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:36:59.210 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-11-15T01:36:59.210+0000 7efdd2067700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T01:36:59.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.217+0000 7f524014a700 1 Processor -- start 2023-11-15T01:36:59.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.217+0000 7f524014a700 1 -- start start 2023-11-15T01:36:59.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.218+0000 7f524014a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f52380ab1a0 0x7f5238154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:59.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.218+0000 7f524014a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52380c06f0 con 0x7f52380aa060 2023-11-15T01:36:59.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.218+0000 7f524014a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52380c09d0 con 0x7f5238154150 2023-11-15T01:36:59.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.218+0000 7f524014a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5238158820 con 0x7f52380ab1a0 2023-11-15T01:36:59.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.218+0000 7f523e6e7700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f52380aa060 0x7f52380c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:56262/0 (socket says 172.21.15.1:56262) 2023-11-15T01:36:59.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.218+0000 7f523e6e7700 1 -- 172.21.15.1:0/3463031655 learned_addr learned my addr 172.21.15.1:0/3463031655 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:59.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.218+0000 7f523d6e5700 1 --2- 172.21.15.1:0/3463031655 >> v2:172.21.15.141:3300/0 conn(0x7f52380ab1a0 0x7f5238154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:59.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.218+0000 7f523cee4700 1 -- 172.21.15.1:0/3463031655 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473496967 0 0) 0x7f52380c06f0 con 0x7f52380aa060 2023-11-15T01:36:59.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.219+0000 7f523cee4700 1 -- 172.21.15.1:0/3463031655 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52200033f0 con 0x7f52380aa060 2023-11-15T01:36:59.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.219+0000 7f523d6e5700 1 -- 172.21.15.1:0/3463031655 >> v1:172.21.15.141:6789/0 conn(0x7f5238154150 legacy=0x7f5238158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:59.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.219+0000 7f523d6e5700 1 -- 172.21.15.1:0/3463031655 >> v1:172.21.15.1:6789/0 conn(0x7f52380aa060 legacy=0x7f52380c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:59.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.219+0000 7f523d6e5700 1 -- 172.21.15.1:0/3463031655 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5238158b00 con 0x7f52380ab1a0 2023-11-15T01:36:59.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.219+0000 7f523d6e5700 1 --2- 172.21.15.1:0/3463031655 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52380ab1a0 0x7f5238154530 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f522c009760 tx=0x7f522c009060).ready entity=mon.1 client_cookie=e5bcbc76fd031d30 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:59.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.219+0000 7f523cee4700 1 -- 172.21.15.1:0/3463031655 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c0090d0 con 0x7f52380ab1a0 2023-11-15T01:36:59.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.219+0000 7f523cee4700 1 -- 172.21.15.1:0/3463031655 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c00f510 con 0x7f52380ab1a0 2023-11-15T01:36:59.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.219+0000 7f523cee4700 1 -- 172.21.15.1:0/3463031655 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c00f890 con 0x7f52380ab1a0 2023-11-15T01:36:59.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.219+0000 7f524014a700 1 -- 172.21.15.1:0/3463031655 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52380ab1a0 msgr2=0x7f5238154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:59.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.219+0000 7f524014a700 1 --2- 172.21.15.1:0/3463031655 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52380ab1a0 0x7f5238154530 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f522c009760 tx=0x7f522c009060).stop 2023-11-15T01:36:59.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.220+0000 7f524014a700 1 -- 172.21.15.1:0/3463031655 shutdown_connections 2023-11-15T01:36:59.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.220+0000 7f524014a700 1 --2- 172.21.15.1:0/3463031655 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52380ab1a0 0x7f5238154530 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:59.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.220+0000 7f524014a700 1 -- 172.21.15.1:0/3463031655 >> 172.21.15.1:0/3463031655 conn(0x7f5238064aa0 msgr2=0x7f5238064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:59.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.220+0000 7f524014a700 1 -- 172.21.15.1:0/3463031655 shutdown_connections 2023-11-15T01:36:59.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.220+0000 7f524014a700 1 -- 172.21.15.1:0/3463031655 wait complete. 2023-11-15T01:36:59.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.221+0000 7f524014a700 1 Processor -- start 2023-11-15T01:36:59.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.221+0000 7f524014a700 1 -- start start 2023-11-15T01:36:59.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f524014a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52380aa060 0x7f523814e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:59.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f524014a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52380ab1a0 0x7f523814eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:59.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f524014a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5238154150 0x7f5238167cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:59.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f524014a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523814f390 con 0x7f5238154150 2023-11-15T01:36:59.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f524014a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52381650c0 con 0x7f52380ab1a0 2023-11-15T01:36:59.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f524014a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5238165550 con 0x7f52380aa060 2023-11-15T01:36:59.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f523e6e7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5238154150 0x7f5238167cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:59.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f523e6e7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5238154150 0x7f5238167cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53382/0 (socket says 172.21.15.1:53382) 2023-11-15T01:36:59.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f523e6e7700 1 -- 172.21.15.1:0/2488153790 learned_addr learned my addr 172.21.15.1:0/2488153790 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:36:59.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f523d6e5700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52380ab1a0 0x7f523814eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:59.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f523dee6700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52380aa060 0x7f523814e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:59.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f523e6e7700 1 -- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52380aa060 msgr2=0x7f523814e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:59.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f523e6e7700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52380aa060 0x7f523814e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:59.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f523e6e7700 1 -- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52380ab1a0 msgr2=0x7f523814eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:59.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f523e6e7700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52380ab1a0 0x7f523814eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:59.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f523e6e7700 1 -- 172.21.15.1:0/2488153790 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c0092a0 con 0x7f5238154150 2023-11-15T01:36:59.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f523d6e5700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52380ab1a0 0x7f523814eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:59.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f523dee6700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52380aa060 0x7f523814e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:36:59.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f523e6e7700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5238154150 0x7f5238167cc0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f5228001460 tx=0x7f5228001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:59.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f5235ffb700 1 -- 172.21.15.1:0/2488153790 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228005d30 con 0x7f5238154150 2023-11-15T01:36:59.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f5235ffb700 1 -- 172.21.15.1:0/2488153790 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5228005e90 con 0x7f5238154150 2023-11-15T01:36:59.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f524014a700 1 -- 172.21.15.1:0/2488153790 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5238168a30 con 0x7f5238154150 2023-11-15T01:36:59.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.222+0000 7f5235ffb700 1 -- 172.21.15.1:0/2488153790 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228007320 con 0x7f5238154150 2023-11-15T01:36:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.223+0000 7f524014a700 1 -- 172.21.15.1:0/2488153790 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5238164a70 con 0x7f5238154150 2023-11-15T01:36:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.223+0000 7f524014a700 1 -- 172.21.15.1:0/2488153790 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5238165250 con 0x7f5238154150 2023-11-15T01:36:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.224+0000 7f5235ffb700 1 -- 172.21.15.1:0/2488153790 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f52280076d0 con 0x7f5238154150 2023-11-15T01:36:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.224+0000 7f5235ffb700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f522405f270 0x7f5224061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.224+0000 7f5235ffb700 1 -- 172.21.15.1:0/2488153790 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f522807a5c0 con 0x7f5238154150 2023-11-15T01:36:59.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.224+0000 7f523dee6700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f522405f270 0x7f5224061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:59.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.225+0000 7f523dee6700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f522405f270 0x7f5224061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5230001670 tx=0x7f5230009040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:59.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.228+0000 7f5235ffb700 1 -- 172.21.15.1:0/2488153790 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f522804b560 con 0x7f5238154150 2023-11-15T01:36:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.443+0000 7f524014a700 1 -- 172.21.15.1:0/2488153790 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f523806c7e0 con 0x7f5238154150 2023-11-15T01:36:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.444+0000 7f5235ffb700 1 -- 172.21.15.1:0/2488153790 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f522804eb80 con 0x7f5238154150 2023-11-15T01:36:59.445 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:36:59.445 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2863729575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2863729575},{"type":"v1","addr":"172.21.15.141:6836","nonce":2863729575}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/4111210566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":4111210566},{"type":"v1","addr":"172.21.15.141:6837","nonce":4111210566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6696,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/4099031019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4099031019},{"type":"v1","addr":"172.21.15.1:6834","nonce":4099031019}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:36:54.262333+0000","modified":"2023-11-15T01:36:57.273246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6699":{"gid":6699,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/1737301018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1737301018},{"type":"v1","addr":"172.21.15.1:6835","nonce":1737301018}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-11-15T01:36:59.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.446+0000 7f524014a700 1 -- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f522405f270 msgr2=0x7f5224061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:59.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.446+0000 7f524014a700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f522405f270 0x7f5224061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5230001670 tx=0x7f5230009040).stop 2023-11-15T01:36:59.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.446+0000 7f524014a700 1 -- 172.21.15.1:0/2488153790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5238154150 msgr2=0x7f5238167cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:59.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.446+0000 7f524014a700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5238154150 0x7f5238167cc0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f5228001460 tx=0x7f5228001650).stop 2023-11-15T01:36:59.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.446+0000 7f524014a700 1 -- 172.21.15.1:0/2488153790 shutdown_connections 2023-11-15T01:36:59.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.446+0000 7f524014a700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f522405f270 0x7f5224061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:59.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.446+0000 7f524014a700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5238154150 0x7f5238167cc0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:59.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.446+0000 7f524014a700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52380aa060 0x7f523814e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:59.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.446+0000 7f524014a700 1 --2- 172.21.15.1:0/2488153790 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52380ab1a0 0x7f523814eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:59.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.446+0000 7f524014a700 1 -- 172.21.15.1:0/2488153790 >> 172.21.15.1:0/2488153790 conn(0x7f5238064aa0 msgr2=0x7f52380c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:36:59.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.446+0000 7f524014a700 1 -- 172.21.15.1:0/2488153790 shutdown_connections 2023-11-15T01:36:59.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.446+0000 7f524014a700 1 -- 172.21.15.1:0/2488153790 wait complete. 2023-11-15T01:36:59.451 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 39 2023-11-15T01:36:59.861 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-15T01:36:54.262333+0000', 'modified': '2023-11-15T01:36:57.273246+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6699}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6699': {'gid': 6699, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.1:6835/1737301018', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6833', 'nonce': 1737301018}, {'type': 'v1', 'addr': '172.21.15.1:6835', 'nonce': 1737301018}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-15T01:36:59.861 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-15T01:36:59.862 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-15T01:36:59.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.984+0000 7f688759e700 1 Processor -- start 2023-11-15T01:36:59.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.984+0000 7f688759e700 1 -- start start 2023-11-15T01:36:59.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.985+0000 7f688759e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6888151e10 0x7f6888155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:59.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.985+0000 7f688759e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68880c7980 con 0x7f68880c98b0 2023-11-15T01:36:59.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.985+0000 7f688759e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68880c8b10 con 0x7f68880c86b0 2023-11-15T01:36:59.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.985+0000 7f688759e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68880aa890 con 0x7f6888151e10 2023-11-15T01:36:59.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.985+0000 7f6886d9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f68880c98b0 0x7f68880c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:56270/0 (socket says 172.21.15.1:56270) 2023-11-15T01:36:59.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.985+0000 7f6886d9d700 1 -- 172.21.15.1:0/1994926509 learned_addr learned my addr 172.21.15.1:0/1994926509 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:36:59.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.985+0000 7f688659c700 1 --2- 172.21.15.1:0/1994926509 >> v2:172.21.15.141:3300/0 conn(0x7f6888151e10 0x7f6888155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:59.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.985+0000 7f688559a700 1 -- 172.21.15.1:0/1994926509 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567442255 0 0) 0x7f68880c7980 con 0x7f68880c98b0 2023-11-15T01:36:59.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.985+0000 7f688559a700 1 -- 172.21.15.1:0/1994926509 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68740033f0 con 0x7f68880c98b0 2023-11-15T01:36:59.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688559a700 1 -- 172.21.15.1:0/1994926509 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 147231493 0 0) 0x7f68740033f0 con 0x7f68880c98b0 2023-11-15T01:36:59.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688559a700 1 -- 172.21.15.1:0/1994926509 >> v2:172.21.15.141:3300/0 conn(0x7f6888151e10 msgr2=0x7f6888155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:59.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688559a700 1 --2- 172.21.15.1:0/1994926509 >> v2:172.21.15.141:3300/0 conn(0x7f6888151e10 0x7f6888155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:59.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688559a700 1 -- 172.21.15.1:0/1994926509 >> v1:172.21.15.141:6789/0 conn(0x7f68880c86b0 legacy=0x7f68880aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:59.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688559a700 1 -- 172.21.15.1:0/1994926509 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68880c7bd0 con 0x7f68880c98b0 2023-11-15T01:36:59.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688559a700 1 -- 172.21.15.1:0/1994926509 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f6878001470 con 0x7f68880c98b0 2023-11-15T01:36:59.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688559a700 1 -- 172.21.15.1:0/1994926509 >> v1:172.21.15.1:6789/0 conn(0x7f68880c98b0 legacy=0x7f68880c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:59.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688559a700 1 --2- 172.21.15.1:0/1994926509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68740038e0 0x7f6874003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:59.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688559a700 1 --2- 172.21.15.1:0/1994926509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6874004690 0x7f6874004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:59.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688559a700 1 --2- 172.21.15.1:0/1994926509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874005000 0x7f687400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:36:59.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688559a700 1 -- 172.21.15.1:0/1994926509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68880aa890 con 0x7f6874005000 2023-11-15T01:36:59.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688559a700 1 -- 172.21.15.1:0/1994926509 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687400beb0 con 0x7f68740038e0 2023-11-15T01:36:59.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688559a700 1 -- 172.21.15.1:0/1994926509 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687400c070 con 0x7f6874004690 2023-11-15T01:36:59.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f6886d9d700 1 --2- 172.21.15.1:0/1994926509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874005000 0x7f687400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:59.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688659c700 1 --2- 172.21.15.1:0/1994926509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68740038e0 0x7f6874003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:59.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f6885d9b700 1 --2- 172.21.15.1:0/1994926509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6874004690 0x7f6874004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:36:59.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f6886d9d700 1 -- 172.21.15.1:0/1994926509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6874004690 msgr2=0x7f6874004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:59.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f6886d9d700 1 --2- 172.21.15.1:0/1994926509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6874004690 0x7f6874004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:59.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f6886d9d700 1 -- 172.21.15.1:0/1994926509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68740038e0 msgr2=0x7f6874003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:36:59.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f6886d9d700 1 --2- 172.21.15.1:0/1994926509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68740038e0 0x7f6874003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:36:59.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f6886d9d700 1 -- 172.21.15.1:0/1994926509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68740033f0 con 0x7f6874005000 2023-11-15T01:36:59.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f6885d9b700 1 --2- 172.21.15.1:0/1994926509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6874004690 0x7f6874004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:36:59.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f6886d9d700 1 -- 172.21.15.1:0/1994926509 reap_dead start 2023-11-15T01:36:59.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f6886d9d700 1 --2- 172.21.15.1:0/1994926509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874005000 0x7f687400b8e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f687800c190 tx=0x7f6878001e70).ready entity=mon.0 client_cookie=e8c332912b5091ce server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:36:59.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688559a700 1 -- 172.21.15.1:0/1994926509 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878007a40 con 0x7f6874005000 2023-11-15T01:36:59.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.986+0000 7f688559a700 1 -- 172.21.15.1:0/1994926509 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687800ca60 con 0x7f6874005000 2023-11-15T01:36:59.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.987+0000 7f688559a700 1 -- 172.21.15.1:0/1994926509 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687800ce00 con 0x7f6874005000 2023-11-15T01:36:59.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.987+0000 7f688759e700 1 -- 172.21.15.1:0/1994926509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874005000 msgr2=0x7f687400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:36:59.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.987+0000 7f688759e700 1 --2- 172.21.15.1:0/1994926509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874005000 0x7f687400b8e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f687800c190 tx=0x7f6878001e70).stop 2023-11-15T01:36:59.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.987+0000 7f688759e700 1 -- 172.21.15.1:0/1994926509 shutdown_connections 2023-11-15T01:37:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.987+0000 7f688759e700 1 --2- 172.21.15.1:0/1994926509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874005000 0x7f687400b8e0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.987+0000 7f688759e700 1 -- 172.21.15.1:0/1994926509 >> 172.21.15.1:0/1994926509 conn(0x7f68880947e0 msgr2=0x7f688806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.987+0000 7f688759e700 1 -- 172.21.15.1:0/1994926509 shutdown_connections 2023-11-15T01:37:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.987+0000 7f688759e700 1 -- 172.21.15.1:0/1994926509 wait complete. 2023-11-15T01:37:00.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.988+0000 7f688759e700 1 Processor -- start 2023-11-15T01:37:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.988+0000 7f688759e700 1 -- start start 2023-11-15T01:37:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.989+0000 7f688759e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6874005000 0x7f68880af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.989+0000 7f688759e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68880ada50 0x7f688814ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.989+0000 7f688759e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68880c6160 0x7f68880c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.989+0000 7f688759e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68880b0e30 con 0x7f68880ada50 2023-11-15T01:37:00.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.989+0000 7f688759e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68880c6ab0 con 0x7f6874005000 2023-11-15T01:37:00.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.989+0000 7f688759e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68880b0220 con 0x7f68880c6160 2023-11-15T01:37:00.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.989+0000 7f6885d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68880ada50 0x7f688814ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.989+0000 7f6885d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68880ada50 0x7f688814ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53398/0 (socket says 172.21.15.1:53398) 2023-11-15T01:37:00.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.989+0000 7f6885d9b700 1 -- 172.21.15.1:0/2955789521 learned_addr learned my addr 172.21.15.1:0/2955789521 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:00.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.989+0000 7f6885d9b700 1 -- 172.21.15.1:0/2955789521 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68880c6160 msgr2=0x7f68880c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:00.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.989+0000 7f6885d9b700 1 --2- 172.21.15.1:0/2955789521 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68880c6160 0x7f68880c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:00.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.989+0000 7f6885d9b700 1 -- 172.21.15.1:0/2955789521 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6874005000 msgr2=0x7f68880af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:00.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.989+0000 7f688659c700 1 --2- 172.21.15.1:0/2955789521 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6874005000 0x7f68880af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.989+0000 7f6885d9b700 1 --2- 172.21.15.1:0/2955789521 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6874005000 0x7f68880af540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.989+0000 7f6885d9b700 1 -- 172.21.15.1:0/2955789521 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68880b0500 con 0x7f68880ada50 2023-11-15T01:37:00.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.990+0000 7f6885d9b700 1 --2- 172.21.15.1:0/2955789521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68880ada50 0x7f688814ee50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f687000e550 tx=0x7f6870009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:00.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.990+0000 7f687e7fc700 1 -- 172.21.15.1:0/2955789521 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6870015440 con 0x7f68880ada50 2023-11-15T01:37:00.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.990+0000 7f687e7fc700 1 -- 172.21.15.1:0/2955789521 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6870010040 con 0x7f68880ada50 2023-11-15T01:37:00.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.990+0000 7f688759e700 1 -- 172.21.15.1:0/2955789521 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68880b07e0 con 0x7f68880ada50 2023-11-15T01:37:00.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.990+0000 7f687e7fc700 1 -- 172.21.15.1:0/2955789521 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68700157b0 con 0x7f68880ada50 2023-11-15T01:37:00.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.990+0000 7f688759e700 1 -- 172.21.15.1:0/2955789521 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68880afeb0 con 0x7f68880ada50 2023-11-15T01:37:00.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.991+0000 7f687e7fc700 1 -- 172.21.15.1:0/2955789521 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f687001f440 con 0x7f68880ada50 2023-11-15T01:37:00.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.991+0000 7f687e7fc700 1 --2- 172.21.15.1:0/2955789521 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f686805f270 0x7f6868061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.991+0000 7f687e7fc700 1 -- 172.21.15.1:0/2955789521 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f6870079e80 con 0x7f68880ada50 2023-11-15T01:37:00.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.992+0000 7f688659c700 1 --2- 172.21.15.1:0/2955789521 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f686805f270 0x7f6868061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.992+0000 7f688659c700 1 --2- 172.21.15.1:0/2955789521 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f686805f270 0x7f6868061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f68800094a0 tx=0x7f688000b040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:00.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.994+0000 7f689e8e2b80 1 Processor -- start 2023-11-15T01:37:00.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.994+0000 7f689e8e2b80 1 -- start start 2023-11-15T01:37:00.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.994+0000 7f689e8e2b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e5c7e40 0x556c0e80b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.994+0000 7f689e8e2b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e8544e0 0x556c0e80bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.994+0000 7f689e8e2b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e833cf0 0x556c0e8067e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.994+0000 7f689e8e2b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c0e7d1060 con 0x556c0e833cf0 2023-11-15T01:37:00.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.994+0000 7f689e8e2b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c0e7481f0 con 0x556c0e5c7e40 2023-11-15T01:37:00.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.994+0000 7f689e8e2b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c0e75d440 con 0x556c0e8544e0 2023-11-15T01:37:00.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.995+0000 7f6886d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e833cf0 0x556c0e8067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.995+0000 7f6886d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e833cf0 0x556c0e8067e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53412/0 (socket says 172.21.15.1:53412) 2023-11-15T01:37:00.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.995+0000 7f6886d9d700 1 -- 172.21.15.1:0/3509273956 learned_addr learned my addr 172.21.15.1:0/3509273956 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:00.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.995+0000 7f688659c700 1 --2- 172.21.15.1:0/3509273956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e5c7e40 0x556c0e80b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.995+0000 7f6885d9b700 1 --2- 172.21.15.1:0/3509273956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e8544e0 0x556c0e80bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.995+0000 7f6886d9d700 1 -- 172.21.15.1:0/3509273956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e8544e0 msgr2=0x556c0e80bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:00.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.995+0000 7f6886d9d700 1 --2- 172.21.15.1:0/3509273956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e8544e0 0x556c0e80bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.995+0000 7f6886d9d700 1 -- 172.21.15.1:0/3509273956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e5c7e40 msgr2=0x556c0e80b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.995+0000 7f6886d9d700 1 --2- 172.21.15.1:0/3509273956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e5c7e40 0x556c0e80b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.995+0000 7f6886d9d700 1 -- 172.21.15.1:0/3509273956 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c0e756620 con 0x556c0e833cf0 2023-11-15T01:37:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.995+0000 7f6886d9d700 1 --2- 172.21.15.1:0/3509273956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e833cf0 0x556c0e8067e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f6878000c00 tx=0x7f6878015000).ready entity=mon.0 client_cookie=aa11d89ecb0474f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.995+0000 7f68677fe700 1 -- 172.21.15.1:0/3509273956 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878007a40 con 0x556c0e833cf0 2023-11-15T01:37:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.995+0000 7f68677fe700 1 -- 172.21.15.1:0/3509273956 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687800c7b0 con 0x556c0e833cf0 2023-11-15T01:37:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.995+0000 7f68677fe700 1 -- 172.21.15.1:0/3509273956 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878000ed0 con 0x556c0e833cf0 2023-11-15T01:37:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.996+0000 7f689e8e2b80 1 -- 172.21.15.1:0/3509273956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e833cf0 msgr2=0x556c0e8067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.996+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/3509273956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e833cf0 0x556c0e8067e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f6878000c00 tx=0x7f6878015000).stop 2023-11-15T01:37:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.996+0000 7f689e8e2b80 1 -- 172.21.15.1:0/3509273956 shutdown_connections 2023-11-15T01:37:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.996+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/3509273956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e833cf0 0x556c0e8067e0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.996+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/3509273956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e5c7e40 0x556c0e80b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.996+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/3509273956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e8544e0 0x556c0e80bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.996+0000 7f689e8e2b80 1 -- 172.21.15.1:0/3509273956 >> 172.21.15.1:0/3509273956 conn(0x556c0e6754a0 msgr2=0x556c0e854970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.996+0000 7f689e8e2b80 1 -- 172.21.15.1:0/3509273956 shutdown_connections 2023-11-15T01:37:00.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.996+0000 7f689e8e2b80 1 -- 172.21.15.1:0/3509273956 wait complete. 2023-11-15T01:37:00.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.997+0000 7f689e8e2b80 1 -- start start 2023-11-15T01:37:00.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.997+0000 7f689e8e2b80 1 Processor -- start 2023-11-15T01:37:00.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f689e8e2b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e830370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f689e8e2b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 0x556c0e806220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f689e8e2b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 0x556c0e806710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f689e8e2b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c0e75d580 con 0x556c0e5c7e40 2023-11-15T01:37:00.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f689e8e2b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c0e75d800 con 0x556c0e8544e0 2023-11-15T01:37:00.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f689e8e2b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c0e728e10 con 0x556c0e833cf0 2023-11-15T01:37:00.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f689e8e2b80 10 client.0 ll_register_callbacks cb 0x556c0e7cb640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:37:00.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f688659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e830370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f688659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e830370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53416/0 (socket says 172.21.15.1:53416) 2023-11-15T01:37:00.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f688659c700 1 -- 172.21.15.1:0/1991153055 learned_addr learned my addr 172.21.15.1:0/1991153055 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:00.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f6885d9b700 1 --2- 172.21.15.1:0/1991153055 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 0x556c0e806220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f6886d9d700 1 --2- 172.21.15.1:0/1991153055 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 0x556c0e806710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f688659c700 1 -- 172.21.15.1:0/1991153055 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 msgr2=0x556c0e806220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:00.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f688659c700 1 --2- 172.21.15.1:0/1991153055 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 0x556c0e806220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f688659c700 1 -- 172.21.15.1:0/1991153055 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 msgr2=0x556c0e806710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:00.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f688659c700 1 --2- 172.21.15.1:0/1991153055 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 0x556c0e806710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f688659c700 1 -- 172.21.15.1:0/1991153055 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68740033f0 con 0x556c0e5c7e40 2023-11-15T01:37:00.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f688659c700 1 --2- 172.21.15.1:0/1991153055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e830370 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f6880016e80 tx=0x7f6880019040).ready entity=mon.0 client_cookie=9ae46bf9294a4d0c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:00.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f6864ff9700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:37:00.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f6864ff9700 1 -- 172.21.15.1:0/1991153055 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688000e040 con 0x556c0e5c7e40 2023-11-15T01:37:00.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f6864ff9700 1 -- 172.21.15.1:0/1991153055 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f6880015a60 con 0x556c0e5c7e40 2023-11-15T01:37:00.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f689e8e2b80 1 -- 172.21.15.1:0/1991153055 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c0e5c3ca0 con 0x556c0e5c7e40 2023-11-15T01:37:00.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.998+0000 7f6864ff9700 1 -- 172.21.15.1:0/1991153055 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6880015e30 con 0x556c0e5c7e40 2023-11-15T01:37:00.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.999+0000 7f689e8e2b80 10 client.6852 fetch_fsmap learned FSMap version 39 2023-11-15T01:37:00.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.999+0000 7f689e8e2b80 1 -- 172.21.15.1:0/1991153055 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x556c0e7519c0 con 0x556c0e5c7e40 2023-11-15T01:37:00.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.999+0000 7f6864ff9700 1 -- 172.21.15.1:0/1991153055 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c0e5c3ca0 con 0x556c0e5c7e40 2023-11-15T01:37:00.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.999+0000 7f6864ff9700 1 -- 172.21.15.1:0/1991153055 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6880023420 con 0x556c0e5c7e40 2023-11-15T01:37:00.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.999+0000 7f689e8e2b80 10 client.6852 fetch_fsmap finished waiting for FSMap version 39 2023-11-15T01:37:00.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.999+0000 7f689e8e2b80 10 client.6852 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-15T01:37:00.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.999+0000 7f689e8e2b80 20 client.6852 populate_metadata read hostname 'smithi001' 2023-11-15T01:37:00.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.999+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/1991153055 >> [v2:172.21.15.1:6833/1737301018,v1:172.21.15.1:6835/1737301018] conn(0x556c0e831fc0 0x556c0e8323a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.999+0000 7f689e8e2b80 4 client.6852 mds_command: new command op to 6699 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-15T01:37:00.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.999+0000 7f689e8e2b80 1 -- 172.21.15.1:0/1991153055 --> [v2:172.21.15.1:6833/1737301018,v1:172.21.15.1:6835/1737301018] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c0e5faca0 con 0x556c0e831fc0 2023-11-15T01:37:00.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.999+0000 7f6885d9b700 1 --2- 172.21.15.1:0/1991153055 >> [v2:172.21.15.1:6833/1737301018,v1:172.21.15.1:6835/1737301018] conn(0x556c0e831fc0 0x556c0e8323a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.999+0000 7f6864ff9700 10 client.6852 ms_handle_connect on v2:172.21.15.1:6833/1737301018 2023-11-15T01:37:00.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:36:59.999+0000 7f6885d9b700 1 --2- 172.21.15.1:0/1991153055 >> [v2:172.21.15.1:6833/1737301018,v1:172.21.15.1:6835/1737301018] conn(0x556c0e831fc0 0x556c0e8323a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5b1822a5aeb65a06 server_cookie=ab985d8511e8d4a6 in_seq=0 out_seq=0 2023-11-15T01:37:00.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.000+0000 7f6864ff9700 1 -- 172.21.15.1:0/1991153055 <== mds.0 v2:172.21.15.1:6833/1737301018 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x556c0e5faca0 con 0x556c0e831fc0 2023-11-15T01:37:00.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.000+0000 7f6864ff9700 10 client.6852 handle_command_reply: tid=0 2023-11-15T01:37:00.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.000+0000 7f689e8e2b80 1 client.6852 shutdown 2023-11-15T01:37:00.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.000+0000 7f689e8e2b80 1 -- 172.21.15.1:0/1991153055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 msgr2=0x556c0e830370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:00.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.000+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/1991153055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e830370 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f6880016e80 tx=0x7f6880019040).stop 2023-11-15T01:37:00.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.000+0000 7f689e8e2b80 1 -- 172.21.15.1:0/1991153055 shutdown_connections 2023-11-15T01:37:00.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.000+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/1991153055 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 0x556c0e806710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.000+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/1991153055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e830370 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.000+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/1991153055 >> [v2:172.21.15.1:6833/1737301018,v1:172.21.15.1:6835/1737301018] conn(0x556c0e831fc0 0x556c0e8323a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.000+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/1991153055 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 0x556c0e806220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.000+0000 7f689e8e2b80 1 -- 172.21.15.1:0/1991153055 >> 172.21.15.1:0/1991153055 conn(0x556c0e6754a0 msgr2=0x556c0e80cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:00.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.000+0000 7f6864ff9700 0 client.6852 ms_handle_reset on v2:172.21.15.1:6833/1737301018 2023-11-15T01:37:00.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.000+0000 7f689e8e2b80 1 -- 172.21.15.1:0/1991153055 shutdown_connections 2023-11-15T01:37:00.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.000+0000 7f689e8e2b80 1 -- 172.21.15.1:0/1991153055 wait complete. 2023-11-15T01:37:00.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.000+0000 7f689e8e2b80 20 client.6852 trim_cache size 0 max 16384 2023-11-15T01:37:00.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.017+0000 7f689e8e2b80 1 Processor -- start 2023-11-15T01:37:00.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.017+0000 7f689e8e2b80 1 -- start start 2023-11-15T01:37:00.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f689e8e2b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e8391e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f689e8e2b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 0x556c0e832570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f689e8e2b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 0x556c0e82f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f689e8e2b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c0e7ff2e0 con 0x556c0e5c7e40 2023-11-15T01:37:00.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f689e8e2b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c0e833820 con 0x556c0e8544e0 2023-11-15T01:37:00.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f689e8e2b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c0e851ab0 con 0x556c0e833cf0 2023-11-15T01:37:00.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f688659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e8391e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f688659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e8391e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53426/0 (socket says 172.21.15.1:53426) 2023-11-15T01:37:00.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f688659c700 1 -- 172.21.15.1:0/754284683 learned_addr learned my addr 172.21.15.1:0/754284683 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:00.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f6886d9d700 1 --2- 172.21.15.1:0/754284683 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 0x556c0e82f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f6885d9b700 1 --2- 172.21.15.1:0/754284683 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 0x556c0e832570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f688659c700 1 -- 172.21.15.1:0/754284683 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 msgr2=0x556c0e832570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:00.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f688659c700 1 --2- 172.21.15.1:0/754284683 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 0x556c0e832570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f688659c700 1 -- 172.21.15.1:0/754284683 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 msgr2=0x556c0e82f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:00.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f688659c700 1 --2- 172.21.15.1:0/754284683 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 0x556c0e82f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f688659c700 1 -- 172.21.15.1:0/754284683 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c0e751710 con 0x556c0e5c7e40 2023-11-15T01:37:00.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f688659c700 1 --2- 172.21.15.1:0/754284683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e8391e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f6880009b50 tx=0x7f688001b000).ready entity=mon.0 client_cookie=823f455986c92984 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:00.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f6867fff700 1 -- 172.21.15.1:0/754284683 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688000e070 con 0x556c0e5c7e40 2023-11-15T01:37:00.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f6867fff700 1 -- 172.21.15.1:0/754284683 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688001d030 con 0x556c0e5c7e40 2023-11-15T01:37:00.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.018+0000 7f6867fff700 1 -- 172.21.15.1:0/754284683 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880015a60 con 0x556c0e5c7e40 2023-11-15T01:37:00.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.019+0000 7f689e8e2b80 1 -- 172.21.15.1:0/754284683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 msgr2=0x556c0e8391e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:00.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.019+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/754284683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e8391e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f6880009b50 tx=0x7f688001b000).stop 2023-11-15T01:37:00.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.019+0000 7f689e8e2b80 1 -- 172.21.15.1:0/754284683 shutdown_connections 2023-11-15T01:37:00.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.019+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/754284683 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 0x556c0e82f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.019+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/754284683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e8391e0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.019+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/754284683 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 0x556c0e832570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.019+0000 7f689e8e2b80 1 -- 172.21.15.1:0/754284683 >> 172.21.15.1:0/754284683 conn(0x556c0e6754a0 msgr2=0x556c0e850750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:00.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.019+0000 7f689e8e2b80 1 -- 172.21.15.1:0/754284683 shutdown_connections 2023-11-15T01:37:00.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.019+0000 7f689e8e2b80 1 -- 172.21.15.1:0/754284683 wait complete. 2023-11-15T01:37:00.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.019+0000 7f689e8e2b80 1 -- start start 2023-11-15T01:37:00.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.020+0000 7f689e8e2b80 1 Processor -- start 2023-11-15T01:37:00.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.020+0000 7f689e8e2b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e8b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.020+0000 7f689e8e2b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 0x556c0e861790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f689e8e2b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 0x556c0e861c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f689e8e2b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c0e862170 con 0x556c0e5c7e40 2023-11-15T01:37:00.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f689e8e2b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c0e8b58e0 con 0x556c0e8544e0 2023-11-15T01:37:00.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f689e8e2b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c0e84e150 con 0x556c0e833cf0 2023-11-15T01:37:00.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f689e8e2b80 10 client.0 ll_register_callbacks cb 0x556c0e7cb640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:37:00.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f688659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e8b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f688659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e8b53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53436/0 (socket says 172.21.15.1:53436) 2023-11-15T01:37:00.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f688659c700 1 -- 172.21.15.1:0/2939776880 learned_addr learned my addr 172.21.15.1:0/2939776880 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:00.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f6885d9b700 1 --2- 172.21.15.1:0/2939776880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 0x556c0e861790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f6886d9d700 1 --2- 172.21.15.1:0/2939776880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 0x556c0e861c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f688659c700 1 -- 172.21.15.1:0/2939776880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 msgr2=0x556c0e861790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:00.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f688659c700 1 --2- 172.21.15.1:0/2939776880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 0x556c0e861790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f688659c700 1 -- 172.21.15.1:0/2939776880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 msgr2=0x556c0e861c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:00.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f688659c700 1 --2- 172.21.15.1:0/2939776880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 0x556c0e861c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f688659c700 1 -- 172.21.15.1:0/2939776880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c0e7519c0 con 0x556c0e5c7e40 2023-11-15T01:37:00.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f6885d9b700 1 --2- 172.21.15.1:0/2939776880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 0x556c0e861790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:00.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f6886d9d700 1 --2- 172.21.15.1:0/2939776880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 0x556c0e861c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:00.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f688659c700 1 --2- 172.21.15.1:0/2939776880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e8b53f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f6880033040 tx=0x7f688002a000).ready entity=mon.0 client_cookie=8b3233666cd2a974 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:00.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f6864ff9700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:37:00.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f6864ff9700 1 -- 172.21.15.1:0/2939776880 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688000e040 con 0x556c0e5c7e40 2023-11-15T01:37:00.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f6864ff9700 1 -- 172.21.15.1:0/2939776880 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f6880023af0 con 0x556c0e5c7e40 2023-11-15T01:37:00.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f689e8e2b80 1 -- 172.21.15.1:0/2939776880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c0e7ff720 con 0x556c0e5c7e40 2023-11-15T01:37:00.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f6864ff9700 1 -- 172.21.15.1:0/2939776880 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f688003a420 con 0x556c0e5c7e40 2023-11-15T01:37:00.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f689e8e2b80 10 client.6858 fetch_fsmap learned FSMap version 39 2023-11-15T01:37:00.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f689e8e2b80 1 -- 172.21.15.1:0/2939776880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x556c0e5c8f80 con 0x556c0e5c7e40 2023-11-15T01:37:00.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.021+0000 7f6864ff9700 1 -- 172.21.15.1:0/2939776880 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c0e7ff720 con 0x556c0e5c7e40 2023-11-15T01:37:00.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f6864ff9700 1 -- 172.21.15.1:0/2939776880 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6880040250 con 0x556c0e5c7e40 2023-11-15T01:37:00.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f689e8e2b80 10 client.6858 fetch_fsmap finished waiting for FSMap version 39 2023-11-15T01:37:00.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f689e8e2b80 10 client.6858 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-15T01:37:00.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f689e8e2b80 20 client.6858 populate_metadata read hostname 'smithi001' 2023-11-15T01:37:00.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/2939776880 >> [v2:172.21.15.1:6833/1737301018,v1:172.21.15.1:6835/1737301018] conn(0x556c0e84cef0 0x556c0e84d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f689e8e2b80 4 client.6858 mds_command: new command op to 6699 tid=0[{"prefix": "status"}] 2023-11-15T01:37:00.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f689e8e2b80 1 -- 172.21.15.1:0/2939776880 --> [v2:172.21.15.1:6833/1737301018,v1:172.21.15.1:6835/1737301018] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556c0e629540 con 0x556c0e84cef0 2023-11-15T01:37:00.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f6885d9b700 1 --2- 172.21.15.1:0/2939776880 >> [v2:172.21.15.1:6833/1737301018,v1:172.21.15.1:6835/1737301018] conn(0x556c0e84cef0 0x556c0e84d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f6885d9b700 1 --2- 172.21.15.1:0/2939776880 >> [v2:172.21.15.1:6833/1737301018,v1:172.21.15.1:6835/1737301018] conn(0x556c0e84cef0 0x556c0e84d2d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=75b7e58ca1a1011b server_cookie=d196d6cf4589adf5 in_seq=0 out_seq=0 2023-11-15T01:37:00.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f6864ff9700 10 client.6858 ms_handle_connect on v2:172.21.15.1:6833/1737301018 2023-11-15T01:37:00.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f6864ff9700 1 -- 172.21.15.1:0/2939776880 <== mds.0 v2:172.21.15.1:6833/1737301018 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x556c0e629540 con 0x556c0e84cef0 2023-11-15T01:37:00.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f6864ff9700 10 client.6858 handle_command_reply: tid=0 2023-11-15T01:37:00.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f689e8e2b80 1 client.6858 shutdown 2023-11-15T01:37:00.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f689e8e2b80 1 -- 172.21.15.1:0/2939776880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 msgr2=0x556c0e8b53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:00.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/2939776880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e8b53f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f6880033040 tx=0x7f688002a000).stop 2023-11-15T01:37:00.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f689e8e2b80 1 -- 172.21.15.1:0/2939776880 shutdown_connections 2023-11-15T01:37:00.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/2939776880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556c0e8544e0 0x556c0e861c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/2939776880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c0e5c7e40 0x556c0e8b53f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/2939776880 >> [v2:172.21.15.1:6833/1737301018,v1:172.21.15.1:6835/1737301018] conn(0x556c0e84cef0 0x556c0e84d2d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f689e8e2b80 1 --2- 172.21.15.1:0/2939776880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x556c0e833cf0 0x556c0e861790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f6864ff9700 0 client.6858 ms_handle_reset on v2:172.21.15.1:6833/1737301018 2023-11-15T01:37:00.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.022+0000 7f689e8e2b80 1 -- 172.21.15.1:0/2939776880 >> 172.21.15.1:0/2939776880 conn(0x556c0e6754a0 msgr2=0x556c0e850980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:00.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.023+0000 7f689e8e2b80 1 -- 172.21.15.1:0/2939776880 shutdown_connections 2023-11-15T01:37:00.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.023+0000 7f689e8e2b80 1 -- 172.21.15.1:0/2939776880 wait complete. 2023-11-15T01:37:00.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.023+0000 7f689e8e2b80 20 client.6858 trim_cache size 0 max 16384 2023-11-15T01:37:00.060 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T01:37:00.061 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "32ffb44b-12dc-4e79-bad7-24a9692dabf6", 2023-11-15T01:37:00.061 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2023-11-15T01:37:00.061 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 6699, 2023-11-15T01:37:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2023-11-15T01:37:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2023-11-15T01:37:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2023-11-15T01:37:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 5.7590380540000004, 2023-11-15T01:37:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 39, 2023-11-15T01:37:00.063 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 94, 2023-11-15T01:37:00.063 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 94, 2023-11-15T01:37:00.063 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 11.225249941 2023-11-15T01:37:00.063 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T01:37:00.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.023+0000 7f688759e700 1 -- 172.21.15.1:0/2955789521 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f686805f270 msgr2=0x7f6868061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:00.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.023+0000 7f688759e700 1 --2- 172.21.15.1:0/2955789521 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f686805f270 0x7f6868061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f68800094a0 tx=0x7f688000b040).stop 2023-11-15T01:37:00.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.023+0000 7f688759e700 1 -- 172.21.15.1:0/2955789521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68880ada50 msgr2=0x7f688814ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:00.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.023+0000 7f688759e700 1 --2- 172.21.15.1:0/2955789521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68880ada50 0x7f688814ee50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f687000e550 tx=0x7f6870009040).stop 2023-11-15T01:37:00.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.023+0000 7f688759e700 1 -- 172.21.15.1:0/2955789521 shutdown_connections 2023-11-15T01:37:00.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.023+0000 7f688759e700 1 --2- 172.21.15.1:0/2955789521 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f686805f270 0x7f6868061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.023+0000 7f688759e700 1 --2- 172.21.15.1:0/2955789521 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68880c6160 0x7f68880c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:00.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.023+0000 7f688759e700 1 --2- 172.21.15.1:0/2955789521 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6874005000 0x7f68880af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.023+0000 7f688759e700 1 --2- 172.21.15.1:0/2955789521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68880ada50 0x7f688814ee50 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.023+0000 7f688759e700 1 -- 172.21.15.1:0/2955789521 >> 172.21.15.1:0/2955789521 conn(0x7f68880947e0 msgr2=0x7f68880a9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:00.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.023+0000 7f688759e700 1 -- 172.21.15.1:0/2955789521 shutdown_connections 2023-11-15T01:37:00.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.023+0000 7f688759e700 1 -- 172.21.15.1:0/2955789521 wait complete. 2023-11-15T01:37:00.068 DEBUG:teuthology.orchestra.run.smithi001:> ceph fs ls 2023-11-15T01:37:00.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.173+0000 7fb5a7329700 1 Processor -- start 2023-11-15T01:37:00.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.173+0000 7fb5a7329700 1 -- start start 2023-11-15T01:37:00.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.174+0000 7fb5a7329700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb5a014e920 0x7fb5a00629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.174+0000 7fb5a7329700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb5a014ed00 0x7fb5a0157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.174+0000 7fb5a7329700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a0063eb0 con 0x7fb5a0158490 2023-11-15T01:37:00.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.174+0000 7fb5a7329700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a00632a0 con 0x7fb5a014ed00 2023-11-15T01:37:00.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.174+0000 7fb5a7329700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a0063580 con 0x7fb5a014e920 2023-11-15T01:37:00.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.174+0000 7fb5a48c4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb5a014ed00 0x7fb5a0157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.174+0000 7fb5a58c6700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb5a0158490 0x7fb5a01549d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:56282/0 (socket says 172.21.15.1:56282) 2023-11-15T01:37:00.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.174+0000 7fb5a58c6700 1 -- 172.21.15.1:0/4224347049 learned_addr learned my addr 172.21.15.1:0/4224347049 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:00.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.174+0000 7fb5a50c5700 1 --2- 172.21.15.1:0/4224347049 >> v2:172.21.15.141:3300/0 conn(0x7fb5a014e920 0x7fb5a00629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.174+0000 7fb5a48c4700 1 -- 172.21.15.1:0/4224347049 >> v2:172.21.15.141:3300/0 conn(0x7fb5a014e920 msgr2=0x7fb5a00629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:00.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb5a48c4700 1 --2- 172.21.15.1:0/4224347049 >> v2:172.21.15.141:3300/0 conn(0x7fb5a014e920 0x7fb5a00629c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb5a48c4700 1 -- 172.21.15.1:0/4224347049 >> v1:172.21.15.1:6789/0 conn(0x7fb5a0158490 legacy=0x7fb5a01549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:00.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb59ffff700 1 -- 172.21.15.1:0/4224347049 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515697100 0 0) 0x7fb5a0063eb0 con 0x7fb5a0158490 2023-11-15T01:37:00.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb5a48c4700 1 -- 172.21.15.1:0/4224347049 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a0063860 con 0x7fb5a014ed00 2023-11-15T01:37:00.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb5a48c4700 1 --2- 172.21.15.1:0/4224347049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5a014ed00 0x7fb5a0157fa0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fb5a00cbe80 tx=0x7fb594009060).ready entity=mon.0 client_cookie=cd33c971d110f3ee server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:00.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb59ffff700 1 -- 172.21.15.1:0/4224347049 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5940090d0 con 0x7fb5a014ed00 2023-11-15T01:37:00.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb59ffff700 1 -- 172.21.15.1:0/4224347049 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59400b580 con 0x7fb5a014ed00 2023-11-15T01:37:00.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb59ffff700 1 -- 172.21.15.1:0/4224347049 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59400b900 con 0x7fb5a014ed00 2023-11-15T01:37:00.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb5a7329700 1 -- 172.21.15.1:0/4224347049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5a014ed00 msgr2=0x7fb5a0157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:00.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb5a7329700 1 --2- 172.21.15.1:0/4224347049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5a014ed00 0x7fb5a0157fa0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fb5a00cbe80 tx=0x7fb594009060).stop 2023-11-15T01:37:00.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb5a7329700 1 -- 172.21.15.1:0/4224347049 shutdown_connections 2023-11-15T01:37:00.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb5a7329700 1 --2- 172.21.15.1:0/4224347049 >> v2:172.21.15.141:3300/0 conn(0x7fb5a014e920 0x7fb5a00629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb5a7329700 1 --2- 172.21.15.1:0/4224347049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5a014ed00 0x7fb5a0157fa0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb5a7329700 1 -- 172.21.15.1:0/4224347049 >> 172.21.15.1:0/4224347049 conn(0x7fb5a00cb0f0 msgr2=0x7fb5a00cb500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:00.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb5a7329700 1 -- 172.21.15.1:0/4224347049 shutdown_connections 2023-11-15T01:37:00.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.175+0000 7fb5a7329700 1 -- 172.21.15.1:0/4224347049 wait complete. 2023-11-15T01:37:00.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.177+0000 7fb5a7329700 1 Processor -- start 2023-11-15T01:37:00.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.177+0000 7fb5a7329700 1 -- start start 2023-11-15T01:37:00.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.177+0000 7fb5a7329700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5a014e920 0x7fb5a00ad570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.177+0000 7fb5a7329700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5a014ed00 0x7fb5a00c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a7329700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5a0158490 0x7fb5a0168460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a7329700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00c3c60 con 0x7fb5a0158490 2023-11-15T01:37:00.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a7329700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00adb30 con 0x7fb5a014ed00 2023-11-15T01:37:00.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a7329700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00c47c0 con 0x7fb5a014e920 2023-11-15T01:37:00.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a58c6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5a0158490 0x7fb5a0168460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a58c6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5a0158490 0x7fb5a0168460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53464/0 (socket says 172.21.15.1:53464) 2023-11-15T01:37:00.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a58c6700 1 -- 172.21.15.1:0/3771983842 learned_addr learned my addr 172.21.15.1:0/3771983842 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:00.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a48c4700 1 --2- 172.21.15.1:0/3771983842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5a014ed00 0x7fb5a00c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a50c5700 1 --2- 172.21.15.1:0/3771983842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5a014e920 0x7fb5a00ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a58c6700 1 -- 172.21.15.1:0/3771983842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5a014e920 msgr2=0x7fb5a00ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:00.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a58c6700 1 --2- 172.21.15.1:0/3771983842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5a014e920 0x7fb5a00ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a58c6700 1 -- 172.21.15.1:0/3771983842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5a014ed00 msgr2=0x7fb5a00c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:00.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a58c6700 1 --2- 172.21.15.1:0/3771983842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5a014ed00 0x7fb5a00c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a58c6700 1 -- 172.21.15.1:0/3771983842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5940092a0 con 0x7fb5a0158490 2023-11-15T01:37:00.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a58c6700 1 --2- 172.21.15.1:0/3771983842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5a0158490 0x7fb5a0168460 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fb59000c810 tx=0x7fb5900014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:00.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb59d7fa700 1 -- 172.21.15.1:0/3771983842 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590005d30 con 0x7fb5a0158490 2023-11-15T01:37:00.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb59d7fa700 1 -- 172.21.15.1:0/3771983842 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb590005e90 con 0x7fb5a0158490 2023-11-15T01:37:00.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a7329700 1 -- 172.21.15.1:0/3771983842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a0168950 con 0x7fb5a0158490 2023-11-15T01:37:00.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb59d7fa700 1 -- 172.21.15.1:0/3771983842 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5900072e0 con 0x7fb5a0158490 2023-11-15T01:37:00.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.178+0000 7fb5a7329700 1 -- 172.21.15.1:0/3771983842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a00c41f0 con 0x7fb5a0158490 2023-11-15T01:37:00.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.179+0000 7fb5a7329700 1 -- 172.21.15.1:0/3771983842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a00c4930 con 0x7fb5a0158490 2023-11-15T01:37:00.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.180+0000 7fb59d7fa700 1 -- 172.21.15.1:0/3771983842 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb590007710 con 0x7fb5a0158490 2023-11-15T01:37:00.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.180+0000 7fb59d7fa700 1 --2- 172.21.15.1:0/3771983842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb58c05f270 0x7fb58c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:00.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.180+0000 7fb59d7fa700 1 -- 172.21.15.1:0/3771983842 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fb590079f80 con 0x7fb5a0158490 2023-11-15T01:37:00.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.180+0000 7fb5a50c5700 1 --2- 172.21.15.1:0/3771983842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb58c05f270 0x7fb58c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:00.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.181+0000 7fb5a50c5700 1 --2- 172.21.15.1:0/3771983842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb58c05f270 0x7fb58c061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb59800bbc0 tx=0x7fb598008040).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:00.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.184+0000 7fb59d7fa700 1 -- 172.21.15.1:0/3771983842 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb59004af20 con 0x7fb5a0158490 2023-11-15T01:37:00.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.403+0000 7fb5a7329700 1 -- 172.21.15.1:0/3771983842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb5a00475e0 con 0x7fb5a0158490 2023-11-15T01:37:00.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.403+0000 7fb59d7fa700 1 -- 172.21.15.1:0/3771983842 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb590018030 con 0x7fb5a0158490 2023-11-15T01:37:00.404 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-15T01:37:00.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.405+0000 7fb5a7329700 1 -- 172.21.15.1:0/3771983842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb58c05f270 msgr2=0x7fb58c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:00.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.405+0000 7fb5a7329700 1 --2- 172.21.15.1:0/3771983842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb58c05f270 0x7fb58c061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb59800bbc0 tx=0x7fb598008040).stop 2023-11-15T01:37:00.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.405+0000 7fb5a7329700 1 -- 172.21.15.1:0/3771983842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5a0158490 msgr2=0x7fb5a0168460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:00.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.405+0000 7fb5a7329700 1 --2- 172.21.15.1:0/3771983842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5a0158490 0x7fb5a0168460 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fb59000c810 tx=0x7fb5900014d0).stop 2023-11-15T01:37:00.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.405+0000 7fb5a7329700 1 -- 172.21.15.1:0/3771983842 shutdown_connections 2023-11-15T01:37:00.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.405+0000 7fb5a7329700 1 --2- 172.21.15.1:0/3771983842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb58c05f270 0x7fb58c061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.405+0000 7fb5a7329700 1 --2- 172.21.15.1:0/3771983842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5a0158490 0x7fb5a0168460 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.405+0000 7fb5a7329700 1 --2- 172.21.15.1:0/3771983842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5a014e920 0x7fb5a00ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.405+0000 7fb5a7329700 1 --2- 172.21.15.1:0/3771983842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5a014ed00 0x7fb5a00c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:00.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.405+0000 7fb5a7329700 1 -- 172.21.15.1:0/3771983842 >> 172.21.15.1:0/3771983842 conn(0x7fb5a00cb0f0 msgr2=0x7fb5a00cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:00.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.405+0000 7fb5a7329700 1 -- 172.21.15.1:0/3771983842 shutdown_connections 2023-11-15T01:37:00.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:00.405+0000 7fb5a7329700 1 -- 172.21.15.1:0/3771983842 wait complete. 2023-11-15T01:37:00.416 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-15T01:37:00.416 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-15T01:37:00.417 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-11-15T01:37:00.417 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-15T01:37:00.418 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-15T01:37:00.418 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-15T01:37:00.419 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-15T01:37:00.419 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-15T01:37:00.419 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T01:37:00.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:00.420 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-11-15T01:37:00.436 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:37:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T01:37:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T01:37:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:37:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-11-15T01:37:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:37:00.438 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:37:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-11-15T01:37:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-11-15T01:37:00.439 INFO:teuthology.orchestra.run.smithi001.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-15T01:37:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:37:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-11-15T01:37:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-15T01:37:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 41585sec preferred_lft 41585sec 2023-11-15T01:37:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2023-11-15T01:37:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:37:00.440 INFO:teuthology.orchestra.run.smithi001.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:37:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-11-15T01:37:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-11-15T01:37:00.441 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:37:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:37:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-11-15T01:37:00.441 INFO:teuthology.orchestra.run.smithi001.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-15T01:37:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:37:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-15T01:37:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:37:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::74ff:4aff:fef6:c8f5/64 scope link 2023-11-15T01:37:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:37:00.443 INFO:teuthology.orchestra.run.smithi001.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:37:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-15T01:37:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::10ca:5cff:fe8a:9a23/64 scope link 2023-11-15T01:37:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:37:00.443 INFO:teuthology.orchestra.run.smithi001.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:37:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 92:7a:64:05:0f:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-15T01:37:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::907a:64ff:fe05:f37/64 scope link 2023-11-15T01:37:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:37:00.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:00.445 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-15T01:37:00.500 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-11-15T01:37:00.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:00.502 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-11-15T01:37:00.558 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-11-15T01:37:00.558 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-15T01:37:00.559 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-15T01:37:00.559 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-15T01:37:00.559 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-15T01:37:00.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:00.560 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:37:00.560 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:37:00.561 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-15T01:37:00.561 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-15T01:37:00.561 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-15T01:37:00.562 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:37:00.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:00.661 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T01:37:00.676 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-15T01:37:00.676 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-15T01:37:00.676 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T01:37:00.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:00.677 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2023-11-15T01:37:00.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:00.742 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-15T01:37:00.796 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-15T01:37:00.797 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:37:00.876 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:37:00.877 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:37:00.901 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:37:00.901 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:37:00.903 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-15T01:37:00.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:00.904 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-15T01:37:00.969 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-15T01:37:01.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.129+0000 7f033d397700 1 Processor -- start 2023-11-15T01:37:01.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.129+0000 7f033d397700 1 -- start start 2023-11-15T01:37:01.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f033d397700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0338154150 0x7f0338154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f033d397700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f03380ab1a0 0x7f0338158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f033d397700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03380c06f0 con 0x7f03380aa060 2023-11-15T01:37:01.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f033d397700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03380c09d0 con 0x7f03380ab1a0 2023-11-15T01:37:01.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f033d397700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0338158820 con 0x7f0338154150 2023-11-15T01:37:01.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f03367fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f03380ab1a0 0x7f0338158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f03377fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f03380aa060 0x7f03380c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:56298/0 (socket says 172.21.15.1:56298) 2023-11-15T01:37:01.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f03377fe700 1 -- 172.21.15.1:0/2810962377 learned_addr learned my addr 172.21.15.1:0/2810962377 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:01.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f0336ffd700 1 --2- 172.21.15.1:0/2810962377 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0338154150 0x7f0338154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f03367fc700 1 -- 172.21.15.1:0/2810962377 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0338154150 msgr2=0x7f0338154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:01.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f03367fc700 1 --2- 172.21.15.1:0/2810962377 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0338154150 0x7f0338154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f0335ffb700 1 -- 172.21.15.1:0/2810962377 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094970622 0 0) 0x7f03380c06f0 con 0x7f03380aa060 2023-11-15T01:37:01.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f03367fc700 1 -- 172.21.15.1:0/2810962377 >> v1:172.21.15.1:6789/0 conn(0x7f03380aa060 legacy=0x7f03380c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f03367fc700 1 -- 172.21.15.1:0/2810962377 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0338158b00 con 0x7f03380ab1a0 2023-11-15T01:37:01.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f03367fc700 1 --2- 172.21.15.1:0/2810962377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03380ab1a0 0x7f0338158040 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f0320009760 tx=0x7f0320009060).ready entity=mon.0 client_cookie=5cb768aca796b21 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:01.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f0335ffb700 1 -- 172.21.15.1:0/2810962377 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03200090d0 con 0x7f03380ab1a0 2023-11-15T01:37:01.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f0335ffb700 1 -- 172.21.15.1:0/2810962377 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032000b580 con 0x7f03380ab1a0 2023-11-15T01:37:01.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.130+0000 7f0335ffb700 1 -- 172.21.15.1:0/2810962377 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032000b900 con 0x7f03380ab1a0 2023-11-15T01:37:01.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.131+0000 7f033d397700 1 -- 172.21.15.1:0/2810962377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03380ab1a0 msgr2=0x7f0338158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.131+0000 7f033d397700 1 --2- 172.21.15.1:0/2810962377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03380ab1a0 0x7f0338158040 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f0320009760 tx=0x7f0320009060).stop 2023-11-15T01:37:01.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.131+0000 7f033d397700 1 -- 172.21.15.1:0/2810962377 shutdown_connections 2023-11-15T01:37:01.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.131+0000 7f033d397700 1 --2- 172.21.15.1:0/2810962377 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0338154150 0x7f0338154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.131+0000 7f033d397700 1 --2- 172.21.15.1:0/2810962377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03380ab1a0 0x7f0338158040 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.131+0000 7f033d397700 1 -- 172.21.15.1:0/2810962377 >> 172.21.15.1:0/2810962377 conn(0x7f0338064aa0 msgr2=0x7f0338064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:01.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.131+0000 7f033d397700 1 -- 172.21.15.1:0/2810962377 shutdown_connections 2023-11-15T01:37:01.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.131+0000 7f033d397700 1 -- 172.21.15.1:0/2810962377 wait complete. 2023-11-15T01:37:01.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.132+0000 7f033d397700 1 Processor -- start 2023-11-15T01:37:01.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.132+0000 7f033d397700 1 -- start start 2023-11-15T01:37:01.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.133+0000 7f033d397700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03380aa060 0x7f03381566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.133+0000 7f033d397700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03380ab1a0 0x7f0338144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.133+0000 7f033d397700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0338154150 0x7f0338156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.133+0000 7f033d397700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0338157b50 con 0x7f03380aa060 2023-11-15T01:37:01.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.133+0000 7f033d397700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0338156260 con 0x7f03380ab1a0 2023-11-15T01:37:01.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.133+0000 7f033d397700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0338155c50 con 0x7f0338154150 2023-11-15T01:37:01.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.133+0000 7f0336ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03380aa060 0x7f03381566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.133+0000 7f0336ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03380aa060 0x7f03381566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53482/0 (socket says 172.21.15.1:53482) 2023-11-15T01:37:01.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.133+0000 7f0336ffd700 1 -- 172.21.15.1:0/2012314512 learned_addr learned my addr 172.21.15.1:0/2012314512 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:01.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.133+0000 7f03367fc700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03380ab1a0 0x7f0338144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.133+0000 7f03377fe700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0338154150 0x7f0338156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.134+0000 7f0336ffd700 1 -- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0338154150 msgr2=0x7f0338156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.134+0000 7f0336ffd700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0338154150 0x7f0338156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.134+0000 7f0336ffd700 1 -- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03380ab1a0 msgr2=0x7f0338144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.134+0000 7f0336ffd700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03380ab1a0 0x7f0338144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.134+0000 7f0336ffd700 1 -- 172.21.15.1:0/2012314512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03200092a0 con 0x7f03380aa060 2023-11-15T01:37:01.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.134+0000 7f03367fc700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03380ab1a0 0x7f0338144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:01.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.134+0000 7f03377fe700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0338154150 0x7f0338156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:01.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.134+0000 7f0336ffd700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03380aa060 0x7f03381566f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f032800ce40 tx=0x7f0328007810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:01.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.134+0000 7f032effd700 1 -- 172.21.15.1:0/2012314512 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032800ab50 con 0x7f03380aa060 2023-11-15T01:37:01.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.134+0000 7f032effd700 1 -- 172.21.15.1:0/2012314512 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032800acb0 con 0x7f03380aa060 2023-11-15T01:37:01.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.134+0000 7f033d397700 1 -- 172.21.15.1:0/2012314512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0338145090 con 0x7f03380aa060 2023-11-15T01:37:01.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.134+0000 7f032effd700 1 -- 172.21.15.1:0/2012314512 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032800f610 con 0x7f03380aa060 2023-11-15T01:37:01.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.134+0000 7f033d397700 1 -- 172.21.15.1:0/2012314512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0338155ef0 con 0x7f03380aa060 2023-11-15T01:37:01.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.135+0000 7f033d397700 1 -- 172.21.15.1:0/2012314512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0338155ab0 con 0x7f03380aa060 2023-11-15T01:37:01.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.135+0000 7f032effd700 1 -- 172.21.15.1:0/2012314512 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f032800d040 con 0x7f03380aa060 2023-11-15T01:37:01.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.136+0000 7f032effd700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f031805f270 0x7f0318061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.136+0000 7f032effd700 1 -- 172.21.15.1:0/2012314512 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f032807a750 con 0x7f03380aa060 2023-11-15T01:37:01.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.136+0000 7f03367fc700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f031805f270 0x7f0318061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.136+0000 7f03367fc700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f031805f270 0x7f0318061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0320009760 tx=0x7f0320017000).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:01.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.140+0000 7f032effd700 1 -- 172.21.15.1:0/2012314512 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0338155ab0 con 0x7f03380aa060 2023-11-15T01:37:01.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.338+0000 7f033d397700 1 -- 172.21.15.1:0/2012314512 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0338155ab0 con 0x7f031805f270 2023-11-15T01:37:01.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.340+0000 7f032effd700 1 -- 172.21.15.1:0/2012314512 <== mgr.5627 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0338155ab0 con 0x7f031805f270 2023-11-15T01:37:01.341 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T01:37:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephfs" 2023-11-15T01:37:01.341 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:01.342 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T01:37:01.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.342+0000 7f033d397700 1 -- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f031805f270 msgr2=0x7f0318061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.342+0000 7f033d397700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f031805f270 0x7f0318061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0320009760 tx=0x7f0320017000).stop 2023-11-15T01:37:01.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.342+0000 7f033d397700 1 -- 172.21.15.1:0/2012314512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03380aa060 msgr2=0x7f03381566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.342+0000 7f033d397700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03380aa060 0x7f03381566f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f032800ce40 tx=0x7f0328007810).stop 2023-11-15T01:37:01.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.342+0000 7f033d397700 1 -- 172.21.15.1:0/2012314512 shutdown_connections 2023-11-15T01:37:01.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.342+0000 7f033d397700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f031805f270 0x7f0318061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.342+0000 7f033d397700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0338154150 0x7f0338156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.342+0000 7f033d397700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03380aa060 0x7f03381566f0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.342+0000 7f033d397700 1 --2- 172.21.15.1:0/2012314512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03380ab1a0 0x7f0338144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.342+0000 7f033d397700 1 -- 172.21.15.1:0/2012314512 >> 172.21.15.1:0/2012314512 conn(0x7f0338064aa0 msgr2=0x7f03380ad0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:01.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.342+0000 7f033d397700 1 -- 172.21.15.1:0/2012314512 shutdown_connections 2023-11-15T01:37:01.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.342+0000 7f033d397700 1 -- 172.21.15.1:0/2012314512 wait complete. 2023-11-15T01:37:01.356 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-15T01:37:01.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.475+0000 7f3688273700 1 Processor -- start 2023-11-15T01:37:01.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.475+0000 7f3688273700 1 -- start start 2023-11-15T01:37:01.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.476+0000 7f3688273700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3680154480 0x7f36800c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.476+0000 7f3688273700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f36800c6430 0x7f36800aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.476+0000 7f3688273700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36800ca050 con 0x7f36801540a0 2023-11-15T01:37:01.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.476+0000 7f3688273700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36800c68c0 con 0x7f3680154480 2023-11-15T01:37:01.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.476+0000 7f3688273700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36800c9440 con 0x7f36800c6430 2023-11-15T01:37:01.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.477+0000 7f368580e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3680154480 0x7f36800c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.477+0000 7f368580e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3680154480 0x7f36800c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53496/0 (socket says 172.21.15.1:53496) 2023-11-15T01:37:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.477+0000 7f368580e700 1 -- 172.21.15.1:0/2657430485 learned_addr learned my addr 172.21.15.1:0/2657430485 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.477+0000 7f3686810700 1 --2- 172.21.15.1:0/2657430485 >> v2:172.21.15.141:3300/0 conn(0x7f36800c6430 0x7f36800aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.477+0000 7f368580e700 1 -- 172.21.15.1:0/2657430485 >> v2:172.21.15.141:3300/0 conn(0x7f36800c6430 msgr2=0x7f36800aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.477+0000 7f368580e700 1 --2- 172.21.15.1:0/2657430485 >> v2:172.21.15.141:3300/0 conn(0x7f36800c6430 0x7f36800aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.477+0000 7f368580e700 1 -- 172.21.15.1:0/2657430485 >> v1:172.21.15.141:6789/0 conn(0x7f36801540a0 legacy=0x7f36800ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.477+0000 7f368580e700 1 -- 172.21.15.1:0/2657430485 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36800c9720 con 0x7f3680154480 2023-11-15T01:37:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.477+0000 7f3686810700 1 --2- 172.21.15.1:0/2657430485 >> v2:172.21.15.141:3300/0 conn(0x7f36800c6430 0x7f36800aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.477+0000 7f368580e700 1 --2- 172.21.15.1:0/2657430485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3680154480 0x7f36800c5f40 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f36800aab60 tx=0x7f36740090f0).ready entity=mon.0 client_cookie=2a57c502a72fe8f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.477+0000 7f368500d700 1 -- 172.21.15.1:0/2657430485 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367400b600 con 0x7f3680154480 2023-11-15T01:37:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.477+0000 7f368500d700 1 -- 172.21.15.1:0/2657430485 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367400b760 con 0x7f3680154480 2023-11-15T01:37:01.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.477+0000 7f368500d700 1 -- 172.21.15.1:0/2657430485 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367400bae0 con 0x7f3680154480 2023-11-15T01:37:01.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.478+0000 7f3688273700 1 -- 172.21.15.1:0/2657430485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3680154480 msgr2=0x7f36800c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.478+0000 7f3688273700 1 --2- 172.21.15.1:0/2657430485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3680154480 0x7f36800c5f40 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f36800aab60 tx=0x7f36740090f0).stop 2023-11-15T01:37:01.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.478+0000 7f3688273700 1 -- 172.21.15.1:0/2657430485 shutdown_connections 2023-11-15T01:37:01.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.478+0000 7f3688273700 1 --2- 172.21.15.1:0/2657430485 >> v2:172.21.15.141:3300/0 conn(0x7f36800c6430 0x7f36800aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.478+0000 7f3688273700 1 --2- 172.21.15.1:0/2657430485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3680154480 0x7f36800c5f40 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.478+0000 7f3688273700 1 -- 172.21.15.1:0/2657430485 >> 172.21.15.1:0/2657430485 conn(0x7f3680064a70 msgr2=0x7f3680064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:01.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.478+0000 7f3688273700 1 -- 172.21.15.1:0/2657430485 shutdown_connections 2023-11-15T01:37:01.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.478+0000 7f3688273700 1 -- 172.21.15.1:0/2657430485 wait complete. 2023-11-15T01:37:01.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.479+0000 7f3688273700 1 Processor -- start 2023-11-15T01:37:01.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.479+0000 7f3688273700 1 -- start start 2023-11-15T01:37:01.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f3688273700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36800c6430 0x7f3680159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f3688273700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36801540a0 0x7f3680158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f3688273700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3680154480 0x7f368014efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f3688273700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36800c2bd0 con 0x7f3680154480 2023-11-15T01:37:01.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f3688273700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36801593d0 con 0x7f36801540a0 2023-11-15T01:37:01.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f3688273700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36800c3060 con 0x7f36800c6430 2023-11-15T01:37:01.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f3686810700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3680154480 0x7f368014efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f3686810700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3680154480 0x7f368014efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53506/0 (socket says 172.21.15.1:53506) 2023-11-15T01:37:01.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f3686810700 1 -- 172.21.15.1:0/2782487018 learned_addr learned my addr 172.21.15.1:0/2782487018 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:01.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f368580e700 1 --2- 172.21.15.1:0/2782487018 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36801540a0 0x7f3680158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f368600f700 1 --2- 172.21.15.1:0/2782487018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36800c6430 0x7f3680159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f3686810700 1 -- 172.21.15.1:0/2782487018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36800c6430 msgr2=0x7f3680159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f3686810700 1 --2- 172.21.15.1:0/2782487018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36800c6430 0x7f3680159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f3686810700 1 -- 172.21.15.1:0/2782487018 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36801540a0 msgr2=0x7f3680158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f3686810700 1 --2- 172.21.15.1:0/2782487018 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36801540a0 0x7f3680158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f3686810700 1 -- 172.21.15.1:0/2782487018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3674009370 con 0x7f3680154480 2023-11-15T01:37:01.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f3686810700 1 --2- 172.21.15.1:0/2782487018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3680154480 0x7f368014efd0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f367000d860 tx=0x7f3670008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:01.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.480+0000 7f367e7fc700 1 -- 172.21.15.1:0/2782487018 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670011590 con 0x7f3680154480 2023-11-15T01:37:01.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.481+0000 7f367e7fc700 1 -- 172.21.15.1:0/2782487018 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36700116f0 con 0x7f3680154480 2023-11-15T01:37:01.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.481+0000 7f367e7fc700 1 -- 172.21.15.1:0/2782487018 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670011a90 con 0x7f3680154480 2023-11-15T01:37:01.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.481+0000 7f3688273700 1 -- 172.21.15.1:0/2782487018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368014f4c0 con 0x7f3680154480 2023-11-15T01:37:01.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.481+0000 7f3688273700 1 -- 172.21.15.1:0/2782487018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36800c22a0 con 0x7f3680154480 2023-11-15T01:37:01.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.482+0000 7f3688273700 1 -- 172.21.15.1:0/2782487018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368006c7e0 con 0x7f3680154480 2023-11-15T01:37:01.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.482+0000 7f367e7fc700 1 -- 172.21.15.1:0/2782487018 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 32) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f367001c460 con 0x7f3680154480 2023-11-15T01:37:01.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.482+0000 7f367e7fc700 1 --2- 172.21.15.1:0/2782487018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f366c05f270 0x7f366c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.483+0000 7f367e7fc700 1 -- 172.21.15.1:0/2782487018 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f367007a2e0 con 0x7f3680154480 2023-11-15T01:37:01.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.483+0000 7f368600f700 1 --2- 172.21.15.1:0/2782487018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f366c05f270 0x7f366c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.483+0000 7f368600f700 1 --2- 172.21.15.1:0/2782487018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f366c05f270 0x7f366c061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3678004290 tx=0x7f3678001560).ready entity=mgr.5627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:01.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.487+0000 7f367e7fc700 1 -- 172.21.15.1:0/2782487018 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f367004b220 con 0x7f3680154480 2023-11-15T01:37:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.706+0000 7f3688273700 1 -- 172.21.15.1:0/2782487018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f36800c9a00 con 0x7f3680154480 2023-11-15T01:37:01.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.838+0000 7f367e7fc700 1 -- 172.21.15.1:0/2782487018 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 33) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f3670077d80 con 0x7f3680154480 2023-11-15T01:37:01.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.839+0000 7f367e7fc700 1 -- 172.21.15.1:0/2782487018 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v33) v1 ==== 92+0+0 (secure 0 0 0) 0x7f3670072f70 con 0x7f3680154480 2023-11-15T01:37:01.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.841+0000 7f3688273700 1 -- 172.21.15.1:0/2782487018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f366c05f270 msgr2=0x7f366c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.841+0000 7f3688273700 1 --2- 172.21.15.1:0/2782487018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f366c05f270 0x7f366c061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3678004290 tx=0x7f3678001560).stop 2023-11-15T01:37:01.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.841+0000 7f3688273700 1 -- 172.21.15.1:0/2782487018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3680154480 msgr2=0x7f368014efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.841+0000 7f3688273700 1 --2- 172.21.15.1:0/2782487018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3680154480 0x7f368014efd0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f367000d860 tx=0x7f3670008040).stop 2023-11-15T01:37:01.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.841+0000 7f3688273700 1 -- 172.21.15.1:0/2782487018 shutdown_connections 2023-11-15T01:37:01.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.841+0000 7f3688273700 1 --2- 172.21.15.1:0/2782487018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f366c05f270 0x7f366c061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.841+0000 7f3688273700 1 --2- 172.21.15.1:0/2782487018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3680154480 0x7f368014efd0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.841+0000 7f3688273700 1 --2- 172.21.15.1:0/2782487018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36800c6430 0x7f3680159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.841+0000 7f3688273700 1 --2- 172.21.15.1:0/2782487018 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36801540a0 0x7f3680158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.841+0000 7f3688273700 1 -- 172.21.15.1:0/2782487018 >> 172.21.15.1:0/2782487018 conn(0x7f3680064a70 msgr2=0x7f36800ac6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:01.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.841+0000 7f3688273700 1 -- 172.21.15.1:0/2782487018 shutdown_connections 2023-11-15T01:37:01.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.841+0000 7f3688273700 1 -- 172.21.15.1:0/2782487018 wait complete. 2023-11-15T01:37:01.855 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-15T01:37:01.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.979+0000 7fb20be44700 1 Processor -- start 2023-11-15T01:37:01.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.980+0000 7fb20be44700 1 -- start start 2023-11-15T01:37:01.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.980+0000 7fb20be44700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2041540a0 0x7fb2040ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.980+0000 7fb20be44700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb204154480 0x7fb2040ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.980+0000 7fb20be44700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2040ca050 con 0x7fb2040c5f40 2023-11-15T01:37:01.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.980+0000 7fb20be44700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2040c9440 con 0x7fb204154480 2023-11-15T01:37:01.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.981+0000 7fb20be44700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040c9720 con 0x7fb2041540a0 2023-11-15T01:37:01.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.981+0000 7fb2093df700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb204154480 0x7fb2040ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.981+0000 7fb2093df700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb204154480 0x7fb2040ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53516/0 (socket says 172.21.15.1:53516) 2023-11-15T01:37:01.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.981+0000 7fb2093df700 1 -- 172.21.15.1:0/781851824 learned_addr learned my addr 172.21.15.1:0/781851824 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:01.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.981+0000 7fb209be0700 1 --2- 172.21.15.1:0/781851824 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2041540a0 0x7fb2040ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.981+0000 7fb2093df700 1 -- 172.21.15.1:0/781851824 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2041540a0 msgr2=0x7fb2040ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:01.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.981+0000 7fb2093df700 1 --2- 172.21.15.1:0/781851824 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2041540a0 0x7fb2040ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.981+0000 7fb2093df700 1 -- 172.21.15.1:0/781851824 >> v1:172.21.15.141:6789/0 conn(0x7fb2040c5f40 legacy=0x7fb2040aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.981+0000 7fb2093df700 1 -- 172.21.15.1:0/781851824 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2040c9a00 con 0x7fb204154480 2023-11-15T01:37:01.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.981+0000 7fb2093df700 1 --2- 172.21.15.1:0/781851824 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb204154480 0x7fb2040ca9d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7fb1f8006fd0 tx=0x7fb1f80090f0).ready entity=mon.0 client_cookie=34a16121cb5b331d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:01.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.981+0000 7fb208bde700 1 -- 172.21.15.1:0/781851824 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f800b580 con 0x7fb204154480 2023-11-15T01:37:01.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.981+0000 7fb208bde700 1 -- 172.21.15.1:0/781851824 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f800b6e0 con 0x7fb204154480 2023-11-15T01:37:01.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.981+0000 7fb208bde700 1 -- 172.21.15.1:0/781851824 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f800ba60 con 0x7fb204154480 2023-11-15T01:37:01.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.982+0000 7fb20be44700 1 -- 172.21.15.1:0/781851824 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb204154480 msgr2=0x7fb2040ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.982+0000 7fb20be44700 1 --2- 172.21.15.1:0/781851824 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb204154480 0x7fb2040ca9d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7fb1f8006fd0 tx=0x7fb1f80090f0).stop 2023-11-15T01:37:01.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.982+0000 7fb20be44700 1 -- 172.21.15.1:0/781851824 shutdown_connections 2023-11-15T01:37:01.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.982+0000 7fb20be44700 1 --2- 172.21.15.1:0/781851824 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2041540a0 0x7fb2040ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.982+0000 7fb20be44700 1 --2- 172.21.15.1:0/781851824 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb204154480 0x7fb2040ca9d0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.982+0000 7fb20be44700 1 -- 172.21.15.1:0/781851824 >> 172.21.15.1:0/781851824 conn(0x7fb204064a70 msgr2=0x7fb204064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:01.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.982+0000 7fb20be44700 1 -- 172.21.15.1:0/781851824 shutdown_connections 2023-11-15T01:37:01.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.982+0000 7fb20be44700 1 -- 172.21.15.1:0/781851824 wait complete. 2023-11-15T01:37:01.989 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:01.983+0000 7ff0d912f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:37:01.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.984+0000 7fb20be44700 1 Processor -- start 2023-11-15T01:37:01.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.984+0000 7fb20be44700 1 -- start start 2023-11-15T01:37:01.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.985+0000 7fb20be44700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2040c5f40 0x7fb204153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.985+0000 7fb20be44700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2041540a0 0x7fb204150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.985+0000 7fb20be44700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb204154480 0x7fb2040a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.985+0000 7fb20be44700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040afa20 con 0x7fb2041540a0 2023-11-15T01:37:01.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.985+0000 7fb20be44700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb204151020 con 0x7fb2040c5f40 2023-11-15T01:37:01.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.985+0000 7fb20be44700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040b09c0 con 0x7fb204154480 2023-11-15T01:37:01.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.986+0000 7fb2093df700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2041540a0 0x7fb204150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.986+0000 7fb2093df700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2041540a0 0x7fb204150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53518/0 (socket says 172.21.15.1:53518) 2023-11-15T01:37:01.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.986+0000 7fb2093df700 1 -- 172.21.15.1:0/3493288228 learned_addr learned my addr 172.21.15.1:0/3493288228 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:01.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.986+0000 7fb209be0700 1 --2- 172.21.15.1:0/3493288228 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2040c5f40 0x7fb204153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.986+0000 7fb20a3e1700 1 --2- 172.21.15.1:0/3493288228 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb204154480 0x7fb2040a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:01.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.986+0000 7fb2093df700 1 -- 172.21.15.1:0/3493288228 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb204154480 msgr2=0x7fb2040a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.986+0000 7fb2093df700 1 --2- 172.21.15.1:0/3493288228 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb204154480 0x7fb2040a9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.986+0000 7fb2093df700 1 -- 172.21.15.1:0/3493288228 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2040c5f40 msgr2=0x7fb204153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:01.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.986+0000 7fb2093df700 1 --2- 172.21.15.1:0/3493288228 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2040c5f40 0x7fb204153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:01.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.986+0000 7fb2093df700 1 -- 172.21.15.1:0/3493288228 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f8009370 con 0x7fb2041540a0 2023-11-15T01:37:01.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.986+0000 7fb2093df700 1 --2- 172.21.15.1:0/3493288228 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2041540a0 0x7fb204150860 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fb1f8011000 tx=0x7fb1f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:01.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.986+0000 7fb1f5ffb700 1 -- 172.21.15.1:0/3493288228 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8000bc0 con 0x7fb2041540a0 2023-11-15T01:37:01.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.986+0000 7fb1f5ffb700 1 -- 172.21.15.1:0/3493288228 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f800b850 con 0x7fb2041540a0 2023-11-15T01:37:01.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.986+0000 7fb1f5ffb700 1 -- 172.21.15.1:0/3493288228 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8000d20 con 0x7fb2041540a0 2023-11-15T01:37:01.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.986+0000 7fb20be44700 1 -- 172.21.15.1:0/3493288228 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2040b0530 con 0x7fb2041540a0 2023-11-15T01:37:01.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.987+0000 7fb20be44700 1 -- 172.21.15.1:0/3493288228 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2040afc00 con 0x7fb2041540a0 2023-11-15T01:37:01.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.988+0000 7fb20be44700 1 -- 172.21.15.1:0/3493288228 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2040b06c0 con 0x7fb2041540a0 2023-11-15T01:37:01.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.988+0000 7fb1f5ffb700 1 -- 172.21.15.1:0/3493288228 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 33) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fb1f801cb10 con 0x7fb2041540a0 2023-11-15T01:37:01.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.988+0000 7fb1f5ffb700 1 --2- 172.21.15.1:0/3493288228 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1e805f2c0 0x7fb1e8061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:01.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.989+0000 7fb209be0700 1 -- 172.21.15.1:0/3493288228 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1e805f2c0 msgr2=0x7fb1e8061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:01.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.989+0000 7fb1f5ffb700 1 -- 172.21.15.1:0/3493288228 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fb1f807c2a0 con 0x7fb2041540a0 2023-11-15T01:37:01.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.989+0000 7fb209be0700 1 --2- 172.21.15.1:0/3493288228 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1e805f2c0 0x7fb1e8061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:01.999 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:01.989+0000 7f6004ce5680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:37:01.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:01.992+0000 7fb1f5ffb700 1 -- 172.21.15.1:0/3493288228 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb1f804d240 con 0x7fb2041540a0 2023-11-15T01:37:02.047 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:02.047+0000 7ff0d912f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:37:02.057 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:02.057+0000 7f6004ce5680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:37:02.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.168+0000 7fb20be44700 1 -- 172.21.15.1:0/3493288228 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fb2040c9ce0 con 0x7fb2041540a0 2023-11-15T01:37:02.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.171+0000 7fb1f5ffb700 1 -- 172.21.15.1:0/3493288228 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v15)=0 v15) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb1f802a020 con 0x7fb2041540a0 2023-11-15T01:37:02.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.173+0000 7fb20be44700 1 -- 172.21.15.1:0/3493288228 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1e805f2c0 msgr2=0x7fb1e8061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:02.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.173+0000 7fb20be44700 1 --2- 172.21.15.1:0/3493288228 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1e805f2c0 0x7fb1e8061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:02.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.173+0000 7fb20be44700 1 -- 172.21.15.1:0/3493288228 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2041540a0 msgr2=0x7fb204150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:02.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.173+0000 7fb20be44700 1 --2- 172.21.15.1:0/3493288228 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2041540a0 0x7fb204150860 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fb1f8011000 tx=0x7fb1f8017000).stop 2023-11-15T01:37:02.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.173+0000 7fb20be44700 1 -- 172.21.15.1:0/3493288228 shutdown_connections 2023-11-15T01:37:02.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.173+0000 7fb20be44700 1 --2- 172.21.15.1:0/3493288228 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1e805f2c0 0x7fb1e8061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:02.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.173+0000 7fb20be44700 1 --2- 172.21.15.1:0/3493288228 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb204154480 0x7fb2040a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:02.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.173+0000 7fb20be44700 1 --2- 172.21.15.1:0/3493288228 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2040c5f40 0x7fb204153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:02.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.173+0000 7fb20be44700 1 --2- 172.21.15.1:0/3493288228 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2041540a0 0x7fb204150860 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:02.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.173+0000 7fb20be44700 1 -- 172.21.15.1:0/3493288228 >> 172.21.15.1:0/3493288228 conn(0x7fb204064a70 msgr2=0x7fb2040c43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:02.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.173+0000 7fb20be44700 1 -- 172.21.15.1:0/3493288228 shutdown_connections 2023-11-15T01:37:02.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.173+0000 7fb20be44700 1 -- 172.21.15.1:0/3493288228 wait complete. 2023-11-15T01:37:02.186 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-11-15T01:37:02.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.312+0000 7fc9efbd0700 1 Processor -- start 2023-11-15T01:37:02.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.312+0000 7fc9efbd0700 1 -- start start 2023-11-15T01:37:02.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9efbd0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9e8151f10 0x7fc9e806a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:02.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9efbd0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc9e80c62d0 0x7fc9e80c6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:02.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9efbd0700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e80c0250 con 0x7fc9e8155080 2023-11-15T01:37:02.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9efbd0700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e8154bf0 con 0x7fc9e80c62d0 2023-11-15T01:37:02.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9efbd0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e80c0ee0 con 0x7fc9e8151f10 2023-11-15T01:37:02.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9ed16b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc9e80c62d0 0x7fc9e80c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:02.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9ee16d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc9e8155080 0x7fc9e80c7ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:56312/0 (socket says 172.21.15.1:56312) 2023-11-15T01:37:02.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9ee16d700 1 -- 172.21.15.1:0/3939113987 learned_addr learned my addr 172.21.15.1:0/3939113987 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:02.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9ed96c700 1 --2- 172.21.15.1:0/3939113987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9e8151f10 0x7fc9e806a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:02.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9ed16b700 1 -- 172.21.15.1:0/3939113987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9e8151f10 msgr2=0x7fc9e806a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:02.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9ed16b700 1 --2- 172.21.15.1:0/3939113987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9e8151f10 0x7fc9e806a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:02.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9ed16b700 1 -- 172.21.15.1:0/3939113987 >> v1:172.21.15.1:6789/0 conn(0x7fc9e8155080 legacy=0x7fc9e80c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:02.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9ed16b700 1 -- 172.21.15.1:0/3939113987 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e80c11a0 con 0x7fc9e80c62d0 2023-11-15T01:37:02.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9ec96a700 1 -- 172.21.15.1:0/3939113987 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379025551 0 0) 0x7fc9e80c0250 con 0x7fc9e8155080 2023-11-15T01:37:02.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9ed16b700 1 --2- 172.21.15.1:0/3939113987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e80c62d0 0x7fc9e80c6750 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7fc9d8009760 tx=0x7fc9d8009060).ready entity=mon.0 client_cookie=927ffd24d78b7d83 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:02.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.313+0000 7fc9ec96a700 1 -- 172.21.15.1:0/3939113987 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80090d0 con 0x7fc9e80c62d0 2023-11-15T01:37:02.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.314+0000 7fc9ec96a700 1 -- 172.21.15.1:0/3939113987 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d800f510 con 0x7fc9e80c62d0 2023-11-15T01:37:02.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.314+0000 7fc9ec96a700 1 -- 172.21.15.1:0/3939113987 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d800f890 con 0x7fc9e80c62d0 2023-11-15T01:37:02.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.314+0000 7fc9efbd0700 1 -- 172.21.15.1:0/3939113987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e80c62d0 msgr2=0x7fc9e80c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:02.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.314+0000 7fc9efbd0700 1 --2- 172.21.15.1:0/3939113987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e80c62d0 0x7fc9e80c6750 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7fc9d8009760 tx=0x7fc9d8009060).stop 2023-11-15T01:37:02.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.314+0000 7fc9efbd0700 1 -- 172.21.15.1:0/3939113987 shutdown_connections 2023-11-15T01:37:02.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.314+0000 7fc9efbd0700 1 --2- 172.21.15.1:0/3939113987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9e8151f10 0x7fc9e806a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:02.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.314+0000 7fc9efbd0700 1 --2- 172.21.15.1:0/3939113987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e80c62d0 0x7fc9e80c6750 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:02.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.314+0000 7fc9efbd0700 1 -- 172.21.15.1:0/3939113987 >> 172.21.15.1:0/3939113987 conn(0x7fc9e8084ea0 msgr2=0x7fc9e80947c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:02.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.315+0000 7fc9efbd0700 1 -- 172.21.15.1:0/3939113987 shutdown_connections 2023-11-15T01:37:02.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.315+0000 7fc9efbd0700 1 -- 172.21.15.1:0/3939113987 wait complete. 2023-11-15T01:37:02.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.316+0000 7fc9efbd0700 1 Processor -- start 2023-11-15T01:37:02.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.316+0000 7fc9efbd0700 1 -- start start 2023-11-15T01:37:02.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9efbd0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9e80c62d0 0x7fc9e80ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:02.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9efbd0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9e8151f10 0x7fc9e814ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:02.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9efbd0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e8155080 0x7fc9e814f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:02.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9efbd0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e814fcf0 con 0x7fc9e8155080 2023-11-15T01:37:02.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9efbd0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e814ffd0 con 0x7fc9e8151f10 2023-11-15T01:37:02.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9efbd0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e81502b0 con 0x7fc9e80c62d0 2023-11-15T01:37:02.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9ee16d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e8155080 0x7fc9e814f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:02.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9ed96c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9e80c62d0 0x7fc9e80ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:02.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9ee16d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e8155080 0x7fc9e814f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53530/0 (socket says 172.21.15.1:53530) 2023-11-15T01:37:02.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9ee16d700 1 -- 172.21.15.1:0/530179661 learned_addr learned my addr 172.21.15.1:0/530179661 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:02.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9ed16b700 1 --2- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9e8151f10 0x7fc9e814ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9ed96c700 1 -- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9e8151f10 msgr2=0x7fc9e814ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9ed96c700 1 --2- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9e8151f10 0x7fc9e814ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9ed96c700 1 -- 172.21.15.1:0/530179661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e8155080 msgr2=0x7fc9e814f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9ed96c700 1 --2- 172.21.15.1:0/530179661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e8155080 0x7fc9e814f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9ed96c700 1 -- 172.21.15.1:0/530179661 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d80092a0 con 0x7fc9e80c62d0 2023-11-15T01:37:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9ee16d700 1 --2- 172.21.15.1:0/530179661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e8155080 0x7fc9e814f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9ed96c700 1 --2- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc9e80c62d0 0x7fc9e80ca690 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fc9e400e6d0 tx=0x7fc9e4009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9ddffb700 1 -- 172.21.15.1:0/530179661 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4012600 con 0x7fc9e80c62d0 2023-11-15T01:37:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9ddffb700 1 -- 172.21.15.1:0/530179661 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e4012760 con 0x7fc9e80c62d0 2023-11-15T01:37:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.317+0000 7fc9efbd0700 1 -- 172.21.15.1:0/530179661 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e8150590 con 0x7fc9e80c62d0 2023-11-15T01:37:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.318+0000 7fc9ddffb700 1 -- 172.21.15.1:0/530179661 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4012ae0 con 0x7fc9e80c62d0 2023-11-15T01:37:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.318+0000 7fc9efbd0700 1 -- 172.21.15.1:0/530179661 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e80cab80 con 0x7fc9e80c62d0 2023-11-15T01:37:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.319+0000 7fc9efbd0700 1 -- 172.21.15.1:0/530179661 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e8150ab0 con 0x7fc9e80c62d0 2023-11-15T01:37:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.319+0000 7fc9ddffb700 1 -- 172.21.15.1:0/530179661 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 33) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fc9e401b400 con 0x7fc9e80c62d0 2023-11-15T01:37:02.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.319+0000 7fc9ddffb700 1 --2- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 0x7fc9cc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:02.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.320+0000 7fc9ddffb700 1 -- 172.21.15.1:0/530179661 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fc9e407a820 con 0x7fc9e80c62d0 2023-11-15T01:37:02.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.320+0000 7fc9ed16b700 1 -- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 msgr2=0x7fc9cc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:02.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.320+0000 7fc9ed16b700 1 --2- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 0x7fc9cc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:02.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.324+0000 7fc9ddffb700 1 -- 172.21.15.1:0/530179661 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc9e8150ab0 con 0x7fc9e80c62d0 2023-11-15T01:37:02.332 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:02.323+0000 7ff0d912f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:37:02.356 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:02.356+0000 7f6004ce5680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:37:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.521+0000 7fc9ed16b700 1 -- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 msgr2=0x7fc9cc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.521+0000 7fc9ed16b700 1 --2- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 0x7fc9cc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:37:02.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.524+0000 7fc9efbd0700 1 -- 172.21.15.1:0/530179661 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9e8150ab0 con 0x7fc9cc05f2c0 2023-11-15T01:37:02.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.922+0000 7fc9ed16b700 1 -- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 msgr2=0x7fc9cc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:02.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:02.922+0000 7fc9ed16b700 1 --2- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 0x7fc9cc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-15T01:37:02.935 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:02.934+0000 7ff0d912f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:37:03.007 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:03.006+0000 7ff0d912f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:37:03.027 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:03.027+0000 7f6004ce5680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:37:03.097 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:03.097+0000 7f6004ce5680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:37:03.193 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:03.193+0000 7ff0d912f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:37:03.293 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:03.292+0000 7f6004ce5680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:37:03.611 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:03.611+0000 7ff0d912f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:37:03.714 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:03.713+0000 7ff0d912f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:37:03.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:03.723+0000 7fc9ed16b700 1 -- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 msgr2=0x7fc9cc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:03.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:03.723+0000 7fc9ed16b700 1 --2- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 0x7fc9cc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-15T01:37:03.737 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:03.736+0000 7f6004ce5680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:37:03.846 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:03.846+0000 7f6004ce5680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:37:03.868 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:03.867+0000 7ff0d912f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:37:03.942 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:03.941+0000 7ff0d912f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:37:04.006 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:04.006+0000 7f6004ce5680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:37:04.008 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:04.008+0000 7ff0d912f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:37:04.085 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:04.084+0000 7f6004ce5680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:37:04.156 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:04.155+0000 7f6004ce5680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:37:04.265 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:04.264+0000 7ff0d912f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:37:04.432 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:04.431+0000 7f6004ce5680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:37:04.448 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:04.447+0000 7ff0d912f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:37:04.624 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:04.624+0000 7f6004ce5680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:37:05.095 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:05.094+0000 7ff0d912f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:37:05.163 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:05.162+0000 7ff0d912f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:37:05.238 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:05.237+0000 7ff0d912f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:37:05.316 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:05.316+0000 7f6004ce5680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:37:05.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:05.324+0000 7fc9ed16b700 1 -- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 msgr2=0x7fc9cc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:05.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:05.324+0000 7fc9ed16b700 1 --2- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 0x7fc9cc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-15T01:37:05.384 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:05.383+0000 7ff0d912f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:37:05.388 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:05.388+0000 7f6004ce5680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:37:05.454 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:05.453+0000 7ff0d912f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:37:05.467 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:05.467+0000 7f6004ce5680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:37:05.569 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:05.568+0000 7ff0d912f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:37:05.623 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:05.622+0000 7f6004ce5680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:37:05.676 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:05.676+0000 7ff0d912f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:37:05.696 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:05.696+0000 7f6004ce5680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:37:05.818 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:05.818+0000 7f6004ce5680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:37:05.933 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:05.932+0000 7f6004ce5680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:37:05.966 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:05.966+0000 7ff0d912f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:37:06.037 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:06.037+0000 7ff0d912f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:37:06.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:06.060+0000 7fc9ddffb700 1 -- 172.21.15.1:0/530179661 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mgrmap(e 34) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fc9e40782c0 con 0x7fc9e80c62d0 2023-11-15T01:37:06.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:06.060+0000 7fc9ddffb700 1 -- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 msgr2=0x7fc9cc061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:06.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:06.060+0000 7fc9ddffb700 1 --2- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 0x7fc9cc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:06.123 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:06.122+0000 7ff04d8b4700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:06.123 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:06.122+0000 7ff04d8b4700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:06.123 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:06.122+0000 7ff04d8b4700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:06.123 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:06.122+0000 7ff04d8b4700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:06.124 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:06.122+0000 7ff04d8b4700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:06.124 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:06.122+0000 7ff0508ba700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:06.124 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:06.122+0000 7ff0508ba700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:06.124 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:06.122+0000 7ff0508ba700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:06.124 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:06.122+0000 7ff0508ba700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:06.124 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:06.122+0000 7ff0508ba700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:06.242 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:06.241+0000 7f6004ce5680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:37:06.317 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:06.316+0000 7f6004ce5680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:37:07.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.062+0000 7fc9ddffb700 1 -- 172.21.15.1:0/530179661 <== mon.2 v2:172.21.15.141:3301/0 8 ==== mgrmap(e 35) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fc9e4078640 con 0x7fc9e80c62d0 2023-11-15T01:37:07.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.063+0000 7fc9ddffb700 1 --2- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 0x7fc9cc061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:07.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.063+0000 7fc9ddffb700 1 -- 172.21.15.1:0/530179661 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9e8150ab0 con 0x7fc9cc05f2c0 2023-11-15T01:37:07.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.064+0000 7fc9ed16b700 1 --2- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 0x7fc9cc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:07.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.065+0000 7fc9ed16b700 1 --2- 172.21.15.1:0/530179661 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc9cc05f2c0 0x7fc9cc061700 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc9d8009760 tx=0x7fc9d8017000).ready entity=mgr.5843 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:07.067 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:07.066+0000 7ff0580c9700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-11-15T01:37:07.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.067+0000 7fc9ddffb700 1 -- 172.21.15.1:0/530179661 <== mgr.5843 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fc9e8150ab0 con 0x7fc9cc05f2c0 2023-11-15T01:37:07.068 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-11-15T01:37:07.072 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-11-15T01:37:07.073 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-15T01:37:07.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.199+0000 7f647fd3b700 1 Processor -- start 2023-11-15T01:37:07.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.200+0000 7f647fd3b700 1 -- start start 2023-11-15T01:37:07.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.200+0000 7f647fd3b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f64780c6650 0x7f64780aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:07.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.200+0000 7f647fd3b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64780ca050 con 0x7f64781540a0 2023-11-15T01:37:07.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.200+0000 7f647fd3b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64780c9440 con 0x7f6478154480 2023-11-15T01:37:07.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.200+0000 7f647fd3b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64780c9720 con 0x7f64780c6650 2023-11-15T01:37:07.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.201+0000 7f647e2d8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f64780c6650 0x7f64780aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:07.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.201+0000 7f647dad7700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f64781540a0 0x7f64780ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:56316/0 (socket says 172.21.15.1:56316) 2023-11-15T01:37:07.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.201+0000 7f647dad7700 1 -- 172.21.15.1:0/3295958207 learned_addr learned my addr 172.21.15.1:0/3295958207 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:07.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.201+0000 7f647e2d8700 1 -- 172.21.15.1:0/3295958207 >> v1:172.21.15.141:6789/0 conn(0x7f6478154480 legacy=0x7f64780c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:07.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.201+0000 7f647e2d8700 1 -- 172.21.15.1:0/3295958207 >> v1:172.21.15.1:6789/0 conn(0x7f64781540a0 legacy=0x7f64780ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:07.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.201+0000 7f647cad5700 1 -- 172.21.15.1:0/3295958207 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290266812 0 0) 0x7f64780ca050 con 0x7f64781540a0 2023-11-15T01:37:07.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.201+0000 7f647e2d8700 1 -- 172.21.15.1:0/3295958207 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64780c9a00 con 0x7f64780c6650 2023-11-15T01:37:07.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.201+0000 7f647e2d8700 1 --2- 172.21.15.1:0/3295958207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64780c6650 0x7f64780aaf40 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f6468009e60 tx=0x7f6468009780).ready entity=mon.0 client_cookie=740099a256cc4fb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:07.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.201+0000 7f647cad5700 1 -- 172.21.15.1:0/3295958207 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646800e070 con 0x7f64780c6650 2023-11-15T01:37:07.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.201+0000 7f647cad5700 1 -- 172.21.15.1:0/3295958207 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646800bc30 con 0x7f64780c6650 2023-11-15T01:37:07.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.201+0000 7f647cad5700 1 -- 172.21.15.1:0/3295958207 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468012410 con 0x7f64780c6650 2023-11-15T01:37:07.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.202+0000 7f647fd3b700 1 -- 172.21.15.1:0/3295958207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64780c6650 msgr2=0x7f64780aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:07.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.202+0000 7f647fd3b700 1 --2- 172.21.15.1:0/3295958207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64780c6650 0x7f64780aaf40 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f6468009e60 tx=0x7f6468009780).stop 2023-11-15T01:37:07.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.202+0000 7f647fd3b700 1 -- 172.21.15.1:0/3295958207 shutdown_connections 2023-11-15T01:37:07.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.202+0000 7f647fd3b700 1 --2- 172.21.15.1:0/3295958207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64780c6650 0x7f64780aaf40 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:07.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.202+0000 7f647fd3b700 1 -- 172.21.15.1:0/3295958207 >> 172.21.15.1:0/3295958207 conn(0x7f6478064a70 msgr2=0x7f6478064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:07.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.202+0000 7f647fd3b700 1 -- 172.21.15.1:0/3295958207 shutdown_connections 2023-11-15T01:37:07.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.202+0000 7f647fd3b700 1 -- 172.21.15.1:0/3295958207 wait complete. 2023-11-15T01:37:07.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.203+0000 7f647fd3b700 1 Processor -- start 2023-11-15T01:37:07.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.203+0000 7f647fd3b700 1 -- start start 2023-11-15T01:37:07.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647fd3b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64780c6650 0x7f64780b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:07.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647fd3b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64781540a0 0x7f6478150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:07.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647fd3b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6478154480 0x7f6478150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:07.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647fd3b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6478150f70 con 0x7f64780c6650 2023-11-15T01:37:07.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647fd3b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64780c2680 con 0x7f6478154480 2023-11-15T01:37:07.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647fd3b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64780c3200 con 0x7f64781540a0 2023-11-15T01:37:07.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647dad7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64780c6650 0x7f64780b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:07.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647dad7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64780c6650 0x7f64780b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53548/0 (socket says 172.21.15.1:53548) 2023-11-15T01:37:07.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647dad7700 1 -- 172.21.15.1:0/3452121181 learned_addr learned my addr 172.21.15.1:0/3452121181 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:07.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647e2d8700 1 --2- 172.21.15.1:0/3452121181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6478154480 0x7f6478150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:07.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647d2d6700 1 --2- 172.21.15.1:0/3452121181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64781540a0 0x7f6478150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:07.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647dad7700 1 -- 172.21.15.1:0/3452121181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64781540a0 msgr2=0x7f6478150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:07.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647dad7700 1 --2- 172.21.15.1:0/3452121181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64781540a0 0x7f6478150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:07.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647dad7700 1 -- 172.21.15.1:0/3452121181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6478154480 msgr2=0x7f6478150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:07.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647dad7700 1 --2- 172.21.15.1:0/3452121181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6478154480 0x7f6478150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:07.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647dad7700 1 -- 172.21.15.1:0/3452121181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6468009a20 con 0x7f64780c6650 2023-11-15T01:37:07.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647dad7700 1 --2- 172.21.15.1:0/3452121181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64780c6650 0x7f64780b0790 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f647000c4c0 tx=0x7f6470007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:07.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f6475ffb700 1 -- 172.21.15.1:0/3452121181 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647000ce30 con 0x7f64780c6650 2023-11-15T01:37:07.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f6475ffb700 1 -- 172.21.15.1:0/3452121181 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64700072e0 con 0x7f64780c6650 2023-11-15T01:37:07.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f6475ffb700 1 -- 172.21.15.1:0/3452121181 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64700057a0 con 0x7f64780c6650 2023-11-15T01:37:07.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.204+0000 7f647fd3b700 1 -- 172.21.15.1:0/3452121181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64780c28d0 con 0x7f64780c6650 2023-11-15T01:37:07.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.205+0000 7f647fd3b700 1 -- 172.21.15.1:0/3452121181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64780c2e90 con 0x7f64780c6650 2023-11-15T01:37:07.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.206+0000 7f647fd3b700 1 -- 172.21.15.1:0/3452121181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647806c7e0 con 0x7f64780c6650 2023-11-15T01:37:07.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.206+0000 7f6475ffb700 1 -- 172.21.15.1:0/3452121181 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 35) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f6470005bd0 con 0x7f64780c6650 2023-11-15T01:37:07.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.206+0000 7f6475ffb700 1 --2- 172.21.15.1:0/3452121181 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f646405f080 0x7f6464061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:07.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.206+0000 7f6475ffb700 1 -- 172.21.15.1:0/3452121181 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f6470079970 con 0x7f64780c6650 2023-11-15T01:37:07.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.206+0000 7f647d2d6700 1 --2- 172.21.15.1:0/3452121181 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f646405f080 0x7f6464061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:07.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.207+0000 7f647d2d6700 1 --2- 172.21.15.1:0/3452121181 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f646405f080 0x7f6464061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f647815ab10 tx=0x7f646c007d40).ready entity=mgr.5843 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:07.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.210+0000 7f6475ffb700 1 -- 172.21.15.1:0/3452121181 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f647004ab60 con 0x7f64780c6650 2023-11-15T01:37:07.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:07.429+0000 7f647fd3b700 1 -- 172.21.15.1:0/3452121181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f64780c9ce0 con 0x7f64780c6650 2023-11-15T01:37:08.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.113+0000 7f6475ffb700 1 -- 172.21.15.1:0/3452121181 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 36) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f6470077660 con 0x7f64780c6650 2023-11-15T01:37:08.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.114+0000 7f6475ffb700 1 -- 172.21.15.1:0/3452121181 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v36) v1 ==== 93+0+0 (secure 0 0 0) 0x7f6470073440 con 0x7f64780c6650 2023-11-15T01:37:08.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.118+0000 7f647fd3b700 1 -- 172.21.15.1:0/3452121181 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f646405f080 msgr2=0x7f6464061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:08.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.118+0000 7f647fd3b700 1 --2- 172.21.15.1:0/3452121181 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f646405f080 0x7f6464061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f647815ab10 tx=0x7f646c007d40).stop 2023-11-15T01:37:08.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.118+0000 7f647fd3b700 1 -- 172.21.15.1:0/3452121181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64780c6650 msgr2=0x7f64780b0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:08.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.118+0000 7f647fd3b700 1 --2- 172.21.15.1:0/3452121181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64780c6650 0x7f64780b0790 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f647000c4c0 tx=0x7f6470007c10).stop 2023-11-15T01:37:08.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.118+0000 7f647fd3b700 1 -- 172.21.15.1:0/3452121181 shutdown_connections 2023-11-15T01:37:08.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.118+0000 7f647fd3b700 1 --2- 172.21.15.1:0/3452121181 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f646405f080 0x7f6464061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:08.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.118+0000 7f647fd3b700 1 --2- 172.21.15.1:0/3452121181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6478154480 0x7f6478150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:08.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.118+0000 7f647fd3b700 1 --2- 172.21.15.1:0/3452121181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64780c6650 0x7f64780b0790 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:08.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.118+0000 7f647fd3b700 1 --2- 172.21.15.1:0/3452121181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64781540a0 0x7f6478150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:08.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.118+0000 7f647fd3b700 1 -- 172.21.15.1:0/3452121181 >> 172.21.15.1:0/3452121181 conn(0x7f6478064a70 msgr2=0x7f64780c1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:08.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.118+0000 7f647fd3b700 1 -- 172.21.15.1:0/3452121181 shutdown_connections 2023-11-15T01:37:08.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.118+0000 7f647fd3b700 1 -- 172.21.15.1:0/3452121181 wait complete. 2023-11-15T01:37:08.137 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T01:37:08.137 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:37:08.176 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:37:08.216 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T01:37:08.217 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-15T01:37:08.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:37:08.217 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-15T01:37:08.257 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:08.257+0000 7f5292392680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:37:08.268 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:08.268+0000 7f73c5b6f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:37:08.271 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T01:37:08.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:08.272 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-15T01:37:08.287 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:37:08.319 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:08.319+0000 7f5292392680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:37:08.336 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:08.336+0000 7f73c5b6f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:37:08.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.447+0000 7f457a11a700 1 Processor -- start 2023-11-15T01:37:08.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.447+0000 7f457a11a700 1 -- start start 2023-11-15T01:37:08.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f457a11a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f45740833a0 0x7f45740a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:08.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f457a11a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f45740be520 0x7f4574154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:08.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f457a11a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45740a85e0 con 0x7f4574154450 2023-11-15T01:37:08.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f457a11a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4574065940 con 0x7f45740be520 2023-11-15T01:37:08.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f457a11a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4574065660 con 0x7f45740833a0 2023-11-15T01:37:08.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f4573fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f45740be520 0x7f4574154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:08.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f45737fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4574154450 0x7f45740bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42256/0 (socket says 172.21.15.1:42256) 2023-11-15T01:37:08.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f4573fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f45740be520 0x7f4574154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40620/0 (socket says 172.21.15.1:40620) 2023-11-15T01:37:08.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f45737fe700 1 -- 172.21.15.1:0/469480285 learned_addr learned my addr 172.21.15.1:0/469480285 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:08.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f4572ffd700 1 --2- 172.21.15.1:0/469480285 >> v2:172.21.15.141:3300/0 conn(0x7f45740833a0 0x7f45740a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:08.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f4573fff700 1 -- 172.21.15.1:0/469480285 >> v2:172.21.15.141:3300/0 conn(0x7f45740833a0 msgr2=0x7f45740a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:08.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f4573fff700 1 --2- 172.21.15.1:0/469480285 >> v2:172.21.15.141:3300/0 conn(0x7f45740833a0 0x7f45740a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:08.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f4573fff700 1 -- 172.21.15.1:0/469480285 >> v1:172.21.15.1:6789/0 conn(0x7f4574154450 legacy=0x7f45740bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:08.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f45727fc700 1 -- 172.21.15.1:0/469480285 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279005880 0 0) 0x7f45740a85e0 con 0x7f4574154450 2023-11-15T01:37:08.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f4573fff700 1 -- 172.21.15.1:0/469480285 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45740c6f50 con 0x7f45740be520 2023-11-15T01:37:08.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f4573fff700 1 --2- 172.21.15.1:0/469480285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45740be520 0x7f4574154830 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f4574158220 tx=0x7f456c009060).ready entity=mon.0 client_cookie=6bf3063d1072bb9b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:08.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f45727fc700 1 -- 172.21.15.1:0/469480285 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c00f510 con 0x7f45740be520 2023-11-15T01:37:08.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.448+0000 7f45727fc700 1 -- 172.21.15.1:0/469480285 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c00f670 con 0x7f45740be520 2023-11-15T01:37:08.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.449+0000 7f45727fc700 1 -- 172.21.15.1:0/469480285 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c00f9f0 con 0x7f45740be520 2023-11-15T01:37:08.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.449+0000 7f457a11a700 1 -- 172.21.15.1:0/469480285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45740be520 msgr2=0x7f4574154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:08.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.449+0000 7f457a11a700 1 --2- 172.21.15.1:0/469480285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45740be520 0x7f4574154830 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f4574158220 tx=0x7f456c009060).stop 2023-11-15T01:37:08.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.449+0000 7f457a11a700 1 -- 172.21.15.1:0/469480285 shutdown_connections 2023-11-15T01:37:08.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.449+0000 7f457a11a700 1 --2- 172.21.15.1:0/469480285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45740be520 0x7f4574154830 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:08.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.449+0000 7f457a11a700 1 --2- 172.21.15.1:0/469480285 >> v2:172.21.15.141:3300/0 conn(0x7f45740833a0 0x7f45740a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:08.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.449+0000 7f457a11a700 1 -- 172.21.15.1:0/469480285 >> 172.21.15.1:0/469480285 conn(0x7f4574082f90 msgr2=0x7f45740c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:08.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.449+0000 7f457a11a700 1 -- 172.21.15.1:0/469480285 shutdown_connections 2023-11-15T01:37:08.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.449+0000 7f457a11a700 1 -- 172.21.15.1:0/469480285 wait complete. 2023-11-15T01:37:08.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.450+0000 7f457a11a700 1 Processor -- start 2023-11-15T01:37:08.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.450+0000 7f457a11a700 1 -- start start 2023-11-15T01:37:08.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.451+0000 7f457a11a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45740833a0 0x7f457415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:08.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.451+0000 7f457a11a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45740be520 0x7f4574158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:08.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.451+0000 7f457a11a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4574154450 0x7f4574150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:08.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.451+0000 7f457a11a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4574163cb0 con 0x7f45740833a0 2023-11-15T01:37:08.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.451+0000 7f457a11a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4574167750 con 0x7f45740be520 2023-11-15T01:37:08.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.451+0000 7f457a11a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4574167a30 con 0x7f4574154450 2023-11-15T01:37:08.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.451+0000 7f45737fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45740833a0 0x7f457415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:08.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.451+0000 7f45737fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45740833a0 0x7f457415a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40634/0 (socket says 172.21.15.1:40634) 2023-11-15T01:37:08.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.451+0000 7f45737fe700 1 -- 172.21.15.1:0/3174000366 learned_addr learned my addr 172.21.15.1:0/3174000366 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:08.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.451+0000 7f4572ffd700 1 --2- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45740be520 0x7f4574158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:08.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.451+0000 7f4573fff700 1 --2- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4574154450 0x7f4574150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:08.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.452+0000 7f45737fe700 1 -- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4574154450 msgr2=0x7f4574150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:08.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.452+0000 7f45737fe700 1 --2- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4574154450 0x7f4574150740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:08.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.452+0000 7f45737fe700 1 -- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45740be520 msgr2=0x7f4574158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:08.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.452+0000 7f45737fe700 1 --2- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45740be520 0x7f4574158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:08.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.452+0000 7f45737fe700 1 -- 172.21.15.1:0/3174000366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c0092a0 con 0x7f45740833a0 2023-11-15T01:37:08.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.452+0000 7f45737fe700 1 --2- 172.21.15.1:0/3174000366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45740833a0 0x7f457415a1c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f456400c810 tx=0x7f4564001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:08.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.452+0000 7f456b7fe700 1 -- 172.21.15.1:0/3174000366 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564005c00 con 0x7f45740833a0 2023-11-15T01:37:08.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.452+0000 7f456b7fe700 1 -- 172.21.15.1:0/3174000366 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4564005d60 con 0x7f45740833a0 2023-11-15T01:37:08.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.452+0000 7f457a11a700 1 -- 172.21.15.1:0/3174000366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4574167d10 con 0x7f45740833a0 2023-11-15T01:37:08.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.452+0000 7f456b7fe700 1 -- 172.21.15.1:0/3174000366 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564007320 con 0x7f45740833a0 2023-11-15T01:37:08.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.452+0000 7f457a11a700 1 -- 172.21.15.1:0/3174000366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4574158740 con 0x7f45740833a0 2023-11-15T01:37:08.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.453+0000 7f457a11a700 1 -- 172.21.15.1:0/3174000366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f457406c7e0 con 0x7f45740833a0 2023-11-15T01:37:08.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.454+0000 7f456b7fe700 1 -- 172.21.15.1:0/3174000366 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 36) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f4564007710 con 0x7f45740833a0 2023-11-15T01:37:08.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.454+0000 7f456b7fe700 1 --2- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f455405f300 0x7f45540617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:08.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.454+0000 7f456b7fe700 1 -- 172.21.15.1:0/3174000366 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f456407a6c0 con 0x7f45740833a0 2023-11-15T01:37:08.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.454+0000 7f4572ffd700 1 -- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f455405f300 msgr2=0x7f45540617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:08.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.454+0000 7f4572ffd700 1 --2- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f455405f300 0x7f45540617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:08.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.459+0000 7f456b7fe700 1 -- 172.21.15.1:0/3174000366 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f456404b4e0 con 0x7f45740833a0 2023-11-15T01:37:08.593 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:08.592+0000 7f5292392680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:37:08.629 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:08.629+0000 7f73c5b6f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:37:08.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.655+0000 7f4572ffd700 1 -- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f455405f300 msgr2=0x7f45540617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:08.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.655+0000 7f4572ffd700 1 --2- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f455405f300 0x7f45540617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:37:08.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.674+0000 7f457a11a700 1 -- 172.21.15.1:0/3174000366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4574065350 con 0x7f45740833a0 2023-11-15T01:37:08.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.674+0000 7f456b7fe700 1 -- 172.21.15.1:0/3174000366 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f456404eb00 con 0x7f45740833a0 2023-11-15T01:37:08.675 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:08.675 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2863729575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2863729575},{"type":"v1","addr":"172.21.15.141:6836","nonce":2863729575}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/4111210566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":4111210566},{"type":"v1","addr":"172.21.15.141:6837","nonce":4111210566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6696,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/4099031019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4099031019},{"type":"v1","addr":"172.21.15.1:6834","nonce":4099031019}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:36:54.262333+0000","modified":"2023-11-15T01:36:57.273246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6699":{"gid":6699,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/1737301018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1737301018},{"type":"v1","addr":"172.21.15.1:6835","nonce":1737301018}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-11-15T01:37:08.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.676+0000 7f457a11a700 1 -- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f455405f300 msgr2=0x7f45540617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:08.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.676+0000 7f457a11a700 1 --2- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f455405f300 0x7f45540617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:08.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.676+0000 7f457a11a700 1 -- 172.21.15.1:0/3174000366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45740833a0 msgr2=0x7f457415a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:08.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.676+0000 7f457a11a700 1 --2- 172.21.15.1:0/3174000366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45740833a0 0x7f457415a1c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f456400c810 tx=0x7f4564001570).stop 2023-11-15T01:37:08.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.676+0000 7f457a11a700 1 -- 172.21.15.1:0/3174000366 shutdown_connections 2023-11-15T01:37:08.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.676+0000 7f457a11a700 1 --2- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f455405f300 0x7f45540617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:08.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.676+0000 7f457a11a700 1 --2- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4574154450 0x7f4574150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:08.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.676+0000 7f457a11a700 1 --2- 172.21.15.1:0/3174000366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45740833a0 0x7f457415a1c0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:08.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.676+0000 7f457a11a700 1 --2- 172.21.15.1:0/3174000366 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45740be520 0x7f4574158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:08.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.676+0000 7f457a11a700 1 -- 172.21.15.1:0/3174000366 >> 172.21.15.1:0/3174000366 conn(0x7f4574082f90 msgr2=0x7f45740bf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:08.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.676+0000 7f457a11a700 1 -- 172.21.15.1:0/3174000366 shutdown_connections 2023-11-15T01:37:08.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.676+0000 7f457a11a700 1 -- 172.21.15.1:0/3174000366 wait complete. 2023-11-15T01:37:08.680 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 39 2023-11-15T01:37:08.690 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:37:08.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.848+0000 7f624675a700 1 Processor -- start 2023-11-15T01:37:08.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.849+0000 7f624675a700 1 -- start start 2023-11-15T01:37:08.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.849+0000 7f624675a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6240158000 0x7f6240154560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:08.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.849+0000 7f624675a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6240064e80 con 0x7f62400aa640 2023-11-15T01:37:08.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.849+0000 7f624675a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62401585e0 con 0x7f6240154180 2023-11-15T01:37:08.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.849+0000 7f624675a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62401588c0 con 0x7f6240158000 2023-11-15T01:37:08.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.850+0000 7f6244cf7700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f62400aa640 0x7f62400c1b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42260/0 (socket says 172.21.15.1:42260) 2023-11-15T01:37:08.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.850+0000 7f6244cf7700 1 -- 172.21.15.1:0/3491189463 learned_addr learned my addr 172.21.15.1:0/3491189463 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:08.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.850+0000 7f623f7fe700 1 --2- 172.21.15.1:0/3491189463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6240158000 0x7f6240154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:08.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.850+0000 7f623effd700 1 -- 172.21.15.1:0/3491189463 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500051532 0 0) 0x7f6240064e80 con 0x7f62400aa640 2023-11-15T01:37:08.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.850+0000 7f623effd700 1 -- 172.21.15.1:0/3491189463 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62280033f0 con 0x7f62400aa640 2023-11-15T01:37:08.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.850+0000 7f623effd700 1 -- 172.21.15.1:0/3491189463 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353131291 0 0) 0x7f62401585e0 con 0x7f6240154180 2023-11-15T01:37:08.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.850+0000 7f623effd700 1 -- 172.21.15.1:0/3491189463 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6240064e80 con 0x7f6240154180 2023-11-15T01:37:08.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.850+0000 7f623f7fe700 1 -- 172.21.15.1:0/3491189463 >> v1:172.21.15.141:6789/0 conn(0x7f6240154180 legacy=0x7f6240063bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:08.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.850+0000 7f623f7fe700 1 -- 172.21.15.1:0/3491189463 >> v1:172.21.15.1:6789/0 conn(0x7f62400aa640 legacy=0x7f62400c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:08.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.850+0000 7f623f7fe700 1 -- 172.21.15.1:0/3491189463 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6240158ba0 con 0x7f6240158000 2023-11-15T01:37:08.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.850+0000 7f623f7fe700 1 --2- 172.21.15.1:0/3491189463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6240158000 0x7f6240154560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f62300097c0 tx=0x7f6230009060).ready entity=mon.2 client_cookie=92570552d4e364a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:08.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.850+0000 7f623effd700 1 -- 172.21.15.1:0/3491189463 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62300090d0 con 0x7f6240158000 2023-11-15T01:37:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.850+0000 7f623effd700 1 -- 172.21.15.1:0/3491189463 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623000d4a0 con 0x7f6240158000 2023-11-15T01:37:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.850+0000 7f623effd700 1 -- 172.21.15.1:0/3491189463 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623000d820 con 0x7f6240158000 2023-11-15T01:37:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.851+0000 7f624675a700 1 -- 172.21.15.1:0/3491189463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6240158000 msgr2=0x7f6240154560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.851+0000 7f624675a700 1 --2- 172.21.15.1:0/3491189463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6240158000 0x7f6240154560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f62300097c0 tx=0x7f6230009060).stop 2023-11-15T01:37:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.851+0000 7f624675a700 1 -- 172.21.15.1:0/3491189463 shutdown_connections 2023-11-15T01:37:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.851+0000 7f624675a700 1 --2- 172.21.15.1:0/3491189463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6240158000 0x7f6240154560 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.851+0000 7f624675a700 1 -- 172.21.15.1:0/3491189463 >> 172.21.15.1:0/3491189463 conn(0x7f62400c74f0 msgr2=0x7f62400c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.851+0000 7f624675a700 1 -- 172.21.15.1:0/3491189463 shutdown_connections 2023-11-15T01:37:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.851+0000 7f624675a700 1 -- 172.21.15.1:0/3491189463 wait complete. 2023-11-15T01:37:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.852+0000 7f624675a700 1 Processor -- start 2023-11-15T01:37:08.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.852+0000 7f624675a700 1 -- start start 2023-11-15T01:37:08.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.853+0000 7f624675a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62400aa640 0x7f62400a7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.853+0000 7f624675a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6240154180 0x7f62400a6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.853+0000 7f624675a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6240158000 0x7f624013f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.853+0000 7f624675a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400a62e0 con 0x7f6240158000 2023-11-15T01:37:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.853+0000 7f624675a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400a56d0 con 0x7f6240154180 2023-11-15T01:37:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.853+0000 7f624675a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400a59b0 con 0x7f62400aa640 2023-11-15T01:37:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.853+0000 7f6244cf7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6240158000 0x7f624013f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.853+0000 7f623f7fe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6240154180 0x7f62400a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.853+0000 7f623f7fe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6240154180 0x7f62400a6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:49890/0 (socket says 172.21.15.1:49890) 2023-11-15T01:37:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.853+0000 7f623ffff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62400aa640 0x7f62400a7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.853+0000 7f623f7fe700 1 -- 172.21.15.1:0/3173909565 learned_addr learned my addr 172.21.15.1:0/3173909565 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.853+0000 7f6244cf7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6240158000 0x7f624013f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40640/0 (socket says 172.21.15.1:40640) 2023-11-15T01:37:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.854+0000 7f623f7fe700 1 -- 172.21.15.1:0/3173909565 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62400aa640 msgr2=0x7f62400a7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.854+0000 7f623f7fe700 1 --2- 172.21.15.1:0/3173909565 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62400aa640 0x7f62400a7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.854+0000 7f623f7fe700 1 -- 172.21.15.1:0/3173909565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6240158000 msgr2=0x7f624013f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.854+0000 7f623f7fe700 1 --2- 172.21.15.1:0/3173909565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6240158000 0x7f624013f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:08.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.854+0000 7f623f7fe700 1 -- 172.21.15.1:0/3173909565 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62300092a0 con 0x7f6240154180 2023-11-15T01:37:08.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.854+0000 7f6244cf7700 1 --2- 172.21.15.1:0/3173909565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6240158000 0x7f624013f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:08.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.854+0000 7f623f7fe700 1 --2- 172.21.15.1:0/3173909565 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6240154180 0x7f62400a6770 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f6230009db0 tx=0x7f6230016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:08.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.854+0000 7f6227fff700 1 -- 172.21.15.1:0/3173909565 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230006950 con 0x7f6240154180 2023-11-15T01:37:08.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.854+0000 7f6227fff700 1 -- 172.21.15.1:0/3173909565 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62300128a0 con 0x7f6240154180 2023-11-15T01:37:08.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.854+0000 7f624675a700 1 -- 172.21.15.1:0/3173909565 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62400a5c90 con 0x7f6240154180 2023-11-15T01:37:08.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.854+0000 7f6227fff700 1 -- 172.21.15.1:0/3173909565 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230012c60 con 0x7f6240154180 2023-11-15T01:37:08.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.854+0000 7f624675a700 1 -- 172.21.15.1:0/3173909565 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62400a7c70 con 0x7f6240154180 2023-11-15T01:37:08.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.855+0000 7f624675a700 1 -- 172.21.15.1:0/3173909565 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62400a6450 con 0x7f6240154180 2023-11-15T01:37:08.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.855+0000 7f6227fff700 1 -- 172.21.15.1:0/3173909565 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 36) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f623001c630 con 0x7f6240154180 2023-11-15T01:37:08.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.856+0000 7f6227fff700 1 --2- 172.21.15.1:0/3173909565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f622c05f300 0x7f622c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:08.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.856+0000 7f6227fff700 1 -- 172.21.15.1:0/3173909565 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f623007b990 con 0x7f6240154180 2023-11-15T01:37:08.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.856+0000 7f623ffff700 1 -- 172.21.15.1:0/3173909565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f622c05f300 msgr2=0x7f622c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:08.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.856+0000 7f623ffff700 1 --2- 172.21.15.1:0/3173909565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f622c05f300 0x7f622c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:08.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:08.860+0000 7f6227fff700 1 -- 172.21.15.1:0/3173909565 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f623004c7b0 con 0x7f6240154180 2023-11-15T01:37:09.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.035+0000 7f624675a700 1 -- 172.21.15.1:0/3173909565 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f624006c7e0 con 0x7f6240154180 2023-11-15T01:37:09.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.036+0000 7f6227fff700 1 -- 172.21.15.1:0/3173909565 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+17900 (secure 0 0 0) 0x7f623004fdd0 con 0x7f6240154180 2023-11-15T01:37:09.037 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:09.037 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":95,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:37:06.051491+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:36:51.906477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-11-15T01:36:53.240462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:6833/90546":"2023-11-16T01:37:06.051446+0000","172.21.15.141:6832/90546":"2023-11-16T01:37:06.051446+0000","172.21.15.141:0/1004505685":"2023-11-16T01:37:06.051446+0000","172.21.15.141:0/3554724124":"2023-11-16T01:37:06.051446+0000","172.21.15.141:0/2782194221":"2023-11-16T01:37:06.051446+0000","172.21.15.141:0/1118138396":"2023-11-16T01:37:06.051446+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:37:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.038+0000 7f624675a700 1 -- 172.21.15.1:0/3173909565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f622c05f300 msgr2=0x7f622c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.038+0000 7f624675a700 1 --2- 172.21.15.1:0/3173909565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f622c05f300 0x7f622c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.038+0000 7f624675a700 1 -- 172.21.15.1:0/3173909565 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6240154180 msgr2=0x7f62400a6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.038+0000 7f624675a700 1 --2- 172.21.15.1:0/3173909565 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6240154180 0x7f62400a6770 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f6230009db0 tx=0x7f6230016000).stop 2023-11-15T01:37:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.038+0000 7f624675a700 1 -- 172.21.15.1:0/3173909565 shutdown_connections 2023-11-15T01:37:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.038+0000 7f624675a700 1 --2- 172.21.15.1:0/3173909565 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f622c05f300 0x7f622c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.038+0000 7f624675a700 1 --2- 172.21.15.1:0/3173909565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6240158000 0x7f624013f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.038+0000 7f624675a700 1 --2- 172.21.15.1:0/3173909565 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62400aa640 0x7f62400a7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.038+0000 7f624675a700 1 --2- 172.21.15.1:0/3173909565 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6240154180 0x7f62400a6770 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.038+0000 7f624675a700 1 -- 172.21.15.1:0/3173909565 >> 172.21.15.1:0/3173909565 conn(0x7f62400c74f0 msgr2=0x7f62400aaad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:09.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.038+0000 7f624675a700 1 -- 172.21.15.1:0/3173909565 shutdown_connections 2023-11-15T01:37:09.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.038+0000 7f624675a700 1 -- 172.21.15.1:0/3173909565 wait complete. 2023-11-15T01:37:09.051 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T01:36:51.906477+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T01:36:53.240462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T01:37:09.052 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:37:09.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.177+0000 7f3e63fd2700 1 Processor -- start 2023-11-15T01:37:09.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.177+0000 7f3e63fd2700 1 -- start start 2023-11-15T01:37:09.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.178+0000 7f3e63fd2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e5c14ad20 0x7f3e5c0bcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.178+0000 7f3e63fd2700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3e5c14b100 0x7f3e5c0bd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.178+0000 7f3e63fd2700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c0c6a20 con 0x7f3e5c0c5cb0 2023-11-15T01:37:09.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.178+0000 7f3e63fd2700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5c0c6830 con 0x7f3e5c14b100 2023-11-15T01:37:09.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.178+0000 7f3e63fd2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0bd720 con 0x7f3e5c14ad20 2023-11-15T01:37:09.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.178+0000 7f3e6256f700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3e5c0c5cb0 0x7f3e5c0c6120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42272/0 (socket says 172.21.15.1:42272) 2023-11-15T01:37:09.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.178+0000 7f3e6256f700 1 -- 172.21.15.1:0/1792622296 learned_addr learned my addr 172.21.15.1:0/1792622296 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:09.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.178+0000 7f3e6156d700 1 --2- 172.21.15.1:0/1792622296 >> v2:172.21.15.141:3300/0 conn(0x7f3e5c14b100 0x7f3e5c0bd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:09.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.178+0000 7f3e61d6e700 1 --2- 172.21.15.1:0/1792622296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e5c14ad20 0x7f3e5c0bcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:09.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.179+0000 7f3e60d6c700 1 -- 172.21.15.1:0/1792622296 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122855981 0 0) 0x7f3e5c0c6a20 con 0x7f3e5c0c5cb0 2023-11-15T01:37:09.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.179+0000 7f3e60d6c700 1 -- 172.21.15.1:0/1792622296 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e480033f0 con 0x7f3e5c0c5cb0 2023-11-15T01:37:09.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.179+0000 7f3e6156d700 1 -- 172.21.15.1:0/1792622296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e5c14ad20 msgr2=0x7f3e5c0bcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:09.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.179+0000 7f3e6156d700 1 --2- 172.21.15.1:0/1792622296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e5c14ad20 0x7f3e5c0bcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.179+0000 7f3e6156d700 1 -- 172.21.15.1:0/1792622296 >> v1:172.21.15.1:6789/0 conn(0x7f3e5c0c5cb0 legacy=0x7f3e5c0c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:09.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.179+0000 7f3e6156d700 1 -- 172.21.15.1:0/1792622296 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c0c6d00 con 0x7f3e5c14b100 2023-11-15T01:37:09.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.179+0000 7f3e61d6e700 1 --2- 172.21.15.1:0/1792622296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e5c14ad20 0x7f3e5c0bcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:09.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.179+0000 7f3e6156d700 1 --2- 172.21.15.1:0/1792622296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e5c14b100 0x7f3e5c0bd230 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f3e58009760 tx=0x7f3e58009060).ready entity=mon.1 client_cookie=ab71e7ff58a78b68 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:09.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.179+0000 7f3e60d6c700 1 -- 172.21.15.1:0/1792622296 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5800d4a0 con 0x7f3e5c14b100 2023-11-15T01:37:09.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.179+0000 7f3e60d6c700 1 -- 172.21.15.1:0/1792622296 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5800d600 con 0x7f3e5c14b100 2023-11-15T01:37:09.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.179+0000 7f3e60d6c700 1 -- 172.21.15.1:0/1792622296 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5800d980 con 0x7f3e5c14b100 2023-11-15T01:37:09.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.180+0000 7f3e63fd2700 1 -- 172.21.15.1:0/1792622296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e5c14b100 msgr2=0x7f3e5c0bd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:09.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.180+0000 7f3e63fd2700 1 --2- 172.21.15.1:0/1792622296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e5c14b100 0x7f3e5c0bd230 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f3e58009760 tx=0x7f3e58009060).stop 2023-11-15T01:37:09.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.180+0000 7f3e63fd2700 1 -- 172.21.15.1:0/1792622296 shutdown_connections 2023-11-15T01:37:09.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.180+0000 7f3e63fd2700 1 --2- 172.21.15.1:0/1792622296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e5c14ad20 0x7f3e5c0bcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.180+0000 7f3e63fd2700 1 --2- 172.21.15.1:0/1792622296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e5c14b100 0x7f3e5c0bd230 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.180+0000 7f3e63fd2700 1 -- 172.21.15.1:0/1792622296 >> 172.21.15.1:0/1792622296 conn(0x7f3e5c0c8050 msgr2=0x7f3e5c0c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:09.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.180+0000 7f3e63fd2700 1 -- 172.21.15.1:0/1792622296 shutdown_connections 2023-11-15T01:37:09.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.180+0000 7f3e63fd2700 1 -- 172.21.15.1:0/1792622296 wait complete. 2023-11-15T01:37:09.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.181+0000 7f3e63fd2700 1 Processor -- start 2023-11-15T01:37:09.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.181+0000 7f3e63fd2700 1 -- start start 2023-11-15T01:37:09.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e63fd2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e5c0c5cb0 0x7f3e5c14a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e63fd2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e5c14ad20 0x7f3e5c0a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e63fd2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e5c14b100 0x7f3e5c0a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e63fd2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c1545e0 con 0x7f3e5c14b100 2023-11-15T01:37:09.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e63fd2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0a9b90 con 0x7f3e5c14ad20 2023-11-15T01:37:09.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e63fd2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0a6530 con 0x7f3e5c0c5cb0 2023-11-15T01:37:09.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e6256f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e5c14b100 0x7f3e5c0a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:09.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e6256f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e5c14b100 0x7f3e5c0a96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40644/0 (socket says 172.21.15.1:40644) 2023-11-15T01:37:09.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e6256f700 1 -- 172.21.15.1:0/20290050 learned_addr learned my addr 172.21.15.1:0/20290050 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:09.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e61d6e700 1 --2- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e5c0c5cb0 0x7f3e5c14a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:09.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e6156d700 1 --2- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e5c14ad20 0x7f3e5c0a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:09.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e6256f700 1 -- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e5c0c5cb0 msgr2=0x7f3e5c14a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:09.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e6256f700 1 --2- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e5c0c5cb0 0x7f3e5c14a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e6256f700 1 -- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e5c14ad20 msgr2=0x7f3e5c0a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:09.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e6256f700 1 --2- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e5c14ad20 0x7f3e5c0a91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e6256f700 1 -- 172.21.15.1:0/20290050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c0092a0 con 0x7f3e5c14b100 2023-11-15T01:37:09.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.182+0000 7f3e6156d700 1 --2- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e5c14ad20 0x7f3e5c0a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:09.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.183+0000 7f3e6256f700 1 --2- 172.21.15.1:0/20290050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e5c14b100 0x7f3e5c0a96a0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f3e54005ad0 tx=0x7f3e54001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:09.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.183+0000 7f3e51ffb700 1 -- 172.21.15.1:0/20290050 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e54005d30 con 0x7f3e5c14b100 2023-11-15T01:37:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.183+0000 7f3e51ffb700 1 -- 172.21.15.1:0/20290050 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e54005e90 con 0x7f3e5c14b100 2023-11-15T01:37:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.183+0000 7f3e51ffb700 1 -- 172.21.15.1:0/20290050 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e54007320 con 0x7f3e5c14b100 2023-11-15T01:37:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.183+0000 7f3e63fd2700 1 -- 172.21.15.1:0/20290050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e580092a0 con 0x7f3e5c14b100 2023-11-15T01:37:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.183+0000 7f3e63fd2700 1 -- 172.21.15.1:0/20290050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5c0ac5a0 con 0x7f3e5c14b100 2023-11-15T01:37:09.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.184+0000 7f3e63fd2700 1 -- 172.21.15.1:0/20290050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5c06c7e0 con 0x7f3e5c14b100 2023-11-15T01:37:09.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.184+0000 7f3e51ffb700 1 -- 172.21.15.1:0/20290050 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 36) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f3e54007710 con 0x7f3e5c14b100 2023-11-15T01:37:09.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.185+0000 7f3e51ffb700 1 --2- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e4005f300 0x7f3e400617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.185+0000 7f3e61d6e700 1 -- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e4005f300 msgr2=0x7f3e400617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:09.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.185+0000 7f3e51ffb700 1 -- 172.21.15.1:0/20290050 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f3e5407a700 con 0x7f3e5c14b100 2023-11-15T01:37:09.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.185+0000 7f3e61d6e700 1 --2- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e4005f300 0x7f3e400617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:09.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.189+0000 7f3e51ffb700 1 -- 172.21.15.1:0/20290050 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3e5404b4c0 con 0x7f3e5c14b100 2023-11-15T01:37:09.207 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:09.206+0000 7f5292392680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:37:09.278 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:09.277+0000 7f5292392680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:37:09.302 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:09.301+0000 7f73c5b6f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:37:09.373 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:09.372+0000 7f73c5b6f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:37:09.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.386+0000 7f3e61d6e700 1 -- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e4005f300 msgr2=0x7f3e400617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:09.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.386+0000 7f3e61d6e700 1 --2- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e4005f300 0x7f3e400617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:37:09.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.409+0000 7f3e63fd2700 1 -- 172.21.15.1:0/20290050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3e5c153e80 con 0x7f3e5c14b100 2023-11-15T01:37:09.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.410+0000 7f3e51ffb700 1 -- 172.21.15.1:0/20290050 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v95) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3e5404eae0 con 0x7f3e5c14b100 2023-11-15T01:37:09.410 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:37:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.412+0000 7f3e63fd2700 1 -- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e4005f300 msgr2=0x7f3e400617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.412+0000 7f3e63fd2700 1 --2- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e4005f300 0x7f3e400617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.412+0000 7f3e63fd2700 1 -- 172.21.15.1:0/20290050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e5c14b100 msgr2=0x7f3e5c0a96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.412+0000 7f3e63fd2700 1 --2- 172.21.15.1:0/20290050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e5c14b100 0x7f3e5c0a96a0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f3e54005ad0 tx=0x7f3e54001650).stop 2023-11-15T01:37:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.412+0000 7f3e63fd2700 1 -- 172.21.15.1:0/20290050 shutdown_connections 2023-11-15T01:37:09.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.412+0000 7f3e63fd2700 1 --2- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e4005f300 0x7f3e400617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:09.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.412+0000 7f3e63fd2700 1 --2- 172.21.15.1:0/20290050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e5c14b100 0x7f3e5c0a96a0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.412+0000 7f3e63fd2700 1 --2- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e5c0c5cb0 0x7f3e5c14a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.412+0000 7f3e63fd2700 1 --2- 172.21.15.1:0/20290050 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e5c14ad20 0x7f3e5c0a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.412+0000 7f3e63fd2700 1 -- 172.21.15.1:0/20290050 >> 172.21.15.1:0/20290050 conn(0x7f3e5c0c8050 msgr2=0x7f3e5c0bc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.412+0000 7f3e63fd2700 1 -- 172.21.15.1:0/20290050 shutdown_connections 2023-11-15T01:37:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.412+0000 7f3e63fd2700 1 -- 172.21.15.1:0/20290050 wait complete. 2023-11-15T01:37:09.425 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:37:09.463 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:09.463+0000 7f5292392680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:37:09.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.549+0000 7fd51ec5b700 1 Processor -- start 2023-11-15T01:37:09.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.549+0000 7fd51ec5b700 1 -- start start 2023-11-15T01:37:09.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.550+0000 7fd51ec5b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5181545b0 0x7fd5180c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.550+0000 7fd51ec5b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd5180c7f50 0x7fd5180c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.550+0000 7fd51ec5b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd518155830 con 0x7fd5181541d0 2023-11-15T01:37:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.550+0000 7fd51ec5b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd518158f40 con 0x7fd5180c7f50 2023-11-15T01:37:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.550+0000 7fd51ec5b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd518154a30 con 0x7fd5181545b0 2023-11-15T01:37:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.550+0000 7fd51dc59700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd5181541d0 0x7fd5180c60d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42274/0 (socket says 172.21.15.1:42274) 2023-11-15T01:37:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.550+0000 7fd51dc59700 1 -- 172.21.15.1:0/3690254469 learned_addr learned my addr 172.21.15.1:0/3690254469 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.550+0000 7fd51e45a700 1 --2- 172.21.15.1:0/3690254469 >> v2:172.21.15.141:3300/0 conn(0x7fd5180c7f50 0x7fd5180c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.550+0000 7fd51d458700 1 --2- 172.21.15.1:0/3690254469 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5181545b0 0x7fd5180c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.551+0000 7fd51cc57700 1 -- 172.21.15.1:0/3690254469 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110087365 0 0) 0x7fd518155830 con 0x7fd5181541d0 2023-11-15T01:37:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.551+0000 7fd51cc57700 1 -- 172.21.15.1:0/3690254469 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5040033f0 con 0x7fd5181541d0 2023-11-15T01:37:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.551+0000 7fd51e45a700 1 -- 172.21.15.1:0/3690254469 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5181545b0 msgr2=0x7fd5180c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.551+0000 7fd51e45a700 1 --2- 172.21.15.1:0/3690254469 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5181545b0 0x7fd5180c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.551+0000 7fd51e45a700 1 -- 172.21.15.1:0/3690254469 >> v1:172.21.15.1:6789/0 conn(0x7fd5181541d0 legacy=0x7fd5180c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.551+0000 7fd51e45a700 1 -- 172.21.15.1:0/3690254469 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5180c83a0 con 0x7fd5180c7f50 2023-11-15T01:37:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.551+0000 7fd51d458700 1 --2- 172.21.15.1:0/3690254469 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5181545b0 0x7fd5180c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:09.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.551+0000 7fd51e45a700 1 --2- 172.21.15.1:0/3690254469 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5180c7f50 0x7fd5180c9620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fd510009e60 tx=0x7fd510009780).ready entity=mon.1 client_cookie=4ecb6c855f570683 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:09.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.551+0000 7fd51cc57700 1 -- 172.21.15.1:0/3690254469 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000e070 con 0x7fd5180c7f50 2023-11-15T01:37:09.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.551+0000 7fd51cc57700 1 -- 172.21.15.1:0/3690254469 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51000bab0 con 0x7fd5180c7f50 2023-11-15T01:37:09.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.551+0000 7fd51cc57700 1 -- 172.21.15.1:0/3690254469 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000be30 con 0x7fd5180c7f50 2023-11-15T01:37:09.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.552+0000 7fd51ec5b700 1 -- 172.21.15.1:0/3690254469 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5180c7f50 msgr2=0x7fd5180c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:09.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.552+0000 7fd51ec5b700 1 --2- 172.21.15.1:0/3690254469 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5180c7f50 0x7fd5180c9620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fd510009e60 tx=0x7fd510009780).stop 2023-11-15T01:37:09.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.552+0000 7fd51ec5b700 1 -- 172.21.15.1:0/3690254469 shutdown_connections 2023-11-15T01:37:09.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.552+0000 7fd51ec5b700 1 --2- 172.21.15.1:0/3690254469 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5180c7f50 0x7fd5180c9620 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.552+0000 7fd51ec5b700 1 --2- 172.21.15.1:0/3690254469 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5181545b0 0x7fd5180c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.552+0000 7fd51ec5b700 1 -- 172.21.15.1:0/3690254469 >> 172.21.15.1:0/3690254469 conn(0x7fd518069ee0 msgr2=0x7fd51806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:09.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.552+0000 7fd51ec5b700 1 -- 172.21.15.1:0/3690254469 shutdown_connections 2023-11-15T01:37:09.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.552+0000 7fd51ec5b700 1 -- 172.21.15.1:0/3690254469 wait complete. 2023-11-15T01:37:09.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.553+0000 7fd51ec5b700 1 Processor -- start 2023-11-15T01:37:09.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.553+0000 7fd51ec5b700 1 -- start start 2023-11-15T01:37:09.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51ec5b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5180c7f50 0x7fd5180b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51ec5b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5181541d0 0x7fd5180ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51ec5b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5181545b0 0x7fd5180ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51ec5b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180acde0 con 0x7fd5181545b0 2023-11-15T01:37:09.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51ec5b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180ac1d0 con 0x7fd5180c7f50 2023-11-15T01:37:09.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51ec5b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180ac4b0 con 0x7fd5181541d0 2023-11-15T01:37:09.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51e45a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5181545b0 0x7fd5180ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:09.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51e45a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5181545b0 0x7fd5180ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40654/0 (socket says 172.21.15.1:40654) 2023-11-15T01:37:09.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51e45a700 1 -- 172.21.15.1:0/3642833261 learned_addr learned my addr 172.21.15.1:0/3642833261 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:09.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51dc59700 1 --2- 172.21.15.1:0/3642833261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5180c7f50 0x7fd5180b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:09.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51d458700 1 --2- 172.21.15.1:0/3642833261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5181541d0 0x7fd5180ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:09.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51e45a700 1 -- 172.21.15.1:0/3642833261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5181541d0 msgr2=0x7fd5180ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:09.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51e45a700 1 --2- 172.21.15.1:0/3642833261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5181541d0 0x7fd5180ab7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51e45a700 1 -- 172.21.15.1:0/3642833261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5180c7f50 msgr2=0x7fd5180b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:09.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51e45a700 1 --2- 172.21.15.1:0/3642833261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5180c7f50 0x7fd5180b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51e45a700 1 -- 172.21.15.1:0/3642833261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5140092a0 con 0x7fd5181545b0 2023-11-15T01:37:09.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51dc59700 1 --2- 172.21.15.1:0/3642833261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5180c7f50 0x7fd5180b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:09.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.554+0000 7fd51e45a700 1 --2- 172.21.15.1:0/3642833261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5181545b0 0x7fd5180ae0b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7fd51805fe80 tx=0x7fd5181557a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:09.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.555+0000 7fd50dffb700 1 -- 172.21.15.1:0/3642833261 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510013e40 con 0x7fd5181545b0 2023-11-15T01:37:09.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.555+0000 7fd50dffb700 1 -- 172.21.15.1:0/3642833261 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51001d630 con 0x7fd5181545b0 2023-11-15T01:37:09.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.555+0000 7fd51ec5b700 1 -- 172.21.15.1:0/3642833261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd510009a20 con 0x7fd5181545b0 2023-11-15T01:37:09.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.555+0000 7fd50dffb700 1 -- 172.21.15.1:0/3642833261 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51001d9f0 con 0x7fd5181545b0 2023-11-15T01:37:09.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.555+0000 7fd51ec5b700 1 -- 172.21.15.1:0/3642833261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5180aca70 con 0x7fd5181545b0 2023-11-15T01:37:09.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.556+0000 7fd50dffb700 1 -- 172.21.15.1:0/3642833261 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 36) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fd510003040 con 0x7fd5181545b0 2023-11-15T01:37:09.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.556+0000 7fd51ec5b700 1 -- 172.21.15.1:0/3642833261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5180ad170 con 0x7fd5181545b0 2023-11-15T01:37:09.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.557+0000 7fd50dffb700 1 --2- 172.21.15.1:0/3642833261 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd4fc05f300 0x7fd4fc0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.557+0000 7fd51dc59700 1 -- 172.21.15.1:0/3642833261 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd4fc05f300 msgr2=0x7fd4fc0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:09.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.557+0000 7fd50dffb700 1 -- 172.21.15.1:0/3642833261 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fd51007c4d0 con 0x7fd5181545b0 2023-11-15T01:37:09.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.557+0000 7fd51dc59700 1 --2- 172.21.15.1:0/3642833261 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd4fc05f300 0x7fd4fc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:09.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.561+0000 7fd50dffb700 1 -- 172.21.15.1:0/3642833261 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd5180ad170 con 0x7fd5181545b0 2023-11-15T01:37:09.581 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:09.580+0000 7f73c5b6f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:37:09.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.751+0000 7fd51ec5b700 1 -- 172.21.15.1:0/3642833261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5180ad170 con 0x7fd5181545b0 2023-11-15T01:37:09.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.752+0000 7fd50dffb700 1 -- 172.21.15.1:0/3642833261 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v95) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5180ad170 con 0x7fd5181545b0 2023-11-15T01:37:09.753 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:37:09.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.754+0000 7fd51ec5b700 1 -- 172.21.15.1:0/3642833261 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd4fc05f300 msgr2=0x7fd4fc0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:09.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.754+0000 7fd51ec5b700 1 --2- 172.21.15.1:0/3642833261 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd4fc05f300 0x7fd4fc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:09.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.754+0000 7fd51ec5b700 1 -- 172.21.15.1:0/3642833261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5181545b0 msgr2=0x7fd5180ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:09.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.754+0000 7fd51ec5b700 1 --2- 172.21.15.1:0/3642833261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5181545b0 0x7fd5180ae0b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7fd51805fe80 tx=0x7fd5181557a0).stop 2023-11-15T01:37:09.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.754+0000 7fd51ec5b700 1 -- 172.21.15.1:0/3642833261 shutdown_connections 2023-11-15T01:37:09.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.754+0000 7fd51ec5b700 1 --2- 172.21.15.1:0/3642833261 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd4fc05f300 0x7fd4fc0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:09.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.754+0000 7fd51ec5b700 1 --2- 172.21.15.1:0/3642833261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5181545b0 0x7fd5180ae0b0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.754+0000 7fd51ec5b700 1 --2- 172.21.15.1:0/3642833261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5180c7f50 0x7fd5180b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.754+0000 7fd51ec5b700 1 --2- 172.21.15.1:0/3642833261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5181541d0 0x7fd5180ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.754+0000 7fd51ec5b700 1 -- 172.21.15.1:0/3642833261 >> 172.21.15.1:0/3642833261 conn(0x7fd518069ee0 msgr2=0x7fd5180c0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:09.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.754+0000 7fd51ec5b700 1 -- 172.21.15.1:0/3642833261 shutdown_connections 2023-11-15T01:37:09.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.754+0000 7fd51ec5b700 1 -- 172.21.15.1:0/3642833261 wait complete. 2023-11-15T01:37:09.766 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T01:37:09.882 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:09.881+0000 7f5292392680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:37:09.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.894+0000 7feb40b6d700 1 Processor -- start 2023-11-15T01:37:09.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.894+0000 7feb40b6d700 1 -- start start 2023-11-15T01:37:09.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb40b6d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7feb3c1545b0 0x7feb3c0c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb40b6d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0696c0 0x7feb3c0658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb40b6d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3c0c2640 con 0x7feb3c0627b0 2023-11-15T01:37:09.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb40b6d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c06a6d0 con 0x7feb3c1545b0 2023-11-15T01:37:09.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb40b6d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0c4790 con 0x7feb3c0696c0 2023-11-15T01:37:09.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb3a59c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7feb3c1545b0 0x7feb3c0c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:09.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb39d9b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0696c0 0x7feb3c0658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:09.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb3ad9d700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7feb3c0627b0 0x7feb3c0c2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:51584/0 (socket says 172.21.15.1:51584) 2023-11-15T01:37:09.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb3ad9d700 1 -- 172.21.15.1:0/2192614888 learned_addr learned my addr 172.21.15.1:0/2192614888 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:09.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb3959a700 1 -- 172.21.15.1:0/2192614888 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958859978 0 0) 0x7feb3c0c2640 con 0x7feb3c0627b0 2023-11-15T01:37:09.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb39d9b700 1 -- 172.21.15.1:0/2192614888 >> v2:172.21.15.141:3300/0 conn(0x7feb3c1545b0 msgr2=0x7feb3c0c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:09.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb39d9b700 1 --2- 172.21.15.1:0/2192614888 >> v2:172.21.15.141:3300/0 conn(0x7feb3c1545b0 0x7feb3c0c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb39d9b700 1 -- 172.21.15.1:0/2192614888 >> v1:172.21.15.141:6789/0 conn(0x7feb3c0627b0 legacy=0x7feb3c0c2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:09.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb39d9b700 1 -- 172.21.15.1:0/2192614888 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c065dd0 con 0x7feb3c0696c0 2023-11-15T01:37:09.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb3a59c700 1 --2- 172.21.15.1:0/2192614888 >> v2:172.21.15.141:3300/0 conn(0x7feb3c1545b0 0x7feb3c0c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:09.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.895+0000 7feb39d9b700 1 --2- 172.21.15.1:0/2192614888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0696c0 0x7feb3c0658e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7feb30009760 tx=0x7feb30009060).ready entity=mon.2 client_cookie=24f4e5910044381f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:09.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.896+0000 7feb3959a700 1 -- 172.21.15.1:0/2192614888 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb300090d0 con 0x7feb3c0696c0 2023-11-15T01:37:09.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.896+0000 7feb3959a700 1 -- 172.21.15.1:0/2192614888 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3000f510 con 0x7feb3c0696c0 2023-11-15T01:37:09.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.896+0000 7feb3959a700 1 -- 172.21.15.1:0/2192614888 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3000f890 con 0x7feb3c0696c0 2023-11-15T01:37:09.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.896+0000 7feb40b6d700 1 -- 172.21.15.1:0/2192614888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0696c0 msgr2=0x7feb3c0658e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:09.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.896+0000 7feb40b6d700 1 --2- 172.21.15.1:0/2192614888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0696c0 0x7feb3c0658e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7feb30009760 tx=0x7feb30009060).stop 2023-11-15T01:37:09.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.896+0000 7feb40b6d700 1 -- 172.21.15.1:0/2192614888 shutdown_connections 2023-11-15T01:37:09.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.896+0000 7feb40b6d700 1 --2- 172.21.15.1:0/2192614888 >> v2:172.21.15.141:3300/0 conn(0x7feb3c1545b0 0x7feb3c0c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.896+0000 7feb40b6d700 1 --2- 172.21.15.1:0/2192614888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0696c0 0x7feb3c0658e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.896+0000 7feb40b6d700 1 -- 172.21.15.1:0/2192614888 >> 172.21.15.1:0/2192614888 conn(0x7feb3c064390 msgr2=0x7feb3c0c7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:09.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.896+0000 7feb40b6d700 1 -- 172.21.15.1:0/2192614888 shutdown_connections 2023-11-15T01:37:09.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.896+0000 7feb40b6d700 1 -- 172.21.15.1:0/2192614888 wait complete. 2023-11-15T01:37:09.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.898+0000 7feb40b6d700 1 Processor -- start 2023-11-15T01:37:09.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.898+0000 7feb40b6d700 1 -- start start 2023-11-15T01:37:09.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.898+0000 7feb40b6d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0627b0 0x7feb3c1495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.898+0000 7feb40b6d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c0696c0 0x7feb3c0acc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.898+0000 7feb40b6d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb3c1545b0 0x7feb3c0ad130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.898+0000 7feb40b6d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c156b60 con 0x7feb3c0696c0 2023-11-15T01:37:09.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.898+0000 7feb40b6d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c14a160 con 0x7feb3c1545b0 2023-11-15T01:37:09.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.898+0000 7feb40b6d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c159da0 con 0x7feb3c0627b0 2023-11-15T01:37:09.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.898+0000 7feb39d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c0696c0 0x7feb3c0acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:09.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.898+0000 7feb39d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c0696c0 0x7feb3c0acc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40668/0 (socket says 172.21.15.1:40668) 2023-11-15T01:37:09.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.899+0000 7feb39d9b700 1 -- 172.21.15.1:0/1304874287 learned_addr learned my addr 172.21.15.1:0/1304874287 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:09.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.899+0000 7feb3ad9d700 1 --2- 172.21.15.1:0/1304874287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb3c1545b0 0x7feb3c0ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:09.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.899+0000 7feb3a59c700 1 --2- 172.21.15.1:0/1304874287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0627b0 0x7feb3c1495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:09.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.899+0000 7feb39d9b700 1 -- 172.21.15.1:0/1304874287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0627b0 msgr2=0x7feb3c1495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:09.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.899+0000 7feb39d9b700 1 --2- 172.21.15.1:0/1304874287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0627b0 0x7feb3c1495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.899+0000 7feb39d9b700 1 -- 172.21.15.1:0/1304874287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb3c1545b0 msgr2=0x7feb3c0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:09.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.899+0000 7feb39d9b700 1 --2- 172.21.15.1:0/1304874287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb3c1545b0 0x7feb3c0ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:09.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.899+0000 7feb39d9b700 1 -- 172.21.15.1:0/1304874287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c0092a0 con 0x7feb3c0696c0 2023-11-15T01:37:09.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.899+0000 7feb3ad9d700 1 --2- 172.21.15.1:0/1304874287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb3c1545b0 0x7feb3c0ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:09.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.899+0000 7feb39d9b700 1 --2- 172.21.15.1:0/1304874287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c0696c0 0x7feb3c0acc40 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7feb30009e00 tx=0x7feb30017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:09.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.899+0000 7feb2a7fc700 1 -- 172.21.15.1:0/1304874287 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30006970 con 0x7feb3c0696c0 2023-11-15T01:37:09.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.899+0000 7feb2a7fc700 1 -- 172.21.15.1:0/1304874287 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3000f680 con 0x7feb3c0696c0 2023-11-15T01:37:09.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.899+0000 7feb40b6d700 1 -- 172.21.15.1:0/1304874287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb300092a0 con 0x7feb3c0696c0 2023-11-15T01:37:09.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.899+0000 7feb2a7fc700 1 -- 172.21.15.1:0/1304874287 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3000fea0 con 0x7feb3c0696c0 2023-11-15T01:37:09.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.899+0000 7feb40b6d700 1 -- 172.21.15.1:0/1304874287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3c0adac0 con 0x7feb3c0696c0 2023-11-15T01:37:09.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.900+0000 7feb2a7fc700 1 -- 172.21.15.1:0/1304874287 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 36) v1 ==== 75605+0+0 (secure 0 0 0) 0x7feb3001b620 con 0x7feb3c0696c0 2023-11-15T01:37:09.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.901+0000 7feb40b6d700 1 -- 172.21.15.1:0/1304874287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c14a2f0 con 0x7feb3c0696c0 2023-11-15T01:37:09.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.901+0000 7feb2a7fc700 1 --2- 172.21.15.1:0/1304874287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feb1c05f300 0x7feb1c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:09.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.901+0000 7feb3a59c700 1 -- 172.21.15.1:0/1304874287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feb1c05f300 msgr2=0x7feb1c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:09.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.901+0000 7feb2a7fc700 1 -- 172.21.15.1:0/1304874287 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6803+0+0 (secure 0 0 0) 0x7feb3007bfe0 con 0x7feb3c0696c0 2023-11-15T01:37:09.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.901+0000 7feb3a59c700 1 --2- 172.21.15.1:0/1304874287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feb1c05f300 0x7feb1c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:09.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:09.905+0000 7feb2a7fc700 1 -- 172.21.15.1:0/1304874287 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7feb3004cdc0 con 0x7feb3c0696c0 2023-11-15T01:37:09.988 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:09.988+0000 7f5292392680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:37:10.037 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:10.036+0000 7f73c5b6f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:37:10.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.079+0000 7feb40b6d700 1 -- 172.21.15.1:0/1304874287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb3c06c850 con 0x7feb3c0696c0 2023-11-15T01:37:10.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.079+0000 7feb2a7fc700 1 -- 172.21.15.1:0/1304874287 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb300280a0 con 0x7feb3c0696c0 2023-11-15T01:37:10.080 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:37:10.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.081+0000 7feb40b6d700 1 -- 172.21.15.1:0/1304874287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feb1c05f300 msgr2=0x7feb1c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:10.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.081+0000 7feb40b6d700 1 --2- 172.21.15.1:0/1304874287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feb1c05f300 0x7feb1c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:10.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.081+0000 7feb40b6d700 1 -- 172.21.15.1:0/1304874287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c0696c0 msgr2=0x7feb3c0acc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:10.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.081+0000 7feb40b6d700 1 --2- 172.21.15.1:0/1304874287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c0696c0 0x7feb3c0acc40 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7feb30009e00 tx=0x7feb30017000).stop 2023-11-15T01:37:10.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.081+0000 7feb40b6d700 1 -- 172.21.15.1:0/1304874287 shutdown_connections 2023-11-15T01:37:10.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.081+0000 7feb40b6d700 1 --2- 172.21.15.1:0/1304874287 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7feb1c05f300 0x7feb1c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:10.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.081+0000 7feb40b6d700 1 --2- 172.21.15.1:0/1304874287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb3c1545b0 0x7feb3c0ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.081+0000 7feb40b6d700 1 --2- 172.21.15.1:0/1304874287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb3c0627b0 0x7feb3c1495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.081+0000 7feb40b6d700 1 --2- 172.21.15.1:0/1304874287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb3c0696c0 0x7feb3c0acc40 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.081+0000 7feb40b6d700 1 -- 172.21.15.1:0/1304874287 >> 172.21.15.1:0/1304874287 conn(0x7feb3c064390 msgr2=0x7feb3c062b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:10.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.081+0000 7feb40b6d700 1 -- 172.21.15.1:0/1304874287 shutdown_connections 2023-11-15T01:37:10.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.081+0000 7feb40b6d700 1 -- 172.21.15.1:0/1304874287 wait complete. 2023-11-15T01:37:10.094 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T01:37:10.141 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:10.141+0000 7f5292392680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:37:10.150 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:10.150+0000 7f73c5b6f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:37:10.216 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:10.215+0000 7f5292392680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:37:10.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.216+0000 7ff6ac180700 1 Processor -- start 2023-11-15T01:37:10.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.216+0000 7ff6ac180700 1 -- start start 2023-11-15T01:37:10.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.217+0000 7ff6ac180700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6a4154cb0 0x7ff6a4155110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.217+0000 7ff6ac180700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff6a40c5a90 0x7ff6a40c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.217+0000 7ff6ac180700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a40c3e30 con 0x7ff6a414ec30 2023-11-15T01:37:10.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.217+0000 7ff6ac180700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a40c5640 con 0x7ff6a40c5a90 2023-11-15T01:37:10.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.217+0000 7ff6ac180700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4155600 con 0x7ff6a4154cb0 2023-11-15T01:37:10.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.217+0000 7ff6aa71d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff6a40c5a90 0x7ff6a40c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:10.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.217+0000 7ff6aa71d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff6a40c5a90 0x7ff6a40c5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40682/0 (socket says 172.21.15.1:40682) 2023-11-15T01:37:10.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.217+0000 7ff6aa71d700 1 -- 172.21.15.1:0/834591160 learned_addr learned my addr 172.21.15.1:0/834591160 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:10.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.217+0000 7ff6a971b700 1 --2- 172.21.15.1:0/834591160 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6a4154cb0 0x7ff6a4155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:10.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.218+0000 7ff6aa71d700 1 -- 172.21.15.1:0/834591160 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6a4154cb0 msgr2=0x7ff6a4155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:10.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.218+0000 7ff6aa71d700 1 --2- 172.21.15.1:0/834591160 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6a4154cb0 0x7ff6a4155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.218+0000 7ff6aa71d700 1 -- 172.21.15.1:0/834591160 >> v1:172.21.15.141:6789/0 conn(0x7ff6a414ec30 legacy=0x7ff6a40638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:10.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.218+0000 7ff6a8f1a700 1 -- 172.21.15.1:0/834591160 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557867801 0 0) 0x7ff6a40c3e30 con 0x7ff6a414ec30 2023-11-15T01:37:10.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.218+0000 7ff6aa71d700 1 -- 172.21.15.1:0/834591160 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4063fd0 con 0x7ff6a40c5a90 2023-11-15T01:37:10.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.218+0000 7ff6aa71d700 1 --2- 172.21.15.1:0/834591160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6a40c5a90 0x7ff6a40c5f00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7ff69c00d1a0 tx=0x7ff69c00ba50).ready entity=mon.0 client_cookie=ed53a6b6e8819b79 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:10.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.218+0000 7ff6a8f1a700 1 -- 172.21.15.1:0/834591160 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c010070 con 0x7ff6a40c5a90 2023-11-15T01:37:10.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.218+0000 7ff6a8f1a700 1 -- 172.21.15.1:0/834591160 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c00de10 con 0x7ff6a40c5a90 2023-11-15T01:37:10.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.218+0000 7ff6a8f1a700 1 -- 172.21.15.1:0/834591160 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c00b2e0 con 0x7ff6a40c5a90 2023-11-15T01:37:10.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.219+0000 7ff6ac180700 1 -- 172.21.15.1:0/834591160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6a40c5a90 msgr2=0x7ff6a40c5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:10.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.219+0000 7ff6ac180700 1 --2- 172.21.15.1:0/834591160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6a40c5a90 0x7ff6a40c5f00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7ff69c00d1a0 tx=0x7ff69c00ba50).stop 2023-11-15T01:37:10.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.219+0000 7ff6ac180700 1 -- 172.21.15.1:0/834591160 shutdown_connections 2023-11-15T01:37:10.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.219+0000 7ff6ac180700 1 --2- 172.21.15.1:0/834591160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6a40c5a90 0x7ff6a40c5f00 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.219+0000 7ff6ac180700 1 --2- 172.21.15.1:0/834591160 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6a4154cb0 0x7ff6a4155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.219+0000 7ff6ac180700 1 -- 172.21.15.1:0/834591160 >> 172.21.15.1:0/834591160 conn(0x7ff6a40c8050 msgr2=0x7ff6a40c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:10.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.219+0000 7ff6ac180700 1 -- 172.21.15.1:0/834591160 shutdown_connections 2023-11-15T01:37:10.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.219+0000 7ff6ac180700 1 -- 172.21.15.1:0/834591160 wait complete. 2023-11-15T01:37:10.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.220+0000 7ff6ac180700 1 Processor -- start 2023-11-15T01:37:10.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.220+0000 7ff6ac180700 1 -- start start 2023-11-15T01:37:10.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6ac180700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6a40c5a90 0x7ff6a40ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6ac180700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6a414ec30 0x7ff6a414b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6ac180700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6a4154cb0 0x7ff6a414b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6ac180700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40c1120 con 0x7ff6a40c5a90 2023-11-15T01:37:10.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6ac180700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a414bb00 con 0x7ff6a414ec30 2023-11-15T01:37:10.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6ac180700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40c0880 con 0x7ff6a4154cb0 2023-11-15T01:37:10.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6a9f1c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6a40c5a90 0x7ff6a40ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:10.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6a9f1c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6a40c5a90 0x7ff6a40ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40690/0 (socket says 172.21.15.1:40690) 2023-11-15T01:37:10.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6a9f1c700 1 -- 172.21.15.1:0/1138289472 learned_addr learned my addr 172.21.15.1:0/1138289472 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:10.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6aa71d700 1 --2- 172.21.15.1:0/1138289472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6a4154cb0 0x7ff6a414b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:10.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6a971b700 1 --2- 172.21.15.1:0/1138289472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6a414ec30 0x7ff6a414b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:10.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6a9f1c700 1 -- 172.21.15.1:0/1138289472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6a4154cb0 msgr2=0x7ff6a414b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:10.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6a9f1c700 1 --2- 172.21.15.1:0/1138289472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6a4154cb0 0x7ff6a414b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6a9f1c700 1 -- 172.21.15.1:0/1138289472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6a414ec30 msgr2=0x7ff6a414b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:10.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6a9f1c700 1 --2- 172.21.15.1:0/1138289472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6a414ec30 0x7ff6a414b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6a9f1c700 1 -- 172.21.15.1:0/1138289472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c00bcf0 con 0x7ff6a40c5a90 2023-11-15T01:37:10.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6aa71d700 1 --2- 172.21.15.1:0/1138289472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6a4154cb0 0x7ff6a414b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:10.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.221+0000 7ff6a9f1c700 1 --2- 172.21.15.1:0/1138289472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6a40c5a90 0x7ff6a40ace20 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7ff694001eb0 tx=0x7ff694007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:10.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.222+0000 7ff699ffb700 1 -- 172.21.15.1:0/1138289472 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69400ce60 con 0x7ff6a40c5a90 2023-11-15T01:37:10.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.222+0000 7ff699ffb700 1 -- 172.21.15.1:0/1138289472 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69400f470 con 0x7ff6a40c5a90 2023-11-15T01:37:10.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.222+0000 7ff6ac180700 1 -- 172.21.15.1:0/1138289472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a40c0b60 con 0x7ff6a40c5a90 2023-11-15T01:37:10.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.222+0000 7ff699ffb700 1 -- 172.21.15.1:0/1138289472 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69400f810 con 0x7ff6a40c5a90 2023-11-15T01:37:10.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.222+0000 7ff6ac180700 1 -- 172.21.15.1:0/1138289472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a40a7270 con 0x7ff6a40c5a90 2023-11-15T01:37:10.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.223+0000 7ff699ffb700 1 -- 172.21.15.1:0/1138289472 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 36) v1 ==== 75605+0+0 (secure 0 0 0) 0x7ff69400fb80 con 0x7ff6a40c5a90 2023-11-15T01:37:10.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.223+0000 7ff6ac180700 1 -- 172.21.15.1:0/1138289472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a406c7e0 con 0x7ff6a40c5a90 2023-11-15T01:37:10.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.223+0000 7ff699ffb700 1 --2- 172.21.15.1:0/1138289472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff68805f330 0x7ff6880617f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.223+0000 7ff699ffb700 1 -- 172.21.15.1:0/1138289472 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6803+0+0 (secure 0 0 0) 0x7ff694079bb0 con 0x7ff6a40c5a90 2023-11-15T01:37:10.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.224+0000 7ff6a971b700 1 -- 172.21.15.1:0/1138289472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff68805f330 msgr2=0x7ff6880617f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:10.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.224+0000 7ff6a971b700 1 --2- 172.21.15.1:0/1138289472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff68805f330 0x7ff6880617f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:10.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.228+0000 7ff699ffb700 1 -- 172.21.15.1:0/1138289472 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff694080080 con 0x7ff6a40c5a90 2023-11-15T01:37:10.285 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:10.284+0000 7f5292392680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:37:10.315 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:10.315+0000 7f73c5b6f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:37:10.394 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:10.394+0000 7f73c5b6f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:37:10.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.403+0000 7ff6ac180700 1 -- 172.21.15.1:0/1138289472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6a40c3590 con 0x7ff6a40c5a90 2023-11-15T01:37:10.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.403+0000 7ff699ffb700 1 -- 172.21.15.1:0/1138289472 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff69404a9d0 con 0x7ff6a40c5a90 2023-11-15T01:37:10.404 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:37:10.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.405+0000 7ff6ac180700 1 -- 172.21.15.1:0/1138289472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff68805f330 msgr2=0x7ff6880617f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:10.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.405+0000 7ff6ac180700 1 --2- 172.21.15.1:0/1138289472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff68805f330 0x7ff6880617f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:10.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.405+0000 7ff6ac180700 1 -- 172.21.15.1:0/1138289472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6a40c5a90 msgr2=0x7ff6a40ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:10.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.405+0000 7ff6ac180700 1 --2- 172.21.15.1:0/1138289472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6a40c5a90 0x7ff6a40ace20 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7ff694001eb0 tx=0x7ff694007c70).stop 2023-11-15T01:37:10.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.405+0000 7ff6ac180700 1 -- 172.21.15.1:0/1138289472 shutdown_connections 2023-11-15T01:37:10.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.405+0000 7ff6ac180700 1 --2- 172.21.15.1:0/1138289472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff68805f330 0x7ff6880617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:10.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.405+0000 7ff6ac180700 1 --2- 172.21.15.1:0/1138289472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6a4154cb0 0x7ff6a414b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.405+0000 7ff6ac180700 1 --2- 172.21.15.1:0/1138289472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6a40c5a90 0x7ff6a40ace20 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.405+0000 7ff6ac180700 1 --2- 172.21.15.1:0/1138289472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6a414ec30 0x7ff6a414b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.405+0000 7ff6ac180700 1 -- 172.21.15.1:0/1138289472 >> 172.21.15.1:0/1138289472 conn(0x7ff6a40c8050 msgr2=0x7ff6a414d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:10.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.405+0000 7ff6ac180700 1 -- 172.21.15.1:0/1138289472 shutdown_connections 2023-11-15T01:37:10.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.405+0000 7ff6ac180700 1 -- 172.21.15.1:0/1138289472 wait complete. 2023-11-15T01:37:10.418 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:37:10.467 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:10.467+0000 7f73c5b6f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:37:10.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.537+0000 7f75c859a700 1 Processor -- start 2023-11-15T01:37:10.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.537+0000 7f75c859a700 1 -- start start 2023-11-15T01:37:10.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.538+0000 7f75c859a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c00c8120 0x7f75c00c8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.538+0000 7f75c859a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c0083630 con 0x7f75c0155b70 2023-11-15T01:37:10.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.538+0000 7f75c859a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c00c7c90 con 0x7f75c0155790 2023-11-15T01:37:10.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.538+0000 7f75c859a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c00c5420 con 0x7f75c00c8120 2023-11-15T01:37:10.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.538+0000 7f75c5b35700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f75c0155b70 0x7f75c00bee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42280/0 (socket says 172.21.15.1:42280) 2023-11-15T01:37:10.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.538+0000 7f75c5b35700 1 -- 172.21.15.1:0/614600539 learned_addr learned my addr 172.21.15.1:0/614600539 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:10.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.538+0000 7f75c6b37700 1 --2- 172.21.15.1:0/614600539 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c00c8120 0x7f75c00c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:10.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.538+0000 7f75c5334700 1 -- 172.21.15.1:0/614600539 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508211751 0 0) 0x7f75c0083630 con 0x7f75c0155b70 2023-11-15T01:37:10.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.538+0000 7f75c5334700 1 -- 172.21.15.1:0/614600539 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75ac0033f0 con 0x7f75c0155b70 2023-11-15T01:37:10.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.538+0000 7f75c5334700 1 -- 172.21.15.1:0/614600539 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507400318 0 0) 0x7f75c00c7c90 con 0x7f75c0155790 2023-11-15T01:37:10.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.538+0000 7f75c5334700 1 -- 172.21.15.1:0/614600539 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75c0083630 con 0x7f75c0155790 2023-11-15T01:37:10.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.538+0000 7f75c6b37700 1 -- 172.21.15.1:0/614600539 >> v1:172.21.15.141:6789/0 conn(0x7f75c0155790 legacy=0x7f75c00a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:10.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.538+0000 7f75c6b37700 1 -- 172.21.15.1:0/614600539 >> v1:172.21.15.1:6789/0 conn(0x7f75c0155b70 legacy=0x7f75c00bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:10.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.538+0000 7f75c6b37700 1 -- 172.21.15.1:0/614600539 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c00c7960 con 0x7f75c00c8120 2023-11-15T01:37:10.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.539+0000 7f75c6b37700 1 --2- 172.21.15.1:0/614600539 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c00c8120 0x7f75c00c8590 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f75b8009e90 tx=0x7f75b8009780).ready entity=mon.2 client_cookie=e4f08484c159d8c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:10.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.539+0000 7f75c5334700 1 -- 172.21.15.1:0/614600539 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b800e070 con 0x7f75c00c8120 2023-11-15T01:37:10.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.539+0000 7f75c5334700 1 -- 172.21.15.1:0/614600539 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b800bab0 con 0x7f75c00c8120 2023-11-15T01:37:10.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.539+0000 7f75c5334700 1 -- 172.21.15.1:0/614600539 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b800be30 con 0x7f75c00c8120 2023-11-15T01:37:10.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.539+0000 7f75c859a700 1 -- 172.21.15.1:0/614600539 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c00c8120 msgr2=0x7f75c00c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:10.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.539+0000 7f75c859a700 1 --2- 172.21.15.1:0/614600539 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c00c8120 0x7f75c00c8590 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f75b8009e90 tx=0x7f75b8009780).stop 2023-11-15T01:37:10.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.539+0000 7f75c859a700 1 -- 172.21.15.1:0/614600539 shutdown_connections 2023-11-15T01:37:10.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.539+0000 7f75c859a700 1 --2- 172.21.15.1:0/614600539 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c00c8120 0x7f75c00c8590 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.539+0000 7f75c859a700 1 -- 172.21.15.1:0/614600539 >> 172.21.15.1:0/614600539 conn(0x7f75c0082f90 msgr2=0x7f75c00c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:10.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.539+0000 7f75c859a700 1 -- 172.21.15.1:0/614600539 shutdown_connections 2023-11-15T01:37:10.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.539+0000 7f75c859a700 1 -- 172.21.15.1:0/614600539 wait complete. 2023-11-15T01:37:10.545 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:10.543+0000 7f5292392680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:37:10.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.540+0000 7f75c859a700 1 Processor -- start 2023-11-15T01:37:10.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.540+0000 7f75c859a700 1 -- start start 2023-11-15T01:37:10.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.541+0000 7f75c859a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75c00c8120 0x7f75c0152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.541+0000 7f75c859a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c0155790 0x7f75c0157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.541+0000 7f75c859a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75c0155b70 0x7f75c00aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.541+0000 7f75c859a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c00c1120 con 0x7f75c00c8120 2023-11-15T01:37:10.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.541+0000 7f75c859a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c0158ef0 con 0x7f75c0155b70 2023-11-15T01:37:10.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.541+0000 7f75c859a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c00c13e0 con 0x7f75c0155790 2023-11-15T01:37:10.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.541+0000 7f75c6336700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75c00c8120 0x7f75c0152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:10.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.541+0000 7f75c6336700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75c00c8120 0x7f75c0152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40698/0 (socket says 172.21.15.1:40698) 2023-11-15T01:37:10.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.541+0000 7f75c6336700 1 -- 172.21.15.1:0/1581155414 learned_addr learned my addr 172.21.15.1:0/1581155414 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:10.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.541+0000 7f75c5b35700 1 --2- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c0155790 0x7f75c0157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:10.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.541+0000 7f75c6b37700 1 --2- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75c0155b70 0x7f75c00aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:10.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.542+0000 7f75c6336700 1 -- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c0155790 msgr2=0x7f75c0157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:10.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.542+0000 7f75c6336700 1 --2- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c0155790 0x7f75c0157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.542+0000 7f75c6336700 1 -- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75c0155b70 msgr2=0x7f75c00aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:10.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.542+0000 7f75c6336700 1 --2- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75c0155b70 0x7f75c00aa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.542+0000 7f75c6336700 1 -- 172.21.15.1:0/1581155414 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b8009a20 con 0x7f75c00c8120 2023-11-15T01:37:10.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.542+0000 7f75c6336700 1 --2- 172.21.15.1:0/1581155414 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75c00c8120 0x7f75c0152470 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f75bc00c4c0 tx=0x7f75bc007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:10.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.542+0000 7f75b67fc700 1 -- 172.21.15.1:0/1581155414 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00ce30 con 0x7f75c00c8120 2023-11-15T01:37:10.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.542+0000 7f75b67fc700 1 -- 172.21.15.1:0/1581155414 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc00f470 con 0x7f75c00c8120 2023-11-15T01:37:10.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.542+0000 7f75b67fc700 1 -- 172.21.15.1:0/1581155414 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00f810 con 0x7f75c00c8120 2023-11-15T01:37:10.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.542+0000 7f75c859a700 1 -- 172.21.15.1:0/1581155414 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c0158650 con 0x7f75c00c8120 2023-11-15T01:37:10.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.542+0000 7f75c859a700 1 -- 172.21.15.1:0/1581155414 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c0158c10 con 0x7f75c00c8120 2023-11-15T01:37:10.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.543+0000 7f75c859a700 1 -- 172.21.15.1:0/1581155414 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c006c7e0 con 0x7f75c00c8120 2023-11-15T01:37:10.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.543+0000 7f75b67fc700 1 -- 172.21.15.1:0/1581155414 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 36) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f75bc00fbc0 con 0x7f75c00c8120 2023-11-15T01:37:10.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.544+0000 7f75b67fc700 1 --2- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75a405f300 0x7f75a40617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.544+0000 7f75c5b35700 1 -- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75a405f300 msgr2=0x7f75a40617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:10.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.544+0000 7f75b67fc700 1 -- 172.21.15.1:0/1581155414 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f75bc079bf0 con 0x7f75c00c8120 2023-11-15T01:37:10.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.544+0000 7f75c5b35700 1 --2- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75a405f300 0x7f75a40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:10.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.548+0000 7f75b67fc700 1 -- 172.21.15.1:0/1581155414 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f75bc04a9b0 con 0x7f75c00c8120 2023-11-15T01:37:10.728 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:10.727+0000 7f5292392680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:37:10.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.745+0000 7f75c5b35700 1 -- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75a405f300 msgr2=0x7f75a40617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:10.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.745+0000 7f75c5b35700 1 --2- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75a405f300 0x7f75a40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:37:10.746 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:10.746+0000 7f73c5b6f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:37:10.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.766+0000 7f75c859a700 1 -- 172.21.15.1:0/1581155414 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75c005f8b0 con 0x7f75c00c8120 2023-11-15T01:37:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.766+0000 7f75b67fc700 1 -- 172.21.15.1:0/1581155414 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f75bc04dfd0 con 0x7f75c00c8120 2023-11-15T01:37:10.767 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:10.767 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2863729575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2863729575},{"type":"v1","addr":"172.21.15.141:6836","nonce":2863729575}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/4111210566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":4111210566},{"type":"v1","addr":"172.21.15.141:6837","nonce":4111210566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6696,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/4099031019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4099031019},{"type":"v1","addr":"172.21.15.1:6834","nonce":4099031019}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:36:54.262333+0000","modified":"2023-11-15T01:36:57.273246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6699":{"gid":6699,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/1737301018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1737301018},{"type":"v1","addr":"172.21.15.1:6835","nonce":1737301018}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-11-15T01:37:10.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.769+0000 7f75c859a700 1 -- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75a405f300 msgr2=0x7f75a40617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:10.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.769+0000 7f75c859a700 1 --2- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75a405f300 0x7f75a40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:10.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.769+0000 7f75c859a700 1 -- 172.21.15.1:0/1581155414 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75c00c8120 msgr2=0x7f75c0152470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:10.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.769+0000 7f75c859a700 1 --2- 172.21.15.1:0/1581155414 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75c00c8120 0x7f75c0152470 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f75bc00c4c0 tx=0x7f75bc007c80).stop 2023-11-15T01:37:10.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.769+0000 7f75c859a700 1 -- 172.21.15.1:0/1581155414 shutdown_connections 2023-11-15T01:37:10.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.769+0000 7f75c859a700 1 --2- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75a405f300 0x7f75a40617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:10.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.769+0000 7f75c859a700 1 --2- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75c0155b70 0x7f75c00aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.769+0000 7f75c859a700 1 --2- 172.21.15.1:0/1581155414 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75c00c8120 0x7f75c0152470 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.769+0000 7f75c859a700 1 --2- 172.21.15.1:0/1581155414 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c0155790 0x7f75c0157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.769+0000 7f75c859a700 1 -- 172.21.15.1:0/1581155414 >> 172.21.15.1:0/1581155414 conn(0x7f75c0082f90 msgr2=0x7f75c00c6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.769+0000 7f75c859a700 1 -- 172.21.15.1:0/1581155414 shutdown_connections 2023-11-15T01:37:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.769+0000 7f75c859a700 1 -- 172.21.15.1:0/1581155414 wait complete. 2023-11-15T01:37:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 39 2023-11-15T01:37:10.782 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:37:10.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.906+0000 7fa602320700 1 Processor -- start 2023-11-15T01:37:10.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.906+0000 7fa602320700 1 -- start start 2023-11-15T01:37:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa602320700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa5fc155790 0x7fa5fc0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa602320700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa5fc155b70 0x7fa5fc0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa602320700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5fc0a61b0 0x7fa5fc0c8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa602320700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5fc0c5420 con 0x7fa5fc155790 2023-11-15T01:37:10.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa602320700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5fc083630 con 0x7fa5fc155b70 2023-11-15T01:37:10.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa602320700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc0c7c90 con 0x7fa5fc0a61b0 2023-11-15T01:37:10.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa5fbfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa5fc155790 0x7fa5fc0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:10.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa5fbfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa5fc155790 0x7fa5fc0a5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40702/0 (socket says 172.21.15.1:40702) 2023-11-15T01:37:10.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa5fbfff700 1 -- 172.21.15.1:0/2849011585 learned_addr learned my addr 172.21.15.1:0/2849011585 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:10.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa5f3fff700 1 --2- 172.21.15.1:0/2849011585 >> v2:172.21.15.141:3300/0 conn(0x7fa5fc155b70 0x7fa5fc0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:10.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa6008bd700 1 --2- 172.21.15.1:0/2849011585 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5fc0a61b0 0x7fa5fc0c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:10.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa5fbfff700 1 -- 172.21.15.1:0/2849011585 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5fc0a61b0 msgr2=0x7fa5fc0c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:10.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa5fbfff700 1 --2- 172.21.15.1:0/2849011585 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5fc0a61b0 0x7fa5fc0c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa5fbfff700 1 -- 172.21.15.1:0/2849011585 >> v2:172.21.15.141:3300/0 conn(0x7fa5fc155b70 msgr2=0x7fa5fc0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:10.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa5fbfff700 1 --2- 172.21.15.1:0/2849011585 >> v2:172.21.15.141:3300/0 conn(0x7fa5fc155b70 0x7fa5fc0c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa5fbfff700 1 -- 172.21.15.1:0/2849011585 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc0c8b00 con 0x7fa5fc155790 2023-11-15T01:37:10.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.907+0000 7fa5fbfff700 1 --2- 172.21.15.1:0/2849011585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5fc155790 0x7fa5fc0a5cc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7fa5fc06a7f0 tx=0x7fa5ec009060).ready entity=mon.0 client_cookie=12b260beaf124ac server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:10.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.908+0000 7fa5fb7fe700 1 -- 172.21.15.1:0/2849011585 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec005880 con 0x7fa5fc155790 2023-11-15T01:37:10.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.908+0000 7fa5fb7fe700 1 -- 172.21.15.1:0/2849011585 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec0059e0 con 0x7fa5fc155790 2023-11-15T01:37:10.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.908+0000 7fa5fb7fe700 1 -- 172.21.15.1:0/2849011585 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec005d60 con 0x7fa5fc155790 2023-11-15T01:37:10.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.908+0000 7fa602320700 1 -- 172.21.15.1:0/2849011585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5fc155790 msgr2=0x7fa5fc0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:10.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.908+0000 7fa602320700 1 --2- 172.21.15.1:0/2849011585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5fc155790 0x7fa5fc0a5cc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7fa5fc06a7f0 tx=0x7fa5ec009060).stop 2023-11-15T01:37:10.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.908+0000 7fa602320700 1 -- 172.21.15.1:0/2849011585 shutdown_connections 2023-11-15T01:37:10.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.908+0000 7fa602320700 1 --2- 172.21.15.1:0/2849011585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5fc155790 0x7fa5fc0a5cc0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.908+0000 7fa602320700 1 --2- 172.21.15.1:0/2849011585 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5fc0a61b0 0x7fa5fc0c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.908+0000 7fa602320700 1 --2- 172.21.15.1:0/2849011585 >> v2:172.21.15.141:3300/0 conn(0x7fa5fc155b70 0x7fa5fc0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.908+0000 7fa602320700 1 -- 172.21.15.1:0/2849011585 >> 172.21.15.1:0/2849011585 conn(0x7fa5fc082f90 msgr2=0x7fa5fc0c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:10.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.908+0000 7fa602320700 1 -- 172.21.15.1:0/2849011585 shutdown_connections 2023-11-15T01:37:10.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.908+0000 7fa602320700 1 -- 172.21.15.1:0/2849011585 wait complete. 2023-11-15T01:37:10.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.910+0000 7fa602320700 1 Processor -- start 2023-11-15T01:37:10.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.910+0000 7fa602320700 1 -- start start 2023-11-15T01:37:10.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.910+0000 7fa602320700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5fc0a61b0 0x7fa5fc0bf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.910+0000 7fa602320700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5fc155790 0x7fa5fc1541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.910+0000 7fa602320700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5fc155b70 0x7fa5fc0abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.910+0000 7fa602320700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc1517a0 con 0x7fa5fc0a61b0 2023-11-15T01:37:10.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.910+0000 7fa602320700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc063a60 con 0x7fa5fc155b70 2023-11-15T01:37:10.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.910+0000 7fa602320700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc063d40 con 0x7fa5fc155790 2023-11-15T01:37:10.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.910+0000 7fa5fbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5fc0a61b0 0x7fa5fc0bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:10.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.910+0000 7fa5fbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5fc0a61b0 0x7fa5fc0bf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40714/0 (socket says 172.21.15.1:40714) 2023-11-15T01:37:10.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.910+0000 7fa5fbfff700 1 -- 172.21.15.1:0/236430755 learned_addr learned my addr 172.21.15.1:0/236430755 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:10.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.911+0000 7fa5f3fff700 1 --2- 172.21.15.1:0/236430755 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5fc155790 0x7fa5fc1541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:10.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.911+0000 7fa6008bd700 1 --2- 172.21.15.1:0/236430755 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5fc155b70 0x7fa5fc0abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:10.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.911+0000 7fa5fbfff700 1 -- 172.21.15.1:0/236430755 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5fc155790 msgr2=0x7fa5fc1541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:10.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.911+0000 7fa5fbfff700 1 --2- 172.21.15.1:0/236430755 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5fc155790 0x7fa5fc1541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.911+0000 7fa5fbfff700 1 -- 172.21.15.1:0/236430755 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5fc155b70 msgr2=0x7fa5fc0abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:10.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.911+0000 7fa5fbfff700 1 --2- 172.21.15.1:0/236430755 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5fc155b70 0x7fa5fc0abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:10.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.911+0000 7fa5fbfff700 1 -- 172.21.15.1:0/236430755 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec009300 con 0x7fa5fc0a61b0 2023-11-15T01:37:10.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.911+0000 7fa5fbfff700 1 --2- 172.21.15.1:0/236430755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5fc0a61b0 0x7fa5fc0bf550 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fa5fc0665a0 tx=0x7fa5ec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:10.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.911+0000 7fa5f8ff9700 1 -- 172.21.15.1:0/236430755 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec00f720 con 0x7fa5fc0a61b0 2023-11-15T01:37:10.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.911+0000 7fa5f8ff9700 1 -- 172.21.15.1:0/236430755 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec00f880 con 0x7fa5fc0a61b0 2023-11-15T01:37:10.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.911+0000 7fa602320700 1 -- 172.21.15.1:0/236430755 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5fc064020 con 0x7fa5fc0a61b0 2023-11-15T01:37:10.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.911+0000 7fa5f8ff9700 1 -- 172.21.15.1:0/236430755 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec00fc40 con 0x7fa5fc0a61b0 2023-11-15T01:37:10.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.911+0000 7fa602320700 1 -- 172.21.15.1:0/236430755 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5fc0645e0 con 0x7fa5fc0a61b0 2023-11-15T01:37:10.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.912+0000 7fa602320700 1 -- 172.21.15.1:0/236430755 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5fc064800 con 0x7fa5fc0a61b0 2023-11-15T01:37:10.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.912+0000 7fa5f8ff9700 1 -- 172.21.15.1:0/236430755 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 36) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fa5ec018070 con 0x7fa5fc0a61b0 2023-11-15T01:37:10.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.913+0000 7fa5f8ff9700 1 --2- 172.21.15.1:0/236430755 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa5dc05f300 0x7fa5dc0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:10.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.913+0000 7fa5f3fff700 1 -- 172.21.15.1:0/236430755 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa5dc05f300 msgr2=0x7fa5dc0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:10.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.913+0000 7fa5f8ff9700 1 -- 172.21.15.1:0/236430755 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fa5ec07abb0 con 0x7fa5fc0a61b0 2023-11-15T01:37:10.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.913+0000 7fa5f3fff700 1 --2- 172.21.15.1:0/236430755 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa5dc05f300 0x7fa5dc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:10.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:10.917+0000 7fa5f8ff9700 1 -- 172.21.15.1:0/236430755 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa5ec081080 con 0x7fa5fc0a61b0 2023-11-15T01:37:10.942 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:10.942+0000 7f73c5b6f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:37:11.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.091+0000 7fa602320700 1 -- 172.21.15.1:0/236430755 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5fc06c7e0 con 0x7fa5fc0a61b0 2023-11-15T01:37:11.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.092+0000 7fa5f8ff9700 1 -- 172.21.15.1:0/236430755 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+17900 (secure 0 0 0) 0x7fa5ec020020 con 0x7fa5fc0a61b0 2023-11-15T01:37:11.093 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:11.093 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":95,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:37:06.051491+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:36:51.906477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-11-15T01:36:53.240462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:6833/90546":"2023-11-16T01:37:06.051446+0000","172.21.15.141:6832/90546":"2023-11-16T01:37:06.051446+0000","172.21.15.141:0/1004505685":"2023-11-16T01:37:06.051446+0000","172.21.15.141:0/3554724124":"2023-11-16T01:37:06.051446+0000","172.21.15.141:0/2782194221":"2023-11-16T01:37:06.051446+0000","172.21.15.141:0/1118138396":"2023-11-16T01:37:06.051446+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:37:11.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.094+0000 7fa602320700 1 -- 172.21.15.1:0/236430755 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa5dc05f300 msgr2=0x7fa5dc0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:11.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.094+0000 7fa602320700 1 --2- 172.21.15.1:0/236430755 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa5dc05f300 0x7fa5dc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:11.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.094+0000 7fa602320700 1 -- 172.21.15.1:0/236430755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5fc0a61b0 msgr2=0x7fa5fc0bf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.094+0000 7fa602320700 1 --2- 172.21.15.1:0/236430755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5fc0a61b0 0x7fa5fc0bf550 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fa5fc0665a0 tx=0x7fa5ec016000).stop 2023-11-15T01:37:11.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.094+0000 7fa602320700 1 -- 172.21.15.1:0/236430755 shutdown_connections 2023-11-15T01:37:11.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.094+0000 7fa602320700 1 --2- 172.21.15.1:0/236430755 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa5dc05f300 0x7fa5dc0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:11.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.094+0000 7fa602320700 1 --2- 172.21.15.1:0/236430755 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5fc155b70 0x7fa5fc0abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.094+0000 7fa602320700 1 --2- 172.21.15.1:0/236430755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5fc0a61b0 0x7fa5fc0bf550 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.094+0000 7fa602320700 1 --2- 172.21.15.1:0/236430755 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5fc155790 0x7fa5fc1541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.094+0000 7fa602320700 1 -- 172.21.15.1:0/236430755 >> 172.21.15.1:0/236430755 conn(0x7fa5fc082f90 msgr2=0x7fa5fc067700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:11.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.094+0000 7fa602320700 1 -- 172.21.15.1:0/236430755 shutdown_connections 2023-11-15T01:37:11.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.094+0000 7fa602320700 1 -- 172.21.15.1:0/236430755 wait complete. 2023-11-15T01:37:11.107 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-15T01:37:11.107 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:37:11.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.227+0000 7fc13176d700 1 Processor -- start 2023-11-15T01:37:11.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.227+0000 7fc13176d700 1 -- start start 2023-11-15T01:37:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc13176d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc12c154150 0x7fc12c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc13176d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc12c0aa060 0x7fc12c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc13176d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc12c0c06f0 con 0x7fc12c0ab1a0 2023-11-15T01:37:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc13176d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12c0c09d0 con 0x7fc12c154150 2023-11-15T01:37:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc13176d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12c158820 con 0x7fc12c0aa060 2023-11-15T01:37:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc12affd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc12c154150 0x7fc12c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc12a7fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc12c0ab1a0 0x7fc12c158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42288/0 (socket says 172.21.15.1:42288) 2023-11-15T01:37:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc12a7fc700 1 -- 172.21.15.1:0/2592511286 learned_addr learned my addr 172.21.15.1:0/2592511286 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc12affd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc12c154150 0x7fc12c154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40720/0 (socket says 172.21.15.1:40720) 2023-11-15T01:37:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc12b7fe700 1 --2- 172.21.15.1:0/2592511286 >> v2:172.21.15.141:3300/0 conn(0x7fc12c0aa060 0x7fc12c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc12affd700 1 -- 172.21.15.1:0/2592511286 >> v2:172.21.15.141:3300/0 conn(0x7fc12c0aa060 msgr2=0x7fc12c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc12affd700 1 --2- 172.21.15.1:0/2592511286 >> v2:172.21.15.141:3300/0 conn(0x7fc12c0aa060 0x7fc12c0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc129ffb700 1 -- 172.21.15.1:0/2592511286 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722157624 0 0) 0x7fc12c0c06f0 con 0x7fc12c0ab1a0 2023-11-15T01:37:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc12affd700 1 -- 172.21.15.1:0/2592511286 >> v1:172.21.15.1:6789/0 conn(0x7fc12c0ab1a0 legacy=0x7fc12c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc12affd700 1 -- 172.21.15.1:0/2592511286 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c158b00 con 0x7fc12c154150 2023-11-15T01:37:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.228+0000 7fc12affd700 1 --2- 172.21.15.1:0/2592511286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc12c154150 0x7fc12c154530 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7fc12c157f80 tx=0x7fc11c009060).ready entity=mon.0 client_cookie=75b6af21026e4387 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.229+0000 7fc129ffb700 1 -- 172.21.15.1:0/2592511286 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c0090d0 con 0x7fc12c154150 2023-11-15T01:37:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.229+0000 7fc129ffb700 1 -- 172.21.15.1:0/2592511286 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c00f510 con 0x7fc12c154150 2023-11-15T01:37:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.229+0000 7fc129ffb700 1 -- 172.21.15.1:0/2592511286 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00f890 con 0x7fc12c154150 2023-11-15T01:37:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.229+0000 7fc13176d700 1 -- 172.21.15.1:0/2592511286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc12c154150 msgr2=0x7fc12c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.229+0000 7fc13176d700 1 --2- 172.21.15.1:0/2592511286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc12c154150 0x7fc12c154530 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7fc12c157f80 tx=0x7fc11c009060).stop 2023-11-15T01:37:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.229+0000 7fc13176d700 1 -- 172.21.15.1:0/2592511286 shutdown_connections 2023-11-15T01:37:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.229+0000 7fc13176d700 1 --2- 172.21.15.1:0/2592511286 >> v2:172.21.15.141:3300/0 conn(0x7fc12c0aa060 0x7fc12c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.229+0000 7fc13176d700 1 --2- 172.21.15.1:0/2592511286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc12c154150 0x7fc12c154530 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.229+0000 7fc13176d700 1 -- 172.21.15.1:0/2592511286 >> 172.21.15.1:0/2592511286 conn(0x7fc12c064aa0 msgr2=0x7fc12c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.229+0000 7fc13176d700 1 -- 172.21.15.1:0/2592511286 shutdown_connections 2023-11-15T01:37:11.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.229+0000 7fc13176d700 1 -- 172.21.15.1:0/2592511286 wait complete. 2023-11-15T01:37:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.230+0000 7fc13176d700 1 Processor -- start 2023-11-15T01:37:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.231+0000 7fc13176d700 1 -- start start 2023-11-15T01:37:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.231+0000 7fc13176d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc12c0aa060 0x7fc12c0ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.231+0000 7fc13176d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc12c0ab1a0 0x7fc12c0c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.231+0000 7fc13176d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc12c154150 0x7fc12c0c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.231+0000 7fc13176d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c0c84f0 con 0x7fc12c0aa060 2023-11-15T01:37:11.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.231+0000 7fc13176d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c0ae870 con 0x7fc12c154150 2023-11-15T01:37:11.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.231+0000 7fc13176d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c155240 con 0x7fc12c0ab1a0 2023-11-15T01:37:11.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.231+0000 7fc12affd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc12c0aa060 0x7fc12c0ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:11.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.231+0000 7fc12affd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc12c0aa060 0x7fc12c0ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40724/0 (socket says 172.21.15.1:40724) 2023-11-15T01:37:11.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.231+0000 7fc12affd700 1 -- 172.21.15.1:0/2091252713 learned_addr learned my addr 172.21.15.1:0/2091252713 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:11.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.231+0000 7fc12a7fc700 1 --2- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc12c0ab1a0 0x7fc12c0c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:11.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.231+0000 7fc12b7fe700 1 --2- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc12c154150 0x7fc12c0c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:11.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.232+0000 7fc12affd700 1 -- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc12c0ab1a0 msgr2=0x7fc12c0c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.232+0000 7fc12affd700 1 --2- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc12c0ab1a0 0x7fc12c0c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.232+0000 7fc12affd700 1 -- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc12c154150 msgr2=0x7fc12c0c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.232+0000 7fc12affd700 1 --2- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc12c154150 0x7fc12c0c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.232+0000 7fc12affd700 1 -- 172.21.15.1:0/2091252713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c0092a0 con 0x7fc12c0aa060 2023-11-15T01:37:11.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.232+0000 7fc12affd700 1 --2- 172.21.15.1:0/2091252713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc12c0aa060 0x7fc12c0ae380 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7fc11c009dd0 tx=0x7fc11c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:11.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.232+0000 7fc112ffd700 1 -- 172.21.15.1:0/2091252713 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00f890 con 0x7fc12c0aa060 2023-11-15T01:37:11.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.232+0000 7fc112ffd700 1 -- 172.21.15.1:0/2091252713 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c00fc50 con 0x7fc12c0aa060 2023-11-15T01:37:11.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.232+0000 7fc13176d700 1 -- 172.21.15.1:0/2091252713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12c155ae0 con 0x7fc12c0aa060 2023-11-15T01:37:11.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.232+0000 7fc112ffd700 1 -- 172.21.15.1:0/2091252713 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c01b440 con 0x7fc12c0aa060 2023-11-15T01:37:11.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.232+0000 7fc13176d700 1 -- 172.21.15.1:0/2091252713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12c155490 con 0x7fc12c0aa060 2023-11-15T01:37:11.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.233+0000 7fc13176d700 1 -- 172.21.15.1:0/2091252713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12c06c7e0 con 0x7fc12c0aa060 2023-11-15T01:37:11.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.233+0000 7fc112ffd700 1 -- 172.21.15.1:0/2091252713 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 36) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fc11c01b7f0 con 0x7fc12c0aa060 2023-11-15T01:37:11.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.234+0000 7fc112ffd700 1 --2- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc11805f300 0x7fc1180617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.234+0000 7fc112ffd700 1 -- 172.21.15.1:0/2091252713 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fc11c07bcc0 con 0x7fc12c0aa060 2023-11-15T01:37:11.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.234+0000 7fc12a7fc700 1 -- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc11805f300 msgr2=0x7fc1180617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:11.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.234+0000 7fc12a7fc700 1 --2- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc11805f300 0x7fc1180617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:11.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.238+0000 7fc112ffd700 1 -- 172.21.15.1:0/2091252713 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc11c04cae0 con 0x7fc12c0aa060 2023-11-15T01:37:11.376 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:11.375+0000 7f5292392680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:37:11.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.435+0000 7fc12a7fc700 1 -- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc11805f300 msgr2=0x7fc1180617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:11.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.435+0000 7fc12a7fc700 1 --2- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc11805f300 0x7fc1180617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:37:11.443 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:11.443+0000 7f5292392680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:37:11.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.454+0000 7fc13176d700 1 -- 172.21.15.1:0/2091252713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc12c158de0 con 0x7fc12c0aa060 2023-11-15T01:37:11.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.454+0000 7fc112ffd700 1 -- 172.21.15.1:0/2091252713 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fc11c050100 con 0x7fc12c0aa060 2023-11-15T01:37:11.455 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:11.455 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2863729575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2863729575},{"type":"v1","addr":"172.21.15.141:6836","nonce":2863729575}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/4111210566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":4111210566},{"type":"v1","addr":"172.21.15.141:6837","nonce":4111210566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6696,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/4099031019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4099031019},{"type":"v1","addr":"172.21.15.1:6834","nonce":4099031019}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:36:54.262333+0000","modified":"2023-11-15T01:36:57.273246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6699":{"gid":6699,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/1737301018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1737301018},{"type":"v1","addr":"172.21.15.1:6835","nonce":1737301018}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-11-15T01:37:11.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.456+0000 7fc13176d700 1 -- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc11805f300 msgr2=0x7fc1180617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:11.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.456+0000 7fc13176d700 1 --2- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc11805f300 0x7fc1180617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:11.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.456+0000 7fc13176d700 1 -- 172.21.15.1:0/2091252713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc12c0aa060 msgr2=0x7fc12c0ae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.456+0000 7fc13176d700 1 --2- 172.21.15.1:0/2091252713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc12c0aa060 0x7fc12c0ae380 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7fc11c009dd0 tx=0x7fc11c017000).stop 2023-11-15T01:37:11.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.456+0000 7fc13176d700 1 -- 172.21.15.1:0/2091252713 shutdown_connections 2023-11-15T01:37:11.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.456+0000 7fc13176d700 1 --2- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc11805f300 0x7fc1180617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:11.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.456+0000 7fc13176d700 1 --2- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc12c154150 0x7fc12c0c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.456+0000 7fc13176d700 1 --2- 172.21.15.1:0/2091252713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc12c0aa060 0x7fc12c0ae380 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.456+0000 7fc13176d700 1 --2- 172.21.15.1:0/2091252713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc12c0ab1a0 0x7fc12c0c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.456+0000 7fc13176d700 1 -- 172.21.15.1:0/2091252713 >> 172.21.15.1:0/2091252713 conn(0x7fc12c064aa0 msgr2=0x7fc12c063eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:11.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.456+0000 7fc13176d700 1 -- 172.21.15.1:0/2091252713 shutdown_connections 2023-11-15T01:37:11.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.456+0000 7fc13176d700 1 -- 172.21.15.1:0/2091252713 wait complete. 2023-11-15T01:37:11.459 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 39 2023-11-15T01:37:11.469 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:37:11.518 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:11.517+0000 7f5292392680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:37:11.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.594+0000 7f7d13994700 1 Processor -- start 2023-11-15T01:37:11.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.594+0000 7f7d13994700 1 -- start start 2023-11-15T01:37:11.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.595+0000 7f7d13994700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d0c0ab1a0 0x7f7d0c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.595+0000 7f7d13994700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c0c06f0 con 0x7f7d0c0aa060 2023-11-15T01:37:11.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.595+0000 7f7d13994700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c0c09d0 con 0x7f7d0c154150 2023-11-15T01:37:11.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.595+0000 7f7d13994700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c158820 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.595+0000 7f7d11f31700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7d0c0aa060 0x7f7d0c0c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42302/0 (socket says 172.21.15.1:42302) 2023-11-15T01:37:11.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.595+0000 7f7d11f31700 1 -- 172.21.15.1:0/774290633 learned_addr learned my addr 172.21.15.1:0/774290633 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:11.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.595+0000 7f7d10f2f700 1 --2- 172.21.15.1:0/774290633 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d0c0ab1a0 0x7f7d0c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:11.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.595+0000 7f7d03fff700 1 -- 172.21.15.1:0/774290633 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418886854 0 0) 0x7f7d0c0c06f0 con 0x7f7d0c0aa060 2023-11-15T01:37:11.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.595+0000 7f7d03fff700 1 -- 172.21.15.1:0/774290633 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cf80033f0 con 0x7f7d0c0aa060 2023-11-15T01:37:11.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.595+0000 7f7d03fff700 1 -- 172.21.15.1:0/774290633 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174541842 0 0) 0x7f7d0c0c09d0 con 0x7f7d0c154150 2023-11-15T01:37:11.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.595+0000 7f7d03fff700 1 -- 172.21.15.1:0/774290633 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d0c0c06f0 con 0x7f7d0c154150 2023-11-15T01:37:11.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.595+0000 7f7d10f2f700 1 -- 172.21.15.1:0/774290633 >> v1:172.21.15.141:6789/0 conn(0x7f7d0c154150 legacy=0x7f7d0c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.595+0000 7f7d10f2f700 1 -- 172.21.15.1:0/774290633 >> v1:172.21.15.1:6789/0 conn(0x7f7d0c0aa060 legacy=0x7f7d0c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.595+0000 7f7d10f2f700 1 -- 172.21.15.1:0/774290633 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c158b00 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.596+0000 7f7d10f2f700 1 --2- 172.21.15.1:0/774290633 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d0c0ab1a0 0x7f7d0c154530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f7cfc009790 tx=0x7f7cfc009060).ready entity=mon.2 client_cookie=f323b12e8bffce7a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:11.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.596+0000 7f7d03fff700 1 -- 172.21.15.1:0/774290633 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0090d0 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.596+0000 7f7d03fff700 1 -- 172.21.15.1:0/774290633 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00f510 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.596+0000 7f7d03fff700 1 -- 172.21.15.1:0/774290633 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00f890 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.596+0000 7f7d13994700 1 -- 172.21.15.1:0/774290633 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d0c0ab1a0 msgr2=0x7f7d0c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.596+0000 7f7d13994700 1 --2- 172.21.15.1:0/774290633 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d0c0ab1a0 0x7f7d0c154530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f7cfc009790 tx=0x7f7cfc009060).stop 2023-11-15T01:37:11.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.596+0000 7f7d13994700 1 -- 172.21.15.1:0/774290633 shutdown_connections 2023-11-15T01:37:11.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.596+0000 7f7d13994700 1 --2- 172.21.15.1:0/774290633 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d0c0ab1a0 0x7f7d0c154530 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.596+0000 7f7d13994700 1 -- 172.21.15.1:0/774290633 >> 172.21.15.1:0/774290633 conn(0x7f7d0c064aa0 msgr2=0x7f7d0c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:11.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.596+0000 7f7d13994700 1 -- 172.21.15.1:0/774290633 shutdown_connections 2023-11-15T01:37:11.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.596+0000 7f7d13994700 1 -- 172.21.15.1:0/774290633 wait complete. 2023-11-15T01:37:11.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.597+0000 7f7d13994700 1 Processor -- start 2023-11-15T01:37:11.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.598+0000 7f7d13994700 1 -- start start 2023-11-15T01:37:11.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.598+0000 7f7d13994700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d0c0aa060 0x7f7d0c165500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.598+0000 7f7d13994700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d0c0ab1a0 0x7f7d0c1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.598+0000 7f7d13994700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d0c154150 0x7f7d0c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.598+0000 7f7d13994700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c157200 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.598+0000 7f7d13994700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c0ae030 con 0x7f7d0c0aa060 2023-11-15T01:37:11.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.598+0000 7f7d13994700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c157990 con 0x7f7d0c154150 2023-11-15T01:37:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d10f2f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d0c0ab1a0 0x7f7d0c1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d10f2f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d0c0ab1a0 0x7f7d0c1574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40728/0 (socket says 172.21.15.1:40728) 2023-11-15T01:37:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d10f2f700 1 -- 172.21.15.1:0/3145968856 learned_addr learned my addr 172.21.15.1:0/3145968856 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d11f31700 1 --2- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d0c154150 0x7f7d0c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d11730700 1 --2- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d0c0aa060 0x7f7d0c165500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d10f2f700 1 -- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d0c154150 msgr2=0x7f7d0c150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d10f2f700 1 --2- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d0c154150 0x7f7d0c150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d10f2f700 1 -- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d0c0aa060 msgr2=0x7f7d0c165500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d10f2f700 1 --2- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d0c0aa060 0x7f7d0c165500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d10f2f700 1 -- 172.21.15.1:0/3145968856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc0092a0 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d10f2f700 1 --2- 172.21.15.1:0/3145968856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d0c0ab1a0 0x7f7d0c1574a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f7d0c062af0 tx=0x7f7cfc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d017fa700 1 -- 172.21.15.1:0/3145968856 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00f890 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d017fa700 1 -- 172.21.15.1:0/3145968856 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00fc50 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d13994700 1 -- 172.21.15.1:0/3145968856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c1648a0 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d017fa700 1 -- 172.21.15.1:0/3145968856 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc01b410 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.599+0000 7f7d13994700 1 -- 172.21.15.1:0/3145968856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c164e60 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.600+0000 7f7d13994700 1 -- 172.21.15.1:0/3145968856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c06c7e0 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.601+0000 7f7d017fa700 1 -- 172.21.15.1:0/3145968856 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 36) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f7cfc01b780 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.601+0000 7f7d017fa700 1 --2- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7cf005f300 0x7f7cf00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.601+0000 7f7d017fa700 1 -- 172.21.15.1:0/3145968856 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f7cfc07bf50 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.601+0000 7f7d11730700 1 -- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7cf005f300 msgr2=0x7f7cf00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.601+0000 7f7d11730700 1 --2- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7cf005f300 0x7f7cf00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.605+0000 7f7d017fa700 1 -- 172.21.15.1:0/3145968856 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7cfc0aaaf0 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.645 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:11.645+0000 7f73c5b6f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:37:11.665 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:11.664+0000 7f5292392680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:37:11.719 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:11.718+0000 7f73c5b6f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:37:11.736 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:11.735+0000 7f5292392680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:37:11.798 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:11.798+0000 7f73c5b6f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:37:11.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.802+0000 7f7d11730700 1 -- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7cf005f300 msgr2=0x7f7cf00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:11.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.802+0000 7f7d11730700 1 --2- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7cf005f300 0x7f7cf00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:37:11.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.822+0000 7f7d13994700 1 -- 172.21.15.1:0/3145968856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d0c158de0 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.822+0000 7f7d017fa700 1 -- 172.21.15.1:0/3145968856 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f7cfc04cd70 con 0x7f7d0c0ab1a0 2023-11-15T01:37:11.823 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:11.823 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2863729575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2863729575},{"type":"v1","addr":"172.21.15.141:6836","nonce":2863729575}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/4111210566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":4111210566},{"type":"v1","addr":"172.21.15.141:6837","nonce":4111210566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6696,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/4099031019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4099031019},{"type":"v1","addr":"172.21.15.1:6834","nonce":4099031019}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:36:54.262333+0000","modified":"2023-11-15T01:36:57.273246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6699":{"gid":6699,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/1737301018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1737301018},{"type":"v1","addr":"172.21.15.1:6835","nonce":1737301018}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-11-15T01:37:11.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.824+0000 7f7d13994700 1 -- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7cf005f300 msgr2=0x7f7cf00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:11.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.824+0000 7f7d13994700 1 --2- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7cf005f300 0x7f7cf00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:11.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.824+0000 7f7d13994700 1 -- 172.21.15.1:0/3145968856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d0c0ab1a0 msgr2=0x7f7d0c1574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.824+0000 7f7d13994700 1 --2- 172.21.15.1:0/3145968856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d0c0ab1a0 0x7f7d0c1574a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f7d0c062af0 tx=0x7f7cfc017000).stop 2023-11-15T01:37:11.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.824+0000 7f7d13994700 1 -- 172.21.15.1:0/3145968856 shutdown_connections 2023-11-15T01:37:11.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.824+0000 7f7d13994700 1 --2- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7cf005f300 0x7f7cf00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:11.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.824+0000 7f7d13994700 1 --2- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d0c154150 0x7f7d0c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.824+0000 7f7d13994700 1 --2- 172.21.15.1:0/3145968856 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d0c0aa060 0x7f7d0c165500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.824+0000 7f7d13994700 1 --2- 172.21.15.1:0/3145968856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d0c0ab1a0 0x7f7d0c1574a0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.824+0000 7f7d13994700 1 -- 172.21.15.1:0/3145968856 >> 172.21.15.1:0/3145968856 conn(0x7f7d0c064aa0 msgr2=0x7f7d0c0ad5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:11.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.824+0000 7f7d13994700 1 -- 172.21.15.1:0/3145968856 shutdown_connections 2023-11-15T01:37:11.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.824+0000 7f7d13994700 1 -- 172.21.15.1:0/3145968856 wait complete. 2023-11-15T01:37:11.828 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 39 2023-11-15T01:37:11.837 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:37:11.850 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:11.850+0000 7f5292392680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:37:11.958 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:11.957+0000 7f73c5b6f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:37:11.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.958+0000 7fe844509700 1 Processor -- start 2023-11-15T01:37:11.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.958+0000 7fe844509700 1 -- start start 2023-11-15T01:37:11.959 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:11.957+0000 7f5292392680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:37:11.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.959+0000 7fe844509700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe83c154150 0x7fe83c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.960+0000 7fe844509700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83c0c06f0 con 0x7fe83c0aa060 2023-11-15T01:37:11.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.960+0000 7fe844509700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83c0c09d0 con 0x7fe83c0ab1a0 2023-11-15T01:37:11.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.960+0000 7fe844509700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83c158820 con 0x7fe83c154150 2023-11-15T01:37:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.960+0000 7fe8422a5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe83c154150 0x7fe83c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.960+0000 7fe842aa6700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe83c0aa060 0x7fe83c0c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42312/0 (socket says 172.21.15.1:42312) 2023-11-15T01:37:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.960+0000 7fe842aa6700 1 -- 172.21.15.1:0/555834550 learned_addr learned my addr 172.21.15.1:0/555834550 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.960+0000 7fe8422a5700 1 -- 172.21.15.1:0/555834550 >> v1:172.21.15.141:6789/0 conn(0x7fe83c0ab1a0 legacy=0x7fe83c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.960+0000 7fe8422a5700 1 -- 172.21.15.1:0/555834550 >> v1:172.21.15.1:6789/0 conn(0x7fe83c0aa060 legacy=0x7fe83c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.960+0000 7fe8422a5700 1 -- 172.21.15.1:0/555834550 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c158b00 con 0x7fe83c154150 2023-11-15T01:37:11.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.960+0000 7fe8412a3700 1 -- 172.21.15.1:0/555834550 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484901039 0 0) 0x7fe83c0c06f0 con 0x7fe83c0aa060 2023-11-15T01:37:11.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.960+0000 7fe8422a5700 1 --2- 172.21.15.1:0/555834550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe83c154150 0x7fe83c154530 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fe838009760 tx=0x7fe838009060).ready entity=mon.0 client_cookie=520245165e03d6b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:11.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.960+0000 7fe8412a3700 1 -- 172.21.15.1:0/555834550 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe838009120 con 0x7fe83c154150 2023-11-15T01:37:11.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.960+0000 7fe8412a3700 1 -- 172.21.15.1:0/555834550 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83800b580 con 0x7fe83c154150 2023-11-15T01:37:11.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.960+0000 7fe8412a3700 1 -- 172.21.15.1:0/555834550 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83800b900 con 0x7fe83c154150 2023-11-15T01:37:11.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.961+0000 7fe844509700 1 -- 172.21.15.1:0/555834550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe83c154150 msgr2=0x7fe83c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.961+0000 7fe844509700 1 --2- 172.21.15.1:0/555834550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe83c154150 0x7fe83c154530 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fe838009760 tx=0x7fe838009060).stop 2023-11-15T01:37:11.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.961+0000 7fe844509700 1 -- 172.21.15.1:0/555834550 shutdown_connections 2023-11-15T01:37:11.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.961+0000 7fe844509700 1 --2- 172.21.15.1:0/555834550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe83c154150 0x7fe83c154530 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.961+0000 7fe844509700 1 -- 172.21.15.1:0/555834550 >> 172.21.15.1:0/555834550 conn(0x7fe83c064aa0 msgr2=0x7fe83c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.961+0000 7fe844509700 1 -- 172.21.15.1:0/555834550 shutdown_connections 2023-11-15T01:37:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.961+0000 7fe844509700 1 -- 172.21.15.1:0/555834550 wait complete. 2023-11-15T01:37:11.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.962+0000 7fe844509700 1 Processor -- start 2023-11-15T01:37:11.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.963+0000 7fe844509700 1 -- start start 2023-11-15T01:37:11.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.963+0000 7fe844509700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe83c0aa060 0x7fe83c144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.963+0000 7fe844509700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe83c0ab1a0 0x7fe83c156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.963+0000 7fe844509700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe83c154150 0x7fe83c156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.963+0000 7fe844509700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c156f30 con 0x7fe83c0ab1a0 2023-11-15T01:37:11.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.963+0000 7fe844509700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c0c24b0 con 0x7fe83c154150 2023-11-15T01:37:11.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.963+0000 7fe844509700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c0aea10 con 0x7fe83c0aa060 2023-11-15T01:37:11.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.963+0000 7fe841aa4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe83c0ab1a0 0x7fe83c156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:11.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.963+0000 7fe841aa4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe83c0ab1a0 0x7fe83c156550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40744/0 (socket says 172.21.15.1:40744) 2023-11-15T01:37:11.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.963+0000 7fe841aa4700 1 -- 172.21.15.1:0/1516658990 learned_addr learned my addr 172.21.15.1:0/1516658990 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:11.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.963+0000 7fe842aa6700 1 --2- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe83c154150 0x7fe83c156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:11.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.963+0000 7fe8422a5700 1 --2- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe83c0aa060 0x7fe83c144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:11.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.964+0000 7fe841aa4700 1 -- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe83c0aa060 msgr2=0x7fe83c144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.964+0000 7fe841aa4700 1 --2- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe83c0aa060 0x7fe83c144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.964+0000 7fe841aa4700 1 -- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe83c154150 msgr2=0x7fe83c156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:11.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.964+0000 7fe841aa4700 1 --2- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe83c154150 0x7fe83c156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:11.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.964+0000 7fe841aa4700 1 -- 172.21.15.1:0/1516658990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8380092a0 con 0x7fe83c0ab1a0 2023-11-15T01:37:11.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.964+0000 7fe8422a5700 1 --2- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe83c0aa060 0x7fe83c144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:11.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.964+0000 7fe842aa6700 1 --2- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe83c154150 0x7fe83c156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:11.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.964+0000 7fe841aa4700 1 --2- 172.21.15.1:0/1516658990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe83c0ab1a0 0x7fe83c156550 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7fe82c00c4c0 tx=0x7fe82c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:11.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.964+0000 7fe8327fc700 1 -- 172.21.15.1:0/1516658990 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00ce70 con 0x7fe83c0ab1a0 2023-11-15T01:37:11.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.964+0000 7fe8327fc700 1 -- 172.21.15.1:0/1516658990 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c001e90 con 0x7fe83c0ab1a0 2023-11-15T01:37:11.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.964+0000 7fe8327fc700 1 -- 172.21.15.1:0/1516658990 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c007250 con 0x7fe83c0ab1a0 2023-11-15T01:37:11.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.964+0000 7fe844509700 1 -- 172.21.15.1:0/1516658990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83c155740 con 0x7fe83c0ab1a0 2023-11-15T01:37:11.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.964+0000 7fe844509700 1 -- 172.21.15.1:0/1516658990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83c155d00 con 0x7fe83c0ab1a0 2023-11-15T01:37:11.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.965+0000 7fe844509700 1 -- 172.21.15.1:0/1516658990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83c0c2640 con 0x7fe83c0ab1a0 2023-11-15T01:37:11.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.965+0000 7fe8327fc700 1 -- 172.21.15.1:0/1516658990 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 36) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fe82c0066a0 con 0x7fe83c0ab1a0 2023-11-15T01:37:11.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.966+0000 7fe8327fc700 1 --2- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe82005f300 0x7fe8200617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:11.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.966+0000 7fe8422a5700 1 -- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe82005f300 msgr2=0x7fe8200617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:11.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.966+0000 7fe8327fc700 1 -- 172.21.15.1:0/1516658990 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fe82c079fe0 con 0x7fe83c0ab1a0 2023-11-15T01:37:11.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.966+0000 7fe8422a5700 1 --2- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe82005f300 0x7fe8200617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:11.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:11.970+0000 7fe8327fc700 1 -- 172.21.15.1:0/1516658990 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe82c04ae00 con 0x7fe83c0ab1a0 2023-11-15T01:37:12.036 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:12.035+0000 7f73c5b6f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:37:12.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.145+0000 7fe844509700 1 -- 172.21.15.1:0/1516658990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe83c06c7e0 con 0x7fe83c0ab1a0 2023-11-15T01:37:12.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.146+0000 7fe8327fc700 1 -- 172.21.15.1:0/1516658990 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+17900 (secure 0 0 0) 0x7fe82c04e420 con 0x7fe83c0ab1a0 2023-11-15T01:37:12.146 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:12.147 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":95,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:37:06.051491+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:36:51.906477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-11-15T01:36:53.240462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:6833/90546":"2023-11-16T01:37:06.051446+0000","172.21.15.141:6832/90546":"2023-11-16T01:37:06.051446+0000","172.21.15.141:0/1004505685":"2023-11-16T01:37:06.051446+0000","172.21.15.141:0/3554724124":"2023-11-16T01:37:06.051446+0000","172.21.15.141:0/2782194221":"2023-11-16T01:37:06.051446+0000","172.21.15.141:0/1118138396":"2023-11-16T01:37:06.051446+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:37:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.147+0000 7fe844509700 1 -- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe82005f300 msgr2=0x7fe8200617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.147+0000 7fe844509700 1 --2- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe82005f300 0x7fe8200617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.147+0000 7fe844509700 1 -- 172.21.15.1:0/1516658990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe83c0ab1a0 msgr2=0x7fe83c156550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:12.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.147+0000 7fe844509700 1 --2- 172.21.15.1:0/1516658990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe83c0ab1a0 0x7fe83c156550 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7fe82c00c4c0 tx=0x7fe82c007e00).stop 2023-11-15T01:37:12.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.147+0000 7fe844509700 1 -- 172.21.15.1:0/1516658990 shutdown_connections 2023-11-15T01:37:12.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.147+0000 7fe844509700 1 --2- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe82005f300 0x7fe8200617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:12.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.147+0000 7fe844509700 1 --2- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe83c154150 0x7fe83c156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:12.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.147+0000 7fe844509700 1 --2- 172.21.15.1:0/1516658990 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe83c0aa060 0x7fe83c144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.147+0000 7fe844509700 1 --2- 172.21.15.1:0/1516658990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe83c0ab1a0 0x7fe83c156550 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.147+0000 7fe844509700 1 -- 172.21.15.1:0/1516658990 >> 172.21.15.1:0/1516658990 conn(0x7fe83c064aa0 msgr2=0x7fe83c152de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.148+0000 7fe844509700 1 -- 172.21.15.1:0/1516658990 shutdown_connections 2023-11-15T01:37:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.148+0000 7fe844509700 1 -- 172.21.15.1:0/1516658990 wait complete. 2023-11-15T01:37:12.160 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-15T01:37:12.162 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:12.161+0000 7f73c5b6f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:37:12.250 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:12.249+0000 7f5292392680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:37:12.278 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:12.277+0000 7f73c5b6f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:37:12.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.282+0000 7f1f5f5bf700 1 Processor -- start 2023-11-15T01:37:12.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.282+0000 7f1f5f5bf700 1 -- start start 2023-11-15T01:37:12.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f5f5bf700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1f58154250 0x7f1f58154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:12.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f5f5bf700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1f580aa700 0x7f1f580c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:12.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f5f5bf700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f58158ff0 con 0x7f1f580c6110 2023-11-15T01:37:12.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f5f5bf700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f58158100 con 0x7f1f580aa700 2023-11-15T01:37:12.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f5f5bf700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f581583e0 con 0x7f1f58154250 2023-11-15T01:37:12.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f5db5c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1f580aa700 0x7f1f580c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:12.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f5cb5a700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f1f580c6110 0x7f1f580a9ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42326/0 (socket says 172.21.15.1:42326) 2023-11-15T01:37:12.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f5cb5a700 1 -- 172.21.15.1:0/1208635351 learned_addr learned my addr 172.21.15.1:0/1208635351 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:12.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f5d35b700 1 --2- 172.21.15.1:0/1208635351 >> v2:172.21.15.141:3300/0 conn(0x7f1f58154250 0x7f1f58154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:12.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f4ffff700 1 -- 172.21.15.1:0/1208635351 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493684771 0 0) 0x7f1f58158ff0 con 0x7f1f580c6110 2023-11-15T01:37:12.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f4ffff700 1 -- 172.21.15.1:0/1208635351 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f440033f0 con 0x7f1f580c6110 2023-11-15T01:37:12.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f5db5c700 1 -- 172.21.15.1:0/1208635351 >> v2:172.21.15.141:3300/0 conn(0x7f1f58154250 msgr2=0x7f1f58154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:12.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f5db5c700 1 --2- 172.21.15.1:0/1208635351 >> v2:172.21.15.141:3300/0 conn(0x7f1f58154250 0x7f1f58154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:12.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f5db5c700 1 -- 172.21.15.1:0/1208635351 >> v1:172.21.15.1:6789/0 conn(0x7f1f580c6110 legacy=0x7f1f580a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:12.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f5db5c700 1 -- 172.21.15.1:0/1208635351 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f581586c0 con 0x7f1f580aa700 2023-11-15T01:37:12.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.283+0000 7f1f5db5c700 1 --2- 172.21.15.1:0/1208635351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f580aa700 0x7f1f580c6590 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f1f58062cb0 tx=0x7f1f50009780).ready entity=mon.0 client_cookie=68604488eee79de9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:12.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.284+0000 7f1f4ffff700 1 -- 172.21.15.1:0/1208635351 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000e070 con 0x7f1f580aa700 2023-11-15T01:37:12.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.284+0000 7f1f4ffff700 1 -- 172.21.15.1:0/1208635351 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5000bab0 con 0x7f1f580aa700 2023-11-15T01:37:12.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.284+0000 7f1f4ffff700 1 -- 172.21.15.1:0/1208635351 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000be30 con 0x7f1f580aa700 2023-11-15T01:37:12.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.284+0000 7f1f5f5bf700 1 -- 172.21.15.1:0/1208635351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f580aa700 msgr2=0x7f1f580c6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:12.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.284+0000 7f1f5f5bf700 1 --2- 172.21.15.1:0/1208635351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f580aa700 0x7f1f580c6590 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f1f58062cb0 tx=0x7f1f50009780).stop 2023-11-15T01:37:12.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.284+0000 7f1f5f5bf700 1 -- 172.21.15.1:0/1208635351 shutdown_connections 2023-11-15T01:37:12.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.284+0000 7f1f5f5bf700 1 --2- 172.21.15.1:0/1208635351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f580aa700 0x7f1f580c6590 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:12.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.284+0000 7f1f5f5bf700 1 --2- 172.21.15.1:0/1208635351 >> v2:172.21.15.141:3300/0 conn(0x7f1f58154250 0x7f1f58154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:12.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.284+0000 7f1f5f5bf700 1 -- 172.21.15.1:0/1208635351 >> 172.21.15.1:0/1208635351 conn(0x7f1f580c7b20 msgr2=0x7f1f580c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:12.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.284+0000 7f1f5f5bf700 1 -- 172.21.15.1:0/1208635351 shutdown_connections 2023-11-15T01:37:12.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.284+0000 7f1f5f5bf700 1 -- 172.21.15.1:0/1208635351 wait complete. 2023-11-15T01:37:12.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.285+0000 7f1f5f5bf700 1 Processor -- start 2023-11-15T01:37:12.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.285+0000 7f1f5f5bf700 1 -- start start 2023-11-15T01:37:12.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.286+0000 7f1f5f5bf700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f580aa700 0x7f1f58157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:12.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.286+0000 7f1f5f5bf700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f580c6110 0x7f1f580afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:12.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.286+0000 7f1f5f5bf700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1f58154250 0x7f1f580b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:12.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.286+0000 7f1f5f5bf700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f580b0700 con 0x7f1f580c6110 2023-11-15T01:37:12.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.286+0000 7f1f5f5bf700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f580b09e0 con 0x7f1f58154250 2023-11-15T01:37:12.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.286+0000 7f1f5f5bf700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f580b0cc0 con 0x7f1f580aa700 2023-11-15T01:37:12.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.286+0000 7f1f5cb5a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f580c6110 0x7f1f580afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:12.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.286+0000 7f1f5cb5a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f580c6110 0x7f1f580afc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40766/0 (socket says 172.21.15.1:40766) 2023-11-15T01:37:12.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.286+0000 7f1f5cb5a700 1 -- 172.21.15.1:0/2261422167 learned_addr learned my addr 172.21.15.1:0/2261422167 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:12.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.287+0000 7f1f5db5c700 1 --2- 172.21.15.1:0/2261422167 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1f58154250 0x7f1f580b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:12.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.287+0000 7f1f5d35b700 1 --2- 172.21.15.1:0/2261422167 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f580aa700 0x7f1f58157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:12.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.287+0000 7f1f5cb5a700 1 -- 172.21.15.1:0/2261422167 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f580aa700 msgr2=0x7f1f58157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:12.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.287+0000 7f1f5cb5a700 1 --2- 172.21.15.1:0/2261422167 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f580aa700 0x7f1f58157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:12.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.287+0000 7f1f5cb5a700 1 -- 172.21.15.1:0/2261422167 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1f58154250 msgr2=0x7f1f580b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:12.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.287+0000 7f1f5cb5a700 1 --2- 172.21.15.1:0/2261422167 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1f58154250 0x7f1f580b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:12.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.287+0000 7f1f5cb5a700 1 -- 172.21.15.1:0/2261422167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f50009a20 con 0x7f1f580c6110 2023-11-15T01:37:12.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.287+0000 7f1f5cb5a700 1 --2- 172.21.15.1:0/2261422167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f580c6110 0x7f1f580afc50 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f1f4800c590 tx=0x7f1f48007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:12.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.287+0000 7f1f4d7fa700 1 -- 172.21.15.1:0/2261422167 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f480072e0 con 0x7f1f580c6110 2023-11-15T01:37:12.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.287+0000 7f1f4d7fa700 1 -- 172.21.15.1:0/2261422167 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f48007440 con 0x7f1f580c6110 2023-11-15T01:37:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.287+0000 7f1f5f5bf700 1 -- 172.21.15.1:0/2261422167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f580b0fa0 con 0x7f1f580c6110 2023-11-15T01:37:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.287+0000 7f1f4d7fa700 1 -- 172.21.15.1:0/2261422167 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f480057a0 con 0x7f1f580c6110 2023-11-15T01:37:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.287+0000 7f1f5f5bf700 1 -- 172.21.15.1:0/2261422167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f58157930 con 0x7f1f580c6110 2023-11-15T01:37:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.288+0000 7f1f4d7fa700 1 -- 172.21.15.1:0/2261422167 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 36) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f1f48005bd0 con 0x7f1f580c6110 2023-11-15T01:37:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.289+0000 7f1f5f5bf700 1 -- 172.21.15.1:0/2261422167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f581556d0 con 0x7f1f580c6110 2023-11-15T01:37:12.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.289+0000 7f1f4d7fa700 1 --2- 172.21.15.1:0/2261422167 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1f3c05f300 0x7f1f3c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:12.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.289+0000 7f1f5d35b700 1 -- 172.21.15.1:0/2261422167 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1f3c05f300 msgr2=0x7f1f3c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:12.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.289+0000 7f1f4d7fa700 1 -- 172.21.15.1:0/2261422167 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f1f48079e60 con 0x7f1f580c6110 2023-11-15T01:37:12.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.289+0000 7f1f5d35b700 1 --2- 172.21.15.1:0/2261422167 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1f3c05f300 0x7f1f3c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:12.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.293+0000 7f1f4d7fa700 1 -- 172.21.15.1:0/2261422167 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1f581556d0 con 0x7f1f580c6110 2023-11-15T01:37:12.321 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:12.320+0000 7f5292392680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:37:12.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.342+0000 7f1f4d7fa700 1 -- 172.21.15.1:0/2261422167 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 37) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f1f4801bdb0 con 0x7f1f580c6110 2023-11-15T01:37:12.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.342+0000 7f1f4d7fa700 1 -- 172.21.15.1:0/2261422167 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1f3c05f300 msgr2=0x7f1f3c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:12.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.342+0000 7f1f4d7fa700 1 --2- 172.21.15.1:0/2261422167 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1f3c05f300 0x7f1f3c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:12.397 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:12.396+0000 7f520bb21700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:12.397 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:12.396+0000 7f520bb21700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:12.398 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:12.396+0000 7f520bb21700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:12.398 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:12.396+0000 7f520bb21700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:12.398 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:12.396+0000 7f520bb21700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:12.398 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:12.396+0000 7f520fb29700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:12.398 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:12.396+0000 7f520fb29700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:12.399 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:12.396+0000 7f520fb29700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:12.399 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:12.396+0000 7f520fb29700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:12.399 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:12.396+0000 7f520fb29700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:12.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:12.542+0000 7f1f5f5bf700 1 -- 172.21.15.1:0/2261422167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1f581556d0 con 0x7f1f580c6110 2023-11-15T01:37:12.598 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:12.597+0000 7f73c5b6f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:37:12.673 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:12.672+0000 7f73c5b6f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:37:13.337 INFO:tasks.ceph.mon.a.smithi001.stderr:2023-11-15T01:37:13.337+0000 7f8072214700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-15T01:37:13.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.340+0000 7f1f4d7fa700 1 -- 172.21.15.1:0/2261422167 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1f581556d0 con 0x7f1f580c6110 2023-11-15T01:37:13.342 INFO:tasks.ceph.mds.a.smithi001.stderr: -1302> 2023-11-15T01:36:59.210+0000 7efdd2067700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T01:37:13.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.343+0000 7f1f5f5bf700 1 -- 172.21.15.1:0/2261422167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f580c6110 msgr2=0x7f1f580afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:13.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.343+0000 7f1f5f5bf700 1 --2- 172.21.15.1:0/2261422167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f580c6110 0x7f1f580afc50 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f1f4800c590 tx=0x7f1f48007c80).stop 2023-11-15T01:37:13.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.343+0000 7f1f5f5bf700 1 -- 172.21.15.1:0/2261422167 shutdown_connections 2023-11-15T01:37:13.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.343+0000 7f1f5f5bf700 1 --2- 172.21.15.1:0/2261422167 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1f3c05f300 0x7f1f3c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:13.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.343+0000 7f1f5f5bf700 1 --2- 172.21.15.1:0/2261422167 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1f58154250 0x7f1f580b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:13.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.343+0000 7f1f5f5bf700 1 --2- 172.21.15.1:0/2261422167 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f580aa700 0x7f1f58157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:13.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.343+0000 7f1f5f5bf700 1 --2- 172.21.15.1:0/2261422167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f580c6110 0x7f1f580afc50 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:13.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.343+0000 7f1f5f5bf700 1 -- 172.21.15.1:0/2261422167 >> 172.21.15.1:0/2261422167 conn(0x7f1f580c7b20 msgr2=0x7f1f580c9680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:13.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.343+0000 7f1f5f5bf700 1 -- 172.21.15.1:0/2261422167 shutdown_connections 2023-11-15T01:37:13.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.343+0000 7f1f5f5bf700 1 -- 172.21.15.1:0/2261422167 wait complete. 2023-11-15T01:37:13.347 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-15T01:37:13.361 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-15T01:37:13.369 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T01:37:13.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.484+0000 7fdcc63bc700 1 Processor -- start 2023-11-15T01:37:13.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.484+0000 7fdcc63bc700 1 -- start start 2023-11-15T01:37:13.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcc63bc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdcc0154480 0x7fdcc00c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:13.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcc63bc700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdcc00c6430 0x7fdcc00aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:13.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcc63bc700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc00ca050 con 0x7fdcc01540a0 2023-11-15T01:37:13.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcc63bc700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc00c68c0 con 0x7fdcc0154480 2023-11-15T01:37:13.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcc63bc700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc00c9440 con 0x7fdcc00c6430 2023-11-15T01:37:13.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcbf7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdcc0154480 0x7fdcc00c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:13.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcbf7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdcc0154480 0x7fdcc00c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40786/0 (socket says 172.21.15.1:40786) 2023-11-15T01:37:13.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcbf7fe700 1 -- 172.21.15.1:0/815638816 learned_addr learned my addr 172.21.15.1:0/815638816 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:13.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcc4959700 1 --2- 172.21.15.1:0/815638816 >> v2:172.21.15.141:3300/0 conn(0x7fdcc00c6430 0x7fdcc00aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:13.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcbf7fe700 1 -- 172.21.15.1:0/815638816 >> v2:172.21.15.141:3300/0 conn(0x7fdcc00c6430 msgr2=0x7fdcc00aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:13.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcbf7fe700 1 --2- 172.21.15.1:0/815638816 >> v2:172.21.15.141:3300/0 conn(0x7fdcc00c6430 0x7fdcc00aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:13.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcbf7fe700 1 -- 172.21.15.1:0/815638816 >> v1:172.21.15.141:6789/0 conn(0x7fdcc01540a0 legacy=0x7fdcc00ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:13.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcbf7fe700 1 -- 172.21.15.1:0/815638816 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc00c9720 con 0x7fdcc0154480 2023-11-15T01:37:13.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcbf7fe700 1 --2- 172.21.15.1:0/815638816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdcc0154480 0x7fdcc00c5f40 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fdcc00aab60 tx=0x7fdcb40090f0).ready entity=mon.0 client_cookie=899989aed7d870a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:13.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcbeffd700 1 -- 172.21.15.1:0/815638816 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400b520 con 0x7fdcc0154480 2023-11-15T01:37:13.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcbeffd700 1 -- 172.21.15.1:0/815638816 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb400b680 con 0x7fdcc0154480 2023-11-15T01:37:13.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.485+0000 7fdcbeffd700 1 -- 172.21.15.1:0/815638816 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400ba00 con 0x7fdcc0154480 2023-11-15T01:37:13.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.486+0000 7fdcc63bc700 1 -- 172.21.15.1:0/815638816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdcc0154480 msgr2=0x7fdcc00c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:13.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.486+0000 7fdcc63bc700 1 --2- 172.21.15.1:0/815638816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdcc0154480 0x7fdcc00c5f40 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fdcc00aab60 tx=0x7fdcb40090f0).stop 2023-11-15T01:37:13.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.486+0000 7fdcc63bc700 1 -- 172.21.15.1:0/815638816 shutdown_connections 2023-11-15T01:37:13.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.486+0000 7fdcc63bc700 1 --2- 172.21.15.1:0/815638816 >> v2:172.21.15.141:3300/0 conn(0x7fdcc00c6430 0x7fdcc00aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:13.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.486+0000 7fdcc63bc700 1 --2- 172.21.15.1:0/815638816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdcc0154480 0x7fdcc00c5f40 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:13.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.486+0000 7fdcc63bc700 1 -- 172.21.15.1:0/815638816 >> 172.21.15.1:0/815638816 conn(0x7fdcc0064a70 msgr2=0x7fdcc0064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:13.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.486+0000 7fdcc63bc700 1 -- 172.21.15.1:0/815638816 shutdown_connections 2023-11-15T01:37:13.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.486+0000 7fdcc63bc700 1 -- 172.21.15.1:0/815638816 wait complete. 2023-11-15T01:37:13.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.487+0000 7fdcc63bc700 1 Processor -- start 2023-11-15T01:37:13.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.487+0000 7fdcc63bc700 1 -- start start 2023-11-15T01:37:13.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.488+0000 7fdcc63bc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcc00c6430 0x7fdcc00ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:13.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.488+0000 7fdcc63bc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdcc01540a0 0x7fdcc00c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:13.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.488+0000 7fdcc63bc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdcc0154480 0x7fdcc00aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:13.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.488+0000 7fdcc63bc700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc01576b0 con 0x7fdcc0154480 2023-11-15T01:37:13.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.488+0000 7fdcc63bc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc00aebb0 con 0x7fdcc01540a0 2023-11-15T01:37:13.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.488+0000 7fdcc63bc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc00c3630 con 0x7fdcc00c6430 2023-11-15T01:37:13.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.488+0000 7fdcc4959700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdcc0154480 0x7fdcc00aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:13.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.488+0000 7fdcc4959700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdcc0154480 0x7fdcc00aed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40790/0 (socket says 172.21.15.1:40790) 2023-11-15T01:37:13.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.488+0000 7fdcbffff700 1 --2- 172.21.15.1:0/148644895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcc00c6430 0x7fdcc00ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:13.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.488+0000 7fdcbf7fe700 1 --2- 172.21.15.1:0/148644895 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdcc01540a0 0x7fdcc00c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:13.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.488+0000 7fdcc4959700 1 -- 172.21.15.1:0/148644895 learned_addr learned my addr 172.21.15.1:0/148644895 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:13.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.488+0000 7fdcc4959700 1 -- 172.21.15.1:0/148644895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcc00c6430 msgr2=0x7fdcc00ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:13.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.488+0000 7fdcc4959700 1 --2- 172.21.15.1:0/148644895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcc00c6430 0x7fdcc00ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:13.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.488+0000 7fdcc4959700 1 -- 172.21.15.1:0/148644895 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdcc01540a0 msgr2=0x7fdcc00c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:13.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.488+0000 7fdcc4959700 1 --2- 172.21.15.1:0/148644895 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdcc01540a0 0x7fdcc00c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:13.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.489+0000 7fdcc4959700 1 -- 172.21.15.1:0/148644895 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb4009370 con 0x7fdcc0154480 2023-11-15T01:37:13.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.489+0000 7fdcbffff700 1 --2- 172.21.15.1:0/148644895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcc00c6430 0x7fdcc00ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:13.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.489+0000 7fdcc4959700 1 --2- 172.21.15.1:0/148644895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdcc0154480 0x7fdcc00aed10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fdcb8009e90 tx=0x7fdcb800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:13.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.489+0000 7fdca7fff700 1 -- 172.21.15.1:0/148644895 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb800caa0 con 0x7fdcc0154480 2023-11-15T01:37:13.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.489+0000 7fdca7fff700 1 -- 172.21.15.1:0/148644895 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb800f040 con 0x7fdcc0154480 2023-11-15T01:37:13.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.489+0000 7fdcc63bc700 1 -- 172.21.15.1:0/148644895 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc00c3820 con 0x7fdcc0154480 2023-11-15T01:37:13.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.489+0000 7fdca7fff700 1 -- 172.21.15.1:0/148644895 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb800ce10 con 0x7fdcc0154480 2023-11-15T01:37:13.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.489+0000 7fdcc63bc700 1 -- 172.21.15.1:0/148644895 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc00c3de0 con 0x7fdcc0154480 2023-11-15T01:37:13.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.490+0000 7fdcc63bc700 1 -- 172.21.15.1:0/148644895 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc00c45e0 con 0x7fdcc0154480 2023-11-15T01:37:13.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.490+0000 7fdca7fff700 1 -- 172.21.15.1:0/148644895 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 38) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fdcb8013610 con 0x7fdcc0154480 2023-11-15T01:37:13.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.491+0000 7fdca7fff700 1 --2- 172.21.15.1:0/148644895 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdcac05f000 0x7fdcac0614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:13.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.491+0000 7fdca7fff700 1 -- 172.21.15.1:0/148644895 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7104+0+0 (secure 0 0 0) 0x7fdcb807abc0 con 0x7fdcc0154480 2023-11-15T01:37:13.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.491+0000 7fdcbffff700 1 --2- 172.21.15.1:0/148644895 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdcac05f000 0x7fdcac0614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:13.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.491+0000 7fdcbffff700 1 --2- 172.21.15.1:0/148644895 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdcac05f000 0x7fdcac0614c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fdcb0001bb0 tx=0x7fdcb0009040).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:13.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.495+0000 7fdca7fff700 1 -- 172.21.15.1:0/148644895 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdcc00c45e0 con 0x7fdcc0154480 2023-11-15T01:37:13.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:13.714+0000 7fdcc63bc700 1 -- 172.21.15.1:0/148644895 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdcc00c45e0 con 0x7fdcc0154480 2023-11-15T01:37:14.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.351+0000 7fdca7fff700 1 -- 172.21.15.1:0/148644895 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdcc00c45e0 con 0x7fdcc0154480 2023-11-15T01:37:14.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.354+0000 7fdcc63bc700 1 -- 172.21.15.1:0/148644895 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdcac05f000 msgr2=0x7fdcac0614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:14.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.354+0000 7fdcc63bc700 1 --2- 172.21.15.1:0/148644895 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdcac05f000 0x7fdcac0614c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fdcb0001bb0 tx=0x7fdcb0009040).stop 2023-11-15T01:37:14.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.354+0000 7fdcc63bc700 1 -- 172.21.15.1:0/148644895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdcc0154480 msgr2=0x7fdcc00aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:14.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.354+0000 7fdcc63bc700 1 --2- 172.21.15.1:0/148644895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdcc0154480 0x7fdcc00aed10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fdcb8009e90 tx=0x7fdcb800b040).stop 2023-11-15T01:37:14.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.354+0000 7fdcc63bc700 1 -- 172.21.15.1:0/148644895 shutdown_connections 2023-11-15T01:37:14.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.354+0000 7fdcc63bc700 1 --2- 172.21.15.1:0/148644895 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdcac05f000 0x7fdcac0614c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:14.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.354+0000 7fdcc63bc700 1 --2- 172.21.15.1:0/148644895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdcc0154480 0x7fdcc00aed10 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:14.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.354+0000 7fdcc63bc700 1 --2- 172.21.15.1:0/148644895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcc00c6430 0x7fdcc00ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:14.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.354+0000 7fdcc63bc700 1 --2- 172.21.15.1:0/148644895 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdcc01540a0 0x7fdcc00c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:14.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.354+0000 7fdcc63bc700 1 -- 172.21.15.1:0/148644895 >> 172.21.15.1:0/148644895 conn(0x7fdcc0064a70 msgr2=0x7fdcc0064e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:14.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.354+0000 7fdcc63bc700 1 -- 172.21.15.1:0/148644895 shutdown_connections 2023-11-15T01:37:14.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.354+0000 7fdcc63bc700 1 -- 172.21.15.1:0/148644895 wait complete. 2023-11-15T01:37:14.370 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-15T01:37:14.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.539+0000 7f71bfd05700 1 Processor -- start 2023-11-15T01:37:14.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.539+0000 7f71bfd05700 1 -- start start 2023-11-15T01:37:14.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.540+0000 7f71bfd05700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b8158c70 0x7f71b80c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:14.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.540+0000 7f71bfd05700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b81580d0 con 0x7f71b80aa750 2023-11-15T01:37:14.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.540+0000 7f71bfd05700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b8155000 con 0x7f71b814b350 2023-11-15T01:37:14.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.540+0000 7f71bfd05700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81552e0 con 0x7f71b8158c70 2023-11-15T01:37:14.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.540+0000 7f71bd2a0700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f71b80aa750 0x7f71b8158560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42328/0 (socket says 172.21.15.1:42328) 2023-11-15T01:37:14.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.540+0000 7f71bd2a0700 1 -- 172.21.15.1:0/4136480649 learned_addr learned my addr 172.21.15.1:0/4136480649 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:14.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.540+0000 7f71be2a2700 1 --2- 172.21.15.1:0/4136480649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b8158c70 0x7f71b80c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:14.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.541+0000 7f71bca9f700 1 -- 172.21.15.1:0/4136480649 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768213699 0 0) 0x7f71b81580d0 con 0x7f71b80aa750 2023-11-15T01:37:14.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.541+0000 7f71bca9f700 1 -- 172.21.15.1:0/4136480649 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71a00033f0 con 0x7f71b80aa750 2023-11-15T01:37:14.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.541+0000 7f71bca9f700 1 -- 172.21.15.1:0/4136480649 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820813030 0 0) 0x7f71b8155000 con 0x7f71b814b350 2023-11-15T01:37:14.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.541+0000 7f71bca9f700 1 -- 172.21.15.1:0/4136480649 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71b81580d0 con 0x7f71b814b350 2023-11-15T01:37:14.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.541+0000 7f71be2a2700 1 -- 172.21.15.1:0/4136480649 >> v1:172.21.15.141:6789/0 conn(0x7f71b814b350 legacy=0x7f71b80aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:14.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.541+0000 7f71be2a2700 1 -- 172.21.15.1:0/4136480649 >> v1:172.21.15.1:6789/0 conn(0x7f71b80aa750 legacy=0x7f71b8158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:14.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.541+0000 7f71be2a2700 1 -- 172.21.15.1:0/4136480649 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b81555c0 con 0x7f71b8158c70 2023-11-15T01:37:14.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.541+0000 7f71be2a2700 1 --2- 172.21.15.1:0/4136480649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b8158c70 0x7f71b80c8290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f71b0009790 tx=0x7f71b0009060).ready entity=mon.2 client_cookie=a8a6b5f48f4f705c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:14.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.541+0000 7f71bca9f700 1 -- 172.21.15.1:0/4136480649 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b000f510 con 0x7f71b8158c70 2023-11-15T01:37:14.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.541+0000 7f71bca9f700 1 -- 172.21.15.1:0/4136480649 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b000f670 con 0x7f71b8158c70 2023-11-15T01:37:14.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.541+0000 7f71bca9f700 1 -- 172.21.15.1:0/4136480649 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b000f9f0 con 0x7f71b8158c70 2023-11-15T01:37:14.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.542+0000 7f71bfd05700 1 -- 172.21.15.1:0/4136480649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b8158c70 msgr2=0x7f71b80c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:14.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.542+0000 7f71bfd05700 1 --2- 172.21.15.1:0/4136480649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b8158c70 0x7f71b80c8290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f71b0009790 tx=0x7f71b0009060).stop 2023-11-15T01:37:14.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.542+0000 7f71bfd05700 1 -- 172.21.15.1:0/4136480649 shutdown_connections 2023-11-15T01:37:14.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.542+0000 7f71bfd05700 1 --2- 172.21.15.1:0/4136480649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b8158c70 0x7f71b80c8290 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:14.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.542+0000 7f71bfd05700 1 -- 172.21.15.1:0/4136480649 >> 172.21.15.1:0/4136480649 conn(0x7f71b8069ee0 msgr2=0x7f71b806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:14.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.542+0000 7f71bfd05700 1 -- 172.21.15.1:0/4136480649 shutdown_connections 2023-11-15T01:37:14.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.542+0000 7f71bfd05700 1 -- 172.21.15.1:0/4136480649 wait complete. 2023-11-15T01:37:14.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.543+0000 7f71bfd05700 1 Processor -- start 2023-11-15T01:37:14.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.543+0000 7f71bfd05700 1 -- start start 2023-11-15T01:37:14.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bfd05700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71b80aa750 0x7f71b80c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:14.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bfd05700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71b814b350 0x7f71b8138c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:14.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bfd05700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b8158c70 0x7f71b8139100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:14.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bfd05700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81395f0 con 0x7f71b814b350 2023-11-15T01:37:14.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bfd05700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8139840 con 0x7f71b80aa750 2023-11-15T01:37:14.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bfd05700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b814e430 con 0x7f71b8158c70 2023-11-15T01:37:14.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bd2a0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71b814b350 0x7f71b8138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:14.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bd2a0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71b814b350 0x7f71b8138c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40798/0 (socket says 172.21.15.1:40798) 2023-11-15T01:37:14.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bd2a0700 1 -- 172.21.15.1:0/4214846059 learned_addr learned my addr 172.21.15.1:0/4214846059 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:14.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bdaa1700 1 --2- 172.21.15.1:0/4214846059 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71b80aa750 0x7f71b80c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:14.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71be2a2700 1 --2- 172.21.15.1:0/4214846059 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b8158c70 0x7f71b8139100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:14.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bd2a0700 1 -- 172.21.15.1:0/4214846059 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b8158c70 msgr2=0x7f71b8139100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:14.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bd2a0700 1 --2- 172.21.15.1:0/4214846059 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b8158c70 0x7f71b8139100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:14.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bd2a0700 1 -- 172.21.15.1:0/4214846059 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71b80aa750 msgr2=0x7f71b80c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:14.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bd2a0700 1 --2- 172.21.15.1:0/4214846059 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71b80aa750 0x7f71b80c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:14.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bd2a0700 1 -- 172.21.15.1:0/4214846059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b00092a0 con 0x7f71b814b350 2023-11-15T01:37:14.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bd2a0700 1 --2- 172.21.15.1:0/4214846059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71b814b350 0x7f71b8138c10 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f71ac00c560 tx=0x7f71ac007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:14.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71b5ffb700 1 -- 172.21.15.1:0/4214846059 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0072e0 con 0x7f71b814b350 2023-11-15T01:37:14.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71b5ffb700 1 -- 172.21.15.1:0/4214846059 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac007440 con 0x7f71b814b350 2023-11-15T01:37:14.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71bfd05700 1 -- 172.21.15.1:0/4214846059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b814e710 con 0x7f71b814b350 2023-11-15T01:37:14.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.544+0000 7f71b5ffb700 1 -- 172.21.15.1:0/4214846059 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0057a0 con 0x7f71b814b350 2023-11-15T01:37:14.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.545+0000 7f71bfd05700 1 -- 172.21.15.1:0/4214846059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b814ecd0 con 0x7f71b814b350 2023-11-15T01:37:14.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.546+0000 7f71bfd05700 1 -- 172.21.15.1:0/4214846059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b806c7e0 con 0x7f71b814b350 2023-11-15T01:37:14.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.546+0000 7f71b5ffb700 1 -- 172.21.15.1:0/4214846059 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 38) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f71ac005b50 con 0x7f71b814b350 2023-11-15T01:37:14.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.546+0000 7f71b5ffb700 1 --2- 172.21.15.1:0/4214846059 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71a405f030 0x7f71a40614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:14.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.546+0000 7f71b5ffb700 1 -- 172.21.15.1:0/4214846059 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7104+0+0 (secure 0 0 0) 0x7f71ac079a80 con 0x7f71b814b350 2023-11-15T01:37:14.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.546+0000 7f71bdaa1700 1 --2- 172.21.15.1:0/4214846059 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71a405f030 0x7f71a40614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:14.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.547+0000 7f71bdaa1700 1 --2- 172.21.15.1:0/4214846059 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71a405f030 0x7f71a40614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f71a8003df0 tx=0x7f71a8009040).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:14.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.550+0000 7f71b5ffb700 1 -- 172.21.15.1:0/4214846059 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f71ac04ab50 con 0x7f71b814b350 2023-11-15T01:37:14.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:14.724+0000 7f71bfd05700 1 -- 172.21.15.1:0/4214846059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f71b805f8b0 con 0x7f71b814b350 2023-11-15T01:37:15.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.354+0000 7f71b5ffb700 1 -- 172.21.15.1:0/4214846059 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f71ac077650 con 0x7f71b814b350 2023-11-15T01:37:15.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.363+0000 7f71b5ffb700 1 -- 172.21.15.1:0/4214846059 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v99) v1 ==== 181+0+0 (secure 0 0 0) 0x7f71ac073360 con 0x7f71b814b350 2023-11-15T01:37:15.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.366+0000 7f71bfd05700 1 -- 172.21.15.1:0/4214846059 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71a405f030 msgr2=0x7f71a40614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:15.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.366+0000 7f71bfd05700 1 --2- 172.21.15.1:0/4214846059 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71a405f030 0x7f71a40614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f71a8003df0 tx=0x7f71a8009040).stop 2023-11-15T01:37:15.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.366+0000 7f71bfd05700 1 -- 172.21.15.1:0/4214846059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71b814b350 msgr2=0x7f71b8138c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:15.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.366+0000 7f71bfd05700 1 --2- 172.21.15.1:0/4214846059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71b814b350 0x7f71b8138c10 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f71ac00c560 tx=0x7f71ac007cc0).stop 2023-11-15T01:37:15.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.366+0000 7f71bfd05700 1 -- 172.21.15.1:0/4214846059 shutdown_connections 2023-11-15T01:37:15.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.366+0000 7f71bfd05700 1 --2- 172.21.15.1:0/4214846059 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f71a405f030 0x7f71a40614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:15.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.366+0000 7f71bfd05700 1 --2- 172.21.15.1:0/4214846059 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b8158c70 0x7f71b8139100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:15.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.366+0000 7f71bfd05700 1 --2- 172.21.15.1:0/4214846059 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71b80aa750 0x7f71b80c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:15.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.366+0000 7f71bfd05700 1 --2- 172.21.15.1:0/4214846059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71b814b350 0x7f71b8138c10 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:15.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.366+0000 7f71bfd05700 1 -- 172.21.15.1:0/4214846059 >> 172.21.15.1:0/4214846059 conn(0x7f71b8069ee0 msgr2=0x7f71b80ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:15.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.366+0000 7f71bfd05700 1 -- 172.21.15.1:0/4214846059 shutdown_connections 2023-11-15T01:37:15.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.366+0000 7f71bfd05700 1 -- 172.21.15.1:0/4214846059 wait complete. 2023-11-15T01:37:15.369 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2023-11-15T01:37:15.382 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-15T01:37:15.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.508+0000 7f3b60c64700 1 Processor -- start 2023-11-15T01:37:15.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.508+0000 7f3b60c64700 1 -- start start 2023-11-15T01:37:15.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.509+0000 7f3b60c64700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b5c0c1cb0 0x7f3b5c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:15.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.509+0000 7f3b60c64700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3b5c0aa060 0x7f3b5c0aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:15.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.509+0000 7f3b60c64700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5c0c1820 con 0x7f3b5c157660 2023-11-15T01:37:15.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.509+0000 7f3b60c64700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c0c7540 con 0x7f3b5c0aa060 2023-11-15T01:37:15.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.509+0000 7f3b60c64700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0aa9e0 con 0x7f3b5c0c1cb0 2023-11-15T01:37:15.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.509+0000 7f3b5ad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3b5c0aa060 0x7f3b5c0aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:15.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.509+0000 7f3b5ad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3b5c0aa060 0x7f3b5c0aa4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40812/0 (socket says 172.21.15.1:40812) 2023-11-15T01:37:15.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.509+0000 7f3b5ad9d700 1 -- 172.21.15.1:0/3107577515 learned_addr learned my addr 172.21.15.1:0/3107577515 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:15.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.509+0000 7f3b59d9b700 1 --2- 172.21.15.1:0/3107577515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b5c0c1cb0 0x7f3b5c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:15.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.509+0000 7f3b5ad9d700 1 -- 172.21.15.1:0/3107577515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b5c0c1cb0 msgr2=0x7f3b5c157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:15.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.509+0000 7f3b5ad9d700 1 --2- 172.21.15.1:0/3107577515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b5c0c1cb0 0x7f3b5c157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:15.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.510+0000 7f3b5ad9d700 1 -- 172.21.15.1:0/3107577515 >> v1:172.21.15.141:6789/0 conn(0x7f3b5c157660 legacy=0x7f3b5c0c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:15.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.510+0000 7f3b5ad9d700 1 -- 172.21.15.1:0/3107577515 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c0c0c30 con 0x7f3b5c0aa060 2023-11-15T01:37:15.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.510+0000 7f3b59d9b700 1 --2- 172.21.15.1:0/3107577515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b5c0c1cb0 0x7f3b5c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:15.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.510+0000 7f3b5ad9d700 1 --2- 172.21.15.1:0/3107577515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b5c0aa060 0x7f3b5c0aa4f0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f3b54006fd0 tx=0x7f3b540090f0).ready entity=mon.0 client_cookie=9a6b4fbf0cd63426 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:15.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.510+0000 7f3b5959a700 1 -- 172.21.15.1:0/3107577515 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5400b600 con 0x7f3b5c0aa060 2023-11-15T01:37:15.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.510+0000 7f3b5959a700 1 -- 172.21.15.1:0/3107577515 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5400b760 con 0x7f3b5c0aa060 2023-11-15T01:37:15.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.510+0000 7f3b5959a700 1 -- 172.21.15.1:0/3107577515 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5400bb00 con 0x7f3b5c0aa060 2023-11-15T01:37:15.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.510+0000 7f3b60c64700 1 -- 172.21.15.1:0/3107577515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b5c0aa060 msgr2=0x7f3b5c0aa4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:15.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.510+0000 7f3b60c64700 1 --2- 172.21.15.1:0/3107577515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b5c0aa060 0x7f3b5c0aa4f0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f3b54006fd0 tx=0x7f3b540090f0).stop 2023-11-15T01:37:15.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.510+0000 7f3b60c64700 1 -- 172.21.15.1:0/3107577515 shutdown_connections 2023-11-15T01:37:15.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.510+0000 7f3b60c64700 1 --2- 172.21.15.1:0/3107577515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b5c0aa060 0x7f3b5c0aa4f0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:15.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.510+0000 7f3b60c64700 1 --2- 172.21.15.1:0/3107577515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b5c0c1cb0 0x7f3b5c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:15.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.510+0000 7f3b60c64700 1 -- 172.21.15.1:0/3107577515 >> 172.21.15.1:0/3107577515 conn(0x7f3b5c064aa0 msgr2=0x7f3b5c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:15.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.510+0000 7f3b60c64700 1 -- 172.21.15.1:0/3107577515 shutdown_connections 2023-11-15T01:37:15.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.511+0000 7f3b60c64700 1 -- 172.21.15.1:0/3107577515 wait complete. 2023-11-15T01:37:15.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.512+0000 7f3b60c64700 1 Processor -- start 2023-11-15T01:37:15.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.512+0000 7f3b60c64700 1 -- start start 2023-11-15T01:37:15.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.512+0000 7f3b60c64700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b5c0aa060 0x7f3b5c145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:15.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.512+0000 7f3b60c64700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b5c0c1cb0 0x7f3b5c0af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:15.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.512+0000 7f3b60c64700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b5c157660 0x7f3b5c0c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:15.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.512+0000 7f3b60c64700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0c4530 con 0x7f3b5c0aa060 2023-11-15T01:37:15.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.512+0000 7f3b60c64700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0c3c00 con 0x7f3b5c0c1cb0 2023-11-15T01:37:15.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.512+0000 7f3b60c64700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0c3ee0 con 0x7f3b5c157660 2023-11-15T01:37:15.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b5a59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b5c0aa060 0x7f3b5c145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:15.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b5a59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b5c0aa060 0x7f3b5c145af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40818/0 (socket says 172.21.15.1:40818) 2023-11-15T01:37:15.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b5a59c700 1 -- 172.21.15.1:0/3055382031 learned_addr learned my addr 172.21.15.1:0/3055382031 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:15.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b59d9b700 1 --2- 172.21.15.1:0/3055382031 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b5c0c1cb0 0x7f3b5c0af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:15.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b5ad9d700 1 --2- 172.21.15.1:0/3055382031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b5c157660 0x7f3b5c0c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:15.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b5a59c700 1 -- 172.21.15.1:0/3055382031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b5c157660 msgr2=0x7f3b5c0c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:15.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b5a59c700 1 --2- 172.21.15.1:0/3055382031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b5c157660 0x7f3b5c0c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:15.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b5a59c700 1 -- 172.21.15.1:0/3055382031 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b5c0c1cb0 msgr2=0x7f3b5c0af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:15.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b5a59c700 1 --2- 172.21.15.1:0/3055382031 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b5c0c1cb0 0x7f3b5c0af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:15.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b5a59c700 1 -- 172.21.15.1:0/3055382031 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b54009370 con 0x7f3b5c0aa060 2023-11-15T01:37:15.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b59d9b700 1 --2- 172.21.15.1:0/3055382031 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b5c0c1cb0 0x7f3b5c0af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:15.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b5a59c700 1 --2- 172.21.15.1:0/3055382031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b5c0aa060 0x7f3b5c145af0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f3b4c00c7c0 tx=0x7f3b4c0015c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:15.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b527fc700 1 -- 172.21.15.1:0/3055382031 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c006a20 con 0x7f3b5c0aa060 2023-11-15T01:37:15.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b527fc700 1 -- 172.21.15.1:0/3055382031 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c006b80 con 0x7f3b5c0aa060 2023-11-15T01:37:15.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b527fc700 1 -- 172.21.15.1:0/3055382031 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c007020 con 0x7f3b5c0aa060 2023-11-15T01:37:15.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b60c64700 1 -- 172.21.15.1:0/3055382031 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5c0c41c0 con 0x7f3b5c0aa060 2023-11-15T01:37:15.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.513+0000 7f3b60c64700 1 -- 172.21.15.1:0/3055382031 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5c0c3840 con 0x7f3b5c0aa060 2023-11-15T01:37:15.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.514+0000 7f3b60c64700 1 -- 172.21.15.1:0/3055382031 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5c0c4810 con 0x7f3b5c0aa060 2023-11-15T01:37:15.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.515+0000 7f3b527fc700 1 -- 172.21.15.1:0/3055382031 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3b4c007390 con 0x7f3b5c0aa060 2023-11-15T01:37:15.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.515+0000 7f3b527fc700 1 --2- 172.21.15.1:0/3055382031 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3b3c05f2a0 0x7f3b3c061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:15.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.515+0000 7f3b527fc700 1 -- 172.21.15.1:0/3055382031 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6666+0+0 (secure 0 0 0) 0x7f3b4c079c00 con 0x7f3b5c0aa060 2023-11-15T01:37:15.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.515+0000 7f3b59d9b700 1 --2- 172.21.15.1:0/3055382031 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3b3c05f2a0 0x7f3b3c061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:15.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.516+0000 7f3b59d9b700 1 --2- 172.21.15.1:0/3055382031 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3b3c05f2a0 0x7f3b3c061760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3b5c153de0 tx=0x7f3b44008040).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:15.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.519+0000 7f3b527fc700 1 -- 172.21.15.1:0/3055382031 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3b4c048af0 con 0x7f3b5c0aa060 2023-11-15T01:37:15.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:15.692+0000 7f3b60c64700 1 -- 172.21.15.1:0/3055382031 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3b5c06c7e0 con 0x7f3b5c0aa060 2023-11-15T01:37:16.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.364+0000 7f3b527fc700 1 -- 172.21.15.1:0/3055382031 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v100) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3b4c04ab30 con 0x7f3b5c0aa060 2023-11-15T01:37:16.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.368+0000 7f3b60c64700 1 -- 172.21.15.1:0/3055382031 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3b3c05f2a0 msgr2=0x7f3b3c061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:16.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.368+0000 7f3b60c64700 1 --2- 172.21.15.1:0/3055382031 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3b3c05f2a0 0x7f3b3c061760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3b5c153de0 tx=0x7f3b44008040).stop 2023-11-15T01:37:16.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.368+0000 7f3b60c64700 1 -- 172.21.15.1:0/3055382031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b5c0aa060 msgr2=0x7f3b5c145af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:16.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.368+0000 7f3b60c64700 1 --2- 172.21.15.1:0/3055382031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b5c0aa060 0x7f3b5c145af0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f3b4c00c7c0 tx=0x7f3b4c0015c0).stop 2023-11-15T01:37:16.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.368+0000 7f3b60c64700 1 -- 172.21.15.1:0/3055382031 shutdown_connections 2023-11-15T01:37:16.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.368+0000 7f3b60c64700 1 --2- 172.21.15.1:0/3055382031 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3b3c05f2a0 0x7f3b3c061760 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.368+0000 7f3b60c64700 1 --2- 172.21.15.1:0/3055382031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b5c157660 0x7f3b5c0c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.368+0000 7f3b60c64700 1 --2- 172.21.15.1:0/3055382031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b5c0aa060 0x7f3b5c145af0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.368+0000 7f3b60c64700 1 --2- 172.21.15.1:0/3055382031 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b5c0c1cb0 0x7f3b5c0af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.368+0000 7f3b60c64700 1 -- 172.21.15.1:0/3055382031 >> 172.21.15.1:0/3055382031 conn(0x7f3b5c064aa0 msgr2=0x7f3b5c154050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:16.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.368+0000 7f3b60c64700 1 -- 172.21.15.1:0/3055382031 shutdown_connections 2023-11-15T01:37:16.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.369+0000 7f3b60c64700 1 -- 172.21.15.1:0/3055382031 wait complete. 2023-11-15T01:37:16.371 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2023-11-15T01:37:16.385 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-15T01:37:16.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.512+0000 7f273088d700 1 Processor -- start 2023-11-15T01:37:16.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.512+0000 7f273088d700 1 -- start start 2023-11-15T01:37:16.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.513+0000 7f273088d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f272c14e6e0 0x7f272c14eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:16.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.513+0000 7f273088d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f272c062ec0 0x7f272c0c6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:16.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.513+0000 7f273088d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c158e40 con 0x7f272c155370 2023-11-15T01:37:16.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.513+0000 7f273088d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c158230 con 0x7f272c062ec0 2023-11-15T01:37:16.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.513+0000 7f273088d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c158510 con 0x7f272c14e6e0 2023-11-15T01:37:16.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.514+0000 7f272ad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f272c062ec0 0x7f272c0c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:16.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.514+0000 7f2729d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f272c155370 0x7f272c0627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42344/0 (socket says 172.21.15.1:42344) 2023-11-15T01:37:16.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.514+0000 7f2729d9b700 1 -- 172.21.15.1:0/3507233372 learned_addr learned my addr 172.21.15.1:0/3507233372 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:16.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.514+0000 7f272ad9d700 1 -- 172.21.15.1:0/3507233372 >> v2:172.21.15.141:3300/0 conn(0x7f272c14e6e0 msgr2=0x7f272c14eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:16.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.514+0000 7f272a59c700 1 --2- 172.21.15.1:0/3507233372 >> v2:172.21.15.141:3300/0 conn(0x7f272c14e6e0 0x7f272c14eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:16.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.514+0000 7f272959a700 1 -- 172.21.15.1:0/3507233372 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977475171 0 0) 0x7f272c158e40 con 0x7f272c155370 2023-11-15T01:37:16.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.514+0000 7f272ad9d700 1 --2- 172.21.15.1:0/3507233372 >> v2:172.21.15.141:3300/0 conn(0x7f272c14e6e0 0x7f272c14eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.514+0000 7f272ad9d700 1 -- 172.21.15.1:0/3507233372 >> v1:172.21.15.1:6789/0 conn(0x7f272c155370 legacy=0x7f272c0627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:16.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.514+0000 7f272ad9d700 1 -- 172.21.15.1:0/3507233372 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c1587f0 con 0x7f272c062ec0 2023-11-15T01:37:16.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.514+0000 7f272ad9d700 1 --2- 172.21.15.1:0/3507233372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f272c062ec0 0x7f272c0c6480 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f272c06a900 tx=0x7f2724009060).ready entity=mon.0 client_cookie=3e83524cc513f4ae server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:16.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.514+0000 7f272959a700 1 -- 172.21.15.1:0/3507233372 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272400b580 con 0x7f272c062ec0 2023-11-15T01:37:16.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.514+0000 7f272959a700 1 -- 172.21.15.1:0/3507233372 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272400b6e0 con 0x7f272c062ec0 2023-11-15T01:37:16.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.514+0000 7f272959a700 1 -- 172.21.15.1:0/3507233372 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272400ba60 con 0x7f272c062ec0 2023-11-15T01:37:16.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.515+0000 7f273088d700 1 -- 172.21.15.1:0/3507233372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f272c062ec0 msgr2=0x7f272c0c6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:16.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.515+0000 7f273088d700 1 --2- 172.21.15.1:0/3507233372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f272c062ec0 0x7f272c0c6480 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f272c06a900 tx=0x7f2724009060).stop 2023-11-15T01:37:16.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.515+0000 7f273088d700 1 -- 172.21.15.1:0/3507233372 shutdown_connections 2023-11-15T01:37:16.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.515+0000 7f273088d700 1 --2- 172.21.15.1:0/3507233372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f272c062ec0 0x7f272c0c6480 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.515+0000 7f273088d700 1 --2- 172.21.15.1:0/3507233372 >> v2:172.21.15.141:3300/0 conn(0x7f272c14e6e0 0x7f272c14eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.515+0000 7f273088d700 1 -- 172.21.15.1:0/3507233372 >> 172.21.15.1:0/3507233372 conn(0x7f272c0c7dc0 msgr2=0x7f272c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:16.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.515+0000 7f273088d700 1 -- 172.21.15.1:0/3507233372 shutdown_connections 2023-11-15T01:37:16.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.515+0000 7f273088d700 1 -- 172.21.15.1:0/3507233372 wait complete. 2023-11-15T01:37:16.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.516+0000 7f273088d700 1 Processor -- start 2023-11-15T01:37:16.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.516+0000 7f273088d700 1 -- start start 2023-11-15T01:37:16.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f273088d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f272c062ec0 0x7f272c139970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:16.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f273088d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f272c14e6e0 0x7f272c0a6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:16.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f273088d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f272c155370 0x7f272c0c0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:16.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f273088d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0bee60 con 0x7f272c14e6e0 2023-11-15T01:37:16.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f273088d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0bf420 con 0x7f272c062ec0 2023-11-15T01:37:16.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f273088d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0c0e40 con 0x7f272c155370 2023-11-15T01:37:16.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f2729d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f272c14e6e0 0x7f272c0a6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:16.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f2729d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f272c14e6e0 0x7f272c0a6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40842/0 (socket says 172.21.15.1:40842) 2023-11-15T01:37:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f2729d9b700 1 -- 172.21.15.1:0/87642124 learned_addr learned my addr 172.21.15.1:0/87642124 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f272a59c700 1 --2- 172.21.15.1:0/87642124 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f272c062ec0 0x7f272c139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f272ad9d700 1 --2- 172.21.15.1:0/87642124 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f272c155370 0x7f272c0c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f2729d9b700 1 -- 172.21.15.1:0/87642124 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f272c155370 msgr2=0x7f272c0c0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:16.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f2729d9b700 1 --2- 172.21.15.1:0/87642124 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f272c155370 0x7f272c0c0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f2729d9b700 1 -- 172.21.15.1:0/87642124 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f272c062ec0 msgr2=0x7f272c139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:16.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f2729d9b700 1 --2- 172.21.15.1:0/87642124 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f272c062ec0 0x7f272c139970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f2729d9b700 1 -- 172.21.15.1:0/87642124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27240092a0 con 0x7f272c14e6e0 2023-11-15T01:37:16.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.517+0000 7f2729d9b700 1 --2- 172.21.15.1:0/87642124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f272c14e6e0 0x7f272c0a6d80 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f271400c460 tx=0x7f2714007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:16.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.518+0000 7f27227fc700 1 -- 172.21.15.1:0/87642124 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27140072e0 con 0x7f272c14e6e0 2023-11-15T01:37:16.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.518+0000 7f27227fc700 1 -- 172.21.15.1:0/87642124 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2714007440 con 0x7f272c14e6e0 2023-11-15T01:37:16.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.518+0000 7f273088d700 1 -- 172.21.15.1:0/87642124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c0c10c0 con 0x7f272c14e6e0 2023-11-15T01:37:16.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.518+0000 7f27227fc700 1 -- 172.21.15.1:0/87642124 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27140057a0 con 0x7f272c14e6e0 2023-11-15T01:37:16.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.518+0000 7f273088d700 1 -- 172.21.15.1:0/87642124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c0bf0b0 con 0x7f272c14e6e0 2023-11-15T01:37:16.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.519+0000 7f273088d700 1 -- 172.21.15.1:0/87642124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272c0c1cb0 con 0x7f272c14e6e0 2023-11-15T01:37:16.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.519+0000 7f27227fc700 1 -- 172.21.15.1:0/87642124 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2714005b90 con 0x7f272c14e6e0 2023-11-15T01:37:16.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.519+0000 7f27227fc700 1 --2- 172.21.15.1:0/87642124 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f270c05f270 0x7f270c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:16.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.519+0000 7f27227fc700 1 -- 172.21.15.1:0/87642124 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6252+0+0 (secure 0 0 0) 0x7f2714079cb0 con 0x7f272c14e6e0 2023-11-15T01:37:16.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.520+0000 7f272a59c700 1 --2- 172.21.15.1:0/87642124 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f270c05f270 0x7f270c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:16.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.520+0000 7f272a59c700 1 --2- 172.21.15.1:0/87642124 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f270c05f270 0x7f270c061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f271c00e4d0 tx=0x7f271c007680).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:16.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.523+0000 7f27227fc700 1 -- 172.21.15.1:0/87642124 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f271404ad80 con 0x7f272c14e6e0 2023-11-15T01:37:16.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.703+0000 7f273088d700 1 -- 172.21.15.1:0/87642124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f272c06c7e0 con 0x7f272c14e6e0 2023-11-15T01:37:16.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.707+0000 7f27227fc700 1 -- 172.21.15.1:0/87642124 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f271404e3a0 con 0x7f272c14e6e0 2023-11-15T01:37:16.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.709+0000 7f273088d700 1 -- 172.21.15.1:0/87642124 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f270c05f270 msgr2=0x7f270c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:16.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.709+0000 7f273088d700 1 --2- 172.21.15.1:0/87642124 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f270c05f270 0x7f270c061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f271c00e4d0 tx=0x7f271c007680).stop 2023-11-15T01:37:16.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.709+0000 7f273088d700 1 -- 172.21.15.1:0/87642124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f272c14e6e0 msgr2=0x7f272c0a6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:16.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.709+0000 7f273088d700 1 --2- 172.21.15.1:0/87642124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f272c14e6e0 0x7f272c0a6d80 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f271400c460 tx=0x7f2714007e90).stop 2023-11-15T01:37:16.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.709+0000 7f273088d700 1 -- 172.21.15.1:0/87642124 shutdown_connections 2023-11-15T01:37:16.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.709+0000 7f273088d700 1 --2- 172.21.15.1:0/87642124 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f270c05f270 0x7f270c061730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.709+0000 7f273088d700 1 --2- 172.21.15.1:0/87642124 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f272c155370 0x7f272c0c0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.709+0000 7f273088d700 1 --2- 172.21.15.1:0/87642124 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f272c062ec0 0x7f272c139970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.709+0000 7f273088d700 1 --2- 172.21.15.1:0/87642124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f272c14e6e0 0x7f272c0a6d80 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.709+0000 7f273088d700 1 -- 172.21.15.1:0/87642124 >> 172.21.15.1:0/87642124 conn(0x7f272c0c7dc0 msgr2=0x7f272c155db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:16.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.709+0000 7f273088d700 1 -- 172.21.15.1:0/87642124 shutdown_connections 2023-11-15T01:37:16.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.709+0000 7f273088d700 1 -- 172.21.15.1:0/87642124 wait complete. 2023-11-15T01:37:16.722 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-15T01:37:16.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.841+0000 7fbce85ec700 1 Processor -- start 2023-11-15T01:37:16.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.841+0000 7fbce85ec700 1 -- start start 2023-11-15T01:37:16.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce85ec700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbce01540a0 0x7fbce00ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:16.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce85ec700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbce0154480 0x7fbce00ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:16.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce85ec700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbce00c5f40 0x7fbce00c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:16.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce85ec700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce00ca050 con 0x7fbce01540a0 2023-11-15T01:37:16.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce85ec700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce00c68c0 con 0x7fbce00c5f40 2023-11-15T01:37:16.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce85ec700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce00c9440 con 0x7fbce0154480 2023-11-15T01:37:16.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce6388700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbce01540a0 0x7fbce00ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:16.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce6388700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbce01540a0 0x7fbce00ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40854/0 (socket says 172.21.15.1:40854) 2023-11-15T01:37:16.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce6388700 1 -- 172.21.15.1:0/747343168 learned_addr learned my addr 172.21.15.1:0/747343168 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:16.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce6b89700 1 --2- 172.21.15.1:0/747343168 >> v2:172.21.15.141:3300/0 conn(0x7fbce00c5f40 0x7fbce00c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce5b87700 1 --2- 172.21.15.1:0/747343168 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbce0154480 0x7fbce00ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce6388700 1 -- 172.21.15.1:0/747343168 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbce0154480 msgr2=0x7fbce00ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce6388700 1 --2- 172.21.15.1:0/747343168 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbce0154480 0x7fbce00ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce6388700 1 -- 172.21.15.1:0/747343168 >> v2:172.21.15.141:3300/0 conn(0x7fbce00c5f40 msgr2=0x7fbce00c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce6388700 1 --2- 172.21.15.1:0/747343168 >> v2:172.21.15.141:3300/0 conn(0x7fbce00c5f40 0x7fbce00c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce6388700 1 -- 172.21.15.1:0/747343168 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce00c9720 con 0x7fbce01540a0 2023-11-15T01:37:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce5b87700 1 --2- 172.21.15.1:0/747343168 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbce0154480 0x7fbce00ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:37:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce6388700 1 --2- 172.21.15.1:0/747343168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbce01540a0 0x7fbce00ca4e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7fbce00aad10 tx=0x7fbcdc0090f0).ready entity=mon.0 client_cookie=e4298fc238979040 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce5386700 1 -- 172.21.15.1:0/747343168 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00b600 con 0x7fbce01540a0 2023-11-15T01:37:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce5386700 1 -- 172.21.15.1:0/747343168 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc00b760 con 0x7fbce01540a0 2023-11-15T01:37:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.842+0000 7fbce5386700 1 -- 172.21.15.1:0/747343168 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00bae0 con 0x7fbce01540a0 2023-11-15T01:37:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.843+0000 7fbce85ec700 1 -- 172.21.15.1:0/747343168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbce01540a0 msgr2=0x7fbce00ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.843+0000 7fbce85ec700 1 --2- 172.21.15.1:0/747343168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbce01540a0 0x7fbce00ca4e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7fbce00aad10 tx=0x7fbcdc0090f0).stop 2023-11-15T01:37:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.843+0000 7fbce85ec700 1 -- 172.21.15.1:0/747343168 shutdown_connections 2023-11-15T01:37:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.843+0000 7fbce85ec700 1 --2- 172.21.15.1:0/747343168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbce01540a0 0x7fbce00ca4e0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.843+0000 7fbce85ec700 1 --2- 172.21.15.1:0/747343168 >> v2:172.21.15.141:3300/0 conn(0x7fbce00c5f40 0x7fbce00c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.843+0000 7fbce85ec700 1 --2- 172.21.15.1:0/747343168 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbce0154480 0x7fbce00ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.843+0000 7fbce85ec700 1 -- 172.21.15.1:0/747343168 >> 172.21.15.1:0/747343168 conn(0x7fbce0064a70 msgr2=0x7fbce0064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.843+0000 7fbce85ec700 1 -- 172.21.15.1:0/747343168 shutdown_connections 2023-11-15T01:37:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.843+0000 7fbce85ec700 1 -- 172.21.15.1:0/747343168 wait complete. 2023-11-15T01:37:16.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.844+0000 7fbce85ec700 1 Processor -- start 2023-11-15T01:37:16.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.844+0000 7fbce85ec700 1 -- start start 2023-11-15T01:37:16.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce85ec700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbce00c5f40 0x7fbce014fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:16.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce85ec700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbce01540a0 0x7fbce0167ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:16.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce85ec700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbce0154480 0x7fbce0168190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:16.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce85ec700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce00c2810 con 0x7fbce00c5f40 2023-11-15T01:37:16.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce85ec700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce00c2dd0 con 0x7fbce01540a0 2023-11-15T01:37:16.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce85ec700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce0168720 con 0x7fbce0154480 2023-11-15T01:37:16.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce6388700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbce00c5f40 0x7fbce014fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:16.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce6388700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbce00c5f40 0x7fbce014fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40862/0 (socket says 172.21.15.1:40862) 2023-11-15T01:37:16.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce6388700 1 -- 172.21.15.1:0/1483575391 learned_addr learned my addr 172.21.15.1:0/1483575391 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:16.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce5b87700 1 --2- 172.21.15.1:0/1483575391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbce01540a0 0x7fbce0167ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:16.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce6b89700 1 --2- 172.21.15.1:0/1483575391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbce0154480 0x7fbce0168190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:16.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce6388700 1 -- 172.21.15.1:0/1483575391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbce0154480 msgr2=0x7fbce0168190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:16.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce6388700 1 --2- 172.21.15.1:0/1483575391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbce0154480 0x7fbce0168190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce6388700 1 -- 172.21.15.1:0/1483575391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbce01540a0 msgr2=0x7fbce0167ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:16.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce6388700 1 --2- 172.21.15.1:0/1483575391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbce01540a0 0x7fbce0167ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:16.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.845+0000 7fbce6388700 1 -- 172.21.15.1:0/1483575391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc009370 con 0x7fbce00c5f40 2023-11-15T01:37:16.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.846+0000 7fbce6388700 1 --2- 172.21.15.1:0/1483575391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbce00c5f40 0x7fbce014fd20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fbcdc009130 tx=0x7fbcdc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:16.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.846+0000 7fbcd67fc700 1 -- 172.21.15.1:0/1483575391 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00bea0 con 0x7fbce00c5f40 2023-11-15T01:37:16.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.846+0000 7fbcd67fc700 1 -- 172.21.15.1:0/1483575391 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc00b8d0 con 0x7fbce00c5f40 2023-11-15T01:37:16.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.846+0000 7fbce85ec700 1 -- 172.21.15.1:0/1483575391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce0168a00 con 0x7fbce00c5f40 2023-11-15T01:37:16.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.846+0000 7fbcd67fc700 1 -- 172.21.15.1:0/1483575391 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc01b660 con 0x7fbce00c5f40 2023-11-15T01:37:16.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.846+0000 7fbce85ec700 1 -- 172.21.15.1:0/1483575391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce0150210 con 0x7fbce00c5f40 2023-11-15T01:37:16.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.847+0000 7fbce85ec700 1 -- 172.21.15.1:0/1483575391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce006c7e0 con 0x7fbce00c5f40 2023-11-15T01:37:16.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.847+0000 7fbcd67fc700 1 -- 172.21.15.1:0/1483575391 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fbcdc01ba10 con 0x7fbce00c5f40 2023-11-15T01:37:16.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.847+0000 7fbcd67fc700 1 --2- 172.21.15.1:0/1483575391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbcc405f240 0x7fbcc4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:16.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.848+0000 7fbcd67fc700 1 -- 172.21.15.1:0/1483575391 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6252+0+0 (secure 0 0 0) 0x7fbcdc07bdb0 con 0x7fbce00c5f40 2023-11-15T01:37:16.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.848+0000 7fbce5b87700 1 --2- 172.21.15.1:0/1483575391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbcc405f240 0x7fbcc4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:16.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.848+0000 7fbce5b87700 1 --2- 172.21.15.1:0/1483575391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbcc405f240 0x7fbcc4061700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fbce00c4870 tx=0x7fbcd0008040).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:16.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:16.852+0000 7fbcd67fc700 1 -- 172.21.15.1:0/1483575391 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbcdc0508b0 con 0x7fbce00c5f40 2023-11-15T01:37:17.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.033+0000 7fbce85ec700 1 -- 172.21.15.1:0/1483575391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fbce00c9a00 con 0x7fbce00c5f40 2023-11-15T01:37:17.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.037+0000 7fbcd67fc700 1 -- 172.21.15.1:0/1483575391 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v17) v1 ==== 120+0+0 (secure 0 0 0) 0x7fbcdc01f0b0 con 0x7fbce00c5f40 2023-11-15T01:37:17.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.039+0000 7fbce85ec700 1 -- 172.21.15.1:0/1483575391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbcc405f240 msgr2=0x7fbcc4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:17.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.039+0000 7fbce85ec700 1 --2- 172.21.15.1:0/1483575391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbcc405f240 0x7fbcc4061700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fbce00c4870 tx=0x7fbcd0008040).stop 2023-11-15T01:37:17.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.039+0000 7fbce85ec700 1 -- 172.21.15.1:0/1483575391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbce00c5f40 msgr2=0x7fbce014fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:17.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.039+0000 7fbce85ec700 1 --2- 172.21.15.1:0/1483575391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbce00c5f40 0x7fbce014fd20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fbcdc009130 tx=0x7fbcdc017000).stop 2023-11-15T01:37:17.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.039+0000 7fbce85ec700 1 -- 172.21.15.1:0/1483575391 shutdown_connections 2023-11-15T01:37:17.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.039+0000 7fbce85ec700 1 --2- 172.21.15.1:0/1483575391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbcc405f240 0x7fbcc4061700 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:17.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.039+0000 7fbce85ec700 1 --2- 172.21.15.1:0/1483575391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbce0154480 0x7fbce0168190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:17.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.039+0000 7fbce85ec700 1 --2- 172.21.15.1:0/1483575391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbce00c5f40 0x7fbce014fd20 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:17.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.039+0000 7fbce85ec700 1 --2- 172.21.15.1:0/1483575391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbce01540a0 0x7fbce0167ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:17.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.039+0000 7fbce85ec700 1 -- 172.21.15.1:0/1483575391 >> 172.21.15.1:0/1483575391 conn(0x7fbce0064a70 msgr2=0x7fbce015a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:17.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.039+0000 7fbce85ec700 1 -- 172.21.15.1:0/1483575391 shutdown_connections 2023-11-15T01:37:17.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.039+0000 7fbce85ec700 1 -- 172.21.15.1:0/1483575391 wait complete. 2023-11-15T01:37:17.051 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-11-15T01:37:17.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.169+0000 7fae584cc700 1 Processor -- start 2023-11-15T01:37:17.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.169+0000 7fae584cc700 1 -- start start 2023-11-15T01:37:17.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.170+0000 7fae584cc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fae50154150 0x7fae50154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:17.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.170+0000 7fae584cc700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fae500aa060 0x7fae500c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:17.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.170+0000 7fae584cc700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae500c06f0 con 0x7fae500ab1a0 2023-11-15T01:37:17.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.170+0000 7fae584cc700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae500c09d0 con 0x7fae50154150 2023-11-15T01:37:17.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.170+0000 7fae584cc700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae50158820 con 0x7fae500aa060 2023-11-15T01:37:17.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.170+0000 7fae56268700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fae50154150 0x7fae50154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:17.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.170+0000 7fae56268700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fae50154150 0x7fae50154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40866/0 (socket says 172.21.15.1:40866) 2023-11-15T01:37:17.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.170+0000 7fae56268700 1 -- 172.21.15.1:0/1583785590 learned_addr learned my addr 172.21.15.1:0/1583785590 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:17.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.170+0000 7fae56a69700 1 --2- 172.21.15.1:0/1583785590 >> v2:172.21.15.141:3300/0 conn(0x7fae500aa060 0x7fae500c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:17.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.170+0000 7fae56268700 1 -- 172.21.15.1:0/1583785590 >> v2:172.21.15.141:3300/0 conn(0x7fae500aa060 msgr2=0x7fae500c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:17.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.170+0000 7fae56268700 1 --2- 172.21.15.1:0/1583785590 >> v2:172.21.15.141:3300/0 conn(0x7fae500aa060 0x7fae500c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:17.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.170+0000 7fae56268700 1 -- 172.21.15.1:0/1583785590 >> v1:172.21.15.141:6789/0 conn(0x7fae500ab1a0 legacy=0x7fae50158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:17.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.170+0000 7fae56268700 1 -- 172.21.15.1:0/1583785590 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae50158b00 con 0x7fae50154150 2023-11-15T01:37:17.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.171+0000 7fae56268700 1 --2- 172.21.15.1:0/1583785590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50154150 0x7fae50154530 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fae50157f80 tx=0x7fae4c0090f0).ready entity=mon.0 client_cookie=a59873d6615ab4e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:17.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.171+0000 7fae55266700 1 -- 172.21.15.1:0/1583785590 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c00b520 con 0x7fae50154150 2023-11-15T01:37:17.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.171+0000 7fae55266700 1 -- 172.21.15.1:0/1583785590 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4c00b680 con 0x7fae50154150 2023-11-15T01:37:17.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.171+0000 7fae55266700 1 -- 172.21.15.1:0/1583785590 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c00ba20 con 0x7fae50154150 2023-11-15T01:37:17.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.171+0000 7fae584cc700 1 -- 172.21.15.1:0/1583785590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50154150 msgr2=0x7fae50154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:17.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.171+0000 7fae584cc700 1 --2- 172.21.15.1:0/1583785590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50154150 0x7fae50154530 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fae50157f80 tx=0x7fae4c0090f0).stop 2023-11-15T01:37:17.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.171+0000 7fae584cc700 1 -- 172.21.15.1:0/1583785590 shutdown_connections 2023-11-15T01:37:17.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.171+0000 7fae584cc700 1 --2- 172.21.15.1:0/1583785590 >> v2:172.21.15.141:3300/0 conn(0x7fae500aa060 0x7fae500c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:17.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.171+0000 7fae584cc700 1 --2- 172.21.15.1:0/1583785590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50154150 0x7fae50154530 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:17.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.171+0000 7fae584cc700 1 -- 172.21.15.1:0/1583785590 >> 172.21.15.1:0/1583785590 conn(0x7fae50064aa0 msgr2=0x7fae50064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:17.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.171+0000 7fae584cc700 1 -- 172.21.15.1:0/1583785590 shutdown_connections 2023-11-15T01:37:17.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.171+0000 7fae584cc700 1 -- 172.21.15.1:0/1583785590 wait complete. 2023-11-15T01:37:17.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.172+0000 7fae584cc700 1 Processor -- start 2023-11-15T01:37:17.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.172+0000 7fae584cc700 1 -- start start 2023-11-15T01:37:17.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.173+0000 7fae584cc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae500aa060 0x7fae501687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:17.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.173+0000 7fae584cc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae500ab1a0 0x7fae500c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:17.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.173+0000 7fae584cc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50154150 0x7fae500c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:17.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.173+0000 7fae584cc700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500c42d0 con 0x7fae50154150 2023-11-15T01:37:17.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.173+0000 7fae584cc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500ae560 con 0x7fae500ab1a0 2023-11-15T01:37:17.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.173+0000 7fae584cc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5014e310 con 0x7fae500aa060 2023-11-15T01:37:17.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.173+0000 7fae56a69700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50154150 0x7fae500c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:17.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.173+0000 7fae56a69700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50154150 0x7fae500c3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40876/0 (socket says 172.21.15.1:40876) 2023-11-15T01:37:17.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.173+0000 7fae56a69700 1 -- 172.21.15.1:0/1520723910 learned_addr learned my addr 172.21.15.1:0/1520723910 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:17.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.173+0000 7fae56268700 1 --2- 172.21.15.1:0/1520723910 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae500aa060 0x7fae501687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:17.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.173+0000 7fae55a67700 1 --2- 172.21.15.1:0/1520723910 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae500ab1a0 0x7fae500c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:17.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.174+0000 7fae56a69700 1 -- 172.21.15.1:0/1520723910 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae500aa060 msgr2=0x7fae501687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:17.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.174+0000 7fae56a69700 1 --2- 172.21.15.1:0/1520723910 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae500aa060 0x7fae501687a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:17.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.174+0000 7fae56a69700 1 -- 172.21.15.1:0/1520723910 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae500ab1a0 msgr2=0x7fae500c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:17.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.174+0000 7fae56a69700 1 --2- 172.21.15.1:0/1520723910 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae500ab1a0 0x7fae500c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:17.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.174+0000 7fae56a69700 1 -- 172.21.15.1:0/1520723910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c009370 con 0x7fae50154150 2023-11-15T01:37:17.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.174+0000 7fae56a69700 1 --2- 172.21.15.1:0/1520723910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50154150 0x7fae500c3de0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7fae48009ec0 tx=0x7fae4800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:17.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.174+0000 7fae467fc700 1 -- 172.21.15.1:0/1520723910 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800cb70 con 0x7fae50154150 2023-11-15T01:37:17.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.174+0000 7fae467fc700 1 -- 172.21.15.1:0/1520723910 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4800f040 con 0x7fae50154150 2023-11-15T01:37:17.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.174+0000 7fae584cc700 1 -- 172.21.15.1:0/1520723910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae50164d60 con 0x7fae50154150 2023-11-15T01:37:17.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.174+0000 7fae467fc700 1 -- 172.21.15.1:0/1520723910 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800cee0 con 0x7fae50154150 2023-11-15T01:37:17.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.174+0000 7fae584cc700 1 -- 172.21.15.1:0/1520723910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae50165320 con 0x7fae50154150 2023-11-15T01:37:17.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.175+0000 7fae584cc700 1 -- 172.21.15.1:0/1520723910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae500ae710 con 0x7fae50154150 2023-11-15T01:37:17.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.175+0000 7fae467fc700 1 -- 172.21.15.1:0/1520723910 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fae48013610 con 0x7fae50154150 2023-11-15T01:37:17.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.176+0000 7fae467fc700 1 --2- 172.21.15.1:0/1520723910 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fae3405f270 0x7fae34061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:17.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.176+0000 7fae467fc700 1 -- 172.21.15.1:0/1520723910 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6252+0+0 (secure 0 0 0) 0x7fae4807ac00 con 0x7fae50154150 2023-11-15T01:37:17.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.176+0000 7fae56268700 1 --2- 172.21.15.1:0/1520723910 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fae3405f270 0x7fae34061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:17.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.176+0000 7fae56268700 1 --2- 172.21.15.1:0/1520723910 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fae3405f270 0x7fae34061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fae4c00b2e0 tx=0x7fae4c017000).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:17.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.180+0000 7fae467fc700 1 -- 172.21.15.1:0/1520723910 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fae500ae710 con 0x7fae50154150 2023-11-15T01:37:17.224 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:37:17.227 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:37:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:17.423+0000 7fae584cc700 1 -- 172.21.15.1:0/1520723910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7fae500ae710 con 0x7fae50154150 2023-11-15T01:37:18.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.370+0000 7fae467fc700 1 -- 172.21.15.1:0/1520723910 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v578) v1 ==== 166+0+0 (secure 0 0 0) 0x7fae500ae710 con 0x7fae50154150 2023-11-15T01:37:18.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.373+0000 7fae584cc700 1 -- 172.21.15.1:0/1520723910 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fae3405f270 msgr2=0x7fae34061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:18.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.373+0000 7fae584cc700 1 --2- 172.21.15.1:0/1520723910 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fae3405f270 0x7fae34061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fae4c00b2e0 tx=0x7fae4c017000).stop 2023-11-15T01:37:18.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.373+0000 7fae584cc700 1 -- 172.21.15.1:0/1520723910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50154150 msgr2=0x7fae500c3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:18.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.373+0000 7fae584cc700 1 --2- 172.21.15.1:0/1520723910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50154150 0x7fae500c3de0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7fae48009ec0 tx=0x7fae4800b040).stop 2023-11-15T01:37:18.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.373+0000 7fae584cc700 1 -- 172.21.15.1:0/1520723910 shutdown_connections 2023-11-15T01:37:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.373+0000 7fae584cc700 1 --2- 172.21.15.1:0/1520723910 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fae3405f270 0x7fae34061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.373+0000 7fae584cc700 1 --2- 172.21.15.1:0/1520723910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae50154150 0x7fae500c3de0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.373+0000 7fae584cc700 1 --2- 172.21.15.1:0/1520723910 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae500aa060 0x7fae501687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.373+0000 7fae584cc700 1 --2- 172.21.15.1:0/1520723910 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae500ab1a0 0x7fae500c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.373+0000 7fae584cc700 1 -- 172.21.15.1:0/1520723910 >> 172.21.15.1:0/1520723910 conn(0x7fae50064aa0 msgr2=0x7fae500ad650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.373+0000 7fae584cc700 1 -- 172.21.15.1:0/1520723910 shutdown_connections 2023-11-15T01:37:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.373+0000 7fae584cc700 1 -- 172.21.15.1:0/1520723910 wait complete. 2023-11-15T01:37:18.388 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-11-15T01:37:18.389 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that a non-existent path leads to schedule deactivation after a few retries. 2023-11-15T01:37:18.389 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-15T01:37:18.390 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-11-15T01:37:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.514+0000 7f0ab9f5a700 1 Processor -- start 2023-11-15T01:37:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.515+0000 7f0ab9f5a700 1 -- start start 2023-11-15T01:37:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.515+0000 7f0ab9f5a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0ab4151e10 0x7f0ab4155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.515+0000 7f0ab9f5a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0ab40c86b0 0x7f0ab40aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.515+0000 7f0ab9f5a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab40c7980 con 0x7f0ab40c98b0 2023-11-15T01:37:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.515+0000 7f0ab9f5a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab40c8b10 con 0x7f0ab40c86b0 2023-11-15T01:37:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.515+0000 7f0ab9f5a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab40aa5c0 con 0x7f0ab4151e10 2023-11-15T01:37:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.516+0000 7f0ab3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0ab40c86b0 0x7f0ab40aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.516+0000 7f0ab9759700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0ab40c98b0 0x7f0ab40c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57436/0 (socket says 172.21.15.1:57436) 2023-11-15T01:37:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.516+0000 7f0ab9759700 1 -- 172.21.15.1:0/525472327 learned_addr learned my addr 172.21.15.1:0/525472327 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.516+0000 7f0ab8f58700 1 --2- 172.21.15.1:0/525472327 >> v2:172.21.15.141:3300/0 conn(0x7f0ab4151e10 0x7f0ab4155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.516+0000 7f0ab3fff700 1 -- 172.21.15.1:0/525472327 >> v2:172.21.15.141:3300/0 conn(0x7f0ab4151e10 msgr2=0x7f0ab4155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.516+0000 7f0ab3fff700 1 --2- 172.21.15.1:0/525472327 >> v2:172.21.15.141:3300/0 conn(0x7f0ab4151e10 0x7f0ab4155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.516+0000 7f0ab3fff700 1 -- 172.21.15.1:0/525472327 >> v1:172.21.15.1:6789/0 conn(0x7f0ab40c98b0 legacy=0x7f0ab40c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.516+0000 7f0ab3fff700 1 -- 172.21.15.1:0/525472327 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab40aa890 con 0x7f0ab40c86b0 2023-11-15T01:37:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.516+0000 7f0ab37fe700 1 -- 172.21.15.1:0/525472327 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605297523 0 0) 0x7f0ab40c7980 con 0x7f0ab40c98b0 2023-11-15T01:37:18.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.516+0000 7f0ab3fff700 1 --2- 172.21.15.1:0/525472327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab40c86b0 0x7f0ab40aa0d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f0ab4084780 tx=0x7f0a9c009060).ready entity=mon.0 client_cookie=9e598af417ffb626 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:18.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.516+0000 7f0ab37fe700 1 -- 172.21.15.1:0/525472327 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c00f510 con 0x7f0ab40c86b0 2023-11-15T01:37:18.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.516+0000 7f0ab37fe700 1 -- 172.21.15.1:0/525472327 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c00f670 con 0x7f0ab40c86b0 2023-11-15T01:37:18.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.516+0000 7f0ab37fe700 1 -- 172.21.15.1:0/525472327 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c00f9f0 con 0x7f0ab40c86b0 2023-11-15T01:37:18.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.517+0000 7f0ab9f5a700 1 -- 172.21.15.1:0/525472327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab40c86b0 msgr2=0x7f0ab40aa0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:18.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.517+0000 7f0ab9f5a700 1 --2- 172.21.15.1:0/525472327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab40c86b0 0x7f0ab40aa0d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f0ab4084780 tx=0x7f0a9c009060).stop 2023-11-15T01:37:18.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.517+0000 7f0ab9f5a700 1 -- 172.21.15.1:0/525472327 shutdown_connections 2023-11-15T01:37:18.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.517+0000 7f0ab9f5a700 1 --2- 172.21.15.1:0/525472327 >> v2:172.21.15.141:3300/0 conn(0x7f0ab4151e10 0x7f0ab4155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:18.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.517+0000 7f0ab9f5a700 1 --2- 172.21.15.1:0/525472327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab40c86b0 0x7f0ab40aa0d0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:18.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.517+0000 7f0ab9f5a700 1 -- 172.21.15.1:0/525472327 >> 172.21.15.1:0/525472327 conn(0x7f0ab40947e0 msgr2=0x7f0ab406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:18.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.517+0000 7f0ab9f5a700 1 -- 172.21.15.1:0/525472327 shutdown_connections 2023-11-15T01:37:18.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.517+0000 7f0ab9f5a700 1 -- 172.21.15.1:0/525472327 wait complete. 2023-11-15T01:37:18.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.518+0000 7f0ab9f5a700 1 Processor -- start 2023-11-15T01:37:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.518+0000 7f0ab9f5a700 1 -- start start 2023-11-15T01:37:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab9f5a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab40c86b0 0x7f0ab40acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab9f5a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ab40c98b0 0x7f0ab4167df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab9f5a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab4151e10 0x7f0ab40b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab9f5a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab413e450 con 0x7f0ab40c86b0 2023-11-15T01:37:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab9f5a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40ad070 con 0x7f0ab4151e10 2023-11-15T01:37:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab9f5a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40ae940 con 0x7f0ab40c98b0 2023-11-15T01:37:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab8f58700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab40c86b0 0x7f0ab40acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab8f58700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab40c86b0 0x7f0ab40acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34940/0 (socket says 172.21.15.1:34940) 2023-11-15T01:37:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab8f58700 1 -- 172.21.15.1:0/1413412764 learned_addr learned my addr 172.21.15.1:0/1413412764 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab9759700 1 --2- 172.21.15.1:0/1413412764 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab4151e10 0x7f0ab40b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab3fff700 1 --2- 172.21.15.1:0/1413412764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ab40c98b0 0x7f0ab4167df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab8f58700 1 -- 172.21.15.1:0/1413412764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ab40c98b0 msgr2=0x7f0ab4167df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab8f58700 1 --2- 172.21.15.1:0/1413412764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ab40c98b0 0x7f0ab4167df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab8f58700 1 -- 172.21.15.1:0/1413412764 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab4151e10 msgr2=0x7f0ab40b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab8f58700 1 --2- 172.21.15.1:0/1413412764 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab4151e10 0x7f0ab40b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.519+0000 7f0ab8f58700 1 -- 172.21.15.1:0/1413412764 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c0092a0 con 0x7f0ab40c86b0 2023-11-15T01:37:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.520+0000 7f0ab8f58700 1 --2- 172.21.15.1:0/1413412764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab40c86b0 0x7f0ab40acb80 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f0aac009e50 tx=0x7f0aac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.520+0000 7f0ab0ff9700 1 -- 172.21.15.1:0/1413412764 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac00caa0 con 0x7f0ab40c86b0 2023-11-15T01:37:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.520+0000 7f0ab0ff9700 1 -- 172.21.15.1:0/1413412764 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac00f040 con 0x7f0ab40c86b0 2023-11-15T01:37:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.520+0000 7f0ab9f5a700 1 -- 172.21.15.1:0/1413412764 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab40ad280 con 0x7f0ab40c86b0 2023-11-15T01:37:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.520+0000 7f0ab0ff9700 1 -- 172.21.15.1:0/1413412764 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac00ce10 con 0x7f0ab40c86b0 2023-11-15T01:37:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.520+0000 7f0ab9f5a700 1 -- 172.21.15.1:0/1413412764 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab40adb20 con 0x7f0ab40c86b0 2023-11-15T01:37:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.521+0000 7f0ab9f5a700 1 -- 172.21.15.1:0/1413412764 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab40475e0 con 0x7f0ab40c86b0 2023-11-15T01:37:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.521+0000 7f0ab0ff9700 1 -- 172.21.15.1:0/1413412764 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0aac013610 con 0x7f0ab40c86b0 2023-11-15T01:37:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.521+0000 7f0ab0ff9700 1 --2- 172.21.15.1:0/1413412764 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a9405f270 0x7f0a94061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:18.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.521+0000 7f0ab0ff9700 1 -- 172.21.15.1:0/1413412764 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6252+0+0 (secure 0 0 0) 0x7f0aac07aba0 con 0x7f0ab40c86b0 2023-11-15T01:37:18.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.522+0000 7f0ab3fff700 1 --2- 172.21.15.1:0/1413412764 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a9405f270 0x7f0a94061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:18.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.522+0000 7f0ab3fff700 1 --2- 172.21.15.1:0/1413412764 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a9405f270 0x7f0a94061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0ab4167340 tx=0x7f0a9c017000).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:18.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.526+0000 7f0ab0ff9700 1 -- 172.21.15.1:0/1413412764 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0aac04bc70 con 0x7f0ab40c86b0 2023-11-15T01:37:18.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:18.767+0000 7f0ab9f5a700 1 -- 172.21.15.1:0/1413412764 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f0ab40aeb70 con 0x7f0ab40c86b0 2023-11-15T01:37:19.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.372+0000 7f0ab0ff9700 1 -- 172.21.15.1:0/1413412764 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v579) v1 ==== 186+0+0 (secure 0 0 0) 0x7f0aac01a310 con 0x7f0ab40c86b0 2023-11-15T01:37:19.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.375+0000 7f0ab9f5a700 1 -- 172.21.15.1:0/1413412764 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a9405f270 msgr2=0x7f0a94061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:19.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.375+0000 7f0ab9f5a700 1 --2- 172.21.15.1:0/1413412764 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a9405f270 0x7f0a94061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0ab4167340 tx=0x7f0a9c017000).stop 2023-11-15T01:37:19.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.375+0000 7f0ab9f5a700 1 -- 172.21.15.1:0/1413412764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab40c86b0 msgr2=0x7f0ab40acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:19.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.375+0000 7f0ab9f5a700 1 --2- 172.21.15.1:0/1413412764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab40c86b0 0x7f0ab40acb80 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f0aac009e50 tx=0x7f0aac00b040).stop 2023-11-15T01:37:19.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.375+0000 7f0ab9f5a700 1 -- 172.21.15.1:0/1413412764 shutdown_connections 2023-11-15T01:37:19.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.375+0000 7f0ab9f5a700 1 --2- 172.21.15.1:0/1413412764 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0a9405f270 0x7f0a94061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.375+0000 7f0ab9f5a700 1 --2- 172.21.15.1:0/1413412764 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab4151e10 0x7f0ab40b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.375+0000 7f0ab9f5a700 1 --2- 172.21.15.1:0/1413412764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab40c86b0 0x7f0ab40acb80 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.375+0000 7f0ab9f5a700 1 --2- 172.21.15.1:0/1413412764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ab40c98b0 0x7f0ab4167df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.375+0000 7f0ab9f5a700 1 -- 172.21.15.1:0/1413412764 >> 172.21.15.1:0/1413412764 conn(0x7f0ab40947e0 msgr2=0x7f0ab40a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.375+0000 7f0ab9f5a700 1 -- 172.21.15.1:0/1413412764 shutdown_connections 2023-11-15T01:37:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.375+0000 7f0ab9f5a700 1 -- 172.21.15.1:0/1413412764 wait complete. 2023-11-15T01:37:19.390 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-15T01:37:19.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.518+0000 7fda67acd700 1 Processor -- start 2023-11-15T01:37:19.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.518+0000 7fda67acd700 1 -- start start 2023-11-15T01:37:19.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.519+0000 7fda67acd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda60154480 0x7fda600c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:19.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.519+0000 7fda67acd700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda600ca050 con 0x7fda601540a0 2023-11-15T01:37:19.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.519+0000 7fda67acd700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda600c68c0 con 0x7fda600c6430 2023-11-15T01:37:19.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.519+0000 7fda67acd700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda600c9440 con 0x7fda60154480 2023-11-15T01:37:19.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.519+0000 7fda65869700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fda601540a0 0x7fda600ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57442/0 (socket says 172.21.15.1:57442) 2023-11-15T01:37:19.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.519+0000 7fda65869700 1 -- 172.21.15.1:0/3725806743 learned_addr learned my addr 172.21.15.1:0/3725806743 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:19.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.519+0000 7fda65068700 1 --2- 172.21.15.1:0/3725806743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda60154480 0x7fda600c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:19.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda64867700 1 -- 172.21.15.1:0/3725806743 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357712184 0 0) 0x7fda600ca050 con 0x7fda601540a0 2023-11-15T01:37:19.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda64867700 1 -- 172.21.15.1:0/3725806743 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda480033f0 con 0x7fda601540a0 2023-11-15T01:37:19.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda64867700 1 -- 172.21.15.1:0/3725806743 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 181110255 0 0) 0x7fda480033f0 con 0x7fda601540a0 2023-11-15T01:37:19.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda64867700 1 -- 172.21.15.1:0/3725806743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda60154480 msgr2=0x7fda600c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:19.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda64867700 1 --2- 172.21.15.1:0/3725806743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda60154480 0x7fda600c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda64867700 1 -- 172.21.15.1:0/3725806743 >> v1:172.21.15.141:6789/0 conn(0x7fda600c6430 legacy=0x7fda600aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:19.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda64867700 1 -- 172.21.15.1:0/3725806743 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda600c9720 con 0x7fda601540a0 2023-11-15T01:37:19.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda64867700 1 -- 172.21.15.1:0/3725806743 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fda500017f0 con 0x7fda601540a0 2023-11-15T01:37:19.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda64867700 1 -- 172.21.15.1:0/3725806743 >> v1:172.21.15.1:6789/0 conn(0x7fda601540a0 legacy=0x7fda600ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:19.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda64867700 1 --2- 172.21.15.1:0/3725806743 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fda48003910 0x7fda48003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:19.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda64867700 1 --2- 172.21.15.1:0/3725806743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda48004690 0x7fda48004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:19.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda64867700 1 --2- 172.21.15.1:0/3725806743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda60154480 0x7fda48005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:19.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda64867700 1 -- 172.21.15.1:0/3725806743 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda600c9440 con 0x7fda48004690 2023-11-15T01:37:19.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda64867700 1 -- 172.21.15.1:0/3725806743 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4800b8e0 con 0x7fda48003910 2023-11-15T01:37:19.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda64867700 1 -- 172.21.15.1:0/3725806743 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4800ba50 con 0x7fda60154480 2023-11-15T01:37:19.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda65068700 1 --2- 172.21.15.1:0/3725806743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda48004690 0x7fda48004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:19.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda6606a700 1 --2- 172.21.15.1:0/3725806743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda60154480 0x7fda48005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:19.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda65869700 1 --2- 172.21.15.1:0/3725806743 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fda48003910 0x7fda48003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:19.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda65068700 1 -- 172.21.15.1:0/3725806743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda60154480 msgr2=0x7fda48005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:19.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda65068700 1 --2- 172.21.15.1:0/3725806743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda60154480 0x7fda48005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda65068700 1 -- 172.21.15.1:0/3725806743 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fda48003910 msgr2=0x7fda48003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:19.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda65068700 1 --2- 172.21.15.1:0/3725806743 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fda48003910 0x7fda48003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda65068700 1 -- 172.21.15.1:0/3725806743 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda480033f0 con 0x7fda48004690 2023-11-15T01:37:19.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.520+0000 7fda65068700 1 --2- 172.21.15.1:0/3725806743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda48004690 0x7fda48004b10 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7fda54009a80 tx=0x7fda54009060).ready entity=mon.0 client_cookie=769ccd9c868c46a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:19.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.521+0000 7fda64867700 1 -- 172.21.15.1:0/3725806743 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54009430 con 0x7fda48004690 2023-11-15T01:37:19.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.521+0000 7fda64867700 1 -- 172.21.15.1:0/3725806743 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5400e5e0 con 0x7fda48004690 2023-11-15T01:37:19.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.521+0000 7fda64867700 1 -- 172.21.15.1:0/3725806743 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5400e960 con 0x7fda48004690 2023-11-15T01:37:19.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.521+0000 7fda67acd700 1 -- 172.21.15.1:0/3725806743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda48004690 msgr2=0x7fda48004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:19.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.521+0000 7fda67acd700 1 --2- 172.21.15.1:0/3725806743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda48004690 0x7fda48004b10 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7fda54009a80 tx=0x7fda54009060).stop 2023-11-15T01:37:19.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.521+0000 7fda6606a700 1 -- 172.21.15.1:0/3725806743 reap_dead start 2023-11-15T01:37:19.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.521+0000 7fda67acd700 1 -- 172.21.15.1:0/3725806743 shutdown_connections 2023-11-15T01:37:19.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.521+0000 7fda67acd700 1 -- 172.21.15.1:0/3725806743 >> 172.21.15.1:0/3725806743 conn(0x7fda60064a70 msgr2=0x7fda60064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:19.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.521+0000 7fda67acd700 1 -- 172.21.15.1:0/3725806743 shutdown_connections 2023-11-15T01:37:19.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.521+0000 7fda67acd700 1 -- 172.21.15.1:0/3725806743 wait complete. 2023-11-15T01:37:19.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.522+0000 7fda67acd700 1 Processor -- start 2023-11-15T01:37:19.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.522+0000 7fda67acd700 1 -- start start 2023-11-15T01:37:19.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.523+0000 7fda67acd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda48004690 0x7fda600ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:19.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.523+0000 7fda67acd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fda60155d60 0x7fda600b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.523+0000 7fda67acd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda600b07e0 0x7fda60168110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.523+0000 7fda67acd700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda60164f70 con 0x7fda600b07e0 2023-11-15T01:37:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.523+0000 7fda67acd700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda60165250 con 0x7fda60155d60 2023-11-15T01:37:19.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.523+0000 7fda67acd700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda60165530 con 0x7fda48004690 2023-11-15T01:37:19.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.523+0000 7fda6606a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda600b07e0 0x7fda60168110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:19.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.523+0000 7fda6606a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda600b07e0 0x7fda60168110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34970/0 (socket says 172.21.15.1:34970) 2023-11-15T01:37:19.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.523+0000 7fda6606a700 1 -- 172.21.15.1:0/411683589 learned_addr learned my addr 172.21.15.1:0/411683589 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:19.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.523+0000 7fda65068700 1 --2- 172.21.15.1:0/411683589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fda60155d60 0x7fda600b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:19.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.523+0000 7fda65869700 1 --2- 172.21.15.1:0/411683589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda48004690 0x7fda600ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:19.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.524+0000 7fda6606a700 1 -- 172.21.15.1:0/411683589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda48004690 msgr2=0x7fda600ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:19.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.524+0000 7fda6606a700 1 --2- 172.21.15.1:0/411683589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda48004690 0x7fda600ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.524+0000 7fda6606a700 1 -- 172.21.15.1:0/411683589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fda60155d60 msgr2=0x7fda600b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:19.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.524+0000 7fda6606a700 1 --2- 172.21.15.1:0/411683589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fda60155d60 0x7fda600b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.524+0000 7fda6606a700 1 -- 172.21.15.1:0/411683589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda60165810 con 0x7fda600b07e0 2023-11-15T01:37:19.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.524+0000 7fda6606a700 1 --2- 172.21.15.1:0/411683589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda600b07e0 0x7fda60168110 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7fda60084440 tx=0x7fda58007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:19.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.524+0000 7fda5dffb700 1 -- 172.21.15.1:0/411683589 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda580114c0 con 0x7fda600b07e0 2023-11-15T01:37:19.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.524+0000 7fda5dffb700 1 -- 172.21.15.1:0/411683589 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda58011620 con 0x7fda600b07e0 2023-11-15T01:37:19.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.524+0000 7fda67acd700 1 -- 172.21.15.1:0/411683589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda600b0c60 con 0x7fda600b07e0 2023-11-15T01:37:19.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.524+0000 7fda5dffb700 1 -- 172.21.15.1:0/411683589 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda580119a0 con 0x7fda600b07e0 2023-11-15T01:37:19.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.524+0000 7fda67acd700 1 -- 172.21.15.1:0/411683589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda600c4c40 con 0x7fda600b07e0 2023-11-15T01:37:19.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.525+0000 7fda67acd700 1 -- 172.21.15.1:0/411683589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda600c2a40 con 0x7fda600b07e0 2023-11-15T01:37:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.526+0000 7fda5dffb700 1 -- 172.21.15.1:0/411683589 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fda580133f0 con 0x7fda600b07e0 2023-11-15T01:37:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.526+0000 7fda5dffb700 1 --2- 172.21.15.1:0/411683589 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fda4c05f270 0x7fda4c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.526+0000 7fda5dffb700 1 -- 172.21.15.1:0/411683589 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6252+0+0 (secure 0 0 0) 0x7fda58079ce0 con 0x7fda600b07e0 2023-11-15T01:37:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.526+0000 7fda65869700 1 --2- 172.21.15.1:0/411683589 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fda4c05f270 0x7fda4c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.526+0000 7fda65869700 1 --2- 172.21.15.1:0/411683589 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fda4c05f270 0x7fda4c061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fda500014a0 tx=0x7fda50001d90).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:19.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.530+0000 7fda5dffb700 1 -- 172.21.15.1:0/411683589 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fda58049af0 con 0x7fda600b07e0 2023-11-15T01:37:19.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.703+0000 7fda67acd700 1 -- 172.21.15.1:0/411683589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fda601659a0 con 0x7fda600b07e0 2023-11-15T01:37:19.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.706+0000 7fda5dffb700 1 -- 172.21.15.1:0/411683589 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fda5807e070 con 0x7fda600b07e0 2023-11-15T01:37:19.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.708+0000 7fda67acd700 1 -- 172.21.15.1:0/411683589 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fda4c05f270 msgr2=0x7fda4c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:19.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.708+0000 7fda67acd700 1 --2- 172.21.15.1:0/411683589 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fda4c05f270 0x7fda4c061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fda500014a0 tx=0x7fda50001d90).stop 2023-11-15T01:37:19.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.708+0000 7fda67acd700 1 -- 172.21.15.1:0/411683589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda600b07e0 msgr2=0x7fda60168110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.708+0000 7fda67acd700 1 --2- 172.21.15.1:0/411683589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda600b07e0 0x7fda60168110 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7fda60084440 tx=0x7fda58007b90).stop 2023-11-15T01:37:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.708+0000 7fda67acd700 1 -- 172.21.15.1:0/411683589 shutdown_connections 2023-11-15T01:37:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.708+0000 7fda67acd700 1 --2- 172.21.15.1:0/411683589 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fda4c05f270 0x7fda4c061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.708+0000 7fda67acd700 1 --2- 172.21.15.1:0/411683589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda600b07e0 0x7fda60168110 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.708+0000 7fda67acd700 1 --2- 172.21.15.1:0/411683589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda48004690 0x7fda600ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.708+0000 7fda67acd700 1 --2- 172.21.15.1:0/411683589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fda60155d60 0x7fda600b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.708+0000 7fda67acd700 1 -- 172.21.15.1:0/411683589 >> 172.21.15.1:0/411683589 conn(0x7fda60064a70 msgr2=0x7fda600c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.708+0000 7fda67acd700 1 -- 172.21.15.1:0/411683589 shutdown_connections 2023-11-15T01:37:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.708+0000 7fda67acd700 1 -- 172.21.15.1:0/411683589 wait complete. 2023-11-15T01:37:19.720 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T01:37:19.721 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:37:19.768 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:37:19.813 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T01:37:19.813 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-15T01:37:19.814 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:37:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.932+0000 7f41ee24d700 1 Processor -- start 2023-11-15T01:37:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.932+0000 7f41ee24d700 1 -- start start 2023-11-15T01:37:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.932+0000 7f41ee24d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f41e80bccd0 0x7f41e80bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.932+0000 7f41ee24d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f41e80c60b0 0x7f41e80c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.932+0000 7f41ee24d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e806a6b0 con 0x7f41e8154680 2023-11-15T01:37:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.932+0000 7f41ee24d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e80c3360 con 0x7f41e80bccd0 2023-11-15T01:37:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.932+0000 7f41ee24d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e80bd620 con 0x7f41e80c60b0 2023-11-15T01:37:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.933+0000 7f41e6ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f41e80bccd0 0x7f41e80bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.933+0000 7f41e6ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f41e80bccd0 0x7f41e80bd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34978/0 (socket says 172.21.15.1:34978) 2023-11-15T01:37:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.933+0000 7f41e6ffd700 1 -- 172.21.15.1:0/3758116128 learned_addr learned my addr 172.21.15.1:0/3758116128 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.933+0000 7f41e7fff700 1 --2- 172.21.15.1:0/3758116128 >> v2:172.21.15.141:3300/0 conn(0x7f41e80c60b0 0x7f41e80c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.933+0000 7f41e6ffd700 1 -- 172.21.15.1:0/3758116128 >> v2:172.21.15.141:3300/0 conn(0x7f41e80c60b0 msgr2=0x7f41e80c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.933+0000 7f41e6ffd700 1 --2- 172.21.15.1:0/3758116128 >> v2:172.21.15.141:3300/0 conn(0x7f41e80c60b0 0x7f41e80c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.933+0000 7f41e6ffd700 1 -- 172.21.15.1:0/3758116128 >> v1:172.21.15.141:6789/0 conn(0x7f41e8154680 legacy=0x7f41e8069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.933+0000 7f41e6ffd700 1 -- 172.21.15.1:0/3758116128 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e80c2750 con 0x7f41e80bccd0 2023-11-15T01:37:19.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.933+0000 7f41e7fff700 1 --2- 172.21.15.1:0/3758116128 >> v2:172.21.15.141:3300/0 conn(0x7f41e80c60b0 0x7f41e80c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:19.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.933+0000 7f41e6ffd700 1 --2- 172.21.15.1:0/3758116128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e80bccd0 0x7f41e80bd130 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f41e8064cc0 tx=0x7f41dc0090f0).ready entity=mon.0 client_cookie=24d91121ba83c147 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:19.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.933+0000 7f41e67fc700 1 -- 172.21.15.1:0/3758116128 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc00b600 con 0x7f41e80bccd0 2023-11-15T01:37:19.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.933+0000 7f41e67fc700 1 -- 172.21.15.1:0/3758116128 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc00b760 con 0x7f41e80bccd0 2023-11-15T01:37:19.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.933+0000 7f41e67fc700 1 -- 172.21.15.1:0/3758116128 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc00bae0 con 0x7f41e80bccd0 2023-11-15T01:37:19.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.934+0000 7f41ee24d700 1 -- 172.21.15.1:0/3758116128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e80bccd0 msgr2=0x7f41e80bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:19.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.934+0000 7f41ee24d700 1 --2- 172.21.15.1:0/3758116128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e80bccd0 0x7f41e80bd130 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f41e8064cc0 tx=0x7f41dc0090f0).stop 2023-11-15T01:37:19.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.934+0000 7f41ee24d700 1 -- 172.21.15.1:0/3758116128 shutdown_connections 2023-11-15T01:37:19.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.934+0000 7f41ee24d700 1 --2- 172.21.15.1:0/3758116128 >> v2:172.21.15.141:3300/0 conn(0x7f41e80c60b0 0x7f41e80c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.934+0000 7f41ee24d700 1 --2- 172.21.15.1:0/3758116128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e80bccd0 0x7f41e80bd130 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.934+0000 7f41ee24d700 1 -- 172.21.15.1:0/3758116128 >> 172.21.15.1:0/3758116128 conn(0x7f41e80c7d70 msgr2=0x7f41e80c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:19.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.934+0000 7f41ee24d700 1 -- 172.21.15.1:0/3758116128 shutdown_connections 2023-11-15T01:37:19.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.934+0000 7f41ee24d700 1 -- 172.21.15.1:0/3758116128 wait complete. 2023-11-15T01:37:19.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.935+0000 7f41ee24d700 1 Processor -- start 2023-11-15T01:37:19.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.935+0000 7f41ee24d700 1 -- start start 2023-11-15T01:37:19.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41ee24d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e80bccd0 0x7f41e8168970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:19.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41ee24d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41e80c60b0 0x7f41e80a9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:19.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41ee24d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41e8154680 0x7f41e8164140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:19.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41ee24d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e8168e60 con 0x7f41e80bccd0 2023-11-15T01:37:19.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41ee24d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e80a9560 con 0x7f41e8154680 2023-11-15T01:37:19.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41ee24d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e80aa8a0 con 0x7f41e80c60b0 2023-11-15T01:37:19.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41e77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e80bccd0 0x7f41e8168970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:19.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41e77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e80bccd0 0x7f41e8168970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34982/0 (socket says 172.21.15.1:34982) 2023-11-15T01:37:19.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41e77fe700 1 -- 172.21.15.1:0/3563335660 learned_addr learned my addr 172.21.15.1:0/3563335660 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:19.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41e7fff700 1 --2- 172.21.15.1:0/3563335660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41e8154680 0x7f41e8164140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:19.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41e6ffd700 1 --2- 172.21.15.1:0/3563335660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41e80c60b0 0x7f41e80a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:19.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41e77fe700 1 -- 172.21.15.1:0/3563335660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41e80c60b0 msgr2=0x7f41e80a9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41e77fe700 1 --2- 172.21.15.1:0/3563335660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41e80c60b0 0x7f41e80a9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41e77fe700 1 -- 172.21.15.1:0/3563335660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41e8154680 msgr2=0x7f41e8164140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41e77fe700 1 --2- 172.21.15.1:0/3563335660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41e8154680 0x7f41e8164140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.936+0000 7f41e77fe700 1 -- 172.21.15.1:0/3563335660 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc009370 con 0x7f41e80bccd0 2023-11-15T01:37:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.937+0000 7f41e77fe700 1 --2- 172.21.15.1:0/3563335660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e80bccd0 0x7f41e8168970 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f41d800c7c0 tx=0x7f41d80015c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.937+0000 7f41cf7fe700 1 -- 172.21.15.1:0/3563335660 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8006a20 con 0x7f41e80bccd0 2023-11-15T01:37:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.937+0000 7f41cf7fe700 1 -- 172.21.15.1:0/3563335660 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d8006b80 con 0x7f41e80bccd0 2023-11-15T01:37:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.937+0000 7f41cf7fe700 1 -- 172.21.15.1:0/3563335660 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8007020 con 0x7f41e80bccd0 2023-11-15T01:37:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.937+0000 7f41ee24d700 1 -- 172.21.15.1:0/3563335660 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e80a9800 con 0x7f41e80bccd0 2023-11-15T01:37:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.937+0000 7f41ee24d700 1 -- 172.21.15.1:0/3563335660 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e80a9dc0 con 0x7f41e80bccd0 2023-11-15T01:37:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.938+0000 7f41ee24d700 1 -- 172.21.15.1:0/3563335660 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e806c7e0 con 0x7f41e80bccd0 2023-11-15T01:37:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.938+0000 7f41cf7fe700 1 -- 172.21.15.1:0/3563335660 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f41d80073d0 con 0x7f41e80bccd0 2023-11-15T01:37:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.938+0000 7f41cf7fe700 1 --2- 172.21.15.1:0/3563335660 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f41d405f270 0x7f41d4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.939+0000 7f41cf7fe700 1 -- 172.21.15.1:0/3563335660 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6252+0+0 (secure 0 0 0) 0x7f41d8079a40 con 0x7f41e80bccd0 2023-11-15T01:37:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.939+0000 7f41e6ffd700 1 --2- 172.21.15.1:0/3563335660 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f41d405f270 0x7f41d4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:19.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.939+0000 7f41e6ffd700 1 --2- 172.21.15.1:0/3563335660 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f41d405f270 0x7f41d4061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f41dc009fd0 tx=0x7f41dc017000).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:19.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:19.943+0000 7f41cf7fe700 1 -- 172.21.15.1:0/3563335660 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f41d8047af0 con 0x7f41e80bccd0 2023-11-15T01:37:20.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.157+0000 7f41ee24d700 1 -- 172.21.15.1:0/3563335660 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41e80c2a30 con 0x7f41e80bccd0 2023-11-15T01:37:20.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.157+0000 7f41cf7fe700 1 -- 172.21.15.1:0/3563335660 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f41d804ab10 con 0x7f41e80bccd0 2023-11-15T01:37:20.158 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:20.158 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2863729575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2863729575},{"type":"v1","addr":"172.21.15.141:6836","nonce":2863729575}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/4111210566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":4111210566},{"type":"v1","addr":"172.21.15.141:6837","nonce":4111210566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6696,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/4099031019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4099031019},{"type":"v1","addr":"172.21.15.1:6834","nonce":4099031019}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/762835884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":762835884},{"type":"v1","addr":"172.21.15.1:6835","nonce":762835884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[]} 2023-11-15T01:37:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.159+0000 7f41ee24d700 1 -- 172.21.15.1:0/3563335660 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f41d405f270 msgr2=0x7f41d4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:20.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.159+0000 7f41ee24d700 1 --2- 172.21.15.1:0/3563335660 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f41d405f270 0x7f41d4061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f41dc009fd0 tx=0x7f41dc017000).stop 2023-11-15T01:37:20.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.159+0000 7f41ee24d700 1 -- 172.21.15.1:0/3563335660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e80bccd0 msgr2=0x7f41e8168970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:20.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.159+0000 7f41ee24d700 1 --2- 172.21.15.1:0/3563335660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e80bccd0 0x7f41e8168970 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f41d800c7c0 tx=0x7f41d80015c0).stop 2023-11-15T01:37:20.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.159+0000 7f41ee24d700 1 -- 172.21.15.1:0/3563335660 shutdown_connections 2023-11-15T01:37:20.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.159+0000 7f41ee24d700 1 --2- 172.21.15.1:0/3563335660 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f41d405f270 0x7f41d4061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:20.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.159+0000 7f41ee24d700 1 --2- 172.21.15.1:0/3563335660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41e8154680 0x7f41e8164140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:20.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.159+0000 7f41ee24d700 1 --2- 172.21.15.1:0/3563335660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41e80bccd0 0x7f41e8168970 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:20.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.159+0000 7f41ee24d700 1 --2- 172.21.15.1:0/3563335660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41e80c60b0 0x7f41e80a9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:20.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.159+0000 7f41ee24d700 1 -- 172.21.15.1:0/3563335660 >> 172.21.15.1:0/3563335660 conn(0x7f41e80c7d70 msgr2=0x7f41e8066490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:20.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.159+0000 7f41ee24d700 1 -- 172.21.15.1:0/3563335660 shutdown_connections 2023-11-15T01:37:20.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.159+0000 7f41ee24d700 1 -- 172.21.15.1:0/3563335660 wait complete. 2023-11-15T01:37:20.162 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 41 2023-11-15T01:37:20.171 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-15T01:37:20.172 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-15T01:37:20.172 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-15T01:37:20.172 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:37:20.173 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-15T01:37:20.173 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-15T01:37:20.173 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-15T01:37:20.173 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:37:20.174 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-15T01:37:20.174 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-15T01:37:20.174 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-15T01:37:20.175 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:37:20.175 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-15T01:37:20.175 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-15T01:37:20.175 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-15T01:37:20.176 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:37:20.183 INFO:tasks.ceph.mds.a:Stopped 2023-11-15T01:37:20.183 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-15T01:37:20.184 INFO:tasks.ceph.mds.c:Stopped 2023-11-15T01:37:20.184 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-15T01:37:20.185 INFO:tasks.ceph.mds.b:Stopped 2023-11-15T01:37:20.186 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-15T01:37:20.186 INFO:tasks.ceph.mds.d:Stopped 2023-11-15T01:37:20.187 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-15T01:37:20.225 INFO:tasks.ceph.mds.a:Started 2023-11-15T01:37:20.226 DEBUG:teuthology.parallel:result is None 2023-11-15T01:37:20.227 INFO:tasks.ceph.mds.c:Started 2023-11-15T01:37:20.227 DEBUG:teuthology.parallel:result is None 2023-11-15T01:37:20.228 INFO:tasks.ceph.mds.b:Started 2023-11-15T01:37:20.228 DEBUG:teuthology.parallel:result is None 2023-11-15T01:37:20.229 INFO:tasks.ceph.mds.d:Started 2023-11-15T01:37:20.229 DEBUG:teuthology.parallel:result is None 2023-11-15T01:37:20.230 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-15T01:37:20.301 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-11-15T01:37:20.302 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T01:37:20.307 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T01:37:20.307 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-15T01:37:20.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.357+0000 7f87fc562700 1 Processor -- start 2023-11-15T01:37:20.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.357+0000 7f87fc562700 1 -- start start 2023-11-15T01:37:20.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.358+0000 7f87fc562700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87f40629e0 0x7f87f40c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:20.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.358+0000 7f87fc562700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f87f40c3400 0x7f87f40ab430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:20.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.358+0000 7f87fc562700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f40a9f60 con 0x7f87f40ab920 2023-11-15T01:37:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.358+0000 7f87fc562700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f40c3880 con 0x7f87f40c3400 2023-11-15T01:37:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.358+0000 7f87fc562700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40abdd0 con 0x7f87f40629e0 2023-11-15T01:37:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.358+0000 7f87f9afd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f87f40c3400 0x7f87f40ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.358+0000 7f87faaff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f87f40ab920 0x7f87f4064df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57458/0 (socket says 172.21.15.1:57458) 2023-11-15T01:37:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.358+0000 7f87f9afd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f87f40c3400 0x7f87f40ab430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35016/0 (socket says 172.21.15.1:35016) 2023-11-15T01:37:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.358+0000 7f87faaff700 1 -- 172.21.15.1:0/3720485931 learned_addr learned my addr 172.21.15.1:0/3720485931 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.359+0000 7f87fa2fe700 1 --2- 172.21.15.1:0/3720485931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87f40629e0 0x7f87f40c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.359+0000 7f87f9afd700 1 -- 172.21.15.1:0/3720485931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87f40629e0 msgr2=0x7f87f40c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.359+0000 7f87f92fc700 1 -- 172.21.15.1:0/3720485931 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961624301 0 0) 0x7f87f40a9f60 con 0x7f87f40ab920 2023-11-15T01:37:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.359+0000 7f87f9afd700 1 --2- 172.21.15.1:0/3720485931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87f40629e0 0x7f87f40c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.359+0000 7f87f9afd700 1 -- 172.21.15.1:0/3720485931 >> v1:172.21.15.1:6789/0 conn(0x7f87f40ab920 legacy=0x7f87f4064df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.359+0000 7f87f9afd700 1 -- 172.21.15.1:0/3720485931 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40c2a80 con 0x7f87f40c3400 2023-11-15T01:37:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.359+0000 7f87fa2fe700 1 --2- 172.21.15.1:0/3720485931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87f40629e0 0x7f87f40c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:37:20.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.359+0000 7f87f9afd700 1 --2- 172.21.15.1:0/3720485931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87f40c3400 0x7f87f40ab430 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f87e8009760 tx=0x7f87e8009060).ready entity=mon.0 client_cookie=8a9463487db52626 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:20.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.359+0000 7f87f92fc700 1 -- 172.21.15.1:0/3720485931 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e800b580 con 0x7f87f40c3400 2023-11-15T01:37:20.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.359+0000 7f87f92fc700 1 -- 172.21.15.1:0/3720485931 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e800b6e0 con 0x7f87f40c3400 2023-11-15T01:37:20.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.359+0000 7f87f92fc700 1 -- 172.21.15.1:0/3720485931 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e800ba60 con 0x7f87f40c3400 2023-11-15T01:37:20.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.359+0000 7f87fc562700 1 -- 172.21.15.1:0/3720485931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87f40c3400 msgr2=0x7f87f40ab430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:20.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.359+0000 7f87fc562700 1 --2- 172.21.15.1:0/3720485931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87f40c3400 0x7f87f40ab430 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f87e8009760 tx=0x7f87e8009060).stop 2023-11-15T01:37:20.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.360+0000 7f87fc562700 1 -- 172.21.15.1:0/3720485931 shutdown_connections 2023-11-15T01:37:20.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.360+0000 7f87fc562700 1 --2- 172.21.15.1:0/3720485931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87f40629e0 0x7f87f40c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:20.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.360+0000 7f87fc562700 1 --2- 172.21.15.1:0/3720485931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87f40c3400 0x7f87f40ab430 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:20.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.360+0000 7f87fc562700 1 -- 172.21.15.1:0/3720485931 >> 172.21.15.1:0/3720485931 conn(0x7f87f40c74f0 msgr2=0x7f87f40c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:20.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.360+0000 7f87fc562700 1 -- 172.21.15.1:0/3720485931 shutdown_connections 2023-11-15T01:37:20.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.360+0000 7f87fc562700 1 -- 172.21.15.1:0/3720485931 wait complete. 2023-11-15T01:37:20.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.361+0000 7f87fc562700 1 Processor -- start 2023-11-15T01:37:20.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.361+0000 7f87fc562700 1 -- start start 2023-11-15T01:37:20.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.361+0000 7f87fc562700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87f40629e0 0x7f87f413f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:20.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.361+0000 7f87fc562700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87f40ab920 0x7f87f40bb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:20.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.361+0000 7f87fc562700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87f40c3400 0x7f87f40bb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:20.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.361+0000 7f87fc562700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40bbd70 con 0x7f87f40ab920 2023-11-15T01:37:20.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.361+0000 7f87fc562700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f41528c0 con 0x7f87f40629e0 2023-11-15T01:37:20.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.361+0000 7f87fc562700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4151cb0 con 0x7f87f40c3400 2023-11-15T01:37:20.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87f9afd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87f40ab920 0x7f87f40bb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:20.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87f9afd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87f40ab920 0x7f87f40bb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35026/0 (socket says 172.21.15.1:35026) 2023-11-15T01:37:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87f9afd700 1 -- 172.21.15.1:0/652157747 learned_addr learned my addr 172.21.15.1:0/652157747 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87faaff700 1 --2- 172.21.15.1:0/652157747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87f40c3400 0x7f87f40bb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87fa2fe700 1 --2- 172.21.15.1:0/652157747 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87f40629e0 0x7f87f413f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87f9afd700 1 -- 172.21.15.1:0/652157747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87f40c3400 msgr2=0x7f87f40bb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87f9afd700 1 --2- 172.21.15.1:0/652157747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87f40c3400 0x7f87f40bb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87f9afd700 1 -- 172.21.15.1:0/652157747 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87f40629e0 msgr2=0x7f87f413f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87f9afd700 1 --2- 172.21.15.1:0/652157747 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87f40629e0 0x7f87f413f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87f9afd700 1 -- 172.21.15.1:0/652157747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80092a0 con 0x7f87f40ab920 2023-11-15T01:37:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87f9afd700 1 --2- 172.21.15.1:0/652157747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87f40ab920 0x7f87f40bb390 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f87e8009eb0 tx=0x7f87e8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87f27fc700 1 -- 172.21.15.1:0/652157747 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e800b850 con 0x7f87f40ab920 2023-11-15T01:37:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87f27fc700 1 -- 172.21.15.1:0/652157747 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e800b9b0 con 0x7f87f40ab920 2023-11-15T01:37:20.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87fc562700 1 -- 172.21.15.1:0/652157747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f4151f90 con 0x7f87f40ab920 2023-11-15T01:37:20.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87f27fc700 1 -- 172.21.15.1:0/652157747 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e801c670 con 0x7f87f40ab920 2023-11-15T01:37:20.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.362+0000 7f87fc562700 1 -- 172.21.15.1:0/652157747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f4152550 con 0x7f87f40ab920 2023-11-15T01:37:20.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.363+0000 7f87fc562700 1 -- 172.21.15.1:0/652157747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f4152a50 con 0x7f87f40ab920 2023-11-15T01:37:20.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.364+0000 7f87f27fc700 1 -- 172.21.15.1:0/652157747 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f87e801ca60 con 0x7f87f40ab920 2023-11-15T01:37:20.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.364+0000 7f87f27fc700 1 --2- 172.21.15.1:0/652157747 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f87e005f270 0x7f87e0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:20.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.364+0000 7f87f27fc700 1 -- 172.21.15.1:0/652157747 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6252+0+0 (secure 0 0 0) 0x7f87e807c140 con 0x7f87f40ab920 2023-11-15T01:37:20.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.364+0000 7f87fa2fe700 1 --2- 172.21.15.1:0/652157747 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f87e005f270 0x7f87e0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:20.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.364+0000 7f87fa2fe700 1 --2- 172.21.15.1:0/652157747 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f87e005f270 0x7f87e0061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f87e400f600 tx=0x7f87e40077b0).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:20.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.368+0000 7f87f27fc700 1 -- 172.21.15.1:0/652157747 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f87e804d210 con 0x7f87f40ab920 2023-11-15T01:37:20.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:20.557+0000 7f87fc562700 1 -- 172.21.15.1:0/652157747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f87f406c7e0 con 0x7f87f40ab920 2023-11-15T01:37:21.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.380+0000 7f87f27fc700 1 -- 172.21.15.1:0/652157747 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v105) v1 ==== 97+0+0 (secure 0 0 0) 0x7f87e802a080 con 0x7f87f40ab920 2023-11-15T01:37:21.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.382+0000 7f87fc562700 1 -- 172.21.15.1:0/652157747 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f87e005f270 msgr2=0x7f87e0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:21.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.382+0000 7f87fc562700 1 --2- 172.21.15.1:0/652157747 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f87e005f270 0x7f87e0061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f87e400f600 tx=0x7f87e40077b0).stop 2023-11-15T01:37:21.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.383+0000 7f87fc562700 1 -- 172.21.15.1:0/652157747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87f40ab920 msgr2=0x7f87f40bb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:21.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.383+0000 7f87fc562700 1 --2- 172.21.15.1:0/652157747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87f40ab920 0x7f87f40bb390 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f87e8009eb0 tx=0x7f87e8017000).stop 2023-11-15T01:37:21.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.383+0000 7f87fc562700 1 -- 172.21.15.1:0/652157747 shutdown_connections 2023-11-15T01:37:21.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.383+0000 7f87fc562700 1 --2- 172.21.15.1:0/652157747 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f87e005f270 0x7f87e0061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.383+0000 7f87fc562700 1 --2- 172.21.15.1:0/652157747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87f40c3400 0x7f87f40bb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.383+0000 7f87fc562700 1 --2- 172.21.15.1:0/652157747 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87f40629e0 0x7f87f413f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.383+0000 7f87fc562700 1 --2- 172.21.15.1:0/652157747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87f40ab920 0x7f87f40bb390 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.383+0000 7f87fc562700 1 -- 172.21.15.1:0/652157747 >> 172.21.15.1:0/652157747 conn(0x7f87f40c74f0 msgr2=0x7f87f414fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:21.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.383+0000 7f87fc562700 1 -- 172.21.15.1:0/652157747 shutdown_connections 2023-11-15T01:37:21.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.383+0000 7f87fc562700 1 -- 172.21.15.1:0/652157747 wait complete. 2023-11-15T01:37:21.386 INFO:teuthology.orchestra.run.smithi001.stderr: removed all blocklist entries 2023-11-15T01:37:21.397 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-15T01:37:21.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.518+0000 7fed98773700 1 Processor -- start 2023-11-15T01:37:21.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.518+0000 7fed98773700 1 -- start start 2023-11-15T01:37:21.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.519+0000 7fed98773700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed900c6620 0x7fed90154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:21.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.519+0000 7fed98773700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed900c06f0 con 0x7fed90154150 2023-11-15T01:37:21.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.519+0000 7fed98773700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed900c09d0 con 0x7fed900ab1a0 2023-11-15T01:37:21.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.519+0000 7fed98773700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed90158820 con 0x7fed900c6620 2023-11-15T01:37:21.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.519+0000 7fed9650f700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fed90154150 0x7fed90158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57462/0 (socket says 172.21.15.1:57462) 2023-11-15T01:37:21.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.519+0000 7fed9650f700 1 -- 172.21.15.1:0/734244927 learned_addr learned my addr 172.21.15.1:0/734244927 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:21.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.519+0000 7fed96d10700 1 --2- 172.21.15.1:0/734244927 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed900c6620 0x7fed90154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:21.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.520+0000 7fed9550d700 1 -- 172.21.15.1:0/734244927 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779269397 0 0) 0x7fed900c06f0 con 0x7fed90154150 2023-11-15T01:37:21.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.520+0000 7fed9550d700 1 -- 172.21.15.1:0/734244927 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed780033f0 con 0x7fed90154150 2023-11-15T01:37:21.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.520+0000 7fed9550d700 1 -- 172.21.15.1:0/734244927 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959596822 0 0) 0x7fed900c09d0 con 0x7fed900ab1a0 2023-11-15T01:37:21.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.520+0000 7fed9550d700 1 -- 172.21.15.1:0/734244927 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed900c06f0 con 0x7fed900ab1a0 2023-11-15T01:37:21.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.520+0000 7fed9550d700 1 -- 172.21.15.1:0/734244927 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 610681109 0 0) 0x7fed780033f0 con 0x7fed90154150 2023-11-15T01:37:21.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.520+0000 7fed96d10700 1 -- 172.21.15.1:0/734244927 >> v1:172.21.15.141:6789/0 conn(0x7fed900ab1a0 legacy=0x7fed900c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:21.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.520+0000 7fed96d10700 1 -- 172.21.15.1:0/734244927 >> v1:172.21.15.1:6789/0 conn(0x7fed90154150 legacy=0x7fed90158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:21.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.520+0000 7fed96d10700 1 -- 172.21.15.1:0/734244927 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed90158b00 con 0x7fed900c6620 2023-11-15T01:37:21.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.520+0000 7fed96d10700 1 --2- 172.21.15.1:0/734244927 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed900c6620 0x7fed90154530 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fed80009e90 tx=0x7fed80009780).ready entity=mon.2 client_cookie=7aaded6a76c5e65e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:21.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.520+0000 7fed9550d700 1 -- 172.21.15.1:0/734244927 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8000e070 con 0x7fed900c6620 2023-11-15T01:37:21.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.520+0000 7fed9550d700 1 -- 172.21.15.1:0/734244927 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8000b7a0 con 0x7fed900c6620 2023-11-15T01:37:21.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.520+0000 7fed9550d700 1 -- 172.21.15.1:0/734244927 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88001470 con 0x7fed900c6620 2023-11-15T01:37:21.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.521+0000 7fed98773700 1 -- 172.21.15.1:0/734244927 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed900c6620 msgr2=0x7fed90154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:21.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.521+0000 7fed98773700 1 --2- 172.21.15.1:0/734244927 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed900c6620 0x7fed90154530 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fed80009e90 tx=0x7fed80009780).stop 2023-11-15T01:37:21.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.521+0000 7fed98773700 1 -- 172.21.15.1:0/734244927 shutdown_connections 2023-11-15T01:37:21.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.521+0000 7fed98773700 1 --2- 172.21.15.1:0/734244927 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed900c6620 0x7fed90154530 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.521+0000 7fed98773700 1 -- 172.21.15.1:0/734244927 >> 172.21.15.1:0/734244927 conn(0x7fed90064aa0 msgr2=0x7fed90064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:21.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.521+0000 7fed98773700 1 -- 172.21.15.1:0/734244927 shutdown_connections 2023-11-15T01:37:21.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.521+0000 7fed98773700 1 -- 172.21.15.1:0/734244927 wait complete. 2023-11-15T01:37:21.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.522+0000 7fed98773700 1 Processor -- start 2023-11-15T01:37:21.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.522+0000 7fed98773700 1 -- start start 2023-11-15T01:37:21.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed98773700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed900ab1a0 0x7fed90152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:21.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed98773700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed900c6620 0x7fed900c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed98773700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed90154150 0x7fed90156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed98773700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed900aeb70 con 0x7fed900c6620 2023-11-15T01:37:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed98773700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed900aee50 con 0x7fed90154150 2023-11-15T01:37:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed98773700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed900af130 con 0x7fed900ab1a0 2023-11-15T01:37:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed95d0e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed900c6620 0x7fed900c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:21.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed95d0e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed900c6620 0x7fed900c4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35042/0 (socket says 172.21.15.1:35042) 2023-11-15T01:37:21.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed95d0e700 1 -- 172.21.15.1:0/3941611219 learned_addr learned my addr 172.21.15.1:0/3941611219 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:21.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed9650f700 1 --2- 172.21.15.1:0/3941611219 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed900ab1a0 0x7fed90152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:21.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed96d10700 1 --2- 172.21.15.1:0/3941611219 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed90154150 0x7fed90156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:21.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed95d0e700 1 -- 172.21.15.1:0/3941611219 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed900ab1a0 msgr2=0x7fed90152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:21.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed95d0e700 1 --2- 172.21.15.1:0/3941611219 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed900ab1a0 0x7fed90152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed95d0e700 1 -- 172.21.15.1:0/3941611219 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed90154150 msgr2=0x7fed90156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed95d0e700 1 --2- 172.21.15.1:0/3941611219 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed90154150 0x7fed90156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed95d0e700 1 -- 172.21.15.1:0/3941611219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed80009a20 con 0x7fed900c6620 2023-11-15T01:37:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed95d0e700 1 --2- 172.21.15.1:0/3941611219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed900c6620 0x7fed900c4c90 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7fed8400c440 tx=0x7fed84007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.523+0000 7fed8e7fc700 1 -- 172.21.15.1:0/3941611219 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84012400 con 0x7fed900c6620 2023-11-15T01:37:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.524+0000 7fed8e7fc700 1 -- 172.21.15.1:0/3941611219 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed84012560 con 0x7fed900c6620 2023-11-15T01:37:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.524+0000 7fed98773700 1 -- 172.21.15.1:0/3941611219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed900af410 con 0x7fed900c6620 2023-11-15T01:37:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.524+0000 7fed8e7fc700 1 -- 172.21.15.1:0/3941611219 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84012920 con 0x7fed900c6620 2023-11-15T01:37:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.524+0000 7fed98773700 1 -- 172.21.15.1:0/3941611219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed900b09f0 con 0x7fed900c6620 2023-11-15T01:37:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.525+0000 7fed98773700 1 -- 172.21.15.1:0/3941611219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed900aef90 con 0x7fed900c6620 2023-11-15T01:37:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.525+0000 7fed8e7fc700 1 -- 172.21.15.1:0/3941611219 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fed8401b3b0 con 0x7fed900c6620 2023-11-15T01:37:21.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.525+0000 7fed8e7fc700 1 --2- 172.21.15.1:0/3941611219 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed7c05f270 0x7fed7c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:21.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.526+0000 7fed8e7fc700 1 -- 172.21.15.1:0/3941611219 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5693+0+0 (secure 0 0 0) 0x7fed84079950 con 0x7fed900c6620 2023-11-15T01:37:21.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.526+0000 7fed9650f700 1 --2- 172.21.15.1:0/3941611219 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed7c05f270 0x7fed7c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:21.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.526+0000 7fed9650f700 1 --2- 172.21.15.1:0/3941611219 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed7c05f270 0x7fed7c061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fed88001660 tx=0x7fed88001990).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:21.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.530+0000 7fed8e7fc700 1 -- 172.21.15.1:0/3941611219 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fed900aef90 con 0x7fed900c6620 2023-11-15T01:37:21.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.773+0000 7fed98773700 1 -- 172.21.15.1:0/3941611219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fed90152620 con 0x7fed900c6620 2023-11-15T01:37:21.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.773+0000 7fed8e7fc700 1 -- 172.21.15.1:0/3941611219 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fed8404e620 con 0x7fed900c6620 2023-11-15T01:37:21.774 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:21.775 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T01:37:21.775 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_dump": [ 2023-11-15T01:37:21.775 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.775 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.a", 2023-11-15T01:37:21.775 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlmtf5GBAA2CojasXoquGQ9L5rKjVwTQ==", 2023-11-15T01:37:21.776 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.776 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:37:21.776 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:37:21.776 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:37:21.776 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:37:21.777 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.777 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.777 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.777 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.b", 2023-11-15T01:37:21.777 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl/Y5mJBAAz7iLl3kBJ8kSsyTetTZByw==", 2023-11-15T01:37:21.778 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.778 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:37:21.778 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:37:21.778 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:37:21.778 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:37:21.779 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.779 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.779 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.779 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.c", 2023-11-15T01:37:21.779 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlWTrwHxAAqLVpwNca0vAXUBFnWUN3pg==", 2023-11-15T01:37:21.780 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.780 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:37:21.780 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:37:21.780 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:37:21.780 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:37:21.781 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.781 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.781 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.781 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.d", 2023-11-15T01:37:21.781 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlVwUnKxAAhx2/mX1ljgQwJLagVpmZIA==", 2023-11-15T01:37:21.781 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.782 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:37:21.782 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:37:21.782 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:37:21.782 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:37:21.782 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.783 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.783 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.783 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.0", 2023-11-15T01:37:21.783 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDxHFRlII6rERAA/kvPPhTPHHy6pu5wSPsR/A==", 2023-11-15T01:37:21.783 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.784 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:37:21.784 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:37:21.784 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:37:21.784 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.784 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.784 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.785 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.1", 2023-11-15T01:37:21.785 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD0HFRlPkstEBAAqx31fnNonRCVh98eY6qbxQ==", 2023-11-15T01:37:21.785 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.785 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:37:21.785 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:37:21.786 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:37:21.786 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.786 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.786 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.786 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.2", 2023-11-15T01:37:21.787 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD3HFRl8e3nDRAAKigcbIo0/BFo0Qi6rV+amQ==", 2023-11-15T01:37:21.787 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.787 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:37:21.787 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:37:21.787 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:37:21.788 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.788 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.788 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.788 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.3", 2023-11-15T01:37:21.788 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD6HFRlbwDTCxAAkWv04RyNqW4p8pOqvYCS3A==", 2023-11-15T01:37:21.789 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.789 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:37:21.789 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:37:21.789 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:37:21.789 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.789 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.790 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.790 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.4", 2023-11-15T01:37:21.790 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAAHVRlTQihDxAA/HcZbSytP9qD5PsTjvJBoA==", 2023-11-15T01:37:21.790 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.790 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:37:21.791 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:37:21.791 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:37:21.791 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.791 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.791 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.792 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.5", 2023-11-15T01:37:21.792 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQADHVRlQ2hjDRAAFiI+hKubCPcZ/1AJVu1fvQ==", 2023-11-15T01:37:21.792 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.792 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:37:21.792 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:37:21.793 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:37:21.793 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.793 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.793 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.793 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.6", 2023-11-15T01:37:21.793 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAGHVRl/KEbCxAAmKTnRU4m4qNzX+SVcFY+Qw==", 2023-11-15T01:37:21.794 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.794 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:37:21.794 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:37:21.794 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:37:21.794 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.795 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.795 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.795 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.7", 2023-11-15T01:37:21.795 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAJHVRl4wOFCBAAAiGT4UPE5vSb2LjqgGgGFw==", 2023-11-15T01:37:21.795 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.796 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:37:21.796 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:37:21.796 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:37:21.796 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.796 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.797 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.797 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.0", 2023-11-15T01:37:21.797 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl2hkHLxAAxQE/Cslig6gmXR/xcVlRuw==", 2023-11-15T01:37:21.797 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.797 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:37:21.798 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow r", 2023-11-15T01:37:21.798 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-15T01:37:21.798 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.798 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.798 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.799 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.1", 2023-11-15T01:37:21.799 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRltolkNxAAXmQ4yXOlavwqKq2jFKwsYQ==", 2023-11-15T01:37:21.799 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.799 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:37:21.799 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:37:21.799 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:37:21.800 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:37:21.800 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.800 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.800 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.800 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.2", 2023-11-15T01:37:21.801 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlFrJvNBAAH97x7ERzuzpWrUALO+HvpA==", 2023-11-15T01:37:21.801 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.801 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:37:21.801 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:37:21.801 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:37:21.802 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:37:21.802 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.802 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.802 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.802 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.3", 2023-11-15T01:37:21.802 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDwHFRlko0ZARAA2RqeRJGwWns00DeWgd/9hA==", 2023-11-15T01:37:21.803 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.803 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:37:21.803 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:37:21.803 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:37:21.803 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:37:21.804 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.804 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.804 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.804 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.admin", 2023-11-15T01:37:21.804 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDuHFRlxIQDORAALrVIyQoaVSADkyv9yzMaZw==", 2023-11-15T01:37:21.805 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.805 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:37:21.805 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:37:21.805 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:37:21.805 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:37:21.805 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.806 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.806 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.806 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.x", 2023-11-15T01:37:21.806 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlnyjlFRAAjJwtxkAvJ0ZGmvOOawQseQ==", 2023-11-15T01:37:21.806 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.807 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:37:21.807 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T01:37:21.807 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:37:21.807 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.807 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:21.808 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:21.808 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.y", 2023-11-15T01:37:21.808 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl8nW3ERAA4CJQt/ZEZCJ9UaRRuEHfzw==", 2023-11-15T01:37:21.808 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:37:21.809 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:37:21.809 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T01:37:21.809 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:37:21.809 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.809 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:21.810 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2023-11-15T01:37:21.810 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T01:37:21.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.775+0000 7fed98773700 1 -- 172.21.15.1:0/3941611219 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed7c05f270 msgr2=0x7fed7c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:21.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.775+0000 7fed98773700 1 --2- 172.21.15.1:0/3941611219 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed7c05f270 0x7fed7c061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fed88001660 tx=0x7fed88001990).stop 2023-11-15T01:37:21.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.775+0000 7fed98773700 1 -- 172.21.15.1:0/3941611219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed900c6620 msgr2=0x7fed900c4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:21.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.775+0000 7fed98773700 1 --2- 172.21.15.1:0/3941611219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed900c6620 0x7fed900c4c90 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7fed8400c440 tx=0x7fed84007c90).stop 2023-11-15T01:37:21.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.775+0000 7fed98773700 1 -- 172.21.15.1:0/3941611219 shutdown_connections 2023-11-15T01:37:21.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.775+0000 7fed98773700 1 --2- 172.21.15.1:0/3941611219 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fed7c05f270 0x7fed7c061730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.775+0000 7fed98773700 1 --2- 172.21.15.1:0/3941611219 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed90154150 0x7fed90156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.775+0000 7fed98773700 1 --2- 172.21.15.1:0/3941611219 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed900ab1a0 0x7fed90152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.775+0000 7fed98773700 1 --2- 172.21.15.1:0/3941611219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed900c6620 0x7fed900c4c90 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.775+0000 7fed98773700 1 -- 172.21.15.1:0/3941611219 >> 172.21.15.1:0/3941611219 conn(0x7fed90064aa0 msgr2=0x7fed900c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:21.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.775+0000 7fed98773700 1 -- 172.21.15.1:0/3941611219 shutdown_connections 2023-11-15T01:37:21.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.775+0000 7fed98773700 1 -- 172.21.15.1:0/3941611219 wait complete. 2023-11-15T01:37:21.814 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:37:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.932+0000 7ff77dbe0700 1 Processor -- start 2023-11-15T01:37:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.932+0000 7ff77dbe0700 1 -- start start 2023-11-15T01:37:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.933+0000 7ff77dbe0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff778154150 0x7ff778154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.933+0000 7ff77dbe0700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff7780ab1a0 0x7ff778158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.933+0000 7ff77dbe0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7780aa060 0x7ff7780c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.933+0000 7ff77dbe0700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7780c06f0 con 0x7ff778154150 2023-11-15T01:37:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.933+0000 7ff77dbe0700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7780c09d0 con 0x7ff7780ab1a0 2023-11-15T01:37:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.933+0000 7ff77dbe0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff778158820 con 0x7ff7780aa060 2023-11-15T01:37:21.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.933+0000 7ff7777fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff778154150 0x7ff778154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:21.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.933+0000 7ff7777fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff778154150 0x7ff778154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35056/0 (socket says 172.21.15.1:35056) 2023-11-15T01:37:21.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.933+0000 7ff7777fe700 1 -- 172.21.15.1:0/3257593651 learned_addr learned my addr 172.21.15.1:0/3257593651 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:21.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.933+0000 7ff777fff700 1 --2- 172.21.15.1:0/3257593651 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7780aa060 0x7ff7780c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:21.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.933+0000 7ff776ffd700 1 --2- 172.21.15.1:0/3257593651 >> v2:172.21.15.141:3300/0 conn(0x7ff7780ab1a0 0x7ff778158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:21.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff7777fe700 1 -- 172.21.15.1:0/3257593651 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7780aa060 msgr2=0x7ff7780c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:21.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff7777fe700 1 --2- 172.21.15.1:0/3257593651 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7780aa060 0x7ff7780c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff7777fe700 1 -- 172.21.15.1:0/3257593651 >> v2:172.21.15.141:3300/0 conn(0x7ff7780ab1a0 msgr2=0x7ff778158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:21.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff7777fe700 1 --2- 172.21.15.1:0/3257593651 >> v2:172.21.15.141:3300/0 conn(0x7ff7780ab1a0 0x7ff778158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff7777fe700 1 -- 172.21.15.1:0/3257593651 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff778158b00 con 0x7ff778154150 2023-11-15T01:37:21.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff777fff700 1 --2- 172.21.15.1:0/3257593651 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7780aa060 0x7ff7780c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:21.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff776ffd700 1 --2- 172.21.15.1:0/3257593651 >> v2:172.21.15.141:3300/0 conn(0x7ff7780ab1a0 0x7ff778158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:21.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff7777fe700 1 --2- 172.21.15.1:0/3257593651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff778154150 0x7ff778154530 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7ff7780c0270 tx=0x7ff768009840).ready entity=mon.0 client_cookie=e3c0faaa16112ee5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:21.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff7767fc700 1 -- 172.21.15.1:0/3257593651 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76800e070 con 0x7ff778154150 2023-11-15T01:37:21.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff7767fc700 1 -- 172.21.15.1:0/3257593651 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76800ba50 con 0x7ff778154150 2023-11-15T01:37:21.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff7767fc700 1 -- 172.21.15.1:0/3257593651 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76800bdd0 con 0x7ff778154150 2023-11-15T01:37:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff77dbe0700 1 -- 172.21.15.1:0/3257593651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff778154150 msgr2=0x7ff778154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff77dbe0700 1 --2- 172.21.15.1:0/3257593651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff778154150 0x7ff778154530 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7ff7780c0270 tx=0x7ff768009840).stop 2023-11-15T01:37:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff77dbe0700 1 -- 172.21.15.1:0/3257593651 shutdown_connections 2023-11-15T01:37:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff77dbe0700 1 --2- 172.21.15.1:0/3257593651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff778154150 0x7ff778154530 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff77dbe0700 1 --2- 172.21.15.1:0/3257593651 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7780aa060 0x7ff7780c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff77dbe0700 1 --2- 172.21.15.1:0/3257593651 >> v2:172.21.15.141:3300/0 conn(0x7ff7780ab1a0 0x7ff778158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff77dbe0700 1 -- 172.21.15.1:0/3257593651 >> 172.21.15.1:0/3257593651 conn(0x7ff778064aa0 msgr2=0x7ff778064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.934+0000 7ff77dbe0700 1 -- 172.21.15.1:0/3257593651 shutdown_connections 2023-11-15T01:37:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.935+0000 7ff77dbe0700 1 -- 172.21.15.1:0/3257593651 wait complete. 2023-11-15T01:37:21.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.936+0000 7ff77dbe0700 1 Processor -- start 2023-11-15T01:37:21.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.936+0000 7ff77dbe0700 1 -- start start 2023-11-15T01:37:21.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.936+0000 7ff77dbe0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7780aa060 0x7ff77814b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:21.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.936+0000 7ff77dbe0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff7780ab1a0 0x7ff77814c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:21.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.936+0000 7ff77dbe0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff778154150 0x7ff77814caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:21.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.936+0000 7ff77dbe0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77814cfe0 con 0x7ff778154150 2023-11-15T01:37:21.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff77dbe0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7780af580 con 0x7ff7780ab1a0 2023-11-15T01:37:21.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff77dbe0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7780b05e0 con 0x7ff7780aa060 2023-11-15T01:37:21.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff777fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff778154150 0x7ff77814caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff777fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff778154150 0x7ff77814caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35072/0 (socket says 172.21.15.1:35072) 2023-11-15T01:37:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff777fff700 1 -- 172.21.15.1:0/2099237552 learned_addr learned my addr 172.21.15.1:0/2099237552 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff776ffd700 1 --2- 172.21.15.1:0/2099237552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff7780ab1a0 0x7ff77814c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff7777fe700 1 --2- 172.21.15.1:0/2099237552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7780aa060 0x7ff77814b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff777fff700 1 -- 172.21.15.1:0/2099237552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7780aa060 msgr2=0x7ff77814b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:21.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff777fff700 1 --2- 172.21.15.1:0/2099237552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7780aa060 0x7ff77814b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff777fff700 1 -- 172.21.15.1:0/2099237552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff7780ab1a0 msgr2=0x7ff77814c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:21.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff777fff700 1 --2- 172.21.15.1:0/2099237552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff7780ab1a0 0x7ff77814c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:21.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff777fff700 1 -- 172.21.15.1:0/2099237552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff768009ae0 con 0x7ff778154150 2023-11-15T01:37:21.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff777fff700 1 --2- 172.21.15.1:0/2099237552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff778154150 0x7ff77814caf0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7ff77000d860 tx=0x7ff770008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:21.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff76f7fe700 1 -- 172.21.15.1:0/2099237552 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff770011590 con 0x7ff778154150 2023-11-15T01:37:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff76f7fe700 1 -- 172.21.15.1:0/2099237552 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7700116f0 con 0x7ff778154150 2023-11-15T01:37:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff76f7fe700 1 -- 172.21.15.1:0/2099237552 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff770011a90 con 0x7ff778154150 2023-11-15T01:37:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff77dbe0700 1 -- 172.21.15.1:0/2099237552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7780af820 con 0x7ff778154150 2023-11-15T01:37:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.937+0000 7ff77dbe0700 1 -- 172.21.15.1:0/2099237552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7780afde0 con 0x7ff778154150 2023-11-15T01:37:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.938+0000 7ff77dbe0700 1 -- 172.21.15.1:0/2099237552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77806c7e0 con 0x7ff778154150 2023-11-15T01:37:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.939+0000 7ff76f7fe700 1 -- 172.21.15.1:0/2099237552 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff77001c460 con 0x7ff778154150 2023-11-15T01:37:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.939+0000 7ff76f7fe700 1 --2- 172.21.15.1:0/2099237552 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff75805f270 0x7ff758061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.939+0000 7ff76f7fe700 1 -- 172.21.15.1:0/2099237552 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5693+0+0 (secure 0 0 0) 0x7ff770079f80 con 0x7ff778154150 2023-11-15T01:37:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.939+0000 7ff7777fe700 1 --2- 172.21.15.1:0/2099237552 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff75805f270 0x7ff758061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.940+0000 7ff7777fe700 1 --2- 172.21.15.1:0/2099237552 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff75805f270 0x7ff758061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff768009930 tx=0x7ff768009840).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:21.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:21.943+0000 7ff76f7fe700 1 -- 172.21.15.1:0/2099237552 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff7700a8af0 con 0x7ff778154150 2023-11-15T01:37:22.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.115+0000 7ff77dbe0700 1 -- 172.21.15.1:0/2099237552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7780c02a0 con 0x7ff778154150 2023-11-15T01:37:22.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.116+0000 7ff76f7fe700 1 -- 172.21.15.1:0/2099237552 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+14310 (secure 0 0 0) 0x7ff77004b220 con 0x7ff778154150 2023-11-15T01:37:22.117 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:22.117 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":105,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:37:21.372742+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:37:22.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.118+0000 7ff77dbe0700 1 -- 172.21.15.1:0/2099237552 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff75805f270 msgr2=0x7ff758061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.118+0000 7ff77dbe0700 1 --2- 172.21.15.1:0/2099237552 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff75805f270 0x7ff758061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff768009930 tx=0x7ff768009840).stop 2023-11-15T01:37:22.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.118+0000 7ff77dbe0700 1 -- 172.21.15.1:0/2099237552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff778154150 msgr2=0x7ff77814caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.118+0000 7ff77dbe0700 1 --2- 172.21.15.1:0/2099237552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff778154150 0x7ff77814caf0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7ff77000d860 tx=0x7ff770008040).stop 2023-11-15T01:37:22.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.118+0000 7ff77dbe0700 1 -- 172.21.15.1:0/2099237552 shutdown_connections 2023-11-15T01:37:22.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.118+0000 7ff77dbe0700 1 --2- 172.21.15.1:0/2099237552 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff75805f270 0x7ff758061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.118+0000 7ff77dbe0700 1 --2- 172.21.15.1:0/2099237552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff778154150 0x7ff77814caf0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.118+0000 7ff77dbe0700 1 --2- 172.21.15.1:0/2099237552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7780aa060 0x7ff77814b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.118+0000 7ff77dbe0700 1 --2- 172.21.15.1:0/2099237552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff7780ab1a0 0x7ff77814c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.118+0000 7ff77dbe0700 1 -- 172.21.15.1:0/2099237552 >> 172.21.15.1:0/2099237552 conn(0x7ff778064aa0 msgr2=0x7ff77814d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:22.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.118+0000 7ff77dbe0700 1 -- 172.21.15.1:0/2099237552 shutdown_connections 2023-11-15T01:37:22.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.118+0000 7ff77dbe0700 1 -- 172.21.15.1:0/2099237552 wait complete. 2023-11-15T01:37:22.131 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-15T01:37:22.131 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:37:22.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.252+0000 7efcf8e81700 1 Processor -- start 2023-11-15T01:37:22.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.252+0000 7efcf8e81700 1 -- start start 2023-11-15T01:37:22.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf8e81700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcf41540a0 0x7efcf40ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf8e81700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efcf40c6650 0x7efcf40ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf8e81700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf40ca050 con 0x7efcf4154480 2023-11-15T01:37:22.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf8e81700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf40c9440 con 0x7efcf40c6650 2023-11-15T01:37:22.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf8e81700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40c9720 con 0x7efcf41540a0 2023-11-15T01:37:22.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf2d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efcf40c6650 0x7efcf40ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf1d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7efcf4154480 0x7efcf40c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57464/0 (socket says 172.21.15.1:57464) 2023-11-15T01:37:22.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf1d9b700 1 -- 172.21.15.1:0/1083214686 learned_addr learned my addr 172.21.15.1:0/1083214686 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:22.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf259c700 1 --2- 172.21.15.1:0/1083214686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcf41540a0 0x7efcf40ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf159a700 1 -- 172.21.15.1:0/1083214686 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771663462 0 0) 0x7efcf40ca050 con 0x7efcf4154480 2023-11-15T01:37:22.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf159a700 1 -- 172.21.15.1:0/1083214686 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efce00033f0 con 0x7efcf4154480 2023-11-15T01:37:22.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf2d9d700 1 -- 172.21.15.1:0/1083214686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcf41540a0 msgr2=0x7efcf40ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:22.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf2d9d700 1 --2- 172.21.15.1:0/1083214686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcf41540a0 0x7efcf40ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf2d9d700 1 -- 172.21.15.1:0/1083214686 >> v1:172.21.15.1:6789/0 conn(0x7efcf4154480 legacy=0x7efcf40c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf2d9d700 1 -- 172.21.15.1:0/1083214686 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40c9a00 con 0x7efcf40c6650 2023-11-15T01:37:22.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.253+0000 7efcf259c700 1 --2- 172.21.15.1:0/1083214686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcf41540a0 0x7efcf40ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:37:22.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.254+0000 7efcf2d9d700 1 --2- 172.21.15.1:0/1083214686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcf40c6650 0x7efcf40ca9d0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7efce4009e60 tx=0x7efce4009780).ready entity=mon.0 client_cookie=475576125a20a6f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:22.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.254+0000 7efcf159a700 1 -- 172.21.15.1:0/1083214686 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce400e070 con 0x7efcf40c6650 2023-11-15T01:37:22.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.254+0000 7efcf159a700 1 -- 172.21.15.1:0/1083214686 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce400bb60 con 0x7efcf40c6650 2023-11-15T01:37:22.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.254+0000 7efcf159a700 1 -- 172.21.15.1:0/1083214686 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4012410 con 0x7efcf40c6650 2023-11-15T01:37:22.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.254+0000 7efcf8e81700 1 -- 172.21.15.1:0/1083214686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcf40c6650 msgr2=0x7efcf40ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.254+0000 7efcf8e81700 1 --2- 172.21.15.1:0/1083214686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcf40c6650 0x7efcf40ca9d0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7efce4009e60 tx=0x7efce4009780).stop 2023-11-15T01:37:22.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.255+0000 7efcf8e81700 1 -- 172.21.15.1:0/1083214686 shutdown_connections 2023-11-15T01:37:22.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.255+0000 7efcf8e81700 1 --2- 172.21.15.1:0/1083214686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcf40c6650 0x7efcf40ca9d0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.255+0000 7efcf8e81700 1 --2- 172.21.15.1:0/1083214686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcf41540a0 0x7efcf40ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.255+0000 7efcf8e81700 1 -- 172.21.15.1:0/1083214686 >> 172.21.15.1:0/1083214686 conn(0x7efcf4064a70 msgr2=0x7efcf4064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:22.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.255+0000 7efcf8e81700 1 -- 172.21.15.1:0/1083214686 shutdown_connections 2023-11-15T01:37:22.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.255+0000 7efcf8e81700 1 -- 172.21.15.1:0/1083214686 wait complete. 2023-11-15T01:37:22.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.256+0000 7efcf8e81700 1 Processor -- start 2023-11-15T01:37:22.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.256+0000 7efcf8e81700 1 -- start start 2023-11-15T01:37:22.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.256+0000 7efcf8e81700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcf40c6650 0x7efcf414b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.256+0000 7efcf8e81700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efcf41540a0 0x7efcf40ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.256+0000 7efcf8e81700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcf4154480 0x7efcf4148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf8e81700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40af3e0 con 0x7efcf4154480 2023-11-15T01:37:22.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf8e81700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40ae550 con 0x7efcf41540a0 2023-11-15T01:37:22.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf8e81700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40ae7d0 con 0x7efcf40c6650 2023-11-15T01:37:22.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf2d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcf4154480 0x7efcf4148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf2d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcf4154480 0x7efcf4148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35090/0 (socket says 172.21.15.1:35090) 2023-11-15T01:37:22.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf2d9d700 1 -- 172.21.15.1:0/2240674009 learned_addr learned my addr 172.21.15.1:0/2240674009 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:22.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf259c700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcf40c6650 0x7efcf414b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf1d9b700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efcf41540a0 0x7efcf40ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf2d9d700 1 -- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcf40c6650 msgr2=0x7efcf414b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf2d9d700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcf40c6650 0x7efcf414b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf2d9d700 1 -- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efcf41540a0 msgr2=0x7efcf40ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf2d9d700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efcf41540a0 0x7efcf40ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf2d9d700 1 -- 172.21.15.1:0/2240674009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce4009a20 con 0x7efcf4154480 2023-11-15T01:37:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf259c700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcf40c6650 0x7efcf414b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf1d9b700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efcf41540a0 0x7efcf40ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf2d9d700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcf4154480 0x7efcf4148ba0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7efcf40c2070 tx=0x7efce4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcea7fc700 1 -- 172.21.15.1:0/2240674009 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce401d630 con 0x7efcf4154480 2023-11-15T01:37:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcea7fc700 1 -- 172.21.15.1:0/2240674009 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce401d790 con 0x7efcf4154480 2023-11-15T01:37:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcea7fc700 1 -- 172.21.15.1:0/2240674009 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce401db50 con 0x7efcf4154480 2023-11-15T01:37:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf8e81700 1 -- 172.21.15.1:0/2240674009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf40aeab0 con 0x7efcf4154480 2023-11-15T01:37:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.257+0000 7efcf8e81700 1 -- 172.21.15.1:0/2240674009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf40af070 con 0x7efcf4154480 2023-11-15T01:37:22.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.258+0000 7efcf8e81700 1 -- 172.21.15.1:0/2240674009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf40af590 con 0x7efcf4154480 2023-11-15T01:37:22.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.259+0000 7efcea7fc700 1 -- 172.21.15.1:0/2240674009 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7efce4026410 con 0x7efcf4154480 2023-11-15T01:37:22.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.259+0000 7efcea7fc700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efcd405f270 0x7efcd4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.259+0000 7efcea7fc700 1 -- 172.21.15.1:0/2240674009 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5693+0+0 (secure 0 0 0) 0x7efce407c0f0 con 0x7efcf4154480 2023-11-15T01:37:22.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.259+0000 7efcf259c700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efcd405f270 0x7efcd4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.260+0000 7efcf259c700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efcd405f270 0x7efcd4061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7efcec00aa90 tx=0x7efcec008040).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:22.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.263+0000 7efcea7fc700 1 -- 172.21.15.1:0/2240674009 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efcf40af590 con 0x7efcf4154480 2023-11-15T01:37:22.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.434+0000 7efcf8e81700 1 -- 172.21.15.1:0/2240674009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efcf40ca3e0 con 0x7efcf4154480 2023-11-15T01:37:22.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.434+0000 7efcea7fc700 1 -- 172.21.15.1:0/2240674009 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v105) v1 ==== 110+0+10 (secure 0 0 0) 0x7efce404d390 con 0x7efcf4154480 2023-11-15T01:37:22.435 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:37:22.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.436+0000 7efcf8e81700 1 -- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efcd405f270 msgr2=0x7efcd4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.436+0000 7efcf8e81700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efcd405f270 0x7efcd4061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7efcec00aa90 tx=0x7efcec008040).stop 2023-11-15T01:37:22.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.436+0000 7efcf8e81700 1 -- 172.21.15.1:0/2240674009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcf4154480 msgr2=0x7efcf4148ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.436+0000 7efcf8e81700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcf4154480 0x7efcf4148ba0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7efcf40c2070 tx=0x7efce4009780).stop 2023-11-15T01:37:22.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.436+0000 7efcf8e81700 1 -- 172.21.15.1:0/2240674009 shutdown_connections 2023-11-15T01:37:22.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.436+0000 7efcf8e81700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efcd405f270 0x7efcd4061730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.436+0000 7efcf8e81700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efcf4154480 0x7efcf4148ba0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.436+0000 7efcf8e81700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efcf40c6650 0x7efcf414b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.436+0000 7efcf8e81700 1 --2- 172.21.15.1:0/2240674009 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efcf41540a0 0x7efcf40ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.436+0000 7efcf8e81700 1 -- 172.21.15.1:0/2240674009 >> 172.21.15.1:0/2240674009 conn(0x7efcf4064a70 msgr2=0x7efcf40ab230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:22.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.436+0000 7efcf8e81700 1 -- 172.21.15.1:0/2240674009 shutdown_connections 2023-11-15T01:37:22.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.436+0000 7efcf8e81700 1 -- 172.21.15.1:0/2240674009 wait complete. 2023-11-15T01:37:22.449 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:37:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.569+0000 7fa7830d8700 1 Processor -- start 2023-11-15T01:37:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.569+0000 7fa7830d8700 1 -- start start 2023-11-15T01:37:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.570+0000 7fa7830d8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa77c1540a0 0x7fa77c0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.570+0000 7fa7830d8700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa77c0c6650 0x7fa77c0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.570+0000 7fa7830d8700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77c0ca050 con 0x7fa77c154480 2023-11-15T01:37:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.570+0000 7fa7830d8700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77c0c9440 con 0x7fa77c0c6650 2023-11-15T01:37:22.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.570+0000 7fa7830d8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c0c9720 con 0x7fa77c1540a0 2023-11-15T01:37:22.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.570+0000 7fa781675700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa77c0c6650 0x7fa77c0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.570+0000 7fa780e74700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa77c1540a0 0x7fa77c0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.570+0000 7fa780e74700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa77c1540a0 0x7fa77c0ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:34368/0 (socket says 172.21.15.1:34368) 2023-11-15T01:37:22.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.570+0000 7fa781675700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa77c0c6650 0x7fa77c0ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:56282/0 (socket says 172.21.15.1:56282) 2023-11-15T01:37:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.570+0000 7fa780e74700 1 -- 172.21.15.1:0/2773835753 learned_addr learned my addr 172.21.15.1:0/2773835753 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.570+0000 7fa77bfff700 1 --1- 172.21.15.1:0/2773835753 >> v1:172.21.15.141:6789/0 conn(0x7fa77c154480 0x7fa77c0c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:44122/0 (socket says 172.21.15.1:44122) 2023-11-15T01:37:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.571+0000 7fa780e74700 1 -- 172.21.15.1:0/2773835753 >> v2:172.21.15.141:3300/0 conn(0x7fa77c0c6650 msgr2=0x7fa77c0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.571+0000 7fa780e74700 1 --2- 172.21.15.1:0/2773835753 >> v2:172.21.15.141:3300/0 conn(0x7fa77c0c6650 0x7fa77c0ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.571+0000 7fa780e74700 1 -- 172.21.15.1:0/2773835753 >> v1:172.21.15.141:6789/0 conn(0x7fa77c154480 legacy=0x7fa77c0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.571+0000 7fa780e74700 1 -- 172.21.15.1:0/2773835753 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c0c9a00 con 0x7fa77c1540a0 2023-11-15T01:37:22.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.571+0000 7fa77b7fe700 1 -- 172.21.15.1:0/2773835753 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228545285 0 0) 0x7fa77c0ca050 con 0x7fa77c154480 2023-11-15T01:37:22.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.571+0000 7fa781675700 1 --2- 172.21.15.1:0/2773835753 >> v2:172.21.15.141:3300/0 conn(0x7fa77c0c6650 0x7fa77c0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:22.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.571+0000 7fa780e74700 1 --2- 172.21.15.1:0/2773835753 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa77c1540a0 0x7fa77c0ca4e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fa774009f20 tx=0x7fa774009840).ready entity=mon.2 client_cookie=5ad6079547c1157d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:22.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.571+0000 7fa77b7fe700 1 -- 172.21.15.1:0/2773835753 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77400e070 con 0x7fa77c1540a0 2023-11-15T01:37:22.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.571+0000 7fa77b7fe700 1 -- 172.21.15.1:0/2773835753 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77400b9d0 con 0x7fa77c1540a0 2023-11-15T01:37:22.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.571+0000 7fa77b7fe700 1 -- 172.21.15.1:0/2773835753 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77400bd50 con 0x7fa77c1540a0 2023-11-15T01:37:22.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.572+0000 7fa7830d8700 1 -- 172.21.15.1:0/2773835753 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa77c1540a0 msgr2=0x7fa77c0ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.572+0000 7fa7830d8700 1 --2- 172.21.15.1:0/2773835753 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa77c1540a0 0x7fa77c0ca4e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fa774009f20 tx=0x7fa774009840).stop 2023-11-15T01:37:22.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.572+0000 7fa7830d8700 1 -- 172.21.15.1:0/2773835753 shutdown_connections 2023-11-15T01:37:22.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.572+0000 7fa7830d8700 1 --2- 172.21.15.1:0/2773835753 >> v2:172.21.15.141:3300/0 conn(0x7fa77c0c6650 0x7fa77c0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.572+0000 7fa7830d8700 1 --2- 172.21.15.1:0/2773835753 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa77c1540a0 0x7fa77c0ca4e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.572+0000 7fa7830d8700 1 -- 172.21.15.1:0/2773835753 >> 172.21.15.1:0/2773835753 conn(0x7fa77c064a70 msgr2=0x7fa77c064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.572+0000 7fa7830d8700 1 -- 172.21.15.1:0/2773835753 shutdown_connections 2023-11-15T01:37:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.572+0000 7fa7830d8700 1 -- 172.21.15.1:0/2773835753 wait complete. 2023-11-15T01:37:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.573+0000 7fa7830d8700 1 Processor -- start 2023-11-15T01:37:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.573+0000 7fa7830d8700 1 -- start start 2023-11-15T01:37:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa7830d8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa77c0c6650 0x7fa77c0c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa7830d8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa77c1540a0 0x7fa77c1486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa7830d8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa77c154480 0x7fa77c0c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa7830d8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c14c980 con 0x7fa77c1540a0 2023-11-15T01:37:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa7830d8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c0c49c0 con 0x7fa77c154480 2023-11-15T01:37:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa7830d8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c0c2660 con 0x7fa77c0c6650 2023-11-15T01:37:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa77bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa77c1540a0 0x7fa77c1486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa77bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa77c1540a0 0x7fa77c1486e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35092/0 (socket says 172.21.15.1:35092) 2023-11-15T01:37:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa77bfff700 1 -- 172.21.15.1:0/1132986115 learned_addr learned my addr 172.21.15.1:0/1132986115 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa780e74700 1 --2- 172.21.15.1:0/1132986115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa77c0c6650 0x7fa77c0c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa781675700 1 --2- 172.21.15.1:0/1132986115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa77c154480 0x7fa77c0c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa77bfff700 1 -- 172.21.15.1:0/1132986115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa77c0c6650 msgr2=0x7fa77c0c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa77bfff700 1 --2- 172.21.15.1:0/1132986115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa77c0c6650 0x7fa77c0c2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa77bfff700 1 -- 172.21.15.1:0/1132986115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa77c154480 msgr2=0x7fa77c0c3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa77bfff700 1 --2- 172.21.15.1:0/1132986115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa77c154480 0x7fa77c0c3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa77bfff700 1 -- 172.21.15.1:0/1132986115 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7640092a0 con 0x7fa77c1540a0 2023-11-15T01:37:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa77bfff700 1 --2- 172.21.15.1:0/1132986115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa77c1540a0 0x7fa77c1486e0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7fa76c00c4e0 tx=0x7fa76c007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.574+0000 7fa778ff9700 1 -- 172.21.15.1:0/1132986115 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c00ce50 con 0x7fa77c1540a0 2023-11-15T01:37:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.575+0000 7fa778ff9700 1 -- 172.21.15.1:0/1132986115 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76c0072e0 con 0x7fa77c1540a0 2023-11-15T01:37:22.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.575+0000 7fa7830d8700 1 -- 172.21.15.1:0/1132986115 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa774009ae0 con 0x7fa77c1540a0 2023-11-15T01:37:22.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.575+0000 7fa778ff9700 1 -- 172.21.15.1:0/1132986115 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c0056e0 con 0x7fa77c1540a0 2023-11-15T01:37:22.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.575+0000 7fa7830d8700 1 -- 172.21.15.1:0/1132986115 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77c0c4f60 con 0x7fa77c1540a0 2023-11-15T01:37:22.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.576+0000 7fa7830d8700 1 -- 172.21.15.1:0/1132986115 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77c06c7e0 con 0x7fa77c1540a0 2023-11-15T01:37:22.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.576+0000 7fa778ff9700 1 -- 172.21.15.1:0/1132986115 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa76c005ad0 con 0x7fa77c1540a0 2023-11-15T01:37:22.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.576+0000 7fa778ff9700 1 --2- 172.21.15.1:0/1132986115 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa75c05f270 0x7fa75c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.576+0000 7fa778ff9700 1 -- 172.21.15.1:0/1132986115 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5693+0+0 (secure 0 0 0) 0x7fa76c0799e0 con 0x7fa77c1540a0 2023-11-15T01:37:22.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.577+0000 7fa780e74700 1 --2- 172.21.15.1:0/1132986115 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa75c05f270 0x7fa75c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.577+0000 7fa780e74700 1 --2- 172.21.15.1:0/1132986115 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa75c05f270 0x7fa75c061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa77400b9a0 tx=0x7fa774009840).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:22.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.580+0000 7fa778ff9700 1 -- 172.21.15.1:0/1132986115 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa76c04ace0 con 0x7fa77c1540a0 2023-11-15T01:37:22.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.754+0000 7fa7830d8700 1 -- 172.21.15.1:0/1132986115 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa77c0c9ce0 con 0x7fa77c1540a0 2023-11-15T01:37:22.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.754+0000 7fa778ff9700 1 -- 172.21.15.1:0/1132986115 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v105) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa76c018030 con 0x7fa77c1540a0 2023-11-15T01:37:22.755 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:37:22.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.756+0000 7fa7830d8700 1 -- 172.21.15.1:0/1132986115 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa75c05f270 msgr2=0x7fa75c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.756+0000 7fa7830d8700 1 --2- 172.21.15.1:0/1132986115 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa75c05f270 0x7fa75c061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa77400b9a0 tx=0x7fa774009840).stop 2023-11-15T01:37:22.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.756+0000 7fa7830d8700 1 -- 172.21.15.1:0/1132986115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa77c1540a0 msgr2=0x7fa77c1486e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.756+0000 7fa7830d8700 1 --2- 172.21.15.1:0/1132986115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa77c1540a0 0x7fa77c1486e0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7fa76c00c4e0 tx=0x7fa76c007c60).stop 2023-11-15T01:37:22.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.756+0000 7fa7830d8700 1 -- 172.21.15.1:0/1132986115 shutdown_connections 2023-11-15T01:37:22.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.756+0000 7fa7830d8700 1 --2- 172.21.15.1:0/1132986115 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa75c05f270 0x7fa75c061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.756+0000 7fa7830d8700 1 --2- 172.21.15.1:0/1132986115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa77c154480 0x7fa77c0c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.756+0000 7fa7830d8700 1 --2- 172.21.15.1:0/1132986115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa77c0c6650 0x7fa77c0c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.756+0000 7fa7830d8700 1 --2- 172.21.15.1:0/1132986115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa77c1540a0 0x7fa77c1486e0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.756+0000 7fa7830d8700 1 -- 172.21.15.1:0/1132986115 >> 172.21.15.1:0/1132986115 conn(0x7fa77c064a70 msgr2=0x7fa77c0c5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:22.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.756+0000 7fa7830d8700 1 -- 172.21.15.1:0/1132986115 shutdown_connections 2023-11-15T01:37:22.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.756+0000 7fa7830d8700 1 -- 172.21.15.1:0/1132986115 wait complete. 2023-11-15T01:37:22.769 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-15T01:37:22.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.886+0000 7f06f0ebd700 1 Processor -- start 2023-11-15T01:37:22.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.886+0000 7f06f0ebd700 1 -- start start 2023-11-15T01:37:22.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.887+0000 7f06f0ebd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f06ec154150 0x7f06ec154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.887+0000 7f06f0ebd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06ec0ab1a0 0x7f06ec158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.887+0000 7f06f0ebd700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec0c06f0 con 0x7f06ec0aa060 2023-11-15T01:37:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.887+0000 7f06f0ebd700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec0c09d0 con 0x7f06ec154150 2023-11-15T01:37:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.887+0000 7f06f0ebd700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec158820 con 0x7f06ec0ab1a0 2023-11-15T01:37:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.888+0000 7f06ea59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f06ec154150 0x7f06ec154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.888+0000 7f06ea59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f06ec154150 0x7f06ec154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35108/0 (socket says 172.21.15.1:35108) 2023-11-15T01:37:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.888+0000 7f06ea59c700 1 -- 172.21.15.1:0/1068813695 learned_addr learned my addr 172.21.15.1:0/1068813695 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.888+0000 7f06e9d9b700 1 --2- 172.21.15.1:0/1068813695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06ec0ab1a0 0x7f06ec158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.888+0000 7f06ea59c700 1 -- 172.21.15.1:0/1068813695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06ec0ab1a0 msgr2=0x7f06ec158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.888+0000 7f06ea59c700 1 --2- 172.21.15.1:0/1068813695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06ec0ab1a0 0x7f06ec158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.888+0000 7f06ea59c700 1 -- 172.21.15.1:0/1068813695 >> v1:172.21.15.141:6789/0 conn(0x7f06ec0aa060 legacy=0x7f06ec0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.888+0000 7f06ea59c700 1 -- 172.21.15.1:0/1068813695 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec158b00 con 0x7f06ec154150 2023-11-15T01:37:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.888+0000 7f06ea59c700 1 --2- 172.21.15.1:0/1068813695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06ec154150 0x7f06ec154530 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f06e4009f20 tx=0x7f06e4009840).ready entity=mon.0 client_cookie=4252c7a00815dee1 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.888+0000 7f06e959a700 1 -- 172.21.15.1:0/1068813695 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e400e070 con 0x7f06ec154150 2023-11-15T01:37:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.888+0000 7f06e959a700 1 -- 172.21.15.1:0/1068813695 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e400ba80 con 0x7f06ec154150 2023-11-15T01:37:22.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.888+0000 7f06e959a700 1 -- 172.21.15.1:0/1068813695 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e400be00 con 0x7f06ec154150 2023-11-15T01:37:22.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.889+0000 7f06f0ebd700 1 -- 172.21.15.1:0/1068813695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06ec154150 msgr2=0x7f06ec154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.889+0000 7f06f0ebd700 1 --2- 172.21.15.1:0/1068813695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06ec154150 0x7f06ec154530 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f06e4009f20 tx=0x7f06e4009840).stop 2023-11-15T01:37:22.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.889+0000 7f06f0ebd700 1 -- 172.21.15.1:0/1068813695 shutdown_connections 2023-11-15T01:37:22.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.889+0000 7f06f0ebd700 1 --2- 172.21.15.1:0/1068813695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06ec154150 0x7f06ec154530 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.889+0000 7f06f0ebd700 1 --2- 172.21.15.1:0/1068813695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06ec0ab1a0 0x7f06ec158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.889+0000 7f06f0ebd700 1 -- 172.21.15.1:0/1068813695 >> 172.21.15.1:0/1068813695 conn(0x7f06ec064aa0 msgr2=0x7f06ec064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:22.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.889+0000 7f06f0ebd700 1 -- 172.21.15.1:0/1068813695 shutdown_connections 2023-11-15T01:37:22.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.889+0000 7f06f0ebd700 1 -- 172.21.15.1:0/1068813695 wait complete. 2023-11-15T01:37:22.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.890+0000 7f06f0ebd700 1 Processor -- start 2023-11-15T01:37:22.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.890+0000 7f06f0ebd700 1 -- start start 2023-11-15T01:37:22.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06f0ebd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06ec0aa060 0x7f06ec147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06f0ebd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06ec0ab1a0 0x7f06ec151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06f0ebd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06ec154150 0x7f06ec14bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06f0ebd700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec150680 con 0x7f06ec0ab1a0 2023-11-15T01:37:22.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06f0ebd700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec1508d0 con 0x7f06ec0aa060 2023-11-15T01:37:22.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06f0ebd700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec150bb0 con 0x7f06ec154150 2023-11-15T01:37:22.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06e9d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06ec0ab1a0 0x7f06ec151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06e9d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06ec0ab1a0 0x7f06ec151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35120/0 (socket says 172.21.15.1:35120) 2023-11-15T01:37:22.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06e9d9b700 1 -- 172.21.15.1:0/570737695 learned_addr learned my addr 172.21.15.1:0/570737695 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:22.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06ea59c700 1 --2- 172.21.15.1:0/570737695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06ec0aa060 0x7f06ec147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06ead9d700 1 --2- 172.21.15.1:0/570737695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06ec154150 0x7f06ec14bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06e9d9b700 1 -- 172.21.15.1:0/570737695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06ec154150 msgr2=0x7f06ec14bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06e9d9b700 1 --2- 172.21.15.1:0/570737695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06ec154150 0x7f06ec14bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06e9d9b700 1 -- 172.21.15.1:0/570737695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06ec0aa060 msgr2=0x7f06ec147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:22.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06e9d9b700 1 --2- 172.21.15.1:0/570737695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06ec0aa060 0x7f06ec147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:22.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06e9d9b700 1 -- 172.21.15.1:0/570737695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e4009ae0 con 0x7f06ec0ab1a0 2023-11-15T01:37:22.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.891+0000 7f06e9d9b700 1 --2- 172.21.15.1:0/570737695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06ec0ab1a0 0x7f06ec151690 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f06d400d890 tx=0x7f06d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:22.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.892+0000 7f06e27fc700 1 -- 172.21.15.1:0/570737695 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4011590 con 0x7f06ec0ab1a0 2023-11-15T01:37:22.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.892+0000 7f06e27fc700 1 -- 172.21.15.1:0/570737695 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d40116f0 con 0x7f06ec0ab1a0 2023-11-15T01:37:22.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.892+0000 7f06f0ebd700 1 -- 172.21.15.1:0/570737695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ec150e90 con 0x7f06ec0ab1a0 2023-11-15T01:37:22.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.892+0000 7f06e27fc700 1 -- 172.21.15.1:0/570737695 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4011a70 con 0x7f06ec0ab1a0 2023-11-15T01:37:22.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.892+0000 7f06f0ebd700 1 -- 172.21.15.1:0/570737695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec1483c0 con 0x7f06ec0ab1a0 2023-11-15T01:37:22.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.893+0000 7f06f0ebd700 1 -- 172.21.15.1:0/570737695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ec151330 con 0x7f06ec0ab1a0 2023-11-15T01:37:22.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.893+0000 7f06e27fc700 1 -- 172.21.15.1:0/570737695 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f06d401c460 con 0x7f06ec0ab1a0 2023-11-15T01:37:22.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.893+0000 7f06e27fc700 1 --2- 172.21.15.1:0/570737695 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f06cc05f270 0x7f06cc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:22.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.893+0000 7f06e27fc700 1 -- 172.21.15.1:0/570737695 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5693+0+0 (secure 0 0 0) 0x7f06d4079fd0 con 0x7f06ec0ab1a0 2023-11-15T01:37:22.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.894+0000 7f06ea59c700 1 --2- 172.21.15.1:0/570737695 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f06cc05f270 0x7f06cc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:22.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.894+0000 7f06ea59c700 1 --2- 172.21.15.1:0/570737695 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f06cc05f270 0x7f06cc061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f06e4009930 tx=0x7f06e4009840).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:22.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:22.897+0000 7f06e27fc700 1 -- 172.21.15.1:0/570737695 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f06d404b270 con 0x7f06ec0ab1a0 2023-11-15T01:37:23.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.072+0000 7f06f0ebd700 1 -- 172.21.15.1:0/570737695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f06ec06c7e0 con 0x7f06ec0ab1a0 2023-11-15T01:37:23.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.073+0000 7f06e27fc700 1 -- 172.21.15.1:0/570737695 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v105) v1 ==== 84+0+143 (secure 0 0 0) 0x7f06d4011e60 con 0x7f06ec0ab1a0 2023-11-15T01:37:23.074 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:23.074 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T01:37:23.074 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:23.074 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2023-11-15T01:37:23.075 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "device_health_metrics" 2023-11-15T01:37:23.075 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:37:23.075 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:23.075 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 2, 2023-11-15T01:37:23.075 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "rbd" 2023-11-15T01:37:23.076 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:23.076 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T01:37:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.075+0000 7f06f0ebd700 1 -- 172.21.15.1:0/570737695 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f06cc05f270 msgr2=0x7f06cc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.075+0000 7f06f0ebd700 1 --2- 172.21.15.1:0/570737695 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f06cc05f270 0x7f06cc061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f06e4009930 tx=0x7f06e4009840).stop 2023-11-15T01:37:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.075+0000 7f06f0ebd700 1 -- 172.21.15.1:0/570737695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06ec0ab1a0 msgr2=0x7f06ec151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.075+0000 7f06f0ebd700 1 --2- 172.21.15.1:0/570737695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06ec0ab1a0 0x7f06ec151690 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f06d400d890 tx=0x7f06d4008040).stop 2023-11-15T01:37:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.075+0000 7f06f0ebd700 1 -- 172.21.15.1:0/570737695 shutdown_connections 2023-11-15T01:37:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.075+0000 7f06f0ebd700 1 --2- 172.21.15.1:0/570737695 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f06cc05f270 0x7f06cc061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.075+0000 7f06f0ebd700 1 --2- 172.21.15.1:0/570737695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06ec154150 0x7f06ec14bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.075+0000 7f06f0ebd700 1 --2- 172.21.15.1:0/570737695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06ec0aa060 0x7f06ec147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.075+0000 7f06f0ebd700 1 --2- 172.21.15.1:0/570737695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06ec0ab1a0 0x7f06ec151690 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.075+0000 7f06f0ebd700 1 -- 172.21.15.1:0/570737695 >> 172.21.15.1:0/570737695 conn(0x7f06ec064aa0 msgr2=0x7f06ec0ad530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.075+0000 7f06f0ebd700 1 -- 172.21.15.1:0/570737695 shutdown_connections 2023-11-15T01:37:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.075+0000 7f06f0ebd700 1 -- 172.21.15.1:0/570737695 wait complete. 2023-11-15T01:37:23.087 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-15T01:37:23.088 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-15T01:37:23.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.211+0000 7f6cc412b700 1 Processor -- start 2023-11-15T01:37:23.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.211+0000 7f6cc412b700 1 -- start start 2023-11-15T01:37:23.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc412b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6cbc0aa750 0x7f6cbc0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:23.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc412b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cbc14b730 0x7f6cbc154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc412b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cbc1580d0 con 0x7f6cbc14b350 2023-11-15T01:37:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc412b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cbc155000 con 0x7f6cbc0aa750 2023-11-15T01:37:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc412b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc1552e0 con 0x7f6cbc14b730 2023-11-15T01:37:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc1ec7700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6cbc14b350 0x7f6cbc0aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57478/0 (socket says 172.21.15.1:57478) 2023-11-15T01:37:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc1ec7700 1 -- 172.21.15.1:0/91321329 learned_addr learned my addr 172.21.15.1:0/91321329 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc16c6700 1 --2- 172.21.15.1:0/91321329 >> v2:172.21.15.141:3300/0 conn(0x7f6cbc0aa750 0x7f6cbc0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc26c8700 1 --2- 172.21.15.1:0/91321329 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cbc14b730 0x7f6cbc154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc0ec5700 1 -- 172.21.15.1:0/91321329 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048650774 0 0) 0x7f6cbc1580d0 con 0x7f6cbc14b350 2023-11-15T01:37:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc0ec5700 1 -- 172.21.15.1:0/91321329 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ca40033f0 con 0x7f6cbc14b350 2023-11-15T01:37:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc26c8700 1 -- 172.21.15.1:0/91321329 >> v2:172.21.15.141:3300/0 conn(0x7f6cbc0aa750 msgr2=0x7f6cbc0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc26c8700 1 --2- 172.21.15.1:0/91321329 >> v2:172.21.15.141:3300/0 conn(0x7f6cbc0aa750 0x7f6cbc0c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc26c8700 1 -- 172.21.15.1:0/91321329 >> v1:172.21.15.1:6789/0 conn(0x7f6cbc14b350 legacy=0x7f6cbc0aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc26c8700 1 -- 172.21.15.1:0/91321329 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc1555c0 con 0x7f6cbc14b730 2023-11-15T01:37:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.212+0000 7f6cc26c8700 1 --2- 172.21.15.1:0/91321329 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cbc14b730 0x7f6cbc154a10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f6cac009e60 tx=0x7f6cac009780).ready entity=mon.2 client_cookie=ef18148e6f80b15 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.213+0000 7f6cc0ec5700 1 -- 172.21.15.1:0/91321329 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac00e070 con 0x7f6cbc14b730 2023-11-15T01:37:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.213+0000 7f6cc0ec5700 1 -- 172.21.15.1:0/91321329 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cac00bab0 con 0x7f6cbc14b730 2023-11-15T01:37:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.213+0000 7f6cc0ec5700 1 -- 172.21.15.1:0/91321329 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac00be30 con 0x7f6cbc14b730 2023-11-15T01:37:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.213+0000 7f6cc412b700 1 -- 172.21.15.1:0/91321329 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cbc14b730 msgr2=0x7f6cbc154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.213+0000 7f6cc412b700 1 --2- 172.21.15.1:0/91321329 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cbc14b730 0x7f6cbc154a10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f6cac009e60 tx=0x7f6cac009780).stop 2023-11-15T01:37:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.213+0000 7f6cc412b700 1 -- 172.21.15.1:0/91321329 shutdown_connections 2023-11-15T01:37:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.213+0000 7f6cc412b700 1 --2- 172.21.15.1:0/91321329 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cbc14b730 0x7f6cbc154a10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:23.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.213+0000 7f6cc412b700 1 --2- 172.21.15.1:0/91321329 >> v2:172.21.15.141:3300/0 conn(0x7f6cbc0aa750 0x7f6cbc0c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:23.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.213+0000 7f6cc412b700 1 -- 172.21.15.1:0/91321329 >> 172.21.15.1:0/91321329 conn(0x7f6cbc069ee0 msgr2=0x7f6cbc06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:23.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.213+0000 7f6cc412b700 1 -- 172.21.15.1:0/91321329 shutdown_connections 2023-11-15T01:37:23.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.213+0000 7f6cc412b700 1 -- 172.21.15.1:0/91321329 wait complete. 2023-11-15T01:37:23.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.214+0000 7f6cc412b700 1 Processor -- start 2023-11-15T01:37:23.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.214+0000 7f6cc412b700 1 -- start start 2023-11-15T01:37:23.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.215+0000 7f6cc412b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6cbc0aa750 0x7f6cbc148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:23.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.215+0000 7f6cc412b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cbc14b350 0x7f6cbc15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:23.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.215+0000 7f6cc412b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cbc14b730 0x7f6cbc0ac350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:23.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.215+0000 7f6cc412b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc0aef50 con 0x7f6cbc14b350 2023-11-15T01:37:23.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.215+0000 7f6cc412b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc0af230 con 0x7f6cbc0aa750 2023-11-15T01:37:23.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.215+0000 7f6cc412b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc0af510 con 0x7f6cbc14b730 2023-11-15T01:37:23.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.215+0000 7f6cc16c6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cbc14b350 0x7f6cbc15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:23.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.215+0000 7f6cc16c6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cbc14b350 0x7f6cbc15acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35122/0 (socket says 172.21.15.1:35122) 2023-11-15T01:37:23.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.215+0000 7f6cc16c6700 1 -- 172.21.15.1:0/3149753587 learned_addr learned my addr 172.21.15.1:0/3149753587 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:23.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.215+0000 7f6cc1ec7700 1 --2- 172.21.15.1:0/3149753587 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6cbc0aa750 0x7f6cbc148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:23.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.215+0000 7f6cc26c8700 1 --2- 172.21.15.1:0/3149753587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cbc14b730 0x7f6cbc0ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:23.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.216+0000 7f6cc16c6700 1 -- 172.21.15.1:0/3149753587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cbc14b730 msgr2=0x7f6cbc0ac350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:23.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.216+0000 7f6cc16c6700 1 --2- 172.21.15.1:0/3149753587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cbc14b730 0x7f6cbc0ac350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:23.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.216+0000 7f6cc16c6700 1 -- 172.21.15.1:0/3149753587 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6cbc0aa750 msgr2=0x7f6cbc148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:23.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.216+0000 7f6cc16c6700 1 --2- 172.21.15.1:0/3149753587 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6cbc0aa750 0x7f6cbc148e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:23.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.216+0000 7f6cc16c6700 1 -- 172.21.15.1:0/3149753587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac009a20 con 0x7f6cbc14b350 2023-11-15T01:37:23.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.216+0000 7f6cc16c6700 1 --2- 172.21.15.1:0/3149753587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cbc14b350 0x7f6cbc15acc0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f6cb000e900 tx=0x7f6cb0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:23.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.216+0000 7f6cb9ffb700 1 -- 172.21.15.1:0/3149753587 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0012600 con 0x7f6cbc14b350 2023-11-15T01:37:23.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.216+0000 7f6cb9ffb700 1 -- 172.21.15.1:0/3149753587 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb0012760 con 0x7f6cbc14b350 2023-11-15T01:37:23.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.216+0000 7f6cc412b700 1 -- 172.21.15.1:0/3149753587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cbc0af7f0 con 0x7f6cbc14b350 2023-11-15T01:37:23.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.216+0000 7f6cb9ffb700 1 -- 172.21.15.1:0/3149753587 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0012ae0 con 0x7f6cbc14b350 2023-11-15T01:37:23.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.216+0000 7f6cc412b700 1 -- 172.21.15.1:0/3149753587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cbc149360 con 0x7f6cbc14b350 2023-11-15T01:37:23.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.217+0000 7f6cc412b700 1 -- 172.21.15.1:0/3149753587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cbc0afe40 con 0x7f6cbc14b350 2023-11-15T01:37:23.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.217+0000 7f6cb9ffb700 1 -- 172.21.15.1:0/3149753587 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6cb001b400 con 0x7f6cbc14b350 2023-11-15T01:37:23.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.218+0000 7f6cb9ffb700 1 --2- 172.21.15.1:0/3149753587 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ca805f270 0x7f6ca8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:23.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.218+0000 7f6cb9ffb700 1 -- 172.21.15.1:0/3149753587 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5693+0+0 (secure 0 0 0) 0x7f6cb007a620 con 0x7f6cbc14b350 2023-11-15T01:37:23.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.218+0000 7f6cc1ec7700 1 --2- 172.21.15.1:0/3149753587 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ca805f270 0x7f6ca8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:23.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.219+0000 7f6cc1ec7700 1 --2- 172.21.15.1:0/3149753587 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ca805f270 0x7f6ca8061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6cb4005750 tx=0x7f6cb4009040).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:23.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.222+0000 7f6cb9ffb700 1 -- 172.21.15.1:0/3149753587 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6cb004b8c0 con 0x7f6cbc14b350 2023-11-15T01:37:23.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:23.396+0000 7f6cc412b700 1 -- 172.21.15.1:0/3149753587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f6cbc0c61c0 con 0x7f6cbc14b350 2023-11-15T01:37:24.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.390+0000 7f6cb9ffb700 1 -- 172.21.15.1:0/3149753587 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v106) v1 ==== 152+0+0 (secure 0 0 0) 0x7f6cb0016020 con 0x7f6cbc14b350 2023-11-15T01:37:24.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.396+0000 7f6cc412b700 1 -- 172.21.15.1:0/3149753587 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ca805f270 msgr2=0x7f6ca8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:24.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.396+0000 7f6cc412b700 1 --2- 172.21.15.1:0/3149753587 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ca805f270 0x7f6ca8061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6cb4005750 tx=0x7f6cb4009040).stop 2023-11-15T01:37:24.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.396+0000 7f6cc412b700 1 -- 172.21.15.1:0/3149753587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cbc14b350 msgr2=0x7f6cbc15acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:24.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.396+0000 7f6cc412b700 1 --2- 172.21.15.1:0/3149753587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cbc14b350 0x7f6cbc15acc0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f6cb000e900 tx=0x7f6cb0009060).stop 2023-11-15T01:37:24.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.397+0000 7f6cc412b700 1 -- 172.21.15.1:0/3149753587 shutdown_connections 2023-11-15T01:37:24.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.397+0000 7f6cc412b700 1 --2- 172.21.15.1:0/3149753587 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ca805f270 0x7f6ca8061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:24.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.397+0000 7f6cc412b700 1 --2- 172.21.15.1:0/3149753587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6cbc14b730 0x7f6cbc0ac350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:24.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.397+0000 7f6cc412b700 1 --2- 172.21.15.1:0/3149753587 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6cbc0aa750 0x7f6cbc148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:24.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.397+0000 7f6cc412b700 1 --2- 172.21.15.1:0/3149753587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cbc14b350 0x7f6cbc15acc0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:24.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.397+0000 7f6cc412b700 1 -- 172.21.15.1:0/3149753587 >> 172.21.15.1:0/3149753587 conn(0x7f6cbc069ee0 msgr2=0x7f6cbc06a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:24.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.397+0000 7f6cc412b700 1 -- 172.21.15.1:0/3149753587 shutdown_connections 2023-11-15T01:37:24.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.397+0000 7f6cc412b700 1 -- 172.21.15.1:0/3149753587 wait complete. 2023-11-15T01:37:24.401 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2023-11-15T01:37:24.415 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-15T01:37:24.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.545+0000 7fa8bb614700 1 Processor -- start 2023-11-15T01:37:24.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.546+0000 7fa8bb614700 1 -- start start 2023-11-15T01:37:24.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.546+0000 7fa8bb614700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b4154480 0x7fa8b40c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:24.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.546+0000 7fa8bb614700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa8b40c6430 0x7fa8b40aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:24.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8bb614700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b40ca050 con 0x7fa8b41540a0 2023-11-15T01:37:24.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8bb614700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b40c68c0 con 0x7fa8b40c6430 2023-11-15T01:37:24.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8bb614700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40c9440 con 0x7fa8b4154480 2023-11-15T01:37:24.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b93b0700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa8b41540a0 0x7fa8b40ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57486/0 (socket says 172.21.15.1:57486) 2023-11-15T01:37:24.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b93b0700 1 -- 172.21.15.1:0/3027771417 learned_addr learned my addr 172.21.15.1:0/3027771417 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:24.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b9bb1700 1 --2- 172.21.15.1:0/3027771417 >> v2:172.21.15.141:3300/0 conn(0x7fa8b40c6430 0x7fa8b40aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:24.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b8baf700 1 --2- 172.21.15.1:0/3027771417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b4154480 0x7fa8b40c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:24.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 -- 172.21.15.1:0/3027771417 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898415493 0 0) 0x7fa8b40ca050 con 0x7fa8b41540a0 2023-11-15T01:37:24.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 -- 172.21.15.1:0/3027771417 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa89c0033f0 con 0x7fa8b41540a0 2023-11-15T01:37:24.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 -- 172.21.15.1:0/3027771417 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1374058024 0 0) 0x7fa89c0033f0 con 0x7fa8b41540a0 2023-11-15T01:37:24.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 -- 172.21.15.1:0/3027771417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b4154480 msgr2=0x7fa8b40c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:24.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 --2- 172.21.15.1:0/3027771417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b4154480 0x7fa8b40c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:24.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 -- 172.21.15.1:0/3027771417 >> v2:172.21.15.141:3300/0 conn(0x7fa8b40c6430 msgr2=0x7fa8b40aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:24.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 --2- 172.21.15.1:0/3027771417 >> v2:172.21.15.141:3300/0 conn(0x7fa8b40c6430 0x7fa8b40aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:24.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 -- 172.21.15.1:0/3027771417 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b40c9720 con 0x7fa8b41540a0 2023-11-15T01:37:24.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 -- 172.21.15.1:0/3027771417 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fa8a40017f0 con 0x7fa8b41540a0 2023-11-15T01:37:24.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 -- 172.21.15.1:0/3027771417 >> v1:172.21.15.1:6789/0 conn(0x7fa8b41540a0 legacy=0x7fa8b40ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:24.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 --2- 172.21.15.1:0/3027771417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa89c0038e0 0x7fa89c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:24.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 --2- 172.21.15.1:0/3027771417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa89c004690 0x7fa89c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:24.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 --2- 172.21.15.1:0/3027771417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b4154480 0x7fa89c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:24.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 -- 172.21.15.1:0/3027771417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40c68c0 con 0x7fa89c0038e0 2023-11-15T01:37:24.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 -- 172.21.15.1:0/3027771417 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40c9440 con 0x7fa89c004690 2023-11-15T01:37:24.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b3fff700 1 -- 172.21.15.1:0/3027771417 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c00b8e0 con 0x7fa8b4154480 2023-11-15T01:37:24.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b93b0700 1 --2- 172.21.15.1:0/3027771417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa89c0038e0 0x7fa89c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:24.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.547+0000 7fa8b8baf700 1 --2- 172.21.15.1:0/3027771417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa89c004690 0x7fa89c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:24.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.548+0000 7fa8b9bb1700 1 --2- 172.21.15.1:0/3027771417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b4154480 0x7fa89c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:24.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.548+0000 7fa8b93b0700 1 -- 172.21.15.1:0/3027771417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b4154480 msgr2=0x7fa89c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:24.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.548+0000 7fa8b93b0700 1 --2- 172.21.15.1:0/3027771417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b4154480 0x7fa89c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:24.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.548+0000 7fa8b93b0700 1 -- 172.21.15.1:0/3027771417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa89c004690 msgr2=0x7fa89c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:24.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.548+0000 7fa8b93b0700 1 --2- 172.21.15.1:0/3027771417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa89c004690 0x7fa89c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:24.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.548+0000 7fa8b93b0700 1 -- 172.21.15.1:0/3027771417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c0033f0 con 0x7fa89c0038e0 2023-11-15T01:37:24.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.548+0000 7fa8b93b0700 1 --2- 172.21.15.1:0/3027771417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa89c0038e0 0x7fa89c003d00 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7fa8a400c530 tx=0x7fa8a4001d90).ready entity=mon.0 client_cookie=b91f25c97359d3d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:24.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.548+0000 7fa8b3fff700 1 -- 172.21.15.1:0/3027771417 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a400ce60 con 0x7fa89c0038e0 2023-11-15T01:37:24.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.548+0000 7fa8b3fff700 1 -- 172.21.15.1:0/3027771417 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a4005b20 con 0x7fa89c0038e0 2023-11-15T01:37:24.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.548+0000 7fa8b3fff700 1 -- 172.21.15.1:0/3027771417 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a40070d0 con 0x7fa89c0038e0 2023-11-15T01:37:24.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.548+0000 7fa8bb614700 1 -- 172.21.15.1:0/3027771417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa89c0038e0 msgr2=0x7fa89c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:24.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.548+0000 7fa8bb614700 1 --2- 172.21.15.1:0/3027771417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa89c0038e0 0x7fa89c003d00 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7fa8a400c530 tx=0x7fa8a4001d90).stop 2023-11-15T01:37:24.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.549+0000 7fa8b9bb1700 1 -- 172.21.15.1:0/3027771417 reap_dead start 2023-11-15T01:37:24.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.549+0000 7fa8bb614700 1 -- 172.21.15.1:0/3027771417 shutdown_connections 2023-11-15T01:37:24.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.549+0000 7fa8bb614700 1 -- 172.21.15.1:0/3027771417 >> 172.21.15.1:0/3027771417 conn(0x7fa8b4064a70 msgr2=0x7fa8b4064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:24.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.549+0000 7fa8bb614700 1 -- 172.21.15.1:0/3027771417 shutdown_connections 2023-11-15T01:37:24.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.549+0000 7fa8bb614700 1 -- 172.21.15.1:0/3027771417 wait complete. 2023-11-15T01:37:24.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.550+0000 7fa8bb614700 1 Processor -- start 2023-11-15T01:37:24.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.550+0000 7fa8bb614700 1 -- start start 2023-11-15T01:37:24.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8bb614700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa89c0038e0 0x7fa8b413c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:24.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8bb614700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8b40ae080 0x7fa8b40ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:24.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8bb614700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b41514b0 0x7fa8b4151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:24.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8bb614700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40c2bc0 con 0x7fa89c0038e0 2023-11-15T01:37:24.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8bb614700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40c3700 con 0x7fa8b40ae080 2023-11-15T01:37:24.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8bb614700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40ae9f0 con 0x7fa8b41514b0 2023-11-15T01:37:24.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8b93b0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa89c0038e0 0x7fa8b413c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:24.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8b93b0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa89c0038e0 0x7fa8b413c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35134/0 (socket says 172.21.15.1:35134) 2023-11-15T01:37:24.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8b93b0700 1 -- 172.21.15.1:0/3200135912 learned_addr learned my addr 172.21.15.1:0/3200135912 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:24.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8b9bb1700 1 --2- 172.21.15.1:0/3200135912 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b41514b0 0x7fa8b4151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:24.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8b8baf700 1 --2- 172.21.15.1:0/3200135912 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8b40ae080 0x7fa8b40ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:24.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8b93b0700 1 -- 172.21.15.1:0/3200135912 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b41514b0 msgr2=0x7fa8b4151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:24.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8b93b0700 1 --2- 172.21.15.1:0/3200135912 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b41514b0 0x7fa8b4151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:24.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8b93b0700 1 -- 172.21.15.1:0/3200135912 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8b40ae080 msgr2=0x7fa8b40ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:24.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8b93b0700 1 --2- 172.21.15.1:0/3200135912 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8b40ae080 0x7fa8b40ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:24.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8b93b0700 1 -- 172.21.15.1:0/3200135912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b40c2dd0 con 0x7fa89c0038e0 2023-11-15T01:37:24.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8b93b0700 1 --2- 172.21.15.1:0/3200135912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa89c0038e0 0x7fa8b413c7e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7fa8a4005fc0 tx=0x7fa8a4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:24.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.551+0000 7fa8b17fa700 1 -- 172.21.15.1:0/3200135912 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4004a30 con 0x7fa89c0038e0 2023-11-15T01:37:24.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.552+0000 7fa8b17fa700 1 -- 172.21.15.1:0/3200135912 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a4004b90 con 0x7fa89c0038e0 2023-11-15T01:37:24.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.552+0000 7fa8bb614700 1 -- 172.21.15.1:0/3200135912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b40c30b0 con 0x7fa89c0038e0 2023-11-15T01:37:24.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.552+0000 7fa8b17fa700 1 -- 172.21.15.1:0/3200135912 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4007440 con 0x7fa89c0038e0 2023-11-15T01:37:24.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.552+0000 7fa8bb614700 1 -- 172.21.15.1:0/3200135912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b4151e20 con 0x7fa89c0038e0 2023-11-15T01:37:24.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.553+0000 7fa8bb614700 1 -- 172.21.15.1:0/3200135912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b406c7e0 con 0x7fa89c0038e0 2023-11-15T01:37:24.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.553+0000 7fa8b17fa700 1 -- 172.21.15.1:0/3200135912 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa8a40077f0 con 0x7fa89c0038e0 2023-11-15T01:37:24.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.554+0000 7fa8b17fa700 1 --2- 172.21.15.1:0/3200135912 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa8a005f240 0x7fa8a0061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:24.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.554+0000 7fa8b17fa700 1 -- 172.21.15.1:0/3200135912 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fa8a407b7a0 con 0x7fa89c0038e0 2023-11-15T01:37:24.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.554+0000 7fa8b8baf700 1 --2- 172.21.15.1:0/3200135912 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa8a005f240 0x7fa8a0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:24.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.554+0000 7fa8b8baf700 1 --2- 172.21.15.1:0/3200135912 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa8a005f240 0x7fa8a0061700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fa8b41537a0 tx=0x7fa8a8009060).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:24.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.558+0000 7fa8b17fa700 1 -- 172.21.15.1:0/3200135912 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa8a404c9e0 con 0x7fa89c0038e0 2023-11-15T01:37:24.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:24.729+0000 7fa8bb614700 1 -- 172.21.15.1:0/3200135912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa8b40c9a00 con 0x7fa89c0038e0 2023-11-15T01:37:25.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.393+0000 7fa8b17fa700 1 -- 172.21.15.1:0/3200135912 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v107) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa8a4050000 con 0x7fa89c0038e0 2023-11-15T01:37:25.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.397+0000 7fa8bb614700 1 -- 172.21.15.1:0/3200135912 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa8a005f240 msgr2=0x7fa8a0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:25.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.397+0000 7fa8bb614700 1 --2- 172.21.15.1:0/3200135912 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa8a005f240 0x7fa8a0061700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fa8b41537a0 tx=0x7fa8a8009060).stop 2023-11-15T01:37:25.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.397+0000 7fa8bb614700 1 -- 172.21.15.1:0/3200135912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa89c0038e0 msgr2=0x7fa8b413c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:25.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.397+0000 7fa8bb614700 1 --2- 172.21.15.1:0/3200135912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa89c0038e0 0x7fa8b413c7e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7fa8a4005fc0 tx=0x7fa8a4015000).stop 2023-11-15T01:37:25.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.397+0000 7fa8bb614700 1 -- 172.21.15.1:0/3200135912 shutdown_connections 2023-11-15T01:37:25.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.397+0000 7fa8bb614700 1 --2- 172.21.15.1:0/3200135912 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa8a005f240 0x7fa8a0061700 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.397+0000 7fa8bb614700 1 --2- 172.21.15.1:0/3200135912 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b41514b0 0x7fa8b4151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.397+0000 7fa8bb614700 1 --2- 172.21.15.1:0/3200135912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa89c0038e0 0x7fa8b413c7e0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.397+0000 7fa8bb614700 1 --2- 172.21.15.1:0/3200135912 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8b40ae080 0x7fa8b40ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.397+0000 7fa8bb614700 1 -- 172.21.15.1:0/3200135912 >> 172.21.15.1:0/3200135912 conn(0x7fa8b4064a70 msgr2=0x7fa8b4063730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:25.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.398+0000 7fa8bb614700 1 -- 172.21.15.1:0/3200135912 shutdown_connections 2023-11-15T01:37:25.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.401+0000 7fa8bb614700 1 -- 172.21.15.1:0/3200135912 wait complete. 2023-11-15T01:37:25.413 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2023-11-15T01:37:25.432 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-15T01:37:25.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.553+0000 7f2f5dfc8700 1 Processor -- start 2023-11-15T01:37:25.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.554+0000 7f2f5dfc8700 1 -- start start 2023-11-15T01:37:25.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.554+0000 7f2f5dfc8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f58066f80 0x7f2f58137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:25.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.554+0000 7f2f5dfc8700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2f581588e0 0x7f2f5814e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:25.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.554+0000 7f2f5dfc8700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f58154ce0 con 0x7f2f58137030 2023-11-15T01:37:25.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.554+0000 7f2f5dfc8700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f58137900 con 0x7f2f581588e0 2023-11-15T01:37:25.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.554+0000 7f2f5dfc8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58154fc0 con 0x7f2f58066f80 2023-11-15T01:37:25.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.555+0000 7f2f57fff700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2f581588e0 0x7f2f5814e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:25.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.555+0000 7f2f56ffd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f58066f80 0x7f2f58137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:25.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.555+0000 7f2f57fff700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2f581588e0 0x7f2f5814e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:56346/0 (socket says 172.21.15.1:56346) 2023-11-15T01:37:25.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.555+0000 7f2f57fff700 1 -- 172.21.15.1:0/3857324196 learned_addr learned my addr 172.21.15.1:0/3857324196 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:25.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.555+0000 7f2f56ffd700 1 --2- 172.21.15.1:0/3857324196 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f58066f80 0x7f2f58137410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:34428/0 (socket says 172.21.15.1:34428) 2023-11-15T01:37:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.555+0000 7f2f577fe700 1 --1- 172.21.15.1:0/3857324196 >> v1:172.21.15.141:6789/0 conn(0x7f2f58137030 0x7f2f58066870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:44130/0 (socket says 172.21.15.1:44130) 2023-11-15T01:37:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.555+0000 7f2f56ffd700 1 -- 172.21.15.1:0/3857324196 >> v2:172.21.15.141:3300/0 conn(0x7f2f581588e0 msgr2=0x7f2f5814e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.555+0000 7f2f56ffd700 1 --2- 172.21.15.1:0/3857324196 >> v2:172.21.15.141:3300/0 conn(0x7f2f581588e0 0x7f2f5814e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.555+0000 7f2f56ffd700 1 -- 172.21.15.1:0/3857324196 >> v1:172.21.15.141:6789/0 conn(0x7f2f58137030 legacy=0x7f2f58066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.555+0000 7f2f567fc700 1 -- 172.21.15.1:0/3857324196 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297422660 0 0) 0x7f2f58154ce0 con 0x7f2f58137030 2023-11-15T01:37:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.555+0000 7f2f56ffd700 1 -- 172.21.15.1:0/3857324196 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f581552a0 con 0x7f2f58066f80 2023-11-15T01:37:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.555+0000 7f2f57fff700 1 --2- 172.21.15.1:0/3857324196 >> v2:172.21.15.141:3300/0 conn(0x7f2f581588e0 0x7f2f5814e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.555+0000 7f2f56ffd700 1 --2- 172.21.15.1:0/3857324196 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f58066f80 0x7f2f58137410 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f2f4c009760 tx=0x7f2f4c009060).ready entity=mon.2 client_cookie=3dee6eb1699196a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.555+0000 7f2f567fc700 1 -- 172.21.15.1:0/3857324196 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c00f510 con 0x7f2f58066f80 2023-11-15T01:37:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.556+0000 7f2f567fc700 1 -- 172.21.15.1:0/3857324196 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4c00f670 con 0x7f2f58066f80 2023-11-15T01:37:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.556+0000 7f2f567fc700 1 -- 172.21.15.1:0/3857324196 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c00f9f0 con 0x7f2f58066f80 2023-11-15T01:37:25.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.556+0000 7f2f5dfc8700 1 -- 172.21.15.1:0/3857324196 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f58066f80 msgr2=0x7f2f58137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:25.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.556+0000 7f2f5dfc8700 1 --2- 172.21.15.1:0/3857324196 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f58066f80 0x7f2f58137410 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f2f4c009760 tx=0x7f2f4c009060).stop 2023-11-15T01:37:25.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.556+0000 7f2f5dfc8700 1 -- 172.21.15.1:0/3857324196 shutdown_connections 2023-11-15T01:37:25.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.556+0000 7f2f5dfc8700 1 --2- 172.21.15.1:0/3857324196 >> v2:172.21.15.141:3300/0 conn(0x7f2f581588e0 0x7f2f5814e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.556+0000 7f2f5dfc8700 1 --2- 172.21.15.1:0/3857324196 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f58066f80 0x7f2f58137410 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.556+0000 7f2f5dfc8700 1 -- 172.21.15.1:0/3857324196 >> 172.21.15.1:0/3857324196 conn(0x7f2f58063280 msgr2=0x7f2f580c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:25.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.556+0000 7f2f5dfc8700 1 -- 172.21.15.1:0/3857324196 shutdown_connections 2023-11-15T01:37:25.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.556+0000 7f2f5dfc8700 1 -- 172.21.15.1:0/3857324196 wait complete. 2023-11-15T01:37:25.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.557+0000 7f2f5dfc8700 1 Processor -- start 2023-11-15T01:37:25.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.557+0000 7f2f5dfc8700 1 -- start start 2023-11-15T01:37:25.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.558+0000 7f2f5dfc8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f58066f80 0x7f2f580ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:25.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.558+0000 7f2f5dfc8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f58137030 0x7f2f580ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:25.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.558+0000 7f2f5dfc8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f581588e0 0x7f2f58164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:25.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.558+0000 7f2f5dfc8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58151540 con 0x7f2f58066f80 2023-11-15T01:37:25.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.558+0000 7f2f5dfc8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580ae6f0 con 0x7f2f581588e0 2023-11-15T01:37:25.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.558+0000 7f2f5dfc8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f581381a0 con 0x7f2f58137030 2023-11-15T01:37:25.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.558+0000 7f2f577fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f58066f80 0x7f2f580ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:25.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.558+0000 7f2f577fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f58066f80 0x7f2f580ad990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35150/0 (socket says 172.21.15.1:35150) 2023-11-15T01:37:25.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.558+0000 7f2f577fe700 1 -- 172.21.15.1:0/1851160185 learned_addr learned my addr 172.21.15.1:0/1851160185 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:25.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.558+0000 7f2f57fff700 1 --2- 172.21.15.1:0/1851160185 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f581588e0 0x7f2f58164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:25.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.558+0000 7f2f56ffd700 1 --2- 172.21.15.1:0/1851160185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f58137030 0x7f2f580ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:25.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.559+0000 7f2f577fe700 1 -- 172.21.15.1:0/1851160185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f58137030 msgr2=0x7f2f580ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:25.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.559+0000 7f2f577fe700 1 --2- 172.21.15.1:0/1851160185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f58137030 0x7f2f580ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.559+0000 7f2f577fe700 1 -- 172.21.15.1:0/1851160185 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f581588e0 msgr2=0x7f2f58164ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:25.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.559+0000 7f2f577fe700 1 --2- 172.21.15.1:0/1851160185 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f581588e0 0x7f2f58164ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.559+0000 7f2f577fe700 1 -- 172.21.15.1:0/1851160185 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f50009ae0 con 0x7f2f58066f80 2023-11-15T01:37:25.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.559+0000 7f2f577fe700 1 --2- 172.21.15.1:0/1851160185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f58066f80 0x7f2f580ad990 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f2f4800c560 tx=0x7f2f48007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:25.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.559+0000 7f2f3f7fe700 1 -- 172.21.15.1:0/1851160185 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480072e0 con 0x7f2f58066f80 2023-11-15T01:37:25.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.559+0000 7f2f3f7fe700 1 -- 172.21.15.1:0/1851160185 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f48007440 con 0x7f2f58066f80 2023-11-15T01:37:25.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.559+0000 7f2f5dfc8700 1 -- 172.21.15.1:0/1851160185 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c0092a0 con 0x7f2f58066f80 2023-11-15T01:37:25.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.559+0000 7f2f3f7fe700 1 -- 172.21.15.1:0/1851160185 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480058f0 con 0x7f2f58066f80 2023-11-15T01:37:25.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.559+0000 7f2f5dfc8700 1 -- 172.21.15.1:0/1851160185 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f58138760 con 0x7f2f58066f80 2023-11-15T01:37:25.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.560+0000 7f2f5dfc8700 1 -- 172.21.15.1:0/1851160185 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5806c7e0 con 0x7f2f58066f80 2023-11-15T01:37:25.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.560+0000 7f2f3f7fe700 1 -- 172.21.15.1:0/1851160185 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2f48005ce0 con 0x7f2f58066f80 2023-11-15T01:37:25.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.561+0000 7f2f3f7fe700 1 --2- 172.21.15.1:0/1851160185 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2f4405f270 0x7f2f44061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:25.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.561+0000 7f2f3f7fe700 1 -- 172.21.15.1:0/1851160185 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f2f48079d40 con 0x7f2f58066f80 2023-11-15T01:37:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.561+0000 7f2f56ffd700 1 --2- 172.21.15.1:0/1851160185 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2f4405f270 0x7f2f44061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.561+0000 7f2f56ffd700 1 --2- 172.21.15.1:0/1851160185 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2f4405f270 0x7f2f44061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2f58067380 tx=0x7f2f4c017000).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.565+0000 7f2f3f7fe700 1 -- 172.21.15.1:0/1851160185 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2f4807d030 con 0x7f2f58066f80 2023-11-15T01:37:25.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.781+0000 7f2f5dfc8700 1 -- 172.21.15.1:0/1851160185 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2f58138da0 con 0x7f2f58066f80 2023-11-15T01:37:25.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.787+0000 7f2f3f7fe700 1 -- 172.21.15.1:0/1851160185 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v43) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2f58138da0 con 0x7f2f58066f80 2023-11-15T01:37:25.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.791+0000 7f2f5dfc8700 1 -- 172.21.15.1:0/1851160185 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2f4405f270 msgr2=0x7f2f44061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:25.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.791+0000 7f2f5dfc8700 1 --2- 172.21.15.1:0/1851160185 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2f4405f270 0x7f2f44061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2f58067380 tx=0x7f2f4c017000).stop 2023-11-15T01:37:25.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.791+0000 7f2f5dfc8700 1 -- 172.21.15.1:0/1851160185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f58066f80 msgr2=0x7f2f580ad990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:25.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.791+0000 7f2f5dfc8700 1 --2- 172.21.15.1:0/1851160185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f58066f80 0x7f2f580ad990 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f2f4800c560 tx=0x7f2f48007c90).stop 2023-11-15T01:37:25.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.793+0000 7f2f5dfc8700 1 -- 172.21.15.1:0/1851160185 shutdown_connections 2023-11-15T01:37:25.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.793+0000 7f2f5dfc8700 1 --2- 172.21.15.1:0/1851160185 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2f4405f270 0x7f2f44061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.793+0000 7f2f5dfc8700 1 --2- 172.21.15.1:0/1851160185 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f581588e0 0x7f2f58164ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.793+0000 7f2f5dfc8700 1 --2- 172.21.15.1:0/1851160185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f58066f80 0x7f2f580ad990 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.793+0000 7f2f5dfc8700 1 --2- 172.21.15.1:0/1851160185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f58137030 0x7f2f580ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.793+0000 7f2f5dfc8700 1 -- 172.21.15.1:0/1851160185 >> 172.21.15.1:0/1851160185 conn(0x7f2f58063280 msgr2=0x7f2f58063aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:25.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.795+0000 7f2f5dfc8700 1 -- 172.21.15.1:0/1851160185 shutdown_connections 2023-11-15T01:37:25.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.797+0000 7f2f5dfc8700 1 -- 172.21.15.1:0/1851160185 wait complete. 2023-11-15T01:37:25.806 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 13 and data pool 14 2023-11-15T01:37:25.822 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:37:25.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.938+0000 7f9720bca700 1 Processor -- start 2023-11-15T01:37:25.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.938+0000 7f9720bca700 1 -- start start 2023-11-15T01:37:25.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.939+0000 7f9720bca700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f971c154300 0x7f971c0c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:25.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.939+0000 7f9720bca700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971c069640 con 0x7f971c1546e0 2023-11-15T01:37:25.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.939+0000 7f9720bca700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971c06bac0 con 0x7f971c158b30 2023-11-15T01:37:25.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.939+0000 7f9720bca700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c06a1e0 con 0x7f971c154300 2023-11-15T01:37:25.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.939+0000 7f971bfff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f971c1546e0 0x7f971c0bc2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57496/0 (socket says 172.21.15.1:57496) 2023-11-15T01:37:25.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.939+0000 7f971bfff700 1 -- 172.21.15.1:0/4270209730 learned_addr learned my addr 172.21.15.1:0/4270209730 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:25.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.939+0000 7f971b7fe700 1 --2- 172.21.15.1:0/4270209730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f971c154300 0x7f971c0c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:25.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.939+0000 7f971a7fc700 1 -- 172.21.15.1:0/4270209730 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956926723 0 0) 0x7f971c069640 con 0x7f971c1546e0 2023-11-15T01:37:25.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.939+0000 7f971a7fc700 1 -- 172.21.15.1:0/4270209730 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97040033f0 con 0x7f971c1546e0 2023-11-15T01:37:25.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.940+0000 7f971a7fc700 1 -- 172.21.15.1:0/4270209730 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13286404 0 0) 0x7f971c06bac0 con 0x7f971c158b30 2023-11-15T01:37:25.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.940+0000 7f971a7fc700 1 -- 172.21.15.1:0/4270209730 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f971c069640 con 0x7f971c158b30 2023-11-15T01:37:25.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.940+0000 7f971b7fe700 1 -- 172.21.15.1:0/4270209730 >> v1:172.21.15.141:6789/0 conn(0x7f971c158b30 legacy=0x7f971c069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:25.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.940+0000 7f971a7fc700 1 -- 172.21.15.1:0/4270209730 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 503505636 0 0) 0x7f97040033f0 con 0x7f971c1546e0 2023-11-15T01:37:25.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.940+0000 7f971b7fe700 1 -- 172.21.15.1:0/4270209730 >> v1:172.21.15.1:6789/0 conn(0x7f971c1546e0 legacy=0x7f971c0bc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:25.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.940+0000 7f971b7fe700 1 -- 172.21.15.1:0/4270209730 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c068d10 con 0x7f971c154300 2023-11-15T01:37:25.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.940+0000 7f971b7fe700 1 --2- 172.21.15.1:0/4270209730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f971c154300 0x7f971c0c45d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f970c0097c0 tx=0x7f970c009060).ready entity=mon.2 client_cookie=b50765371cf12dc7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:25.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.940+0000 7f971a7fc700 1 -- 172.21.15.1:0/4270209730 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97140017f0 con 0x7f971c154300 2023-11-15T01:37:25.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.940+0000 7f971a7fc700 1 -- 172.21.15.1:0/4270209730 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970c011400 con 0x7f971c154300 2023-11-15T01:37:25.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.940+0000 7f971a7fc700 1 -- 172.21.15.1:0/4270209730 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c011780 con 0x7f971c154300 2023-11-15T01:37:25.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.940+0000 7f9720bca700 1 -- 172.21.15.1:0/4270209730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f971c154300 msgr2=0x7f971c0c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:25.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.940+0000 7f9720bca700 1 --2- 172.21.15.1:0/4270209730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f971c154300 0x7f971c0c45d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f970c0097c0 tx=0x7f970c009060).stop 2023-11-15T01:37:25.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.940+0000 7f9720bca700 1 -- 172.21.15.1:0/4270209730 shutdown_connections 2023-11-15T01:37:25.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.940+0000 7f9720bca700 1 --2- 172.21.15.1:0/4270209730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f971c154300 0x7f971c0c45d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.941+0000 7f9720bca700 1 -- 172.21.15.1:0/4270209730 >> 172.21.15.1:0/4270209730 conn(0x7f971c0c7e00 msgr2=0x7f971c0c3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:25.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.941+0000 7f9720bca700 1 -- 172.21.15.1:0/4270209730 shutdown_connections 2023-11-15T01:37:25.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.941+0000 7f9720bca700 1 -- 172.21.15.1:0/4270209730 wait complete. 2023-11-15T01:37:25.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.942+0000 7f9720bca700 1 Processor -- start 2023-11-15T01:37:25.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.942+0000 7f9720bca700 1 -- start start 2023-11-15T01:37:25.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f9720bca700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f971c154300 0x7f971c1500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:25.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f9720bca700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f971c1546e0 0x7f971c15a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:25.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f9720bca700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f971c158b30 0x7f971c15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:25.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f9720bca700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c15ac10 con 0x7f971c158b30 2023-11-15T01:37:25.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f9720bca700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c158240 con 0x7f971c154300 2023-11-15T01:37:25.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f9720bca700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c158520 con 0x7f971c1546e0 2023-11-15T01:37:25.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f971bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f971c158b30 0x7f971c15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:25.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f971bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f971c158b30 0x7f971c15a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35162/0 (socket says 172.21.15.1:35162) 2023-11-15T01:37:25.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f971bfff700 1 -- 172.21.15.1:0/3313429855 learned_addr learned my addr 172.21.15.1:0/3313429855 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:25.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f971b7fe700 1 --2- 172.21.15.1:0/3313429855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f971c154300 0x7f971c1500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:25.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f971affd700 1 --2- 172.21.15.1:0/3313429855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f971c1546e0 0x7f971c15a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:25.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f971bfff700 1 -- 172.21.15.1:0/3313429855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f971c1546e0 msgr2=0x7f971c15a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:25.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f971bfff700 1 --2- 172.21.15.1:0/3313429855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f971c1546e0 0x7f971c15a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f971bfff700 1 -- 172.21.15.1:0/3313429855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f971c154300 msgr2=0x7f971c1500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:25.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f971bfff700 1 --2- 172.21.15.1:0/3313429855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f971c154300 0x7f971c1500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:25.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f971bfff700 1 -- 172.21.15.1:0/3313429855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c0092a0 con 0x7f971c158b30 2023-11-15T01:37:25.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f971affd700 1 --2- 172.21.15.1:0/3313429855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f971c1546e0 0x7f971c15a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:37:25.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f971bfff700 1 --2- 172.21.15.1:0/3313429855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f971c158b30 0x7f971c15a720 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f971400cae0 tx=0x7f9714001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:25.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f97037fe700 1 -- 172.21.15.1:0/3313429855 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9714004c40 con 0x7f971c158b30 2023-11-15T01:37:25.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f97037fe700 1 -- 172.21.15.1:0/3313429855 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9714004dc0 con 0x7f971c158b30 2023-11-15T01:37:25.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f9720bca700 1 -- 172.21.15.1:0/3313429855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c158800 con 0x7f971c158b30 2023-11-15T01:37:25.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f97037fe700 1 -- 172.21.15.1:0/3313429855 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97140073c0 con 0x7f971c158b30 2023-11-15T01:37:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.943+0000 7f9720bca700 1 -- 172.21.15.1:0/3313429855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c0a7200 con 0x7f971c158b30 2023-11-15T01:37:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.944+0000 7f9720bca700 1 -- 172.21.15.1:0/3313429855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c0a7390 con 0x7f971c158b30 2023-11-15T01:37:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.945+0000 7f97037fe700 1 -- 172.21.15.1:0/3313429855 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9714007730 con 0x7f971c158b30 2023-11-15T01:37:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.945+0000 7f97037fe700 1 --2- 172.21.15.1:0/3313429855 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f970805f270 0x7f9708061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.945+0000 7f97037fe700 1 -- 172.21.15.1:0/3313429855 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f971407a440 con 0x7f971c158b30 2023-11-15T01:37:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.945+0000 7f971b7fe700 1 --2- 172.21.15.1:0/3313429855 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f970805f270 0x7f9708061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:25.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.946+0000 7f971b7fe700 1 --2- 172.21.15.1:0/3313429855 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f970805f270 0x7f9708061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f970c006d30 tx=0x7f970c016000).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:25.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:25.949+0000 7f97037fe700 1 -- 172.21.15.1:0/3313429855 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f971c0a7390 con 0x7f971c158b30 2023-11-15T01:37:26.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.123+0000 7f9720bca700 1 -- 172.21.15.1:0/3313429855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f971c0a7390 con 0x7f971c158b30 2023-11-15T01:37:26.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.124+0000 7f97037fe700 1 -- 172.21.15.1:0/3313429855 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+17551 (secure 0 0 0) 0x7f971c0a7390 con 0x7f971c158b30 2023-11-15T01:37:26.126 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:26.126 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":108,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:37:25.783746+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:37:23.432127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-15T01:37:24.767163+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:37:26.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.126+0000 7f9720bca700 1 -- 172.21.15.1:0/3313429855 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f970805f270 msgr2=0x7f9708061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:26.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.126+0000 7f9720bca700 1 --2- 172.21.15.1:0/3313429855 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f970805f270 0x7f9708061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f970c006d30 tx=0x7f970c016000).stop 2023-11-15T01:37:26.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.126+0000 7f9720bca700 1 -- 172.21.15.1:0/3313429855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f971c158b30 msgr2=0x7f971c15a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:26.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.126+0000 7f9720bca700 1 --2- 172.21.15.1:0/3313429855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f971c158b30 0x7f971c15a720 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f971400cae0 tx=0x7f9714001df0).stop 2023-11-15T01:37:26.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.126+0000 7f9720bca700 1 -- 172.21.15.1:0/3313429855 shutdown_connections 2023-11-15T01:37:26.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.126+0000 7f9720bca700 1 --2- 172.21.15.1:0/3313429855 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f970805f270 0x7f9708061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.126+0000 7f9720bca700 1 --2- 172.21.15.1:0/3313429855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f971c158b30 0x7f971c15a720 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.126+0000 7f9720bca700 1 --2- 172.21.15.1:0/3313429855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f971c154300 0x7f971c1500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.126+0000 7f9720bca700 1 --2- 172.21.15.1:0/3313429855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f971c1546e0 0x7f971c15a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.126+0000 7f9720bca700 1 -- 172.21.15.1:0/3313429855 >> 172.21.15.1:0/3313429855 conn(0x7f971c0c7e00 msgr2=0x7f971c152500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.126+0000 7f9720bca700 1 -- 172.21.15.1:0/3313429855 shutdown_connections 2023-11-15T01:37:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.126+0000 7f9720bca700 1 -- 172.21.15.1:0/3313429855 wait complete. 2023-11-15T01:37:26.140 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:37:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.256+0000 7f358ac4a700 1 Processor -- start 2023-11-15T01:37:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.256+0000 7f358ac4a700 1 -- start start 2023-11-15T01:37:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.257+0000 7f358ac4a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3584154680 0x7f3584069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.257+0000 7f358ac4a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f35840c70c0 0x7f35840bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.257+0000 7f358ac4a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35840c3360 con 0x7f35840bccd0 2023-11-15T01:37:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.257+0000 7f358ac4a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35840bd620 con 0x7f35840c70c0 2023-11-15T01:37:26.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.257+0000 7f358ac4a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35840c2750 con 0x7f3584154680 2023-11-15T01:37:26.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.258+0000 7f35891e7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f35840c70c0 0x7f35840bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:26.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.258+0000 7f35889e6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3584154680 0x7f3584069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:26.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.258+0000 7f35889e6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3584154680 0x7f3584069fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:34476/0 (socket says 172.21.15.1:34476) 2023-11-15T01:37:26.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.258+0000 7f35889e6700 1 -- 172.21.15.1:0/2228953099 learned_addr learned my addr 172.21.15.1:0/2228953099 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:26.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.258+0000 7f35891e7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f35840c70c0 0x7f35840bd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:56380/0 (socket says 172.21.15.1:56380) 2023-11-15T01:37:26.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.258+0000 7f35889e6700 1 -- 172.21.15.1:0/2228953099 >> v2:172.21.15.141:3300/0 conn(0x7f35840c70c0 msgr2=0x7f35840bd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:26.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.258+0000 7f35889e6700 1 --2- 172.21.15.1:0/2228953099 >> v2:172.21.15.141:3300/0 conn(0x7f35840c70c0 0x7f35840bd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.258+0000 7f35889e6700 1 -- 172.21.15.1:0/2228953099 >> v1:172.21.15.141:6789/0 conn(0x7f35840bccd0 legacy=0x7f35840627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:26.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.258+0000 7f35889e6700 1 -- 172.21.15.1:0/2228953099 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35840c2a30 con 0x7f3584154680 2023-11-15T01:37:26.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.258+0000 7f35889e6700 1 --2- 172.21.15.1:0/2228953099 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3584154680 0x7f3584069fa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f357c006fd0 tx=0x7f357c0090f0).ready entity=mon.2 client_cookie=fcb8b6f9930aa7a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:26.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.258+0000 7f35837fe700 1 -- 172.21.15.1:0/2228953099 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c00b580 con 0x7f3584154680 2023-11-15T01:37:26.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.258+0000 7f35837fe700 1 -- 172.21.15.1:0/2228953099 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c00b6e0 con 0x7f3584154680 2023-11-15T01:37:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.258+0000 7f35837fe700 1 -- 172.21.15.1:0/2228953099 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c00ba60 con 0x7f3584154680 2023-11-15T01:37:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.259+0000 7f358ac4a700 1 -- 172.21.15.1:0/2228953099 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3584154680 msgr2=0x7f3584069fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.259+0000 7f358ac4a700 1 --2- 172.21.15.1:0/2228953099 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3584154680 0x7f3584069fa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f357c006fd0 tx=0x7f357c0090f0).stop 2023-11-15T01:37:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.259+0000 7f358ac4a700 1 -- 172.21.15.1:0/2228953099 shutdown_connections 2023-11-15T01:37:26.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.259+0000 7f358ac4a700 1 --2- 172.21.15.1:0/2228953099 >> v2:172.21.15.141:3300/0 conn(0x7f35840c70c0 0x7f35840bd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.259+0000 7f358ac4a700 1 --2- 172.21.15.1:0/2228953099 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3584154680 0x7f3584069fa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.259+0000 7f358ac4a700 1 -- 172.21.15.1:0/2228953099 >> 172.21.15.1:0/2228953099 conn(0x7f35840c7d70 msgr2=0x7f35840c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:26.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.259+0000 7f358ac4a700 1 -- 172.21.15.1:0/2228953099 shutdown_connections 2023-11-15T01:37:26.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.259+0000 7f358ac4a700 1 -- 172.21.15.1:0/2228953099 wait complete. 2023-11-15T01:37:26.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.260+0000 7f358ac4a700 1 Processor -- start 2023-11-15T01:37:26.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.260+0000 7f358ac4a700 1 -- start start 2023-11-15T01:37:26.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.261+0000 7f358ac4a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35840bccd0 0x7f3584154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:26.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.261+0000 7f358ac4a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35840c70c0 0x7f3584152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:26.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.261+0000 7f358ac4a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3584154680 0x7f35840aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:26.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.261+0000 7f358ac4a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35840a95c0 con 0x7f35840bccd0 2023-11-15T01:37:26.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.261+0000 7f358ac4a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35840a8d00 con 0x7f35840c70c0 2023-11-15T01:37:26.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.261+0000 7f358ac4a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35840a8f70 con 0x7f3584154680 2023-11-15T01:37:26.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.261+0000 7f35889e6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35840bccd0 0x7f3584154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.261+0000 7f35889e6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35840bccd0 0x7f3584154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35166/0 (socket says 172.21.15.1:35166) 2023-11-15T01:37:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.261+0000 7f35889e6700 1 -- 172.21.15.1:0/2182492257 learned_addr learned my addr 172.21.15.1:0/2182492257 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.261+0000 7f35891e7700 1 --2- 172.21.15.1:0/2182492257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3584154680 0x7f35840aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.261+0000 7f3583fff700 1 --2- 172.21.15.1:0/2182492257 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35840c70c0 0x7f3584152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:26.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.262+0000 7f35889e6700 1 -- 172.21.15.1:0/2182492257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3584154680 msgr2=0x7f35840aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.262+0000 7f35889e6700 1 --2- 172.21.15.1:0/2182492257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3584154680 0x7f35840aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.262+0000 7f35889e6700 1 -- 172.21.15.1:0/2182492257 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35840c70c0 msgr2=0x7f3584152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.262+0000 7f35889e6700 1 --2- 172.21.15.1:0/2182492257 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35840c70c0 0x7f3584152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.262+0000 7f35889e6700 1 -- 172.21.15.1:0/2182492257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c009370 con 0x7f35840bccd0 2023-11-15T01:37:26.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.262+0000 7f35889e6700 1 --2- 172.21.15.1:0/2182492257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35840bccd0 0x7f3584154a60 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f357c009ea0 tx=0x7f357c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.262+0000 7f3580ff9700 1 -- 172.21.15.1:0/2182492257 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c000bc0 con 0x7f35840bccd0 2023-11-15T01:37:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.262+0000 7f3580ff9700 1 -- 172.21.15.1:0/2182492257 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c00b850 con 0x7f35840bccd0 2023-11-15T01:37:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.262+0000 7f3580ff9700 1 -- 172.21.15.1:0/2182492257 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c000d20 con 0x7f35840bccd0 2023-11-15T01:37:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.262+0000 7f358ac4a700 1 -- 172.21.15.1:0/2182492257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35840a9250 con 0x7f35840bccd0 2023-11-15T01:37:26.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.262+0000 7f358ac4a700 1 -- 172.21.15.1:0/2182492257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35840ac460 con 0x7f35840bccd0 2023-11-15T01:37:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.263+0000 7f358ac4a700 1 -- 172.21.15.1:0/2182492257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358406c7e0 con 0x7f35840bccd0 2023-11-15T01:37:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.263+0000 7f3580ff9700 1 -- 172.21.15.1:0/2182492257 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f357c01ca90 con 0x7f35840bccd0 2023-11-15T01:37:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.264+0000 7f3580ff9700 1 --2- 172.21.15.1:0/2182492257 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f356405f240 0x7f3564061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:26.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.264+0000 7f3580ff9700 1 -- 172.21.15.1:0/2182492257 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f357c07b980 con 0x7f35840bccd0 2023-11-15T01:37:26.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.264+0000 7f3583fff700 1 --2- 172.21.15.1:0/2182492257 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f356405f240 0x7f3564061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:26.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.264+0000 7f3583fff700 1 --2- 172.21.15.1:0/2182492257 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f356405f240 0x7f3564061700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3574004290 tx=0x7f3574001560).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:26.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.268+0000 7f3580ff9700 1 -- 172.21.15.1:0/2182492257 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f357c050400 con 0x7f35840bccd0 2023-11-15T01:37:26.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.442+0000 7f358ac4a700 1 -- 172.21.15.1:0/2182492257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35840c2d10 con 0x7f35840bccd0 2023-11-15T01:37:26.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.443+0000 7f3580ff9700 1 -- 172.21.15.1:0/2182492257 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+17551 (secure 0 0 0) 0x7f357c022070 con 0x7f35840bccd0 2023-11-15T01:37:26.445 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:26.445 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":108,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:37:25.783746+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:37:23.432127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-15T01:37:24.767163+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:37:26.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.445+0000 7f358ac4a700 1 -- 172.21.15.1:0/2182492257 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f356405f240 msgr2=0x7f3564061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:26.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.445+0000 7f358ac4a700 1 --2- 172.21.15.1:0/2182492257 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f356405f240 0x7f3564061700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3574004290 tx=0x7f3574001560).stop 2023-11-15T01:37:26.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.445+0000 7f358ac4a700 1 -- 172.21.15.1:0/2182492257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35840bccd0 msgr2=0x7f3584154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:26.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.445+0000 7f358ac4a700 1 --2- 172.21.15.1:0/2182492257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35840bccd0 0x7f3584154a60 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f357c009ea0 tx=0x7f357c017000).stop 2023-11-15T01:37:26.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.446+0000 7f358ac4a700 1 -- 172.21.15.1:0/2182492257 shutdown_connections 2023-11-15T01:37:26.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.446+0000 7f358ac4a700 1 --2- 172.21.15.1:0/2182492257 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f356405f240 0x7f3564061700 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.446+0000 7f358ac4a700 1 --2- 172.21.15.1:0/2182492257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3584154680 0x7f35840aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.446+0000 7f358ac4a700 1 --2- 172.21.15.1:0/2182492257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35840bccd0 0x7f3584154a60 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.446+0000 7f358ac4a700 1 --2- 172.21.15.1:0/2182492257 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35840c70c0 0x7f3584152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.446+0000 7f358ac4a700 1 -- 172.21.15.1:0/2182492257 >> 172.21.15.1:0/2182492257 conn(0x7f35840c7d70 msgr2=0x7f35840a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:26.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.446+0000 7f358ac4a700 1 -- 172.21.15.1:0/2182492257 shutdown_connections 2023-11-15T01:37:26.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.446+0000 7f358ac4a700 1 -- 172.21.15.1:0/2182492257 wait complete. 2023-11-15T01:37:26.459 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-15T01:37:26.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.579+0000 7fc455a6b700 1 Processor -- start 2023-11-15T01:37:26.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.579+0000 7fc455a6b700 1 -- start start 2023-11-15T01:37:26.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc455a6b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc4501541d0 0x7fc4501545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:26.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc455a6b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4500c60d0 0x7fc4500c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:26.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc455a6b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc450155830 con 0x7fc4500c7a60 2023-11-15T01:37:26.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc455a6b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc450158f40 con 0x7fc4501541d0 2023-11-15T01:37:26.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc455a6b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc450154c20 con 0x7fc4500c60d0 2023-11-15T01:37:26.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc454a69700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc4501541d0 0x7fc4501545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:26.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc45526a700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc4500c7a60 0x7fc4500c7eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57510/0 (socket says 172.21.15.1:57510) 2023-11-15T01:37:26.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc454a69700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc4501541d0 0x7fc4501545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35168/0 (socket says 172.21.15.1:35168) 2023-11-15T01:37:26.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc45526a700 1 -- 172.21.15.1:0/2948612519 learned_addr learned my addr 172.21.15.1:0/2948612519 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:26.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc44ffff700 1 --2- 172.21.15.1:0/2948612519 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4500c60d0 0x7fc4500c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:26.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc454a69700 1 -- 172.21.15.1:0/2948612519 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4500c60d0 msgr2=0x7fc4500c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:26.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc454a69700 1 --2- 172.21.15.1:0/2948612519 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4500c60d0 0x7fc4500c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc454a69700 1 -- 172.21.15.1:0/2948612519 >> v1:172.21.15.1:6789/0 conn(0x7fc4500c7a60 legacy=0x7fc4500c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:26.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc44f7fe700 1 -- 172.21.15.1:0/2948612519 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686107914 0 0) 0x7fc450155830 con 0x7fc4500c7a60 2023-11-15T01:37:26.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc454a69700 1 -- 172.21.15.1:0/2948612519 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc450154f00 con 0x7fc4501541d0 2023-11-15T01:37:26.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.580+0000 7fc454a69700 1 --2- 172.21.15.1:0/2948612519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4501541d0 0x7fc4501545b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7fc444009760 tx=0x7fc444009060).ready entity=mon.0 client_cookie=a2c7448105aa8473 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:26.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.581+0000 7fc44f7fe700 1 -- 172.21.15.1:0/2948612519 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44400b580 con 0x7fc4501541d0 2023-11-15T01:37:26.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.581+0000 7fc44f7fe700 1 -- 172.21.15.1:0/2948612519 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44400b6e0 con 0x7fc4501541d0 2023-11-15T01:37:26.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.581+0000 7fc44f7fe700 1 -- 172.21.15.1:0/2948612519 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44400ba60 con 0x7fc4501541d0 2023-11-15T01:37:26.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.581+0000 7fc455a6b700 1 -- 172.21.15.1:0/2948612519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4501541d0 msgr2=0x7fc4501545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:26.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.581+0000 7fc455a6b700 1 --2- 172.21.15.1:0/2948612519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4501541d0 0x7fc4501545b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7fc444009760 tx=0x7fc444009060).stop 2023-11-15T01:37:26.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.581+0000 7fc455a6b700 1 -- 172.21.15.1:0/2948612519 shutdown_connections 2023-11-15T01:37:26.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.581+0000 7fc455a6b700 1 --2- 172.21.15.1:0/2948612519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4501541d0 0x7fc4501545b0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.581+0000 7fc455a6b700 1 --2- 172.21.15.1:0/2948612519 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4500c60d0 0x7fc4500c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.581+0000 7fc455a6b700 1 -- 172.21.15.1:0/2948612519 >> 172.21.15.1:0/2948612519 conn(0x7fc450069ee0 msgr2=0x7fc45006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:26.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.581+0000 7fc455a6b700 1 -- 172.21.15.1:0/2948612519 shutdown_connections 2023-11-15T01:37:26.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.581+0000 7fc455a6b700 1 -- 172.21.15.1:0/2948612519 wait complete. 2023-11-15T01:37:26.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.582+0000 7fc455a6b700 1 Processor -- start 2023-11-15T01:37:26.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.582+0000 7fc455a6b700 1 -- start start 2023-11-15T01:37:26.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.583+0000 7fc455a6b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4500c60d0 0x7fc4500b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:26.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.583+0000 7fc455a6b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4500c7a60 0x7fc450156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:26.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.583+0000 7fc455a6b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4501541d0 0x7fc45014cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:26.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.583+0000 7fc455a6b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc450155b30 con 0x7fc4501541d0 2023-11-15T01:37:26.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.583+0000 7fc455a6b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500aa820 con 0x7fc4500c60d0 2023-11-15T01:37:26.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.583+0000 7fc455a6b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc450155d40 con 0x7fc4500c7a60 2023-11-15T01:37:26.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.583+0000 7fc45526a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4501541d0 0x7fc45014cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:26.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.583+0000 7fc45526a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4501541d0 0x7fc45014cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35170/0 (socket says 172.21.15.1:35170) 2023-11-15T01:37:26.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.583+0000 7fc45526a700 1 -- 172.21.15.1:0/2438779049 learned_addr learned my addr 172.21.15.1:0/2438779049 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:26.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.583+0000 7fc454a69700 1 --2- 172.21.15.1:0/2438779049 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4500c60d0 0x7fc4500b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:26.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.583+0000 7fc44ffff700 1 --2- 172.21.15.1:0/2438779049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4500c7a60 0x7fc450156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:26.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.584+0000 7fc45526a700 1 -- 172.21.15.1:0/2438779049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4500c7a60 msgr2=0x7fc450156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:26.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.584+0000 7fc45526a700 1 --2- 172.21.15.1:0/2438779049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4500c7a60 0x7fc450156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.584+0000 7fc45526a700 1 -- 172.21.15.1:0/2438779049 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4500c60d0 msgr2=0x7fc4500b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:26.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.584+0000 7fc45526a700 1 --2- 172.21.15.1:0/2438779049 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4500c60d0 0x7fc4500b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:26.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.584+0000 7fc45526a700 1 -- 172.21.15.1:0/2438779049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4440092a0 con 0x7fc4501541d0 2023-11-15T01:37:26.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.584+0000 7fc45526a700 1 --2- 172.21.15.1:0/2438779049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4501541d0 0x7fc45014cdb0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7fc44800c7e0 tx=0x7fc448007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:26.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.584+0000 7fc44cff9700 1 -- 172.21.15.1:0/2438779049 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448005d30 con 0x7fc4501541d0 2023-11-15T01:37:26.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.584+0000 7fc44cff9700 1 -- 172.21.15.1:0/2438779049 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc448005e90 con 0x7fc4501541d0 2023-11-15T01:37:26.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.584+0000 7fc455a6b700 1 -- 172.21.15.1:0/2438779049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc450156020 con 0x7fc4501541d0 2023-11-15T01:37:26.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.584+0000 7fc44cff9700 1 -- 172.21.15.1:0/2438779049 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448007320 con 0x7fc4501541d0 2023-11-15T01:37:26.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.584+0000 7fc455a6b700 1 -- 172.21.15.1:0/2438779049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4501571c0 con 0x7fc4501541d0 2023-11-15T01:37:26.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.585+0000 7fc455a6b700 1 -- 172.21.15.1:0/2438779049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc450156540 con 0x7fc4501541d0 2023-11-15T01:37:26.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.585+0000 7fc44cff9700 1 -- 172.21.15.1:0/2438779049 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc448007710 con 0x7fc4501541d0 2023-11-15T01:37:26.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.586+0000 7fc44cff9700 1 --2- 172.21.15.1:0/2438779049 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc43405f270 0x7fc434061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:26.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.586+0000 7fc44cff9700 1 -- 172.21.15.1:0/2438779049 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fc44807a480 con 0x7fc4501541d0 2023-11-15T01:37:26.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.586+0000 7fc454a69700 1 --2- 172.21.15.1:0/2438779049 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc43405f270 0x7fc434061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:26.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.586+0000 7fc454a69700 1 --2- 172.21.15.1:0/2438779049 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc43405f270 0x7fc434061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc44400b340 tx=0x7fc444017000).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:26.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.590+0000 7fc44cff9700 1 -- 172.21.15.1:0/2438779049 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc44804b3c0 con 0x7fc4501541d0 2023-11-15T01:37:26.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:26.809+0000 7fc455a6b700 1 -- 172.21.15.1:0/2438779049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc4500475e0 con 0x7fc4501541d0 2023-11-15T01:37:27.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.796+0000 7fc44cff9700 1 -- 172.21.15.1:0/2438779049 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc44804e9e0 con 0x7fc4501541d0 2023-11-15T01:37:27.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.798+0000 7fc455a6b700 1 -- 172.21.15.1:0/2438779049 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc43405f270 msgr2=0x7fc434061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:27.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.798+0000 7fc455a6b700 1 --2- 172.21.15.1:0/2438779049 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc43405f270 0x7fc434061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc44400b340 tx=0x7fc444017000).stop 2023-11-15T01:37:27.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.798+0000 7fc455a6b700 1 -- 172.21.15.1:0/2438779049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4501541d0 msgr2=0x7fc45014cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:27.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.798+0000 7fc455a6b700 1 --2- 172.21.15.1:0/2438779049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4501541d0 0x7fc45014cdb0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7fc44800c7e0 tx=0x7fc448007f90).stop 2023-11-15T01:37:27.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.798+0000 7fc455a6b700 1 -- 172.21.15.1:0/2438779049 shutdown_connections 2023-11-15T01:37:27.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.798+0000 7fc455a6b700 1 --2- 172.21.15.1:0/2438779049 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc43405f270 0x7fc434061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:27.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.798+0000 7fc455a6b700 1 --2- 172.21.15.1:0/2438779049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4501541d0 0x7fc45014cdb0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:27.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.798+0000 7fc455a6b700 1 --2- 172.21.15.1:0/2438779049 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4500c60d0 0x7fc4500b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:27.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.798+0000 7fc455a6b700 1 --2- 172.21.15.1:0/2438779049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4500c7a60 0x7fc450156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:27.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.799+0000 7fc455a6b700 1 -- 172.21.15.1:0/2438779049 >> 172.21.15.1:0/2438779049 conn(0x7fc450069ee0 msgr2=0x7fc45014dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:27.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.799+0000 7fc455a6b700 1 -- 172.21.15.1:0/2438779049 shutdown_connections 2023-11-15T01:37:27.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.799+0000 7fc455a6b700 1 -- 172.21.15.1:0/2438779049 wait complete. 2023-11-15T01:37:27.814 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-15T01:37:27.815 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-15T01:37:27.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.943+0000 7fe70d100700 1 Processor -- start 2023-11-15T01:37:27.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.943+0000 7fe70d100700 1 -- start start 2023-11-15T01:37:27.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.944+0000 7fe70d100700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7081541d0 0x7fe7081545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:27.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.944+0000 7fe70d100700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe7080c8170 0x7fe7080c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:27.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.944+0000 7fe70d100700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe708155830 con 0x7fe7080c60d0 2023-11-15T01:37:27.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.944+0000 7fe70d100700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe708158f40 con 0x7fe7080c8170 2023-11-15T01:37:27.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.944+0000 7fe70d100700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe708154c20 con 0x7fe7081541d0 2023-11-15T01:37:27.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.944+0000 7fe70c8ff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe7080c8170 0x7fe7080c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:27.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.944+0000 7fe70c8ff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe7080c8170 0x7fe7080c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43524/0 (socket says 172.21.15.1:43524) 2023-11-15T01:37:27.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.944+0000 7fe70c8ff700 1 -- 172.21.15.1:0/1783529657 learned_addr learned my addr 172.21.15.1:0/1783529657 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:27.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.944+0000 7fe707fff700 1 --2- 172.21.15.1:0/1783529657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7081541d0 0x7fe7081545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:27.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.944+0000 7fe70c8ff700 1 -- 172.21.15.1:0/1783529657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7081541d0 msgr2=0x7fe7081545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:27.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.944+0000 7fe70c8ff700 1 --2- 172.21.15.1:0/1783529657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7081541d0 0x7fe7081545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:27.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.944+0000 7fe70c8ff700 1 -- 172.21.15.1:0/1783529657 >> v1:172.21.15.141:6789/0 conn(0x7fe7080c60d0 legacy=0x7fe7080c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:27.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.944+0000 7fe70c8ff700 1 -- 172.21.15.1:0/1783529657 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe708154f00 con 0x7fe7080c8170 2023-11-15T01:37:27.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.945+0000 7fe70c8ff700 1 --2- 172.21.15.1:0/1783529657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7080c8170 0x7fe7080c6550 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7fe700009f20 tx=0x7fe700009840).ready entity=mon.0 client_cookie=84e9189832f937d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:27.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.945+0000 7fe706ffd700 1 -- 172.21.15.1:0/1783529657 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70000e070 con 0x7fe7080c8170 2023-11-15T01:37:27.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.945+0000 7fe706ffd700 1 -- 172.21.15.1:0/1783529657 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70000ba80 con 0x7fe7080c8170 2023-11-15T01:37:27.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.945+0000 7fe706ffd700 1 -- 172.21.15.1:0/1783529657 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70000be00 con 0x7fe7080c8170 2023-11-15T01:37:27.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.945+0000 7fe70d100700 1 -- 172.21.15.1:0/1783529657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7080c8170 msgr2=0x7fe7080c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:27.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.945+0000 7fe70d100700 1 --2- 172.21.15.1:0/1783529657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7080c8170 0x7fe7080c6550 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7fe700009f20 tx=0x7fe700009840).stop 2023-11-15T01:37:27.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.945+0000 7fe70d100700 1 -- 172.21.15.1:0/1783529657 shutdown_connections 2023-11-15T01:37:27.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.945+0000 7fe70d100700 1 --2- 172.21.15.1:0/1783529657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7081541d0 0x7fe7081545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:27.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.945+0000 7fe70d100700 1 --2- 172.21.15.1:0/1783529657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7080c8170 0x7fe7080c6550 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:27.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.945+0000 7fe70d100700 1 -- 172.21.15.1:0/1783529657 >> 172.21.15.1:0/1783529657 conn(0x7fe708069ee0 msgr2=0x7fe70806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:27.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.945+0000 7fe70d100700 1 -- 172.21.15.1:0/1783529657 shutdown_connections 2023-11-15T01:37:27.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.945+0000 7fe70d100700 1 -- 172.21.15.1:0/1783529657 wait complete. 2023-11-15T01:37:27.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.946+0000 7fe70d100700 1 Processor -- start 2023-11-15T01:37:27.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.947+0000 7fe70d100700 1 -- start start 2023-11-15T01:37:27.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.947+0000 7fe70d100700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7080c60d0 0x7fe70813b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:27.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.947+0000 7fe70d100700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7080c8170 0x7fe7080c1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:27.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.947+0000 7fe70d100700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7081541d0 0x7fe7080c16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:27.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.947+0000 7fe70d100700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7080c1be0 con 0x7fe7080c60d0 2023-11-15T01:37:27.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.947+0000 7fe70d100700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe708165530 con 0x7fe7080c8170 2023-11-15T01:37:27.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.947+0000 7fe70d100700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe708167d00 con 0x7fe7081541d0 2023-11-15T01:37:27.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe707fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7080c60d0 0x7fe70813b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:27.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe707fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7080c60d0 0x7fe70813b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43526/0 (socket says 172.21.15.1:43526) 2023-11-15T01:37:27.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe707fff700 1 -- 172.21.15.1:0/1691792485 learned_addr learned my addr 172.21.15.1:0/1691792485 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:27.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe70c8ff700 1 --2- 172.21.15.1:0/1691792485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7081541d0 0x7fe7080c16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:27.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe7077fe700 1 --2- 172.21.15.1:0/1691792485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7080c8170 0x7fe7080c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:27.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe707fff700 1 -- 172.21.15.1:0/1691792485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7081541d0 msgr2=0x7fe7080c16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:27.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe707fff700 1 --2- 172.21.15.1:0/1691792485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7081541d0 0x7fe7080c16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:27.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe707fff700 1 -- 172.21.15.1:0/1691792485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7080c8170 msgr2=0x7fe7080c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:27.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe707fff700 1 --2- 172.21.15.1:0/1691792485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7080c8170 0x7fe7080c1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:27.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe707fff700 1 -- 172.21.15.1:0/1691792485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe700009ae0 con 0x7fe7080c60d0 2023-11-15T01:37:27.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe707fff700 1 --2- 172.21.15.1:0/1691792485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7080c60d0 0x7fe70813b270 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7fe6f800d860 tx=0x7fe6f8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:27.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe6effff700 1 -- 172.21.15.1:0/1691792485 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8011590 con 0x7fe7080c60d0 2023-11-15T01:37:27.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe6effff700 1 -- 172.21.15.1:0/1691792485 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f80116f0 con 0x7fe7080c60d0 2023-11-15T01:37:27.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe70d100700 1 -- 172.21.15.1:0/1691792485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe708167fe0 con 0x7fe7080c60d0 2023-11-15T01:37:27.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe6effff700 1 -- 172.21.15.1:0/1691792485 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8011a70 con 0x7fe7080c60d0 2023-11-15T01:37:27.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.948+0000 7fe70d100700 1 -- 172.21.15.1:0/1691792485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7081685a0 con 0x7fe7080c60d0 2023-11-15T01:37:27.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.949+0000 7fe70d100700 1 -- 172.21.15.1:0/1691792485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7080475e0 con 0x7fe7080c60d0 2023-11-15T01:37:27.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.949+0000 7fe6effff700 1 -- 172.21.15.1:0/1691792485 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe6f8012420 con 0x7fe7080c60d0 2023-11-15T01:37:27.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.950+0000 7fe6effff700 1 --2- 172.21.15.1:0/1691792485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe6f405f270 0x7fe6f4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:27.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.950+0000 7fe6effff700 1 -- 172.21.15.1:0/1691792485 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fe6f807a010 con 0x7fe7080c60d0 2023-11-15T01:37:27.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.950+0000 7fe7077fe700 1 --2- 172.21.15.1:0/1691792485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe6f405f270 0x7fe6f4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:27.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.950+0000 7fe7077fe700 1 --2- 172.21.15.1:0/1691792485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe6f405f270 0x7fe6f4061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fe7080ae4f0 tx=0x7fe6fc009040).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:27.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:27.954+0000 7fe6effff700 1 -- 172.21.15.1:0/1691792485 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe6f804af50 con 0x7fe7080c60d0 2023-11-15T01:37:28.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.171+0000 7fe70d100700 1 -- 172.21.15.1:0/1691792485 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe7081551e0 con 0x7fe7080c60d0 2023-11-15T01:37:28.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.800+0000 7fe6effff700 1 -- 172.21.15.1:0/1691792485 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe6f8011e60 con 0x7fe7080c60d0 2023-11-15T01:37:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.803+0000 7fe70d100700 1 -- 172.21.15.1:0/1691792485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe6f405f270 msgr2=0x7fe6f4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.803+0000 7fe70d100700 1 --2- 172.21.15.1:0/1691792485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe6f405f270 0x7fe6f4061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fe7080ae4f0 tx=0x7fe6fc009040).stop 2023-11-15T01:37:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.803+0000 7fe70d100700 1 -- 172.21.15.1:0/1691792485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7080c60d0 msgr2=0x7fe70813b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.803+0000 7fe70d100700 1 --2- 172.21.15.1:0/1691792485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7080c60d0 0x7fe70813b270 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7fe6f800d860 tx=0x7fe6f8008040).stop 2023-11-15T01:37:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.803+0000 7fe70d100700 1 -- 172.21.15.1:0/1691792485 shutdown_connections 2023-11-15T01:37:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.803+0000 7fe70d100700 1 --2- 172.21.15.1:0/1691792485 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe6f405f270 0x7fe6f4061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.803+0000 7fe70d100700 1 --2- 172.21.15.1:0/1691792485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7081541d0 0x7fe7080c16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.803+0000 7fe70d100700 1 --2- 172.21.15.1:0/1691792485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7080c60d0 0x7fe70813b270 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.803+0000 7fe70d100700 1 --2- 172.21.15.1:0/1691792485 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7080c8170 0x7fe7080c1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:28.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.803+0000 7fe70d100700 1 -- 172.21.15.1:0/1691792485 >> 172.21.15.1:0/1691792485 conn(0x7fe708069ee0 msgr2=0x7fe7080cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:28.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.803+0000 7fe70d100700 1 -- 172.21.15.1:0/1691792485 shutdown_connections 2023-11-15T01:37:28.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.803+0000 7fe70d100700 1 -- 172.21.15.1:0/1691792485 wait complete. 2023-11-15T01:37:28.819 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-15T01:37:28.820 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:37:28.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.943+0000 7f0754a92700 1 Processor -- start 2023-11-15T01:37:28.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.943+0000 7f0754a92700 1 -- start start 2023-11-15T01:37:28.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.944+0000 7f0754a92700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0750151e10 0x7f0750155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:28.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.944+0000 7f0754a92700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f07500c98b0 0x7f07500c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:28.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.944+0000 7f0754a92700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07500c7980 con 0x7f07500c86b0 2023-11-15T01:37:28.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.944+0000 7f0754a92700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07500c8b10 con 0x7f07500c98b0 2023-11-15T01:37:28.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.944+0000 7f0754a92700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07500ca230 con 0x7f0750151e10 2023-11-15T01:37:28.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.944+0000 7f074ffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f07500c98b0 0x7f07500c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:28.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.944+0000 7f074ffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f07500c98b0 0x7f07500c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43530/0 (socket says 172.21.15.1:43530) 2023-11-15T01:37:28.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.944+0000 7f074ffff700 1 -- 172.21.15.1:0/2296263814 learned_addr learned my addr 172.21.15.1:0/2296263814 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:28.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.945+0000 7f074f7fe700 1 --2- 172.21.15.1:0/2296263814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0750151e10 0x7f0750155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:28.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.945+0000 7f074ffff700 1 -- 172.21.15.1:0/2296263814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0750151e10 msgr2=0x7f0750155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:28.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.945+0000 7f074ffff700 1 --2- 172.21.15.1:0/2296263814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0750151e10 0x7f0750155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:28.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.945+0000 7f074ffff700 1 -- 172.21.15.1:0/2296263814 >> v1:172.21.15.141:6789/0 conn(0x7f07500c86b0 legacy=0x7f07500aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:28.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.945+0000 7f074ffff700 1 -- 172.21.15.1:0/2296263814 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07500aa890 con 0x7f07500c98b0 2023-11-15T01:37:28.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.945+0000 7f074f7fe700 1 --2- 172.21.15.1:0/2296263814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0750151e10 0x7f0750155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:37:28.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.945+0000 7f074ffff700 1 --2- 172.21.15.1:0/2296263814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07500c98b0 0x7f07500c9d40 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f0748009f20 tx=0x7f0748009840).ready entity=mon.0 client_cookie=37b57a957830ac28 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:28.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.945+0000 7f074e7fc700 1 -- 172.21.15.1:0/2296263814 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074800e070 con 0x7f07500c98b0 2023-11-15T01:37:28.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.945+0000 7f074e7fc700 1 -- 172.21.15.1:0/2296263814 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074800ba40 con 0x7f07500c98b0 2023-11-15T01:37:28.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.945+0000 7f074e7fc700 1 -- 172.21.15.1:0/2296263814 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074800bdc0 con 0x7f07500c98b0 2023-11-15T01:37:28.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.945+0000 7f0754a92700 1 -- 172.21.15.1:0/2296263814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07500c98b0 msgr2=0x7f07500c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:28.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.945+0000 7f0754a92700 1 --2- 172.21.15.1:0/2296263814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07500c98b0 0x7f07500c9d40 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f0748009f20 tx=0x7f0748009840).stop 2023-11-15T01:37:28.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.946+0000 7f0754a92700 1 -- 172.21.15.1:0/2296263814 shutdown_connections 2023-11-15T01:37:28.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.946+0000 7f0754a92700 1 --2- 172.21.15.1:0/2296263814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0750151e10 0x7f0750155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:28.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.946+0000 7f0754a92700 1 --2- 172.21.15.1:0/2296263814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07500c98b0 0x7f07500c9d40 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:28.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.946+0000 7f0754a92700 1 -- 172.21.15.1:0/2296263814 >> 172.21.15.1:0/2296263814 conn(0x7f07500947e0 msgr2=0x7f075006a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:28.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.946+0000 7f0754a92700 1 -- 172.21.15.1:0/2296263814 shutdown_connections 2023-11-15T01:37:28.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.946+0000 7f0754a92700 1 -- 172.21.15.1:0/2296263814 wait complete. 2023-11-15T01:37:28.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.947+0000 7f0754a92700 1 Processor -- start 2023-11-15T01:37:28.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.947+0000 7f0754a92700 1 -- start start 2023-11-15T01:37:28.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f0754a92700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07500c86b0 0x7f07500ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:28.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f0754a92700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07500c98b0 0x7f07500ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:28.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f0754a92700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0750151e10 0x7f07500afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:28.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f0754a92700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07501537d0 con 0x7f07500c86b0 2023-11-15T01:37:28.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f0754a92700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07501545f0 con 0x7f07500c98b0 2023-11-15T01:37:28.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f0754a92700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07500ae5a0 con 0x7f0750151e10 2023-11-15T01:37:28.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f074f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07500c86b0 0x7f07500ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:28.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f074f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07500c86b0 0x7f07500ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43536/0 (socket says 172.21.15.1:43536) 2023-11-15T01:37:28.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f074f7fe700 1 -- 172.21.15.1:0/1097482711 learned_addr learned my addr 172.21.15.1:0/1097482711 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:28.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f074effd700 1 --2- 172.21.15.1:0/1097482711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07500c98b0 0x7f07500ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:28.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f074ffff700 1 --2- 172.21.15.1:0/1097482711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0750151e10 0x7f07500afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:28.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f074f7fe700 1 -- 172.21.15.1:0/1097482711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0750151e10 msgr2=0x7f07500afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:28.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f074f7fe700 1 --2- 172.21.15.1:0/1097482711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0750151e10 0x7f07500afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:28.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f074f7fe700 1 -- 172.21.15.1:0/1097482711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07500c98b0 msgr2=0x7f07500ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:28.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f074f7fe700 1 --2- 172.21.15.1:0/1097482711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07500c98b0 0x7f07500ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:28.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f074f7fe700 1 -- 172.21.15.1:0/1097482711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0748009ae0 con 0x7f07500c86b0 2023-11-15T01:37:28.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f074ffff700 1 --2- 172.21.15.1:0/1097482711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0750151e10 0x7f07500afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:37:28.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f074f7fe700 1 --2- 172.21.15.1:0/1097482711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07500c86b0 0x7f07500ae0b0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f074000c880 tx=0x7f0740008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:28.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f07377fe700 1 -- 172.21.15.1:0/1097482711 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0740010580 con 0x7f07500c86b0 2023-11-15T01:37:28.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f07377fe700 1 -- 172.21.15.1:0/1097482711 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07400106e0 con 0x7f07500c86b0 2023-11-15T01:37:28.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f0754a92700 1 -- 172.21.15.1:0/1097482711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07501539e0 con 0x7f07500c86b0 2023-11-15T01:37:28.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f07377fe700 1 -- 172.21.15.1:0/1097482711 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0740010a60 con 0x7f07500c86b0 2023-11-15T01:37:28.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.948+0000 7f0754a92700 1 -- 172.21.15.1:0/1097482711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0750153fa0 con 0x7f07500c86b0 2023-11-15T01:37:28.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.949+0000 7f0754a92700 1 -- 172.21.15.1:0/1097482711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07500c5810 con 0x7f07500c86b0 2023-11-15T01:37:28.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.950+0000 7f07377fe700 1 -- 172.21.15.1:0/1097482711 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f074001b460 con 0x7f07500c86b0 2023-11-15T01:37:28.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.950+0000 7f07377fe700 1 --2- 172.21.15.1:0/1097482711 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f073c05f270 0x7f073c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:28.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.950+0000 7f07377fe700 1 -- 172.21.15.1:0/1097482711 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f074007a580 con 0x7f07500c86b0 2023-11-15T01:37:28.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.950+0000 7f074effd700 1 --2- 172.21.15.1:0/1097482711 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f073c05f270 0x7f073c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:28.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.951+0000 7f074effd700 1 --2- 172.21.15.1:0/1097482711 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f073c05f270 0x7f073c061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f07501555e0 tx=0x7f0744009040).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:28.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:28.954+0000 7f07377fe700 1 -- 172.21.15.1:0/1097482711 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f074004b4c0 con 0x7f07500c86b0 2023-11-15T01:37:29.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.168+0000 7f0754a92700 1 -- 172.21.15.1:0/1097482711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07500475e0 con 0x7f07500c86b0 2023-11-15T01:37:29.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.168+0000 7f07377fe700 1 -- 172.21.15.1:0/1097482711 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f074004eae0 con 0x7f07500c86b0 2023-11-15T01:37:29.170 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:29.171 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6035,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2141857111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2141857111},{"type":"v1","addr":"172.21.15.141:6836","nonce":2141857111}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7140,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3686794692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3686794692},{"type":"v1","addr":"172.21.15.1:6834","nonce":3686794692}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7143,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1233089645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1233089645},{"type":"v1","addr":"172.21.15.1:6835","nonce":1233089645}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:37:25.784087+0000","modified":"2023-11-15T01:37:28.796286+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7155},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7155":{"gid":7155,"name":"b","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/173614126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":173614126},{"type":"v1","addr":"172.21.15.141:6837","nonce":173614126}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-11-15T01:37:29.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.170+0000 7f0754a92700 1 -- 172.21.15.1:0/1097482711 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f073c05f270 msgr2=0x7f073c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.170+0000 7f0754a92700 1 --2- 172.21.15.1:0/1097482711 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f073c05f270 0x7f073c061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f07501555e0 tx=0x7f0744009040).stop 2023-11-15T01:37:29.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.170+0000 7f0754a92700 1 -- 172.21.15.1:0/1097482711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07500c86b0 msgr2=0x7f07500ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.170+0000 7f0754a92700 1 --2- 172.21.15.1:0/1097482711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07500c86b0 0x7f07500ae0b0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f074000c880 tx=0x7f0740008040).stop 2023-11-15T01:37:29.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.170+0000 7f0754a92700 1 -- 172.21.15.1:0/1097482711 shutdown_connections 2023-11-15T01:37:29.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.170+0000 7f0754a92700 1 --2- 172.21.15.1:0/1097482711 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f073c05f270 0x7f073c061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.170+0000 7f0754a92700 1 --2- 172.21.15.1:0/1097482711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0750151e10 0x7f07500afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.170+0000 7f0754a92700 1 --2- 172.21.15.1:0/1097482711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07500c86b0 0x7f07500ae0b0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.170+0000 7f0754a92700 1 --2- 172.21.15.1:0/1097482711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07500c98b0 0x7f07500ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.170+0000 7f0754a92700 1 -- 172.21.15.1:0/1097482711 >> 172.21.15.1:0/1097482711 conn(0x7f07500947e0 msgr2=0x7f0750150af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:29.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.170+0000 7f0754a92700 1 -- 172.21.15.1:0/1097482711 shutdown_connections 2023-11-15T01:37:29.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.170+0000 7f0754a92700 1 -- 172.21.15.1:0/1097482711 wait complete. 2023-11-15T01:37:29.174 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 47 2023-11-15T01:37:29.184 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:37:29.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.300+0000 7f9666d29700 1 Processor -- start 2023-11-15T01:37:29.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.300+0000 7f9666d29700 1 -- start start 2023-11-15T01:37:29.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.301+0000 7f9666d29700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96600c6620 0x7f9660154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.301+0000 7f9666d29700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96600c06f0 con 0x7f96600ab1a0 2023-11-15T01:37:29.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.301+0000 7f9666d29700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96600c09d0 con 0x7f9660154150 2023-11-15T01:37:29.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.301+0000 7f9666d29700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9660158820 con 0x7f96600c6620 2023-11-15T01:37:29.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.301+0000 7f965ffff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f96600ab1a0 0x7f96600c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45004/0 (socket says 172.21.15.1:45004) 2023-11-15T01:37:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.301+0000 7f965ffff700 1 -- 172.21.15.1:0/4044764787 learned_addr learned my addr 172.21.15.1:0/4044764787 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.302+0000 7f96652c6700 1 --2- 172.21.15.1:0/4044764787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96600c6620 0x7f9660154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.302+0000 7f965f7fe700 1 -- 172.21.15.1:0/4044764787 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728793287 0 0) 0x7f96600c06f0 con 0x7f96600ab1a0 2023-11-15T01:37:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.302+0000 7f965f7fe700 1 -- 172.21.15.1:0/4044764787 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f964c0033f0 con 0x7f96600ab1a0 2023-11-15T01:37:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.302+0000 7f965f7fe700 1 -- 172.21.15.1:0/4044764787 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437449373 0 0) 0x7f96600c09d0 con 0x7f9660154150 2023-11-15T01:37:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.302+0000 7f965f7fe700 1 -- 172.21.15.1:0/4044764787 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96600c06f0 con 0x7f9660154150 2023-11-15T01:37:29.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.302+0000 7f965f7fe700 1 -- 172.21.15.1:0/4044764787 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3756972176 0 0) 0x7f964c0033f0 con 0x7f96600ab1a0 2023-11-15T01:37:29.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.302+0000 7f96652c6700 1 -- 172.21.15.1:0/4044764787 >> v1:172.21.15.141:6789/0 conn(0x7f9660154150 legacy=0x7f9660158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.302+0000 7f96652c6700 1 -- 172.21.15.1:0/4044764787 >> v1:172.21.15.1:6789/0 conn(0x7f96600ab1a0 legacy=0x7f96600c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.302+0000 7f96652c6700 1 -- 172.21.15.1:0/4044764787 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9660158b00 con 0x7f96600c6620 2023-11-15T01:37:29.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.302+0000 7f96652c6700 1 --2- 172.21.15.1:0/4044764787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96600c6620 0x7f9660154530 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f9658009790 tx=0x7f9658009060).ready entity=mon.2 client_cookie=9bc65e468997bf35 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:29.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.302+0000 7f965f7fe700 1 -- 172.21.15.1:0/4044764787 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500017f0 con 0x7f96600c6620 2023-11-15T01:37:29.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.302+0000 7f965f7fe700 1 -- 172.21.15.1:0/4044764787 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96580090d0 con 0x7f96600c6620 2023-11-15T01:37:29.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.302+0000 7f965f7fe700 1 -- 172.21.15.1:0/4044764787 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9658011610 con 0x7f96600c6620 2023-11-15T01:37:29.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.303+0000 7f9666d29700 1 -- 172.21.15.1:0/4044764787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96600c6620 msgr2=0x7f9660154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.303+0000 7f9666d29700 1 --2- 172.21.15.1:0/4044764787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96600c6620 0x7f9660154530 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f9658009790 tx=0x7f9658009060).stop 2023-11-15T01:37:29.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.303+0000 7f9666d29700 1 -- 172.21.15.1:0/4044764787 shutdown_connections 2023-11-15T01:37:29.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.303+0000 7f9666d29700 1 --2- 172.21.15.1:0/4044764787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96600c6620 0x7f9660154530 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.303+0000 7f9666d29700 1 -- 172.21.15.1:0/4044764787 >> 172.21.15.1:0/4044764787 conn(0x7f9660064aa0 msgr2=0x7f9660064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:29.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.303+0000 7f9666d29700 1 -- 172.21.15.1:0/4044764787 shutdown_connections 2023-11-15T01:37:29.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.303+0000 7f9666d29700 1 -- 172.21.15.1:0/4044764787 wait complete. 2023-11-15T01:37:29.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.304+0000 7f9666d29700 1 Processor -- start 2023-11-15T01:37:29.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.304+0000 7f9666d29700 1 -- start start 2023-11-15T01:37:29.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f9666d29700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96600ab1a0 0x7f96600b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f9666d29700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96600c6620 0x7f9660156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f9666d29700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9660154150 0x7f9660157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f9666d29700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96600b1050 con 0x7f96600ab1a0 2023-11-15T01:37:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f9666d29700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96601688b0 con 0x7f96600c6620 2023-11-15T01:37:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f9666d29700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9660155910 con 0x7f9660154150 2023-11-15T01:37:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f9664ac5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96600ab1a0 0x7f96600b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f9664ac5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96600ab1a0 0x7f96600b0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43552/0 (socket says 172.21.15.1:43552) 2023-11-15T01:37:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f9664ac5700 1 -- 172.21.15.1:0/132797506 learned_addr learned my addr 172.21.15.1:0/132797506 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:29.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f96652c6700 1 --2- 172.21.15.1:0/132797506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9660154150 0x7f9660157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:29.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f965ffff700 1 --2- 172.21.15.1:0/132797506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96600c6620 0x7f9660156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:29.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f9664ac5700 1 -- 172.21.15.1:0/132797506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9660154150 msgr2=0x7f9660157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f9664ac5700 1 --2- 172.21.15.1:0/132797506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9660154150 0x7f9660157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f9664ac5700 1 -- 172.21.15.1:0/132797506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96600c6620 msgr2=0x7f9660156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f9664ac5700 1 --2- 172.21.15.1:0/132797506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96600c6620 0x7f9660156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.305+0000 7f9664ac5700 1 -- 172.21.15.1:0/132797506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96580092a0 con 0x7f96600ab1a0 2023-11-15T01:37:29.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.306+0000 7f9664ac5700 1 --2- 172.21.15.1:0/132797506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96600ab1a0 0x7f96600b0b60 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f964800c440 tx=0x7f9648007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:29.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.306+0000 7f965cff9700 1 -- 172.21.15.1:0/132797506 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9648012400 con 0x7f96600ab1a0 2023-11-15T01:37:29.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.306+0000 7f965cff9700 1 -- 172.21.15.1:0/132797506 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9648012560 con 0x7f96600ab1a0 2023-11-15T01:37:29.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.306+0000 7f9666d29700 1 -- 172.21.15.1:0/132797506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96600abcb0 con 0x7f96600ab1a0 2023-11-15T01:37:29.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.306+0000 7f965cff9700 1 -- 172.21.15.1:0/132797506 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9648012920 con 0x7f96600ab1a0 2023-11-15T01:37:29.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.306+0000 7f9666d29700 1 -- 172.21.15.1:0/132797506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9660155630 con 0x7f96600ab1a0 2023-11-15T01:37:29.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.307+0000 7f9666d29700 1 -- 172.21.15.1:0/132797506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96600c5490 con 0x7f96600ab1a0 2023-11-15T01:37:29.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.307+0000 7f965cff9700 1 -- 172.21.15.1:0/132797506 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f964801b3b0 con 0x7f96600ab1a0 2023-11-15T01:37:29.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.308+0000 7f965cff9700 1 --2- 172.21.15.1:0/132797506 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f964005f270 0x7f9640061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.308+0000 7f965cff9700 1 -- 172.21.15.1:0/132797506 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f9648079c60 con 0x7f96600ab1a0 2023-11-15T01:37:29.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.308+0000 7f965ffff700 1 --2- 172.21.15.1:0/132797506 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f964005f270 0x7f9640061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:29.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.308+0000 7f965ffff700 1 --2- 172.21.15.1:0/132797506 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f964005f270 0x7f9640061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f96600abb50 tx=0x7f9650000f40).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:29.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.312+0000 7f965cff9700 1 -- 172.21.15.1:0/132797506 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f964804aba0 con 0x7f96600ab1a0 2023-11-15T01:37:29.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.486+0000 7f9666d29700 1 -- 172.21.15.1:0/132797506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96600abf90 con 0x7f96600ab1a0 2023-11-15T01:37:29.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.487+0000 7f965cff9700 1 -- 172.21.15.1:0/132797506 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+17538 (secure 0 0 0) 0x7f964804e1c0 con 0x7f96600ab1a0 2023-11-15T01:37:29.488 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:29.488 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":109,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:37:26.785751+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:37:23.432127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-15T01:37:24.767163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:37:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.488+0000 7f9666d29700 1 -- 172.21.15.1:0/132797506 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f964005f270 msgr2=0x7f9640061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.488+0000 7f9666d29700 1 --2- 172.21.15.1:0/132797506 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f964005f270 0x7f9640061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f96600abb50 tx=0x7f9650000f40).stop 2023-11-15T01:37:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.488+0000 7f9666d29700 1 -- 172.21.15.1:0/132797506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96600ab1a0 msgr2=0x7f96600b0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.488+0000 7f9666d29700 1 --2- 172.21.15.1:0/132797506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96600ab1a0 0x7f96600b0b60 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f964800c440 tx=0x7f9648007c90).stop 2023-11-15T01:37:29.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.488+0000 7f9666d29700 1 -- 172.21.15.1:0/132797506 shutdown_connections 2023-11-15T01:37:29.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.488+0000 7f9666d29700 1 --2- 172.21.15.1:0/132797506 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f964005f270 0x7f9640061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.488+0000 7f9666d29700 1 --2- 172.21.15.1:0/132797506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9660154150 0x7f9660157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.488+0000 7f9666d29700 1 --2- 172.21.15.1:0/132797506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96600ab1a0 0x7f96600b0b60 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.488+0000 7f9666d29700 1 --2- 172.21.15.1:0/132797506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96600c6620 0x7f9660156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.488+0000 7f9666d29700 1 -- 172.21.15.1:0/132797506 >> 172.21.15.1:0/132797506 conn(0x7f9660064aa0 msgr2=0x7f9660063fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:29.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.488+0000 7f9666d29700 1 -- 172.21.15.1:0/132797506 shutdown_connections 2023-11-15T01:37:29.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.488+0000 7f9666d29700 1 -- 172.21.15.1:0/132797506 wait complete. 2023-11-15T01:37:29.502 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-15T01:37:29.503 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:37:29.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.619+0000 7f20c1949700 1 Processor -- start 2023-11-15T01:37:29.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.619+0000 7f20c1949700 1 -- start start 2023-11-15T01:37:29.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.620+0000 7f20c1949700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20bc154450 0x7f20bc0a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.620+0000 7f20c1949700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f20bc0833a0 0x7f20bc154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.620+0000 7f20c1949700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20bc0a85e0 con 0x7f20bc0bde10 2023-11-15T01:37:29.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.620+0000 7f20c1949700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20bc065940 con 0x7f20bc0833a0 2023-11-15T01:37:29.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.620+0000 7f20c1949700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc065660 con 0x7f20bc154450 2023-11-15T01:37:29.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.621+0000 7f20baffd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20bc154450 0x7f20bc0a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:29.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.621+0000 7f20ba7fc700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f20bc0833a0 0x7f20bc154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:29.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.621+0000 7f20ba7fc700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f20bc0833a0 0x7f20bc154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:45414/0 (socket says 172.21.15.1:45414) 2023-11-15T01:37:29.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.621+0000 7f20ba7fc700 1 -- 172.21.15.1:0/2270789745 learned_addr learned my addr 172.21.15.1:0/2270789745 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:29.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.621+0000 7f20baffd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20bc154450 0x7f20bc0a7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:38098/0 (socket says 172.21.15.1:38098) 2023-11-15T01:37:29.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.621+0000 7f20baffd700 1 -- 172.21.15.1:0/2270789745 >> v2:172.21.15.141:3300/0 conn(0x7f20bc0833a0 msgr2=0x7f20bc154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:29.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.621+0000 7f20baffd700 1 --2- 172.21.15.1:0/2270789745 >> v2:172.21.15.141:3300/0 conn(0x7f20bc0833a0 0x7f20bc154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.621+0000 7f20baffd700 1 -- 172.21.15.1:0/2270789745 >> v1:172.21.15.141:6789/0 conn(0x7f20bc0bde10 legacy=0x7f20bc0be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.621+0000 7f20baffd700 1 -- 172.21.15.1:0/2270789745 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc0c6f50 con 0x7f20bc154450 2023-11-15T01:37:29.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.621+0000 7f20baffd700 1 --2- 172.21.15.1:0/2270789745 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20bc154450 0x7f20bc0a7ef0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f20b4006fd0 tx=0x7f20b4006f40).ready entity=mon.2 client_cookie=7519cd060d60d48 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:29.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.621+0000 7f20b9ffb700 1 -- 172.21.15.1:0/2270789745 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4005880 con 0x7f20bc154450 2023-11-15T01:37:29.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.622+0000 7f20b9ffb700 1 -- 172.21.15.1:0/2270789745 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b40059e0 con 0x7f20bc154450 2023-11-15T01:37:29.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.622+0000 7f20b9ffb700 1 -- 172.21.15.1:0/2270789745 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4005d60 con 0x7f20bc154450 2023-11-15T01:37:29.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.622+0000 7f20c1949700 1 -- 172.21.15.1:0/2270789745 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20bc154450 msgr2=0x7f20bc0a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.622+0000 7f20c1949700 1 --2- 172.21.15.1:0/2270789745 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20bc154450 0x7f20bc0a7ef0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f20b4006fd0 tx=0x7f20b4006f40).stop 2023-11-15T01:37:29.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.622+0000 7f20c1949700 1 -- 172.21.15.1:0/2270789745 shutdown_connections 2023-11-15T01:37:29.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.622+0000 7f20c1949700 1 --2- 172.21.15.1:0/2270789745 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20bc154450 0x7f20bc0a7ef0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.622+0000 7f20c1949700 1 --2- 172.21.15.1:0/2270789745 >> v2:172.21.15.141:3300/0 conn(0x7f20bc0833a0 0x7f20bc154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.622+0000 7f20c1949700 1 -- 172.21.15.1:0/2270789745 >> 172.21.15.1:0/2270789745 conn(0x7f20bc082f90 msgr2=0x7f20bc0c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:29.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.622+0000 7f20c1949700 1 -- 172.21.15.1:0/2270789745 shutdown_connections 2023-11-15T01:37:29.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.622+0000 7f20c1949700 1 -- 172.21.15.1:0/2270789745 wait complete. 2023-11-15T01:37:29.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.623+0000 7f20c1949700 1 Processor -- start 2023-11-15T01:37:29.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.623+0000 7f20c1949700 1 -- start start 2023-11-15T01:37:29.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.624+0000 7f20c1949700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20bc0833a0 0x7f20bc0ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.624+0000 7f20c1949700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20bc0bde10 0x7f20bc0adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.624+0000 7f20c1949700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20bc154450 0x7f20bc0ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.624+0000 7f20c1949700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc165100 con 0x7f20bc0bde10 2023-11-15T01:37:29.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.624+0000 7f20c1949700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc0ab640 con 0x7f20bc0833a0 2023-11-15T01:37:29.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.624+0000 7f20c1949700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc0ae9f0 con 0x7f20bc154450 2023-11-15T01:37:29.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.624+0000 7f20ba7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20bc0bde10 0x7f20bc0adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:29.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.624+0000 7f20ba7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20bc0bde10 0x7f20bc0adf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43560/0 (socket says 172.21.15.1:43560) 2023-11-15T01:37:29.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.624+0000 7f20ba7fc700 1 -- 172.21.15.1:0/1846539225 learned_addr learned my addr 172.21.15.1:0/1846539225 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:29.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.624+0000 7f20baffd700 1 --2- 172.21.15.1:0/1846539225 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20bc0833a0 0x7f20bc0ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:29.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.624+0000 7f20bb7fe700 1 --2- 172.21.15.1:0/1846539225 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20bc154450 0x7f20bc0ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:29.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.625+0000 7f20ba7fc700 1 -- 172.21.15.1:0/1846539225 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20bc154450 msgr2=0x7f20bc0ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.625+0000 7f20ba7fc700 1 --2- 172.21.15.1:0/1846539225 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20bc154450 0x7f20bc0ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.625+0000 7f20ba7fc700 1 -- 172.21.15.1:0/1846539225 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20bc0833a0 msgr2=0x7f20bc0ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.625+0000 7f20ba7fc700 1 --2- 172.21.15.1:0/1846539225 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20bc0833a0 0x7f20bc0ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.625+0000 7f20ba7fc700 1 -- 172.21.15.1:0/1846539225 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b4009250 con 0x7f20bc0bde10 2023-11-15T01:37:29.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.625+0000 7f20bb7fe700 1 --2- 172.21.15.1:0/1846539225 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20bc154450 0x7f20bc0ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:29.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.625+0000 7f20ba7fc700 1 --2- 172.21.15.1:0/1846539225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20bc0bde10 0x7f20bc0adf70 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f20a400e8d0 tx=0x7f20a40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:29.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.625+0000 7f20b2ffd700 1 -- 172.21.15.1:0/1846539225 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4009410 con 0x7f20bc0bde10 2023-11-15T01:37:29.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.625+0000 7f20b2ffd700 1 -- 172.21.15.1:0/1846539225 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a4012600 con 0x7f20bc0bde10 2023-11-15T01:37:29.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.625+0000 7f20b2ffd700 1 -- 172.21.15.1:0/1846539225 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4012980 con 0x7f20bc0bde10 2023-11-15T01:37:29.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.625+0000 7f20c1949700 1 -- 172.21.15.1:0/1846539225 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20bc0aecd0 con 0x7f20bc0bde10 2023-11-15T01:37:29.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.625+0000 7f20c1949700 1 -- 172.21.15.1:0/1846539225 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20bc164a70 con 0x7f20bc0bde10 2023-11-15T01:37:29.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.626+0000 7f20c1949700 1 -- 172.21.15.1:0/1846539225 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20bc1652b0 con 0x7f20bc0bde10 2023-11-15T01:37:29.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.626+0000 7f20b2ffd700 1 -- 172.21.15.1:0/1846539225 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f20a4012d30 con 0x7f20bc0bde10 2023-11-15T01:37:29.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.627+0000 7f20b2ffd700 1 --2- 172.21.15.1:0/1846539225 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f209c05f270 0x7f209c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.627+0000 7f20b2ffd700 1 -- 172.21.15.1:0/1846539225 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f20a407a1b0 con 0x7f20bc0bde10 2023-11-15T01:37:29.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.627+0000 7f20baffd700 1 --2- 172.21.15.1:0/1846539225 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f209c05f270 0x7f209c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:29.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.627+0000 7f20baffd700 1 --2- 172.21.15.1:0/1846539225 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f209c05f270 0x7f209c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f20b4006f80 tx=0x7f20b4016000).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:29.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.631+0000 7f20b2ffd700 1 -- 172.21.15.1:0/1846539225 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f20bc1652b0 con 0x7f20bc0bde10 2023-11-15T01:37:29.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.801+0000 7f20c1949700 1 -- 172.21.15.1:0/1846539225 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20bc1652b0 con 0x7f209c05f270 2023-11-15T01:37:29.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.811+0000 7f20b2ffd700 1 -- 172.21.15.1:0/1846539225 <== mgr.6466 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+349618 (secure 0 0 0) 0x7f20bc1652b0 con 0x7f209c05f270 2023-11-15T01:37:29.817 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:29.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.815+0000 7f20c1949700 1 -- 172.21.15.1:0/1846539225 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f209c05f270 msgr2=0x7f209c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.815+0000 7f20c1949700 1 --2- 172.21.15.1:0/1846539225 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f209c05f270 0x7f209c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f20b4006f80 tx=0x7f20b4016000).stop 2023-11-15T01:37:29.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.815+0000 7f20c1949700 1 -- 172.21.15.1:0/1846539225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20bc0bde10 msgr2=0x7f20bc0adf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.815+0000 7f20c1949700 1 --2- 172.21.15.1:0/1846539225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20bc0bde10 0x7f20bc0adf70 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f20a400e8d0 tx=0x7f20a40090f0).stop 2023-11-15T01:37:29.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.815+0000 7f20c1949700 1 -- 172.21.15.1:0/1846539225 shutdown_connections 2023-11-15T01:37:29.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.815+0000 7f20c1949700 1 --2- 172.21.15.1:0/1846539225 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f209c05f270 0x7f209c061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.815+0000 7f20c1949700 1 --2- 172.21.15.1:0/1846539225 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20bc154450 0x7f20bc0ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.815+0000 7f20c1949700 1 --2- 172.21.15.1:0/1846539225 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20bc0833a0 0x7f20bc0ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.815+0000 7f20c1949700 1 --2- 172.21.15.1:0/1846539225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20bc0bde10 0x7f20bc0adf70 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.815+0000 7f20c1949700 1 -- 172.21.15.1:0/1846539225 >> 172.21.15.1:0/1846539225 conn(0x7f20bc082f90 msgr2=0x7f20bc151040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:29.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.815+0000 7f20c1949700 1 -- 172.21.15.1:0/1846539225 shutdown_connections 2023-11-15T01:37:29.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.815+0000 7f20c1949700 1 -- 172.21.15.1:0/1846539225 wait complete. 2023-11-15T01:37:29.822 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:37:29.828 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T01:37:28.351842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2427808,"kb_used_data":10080,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752546912,"statfs":{"total":773094113280,"available":770608037888,"internally_reserved":0,"allocated":10321920,"data_stored":5280920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5548,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.005618"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.490709+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:37:20.490709+0000","last_peered":"2023-11-15T01:37:20.490709+0000","last_clean":"2023-11-15T01:37:20.490709+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:37:20.490709+0000","last_undegraded":"2023-11-15T01:37:20.490709+0000","last_fullsized":"2023-11-15T01:37:20.490709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.490642+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:37:20.490642+0000","last_peered":"2023-11-15T01:37:20.490642+0000","last_clean":"2023-11-15T01:37:20.490642+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:37:20.490642+0000","last_undegraded":"2023-11-15T01:37:20.490642+0000","last_fullsized":"2023-11-15T01:37:20.490642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.490976+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:37:20.490976+0000","last_peered":"2023-11-15T01:37:20.490976+0000","last_clean":"2023-11-15T01:37:20.490976+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:37:20.490976+0000","last_undegraded":"2023-11-15T01:37:20.490976+0000","last_fullsized":"2023-11-15T01:37:20.490976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.490695+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:37:20.490695+0000","last_peered":"2023-11-15T01:37:20.490695+0000","last_clean":"2023-11-15T01:37:20.490695+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:37:20.490695+0000","last_undegraded":"2023-11-15T01:37:20.490695+0000","last_fullsized":"2023-11-15T01:37:20.490695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":80,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.425222+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:37:20.425222+0000","last_peered":"2023-11-15T01:37:20.425222+0000","last_clean":"2023-11-15T01:37:20.425222+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:37:20.425222+0000","last_undegraded":"2023-11-15T01:37:20.425222+0000","last_fullsized":"2023-11-15T01:37:20.425222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.425282+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:37:20.425282+0000","last_peered":"2023-11-15T01:37:20.425282+0000","last_clean":"2023-11-15T01:37:20.425282+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:37:20.425282+0000","last_undegraded":"2023-11-15T01:37:20.425282+0000","last_fullsized":"2023-11-15T01:37:20.425282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.425239+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:37:20.425239+0000","last_peered":"2023-11-15T01:37:20.425239+0000","last_clean":"2023-11-15T01:37:20.425239+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:37:20.425239+0000","last_undegraded":"2023-11-15T01:37:20.425239+0000","last_fullsized":"2023-11-15T01:37:20.425239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.490797+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:37:20.490797+0000","last_peered":"2023-11-15T01:37:20.490797+0000","last_clean":"2023-11-15T01:37:20.490797+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:37:20.490797+0000","last_undegraded":"2023-11-15T01:37:20.490797+0000","last_fullsized":"2023-11-15T01:37:20.490797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":93,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.346112+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:37:20.346112+0000","last_peered":"2023-11-15T01:37:20.346112+0000","last_clean":"2023-11-15T01:37:20.346112+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:37:20.346112+0000","last_undegraded":"2023-11-15T01:37:20.346112+0000","last_fullsized":"2023-11-15T01:37:20.346112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68500000000000005,"5min":0.71199999999999997,"15min":0.82299999999999995},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.35799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":2.9020000000000001,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.68200000000000005}]},{"osd":1,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68500000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.34499999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67100000000000004,"5min":0.80800000000000005,"15min":0.81499999999999995},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.82599999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73799999999999999,"5min":0.82299999999999995,"15min":0.86299999999999999},"last":0.42999999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.80700000000000005,"15min":0.85999999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.9209999999999998,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.64100000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45400000000000001,"15min":0.46500000000000002},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.84499999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.67400000000000004}]},{"osd":5,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47699999999999998,"15min":0.48499999999999999},"min":{"1min":0.26500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.36499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72299999999999998,"5min":0.73899999999999999,"15min":0.78500000000000003},"last":0.48499999999999999}]},{"osd":6,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82999999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.73999999999999999,"5min":0.755,"15min":0.85099999999999998},"last":0.63}]}]},{"osd":6,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.29199999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73299999999999998,"5min":0.89000000000000001,"15min":0.97799999999999998},"last":0.56399999999999995}]},{"osd":1,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54900000000000004,"15min":0.56299999999999994},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.0649999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.33100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.60199999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.75700000000000001,"5min":0.79100000000000004,"15min":1.038},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.68100000000000005}]},{"osd":3,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.77100000000000002,"5min":0.85499999999999998,"15min":1.028},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35699999999999998},"max":{"1min":0.67100000000000004,"5min":0.874,"15min":1.004},"last":0.621}]},{"osd":4,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44700000000000001,"15min":0.44800000000000001},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.68200000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.25800000000000001},"max":{"1min":0.65400000000000003,"5min":0.73299999999999998,"15min":0.81799999999999995},"last":0.435}]},{"osd":5,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63500000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.70999999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65200000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.496,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":0.64000000000000001,"5min":0.72099999999999997,"15min":0.86499999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.34000000000000002},"max":{"1min":0.67200000000000004,"5min":0.82399999999999995,"15min":1.0009999999999999},"last":0.55300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575039,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.373,"15min":0.376},"min":{"1min":0.25,"5min":0.249,"15min":0.23999999999999999},"max":{"1min":0.59099999999999997,"5min":0.73699999999999999,"15min":0.77800000000000002},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.42299999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.22600000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.312}]},{"osd":3,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.31},"max":{"1min":9.641,"5min":9.641,"15min":9.641},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.53800000000000003,"15min":0.496},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.28000000000000003},"max":{"1min":9.6199999999999992,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.39500000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.68500000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.378},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.0509999999999999},"last":0.34100000000000003}]},{"osd":5,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71699999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.624},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.40400000000000003,"15min":0.373},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.51000000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.46200000000000002,"5min":0.441,"15min":0.42799999999999999},"max":{"1min":0.77500000000000002,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0429999999999999,"5min":1.0509999999999999,"15min":1.25},"last":0.433},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66800000000000004,"15min":0.68799999999999994},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81499999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.375,"15min":0.36899999999999999},"min":{"1min":0.23799999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.498,"5min":2.024,"15min":2.024},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.42799999999999999,"15min":0.41599999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.215},"max":{"1min":0.60199999999999998,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.371}]},{"osd":2,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.39200000000000002,"15min":0.38700000000000001},"min":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.44600000000000001,"5min":1.768,"15min":1.768},"last":0.25},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.437,"15min":0.44},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60799999999999998,"5min":1.982,"15min":1.982},"last":0.30499999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.433,"15min":0.434},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.22500000000000001},"max":{"1min":0.58599999999999997,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.45400000000000001,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.28100000000000003,"15min":0.27700000000000002},"max":{"1min":0.56299999999999994,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.29799999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79400000000000004,"5min":0.97799999999999998,"15min":1.454},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82799999999999996,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78500000000000003,"5min":1.881,"15min":1.881},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.42199999999999999,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.80400000000000005,"5min":0.88300000000000001,"15min":1.1120000000000001},"last":0.502}]},{"osd":6,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81799999999999995,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85799999999999998,"5min":1.917,"15min":1.917},"last":0.47699999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.85399999999999998,"5min":1.843,"15min":1.843},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67400000000000004,"15min":0.68999999999999995},"min":{"1min":0.49399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84599999999999997,"5min":0.92300000000000004,"15min":1.4119999999999999},"last":0.53100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306548,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065292,"statfs":{"total":96636764160,"available":96322859008,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36499999999999999,"15min":0.36899999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52500000000000002,"5min":0.55100000000000005,"15min":0.61899999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.39800000000000002,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.57699999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.248}]},{"osd":1,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.222},"max":{"1min":0.745,"5min":0.745,"15min":0.75},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.441,"15min":0.442},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.69799999999999995,"5min":0.73499999999999999,"15min":0.92000000000000004},"last":0.313}]},{"osd":3,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.248},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45000000000000001,"15min":0.44400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.253},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.35699999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59999999999999998,"15min":0.625},"min":{"1min":0.41299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92700000000000005,"5min":1.0549999999999999,"15min":1.0800000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.39200000000000002},"max":{"1min":0.872,"5min":0.91100000000000003,"15min":1.052},"last":0.55700000000000005}]},{"osd":5,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.627,"15min":0.64800000000000002},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.89400000000000002,"5min":1.032,"15min":1.032},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.64100000000000001},"min":{"1min":0.44700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.871,"5min":0.96699999999999997,"15min":1.1339999999999999},"last":0.48499999999999999}]},{"osd":6,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.66300000000000003},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.876,"5min":1.002,"15min":1.0389999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.65300000000000002,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85699999999999998,"5min":1.0669999999999999,"15min":1.119},"last":0.53900000000000003}]},{"osd":7,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.67700000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78300000000000003,"5min":1.079,"15min":1.103},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67600000000000005,"15min":0.69499999999999995},"min":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.86599999999999999,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.503}]}]},{"osd":3,"up_from":13,"seq":55834575039,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306548,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065292,"statfs":{"total":96636764160,"available":96322859008,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48399999999999999,"5min":0.65900000000000003,"15min":0.79900000000000004},"last":0.313},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.38200000000000001,"15min":0.39800000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23200000000000001},"max":{"1min":0.60699999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.34599999999999997}]},{"osd":1,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.371,"15min":0.38700000000000001},"min":{"1min":0.27000000000000002,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":0.47499999999999998,"5min":0.59799999999999998,"15min":0.72899999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.42799999999999999,"15min":0.44400000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52700000000000002,"5min":0.72499999999999998,"15min":0.80500000000000005},"last":0.41599999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.42699999999999999,"15min":0.44600000000000001},"min":{"1min":0.28000000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61699999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.45300000000000001,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26200000000000001},"max":{"1min":0.53000000000000003,"5min":0.69199999999999995,"15min":0.81999999999999995},"last":0.38100000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58699999999999997,"15min":0.61799999999999999},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.80800000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.627},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.39000000000000001},"max":{"1min":0.73599999999999999,"5min":0.89200000000000002,"15min":1.0589999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.60299999999999998,"15min":0.63600000000000001},"min":{"1min":0.41799999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.72799999999999998,"5min":0.92000000000000004,"15min":1.0569999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61299999999999999,"15min":0.64100000000000001},"min":{"1min":0.375,"5min":0.373,"15min":0.373},"max":{"1min":0.84899999999999998,"5min":0.879,"15min":0.95999999999999996},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61699999999999999,"15min":0.64700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":0.94299999999999995,"15min":1.0980000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.67100000000000004},"min":{"1min":0.442,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73999999999999999,"5min":0.95799999999999996,"15min":1.169},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63500000000000001,"15min":0.66800000000000004},"min":{"1min":0.41999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88700000000000001,"5min":1.0429999999999999,"15min":1.071},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.64500000000000002,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75800000000000001,"5min":0.996,"15min":1.1459999999999999},"last":0.52200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76500000000000001,"5min":0.88,"15min":0.88},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.32900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65600000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.38800000000000001}]},{"osd":1,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55700000000000005,"15min":0.57199999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.746,"5min":1.087,"15min":1.087},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34699999999999998},"max":{"1min":0.69199999999999995,"5min":0.76600000000000001,"15min":0.81000000000000005},"last":0.34799999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.34699999999999998,"15min":0.33100000000000002},"max":{"1min":0.78900000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.436}]},{"osd":3,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72099999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.5}]},{"osd":5,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30399999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.30399999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.44700000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.34000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.53000000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82799999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52400000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.46999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78500000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.81200000000000006},"last":0.48599999999999999}]},{"osd":1,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32600000000000001},"max":{"1min":0.68799999999999994,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33400000000000002},"max":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.375}]},{"osd":2,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.86199999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34999999999999998},"max":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":1.103},"last":0.432}]},{"osd":3,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.376,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":1.127},"last":0.38800000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64400000000000002,"5min":0.66500000000000004,"15min":0.94399999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.50800000000000001,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.52200000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46400000000000002,"15min":0.47599999999999998},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74399999999999999,"5min":0.83099999999999996,"15min":1.0660000000000001},"last":0.499},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.47299999999999998,"15min":0.495},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57099999999999995}]},{"osd":7,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48099999999999998,"15min":0.498},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.69899999999999995,"5min":0.72999999999999998,"15min":0.97199999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":0.85799999999999998,"15min":1.1499999999999999},"last":0.58199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:37:29.836 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:37:29.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.985+0000 7feaee979700 1 Processor -- start 2023-11-15T01:37:29.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.985+0000 7feaee979700 1 -- start start 2023-11-15T01:37:29.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.986+0000 7feaee979700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7feae8154450 0x7feae80a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.986+0000 7feaee979700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feae80833a0 0x7feae8154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.986+0000 7feaee979700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feae80bde10 0x7feae80be2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.986+0000 7feaee979700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae8065940 con 0x7feae80833a0 2023-11-15T01:37:29.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.986+0000 7feaee979700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae80be790 con 0x7feae8154450 2023-11-15T01:37:29.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.986+0000 7feaee979700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae80a85e0 con 0x7feae80bde10 2023-11-15T01:37:29.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.986+0000 7feae77fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feae80833a0 0x7feae8154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:29.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.986+0000 7feae77fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feae80833a0 0x7feae8154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43570/0 (socket says 172.21.15.1:43570) 2023-11-15T01:37:29.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.986+0000 7feae77fe700 1 -- 172.21.15.1:0/4064470679 learned_addr learned my addr 172.21.15.1:0/4064470679 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:29.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.987+0000 7feaecf16700 1 --2- 172.21.15.1:0/4064470679 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feae80bde10 0x7feae80be2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:29.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.987+0000 7feae7fff700 1 --2- 172.21.15.1:0/4064470679 >> v2:172.21.15.141:3300/0 conn(0x7feae8154450 0x7feae80a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:29.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.987+0000 7feae77fe700 1 -- 172.21.15.1:0/4064470679 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feae80bde10 msgr2=0x7feae80be2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:29.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.987+0000 7feae77fe700 1 --2- 172.21.15.1:0/4064470679 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feae80bde10 0x7feae80be2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.987+0000 7feae77fe700 1 -- 172.21.15.1:0/4064470679 >> v2:172.21.15.141:3300/0 conn(0x7feae8154450 msgr2=0x7feae80a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:29.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.987+0000 7feae77fe700 1 --2- 172.21.15.1:0/4064470679 >> v2:172.21.15.141:3300/0 conn(0x7feae8154450 0x7feae80a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.987+0000 7feae77fe700 1 -- 172.21.15.1:0/4064470679 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8065660 con 0x7feae80833a0 2023-11-15T01:37:29.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.987+0000 7feae7fff700 1 --2- 172.21.15.1:0/4064470679 >> v2:172.21.15.141:3300/0 conn(0x7feae8154450 0x7feae80a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:37:29.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.987+0000 7feae77fe700 1 --2- 172.21.15.1:0/4064470679 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae80833a0 0x7feae8154830 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7feae8066140 tx=0x7feadc0090f0).ready entity=mon.0 client_cookie=5472079342d8085b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:29.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.987+0000 7feae6ffd700 1 -- 172.21.15.1:0/4064470679 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc00b600 con 0x7feae80833a0 2023-11-15T01:37:29.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.987+0000 7feae6ffd700 1 -- 172.21.15.1:0/4064470679 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc00b760 con 0x7feae80833a0 2023-11-15T01:37:29.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.987+0000 7feae6ffd700 1 -- 172.21.15.1:0/4064470679 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc00bae0 con 0x7feae80833a0 2023-11-15T01:37:29.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.988+0000 7feaee979700 1 -- 172.21.15.1:0/4064470679 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae80833a0 msgr2=0x7feae8154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:29.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.988+0000 7feaee979700 1 --2- 172.21.15.1:0/4064470679 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae80833a0 0x7feae8154830 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7feae8066140 tx=0x7feadc0090f0).stop 2023-11-15T01:37:29.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.988+0000 7feaee979700 1 -- 172.21.15.1:0/4064470679 shutdown_connections 2023-11-15T01:37:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.988+0000 7feaee979700 1 --2- 172.21.15.1:0/4064470679 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feae80bde10 0x7feae80be2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.988+0000 7feaee979700 1 --2- 172.21.15.1:0/4064470679 >> v2:172.21.15.141:3300/0 conn(0x7feae8154450 0x7feae80a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.988+0000 7feaee979700 1 --2- 172.21.15.1:0/4064470679 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae80833a0 0x7feae8154830 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.988+0000 7feaee979700 1 -- 172.21.15.1:0/4064470679 >> 172.21.15.1:0/4064470679 conn(0x7feae8082f90 msgr2=0x7feae80c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.988+0000 7feaee979700 1 -- 172.21.15.1:0/4064470679 shutdown_connections 2023-11-15T01:37:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.988+0000 7feaee979700 1 -- 172.21.15.1:0/4064470679 wait complete. 2023-11-15T01:37:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.989+0000 7feaee979700 1 Processor -- start 2023-11-15T01:37:29.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.989+0000 7feaee979700 1 -- start start 2023-11-15T01:37:29.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feaee979700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feae80833a0 0x7feae814e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feaee979700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feae80bde10 0x7feae80add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feaee979700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae8154450 0x7feae80ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:29.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feaee979700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae80a5df0 con 0x7feae8154450 2023-11-15T01:37:29.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feaee979700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae80a60d0 con 0x7feae80bde10 2023-11-15T01:37:30.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feaee979700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae80a63b0 con 0x7feae80833a0 2023-11-15T01:37:30.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feaecf16700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae8154450 0x7feae80ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feaecf16700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae8154450 0x7feae80ae210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43576/0 (socket says 172.21.15.1:43576) 2023-11-15T01:37:30.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feaecf16700 1 -- 172.21.15.1:0/1961120504 learned_addr learned my addr 172.21.15.1:0/1961120504 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:30.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feae7fff700 1 --2- 172.21.15.1:0/1961120504 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feae80833a0 0x7feae814e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feae77fe700 1 --2- 172.21.15.1:0/1961120504 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feae80bde10 0x7feae80add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feaecf16700 1 -- 172.21.15.1:0/1961120504 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feae80833a0 msgr2=0x7feae814e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feaecf16700 1 --2- 172.21.15.1:0/1961120504 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feae80833a0 0x7feae814e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feaecf16700 1 -- 172.21.15.1:0/1961120504 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feae80bde10 msgr2=0x7feae80add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feaecf16700 1 --2- 172.21.15.1:0/1961120504 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feae80bde10 0x7feae80add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feaecf16700 1 -- 172.21.15.1:0/1961120504 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc009370 con 0x7feae8154450 2023-11-15T01:37:30.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feaecf16700 1 --2- 172.21.15.1:0/1961120504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae8154450 0x7feae80ae210 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7feae0009fa0 tx=0x7feae0009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:30.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feacffff700 1 -- 172.21.15.1:0/1961120504 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae000ebc0 con 0x7feae8154450 2023-11-15T01:37:30.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.990+0000 7feacffff700 1 -- 172.21.15.1:0/1961120504 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae000ed20 con 0x7feae8154450 2023-11-15T01:37:30.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.991+0000 7feaee979700 1 -- 172.21.15.1:0/1961120504 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae80a6690 con 0x7feae8154450 2023-11-15T01:37:30.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.991+0000 7feacffff700 1 -- 172.21.15.1:0/1961120504 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0014610 con 0x7feae8154450 2023-11-15T01:37:30.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.991+0000 7feaee979700 1 -- 172.21.15.1:0/1961120504 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae814e520 con 0x7feae8154450 2023-11-15T01:37:30.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.992+0000 7feaee979700 1 -- 172.21.15.1:0/1961120504 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae806c7e0 con 0x7feae8154450 2023-11-15T01:37:30.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.992+0000 7feacffff700 1 -- 172.21.15.1:0/1961120504 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7feae001d3b0 con 0x7feae8154450 2023-11-15T01:37:30.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.992+0000 7feacffff700 1 --2- 172.21.15.1:0/1961120504 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fead405f270 0x7fead4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:30.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.992+0000 7feacffff700 1 -- 172.21.15.1:0/1961120504 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7feae007a9f0 con 0x7feae8154450 2023-11-15T01:37:30.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.993+0000 7feae7fff700 1 --2- 172.21.15.1:0/1961120504 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fead405f270 0x7fead4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.993+0000 7feae7fff700 1 --2- 172.21.15.1:0/1961120504 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fead405f270 0x7fead4061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fead800abb0 tx=0x7fead8008040).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:30.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:29.996+0000 7feacffff700 1 -- 172.21.15.1:0/1961120504 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7feae004b930 con 0x7feae8154450 2023-11-15T01:37:30.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.162+0000 7feaee979700 1 -- 172.21.15.1:0/1961120504 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feae81516b0 con 0x7fead405f270 2023-11-15T01:37:30.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.172+0000 7feacffff700 1 -- 172.21.15.1:0/1961120504 <== mgr.6466 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+349618 (secure 0 0 0) 0x7feae81516b0 con 0x7fead405f270 2023-11-15T01:37:30.178 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:30.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.175+0000 7feaee979700 1 -- 172.21.15.1:0/1961120504 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fead405f270 msgr2=0x7fead4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.175+0000 7feaee979700 1 --2- 172.21.15.1:0/1961120504 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fead405f270 0x7fead4061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fead800abb0 tx=0x7fead8008040).stop 2023-11-15T01:37:30.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.175+0000 7feaee979700 1 -- 172.21.15.1:0/1961120504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae8154450 msgr2=0x7feae80ae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.175+0000 7feaee979700 1 --2- 172.21.15.1:0/1961120504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae8154450 0x7feae80ae210 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7feae0009fa0 tx=0x7feae0009900).stop 2023-11-15T01:37:30.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.175+0000 7feaee979700 1 -- 172.21.15.1:0/1961120504 shutdown_connections 2023-11-15T01:37:30.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.175+0000 7feaee979700 1 --2- 172.21.15.1:0/1961120504 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fead405f270 0x7fead4061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.175+0000 7feaee979700 1 --2- 172.21.15.1:0/1961120504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae8154450 0x7feae80ae210 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.175+0000 7feaee979700 1 --2- 172.21.15.1:0/1961120504 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feae80833a0 0x7feae814e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.175+0000 7feaee979700 1 --2- 172.21.15.1:0/1961120504 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feae80bde10 0x7feae80add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.175+0000 7feaee979700 1 -- 172.21.15.1:0/1961120504 >> 172.21.15.1:0/1961120504 conn(0x7feae8082f90 msgr2=0x7feae80c7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:30.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.175+0000 7feaee979700 1 -- 172.21.15.1:0/1961120504 shutdown_connections 2023-11-15T01:37:30.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.175+0000 7feaee979700 1 -- 172.21.15.1:0/1961120504 wait complete. 2023-11-15T01:37:30.183 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:37:30.188 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T01:37:28.351842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2427808,"kb_used_data":10080,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752546912,"statfs":{"total":773094113280,"available":770608037888,"internally_reserved":0,"allocated":10321920,"data_stored":5280920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5548,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.005618"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.490709+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:37:20.490709+0000","last_peered":"2023-11-15T01:37:20.490709+0000","last_clean":"2023-11-15T01:37:20.490709+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:37:20.490709+0000","last_undegraded":"2023-11-15T01:37:20.490709+0000","last_fullsized":"2023-11-15T01:37:20.490709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.490642+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:37:20.490642+0000","last_peered":"2023-11-15T01:37:20.490642+0000","last_clean":"2023-11-15T01:37:20.490642+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:37:20.490642+0000","last_undegraded":"2023-11-15T01:37:20.490642+0000","last_fullsized":"2023-11-15T01:37:20.490642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.490976+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:37:20.490976+0000","last_peered":"2023-11-15T01:37:20.490976+0000","last_clean":"2023-11-15T01:37:20.490976+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:37:20.490976+0000","last_undegraded":"2023-11-15T01:37:20.490976+0000","last_fullsized":"2023-11-15T01:37:20.490976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.490695+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:37:20.490695+0000","last_peered":"2023-11-15T01:37:20.490695+0000","last_clean":"2023-11-15T01:37:20.490695+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:37:20.490695+0000","last_undegraded":"2023-11-15T01:37:20.490695+0000","last_fullsized":"2023-11-15T01:37:20.490695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":80,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.425222+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:37:20.425222+0000","last_peered":"2023-11-15T01:37:20.425222+0000","last_clean":"2023-11-15T01:37:20.425222+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:37:20.425222+0000","last_undegraded":"2023-11-15T01:37:20.425222+0000","last_fullsized":"2023-11-15T01:37:20.425222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.425282+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:37:20.425282+0000","last_peered":"2023-11-15T01:37:20.425282+0000","last_clean":"2023-11-15T01:37:20.425282+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:37:20.425282+0000","last_undegraded":"2023-11-15T01:37:20.425282+0000","last_fullsized":"2023-11-15T01:37:20.425282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.425239+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:37:20.425239+0000","last_peered":"2023-11-15T01:37:20.425239+0000","last_clean":"2023-11-15T01:37:20.425239+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:37:20.425239+0000","last_undegraded":"2023-11-15T01:37:20.425239+0000","last_fullsized":"2023-11-15T01:37:20.425239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.490797+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:37:20.490797+0000","last_peered":"2023-11-15T01:37:20.490797+0000","last_clean":"2023-11-15T01:37:20.490797+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:37:20.490797+0000","last_undegraded":"2023-11-15T01:37:20.490797+0000","last_fullsized":"2023-11-15T01:37:20.490797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:25.389790+0000","last_change":"2023-11-15T01:37:25.389790+0000","last_active":"2023-11-15T01:37:25.389790+0000","last_peered":"2023-11-15T01:37:25.389790+0000","last_clean":"2023-11-15T01:37:25.389790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:25.389790+0000","last_undegraded":"2023-11-15T01:37:25.389790+0000","last_fullsized":"2023-11-15T01:37:25.389790+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:37:24.385332+0000","last_change":"2023-11-15T01:37:24.385332+0000","last_active":"2023-11-15T01:37:24.385332+0000","last_peered":"2023-11-15T01:37:24.385332+0000","last_clean":"2023-11-15T01:37:24.385332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:37:24.385332+0000","last_undegraded":"2023-11-15T01:37:24.385332+0000","last_fullsized":"2023-11-15T01:37:24.385332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":93,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-11-15T01:37:20.346112+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:37:20.346112+0000","last_peered":"2023-11-15T01:37:20.346112+0000","last_clean":"2023-11-15T01:37:20.346112+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:37:20.346112+0000","last_undegraded":"2023-11-15T01:37:20.346112+0000","last_fullsized":"2023-11-15T01:37:20.346112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68500000000000005,"5min":0.71199999999999997,"15min":0.82299999999999995},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.35799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":2.9020000000000001,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.68200000000000005}]},{"osd":1,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68500000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.34499999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67100000000000004,"5min":0.80800000000000005,"15min":0.81499999999999995},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.82599999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73799999999999999,"5min":0.82299999999999995,"15min":0.86299999999999999},"last":0.42999999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.80700000000000005,"15min":0.85999999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.9209999999999998,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.64100000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45400000000000001,"15min":0.46500000000000002},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.84499999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.67400000000000004}]},{"osd":5,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47699999999999998,"15min":0.48499999999999999},"min":{"1min":0.26500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.36499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72299999999999998,"5min":0.73899999999999999,"15min":0.78500000000000003},"last":0.48499999999999999}]},{"osd":6,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82999999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.73999999999999999,"5min":0.755,"15min":0.85099999999999998},"last":0.63}]}]},{"osd":6,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.29199999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73299999999999998,"5min":0.89000000000000001,"15min":0.97799999999999998},"last":0.56399999999999995}]},{"osd":1,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54900000000000004,"15min":0.56299999999999994},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.0649999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.33100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.60199999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.75700000000000001,"5min":0.79100000000000004,"15min":1.038},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.68100000000000005}]},{"osd":3,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.77100000000000002,"5min":0.85499999999999998,"15min":1.028},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35699999999999998},"max":{"1min":0.67100000000000004,"5min":0.874,"15min":1.004},"last":0.621}]},{"osd":4,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44700000000000001,"15min":0.44800000000000001},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.68200000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.25800000000000001},"max":{"1min":0.65400000000000003,"5min":0.73299999999999998,"15min":0.81799999999999995},"last":0.435}]},{"osd":5,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63500000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.70999999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65200000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.496,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":0.64000000000000001,"5min":0.72099999999999997,"15min":0.86499999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.34000000000000002},"max":{"1min":0.67200000000000004,"5min":0.82399999999999995,"15min":1.0009999999999999},"last":0.55300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575039,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.373,"15min":0.376},"min":{"1min":0.25,"5min":0.249,"15min":0.23999999999999999},"max":{"1min":0.59099999999999997,"5min":0.73699999999999999,"15min":0.77800000000000002},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.42299999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.22600000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.312}]},{"osd":3,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.31},"max":{"1min":9.641,"5min":9.641,"15min":9.641},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.53800000000000003,"15min":0.496},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.28000000000000003},"max":{"1min":9.6199999999999992,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.39500000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.68500000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.378},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.0509999999999999},"last":0.34100000000000003}]},{"osd":5,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71699999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.624},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.40400000000000003,"15min":0.373},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.51000000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.46200000000000002,"5min":0.441,"15min":0.42799999999999999},"max":{"1min":0.77500000000000002,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0429999999999999,"5min":1.0509999999999999,"15min":1.25},"last":0.433},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66800000000000004,"15min":0.68799999999999994},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81499999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.375,"15min":0.36899999999999999},"min":{"1min":0.23799999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.498,"5min":2.024,"15min":2.024},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.42799999999999999,"15min":0.41599999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.215},"max":{"1min":0.60199999999999998,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.371}]},{"osd":2,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.39200000000000002,"15min":0.38700000000000001},"min":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.44600000000000001,"5min":1.768,"15min":1.768},"last":0.25},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.437,"15min":0.44},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60799999999999998,"5min":1.982,"15min":1.982},"last":0.30499999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.433,"15min":0.434},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.22500000000000001},"max":{"1min":0.58599999999999997,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.45400000000000001,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.28100000000000003,"15min":0.27700000000000002},"max":{"1min":0.56299999999999994,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.29799999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79400000000000004,"5min":0.97799999999999998,"15min":1.454},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82799999999999996,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78500000000000003,"5min":1.881,"15min":1.881},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.42199999999999999,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.80400000000000005,"5min":0.88300000000000001,"15min":1.1120000000000001},"last":0.502}]},{"osd":6,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81799999999999995,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85799999999999998,"5min":1.917,"15min":1.917},"last":0.47699999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.85399999999999998,"5min":1.843,"15min":1.843},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67400000000000004,"15min":0.68999999999999995},"min":{"1min":0.49399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84599999999999997,"5min":0.92300000000000004,"15min":1.4119999999999999},"last":0.53100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306548,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065292,"statfs":{"total":96636764160,"available":96322859008,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36499999999999999,"15min":0.36899999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52500000000000002,"5min":0.55100000000000005,"15min":0.61899999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.39800000000000002,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.57699999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.248}]},{"osd":1,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.222},"max":{"1min":0.745,"5min":0.745,"15min":0.75},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.441,"15min":0.442},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.69799999999999995,"5min":0.73499999999999999,"15min":0.92000000000000004},"last":0.313}]},{"osd":3,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.248},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45000000000000001,"15min":0.44400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.253},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.35699999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59999999999999998,"15min":0.625},"min":{"1min":0.41299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92700000000000005,"5min":1.0549999999999999,"15min":1.0800000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.39200000000000002},"max":{"1min":0.872,"5min":0.91100000000000003,"15min":1.052},"last":0.55700000000000005}]},{"osd":5,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.627,"15min":0.64800000000000002},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.89400000000000002,"5min":1.032,"15min":1.032},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.64100000000000001},"min":{"1min":0.44700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.871,"5min":0.96699999999999997,"15min":1.1339999999999999},"last":0.48499999999999999}]},{"osd":6,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.66300000000000003},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.876,"5min":1.002,"15min":1.0389999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.65300000000000002,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85699999999999998,"5min":1.0669999999999999,"15min":1.119},"last":0.53900000000000003}]},{"osd":7,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.67700000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78300000000000003,"5min":1.079,"15min":1.103},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67600000000000005,"15min":0.69499999999999995},"min":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.86599999999999999,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.503}]}]},{"osd":3,"up_from":13,"seq":55834575039,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306548,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065292,"statfs":{"total":96636764160,"available":96322859008,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48399999999999999,"5min":0.65900000000000003,"15min":0.79900000000000004},"last":0.313},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.38200000000000001,"15min":0.39800000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23200000000000001},"max":{"1min":0.60699999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.34599999999999997}]},{"osd":1,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.371,"15min":0.38700000000000001},"min":{"1min":0.27000000000000002,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":0.47499999999999998,"5min":0.59799999999999998,"15min":0.72899999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.42799999999999999,"15min":0.44400000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52700000000000002,"5min":0.72499999999999998,"15min":0.80500000000000005},"last":0.41599999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.42699999999999999,"15min":0.44600000000000001},"min":{"1min":0.28000000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61699999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.45300000000000001,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26200000000000001},"max":{"1min":0.53000000000000003,"5min":0.69199999999999995,"15min":0.81999999999999995},"last":0.38100000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58699999999999997,"15min":0.61799999999999999},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.80800000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.627},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.39000000000000001},"max":{"1min":0.73599999999999999,"5min":0.89200000000000002,"15min":1.0589999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.60299999999999998,"15min":0.63600000000000001},"min":{"1min":0.41799999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.72799999999999998,"5min":0.92000000000000004,"15min":1.0569999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61299999999999999,"15min":0.64100000000000001},"min":{"1min":0.375,"5min":0.373,"15min":0.373},"max":{"1min":0.84899999999999998,"5min":0.879,"15min":0.95999999999999996},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61699999999999999,"15min":0.64700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":0.94299999999999995,"15min":1.0980000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.67100000000000004},"min":{"1min":0.442,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73999999999999999,"5min":0.95799999999999996,"15min":1.169},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63500000000000001,"15min":0.66800000000000004},"min":{"1min":0.41999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88700000000000001,"5min":1.0429999999999999,"15min":1.071},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.64500000000000002,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75800000000000001,"5min":0.996,"15min":1.1459999999999999},"last":0.52200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76500000000000001,"5min":0.88,"15min":0.88},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.32900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65600000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.38800000000000001}]},{"osd":1,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55700000000000005,"15min":0.57199999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.746,"5min":1.087,"15min":1.087},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34699999999999998},"max":{"1min":0.69199999999999995,"5min":0.76600000000000001,"15min":0.81000000000000005},"last":0.34799999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.34699999999999998,"15min":0.33100000000000002},"max":{"1min":0.78900000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.436}]},{"osd":3,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72099999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.5}]},{"osd":5,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30399999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.30399999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.44700000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.34000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.53000000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82799999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52400000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.46999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":660115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78500000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.81200000000000006},"last":0.48599999999999999}]},{"osd":1,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32600000000000001},"max":{"1min":0.68799999999999994,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33400000000000002},"max":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.375}]},{"osd":2,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.86199999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34999999999999998},"max":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":1.103},"last":0.432}]},{"osd":3,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.376,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":1.127},"last":0.38800000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64400000000000002,"5min":0.66500000000000004,"15min":0.94399999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.50800000000000001,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.52200000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46400000000000002,"15min":0.47599999999999998},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74399999999999999,"5min":0.83099999999999996,"15min":1.0660000000000001},"last":0.499},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.47299999999999998,"15min":0.495},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57099999999999995}]},{"osd":7,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48099999999999998,"15min":0.498},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.69899999999999995,"5min":0.72999999999999998,"15min":0.97199999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":0.85799999999999998,"15min":1.1499999999999999},"last":0.58199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:37:30.195 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:37:30.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.344+0000 7f63253c8700 1 Processor -- start 2023-11-15T01:37:30.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.344+0000 7f63253c8700 1 -- start start 2023-11-15T01:37:30.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.345+0000 7f63253c8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6320154150 0x7f6320154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:30.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.345+0000 7f63253c8700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f63200aa060 0x7f63200c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:30.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.345+0000 7f63253c8700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63200c06f0 con 0x7f63200ab1a0 2023-11-15T01:37:30.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.345+0000 7f63253c8700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63200c09d0 con 0x7f6320154150 2023-11-15T01:37:30.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.345+0000 7f63253c8700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6320158820 con 0x7f63200aa060 2023-11-15T01:37:30.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.345+0000 7f631effd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6320154150 0x7f6320154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.345+0000 7f631effd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6320154150 0x7f6320154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43592/0 (socket says 172.21.15.1:43592) 2023-11-15T01:37:30.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.345+0000 7f631effd700 1 -- 172.21.15.1:0/1841513434 learned_addr learned my addr 172.21.15.1:0/1841513434 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:30.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.345+0000 7f631e7fc700 1 --1- 172.21.15.1:0/1841513434 >> v1:172.21.15.1:6789/0 conn(0x7f63200ab1a0 0x7f6320158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45018/0 (socket says 172.21.15.1:45018) 2023-11-15T01:37:30.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f631f7fe700 1 --2- 172.21.15.1:0/1841513434 >> v2:172.21.15.141:3300/0 conn(0x7f63200aa060 0x7f63200c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f631effd700 1 -- 172.21.15.1:0/1841513434 >> v2:172.21.15.141:3300/0 conn(0x7f63200aa060 msgr2=0x7f63200c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:30.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f631effd700 1 --2- 172.21.15.1:0/1841513434 >> v2:172.21.15.141:3300/0 conn(0x7f63200aa060 0x7f63200c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f631effd700 1 -- 172.21.15.1:0/1841513434 >> v1:172.21.15.1:6789/0 conn(0x7f63200ab1a0 legacy=0x7f6320158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f631effd700 1 -- 172.21.15.1:0/1841513434 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6320158b00 con 0x7f6320154150 2023-11-15T01:37:30.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f631dffb700 1 -- 172.21.15.1:0/1841513434 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701894443 0 0) 0x7f63200c06f0 con 0x7f63200ab1a0 2023-11-15T01:37:30.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f631effd700 1 --2- 172.21.15.1:0/1841513434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6320154150 0x7f6320154530 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f6320157f80 tx=0x7f63180090f0).ready entity=mon.0 client_cookie=544023d92ce3c4be server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:30.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f631dffb700 1 -- 172.21.15.1:0/1841513434 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631800b600 con 0x7f6320154150 2023-11-15T01:37:30.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f631dffb700 1 -- 172.21.15.1:0/1841513434 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631800b760 con 0x7f6320154150 2023-11-15T01:37:30.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f631dffb700 1 -- 172.21.15.1:0/1841513434 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631800bb00 con 0x7f6320154150 2023-11-15T01:37:30.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f63253c8700 1 -- 172.21.15.1:0/1841513434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6320154150 msgr2=0x7f6320154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f63253c8700 1 --2- 172.21.15.1:0/1841513434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6320154150 0x7f6320154530 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f6320157f80 tx=0x7f63180090f0).stop 2023-11-15T01:37:30.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f63253c8700 1 -- 172.21.15.1:0/1841513434 shutdown_connections 2023-11-15T01:37:30.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f63253c8700 1 --2- 172.21.15.1:0/1841513434 >> v2:172.21.15.141:3300/0 conn(0x7f63200aa060 0x7f63200c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f63253c8700 1 --2- 172.21.15.1:0/1841513434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6320154150 0x7f6320154530 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.346+0000 7f63253c8700 1 -- 172.21.15.1:0/1841513434 >> 172.21.15.1:0/1841513434 conn(0x7f6320064aa0 msgr2=0x7f6320064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:30.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.347+0000 7f63253c8700 1 -- 172.21.15.1:0/1841513434 shutdown_connections 2023-11-15T01:37:30.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.347+0000 7f63253c8700 1 -- 172.21.15.1:0/1841513434 wait complete. 2023-11-15T01:37:30.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.348+0000 7f63253c8700 1 Processor -- start 2023-11-15T01:37:30.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.348+0000 7f63253c8700 1 -- start start 2023-11-15T01:37:30.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f63253c8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63200aa060 0x7f632014eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:30.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f63253c8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63200ab1a0 0x7f63200ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:30.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f63253c8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6320154150 0x7f63200aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:30.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f63253c8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6320151250 con 0x7f63200ab1a0 2023-11-15T01:37:30.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f63253c8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6320150680 con 0x7f63200aa060 2023-11-15T01:37:30.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f63253c8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6320153290 con 0x7f6320154150 2023-11-15T01:37:30.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f631e7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63200ab1a0 0x7f63200ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f631e7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63200ab1a0 0x7f63200ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43604/0 (socket says 172.21.15.1:43604) 2023-11-15T01:37:30.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f631e7fc700 1 -- 172.21.15.1:0/670859968 learned_addr learned my addr 172.21.15.1:0/670859968 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:30.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f631effd700 1 --2- 172.21.15.1:0/670859968 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63200aa060 0x7f632014eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f631e7fc700 1 -- 172.21.15.1:0/670859968 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6320154150 msgr2=0x7f63200aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f631f7fe700 1 --2- 172.21.15.1:0/670859968 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6320154150 0x7f63200aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f631e7fc700 1 --2- 172.21.15.1:0/670859968 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6320154150 0x7f63200aeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f631e7fc700 1 -- 172.21.15.1:0/670859968 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63200aa060 msgr2=0x7f632014eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f631e7fc700 1 --2- 172.21.15.1:0/670859968 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63200aa060 0x7f632014eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f631e7fc700 1 -- 172.21.15.1:0/670859968 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6318009370 con 0x7f63200ab1a0 2023-11-15T01:37:30.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f631effd700 1 --2- 172.21.15.1:0/670859968 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63200aa060 0x7f632014eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:37:30.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f631e7fc700 1 --2- 172.21.15.1:0/670859968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63200ab1a0 0x7f63200ae660 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f630800c4c0 tx=0x7f6308007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:30.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f6316ffd700 1 -- 172.21.15.1:0/670859968 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63080072e0 con 0x7f63200ab1a0 2023-11-15T01:37:30.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f6316ffd700 1 -- 172.21.15.1:0/670859968 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6308007440 con 0x7f63200ab1a0 2023-11-15T01:37:30.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f63253c8700 1 -- 172.21.15.1:0/670859968 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6320150920 con 0x7f63200ab1a0 2023-11-15T01:37:30.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f6316ffd700 1 -- 172.21.15.1:0/670859968 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308005930 con 0x7f63200ab1a0 2023-11-15T01:37:30.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.349+0000 7f63253c8700 1 -- 172.21.15.1:0/670859968 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6320150ee0 con 0x7f63200ab1a0 2023-11-15T01:37:30.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.350+0000 7f63253c8700 1 -- 172.21.15.1:0/670859968 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632006c7e0 con 0x7f63200ab1a0 2023-11-15T01:37:30.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.351+0000 7f6316ffd700 1 -- 172.21.15.1:0/670859968 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6308005ce0 con 0x7f63200ab1a0 2023-11-15T01:37:30.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.351+0000 7f6316ffd700 1 --2- 172.21.15.1:0/670859968 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f630005f270 0x7f6300061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:30.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.351+0000 7f6316ffd700 1 -- 172.21.15.1:0/670859968 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f6308079d50 con 0x7f63200ab1a0 2023-11-15T01:37:30.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.351+0000 7f631effd700 1 --2- 172.21.15.1:0/670859968 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f630005f270 0x7f6300061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.352+0000 7f631effd700 1 --2- 172.21.15.1:0/670859968 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f630005f270 0x7f6300061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f631800b3c0 tx=0x7f6318017000).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:30.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.355+0000 7f6316ffd700 1 -- 172.21.15.1:0/670859968 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f630804acf0 con 0x7f63200ab1a0 2023-11-15T01:37:30.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.523+0000 7f63253c8700 1 -- 172.21.15.1:0/670859968 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6320158de0 con 0x7f630005f270 2023-11-15T01:37:30.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.533+0000 7f6316ffd700 1 -- 172.21.15.1:0/670859968 <== mgr.6466 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361471 (secure 0 0 0) 0x7f6320158de0 con 0x7f630005f270 2023-11-15T01:37:30.538 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:30.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.537+0000 7f63253c8700 1 -- 172.21.15.1:0/670859968 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f630005f270 msgr2=0x7f6300061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.537+0000 7f63253c8700 1 --2- 172.21.15.1:0/670859968 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f630005f270 0x7f6300061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f631800b3c0 tx=0x7f6318017000).stop 2023-11-15T01:37:30.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.537+0000 7f63253c8700 1 -- 172.21.15.1:0/670859968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63200ab1a0 msgr2=0x7f63200ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.537+0000 7f63253c8700 1 --2- 172.21.15.1:0/670859968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63200ab1a0 0x7f63200ae660 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f630800c4c0 tx=0x7f6308007c10).stop 2023-11-15T01:37:30.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.537+0000 7f63253c8700 1 -- 172.21.15.1:0/670859968 shutdown_connections 2023-11-15T01:37:30.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.537+0000 7f63253c8700 1 --2- 172.21.15.1:0/670859968 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f630005f270 0x7f6300061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.537+0000 7f63253c8700 1 --2- 172.21.15.1:0/670859968 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6320154150 0x7f63200aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.537+0000 7f63253c8700 1 --2- 172.21.15.1:0/670859968 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63200aa060 0x7f632014eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.537+0000 7f63253c8700 1 --2- 172.21.15.1:0/670859968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63200ab1a0 0x7f63200ae660 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.537+0000 7f63253c8700 1 -- 172.21.15.1:0/670859968 >> 172.21.15.1:0/670859968 conn(0x7f6320064aa0 msgr2=0x7f63200c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:30.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.537+0000 7f63253c8700 1 -- 172.21.15.1:0/670859968 shutdown_connections 2023-11-15T01:37:30.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.537+0000 7f63253c8700 1 -- 172.21.15.1:0/670859968 wait complete. 2023-11-15T01:37:30.543 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:37:30.551 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T01:37:30.352340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428256,"kb_used_data":10528,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752546464,"statfs":{"total":773094113280,"available":770607579136,"internally_reserved":0,"allocated":10780672,"data_stored":5513364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5548,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.005618"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.818300+0000","last_change":"2023-11-15T01:37:25.816590+0000","last_active":"2023-11-15T01:37:25.818300+0000","last_peered":"2023-11-15T01:37:25.818300+0000","last_clean":"2023-11-15T01:37:25.818300+0000","last_became_active":"2023-11-15T01:37:25.816262+0000","last_became_peered":"2023-11-15T01:37:25.816262+0000","last_unstale":"2023-11-15T01:37:25.818300+0000","last_undegraded":"2023-11-15T01:37:25.818300+0000","last_fullsized":"2023-11-15T01:37:25.818300+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"108'3","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814693+0000","last_change":"2023-11-15T01:37:25.408583+0000","last_active":"2023-11-15T01:37:25.814693+0000","last_peered":"2023-11-15T01:37:25.814693+0000","last_clean":"2023-11-15T01:37:25.814693+0000","last_became_active":"2023-11-15T01:37:25.407367+0000","last_became_peered":"2023-11-15T01:37:25.407367+0000","last_unstale":"2023-11-15T01:37:25.814693+0000","last_undegraded":"2023-11-15T01:37:25.814693+0000","last_fullsized":"2023-11-15T01:37:25.814693+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811410+0000","last_change":"2023-11-15T01:37:25.806157+0000","last_active":"2023-11-15T01:37:25.811410+0000","last_peered":"2023-11-15T01:37:25.811410+0000","last_clean":"2023-11-15T01:37:25.811410+0000","last_became_active":"2023-11-15T01:37:25.805886+0000","last_became_peered":"2023-11-15T01:37:25.805886+0000","last_unstale":"2023-11-15T01:37:25.811410+0000","last_undegraded":"2023-11-15T01:37:25.811410+0000","last_fullsized":"2023-11-15T01:37:25.811410+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.805334+0000","last_change":"2023-11-15T01:37:25.420055+0000","last_active":"2023-11-15T01:37:25.805334+0000","last_peered":"2023-11-15T01:37:25.805334+0000","last_clean":"2023-11-15T01:37:25.805334+0000","last_became_active":"2023-11-15T01:37:25.419766+0000","last_became_peered":"2023-11-15T01:37:25.419766+0000","last_unstale":"2023-11-15T01:37:25.805334+0000","last_undegraded":"2023-11-15T01:37:25.805334+0000","last_fullsized":"2023-11-15T01:37:25.805334+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.816767+0000","last_change":"2023-11-15T01:37:25.807109+0000","last_active":"2023-11-15T01:37:25.816767+0000","last_peered":"2023-11-15T01:37:25.816767+0000","last_clean":"2023-11-15T01:37:25.816767+0000","last_became_active":"2023-11-15T01:37:25.806775+0000","last_became_peered":"2023-11-15T01:37:25.806775+0000","last_unstale":"2023-11-15T01:37:25.816767+0000","last_undegraded":"2023-11-15T01:37:25.816767+0000","last_fullsized":"2023-11-15T01:37:25.816767+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.800464+0000","last_change":"2023-11-15T01:37:25.418749+0000","last_active":"2023-11-15T01:37:25.800464+0000","last_peered":"2023-11-15T01:37:25.800464+0000","last_clean":"2023-11-15T01:37:25.800464+0000","last_became_active":"2023-11-15T01:37:25.418443+0000","last_became_peered":"2023-11-15T01:37:25.418443+0000","last_unstale":"2023-11-15T01:37:25.800464+0000","last_undegraded":"2023-11-15T01:37:25.800464+0000","last_fullsized":"2023-11-15T01:37:25.800464+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812937+0000","last_change":"2023-11-15T01:37:25.810112+0000","last_active":"2023-11-15T01:37:25.812937+0000","last_peered":"2023-11-15T01:37:25.812937+0000","last_clean":"2023-11-15T01:37:25.812937+0000","last_became_active":"2023-11-15T01:37:25.809789+0000","last_became_peered":"2023-11-15T01:37:25.809789+0000","last_unstale":"2023-11-15T01:37:25.812937+0000","last_undegraded":"2023-11-15T01:37:25.812937+0000","last_fullsized":"2023-11-15T01:37:25.812937+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.802236+0000","last_change":"2023-11-15T01:37:25.416214+0000","last_active":"2023-11-15T01:37:25.802236+0000","last_peered":"2023-11-15T01:37:25.802236+0000","last_clean":"2023-11-15T01:37:25.802236+0000","last_became_active":"2023-11-15T01:37:25.415899+0000","last_became_peered":"2023-11-15T01:37:25.415899+0000","last_unstale":"2023-11-15T01:37:25.802236+0000","last_undegraded":"2023-11-15T01:37:25.802236+0000","last_fullsized":"2023-11-15T01:37:25.802236+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.818600+0000","last_change":"2023-11-15T01:37:25.816925+0000","last_active":"2023-11-15T01:37:25.818600+0000","last_peered":"2023-11-15T01:37:25.818600+0000","last_clean":"2023-11-15T01:37:25.818600+0000","last_became_active":"2023-11-15T01:37:25.816682+0000","last_became_peered":"2023-11-15T01:37:25.816682+0000","last_unstale":"2023-11-15T01:37:25.818600+0000","last_undegraded":"2023-11-15T01:37:25.818600+0000","last_fullsized":"2023-11-15T01:37:25.818600+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.817460+0000","last_change":"2023-11-15T01:37:25.412742+0000","last_active":"2023-11-15T01:37:25.817460+0000","last_peered":"2023-11-15T01:37:25.817460+0000","last_clean":"2023-11-15T01:37:25.817460+0000","last_became_active":"2023-11-15T01:37:25.412471+0000","last_became_peered":"2023-11-15T01:37:25.412471+0000","last_unstale":"2023-11-15T01:37:25.817460+0000","last_undegraded":"2023-11-15T01:37:25.817460+0000","last_fullsized":"2023-11-15T01:37:25.817460+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.815898+0000","last_change":"2023-11-15T01:37:25.811286+0000","last_active":"2023-11-15T01:37:25.815898+0000","last_peered":"2023-11-15T01:37:25.815898+0000","last_clean":"2023-11-15T01:37:25.815898+0000","last_became_active":"2023-11-15T01:37:25.811059+0000","last_became_peered":"2023-11-15T01:37:25.811059+0000","last_unstale":"2023-11-15T01:37:25.815898+0000","last_undegraded":"2023-11-15T01:37:25.815898+0000","last_fullsized":"2023-11-15T01:37:25.815898+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813341+0000","last_change":"2023-11-15T01:37:25.415016+0000","last_active":"2023-11-15T01:37:25.813341+0000","last_peered":"2023-11-15T01:37:25.813341+0000","last_clean":"2023-11-15T01:37:25.813341+0000","last_became_active":"2023-11-15T01:37:25.414532+0000","last_became_peered":"2023-11-15T01:37:25.414532+0000","last_unstale":"2023-11-15T01:37:25.813341+0000","last_undegraded":"2023-11-15T01:37:25.813341+0000","last_fullsized":"2023-11-15T01:37:25.813341+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.817551+0000","last_change":"2023-11-15T01:37:25.805785+0000","last_active":"2023-11-15T01:37:25.817551+0000","last_peered":"2023-11-15T01:37:25.817551+0000","last_clean":"2023-11-15T01:37:25.817551+0000","last_became_active":"2023-11-15T01:37:25.805510+0000","last_became_peered":"2023-11-15T01:37:25.805510+0000","last_unstale":"2023-11-15T01:37:25.817551+0000","last_undegraded":"2023-11-15T01:37:25.817551+0000","last_fullsized":"2023-11-15T01:37:25.817551+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.788055+0000","last_change":"2023-11-15T01:37:25.417606+0000","last_active":"2023-11-15T01:37:25.788055+0000","last_peered":"2023-11-15T01:37:25.788055+0000","last_clean":"2023-11-15T01:37:25.788055+0000","last_became_active":"2023-11-15T01:37:25.417271+0000","last_became_peered":"2023-11-15T01:37:25.417271+0000","last_unstale":"2023-11-15T01:37:25.788055+0000","last_undegraded":"2023-11-15T01:37:25.788055+0000","last_fullsized":"2023-11-15T01:37:25.788055+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819336+0000","last_change":"2023-11-15T01:37:25.816625+0000","last_active":"2023-11-15T01:37:25.819336+0000","last_peered":"2023-11-15T01:37:25.819336+0000","last_clean":"2023-11-15T01:37:25.819336+0000","last_became_active":"2023-11-15T01:37:25.816296+0000","last_became_peered":"2023-11-15T01:37:25.816296+0000","last_unstale":"2023-11-15T01:37:25.819336+0000","last_undegraded":"2023-11-15T01:37:25.819336+0000","last_fullsized":"2023-11-15T01:37:25.819336+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803923+0000","last_change":"2023-11-15T01:37:25.417379+0000","last_active":"2023-11-15T01:37:25.803923+0000","last_peered":"2023-11-15T01:37:25.803923+0000","last_clean":"2023-11-15T01:37:25.803923+0000","last_became_active":"2023-11-15T01:37:25.417085+0000","last_became_peered":"2023-11-15T01:37:25.417085+0000","last_unstale":"2023-11-15T01:37:25.803923+0000","last_undegraded":"2023-11-15T01:37:25.803923+0000","last_fullsized":"2023-11-15T01:37:25.803923+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.808143+0000","last_change":"2023-11-15T01:37:25.798848+0000","last_active":"2023-11-15T01:37:25.808143+0000","last_peered":"2023-11-15T01:37:25.808143+0000","last_clean":"2023-11-15T01:37:25.808143+0000","last_became_active":"2023-11-15T01:37:25.798566+0000","last_became_peered":"2023-11-15T01:37:25.798566+0000","last_unstale":"2023-11-15T01:37:25.808143+0000","last_undegraded":"2023-11-15T01:37:25.808143+0000","last_fullsized":"2023-11-15T01:37:25.808143+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807542+0000","last_change":"2023-11-15T01:37:25.414011+0000","last_active":"2023-11-15T01:37:25.807542+0000","last_peered":"2023-11-15T01:37:25.807542+0000","last_clean":"2023-11-15T01:37:25.807542+0000","last_became_active":"2023-11-15T01:37:25.413687+0000","last_became_peered":"2023-11-15T01:37:25.413687+0000","last_unstale":"2023-11-15T01:37:25.807542+0000","last_undegraded":"2023-11-15T01:37:25.807542+0000","last_fullsized":"2023-11-15T01:37:25.807542+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812301+0000","last_change":"2023-11-15T01:37:25.805983+0000","last_active":"2023-11-15T01:37:25.812301+0000","last_peered":"2023-11-15T01:37:25.812301+0000","last_clean":"2023-11-15T01:37:25.812301+0000","last_became_active":"2023-11-15T01:37:25.805783+0000","last_became_peered":"2023-11-15T01:37:25.805783+0000","last_unstale":"2023-11-15T01:37:25.812301+0000","last_undegraded":"2023-11-15T01:37:25.812301+0000","last_fullsized":"2023-11-15T01:37:25.812301+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.796597+0000","last_change":"2023-11-15T01:37:25.411780+0000","last_active":"2023-11-15T01:37:25.796597+0000","last_peered":"2023-11-15T01:37:25.796597+0000","last_clean":"2023-11-15T01:37:25.796597+0000","last_became_active":"2023-11-15T01:37:25.411497+0000","last_became_peered":"2023-11-15T01:37:25.411497+0000","last_unstale":"2023-11-15T01:37:25.796597+0000","last_undegraded":"2023-11-15T01:37:25.796597+0000","last_fullsized":"2023-11-15T01:37:25.796597+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807763+0000","last_change":"2023-11-15T01:37:25.796296+0000","last_active":"2023-11-15T01:37:25.807763+0000","last_peered":"2023-11-15T01:37:25.807763+0000","last_clean":"2023-11-15T01:37:25.807763+0000","last_became_active":"2023-11-15T01:37:25.796037+0000","last_became_peered":"2023-11-15T01:37:25.796037+0000","last_unstale":"2023-11-15T01:37:25.807763+0000","last_undegraded":"2023-11-15T01:37:25.807763+0000","last_fullsized":"2023-11-15T01:37:25.807763+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.804237+0000","last_change":"2023-11-15T01:37:25.417734+0000","last_active":"2023-11-15T01:37:25.804237+0000","last_peered":"2023-11-15T01:37:25.804237+0000","last_clean":"2023-11-15T01:37:25.804237+0000","last_became_active":"2023-11-15T01:37:25.417457+0000","last_became_peered":"2023-11-15T01:37:25.417457+0000","last_unstale":"2023-11-15T01:37:25.804237+0000","last_undegraded":"2023-11-15T01:37:25.804237+0000","last_fullsized":"2023-11-15T01:37:25.804237+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813686+0000","last_change":"2023-11-15T01:37:25.809518+0000","last_active":"2023-11-15T01:37:25.813686+0000","last_peered":"2023-11-15T01:37:25.813686+0000","last_clean":"2023-11-15T01:37:25.813686+0000","last_became_active":"2023-11-15T01:37:25.809139+0000","last_became_peered":"2023-11-15T01:37:25.809139+0000","last_unstale":"2023-11-15T01:37:25.813686+0000","last_undegraded":"2023-11-15T01:37:25.813686+0000","last_fullsized":"2023-11-15T01:37:25.813686+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"108'4","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.822226+0000","last_change":"2023-11-15T01:37:25.412130+0000","last_active":"2023-11-15T01:37:25.822226+0000","last_peered":"2023-11-15T01:37:25.822226+0000","last_clean":"2023-11-15T01:37:25.822226+0000","last_became_active":"2023-11-15T01:37:25.411854+0000","last_became_peered":"2023-11-15T01:37:25.411854+0000","last_unstale":"2023-11-15T01:37:25.822226+0000","last_undegraded":"2023-11-15T01:37:25.822226+0000","last_fullsized":"2023-11-15T01:37:25.822226+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.808607+0000","last_change":"2023-11-15T01:37:25.804754+0000","last_active":"2023-11-15T01:37:25.808607+0000","last_peered":"2023-11-15T01:37:25.808607+0000","last_clean":"2023-11-15T01:37:25.808607+0000","last_became_active":"2023-11-15T01:37:25.804091+0000","last_became_peered":"2023-11-15T01:37:25.804091+0000","last_unstale":"2023-11-15T01:37:25.808607+0000","last_undegraded":"2023-11-15T01:37:25.808607+0000","last_fullsized":"2023-11-15T01:37:25.808607+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.816266+0000","last_change":"2023-11-15T01:37:25.421559+0000","last_active":"2023-11-15T01:37:25.816266+0000","last_peered":"2023-11-15T01:37:25.816266+0000","last_clean":"2023-11-15T01:37:25.816266+0000","last_became_active":"2023-11-15T01:37:25.421284+0000","last_became_peered":"2023-11-15T01:37:25.421284+0000","last_unstale":"2023-11-15T01:37:25.816266+0000","last_undegraded":"2023-11-15T01:37:25.816266+0000","last_fullsized":"2023-11-15T01:37:25.816266+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812654+0000","last_change":"2023-11-15T01:37:25.802867+0000","last_active":"2023-11-15T01:37:25.812654+0000","last_peered":"2023-11-15T01:37:25.812654+0000","last_clean":"2023-11-15T01:37:25.812654+0000","last_became_active":"2023-11-15T01:37:25.802608+0000","last_became_peered":"2023-11-15T01:37:25.802608+0000","last_unstale":"2023-11-15T01:37:25.812654+0000","last_undegraded":"2023-11-15T01:37:25.812654+0000","last_fullsized":"2023-11-15T01:37:25.812654+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.787960+0000","last_change":"2023-11-15T01:37:25.414896+0000","last_active":"2023-11-15T01:37:25.787960+0000","last_peered":"2023-11-15T01:37:25.787960+0000","last_clean":"2023-11-15T01:37:25.787960+0000","last_became_active":"2023-11-15T01:37:25.414626+0000","last_became_peered":"2023-11-15T01:37:25.414626+0000","last_unstale":"2023-11-15T01:37:25.787960+0000","last_undegraded":"2023-11-15T01:37:25.787960+0000","last_fullsized":"2023-11-15T01:37:25.787960+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.822179+0000","last_change":"2023-11-15T01:37:25.817409+0000","last_active":"2023-11-15T01:37:25.822179+0000","last_peered":"2023-11-15T01:37:25.822179+0000","last_clean":"2023-11-15T01:37:25.822179+0000","last_became_active":"2023-11-15T01:37:25.817134+0000","last_became_peered":"2023-11-15T01:37:25.817134+0000","last_unstale":"2023-11-15T01:37:25.822179+0000","last_undegraded":"2023-11-15T01:37:25.822179+0000","last_fullsized":"2023-11-15T01:37:25.822179+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.792367+0000","last_change":"2023-11-15T01:37:25.418553+0000","last_active":"2023-11-15T01:37:25.792367+0000","last_peered":"2023-11-15T01:37:25.792367+0000","last_clean":"2023-11-15T01:37:25.792367+0000","last_became_active":"2023-11-15T01:37:25.418043+0000","last_became_peered":"2023-11-15T01:37:25.418043+0000","last_unstale":"2023-11-15T01:37:25.792367+0000","last_undegraded":"2023-11-15T01:37:25.792367+0000","last_fullsized":"2023-11-15T01:37:25.792367+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.818077+0000","last_change":"2023-11-15T01:37:25.816718+0000","last_active":"2023-11-15T01:37:25.818077+0000","last_peered":"2023-11-15T01:37:25.818077+0000","last_clean":"2023-11-15T01:37:25.818077+0000","last_became_active":"2023-11-15T01:37:25.816448+0000","last_became_peered":"2023-11-15T01:37:25.816448+0000","last_unstale":"2023-11-15T01:37:25.818077+0000","last_undegraded":"2023-11-15T01:37:25.818077+0000","last_fullsized":"2023-11-15T01:37:25.818077+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"108'4","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814744+0000","last_change":"2023-11-15T01:37:25.408759+0000","last_active":"2023-11-15T01:37:25.814744+0000","last_peered":"2023-11-15T01:37:25.814744+0000","last_clean":"2023-11-15T01:37:25.814744+0000","last_became_active":"2023-11-15T01:37:25.408461+0000","last_became_peered":"2023-11-15T01:37:25.408461+0000","last_unstale":"2023-11-15T01:37:25.814744+0000","last_undegraded":"2023-11-15T01:37:25.814744+0000","last_fullsized":"2023-11-15T01:37:25.814744+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812814+0000","last_change":"2023-11-15T01:37:25.806103+0000","last_active":"2023-11-15T01:37:25.812814+0000","last_peered":"2023-11-15T01:37:25.812814+0000","last_clean":"2023-11-15T01:37:25.812814+0000","last_became_active":"2023-11-15T01:37:25.805836+0000","last_became_peered":"2023-11-15T01:37:25.805836+0000","last_unstale":"2023-11-15T01:37:25.812814+0000","last_undegraded":"2023-11-15T01:37:25.812814+0000","last_fullsized":"2023-11-15T01:37:25.812814+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.802995+0000","last_change":"2023-11-15T01:37:25.409251+0000","last_active":"2023-11-15T01:37:25.802995+0000","last_peered":"2023-11-15T01:37:25.802995+0000","last_clean":"2023-11-15T01:37:25.802995+0000","last_became_active":"2023-11-15T01:37:25.408943+0000","last_became_peered":"2023-11-15T01:37:25.408943+0000","last_unstale":"2023-11-15T01:37:25.802995+0000","last_undegraded":"2023-11-15T01:37:25.802995+0000","last_fullsized":"2023-11-15T01:37:25.802995+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.822232+0000","last_change":"2023-11-15T01:37:25.818048+0000","last_active":"2023-11-15T01:37:25.822232+0000","last_peered":"2023-11-15T01:37:25.822232+0000","last_clean":"2023-11-15T01:37:25.822232+0000","last_became_active":"2023-11-15T01:37:25.817752+0000","last_became_peered":"2023-11-15T01:37:25.817752+0000","last_unstale":"2023-11-15T01:37:25.822232+0000","last_undegraded":"2023-11-15T01:37:25.822232+0000","last_fullsized":"2023-11-15T01:37:25.822232+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.788055+0000","last_change":"2023-11-15T01:37:25.408296+0000","last_active":"2023-11-15T01:37:25.788055+0000","last_peered":"2023-11-15T01:37:25.788055+0000","last_clean":"2023-11-15T01:37:25.788055+0000","last_became_active":"2023-11-15T01:37:25.408001+0000","last_became_peered":"2023-11-15T01:37:25.408001+0000","last_unstale":"2023-11-15T01:37:25.788055+0000","last_undegraded":"2023-11-15T01:37:25.788055+0000","last_fullsized":"2023-11-15T01:37:25.788055+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811519+0000","last_change":"2023-11-15T01:37:25.807821+0000","last_active":"2023-11-15T01:37:25.811519+0000","last_peered":"2023-11-15T01:37:25.811519+0000","last_clean":"2023-11-15T01:37:25.811519+0000","last_became_active":"2023-11-15T01:37:25.807548+0000","last_became_peered":"2023-11-15T01:37:25.807548+0000","last_unstale":"2023-11-15T01:37:25.811519+0000","last_undegraded":"2023-11-15T01:37:25.811519+0000","last_fullsized":"2023-11-15T01:37:25.811519+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807354+0000","last_change":"2023-11-15T01:37:25.415139+0000","last_active":"2023-11-15T01:37:25.807354+0000","last_peered":"2023-11-15T01:37:25.807354+0000","last_clean":"2023-11-15T01:37:25.807354+0000","last_became_active":"2023-11-15T01:37:25.414854+0000","last_became_peered":"2023-11-15T01:37:25.414854+0000","last_unstale":"2023-11-15T01:37:25.807354+0000","last_undegraded":"2023-11-15T01:37:25.807354+0000","last_fullsized":"2023-11-15T01:37:25.807354+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.809065+0000","last_change":"2023-11-15T01:37:25.803846+0000","last_active":"2023-11-15T01:37:25.809065+0000","last_peered":"2023-11-15T01:37:25.809065+0000","last_clean":"2023-11-15T01:37:25.809065+0000","last_became_active":"2023-11-15T01:37:25.803576+0000","last_became_peered":"2023-11-15T01:37:25.803576+0000","last_unstale":"2023-11-15T01:37:25.809065+0000","last_undegraded":"2023-11-15T01:37:25.809065+0000","last_fullsized":"2023-11-15T01:37:25.809065+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.788680+0000","last_change":"2023-11-15T01:37:25.411892+0000","last_active":"2023-11-15T01:37:25.788680+0000","last_peered":"2023-11-15T01:37:25.788680+0000","last_clean":"2023-11-15T01:37:25.788680+0000","last_became_active":"2023-11-15T01:37:25.411598+0000","last_became_peered":"2023-11-15T01:37:25.411598+0000","last_unstale":"2023-11-15T01:37:25.788680+0000","last_undegraded":"2023-11-15T01:37:25.788680+0000","last_fullsized":"2023-11-15T01:37:25.788680+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801483+0000","last_change":"2023-11-15T01:37:25.798574+0000","last_active":"2023-11-15T01:37:25.801483+0000","last_peered":"2023-11-15T01:37:25.801483+0000","last_clean":"2023-11-15T01:37:25.801483+0000","last_became_active":"2023-11-15T01:37:25.798289+0000","last_became_peered":"2023-11-15T01:37:25.798289+0000","last_unstale":"2023-11-15T01:37:25.801483+0000","last_undegraded":"2023-11-15T01:37:25.801483+0000","last_fullsized":"2023-11-15T01:37:25.801483+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798969+0000","last_change":"2023-11-15T01:37:25.411973+0000","last_active":"2023-11-15T01:37:25.798969+0000","last_peered":"2023-11-15T01:37:25.798969+0000","last_clean":"2023-11-15T01:37:25.798969+0000","last_became_active":"2023-11-15T01:37:25.411664+0000","last_became_peered":"2023-11-15T01:37:25.411664+0000","last_unstale":"2023-11-15T01:37:25.798969+0000","last_undegraded":"2023-11-15T01:37:25.798969+0000","last_fullsized":"2023-11-15T01:37:25.798969+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819072+0000","last_change":"2023-11-15T01:37:25.813328+0000","last_active":"2023-11-15T01:37:25.819072+0000","last_peered":"2023-11-15T01:37:25.819072+0000","last_clean":"2023-11-15T01:37:25.819072+0000","last_became_active":"2023-11-15T01:37:25.813035+0000","last_became_peered":"2023-11-15T01:37:25.813035+0000","last_unstale":"2023-11-15T01:37:25.819072+0000","last_undegraded":"2023-11-15T01:37:25.819072+0000","last_fullsized":"2023-11-15T01:37:25.819072+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801598+0000","last_change":"2023-11-15T01:37:25.422486+0000","last_active":"2023-11-15T01:37:25.801598+0000","last_peered":"2023-11-15T01:37:25.801598+0000","last_clean":"2023-11-15T01:37:25.801598+0000","last_became_active":"2023-11-15T01:37:25.421987+0000","last_became_peered":"2023-11-15T01:37:25.421987+0000","last_unstale":"2023-11-15T01:37:25.801598+0000","last_undegraded":"2023-11-15T01:37:25.801598+0000","last_fullsized":"2023-11-15T01:37:25.801598+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812169+0000","last_change":"2023-11-15T01:37:25.803837+0000","last_active":"2023-11-15T01:37:25.812169+0000","last_peered":"2023-11-15T01:37:25.812169+0000","last_clean":"2023-11-15T01:37:25.812169+0000","last_became_active":"2023-11-15T01:37:25.803555+0000","last_became_peered":"2023-11-15T01:37:25.803555+0000","last_unstale":"2023-11-15T01:37:25.812169+0000","last_undegraded":"2023-11-15T01:37:25.812169+0000","last_fullsized":"2023-11-15T01:37:25.812169+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.797162+0000","last_change":"2023-11-15T01:37:25.415462+0000","last_active":"2023-11-15T01:37:25.797162+0000","last_peered":"2023-11-15T01:37:25.797162+0000","last_clean":"2023-11-15T01:37:25.797162+0000","last_became_active":"2023-11-15T01:37:25.415190+0000","last_became_peered":"2023-11-15T01:37:25.415190+0000","last_unstale":"2023-11-15T01:37:25.797162+0000","last_undegraded":"2023-11-15T01:37:25.797162+0000","last_fullsized":"2023-11-15T01:37:25.797162+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813281+0000","last_change":"2023-11-15T01:37:25.806746+0000","last_active":"2023-11-15T01:37:25.813281+0000","last_peered":"2023-11-15T01:37:25.813281+0000","last_clean":"2023-11-15T01:37:25.813281+0000","last_became_active":"2023-11-15T01:37:25.806466+0000","last_became_peered":"2023-11-15T01:37:25.806466+0000","last_unstale":"2023-11-15T01:37:25.813281+0000","last_undegraded":"2023-11-15T01:37:25.813281+0000","last_fullsized":"2023-11-15T01:37:25.813281+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.787515+0000","last_change":"2023-11-15T01:37:25.412836+0000","last_active":"2023-11-15T01:37:25.787515+0000","last_peered":"2023-11-15T01:37:25.787515+0000","last_clean":"2023-11-15T01:37:25.787515+0000","last_became_active":"2023-11-15T01:37:25.412175+0000","last_became_peered":"2023-11-15T01:37:25.412175+0000","last_unstale":"2023-11-15T01:37:25.787515+0000","last_undegraded":"2023-11-15T01:37:25.787515+0000","last_fullsized":"2023-11-15T01:37:25.787515+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813143+0000","last_change":"2023-11-15T01:37:25.809933+0000","last_active":"2023-11-15T01:37:25.813143+0000","last_peered":"2023-11-15T01:37:25.813143+0000","last_clean":"2023-11-15T01:37:25.813143+0000","last_became_active":"2023-11-15T01:37:25.809264+0000","last_became_peered":"2023-11-15T01:37:25.809264+0000","last_unstale":"2023-11-15T01:37:25.813143+0000","last_undegraded":"2023-11-15T01:37:25.813143+0000","last_fullsized":"2023-11-15T01:37:25.813143+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.804839+0000","last_change":"2023-11-15T01:37:25.419579+0000","last_active":"2023-11-15T01:37:25.804839+0000","last_peered":"2023-11-15T01:37:25.804839+0000","last_clean":"2023-11-15T01:37:25.804839+0000","last_became_active":"2023-11-15T01:37:25.419265+0000","last_became_peered":"2023-11-15T01:37:25.419265+0000","last_unstale":"2023-11-15T01:37:25.804839+0000","last_undegraded":"2023-11-15T01:37:25.804839+0000","last_fullsized":"2023-11-15T01:37:25.804839+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811811+0000","last_change":"2023-11-15T01:37:25.807257+0000","last_active":"2023-11-15T01:37:25.811811+0000","last_peered":"2023-11-15T01:37:25.811811+0000","last_clean":"2023-11-15T01:37:25.811811+0000","last_became_active":"2023-11-15T01:37:25.806982+0000","last_became_peered":"2023-11-15T01:37:25.806982+0000","last_unstale":"2023-11-15T01:37:25.811811+0000","last_undegraded":"2023-11-15T01:37:25.811811+0000","last_fullsized":"2023-11-15T01:37:25.811811+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.800848+0000","last_change":"2023-11-15T01:37:25.422421+0000","last_active":"2023-11-15T01:37:25.800848+0000","last_peered":"2023-11-15T01:37:25.800848+0000","last_clean":"2023-11-15T01:37:25.800848+0000","last_became_active":"2023-11-15T01:37:25.422115+0000","last_became_peered":"2023-11-15T01:37:25.422115+0000","last_unstale":"2023-11-15T01:37:25.800848+0000","last_undegraded":"2023-11-15T01:37:25.800848+0000","last_fullsized":"2023-11-15T01:37:25.800848+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.822215+0000","last_change":"2023-11-15T01:37:25.818001+0000","last_active":"2023-11-15T01:37:25.822215+0000","last_peered":"2023-11-15T01:37:25.822215+0000","last_clean":"2023-11-15T01:37:25.822215+0000","last_became_active":"2023-11-15T01:37:25.817735+0000","last_became_peered":"2023-11-15T01:37:25.817735+0000","last_unstale":"2023-11-15T01:37:25.822215+0000","last_undegraded":"2023-11-15T01:37:25.822215+0000","last_fullsized":"2023-11-15T01:37:25.822215+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801808+0000","last_change":"2023-11-15T01:37:25.412803+0000","last_active":"2023-11-15T01:37:25.801808+0000","last_peered":"2023-11-15T01:37:25.801808+0000","last_clean":"2023-11-15T01:37:25.801808+0000","last_became_active":"2023-11-15T01:37:25.412197+0000","last_became_peered":"2023-11-15T01:37:25.412197+0000","last_unstale":"2023-11-15T01:37:25.801808+0000","last_undegraded":"2023-11-15T01:37:25.801808+0000","last_fullsized":"2023-11-15T01:37:25.801808+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819287+0000","last_change":"2023-11-15T01:37:25.815673+0000","last_active":"2023-11-15T01:37:25.819287+0000","last_peered":"2023-11-15T01:37:25.819287+0000","last_clean":"2023-11-15T01:37:25.819287+0000","last_became_active":"2023-11-15T01:37:25.815450+0000","last_became_peered":"2023-11-15T01:37:25.815450+0000","last_unstale":"2023-11-15T01:37:25.819287+0000","last_undegraded":"2023-11-15T01:37:25.819287+0000","last_fullsized":"2023-11-15T01:37:25.819287+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798506+0000","last_change":"2023-11-15T01:37:25.407768+0000","last_active":"2023-11-15T01:37:25.798506+0000","last_peered":"2023-11-15T01:37:25.798506+0000","last_clean":"2023-11-15T01:37:25.798506+0000","last_became_active":"2023-11-15T01:37:25.407475+0000","last_became_peered":"2023-11-15T01:37:25.407475+0000","last_unstale":"2023-11-15T01:37:25.798506+0000","last_undegraded":"2023-11-15T01:37:25.798506+0000","last_fullsized":"2023-11-15T01:37:25.798506+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803880+0000","last_change":"2023-11-15T01:37:25.799740+0000","last_active":"2023-11-15T01:37:25.803880+0000","last_peered":"2023-11-15T01:37:25.803880+0000","last_clean":"2023-11-15T01:37:25.803880+0000","last_became_active":"2023-11-15T01:37:25.799413+0000","last_became_peered":"2023-11-15T01:37:25.799413+0000","last_unstale":"2023-11-15T01:37:25.803880+0000","last_undegraded":"2023-11-15T01:37:25.803880+0000","last_fullsized":"2023-11-15T01:37:25.803880+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803199+0000","last_change":"2023-11-15T01:37:25.419492+0000","last_active":"2023-11-15T01:37:25.803199+0000","last_peered":"2023-11-15T01:37:25.803199+0000","last_clean":"2023-11-15T01:37:25.803199+0000","last_became_active":"2023-11-15T01:37:25.419164+0000","last_became_peered":"2023-11-15T01:37:25.419164+0000","last_unstale":"2023-11-15T01:37:25.803199+0000","last_undegraded":"2023-11-15T01:37:25.803199+0000","last_fullsized":"2023-11-15T01:37:25.803199+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.816913+0000","last_change":"2023-11-15T01:37:25.807456+0000","last_active":"2023-11-15T01:37:25.816913+0000","last_peered":"2023-11-15T01:37:25.816913+0000","last_clean":"2023-11-15T01:37:25.816913+0000","last_became_active":"2023-11-15T01:37:25.807080+0000","last_became_peered":"2023-11-15T01:37:25.807080+0000","last_unstale":"2023-11-15T01:37:25.816913+0000","last_undegraded":"2023-11-15T01:37:25.816913+0000","last_fullsized":"2023-11-15T01:37:25.816913+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801698+0000","last_change":"2023-11-15T01:37:25.422722+0000","last_active":"2023-11-15T01:37:25.801698+0000","last_peered":"2023-11-15T01:37:25.801698+0000","last_clean":"2023-11-15T01:37:25.801698+0000","last_became_active":"2023-11-15T01:37:25.422418+0000","last_became_peered":"2023-11-15T01:37:25.422418+0000","last_unstale":"2023-11-15T01:37:25.801698+0000","last_undegraded":"2023-11-15T01:37:25.801698+0000","last_fullsized":"2023-11-15T01:37:25.801698+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813458+0000","last_change":"2023-11-15T01:37:25.809142+0000","last_active":"2023-11-15T01:37:25.813458+0000","last_peered":"2023-11-15T01:37:25.813458+0000","last_clean":"2023-11-15T01:37:25.813458+0000","last_became_active":"2023-11-15T01:37:25.808816+0000","last_became_peered":"2023-11-15T01:37:25.808816+0000","last_unstale":"2023-11-15T01:37:25.813458+0000","last_undegraded":"2023-11-15T01:37:25.813458+0000","last_fullsized":"2023-11-15T01:37:25.813458+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.799876+0000","last_change":"2023-11-15T01:37:25.411372+0000","last_active":"2023-11-15T01:37:25.799876+0000","last_peered":"2023-11-15T01:37:25.799876+0000","last_clean":"2023-11-15T01:37:25.799876+0000","last_became_active":"2023-11-15T01:37:25.411048+0000","last_became_peered":"2023-11-15T01:37:25.411048+0000","last_unstale":"2023-11-15T01:37:25.799876+0000","last_undegraded":"2023-11-15T01:37:25.799876+0000","last_fullsized":"2023-11-15T01:37:25.799876+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.817368+0000","last_change":"2023-11-15T01:37:25.815100+0000","last_active":"2023-11-15T01:37:25.817368+0000","last_peered":"2023-11-15T01:37:25.817368+0000","last_clean":"2023-11-15T01:37:25.817368+0000","last_became_active":"2023-11-15T01:37:25.812371+0000","last_became_peered":"2023-11-15T01:37:25.812371+0000","last_unstale":"2023-11-15T01:37:25.817368+0000","last_undegraded":"2023-11-15T01:37:25.817368+0000","last_fullsized":"2023-11-15T01:37:25.817368+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.795484+0000","last_change":"2023-11-15T01:37:25.413924+0000","last_active":"2023-11-15T01:37:25.795484+0000","last_peered":"2023-11-15T01:37:25.795484+0000","last_clean":"2023-11-15T01:37:25.795484+0000","last_became_active":"2023-11-15T01:37:25.413648+0000","last_became_peered":"2023-11-15T01:37:25.413648+0000","last_unstale":"2023-11-15T01:37:25.795484+0000","last_undegraded":"2023-11-15T01:37:25.795484+0000","last_fullsized":"2023-11-15T01:37:25.795484+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819673+0000","last_change":"2023-11-15T01:37:25.808310+0000","last_active":"2023-11-15T01:37:25.819673+0000","last_peered":"2023-11-15T01:37:25.819673+0000","last_clean":"2023-11-15T01:37:25.819673+0000","last_became_active":"2023-11-15T01:37:25.808023+0000","last_became_peered":"2023-11-15T01:37:25.808023+0000","last_unstale":"2023-11-15T01:37:25.819673+0000","last_undegraded":"2023-11-15T01:37:25.819673+0000","last_fullsized":"2023-11-15T01:37:25.819673+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814509+0000","last_change":"2023-11-15T01:37:25.414235+0000","last_active":"2023-11-15T01:37:25.814509+0000","last_peered":"2023-11-15T01:37:25.814509+0000","last_clean":"2023-11-15T01:37:25.814509+0000","last_became_active":"2023-11-15T01:37:25.413369+0000","last_became_peered":"2023-11-15T01:37:25.413369+0000","last_unstale":"2023-11-15T01:37:25.814509+0000","last_undegraded":"2023-11-15T01:37:25.814509+0000","last_fullsized":"2023-11-15T01:37:25.814509+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.804906+0000","last_change":"2023-11-15T01:37:25.800425+0000","last_active":"2023-11-15T01:37:25.804906+0000","last_peered":"2023-11-15T01:37:25.804906+0000","last_clean":"2023-11-15T01:37:25.804906+0000","last_became_active":"2023-11-15T01:37:25.800126+0000","last_became_peered":"2023-11-15T01:37:25.800126+0000","last_unstale":"2023-11-15T01:37:25.804906+0000","last_undegraded":"2023-11-15T01:37:25.804906+0000","last_fullsized":"2023-11-15T01:37:25.804906+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814639+0000","last_change":"2023-11-15T01:37:25.409824+0000","last_active":"2023-11-15T01:37:25.814639+0000","last_peered":"2023-11-15T01:37:25.814639+0000","last_clean":"2023-11-15T01:37:25.814639+0000","last_became_active":"2023-11-15T01:37:25.408888+0000","last_became_peered":"2023-11-15T01:37:25.408888+0000","last_unstale":"2023-11-15T01:37:25.814639+0000","last_undegraded":"2023-11-15T01:37:25.814639+0000","last_fullsized":"2023-11-15T01:37:25.814639+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819124+0000","last_change":"2023-11-15T01:37:25.815870+0000","last_active":"2023-11-15T01:37:25.819124+0000","last_peered":"2023-11-15T01:37:25.819124+0000","last_clean":"2023-11-15T01:37:25.819124+0000","last_became_active":"2023-11-15T01:37:25.815610+0000","last_became_peered":"2023-11-15T01:37:25.815610+0000","last_unstale":"2023-11-15T01:37:25.819124+0000","last_undegraded":"2023-11-15T01:37:25.819124+0000","last_fullsized":"2023-11-15T01:37:25.819124+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.815892+0000","last_change":"2023-11-15T01:37:25.419445+0000","last_active":"2023-11-15T01:37:25.815892+0000","last_peered":"2023-11-15T01:37:25.815892+0000","last_clean":"2023-11-15T01:37:25.815892+0000","last_became_active":"2023-11-15T01:37:25.419103+0000","last_became_peered":"2023-11-15T01:37:25.419103+0000","last_unstale":"2023-11-15T01:37:25.815892+0000","last_undegraded":"2023-11-15T01:37:25.815892+0000","last_fullsized":"2023-11-15T01:37:25.815892+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819805+0000","last_change":"2023-11-15T01:37:25.815047+0000","last_active":"2023-11-15T01:37:25.819805+0000","last_peered":"2023-11-15T01:37:25.819805+0000","last_clean":"2023-11-15T01:37:25.819805+0000","last_became_active":"2023-11-15T01:37:25.814763+0000","last_became_peered":"2023-11-15T01:37:25.814763+0000","last_unstale":"2023-11-15T01:37:25.819805+0000","last_undegraded":"2023-11-15T01:37:25.819805+0000","last_fullsized":"2023-11-15T01:37:25.819805+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798392+0000","last_change":"2023-11-15T01:37:25.416138+0000","last_active":"2023-11-15T01:37:25.798392+0000","last_peered":"2023-11-15T01:37:25.798392+0000","last_clean":"2023-11-15T01:37:25.798392+0000","last_became_active":"2023-11-15T01:37:25.415835+0000","last_became_peered":"2023-11-15T01:37:25.415835+0000","last_unstale":"2023-11-15T01:37:25.798392+0000","last_undegraded":"2023-11-15T01:37:25.798392+0000","last_fullsized":"2023-11-15T01:37:25.798392+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812456+0000","last_change":"2023-11-15T01:37:25.801486+0000","last_active":"2023-11-15T01:37:25.812456+0000","last_peered":"2023-11-15T01:37:25.812456+0000","last_clean":"2023-11-15T01:37:25.812456+0000","last_became_active":"2023-11-15T01:37:25.801217+0000","last_became_peered":"2023-11-15T01:37:25.801217+0000","last_unstale":"2023-11-15T01:37:25.812456+0000","last_undegraded":"2023-11-15T01:37:25.812456+0000","last_fullsized":"2023-11-15T01:37:25.812456+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803447+0000","last_change":"2023-11-15T01:37:25.413617+0000","last_active":"2023-11-15T01:37:25.803447+0000","last_peered":"2023-11-15T01:37:25.803447+0000","last_clean":"2023-11-15T01:37:25.803447+0000","last_became_active":"2023-11-15T01:37:25.413326+0000","last_became_peered":"2023-11-15T01:37:25.413326+0000","last_unstale":"2023-11-15T01:37:25.803447+0000","last_undegraded":"2023-11-15T01:37:25.803447+0000","last_fullsized":"2023-11-15T01:37:25.803447+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814422+0000","last_change":"2023-11-15T01:37:25.806496+0000","last_active":"2023-11-15T01:37:25.814422+0000","last_peered":"2023-11-15T01:37:25.814422+0000","last_clean":"2023-11-15T01:37:25.814422+0000","last_became_active":"2023-11-15T01:37:25.806193+0000","last_became_peered":"2023-11-15T01:37:25.806193+0000","last_unstale":"2023-11-15T01:37:25.814422+0000","last_undegraded":"2023-11-15T01:37:25.814422+0000","last_fullsized":"2023-11-15T01:37:25.814422+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801797+0000","last_change":"2023-11-15T01:37:25.422680+0000","last_active":"2023-11-15T01:37:25.801797+0000","last_peered":"2023-11-15T01:37:25.801797+0000","last_clean":"2023-11-15T01:37:25.801797+0000","last_became_active":"2023-11-15T01:37:25.422182+0000","last_became_peered":"2023-11-15T01:37:25.422182+0000","last_unstale":"2023-11-15T01:37:25.801797+0000","last_undegraded":"2023-11-15T01:37:25.801797+0000","last_fullsized":"2023-11-15T01:37:25.801797+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.817528+0000","last_change":"2023-11-15T01:37:25.805736+0000","last_active":"2023-11-15T01:37:25.817528+0000","last_peered":"2023-11-15T01:37:25.817528+0000","last_clean":"2023-11-15T01:37:25.817528+0000","last_became_active":"2023-11-15T01:37:25.805466+0000","last_became_peered":"2023-11-15T01:37:25.805466+0000","last_unstale":"2023-11-15T01:37:25.817528+0000","last_undegraded":"2023-11-15T01:37:25.817528+0000","last_fullsized":"2023-11-15T01:37:25.817528+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.792467+0000","last_change":"2023-11-15T01:37:25.418329+0000","last_active":"2023-11-15T01:37:25.792467+0000","last_peered":"2023-11-15T01:37:25.792467+0000","last_clean":"2023-11-15T01:37:25.792467+0000","last_became_active":"2023-11-15T01:37:25.417999+0000","last_became_peered":"2023-11-15T01:37:25.417999+0000","last_unstale":"2023-11-15T01:37:25.792467+0000","last_undegraded":"2023-11-15T01:37:25.792467+0000","last_fullsized":"2023-11-15T01:37:25.792467+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813033+0000","last_change":"2023-11-15T01:37:25.807469+0000","last_active":"2023-11-15T01:37:25.813033+0000","last_peered":"2023-11-15T01:37:25.813033+0000","last_clean":"2023-11-15T01:37:25.813033+0000","last_became_active":"2023-11-15T01:37:25.807202+0000","last_became_peered":"2023-11-15T01:37:25.807202+0000","last_unstale":"2023-11-15T01:37:25.813033+0000","last_undegraded":"2023-11-15T01:37:25.813033+0000","last_fullsized":"2023-11-15T01:37:25.813033+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801552+0000","last_change":"2023-11-15T01:37:25.416493+0000","last_active":"2023-11-15T01:37:25.801552+0000","last_peered":"2023-11-15T01:37:25.801552+0000","last_clean":"2023-11-15T01:37:25.801552+0000","last_became_active":"2023-11-15T01:37:25.416156+0000","last_became_peered":"2023-11-15T01:37:25.416156+0000","last_unstale":"2023-11-15T01:37:25.801552+0000","last_undegraded":"2023-11-15T01:37:25.801552+0000","last_fullsized":"2023-11-15T01:37:25.801552+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813363+0000","last_change":"2023-11-15T01:37:25.807158+0000","last_active":"2023-11-15T01:37:25.813363+0000","last_peered":"2023-11-15T01:37:25.813363+0000","last_clean":"2023-11-15T01:37:25.813363+0000","last_became_active":"2023-11-15T01:37:25.804197+0000","last_became_peered":"2023-11-15T01:37:25.804197+0000","last_unstale":"2023-11-15T01:37:25.813363+0000","last_undegraded":"2023-11-15T01:37:25.813363+0000","last_fullsized":"2023-11-15T01:37:25.813363+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807648+0000","last_change":"2023-11-15T01:37:25.415719+0000","last_active":"2023-11-15T01:37:25.807648+0000","last_peered":"2023-11-15T01:37:25.807648+0000","last_clean":"2023-11-15T01:37:25.807648+0000","last_became_active":"2023-11-15T01:37:25.414403+0000","last_became_peered":"2023-11-15T01:37:25.414403+0000","last_unstale":"2023-11-15T01:37:25.807648+0000","last_undegraded":"2023-11-15T01:37:25.807648+0000","last_fullsized":"2023-11-15T01:37:25.807648+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.815961+0000","last_change":"2023-11-15T01:37:25.810768+0000","last_active":"2023-11-15T01:37:25.815961+0000","last_peered":"2023-11-15T01:37:25.815961+0000","last_clean":"2023-11-15T01:37:25.815961+0000","last_became_active":"2023-11-15T01:37:25.810322+0000","last_became_peered":"2023-11-15T01:37:25.810322+0000","last_unstale":"2023-11-15T01:37:25.815961+0000","last_undegraded":"2023-11-15T01:37:25.815961+0000","last_fullsized":"2023-11-15T01:37:25.815961+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.791388+0000","last_change":"2023-11-15T01:37:25.414123+0000","last_active":"2023-11-15T01:37:25.791388+0000","last_peered":"2023-11-15T01:37:25.791388+0000","last_clean":"2023-11-15T01:37:25.791388+0000","last_became_active":"2023-11-15T01:37:25.413793+0000","last_became_peered":"2023-11-15T01:37:25.413793+0000","last_unstale":"2023-11-15T01:37:25.791388+0000","last_undegraded":"2023-11-15T01:37:25.791388+0000","last_fullsized":"2023-11-15T01:37:25.791388+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813077+0000","last_change":"2023-11-15T01:37:25.810101+0000","last_active":"2023-11-15T01:37:25.813077+0000","last_peered":"2023-11-15T01:37:25.813077+0000","last_clean":"2023-11-15T01:37:25.813077+0000","last_became_active":"2023-11-15T01:37:25.809845+0000","last_became_peered":"2023-11-15T01:37:25.809845+0000","last_unstale":"2023-11-15T01:37:25.813077+0000","last_undegraded":"2023-11-15T01:37:25.813077+0000","last_fullsized":"2023-11-15T01:37:25.813077+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"108'3","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819993+0000","last_change":"2023-11-15T01:37:25.412490+0000","last_active":"2023-11-15T01:37:25.819993+0000","last_peered":"2023-11-15T01:37:25.819993+0000","last_clean":"2023-11-15T01:37:25.819993+0000","last_became_active":"2023-11-15T01:37:25.411493+0000","last_became_peered":"2023-11-15T01:37:25.411493+0000","last_unstale":"2023-11-15T01:37:25.819993+0000","last_undegraded":"2023-11-15T01:37:25.819993+0000","last_fullsized":"2023-11-15T01:37:25.819993+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813120+0000","last_change":"2023-11-15T01:37:25.809185+0000","last_active":"2023-11-15T01:37:25.813120+0000","last_peered":"2023-11-15T01:37:25.813120+0000","last_clean":"2023-11-15T01:37:25.813120+0000","last_became_active":"2023-11-15T01:37:25.808906+0000","last_became_peered":"2023-11-15T01:37:25.808906+0000","last_unstale":"2023-11-15T01:37:25.813120+0000","last_undegraded":"2023-11-15T01:37:25.813120+0000","last_fullsized":"2023-11-15T01:37:25.813120+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814808+0000","last_change":"2023-11-15T01:37:25.404139+0000","last_active":"2023-11-15T01:37:25.814808+0000","last_peered":"2023-11-15T01:37:25.814808+0000","last_clean":"2023-11-15T01:37:25.814808+0000","last_became_active":"2023-11-15T01:37:25.403845+0000","last_became_peered":"2023-11-15T01:37:25.403845+0000","last_unstale":"2023-11-15T01:37:25.814808+0000","last_undegraded":"2023-11-15T01:37:25.814808+0000","last_fullsized":"2023-11-15T01:37:25.814808+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.818199+0000","last_change":"2023-11-15T01:37:25.816681+0000","last_active":"2023-11-15T01:37:25.818199+0000","last_peered":"2023-11-15T01:37:25.818199+0000","last_clean":"2023-11-15T01:37:25.818199+0000","last_became_active":"2023-11-15T01:37:25.816348+0000","last_became_peered":"2023-11-15T01:37:25.816348+0000","last_unstale":"2023-11-15T01:37:25.818199+0000","last_undegraded":"2023-11-15T01:37:25.818199+0000","last_fullsized":"2023-11-15T01:37:25.818199+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819997+0000","last_change":"2023-11-15T01:37:25.416428+0000","last_active":"2023-11-15T01:37:25.819997+0000","last_peered":"2023-11-15T01:37:25.819997+0000","last_clean":"2023-11-15T01:37:25.819997+0000","last_became_active":"2023-11-15T01:37:25.416125+0000","last_became_peered":"2023-11-15T01:37:25.416125+0000","last_unstale":"2023-11-15T01:37:25.819997+0000","last_undegraded":"2023-11-15T01:37:25.819997+0000","last_fullsized":"2023-11-15T01:37:25.819997+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813355+0000","last_change":"2023-11-15T01:37:25.807841+0000","last_active":"2023-11-15T01:37:25.813355+0000","last_peered":"2023-11-15T01:37:25.813355+0000","last_clean":"2023-11-15T01:37:25.813355+0000","last_became_active":"2023-11-15T01:37:25.807533+0000","last_became_peered":"2023-11-15T01:37:25.807533+0000","last_unstale":"2023-11-15T01:37:25.813355+0000","last_undegraded":"2023-11-15T01:37:25.813355+0000","last_fullsized":"2023-11-15T01:37:25.813355+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798340+0000","last_change":"2023-11-15T01:37:25.405232+0000","last_active":"2023-11-15T01:37:25.798340+0000","last_peered":"2023-11-15T01:37:25.798340+0000","last_clean":"2023-11-15T01:37:25.798340+0000","last_became_active":"2023-11-15T01:37:25.404955+0000","last_became_peered":"2023-11-15T01:37:25.404955+0000","last_unstale":"2023-11-15T01:37:25.798340+0000","last_undegraded":"2023-11-15T01:37:25.798340+0000","last_fullsized":"2023-11-15T01:37:25.798340+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807683+0000","last_change":"2023-11-15T01:37:25.796369+0000","last_active":"2023-11-15T01:37:25.807683+0000","last_peered":"2023-11-15T01:37:25.807683+0000","last_clean":"2023-11-15T01:37:25.807683+0000","last_became_active":"2023-11-15T01:37:25.796095+0000","last_became_peered":"2023-11-15T01:37:25.796095+0000","last_unstale":"2023-11-15T01:37:25.807683+0000","last_undegraded":"2023-11-15T01:37:25.807683+0000","last_fullsized":"2023-11-15T01:37:25.807683+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.796007+0000","last_change":"2023-11-15T01:37:25.419012+0000","last_active":"2023-11-15T01:37:25.796007+0000","last_peered":"2023-11-15T01:37:25.796007+0000","last_clean":"2023-11-15T01:37:25.796007+0000","last_became_active":"2023-11-15T01:37:25.418723+0000","last_became_peered":"2023-11-15T01:37:25.418723+0000","last_unstale":"2023-11-15T01:37:25.796007+0000","last_undegraded":"2023-11-15T01:37:25.796007+0000","last_fullsized":"2023-11-15T01:37:25.796007+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811901+0000","last_change":"2023-11-15T01:37:25.807654+0000","last_active":"2023-11-15T01:37:25.811901+0000","last_peered":"2023-11-15T01:37:25.811901+0000","last_clean":"2023-11-15T01:37:25.811901+0000","last_became_active":"2023-11-15T01:37:25.807383+0000","last_became_peered":"2023-11-15T01:37:25.807383+0000","last_unstale":"2023-11-15T01:37:25.811901+0000","last_undegraded":"2023-11-15T01:37:25.811901+0000","last_fullsized":"2023-11-15T01:37:25.811901+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"108'4","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812373+0000","last_change":"2023-11-15T01:37:25.422349+0000","last_active":"2023-11-15T01:37:25.812373+0000","last_peered":"2023-11-15T01:37:25.812373+0000","last_clean":"2023-11-15T01:37:25.812373+0000","last_became_active":"2023-11-15T01:37:25.422074+0000","last_became_peered":"2023-11-15T01:37:25.422074+0000","last_unstale":"2023-11-15T01:37:25.812373+0000","last_undegraded":"2023-11-15T01:37:25.812373+0000","last_fullsized":"2023-11-15T01:37:25.812373+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814405+0000","last_change":"2023-11-15T01:37:25.810986+0000","last_active":"2023-11-15T01:37:25.814405+0000","last_peered":"2023-11-15T01:37:25.814405+0000","last_clean":"2023-11-15T01:37:25.814405+0000","last_became_active":"2023-11-15T01:37:25.810693+0000","last_became_peered":"2023-11-15T01:37:25.810693+0000","last_unstale":"2023-11-15T01:37:25.814405+0000","last_undegraded":"2023-11-15T01:37:25.814405+0000","last_fullsized":"2023-11-15T01:37:25.814405+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.815114+0000","last_change":"2023-11-15T01:37:25.419780+0000","last_active":"2023-11-15T01:37:25.815114+0000","last_peered":"2023-11-15T01:37:25.815114+0000","last_clean":"2023-11-15T01:37:25.815114+0000","last_became_active":"2023-11-15T01:37:25.419483+0000","last_became_peered":"2023-11-15T01:37:25.419483+0000","last_unstale":"2023-11-15T01:37:25.815114+0000","last_undegraded":"2023-11-15T01:37:25.815114+0000","last_fullsized":"2023-11-15T01:37:25.815114+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819603+0000","last_change":"2023-11-15T01:37:25.807318+0000","last_active":"2023-11-15T01:37:25.819603+0000","last_peered":"2023-11-15T01:37:25.819603+0000","last_clean":"2023-11-15T01:37:25.819603+0000","last_became_active":"2023-11-15T01:37:25.807040+0000","last_became_peered":"2023-11-15T01:37:25.807040+0000","last_unstale":"2023-11-15T01:37:25.819603+0000","last_undegraded":"2023-11-15T01:37:25.819603+0000","last_fullsized":"2023-11-15T01:37:25.819603+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803767+0000","last_change":"2023-11-15T01:37:25.415380+0000","last_active":"2023-11-15T01:37:25.803767+0000","last_peered":"2023-11-15T01:37:25.803767+0000","last_clean":"2023-11-15T01:37:25.803767+0000","last_became_active":"2023-11-15T01:37:25.415095+0000","last_became_peered":"2023-11-15T01:37:25.415095+0000","last_unstale":"2023-11-15T01:37:25.803767+0000","last_undegraded":"2023-11-15T01:37:25.803767+0000","last_fullsized":"2023-11-15T01:37:25.803767+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807536+0000","last_change":"2023-11-15T01:37:25.803469+0000","last_active":"2023-11-15T01:37:25.807536+0000","last_peered":"2023-11-15T01:37:25.807536+0000","last_clean":"2023-11-15T01:37:25.807536+0000","last_became_active":"2023-11-15T01:37:25.803181+0000","last_became_peered":"2023-11-15T01:37:25.803181+0000","last_unstale":"2023-11-15T01:37:25.807536+0000","last_undegraded":"2023-11-15T01:37:25.807536+0000","last_fullsized":"2023-11-15T01:37:25.807536+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801457+0000","last_change":"2023-11-15T01:37:25.412639+0000","last_active":"2023-11-15T01:37:25.801457+0000","last_peered":"2023-11-15T01:37:25.801457+0000","last_clean":"2023-11-15T01:37:25.801457+0000","last_became_active":"2023-11-15T01:37:25.411867+0000","last_became_peered":"2023-11-15T01:37:25.411867+0000","last_unstale":"2023-11-15T01:37:25.801457+0000","last_undegraded":"2023-11-15T01:37:25.801457+0000","last_fullsized":"2023-11-15T01:37:25.801457+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.816802+0000","last_change":"2023-11-15T01:37:25.808140+0000","last_active":"2023-11-15T01:37:25.816802+0000","last_peered":"2023-11-15T01:37:25.816802+0000","last_clean":"2023-11-15T01:37:25.816802+0000","last_became_active":"2023-11-15T01:37:25.807819+0000","last_became_peered":"2023-11-15T01:37:25.807819+0000","last_unstale":"2023-11-15T01:37:25.816802+0000","last_undegraded":"2023-11-15T01:37:25.816802+0000","last_fullsized":"2023-11-15T01:37:25.816802+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798292+0000","last_change":"2023-11-15T01:37:25.409692+0000","last_active":"2023-11-15T01:37:25.798292+0000","last_peered":"2023-11-15T01:37:25.798292+0000","last_clean":"2023-11-15T01:37:25.798292+0000","last_became_active":"2023-11-15T01:37:25.409430+0000","last_became_peered":"2023-11-15T01:37:25.409430+0000","last_unstale":"2023-11-15T01:37:25.798292+0000","last_undegraded":"2023-11-15T01:37:25.798292+0000","last_fullsized":"2023-11-15T01:37:25.798292+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811684+0000","last_change":"2023-11-15T01:37:25.805180+0000","last_active":"2023-11-15T01:37:25.811684+0000","last_peered":"2023-11-15T01:37:25.811684+0000","last_clean":"2023-11-15T01:37:25.811684+0000","last_became_active":"2023-11-15T01:37:25.804916+0000","last_became_peered":"2023-11-15T01:37:25.804916+0000","last_unstale":"2023-11-15T01:37:25.811684+0000","last_undegraded":"2023-11-15T01:37:25.811684+0000","last_fullsized":"2023-11-15T01:37:25.811684+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798571+0000","last_change":"2023-11-15T01:37:25.409244+0000","last_active":"2023-11-15T01:37:25.798571+0000","last_peered":"2023-11-15T01:37:25.798571+0000","last_clean":"2023-11-15T01:37:25.798571+0000","last_became_active":"2023-11-15T01:37:25.406533+0000","last_became_peered":"2023-11-15T01:37:25.406533+0000","last_unstale":"2023-11-15T01:37:25.798571+0000","last_undegraded":"2023-11-15T01:37:25.798571+0000","last_fullsized":"2023-11-15T01:37:25.798571+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.805299+0000","last_change":"2023-11-15T01:37:25.801143+0000","last_active":"2023-11-15T01:37:25.805299+0000","last_peered":"2023-11-15T01:37:25.805299+0000","last_clean":"2023-11-15T01:37:25.805299+0000","last_became_active":"2023-11-15T01:37:25.800873+0000","last_became_peered":"2023-11-15T01:37:25.800873+0000","last_unstale":"2023-11-15T01:37:25.805299+0000","last_undegraded":"2023-11-15T01:37:25.805299+0000","last_fullsized":"2023-11-15T01:37:25.805299+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.805699+0000","last_change":"2023-11-15T01:37:25.419213+0000","last_active":"2023-11-15T01:37:25.805699+0000","last_peered":"2023-11-15T01:37:25.805699+0000","last_clean":"2023-11-15T01:37:25.805699+0000","last_became_active":"2023-11-15T01:37:25.418887+0000","last_became_peered":"2023-11-15T01:37:25.418887+0000","last_unstale":"2023-11-15T01:37:25.805699+0000","last_undegraded":"2023-11-15T01:37:25.805699+0000","last_fullsized":"2023-11-15T01:37:25.805699+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819120+0000","last_change":"2023-11-15T01:37:25.813749+0000","last_active":"2023-11-15T01:37:25.819120+0000","last_peered":"2023-11-15T01:37:25.819120+0000","last_clean":"2023-11-15T01:37:25.819120+0000","last_became_active":"2023-11-15T01:37:25.813486+0000","last_became_peered":"2023-11-15T01:37:25.813486+0000","last_unstale":"2023-11-15T01:37:25.819120+0000","last_undegraded":"2023-11-15T01:37:25.819120+0000","last_fullsized":"2023-11-15T01:37:25.819120+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.797259+0000","last_change":"2023-11-15T01:37:25.410488+0000","last_active":"2023-11-15T01:37:25.797259+0000","last_peered":"2023-11-15T01:37:25.797259+0000","last_clean":"2023-11-15T01:37:25.797259+0000","last_became_active":"2023-11-15T01:37:25.410177+0000","last_became_peered":"2023-11-15T01:37:25.410177+0000","last_unstale":"2023-11-15T01:37:25.797259+0000","last_undegraded":"2023-11-15T01:37:25.797259+0000","last_fullsized":"2023-11-15T01:37:25.797259+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819620+0000","last_change":"2023-11-15T01:37:25.807363+0000","last_active":"2023-11-15T01:37:25.819620+0000","last_peered":"2023-11-15T01:37:25.819620+0000","last_clean":"2023-11-15T01:37:25.819620+0000","last_became_active":"2023-11-15T01:37:25.807089+0000","last_became_peered":"2023-11-15T01:37:25.807089+0000","last_unstale":"2023-11-15T01:37:25.819620+0000","last_undegraded":"2023-11-15T01:37:25.819620+0000","last_fullsized":"2023-11-15T01:37:25.819620+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801665+0000","last_change":"2023-11-15T01:37:25.422474+0000","last_active":"2023-11-15T01:37:25.801665+0000","last_peered":"2023-11-15T01:37:25.801665+0000","last_clean":"2023-11-15T01:37:25.801665+0000","last_became_active":"2023-11-15T01:37:25.422209+0000","last_became_peered":"2023-11-15T01:37:25.422209+0000","last_unstale":"2023-11-15T01:37:25.801665+0000","last_undegraded":"2023-11-15T01:37:25.801665+0000","last_fullsized":"2023-11-15T01:37:25.801665+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.808626+0000","last_change":"2023-11-15T01:37:25.804923+0000","last_active":"2023-11-15T01:37:25.808626+0000","last_peered":"2023-11-15T01:37:25.808626+0000","last_clean":"2023-11-15T01:37:25.808626+0000","last_became_active":"2023-11-15T01:37:25.804493+0000","last_became_peered":"2023-11-15T01:37:25.804493+0000","last_unstale":"2023-11-15T01:37:25.808626+0000","last_undegraded":"2023-11-15T01:37:25.808626+0000","last_fullsized":"2023-11-15T01:37:25.808626+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812722+0000","last_change":"2023-11-15T01:37:25.418505+0000","last_active":"2023-11-15T01:37:25.812722+0000","last_peered":"2023-11-15T01:37:25.812722+0000","last_clean":"2023-11-15T01:37:25.812722+0000","last_became_active":"2023-11-15T01:37:25.417849+0000","last_became_peered":"2023-11-15T01:37:25.417849+0000","last_unstale":"2023-11-15T01:37:25.812722+0000","last_undegraded":"2023-11-15T01:37:25.812722+0000","last_fullsized":"2023-11-15T01:37:25.812722+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":87,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803604+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:37:25.803604+0000","last_peered":"2023-11-15T01:37:25.803604+0000","last_clean":"2023-11-15T01:37:25.803604+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:37:25.803604+0000","last_undegraded":"2023-11-15T01:37:25.803604+0000","last_fullsized":"2023-11-15T01:37:25.803604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813918+0000","last_change":"2023-11-15T01:37:25.812577+0000","last_active":"2023-11-15T01:37:25.813918+0000","last_peered":"2023-11-15T01:37:25.813918+0000","last_clean":"2023-11-15T01:37:25.813918+0000","last_became_active":"2023-11-15T01:37:25.812293+0000","last_became_peered":"2023-11-15T01:37:25.812293+0000","last_unstale":"2023-11-15T01:37:25.813918+0000","last_undegraded":"2023-11-15T01:37:25.813918+0000","last_fullsized":"2023-11-15T01:37:25.813918+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801571+0000","last_change":"2023-11-15T01:37:25.410009+0000","last_active":"2023-11-15T01:37:25.801571+0000","last_peered":"2023-11-15T01:37:25.801571+0000","last_clean":"2023-11-15T01:37:25.801571+0000","last_became_active":"2023-11-15T01:37:25.409735+0000","last_became_peered":"2023-11-15T01:37:25.409735+0000","last_unstale":"2023-11-15T01:37:25.801571+0000","last_undegraded":"2023-11-15T01:37:25.801571+0000","last_fullsized":"2023-11-15T01:37:25.801571+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.805793+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:37:25.805793+0000","last_peered":"2023-11-15T01:37:25.805793+0000","last_clean":"2023-11-15T01:37:25.805793+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:37:25.805793+0000","last_undegraded":"2023-11-15T01:37:25.805793+0000","last_fullsized":"2023-11-15T01:37:25.805793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814344+0000","last_change":"2023-11-15T01:37:25.807465+0000","last_active":"2023-11-15T01:37:25.814344+0000","last_peered":"2023-11-15T01:37:25.814344+0000","last_clean":"2023-11-15T01:37:25.814344+0000","last_became_active":"2023-11-15T01:37:25.807190+0000","last_became_peered":"2023-11-15T01:37:25.807190+0000","last_unstale":"2023-11-15T01:37:25.814344+0000","last_undegraded":"2023-11-15T01:37:25.814344+0000","last_fullsized":"2023-11-15T01:37:25.814344+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819413+0000","last_change":"2023-11-15T01:37:25.419258+0000","last_active":"2023-11-15T01:37:25.819413+0000","last_peered":"2023-11-15T01:37:25.819413+0000","last_clean":"2023-11-15T01:37:25.819413+0000","last_became_active":"2023-11-15T01:37:25.418620+0000","last_became_peered":"2023-11-15T01:37:25.418620+0000","last_unstale":"2023-11-15T01:37:25.819413+0000","last_undegraded":"2023-11-15T01:37:25.819413+0000","last_fullsized":"2023-11-15T01:37:25.819413+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":92,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.787535+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:37:25.787535+0000","last_peered":"2023-11-15T01:37:25.787535+0000","last_clean":"2023-11-15T01:37:25.787535+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:37:25.787535+0000","last_undegraded":"2023-11-15T01:37:25.787535+0000","last_fullsized":"2023-11-15T01:37:25.787535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811757+0000","last_change":"2023-11-15T01:37:25.805821+0000","last_active":"2023-11-15T01:37:25.811757+0000","last_peered":"2023-11-15T01:37:25.811757+0000","last_clean":"2023-11-15T01:37:25.811757+0000","last_became_active":"2023-11-15T01:37:25.805535+0000","last_became_peered":"2023-11-15T01:37:25.805535+0000","last_unstale":"2023-11-15T01:37:25.811757+0000","last_undegraded":"2023-11-15T01:37:25.811757+0000","last_fullsized":"2023-11-15T01:37:25.811757+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803523+0000","last_change":"2023-11-15T01:37:25.424116+0000","last_active":"2023-11-15T01:37:25.803523+0000","last_peered":"2023-11-15T01:37:25.803523+0000","last_clean":"2023-11-15T01:37:25.803523+0000","last_became_active":"2023-11-15T01:37:25.423763+0000","last_became_peered":"2023-11-15T01:37:25.423763+0000","last_unstale":"2023-11-15T01:37:25.803523+0000","last_undegraded":"2023-11-15T01:37:25.803523+0000","last_fullsized":"2023-11-15T01:37:25.803523+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.804171+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:37:25.804171+0000","last_peered":"2023-11-15T01:37:25.804171+0000","last_clean":"2023-11-15T01:37:25.804171+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:37:25.804171+0000","last_undegraded":"2023-11-15T01:37:25.804171+0000","last_fullsized":"2023-11-15T01:37:25.804171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":84,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801753+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:37:25.801753+0000","last_peered":"2023-11-15T01:37:25.801753+0000","last_clean":"2023-11-15T01:37:25.801753+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:37:25.801753+0000","last_undegraded":"2023-11-15T01:37:25.801753+0000","last_fullsized":"2023-11-15T01:37:25.801753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819651+0000","last_change":"2023-11-15T01:37:25.808026+0000","last_active":"2023-11-15T01:37:25.819651+0000","last_peered":"2023-11-15T01:37:25.819651+0000","last_clean":"2023-11-15T01:37:25.819651+0000","last_became_active":"2023-11-15T01:37:25.807733+0000","last_became_peered":"2023-11-15T01:37:25.807733+0000","last_unstale":"2023-11-15T01:37:25.819651+0000","last_undegraded":"2023-11-15T01:37:25.819651+0000","last_fullsized":"2023-11-15T01:37:25.819651+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.816224+0000","last_change":"2023-11-15T01:37:25.418245+0000","last_active":"2023-11-15T01:37:25.816224+0000","last_peered":"2023-11-15T01:37:25.816224+0000","last_clean":"2023-11-15T01:37:25.816224+0000","last_became_active":"2023-11-15T01:37:25.417901+0000","last_became_peered":"2023-11-15T01:37:25.417901+0000","last_unstale":"2023-11-15T01:37:25.816224+0000","last_undegraded":"2023-11-15T01:37:25.816224+0000","last_fullsized":"2023-11-15T01:37:25.816224+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":82,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801840+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:37:25.801840+0000","last_peered":"2023-11-15T01:37:25.801840+0000","last_clean":"2023-11-15T01:37:25.801840+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:37:25.801840+0000","last_undegraded":"2023-11-15T01:37:25.801840+0000","last_fullsized":"2023-11-15T01:37:25.801840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.806930+0000","last_change":"2023-11-15T01:37:25.805178+0000","last_active":"2023-11-15T01:37:25.806930+0000","last_peered":"2023-11-15T01:37:25.806930+0000","last_clean":"2023-11-15T01:37:25.806930+0000","last_became_active":"2023-11-15T01:37:25.804905+0000","last_became_peered":"2023-11-15T01:37:25.804905+0000","last_unstale":"2023-11-15T01:37:25.806930+0000","last_undegraded":"2023-11-15T01:37:25.806930+0000","last_fullsized":"2023-11-15T01:37:25.806930+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.788036+0000","last_change":"2023-11-15T01:37:25.415983+0000","last_active":"2023-11-15T01:37:25.788036+0000","last_peered":"2023-11-15T01:37:25.788036+0000","last_clean":"2023-11-15T01:37:25.788036+0000","last_became_active":"2023-11-15T01:37:25.415669+0000","last_became_peered":"2023-11-15T01:37:25.415669+0000","last_unstale":"2023-11-15T01:37:25.788036+0000","last_undegraded":"2023-11-15T01:37:25.788036+0000","last_fullsized":"2023-11-15T01:37:25.788036+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":82,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.800664+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:37:25.800664+0000","last_peered":"2023-11-15T01:37:25.800664+0000","last_clean":"2023-11-15T01:37:25.800664+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:37:25.800664+0000","last_undegraded":"2023-11-15T01:37:25.800664+0000","last_fullsized":"2023-11-15T01:37:25.800664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819233+0000","last_change":"2023-11-15T01:37:25.813192+0000","last_active":"2023-11-15T01:37:25.819233+0000","last_peered":"2023-11-15T01:37:25.819233+0000","last_clean":"2023-11-15T01:37:25.819233+0000","last_became_active":"2023-11-15T01:37:25.812962+0000","last_became_peered":"2023-11-15T01:37:25.812962+0000","last_unstale":"2023-11-15T01:37:25.819233+0000","last_undegraded":"2023-11-15T01:37:25.819233+0000","last_fullsized":"2023-11-15T01:37:25.819233+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.804324+0000","last_change":"2023-11-15T01:37:25.414908+0000","last_active":"2023-11-15T01:37:25.804324+0000","last_peered":"2023-11-15T01:37:25.804324+0000","last_clean":"2023-11-15T01:37:25.804324+0000","last_became_active":"2023-11-15T01:37:25.414175+0000","last_became_peered":"2023-11-15T01:37:25.414175+0000","last_unstale":"2023-11-15T01:37:25.804324+0000","last_undegraded":"2023-11-15T01:37:25.804324+0000","last_fullsized":"2023-11-15T01:37:25.804324+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":87,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.805288+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:37:25.805288+0000","last_peered":"2023-11-15T01:37:25.805288+0000","last_clean":"2023-11-15T01:37:25.805288+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:37:25.805288+0000","last_undegraded":"2023-11-15T01:37:25.805288+0000","last_fullsized":"2023-11-15T01:37:25.805288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807563+0000","last_change":"2023-11-15T01:37:25.803563+0000","last_active":"2023-11-15T01:37:25.807563+0000","last_peered":"2023-11-15T01:37:25.807563+0000","last_clean":"2023-11-15T01:37:25.807563+0000","last_became_active":"2023-11-15T01:37:25.803286+0000","last_became_peered":"2023-11-15T01:37:25.803286+0000","last_unstale":"2023-11-15T01:37:25.807563+0000","last_undegraded":"2023-11-15T01:37:25.807563+0000","last_fullsized":"2023-11-15T01:37:25.807563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.787733+0000","last_change":"2023-11-15T01:37:25.419665+0000","last_active":"2023-11-15T01:37:25.787733+0000","last_peered":"2023-11-15T01:37:25.787733+0000","last_clean":"2023-11-15T01:37:25.787733+0000","last_became_active":"2023-11-15T01:37:25.419392+0000","last_became_peered":"2023-11-15T01:37:25.419392+0000","last_unstale":"2023-11-15T01:37:25.787733+0000","last_undegraded":"2023-11-15T01:37:25.787733+0000","last_fullsized":"2023-11-15T01:37:25.787733+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.799054+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:37:25.799054+0000","last_peered":"2023-11-15T01:37:25.799054+0000","last_clean":"2023-11-15T01:37:25.799054+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:37:25.799054+0000","last_undegraded":"2023-11-15T01:37:25.799054+0000","last_fullsized":"2023-11-15T01:37:25.799054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302508,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069332,"statfs":{"total":96636764160,"available":96326995968,"internally_reserved":0,"allocated":1347584,"data_stored":688650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68500000000000005,"5min":0.71199999999999997,"15min":0.82299999999999995},"last":0.433},{"interface":"front","average":{"1min":0.624,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.35799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":2.9020000000000001,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68500000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.621},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.34499999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67100000000000004,"5min":0.80800000000000005,"15min":0.81499999999999995},"last":0.49199999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.82599999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73799999999999999,"5min":0.82299999999999995,"15min":0.86299999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.80700000000000005,"15min":0.85999999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.9209999999999998,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.64000000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45400000000000001,"15min":0.46500000000000002},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.84499999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.57999999999999996}]},{"osd":5,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47699999999999998,"15min":0.48499999999999999},"min":{"1min":0.26500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.36499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72299999999999998,"5min":0.73899999999999999,"15min":0.78500000000000003},"last":0.55500000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82999999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.73999999999999999,"5min":0.755,"15min":0.85099999999999998},"last":0.60399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575039,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302520,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069320,"statfs":{"total":96636764160,"available":96326983680,"internally_reserved":0,"allocated":1359872,"data_stored":690706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.29199999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.439},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73299999999999998,"5min":0.89000000000000001,"15min":0.97799999999999998},"last":0.42299999999999999}]},{"osd":1,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54900000000000004,"15min":0.56299999999999994},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.0649999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.33100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.75700000000000001,"5min":0.79100000000000004,"15min":1.038},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.52700000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.77100000000000002,"5min":0.85499999999999998,"15min":1.028},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35699999999999998},"max":{"1min":0.67100000000000004,"5min":0.874,"15min":1.004},"last":0.59299999999999997}]},{"osd":4,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44700000000000001,"15min":0.44800000000000001},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.68200000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.25800000000000001},"max":{"1min":0.65400000000000003,"5min":0.73299999999999998,"15min":0.81799999999999995},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63500000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.70999999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.627}]},{"osd":7,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.496,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":0.64000000000000001,"5min":0.72099999999999997,"15min":0.86499999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.34000000000000002},"max":{"1min":0.67200000000000004,"5min":0.82399999999999995,"15min":1.0009999999999999},"last":0.66500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575040,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":688594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.373,"15min":0.376},"min":{"1min":0.25,"5min":0.249,"15min":0.23999999999999999},"max":{"1min":0.59099999999999997,"5min":0.73699999999999999,"15min":0.77800000000000002},"last":0.246},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.29399999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.22600000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.252},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.27800000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.31},"max":{"1min":9.641,"5min":9.641,"15min":9.641},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.53800000000000003,"15min":0.496},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.28000000000000003},"max":{"1min":9.6199999999999992,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.38900000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.68500000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.0509999999999999},"last":0.61899999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71699999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.40400000000000003,"15min":0.373},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.46200000000000002,"5min":0.441,"15min":0.42799999999999999},"max":{"1min":0.77500000000000002,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.73399999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0429999999999999,"5min":1.0509999999999999,"15min":1.25},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66800000000000004,"15min":0.68799999999999994},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81499999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.76500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575038,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302520,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069320,"statfs":{"total":96636764160,"available":96326983680,"internally_reserved":0,"allocated":1359872,"data_stored":689432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.375,"15min":0.36899999999999999},"min":{"1min":0.23799999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.498,"5min":2.024,"15min":2.024},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.42799999999999999,"15min":0.41599999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.215},"max":{"1min":0.60199999999999998,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.376}]},{"osd":2,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.39200000000000002,"15min":0.38700000000000001},"min":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.44600000000000001,"5min":1.768,"15min":1.768},"last":0.318},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.437,"15min":0.44},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60799999999999998,"5min":1.982,"15min":1.982},"last":0.44700000000000001}]},{"osd":3,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.433,"15min":0.434},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.22500000000000001},"max":{"1min":0.58599999999999997,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.45400000000000001,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.28100000000000003,"15min":0.27700000000000002},"max":{"1min":0.56299999999999994,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.28299999999999997}]},{"osd":4,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79400000000000004,"5min":0.97799999999999998,"15min":1.454},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82799999999999996,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78500000000000003,"5min":1.881,"15min":1.881},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.42199999999999999,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.80400000000000005,"5min":0.88300000000000001,"15min":1.1120000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81799999999999995,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85799999999999998,"5min":1.917,"15min":1.917},"last":0.68899999999999995}]},{"osd":7,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.85399999999999998,"5min":1.843,"15min":1.843},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67400000000000004,"15min":0.68999999999999995},"min":{"1min":0.49399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84599999999999997,"5min":0.92300000000000004,"15min":1.4119999999999999},"last":0.749}]}]},{"osd":2,"up_from":13,"seq":55834575039,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306596,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065244,"statfs":{"total":96636764160,"available":96322809856,"internally_reserved":0,"allocated":1339392,"data_stored":688594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36499999999999999,"15min":0.36899999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52500000000000002,"5min":0.55100000000000005,"15min":0.61899999999999999},"last":0.218},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.39800000000000002,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.57699999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.251}]},{"osd":1,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.222},"max":{"1min":0.745,"5min":0.745,"15min":0.75},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.441,"15min":0.442},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.69799999999999995,"5min":0.73499999999999999,"15min":0.92000000000000004},"last":0.28499999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.248},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45000000000000001,"15min":0.44400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.253},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.27300000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59999999999999998,"15min":0.625},"min":{"1min":0.41299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92700000000000005,"5min":1.0549999999999999,"15min":1.0800000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.39200000000000002},"max":{"1min":0.872,"5min":0.91100000000000003,"15min":1.052},"last":0.41199999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.627,"15min":0.64800000000000002},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.89400000000000002,"5min":1.032,"15min":1.032},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.64100000000000001},"min":{"1min":0.44700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.871,"5min":0.96699999999999997,"15min":1.1339999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.66300000000000003},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.876,"5min":1.002,"15min":1.0389999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.65300000000000002,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85699999999999998,"5min":1.0669999999999999,"15min":1.119},"last":0.56200000000000006}]},{"osd":7,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.67700000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78300000000000003,"5min":1.079,"15min":1.103},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67600000000000005,"15min":0.69499999999999995},"min":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.86599999999999999,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.53000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575040,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306604,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065236,"statfs":{"total":96636764160,"available":96322801664,"internally_reserved":0,"allocated":1347584,"data_stored":689556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48399999999999999,"5min":0.65900000000000003,"15min":0.79900000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.38200000000000001,"15min":0.39800000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23200000000000001},"max":{"1min":0.60699999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.48599999999999999}]},{"osd":1,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.371,"15min":0.38700000000000001},"min":{"1min":0.27000000000000002,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":0.47499999999999998,"5min":0.59799999999999998,"15min":0.72899999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.42799999999999999,"15min":0.44400000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52700000000000002,"5min":0.72499999999999998,"15min":0.80500000000000005},"last":0.5}]},{"osd":2,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.42699999999999999,"15min":0.44600000000000001},"min":{"1min":0.28000000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61699999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.45300000000000001,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26200000000000001},"max":{"1min":0.53000000000000003,"5min":0.69199999999999995,"15min":0.81999999999999995},"last":0.46400000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58699999999999997,"15min":0.61799999999999999},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.80800000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.627},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.39000000000000001},"max":{"1min":0.73599999999999999,"5min":0.89200000000000002,"15min":1.0589999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.60299999999999998,"15min":0.63600000000000001},"min":{"1min":0.41799999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.72799999999999998,"5min":0.92000000000000004,"15min":1.0569999999999999},"last":0.63},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61299999999999999,"15min":0.64100000000000001},"min":{"1min":0.375,"5min":0.373,"15min":0.373},"max":{"1min":0.84899999999999998,"5min":0.879,"15min":0.95999999999999996},"last":0.61199999999999999}]},{"osd":6,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61699999999999999,"15min":0.64700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":0.94299999999999995,"15min":1.0980000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.67100000000000004},"min":{"1min":0.442,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73999999999999999,"5min":0.95799999999999996,"15min":1.169},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63500000000000001,"15min":0.66800000000000004},"min":{"1min":0.41999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88700000000000001,"5min":1.0429999999999999,"15min":1.071},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.64500000000000002,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75800000000000001,"5min":0.996,"15min":1.1459999999999999},"last":0.67300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302508,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069332,"statfs":{"total":96636764160,"available":96326995968,"internally_reserved":0,"allocated":1347584,"data_stored":689238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76500000000000001,"5min":0.88,"15min":0.88},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.32900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65600000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54000000000000004}]},{"osd":1,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55700000000000005,"15min":0.57199999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.746,"5min":1.087,"15min":1.087},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34699999999999998},"max":{"1min":0.69199999999999995,"5min":0.76600000000000001,"15min":0.81000000000000005},"last":0.52800000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.34699999999999998,"15min":0.33100000000000002},"max":{"1min":0.78900000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56200000000000006}]},{"osd":3,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72099999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30399999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.30399999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.57499999999999996}]},{"osd":6,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.34000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.53000000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82799999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.63400000000000001}]},{"osd":7,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.64300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575038,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":688594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78500000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.81200000000000006},"last":0.40000000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32600000000000001},"max":{"1min":0.68799999999999994,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.504},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33400000000000002},"max":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.441}]},{"osd":2,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.86199999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34999999999999998},"max":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":1.103},"last":0.58099999999999996}]},{"osd":3,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.376,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":1.127},"last":0.54400000000000004}]},{"osd":4,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64400000000000002,"5min":0.66500000000000004,"15min":0.94399999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.50800000000000001,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56399999999999995}]},{"osd":6,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46400000000000002,"15min":0.47599999999999998},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74399999999999999,"5min":0.83099999999999996,"15min":1.0660000000000001},"last":0.629},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.47299999999999998,"15min":0.495},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.622}]},{"osd":7,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48099999999999998,"15min":0.498},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.69899999999999995,"5min":0.72999999999999998,"15min":0.97199999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":0.85799999999999998,"15min":1.1499999999999999},"last":0.75900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:37:30.559 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-15T01:37:30.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.707+0000 7f62ae7cb700 1 Processor -- start 2023-11-15T01:37:30.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.707+0000 7f62ae7cb700 1 -- start start 2023-11-15T01:37:30.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.708+0000 7f62ae7cb700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f62a8155510 0x7f62a80c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:30.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.708+0000 7f62ae7cb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62a80c7f20 0x7f62a80c6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:30.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.708+0000 7f62ae7cb700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a8155080 con 0x7f62a814e940 2023-11-15T01:37:30.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.708+0000 7f62ae7cb700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a80c83b0 con 0x7f62a8155510 2023-11-15T01:37:30.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.708+0000 7f62ae7cb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80c1200 con 0x7f62a80c7f20 2023-11-15T01:37:30.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.708+0000 7f62adfca700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62a80c7f20 0x7f62a80c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.708+0000 7f62acfc8700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f62a8155510 0x7f62a80c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.708+0000 7f62acfc8700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f62a8155510 0x7f62a80c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:45460/0 (socket says 172.21.15.1:45460) 2023-11-15T01:37:30.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.708+0000 7f62adfca700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62a80c7f20 0x7f62a80c6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:38126/0 (socket says 172.21.15.1:38126) 2023-11-15T01:37:30.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.708+0000 7f62acfc8700 1 -- 172.21.15.1:0/3210085869 learned_addr learned my addr 172.21.15.1:0/3210085869 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:30.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.708+0000 7f62ad7c9700 1 --1- 172.21.15.1:0/3210085869 >> v1:172.21.15.141:6789/0 conn(0x7f62a814e940 0x7f62a80c0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:40414/0 (socket says 172.21.15.1:40414) 2023-11-15T01:37:30.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.709+0000 7f62adfca700 1 -- 172.21.15.1:0/3210085869 >> v2:172.21.15.141:3300/0 conn(0x7f62a8155510 msgr2=0x7f62a80c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:30.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.709+0000 7f62adfca700 1 --2- 172.21.15.1:0/3210085869 >> v2:172.21.15.141:3300/0 conn(0x7f62a8155510 0x7f62a80c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.709+0000 7f62adfca700 1 -- 172.21.15.1:0/3210085869 >> v1:172.21.15.141:6789/0 conn(0x7f62a814e940 legacy=0x7f62a80c0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.709+0000 7f62adfca700 1 -- 172.21.15.1:0/3210085869 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a80c1470 con 0x7f62a80c7f20 2023-11-15T01:37:30.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.709+0000 7f62acfc8700 1 --2- 172.21.15.1:0/3210085869 >> v2:172.21.15.141:3300/0 conn(0x7f62a8155510 0x7f62a80c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.709+0000 7f62adfca700 1 --2- 172.21.15.1:0/3210085869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62a80c7f20 0x7f62a80c6250 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f6298009e60 tx=0x7f6298009780).ready entity=mon.2 client_cookie=bc42c57b965e5825 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.709+0000 7f62a7fff700 1 -- 172.21.15.1:0/3210085869 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629800e070 con 0x7f62a80c7f20 2023-11-15T01:37:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.709+0000 7f62a7fff700 1 -- 172.21.15.1:0/3210085869 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629800bb60 con 0x7f62a80c7f20 2023-11-15T01:37:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.709+0000 7f62a7fff700 1 -- 172.21.15.1:0/3210085869 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6298012410 con 0x7f62a80c7f20 2023-11-15T01:37:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.710+0000 7f62ae7cb700 1 -- 172.21.15.1:0/3210085869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62a80c7f20 msgr2=0x7f62a80c6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.710+0000 7f62ae7cb700 1 --2- 172.21.15.1:0/3210085869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62a80c7f20 0x7f62a80c6250 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f6298009e60 tx=0x7f6298009780).stop 2023-11-15T01:37:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.710+0000 7f62ae7cb700 1 -- 172.21.15.1:0/3210085869 shutdown_connections 2023-11-15T01:37:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.710+0000 7f62ae7cb700 1 --2- 172.21.15.1:0/3210085869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62a80c7f20 0x7f62a80c6250 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.710+0000 7f62ae7cb700 1 --2- 172.21.15.1:0/3210085869 >> v2:172.21.15.141:3300/0 conn(0x7f62a8155510 0x7f62a80c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.710+0000 7f62ae7cb700 1 -- 172.21.15.1:0/3210085869 >> 172.21.15.1:0/3210085869 conn(0x7f62a8084ea0 msgr2=0x7f62a80947c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:30.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.710+0000 7f62ae7cb700 1 -- 172.21.15.1:0/3210085869 shutdown_connections 2023-11-15T01:37:30.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.710+0000 7f62ae7cb700 1 -- 172.21.15.1:0/3210085869 wait complete. 2023-11-15T01:37:30.717 INFO:tasks.ceph.mds.b.smithi141.stderr:2023-11-15T01:37:30.710+0000 7fc524954700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T01:37:30.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.711+0000 7f62ae7cb700 1 Processor -- start 2023-11-15T01:37:30.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.711+0000 7f62ae7cb700 1 -- start start 2023-11-15T01:37:30.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62ae7cb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62a80c7f20 0x7f62a80ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:30.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62ae7cb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62a814e940 0x7f62a8167bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:30.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62ae7cb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a8155510 0x7f62a81680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:30.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62ae7cb700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80abdb0 con 0x7f62a8155510 2023-11-15T01:37:30.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62ae7cb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80ab920 con 0x7f62a814e940 2023-11-15T01:37:30.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62ae7cb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80aad10 con 0x7f62a80c7f20 2023-11-15T01:37:30.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62adfca700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a8155510 0x7f62a81680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62adfca700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a8155510 0x7f62a81680b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43606/0 (socket says 172.21.15.1:43606) 2023-11-15T01:37:30.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62adfca700 1 -- 172.21.15.1:0/1687570592 learned_addr learned my addr 172.21.15.1:0/1687570592 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:30.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62ad7c9700 1 --2- 172.21.15.1:0/1687570592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62a80c7f20 0x7f62a80ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62acfc8700 1 --2- 172.21.15.1:0/1687570592 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62a814e940 0x7f62a8167bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62adfca700 1 -- 172.21.15.1:0/1687570592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62a80c7f20 msgr2=0x7f62a80ad0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62adfca700 1 --2- 172.21.15.1:0/1687570592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62a80c7f20 0x7f62a80ad0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62adfca700 1 -- 172.21.15.1:0/1687570592 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62a814e940 msgr2=0x7f62a8167bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62adfca700 1 --2- 172.21.15.1:0/1687570592 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62a814e940 0x7f62a8167bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.712+0000 7f62adfca700 1 -- 172.21.15.1:0/1687570592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c009370 con 0x7f62a8155510 2023-11-15T01:37:30.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.713+0000 7f62adfca700 1 --2- 172.21.15.1:0/1687570592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a8155510 0x7f62a81680b0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f629800b6c0 tx=0x7f6298009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:30.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.713+0000 7f62a57fa700 1 -- 172.21.15.1:0/1687570592 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6298012410 con 0x7f62a8155510 2023-11-15T01:37:30.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.713+0000 7f62a57fa700 1 -- 172.21.15.1:0/1687570592 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629801d630 con 0x7f62a8155510 2023-11-15T01:37:30.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.713+0000 7f62ae7cb700 1 -- 172.21.15.1:0/1687570592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6298009a20 con 0x7f62a8155510 2023-11-15T01:37:30.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.713+0000 7f62a57fa700 1 -- 172.21.15.1:0/1687570592 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629801d9f0 con 0x7f62a8155510 2023-11-15T01:37:30.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.713+0000 7f62ae7cb700 1 -- 172.21.15.1:0/1687570592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a80ab2d0 con 0x7f62a8155510 2023-11-15T01:37:30.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.714+0000 7f62ae7cb700 1 -- 172.21.15.1:0/1687570592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a80c5420 con 0x7f62a8155510 2023-11-15T01:37:30.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.714+0000 7f62a57fa700 1 -- 172.21.15.1:0/1687570592 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6298003040 con 0x7f62a8155510 2023-11-15T01:37:30.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.714+0000 7f62a57fa700 1 --2- 172.21.15.1:0/1687570592 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f629405f270 0x7f6294061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:30.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.715+0000 7f62a57fa700 1 -- 172.21.15.1:0/1687570592 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f629807c260 con 0x7f62a8155510 2023-11-15T01:37:30.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.715+0000 7f62ad7c9700 1 --2- 172.21.15.1:0/1687570592 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f629405f270 0x7f6294061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:30.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.715+0000 7f62ad7c9700 1 --2- 172.21.15.1:0/1687570592 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f629405f270 0x7f6294061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f62a00047d0 tx=0x7f62a0007d20).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:30.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.719+0000 7f62a57fa700 1 -- 172.21.15.1:0/1687570592 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f629804d200 con 0x7f62a8155510 2023-11-15T01:37:30.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.961+0000 7f62ae7cb700 1 -- 172.21.15.1:0/1687570592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f62a80475e0 con 0x7f62a8155510 2023-11-15T01:37:30.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.962+0000 7f62a57fa700 1 -- 172.21.15.1:0/1687570592 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+953 (secure 0 0 0) 0x7f6298050820 con 0x7f62a8155510 2023-11-15T01:37:30.964 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:30.964 INFO:teuthology.orchestra.run.smithi001.stdout:{"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":972,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1700011287,"num_in_osds":8,"osd_in_since":1700011281,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":2486534144,"bytes_avail":770607579136,"bytes_total":773094113280},"fsmap":{"epoch":47,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"b","status":"up:active","gid":7155}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-11-15T01:35:15.132534+0000","services":{}},"progress_events":{}} 2023-11-15T01:37:30.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.964+0000 7f62ae7cb700 1 -- 172.21.15.1:0/1687570592 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f629405f270 msgr2=0x7f6294061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.964+0000 7f62ae7cb700 1 --2- 172.21.15.1:0/1687570592 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f629405f270 0x7f6294061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f62a00047d0 tx=0x7f62a0007d20).stop 2023-11-15T01:37:30.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.964+0000 7f62ae7cb700 1 -- 172.21.15.1:0/1687570592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a8155510 msgr2=0x7f62a81680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:30.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.964+0000 7f62ae7cb700 1 --2- 172.21.15.1:0/1687570592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a8155510 0x7f62a81680b0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f629800b6c0 tx=0x7f6298009780).stop 2023-11-15T01:37:30.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.964+0000 7f62ae7cb700 1 -- 172.21.15.1:0/1687570592 shutdown_connections 2023-11-15T01:37:30.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.964+0000 7f62ae7cb700 1 --2- 172.21.15.1:0/1687570592 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f629405f270 0x7f6294061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.964+0000 7f62ae7cb700 1 --2- 172.21.15.1:0/1687570592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62a8155510 0x7f62a81680b0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.964+0000 7f62ae7cb700 1 --2- 172.21.15.1:0/1687570592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62a80c7f20 0x7f62a80ad0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.964+0000 7f62ae7cb700 1 --2- 172.21.15.1:0/1687570592 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62a814e940 0x7f62a8167bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:30.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.964+0000 7f62ae7cb700 1 -- 172.21.15.1:0/1687570592 >> 172.21.15.1:0/1687570592 conn(0x7f62a8084ea0 msgr2=0x7f62a814dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:30.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.964+0000 7f62ae7cb700 1 -- 172.21.15.1:0/1687570592 shutdown_connections 2023-11-15T01:37:30.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:30.964+0000 7f62ae7cb700 1 -- 172.21.15.1:0/1687570592 wait complete. 2023-11-15T01:37:30.977 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-15T01:37:30.978 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:37:31.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.094+0000 7f0158d2a700 1 Processor -- start 2023-11-15T01:37:31.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.094+0000 7f0158d2a700 1 -- start start 2023-11-15T01:37:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.095+0000 7f0158d2a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f01540c7350 0x7f0154066a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.095+0000 7f0158d2a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0154066f30 con 0x7f0154065560 2023-11-15T01:37:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.095+0000 7f0158d2a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01541528e0 con 0x7f0154069b70 2023-11-15T01:37:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.095+0000 7f0158d2a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0154151d60 con 0x7f01540c7350 2023-11-15T01:37:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.095+0000 7f0152ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0154065560 0x7f0154069460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45032/0 (socket says 172.21.15.1:45032) 2023-11-15T01:37:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.095+0000 7f0152ffd700 1 -- 172.21.15.1:0/990428443 learned_addr learned my addr 172.21.15.1:0/990428443 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.095+0000 7f01537fe700 1 --2- 172.21.15.1:0/990428443 >> v2:172.21.15.141:3300/0 conn(0x7f01540c7350 0x7f0154066a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.095+0000 7f01527fc700 1 -- 172.21.15.1:0/990428443 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1561281283 0 0) 0x7f0154066f30 con 0x7f0154065560 2023-11-15T01:37:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.095+0000 7f01527fc700 1 -- 172.21.15.1:0/990428443 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f013c0033f0 con 0x7f0154065560 2023-11-15T01:37:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01527fc700 1 -- 172.21.15.1:0/990428443 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3261693141 0 0) 0x7f013c0033f0 con 0x7f0154065560 2023-11-15T01:37:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01527fc700 1 -- 172.21.15.1:0/990428443 >> v2:172.21.15.141:3300/0 conn(0x7f01540c7350 msgr2=0x7f0154066a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01527fc700 1 --2- 172.21.15.1:0/990428443 >> v2:172.21.15.141:3300/0 conn(0x7f01540c7350 0x7f0154066a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01527fc700 1 -- 172.21.15.1:0/990428443 >> v1:172.21.15.141:6789/0 conn(0x7f0154069b70 legacy=0x7f0154155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01527fc700 1 -- 172.21.15.1:0/990428443 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0154152040 con 0x7f0154065560 2023-11-15T01:37:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01527fc700 1 -- 172.21.15.1:0/990428443 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f0148001470 con 0x7f0154065560 2023-11-15T01:37:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01527fc700 1 -- 172.21.15.1:0/990428443 >> v1:172.21.15.1:6789/0 conn(0x7f0154065560 legacy=0x7f0154069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01527fc700 1 --2- 172.21.15.1:0/990428443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f013c0038e0 0x7f013c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01527fc700 1 --2- 172.21.15.1:0/990428443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f013c004690 0x7f013c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01527fc700 1 --2- 172.21.15.1:0/990428443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f013c005000 0x7f013c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01527fc700 1 -- 172.21.15.1:0/990428443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0154151d60 con 0x7f013c005000 2023-11-15T01:37:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01527fc700 1 -- 172.21.15.1:0/990428443 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c00beb0 con 0x7f013c0038e0 2023-11-15T01:37:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01527fc700 1 -- 172.21.15.1:0/990428443 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013c00c070 con 0x7f013c004690 2023-11-15T01:37:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f0153fff700 1 --2- 172.21.15.1:0/990428443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f013c005000 0x7f013c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01537fe700 1 --2- 172.21.15.1:0/990428443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f013c0038e0 0x7f013c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:31.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f0152ffd700 1 --2- 172.21.15.1:0/990428443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f013c004690 0x7f013c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:31.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f0153fff700 1 -- 172.21.15.1:0/990428443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f013c004690 msgr2=0x7f013c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:31.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f0153fff700 1 --2- 172.21.15.1:0/990428443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f013c004690 0x7f013c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:31.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f0153fff700 1 -- 172.21.15.1:0/990428443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f013c0038e0 msgr2=0x7f013c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:31.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f0153fff700 1 --2- 172.21.15.1:0/990428443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f013c0038e0 0x7f013c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:31.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f0153fff700 1 -- 172.21.15.1:0/990428443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c0033f0 con 0x7f013c005000 2023-11-15T01:37:31.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f0153fff700 1 -- 172.21.15.1:0/990428443 reap_dead start 2023-11-15T01:37:31.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f0153fff700 1 --2- 172.21.15.1:0/990428443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f013c005000 0x7f013c00b8e0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f014c001e30 tx=0x7f014c007f30).ready entity=mon.0 client_cookie=2629962ecfdfdf62 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:31.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01527fc700 1 -- 172.21.15.1:0/990428443 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c006a20 con 0x7f013c005000 2023-11-15T01:37:31.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.096+0000 7f01527fc700 1 -- 172.21.15.1:0/990428443 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c006b80 con 0x7f013c005000 2023-11-15T01:37:31.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.097+0000 7f01527fc700 1 -- 172.21.15.1:0/990428443 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c00c5d0 con 0x7f013c005000 2023-11-15T01:37:31.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.097+0000 7f0158d2a700 1 -- 172.21.15.1:0/990428443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f013c005000 msgr2=0x7f013c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:31.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.097+0000 7f0158d2a700 1 --2- 172.21.15.1:0/990428443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f013c005000 0x7f013c00b8e0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f014c001e30 tx=0x7f014c007f30).stop 2023-11-15T01:37:31.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.097+0000 7f0158d2a700 1 -- 172.21.15.1:0/990428443 shutdown_connections 2023-11-15T01:37:31.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.097+0000 7f0158d2a700 1 --2- 172.21.15.1:0/990428443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f013c005000 0x7f013c00b8e0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:31.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.097+0000 7f0158d2a700 1 -- 172.21.15.1:0/990428443 >> 172.21.15.1:0/990428443 conn(0x7f01540c7c10 msgr2=0x7f01540c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:31.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.097+0000 7f0158d2a700 1 -- 172.21.15.1:0/990428443 shutdown_connections 2023-11-15T01:37:31.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.097+0000 7f0158d2a700 1 -- 172.21.15.1:0/990428443 wait complete. 2023-11-15T01:37:31.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.098+0000 7f0158d2a700 1 Processor -- start 2023-11-15T01:37:31.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.098+0000 7f0158d2a700 1 -- start start 2023-11-15T01:37:31.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.099+0000 7f0158d2a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f013c005000 0x7f0154161a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.099+0000 7f0158d2a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f01541503c0 0x7f01540a9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.099+0000 7f0158d2a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01540c0aa0 0x7f0154153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.099+0000 7f0158d2a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01540bf8c0 con 0x7f01540c0aa0 2023-11-15T01:37:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.099+0000 7f0158d2a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01540becb0 con 0x7f013c005000 2023-11-15T01:37:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.099+0000 7f0158d2a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01540bef90 con 0x7f01541503c0 2023-11-15T01:37:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.099+0000 7f0153fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01540c0aa0 0x7f0154153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.099+0000 7f0153fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01540c0aa0 0x7f0154153c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43628/0 (socket says 172.21.15.1:43628) 2023-11-15T01:37:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.099+0000 7f0153fff700 1 -- 172.21.15.1:0/1062795775 learned_addr learned my addr 172.21.15.1:0/1062795775 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.099+0000 7f01537fe700 1 --2- 172.21.15.1:0/1062795775 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f013c005000 0x7f0154161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.099+0000 7f0152ffd700 1 --2- 172.21.15.1:0/1062795775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f01541503c0 0x7f01540a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.100+0000 7f0153fff700 1 -- 172.21.15.1:0/1062795775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f01541503c0 msgr2=0x7f01540a9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:31.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.100+0000 7f0153fff700 1 --2- 172.21.15.1:0/1062795775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f01541503c0 0x7f01540a9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:31.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.100+0000 7f0153fff700 1 -- 172.21.15.1:0/1062795775 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f013c005000 msgr2=0x7f0154161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:31.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.100+0000 7f0153fff700 1 --2- 172.21.15.1:0/1062795775 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f013c005000 0x7f0154161a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:31.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.100+0000 7f0153fff700 1 -- 172.21.15.1:0/1062795775 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01540bf270 con 0x7f01540c0aa0 2023-11-15T01:37:31.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.100+0000 7f0153fff700 1 --2- 172.21.15.1:0/1062795775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01540c0aa0 0x7f0154153c30 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f015413ab70 tx=0x7f014c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:31.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.100+0000 7f013b7fe700 1 -- 172.21.15.1:0/1062795775 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c00c5d0 con 0x7f01540c0aa0 2023-11-15T01:37:31.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.100+0000 7f013b7fe700 1 -- 172.21.15.1:0/1062795775 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c013c90 con 0x7f01540c0aa0 2023-11-15T01:37:31.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.100+0000 7f013b7fe700 1 -- 172.21.15.1:0/1062795775 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c006a20 con 0x7f01540c0aa0 2023-11-15T01:37:31.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.100+0000 7f0158d2a700 1 -- 172.21.15.1:0/1062795775 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01540bf550 con 0x7f01540c0aa0 2023-11-15T01:37:31.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.100+0000 7f0158d2a700 1 -- 172.21.15.1:0/1062795775 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01540a9a10 con 0x7f01540c0aa0 2023-11-15T01:37:31.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.101+0000 7f0158d2a700 1 -- 172.21.15.1:0/1062795775 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01540475e0 con 0x7f01540c0aa0 2023-11-15T01:37:31.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.101+0000 7f013b7fe700 1 -- 172.21.15.1:0/1062795775 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f014c01d950 con 0x7f01540c0aa0 2023-11-15T01:37:31.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.102+0000 7f013b7fe700 1 --2- 172.21.15.1:0/1062795775 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f014005f270 0x7f0140061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:31.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.102+0000 7f013b7fe700 1 -- 172.21.15.1:0/1062795775 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f014c07bc10 con 0x7f01540c0aa0 2023-11-15T01:37:31.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.102+0000 7f01537fe700 1 --2- 172.21.15.1:0/1062795775 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f014005f270 0x7f0140061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:31.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.102+0000 7f01537fe700 1 --2- 172.21.15.1:0/1062795775 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f014005f270 0x7f0140061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0144006d50 tx=0x7f0144008040).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:31.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.106+0000 7f013b7fe700 1 -- 172.21.15.1:0/1062795775 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f014c04cbb0 con 0x7f01540c0aa0 2023-11-15T01:37:31.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.272+0000 7f0158d2a700 1 -- 172.21.15.1:0/1062795775 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01541528e0 con 0x7f014005f270 2023-11-15T01:37:31.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.283+0000 7f013b7fe700 1 -- 172.21.15.1:0/1062795775 <== mgr.6466 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361471 (secure 0 0 0) 0x7f01541528e0 con 0x7f014005f270 2023-11-15T01:37:31.288 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:31.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.286+0000 7f0158d2a700 1 -- 172.21.15.1:0/1062795775 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f014005f270 msgr2=0x7f0140061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:31.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.286+0000 7f0158d2a700 1 --2- 172.21.15.1:0/1062795775 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f014005f270 0x7f0140061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0144006d50 tx=0x7f0144008040).stop 2023-11-15T01:37:31.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.286+0000 7f0158d2a700 1 -- 172.21.15.1:0/1062795775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01540c0aa0 msgr2=0x7f0154153c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:31.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.286+0000 7f0158d2a700 1 --2- 172.21.15.1:0/1062795775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01540c0aa0 0x7f0154153c30 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f015413ab70 tx=0x7f014c016000).stop 2023-11-15T01:37:31.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.286+0000 7f0158d2a700 1 -- 172.21.15.1:0/1062795775 shutdown_connections 2023-11-15T01:37:31.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.286+0000 7f0158d2a700 1 --2- 172.21.15.1:0/1062795775 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f014005f270 0x7f0140061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:31.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.286+0000 7f0158d2a700 1 --2- 172.21.15.1:0/1062795775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01540c0aa0 0x7f0154153c30 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:31.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.286+0000 7f0158d2a700 1 --2- 172.21.15.1:0/1062795775 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f013c005000 0x7f0154161a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:31.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.286+0000 7f0158d2a700 1 --2- 172.21.15.1:0/1062795775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f01541503c0 0x7f01540a9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:31.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.286+0000 7f0158d2a700 1 -- 172.21.15.1:0/1062795775 >> 172.21.15.1:0/1062795775 conn(0x7f01540c7c10 msgr2=0x7f0154151010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:31.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.286+0000 7f0158d2a700 1 -- 172.21.15.1:0/1062795775 shutdown_connections 2023-11-15T01:37:31.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:31.286+0000 7f0158d2a700 1 -- 172.21.15.1:0/1062795775 wait complete. 2023-11-15T01:37:31.293 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:37:31.299 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T01:37:30.352340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428256,"kb_used_data":10528,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752546464,"statfs":{"total":773094113280,"available":770607579136,"internally_reserved":0,"allocated":10780672,"data_stored":5513364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5548,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.005618"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.818300+0000","last_change":"2023-11-15T01:37:25.816590+0000","last_active":"2023-11-15T01:37:25.818300+0000","last_peered":"2023-11-15T01:37:25.818300+0000","last_clean":"2023-11-15T01:37:25.818300+0000","last_became_active":"2023-11-15T01:37:25.816262+0000","last_became_peered":"2023-11-15T01:37:25.816262+0000","last_unstale":"2023-11-15T01:37:25.818300+0000","last_undegraded":"2023-11-15T01:37:25.818300+0000","last_fullsized":"2023-11-15T01:37:25.818300+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"108'3","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814693+0000","last_change":"2023-11-15T01:37:25.408583+0000","last_active":"2023-11-15T01:37:25.814693+0000","last_peered":"2023-11-15T01:37:25.814693+0000","last_clean":"2023-11-15T01:37:25.814693+0000","last_became_active":"2023-11-15T01:37:25.407367+0000","last_became_peered":"2023-11-15T01:37:25.407367+0000","last_unstale":"2023-11-15T01:37:25.814693+0000","last_undegraded":"2023-11-15T01:37:25.814693+0000","last_fullsized":"2023-11-15T01:37:25.814693+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811410+0000","last_change":"2023-11-15T01:37:25.806157+0000","last_active":"2023-11-15T01:37:25.811410+0000","last_peered":"2023-11-15T01:37:25.811410+0000","last_clean":"2023-11-15T01:37:25.811410+0000","last_became_active":"2023-11-15T01:37:25.805886+0000","last_became_peered":"2023-11-15T01:37:25.805886+0000","last_unstale":"2023-11-15T01:37:25.811410+0000","last_undegraded":"2023-11-15T01:37:25.811410+0000","last_fullsized":"2023-11-15T01:37:25.811410+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.805334+0000","last_change":"2023-11-15T01:37:25.420055+0000","last_active":"2023-11-15T01:37:25.805334+0000","last_peered":"2023-11-15T01:37:25.805334+0000","last_clean":"2023-11-15T01:37:25.805334+0000","last_became_active":"2023-11-15T01:37:25.419766+0000","last_became_peered":"2023-11-15T01:37:25.419766+0000","last_unstale":"2023-11-15T01:37:25.805334+0000","last_undegraded":"2023-11-15T01:37:25.805334+0000","last_fullsized":"2023-11-15T01:37:25.805334+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.816767+0000","last_change":"2023-11-15T01:37:25.807109+0000","last_active":"2023-11-15T01:37:25.816767+0000","last_peered":"2023-11-15T01:37:25.816767+0000","last_clean":"2023-11-15T01:37:25.816767+0000","last_became_active":"2023-11-15T01:37:25.806775+0000","last_became_peered":"2023-11-15T01:37:25.806775+0000","last_unstale":"2023-11-15T01:37:25.816767+0000","last_undegraded":"2023-11-15T01:37:25.816767+0000","last_fullsized":"2023-11-15T01:37:25.816767+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.800464+0000","last_change":"2023-11-15T01:37:25.418749+0000","last_active":"2023-11-15T01:37:25.800464+0000","last_peered":"2023-11-15T01:37:25.800464+0000","last_clean":"2023-11-15T01:37:25.800464+0000","last_became_active":"2023-11-15T01:37:25.418443+0000","last_became_peered":"2023-11-15T01:37:25.418443+0000","last_unstale":"2023-11-15T01:37:25.800464+0000","last_undegraded":"2023-11-15T01:37:25.800464+0000","last_fullsized":"2023-11-15T01:37:25.800464+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812937+0000","last_change":"2023-11-15T01:37:25.810112+0000","last_active":"2023-11-15T01:37:25.812937+0000","last_peered":"2023-11-15T01:37:25.812937+0000","last_clean":"2023-11-15T01:37:25.812937+0000","last_became_active":"2023-11-15T01:37:25.809789+0000","last_became_peered":"2023-11-15T01:37:25.809789+0000","last_unstale":"2023-11-15T01:37:25.812937+0000","last_undegraded":"2023-11-15T01:37:25.812937+0000","last_fullsized":"2023-11-15T01:37:25.812937+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.802236+0000","last_change":"2023-11-15T01:37:25.416214+0000","last_active":"2023-11-15T01:37:25.802236+0000","last_peered":"2023-11-15T01:37:25.802236+0000","last_clean":"2023-11-15T01:37:25.802236+0000","last_became_active":"2023-11-15T01:37:25.415899+0000","last_became_peered":"2023-11-15T01:37:25.415899+0000","last_unstale":"2023-11-15T01:37:25.802236+0000","last_undegraded":"2023-11-15T01:37:25.802236+0000","last_fullsized":"2023-11-15T01:37:25.802236+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.818600+0000","last_change":"2023-11-15T01:37:25.816925+0000","last_active":"2023-11-15T01:37:25.818600+0000","last_peered":"2023-11-15T01:37:25.818600+0000","last_clean":"2023-11-15T01:37:25.818600+0000","last_became_active":"2023-11-15T01:37:25.816682+0000","last_became_peered":"2023-11-15T01:37:25.816682+0000","last_unstale":"2023-11-15T01:37:25.818600+0000","last_undegraded":"2023-11-15T01:37:25.818600+0000","last_fullsized":"2023-11-15T01:37:25.818600+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.817460+0000","last_change":"2023-11-15T01:37:25.412742+0000","last_active":"2023-11-15T01:37:25.817460+0000","last_peered":"2023-11-15T01:37:25.817460+0000","last_clean":"2023-11-15T01:37:25.817460+0000","last_became_active":"2023-11-15T01:37:25.412471+0000","last_became_peered":"2023-11-15T01:37:25.412471+0000","last_unstale":"2023-11-15T01:37:25.817460+0000","last_undegraded":"2023-11-15T01:37:25.817460+0000","last_fullsized":"2023-11-15T01:37:25.817460+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.815898+0000","last_change":"2023-11-15T01:37:25.811286+0000","last_active":"2023-11-15T01:37:25.815898+0000","last_peered":"2023-11-15T01:37:25.815898+0000","last_clean":"2023-11-15T01:37:25.815898+0000","last_became_active":"2023-11-15T01:37:25.811059+0000","last_became_peered":"2023-11-15T01:37:25.811059+0000","last_unstale":"2023-11-15T01:37:25.815898+0000","last_undegraded":"2023-11-15T01:37:25.815898+0000","last_fullsized":"2023-11-15T01:37:25.815898+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813341+0000","last_change":"2023-11-15T01:37:25.415016+0000","last_active":"2023-11-15T01:37:25.813341+0000","last_peered":"2023-11-15T01:37:25.813341+0000","last_clean":"2023-11-15T01:37:25.813341+0000","last_became_active":"2023-11-15T01:37:25.414532+0000","last_became_peered":"2023-11-15T01:37:25.414532+0000","last_unstale":"2023-11-15T01:37:25.813341+0000","last_undegraded":"2023-11-15T01:37:25.813341+0000","last_fullsized":"2023-11-15T01:37:25.813341+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.817551+0000","last_change":"2023-11-15T01:37:25.805785+0000","last_active":"2023-11-15T01:37:25.817551+0000","last_peered":"2023-11-15T01:37:25.817551+0000","last_clean":"2023-11-15T01:37:25.817551+0000","last_became_active":"2023-11-15T01:37:25.805510+0000","last_became_peered":"2023-11-15T01:37:25.805510+0000","last_unstale":"2023-11-15T01:37:25.817551+0000","last_undegraded":"2023-11-15T01:37:25.817551+0000","last_fullsized":"2023-11-15T01:37:25.817551+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.788055+0000","last_change":"2023-11-15T01:37:25.417606+0000","last_active":"2023-11-15T01:37:25.788055+0000","last_peered":"2023-11-15T01:37:25.788055+0000","last_clean":"2023-11-15T01:37:25.788055+0000","last_became_active":"2023-11-15T01:37:25.417271+0000","last_became_peered":"2023-11-15T01:37:25.417271+0000","last_unstale":"2023-11-15T01:37:25.788055+0000","last_undegraded":"2023-11-15T01:37:25.788055+0000","last_fullsized":"2023-11-15T01:37:25.788055+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819336+0000","last_change":"2023-11-15T01:37:25.816625+0000","last_active":"2023-11-15T01:37:25.819336+0000","last_peered":"2023-11-15T01:37:25.819336+0000","last_clean":"2023-11-15T01:37:25.819336+0000","last_became_active":"2023-11-15T01:37:25.816296+0000","last_became_peered":"2023-11-15T01:37:25.816296+0000","last_unstale":"2023-11-15T01:37:25.819336+0000","last_undegraded":"2023-11-15T01:37:25.819336+0000","last_fullsized":"2023-11-15T01:37:25.819336+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803923+0000","last_change":"2023-11-15T01:37:25.417379+0000","last_active":"2023-11-15T01:37:25.803923+0000","last_peered":"2023-11-15T01:37:25.803923+0000","last_clean":"2023-11-15T01:37:25.803923+0000","last_became_active":"2023-11-15T01:37:25.417085+0000","last_became_peered":"2023-11-15T01:37:25.417085+0000","last_unstale":"2023-11-15T01:37:25.803923+0000","last_undegraded":"2023-11-15T01:37:25.803923+0000","last_fullsized":"2023-11-15T01:37:25.803923+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.808143+0000","last_change":"2023-11-15T01:37:25.798848+0000","last_active":"2023-11-15T01:37:25.808143+0000","last_peered":"2023-11-15T01:37:25.808143+0000","last_clean":"2023-11-15T01:37:25.808143+0000","last_became_active":"2023-11-15T01:37:25.798566+0000","last_became_peered":"2023-11-15T01:37:25.798566+0000","last_unstale":"2023-11-15T01:37:25.808143+0000","last_undegraded":"2023-11-15T01:37:25.808143+0000","last_fullsized":"2023-11-15T01:37:25.808143+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807542+0000","last_change":"2023-11-15T01:37:25.414011+0000","last_active":"2023-11-15T01:37:25.807542+0000","last_peered":"2023-11-15T01:37:25.807542+0000","last_clean":"2023-11-15T01:37:25.807542+0000","last_became_active":"2023-11-15T01:37:25.413687+0000","last_became_peered":"2023-11-15T01:37:25.413687+0000","last_unstale":"2023-11-15T01:37:25.807542+0000","last_undegraded":"2023-11-15T01:37:25.807542+0000","last_fullsized":"2023-11-15T01:37:25.807542+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812301+0000","last_change":"2023-11-15T01:37:25.805983+0000","last_active":"2023-11-15T01:37:25.812301+0000","last_peered":"2023-11-15T01:37:25.812301+0000","last_clean":"2023-11-15T01:37:25.812301+0000","last_became_active":"2023-11-15T01:37:25.805783+0000","last_became_peered":"2023-11-15T01:37:25.805783+0000","last_unstale":"2023-11-15T01:37:25.812301+0000","last_undegraded":"2023-11-15T01:37:25.812301+0000","last_fullsized":"2023-11-15T01:37:25.812301+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.796597+0000","last_change":"2023-11-15T01:37:25.411780+0000","last_active":"2023-11-15T01:37:25.796597+0000","last_peered":"2023-11-15T01:37:25.796597+0000","last_clean":"2023-11-15T01:37:25.796597+0000","last_became_active":"2023-11-15T01:37:25.411497+0000","last_became_peered":"2023-11-15T01:37:25.411497+0000","last_unstale":"2023-11-15T01:37:25.796597+0000","last_undegraded":"2023-11-15T01:37:25.796597+0000","last_fullsized":"2023-11-15T01:37:25.796597+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807763+0000","last_change":"2023-11-15T01:37:25.796296+0000","last_active":"2023-11-15T01:37:25.807763+0000","last_peered":"2023-11-15T01:37:25.807763+0000","last_clean":"2023-11-15T01:37:25.807763+0000","last_became_active":"2023-11-15T01:37:25.796037+0000","last_became_peered":"2023-11-15T01:37:25.796037+0000","last_unstale":"2023-11-15T01:37:25.807763+0000","last_undegraded":"2023-11-15T01:37:25.807763+0000","last_fullsized":"2023-11-15T01:37:25.807763+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.804237+0000","last_change":"2023-11-15T01:37:25.417734+0000","last_active":"2023-11-15T01:37:25.804237+0000","last_peered":"2023-11-15T01:37:25.804237+0000","last_clean":"2023-11-15T01:37:25.804237+0000","last_became_active":"2023-11-15T01:37:25.417457+0000","last_became_peered":"2023-11-15T01:37:25.417457+0000","last_unstale":"2023-11-15T01:37:25.804237+0000","last_undegraded":"2023-11-15T01:37:25.804237+0000","last_fullsized":"2023-11-15T01:37:25.804237+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813686+0000","last_change":"2023-11-15T01:37:25.809518+0000","last_active":"2023-11-15T01:37:25.813686+0000","last_peered":"2023-11-15T01:37:25.813686+0000","last_clean":"2023-11-15T01:37:25.813686+0000","last_became_active":"2023-11-15T01:37:25.809139+0000","last_became_peered":"2023-11-15T01:37:25.809139+0000","last_unstale":"2023-11-15T01:37:25.813686+0000","last_undegraded":"2023-11-15T01:37:25.813686+0000","last_fullsized":"2023-11-15T01:37:25.813686+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"108'4","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.822226+0000","last_change":"2023-11-15T01:37:25.412130+0000","last_active":"2023-11-15T01:37:25.822226+0000","last_peered":"2023-11-15T01:37:25.822226+0000","last_clean":"2023-11-15T01:37:25.822226+0000","last_became_active":"2023-11-15T01:37:25.411854+0000","last_became_peered":"2023-11-15T01:37:25.411854+0000","last_unstale":"2023-11-15T01:37:25.822226+0000","last_undegraded":"2023-11-15T01:37:25.822226+0000","last_fullsized":"2023-11-15T01:37:25.822226+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.808607+0000","last_change":"2023-11-15T01:37:25.804754+0000","last_active":"2023-11-15T01:37:25.808607+0000","last_peered":"2023-11-15T01:37:25.808607+0000","last_clean":"2023-11-15T01:37:25.808607+0000","last_became_active":"2023-11-15T01:37:25.804091+0000","last_became_peered":"2023-11-15T01:37:25.804091+0000","last_unstale":"2023-11-15T01:37:25.808607+0000","last_undegraded":"2023-11-15T01:37:25.808607+0000","last_fullsized":"2023-11-15T01:37:25.808607+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.816266+0000","last_change":"2023-11-15T01:37:25.421559+0000","last_active":"2023-11-15T01:37:25.816266+0000","last_peered":"2023-11-15T01:37:25.816266+0000","last_clean":"2023-11-15T01:37:25.816266+0000","last_became_active":"2023-11-15T01:37:25.421284+0000","last_became_peered":"2023-11-15T01:37:25.421284+0000","last_unstale":"2023-11-15T01:37:25.816266+0000","last_undegraded":"2023-11-15T01:37:25.816266+0000","last_fullsized":"2023-11-15T01:37:25.816266+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812654+0000","last_change":"2023-11-15T01:37:25.802867+0000","last_active":"2023-11-15T01:37:25.812654+0000","last_peered":"2023-11-15T01:37:25.812654+0000","last_clean":"2023-11-15T01:37:25.812654+0000","last_became_active":"2023-11-15T01:37:25.802608+0000","last_became_peered":"2023-11-15T01:37:25.802608+0000","last_unstale":"2023-11-15T01:37:25.812654+0000","last_undegraded":"2023-11-15T01:37:25.812654+0000","last_fullsized":"2023-11-15T01:37:25.812654+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.787960+0000","last_change":"2023-11-15T01:37:25.414896+0000","last_active":"2023-11-15T01:37:25.787960+0000","last_peered":"2023-11-15T01:37:25.787960+0000","last_clean":"2023-11-15T01:37:25.787960+0000","last_became_active":"2023-11-15T01:37:25.414626+0000","last_became_peered":"2023-11-15T01:37:25.414626+0000","last_unstale":"2023-11-15T01:37:25.787960+0000","last_undegraded":"2023-11-15T01:37:25.787960+0000","last_fullsized":"2023-11-15T01:37:25.787960+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.822179+0000","last_change":"2023-11-15T01:37:25.817409+0000","last_active":"2023-11-15T01:37:25.822179+0000","last_peered":"2023-11-15T01:37:25.822179+0000","last_clean":"2023-11-15T01:37:25.822179+0000","last_became_active":"2023-11-15T01:37:25.817134+0000","last_became_peered":"2023-11-15T01:37:25.817134+0000","last_unstale":"2023-11-15T01:37:25.822179+0000","last_undegraded":"2023-11-15T01:37:25.822179+0000","last_fullsized":"2023-11-15T01:37:25.822179+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.792367+0000","last_change":"2023-11-15T01:37:25.418553+0000","last_active":"2023-11-15T01:37:25.792367+0000","last_peered":"2023-11-15T01:37:25.792367+0000","last_clean":"2023-11-15T01:37:25.792367+0000","last_became_active":"2023-11-15T01:37:25.418043+0000","last_became_peered":"2023-11-15T01:37:25.418043+0000","last_unstale":"2023-11-15T01:37:25.792367+0000","last_undegraded":"2023-11-15T01:37:25.792367+0000","last_fullsized":"2023-11-15T01:37:25.792367+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.818077+0000","last_change":"2023-11-15T01:37:25.816718+0000","last_active":"2023-11-15T01:37:25.818077+0000","last_peered":"2023-11-15T01:37:25.818077+0000","last_clean":"2023-11-15T01:37:25.818077+0000","last_became_active":"2023-11-15T01:37:25.816448+0000","last_became_peered":"2023-11-15T01:37:25.816448+0000","last_unstale":"2023-11-15T01:37:25.818077+0000","last_undegraded":"2023-11-15T01:37:25.818077+0000","last_fullsized":"2023-11-15T01:37:25.818077+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"108'4","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814744+0000","last_change":"2023-11-15T01:37:25.408759+0000","last_active":"2023-11-15T01:37:25.814744+0000","last_peered":"2023-11-15T01:37:25.814744+0000","last_clean":"2023-11-15T01:37:25.814744+0000","last_became_active":"2023-11-15T01:37:25.408461+0000","last_became_peered":"2023-11-15T01:37:25.408461+0000","last_unstale":"2023-11-15T01:37:25.814744+0000","last_undegraded":"2023-11-15T01:37:25.814744+0000","last_fullsized":"2023-11-15T01:37:25.814744+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812814+0000","last_change":"2023-11-15T01:37:25.806103+0000","last_active":"2023-11-15T01:37:25.812814+0000","last_peered":"2023-11-15T01:37:25.812814+0000","last_clean":"2023-11-15T01:37:25.812814+0000","last_became_active":"2023-11-15T01:37:25.805836+0000","last_became_peered":"2023-11-15T01:37:25.805836+0000","last_unstale":"2023-11-15T01:37:25.812814+0000","last_undegraded":"2023-11-15T01:37:25.812814+0000","last_fullsized":"2023-11-15T01:37:25.812814+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.802995+0000","last_change":"2023-11-15T01:37:25.409251+0000","last_active":"2023-11-15T01:37:25.802995+0000","last_peered":"2023-11-15T01:37:25.802995+0000","last_clean":"2023-11-15T01:37:25.802995+0000","last_became_active":"2023-11-15T01:37:25.408943+0000","last_became_peered":"2023-11-15T01:37:25.408943+0000","last_unstale":"2023-11-15T01:37:25.802995+0000","last_undegraded":"2023-11-15T01:37:25.802995+0000","last_fullsized":"2023-11-15T01:37:25.802995+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.822232+0000","last_change":"2023-11-15T01:37:25.818048+0000","last_active":"2023-11-15T01:37:25.822232+0000","last_peered":"2023-11-15T01:37:25.822232+0000","last_clean":"2023-11-15T01:37:25.822232+0000","last_became_active":"2023-11-15T01:37:25.817752+0000","last_became_peered":"2023-11-15T01:37:25.817752+0000","last_unstale":"2023-11-15T01:37:25.822232+0000","last_undegraded":"2023-11-15T01:37:25.822232+0000","last_fullsized":"2023-11-15T01:37:25.822232+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.788055+0000","last_change":"2023-11-15T01:37:25.408296+0000","last_active":"2023-11-15T01:37:25.788055+0000","last_peered":"2023-11-15T01:37:25.788055+0000","last_clean":"2023-11-15T01:37:25.788055+0000","last_became_active":"2023-11-15T01:37:25.408001+0000","last_became_peered":"2023-11-15T01:37:25.408001+0000","last_unstale":"2023-11-15T01:37:25.788055+0000","last_undegraded":"2023-11-15T01:37:25.788055+0000","last_fullsized":"2023-11-15T01:37:25.788055+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811519+0000","last_change":"2023-11-15T01:37:25.807821+0000","last_active":"2023-11-15T01:37:25.811519+0000","last_peered":"2023-11-15T01:37:25.811519+0000","last_clean":"2023-11-15T01:37:25.811519+0000","last_became_active":"2023-11-15T01:37:25.807548+0000","last_became_peered":"2023-11-15T01:37:25.807548+0000","last_unstale":"2023-11-15T01:37:25.811519+0000","last_undegraded":"2023-11-15T01:37:25.811519+0000","last_fullsized":"2023-11-15T01:37:25.811519+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807354+0000","last_change":"2023-11-15T01:37:25.415139+0000","last_active":"2023-11-15T01:37:25.807354+0000","last_peered":"2023-11-15T01:37:25.807354+0000","last_clean":"2023-11-15T01:37:25.807354+0000","last_became_active":"2023-11-15T01:37:25.414854+0000","last_became_peered":"2023-11-15T01:37:25.414854+0000","last_unstale":"2023-11-15T01:37:25.807354+0000","last_undegraded":"2023-11-15T01:37:25.807354+0000","last_fullsized":"2023-11-15T01:37:25.807354+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.809065+0000","last_change":"2023-11-15T01:37:25.803846+0000","last_active":"2023-11-15T01:37:25.809065+0000","last_peered":"2023-11-15T01:37:25.809065+0000","last_clean":"2023-11-15T01:37:25.809065+0000","last_became_active":"2023-11-15T01:37:25.803576+0000","last_became_peered":"2023-11-15T01:37:25.803576+0000","last_unstale":"2023-11-15T01:37:25.809065+0000","last_undegraded":"2023-11-15T01:37:25.809065+0000","last_fullsized":"2023-11-15T01:37:25.809065+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.788680+0000","last_change":"2023-11-15T01:37:25.411892+0000","last_active":"2023-11-15T01:37:25.788680+0000","last_peered":"2023-11-15T01:37:25.788680+0000","last_clean":"2023-11-15T01:37:25.788680+0000","last_became_active":"2023-11-15T01:37:25.411598+0000","last_became_peered":"2023-11-15T01:37:25.411598+0000","last_unstale":"2023-11-15T01:37:25.788680+0000","last_undegraded":"2023-11-15T01:37:25.788680+0000","last_fullsized":"2023-11-15T01:37:25.788680+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801483+0000","last_change":"2023-11-15T01:37:25.798574+0000","last_active":"2023-11-15T01:37:25.801483+0000","last_peered":"2023-11-15T01:37:25.801483+0000","last_clean":"2023-11-15T01:37:25.801483+0000","last_became_active":"2023-11-15T01:37:25.798289+0000","last_became_peered":"2023-11-15T01:37:25.798289+0000","last_unstale":"2023-11-15T01:37:25.801483+0000","last_undegraded":"2023-11-15T01:37:25.801483+0000","last_fullsized":"2023-11-15T01:37:25.801483+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798969+0000","last_change":"2023-11-15T01:37:25.411973+0000","last_active":"2023-11-15T01:37:25.798969+0000","last_peered":"2023-11-15T01:37:25.798969+0000","last_clean":"2023-11-15T01:37:25.798969+0000","last_became_active":"2023-11-15T01:37:25.411664+0000","last_became_peered":"2023-11-15T01:37:25.411664+0000","last_unstale":"2023-11-15T01:37:25.798969+0000","last_undegraded":"2023-11-15T01:37:25.798969+0000","last_fullsized":"2023-11-15T01:37:25.798969+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819072+0000","last_change":"2023-11-15T01:37:25.813328+0000","last_active":"2023-11-15T01:37:25.819072+0000","last_peered":"2023-11-15T01:37:25.819072+0000","last_clean":"2023-11-15T01:37:25.819072+0000","last_became_active":"2023-11-15T01:37:25.813035+0000","last_became_peered":"2023-11-15T01:37:25.813035+0000","last_unstale":"2023-11-15T01:37:25.819072+0000","last_undegraded":"2023-11-15T01:37:25.819072+0000","last_fullsized":"2023-11-15T01:37:25.819072+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801598+0000","last_change":"2023-11-15T01:37:25.422486+0000","last_active":"2023-11-15T01:37:25.801598+0000","last_peered":"2023-11-15T01:37:25.801598+0000","last_clean":"2023-11-15T01:37:25.801598+0000","last_became_active":"2023-11-15T01:37:25.421987+0000","last_became_peered":"2023-11-15T01:37:25.421987+0000","last_unstale":"2023-11-15T01:37:25.801598+0000","last_undegraded":"2023-11-15T01:37:25.801598+0000","last_fullsized":"2023-11-15T01:37:25.801598+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812169+0000","last_change":"2023-11-15T01:37:25.803837+0000","last_active":"2023-11-15T01:37:25.812169+0000","last_peered":"2023-11-15T01:37:25.812169+0000","last_clean":"2023-11-15T01:37:25.812169+0000","last_became_active":"2023-11-15T01:37:25.803555+0000","last_became_peered":"2023-11-15T01:37:25.803555+0000","last_unstale":"2023-11-15T01:37:25.812169+0000","last_undegraded":"2023-11-15T01:37:25.812169+0000","last_fullsized":"2023-11-15T01:37:25.812169+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.797162+0000","last_change":"2023-11-15T01:37:25.415462+0000","last_active":"2023-11-15T01:37:25.797162+0000","last_peered":"2023-11-15T01:37:25.797162+0000","last_clean":"2023-11-15T01:37:25.797162+0000","last_became_active":"2023-11-15T01:37:25.415190+0000","last_became_peered":"2023-11-15T01:37:25.415190+0000","last_unstale":"2023-11-15T01:37:25.797162+0000","last_undegraded":"2023-11-15T01:37:25.797162+0000","last_fullsized":"2023-11-15T01:37:25.797162+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813281+0000","last_change":"2023-11-15T01:37:25.806746+0000","last_active":"2023-11-15T01:37:25.813281+0000","last_peered":"2023-11-15T01:37:25.813281+0000","last_clean":"2023-11-15T01:37:25.813281+0000","last_became_active":"2023-11-15T01:37:25.806466+0000","last_became_peered":"2023-11-15T01:37:25.806466+0000","last_unstale":"2023-11-15T01:37:25.813281+0000","last_undegraded":"2023-11-15T01:37:25.813281+0000","last_fullsized":"2023-11-15T01:37:25.813281+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.787515+0000","last_change":"2023-11-15T01:37:25.412836+0000","last_active":"2023-11-15T01:37:25.787515+0000","last_peered":"2023-11-15T01:37:25.787515+0000","last_clean":"2023-11-15T01:37:25.787515+0000","last_became_active":"2023-11-15T01:37:25.412175+0000","last_became_peered":"2023-11-15T01:37:25.412175+0000","last_unstale":"2023-11-15T01:37:25.787515+0000","last_undegraded":"2023-11-15T01:37:25.787515+0000","last_fullsized":"2023-11-15T01:37:25.787515+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813143+0000","last_change":"2023-11-15T01:37:25.809933+0000","last_active":"2023-11-15T01:37:25.813143+0000","last_peered":"2023-11-15T01:37:25.813143+0000","last_clean":"2023-11-15T01:37:25.813143+0000","last_became_active":"2023-11-15T01:37:25.809264+0000","last_became_peered":"2023-11-15T01:37:25.809264+0000","last_unstale":"2023-11-15T01:37:25.813143+0000","last_undegraded":"2023-11-15T01:37:25.813143+0000","last_fullsized":"2023-11-15T01:37:25.813143+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.804839+0000","last_change":"2023-11-15T01:37:25.419579+0000","last_active":"2023-11-15T01:37:25.804839+0000","last_peered":"2023-11-15T01:37:25.804839+0000","last_clean":"2023-11-15T01:37:25.804839+0000","last_became_active":"2023-11-15T01:37:25.419265+0000","last_became_peered":"2023-11-15T01:37:25.419265+0000","last_unstale":"2023-11-15T01:37:25.804839+0000","last_undegraded":"2023-11-15T01:37:25.804839+0000","last_fullsized":"2023-11-15T01:37:25.804839+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811811+0000","last_change":"2023-11-15T01:37:25.807257+0000","last_active":"2023-11-15T01:37:25.811811+0000","last_peered":"2023-11-15T01:37:25.811811+0000","last_clean":"2023-11-15T01:37:25.811811+0000","last_became_active":"2023-11-15T01:37:25.806982+0000","last_became_peered":"2023-11-15T01:37:25.806982+0000","last_unstale":"2023-11-15T01:37:25.811811+0000","last_undegraded":"2023-11-15T01:37:25.811811+0000","last_fullsized":"2023-11-15T01:37:25.811811+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.800848+0000","last_change":"2023-11-15T01:37:25.422421+0000","last_active":"2023-11-15T01:37:25.800848+0000","last_peered":"2023-11-15T01:37:25.800848+0000","last_clean":"2023-11-15T01:37:25.800848+0000","last_became_active":"2023-11-15T01:37:25.422115+0000","last_became_peered":"2023-11-15T01:37:25.422115+0000","last_unstale":"2023-11-15T01:37:25.800848+0000","last_undegraded":"2023-11-15T01:37:25.800848+0000","last_fullsized":"2023-11-15T01:37:25.800848+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.822215+0000","last_change":"2023-11-15T01:37:25.818001+0000","last_active":"2023-11-15T01:37:25.822215+0000","last_peered":"2023-11-15T01:37:25.822215+0000","last_clean":"2023-11-15T01:37:25.822215+0000","last_became_active":"2023-11-15T01:37:25.817735+0000","last_became_peered":"2023-11-15T01:37:25.817735+0000","last_unstale":"2023-11-15T01:37:25.822215+0000","last_undegraded":"2023-11-15T01:37:25.822215+0000","last_fullsized":"2023-11-15T01:37:25.822215+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801808+0000","last_change":"2023-11-15T01:37:25.412803+0000","last_active":"2023-11-15T01:37:25.801808+0000","last_peered":"2023-11-15T01:37:25.801808+0000","last_clean":"2023-11-15T01:37:25.801808+0000","last_became_active":"2023-11-15T01:37:25.412197+0000","last_became_peered":"2023-11-15T01:37:25.412197+0000","last_unstale":"2023-11-15T01:37:25.801808+0000","last_undegraded":"2023-11-15T01:37:25.801808+0000","last_fullsized":"2023-11-15T01:37:25.801808+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819287+0000","last_change":"2023-11-15T01:37:25.815673+0000","last_active":"2023-11-15T01:37:25.819287+0000","last_peered":"2023-11-15T01:37:25.819287+0000","last_clean":"2023-11-15T01:37:25.819287+0000","last_became_active":"2023-11-15T01:37:25.815450+0000","last_became_peered":"2023-11-15T01:37:25.815450+0000","last_unstale":"2023-11-15T01:37:25.819287+0000","last_undegraded":"2023-11-15T01:37:25.819287+0000","last_fullsized":"2023-11-15T01:37:25.819287+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798506+0000","last_change":"2023-11-15T01:37:25.407768+0000","last_active":"2023-11-15T01:37:25.798506+0000","last_peered":"2023-11-15T01:37:25.798506+0000","last_clean":"2023-11-15T01:37:25.798506+0000","last_became_active":"2023-11-15T01:37:25.407475+0000","last_became_peered":"2023-11-15T01:37:25.407475+0000","last_unstale":"2023-11-15T01:37:25.798506+0000","last_undegraded":"2023-11-15T01:37:25.798506+0000","last_fullsized":"2023-11-15T01:37:25.798506+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803880+0000","last_change":"2023-11-15T01:37:25.799740+0000","last_active":"2023-11-15T01:37:25.803880+0000","last_peered":"2023-11-15T01:37:25.803880+0000","last_clean":"2023-11-15T01:37:25.803880+0000","last_became_active":"2023-11-15T01:37:25.799413+0000","last_became_peered":"2023-11-15T01:37:25.799413+0000","last_unstale":"2023-11-15T01:37:25.803880+0000","last_undegraded":"2023-11-15T01:37:25.803880+0000","last_fullsized":"2023-11-15T01:37:25.803880+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803199+0000","last_change":"2023-11-15T01:37:25.419492+0000","last_active":"2023-11-15T01:37:25.803199+0000","last_peered":"2023-11-15T01:37:25.803199+0000","last_clean":"2023-11-15T01:37:25.803199+0000","last_became_active":"2023-11-15T01:37:25.419164+0000","last_became_peered":"2023-11-15T01:37:25.419164+0000","last_unstale":"2023-11-15T01:37:25.803199+0000","last_undegraded":"2023-11-15T01:37:25.803199+0000","last_fullsized":"2023-11-15T01:37:25.803199+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.816913+0000","last_change":"2023-11-15T01:37:25.807456+0000","last_active":"2023-11-15T01:37:25.816913+0000","last_peered":"2023-11-15T01:37:25.816913+0000","last_clean":"2023-11-15T01:37:25.816913+0000","last_became_active":"2023-11-15T01:37:25.807080+0000","last_became_peered":"2023-11-15T01:37:25.807080+0000","last_unstale":"2023-11-15T01:37:25.816913+0000","last_undegraded":"2023-11-15T01:37:25.816913+0000","last_fullsized":"2023-11-15T01:37:25.816913+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801698+0000","last_change":"2023-11-15T01:37:25.422722+0000","last_active":"2023-11-15T01:37:25.801698+0000","last_peered":"2023-11-15T01:37:25.801698+0000","last_clean":"2023-11-15T01:37:25.801698+0000","last_became_active":"2023-11-15T01:37:25.422418+0000","last_became_peered":"2023-11-15T01:37:25.422418+0000","last_unstale":"2023-11-15T01:37:25.801698+0000","last_undegraded":"2023-11-15T01:37:25.801698+0000","last_fullsized":"2023-11-15T01:37:25.801698+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813458+0000","last_change":"2023-11-15T01:37:25.809142+0000","last_active":"2023-11-15T01:37:25.813458+0000","last_peered":"2023-11-15T01:37:25.813458+0000","last_clean":"2023-11-15T01:37:25.813458+0000","last_became_active":"2023-11-15T01:37:25.808816+0000","last_became_peered":"2023-11-15T01:37:25.808816+0000","last_unstale":"2023-11-15T01:37:25.813458+0000","last_undegraded":"2023-11-15T01:37:25.813458+0000","last_fullsized":"2023-11-15T01:37:25.813458+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.799876+0000","last_change":"2023-11-15T01:37:25.411372+0000","last_active":"2023-11-15T01:37:25.799876+0000","last_peered":"2023-11-15T01:37:25.799876+0000","last_clean":"2023-11-15T01:37:25.799876+0000","last_became_active":"2023-11-15T01:37:25.411048+0000","last_became_peered":"2023-11-15T01:37:25.411048+0000","last_unstale":"2023-11-15T01:37:25.799876+0000","last_undegraded":"2023-11-15T01:37:25.799876+0000","last_fullsized":"2023-11-15T01:37:25.799876+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.817368+0000","last_change":"2023-11-15T01:37:25.815100+0000","last_active":"2023-11-15T01:37:25.817368+0000","last_peered":"2023-11-15T01:37:25.817368+0000","last_clean":"2023-11-15T01:37:25.817368+0000","last_became_active":"2023-11-15T01:37:25.812371+0000","last_became_peered":"2023-11-15T01:37:25.812371+0000","last_unstale":"2023-11-15T01:37:25.817368+0000","last_undegraded":"2023-11-15T01:37:25.817368+0000","last_fullsized":"2023-11-15T01:37:25.817368+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.795484+0000","last_change":"2023-11-15T01:37:25.413924+0000","last_active":"2023-11-15T01:37:25.795484+0000","last_peered":"2023-11-15T01:37:25.795484+0000","last_clean":"2023-11-15T01:37:25.795484+0000","last_became_active":"2023-11-15T01:37:25.413648+0000","last_became_peered":"2023-11-15T01:37:25.413648+0000","last_unstale":"2023-11-15T01:37:25.795484+0000","last_undegraded":"2023-11-15T01:37:25.795484+0000","last_fullsized":"2023-11-15T01:37:25.795484+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819673+0000","last_change":"2023-11-15T01:37:25.808310+0000","last_active":"2023-11-15T01:37:25.819673+0000","last_peered":"2023-11-15T01:37:25.819673+0000","last_clean":"2023-11-15T01:37:25.819673+0000","last_became_active":"2023-11-15T01:37:25.808023+0000","last_became_peered":"2023-11-15T01:37:25.808023+0000","last_unstale":"2023-11-15T01:37:25.819673+0000","last_undegraded":"2023-11-15T01:37:25.819673+0000","last_fullsized":"2023-11-15T01:37:25.819673+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814509+0000","last_change":"2023-11-15T01:37:25.414235+0000","last_active":"2023-11-15T01:37:25.814509+0000","last_peered":"2023-11-15T01:37:25.814509+0000","last_clean":"2023-11-15T01:37:25.814509+0000","last_became_active":"2023-11-15T01:37:25.413369+0000","last_became_peered":"2023-11-15T01:37:25.413369+0000","last_unstale":"2023-11-15T01:37:25.814509+0000","last_undegraded":"2023-11-15T01:37:25.814509+0000","last_fullsized":"2023-11-15T01:37:25.814509+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.804906+0000","last_change":"2023-11-15T01:37:25.800425+0000","last_active":"2023-11-15T01:37:25.804906+0000","last_peered":"2023-11-15T01:37:25.804906+0000","last_clean":"2023-11-15T01:37:25.804906+0000","last_became_active":"2023-11-15T01:37:25.800126+0000","last_became_peered":"2023-11-15T01:37:25.800126+0000","last_unstale":"2023-11-15T01:37:25.804906+0000","last_undegraded":"2023-11-15T01:37:25.804906+0000","last_fullsized":"2023-11-15T01:37:25.804906+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814639+0000","last_change":"2023-11-15T01:37:25.409824+0000","last_active":"2023-11-15T01:37:25.814639+0000","last_peered":"2023-11-15T01:37:25.814639+0000","last_clean":"2023-11-15T01:37:25.814639+0000","last_became_active":"2023-11-15T01:37:25.408888+0000","last_became_peered":"2023-11-15T01:37:25.408888+0000","last_unstale":"2023-11-15T01:37:25.814639+0000","last_undegraded":"2023-11-15T01:37:25.814639+0000","last_fullsized":"2023-11-15T01:37:25.814639+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819124+0000","last_change":"2023-11-15T01:37:25.815870+0000","last_active":"2023-11-15T01:37:25.819124+0000","last_peered":"2023-11-15T01:37:25.819124+0000","last_clean":"2023-11-15T01:37:25.819124+0000","last_became_active":"2023-11-15T01:37:25.815610+0000","last_became_peered":"2023-11-15T01:37:25.815610+0000","last_unstale":"2023-11-15T01:37:25.819124+0000","last_undegraded":"2023-11-15T01:37:25.819124+0000","last_fullsized":"2023-11-15T01:37:25.819124+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.815892+0000","last_change":"2023-11-15T01:37:25.419445+0000","last_active":"2023-11-15T01:37:25.815892+0000","last_peered":"2023-11-15T01:37:25.815892+0000","last_clean":"2023-11-15T01:37:25.815892+0000","last_became_active":"2023-11-15T01:37:25.419103+0000","last_became_peered":"2023-11-15T01:37:25.419103+0000","last_unstale":"2023-11-15T01:37:25.815892+0000","last_undegraded":"2023-11-15T01:37:25.815892+0000","last_fullsized":"2023-11-15T01:37:25.815892+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819805+0000","last_change":"2023-11-15T01:37:25.815047+0000","last_active":"2023-11-15T01:37:25.819805+0000","last_peered":"2023-11-15T01:37:25.819805+0000","last_clean":"2023-11-15T01:37:25.819805+0000","last_became_active":"2023-11-15T01:37:25.814763+0000","last_became_peered":"2023-11-15T01:37:25.814763+0000","last_unstale":"2023-11-15T01:37:25.819805+0000","last_undegraded":"2023-11-15T01:37:25.819805+0000","last_fullsized":"2023-11-15T01:37:25.819805+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798392+0000","last_change":"2023-11-15T01:37:25.416138+0000","last_active":"2023-11-15T01:37:25.798392+0000","last_peered":"2023-11-15T01:37:25.798392+0000","last_clean":"2023-11-15T01:37:25.798392+0000","last_became_active":"2023-11-15T01:37:25.415835+0000","last_became_peered":"2023-11-15T01:37:25.415835+0000","last_unstale":"2023-11-15T01:37:25.798392+0000","last_undegraded":"2023-11-15T01:37:25.798392+0000","last_fullsized":"2023-11-15T01:37:25.798392+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812456+0000","last_change":"2023-11-15T01:37:25.801486+0000","last_active":"2023-11-15T01:37:25.812456+0000","last_peered":"2023-11-15T01:37:25.812456+0000","last_clean":"2023-11-15T01:37:25.812456+0000","last_became_active":"2023-11-15T01:37:25.801217+0000","last_became_peered":"2023-11-15T01:37:25.801217+0000","last_unstale":"2023-11-15T01:37:25.812456+0000","last_undegraded":"2023-11-15T01:37:25.812456+0000","last_fullsized":"2023-11-15T01:37:25.812456+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803447+0000","last_change":"2023-11-15T01:37:25.413617+0000","last_active":"2023-11-15T01:37:25.803447+0000","last_peered":"2023-11-15T01:37:25.803447+0000","last_clean":"2023-11-15T01:37:25.803447+0000","last_became_active":"2023-11-15T01:37:25.413326+0000","last_became_peered":"2023-11-15T01:37:25.413326+0000","last_unstale":"2023-11-15T01:37:25.803447+0000","last_undegraded":"2023-11-15T01:37:25.803447+0000","last_fullsized":"2023-11-15T01:37:25.803447+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814422+0000","last_change":"2023-11-15T01:37:25.806496+0000","last_active":"2023-11-15T01:37:25.814422+0000","last_peered":"2023-11-15T01:37:25.814422+0000","last_clean":"2023-11-15T01:37:25.814422+0000","last_became_active":"2023-11-15T01:37:25.806193+0000","last_became_peered":"2023-11-15T01:37:25.806193+0000","last_unstale":"2023-11-15T01:37:25.814422+0000","last_undegraded":"2023-11-15T01:37:25.814422+0000","last_fullsized":"2023-11-15T01:37:25.814422+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801797+0000","last_change":"2023-11-15T01:37:25.422680+0000","last_active":"2023-11-15T01:37:25.801797+0000","last_peered":"2023-11-15T01:37:25.801797+0000","last_clean":"2023-11-15T01:37:25.801797+0000","last_became_active":"2023-11-15T01:37:25.422182+0000","last_became_peered":"2023-11-15T01:37:25.422182+0000","last_unstale":"2023-11-15T01:37:25.801797+0000","last_undegraded":"2023-11-15T01:37:25.801797+0000","last_fullsized":"2023-11-15T01:37:25.801797+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.817528+0000","last_change":"2023-11-15T01:37:25.805736+0000","last_active":"2023-11-15T01:37:25.817528+0000","last_peered":"2023-11-15T01:37:25.817528+0000","last_clean":"2023-11-15T01:37:25.817528+0000","last_became_active":"2023-11-15T01:37:25.805466+0000","last_became_peered":"2023-11-15T01:37:25.805466+0000","last_unstale":"2023-11-15T01:37:25.817528+0000","last_undegraded":"2023-11-15T01:37:25.817528+0000","last_fullsized":"2023-11-15T01:37:25.817528+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.792467+0000","last_change":"2023-11-15T01:37:25.418329+0000","last_active":"2023-11-15T01:37:25.792467+0000","last_peered":"2023-11-15T01:37:25.792467+0000","last_clean":"2023-11-15T01:37:25.792467+0000","last_became_active":"2023-11-15T01:37:25.417999+0000","last_became_peered":"2023-11-15T01:37:25.417999+0000","last_unstale":"2023-11-15T01:37:25.792467+0000","last_undegraded":"2023-11-15T01:37:25.792467+0000","last_fullsized":"2023-11-15T01:37:25.792467+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813033+0000","last_change":"2023-11-15T01:37:25.807469+0000","last_active":"2023-11-15T01:37:25.813033+0000","last_peered":"2023-11-15T01:37:25.813033+0000","last_clean":"2023-11-15T01:37:25.813033+0000","last_became_active":"2023-11-15T01:37:25.807202+0000","last_became_peered":"2023-11-15T01:37:25.807202+0000","last_unstale":"2023-11-15T01:37:25.813033+0000","last_undegraded":"2023-11-15T01:37:25.813033+0000","last_fullsized":"2023-11-15T01:37:25.813033+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801552+0000","last_change":"2023-11-15T01:37:25.416493+0000","last_active":"2023-11-15T01:37:25.801552+0000","last_peered":"2023-11-15T01:37:25.801552+0000","last_clean":"2023-11-15T01:37:25.801552+0000","last_became_active":"2023-11-15T01:37:25.416156+0000","last_became_peered":"2023-11-15T01:37:25.416156+0000","last_unstale":"2023-11-15T01:37:25.801552+0000","last_undegraded":"2023-11-15T01:37:25.801552+0000","last_fullsized":"2023-11-15T01:37:25.801552+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813363+0000","last_change":"2023-11-15T01:37:25.807158+0000","last_active":"2023-11-15T01:37:25.813363+0000","last_peered":"2023-11-15T01:37:25.813363+0000","last_clean":"2023-11-15T01:37:25.813363+0000","last_became_active":"2023-11-15T01:37:25.804197+0000","last_became_peered":"2023-11-15T01:37:25.804197+0000","last_unstale":"2023-11-15T01:37:25.813363+0000","last_undegraded":"2023-11-15T01:37:25.813363+0000","last_fullsized":"2023-11-15T01:37:25.813363+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807648+0000","last_change":"2023-11-15T01:37:25.415719+0000","last_active":"2023-11-15T01:37:25.807648+0000","last_peered":"2023-11-15T01:37:25.807648+0000","last_clean":"2023-11-15T01:37:25.807648+0000","last_became_active":"2023-11-15T01:37:25.414403+0000","last_became_peered":"2023-11-15T01:37:25.414403+0000","last_unstale":"2023-11-15T01:37:25.807648+0000","last_undegraded":"2023-11-15T01:37:25.807648+0000","last_fullsized":"2023-11-15T01:37:25.807648+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.815961+0000","last_change":"2023-11-15T01:37:25.810768+0000","last_active":"2023-11-15T01:37:25.815961+0000","last_peered":"2023-11-15T01:37:25.815961+0000","last_clean":"2023-11-15T01:37:25.815961+0000","last_became_active":"2023-11-15T01:37:25.810322+0000","last_became_peered":"2023-11-15T01:37:25.810322+0000","last_unstale":"2023-11-15T01:37:25.815961+0000","last_undegraded":"2023-11-15T01:37:25.815961+0000","last_fullsized":"2023-11-15T01:37:25.815961+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.791388+0000","last_change":"2023-11-15T01:37:25.414123+0000","last_active":"2023-11-15T01:37:25.791388+0000","last_peered":"2023-11-15T01:37:25.791388+0000","last_clean":"2023-11-15T01:37:25.791388+0000","last_became_active":"2023-11-15T01:37:25.413793+0000","last_became_peered":"2023-11-15T01:37:25.413793+0000","last_unstale":"2023-11-15T01:37:25.791388+0000","last_undegraded":"2023-11-15T01:37:25.791388+0000","last_fullsized":"2023-11-15T01:37:25.791388+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813077+0000","last_change":"2023-11-15T01:37:25.810101+0000","last_active":"2023-11-15T01:37:25.813077+0000","last_peered":"2023-11-15T01:37:25.813077+0000","last_clean":"2023-11-15T01:37:25.813077+0000","last_became_active":"2023-11-15T01:37:25.809845+0000","last_became_peered":"2023-11-15T01:37:25.809845+0000","last_unstale":"2023-11-15T01:37:25.813077+0000","last_undegraded":"2023-11-15T01:37:25.813077+0000","last_fullsized":"2023-11-15T01:37:25.813077+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"108'3","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819993+0000","last_change":"2023-11-15T01:37:25.412490+0000","last_active":"2023-11-15T01:37:25.819993+0000","last_peered":"2023-11-15T01:37:25.819993+0000","last_clean":"2023-11-15T01:37:25.819993+0000","last_became_active":"2023-11-15T01:37:25.411493+0000","last_became_peered":"2023-11-15T01:37:25.411493+0000","last_unstale":"2023-11-15T01:37:25.819993+0000","last_undegraded":"2023-11-15T01:37:25.819993+0000","last_fullsized":"2023-11-15T01:37:25.819993+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813120+0000","last_change":"2023-11-15T01:37:25.809185+0000","last_active":"2023-11-15T01:37:25.813120+0000","last_peered":"2023-11-15T01:37:25.813120+0000","last_clean":"2023-11-15T01:37:25.813120+0000","last_became_active":"2023-11-15T01:37:25.808906+0000","last_became_peered":"2023-11-15T01:37:25.808906+0000","last_unstale":"2023-11-15T01:37:25.813120+0000","last_undegraded":"2023-11-15T01:37:25.813120+0000","last_fullsized":"2023-11-15T01:37:25.813120+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814808+0000","last_change":"2023-11-15T01:37:25.404139+0000","last_active":"2023-11-15T01:37:25.814808+0000","last_peered":"2023-11-15T01:37:25.814808+0000","last_clean":"2023-11-15T01:37:25.814808+0000","last_became_active":"2023-11-15T01:37:25.403845+0000","last_became_peered":"2023-11-15T01:37:25.403845+0000","last_unstale":"2023-11-15T01:37:25.814808+0000","last_undegraded":"2023-11-15T01:37:25.814808+0000","last_fullsized":"2023-11-15T01:37:25.814808+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.818199+0000","last_change":"2023-11-15T01:37:25.816681+0000","last_active":"2023-11-15T01:37:25.818199+0000","last_peered":"2023-11-15T01:37:25.818199+0000","last_clean":"2023-11-15T01:37:25.818199+0000","last_became_active":"2023-11-15T01:37:25.816348+0000","last_became_peered":"2023-11-15T01:37:25.816348+0000","last_unstale":"2023-11-15T01:37:25.818199+0000","last_undegraded":"2023-11-15T01:37:25.818199+0000","last_fullsized":"2023-11-15T01:37:25.818199+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819997+0000","last_change":"2023-11-15T01:37:25.416428+0000","last_active":"2023-11-15T01:37:25.819997+0000","last_peered":"2023-11-15T01:37:25.819997+0000","last_clean":"2023-11-15T01:37:25.819997+0000","last_became_active":"2023-11-15T01:37:25.416125+0000","last_became_peered":"2023-11-15T01:37:25.416125+0000","last_unstale":"2023-11-15T01:37:25.819997+0000","last_undegraded":"2023-11-15T01:37:25.819997+0000","last_fullsized":"2023-11-15T01:37:25.819997+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813355+0000","last_change":"2023-11-15T01:37:25.807841+0000","last_active":"2023-11-15T01:37:25.813355+0000","last_peered":"2023-11-15T01:37:25.813355+0000","last_clean":"2023-11-15T01:37:25.813355+0000","last_became_active":"2023-11-15T01:37:25.807533+0000","last_became_peered":"2023-11-15T01:37:25.807533+0000","last_unstale":"2023-11-15T01:37:25.813355+0000","last_undegraded":"2023-11-15T01:37:25.813355+0000","last_fullsized":"2023-11-15T01:37:25.813355+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798340+0000","last_change":"2023-11-15T01:37:25.405232+0000","last_active":"2023-11-15T01:37:25.798340+0000","last_peered":"2023-11-15T01:37:25.798340+0000","last_clean":"2023-11-15T01:37:25.798340+0000","last_became_active":"2023-11-15T01:37:25.404955+0000","last_became_peered":"2023-11-15T01:37:25.404955+0000","last_unstale":"2023-11-15T01:37:25.798340+0000","last_undegraded":"2023-11-15T01:37:25.798340+0000","last_fullsized":"2023-11-15T01:37:25.798340+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807683+0000","last_change":"2023-11-15T01:37:25.796369+0000","last_active":"2023-11-15T01:37:25.807683+0000","last_peered":"2023-11-15T01:37:25.807683+0000","last_clean":"2023-11-15T01:37:25.807683+0000","last_became_active":"2023-11-15T01:37:25.796095+0000","last_became_peered":"2023-11-15T01:37:25.796095+0000","last_unstale":"2023-11-15T01:37:25.807683+0000","last_undegraded":"2023-11-15T01:37:25.807683+0000","last_fullsized":"2023-11-15T01:37:25.807683+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.796007+0000","last_change":"2023-11-15T01:37:25.419012+0000","last_active":"2023-11-15T01:37:25.796007+0000","last_peered":"2023-11-15T01:37:25.796007+0000","last_clean":"2023-11-15T01:37:25.796007+0000","last_became_active":"2023-11-15T01:37:25.418723+0000","last_became_peered":"2023-11-15T01:37:25.418723+0000","last_unstale":"2023-11-15T01:37:25.796007+0000","last_undegraded":"2023-11-15T01:37:25.796007+0000","last_fullsized":"2023-11-15T01:37:25.796007+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811901+0000","last_change":"2023-11-15T01:37:25.807654+0000","last_active":"2023-11-15T01:37:25.811901+0000","last_peered":"2023-11-15T01:37:25.811901+0000","last_clean":"2023-11-15T01:37:25.811901+0000","last_became_active":"2023-11-15T01:37:25.807383+0000","last_became_peered":"2023-11-15T01:37:25.807383+0000","last_unstale":"2023-11-15T01:37:25.811901+0000","last_undegraded":"2023-11-15T01:37:25.811901+0000","last_fullsized":"2023-11-15T01:37:25.811901+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"108'4","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812373+0000","last_change":"2023-11-15T01:37:25.422349+0000","last_active":"2023-11-15T01:37:25.812373+0000","last_peered":"2023-11-15T01:37:25.812373+0000","last_clean":"2023-11-15T01:37:25.812373+0000","last_became_active":"2023-11-15T01:37:25.422074+0000","last_became_peered":"2023-11-15T01:37:25.422074+0000","last_unstale":"2023-11-15T01:37:25.812373+0000","last_undegraded":"2023-11-15T01:37:25.812373+0000","last_fullsized":"2023-11-15T01:37:25.812373+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814405+0000","last_change":"2023-11-15T01:37:25.810986+0000","last_active":"2023-11-15T01:37:25.814405+0000","last_peered":"2023-11-15T01:37:25.814405+0000","last_clean":"2023-11-15T01:37:25.814405+0000","last_became_active":"2023-11-15T01:37:25.810693+0000","last_became_peered":"2023-11-15T01:37:25.810693+0000","last_unstale":"2023-11-15T01:37:25.814405+0000","last_undegraded":"2023-11-15T01:37:25.814405+0000","last_fullsized":"2023-11-15T01:37:25.814405+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.815114+0000","last_change":"2023-11-15T01:37:25.419780+0000","last_active":"2023-11-15T01:37:25.815114+0000","last_peered":"2023-11-15T01:37:25.815114+0000","last_clean":"2023-11-15T01:37:25.815114+0000","last_became_active":"2023-11-15T01:37:25.419483+0000","last_became_peered":"2023-11-15T01:37:25.419483+0000","last_unstale":"2023-11-15T01:37:25.815114+0000","last_undegraded":"2023-11-15T01:37:25.815114+0000","last_fullsized":"2023-11-15T01:37:25.815114+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819603+0000","last_change":"2023-11-15T01:37:25.807318+0000","last_active":"2023-11-15T01:37:25.819603+0000","last_peered":"2023-11-15T01:37:25.819603+0000","last_clean":"2023-11-15T01:37:25.819603+0000","last_became_active":"2023-11-15T01:37:25.807040+0000","last_became_peered":"2023-11-15T01:37:25.807040+0000","last_unstale":"2023-11-15T01:37:25.819603+0000","last_undegraded":"2023-11-15T01:37:25.819603+0000","last_fullsized":"2023-11-15T01:37:25.819603+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803767+0000","last_change":"2023-11-15T01:37:25.415380+0000","last_active":"2023-11-15T01:37:25.803767+0000","last_peered":"2023-11-15T01:37:25.803767+0000","last_clean":"2023-11-15T01:37:25.803767+0000","last_became_active":"2023-11-15T01:37:25.415095+0000","last_became_peered":"2023-11-15T01:37:25.415095+0000","last_unstale":"2023-11-15T01:37:25.803767+0000","last_undegraded":"2023-11-15T01:37:25.803767+0000","last_fullsized":"2023-11-15T01:37:25.803767+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807536+0000","last_change":"2023-11-15T01:37:25.803469+0000","last_active":"2023-11-15T01:37:25.807536+0000","last_peered":"2023-11-15T01:37:25.807536+0000","last_clean":"2023-11-15T01:37:25.807536+0000","last_became_active":"2023-11-15T01:37:25.803181+0000","last_became_peered":"2023-11-15T01:37:25.803181+0000","last_unstale":"2023-11-15T01:37:25.807536+0000","last_undegraded":"2023-11-15T01:37:25.807536+0000","last_fullsized":"2023-11-15T01:37:25.807536+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801457+0000","last_change":"2023-11-15T01:37:25.412639+0000","last_active":"2023-11-15T01:37:25.801457+0000","last_peered":"2023-11-15T01:37:25.801457+0000","last_clean":"2023-11-15T01:37:25.801457+0000","last_became_active":"2023-11-15T01:37:25.411867+0000","last_became_peered":"2023-11-15T01:37:25.411867+0000","last_unstale":"2023-11-15T01:37:25.801457+0000","last_undegraded":"2023-11-15T01:37:25.801457+0000","last_fullsized":"2023-11-15T01:37:25.801457+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.816802+0000","last_change":"2023-11-15T01:37:25.808140+0000","last_active":"2023-11-15T01:37:25.816802+0000","last_peered":"2023-11-15T01:37:25.816802+0000","last_clean":"2023-11-15T01:37:25.816802+0000","last_became_active":"2023-11-15T01:37:25.807819+0000","last_became_peered":"2023-11-15T01:37:25.807819+0000","last_unstale":"2023-11-15T01:37:25.816802+0000","last_undegraded":"2023-11-15T01:37:25.816802+0000","last_fullsized":"2023-11-15T01:37:25.816802+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798292+0000","last_change":"2023-11-15T01:37:25.409692+0000","last_active":"2023-11-15T01:37:25.798292+0000","last_peered":"2023-11-15T01:37:25.798292+0000","last_clean":"2023-11-15T01:37:25.798292+0000","last_became_active":"2023-11-15T01:37:25.409430+0000","last_became_peered":"2023-11-15T01:37:25.409430+0000","last_unstale":"2023-11-15T01:37:25.798292+0000","last_undegraded":"2023-11-15T01:37:25.798292+0000","last_fullsized":"2023-11-15T01:37:25.798292+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811684+0000","last_change":"2023-11-15T01:37:25.805180+0000","last_active":"2023-11-15T01:37:25.811684+0000","last_peered":"2023-11-15T01:37:25.811684+0000","last_clean":"2023-11-15T01:37:25.811684+0000","last_became_active":"2023-11-15T01:37:25.804916+0000","last_became_peered":"2023-11-15T01:37:25.804916+0000","last_unstale":"2023-11-15T01:37:25.811684+0000","last_undegraded":"2023-11-15T01:37:25.811684+0000","last_fullsized":"2023-11-15T01:37:25.811684+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798571+0000","last_change":"2023-11-15T01:37:25.409244+0000","last_active":"2023-11-15T01:37:25.798571+0000","last_peered":"2023-11-15T01:37:25.798571+0000","last_clean":"2023-11-15T01:37:25.798571+0000","last_became_active":"2023-11-15T01:37:25.406533+0000","last_became_peered":"2023-11-15T01:37:25.406533+0000","last_unstale":"2023-11-15T01:37:25.798571+0000","last_undegraded":"2023-11-15T01:37:25.798571+0000","last_fullsized":"2023-11-15T01:37:25.798571+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.805299+0000","last_change":"2023-11-15T01:37:25.801143+0000","last_active":"2023-11-15T01:37:25.805299+0000","last_peered":"2023-11-15T01:37:25.805299+0000","last_clean":"2023-11-15T01:37:25.805299+0000","last_became_active":"2023-11-15T01:37:25.800873+0000","last_became_peered":"2023-11-15T01:37:25.800873+0000","last_unstale":"2023-11-15T01:37:25.805299+0000","last_undegraded":"2023-11-15T01:37:25.805299+0000","last_fullsized":"2023-11-15T01:37:25.805299+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.805699+0000","last_change":"2023-11-15T01:37:25.419213+0000","last_active":"2023-11-15T01:37:25.805699+0000","last_peered":"2023-11-15T01:37:25.805699+0000","last_clean":"2023-11-15T01:37:25.805699+0000","last_became_active":"2023-11-15T01:37:25.418887+0000","last_became_peered":"2023-11-15T01:37:25.418887+0000","last_unstale":"2023-11-15T01:37:25.805699+0000","last_undegraded":"2023-11-15T01:37:25.805699+0000","last_fullsized":"2023-11-15T01:37:25.805699+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819120+0000","last_change":"2023-11-15T01:37:25.813749+0000","last_active":"2023-11-15T01:37:25.819120+0000","last_peered":"2023-11-15T01:37:25.819120+0000","last_clean":"2023-11-15T01:37:25.819120+0000","last_became_active":"2023-11-15T01:37:25.813486+0000","last_became_peered":"2023-11-15T01:37:25.813486+0000","last_unstale":"2023-11-15T01:37:25.819120+0000","last_undegraded":"2023-11-15T01:37:25.819120+0000","last_fullsized":"2023-11-15T01:37:25.819120+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.797259+0000","last_change":"2023-11-15T01:37:25.410488+0000","last_active":"2023-11-15T01:37:25.797259+0000","last_peered":"2023-11-15T01:37:25.797259+0000","last_clean":"2023-11-15T01:37:25.797259+0000","last_became_active":"2023-11-15T01:37:25.410177+0000","last_became_peered":"2023-11-15T01:37:25.410177+0000","last_unstale":"2023-11-15T01:37:25.797259+0000","last_undegraded":"2023-11-15T01:37:25.797259+0000","last_fullsized":"2023-11-15T01:37:25.797259+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819620+0000","last_change":"2023-11-15T01:37:25.807363+0000","last_active":"2023-11-15T01:37:25.819620+0000","last_peered":"2023-11-15T01:37:25.819620+0000","last_clean":"2023-11-15T01:37:25.819620+0000","last_became_active":"2023-11-15T01:37:25.807089+0000","last_became_peered":"2023-11-15T01:37:25.807089+0000","last_unstale":"2023-11-15T01:37:25.819620+0000","last_undegraded":"2023-11-15T01:37:25.819620+0000","last_fullsized":"2023-11-15T01:37:25.819620+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801665+0000","last_change":"2023-11-15T01:37:25.422474+0000","last_active":"2023-11-15T01:37:25.801665+0000","last_peered":"2023-11-15T01:37:25.801665+0000","last_clean":"2023-11-15T01:37:25.801665+0000","last_became_active":"2023-11-15T01:37:25.422209+0000","last_became_peered":"2023-11-15T01:37:25.422209+0000","last_unstale":"2023-11-15T01:37:25.801665+0000","last_undegraded":"2023-11-15T01:37:25.801665+0000","last_fullsized":"2023-11-15T01:37:25.801665+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.808626+0000","last_change":"2023-11-15T01:37:25.804923+0000","last_active":"2023-11-15T01:37:25.808626+0000","last_peered":"2023-11-15T01:37:25.808626+0000","last_clean":"2023-11-15T01:37:25.808626+0000","last_became_active":"2023-11-15T01:37:25.804493+0000","last_became_peered":"2023-11-15T01:37:25.804493+0000","last_unstale":"2023-11-15T01:37:25.808626+0000","last_undegraded":"2023-11-15T01:37:25.808626+0000","last_fullsized":"2023-11-15T01:37:25.808626+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812722+0000","last_change":"2023-11-15T01:37:25.418505+0000","last_active":"2023-11-15T01:37:25.812722+0000","last_peered":"2023-11-15T01:37:25.812722+0000","last_clean":"2023-11-15T01:37:25.812722+0000","last_became_active":"2023-11-15T01:37:25.417849+0000","last_became_peered":"2023-11-15T01:37:25.417849+0000","last_unstale":"2023-11-15T01:37:25.812722+0000","last_undegraded":"2023-11-15T01:37:25.812722+0000","last_fullsized":"2023-11-15T01:37:25.812722+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":87,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803604+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:37:25.803604+0000","last_peered":"2023-11-15T01:37:25.803604+0000","last_clean":"2023-11-15T01:37:25.803604+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:37:25.803604+0000","last_undegraded":"2023-11-15T01:37:25.803604+0000","last_fullsized":"2023-11-15T01:37:25.803604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813918+0000","last_change":"2023-11-15T01:37:25.812577+0000","last_active":"2023-11-15T01:37:25.813918+0000","last_peered":"2023-11-15T01:37:25.813918+0000","last_clean":"2023-11-15T01:37:25.813918+0000","last_became_active":"2023-11-15T01:37:25.812293+0000","last_became_peered":"2023-11-15T01:37:25.812293+0000","last_unstale":"2023-11-15T01:37:25.813918+0000","last_undegraded":"2023-11-15T01:37:25.813918+0000","last_fullsized":"2023-11-15T01:37:25.813918+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801571+0000","last_change":"2023-11-15T01:37:25.410009+0000","last_active":"2023-11-15T01:37:25.801571+0000","last_peered":"2023-11-15T01:37:25.801571+0000","last_clean":"2023-11-15T01:37:25.801571+0000","last_became_active":"2023-11-15T01:37:25.409735+0000","last_became_peered":"2023-11-15T01:37:25.409735+0000","last_unstale":"2023-11-15T01:37:25.801571+0000","last_undegraded":"2023-11-15T01:37:25.801571+0000","last_fullsized":"2023-11-15T01:37:25.801571+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.805793+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:37:25.805793+0000","last_peered":"2023-11-15T01:37:25.805793+0000","last_clean":"2023-11-15T01:37:25.805793+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:37:25.805793+0000","last_undegraded":"2023-11-15T01:37:25.805793+0000","last_fullsized":"2023-11-15T01:37:25.805793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814344+0000","last_change":"2023-11-15T01:37:25.807465+0000","last_active":"2023-11-15T01:37:25.814344+0000","last_peered":"2023-11-15T01:37:25.814344+0000","last_clean":"2023-11-15T01:37:25.814344+0000","last_became_active":"2023-11-15T01:37:25.807190+0000","last_became_peered":"2023-11-15T01:37:25.807190+0000","last_unstale":"2023-11-15T01:37:25.814344+0000","last_undegraded":"2023-11-15T01:37:25.814344+0000","last_fullsized":"2023-11-15T01:37:25.814344+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819413+0000","last_change":"2023-11-15T01:37:25.419258+0000","last_active":"2023-11-15T01:37:25.819413+0000","last_peered":"2023-11-15T01:37:25.819413+0000","last_clean":"2023-11-15T01:37:25.819413+0000","last_became_active":"2023-11-15T01:37:25.418620+0000","last_became_peered":"2023-11-15T01:37:25.418620+0000","last_unstale":"2023-11-15T01:37:25.819413+0000","last_undegraded":"2023-11-15T01:37:25.819413+0000","last_fullsized":"2023-11-15T01:37:25.819413+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":92,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.787535+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:37:25.787535+0000","last_peered":"2023-11-15T01:37:25.787535+0000","last_clean":"2023-11-15T01:37:25.787535+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:37:25.787535+0000","last_undegraded":"2023-11-15T01:37:25.787535+0000","last_fullsized":"2023-11-15T01:37:25.787535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811757+0000","last_change":"2023-11-15T01:37:25.805821+0000","last_active":"2023-11-15T01:37:25.811757+0000","last_peered":"2023-11-15T01:37:25.811757+0000","last_clean":"2023-11-15T01:37:25.811757+0000","last_became_active":"2023-11-15T01:37:25.805535+0000","last_became_peered":"2023-11-15T01:37:25.805535+0000","last_unstale":"2023-11-15T01:37:25.811757+0000","last_undegraded":"2023-11-15T01:37:25.811757+0000","last_fullsized":"2023-11-15T01:37:25.811757+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803523+0000","last_change":"2023-11-15T01:37:25.424116+0000","last_active":"2023-11-15T01:37:25.803523+0000","last_peered":"2023-11-15T01:37:25.803523+0000","last_clean":"2023-11-15T01:37:25.803523+0000","last_became_active":"2023-11-15T01:37:25.423763+0000","last_became_peered":"2023-11-15T01:37:25.423763+0000","last_unstale":"2023-11-15T01:37:25.803523+0000","last_undegraded":"2023-11-15T01:37:25.803523+0000","last_fullsized":"2023-11-15T01:37:25.803523+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.804171+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:37:25.804171+0000","last_peered":"2023-11-15T01:37:25.804171+0000","last_clean":"2023-11-15T01:37:25.804171+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:37:25.804171+0000","last_undegraded":"2023-11-15T01:37:25.804171+0000","last_fullsized":"2023-11-15T01:37:25.804171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":84,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801753+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:37:25.801753+0000","last_peered":"2023-11-15T01:37:25.801753+0000","last_clean":"2023-11-15T01:37:25.801753+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:37:25.801753+0000","last_undegraded":"2023-11-15T01:37:25.801753+0000","last_fullsized":"2023-11-15T01:37:25.801753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819651+0000","last_change":"2023-11-15T01:37:25.808026+0000","last_active":"2023-11-15T01:37:25.819651+0000","last_peered":"2023-11-15T01:37:25.819651+0000","last_clean":"2023-11-15T01:37:25.819651+0000","last_became_active":"2023-11-15T01:37:25.807733+0000","last_became_peered":"2023-11-15T01:37:25.807733+0000","last_unstale":"2023-11-15T01:37:25.819651+0000","last_undegraded":"2023-11-15T01:37:25.819651+0000","last_fullsized":"2023-11-15T01:37:25.819651+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.816224+0000","last_change":"2023-11-15T01:37:25.418245+0000","last_active":"2023-11-15T01:37:25.816224+0000","last_peered":"2023-11-15T01:37:25.816224+0000","last_clean":"2023-11-15T01:37:25.816224+0000","last_became_active":"2023-11-15T01:37:25.417901+0000","last_became_peered":"2023-11-15T01:37:25.417901+0000","last_unstale":"2023-11-15T01:37:25.816224+0000","last_undegraded":"2023-11-15T01:37:25.816224+0000","last_fullsized":"2023-11-15T01:37:25.816224+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":82,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801840+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:37:25.801840+0000","last_peered":"2023-11-15T01:37:25.801840+0000","last_clean":"2023-11-15T01:37:25.801840+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:37:25.801840+0000","last_undegraded":"2023-11-15T01:37:25.801840+0000","last_fullsized":"2023-11-15T01:37:25.801840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.806930+0000","last_change":"2023-11-15T01:37:25.805178+0000","last_active":"2023-11-15T01:37:25.806930+0000","last_peered":"2023-11-15T01:37:25.806930+0000","last_clean":"2023-11-15T01:37:25.806930+0000","last_became_active":"2023-11-15T01:37:25.804905+0000","last_became_peered":"2023-11-15T01:37:25.804905+0000","last_unstale":"2023-11-15T01:37:25.806930+0000","last_undegraded":"2023-11-15T01:37:25.806930+0000","last_fullsized":"2023-11-15T01:37:25.806930+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.788036+0000","last_change":"2023-11-15T01:37:25.415983+0000","last_active":"2023-11-15T01:37:25.788036+0000","last_peered":"2023-11-15T01:37:25.788036+0000","last_clean":"2023-11-15T01:37:25.788036+0000","last_became_active":"2023-11-15T01:37:25.415669+0000","last_became_peered":"2023-11-15T01:37:25.415669+0000","last_unstale":"2023-11-15T01:37:25.788036+0000","last_undegraded":"2023-11-15T01:37:25.788036+0000","last_fullsized":"2023-11-15T01:37:25.788036+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":82,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.800664+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:37:25.800664+0000","last_peered":"2023-11-15T01:37:25.800664+0000","last_clean":"2023-11-15T01:37:25.800664+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:37:25.800664+0000","last_undegraded":"2023-11-15T01:37:25.800664+0000","last_fullsized":"2023-11-15T01:37:25.800664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819233+0000","last_change":"2023-11-15T01:37:25.813192+0000","last_active":"2023-11-15T01:37:25.819233+0000","last_peered":"2023-11-15T01:37:25.819233+0000","last_clean":"2023-11-15T01:37:25.819233+0000","last_became_active":"2023-11-15T01:37:25.812962+0000","last_became_peered":"2023-11-15T01:37:25.812962+0000","last_unstale":"2023-11-15T01:37:25.819233+0000","last_undegraded":"2023-11-15T01:37:25.819233+0000","last_fullsized":"2023-11-15T01:37:25.819233+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.804324+0000","last_change":"2023-11-15T01:37:25.414908+0000","last_active":"2023-11-15T01:37:25.804324+0000","last_peered":"2023-11-15T01:37:25.804324+0000","last_clean":"2023-11-15T01:37:25.804324+0000","last_became_active":"2023-11-15T01:37:25.414175+0000","last_became_peered":"2023-11-15T01:37:25.414175+0000","last_unstale":"2023-11-15T01:37:25.804324+0000","last_undegraded":"2023-11-15T01:37:25.804324+0000","last_fullsized":"2023-11-15T01:37:25.804324+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":87,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.805288+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:37:25.805288+0000","last_peered":"2023-11-15T01:37:25.805288+0000","last_clean":"2023-11-15T01:37:25.805288+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:37:25.805288+0000","last_undegraded":"2023-11-15T01:37:25.805288+0000","last_fullsized":"2023-11-15T01:37:25.805288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807563+0000","last_change":"2023-11-15T01:37:25.803563+0000","last_active":"2023-11-15T01:37:25.807563+0000","last_peered":"2023-11-15T01:37:25.807563+0000","last_clean":"2023-11-15T01:37:25.807563+0000","last_became_active":"2023-11-15T01:37:25.803286+0000","last_became_peered":"2023-11-15T01:37:25.803286+0000","last_unstale":"2023-11-15T01:37:25.807563+0000","last_undegraded":"2023-11-15T01:37:25.807563+0000","last_fullsized":"2023-11-15T01:37:25.807563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.787733+0000","last_change":"2023-11-15T01:37:25.419665+0000","last_active":"2023-11-15T01:37:25.787733+0000","last_peered":"2023-11-15T01:37:25.787733+0000","last_clean":"2023-11-15T01:37:25.787733+0000","last_became_active":"2023-11-15T01:37:25.419392+0000","last_became_peered":"2023-11-15T01:37:25.419392+0000","last_unstale":"2023-11-15T01:37:25.787733+0000","last_undegraded":"2023-11-15T01:37:25.787733+0000","last_fullsized":"2023-11-15T01:37:25.787733+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.799054+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:37:25.799054+0000","last_peered":"2023-11-15T01:37:25.799054+0000","last_clean":"2023-11-15T01:37:25.799054+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:37:25.799054+0000","last_undegraded":"2023-11-15T01:37:25.799054+0000","last_fullsized":"2023-11-15T01:37:25.799054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302508,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069332,"statfs":{"total":96636764160,"available":96326995968,"internally_reserved":0,"allocated":1347584,"data_stored":688650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68500000000000005,"5min":0.71199999999999997,"15min":0.82299999999999995},"last":0.433},{"interface":"front","average":{"1min":0.624,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.35799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":2.9020000000000001,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68500000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.621},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.34499999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67100000000000004,"5min":0.80800000000000005,"15min":0.81499999999999995},"last":0.49199999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.82599999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73799999999999999,"5min":0.82299999999999995,"15min":0.86299999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.80700000000000005,"15min":0.85999999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.9209999999999998,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.64000000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45400000000000001,"15min":0.46500000000000002},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.84499999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.57999999999999996}]},{"osd":5,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47699999999999998,"15min":0.48499999999999999},"min":{"1min":0.26500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.36499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72299999999999998,"5min":0.73899999999999999,"15min":0.78500000000000003},"last":0.55500000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82999999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.73999999999999999,"5min":0.755,"15min":0.85099999999999998},"last":0.60399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575039,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302520,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069320,"statfs":{"total":96636764160,"available":96326983680,"internally_reserved":0,"allocated":1359872,"data_stored":690706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.29199999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.439},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73299999999999998,"5min":0.89000000000000001,"15min":0.97799999999999998},"last":0.42299999999999999}]},{"osd":1,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54900000000000004,"15min":0.56299999999999994},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.0649999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.33100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.75700000000000001,"5min":0.79100000000000004,"15min":1.038},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.52700000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.77100000000000002,"5min":0.85499999999999998,"15min":1.028},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35699999999999998},"max":{"1min":0.67100000000000004,"5min":0.874,"15min":1.004},"last":0.59299999999999997}]},{"osd":4,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44700000000000001,"15min":0.44800000000000001},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.68200000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.25800000000000001},"max":{"1min":0.65400000000000003,"5min":0.73299999999999998,"15min":0.81799999999999995},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63500000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.70999999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.627}]},{"osd":7,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.496,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":0.64000000000000001,"5min":0.72099999999999997,"15min":0.86499999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.34000000000000002},"max":{"1min":0.67200000000000004,"5min":0.82399999999999995,"15min":1.0009999999999999},"last":0.66500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575040,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":688594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.373,"15min":0.376},"min":{"1min":0.25,"5min":0.249,"15min":0.23999999999999999},"max":{"1min":0.59099999999999997,"5min":0.73699999999999999,"15min":0.77800000000000002},"last":0.246},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.29399999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.22600000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.252},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.27800000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.31},"max":{"1min":9.641,"5min":9.641,"15min":9.641},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.53800000000000003,"15min":0.496},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.28000000000000003},"max":{"1min":9.6199999999999992,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.38900000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.68500000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.0509999999999999},"last":0.61899999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71699999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.40400000000000003,"15min":0.373},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.46200000000000002,"5min":0.441,"15min":0.42799999999999999},"max":{"1min":0.77500000000000002,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.73399999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0429999999999999,"5min":1.0509999999999999,"15min":1.25},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66800000000000004,"15min":0.68799999999999994},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81499999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.76500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575038,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302520,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069320,"statfs":{"total":96636764160,"available":96326983680,"internally_reserved":0,"allocated":1359872,"data_stored":689432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.375,"15min":0.36899999999999999},"min":{"1min":0.23799999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.498,"5min":2.024,"15min":2.024},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.42799999999999999,"15min":0.41599999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.215},"max":{"1min":0.60199999999999998,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.376}]},{"osd":2,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.39200000000000002,"15min":0.38700000000000001},"min":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.44600000000000001,"5min":1.768,"15min":1.768},"last":0.318},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.437,"15min":0.44},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60799999999999998,"5min":1.982,"15min":1.982},"last":0.44700000000000001}]},{"osd":3,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.433,"15min":0.434},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.22500000000000001},"max":{"1min":0.58599999999999997,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.45400000000000001,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.28100000000000003,"15min":0.27700000000000002},"max":{"1min":0.56299999999999994,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.28299999999999997}]},{"osd":4,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79400000000000004,"5min":0.97799999999999998,"15min":1.454},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82799999999999996,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78500000000000003,"5min":1.881,"15min":1.881},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.42199999999999999,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.80400000000000005,"5min":0.88300000000000001,"15min":1.1120000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81799999999999995,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85799999999999998,"5min":1.917,"15min":1.917},"last":0.68899999999999995}]},{"osd":7,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.85399999999999998,"5min":1.843,"15min":1.843},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67400000000000004,"15min":0.68999999999999995},"min":{"1min":0.49399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84599999999999997,"5min":0.92300000000000004,"15min":1.4119999999999999},"last":0.749}]}]},{"osd":2,"up_from":13,"seq":55834575039,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306596,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065244,"statfs":{"total":96636764160,"available":96322809856,"internally_reserved":0,"allocated":1339392,"data_stored":688594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36499999999999999,"15min":0.36899999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52500000000000002,"5min":0.55100000000000005,"15min":0.61899999999999999},"last":0.218},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.39800000000000002,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.57699999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.251}]},{"osd":1,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.222},"max":{"1min":0.745,"5min":0.745,"15min":0.75},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.441,"15min":0.442},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.69799999999999995,"5min":0.73499999999999999,"15min":0.92000000000000004},"last":0.28499999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.248},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45000000000000001,"15min":0.44400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.253},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.27300000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59999999999999998,"15min":0.625},"min":{"1min":0.41299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92700000000000005,"5min":1.0549999999999999,"15min":1.0800000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.39200000000000002},"max":{"1min":0.872,"5min":0.91100000000000003,"15min":1.052},"last":0.41199999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.627,"15min":0.64800000000000002},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.89400000000000002,"5min":1.032,"15min":1.032},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.64100000000000001},"min":{"1min":0.44700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.871,"5min":0.96699999999999997,"15min":1.1339999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.66300000000000003},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.876,"5min":1.002,"15min":1.0389999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.65300000000000002,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85699999999999998,"5min":1.0669999999999999,"15min":1.119},"last":0.56200000000000006}]},{"osd":7,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.67700000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78300000000000003,"5min":1.079,"15min":1.103},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67600000000000005,"15min":0.69499999999999995},"min":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.86599999999999999,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.53000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575040,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306604,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065236,"statfs":{"total":96636764160,"available":96322801664,"internally_reserved":0,"allocated":1347584,"data_stored":689556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48399999999999999,"5min":0.65900000000000003,"15min":0.79900000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.38200000000000001,"15min":0.39800000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23200000000000001},"max":{"1min":0.60699999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.48599999999999999}]},{"osd":1,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.371,"15min":0.38700000000000001},"min":{"1min":0.27000000000000002,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":0.47499999999999998,"5min":0.59799999999999998,"15min":0.72899999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.42799999999999999,"15min":0.44400000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52700000000000002,"5min":0.72499999999999998,"15min":0.80500000000000005},"last":0.5}]},{"osd":2,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.42699999999999999,"15min":0.44600000000000001},"min":{"1min":0.28000000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61699999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.45300000000000001,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26200000000000001},"max":{"1min":0.53000000000000003,"5min":0.69199999999999995,"15min":0.81999999999999995},"last":0.46400000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58699999999999997,"15min":0.61799999999999999},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.80800000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.627},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.39000000000000001},"max":{"1min":0.73599999999999999,"5min":0.89200000000000002,"15min":1.0589999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.60299999999999998,"15min":0.63600000000000001},"min":{"1min":0.41799999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.72799999999999998,"5min":0.92000000000000004,"15min":1.0569999999999999},"last":0.63},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61299999999999999,"15min":0.64100000000000001},"min":{"1min":0.375,"5min":0.373,"15min":0.373},"max":{"1min":0.84899999999999998,"5min":0.879,"15min":0.95999999999999996},"last":0.61199999999999999}]},{"osd":6,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61699999999999999,"15min":0.64700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":0.94299999999999995,"15min":1.0980000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.67100000000000004},"min":{"1min":0.442,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73999999999999999,"5min":0.95799999999999996,"15min":1.169},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63500000000000001,"15min":0.66800000000000004},"min":{"1min":0.41999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88700000000000001,"5min":1.0429999999999999,"15min":1.071},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.64500000000000002,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75800000000000001,"5min":0.996,"15min":1.1459999999999999},"last":0.67300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302508,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069332,"statfs":{"total":96636764160,"available":96326995968,"internally_reserved":0,"allocated":1347584,"data_stored":689238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76500000000000001,"5min":0.88,"15min":0.88},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.32900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65600000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54000000000000004}]},{"osd":1,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55700000000000005,"15min":0.57199999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.746,"5min":1.087,"15min":1.087},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34699999999999998},"max":{"1min":0.69199999999999995,"5min":0.76600000000000001,"15min":0.81000000000000005},"last":0.52800000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.34699999999999998,"15min":0.33100000000000002},"max":{"1min":0.78900000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56200000000000006}]},{"osd":3,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72099999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30399999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.30399999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.57499999999999996}]},{"osd":6,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.34000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.53000000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82799999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.63400000000000001}]},{"osd":7,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.64300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575038,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":688594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78500000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.81200000000000006},"last":0.40000000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32600000000000001},"max":{"1min":0.68799999999999994,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.504},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33400000000000002},"max":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.441}]},{"osd":2,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.86199999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34999999999999998},"max":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":1.103},"last":0.58099999999999996}]},{"osd":3,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.376,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":1.127},"last":0.54400000000000004}]},{"osd":4,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64400000000000002,"5min":0.66500000000000004,"15min":0.94399999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.50800000000000001,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56399999999999995}]},{"osd":6,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46400000000000002,"15min":0.47599999999999998},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74399999999999999,"5min":0.83099999999999996,"15min":1.0660000000000001},"last":0.629},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.47299999999999998,"15min":0.495},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.622}]},{"osd":7,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48099999999999998,"15min":0.498},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.69899999999999995,"5min":0.72999999999999998,"15min":0.97199999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":0.85799999999999998,"15min":1.1499999999999999},"last":0.75900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:37:34.307 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:37:34.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.438+0000 7f2aee27d700 1 Processor -- start 2023-11-15T01:37:34.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.439+0000 7f2aee27d700 1 -- start start 2023-11-15T01:37:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.439+0000 7f2aee27d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2ae8154150 0x7f2ae8154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.439+0000 7f2aee27d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2ae80aa060 0x7f2ae80c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.439+0000 7f2aee27d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae80c06f0 con 0x7f2ae80ab1a0 2023-11-15T01:37:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.439+0000 7f2aee27d700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae80c09d0 con 0x7f2ae80aa060 2023-11-15T01:37:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.439+0000 7f2aee27d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae8158820 con 0x7f2ae8154150 2023-11-15T01:37:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.440+0000 7f2aec81a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2ae80aa060 0x7f2ae80c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.440+0000 7f2aec81a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2ae80aa060 0x7f2ae80c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43634/0 (socket says 172.21.15.1:43634) 2023-11-15T01:37:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.440+0000 7f2ae77fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2ae80ab1a0 0x7f2ae8158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45040/0 (socket says 172.21.15.1:45040) 2023-11-15T01:37:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.440+0000 7f2aec81a700 1 -- 172.21.15.1:0/636341667 learned_addr learned my addr 172.21.15.1:0/636341667 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.440+0000 7f2ae7fff700 1 --2- 172.21.15.1:0/636341667 >> v2:172.21.15.141:3300/0 conn(0x7f2ae8154150 0x7f2ae8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.440+0000 7f2aec81a700 1 -- 172.21.15.1:0/636341667 >> v2:172.21.15.141:3300/0 conn(0x7f2ae8154150 msgr2=0x7f2ae8154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:34.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.440+0000 7f2aec81a700 1 --2- 172.21.15.1:0/636341667 >> v2:172.21.15.141:3300/0 conn(0x7f2ae8154150 0x7f2ae8154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.440+0000 7f2aec81a700 1 -- 172.21.15.1:0/636341667 >> v1:172.21.15.1:6789/0 conn(0x7f2ae80ab1a0 legacy=0x7f2ae8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:34.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.440+0000 7f2ae6ffd700 1 -- 172.21.15.1:0/636341667 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972258826 0 0) 0x7f2ae80c06f0 con 0x7f2ae80ab1a0 2023-11-15T01:37:34.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.440+0000 7f2aec81a700 1 -- 172.21.15.1:0/636341667 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae8158b00 con 0x7f2ae80aa060 2023-11-15T01:37:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.440+0000 7f2aec81a700 1 --2- 172.21.15.1:0/636341667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ae80aa060 0x7f2ae80c5f10 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f2ae806bfb0 tx=0x7f2ae0009840).ready entity=mon.0 client_cookie=b7bf3aae78510b9c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.440+0000 7f2ae6ffd700 1 -- 172.21.15.1:0/636341667 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae000e070 con 0x7f2ae80aa060 2023-11-15T01:37:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.440+0000 7f2ae6ffd700 1 -- 172.21.15.1:0/636341667 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae000ba50 con 0x7f2ae80aa060 2023-11-15T01:37:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.440+0000 7f2ae6ffd700 1 -- 172.21.15.1:0/636341667 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae000bdd0 con 0x7f2ae80aa060 2023-11-15T01:37:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.441+0000 7f2aee27d700 1 -- 172.21.15.1:0/636341667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ae80aa060 msgr2=0x7f2ae80c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:34.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.441+0000 7f2aee27d700 1 --2- 172.21.15.1:0/636341667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ae80aa060 0x7f2ae80c5f10 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f2ae806bfb0 tx=0x7f2ae0009840).stop 2023-11-15T01:37:34.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.441+0000 7f2aee27d700 1 -- 172.21.15.1:0/636341667 shutdown_connections 2023-11-15T01:37:34.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.441+0000 7f2aee27d700 1 --2- 172.21.15.1:0/636341667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ae80aa060 0x7f2ae80c5f10 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.441+0000 7f2aee27d700 1 --2- 172.21.15.1:0/636341667 >> v2:172.21.15.141:3300/0 conn(0x7f2ae8154150 0x7f2ae8154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.441+0000 7f2aee27d700 1 -- 172.21.15.1:0/636341667 >> 172.21.15.1:0/636341667 conn(0x7f2ae8064aa0 msgr2=0x7f2ae8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:34.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.441+0000 7f2aee27d700 1 -- 172.21.15.1:0/636341667 shutdown_connections 2023-11-15T01:37:34.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.441+0000 7f2aee27d700 1 -- 172.21.15.1:0/636341667 wait complete. 2023-11-15T01:37:34.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.442+0000 7f2aee27d700 1 Processor -- start 2023-11-15T01:37:34.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.442+0000 7f2aee27d700 1 -- start start 2023-11-15T01:37:34.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2aee27d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ae80aa060 0x7f2ae8146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:34.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2aee27d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ae80ab1a0 0x7f2ae80c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:34.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2aee27d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ae8154150 0x7f2ae80c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:34.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2aee27d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae81676b0 con 0x7f2ae80aa060 2023-11-15T01:37:34.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2aee27d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae80abae0 con 0x7f2ae80ab1a0 2023-11-15T01:37:34.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2aee27d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae80abdc0 con 0x7f2ae8154150 2023-11-15T01:37:34.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2ae7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ae80aa060 0x7f2ae8146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:34.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2ae7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ae80aa060 0x7f2ae8146c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43640/0 (socket says 172.21.15.1:43640) 2023-11-15T01:37:34.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2ae7fff700 1 -- 172.21.15.1:0/1114998515 learned_addr learned my addr 172.21.15.1:0/1114998515 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:34.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2ae77fe700 1 --2- 172.21.15.1:0/1114998515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ae80ab1a0 0x7f2ae80c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:34.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2aec81a700 1 --2- 172.21.15.1:0/1114998515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ae8154150 0x7f2ae80c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:34.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2ae7fff700 1 -- 172.21.15.1:0/1114998515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ae8154150 msgr2=0x7f2ae80c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:34.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2ae7fff700 1 --2- 172.21.15.1:0/1114998515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ae8154150 0x7f2ae80c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2ae7fff700 1 -- 172.21.15.1:0/1114998515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ae80ab1a0 msgr2=0x7f2ae80c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:34.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2ae7fff700 1 --2- 172.21.15.1:0/1114998515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ae80ab1a0 0x7f2ae80c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2ae7fff700 1 -- 172.21.15.1:0/1114998515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae0009ae0 con 0x7f2ae80aa060 2023-11-15T01:37:34.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.443+0000 7f2ae7fff700 1 --2- 172.21.15.1:0/1114998515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ae80aa060 0x7f2ae8146c60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f2ad800d890 tx=0x7f2ad8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:34.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.444+0000 7f2acffff700 1 -- 172.21.15.1:0/1114998515 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80125f0 con 0x7f2ae80aa060 2023-11-15T01:37:34.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.444+0000 7f2acffff700 1 -- 172.21.15.1:0/1114998515 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad8012750 con 0x7f2ae80aa060 2023-11-15T01:37:34.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.444+0000 7f2aee27d700 1 -- 172.21.15.1:0/1114998515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae80ac0a0 con 0x7f2ae80aa060 2023-11-15T01:37:34.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.444+0000 7f2acffff700 1 -- 172.21.15.1:0/1114998515 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8012ad0 con 0x7f2ae80aa060 2023-11-15T01:37:34.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.444+0000 7f2aee27d700 1 -- 172.21.15.1:0/1114998515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae8147150 con 0x7f2ae80aa060 2023-11-15T01:37:34.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.445+0000 7f2aee27d700 1 -- 172.21.15.1:0/1114998515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae806c7e0 con 0x7f2ae80aa060 2023-11-15T01:37:34.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.445+0000 7f2acffff700 1 -- 172.21.15.1:0/1114998515 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2ad8013480 con 0x7f2ae80aa060 2023-11-15T01:37:34.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.445+0000 7f2acffff700 1 --2- 172.21.15.1:0/1114998515 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2ad405f270 0x7f2ad4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:34.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.445+0000 7f2acffff700 1 -- 172.21.15.1:0/1114998515 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f2ad807a2b0 con 0x7f2ae80aa060 2023-11-15T01:37:34.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.446+0000 7f2ae77fe700 1 --2- 172.21.15.1:0/1114998515 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2ad405f270 0x7f2ad4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:34.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.446+0000 7f2ae77fe700 1 --2- 172.21.15.1:0/1114998515 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2ad405f270 0x7f2ad4061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2ae8063b90 tx=0x7f2adc007180).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:34.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.450+0000 7f2acffff700 1 -- 172.21.15.1:0/1114998515 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2ad804b1f0 con 0x7f2ae80aa060 2023-11-15T01:37:34.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.622+0000 7f2aee27d700 1 -- 172.21.15.1:0/1114998515 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ae8158de0 con 0x7f2ad405f270 2023-11-15T01:37:34.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.632+0000 7f2acffff700 1 -- 172.21.15.1:0/1114998515 <== mgr.6466 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361431 (secure 0 0 0) 0x7f2ae8158de0 con 0x7f2ad405f270 2023-11-15T01:37:34.638 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:34.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.635+0000 7f2aee27d700 1 -- 172.21.15.1:0/1114998515 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2ad405f270 msgr2=0x7f2ad4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:34.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.635+0000 7f2aee27d700 1 --2- 172.21.15.1:0/1114998515 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2ad405f270 0x7f2ad4061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2ae8063b90 tx=0x7f2adc007180).stop 2023-11-15T01:37:34.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.635+0000 7f2aee27d700 1 -- 172.21.15.1:0/1114998515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ae80aa060 msgr2=0x7f2ae8146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:34.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.635+0000 7f2aee27d700 1 --2- 172.21.15.1:0/1114998515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ae80aa060 0x7f2ae8146c60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f2ad800d890 tx=0x7f2ad8008040).stop 2023-11-15T01:37:34.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.635+0000 7f2aee27d700 1 -- 172.21.15.1:0/1114998515 shutdown_connections 2023-11-15T01:37:34.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.635+0000 7f2aee27d700 1 --2- 172.21.15.1:0/1114998515 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2ad405f270 0x7f2ad4061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.635+0000 7f2aee27d700 1 --2- 172.21.15.1:0/1114998515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ae8154150 0x7f2ae80c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.635+0000 7f2aee27d700 1 --2- 172.21.15.1:0/1114998515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ae80aa060 0x7f2ae8146c60 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.635+0000 7f2aee27d700 1 --2- 172.21.15.1:0/1114998515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ae80ab1a0 0x7f2ae80c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.635+0000 7f2aee27d700 1 -- 172.21.15.1:0/1114998515 >> 172.21.15.1:0/1114998515 conn(0x7f2ae8064aa0 msgr2=0x7f2ae8063e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:34.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.635+0000 7f2aee27d700 1 -- 172.21.15.1:0/1114998515 shutdown_connections 2023-11-15T01:37:34.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.635+0000 7f2aee27d700 1 -- 172.21.15.1:0/1114998515 wait complete. 2023-11-15T01:37:34.643 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:37:34.649 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-11-15T01:37:34.353291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428256,"kb_used_data":10528,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752546464,"statfs":{"total":773094113280,"available":770607579136,"internally_reserved":0,"allocated":10780672,"data_stored":5513364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5548,"num_objects":-21,"num_object_clones":0,"num_object_copies":-42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-54,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.006569"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.818300+0000","last_change":"2023-11-15T01:37:25.816590+0000","last_active":"2023-11-15T01:37:25.818300+0000","last_peered":"2023-11-15T01:37:25.818300+0000","last_clean":"2023-11-15T01:37:25.818300+0000","last_became_active":"2023-11-15T01:37:25.816262+0000","last_became_peered":"2023-11-15T01:37:25.816262+0000","last_unstale":"2023-11-15T01:37:25.818300+0000","last_undegraded":"2023-11-15T01:37:25.818300+0000","last_fullsized":"2023-11-15T01:37:25.818300+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"108'3","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814693+0000","last_change":"2023-11-15T01:37:25.408583+0000","last_active":"2023-11-15T01:37:25.814693+0000","last_peered":"2023-11-15T01:37:25.814693+0000","last_clean":"2023-11-15T01:37:25.814693+0000","last_became_active":"2023-11-15T01:37:25.407367+0000","last_became_peered":"2023-11-15T01:37:25.407367+0000","last_unstale":"2023-11-15T01:37:25.814693+0000","last_undegraded":"2023-11-15T01:37:25.814693+0000","last_fullsized":"2023-11-15T01:37:25.814693+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811410+0000","last_change":"2023-11-15T01:37:25.806157+0000","last_active":"2023-11-15T01:37:25.811410+0000","last_peered":"2023-11-15T01:37:25.811410+0000","last_clean":"2023-11-15T01:37:25.811410+0000","last_became_active":"2023-11-15T01:37:25.805886+0000","last_became_peered":"2023-11-15T01:37:25.805886+0000","last_unstale":"2023-11-15T01:37:25.811410+0000","last_undegraded":"2023-11-15T01:37:25.811410+0000","last_fullsized":"2023-11-15T01:37:25.811410+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.805334+0000","last_change":"2023-11-15T01:37:25.420055+0000","last_active":"2023-11-15T01:37:25.805334+0000","last_peered":"2023-11-15T01:37:25.805334+0000","last_clean":"2023-11-15T01:37:25.805334+0000","last_became_active":"2023-11-15T01:37:25.419766+0000","last_became_peered":"2023-11-15T01:37:25.419766+0000","last_unstale":"2023-11-15T01:37:25.805334+0000","last_undegraded":"2023-11-15T01:37:25.805334+0000","last_fullsized":"2023-11-15T01:37:25.805334+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.816767+0000","last_change":"2023-11-15T01:37:25.807109+0000","last_active":"2023-11-15T01:37:25.816767+0000","last_peered":"2023-11-15T01:37:25.816767+0000","last_clean":"2023-11-15T01:37:25.816767+0000","last_became_active":"2023-11-15T01:37:25.806775+0000","last_became_peered":"2023-11-15T01:37:25.806775+0000","last_unstale":"2023-11-15T01:37:25.816767+0000","last_undegraded":"2023-11-15T01:37:25.816767+0000","last_fullsized":"2023-11-15T01:37:25.816767+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.800464+0000","last_change":"2023-11-15T01:37:25.418749+0000","last_active":"2023-11-15T01:37:25.800464+0000","last_peered":"2023-11-15T01:37:25.800464+0000","last_clean":"2023-11-15T01:37:25.800464+0000","last_became_active":"2023-11-15T01:37:25.418443+0000","last_became_peered":"2023-11-15T01:37:25.418443+0000","last_unstale":"2023-11-15T01:37:25.800464+0000","last_undegraded":"2023-11-15T01:37:25.800464+0000","last_fullsized":"2023-11-15T01:37:25.800464+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812937+0000","last_change":"2023-11-15T01:37:25.810112+0000","last_active":"2023-11-15T01:37:25.812937+0000","last_peered":"2023-11-15T01:37:25.812937+0000","last_clean":"2023-11-15T01:37:25.812937+0000","last_became_active":"2023-11-15T01:37:25.809789+0000","last_became_peered":"2023-11-15T01:37:25.809789+0000","last_unstale":"2023-11-15T01:37:25.812937+0000","last_undegraded":"2023-11-15T01:37:25.812937+0000","last_fullsized":"2023-11-15T01:37:25.812937+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.802236+0000","last_change":"2023-11-15T01:37:25.416214+0000","last_active":"2023-11-15T01:37:25.802236+0000","last_peered":"2023-11-15T01:37:25.802236+0000","last_clean":"2023-11-15T01:37:25.802236+0000","last_became_active":"2023-11-15T01:37:25.415899+0000","last_became_peered":"2023-11-15T01:37:25.415899+0000","last_unstale":"2023-11-15T01:37:25.802236+0000","last_undegraded":"2023-11-15T01:37:25.802236+0000","last_fullsized":"2023-11-15T01:37:25.802236+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.818600+0000","last_change":"2023-11-15T01:37:25.816925+0000","last_active":"2023-11-15T01:37:25.818600+0000","last_peered":"2023-11-15T01:37:25.818600+0000","last_clean":"2023-11-15T01:37:25.818600+0000","last_became_active":"2023-11-15T01:37:25.816682+0000","last_became_peered":"2023-11-15T01:37:25.816682+0000","last_unstale":"2023-11-15T01:37:25.818600+0000","last_undegraded":"2023-11-15T01:37:25.818600+0000","last_fullsized":"2023-11-15T01:37:25.818600+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.817460+0000","last_change":"2023-11-15T01:37:25.412742+0000","last_active":"2023-11-15T01:37:25.817460+0000","last_peered":"2023-11-15T01:37:25.817460+0000","last_clean":"2023-11-15T01:37:25.817460+0000","last_became_active":"2023-11-15T01:37:25.412471+0000","last_became_peered":"2023-11-15T01:37:25.412471+0000","last_unstale":"2023-11-15T01:37:25.817460+0000","last_undegraded":"2023-11-15T01:37:25.817460+0000","last_fullsized":"2023-11-15T01:37:25.817460+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.815898+0000","last_change":"2023-11-15T01:37:25.811286+0000","last_active":"2023-11-15T01:37:25.815898+0000","last_peered":"2023-11-15T01:37:25.815898+0000","last_clean":"2023-11-15T01:37:25.815898+0000","last_became_active":"2023-11-15T01:37:25.811059+0000","last_became_peered":"2023-11-15T01:37:25.811059+0000","last_unstale":"2023-11-15T01:37:25.815898+0000","last_undegraded":"2023-11-15T01:37:25.815898+0000","last_fullsized":"2023-11-15T01:37:25.815898+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813341+0000","last_change":"2023-11-15T01:37:25.415016+0000","last_active":"2023-11-15T01:37:25.813341+0000","last_peered":"2023-11-15T01:37:25.813341+0000","last_clean":"2023-11-15T01:37:25.813341+0000","last_became_active":"2023-11-15T01:37:25.414532+0000","last_became_peered":"2023-11-15T01:37:25.414532+0000","last_unstale":"2023-11-15T01:37:25.813341+0000","last_undegraded":"2023-11-15T01:37:25.813341+0000","last_fullsized":"2023-11-15T01:37:25.813341+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.817551+0000","last_change":"2023-11-15T01:37:25.805785+0000","last_active":"2023-11-15T01:37:25.817551+0000","last_peered":"2023-11-15T01:37:25.817551+0000","last_clean":"2023-11-15T01:37:25.817551+0000","last_became_active":"2023-11-15T01:37:25.805510+0000","last_became_peered":"2023-11-15T01:37:25.805510+0000","last_unstale":"2023-11-15T01:37:25.817551+0000","last_undegraded":"2023-11-15T01:37:25.817551+0000","last_fullsized":"2023-11-15T01:37:25.817551+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.788055+0000","last_change":"2023-11-15T01:37:25.417606+0000","last_active":"2023-11-15T01:37:25.788055+0000","last_peered":"2023-11-15T01:37:25.788055+0000","last_clean":"2023-11-15T01:37:25.788055+0000","last_became_active":"2023-11-15T01:37:25.417271+0000","last_became_peered":"2023-11-15T01:37:25.417271+0000","last_unstale":"2023-11-15T01:37:25.788055+0000","last_undegraded":"2023-11-15T01:37:25.788055+0000","last_fullsized":"2023-11-15T01:37:25.788055+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819336+0000","last_change":"2023-11-15T01:37:25.816625+0000","last_active":"2023-11-15T01:37:25.819336+0000","last_peered":"2023-11-15T01:37:25.819336+0000","last_clean":"2023-11-15T01:37:25.819336+0000","last_became_active":"2023-11-15T01:37:25.816296+0000","last_became_peered":"2023-11-15T01:37:25.816296+0000","last_unstale":"2023-11-15T01:37:25.819336+0000","last_undegraded":"2023-11-15T01:37:25.819336+0000","last_fullsized":"2023-11-15T01:37:25.819336+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803923+0000","last_change":"2023-11-15T01:37:25.417379+0000","last_active":"2023-11-15T01:37:25.803923+0000","last_peered":"2023-11-15T01:37:25.803923+0000","last_clean":"2023-11-15T01:37:25.803923+0000","last_became_active":"2023-11-15T01:37:25.417085+0000","last_became_peered":"2023-11-15T01:37:25.417085+0000","last_unstale":"2023-11-15T01:37:25.803923+0000","last_undegraded":"2023-11-15T01:37:25.803923+0000","last_fullsized":"2023-11-15T01:37:25.803923+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.808143+0000","last_change":"2023-11-15T01:37:25.798848+0000","last_active":"2023-11-15T01:37:25.808143+0000","last_peered":"2023-11-15T01:37:25.808143+0000","last_clean":"2023-11-15T01:37:25.808143+0000","last_became_active":"2023-11-15T01:37:25.798566+0000","last_became_peered":"2023-11-15T01:37:25.798566+0000","last_unstale":"2023-11-15T01:37:25.808143+0000","last_undegraded":"2023-11-15T01:37:25.808143+0000","last_fullsized":"2023-11-15T01:37:25.808143+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807542+0000","last_change":"2023-11-15T01:37:25.414011+0000","last_active":"2023-11-15T01:37:25.807542+0000","last_peered":"2023-11-15T01:37:25.807542+0000","last_clean":"2023-11-15T01:37:25.807542+0000","last_became_active":"2023-11-15T01:37:25.413687+0000","last_became_peered":"2023-11-15T01:37:25.413687+0000","last_unstale":"2023-11-15T01:37:25.807542+0000","last_undegraded":"2023-11-15T01:37:25.807542+0000","last_fullsized":"2023-11-15T01:37:25.807542+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812301+0000","last_change":"2023-11-15T01:37:25.805983+0000","last_active":"2023-11-15T01:37:25.812301+0000","last_peered":"2023-11-15T01:37:25.812301+0000","last_clean":"2023-11-15T01:37:25.812301+0000","last_became_active":"2023-11-15T01:37:25.805783+0000","last_became_peered":"2023-11-15T01:37:25.805783+0000","last_unstale":"2023-11-15T01:37:25.812301+0000","last_undegraded":"2023-11-15T01:37:25.812301+0000","last_fullsized":"2023-11-15T01:37:25.812301+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.796597+0000","last_change":"2023-11-15T01:37:25.411780+0000","last_active":"2023-11-15T01:37:25.796597+0000","last_peered":"2023-11-15T01:37:25.796597+0000","last_clean":"2023-11-15T01:37:25.796597+0000","last_became_active":"2023-11-15T01:37:25.411497+0000","last_became_peered":"2023-11-15T01:37:25.411497+0000","last_unstale":"2023-11-15T01:37:25.796597+0000","last_undegraded":"2023-11-15T01:37:25.796597+0000","last_fullsized":"2023-11-15T01:37:25.796597+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807763+0000","last_change":"2023-11-15T01:37:25.796296+0000","last_active":"2023-11-15T01:37:25.807763+0000","last_peered":"2023-11-15T01:37:25.807763+0000","last_clean":"2023-11-15T01:37:25.807763+0000","last_became_active":"2023-11-15T01:37:25.796037+0000","last_became_peered":"2023-11-15T01:37:25.796037+0000","last_unstale":"2023-11-15T01:37:25.807763+0000","last_undegraded":"2023-11-15T01:37:25.807763+0000","last_fullsized":"2023-11-15T01:37:25.807763+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.804237+0000","last_change":"2023-11-15T01:37:25.417734+0000","last_active":"2023-11-15T01:37:25.804237+0000","last_peered":"2023-11-15T01:37:25.804237+0000","last_clean":"2023-11-15T01:37:25.804237+0000","last_became_active":"2023-11-15T01:37:25.417457+0000","last_became_peered":"2023-11-15T01:37:25.417457+0000","last_unstale":"2023-11-15T01:37:25.804237+0000","last_undegraded":"2023-11-15T01:37:25.804237+0000","last_fullsized":"2023-11-15T01:37:25.804237+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813686+0000","last_change":"2023-11-15T01:37:25.809518+0000","last_active":"2023-11-15T01:37:25.813686+0000","last_peered":"2023-11-15T01:37:25.813686+0000","last_clean":"2023-11-15T01:37:25.813686+0000","last_became_active":"2023-11-15T01:37:25.809139+0000","last_became_peered":"2023-11-15T01:37:25.809139+0000","last_unstale":"2023-11-15T01:37:25.813686+0000","last_undegraded":"2023-11-15T01:37:25.813686+0000","last_fullsized":"2023-11-15T01:37:25.813686+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"108'4","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.822226+0000","last_change":"2023-11-15T01:37:25.412130+0000","last_active":"2023-11-15T01:37:25.822226+0000","last_peered":"2023-11-15T01:37:25.822226+0000","last_clean":"2023-11-15T01:37:25.822226+0000","last_became_active":"2023-11-15T01:37:25.411854+0000","last_became_peered":"2023-11-15T01:37:25.411854+0000","last_unstale":"2023-11-15T01:37:25.822226+0000","last_undegraded":"2023-11-15T01:37:25.822226+0000","last_fullsized":"2023-11-15T01:37:25.822226+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.808607+0000","last_change":"2023-11-15T01:37:25.804754+0000","last_active":"2023-11-15T01:37:25.808607+0000","last_peered":"2023-11-15T01:37:25.808607+0000","last_clean":"2023-11-15T01:37:25.808607+0000","last_became_active":"2023-11-15T01:37:25.804091+0000","last_became_peered":"2023-11-15T01:37:25.804091+0000","last_unstale":"2023-11-15T01:37:25.808607+0000","last_undegraded":"2023-11-15T01:37:25.808607+0000","last_fullsized":"2023-11-15T01:37:25.808607+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.816266+0000","last_change":"2023-11-15T01:37:25.421559+0000","last_active":"2023-11-15T01:37:25.816266+0000","last_peered":"2023-11-15T01:37:25.816266+0000","last_clean":"2023-11-15T01:37:25.816266+0000","last_became_active":"2023-11-15T01:37:25.421284+0000","last_became_peered":"2023-11-15T01:37:25.421284+0000","last_unstale":"2023-11-15T01:37:25.816266+0000","last_undegraded":"2023-11-15T01:37:25.816266+0000","last_fullsized":"2023-11-15T01:37:25.816266+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812654+0000","last_change":"2023-11-15T01:37:25.802867+0000","last_active":"2023-11-15T01:37:25.812654+0000","last_peered":"2023-11-15T01:37:25.812654+0000","last_clean":"2023-11-15T01:37:25.812654+0000","last_became_active":"2023-11-15T01:37:25.802608+0000","last_became_peered":"2023-11-15T01:37:25.802608+0000","last_unstale":"2023-11-15T01:37:25.812654+0000","last_undegraded":"2023-11-15T01:37:25.812654+0000","last_fullsized":"2023-11-15T01:37:25.812654+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.787960+0000","last_change":"2023-11-15T01:37:25.414896+0000","last_active":"2023-11-15T01:37:25.787960+0000","last_peered":"2023-11-15T01:37:25.787960+0000","last_clean":"2023-11-15T01:37:25.787960+0000","last_became_active":"2023-11-15T01:37:25.414626+0000","last_became_peered":"2023-11-15T01:37:25.414626+0000","last_unstale":"2023-11-15T01:37:25.787960+0000","last_undegraded":"2023-11-15T01:37:25.787960+0000","last_fullsized":"2023-11-15T01:37:25.787960+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.822179+0000","last_change":"2023-11-15T01:37:25.817409+0000","last_active":"2023-11-15T01:37:25.822179+0000","last_peered":"2023-11-15T01:37:25.822179+0000","last_clean":"2023-11-15T01:37:25.822179+0000","last_became_active":"2023-11-15T01:37:25.817134+0000","last_became_peered":"2023-11-15T01:37:25.817134+0000","last_unstale":"2023-11-15T01:37:25.822179+0000","last_undegraded":"2023-11-15T01:37:25.822179+0000","last_fullsized":"2023-11-15T01:37:25.822179+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.792367+0000","last_change":"2023-11-15T01:37:25.418553+0000","last_active":"2023-11-15T01:37:25.792367+0000","last_peered":"2023-11-15T01:37:25.792367+0000","last_clean":"2023-11-15T01:37:25.792367+0000","last_became_active":"2023-11-15T01:37:25.418043+0000","last_became_peered":"2023-11-15T01:37:25.418043+0000","last_unstale":"2023-11-15T01:37:25.792367+0000","last_undegraded":"2023-11-15T01:37:25.792367+0000","last_fullsized":"2023-11-15T01:37:25.792367+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.818077+0000","last_change":"2023-11-15T01:37:25.816718+0000","last_active":"2023-11-15T01:37:25.818077+0000","last_peered":"2023-11-15T01:37:25.818077+0000","last_clean":"2023-11-15T01:37:25.818077+0000","last_became_active":"2023-11-15T01:37:25.816448+0000","last_became_peered":"2023-11-15T01:37:25.816448+0000","last_unstale":"2023-11-15T01:37:25.818077+0000","last_undegraded":"2023-11-15T01:37:25.818077+0000","last_fullsized":"2023-11-15T01:37:25.818077+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"108'4","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814744+0000","last_change":"2023-11-15T01:37:25.408759+0000","last_active":"2023-11-15T01:37:25.814744+0000","last_peered":"2023-11-15T01:37:25.814744+0000","last_clean":"2023-11-15T01:37:25.814744+0000","last_became_active":"2023-11-15T01:37:25.408461+0000","last_became_peered":"2023-11-15T01:37:25.408461+0000","last_unstale":"2023-11-15T01:37:25.814744+0000","last_undegraded":"2023-11-15T01:37:25.814744+0000","last_fullsized":"2023-11-15T01:37:25.814744+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812814+0000","last_change":"2023-11-15T01:37:25.806103+0000","last_active":"2023-11-15T01:37:25.812814+0000","last_peered":"2023-11-15T01:37:25.812814+0000","last_clean":"2023-11-15T01:37:25.812814+0000","last_became_active":"2023-11-15T01:37:25.805836+0000","last_became_peered":"2023-11-15T01:37:25.805836+0000","last_unstale":"2023-11-15T01:37:25.812814+0000","last_undegraded":"2023-11-15T01:37:25.812814+0000","last_fullsized":"2023-11-15T01:37:25.812814+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.802995+0000","last_change":"2023-11-15T01:37:25.409251+0000","last_active":"2023-11-15T01:37:25.802995+0000","last_peered":"2023-11-15T01:37:25.802995+0000","last_clean":"2023-11-15T01:37:25.802995+0000","last_became_active":"2023-11-15T01:37:25.408943+0000","last_became_peered":"2023-11-15T01:37:25.408943+0000","last_unstale":"2023-11-15T01:37:25.802995+0000","last_undegraded":"2023-11-15T01:37:25.802995+0000","last_fullsized":"2023-11-15T01:37:25.802995+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.822232+0000","last_change":"2023-11-15T01:37:25.818048+0000","last_active":"2023-11-15T01:37:25.822232+0000","last_peered":"2023-11-15T01:37:25.822232+0000","last_clean":"2023-11-15T01:37:25.822232+0000","last_became_active":"2023-11-15T01:37:25.817752+0000","last_became_peered":"2023-11-15T01:37:25.817752+0000","last_unstale":"2023-11-15T01:37:25.822232+0000","last_undegraded":"2023-11-15T01:37:25.822232+0000","last_fullsized":"2023-11-15T01:37:25.822232+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.788055+0000","last_change":"2023-11-15T01:37:25.408296+0000","last_active":"2023-11-15T01:37:25.788055+0000","last_peered":"2023-11-15T01:37:25.788055+0000","last_clean":"2023-11-15T01:37:25.788055+0000","last_became_active":"2023-11-15T01:37:25.408001+0000","last_became_peered":"2023-11-15T01:37:25.408001+0000","last_unstale":"2023-11-15T01:37:25.788055+0000","last_undegraded":"2023-11-15T01:37:25.788055+0000","last_fullsized":"2023-11-15T01:37:25.788055+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811519+0000","last_change":"2023-11-15T01:37:25.807821+0000","last_active":"2023-11-15T01:37:25.811519+0000","last_peered":"2023-11-15T01:37:25.811519+0000","last_clean":"2023-11-15T01:37:25.811519+0000","last_became_active":"2023-11-15T01:37:25.807548+0000","last_became_peered":"2023-11-15T01:37:25.807548+0000","last_unstale":"2023-11-15T01:37:25.811519+0000","last_undegraded":"2023-11-15T01:37:25.811519+0000","last_fullsized":"2023-11-15T01:37:25.811519+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807354+0000","last_change":"2023-11-15T01:37:25.415139+0000","last_active":"2023-11-15T01:37:25.807354+0000","last_peered":"2023-11-15T01:37:25.807354+0000","last_clean":"2023-11-15T01:37:25.807354+0000","last_became_active":"2023-11-15T01:37:25.414854+0000","last_became_peered":"2023-11-15T01:37:25.414854+0000","last_unstale":"2023-11-15T01:37:25.807354+0000","last_undegraded":"2023-11-15T01:37:25.807354+0000","last_fullsized":"2023-11-15T01:37:25.807354+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.809065+0000","last_change":"2023-11-15T01:37:25.803846+0000","last_active":"2023-11-15T01:37:25.809065+0000","last_peered":"2023-11-15T01:37:25.809065+0000","last_clean":"2023-11-15T01:37:25.809065+0000","last_became_active":"2023-11-15T01:37:25.803576+0000","last_became_peered":"2023-11-15T01:37:25.803576+0000","last_unstale":"2023-11-15T01:37:25.809065+0000","last_undegraded":"2023-11-15T01:37:25.809065+0000","last_fullsized":"2023-11-15T01:37:25.809065+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.788680+0000","last_change":"2023-11-15T01:37:25.411892+0000","last_active":"2023-11-15T01:37:25.788680+0000","last_peered":"2023-11-15T01:37:25.788680+0000","last_clean":"2023-11-15T01:37:25.788680+0000","last_became_active":"2023-11-15T01:37:25.411598+0000","last_became_peered":"2023-11-15T01:37:25.411598+0000","last_unstale":"2023-11-15T01:37:25.788680+0000","last_undegraded":"2023-11-15T01:37:25.788680+0000","last_fullsized":"2023-11-15T01:37:25.788680+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801483+0000","last_change":"2023-11-15T01:37:25.798574+0000","last_active":"2023-11-15T01:37:25.801483+0000","last_peered":"2023-11-15T01:37:25.801483+0000","last_clean":"2023-11-15T01:37:25.801483+0000","last_became_active":"2023-11-15T01:37:25.798289+0000","last_became_peered":"2023-11-15T01:37:25.798289+0000","last_unstale":"2023-11-15T01:37:25.801483+0000","last_undegraded":"2023-11-15T01:37:25.801483+0000","last_fullsized":"2023-11-15T01:37:25.801483+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798969+0000","last_change":"2023-11-15T01:37:25.411973+0000","last_active":"2023-11-15T01:37:25.798969+0000","last_peered":"2023-11-15T01:37:25.798969+0000","last_clean":"2023-11-15T01:37:25.798969+0000","last_became_active":"2023-11-15T01:37:25.411664+0000","last_became_peered":"2023-11-15T01:37:25.411664+0000","last_unstale":"2023-11-15T01:37:25.798969+0000","last_undegraded":"2023-11-15T01:37:25.798969+0000","last_fullsized":"2023-11-15T01:37:25.798969+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819072+0000","last_change":"2023-11-15T01:37:25.813328+0000","last_active":"2023-11-15T01:37:25.819072+0000","last_peered":"2023-11-15T01:37:25.819072+0000","last_clean":"2023-11-15T01:37:25.819072+0000","last_became_active":"2023-11-15T01:37:25.813035+0000","last_became_peered":"2023-11-15T01:37:25.813035+0000","last_unstale":"2023-11-15T01:37:25.819072+0000","last_undegraded":"2023-11-15T01:37:25.819072+0000","last_fullsized":"2023-11-15T01:37:25.819072+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801598+0000","last_change":"2023-11-15T01:37:25.422486+0000","last_active":"2023-11-15T01:37:25.801598+0000","last_peered":"2023-11-15T01:37:25.801598+0000","last_clean":"2023-11-15T01:37:25.801598+0000","last_became_active":"2023-11-15T01:37:25.421987+0000","last_became_peered":"2023-11-15T01:37:25.421987+0000","last_unstale":"2023-11-15T01:37:25.801598+0000","last_undegraded":"2023-11-15T01:37:25.801598+0000","last_fullsized":"2023-11-15T01:37:25.801598+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812169+0000","last_change":"2023-11-15T01:37:25.803837+0000","last_active":"2023-11-15T01:37:25.812169+0000","last_peered":"2023-11-15T01:37:25.812169+0000","last_clean":"2023-11-15T01:37:25.812169+0000","last_became_active":"2023-11-15T01:37:25.803555+0000","last_became_peered":"2023-11-15T01:37:25.803555+0000","last_unstale":"2023-11-15T01:37:25.812169+0000","last_undegraded":"2023-11-15T01:37:25.812169+0000","last_fullsized":"2023-11-15T01:37:25.812169+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.797162+0000","last_change":"2023-11-15T01:37:25.415462+0000","last_active":"2023-11-15T01:37:25.797162+0000","last_peered":"2023-11-15T01:37:25.797162+0000","last_clean":"2023-11-15T01:37:25.797162+0000","last_became_active":"2023-11-15T01:37:25.415190+0000","last_became_peered":"2023-11-15T01:37:25.415190+0000","last_unstale":"2023-11-15T01:37:25.797162+0000","last_undegraded":"2023-11-15T01:37:25.797162+0000","last_fullsized":"2023-11-15T01:37:25.797162+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813281+0000","last_change":"2023-11-15T01:37:25.806746+0000","last_active":"2023-11-15T01:37:25.813281+0000","last_peered":"2023-11-15T01:37:25.813281+0000","last_clean":"2023-11-15T01:37:25.813281+0000","last_became_active":"2023-11-15T01:37:25.806466+0000","last_became_peered":"2023-11-15T01:37:25.806466+0000","last_unstale":"2023-11-15T01:37:25.813281+0000","last_undegraded":"2023-11-15T01:37:25.813281+0000","last_fullsized":"2023-11-15T01:37:25.813281+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.787515+0000","last_change":"2023-11-15T01:37:25.412836+0000","last_active":"2023-11-15T01:37:25.787515+0000","last_peered":"2023-11-15T01:37:25.787515+0000","last_clean":"2023-11-15T01:37:25.787515+0000","last_became_active":"2023-11-15T01:37:25.412175+0000","last_became_peered":"2023-11-15T01:37:25.412175+0000","last_unstale":"2023-11-15T01:37:25.787515+0000","last_undegraded":"2023-11-15T01:37:25.787515+0000","last_fullsized":"2023-11-15T01:37:25.787515+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813143+0000","last_change":"2023-11-15T01:37:25.809933+0000","last_active":"2023-11-15T01:37:25.813143+0000","last_peered":"2023-11-15T01:37:25.813143+0000","last_clean":"2023-11-15T01:37:25.813143+0000","last_became_active":"2023-11-15T01:37:25.809264+0000","last_became_peered":"2023-11-15T01:37:25.809264+0000","last_unstale":"2023-11-15T01:37:25.813143+0000","last_undegraded":"2023-11-15T01:37:25.813143+0000","last_fullsized":"2023-11-15T01:37:25.813143+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.804839+0000","last_change":"2023-11-15T01:37:25.419579+0000","last_active":"2023-11-15T01:37:25.804839+0000","last_peered":"2023-11-15T01:37:25.804839+0000","last_clean":"2023-11-15T01:37:25.804839+0000","last_became_active":"2023-11-15T01:37:25.419265+0000","last_became_peered":"2023-11-15T01:37:25.419265+0000","last_unstale":"2023-11-15T01:37:25.804839+0000","last_undegraded":"2023-11-15T01:37:25.804839+0000","last_fullsized":"2023-11-15T01:37:25.804839+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811811+0000","last_change":"2023-11-15T01:37:25.807257+0000","last_active":"2023-11-15T01:37:25.811811+0000","last_peered":"2023-11-15T01:37:25.811811+0000","last_clean":"2023-11-15T01:37:25.811811+0000","last_became_active":"2023-11-15T01:37:25.806982+0000","last_became_peered":"2023-11-15T01:37:25.806982+0000","last_unstale":"2023-11-15T01:37:25.811811+0000","last_undegraded":"2023-11-15T01:37:25.811811+0000","last_fullsized":"2023-11-15T01:37:25.811811+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"109'1","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-15T01:37:26.924045+0000","last_change":"2023-11-15T01:37:25.422421+0000","last_active":"2023-11-15T01:37:26.924045+0000","last_peered":"2023-11-15T01:37:26.924045+0000","last_clean":"2023-11-15T01:37:26.924045+0000","last_became_active":"2023-11-15T01:37:25.422115+0000","last_became_peered":"2023-11-15T01:37:25.422115+0000","last_unstale":"2023-11-15T01:37:26.924045+0000","last_undegraded":"2023-11-15T01:37:26.924045+0000","last_fullsized":"2023-11-15T01:37:26.924045+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.822215+0000","last_change":"2023-11-15T01:37:25.818001+0000","last_active":"2023-11-15T01:37:25.822215+0000","last_peered":"2023-11-15T01:37:25.822215+0000","last_clean":"2023-11-15T01:37:25.822215+0000","last_became_active":"2023-11-15T01:37:25.817735+0000","last_became_peered":"2023-11-15T01:37:25.817735+0000","last_unstale":"2023-11-15T01:37:25.822215+0000","last_undegraded":"2023-11-15T01:37:25.822215+0000","last_fullsized":"2023-11-15T01:37:25.822215+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801808+0000","last_change":"2023-11-15T01:37:25.412803+0000","last_active":"2023-11-15T01:37:25.801808+0000","last_peered":"2023-11-15T01:37:25.801808+0000","last_clean":"2023-11-15T01:37:25.801808+0000","last_became_active":"2023-11-15T01:37:25.412197+0000","last_became_peered":"2023-11-15T01:37:25.412197+0000","last_unstale":"2023-11-15T01:37:25.801808+0000","last_undegraded":"2023-11-15T01:37:25.801808+0000","last_fullsized":"2023-11-15T01:37:25.801808+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819287+0000","last_change":"2023-11-15T01:37:25.815673+0000","last_active":"2023-11-15T01:37:25.819287+0000","last_peered":"2023-11-15T01:37:25.819287+0000","last_clean":"2023-11-15T01:37:25.819287+0000","last_became_active":"2023-11-15T01:37:25.815450+0000","last_became_peered":"2023-11-15T01:37:25.815450+0000","last_unstale":"2023-11-15T01:37:25.819287+0000","last_undegraded":"2023-11-15T01:37:25.819287+0000","last_fullsized":"2023-11-15T01:37:25.819287+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798506+0000","last_change":"2023-11-15T01:37:25.407768+0000","last_active":"2023-11-15T01:37:25.798506+0000","last_peered":"2023-11-15T01:37:25.798506+0000","last_clean":"2023-11-15T01:37:25.798506+0000","last_became_active":"2023-11-15T01:37:25.407475+0000","last_became_peered":"2023-11-15T01:37:25.407475+0000","last_unstale":"2023-11-15T01:37:25.798506+0000","last_undegraded":"2023-11-15T01:37:25.798506+0000","last_fullsized":"2023-11-15T01:37:25.798506+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803880+0000","last_change":"2023-11-15T01:37:25.799740+0000","last_active":"2023-11-15T01:37:25.803880+0000","last_peered":"2023-11-15T01:37:25.803880+0000","last_clean":"2023-11-15T01:37:25.803880+0000","last_became_active":"2023-11-15T01:37:25.799413+0000","last_became_peered":"2023-11-15T01:37:25.799413+0000","last_unstale":"2023-11-15T01:37:25.803880+0000","last_undegraded":"2023-11-15T01:37:25.803880+0000","last_fullsized":"2023-11-15T01:37:25.803880+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803199+0000","last_change":"2023-11-15T01:37:25.419492+0000","last_active":"2023-11-15T01:37:25.803199+0000","last_peered":"2023-11-15T01:37:25.803199+0000","last_clean":"2023-11-15T01:37:25.803199+0000","last_became_active":"2023-11-15T01:37:25.419164+0000","last_became_peered":"2023-11-15T01:37:25.419164+0000","last_unstale":"2023-11-15T01:37:25.803199+0000","last_undegraded":"2023-11-15T01:37:25.803199+0000","last_fullsized":"2023-11-15T01:37:25.803199+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.816913+0000","last_change":"2023-11-15T01:37:25.807456+0000","last_active":"2023-11-15T01:37:25.816913+0000","last_peered":"2023-11-15T01:37:25.816913+0000","last_clean":"2023-11-15T01:37:25.816913+0000","last_became_active":"2023-11-15T01:37:25.807080+0000","last_became_peered":"2023-11-15T01:37:25.807080+0000","last_unstale":"2023-11-15T01:37:25.816913+0000","last_undegraded":"2023-11-15T01:37:25.816913+0000","last_fullsized":"2023-11-15T01:37:25.816913+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801698+0000","last_change":"2023-11-15T01:37:25.422722+0000","last_active":"2023-11-15T01:37:25.801698+0000","last_peered":"2023-11-15T01:37:25.801698+0000","last_clean":"2023-11-15T01:37:25.801698+0000","last_became_active":"2023-11-15T01:37:25.422418+0000","last_became_peered":"2023-11-15T01:37:25.422418+0000","last_unstale":"2023-11-15T01:37:25.801698+0000","last_undegraded":"2023-11-15T01:37:25.801698+0000","last_fullsized":"2023-11-15T01:37:25.801698+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813458+0000","last_change":"2023-11-15T01:37:25.809142+0000","last_active":"2023-11-15T01:37:25.813458+0000","last_peered":"2023-11-15T01:37:25.813458+0000","last_clean":"2023-11-15T01:37:25.813458+0000","last_became_active":"2023-11-15T01:37:25.808816+0000","last_became_peered":"2023-11-15T01:37:25.808816+0000","last_unstale":"2023-11-15T01:37:25.813458+0000","last_undegraded":"2023-11-15T01:37:25.813458+0000","last_fullsized":"2023-11-15T01:37:25.813458+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.799876+0000","last_change":"2023-11-15T01:37:25.411372+0000","last_active":"2023-11-15T01:37:25.799876+0000","last_peered":"2023-11-15T01:37:25.799876+0000","last_clean":"2023-11-15T01:37:25.799876+0000","last_became_active":"2023-11-15T01:37:25.411048+0000","last_became_peered":"2023-11-15T01:37:25.411048+0000","last_unstale":"2023-11-15T01:37:25.799876+0000","last_undegraded":"2023-11-15T01:37:25.799876+0000","last_fullsized":"2023-11-15T01:37:25.799876+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.817368+0000","last_change":"2023-11-15T01:37:25.815100+0000","last_active":"2023-11-15T01:37:25.817368+0000","last_peered":"2023-11-15T01:37:25.817368+0000","last_clean":"2023-11-15T01:37:25.817368+0000","last_became_active":"2023-11-15T01:37:25.812371+0000","last_became_peered":"2023-11-15T01:37:25.812371+0000","last_unstale":"2023-11-15T01:37:25.817368+0000","last_undegraded":"2023-11-15T01:37:25.817368+0000","last_fullsized":"2023-11-15T01:37:25.817368+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.795484+0000","last_change":"2023-11-15T01:37:25.413924+0000","last_active":"2023-11-15T01:37:25.795484+0000","last_peered":"2023-11-15T01:37:25.795484+0000","last_clean":"2023-11-15T01:37:25.795484+0000","last_became_active":"2023-11-15T01:37:25.413648+0000","last_became_peered":"2023-11-15T01:37:25.413648+0000","last_unstale":"2023-11-15T01:37:25.795484+0000","last_undegraded":"2023-11-15T01:37:25.795484+0000","last_fullsized":"2023-11-15T01:37:25.795484+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819673+0000","last_change":"2023-11-15T01:37:25.808310+0000","last_active":"2023-11-15T01:37:25.819673+0000","last_peered":"2023-11-15T01:37:25.819673+0000","last_clean":"2023-11-15T01:37:25.819673+0000","last_became_active":"2023-11-15T01:37:25.808023+0000","last_became_peered":"2023-11-15T01:37:25.808023+0000","last_unstale":"2023-11-15T01:37:25.819673+0000","last_undegraded":"2023-11-15T01:37:25.819673+0000","last_fullsized":"2023-11-15T01:37:25.819673+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814509+0000","last_change":"2023-11-15T01:37:25.414235+0000","last_active":"2023-11-15T01:37:25.814509+0000","last_peered":"2023-11-15T01:37:25.814509+0000","last_clean":"2023-11-15T01:37:25.814509+0000","last_became_active":"2023-11-15T01:37:25.413369+0000","last_became_peered":"2023-11-15T01:37:25.413369+0000","last_unstale":"2023-11-15T01:37:25.814509+0000","last_undegraded":"2023-11-15T01:37:25.814509+0000","last_fullsized":"2023-11-15T01:37:25.814509+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.804906+0000","last_change":"2023-11-15T01:37:25.800425+0000","last_active":"2023-11-15T01:37:25.804906+0000","last_peered":"2023-11-15T01:37:25.804906+0000","last_clean":"2023-11-15T01:37:25.804906+0000","last_became_active":"2023-11-15T01:37:25.800126+0000","last_became_peered":"2023-11-15T01:37:25.800126+0000","last_unstale":"2023-11-15T01:37:25.804906+0000","last_undegraded":"2023-11-15T01:37:25.804906+0000","last_fullsized":"2023-11-15T01:37:25.804906+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814639+0000","last_change":"2023-11-15T01:37:25.409824+0000","last_active":"2023-11-15T01:37:25.814639+0000","last_peered":"2023-11-15T01:37:25.814639+0000","last_clean":"2023-11-15T01:37:25.814639+0000","last_became_active":"2023-11-15T01:37:25.408888+0000","last_became_peered":"2023-11-15T01:37:25.408888+0000","last_unstale":"2023-11-15T01:37:25.814639+0000","last_undegraded":"2023-11-15T01:37:25.814639+0000","last_fullsized":"2023-11-15T01:37:25.814639+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819124+0000","last_change":"2023-11-15T01:37:25.815870+0000","last_active":"2023-11-15T01:37:25.819124+0000","last_peered":"2023-11-15T01:37:25.819124+0000","last_clean":"2023-11-15T01:37:25.819124+0000","last_became_active":"2023-11-15T01:37:25.815610+0000","last_became_peered":"2023-11-15T01:37:25.815610+0000","last_unstale":"2023-11-15T01:37:25.819124+0000","last_undegraded":"2023-11-15T01:37:25.819124+0000","last_fullsized":"2023-11-15T01:37:25.819124+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.815892+0000","last_change":"2023-11-15T01:37:25.419445+0000","last_active":"2023-11-15T01:37:25.815892+0000","last_peered":"2023-11-15T01:37:25.815892+0000","last_clean":"2023-11-15T01:37:25.815892+0000","last_became_active":"2023-11-15T01:37:25.419103+0000","last_became_peered":"2023-11-15T01:37:25.419103+0000","last_unstale":"2023-11-15T01:37:25.815892+0000","last_undegraded":"2023-11-15T01:37:25.815892+0000","last_fullsized":"2023-11-15T01:37:25.815892+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819805+0000","last_change":"2023-11-15T01:37:25.815047+0000","last_active":"2023-11-15T01:37:25.819805+0000","last_peered":"2023-11-15T01:37:25.819805+0000","last_clean":"2023-11-15T01:37:25.819805+0000","last_became_active":"2023-11-15T01:37:25.814763+0000","last_became_peered":"2023-11-15T01:37:25.814763+0000","last_unstale":"2023-11-15T01:37:25.819805+0000","last_undegraded":"2023-11-15T01:37:25.819805+0000","last_fullsized":"2023-11-15T01:37:25.819805+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798392+0000","last_change":"2023-11-15T01:37:25.416138+0000","last_active":"2023-11-15T01:37:25.798392+0000","last_peered":"2023-11-15T01:37:25.798392+0000","last_clean":"2023-11-15T01:37:25.798392+0000","last_became_active":"2023-11-15T01:37:25.415835+0000","last_became_peered":"2023-11-15T01:37:25.415835+0000","last_unstale":"2023-11-15T01:37:25.798392+0000","last_undegraded":"2023-11-15T01:37:25.798392+0000","last_fullsized":"2023-11-15T01:37:25.798392+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812456+0000","last_change":"2023-11-15T01:37:25.801486+0000","last_active":"2023-11-15T01:37:25.812456+0000","last_peered":"2023-11-15T01:37:25.812456+0000","last_clean":"2023-11-15T01:37:25.812456+0000","last_became_active":"2023-11-15T01:37:25.801217+0000","last_became_peered":"2023-11-15T01:37:25.801217+0000","last_unstale":"2023-11-15T01:37:25.812456+0000","last_undegraded":"2023-11-15T01:37:25.812456+0000","last_fullsized":"2023-11-15T01:37:25.812456+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803447+0000","last_change":"2023-11-15T01:37:25.413617+0000","last_active":"2023-11-15T01:37:25.803447+0000","last_peered":"2023-11-15T01:37:25.803447+0000","last_clean":"2023-11-15T01:37:25.803447+0000","last_became_active":"2023-11-15T01:37:25.413326+0000","last_became_peered":"2023-11-15T01:37:25.413326+0000","last_unstale":"2023-11-15T01:37:25.803447+0000","last_undegraded":"2023-11-15T01:37:25.803447+0000","last_fullsized":"2023-11-15T01:37:25.803447+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814422+0000","last_change":"2023-11-15T01:37:25.806496+0000","last_active":"2023-11-15T01:37:25.814422+0000","last_peered":"2023-11-15T01:37:25.814422+0000","last_clean":"2023-11-15T01:37:25.814422+0000","last_became_active":"2023-11-15T01:37:25.806193+0000","last_became_peered":"2023-11-15T01:37:25.806193+0000","last_unstale":"2023-11-15T01:37:25.814422+0000","last_undegraded":"2023-11-15T01:37:25.814422+0000","last_fullsized":"2023-11-15T01:37:25.814422+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801797+0000","last_change":"2023-11-15T01:37:25.422680+0000","last_active":"2023-11-15T01:37:25.801797+0000","last_peered":"2023-11-15T01:37:25.801797+0000","last_clean":"2023-11-15T01:37:25.801797+0000","last_became_active":"2023-11-15T01:37:25.422182+0000","last_became_peered":"2023-11-15T01:37:25.422182+0000","last_unstale":"2023-11-15T01:37:25.801797+0000","last_undegraded":"2023-11-15T01:37:25.801797+0000","last_fullsized":"2023-11-15T01:37:25.801797+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.817528+0000","last_change":"2023-11-15T01:37:25.805736+0000","last_active":"2023-11-15T01:37:25.817528+0000","last_peered":"2023-11-15T01:37:25.817528+0000","last_clean":"2023-11-15T01:37:25.817528+0000","last_became_active":"2023-11-15T01:37:25.805466+0000","last_became_peered":"2023-11-15T01:37:25.805466+0000","last_unstale":"2023-11-15T01:37:25.817528+0000","last_undegraded":"2023-11-15T01:37:25.817528+0000","last_fullsized":"2023-11-15T01:37:25.817528+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.792467+0000","last_change":"2023-11-15T01:37:25.418329+0000","last_active":"2023-11-15T01:37:25.792467+0000","last_peered":"2023-11-15T01:37:25.792467+0000","last_clean":"2023-11-15T01:37:25.792467+0000","last_became_active":"2023-11-15T01:37:25.417999+0000","last_became_peered":"2023-11-15T01:37:25.417999+0000","last_unstale":"2023-11-15T01:37:25.792467+0000","last_undegraded":"2023-11-15T01:37:25.792467+0000","last_fullsized":"2023-11-15T01:37:25.792467+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813033+0000","last_change":"2023-11-15T01:37:25.807469+0000","last_active":"2023-11-15T01:37:25.813033+0000","last_peered":"2023-11-15T01:37:25.813033+0000","last_clean":"2023-11-15T01:37:25.813033+0000","last_became_active":"2023-11-15T01:37:25.807202+0000","last_became_peered":"2023-11-15T01:37:25.807202+0000","last_unstale":"2023-11-15T01:37:25.813033+0000","last_undegraded":"2023-11-15T01:37:25.813033+0000","last_fullsized":"2023-11-15T01:37:25.813033+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801552+0000","last_change":"2023-11-15T01:37:25.416493+0000","last_active":"2023-11-15T01:37:25.801552+0000","last_peered":"2023-11-15T01:37:25.801552+0000","last_clean":"2023-11-15T01:37:25.801552+0000","last_became_active":"2023-11-15T01:37:25.416156+0000","last_became_peered":"2023-11-15T01:37:25.416156+0000","last_unstale":"2023-11-15T01:37:25.801552+0000","last_undegraded":"2023-11-15T01:37:25.801552+0000","last_fullsized":"2023-11-15T01:37:25.801552+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813363+0000","last_change":"2023-11-15T01:37:25.807158+0000","last_active":"2023-11-15T01:37:25.813363+0000","last_peered":"2023-11-15T01:37:25.813363+0000","last_clean":"2023-11-15T01:37:25.813363+0000","last_became_active":"2023-11-15T01:37:25.804197+0000","last_became_peered":"2023-11-15T01:37:25.804197+0000","last_unstale":"2023-11-15T01:37:25.813363+0000","last_undegraded":"2023-11-15T01:37:25.813363+0000","last_fullsized":"2023-11-15T01:37:25.813363+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807648+0000","last_change":"2023-11-15T01:37:25.415719+0000","last_active":"2023-11-15T01:37:25.807648+0000","last_peered":"2023-11-15T01:37:25.807648+0000","last_clean":"2023-11-15T01:37:25.807648+0000","last_became_active":"2023-11-15T01:37:25.414403+0000","last_became_peered":"2023-11-15T01:37:25.414403+0000","last_unstale":"2023-11-15T01:37:25.807648+0000","last_undegraded":"2023-11-15T01:37:25.807648+0000","last_fullsized":"2023-11-15T01:37:25.807648+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.815961+0000","last_change":"2023-11-15T01:37:25.810768+0000","last_active":"2023-11-15T01:37:25.815961+0000","last_peered":"2023-11-15T01:37:25.815961+0000","last_clean":"2023-11-15T01:37:25.815961+0000","last_became_active":"2023-11-15T01:37:25.810322+0000","last_became_peered":"2023-11-15T01:37:25.810322+0000","last_unstale":"2023-11-15T01:37:25.815961+0000","last_undegraded":"2023-11-15T01:37:25.815961+0000","last_fullsized":"2023-11-15T01:37:25.815961+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.791388+0000","last_change":"2023-11-15T01:37:25.414123+0000","last_active":"2023-11-15T01:37:25.791388+0000","last_peered":"2023-11-15T01:37:25.791388+0000","last_clean":"2023-11-15T01:37:25.791388+0000","last_became_active":"2023-11-15T01:37:25.413793+0000","last_became_peered":"2023-11-15T01:37:25.413793+0000","last_unstale":"2023-11-15T01:37:25.791388+0000","last_undegraded":"2023-11-15T01:37:25.791388+0000","last_fullsized":"2023-11-15T01:37:25.791388+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813077+0000","last_change":"2023-11-15T01:37:25.810101+0000","last_active":"2023-11-15T01:37:25.813077+0000","last_peered":"2023-11-15T01:37:25.813077+0000","last_clean":"2023-11-15T01:37:25.813077+0000","last_became_active":"2023-11-15T01:37:25.809845+0000","last_became_peered":"2023-11-15T01:37:25.809845+0000","last_unstale":"2023-11-15T01:37:25.813077+0000","last_undegraded":"2023-11-15T01:37:25.813077+0000","last_fullsized":"2023-11-15T01:37:25.813077+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"108'3","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819993+0000","last_change":"2023-11-15T01:37:25.412490+0000","last_active":"2023-11-15T01:37:25.819993+0000","last_peered":"2023-11-15T01:37:25.819993+0000","last_clean":"2023-11-15T01:37:25.819993+0000","last_became_active":"2023-11-15T01:37:25.411493+0000","last_became_peered":"2023-11-15T01:37:25.411493+0000","last_unstale":"2023-11-15T01:37:25.819993+0000","last_undegraded":"2023-11-15T01:37:25.819993+0000","last_fullsized":"2023-11-15T01:37:25.819993+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813120+0000","last_change":"2023-11-15T01:37:25.809185+0000","last_active":"2023-11-15T01:37:25.813120+0000","last_peered":"2023-11-15T01:37:25.813120+0000","last_clean":"2023-11-15T01:37:25.813120+0000","last_became_active":"2023-11-15T01:37:25.808906+0000","last_became_peered":"2023-11-15T01:37:25.808906+0000","last_unstale":"2023-11-15T01:37:25.813120+0000","last_undegraded":"2023-11-15T01:37:25.813120+0000","last_fullsized":"2023-11-15T01:37:25.813120+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814808+0000","last_change":"2023-11-15T01:37:25.404139+0000","last_active":"2023-11-15T01:37:25.814808+0000","last_peered":"2023-11-15T01:37:25.814808+0000","last_clean":"2023-11-15T01:37:25.814808+0000","last_became_active":"2023-11-15T01:37:25.403845+0000","last_became_peered":"2023-11-15T01:37:25.403845+0000","last_unstale":"2023-11-15T01:37:25.814808+0000","last_undegraded":"2023-11-15T01:37:25.814808+0000","last_fullsized":"2023-11-15T01:37:25.814808+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.818199+0000","last_change":"2023-11-15T01:37:25.816681+0000","last_active":"2023-11-15T01:37:25.818199+0000","last_peered":"2023-11-15T01:37:25.818199+0000","last_clean":"2023-11-15T01:37:25.818199+0000","last_became_active":"2023-11-15T01:37:25.816348+0000","last_became_peered":"2023-11-15T01:37:25.816348+0000","last_unstale":"2023-11-15T01:37:25.818199+0000","last_undegraded":"2023-11-15T01:37:25.818199+0000","last_fullsized":"2023-11-15T01:37:25.818199+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819997+0000","last_change":"2023-11-15T01:37:25.416428+0000","last_active":"2023-11-15T01:37:25.819997+0000","last_peered":"2023-11-15T01:37:25.819997+0000","last_clean":"2023-11-15T01:37:25.819997+0000","last_became_active":"2023-11-15T01:37:25.416125+0000","last_became_peered":"2023-11-15T01:37:25.416125+0000","last_unstale":"2023-11-15T01:37:25.819997+0000","last_undegraded":"2023-11-15T01:37:25.819997+0000","last_fullsized":"2023-11-15T01:37:25.819997+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813355+0000","last_change":"2023-11-15T01:37:25.807841+0000","last_active":"2023-11-15T01:37:25.813355+0000","last_peered":"2023-11-15T01:37:25.813355+0000","last_clean":"2023-11-15T01:37:25.813355+0000","last_became_active":"2023-11-15T01:37:25.807533+0000","last_became_peered":"2023-11-15T01:37:25.807533+0000","last_unstale":"2023-11-15T01:37:25.813355+0000","last_undegraded":"2023-11-15T01:37:25.813355+0000","last_fullsized":"2023-11-15T01:37:25.813355+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798340+0000","last_change":"2023-11-15T01:37:25.405232+0000","last_active":"2023-11-15T01:37:25.798340+0000","last_peered":"2023-11-15T01:37:25.798340+0000","last_clean":"2023-11-15T01:37:25.798340+0000","last_became_active":"2023-11-15T01:37:25.404955+0000","last_became_peered":"2023-11-15T01:37:25.404955+0000","last_unstale":"2023-11-15T01:37:25.798340+0000","last_undegraded":"2023-11-15T01:37:25.798340+0000","last_fullsized":"2023-11-15T01:37:25.798340+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807683+0000","last_change":"2023-11-15T01:37:25.796369+0000","last_active":"2023-11-15T01:37:25.807683+0000","last_peered":"2023-11-15T01:37:25.807683+0000","last_clean":"2023-11-15T01:37:25.807683+0000","last_became_active":"2023-11-15T01:37:25.796095+0000","last_became_peered":"2023-11-15T01:37:25.796095+0000","last_unstale":"2023-11-15T01:37:25.807683+0000","last_undegraded":"2023-11-15T01:37:25.807683+0000","last_fullsized":"2023-11-15T01:37:25.807683+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.796007+0000","last_change":"2023-11-15T01:37:25.419012+0000","last_active":"2023-11-15T01:37:25.796007+0000","last_peered":"2023-11-15T01:37:25.796007+0000","last_clean":"2023-11-15T01:37:25.796007+0000","last_became_active":"2023-11-15T01:37:25.418723+0000","last_became_peered":"2023-11-15T01:37:25.418723+0000","last_unstale":"2023-11-15T01:37:25.796007+0000","last_undegraded":"2023-11-15T01:37:25.796007+0000","last_fullsized":"2023-11-15T01:37:25.796007+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811901+0000","last_change":"2023-11-15T01:37:25.807654+0000","last_active":"2023-11-15T01:37:25.811901+0000","last_peered":"2023-11-15T01:37:25.811901+0000","last_clean":"2023-11-15T01:37:25.811901+0000","last_became_active":"2023-11-15T01:37:25.807383+0000","last_became_peered":"2023-11-15T01:37:25.807383+0000","last_unstale":"2023-11-15T01:37:25.811901+0000","last_undegraded":"2023-11-15T01:37:25.811901+0000","last_fullsized":"2023-11-15T01:37:25.811901+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"108'4","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812373+0000","last_change":"2023-11-15T01:37:25.422349+0000","last_active":"2023-11-15T01:37:25.812373+0000","last_peered":"2023-11-15T01:37:25.812373+0000","last_clean":"2023-11-15T01:37:25.812373+0000","last_became_active":"2023-11-15T01:37:25.422074+0000","last_became_peered":"2023-11-15T01:37:25.422074+0000","last_unstale":"2023-11-15T01:37:25.812373+0000","last_undegraded":"2023-11-15T01:37:25.812373+0000","last_fullsized":"2023-11-15T01:37:25.812373+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814405+0000","last_change":"2023-11-15T01:37:25.810986+0000","last_active":"2023-11-15T01:37:25.814405+0000","last_peered":"2023-11-15T01:37:25.814405+0000","last_clean":"2023-11-15T01:37:25.814405+0000","last_became_active":"2023-11-15T01:37:25.810693+0000","last_became_peered":"2023-11-15T01:37:25.810693+0000","last_unstale":"2023-11-15T01:37:25.814405+0000","last_undegraded":"2023-11-15T01:37:25.814405+0000","last_fullsized":"2023-11-15T01:37:25.814405+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.815114+0000","last_change":"2023-11-15T01:37:25.419780+0000","last_active":"2023-11-15T01:37:25.815114+0000","last_peered":"2023-11-15T01:37:25.815114+0000","last_clean":"2023-11-15T01:37:25.815114+0000","last_became_active":"2023-11-15T01:37:25.419483+0000","last_became_peered":"2023-11-15T01:37:25.419483+0000","last_unstale":"2023-11-15T01:37:25.815114+0000","last_undegraded":"2023-11-15T01:37:25.815114+0000","last_fullsized":"2023-11-15T01:37:25.815114+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819603+0000","last_change":"2023-11-15T01:37:25.807318+0000","last_active":"2023-11-15T01:37:25.819603+0000","last_peered":"2023-11-15T01:37:25.819603+0000","last_clean":"2023-11-15T01:37:25.819603+0000","last_became_active":"2023-11-15T01:37:25.807040+0000","last_became_peered":"2023-11-15T01:37:25.807040+0000","last_unstale":"2023-11-15T01:37:25.819603+0000","last_undegraded":"2023-11-15T01:37:25.819603+0000","last_fullsized":"2023-11-15T01:37:25.819603+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803767+0000","last_change":"2023-11-15T01:37:25.415380+0000","last_active":"2023-11-15T01:37:25.803767+0000","last_peered":"2023-11-15T01:37:25.803767+0000","last_clean":"2023-11-15T01:37:25.803767+0000","last_became_active":"2023-11-15T01:37:25.415095+0000","last_became_peered":"2023-11-15T01:37:25.415095+0000","last_unstale":"2023-11-15T01:37:25.803767+0000","last_undegraded":"2023-11-15T01:37:25.803767+0000","last_fullsized":"2023-11-15T01:37:25.803767+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807536+0000","last_change":"2023-11-15T01:37:25.803469+0000","last_active":"2023-11-15T01:37:25.807536+0000","last_peered":"2023-11-15T01:37:25.807536+0000","last_clean":"2023-11-15T01:37:25.807536+0000","last_became_active":"2023-11-15T01:37:25.803181+0000","last_became_peered":"2023-11-15T01:37:25.803181+0000","last_unstale":"2023-11-15T01:37:25.807536+0000","last_undegraded":"2023-11-15T01:37:25.807536+0000","last_fullsized":"2023-11-15T01:37:25.807536+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801457+0000","last_change":"2023-11-15T01:37:25.412639+0000","last_active":"2023-11-15T01:37:25.801457+0000","last_peered":"2023-11-15T01:37:25.801457+0000","last_clean":"2023-11-15T01:37:25.801457+0000","last_became_active":"2023-11-15T01:37:25.411867+0000","last_became_peered":"2023-11-15T01:37:25.411867+0000","last_unstale":"2023-11-15T01:37:25.801457+0000","last_undegraded":"2023-11-15T01:37:25.801457+0000","last_fullsized":"2023-11-15T01:37:25.801457+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.816802+0000","last_change":"2023-11-15T01:37:25.808140+0000","last_active":"2023-11-15T01:37:25.816802+0000","last_peered":"2023-11-15T01:37:25.816802+0000","last_clean":"2023-11-15T01:37:25.816802+0000","last_became_active":"2023-11-15T01:37:25.807819+0000","last_became_peered":"2023-11-15T01:37:25.807819+0000","last_unstale":"2023-11-15T01:37:25.816802+0000","last_undegraded":"2023-11-15T01:37:25.816802+0000","last_fullsized":"2023-11-15T01:37:25.816802+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798292+0000","last_change":"2023-11-15T01:37:25.409692+0000","last_active":"2023-11-15T01:37:25.798292+0000","last_peered":"2023-11-15T01:37:25.798292+0000","last_clean":"2023-11-15T01:37:25.798292+0000","last_became_active":"2023-11-15T01:37:25.409430+0000","last_became_peered":"2023-11-15T01:37:25.409430+0000","last_unstale":"2023-11-15T01:37:25.798292+0000","last_undegraded":"2023-11-15T01:37:25.798292+0000","last_fullsized":"2023-11-15T01:37:25.798292+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811684+0000","last_change":"2023-11-15T01:37:25.805180+0000","last_active":"2023-11-15T01:37:25.811684+0000","last_peered":"2023-11-15T01:37:25.811684+0000","last_clean":"2023-11-15T01:37:25.811684+0000","last_became_active":"2023-11-15T01:37:25.804916+0000","last_became_peered":"2023-11-15T01:37:25.804916+0000","last_unstale":"2023-11-15T01:37:25.811684+0000","last_undegraded":"2023-11-15T01:37:25.811684+0000","last_fullsized":"2023-11-15T01:37:25.811684+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.798571+0000","last_change":"2023-11-15T01:37:25.409244+0000","last_active":"2023-11-15T01:37:25.798571+0000","last_peered":"2023-11-15T01:37:25.798571+0000","last_clean":"2023-11-15T01:37:25.798571+0000","last_became_active":"2023-11-15T01:37:25.406533+0000","last_became_peered":"2023-11-15T01:37:25.406533+0000","last_unstale":"2023-11-15T01:37:25.798571+0000","last_undegraded":"2023-11-15T01:37:25.798571+0000","last_fullsized":"2023-11-15T01:37:25.798571+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.805299+0000","last_change":"2023-11-15T01:37:25.801143+0000","last_active":"2023-11-15T01:37:25.805299+0000","last_peered":"2023-11-15T01:37:25.805299+0000","last_clean":"2023-11-15T01:37:25.805299+0000","last_became_active":"2023-11-15T01:37:25.800873+0000","last_became_peered":"2023-11-15T01:37:25.800873+0000","last_unstale":"2023-11-15T01:37:25.805299+0000","last_undegraded":"2023-11-15T01:37:25.805299+0000","last_fullsized":"2023-11-15T01:37:25.805299+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.805699+0000","last_change":"2023-11-15T01:37:25.419213+0000","last_active":"2023-11-15T01:37:25.805699+0000","last_peered":"2023-11-15T01:37:25.805699+0000","last_clean":"2023-11-15T01:37:25.805699+0000","last_became_active":"2023-11-15T01:37:25.418887+0000","last_became_peered":"2023-11-15T01:37:25.418887+0000","last_unstale":"2023-11-15T01:37:25.805699+0000","last_undegraded":"2023-11-15T01:37:25.805699+0000","last_fullsized":"2023-11-15T01:37:25.805699+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819120+0000","last_change":"2023-11-15T01:37:25.813749+0000","last_active":"2023-11-15T01:37:25.819120+0000","last_peered":"2023-11-15T01:37:25.819120+0000","last_clean":"2023-11-15T01:37:25.819120+0000","last_became_active":"2023-11-15T01:37:25.813486+0000","last_became_peered":"2023-11-15T01:37:25.813486+0000","last_unstale":"2023-11-15T01:37:25.819120+0000","last_undegraded":"2023-11-15T01:37:25.819120+0000","last_fullsized":"2023-11-15T01:37:25.819120+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.797259+0000","last_change":"2023-11-15T01:37:25.410488+0000","last_active":"2023-11-15T01:37:25.797259+0000","last_peered":"2023-11-15T01:37:25.797259+0000","last_clean":"2023-11-15T01:37:25.797259+0000","last_became_active":"2023-11-15T01:37:25.410177+0000","last_became_peered":"2023-11-15T01:37:25.410177+0000","last_unstale":"2023-11-15T01:37:25.797259+0000","last_undegraded":"2023-11-15T01:37:25.797259+0000","last_fullsized":"2023-11-15T01:37:25.797259+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819620+0000","last_change":"2023-11-15T01:37:25.807363+0000","last_active":"2023-11-15T01:37:25.819620+0000","last_peered":"2023-11-15T01:37:25.819620+0000","last_clean":"2023-11-15T01:37:25.819620+0000","last_became_active":"2023-11-15T01:37:25.807089+0000","last_became_peered":"2023-11-15T01:37:25.807089+0000","last_unstale":"2023-11-15T01:37:25.819620+0000","last_undegraded":"2023-11-15T01:37:25.819620+0000","last_fullsized":"2023-11-15T01:37:25.819620+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801665+0000","last_change":"2023-11-15T01:37:25.422474+0000","last_active":"2023-11-15T01:37:25.801665+0000","last_peered":"2023-11-15T01:37:25.801665+0000","last_clean":"2023-11-15T01:37:25.801665+0000","last_became_active":"2023-11-15T01:37:25.422209+0000","last_became_peered":"2023-11-15T01:37:25.422209+0000","last_unstale":"2023-11-15T01:37:25.801665+0000","last_undegraded":"2023-11-15T01:37:25.801665+0000","last_fullsized":"2023-11-15T01:37:25.801665+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.808626+0000","last_change":"2023-11-15T01:37:25.804923+0000","last_active":"2023-11-15T01:37:25.808626+0000","last_peered":"2023-11-15T01:37:25.808626+0000","last_clean":"2023-11-15T01:37:25.808626+0000","last_became_active":"2023-11-15T01:37:25.804493+0000","last_became_peered":"2023-11-15T01:37:25.804493+0000","last_unstale":"2023-11-15T01:37:25.808626+0000","last_undegraded":"2023-11-15T01:37:25.808626+0000","last_fullsized":"2023-11-15T01:37:25.808626+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.812722+0000","last_change":"2023-11-15T01:37:25.418505+0000","last_active":"2023-11-15T01:37:25.812722+0000","last_peered":"2023-11-15T01:37:25.812722+0000","last_clean":"2023-11-15T01:37:25.812722+0000","last_became_active":"2023-11-15T01:37:25.417849+0000","last_became_peered":"2023-11-15T01:37:25.417849+0000","last_unstale":"2023-11-15T01:37:25.812722+0000","last_undegraded":"2023-11-15T01:37:25.812722+0000","last_fullsized":"2023-11-15T01:37:25.812722+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":87,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803604+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:37:25.803604+0000","last_peered":"2023-11-15T01:37:25.803604+0000","last_clean":"2023-11-15T01:37:25.803604+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:37:25.803604+0000","last_undegraded":"2023-11-15T01:37:25.803604+0000","last_fullsized":"2023-11-15T01:37:25.803604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.813918+0000","last_change":"2023-11-15T01:37:25.812577+0000","last_active":"2023-11-15T01:37:25.813918+0000","last_peered":"2023-11-15T01:37:25.813918+0000","last_clean":"2023-11-15T01:37:25.813918+0000","last_became_active":"2023-11-15T01:37:25.812293+0000","last_became_peered":"2023-11-15T01:37:25.812293+0000","last_unstale":"2023-11-15T01:37:25.813918+0000","last_undegraded":"2023-11-15T01:37:25.813918+0000","last_fullsized":"2023-11-15T01:37:25.813918+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801571+0000","last_change":"2023-11-15T01:37:25.410009+0000","last_active":"2023-11-15T01:37:25.801571+0000","last_peered":"2023-11-15T01:37:25.801571+0000","last_clean":"2023-11-15T01:37:25.801571+0000","last_became_active":"2023-11-15T01:37:25.409735+0000","last_became_peered":"2023-11-15T01:37:25.409735+0000","last_unstale":"2023-11-15T01:37:25.801571+0000","last_undegraded":"2023-11-15T01:37:25.801571+0000","last_fullsized":"2023-11-15T01:37:25.801571+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.805793+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:37:25.805793+0000","last_peered":"2023-11-15T01:37:25.805793+0000","last_clean":"2023-11-15T01:37:25.805793+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:37:25.805793+0000","last_undegraded":"2023-11-15T01:37:25.805793+0000","last_fullsized":"2023-11-15T01:37:25.805793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.814344+0000","last_change":"2023-11-15T01:37:25.807465+0000","last_active":"2023-11-15T01:37:25.814344+0000","last_peered":"2023-11-15T01:37:25.814344+0000","last_clean":"2023-11-15T01:37:25.814344+0000","last_became_active":"2023-11-15T01:37:25.807190+0000","last_became_peered":"2023-11-15T01:37:25.807190+0000","last_unstale":"2023-11-15T01:37:25.814344+0000","last_undegraded":"2023-11-15T01:37:25.814344+0000","last_fullsized":"2023-11-15T01:37:25.814344+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819413+0000","last_change":"2023-11-15T01:37:25.419258+0000","last_active":"2023-11-15T01:37:25.819413+0000","last_peered":"2023-11-15T01:37:25.819413+0000","last_clean":"2023-11-15T01:37:25.819413+0000","last_became_active":"2023-11-15T01:37:25.418620+0000","last_became_peered":"2023-11-15T01:37:25.418620+0000","last_unstale":"2023-11-15T01:37:25.819413+0000","last_undegraded":"2023-11-15T01:37:25.819413+0000","last_fullsized":"2023-11-15T01:37:25.819413+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":92,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.787535+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:37:25.787535+0000","last_peered":"2023-11-15T01:37:25.787535+0000","last_clean":"2023-11-15T01:37:25.787535+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:37:25.787535+0000","last_undegraded":"2023-11-15T01:37:25.787535+0000","last_fullsized":"2023-11-15T01:37:25.787535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.811757+0000","last_change":"2023-11-15T01:37:25.805821+0000","last_active":"2023-11-15T01:37:25.811757+0000","last_peered":"2023-11-15T01:37:25.811757+0000","last_clean":"2023-11-15T01:37:25.811757+0000","last_became_active":"2023-11-15T01:37:25.805535+0000","last_became_peered":"2023-11-15T01:37:25.805535+0000","last_unstale":"2023-11-15T01:37:25.811757+0000","last_undegraded":"2023-11-15T01:37:25.811757+0000","last_fullsized":"2023-11-15T01:37:25.811757+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.803523+0000","last_change":"2023-11-15T01:37:25.424116+0000","last_active":"2023-11-15T01:37:25.803523+0000","last_peered":"2023-11-15T01:37:25.803523+0000","last_clean":"2023-11-15T01:37:25.803523+0000","last_became_active":"2023-11-15T01:37:25.423763+0000","last_became_peered":"2023-11-15T01:37:25.423763+0000","last_unstale":"2023-11-15T01:37:25.803523+0000","last_undegraded":"2023-11-15T01:37:25.803523+0000","last_fullsized":"2023-11-15T01:37:25.803523+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.804171+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:37:25.804171+0000","last_peered":"2023-11-15T01:37:25.804171+0000","last_clean":"2023-11-15T01:37:25.804171+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:37:25.804171+0000","last_undegraded":"2023-11-15T01:37:25.804171+0000","last_fullsized":"2023-11-15T01:37:25.804171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":84,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801753+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:37:25.801753+0000","last_peered":"2023-11-15T01:37:25.801753+0000","last_clean":"2023-11-15T01:37:25.801753+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:37:25.801753+0000","last_undegraded":"2023-11-15T01:37:25.801753+0000","last_fullsized":"2023-11-15T01:37:25.801753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819651+0000","last_change":"2023-11-15T01:37:25.808026+0000","last_active":"2023-11-15T01:37:25.819651+0000","last_peered":"2023-11-15T01:37:25.819651+0000","last_clean":"2023-11-15T01:37:25.819651+0000","last_became_active":"2023-11-15T01:37:25.807733+0000","last_became_peered":"2023-11-15T01:37:25.807733+0000","last_unstale":"2023-11-15T01:37:25.819651+0000","last_undegraded":"2023-11-15T01:37:25.819651+0000","last_fullsized":"2023-11-15T01:37:25.819651+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.816224+0000","last_change":"2023-11-15T01:37:25.418245+0000","last_active":"2023-11-15T01:37:25.816224+0000","last_peered":"2023-11-15T01:37:25.816224+0000","last_clean":"2023-11-15T01:37:25.816224+0000","last_became_active":"2023-11-15T01:37:25.417901+0000","last_became_peered":"2023-11-15T01:37:25.417901+0000","last_unstale":"2023-11-15T01:37:25.816224+0000","last_undegraded":"2023-11-15T01:37:25.816224+0000","last_fullsized":"2023-11-15T01:37:25.816224+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":82,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.801840+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:37:25.801840+0000","last_peered":"2023-11-15T01:37:25.801840+0000","last_clean":"2023-11-15T01:37:25.801840+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:37:25.801840+0000","last_undegraded":"2023-11-15T01:37:25.801840+0000","last_fullsized":"2023-11-15T01:37:25.801840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.806930+0000","last_change":"2023-11-15T01:37:25.805178+0000","last_active":"2023-11-15T01:37:25.806930+0000","last_peered":"2023-11-15T01:37:25.806930+0000","last_clean":"2023-11-15T01:37:25.806930+0000","last_became_active":"2023-11-15T01:37:25.804905+0000","last_became_peered":"2023-11-15T01:37:25.804905+0000","last_unstale":"2023-11-15T01:37:25.806930+0000","last_undegraded":"2023-11-15T01:37:25.806930+0000","last_fullsized":"2023-11-15T01:37:25.806930+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.788036+0000","last_change":"2023-11-15T01:37:25.415983+0000","last_active":"2023-11-15T01:37:25.788036+0000","last_peered":"2023-11-15T01:37:25.788036+0000","last_clean":"2023-11-15T01:37:25.788036+0000","last_became_active":"2023-11-15T01:37:25.415669+0000","last_became_peered":"2023-11-15T01:37:25.415669+0000","last_unstale":"2023-11-15T01:37:25.788036+0000","last_undegraded":"2023-11-15T01:37:25.788036+0000","last_fullsized":"2023-11-15T01:37:25.788036+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":82,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.800664+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:37:25.800664+0000","last_peered":"2023-11-15T01:37:25.800664+0000","last_clean":"2023-11-15T01:37:25.800664+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:37:25.800664+0000","last_undegraded":"2023-11-15T01:37:25.800664+0000","last_fullsized":"2023-11-15T01:37:25.800664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.819233+0000","last_change":"2023-11-15T01:37:25.813192+0000","last_active":"2023-11-15T01:37:25.819233+0000","last_peered":"2023-11-15T01:37:25.819233+0000","last_clean":"2023-11-15T01:37:25.819233+0000","last_became_active":"2023-11-15T01:37:25.812962+0000","last_became_peered":"2023-11-15T01:37:25.812962+0000","last_unstale":"2023-11-15T01:37:25.819233+0000","last_undegraded":"2023-11-15T01:37:25.819233+0000","last_fullsized":"2023-11-15T01:37:25.819233+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.804324+0000","last_change":"2023-11-15T01:37:25.414908+0000","last_active":"2023-11-15T01:37:25.804324+0000","last_peered":"2023-11-15T01:37:25.804324+0000","last_clean":"2023-11-15T01:37:25.804324+0000","last_became_active":"2023-11-15T01:37:25.414175+0000","last_became_peered":"2023-11-15T01:37:25.414175+0000","last_unstale":"2023-11-15T01:37:25.804324+0000","last_undegraded":"2023-11-15T01:37:25.804324+0000","last_fullsized":"2023-11-15T01:37:25.804324+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":87,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.805288+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:37:25.805288+0000","last_peered":"2023-11-15T01:37:25.805288+0000","last_clean":"2023-11-15T01:37:25.805288+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:37:25.805288+0000","last_undegraded":"2023-11-15T01:37:25.805288+0000","last_fullsized":"2023-11-15T01:37:25.805288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.807563+0000","last_change":"2023-11-15T01:37:25.803563+0000","last_active":"2023-11-15T01:37:25.807563+0000","last_peered":"2023-11-15T01:37:25.807563+0000","last_clean":"2023-11-15T01:37:25.807563+0000","last_became_active":"2023-11-15T01:37:25.803286+0000","last_became_peered":"2023-11-15T01:37:25.803286+0000","last_unstale":"2023-11-15T01:37:25.807563+0000","last_undegraded":"2023-11-15T01:37:25.807563+0000","last_fullsized":"2023-11-15T01:37:25.807563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:25.389790+0000","last_clean_scrub_stamp":"2023-11-15T01:37:25.389790+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.787733+0000","last_change":"2023-11-15T01:37:25.419665+0000","last_active":"2023-11-15T01:37:25.787733+0000","last_peered":"2023-11-15T01:37:25.787733+0000","last_clean":"2023-11-15T01:37:25.787733+0000","last_became_active":"2023-11-15T01:37:25.419392+0000","last_became_peered":"2023-11-15T01:37:25.419392+0000","last_unstale":"2023-11-15T01:37:25.787733+0000","last_undegraded":"2023-11-15T01:37:25.787733+0000","last_fullsized":"2023-11-15T01:37:25.787733+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:37:24.385332+0000","last_clean_scrub_stamp":"2023-11-15T01:37:24.385332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-11-15T01:37:25.799054+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:37:25.799054+0000","last_peered":"2023-11-15T01:37:25.799054+0000","last_clean":"2023-11-15T01:37:25.799054+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:37:25.799054+0000","last_undegraded":"2023-11-15T01:37:25.799054+0000","last_fullsized":"2023-11-15T01:37:25.799054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575039,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302508,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069332,"statfs":{"total":96636764160,"available":96326995968,"internally_reserved":0,"allocated":1347584,"data_stored":688650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68500000000000005,"5min":0.71199999999999997,"15min":0.82299999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.35799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":2.9020000000000001,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.46999999999999997}]},{"osd":1,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68500000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.34499999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67100000000000004,"5min":0.80800000000000005,"15min":0.81499999999999995},"last":0.54800000000000004}]},{"osd":2,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.82599999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73799999999999999,"5min":0.82299999999999995,"15min":0.86299999999999999},"last":0.51200000000000001}]},{"osd":3,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.80700000000000005,"15min":0.85999999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.9209999999999998,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.58099999999999996}]},{"osd":4,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45400000000000001,"15min":0.46500000000000002},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.84499999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47699999999999998,"15min":0.48499999999999999},"min":{"1min":0.26500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.36499999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72299999999999998,"5min":0.73899999999999999,"15min":0.78500000000000003},"last":0.433}]},{"osd":6,"last update":"Wed Nov 15 01:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82999999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.5},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.73999999999999999,"5min":0.755,"15min":0.85099999999999998},"last":0.47899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575040,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302520,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069320,"statfs":{"total":96636764160,"available":96326983680,"internally_reserved":0,"allocated":1359872,"data_stored":690706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.29199999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73299999999999998,"5min":0.89000000000000001,"15min":0.97799999999999998},"last":0.69199999999999995}]},{"osd":1,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54900000000000004,"15min":0.56299999999999994},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.0649999999999999},"last":0.63},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.33100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.72499999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.75700000000000001,"5min":0.79100000000000004,"15min":1.038},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.76400000000000001}]},{"osd":3,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54400000000000004,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.77100000000000002,"5min":0.85499999999999998,"15min":1.028},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35699999999999998},"max":{"1min":0.67100000000000004,"5min":0.874,"15min":1.004},"last":0.78300000000000003}]},{"osd":4,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44700000000000001,"15min":0.44800000000000001},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.68200000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.25800000000000001},"max":{"1min":0.65400000000000003,"5min":0.73299999999999998,"15min":0.81799999999999995},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63500000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.315,"15min":0.28299999999999997},"max":{"1min":0.70999999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46899999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.496,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":0.64000000000000001,"5min":0.72099999999999997,"15min":0.86499999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.34000000000000002},"max":{"1min":0.67200000000000004,"5min":0.82399999999999995,"15min":1.0009999999999999},"last":0.57799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575041,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":688594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.373,"15min":0.376},"min":{"1min":0.25,"5min":0.249,"15min":0.23999999999999999},"max":{"1min":0.59099999999999997,"5min":0.73699999999999999,"15min":0.77800000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.26900000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.35799999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38200000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.22600000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.34000000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.31},"max":{"1min":9.641,"5min":9.641,"15min":9.641},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.53800000000000003,"15min":0.496},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.28000000000000003},"max":{"1min":9.6199999999999992,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.30599999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.68500000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.0509999999999999},"last":0.52300000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71699999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.40400000000000003,"15min":0.373},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.53500000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.46200000000000002,"5min":0.441,"15min":0.42799999999999999},"max":{"1min":0.77500000000000002,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.55300000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0429999999999999,"5min":1.0509999999999999,"15min":1.25},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66800000000000004,"15min":0.68799999999999994},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81499999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.55900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575039,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302520,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069320,"statfs":{"total":96636764160,"available":96326983680,"internally_reserved":0,"allocated":1359872,"data_stored":689432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.375,"15min":0.36899999999999999},"min":{"1min":0.23799999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.498,"5min":2.024,"15min":2.024},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.42799999999999999,"15min":0.41599999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.215},"max":{"1min":0.60199999999999998,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.442}]},{"osd":2,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.39200000000000002,"15min":0.38700000000000001},"min":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.44600000000000001,"5min":1.768,"15min":1.768},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.437,"15min":0.44},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60799999999999998,"5min":1.982,"15min":1.982},"last":0.36299999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.433,"15min":0.434},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.22500000000000001},"max":{"1min":0.58599999999999997,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.45400000000000001,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.28100000000000003,"15min":0.27700000000000002},"max":{"1min":0.56299999999999994,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.42399999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79400000000000004,"5min":0.97799999999999998,"15min":1.454},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82799999999999996,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.65600000000000003}]},{"osd":5,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78500000000000003,"5min":1.881,"15min":1.881},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.42199999999999999,"5min":0.41899999999999998,"15min":0.38500000000000001},"max":{"1min":0.80400000000000005,"5min":0.88300000000000001,"15min":1.1120000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81799999999999995,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85799999999999998,"5min":1.917,"15min":1.917},"last":0.60599999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.85399999999999998,"5min":1.843,"15min":1.843},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67400000000000004,"15min":0.68999999999999995},"min":{"1min":0.49399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84599999999999997,"5min":0.92300000000000004,"15min":1.4119999999999999},"last":0.63400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575040,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306596,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065244,"statfs":{"total":96636764160,"available":96322809856,"internally_reserved":0,"allocated":1339392,"data_stored":688594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36499999999999999,"15min":0.36899999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52500000000000002,"5min":0.55100000000000005,"15min":0.61899999999999999},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.39800000000000002,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.57699999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.29999999999999999}]},{"osd":1,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.222},"max":{"1min":0.745,"5min":0.745,"15min":0.75},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.441,"15min":0.442},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.69799999999999995,"5min":0.73499999999999999,"15min":0.92000000000000004},"last":0.40600000000000003}]},{"osd":3,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.248},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.317},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45000000000000001,"15min":0.44400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.253},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.32800000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59999999999999998,"15min":0.625},"min":{"1min":0.41299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92700000000000005,"5min":1.0549999999999999,"15min":1.0800000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.39200000000000002},"max":{"1min":0.872,"5min":0.91100000000000003,"15min":1.052},"last":0.496}]},{"osd":5,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.627,"15min":0.64800000000000002},"min":{"1min":0.43099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.89400000000000002,"5min":1.032,"15min":1.032},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61499999999999999,"15min":0.64100000000000001},"min":{"1min":0.44700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.871,"5min":0.96699999999999997,"15min":1.1339999999999999},"last":0.51600000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.66300000000000003},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.876,"5min":1.002,"15min":1.0389999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.65300000000000002,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85699999999999998,"5min":1.0669999999999999,"15min":1.119},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.67700000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78300000000000003,"5min":1.079,"15min":1.103},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67600000000000005,"15min":0.69499999999999995},"min":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.86599999999999999,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575041,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306604,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065236,"statfs":{"total":96636764160,"available":96322801664,"internally_reserved":0,"allocated":1347584,"data_stored":689556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48399999999999999,"5min":0.65900000000000003,"15min":0.79900000000000004},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.38200000000000001,"15min":0.39800000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23200000000000001},"max":{"1min":0.60699999999999998,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.309}]},{"osd":1,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.371,"15min":0.38700000000000001},"min":{"1min":0.27000000000000002,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":0.47499999999999998,"5min":0.59799999999999998,"15min":0.72899999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.42799999999999999,"15min":0.44400000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52700000000000002,"5min":0.72499999999999998,"15min":0.80500000000000005},"last":0.28699999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.42699999999999999,"15min":0.44600000000000001},"min":{"1min":0.28000000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61699999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.45300000000000001,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26200000000000001},"max":{"1min":0.53000000000000003,"5min":0.69199999999999995,"15min":0.81999999999999995},"last":0.34499999999999997}]},{"osd":4,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58699999999999997,"15min":0.61799999999999999},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.80800000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.627},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.39000000000000001},"max":{"1min":0.73599999999999999,"5min":0.89200000000000002,"15min":1.0589999999999999},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.60299999999999998,"15min":0.63600000000000001},"min":{"1min":0.41799999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.72799999999999998,"5min":0.92000000000000004,"15min":1.0569999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61299999999999999,"15min":0.64100000000000001},"min":{"1min":0.375,"5min":0.373,"15min":0.373},"max":{"1min":0.84899999999999998,"5min":0.879,"15min":0.95999999999999996},"last":0.41499999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61699999999999999,"15min":0.64700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":0.94299999999999995,"15min":1.0980000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.67100000000000004},"min":{"1min":0.442,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73999999999999999,"5min":0.95799999999999996,"15min":1.169},"last":0.50800000000000001}]},{"osd":7,"last update":"Wed Nov 15 01:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63500000000000001,"15min":0.66800000000000004},"min":{"1min":0.41999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88700000000000001,"5min":1.0429999999999999,"15min":1.071},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.64500000000000002,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75800000000000001,"5min":0.996,"15min":1.1459999999999999},"last":0.436}]}]},{"osd":4,"up_from":13,"seq":55834575039,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302508,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069332,"statfs":{"total":96636764160,"available":96326995968,"internally_reserved":0,"allocated":1347584,"data_stored":689238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76500000000000001,"5min":0.88,"15min":0.88},"last":0.504},{"interface":"front","average":{"1min":0.5,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.32900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65600000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51100000000000001}]},{"osd":1,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55700000000000005,"15min":0.57199999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.746,"5min":1.087,"15min":1.087},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34699999999999998},"max":{"1min":0.69199999999999995,"5min":0.76600000000000001,"15min":0.81000000000000005},"last":0.53500000000000003}]},{"osd":2,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.34699999999999998,"15min":0.33100000000000002},"max":{"1min":0.78900000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47899999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72099999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30399999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.30399999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.36799999999999999}]},{"osd":6,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.34000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.53000000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82799999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.45800000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:36:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.435},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.52600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575039,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":688594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78500000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.63},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.53700000000000003,"15min":0.55000000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.81200000000000006},"last":0.73199999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32600000000000001},"max":{"1min":0.68799999999999994,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.33400000000000002},"max":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.86199999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.498,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34999999999999998},"max":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":1.103},"last":0.70399999999999996}]},{"osd":3,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.376,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":1.127},"last":0.74399999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64400000000000002,"5min":0.66500000000000004,"15min":0.94399999999999995},"last":0.498},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.50800000000000001,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46400000000000002,"15min":0.47599999999999998},"min":{"1min":0.307,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74399999999999999,"5min":0.83099999999999996,"15min":1.0660000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.47299999999999998,"15min":0.495},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.54900000000000004}]},{"osd":7,"last update":"Wed Nov 15 01:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48099999999999998,"15min":0.498},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.69899999999999995,"5min":0.72999999999999998,"15min":0.97199999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":0.85799999999999998,"15min":1.1499999999999999},"last":0.76900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:37:34.657 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-15T01:37:34.658 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-15T01:37:34.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.813+0000 7f1269318700 1 Processor -- start 2023-11-15T01:37:34.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.813+0000 7f1269318700 1 -- start start 2023-11-15T01:37:34.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.813+0000 7f1269318700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f12641576c0 0x7f12640a5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:34.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.813+0000 7f1269318700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12640c4900 0x7f12640c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:34.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.813+0000 7f1269318700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f12640c1ee0 0x7f12640a6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:34.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.813+0000 7f1269318700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12640c2640 con 0x7f12640c1ee0 2023-11-15T01:37:34.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.813+0000 7f1269318700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12640a4870 con 0x7f12641576c0 2023-11-15T01:37:34.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.813+0000 7f1269318700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12640a50f0 con 0x7f12640c4900 2023-11-15T01:37:34.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.814+0000 7f12637fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f12640c1ee0 0x7f12640a6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:34.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.814+0000 7f12637fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f12640c1ee0 0x7f12640a6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43652/0 (socket says 172.21.15.1:43652) 2023-11-15T01:37:34.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.814+0000 7f12637fe700 1 -- 172.21.15.1:0/2483172974 learned_addr learned my addr 172.21.15.1:0/2483172974 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:34.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.814+0000 7f12627fc700 1 --2- 172.21.15.1:0/2483172974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12640c4900 0x7f12640c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:34.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.814+0000 7f1262ffd700 1 --2- 172.21.15.1:0/2483172974 >> v2:172.21.15.141:3300/0 conn(0x7f12641576c0 0x7f12640a5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:34.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.814+0000 7f12637fe700 1 -- 172.21.15.1:0/2483172974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12640c4900 msgr2=0x7f12640c19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:34.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.814+0000 7f12637fe700 1 --2- 172.21.15.1:0/2483172974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12640c4900 0x7f12640c19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.814+0000 7f12637fe700 1 -- 172.21.15.1:0/2483172974 >> v2:172.21.15.141:3300/0 conn(0x7f12641576c0 msgr2=0x7f12640a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:34.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.814+0000 7f12637fe700 1 --2- 172.21.15.1:0/2483172974 >> v2:172.21.15.141:3300/0 conn(0x7f12641576c0 0x7f12640a5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.814+0000 7f12637fe700 1 -- 172.21.15.1:0/2483172974 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12640c2360 con 0x7f12640c1ee0 2023-11-15T01:37:34.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.814+0000 7f12637fe700 1 --2- 172.21.15.1:0/2483172974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640c1ee0 0x7f12640a6050 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f126406bee0 tx=0x7f125c009840).ready entity=mon.0 client_cookie=a9b28338e6c2d4bc server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:34.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.814+0000 7f1261ffb700 1 -- 172.21.15.1:0/2483172974 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c00e070 con 0x7f12640c1ee0 2023-11-15T01:37:34.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.814+0000 7f1261ffb700 1 -- 172.21.15.1:0/2483172974 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c00ba50 con 0x7f12640c1ee0 2023-11-15T01:37:34.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.814+0000 7f1261ffb700 1 -- 172.21.15.1:0/2483172974 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c00bdd0 con 0x7f12640c1ee0 2023-11-15T01:37:34.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.815+0000 7f1269318700 1 -- 172.21.15.1:0/2483172974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640c1ee0 msgr2=0x7f12640a6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:34.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.815+0000 7f1269318700 1 --2- 172.21.15.1:0/2483172974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640c1ee0 0x7f12640a6050 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f126406bee0 tx=0x7f125c009840).stop 2023-11-15T01:37:34.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.815+0000 7f1269318700 1 -- 172.21.15.1:0/2483172974 shutdown_connections 2023-11-15T01:37:34.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.815+0000 7f1269318700 1 --2- 172.21.15.1:0/2483172974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640c1ee0 0x7f12640a6050 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.815+0000 7f1269318700 1 --2- 172.21.15.1:0/2483172974 >> v2:172.21.15.141:3300/0 conn(0x7f12641576c0 0x7f12640a5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.815+0000 7f1269318700 1 --2- 172.21.15.1:0/2483172974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12640c4900 0x7f12640c19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.815+0000 7f1269318700 1 -- 172.21.15.1:0/2483172974 >> 172.21.15.1:0/2483172974 conn(0x7f12640c7c10 msgr2=0x7f12640c3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:34.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.815+0000 7f1269318700 1 -- 172.21.15.1:0/2483172974 shutdown_connections 2023-11-15T01:37:34.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.815+0000 7f1269318700 1 -- 172.21.15.1:0/2483172974 wait complete. 2023-11-15T01:37:34.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.816+0000 7f1269318700 1 Processor -- start 2023-11-15T01:37:34.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.816+0000 7f1269318700 1 -- start start 2023-11-15T01:37:34.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f1269318700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12640c1ee0 0x7f12640ab690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:34.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f1269318700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640c4900 0x7f12640be240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:34.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f1269318700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12641576c0 0x7f12640be730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:34.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f1269318700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12640bec20 con 0x7f12640c4900 2023-11-15T01:37:34.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f1269318700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12641654c0 con 0x7f12640c1ee0 2023-11-15T01:37:34.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f1269318700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12640c1060 con 0x7f12641576c0 2023-11-15T01:37:34.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f12627fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640c4900 0x7f12640be240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:34.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f12627fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640c4900 0x7f12640be240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43658/0 (socket says 172.21.15.1:43658) 2023-11-15T01:37:34.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f12627fc700 1 -- 172.21.15.1:0/134964155 learned_addr learned my addr 172.21.15.1:0/134964155 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:34.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f12637fe700 1 --2- 172.21.15.1:0/134964155 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12641576c0 0x7f12640be730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:34.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f1262ffd700 1 --2- 172.21.15.1:0/134964155 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12640c1ee0 0x7f12640ab690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:34.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f12627fc700 1 -- 172.21.15.1:0/134964155 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12641576c0 msgr2=0x7f12640be730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:34.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f12627fc700 1 --2- 172.21.15.1:0/134964155 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12641576c0 0x7f12640be730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f12627fc700 1 -- 172.21.15.1:0/134964155 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12640c1ee0 msgr2=0x7f12640ab690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:34.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f12627fc700 1 --2- 172.21.15.1:0/134964155 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12640c1ee0 0x7f12640ab690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:34.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f12627fc700 1 -- 172.21.15.1:0/134964155 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c009ae0 con 0x7f12640c4900 2023-11-15T01:37:34.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f12627fc700 1 --2- 172.21.15.1:0/134964155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640c4900 0x7f12640be240 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f124c00d890 tx=0x7f124c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:34.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f125affd700 1 -- 172.21.15.1:0/134964155 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c011590 con 0x7f12640c4900 2023-11-15T01:37:34.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f1269318700 1 -- 172.21.15.1:0/134964155 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12640c1340 con 0x7f12640c4900 2023-11-15T01:37:34.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f125affd700 1 -- 172.21.15.1:0/134964155 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c0116f0 con 0x7f12640c4900 2023-11-15T01:37:34.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.817+0000 7f125affd700 1 -- 172.21.15.1:0/134964155 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c011a70 con 0x7f12640c4900 2023-11-15T01:37:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.818+0000 7f1269318700 1 -- 172.21.15.1:0/134964155 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12640c16a0 con 0x7f12640c4900 2023-11-15T01:37:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.819+0000 7f1269318700 1 -- 172.21.15.1:0/134964155 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126406c7e0 con 0x7f12640c4900 2023-11-15T01:37:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.819+0000 7f125affd700 1 -- 172.21.15.1:0/134964155 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f124c012420 con 0x7f12640c4900 2023-11-15T01:37:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.819+0000 7f125affd700 1 --2- 172.21.15.1:0/134964155 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f124405f270 0x7f1244061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.819+0000 7f125affd700 1 -- 172.21.15.1:0/134964155 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f124c079ed0 con 0x7f12640c4900 2023-11-15T01:37:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.819+0000 7f1262ffd700 1 --2- 172.21.15.1:0/134964155 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f124405f270 0x7f1244061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.820+0000 7f1262ffd700 1 --2- 172.21.15.1:0/134964155 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f124405f270 0x7f1244061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f125400bbc0 tx=0x7f1254008040).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:34.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:34.824+0000 7f125affd700 1 -- 172.21.15.1:0/134964155 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f124c04aed0 con 0x7f12640c4900 2023-11-15T01:37:35.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.062+0000 7f1269318700 1 -- 172.21.15.1:0/134964155 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f12640c46e0 con 0x7f12640c4900 2023-11-15T01:37:35.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.066+0000 7f125affd700 1 -- 172.21.15.1:0/134964155 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f124c011e60 con 0x7f12640c4900 2023-11-15T01:37:35.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.068+0000 7f1269318700 1 -- 172.21.15.1:0/134964155 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f124405f270 msgr2=0x7f1244061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:35.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.068+0000 7f1269318700 1 --2- 172.21.15.1:0/134964155 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f124405f270 0x7f1244061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f125400bbc0 tx=0x7f1254008040).stop 2023-11-15T01:37:35.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.068+0000 7f1269318700 1 -- 172.21.15.1:0/134964155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640c4900 msgr2=0x7f12640be240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:35.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.068+0000 7f1269318700 1 --2- 172.21.15.1:0/134964155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640c4900 0x7f12640be240 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f124c00d890 tx=0x7f124c008040).stop 2023-11-15T01:37:35.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.068+0000 7f1269318700 1 -- 172.21.15.1:0/134964155 shutdown_connections 2023-11-15T01:37:35.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.068+0000 7f1269318700 1 --2- 172.21.15.1:0/134964155 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f124405f270 0x7f1244061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.068+0000 7f1269318700 1 --2- 172.21.15.1:0/134964155 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12641576c0 0x7f12640be730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.068+0000 7f1269318700 1 --2- 172.21.15.1:0/134964155 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12640c1ee0 0x7f12640ab690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.068+0000 7f1269318700 1 --2- 172.21.15.1:0/134964155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640c4900 0x7f12640be240 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.068+0000 7f1269318700 1 -- 172.21.15.1:0/134964155 >> 172.21.15.1:0/134964155 conn(0x7f12640c7c10 msgr2=0x7f126406a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:35.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.068+0000 7f1269318700 1 -- 172.21.15.1:0/134964155 shutdown_connections 2023-11-15T01:37:35.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.068+0000 7f1269318700 1 -- 172.21.15.1:0/134964155 wait complete. 2023-11-15T01:37:35.072 INFO:teuthology.orchestra.run.smithi001.stderr:updated caps for client.0 2023-11-15T01:37:35.081 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:37:35.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.198+0000 7f30cb35e700 1 Processor -- start 2023-11-15T01:37:35.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.199+0000 7f30cb35e700 1 -- start start 2023-11-15T01:37:35.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.199+0000 7f30cb35e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f30c4154150 0x7f30c4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30cb35e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30c40aa060 0x7f30c40c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30cb35e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c40c06f0 con 0x7f30c40ab1a0 2023-11-15T01:37:35.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30cb35e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c40c09d0 con 0x7f30c4154150 2023-11-15T01:37:35.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30cb35e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c4158820 con 0x7f30c40aa060 2023-11-15T01:37:35.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30c90fa700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f30c4154150 0x7f30c4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:35.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30c88f9700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f30c40ab1a0 0x7f30c4158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45046/0 (socket says 172.21.15.1:45046) 2023-11-15T01:37:35.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30c90fa700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f30c4154150 0x7f30c4154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43670/0 (socket says 172.21.15.1:43670) 2023-11-15T01:37:35.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30c88f9700 1 -- 172.21.15.1:0/3859189652 learned_addr learned my addr 172.21.15.1:0/3859189652 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:35.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30c98fb700 1 --2- 172.21.15.1:0/3859189652 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30c40aa060 0x7f30c40c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:35.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30c90fa700 1 -- 172.21.15.1:0/3859189652 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30c40aa060 msgr2=0x7f30c40c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:35.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30c90fa700 1 --2- 172.21.15.1:0/3859189652 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30c40aa060 0x7f30c40c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30c90fa700 1 -- 172.21.15.1:0/3859189652 >> v1:172.21.15.1:6789/0 conn(0x7f30c40ab1a0 legacy=0x7f30c4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:35.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30c90fa700 1 -- 172.21.15.1:0/3859189652 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c4158b00 con 0x7f30c4154150 2023-11-15T01:37:35.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30c3fff700 1 -- 172.21.15.1:0/3859189652 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696254033 0 0) 0x7f30c40c06f0 con 0x7f30c40ab1a0 2023-11-15T01:37:35.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30c90fa700 1 --2- 172.21.15.1:0/3859189652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30c4154150 0x7f30c4154530 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f30bc009e60 tx=0x7f30bc009780).ready entity=mon.0 client_cookie=4fb1a78872169f4d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:35.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30c3fff700 1 -- 172.21.15.1:0/3859189652 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc00e070 con 0x7f30c4154150 2023-11-15T01:37:35.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30c3fff700 1 -- 172.21.15.1:0/3859189652 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc00bc30 con 0x7f30c4154150 2023-11-15T01:37:35.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.200+0000 7f30c3fff700 1 -- 172.21.15.1:0/3859189652 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc012410 con 0x7f30c4154150 2023-11-15T01:37:35.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.201+0000 7f30cb35e700 1 -- 172.21.15.1:0/3859189652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30c4154150 msgr2=0x7f30c4154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:35.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.201+0000 7f30cb35e700 1 --2- 172.21.15.1:0/3859189652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30c4154150 0x7f30c4154530 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f30bc009e60 tx=0x7f30bc009780).stop 2023-11-15T01:37:35.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.201+0000 7f30cb35e700 1 -- 172.21.15.1:0/3859189652 shutdown_connections 2023-11-15T01:37:35.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.201+0000 7f30cb35e700 1 --2- 172.21.15.1:0/3859189652 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30c40aa060 0x7f30c40c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.201+0000 7f30cb35e700 1 --2- 172.21.15.1:0/3859189652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30c4154150 0x7f30c4154530 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.201+0000 7f30cb35e700 1 -- 172.21.15.1:0/3859189652 >> 172.21.15.1:0/3859189652 conn(0x7f30c4064aa0 msgr2=0x7f30c4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:35.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.201+0000 7f30cb35e700 1 -- 172.21.15.1:0/3859189652 shutdown_connections 2023-11-15T01:37:35.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.201+0000 7f30cb35e700 1 -- 172.21.15.1:0/3859189652 wait complete. 2023-11-15T01:37:35.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.202+0000 7f30cb35e700 1 Processor -- start 2023-11-15T01:37:35.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.202+0000 7f30cb35e700 1 -- start start 2023-11-15T01:37:35.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30cb35e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30c40aa060 0x7f30c4144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30cb35e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30c40ab1a0 0x7f30c40ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30cb35e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30c4154150 0x7f30c40ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30cb35e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40aea10 con 0x7f30c40aa060 2023-11-15T01:37:35.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30cb35e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c4151370 con 0x7f30c4154150 2023-11-15T01:37:35.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30cb35e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40aebf0 con 0x7f30c40ab1a0 2023-11-15T01:37:35.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30c90fa700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30c40aa060 0x7f30c4144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:35.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30c90fa700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30c40aa060 0x7f30c4144a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43672/0 (socket says 172.21.15.1:43672) 2023-11-15T01:37:35.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30c90fa700 1 -- 172.21.15.1:0/2409392701 learned_addr learned my addr 172.21.15.1:0/2409392701 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:35.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30c88f9700 1 --2- 172.21.15.1:0/2409392701 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30c40ab1a0 0x7f30c40ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:35.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30c98fb700 1 --2- 172.21.15.1:0/2409392701 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30c4154150 0x7f30c40ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:35.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30c90fa700 1 -- 172.21.15.1:0/2409392701 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30c40ab1a0 msgr2=0x7f30c40ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:35.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30c90fa700 1 --2- 172.21.15.1:0/2409392701 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30c40ab1a0 0x7f30c40ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30c90fa700 1 -- 172.21.15.1:0/2409392701 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30c4154150 msgr2=0x7f30c40ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:35.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30c90fa700 1 --2- 172.21.15.1:0/2409392701 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30c4154150 0x7f30c40ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.203+0000 7f30c90fa700 1 -- 172.21.15.1:0/2409392701 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc009a20 con 0x7f30c40aa060 2023-11-15T01:37:35.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.204+0000 7f30c90fa700 1 --2- 172.21.15.1:0/2409392701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30c40aa060 0x7f30c4144a60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f30bc00b6c0 tx=0x7f30bc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:35.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.204+0000 7f30c17fa700 1 -- 172.21.15.1:0/2409392701 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc007080 con 0x7f30c40aa060 2023-11-15T01:37:35.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.204+0000 7f30c17fa700 1 -- 172.21.15.1:0/2409392701 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc01d630 con 0x7f30c40aa060 2023-11-15T01:37:35.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.204+0000 7f30cb35e700 1 -- 172.21.15.1:0/2409392701 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c40aeed0 con 0x7f30c40aa060 2023-11-15T01:37:35.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.204+0000 7f30c17fa700 1 -- 172.21.15.1:0/2409392701 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc01d9d0 con 0x7f30c40aa060 2023-11-15T01:37:35.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.204+0000 7f30cb35e700 1 -- 172.21.15.1:0/2409392701 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c40af490 con 0x7f30c40aa060 2023-11-15T01:37:35.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.205+0000 7f30cb35e700 1 -- 172.21.15.1:0/2409392701 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c406c7e0 con 0x7f30c40aa060 2023-11-15T01:37:35.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.205+0000 7f30c17fa700 1 -- 172.21.15.1:0/2409392701 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f30bc003040 con 0x7f30c40aa060 2023-11-15T01:37:35.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.205+0000 7f30c17fa700 1 --2- 172.21.15.1:0/2409392701 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f30b005f270 0x7f30b0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.206+0000 7f30c17fa700 1 -- 172.21.15.1:0/2409392701 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f30bc07c1b0 con 0x7f30c40aa060 2023-11-15T01:37:35.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.206+0000 7f30c88f9700 1 --2- 172.21.15.1:0/2409392701 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f30b005f270 0x7f30b0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:35.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.206+0000 7f30c88f9700 1 --2- 172.21.15.1:0/2409392701 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f30b005f270 0x7f30b0061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f30b80011e0 tx=0x7f30b8009040).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:35.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.210+0000 7f30c17fa700 1 -- 172.21.15.1:0/2409392701 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f30bc04d150 con 0x7f30c40aa060 2023-11-15T01:37:35.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.426+0000 7f30cb35e700 1 -- 172.21.15.1:0/2409392701 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30c40c02a0 con 0x7f30c40aa060 2023-11-15T01:37:35.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.427+0000 7f30c17fa700 1 -- 172.21.15.1:0/2409392701 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f30bc050770 con 0x7f30c40aa060 2023-11-15T01:37:35.428 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:35.429 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6035,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2141857111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2141857111},{"type":"v1","addr":"172.21.15.141:6836","nonce":2141857111}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7140,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3686794692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3686794692},{"type":"v1","addr":"172.21.15.1:6834","nonce":3686794692}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7143,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1233089645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1233089645},{"type":"v1","addr":"172.21.15.1:6835","nonce":1233089645}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:37:25.784087+0000","modified":"2023-11-15T01:37:28.796286+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7155},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7155":{"gid":7155,"name":"b","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/173614126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":173614126},{"type":"v1","addr":"172.21.15.141:6837","nonce":173614126}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-11-15T01:37:35.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.429+0000 7f30cb35e700 1 -- 172.21.15.1:0/2409392701 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f30b005f270 msgr2=0x7f30b0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:35.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.429+0000 7f30cb35e700 1 --2- 172.21.15.1:0/2409392701 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f30b005f270 0x7f30b0061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f30b80011e0 tx=0x7f30b8009040).stop 2023-11-15T01:37:35.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.429+0000 7f30cb35e700 1 -- 172.21.15.1:0/2409392701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30c40aa060 msgr2=0x7f30c4144a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:35.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.429+0000 7f30cb35e700 1 --2- 172.21.15.1:0/2409392701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30c40aa060 0x7f30c4144a60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f30bc00b6c0 tx=0x7f30bc009780).stop 2023-11-15T01:37:35.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.429+0000 7f30cb35e700 1 -- 172.21.15.1:0/2409392701 shutdown_connections 2023-11-15T01:37:35.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.429+0000 7f30cb35e700 1 --2- 172.21.15.1:0/2409392701 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f30b005f270 0x7f30b0061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.429+0000 7f30cb35e700 1 --2- 172.21.15.1:0/2409392701 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30c4154150 0x7f30c40ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.429+0000 7f30cb35e700 1 --2- 172.21.15.1:0/2409392701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30c40aa060 0x7f30c4144a60 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.429+0000 7f30cb35e700 1 --2- 172.21.15.1:0/2409392701 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30c40ab1a0 0x7f30c40ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.429+0000 7f30cb35e700 1 -- 172.21.15.1:0/2409392701 >> 172.21.15.1:0/2409392701 conn(0x7f30c4064aa0 msgr2=0x7f30c4063d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:35.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.429+0000 7f30cb35e700 1 -- 172.21.15.1:0/2409392701 shutdown_connections 2023-11-15T01:37:35.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.429+0000 7f30cb35e700 1 -- 172.21.15.1:0/2409392701 wait complete. 2023-11-15T01:37:35.433 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 47 2023-11-15T01:37:35.845 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-15T01:37:25.784087+0000', 'modified': '2023-11-15T01:37:28.796286+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7155}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7155': {'gid': 7155, 'name': 'b', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.141:6837/173614126', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6835', 'nonce': 173614126}, {'type': 'v1', 'addr': '172.21.15.141:6837', 'nonce': 173614126}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-15T01:37:35.845 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-15T01:37:35.846 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-15T01:37:35.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.968+0000 7f0bd41df700 1 Processor -- start 2023-11-15T01:37:35.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.968+0000 7f0bd41df700 1 -- start start 2023-11-15T01:37:35.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.969+0000 7f0bd41df700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0bcc154250 0x7f0bcc154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.969+0000 7f0bd41df700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bcc0aa700 0x7f0bcc0c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.969+0000 7f0bd41df700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc158ff0 con 0x7f0bcc0c6110 2023-11-15T01:37:35.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.969+0000 7f0bd41df700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc158100 con 0x7f0bcc154250 2023-11-15T01:37:35.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.969+0000 7f0bd41df700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc1583e0 con 0x7f0bcc0aa700 2023-11-15T01:37:35.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.969+0000 7f0bd1f7b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0bcc154250 0x7f0bcc154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:35.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.969+0000 7f0bd1f7b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0bcc154250 0x7f0bcc154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43676/0 (socket says 172.21.15.1:43676) 2023-11-15T01:37:35.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.969+0000 7f0bd1f7b700 1 -- 172.21.15.1:0/3046719913 learned_addr learned my addr 172.21.15.1:0/3046719913 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:35.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.969+0000 7f0bd277c700 1 --2- 172.21.15.1:0/3046719913 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bcc0aa700 0x7f0bcc0c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:35.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.969+0000 7f0bd1f7b700 1 -- 172.21.15.1:0/3046719913 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bcc0aa700 msgr2=0x7f0bcc0c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:35.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd1f7b700 1 --2- 172.21.15.1:0/3046719913 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bcc0aa700 0x7f0bcc0c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd1f7b700 1 -- 172.21.15.1:0/3046719913 >> v1:172.21.15.141:6789/0 conn(0x7f0bcc0c6110 legacy=0x7f0bcc0a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:35.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd1f7b700 1 -- 172.21.15.1:0/3046719913 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc1586c0 con 0x7f0bcc154250 2023-11-15T01:37:35.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd277c700 1 --2- 172.21.15.1:0/3046719913 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bcc0aa700 0x7f0bcc0c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:37:35.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd1f7b700 1 --2- 172.21.15.1:0/3046719913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bcc154250 0x7f0bcc154630 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f0bc4009f20 tx=0x7f0bc4009840).ready entity=mon.0 client_cookie=59dd89b65783537 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:35.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd0f79700 1 -- 172.21.15.1:0/3046719913 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400e070 con 0x7f0bcc154250 2023-11-15T01:37:35.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd0f79700 1 -- 172.21.15.1:0/3046719913 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc400ba40 con 0x7f0bcc154250 2023-11-15T01:37:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd0f79700 1 -- 172.21.15.1:0/3046719913 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400bdc0 con 0x7f0bcc154250 2023-11-15T01:37:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd41df700 1 -- 172.21.15.1:0/3046719913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bcc154250 msgr2=0x7f0bcc154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd41df700 1 --2- 172.21.15.1:0/3046719913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bcc154250 0x7f0bcc154630 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f0bc4009f20 tx=0x7f0bc4009840).stop 2023-11-15T01:37:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd41df700 1 -- 172.21.15.1:0/3046719913 shutdown_connections 2023-11-15T01:37:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd41df700 1 --2- 172.21.15.1:0/3046719913 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bcc0aa700 0x7f0bcc0c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd41df700 1 --2- 172.21.15.1:0/3046719913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bcc154250 0x7f0bcc154630 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd41df700 1 -- 172.21.15.1:0/3046719913 >> 172.21.15.1:0/3046719913 conn(0x7f0bcc0c7b20 msgr2=0x7f0bcc0c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:35.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd41df700 1 -- 172.21.15.1:0/3046719913 shutdown_connections 2023-11-15T01:37:35.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.970+0000 7f0bd41df700 1 -- 172.21.15.1:0/3046719913 wait complete. 2023-11-15T01:37:35.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.972+0000 7f0bd41df700 1 Processor -- start 2023-11-15T01:37:35.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.972+0000 7f0bd41df700 1 -- start start 2023-11-15T01:37:35.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.972+0000 7f0bd41df700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bcc0aa700 0x7f0bcc153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.972+0000 7f0bd41df700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0bcc0c6110 0x7f0bcc0ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.972+0000 7f0bd41df700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bcc154250 0x7f0bcc0ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.972+0000 7f0bd41df700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc13f5c0 con 0x7f0bcc0aa700 2023-11-15T01:37:35.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.972+0000 7f0bd41df700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0c3e50 con 0x7f0bcc0c6110 2023-11-15T01:37:35.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.972+0000 7f0bd41df700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0c4130 con 0x7f0bcc154250 2023-11-15T01:37:35.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.972+0000 7f0bd1f7b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bcc0aa700 0x7f0bcc153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:35.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.972+0000 7f0bd1f7b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bcc0aa700 0x7f0bcc153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43678/0 (socket says 172.21.15.1:43678) 2023-11-15T01:37:35.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.972+0000 7f0bd1f7b700 1 -- 172.21.15.1:0/2076094153 learned_addr learned my addr 172.21.15.1:0/2076094153 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:35.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.973+0000 7f0bd277c700 1 --2- 172.21.15.1:0/2076094153 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bcc154250 0x7f0bcc0ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:35.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.973+0000 7f0bd177a700 1 --2- 172.21.15.1:0/2076094153 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0bcc0c6110 0x7f0bcc0ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:35.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.973+0000 7f0bd1f7b700 1 -- 172.21.15.1:0/2076094153 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bcc154250 msgr2=0x7f0bcc0ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:35.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.973+0000 7f0bd1f7b700 1 --2- 172.21.15.1:0/2076094153 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bcc154250 0x7f0bcc0ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.973+0000 7f0bd1f7b700 1 -- 172.21.15.1:0/2076094153 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0bcc0c6110 msgr2=0x7f0bcc0ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:35.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.973+0000 7f0bd1f7b700 1 --2- 172.21.15.1:0/2076094153 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0bcc0c6110 0x7f0bcc0ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.973+0000 7f0bd1f7b700 1 -- 172.21.15.1:0/2076094153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc4009ae0 con 0x7f0bcc0aa700 2023-11-15T01:37:35.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.973+0000 7f0bd177a700 1 --2- 172.21.15.1:0/2076094153 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0bcc0c6110 0x7f0bcc0ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:35.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.973+0000 7f0bd1f7b700 1 --2- 172.21.15.1:0/2076094153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bcc0aa700 0x7f0bcc153180 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f0bc400b6c0 tx=0x7f0bc4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:35.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.973+0000 7f0bc1ffb700 1 -- 172.21.15.1:0/2076094153 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc401f480 con 0x7f0bcc0aa700 2023-11-15T01:37:35.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.973+0000 7f0bc1ffb700 1 -- 172.21.15.1:0/2076094153 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc401f5e0 con 0x7f0bcc0aa700 2023-11-15T01:37:35.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.973+0000 7f0bd41df700 1 -- 172.21.15.1:0/2076094153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc0c4410 con 0x7f0bcc0aa700 2023-11-15T01:37:35.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.973+0000 7f0bc1ffb700 1 -- 172.21.15.1:0/2076094153 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc401f960 con 0x7f0bcc0aa700 2023-11-15T01:37:35.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.973+0000 7f0bd41df700 1 -- 172.21.15.1:0/2076094153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc0c49d0 con 0x7f0bcc0aa700 2023-11-15T01:37:35.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.975+0000 7f0bc1ffb700 1 -- 172.21.15.1:0/2076094153 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0bc4003040 con 0x7f0bcc0aa700 2023-11-15T01:37:35.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.975+0000 7f0bc1ffb700 1 --2- 172.21.15.1:0/2076094153 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0bb005f270 0x7f0bb0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.975+0000 7f0bc1ffb700 1 -- 172.21.15.1:0/2076094153 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f0bc407c170 con 0x7f0bcc0aa700 2023-11-15T01:37:35.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.975+0000 7f0bd177a700 1 --2- 172.21.15.1:0/2076094153 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0bb005f270 0x7f0bb0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:35.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.976+0000 7f0bd177a700 1 --2- 172.21.15.1:0/2076094153 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0bb005f270 0x7f0bb0061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0bcc0c5120 tx=0x7f0bbc009040).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:35.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.977+0000 7f0be5b78b80 1 Processor -- start 2023-11-15T01:37:35.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.977+0000 7f0be5b78b80 1 -- start start 2023-11-15T01:37:35.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0be5b78b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c58dfe40 0x5623c5b4bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0be5b78b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 0x5623c5b237c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0be5b78b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c5b23cb0 0x5623c5b1e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0be5b78b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623c5ae9060 con 0x5623c58dfe40 2023-11-15T01:37:35.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0be5b78b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623c5a601f0 con 0x5623c5b23cb0 2023-11-15T01:37:35.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0be5b78b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623c5a75440 con 0x5623c5b6cea0 2023-11-15T01:37:35.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0bd1f7b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c58dfe40 0x5623c5b4bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:35.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0bd1f7b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c58dfe40 0x5623c5b4bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43686/0 (socket says 172.21.15.1:43686) 2023-11-15T01:37:35.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0bd1f7b700 1 -- 172.21.15.1:0/1248468585 learned_addr learned my addr 172.21.15.1:0/1248468585 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:35.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0bd177a700 1 --2- 172.21.15.1:0/1248468585 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 0x5623c5b237c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:35.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0bd277c700 1 --2- 172.21.15.1:0/1248468585 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c5b23cb0 0x5623c5b1e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:35.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0bd1f7b700 1 -- 172.21.15.1:0/1248468585 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 msgr2=0x5623c5b237c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:35.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0bd1f7b700 1 --2- 172.21.15.1:0/1248468585 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 0x5623c5b237c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0bd1f7b700 1 -- 172.21.15.1:0/1248468585 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c5b23cb0 msgr2=0x5623c5b1e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:35.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0bd1f7b700 1 --2- 172.21.15.1:0/1248468585 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c5b23cb0 0x5623c5b1e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0bd1f7b700 1 -- 172.21.15.1:0/1248468585 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623c5a6e620 con 0x5623c58dfe40 2023-11-15T01:37:35.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0bd277c700 1 --2- 172.21.15.1:0/1248468585 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c5b23cb0 0x5623c5b1e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:37:35.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.978+0000 7f0bd1f7b700 1 --2- 172.21.15.1:0/1248468585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c58dfe40 0x5623c5b4bd90 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f0bc407a370 tx=0x7f0bc400e000).ready entity=mon.0 client_cookie=83b5b0e60c0d2721 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:35.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.979+0000 7f0bb6ffd700 1 -- 172.21.15.1:0/1248468585 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc404efc0 con 0x5623c58dfe40 2023-11-15T01:37:35.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.979+0000 7f0bb6ffd700 1 -- 172.21.15.1:0/1248468585 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc404f220 con 0x5623c58dfe40 2023-11-15T01:37:35.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.979+0000 7f0bb6ffd700 1 -- 172.21.15.1:0/1248468585 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc401fd50 con 0x5623c58dfe40 2023-11-15T01:37:35.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.979+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1248468585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c58dfe40 msgr2=0x5623c5b4bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:35.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.979+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1248468585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c58dfe40 0x5623c5b4bd90 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f0bc407a370 tx=0x7f0bc400e000).stop 2023-11-15T01:37:35.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.979+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1248468585 shutdown_connections 2023-11-15T01:37:35.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.979+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1248468585 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c5b23cb0 0x5623c5b1e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.979+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1248468585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c58dfe40 0x5623c5b4bd90 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.979+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1248468585 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 0x5623c5b237c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:35.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.979+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1248468585 >> 172.21.15.1:0/1248468585 conn(0x5623c598d4a0 msgr2=0x5623c5b6c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:35.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.979+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1248468585 shutdown_connections 2023-11-15T01:37:35.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.979+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1248468585 wait complete. 2023-11-15T01:37:35.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.980+0000 7f0be5b78b80 1 -- start start 2023-11-15T01:37:35.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.980+0000 7f0be5b78b80 1 Processor -- start 2023-11-15T01:37:35.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0be5b78b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c58dfe40 0x5623c5b4f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0be5b78b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b23cb0 0x5623c5b4f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0be5b78b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 0x5623c5b4fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:35.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0be5b78b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623c5a75580 con 0x5623c5b23cb0 2023-11-15T01:37:35.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0be5b78b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623c5a75800 con 0x5623c58dfe40 2023-11-15T01:37:35.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0be5b78b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623c5a40e10 con 0x5623c5b6cea0 2023-11-15T01:37:35.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0be5b78b80 10 client.0 ll_register_callbacks cb 0x5623c5ae3460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:37:35.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0bd177a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b23cb0 0x5623c5b4f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0bd177a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b23cb0 0x5623c5b4f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43692/0 (socket says 172.21.15.1:43692) 2023-11-15T01:37:36.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0bd177a700 1 -- 172.21.15.1:0/1781824200 learned_addr learned my addr 172.21.15.1:0/1781824200 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:36.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0bd277c700 1 --2- 172.21.15.1:0/1781824200 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 0x5623c5b4fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0bd1f7b700 1 --2- 172.21.15.1:0/1781824200 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c58dfe40 0x5623c5b4f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0bd177a700 1 -- 172.21.15.1:0/1781824200 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 msgr2=0x5623c5b4fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:36.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0bd177a700 1 --2- 172.21.15.1:0/1781824200 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 0x5623c5b4fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0bd177a700 1 -- 172.21.15.1:0/1781824200 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c58dfe40 msgr2=0x5623c5b4f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:36.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0bd177a700 1 --2- 172.21.15.1:0/1781824200 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c58dfe40 0x5623c5b4f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0bd177a700 1 -- 172.21.15.1:0/1781824200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc0c49d0 con 0x5623c5b23cb0 2023-11-15T01:37:36.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0bd177a700 1 --2- 172.21.15.1:0/1781824200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b23cb0 0x5623c5b4f740 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f0bbc013cd0 tx=0x7f0bbc015040).ready entity=mon.0 client_cookie=8c62fb2cbb26bbe8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:36.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0babfff700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:37:36.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.981+0000 7f0babfff700 1 -- 172.21.15.1:0/1781824200 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc00eb80 con 0x5623c5b23cb0 2023-11-15T01:37:36.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.982+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1781824200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623c5b17720 con 0x5623c5b23cb0 2023-11-15T01:37:36.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.982+0000 7f0babfff700 1 -- 172.21.15.1:0/1781824200 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f0bbc00ece0 con 0x5623c5b23cb0 2023-11-15T01:37:36.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.982+0000 7f0babfff700 1 -- 172.21.15.1:0/1781824200 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bbc020640 con 0x5623c5b23cb0 2023-11-15T01:37:36.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.982+0000 7f0be5b78b80 10 client.7308 fetch_fsmap learned FSMap version 47 2023-11-15T01:37:36.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.982+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1781824200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x5623c5a699c0 con 0x5623c5b23cb0 2023-11-15T01:37:36.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.982+0000 7f0babfff700 1 -- 172.21.15.1:0/1781824200 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5623c5b17720 con 0x5623c5b23cb0 2023-11-15T01:37:36.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.982+0000 7f0babfff700 1 -- 172.21.15.1:0/1781824200 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 47) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0bbc0207a0 con 0x5623c5b23cb0 2023-11-15T01:37:36.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.982+0000 7f0be5b78b80 10 client.7308 fetch_fsmap finished waiting for FSMap version 47 2023-11-15T01:37:36.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.982+0000 7f0be5b78b80 10 client.7308 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-15T01:37:36.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.982+0000 7f0be5b78b80 20 client.7308 populate_metadata read hostname 'smithi001' 2023-11-15T01:37:36.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.982+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1781824200 >> [v2:172.21.15.141:6835/173614126,v1:172.21.15.141:6837/173614126] conn(0x5623c5b4b420 0x5623c5b4c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.982+0000 7f0be5b78b80 4 client.7308 mds_command: new command op to 7155 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-15T01:37:36.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.982+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1781824200 --> [v2:172.21.15.141:6835/173614126,v1:172.21.15.141:6837/173614126] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623c58dbca0 con 0x5623c5b4b420 2023-11-15T01:37:36.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.982+0000 7f0bd1f7b700 1 --2- 172.21.15.1:0/1781824200 >> [v2:172.21.15.141:6835/173614126,v1:172.21.15.141:6837/173614126] conn(0x5623c5b4b420 0x5623c5b4c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.983+0000 7f0bd1f7b700 1 --2- 172.21.15.1:0/1781824200 >> [v2:172.21.15.141:6835/173614126,v1:172.21.15.141:6837/173614126] conn(0x5623c5b4b420 0x5623c5b4c8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9cc6fd5c252dfe99 server_cookie=bc5dc93ff11abae8 in_seq=0 out_seq=0 2023-11-15T01:37:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.983+0000 7f0babfff700 10 client.7308 ms_handle_connect on v2:172.21.15.141:6835/173614126 2023-11-15T01:37:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.984+0000 7f0babfff700 1 -- 172.21.15.1:0/1781824200 <== mds.0 v2:172.21.15.141:6835/173614126 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5623c58dbca0 con 0x5623c5b4b420 2023-11-15T01:37:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.984+0000 7f0babfff700 10 client.7308 handle_command_reply: tid=0 2023-11-15T01:37:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.984+0000 7f0be5b78b80 1 client.7308 shutdown 2023-11-15T01:37:36.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.984+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1781824200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b23cb0 msgr2=0x5623c5b4f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:36.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.984+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1781824200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b23cb0 0x5623c5b4f740 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f0bbc013cd0 tx=0x7f0bbc015040).stop 2023-11-15T01:37:36.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.984+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1781824200 shutdown_connections 2023-11-15T01:37:36.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.984+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1781824200 >> [v2:172.21.15.141:6835/173614126,v1:172.21.15.141:6837/173614126] conn(0x5623c5b4b420 0x5623c5b4c8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.984+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1781824200 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 0x5623c5b4fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.984+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1781824200 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c58dfe40 0x5623c5b4f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.984+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1781824200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b23cb0 0x5623c5b4f740 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.984+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1781824200 >> 172.21.15.1:0/1781824200 conn(0x5623c598d4a0 msgr2=0x5623c5b24110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:36.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.984+0000 7f0babfff700 0 client.7308 ms_handle_reset on v2:172.21.15.141:6835/173614126 2023-11-15T01:37:36.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.984+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1781824200 shutdown_connections 2023-11-15T01:37:36.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.984+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1781824200 wait complete. 2023-11-15T01:37:36.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:35.984+0000 7f0be5b78b80 20 client.7308 trim_cache size 0 max 16384 2023-11-15T01:37:36.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.001+0000 7f0be5b78b80 1 Processor -- start 2023-11-15T01:37:36.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.001+0000 7f0be5b78b80 1 -- start start 2023-11-15T01:37:36.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.001+0000 7f0be5b78b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c58dfe40 0x5623c5b4c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.001+0000 7f0be5b78b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b23cb0 0x5623c5b4cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.001+0000 7f0be5b78b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b6cea0 0x5623c5b80ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.001+0000 7f0be5b78b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623c5b81d30 con 0x5623c5b6cea0 2023-11-15T01:37:36.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.001+0000 7f0be5b78b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623c5b4ef90 con 0x5623c58dfe40 2023-11-15T01:37:36.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.001+0000 7f0be5b78b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623c5b4d410 con 0x5623c5b23cb0 2023-11-15T01:37:36.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.002+0000 7f0bd277c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b6cea0 0x5623c5b80ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.002+0000 7f0bd277c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b6cea0 0x5623c5b80ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43704/0 (socket says 172.21.15.1:43704) 2023-11-15T01:37:36.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.002+0000 7f0bd277c700 1 -- 172.21.15.1:0/1281274497 learned_addr learned my addr 172.21.15.1:0/1281274497 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:36.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.002+0000 7f0bd277c700 1 -- 172.21.15.1:0/1281274497 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b23cb0 msgr2=0x5623c5b4cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:36.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.002+0000 7f0bd277c700 1 --2- 172.21.15.1:0/1281274497 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b23cb0 0x5623c5b4cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:36.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.002+0000 7f0bd277c700 1 -- 172.21.15.1:0/1281274497 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c58dfe40 msgr2=0x5623c5b4c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:36.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.002+0000 7f0bd277c700 1 --2- 172.21.15.1:0/1281274497 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c58dfe40 0x5623c5b4c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:36.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.002+0000 7f0bd277c700 1 -- 172.21.15.1:0/1281274497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623c5b17340 con 0x5623c5b6cea0 2023-11-15T01:37:36.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.002+0000 7f0bd277c700 1 --2- 172.21.15.1:0/1281274497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b6cea0 0x5623c5b80ea0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f0bcc0cb050 tx=0x7f0bc8008040).ready entity=mon.0 client_cookie=f538aa51e18cff60 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:36.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.002+0000 7f0bb77fe700 1 -- 172.21.15.1:0/1281274497 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc800a640 con 0x5623c5b6cea0 2023-11-15T01:37:36.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.002+0000 7f0bb77fe700 1 -- 172.21.15.1:0/1281274497 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc800c030 con 0x5623c5b6cea0 2023-11-15T01:37:36.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.002+0000 7f0bb77fe700 1 -- 172.21.15.1:0/1281274497 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc80127c0 con 0x5623c5b6cea0 2023-11-15T01:37:36.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.003+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1281274497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b6cea0 msgr2=0x5623c5b80ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:36.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.003+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1281274497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b6cea0 0x5623c5b80ea0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f0bcc0cb050 tx=0x7f0bc8008040).stop 2023-11-15T01:37:36.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.003+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1281274497 shutdown_connections 2023-11-15T01:37:36.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.003+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1281274497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b6cea0 0x5623c5b80ea0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.003+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1281274497 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c58dfe40 0x5623c5b4c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:36.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.003+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1281274497 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b23cb0 0x5623c5b4cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:36.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.003+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1281274497 >> 172.21.15.1:0/1281274497 conn(0x5623c598d4a0 msgr2=0x5623c5b24c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:36.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.003+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1281274497 shutdown_connections 2023-11-15T01:37:36.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.003+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1281274497 wait complete. 2023-11-15T01:37:36.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.003+0000 7f0be5b78b80 1 -- start start 2023-11-15T01:37:36.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.003+0000 7f0be5b78b80 1 Processor -- start 2023-11-15T01:37:36.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.004+0000 7f0be5b78b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c58dfe40 0x5623c5b24090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.004+0000 7f0be5b78b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b23cb0 0x5623c5bcd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.004+0000 7f0be5b78b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 0x5623c5b39070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.004+0000 7f0be5b78b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623c5b1e160 con 0x5623c5b23cb0 2023-11-15T01:37:36.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.004+0000 7f0be5b78b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623c5b81880 con 0x5623c58dfe40 2023-11-15T01:37:36.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.004+0000 7f0be5b78b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623c5b24600 con 0x5623c5b6cea0 2023-11-15T01:37:36.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.004+0000 7f0be5b78b80 10 client.0 ll_register_callbacks cb 0x5623c5ae3460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:37:36.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.004+0000 7f0bd177a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b23cb0 0x5623c5bcd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.004+0000 7f0bd177a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b23cb0 0x5623c5bcd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43708/0 (socket says 172.21.15.1:43708) 2023-11-15T01:37:36.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.004+0000 7f0bd177a700 1 -- 172.21.15.1:0/1149021839 learned_addr learned my addr 172.21.15.1:0/1149021839 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:36.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.004+0000 7f0bd277c700 1 --2- 172.21.15.1:0/1149021839 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 0x5623c5b39070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.004+0000 7f0bd1f7b700 1 --2- 172.21.15.1:0/1149021839 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c58dfe40 0x5623c5b24090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0bd177a700 1 -- 172.21.15.1:0/1149021839 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 msgr2=0x5623c5b39070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:36.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0bd177a700 1 --2- 172.21.15.1:0/1149021839 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 0x5623c5b39070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0bd177a700 1 -- 172.21.15.1:0/1149021839 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c58dfe40 msgr2=0x5623c5b24090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:36.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0bd177a700 1 --2- 172.21.15.1:0/1149021839 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c58dfe40 0x5623c5b24090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0bd177a700 1 -- 172.21.15.1:0/1149021839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc800e040 con 0x5623c5b23cb0 2023-11-15T01:37:36.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0bd277c700 1 --2- 172.21.15.1:0/1149021839 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 0x5623c5b39070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:36.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0bd1f7b700 1 --2- 172.21.15.1:0/1149021839 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c58dfe40 0x5623c5b24090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:36.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0bd177a700 1 --2- 172.21.15.1:0/1149021839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b23cb0 0x5623c5bcd220 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f0bbc013cd0 tx=0x7f0bbc018000).ready entity=mon.0 client_cookie=f9184902ee657583 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:36.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0babfff700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:37:36.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0babfff700 1 -- 172.21.15.1:0/1149021839 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc020640 con 0x5623c5b23cb0 2023-11-15T01:37:36.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1149021839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0bc404f220 con 0x5623c5b23cb0 2023-11-15T01:37:36.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0babfff700 1 -- 172.21.15.1:0/1149021839 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f0bbc0207a0 con 0x5623c5b23cb0 2023-11-15T01:37:36.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0babfff700 1 -- 172.21.15.1:0/1149021839 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bbc00eb80 con 0x5623c5b23cb0 2023-11-15T01:37:36.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0be5b78b80 10 client.7314 fetch_fsmap learned FSMap version 47 2023-11-15T01:37:36.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1149021839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x5623c5b23b20 con 0x5623c5b23cb0 2023-11-15T01:37:36.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0babfff700 1 -- 172.21.15.1:0/1149021839 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc404f220 con 0x5623c5b23cb0 2023-11-15T01:37:36.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0babfff700 1 -- 172.21.15.1:0/1149021839 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 47) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0bbc00ece0 con 0x5623c5b23cb0 2023-11-15T01:37:36.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0be5b78b80 10 client.7314 fetch_fsmap finished waiting for FSMap version 47 2023-11-15T01:37:36.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0be5b78b80 10 client.7314 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-15T01:37:36.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0be5b78b80 20 client.7314 populate_metadata read hostname 'smithi001' 2023-11-15T01:37:36.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1149021839 >> [v2:172.21.15.141:6835/173614126,v1:172.21.15.141:6837/173614126] conn(0x5623c5b4c8f0 0x5623c5b4ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0be5b78b80 4 client.7314 mds_command: new command op to 7155 tid=0[{"prefix": "status"}] 2023-11-15T01:37:36.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.005+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1149021839 --> [v2:172.21.15.141:6835/173614126,v1:172.21.15.141:6837/173614126] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5623c5912ca0 con 0x5623c5b4c8f0 2023-11-15T01:37:36.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0bd1f7b700 1 --2- 172.21.15.1:0/1149021839 >> [v2:172.21.15.141:6835/173614126,v1:172.21.15.141:6837/173614126] conn(0x5623c5b4c8f0 0x5623c5b4ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0babfff700 10 client.7314 ms_handle_connect on v2:172.21.15.141:6835/173614126 2023-11-15T01:37:36.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0bd1f7b700 1 --2- 172.21.15.1:0/1149021839 >> [v2:172.21.15.141:6835/173614126,v1:172.21.15.141:6837/173614126] conn(0x5623c5b4c8f0 0x5623c5b4ccd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6cff7c993e9e0746 server_cookie=dca9ee043dee8da3 in_seq=0 out_seq=0 2023-11-15T01:37:36.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0babfff700 1 -- 172.21.15.1:0/1149021839 <== mds.0 v2:172.21.15.141:6835/173614126 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5623c5912ca0 con 0x5623c5b4c8f0 2023-11-15T01:37:36.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0babfff700 10 client.7314 handle_command_reply: tid=0 2023-11-15T01:37:36.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0be5b78b80 1 client.7314 shutdown 2023-11-15T01:37:36.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1149021839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b23cb0 msgr2=0x5623c5bcd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:36.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1149021839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b23cb0 0x5623c5bcd220 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f0bbc013cd0 tx=0x7f0bbc018000).stop 2023-11-15T01:37:36.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1149021839 shutdown_connections 2023-11-15T01:37:36.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1149021839 >> [v2:172.21.15.141:6835/173614126,v1:172.21.15.141:6837/173614126] conn(0x5623c5b4c8f0 0x5623c5b4ccd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1149021839 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5623c5b6cea0 0x5623c5b39070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1149021839 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5623c58dfe40 0x5623c5b24090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0babfff700 0 client.7314 ms_handle_reset on v2:172.21.15.141:6835/173614126 2023-11-15T01:37:36.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0be5b78b80 1 --2- 172.21.15.1:0/1149021839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623c5b23cb0 0x5623c5bcd220 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1149021839 >> 172.21.15.1:0/1149021839 conn(0x5623c598d4a0 msgr2=0x5623c5b4f710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:36.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1149021839 shutdown_connections 2023-11-15T01:37:36.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.006+0000 7f0be5b78b80 1 -- 172.21.15.1:0/1149021839 wait complete. 2023-11-15T01:37:36.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.007+0000 7f0be5b78b80 20 client.7314 trim_cache size 0 max 16384 2023-11-15T01:37:36.038 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T01:37:36.039 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "32ffb44b-12dc-4e79-bad7-24a9692dabf6", 2023-11-15T01:37:36.039 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2023-11-15T01:37:36.039 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 7155, 2023-11-15T01:37:36.040 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2023-11-15T01:37:36.040 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2023-11-15T01:37:36.040 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2023-11-15T01:37:36.040 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 10.221915961000001, 2023-11-15T01:37:36.041 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 47, 2023-11-15T01:37:36.041 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 109, 2023-11-15T01:37:36.041 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 109, 2023-11-15T01:37:36.041 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 15.698866541999999 2023-11-15T01:37:36.041 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T01:37:36.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.007+0000 7f0bd41df700 1 -- 172.21.15.1:0/2076094153 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0bb005f270 msgr2=0x7f0bb0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:36.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.007+0000 7f0bd41df700 1 --2- 172.21.15.1:0/2076094153 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0bb005f270 0x7f0bb0061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0bcc0c5120 tx=0x7f0bbc009040).stop 2023-11-15T01:37:36.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.007+0000 7f0bd41df700 1 -- 172.21.15.1:0/2076094153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bcc0aa700 msgr2=0x7f0bcc153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:36.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.007+0000 7f0bd41df700 1 --2- 172.21.15.1:0/2076094153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bcc0aa700 0x7f0bcc153180 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f0bc400b6c0 tx=0x7f0bc4009840).stop 2023-11-15T01:37:36.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.007+0000 7f0bd41df700 1 -- 172.21.15.1:0/2076094153 shutdown_connections 2023-11-15T01:37:36.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.007+0000 7f0bd41df700 1 --2- 172.21.15.1:0/2076094153 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0bb005f270 0x7f0bb0061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.007+0000 7f0bd41df700 1 --2- 172.21.15.1:0/2076094153 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bcc154250 0x7f0bcc0ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.007+0000 7f0bd41df700 1 --2- 172.21.15.1:0/2076094153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bcc0aa700 0x7f0bcc153180 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.007+0000 7f0bd41df700 1 --2- 172.21.15.1:0/2076094153 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0bcc0c6110 0x7f0bcc0ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.007+0000 7f0bd41df700 1 -- 172.21.15.1:0/2076094153 >> 172.21.15.1:0/2076094153 conn(0x7f0bcc0c7b20 msgr2=0x7f0bcc14dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:36.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.007+0000 7f0bd41df700 1 -- 172.21.15.1:0/2076094153 shutdown_connections 2023-11-15T01:37:36.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.007+0000 7f0bd41df700 1 -- 172.21.15.1:0/2076094153 wait complete. 2023-11-15T01:37:36.046 DEBUG:teuthology.orchestra.run.smithi001:> ceph fs ls 2023-11-15T01:37:36.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.149+0000 7f20d9829700 1 Processor -- start 2023-11-15T01:37:36.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.150+0000 7f20d9829700 1 -- start start 2023-11-15T01:37:36.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.150+0000 7f20d9829700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20d4154410 0x7f20d40ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.150+0000 7f20d9829700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f20d4158cf0 0x7f20d40ab580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.150+0000 7f20d9829700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d4158150 con 0x7f20d4062c10 2023-11-15T01:37:36.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.150+0000 7f20d9829700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d4063670 con 0x7f20d4158cf0 2023-11-15T01:37:36.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.150+0000 7f20d9829700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d4063950 con 0x7f20d4154410 2023-11-15T01:37:36.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d27fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f20d4062c10 0x7f20d41585e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45050/0 (socket says 172.21.15.1:45050) 2023-11-15T01:37:36.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d27fc700 1 -- 172.21.15.1:0/3892965809 learned_addr learned my addr 172.21.15.1:0/3892965809 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:36.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d2ffd700 1 --2- 172.21.15.1:0/3892965809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20d4154410 0x7f20d40ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d37fe700 1 --2- 172.21.15.1:0/3892965809 >> v2:172.21.15.141:3300/0 conn(0x7f20d4158cf0 0x7f20d40ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 -- 172.21.15.1:0/3892965809 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174898970 0 0) 0x7f20d4158150 con 0x7f20d4062c10 2023-11-15T01:37:36.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 -- 172.21.15.1:0/3892965809 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20c00033f0 con 0x7f20d4062c10 2023-11-15T01:37:36.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 -- 172.21.15.1:0/3892965809 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1151880774 0 0) 0x7f20c00033f0 con 0x7f20d4062c10 2023-11-15T01:37:36.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 -- 172.21.15.1:0/3892965809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20d4154410 msgr2=0x7f20d40ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:36.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 --2- 172.21.15.1:0/3892965809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20d4154410 0x7f20d40ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 -- 172.21.15.1:0/3892965809 >> v2:172.21.15.141:3300/0 conn(0x7f20d4158cf0 msgr2=0x7f20d40ab580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:36.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 --2- 172.21.15.1:0/3892965809 >> v2:172.21.15.141:3300/0 conn(0x7f20d4158cf0 0x7f20d40ab580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 -- 172.21.15.1:0/3892965809 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d4063c30 con 0x7f20d4062c10 2023-11-15T01:37:36.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 -- 172.21.15.1:0/3892965809 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f20bc001470 con 0x7f20d4062c10 2023-11-15T01:37:36.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 -- 172.21.15.1:0/3892965809 >> v1:172.21.15.1:6789/0 conn(0x7f20d4062c10 legacy=0x7f20d41585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:36.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 --2- 172.21.15.1:0/3892965809 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20c00038e0 0x7f20c0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 --2- 172.21.15.1:0/3892965809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20c0004690 0x7f20c0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 --2- 172.21.15.1:0/3892965809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20c0005000 0x7f20c000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 -- 172.21.15.1:0/3892965809 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d4063670 con 0x7f20c0005000 2023-11-15T01:37:36.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 -- 172.21.15.1:0/3892965809 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d4063950 con 0x7f20c00038e0 2023-11-15T01:37:36.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d1ffb700 1 -- 172.21.15.1:0/3892965809 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c000bdd0 con 0x7f20c0004690 2023-11-15T01:37:36.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d2ffd700 1 --2- 172.21.15.1:0/3892965809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20d4154410 0x7f20d40ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:36.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d37fe700 1 --2- 172.21.15.1:0/3892965809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20c0005000 0x7f20c000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.151+0000 7f20d27fc700 1 --2- 172.21.15.1:0/3892965809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20c0004690 0x7f20c0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.152+0000 7f20d2ffd700 1 --2- 172.21.15.1:0/3892965809 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20c00038e0 0x7f20c0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.152+0000 7f20d37fe700 1 -- 172.21.15.1:0/3892965809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20c0004690 msgr2=0x7f20c0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:36.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.152+0000 7f20d37fe700 1 --2- 172.21.15.1:0/3892965809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20c0004690 0x7f20c0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.152+0000 7f20d37fe700 1 -- 172.21.15.1:0/3892965809 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20c00038e0 msgr2=0x7f20c0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:36.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.152+0000 7f20d37fe700 1 --2- 172.21.15.1:0/3892965809 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20c00038e0 0x7f20c0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.152+0000 7f20d37fe700 1 -- 172.21.15.1:0/3892965809 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c00033f0 con 0x7f20c0005000 2023-11-15T01:37:36.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.152+0000 7f20d27fc700 1 --2- 172.21.15.1:0/3892965809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20c0004690 0x7f20c0004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:36.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.152+0000 7f20d2ffd700 1 --2- 172.21.15.1:0/3892965809 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20c00038e0 0x7f20c0003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:36.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.152+0000 7f20d37fe700 1 --2- 172.21.15.1:0/3892965809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20c0005000 0x7f20c000b8e0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f20d40aae80 tx=0x7f20cc009060).ready entity=mon.0 client_cookie=7aa3924ea7287de1 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:36.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.152+0000 7f20d1ffb700 1 -- 172.21.15.1:0/3892965809 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc009e90 con 0x7f20c0005000 2023-11-15T01:37:36.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.152+0000 7f20d1ffb700 1 -- 172.21.15.1:0/3892965809 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc009430 con 0x7f20c0005000 2023-11-15T01:37:36.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.152+0000 7f20d1ffb700 1 -- 172.21.15.1:0/3892965809 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc00e850 con 0x7f20c0005000 2023-11-15T01:37:36.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.152+0000 7f20d9829700 1 -- 172.21.15.1:0/3892965809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20c0005000 msgr2=0x7f20c000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:36.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.152+0000 7f20d9829700 1 --2- 172.21.15.1:0/3892965809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20c0005000 0x7f20c000b8e0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f20d40aae80 tx=0x7f20cc009060).stop 2023-11-15T01:37:36.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.152+0000 7f20d37fe700 1 -- 172.21.15.1:0/3892965809 reap_dead start 2023-11-15T01:37:36.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.153+0000 7f20d9829700 1 -- 172.21.15.1:0/3892965809 shutdown_connections 2023-11-15T01:37:36.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.153+0000 7f20d9829700 1 -- 172.21.15.1:0/3892965809 >> 172.21.15.1:0/3892965809 conn(0x7f20d40cbbd0 msgr2=0x7f20d40c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:36.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.153+0000 7f20d9829700 1 -- 172.21.15.1:0/3892965809 shutdown_connections 2023-11-15T01:37:36.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.153+0000 7f20d9829700 1 -- 172.21.15.1:0/3892965809 wait complete. 2023-11-15T01:37:36.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.154+0000 7f20d9829700 1 Processor -- start 2023-11-15T01:37:36.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.154+0000 7f20d9829700 1 -- start start 2023-11-15T01:37:36.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d9829700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20d414c9a0 0x7f20d414cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d9829700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20d40b0850 0x7f20d40ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d9829700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20d40ca8b0 0x7f20d4164980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d9829700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d414d5c0 con 0x7f20d414c9a0 2023-11-15T01:37:36.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d9829700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d40cad30 con 0x7f20d40b0850 2023-11-15T01:37:36.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d9829700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d4165610 con 0x7f20d40ca8b0 2023-11-15T01:37:36.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20d414c9a0 0x7f20d414cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20d414c9a0 0x7f20d414cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43728/0 (socket says 172.21.15.1:43728) 2023-11-15T01:37:36.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d2ffd700 1 -- 172.21.15.1:0/2918109460 learned_addr learned my addr 172.21.15.1:0/2918109460 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:36.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d37fe700 1 --2- 172.21.15.1:0/2918109460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20d40ca8b0 0x7f20d4164980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d27fc700 1 --2- 172.21.15.1:0/2918109460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20d40b0850 0x7f20d40ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d2ffd700 1 -- 172.21.15.1:0/2918109460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20d40ca8b0 msgr2=0x7f20d4164980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:36.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d2ffd700 1 --2- 172.21.15.1:0/2918109460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20d40ca8b0 0x7f20d4164980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d2ffd700 1 -- 172.21.15.1:0/2918109460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20d40b0850 msgr2=0x7f20d40ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:36.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d2ffd700 1 --2- 172.21.15.1:0/2918109460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20d40b0850 0x7f20d40ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d2ffd700 1 -- 172.21.15.1:0/2918109460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d41658f0 con 0x7f20d414c9a0 2023-11-15T01:37:36.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d27fc700 1 --2- 172.21.15.1:0/2918109460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20d40b0850 0x7f20d40ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:37:36.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20d2ffd700 1 --2- 172.21.15.1:0/2918109460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20d414c9a0 0x7f20d414cd80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f20c40114b0 tx=0x7f20c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:36.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20caffd700 1 -- 172.21.15.1:0/2918109460 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c400e030 con 0x7f20d414c9a0 2023-11-15T01:37:36.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.155+0000 7f20caffd700 1 -- 172.21.15.1:0/2918109460 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c40153f0 con 0x7f20d414c9a0 2023-11-15T01:37:36.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.156+0000 7f20d9829700 1 -- 172.21.15.1:0/2918109460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d40afd70 con 0x7f20d414c9a0 2023-11-15T01:37:36.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.156+0000 7f20caffd700 1 -- 172.21.15.1:0/2918109460 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c4011ee0 con 0x7f20d414c9a0 2023-11-15T01:37:36.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.156+0000 7f20d9829700 1 -- 172.21.15.1:0/2918109460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d40b0330 con 0x7f20d414c9a0 2023-11-15T01:37:36.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.157+0000 7f20d9829700 1 -- 172.21.15.1:0/2918109460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d40475e0 con 0x7f20d414c9a0 2023-11-15T01:37:36.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.157+0000 7f20caffd700 1 -- 172.21.15.1:0/2918109460 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f20c4015a80 con 0x7f20d414c9a0 2023-11-15T01:37:36.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.157+0000 7f20caffd700 1 --2- 172.21.15.1:0/2918109460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f20b405f2a0 0x7f20b4061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:36.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.157+0000 7f20caffd700 1 -- 172.21.15.1:0/2918109460 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f20c400f070 con 0x7f20d414c9a0 2023-11-15T01:37:36.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.158+0000 7f20d27fc700 1 --2- 172.21.15.1:0/2918109460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f20b405f2a0 0x7f20b4061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:36.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.158+0000 7f20d27fc700 1 --2- 172.21.15.1:0/2918109460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f20b405f2a0 0x7f20b4061760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f20bc001030 tx=0x7f20bc009040).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:36.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.161+0000 7f20caffd700 1 -- 172.21.15.1:0/2918109460 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f20c404c170 con 0x7f20d414c9a0 2023-11-15T01:37:36.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.378+0000 7f20d9829700 1 -- 172.21.15.1:0/2918109460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f20d4063f10 con 0x7f20d414c9a0 2023-11-15T01:37:36.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.378+0000 7f20caffd700 1 -- 172.21.15.1:0/2918109460 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f20c404f790 con 0x7f20d414c9a0 2023-11-15T01:37:36.380 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-15T01:37:36.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.380+0000 7f20d9829700 1 -- 172.21.15.1:0/2918109460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f20b405f2a0 msgr2=0x7f20b4061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:36.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.380+0000 7f20d9829700 1 --2- 172.21.15.1:0/2918109460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f20b405f2a0 0x7f20b4061760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f20bc001030 tx=0x7f20bc009040).stop 2023-11-15T01:37:36.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.380+0000 7f20d9829700 1 -- 172.21.15.1:0/2918109460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20d414c9a0 msgr2=0x7f20d414cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:36.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.380+0000 7f20d9829700 1 --2- 172.21.15.1:0/2918109460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20d414c9a0 0x7f20d414cd80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f20c40114b0 tx=0x7f20c400b040).stop 2023-11-15T01:37:36.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.380+0000 7f20d9829700 1 -- 172.21.15.1:0/2918109460 shutdown_connections 2023-11-15T01:37:36.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.380+0000 7f20d9829700 1 --2- 172.21.15.1:0/2918109460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f20b405f2a0 0x7f20b4061760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.380+0000 7f20d9829700 1 --2- 172.21.15.1:0/2918109460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20d40ca8b0 0x7f20d4164980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.380+0000 7f20d9829700 1 --2- 172.21.15.1:0/2918109460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20d414c9a0 0x7f20d414cd80 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.380+0000 7f20d9829700 1 --2- 172.21.15.1:0/2918109460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20d40b0850 0x7f20d40ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:36.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.380+0000 7f20d9829700 1 -- 172.21.15.1:0/2918109460 >> 172.21.15.1:0/2918109460 conn(0x7f20d40cbbd0 msgr2=0x7f20d414df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:36.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.380+0000 7f20d9829700 1 -- 172.21.15.1:0/2918109460 shutdown_connections 2023-11-15T01:37:36.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:36.380+0000 7f20d9829700 1 -- 172.21.15.1:0/2918109460 wait complete. 2023-11-15T01:37:36.392 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-15T01:37:36.392 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-15T01:37:36.393 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-11-15T01:37:36.393 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-15T01:37:36.393 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-15T01:37:36.394 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-15T01:37:36.394 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-15T01:37:36.394 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-15T01:37:36.395 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T01:37:36.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:36.396 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-11-15T01:37:36.411 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:37:36.411 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T01:37:36.412 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T01:37:36.412 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:37:36.412 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-11-15T01:37:36.412 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:37:36.412 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:37:36.413 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-11-15T01:37:36.413 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-11-15T01:37:36.413 INFO:teuthology.orchestra.run.smithi001.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-15T01:37:36.413 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:37:36.413 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-11-15T01:37:36.414 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-15T01:37:36.414 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 41549sec preferred_lft 41549sec 2023-11-15T01:37:36.414 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2023-11-15T01:37:36.414 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:37:36.414 INFO:teuthology.orchestra.run.smithi001.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:37:36.415 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-11-15T01:37:36.415 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-11-15T01:37:36.415 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:37:36.415 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:37:36.415 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-11-15T01:37:36.416 INFO:teuthology.orchestra.run.smithi001.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-15T01:37:36.416 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:37:36.416 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-15T01:37:36.416 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:37:36.416 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::74ff:4aff:fef6:c8f5/64 scope link 2023-11-15T01:37:36.417 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:37:36.417 INFO:teuthology.orchestra.run.smithi001.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:37:36.417 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-15T01:37:36.417 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::10ca:5cff:fe8a:9a23/64 scope link 2023-11-15T01:37:36.417 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:37:36.417 INFO:teuthology.orchestra.run.smithi001.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:37:36.418 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 92:7a:64:05:0f:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-15T01:37:36.418 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::907a:64ff:fe05:f37/64 scope link 2023-11-15T01:37:36.418 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:37:36.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:36.419 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-15T01:37:36.475 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-11-15T01:37:36.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:36.477 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-11-15T01:37:36.533 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-11-15T01:37:36.534 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-15T01:37:36.534 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-15T01:37:36.534 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-15T01:37:36.534 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-15T01:37:36.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:36.535 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:37:36.536 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:37:36.536 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-15T01:37:36.536 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-15T01:37:36.537 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-15T01:37:36.537 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:37:36.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:36.637 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T01:37:36.652 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-15T01:37:36.652 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-15T01:37:36.652 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T01:37:36.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:36.653 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2023-11-15T01:37:36.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:36.718 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-15T01:37:36.772 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-15T01:37:36.772 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:37:36.852 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:37:36.853 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:37:36.878 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:37:36.878 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:37:36.881 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-15T01:37:36.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:37:36.881 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-15T01:37:36.947 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-15T01:37:37.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.105+0000 7fd616ff6700 1 Processor -- start 2023-11-15T01:37:37.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.105+0000 7fd616ff6700 1 -- start start 2023-11-15T01:37:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.106+0000 7fd616ff6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd6101579f0 0x7fd6100657e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.106+0000 7fd616ff6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd610062ec0 0x7fd6100a4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.106+0000 7fd616ff6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd610066a80 con 0x7fd610157dd0 2023-11-15T01:37:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.106+0000 7fd616ff6700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd610066f10 con 0x7fd610062ec0 2023-11-15T01:37:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.106+0000 7fd616ff6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd610065e70 con 0x7fd6101579f0 2023-11-15T01:37:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.106+0000 7fd6167f5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd610062ec0 0x7fd6100a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.106+0000 7fd6157f3700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd610157dd0 0x7fd6100627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45056/0 (socket says 172.21.15.1:45056) 2023-11-15T01:37:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.106+0000 7fd6167f5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd610062ec0 0x7fd6100a4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43730/0 (socket says 172.21.15.1:43730) 2023-11-15T01:37:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.106+0000 7fd6157f3700 1 -- 172.21.15.1:0/2445542350 learned_addr learned my addr 172.21.15.1:0/2445542350 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.106+0000 7fd6167f5700 1 -- 172.21.15.1:0/2445542350 >> v2:172.21.15.141:3300/0 conn(0x7fd6101579f0 msgr2=0x7fd6100657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.106+0000 7fd6167f5700 1 --2- 172.21.15.1:0/2445542350 >> v2:172.21.15.141:3300/0 conn(0x7fd6101579f0 0x7fd6100657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.106+0000 7fd6167f5700 1 -- 172.21.15.1:0/2445542350 >> v1:172.21.15.1:6789/0 conn(0x7fd610157dd0 legacy=0x7fd6100627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.106+0000 7fd614ff2700 1 -- 172.21.15.1:0/2445542350 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476289144 0 0) 0x7fd610066a80 con 0x7fd610157dd0 2023-11-15T01:37:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.106+0000 7fd6167f5700 1 -- 172.21.15.1:0/2445542350 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd610066150 con 0x7fd610062ec0 2023-11-15T01:37:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.107+0000 7fd6167f5700 1 --2- 172.21.15.1:0/2445542350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd610062ec0 0x7fd6100a4870 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fd6100bebb0 tx=0x7fd600009780).ready entity=mon.0 client_cookie=42c618f7ac0b2922 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.107+0000 7fd614ff2700 1 -- 172.21.15.1:0/2445542350 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60000e070 con 0x7fd610062ec0 2023-11-15T01:37:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.107+0000 7fd614ff2700 1 -- 172.21.15.1:0/2445542350 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60000bc30 con 0x7fd610062ec0 2023-11-15T01:37:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.107+0000 7fd614ff2700 1 -- 172.21.15.1:0/2445542350 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd600012410 con 0x7fd610062ec0 2023-11-15T01:37:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.107+0000 7fd616ff6700 1 -- 172.21.15.1:0/2445542350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd610062ec0 msgr2=0x7fd6100a4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.107+0000 7fd616ff6700 1 --2- 172.21.15.1:0/2445542350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd610062ec0 0x7fd6100a4870 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fd6100bebb0 tx=0x7fd600009780).stop 2023-11-15T01:37:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.107+0000 7fd616ff6700 1 -- 172.21.15.1:0/2445542350 shutdown_connections 2023-11-15T01:37:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.107+0000 7fd616ff6700 1 --2- 172.21.15.1:0/2445542350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd610062ec0 0x7fd6100a4870 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.107+0000 7fd616ff6700 1 --2- 172.21.15.1:0/2445542350 >> v2:172.21.15.141:3300/0 conn(0x7fd6101579f0 0x7fd6100657e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.107+0000 7fd616ff6700 1 -- 172.21.15.1:0/2445542350 >> 172.21.15.1:0/2445542350 conn(0x7fd6100c7c10 msgr2=0x7fd6100c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.107+0000 7fd616ff6700 1 -- 172.21.15.1:0/2445542350 shutdown_connections 2023-11-15T01:37:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.107+0000 7fd616ff6700 1 -- 172.21.15.1:0/2445542350 wait complete. 2023-11-15T01:37:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.108+0000 7fd616ff6700 1 Processor -- start 2023-11-15T01:37:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.109+0000 7fd616ff6700 1 -- start start 2023-11-15T01:37:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.109+0000 7fd616ff6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd610062ec0 0x7fd6100a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.109+0000 7fd616ff6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6101579f0 0x7fd610164d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.109+0000 7fd616ff6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd610157dd0 0x7fd6100c0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.109+0000 7fd616ff6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6100c38b0 con 0x7fd610062ec0 2023-11-15T01:37:37.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.109+0000 7fd616ff6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6100a84e0 con 0x7fd6101579f0 2023-11-15T01:37:37.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.109+0000 7fd616ff6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd610165260 con 0x7fd610157dd0 2023-11-15T01:37:37.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.109+0000 7fd615ff4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd610062ec0 0x7fd6100a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.109+0000 7fd615ff4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd610062ec0 0x7fd6100a7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43744/0 (socket says 172.21.15.1:43744) 2023-11-15T01:37:37.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.109+0000 7fd615ff4700 1 -- 172.21.15.1:0/3849269250 learned_addr learned my addr 172.21.15.1:0/3849269250 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:37.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.110+0000 7fd6167f5700 1 --2- 172.21.15.1:0/3849269250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd610157dd0 0x7fd6100c0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.110+0000 7fd6157f3700 1 --2- 172.21.15.1:0/3849269250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6101579f0 0x7fd610164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.110+0000 7fd615ff4700 1 -- 172.21.15.1:0/3849269250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd610157dd0 msgr2=0x7fd6100c0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.110+0000 7fd615ff4700 1 --2- 172.21.15.1:0/3849269250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd610157dd0 0x7fd6100c0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.110+0000 7fd615ff4700 1 -- 172.21.15.1:0/3849269250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6101579f0 msgr2=0x7fd610164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.110+0000 7fd615ff4700 1 --2- 172.21.15.1:0/3849269250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6101579f0 0x7fd610164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.110+0000 7fd615ff4700 1 -- 172.21.15.1:0/3849269250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd600009a20 con 0x7fd610062ec0 2023-11-15T01:37:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.110+0000 7fd6157f3700 1 --2- 172.21.15.1:0/3849269250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6101579f0 0x7fd610164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:37:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.110+0000 7fd615ff4700 1 --2- 172.21.15.1:0/3849269250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd610062ec0 0x7fd6100a7ff0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fd60800b530 tx=0x7fd6080090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.110+0000 7fd60dffb700 1 -- 172.21.15.1:0/3849269250 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60800d4a0 con 0x7fd610062ec0 2023-11-15T01:37:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.110+0000 7fd60dffb700 1 -- 172.21.15.1:0/3849269250 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60800d620 con 0x7fd610062ec0 2023-11-15T01:37:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.110+0000 7fd616ff6700 1 -- 172.21.15.1:0/3849269250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6100c2ca0 con 0x7fd610062ec0 2023-11-15T01:37:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.110+0000 7fd60dffb700 1 -- 172.21.15.1:0/3849269250 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60800d9e0 con 0x7fd610062ec0 2023-11-15T01:37:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.110+0000 7fd616ff6700 1 -- 172.21.15.1:0/3849269250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6100c3260 con 0x7fd610062ec0 2023-11-15T01:37:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.111+0000 7fd616ff6700 1 -- 172.21.15.1:0/3849269250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6100475e0 con 0x7fd610062ec0 2023-11-15T01:37:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.111+0000 7fd60dffb700 1 -- 172.21.15.1:0/3849269250 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd608012410 con 0x7fd610062ec0 2023-11-15T01:37:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.112+0000 7fd60dffb700 1 --2- 172.21.15.1:0/3849269250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd5fc05f270 0x7fd5fc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.112+0000 7fd60dffb700 1 -- 172.21.15.1:0/3849269250 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fd60807a4a0 con 0x7fd610062ec0 2023-11-15T01:37:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.112+0000 7fd6157f3700 1 --2- 172.21.15.1:0/3849269250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd5fc05f270 0x7fd5fc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.112+0000 7fd6157f3700 1 --2- 172.21.15.1:0/3849269250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd5fc05f270 0x7fd5fc061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd6100a9050 tx=0x7fd604009040).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.116+0000 7fd60dffb700 1 -- 172.21.15.1:0/3849269250 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd60804b3e0 con 0x7fd610062ec0 2023-11-15T01:37:37.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.314+0000 7fd616ff6700 1 -- 172.21.15.1:0/3849269250 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6100c39f0 con 0x7fd5fc05f270 2023-11-15T01:37:37.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.316+0000 7fd60dffb700 1 -- 172.21.15.1:0/3849269250 <== mgr.6466 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd604007110 con 0x7fd5fc05f270 2023-11-15T01:37:37.318 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T01:37:37.318 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:37:37.319 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephfs" 2023-11-15T01:37:37.319 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:37:37.321 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T01:37:37.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.318+0000 7fd616ff6700 1 -- 172.21.15.1:0/3849269250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd5fc05f270 msgr2=0x7fd5fc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:37.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.318+0000 7fd616ff6700 1 --2- 172.21.15.1:0/3849269250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd5fc05f270 0x7fd5fc061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd6100a9050 tx=0x7fd604009040).stop 2023-11-15T01:37:37.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.318+0000 7fd616ff6700 1 -- 172.21.15.1:0/3849269250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd610062ec0 msgr2=0x7fd6100a7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:37.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.318+0000 7fd616ff6700 1 --2- 172.21.15.1:0/3849269250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd610062ec0 0x7fd6100a7ff0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fd60800b530 tx=0x7fd6080090f0).stop 2023-11-15T01:37:37.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.318+0000 7fd616ff6700 1 -- 172.21.15.1:0/3849269250 shutdown_connections 2023-11-15T01:37:37.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.318+0000 7fd616ff6700 1 --2- 172.21.15.1:0/3849269250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd5fc05f270 0x7fd5fc061730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.318+0000 7fd616ff6700 1 --2- 172.21.15.1:0/3849269250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd610157dd0 0x7fd6100c0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.318+0000 7fd616ff6700 1 --2- 172.21.15.1:0/3849269250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd610062ec0 0x7fd6100a7ff0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.318+0000 7fd616ff6700 1 --2- 172.21.15.1:0/3849269250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6101579f0 0x7fd610164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.318+0000 7fd616ff6700 1 -- 172.21.15.1:0/3849269250 >> 172.21.15.1:0/3849269250 conn(0x7fd6100c7c10 msgr2=0x7fd6100a4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:37.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.318+0000 7fd616ff6700 1 -- 172.21.15.1:0/3849269250 shutdown_connections 2023-11-15T01:37:37.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.318+0000 7fd616ff6700 1 -- 172.21.15.1:0/3849269250 wait complete. 2023-11-15T01:37:37.332 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-15T01:37:37.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.451+0000 7f512fce7700 1 Processor -- start 2023-11-15T01:37:37.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.451+0000 7f512fce7700 1 -- start start 2023-11-15T01:37:37.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512fce7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5128154480 0x7f51280c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512fce7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51280c6430 0x7f51280aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512fce7700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51280ca050 con 0x7f51281540a0 2023-11-15T01:37:37.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512fce7700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51280c68c0 con 0x7f5128154480 2023-11-15T01:37:37.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512fce7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51280c9440 con 0x7f51280c6430 2023-11-15T01:37:37.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512d282700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5128154480 0x7f51280c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512d282700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5128154480 0x7f51280c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43752/0 (socket says 172.21.15.1:43752) 2023-11-15T01:37:37.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512d282700 1 -- 172.21.15.1:0/4036209482 learned_addr learned my addr 172.21.15.1:0/4036209482 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:37.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512e284700 1 --2- 172.21.15.1:0/4036209482 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51280c6430 0x7f51280aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512d282700 1 -- 172.21.15.1:0/4036209482 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51280c6430 msgr2=0x7f51280aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:37.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512d282700 1 --2- 172.21.15.1:0/4036209482 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51280c6430 0x7f51280aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512d282700 1 -- 172.21.15.1:0/4036209482 >> v1:172.21.15.141:6789/0 conn(0x7f51281540a0 legacy=0x7f51280ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:37.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512d282700 1 -- 172.21.15.1:0/4036209482 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51280c9720 con 0x7f5128154480 2023-11-15T01:37:37.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512d282700 1 --2- 172.21.15.1:0/4036209482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5128154480 0x7f51280c5f40 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f511c006fd0 tx=0x7f511c0090f0).ready entity=mon.0 client_cookie=7a33008d6c0856fe server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:37.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512ca81700 1 -- 172.21.15.1:0/4036209482 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c00b580 con 0x7f5128154480 2023-11-15T01:37:37.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512ca81700 1 -- 172.21.15.1:0/4036209482 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c00b6e0 con 0x7f5128154480 2023-11-15T01:37:37.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.452+0000 7f512ca81700 1 -- 172.21.15.1:0/4036209482 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c00ba60 con 0x7f5128154480 2023-11-15T01:37:37.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.453+0000 7f512fce7700 1 -- 172.21.15.1:0/4036209482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5128154480 msgr2=0x7f51280c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:37.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.453+0000 7f512fce7700 1 --2- 172.21.15.1:0/4036209482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5128154480 0x7f51280c5f40 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f511c006fd0 tx=0x7f511c0090f0).stop 2023-11-15T01:37:37.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.453+0000 7f512fce7700 1 -- 172.21.15.1:0/4036209482 shutdown_connections 2023-11-15T01:37:37.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.453+0000 7f512fce7700 1 --2- 172.21.15.1:0/4036209482 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51280c6430 0x7f51280aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.453+0000 7f512fce7700 1 --2- 172.21.15.1:0/4036209482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5128154480 0x7f51280c5f40 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.453+0000 7f512fce7700 1 -- 172.21.15.1:0/4036209482 >> 172.21.15.1:0/4036209482 conn(0x7f5128064a70 msgr2=0x7f5128064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:37.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.453+0000 7f512fce7700 1 -- 172.21.15.1:0/4036209482 shutdown_connections 2023-11-15T01:37:37.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.453+0000 7f512fce7700 1 -- 172.21.15.1:0/4036209482 wait complete. 2023-11-15T01:37:37.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.454+0000 7f512fce7700 1 Processor -- start 2023-11-15T01:37:37.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.454+0000 7f512fce7700 1 -- start start 2023-11-15T01:37:37.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512fce7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51280c6430 0x7f5128168680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512fce7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51281540a0 0x7f512814e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512fce7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5128154480 0x7f512814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512fce7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51280b0b30 con 0x7f51280c6430 2023-11-15T01:37:37.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512fce7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51280af6e0 con 0x7f51281540a0 2023-11-15T01:37:37.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512fce7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51280af9c0 con 0x7f5128154480 2023-11-15T01:37:37.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512da83700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51280c6430 0x7f5128168680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512da83700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51280c6430 0x7f5128168680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43758/0 (socket says 172.21.15.1:43758) 2023-11-15T01:37:37.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512da83700 1 -- 172.21.15.1:0/2600331259 learned_addr learned my addr 172.21.15.1:0/2600331259 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:37.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512d282700 1 --2- 172.21.15.1:0/2600331259 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51281540a0 0x7f512814e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512e284700 1 --2- 172.21.15.1:0/2600331259 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5128154480 0x7f512814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512da83700 1 -- 172.21.15.1:0/2600331259 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5128154480 msgr2=0x7f512814d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:37.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512da83700 1 --2- 172.21.15.1:0/2600331259 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5128154480 0x7f512814d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512da83700 1 -- 172.21.15.1:0/2600331259 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51281540a0 msgr2=0x7f512814e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:37.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512da83700 1 --2- 172.21.15.1:0/2600331259 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51281540a0 0x7f512814e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512da83700 1 -- 172.21.15.1:0/2600331259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c009370 con 0x7f51280c6430 2023-11-15T01:37:37.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.455+0000 7f512da83700 1 --2- 172.21.15.1:0/2600331259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51280c6430 0x7f5128168680 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f511800c710 tx=0x7f5118001540).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:37.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.456+0000 7f5125ffb700 1 -- 172.21.15.1:0/2600331259 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511800e4a0 con 0x7f51280c6430 2023-11-15T01:37:37.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.456+0000 7f5125ffb700 1 -- 172.21.15.1:0/2600331259 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511800e600 con 0x7f51280c6430 2023-11-15T01:37:37.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.456+0000 7f512fce7700 1 -- 172.21.15.1:0/2600331259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51280afca0 con 0x7f51280c6430 2023-11-15T01:37:37.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.456+0000 7f5125ffb700 1 -- 172.21.15.1:0/2600331259 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511800e9a0 con 0x7f51280c6430 2023-11-15T01:37:37.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.456+0000 7f512fce7700 1 -- 172.21.15.1:0/2600331259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5128168b70 con 0x7f51280c6430 2023-11-15T01:37:37.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.457+0000 7f5125ffb700 1 -- 172.21.15.1:0/2600331259 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 39) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f511800ed50 con 0x7f51280c6430 2023-11-15T01:37:37.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.457+0000 7f512fce7700 1 -- 172.21.15.1:0/2600331259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51280b01c0 con 0x7f51280c6430 2023-11-15T01:37:37.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.457+0000 7f5125ffb700 1 --2- 172.21.15.1:0/2600331259 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f511405f270 0x7f5114061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.457+0000 7f5125ffb700 1 -- 172.21.15.1:0/2600331259 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f5118079cd0 con 0x7f51280c6430 2023-11-15T01:37:37.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.458+0000 7f512d282700 1 --2- 172.21.15.1:0/2600331259 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f511405f270 0x7f5114061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.458+0000 7f512d282700 1 --2- 172.21.15.1:0/2600331259 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f511405f270 0x7f5114061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f511c009130 tx=0x7f511c017000).ready entity=mgr.6466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:37.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.462+0000 7f5125ffb700 1 -- 172.21.15.1:0/2600331259 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f51280b01c0 con 0x7f51280c6430 2023-11-15T01:37:37.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.682+0000 7f512fce7700 1 -- 172.21.15.1:0/2600331259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f51280b01c0 con 0x7f51280c6430 2023-11-15T01:37:37.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.841+0000 7f5125ffb700 1 -- 172.21.15.1:0/2600331259 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 40) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f5118077770 con 0x7f51280c6430 2023-11-15T01:37:37.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.842+0000 7f5125ffb700 1 -- 172.21.15.1:0/2600331259 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v40) v1 ==== 92+0+0 (secure 0 0 0) 0x7f5118071b00 con 0x7f51280c6430 2023-11-15T01:37:37.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.844+0000 7f512fce7700 1 -- 172.21.15.1:0/2600331259 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f511405f270 msgr2=0x7f5114061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:37.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.844+0000 7f512fce7700 1 --2- 172.21.15.1:0/2600331259 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f511405f270 0x7f5114061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f511c009130 tx=0x7f511c017000).stop 2023-11-15T01:37:37.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.844+0000 7f512fce7700 1 -- 172.21.15.1:0/2600331259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51280c6430 msgr2=0x7f5128168680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:37.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.844+0000 7f512fce7700 1 --2- 172.21.15.1:0/2600331259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51280c6430 0x7f5128168680 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f511800c710 tx=0x7f5118001540).stop 2023-11-15T01:37:37.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.844+0000 7f512fce7700 1 -- 172.21.15.1:0/2600331259 shutdown_connections 2023-11-15T01:37:37.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.844+0000 7f512fce7700 1 --2- 172.21.15.1:0/2600331259 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f511405f270 0x7f5114061730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.844+0000 7f512fce7700 1 --2- 172.21.15.1:0/2600331259 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5128154480 0x7f512814d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.844+0000 7f512fce7700 1 --2- 172.21.15.1:0/2600331259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51280c6430 0x7f5128168680 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.844+0000 7f512fce7700 1 --2- 172.21.15.1:0/2600331259 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51281540a0 0x7f512814e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.844+0000 7f512fce7700 1 -- 172.21.15.1:0/2600331259 >> 172.21.15.1:0/2600331259 conn(0x7f5128064a70 msgr2=0x7f51280cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:37.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.845+0000 7f512fce7700 1 -- 172.21.15.1:0/2600331259 shutdown_connections 2023-11-15T01:37:37.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.845+0000 7f512fce7700 1 -- 172.21.15.1:0/2600331259 wait complete. 2023-11-15T01:37:37.859 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-15T01:37:37.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.982+0000 7f8dca0d2700 1 Processor -- start 2023-11-15T01:37:37.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.982+0000 7f8dca0d2700 1 -- start start 2023-11-15T01:37:37.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.982+0000 7f8dca0d2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8dc413b990 0x7f8dc41568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.982+0000 7f8dca0d2700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8dc413bd70 0x7f8dc4066870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.982+0000 7f8dca0d2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8dc40a8ab0 0x7f8dc40c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.982+0000 7f8dca0d2700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc4067340 con 0x7f8dc40a8ab0 2023-11-15T01:37:37.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.982+0000 7f8dca0d2700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc40c7760 con 0x7f8dc413bd70 2023-11-15T01:37:37.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.982+0000 7f8dca0d2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc4067060 con 0x7f8dc413b990 2023-11-15T01:37:37.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.983+0000 7f8dc3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8dc40a8ab0 0x7f8dc40c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.983+0000 7f8dc3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8dc40a8ab0 0x7f8dc40c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40490/0 (socket says 172.21.15.1:40490) 2023-11-15T01:37:37.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.983+0000 7f8dc3fff700 1 -- 172.21.15.1:0/2219000139 learned_addr learned my addr 172.21.15.1:0/2219000139 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:37.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.983+0000 7f8dc2ffd700 1 --2- 172.21.15.1:0/2219000139 >> v2:172.21.15.141:3300/0 conn(0x7f8dc413bd70 0x7f8dc4066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.983+0000 7f8dc37fe700 1 --2- 172.21.15.1:0/2219000139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8dc413b990 0x7f8dc41568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.983+0000 7f8dc3fff700 1 -- 172.21.15.1:0/2219000139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8dc413b990 msgr2=0x7f8dc41568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:37.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.983+0000 7f8dc3fff700 1 --2- 172.21.15.1:0/2219000139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8dc413b990 0x7f8dc41568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.983+0000 7f8dc3fff700 1 -- 172.21.15.1:0/2219000139 >> v2:172.21.15.141:3300/0 conn(0x7f8dc413bd70 msgr2=0x7f8dc4066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:37.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.983+0000 7f8dc3fff700 1 --2- 172.21.15.1:0/2219000139 >> v2:172.21.15.141:3300/0 conn(0x7f8dc413bd70 0x7f8dc4066870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.983+0000 7f8dc3fff700 1 -- 172.21.15.1:0/2219000139 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc40c7110 con 0x7f8dc40a8ab0 2023-11-15T01:37:37.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.983+0000 7f8dc3fff700 1 --2- 172.21.15.1:0/2219000139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc40a8ab0 0x7f8dc40c3500 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f8dc406a2f0 tx=0x7f8dbc009840).ready entity=mon.0 client_cookie=3e2d1aa38dac627c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:37.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.983+0000 7f8dc27fc700 1 -- 172.21.15.1:0/2219000139 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc00e070 con 0x7f8dc40a8ab0 2023-11-15T01:37:37.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.983+0000 7f8dc27fc700 1 -- 172.21.15.1:0/2219000139 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc00b970 con 0x7f8dc40a8ab0 2023-11-15T01:37:37.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.983+0000 7f8dc27fc700 1 -- 172.21.15.1:0/2219000139 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc00bcf0 con 0x7f8dc40a8ab0 2023-11-15T01:37:37.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.984+0000 7f8dca0d2700 1 -- 172.21.15.1:0/2219000139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc40a8ab0 msgr2=0x7f8dc40c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:37.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.984+0000 7f8dca0d2700 1 --2- 172.21.15.1:0/2219000139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc40a8ab0 0x7f8dc40c3500 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f8dc406a2f0 tx=0x7f8dbc009840).stop 2023-11-15T01:37:37.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.984+0000 7f8dca0d2700 1 -- 172.21.15.1:0/2219000139 shutdown_connections 2023-11-15T01:37:37.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.984+0000 7f8dca0d2700 1 --2- 172.21.15.1:0/2219000139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc40a8ab0 0x7f8dc40c3500 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.984+0000 7f8dca0d2700 1 --2- 172.21.15.1:0/2219000139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8dc413b990 0x7f8dc41568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.984+0000 7f8dca0d2700 1 --2- 172.21.15.1:0/2219000139 >> v2:172.21.15.141:3300/0 conn(0x7f8dc413bd70 0x7f8dc4066870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.984+0000 7f8dca0d2700 1 -- 172.21.15.1:0/2219000139 >> 172.21.15.1:0/2219000139 conn(0x7f8dc4063280 msgr2=0x7f8dc40c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:37.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.984+0000 7f8dca0d2700 1 -- 172.21.15.1:0/2219000139 shutdown_connections 2023-11-15T01:37:37.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.984+0000 7f8dca0d2700 1 -- 172.21.15.1:0/2219000139 wait complete. 2023-11-15T01:37:37.992 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:37.987+0000 7f85c54ab680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:37:37.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.985+0000 7f8dca0d2700 1 Processor -- start 2023-11-15T01:37:37.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.985+0000 7f8dca0d2700 1 -- start start 2023-11-15T01:37:37.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.986+0000 7f8dca0d2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8dc40a8ab0 0x7f8dc4151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.986+0000 7f8dca0d2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8dc413b990 0x7f8dc40be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.986+0000 7f8dca0d2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc40bedd0 0x7f8dc4063e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:37.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.986+0000 7f8dca0d2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc40657d0 con 0x7f8dc40bedd0 2023-11-15T01:37:37.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.986+0000 7f8dca0d2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc40bf230 con 0x7f8dc413b990 2023-11-15T01:37:37.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.986+0000 7f8dca0d2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc4064bc0 con 0x7f8dc40a8ab0 2023-11-15T01:37:37.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.986+0000 7f8dc3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc40bedd0 0x7f8dc4063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.986+0000 7f8dc2ffd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8dc413b990 0x7f8dc40be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.986+0000 7f8dc3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc40bedd0 0x7f8dc4063e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40496/0 (socket says 172.21.15.1:40496) 2023-11-15T01:37:37.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.986+0000 7f8dc3fff700 1 -- 172.21.15.1:0/1531376070 learned_addr learned my addr 172.21.15.1:0/1531376070 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:37.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.986+0000 7f8dc37fe700 1 --2- 172.21.15.1:0/1531376070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8dc40a8ab0 0x7f8dc4151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:37.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.987+0000 7f8dc3fff700 1 -- 172.21.15.1:0/1531376070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8dc40a8ab0 msgr2=0x7f8dc4151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:37.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.987+0000 7f8dc3fff700 1 --2- 172.21.15.1:0/1531376070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8dc40a8ab0 0x7f8dc4151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.987+0000 7f8dc3fff700 1 -- 172.21.15.1:0/1531376070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8dc413b990 msgr2=0x7f8dc40be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:37.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.987+0000 7f8dc3fff700 1 --2- 172.21.15.1:0/1531376070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8dc413b990 0x7f8dc40be8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:37.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.987+0000 7f8dc3fff700 1 -- 172.21.15.1:0/1531376070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc009ae0 con 0x7f8dc40bedd0 2023-11-15T01:37:37.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.987+0000 7f8dc37fe700 1 --2- 172.21.15.1:0/1531376070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8dc40a8ab0 0x7f8dc4151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:37.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.987+0000 7f8dc2ffd700 1 --2- 172.21.15.1:0/1531376070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8dc413b990 0x7f8dc40be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:37:37.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.987+0000 7f8dc3fff700 1 --2- 172.21.15.1:0/1531376070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc40bedd0 0x7f8dc4063e60 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f8dbc00b610 tx=0x7f8dbc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:37.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.987+0000 7f8dab7fe700 1 -- 172.21.15.1:0/1531376070 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc00bee0 con 0x7f8dc40bedd0 2023-11-15T01:37:37.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.987+0000 7f8dab7fe700 1 -- 172.21.15.1:0/1531376070 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc00bcf0 con 0x7f8dc40bedd0 2023-11-15T01:37:37.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.987+0000 7f8dab7fe700 1 -- 172.21.15.1:0/1531376070 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc01d6b0 con 0x7f8dc40bedd0 2023-11-15T01:37:37.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.987+0000 7f8dca0d2700 1 -- 172.21.15.1:0/1531376070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc4064ea0 con 0x7f8dc40bedd0 2023-11-15T01:37:38.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.987+0000 7f8dca0d2700 1 -- 172.21.15.1:0/1531376070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc4065460 con 0x7f8dc40bedd0 2023-11-15T01:37:38.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.988+0000 7f8dca0d2700 1 -- 172.21.15.1:0/1531376070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc4152840 con 0x7f8dc40bedd0 2023-11-15T01:37:38.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.989+0000 7f8dab7fe700 1 -- 172.21.15.1:0/1531376070 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 40) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f8dbc003040 con 0x7f8dc40bedd0 2023-11-15T01:37:38.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.989+0000 7f8dab7fe700 1 --2- 172.21.15.1:0/1531376070 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8db005f2c0 0x7f8db0061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:38.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.989+0000 7f8dab7fe700 1 -- 172.21.15.1:0/1531376070 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f8dbc07b810 con 0x7f8dc40bedd0 2023-11-15T01:37:38.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.989+0000 7f8dc37fe700 1 -- 172.21.15.1:0/1531376070 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8db005f2c0 msgr2=0x7f8db0061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:38.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.989+0000 7f8dc37fe700 1 --2- 172.21.15.1:0/1531376070 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8db005f2c0 0x7f8db0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:38.001 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:37.990+0000 7f6d2bd85680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:37:38.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:37.994+0000 7f8dab7fe700 1 -- 172.21.15.1:0/1531376070 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8dbc04c820 con 0x7f8dc40bedd0 2023-11-15T01:37:38.051 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:38.050+0000 7f85c54ab680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:37:38.058 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:38.057+0000 7f6d2bd85680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:37:38.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.168+0000 7f8dca0d2700 1 -- 172.21.15.1:0/1531376070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f8dc4065910 con 0x7f8dc40bedd0 2023-11-15T01:37:38.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.171+0000 7f8dab7fe700 1 -- 172.21.15.1:0/1531376070 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v19)=0 v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8dc4065910 con 0x7f8dc40bedd0 2023-11-15T01:37:38.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.173+0000 7f8dca0d2700 1 -- 172.21.15.1:0/1531376070 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8db005f2c0 msgr2=0x7f8db0061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:38.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.173+0000 7f8dca0d2700 1 --2- 172.21.15.1:0/1531376070 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8db005f2c0 0x7f8db0061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:38.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.173+0000 7f8dca0d2700 1 -- 172.21.15.1:0/1531376070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc40bedd0 msgr2=0x7f8dc4063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:38.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.173+0000 7f8dca0d2700 1 --2- 172.21.15.1:0/1531376070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc40bedd0 0x7f8dc4063e60 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f8dbc00b610 tx=0x7f8dbc009840).stop 2023-11-15T01:37:38.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.173+0000 7f8dca0d2700 1 -- 172.21.15.1:0/1531376070 shutdown_connections 2023-11-15T01:37:38.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.173+0000 7f8dca0d2700 1 --2- 172.21.15.1:0/1531376070 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8db005f2c0 0x7f8db0061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:38.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.173+0000 7f8dca0d2700 1 --2- 172.21.15.1:0/1531376070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc40bedd0 0x7f8dc4063e60 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:38.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.173+0000 7f8dca0d2700 1 --2- 172.21.15.1:0/1531376070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8dc40a8ab0 0x7f8dc4151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:38.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.173+0000 7f8dca0d2700 1 --2- 172.21.15.1:0/1531376070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8dc413b990 0x7f8dc40be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:38.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.173+0000 7f8dca0d2700 1 -- 172.21.15.1:0/1531376070 >> 172.21.15.1:0/1531376070 conn(0x7f8dc4063280 msgr2=0x7f8dc40ab270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:38.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.174+0000 7f8dca0d2700 1 -- 172.21.15.1:0/1531376070 shutdown_connections 2023-11-15T01:37:38.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.174+0000 7f8dca0d2700 1 -- 172.21.15.1:0/1531376070 wait complete. 2023-11-15T01:37:38.188 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-11-15T01:37:38.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.311+0000 7ff646be6700 1 Processor -- start 2023-11-15T01:37:38.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.311+0000 7ff646be6700 1 -- start start 2023-11-15T01:37:38.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.312+0000 7ff646be6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff6400c53b0 0x7ff6400c3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:38.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.312+0000 7ff646be6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6400835c0 con 0x7ff640064660 2023-11-15T01:37:38.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.312+0000 7ff646be6700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6400c5790 con 0x7ff6400c7f50 2023-11-15T01:37:38.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.312+0000 7ff646be6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6400c3a00 con 0x7ff6400c53b0 2023-11-15T01:37:38.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.312+0000 7ff645183700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff640064660 0x7ff640064ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:50474/0 (socket says 172.21.15.1:50474) 2023-11-15T01:37:38.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.312+0000 7ff645183700 1 -- 172.21.15.1:0/2924211199 learned_addr learned my addr 172.21.15.1:0/2924211199 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:38.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.313+0000 7ff644982700 1 --2- 172.21.15.1:0/2924211199 >> v2:172.21.15.141:3300/0 conn(0x7ff6400c53b0 0x7ff6400c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:38.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.313+0000 7ff63f7fe700 1 -- 172.21.15.1:0/2924211199 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818372819 0 0) 0x7ff6400835c0 con 0x7ff640064660 2023-11-15T01:37:38.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.313+0000 7ff63f7fe700 1 -- 172.21.15.1:0/2924211199 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6300033f0 con 0x7ff640064660 2023-11-15T01:37:38.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.313+0000 7ff644982700 1 -- 172.21.15.1:0/2924211199 >> v1:172.21.15.141:6789/0 conn(0x7ff6400c7f50 legacy=0x7ff6400c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:38.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.313+0000 7ff63f7fe700 1 -- 172.21.15.1:0/2924211199 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90057595 0 0) 0x7ff6400c5790 con 0x7ff6400c7f50 2023-11-15T01:37:38.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.313+0000 7ff644982700 1 -- 172.21.15.1:0/2924211199 >> v1:172.21.15.1:6789/0 conn(0x7ff640064660 legacy=0x7ff640064ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:38.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.313+0000 7ff644982700 1 -- 172.21.15.1:0/2924211199 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6400c6eb0 con 0x7ff6400c53b0 2023-11-15T01:37:38.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.313+0000 7ff644982700 1 --2- 172.21.15.1:0/2924211199 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6400c53b0 0x7ff6400c3510 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7ff634006fd0 tx=0x7ff634006f40).ready entity=mon.1 client_cookie=57f7ba9c321b6792 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:38.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.313+0000 7ff63f7fe700 1 -- 172.21.15.1:0/2924211199 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6380017f0 con 0x7ff6400c53b0 2023-11-15T01:37:38.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.313+0000 7ff63f7fe700 1 -- 172.21.15.1:0/2924211199 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff634012410 con 0x7ff6400c53b0 2023-11-15T01:37:38.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.313+0000 7ff63f7fe700 1 -- 172.21.15.1:0/2924211199 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff634012790 con 0x7ff6400c53b0 2023-11-15T01:37:38.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.314+0000 7ff646be6700 1 -- 172.21.15.1:0/2924211199 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6400c53b0 msgr2=0x7ff6400c3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:38.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.314+0000 7ff646be6700 1 --2- 172.21.15.1:0/2924211199 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6400c53b0 0x7ff6400c3510 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7ff634006fd0 tx=0x7ff634006f40).stop 2023-11-15T01:37:38.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.314+0000 7ff646be6700 1 -- 172.21.15.1:0/2924211199 shutdown_connections 2023-11-15T01:37:38.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.314+0000 7ff646be6700 1 --2- 172.21.15.1:0/2924211199 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6400c53b0 0x7ff6400c3510 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:38.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.314+0000 7ff646be6700 1 -- 172.21.15.1:0/2924211199 >> 172.21.15.1:0/2924211199 conn(0x7ff640082f90 msgr2=0x7ff6400c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:38.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.314+0000 7ff646be6700 1 -- 172.21.15.1:0/2924211199 shutdown_connections 2023-11-15T01:37:38.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.314+0000 7ff646be6700 1 -- 172.21.15.1:0/2924211199 wait complete. 2023-11-15T01:37:38.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.315+0000 7ff646be6700 1 Processor -- start 2023-11-15T01:37:38.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.315+0000 7ff646be6700 1 -- start start 2023-11-15T01:37:38.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.316+0000 7ff646be6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff640064660 0x7ff64013f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:38.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.316+0000 7ff646be6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6400c53b0 0x7ff6400addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:38.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.316+0000 7ff646be6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6400c7f50 0x7ff6400ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:38.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.316+0000 7ff646be6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400a96c0 con 0x7ff6400c53b0 2023-11-15T01:37:38.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.316+0000 7ff646be6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400a99a0 con 0x7ff6400c7f50 2023-11-15T01:37:38.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.316+0000 7ff646be6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400ae8e0 con 0x7ff640064660 2023-11-15T01:37:38.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.316+0000 7ff63ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6400c53b0 0x7ff6400addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:38.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.316+0000 7ff645183700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6400c7f50 0x7ff6400ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:38.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.316+0000 7ff644982700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff640064660 0x7ff64013f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:38.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.316+0000 7ff63ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6400c53b0 0x7ff6400addd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40506/0 (socket says 172.21.15.1:40506) 2023-11-15T01:37:38.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.316+0000 7ff63ffff700 1 -- 172.21.15.1:0/3667365559 learned_addr learned my addr 172.21.15.1:0/3667365559 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:38.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.317+0000 7ff645183700 1 -- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff640064660 msgr2=0x7ff64013f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:38.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.317+0000 7ff645183700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff640064660 0x7ff64013f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:38.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.317+0000 7ff645183700 1 -- 172.21.15.1:0/3667365559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6400c53b0 msgr2=0x7ff6400addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:38.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.317+0000 7ff645183700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6400c53b0 0x7ff6400addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:38.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.317+0000 7ff645183700 1 -- 172.21.15.1:0/3667365559 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff634009250 con 0x7ff6400c7f50 2023-11-15T01:37:38.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.317+0000 7ff645183700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6400c7f50 0x7ff6400ae2c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7ff63800cb10 tx=0x7ff638007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:38.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.317+0000 7ff63cff9700 1 -- 172.21.15.1:0/3667365559 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff638004c40 con 0x7ff6400c7f50 2023-11-15T01:37:38.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.317+0000 7ff63cff9700 1 -- 172.21.15.1:0/3667365559 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff638004da0 con 0x7ff6400c7f50 2023-11-15T01:37:38.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.317+0000 7ff646be6700 1 -- 172.21.15.1:0/3667365559 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6400aebc0 con 0x7ff6400c7f50 2023-11-15T01:37:38.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.317+0000 7ff63cff9700 1 -- 172.21.15.1:0/3667365559 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6380073a0 con 0x7ff6400c7f50 2023-11-15T01:37:38.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.317+0000 7ff646be6700 1 -- 172.21.15.1:0/3667365559 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64013f970 con 0x7ff6400c7f50 2023-11-15T01:37:38.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.318+0000 7ff646be6700 1 -- 172.21.15.1:0/3667365559 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64006c7e0 con 0x7ff6400c7f50 2023-11-15T01:37:38.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.318+0000 7ff63cff9700 1 -- 172.21.15.1:0/3667365559 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 40) v1 ==== 75565+0+0 (secure 0 0 0) 0x7ff638007750 con 0x7ff6400c7f50 2023-11-15T01:37:38.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.319+0000 7ff63cff9700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 0x7ff624061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:38.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.319+0000 7ff644982700 1 -- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 msgr2=0x7ff624061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:38.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.319+0000 7ff63cff9700 1 -- 172.21.15.1:0/3667365559 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6545+0+0 (secure 0 0 0) 0x7ff63807a420 con 0x7ff6400c7f50 2023-11-15T01:37:38.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.319+0000 7ff644982700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 0x7ff624061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:37:38.329 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:38.323+0000 7f85c54ab680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:37:38.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.323+0000 7ff63cff9700 1 -- 172.21.15.1:0/3667365559 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff63804b3c0 con 0x7ff6400c7f50 2023-11-15T01:37:38.353 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:38.351+0000 7f6d2bd85680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:37:38.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.520+0000 7ff644982700 1 -- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 msgr2=0x7ff624061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:38.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.520+0000 7ff644982700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 0x7ff624061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:37:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.528+0000 7ff646be6700 1 -- 172.21.15.1:0/3667365559 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6400833a0 con 0x7ff62405f2c0 2023-11-15T01:37:38.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.921+0000 7ff644982700 1 -- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 msgr2=0x7ff624061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:38.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:38.921+0000 7ff644982700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 0x7ff624061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-15T01:37:38.934 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:38.934+0000 7f85c54ab680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:37:39.006 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:39.006+0000 7f85c54ab680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:37:39.020 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:39.019+0000 7f6d2bd85680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:37:39.089 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:39.088+0000 7f6d2bd85680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:37:39.193 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:39.193+0000 7f85c54ab680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:37:39.285 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:39.284+0000 7f6d2bd85680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:37:39.611 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:39.611+0000 7f85c54ab680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:37:39.714 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:39.713+0000 7f85c54ab680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:37:39.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:39.722+0000 7ff644982700 1 -- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 msgr2=0x7ff624061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:39.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:39.722+0000 7ff644982700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 0x7ff624061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-15T01:37:39.726 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:39.725+0000 7f6d2bd85680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:37:39.835 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:39.834+0000 7f6d2bd85680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:37:39.867 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:39.867+0000 7f85c54ab680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:37:39.940 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:39.940+0000 7f85c54ab680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:37:39.994 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:39.993+0000 7f6d2bd85680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:37:40.007 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:40.007+0000 7f85c54ab680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:37:40.073 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:40.071+0000 7f6d2bd85680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:37:40.143 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:40.142+0000 7f6d2bd85680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:37:40.262 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:40.262+0000 7f85c54ab680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:37:40.417 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:40.416+0000 7f6d2bd85680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:37:40.446 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:40.445+0000 7f85c54ab680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:37:40.607 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:40.606+0000 7f6d2bd85680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:37:41.093 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:41.092+0000 7f85c54ab680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:37:41.160 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:41.160+0000 7f85c54ab680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:37:41.236 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:41.235+0000 7f85c54ab680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:37:41.298 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:41.297+0000 7f6d2bd85680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:37:41.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:41.323+0000 7ff644982700 1 -- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 msgr2=0x7ff624061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:37:41.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:41.323+0000 7ff644982700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 0x7ff624061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-15T01:37:41.370 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:41.369+0000 7f6d2bd85680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:37:41.382 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:41.381+0000 7f85c54ab680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:37:41.452 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:41.450+0000 7f6d2bd85680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:37:41.455 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:41.454+0000 7f85c54ab680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:37:41.571 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:41.571+0000 7f85c54ab680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:37:41.607 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:41.605+0000 7f6d2bd85680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:37:41.679 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:41.678+0000 7f85c54ab680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:37:41.680 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:41.679+0000 7f6d2bd85680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:37:41.804 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:41.803+0000 7f6d2bd85680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:37:41.919 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:41.918+0000 7f6d2bd85680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:37:41.971 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:41.971+0000 7f85c54ab680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:37:42.042 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:42.041+0000 7f85c54ab680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:37:42.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:42.063+0000 7ff63cff9700 1 -- 172.21.15.1:0/3667365559 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mgrmap(e 41) v1 ==== 75287+0+0 (secure 0 0 0) 0x7ff638077ec0 con 0x7ff6400c7f50 2023-11-15T01:37:42.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:42.063+0000 7ff63cff9700 1 -- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 msgr2=0x7ff624061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:37:42.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:42.064+0000 7ff63cff9700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 0x7ff624061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:37:42.127 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:42.126+0000 7f8539c30700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:42.128 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:42.126+0000 7f8539c30700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:42.128 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:42.126+0000 7f8539c30700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:42.128 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:42.126+0000 7f8539c30700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:42.128 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:42.126+0000 7f8539c30700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:42.128 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:42.126+0000 7f853cc36700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:42.129 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:42.126+0000 7f853cc36700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:42.129 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:42.126+0000 7f853cc36700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:42.129 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:42.126+0000 7f853cc36700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:42.129 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:37:42.126+0000 7f853cc36700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:37:42.227 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:42.226+0000 7f6d2bd85680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:37:42.301 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:37:42.300+0000 7f6d2bd85680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:37:43.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.067+0000 7ff63cff9700 1 -- 172.21.15.1:0/3667365559 <== mon.1 v2:172.21.15.141:3300/0 8 ==== mgrmap(e 42) v1 ==== 75357+0+0 (secure 0 0 0) 0x7ff638078240 con 0x7ff6400c7f50 2023-11-15T01:37:43.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.067+0000 7ff63cff9700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 0x7ff624061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:43.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.067+0000 7ff63cff9700 1 -- 172.21.15.1:0/3667365559 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6400833a0 con 0x7ff62405f2c0 2023-11-15T01:37:43.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.068+0000 7ff644982700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 0x7ff624061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:43.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.070+0000 7ff644982700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 0x7ff624061700 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff634006fa0 tx=0x7ff634015000).ready entity=mgr.6185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:43.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.091+0000 7ff63cff9700 1 -- 172.21.15.1:0/3667365559 <== mgr.6185 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7ff6400833a0 con 0x7ff62405f2c0 2023-11-15T01:37:43.093 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path /bad-path 2023-11-15T01:37:43.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.094+0000 7ff646be6700 1 -- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 msgr2=0x7ff624061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:43.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.094+0000 7ff646be6700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 0x7ff624061700 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff634006fa0 tx=0x7ff634015000).stop 2023-11-15T01:37:43.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.094+0000 7ff646be6700 1 -- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6400c7f50 msgr2=0x7ff6400ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:43.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.094+0000 7ff646be6700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6400c7f50 0x7ff6400ae2c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7ff63800cb10 tx=0x7ff638007c20).stop 2023-11-15T01:37:43.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.094+0000 7ff646be6700 1 -- 172.21.15.1:0/3667365559 shutdown_connections 2023-11-15T01:37:43.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.094+0000 7ff646be6700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff62405f2c0 0x7ff624061700 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:43.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.094+0000 7ff646be6700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6400c7f50 0x7ff6400ae2c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:43.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.094+0000 7ff646be6700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff640064660 0x7ff64013f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:43.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.094+0000 7ff646be6700 1 --2- 172.21.15.1:0/3667365559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6400c53b0 0x7ff6400addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:43.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.094+0000 7ff646be6700 1 -- 172.21.15.1:0/3667365559 >> 172.21.15.1:0/3667365559 conn(0x7ff640082f90 msgr2=0x7ff6400c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:43.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.094+0000 7ff646be6700 1 -- 172.21.15.1:0/3667365559 shutdown_connections 2023-11-15T01:37:43.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.094+0000 7ff646be6700 1 -- 172.21.15.1:0/3667365559 wait complete. 2023-11-15T01:37:43.110 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-11-15T01:37:43.111 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-11-15T01:37:43.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.238+0000 7f0fc2878700 1 Processor -- start 2023-11-15T01:37:43.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.238+0000 7f0fc2878700 1 -- start start 2023-11-15T01:37:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.239+0000 7f0fc2878700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc137210 0x7f0fbc1552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.239+0000 7f0fc2878700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0fbc1375f0 0x7f0fbc14e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.239+0000 7f0fc2878700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fbc158330 con 0x7f0fbc14ea50 2023-11-15T01:37:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.239+0000 7f0fc2878700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc158610 con 0x7f0fbc1375f0 2023-11-15T01:37:43.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.239+0000 7f0fc2878700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc1588f0 con 0x7f0fbc137210 2023-11-15T01:37:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.239+0000 7f0fc2077700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0fbc14ea50 0x7f0fbc066850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:50476/0 (socket says 172.21.15.1:50476) 2023-11-15T01:37:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.239+0000 7f0fc2077700 1 -- 172.21.15.1:0/2052233384 learned_addr learned my addr 172.21.15.1:0/2052233384 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:37:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.239+0000 7f0fc1075700 1 --2- 172.21.15.1:0/2052233384 >> v2:172.21.15.141:3300/0 conn(0x7f0fbc1375f0 0x7f0fbc14e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.239+0000 7f0fc1876700 1 --2- 172.21.15.1:0/2052233384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc137210 0x7f0fbc1552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:43.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.239+0000 7f0fc0874700 1 -- 172.21.15.1:0/2052233384 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885931491 0 0) 0x7f0fbc158330 con 0x7f0fbc14ea50 2023-11-15T01:37:43.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.239+0000 7f0fc0874700 1 -- 172.21.15.1:0/2052233384 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa80033f0 con 0x7f0fbc14ea50 2023-11-15T01:37:43.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.239+0000 7f0fc1075700 1 -- 172.21.15.1:0/2052233384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc137210 msgr2=0x7f0fbc1552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:37:43.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.239+0000 7f0fc1075700 1 --2- 172.21.15.1:0/2052233384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc137210 0x7f0fbc1552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:43.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.239+0000 7f0fc1075700 1 -- 172.21.15.1:0/2052233384 >> v1:172.21.15.1:6789/0 conn(0x7f0fbc14ea50 legacy=0x7f0fbc066850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:43.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.239+0000 7f0fc1075700 1 -- 172.21.15.1:0/2052233384 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc158bd0 con 0x7f0fbc1375f0 2023-11-15T01:37:43.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.240+0000 7f0fc1075700 1 --2- 172.21.15.1:0/2052233384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fbc1375f0 0x7f0fbc14e560 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f0fac009760 tx=0x7f0fac009060).ready entity=mon.1 client_cookie=c070f515ee142e99 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:43.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.240+0000 7f0fc0874700 1 -- 172.21.15.1:0/2052233384 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac00d4a0 con 0x7f0fbc1375f0 2023-11-15T01:37:43.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.240+0000 7f0fc0874700 1 -- 172.21.15.1:0/2052233384 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac00d600 con 0x7f0fbc1375f0 2023-11-15T01:37:43.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.240+0000 7f0fc0874700 1 -- 172.21.15.1:0/2052233384 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac00d980 con 0x7f0fbc1375f0 2023-11-15T01:37:43.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.240+0000 7f0fc2878700 1 -- 172.21.15.1:0/2052233384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fbc1375f0 msgr2=0x7f0fbc14e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:43.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.240+0000 7f0fc2878700 1 --2- 172.21.15.1:0/2052233384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fbc1375f0 0x7f0fbc14e560 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f0fac009760 tx=0x7f0fac009060).stop 2023-11-15T01:37:43.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.240+0000 7f0fc2878700 1 -- 172.21.15.1:0/2052233384 shutdown_connections 2023-11-15T01:37:43.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.240+0000 7f0fc2878700 1 --2- 172.21.15.1:0/2052233384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc137210 0x7f0fbc1552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:43.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.240+0000 7f0fc2878700 1 --2- 172.21.15.1:0/2052233384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fbc1375f0 0x7f0fbc14e560 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:43.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.240+0000 7f0fc2878700 1 -- 172.21.15.1:0/2052233384 >> 172.21.15.1:0/2052233384 conn(0x7f0fbc063280 msgr2=0x7f0fbc0c8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:43.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.240+0000 7f0fc2878700 1 -- 172.21.15.1:0/2052233384 shutdown_connections 2023-11-15T01:37:43.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.240+0000 7f0fc2878700 1 -- 172.21.15.1:0/2052233384 wait complete. 2023-11-15T01:37:43.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.241+0000 7f0fc2878700 1 Processor -- start 2023-11-15T01:37:43.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.242+0000 7f0fc2878700 1 -- start start 2023-11-15T01:37:43.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.242+0000 7f0fc2878700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fbc137210 0x7f0fbc1653b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:43.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.242+0000 7f0fc2878700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc1375f0 0x7f0fbc135420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:43.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.242+0000 7f0fc2878700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fbc14ea50 0x7f0fbc0c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.242+0000 7f0fc2878700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc135ee0 con 0x7f0fbc137210 2023-11-15T01:37:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.242+0000 7f0fc2878700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0abeb0 con 0x7f0fbc14ea50 2023-11-15T01:37:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.242+0000 7f0fc2878700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc1658a0 con 0x7f0fbc1375f0 2023-11-15T01:37:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.242+0000 7f0fc1876700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fbc137210 0x7f0fbc1653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:43.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.242+0000 7f0fc1876700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fbc137210 0x7f0fbc1653b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40514/0 (socket says 172.21.15.1:40514) 2023-11-15T01:37:43.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.242+0000 7f0fc1876700 1 -- 172.21.15.1:0/1724625687 learned_addr learned my addr 172.21.15.1:0/1724625687 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:37:43.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.243+0000 7f0fc1075700 1 --2- 172.21.15.1:0/1724625687 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc1375f0 0x7f0fbc135420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:43.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.243+0000 7f0fc2077700 1 --2- 172.21.15.1:0/1724625687 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fbc14ea50 0x7f0fbc0c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:43.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.243+0000 7f0fc1876700 1 -- 172.21.15.1:0/1724625687 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc1375f0 msgr2=0x7f0fbc135420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:43.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.243+0000 7f0fc1876700 1 --2- 172.21.15.1:0/1724625687 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc1375f0 0x7f0fbc135420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.243+0000 7f0fc1876700 1 -- 172.21.15.1:0/1724625687 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fbc14ea50 msgr2=0x7f0fbc0c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.243+0000 7f0fc1876700 1 --2- 172.21.15.1:0/1724625687 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fbc14ea50 0x7f0fbc0c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.243+0000 7f0fc1876700 1 -- 172.21.15.1:0/1724625687 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac0092a0 con 0x7f0fbc137210 2023-11-15T01:37:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.243+0000 7f0fc1876700 1 --2- 172.21.15.1:0/1724625687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fbc137210 0x7f0fbc1653b0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f0fb800e930 tx=0x7f0fb8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:43.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.243+0000 7f0fb1ffb700 1 -- 172.21.15.1:0/1724625687 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb800eed0 con 0x7f0fbc137210 2023-11-15T01:37:43.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.243+0000 7f0fb1ffb700 1 -- 172.21.15.1:0/1724625687 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb800c850 con 0x7f0fbc137210 2023-11-15T01:37:43.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.243+0000 7f0fc2878700 1 -- 172.21.15.1:0/1724625687 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fbc135910 con 0x7f0fbc137210 2023-11-15T01:37:43.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.243+0000 7f0fb1ffb700 1 -- 172.21.15.1:0/1724625687 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb800cbd0 con 0x7f0fbc137210 2023-11-15T01:37:43.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.243+0000 7f0fc2878700 1 -- 172.21.15.1:0/1724625687 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fbc1382c0 con 0x7f0fbc137210 2023-11-15T01:37:43.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.244+0000 7f0fc2878700 1 -- 172.21.15.1:0/1724625687 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fbc0ac190 con 0x7f0fbc137210 2023-11-15T01:37:43.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.244+0000 7f0fb1ffb700 1 -- 172.21.15.1:0/1724625687 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 42) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f0fb801b400 con 0x7f0fbc137210 2023-11-15T01:37:43.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.245+0000 7f0fb1ffb700 1 --2- 172.21.15.1:0/1724625687 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0fa005f080 0x7f0fa0061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:37:43.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.245+0000 7f0fb1ffb700 1 -- 172.21.15.1:0/1724625687 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f0fb807a870 con 0x7f0fbc137210 2023-11-15T01:37:43.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.245+0000 7f0fc1075700 1 --2- 172.21.15.1:0/1724625687 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0fa005f080 0x7f0fa0061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:37:43.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.245+0000 7f0fc1075700 1 --2- 172.21.15.1:0/1724625687 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0fa005f080 0x7f0fa0061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0fac009760 tx=0x7f0fac016000).ready entity=mgr.6185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:37:43.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.249+0000 7f0fb1ffb700 1 -- 172.21.15.1:0/1724625687 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0fb804ba00 con 0x7f0fbc137210 2023-11-15T01:37:43.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.448+0000 7f0fc2878700 1 -- 172.21.15.1:0/1724625687 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fbc155050 con 0x7f0fa005f080 2023-11-15T01:37:43.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.451+0000 7f0fb1ffb700 1 -- 172.21.15.1:0/1724625687 <== mgr.6185 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7f0fbc155050 con 0x7f0fa005f080 2023-11-15T01:37:43.453 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:37:43.453 INFO:teuthology.orchestra.run.smithi001.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:37:43", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-11-15T01:37:43.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.453+0000 7f0fc2878700 1 -- 172.21.15.1:0/1724625687 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0fa005f080 msgr2=0x7f0fa0061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:43.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.453+0000 7f0fc2878700 1 --2- 172.21.15.1:0/1724625687 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0fa005f080 0x7f0fa0061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0fac009760 tx=0x7f0fac016000).stop 2023-11-15T01:37:43.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.453+0000 7f0fc2878700 1 -- 172.21.15.1:0/1724625687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fbc137210 msgr2=0x7f0fbc1653b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:37:43.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.453+0000 7f0fc2878700 1 --2- 172.21.15.1:0/1724625687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fbc137210 0x7f0fbc1653b0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f0fb800e930 tx=0x7f0fb8009060).stop 2023-11-15T01:37:43.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.453+0000 7f0fc2878700 1 -- 172.21.15.1:0/1724625687 shutdown_connections 2023-11-15T01:37:43.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.453+0000 7f0fc2878700 1 --2- 172.21.15.1:0/1724625687 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0fa005f080 0x7f0fa0061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:43.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.453+0000 7f0fc2878700 1 --2- 172.21.15.1:0/1724625687 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fbc14ea50 0x7f0fbc0c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:43.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.453+0000 7f0fc2878700 1 --2- 172.21.15.1:0/1724625687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0fbc137210 0x7f0fbc1653b0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:43.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.453+0000 7f0fc2878700 1 --2- 172.21.15.1:0/1724625687 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc1375f0 0x7f0fbc135420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:37:43.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.453+0000 7f0fc2878700 1 -- 172.21.15.1:0/1724625687 >> 172.21.15.1:0/1724625687 conn(0x7f0fbc063280 msgr2=0x7f0fbc066920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:37:43.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.453+0000 7f0fc2878700 1 -- 172.21.15.1:0/1724625687 shutdown_connections 2023-11-15T01:37:43.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:37:43.453+0000 7f0fc2878700 1 -- 172.21.15.1:0/1724625687 wait complete. 2023-11-15T01:37:43.466 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:37:43", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-11-15T01:37:47.327 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:37:47.331 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:38:00.097 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:00.096+0000 7f852c415700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:38:00.098 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:00.096+0000 7f852c415700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:38:00.098 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:00.096+0000 7f852c415700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:38:00.098 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:00.096+0000 7f852c415700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:38:00.098 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:00.096+0000 7f852c415700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:38:17.399 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:38:17.402 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:38:43.470 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-11-15T01:38:43.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.604+0000 7f81cf472700 1 Processor -- start 2023-11-15T01:38:43.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.604+0000 7f81cf472700 1 -- start start 2023-11-15T01:38:43.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.605+0000 7f81cf472700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f81c80c1cb0 0x7f81c8157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:43.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.605+0000 7f81cf472700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c80aa060 0x7f81c80aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:43.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.605+0000 7f81cf472700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c80c1820 con 0x7f81c8157660 2023-11-15T01:38:43.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.605+0000 7f81cf472700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c80c7540 con 0x7f81c80c1cb0 2023-11-15T01:38:43.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.605+0000 7f81cf472700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80aa9e0 con 0x7f81c80aa060 2023-11-15T01:38:43.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.605+0000 7f81cca0d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f81c80c1cb0 0x7f81c8157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:43.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.605+0000 7f81cca0d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f81c80c1cb0 0x7f81c8157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49612/0 (socket says 172.21.15.1:49612) 2023-11-15T01:38:43.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.605+0000 7f81cca0d700 1 -- 172.21.15.1:0/1693195431 learned_addr learned my addr 172.21.15.1:0/1693195431 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:43.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81cca0d700 1 -- 172.21.15.1:0/1693195431 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c80aa060 msgr2=0x7f81c80aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:43.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81cda0f700 1 --2- 172.21.15.1:0/1693195431 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c80aa060 0x7f81c80aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:43.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81cca0d700 1 --2- 172.21.15.1:0/1693195431 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c80aa060 0x7f81c80aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:43.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81cca0d700 1 -- 172.21.15.1:0/1693195431 >> v1:172.21.15.141:6789/0 conn(0x7f81c8157660 legacy=0x7f81c80c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:43.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81cca0d700 1 -- 172.21.15.1:0/1693195431 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c80c0c30 con 0x7f81c80c1cb0 2023-11-15T01:38:43.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81cda0f700 1 --2- 172.21.15.1:0/1693195431 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c80aa060 0x7f81c80aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:38:43.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81cca0d700 1 --2- 172.21.15.1:0/1693195431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c80c1cb0 0x7f81c8157a40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f81b8006fd0 tx=0x7f81b80090f0).ready entity=mon.0 client_cookie=174fbac4899ee3dd server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:43.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81bffff700 1 -- 172.21.15.1:0/1693195431 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b800b600 con 0x7f81c80c1cb0 2023-11-15T01:38:43.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81bffff700 1 -- 172.21.15.1:0/1693195431 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b800b760 con 0x7f81c80c1cb0 2023-11-15T01:38:43.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81bffff700 1 -- 172.21.15.1:0/1693195431 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b800bb00 con 0x7f81c80c1cb0 2023-11-15T01:38:43.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81cf472700 1 -- 172.21.15.1:0/1693195431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c80c1cb0 msgr2=0x7f81c8157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:43.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81cf472700 1 --2- 172.21.15.1:0/1693195431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c80c1cb0 0x7f81c8157a40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f81b8006fd0 tx=0x7f81b80090f0).stop 2023-11-15T01:38:43.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81cf472700 1 -- 172.21.15.1:0/1693195431 shutdown_connections 2023-11-15T01:38:43.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81cf472700 1 --2- 172.21.15.1:0/1693195431 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c80aa060 0x7f81c80aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:43.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81cf472700 1 --2- 172.21.15.1:0/1693195431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c80c1cb0 0x7f81c8157a40 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:43.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.606+0000 7f81cf472700 1 -- 172.21.15.1:0/1693195431 >> 172.21.15.1:0/1693195431 conn(0x7f81c8064aa0 msgr2=0x7f81c8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:43.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.607+0000 7f81cf472700 1 -- 172.21.15.1:0/1693195431 shutdown_connections 2023-11-15T01:38:43.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.607+0000 7f81cf472700 1 -- 172.21.15.1:0/1693195431 wait complete. 2023-11-15T01:38:43.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.608+0000 7f81cf472700 1 Processor -- start 2023-11-15T01:38:43.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.608+0000 7f81cf472700 1 -- start start 2023-11-15T01:38:43.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cf472700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81c80aa060 0x7f81c8142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:43.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cf472700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c80c1cb0 0x7f81c8164700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:43.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cf472700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c8157660 0x7f81c8168330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:43.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cf472700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8167ee0 con 0x7f81c80c1cb0 2023-11-15T01:38:43.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cf472700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8165710 con 0x7f81c80aa060 2023-11-15T01:38:43.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cf472700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80c2490 con 0x7f81c8157660 2023-11-15T01:38:43.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cca0d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c80c1cb0 0x7f81c8164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:43.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cca0d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c80c1cb0 0x7f81c8164700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49618/0 (socket says 172.21.15.1:49618) 2023-11-15T01:38:43.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cca0d700 1 -- 172.21.15.1:0/3487212659 learned_addr learned my addr 172.21.15.1:0/3487212659 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:43.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cda0f700 1 --2- 172.21.15.1:0/3487212659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c8157660 0x7f81c8168330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:43.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cd20e700 1 --2- 172.21.15.1:0/3487212659 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81c80aa060 0x7f81c8142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:43.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cca0d700 1 -- 172.21.15.1:0/3487212659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c8157660 msgr2=0x7f81c8168330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:43.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cca0d700 1 --2- 172.21.15.1:0/3487212659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c8157660 0x7f81c8168330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:43.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cca0d700 1 -- 172.21.15.1:0/3487212659 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81c80aa060 msgr2=0x7f81c8142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:43.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cca0d700 1 --2- 172.21.15.1:0/3487212659 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81c80aa060 0x7f81c8142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:43.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cca0d700 1 -- 172.21.15.1:0/3487212659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b8009370 con 0x7f81c80c1cb0 2023-11-15T01:38:43.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cca0d700 1 --2- 172.21.15.1:0/3487212659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c80c1cb0 0x7f81c8164700 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f81b8009170 tx=0x7f81b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:43.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81bd7fa700 1 -- 172.21.15.1:0/3487212659 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b800bec0 con 0x7f81c80c1cb0 2023-11-15T01:38:43.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81bd7fa700 1 -- 172.21.15.1:0/3487212659 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b8000bc0 con 0x7f81c80c1cb0 2023-11-15T01:38:43.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cf472700 1 -- 172.21.15.1:0/3487212659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c8143110 con 0x7f81c80c1cb0 2023-11-15T01:38:43.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81bd7fa700 1 -- 172.21.15.1:0/3487212659 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b800bb00 con 0x7f81c80c1cb0 2023-11-15T01:38:43.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.609+0000 7f81cf472700 1 -- 172.21.15.1:0/3487212659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c8164e70 con 0x7f81c80c1cb0 2023-11-15T01:38:43.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.611+0000 7f81cf472700 1 -- 172.21.15.1:0/3487212659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c8167cb0 con 0x7f81c80c1cb0 2023-11-15T01:38:43.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.611+0000 7f81bd7fa700 1 -- 172.21.15.1:0/3487212659 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 44) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f81b8021070 con 0x7f81c80c1cb0 2023-11-15T01:38:43.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.611+0000 7f81bd7fa700 1 --2- 172.21.15.1:0/3487212659 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f81ac05f3e0 0x7f81ac0618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:43.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.611+0000 7f81bd7fa700 1 -- 172.21.15.1:0/3487212659 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f81b807c440 con 0x7f81c80c1cb0 2023-11-15T01:38:43.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.612+0000 7f81cd20e700 1 --2- 172.21.15.1:0/3487212659 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f81ac05f3e0 0x7f81ac0618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:43.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.612+0000 7f81cd20e700 1 --2- 172.21.15.1:0/3487212659 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f81ac05f3e0 0x7f81ac0618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f81c4003860 tx=0x7f81c4007d40).ready entity=mgr.6185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:43.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.616+0000 7f81bd7fa700 1 -- 172.21.15.1:0/3487212659 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f81b804d0b0 con 0x7f81c80c1cb0 2023-11-15T01:38:43.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.813+0000 7f81cf472700 1 -- 172.21.15.1:0/3487212659 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81c80c0ef0 con 0x7f81ac05f3e0 2023-11-15T01:38:43.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.815+0000 7f81bd7fa700 1 -- 172.21.15.1:0/3487212659 <== mgr.6185 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7f81c80c0ef0 con 0x7f81ac05f3e0 2023-11-15T01:38:43.816 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:38:43.816 INFO:teuthology.orchestra.run.smithi001.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:37:43", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-11-15T01:38:43.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.817+0000 7f81cf472700 1 -- 172.21.15.1:0/3487212659 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f81ac05f3e0 msgr2=0x7f81ac0618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:43.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.817+0000 7f81cf472700 1 --2- 172.21.15.1:0/3487212659 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f81ac05f3e0 0x7f81ac0618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f81c4003860 tx=0x7f81c4007d40).stop 2023-11-15T01:38:43.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.817+0000 7f81cf472700 1 -- 172.21.15.1:0/3487212659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c80c1cb0 msgr2=0x7f81c8164700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:43.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.817+0000 7f81cf472700 1 --2- 172.21.15.1:0/3487212659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c80c1cb0 0x7f81c8164700 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f81b8009170 tx=0x7f81b8017000).stop 2023-11-15T01:38:43.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.817+0000 7f81cf472700 1 -- 172.21.15.1:0/3487212659 shutdown_connections 2023-11-15T01:38:43.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.817+0000 7f81cf472700 1 --2- 172.21.15.1:0/3487212659 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f81ac05f3e0 0x7f81ac0618a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:43.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.817+0000 7f81cf472700 1 --2- 172.21.15.1:0/3487212659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81c8157660 0x7f81c8168330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:43.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.817+0000 7f81cf472700 1 --2- 172.21.15.1:0/3487212659 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81c80aa060 0x7f81c8142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:43.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.817+0000 7f81cf472700 1 --2- 172.21.15.1:0/3487212659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c80c1cb0 0x7f81c8164700 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:43.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.817+0000 7f81cf472700 1 -- 172.21.15.1:0/3487212659 >> 172.21.15.1:0/3487212659 conn(0x7f81c8064aa0 msgr2=0x7f81c8154770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:43.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.817+0000 7f81cf472700 1 -- 172.21.15.1:0/3487212659 shutdown_connections 2023-11-15T01:38:43.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.817+0000 7f81cf472700 1 -- 172.21.15.1:0/3487212659 wait complete. 2023-11-15T01:38:43.830 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:37:43", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-11-15T01:38:43.831 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-11-15T01:38:43.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.957+0000 7f3b98c69700 1 Processor -- start 2023-11-15T01:38:43.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.957+0000 7f3b98c69700 1 -- start start 2023-11-15T01:38:43.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.958+0000 7f3b98c69700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3b94157660 0x7f3b94157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:43.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.958+0000 7f3b98c69700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3b940aa060 0x7f3b940aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:43.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.958+0000 7f3b98c69700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b940c1820 con 0x7f3b940c1cb0 2023-11-15T01:38:43.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.958+0000 7f3b98c69700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b940c7540 con 0x7f3b94157660 2023-11-15T01:38:43.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.958+0000 7f3b98c69700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b940aa9e0 con 0x7f3b940aa060 2023-11-15T01:38:43.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.958+0000 7f3b9259c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3b94157660 0x7f3b94157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:43.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.958+0000 7f3b91d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3b940c1cb0 0x7f3b940c6280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:54986/0 (socket says 172.21.15.1:54986) 2023-11-15T01:38:43.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.958+0000 7f3b91d9b700 1 -- 172.21.15.1:0/649498276 learned_addr learned my addr 172.21.15.1:0/649498276 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:43.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.958+0000 7f3b9259c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3b94157660 0x7f3b94157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49620/0 (socket says 172.21.15.1:49620) 2023-11-15T01:38:43.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.959+0000 7f3b92d9d700 1 --2- 172.21.15.1:0/649498276 >> v2:172.21.15.141:3300/0 conn(0x7f3b940aa060 0x7f3b940aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:43.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.959+0000 7f3b9259c700 1 -- 172.21.15.1:0/649498276 >> v2:172.21.15.141:3300/0 conn(0x7f3b940aa060 msgr2=0x7f3b940aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:43.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.959+0000 7f3b9259c700 1 --2- 172.21.15.1:0/649498276 >> v2:172.21.15.141:3300/0 conn(0x7f3b940aa060 0x7f3b940aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:43.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.959+0000 7f3b9259c700 1 -- 172.21.15.1:0/649498276 >> v1:172.21.15.1:6789/0 conn(0x7f3b940c1cb0 legacy=0x7f3b940c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:43.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.959+0000 7f3b9159a700 1 -- 172.21.15.1:0/649498276 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239110910 0 0) 0x7f3b940c1820 con 0x7f3b940c1cb0 2023-11-15T01:38:43.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.959+0000 7f3b9259c700 1 -- 172.21.15.1:0/649498276 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b940c0c30 con 0x7f3b94157660 2023-11-15T01:38:43.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.959+0000 7f3b9259c700 1 --2- 172.21.15.1:0/649498276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94157660 0x7f3b94157a40 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f3b94157f30 tx=0x7f3b8c009780).ready entity=mon.0 client_cookie=7ff2468a76230f05 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:43.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.959+0000 7f3b9159a700 1 -- 172.21.15.1:0/649498276 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c00e070 con 0x7f3b94157660 2023-11-15T01:38:43.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.959+0000 7f3b9159a700 1 -- 172.21.15.1:0/649498276 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c00bc30 con 0x7f3b94157660 2023-11-15T01:38:43.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.959+0000 7f3b9159a700 1 -- 172.21.15.1:0/649498276 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c012410 con 0x7f3b94157660 2023-11-15T01:38:43.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.960+0000 7f3b98c69700 1 -- 172.21.15.1:0/649498276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94157660 msgr2=0x7f3b94157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:43.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.960+0000 7f3b98c69700 1 --2- 172.21.15.1:0/649498276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94157660 0x7f3b94157a40 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f3b94157f30 tx=0x7f3b8c009780).stop 2023-11-15T01:38:43.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.960+0000 7f3b98c69700 1 -- 172.21.15.1:0/649498276 shutdown_connections 2023-11-15T01:38:43.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.960+0000 7f3b98c69700 1 --2- 172.21.15.1:0/649498276 >> v2:172.21.15.141:3300/0 conn(0x7f3b940aa060 0x7f3b940aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:43.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.960+0000 7f3b98c69700 1 --2- 172.21.15.1:0/649498276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94157660 0x7f3b94157a40 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:43.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.960+0000 7f3b98c69700 1 -- 172.21.15.1:0/649498276 >> 172.21.15.1:0/649498276 conn(0x7f3b94064aa0 msgr2=0x7f3b94064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:43.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.960+0000 7f3b98c69700 1 -- 172.21.15.1:0/649498276 shutdown_connections 2023-11-15T01:38:43.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.960+0000 7f3b98c69700 1 -- 172.21.15.1:0/649498276 wait complete. 2023-11-15T01:38:43.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.961+0000 7f3b98c69700 1 Processor -- start 2023-11-15T01:38:43.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.961+0000 7f3b98c69700 1 -- start start 2023-11-15T01:38:43.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.961+0000 7f3b98c69700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b940aa060 0x7f3b94156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:43.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b98c69700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b940c1cb0 0x7f3b94163f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:43.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b98c69700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94157660 0x7f3b940ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:43.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b98c69700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b94164f10 con 0x7f3b94157660 2023-11-15T01:38:43.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b98c69700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b94155c30 con 0x7f3b940aa060 2023-11-15T01:38:43.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b98c69700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b94164410 con 0x7f3b940c1cb0 2023-11-15T01:38:43.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b92d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94157660 0x7f3b940ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:43.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b92d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94157660 0x7f3b940ac8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49624/0 (socket says 172.21.15.1:49624) 2023-11-15T01:38:43.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b92d9d700 1 -- 172.21.15.1:0/3844940792 learned_addr learned my addr 172.21.15.1:0/3844940792 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:43.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b9259c700 1 --2- 172.21.15.1:0/3844940792 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b940aa060 0x7f3b94156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:43.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b91d9b700 1 --2- 172.21.15.1:0/3844940792 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b940c1cb0 0x7f3b94163f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:43.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b92d9d700 1 -- 172.21.15.1:0/3844940792 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b940c1cb0 msgr2=0x7f3b94163f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:43.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b92d9d700 1 --2- 172.21.15.1:0/3844940792 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b940c1cb0 0x7f3b94163f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:43.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b92d9d700 1 -- 172.21.15.1:0/3844940792 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b940aa060 msgr2=0x7f3b94156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:43.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b92d9d700 1 --2- 172.21.15.1:0/3844940792 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b940aa060 0x7f3b94156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:43.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b92d9d700 1 -- 172.21.15.1:0/3844940792 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c009a20 con 0x7f3b94157660 2023-11-15T01:38:43.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b92d9d700 1 --2- 172.21.15.1:0/3844940792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94157660 0x7f3b940ac8a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f3b8400d890 tx=0x7f3b84008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:43.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b8a7fc700 1 -- 172.21.15.1:0/3844940792 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84011590 con 0x7f3b94157660 2023-11-15T01:38:43.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b8a7fc700 1 -- 172.21.15.1:0/3844940792 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b840116f0 con 0x7f3b94157660 2023-11-15T01:38:43.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b98c69700 1 -- 172.21.15.1:0/3844940792 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b94164670 con 0x7f3b94157660 2023-11-15T01:38:43.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b8a7fc700 1 -- 172.21.15.1:0/3844940792 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84011a70 con 0x7f3b94157660 2023-11-15T01:38:43.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.962+0000 7f3b98c69700 1 -- 172.21.15.1:0/3844940792 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b94164c30 con 0x7f3b94157660 2023-11-15T01:38:43.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.964+0000 7f3b98c69700 1 -- 172.21.15.1:0/3844940792 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b94156f80 con 0x7f3b94157660 2023-11-15T01:38:43.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.964+0000 7f3b8a7fc700 1 -- 172.21.15.1:0/3844940792 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 44) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f3b84012420 con 0x7f3b94157660 2023-11-15T01:38:43.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.964+0000 7f3b8a7fc700 1 --2- 172.21.15.1:0/3844940792 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3b7405f410 0x7f3b740618d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:43.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.964+0000 7f3b8a7fc700 1 -- 172.21.15.1:0/3844940792 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f3b8407a280 con 0x7f3b94157660 2023-11-15T01:38:43.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.964+0000 7f3b9259c700 1 --2- 172.21.15.1:0/3844940792 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3b7405f410 0x7f3b740618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:43.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.965+0000 7f3b9259c700 1 --2- 172.21.15.1:0/3844940792 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3b7405f410 0x7f3b740618d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3b8c009fd0 tx=0x7f3b8c009780).ready entity=mgr.6185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:43.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:43.968+0000 7f3b8a7fc700 1 -- 172.21.15.1:0/3844940792 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3b8404ae90 con 0x7f3b94157660 2023-11-15T01:38:44.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.165+0000 7f3b98c69700 1 -- 172.21.15.1:0/3844940792 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b9406c7e0 con 0x7f3b7405f410 2023-11-15T01:38:44.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.170+0000 7f3b8a7fc700 1 -- 172.21.15.1:0/3844940792 <== mgr.6185 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7f3b9406c7e0 con 0x7f3b7405f410 2023-11-15T01:38:44.171 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path /bad-path 2023-11-15T01:38:44.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.171+0000 7f3b98c69700 1 -- 172.21.15.1:0/3844940792 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3b7405f410 msgr2=0x7f3b740618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:44.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.171+0000 7f3b98c69700 1 --2- 172.21.15.1:0/3844940792 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3b7405f410 0x7f3b740618d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3b8c009fd0 tx=0x7f3b8c009780).stop 2023-11-15T01:38:44.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.171+0000 7f3b98c69700 1 -- 172.21.15.1:0/3844940792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94157660 msgr2=0x7f3b940ac8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:44.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.171+0000 7f3b98c69700 1 --2- 172.21.15.1:0/3844940792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94157660 0x7f3b940ac8a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f3b8400d890 tx=0x7f3b84008040).stop 2023-11-15T01:38:44.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.172+0000 7f3b98c69700 1 -- 172.21.15.1:0/3844940792 shutdown_connections 2023-11-15T01:38:44.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.172+0000 7f3b98c69700 1 --2- 172.21.15.1:0/3844940792 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3b7405f410 0x7f3b740618d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:44.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.172+0000 7f3b98c69700 1 --2- 172.21.15.1:0/3844940792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94157660 0x7f3b940ac8a0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:44.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.172+0000 7f3b98c69700 1 --2- 172.21.15.1:0/3844940792 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b940aa060 0x7f3b94156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:44.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.172+0000 7f3b98c69700 1 --2- 172.21.15.1:0/3844940792 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b940c1cb0 0x7f3b94163f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:44.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.172+0000 7f3b98c69700 1 -- 172.21.15.1:0/3844940792 >> 172.21.15.1:0/3844940792 conn(0x7f3b94064aa0 msgr2=0x7f3b940ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:44.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.172+0000 7f3b98c69700 1 -- 172.21.15.1:0/3844940792 shutdown_connections 2023-11-15T01:38:44.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.172+0000 7f3b98c69700 1 -- 172.21.15.1:0/3844940792 wait complete. 2023-11-15T01:38:44.185 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-11-15T01:38:44.185 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-15T01:38:44.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.304+0000 7f66120a3700 1 Processor -- start 2023-11-15T01:38:44.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.304+0000 7f66120a3700 1 -- start start 2023-11-15T01:38:44.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f66120a3700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f660c1540a0 0x7f660c0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:44.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f66120a3700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660c0ca050 con 0x7f660c0c6650 2023-11-15T01:38:44.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f66120a3700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660c0c9440 con 0x7f660c154480 2023-11-15T01:38:44.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f66120a3700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660c0c9720 con 0x7f660c1540a0 2023-11-15T01:38:44.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f660bfff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f660c0c6650 0x7f660c0aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55000/0 (socket says 172.21.15.1:55000) 2023-11-15T01:38:44.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f660bfff700 1 -- 172.21.15.1:0/929770023 learned_addr learned my addr 172.21.15.1:0/929770023 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:44.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f660b7fe700 1 --2- 172.21.15.1:0/929770023 >> v2:172.21.15.141:3300/0 conn(0x7f660c1540a0 0x7f660c0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:44.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f660a7fc700 1 -- 172.21.15.1:0/929770023 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494308546 0 0) 0x7f660c0ca050 con 0x7f660c0c6650 2023-11-15T01:38:44.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f660a7fc700 1 -- 172.21.15.1:0/929770023 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65f40033f0 con 0x7f660c0c6650 2023-11-15T01:38:44.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f660a7fc700 1 -- 172.21.15.1:0/929770023 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3349599858 0 0) 0x7f65f40033f0 con 0x7f660c0c6650 2023-11-15T01:38:44.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f660a7fc700 1 -- 172.21.15.1:0/929770023 >> v2:172.21.15.141:3300/0 conn(0x7f660c1540a0 msgr2=0x7f660c0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:44.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f660a7fc700 1 --2- 172.21.15.1:0/929770023 >> v2:172.21.15.141:3300/0 conn(0x7f660c1540a0 0x7f660c0ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:44.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f660a7fc700 1 -- 172.21.15.1:0/929770023 >> v1:172.21.15.141:6789/0 conn(0x7f660c154480 legacy=0x7f660c0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:44.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f660a7fc700 1 -- 172.21.15.1:0/929770023 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c0c9a00 con 0x7f660c0c6650 2023-11-15T01:38:44.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f660a7fc700 1 -- 172.21.15.1:0/929770023 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f66040017f0 con 0x7f660c0c6650 2023-11-15T01:38:44.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f660b7fe700 1 --2- 172.21.15.1:0/929770023 >> v2:172.21.15.141:3300/0 conn(0x7f660c1540a0 0x7f660c0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:38:44.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.305+0000 7f660a7fc700 1 -- 172.21.15.1:0/929770023 >> v1:172.21.15.1:6789/0 conn(0x7f660c0c6650 legacy=0x7f660c0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:44.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660a7fc700 1 --2- 172.21.15.1:0/929770023 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65f40038e0 0x7f65f4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:44.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660a7fc700 1 --2- 172.21.15.1:0/929770023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65f4004690 0x7f65f4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:44.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660a7fc700 1 --2- 172.21.15.1:0/929770023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65f4005050 0x7f65f400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:44.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660a7fc700 1 -- 172.21.15.1:0/929770023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c0c9720 con 0x7f65f4004690 2023-11-15T01:38:44.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660a7fc700 1 -- 172.21.15.1:0/929770023 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f400bf30 con 0x7f65f40038e0 2023-11-15T01:38:44.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660a7fc700 1 -- 172.21.15.1:0/929770023 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f400c0f0 con 0x7f65f4005050 2023-11-15T01:38:44.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660affd700 1 --2- 172.21.15.1:0/929770023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65f4004690 0x7f65f4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:44.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660b7fe700 1 --2- 172.21.15.1:0/929770023 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65f40038e0 0x7f65f4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:44.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660bfff700 1 --2- 172.21.15.1:0/929770023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65f4005050 0x7f65f400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:44.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660affd700 1 -- 172.21.15.1:0/929770023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65f4005050 msgr2=0x7f65f400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:44.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660affd700 1 --2- 172.21.15.1:0/929770023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65f4005050 0x7f65f400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:44.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660affd700 1 -- 172.21.15.1:0/929770023 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65f40038e0 msgr2=0x7f65f4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:44.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660affd700 1 --2- 172.21.15.1:0/929770023 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65f40038e0 0x7f65f4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:44.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660bfff700 1 -- 172.21.15.1:0/929770023 reap_dead start 2023-11-15T01:38:44.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660affd700 1 -- 172.21.15.1:0/929770023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f40033f0 con 0x7f65f4004690 2023-11-15T01:38:44.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660affd700 1 --2- 172.21.15.1:0/929770023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65f4004690 0x7f65f4004b10 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f6600001730 tx=0x7f6600007bb0).ready entity=mon.0 client_cookie=398fa8d926eed9b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:44.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660a7fc700 1 -- 172.21.15.1:0/929770023 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600007020 con 0x7f65f4004690 2023-11-15T01:38:44.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660a7fc700 1 -- 172.21.15.1:0/929770023 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6600007180 con 0x7f65f4004690 2023-11-15T01:38:44.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.306+0000 7f660a7fc700 1 -- 172.21.15.1:0/929770023 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600007500 con 0x7f65f4004690 2023-11-15T01:38:44.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.307+0000 7f66120a3700 1 -- 172.21.15.1:0/929770023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65f4004690 msgr2=0x7f65f4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:44.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.307+0000 7f66120a3700 1 --2- 172.21.15.1:0/929770023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65f4004690 0x7f65f4004b10 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f6600001730 tx=0x7f6600007bb0).stop 2023-11-15T01:38:44.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.307+0000 7f66120a3700 1 -- 172.21.15.1:0/929770023 shutdown_connections 2023-11-15T01:38:44.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.307+0000 7f66120a3700 1 --2- 172.21.15.1:0/929770023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65f4004690 0x7f65f4004b10 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:44.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.307+0000 7f66120a3700 1 -- 172.21.15.1:0/929770023 >> 172.21.15.1:0/929770023 conn(0x7f660c064a70 msgr2=0x7f660c064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:44.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.307+0000 7f66120a3700 1 -- 172.21.15.1:0/929770023 shutdown_connections 2023-11-15T01:38:44.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.307+0000 7f66120a3700 1 -- 172.21.15.1:0/929770023 wait complete. 2023-11-15T01:38:44.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.308+0000 7f66120a3700 1 Processor -- start 2023-11-15T01:38:44.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.308+0000 7f66120a3700 1 -- start start 2023-11-15T01:38:44.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f66120a3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65f4004690 0x7f660c156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:44.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f66120a3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f660c0af580 0x7f660c14eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:44.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f66120a3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c14f190 0x7f660c14f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:44.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f66120a3700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c0ae060 con 0x7f660c14f190 2023-11-15T01:38:44.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f66120a3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c157980 con 0x7f660c0af580 2023-11-15T01:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f66120a3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c153550 con 0x7f65f4004690 2023-11-15T01:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f660bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c14f190 0x7f660c14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f660bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c14f190 0x7f660c14f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49636/0 (socket says 172.21.15.1:49636) 2023-11-15T01:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f660bfff700 1 -- 172.21.15.1:0/3188025187 learned_addr learned my addr 172.21.15.1:0/3188025187 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f660affd700 1 --2- 172.21.15.1:0/3188025187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f660c0af580 0x7f660c14eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f660b7fe700 1 --2- 172.21.15.1:0/3188025187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65f4004690 0x7f660c156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f660bfff700 1 -- 172.21.15.1:0/3188025187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65f4004690 msgr2=0x7f660c156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f660bfff700 1 --2- 172.21.15.1:0/3188025187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65f4004690 0x7f660c156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f660bfff700 1 -- 172.21.15.1:0/3188025187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f660c0af580 msgr2=0x7f660c14eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f660bfff700 1 --2- 172.21.15.1:0/3188025187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f660c0af580 0x7f660c14eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.309+0000 7f660bfff700 1 -- 172.21.15.1:0/3188025187 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c153830 con 0x7f660c14f190 2023-11-15T01:38:44.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.310+0000 7f660bfff700 1 --2- 172.21.15.1:0/3188025187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c14f190 0x7f660c14f750 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f660c0841f0 tx=0x7f6604007d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:44.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.310+0000 7f65f37fe700 1 -- 172.21.15.1:0/3188025187 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660400f8a0 con 0x7f660c14f190 2023-11-15T01:38:44.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.310+0000 7f65f37fe700 1 -- 172.21.15.1:0/3188025187 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660400fa00 con 0x7f660c14f190 2023-11-15T01:38:44.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.310+0000 7f66120a3700 1 -- 172.21.15.1:0/3188025187 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660c157130 con 0x7f660c14f190 2023-11-15T01:38:44.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.310+0000 7f65f37fe700 1 -- 172.21.15.1:0/3188025187 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660400fd80 con 0x7f660c14f190 2023-11-15T01:38:44.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.310+0000 7f66120a3700 1 -- 172.21.15.1:0/3188025187 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660c0b0d10 con 0x7f660c14f190 2023-11-15T01:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.311+0000 7f66120a3700 1 -- 172.21.15.1:0/3188025187 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660c1533b0 con 0x7f660c14f190 2023-11-15T01:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.311+0000 7f65f37fe700 1 -- 172.21.15.1:0/3188025187 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 44) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f6604012560 con 0x7f660c14f190 2023-11-15T01:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.312+0000 7f65f37fe700 1 --2- 172.21.15.1:0/3188025187 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65f805f3e0 0x7f65f80618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.312+0000 7f65f37fe700 1 -- 172.21.15.1:0/3188025187 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f660407a3e0 con 0x7f660c14f190 2023-11-15T01:38:44.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.312+0000 7f660b7fe700 1 --2- 172.21.15.1:0/3188025187 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65f805f3e0 0x7f65f80618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:44.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.312+0000 7f660b7fe700 1 --2- 172.21.15.1:0/3188025187 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65f805f3e0 0x7f65f80618a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f660c06cb20 tx=0x7f65fc008040).ready entity=mgr.6185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:44.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.316+0000 7f65f37fe700 1 -- 172.21.15.1:0/3188025187 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f660c1533b0 con 0x7f660c14f190 2023-11-15T01:38:44.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.540+0000 7f66120a3700 1 -- 172.21.15.1:0/3188025187 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f660c1533b0 con 0x7f660c14f190 2023-11-15T01:38:44.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.894+0000 7f65f37fe700 1 -- 172.21.15.1:0/3188025187 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f6604077b50 con 0x7f660c14f190 2023-11-15T01:38:44.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.896+0000 7f65f37fe700 1 -- 172.21.15.1:0/3188025187 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v45) v1 ==== 93+0+0 (secure 0 0 0) 0x7f6604072940 con 0x7f660c14f190 2023-11-15T01:38:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.898+0000 7f66120a3700 1 -- 172.21.15.1:0/3188025187 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65f805f3e0 msgr2=0x7f65f80618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.898+0000 7f66120a3700 1 --2- 172.21.15.1:0/3188025187 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65f805f3e0 0x7f65f80618a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f660c06cb20 tx=0x7f65fc008040).stop 2023-11-15T01:38:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.898+0000 7f66120a3700 1 -- 172.21.15.1:0/3188025187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c14f190 msgr2=0x7f660c14f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:44.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.898+0000 7f66120a3700 1 --2- 172.21.15.1:0/3188025187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c14f190 0x7f660c14f750 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f660c0841f0 tx=0x7f6604007d50).stop 2023-11-15T01:38:44.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.898+0000 7f66120a3700 1 -- 172.21.15.1:0/3188025187 shutdown_connections 2023-11-15T01:38:44.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.898+0000 7f66120a3700 1 --2- 172.21.15.1:0/3188025187 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65f805f3e0 0x7f65f80618a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:44.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.898+0000 7f66120a3700 1 --2- 172.21.15.1:0/3188025187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c14f190 0x7f660c14f750 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:44.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.898+0000 7f66120a3700 1 --2- 172.21.15.1:0/3188025187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65f4004690 0x7f660c156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:44.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.898+0000 7f66120a3700 1 --2- 172.21.15.1:0/3188025187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f660c0af580 0x7f660c14eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:44.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.898+0000 7f66120a3700 1 -- 172.21.15.1:0/3188025187 >> 172.21.15.1:0/3188025187 conn(0x7f660c064a70 msgr2=0x7f660c0ad3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:44.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.898+0000 7f66120a3700 1 -- 172.21.15.1:0/3188025187 shutdown_connections 2023-11-15T01:38:44.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:44.898+0000 7f66120a3700 1 -- 172.21.15.1:0/3188025187 wait complete. 2023-11-15T01:38:44.913 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T01:38:44.914 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:38:44.952 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:38:44.986 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T01:38:44.986 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-15T01:38:44.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:38:44.988 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-15T01:38:45.031 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T01:38:45.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:38:45.032 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-15T01:38:45.043 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:45.042+0000 7fc205ca3680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:38:45.045 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:45.044+0000 7faf42cea680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:38:45.060 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:38:45.105 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:45.104+0000 7fc205ca3680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:38:45.112 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:45.111+0000 7faf42cea680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:38:45.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.219+0000 7f21f9552700 1 Processor -- start 2023-11-15T01:38:45.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.219+0000 7f21f9552700 1 -- start start 2023-11-15T01:38:45.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.219+0000 7f21f9552700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f21f40629e0 0x7f21f40c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.219+0000 7f21f9552700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f21f40c3400 0x7f21f40ab430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f9552700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f40a9f60 con 0x7f21f40ab920 2023-11-15T01:38:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f9552700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f40c3880 con 0x7f21f40c3400 2023-11-15T01:38:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f9552700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f4151700 con 0x7f21f40629e0 2023-11-15T01:38:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f27fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f21f40c3400 0x7f21f40ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f27fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f21f40c3400 0x7f21f40ab430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49654/0 (socket says 172.21.15.1:49654) 2023-11-15T01:38:45.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f37fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f21f40ab920 0x7f21f4064df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55014/0 (socket says 172.21.15.1:55014) 2023-11-15T01:38:45.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f27fc700 1 -- 172.21.15.1:0/3792080886 learned_addr learned my addr 172.21.15.1:0/3792080886 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:45.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f2ffd700 1 --2- 172.21.15.1:0/3792080886 >> v2:172.21.15.141:3300/0 conn(0x7f21f40629e0 0x7f21f40c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f27fc700 1 -- 172.21.15.1:0/3792080886 >> v2:172.21.15.141:3300/0 conn(0x7f21f40629e0 msgr2=0x7f21f40c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:45.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f27fc700 1 --2- 172.21.15.1:0/3792080886 >> v2:172.21.15.141:3300/0 conn(0x7f21f40629e0 0x7f21f40c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f27fc700 1 -- 172.21.15.1:0/3792080886 >> v1:172.21.15.1:6789/0 conn(0x7f21f40ab920 legacy=0x7f21f4064df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:45.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f1ffb700 1 -- 172.21.15.1:0/3792080886 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309614759 0 0) 0x7f21f40a9f60 con 0x7f21f40ab920 2023-11-15T01:38:45.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f27fc700 1 -- 172.21.15.1:0/3792080886 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f40c2a80 con 0x7f21f40c3400 2023-11-15T01:38:45.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f27fc700 1 --2- 172.21.15.1:0/3792080886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f40c3400 0x7f21f40ab430 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f21f40c7400 tx=0x7f21e80090f0).ready entity=mon.0 client_cookie=605f82b3bb7f4d7c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f1ffb700 1 -- 172.21.15.1:0/3792080886 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e800b520 con 0x7f21f40c3400 2023-11-15T01:38:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f1ffb700 1 -- 172.21.15.1:0/3792080886 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e800b680 con 0x7f21f40c3400 2023-11-15T01:38:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.220+0000 7f21f1ffb700 1 -- 172.21.15.1:0/3792080886 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e800ba00 con 0x7f21f40c3400 2023-11-15T01:38:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.221+0000 7f21f9552700 1 -- 172.21.15.1:0/3792080886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f40c3400 msgr2=0x7f21f40ab430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.221+0000 7f21f9552700 1 --2- 172.21.15.1:0/3792080886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f40c3400 0x7f21f40ab430 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f21f40c7400 tx=0x7f21e80090f0).stop 2023-11-15T01:38:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.221+0000 7f21f9552700 1 -- 172.21.15.1:0/3792080886 shutdown_connections 2023-11-15T01:38:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.221+0000 7f21f9552700 1 --2- 172.21.15.1:0/3792080886 >> v2:172.21.15.141:3300/0 conn(0x7f21f40629e0 0x7f21f40c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.221+0000 7f21f9552700 1 --2- 172.21.15.1:0/3792080886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f40c3400 0x7f21f40ab430 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.221+0000 7f21f9552700 1 -- 172.21.15.1:0/3792080886 >> 172.21.15.1:0/3792080886 conn(0x7f21f40c74f0 msgr2=0x7f21f40c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.221+0000 7f21f9552700 1 -- 172.21.15.1:0/3792080886 shutdown_connections 2023-11-15T01:38:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.221+0000 7f21f9552700 1 -- 172.21.15.1:0/3792080886 wait complete. 2023-11-15T01:38:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.222+0000 7f21f9552700 1 Processor -- start 2023-11-15T01:38:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.222+0000 7f21f9552700 1 -- start start 2023-11-15T01:38:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.223+0000 7f21f9552700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f40629e0 0x7f21f40c0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.223+0000 7f21f9552700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f21f40ab920 0x7f21f40bba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.223+0000 7f21f9552700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21f40c3400 0x7f21f41498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.223+0000 7f21f9552700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f4144da0 con 0x7f21f40629e0 2023-11-15T01:38:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.223+0000 7f21f9552700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40c1420 con 0x7f21f40ab920 2023-11-15T01:38:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.223+0000 7f21f9552700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40bbf70 con 0x7f21f40c3400 2023-11-15T01:38:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.223+0000 7f21f2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f40629e0 0x7f21f40c0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.223+0000 7f21f2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f40629e0 0x7f21f40c0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49670/0 (socket says 172.21.15.1:49670) 2023-11-15T01:38:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.223+0000 7f21f2ffd700 1 -- 172.21.15.1:0/2899185885 learned_addr learned my addr 172.21.15.1:0/2899185885 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:45.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.223+0000 7f21f27fc700 1 --2- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f21f40ab920 0x7f21f40bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.223+0000 7f21f37fe700 1 --2- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21f40c3400 0x7f21f41498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.223+0000 7f21f2ffd700 1 -- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21f40c3400 msgr2=0x7f21f41498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:45.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.223+0000 7f21f2ffd700 1 --2- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21f40c3400 0x7f21f41498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.223+0000 7f21f2ffd700 1 -- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f21f40ab920 msgr2=0x7f21f40bba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:45.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.223+0000 7f21f2ffd700 1 --2- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f21f40ab920 0x7f21f40bba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.224+0000 7f21f2ffd700 1 -- 172.21.15.1:0/2899185885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e8009370 con 0x7f21f40629e0 2023-11-15T01:38:45.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.224+0000 7f21f2ffd700 1 --2- 172.21.15.1:0/2899185885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f40629e0 0x7f21f40c0f30 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f21e400e900 tx=0x7f21e4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:45.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.224+0000 7f21daffd700 1 -- 172.21.15.1:0/2899185885 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4009390 con 0x7f21f40629e0 2023-11-15T01:38:45.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.224+0000 7f21daffd700 1 -- 172.21.15.1:0/2899185885 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e4012600 con 0x7f21f40629e0 2023-11-15T01:38:45.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.224+0000 7f21f9552700 1 -- 172.21.15.1:0/2899185885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f40bc210 con 0x7f21f40629e0 2023-11-15T01:38:45.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.224+0000 7f21daffd700 1 -- 172.21.15.1:0/2899185885 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4012980 con 0x7f21f40629e0 2023-11-15T01:38:45.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.224+0000 7f21f9552700 1 -- 172.21.15.1:0/2899185885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f40bc790 con 0x7f21f40629e0 2023-11-15T01:38:45.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.225+0000 7f21f9552700 1 -- 172.21.15.1:0/2899185885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f4145080 con 0x7f21f40629e0 2023-11-15T01:38:45.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.225+0000 7f21daffd700 1 -- 172.21.15.1:0/2899185885 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f21e4012d30 con 0x7f21f40629e0 2023-11-15T01:38:45.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.226+0000 7f21daffd700 1 --2- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f21e005f390 0x7f21e0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.226+0000 7f21daffd700 1 -- 172.21.15.1:0/2899185885 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f21e407ac00 con 0x7f21f40629e0 2023-11-15T01:38:45.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.226+0000 7f21f27fc700 1 -- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f21e005f390 msgr2=0x7f21e0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:45.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.226+0000 7f21f27fc700 1 --2- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f21e005f390 0x7f21e0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:38:45.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.230+0000 7f21daffd700 1 -- 172.21.15.1:0/2899185885 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f21e404b870 con 0x7f21f40629e0 2023-11-15T01:38:45.378 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:45.378+0000 7fc205ca3680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:38:45.407 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:45.406+0000 7faf42cea680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:38:45.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.427+0000 7f21f27fc700 1 -- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f21e005f390 msgr2=0x7f21e0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:45.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.427+0000 7f21f27fc700 1 --2- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f21e005f390 0x7f21e0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:38:45.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.449+0000 7f21f9552700 1 -- 172.21.15.1:0/2899185885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21f406c7e0 con 0x7f21f40629e0 2023-11-15T01:38:45.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.450+0000 7f21daffd700 1 -- 172.21.15.1:0/2899185885 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f21e404ee90 con 0x7f21f40629e0 2023-11-15T01:38:45.451 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:38:45.452 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6035,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2141857111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2141857111},{"type":"v1","addr":"172.21.15.141:6836","nonce":2141857111}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7140,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3686794692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3686794692},{"type":"v1","addr":"172.21.15.1:6834","nonce":3686794692}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7143,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1233089645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1233089645},{"type":"v1","addr":"172.21.15.1:6835","nonce":1233089645}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:37:25.784087+0000","modified":"2023-11-15T01:37:28.796286+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7155},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7155":{"gid":7155,"name":"b","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/173614126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":173614126},{"type":"v1","addr":"172.21.15.141:6837","nonce":173614126}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-11-15T01:38:45.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.452+0000 7f21f9552700 1 -- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f21e005f390 msgr2=0x7f21e0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:38:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.452+0000 7f21f9552700 1 --2- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f21e005f390 0x7f21e0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.452+0000 7f21f9552700 1 -- 172.21.15.1:0/2899185885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f40629e0 msgr2=0x7f21f40c0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.452+0000 7f21f9552700 1 --2- 172.21.15.1:0/2899185885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f40629e0 0x7f21f40c0f30 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f21e400e900 tx=0x7f21e4009060).stop 2023-11-15T01:38:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.452+0000 7f21f9552700 1 -- 172.21.15.1:0/2899185885 shutdown_connections 2023-11-15T01:38:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.452+0000 7f21f9552700 1 --2- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f21e005f390 0x7f21e0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.452+0000 7f21f9552700 1 --2- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21f40c3400 0x7f21f41498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.452+0000 7f21f9552700 1 --2- 172.21.15.1:0/2899185885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f40629e0 0x7f21f40c0f30 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.452+0000 7f21f9552700 1 --2- 172.21.15.1:0/2899185885 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f21f40ab920 0x7f21f40bba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.452+0000 7f21f9552700 1 -- 172.21.15.1:0/2899185885 >> 172.21.15.1:0/2899185885 conn(0x7f21f40c74f0 msgr2=0x7f21f414a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.452+0000 7f21f9552700 1 -- 172.21.15.1:0/2899185885 shutdown_connections 2023-11-15T01:38:45.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.452+0000 7f21f9552700 1 -- 172.21.15.1:0/2899185885 wait complete. 2023-11-15T01:38:45.456 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 47 2023-11-15T01:38:45.466 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:38:45.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.624+0000 7fd75e363700 1 Processor -- start 2023-11-15T01:38:45.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.624+0000 7fd75e363700 1 -- start start 2023-11-15T01:38:45.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd75e363700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd758154150 0x7fd758154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd75e363700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd7580aa060 0x7fd7580c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd75e363700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7580c06f0 con 0x7fd7580ab1a0 2023-11-15T01:38:45.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd75e363700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7580c09d0 con 0x7fd7580aa060 2023-11-15T01:38:45.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd75e363700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd758158820 con 0x7fd758154150 2023-11-15T01:38:45.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd75c900700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd7580aa060 0x7fd7580c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd7577fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd7580ab1a0 0x7fd758158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55020/0 (socket says 172.21.15.1:55020) 2023-11-15T01:38:45.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd7577fe700 1 -- 172.21.15.1:0/3838474879 learned_addr learned my addr 172.21.15.1:0/3838474879 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:45.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd75c900700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd7580aa060 0x7fd7580c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49680/0 (socket says 172.21.15.1:49680) 2023-11-15T01:38:45.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd757fff700 1 --2- 172.21.15.1:0/3838474879 >> v2:172.21.15.141:3300/0 conn(0x7fd758154150 0x7fd758154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd75c900700 1 -- 172.21.15.1:0/3838474879 >> v2:172.21.15.141:3300/0 conn(0x7fd758154150 msgr2=0x7fd758154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:45.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd75c900700 1 --2- 172.21.15.1:0/3838474879 >> v2:172.21.15.141:3300/0 conn(0x7fd758154150 0x7fd758154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd75c900700 1 -- 172.21.15.1:0/3838474879 >> v1:172.21.15.1:6789/0 conn(0x7fd7580ab1a0 legacy=0x7fd758158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:45.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd756ffd700 1 -- 172.21.15.1:0/3838474879 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822636570 0 0) 0x7fd7580c06f0 con 0x7fd7580ab1a0 2023-11-15T01:38:45.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd75c900700 1 -- 172.21.15.1:0/3838474879 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd758158b00 con 0x7fd7580aa060 2023-11-15T01:38:45.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.625+0000 7fd75c900700 1 --2- 172.21.15.1:0/3838474879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580aa060 0x7fd7580c5f10 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fd75806bfb0 tx=0x7fd750009780).ready entity=mon.0 client_cookie=6ea77e42b2084078 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:45.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.626+0000 7fd756ffd700 1 -- 172.21.15.1:0/3838474879 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75000e070 con 0x7fd7580aa060 2023-11-15T01:38:45.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.626+0000 7fd756ffd700 1 -- 172.21.15.1:0/3838474879 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75000bb60 con 0x7fd7580aa060 2023-11-15T01:38:45.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.626+0000 7fd756ffd700 1 -- 172.21.15.1:0/3838474879 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750012410 con 0x7fd7580aa060 2023-11-15T01:38:45.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.626+0000 7fd75e363700 1 -- 172.21.15.1:0/3838474879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580aa060 msgr2=0x7fd7580c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:45.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.626+0000 7fd75e363700 1 --2- 172.21.15.1:0/3838474879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580aa060 0x7fd7580c5f10 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fd75806bfb0 tx=0x7fd750009780).stop 2023-11-15T01:38:45.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.626+0000 7fd75e363700 1 -- 172.21.15.1:0/3838474879 shutdown_connections 2023-11-15T01:38:45.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.626+0000 7fd75e363700 1 --2- 172.21.15.1:0/3838474879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580aa060 0x7fd7580c5f10 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.626+0000 7fd75e363700 1 --2- 172.21.15.1:0/3838474879 >> v2:172.21.15.141:3300/0 conn(0x7fd758154150 0x7fd758154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.626+0000 7fd75e363700 1 -- 172.21.15.1:0/3838474879 >> 172.21.15.1:0/3838474879 conn(0x7fd758064aa0 msgr2=0x7fd758064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:45.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.626+0000 7fd75e363700 1 -- 172.21.15.1:0/3838474879 shutdown_connections 2023-11-15T01:38:45.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.626+0000 7fd75e363700 1 -- 172.21.15.1:0/3838474879 wait complete. 2023-11-15T01:38:45.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.627+0000 7fd75e363700 1 Processor -- start 2023-11-15T01:38:45.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.628+0000 7fd75e363700 1 -- start start 2023-11-15T01:38:45.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.628+0000 7fd75e363700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7580aa060 0x7fd7580ac520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.628+0000 7fd75e363700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580ab1a0 0x7fd758147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.628+0000 7fd75e363700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd758154150 0x7fd7580ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.628+0000 7fd75e363700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7580acf50 con 0x7fd7580ab1a0 2023-11-15T01:38:45.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.628+0000 7fd75e363700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd758156160 con 0x7fd7580aa060 2023-11-15T01:38:45.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.628+0000 7fd75e363700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7580aca10 con 0x7fd758154150 2023-11-15T01:38:45.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.628+0000 7fd7577fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580ab1a0 0x7fd758147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.628+0000 7fd7577fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580ab1a0 0x7fd758147bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49688/0 (socket says 172.21.15.1:49688) 2023-11-15T01:38:45.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.628+0000 7fd7577fe700 1 -- 172.21.15.1:0/848468484 learned_addr learned my addr 172.21.15.1:0/848468484 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:45.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.628+0000 7fd757fff700 1 --2- 172.21.15.1:0/848468484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7580aa060 0x7fd7580ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.628+0000 7fd75c900700 1 --2- 172.21.15.1:0/848468484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd758154150 0x7fd7580ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.629+0000 7fd7577fe700 1 -- 172.21.15.1:0/848468484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd758154150 msgr2=0x7fd7580ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:45.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.629+0000 7fd7577fe700 1 --2- 172.21.15.1:0/848468484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd758154150 0x7fd7580ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.629+0000 7fd7577fe700 1 -- 172.21.15.1:0/848468484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7580aa060 msgr2=0x7fd7580ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:45.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.629+0000 7fd7577fe700 1 --2- 172.21.15.1:0/848468484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7580aa060 0x7fd7580ac520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.629+0000 7fd7577fe700 1 -- 172.21.15.1:0/848468484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd750009a20 con 0x7fd7580ab1a0 2023-11-15T01:38:45.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.629+0000 7fd757fff700 1 --2- 172.21.15.1:0/848468484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7580aa060 0x7fd7580ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:38:45.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.629+0000 7fd7577fe700 1 --2- 172.21.15.1:0/848468484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580ab1a0 0x7fd758147bb0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fd74c00c510 tx=0x7fd74c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:45.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.629+0000 7fd73ffff700 1 -- 172.21.15.1:0/848468484 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c00ce80 con 0x7fd7580ab1a0 2023-11-15T01:38:45.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.629+0000 7fd73ffff700 1 -- 172.21.15.1:0/848468484 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74c0072e0 con 0x7fd7580ab1a0 2023-11-15T01:38:45.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.629+0000 7fd75e363700 1 -- 172.21.15.1:0/848468484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7580acc70 con 0x7fd7580ab1a0 2023-11-15T01:38:45.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.629+0000 7fd73ffff700 1 -- 172.21.15.1:0/848468484 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c007660 con 0x7fd7580ab1a0 2023-11-15T01:38:45.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.629+0000 7fd75e363700 1 -- 172.21.15.1:0/848468484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd758155df0 con 0x7fd7580ab1a0 2023-11-15T01:38:45.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.630+0000 7fd75e363700 1 -- 172.21.15.1:0/848468484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd758157f20 con 0x7fd7580ab1a0 2023-11-15T01:38:45.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.631+0000 7fd73ffff700 1 -- 172.21.15.1:0/848468484 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fd74c0059b0 con 0x7fd7580ab1a0 2023-11-15T01:38:45.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.631+0000 7fd73ffff700 1 --2- 172.21.15.1:0/848468484 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd74405f390 0x7fd744061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.631+0000 7fd73ffff700 1 -- 172.21.15.1:0/848468484 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6977+0+0 (secure 0 0 0) 0x7fd74c07a0d0 con 0x7fd7580ab1a0 2023-11-15T01:38:45.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.631+0000 7fd757fff700 1 -- 172.21.15.1:0/848468484 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd74405f390 msgr2=0x7fd744061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:45.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.631+0000 7fd757fff700 1 --2- 172.21.15.1:0/848468484 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd74405f390 0x7fd744061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:38:45.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.635+0000 7fd73ffff700 1 -- 172.21.15.1:0/848468484 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd74c04ad40 con 0x7fd7580ab1a0 2023-11-15T01:38:45.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.813+0000 7fd75e363700 1 -- 172.21.15.1:0/848468484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7581562f0 con 0x7fd7580ab1a0 2023-11-15T01:38:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.814+0000 7fd73ffff700 1 -- 172.21.15.1:0/848468484 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+18200 (secure 0 0 0) 0x7fd74c04e360 con 0x7fd7580ab1a0 2023-11-15T01:38:45.816 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:38:45.817 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":112,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:38:43.877852+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:37:23.432127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-15T01:37:24.767163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1","mappings":[{"from":6,"to":3}]},{"pgid":"13.32","mappings":[{"from":1,"to":5}]},{"pgid":"14.2","mappings":[{"from":1,"to":2}]},{"pgid":"14.1e","mappings":[{"from":1,"to":5}]},{"pgid":"14.31","mappings":[{"from":1,"to":7}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/3033408699":"2023-11-16T01:37:42.056268+0000","172.21.15.141:6833/90546":"2023-11-16T01:37:42.056268+0000","172.21.15.141:0/1196460966":"2023-11-16T01:37:42.056268+0000","172.21.15.141:6832/90546":"2023-11-16T01:37:42.056268+0000","172.21.15.141:0/1263900820":"2023-11-16T01:37:42.056268+0000","172.21.15.141:0/2534309710":"2023-11-16T01:37:42.056268+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:38:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.816+0000 7fd75e363700 1 -- 172.21.15.1:0/848468484 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd74405f390 msgr2=0x7fd744061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:38:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.816+0000 7fd75e363700 1 --2- 172.21.15.1:0/848468484 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd74405f390 0x7fd744061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.816+0000 7fd75e363700 1 -- 172.21.15.1:0/848468484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580ab1a0 msgr2=0x7fd758147bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.816+0000 7fd75e363700 1 --2- 172.21.15.1:0/848468484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580ab1a0 0x7fd758147bb0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fd74c00c510 tx=0x7fd74c007c70).stop 2023-11-15T01:38:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.817+0000 7fd75e363700 1 -- 172.21.15.1:0/848468484 shutdown_connections 2023-11-15T01:38:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.817+0000 7fd75e363700 1 --2- 172.21.15.1:0/848468484 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd74405f390 0x7fd744061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.817+0000 7fd75e363700 1 --2- 172.21.15.1:0/848468484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd758154150 0x7fd7580ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.817+0000 7fd75e363700 1 --2- 172.21.15.1:0/848468484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7580aa060 0x7fd7580ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.817+0000 7fd75e363700 1 --2- 172.21.15.1:0/848468484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580ab1a0 0x7fd758147bb0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.817+0000 7fd75e363700 1 -- 172.21.15.1:0/848468484 >> 172.21.15.1:0/848468484 conn(0x7fd758064aa0 msgr2=0x7fd758063fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:45.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.817+0000 7fd75e363700 1 -- 172.21.15.1:0/848468484 shutdown_connections 2023-11-15T01:38:45.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.817+0000 7fd75e363700 1 -- 172.21.15.1:0/848468484 wait complete. 2023-11-15T01:38:45.831 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T01:37:23.432127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T01:37:24.767163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T01:38:45.832 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:38:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.955+0000 7f5162d28700 1 Processor -- start 2023-11-15T01:38:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.955+0000 7f5162d28700 1 -- start start 2023-11-15T01:38:45.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f5162d28700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f515c14e6e0 0x7f515c14eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f5162d28700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f515c155370 0x7f515c0627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f5162d28700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515c158e40 con 0x7f515c062ca0 2023-11-15T01:38:45.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f5162d28700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515c063130 con 0x7f515c155370 2023-11-15T01:38:45.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f5162d28700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c158230 con 0x7f515c14e6e0 2023-11-15T01:38:45.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f51612c5700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f515c062ca0 0x7f515c069610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55028/0 (socket says 172.21.15.1:55028) 2023-11-15T01:38:45.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f51612c5700 1 -- 172.21.15.1:0/2778585404 learned_addr learned my addr 172.21.15.1:0/2778585404 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:45.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515bfff700 1 --2- 172.21.15.1:0/2778585404 >> v2:172.21.15.141:3300/0 conn(0x7f515c155370 0x7f515c0627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f5160ac4700 1 --2- 172.21.15.1:0/2778585404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f515c14e6e0 0x7f515c14eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 -- 172.21.15.1:0/2778585404 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73728582 0 0) 0x7f515c158e40 con 0x7f515c062ca0 2023-11-15T01:38:45.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 -- 172.21.15.1:0/2778585404 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f514c0033f0 con 0x7f515c062ca0 2023-11-15T01:38:45.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 -- 172.21.15.1:0/2778585404 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2913258294 0 0) 0x7f514c0033f0 con 0x7f515c062ca0 2023-11-15T01:38:45.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 -- 172.21.15.1:0/2778585404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f515c14e6e0 msgr2=0x7f515c14eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:45.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 --2- 172.21.15.1:0/2778585404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f515c14e6e0 0x7f515c14eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 -- 172.21.15.1:0/2778585404 >> v2:172.21.15.141:3300/0 conn(0x7f515c155370 msgr2=0x7f515c0627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 --2- 172.21.15.1:0/2778585404 >> v2:172.21.15.141:3300/0 conn(0x7f515c155370 0x7f515c0627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 -- 172.21.15.1:0/2778585404 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c158510 con 0x7f515c062ca0 2023-11-15T01:38:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 -- 172.21.15.1:0/2778585404 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f51540017f0 con 0x7f515c062ca0 2023-11-15T01:38:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 -- 172.21.15.1:0/2778585404 >> v1:172.21.15.1:6789/0 conn(0x7f515c062ca0 legacy=0x7f515c069610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 --2- 172.21.15.1:0/2778585404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f515c14e6e0 0x7f514c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 --2- 172.21.15.1:0/2778585404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f514c003e10 0x7f514c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 --2- 172.21.15.1:0/2778585404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f514c004b80 0x7f514c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 -- 172.21.15.1:0/2778585404 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c063130 con 0x7f514c003e10 2023-11-15T01:38:45.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 -- 172.21.15.1:0/2778585404 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c158230 con 0x7f514c004b80 2023-11-15T01:38:45.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.956+0000 7f515b7fe700 1 -- 172.21.15.1:0/2778585404 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c00b8e0 con 0x7f515c14e6e0 2023-11-15T01:38:45.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.957+0000 7f515bfff700 1 --2- 172.21.15.1:0/2778585404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f514c003e10 0x7f514c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.957+0000 7f5160ac4700 1 --2- 172.21.15.1:0/2778585404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f515c14e6e0 0x7f514c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.957+0000 7f51612c5700 1 --2- 172.21.15.1:0/2778585404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f514c004b80 0x7f514c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.957+0000 7f515bfff700 1 -- 172.21.15.1:0/2778585404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f515c14e6e0 msgr2=0x7f514c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:45.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.957+0000 7f515bfff700 1 --2- 172.21.15.1:0/2778585404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f515c14e6e0 0x7f514c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.957+0000 7f515bfff700 1 -- 172.21.15.1:0/2778585404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f514c004b80 msgr2=0x7f514c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:45.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.957+0000 7f515bfff700 1 --2- 172.21.15.1:0/2778585404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f514c004b80 0x7f514c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.957+0000 7f515bfff700 1 -- 172.21.15.1:0/2778585404 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c0033f0 con 0x7f514c003e10 2023-11-15T01:38:45.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.957+0000 7f515bfff700 1 --2- 172.21.15.1:0/2778585404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f514c003e10 0x7f514c004690 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f5148009a80 tx=0x7f5148009060).ready entity=mon.0 client_cookie=21beb866597e2565 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:45.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.957+0000 7f515b7fe700 1 -- 172.21.15.1:0/2778585404 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148009430 con 0x7f514c003e10 2023-11-15T01:38:45.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.957+0000 7f515b7fe700 1 -- 172.21.15.1:0/2778585404 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514800e640 con 0x7f514c003e10 2023-11-15T01:38:45.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.957+0000 7f515b7fe700 1 -- 172.21.15.1:0/2778585404 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800e9c0 con 0x7f514c003e10 2023-11-15T01:38:45.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.958+0000 7f5162d28700 1 -- 172.21.15.1:0/2778585404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f514c003e10 msgr2=0x7f514c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:45.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.958+0000 7f5162d28700 1 --2- 172.21.15.1:0/2778585404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f514c003e10 0x7f514c004690 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f5148009a80 tx=0x7f5148009060).stop 2023-11-15T01:38:45.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.958+0000 7f51612c5700 1 -- 172.21.15.1:0/2778585404 reap_dead start 2023-11-15T01:38:45.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.958+0000 7f5162d28700 1 -- 172.21.15.1:0/2778585404 shutdown_connections 2023-11-15T01:38:45.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.958+0000 7f5162d28700 1 -- 172.21.15.1:0/2778585404 >> 172.21.15.1:0/2778585404 conn(0x7f515c0c7dc0 msgr2=0x7f515c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:45.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.958+0000 7f5162d28700 1 -- 172.21.15.1:0/2778585404 shutdown_connections 2023-11-15T01:38:45.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.958+0000 7f5162d28700 1 -- 172.21.15.1:0/2778585404 wait complete. 2023-11-15T01:38:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.959+0000 7f5162d28700 1 Processor -- start 2023-11-15T01:38:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.959+0000 7f5162d28700 1 -- start start 2023-11-15T01:38:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.960+0000 7f5162d28700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f514c003e10 0x7f515c139970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.960+0000 7f5162d28700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f515c0abc50 0x7f515c0ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.960+0000 7f5162d28700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f515c0a4e30 0x7f515c0a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.960+0000 7f5162d28700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c0ab090 con 0x7f515c0a4e30 2023-11-15T01:38:45.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.960+0000 7f5162d28700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c139e60 con 0x7f514c003e10 2023-11-15T01:38:45.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.960+0000 7f5162d28700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c0a49a0 con 0x7f515c0abc50 2023-11-15T01:38:45.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.960+0000 7f51612c5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f515c0a4e30 0x7f515c0a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.960+0000 7f51612c5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f515c0a4e30 0x7f515c0a52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49698/0 (socket says 172.21.15.1:49698) 2023-11-15T01:38:45.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.960+0000 7f51612c5700 1 -- 172.21.15.1:0/362968975 learned_addr learned my addr 172.21.15.1:0/362968975 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:45.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.960+0000 7f5160ac4700 1 --2- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f514c003e10 0x7f515c139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.960+0000 7f515bfff700 1 --2- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f515c0abc50 0x7f515c0ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:45.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.961+0000 7f51612c5700 1 -- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f515c0abc50 msgr2=0x7f515c0ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:45.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.961+0000 7f51612c5700 1 --2- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f515c0abc50 0x7f515c0ac0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.961+0000 7f51612c5700 1 -- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f514c003e10 msgr2=0x7f515c139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:45.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.961+0000 7f51612c5700 1 --2- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f514c003e10 0x7f515c139970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:45.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.961+0000 7f51612c5700 1 -- 172.21.15.1:0/362968975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c0ac5c0 con 0x7f515c0a4e30 2023-11-15T01:38:45.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.961+0000 7f51612c5700 1 --2- 172.21.15.1:0/362968975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f515c0a4e30 0x7f515c0a52b0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f515c0c5d20 tx=0x7f5154001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:45.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.961+0000 7f5158ff9700 1 -- 172.21.15.1:0/362968975 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51540079e0 con 0x7f515c0a4e30 2023-11-15T01:38:45.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.961+0000 7f5158ff9700 1 -- 172.21.15.1:0/362968975 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515400fbd0 con 0x7f515c0a4e30 2023-11-15T01:38:45.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.961+0000 7f5162d28700 1 -- 172.21.15.1:0/362968975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515c0ac870 con 0x7f515c0a4e30 2023-11-15T01:38:45.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.961+0000 7f5158ff9700 1 -- 172.21.15.1:0/362968975 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154015410 con 0x7f515c0a4e30 2023-11-15T01:38:45.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.961+0000 7f5162d28700 1 -- 172.21.15.1:0/362968975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515c0ace30 con 0x7f515c0a4e30 2023-11-15T01:38:45.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.962+0000 7f5162d28700 1 -- 172.21.15.1:0/362968975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515c13df90 con 0x7f515c0a4e30 2023-11-15T01:38:45.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.963+0000 7f5158ff9700 1 -- 172.21.15.1:0/362968975 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f5154015780 con 0x7f515c0a4e30 2023-11-15T01:38:45.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.963+0000 7f5158ff9700 1 --2- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f514005f390 0x7f5140061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:45.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.963+0000 7f5158ff9700 1 -- 172.21.15.1:0/362968975 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f515407a3f0 con 0x7f515c0a4e30 2023-11-15T01:38:45.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.963+0000 7f5160ac4700 1 -- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f514005f390 msgr2=0x7f5140061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:45.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.963+0000 7f5160ac4700 1 --2- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f514005f390 0x7f5140061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:38:45.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:45.967+0000 7f5158ff9700 1 -- 172.21.15.1:0/362968975 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f515404b000 con 0x7f515c0a4e30 2023-11-15T01:38:45.994 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:45.994+0000 7fc205ca3680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:38:46.066 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:46.065+0000 7fc205ca3680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:38:46.086 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:46.084+0000 7faf42cea680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:38:46.157 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:46.155+0000 7faf42cea680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:38:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.164+0000 7f5160ac4700 1 -- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f514005f390 msgr2=0x7f5140061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.164+0000 7f5160ac4700 1 --2- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f514005f390 0x7f5140061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:38:46.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.187+0000 7f5162d28700 1 -- 172.21.15.1:0/362968975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f515c0a4b30 con 0x7f515c0a4e30 2023-11-15T01:38:46.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.187+0000 7f5158ff9700 1 -- 172.21.15.1:0/362968975 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v112) v1 ==== 110+0+10 (secure 0 0 0) 0x7f515401d020 con 0x7f515c0a4e30 2023-11-15T01:38:46.189 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:38:46.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.189+0000 7f5162d28700 1 -- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f514005f390 msgr2=0x7f5140061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:38:46.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.189+0000 7f5162d28700 1 --2- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f514005f390 0x7f5140061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:46.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.189+0000 7f5162d28700 1 -- 172.21.15.1:0/362968975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f515c0a4e30 msgr2=0x7f515c0a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.189+0000 7f5162d28700 1 --2- 172.21.15.1:0/362968975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f515c0a4e30 0x7f515c0a52b0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f515c0c5d20 tx=0x7f5154001d90).stop 2023-11-15T01:38:46.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.189+0000 7f5162d28700 1 -- 172.21.15.1:0/362968975 shutdown_connections 2023-11-15T01:38:46.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.189+0000 7f5162d28700 1 --2- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f514005f390 0x7f5140061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:46.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.189+0000 7f5162d28700 1 --2- 172.21.15.1:0/362968975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f515c0a4e30 0x7f515c0a52b0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.189+0000 7f5162d28700 1 --2- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f514c003e10 0x7f515c139970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.189+0000 7f5162d28700 1 --2- 172.21.15.1:0/362968975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f515c0abc50 0x7f515c0ac0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.189+0000 7f5162d28700 1 -- 172.21.15.1:0/362968975 >> 172.21.15.1:0/362968975 conn(0x7f515c0c7dc0 msgr2=0x7f515c0c4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:46.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.190+0000 7f5162d28700 1 -- 172.21.15.1:0/362968975 shutdown_connections 2023-11-15T01:38:46.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.190+0000 7f5162d28700 1 -- 172.21.15.1:0/362968975 wait complete. 2023-11-15T01:38:46.204 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:38:46.252 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:46.251+0000 7fc205ca3680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:38:46.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.326+0000 7f0ef3d21700 1 Processor -- start 2023-11-15T01:38:46.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.326+0000 7f0ef3d21700 1 -- start start 2023-11-15T01:38:46.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.327+0000 7f0ef3d21700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0eec14e960 0x7f0eec0bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.327+0000 7f0ef3d21700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0eec063020 0x7f0eec0c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.327+0000 7f0ef3d21700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec0634b0 con 0x7f0eec0bc9d0 2023-11-15T01:38:46.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.327+0000 7f0ef3d21700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec0c5480 con 0x7f0eec14e960 2023-11-15T01:38:46.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.327+0000 7f0ef3d21700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0bce50 con 0x7f0eec063020 2023-11-15T01:38:46.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.327+0000 7f0ef1abd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0eec14e960 0x7f0eec0bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:46.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.327+0000 7f0ef1abd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0eec14e960 0x7f0eec0bc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49700/0 (socket says 172.21.15.1:49700) 2023-11-15T01:38:46.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.327+0000 7f0ef1abd700 1 -- 172.21.15.1:0/2777666501 learned_addr learned my addr 172.21.15.1:0/2777666501 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:46.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.327+0000 7f0ef22be700 1 --2- 172.21.15.1:0/2777666501 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0eec063020 0x7f0eec0c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:46.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.328+0000 7f0ef1abd700 1 -- 172.21.15.1:0/2777666501 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0eec063020 msgr2=0x7f0eec0c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:46.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.328+0000 7f0ef1abd700 1 --2- 172.21.15.1:0/2777666501 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0eec063020 0x7f0eec0c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.328+0000 7f0ef0abb700 1 -- 172.21.15.1:0/2777666501 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121283426 0 0) 0x7f0eec0634b0 con 0x7f0eec0bc9d0 2023-11-15T01:38:46.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.328+0000 7f0ef1abd700 1 -- 172.21.15.1:0/2777666501 >> v1:172.21.15.141:6789/0 conn(0x7f0eec0bc9d0 legacy=0x7f0eec062910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.328+0000 7f0ef1abd700 1 -- 172.21.15.1:0/2777666501 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec0636e0 con 0x7f0eec14e960 2023-11-15T01:38:46.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.328+0000 7f0ef1abd700 1 --2- 172.21.15.1:0/2777666501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0eec14e960 0x7f0eec0bc4e0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7f0ee0006fd0 tx=0x7f0ee00090f0).ready entity=mon.0 client_cookie=3f4be5f6229e60fb server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:46.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.328+0000 7f0ef0abb700 1 -- 172.21.15.1:0/2777666501 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000b580 con 0x7f0eec14e960 2023-11-15T01:38:46.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.328+0000 7f0ef0abb700 1 -- 172.21.15.1:0/2777666501 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee000b6e0 con 0x7f0eec14e960 2023-11-15T01:38:46.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.328+0000 7f0ef0abb700 1 -- 172.21.15.1:0/2777666501 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000ba60 con 0x7f0eec14e960 2023-11-15T01:38:46.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.329+0000 7f0ef3d21700 1 -- 172.21.15.1:0/2777666501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0eec14e960 msgr2=0x7f0eec0bc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.329+0000 7f0ef3d21700 1 --2- 172.21.15.1:0/2777666501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0eec14e960 0x7f0eec0bc4e0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7f0ee0006fd0 tx=0x7f0ee00090f0).stop 2023-11-15T01:38:46.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.329+0000 7f0ef3d21700 1 -- 172.21.15.1:0/2777666501 shutdown_connections 2023-11-15T01:38:46.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.329+0000 7f0ef3d21700 1 --2- 172.21.15.1:0/2777666501 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0eec063020 0x7f0eec0c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.329+0000 7f0ef3d21700 1 --2- 172.21.15.1:0/2777666501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0eec14e960 0x7f0eec0bc4e0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.329+0000 7f0ef3d21700 1 -- 172.21.15.1:0/2777666501 >> 172.21.15.1:0/2777666501 conn(0x7f0eec0c8050 msgr2=0x7f0eec0c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:46.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.329+0000 7f0ef3d21700 1 -- 172.21.15.1:0/2777666501 shutdown_connections 2023-11-15T01:38:46.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.329+0000 7f0ef3d21700 1 -- 172.21.15.1:0/2777666501 wait complete. 2023-11-15T01:38:46.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.330+0000 7f0ef3d21700 1 Processor -- start 2023-11-15T01:38:46.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.330+0000 7f0ef3d21700 1 -- start start 2023-11-15T01:38:46.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef3d21700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0eec063020 0x7f0eec0a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef3d21700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0eec0bc9d0 0x7f0eec136bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef3d21700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0eec14e960 0x7f0eec1370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef3d21700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec1375b0 con 0x7f0eec0bc9d0 2023-11-15T01:38:46.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef3d21700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec164b90 con 0x7f0eec14e960 2023-11-15T01:38:46.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef3d21700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec164e30 con 0x7f0eec063020 2023-11-15T01:38:46.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef12bc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0eec0bc9d0 0x7f0eec136bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:46.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef22be700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0eec14e960 0x7f0eec1370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:46.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef12bc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0eec0bc9d0 0x7f0eec136bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49714/0 (socket says 172.21.15.1:49714) 2023-11-15T01:38:46.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef22be700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0eec14e960 0x7f0eec1370c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:45526/0 (socket says 172.21.15.1:45526) 2023-11-15T01:38:46.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef1abd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0eec063020 0x7f0eec0a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:46.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef22be700 1 -- 172.21.15.1:0/989400945 learned_addr learned my addr 172.21.15.1:0/989400945 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:46.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef22be700 1 -- 172.21.15.1:0/989400945 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0eec063020 msgr2=0x7f0eec0a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef22be700 1 --2- 172.21.15.1:0/989400945 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0eec063020 0x7f0eec0a92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef22be700 1 -- 172.21.15.1:0/989400945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0eec0bc9d0 msgr2=0x7f0eec136bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef22be700 1 --2- 172.21.15.1:0/989400945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0eec0bc9d0 0x7f0eec136bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef22be700 1 -- 172.21.15.1:0/989400945 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee0009370 con 0x7f0eec14e960 2023-11-15T01:38:46.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef12bc700 1 --2- 172.21.15.1:0/989400945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0eec0bc9d0 0x7f0eec136bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:38:46.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.331+0000 7f0ef22be700 1 --2- 172.21.15.1:0/989400945 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0eec14e960 0x7f0eec1370c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f0ee4009df0 tx=0x7f0ee400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:46.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.332+0000 7f0eddffb700 1 -- 172.21.15.1:0/989400945 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee400caa0 con 0x7f0eec14e960 2023-11-15T01:38:46.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.332+0000 7f0eddffb700 1 -- 172.21.15.1:0/989400945 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee400f040 con 0x7f0eec14e960 2023-11-15T01:38:46.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.332+0000 7f0eddffb700 1 -- 172.21.15.1:0/989400945 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee400ce10 con 0x7f0eec14e960 2023-11-15T01:38:46.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.332+0000 7f0ef3d21700 1 -- 172.21.15.1:0/989400945 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec165110 con 0x7f0eec14e960 2023-11-15T01:38:46.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.332+0000 7f0ef3d21700 1 -- 172.21.15.1:0/989400945 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec1656d0 con 0x7f0eec14e960 2023-11-15T01:38:46.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.333+0000 7f0ef3d21700 1 -- 172.21.15.1:0/989400945 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec1658c0 con 0x7f0eec14e960 2023-11-15T01:38:46.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.333+0000 7f0eddffb700 1 -- 172.21.15.1:0/989400945 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f0ee4013610 con 0x7f0eec14e960 2023-11-15T01:38:46.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.333+0000 7f0eddffb700 1 --2- 172.21.15.1:0/989400945 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ed005f390 0x7f0ed0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.333+0000 7f0ef1abd700 1 -- 172.21.15.1:0/989400945 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ed005f390 msgr2=0x7f0ed0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:46.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.333+0000 7f0eddffb700 1 -- 172.21.15.1:0/989400945 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f0ee407b130 con 0x7f0eec14e960 2023-11-15T01:38:46.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.333+0000 7f0ef1abd700 1 --2- 172.21.15.1:0/989400945 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ed005f390 0x7f0ed0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:38:46.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.338+0000 7f0eddffb700 1 -- 172.21.15.1:0/989400945 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0ee404bc90 con 0x7f0eec14e960 2023-11-15T01:38:46.357 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:46.355+0000 7faf42cea680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:38:46.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.510+0000 7f0ef3d21700 1 -- 172.21.15.1:0/989400945 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0eec06c7e0 con 0x7f0eec14e960 2023-11-15T01:38:46.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.511+0000 7f0eddffb700 1 -- 172.21.15.1:0/989400945 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v112) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0ee404f2b0 con 0x7f0eec14e960 2023-11-15T01:38:46.513 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:38:46.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.513+0000 7f0ef3d21700 1 -- 172.21.15.1:0/989400945 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ed005f390 msgr2=0x7f0ed0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:38:46.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.513+0000 7f0ef3d21700 1 --2- 172.21.15.1:0/989400945 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ed005f390 0x7f0ed0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:46.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.513+0000 7f0ef3d21700 1 -- 172.21.15.1:0/989400945 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0eec14e960 msgr2=0x7f0eec1370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.513+0000 7f0ef3d21700 1 --2- 172.21.15.1:0/989400945 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0eec14e960 0x7f0eec1370c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f0ee4009df0 tx=0x7f0ee400b040).stop 2023-11-15T01:38:46.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.513+0000 7f0ef3d21700 1 -- 172.21.15.1:0/989400945 shutdown_connections 2023-11-15T01:38:46.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.513+0000 7f0ef3d21700 1 --2- 172.21.15.1:0/989400945 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ed005f390 0x7f0ed0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:46.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.513+0000 7f0ef3d21700 1 --2- 172.21.15.1:0/989400945 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0eec14e960 0x7f0eec1370c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.513+0000 7f0ef3d21700 1 --2- 172.21.15.1:0/989400945 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0eec063020 0x7f0eec0a92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.513+0000 7f0ef3d21700 1 --2- 172.21.15.1:0/989400945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0eec0bc9d0 0x7f0eec136bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.513+0000 7f0ef3d21700 1 -- 172.21.15.1:0/989400945 >> 172.21.15.1:0/989400945 conn(0x7f0eec0c8050 msgr2=0x7f0eec13d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:46.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.513+0000 7f0ef3d21700 1 -- 172.21.15.1:0/989400945 shutdown_connections 2023-11-15T01:38:46.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.513+0000 7f0ef3d21700 1 -- 172.21.15.1:0/989400945 wait complete. 2023-11-15T01:38:46.527 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T01:38:46.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.651+0000 7f96ca9c8700 1 Processor -- start 2023-11-15T01:38:46.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.651+0000 7f96ca9c8700 1 -- start start 2023-11-15T01:38:46.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.652+0000 7f96ca9c8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96c40bcbf0 0x7f96c4062910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.652+0000 7f96ca9c8700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f96c4062e00 0x7f96c40c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.652+0000 7f96ca9c8700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c40c5480 con 0x7f96c414e960 2023-11-15T01:38:46.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.652+0000 7f96ca9c8700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c40636e0 con 0x7f96c4062e00 2023-11-15T01:38:46.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.652+0000 7f96ca9c8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40639c0 con 0x7f96c40bcbf0 2023-11-15T01:38:46.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.652+0000 7f96c3fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f96c414e960 0x7f96c40bc4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55034/0 (socket says 172.21.15.1:55034) 2023-11-15T01:38:46.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.652+0000 7f96c3fff700 1 -- 172.21.15.1:0/3225327489 learned_addr learned my addr 172.21.15.1:0/3225327489 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:46.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.652+0000 7f96c8f65700 1 --2- 172.21.15.1:0/3225327489 >> v2:172.21.15.141:3300/0 conn(0x7f96c4062e00 0x7f96c40c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:46.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.652+0000 7f96c37fe700 1 --2- 172.21.15.1:0/3225327489 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96c40bcbf0 0x7f96c4062910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:46.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.653+0000 7f96c2ffd700 1 -- 172.21.15.1:0/3225327489 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806647958 0 0) 0x7f96c40c5480 con 0x7f96c414e960 2023-11-15T01:38:46.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.653+0000 7f96c2ffd700 1 -- 172.21.15.1:0/3225327489 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96b00033f0 con 0x7f96c414e960 2023-11-15T01:38:46.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.653+0000 7f96c37fe700 1 -- 172.21.15.1:0/3225327489 >> v2:172.21.15.141:3300/0 conn(0x7f96c4062e00 msgr2=0x7f96c40c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:46.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.653+0000 7f96c37fe700 1 --2- 172.21.15.1:0/3225327489 >> v2:172.21.15.141:3300/0 conn(0x7f96c4062e00 0x7f96c40c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.653+0000 7f96c37fe700 1 -- 172.21.15.1:0/3225327489 >> v1:172.21.15.1:6789/0 conn(0x7f96c414e960 legacy=0x7f96c40bc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.653+0000 7f96c37fe700 1 -- 172.21.15.1:0/3225327489 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c4063ca0 con 0x7f96c40bcbf0 2023-11-15T01:38:46.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.653+0000 7f96c8f65700 1 --2- 172.21.15.1:0/3225327489 >> v2:172.21.15.141:3300/0 conn(0x7f96c4062e00 0x7f96c40c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:38:46.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.653+0000 7f96c37fe700 1 --2- 172.21.15.1:0/3225327489 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96c40bcbf0 0x7f96c4062910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f96b4009760 tx=0x7f96b4009060).ready entity=mon.2 client_cookie=dc45f13d76ada6b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:46.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.653+0000 7f96c2ffd700 1 -- 172.21.15.1:0/3225327489 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b400d4a0 con 0x7f96c40bcbf0 2023-11-15T01:38:46.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.653+0000 7f96c2ffd700 1 -- 172.21.15.1:0/3225327489 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b400d600 con 0x7f96c40bcbf0 2023-11-15T01:38:46.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.653+0000 7f96c2ffd700 1 -- 172.21.15.1:0/3225327489 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b400d980 con 0x7f96c40bcbf0 2023-11-15T01:38:46.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.654+0000 7f96ca9c8700 1 -- 172.21.15.1:0/3225327489 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96c40bcbf0 msgr2=0x7f96c4062910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.654+0000 7f96ca9c8700 1 --2- 172.21.15.1:0/3225327489 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96c40bcbf0 0x7f96c4062910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f96b4009760 tx=0x7f96b4009060).stop 2023-11-15T01:38:46.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.654+0000 7f96ca9c8700 1 -- 172.21.15.1:0/3225327489 shutdown_connections 2023-11-15T01:38:46.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.654+0000 7f96ca9c8700 1 --2- 172.21.15.1:0/3225327489 >> v2:172.21.15.141:3300/0 conn(0x7f96c4062e00 0x7f96c40c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.654+0000 7f96ca9c8700 1 --2- 172.21.15.1:0/3225327489 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96c40bcbf0 0x7f96c4062910 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.654+0000 7f96ca9c8700 1 -- 172.21.15.1:0/3225327489 >> 172.21.15.1:0/3225327489 conn(0x7f96c40c8050 msgr2=0x7f96c40c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:46.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.654+0000 7f96ca9c8700 1 -- 172.21.15.1:0/3225327489 shutdown_connections 2023-11-15T01:38:46.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.654+0000 7f96ca9c8700 1 -- 172.21.15.1:0/3225327489 wait complete. 2023-11-15T01:38:46.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.655+0000 7f96ca9c8700 1 Processor -- start 2023-11-15T01:38:46.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.655+0000 7f96ca9c8700 1 -- start start 2023-11-15T01:38:46.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96ca9c8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96c4062e00 0x7f96c4137000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96ca9c8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96c40bcbf0 0x7f96c40a9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96ca9c8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96c414e960 0x7f96c40a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96ca9c8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40a9d30 con 0x7f96c414e960 2023-11-15T01:38:46.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96ca9c8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c41374f0 con 0x7f96c40bcbf0 2023-11-15T01:38:46.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96ca9c8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40a8920 con 0x7f96c4062e00 2023-11-15T01:38:46.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96c8f65700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96c414e960 0x7f96c40a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:46.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96c8f65700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96c414e960 0x7f96c40a9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49726/0 (socket says 172.21.15.1:49726) 2023-11-15T01:38:46.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96c8f65700 1 -- 172.21.15.1:0/951504102 learned_addr learned my addr 172.21.15.1:0/951504102 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:46.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96c3fff700 1 --2- 172.21.15.1:0/951504102 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96c4062e00 0x7f96c4137000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:46.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96c37fe700 1 --2- 172.21.15.1:0/951504102 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96c40bcbf0 0x7f96c40a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:46.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96c8f65700 1 -- 172.21.15.1:0/951504102 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96c4062e00 msgr2=0x7f96c4137000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96c8f65700 1 --2- 172.21.15.1:0/951504102 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96c4062e00 0x7f96c4137000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96c8f65700 1 -- 172.21.15.1:0/951504102 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96c40bcbf0 msgr2=0x7f96c40a9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96c8f65700 1 --2- 172.21.15.1:0/951504102 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96c40bcbf0 0x7f96c40a9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96c8f65700 1 -- 172.21.15.1:0/951504102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc009a20 con 0x7f96c414e960 2023-11-15T01:38:46.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.656+0000 7f96c8f65700 1 --2- 172.21.15.1:0/951504102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96c414e960 0x7f96c40a9840 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f96bc009f20 tx=0x7f96bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:46.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.657+0000 7f96bbfff700 1 -- 172.21.15.1:0/951504102 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc00cb70 con 0x7f96c414e960 2023-11-15T01:38:46.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.657+0000 7f96bbfff700 1 -- 172.21.15.1:0/951504102 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc00f040 con 0x7f96c414e960 2023-11-15T01:38:46.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.657+0000 7f96ca9c8700 1 -- 172.21.15.1:0/951504102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b40092a0 con 0x7f96c414e960 2023-11-15T01:38:46.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.657+0000 7f96bbfff700 1 -- 172.21.15.1:0/951504102 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc013400 con 0x7f96c414e960 2023-11-15T01:38:46.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.657+0000 7f96ca9c8700 1 -- 172.21.15.1:0/951504102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c40a7ff0 con 0x7f96c414e960 2023-11-15T01:38:46.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.658+0000 7f96ca9c8700 1 -- 172.21.15.1:0/951504102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c406c7e0 con 0x7f96c414e960 2023-11-15T01:38:46.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.658+0000 7f96bbfff700 1 -- 172.21.15.1:0/951504102 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f96bc0137f0 con 0x7f96c414e960 2023-11-15T01:38:46.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.659+0000 7f96bbfff700 1 --2- 172.21.15.1:0/951504102 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96a405f390 0x7f96a4061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.659+0000 7f96c3fff700 1 -- 172.21.15.1:0/951504102 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96a405f390 msgr2=0x7f96a4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:46.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.659+0000 7f96bbfff700 1 -- 172.21.15.1:0/951504102 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f96bc07b240 con 0x7f96c414e960 2023-11-15T01:38:46.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.659+0000 7f96c3fff700 1 --2- 172.21.15.1:0/951504102 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96a405f390 0x7f96a4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:38:46.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.663+0000 7f96bbfff700 1 -- 172.21.15.1:0/951504102 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f96bc04bda0 con 0x7f96c414e960 2023-11-15T01:38:46.672 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:46.671+0000 7fc205ca3680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:38:46.775 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:46.774+0000 7fc205ca3680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:38:46.806 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:46.805+0000 7faf42cea680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:38:46.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.837+0000 7f96ca9c8700 1 -- 172.21.15.1:0/951504102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96c4063fe0 con 0x7f96c414e960 2023-11-15T01:38:46.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.837+0000 7f96bbfff700 1 -- 172.21.15.1:0/951504102 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96bc04f3c0 con 0x7f96c414e960 2023-11-15T01:38:46.839 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:38:46.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.839+0000 7f96ca9c8700 1 -- 172.21.15.1:0/951504102 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96a405f390 msgr2=0x7f96a4061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:38:46.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.839+0000 7f96ca9c8700 1 --2- 172.21.15.1:0/951504102 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96a405f390 0x7f96a4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:46.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.839+0000 7f96ca9c8700 1 -- 172.21.15.1:0/951504102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96c414e960 msgr2=0x7f96c40a9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.839+0000 7f96ca9c8700 1 --2- 172.21.15.1:0/951504102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96c414e960 0x7f96c40a9840 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f96bc009f20 tx=0x7f96bc00b040).stop 2023-11-15T01:38:46.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.839+0000 7f96ca9c8700 1 -- 172.21.15.1:0/951504102 shutdown_connections 2023-11-15T01:38:46.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.839+0000 7f96ca9c8700 1 --2- 172.21.15.1:0/951504102 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96a405f390 0x7f96a4061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:46.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.839+0000 7f96ca9c8700 1 --2- 172.21.15.1:0/951504102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96c414e960 0x7f96c40a9840 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.839+0000 7f96ca9c8700 1 --2- 172.21.15.1:0/951504102 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96c4062e00 0x7f96c4137000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.839+0000 7f96ca9c8700 1 --2- 172.21.15.1:0/951504102 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96c40bcbf0 0x7f96c40a9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.839+0000 7f96ca9c8700 1 -- 172.21.15.1:0/951504102 >> 172.21.15.1:0/951504102 conn(0x7f96c40c8050 msgr2=0x7f96c40a4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:46.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.839+0000 7f96ca9c8700 1 -- 172.21.15.1:0/951504102 shutdown_connections 2023-11-15T01:38:46.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.839+0000 7f96ca9c8700 1 -- 172.21.15.1:0/951504102 wait complete. 2023-11-15T01:38:46.853 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T01:38:46.920 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:46.919+0000 7faf42cea680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:38:46.928 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:46.928+0000 7fc205ca3680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:38:46.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.976+0000 7f36db388700 1 Processor -- start 2023-11-15T01:38:46.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.976+0000 7f36db388700 1 -- start start 2023-11-15T01:38:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.977+0000 7f36db388700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36d414ebd0 0x7f36d4137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.977+0000 7f36db388700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d4154ce0 con 0x7f36d4137030 2023-11-15T01:38:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.977+0000 7f36db388700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d4154fc0 con 0x7f36d4066f80 2023-11-15T01:38:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.977+0000 7f36db388700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4137900 con 0x7f36d414ebd0 2023-11-15T01:38:46.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.977+0000 7f36d9124700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f36d4137030 0x7f36d4066870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55036/0 (socket says 172.21.15.1:55036) 2023-11-15T01:38:46.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.977+0000 7f36d9124700 1 -- 172.21.15.1:0/3887147178 learned_addr learned my addr 172.21.15.1:0/3887147178 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:46.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.977+0000 7f36d9925700 1 --2- 172.21.15.1:0/3887147178 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36d414ebd0 0x7f36d4137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:46.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.977+0000 7f36cbfff700 1 -- 172.21.15.1:0/3887147178 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2098542030 0 0) 0x7f36d4154ce0 con 0x7f36d4137030 2023-11-15T01:38:46.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.977+0000 7f36cbfff700 1 -- 172.21.15.1:0/3887147178 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36c00033f0 con 0x7f36d4137030 2023-11-15T01:38:46.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.977+0000 7f36cbfff700 1 -- 172.21.15.1:0/3887147178 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479069709 0 0) 0x7f36d4154fc0 con 0x7f36d4066f80 2023-11-15T01:38:46.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.977+0000 7f36cbfff700 1 -- 172.21.15.1:0/3887147178 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36d4154ce0 con 0x7f36d4066f80 2023-11-15T01:38:46.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.977+0000 7f36d9925700 1 -- 172.21.15.1:0/3887147178 >> v1:172.21.15.141:6789/0 conn(0x7f36d4066f80 legacy=0x7f36d414e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.977+0000 7f36d9925700 1 -- 172.21.15.1:0/3887147178 >> v1:172.21.15.1:6789/0 conn(0x7f36d4137030 legacy=0x7f36d4066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.977+0000 7f36d9925700 1 -- 172.21.15.1:0/3887147178 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d41552a0 con 0x7f36d414ebd0 2023-11-15T01:38:46.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.978+0000 7f36d9925700 1 --2- 172.21.15.1:0/3887147178 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36d414ebd0 0x7f36d4137410 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f36cc009e90 tx=0x7f36cc009780).ready entity=mon.2 client_cookie=3809f3e8cab17922 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.978+0000 7f36cbfff700 1 -- 172.21.15.1:0/3887147178 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc00e070 con 0x7f36d414ebd0 2023-11-15T01:38:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.978+0000 7f36cbfff700 1 -- 172.21.15.1:0/3887147178 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc00bab0 con 0x7f36d414ebd0 2023-11-15T01:38:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.978+0000 7f36cbfff700 1 -- 172.21.15.1:0/3887147178 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc00be30 con 0x7f36d414ebd0 2023-11-15T01:38:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.978+0000 7f36db388700 1 -- 172.21.15.1:0/3887147178 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36d414ebd0 msgr2=0x7f36d4137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.978+0000 7f36db388700 1 --2- 172.21.15.1:0/3887147178 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36d414ebd0 0x7f36d4137410 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f36cc009e90 tx=0x7f36cc009780).stop 2023-11-15T01:38:46.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.978+0000 7f36db388700 1 -- 172.21.15.1:0/3887147178 shutdown_connections 2023-11-15T01:38:46.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.978+0000 7f36db388700 1 --2- 172.21.15.1:0/3887147178 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36d414ebd0 0x7f36d4137410 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.978+0000 7f36db388700 1 -- 172.21.15.1:0/3887147178 >> 172.21.15.1:0/3887147178 conn(0x7f36d4063280 msgr2=0x7f36d40c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:46.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.979+0000 7f36db388700 1 -- 172.21.15.1:0/3887147178 shutdown_connections 2023-11-15T01:38:46.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.979+0000 7f36db388700 1 -- 172.21.15.1:0/3887147178 wait complete. 2023-11-15T01:38:46.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.980+0000 7f36db388700 1 Processor -- start 2023-11-15T01:38:46.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.980+0000 7f36db388700 1 -- start start 2023-11-15T01:38:46.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36db388700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36d4066f80 0x7f36d40ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36db388700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36d4137030 0x7f36d4151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36db388700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36d414ebd0 0x7f36d414f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36db388700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d40ace90 con 0x7f36d4137030 2023-11-15T01:38:46.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36db388700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4152380 con 0x7f36d4066f80 2023-11-15T01:38:46.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36db388700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d40ad0b0 con 0x7f36d414ebd0 2023-11-15T01:38:46.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36d8923700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36d4137030 0x7f36d4151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:46.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36d8923700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36d4137030 0x7f36d4151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49728/0 (socket says 172.21.15.1:49728) 2023-11-15T01:38:46.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36d8923700 1 -- 172.21.15.1:0/3929428841 learned_addr learned my addr 172.21.15.1:0/3929428841 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:46.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36d9925700 1 --2- 172.21.15.1:0/3929428841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36d414ebd0 0x7f36d414f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:46.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36d9124700 1 --2- 172.21.15.1:0/3929428841 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36d4066f80 0x7f36d40ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:46.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36d8923700 1 -- 172.21.15.1:0/3929428841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36d414ebd0 msgr2=0x7f36d414f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36d8923700 1 --2- 172.21.15.1:0/3929428841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36d414ebd0 0x7f36d414f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36d8923700 1 -- 172.21.15.1:0/3929428841 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36d4066f80 msgr2=0x7f36d40ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:46.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36d8923700 1 --2- 172.21.15.1:0/3929428841 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36d4066f80 0x7f36d40ac9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:46.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36d8923700 1 -- 172.21.15.1:0/3929428841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36cc009a20 con 0x7f36d4137030 2023-11-15T01:38:46.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36d9925700 1 --2- 172.21.15.1:0/3929428841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36d414ebd0 0x7f36d414f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:38:46.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36d8923700 1 --2- 172.21.15.1:0/3929428841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36d4137030 0x7f36d4151e90 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f36c400c470 tx=0x7f36c4007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:46.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36c97fa700 1 -- 172.21.15.1:0/3929428841 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4012400 con 0x7f36d4137030 2023-11-15T01:38:46.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36c97fa700 1 -- 172.21.15.1:0/3929428841 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c4012560 con 0x7f36d4137030 2023-11-15T01:38:46.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36db388700 1 -- 172.21.15.1:0/3929428841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d40ad390 con 0x7f36d4137030 2023-11-15T01:38:46.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36c97fa700 1 -- 172.21.15.1:0/3929428841 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4012920 con 0x7f36d4137030 2023-11-15T01:38:46.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.981+0000 7f36db388700 1 -- 172.21.15.1:0/3929428841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d40ad950 con 0x7f36d4137030 2023-11-15T01:38:46.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.983+0000 7f36db388700 1 -- 172.21.15.1:0/3929428841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d406c7e0 con 0x7f36d4137030 2023-11-15T01:38:46.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.983+0000 7f36c97fa700 1 -- 172.21.15.1:0/3929428841 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f36c401b3b0 con 0x7f36d4137030 2023-11-15T01:38:46.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.984+0000 7f36c97fa700 1 --2- 172.21.15.1:0/3929428841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f36b805f360 0x7f36b8061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:46.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.984+0000 7f36d9124700 1 -- 172.21.15.1:0/3929428841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f36b805f360 msgr2=0x7f36b8061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:46.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.984+0000 7f36c97fa700 1 -- 172.21.15.1:0/3929428841 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f36c4079df0 con 0x7f36d4137030 2023-11-15T01:38:46.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.984+0000 7f36d9124700 1 --2- 172.21.15.1:0/3929428841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f36b805f360 0x7f36b8061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:38:46.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:46.988+0000 7f36c97fa700 1 -- 172.21.15.1:0/3929428841 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f36c4048af0 con 0x7f36d4137030 2023-11-15T01:38:47.003 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:47.003+0000 7fc205ca3680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:38:47.071 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:47.070+0000 7fc205ca3680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:38:47.082 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:47.081+0000 7faf42cea680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:38:47.161 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:47.159+0000 7faf42cea680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:38:47.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.161+0000 7f36db388700 1 -- 172.21.15.1:0/3929428841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36d40ae050 con 0x7f36d4137030 2023-11-15T01:38:47.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.162+0000 7f36c97fa700 1 -- 172.21.15.1:0/3929428841 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+11 (secure 0 0 0) 0x7f36c404aab0 con 0x7f36d4137030 2023-11-15T01:38:47.164 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:38:47.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.164+0000 7f36db388700 1 -- 172.21.15.1:0/3929428841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f36b805f360 msgr2=0x7f36b8061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:38:47.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.164+0000 7f36db388700 1 --2- 172.21.15.1:0/3929428841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f36b805f360 0x7f36b8061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:47.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.164+0000 7f36db388700 1 -- 172.21.15.1:0/3929428841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36d4137030 msgr2=0x7f36d4151e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:47.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.164+0000 7f36db388700 1 --2- 172.21.15.1:0/3929428841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36d4137030 0x7f36d4151e90 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f36c400c470 tx=0x7f36c4007be0).stop 2023-11-15T01:38:47.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.164+0000 7f36db388700 1 -- 172.21.15.1:0/3929428841 shutdown_connections 2023-11-15T01:38:47.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.164+0000 7f36db388700 1 --2- 172.21.15.1:0/3929428841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f36b805f360 0x7f36b8061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:47.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.164+0000 7f36db388700 1 --2- 172.21.15.1:0/3929428841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36d414ebd0 0x7f36d414f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.164+0000 7f36db388700 1 --2- 172.21.15.1:0/3929428841 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36d4066f80 0x7f36d40ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.164+0000 7f36db388700 1 --2- 172.21.15.1:0/3929428841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36d4137030 0x7f36d4151e90 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.164+0000 7f36db388700 1 -- 172.21.15.1:0/3929428841 >> 172.21.15.1:0/3929428841 conn(0x7f36d4063280 msgr2=0x7f36d4063aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:47.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.164+0000 7f36db388700 1 -- 172.21.15.1:0/3929428841 shutdown_connections 2023-11-15T01:38:47.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.164+0000 7f36db388700 1 -- 172.21.15.1:0/3929428841 wait complete. 2023-11-15T01:38:47.178 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:38:47.235 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:47.234+0000 7faf42cea680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:38:47.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.297+0000 7f75df8e2700 1 Processor -- start 2023-11-15T01:38:47.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.297+0000 7f75df8e2700 1 -- start start 2023-11-15T01:38:47.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.298+0000 7f75df8e2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f75d80833a0 0x7f75d80a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:47.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.298+0000 7f75df8e2700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d80a85e0 con 0x7f75d80be520 2023-11-15T01:38:47.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.298+0000 7f75df8e2700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d8065660 con 0x7f75d8154450 2023-11-15T01:38:47.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.298+0000 7f75df8e2700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d8065940 con 0x7f75d80833a0 2023-11-15T01:38:47.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.298+0000 7f75dce7d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f75d80833a0 0x7f75d80a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:47.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.298+0000 7f75dce7d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f75d80833a0 0x7f75d80a7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49744/0 (socket says 172.21.15.1:49744) 2023-11-15T01:38:47.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.298+0000 7f75dde7f700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f75d80be520 0x7f75d80c7470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55038/0 (socket says 172.21.15.1:55038) 2023-11-15T01:38:47.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.298+0000 7f75dce7d700 1 -- 172.21.15.1:0/1113000162 learned_addr learned my addr 172.21.15.1:0/1113000162 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:47.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.298+0000 7f75dce7d700 1 -- 172.21.15.1:0/1113000162 >> v1:172.21.15.141:6789/0 conn(0x7f75d8154450 legacy=0x7f75d80bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:47.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.298+0000 7f75dce7d700 1 -- 172.21.15.1:0/1113000162 >> v1:172.21.15.1:6789/0 conn(0x7f75d80be520 legacy=0x7f75d80c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:47.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.298+0000 7f75dce7d700 1 -- 172.21.15.1:0/1113000162 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d80c6f50 con 0x7f75d80833a0 2023-11-15T01:38:47.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.298+0000 7f75dce7d700 1 --2- 172.21.15.1:0/1113000162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75d80833a0 0x7f75d80a7ef0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f75c8006fd0 tx=0x7f75c80090f0).ready entity=mon.0 client_cookie=282ca81276eab95b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:47.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.298+0000 7f75cffff700 1 -- 172.21.15.1:0/1113000162 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c800b600 con 0x7f75d80833a0 2023-11-15T01:38:47.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.299+0000 7f75cffff700 1 -- 172.21.15.1:0/1113000162 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c800b760 con 0x7f75d80833a0 2023-11-15T01:38:47.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.299+0000 7f75cffff700 1 -- 172.21.15.1:0/1113000162 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c800bae0 con 0x7f75d80833a0 2023-11-15T01:38:47.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.299+0000 7f75df8e2700 1 -- 172.21.15.1:0/1113000162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75d80833a0 msgr2=0x7f75d80a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:47.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.299+0000 7f75df8e2700 1 --2- 172.21.15.1:0/1113000162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75d80833a0 0x7f75d80a7ef0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f75c8006fd0 tx=0x7f75c80090f0).stop 2023-11-15T01:38:47.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.299+0000 7f75df8e2700 1 -- 172.21.15.1:0/1113000162 shutdown_connections 2023-11-15T01:38:47.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.299+0000 7f75df8e2700 1 --2- 172.21.15.1:0/1113000162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75d80833a0 0x7f75d80a7ef0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.299+0000 7f75df8e2700 1 -- 172.21.15.1:0/1113000162 >> 172.21.15.1:0/1113000162 conn(0x7f75d8082f90 msgr2=0x7f75d80c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:47.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.299+0000 7f75df8e2700 1 -- 172.21.15.1:0/1113000162 shutdown_connections 2023-11-15T01:38:47.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.299+0000 7f75df8e2700 1 -- 172.21.15.1:0/1113000162 wait complete. 2023-11-15T01:38:47.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.300+0000 7f75df8e2700 1 Processor -- start 2023-11-15T01:38:47.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.300+0000 7f75df8e2700 1 -- start start 2023-11-15T01:38:47.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.301+0000 7f75df8e2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75d80833a0 0x7f75d80c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:47.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.301+0000 7f75df8e2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75d80be520 0x7f75d80aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:47.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.301+0000 7f75df8e2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75d8154450 0x7f75d8141c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:47.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.301+0000 7f75df8e2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d80aabd0 con 0x7f75d80be520 2023-11-15T01:38:47.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.301+0000 7f75df8e2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d80aaeb0 con 0x7f75d8154450 2023-11-15T01:38:47.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.301+0000 7f75df8e2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d80ab190 con 0x7f75d80833a0 2023-11-15T01:38:47.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.301+0000 7f75dce7d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75d80be520 0x7f75d80aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:47.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.301+0000 7f75dce7d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75d80be520 0x7f75d80aa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49756/0 (socket says 172.21.15.1:49756) 2023-11-15T01:38:47.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.301+0000 7f75dce7d700 1 -- 172.21.15.1:0/3745894841 learned_addr learned my addr 172.21.15.1:0/3745894841 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:47.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.301+0000 7f75dd67e700 1 --2- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75d80833a0 0x7f75d80c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:47.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.302+0000 7f75dde7f700 1 --2- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75d8154450 0x7f75d8141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:47.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.302+0000 7f75dce7d700 1 -- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75d80833a0 msgr2=0x7f75d80c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:47.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.302+0000 7f75dce7d700 1 --2- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75d80833a0 0x7f75d80c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.302+0000 7f75dce7d700 1 -- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75d8154450 msgr2=0x7f75d8141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:47.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.302+0000 7f75dce7d700 1 --2- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75d8154450 0x7f75d8141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.302+0000 7f75dce7d700 1 -- 172.21.15.1:0/3745894841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8009370 con 0x7f75d80be520 2023-11-15T01:38:47.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.302+0000 7f75dce7d700 1 --2- 172.21.15.1:0/3745894841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75d80be520 0x7f75d80aa1a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f75d80665a0 tx=0x7f75c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:47.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.302+0000 7f75cd7fa700 1 -- 172.21.15.1:0/3745894841 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c800b8d0 con 0x7f75d80be520 2023-11-15T01:38:47.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.302+0000 7f75cd7fa700 1 -- 172.21.15.1:0/3745894841 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c800ba30 con 0x7f75d80be520 2023-11-15T01:38:47.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.302+0000 7f75df8e2700 1 -- 172.21.15.1:0/3745894841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d80ab470 con 0x7f75d80be520 2023-11-15T01:38:47.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.302+0000 7f75cd7fa700 1 -- 172.21.15.1:0/3745894841 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c801c670 con 0x7f75d80be520 2023-11-15T01:38:47.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.302+0000 7f75df8e2700 1 -- 172.21.15.1:0/3745894841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d8168ae0 con 0x7f75d80be520 2023-11-15T01:38:47.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.303+0000 7f75df8e2700 1 -- 172.21.15.1:0/3745894841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d80aef40 con 0x7f75d80be520 2023-11-15T01:38:47.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.303+0000 7f75cd7fa700 1 -- 172.21.15.1:0/3745894841 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f75c801ca20 con 0x7f75d80be520 2023-11-15T01:38:47.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.304+0000 7f75cd7fa700 1 --2- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75bc05f390 0x7f75bc061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:47.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.304+0000 7f75dd67e700 1 -- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75bc05f390 msgr2=0x7f75bc061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:47.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.304+0000 7f75cd7fa700 1 -- 172.21.15.1:0/3745894841 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f75c807c670 con 0x7f75d80be520 2023-11-15T01:38:47.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.304+0000 7f75dd67e700 1 --2- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75bc05f390 0x7f75bc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:38:47.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.308+0000 7f75cd7fa700 1 -- 172.21.15.1:0/3745894841 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f75c804d2e0 con 0x7f75d80be520 2023-11-15T01:38:47.329 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:47.328+0000 7fc205ca3680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:38:47.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.505+0000 7f75dd67e700 1 -- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75bc05f390 msgr2=0x7f75bc061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:47.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.505+0000 7f75dd67e700 1 --2- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75bc05f390 0x7f75bc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:38:47.507 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:38:47.509 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:38:47.512 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:47.512+0000 7fc205ca3680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:38:47.515 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:47.514+0000 7faf42cea680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:38:47.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.527+0000 7f75df8e2700 1 -- 172.21.15.1:0/3745894841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75d80ab990 con 0x7f75d80be520 2023-11-15T01:38:47.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.528+0000 7f75cd7fa700 1 -- 172.21.15.1:0/3745894841 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f75d80ab990 con 0x7f75d80be520 2023-11-15T01:38:47.530 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:38:47.530 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6035,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2141857111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2141857111},{"type":"v1","addr":"172.21.15.141:6836","nonce":2141857111}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7140,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3686794692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3686794692},{"type":"v1","addr":"172.21.15.1:6834","nonce":3686794692}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7143,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1233089645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1233089645},{"type":"v1","addr":"172.21.15.1:6835","nonce":1233089645}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:37:25.784087+0000","modified":"2023-11-15T01:37:28.796286+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7155},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7155":{"gid":7155,"name":"b","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/173614126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":173614126},{"type":"v1","addr":"172.21.15.141:6837","nonce":173614126}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-11-15T01:38:47.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.530+0000 7f75df8e2700 1 -- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75bc05f390 msgr2=0x7f75bc061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:38:47.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.530+0000 7f75df8e2700 1 --2- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75bc05f390 0x7f75bc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:47.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.530+0000 7f75df8e2700 1 -- 172.21.15.1:0/3745894841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75d80be520 msgr2=0x7f75d80aa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:47.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.530+0000 7f75df8e2700 1 --2- 172.21.15.1:0/3745894841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75d80be520 0x7f75d80aa1a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f75d80665a0 tx=0x7f75c8017000).stop 2023-11-15T01:38:47.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.530+0000 7f75df8e2700 1 -- 172.21.15.1:0/3745894841 shutdown_connections 2023-11-15T01:38:47.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.530+0000 7f75df8e2700 1 --2- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75bc05f390 0x7f75bc061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:47.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.530+0000 7f75df8e2700 1 --2- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75d8154450 0x7f75d8141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.530+0000 7f75df8e2700 1 --2- 172.21.15.1:0/3745894841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75d80833a0 0x7f75d80c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.530+0000 7f75df8e2700 1 --2- 172.21.15.1:0/3745894841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75d80be520 0x7f75d80aa1a0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.530+0000 7f75df8e2700 1 -- 172.21.15.1:0/3745894841 >> 172.21.15.1:0/3745894841 conn(0x7f75d8082f90 msgr2=0x7f75d8067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:47.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.530+0000 7f75df8e2700 1 -- 172.21.15.1:0/3745894841 shutdown_connections 2023-11-15T01:38:47.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.530+0000 7f75df8e2700 1 -- 172.21.15.1:0/3745894841 wait complete. 2023-11-15T01:38:47.535 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 47 2023-11-15T01:38:47.544 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:38:47.710 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:47.709+0000 7faf42cea680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:38:47.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.721+0000 7f7d92572700 1 Processor -- start 2023-11-15T01:38:47.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.721+0000 7f7d92572700 1 -- start start 2023-11-15T01:38:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.722+0000 7f7d92572700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7d8c0ab1a0 0x7f7d8c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.722+0000 7f7d92572700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7d8c0aa060 0x7f7d8c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.722+0000 7f7d92572700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c0c06f0 con 0x7f7d8c154150 2023-11-15T01:38:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.722+0000 7f7d92572700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c0c09d0 con 0x7f7d8c0aa060 2023-11-15T01:38:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.722+0000 7f7d92572700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c158820 con 0x7f7d8c0ab1a0 2023-11-15T01:38:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.722+0000 7f7d90b0f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7d8c0aa060 0x7f7d8c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.722+0000 7f7d8bfff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7d8c154150 0x7f7d8c158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49390/0 (socket says 172.21.15.1:49390) 2023-11-15T01:38:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.723+0000 7f7d90b0f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7d8c0aa060 0x7f7d8c0c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34110/0 (socket says 172.21.15.1:34110) 2023-11-15T01:38:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.723+0000 7f7d8bfff700 1 -- 172.21.15.1:0/3138511350 learned_addr learned my addr 172.21.15.1:0/3138511350 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.723+0000 7f7d8b7fe700 1 --2- 172.21.15.1:0/3138511350 >> v2:172.21.15.141:3300/0 conn(0x7f7d8c0ab1a0 0x7f7d8c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.723+0000 7f7d90b0f700 1 -- 172.21.15.1:0/3138511350 >> v2:172.21.15.141:3300/0 conn(0x7f7d8c0ab1a0 msgr2=0x7f7d8c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.723+0000 7f7d90b0f700 1 --2- 172.21.15.1:0/3138511350 >> v2:172.21.15.141:3300/0 conn(0x7f7d8c0ab1a0 0x7f7d8c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.723+0000 7f7d90b0f700 1 -- 172.21.15.1:0/3138511350 >> v1:172.21.15.1:6789/0 conn(0x7f7d8c154150 legacy=0x7f7d8c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:47.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.723+0000 7f7d8affd700 1 -- 172.21.15.1:0/3138511350 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298806599 0 0) 0x7f7d8c0c06f0 con 0x7f7d8c154150 2023-11-15T01:38:47.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.723+0000 7f7d90b0f700 1 -- 172.21.15.1:0/3138511350 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c158b00 con 0x7f7d8c0aa060 2023-11-15T01:38:47.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.723+0000 7f7d8b7fe700 1 --2- 172.21.15.1:0/3138511350 >> v2:172.21.15.141:3300/0 conn(0x7f7d8c0ab1a0 0x7f7d8c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:38:47.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.723+0000 7f7d90b0f700 1 --2- 172.21.15.1:0/3138511350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d8c0aa060 0x7f7d8c0c5f10 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f7d8c158750 tx=0x7f7d84009780).ready entity=mon.0 client_cookie=9117baa91562d039 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:47.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.723+0000 7f7d8affd700 1 -- 172.21.15.1:0/3138511350 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8400e070 con 0x7f7d8c0aa060 2023-11-15T01:38:47.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.723+0000 7f7d8affd700 1 -- 172.21.15.1:0/3138511350 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8400bc30 con 0x7f7d8c0aa060 2023-11-15T01:38:47.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.723+0000 7f7d8affd700 1 -- 172.21.15.1:0/3138511350 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84012410 con 0x7f7d8c0aa060 2023-11-15T01:38:47.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.724+0000 7f7d92572700 1 -- 172.21.15.1:0/3138511350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d8c0aa060 msgr2=0x7f7d8c0c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:47.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.724+0000 7f7d92572700 1 --2- 172.21.15.1:0/3138511350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d8c0aa060 0x7f7d8c0c5f10 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f7d8c158750 tx=0x7f7d84009780).stop 2023-11-15T01:38:47.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.724+0000 7f7d92572700 1 -- 172.21.15.1:0/3138511350 shutdown_connections 2023-11-15T01:38:47.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.724+0000 7f7d92572700 1 --2- 172.21.15.1:0/3138511350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d8c0aa060 0x7f7d8c0c5f10 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.724+0000 7f7d92572700 1 --2- 172.21.15.1:0/3138511350 >> v2:172.21.15.141:3300/0 conn(0x7f7d8c0ab1a0 0x7f7d8c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.724+0000 7f7d92572700 1 -- 172.21.15.1:0/3138511350 >> 172.21.15.1:0/3138511350 conn(0x7f7d8c064aa0 msgr2=0x7f7d8c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:47.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.724+0000 7f7d92572700 1 -- 172.21.15.1:0/3138511350 shutdown_connections 2023-11-15T01:38:47.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.724+0000 7f7d92572700 1 -- 172.21.15.1:0/3138511350 wait complete. 2023-11-15T01:38:47.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.725+0000 7f7d92572700 1 Processor -- start 2023-11-15T01:38:47.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.725+0000 7f7d92572700 1 -- start start 2023-11-15T01:38:47.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d92572700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d8c0aa060 0x7f7d8c14c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:47.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d92572700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d8c0ab1a0 0x7f7d8c0ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:47.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d92572700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d8c154150 0x7f7d8c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:47.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d92572700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c14c930 con 0x7f7d8c0ab1a0 2023-11-15T01:38:47.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d92572700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0acec0 con 0x7f7d8c0aa060 2023-11-15T01:38:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d92572700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0ad1a0 con 0x7f7d8c154150 2023-11-15T01:38:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d8b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d8c0ab1a0 0x7f7d8c0ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d8b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d8c0ab1a0 0x7f7d8c0ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34122/0 (socket says 172.21.15.1:34122) 2023-11-15T01:38:47.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d8b7fe700 1 -- 172.21.15.1:0/1208394915 learned_addr learned my addr 172.21.15.1:0/1208394915 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d8bfff700 1 --2- 172.21.15.1:0/1208394915 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d8c0aa060 0x7f7d8c14c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d90b0f700 1 --2- 172.21.15.1:0/1208394915 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d8c154150 0x7f7d8c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d8b7fe700 1 -- 172.21.15.1:0/1208394915 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d8c154150 msgr2=0x7f7d8c154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d8b7fe700 1 --2- 172.21.15.1:0/1208394915 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d8c154150 0x7f7d8c154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d8b7fe700 1 -- 172.21.15.1:0/1208394915 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d8c0aa060 msgr2=0x7f7d8c14c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:47.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d8b7fe700 1 --2- 172.21.15.1:0/1208394915 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d8c0aa060 0x7f7d8c14c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d8b7fe700 1 -- 172.21.15.1:0/1208394915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84009a20 con 0x7f7d8c0ab1a0 2023-11-15T01:38:47.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.726+0000 7f7d8bfff700 1 --2- 172.21.15.1:0/1208394915 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d8c0aa060 0x7f7d8c14c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:38:47.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.727+0000 7f7d8b7fe700 1 --2- 172.21.15.1:0/1208394915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d8c0ab1a0 0x7f7d8c0ae030 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f7d8000d860 tx=0x7f7d80008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:47.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.727+0000 7f7d73fff700 1 -- 172.21.15.1:0/1208394915 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000f520 con 0x7f7d8c0ab1a0 2023-11-15T01:38:47.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.727+0000 7f7d73fff700 1 -- 172.21.15.1:0/1208394915 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8000f680 con 0x7f7d8c0ab1a0 2023-11-15T01:38:47.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.727+0000 7f7d92572700 1 -- 172.21.15.1:0/1208394915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c0ad480 con 0x7f7d8c0ab1a0 2023-11-15T01:38:47.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.727+0000 7f7d73fff700 1 -- 172.21.15.1:0/1208394915 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000fa00 con 0x7f7d8c0ab1a0 2023-11-15T01:38:47.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.727+0000 7f7d92572700 1 -- 172.21.15.1:0/1208394915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c0acae0 con 0x7f7d8c0ab1a0 2023-11-15T01:38:47.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.728+0000 7f7d92572700 1 -- 172.21.15.1:0/1208394915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c06c7e0 con 0x7f7d8c0ab1a0 2023-11-15T01:38:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.728+0000 7f7d73fff700 1 -- 172.21.15.1:0/1208394915 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f7d80013480 con 0x7f7d8c0ab1a0 2023-11-15T01:38:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.728+0000 7f7d73fff700 1 --2- 172.21.15.1:0/1208394915 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d7805f390 0x7f7d78061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.729+0000 7f7d8bfff700 1 -- 172.21.15.1:0/1208394915 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d7805f390 msgr2=0x7f7d78061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.729+0000 7f7d73fff700 1 -- 172.21.15.1:0/1208394915 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f7d8007a520 con 0x7f7d8c0ab1a0 2023-11-15T01:38:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.729+0000 7f7d8bfff700 1 --2- 172.21.15.1:0/1208394915 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d7805f390 0x7f7d78061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:38:47.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.733+0000 7f7d73fff700 1 -- 172.21.15.1:0/1208394915 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7d8004eb60 con 0x7f7d8c0ab1a0 2023-11-15T01:38:47.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.908+0000 7f7d92572700 1 -- 172.21.15.1:0/1208394915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d8c158de0 con 0x7f7d8c0ab1a0 2023-11-15T01:38:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.909+0000 7f7d73fff700 1 -- 172.21.15.1:0/1208394915 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+18200 (secure 0 0 0) 0x7f7d8000b3f0 con 0x7f7d8c0ab1a0 2023-11-15T01:38:47.911 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:38:47.912 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":112,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:38:43.877852+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:37:23.432127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-15T01:37:24.767163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1","mappings":[{"from":6,"to":3}]},{"pgid":"13.32","mappings":[{"from":1,"to":5}]},{"pgid":"14.2","mappings":[{"from":1,"to":2}]},{"pgid":"14.1e","mappings":[{"from":1,"to":5}]},{"pgid":"14.31","mappings":[{"from":1,"to":7}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/3033408699":"2023-11-16T01:37:42.056268+0000","172.21.15.141:6833/90546":"2023-11-16T01:37:42.056268+0000","172.21.15.141:0/1196460966":"2023-11-16T01:37:42.056268+0000","172.21.15.141:6832/90546":"2023-11-16T01:37:42.056268+0000","172.21.15.141:0/1263900820":"2023-11-16T01:37:42.056268+0000","172.21.15.141:0/2534309710":"2023-11-16T01:37:42.056268+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:38:47.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.911+0000 7f7d92572700 1 -- 172.21.15.1:0/1208394915 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d7805f390 msgr2=0x7f7d78061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:38:47.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.911+0000 7f7d92572700 1 --2- 172.21.15.1:0/1208394915 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d7805f390 0x7f7d78061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.911+0000 7f7d92572700 1 -- 172.21.15.1:0/1208394915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d8c0ab1a0 msgr2=0x7f7d8c0ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.911+0000 7f7d92572700 1 --2- 172.21.15.1:0/1208394915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d8c0ab1a0 0x7f7d8c0ae030 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f7d8000d860 tx=0x7f7d80008040).stop 2023-11-15T01:38:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.911+0000 7f7d92572700 1 -- 172.21.15.1:0/1208394915 shutdown_connections 2023-11-15T01:38:47.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.911+0000 7f7d92572700 1 --2- 172.21.15.1:0/1208394915 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d7805f390 0x7f7d78061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.911+0000 7f7d92572700 1 --2- 172.21.15.1:0/1208394915 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d8c154150 0x7f7d8c154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.911+0000 7f7d92572700 1 --2- 172.21.15.1:0/1208394915 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d8c0aa060 0x7f7d8c14c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.911+0000 7f7d92572700 1 --2- 172.21.15.1:0/1208394915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d8c0ab1a0 0x7f7d8c0ae030 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.911+0000 7f7d92572700 1 -- 172.21.15.1:0/1208394915 >> 172.21.15.1:0/1208394915 conn(0x7f7d8c064aa0 msgr2=0x7f7d8c063d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:47.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.911+0000 7f7d92572700 1 -- 172.21.15.1:0/1208394915 shutdown_connections 2023-11-15T01:38:47.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:47.911+0000 7f7d92572700 1 -- 172.21.15.1:0/1208394915 wait complete. 2023-11-15T01:38:47.926 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-15T01:38:47.927 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:38:48.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.046+0000 7f340853b700 1 Processor -- start 2023-11-15T01:38:48.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.046+0000 7f340853b700 1 -- start start 2023-11-15T01:38:48.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.047+0000 7f340853b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3400155790 0x7f34000a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.047+0000 7f340853b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3400083630 con 0x7f3400155b70 2023-11-15T01:38:48.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.047+0000 7f340853b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34000c7c90 con 0x7f34000a61b0 2023-11-15T01:38:48.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.047+0000 7f340853b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34000c5420 con 0x7f3400155790 2023-11-15T01:38:48.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.047+0000 7f3405ad6700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3400155b70 0x7f34000c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49396/0 (socket says 172.21.15.1:49396) 2023-11-15T01:38:48.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.047+0000 7f3405ad6700 1 -- 172.21.15.1:0/3580218120 learned_addr learned my addr 172.21.15.1:0/3580218120 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:48.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.047+0000 7f34062d7700 1 --2- 172.21.15.1:0/3580218120 >> v2:172.21.15.141:3300/0 conn(0x7f3400155790 0x7f34000a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:48.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.047+0000 7f34052d5700 1 -- 172.21.15.1:0/3580218120 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737463953 0 0) 0x7f3400083630 con 0x7f3400155b70 2023-11-15T01:38:48.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.047+0000 7f34052d5700 1 -- 172.21.15.1:0/3580218120 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33ec0033f0 con 0x7f3400155b70 2023-11-15T01:38:48.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.047+0000 7f34062d7700 1 -- 172.21.15.1:0/3580218120 >> v1:172.21.15.141:6789/0 conn(0x7f34000a61b0 legacy=0x7f34000bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.047+0000 7f34052d5700 1 -- 172.21.15.1:0/3580218120 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244326585 0 0) 0x7f34000c7c90 con 0x7f34000a61b0 2023-11-15T01:38:48.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.047+0000 7f34062d7700 1 -- 172.21.15.1:0/3580218120 >> v1:172.21.15.1:6789/0 conn(0x7f3400155b70 legacy=0x7f34000c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.047+0000 7f34062d7700 1 -- 172.21.15.1:0/3580218120 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34000c7960 con 0x7f3400155790 2023-11-15T01:38:48.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.048+0000 7f34062d7700 1 --2- 172.21.15.1:0/3580218120 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3400155790 0x7f34000a5cc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f33fc006fd0 tx=0x7f33fc006f40).ready entity=mon.1 client_cookie=4666ba836b248353 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:48.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.048+0000 7f34052d5700 1 -- 172.21.15.1:0/3580218120 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0001470 con 0x7f3400155790 2023-11-15T01:38:48.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.048+0000 7f34052d5700 1 -- 172.21.15.1:0/3580218120 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc012410 con 0x7f3400155790 2023-11-15T01:38:48.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.048+0000 7f34052d5700 1 -- 172.21.15.1:0/3580218120 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc012790 con 0x7f3400155790 2023-11-15T01:38:48.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.048+0000 7f340853b700 1 -- 172.21.15.1:0/3580218120 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3400155790 msgr2=0x7f34000a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.048+0000 7f340853b700 1 --2- 172.21.15.1:0/3580218120 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3400155790 0x7f34000a5cc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f33fc006fd0 tx=0x7f33fc006f40).stop 2023-11-15T01:38:48.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.048+0000 7f340853b700 1 -- 172.21.15.1:0/3580218120 shutdown_connections 2023-11-15T01:38:48.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.048+0000 7f340853b700 1 --2- 172.21.15.1:0/3580218120 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3400155790 0x7f34000a5cc0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.048+0000 7f340853b700 1 -- 172.21.15.1:0/3580218120 >> 172.21.15.1:0/3580218120 conn(0x7f3400082f90 msgr2=0x7f34000c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:48.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.048+0000 7f340853b700 1 -- 172.21.15.1:0/3580218120 shutdown_connections 2023-11-15T01:38:48.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.048+0000 7f340853b700 1 -- 172.21.15.1:0/3580218120 wait complete. 2023-11-15T01:38:48.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.050+0000 7f340853b700 1 Processor -- start 2023-11-15T01:38:48.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.050+0000 7f340853b700 1 -- start start 2023-11-15T01:38:48.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.050+0000 7f340853b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34000a61b0 0x7f3400161840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.050+0000 7f340853b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3400155790 0x7f3400152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.050+0000 7f340853b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3400155b70 0x7f3400153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f340853b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34001539a0 con 0x7f3400155790 2023-11-15T01:38:48.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f340853b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3400167a50 con 0x7f34000a61b0 2023-11-15T01:38:48.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f340853b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34000c9550 con 0x7f3400155b70 2023-11-15T01:38:48.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f3405ad6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3400155790 0x7f3400152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:48.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f3405ad6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3400155790 0x7f3400152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34124/0 (socket says 172.21.15.1:34124) 2023-11-15T01:38:48.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f3405ad6700 1 -- 172.21.15.1:0/1721978840 learned_addr learned my addr 172.21.15.1:0/1721978840 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:48.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f34062d7700 1 --2- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34000a61b0 0x7f3400161840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:48.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f3406ad8700 1 --2- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3400155b70 0x7f3400153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:48.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f3405ad6700 1 -- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3400155b70 msgr2=0x7f3400153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f3405ad6700 1 --2- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3400155b70 0x7f3400153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f3405ad6700 1 -- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34000a61b0 msgr2=0x7f3400161840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f3405ad6700 1 --2- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34000a61b0 0x7f3400161840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f3405ad6700 1 -- 172.21.15.1:0/1721978840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc009250 con 0x7f3400155790 2023-11-15T01:38:48.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f3405ad6700 1 --2- 172.21.15.1:0/1721978840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3400155790 0x7f3400152b50 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f33f000c7f0 tx=0x7f33f0001b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:48.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f33f67fc700 1 -- 172.21.15.1:0/1721978840 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0007170 con 0x7f3400155790 2023-11-15T01:38:48.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f33f67fc700 1 -- 172.21.15.1:0/1721978840 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f00072d0 con 0x7f3400155790 2023-11-15T01:38:48.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f340853b700 1 -- 172.21.15.1:0/1721978840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34001682b0 con 0x7f3400155790 2023-11-15T01:38:48.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f33f67fc700 1 -- 172.21.15.1:0/1721978840 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f00048c0 con 0x7f3400155790 2023-11-15T01:38:48.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.051+0000 7f340853b700 1 -- 172.21.15.1:0/1721978840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3400167c60 con 0x7f3400155790 2023-11-15T01:38:48.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.052+0000 7f340853b700 1 -- 172.21.15.1:0/1721978840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340006c7e0 con 0x7f3400155790 2023-11-15T01:38:48.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.053+0000 7f33f67fc700 1 -- 172.21.15.1:0/1721978840 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f33f0004c70 con 0x7f3400155790 2023-11-15T01:38:48.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.053+0000 7f33f67fc700 1 --2- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f33e405f390 0x7f33e4061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.053+0000 7f34062d7700 1 -- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f33e405f390 msgr2=0x7f33e4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:48.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.053+0000 7f33f67fc700 1 -- 172.21.15.1:0/1721978840 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f33f007a390 con 0x7f3400155790 2023-11-15T01:38:48.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.053+0000 7f34062d7700 1 --2- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f33e405f390 0x7f33e4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:38:48.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.057+0000 7f33f67fc700 1 -- 172.21.15.1:0/1721978840 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f33f004afa0 con 0x7f3400155790 2023-11-15T01:38:48.169 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:48.168+0000 7fc205ca3680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:38:48.238 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:48.237+0000 7fc205ca3680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:38:48.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.254+0000 7f34062d7700 1 -- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f33e405f390 msgr2=0x7f33e4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:48.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.254+0000 7f34062d7700 1 --2- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f33e405f390 0x7f33e4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:38:48.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.273+0000 7f340853b700 1 -- 172.21.15.1:0/1721978840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34000c4220 con 0x7f3400155790 2023-11-15T01:38:48.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.274+0000 7f33f67fc700 1 -- 172.21.15.1:0/1721978840 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f33f004e5c0 con 0x7f3400155790 2023-11-15T01:38:48.276 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:38:48.276 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6035,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2141857111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2141857111},{"type":"v1","addr":"172.21.15.141:6836","nonce":2141857111}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7140,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3686794692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3686794692},{"type":"v1","addr":"172.21.15.1:6834","nonce":3686794692}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7143,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1233089645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1233089645},{"type":"v1","addr":"172.21.15.1:6835","nonce":1233089645}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:37:25.784087+0000","modified":"2023-11-15T01:37:28.796286+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7155},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7155":{"gid":7155,"name":"b","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/173614126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":173614126},{"type":"v1","addr":"172.21.15.141:6837","nonce":173614126}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-11-15T01:38:48.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.276+0000 7f340853b700 1 -- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f33e405f390 msgr2=0x7f33e4061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:38:48.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.276+0000 7f340853b700 1 --2- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f33e405f390 0x7f33e4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:48.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.276+0000 7f340853b700 1 -- 172.21.15.1:0/1721978840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3400155790 msgr2=0x7f3400152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.276+0000 7f340853b700 1 --2- 172.21.15.1:0/1721978840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3400155790 0x7f3400152b50 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f33f000c7f0 tx=0x7f33f0001b70).stop 2023-11-15T01:38:48.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.276+0000 7f340853b700 1 -- 172.21.15.1:0/1721978840 shutdown_connections 2023-11-15T01:38:48.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.276+0000 7f340853b700 1 --2- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f33e405f390 0x7f33e4061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:48.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.276+0000 7f340853b700 1 --2- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3400155b70 0x7f3400153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.276+0000 7f340853b700 1 --2- 172.21.15.1:0/1721978840 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34000a61b0 0x7f3400161840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.276+0000 7f340853b700 1 --2- 172.21.15.1:0/1721978840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3400155790 0x7f3400152b50 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.276+0000 7f340853b700 1 -- 172.21.15.1:0/1721978840 >> 172.21.15.1:0/1721978840 conn(0x7f3400082f90 msgr2=0x7f3400067c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:48.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.276+0000 7f340853b700 1 -- 172.21.15.1:0/1721978840 shutdown_connections 2023-11-15T01:38:48.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.276+0000 7f340853b700 1 -- 172.21.15.1:0/1721978840 wait complete. 2023-11-15T01:38:48.281 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 47 2023-11-15T01:38:48.291 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:38:48.314 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:48.313+0000 7fc205ca3680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:38:48.410 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:48.408+0000 7faf42cea680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:38:48.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.411+0000 7f6164945700 1 Processor -- start 2023-11-15T01:38:48.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.411+0000 7f6164945700 1 -- start start 2023-11-15T01:38:48.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.412+0000 7f6164945700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6160155530 0x7f61600c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.412+0000 7f6164945700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61600c7980 con 0x7f61600c98b0 2023-11-15T01:38:48.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.412+0000 7f6164945700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61600aa890 con 0x7f6160151e10 2023-11-15T01:38:48.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.412+0000 7f6164945700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61600c7bd0 con 0x7f6160155530 2023-11-15T01:38:48.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.412+0000 7f615f59e700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f61600c98b0 0x7f61600c61a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49408/0 (socket says 172.21.15.1:49408) 2023-11-15T01:38:48.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.412+0000 7f615f59e700 1 -- 172.21.15.1:0/238410643 learned_addr learned my addr 172.21.15.1:0/238410643 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:48.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.412+0000 7f615e59c700 1 --2- 172.21.15.1:0/238410643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6160155530 0x7f61600c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:48.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.412+0000 7f615dd9b700 1 -- 172.21.15.1:0/238410643 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348038861 0 0) 0x7f61600c7980 con 0x7f61600c98b0 2023-11-15T01:38:48.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.412+0000 7f615dd9b700 1 -- 172.21.15.1:0/238410643 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61480033f0 con 0x7f61600c98b0 2023-11-15T01:38:48.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.412+0000 7f615dd9b700 1 -- 172.21.15.1:0/238410643 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408900998 0 0) 0x7f61600aa890 con 0x7f6160151e10 2023-11-15T01:38:48.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.412+0000 7f615dd9b700 1 -- 172.21.15.1:0/238410643 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61600c7980 con 0x7f6160151e10 2023-11-15T01:38:48.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.412+0000 7f615e59c700 1 -- 172.21.15.1:0/238410643 >> v1:172.21.15.141:6789/0 conn(0x7f6160151e10 legacy=0x7f61600aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.412+0000 7f615e59c700 1 -- 172.21.15.1:0/238410643 >> v1:172.21.15.1:6789/0 conn(0x7f61600c98b0 legacy=0x7f61600c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.412+0000 7f615dd9b700 1 -- 172.21.15.1:0/238410643 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 198699081 0 0) 0x7f61480033f0 con 0x7f61600c98b0 2023-11-15T01:38:48.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.412+0000 7f615e59c700 1 -- 172.21.15.1:0/238410643 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61600c7eb0 con 0x7f6160155530 2023-11-15T01:38:48.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.413+0000 7f615e59c700 1 --2- 172.21.15.1:0/238410643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6160155530 0x7f61600c86b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f6154009790 tx=0x7f6154009060).ready entity=mon.2 client_cookie=3d5ec53c3c53bb3d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:48.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.413+0000 7f615dd9b700 1 -- 172.21.15.1:0/238410643 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580017f0 con 0x7f6160155530 2023-11-15T01:38:48.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.413+0000 7f615dd9b700 1 -- 172.21.15.1:0/238410643 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6154011400 con 0x7f6160155530 2023-11-15T01:38:48.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.413+0000 7f615dd9b700 1 -- 172.21.15.1:0/238410643 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154011780 con 0x7f6160155530 2023-11-15T01:38:48.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.413+0000 7f6164945700 1 -- 172.21.15.1:0/238410643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6160155530 msgr2=0x7f61600c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.413+0000 7f6164945700 1 --2- 172.21.15.1:0/238410643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6160155530 0x7f61600c86b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f6154009790 tx=0x7f6154009060).stop 2023-11-15T01:38:48.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.413+0000 7f6164945700 1 -- 172.21.15.1:0/238410643 shutdown_connections 2023-11-15T01:38:48.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.413+0000 7f6164945700 1 --2- 172.21.15.1:0/238410643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6160155530 0x7f61600c86b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.413+0000 7f6164945700 1 -- 172.21.15.1:0/238410643 >> 172.21.15.1:0/238410643 conn(0x7f61600947e0 msgr2=0x7f616006a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:48.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.413+0000 7f6164945700 1 -- 172.21.15.1:0/238410643 shutdown_connections 2023-11-15T01:38:48.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.413+0000 7f6164945700 1 -- 172.21.15.1:0/238410643 wait complete. 2023-11-15T01:38:48.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.415+0000 7f6164945700 1 Processor -- start 2023-11-15T01:38:48.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.415+0000 7f6164945700 1 -- start start 2023-11-15T01:38:48.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.415+0000 7f6164945700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61600c98b0 0x7f6160164380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.415+0000 7f6164945700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6160151e10 0x7f6160164870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.415+0000 7f6164945700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6160155530 0x7f6160164d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.415+0000 7f6164945700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61600b1050 con 0x7f6160155530 2023-11-15T01:38:48.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.415+0000 7f6164945700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61600ae5b0 con 0x7f61600c98b0 2023-11-15T01:38:48.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.415+0000 7f6164945700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61600b0720 con 0x7f6160151e10 2023-11-15T01:38:48.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.415+0000 7f615f59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6160155530 0x7f6160164d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:48.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.415+0000 7f615f59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6160155530 0x7f6160164d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34134/0 (socket says 172.21.15.1:34134) 2023-11-15T01:38:48.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.416+0000 7f615f59e700 1 -- 172.21.15.1:0/2593149644 learned_addr learned my addr 172.21.15.1:0/2593149644 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:48.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.416+0000 7f615e59c700 1 --2- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6160151e10 0x7f6160164870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:48.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.416+0000 7f615ed9d700 1 --2- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61600c98b0 0x7f6160164380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:48.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.416+0000 7f615f59e700 1 -- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6160151e10 msgr2=0x7f6160164870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.416+0000 7f615f59e700 1 --2- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6160151e10 0x7f6160164870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.416+0000 7f615f59e700 1 -- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61600c98b0 msgr2=0x7f6160164380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.416+0000 7f615f59e700 1 --2- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61600c98b0 0x7f6160164380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.416+0000 7f615f59e700 1 -- 172.21.15.1:0/2593149644 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61540092a0 con 0x7f6160155530 2023-11-15T01:38:48.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.416+0000 7f615f59e700 1 --2- 172.21.15.1:0/2593149644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6160155530 0x7f6160164d60 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f615800cb90 tx=0x7f6158001e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:48.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.416+0000 7f6146ffd700 1 -- 172.21.15.1:0/2593149644 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158004c40 con 0x7f6160155530 2023-11-15T01:38:48.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.416+0000 7f6146ffd700 1 -- 172.21.15.1:0/2593149644 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6158004da0 con 0x7f6160155530 2023-11-15T01:38:48.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.416+0000 7f6164945700 1 -- 172.21.15.1:0/2593149644 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61600b0a00 con 0x7f6160155530 2023-11-15T01:38:48.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.416+0000 7f6146ffd700 1 -- 172.21.15.1:0/2593149644 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580073a0 con 0x7f6160155530 2023-11-15T01:38:48.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.416+0000 7f6164945700 1 -- 172.21.15.1:0/2593149644 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6160165250 con 0x7f6160155530 2023-11-15T01:38:48.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.417+0000 7f6164945700 1 -- 172.21.15.1:0/2593149644 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61600475e0 con 0x7f6160155530 2023-11-15T01:38:48.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.418+0000 7f6146ffd700 1 -- 172.21.15.1:0/2593149644 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f6158007750 con 0x7f6160155530 2023-11-15T01:38:48.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.419+0000 7f6146ffd700 1 --2- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f614c05f360 0x7f614c061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.419+0000 7f615ed9d700 1 -- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f614c05f360 msgr2=0x7f614c061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:48.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.419+0000 7f6146ffd700 1 -- 172.21.15.1:0/2593149644 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f615807ac80 con 0x7f6160155530 2023-11-15T01:38:48.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.419+0000 7f615ed9d700 1 --2- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f614c05f360 0x7f614c061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:38:48.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.422+0000 7f6146ffd700 1 -- 172.21.15.1:0/2593149644 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f615804b9b0 con 0x7f6160155530 2023-11-15T01:38:48.462 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:48.461+0000 7fc205ca3680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:38:48.485 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:48.484+0000 7faf42cea680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:38:48.532 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:48.531+0000 7fc205ca3680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:38:48.565 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:48.564+0000 7faf42cea680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:38:48.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.620+0000 7f615ed9d700 1 -- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f614c05f360 msgr2=0x7f614c061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:48.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.620+0000 7f615ed9d700 1 --2- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f614c05f360 0x7f614c061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:38:48.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.639+0000 7f6164945700 1 -- 172.21.15.1:0/2593149644 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61600ad710 con 0x7f6160155530 2023-11-15T01:38:48.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.640+0000 7f6146ffd700 1 -- 172.21.15.1:0/2593149644 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f615804efd0 con 0x7f6160155530 2023-11-15T01:38:48.641 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:38:48.642 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6035,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2141857111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2141857111},{"type":"v1","addr":"172.21.15.141:6836","nonce":2141857111}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7140,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3686794692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3686794692},{"type":"v1","addr":"172.21.15.1:6834","nonce":3686794692}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7143,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1233089645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1233089645},{"type":"v1","addr":"172.21.15.1:6835","nonce":1233089645}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:37:25.784087+0000","modified":"2023-11-15T01:37:28.796286+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7155},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7155":{"gid":7155,"name":"b","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/173614126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":173614126},{"type":"v1","addr":"172.21.15.141:6837","nonce":173614126}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-11-15T01:38:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.642+0000 7f6164945700 1 -- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f614c05f360 msgr2=0x7f614c061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:38:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.642+0000 7f6164945700 1 --2- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f614c05f360 0x7f614c061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.642+0000 7f6164945700 1 -- 172.21.15.1:0/2593149644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6160155530 msgr2=0x7f6160164d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.642+0000 7f6164945700 1 --2- 172.21.15.1:0/2593149644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6160155530 0x7f6160164d60 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f615800cb90 tx=0x7f6158001e80).stop 2023-11-15T01:38:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.642+0000 7f6164945700 1 -- 172.21.15.1:0/2593149644 shutdown_connections 2023-11-15T01:38:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.642+0000 7f6164945700 1 --2- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f614c05f360 0x7f614c061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.642+0000 7f6164945700 1 --2- 172.21.15.1:0/2593149644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6160155530 0x7f6160164d60 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.642+0000 7f6164945700 1 --2- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61600c98b0 0x7f6160164380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.642+0000 7f6164945700 1 --2- 172.21.15.1:0/2593149644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6160151e10 0x7f6160164870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.642+0000 7f6164945700 1 -- 172.21.15.1:0/2593149644 >> 172.21.15.1:0/2593149644 conn(0x7f61600947e0 msgr2=0x7f61600c6160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:48.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.642+0000 7f6164945700 1 -- 172.21.15.1:0/2593149644 shutdown_connections 2023-11-15T01:38:48.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.642+0000 7f6164945700 1 -- 172.21.15.1:0/2593149644 wait complete. 2023-11-15T01:38:48.646 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 47 2023-11-15T01:38:48.647 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:48.647+0000 7fc205ca3680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:38:48.656 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:38:48.723 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:48.722+0000 7faf42cea680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:38:48.755 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:48.755+0000 7fc205ca3680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:38:48.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.774+0000 7f9817674700 1 Processor -- start 2023-11-15T01:38:48.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.774+0000 7f9817674700 1 -- start start 2023-11-15T01:38:48.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.775+0000 7f9817674700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9810154150 0x7f9810154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.775+0000 7f9817674700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98100aa060 0x7f98100c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.775+0000 7f9817674700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98100c06f0 con 0x7f98100ab1a0 2023-11-15T01:38:48.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.775+0000 7f9817674700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98100c09d0 con 0x7f9810154150 2023-11-15T01:38:48.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.775+0000 7f9817674700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9810158820 con 0x7f98100aa060 2023-11-15T01:38:48.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.776+0000 7f9815c11700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98100aa060 0x7f98100c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:48.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.776+0000 7f9815410700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9810154150 0x7f9810154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:48.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.776+0000 7f9814c0f700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f98100ab1a0 0x7f9810158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:41596/0 (socket says 172.21.15.1:41596) 2023-11-15T01:38:48.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.776+0000 7f9814c0f700 1 -- 172.21.15.1:0/723499577 learned_addr learned my addr 172.21.15.1:0/723499577 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:48.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.776+0000 7f9803fff700 1 -- 172.21.15.1:0/723499577 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365278543 0 0) 0x7f98100c06f0 con 0x7f98100ab1a0 2023-11-15T01:38:48.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.776+0000 7f9803fff700 1 -- 172.21.15.1:0/723499577 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97fc0033f0 con 0x7f98100ab1a0 2023-11-15T01:38:48.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.776+0000 7f9815c11700 1 -- 172.21.15.1:0/723499577 >> v2:172.21.15.141:3300/0 conn(0x7f9810154150 msgr2=0x7f9810154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:48.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.776+0000 7f9815c11700 1 --2- 172.21.15.1:0/723499577 >> v2:172.21.15.141:3300/0 conn(0x7f9810154150 0x7f9810154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.776+0000 7f9815c11700 1 -- 172.21.15.1:0/723499577 >> v1:172.21.15.141:6789/0 conn(0x7f98100ab1a0 legacy=0x7f9810158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.776+0000 7f9815c11700 1 -- 172.21.15.1:0/723499577 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810158b00 con 0x7f98100aa060 2023-11-15T01:38:48.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.776+0000 7f9815410700 1 --2- 172.21.15.1:0/723499577 >> v2:172.21.15.141:3300/0 conn(0x7f9810154150 0x7f9810154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:38:48.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.776+0000 7f9815c11700 1 --2- 172.21.15.1:0/723499577 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98100aa060 0x7f98100c5f10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f9808009e60 tx=0x7f9808009780).ready entity=mon.2 client_cookie=708aac1afe294c7d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:48.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.776+0000 7f9803fff700 1 -- 172.21.15.1:0/723499577 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800e070 con 0x7f98100aa060 2023-11-15T01:38:48.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.776+0000 7f9803fff700 1 -- 172.21.15.1:0/723499577 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980800bab0 con 0x7f98100aa060 2023-11-15T01:38:48.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.776+0000 7f9803fff700 1 -- 172.21.15.1:0/723499577 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800be30 con 0x7f98100aa060 2023-11-15T01:38:48.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.777+0000 7f9817674700 1 -- 172.21.15.1:0/723499577 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98100aa060 msgr2=0x7f98100c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.777+0000 7f9817674700 1 --2- 172.21.15.1:0/723499577 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98100aa060 0x7f98100c5f10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f9808009e60 tx=0x7f9808009780).stop 2023-11-15T01:38:48.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.777+0000 7f9817674700 1 -- 172.21.15.1:0/723499577 shutdown_connections 2023-11-15T01:38:48.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.777+0000 7f9817674700 1 --2- 172.21.15.1:0/723499577 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98100aa060 0x7f98100c5f10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.777+0000 7f9817674700 1 --2- 172.21.15.1:0/723499577 >> v2:172.21.15.141:3300/0 conn(0x7f9810154150 0x7f9810154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.777+0000 7f9817674700 1 -- 172.21.15.1:0/723499577 >> 172.21.15.1:0/723499577 conn(0x7f9810064aa0 msgr2=0x7f9810064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:48.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.777+0000 7f9817674700 1 -- 172.21.15.1:0/723499577 shutdown_connections 2023-11-15T01:38:48.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.777+0000 7f9817674700 1 -- 172.21.15.1:0/723499577 wait complete. 2023-11-15T01:38:48.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.778+0000 7f9817674700 1 Processor -- start 2023-11-15T01:38:48.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.778+0000 7f9817674700 1 -- start start 2023-11-15T01:38:48.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.779+0000 7f9817674700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98100aa060 0x7f98101567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.779+0000 7f9817674700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98100ab1a0 0x7f9810147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.779+0000 7f9817674700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9810154150 0x7f98101554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.779+0000 7f9817674700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9810156c90 con 0x7f98100aa060 2023-11-15T01:38:48.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.779+0000 7f9817674700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98100ad320 con 0x7f98100ab1a0 2023-11-15T01:38:48.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.779+0000 7f9817674700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9810148350 con 0x7f9810154150 2023-11-15T01:38:48.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.779+0000 7f9815410700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98100aa060 0x7f98101567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:48.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.779+0000 7f9815410700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98100aa060 0x7f98101567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34150/0 (socket says 172.21.15.1:34150) 2023-11-15T01:38:48.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.779+0000 7f9815410700 1 -- 172.21.15.1:0/3646036398 learned_addr learned my addr 172.21.15.1:0/3646036398 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:48.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.779+0000 7f9815c11700 1 --2- 172.21.15.1:0/3646036398 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9810154150 0x7f98101554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:48.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.779+0000 7f9814c0f700 1 --2- 172.21.15.1:0/3646036398 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98100ab1a0 0x7f9810147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:48.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.780+0000 7f9815410700 1 -- 172.21.15.1:0/3646036398 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9810154150 msgr2=0x7f98101554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.780+0000 7f9815410700 1 --2- 172.21.15.1:0/3646036398 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9810154150 0x7f98101554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.780+0000 7f9815410700 1 -- 172.21.15.1:0/3646036398 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98100ab1a0 msgr2=0x7f9810147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.780+0000 7f9815410700 1 --2- 172.21.15.1:0/3646036398 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98100ab1a0 0x7f9810147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.780+0000 7f9815410700 1 -- 172.21.15.1:0/3646036398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040092a0 con 0x7f98100aa060 2023-11-15T01:38:48.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.780+0000 7f9815c11700 1 --2- 172.21.15.1:0/3646036398 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9810154150 0x7f98101554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:38:48.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.780+0000 7f9815410700 1 --2- 172.21.15.1:0/3646036398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98100aa060 0x7f98101567a0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f980400e980 tx=0x7f9804009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:48.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.780+0000 7f98017fa700 1 -- 172.21.15.1:0/3646036398 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804012600 con 0x7f98100aa060 2023-11-15T01:38:48.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.780+0000 7f98017fa700 1 -- 172.21.15.1:0/3646036398 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9804012760 con 0x7f98100aa060 2023-11-15T01:38:48.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.780+0000 7f9817674700 1 -- 172.21.15.1:0/3646036398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9808009a20 con 0x7f98100aa060 2023-11-15T01:38:48.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.780+0000 7f98017fa700 1 -- 172.21.15.1:0/3646036398 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804012ae0 con 0x7f98100aa060 2023-11-15T01:38:48.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.780+0000 7f9817674700 1 -- 172.21.15.1:0/3646036398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98100ac7c0 con 0x7f98100aa060 2023-11-15T01:38:48.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.781+0000 7f9817674700 1 -- 172.21.15.1:0/3646036398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981006c7e0 con 0x7f98100aa060 2023-11-15T01:38:48.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.781+0000 7f98017fa700 1 -- 172.21.15.1:0/3646036398 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f980401b400 con 0x7f98100aa060 2023-11-15T01:38:48.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.782+0000 7f98017fa700 1 --2- 172.21.15.1:0/3646036398 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f97f405f390 0x7f97f4061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:48.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.782+0000 7f98017fa700 1 -- 172.21.15.1:0/3646036398 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f980407ada0 con 0x7f98100aa060 2023-11-15T01:38:48.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.782+0000 7f9814c0f700 1 -- 172.21.15.1:0/3646036398 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f97f405f390 msgr2=0x7f97f4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:48.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.782+0000 7f9814c0f700 1 --2- 172.21.15.1:0/3646036398 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f97f405f390 0x7f97f4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:38:48.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.789+0000 7f98017fa700 1 -- 172.21.15.1:0/3646036398 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f980404b9b0 con 0x7f98100aa060 2023-11-15T01:38:48.803 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:48.802+0000 7faf42cea680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:38:48.927 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:48.926+0000 7faf42cea680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:38:48.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.964+0000 7f9817674700 1 -- 172.21.15.1:0/3646036398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9810158de0 con 0x7f98100aa060 2023-11-15T01:38:48.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.966+0000 7f98017fa700 1 -- 172.21.15.1:0/3646036398 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+18200 (secure 0 0 0) 0x7f9810158de0 con 0x7f98100aa060 2023-11-15T01:38:48.967 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:38:48.968 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":112,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:38:43.877852+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:37:23.432127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-15T01:37:24.767163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1","mappings":[{"from":6,"to":3}]},{"pgid":"13.32","mappings":[{"from":1,"to":5}]},{"pgid":"14.2","mappings":[{"from":1,"to":2}]},{"pgid":"14.1e","mappings":[{"from":1,"to":5}]},{"pgid":"14.31","mappings":[{"from":1,"to":7}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/3033408699":"2023-11-16T01:37:42.056268+0000","172.21.15.141:6833/90546":"2023-11-16T01:37:42.056268+0000","172.21.15.141:0/1196460966":"2023-11-16T01:37:42.056268+0000","172.21.15.141:6832/90546":"2023-11-16T01:37:42.056268+0000","172.21.15.141:0/1263900820":"2023-11-16T01:37:42.056268+0000","172.21.15.141:0/2534309710":"2023-11-16T01:37:42.056268+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:38:48.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.967+0000 7f9817674700 1 -- 172.21.15.1:0/3646036398 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f97f405f390 msgr2=0x7f97f4061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:38:48.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.967+0000 7f9817674700 1 --2- 172.21.15.1:0/3646036398 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f97f405f390 0x7f97f4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:48.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.967+0000 7f9817674700 1 -- 172.21.15.1:0/3646036398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98100aa060 msgr2=0x7f98101567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:48.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.967+0000 7f9817674700 1 --2- 172.21.15.1:0/3646036398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98100aa060 0x7f98101567a0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f980400e980 tx=0x7f9804009060).stop 2023-11-15T01:38:48.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.968+0000 7f9817674700 1 -- 172.21.15.1:0/3646036398 shutdown_connections 2023-11-15T01:38:48.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.968+0000 7f9817674700 1 --2- 172.21.15.1:0/3646036398 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f97f405f390 0x7f97f4061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:48.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.968+0000 7f9817674700 1 --2- 172.21.15.1:0/3646036398 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9810154150 0x7f98101554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.968+0000 7f9817674700 1 --2- 172.21.15.1:0/3646036398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98100aa060 0x7f98101567a0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.968+0000 7f9817674700 1 --2- 172.21.15.1:0/3646036398 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98100ab1a0 0x7f9810147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:48.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.968+0000 7f9817674700 1 -- 172.21.15.1:0/3646036398 >> 172.21.15.1:0/3646036398 conn(0x7f9810064aa0 msgr2=0x7f98100c5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:48.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.968+0000 7f9817674700 1 -- 172.21.15.1:0/3646036398 shutdown_connections 2023-11-15T01:38:48.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:48.968+0000 7f9817674700 1 -- 172.21.15.1:0/3646036398 wait complete. 2023-11-15T01:38:48.982 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-15T01:38:49.047 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:49.045+0000 7faf42cea680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:38:49.047 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:49.046+0000 7fc205ca3680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:38:49.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.103+0000 7f7ab9439700 1 Processor -- start 2023-11-15T01:38:49.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.103+0000 7f7ab9439700 1 -- start start 2023-11-15T01:38:49.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.103+0000 7f7ab9439700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7ab4154450 0x7f7ab40a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:49.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.103+0000 7f7ab9439700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40be520 0x7f7ab4154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:49.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.103+0000 7f7ab9439700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab40a85e0 con 0x7f7ab40833a0 2023-11-15T01:38:49.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.103+0000 7f7ab9439700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab4065940 con 0x7f7ab4154450 2023-11-15T01:38:49.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.103+0000 7f7ab9439700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4065660 con 0x7f7ab40be520 2023-11-15T01:38:49.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.104+0000 7f7ab2ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7ab4154450 0x7f7ab40a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:49.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.104+0000 7f7ab2ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7ab4154450 0x7f7ab40a7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34166/0 (socket says 172.21.15.1:34166) 2023-11-15T01:38:49.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.104+0000 7f7ab2ffd700 1 -- 172.21.15.1:0/817794084 learned_addr learned my addr 172.21.15.1:0/817794084 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:49.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.104+0000 7f7ab37fe700 1 --2- 172.21.15.1:0/817794084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40be520 0x7f7ab4154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:49.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.104+0000 7f7ab2ffd700 1 -- 172.21.15.1:0/817794084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40be520 msgr2=0x7f7ab4154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:49.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.104+0000 7f7ab2ffd700 1 --2- 172.21.15.1:0/817794084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40be520 0x7f7ab4154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:49.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.104+0000 7f7ab2ffd700 1 -- 172.21.15.1:0/817794084 >> v1:172.21.15.141:6789/0 conn(0x7f7ab40833a0 legacy=0x7f7ab40bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:49.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.104+0000 7f7ab2ffd700 1 -- 172.21.15.1:0/817794084 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab40c6f50 con 0x7f7ab4154450 2023-11-15T01:38:49.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.104+0000 7f7ab2ffd700 1 --2- 172.21.15.1:0/817794084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154450 0x7f7ab40a7ef0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f7aa4009810 tx=0x7f7aa4009060).ready entity=mon.0 client_cookie=529a914f790b0acf server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:49.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.104+0000 7f7ab1ffb700 1 -- 172.21.15.1:0/817794084 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4005880 con 0x7f7ab4154450 2023-11-15T01:38:49.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.104+0000 7f7ab1ffb700 1 -- 172.21.15.1:0/817794084 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa40059e0 con 0x7f7ab4154450 2023-11-15T01:38:49.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.104+0000 7f7ab1ffb700 1 -- 172.21.15.1:0/817794084 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4005d60 con 0x7f7ab4154450 2023-11-15T01:38:49.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.105+0000 7f7ab9439700 1 -- 172.21.15.1:0/817794084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154450 msgr2=0x7f7ab40a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:49.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.105+0000 7f7ab9439700 1 --2- 172.21.15.1:0/817794084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154450 0x7f7ab40a7ef0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f7aa4009810 tx=0x7f7aa4009060).stop 2023-11-15T01:38:49.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.105+0000 7f7ab9439700 1 -- 172.21.15.1:0/817794084 shutdown_connections 2023-11-15T01:38:49.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.105+0000 7f7ab9439700 1 --2- 172.21.15.1:0/817794084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40be520 0x7f7ab4154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:49.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.105+0000 7f7ab9439700 1 --2- 172.21.15.1:0/817794084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154450 0x7f7ab40a7ef0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:49.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.105+0000 7f7ab9439700 1 -- 172.21.15.1:0/817794084 >> 172.21.15.1:0/817794084 conn(0x7f7ab4082f90 msgr2=0x7f7ab40c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:49.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.105+0000 7f7ab9439700 1 -- 172.21.15.1:0/817794084 shutdown_connections 2023-11-15T01:38:49.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.105+0000 7f7ab9439700 1 -- 172.21.15.1:0/817794084 wait complete. 2023-11-15T01:38:49.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.106+0000 7f7ab9439700 1 Processor -- start 2023-11-15T01:38:49.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.106+0000 7f7ab9439700 1 -- start start 2023-11-15T01:38:49.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.107+0000 7f7ab9439700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40833a0 0x7f7ab40a9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:49.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.107+0000 7f7ab9439700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ab40be520 0x7f7ab4158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:49.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.107+0000 7f7ab9439700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154450 0x7f7ab4168660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:49.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.107+0000 7f7ab9439700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40aa2c0 con 0x7f7ab4154450 2023-11-15T01:38:49.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.107+0000 7f7ab9439700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40adbf0 con 0x7f7ab40be520 2023-11-15T01:38:49.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.107+0000 7f7ab9439700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40a9d00 con 0x7f7ab40833a0 2023-11-15T01:38:49.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.107+0000 7f7ab37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154450 0x7f7ab4168660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:49.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.107+0000 7f7ab2ffd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40833a0 0x7f7ab40a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:49.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.107+0000 7f7ab37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154450 0x7f7ab4168660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34168/0 (socket says 172.21.15.1:34168) 2023-11-15T01:38:49.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.107+0000 7f7ab27fc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ab40be520 0x7f7ab4158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:49.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.107+0000 7f7ab37fe700 1 -- 172.21.15.1:0/135712607 learned_addr learned my addr 172.21.15.1:0/135712607 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:49.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.108+0000 7f7ab2ffd700 1 -- 172.21.15.1:0/135712607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ab40be520 msgr2=0x7f7ab4158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:49.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.108+0000 7f7ab2ffd700 1 --2- 172.21.15.1:0/135712607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ab40be520 0x7f7ab4158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:49.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.108+0000 7f7ab2ffd700 1 -- 172.21.15.1:0/135712607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154450 msgr2=0x7f7ab4168660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:49.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.108+0000 7f7ab2ffd700 1 --2- 172.21.15.1:0/135712607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154450 0x7f7ab4168660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:49.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.108+0000 7f7ab2ffd700 1 -- 172.21.15.1:0/135712607 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa4009300 con 0x7f7ab40833a0 2023-11-15T01:38:49.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.108+0000 7f7ab37fe700 1 --2- 172.21.15.1:0/135712607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154450 0x7f7ab4168660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:38:49.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.108+0000 7f7ab2ffd700 1 --2- 172.21.15.1:0/135712607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40833a0 0x7f7ab40a9720 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f7aa4013000 tx=0x7f7aa4016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:49.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.108+0000 7f7a9affd700 1 -- 172.21.15.1:0/135712607 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400b580 con 0x7f7ab40833a0 2023-11-15T01:38:49.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.108+0000 7f7a9affd700 1 -- 172.21.15.1:0/135712607 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa400b6e0 con 0x7f7ab40833a0 2023-11-15T01:38:49.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.108+0000 7f7ab9439700 1 -- 172.21.15.1:0/135712607 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab40a9fe0 con 0x7f7ab40833a0 2023-11-15T01:38:49.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.108+0000 7f7a9affd700 1 -- 172.21.15.1:0/135712607 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400ba60 con 0x7f7ab40833a0 2023-11-15T01:38:49.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.108+0000 7f7ab9439700 1 -- 172.21.15.1:0/135712607 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab4168b50 con 0x7f7ab40833a0 2023-11-15T01:38:49.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.109+0000 7f7ab9439700 1 -- 172.21.15.1:0/135712607 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab40ad6e0 con 0x7f7ab40833a0 2023-11-15T01:38:49.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.109+0000 7f7a9affd700 1 -- 172.21.15.1:0/135712607 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f7aa4018070 con 0x7f7ab40833a0 2023-11-15T01:38:49.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.110+0000 7f7a9affd700 1 --2- 172.21.15.1:0/135712607 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7aa005f390 0x7f7aa0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:49.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.110+0000 7f7a9affd700 1 -- 172.21.15.1:0/135712607 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f7aa407ba20 con 0x7f7ab40833a0 2023-11-15T01:38:49.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.110+0000 7f7ab27fc700 1 -- 172.21.15.1:0/135712607 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7aa005f390 msgr2=0x7f7aa0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:38:49.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.110+0000 7f7ab27fc700 1 --2- 172.21.15.1:0/135712607 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7aa005f390 0x7f7aa0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:38:49.121 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:49.118+0000 7fc205ca3680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:38:49.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.114+0000 7f7a9affd700 1 -- 172.21.15.1:0/135712607 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7ab40ad6e0 con 0x7f7ab40833a0 2023-11-15T01:38:49.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.139+0000 7f7a9affd700 1 -- 172.21.15.1:0/135712607 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mgrmap(e 46) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f7aa4079190 con 0x7f7ab40833a0 2023-11-15T01:38:49.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.139+0000 7f7a9affd700 1 -- 172.21.15.1:0/135712607 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7aa005f390 msgr2=0x7f7aa0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:38:49.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.139+0000 7f7a9affd700 1 --2- 172.21.15.1:0/135712607 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7aa005f390 0x7f7aa0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:49.197 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:49.196+0000 7fc17fc33700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:38:49.197 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:49.196+0000 7fc17fc33700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:38:49.198 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:49.196+0000 7fc17fc33700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:38:49.198 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:49.196+0000 7fc17fc33700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:38:49.198 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:49.196+0000 7fc17fc33700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:38:49.198 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:49.196+0000 7fc182c39700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:38:49.199 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:49.196+0000 7fc182c39700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:38:49.199 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:49.196+0000 7fc182c39700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:38:49.199 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:49.196+0000 7fc182c39700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:38:49.199 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:38:49.196+0000 7fc182c39700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:38:49.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:49.340+0000 7f7ab9439700 1 -- 172.21.15.1:0/135712607 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7ab40ad6e0 con 0x7f7ab40833a0 2023-11-15T01:38:49.362 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:49.360+0000 7faf42cea680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:38:49.437 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:38:49.436+0000 7faf42cea680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:38:50.134 INFO:tasks.ceph.mon.a.smithi001.stderr:2023-11-15T01:38:50.133+0000 7f8072214700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-15T01:38:50.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.137+0000 7f7a9affd700 1 -- 172.21.15.1:0/135712607 <== mon.2 v2:172.21.15.141:3301/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7ab40ad6e0 con 0x7f7ab40833a0 2023-11-15T01:38:50.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.139+0000 7f7ab9439700 1 -- 172.21.15.1:0/135712607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40833a0 msgr2=0x7f7ab40a9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:50.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.139+0000 7f7ab9439700 1 --2- 172.21.15.1:0/135712607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40833a0 0x7f7ab40a9720 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f7aa4013000 tx=0x7f7aa4016000).stop 2023-11-15T01:38:50.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.139+0000 7f7ab9439700 1 -- 172.21.15.1:0/135712607 shutdown_connections 2023-11-15T01:38:50.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.139+0000 7f7ab9439700 1 --2- 172.21.15.1:0/135712607 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7aa005f390 0x7f7aa0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:50.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.139+0000 7f7ab9439700 1 --2- 172.21.15.1:0/135712607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154450 0x7f7ab4168660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:50.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.139+0000 7f7ab9439700 1 --2- 172.21.15.1:0/135712607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40833a0 0x7f7ab40a9720 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:50.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.139+0000 7f7ab9439700 1 --2- 172.21.15.1:0/135712607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ab40be520 0x7f7ab4158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:50.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.139+0000 7f7ab9439700 1 -- 172.21.15.1:0/135712607 >> 172.21.15.1:0/135712607 conn(0x7f7ab4082f90 msgr2=0x7f7ab4067f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:50.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.139+0000 7f7ab9439700 1 -- 172.21.15.1:0/135712607 shutdown_connections 2023-11-15T01:38:50.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.139+0000 7f7ab9439700 1 -- 172.21.15.1:0/135712607 wait complete. 2023-11-15T01:38:50.143 INFO:tasks.ceph.mds.b.smithi141.stderr: -6033> 2023-11-15T01:37:30.710+0000 7fc524954700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T01:38:50.145 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-15T01:38:50.157 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-15T01:38:50.171 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-15T01:38:50.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.281+0000 7f95291be700 1 Processor -- start 2023-11-15T01:38:50.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.281+0000 7f95291be700 1 -- start start 2023-11-15T01:38:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.281+0000 7f95291be700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f95240c5900 0x7f9524069620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.281+0000 7f95291be700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95240bcd20 0x7f95240bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.281+0000 7f95291be700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952406a810 con 0x7f952413a980 2023-11-15T01:38:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.281+0000 7f95291be700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952413ad60 con 0x7f95240c5900 2023-11-15T01:38:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.281+0000 7f95291be700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95240bd660 con 0x7f95240bcd20 2023-11-15T01:38:50.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.282+0000 7f952259c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f95240c5900 0x7f9524069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:50.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.282+0000 7f952259c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f95240c5900 0x7f9524069620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34176/0 (socket says 172.21.15.1:34176) 2023-11-15T01:38:50.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.282+0000 7f952259c700 1 -- 172.21.15.1:0/1220387657 learned_addr learned my addr 172.21.15.1:0/1220387657 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:50.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.282+0000 7f952359e700 1 --2- 172.21.15.1:0/1220387657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95240bcd20 0x7f95240bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:50.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.282+0000 7f952259c700 1 -- 172.21.15.1:0/1220387657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95240bcd20 msgr2=0x7f95240bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:50.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.282+0000 7f952259c700 1 --2- 172.21.15.1:0/1220387657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95240bcd20 0x7f95240bd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:50.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.282+0000 7f952259c700 1 -- 172.21.15.1:0/1220387657 >> v1:172.21.15.141:6789/0 conn(0x7f952413a980 legacy=0x7f95240c1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:50.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.282+0000 7f952259c700 1 -- 172.21.15.1:0/1220387657 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9524069c00 con 0x7f95240c5900 2023-11-15T01:38:50.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.282+0000 7f952259c700 1 --2- 172.21.15.1:0/1220387657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95240c5900 0x7f9524069620 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f9518006fd0 tx=0x7f951800b3b0).ready entity=mon.0 client_cookie=78e686aa698df10b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:50.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.282+0000 7f9521d9b700 1 -- 172.21.15.1:0/1220387657 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951800db40 con 0x7f95240c5900 2023-11-15T01:38:50.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.282+0000 7f9521d9b700 1 -- 172.21.15.1:0/1220387657 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951800dca0 con 0x7f95240c5900 2023-11-15T01:38:50.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.282+0000 7f9521d9b700 1 -- 172.21.15.1:0/1220387657 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518010680 con 0x7f95240c5900 2023-11-15T01:38:50.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.283+0000 7f95291be700 1 -- 172.21.15.1:0/1220387657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95240c5900 msgr2=0x7f9524069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:50.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.283+0000 7f95291be700 1 --2- 172.21.15.1:0/1220387657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95240c5900 0x7f9524069620 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f9518006fd0 tx=0x7f951800b3b0).stop 2023-11-15T01:38:50.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.283+0000 7f95291be700 1 -- 172.21.15.1:0/1220387657 shutdown_connections 2023-11-15T01:38:50.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.283+0000 7f95291be700 1 --2- 172.21.15.1:0/1220387657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95240bcd20 0x7f95240bd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:50.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.283+0000 7f95291be700 1 --2- 172.21.15.1:0/1220387657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95240c5900 0x7f9524069620 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:50.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.283+0000 7f95291be700 1 -- 172.21.15.1:0/1220387657 >> 172.21.15.1:0/1220387657 conn(0x7f9524063280 msgr2=0x7f95240c6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:50.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.283+0000 7f95291be700 1 -- 172.21.15.1:0/1220387657 shutdown_connections 2023-11-15T01:38:50.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.283+0000 7f95291be700 1 -- 172.21.15.1:0/1220387657 wait complete. 2023-11-15T01:38:50.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.284+0000 7f95291be700 1 Processor -- start 2023-11-15T01:38:50.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.284+0000 7f95291be700 1 -- start start 2023-11-15T01:38:50.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f95291be700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95240bcd20 0x7f95240a66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:50.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f95291be700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f95240c5900 0x7f95241680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:50.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f95291be700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f952413a980 0x7f9524150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:50.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f95291be700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9524164b20 con 0x7f952413a980 2023-11-15T01:38:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f95291be700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9524168920 con 0x7f95240c5900 2023-11-15T01:38:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f95291be700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9524168c00 con 0x7f95240bcd20 2023-11-15T01:38:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f952359e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f952413a980 0x7f9524150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f952359e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f952413a980 0x7f9524150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34186/0 (socket says 172.21.15.1:34186) 2023-11-15T01:38:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f952359e700 1 -- 172.21.15.1:0/460148795 learned_addr learned my addr 172.21.15.1:0/460148795 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f9522d9d700 1 --2- 172.21.15.1:0/460148795 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95240bcd20 0x7f95240a66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f952259c700 1 --2- 172.21.15.1:0/460148795 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f95240c5900 0x7f95241680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f952359e700 1 -- 172.21.15.1:0/460148795 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95240bcd20 msgr2=0x7f95240a66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f952359e700 1 --2- 172.21.15.1:0/460148795 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95240bcd20 0x7f95240a66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f952359e700 1 -- 172.21.15.1:0/460148795 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f95240c5900 msgr2=0x7f95241680d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f952359e700 1 --2- 172.21.15.1:0/460148795 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f95240c5900 0x7f95241680d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f952359e700 1 -- 172.21.15.1:0/460148795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951800b610 con 0x7f952413a980 2023-11-15T01:38:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.285+0000 7f952359e700 1 --2- 172.21.15.1:0/460148795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f952413a980 0x7f9524150850 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f951c009fa0 tx=0x7f951c009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.286+0000 7f950affd700 1 -- 172.21.15.1:0/460148795 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c00ebc0 con 0x7f952413a980 2023-11-15T01:38:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.286+0000 7f950affd700 1 -- 172.21.15.1:0/460148795 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c00ed20 con 0x7f952413a980 2023-11-15T01:38:50.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.286+0000 7f95291be700 1 -- 172.21.15.1:0/460148795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9524168ee0 con 0x7f952413a980 2023-11-15T01:38:50.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.286+0000 7f950affd700 1 -- 172.21.15.1:0/460148795 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c014610 con 0x7f952413a980 2023-11-15T01:38:50.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.286+0000 7f95291be700 1 -- 172.21.15.1:0/460148795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95241685c0 con 0x7f952413a980 2023-11-15T01:38:50.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.287+0000 7f95291be700 1 -- 172.21.15.1:0/460148795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95240bf420 con 0x7f952413a980 2023-11-15T01:38:50.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.287+0000 7f950affd700 1 -- 172.21.15.1:0/460148795 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 47) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f951c01d3b0 con 0x7f952413a980 2023-11-15T01:38:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.287+0000 7f950affd700 1 --2- 172.21.15.1:0/460148795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f951005f030 0x7f95100614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.287+0000 7f950affd700 1 -- 172.21.15.1:0/460148795 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 7321+0+0 (secure 0 0 0) 0x7f951c07a910 con 0x7f952413a980 2023-11-15T01:38:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.287+0000 7f9522d9d700 1 --2- 172.21.15.1:0/460148795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f951005f030 0x7f95100614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.288+0000 7f9522d9d700 1 --2- 172.21.15.1:0/460148795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f951005f030 0x7f95100614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f9514003860 tx=0x7f9514007d40).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:50.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.291+0000 7f950affd700 1 -- 172.21.15.1:0/460148795 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f951c04b8a0 con 0x7f952413a980 2023-11-15T01:38:50.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:50.510+0000 7f95291be700 1 -- 172.21.15.1:0/460148795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f952406c7e0 con 0x7f952413a980 2023-11-15T01:38:51.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.148+0000 7f950affd700 1 -- 172.21.15.1:0/460148795 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7f951c04eec0 con 0x7f952413a980 2023-11-15T01:38:51.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.150+0000 7f95291be700 1 -- 172.21.15.1:0/460148795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f951005f030 msgr2=0x7f95100614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:51.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.150+0000 7f95291be700 1 --2- 172.21.15.1:0/460148795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f951005f030 0x7f95100614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f9514003860 tx=0x7f9514007d40).stop 2023-11-15T01:38:51.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.150+0000 7f95291be700 1 -- 172.21.15.1:0/460148795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f952413a980 msgr2=0x7f9524150850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:51.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.150+0000 7f95291be700 1 --2- 172.21.15.1:0/460148795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f952413a980 0x7f9524150850 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f951c009fa0 tx=0x7f951c009900).stop 2023-11-15T01:38:51.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.150+0000 7f95291be700 1 -- 172.21.15.1:0/460148795 shutdown_connections 2023-11-15T01:38:51.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.150+0000 7f95291be700 1 --2- 172.21.15.1:0/460148795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f951005f030 0x7f95100614f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:51.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.150+0000 7f95291be700 1 --2- 172.21.15.1:0/460148795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f952413a980 0x7f9524150850 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:51.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.150+0000 7f95291be700 1 --2- 172.21.15.1:0/460148795 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95240bcd20 0x7f95240a66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.150+0000 7f95291be700 1 --2- 172.21.15.1:0/460148795 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f95240c5900 0x7f95241680d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.150+0000 7f95291be700 1 -- 172.21.15.1:0/460148795 >> 172.21.15.1:0/460148795 conn(0x7f9524063280 msgr2=0x7f95240c3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.150+0000 7f95291be700 1 -- 172.21.15.1:0/460148795 shutdown_connections 2023-11-15T01:38:51.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.150+0000 7f95291be700 1 -- 172.21.15.1:0/460148795 wait complete. 2023-11-15T01:38:51.166 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-15T01:38:51.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.291+0000 7f61d5380700 1 Processor -- start 2023-11-15T01:38:51.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.291+0000 7f61d5380700 1 -- start start 2023-11-15T01:38:51.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.292+0000 7f61d5380700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f61d0155610 0x7f61d00aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:51.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.292+0000 7f61d5380700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d01548f0 con 0x7f61d00ca5d0 2023-11-15T01:38:51.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.292+0000 7f61d5380700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d00aa4f0 con 0x7f61d0063b50 2023-11-15T01:38:51.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.292+0000 7f61d5380700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d00aaa50 con 0x7f61d0155610 2023-11-15T01:38:51.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.292+0000 7f61cffff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f61d00ca5d0 0x7f61d0063440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49412/0 (socket says 172.21.15.1:49412) 2023-11-15T01:38:51.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.292+0000 7f61cffff700 1 -- 172.21.15.1:0/3025516484 learned_addr learned my addr 172.21.15.1:0/3025516484 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:51.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.292+0000 7f61d4b7f700 1 --2- 172.21.15.1:0/3025516484 >> v2:172.21.15.141:3300/0 conn(0x7f61d0155610 0x7f61d00aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:51.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.292+0000 7f61ceffd700 1 -- 172.21.15.1:0/3025516484 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570295880 0 0) 0x7f61c0001110 con 0x7f61d00ca5d0 2023-11-15T01:38:51.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.292+0000 7f61ceffd700 1 -- 172.21.15.1:0/3025516484 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61b80033f0 con 0x7f61d00ca5d0 2023-11-15T01:38:51.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.293+0000 7f61d4b7f700 1 -- 172.21.15.1:0/3025516484 >> v1:172.21.15.141:6789/0 conn(0x7f61d0063b50 legacy=0x7f61d015bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:51.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.293+0000 7f61ceffd700 1 -- 172.21.15.1:0/3025516484 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826089084 0 0) 0x7f61d00aa4f0 con 0x7f61d0063b50 2023-11-15T01:38:51.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.293+0000 7f61d4b7f700 1 -- 172.21.15.1:0/3025516484 >> v1:172.21.15.1:6789/0 conn(0x7f61d00ca5d0 legacy=0x7f61d0063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:51.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.293+0000 7f61d4b7f700 1 -- 172.21.15.1:0/3025516484 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00aa770 con 0x7f61d0155610 2023-11-15T01:38:51.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.293+0000 7f61d4b7f700 1 --2- 172.21.15.1:0/3025516484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61d0155610 0x7f61d00aa000 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f61c8009e60 tx=0x7f61c8009780).ready entity=mon.1 client_cookie=b489aca9a3296bdf server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.293+0000 7f61ceffd700 1 -- 172.21.15.1:0/3025516484 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c800e070 con 0x7f61d0155610 2023-11-15T01:38:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.293+0000 7f61ceffd700 1 -- 172.21.15.1:0/3025516484 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c800bb60 con 0x7f61d0155610 2023-11-15T01:38:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.293+0000 7f61ceffd700 1 -- 172.21.15.1:0/3025516484 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c800bee0 con 0x7f61d0155610 2023-11-15T01:38:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.293+0000 7f61d5380700 1 -- 172.21.15.1:0/3025516484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61d0155610 msgr2=0x7f61d00aa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.293+0000 7f61d5380700 1 --2- 172.21.15.1:0/3025516484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61d0155610 0x7f61d00aa000 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f61c8009e60 tx=0x7f61c8009780).stop 2023-11-15T01:38:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.293+0000 7f61d5380700 1 -- 172.21.15.1:0/3025516484 shutdown_connections 2023-11-15T01:38:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.293+0000 7f61d5380700 1 --2- 172.21.15.1:0/3025516484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61d0155610 0x7f61d00aa000 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.293+0000 7f61d5380700 1 -- 172.21.15.1:0/3025516484 >> 172.21.15.1:0/3025516484 conn(0x7f61d006a9b0 msgr2=0x7f61d00cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.293+0000 7f61d5380700 1 -- 172.21.15.1:0/3025516484 shutdown_connections 2023-11-15T01:38:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.293+0000 7f61d5380700 1 -- 172.21.15.1:0/3025516484 wait complete. 2023-11-15T01:38:51.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.295+0000 7f61d5380700 1 Processor -- start 2023-11-15T01:38:51.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.295+0000 7f61d5380700 1 -- start start 2023-11-15T01:38:51.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.295+0000 7f61d5380700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61d0063b50 0x7f61d0150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:51.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.295+0000 7f61d5380700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61d00ca5d0 0x7f61d0158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:51.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.295+0000 7f61d5380700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d0155610 0x7f61d01599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:51.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61d5380700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d01597c0 con 0x7f61d0155610 2023-11-15T01:38:51.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61d5380700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00ae550 con 0x7f61d0063b50 2023-11-15T01:38:51.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61d5380700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00c27f0 con 0x7f61d00ca5d0 2023-11-15T01:38:51.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61d4b7f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d0155610 0x7f61d01599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:51.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61d4b7f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d0155610 0x7f61d01599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34196/0 (socket says 172.21.15.1:34196) 2023-11-15T01:38:51.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61d4b7f700 1 -- 172.21.15.1:0/3076030082 learned_addr learned my addr 172.21.15.1:0/3076030082 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:51.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61cffff700 1 --2- 172.21.15.1:0/3076030082 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61d0063b50 0x7f61d0150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:51.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61cf7fe700 1 --2- 172.21.15.1:0/3076030082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61d00ca5d0 0x7f61d0158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:51.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61d4b7f700 1 -- 172.21.15.1:0/3076030082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61d00ca5d0 msgr2=0x7f61d0158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:51.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61d4b7f700 1 --2- 172.21.15.1:0/3076030082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61d00ca5d0 0x7f61d0158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:51.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61d4b7f700 1 -- 172.21.15.1:0/3076030082 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61d0063b50 msgr2=0x7f61d0150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:51.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61d4b7f700 1 --2- 172.21.15.1:0/3076030082 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61d0063b50 0x7f61d0150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:51.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61d4b7f700 1 -- 172.21.15.1:0/3076030082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c8009a20 con 0x7f61d0155610 2023-11-15T01:38:51.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61cffff700 1 --2- 172.21.15.1:0/3076030082 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61d0063b50 0x7f61d0150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:38:51.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61d4b7f700 1 --2- 172.21.15.1:0/3076030082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d0155610 0x7f61d01599c0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f61c800b6c0 tx=0x7f61c8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:51.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61b7fff700 1 -- 172.21.15.1:0/3076030082 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c801c660 con 0x7f61d0155610 2023-11-15T01:38:51.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61b7fff700 1 -- 172.21.15.1:0/3076030082 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c801c7c0 con 0x7f61d0155610 2023-11-15T01:38:51.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61d5380700 1 -- 172.21.15.1:0/3076030082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d0159200 con 0x7f61d0155610 2023-11-15T01:38:51.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61b7fff700 1 -- 172.21.15.1:0/3076030082 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c801cb60 con 0x7f61d0155610 2023-11-15T01:38:51.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.296+0000 7f61d5380700 1 -- 172.21.15.1:0/3076030082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d00ae1e0 con 0x7f61d0155610 2023-11-15T01:38:51.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.297+0000 7f61d5380700 1 -- 172.21.15.1:0/3076030082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d00ae6c0 con 0x7f61d0155610 2023-11-15T01:38:51.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.297+0000 7f61b7fff700 1 -- 172.21.15.1:0/3076030082 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 47) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f61c801d420 con 0x7f61d0155610 2023-11-15T01:38:51.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.298+0000 7f61b7fff700 1 --2- 172.21.15.1:0/3076030082 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f61bc05f030 0x7f61bc0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:51.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.298+0000 7f61b7fff700 1 -- 172.21.15.1:0/3076030082 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 7321+0+0 (secure 0 0 0) 0x7f61c807c3e0 con 0x7f61d0155610 2023-11-15T01:38:51.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.298+0000 7f61cffff700 1 --2- 172.21.15.1:0/3076030082 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f61bc05f030 0x7f61bc0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:51.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.298+0000 7f61cffff700 1 --2- 172.21.15.1:0/3076030082 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f61bc05f030 0x7f61bc0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f61c0007fd0 tx=0x7f61c0009040).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:51.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.302+0000 7f61b7fff700 1 -- 172.21.15.1:0/3076030082 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f61c804d370 con 0x7f61d0155610 2023-11-15T01:38:51.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:51.473+0000 7f61d5380700 1 -- 172.21.15.1:0/3076030082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f61d0154b30 con 0x7f61d0155610 2023-11-15T01:38:52.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.162+0000 7f61b7fff700 1 -- 172.21.15.1:0/3076030082 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f61c807c0d0 con 0x7f61d0155610 2023-11-15T01:38:52.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.162+0000 7f61b7fff700 1 -- 172.21.15.1:0/3076030082 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v116) v1 ==== 181+0+0 (secure 0 0 0) 0x7f61c8076b60 con 0x7f61d0155610 2023-11-15T01:38:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.165+0000 7f61d5380700 1 -- 172.21.15.1:0/3076030082 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f61bc05f030 msgr2=0x7f61bc0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:52.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.166+0000 7f61d5380700 1 --2- 172.21.15.1:0/3076030082 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f61bc05f030 0x7f61bc0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f61c0007fd0 tx=0x7f61c0009040).stop 2023-11-15T01:38:52.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.166+0000 7f61d5380700 1 -- 172.21.15.1:0/3076030082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d0155610 msgr2=0x7f61d01599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:52.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.166+0000 7f61d5380700 1 --2- 172.21.15.1:0/3076030082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d0155610 0x7f61d01599c0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f61c800b6c0 tx=0x7f61c8009780).stop 2023-11-15T01:38:52.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.166+0000 7f61d5380700 1 -- 172.21.15.1:0/3076030082 shutdown_connections 2023-11-15T01:38:52.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.166+0000 7f61d5380700 1 --2- 172.21.15.1:0/3076030082 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f61bc05f030 0x7f61bc0614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:52.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.166+0000 7f61d5380700 1 --2- 172.21.15.1:0/3076030082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d0155610 0x7f61d01599c0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:52.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.166+0000 7f61d5380700 1 --2- 172.21.15.1:0/3076030082 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61d0063b50 0x7f61d0150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:52.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.166+0000 7f61d5380700 1 --2- 172.21.15.1:0/3076030082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61d00ca5d0 0x7f61d0158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:52.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.166+0000 7f61d5380700 1 -- 172.21.15.1:0/3076030082 >> 172.21.15.1:0/3076030082 conn(0x7f61d006a9b0 msgr2=0x7f61d0153b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:52.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.166+0000 7f61d5380700 1 -- 172.21.15.1:0/3076030082 shutdown_connections 2023-11-15T01:38:52.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.166+0000 7f61d5380700 1 -- 172.21.15.1:0/3076030082 wait complete. 2023-11-15T01:38:52.170 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2023-11-15T01:38:52.182 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-15T01:38:52.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.310+0000 7f0ba5ce3700 1 Processor -- start 2023-11-15T01:38:52.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.310+0000 7f0ba5ce3700 1 -- start start 2023-11-15T01:38:52.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.311+0000 7f0ba5ce3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0ba014b350 0x7f0ba00c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:52.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.311+0000 7f0ba5ce3700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0ba00aa750 0x7f0ba0154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:52.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.311+0000 7f0ba5ce3700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba01580d0 con 0x7f0ba014b730 2023-11-15T01:38:52.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.311+0000 7f0ba5ce3700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba0155000 con 0x7f0ba014b350 2023-11-15T01:38:52.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.311+0000 7f0ba5ce3700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba01552e0 con 0x7f0ba00aa750 2023-11-15T01:38:52.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.311+0000 7f0b9f7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0ba014b350 0x7f0ba00c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:52.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.311+0000 7f0b9effd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0ba014b730 0x7f0ba00aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49424/0 (socket says 172.21.15.1:49424) 2023-11-15T01:38:52.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.311+0000 7f0b9effd700 1 -- 172.21.15.1:0/388285309 learned_addr learned my addr 172.21.15.1:0/388285309 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:52.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.311+0000 7f0b9f7fe700 1 -- 172.21.15.1:0/388285309 >> v2:172.21.15.141:3300/0 conn(0x7f0ba00aa750 msgr2=0x7f0ba0154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:52.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.311+0000 7f0b9f7fe700 1 --2- 172.21.15.1:0/388285309 >> v2:172.21.15.141:3300/0 conn(0x7f0ba00aa750 0x7f0ba0154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:52.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.311+0000 7f0b9f7fe700 1 -- 172.21.15.1:0/388285309 >> v1:172.21.15.1:6789/0 conn(0x7f0ba014b730 legacy=0x7f0ba00aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:52.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.312+0000 7f0b9f7fe700 1 -- 172.21.15.1:0/388285309 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba01555c0 con 0x7f0ba014b350 2023-11-15T01:38:52.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.311+0000 7f0b9e7fc700 1 -- 172.21.15.1:0/388285309 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293763972 0 0) 0x7f0ba01580d0 con 0x7f0ba014b730 2023-11-15T01:38:52.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.312+0000 7f0b9f7fe700 1 --2- 172.21.15.1:0/388285309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ba014b350 0x7f0ba00c8290 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f0ba00c5690 tx=0x7f0b90009060).ready entity=mon.0 client_cookie=418fa7c4f6615625 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:52.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.312+0000 7f0b9e7fc700 1 -- 172.21.15.1:0/388285309 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9000b580 con 0x7f0ba014b350 2023-11-15T01:38:52.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.312+0000 7f0b9e7fc700 1 -- 172.21.15.1:0/388285309 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9000b6e0 con 0x7f0ba014b350 2023-11-15T01:38:52.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.312+0000 7f0b9e7fc700 1 -- 172.21.15.1:0/388285309 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9000ba60 con 0x7f0ba014b350 2023-11-15T01:38:52.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.312+0000 7f0ba5ce3700 1 -- 172.21.15.1:0/388285309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ba014b350 msgr2=0x7f0ba00c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:52.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.312+0000 7f0ba5ce3700 1 --2- 172.21.15.1:0/388285309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ba014b350 0x7f0ba00c8290 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f0ba00c5690 tx=0x7f0b90009060).stop 2023-11-15T01:38:52.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.312+0000 7f0ba5ce3700 1 -- 172.21.15.1:0/388285309 shutdown_connections 2023-11-15T01:38:52.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.312+0000 7f0ba5ce3700 1 --2- 172.21.15.1:0/388285309 >> v2:172.21.15.141:3300/0 conn(0x7f0ba00aa750 0x7f0ba0154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:52.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.312+0000 7f0ba5ce3700 1 --2- 172.21.15.1:0/388285309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ba014b350 0x7f0ba00c8290 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:52.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.312+0000 7f0ba5ce3700 1 -- 172.21.15.1:0/388285309 >> 172.21.15.1:0/388285309 conn(0x7f0ba0069ee0 msgr2=0x7f0ba006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:52.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.312+0000 7f0ba5ce3700 1 -- 172.21.15.1:0/388285309 shutdown_connections 2023-11-15T01:38:52.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.312+0000 7f0ba5ce3700 1 -- 172.21.15.1:0/388285309 wait complete. 2023-11-15T01:38:52.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.314+0000 7f0ba5ce3700 1 Processor -- start 2023-11-15T01:38:52.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.314+0000 7f0ba5ce3700 1 -- start start 2023-11-15T01:38:52.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.314+0000 7f0ba5ce3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ba00aa750 0x7f0ba00b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:52.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.314+0000 7f0ba5ce3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ba014b350 0x7f0ba0149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:52.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.314+0000 7f0ba5ce3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ba014b730 0x7f0ba0149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:52.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.314+0000 7f0ba5ce3700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba00c4970 con 0x7f0ba00aa750 2023-11-15T01:38:52.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.314+0000 7f0ba5ce3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba00c43b0 con 0x7f0ba014b730 2023-11-15T01:38:52.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.314+0000 7f0ba5ce3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba00c4690 con 0x7f0ba014b350 2023-11-15T01:38:52.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.315+0000 7f0b9f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ba00aa750 0x7f0ba00b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:52.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.315+0000 7f0b9f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ba00aa750 0x7f0ba00b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34218/0 (socket says 172.21.15.1:34218) 2023-11-15T01:38:52.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.315+0000 7f0b9f7fe700 1 -- 172.21.15.1:0/1072308150 learned_addr learned my addr 172.21.15.1:0/1072308150 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:52.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.315+0000 7f0b9ffff700 1 --2- 172.21.15.1:0/1072308150 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ba014b730 0x7f0ba0149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:52.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.315+0000 7f0b9f7fe700 1 -- 172.21.15.1:0/1072308150 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ba014b350 msgr2=0x7f0ba0149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:52.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.315+0000 7f0b9f7fe700 1 --2- 172.21.15.1:0/1072308150 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ba014b350 0x7f0ba0149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:52.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.315+0000 7f0b9f7fe700 1 -- 172.21.15.1:0/1072308150 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ba014b730 msgr2=0x7f0ba0149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:52.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.315+0000 7f0b9f7fe700 1 --2- 172.21.15.1:0/1072308150 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ba014b730 0x7f0ba0149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:52.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.315+0000 7f0b9f7fe700 1 -- 172.21.15.1:0/1072308150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b900092a0 con 0x7f0ba00aa750 2023-11-15T01:38:52.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.315+0000 7f0b9f7fe700 1 --2- 172.21.15.1:0/1072308150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ba00aa750 0x7f0ba00b0690 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f0b90009e80 tx=0x7f0b90017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:52.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.315+0000 7f0b877fe700 1 -- 172.21.15.1:0/1072308150 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90011550 con 0x7f0ba00aa750 2023-11-15T01:38:52.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.315+0000 7f0b877fe700 1 -- 172.21.15.1:0/1072308150 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9001e070 con 0x7f0ba00aa750 2023-11-15T01:38:52.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.315+0000 7f0ba5ce3700 1 -- 172.21.15.1:0/1072308150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba00ae250 con 0x7f0ba00aa750 2023-11-15T01:38:52.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.315+0000 7f0b877fe700 1 -- 172.21.15.1:0/1072308150 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90011900 con 0x7f0ba00aa750 2023-11-15T01:38:52.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.315+0000 7f0ba5ce3700 1 -- 172.21.15.1:0/1072308150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba014a110 con 0x7f0ba00aa750 2023-11-15T01:38:52.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.316+0000 7f0ba5ce3700 1 -- 172.21.15.1:0/1072308150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba006c7e0 con 0x7f0ba00aa750 2023-11-15T01:38:52.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.316+0000 7f0b877fe700 1 -- 172.21.15.1:0/1072308150 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0b90020030 con 0x7f0ba00aa750 2023-11-15T01:38:52.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.317+0000 7f0b877fe700 1 --2- 172.21.15.1:0/1072308150 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0b8c05f270 0x7f0b8c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:52.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.317+0000 7f0b877fe700 1 -- 172.21.15.1:0/1072308150 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f0b9007b850 con 0x7f0ba00aa750 2023-11-15T01:38:52.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.317+0000 7f0b9effd700 1 --2- 172.21.15.1:0/1072308150 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0b8c05f270 0x7f0b8c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:52.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.318+0000 7f0b9effd700 1 --2- 172.21.15.1:0/1072308150 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0b8c05f270 0x7f0b8c061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0ba014efe0 tx=0x7f0b940079e0).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:52.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.321+0000 7f0b877fe700 1 -- 172.21.15.1:0/1072308150 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0b9004c680 con 0x7f0ba00aa750 2023-11-15T01:38:52.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:52.497+0000 7f0ba5ce3700 1 -- 172.21.15.1:0/1072308150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ba00c61c0 con 0x7f0ba00aa750 2023-11-15T01:38:53.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.159+0000 7f0b877fe700 1 -- 172.21.15.1:0/1072308150 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v117) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0b90011cb0 con 0x7f0ba00aa750 2023-11-15T01:38:53.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.163+0000 7f0ba5ce3700 1 -- 172.21.15.1:0/1072308150 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0b8c05f270 msgr2=0x7f0b8c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.163+0000 7f0ba5ce3700 1 --2- 172.21.15.1:0/1072308150 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0b8c05f270 0x7f0b8c061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0ba014efe0 tx=0x7f0b940079e0).stop 2023-11-15T01:38:53.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.163+0000 7f0ba5ce3700 1 -- 172.21.15.1:0/1072308150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ba00aa750 msgr2=0x7f0ba00b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.163+0000 7f0ba5ce3700 1 --2- 172.21.15.1:0/1072308150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ba00aa750 0x7f0ba00b0690 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f0b90009e80 tx=0x7f0b90017000).stop 2023-11-15T01:38:53.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.163+0000 7f0ba5ce3700 1 -- 172.21.15.1:0/1072308150 shutdown_connections 2023-11-15T01:38:53.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.163+0000 7f0ba5ce3700 1 --2- 172.21.15.1:0/1072308150 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0b8c05f270 0x7f0b8c061730 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.163+0000 7f0ba5ce3700 1 --2- 172.21.15.1:0/1072308150 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ba014b730 0x7f0ba0149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.163+0000 7f0ba5ce3700 1 --2- 172.21.15.1:0/1072308150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ba00aa750 0x7f0ba00b0690 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.163+0000 7f0ba5ce3700 1 --2- 172.21.15.1:0/1072308150 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ba014b350 0x7f0ba0149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:38:53.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.163+0000 7f0ba5ce3700 1 -- 172.21.15.1:0/1072308150 >> 172.21.15.1:0/1072308150 conn(0x7f0ba0069ee0 msgr2=0x7f0ba00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:53.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.163+0000 7f0ba5ce3700 1 -- 172.21.15.1:0/1072308150 shutdown_connections 2023-11-15T01:38:53.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.163+0000 7f0ba5ce3700 1 -- 172.21.15.1:0/1072308150 wait complete. 2023-11-15T01:38:53.167 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2023-11-15T01:38:53.179 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-15T01:38:53.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.303+0000 7f6198f43700 1 Processor -- start 2023-11-15T01:38:53.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.303+0000 7f6198f43700 1 -- start start 2023-11-15T01:38:53.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.304+0000 7f6198f43700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f61940c6650 0x7f61940aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.304+0000 7f6198f43700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61940ca050 con 0x7f6194154480 2023-11-15T01:38:53.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.304+0000 7f6198f43700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61940c9440 con 0x7f61941540a0 2023-11-15T01:38:53.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.304+0000 7f6198f43700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61940c9720 con 0x7f61940c6650 2023-11-15T01:38:53.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.304+0000 7f6191d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6194154480 0x7f61940c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49426/0 (socket says 172.21.15.1:49426) 2023-11-15T01:38:53.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.304+0000 7f6191d9b700 1 -- 172.21.15.1:0/3838481460 learned_addr learned my addr 172.21.15.1:0/3838481460 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:53.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.304+0000 7f6192d9d700 1 --2- 172.21.15.1:0/3838481460 >> v2:172.21.15.141:3300/0 conn(0x7f61940c6650 0x7f61940aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.304+0000 7f619159a700 1 -- 172.21.15.1:0/3838481460 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088018029 0 0) 0x7f61940ca050 con 0x7f6194154480 2023-11-15T01:38:53.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.304+0000 7f619159a700 1 -- 172.21.15.1:0/3838481460 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f617c0033f0 con 0x7f6194154480 2023-11-15T01:38:53.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f619159a700 1 -- 172.21.15.1:0/3838481460 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4079358628 0 0) 0x7f617c0033f0 con 0x7f6194154480 2023-11-15T01:38:53.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f619159a700 1 -- 172.21.15.1:0/3838481460 >> v2:172.21.15.141:3300/0 conn(0x7f61940c6650 msgr2=0x7f61940aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:53.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f619159a700 1 --2- 172.21.15.1:0/3838481460 >> v2:172.21.15.141:3300/0 conn(0x7f61940c6650 0x7f61940aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f619159a700 1 -- 172.21.15.1:0/3838481460 >> v1:172.21.15.141:6789/0 conn(0x7f61941540a0 legacy=0x7f61940ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f619159a700 1 -- 172.21.15.1:0/3838481460 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61940c9a00 con 0x7f6194154480 2023-11-15T01:38:53.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f619159a700 1 -- 172.21.15.1:0/3838481460 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f6188001470 con 0x7f6194154480 2023-11-15T01:38:53.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f619159a700 1 -- 172.21.15.1:0/3838481460 >> v1:172.21.15.1:6789/0 conn(0x7f6194154480 legacy=0x7f61940c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f619159a700 1 --2- 172.21.15.1:0/3838481460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f617c0038e0 0x7f617c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f619159a700 1 --2- 172.21.15.1:0/3838481460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f617c004690 0x7f617c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f619159a700 1 --2- 172.21.15.1:0/3838481460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f617c005000 0x7f617c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f619159a700 1 -- 172.21.15.1:0/3838481460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61940c9720 con 0x7f617c005000 2023-11-15T01:38:53.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f619159a700 1 -- 172.21.15.1:0/3838481460 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c00beb0 con 0x7f617c004690 2023-11-15T01:38:53.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f619159a700 1 -- 172.21.15.1:0/3838481460 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c00c070 con 0x7f617c0038e0 2023-11-15T01:38:53.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f6192d9d700 1 --2- 172.21.15.1:0/3838481460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f617c005000 0x7f617c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f6191d9b700 1 --2- 172.21.15.1:0/3838481460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f617c004690 0x7f617c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f619259c700 1 --2- 172.21.15.1:0/3838481460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f617c0038e0 0x7f617c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f6192d9d700 1 -- 172.21.15.1:0/3838481460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f617c0038e0 msgr2=0x7f617c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:53.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f6192d9d700 1 --2- 172.21.15.1:0/3838481460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f617c0038e0 0x7f617c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f6192d9d700 1 -- 172.21.15.1:0/3838481460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f617c004690 msgr2=0x7f617c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:53.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f6192d9d700 1 --2- 172.21.15.1:0/3838481460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f617c004690 0x7f617c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f6192d9d700 1 -- 172.21.15.1:0/3838481460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c0033f0 con 0x7f617c005000 2023-11-15T01:38:53.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f6192d9d700 1 -- 172.21.15.1:0/3838481460 reap_dead start 2023-11-15T01:38:53.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.305+0000 7f6192d9d700 1 --2- 172.21.15.1:0/3838481460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f617c005000 0x7f617c00b8e0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f61940aad30 tx=0x7f618400b040).ready entity=mon.0 client_cookie=cc3a71bd711c3b41 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:53.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.306+0000 7f619159a700 1 -- 172.21.15.1:0/3838481460 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6184017070 con 0x7f617c005000 2023-11-15T01:38:53.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.306+0000 7f619159a700 1 -- 172.21.15.1:0/3838481460 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618400f040 con 0x7f617c005000 2023-11-15T01:38:53.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.306+0000 7f619159a700 1 -- 172.21.15.1:0/3838481460 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618400ecb0 con 0x7f617c005000 2023-11-15T01:38:53.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.306+0000 7f6198f43700 1 -- 172.21.15.1:0/3838481460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f617c005000 msgr2=0x7f617c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.306+0000 7f6198f43700 1 --2- 172.21.15.1:0/3838481460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f617c005000 0x7f617c00b8e0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f61940aad30 tx=0x7f618400b040).stop 2023-11-15T01:38:53.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.306+0000 7f6198f43700 1 -- 172.21.15.1:0/3838481460 shutdown_connections 2023-11-15T01:38:53.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.306+0000 7f6198f43700 1 --2- 172.21.15.1:0/3838481460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f617c005000 0x7f617c00b8e0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.306+0000 7f6198f43700 1 -- 172.21.15.1:0/3838481460 >> 172.21.15.1:0/3838481460 conn(0x7f6194064a70 msgr2=0x7f6194064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:53.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.306+0000 7f6198f43700 1 -- 172.21.15.1:0/3838481460 shutdown_connections 2023-11-15T01:38:53.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.306+0000 7f6198f43700 1 -- 172.21.15.1:0/3838481460 wait complete. 2023-11-15T01:38:53.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.307+0000 7f6198f43700 1 Processor -- start 2023-11-15T01:38:53.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.307+0000 7f6198f43700 1 -- start start 2023-11-15T01:38:53.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f6198f43700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f617c005000 0x7f61940c3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f6198f43700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61940c3830 0x7f6194158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f6198f43700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6194158e20 0x7f6194165d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f6198f43700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61941592a0 con 0x7f61940c3830 2023-11-15T01:38:53.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f6198f43700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6194159f40 con 0x7f6194158e20 2023-11-15T01:38:53.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f6198f43700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61940c2eb0 con 0x7f617c005000 2023-11-15T01:38:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f6191d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61940c3830 0x7f6194158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f6191d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61940c3830 0x7f6194158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34234/0 (socket says 172.21.15.1:34234) 2023-11-15T01:38:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f6191d9b700 1 -- 172.21.15.1:0/597255951 learned_addr learned my addr 172.21.15.1:0/597255951 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f619259c700 1 --2- 172.21.15.1:0/597255951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f617c005000 0x7f61940c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f6192d9d700 1 --2- 172.21.15.1:0/597255951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6194158e20 0x7f6194165d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f6191d9b700 1 -- 172.21.15.1:0/597255951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f617c005000 msgr2=0x7f61940c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f6191d9b700 1 --2- 172.21.15.1:0/597255951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f617c005000 0x7f61940c3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f6191d9b700 1 -- 172.21.15.1:0/597255951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6194158e20 msgr2=0x7f6194165d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f6191d9b700 1 --2- 172.21.15.1:0/597255951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6194158e20 0x7f6194165d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.308+0000 7f6191d9b700 1 -- 172.21.15.1:0/597255951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61940c22a0 con 0x7f61940c3830 2023-11-15T01:38:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.309+0000 7f6191d9b700 1 --2- 172.21.15.1:0/597255951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61940c3830 0x7f6194158930 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f6188004a10 tx=0x7f6188001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.309+0000 7f61827fc700 1 -- 172.21.15.1:0/597255951 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618800f8d0 con 0x7f61940c3830 2023-11-15T01:38:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.309+0000 7f61827fc700 1 -- 172.21.15.1:0/597255951 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618800fa30 con 0x7f61940c3830 2023-11-15T01:38:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.309+0000 7f6198f43700 1 -- 172.21.15.1:0/597255951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61940c2580 con 0x7f61940c3830 2023-11-15T01:38:53.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.309+0000 7f61827fc700 1 -- 172.21.15.1:0/597255951 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618800fdb0 con 0x7f61940c3830 2023-11-15T01:38:53.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.309+0000 7f6198f43700 1 -- 172.21.15.1:0/597255951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61940c2b40 con 0x7f61940c3830 2023-11-15T01:38:53.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.310+0000 7f6198f43700 1 -- 172.21.15.1:0/597255951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619406c7e0 con 0x7f61940c3830 2023-11-15T01:38:53.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.310+0000 7f61827fc700 1 -- 172.21.15.1:0/597255951 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6188015620 con 0x7f61940c3830 2023-11-15T01:38:53.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.310+0000 7f61827fc700 1 --2- 172.21.15.1:0/597255951 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f617405f270 0x7f6174061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.311+0000 7f61827fc700 1 -- 172.21.15.1:0/597255951 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f618807a860 con 0x7f61940c3830 2023-11-15T01:38:53.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.311+0000 7f619259c700 1 --2- 172.21.15.1:0/597255951 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f617405f270 0x7f6174061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.311+0000 7f619259c700 1 --2- 172.21.15.1:0/597255951 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f617405f270 0x7f6174061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f618c007fd0 tx=0x7f618c007bb0).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:53.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.315+0000 7f61827fc700 1 -- 172.21.15.1:0/597255951 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f618804b8a0 con 0x7f61940c3830 2023-11-15T01:38:53.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.488+0000 7f6198f43700 1 -- 172.21.15.1:0/597255951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f61940c2ff0 con 0x7f61940c3830 2023-11-15T01:38:53.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.492+0000 7f61827fc700 1 -- 172.21.15.1:0/597255951 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f618804eec0 con 0x7f61940c3830 2023-11-15T01:38:53.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.494+0000 7f6198f43700 1 -- 172.21.15.1:0/597255951 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f617405f270 msgr2=0x7f6174061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.494+0000 7f6198f43700 1 --2- 172.21.15.1:0/597255951 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f617405f270 0x7f6174061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f618c007fd0 tx=0x7f618c007bb0).stop 2023-11-15T01:38:53.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.494+0000 7f6198f43700 1 -- 172.21.15.1:0/597255951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61940c3830 msgr2=0x7f6194158930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.494+0000 7f6198f43700 1 --2- 172.21.15.1:0/597255951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61940c3830 0x7f6194158930 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f6188004a10 tx=0x7f6188001e50).stop 2023-11-15T01:38:53.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.494+0000 7f6198f43700 1 -- 172.21.15.1:0/597255951 shutdown_connections 2023-11-15T01:38:53.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.494+0000 7f6198f43700 1 --2- 172.21.15.1:0/597255951 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f617405f270 0x7f6174061730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.494+0000 7f6198f43700 1 --2- 172.21.15.1:0/597255951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6194158e20 0x7f6194165d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.494+0000 7f6198f43700 1 --2- 172.21.15.1:0/597255951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f617c005000 0x7f61940c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.494+0000 7f6198f43700 1 --2- 172.21.15.1:0/597255951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61940c3830 0x7f6194158930 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.494+0000 7f6198f43700 1 -- 172.21.15.1:0/597255951 >> 172.21.15.1:0/597255951 conn(0x7f6194064a70 msgr2=0x7f6194064e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:53.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.494+0000 7f6198f43700 1 -- 172.21.15.1:0/597255951 shutdown_connections 2023-11-15T01:38:53.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.494+0000 7f6198f43700 1 -- 172.21.15.1:0/597255951 wait complete. 2023-11-15T01:38:53.507 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-15T01:38:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.626+0000 7f4bcad2e700 1 Processor -- start 2023-11-15T01:38:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.626+0000 7f4bcad2e700 1 -- start start 2023-11-15T01:38:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.626+0000 7f4bcad2e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4bc40bd450 0x7f4bc40c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.626+0000 7f4bcad2e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4bc414b100 0x7f4bc40c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.626+0000 7f4bcad2e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc40c6a20 con 0x7f4bc414ad20 2023-11-15T01:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.626+0000 7f4bcad2e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc40c72c0 con 0x7f4bc40bd450 2023-11-15T01:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.626+0000 7f4bcad2e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc40c6d00 con 0x7f4bc414b100 2023-11-15T01:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.627+0000 7f4bc3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4bc40bd450 0x7f4bc40c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.627+0000 7f4bc3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4bc40bd450 0x7f4bc40c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34238/0 (socket says 172.21.15.1:34238) 2023-11-15T01:38:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.627+0000 7f4bc3fff700 1 -- 172.21.15.1:0/3545404966 learned_addr learned my addr 172.21.15.1:0/3545404966 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.627+0000 7f4bc92cb700 1 --2- 172.21.15.1:0/3545404966 >> v2:172.21.15.141:3300/0 conn(0x7f4bc414b100 0x7f4bc40c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.627+0000 7f4bc3fff700 1 -- 172.21.15.1:0/3545404966 >> v2:172.21.15.141:3300/0 conn(0x7f4bc414b100 msgr2=0x7f4bc40c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.627+0000 7f4bc3fff700 1 --2- 172.21.15.1:0/3545404966 >> v2:172.21.15.141:3300/0 conn(0x7f4bc414b100 0x7f4bc40c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.627+0000 7f4bc3fff700 1 -- 172.21.15.1:0/3545404966 >> v1:172.21.15.141:6789/0 conn(0x7f4bc414ad20 legacy=0x7f4bc40bcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.627+0000 7f4bc3fff700 1 -- 172.21.15.1:0/3545404966 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc40c6fe0 con 0x7f4bc40bd450 2023-11-15T01:38:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.627+0000 7f4bc92cb700 1 --2- 172.21.15.1:0/3545404966 >> v2:172.21.15.141:3300/0 conn(0x7f4bc414b100 0x7f4bc40c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:38:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.627+0000 7f4bc3fff700 1 --2- 172.21.15.1:0/3545404966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc40bd450 0x7f4bc40c5cb0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f4bc40bd830 tx=0x7f4bac00b3b0).ready entity=mon.0 client_cookie=21fdebcd4310b66c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:53.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.627+0000 7f4bc37fe700 1 -- 172.21.15.1:0/3545404966 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac00db10 con 0x7f4bc40bd450 2023-11-15T01:38:53.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.627+0000 7f4bc37fe700 1 -- 172.21.15.1:0/3545404966 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac00dc70 con 0x7f4bc40bd450 2023-11-15T01:38:53.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.627+0000 7f4bc37fe700 1 -- 172.21.15.1:0/3545404966 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac010470 con 0x7f4bc40bd450 2023-11-15T01:38:53.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.628+0000 7f4bcad2e700 1 -- 172.21.15.1:0/3545404966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc40bd450 msgr2=0x7f4bc40c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.628+0000 7f4bcad2e700 1 --2- 172.21.15.1:0/3545404966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc40bd450 0x7f4bc40c5cb0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f4bc40bd830 tx=0x7f4bac00b3b0).stop 2023-11-15T01:38:53.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.628+0000 7f4bcad2e700 1 -- 172.21.15.1:0/3545404966 shutdown_connections 2023-11-15T01:38:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.628+0000 7f4bcad2e700 1 --2- 172.21.15.1:0/3545404966 >> v2:172.21.15.141:3300/0 conn(0x7f4bc414b100 0x7f4bc40c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.628+0000 7f4bcad2e700 1 --2- 172.21.15.1:0/3545404966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc40bd450 0x7f4bc40c5cb0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.628+0000 7f4bcad2e700 1 -- 172.21.15.1:0/3545404966 >> 172.21.15.1:0/3545404966 conn(0x7f4bc40c8050 msgr2=0x7f4bc40c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.628+0000 7f4bcad2e700 1 -- 172.21.15.1:0/3545404966 shutdown_connections 2023-11-15T01:38:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.628+0000 7f4bcad2e700 1 -- 172.21.15.1:0/3545404966 wait complete. 2023-11-15T01:38:53.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.629+0000 7f4bcad2e700 1 Processor -- start 2023-11-15T01:38:53.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.629+0000 7f4bcad2e700 1 -- start start 2023-11-15T01:38:53.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bcad2e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bc40bd450 0x7f4bc4153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bcad2e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bc414ad20 0x7f4bc4155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bcad2e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc414b100 0x7f4bc4156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bcad2e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc41551f0 con 0x7f4bc414b100 2023-11-15T01:38:53.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bcad2e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc41557b0 con 0x7f4bc40bd450 2023-11-15T01:38:53.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bcad2e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40ad4a0 con 0x7f4bc414ad20 2023-11-15T01:38:53.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bc92cb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc414b100 0x7f4bc4156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bc92cb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc414b100 0x7f4bc4156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34248/0 (socket says 172.21.15.1:34248) 2023-11-15T01:38:53.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bc92cb700 1 -- 172.21.15.1:0/2962421188 learned_addr learned my addr 172.21.15.1:0/2962421188 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:53.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bc3fff700 1 --2- 172.21.15.1:0/2962421188 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bc414ad20 0x7f4bc4155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bc8aca700 1 --2- 172.21.15.1:0/2962421188 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bc40bd450 0x7f4bc4153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bc92cb700 1 -- 172.21.15.1:0/2962421188 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bc414ad20 msgr2=0x7f4bc4155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bc92cb700 1 --2- 172.21.15.1:0/2962421188 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bc414ad20 0x7f4bc4155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bc92cb700 1 -- 172.21.15.1:0/2962421188 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bc40bd450 msgr2=0x7f4bc4153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bc92cb700 1 --2- 172.21.15.1:0/2962421188 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bc40bd450 0x7f4bc4153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.630+0000 7f4bc92cb700 1 -- 172.21.15.1:0/2962421188 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac00b610 con 0x7f4bc414b100 2023-11-15T01:38:53.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.631+0000 7f4bc92cb700 1 --2- 172.21.15.1:0/2962421188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc414b100 0x7f4bc4156130 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f4bbc00c6b0 tx=0x7f4bbc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:53.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.631+0000 7f4bc0ff9700 1 -- 172.21.15.1:0/2962421188 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc010580 con 0x7f4bc414b100 2023-11-15T01:38:53.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.631+0000 7f4bc0ff9700 1 -- 172.21.15.1:0/2962421188 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc0106e0 con 0x7f4bc414b100 2023-11-15T01:38:53.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.631+0000 7f4bcad2e700 1 -- 172.21.15.1:0/2962421188 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc4148980 con 0x7f4bc414b100 2023-11-15T01:38:53.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.631+0000 7f4bc0ff9700 1 -- 172.21.15.1:0/2962421188 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc010a60 con 0x7f4bc414b100 2023-11-15T01:38:53.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.631+0000 7f4bcad2e700 1 -- 172.21.15.1:0/2962421188 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc414dab0 con 0x7f4bc414b100 2023-11-15T01:38:53.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.632+0000 7f4bcad2e700 1 -- 172.21.15.1:0/2962421188 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc406c7e0 con 0x7f4bc414b100 2023-11-15T01:38:53.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.632+0000 7f4bc0ff9700 1 -- 172.21.15.1:0/2962421188 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4bbc01b460 con 0x7f4bc414b100 2023-11-15T01:38:53.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.632+0000 7f4bc0ff9700 1 --2- 172.21.15.1:0/2962421188 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4ba405f270 0x7f4ba4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.633+0000 7f4bc0ff9700 1 -- 172.21.15.1:0/2962421188 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f4bbc07a2f0 con 0x7f4bc414b100 2023-11-15T01:38:53.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.633+0000 7f4bc8aca700 1 --2- 172.21.15.1:0/2962421188 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4ba405f270 0x7f4ba4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.633+0000 7f4bc8aca700 1 --2- 172.21.15.1:0/2962421188 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4ba405f270 0x7f4ba4061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4bc414e300 tx=0x7f4bb4009040).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:53.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.637+0000 7f4bc0ff9700 1 -- 172.21.15.1:0/2962421188 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4bbc04b390 con 0x7f4bc414b100 2023-11-15T01:38:53.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.813+0000 7f4bcad2e700 1 -- 172.21.15.1:0/2962421188 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f4bc40c6690 con 0x7f4bc414b100 2023-11-15T01:38:53.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.816+0000 7f4bc0ff9700 1 -- 172.21.15.1:0/2962421188 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v21) v1 ==== 120+0+0 (secure 0 0 0) 0x7f4bbc04e9b0 con 0x7f4bc414b100 2023-11-15T01:38:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.818+0000 7f4bcad2e700 1 -- 172.21.15.1:0/2962421188 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4ba405f270 msgr2=0x7f4ba4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.818+0000 7f4bcad2e700 1 --2- 172.21.15.1:0/2962421188 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4ba405f270 0x7f4ba4061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4bc414e300 tx=0x7f4bb4009040).stop 2023-11-15T01:38:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.818+0000 7f4bcad2e700 1 -- 172.21.15.1:0/2962421188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc414b100 msgr2=0x7f4bc4156130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.818+0000 7f4bcad2e700 1 --2- 172.21.15.1:0/2962421188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc414b100 0x7f4bc4156130 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f4bbc00c6b0 tx=0x7f4bbc008040).stop 2023-11-15T01:38:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.818+0000 7f4bcad2e700 1 -- 172.21.15.1:0/2962421188 shutdown_connections 2023-11-15T01:38:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.818+0000 7f4bcad2e700 1 --2- 172.21.15.1:0/2962421188 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4ba405f270 0x7f4ba4061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.818+0000 7f4bcad2e700 1 --2- 172.21.15.1:0/2962421188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc414b100 0x7f4bc4156130 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.818+0000 7f4bcad2e700 1 --2- 172.21.15.1:0/2962421188 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bc40bd450 0x7f4bc4153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.818+0000 7f4bcad2e700 1 --2- 172.21.15.1:0/2962421188 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bc414ad20 0x7f4bc4155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.818+0000 7f4bcad2e700 1 -- 172.21.15.1:0/2962421188 >> 172.21.15.1:0/2962421188 conn(0x7f4bc40c8050 msgr2=0x7f4bc4062d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:53.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.818+0000 7f4bcad2e700 1 -- 172.21.15.1:0/2962421188 shutdown_connections 2023-11-15T01:38:53.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.818+0000 7f4bcad2e700 1 -- 172.21.15.1:0/2962421188 wait complete. 2023-11-15T01:38:53.831 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-11-15T01:38:53.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.956+0000 7f8bb2af8700 1 Processor -- start 2023-11-15T01:38:53.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.956+0000 7f8bb2af8700 1 -- start start 2023-11-15T01:38:53.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.957+0000 7f8bb2af8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8bac154300 0x7f8bac0c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.957+0000 7f8bb2af8700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bac069640 con 0x7f8bac1546e0 2023-11-15T01:38:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.957+0000 7f8bb2af8700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bac06bac0 con 0x7f8bac158b30 2023-11-15T01:38:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.957+0000 7f8bb2af8700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bac06a1e0 con 0x7f8bac154300 2023-11-15T01:38:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.957+0000 7f8bb1af6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8bac154300 0x7f8bac0c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.957+0000 7f8bb22f7700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8bac1546e0 0x7f8bac0bc2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49432/0 (socket says 172.21.15.1:49432) 2023-11-15T01:38:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.958+0000 7f8bb1af6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8bac154300 0x7f8bac0c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34250/0 (socket says 172.21.15.1:34250) 2023-11-15T01:38:53.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.958+0000 7f8bb22f7700 1 -- 172.21.15.1:0/816912221 learned_addr learned my addr 172.21.15.1:0/816912221 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:53.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.958+0000 7f8bb1af6700 1 -- 172.21.15.1:0/816912221 >> v1:172.21.15.141:6789/0 conn(0x7f8bac158b30 legacy=0x7f8bac069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:53.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.958+0000 7f8bb1af6700 1 -- 172.21.15.1:0/816912221 >> v1:172.21.15.1:6789/0 conn(0x7f8bac1546e0 legacy=0x7f8bac0bc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.958+0000 7f8bb1af6700 1 -- 172.21.15.1:0/816912221 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac068d10 con 0x7f8bac154300 2023-11-15T01:38:53.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.958+0000 7f8bb0af4700 1 -- 172.21.15.1:0/816912221 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822518917 0 0) 0x7f8bac069640 con 0x7f8bac1546e0 2023-11-15T01:38:53.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.958+0000 7f8bb1af6700 1 --2- 172.21.15.1:0/816912221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bac154300 0x7f8bac0c45d0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f8ba4009760 tx=0x7f8ba4009060).ready entity=mon.0 client_cookie=3d16862d2f2cd39d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:53.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.958+0000 7f8bb0af4700 1 -- 172.21.15.1:0/816912221 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400b520 con 0x7f8bac154300 2023-11-15T01:38:53.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.958+0000 7f8bb0af4700 1 -- 172.21.15.1:0/816912221 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba400b680 con 0x7f8bac154300 2023-11-15T01:38:53.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.958+0000 7f8bb0af4700 1 -- 172.21.15.1:0/816912221 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400ba00 con 0x7f8bac154300 2023-11-15T01:38:53.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.959+0000 7f8bb2af8700 1 -- 172.21.15.1:0/816912221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bac154300 msgr2=0x7f8bac0c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.959+0000 7f8bb2af8700 1 --2- 172.21.15.1:0/816912221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bac154300 0x7f8bac0c45d0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f8ba4009760 tx=0x7f8ba4009060).stop 2023-11-15T01:38:53.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.959+0000 7f8bb2af8700 1 -- 172.21.15.1:0/816912221 shutdown_connections 2023-11-15T01:38:53.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.959+0000 7f8bb2af8700 1 --2- 172.21.15.1:0/816912221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bac154300 0x7f8bac0c45d0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.959+0000 7f8bb2af8700 1 -- 172.21.15.1:0/816912221 >> 172.21.15.1:0/816912221 conn(0x7f8bac0c7e00 msgr2=0x7f8bac0c3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:53.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.959+0000 7f8bb2af8700 1 -- 172.21.15.1:0/816912221 shutdown_connections 2023-11-15T01:38:53.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.959+0000 7f8bb2af8700 1 -- 172.21.15.1:0/816912221 wait complete. 2023-11-15T01:38:53.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.960+0000 7f8bb2af8700 1 Processor -- start 2023-11-15T01:38:53.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.960+0000 7f8bb2af8700 1 -- start start 2023-11-15T01:38:53.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb2af8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bac154300 0x7f8bac1430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb2af8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8bac1546e0 0x7f8bac0c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb2af8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bac158b30 0x7f8bac0c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb2af8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac0c34d0 con 0x7f8bac158b30 2023-11-15T01:38:53.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb2af8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac157e40 con 0x7f8bac154300 2023-11-15T01:38:53.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb2af8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac1565f0 con 0x7f8bac1546e0 2023-11-15T01:38:53.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb22f7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bac158b30 0x7f8bac0c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb22f7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bac158b30 0x7f8bac0c2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34258/0 (socket says 172.21.15.1:34258) 2023-11-15T01:38:53.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb22f7700 1 -- 172.21.15.1:0/329246385 learned_addr learned my addr 172.21.15.1:0/329246385 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:53.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb1af6700 1 --2- 172.21.15.1:0/329246385 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bac154300 0x7f8bac1430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb12f5700 1 --2- 172.21.15.1:0/329246385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8bac1546e0 0x7f8bac0c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb22f7700 1 -- 172.21.15.1:0/329246385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8bac1546e0 msgr2=0x7f8bac0c2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb22f7700 1 --2- 172.21.15.1:0/329246385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8bac1546e0 0x7f8bac0c2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb22f7700 1 -- 172.21.15.1:0/329246385 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bac154300 msgr2=0x7f8bac1430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:53.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb22f7700 1 --2- 172.21.15.1:0/329246385 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bac154300 0x7f8bac1430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:53.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb22f7700 1 -- 172.21.15.1:0/329246385 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba40092a0 con 0x7f8bac158b30 2023-11-15T01:38:53.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb12f5700 1 --2- 172.21.15.1:0/329246385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8bac1546e0 0x7f8bac0c2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:38:53.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb22f7700 1 --2- 172.21.15.1:0/329246385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bac158b30 0x7f8bac0c2fe0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f8b9c00c7e0 tx=0x7f8b9c007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:53.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8ba9ffb700 1 -- 172.21.15.1:0/329246385 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c005d30 con 0x7f8bac158b30 2023-11-15T01:38:53.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8ba9ffb700 1 -- 172.21.15.1:0/329246385 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c005e90 con 0x7f8bac158b30 2023-11-15T01:38:53.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.961+0000 7f8bb2af8700 1 -- 172.21.15.1:0/329246385 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bac0be430 con 0x7f8bac158b30 2023-11-15T01:38:53.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.962+0000 7f8ba9ffb700 1 -- 172.21.15.1:0/329246385 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c007320 con 0x7f8bac158b30 2023-11-15T01:38:53.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.962+0000 7f8bb2af8700 1 -- 172.21.15.1:0/329246385 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bac0be680 con 0x7f8bac158b30 2023-11-15T01:38:53.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.963+0000 7f8bb2af8700 1 -- 172.21.15.1:0/329246385 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bac0475e0 con 0x7f8bac158b30 2023-11-15T01:38:53.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.963+0000 7f8ba9ffb700 1 -- 172.21.15.1:0/329246385 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8b9c007710 con 0x7f8bac158b30 2023-11-15T01:38:53.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.963+0000 7f8ba9ffb700 1 --2- 172.21.15.1:0/329246385 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b9805f270 0x7f8b98061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:53.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.963+0000 7f8ba9ffb700 1 -- 172.21.15.1:0/329246385 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f8b9c07a480 con 0x7f8bac158b30 2023-11-15T01:38:53.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.963+0000 7f8bb1af6700 1 --2- 172.21.15.1:0/329246385 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b9805f270 0x7f8b98061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:53.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.964+0000 7f8bb1af6700 1 --2- 172.21.15.1:0/329246385 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b9805f270 0x7f8b98061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f8ba400b2e0 tx=0x7f8ba4017000).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:53.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:53.967+0000 7f8ba9ffb700 1 -- 172.21.15.1:0/329246385 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8b9c04b4c0 con 0x7f8bac158b30 2023-11-15T01:38:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:54.211+0000 7f8bb2af8700 1 -- 172.21.15.1:0/329246385 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f8bac06b5e0 con 0x7f8bac158b30 2023-11-15T01:38:55.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.164+0000 7f8ba9ffb700 1 -- 172.21.15.1:0/329246385 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v642) v1 ==== 183+0+0 (secure 0 0 0) 0x7f8b9c04eae0 con 0x7f8bac158b30 2023-11-15T01:38:55.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.167+0000 7f8bb2af8700 1 -- 172.21.15.1:0/329246385 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b9805f270 msgr2=0x7f8b98061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:55.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.167+0000 7f8bb2af8700 1 --2- 172.21.15.1:0/329246385 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b9805f270 0x7f8b98061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f8ba400b2e0 tx=0x7f8ba4017000).stop 2023-11-15T01:38:55.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.167+0000 7f8bb2af8700 1 -- 172.21.15.1:0/329246385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bac158b30 msgr2=0x7f8bac0c2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:55.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.167+0000 7f8bb2af8700 1 --2- 172.21.15.1:0/329246385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bac158b30 0x7f8bac0c2fe0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f8b9c00c7e0 tx=0x7f8b9c007f90).stop 2023-11-15T01:38:55.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.167+0000 7f8bb2af8700 1 -- 172.21.15.1:0/329246385 shutdown_connections 2023-11-15T01:38:55.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.167+0000 7f8bb2af8700 1 --2- 172.21.15.1:0/329246385 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b9805f270 0x7f8b98061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:55.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.167+0000 7f8bb2af8700 1 --2- 172.21.15.1:0/329246385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bac158b30 0x7f8bac0c2fe0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:55.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.167+0000 7f8bb2af8700 1 --2- 172.21.15.1:0/329246385 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bac154300 0x7f8bac1430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:55.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.167+0000 7f8bb2af8700 1 --2- 172.21.15.1:0/329246385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8bac1546e0 0x7f8bac0c2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:55.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.167+0000 7f8bb2af8700 1 -- 172.21.15.1:0/329246385 >> 172.21.15.1:0/329246385 conn(0x7f8bac0c7e00 msgr2=0x7f8bac158240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:55.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.167+0000 7f8bb2af8700 1 -- 172.21.15.1:0/329246385 shutdown_connections 2023-11-15T01:38:55.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.167+0000 7f8bb2af8700 1 -- 172.21.15.1:0/329246385 wait complete. 2023-11-15T01:38:55.183 INFO:tasks.cephfs_test_runner:Test that a non-existent path leads to schedule deactivation after a few retries. ... ok 2023-11-15T01:38:55.183 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-11-15T01:38:55.184 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-15T01:38:55.184 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-11-15T01:38:55.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.307+0000 7f1eb3cbc700 1 Processor -- start 2023-11-15T01:38:55.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.307+0000 7f1eb3cbc700 1 -- start start 2023-11-15T01:38:55.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb3cbc700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1eac154450 0x7f1eac0a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:55.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb3cbc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1eac0833a0 0x7f1eac154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:55.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb3cbc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1eac0bde10 0x7f1eac0be2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:55.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb3cbc700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eac065940 con 0x7f1eac0833a0 2023-11-15T01:38:55.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb3cbc700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eac0be790 con 0x7f1eac154450 2023-11-15T01:38:55.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb3cbc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0a85e0 con 0x7f1eac0bde10 2023-11-15T01:38:55.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb1257700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1eac0833a0 0x7f1eac154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:55.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb1257700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1eac0833a0 0x7f1eac154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34262/0 (socket says 172.21.15.1:34262) 2023-11-15T01:38:55.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb1257700 1 -- 172.21.15.1:0/2108988667 learned_addr learned my addr 172.21.15.1:0/2108988667 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:55.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb2259700 1 --2- 172.21.15.1:0/2108988667 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1eac0bde10 0x7f1eac0be2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:55.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb1a58700 1 --2- 172.21.15.1:0/2108988667 >> v2:172.21.15.141:3300/0 conn(0x7f1eac154450 0x7f1eac0a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:55.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb1257700 1 -- 172.21.15.1:0/2108988667 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1eac0bde10 msgr2=0x7f1eac0be2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:55.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb1257700 1 --2- 172.21.15.1:0/2108988667 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1eac0bde10 0x7f1eac0be2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb1257700 1 -- 172.21.15.1:0/2108988667 >> v2:172.21.15.141:3300/0 conn(0x7f1eac154450 msgr2=0x7f1eac0a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb1257700 1 --2- 172.21.15.1:0/2108988667 >> v2:172.21.15.141:3300/0 conn(0x7f1eac154450 0x7f1eac0a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.308+0000 7f1eb1257700 1 -- 172.21.15.1:0/2108988667 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac065660 con 0x7f1eac0833a0 2023-11-15T01:38:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.309+0000 7f1eb1257700 1 --2- 172.21.15.1:0/2108988667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1eac0833a0 0x7f1eac154830 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f1eac066140 tx=0x7f1ea00090f0).ready entity=mon.0 client_cookie=c9da0a3eec4892c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.309+0000 7f1eb0a56700 1 -- 172.21.15.1:0/2108988667 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea000f510 con 0x7f1eac0833a0 2023-11-15T01:38:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.309+0000 7f1eb0a56700 1 -- 172.21.15.1:0/2108988667 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea000f670 con 0x7f1eac0833a0 2023-11-15T01:38:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.309+0000 7f1eb0a56700 1 -- 172.21.15.1:0/2108988667 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea000f9f0 con 0x7f1eac0833a0 2023-11-15T01:38:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.309+0000 7f1eb3cbc700 1 -- 172.21.15.1:0/2108988667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1eac0833a0 msgr2=0x7f1eac154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.309+0000 7f1eb3cbc700 1 --2- 172.21.15.1:0/2108988667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1eac0833a0 0x7f1eac154830 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f1eac066140 tx=0x7f1ea00090f0).stop 2023-11-15T01:38:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.309+0000 7f1eb3cbc700 1 -- 172.21.15.1:0/2108988667 shutdown_connections 2023-11-15T01:38:55.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.309+0000 7f1eb3cbc700 1 --2- 172.21.15.1:0/2108988667 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1eac0bde10 0x7f1eac0be2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:55.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.309+0000 7f1eb3cbc700 1 --2- 172.21.15.1:0/2108988667 >> v2:172.21.15.141:3300/0 conn(0x7f1eac154450 0x7f1eac0a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:55.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.309+0000 7f1eb3cbc700 1 --2- 172.21.15.1:0/2108988667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1eac0833a0 0x7f1eac154830 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.309+0000 7f1eb3cbc700 1 -- 172.21.15.1:0/2108988667 >> 172.21.15.1:0/2108988667 conn(0x7f1eac082f90 msgr2=0x7f1eac0c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.309+0000 7f1eb3cbc700 1 -- 172.21.15.1:0/2108988667 shutdown_connections 2023-11-15T01:38:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.309+0000 7f1eb3cbc700 1 -- 172.21.15.1:0/2108988667 wait complete. 2023-11-15T01:38:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.310+0000 7f1eb3cbc700 1 Processor -- start 2023-11-15T01:38:55.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.310+0000 7f1eb3cbc700 1 -- start start 2023-11-15T01:38:55.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.311+0000 7f1eb3cbc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1eac0833a0 0x7f1eac154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:55.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.311+0000 7f1eb3cbc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1eac0bde10 0x7f1eac14ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:55.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.311+0000 7f1eb3cbc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1eac154450 0x7f1eac0abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:55.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.311+0000 7f1eb3cbc700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac068220 con 0x7f1eac0833a0 2023-11-15T01:38:55.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.311+0000 7f1eb3cbc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0ae760 con 0x7f1eac0bde10 2023-11-15T01:38:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.311+0000 7f1eb3cbc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0aea40 con 0x7f1eac154450 2023-11-15T01:38:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.311+0000 7f1eb1a58700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1eac0833a0 0x7f1eac154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.311+0000 7f1eb1a58700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1eac0833a0 0x7f1eac154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34274/0 (socket says 172.21.15.1:34274) 2023-11-15T01:38:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.311+0000 7f1eb1a58700 1 -- 172.21.15.1:0/4080495547 learned_addr learned my addr 172.21.15.1:0/4080495547 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.311+0000 7f1eb1257700 1 --2- 172.21.15.1:0/4080495547 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1eac0bde10 0x7f1eac14ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.311+0000 7f1eb2259700 1 --2- 172.21.15.1:0/4080495547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1eac154450 0x7f1eac0abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.312+0000 7f1eb1a58700 1 -- 172.21.15.1:0/4080495547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1eac154450 msgr2=0x7f1eac0abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.312+0000 7f1eb1a58700 1 --2- 172.21.15.1:0/4080495547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1eac154450 0x7f1eac0abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.312+0000 7f1eb1a58700 1 -- 172.21.15.1:0/4080495547 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1eac0bde10 msgr2=0x7f1eac14ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:55.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.312+0000 7f1eb1a58700 1 --2- 172.21.15.1:0/4080495547 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1eac0bde10 0x7f1eac14ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:55.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.312+0000 7f1eb1a58700 1 -- 172.21.15.1:0/4080495547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea0009370 con 0x7f1eac0833a0 2023-11-15T01:38:55.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.312+0000 7f1eb2259700 1 --2- 172.21.15.1:0/4080495547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1eac154450 0x7f1eac0abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:38:55.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.312+0000 7f1eb1a58700 1 --2- 172.21.15.1:0/4080495547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1eac0833a0 0x7f1eac154db0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f1ea400e8d0 tx=0x7f1ea4006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:55.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.312+0000 7f1ea9ffb700 1 -- 172.21.15.1:0/4080495547 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4012600 con 0x7f1eac0833a0 2023-11-15T01:38:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.312+0000 7f1ea9ffb700 1 -- 172.21.15.1:0/4080495547 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea4012760 con 0x7f1eac0833a0 2023-11-15T01:38:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.312+0000 7f1eb3cbc700 1 -- 172.21.15.1:0/4080495547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eac0aed20 con 0x7f1eac0833a0 2023-11-15T01:38:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.312+0000 7f1ea9ffb700 1 -- 172.21.15.1:0/4080495547 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4012ae0 con 0x7f1eac0833a0 2023-11-15T01:38:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.312+0000 7f1eb3cbc700 1 -- 172.21.15.1:0/4080495547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eac0a6040 con 0x7f1eac0833a0 2023-11-15T01:38:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.313+0000 7f1eb3cbc700 1 -- 172.21.15.1:0/4080495547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eac06c7e0 con 0x7f1eac0833a0 2023-11-15T01:38:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.313+0000 7f1ea9ffb700 1 -- 172.21.15.1:0/4080495547 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1ea401b400 con 0x7f1eac0833a0 2023-11-15T01:38:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.314+0000 7f1ea9ffb700 1 --2- 172.21.15.1:0/4080495547 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e9805f270 0x7f1e98061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.314+0000 7f1ea9ffb700 1 -- 172.21.15.1:0/4080495547 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f1ea407a790 con 0x7f1eac0833a0 2023-11-15T01:38:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.314+0000 7f1eb1257700 1 --2- 172.21.15.1:0/4080495547 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e9805f270 0x7f1e98061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.314+0000 7f1eb1257700 1 --2- 172.21.15.1:0/4080495547 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e9805f270 0x7f1e98061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f1ea0009130 tx=0x7f1ea0017000).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:55.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.318+0000 7f1ea9ffb700 1 -- 172.21.15.1:0/4080495547 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1ea404b7d0 con 0x7f1eac0833a0 2023-11-15T01:38:55.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:55.559+0000 7f1eb3cbc700 1 -- 172.21.15.1:0/4080495547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f1eac05f8b0 con 0x7f1eac0833a0 2023-11-15T01:38:56.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.166+0000 7f1ea9ffb700 1 -- 172.21.15.1:0/4080495547 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v643) v1 ==== 151+0+0 (secure 0 0 0) 0x7f1ea4016020 con 0x7f1eac0833a0 2023-11-15T01:38:56.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.168+0000 7f1eb3cbc700 1 -- 172.21.15.1:0/4080495547 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e9805f270 msgr2=0x7f1e98061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:56.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.168+0000 7f1eb3cbc700 1 --2- 172.21.15.1:0/4080495547 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e9805f270 0x7f1e98061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f1ea0009130 tx=0x7f1ea0017000).stop 2023-11-15T01:38:56.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.168+0000 7f1eb3cbc700 1 -- 172.21.15.1:0/4080495547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1eac0833a0 msgr2=0x7f1eac154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:56.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.168+0000 7f1eb3cbc700 1 --2- 172.21.15.1:0/4080495547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1eac0833a0 0x7f1eac154db0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f1ea400e8d0 tx=0x7f1ea4006f40).stop 2023-11-15T01:38:56.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.169+0000 7f1eb3cbc700 1 -- 172.21.15.1:0/4080495547 shutdown_connections 2023-11-15T01:38:56.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.169+0000 7f1eb3cbc700 1 --2- 172.21.15.1:0/4080495547 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e9805f270 0x7f1e98061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.169+0000 7f1eb3cbc700 1 --2- 172.21.15.1:0/4080495547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1eac154450 0x7f1eac0abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.169+0000 7f1eb3cbc700 1 --2- 172.21.15.1:0/4080495547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1eac0833a0 0x7f1eac154db0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.169+0000 7f1eb3cbc700 1 --2- 172.21.15.1:0/4080495547 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1eac0bde10 0x7f1eac14ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.169+0000 7f1eb3cbc700 1 -- 172.21.15.1:0/4080495547 >> 172.21.15.1:0/4080495547 conn(0x7f1eac082f90 msgr2=0x7f1eac064340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:56.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.169+0000 7f1eb3cbc700 1 -- 172.21.15.1:0/4080495547 shutdown_connections 2023-11-15T01:38:56.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.169+0000 7f1eb3cbc700 1 -- 172.21.15.1:0/4080495547 wait complete. 2023-11-15T01:38:56.185 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-15T01:38:56.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.310+0000 7f779cf18700 1 Processor -- start 2023-11-15T01:38:56.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.311+0000 7f779cf18700 1 -- start start 2023-11-15T01:38:56.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.311+0000 7f779cf18700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f77981540a0 0x7f77980ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:56.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.311+0000 7f779cf18700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77980c6650 0x7f77980ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:56.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.311+0000 7f779cf18700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77980ca050 con 0x7f7798154480 2023-11-15T01:38:56.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f779cf18700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77980c9440 con 0x7f77981540a0 2023-11-15T01:38:56.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f779cf18700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77980c9720 con 0x7f77980c6650 2023-11-15T01:38:56.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f779659c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f77981540a0 0x7f77980ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:56.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f7795d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7798154480 0x7f77980c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49436/0 (socket says 172.21.15.1:49436) 2023-11-15T01:38:56.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f779659c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f77981540a0 0x7f77980ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34276/0 (socket says 172.21.15.1:34276) 2023-11-15T01:38:56.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f7795d9b700 1 -- 172.21.15.1:0/2816658390 learned_addr learned my addr 172.21.15.1:0/2816658390 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:56.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f7796d9d700 1 --2- 172.21.15.1:0/2816658390 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77980c6650 0x7f77980ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:56.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f779659c700 1 -- 172.21.15.1:0/2816658390 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77980c6650 msgr2=0x7f77980ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:56.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f779659c700 1 --2- 172.21.15.1:0/2816658390 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77980c6650 0x7f77980ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f779659c700 1 -- 172.21.15.1:0/2816658390 >> v1:172.21.15.1:6789/0 conn(0x7f7798154480 legacy=0x7f77980c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:56.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f779559a700 1 -- 172.21.15.1:0/2816658390 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734267279 0 0) 0x7f77980ca050 con 0x7f7798154480 2023-11-15T01:38:56.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f779659c700 1 -- 172.21.15.1:0/2816658390 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77980c9a00 con 0x7f77981540a0 2023-11-15T01:38:56.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f779659c700 1 --2- 172.21.15.1:0/2816658390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77981540a0 0x7f77980ca4e0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f7790009760 tx=0x7f7790009060).ready entity=mon.0 client_cookie=e1aecfe5b0f0d30 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:56.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f779559a700 1 -- 172.21.15.1:0/2816658390 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779000f510 con 0x7f77981540a0 2023-11-15T01:38:56.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f779559a700 1 -- 172.21.15.1:0/2816658390 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779000f670 con 0x7f77981540a0 2023-11-15T01:38:56.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.312+0000 7f779559a700 1 -- 172.21.15.1:0/2816658390 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779000f9f0 con 0x7f77981540a0 2023-11-15T01:38:56.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.313+0000 7f779cf18700 1 -- 172.21.15.1:0/2816658390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77981540a0 msgr2=0x7f77980ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:56.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.313+0000 7f779cf18700 1 --2- 172.21.15.1:0/2816658390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77981540a0 0x7f77980ca4e0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f7790009760 tx=0x7f7790009060).stop 2023-11-15T01:38:56.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.313+0000 7f779cf18700 1 -- 172.21.15.1:0/2816658390 shutdown_connections 2023-11-15T01:38:56.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.313+0000 7f779cf18700 1 --2- 172.21.15.1:0/2816658390 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77980c6650 0x7f77980ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.313+0000 7f779cf18700 1 --2- 172.21.15.1:0/2816658390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77981540a0 0x7f77980ca4e0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.313+0000 7f779cf18700 1 -- 172.21.15.1:0/2816658390 >> 172.21.15.1:0/2816658390 conn(0x7f7798064a70 msgr2=0x7f7798064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:56.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.313+0000 7f779cf18700 1 -- 172.21.15.1:0/2816658390 shutdown_connections 2023-11-15T01:38:56.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.313+0000 7f779cf18700 1 -- 172.21.15.1:0/2816658390 wait complete. 2023-11-15T01:38:56.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.314+0000 7f779cf18700 1 Processor -- start 2023-11-15T01:38:56.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.314+0000 7f779cf18700 1 -- start start 2023-11-15T01:38:56.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779cf18700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77980c6650 0x7f7798156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:56.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779cf18700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77981540a0 0x7f77981571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:56.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779cf18700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7798154480 0x7f7798158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:56.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779cf18700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77981576b0 con 0x7f77980c6650 2023-11-15T01:38:56.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779cf18700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77980c4670 con 0x7f7798154480 2023-11-15T01:38:56.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779cf18700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77980aeb10 con 0x7f77981540a0 2023-11-15T01:38:56.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77980c6650 0x7f7798156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:56.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77980c6650 0x7f7798156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34280/0 (socket says 172.21.15.1:34280) 2023-11-15T01:38:56.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779659c700 1 -- 172.21.15.1:0/2099455202 learned_addr learned my addr 172.21.15.1:0/2099455202 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:56.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f7795d9b700 1 --2- 172.21.15.1:0/2099455202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77981540a0 0x7f77981571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:56.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f7796d9d700 1 --2- 172.21.15.1:0/2099455202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7798154480 0x7f7798158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:56.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779659c700 1 -- 172.21.15.1:0/2099455202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77981540a0 msgr2=0x7f77981571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:56.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779659c700 1 --2- 172.21.15.1:0/2099455202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77981540a0 0x7f77981571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779659c700 1 -- 172.21.15.1:0/2099455202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7798154480 msgr2=0x7f7798158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:56.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779659c700 1 --2- 172.21.15.1:0/2099455202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7798154480 0x7f7798158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779659c700 1 -- 172.21.15.1:0/2099455202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77900092a0 con 0x7f77980c6650 2023-11-15T01:38:56.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779659c700 1 --2- 172.21.15.1:0/2099455202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77980c6650 0x7f7798156cd0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f77980c2070 tx=0x7f7790017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:56.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f778e7fc700 1 -- 172.21.15.1:0/2099455202 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779000f7e0 con 0x7f77980c6650 2023-11-15T01:38:56.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f778e7fc700 1 -- 172.21.15.1:0/2099455202 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779000f960 con 0x7f77980c6650 2023-11-15T01:38:56.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.315+0000 7f779cf18700 1 -- 172.21.15.1:0/2099455202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77980aedf0 con 0x7f77980c6650 2023-11-15T01:38:56.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.316+0000 7f778e7fc700 1 -- 172.21.15.1:0/2099455202 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779001b660 con 0x7f77980c6650 2023-11-15T01:38:56.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.316+0000 7f779cf18700 1 -- 172.21.15.1:0/2099455202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77980af3b0 con 0x7f77980c6650 2023-11-15T01:38:56.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.317+0000 7f779cf18700 1 -- 172.21.15.1:0/2099455202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77980af720 con 0x7f77980c6650 2023-11-15T01:38:56.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.317+0000 7f778e7fc700 1 -- 172.21.15.1:0/2099455202 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f779001b9d0 con 0x7f77980c6650 2023-11-15T01:38:56.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.317+0000 7f778e7fc700 1 --2- 172.21.15.1:0/2099455202 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f777805f270 0x7f7778061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:56.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.317+0000 7f778e7fc700 1 -- 172.21.15.1:0/2099455202 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f779007bf80 con 0x7f77980c6650 2023-11-15T01:38:56.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.317+0000 7f7795d9b700 1 --2- 172.21.15.1:0/2099455202 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f777805f270 0x7f7778061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:56.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.318+0000 7f7795d9b700 1 --2- 172.21.15.1:0/2099455202 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f777805f270 0x7f7778061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f77980c5170 tx=0x7f7780009040).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:56.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.321+0000 7f778e7fc700 1 -- 172.21.15.1:0/2099455202 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f77900aaaf0 con 0x7f77980c6650 2023-11-15T01:38:56.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.495+0000 7f779cf18700 1 -- 172.21.15.1:0/2099455202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f779806c7e0 con 0x7f77980c6650 2023-11-15T01:38:56.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.498+0000 7f778e7fc700 1 -- 172.21.15.1:0/2099455202 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f779004d020 con 0x7f77980c6650 2023-11-15T01:38:56.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.500+0000 7f779cf18700 1 -- 172.21.15.1:0/2099455202 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f777805f270 msgr2=0x7f7778061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:56.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.500+0000 7f779cf18700 1 --2- 172.21.15.1:0/2099455202 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f777805f270 0x7f7778061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f77980c5170 tx=0x7f7780009040).stop 2023-11-15T01:38:56.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.500+0000 7f779cf18700 1 -- 172.21.15.1:0/2099455202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77980c6650 msgr2=0x7f7798156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:56.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.500+0000 7f779cf18700 1 --2- 172.21.15.1:0/2099455202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77980c6650 0x7f7798156cd0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f77980c2070 tx=0x7f7790017000).stop 2023-11-15T01:38:56.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.500+0000 7f779cf18700 1 -- 172.21.15.1:0/2099455202 shutdown_connections 2023-11-15T01:38:56.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.500+0000 7f779cf18700 1 --2- 172.21.15.1:0/2099455202 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f777805f270 0x7f7778061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.500+0000 7f779cf18700 1 --2- 172.21.15.1:0/2099455202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7798154480 0x7f7798158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.500+0000 7f779cf18700 1 --2- 172.21.15.1:0/2099455202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77980c6650 0x7f7798156cd0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.500+0000 7f779cf18700 1 --2- 172.21.15.1:0/2099455202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77981540a0 0x7f77981571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.500+0000 7f779cf18700 1 -- 172.21.15.1:0/2099455202 >> 172.21.15.1:0/2099455202 conn(0x7f7798064a70 msgr2=0x7f77980cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:56.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.500+0000 7f779cf18700 1 -- 172.21.15.1:0/2099455202 shutdown_connections 2023-11-15T01:38:56.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.500+0000 7f779cf18700 1 -- 172.21.15.1:0/2099455202 wait complete. 2023-11-15T01:38:56.514 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T01:38:56.515 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:38:56.551 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:38:56.595 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T01:38:56.596 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-15T01:38:56.596 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:38:56.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.712+0000 7fd4be72d700 1 Processor -- start 2023-11-15T01:38:56.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.712+0000 7fd4be72d700 1 -- start start 2023-11-15T01:38:56.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.713+0000 7fd4be72d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd4b80ab1a0 0x7fd4b8154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:56.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.713+0000 7fd4be72d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b80c06f0 con 0x7fd4b80aa060 2023-11-15T01:38:56.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.713+0000 7fd4be72d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b80c09d0 con 0x7fd4b8154150 2023-11-15T01:38:56.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.713+0000 7fd4be72d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b8158820 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.713+0000 7fd4bccca700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd4b80aa060 0x7fd4b80c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49440/0 (socket says 172.21.15.1:49440) 2023-11-15T01:38:56.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.713+0000 7fd4bccca700 1 -- 172.21.15.1:0/1986142680 learned_addr learned my addr 172.21.15.1:0/1986142680 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:56.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.713+0000 7fd4b77fe700 1 --2- 172.21.15.1:0/1986142680 >> v2:172.21.15.141:3300/0 conn(0x7fd4b80ab1a0 0x7fd4b8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:56.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.713+0000 7fd4b6ffd700 1 -- 172.21.15.1:0/1986142680 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465998780 0 0) 0x7fd4b80c06f0 con 0x7fd4b80aa060 2023-11-15T01:38:56.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.714+0000 7fd4b6ffd700 1 -- 172.21.15.1:0/1986142680 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4a40033f0 con 0x7fd4b80aa060 2023-11-15T01:38:56.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.714+0000 7fd4b6ffd700 1 -- 172.21.15.1:0/1986142680 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 543384698 0 0) 0x7fd4a40033f0 con 0x7fd4b80aa060 2023-11-15T01:38:56.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.714+0000 7fd4b77fe700 1 -- 172.21.15.1:0/1986142680 >> v1:172.21.15.141:6789/0 conn(0x7fd4b8154150 legacy=0x7fd4b8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:56.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.714+0000 7fd4b77fe700 1 -- 172.21.15.1:0/1986142680 >> v1:172.21.15.1:6789/0 conn(0x7fd4b80aa060 legacy=0x7fd4b80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:56.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.714+0000 7fd4b77fe700 1 -- 172.21.15.1:0/1986142680 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b8158b00 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.714+0000 7fd4b77fe700 1 --2- 172.21.15.1:0/1986142680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4b80ab1a0 0x7fd4b8154530 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fd4a0009760 tx=0x7fd4a0009060).ready entity=mon.1 client_cookie=7807976694b091a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:56.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.714+0000 7fd4b6ffd700 1 -- 172.21.15.1:0/1986142680 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00017f0 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.714+0000 7fd4b6ffd700 1 -- 172.21.15.1:0/1986142680 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a0009130 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.714+0000 7fd4b6ffd700 1 -- 172.21.15.1:0/1986142680 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0011610 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.715+0000 7fd4be72d700 1 -- 172.21.15.1:0/1986142680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4b80ab1a0 msgr2=0x7fd4b8154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:56.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.715+0000 7fd4be72d700 1 --2- 172.21.15.1:0/1986142680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4b80ab1a0 0x7fd4b8154530 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fd4a0009760 tx=0x7fd4a0009060).stop 2023-11-15T01:38:56.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.715+0000 7fd4be72d700 1 -- 172.21.15.1:0/1986142680 shutdown_connections 2023-11-15T01:38:56.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.715+0000 7fd4be72d700 1 --2- 172.21.15.1:0/1986142680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4b80ab1a0 0x7fd4b8154530 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.715+0000 7fd4be72d700 1 -- 172.21.15.1:0/1986142680 >> 172.21.15.1:0/1986142680 conn(0x7fd4b8064aa0 msgr2=0x7fd4b8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:56.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.715+0000 7fd4be72d700 1 -- 172.21.15.1:0/1986142680 shutdown_connections 2023-11-15T01:38:56.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.715+0000 7fd4be72d700 1 -- 172.21.15.1:0/1986142680 wait complete. 2023-11-15T01:38:56.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.716+0000 7fd4be72d700 1 Processor -- start 2023-11-15T01:38:56.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.716+0000 7fd4be72d700 1 -- start start 2023-11-15T01:38:56.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4be72d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4b80aa060 0x7fd4b814c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:56.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4be72d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4b80ab1a0 0x7fd4b8167c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:56.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4be72d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b8154150 0x7fd4b80ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:56.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4be72d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b8168490 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4be72d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b8168770 con 0x7fd4b80aa060 2023-11-15T01:38:56.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4be72d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b80af2f0 con 0x7fd4b8154150 2023-11-15T01:38:56.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4b77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4b80ab1a0 0x7fd4b8167c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:56.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4b77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4b80ab1a0 0x7fd4b8167c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34288/0 (socket says 172.21.15.1:34288) 2023-11-15T01:38:56.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4b77fe700 1 -- 172.21.15.1:0/146527689 learned_addr learned my addr 172.21.15.1:0/146527689 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:56.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4bccca700 1 --2- 172.21.15.1:0/146527689 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b8154150 0x7fd4b80ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:56.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4b7fff700 1 --2- 172.21.15.1:0/146527689 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4b80aa060 0x7fd4b814c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:56.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4b77fe700 1 -- 172.21.15.1:0/146527689 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b8154150 msgr2=0x7fd4b80ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:56.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4b77fe700 1 --2- 172.21.15.1:0/146527689 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b8154150 0x7fd4b80ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4b77fe700 1 -- 172.21.15.1:0/146527689 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4b80aa060 msgr2=0x7fd4b814c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:56.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4b77fe700 1 --2- 172.21.15.1:0/146527689 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4b80aa060 0x7fd4b814c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4b77fe700 1 -- 172.21.15.1:0/146527689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a00092a0 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4b77fe700 1 --2- 172.21.15.1:0/146527689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4b80ab1a0 0x7fd4b8167c40 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7fd4a0009e00 tx=0x7fd4a0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:56.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.717+0000 7fd4affff700 1 -- 172.21.15.1:0/146527689 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0010840 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.718+0000 7fd4affff700 1 -- 172.21.15.1:0/146527689 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a00109a0 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.718+0000 7fd4be72d700 1 -- 172.21.15.1:0/146527689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b80af5d0 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.718+0000 7fd4affff700 1 -- 172.21.15.1:0/146527689 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0010d20 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.718+0000 7fd4be72d700 1 -- 172.21.15.1:0/146527689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b8168130 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.719+0000 7fd4be72d700 1 -- 172.21.15.1:0/146527689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b80af7e0 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.719+0000 7fd4affff700 1 -- 172.21.15.1:0/146527689 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd4a0018070 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.719+0000 7fd4affff700 1 --2- 172.21.15.1:0/146527689 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd49805f270 0x7fd498061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:56.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.719+0000 7fd4affff700 1 -- 172.21.15.1:0/146527689 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6295+0+0 (secure 0 0 0) 0x7fd4a007b8e0 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.719+0000 7fd4b7fff700 1 --2- 172.21.15.1:0/146527689 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd49805f270 0x7fd498061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:56.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.720+0000 7fd4b7fff700 1 --2- 172.21.15.1:0/146527689 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd49805f270 0x7fd498061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd4a8003860 tx=0x7fd4a8007d40).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:56.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.723+0000 7fd4affff700 1 -- 172.21.15.1:0/146527689 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd4a004c980 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.936+0000 7fd4be72d700 1 -- 172.21.15.1:0/146527689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4b8158de0 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.936+0000 7fd4affff700 1 -- 172.21.15.1:0/146527689 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fd4a0016020 con 0x7fd4b80ab1a0 2023-11-15T01:38:56.938 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:38:56.938 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":49,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6035,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2141857111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2141857111},{"type":"v1","addr":"172.21.15.141:6836","nonce":2141857111}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/1337499503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1337499503},{"type":"v1","addr":"172.21.15.141:6837","nonce":1337499503}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7140,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3686794692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3686794692},{"type":"v1","addr":"172.21.15.1:6834","nonce":3686794692}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7143,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1233089645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1233089645},{"type":"v1","addr":"172.21.15.1:6835","nonce":1233089645}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[]} 2023-11-15T01:38:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.938+0000 7fd4be72d700 1 -- 172.21.15.1:0/146527689 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd49805f270 msgr2=0x7fd498061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.938+0000 7fd4be72d700 1 --2- 172.21.15.1:0/146527689 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd49805f270 0x7fd498061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd4a8003860 tx=0x7fd4a8007d40).stop 2023-11-15T01:38:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.938+0000 7fd4be72d700 1 -- 172.21.15.1:0/146527689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4b80ab1a0 msgr2=0x7fd4b8167c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.938+0000 7fd4be72d700 1 --2- 172.21.15.1:0/146527689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4b80ab1a0 0x7fd4b8167c40 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7fd4a0009e00 tx=0x7fd4a0014000).stop 2023-11-15T01:38:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.938+0000 7fd4be72d700 1 -- 172.21.15.1:0/146527689 shutdown_connections 2023-11-15T01:38:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.938+0000 7fd4be72d700 1 --2- 172.21.15.1:0/146527689 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd49805f270 0x7fd498061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.938+0000 7fd4be72d700 1 --2- 172.21.15.1:0/146527689 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b8154150 0x7fd4b80ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.938+0000 7fd4be72d700 1 --2- 172.21.15.1:0/146527689 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4b80aa060 0x7fd4b814c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.938+0000 7fd4be72d700 1 --2- 172.21.15.1:0/146527689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4b80ab1a0 0x7fd4b8167c40 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:56.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.938+0000 7fd4be72d700 1 -- 172.21.15.1:0/146527689 >> 172.21.15.1:0/146527689 conn(0x7fd4b8064aa0 msgr2=0x7fd4b80ad590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:56.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.938+0000 7fd4be72d700 1 -- 172.21.15.1:0/146527689 shutdown_connections 2023-11-15T01:38:56.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:56.938+0000 7fd4be72d700 1 -- 172.21.15.1:0/146527689 wait complete. 2023-11-15T01:38:56.942 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 49 2023-11-15T01:38:56.952 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-15T01:38:56.952 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-15T01:38:56.952 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-15T01:38:56.953 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:38:56.953 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-15T01:38:56.953 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-15T01:38:56.954 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-15T01:38:56.954 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:38:56.954 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-15T01:38:56.955 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-15T01:38:56.955 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-15T01:38:56.955 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:38:56.955 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-15T01:38:56.956 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-15T01:38:56.956 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-15T01:38:56.956 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:38:56.961 INFO:tasks.ceph.mds.a:Stopped 2023-11-15T01:38:56.961 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-15T01:38:56.963 INFO:tasks.ceph.mds.c:Stopped 2023-11-15T01:38:56.963 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-15T01:38:56.966 INFO:tasks.ceph.mds.b:Stopped 2023-11-15T01:38:56.966 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-15T01:38:56.967 INFO:tasks.ceph.mds.d:Stopped 2023-11-15T01:38:56.968 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-15T01:38:57.005 INFO:tasks.ceph.mds.a:Started 2023-11-15T01:38:57.006 DEBUG:teuthology.parallel:result is None 2023-11-15T01:38:57.006 INFO:tasks.ceph.mds.c:Started 2023-11-15T01:38:57.007 DEBUG:teuthology.parallel:result is None 2023-11-15T01:38:57.009 INFO:tasks.ceph.mds.b:Started 2023-11-15T01:38:57.009 DEBUG:teuthology.parallel:result is None 2023-11-15T01:38:57.010 INFO:tasks.ceph.mds.d:Started 2023-11-15T01:38:57.010 DEBUG:teuthology.parallel:result is None 2023-11-15T01:38:57.011 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-15T01:38:57.080 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T01:38:57.081 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-11-15T01:38:57.092 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-15T01:38:57.092 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T01:38:57.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.136+0000 7f2617748700 1 Processor -- start 2023-11-15T01:38:57.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.137+0000 7f2617748700 1 -- start start 2023-11-15T01:38:57.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.137+0000 7f2617748700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f26100a8230 0x7f26100c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:57.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.137+0000 7f2617748700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26100c39c0 0x7f26100bf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:57.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.137+0000 7f2617748700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f26100bf500 0x7f26100638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:57.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.137+0000 7f2617748700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26100835e0 con 0x7f26100a8230 2023-11-15T01:38:57.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.137+0000 7f2617748700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26100beb80 con 0x7f26100bf500 2023-11-15T01:38:57.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.137+0000 7f2617748700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26100bdfb0 con 0x7f26100c39c0 2023-11-15T01:38:57.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.138+0000 7f26154e4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f26100a8230 0x7f26100c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:57.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.138+0000 7f26154e4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f26100a8230 0x7f26100c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34324/0 (socket says 172.21.15.1:34324) 2023-11-15T01:38:57.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.138+0000 7f26154e4700 1 -- 172.21.15.1:0/3217470346 learned_addr learned my addr 172.21.15.1:0/3217470346 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:57.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.138+0000 7f2614ce3700 1 --2- 172.21.15.1:0/3217470346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26100c39c0 0x7f26100bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:57.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.138+0000 7f2615ce5700 1 --2- 172.21.15.1:0/3217470346 >> v2:172.21.15.141:3300/0 conn(0x7f26100bf500 0x7f26100638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:57.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.138+0000 7f26154e4700 1 -- 172.21.15.1:0/3217470346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26100c39c0 msgr2=0x7f26100bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:57.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.138+0000 7f26154e4700 1 --2- 172.21.15.1:0/3217470346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26100c39c0 0x7f26100bf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:57.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.138+0000 7f26154e4700 1 -- 172.21.15.1:0/3217470346 >> v2:172.21.15.141:3300/0 conn(0x7f26100bf500 msgr2=0x7f26100638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:57.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.138+0000 7f26154e4700 1 --2- 172.21.15.1:0/3217470346 >> v2:172.21.15.141:3300/0 conn(0x7f26100bf500 0x7f26100638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:57.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.138+0000 7f26154e4700 1 -- 172.21.15.1:0/3217470346 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26100bf990 con 0x7f26100a8230 2023-11-15T01:38:57.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.138+0000 7f26154e4700 1 --2- 172.21.15.1:0/3217470346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26100a8230 0x7f26100c34d0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f260c006fd0 tx=0x7f260c0090f0).ready entity=mon.0 client_cookie=dc74c4d8fa7f6459 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:57.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.138+0000 7f2607fff700 1 -- 172.21.15.1:0/3217470346 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c00b600 con 0x7f26100a8230 2023-11-15T01:38:57.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.138+0000 7f2607fff700 1 -- 172.21.15.1:0/3217470346 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c00b760 con 0x7f26100a8230 2023-11-15T01:38:57.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.138+0000 7f2607fff700 1 -- 172.21.15.1:0/3217470346 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c00bae0 con 0x7f26100a8230 2023-11-15T01:38:57.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.139+0000 7f2617748700 1 -- 172.21.15.1:0/3217470346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26100a8230 msgr2=0x7f26100c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:57.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.139+0000 7f2617748700 1 --2- 172.21.15.1:0/3217470346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26100a8230 0x7f26100c34d0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f260c006fd0 tx=0x7f260c0090f0).stop 2023-11-15T01:38:57.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.139+0000 7f2617748700 1 -- 172.21.15.1:0/3217470346 shutdown_connections 2023-11-15T01:38:57.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.139+0000 7f2617748700 1 --2- 172.21.15.1:0/3217470346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26100a8230 0x7f26100c34d0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:57.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.139+0000 7f2617748700 1 --2- 172.21.15.1:0/3217470346 >> v2:172.21.15.141:3300/0 conn(0x7f26100bf500 0x7f26100638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:57.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.139+0000 7f2617748700 1 --2- 172.21.15.1:0/3217470346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26100c39c0 0x7f26100bf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:57.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.139+0000 7f2617748700 1 -- 172.21.15.1:0/3217470346 >> 172.21.15.1:0/3217470346 conn(0x7f2610082f90 msgr2=0x7f26100c8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:57.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.139+0000 7f2617748700 1 -- 172.21.15.1:0/3217470346 shutdown_connections 2023-11-15T01:38:57.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.139+0000 7f2617748700 1 -- 172.21.15.1:0/3217470346 wait complete. 2023-11-15T01:38:57.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.140+0000 7f2617748700 1 Processor -- start 2023-11-15T01:38:57.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.140+0000 7f2617748700 1 -- start start 2023-11-15T01:38:57.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2617748700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26100a8230 0x7f26100aa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:57.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2617748700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26100bf500 0x7f26100adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:57.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2617748700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26100c39c0 0x7f2610153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:57.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2617748700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26100acfc0 con 0x7f26100bf500 2023-11-15T01:38:57.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2617748700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26100adb00 con 0x7f26100a8230 2023-11-15T01:38:57.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2617748700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26101543c0 con 0x7f26100c39c0 2023-11-15T01:38:57.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2614ce3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26100bf500 0x7f26100adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:57.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2614ce3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26100bf500 0x7f26100adf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34336/0 (socket says 172.21.15.1:34336) 2023-11-15T01:38:57.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2614ce3700 1 -- 172.21.15.1:0/376838448 learned_addr learned my addr 172.21.15.1:0/376838448 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:57.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f26154e4700 1 --2- 172.21.15.1:0/376838448 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26100a8230 0x7f26100aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:57.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2615ce5700 1 --2- 172.21.15.1:0/376838448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26100c39c0 0x7f2610153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:57.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2614ce3700 1 -- 172.21.15.1:0/376838448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26100c39c0 msgr2=0x7f2610153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:57.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2614ce3700 1 --2- 172.21.15.1:0/376838448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26100c39c0 0x7f2610153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:57.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2614ce3700 1 -- 172.21.15.1:0/376838448 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26100a8230 msgr2=0x7f26100aa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:57.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2614ce3700 1 --2- 172.21.15.1:0/376838448 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26100a8230 0x7f26100aa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:57.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2614ce3700 1 -- 172.21.15.1:0/376838448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c009370 con 0x7f26100bf500 2023-11-15T01:38:57.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.141+0000 7f2614ce3700 1 --2- 172.21.15.1:0/376838448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26100bf500 0x7f26100adf90 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f260000d8c0 tx=0x7f2600008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:57.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.142+0000 7f26057fa700 1 -- 172.21.15.1:0/376838448 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600011590 con 0x7f26100bf500 2023-11-15T01:38:57.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.142+0000 7f26057fa700 1 -- 172.21.15.1:0/376838448 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26000116f0 con 0x7f26100bf500 2023-11-15T01:38:57.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.142+0000 7f2617748700 1 -- 172.21.15.1:0/376838448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26100ae480 con 0x7f26100bf500 2023-11-15T01:38:57.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.142+0000 7f26057fa700 1 -- 172.21.15.1:0/376838448 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600011a70 con 0x7f26100bf500 2023-11-15T01:38:57.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.142+0000 7f2617748700 1 -- 172.21.15.1:0/376838448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26100ad4b0 con 0x7f26100bf500 2023-11-15T01:38:57.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.143+0000 7f2617748700 1 -- 172.21.15.1:0/376838448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26100adcb0 con 0x7f26100bf500 2023-11-15T01:38:57.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.143+0000 7f26057fa700 1 -- 172.21.15.1:0/376838448 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f260001c460 con 0x7f26100bf500 2023-11-15T01:38:57.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.143+0000 7f26057fa700 1 --2- 172.21.15.1:0/376838448 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f25f405f270 0x7f25f4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:57.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.143+0000 7f26057fa700 1 -- 172.21.15.1:0/376838448 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f260007a0e0 con 0x7f26100bf500 2023-11-15T01:38:57.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.144+0000 7f26154e4700 1 --2- 172.21.15.1:0/376838448 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f25f405f270 0x7f25f4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:57.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.144+0000 7f26154e4700 1 --2- 172.21.15.1:0/376838448 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f25f405f270 0x7f25f4061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f260c009130 tx=0x7f260c017000).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:57.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.148+0000 7f26057fa700 1 -- 172.21.15.1:0/376838448 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f26100adcb0 con 0x7f26100bf500 2023-11-15T01:38:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:57.334+0000 7f2617748700 1 -- 172.21.15.1:0/376838448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f26100adcb0 con 0x7f26100bf500 2023-11-15T01:38:58.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.176+0000 7f26057fa700 1 -- 172.21.15.1:0/376838448 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v122) v1 ==== 97+0+0 (secure 0 0 0) 0x7f26100adcb0 con 0x7f26100bf500 2023-11-15T01:38:58.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.178+0000 7f2617748700 1 -- 172.21.15.1:0/376838448 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f25f405f270 msgr2=0x7f25f4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:58.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.178+0000 7f2617748700 1 --2- 172.21.15.1:0/376838448 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f25f405f270 0x7f25f4061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f260c009130 tx=0x7f260c017000).stop 2023-11-15T01:38:58.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.178+0000 7f2617748700 1 -- 172.21.15.1:0/376838448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26100bf500 msgr2=0x7f26100adf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:58.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.178+0000 7f2617748700 1 --2- 172.21.15.1:0/376838448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26100bf500 0x7f26100adf90 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f260000d8c0 tx=0x7f2600008040).stop 2023-11-15T01:38:58.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.178+0000 7f2617748700 1 -- 172.21.15.1:0/376838448 shutdown_connections 2023-11-15T01:38:58.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.178+0000 7f2617748700 1 --2- 172.21.15.1:0/376838448 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f25f405f270 0x7f25f4061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.178+0000 7f2617748700 1 --2- 172.21.15.1:0/376838448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26100c39c0 0x7f2610153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.178+0000 7f2617748700 1 --2- 172.21.15.1:0/376838448 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26100a8230 0x7f26100aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.178+0000 7f2617748700 1 --2- 172.21.15.1:0/376838448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f26100bf500 0x7f26100adf90 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.178+0000 7f2617748700 1 -- 172.21.15.1:0/376838448 >> 172.21.15.1:0/376838448 conn(0x7f2610082f90 msgr2=0x7f2610067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:58.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.178+0000 7f2617748700 1 -- 172.21.15.1:0/376838448 shutdown_connections 2023-11-15T01:38:58.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.179+0000 7f2617748700 1 -- 172.21.15.1:0/376838448 wait complete. 2023-11-15T01:38:58.182 INFO:teuthology.orchestra.run.smithi001.stderr: removed all blocklist entries 2023-11-15T01:38:58.195 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-15T01:38:58.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.318+0000 7fa94dd3c700 1 Processor -- start 2023-11-15T01:38:58.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.318+0000 7fa94dd3c700 1 -- start start 2023-11-15T01:38:58.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.318+0000 7fa94dd3c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa948155790 0x7fa9480a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:58.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.318+0000 7fa94dd3c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa948083630 con 0x7fa9480a61b0 2023-11-15T01:38:58.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.318+0000 7fa94dd3c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9480c7c90 con 0x7fa948155b70 2023-11-15T01:38:58.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.319+0000 7fa94dd3c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9480c5420 con 0x7fa948155790 2023-11-15T01:38:58.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.319+0000 7fa9477fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa948155790 0x7fa9480a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:58.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.319+0000 7fa947fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa9480a61b0 0x7fa9480bee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47246/0 (socket says 172.21.15.1:47246) 2023-11-15T01:38:58.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.319+0000 7fa947fff700 1 -- 172.21.15.1:0/2491133098 learned_addr learned my addr 172.21.15.1:0/2491133098 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:58.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.319+0000 7fa9477fe700 1 -- 172.21.15.1:0/2491133098 >> v1:172.21.15.141:6789/0 conn(0x7fa948155b70 legacy=0x7fa9480c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:58.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.319+0000 7fa9477fe700 1 -- 172.21.15.1:0/2491133098 >> v1:172.21.15.1:6789/0 conn(0x7fa9480a61b0 legacy=0x7fa9480bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:58.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.319+0000 7fa9467fc700 1 -- 172.21.15.1:0/2491133098 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299381387 0 0) 0x7fa948083630 con 0x7fa9480a61b0 2023-11-15T01:38:58.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.319+0000 7fa9477fe700 1 -- 172.21.15.1:0/2491133098 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9480c7960 con 0x7fa948155790 2023-11-15T01:38:58.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.319+0000 7fa9477fe700 1 --2- 172.21.15.1:0/2491133098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948155790 0x7fa9480a5cc0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7fa938006fd0 tx=0x7fa938006f40).ready entity=mon.0 client_cookie=299c9a54aa3e87e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:58.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.319+0000 7fa9467fc700 1 -- 172.21.15.1:0/2491133098 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa938005880 con 0x7fa948155790 2023-11-15T01:38:58.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.319+0000 7fa9467fc700 1 -- 172.21.15.1:0/2491133098 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9380059e0 con 0x7fa948155790 2023-11-15T01:38:58.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.319+0000 7fa9467fc700 1 -- 172.21.15.1:0/2491133098 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa938005d60 con 0x7fa948155790 2023-11-15T01:38:58.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.320+0000 7fa94dd3c700 1 -- 172.21.15.1:0/2491133098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948155790 msgr2=0x7fa9480a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:58.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.320+0000 7fa94dd3c700 1 --2- 172.21.15.1:0/2491133098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948155790 0x7fa9480a5cc0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7fa938006fd0 tx=0x7fa938006f40).stop 2023-11-15T01:38:58.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.320+0000 7fa94dd3c700 1 -- 172.21.15.1:0/2491133098 shutdown_connections 2023-11-15T01:38:58.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.320+0000 7fa94dd3c700 1 --2- 172.21.15.1:0/2491133098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948155790 0x7fa9480a5cc0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.320+0000 7fa94dd3c700 1 -- 172.21.15.1:0/2491133098 >> 172.21.15.1:0/2491133098 conn(0x7fa948082f90 msgr2=0x7fa9480c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:58.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.320+0000 7fa94dd3c700 1 -- 172.21.15.1:0/2491133098 shutdown_connections 2023-11-15T01:38:58.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.320+0000 7fa94dd3c700 1 -- 172.21.15.1:0/2491133098 wait complete. 2023-11-15T01:38:58.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.321+0000 7fa94dd3c700 1 Processor -- start 2023-11-15T01:38:58.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.321+0000 7fa94dd3c700 1 -- start start 2023-11-15T01:38:58.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa94dd3c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9480a61b0 0x7fa9480bed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:58.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa94dd3c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948155790 0x7fa948150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:58.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa94dd3c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948155b70 0x7fa94814b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:58.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa94dd3c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9481513d0 con 0x7fa948155790 2023-11-15T01:38:58.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa94dd3c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa948150510 con 0x7fa948155b70 2023-11-15T01:38:58.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa94dd3c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9481507c0 con 0x7fa9480a61b0 2023-11-15T01:38:58.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa946ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948155790 0x7fa948150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:58.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa946ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948155790 0x7fa948150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57430/0 (socket says 172.21.15.1:57430) 2023-11-15T01:38:58.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa946ffd700 1 -- 172.21.15.1:0/1216606986 learned_addr learned my addr 172.21.15.1:0/1216606986 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:58.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa9477fe700 1 --2- 172.21.15.1:0/1216606986 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9480a61b0 0x7fa9480bed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:58.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa947fff700 1 --2- 172.21.15.1:0/1216606986 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948155b70 0x7fa94814b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:58.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa946ffd700 1 -- 172.21.15.1:0/1216606986 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9480a61b0 msgr2=0x7fa9480bed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:58.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa946ffd700 1 --2- 172.21.15.1:0/1216606986 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9480a61b0 0x7fa9480bed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa946ffd700 1 -- 172.21.15.1:0/1216606986 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948155b70 msgr2=0x7fa94814b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:58.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa946ffd700 1 --2- 172.21.15.1:0/1216606986 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948155b70 0x7fa94814b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.322+0000 7fa946ffd700 1 -- 172.21.15.1:0/1216606986 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa938009250 con 0x7fa948155790 2023-11-15T01:38:58.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.323+0000 7fa946ffd700 1 --2- 172.21.15.1:0/1216606986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948155790 0x7fa948150020 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7fa93c00c440 tx=0x7fa93c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:58.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.323+0000 7fa92f7fe700 1 -- 172.21.15.1:0/1216606986 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c00f470 con 0x7fa948155790 2023-11-15T01:38:58.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.323+0000 7fa92f7fe700 1 -- 172.21.15.1:0/1216606986 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c00f5f0 con 0x7fa948155790 2023-11-15T01:38:58.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.323+0000 7fa94dd3c700 1 -- 172.21.15.1:0/1216606986 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa948150aa0 con 0x7fa948155790 2023-11-15T01:38:58.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.323+0000 7fa92f7fe700 1 -- 172.21.15.1:0/1216606986 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c00f9b0 con 0x7fa948155790 2023-11-15T01:38:58.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.323+0000 7fa94dd3c700 1 -- 172.21.15.1:0/1216606986 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa948151060 con 0x7fa948155790 2023-11-15T01:38:58.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.324+0000 7fa94dd3c700 1 -- 172.21.15.1:0/1216606986 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9480bf230 con 0x7fa948155790 2023-11-15T01:38:58.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.324+0000 7fa92f7fe700 1 -- 172.21.15.1:0/1216606986 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa93c012400 con 0x7fa948155790 2023-11-15T01:38:58.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.324+0000 7fa92f7fe700 1 --2- 172.21.15.1:0/1216606986 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa93405f270 0x7fa934061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:58.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.324+0000 7fa92f7fe700 1 -- 172.21.15.1:0/1216606986 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5693+0+0 (secure 0 0 0) 0x7fa93c0796c0 con 0x7fa948155790 2023-11-15T01:38:58.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.325+0000 7fa9477fe700 1 --2- 172.21.15.1:0/1216606986 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa93405f270 0x7fa934061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:58.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.325+0000 7fa9477fe700 1 --2- 172.21.15.1:0/1216606986 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa93405f270 0x7fa934061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa938006f80 tx=0x7fa938016000).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:58.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.329+0000 7fa92f7fe700 1 -- 172.21.15.1:0/1216606986 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa93c048af0 con 0x7fa948155790 2023-11-15T01:38:58.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.566+0000 7fa94dd3c700 1 -- 172.21.15.1:0/1216606986 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa948151510 con 0x7fa948155790 2023-11-15T01:38:58.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.567+0000 7fa92f7fe700 1 -- 172.21.15.1:0/1216606986 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa9480bf230 con 0x7fa948155790 2023-11-15T01:38:58.569 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:38:58.569 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T01:38:58.569 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_dump": [ 2023-11-15T01:38:58.569 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.569 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.a", 2023-11-15T01:38:58.570 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlmtf5GBAA2CojasXoquGQ9L5rKjVwTQ==", 2023-11-15T01:38:58.570 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.570 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:38:58.570 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:38:58.570 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:38:58.571 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:38:58.571 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.571 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.571 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.571 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.b", 2023-11-15T01:38:58.572 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl/Y5mJBAAz7iLl3kBJ8kSsyTetTZByw==", 2023-11-15T01:38:58.572 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.572 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:38:58.572 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:38:58.572 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:38:58.573 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:38:58.573 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.573 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.573 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.573 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.c", 2023-11-15T01:38:58.573 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlWTrwHxAAqLVpwNca0vAXUBFnWUN3pg==", 2023-11-15T01:38:58.574 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.574 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:38:58.574 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:38:58.574 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:38:58.574 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:38:58.575 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.575 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.575 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.575 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.d", 2023-11-15T01:38:58.575 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlVwUnKxAAhx2/mX1ljgQwJLagVpmZIA==", 2023-11-15T01:38:58.576 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.576 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:38:58.576 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:38:58.576 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:38:58.576 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:38:58.577 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.577 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.577 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.577 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.0", 2023-11-15T01:38:58.577 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDxHFRlII6rERAA/kvPPhTPHHy6pu5wSPsR/A==", 2023-11-15T01:38:58.577 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.578 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:38:58.578 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:38:58.578 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:38:58.578 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.578 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.579 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.579 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.1", 2023-11-15T01:38:58.579 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD0HFRlPkstEBAAqx31fnNonRCVh98eY6qbxQ==", 2023-11-15T01:38:58.579 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.579 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:38:58.579 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:38:58.580 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:38:58.580 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.580 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.580 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.580 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.2", 2023-11-15T01:38:58.581 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD3HFRl8e3nDRAAKigcbIo0/BFo0Qi6rV+amQ==", 2023-11-15T01:38:58.581 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.581 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:38:58.581 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:38:58.581 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:38:58.581 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.582 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.582 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.582 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.3", 2023-11-15T01:38:58.582 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD6HFRlbwDTCxAAkWv04RyNqW4p8pOqvYCS3A==", 2023-11-15T01:38:58.582 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.583 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:38:58.583 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:38:58.583 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:38:58.583 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.583 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.583 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.584 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.4", 2023-11-15T01:38:58.584 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAAHVRlTQihDxAA/HcZbSytP9qD5PsTjvJBoA==", 2023-11-15T01:38:58.584 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.584 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:38:58.584 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:38:58.585 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:38:58.585 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.585 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.585 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.585 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.5", 2023-11-15T01:38:58.585 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQADHVRlQ2hjDRAAFiI+hKubCPcZ/1AJVu1fvQ==", 2023-11-15T01:38:58.586 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.586 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:38:58.586 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:38:58.586 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:38:58.586 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.587 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.587 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.587 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.6", 2023-11-15T01:38:58.587 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAGHVRl/KEbCxAAmKTnRU4m4qNzX+SVcFY+Qw==", 2023-11-15T01:38:58.587 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.587 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:38:58.588 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:38:58.588 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:38:58.588 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.588 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.588 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.588 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.7", 2023-11-15T01:38:58.589 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAJHVRl4wOFCBAAAiGT4UPE5vSb2LjqgGgGFw==", 2023-11-15T01:38:58.589 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.589 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:38:58.589 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:38:58.589 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:38:58.590 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.590 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.590 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.593 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.0", 2023-11-15T01:38:58.593 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl2hkHLxAAxQE/Cslig6gmXR/xcVlRuw==", 2023-11-15T01:38:58.594 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.594 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:38:58.594 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow r", 2023-11-15T01:38:58.594 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-15T01:38:58.594 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.595 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.595 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.595 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.1", 2023-11-15T01:38:58.595 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRltolkNxAAXmQ4yXOlavwqKq2jFKwsYQ==", 2023-11-15T01:38:58.595 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.596 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:38:58.596 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:38:58.596 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:38:58.596 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:38:58.596 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.597 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.597 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.2", 2023-11-15T01:38:58.597 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlFrJvNBAAH97x7ERzuzpWrUALO+HvpA==", 2023-11-15T01:38:58.597 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.597 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:38:58.598 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:38:58.598 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:38:58.598 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:38:58.598 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.598 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.599 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.3", 2023-11-15T01:38:58.599 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDwHFRlko0ZARAA2RqeRJGwWns00DeWgd/9hA==", 2023-11-15T01:38:58.599 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.599 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:38:58.599 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:38:58.600 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:38:58.600 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:38:58.600 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.600 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.600 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.admin", 2023-11-15T01:38:58.601 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDuHFRlxIQDORAALrVIyQoaVSADkyv9yzMaZw==", 2023-11-15T01:38:58.601 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.601 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:38:58.601 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:38:58.601 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:38:58.601 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:38:58.602 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.602 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.602 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.x", 2023-11-15T01:38:58.602 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlnyjlFRAAjJwtxkAvJ0ZGmvOOawQseQ==", 2023-11-15T01:38:58.603 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.603 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:38:58.603 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T01:38:58.603 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:38:58.603 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.603 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:58.604 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:58.604 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.y", 2023-11-15T01:38:58.604 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl8nW3ERAA4CJQt/ZEZCJ9UaRRuEHfzw==", 2023-11-15T01:38:58.604 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:38:58.604 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:38:58.604 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T01:38:58.605 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:38:58.605 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.605 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:58.605 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2023-11-15T01:38:58.605 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T01:38:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.569+0000 7fa94dd3c700 1 -- 172.21.15.1:0/1216606986 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa93405f270 msgr2=0x7fa934061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.569+0000 7fa94dd3c700 1 --2- 172.21.15.1:0/1216606986 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa93405f270 0x7fa934061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa938006f80 tx=0x7fa938016000).stop 2023-11-15T01:38:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.569+0000 7fa94dd3c700 1 -- 172.21.15.1:0/1216606986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948155790 msgr2=0x7fa948150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.569+0000 7fa94dd3c700 1 --2- 172.21.15.1:0/1216606986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948155790 0x7fa948150020 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7fa93c00c440 tx=0x7fa93c007de0).stop 2023-11-15T01:38:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.569+0000 7fa94dd3c700 1 -- 172.21.15.1:0/1216606986 shutdown_connections 2023-11-15T01:38:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.569+0000 7fa94dd3c700 1 --2- 172.21.15.1:0/1216606986 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa93405f270 0x7fa934061730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.569+0000 7fa94dd3c700 1 --2- 172.21.15.1:0/1216606986 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948155b70 0x7fa94814b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.569+0000 7fa94dd3c700 1 --2- 172.21.15.1:0/1216606986 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9480a61b0 0x7fa9480bed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.569+0000 7fa94dd3c700 1 --2- 172.21.15.1:0/1216606986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948155790 0x7fa948150020 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.569+0000 7fa94dd3c700 1 -- 172.21.15.1:0/1216606986 >> 172.21.15.1:0/1216606986 conn(0x7fa948082f90 msgr2=0x7fa9480c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:58.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.569+0000 7fa94dd3c700 1 -- 172.21.15.1:0/1216606986 shutdown_connections 2023-11-15T01:38:58.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.569+0000 7fa94dd3c700 1 -- 172.21.15.1:0/1216606986 wait complete. 2023-11-15T01:38:58.609 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:38:58.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.727+0000 7fa5ad328700 1 Processor -- start 2023-11-15T01:38:58.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.727+0000 7fa5ad328700 1 -- start start 2023-11-15T01:38:58.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.728+0000 7fa5ad328700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5a814eac0 0x7fa5a81554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:58.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.728+0000 7fa5ad328700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa5a80c7a50 0x7fa5a80c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:58.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.728+0000 7fa5ad328700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a8155050 con 0x7fa5a806a7a0 2023-11-15T01:38:58.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.728+0000 7fa5ad328700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a80c1220 con 0x7fa5a80c7a50 2023-11-15T01:38:58.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.728+0000 7fa5ad328700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80c83a0 con 0x7fa5a814eac0 2023-11-15T01:38:58.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.728+0000 7fa5a6ffd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5a814eac0 0x7fa5a81554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:58.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.728+0000 7fa5a77fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa5a80c7a50 0x7fa5a80c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:58.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.728+0000 7fa5a6ffd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5a814eac0 0x7fa5a81554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:34226/0 (socket says 172.21.15.1:34226) 2023-11-15T01:38:58.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.728+0000 7fa5a6ffd700 1 -- 172.21.15.1:0/1562249063 learned_addr learned my addr 172.21.15.1:0/1562249063 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:58.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.728+0000 7fa5a67fc700 1 --1- 172.21.15.1:0/1562249063 >> v1:172.21.15.141:6789/0 conn(0x7fa5a806a7a0 0x7fa5a80c0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:42516/0 (socket says 172.21.15.1:42516) 2023-11-15T01:38:58.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5a6ffd700 1 -- 172.21.15.1:0/1562249063 >> v2:172.21.15.141:3300/0 conn(0x7fa5a80c7a50 msgr2=0x7fa5a80c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:58.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5a6ffd700 1 --2- 172.21.15.1:0/1562249063 >> v2:172.21.15.141:3300/0 conn(0x7fa5a80c7a50 0x7fa5a80c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5a6ffd700 1 -- 172.21.15.1:0/1562249063 >> v1:172.21.15.141:6789/0 conn(0x7fa5a806a7a0 legacy=0x7fa5a80c0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:58.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5a6ffd700 1 -- 172.21.15.1:0/1562249063 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a80c1420 con 0x7fa5a814eac0 2023-11-15T01:38:58.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5a77fe700 1 --2- 172.21.15.1:0/1562249063 >> v2:172.21.15.141:3300/0 conn(0x7fa5a80c7a50 0x7fa5a80c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:38:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5a6ffd700 1 --2- 172.21.15.1:0/1562249063 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5a814eac0 0x7fa5a81554e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fa5a0006fd0 tx=0x7fa5a00090f0).ready entity=mon.2 client_cookie=25b407a105f24183 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5a5ffb700 1 -- 172.21.15.1:0/1562249063 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000b580 con 0x7fa5a814eac0 2023-11-15T01:38:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5a5ffb700 1 -- 172.21.15.1:0/1562249063 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a000b6e0 con 0x7fa5a814eac0 2023-11-15T01:38:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5a5ffb700 1 -- 172.21.15.1:0/1562249063 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000ba60 con 0x7fa5a814eac0 2023-11-15T01:38:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5ad328700 1 -- 172.21.15.1:0/1562249063 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5a814eac0 msgr2=0x7fa5a81554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:58.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5ad328700 1 --2- 172.21.15.1:0/1562249063 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5a814eac0 0x7fa5a81554e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fa5a0006fd0 tx=0x7fa5a00090f0).stop 2023-11-15T01:38:58.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5ad328700 1 -- 172.21.15.1:0/1562249063 shutdown_connections 2023-11-15T01:38:58.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5ad328700 1 --2- 172.21.15.1:0/1562249063 >> v2:172.21.15.141:3300/0 conn(0x7fa5a80c7a50 0x7fa5a80c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5ad328700 1 --2- 172.21.15.1:0/1562249063 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5a814eac0 0x7fa5a81554e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5ad328700 1 -- 172.21.15.1:0/1562249063 >> 172.21.15.1:0/1562249063 conn(0x7fa5a8084ec0 msgr2=0x7fa5a80947e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:58.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.729+0000 7fa5ad328700 1 -- 172.21.15.1:0/1562249063 shutdown_connections 2023-11-15T01:38:58.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.730+0000 7fa5ad328700 1 -- 172.21.15.1:0/1562249063 wait complete. 2023-11-15T01:38:58.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.731+0000 7fa5ad328700 1 Processor -- start 2023-11-15T01:38:58.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.731+0000 7fa5ad328700 1 -- start start 2023-11-15T01:38:58.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.731+0000 7fa5ad328700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a806a7a0 0x7fa5a80c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:58.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.731+0000 7fa5ad328700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5a80c7a50 0x7fa5a80af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:58.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.731+0000 7fa5ad328700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5a814eac0 0x7fa5a80af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:58.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.731+0000 7fa5ad328700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80ab610 con 0x7fa5a806a7a0 2023-11-15T01:38:58.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa5ad328700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a814c9f0 con 0x7fa5a814eac0 2023-11-15T01:38:58.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa5ad328700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a814ccd0 con 0x7fa5a80c7a50 2023-11-15T01:38:58.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa5a6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a806a7a0 0x7fa5a80c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:58.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa5a6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a806a7a0 0x7fa5a80c44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57444/0 (socket says 172.21.15.1:57444) 2023-11-15T01:38:58.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa5a6ffd700 1 -- 172.21.15.1:0/2856556551 learned_addr learned my addr 172.21.15.1:0/2856556551 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:58.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa5a67fc700 1 --2- 172.21.15.1:0/2856556551 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5a80c7a50 0x7fa5a80af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:58.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa5a77fe700 1 --2- 172.21.15.1:0/2856556551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5a814eac0 0x7fa5a80af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:58.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa5a6ffd700 1 -- 172.21.15.1:0/2856556551 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5a80c7a50 msgr2=0x7fa5a80af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:58.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa5a6ffd700 1 --2- 172.21.15.1:0/2856556551 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5a80c7a50 0x7fa5a80af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa5a6ffd700 1 -- 172.21.15.1:0/2856556551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5a814eac0 msgr2=0x7fa5a80af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:58.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa5a6ffd700 1 --2- 172.21.15.1:0/2856556551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5a814eac0 0x7fa5a80af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa5a6ffd700 1 -- 172.21.15.1:0/2856556551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa598009a20 con 0x7fa5a806a7a0 2023-11-15T01:38:58.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa5a6ffd700 1 --2- 172.21.15.1:0/2856556551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a806a7a0 0x7fa5a80c44b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7fa5a80c84e0 tx=0x7fa5a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:58.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa59effd700 1 -- 172.21.15.1:0/2856556551 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0006a40 con 0x7fa5a806a7a0 2023-11-15T01:38:58.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa59effd700 1 -- 172.21.15.1:0/2856556551 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a000b850 con 0x7fa5a806a7a0 2023-11-15T01:38:58.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa5ad328700 1 -- 172.21.15.1:0/2856556551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a0009370 con 0x7fa5a806a7a0 2023-11-15T01:38:58.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa59effd700 1 -- 172.21.15.1:0/2856556551 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a001c670 con 0x7fa5a806a7a0 2023-11-15T01:38:58.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.732+0000 7fa5ad328700 1 -- 172.21.15.1:0/2856556551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a814d290 con 0x7fa5a806a7a0 2023-11-15T01:38:58.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.733+0000 7fa5ad328700 1 -- 172.21.15.1:0/2856556551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a80adc70 con 0x7fa5a806a7a0 2023-11-15T01:38:58.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.734+0000 7fa59effd700 1 -- 172.21.15.1:0/2856556551 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa5a001ca20 con 0x7fa5a806a7a0 2023-11-15T01:38:58.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.734+0000 7fa59effd700 1 --2- 172.21.15.1:0/2856556551 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa58805f270 0x7fa588061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:58.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.734+0000 7fa59effd700 1 -- 172.21.15.1:0/2856556551 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5693+0+0 (secure 0 0 0) 0x7fa5a007b9a0 con 0x7fa5a806a7a0 2023-11-15T01:38:58.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.734+0000 7fa5a67fc700 1 --2- 172.21.15.1:0/2856556551 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa58805f270 0x7fa588061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:58.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.735+0000 7fa5a67fc700 1 --2- 172.21.15.1:0/2856556551 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa58805f270 0x7fa588061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa590007fd0 tx=0x7fa590007d30).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:58.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.738+0000 7fa59effd700 1 -- 172.21.15.1:0/2856556551 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa5a004cca0 con 0x7fa5a806a7a0 2023-11-15T01:38:58.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.914+0000 7fa5ad328700 1 -- 172.21.15.1:0/2856556551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5a80475e0 con 0x7fa5a806a7a0 2023-11-15T01:38:58.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.915+0000 7fa59effd700 1 -- 172.21.15.1:0/2856556551 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+14319 (secure 0 0 0) 0x7fa5a0020070 con 0x7fa5a806a7a0 2023-11-15T01:38:58.916 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:38:58.916 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":122,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:38:58.167344+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:38:58.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.917+0000 7fa5ad328700 1 -- 172.21.15.1:0/2856556551 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa58805f270 msgr2=0x7fa588061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:58.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.917+0000 7fa5ad328700 1 --2- 172.21.15.1:0/2856556551 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa58805f270 0x7fa588061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa590007fd0 tx=0x7fa590007d30).stop 2023-11-15T01:38:58.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.917+0000 7fa5ad328700 1 -- 172.21.15.1:0/2856556551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a806a7a0 msgr2=0x7fa5a80c44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:58.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.917+0000 7fa5ad328700 1 --2- 172.21.15.1:0/2856556551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a806a7a0 0x7fa5a80c44b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7fa5a80c84e0 tx=0x7fa5a0017000).stop 2023-11-15T01:38:58.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.917+0000 7fa5ad328700 1 -- 172.21.15.1:0/2856556551 shutdown_connections 2023-11-15T01:38:58.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.917+0000 7fa5ad328700 1 --2- 172.21.15.1:0/2856556551 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa58805f270 0x7fa588061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.917+0000 7fa5ad328700 1 --2- 172.21.15.1:0/2856556551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5a814eac0 0x7fa5a80af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.917+0000 7fa5ad328700 1 --2- 172.21.15.1:0/2856556551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a806a7a0 0x7fa5a80c44b0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.917+0000 7fa5ad328700 1 --2- 172.21.15.1:0/2856556551 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5a80c7a50 0x7fa5a80af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:58.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.917+0000 7fa5ad328700 1 -- 172.21.15.1:0/2856556551 >> 172.21.15.1:0/2856556551 conn(0x7fa5a8084ec0 msgr2=0x7fa5a80ca620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:58.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.917+0000 7fa5ad328700 1 -- 172.21.15.1:0/2856556551 shutdown_connections 2023-11-15T01:38:58.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:58.917+0000 7fa5ad328700 1 -- 172.21.15.1:0/2856556551 wait complete. 2023-11-15T01:38:58.930 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-15T01:38:58.931 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:38:59.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.052+0000 7fcb5f223700 1 Processor -- start 2023-11-15T01:38:59.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.052+0000 7fcb5f223700 1 -- start start 2023-11-15T01:38:59.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb5f223700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fcb5813a980 0x7fcb58069620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb5f223700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcb580bd430 0x7fcb5815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb5f223700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5806a810 con 0x7fcb580c1c80 2023-11-15T01:38:59.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb5f223700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb5813ad60 con 0x7fcb580bd430 2023-11-15T01:38:59.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb5f223700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb58069c00 con 0x7fcb5813a980 2023-11-15T01:38:59.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb5d7c0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcb580bd430 0x7fcb5815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb5d7c0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcb580bd430 0x7fcb5815abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57454/0 (socket says 172.21.15.1:57454) 2023-11-15T01:38:59.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb5d7c0700 1 -- 172.21.15.1:0/2743047114 learned_addr learned my addr 172.21.15.1:0/2743047114 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:59.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb5d7c0700 1 -- 172.21.15.1:0/2743047114 >> v2:172.21.15.141:3300/0 conn(0x7fcb5813a980 msgr2=0x7fcb58069620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:59.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb5cfbf700 1 --2- 172.21.15.1:0/2743047114 >> v2:172.21.15.141:3300/0 conn(0x7fcb5813a980 0x7fcb58069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb5d7c0700 1 --2- 172.21.15.1:0/2743047114 >> v2:172.21.15.141:3300/0 conn(0x7fcb5813a980 0x7fcb58069620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb5d7c0700 1 -- 172.21.15.1:0/2743047114 >> v1:172.21.15.141:6789/0 conn(0x7fcb580c1c80 legacy=0x7fcb580bcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:59.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb5d7c0700 1 -- 172.21.15.1:0/2743047114 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb58069ee0 con 0x7fcb580bd430 2023-11-15T01:38:59.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb5cfbf700 1 --2- 172.21.15.1:0/2743047114 >> v2:172.21.15.141:3300/0 conn(0x7fcb5813a980 0x7fcb58069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:38:59.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb5d7c0700 1 --2- 172.21.15.1:0/2743047114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb580bd430 0x7fcb5815abf0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7fcb580c47c0 tx=0x7fcb400090f0).ready entity=mon.0 client_cookie=b51ad74795ee9820 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:59.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb577fe700 1 -- 172.21.15.1:0/2743047114 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4000b5a0 con 0x7fcb580bd430 2023-11-15T01:38:59.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb577fe700 1 -- 172.21.15.1:0/2743047114 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4000b700 con 0x7fcb580bd430 2023-11-15T01:38:59.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.053+0000 7fcb577fe700 1 -- 172.21.15.1:0/2743047114 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4000ba80 con 0x7fcb580bd430 2023-11-15T01:38:59.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.054+0000 7fcb5f223700 1 -- 172.21.15.1:0/2743047114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb580bd430 msgr2=0x7fcb5815abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.054+0000 7fcb5f223700 1 --2- 172.21.15.1:0/2743047114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb580bd430 0x7fcb5815abf0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7fcb580c47c0 tx=0x7fcb400090f0).stop 2023-11-15T01:38:59.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.054+0000 7fcb5f223700 1 -- 172.21.15.1:0/2743047114 shutdown_connections 2023-11-15T01:38:59.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.054+0000 7fcb5f223700 1 --2- 172.21.15.1:0/2743047114 >> v2:172.21.15.141:3300/0 conn(0x7fcb5813a980 0x7fcb58069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.054+0000 7fcb5f223700 1 --2- 172.21.15.1:0/2743047114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb580bd430 0x7fcb5815abf0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.054+0000 7fcb5f223700 1 -- 172.21.15.1:0/2743047114 >> 172.21.15.1:0/2743047114 conn(0x7fcb58063280 msgr2=0x7fcb580c6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:59.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.054+0000 7fcb5f223700 1 -- 172.21.15.1:0/2743047114 shutdown_connections 2023-11-15T01:38:59.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.054+0000 7fcb5f223700 1 -- 172.21.15.1:0/2743047114 wait complete. 2023-11-15T01:38:59.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.055+0000 7fcb5f223700 1 Processor -- start 2023-11-15T01:38:59.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.055+0000 7fcb5f223700 1 -- start start 2023-11-15T01:38:59.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb5f223700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcb580bd430 0x7fcb580c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb5f223700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcb580c1c80 0x7fcb58151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb5f223700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb5813a980 0x7fcb581507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb5f223700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb58155f60 con 0x7fcb5813a980 2023-11-15T01:38:59.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb5f223700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb58156240 con 0x7fcb580bd430 2023-11-15T01:38:59.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb5f223700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb58156520 con 0x7fcb580c1c80 2023-11-15T01:38:59.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb5d7c0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb5813a980 0x7fcb581507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb5d7c0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb5813a980 0x7fcb581507a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57456/0 (socket says 172.21.15.1:57456) 2023-11-15T01:38:59.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb5d7c0700 1 -- 172.21.15.1:0/2202663348 learned_addr learned my addr 172.21.15.1:0/2202663348 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:59.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb5cfbf700 1 --2- 172.21.15.1:0/2202663348 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcb580bd430 0x7fcb580c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb57fff700 1 --2- 172.21.15.1:0/2202663348 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcb580c1c80 0x7fcb58151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb5d7c0700 1 -- 172.21.15.1:0/2202663348 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcb580c1c80 msgr2=0x7fcb58151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb5d7c0700 1 --2- 172.21.15.1:0/2202663348 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcb580c1c80 0x7fcb58151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb5d7c0700 1 -- 172.21.15.1:0/2202663348 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcb580bd430 msgr2=0x7fcb580c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb5d7c0700 1 --2- 172.21.15.1:0/2202663348 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcb580bd430 0x7fcb580c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.056+0000 7fcb5d7c0700 1 -- 172.21.15.1:0/2202663348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40009370 con 0x7fcb5813a980 2023-11-15T01:38:59.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.057+0000 7fcb5d7c0700 1 --2- 172.21.15.1:0/2202663348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb5813a980 0x7fcb581507a0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7fcb40009130 tx=0x7fcb40015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:59.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.057+0000 7fcb54ff9700 1 -- 172.21.15.1:0/2202663348 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4000ba80 con 0x7fcb5813a980 2023-11-15T01:38:59.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.057+0000 7fcb54ff9700 1 -- 172.21.15.1:0/2202663348 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4000bec0 con 0x7fcb5813a980 2023-11-15T01:38:59.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.057+0000 7fcb54ff9700 1 -- 172.21.15.1:0/2202663348 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4001c650 con 0x7fcb5813a980 2023-11-15T01:38:59.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.057+0000 7fcb5f223700 1 -- 172.21.15.1:0/2202663348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb58156800 con 0x7fcb5813a980 2023-11-15T01:38:59.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.057+0000 7fcb5f223700 1 -- 172.21.15.1:0/2202663348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb580c5d80 con 0x7fcb5813a980 2023-11-15T01:38:59.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.058+0000 7fcb5f223700 1 -- 172.21.15.1:0/2202663348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5806c7e0 con 0x7fcb5813a980 2023-11-15T01:38:59.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.058+0000 7fcb54ff9700 1 -- 172.21.15.1:0/2202663348 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcb4001ca00 con 0x7fcb5813a980 2023-11-15T01:38:59.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.058+0000 7fcb54ff9700 1 --2- 172.21.15.1:0/2202663348 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcb3805f270 0x7fcb38061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.059+0000 7fcb54ff9700 1 -- 172.21.15.1:0/2202663348 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5693+0+0 (secure 0 0 0) 0x7fcb4007c0e0 con 0x7fcb5813a980 2023-11-15T01:38:59.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.059+0000 7fcb5cfbf700 1 --2- 172.21.15.1:0/2202663348 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcb3805f270 0x7fcb38061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.059+0000 7fcb5cfbf700 1 --2- 172.21.15.1:0/2202663348 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcb3805f270 0x7fcb38061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fcb580c6b80 tx=0x7fcb500077b0).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:59.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.063+0000 7fcb54ff9700 1 -- 172.21.15.1:0/2202663348 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcb4004d3e0 con 0x7fcb5813a980 2023-11-15T01:38:59.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.235+0000 7fcb5f223700 1 -- 172.21.15.1:0/2202663348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcb580c5070 con 0x7fcb5813a980 2023-11-15T01:38:59.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.235+0000 7fcb54ff9700 1 -- 172.21.15.1:0/2202663348 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v122) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcb400200b0 con 0x7fcb5813a980 2023-11-15T01:38:59.237 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:38:59.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.237+0000 7fcb5f223700 1 -- 172.21.15.1:0/2202663348 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcb3805f270 msgr2=0x7fcb38061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.237+0000 7fcb5f223700 1 --2- 172.21.15.1:0/2202663348 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcb3805f270 0x7fcb38061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fcb580c6b80 tx=0x7fcb500077b0).stop 2023-11-15T01:38:59.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.237+0000 7fcb5f223700 1 -- 172.21.15.1:0/2202663348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb5813a980 msgr2=0x7fcb581507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.237+0000 7fcb5f223700 1 --2- 172.21.15.1:0/2202663348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb5813a980 0x7fcb581507a0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7fcb40009130 tx=0x7fcb40015000).stop 2023-11-15T01:38:59.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.237+0000 7fcb5f223700 1 -- 172.21.15.1:0/2202663348 shutdown_connections 2023-11-15T01:38:59.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.237+0000 7fcb5f223700 1 --2- 172.21.15.1:0/2202663348 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcb3805f270 0x7fcb38061730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.237+0000 7fcb5f223700 1 --2- 172.21.15.1:0/2202663348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb5813a980 0x7fcb581507a0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.237+0000 7fcb5f223700 1 --2- 172.21.15.1:0/2202663348 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcb580bd430 0x7fcb580c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.237+0000 7fcb5f223700 1 --2- 172.21.15.1:0/2202663348 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcb580c1c80 0x7fcb58151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.237+0000 7fcb5f223700 1 -- 172.21.15.1:0/2202663348 >> 172.21.15.1:0/2202663348 conn(0x7fcb58063280 msgr2=0x7fcb580c47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:59.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.237+0000 7fcb5f223700 1 -- 172.21.15.1:0/2202663348 shutdown_connections 2023-11-15T01:38:59.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.237+0000 7fcb5f223700 1 -- 172.21.15.1:0/2202663348 wait complete. 2023-11-15T01:38:59.251 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:38:59.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.371+0000 7f6e44864700 1 Processor -- start 2023-11-15T01:38:59.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.371+0000 7f6e44864700 1 -- start start 2023-11-15T01:38:59.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.372+0000 7f6e44864700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6e401545b0 0x7f6e400c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.372+0000 7f6e44864700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6e400c7f50 0x7f6e400c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.372+0000 7f6e44864700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e40155830 con 0x7f6e401541d0 2023-11-15T01:38:59.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.372+0000 7f6e44864700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e40158f40 con 0x7f6e401545b0 2023-11-15T01:38:59.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.372+0000 7f6e44864700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e40154a30 con 0x7f6e400c7f50 2023-11-15T01:38:59.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.372+0000 7f6e3effd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6e401545b0 0x7f6e400c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.372+0000 7f6e3effd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6e401545b0 0x7f6e400c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57470/0 (socket says 172.21.15.1:57470) 2023-11-15T01:38:59.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.372+0000 7f6e3effd700 1 -- 172.21.15.1:0/1180004943 learned_addr learned my addr 172.21.15.1:0/1180004943 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:59.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.372+0000 7f6e3ffff700 1 --2- 172.21.15.1:0/1180004943 >> v2:172.21.15.141:3300/0 conn(0x7f6e400c7f50 0x7f6e400c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.372+0000 7f6e3effd700 1 -- 172.21.15.1:0/1180004943 >> v2:172.21.15.141:3300/0 conn(0x7f6e400c7f50 msgr2=0x7f6e400c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:59.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.372+0000 7f6e3effd700 1 --2- 172.21.15.1:0/1180004943 >> v2:172.21.15.141:3300/0 conn(0x7f6e400c7f50 0x7f6e400c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.372+0000 7f6e3effd700 1 -- 172.21.15.1:0/1180004943 >> v1:172.21.15.141:6789/0 conn(0x7f6e401541d0 legacy=0x7f6e400c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.372+0000 7f6e3effd700 1 -- 172.21.15.1:0/1180004943 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e40154c20 con 0x7f6e401545b0 2023-11-15T01:38:59.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.372+0000 7f6e3effd700 1 --2- 172.21.15.1:0/1180004943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e401545b0 0x7f6e400c7a60 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f6e400c56d0 tx=0x7f6e300090f0).ready entity=mon.0 client_cookie=587a246013fc69 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:59.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.372+0000 7f6e3e7fc700 1 -- 172.21.15.1:0/1180004943 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000b520 con 0x7f6e401545b0 2023-11-15T01:38:59.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.373+0000 7f6e3e7fc700 1 -- 172.21.15.1:0/1180004943 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3000b680 con 0x7f6e401545b0 2023-11-15T01:38:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.373+0000 7f6e3e7fc700 1 -- 172.21.15.1:0/1180004943 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000ba00 con 0x7f6e401545b0 2023-11-15T01:38:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.373+0000 7f6e44864700 1 -- 172.21.15.1:0/1180004943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e401545b0 msgr2=0x7f6e400c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.373+0000 7f6e44864700 1 --2- 172.21.15.1:0/1180004943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e401545b0 0x7f6e400c7a60 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f6e400c56d0 tx=0x7f6e300090f0).stop 2023-11-15T01:38:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.373+0000 7f6e44864700 1 -- 172.21.15.1:0/1180004943 shutdown_connections 2023-11-15T01:38:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.373+0000 7f6e44864700 1 --2- 172.21.15.1:0/1180004943 >> v2:172.21.15.141:3300/0 conn(0x7f6e400c7f50 0x7f6e400c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.373+0000 7f6e44864700 1 --2- 172.21.15.1:0/1180004943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e401545b0 0x7f6e400c7a60 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.373+0000 7f6e44864700 1 -- 172.21.15.1:0/1180004943 >> 172.21.15.1:0/1180004943 conn(0x7f6e40069ee0 msgr2=0x7f6e4006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:59.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.373+0000 7f6e44864700 1 -- 172.21.15.1:0/1180004943 shutdown_connections 2023-11-15T01:38:59.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.373+0000 7f6e44864700 1 -- 172.21.15.1:0/1180004943 wait complete. 2023-11-15T01:38:59.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.374+0000 7f6e44864700 1 Processor -- start 2023-11-15T01:38:59.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.374+0000 7f6e44864700 1 -- start start 2023-11-15T01:38:59.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.375+0000 7f6e44864700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e400c7f50 0x7f6e4014dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.375+0000 7f6e44864700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e401541d0 0x7f6e400c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.375+0000 7f6e44864700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e401545b0 0x7f6e400c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.375+0000 7f6e44864700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400c40c0 con 0x7f6e400c7f50 2023-11-15T01:38:59.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.375+0000 7f6e44864700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e401507f0 con 0x7f6e401541d0 2023-11-15T01:38:59.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.375+0000 7f6e44864700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4014fbe0 con 0x7f6e401545b0 2023-11-15T01:38:59.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.375+0000 7f6e3f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e400c7f50 0x7f6e4014dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.375+0000 7f6e3f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e400c7f50 0x7f6e4014dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57486/0 (socket says 172.21.15.1:57486) 2023-11-15T01:38:59.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.375+0000 7f6e3f7fe700 1 -- 172.21.15.1:0/1890710862 learned_addr learned my addr 172.21.15.1:0/1890710862 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:59.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.375+0000 7f6e3effd700 1 --2- 172.21.15.1:0/1890710862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e401541d0 0x7f6e400c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.375+0000 7f6e3ffff700 1 --2- 172.21.15.1:0/1890710862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e401545b0 0x7f6e400c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.376+0000 7f6e3f7fe700 1 -- 172.21.15.1:0/1890710862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e401545b0 msgr2=0x7f6e400c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.376+0000 7f6e3f7fe700 1 --2- 172.21.15.1:0/1890710862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e401545b0 0x7f6e400c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.376+0000 7f6e3f7fe700 1 -- 172.21.15.1:0/1890710862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e401541d0 msgr2=0x7f6e400c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.376+0000 7f6e3f7fe700 1 --2- 172.21.15.1:0/1890710862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e401541d0 0x7f6e400c36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.376+0000 7f6e3f7fe700 1 -- 172.21.15.1:0/1890710862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e30009370 con 0x7f6e400c7f50 2023-11-15T01:38:59.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.376+0000 7f6e3f7fe700 1 --2- 172.21.15.1:0/1890710862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e400c7f50 0x7f6e4014dc40 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f6e2800c4c0 tx=0x7f6e28007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:59.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.376+0000 7f6e377fe700 1 -- 172.21.15.1:0/1890710862 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800ce70 con 0x7f6e400c7f50 2023-11-15T01:38:59.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.376+0000 7f6e377fe700 1 -- 172.21.15.1:0/1890710862 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e28001e90 con 0x7f6e400c7f50 2023-11-15T01:38:59.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.376+0000 7f6e44864700 1 -- 172.21.15.1:0/1890710862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4014fec0 con 0x7f6e400c7f50 2023-11-15T01:38:59.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.376+0000 7f6e377fe700 1 -- 172.21.15.1:0/1890710862 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28007250 con 0x7f6e400c7f50 2023-11-15T01:38:59.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.376+0000 7f6e44864700 1 -- 172.21.15.1:0/1890710862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e40150480 con 0x7f6e400c7f50 2023-11-15T01:38:59.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.377+0000 7f6e44864700 1 -- 172.21.15.1:0/1890710862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e400475e0 con 0x7f6e400c7f50 2023-11-15T01:38:59.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.377+0000 7f6e377fe700 1 -- 172.21.15.1:0/1890710862 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6e280066a0 con 0x7f6e400c7f50 2023-11-15T01:38:59.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.377+0000 7f6e377fe700 1 --2- 172.21.15.1:0/1890710862 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6e2005f270 0x7f6e20061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.378+0000 7f6e377fe700 1 -- 172.21.15.1:0/1890710862 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5693+0+0 (secure 0 0 0) 0x7f6e28079ac0 con 0x7f6e400c7f50 2023-11-15T01:38:59.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.378+0000 7f6e3effd700 1 --2- 172.21.15.1:0/1890710862 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6e2005f270 0x7f6e20061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.378+0000 7f6e3effd700 1 --2- 172.21.15.1:0/1890710862 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6e2005f270 0x7f6e20061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6e30009130 tx=0x7f6e30017000).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:59.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.382+0000 7f6e377fe700 1 -- 172.21.15.1:0/1890710862 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6e2804adc0 con 0x7f6e400c7f50 2023-11-15T01:38:59.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.554+0000 7f6e44864700 1 -- 172.21.15.1:0/1890710862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6e40154f00 con 0x7f6e400c7f50 2023-11-15T01:38:59.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.555+0000 7f6e377fe700 1 -- 172.21.15.1:0/1890710862 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v122) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6e2804e3e0 con 0x7f6e400c7f50 2023-11-15T01:38:59.557 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:38:59.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.557+0000 7f6e44864700 1 -- 172.21.15.1:0/1890710862 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6e2005f270 msgr2=0x7f6e20061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.557+0000 7f6e44864700 1 --2- 172.21.15.1:0/1890710862 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6e2005f270 0x7f6e20061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6e30009130 tx=0x7f6e30017000).stop 2023-11-15T01:38:59.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.557+0000 7f6e44864700 1 -- 172.21.15.1:0/1890710862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e400c7f50 msgr2=0x7f6e4014dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.557+0000 7f6e44864700 1 --2- 172.21.15.1:0/1890710862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e400c7f50 0x7f6e4014dc40 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f6e2800c4c0 tx=0x7f6e28007e00).stop 2023-11-15T01:38:59.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.557+0000 7f6e44864700 1 -- 172.21.15.1:0/1890710862 shutdown_connections 2023-11-15T01:38:59.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.557+0000 7f6e44864700 1 --2- 172.21.15.1:0/1890710862 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6e2005f270 0x7f6e20061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.557+0000 7f6e44864700 1 --2- 172.21.15.1:0/1890710862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e401545b0 0x7f6e400c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.557+0000 7f6e44864700 1 --2- 172.21.15.1:0/1890710862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e400c7f50 0x7f6e4014dc40 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.557+0000 7f6e44864700 1 --2- 172.21.15.1:0/1890710862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e401541d0 0x7f6e400c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.557+0000 7f6e44864700 1 -- 172.21.15.1:0/1890710862 >> 172.21.15.1:0/1890710862 conn(0x7f6e40069ee0 msgr2=0x7f6e400c9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:59.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.557+0000 7f6e44864700 1 -- 172.21.15.1:0/1890710862 shutdown_connections 2023-11-15T01:38:59.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.557+0000 7f6e44864700 1 -- 172.21.15.1:0/1890710862 wait complete. 2023-11-15T01:38:59.570 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-15T01:38:59.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.688+0000 7f7abba28700 1 Processor -- start 2023-11-15T01:38:59.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.688+0000 7f7abba28700 1 -- start start 2023-11-15T01:38:59.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7abba28700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7ab4154150 0x7f7ab4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7abba28700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab40c06f0 con 0x7f7ab40ab1a0 2023-11-15T01:38:59.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7abba28700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab40c09d0 con 0x7f7ab40aa060 2023-11-15T01:38:59.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7abba28700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab4158820 con 0x7f7ab4154150 2023-11-15T01:38:59.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7ab97c4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7ab4154150 0x7f7ab4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7ab8fc3700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7ab40ab1a0 0x7f7ab4158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47250/0 (socket says 172.21.15.1:47250) 2023-11-15T01:38:59.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7ab8fc3700 1 -- 172.21.15.1:0/341682465 learned_addr learned my addr 172.21.15.1:0/341682465 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:38:59.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7ab97c4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7ab4154150 0x7f7ab4154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57502/0 (socket says 172.21.15.1:57502) 2023-11-15T01:38:59.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7ab97c4700 1 -- 172.21.15.1:0/341682465 >> v1:172.21.15.141:6789/0 conn(0x7f7ab40aa060 legacy=0x7f7ab40c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:38:59.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7ab97c4700 1 -- 172.21.15.1:0/341682465 >> v1:172.21.15.1:6789/0 conn(0x7f7ab40ab1a0 legacy=0x7f7ab4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7ab97c4700 1 -- 172.21.15.1:0/341682465 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab4158b00 con 0x7f7ab4154150 2023-11-15T01:38:59.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7ab3fff700 1 -- 172.21.15.1:0/341682465 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974428171 0 0) 0x7f7ab40c06f0 con 0x7f7ab40ab1a0 2023-11-15T01:38:59.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7ab97c4700 1 --2- 172.21.15.1:0/341682465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154150 0x7f7ab4154530 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f7aa4009e60 tx=0x7f7aa4009780).ready entity=mon.0 client_cookie=b85189f0812abb46 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:59.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7ab3fff700 1 -- 172.21.15.1:0/341682465 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400e070 con 0x7f7ab4154150 2023-11-15T01:38:59.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7ab3fff700 1 -- 172.21.15.1:0/341682465 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa400bbf0 con 0x7f7ab4154150 2023-11-15T01:38:59.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.689+0000 7f7ab3fff700 1 -- 172.21.15.1:0/341682465 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4012410 con 0x7f7ab4154150 2023-11-15T01:38:59.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.690+0000 7f7abba28700 1 -- 172.21.15.1:0/341682465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154150 msgr2=0x7f7ab4154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.690+0000 7f7abba28700 1 --2- 172.21.15.1:0/341682465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154150 0x7f7ab4154530 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f7aa4009e60 tx=0x7f7aa4009780).stop 2023-11-15T01:38:59.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.690+0000 7f7abba28700 1 -- 172.21.15.1:0/341682465 shutdown_connections 2023-11-15T01:38:59.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.690+0000 7f7abba28700 1 --2- 172.21.15.1:0/341682465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154150 0x7f7ab4154530 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.690+0000 7f7abba28700 1 -- 172.21.15.1:0/341682465 >> 172.21.15.1:0/341682465 conn(0x7f7ab4064aa0 msgr2=0x7f7ab4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:59.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.690+0000 7f7abba28700 1 -- 172.21.15.1:0/341682465 shutdown_connections 2023-11-15T01:38:59.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.690+0000 7f7abba28700 1 -- 172.21.15.1:0/341682465 wait complete. 2023-11-15T01:38:59.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.691+0000 7f7abba28700 1 Processor -- start 2023-11-15T01:38:59.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.691+0000 7f7abba28700 1 -- start start 2023-11-15T01:38:59.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.692+0000 7f7abba28700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ab40aa060 0x7f7ab41513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.692+0000 7f7abba28700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40ab1a0 0x7f7ab40b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.692+0000 7f7abba28700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154150 0x7f7ab40b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.692+0000 7f7abba28700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40b0ba0 con 0x7f7ab4154150 2023-11-15T01:38:59.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.692+0000 7f7abba28700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab41550c0 con 0x7f7ab40aa060 2023-11-15T01:38:59.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.692+0000 7f7abba28700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab41518b0 con 0x7f7ab40ab1a0 2023-11-15T01:38:59.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.692+0000 7f7ab9fc5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154150 0x7f7ab40b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.692+0000 7f7ab9fc5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154150 0x7f7ab40b06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57514/0 (socket says 172.21.15.1:57514) 2023-11-15T01:38:59.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.692+0000 7f7ab9fc5700 1 -- 172.21.15.1:0/594190599 learned_addr learned my addr 172.21.15.1:0/594190599 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:38:59.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.692+0000 7f7ab97c4700 1 --2- 172.21.15.1:0/594190599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ab40aa060 0x7f7ab41513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.692+0000 7f7ab8fc3700 1 --2- 172.21.15.1:0/594190599 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40ab1a0 0x7f7ab40b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.693+0000 7f7ab9fc5700 1 -- 172.21.15.1:0/594190599 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40ab1a0 msgr2=0x7f7ab40b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.693+0000 7f7ab9fc5700 1 --2- 172.21.15.1:0/594190599 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40ab1a0 0x7f7ab40b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.693+0000 7f7ab9fc5700 1 -- 172.21.15.1:0/594190599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ab40aa060 msgr2=0x7f7ab41513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.693+0000 7f7ab9fc5700 1 --2- 172.21.15.1:0/594190599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ab40aa060 0x7f7ab41513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.693+0000 7f7ab9fc5700 1 -- 172.21.15.1:0/594190599 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa4009a20 con 0x7f7ab4154150 2023-11-15T01:38:59.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.693+0000 7f7ab9fc5700 1 --2- 172.21.15.1:0/594190599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154150 0x7f7ab40b06b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f7aac00c4c0 tx=0x7f7aac007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:59.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.693+0000 7f7ab17fa700 1 -- 172.21.15.1:0/594190599 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac002ea0 con 0x7f7ab4154150 2023-11-15T01:38:59.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.693+0000 7f7ab17fa700 1 -- 172.21.15.1:0/594190599 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac00f470 con 0x7f7ab4154150 2023-11-15T01:38:59.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.693+0000 7f7abba28700 1 -- 172.21.15.1:0/594190599 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab4154ab0 con 0x7f7ab4154150 2023-11-15T01:38:59.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.693+0000 7f7ab17fa700 1 -- 172.21.15.1:0/594190599 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac00f810 con 0x7f7ab4154150 2023-11-15T01:38:59.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.693+0000 7f7abba28700 1 -- 172.21.15.1:0/594190599 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab40c4390 con 0x7f7ab4154150 2023-11-15T01:38:59.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.694+0000 7f7abba28700 1 -- 172.21.15.1:0/594190599 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab406c7e0 con 0x7f7ab4154150 2023-11-15T01:38:59.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.694+0000 7f7ab17fa700 1 -- 172.21.15.1:0/594190599 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7aac00fc40 con 0x7f7ab4154150 2023-11-15T01:38:59.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.695+0000 7f7ab17fa700 1 --2- 172.21.15.1:0/594190599 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7aa005f270 0x7f7aa0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:38:59.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.695+0000 7f7ab17fa700 1 -- 172.21.15.1:0/594190599 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5693+0+0 (secure 0 0 0) 0x7f7aac079650 con 0x7f7ab4154150 2023-11-15T01:38:59.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.695+0000 7f7ab97c4700 1 --2- 172.21.15.1:0/594190599 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7aa005f270 0x7f7aa0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:38:59.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.695+0000 7f7ab97c4700 1 --2- 172.21.15.1:0/594190599 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7aa005f270 0x7f7aa0061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7aa4009870 tx=0x7f7aa4009780).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:38:59.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.699+0000 7f7ab17fa700 1 -- 172.21.15.1:0/594190599 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7aac047af0 con 0x7f7ab4154150 2023-11-15T01:38:59.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.876+0000 7f7abba28700 1 -- 172.21.15.1:0/594190599 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7ab4155200 con 0x7f7ab4154150 2023-11-15T01:38:59.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.876+0000 7f7ab17fa700 1 -- 172.21.15.1:0/594190599 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v122) v1 ==== 84+0+143 (secure 0 0 0) 0x7f7aac04a950 con 0x7f7ab4154150 2023-11-15T01:38:59.878 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:38:59.878 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T01:38:59.878 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:59.878 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2023-11-15T01:38:59.879 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "device_health_metrics" 2023-11-15T01:38:59.879 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:38:59.879 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:38:59.879 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 2, 2023-11-15T01:38:59.879 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "rbd" 2023-11-15T01:38:59.880 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:38:59.880 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T01:38:59.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.878+0000 7f7abba28700 1 -- 172.21.15.1:0/594190599 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7aa005f270 msgr2=0x7f7aa0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.878+0000 7f7abba28700 1 --2- 172.21.15.1:0/594190599 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7aa005f270 0x7f7aa0061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7aa4009870 tx=0x7f7aa4009780).stop 2023-11-15T01:38:59.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.878+0000 7f7abba28700 1 -- 172.21.15.1:0/594190599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154150 msgr2=0x7f7ab40b06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:38:59.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.878+0000 7f7abba28700 1 --2- 172.21.15.1:0/594190599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154150 0x7f7ab40b06b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f7aac00c4c0 tx=0x7f7aac007de0).stop 2023-11-15T01:38:59.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.878+0000 7f7abba28700 1 -- 172.21.15.1:0/594190599 shutdown_connections 2023-11-15T01:38:59.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.878+0000 7f7abba28700 1 --2- 172.21.15.1:0/594190599 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7aa005f270 0x7f7aa0061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.878+0000 7f7abba28700 1 --2- 172.21.15.1:0/594190599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ab4154150 0x7f7ab40b06b0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.878+0000 7f7abba28700 1 --2- 172.21.15.1:0/594190599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ab40aa060 0x7f7ab41513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.878+0000 7f7abba28700 1 --2- 172.21.15.1:0/594190599 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ab40ab1a0 0x7f7ab40b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:38:59.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.878+0000 7f7abba28700 1 -- 172.21.15.1:0/594190599 >> 172.21.15.1:0/594190599 conn(0x7f7ab4064aa0 msgr2=0x7f7ab40ca8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:38:59.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.879+0000 7f7abba28700 1 -- 172.21.15.1:0/594190599 shutdown_connections 2023-11-15T01:38:59.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:38:59.879+0000 7f7abba28700 1 -- 172.21.15.1:0/594190599 wait complete. 2023-11-15T01:38:59.892 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-15T01:38:59.892 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-15T01:39:00.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.013+0000 7f5e538cc700 1 Processor -- start 2023-11-15T01:39:00.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.014+0000 7f5e538cc700 1 -- start start 2023-11-15T01:39:00.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.014+0000 7f5e538cc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5e4c157660 0x7f5e4c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:00.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.014+0000 7f5e538cc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e4c0aa060 0x7f5e4c0aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:00.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.014+0000 7f5e538cc700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e4c0c1820 con 0x7f5e4c0c1cb0 2023-11-15T01:39:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.014+0000 7f5e538cc700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4c0c7540 con 0x7f5e4c157660 2023-11-15T01:39:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.014+0000 7f5e538cc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c0aa9e0 con 0x7f5e4c0aa060 2023-11-15T01:39:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.015+0000 7f5e51668700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5e4c157660 0x7f5e4c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:00.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.015+0000 7f5e51668700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5e4c157660 0x7f5e4c157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57520/0 (socket says 172.21.15.1:57520) 2023-11-15T01:39:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.015+0000 7f5e51668700 1 -- 172.21.15.1:0/2228950097 learned_addr learned my addr 172.21.15.1:0/2228950097 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.015+0000 7f5e51e69700 1 --2- 172.21.15.1:0/2228950097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e4c0aa060 0x7f5e4c0aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.015+0000 7f5e51668700 1 -- 172.21.15.1:0/2228950097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e4c0aa060 msgr2=0x7f5e4c0aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.015+0000 7f5e51668700 1 --2- 172.21.15.1:0/2228950097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e4c0aa060 0x7f5e4c0aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:00.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.015+0000 7f5e51668700 1 -- 172.21.15.1:0/2228950097 >> v1:172.21.15.141:6789/0 conn(0x7f5e4c0c1cb0 legacy=0x7f5e4c0c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.015+0000 7f5e51668700 1 -- 172.21.15.1:0/2228950097 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c0c0c30 con 0x7f5e4c157660 2023-11-15T01:39:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.015+0000 7f5e51668700 1 --2- 172.21.15.1:0/2228950097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e4c157660 0x7f5e4c157a40 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f5e44009f20 tx=0x7f5e44009840).ready entity=mon.0 client_cookie=51ca241794e7cfc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:00.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.015+0000 7f5e4bfff700 1 -- 172.21.15.1:0/2228950097 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400e070 con 0x7f5e4c157660 2023-11-15T01:39:00.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.015+0000 7f5e4bfff700 1 -- 172.21.15.1:0/2228950097 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4400b9d0 con 0x7f5e4c157660 2023-11-15T01:39:00.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.015+0000 7f5e4bfff700 1 -- 172.21.15.1:0/2228950097 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400bd50 con 0x7f5e4c157660 2023-11-15T01:39:00.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.016+0000 7f5e538cc700 1 -- 172.21.15.1:0/2228950097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e4c157660 msgr2=0x7f5e4c157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:00.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.016+0000 7f5e538cc700 1 --2- 172.21.15.1:0/2228950097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e4c157660 0x7f5e4c157a40 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f5e44009f20 tx=0x7f5e44009840).stop 2023-11-15T01:39:00.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.016+0000 7f5e538cc700 1 -- 172.21.15.1:0/2228950097 shutdown_connections 2023-11-15T01:39:00.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.016+0000 7f5e538cc700 1 --2- 172.21.15.1:0/2228950097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e4c0aa060 0x7f5e4c0aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:00.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.016+0000 7f5e538cc700 1 --2- 172.21.15.1:0/2228950097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e4c157660 0x7f5e4c157a40 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:00.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.016+0000 7f5e538cc700 1 -- 172.21.15.1:0/2228950097 >> 172.21.15.1:0/2228950097 conn(0x7f5e4c064aa0 msgr2=0x7f5e4c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:00.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.016+0000 7f5e538cc700 1 -- 172.21.15.1:0/2228950097 shutdown_connections 2023-11-15T01:39:00.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.016+0000 7f5e538cc700 1 -- 172.21.15.1:0/2228950097 wait complete. 2023-11-15T01:39:00.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.017+0000 7f5e538cc700 1 Processor -- start 2023-11-15T01:39:00.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.017+0000 7f5e538cc700 1 -- start start 2023-11-15T01:39:00.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e538cc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e4c0aa060 0x7f5e4c147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:00.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e538cc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e4c0c1cb0 0x7f5e4c168610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:00.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e538cc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e4c157660 0x7f5e4c155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:00.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e538cc700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c0c4710 con 0x7f5e4c0aa060 2023-11-15T01:39:00.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e538cc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c148490 con 0x7f5e4c0c1cb0 2023-11-15T01:39:00.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e538cc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c168b00 con 0x7f5e4c157660 2023-11-15T01:39:00.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e51668700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e4c0aa060 0x7f5e4c147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:00.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e51668700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e4c0aa060 0x7f5e4c147fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57536/0 (socket says 172.21.15.1:57536) 2023-11-15T01:39:00.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e51668700 1 -- 172.21.15.1:0/3579218805 learned_addr learned my addr 172.21.15.1:0/3579218805 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:00.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e50e67700 1 --2- 172.21.15.1:0/3579218805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e4c0c1cb0 0x7f5e4c168610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:00.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e51e69700 1 --2- 172.21.15.1:0/3579218805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e4c157660 0x7f5e4c155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:00.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e51668700 1 -- 172.21.15.1:0/3579218805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e4c157660 msgr2=0x7f5e4c155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:00.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e51668700 1 --2- 172.21.15.1:0/3579218805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e4c157660 0x7f5e4c155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:00.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e51668700 1 -- 172.21.15.1:0/3579218805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e4c0c1cb0 msgr2=0x7f5e4c168610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:00.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e51668700 1 --2- 172.21.15.1:0/3579218805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e4c0c1cb0 0x7f5e4c168610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:00.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e51668700 1 -- 172.21.15.1:0/3579218805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e44009ae0 con 0x7f5e4c0aa060 2023-11-15T01:39:00.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.018+0000 7f5e51668700 1 --2- 172.21.15.1:0/3579218805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e4c0aa060 0x7f5e4c147fa0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f5e4c083ed0 tx=0x7f5e44009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:00.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.019+0000 7f5e497fa700 1 -- 172.21.15.1:0/3579218805 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44007080 con 0x7f5e4c0aa060 2023-11-15T01:39:00.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.019+0000 7f5e497fa700 1 -- 172.21.15.1:0/3579218805 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e440092e0 con 0x7f5e4c0aa060 2023-11-15T01:39:00.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.019+0000 7f5e538cc700 1 -- 172.21.15.1:0/3579218805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4c0c3b00 con 0x7f5e4c0aa060 2023-11-15T01:39:00.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.019+0000 7f5e497fa700 1 -- 172.21.15.1:0/3579218805 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400bd70 con 0x7f5e4c0aa060 2023-11-15T01:39:00.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.019+0000 7f5e538cc700 1 -- 172.21.15.1:0/3579218805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4c0c40c0 con 0x7f5e4c0aa060 2023-11-15T01:39:00.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.020+0000 7f5e538cc700 1 -- 172.21.15.1:0/3579218805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4c06c7e0 con 0x7f5e4c0aa060 2023-11-15T01:39:00.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.020+0000 7f5e497fa700 1 -- 172.21.15.1:0/3579218805 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5e44003040 con 0x7f5e4c0aa060 2023-11-15T01:39:00.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.020+0000 7f5e497fa700 1 --2- 172.21.15.1:0/3579218805 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e3805f270 0x7f5e38061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:00.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.020+0000 7f5e497fa700 1 -- 172.21.15.1:0/3579218805 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5693+0+0 (secure 0 0 0) 0x7f5e4407b350 con 0x7f5e4c0aa060 2023-11-15T01:39:00.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.021+0000 7f5e50e67700 1 --2- 172.21.15.1:0/3579218805 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e3805f270 0x7f5e38061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:00.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.021+0000 7f5e50e67700 1 --2- 172.21.15.1:0/3579218805 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e3805f270 0x7f5e38061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5e4c156bb0 tx=0x7f5e40007d40).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:00.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.025+0000 7f5e497fa700 1 -- 172.21.15.1:0/3579218805 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5e4404c700 con 0x7f5e4c0aa060 2023-11-15T01:39:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:00.199+0000 7f5e538cc700 1 -- 172.21.15.1:0/3579218805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f5e4c0c0ef0 con 0x7f5e4c0aa060 2023-11-15T01:39:01.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.186+0000 7f5e497fa700 1 -- 172.21.15.1:0/3579218805 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v123) v1 ==== 152+0+0 (secure 0 0 0) 0x7f5e44022020 con 0x7f5e4c0aa060 2023-11-15T01:39:01.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.194+0000 7f5e538cc700 1 -- 172.21.15.1:0/3579218805 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e3805f270 msgr2=0x7f5e38061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:01.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.194+0000 7f5e538cc700 1 --2- 172.21.15.1:0/3579218805 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e3805f270 0x7f5e38061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5e4c156bb0 tx=0x7f5e40007d40).stop 2023-11-15T01:39:01.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.194+0000 7f5e538cc700 1 -- 172.21.15.1:0/3579218805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e4c0aa060 msgr2=0x7f5e4c147fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:01.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.194+0000 7f5e538cc700 1 --2- 172.21.15.1:0/3579218805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e4c0aa060 0x7f5e4c147fa0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f5e4c083ed0 tx=0x7f5e44009840).stop 2023-11-15T01:39:01.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.196+0000 7f5e538cc700 1 -- 172.21.15.1:0/3579218805 shutdown_connections 2023-11-15T01:39:01.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.197+0000 7f5e538cc700 1 --2- 172.21.15.1:0/3579218805 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e3805f270 0x7f5e38061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:01.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.197+0000 7f5e538cc700 1 --2- 172.21.15.1:0/3579218805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e4c157660 0x7f5e4c155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:01.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.197+0000 7f5e538cc700 1 --2- 172.21.15.1:0/3579218805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e4c0aa060 0x7f5e4c147fa0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:01.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.197+0000 7f5e538cc700 1 --2- 172.21.15.1:0/3579218805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e4c0c1cb0 0x7f5e4c168610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:01.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.197+0000 7f5e538cc700 1 -- 172.21.15.1:0/3579218805 >> 172.21.15.1:0/3579218805 conn(0x7f5e4c064aa0 msgr2=0x7f5e4c0c5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:01.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.197+0000 7f5e538cc700 1 -- 172.21.15.1:0/3579218805 shutdown_connections 2023-11-15T01:39:01.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.197+0000 7f5e538cc700 1 -- 172.21.15.1:0/3579218805 wait complete. 2023-11-15T01:39:01.201 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2023-11-15T01:39:01.215 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-15T01:39:01.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.349+0000 7f34da195700 1 Processor -- start 2023-11-15T01:39:01.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.349+0000 7f34da195700 1 -- start start 2023-11-15T01:39:01.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34da195700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34d41540a0 0x7f34d40ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:01.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34da195700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f34d4154480 0x7f34d40ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:01.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34da195700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d40ca050 con 0x7f34d40c5f40 2023-11-15T01:39:01.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34da195700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d40c9440 con 0x7f34d4154480 2023-11-15T01:39:01.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34da195700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40c9720 con 0x7f34d41540a0 2023-11-15T01:39:01.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34d2ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f34d4154480 0x7f34d40ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:01.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34d3fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f34d40c5f40 0x7f34d40aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47254/0 (socket says 172.21.15.1:47254) 2023-11-15T01:39:01.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34d2ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f34d4154480 0x7f34d40ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57552/0 (socket says 172.21.15.1:57552) 2023-11-15T01:39:01.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34d3fff700 1 -- 172.21.15.1:0/1724942920 learned_addr learned my addr 172.21.15.1:0/1724942920 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:39:01.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34d37fe700 1 --2- 172.21.15.1:0/1724942920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34d41540a0 0x7f34d40ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:01.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34d2ffd700 1 -- 172.21.15.1:0/1724942920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34d41540a0 msgr2=0x7f34d40ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:01.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34d2ffd700 1 --2- 172.21.15.1:0/1724942920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34d41540a0 0x7f34d40ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:01.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34d2ffd700 1 -- 172.21.15.1:0/1724942920 >> v1:172.21.15.1:6789/0 conn(0x7f34d40c5f40 legacy=0x7f34d40aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:01.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34d2ffd700 1 -- 172.21.15.1:0/1724942920 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d40c9a00 con 0x7f34d4154480 2023-11-15T01:39:01.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34d27fc700 1 -- 172.21.15.1:0/1724942920 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348734176 0 0) 0x7f34d40ca050 con 0x7f34d40c5f40 2023-11-15T01:39:01.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.350+0000 7f34d37fe700 1 --2- 172.21.15.1:0/1724942920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34d41540a0 0x7f34d40ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:39:01.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.351+0000 7f34d2ffd700 1 --2- 172.21.15.1:0/1724942920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34d4154480 0x7f34d40ca9d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f34c8009760 tx=0x7f34c8009060).ready entity=mon.0 client_cookie=2eee3c4a79b84079 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:01.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.351+0000 7f34d27fc700 1 -- 172.21.15.1:0/1724942920 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c800b580 con 0x7f34d4154480 2023-11-15T01:39:01.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.351+0000 7f34d27fc700 1 -- 172.21.15.1:0/1724942920 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c800b6e0 con 0x7f34d4154480 2023-11-15T01:39:01.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.351+0000 7f34d27fc700 1 -- 172.21.15.1:0/1724942920 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c800ba60 con 0x7f34d4154480 2023-11-15T01:39:01.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.351+0000 7f34da195700 1 -- 172.21.15.1:0/1724942920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34d4154480 msgr2=0x7f34d40ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:01.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.351+0000 7f34da195700 1 --2- 172.21.15.1:0/1724942920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34d4154480 0x7f34d40ca9d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f34c8009760 tx=0x7f34c8009060).stop 2023-11-15T01:39:01.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.351+0000 7f34da195700 1 -- 172.21.15.1:0/1724942920 shutdown_connections 2023-11-15T01:39:01.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.351+0000 7f34da195700 1 --2- 172.21.15.1:0/1724942920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34d41540a0 0x7f34d40ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:01.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.351+0000 7f34da195700 1 --2- 172.21.15.1:0/1724942920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34d4154480 0x7f34d40ca9d0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:01.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.351+0000 7f34da195700 1 -- 172.21.15.1:0/1724942920 >> 172.21.15.1:0/1724942920 conn(0x7f34d4064a70 msgr2=0x7f34d4064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:01.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.351+0000 7f34da195700 1 -- 172.21.15.1:0/1724942920 shutdown_connections 2023-11-15T01:39:01.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.351+0000 7f34da195700 1 -- 172.21.15.1:0/1724942920 wait complete. 2023-11-15T01:39:01.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.353+0000 7f34da195700 1 Processor -- start 2023-11-15T01:39:01.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.353+0000 7f34da195700 1 -- start start 2023-11-15T01:39:01.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.353+0000 7f34da195700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34d40c5f40 0x7f34d4153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:01.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.353+0000 7f34da195700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34d41540a0 0x7f34d40a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:01.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.353+0000 7f34da195700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34d4154480 0x7f34d40a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:01.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.353+0000 7f34da195700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40a41e0 con 0x7f34d40c5f40 2023-11-15T01:39:01.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.353+0000 7f34da195700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40a35d0 con 0x7f34d41540a0 2023-11-15T01:39:01.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.353+0000 7f34da195700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40a38b0 con 0x7f34d4154480 2023-11-15T01:39:01.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.353+0000 7f34d37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34d40c5f40 0x7f34d4153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:01.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.353+0000 7f34d37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34d40c5f40 0x7f34d4153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57568/0 (socket says 172.21.15.1:57568) 2023-11-15T01:39:01.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.353+0000 7f34d37fe700 1 -- 172.21.15.1:0/3270580842 learned_addr learned my addr 172.21.15.1:0/3270580842 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:01.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.354+0000 7f34d3fff700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34d4154480 0x7f34d40a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:01.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.354+0000 7f34d2ffd700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34d41540a0 0x7f34d40a27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:01.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.354+0000 7f34d37fe700 1 -- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34d4154480 msgr2=0x7f34d40a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:01.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.354+0000 7f34d37fe700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34d4154480 0x7f34d40a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:01.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.354+0000 7f34d37fe700 1 -- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34d41540a0 msgr2=0x7f34d40a27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:01.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.354+0000 7f34d37fe700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34d41540a0 0x7f34d40a27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:01.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.354+0000 7f34d37fe700 1 -- 172.21.15.1:0/3270580842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c80092a0 con 0x7f34d40c5f40 2023-11-15T01:39:01.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.354+0000 7f34d3fff700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34d4154480 0x7f34d40a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:39:01.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.354+0000 7f34d2ffd700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34d41540a0 0x7f34d40a27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:39:01.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.354+0000 7f34d37fe700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34d40c5f40 0x7f34d4153200 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f34c400c880 tx=0x7f34c4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:01.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.354+0000 7f34bb7fe700 1 -- 172.21.15.1:0/3270580842 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c4010580 con 0x7f34d40c5f40 2023-11-15T01:39:01.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.354+0000 7f34bb7fe700 1 -- 172.21.15.1:0/3270580842 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c40106e0 con 0x7f34d40c5f40 2023-11-15T01:39:01.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.354+0000 7f34da195700 1 -- 172.21.15.1:0/3270580842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d40a3b90 con 0x7f34d40c5f40 2023-11-15T01:39:01.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.354+0000 7f34bb7fe700 1 -- 172.21.15.1:0/3270580842 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c4010a80 con 0x7f34d40c5f40 2023-11-15T01:39:01.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.354+0000 7f34da195700 1 -- 172.21.15.1:0/3270580842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d41536f0 con 0x7f34d40c5f40 2023-11-15T01:39:01.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.355+0000 7f34da195700 1 -- 172.21.15.1:0/3270580842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d40a4030 con 0x7f34d40c5f40 2023-11-15T01:39:01.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.356+0000 7f34bb7fe700 1 -- 172.21.15.1:0/3270580842 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f34c401b460 con 0x7f34d40c5f40 2023-11-15T01:39:01.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.356+0000 7f34bb7fe700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f34c005f270 0x7f34c0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:01.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.356+0000 7f34bb7fe700 1 -- 172.21.15.1:0/3270580842 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f34c407a340 con 0x7f34d40c5f40 2023-11-15T01:39:01.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.356+0000 7f34d2ffd700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f34c005f270 0x7f34c0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:01.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.357+0000 7f34d2ffd700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f34c005f270 0x7f34c0061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f34c8009760 tx=0x7f34c8017000).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:01.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.361+0000 7f34bb7fe700 1 -- 172.21.15.1:0/3270580842 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f34c404b470 con 0x7f34d40c5f40 2023-11-15T01:39:01.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:01.534+0000 7f34da195700 1 -- 172.21.15.1:0/3270580842 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f34d40a44c0 con 0x7f34d40c5f40 2023-11-15T01:39:02.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.194+0000 7f34bb7fe700 1 -- 172.21.15.1:0/3270580842 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v124) v1 ==== 170+0+0 (secure 0 0 0) 0x7f34c404ea90 con 0x7f34d40c5f40 2023-11-15T01:39:02.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.206+0000 7f34da195700 1 -- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f34c005f270 msgr2=0x7f34c0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:02.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.206+0000 7f34da195700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f34c005f270 0x7f34c0061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f34c8009760 tx=0x7f34c8017000).stop 2023-11-15T01:39:02.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.206+0000 7f34da195700 1 -- 172.21.15.1:0/3270580842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34d40c5f40 msgr2=0x7f34d4153200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:02.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.206+0000 7f34da195700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34d40c5f40 0x7f34d4153200 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f34c400c880 tx=0x7f34c4008040).stop 2023-11-15T01:39:02.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.206+0000 7f34da195700 1 -- 172.21.15.1:0/3270580842 shutdown_connections 2023-11-15T01:39:02.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.206+0000 7f34da195700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f34c005f270 0x7f34c0061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.206+0000 7f34da195700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34d4154480 0x7f34d40a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.206+0000 7f34da195700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34d40c5f40 0x7f34d4153200 secure :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0x7f34c400c880 tx=0x7f34c4008040).stop 2023-11-15T01:39:02.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.206+0000 7f34da195700 1 --2- 172.21.15.1:0/3270580842 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34d41540a0 0x7f34d40a27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.206+0000 7f34da195700 1 -- 172.21.15.1:0/3270580842 >> 172.21.15.1:0/3270580842 conn(0x7f34d4064a70 msgr2=0x7f34d40ab760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:02.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.208+0000 7f34da195700 1 -- 172.21.15.1:0/3270580842 shutdown_connections 2023-11-15T01:39:02.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.209+0000 7f34da195700 1 -- 172.21.15.1:0/3270580842 wait complete. 2023-11-15T01:39:02.215 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2023-11-15T01:39:02.231 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-15T01:39:02.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.352+0000 7f7fb3cc6700 1 Processor -- start 2023-11-15T01:39:02.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.352+0000 7f7fb3cc6700 1 -- start start 2023-11-15T01:39:02.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.353+0000 7f7fb3cc6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7fac1540a0 0x7f7fac0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:02.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.353+0000 7f7fb3cc6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fac154480 0x7f7fac0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:02.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.353+0000 7f7fb3cc6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac0ca050 con 0x7f7fac0c5f40 2023-11-15T01:39:02.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.353+0000 7f7fb3cc6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac0c9440 con 0x7f7fac1540a0 2023-11-15T01:39:02.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.353+0000 7f7fb3cc6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0c9720 con 0x7f7fac154480 2023-11-15T01:39:02.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.353+0000 7f7fb2263700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7fac0c5f40 0x7f7fac0aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47270/0 (socket says 172.21.15.1:47270) 2023-11-15T01:39:02.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.353+0000 7f7fb2263700 1 -- 172.21.15.1:0/4230287855 learned_addr learned my addr 172.21.15.1:0/4230287855 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:39:02.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.353+0000 7f7fb1261700 1 --2- 172.21.15.1:0/4230287855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fac154480 0x7f7fac0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:02.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.353+0000 7f7fb1a62700 1 --2- 172.21.15.1:0/4230287855 >> v2:172.21.15.141:3300/0 conn(0x7f7fac1540a0 0x7f7fac0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:02.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.353+0000 7f7fb0a60700 1 -- 172.21.15.1:0/4230287855 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868385957 0 0) 0x7f7fac0ca050 con 0x7f7fac0c5f40 2023-11-15T01:39:02.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.353+0000 7f7fb0a60700 1 -- 172.21.15.1:0/4230287855 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f940033f0 con 0x7f7fac0c5f40 2023-11-15T01:39:02.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.354+0000 7f7fb1261700 1 -- 172.21.15.1:0/4230287855 >> v2:172.21.15.141:3300/0 conn(0x7f7fac1540a0 msgr2=0x7f7fac0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:02.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.354+0000 7f7fb1261700 1 --2- 172.21.15.1:0/4230287855 >> v2:172.21.15.141:3300/0 conn(0x7f7fac1540a0 0x7f7fac0ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.354+0000 7f7fb1261700 1 -- 172.21.15.1:0/4230287855 >> v1:172.21.15.1:6789/0 conn(0x7f7fac0c5f40 legacy=0x7f7fac0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:02.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.354+0000 7f7fb1261700 1 -- 172.21.15.1:0/4230287855 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac0c9a00 con 0x7f7fac154480 2023-11-15T01:39:02.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.354+0000 7f7fb1a62700 1 --2- 172.21.15.1:0/4230287855 >> v2:172.21.15.141:3300/0 conn(0x7f7fac1540a0 0x7f7fac0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:39:02.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.354+0000 7f7fb1261700 1 --2- 172.21.15.1:0/4230287855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fac154480 0x7f7fac0ca9d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f7fa0009760 tx=0x7f7fa0009060).ready entity=mon.2 client_cookie=114d200e77b30317 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:02.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.354+0000 7f7fb0a60700 1 -- 172.21.15.1:0/4230287855 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa000d4a0 con 0x7f7fac154480 2023-11-15T01:39:02.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.354+0000 7f7fb0a60700 1 -- 172.21.15.1:0/4230287855 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa000d600 con 0x7f7fac154480 2023-11-15T01:39:02.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.354+0000 7f7fb0a60700 1 -- 172.21.15.1:0/4230287855 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa000d980 con 0x7f7fac154480 2023-11-15T01:39:02.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.354+0000 7f7fb3cc6700 1 -- 172.21.15.1:0/4230287855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fac154480 msgr2=0x7f7fac0ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:02.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.354+0000 7f7fb3cc6700 1 --2- 172.21.15.1:0/4230287855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fac154480 0x7f7fac0ca9d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f7fa0009760 tx=0x7f7fa0009060).stop 2023-11-15T01:39:02.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.354+0000 7f7fb3cc6700 1 -- 172.21.15.1:0/4230287855 shutdown_connections 2023-11-15T01:39:02.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.354+0000 7f7fb3cc6700 1 --2- 172.21.15.1:0/4230287855 >> v2:172.21.15.141:3300/0 conn(0x7f7fac1540a0 0x7f7fac0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.354+0000 7f7fb3cc6700 1 --2- 172.21.15.1:0/4230287855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fac154480 0x7f7fac0ca9d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.354+0000 7f7fb3cc6700 1 -- 172.21.15.1:0/4230287855 >> 172.21.15.1:0/4230287855 conn(0x7f7fac064a70 msgr2=0x7f7fac064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:02.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.355+0000 7f7fb3cc6700 1 -- 172.21.15.1:0/4230287855 shutdown_connections 2023-11-15T01:39:02.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.355+0000 7f7fb3cc6700 1 -- 172.21.15.1:0/4230287855 wait complete. 2023-11-15T01:39:02.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.356+0000 7f7fb3cc6700 1 Processor -- start 2023-11-15T01:39:02.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.356+0000 7f7fb3cc6700 1 -- start start 2023-11-15T01:39:02.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.356+0000 7f7fb3cc6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fac0c5f40 0x7f7fac1493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:02.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.356+0000 7f7fb3cc6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fac1540a0 0x7f7fac0a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:02.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.356+0000 7f7fb3cc6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fac154480 0x7f7fac0a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:02.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.356+0000 7f7fb3cc6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0a31e0 con 0x7f7fac154480 2023-11-15T01:39:02.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.356+0000 7f7fb3cc6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0a5140 con 0x7f7fac1540a0 2023-11-15T01:39:02.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.356+0000 7f7fb3cc6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0a2560 con 0x7f7fac0c5f40 2023-11-15T01:39:02.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.356+0000 7f7fb2263700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fac154480 0x7f7fac0a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:02.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.356+0000 7f7fb2263700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fac154480 0x7f7fac0a4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57576/0 (socket says 172.21.15.1:57576) 2023-11-15T01:39:02.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.356+0000 7f7fb2263700 1 -- 172.21.15.1:0/3378838391 learned_addr learned my addr 172.21.15.1:0/3378838391 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:02.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.357+0000 7f7fb1a62700 1 --2- 172.21.15.1:0/3378838391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fac0c5f40 0x7f7fac1493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:02.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.357+0000 7f7fb1261700 1 --2- 172.21.15.1:0/3378838391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fac1540a0 0x7f7fac0a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:02.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.357+0000 7f7fb2263700 1 -- 172.21.15.1:0/3378838391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fac0c5f40 msgr2=0x7f7fac1493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:02.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.357+0000 7f7fb2263700 1 --2- 172.21.15.1:0/3378838391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fac0c5f40 0x7f7fac1493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.357+0000 7f7fb2263700 1 -- 172.21.15.1:0/3378838391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fac1540a0 msgr2=0x7f7fac0a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:02.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.357+0000 7f7fb2263700 1 --2- 172.21.15.1:0/3378838391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fac1540a0 0x7f7fac0a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.357+0000 7f7fb2263700 1 -- 172.21.15.1:0/3378838391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa40092a0 con 0x7f7fac154480 2023-11-15T01:39:02.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.357+0000 7f7fb1261700 1 --2- 172.21.15.1:0/3378838391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fac1540a0 0x7f7fac0a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:39:02.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.357+0000 7f7fb2263700 1 --2- 172.21.15.1:0/3378838391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fac154480 0x7f7fac0a4c50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f7f9c005ad0 tx=0x7f7f9c0015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:02.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.357+0000 7f7fa9ffb700 1 -- 172.21.15.1:0/3378838391 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c005d30 con 0x7f7fac154480 2023-11-15T01:39:02.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.357+0000 7f7fa9ffb700 1 -- 172.21.15.1:0/3378838391 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c005e90 con 0x7f7fac154480 2023-11-15T01:39:02.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.357+0000 7f7fa9ffb700 1 -- 172.21.15.1:0/3378838391 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c007320 con 0x7f7fac154480 2023-11-15T01:39:02.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.357+0000 7f7fb3cc6700 1 -- 172.21.15.1:0/3378838391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa00092a0 con 0x7f7fac154480 2023-11-15T01:39:02.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.357+0000 7f7fb3cc6700 1 -- 172.21.15.1:0/3378838391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac0a2b20 con 0x7f7fac154480 2023-11-15T01:39:02.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.358+0000 7f7fb3cc6700 1 -- 172.21.15.1:0/3378838391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac0a3320 con 0x7f7fac154480 2023-11-15T01:39:02.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.359+0000 7f7fa9ffb700 1 -- 172.21.15.1:0/3378838391 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7f9c007710 con 0x7f7fac154480 2023-11-15T01:39:02.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.359+0000 7f7fa9ffb700 1 --2- 172.21.15.1:0/3378838391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7f9805f240 0x7f7f98061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:02.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.359+0000 7f7fa9ffb700 1 -- 172.21.15.1:0/3378838391 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f7f9c07a460 con 0x7f7fac154480 2023-11-15T01:39:02.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.359+0000 7f7fb1a62700 1 --2- 172.21.15.1:0/3378838391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7f9805f240 0x7f7f98061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:02.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.359+0000 7f7fb1a62700 1 --2- 172.21.15.1:0/3378838391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7f9805f240 0x7f7f98061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7fa4009d20 tx=0x7f7fa4009060).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:02.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.363+0000 7f7fa9ffb700 1 -- 172.21.15.1:0/3378838391 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7fac0a3320 con 0x7f7fac154480 2023-11-15T01:39:02.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.581+0000 7f7fb3cc6700 1 -- 172.21.15.1:0/3378838391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7fac0a3320 con 0x7f7fac154480 2023-11-15T01:39:02.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.587+0000 7f7fa9ffb700 1 -- 172.21.15.1:0/3378838391 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v51) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7fac0a3320 con 0x7f7fac154480 2023-11-15T01:39:02.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.593+0000 7f7fb3cc6700 1 -- 172.21.15.1:0/3378838391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7f9805f240 msgr2=0x7f7f98061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:02.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.593+0000 7f7fb3cc6700 1 --2- 172.21.15.1:0/3378838391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7f9805f240 0x7f7f98061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7fa4009d20 tx=0x7f7fa4009060).stop 2023-11-15T01:39:02.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.594+0000 7f7fb3cc6700 1 -- 172.21.15.1:0/3378838391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fac154480 msgr2=0x7f7fac0a4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:02.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.594+0000 7f7fb3cc6700 1 --2- 172.21.15.1:0/3378838391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fac154480 0x7f7fac0a4c50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f7f9c005ad0 tx=0x7f7f9c0015b0).stop 2023-11-15T01:39:02.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.594+0000 7f7fb3cc6700 1 -- 172.21.15.1:0/3378838391 shutdown_connections 2023-11-15T01:39:02.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.594+0000 7f7fb3cc6700 1 --2- 172.21.15.1:0/3378838391 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7f9805f240 0x7f7f98061700 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0x7f7fa4009d20 tx=0x7f7fa4009060).stop 2023-11-15T01:39:02.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.594+0000 7f7fb3cc6700 1 --2- 172.21.15.1:0/3378838391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7fac154480 0x7f7fac0a4c50 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.594+0000 7f7fb3cc6700 1 --2- 172.21.15.1:0/3378838391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fac0c5f40 0x7f7fac1493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.594+0000 7f7fb3cc6700 1 --2- 172.21.15.1:0/3378838391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fac1540a0 0x7f7fac0a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.594+0000 7f7fb3cc6700 1 -- 172.21.15.1:0/3378838391 >> 172.21.15.1:0/3378838391 conn(0x7f7fac064a70 msgr2=0x7f7fac0c0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:02.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.596+0000 7f7fb3cc6700 1 -- 172.21.15.1:0/3378838391 shutdown_connections 2023-11-15T01:39:02.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.596+0000 7f7fb3cc6700 1 -- 172.21.15.1:0/3378838391 wait complete. 2023-11-15T01:39:02.612 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 15 and data pool 16 2023-11-15T01:39:02.621 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:39:02.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.738+0000 7fcfe61af700 1 Processor -- start 2023-11-15T01:39:02.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.738+0000 7fcfe61af700 1 -- start start 2023-11-15T01:39:02.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.739+0000 7fcfe61af700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe0151e10 0x7fcfe0155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:02.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.739+0000 7fcfe61af700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcfe00c98b0 0x7fcfe00c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:02.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.739+0000 7fcfe61af700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe00c7980 con 0x7fcfe00c86b0 2023-11-15T01:39:02.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.739+0000 7fcfe61af700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe00c8b10 con 0x7fcfe00c98b0 2023-11-15T01:39:02.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.739+0000 7fcfe61af700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00ca230 con 0x7fcfe0151e10 2023-11-15T01:39:02.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.739+0000 7fcfe59ae700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcfe00c98b0 0x7fcfe00c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:02.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.739+0000 7fcfe49ac700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fcfe00c86b0 0x7fcfe00aa0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47284/0 (socket says 172.21.15.1:47284) 2023-11-15T01:39:02.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.739+0000 7fcfe59ae700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcfe00c98b0 0x7fcfe00c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57590/0 (socket says 172.21.15.1:57590) 2023-11-15T01:39:02.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.739+0000 7fcfe49ac700 1 -- 172.21.15.1:0/3444470775 learned_addr learned my addr 172.21.15.1:0/3444470775 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:39:02.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.739+0000 7fcfe51ad700 1 --2- 172.21.15.1:0/3444470775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe0151e10 0x7fcfe0155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:02.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.739+0000 7fcfe59ae700 1 -- 172.21.15.1:0/3444470775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe0151e10 msgr2=0x7fcfe0155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:02.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.739+0000 7fcfdffff700 1 -- 172.21.15.1:0/3444470775 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327343028 0 0) 0x7fcfe00c7980 con 0x7fcfe00c86b0 2023-11-15T01:39:02.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.739+0000 7fcfe59ae700 1 --2- 172.21.15.1:0/3444470775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe0151e10 0x7fcfe0155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.739+0000 7fcfe59ae700 1 -- 172.21.15.1:0/3444470775 >> v1:172.21.15.1:6789/0 conn(0x7fcfe00c86b0 legacy=0x7fcfe00aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:02.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.739+0000 7fcfe59ae700 1 -- 172.21.15.1:0/3444470775 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe00aa890 con 0x7fcfe00c98b0 2023-11-15T01:39:02.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.740+0000 7fcfe59ae700 1 --2- 172.21.15.1:0/3444470775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe00c98b0 0x7fcfe00c9d40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7fcfd8009760 tx=0x7fcfd8009060).ready entity=mon.0 client_cookie=b78207a59582afc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:02.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.740+0000 7fcfdffff700 1 -- 172.21.15.1:0/3444470775 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800f510 con 0x7fcfe00c98b0 2023-11-15T01:39:02.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.740+0000 7fcfdffff700 1 -- 172.21.15.1:0/3444470775 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd800f670 con 0x7fcfe00c98b0 2023-11-15T01:39:02.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.740+0000 7fcfdffff700 1 -- 172.21.15.1:0/3444470775 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800f9f0 con 0x7fcfe00c98b0 2023-11-15T01:39:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.740+0000 7fcfe61af700 1 -- 172.21.15.1:0/3444470775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe00c98b0 msgr2=0x7fcfe00c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.740+0000 7fcfe61af700 1 --2- 172.21.15.1:0/3444470775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe00c98b0 0x7fcfe00c9d40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7fcfd8009760 tx=0x7fcfd8009060).stop 2023-11-15T01:39:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.740+0000 7fcfe61af700 1 -- 172.21.15.1:0/3444470775 shutdown_connections 2023-11-15T01:39:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.740+0000 7fcfe61af700 1 --2- 172.21.15.1:0/3444470775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe00c98b0 0x7fcfe00c9d40 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.740+0000 7fcfe61af700 1 --2- 172.21.15.1:0/3444470775 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe0151e10 0x7fcfe0155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.740+0000 7fcfe61af700 1 -- 172.21.15.1:0/3444470775 >> 172.21.15.1:0/3444470775 conn(0x7fcfe00947e0 msgr2=0x7fcfe006a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:02.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.740+0000 7fcfe61af700 1 -- 172.21.15.1:0/3444470775 shutdown_connections 2023-11-15T01:39:02.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.740+0000 7fcfe61af700 1 -- 172.21.15.1:0/3444470775 wait complete. 2023-11-15T01:39:02.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.741+0000 7fcfe61af700 1 Processor -- start 2023-11-15T01:39:02.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.741+0000 7fcfe61af700 1 -- start start 2023-11-15T01:39:02.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.742+0000 7fcfe61af700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe00c86b0 0x7fcfe00af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:02.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.742+0000 7fcfe61af700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe00c98b0 0x7fcfe00acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:02.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.742+0000 7fcfe61af700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfe0151e10 0x7fcfe00b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:02.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.742+0000 7fcfe61af700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe0163e80 con 0x7fcfe00c86b0 2023-11-15T01:39:02.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.742+0000 7fcfe61af700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00affb0 con 0x7fcfe0151e10 2023-11-15T01:39:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.742+0000 7fcfe61af700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe01640f0 con 0x7fcfe00c98b0 2023-11-15T01:39:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.742+0000 7fcfe51ad700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe00c86b0 0x7fcfe00af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:02.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.742+0000 7fcfe51ad700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe00c86b0 0x7fcfe00af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57600/0 (socket says 172.21.15.1:57600) 2023-11-15T01:39:02.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.742+0000 7fcfe51ad700 1 -- 172.21.15.1:0/1611679312 learned_addr learned my addr 172.21.15.1:0/1611679312 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:02.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.743+0000 7fcfe59ae700 1 --2- 172.21.15.1:0/1611679312 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfe0151e10 0x7fcfe00b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:02.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.743+0000 7fcfe49ac700 1 --2- 172.21.15.1:0/1611679312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe00c98b0 0x7fcfe00acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:02.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.743+0000 7fcfe51ad700 1 -- 172.21.15.1:0/1611679312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe00c98b0 msgr2=0x7fcfe00acba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:02.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.743+0000 7fcfe51ad700 1 --2- 172.21.15.1:0/1611679312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe00c98b0 0x7fcfe00acba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.743+0000 7fcfe51ad700 1 -- 172.21.15.1:0/1611679312 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfe0151e10 msgr2=0x7fcfe00b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:02.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.743+0000 7fcfe51ad700 1 --2- 172.21.15.1:0/1611679312 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfe0151e10 0x7fcfe00b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.743+0000 7fcfe51ad700 1 -- 172.21.15.1:0/1611679312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd80092a0 con 0x7fcfe00c86b0 2023-11-15T01:39:02.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.743+0000 7fcfe59ae700 1 --2- 172.21.15.1:0/1611679312 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfe0151e10 0x7fcfe00b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:39:02.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.743+0000 7fcfe51ad700 1 --2- 172.21.15.1:0/1611679312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe00c86b0 0x7fcfe00af080 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fcfd0009ea0 tx=0x7fcfd000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:02.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.743+0000 7fcfdd7fa700 1 -- 172.21.15.1:0/1611679312 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd000cba0 con 0x7fcfe00c86b0 2023-11-15T01:39:02.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.743+0000 7fcfdd7fa700 1 -- 172.21.15.1:0/1611679312 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd000f040 con 0x7fcfe00c86b0 2023-11-15T01:39:02.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.743+0000 7fcfe61af700 1 -- 172.21.15.1:0/1611679312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe00ad090 con 0x7fcfe00c86b0 2023-11-15T01:39:02.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.743+0000 7fcfdd7fa700 1 -- 172.21.15.1:0/1611679312 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0013400 con 0x7fcfe00c86b0 2023-11-15T01:39:02.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.743+0000 7fcfe61af700 1 -- 172.21.15.1:0/1611679312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe00af710 con 0x7fcfe00c86b0 2023-11-15T01:39:02.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.744+0000 7fcfe61af700 1 -- 172.21.15.1:0/1611679312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe00475e0 con 0x7fcfe00c86b0 2023-11-15T01:39:02.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.744+0000 7fcfdd7fa700 1 -- 172.21.15.1:0/1611679312 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcfd00137b0 con 0x7fcfe00c86b0 2023-11-15T01:39:02.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.745+0000 7fcfdd7fa700 1 --2- 172.21.15.1:0/1611679312 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfcc05f270 0x7fcfcc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:02.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.745+0000 7fcfdd7fa700 1 -- 172.21.15.1:0/1611679312 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fcfd007add0 con 0x7fcfe00c86b0 2023-11-15T01:39:02.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.745+0000 7fcfe49ac700 1 --2- 172.21.15.1:0/1611679312 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfcc05f270 0x7fcfcc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:02.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.745+0000 7fcfe49ac700 1 --2- 172.21.15.1:0/1611679312 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfcc05f270 0x7fcfcc061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcfe0065580 tx=0x7fcfd4009040).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:02.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.749+0000 7fcfdd7fa700 1 -- 172.21.15.1:0/1611679312 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcfd004bd70 con 0x7fcfe00c86b0 2023-11-15T01:39:02.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.922+0000 7fcfe61af700 1 -- 172.21.15.1:0/1611679312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfe00afe10 con 0x7fcfe00c86b0 2023-11-15T01:39:02.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.923+0000 7fcfdd7fa700 1 -- 172.21.15.1:0/1611679312 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+17552 (secure 0 0 0) 0x7fcfe00afe10 con 0x7fcfe00c86b0 2023-11-15T01:39:02.925 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:39:02.925 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":125,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:39:02.583524+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:39:00.237361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-15T01:39:01.572293+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:39:02.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.925+0000 7fcfe61af700 1 -- 172.21.15.1:0/1611679312 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfcc05f270 msgr2=0x7fcfcc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:02.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.925+0000 7fcfe61af700 1 --2- 172.21.15.1:0/1611679312 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfcc05f270 0x7fcfcc061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcfe0065580 tx=0x7fcfd4009040).stop 2023-11-15T01:39:02.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.925+0000 7fcfe61af700 1 -- 172.21.15.1:0/1611679312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe00c86b0 msgr2=0x7fcfe00af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:02.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.925+0000 7fcfe61af700 1 --2- 172.21.15.1:0/1611679312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe00c86b0 0x7fcfe00af080 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fcfd0009ea0 tx=0x7fcfd000b040).stop 2023-11-15T01:39:02.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.925+0000 7fcfe61af700 1 -- 172.21.15.1:0/1611679312 shutdown_connections 2023-11-15T01:39:02.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.925+0000 7fcfe61af700 1 --2- 172.21.15.1:0/1611679312 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfcc05f270 0x7fcfcc061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.925+0000 7fcfe61af700 1 --2- 172.21.15.1:0/1611679312 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfe0151e10 0x7fcfe00b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.925+0000 7fcfe61af700 1 --2- 172.21.15.1:0/1611679312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe00c86b0 0x7fcfe00af080 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.925+0000 7fcfe61af700 1 --2- 172.21.15.1:0/1611679312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe00c98b0 0x7fcfe00acba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:02.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.925+0000 7fcfe61af700 1 -- 172.21.15.1:0/1611679312 >> 172.21.15.1:0/1611679312 conn(0x7fcfe00947e0 msgr2=0x7fcfe0154200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:02.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.925+0000 7fcfe61af700 1 -- 172.21.15.1:0/1611679312 shutdown_connections 2023-11-15T01:39:02.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:02.925+0000 7fcfe61af700 1 -- 172.21.15.1:0/1611679312 wait complete. 2023-11-15T01:39:02.939 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:39:03.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.056+0000 7f918a9bd700 1 Processor -- start 2023-11-15T01:39:03.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.056+0000 7f918a9bd700 1 -- start start 2023-11-15T01:39:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.057+0000 7f918a9bd700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f91840bd130 0x7f91840c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.057+0000 7f918a9bd700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918406a6b0 con 0x7f9184154680 2023-11-15T01:39:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.057+0000 7f918a9bd700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91840c3360 con 0x7f91840bccd0 2023-11-15T01:39:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.057+0000 7f918a9bd700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91840c2750 con 0x7f91840bd130 2023-11-15T01:39:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.057+0000 7f9183fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9184154680 0x7f9184069fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47292/0 (socket says 172.21.15.1:47292) 2023-11-15T01:39:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.057+0000 7f9183fff700 1 -- 172.21.15.1:0/2185854340 learned_addr learned my addr 172.21.15.1:0/2185854340 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:39:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.057+0000 7f9188f5a700 1 --2- 172.21.15.1:0/2185854340 >> v2:172.21.15.141:3300/0 conn(0x7f91840bd130 0x7f91840c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.057+0000 7f9182ffd700 1 -- 172.21.15.1:0/2185854340 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932572211 0 0) 0x7f918406a6b0 con 0x7f9184154680 2023-11-15T01:39:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.057+0000 7f9182ffd700 1 -- 172.21.15.1:0/2185854340 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91700033f0 con 0x7f9184154680 2023-11-15T01:39:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.057+0000 7f9188f5a700 1 -- 172.21.15.1:0/2185854340 >> v1:172.21.15.141:6789/0 conn(0x7f91840bccd0 legacy=0x7f91840c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:03.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.057+0000 7f9182ffd700 1 -- 172.21.15.1:0/2185854340 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149689000 0 0) 0x7f91840c3360 con 0x7f91840bccd0 2023-11-15T01:39:03.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.057+0000 7f9188f5a700 1 -- 172.21.15.1:0/2185854340 >> v1:172.21.15.1:6789/0 conn(0x7f9184154680 legacy=0x7f9184069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:03.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.057+0000 7f9188f5a700 1 -- 172.21.15.1:0/2185854340 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91840c2a30 con 0x7f91840bd130 2023-11-15T01:39:03.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.057+0000 7f9188f5a700 1 --2- 172.21.15.1:0/2185854340 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91840bd130 0x7f91840c67c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f917c009e60 tx=0x7f917c009780).ready entity=mon.1 client_cookie=5abb0909efb21e8e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:03.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.058+0000 7f9182ffd700 1 -- 172.21.15.1:0/2185854340 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c00e070 con 0x7f91840bd130 2023-11-15T01:39:03.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.058+0000 7f9182ffd700 1 -- 172.21.15.1:0/2185854340 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917c00bb60 con 0x7f91840bd130 2023-11-15T01:39:03.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.058+0000 7f9182ffd700 1 -- 172.21.15.1:0/2185854340 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c00bee0 con 0x7f91840bd130 2023-11-15T01:39:03.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.058+0000 7f918a9bd700 1 -- 172.21.15.1:0/2185854340 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91840bd130 msgr2=0x7f91840c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:03.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.058+0000 7f918a9bd700 1 --2- 172.21.15.1:0/2185854340 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91840bd130 0x7f91840c67c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f917c009e60 tx=0x7f917c009780).stop 2023-11-15T01:39:03.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.058+0000 7f918a9bd700 1 -- 172.21.15.1:0/2185854340 shutdown_connections 2023-11-15T01:39:03.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.058+0000 7f918a9bd700 1 --2- 172.21.15.1:0/2185854340 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91840bd130 0x7f91840c67c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:03.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.058+0000 7f918a9bd700 1 -- 172.21.15.1:0/2185854340 >> 172.21.15.1:0/2185854340 conn(0x7f91840c7d70 msgr2=0x7f91840c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:03.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.058+0000 7f918a9bd700 1 -- 172.21.15.1:0/2185854340 shutdown_connections 2023-11-15T01:39:03.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.058+0000 7f918a9bd700 1 -- 172.21.15.1:0/2185854340 wait complete. 2023-11-15T01:39:03.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.059+0000 7f918a9bd700 1 Processor -- start 2023-11-15T01:39:03.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.059+0000 7f918a9bd700 1 -- start start 2023-11-15T01:39:03.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.060+0000 7f918a9bd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91840bccd0 0x7f91840ad870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:03.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.060+0000 7f918a9bd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91840bd130 0x7f91840a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:03.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.060+0000 7f918a9bd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9184154680 0x7f9184151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:03.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.060+0000 7f918a9bd700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9184151e30 con 0x7f91840bccd0 2023-11-15T01:39:03.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.060+0000 7f918a9bd700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91840a9af0 con 0x7f91840bd130 2023-11-15T01:39:03.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.060+0000 7f918a9bd700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91840add60 con 0x7f9184154680 2023-11-15T01:39:03.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.060+0000 7f9183fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91840bccd0 0x7f91840ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:03.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.060+0000 7f9183fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91840bccd0 0x7f91840ad870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57610/0 (socket says 172.21.15.1:57610) 2023-11-15T01:39:03.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.060+0000 7f9183fff700 1 -- 172.21.15.1:0/673192695 learned_addr learned my addr 172.21.15.1:0/673192695 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:03.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.060+0000 7f91837fe700 1 --2- 172.21.15.1:0/673192695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91840bd130 0x7f91840a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:03.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.060+0000 7f9188f5a700 1 --2- 172.21.15.1:0/673192695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9184154680 0x7f9184151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:03.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.061+0000 7f9183fff700 1 -- 172.21.15.1:0/673192695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9184154680 msgr2=0x7f9184151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:03.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.061+0000 7f9183fff700 1 --2- 172.21.15.1:0/673192695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9184154680 0x7f9184151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:03.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.061+0000 7f9183fff700 1 -- 172.21.15.1:0/673192695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91840bd130 msgr2=0x7f91840a9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:03.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.061+0000 7f9183fff700 1 --2- 172.21.15.1:0/673192695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91840bd130 0x7f91840a9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:03.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.061+0000 7f9183fff700 1 -- 172.21.15.1:0/673192695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c009a20 con 0x7f91840bccd0 2023-11-15T01:39:03.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.061+0000 7f9183fff700 1 --2- 172.21.15.1:0/673192695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91840bccd0 0x7f91840ad870 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f917400c410 tx=0x7f9174007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:03.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.061+0000 7f917bfff700 1 -- 172.21.15.1:0/673192695 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91740070d0 con 0x7f91840bccd0 2023-11-15T01:39:03.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.061+0000 7f917bfff700 1 -- 172.21.15.1:0/673192695 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9174007230 con 0x7f91840bccd0 2023-11-15T01:39:03.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.061+0000 7f918a9bd700 1 -- 172.21.15.1:0/673192695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91840a8ee0 con 0x7f91840bccd0 2023-11-15T01:39:03.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.061+0000 7f917bfff700 1 -- 172.21.15.1:0/673192695 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91740075d0 con 0x7f91840bccd0 2023-11-15T01:39:03.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.061+0000 7f918a9bd700 1 -- 172.21.15.1:0/673192695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91840a9780 con 0x7f91840bccd0 2023-11-15T01:39:03.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.062+0000 7f918a9bd700 1 -- 172.21.15.1:0/673192695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91840a9dd0 con 0x7f91840bccd0 2023-11-15T01:39:03.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.062+0000 7f917bfff700 1 -- 172.21.15.1:0/673192695 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f91740059b0 con 0x7f91840bccd0 2023-11-15T01:39:03.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.063+0000 7f917bfff700 1 --2- 172.21.15.1:0/673192695 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f916405f270 0x7f9164061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:03.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.063+0000 7f917bfff700 1 -- 172.21.15.1:0/673192695 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f9174079b10 con 0x7f91840bccd0 2023-11-15T01:39:03.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.063+0000 7f91837fe700 1 --2- 172.21.15.1:0/673192695 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f916405f270 0x7f9164061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:03.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.063+0000 7f91837fe700 1 --2- 172.21.15.1:0/673192695 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f916405f270 0x7f9164061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f916c007fd0 tx=0x7f916c007bb0).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:03.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.067+0000 7f917bfff700 1 -- 172.21.15.1:0/673192695 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f917404aab0 con 0x7f91840bccd0 2023-11-15T01:39:03.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.239+0000 7f918a9bd700 1 -- 172.21.15.1:0/673192695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f918406c7e0 con 0x7f91840bccd0 2023-11-15T01:39:03.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.239+0000 7f917bfff700 1 -- 172.21.15.1:0/673192695 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+17552 (secure 0 0 0) 0x7f9174018030 con 0x7f91840bccd0 2023-11-15T01:39:03.241 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:39:03.241 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":125,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:39:02.583524+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:39:00.237361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-15T01:39:01.572293+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:39:03.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.241+0000 7f918a9bd700 1 -- 172.21.15.1:0/673192695 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f916405f270 msgr2=0x7f9164061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:03.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.241+0000 7f918a9bd700 1 --2- 172.21.15.1:0/673192695 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f916405f270 0x7f9164061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f916c007fd0 tx=0x7f916c007bb0).stop 2023-11-15T01:39:03.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.241+0000 7f918a9bd700 1 -- 172.21.15.1:0/673192695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91840bccd0 msgr2=0x7f91840ad870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:03.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.241+0000 7f918a9bd700 1 --2- 172.21.15.1:0/673192695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91840bccd0 0x7f91840ad870 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f917400c410 tx=0x7f9174007c70).stop 2023-11-15T01:39:03.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.241+0000 7f918a9bd700 1 -- 172.21.15.1:0/673192695 shutdown_connections 2023-11-15T01:39:03.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.241+0000 7f918a9bd700 1 --2- 172.21.15.1:0/673192695 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f916405f270 0x7f9164061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:03.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.241+0000 7f918a9bd700 1 --2- 172.21.15.1:0/673192695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9184154680 0x7f9184151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:03.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.241+0000 7f918a9bd700 1 --2- 172.21.15.1:0/673192695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91840bccd0 0x7f91840ad870 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:03.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.241+0000 7f918a9bd700 1 --2- 172.21.15.1:0/673192695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f91840bd130 0x7f91840a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:03.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.241+0000 7f918a9bd700 1 -- 172.21.15.1:0/673192695 >> 172.21.15.1:0/673192695 conn(0x7f91840c7d70 msgr2=0x7f9184066300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:03.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.241+0000 7f918a9bd700 1 -- 172.21.15.1:0/673192695 shutdown_connections 2023-11-15T01:39:03.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.241+0000 7f918a9bd700 1 -- 172.21.15.1:0/673192695 wait complete. 2023-11-15T01:39:03.255 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-15T01:39:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.375+0000 7f82c56e6700 1 Processor -- start 2023-11-15T01:39:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.375+0000 7f82c56e6700 1 -- start start 2023-11-15T01:39:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.376+0000 7f82c56e6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82c01540a0 0x7f82c00ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.376+0000 7f82c56e6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f82c0154480 0x7f82c00ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.376+0000 7f82c56e6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f82c00c5f40 0x7f82c00c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.376+0000 7f82c56e6700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c00c68e0 con 0x7f82c0154480 2023-11-15T01:39:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.376+0000 7f82c56e6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c00ca050 con 0x7f82c00c5f40 2023-11-15T01:39:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.376+0000 7f82c56e6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00c9440 con 0x7f82c01540a0 2023-11-15T01:39:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.376+0000 7f82be7fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f82c0154480 0x7f82c00ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.376+0000 7f82be7fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f82c0154480 0x7f82c00ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57620/0 (socket says 172.21.15.1:57620) 2023-11-15T01:39:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.376+0000 7f82be7fc700 1 -- 172.21.15.1:0/260897089 learned_addr learned my addr 172.21.15.1:0/260897089 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.376+0000 7f82bf7fe700 1 --2- 172.21.15.1:0/260897089 >> v2:172.21.15.141:3300/0 conn(0x7f82c00c5f40 0x7f82c00c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.376+0000 7f82beffd700 1 --2- 172.21.15.1:0/260897089 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82c01540a0 0x7f82c00ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82be7fc700 1 -- 172.21.15.1:0/260897089 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82c01540a0 msgr2=0x7f82c00ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82be7fc700 1 --2- 172.21.15.1:0/260897089 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82c01540a0 0x7f82c00ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82be7fc700 1 -- 172.21.15.1:0/260897089 >> v2:172.21.15.141:3300/0 conn(0x7f82c00c5f40 msgr2=0x7f82c00c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82be7fc700 1 --2- 172.21.15.1:0/260897089 >> v2:172.21.15.141:3300/0 conn(0x7f82c00c5f40 0x7f82c00c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82be7fc700 1 -- 172.21.15.1:0/260897089 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c00c9720 con 0x7f82c0154480 2023-11-15T01:39:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82bf7fe700 1 --2- 172.21.15.1:0/260897089 >> v2:172.21.15.141:3300/0 conn(0x7f82c00c5f40 0x7f82c00c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:39:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82be7fc700 1 --2- 172.21.15.1:0/260897089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c0154480 0x7f82c00ca9d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f82c00aad10 tx=0x7f82a80090f0).ready entity=mon.0 client_cookie=6aa512efcc69bd5d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82bdffb700 1 -- 172.21.15.1:0/260897089 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a800b600 con 0x7f82c0154480 2023-11-15T01:39:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82bdffb700 1 -- 172.21.15.1:0/260897089 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a800b760 con 0x7f82c0154480 2023-11-15T01:39:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82bdffb700 1 -- 172.21.15.1:0/260897089 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a800bae0 con 0x7f82c0154480 2023-11-15T01:39:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82c56e6700 1 -- 172.21.15.1:0/260897089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c0154480 msgr2=0x7f82c00ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82c56e6700 1 --2- 172.21.15.1:0/260897089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c0154480 0x7f82c00ca9d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f82c00aad10 tx=0x7f82a80090f0).stop 2023-11-15T01:39:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82c56e6700 1 -- 172.21.15.1:0/260897089 shutdown_connections 2023-11-15T01:39:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82c56e6700 1 --2- 172.21.15.1:0/260897089 >> v2:172.21.15.141:3300/0 conn(0x7f82c00c5f40 0x7f82c00c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82c56e6700 1 --2- 172.21.15.1:0/260897089 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82c01540a0 0x7f82c00ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82c56e6700 1 --2- 172.21.15.1:0/260897089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c0154480 0x7f82c00ca9d0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82c56e6700 1 -- 172.21.15.1:0/260897089 >> 172.21.15.1:0/260897089 conn(0x7f82c0064a70 msgr2=0x7f82c0064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82c56e6700 1 -- 172.21.15.1:0/260897089 shutdown_connections 2023-11-15T01:39:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.377+0000 7f82c56e6700 1 -- 172.21.15.1:0/260897089 wait complete. 2023-11-15T01:39:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.379+0000 7f82c56e6700 1 Processor -- start 2023-11-15T01:39:03.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.379+0000 7f82c56e6700 1 -- start start 2023-11-15T01:39:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.379+0000 7f82c56e6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82c00c5f40 0x7f82c01509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.379+0000 7f82c56e6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82c01540a0 0x7f82c00a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.379+0000 7f82c56e6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c0154480 0x7f82c0151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.379+0000 7f82c56e6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00a2300 con 0x7f82c0154480 2023-11-15T01:39:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.379+0000 7f82c56e6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00a2510 con 0x7f82c01540a0 2023-11-15T01:39:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.379+0000 7f82c56e6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00afd90 con 0x7f82c00c5f40 2023-11-15T01:39:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82bf7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c0154480 0x7f82c0151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82bf7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c0154480 0x7f82c0151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57632/0 (socket says 172.21.15.1:57632) 2023-11-15T01:39:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82bf7fe700 1 -- 172.21.15.1:0/4073058201 learned_addr learned my addr 172.21.15.1:0/4073058201 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82beffd700 1 --2- 172.21.15.1:0/4073058201 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82c00c5f40 0x7f82c01509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82be7fc700 1 --2- 172.21.15.1:0/4073058201 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82c01540a0 0x7f82c00a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82bf7fe700 1 -- 172.21.15.1:0/4073058201 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82c00c5f40 msgr2=0x7f82c01509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:03.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82bf7fe700 1 --2- 172.21.15.1:0/4073058201 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82c00c5f40 0x7f82c01509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:03.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82bf7fe700 1 -- 172.21.15.1:0/4073058201 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82c01540a0 msgr2=0x7f82c00a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:03.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82bf7fe700 1 --2- 172.21.15.1:0/4073058201 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82c01540a0 0x7f82c00a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:03.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82bf7fe700 1 -- 172.21.15.1:0/4073058201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a8009370 con 0x7f82c0154480 2023-11-15T01:39:03.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82be7fc700 1 --2- 172.21.15.1:0/4073058201 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82c01540a0 0x7f82c00a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:39:03.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82bf7fe700 1 --2- 172.21.15.1:0/4073058201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c0154480 0x7f82c0151060 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f82b8009fc0 tx=0x7f82b80099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:03.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82b6ffd700 1 -- 172.21.15.1:0/4073058201 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b800dc90 con 0x7f82c0154480 2023-11-15T01:39:03.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82b6ffd700 1 -- 172.21.15.1:0/4073058201 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b800f040 con 0x7f82c0154480 2023-11-15T01:39:03.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82c56e6700 1 -- 172.21.15.1:0/4073058201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c00b0070 con 0x7f82c0154480 2023-11-15T01:39:03.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82b6ffd700 1 -- 172.21.15.1:0/4073058201 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b80133f0 con 0x7f82c0154480 2023-11-15T01:39:03.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.380+0000 7f82c56e6700 1 -- 172.21.15.1:0/4073058201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c00b0630 con 0x7f82c0154480 2023-11-15T01:39:03.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.381+0000 7f82c56e6700 1 -- 172.21.15.1:0/4073058201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c006c7e0 con 0x7f82c0154480 2023-11-15T01:39:03.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.382+0000 7f82b6ffd700 1 -- 172.21.15.1:0/4073058201 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f82b80137e0 con 0x7f82c0154480 2023-11-15T01:39:03.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.382+0000 7f82b6ffd700 1 --2- 172.21.15.1:0/4073058201 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f82a005f240 0x7f82a0061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:03.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.382+0000 7f82b6ffd700 1 -- 172.21.15.1:0/4073058201 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f82b807ab40 con 0x7f82c0154480 2023-11-15T01:39:03.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.382+0000 7f82beffd700 1 --2- 172.21.15.1:0/4073058201 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f82a005f240 0x7f82a0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:03.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.383+0000 7f82beffd700 1 --2- 172.21.15.1:0/4073058201 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f82a005f240 0x7f82a0061700 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f82b000bb10 tx=0x7f82b0008040).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:03.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.386+0000 7f82b6ffd700 1 -- 172.21.15.1:0/4073058201 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f82b804ba80 con 0x7f82c0154480 2023-11-15T01:39:03.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:03.601+0000 7f82c56e6700 1 -- 172.21.15.1:0/4073058201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f82c00c9a00 con 0x7f82c0154480 2023-11-15T01:39:04.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.600+0000 7f82b6ffd700 1 -- 172.21.15.1:0/4073058201 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v54) v1 ==== 118+0+0 (secure 0 0 0) 0x7f82b804f0a0 con 0x7f82c0154480 2023-11-15T01:39:04.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.603+0000 7f82c56e6700 1 -- 172.21.15.1:0/4073058201 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f82a005f240 msgr2=0x7f82a0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:04.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.603+0000 7f82c56e6700 1 --2- 172.21.15.1:0/4073058201 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f82a005f240 0x7f82a0061700 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f82b000bb10 tx=0x7f82b0008040).stop 2023-11-15T01:39:04.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.603+0000 7f82c56e6700 1 -- 172.21.15.1:0/4073058201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c0154480 msgr2=0x7f82c0151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:04.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.603+0000 7f82c56e6700 1 --2- 172.21.15.1:0/4073058201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c0154480 0x7f82c0151060 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f82b8009fc0 tx=0x7f82b80099b0).stop 2023-11-15T01:39:04.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.603+0000 7f82c56e6700 1 -- 172.21.15.1:0/4073058201 shutdown_connections 2023-11-15T01:39:04.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.603+0000 7f82c56e6700 1 --2- 172.21.15.1:0/4073058201 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f82a005f240 0x7f82a0061700 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:04.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.603+0000 7f82c56e6700 1 --2- 172.21.15.1:0/4073058201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c0154480 0x7f82c0151060 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.603+0000 7f82c56e6700 1 --2- 172.21.15.1:0/4073058201 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82c00c5f40 0x7f82c01509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.603+0000 7f82c56e6700 1 --2- 172.21.15.1:0/4073058201 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82c01540a0 0x7f82c00a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.603+0000 7f82c56e6700 1 -- 172.21.15.1:0/4073058201 >> 172.21.15.1:0/4073058201 conn(0x7f82c0064a70 msgr2=0x7f82c0064e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.603+0000 7f82c56e6700 1 -- 172.21.15.1:0/4073058201 shutdown_connections 2023-11-15T01:39:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.603+0000 7f82c56e6700 1 -- 172.21.15.1:0/4073058201 wait complete. 2023-11-15T01:39:04.619 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-15T01:39:04.620 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-15T01:39:04.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.746+0000 7f98a74e7700 1 Processor -- start 2023-11-15T01:39:04.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.746+0000 7f98a74e7700 1 -- start start 2023-11-15T01:39:04.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.747+0000 7f98a74e7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f98a01545b0 0x7f98a00c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:04.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.747+0000 7f98a74e7700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a0155830 con 0x7f98a01541d0 2023-11-15T01:39:04.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.747+0000 7f98a74e7700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a0154c20 con 0x7f98a00c7f50 2023-11-15T01:39:04.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.747+0000 7f98a74e7700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a0158f40 con 0x7f98a01545b0 2023-11-15T01:39:04.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.747+0000 7f98a64e5700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f98a01541d0 0x7f98a00c60d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47302/0 (socket says 172.21.15.1:47302) 2023-11-15T01:39:04.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.747+0000 7f98a64e5700 1 -- 172.21.15.1:0/3374409401 learned_addr learned my addr 172.21.15.1:0/3374409401 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:39:04.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.747+0000 7f98a54e3700 1 -- 172.21.15.1:0/3374409401 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680523880 0 0) 0x7f98a0155830 con 0x7f98a01541d0 2023-11-15T01:39:04.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.747+0000 7f98a5ce4700 1 --2- 172.21.15.1:0/3374409401 >> v2:172.21.15.141:3300/0 conn(0x7f98a01545b0 0x7f98a00c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:04.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a54e3700 1 -- 172.21.15.1:0/3374409401 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98880033f0 con 0x7f98a01541d0 2023-11-15T01:39:04.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a54e3700 1 -- 172.21.15.1:0/3374409401 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2483688657 0 0) 0x7f98880033f0 con 0x7f98a01541d0 2023-11-15T01:39:04.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a54e3700 1 -- 172.21.15.1:0/3374409401 >> v2:172.21.15.141:3300/0 conn(0x7f98a01545b0 msgr2=0x7f98a00c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:04.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a54e3700 1 --2- 172.21.15.1:0/3374409401 >> v2:172.21.15.141:3300/0 conn(0x7f98a01545b0 0x7f98a00c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:04.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a54e3700 1 -- 172.21.15.1:0/3374409401 >> v1:172.21.15.141:6789/0 conn(0x7f98a00c7f50 legacy=0x7f98a00c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:04.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a54e3700 1 -- 172.21.15.1:0/3374409401 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a0154f00 con 0x7f98a01541d0 2023-11-15T01:39:04.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a54e3700 1 -- 172.21.15.1:0/3374409401 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f9898001470 con 0x7f98a01541d0 2023-11-15T01:39:04.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a54e3700 1 -- 172.21.15.1:0/3374409401 >> v1:172.21.15.1:6789/0 conn(0x7f98a01541d0 legacy=0x7f98a00c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:04.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a54e3700 1 --2- 172.21.15.1:0/3374409401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98880038e0 0x7f9888003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:04.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a54e3700 1 --2- 172.21.15.1:0/3374409401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9888004690 0x7f9888004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:04.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a54e3700 1 --2- 172.21.15.1:0/3374409401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9888005000 0x7f988800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:04.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a54e3700 1 -- 172.21.15.1:0/3374409401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988800be80 con 0x7f9888004690 2023-11-15T01:39:04.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a54e3700 1 -- 172.21.15.1:0/3374409401 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988800bff0 con 0x7f9888005000 2023-11-15T01:39:04.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a54e3700 1 -- 172.21.15.1:0/3374409401 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988800c1b0 con 0x7f98880038e0 2023-11-15T01:39:04.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a5ce4700 1 --2- 172.21.15.1:0/3374409401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9888004690 0x7f9888004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:04.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a64e5700 1 --2- 172.21.15.1:0/3374409401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98880038e0 0x7f9888003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:04.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a6ce6700 1 --2- 172.21.15.1:0/3374409401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9888005000 0x7f988800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:04.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a5ce4700 1 -- 172.21.15.1:0/3374409401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98880038e0 msgr2=0x7f9888003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:04.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a5ce4700 1 --2- 172.21.15.1:0/3374409401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98880038e0 0x7f9888003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:04.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a5ce4700 1 -- 172.21.15.1:0/3374409401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9888005000 msgr2=0x7f988800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:04.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a5ce4700 1 --2- 172.21.15.1:0/3374409401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9888005000 0x7f988800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:04.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a6ce6700 1 -- 172.21.15.1:0/3374409401 reap_dead start 2023-11-15T01:39:04.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.748+0000 7f98a5ce4700 1 -- 172.21.15.1:0/3374409401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98880033f0 con 0x7f9888004690 2023-11-15T01:39:04.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.749+0000 7f98a5ce4700 1 --2- 172.21.15.1:0/3374409401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9888004690 0x7f9888004b10 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f9894009a80 tx=0x7f9894009060).ready entity=mon.0 client_cookie=906343738837f989 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:04.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.749+0000 7f98a54e3700 1 -- 172.21.15.1:0/3374409401 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894009430 con 0x7f9888004690 2023-11-15T01:39:04.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.749+0000 7f98a54e3700 1 -- 172.21.15.1:0/3374409401 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989400e640 con 0x7f9888004690 2023-11-15T01:39:04.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.749+0000 7f98a54e3700 1 -- 172.21.15.1:0/3374409401 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989400e9c0 con 0x7f9888004690 2023-11-15T01:39:04.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.749+0000 7f98a74e7700 1 -- 172.21.15.1:0/3374409401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9888004690 msgr2=0x7f9888004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:04.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.749+0000 7f98a74e7700 1 --2- 172.21.15.1:0/3374409401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9888004690 0x7f9888004b10 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f9894009a80 tx=0x7f9894009060).stop 2023-11-15T01:39:04.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.749+0000 7f98a74e7700 1 -- 172.21.15.1:0/3374409401 shutdown_connections 2023-11-15T01:39:04.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.749+0000 7f98a74e7700 1 --2- 172.21.15.1:0/3374409401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9888004690 0x7f9888004b10 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:04.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.749+0000 7f98a74e7700 1 -- 172.21.15.1:0/3374409401 >> 172.21.15.1:0/3374409401 conn(0x7f98a0069ee0 msgr2=0x7f98a006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:04.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.749+0000 7f98a74e7700 1 -- 172.21.15.1:0/3374409401 shutdown_connections 2023-11-15T01:39:04.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.749+0000 7f98a74e7700 1 -- 172.21.15.1:0/3374409401 wait complete. 2023-11-15T01:39:04.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.750+0000 7f98a74e7700 1 Processor -- start 2023-11-15T01:39:04.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.750+0000 7f98a74e7700 1 -- start start 2023-11-15T01:39:04.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a74e7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9888004690 0x7f98a0165020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:04.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a74e7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98a00b06b0 0x7f98a00aa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:04.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a74e7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98a0151680 0x7f98a0151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:04.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a74e7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a0168310 con 0x7f98a00b06b0 2023-11-15T01:39:04.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a74e7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a01523f0 con 0x7f98a0151680 2023-11-15T01:39:04.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a74e7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00b0e70 con 0x7f9888004690 2023-11-15T01:39:04.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a5ce4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98a00b06b0 0x7f98a00aa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:04.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a5ce4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98a00b06b0 0x7f98a00aa1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57648/0 (socket says 172.21.15.1:57648) 2023-11-15T01:39:04.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a5ce4700 1 -- 172.21.15.1:0/2419161353 learned_addr learned my addr 172.21.15.1:0/2419161353 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:04.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a64e5700 1 --2- 172.21.15.1:0/2419161353 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9888004690 0x7f98a0165020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:04.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a6ce6700 1 --2- 172.21.15.1:0/2419161353 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98a0151680 0x7f98a0151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:04.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a5ce4700 1 -- 172.21.15.1:0/2419161353 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9888004690 msgr2=0x7f98a0165020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:04.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a5ce4700 1 --2- 172.21.15.1:0/2419161353 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9888004690 0x7f98a0165020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:04.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a5ce4700 1 -- 172.21.15.1:0/2419161353 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98a0151680 msgr2=0x7f98a0151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:04.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a5ce4700 1 --2- 172.21.15.1:0/2419161353 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98a0151680 0x7f98a0151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:04.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.751+0000 7f98a5ce4700 1 -- 172.21.15.1:0/2419161353 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a0151ff0 con 0x7f98a00b06b0 2023-11-15T01:39:04.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.752+0000 7f98a5ce4700 1 --2- 172.21.15.1:0/2419161353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98a00b06b0 0x7f98a00aa1f0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f98940030b0 tx=0x7f989401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.752+0000 7f989e7fc700 1 -- 172.21.15.1:0/2419161353 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989400ed30 con 0x7f98a00b06b0 2023-11-15T01:39:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.752+0000 7f989e7fc700 1 -- 172.21.15.1:0/2419161353 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989400ee90 con 0x7f98a00b06b0 2023-11-15T01:39:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.752+0000 7f98a74e7700 1 -- 172.21.15.1:0/2419161353 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a0165510 con 0x7f98a00b06b0 2023-11-15T01:39:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.752+0000 7f989e7fc700 1 -- 172.21.15.1:0/2419161353 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98940243f0 con 0x7f98a00b06b0 2023-11-15T01:39:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.752+0000 7f98a74e7700 1 -- 172.21.15.1:0/2419161353 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a0167cc0 con 0x7f98a00b06b0 2023-11-15T01:39:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.753+0000 7f98a74e7700 1 -- 172.21.15.1:0/2419161353 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a01684c0 con 0x7f98a00b06b0 2023-11-15T01:39:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.753+0000 7f989e7fc700 1 -- 172.21.15.1:0/2419161353 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f98940123f0 con 0x7f98a00b06b0 2023-11-15T01:39:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.754+0000 7f989e7fc700 1 --2- 172.21.15.1:0/2419161353 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f988c05f240 0x7f988c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.754+0000 7f989e7fc700 1 -- 172.21.15.1:0/2419161353 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f989407baa0 con 0x7f98a00b06b0 2023-11-15T01:39:04.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.754+0000 7f98a64e5700 1 --2- 172.21.15.1:0/2419161353 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f988c05f240 0x7f988c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:04.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.754+0000 7f98a64e5700 1 --2- 172.21.15.1:0/2419161353 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f988c05f240 0x7f988c061700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f9898001ce0 tx=0x7f9898009040).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:04.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.758+0000 7f989e7fc700 1 -- 172.21.15.1:0/2419161353 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f98a01684c0 con 0x7f98a00b06b0 2023-11-15T01:39:04.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:04.974+0000 7f98a74e7700 1 -- 172.21.15.1:0/2419161353 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f98a01684c0 con 0x7f98a00b06b0 2023-11-15T01:39:05.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.605+0000 7f989e7fc700 1 -- 172.21.15.1:0/2419161353 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v55) v1 ==== 122+0+0 (secure 0 0 0) 0x7f98a01684c0 con 0x7f98a00b06b0 2023-11-15T01:39:05.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.607+0000 7f98a74e7700 1 -- 172.21.15.1:0/2419161353 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f988c05f240 msgr2=0x7f988c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:05.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.607+0000 7f98a74e7700 1 --2- 172.21.15.1:0/2419161353 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f988c05f240 0x7f988c061700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f9898001ce0 tx=0x7f9898009040).stop 2023-11-15T01:39:05.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.607+0000 7f98a74e7700 1 -- 172.21.15.1:0/2419161353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98a00b06b0 msgr2=0x7f98a00aa1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:05.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.607+0000 7f98a74e7700 1 --2- 172.21.15.1:0/2419161353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98a00b06b0 0x7f98a00aa1f0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f98940030b0 tx=0x7f989401a000).stop 2023-11-15T01:39:05.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.607+0000 7f98a74e7700 1 -- 172.21.15.1:0/2419161353 shutdown_connections 2023-11-15T01:39:05.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.607+0000 7f98a74e7700 1 --2- 172.21.15.1:0/2419161353 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f988c05f240 0x7f988c061700 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:05.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.607+0000 7f98a74e7700 1 --2- 172.21.15.1:0/2419161353 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98a0151680 0x7f98a0151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:05.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.607+0000 7f98a74e7700 1 --2- 172.21.15.1:0/2419161353 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9888004690 0x7f98a0165020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:05.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.607+0000 7f98a74e7700 1 --2- 172.21.15.1:0/2419161353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98a00b06b0 0x7f98a00aa1f0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:05.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.607+0000 7f98a74e7700 1 -- 172.21.15.1:0/2419161353 >> 172.21.15.1:0/2419161353 conn(0x7f98a0069ee0 msgr2=0x7f98a00ab010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:05.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.607+0000 7f98a74e7700 1 -- 172.21.15.1:0/2419161353 shutdown_connections 2023-11-15T01:39:05.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.607+0000 7f98a74e7700 1 -- 172.21.15.1:0/2419161353 wait complete. 2023-11-15T01:39:05.623 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-15T01:39:05.623 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:39:05.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.744+0000 7fc4c6ea1700 1 Processor -- start 2023-11-15T01:39:05.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.744+0000 7fc4c6ea1700 1 -- start start 2023-11-15T01:39:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c6ea1700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc4c0154150 0x7fc4c0154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:05.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c6ea1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4c00ab1a0 0x7fc4c0158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:05.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c6ea1700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc4c00aa060 0x7fc4c00c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:05.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c6ea1700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c00c06f0 con 0x7fc4c0154150 2023-11-15T01:39:05.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c6ea1700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c00c09d0 con 0x7fc4c00aa060 2023-11-15T01:39:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c6ea1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c0158820 con 0x7fc4c00ab1a0 2023-11-15T01:39:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c4c3d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc4c0154150 0x7fc4c0154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c4c3d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc4c0154150 0x7fc4c0154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57662/0 (socket says 172.21.15.1:57662) 2023-11-15T01:39:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c4c3d700 1 -- 172.21.15.1:0/1471445030 learned_addr learned my addr 172.21.15.1:0/1471445030 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4bffff700 1 --2- 172.21.15.1:0/1471445030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4c00ab1a0 0x7fc4c0158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c543e700 1 --2- 172.21.15.1:0/1471445030 >> v2:172.21.15.141:3300/0 conn(0x7fc4c00aa060 0x7fc4c00c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c4c3d700 1 -- 172.21.15.1:0/1471445030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4c00ab1a0 msgr2=0x7fc4c0158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c4c3d700 1 --2- 172.21.15.1:0/1471445030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4c00ab1a0 0x7fc4c0158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c4c3d700 1 -- 172.21.15.1:0/1471445030 >> v2:172.21.15.141:3300/0 conn(0x7fc4c00aa060 msgr2=0x7fc4c00c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:05.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c4c3d700 1 --2- 172.21.15.1:0/1471445030 >> v2:172.21.15.141:3300/0 conn(0x7fc4c00aa060 0x7fc4c00c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:05.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c4c3d700 1 -- 172.21.15.1:0/1471445030 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c0158b00 con 0x7fc4c0154150 2023-11-15T01:39:05.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4bffff700 1 --2- 172.21.15.1:0/1471445030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4c00ab1a0 0x7fc4c0158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:39:05.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c543e700 1 --2- 172.21.15.1:0/1471445030 >> v2:172.21.15.141:3300/0 conn(0x7fc4c00aa060 0x7fc4c00c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:39:05.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.745+0000 7fc4c4c3d700 1 --2- 172.21.15.1:0/1471445030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c0154150 0x7fc4c0154530 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fc4c00c8b80 tx=0x7fc4b40090f0).ready entity=mon.0 client_cookie=9d2704b2e4b1617c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:05.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.746+0000 7fc4bf7fe700 1 -- 172.21.15.1:0/1471445030 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400b600 con 0x7fc4c0154150 2023-11-15T01:39:05.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.746+0000 7fc4bf7fe700 1 -- 172.21.15.1:0/1471445030 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b400b760 con 0x7fc4c0154150 2023-11-15T01:39:05.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.746+0000 7fc4bf7fe700 1 -- 172.21.15.1:0/1471445030 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400bb00 con 0x7fc4c0154150 2023-11-15T01:39:05.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.746+0000 7fc4c6ea1700 1 -- 172.21.15.1:0/1471445030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c0154150 msgr2=0x7fc4c0154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:05.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.746+0000 7fc4c6ea1700 1 --2- 172.21.15.1:0/1471445030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c0154150 0x7fc4c0154530 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fc4c00c8b80 tx=0x7fc4b40090f0).stop 2023-11-15T01:39:05.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.746+0000 7fc4c6ea1700 1 -- 172.21.15.1:0/1471445030 shutdown_connections 2023-11-15T01:39:05.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.746+0000 7fc4c6ea1700 1 --2- 172.21.15.1:0/1471445030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c0154150 0x7fc4c0154530 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:05.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.746+0000 7fc4c6ea1700 1 --2- 172.21.15.1:0/1471445030 >> v2:172.21.15.141:3300/0 conn(0x7fc4c00aa060 0x7fc4c00c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:05.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.746+0000 7fc4c6ea1700 1 --2- 172.21.15.1:0/1471445030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4c00ab1a0 0x7fc4c0158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:05.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.746+0000 7fc4c6ea1700 1 -- 172.21.15.1:0/1471445030 >> 172.21.15.1:0/1471445030 conn(0x7fc4c0064aa0 msgr2=0x7fc4c0064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:05.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.746+0000 7fc4c6ea1700 1 -- 172.21.15.1:0/1471445030 shutdown_connections 2023-11-15T01:39:05.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.746+0000 7fc4c6ea1700 1 -- 172.21.15.1:0/1471445030 wait complete. 2023-11-15T01:39:05.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.747+0000 7fc4c6ea1700 1 Processor -- start 2023-11-15T01:39:05.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.747+0000 7fc4c6ea1700 1 -- start start 2023-11-15T01:39:05.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.748+0000 7fc4c6ea1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c00aa060 0x7fc4c013a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:05.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.748+0000 7fc4c6ea1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4c00ab1a0 0x7fc4c00c2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:05.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.748+0000 7fc4c6ea1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4c0154150 0x7fc4c00c2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:05.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.748+0000 7fc4c6ea1700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c013aac0 con 0x7fc4c00aa060 2023-11-15T01:39:05.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.748+0000 7fc4c6ea1700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c00afb60 con 0x7fc4c0154150 2023-11-15T01:39:05.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.748+0000 7fc4c6ea1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c00c2ea0 con 0x7fc4c00ab1a0 2023-11-15T01:39:05.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.748+0000 7fc4c4c3d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c00aa060 0x7fc4c013a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:05.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.748+0000 7fc4c4c3d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c00aa060 0x7fc4c013a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57674/0 (socket says 172.21.15.1:57674) 2023-11-15T01:39:05.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.748+0000 7fc4c4c3d700 1 -- 172.21.15.1:0/3021414627 learned_addr learned my addr 172.21.15.1:0/3021414627 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:05.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.748+0000 7fc4c543e700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4c0154150 0x7fc4c00c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:05.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.748+0000 7fc4bffff700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4c00ab1a0 0x7fc4c00c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:05.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.749+0000 7fc4c4c3d700 1 -- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4c00ab1a0 msgr2=0x7fc4c00c2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:05.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.749+0000 7fc4c4c3d700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4c00ab1a0 0x7fc4c00c2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:05.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.749+0000 7fc4c4c3d700 1 -- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4c0154150 msgr2=0x7fc4c00c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:05.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.749+0000 7fc4c4c3d700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4c0154150 0x7fc4c00c2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:05.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.749+0000 7fc4c4c3d700 1 -- 172.21.15.1:0/3021414627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b4009370 con 0x7fc4c00aa060 2023-11-15T01:39:05.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.749+0000 7fc4bffff700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4c00ab1a0 0x7fc4c00c2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:39:05.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.749+0000 7fc4c543e700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4c0154150 0x7fc4c00c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:39:05.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.749+0000 7fc4c4c3d700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c00aa060 0x7fc4c013a5d0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fc4b4006fd0 tx=0x7fc4b4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:05.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.749+0000 7fc4bcff9700 1 -- 172.21.15.1:0/3021414627 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400b8d0 con 0x7fc4c00aa060 2023-11-15T01:39:05.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.749+0000 7fc4bcff9700 1 -- 172.21.15.1:0/3021414627 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b400ba30 con 0x7fc4c00aa060 2023-11-15T01:39:05.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.749+0000 7fc4c6ea1700 1 -- 172.21.15.1:0/3021414627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c00af230 con 0x7fc4c00aa060 2023-11-15T01:39:05.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.749+0000 7fc4bcff9700 1 -- 172.21.15.1:0/3021414627 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b401c670 con 0x7fc4c00aa060 2023-11-15T01:39:05.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.749+0000 7fc4c6ea1700 1 -- 172.21.15.1:0/3021414627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c00af7f0 con 0x7fc4c00aa060 2023-11-15T01:39:05.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.750+0000 7fc4c6ea1700 1 -- 172.21.15.1:0/3021414627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c01537f0 con 0x7fc4c00aa060 2023-11-15T01:39:05.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.750+0000 7fc4bcff9700 1 -- 172.21.15.1:0/3021414627 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc4b401ca60 con 0x7fc4c00aa060 2023-11-15T01:39:05.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.750+0000 7fc4bcff9700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc4a405f270 0x7fc4a4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:05.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.751+0000 7fc4bcff9700 1 -- 172.21.15.1:0/3021414627 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fc4b407c1a0 con 0x7fc4c00aa060 2023-11-15T01:39:05.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.751+0000 7fc4bffff700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc4a405f270 0x7fc4a4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:05.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.751+0000 7fc4bffff700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc4a405f270 0x7fc4a4061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc4ac00aa90 tx=0x7fc4ac008040).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:05.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.755+0000 7fc4bcff9700 1 -- 172.21.15.1:0/3021414627 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc4b404d140 con 0x7fc4c00aa060 2023-11-15T01:39:05.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.969+0000 7fc4c6ea1700 1 -- 172.21.15.1:0/3021414627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4c006c7e0 con 0x7fc4c00aa060 2023-11-15T01:39:05.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.970+0000 7fc4bcff9700 1 -- 172.21.15.1:0/3021414627 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fc4b4020090 con 0x7fc4c00aa060 2023-11-15T01:39:05.975 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:39:05.975 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7614,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3754341822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3754341822},{"type":"v1","addr":"172.21.15.1:6834","nonce":3754341822}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7617,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2242100060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":2242100060},{"type":"v1","addr":"172.21.15.1:6835","nonce":2242100060}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/1053521790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":1053521790},{"type":"v1","addr":"172.21.15.141:6836","nonce":1053521790}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:39:02.583978+0000","modified":"2023-11-15T01:39:05.601021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7629":{"gid":7629,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/2390881160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":2390881160},{"type":"v1","addr":"172.21.15.141:6837","nonce":2390881160}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-11-15T01:39:05.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.972+0000 7fc4c6ea1700 1 -- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc4a405f270 msgr2=0x7fc4a4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:05.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.972+0000 7fc4c6ea1700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc4a405f270 0x7fc4a4061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc4ac00aa90 tx=0x7fc4ac008040).stop 2023-11-15T01:39:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.972+0000 7fc4c6ea1700 1 -- 172.21.15.1:0/3021414627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c00aa060 msgr2=0x7fc4c013a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.972+0000 7fc4c6ea1700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c00aa060 0x7fc4c013a5d0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fc4b4006fd0 tx=0x7fc4b4017000).stop 2023-11-15T01:39:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.972+0000 7fc4c6ea1700 1 -- 172.21.15.1:0/3021414627 shutdown_connections 2023-11-15T01:39:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.972+0000 7fc4c6ea1700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc4a405f270 0x7fc4a4061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.972+0000 7fc4c6ea1700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4c0154150 0x7fc4c00c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.972+0000 7fc4c6ea1700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c00aa060 0x7fc4c013a5d0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.972+0000 7fc4c6ea1700 1 --2- 172.21.15.1:0/3021414627 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4c00ab1a0 0x7fc4c00c2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.972+0000 7fc4c6ea1700 1 -- 172.21.15.1:0/3021414627 >> 172.21.15.1:0/3021414627 conn(0x7fc4c0064aa0 msgr2=0x7fc4c014d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.972+0000 7fc4c6ea1700 1 -- 172.21.15.1:0/3021414627 shutdown_connections 2023-11-15T01:39:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:05.972+0000 7fc4c6ea1700 1 -- 172.21.15.1:0/3021414627 wait complete. 2023-11-15T01:39:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 55 2023-11-15T01:39:05.986 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:39:06.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.103+0000 7f35bb2c1700 1 Processor -- start 2023-11-15T01:39:06.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.103+0000 7f35bb2c1700 1 -- start start 2023-11-15T01:39:06.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35bb2c1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35b40ab1a0 0x7f35b4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35bb2c1700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f35b40aa060 0x7f35b40c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35bb2c1700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b40c06f0 con 0x7f35b4154150 2023-11-15T01:39:06.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35bb2c1700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b40c09d0 con 0x7f35b40aa060 2023-11-15T01:39:06.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35bb2c1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b4158820 con 0x7f35b40ab1a0 2023-11-15T01:39:06.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35b985e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f35b40aa060 0x7f35b40c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35b885c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35b40ab1a0 0x7f35b4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35b885c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35b40ab1a0 0x7f35b4154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:34414/0 (socket says 172.21.15.1:34414) 2023-11-15T01:39:06.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35b905d700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f35b4154150 0x7f35b4158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:42564/0 (socket says 172.21.15.1:42564) 2023-11-15T01:39:06.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35b985e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f35b40aa060 0x7f35b40c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:45782/0 (socket says 172.21.15.1:45782) 2023-11-15T01:39:06.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35b885c700 1 -- 172.21.15.1:0/1686693193 learned_addr learned my addr 172.21.15.1:0/1686693193 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:06.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35b3fff700 1 -- 172.21.15.1:0/1686693193 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503329487 0 0) 0x7f35b40c06f0 con 0x7f35b4154150 2023-11-15T01:39:06.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35b3fff700 1 -- 172.21.15.1:0/1686693193 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f359c0033f0 con 0x7f35b4154150 2023-11-15T01:39:06.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35b885c700 1 -- 172.21.15.1:0/1686693193 >> v2:172.21.15.141:3300/0 conn(0x7f35b40aa060 msgr2=0x7f35b40c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:06.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35b885c700 1 --2- 172.21.15.1:0/1686693193 >> v2:172.21.15.141:3300/0 conn(0x7f35b40aa060 0x7f35b40c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35b885c700 1 -- 172.21.15.1:0/1686693193 >> v1:172.21.15.141:6789/0 conn(0x7f35b4154150 legacy=0x7f35b4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35b885c700 1 -- 172.21.15.1:0/1686693193 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4158b00 con 0x7f35b40ab1a0 2023-11-15T01:39:06.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.104+0000 7f35b985e700 1 --2- 172.21.15.1:0/1686693193 >> v2:172.21.15.141:3300/0 conn(0x7f35b40aa060 0x7f35b40c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:39:06.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.105+0000 7f35b885c700 1 --2- 172.21.15.1:0/1686693193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35b40ab1a0 0x7f35b4154530 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f35a8006fd0 tx=0x7f35a80090f0).ready entity=mon.2 client_cookie=3d9637d82c00b08e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:06.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.105+0000 7f35b3fff700 1 -- 172.21.15.1:0/1686693193 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a800f510 con 0x7f35b40ab1a0 2023-11-15T01:39:06.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.105+0000 7f35b3fff700 1 -- 172.21.15.1:0/1686693193 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a800f670 con 0x7f35b40ab1a0 2023-11-15T01:39:06.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.105+0000 7f35b3fff700 1 -- 172.21.15.1:0/1686693193 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a800fa10 con 0x7f35b40ab1a0 2023-11-15T01:39:06.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.105+0000 7f35bb2c1700 1 -- 172.21.15.1:0/1686693193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35b40ab1a0 msgr2=0x7f35b4154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.105+0000 7f35bb2c1700 1 --2- 172.21.15.1:0/1686693193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35b40ab1a0 0x7f35b4154530 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f35a8006fd0 tx=0x7f35a80090f0).stop 2023-11-15T01:39:06.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.105+0000 7f35bb2c1700 1 -- 172.21.15.1:0/1686693193 shutdown_connections 2023-11-15T01:39:06.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.105+0000 7f35bb2c1700 1 --2- 172.21.15.1:0/1686693193 >> v2:172.21.15.141:3300/0 conn(0x7f35b40aa060 0x7f35b40c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.105+0000 7f35bb2c1700 1 --2- 172.21.15.1:0/1686693193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35b40ab1a0 0x7f35b4154530 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.105+0000 7f35bb2c1700 1 -- 172.21.15.1:0/1686693193 >> 172.21.15.1:0/1686693193 conn(0x7f35b4064aa0 msgr2=0x7f35b4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:06.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.105+0000 7f35bb2c1700 1 -- 172.21.15.1:0/1686693193 shutdown_connections 2023-11-15T01:39:06.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.105+0000 7f35bb2c1700 1 -- 172.21.15.1:0/1686693193 wait complete. 2023-11-15T01:39:06.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.106+0000 7f35bb2c1700 1 Processor -- start 2023-11-15T01:39:06.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.106+0000 7f35bb2c1700 1 -- start start 2023-11-15T01:39:06.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.107+0000 7f35bb2c1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35b40aa060 0x7f35b4148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.107+0000 7f35bb2c1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35b40ab1a0 0x7f35b4155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.107+0000 7f35bb2c1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35b4154150 0x7f35b40c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.107+0000 7f35bb2c1700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b4148520 con 0x7f35b40aa060 2023-11-15T01:39:06.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.107+0000 7f35bb2c1700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b4157710 con 0x7f35b4154150 2023-11-15T01:39:06.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.107+0000 7f35bb2c1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b4156b00 con 0x7f35b40ab1a0 2023-11-15T01:39:06.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.107+0000 7f35b905d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35b40aa060 0x7f35b4148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.108+0000 7f35b905d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35b40aa060 0x7f35b4148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57688/0 (socket says 172.21.15.1:57688) 2023-11-15T01:39:06.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.108+0000 7f35b905d700 1 -- 172.21.15.1:0/4214350443 learned_addr learned my addr 172.21.15.1:0/4214350443 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:06.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.108+0000 7f35b885c700 1 --2- 172.21.15.1:0/4214350443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35b40ab1a0 0x7f35b4155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.108+0000 7f35b985e700 1 --2- 172.21.15.1:0/4214350443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35b4154150 0x7f35b40c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.108+0000 7f35b905d700 1 -- 172.21.15.1:0/4214350443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35b40ab1a0 msgr2=0x7f35b4155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.108+0000 7f35b905d700 1 --2- 172.21.15.1:0/4214350443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35b40ab1a0 0x7f35b4155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.108+0000 7f35b905d700 1 -- 172.21.15.1:0/4214350443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35b4154150 msgr2=0x7f35b40c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.108+0000 7f35b905d700 1 --2- 172.21.15.1:0/4214350443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35b4154150 0x7f35b40c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.108+0000 7f35b905d700 1 -- 172.21.15.1:0/4214350443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac0092a0 con 0x7f35b40aa060 2023-11-15T01:39:06.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.108+0000 7f35b905d700 1 --2- 172.21.15.1:0/4214350443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35b40aa060 0x7f35b4148030 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f35a400c7c0 tx=0x7f35a40015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:06.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.108+0000 7f35b17fa700 1 -- 172.21.15.1:0/4214350443 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4005c70 con 0x7f35b40aa060 2023-11-15T01:39:06.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.108+0000 7f35b17fa700 1 -- 172.21.15.1:0/4214350443 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a4005dd0 con 0x7f35b40aa060 2023-11-15T01:39:06.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.108+0000 7f35bb2c1700 1 -- 172.21.15.1:0/4214350443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a8009370 con 0x7f35b40aa060 2023-11-15T01:39:06.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.108+0000 7f35b17fa700 1 -- 172.21.15.1:0/4214350443 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4007300 con 0x7f35b40aa060 2023-11-15T01:39:06.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.108+0000 7f35bb2c1700 1 -- 172.21.15.1:0/4214350443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b41570c0 con 0x7f35b40aa060 2023-11-15T01:39:06.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.109+0000 7f35bb2c1700 1 -- 172.21.15.1:0/4214350443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b41579f0 con 0x7f35b40aa060 2023-11-15T01:39:06.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.110+0000 7f35b17fa700 1 -- 172.21.15.1:0/4214350443 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f35a4007730 con 0x7f35b40aa060 2023-11-15T01:39:06.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.110+0000 7f35b17fa700 1 --2- 172.21.15.1:0/4214350443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35a005f270 0x7f35a0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.110+0000 7f35b17fa700 1 -- 172.21.15.1:0/4214350443 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f35a4079c50 con 0x7f35b40aa060 2023-11-15T01:39:06.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.110+0000 7f35b885c700 1 --2- 172.21.15.1:0/4214350443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35a005f270 0x7f35a0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.111+0000 7f35b885c700 1 --2- 172.21.15.1:0/4214350443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35a005f270 0x7f35a0061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f35b4156720 tx=0x7f35a8017000).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:06.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.114+0000 7f35b17fa700 1 -- 172.21.15.1:0/4214350443 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f35a404abf0 con 0x7f35b40aa060 2023-11-15T01:39:06.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.287+0000 7f35bb2c1700 1 -- 172.21.15.1:0/4214350443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35b406c7e0 con 0x7f35b40aa060 2023-11-15T01:39:06.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.288+0000 7f35b17fa700 1 -- 172.21.15.1:0/4214350443 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+17539 (secure 0 0 0) 0x7f35a4018070 con 0x7f35b40aa060 2023-11-15T01:39:06.290 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:39:06.290 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":126,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:39:03.585524+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:39:00.237361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-15T01:39:01.572293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:39:06.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.290+0000 7f35bb2c1700 1 -- 172.21.15.1:0/4214350443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35a005f270 msgr2=0x7f35a0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.290+0000 7f35bb2c1700 1 --2- 172.21.15.1:0/4214350443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35a005f270 0x7f35a0061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f35b4156720 tx=0x7f35a8017000).stop 2023-11-15T01:39:06.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.290+0000 7f35bb2c1700 1 -- 172.21.15.1:0/4214350443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35b40aa060 msgr2=0x7f35b4148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.290+0000 7f35bb2c1700 1 --2- 172.21.15.1:0/4214350443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35b40aa060 0x7f35b4148030 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f35a400c7c0 tx=0x7f35a40015b0).stop 2023-11-15T01:39:06.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.290+0000 7f35bb2c1700 1 -- 172.21.15.1:0/4214350443 shutdown_connections 2023-11-15T01:39:06.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.290+0000 7f35bb2c1700 1 --2- 172.21.15.1:0/4214350443 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f35a005f270 0x7f35a0061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.290+0000 7f35bb2c1700 1 --2- 172.21.15.1:0/4214350443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35b4154150 0x7f35b40c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.290+0000 7f35bb2c1700 1 --2- 172.21.15.1:0/4214350443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35b40aa060 0x7f35b4148030 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.290+0000 7f35bb2c1700 1 --2- 172.21.15.1:0/4214350443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f35b40ab1a0 0x7f35b4155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.290+0000 7f35bb2c1700 1 -- 172.21.15.1:0/4214350443 >> 172.21.15.1:0/4214350443 conn(0x7f35b4064aa0 msgr2=0x7f35b40c7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:06.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.290+0000 7f35bb2c1700 1 -- 172.21.15.1:0/4214350443 shutdown_connections 2023-11-15T01:39:06.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.290+0000 7f35bb2c1700 1 -- 172.21.15.1:0/4214350443 wait complete. 2023-11-15T01:39:06.304 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-15T01:39:06.305 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:39:06.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.421+0000 7f6fe0d2c700 1 Processor -- start 2023-11-15T01:39:06.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.421+0000 7f6fe0d2c700 1 -- start start 2023-11-15T01:39:06.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.422+0000 7f6fe0d2c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fdc151e10 0x7f6fdc155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.422+0000 7f6fe0d2c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6fdc0c98b0 0x7f6fdc0c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.422+0000 7f6fe0d2c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fdc0c7980 con 0x7f6fdc0c86b0 2023-11-15T01:39:06.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.422+0000 7f6fe0d2c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fdc0c8b10 con 0x7f6fdc0c98b0 2023-11-15T01:39:06.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.422+0000 7f6fe0d2c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc0ca230 con 0x7f6fdc151e10 2023-11-15T01:39:06.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.422+0000 7f6fdbfff700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6fdc0c98b0 0x7f6fdc0c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.422+0000 7f6fdb7fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fdc151e10 0x7f6fdc155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.422+0000 7f6fdbfff700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6fdc0c98b0 0x7f6fdc0c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:45798/0 (socket says 172.21.15.1:45798) 2023-11-15T01:39:06.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.422+0000 7f6fdbfff700 1 -- 172.21.15.1:0/3857888906 learned_addr learned my addr 172.21.15.1:0/3857888906 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:06.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.422+0000 7f6fdb7fe700 1 -- 172.21.15.1:0/3857888906 >> v2:172.21.15.141:3300/0 conn(0x7f6fdc0c98b0 msgr2=0x7f6fdc0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:06.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.422+0000 7f6fdb7fe700 1 --2- 172.21.15.1:0/3857888906 >> v2:172.21.15.141:3300/0 conn(0x7f6fdc0c98b0 0x7f6fdc0c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.422+0000 7f6fdb7fe700 1 -- 172.21.15.1:0/3857888906 >> v1:172.21.15.141:6789/0 conn(0x7f6fdc0c86b0 legacy=0x7f6fdc0aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.422+0000 7f6fda7fc700 1 -- 172.21.15.1:0/3857888906 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883403353 0 0) 0x7f6fdc0c7980 con 0x7f6fdc0c86b0 2023-11-15T01:39:06.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.423+0000 7f6fdb7fe700 1 -- 172.21.15.1:0/3857888906 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc0aa890 con 0x7f6fdc151e10 2023-11-15T01:39:06.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.423+0000 7f6fdbfff700 1 --2- 172.21.15.1:0/3857888906 >> v2:172.21.15.141:3300/0 conn(0x7f6fdc0c98b0 0x7f6fdc0c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:39:06.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.423+0000 7f6fdb7fe700 1 --2- 172.21.15.1:0/3857888906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fdc151e10 0x7f6fdc155530 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f6fcc009760 tx=0x7f6fcc009060).ready entity=mon.2 client_cookie=bdc7b1f30bcbdabf server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:06.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.423+0000 7f6fda7fc700 1 -- 172.21.15.1:0/3857888906 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc00f510 con 0x7f6fdc151e10 2023-11-15T01:39:06.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.423+0000 7f6fda7fc700 1 -- 172.21.15.1:0/3857888906 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc00f670 con 0x7f6fdc151e10 2023-11-15T01:39:06.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.423+0000 7f6fda7fc700 1 -- 172.21.15.1:0/3857888906 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc00f9f0 con 0x7f6fdc151e10 2023-11-15T01:39:06.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.423+0000 7f6fe0d2c700 1 -- 172.21.15.1:0/3857888906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fdc151e10 msgr2=0x7f6fdc155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.423+0000 7f6fe0d2c700 1 --2- 172.21.15.1:0/3857888906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fdc151e10 0x7f6fdc155530 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f6fcc009760 tx=0x7f6fcc009060).stop 2023-11-15T01:39:06.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.423+0000 7f6fe0d2c700 1 -- 172.21.15.1:0/3857888906 shutdown_connections 2023-11-15T01:39:06.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.423+0000 7f6fe0d2c700 1 --2- 172.21.15.1:0/3857888906 >> v2:172.21.15.141:3300/0 conn(0x7f6fdc0c98b0 0x7f6fdc0c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.423+0000 7f6fe0d2c700 1 --2- 172.21.15.1:0/3857888906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fdc151e10 0x7f6fdc155530 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.423+0000 7f6fe0d2c700 1 -- 172.21.15.1:0/3857888906 >> 172.21.15.1:0/3857888906 conn(0x7f6fdc0947e0 msgr2=0x7f6fdc06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:06.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.423+0000 7f6fe0d2c700 1 -- 172.21.15.1:0/3857888906 shutdown_connections 2023-11-15T01:39:06.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.423+0000 7f6fe0d2c700 1 -- 172.21.15.1:0/3857888906 wait complete. 2023-11-15T01:39:06.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.425+0000 7f6fe0d2c700 1 Processor -- start 2023-11-15T01:39:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.425+0000 7f6fe0d2c700 1 -- start start 2023-11-15T01:39:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.425+0000 7f6fe0d2c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fdc0c86b0 0x7f6fdc147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.425+0000 7f6fe0d2c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fdc0c98b0 0x7f6fdc0ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fe0d2c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fdc151e10 0x7f6fdc163b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fe0d2c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc0abfe0 con 0x7f6fdc0c86b0 2023-11-15T01:39:06.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fe0d2c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc147810 con 0x7f6fdc151e10 2023-11-15T01:39:06.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fe0d2c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc164ad0 con 0x7f6fdc0c98b0 2023-11-15T01:39:06.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fdb7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fdc0c86b0 0x7f6fdc147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fdb7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fdc0c86b0 0x7f6fdc147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57694/0 (socket says 172.21.15.1:57694) 2023-11-15T01:39:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fdb7fe700 1 -- 172.21.15.1:0/547009256 learned_addr learned my addr 172.21.15.1:0/547009256 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fdbfff700 1 --2- 172.21.15.1:0/547009256 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fdc151e10 0x7f6fdc163b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fdaffd700 1 --2- 172.21.15.1:0/547009256 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fdc0c98b0 0x7f6fdc0ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fdb7fe700 1 -- 172.21.15.1:0/547009256 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fdc0c98b0 msgr2=0x7f6fdc0ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fdb7fe700 1 --2- 172.21.15.1:0/547009256 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fdc0c98b0 0x7f6fdc0ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fdb7fe700 1 -- 172.21.15.1:0/547009256 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fdc151e10 msgr2=0x7f6fdc163b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fdb7fe700 1 --2- 172.21.15.1:0/547009256 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fdc151e10 0x7f6fdc163b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fdb7fe700 1 -- 172.21.15.1:0/547009256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd4009ae0 con 0x7f6fdc0c86b0 2023-11-15T01:39:06.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fdb7fe700 1 --2- 172.21.15.1:0/547009256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fdc0c86b0 0x7f6fdc147320 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f6fcc009e00 tx=0x7f6fcc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:06.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fc37fe700 1 -- 172.21.15.1:0/547009256 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc00fe80 con 0x7f6fdc0c86b0 2023-11-15T01:39:06.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fc37fe700 1 -- 172.21.15.1:0/547009256 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc00f7e0 con 0x7f6fdc0c86b0 2023-11-15T01:39:06.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fe0d2c700 1 -- 172.21.15.1:0/547009256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc0092a0 con 0x7f6fdc0c86b0 2023-11-15T01:39:06.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fc37fe700 1 -- 172.21.15.1:0/547009256 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc01b640 con 0x7f6fdc0c86b0 2023-11-15T01:39:06.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.426+0000 7f6fe0d2c700 1 -- 172.21.15.1:0/547009256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fdc1647f0 con 0x7f6fdc0c86b0 2023-11-15T01:39:06.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.428+0000 7f6fe0d2c700 1 -- 172.21.15.1:0/547009256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fdc0475e0 con 0x7f6fdc0c86b0 2023-11-15T01:39:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.428+0000 7f6fc37fe700 1 -- 172.21.15.1:0/547009256 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6fcc01b9f0 con 0x7f6fdc0c86b0 2023-11-15T01:39:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.428+0000 7f6fc37fe700 1 --2- 172.21.15.1:0/547009256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6fc805f270 0x7f6fc8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.428+0000 7f6fc37fe700 1 -- 172.21.15.1:0/547009256 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f6fcc07bf00 con 0x7f6fdc0c86b0 2023-11-15T01:39:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.428+0000 7f6fdaffd700 1 --2- 172.21.15.1:0/547009256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6fc805f270 0x7f6fc8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.429+0000 7f6fdaffd700 1 --2- 172.21.15.1:0/547009256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6fc805f270 0x7f6fc8061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6fd0007fd0 tx=0x7f6fd0007bb0).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:06.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.432+0000 7f6fc37fe700 1 -- 172.21.15.1:0/547009256 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6fcc04cea0 con 0x7f6fdc0c86b0 2023-11-15T01:39:06.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.603+0000 7f6fe0d2c700 1 -- 172.21.15.1:0/547009256 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6fdc0ac120 con 0x7f6fc805f270 2023-11-15T01:39:06.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.614+0000 7f6fc37fe700 1 -- 172.21.15.1:0/547009256 <== mgr.6919 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359411 (secure 0 0 0) 0x7f6fd0003600 con 0x7f6fc805f270 2023-11-15T01:39:06.620 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:39:06.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.618+0000 7f6fe0d2c700 1 -- 172.21.15.1:0/547009256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6fc805f270 msgr2=0x7f6fc8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.618+0000 7f6fe0d2c700 1 --2- 172.21.15.1:0/547009256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6fc805f270 0x7f6fc8061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6fd0007fd0 tx=0x7f6fd0007bb0).stop 2023-11-15T01:39:06.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.618+0000 7f6fe0d2c700 1 -- 172.21.15.1:0/547009256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fdc0c86b0 msgr2=0x7f6fdc147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.618+0000 7f6fe0d2c700 1 --2- 172.21.15.1:0/547009256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fdc0c86b0 0x7f6fdc147320 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f6fcc009e00 tx=0x7f6fcc017000).stop 2023-11-15T01:39:06.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.618+0000 7f6fe0d2c700 1 -- 172.21.15.1:0/547009256 shutdown_connections 2023-11-15T01:39:06.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.618+0000 7f6fe0d2c700 1 --2- 172.21.15.1:0/547009256 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6fc805f270 0x7f6fc8061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.618+0000 7f6fe0d2c700 1 --2- 172.21.15.1:0/547009256 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6fdc151e10 0x7f6fdc163b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.618+0000 7f6fe0d2c700 1 --2- 172.21.15.1:0/547009256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fdc0c86b0 0x7f6fdc147320 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.618+0000 7f6fe0d2c700 1 --2- 172.21.15.1:0/547009256 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6fdc0c98b0 0x7f6fdc0ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.618+0000 7f6fe0d2c700 1 -- 172.21.15.1:0/547009256 >> 172.21.15.1:0/547009256 conn(0x7f6fdc0947e0 msgr2=0x7f6fdc154200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:06.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.618+0000 7f6fe0d2c700 1 -- 172.21.15.1:0/547009256 shutdown_connections 2023-11-15T01:39:06.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.618+0000 7f6fe0d2c700 1 -- 172.21.15.1:0/547009256 wait complete. 2023-11-15T01:39:06.625 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:39:06.631 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T01:39:05.151482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":230,"acting":230,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2429848,"kb_used_data":12120,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752544872,"statfs":{"total":773094113280,"available":770605948928,"internally_reserved":0,"allocated":12410880,"data_stored":6421538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6812,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.009147"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613925+0000","last_change":"2023-11-15T01:39:02.602396+0000","last_active":"2023-11-15T01:39:02.613925+0000","last_peered":"2023-11-15T01:39:02.613925+0000","last_clean":"2023-11-15T01:39:02.613925+0000","last_became_active":"2023-11-15T01:39:02.602116+0000","last_became_peered":"2023-11-15T01:39:02.602116+0000","last_unstale":"2023-11-15T01:39:02.613925+0000","last_undegraded":"2023-11-15T01:39:02.613925+0000","last_fullsized":"2023-11-15T01:39:02.613925+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616122+0000","last_change":"2023-11-15T01:39:02.218901+0000","last_active":"2023-11-15T01:39:02.616122+0000","last_peered":"2023-11-15T01:39:02.616122+0000","last_clean":"2023-11-15T01:39:02.616122+0000","last_became_active":"2023-11-15T01:39:02.218594+0000","last_became_peered":"2023-11-15T01:39:02.218594+0000","last_unstale":"2023-11-15T01:39:02.616122+0000","last_undegraded":"2023-11-15T01:39:02.616122+0000","last_fullsized":"2023-11-15T01:39:02.616122+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603572+0000","last_change":"2023-11-15T01:39:02.600412+0000","last_active":"2023-11-15T01:39:02.603572+0000","last_peered":"2023-11-15T01:39:02.603572+0000","last_clean":"2023-11-15T01:39:02.603572+0000","last_became_active":"2023-11-15T01:39:02.600184+0000","last_became_peered":"2023-11-15T01:39:02.600184+0000","last_unstale":"2023-11-15T01:39:02.603572+0000","last_undegraded":"2023-11-15T01:39:02.603572+0000","last_fullsized":"2023-11-15T01:39:02.603572+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588186+0000","last_change":"2023-11-15T01:39:02.212406+0000","last_active":"2023-11-15T01:39:02.588186+0000","last_peered":"2023-11-15T01:39:02.588186+0000","last_clean":"2023-11-15T01:39:02.588186+0000","last_became_active":"2023-11-15T01:39:02.212126+0000","last_became_peered":"2023-11-15T01:39:02.212126+0000","last_unstale":"2023-11-15T01:39:02.588186+0000","last_undegraded":"2023-11-15T01:39:02.588186+0000","last_fullsized":"2023-11-15T01:39:02.588186+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619501+0000","last_change":"2023-11-15T01:39:02.616063+0000","last_active":"2023-11-15T01:39:02.619501+0000","last_peered":"2023-11-15T01:39:02.619501+0000","last_clean":"2023-11-15T01:39:02.619501+0000","last_became_active":"2023-11-15T01:39:02.615758+0000","last_became_peered":"2023-11-15T01:39:02.615758+0000","last_unstale":"2023-11-15T01:39:02.619501+0000","last_undegraded":"2023-11-15T01:39:02.619501+0000","last_fullsized":"2023-11-15T01:39:02.619501+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.599254+0000","last_change":"2023-11-15T01:39:02.218897+0000","last_active":"2023-11-15T01:39:02.599254+0000","last_peered":"2023-11-15T01:39:02.599254+0000","last_clean":"2023-11-15T01:39:02.599254+0000","last_became_active":"2023-11-15T01:39:02.218572+0000","last_became_peered":"2023-11-15T01:39:02.218572+0000","last_unstale":"2023-11-15T01:39:02.599254+0000","last_undegraded":"2023-11-15T01:39:02.599254+0000","last_fullsized":"2023-11-15T01:39:02.599254+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613204+0000","last_change":"2023-11-15T01:39:02.604340+0000","last_active":"2023-11-15T01:39:02.613204+0000","last_peered":"2023-11-15T01:39:02.613204+0000","last_clean":"2023-11-15T01:39:02.613204+0000","last_became_active":"2023-11-15T01:39:02.604039+0000","last_became_peered":"2023-11-15T01:39:02.604039+0000","last_unstale":"2023-11-15T01:39:02.613204+0000","last_undegraded":"2023-11-15T01:39:02.613204+0000","last_fullsized":"2023-11-15T01:39:02.613204+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604468+0000","last_change":"2023-11-15T01:39:02.208432+0000","last_active":"2023-11-15T01:39:02.604468+0000","last_peered":"2023-11-15T01:39:02.604468+0000","last_clean":"2023-11-15T01:39:02.604468+0000","last_became_active":"2023-11-15T01:39:02.208125+0000","last_became_peered":"2023-11-15T01:39:02.208125+0000","last_unstale":"2023-11-15T01:39:02.604468+0000","last_undegraded":"2023-11-15T01:39:02.604468+0000","last_fullsized":"2023-11-15T01:39:02.604468+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619578+0000","last_change":"2023-11-15T01:39:02.615475+0000","last_active":"2023-11-15T01:39:02.619578+0000","last_peered":"2023-11-15T01:39:02.619578+0000","last_clean":"2023-11-15T01:39:02.619578+0000","last_became_active":"2023-11-15T01:39:02.615012+0000","last_became_peered":"2023-11-15T01:39:02.615012+0000","last_unstale":"2023-11-15T01:39:02.619578+0000","last_undegraded":"2023-11-15T01:39:02.619578+0000","last_fullsized":"2023-11-15T01:39:02.619578+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607240+0000","last_change":"2023-11-15T01:39:02.216489+0000","last_active":"2023-11-15T01:39:02.607240+0000","last_peered":"2023-11-15T01:39:02.607240+0000","last_clean":"2023-11-15T01:39:02.607240+0000","last_became_active":"2023-11-15T01:39:02.216208+0000","last_became_peered":"2023-11-15T01:39:02.216208+0000","last_unstale":"2023-11-15T01:39:02.607240+0000","last_undegraded":"2023-11-15T01:39:02.607240+0000","last_fullsized":"2023-11-15T01:39:02.607240+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617075+0000","last_change":"2023-11-15T01:39:02.612235+0000","last_active":"2023-11-15T01:39:02.617075+0000","last_peered":"2023-11-15T01:39:02.617075+0000","last_clean":"2023-11-15T01:39:02.617075+0000","last_became_active":"2023-11-15T01:39:02.611945+0000","last_became_peered":"2023-11-15T01:39:02.611945+0000","last_unstale":"2023-11-15T01:39:02.617075+0000","last_undegraded":"2023-11-15T01:39:02.617075+0000","last_fullsized":"2023-11-15T01:39:02.617075+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619471+0000","last_change":"2023-11-15T01:39:02.616010+0000","last_active":"2023-11-15T01:39:02.619471+0000","last_peered":"2023-11-15T01:39:02.619471+0000","last_clean":"2023-11-15T01:39:02.619471+0000","last_became_active":"2023-11-15T01:39:02.615676+0000","last_became_peered":"2023-11-15T01:39:02.615676+0000","last_unstale":"2023-11-15T01:39:02.619471+0000","last_undegraded":"2023-11-15T01:39:02.619471+0000","last_fullsized":"2023-11-15T01:39:02.619471+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587855+0000","last_change":"2023-11-15T01:39:02.215407+0000","last_active":"2023-11-15T01:39:02.587855+0000","last_peered":"2023-11-15T01:39:02.587855+0000","last_clean":"2023-11-15T01:39:02.587855+0000","last_became_active":"2023-11-15T01:39:02.214892+0000","last_became_peered":"2023-11-15T01:39:02.214892+0000","last_unstale":"2023-11-15T01:39:02.587855+0000","last_undegraded":"2023-11-15T01:39:02.587855+0000","last_fullsized":"2023-11-15T01:39:02.587855+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609760+0000","last_change":"2023-11-15T01:39:02.607451+0000","last_active":"2023-11-15T01:39:02.609760+0000","last_peered":"2023-11-15T01:39:02.609760+0000","last_clean":"2023-11-15T01:39:02.609760+0000","last_became_active":"2023-11-15T01:39:02.606494+0000","last_became_peered":"2023-11-15T01:39:02.606494+0000","last_unstale":"2023-11-15T01:39:02.609760+0000","last_undegraded":"2023-11-15T01:39:02.609760+0000","last_fullsized":"2023-11-15T01:39:02.609760+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.594989+0000","last_change":"2023-11-15T01:39:02.219867+0000","last_active":"2023-11-15T01:39:02.594989+0000","last_peered":"2023-11-15T01:39:02.594989+0000","last_clean":"2023-11-15T01:39:02.594989+0000","last_became_active":"2023-11-15T01:39:02.219549+0000","last_became_peered":"2023-11-15T01:39:02.219549+0000","last_unstale":"2023-11-15T01:39:02.594989+0000","last_undegraded":"2023-11-15T01:39:02.594989+0000","last_fullsized":"2023-11-15T01:39:02.594989+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615575+0000","last_change":"2023-11-15T01:39:02.614727+0000","last_active":"2023-11-15T01:39:02.615575+0000","last_peered":"2023-11-15T01:39:02.615575+0000","last_clean":"2023-11-15T01:39:02.615575+0000","last_became_active":"2023-11-15T01:39:02.614435+0000","last_became_peered":"2023-11-15T01:39:02.614435+0000","last_unstale":"2023-11-15T01:39:02.615575+0000","last_undegraded":"2023-11-15T01:39:02.615575+0000","last_fullsized":"2023-11-15T01:39:02.615575+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598319+0000","last_change":"2023-11-15T01:39:02.205172+0000","last_active":"2023-11-15T01:39:02.598319+0000","last_peered":"2023-11-15T01:39:02.598319+0000","last_clean":"2023-11-15T01:39:02.598319+0000","last_became_active":"2023-11-15T01:39:02.204880+0000","last_became_peered":"2023-11-15T01:39:02.204880+0000","last_unstale":"2023-11-15T01:39:02.598319+0000","last_undegraded":"2023-11-15T01:39:02.598319+0000","last_fullsized":"2023-11-15T01:39:02.598319+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.618919+0000","last_change":"2023-11-15T01:39:02.616562+0000","last_active":"2023-11-15T01:39:02.618919+0000","last_peered":"2023-11-15T01:39:02.618919+0000","last_clean":"2023-11-15T01:39:02.618919+0000","last_became_active":"2023-11-15T01:39:02.615953+0000","last_became_peered":"2023-11-15T01:39:02.615953+0000","last_unstale":"2023-11-15T01:39:02.618919+0000","last_undegraded":"2023-11-15T01:39:02.618919+0000","last_fullsized":"2023-11-15T01:39:02.618919+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617325+0000","last_change":"2023-11-15T01:39:02.616248+0000","last_active":"2023-11-15T01:39:02.617325+0000","last_peered":"2023-11-15T01:39:02.617325+0000","last_clean":"2023-11-15T01:39:02.617325+0000","last_became_active":"2023-11-15T01:39:02.615799+0000","last_became_peered":"2023-11-15T01:39:02.615799+0000","last_unstale":"2023-11-15T01:39:02.617325+0000","last_undegraded":"2023-11-15T01:39:02.617325+0000","last_fullsized":"2023-11-15T01:39:02.617325+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615681+0000","last_change":"2023-11-15T01:39:02.214198+0000","last_active":"2023-11-15T01:39:02.615681+0000","last_peered":"2023-11-15T01:39:02.615681+0000","last_clean":"2023-11-15T01:39:02.615681+0000","last_became_active":"2023-11-15T01:39:02.213807+0000","last_became_peered":"2023-11-15T01:39:02.213807+0000","last_unstale":"2023-11-15T01:39:02.615681+0000","last_undegraded":"2023-11-15T01:39:02.615681+0000","last_fullsized":"2023-11-15T01:39:02.615681+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608614+0000","last_change":"2023-11-15T01:39:02.603155+0000","last_active":"2023-11-15T01:39:02.608614+0000","last_peered":"2023-11-15T01:39:02.608614+0000","last_clean":"2023-11-15T01:39:02.608614+0000","last_became_active":"2023-11-15T01:39:02.602711+0000","last_became_peered":"2023-11-15T01:39:02.602711+0000","last_unstale":"2023-11-15T01:39:02.608614+0000","last_undegraded":"2023-11-15T01:39:02.608614+0000","last_fullsized":"2023-11-15T01:39:02.608614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604881+0000","last_change":"2023-11-15T01:39:02.216520+0000","last_active":"2023-11-15T01:39:02.604881+0000","last_peered":"2023-11-15T01:39:02.604881+0000","last_clean":"2023-11-15T01:39:02.604881+0000","last_became_active":"2023-11-15T01:39:02.216259+0000","last_became_peered":"2023-11-15T01:39:02.216259+0000","last_unstale":"2023-11-15T01:39:02.604881+0000","last_undegraded":"2023-11-15T01:39:02.604881+0000","last_fullsized":"2023-11-15T01:39:02.604881+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603577+0000","last_change":"2023-11-15T01:39:02.601591+0000","last_active":"2023-11-15T01:39:02.603577+0000","last_peered":"2023-11-15T01:39:02.603577+0000","last_clean":"2023-11-15T01:39:02.603577+0000","last_became_active":"2023-11-15T01:39:02.600935+0000","last_became_peered":"2023-11-15T01:39:02.600935+0000","last_unstale":"2023-11-15T01:39:02.603577+0000","last_undegraded":"2023-11-15T01:39:02.603577+0000","last_fullsized":"2023-11-15T01:39:02.603577+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593325+0000","last_change":"2023-11-15T01:39:02.208175+0000","last_active":"2023-11-15T01:39:02.593325+0000","last_peered":"2023-11-15T01:39:02.593325+0000","last_clean":"2023-11-15T01:39:02.593325+0000","last_became_active":"2023-11-15T01:39:02.206885+0000","last_became_peered":"2023-11-15T01:39:02.206885+0000","last_unstale":"2023-11-15T01:39:02.593325+0000","last_undegraded":"2023-11-15T01:39:02.593325+0000","last_fullsized":"2023-11-15T01:39:02.593325+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615601+0000","last_change":"2023-11-15T01:39:02.610080+0000","last_active":"2023-11-15T01:39:02.615601+0000","last_peered":"2023-11-15T01:39:02.615601+0000","last_clean":"2023-11-15T01:39:02.615601+0000","last_became_active":"2023-11-15T01:39:02.609739+0000","last_became_peered":"2023-11-15T01:39:02.609739+0000","last_unstale":"2023-11-15T01:39:02.615601+0000","last_undegraded":"2023-11-15T01:39:02.615601+0000","last_fullsized":"2023-11-15T01:39:02.615601+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.592262+0000","last_change":"2023-11-15T01:39:02.220136+0000","last_active":"2023-11-15T01:39:02.592262+0000","last_peered":"2023-11-15T01:39:02.592262+0000","last_clean":"2023-11-15T01:39:02.592262+0000","last_became_active":"2023-11-15T01:39:02.219849+0000","last_became_peered":"2023-11-15T01:39:02.219849+0000","last_unstale":"2023-11-15T01:39:02.592262+0000","last_undegraded":"2023-11-15T01:39:02.592262+0000","last_fullsized":"2023-11-15T01:39:02.592262+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617875+0000","last_change":"2023-11-15T01:39:02.617127+0000","last_active":"2023-11-15T01:39:02.617875+0000","last_peered":"2023-11-15T01:39:02.617875+0000","last_clean":"2023-11-15T01:39:02.617875+0000","last_became_active":"2023-11-15T01:39:02.616799+0000","last_became_peered":"2023-11-15T01:39:02.616799+0000","last_unstale":"2023-11-15T01:39:02.617875+0000","last_undegraded":"2023-11-15T01:39:02.617875+0000","last_fullsized":"2023-11-15T01:39:02.617875+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.589698+0000","last_change":"2023-11-15T01:39:02.218107+0000","last_active":"2023-11-15T01:39:02.589698+0000","last_peered":"2023-11-15T01:39:02.589698+0000","last_clean":"2023-11-15T01:39:02.589698+0000","last_became_active":"2023-11-15T01:39:02.217829+0000","last_became_peered":"2023-11-15T01:39:02.217829+0000","last_unstale":"2023-11-15T01:39:02.589698+0000","last_undegraded":"2023-11-15T01:39:02.589698+0000","last_fullsized":"2023-11-15T01:39:02.589698+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.594904+0000","last_change":"2023-11-15T01:39:02.218103+0000","last_active":"2023-11-15T01:39:02.594904+0000","last_peered":"2023-11-15T01:39:02.594904+0000","last_clean":"2023-11-15T01:39:02.594904+0000","last_became_active":"2023-11-15T01:39:02.217828+0000","last_became_peered":"2023-11-15T01:39:02.217828+0000","last_unstale":"2023-11-15T01:39:02.594904+0000","last_undegraded":"2023-11-15T01:39:02.594904+0000","last_fullsized":"2023-11-15T01:39:02.594904+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.605850+0000","last_change":"2023-11-15T01:39:02.207964+0000","last_active":"2023-11-15T01:39:02.605850+0000","last_peered":"2023-11-15T01:39:02.605850+0000","last_clean":"2023-11-15T01:39:02.605850+0000","last_became_active":"2023-11-15T01:39:02.206902+0000","last_became_peered":"2023-11-15T01:39:02.206902+0000","last_unstale":"2023-11-15T01:39:02.605850+0000","last_undegraded":"2023-11-15T01:39:02.605850+0000","last_fullsized":"2023-11-15T01:39:02.605850+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617013+0000","last_change":"2023-11-15T01:39:02.615878+0000","last_active":"2023-11-15T01:39:02.617013+0000","last_peered":"2023-11-15T01:39:02.617013+0000","last_clean":"2023-11-15T01:39:02.617013+0000","last_became_active":"2023-11-15T01:39:02.615584+0000","last_became_peered":"2023-11-15T01:39:02.615584+0000","last_unstale":"2023-11-15T01:39:02.617013+0000","last_undegraded":"2023-11-15T01:39:02.617013+0000","last_fullsized":"2023-11-15T01:39:02.617013+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.595065+0000","last_change":"2023-11-15T01:39:02.216952+0000","last_active":"2023-11-15T01:39:02.595065+0000","last_peered":"2023-11-15T01:39:02.595065+0000","last_clean":"2023-11-15T01:39:02.595065+0000","last_became_active":"2023-11-15T01:39:02.216649+0000","last_became_peered":"2023-11-15T01:39:02.216649+0000","last_unstale":"2023-11-15T01:39:02.595065+0000","last_undegraded":"2023-11-15T01:39:02.595065+0000","last_fullsized":"2023-11-15T01:39:02.595065+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608591+0000","last_change":"2023-11-15T01:39:02.602985+0000","last_active":"2023-11-15T01:39:02.608591+0000","last_peered":"2023-11-15T01:39:02.608591+0000","last_clean":"2023-11-15T01:39:02.608591+0000","last_became_active":"2023-11-15T01:39:02.602397+0000","last_became_peered":"2023-11-15T01:39:02.602397+0000","last_unstale":"2023-11-15T01:39:02.608591+0000","last_undegraded":"2023-11-15T01:39:02.608591+0000","last_fullsized":"2023-11-15T01:39:02.608591+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.602956+0000","last_change":"2023-11-15T01:39:02.206395+0000","last_active":"2023-11-15T01:39:02.602956+0000","last_peered":"2023-11-15T01:39:02.602956+0000","last_clean":"2023-11-15T01:39:02.602956+0000","last_became_active":"2023-11-15T01:39:02.206104+0000","last_became_peered":"2023-11-15T01:39:02.206104+0000","last_unstale":"2023-11-15T01:39:02.602956+0000","last_undegraded":"2023-11-15T01:39:02.602956+0000","last_fullsized":"2023-11-15T01:39:02.602956+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587393+0000","last_change":"2023-11-15T01:39:02.211558+0000","last_active":"2023-11-15T01:39:02.587393+0000","last_peered":"2023-11-15T01:39:02.587393+0000","last_clean":"2023-11-15T01:39:02.587393+0000","last_became_active":"2023-11-15T01:39:02.211279+0000","last_became_peered":"2023-11-15T01:39:02.211279+0000","last_unstale":"2023-11-15T01:39:02.587393+0000","last_undegraded":"2023-11-15T01:39:02.587393+0000","last_fullsized":"2023-11-15T01:39:02.587393+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609748+0000","last_change":"2023-11-15T01:39:02.607093+0000","last_active":"2023-11-15T01:39:02.609748+0000","last_peered":"2023-11-15T01:39:02.609748+0000","last_clean":"2023-11-15T01:39:02.609748+0000","last_became_active":"2023-11-15T01:39:02.606809+0000","last_became_peered":"2023-11-15T01:39:02.606809+0000","last_unstale":"2023-11-15T01:39:02.609748+0000","last_undegraded":"2023-11-15T01:39:02.609748+0000","last_fullsized":"2023-11-15T01:39:02.609748+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587388+0000","last_change":"2023-11-15T01:39:02.211455+0000","last_active":"2023-11-15T01:39:02.587388+0000","last_peered":"2023-11-15T01:39:02.587388+0000","last_clean":"2023-11-15T01:39:02.587388+0000","last_became_active":"2023-11-15T01:39:02.211174+0000","last_became_peered":"2023-11-15T01:39:02.211174+0000","last_unstale":"2023-11-15T01:39:02.587388+0000","last_undegraded":"2023-11-15T01:39:02.587388+0000","last_fullsized":"2023-11-15T01:39:02.587388+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611523+0000","last_change":"2023-11-15T01:39:02.608672+0000","last_active":"2023-11-15T01:39:02.611523+0000","last_peered":"2023-11-15T01:39:02.611523+0000","last_clean":"2023-11-15T01:39:02.611523+0000","last_became_active":"2023-11-15T01:39:02.608345+0000","last_became_peered":"2023-11-15T01:39:02.608345+0000","last_unstale":"2023-11-15T01:39:02.611523+0000","last_undegraded":"2023-11-15T01:39:02.611523+0000","last_fullsized":"2023-11-15T01:39:02.611523+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616556+0000","last_change":"2023-11-15T01:39:02.613660+0000","last_active":"2023-11-15T01:39:02.616556+0000","last_peered":"2023-11-15T01:39:02.616556+0000","last_clean":"2023-11-15T01:39:02.616556+0000","last_became_active":"2023-11-15T01:39:02.613366+0000","last_became_peered":"2023-11-15T01:39:02.613366+0000","last_unstale":"2023-11-15T01:39:02.616556+0000","last_undegraded":"2023-11-15T01:39:02.616556+0000","last_fullsized":"2023-11-15T01:39:02.616556+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598361+0000","last_change":"2023-11-15T01:39:02.215823+0000","last_active":"2023-11-15T01:39:02.598361+0000","last_peered":"2023-11-15T01:39:02.598361+0000","last_clean":"2023-11-15T01:39:02.598361+0000","last_became_active":"2023-11-15T01:39:02.215525+0000","last_became_peered":"2023-11-15T01:39:02.215525+0000","last_unstale":"2023-11-15T01:39:02.598361+0000","last_undegraded":"2023-11-15T01:39:02.598361+0000","last_fullsized":"2023-11-15T01:39:02.598361+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.614005+0000","last_change":"2023-11-15T01:39:02.609396+0000","last_active":"2023-11-15T01:39:02.614005+0000","last_peered":"2023-11-15T01:39:02.614005+0000","last_clean":"2023-11-15T01:39:02.614005+0000","last_became_active":"2023-11-15T01:39:02.609124+0000","last_became_peered":"2023-11-15T01:39:02.609124+0000","last_unstale":"2023-11-15T01:39:02.614005+0000","last_undegraded":"2023-11-15T01:39:02.614005+0000","last_fullsized":"2023-11-15T01:39:02.614005+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588286+0000","last_change":"2023-11-15T01:39:02.216539+0000","last_active":"2023-11-15T01:39:02.588286+0000","last_peered":"2023-11-15T01:39:02.588286+0000","last_clean":"2023-11-15T01:39:02.588286+0000","last_became_active":"2023-11-15T01:39:02.216251+0000","last_became_peered":"2023-11-15T01:39:02.216251+0000","last_unstale":"2023-11-15T01:39:02.588286+0000","last_undegraded":"2023-11-15T01:39:02.588286+0000","last_fullsized":"2023-11-15T01:39:02.588286+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.614176+0000","last_change":"2023-11-15T01:39:02.610179+0000","last_active":"2023-11-15T01:39:02.614176+0000","last_peered":"2023-11-15T01:39:02.614176+0000","last_clean":"2023-11-15T01:39:02.614176+0000","last_became_active":"2023-11-15T01:39:02.609897+0000","last_became_peered":"2023-11-15T01:39:02.609897+0000","last_unstale":"2023-11-15T01:39:02.614176+0000","last_undegraded":"2023-11-15T01:39:02.614176+0000","last_fullsized":"2023-11-15T01:39:02.614176+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609871+0000","last_change":"2023-11-15T01:39:02.608291+0000","last_active":"2023-11-15T01:39:02.609871+0000","last_peered":"2023-11-15T01:39:02.609871+0000","last_clean":"2023-11-15T01:39:02.609871+0000","last_became_active":"2023-11-15T01:39:02.608031+0000","last_became_peered":"2023-11-15T01:39:02.608031+0000","last_unstale":"2023-11-15T01:39:02.609871+0000","last_undegraded":"2023-11-15T01:39:02.609871+0000","last_fullsized":"2023-11-15T01:39:02.609871+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597800+0000","last_change":"2023-11-15T01:39:02.216727+0000","last_active":"2023-11-15T01:39:02.597800+0000","last_peered":"2023-11-15T01:39:02.597800+0000","last_clean":"2023-11-15T01:39:02.597800+0000","last_became_active":"2023-11-15T01:39:02.216418+0000","last_became_peered":"2023-11-15T01:39:02.216418+0000","last_unstale":"2023-11-15T01:39:02.597800+0000","last_undegraded":"2023-11-15T01:39:02.597800+0000","last_fullsized":"2023-11-15T01:39:02.597800+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609371+0000","last_change":"2023-11-15T01:39:02.607331+0000","last_active":"2023-11-15T01:39:02.609371+0000","last_peered":"2023-11-15T01:39:02.609371+0000","last_clean":"2023-11-15T01:39:02.609371+0000","last_became_active":"2023-11-15T01:39:02.605984+0000","last_became_peered":"2023-11-15T01:39:02.605984+0000","last_unstale":"2023-11-15T01:39:02.609371+0000","last_undegraded":"2023-11-15T01:39:02.609371+0000","last_fullsized":"2023-11-15T01:39:02.609371+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587486+0000","last_change":"2023-11-15T01:39:02.221244+0000","last_active":"2023-11-15T01:39:02.587486+0000","last_peered":"2023-11-15T01:39:02.587486+0000","last_clean":"2023-11-15T01:39:02.587486+0000","last_became_active":"2023-11-15T01:39:02.220925+0000","last_became_peered":"2023-11-15T01:39:02.220925+0000","last_unstale":"2023-11-15T01:39:02.587486+0000","last_undegraded":"2023-11-15T01:39:02.587486+0000","last_fullsized":"2023-11-15T01:39:02.587486+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617865+0000","last_change":"2023-11-15T01:39:02.617229+0000","last_active":"2023-11-15T01:39:02.617865+0000","last_peered":"2023-11-15T01:39:02.617865+0000","last_clean":"2023-11-15T01:39:02.617865+0000","last_became_active":"2023-11-15T01:39:02.616939+0000","last_became_peered":"2023-11-15T01:39:02.616939+0000","last_unstale":"2023-11-15T01:39:02.617865+0000","last_undegraded":"2023-11-15T01:39:02.617865+0000","last_fullsized":"2023-11-15T01:39:02.617865+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593426+0000","last_change":"2023-11-15T01:39:02.221666+0000","last_active":"2023-11-15T01:39:02.593426+0000","last_peered":"2023-11-15T01:39:02.593426+0000","last_clean":"2023-11-15T01:39:02.593426+0000","last_became_active":"2023-11-15T01:39:02.219800+0000","last_became_peered":"2023-11-15T01:39:02.219800+0000","last_unstale":"2023-11-15T01:39:02.593426+0000","last_undegraded":"2023-11-15T01:39:02.593426+0000","last_fullsized":"2023-11-15T01:39:02.593426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604011+0000","last_change":"2023-11-15T01:39:02.602358+0000","last_active":"2023-11-15T01:39:02.604011+0000","last_peered":"2023-11-15T01:39:02.604011+0000","last_clean":"2023-11-15T01:39:02.604011+0000","last_became_active":"2023-11-15T01:39:02.601545+0000","last_became_peered":"2023-11-15T01:39:02.601545+0000","last_unstale":"2023-11-15T01:39:02.604011+0000","last_undegraded":"2023-11-15T01:39:02.604011+0000","last_fullsized":"2023-11-15T01:39:02.604011+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.592380+0000","last_change":"2023-11-15T01:39:02.216213+0000","last_active":"2023-11-15T01:39:02.592380+0000","last_peered":"2023-11-15T01:39:02.592380+0000","last_clean":"2023-11-15T01:39:02.592380+0000","last_became_active":"2023-11-15T01:39:02.215899+0000","last_became_peered":"2023-11-15T01:39:02.215899+0000","last_unstale":"2023-11-15T01:39:02.592380+0000","last_undegraded":"2023-11-15T01:39:02.592380+0000","last_fullsized":"2023-11-15T01:39:02.592380+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608705+0000","last_change":"2023-11-15T01:39:02.604261+0000","last_active":"2023-11-15T01:39:02.608705+0000","last_peered":"2023-11-15T01:39:02.608705+0000","last_clean":"2023-11-15T01:39:02.608705+0000","last_became_active":"2023-11-15T01:39:02.603967+0000","last_became_peered":"2023-11-15T01:39:02.603967+0000","last_unstale":"2023-11-15T01:39:02.608705+0000","last_undegraded":"2023-11-15T01:39:02.608705+0000","last_fullsized":"2023-11-15T01:39:02.608705+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.600917+0000","last_change":"2023-11-15T01:39:02.212132+0000","last_active":"2023-11-15T01:39:02.600917+0000","last_peered":"2023-11-15T01:39:02.600917+0000","last_clean":"2023-11-15T01:39:02.600917+0000","last_became_active":"2023-11-15T01:39:02.210392+0000","last_became_peered":"2023-11-15T01:39:02.210392+0000","last_unstale":"2023-11-15T01:39:02.600917+0000","last_undegraded":"2023-11-15T01:39:02.600917+0000","last_fullsized":"2023-11-15T01:39:02.600917+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603584+0000","last_change":"2023-11-15T01:39:02.600884+0000","last_active":"2023-11-15T01:39:02.603584+0000","last_peered":"2023-11-15T01:39:02.603584+0000","last_clean":"2023-11-15T01:39:02.603584+0000","last_became_active":"2023-11-15T01:39:02.600570+0000","last_became_peered":"2023-11-15T01:39:02.600570+0000","last_unstale":"2023-11-15T01:39:02.603584+0000","last_undegraded":"2023-11-15T01:39:02.603584+0000","last_fullsized":"2023-11-15T01:39:02.603584+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604360+0000","last_change":"2023-11-15T01:39:02.216713+0000","last_active":"2023-11-15T01:39:02.604360+0000","last_peered":"2023-11-15T01:39:02.604360+0000","last_clean":"2023-11-15T01:39:02.604360+0000","last_became_active":"2023-11-15T01:39:02.216444+0000","last_became_peered":"2023-11-15T01:39:02.216444+0000","last_unstale":"2023-11-15T01:39:02.604360+0000","last_undegraded":"2023-11-15T01:39:02.604360+0000","last_fullsized":"2023-11-15T01:39:02.604360+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615377+0000","last_change":"2023-11-15T01:39:02.613239+0000","last_active":"2023-11-15T01:39:02.615377+0000","last_peered":"2023-11-15T01:39:02.615377+0000","last_clean":"2023-11-15T01:39:02.615377+0000","last_became_active":"2023-11-15T01:39:02.612946+0000","last_became_peered":"2023-11-15T01:39:02.612946+0000","last_unstale":"2023-11-15T01:39:02.615377+0000","last_undegraded":"2023-11-15T01:39:02.615377+0000","last_fullsized":"2023-11-15T01:39:02.615377+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.596143+0000","last_change":"2023-11-15T01:39:02.209925+0000","last_active":"2023-11-15T01:39:02.596143+0000","last_peered":"2023-11-15T01:39:02.596143+0000","last_clean":"2023-11-15T01:39:02.596143+0000","last_became_active":"2023-11-15T01:39:02.209663+0000","last_became_peered":"2023-11-15T01:39:02.209663+0000","last_unstale":"2023-11-15T01:39:02.596143+0000","last_undegraded":"2023-11-15T01:39:02.596143+0000","last_fullsized":"2023-11-15T01:39:02.596143+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609247+0000","last_change":"2023-11-15T01:39:02.608245+0000","last_active":"2023-11-15T01:39:02.609247+0000","last_peered":"2023-11-15T01:39:02.609247+0000","last_clean":"2023-11-15T01:39:02.609247+0000","last_became_active":"2023-11-15T01:39:02.607952+0000","last_became_peered":"2023-11-15T01:39:02.607952+0000","last_unstale":"2023-11-15T01:39:02.609247+0000","last_undegraded":"2023-11-15T01:39:02.609247+0000","last_fullsized":"2023-11-15T01:39:02.609247+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607666+0000","last_change":"2023-11-15T01:39:02.212445+0000","last_active":"2023-11-15T01:39:02.607666+0000","last_peered":"2023-11-15T01:39:02.607666+0000","last_clean":"2023-11-15T01:39:02.607666+0000","last_became_active":"2023-11-15T01:39:02.212161+0000","last_became_peered":"2023-11-15T01:39:02.212161+0000","last_unstale":"2023-11-15T01:39:02.607666+0000","last_undegraded":"2023-11-15T01:39:02.607666+0000","last_fullsized":"2023-11-15T01:39:02.607666+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.601003+0000","last_change":"2023-11-15T01:39:02.212296+0000","last_active":"2023-11-15T01:39:02.601003+0000","last_peered":"2023-11-15T01:39:02.601003+0000","last_clean":"2023-11-15T01:39:02.601003+0000","last_became_active":"2023-11-15T01:39:02.211995+0000","last_became_peered":"2023-11-15T01:39:02.211995+0000","last_unstale":"2023-11-15T01:39:02.601003+0000","last_undegraded":"2023-11-15T01:39:02.601003+0000","last_fullsized":"2023-11-15T01:39:02.601003+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609392+0000","last_change":"2023-11-15T01:39:02.607853+0000","last_active":"2023-11-15T01:39:02.609392+0000","last_peered":"2023-11-15T01:39:02.609392+0000","last_clean":"2023-11-15T01:39:02.609392+0000","last_became_active":"2023-11-15T01:39:02.607594+0000","last_became_peered":"2023-11-15T01:39:02.607594+0000","last_unstale":"2023-11-15T01:39:02.609392+0000","last_undegraded":"2023-11-15T01:39:02.609392+0000","last_fullsized":"2023-11-15T01:39:02.609392+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603556+0000","last_change":"2023-11-15T01:39:02.601396+0000","last_active":"2023-11-15T01:39:02.603556+0000","last_peered":"2023-11-15T01:39:02.603556+0000","last_clean":"2023-11-15T01:39:02.603556+0000","last_became_active":"2023-11-15T01:39:02.601172+0000","last_became_peered":"2023-11-15T01:39:02.601172+0000","last_unstale":"2023-11-15T01:39:02.603556+0000","last_undegraded":"2023-11-15T01:39:02.603556+0000","last_fullsized":"2023-11-15T01:39:02.603556+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619529+0000","last_change":"2023-11-15T01:39:02.614609+0000","last_active":"2023-11-15T01:39:02.619529+0000","last_peered":"2023-11-15T01:39:02.619529+0000","last_clean":"2023-11-15T01:39:02.619529+0000","last_became_active":"2023-11-15T01:39:02.614307+0000","last_became_peered":"2023-11-15T01:39:02.614307+0000","last_unstale":"2023-11-15T01:39:02.619529+0000","last_undegraded":"2023-11-15T01:39:02.619529+0000","last_fullsized":"2023-11-15T01:39:02.619529+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593584+0000","last_change":"2023-11-15T01:39:02.213334+0000","last_active":"2023-11-15T01:39:02.593584+0000","last_peered":"2023-11-15T01:39:02.593584+0000","last_clean":"2023-11-15T01:39:02.593584+0000","last_became_active":"2023-11-15T01:39:02.212950+0000","last_became_peered":"2023-11-15T01:39:02.212950+0000","last_unstale":"2023-11-15T01:39:02.593584+0000","last_undegraded":"2023-11-15T01:39:02.593584+0000","last_fullsized":"2023-11-15T01:39:02.593584+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607206+0000","last_change":"2023-11-15T01:39:02.605916+0000","last_active":"2023-11-15T01:39:02.607206+0000","last_peered":"2023-11-15T01:39:02.607206+0000","last_clean":"2023-11-15T01:39:02.607206+0000","last_became_active":"2023-11-15T01:39:02.605221+0000","last_became_peered":"2023-11-15T01:39:02.605221+0000","last_unstale":"2023-11-15T01:39:02.607206+0000","last_undegraded":"2023-11-15T01:39:02.607206+0000","last_fullsized":"2023-11-15T01:39:02.607206+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.592684+0000","last_change":"2023-11-15T01:39:02.214571+0000","last_active":"2023-11-15T01:39:02.592684+0000","last_peered":"2023-11-15T01:39:02.592684+0000","last_clean":"2023-11-15T01:39:02.592684+0000","last_became_active":"2023-11-15T01:39:02.214277+0000","last_became_peered":"2023-11-15T01:39:02.214277+0000","last_unstale":"2023-11-15T01:39:02.592684+0000","last_undegraded":"2023-11-15T01:39:02.592684+0000","last_fullsized":"2023-11-15T01:39:02.592684+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606587+0000","last_change":"2023-11-15T01:39:02.602418+0000","last_active":"2023-11-15T01:39:02.606587+0000","last_peered":"2023-11-15T01:39:02.606587+0000","last_clean":"2023-11-15T01:39:02.606587+0000","last_became_active":"2023-11-15T01:39:02.602063+0000","last_became_peered":"2023-11-15T01:39:02.602063+0000","last_unstale":"2023-11-15T01:39:02.606587+0000","last_undegraded":"2023-11-15T01:39:02.606587+0000","last_fullsized":"2023-11-15T01:39:02.606587+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.595019+0000","last_change":"2023-11-15T01:39:02.212659+0000","last_active":"2023-11-15T01:39:02.595019+0000","last_peered":"2023-11-15T01:39:02.595019+0000","last_clean":"2023-11-15T01:39:02.595019+0000","last_became_active":"2023-11-15T01:39:02.212415+0000","last_became_peered":"2023-11-15T01:39:02.212415+0000","last_unstale":"2023-11-15T01:39:02.595019+0000","last_undegraded":"2023-11-15T01:39:02.595019+0000","last_fullsized":"2023-11-15T01:39:02.595019+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.618320+0000","last_change":"2023-11-15T01:39:02.614637+0000","last_active":"2023-11-15T01:39:02.618320+0000","last_peered":"2023-11-15T01:39:02.618320+0000","last_clean":"2023-11-15T01:39:02.618320+0000","last_became_active":"2023-11-15T01:39:02.614343+0000","last_became_peered":"2023-11-15T01:39:02.614343+0000","last_unstale":"2023-11-15T01:39:02.618320+0000","last_undegraded":"2023-11-15T01:39:02.618320+0000","last_fullsized":"2023-11-15T01:39:02.618320+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588382+0000","last_change":"2023-11-15T01:39:02.216949+0000","last_active":"2023-11-15T01:39:02.588382+0000","last_peered":"2023-11-15T01:39:02.588382+0000","last_clean":"2023-11-15T01:39:02.588382+0000","last_became_active":"2023-11-15T01:39:02.216678+0000","last_became_peered":"2023-11-15T01:39:02.216678+0000","last_unstale":"2023-11-15T01:39:02.588382+0000","last_undegraded":"2023-11-15T01:39:02.588382+0000","last_fullsized":"2023-11-15T01:39:02.588382+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615337+0000","last_change":"2023-11-15T01:39:02.613451+0000","last_active":"2023-11-15T01:39:02.615337+0000","last_peered":"2023-11-15T01:39:02.615337+0000","last_clean":"2023-11-15T01:39:02.615337+0000","last_became_active":"2023-11-15T01:39:02.613039+0000","last_became_peered":"2023-11-15T01:39:02.613039+0000","last_unstale":"2023-11-15T01:39:02.615337+0000","last_undegraded":"2023-11-15T01:39:02.615337+0000","last_fullsized":"2023-11-15T01:39:02.615337+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617294+0000","last_change":"2023-11-15T01:39:02.614533+0000","last_active":"2023-11-15T01:39:02.617294+0000","last_peered":"2023-11-15T01:39:02.617294+0000","last_clean":"2023-11-15T01:39:02.617294+0000","last_became_active":"2023-11-15T01:39:02.614181+0000","last_became_peered":"2023-11-15T01:39:02.614181+0000","last_unstale":"2023-11-15T01:39:02.617294+0000","last_undegraded":"2023-11-15T01:39:02.617294+0000","last_fullsized":"2023-11-15T01:39:02.617294+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611758+0000","last_change":"2023-11-15T01:39:02.215496+0000","last_active":"2023-11-15T01:39:02.611758+0000","last_peered":"2023-11-15T01:39:02.611758+0000","last_clean":"2023-11-15T01:39:02.611758+0000","last_became_active":"2023-11-15T01:39:02.215218+0000","last_became_peered":"2023-11-15T01:39:02.215218+0000","last_unstale":"2023-11-15T01:39:02.611758+0000","last_undegraded":"2023-11-15T01:39:02.611758+0000","last_fullsized":"2023-11-15T01:39:02.611758+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613955+0000","last_change":"2023-11-15T01:39:02.218556+0000","last_active":"2023-11-15T01:39:02.613955+0000","last_peered":"2023-11-15T01:39:02.613955+0000","last_clean":"2023-11-15T01:39:02.613955+0000","last_became_active":"2023-11-15T01:39:02.218223+0000","last_became_peered":"2023-11-15T01:39:02.218223+0000","last_unstale":"2023-11-15T01:39:02.613955+0000","last_undegraded":"2023-11-15T01:39:02.613955+0000","last_fullsized":"2023-11-15T01:39:02.613955+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611507+0000","last_change":"2023-11-15T01:39:02.607095+0000","last_active":"2023-11-15T01:39:02.611507+0000","last_peered":"2023-11-15T01:39:02.611507+0000","last_clean":"2023-11-15T01:39:02.611507+0000","last_became_active":"2023-11-15T01:39:02.606862+0000","last_became_peered":"2023-11-15T01:39:02.606862+0000","last_unstale":"2023-11-15T01:39:02.611507+0000","last_undegraded":"2023-11-15T01:39:02.611507+0000","last_fullsized":"2023-11-15T01:39:02.611507+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.591994+0000","last_change":"2023-11-15T01:39:02.208100+0000","last_active":"2023-11-15T01:39:02.591994+0000","last_peered":"2023-11-15T01:39:02.591994+0000","last_clean":"2023-11-15T01:39:02.591994+0000","last_became_active":"2023-11-15T01:39:02.207787+0000","last_became_peered":"2023-11-15T01:39:02.207787+0000","last_unstale":"2023-11-15T01:39:02.591994+0000","last_undegraded":"2023-11-15T01:39:02.591994+0000","last_fullsized":"2023-11-15T01:39:02.591994+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.612658+0000","last_change":"2023-11-15T01:39:02.603012+0000","last_active":"2023-11-15T01:39:02.612658+0000","last_peered":"2023-11-15T01:39:02.612658+0000","last_clean":"2023-11-15T01:39:02.612658+0000","last_became_active":"2023-11-15T01:39:02.602782+0000","last_became_peered":"2023-11-15T01:39:02.602782+0000","last_unstale":"2023-11-15T01:39:02.612658+0000","last_undegraded":"2023-11-15T01:39:02.612658+0000","last_fullsized":"2023-11-15T01:39:02.612658+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593111+0000","last_change":"2023-11-15T01:39:02.211688+0000","last_active":"2023-11-15T01:39:02.593111+0000","last_peered":"2023-11-15T01:39:02.593111+0000","last_clean":"2023-11-15T01:39:02.593111+0000","last_became_active":"2023-11-15T01:39:02.211393+0000","last_became_peered":"2023-11-15T01:39:02.211393+0000","last_unstale":"2023-11-15T01:39:02.593111+0000","last_undegraded":"2023-11-15T01:39:02.593111+0000","last_fullsized":"2023-11-15T01:39:02.593111+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616897+0000","last_change":"2023-11-15T01:39:02.614804+0000","last_active":"2023-11-15T01:39:02.616897+0000","last_peered":"2023-11-15T01:39:02.616897+0000","last_clean":"2023-11-15T01:39:02.616897+0000","last_became_active":"2023-11-15T01:39:02.614516+0000","last_became_peered":"2023-11-15T01:39:02.614516+0000","last_unstale":"2023-11-15T01:39:02.616897+0000","last_undegraded":"2023-11-15T01:39:02.616897+0000","last_fullsized":"2023-11-15T01:39:02.616897+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607913+0000","last_change":"2023-11-15T01:39:02.212073+0000","last_active":"2023-11-15T01:39:02.607913+0000","last_peered":"2023-11-15T01:39:02.607913+0000","last_clean":"2023-11-15T01:39:02.607913+0000","last_became_active":"2023-11-15T01:39:02.211789+0000","last_became_peered":"2023-11-15T01:39:02.211789+0000","last_unstale":"2023-11-15T01:39:02.607913+0000","last_undegraded":"2023-11-15T01:39:02.607913+0000","last_fullsized":"2023-11-15T01:39:02.607913+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.599449+0000","last_change":"2023-11-15T01:39:02.597319+0000","last_active":"2023-11-15T01:39:02.599449+0000","last_peered":"2023-11-15T01:39:02.599449+0000","last_clean":"2023-11-15T01:39:02.599449+0000","last_became_active":"2023-11-15T01:39:02.597051+0000","last_became_peered":"2023-11-15T01:39:02.597051+0000","last_unstale":"2023-11-15T01:39:02.599449+0000","last_undegraded":"2023-11-15T01:39:02.599449+0000","last_fullsized":"2023-11-15T01:39:02.599449+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.614112+0000","last_change":"2023-11-15T01:39:02.213626+0000","last_active":"2023-11-15T01:39:02.614112+0000","last_peered":"2023-11-15T01:39:02.614112+0000","last_clean":"2023-11-15T01:39:02.614112+0000","last_became_active":"2023-11-15T01:39:02.213021+0000","last_became_peered":"2023-11-15T01:39:02.213021+0000","last_unstale":"2023-11-15T01:39:02.614112+0000","last_undegraded":"2023-11-15T01:39:02.614112+0000","last_fullsized":"2023-11-15T01:39:02.614112+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604865+0000","last_change":"2023-11-15T01:39:02.598955+0000","last_active":"2023-11-15T01:39:02.604865+0000","last_peered":"2023-11-15T01:39:02.604865+0000","last_clean":"2023-11-15T01:39:02.604865+0000","last_became_active":"2023-11-15T01:39:02.598657+0000","last_became_peered":"2023-11-15T01:39:02.598657+0000","last_unstale":"2023-11-15T01:39:02.604865+0000","last_undegraded":"2023-11-15T01:39:02.604865+0000","last_fullsized":"2023-11-15T01:39:02.604865+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588486+0000","last_change":"2023-11-15T01:39:02.212406+0000","last_active":"2023-11-15T01:39:02.588486+0000","last_peered":"2023-11-15T01:39:02.588486+0000","last_clean":"2023-11-15T01:39:02.588486+0000","last_became_active":"2023-11-15T01:39:02.212116+0000","last_became_peered":"2023-11-15T01:39:02.212116+0000","last_unstale":"2023-11-15T01:39:02.588486+0000","last_undegraded":"2023-11-15T01:39:02.588486+0000","last_fullsized":"2023-11-15T01:39:02.588486+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606629+0000","last_change":"2023-11-15T01:39:02.605182+0000","last_active":"2023-11-15T01:39:02.606629+0000","last_peered":"2023-11-15T01:39:02.606629+0000","last_clean":"2023-11-15T01:39:02.606629+0000","last_became_active":"2023-11-15T01:39:02.604892+0000","last_became_peered":"2023-11-15T01:39:02.604892+0000","last_unstale":"2023-11-15T01:39:02.606629+0000","last_undegraded":"2023-11-15T01:39:02.606629+0000","last_fullsized":"2023-11-15T01:39:02.606629+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597149+0000","last_change":"2023-11-15T01:39:02.210712+0000","last_active":"2023-11-15T01:39:02.597149+0000","last_peered":"2023-11-15T01:39:02.597149+0000","last_clean":"2023-11-15T01:39:02.597149+0000","last_became_active":"2023-11-15T01:39:02.210222+0000","last_became_peered":"2023-11-15T01:39:02.210222+0000","last_unstale":"2023-11-15T01:39:02.597149+0000","last_undegraded":"2023-11-15T01:39:02.597149+0000","last_fullsized":"2023-11-15T01:39:02.597149+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.601085+0000","last_change":"2023-11-15T01:39:02.213634+0000","last_active":"2023-11-15T01:39:02.601085+0000","last_peered":"2023-11-15T01:39:02.601085+0000","last_clean":"2023-11-15T01:39:02.601085+0000","last_became_active":"2023-11-15T01:39:02.213348+0000","last_became_peered":"2023-11-15T01:39:02.213348+0000","last_unstale":"2023-11-15T01:39:02.601085+0000","last_undegraded":"2023-11-15T01:39:02.601085+0000","last_fullsized":"2023-11-15T01:39:02.601085+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615584+0000","last_change":"2023-11-15T01:39:02.613224+0000","last_active":"2023-11-15T01:39:02.615584+0000","last_peered":"2023-11-15T01:39:02.615584+0000","last_clean":"2023-11-15T01:39:02.615584+0000","last_became_active":"2023-11-15T01:39:02.612879+0000","last_became_peered":"2023-11-15T01:39:02.612879+0000","last_unstale":"2023-11-15T01:39:02.615584+0000","last_undegraded":"2023-11-15T01:39:02.615584+0000","last_fullsized":"2023-11-15T01:39:02.615584+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.594724+0000","last_change":"2023-11-15T01:39:02.212971+0000","last_active":"2023-11-15T01:39:02.594724+0000","last_peered":"2023-11-15T01:39:02.594724+0000","last_clean":"2023-11-15T01:39:02.594724+0000","last_became_active":"2023-11-15T01:39:02.212667+0000","last_became_peered":"2023-11-15T01:39:02.212667+0000","last_unstale":"2023-11-15T01:39:02.594724+0000","last_undegraded":"2023-11-15T01:39:02.594724+0000","last_fullsized":"2023-11-15T01:39:02.594724+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615238+0000","last_change":"2023-11-15T01:39:02.613211+0000","last_active":"2023-11-15T01:39:02.615238+0000","last_peered":"2023-11-15T01:39:02.615238+0000","last_clean":"2023-11-15T01:39:02.615238+0000","last_became_active":"2023-11-15T01:39:02.612908+0000","last_became_peered":"2023-11-15T01:39:02.612908+0000","last_unstale":"2023-11-15T01:39:02.615238+0000","last_undegraded":"2023-11-15T01:39:02.615238+0000","last_fullsized":"2023-11-15T01:39:02.615238+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593625+0000","last_change":"2023-11-15T01:39:02.211682+0000","last_active":"2023-11-15T01:39:02.593625+0000","last_peered":"2023-11-15T01:39:02.593625+0000","last_clean":"2023-11-15T01:39:02.593625+0000","last_became_active":"2023-11-15T01:39:02.211336+0000","last_became_peered":"2023-11-15T01:39:02.211336+0000","last_unstale":"2023-11-15T01:39:02.593625+0000","last_undegraded":"2023-11-15T01:39:02.593625+0000","last_fullsized":"2023-11-15T01:39:02.593625+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597448+0000","last_change":"2023-11-15T01:39:02.216677+0000","last_active":"2023-11-15T01:39:02.597448+0000","last_peered":"2023-11-15T01:39:02.597448+0000","last_clean":"2023-11-15T01:39:02.597448+0000","last_became_active":"2023-11-15T01:39:02.216244+0000","last_became_peered":"2023-11-15T01:39:02.216244+0000","last_unstale":"2023-11-15T01:39:02.597448+0000","last_undegraded":"2023-11-15T01:39:02.597448+0000","last_fullsized":"2023-11-15T01:39:02.597448+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593206+0000","last_change":"2023-11-15T01:39:02.212115+0000","last_active":"2023-11-15T01:39:02.593206+0000","last_peered":"2023-11-15T01:39:02.593206+0000","last_clean":"2023-11-15T01:39:02.593206+0000","last_became_active":"2023-11-15T01:39:02.211847+0000","last_became_peered":"2023-11-15T01:39:02.211847+0000","last_unstale":"2023-11-15T01:39:02.593206+0000","last_undegraded":"2023-11-15T01:39:02.593206+0000","last_fullsized":"2023-11-15T01:39:02.593206+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606667+0000","last_change":"2023-11-15T01:39:02.604865+0000","last_active":"2023-11-15T01:39:02.606667+0000","last_peered":"2023-11-15T01:39:02.606667+0000","last_clean":"2023-11-15T01:39:02.606667+0000","last_became_active":"2023-11-15T01:39:02.604576+0000","last_became_peered":"2023-11-15T01:39:02.604576+0000","last_unstale":"2023-11-15T01:39:02.606667+0000","last_undegraded":"2023-11-15T01:39:02.606667+0000","last_fullsized":"2023-11-15T01:39:02.606667+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597373+0000","last_change":"2023-11-15T01:39:02.212456+0000","last_active":"2023-11-15T01:39:02.597373+0000","last_peered":"2023-11-15T01:39:02.597373+0000","last_clean":"2023-11-15T01:39:02.597373+0000","last_became_active":"2023-11-15T01:39:02.212123+0000","last_became_peered":"2023-11-15T01:39:02.212123+0000","last_unstale":"2023-11-15T01:39:02.597373+0000","last_undegraded":"2023-11-15T01:39:02.597373+0000","last_fullsized":"2023-11-15T01:39:02.597373+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.601148+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:39:02.601148+0000","last_peered":"2023-11-15T01:39:02.601148+0000","last_clean":"2023-11-15T01:39:02.601148+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:39:02.601148+0000","last_undegraded":"2023-11-15T01:39:02.601148+0000","last_fullsized":"2023-11-15T01:39:02.601148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.596932+0000","last_change":"2023-11-15T01:39:02.594932+0000","last_active":"2023-11-15T01:39:02.596932+0000","last_peered":"2023-11-15T01:39:02.596932+0000","last_clean":"2023-11-15T01:39:02.596932+0000","last_became_active":"2023-11-15T01:39:02.594643+0000","last_became_peered":"2023-11-15T01:39:02.594643+0000","last_unstale":"2023-11-15T01:39:02.596932+0000","last_undegraded":"2023-11-15T01:39:02.596932+0000","last_fullsized":"2023-11-15T01:39:02.596932+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611619+0000","last_change":"2023-11-15T01:39:02.210563+0000","last_active":"2023-11-15T01:39:02.611619+0000","last_peered":"2023-11-15T01:39:02.611619+0000","last_clean":"2023-11-15T01:39:02.611619+0000","last_became_active":"2023-11-15T01:39:02.210071+0000","last_became_peered":"2023-11-15T01:39:02.210071+0000","last_unstale":"2023-11-15T01:39:02.611619+0000","last_undegraded":"2023-11-15T01:39:02.611619+0000","last_fullsized":"2023-11-15T01:39:02.611619+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-11-15T01:38:58.001178+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:38:58.001178+0000","last_peered":"2023-11-15T01:38:58.001178+0000","last_clean":"2023-11-15T01:38:58.001178+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:38:58.001178+0000","last_undegraded":"2023-11-15T01:38:58.001178+0000","last_fullsized":"2023-11-15T01:38:58.001178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611509+0000","last_change":"2023-11-15T01:39:02.610776+0000","last_active":"2023-11-15T01:39:02.611509+0000","last_peered":"2023-11-15T01:39:02.611509+0000","last_clean":"2023-11-15T01:39:02.611509+0000","last_became_active":"2023-11-15T01:39:02.610520+0000","last_became_peered":"2023-11-15T01:39:02.610520+0000","last_unstale":"2023-11-15T01:39:02.611509+0000","last_undegraded":"2023-11-15T01:39:02.611509+0000","last_fullsized":"2023-11-15T01:39:02.611509+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593208+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:39:02.593208+0000","last_peered":"2023-11-15T01:39:02.593208+0000","last_clean":"2023-11-15T01:39:02.593208+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:39:02.593208+0000","last_undegraded":"2023-11-15T01:39:02.593208+0000","last_fullsized":"2023-11-15T01:39:02.593208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.599145+0000","last_change":"2023-11-15T01:39:02.209388+0000","last_active":"2023-11-15T01:39:02.599145+0000","last_peered":"2023-11-15T01:39:02.599145+0000","last_clean":"2023-11-15T01:39:02.599145+0000","last_became_active":"2023-11-15T01:39:02.209125+0000","last_became_peered":"2023-11-15T01:39:02.209125+0000","last_unstale":"2023-11-15T01:39:02.599145+0000","last_undegraded":"2023-11-15T01:39:02.599145+0000","last_fullsized":"2023-11-15T01:39:02.599145+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":97,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-11-15T01:38:58.001177+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:38:58.001177+0000","last_peered":"2023-11-15T01:38:58.001177+0000","last_clean":"2023-11-15T01:38:58.001177+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:38:58.001177+0000","last_undegraded":"2023-11-15T01:38:58.001177+0000","last_fullsized":"2023-11-15T01:38:58.001177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":94,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-11-15T01:38:58.001361+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:38:58.001361+0000","last_peered":"2023-11-15T01:38:58.001361+0000","last_clean":"2023-11-15T01:38:58.001361+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:38:58.001361+0000","last_undegraded":"2023-11-15T01:38:58.001361+0000","last_fullsized":"2023-11-15T01:38:58.001361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608911+0000","last_change":"2023-11-15T01:39:02.604538+0000","last_active":"2023-11-15T01:39:02.608911+0000","last_peered":"2023-11-15T01:39:02.608911+0000","last_clean":"2023-11-15T01:39:02.608911+0000","last_became_active":"2023-11-15T01:39:02.604164+0000","last_became_peered":"2023-11-15T01:39:02.604164+0000","last_unstale":"2023-11-15T01:39:02.608911+0000","last_undegraded":"2023-11-15T01:39:02.608911+0000","last_fullsized":"2023-11-15T01:39:02.608911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-11-15T01:38:58.001375+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:38:58.001375+0000","last_peered":"2023-11-15T01:38:58.001375+0000","last_clean":"2023-11-15T01:38:58.001375+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:38:58.001375+0000","last_undegraded":"2023-11-15T01:38:58.001375+0000","last_fullsized":"2023-11-15T01:38:58.001375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613936+0000","last_change":"2023-11-15T01:39:02.613124+0000","last_active":"2023-11-15T01:39:02.613936+0000","last_peered":"2023-11-15T01:39:02.613936+0000","last_clean":"2023-11-15T01:39:02.613936+0000","last_became_active":"2023-11-15T01:39:02.612807+0000","last_became_peered":"2023-11-15T01:39:02.612807+0000","last_unstale":"2023-11-15T01:39:02.613936+0000","last_undegraded":"2023-11-15T01:39:02.613936+0000","last_fullsized":"2023-11-15T01:39:02.613936+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593105+0000","last_change":"2023-11-15T01:39:02.208753+0000","last_active":"2023-11-15T01:39:02.593105+0000","last_peered":"2023-11-15T01:39:02.593105+0000","last_clean":"2023-11-15T01:39:02.593105+0000","last_became_active":"2023-11-15T01:39:02.208459+0000","last_became_peered":"2023-11-15T01:39:02.208459+0000","last_unstale":"2023-11-15T01:39:02.593105+0000","last_undegraded":"2023-11-15T01:39:02.593105+0000","last_fullsized":"2023-11-15T01:39:02.593105+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-11-15T01:38:58.001307+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:38:58.001307+0000","last_peered":"2023-11-15T01:38:58.001307+0000","last_clean":"2023-11-15T01:38:58.001307+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:38:58.001307+0000","last_undegraded":"2023-11-15T01:38:58.001307+0000","last_fullsized":"2023-11-15T01:38:58.001307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608614+0000","last_change":"2023-11-15T01:39:02.604992+0000","last_active":"2023-11-15T01:39:02.608614+0000","last_peered":"2023-11-15T01:39:02.608614+0000","last_clean":"2023-11-15T01:39:02.608614+0000","last_became_active":"2023-11-15T01:39:02.604731+0000","last_became_peered":"2023-11-15T01:39:02.604731+0000","last_unstale":"2023-11-15T01:39:02.608614+0000","last_undegraded":"2023-11-15T01:39:02.608614+0000","last_fullsized":"2023-11-15T01:39:02.608614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.596996+0000","last_change":"2023-11-15T01:39:02.215566+0000","last_active":"2023-11-15T01:39:02.596996+0000","last_peered":"2023-11-15T01:39:02.596996+0000","last_clean":"2023-11-15T01:39:02.596996+0000","last_became_active":"2023-11-15T01:39:02.215261+0000","last_became_peered":"2023-11-15T01:39:02.215261+0000","last_unstale":"2023-11-15T01:39:02.596996+0000","last_undegraded":"2023-11-15T01:39:02.596996+0000","last_fullsized":"2023-11-15T01:39:02.596996+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598969+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:39:02.598969+0000","last_peered":"2023-11-15T01:39:02.598969+0000","last_clean":"2023-11-15T01:39:02.598969+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:39:02.598969+0000","last_undegraded":"2023-11-15T01:39:02.598969+0000","last_fullsized":"2023-11-15T01:39:02.598969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609619+0000","last_change":"2023-11-15T01:39:02.607704+0000","last_active":"2023-11-15T01:39:02.609619+0000","last_peered":"2023-11-15T01:39:02.609619+0000","last_clean":"2023-11-15T01:39:02.609619+0000","last_became_active":"2023-11-15T01:39:02.607461+0000","last_became_peered":"2023-11-15T01:39:02.607461+0000","last_unstale":"2023-11-15T01:39:02.609619+0000","last_undegraded":"2023-11-15T01:39:02.609619+0000","last_fullsized":"2023-11-15T01:39:02.609619+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593520+0000","last_change":"2023-11-15T01:39:02.208524+0000","last_active":"2023-11-15T01:39:02.593520+0000","last_peered":"2023-11-15T01:39:02.593520+0000","last_clean":"2023-11-15T01:39:02.593520+0000","last_became_active":"2023-11-15T01:39:02.208211+0000","last_became_peered":"2023-11-15T01:39:02.208211+0000","last_unstale":"2023-11-15T01:39:02.593520+0000","last_undegraded":"2023-11-15T01:39:02.593520+0000","last_fullsized":"2023-11-15T01:39:02.593520+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598462+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:39:02.598462+0000","last_peered":"2023-11-15T01:39:02.598462+0000","last_clean":"2023-11-15T01:39:02.598462+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:39:02.598462+0000","last_undegraded":"2023-11-15T01:39:02.598462+0000","last_fullsized":"2023-11-15T01:39:02.598462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":106,"acting":106,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575055,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302664,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069176,"statfs":{"total":96636764160,"available":96326836224,"internally_reserved":0,"allocated":1507328,"data_stored":780837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.55100000000000005},"min":{"1min":0.29699999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67900000000000005,"5min":0.71199999999999997,"15min":0.82299999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.33800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.73699999999999999,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.53500000000000003}]},{"osd":1,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74399999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.626},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54200000000000004,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.34399999999999997,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55800000000000005}]},{"osd":2,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54100000000000004,"15min":0.56200000000000006},"min":{"1min":0.32700000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71099999999999997,"5min":0.79600000000000004,"15min":0.82599999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":0.58499999999999996},"min":{"1min":0.40699999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.66700000000000004}]},{"osd":3,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.58099999999999996},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.76900000000000002,"5min":0.80700000000000005,"15min":0.85999999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78000000000000003,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.70399999999999996}]},{"osd":4,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64400000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.32500000000000001,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.72299999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.316,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.83099999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.70399999999999996,"5min":0.73899999999999999,"15min":0.78500000000000003},"last":0.83999999999999997}]},{"osd":6,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78400000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.85099999999999998},"last":0.75800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1568768,"data_stored":809982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.55600000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.30499999999999999},"max":{"1min":0.70999999999999996,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.41799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77800000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.58899999999999997}]},{"osd":1,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.83099999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.39100000000000001,"5min":0.33100000000000002,"15min":0.32100000000000001},"max":{"1min":0.79600000000000004,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.36699999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72499999999999998,"5min":1.746,"15min":1.746},"last":0.53800000000000003}]},{"osd":3,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.307},"max":{"1min":0.69999999999999996,"5min":0.77100000000000002,"15min":0.91300000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.52900000000000003}]},{"osd":4,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.44900000000000001,"15min":0.45000000000000001},"min":{"1min":0.29099999999999998,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.52200000000000002},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.25800000000000001},"max":{"1min":0.71199999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51900000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48199999999999998,"15min":0.48099999999999998},"min":{"1min":0.32200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63900000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.5},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57599999999999996}]},{"osd":7,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.496,"15min":0.5},"min":{"1min":0.35099999999999998,"5min":0.32500000000000001,"15min":0.29899999999999999},"max":{"1min":0.64800000000000002,"5min":0.875,"15min":0.875},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80800000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575058,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302728,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069112,"statfs":{"total":96636764160,"available":96326770688,"internally_reserved":0,"allocated":1572864,"data_stored":810866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.23999999999999999},"max":{"1min":0.50800000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.40300000000000002},"min":{"1min":0.26600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58699999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.25900000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.373,"15min":0.38900000000000001},"min":{"1min":0.27200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.57599999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.245},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.438},"min":{"1min":0.28199999999999997,"5min":0.27800000000000002,"15min":0.26200000000000001},"max":{"1min":0.68999999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.52400000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55700000000000005,"15min":0.52300000000000002},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60299999999999998,"5min":9.641,"15min":9.641},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53200000000000003,"15min":0.501},"min":{"1min":0.34200000000000003,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":0.63400000000000001,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.373}]},{"osd":4,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.42199999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.63600000000000001},"min":{"1min":0.49299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.875,"5min":1.006,"15min":1.006},"last":0.69799999999999995}]},{"osd":5,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.82299999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.432},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81200000000000006,"5min":1.111,"15min":1.111},"last":0.55700000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.67400000000000004},"min":{"1min":0.498,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":0.78000000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65700000000000003,"15min":0.68500000000000005},"min":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92800000000000005,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.59199999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.51100000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91800000000000004,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66500000000000004,"15min":0.68999999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94199999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575056,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1568768,"data_stored":810050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.375,"15min":0.371},"min":{"1min":0.27800000000000002,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.54200000000000004,"5min":2.024,"15min":2.024},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.26100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.64700000000000002,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.26100000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52400000000000002,"5min":1.768,"15min":1.768},"last":0.245},{"interface":"front","average":{"1min":0.436,"5min":0.439,"15min":0.44},"min":{"1min":0.28899999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.63500000000000001,"5min":1.982,"15min":1.982},"last":0.28899999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44,"15min":0.437},"min":{"1min":0.28100000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61299999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.67900000000000005,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.30599999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.45600000000000002,"5min":0.42199999999999999,"15min":0.40400000000000003},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98899999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.47599999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.624,"15min":0.629},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.38500000000000001},"max":{"1min":0.97899999999999998,"5min":1.881,"15min":1.881},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":1.056},"last":0.56000000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.42999999999999999,"15min":0.36499999999999999},"max":{"1min":1.04,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.5},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67000000000000004,"15min":0.67100000000000004},"min":{"1min":0.51100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.917,"15min":1.917},"last":0.52800000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69899999999999995,"15min":0.68999999999999995},"min":{"1min":0.53400000000000003,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0089999999999999,"5min":1.843,"15min":1.843},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67200000000000004,"15min":0.68700000000000006},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.40899999999999997},"max":{"1min":1.073,"5min":1.073,"15min":1.0960000000000001},"last":0.60599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575057,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306816,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065024,"statfs":{"total":96636764160,"available":96322584576,"internally_reserved":0,"allocated":1564672,"data_stored":809420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35499999999999998,"15min":0.36699999999999999},"min":{"1min":0.26900000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.46000000000000002,"5min":0.54800000000000004,"15min":0.61899999999999999},"last":0.252},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.40600000000000003},"min":{"1min":0.255,"5min":0.246,"15min":0.246},"max":{"1min":0.63200000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.35099999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.26900000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61799999999999999,"5min":0.745,"15min":0.75},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42699999999999999,"15min":0.438},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.56399999999999995,"5min":0.69799999999999995,"15min":0.92000000000000004},"last":0.318}]},{"osd":3,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.44400000000000001,"15min":0.45200000000000001},"min":{"1min":0.34899999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67400000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.439,"15min":0.443},"min":{"1min":0.34100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.30099999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.61799999999999999},"min":{"1min":0.42799999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79800000000000004,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80900000000000005,"5min":0.91100000000000003,"15min":0.95399999999999996},"last":0.51900000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.623,"15min":0.64200000000000002},"min":{"1min":0.495,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84799999999999998,"5min":1.032,"15min":1.032},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.60699999999999998,"15min":0.63600000000000001},"min":{"1min":0.48499999999999999,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":0.75,"5min":0.96699999999999997,"15min":0.99399999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64100000000000001,"15min":0.65700000000000003},"min":{"1min":0.49399999999999999,"5min":0.438,"15min":0.374},"max":{"1min":0.85799999999999998,"5min":1.002,"15min":1.0389999999999999},"last":0.499},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64500000000000002,"15min":0.67000000000000004},"min":{"1min":0.53800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56899999999999995}]},{"osd":7,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64800000000000002,"15min":0.66900000000000004},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":1.079,"15min":1.079},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66000000000000003,"15min":0.68999999999999995},"min":{"1min":0.52600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.82299999999999995,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.505}]}]},{"osd":3,"up_from":13,"seq":55834575058,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306808,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065032,"statfs":{"total":96636764160,"available":96322592768,"internally_reserved":0,"allocated":1556480,"data_stored":809316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35599999999999998,"15min":0.374},"min":{"1min":0.23200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.54500000000000004,"5min":0.65900000000000003,"15min":0.79900000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.374,"15min":0.40000000000000002},"min":{"1min":0.24199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.503,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.438}]},{"osd":1,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.36499999999999999,"15min":0.39000000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.24399999999999999},"max":{"1min":0.52500000000000002,"5min":0.57799999999999996,"15min":0.72899999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.44500000000000001},"min":{"1min":0.28699999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70199999999999996,"5min":0.72499999999999998,"15min":0.747},"last":0.48499999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41499999999999998,"15min":0.44800000000000001},"min":{"1min":0.29499999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.47699999999999998},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":0.69199999999999995,"15min":0.81999999999999995},"last":0.56499999999999995}]},{"osd":4,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56899999999999995,"15min":0.61599999999999999},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.80500000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.626},"min":{"1min":0.435,"5min":0.40600000000000003,"15min":0.39000000000000001},"max":{"1min":0.84799999999999998,"5min":0.89200000000000002,"15min":1.0589999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58799999999999997,"15min":0.63300000000000001},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.76800000000000002,"5min":0.92000000000000004,"15min":1.0569999999999999},"last":0.749},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.63900000000000001},"min":{"1min":0.41499999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73799999999999999,"5min":0.879,"15min":0.95999999999999996},"last":0.92600000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60199999999999998,"15min":0.64600000000000002},"min":{"1min":0.40899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.0980000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.67000000000000004},"min":{"1min":0.42899999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.95799999999999996,"15min":1.169},"last":0.80600000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.66600000000000004},"min":{"1min":0.48399999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":1.0429999999999999,"15min":1.071},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86099999999999999,"5min":0.996,"15min":1.1459999999999999},"last":0.97199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575056,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302720,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069120,"statfs":{"total":96636764160,"available":96326778880,"internally_reserved":0,"allocated":1564672,"data_stored":810230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.34499999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.84499999999999997,"15min":0.88},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.374,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.754,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.47499999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.42099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72499999999999998,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.432},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.45500000000000002,"5min":0.34799999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.59899999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.58699999999999997},"min":{"1min":0.44,"5min":0.34100000000000003,"15min":0.30299999999999999},"max":{"1min":0.70299999999999996,"5min":2.887,"15min":2.887},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.33100000000000002},"max":{"1min":0.77700000000000002,"5min":0.92300000000000004,"15min":0.96299999999999997},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.41299999999999998,"5min":0.35799999999999998,"15min":0.33100000000000002},"max":{"1min":0.71599999999999997,"5min":2.464,"15min":2.464},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.623,"15min":0.60699999999999998},"min":{"1min":0.47599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79400000000000004,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.67700000000000005}]},{"osd":5,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48399999999999999,"15min":0.46800000000000003},"min":{"1min":0.34499999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70499999999999996,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.27400000000000002},"max":{"1min":0.65800000000000003,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.66300000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52200000000000002,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.29699999999999999,"15min":0.28899999999999998},"max":{"1min":0.67800000000000005,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.82899999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.77300000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58499999999999996,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71799999999999997,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.73399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575055,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302664,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069176,"statfs":{"total":96636764160,"available":96326836224,"internally_reserved":0,"allocated":1507328,"data_stored":780837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52600000000000002,"15min":0.54900000000000004},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.63700000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.629},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.55000000000000004},"min":{"1min":0.32300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.73199999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.55700000000000005}]},{"osd":1,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.33300000000000002,"15min":0.32600000000000001},"max":{"1min":0.78500000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55200000000000005,"15min":0.56899999999999995},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.35099999999999998},"max":{"1min":0.72099999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.52400000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69699999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.495},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55400000000000005,"15min":0.57199999999999995},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.84599999999999997},"last":0.60399999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70099999999999996,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":0.58699999999999997},"min":{"1min":0.38800000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74399999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68100000000000005}]},{"osd":4,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.432,"15min":0.44400000000000001},"min":{"1min":0.32400000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57899999999999996,"5min":0.66500000000000004,"15min":0.76500000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.50800000000000001,"15min":0.51900000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67900000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.752}]},{"osd":6,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.31,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.47699999999999998,"15min":0.48899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.80100000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63800000000000001,"5min":0.72999999999999998,"15min":0.755},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.77100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:39:06.639 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:39:06.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.787+0000 7f9cc7e9c700 1 Processor -- start 2023-11-15T01:39:06.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.787+0000 7f9cc7e9c700 1 -- start start 2023-11-15T01:39:06.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.788+0000 7f9cc7e9c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9cc00833a0 0x7f9cc00a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.788+0000 7f9cc7e9c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cc00be520 0x7f9cc0154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.788+0000 7f9cc7e9c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc00a85e0 con 0x7f9cc0154450 2023-11-15T01:39:06.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.788+0000 7f9cc7e9c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc0065940 con 0x7f9cc00833a0 2023-11-15T01:39:06.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.788+0000 7f9cc7e9c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc0065660 con 0x7f9cc00be520 2023-11-15T01:39:06.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.788+0000 7f9cc5437700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9cc00833a0 0x7f9cc00a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.788+0000 7f9cc5437700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9cc00833a0 0x7f9cc00a7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57708/0 (socket says 172.21.15.1:57708) 2023-11-15T01:39:06.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.788+0000 7f9cc5437700 1 -- 172.21.15.1:0/3214863530 learned_addr learned my addr 172.21.15.1:0/3214863530 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:06.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.789+0000 7f9cc6439700 1 --2- 172.21.15.1:0/3214863530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cc00be520 0x7f9cc0154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.789+0000 7f9cc5437700 1 -- 172.21.15.1:0/3214863530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cc00be520 msgr2=0x7f9cc0154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:06.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.789+0000 7f9cc5437700 1 --2- 172.21.15.1:0/3214863530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cc00be520 0x7f9cc0154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.789+0000 7f9cc5437700 1 -- 172.21.15.1:0/3214863530 >> v1:172.21.15.141:6789/0 conn(0x7f9cc0154450 legacy=0x7f9cc00bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.789+0000 7f9cc5437700 1 -- 172.21.15.1:0/3214863530 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc00c6f50 con 0x7f9cc00833a0 2023-11-15T01:39:06.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.789+0000 7f9cc6439700 1 --2- 172.21.15.1:0/3214863530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cc00be520 0x7f9cc0154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:39:06.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.789+0000 7f9cc5437700 1 --2- 172.21.15.1:0/3214863530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cc00833a0 0x7f9cc00a7ef0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f9cb4006fd0 tx=0x7f9cb40090f0).ready entity=mon.0 client_cookie=db30206f7c85e00d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:06.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.789+0000 7f9cc4c36700 1 -- 172.21.15.1:0/3214863530 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb400b600 con 0x7f9cc00833a0 2023-11-15T01:39:06.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.789+0000 7f9cc4c36700 1 -- 172.21.15.1:0/3214863530 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb400b760 con 0x7f9cc00833a0 2023-11-15T01:39:06.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.789+0000 7f9cc4c36700 1 -- 172.21.15.1:0/3214863530 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb400bae0 con 0x7f9cc00833a0 2023-11-15T01:39:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.789+0000 7f9cc7e9c700 1 -- 172.21.15.1:0/3214863530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cc00833a0 msgr2=0x7f9cc00a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.789+0000 7f9cc7e9c700 1 --2- 172.21.15.1:0/3214863530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cc00833a0 0x7f9cc00a7ef0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f9cb4006fd0 tx=0x7f9cb40090f0).stop 2023-11-15T01:39:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.790+0000 7f9cc7e9c700 1 -- 172.21.15.1:0/3214863530 shutdown_connections 2023-11-15T01:39:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.790+0000 7f9cc7e9c700 1 --2- 172.21.15.1:0/3214863530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cc00be520 0x7f9cc0154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.790+0000 7f9cc7e9c700 1 --2- 172.21.15.1:0/3214863530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cc00833a0 0x7f9cc00a7ef0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.790+0000 7f9cc7e9c700 1 -- 172.21.15.1:0/3214863530 >> 172.21.15.1:0/3214863530 conn(0x7f9cc0082f90 msgr2=0x7f9cc00c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:06.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.790+0000 7f9cc7e9c700 1 -- 172.21.15.1:0/3214863530 shutdown_connections 2023-11-15T01:39:06.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.790+0000 7f9cc7e9c700 1 -- 172.21.15.1:0/3214863530 wait complete. 2023-11-15T01:39:06.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.791+0000 7f9cc7e9c700 1 Processor -- start 2023-11-15T01:39:06.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.791+0000 7f9cc7e9c700 1 -- start start 2023-11-15T01:39:06.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.791+0000 7f9cc7e9c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cc00833a0 0x7f9cc014ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.791+0000 7f9cc7e9c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cc00be520 0x7f9cc00a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc7e9c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cc0154450 0x7f9cc00a73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc7e9c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc00a6a30 con 0x7f9cc0154450 2023-11-15T01:39:06.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc7e9c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc00a5e60 con 0x7f9cc00be520 2023-11-15T01:39:06.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc7e9c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc00a6100 con 0x7f9cc00833a0 2023-11-15T01:39:06.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc6439700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cc0154450 0x7f9cc00a73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc6439700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cc0154450 0x7f9cc00a73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57712/0 (socket says 172.21.15.1:57712) 2023-11-15T01:39:06.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc6439700 1 -- 172.21.15.1:0/2907412175 learned_addr learned my addr 172.21.15.1:0/2907412175 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:06.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc5437700 1 --2- 172.21.15.1:0/2907412175 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cc00be520 0x7f9cc00a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc5c38700 1 --2- 172.21.15.1:0/2907412175 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cc00833a0 0x7f9cc014ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc6439700 1 -- 172.21.15.1:0/2907412175 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cc00833a0 msgr2=0x7f9cc014ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc6439700 1 --2- 172.21.15.1:0/2907412175 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cc00833a0 0x7f9cc014ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc6439700 1 -- 172.21.15.1:0/2907412175 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cc00be520 msgr2=0x7f9cc00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc6439700 1 --2- 172.21.15.1:0/2907412175 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cc00be520 0x7f9cc00a6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc6439700 1 -- 172.21.15.1:0/2907412175 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb4009370 con 0x7f9cc0154450 2023-11-15T01:39:06.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc6439700 1 --2- 172.21.15.1:0/2907412175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cc0154450 0x7f9cc00a73b0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f9cb0006c40 tx=0x7f9cb0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:06.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cbdffb700 1 -- 172.21.15.1:0/2907412175 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0011590 con 0x7f9cc0154450 2023-11-15T01:39:06.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cbdffb700 1 -- 172.21.15.1:0/2907412175 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb00116f0 con 0x7f9cc0154450 2023-11-15T01:39:06.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc7e9c700 1 -- 172.21.15.1:0/2907412175 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc00a63e0 con 0x7f9cc0154450 2023-11-15T01:39:06.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cbdffb700 1 -- 172.21.15.1:0/2907412175 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0011a90 con 0x7f9cc0154450 2023-11-15T01:39:06.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.792+0000 7f9cc7e9c700 1 -- 172.21.15.1:0/2907412175 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc014f1c0 con 0x7f9cc0154450 2023-11-15T01:39:06.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.793+0000 7f9cc7e9c700 1 -- 172.21.15.1:0/2907412175 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc014f3b0 con 0x7f9cc0154450 2023-11-15T01:39:06.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.794+0000 7f9cbdffb700 1 -- 172.21.15.1:0/2907412175 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9cb0012420 con 0x7f9cc0154450 2023-11-15T01:39:06.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.794+0000 7f9cbdffb700 1 --2- 172.21.15.1:0/2907412175 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9cac05f270 0x7f9cac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:06.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.794+0000 7f9cbdffb700 1 -- 172.21.15.1:0/2907412175 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f9cb0079ef0 con 0x7f9cc0154450 2023-11-15T01:39:06.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.794+0000 7f9cc5c38700 1 --2- 172.21.15.1:0/2907412175 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9cac05f270 0x7f9cac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:06.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.795+0000 7f9cc5c38700 1 --2- 172.21.15.1:0/2907412175 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9cac05f270 0x7f9cac061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9cb8007fd0 tx=0x7f9cb8001530).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:06.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.798+0000 7f9cbdffb700 1 -- 172.21.15.1:0/2907412175 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9cb004ae30 con 0x7f9cc0154450 2023-11-15T01:39:06.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.967+0000 7f9cc7e9c700 1 -- 172.21.15.1:0/2907412175 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9cc00a6b70 con 0x7f9cac05f270 2023-11-15T01:39:06.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.977+0000 7f9cbdffb700 1 -- 172.21.15.1:0/2907412175 <== mgr.6919 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359411 (secure 0 0 0) 0x7f9cc00a6b70 con 0x7f9cac05f270 2023-11-15T01:39:06.983 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:39:06.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.981+0000 7f9cc7e9c700 1 -- 172.21.15.1:0/2907412175 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9cac05f270 msgr2=0x7f9cac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.981+0000 7f9cc7e9c700 1 --2- 172.21.15.1:0/2907412175 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9cac05f270 0x7f9cac061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9cb8007fd0 tx=0x7f9cb8001530).stop 2023-11-15T01:39:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.981+0000 7f9cc7e9c700 1 -- 172.21.15.1:0/2907412175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cc0154450 msgr2=0x7f9cc00a73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.981+0000 7f9cc7e9c700 1 --2- 172.21.15.1:0/2907412175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cc0154450 0x7f9cc00a73b0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f9cb0006c40 tx=0x7f9cb0008040).stop 2023-11-15T01:39:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.981+0000 7f9cc7e9c700 1 -- 172.21.15.1:0/2907412175 shutdown_connections 2023-11-15T01:39:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.981+0000 7f9cc7e9c700 1 --2- 172.21.15.1:0/2907412175 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9cac05f270 0x7f9cac061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.981+0000 7f9cc7e9c700 1 --2- 172.21.15.1:0/2907412175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cc0154450 0x7f9cc00a73b0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.981+0000 7f9cc7e9c700 1 --2- 172.21.15.1:0/2907412175 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cc00833a0 0x7f9cc014ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.981+0000 7f9cc7e9c700 1 --2- 172.21.15.1:0/2907412175 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cc00be520 0x7f9cc00a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.981+0000 7f9cc7e9c700 1 -- 172.21.15.1:0/2907412175 >> 172.21.15.1:0/2907412175 conn(0x7f9cc0082f90 msgr2=0x7f9cc00c48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.981+0000 7f9cc7e9c700 1 -- 172.21.15.1:0/2907412175 shutdown_connections 2023-11-15T01:39:06.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:06.981+0000 7f9cc7e9c700 1 -- 172.21.15.1:0/2907412175 wait complete. 2023-11-15T01:39:06.989 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:39:06.994 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T01:39:05.151482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":230,"acting":230,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2429848,"kb_used_data":12120,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752544872,"statfs":{"total":773094113280,"available":770605948928,"internally_reserved":0,"allocated":12410880,"data_stored":6421538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6812,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.009147"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613925+0000","last_change":"2023-11-15T01:39:02.602396+0000","last_active":"2023-11-15T01:39:02.613925+0000","last_peered":"2023-11-15T01:39:02.613925+0000","last_clean":"2023-11-15T01:39:02.613925+0000","last_became_active":"2023-11-15T01:39:02.602116+0000","last_became_peered":"2023-11-15T01:39:02.602116+0000","last_unstale":"2023-11-15T01:39:02.613925+0000","last_undegraded":"2023-11-15T01:39:02.613925+0000","last_fullsized":"2023-11-15T01:39:02.613925+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616122+0000","last_change":"2023-11-15T01:39:02.218901+0000","last_active":"2023-11-15T01:39:02.616122+0000","last_peered":"2023-11-15T01:39:02.616122+0000","last_clean":"2023-11-15T01:39:02.616122+0000","last_became_active":"2023-11-15T01:39:02.218594+0000","last_became_peered":"2023-11-15T01:39:02.218594+0000","last_unstale":"2023-11-15T01:39:02.616122+0000","last_undegraded":"2023-11-15T01:39:02.616122+0000","last_fullsized":"2023-11-15T01:39:02.616122+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603572+0000","last_change":"2023-11-15T01:39:02.600412+0000","last_active":"2023-11-15T01:39:02.603572+0000","last_peered":"2023-11-15T01:39:02.603572+0000","last_clean":"2023-11-15T01:39:02.603572+0000","last_became_active":"2023-11-15T01:39:02.600184+0000","last_became_peered":"2023-11-15T01:39:02.600184+0000","last_unstale":"2023-11-15T01:39:02.603572+0000","last_undegraded":"2023-11-15T01:39:02.603572+0000","last_fullsized":"2023-11-15T01:39:02.603572+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588186+0000","last_change":"2023-11-15T01:39:02.212406+0000","last_active":"2023-11-15T01:39:02.588186+0000","last_peered":"2023-11-15T01:39:02.588186+0000","last_clean":"2023-11-15T01:39:02.588186+0000","last_became_active":"2023-11-15T01:39:02.212126+0000","last_became_peered":"2023-11-15T01:39:02.212126+0000","last_unstale":"2023-11-15T01:39:02.588186+0000","last_undegraded":"2023-11-15T01:39:02.588186+0000","last_fullsized":"2023-11-15T01:39:02.588186+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619501+0000","last_change":"2023-11-15T01:39:02.616063+0000","last_active":"2023-11-15T01:39:02.619501+0000","last_peered":"2023-11-15T01:39:02.619501+0000","last_clean":"2023-11-15T01:39:02.619501+0000","last_became_active":"2023-11-15T01:39:02.615758+0000","last_became_peered":"2023-11-15T01:39:02.615758+0000","last_unstale":"2023-11-15T01:39:02.619501+0000","last_undegraded":"2023-11-15T01:39:02.619501+0000","last_fullsized":"2023-11-15T01:39:02.619501+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.599254+0000","last_change":"2023-11-15T01:39:02.218897+0000","last_active":"2023-11-15T01:39:02.599254+0000","last_peered":"2023-11-15T01:39:02.599254+0000","last_clean":"2023-11-15T01:39:02.599254+0000","last_became_active":"2023-11-15T01:39:02.218572+0000","last_became_peered":"2023-11-15T01:39:02.218572+0000","last_unstale":"2023-11-15T01:39:02.599254+0000","last_undegraded":"2023-11-15T01:39:02.599254+0000","last_fullsized":"2023-11-15T01:39:02.599254+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613204+0000","last_change":"2023-11-15T01:39:02.604340+0000","last_active":"2023-11-15T01:39:02.613204+0000","last_peered":"2023-11-15T01:39:02.613204+0000","last_clean":"2023-11-15T01:39:02.613204+0000","last_became_active":"2023-11-15T01:39:02.604039+0000","last_became_peered":"2023-11-15T01:39:02.604039+0000","last_unstale":"2023-11-15T01:39:02.613204+0000","last_undegraded":"2023-11-15T01:39:02.613204+0000","last_fullsized":"2023-11-15T01:39:02.613204+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604468+0000","last_change":"2023-11-15T01:39:02.208432+0000","last_active":"2023-11-15T01:39:02.604468+0000","last_peered":"2023-11-15T01:39:02.604468+0000","last_clean":"2023-11-15T01:39:02.604468+0000","last_became_active":"2023-11-15T01:39:02.208125+0000","last_became_peered":"2023-11-15T01:39:02.208125+0000","last_unstale":"2023-11-15T01:39:02.604468+0000","last_undegraded":"2023-11-15T01:39:02.604468+0000","last_fullsized":"2023-11-15T01:39:02.604468+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619578+0000","last_change":"2023-11-15T01:39:02.615475+0000","last_active":"2023-11-15T01:39:02.619578+0000","last_peered":"2023-11-15T01:39:02.619578+0000","last_clean":"2023-11-15T01:39:02.619578+0000","last_became_active":"2023-11-15T01:39:02.615012+0000","last_became_peered":"2023-11-15T01:39:02.615012+0000","last_unstale":"2023-11-15T01:39:02.619578+0000","last_undegraded":"2023-11-15T01:39:02.619578+0000","last_fullsized":"2023-11-15T01:39:02.619578+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607240+0000","last_change":"2023-11-15T01:39:02.216489+0000","last_active":"2023-11-15T01:39:02.607240+0000","last_peered":"2023-11-15T01:39:02.607240+0000","last_clean":"2023-11-15T01:39:02.607240+0000","last_became_active":"2023-11-15T01:39:02.216208+0000","last_became_peered":"2023-11-15T01:39:02.216208+0000","last_unstale":"2023-11-15T01:39:02.607240+0000","last_undegraded":"2023-11-15T01:39:02.607240+0000","last_fullsized":"2023-11-15T01:39:02.607240+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617075+0000","last_change":"2023-11-15T01:39:02.612235+0000","last_active":"2023-11-15T01:39:02.617075+0000","last_peered":"2023-11-15T01:39:02.617075+0000","last_clean":"2023-11-15T01:39:02.617075+0000","last_became_active":"2023-11-15T01:39:02.611945+0000","last_became_peered":"2023-11-15T01:39:02.611945+0000","last_unstale":"2023-11-15T01:39:02.617075+0000","last_undegraded":"2023-11-15T01:39:02.617075+0000","last_fullsized":"2023-11-15T01:39:02.617075+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619471+0000","last_change":"2023-11-15T01:39:02.616010+0000","last_active":"2023-11-15T01:39:02.619471+0000","last_peered":"2023-11-15T01:39:02.619471+0000","last_clean":"2023-11-15T01:39:02.619471+0000","last_became_active":"2023-11-15T01:39:02.615676+0000","last_became_peered":"2023-11-15T01:39:02.615676+0000","last_unstale":"2023-11-15T01:39:02.619471+0000","last_undegraded":"2023-11-15T01:39:02.619471+0000","last_fullsized":"2023-11-15T01:39:02.619471+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587855+0000","last_change":"2023-11-15T01:39:02.215407+0000","last_active":"2023-11-15T01:39:02.587855+0000","last_peered":"2023-11-15T01:39:02.587855+0000","last_clean":"2023-11-15T01:39:02.587855+0000","last_became_active":"2023-11-15T01:39:02.214892+0000","last_became_peered":"2023-11-15T01:39:02.214892+0000","last_unstale":"2023-11-15T01:39:02.587855+0000","last_undegraded":"2023-11-15T01:39:02.587855+0000","last_fullsized":"2023-11-15T01:39:02.587855+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609760+0000","last_change":"2023-11-15T01:39:02.607451+0000","last_active":"2023-11-15T01:39:02.609760+0000","last_peered":"2023-11-15T01:39:02.609760+0000","last_clean":"2023-11-15T01:39:02.609760+0000","last_became_active":"2023-11-15T01:39:02.606494+0000","last_became_peered":"2023-11-15T01:39:02.606494+0000","last_unstale":"2023-11-15T01:39:02.609760+0000","last_undegraded":"2023-11-15T01:39:02.609760+0000","last_fullsized":"2023-11-15T01:39:02.609760+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.594989+0000","last_change":"2023-11-15T01:39:02.219867+0000","last_active":"2023-11-15T01:39:02.594989+0000","last_peered":"2023-11-15T01:39:02.594989+0000","last_clean":"2023-11-15T01:39:02.594989+0000","last_became_active":"2023-11-15T01:39:02.219549+0000","last_became_peered":"2023-11-15T01:39:02.219549+0000","last_unstale":"2023-11-15T01:39:02.594989+0000","last_undegraded":"2023-11-15T01:39:02.594989+0000","last_fullsized":"2023-11-15T01:39:02.594989+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615575+0000","last_change":"2023-11-15T01:39:02.614727+0000","last_active":"2023-11-15T01:39:02.615575+0000","last_peered":"2023-11-15T01:39:02.615575+0000","last_clean":"2023-11-15T01:39:02.615575+0000","last_became_active":"2023-11-15T01:39:02.614435+0000","last_became_peered":"2023-11-15T01:39:02.614435+0000","last_unstale":"2023-11-15T01:39:02.615575+0000","last_undegraded":"2023-11-15T01:39:02.615575+0000","last_fullsized":"2023-11-15T01:39:02.615575+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598319+0000","last_change":"2023-11-15T01:39:02.205172+0000","last_active":"2023-11-15T01:39:02.598319+0000","last_peered":"2023-11-15T01:39:02.598319+0000","last_clean":"2023-11-15T01:39:02.598319+0000","last_became_active":"2023-11-15T01:39:02.204880+0000","last_became_peered":"2023-11-15T01:39:02.204880+0000","last_unstale":"2023-11-15T01:39:02.598319+0000","last_undegraded":"2023-11-15T01:39:02.598319+0000","last_fullsized":"2023-11-15T01:39:02.598319+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.618919+0000","last_change":"2023-11-15T01:39:02.616562+0000","last_active":"2023-11-15T01:39:02.618919+0000","last_peered":"2023-11-15T01:39:02.618919+0000","last_clean":"2023-11-15T01:39:02.618919+0000","last_became_active":"2023-11-15T01:39:02.615953+0000","last_became_peered":"2023-11-15T01:39:02.615953+0000","last_unstale":"2023-11-15T01:39:02.618919+0000","last_undegraded":"2023-11-15T01:39:02.618919+0000","last_fullsized":"2023-11-15T01:39:02.618919+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617325+0000","last_change":"2023-11-15T01:39:02.616248+0000","last_active":"2023-11-15T01:39:02.617325+0000","last_peered":"2023-11-15T01:39:02.617325+0000","last_clean":"2023-11-15T01:39:02.617325+0000","last_became_active":"2023-11-15T01:39:02.615799+0000","last_became_peered":"2023-11-15T01:39:02.615799+0000","last_unstale":"2023-11-15T01:39:02.617325+0000","last_undegraded":"2023-11-15T01:39:02.617325+0000","last_fullsized":"2023-11-15T01:39:02.617325+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615681+0000","last_change":"2023-11-15T01:39:02.214198+0000","last_active":"2023-11-15T01:39:02.615681+0000","last_peered":"2023-11-15T01:39:02.615681+0000","last_clean":"2023-11-15T01:39:02.615681+0000","last_became_active":"2023-11-15T01:39:02.213807+0000","last_became_peered":"2023-11-15T01:39:02.213807+0000","last_unstale":"2023-11-15T01:39:02.615681+0000","last_undegraded":"2023-11-15T01:39:02.615681+0000","last_fullsized":"2023-11-15T01:39:02.615681+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608614+0000","last_change":"2023-11-15T01:39:02.603155+0000","last_active":"2023-11-15T01:39:02.608614+0000","last_peered":"2023-11-15T01:39:02.608614+0000","last_clean":"2023-11-15T01:39:02.608614+0000","last_became_active":"2023-11-15T01:39:02.602711+0000","last_became_peered":"2023-11-15T01:39:02.602711+0000","last_unstale":"2023-11-15T01:39:02.608614+0000","last_undegraded":"2023-11-15T01:39:02.608614+0000","last_fullsized":"2023-11-15T01:39:02.608614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604881+0000","last_change":"2023-11-15T01:39:02.216520+0000","last_active":"2023-11-15T01:39:02.604881+0000","last_peered":"2023-11-15T01:39:02.604881+0000","last_clean":"2023-11-15T01:39:02.604881+0000","last_became_active":"2023-11-15T01:39:02.216259+0000","last_became_peered":"2023-11-15T01:39:02.216259+0000","last_unstale":"2023-11-15T01:39:02.604881+0000","last_undegraded":"2023-11-15T01:39:02.604881+0000","last_fullsized":"2023-11-15T01:39:02.604881+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603577+0000","last_change":"2023-11-15T01:39:02.601591+0000","last_active":"2023-11-15T01:39:02.603577+0000","last_peered":"2023-11-15T01:39:02.603577+0000","last_clean":"2023-11-15T01:39:02.603577+0000","last_became_active":"2023-11-15T01:39:02.600935+0000","last_became_peered":"2023-11-15T01:39:02.600935+0000","last_unstale":"2023-11-15T01:39:02.603577+0000","last_undegraded":"2023-11-15T01:39:02.603577+0000","last_fullsized":"2023-11-15T01:39:02.603577+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593325+0000","last_change":"2023-11-15T01:39:02.208175+0000","last_active":"2023-11-15T01:39:02.593325+0000","last_peered":"2023-11-15T01:39:02.593325+0000","last_clean":"2023-11-15T01:39:02.593325+0000","last_became_active":"2023-11-15T01:39:02.206885+0000","last_became_peered":"2023-11-15T01:39:02.206885+0000","last_unstale":"2023-11-15T01:39:02.593325+0000","last_undegraded":"2023-11-15T01:39:02.593325+0000","last_fullsized":"2023-11-15T01:39:02.593325+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615601+0000","last_change":"2023-11-15T01:39:02.610080+0000","last_active":"2023-11-15T01:39:02.615601+0000","last_peered":"2023-11-15T01:39:02.615601+0000","last_clean":"2023-11-15T01:39:02.615601+0000","last_became_active":"2023-11-15T01:39:02.609739+0000","last_became_peered":"2023-11-15T01:39:02.609739+0000","last_unstale":"2023-11-15T01:39:02.615601+0000","last_undegraded":"2023-11-15T01:39:02.615601+0000","last_fullsized":"2023-11-15T01:39:02.615601+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.592262+0000","last_change":"2023-11-15T01:39:02.220136+0000","last_active":"2023-11-15T01:39:02.592262+0000","last_peered":"2023-11-15T01:39:02.592262+0000","last_clean":"2023-11-15T01:39:02.592262+0000","last_became_active":"2023-11-15T01:39:02.219849+0000","last_became_peered":"2023-11-15T01:39:02.219849+0000","last_unstale":"2023-11-15T01:39:02.592262+0000","last_undegraded":"2023-11-15T01:39:02.592262+0000","last_fullsized":"2023-11-15T01:39:02.592262+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617875+0000","last_change":"2023-11-15T01:39:02.617127+0000","last_active":"2023-11-15T01:39:02.617875+0000","last_peered":"2023-11-15T01:39:02.617875+0000","last_clean":"2023-11-15T01:39:02.617875+0000","last_became_active":"2023-11-15T01:39:02.616799+0000","last_became_peered":"2023-11-15T01:39:02.616799+0000","last_unstale":"2023-11-15T01:39:02.617875+0000","last_undegraded":"2023-11-15T01:39:02.617875+0000","last_fullsized":"2023-11-15T01:39:02.617875+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.589698+0000","last_change":"2023-11-15T01:39:02.218107+0000","last_active":"2023-11-15T01:39:02.589698+0000","last_peered":"2023-11-15T01:39:02.589698+0000","last_clean":"2023-11-15T01:39:02.589698+0000","last_became_active":"2023-11-15T01:39:02.217829+0000","last_became_peered":"2023-11-15T01:39:02.217829+0000","last_unstale":"2023-11-15T01:39:02.589698+0000","last_undegraded":"2023-11-15T01:39:02.589698+0000","last_fullsized":"2023-11-15T01:39:02.589698+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.594904+0000","last_change":"2023-11-15T01:39:02.218103+0000","last_active":"2023-11-15T01:39:02.594904+0000","last_peered":"2023-11-15T01:39:02.594904+0000","last_clean":"2023-11-15T01:39:02.594904+0000","last_became_active":"2023-11-15T01:39:02.217828+0000","last_became_peered":"2023-11-15T01:39:02.217828+0000","last_unstale":"2023-11-15T01:39:02.594904+0000","last_undegraded":"2023-11-15T01:39:02.594904+0000","last_fullsized":"2023-11-15T01:39:02.594904+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.605850+0000","last_change":"2023-11-15T01:39:02.207964+0000","last_active":"2023-11-15T01:39:02.605850+0000","last_peered":"2023-11-15T01:39:02.605850+0000","last_clean":"2023-11-15T01:39:02.605850+0000","last_became_active":"2023-11-15T01:39:02.206902+0000","last_became_peered":"2023-11-15T01:39:02.206902+0000","last_unstale":"2023-11-15T01:39:02.605850+0000","last_undegraded":"2023-11-15T01:39:02.605850+0000","last_fullsized":"2023-11-15T01:39:02.605850+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617013+0000","last_change":"2023-11-15T01:39:02.615878+0000","last_active":"2023-11-15T01:39:02.617013+0000","last_peered":"2023-11-15T01:39:02.617013+0000","last_clean":"2023-11-15T01:39:02.617013+0000","last_became_active":"2023-11-15T01:39:02.615584+0000","last_became_peered":"2023-11-15T01:39:02.615584+0000","last_unstale":"2023-11-15T01:39:02.617013+0000","last_undegraded":"2023-11-15T01:39:02.617013+0000","last_fullsized":"2023-11-15T01:39:02.617013+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.595065+0000","last_change":"2023-11-15T01:39:02.216952+0000","last_active":"2023-11-15T01:39:02.595065+0000","last_peered":"2023-11-15T01:39:02.595065+0000","last_clean":"2023-11-15T01:39:02.595065+0000","last_became_active":"2023-11-15T01:39:02.216649+0000","last_became_peered":"2023-11-15T01:39:02.216649+0000","last_unstale":"2023-11-15T01:39:02.595065+0000","last_undegraded":"2023-11-15T01:39:02.595065+0000","last_fullsized":"2023-11-15T01:39:02.595065+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608591+0000","last_change":"2023-11-15T01:39:02.602985+0000","last_active":"2023-11-15T01:39:02.608591+0000","last_peered":"2023-11-15T01:39:02.608591+0000","last_clean":"2023-11-15T01:39:02.608591+0000","last_became_active":"2023-11-15T01:39:02.602397+0000","last_became_peered":"2023-11-15T01:39:02.602397+0000","last_unstale":"2023-11-15T01:39:02.608591+0000","last_undegraded":"2023-11-15T01:39:02.608591+0000","last_fullsized":"2023-11-15T01:39:02.608591+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.602956+0000","last_change":"2023-11-15T01:39:02.206395+0000","last_active":"2023-11-15T01:39:02.602956+0000","last_peered":"2023-11-15T01:39:02.602956+0000","last_clean":"2023-11-15T01:39:02.602956+0000","last_became_active":"2023-11-15T01:39:02.206104+0000","last_became_peered":"2023-11-15T01:39:02.206104+0000","last_unstale":"2023-11-15T01:39:02.602956+0000","last_undegraded":"2023-11-15T01:39:02.602956+0000","last_fullsized":"2023-11-15T01:39:02.602956+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587393+0000","last_change":"2023-11-15T01:39:02.211558+0000","last_active":"2023-11-15T01:39:02.587393+0000","last_peered":"2023-11-15T01:39:02.587393+0000","last_clean":"2023-11-15T01:39:02.587393+0000","last_became_active":"2023-11-15T01:39:02.211279+0000","last_became_peered":"2023-11-15T01:39:02.211279+0000","last_unstale":"2023-11-15T01:39:02.587393+0000","last_undegraded":"2023-11-15T01:39:02.587393+0000","last_fullsized":"2023-11-15T01:39:02.587393+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609748+0000","last_change":"2023-11-15T01:39:02.607093+0000","last_active":"2023-11-15T01:39:02.609748+0000","last_peered":"2023-11-15T01:39:02.609748+0000","last_clean":"2023-11-15T01:39:02.609748+0000","last_became_active":"2023-11-15T01:39:02.606809+0000","last_became_peered":"2023-11-15T01:39:02.606809+0000","last_unstale":"2023-11-15T01:39:02.609748+0000","last_undegraded":"2023-11-15T01:39:02.609748+0000","last_fullsized":"2023-11-15T01:39:02.609748+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587388+0000","last_change":"2023-11-15T01:39:02.211455+0000","last_active":"2023-11-15T01:39:02.587388+0000","last_peered":"2023-11-15T01:39:02.587388+0000","last_clean":"2023-11-15T01:39:02.587388+0000","last_became_active":"2023-11-15T01:39:02.211174+0000","last_became_peered":"2023-11-15T01:39:02.211174+0000","last_unstale":"2023-11-15T01:39:02.587388+0000","last_undegraded":"2023-11-15T01:39:02.587388+0000","last_fullsized":"2023-11-15T01:39:02.587388+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611523+0000","last_change":"2023-11-15T01:39:02.608672+0000","last_active":"2023-11-15T01:39:02.611523+0000","last_peered":"2023-11-15T01:39:02.611523+0000","last_clean":"2023-11-15T01:39:02.611523+0000","last_became_active":"2023-11-15T01:39:02.608345+0000","last_became_peered":"2023-11-15T01:39:02.608345+0000","last_unstale":"2023-11-15T01:39:02.611523+0000","last_undegraded":"2023-11-15T01:39:02.611523+0000","last_fullsized":"2023-11-15T01:39:02.611523+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616556+0000","last_change":"2023-11-15T01:39:02.613660+0000","last_active":"2023-11-15T01:39:02.616556+0000","last_peered":"2023-11-15T01:39:02.616556+0000","last_clean":"2023-11-15T01:39:02.616556+0000","last_became_active":"2023-11-15T01:39:02.613366+0000","last_became_peered":"2023-11-15T01:39:02.613366+0000","last_unstale":"2023-11-15T01:39:02.616556+0000","last_undegraded":"2023-11-15T01:39:02.616556+0000","last_fullsized":"2023-11-15T01:39:02.616556+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598361+0000","last_change":"2023-11-15T01:39:02.215823+0000","last_active":"2023-11-15T01:39:02.598361+0000","last_peered":"2023-11-15T01:39:02.598361+0000","last_clean":"2023-11-15T01:39:02.598361+0000","last_became_active":"2023-11-15T01:39:02.215525+0000","last_became_peered":"2023-11-15T01:39:02.215525+0000","last_unstale":"2023-11-15T01:39:02.598361+0000","last_undegraded":"2023-11-15T01:39:02.598361+0000","last_fullsized":"2023-11-15T01:39:02.598361+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.614005+0000","last_change":"2023-11-15T01:39:02.609396+0000","last_active":"2023-11-15T01:39:02.614005+0000","last_peered":"2023-11-15T01:39:02.614005+0000","last_clean":"2023-11-15T01:39:02.614005+0000","last_became_active":"2023-11-15T01:39:02.609124+0000","last_became_peered":"2023-11-15T01:39:02.609124+0000","last_unstale":"2023-11-15T01:39:02.614005+0000","last_undegraded":"2023-11-15T01:39:02.614005+0000","last_fullsized":"2023-11-15T01:39:02.614005+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588286+0000","last_change":"2023-11-15T01:39:02.216539+0000","last_active":"2023-11-15T01:39:02.588286+0000","last_peered":"2023-11-15T01:39:02.588286+0000","last_clean":"2023-11-15T01:39:02.588286+0000","last_became_active":"2023-11-15T01:39:02.216251+0000","last_became_peered":"2023-11-15T01:39:02.216251+0000","last_unstale":"2023-11-15T01:39:02.588286+0000","last_undegraded":"2023-11-15T01:39:02.588286+0000","last_fullsized":"2023-11-15T01:39:02.588286+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.614176+0000","last_change":"2023-11-15T01:39:02.610179+0000","last_active":"2023-11-15T01:39:02.614176+0000","last_peered":"2023-11-15T01:39:02.614176+0000","last_clean":"2023-11-15T01:39:02.614176+0000","last_became_active":"2023-11-15T01:39:02.609897+0000","last_became_peered":"2023-11-15T01:39:02.609897+0000","last_unstale":"2023-11-15T01:39:02.614176+0000","last_undegraded":"2023-11-15T01:39:02.614176+0000","last_fullsized":"2023-11-15T01:39:02.614176+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609871+0000","last_change":"2023-11-15T01:39:02.608291+0000","last_active":"2023-11-15T01:39:02.609871+0000","last_peered":"2023-11-15T01:39:02.609871+0000","last_clean":"2023-11-15T01:39:02.609871+0000","last_became_active":"2023-11-15T01:39:02.608031+0000","last_became_peered":"2023-11-15T01:39:02.608031+0000","last_unstale":"2023-11-15T01:39:02.609871+0000","last_undegraded":"2023-11-15T01:39:02.609871+0000","last_fullsized":"2023-11-15T01:39:02.609871+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597800+0000","last_change":"2023-11-15T01:39:02.216727+0000","last_active":"2023-11-15T01:39:02.597800+0000","last_peered":"2023-11-15T01:39:02.597800+0000","last_clean":"2023-11-15T01:39:02.597800+0000","last_became_active":"2023-11-15T01:39:02.216418+0000","last_became_peered":"2023-11-15T01:39:02.216418+0000","last_unstale":"2023-11-15T01:39:02.597800+0000","last_undegraded":"2023-11-15T01:39:02.597800+0000","last_fullsized":"2023-11-15T01:39:02.597800+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609371+0000","last_change":"2023-11-15T01:39:02.607331+0000","last_active":"2023-11-15T01:39:02.609371+0000","last_peered":"2023-11-15T01:39:02.609371+0000","last_clean":"2023-11-15T01:39:02.609371+0000","last_became_active":"2023-11-15T01:39:02.605984+0000","last_became_peered":"2023-11-15T01:39:02.605984+0000","last_unstale":"2023-11-15T01:39:02.609371+0000","last_undegraded":"2023-11-15T01:39:02.609371+0000","last_fullsized":"2023-11-15T01:39:02.609371+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587486+0000","last_change":"2023-11-15T01:39:02.221244+0000","last_active":"2023-11-15T01:39:02.587486+0000","last_peered":"2023-11-15T01:39:02.587486+0000","last_clean":"2023-11-15T01:39:02.587486+0000","last_became_active":"2023-11-15T01:39:02.220925+0000","last_became_peered":"2023-11-15T01:39:02.220925+0000","last_unstale":"2023-11-15T01:39:02.587486+0000","last_undegraded":"2023-11-15T01:39:02.587486+0000","last_fullsized":"2023-11-15T01:39:02.587486+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617865+0000","last_change":"2023-11-15T01:39:02.617229+0000","last_active":"2023-11-15T01:39:02.617865+0000","last_peered":"2023-11-15T01:39:02.617865+0000","last_clean":"2023-11-15T01:39:02.617865+0000","last_became_active":"2023-11-15T01:39:02.616939+0000","last_became_peered":"2023-11-15T01:39:02.616939+0000","last_unstale":"2023-11-15T01:39:02.617865+0000","last_undegraded":"2023-11-15T01:39:02.617865+0000","last_fullsized":"2023-11-15T01:39:02.617865+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593426+0000","last_change":"2023-11-15T01:39:02.221666+0000","last_active":"2023-11-15T01:39:02.593426+0000","last_peered":"2023-11-15T01:39:02.593426+0000","last_clean":"2023-11-15T01:39:02.593426+0000","last_became_active":"2023-11-15T01:39:02.219800+0000","last_became_peered":"2023-11-15T01:39:02.219800+0000","last_unstale":"2023-11-15T01:39:02.593426+0000","last_undegraded":"2023-11-15T01:39:02.593426+0000","last_fullsized":"2023-11-15T01:39:02.593426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604011+0000","last_change":"2023-11-15T01:39:02.602358+0000","last_active":"2023-11-15T01:39:02.604011+0000","last_peered":"2023-11-15T01:39:02.604011+0000","last_clean":"2023-11-15T01:39:02.604011+0000","last_became_active":"2023-11-15T01:39:02.601545+0000","last_became_peered":"2023-11-15T01:39:02.601545+0000","last_unstale":"2023-11-15T01:39:02.604011+0000","last_undegraded":"2023-11-15T01:39:02.604011+0000","last_fullsized":"2023-11-15T01:39:02.604011+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.592380+0000","last_change":"2023-11-15T01:39:02.216213+0000","last_active":"2023-11-15T01:39:02.592380+0000","last_peered":"2023-11-15T01:39:02.592380+0000","last_clean":"2023-11-15T01:39:02.592380+0000","last_became_active":"2023-11-15T01:39:02.215899+0000","last_became_peered":"2023-11-15T01:39:02.215899+0000","last_unstale":"2023-11-15T01:39:02.592380+0000","last_undegraded":"2023-11-15T01:39:02.592380+0000","last_fullsized":"2023-11-15T01:39:02.592380+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608705+0000","last_change":"2023-11-15T01:39:02.604261+0000","last_active":"2023-11-15T01:39:02.608705+0000","last_peered":"2023-11-15T01:39:02.608705+0000","last_clean":"2023-11-15T01:39:02.608705+0000","last_became_active":"2023-11-15T01:39:02.603967+0000","last_became_peered":"2023-11-15T01:39:02.603967+0000","last_unstale":"2023-11-15T01:39:02.608705+0000","last_undegraded":"2023-11-15T01:39:02.608705+0000","last_fullsized":"2023-11-15T01:39:02.608705+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.600917+0000","last_change":"2023-11-15T01:39:02.212132+0000","last_active":"2023-11-15T01:39:02.600917+0000","last_peered":"2023-11-15T01:39:02.600917+0000","last_clean":"2023-11-15T01:39:02.600917+0000","last_became_active":"2023-11-15T01:39:02.210392+0000","last_became_peered":"2023-11-15T01:39:02.210392+0000","last_unstale":"2023-11-15T01:39:02.600917+0000","last_undegraded":"2023-11-15T01:39:02.600917+0000","last_fullsized":"2023-11-15T01:39:02.600917+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603584+0000","last_change":"2023-11-15T01:39:02.600884+0000","last_active":"2023-11-15T01:39:02.603584+0000","last_peered":"2023-11-15T01:39:02.603584+0000","last_clean":"2023-11-15T01:39:02.603584+0000","last_became_active":"2023-11-15T01:39:02.600570+0000","last_became_peered":"2023-11-15T01:39:02.600570+0000","last_unstale":"2023-11-15T01:39:02.603584+0000","last_undegraded":"2023-11-15T01:39:02.603584+0000","last_fullsized":"2023-11-15T01:39:02.603584+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604360+0000","last_change":"2023-11-15T01:39:02.216713+0000","last_active":"2023-11-15T01:39:02.604360+0000","last_peered":"2023-11-15T01:39:02.604360+0000","last_clean":"2023-11-15T01:39:02.604360+0000","last_became_active":"2023-11-15T01:39:02.216444+0000","last_became_peered":"2023-11-15T01:39:02.216444+0000","last_unstale":"2023-11-15T01:39:02.604360+0000","last_undegraded":"2023-11-15T01:39:02.604360+0000","last_fullsized":"2023-11-15T01:39:02.604360+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615377+0000","last_change":"2023-11-15T01:39:02.613239+0000","last_active":"2023-11-15T01:39:02.615377+0000","last_peered":"2023-11-15T01:39:02.615377+0000","last_clean":"2023-11-15T01:39:02.615377+0000","last_became_active":"2023-11-15T01:39:02.612946+0000","last_became_peered":"2023-11-15T01:39:02.612946+0000","last_unstale":"2023-11-15T01:39:02.615377+0000","last_undegraded":"2023-11-15T01:39:02.615377+0000","last_fullsized":"2023-11-15T01:39:02.615377+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.596143+0000","last_change":"2023-11-15T01:39:02.209925+0000","last_active":"2023-11-15T01:39:02.596143+0000","last_peered":"2023-11-15T01:39:02.596143+0000","last_clean":"2023-11-15T01:39:02.596143+0000","last_became_active":"2023-11-15T01:39:02.209663+0000","last_became_peered":"2023-11-15T01:39:02.209663+0000","last_unstale":"2023-11-15T01:39:02.596143+0000","last_undegraded":"2023-11-15T01:39:02.596143+0000","last_fullsized":"2023-11-15T01:39:02.596143+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609247+0000","last_change":"2023-11-15T01:39:02.608245+0000","last_active":"2023-11-15T01:39:02.609247+0000","last_peered":"2023-11-15T01:39:02.609247+0000","last_clean":"2023-11-15T01:39:02.609247+0000","last_became_active":"2023-11-15T01:39:02.607952+0000","last_became_peered":"2023-11-15T01:39:02.607952+0000","last_unstale":"2023-11-15T01:39:02.609247+0000","last_undegraded":"2023-11-15T01:39:02.609247+0000","last_fullsized":"2023-11-15T01:39:02.609247+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607666+0000","last_change":"2023-11-15T01:39:02.212445+0000","last_active":"2023-11-15T01:39:02.607666+0000","last_peered":"2023-11-15T01:39:02.607666+0000","last_clean":"2023-11-15T01:39:02.607666+0000","last_became_active":"2023-11-15T01:39:02.212161+0000","last_became_peered":"2023-11-15T01:39:02.212161+0000","last_unstale":"2023-11-15T01:39:02.607666+0000","last_undegraded":"2023-11-15T01:39:02.607666+0000","last_fullsized":"2023-11-15T01:39:02.607666+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.601003+0000","last_change":"2023-11-15T01:39:02.212296+0000","last_active":"2023-11-15T01:39:02.601003+0000","last_peered":"2023-11-15T01:39:02.601003+0000","last_clean":"2023-11-15T01:39:02.601003+0000","last_became_active":"2023-11-15T01:39:02.211995+0000","last_became_peered":"2023-11-15T01:39:02.211995+0000","last_unstale":"2023-11-15T01:39:02.601003+0000","last_undegraded":"2023-11-15T01:39:02.601003+0000","last_fullsized":"2023-11-15T01:39:02.601003+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609392+0000","last_change":"2023-11-15T01:39:02.607853+0000","last_active":"2023-11-15T01:39:02.609392+0000","last_peered":"2023-11-15T01:39:02.609392+0000","last_clean":"2023-11-15T01:39:02.609392+0000","last_became_active":"2023-11-15T01:39:02.607594+0000","last_became_peered":"2023-11-15T01:39:02.607594+0000","last_unstale":"2023-11-15T01:39:02.609392+0000","last_undegraded":"2023-11-15T01:39:02.609392+0000","last_fullsized":"2023-11-15T01:39:02.609392+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603556+0000","last_change":"2023-11-15T01:39:02.601396+0000","last_active":"2023-11-15T01:39:02.603556+0000","last_peered":"2023-11-15T01:39:02.603556+0000","last_clean":"2023-11-15T01:39:02.603556+0000","last_became_active":"2023-11-15T01:39:02.601172+0000","last_became_peered":"2023-11-15T01:39:02.601172+0000","last_unstale":"2023-11-15T01:39:02.603556+0000","last_undegraded":"2023-11-15T01:39:02.603556+0000","last_fullsized":"2023-11-15T01:39:02.603556+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619529+0000","last_change":"2023-11-15T01:39:02.614609+0000","last_active":"2023-11-15T01:39:02.619529+0000","last_peered":"2023-11-15T01:39:02.619529+0000","last_clean":"2023-11-15T01:39:02.619529+0000","last_became_active":"2023-11-15T01:39:02.614307+0000","last_became_peered":"2023-11-15T01:39:02.614307+0000","last_unstale":"2023-11-15T01:39:02.619529+0000","last_undegraded":"2023-11-15T01:39:02.619529+0000","last_fullsized":"2023-11-15T01:39:02.619529+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593584+0000","last_change":"2023-11-15T01:39:02.213334+0000","last_active":"2023-11-15T01:39:02.593584+0000","last_peered":"2023-11-15T01:39:02.593584+0000","last_clean":"2023-11-15T01:39:02.593584+0000","last_became_active":"2023-11-15T01:39:02.212950+0000","last_became_peered":"2023-11-15T01:39:02.212950+0000","last_unstale":"2023-11-15T01:39:02.593584+0000","last_undegraded":"2023-11-15T01:39:02.593584+0000","last_fullsized":"2023-11-15T01:39:02.593584+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607206+0000","last_change":"2023-11-15T01:39:02.605916+0000","last_active":"2023-11-15T01:39:02.607206+0000","last_peered":"2023-11-15T01:39:02.607206+0000","last_clean":"2023-11-15T01:39:02.607206+0000","last_became_active":"2023-11-15T01:39:02.605221+0000","last_became_peered":"2023-11-15T01:39:02.605221+0000","last_unstale":"2023-11-15T01:39:02.607206+0000","last_undegraded":"2023-11-15T01:39:02.607206+0000","last_fullsized":"2023-11-15T01:39:02.607206+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.592684+0000","last_change":"2023-11-15T01:39:02.214571+0000","last_active":"2023-11-15T01:39:02.592684+0000","last_peered":"2023-11-15T01:39:02.592684+0000","last_clean":"2023-11-15T01:39:02.592684+0000","last_became_active":"2023-11-15T01:39:02.214277+0000","last_became_peered":"2023-11-15T01:39:02.214277+0000","last_unstale":"2023-11-15T01:39:02.592684+0000","last_undegraded":"2023-11-15T01:39:02.592684+0000","last_fullsized":"2023-11-15T01:39:02.592684+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606587+0000","last_change":"2023-11-15T01:39:02.602418+0000","last_active":"2023-11-15T01:39:02.606587+0000","last_peered":"2023-11-15T01:39:02.606587+0000","last_clean":"2023-11-15T01:39:02.606587+0000","last_became_active":"2023-11-15T01:39:02.602063+0000","last_became_peered":"2023-11-15T01:39:02.602063+0000","last_unstale":"2023-11-15T01:39:02.606587+0000","last_undegraded":"2023-11-15T01:39:02.606587+0000","last_fullsized":"2023-11-15T01:39:02.606587+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.595019+0000","last_change":"2023-11-15T01:39:02.212659+0000","last_active":"2023-11-15T01:39:02.595019+0000","last_peered":"2023-11-15T01:39:02.595019+0000","last_clean":"2023-11-15T01:39:02.595019+0000","last_became_active":"2023-11-15T01:39:02.212415+0000","last_became_peered":"2023-11-15T01:39:02.212415+0000","last_unstale":"2023-11-15T01:39:02.595019+0000","last_undegraded":"2023-11-15T01:39:02.595019+0000","last_fullsized":"2023-11-15T01:39:02.595019+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.618320+0000","last_change":"2023-11-15T01:39:02.614637+0000","last_active":"2023-11-15T01:39:02.618320+0000","last_peered":"2023-11-15T01:39:02.618320+0000","last_clean":"2023-11-15T01:39:02.618320+0000","last_became_active":"2023-11-15T01:39:02.614343+0000","last_became_peered":"2023-11-15T01:39:02.614343+0000","last_unstale":"2023-11-15T01:39:02.618320+0000","last_undegraded":"2023-11-15T01:39:02.618320+0000","last_fullsized":"2023-11-15T01:39:02.618320+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588382+0000","last_change":"2023-11-15T01:39:02.216949+0000","last_active":"2023-11-15T01:39:02.588382+0000","last_peered":"2023-11-15T01:39:02.588382+0000","last_clean":"2023-11-15T01:39:02.588382+0000","last_became_active":"2023-11-15T01:39:02.216678+0000","last_became_peered":"2023-11-15T01:39:02.216678+0000","last_unstale":"2023-11-15T01:39:02.588382+0000","last_undegraded":"2023-11-15T01:39:02.588382+0000","last_fullsized":"2023-11-15T01:39:02.588382+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615337+0000","last_change":"2023-11-15T01:39:02.613451+0000","last_active":"2023-11-15T01:39:02.615337+0000","last_peered":"2023-11-15T01:39:02.615337+0000","last_clean":"2023-11-15T01:39:02.615337+0000","last_became_active":"2023-11-15T01:39:02.613039+0000","last_became_peered":"2023-11-15T01:39:02.613039+0000","last_unstale":"2023-11-15T01:39:02.615337+0000","last_undegraded":"2023-11-15T01:39:02.615337+0000","last_fullsized":"2023-11-15T01:39:02.615337+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617294+0000","last_change":"2023-11-15T01:39:02.614533+0000","last_active":"2023-11-15T01:39:02.617294+0000","last_peered":"2023-11-15T01:39:02.617294+0000","last_clean":"2023-11-15T01:39:02.617294+0000","last_became_active":"2023-11-15T01:39:02.614181+0000","last_became_peered":"2023-11-15T01:39:02.614181+0000","last_unstale":"2023-11-15T01:39:02.617294+0000","last_undegraded":"2023-11-15T01:39:02.617294+0000","last_fullsized":"2023-11-15T01:39:02.617294+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611758+0000","last_change":"2023-11-15T01:39:02.215496+0000","last_active":"2023-11-15T01:39:02.611758+0000","last_peered":"2023-11-15T01:39:02.611758+0000","last_clean":"2023-11-15T01:39:02.611758+0000","last_became_active":"2023-11-15T01:39:02.215218+0000","last_became_peered":"2023-11-15T01:39:02.215218+0000","last_unstale":"2023-11-15T01:39:02.611758+0000","last_undegraded":"2023-11-15T01:39:02.611758+0000","last_fullsized":"2023-11-15T01:39:02.611758+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613955+0000","last_change":"2023-11-15T01:39:02.218556+0000","last_active":"2023-11-15T01:39:02.613955+0000","last_peered":"2023-11-15T01:39:02.613955+0000","last_clean":"2023-11-15T01:39:02.613955+0000","last_became_active":"2023-11-15T01:39:02.218223+0000","last_became_peered":"2023-11-15T01:39:02.218223+0000","last_unstale":"2023-11-15T01:39:02.613955+0000","last_undegraded":"2023-11-15T01:39:02.613955+0000","last_fullsized":"2023-11-15T01:39:02.613955+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611507+0000","last_change":"2023-11-15T01:39:02.607095+0000","last_active":"2023-11-15T01:39:02.611507+0000","last_peered":"2023-11-15T01:39:02.611507+0000","last_clean":"2023-11-15T01:39:02.611507+0000","last_became_active":"2023-11-15T01:39:02.606862+0000","last_became_peered":"2023-11-15T01:39:02.606862+0000","last_unstale":"2023-11-15T01:39:02.611507+0000","last_undegraded":"2023-11-15T01:39:02.611507+0000","last_fullsized":"2023-11-15T01:39:02.611507+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.591994+0000","last_change":"2023-11-15T01:39:02.208100+0000","last_active":"2023-11-15T01:39:02.591994+0000","last_peered":"2023-11-15T01:39:02.591994+0000","last_clean":"2023-11-15T01:39:02.591994+0000","last_became_active":"2023-11-15T01:39:02.207787+0000","last_became_peered":"2023-11-15T01:39:02.207787+0000","last_unstale":"2023-11-15T01:39:02.591994+0000","last_undegraded":"2023-11-15T01:39:02.591994+0000","last_fullsized":"2023-11-15T01:39:02.591994+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.612658+0000","last_change":"2023-11-15T01:39:02.603012+0000","last_active":"2023-11-15T01:39:02.612658+0000","last_peered":"2023-11-15T01:39:02.612658+0000","last_clean":"2023-11-15T01:39:02.612658+0000","last_became_active":"2023-11-15T01:39:02.602782+0000","last_became_peered":"2023-11-15T01:39:02.602782+0000","last_unstale":"2023-11-15T01:39:02.612658+0000","last_undegraded":"2023-11-15T01:39:02.612658+0000","last_fullsized":"2023-11-15T01:39:02.612658+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593111+0000","last_change":"2023-11-15T01:39:02.211688+0000","last_active":"2023-11-15T01:39:02.593111+0000","last_peered":"2023-11-15T01:39:02.593111+0000","last_clean":"2023-11-15T01:39:02.593111+0000","last_became_active":"2023-11-15T01:39:02.211393+0000","last_became_peered":"2023-11-15T01:39:02.211393+0000","last_unstale":"2023-11-15T01:39:02.593111+0000","last_undegraded":"2023-11-15T01:39:02.593111+0000","last_fullsized":"2023-11-15T01:39:02.593111+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616897+0000","last_change":"2023-11-15T01:39:02.614804+0000","last_active":"2023-11-15T01:39:02.616897+0000","last_peered":"2023-11-15T01:39:02.616897+0000","last_clean":"2023-11-15T01:39:02.616897+0000","last_became_active":"2023-11-15T01:39:02.614516+0000","last_became_peered":"2023-11-15T01:39:02.614516+0000","last_unstale":"2023-11-15T01:39:02.616897+0000","last_undegraded":"2023-11-15T01:39:02.616897+0000","last_fullsized":"2023-11-15T01:39:02.616897+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607913+0000","last_change":"2023-11-15T01:39:02.212073+0000","last_active":"2023-11-15T01:39:02.607913+0000","last_peered":"2023-11-15T01:39:02.607913+0000","last_clean":"2023-11-15T01:39:02.607913+0000","last_became_active":"2023-11-15T01:39:02.211789+0000","last_became_peered":"2023-11-15T01:39:02.211789+0000","last_unstale":"2023-11-15T01:39:02.607913+0000","last_undegraded":"2023-11-15T01:39:02.607913+0000","last_fullsized":"2023-11-15T01:39:02.607913+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.599449+0000","last_change":"2023-11-15T01:39:02.597319+0000","last_active":"2023-11-15T01:39:02.599449+0000","last_peered":"2023-11-15T01:39:02.599449+0000","last_clean":"2023-11-15T01:39:02.599449+0000","last_became_active":"2023-11-15T01:39:02.597051+0000","last_became_peered":"2023-11-15T01:39:02.597051+0000","last_unstale":"2023-11-15T01:39:02.599449+0000","last_undegraded":"2023-11-15T01:39:02.599449+0000","last_fullsized":"2023-11-15T01:39:02.599449+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.614112+0000","last_change":"2023-11-15T01:39:02.213626+0000","last_active":"2023-11-15T01:39:02.614112+0000","last_peered":"2023-11-15T01:39:02.614112+0000","last_clean":"2023-11-15T01:39:02.614112+0000","last_became_active":"2023-11-15T01:39:02.213021+0000","last_became_peered":"2023-11-15T01:39:02.213021+0000","last_unstale":"2023-11-15T01:39:02.614112+0000","last_undegraded":"2023-11-15T01:39:02.614112+0000","last_fullsized":"2023-11-15T01:39:02.614112+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604865+0000","last_change":"2023-11-15T01:39:02.598955+0000","last_active":"2023-11-15T01:39:02.604865+0000","last_peered":"2023-11-15T01:39:02.604865+0000","last_clean":"2023-11-15T01:39:02.604865+0000","last_became_active":"2023-11-15T01:39:02.598657+0000","last_became_peered":"2023-11-15T01:39:02.598657+0000","last_unstale":"2023-11-15T01:39:02.604865+0000","last_undegraded":"2023-11-15T01:39:02.604865+0000","last_fullsized":"2023-11-15T01:39:02.604865+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588486+0000","last_change":"2023-11-15T01:39:02.212406+0000","last_active":"2023-11-15T01:39:02.588486+0000","last_peered":"2023-11-15T01:39:02.588486+0000","last_clean":"2023-11-15T01:39:02.588486+0000","last_became_active":"2023-11-15T01:39:02.212116+0000","last_became_peered":"2023-11-15T01:39:02.212116+0000","last_unstale":"2023-11-15T01:39:02.588486+0000","last_undegraded":"2023-11-15T01:39:02.588486+0000","last_fullsized":"2023-11-15T01:39:02.588486+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606629+0000","last_change":"2023-11-15T01:39:02.605182+0000","last_active":"2023-11-15T01:39:02.606629+0000","last_peered":"2023-11-15T01:39:02.606629+0000","last_clean":"2023-11-15T01:39:02.606629+0000","last_became_active":"2023-11-15T01:39:02.604892+0000","last_became_peered":"2023-11-15T01:39:02.604892+0000","last_unstale":"2023-11-15T01:39:02.606629+0000","last_undegraded":"2023-11-15T01:39:02.606629+0000","last_fullsized":"2023-11-15T01:39:02.606629+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597149+0000","last_change":"2023-11-15T01:39:02.210712+0000","last_active":"2023-11-15T01:39:02.597149+0000","last_peered":"2023-11-15T01:39:02.597149+0000","last_clean":"2023-11-15T01:39:02.597149+0000","last_became_active":"2023-11-15T01:39:02.210222+0000","last_became_peered":"2023-11-15T01:39:02.210222+0000","last_unstale":"2023-11-15T01:39:02.597149+0000","last_undegraded":"2023-11-15T01:39:02.597149+0000","last_fullsized":"2023-11-15T01:39:02.597149+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.601085+0000","last_change":"2023-11-15T01:39:02.213634+0000","last_active":"2023-11-15T01:39:02.601085+0000","last_peered":"2023-11-15T01:39:02.601085+0000","last_clean":"2023-11-15T01:39:02.601085+0000","last_became_active":"2023-11-15T01:39:02.213348+0000","last_became_peered":"2023-11-15T01:39:02.213348+0000","last_unstale":"2023-11-15T01:39:02.601085+0000","last_undegraded":"2023-11-15T01:39:02.601085+0000","last_fullsized":"2023-11-15T01:39:02.601085+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615584+0000","last_change":"2023-11-15T01:39:02.613224+0000","last_active":"2023-11-15T01:39:02.615584+0000","last_peered":"2023-11-15T01:39:02.615584+0000","last_clean":"2023-11-15T01:39:02.615584+0000","last_became_active":"2023-11-15T01:39:02.612879+0000","last_became_peered":"2023-11-15T01:39:02.612879+0000","last_unstale":"2023-11-15T01:39:02.615584+0000","last_undegraded":"2023-11-15T01:39:02.615584+0000","last_fullsized":"2023-11-15T01:39:02.615584+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.594724+0000","last_change":"2023-11-15T01:39:02.212971+0000","last_active":"2023-11-15T01:39:02.594724+0000","last_peered":"2023-11-15T01:39:02.594724+0000","last_clean":"2023-11-15T01:39:02.594724+0000","last_became_active":"2023-11-15T01:39:02.212667+0000","last_became_peered":"2023-11-15T01:39:02.212667+0000","last_unstale":"2023-11-15T01:39:02.594724+0000","last_undegraded":"2023-11-15T01:39:02.594724+0000","last_fullsized":"2023-11-15T01:39:02.594724+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615238+0000","last_change":"2023-11-15T01:39:02.613211+0000","last_active":"2023-11-15T01:39:02.615238+0000","last_peered":"2023-11-15T01:39:02.615238+0000","last_clean":"2023-11-15T01:39:02.615238+0000","last_became_active":"2023-11-15T01:39:02.612908+0000","last_became_peered":"2023-11-15T01:39:02.612908+0000","last_unstale":"2023-11-15T01:39:02.615238+0000","last_undegraded":"2023-11-15T01:39:02.615238+0000","last_fullsized":"2023-11-15T01:39:02.615238+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593625+0000","last_change":"2023-11-15T01:39:02.211682+0000","last_active":"2023-11-15T01:39:02.593625+0000","last_peered":"2023-11-15T01:39:02.593625+0000","last_clean":"2023-11-15T01:39:02.593625+0000","last_became_active":"2023-11-15T01:39:02.211336+0000","last_became_peered":"2023-11-15T01:39:02.211336+0000","last_unstale":"2023-11-15T01:39:02.593625+0000","last_undegraded":"2023-11-15T01:39:02.593625+0000","last_fullsized":"2023-11-15T01:39:02.593625+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597448+0000","last_change":"2023-11-15T01:39:02.216677+0000","last_active":"2023-11-15T01:39:02.597448+0000","last_peered":"2023-11-15T01:39:02.597448+0000","last_clean":"2023-11-15T01:39:02.597448+0000","last_became_active":"2023-11-15T01:39:02.216244+0000","last_became_peered":"2023-11-15T01:39:02.216244+0000","last_unstale":"2023-11-15T01:39:02.597448+0000","last_undegraded":"2023-11-15T01:39:02.597448+0000","last_fullsized":"2023-11-15T01:39:02.597448+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593206+0000","last_change":"2023-11-15T01:39:02.212115+0000","last_active":"2023-11-15T01:39:02.593206+0000","last_peered":"2023-11-15T01:39:02.593206+0000","last_clean":"2023-11-15T01:39:02.593206+0000","last_became_active":"2023-11-15T01:39:02.211847+0000","last_became_peered":"2023-11-15T01:39:02.211847+0000","last_unstale":"2023-11-15T01:39:02.593206+0000","last_undegraded":"2023-11-15T01:39:02.593206+0000","last_fullsized":"2023-11-15T01:39:02.593206+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606667+0000","last_change":"2023-11-15T01:39:02.604865+0000","last_active":"2023-11-15T01:39:02.606667+0000","last_peered":"2023-11-15T01:39:02.606667+0000","last_clean":"2023-11-15T01:39:02.606667+0000","last_became_active":"2023-11-15T01:39:02.604576+0000","last_became_peered":"2023-11-15T01:39:02.604576+0000","last_unstale":"2023-11-15T01:39:02.606667+0000","last_undegraded":"2023-11-15T01:39:02.606667+0000","last_fullsized":"2023-11-15T01:39:02.606667+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597373+0000","last_change":"2023-11-15T01:39:02.212456+0000","last_active":"2023-11-15T01:39:02.597373+0000","last_peered":"2023-11-15T01:39:02.597373+0000","last_clean":"2023-11-15T01:39:02.597373+0000","last_became_active":"2023-11-15T01:39:02.212123+0000","last_became_peered":"2023-11-15T01:39:02.212123+0000","last_unstale":"2023-11-15T01:39:02.597373+0000","last_undegraded":"2023-11-15T01:39:02.597373+0000","last_fullsized":"2023-11-15T01:39:02.597373+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.601148+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:39:02.601148+0000","last_peered":"2023-11-15T01:39:02.601148+0000","last_clean":"2023-11-15T01:39:02.601148+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:39:02.601148+0000","last_undegraded":"2023-11-15T01:39:02.601148+0000","last_fullsized":"2023-11-15T01:39:02.601148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.596932+0000","last_change":"2023-11-15T01:39:02.594932+0000","last_active":"2023-11-15T01:39:02.596932+0000","last_peered":"2023-11-15T01:39:02.596932+0000","last_clean":"2023-11-15T01:39:02.596932+0000","last_became_active":"2023-11-15T01:39:02.594643+0000","last_became_peered":"2023-11-15T01:39:02.594643+0000","last_unstale":"2023-11-15T01:39:02.596932+0000","last_undegraded":"2023-11-15T01:39:02.596932+0000","last_fullsized":"2023-11-15T01:39:02.596932+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611619+0000","last_change":"2023-11-15T01:39:02.210563+0000","last_active":"2023-11-15T01:39:02.611619+0000","last_peered":"2023-11-15T01:39:02.611619+0000","last_clean":"2023-11-15T01:39:02.611619+0000","last_became_active":"2023-11-15T01:39:02.210071+0000","last_became_peered":"2023-11-15T01:39:02.210071+0000","last_unstale":"2023-11-15T01:39:02.611619+0000","last_undegraded":"2023-11-15T01:39:02.611619+0000","last_fullsized":"2023-11-15T01:39:02.611619+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-11-15T01:38:58.001178+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:38:58.001178+0000","last_peered":"2023-11-15T01:38:58.001178+0000","last_clean":"2023-11-15T01:38:58.001178+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:38:58.001178+0000","last_undegraded":"2023-11-15T01:38:58.001178+0000","last_fullsized":"2023-11-15T01:38:58.001178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611509+0000","last_change":"2023-11-15T01:39:02.610776+0000","last_active":"2023-11-15T01:39:02.611509+0000","last_peered":"2023-11-15T01:39:02.611509+0000","last_clean":"2023-11-15T01:39:02.611509+0000","last_became_active":"2023-11-15T01:39:02.610520+0000","last_became_peered":"2023-11-15T01:39:02.610520+0000","last_unstale":"2023-11-15T01:39:02.611509+0000","last_undegraded":"2023-11-15T01:39:02.611509+0000","last_fullsized":"2023-11-15T01:39:02.611509+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593208+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:39:02.593208+0000","last_peered":"2023-11-15T01:39:02.593208+0000","last_clean":"2023-11-15T01:39:02.593208+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:39:02.593208+0000","last_undegraded":"2023-11-15T01:39:02.593208+0000","last_fullsized":"2023-11-15T01:39:02.593208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:02.186462+0000","last_change":"2023-11-15T01:39:02.186462+0000","last_active":"2023-11-15T01:39:02.186462+0000","last_peered":"2023-11-15T01:39:02.186462+0000","last_clean":"2023-11-15T01:39:02.186462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:02.186462+0000","last_undegraded":"2023-11-15T01:39:02.186462+0000","last_fullsized":"2023-11-15T01:39:02.186462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.599145+0000","last_change":"2023-11-15T01:39:02.209388+0000","last_active":"2023-11-15T01:39:02.599145+0000","last_peered":"2023-11-15T01:39:02.599145+0000","last_clean":"2023-11-15T01:39:02.599145+0000","last_became_active":"2023-11-15T01:39:02.209125+0000","last_became_peered":"2023-11-15T01:39:02.209125+0000","last_unstale":"2023-11-15T01:39:02.599145+0000","last_undegraded":"2023-11-15T01:39:02.599145+0000","last_fullsized":"2023-11-15T01:39:02.599145+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":97,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-11-15T01:38:58.001177+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:38:58.001177+0000","last_peered":"2023-11-15T01:38:58.001177+0000","last_clean":"2023-11-15T01:38:58.001177+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:38:58.001177+0000","last_undegraded":"2023-11-15T01:38:58.001177+0000","last_fullsized":"2023-11-15T01:38:58.001177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":94,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-11-15T01:38:58.001361+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:38:58.001361+0000","last_peered":"2023-11-15T01:38:58.001361+0000","last_clean":"2023-11-15T01:38:58.001361+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:38:58.001361+0000","last_undegraded":"2023-11-15T01:38:58.001361+0000","last_fullsized":"2023-11-15T01:38:58.001361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608911+0000","last_change":"2023-11-15T01:39:02.604538+0000","last_active":"2023-11-15T01:39:02.608911+0000","last_peered":"2023-11-15T01:39:02.608911+0000","last_clean":"2023-11-15T01:39:02.608911+0000","last_became_active":"2023-11-15T01:39:02.604164+0000","last_became_peered":"2023-11-15T01:39:02.604164+0000","last_unstale":"2023-11-15T01:39:02.608911+0000","last_undegraded":"2023-11-15T01:39:02.608911+0000","last_fullsized":"2023-11-15T01:39:02.608911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:39:01.178176+0000","last_change":"2023-11-15T01:39:01.178176+0000","last_active":"2023-11-15T01:39:01.178176+0000","last_peered":"2023-11-15T01:39:01.178176+0000","last_clean":"2023-11-15T01:39:01.178176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:39:01.178176+0000","last_undegraded":"2023-11-15T01:39:01.178176+0000","last_fullsized":"2023-11-15T01:39:01.178176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-11-15T01:38:58.001375+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:38:58.001375+0000","last_peered":"2023-11-15T01:38:58.001375+0000","last_clean":"2023-11-15T01:38:58.001375+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:38:58.001375+0000","last_undegraded":"2023-11-15T01:38:58.001375+0000","last_fullsized":"2023-11-15T01:38:58.001375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613936+0000","last_change":"2023-11-15T01:39:02.613124+0000","last_active":"2023-11-15T01:39:02.613936+0000","last_peered":"2023-11-15T01:39:02.613936+0000","last_clean":"2023-11-15T01:39:02.613936+0000","last_became_active":"2023-11-15T01:39:02.612807+0000","last_became_peered":"2023-11-15T01:39:02.612807+0000","last_unstale":"2023-11-15T01:39:02.613936+0000","last_undegraded":"2023-11-15T01:39:02.613936+0000","last_fullsized":"2023-11-15T01:39:02.613936+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593105+0000","last_change":"2023-11-15T01:39:02.208753+0000","last_active":"2023-11-15T01:39:02.593105+0000","last_peered":"2023-11-15T01:39:02.593105+0000","last_clean":"2023-11-15T01:39:02.593105+0000","last_became_active":"2023-11-15T01:39:02.208459+0000","last_became_peered":"2023-11-15T01:39:02.208459+0000","last_unstale":"2023-11-15T01:39:02.593105+0000","last_undegraded":"2023-11-15T01:39:02.593105+0000","last_fullsized":"2023-11-15T01:39:02.593105+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-11-15T01:38:58.001307+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:38:58.001307+0000","last_peered":"2023-11-15T01:38:58.001307+0000","last_clean":"2023-11-15T01:38:58.001307+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:38:58.001307+0000","last_undegraded":"2023-11-15T01:38:58.001307+0000","last_fullsized":"2023-11-15T01:38:58.001307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608614+0000","last_change":"2023-11-15T01:39:02.604992+0000","last_active":"2023-11-15T01:39:02.608614+0000","last_peered":"2023-11-15T01:39:02.608614+0000","last_clean":"2023-11-15T01:39:02.608614+0000","last_became_active":"2023-11-15T01:39:02.604731+0000","last_became_peered":"2023-11-15T01:39:02.604731+0000","last_unstale":"2023-11-15T01:39:02.608614+0000","last_undegraded":"2023-11-15T01:39:02.608614+0000","last_fullsized":"2023-11-15T01:39:02.608614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.596996+0000","last_change":"2023-11-15T01:39:02.215566+0000","last_active":"2023-11-15T01:39:02.596996+0000","last_peered":"2023-11-15T01:39:02.596996+0000","last_clean":"2023-11-15T01:39:02.596996+0000","last_became_active":"2023-11-15T01:39:02.215261+0000","last_became_peered":"2023-11-15T01:39:02.215261+0000","last_unstale":"2023-11-15T01:39:02.596996+0000","last_undegraded":"2023-11-15T01:39:02.596996+0000","last_fullsized":"2023-11-15T01:39:02.596996+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598969+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:39:02.598969+0000","last_peered":"2023-11-15T01:39:02.598969+0000","last_clean":"2023-11-15T01:39:02.598969+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:39:02.598969+0000","last_undegraded":"2023-11-15T01:39:02.598969+0000","last_fullsized":"2023-11-15T01:39:02.598969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609619+0000","last_change":"2023-11-15T01:39:02.607704+0000","last_active":"2023-11-15T01:39:02.609619+0000","last_peered":"2023-11-15T01:39:02.609619+0000","last_clean":"2023-11-15T01:39:02.609619+0000","last_became_active":"2023-11-15T01:39:02.607461+0000","last_became_peered":"2023-11-15T01:39:02.607461+0000","last_unstale":"2023-11-15T01:39:02.609619+0000","last_undegraded":"2023-11-15T01:39:02.609619+0000","last_fullsized":"2023-11-15T01:39:02.609619+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593520+0000","last_change":"2023-11-15T01:39:02.208524+0000","last_active":"2023-11-15T01:39:02.593520+0000","last_peered":"2023-11-15T01:39:02.593520+0000","last_clean":"2023-11-15T01:39:02.593520+0000","last_became_active":"2023-11-15T01:39:02.208211+0000","last_became_peered":"2023-11-15T01:39:02.208211+0000","last_unstale":"2023-11-15T01:39:02.593520+0000","last_undegraded":"2023-11-15T01:39:02.593520+0000","last_fullsized":"2023-11-15T01:39:02.593520+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598462+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:39:02.598462+0000","last_peered":"2023-11-15T01:39:02.598462+0000","last_clean":"2023-11-15T01:39:02.598462+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:39:02.598462+0000","last_undegraded":"2023-11-15T01:39:02.598462+0000","last_fullsized":"2023-11-15T01:39:02.598462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":106,"acting":106,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575055,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302664,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069176,"statfs":{"total":96636764160,"available":96326836224,"internally_reserved":0,"allocated":1507328,"data_stored":780837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.55100000000000005},"min":{"1min":0.29699999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67900000000000005,"5min":0.71199999999999997,"15min":0.82299999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.33800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.73699999999999999,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.53500000000000003}]},{"osd":1,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74399999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.626},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54200000000000004,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.34399999999999997,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55800000000000005}]},{"osd":2,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54100000000000004,"15min":0.56200000000000006},"min":{"1min":0.32700000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71099999999999997,"5min":0.79600000000000004,"15min":0.82599999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":0.58499999999999996},"min":{"1min":0.40699999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.66700000000000004}]},{"osd":3,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.58099999999999996},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.76900000000000002,"5min":0.80700000000000005,"15min":0.85999999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78000000000000003,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.70399999999999996}]},{"osd":4,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64400000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.32500000000000001,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.72299999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.316,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.83099999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.70399999999999996,"5min":0.73899999999999999,"15min":0.78500000000000003},"last":0.83999999999999997}]},{"osd":6,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78400000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.85099999999999998},"last":0.75800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1568768,"data_stored":809982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.55600000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.30499999999999999},"max":{"1min":0.70999999999999996,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.41799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77800000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.58899999999999997}]},{"osd":1,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.83099999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.39100000000000001,"5min":0.33100000000000002,"15min":0.32100000000000001},"max":{"1min":0.79600000000000004,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.36699999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72499999999999998,"5min":1.746,"15min":1.746},"last":0.53800000000000003}]},{"osd":3,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.307},"max":{"1min":0.69999999999999996,"5min":0.77100000000000002,"15min":0.91300000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.52900000000000003}]},{"osd":4,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.44900000000000001,"15min":0.45000000000000001},"min":{"1min":0.29099999999999998,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.52200000000000002},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.25800000000000001},"max":{"1min":0.71199999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51900000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48199999999999998,"15min":0.48099999999999998},"min":{"1min":0.32200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63900000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.5},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57599999999999996}]},{"osd":7,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.496,"15min":0.5},"min":{"1min":0.35099999999999998,"5min":0.32500000000000001,"15min":0.29899999999999999},"max":{"1min":0.64800000000000002,"5min":0.875,"15min":0.875},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80800000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575058,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302728,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069112,"statfs":{"total":96636764160,"available":96326770688,"internally_reserved":0,"allocated":1572864,"data_stored":810866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.23999999999999999},"max":{"1min":0.50800000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.40300000000000002},"min":{"1min":0.26600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58699999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.25900000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.373,"15min":0.38900000000000001},"min":{"1min":0.27200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.57599999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.245},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.438},"min":{"1min":0.28199999999999997,"5min":0.27800000000000002,"15min":0.26200000000000001},"max":{"1min":0.68999999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.52400000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55700000000000005,"15min":0.52300000000000002},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60299999999999998,"5min":9.641,"15min":9.641},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53200000000000003,"15min":0.501},"min":{"1min":0.34200000000000003,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":0.63400000000000001,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.373}]},{"osd":4,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.42199999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.63600000000000001},"min":{"1min":0.49299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.875,"5min":1.006,"15min":1.006},"last":0.69799999999999995}]},{"osd":5,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.82299999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.432},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81200000000000006,"5min":1.111,"15min":1.111},"last":0.55700000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.67400000000000004},"min":{"1min":0.498,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":0.78000000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65700000000000003,"15min":0.68500000000000005},"min":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92800000000000005,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.59199999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.51100000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91800000000000004,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66500000000000004,"15min":0.68999999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94199999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575056,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1568768,"data_stored":810050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.375,"15min":0.371},"min":{"1min":0.27800000000000002,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.54200000000000004,"5min":2.024,"15min":2.024},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.26100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.64700000000000002,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.26100000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52400000000000002,"5min":1.768,"15min":1.768},"last":0.245},{"interface":"front","average":{"1min":0.436,"5min":0.439,"15min":0.44},"min":{"1min":0.28899999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.63500000000000001,"5min":1.982,"15min":1.982},"last":0.28899999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44,"15min":0.437},"min":{"1min":0.28100000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61299999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.67900000000000005,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.30599999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.45600000000000002,"5min":0.42199999999999999,"15min":0.40400000000000003},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98899999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.47599999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.624,"15min":0.629},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.38500000000000001},"max":{"1min":0.97899999999999998,"5min":1.881,"15min":1.881},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":1.056},"last":0.56000000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.42999999999999999,"15min":0.36499999999999999},"max":{"1min":1.04,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.5},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67000000000000004,"15min":0.67100000000000004},"min":{"1min":0.51100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.917,"15min":1.917},"last":0.52800000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69899999999999995,"15min":0.68999999999999995},"min":{"1min":0.53400000000000003,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0089999999999999,"5min":1.843,"15min":1.843},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67200000000000004,"15min":0.68700000000000006},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.40899999999999997},"max":{"1min":1.073,"5min":1.073,"15min":1.0960000000000001},"last":0.60599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575057,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306816,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065024,"statfs":{"total":96636764160,"available":96322584576,"internally_reserved":0,"allocated":1564672,"data_stored":809420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35499999999999998,"15min":0.36699999999999999},"min":{"1min":0.26900000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.46000000000000002,"5min":0.54800000000000004,"15min":0.61899999999999999},"last":0.252},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.40600000000000003},"min":{"1min":0.255,"5min":0.246,"15min":0.246},"max":{"1min":0.63200000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.35099999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.26900000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61799999999999999,"5min":0.745,"15min":0.75},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42699999999999999,"15min":0.438},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.56399999999999995,"5min":0.69799999999999995,"15min":0.92000000000000004},"last":0.318}]},{"osd":3,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.44400000000000001,"15min":0.45200000000000001},"min":{"1min":0.34899999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67400000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.439,"15min":0.443},"min":{"1min":0.34100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.30099999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.61799999999999999},"min":{"1min":0.42799999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79800000000000004,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80900000000000005,"5min":0.91100000000000003,"15min":0.95399999999999996},"last":0.51900000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.623,"15min":0.64200000000000002},"min":{"1min":0.495,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84799999999999998,"5min":1.032,"15min":1.032},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.60699999999999998,"15min":0.63600000000000001},"min":{"1min":0.48499999999999999,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":0.75,"5min":0.96699999999999997,"15min":0.99399999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64100000000000001,"15min":0.65700000000000003},"min":{"1min":0.49399999999999999,"5min":0.438,"15min":0.374},"max":{"1min":0.85799999999999998,"5min":1.002,"15min":1.0389999999999999},"last":0.499},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64500000000000002,"15min":0.67000000000000004},"min":{"1min":0.53800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56899999999999995}]},{"osd":7,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64800000000000002,"15min":0.66900000000000004},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":1.079,"15min":1.079},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66000000000000003,"15min":0.68999999999999995},"min":{"1min":0.52600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.82299999999999995,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.505}]}]},{"osd":3,"up_from":13,"seq":55834575058,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306808,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065032,"statfs":{"total":96636764160,"available":96322592768,"internally_reserved":0,"allocated":1556480,"data_stored":809316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35599999999999998,"15min":0.374},"min":{"1min":0.23200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.54500000000000004,"5min":0.65900000000000003,"15min":0.79900000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.374,"15min":0.40000000000000002},"min":{"1min":0.24199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.503,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.438}]},{"osd":1,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.36499999999999999,"15min":0.39000000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.24399999999999999},"max":{"1min":0.52500000000000002,"5min":0.57799999999999996,"15min":0.72899999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.44500000000000001},"min":{"1min":0.28699999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70199999999999996,"5min":0.72499999999999998,"15min":0.747},"last":0.48499999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41499999999999998,"15min":0.44800000000000001},"min":{"1min":0.29499999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.47699999999999998},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":0.69199999999999995,"15min":0.81999999999999995},"last":0.56499999999999995}]},{"osd":4,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56899999999999995,"15min":0.61599999999999999},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.80500000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.626},"min":{"1min":0.435,"5min":0.40600000000000003,"15min":0.39000000000000001},"max":{"1min":0.84799999999999998,"5min":0.89200000000000002,"15min":1.0589999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58799999999999997,"15min":0.63300000000000001},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.76800000000000002,"5min":0.92000000000000004,"15min":1.0569999999999999},"last":0.749},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.63900000000000001},"min":{"1min":0.41499999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73799999999999999,"5min":0.879,"15min":0.95999999999999996},"last":0.92600000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60199999999999998,"15min":0.64600000000000002},"min":{"1min":0.40899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.0980000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.67000000000000004},"min":{"1min":0.42899999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.95799999999999996,"15min":1.169},"last":0.80600000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.66600000000000004},"min":{"1min":0.48399999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":1.0429999999999999,"15min":1.071},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86099999999999999,"5min":0.996,"15min":1.1459999999999999},"last":0.97199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575056,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302720,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069120,"statfs":{"total":96636764160,"available":96326778880,"internally_reserved":0,"allocated":1564672,"data_stored":810230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.34499999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.84499999999999997,"15min":0.88},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.374,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.754,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.47499999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.42099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72499999999999998,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.432},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.45500000000000002,"5min":0.34799999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.59899999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.58699999999999997},"min":{"1min":0.44,"5min":0.34100000000000003,"15min":0.30299999999999999},"max":{"1min":0.70299999999999996,"5min":2.887,"15min":2.887},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.33100000000000002},"max":{"1min":0.77700000000000002,"5min":0.92300000000000004,"15min":0.96299999999999997},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.41299999999999998,"5min":0.35799999999999998,"15min":0.33100000000000002},"max":{"1min":0.71599999999999997,"5min":2.464,"15min":2.464},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.623,"15min":0.60699999999999998},"min":{"1min":0.47599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79400000000000004,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.67700000000000005}]},{"osd":5,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48399999999999999,"15min":0.46800000000000003},"min":{"1min":0.34499999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70499999999999996,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.27400000000000002},"max":{"1min":0.65800000000000003,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.66300000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52200000000000002,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.29699999999999999,"15min":0.28899999999999998},"max":{"1min":0.67800000000000005,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.82899999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.77300000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58499999999999996,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71799999999999997,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.73399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575055,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302664,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069176,"statfs":{"total":96636764160,"available":96326836224,"internally_reserved":0,"allocated":1507328,"data_stored":780837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52600000000000002,"15min":0.54900000000000004},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.63700000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.629},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.55000000000000004},"min":{"1min":0.32300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.73199999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.55700000000000005}]},{"osd":1,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.33300000000000002,"15min":0.32600000000000001},"max":{"1min":0.78500000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55200000000000005,"15min":0.56899999999999995},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.35099999999999998},"max":{"1min":0.72099999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.52400000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69699999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.495},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55400000000000005,"15min":0.57199999999999995},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.84599999999999997},"last":0.60399999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70099999999999996,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":0.58699999999999997},"min":{"1min":0.38800000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74399999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68100000000000005}]},{"osd":4,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.432,"15min":0.44400000000000001},"min":{"1min":0.32400000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57899999999999996,"5min":0.66500000000000004,"15min":0.76500000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.50800000000000001,"15min":0.51900000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67900000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.752}]},{"osd":6,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.31,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.47699999999999998,"15min":0.48899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.80100000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63800000000000001,"5min":0.72999999999999998,"15min":0.755},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.77100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:39:07.002 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:39:07.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.153+0000 7f5f4958a700 1 Processor -- start 2023-11-15T01:39:07.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.153+0000 7f5f4958a700 1 -- start start 2023-11-15T01:39:07.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.153+0000 7f5f4958a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5f440ab1a0 0x7f5f44154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.153+0000 7f5f4958a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5f440aa060 0x7f5f440c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.153+0000 7f5f4958a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f440c06f0 con 0x7f5f44154150 2023-11-15T01:39:07.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.153+0000 7f5f4958a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440c09d0 con 0x7f5f440ab1a0 2023-11-15T01:39:07.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.153+0000 7f5f4958a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f44158820 con 0x7f5f440aa060 2023-11-15T01:39:07.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.154+0000 7f5f427fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5f440ab1a0 0x7f5f44154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.154+0000 7f5f427fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5f440ab1a0 0x7f5f44154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57722/0 (socket says 172.21.15.1:57722) 2023-11-15T01:39:07.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.154+0000 7f5f427fc700 1 -- 172.21.15.1:0/1855000324 learned_addr learned my addr 172.21.15.1:0/1855000324 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:07.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.154+0000 7f5f437fe700 1 --2- 172.21.15.1:0/1855000324 >> v2:172.21.15.141:3300/0 conn(0x7f5f440aa060 0x7f5f440c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.154+0000 7f5f427fc700 1 -- 172.21.15.1:0/1855000324 >> v2:172.21.15.141:3300/0 conn(0x7f5f440aa060 msgr2=0x7f5f440c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:07.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.154+0000 7f5f427fc700 1 --2- 172.21.15.1:0/1855000324 >> v2:172.21.15.141:3300/0 conn(0x7f5f440aa060 0x7f5f440c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.154+0000 7f5f427fc700 1 -- 172.21.15.1:0/1855000324 >> v1:172.21.15.141:6789/0 conn(0x7f5f44154150 legacy=0x7f5f44158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:07.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.154+0000 7f5f427fc700 1 -- 172.21.15.1:0/1855000324 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f44158b00 con 0x7f5f440ab1a0 2023-11-15T01:39:07.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.154+0000 7f5f437fe700 1 --2- 172.21.15.1:0/1855000324 >> v2:172.21.15.141:3300/0 conn(0x7f5f440aa060 0x7f5f440c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:39:07.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.154+0000 7f5f427fc700 1 --2- 172.21.15.1:0/1855000324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f440ab1a0 0x7f5f44154530 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f5f44157f80 tx=0x7f5f2c0090f0).ready entity=mon.0 client_cookie=8fe7118d56c8da8e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:07.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.154+0000 7f5f41ffb700 1 -- 172.21.15.1:0/1855000324 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c00b5a0 con 0x7f5f440ab1a0 2023-11-15T01:39:07.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.154+0000 7f5f41ffb700 1 -- 172.21.15.1:0/1855000324 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c00b700 con 0x7f5f440ab1a0 2023-11-15T01:39:07.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.154+0000 7f5f41ffb700 1 -- 172.21.15.1:0/1855000324 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c00baa0 con 0x7f5f440ab1a0 2023-11-15T01:39:07.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.155+0000 7f5f4958a700 1 -- 172.21.15.1:0/1855000324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f440ab1a0 msgr2=0x7f5f44154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:07.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.155+0000 7f5f4958a700 1 --2- 172.21.15.1:0/1855000324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f440ab1a0 0x7f5f44154530 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f5f44157f80 tx=0x7f5f2c0090f0).stop 2023-11-15T01:39:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.155+0000 7f5f4958a700 1 -- 172.21.15.1:0/1855000324 shutdown_connections 2023-11-15T01:39:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.155+0000 7f5f4958a700 1 --2- 172.21.15.1:0/1855000324 >> v2:172.21.15.141:3300/0 conn(0x7f5f440aa060 0x7f5f440c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.155+0000 7f5f4958a700 1 --2- 172.21.15.1:0/1855000324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f440ab1a0 0x7f5f44154530 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.155+0000 7f5f4958a700 1 -- 172.21.15.1:0/1855000324 >> 172.21.15.1:0/1855000324 conn(0x7f5f44064aa0 msgr2=0x7f5f44064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.155+0000 7f5f4958a700 1 -- 172.21.15.1:0/1855000324 shutdown_connections 2023-11-15T01:39:07.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.155+0000 7f5f4958a700 1 -- 172.21.15.1:0/1855000324 wait complete. 2023-11-15T01:39:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.156+0000 7f5f4958a700 1 Processor -- start 2023-11-15T01:39:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.156+0000 7f5f4958a700 1 -- start start 2023-11-15T01:39:07.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f4958a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f440aa060 0x7f5f44157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f4958a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f440ab1a0 0x7f5f44167d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f4958a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f44154150 0x7f5f44142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f4958a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440c3620 con 0x7f5f44154150 2023-11-15T01:39:07.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f4958a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f44168230 con 0x7f5f440aa060 2023-11-15T01:39:07.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f4958a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441684b0 con 0x7f5f440ab1a0 2023-11-15T01:39:07.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f437fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f44154150 0x7f5f44142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f437fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f44154150 0x7f5f44142a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57732/0 (socket says 172.21.15.1:57732) 2023-11-15T01:39:07.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f437fe700 1 -- 172.21.15.1:0/474798030 learned_addr learned my addr 172.21.15.1:0/474798030 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:07.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f427fc700 1 --2- 172.21.15.1:0/474798030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f440ab1a0 0x7f5f44167d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f42ffd700 1 --2- 172.21.15.1:0/474798030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f440aa060 0x7f5f44157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f437fe700 1 -- 172.21.15.1:0/474798030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f440ab1a0 msgr2=0x7f5f44167d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:07.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f437fe700 1 --2- 172.21.15.1:0/474798030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f440ab1a0 0x7f5f44167d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f437fe700 1 -- 172.21.15.1:0/474798030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f440aa060 msgr2=0x7f5f44157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:07.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f437fe700 1 --2- 172.21.15.1:0/474798030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f440aa060 0x7f5f44157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f437fe700 1 -- 172.21.15.1:0/474798030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c009370 con 0x7f5f44154150 2023-11-15T01:39:07.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f437fe700 1 --2- 172.21.15.1:0/474798030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f44154150 0x7f5f44142a40 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f5f3400a380 tx=0x7f5f34007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:07.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f3affd700 1 -- 172.21.15.1:0/474798030 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34016470 con 0x7f5f44154150 2023-11-15T01:39:07.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.157+0000 7f5f3affd700 1 -- 172.21.15.1:0/474798030 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f340165d0 con 0x7f5f44154150 2023-11-15T01:39:07.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.158+0000 7f5f4958a700 1 -- 172.21.15.1:0/474798030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f44168790 con 0x7f5f44154150 2023-11-15T01:39:07.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.158+0000 7f5f3affd700 1 -- 172.21.15.1:0/474798030 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34016950 con 0x7f5f44154150 2023-11-15T01:39:07.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.158+0000 7f5f4958a700 1 -- 172.21.15.1:0/474798030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f44142f30 con 0x7f5f44154150 2023-11-15T01:39:07.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.159+0000 7f5f4958a700 1 -- 172.21.15.1:0/474798030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f440c33f0 con 0x7f5f44154150 2023-11-15T01:39:07.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.159+0000 7f5f3affd700 1 -- 172.21.15.1:0/474798030 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5f34013070 con 0x7f5f44154150 2023-11-15T01:39:07.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.159+0000 7f5f3affd700 1 --2- 172.21.15.1:0/474798030 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f2405f270 0x7f5f24061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.159+0000 7f5f3affd700 1 -- 172.21.15.1:0/474798030 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f5f3407ae90 con 0x7f5f44154150 2023-11-15T01:39:07.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.159+0000 7f5f42ffd700 1 --2- 172.21.15.1:0/474798030 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f2405f270 0x7f5f24061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.160+0000 7f5f42ffd700 1 --2- 172.21.15.1:0/474798030 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f2405f270 0x7f5f24061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5f3c00b9b0 tx=0x7f5f3c008040).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:07.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.163+0000 7f5f3affd700 1 -- 172.21.15.1:0/474798030 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5f440c33f0 con 0x7f5f44154150 2023-11-15T01:39:07.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.334+0000 7f5f4958a700 1 -- 172.21.15.1:0/474798030 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f440c33f0 con 0x7f5f2405f270 2023-11-15T01:39:07.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.345+0000 7f5f3affd700 1 -- 172.21.15.1:0/474798030 <== mgr.6919 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361708 (secure 0 0 0) 0x7f5f440c33f0 con 0x7f5f2405f270 2023-11-15T01:39:07.351 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:39:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.348+0000 7f5f4958a700 1 -- 172.21.15.1:0/474798030 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f2405f270 msgr2=0x7f5f24061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.348+0000 7f5f4958a700 1 --2- 172.21.15.1:0/474798030 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f2405f270 0x7f5f24061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5f3c00b9b0 tx=0x7f5f3c008040).stop 2023-11-15T01:39:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.348+0000 7f5f4958a700 1 -- 172.21.15.1:0/474798030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f44154150 msgr2=0x7f5f44142a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.348+0000 7f5f4958a700 1 --2- 172.21.15.1:0/474798030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f44154150 0x7f5f44142a40 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f5f3400a380 tx=0x7f5f34007900).stop 2023-11-15T01:39:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.348+0000 7f5f4958a700 1 -- 172.21.15.1:0/474798030 shutdown_connections 2023-11-15T01:39:07.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.348+0000 7f5f4958a700 1 --2- 172.21.15.1:0/474798030 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f2405f270 0x7f5f24061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.348+0000 7f5f4958a700 1 --2- 172.21.15.1:0/474798030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f44154150 0x7f5f44142a40 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.348+0000 7f5f4958a700 1 --2- 172.21.15.1:0/474798030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f440aa060 0x7f5f44157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.348+0000 7f5f4958a700 1 --2- 172.21.15.1:0/474798030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f440ab1a0 0x7f5f44167d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.348+0000 7f5f4958a700 1 -- 172.21.15.1:0/474798030 >> 172.21.15.1:0/474798030 conn(0x7f5f44064aa0 msgr2=0x7f5f440ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:07.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.348+0000 7f5f4958a700 1 -- 172.21.15.1:0/474798030 shutdown_connections 2023-11-15T01:39:07.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.348+0000 7f5f4958a700 1 -- 172.21.15.1:0/474798030 wait complete. 2023-11-15T01:39:07.357 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:39:07.361 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T01:39:07.152065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2429952,"kb_used_data":12224,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752544768,"statfs":{"total":773094113280,"available":770605842432,"internally_reserved":0,"allocated":12517376,"data_stored":6479140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6722,"num_objects":-19,"num_object_clones":0,"num_object_copies":-38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-52,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.009730"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613925+0000","last_change":"2023-11-15T01:39:02.602396+0000","last_active":"2023-11-15T01:39:02.613925+0000","last_peered":"2023-11-15T01:39:02.613925+0000","last_clean":"2023-11-15T01:39:02.613925+0000","last_became_active":"2023-11-15T01:39:02.602116+0000","last_became_peered":"2023-11-15T01:39:02.602116+0000","last_unstale":"2023-11-15T01:39:02.613925+0000","last_undegraded":"2023-11-15T01:39:02.613925+0000","last_fullsized":"2023-11-15T01:39:02.613925+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616122+0000","last_change":"2023-11-15T01:39:02.218901+0000","last_active":"2023-11-15T01:39:02.616122+0000","last_peered":"2023-11-15T01:39:02.616122+0000","last_clean":"2023-11-15T01:39:02.616122+0000","last_became_active":"2023-11-15T01:39:02.218594+0000","last_became_peered":"2023-11-15T01:39:02.218594+0000","last_unstale":"2023-11-15T01:39:02.616122+0000","last_undegraded":"2023-11-15T01:39:02.616122+0000","last_fullsized":"2023-11-15T01:39:02.616122+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603572+0000","last_change":"2023-11-15T01:39:02.600412+0000","last_active":"2023-11-15T01:39:02.603572+0000","last_peered":"2023-11-15T01:39:02.603572+0000","last_clean":"2023-11-15T01:39:02.603572+0000","last_became_active":"2023-11-15T01:39:02.600184+0000","last_became_peered":"2023-11-15T01:39:02.600184+0000","last_unstale":"2023-11-15T01:39:02.603572+0000","last_undegraded":"2023-11-15T01:39:02.603572+0000","last_fullsized":"2023-11-15T01:39:02.603572+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588186+0000","last_change":"2023-11-15T01:39:02.212406+0000","last_active":"2023-11-15T01:39:02.588186+0000","last_peered":"2023-11-15T01:39:02.588186+0000","last_clean":"2023-11-15T01:39:02.588186+0000","last_became_active":"2023-11-15T01:39:02.212126+0000","last_became_peered":"2023-11-15T01:39:02.212126+0000","last_unstale":"2023-11-15T01:39:02.588186+0000","last_undegraded":"2023-11-15T01:39:02.588186+0000","last_fullsized":"2023-11-15T01:39:02.588186+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619501+0000","last_change":"2023-11-15T01:39:02.616063+0000","last_active":"2023-11-15T01:39:02.619501+0000","last_peered":"2023-11-15T01:39:02.619501+0000","last_clean":"2023-11-15T01:39:02.619501+0000","last_became_active":"2023-11-15T01:39:02.615758+0000","last_became_peered":"2023-11-15T01:39:02.615758+0000","last_unstale":"2023-11-15T01:39:02.619501+0000","last_undegraded":"2023-11-15T01:39:02.619501+0000","last_fullsized":"2023-11-15T01:39:02.619501+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.599254+0000","last_change":"2023-11-15T01:39:02.218897+0000","last_active":"2023-11-15T01:39:02.599254+0000","last_peered":"2023-11-15T01:39:02.599254+0000","last_clean":"2023-11-15T01:39:02.599254+0000","last_became_active":"2023-11-15T01:39:02.218572+0000","last_became_peered":"2023-11-15T01:39:02.218572+0000","last_unstale":"2023-11-15T01:39:02.599254+0000","last_undegraded":"2023-11-15T01:39:02.599254+0000","last_fullsized":"2023-11-15T01:39:02.599254+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613204+0000","last_change":"2023-11-15T01:39:02.604340+0000","last_active":"2023-11-15T01:39:02.613204+0000","last_peered":"2023-11-15T01:39:02.613204+0000","last_clean":"2023-11-15T01:39:02.613204+0000","last_became_active":"2023-11-15T01:39:02.604039+0000","last_became_peered":"2023-11-15T01:39:02.604039+0000","last_unstale":"2023-11-15T01:39:02.613204+0000","last_undegraded":"2023-11-15T01:39:02.613204+0000","last_fullsized":"2023-11-15T01:39:02.613204+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604468+0000","last_change":"2023-11-15T01:39:02.208432+0000","last_active":"2023-11-15T01:39:02.604468+0000","last_peered":"2023-11-15T01:39:02.604468+0000","last_clean":"2023-11-15T01:39:02.604468+0000","last_became_active":"2023-11-15T01:39:02.208125+0000","last_became_peered":"2023-11-15T01:39:02.208125+0000","last_unstale":"2023-11-15T01:39:02.604468+0000","last_undegraded":"2023-11-15T01:39:02.604468+0000","last_fullsized":"2023-11-15T01:39:02.604468+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619578+0000","last_change":"2023-11-15T01:39:02.615475+0000","last_active":"2023-11-15T01:39:02.619578+0000","last_peered":"2023-11-15T01:39:02.619578+0000","last_clean":"2023-11-15T01:39:02.619578+0000","last_became_active":"2023-11-15T01:39:02.615012+0000","last_became_peered":"2023-11-15T01:39:02.615012+0000","last_unstale":"2023-11-15T01:39:02.619578+0000","last_undegraded":"2023-11-15T01:39:02.619578+0000","last_fullsized":"2023-11-15T01:39:02.619578+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607240+0000","last_change":"2023-11-15T01:39:02.216489+0000","last_active":"2023-11-15T01:39:02.607240+0000","last_peered":"2023-11-15T01:39:02.607240+0000","last_clean":"2023-11-15T01:39:02.607240+0000","last_became_active":"2023-11-15T01:39:02.216208+0000","last_became_peered":"2023-11-15T01:39:02.216208+0000","last_unstale":"2023-11-15T01:39:02.607240+0000","last_undegraded":"2023-11-15T01:39:02.607240+0000","last_fullsized":"2023-11-15T01:39:02.607240+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619910+0000","last_change":"2023-11-15T01:39:02.614415+0000","last_active":"2023-11-15T01:39:02.619910+0000","last_peered":"2023-11-15T01:39:02.619910+0000","last_clean":"2023-11-15T01:39:02.619910+0000","last_became_active":"2023-11-15T01:39:02.614152+0000","last_became_peered":"2023-11-15T01:39:02.614152+0000","last_unstale":"2023-11-15T01:39:02.619910+0000","last_undegraded":"2023-11-15T01:39:02.619910+0000","last_fullsized":"2023-11-15T01:39:02.619910+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616182+0000","last_change":"2023-11-15T01:39:02.215445+0000","last_active":"2023-11-15T01:39:02.616182+0000","last_peered":"2023-11-15T01:39:02.616182+0000","last_clean":"2023-11-15T01:39:02.616182+0000","last_became_active":"2023-11-15T01:39:02.215164+0000","last_became_peered":"2023-11-15T01:39:02.215164+0000","last_unstale":"2023-11-15T01:39:02.616182+0000","last_undegraded":"2023-11-15T01:39:02.616182+0000","last_fullsized":"2023-11-15T01:39:02.616182+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617075+0000","last_change":"2023-11-15T01:39:02.612235+0000","last_active":"2023-11-15T01:39:02.617075+0000","last_peered":"2023-11-15T01:39:02.617075+0000","last_clean":"2023-11-15T01:39:02.617075+0000","last_became_active":"2023-11-15T01:39:02.611945+0000","last_became_peered":"2023-11-15T01:39:02.611945+0000","last_unstale":"2023-11-15T01:39:02.617075+0000","last_undegraded":"2023-11-15T01:39:02.617075+0000","last_fullsized":"2023-11-15T01:39:02.617075+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.600675+0000","last_change":"2023-11-15T01:39:02.212898+0000","last_active":"2023-11-15T01:39:02.600675+0000","last_peered":"2023-11-15T01:39:02.600675+0000","last_clean":"2023-11-15T01:39:02.600675+0000","last_became_active":"2023-11-15T01:39:02.211808+0000","last_became_peered":"2023-11-15T01:39:02.211808+0000","last_unstale":"2023-11-15T01:39:02.600675+0000","last_undegraded":"2023-11-15T01:39:02.600675+0000","last_fullsized":"2023-11-15T01:39:02.600675+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619471+0000","last_change":"2023-11-15T01:39:02.616010+0000","last_active":"2023-11-15T01:39:02.619471+0000","last_peered":"2023-11-15T01:39:02.619471+0000","last_clean":"2023-11-15T01:39:02.619471+0000","last_became_active":"2023-11-15T01:39:02.615676+0000","last_became_peered":"2023-11-15T01:39:02.615676+0000","last_unstale":"2023-11-15T01:39:02.619471+0000","last_undegraded":"2023-11-15T01:39:02.619471+0000","last_fullsized":"2023-11-15T01:39:02.619471+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587855+0000","last_change":"2023-11-15T01:39:02.215407+0000","last_active":"2023-11-15T01:39:02.587855+0000","last_peered":"2023-11-15T01:39:02.587855+0000","last_clean":"2023-11-15T01:39:02.587855+0000","last_became_active":"2023-11-15T01:39:02.214892+0000","last_became_peered":"2023-11-15T01:39:02.214892+0000","last_unstale":"2023-11-15T01:39:02.587855+0000","last_undegraded":"2023-11-15T01:39:02.587855+0000","last_fullsized":"2023-11-15T01:39:02.587855+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609760+0000","last_change":"2023-11-15T01:39:02.607451+0000","last_active":"2023-11-15T01:39:02.609760+0000","last_peered":"2023-11-15T01:39:02.609760+0000","last_clean":"2023-11-15T01:39:02.609760+0000","last_became_active":"2023-11-15T01:39:02.606494+0000","last_became_peered":"2023-11-15T01:39:02.606494+0000","last_unstale":"2023-11-15T01:39:02.609760+0000","last_undegraded":"2023-11-15T01:39:02.609760+0000","last_fullsized":"2023-11-15T01:39:02.609760+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.594989+0000","last_change":"2023-11-15T01:39:02.219867+0000","last_active":"2023-11-15T01:39:02.594989+0000","last_peered":"2023-11-15T01:39:02.594989+0000","last_clean":"2023-11-15T01:39:02.594989+0000","last_became_active":"2023-11-15T01:39:02.219549+0000","last_became_peered":"2023-11-15T01:39:02.219549+0000","last_unstale":"2023-11-15T01:39:02.594989+0000","last_undegraded":"2023-11-15T01:39:02.594989+0000","last_fullsized":"2023-11-15T01:39:02.594989+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615575+0000","last_change":"2023-11-15T01:39:02.614727+0000","last_active":"2023-11-15T01:39:02.615575+0000","last_peered":"2023-11-15T01:39:02.615575+0000","last_clean":"2023-11-15T01:39:02.615575+0000","last_became_active":"2023-11-15T01:39:02.614435+0000","last_became_peered":"2023-11-15T01:39:02.614435+0000","last_unstale":"2023-11-15T01:39:02.615575+0000","last_undegraded":"2023-11-15T01:39:02.615575+0000","last_fullsized":"2023-11-15T01:39:02.615575+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598319+0000","last_change":"2023-11-15T01:39:02.205172+0000","last_active":"2023-11-15T01:39:02.598319+0000","last_peered":"2023-11-15T01:39:02.598319+0000","last_clean":"2023-11-15T01:39:02.598319+0000","last_became_active":"2023-11-15T01:39:02.204880+0000","last_became_peered":"2023-11-15T01:39:02.204880+0000","last_unstale":"2023-11-15T01:39:02.598319+0000","last_undegraded":"2023-11-15T01:39:02.598319+0000","last_fullsized":"2023-11-15T01:39:02.598319+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.618919+0000","last_change":"2023-11-15T01:39:02.616562+0000","last_active":"2023-11-15T01:39:02.618919+0000","last_peered":"2023-11-15T01:39:02.618919+0000","last_clean":"2023-11-15T01:39:02.618919+0000","last_became_active":"2023-11-15T01:39:02.615953+0000","last_became_peered":"2023-11-15T01:39:02.615953+0000","last_unstale":"2023-11-15T01:39:02.618919+0000","last_undegraded":"2023-11-15T01:39:02.618919+0000","last_fullsized":"2023-11-15T01:39:02.618919+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.605080+0000","last_change":"2023-11-15T01:39:02.216519+0000","last_active":"2023-11-15T01:39:02.605080+0000","last_peered":"2023-11-15T01:39:02.605080+0000","last_clean":"2023-11-15T01:39:02.605080+0000","last_became_active":"2023-11-15T01:39:02.215863+0000","last_became_peered":"2023-11-15T01:39:02.215863+0000","last_unstale":"2023-11-15T01:39:02.605080+0000","last_undegraded":"2023-11-15T01:39:02.605080+0000","last_fullsized":"2023-11-15T01:39:02.605080+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617325+0000","last_change":"2023-11-15T01:39:02.616248+0000","last_active":"2023-11-15T01:39:02.617325+0000","last_peered":"2023-11-15T01:39:02.617325+0000","last_clean":"2023-11-15T01:39:02.617325+0000","last_became_active":"2023-11-15T01:39:02.615799+0000","last_became_peered":"2023-11-15T01:39:02.615799+0000","last_unstale":"2023-11-15T01:39:02.617325+0000","last_undegraded":"2023-11-15T01:39:02.617325+0000","last_fullsized":"2023-11-15T01:39:02.617325+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615681+0000","last_change":"2023-11-15T01:39:02.214198+0000","last_active":"2023-11-15T01:39:02.615681+0000","last_peered":"2023-11-15T01:39:02.615681+0000","last_clean":"2023-11-15T01:39:02.615681+0000","last_became_active":"2023-11-15T01:39:02.213807+0000","last_became_peered":"2023-11-15T01:39:02.213807+0000","last_unstale":"2023-11-15T01:39:02.615681+0000","last_undegraded":"2023-11-15T01:39:02.615681+0000","last_fullsized":"2023-11-15T01:39:02.615681+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608614+0000","last_change":"2023-11-15T01:39:02.603155+0000","last_active":"2023-11-15T01:39:02.608614+0000","last_peered":"2023-11-15T01:39:02.608614+0000","last_clean":"2023-11-15T01:39:02.608614+0000","last_became_active":"2023-11-15T01:39:02.602711+0000","last_became_peered":"2023-11-15T01:39:02.602711+0000","last_unstale":"2023-11-15T01:39:02.608614+0000","last_undegraded":"2023-11-15T01:39:02.608614+0000","last_fullsized":"2023-11-15T01:39:02.608614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604881+0000","last_change":"2023-11-15T01:39:02.216520+0000","last_active":"2023-11-15T01:39:02.604881+0000","last_peered":"2023-11-15T01:39:02.604881+0000","last_clean":"2023-11-15T01:39:02.604881+0000","last_became_active":"2023-11-15T01:39:02.216259+0000","last_became_peered":"2023-11-15T01:39:02.216259+0000","last_unstale":"2023-11-15T01:39:02.604881+0000","last_undegraded":"2023-11-15T01:39:02.604881+0000","last_fullsized":"2023-11-15T01:39:02.604881+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603577+0000","last_change":"2023-11-15T01:39:02.601591+0000","last_active":"2023-11-15T01:39:02.603577+0000","last_peered":"2023-11-15T01:39:02.603577+0000","last_clean":"2023-11-15T01:39:02.603577+0000","last_became_active":"2023-11-15T01:39:02.600935+0000","last_became_peered":"2023-11-15T01:39:02.600935+0000","last_unstale":"2023-11-15T01:39:02.603577+0000","last_undegraded":"2023-11-15T01:39:02.603577+0000","last_fullsized":"2023-11-15T01:39:02.603577+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593325+0000","last_change":"2023-11-15T01:39:02.208175+0000","last_active":"2023-11-15T01:39:02.593325+0000","last_peered":"2023-11-15T01:39:02.593325+0000","last_clean":"2023-11-15T01:39:02.593325+0000","last_became_active":"2023-11-15T01:39:02.206885+0000","last_became_peered":"2023-11-15T01:39:02.206885+0000","last_unstale":"2023-11-15T01:39:02.593325+0000","last_undegraded":"2023-11-15T01:39:02.593325+0000","last_fullsized":"2023-11-15T01:39:02.593325+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615601+0000","last_change":"2023-11-15T01:39:02.610080+0000","last_active":"2023-11-15T01:39:02.615601+0000","last_peered":"2023-11-15T01:39:02.615601+0000","last_clean":"2023-11-15T01:39:02.615601+0000","last_became_active":"2023-11-15T01:39:02.609739+0000","last_became_peered":"2023-11-15T01:39:02.609739+0000","last_unstale":"2023-11-15T01:39:02.615601+0000","last_undegraded":"2023-11-15T01:39:02.615601+0000","last_fullsized":"2023-11-15T01:39:02.615601+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.592262+0000","last_change":"2023-11-15T01:39:02.220136+0000","last_active":"2023-11-15T01:39:02.592262+0000","last_peered":"2023-11-15T01:39:02.592262+0000","last_clean":"2023-11-15T01:39:02.592262+0000","last_became_active":"2023-11-15T01:39:02.219849+0000","last_became_peered":"2023-11-15T01:39:02.219849+0000","last_unstale":"2023-11-15T01:39:02.592262+0000","last_undegraded":"2023-11-15T01:39:02.592262+0000","last_fullsized":"2023-11-15T01:39:02.592262+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617875+0000","last_change":"2023-11-15T01:39:02.617127+0000","last_active":"2023-11-15T01:39:02.617875+0000","last_peered":"2023-11-15T01:39:02.617875+0000","last_clean":"2023-11-15T01:39:02.617875+0000","last_became_active":"2023-11-15T01:39:02.616799+0000","last_became_peered":"2023-11-15T01:39:02.616799+0000","last_unstale":"2023-11-15T01:39:02.617875+0000","last_undegraded":"2023-11-15T01:39:02.617875+0000","last_fullsized":"2023-11-15T01:39:02.617875+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609923+0000","last_change":"2023-11-15T01:39:02.221702+0000","last_active":"2023-11-15T01:39:02.609923+0000","last_peered":"2023-11-15T01:39:02.609923+0000","last_clean":"2023-11-15T01:39:02.609923+0000","last_became_active":"2023-11-15T01:39:02.221488+0000","last_became_peered":"2023-11-15T01:39:02.221488+0000","last_unstale":"2023-11-15T01:39:02.609923+0000","last_undegraded":"2023-11-15T01:39:02.609923+0000","last_fullsized":"2023-11-15T01:39:02.609923+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619406+0000","last_change":"2023-11-15T01:39:02.615133+0000","last_active":"2023-11-15T01:39:02.619406+0000","last_peered":"2023-11-15T01:39:02.619406+0000","last_clean":"2023-11-15T01:39:02.619406+0000","last_became_active":"2023-11-15T01:39:02.614777+0000","last_became_peered":"2023-11-15T01:39:02.614777+0000","last_unstale":"2023-11-15T01:39:02.619406+0000","last_undegraded":"2023-11-15T01:39:02.619406+0000","last_fullsized":"2023-11-15T01:39:02.619406+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.589698+0000","last_change":"2023-11-15T01:39:02.218107+0000","last_active":"2023-11-15T01:39:02.589698+0000","last_peered":"2023-11-15T01:39:02.589698+0000","last_clean":"2023-11-15T01:39:02.589698+0000","last_became_active":"2023-11-15T01:39:02.217829+0000","last_became_peered":"2023-11-15T01:39:02.217829+0000","last_unstale":"2023-11-15T01:39:02.589698+0000","last_undegraded":"2023-11-15T01:39:02.589698+0000","last_fullsized":"2023-11-15T01:39:02.589698+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619811+0000","last_change":"2023-11-15T01:39:02.616657+0000","last_active":"2023-11-15T01:39:02.619811+0000","last_peered":"2023-11-15T01:39:02.619811+0000","last_clean":"2023-11-15T01:39:02.619811+0000","last_became_active":"2023-11-15T01:39:02.616181+0000","last_became_peered":"2023-11-15T01:39:02.616181+0000","last_unstale":"2023-11-15T01:39:02.619811+0000","last_undegraded":"2023-11-15T01:39:02.619811+0000","last_fullsized":"2023-11-15T01:39:02.619811+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.594904+0000","last_change":"2023-11-15T01:39:02.218103+0000","last_active":"2023-11-15T01:39:02.594904+0000","last_peered":"2023-11-15T01:39:02.594904+0000","last_clean":"2023-11-15T01:39:02.594904+0000","last_became_active":"2023-11-15T01:39:02.217828+0000","last_became_peered":"2023-11-15T01:39:02.217828+0000","last_unstale":"2023-11-15T01:39:02.594904+0000","last_undegraded":"2023-11-15T01:39:02.594904+0000","last_fullsized":"2023-11-15T01:39:02.594904+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613941+0000","last_change":"2023-11-15T01:39:02.610781+0000","last_active":"2023-11-15T01:39:02.613941+0000","last_peered":"2023-11-15T01:39:02.613941+0000","last_clean":"2023-11-15T01:39:02.613941+0000","last_became_active":"2023-11-15T01:39:02.610465+0000","last_became_peered":"2023-11-15T01:39:02.610465+0000","last_unstale":"2023-11-15T01:39:02.613941+0000","last_undegraded":"2023-11-15T01:39:02.613941+0000","last_fullsized":"2023-11-15T01:39:02.613941+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.605850+0000","last_change":"2023-11-15T01:39:02.207964+0000","last_active":"2023-11-15T01:39:02.605850+0000","last_peered":"2023-11-15T01:39:02.605850+0000","last_clean":"2023-11-15T01:39:02.605850+0000","last_became_active":"2023-11-15T01:39:02.206902+0000","last_became_peered":"2023-11-15T01:39:02.206902+0000","last_unstale":"2023-11-15T01:39:02.605850+0000","last_undegraded":"2023-11-15T01:39:02.605850+0000","last_fullsized":"2023-11-15T01:39:02.605850+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617013+0000","last_change":"2023-11-15T01:39:02.615878+0000","last_active":"2023-11-15T01:39:02.617013+0000","last_peered":"2023-11-15T01:39:02.617013+0000","last_clean":"2023-11-15T01:39:02.617013+0000","last_became_active":"2023-11-15T01:39:02.615584+0000","last_became_peered":"2023-11-15T01:39:02.615584+0000","last_unstale":"2023-11-15T01:39:02.617013+0000","last_undegraded":"2023-11-15T01:39:02.617013+0000","last_fullsized":"2023-11-15T01:39:02.617013+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.595065+0000","last_change":"2023-11-15T01:39:02.216952+0000","last_active":"2023-11-15T01:39:02.595065+0000","last_peered":"2023-11-15T01:39:02.595065+0000","last_clean":"2023-11-15T01:39:02.595065+0000","last_became_active":"2023-11-15T01:39:02.216649+0000","last_became_peered":"2023-11-15T01:39:02.216649+0000","last_unstale":"2023-11-15T01:39:02.595065+0000","last_undegraded":"2023-11-15T01:39:02.595065+0000","last_fullsized":"2023-11-15T01:39:02.595065+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608591+0000","last_change":"2023-11-15T01:39:02.602985+0000","last_active":"2023-11-15T01:39:02.608591+0000","last_peered":"2023-11-15T01:39:02.608591+0000","last_clean":"2023-11-15T01:39:02.608591+0000","last_became_active":"2023-11-15T01:39:02.602397+0000","last_became_peered":"2023-11-15T01:39:02.602397+0000","last_unstale":"2023-11-15T01:39:02.608591+0000","last_undegraded":"2023-11-15T01:39:02.608591+0000","last_fullsized":"2023-11-15T01:39:02.608591+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.602956+0000","last_change":"2023-11-15T01:39:02.206395+0000","last_active":"2023-11-15T01:39:02.602956+0000","last_peered":"2023-11-15T01:39:02.602956+0000","last_clean":"2023-11-15T01:39:02.602956+0000","last_became_active":"2023-11-15T01:39:02.206104+0000","last_became_peered":"2023-11-15T01:39:02.206104+0000","last_unstale":"2023-11-15T01:39:02.602956+0000","last_undegraded":"2023-11-15T01:39:02.602956+0000","last_fullsized":"2023-11-15T01:39:02.602956+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619975+0000","last_change":"2023-11-15T01:39:02.615104+0000","last_active":"2023-11-15T01:39:02.619975+0000","last_peered":"2023-11-15T01:39:02.619975+0000","last_clean":"2023-11-15T01:39:02.619975+0000","last_became_active":"2023-11-15T01:39:02.614137+0000","last_became_peered":"2023-11-15T01:39:02.614137+0000","last_unstale":"2023-11-15T01:39:02.619975+0000","last_undegraded":"2023-11-15T01:39:02.619975+0000","last_fullsized":"2023-11-15T01:39:02.619975+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587393+0000","last_change":"2023-11-15T01:39:02.211558+0000","last_active":"2023-11-15T01:39:02.587393+0000","last_peered":"2023-11-15T01:39:02.587393+0000","last_clean":"2023-11-15T01:39:02.587393+0000","last_became_active":"2023-11-15T01:39:02.211279+0000","last_became_peered":"2023-11-15T01:39:02.211279+0000","last_unstale":"2023-11-15T01:39:02.587393+0000","last_undegraded":"2023-11-15T01:39:02.587393+0000","last_fullsized":"2023-11-15T01:39:02.587393+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609748+0000","last_change":"2023-11-15T01:39:02.607093+0000","last_active":"2023-11-15T01:39:02.609748+0000","last_peered":"2023-11-15T01:39:02.609748+0000","last_clean":"2023-11-15T01:39:02.609748+0000","last_became_active":"2023-11-15T01:39:02.606809+0000","last_became_peered":"2023-11-15T01:39:02.606809+0000","last_unstale":"2023-11-15T01:39:02.609748+0000","last_undegraded":"2023-11-15T01:39:02.609748+0000","last_fullsized":"2023-11-15T01:39:02.609748+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587388+0000","last_change":"2023-11-15T01:39:02.211455+0000","last_active":"2023-11-15T01:39:02.587388+0000","last_peered":"2023-11-15T01:39:02.587388+0000","last_clean":"2023-11-15T01:39:02.587388+0000","last_became_active":"2023-11-15T01:39:02.211174+0000","last_became_peered":"2023-11-15T01:39:02.211174+0000","last_unstale":"2023-11-15T01:39:02.587388+0000","last_undegraded":"2023-11-15T01:39:02.587388+0000","last_fullsized":"2023-11-15T01:39:02.587388+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611523+0000","last_change":"2023-11-15T01:39:02.608672+0000","last_active":"2023-11-15T01:39:02.611523+0000","last_peered":"2023-11-15T01:39:02.611523+0000","last_clean":"2023-11-15T01:39:02.611523+0000","last_became_active":"2023-11-15T01:39:02.608345+0000","last_became_peered":"2023-11-15T01:39:02.608345+0000","last_unstale":"2023-11-15T01:39:02.611523+0000","last_undegraded":"2023-11-15T01:39:02.611523+0000","last_fullsized":"2023-11-15T01:39:02.611523+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.600509+0000","last_change":"2023-11-15T01:39:02.221210+0000","last_active":"2023-11-15T01:39:02.600509+0000","last_peered":"2023-11-15T01:39:02.600509+0000","last_clean":"2023-11-15T01:39:02.600509+0000","last_became_active":"2023-11-15T01:39:02.220954+0000","last_became_peered":"2023-11-15T01:39:02.220954+0000","last_unstale":"2023-11-15T01:39:02.600509+0000","last_undegraded":"2023-11-15T01:39:02.600509+0000","last_fullsized":"2023-11-15T01:39:02.600509+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616556+0000","last_change":"2023-11-15T01:39:02.613660+0000","last_active":"2023-11-15T01:39:02.616556+0000","last_peered":"2023-11-15T01:39:02.616556+0000","last_clean":"2023-11-15T01:39:02.616556+0000","last_became_active":"2023-11-15T01:39:02.613366+0000","last_became_peered":"2023-11-15T01:39:02.613366+0000","last_unstale":"2023-11-15T01:39:02.616556+0000","last_undegraded":"2023-11-15T01:39:02.616556+0000","last_fullsized":"2023-11-15T01:39:02.616556+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598361+0000","last_change":"2023-11-15T01:39:02.215823+0000","last_active":"2023-11-15T01:39:02.598361+0000","last_peered":"2023-11-15T01:39:02.598361+0000","last_clean":"2023-11-15T01:39:02.598361+0000","last_became_active":"2023-11-15T01:39:02.215525+0000","last_became_peered":"2023-11-15T01:39:02.215525+0000","last_unstale":"2023-11-15T01:39:02.598361+0000","last_undegraded":"2023-11-15T01:39:02.598361+0000","last_fullsized":"2023-11-15T01:39:02.598361+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.614005+0000","last_change":"2023-11-15T01:39:02.609396+0000","last_active":"2023-11-15T01:39:02.614005+0000","last_peered":"2023-11-15T01:39:02.614005+0000","last_clean":"2023-11-15T01:39:02.614005+0000","last_became_active":"2023-11-15T01:39:02.609124+0000","last_became_peered":"2023-11-15T01:39:02.609124+0000","last_unstale":"2023-11-15T01:39:02.614005+0000","last_undegraded":"2023-11-15T01:39:02.614005+0000","last_fullsized":"2023-11-15T01:39:02.614005+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588286+0000","last_change":"2023-11-15T01:39:02.216539+0000","last_active":"2023-11-15T01:39:02.588286+0000","last_peered":"2023-11-15T01:39:02.588286+0000","last_clean":"2023-11-15T01:39:02.588286+0000","last_became_active":"2023-11-15T01:39:02.216251+0000","last_became_peered":"2023-11-15T01:39:02.216251+0000","last_unstale":"2023-11-15T01:39:02.588286+0000","last_undegraded":"2023-11-15T01:39:02.588286+0000","last_fullsized":"2023-11-15T01:39:02.588286+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.614176+0000","last_change":"2023-11-15T01:39:02.610179+0000","last_active":"2023-11-15T01:39:02.614176+0000","last_peered":"2023-11-15T01:39:02.614176+0000","last_clean":"2023-11-15T01:39:02.614176+0000","last_became_active":"2023-11-15T01:39:02.609897+0000","last_became_peered":"2023-11-15T01:39:02.609897+0000","last_unstale":"2023-11-15T01:39:02.614176+0000","last_undegraded":"2023-11-15T01:39:02.614176+0000","last_fullsized":"2023-11-15T01:39:02.614176+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604810+0000","last_change":"2023-11-15T01:39:02.216694+0000","last_active":"2023-11-15T01:39:02.604810+0000","last_peered":"2023-11-15T01:39:02.604810+0000","last_clean":"2023-11-15T01:39:02.604810+0000","last_became_active":"2023-11-15T01:39:02.216225+0000","last_became_peered":"2023-11-15T01:39:02.216225+0000","last_unstale":"2023-11-15T01:39:02.604810+0000","last_undegraded":"2023-11-15T01:39:02.604810+0000","last_fullsized":"2023-11-15T01:39:02.604810+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609871+0000","last_change":"2023-11-15T01:39:02.608291+0000","last_active":"2023-11-15T01:39:02.609871+0000","last_peered":"2023-11-15T01:39:02.609871+0000","last_clean":"2023-11-15T01:39:02.609871+0000","last_became_active":"2023-11-15T01:39:02.608031+0000","last_became_peered":"2023-11-15T01:39:02.608031+0000","last_unstale":"2023-11-15T01:39:02.609871+0000","last_undegraded":"2023-11-15T01:39:02.609871+0000","last_fullsized":"2023-11-15T01:39:02.609871+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597800+0000","last_change":"2023-11-15T01:39:02.216727+0000","last_active":"2023-11-15T01:39:02.597800+0000","last_peered":"2023-11-15T01:39:02.597800+0000","last_clean":"2023-11-15T01:39:02.597800+0000","last_became_active":"2023-11-15T01:39:02.216418+0000","last_became_peered":"2023-11-15T01:39:02.216418+0000","last_unstale":"2023-11-15T01:39:02.597800+0000","last_undegraded":"2023-11-15T01:39:02.597800+0000","last_fullsized":"2023-11-15T01:39:02.597800+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609371+0000","last_change":"2023-11-15T01:39:02.607331+0000","last_active":"2023-11-15T01:39:02.609371+0000","last_peered":"2023-11-15T01:39:02.609371+0000","last_clean":"2023-11-15T01:39:02.609371+0000","last_became_active":"2023-11-15T01:39:02.605984+0000","last_became_peered":"2023-11-15T01:39:02.605984+0000","last_unstale":"2023-11-15T01:39:02.609371+0000","last_undegraded":"2023-11-15T01:39:02.609371+0000","last_fullsized":"2023-11-15T01:39:02.609371+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587486+0000","last_change":"2023-11-15T01:39:02.221244+0000","last_active":"2023-11-15T01:39:02.587486+0000","last_peered":"2023-11-15T01:39:02.587486+0000","last_clean":"2023-11-15T01:39:02.587486+0000","last_became_active":"2023-11-15T01:39:02.220925+0000","last_became_peered":"2023-11-15T01:39:02.220925+0000","last_unstale":"2023-11-15T01:39:02.587486+0000","last_undegraded":"2023-11-15T01:39:02.587486+0000","last_fullsized":"2023-11-15T01:39:02.587486+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617865+0000","last_change":"2023-11-15T01:39:02.617229+0000","last_active":"2023-11-15T01:39:02.617865+0000","last_peered":"2023-11-15T01:39:02.617865+0000","last_clean":"2023-11-15T01:39:02.617865+0000","last_became_active":"2023-11-15T01:39:02.616939+0000","last_became_peered":"2023-11-15T01:39:02.616939+0000","last_unstale":"2023-11-15T01:39:02.617865+0000","last_undegraded":"2023-11-15T01:39:02.617865+0000","last_fullsized":"2023-11-15T01:39:02.617865+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593426+0000","last_change":"2023-11-15T01:39:02.221666+0000","last_active":"2023-11-15T01:39:02.593426+0000","last_peered":"2023-11-15T01:39:02.593426+0000","last_clean":"2023-11-15T01:39:02.593426+0000","last_became_active":"2023-11-15T01:39:02.219800+0000","last_became_peered":"2023-11-15T01:39:02.219800+0000","last_unstale":"2023-11-15T01:39:02.593426+0000","last_undegraded":"2023-11-15T01:39:02.593426+0000","last_fullsized":"2023-11-15T01:39:02.593426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604011+0000","last_change":"2023-11-15T01:39:02.602358+0000","last_active":"2023-11-15T01:39:02.604011+0000","last_peered":"2023-11-15T01:39:02.604011+0000","last_clean":"2023-11-15T01:39:02.604011+0000","last_became_active":"2023-11-15T01:39:02.601545+0000","last_became_peered":"2023-11-15T01:39:02.601545+0000","last_unstale":"2023-11-15T01:39:02.604011+0000","last_undegraded":"2023-11-15T01:39:02.604011+0000","last_fullsized":"2023-11-15T01:39:02.604011+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.592380+0000","last_change":"2023-11-15T01:39:02.216213+0000","last_active":"2023-11-15T01:39:02.592380+0000","last_peered":"2023-11-15T01:39:02.592380+0000","last_clean":"2023-11-15T01:39:02.592380+0000","last_became_active":"2023-11-15T01:39:02.215899+0000","last_became_peered":"2023-11-15T01:39:02.215899+0000","last_unstale":"2023-11-15T01:39:02.592380+0000","last_undegraded":"2023-11-15T01:39:02.592380+0000","last_fullsized":"2023-11-15T01:39:02.592380+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608705+0000","last_change":"2023-11-15T01:39:02.604261+0000","last_active":"2023-11-15T01:39:02.608705+0000","last_peered":"2023-11-15T01:39:02.608705+0000","last_clean":"2023-11-15T01:39:02.608705+0000","last_became_active":"2023-11-15T01:39:02.603967+0000","last_became_peered":"2023-11-15T01:39:02.603967+0000","last_unstale":"2023-11-15T01:39:02.608705+0000","last_undegraded":"2023-11-15T01:39:02.608705+0000","last_fullsized":"2023-11-15T01:39:02.608705+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.600917+0000","last_change":"2023-11-15T01:39:02.212132+0000","last_active":"2023-11-15T01:39:02.600917+0000","last_peered":"2023-11-15T01:39:02.600917+0000","last_clean":"2023-11-15T01:39:02.600917+0000","last_became_active":"2023-11-15T01:39:02.210392+0000","last_became_peered":"2023-11-15T01:39:02.210392+0000","last_unstale":"2023-11-15T01:39:02.600917+0000","last_undegraded":"2023-11-15T01:39:02.600917+0000","last_fullsized":"2023-11-15T01:39:02.600917+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603584+0000","last_change":"2023-11-15T01:39:02.600884+0000","last_active":"2023-11-15T01:39:02.603584+0000","last_peered":"2023-11-15T01:39:02.603584+0000","last_clean":"2023-11-15T01:39:02.603584+0000","last_became_active":"2023-11-15T01:39:02.600570+0000","last_became_peered":"2023-11-15T01:39:02.600570+0000","last_unstale":"2023-11-15T01:39:02.603584+0000","last_undegraded":"2023-11-15T01:39:02.603584+0000","last_fullsized":"2023-11-15T01:39:02.603584+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604360+0000","last_change":"2023-11-15T01:39:02.216713+0000","last_active":"2023-11-15T01:39:02.604360+0000","last_peered":"2023-11-15T01:39:02.604360+0000","last_clean":"2023-11-15T01:39:02.604360+0000","last_became_active":"2023-11-15T01:39:02.216444+0000","last_became_peered":"2023-11-15T01:39:02.216444+0000","last_unstale":"2023-11-15T01:39:02.604360+0000","last_undegraded":"2023-11-15T01:39:02.604360+0000","last_fullsized":"2023-11-15T01:39:02.604360+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615377+0000","last_change":"2023-11-15T01:39:02.613239+0000","last_active":"2023-11-15T01:39:02.615377+0000","last_peered":"2023-11-15T01:39:02.615377+0000","last_clean":"2023-11-15T01:39:02.615377+0000","last_became_active":"2023-11-15T01:39:02.612946+0000","last_became_peered":"2023-11-15T01:39:02.612946+0000","last_unstale":"2023-11-15T01:39:02.615377+0000","last_undegraded":"2023-11-15T01:39:02.615377+0000","last_fullsized":"2023-11-15T01:39:02.615377+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.596143+0000","last_change":"2023-11-15T01:39:02.209925+0000","last_active":"2023-11-15T01:39:02.596143+0000","last_peered":"2023-11-15T01:39:02.596143+0000","last_clean":"2023-11-15T01:39:02.596143+0000","last_became_active":"2023-11-15T01:39:02.209663+0000","last_became_peered":"2023-11-15T01:39:02.209663+0000","last_unstale":"2023-11-15T01:39:02.596143+0000","last_undegraded":"2023-11-15T01:39:02.596143+0000","last_fullsized":"2023-11-15T01:39:02.596143+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609247+0000","last_change":"2023-11-15T01:39:02.608245+0000","last_active":"2023-11-15T01:39:02.609247+0000","last_peered":"2023-11-15T01:39:02.609247+0000","last_clean":"2023-11-15T01:39:02.609247+0000","last_became_active":"2023-11-15T01:39:02.607952+0000","last_became_peered":"2023-11-15T01:39:02.607952+0000","last_unstale":"2023-11-15T01:39:02.609247+0000","last_undegraded":"2023-11-15T01:39:02.609247+0000","last_fullsized":"2023-11-15T01:39:02.609247+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607666+0000","last_change":"2023-11-15T01:39:02.212445+0000","last_active":"2023-11-15T01:39:02.607666+0000","last_peered":"2023-11-15T01:39:02.607666+0000","last_clean":"2023-11-15T01:39:02.607666+0000","last_became_active":"2023-11-15T01:39:02.212161+0000","last_became_peered":"2023-11-15T01:39:02.212161+0000","last_unstale":"2023-11-15T01:39:02.607666+0000","last_undegraded":"2023-11-15T01:39:02.607666+0000","last_fullsized":"2023-11-15T01:39:02.607666+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.620038+0000","last_change":"2023-11-15T01:39:02.615695+0000","last_active":"2023-11-15T01:39:02.620038+0000","last_peered":"2023-11-15T01:39:02.620038+0000","last_clean":"2023-11-15T01:39:02.620038+0000","last_became_active":"2023-11-15T01:39:02.615400+0000","last_became_peered":"2023-11-15T01:39:02.615400+0000","last_unstale":"2023-11-15T01:39:02.620038+0000","last_undegraded":"2023-11-15T01:39:02.620038+0000","last_fullsized":"2023-11-15T01:39:02.620038+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.601003+0000","last_change":"2023-11-15T01:39:02.212296+0000","last_active":"2023-11-15T01:39:02.601003+0000","last_peered":"2023-11-15T01:39:02.601003+0000","last_clean":"2023-11-15T01:39:02.601003+0000","last_became_active":"2023-11-15T01:39:02.211995+0000","last_became_peered":"2023-11-15T01:39:02.211995+0000","last_unstale":"2023-11-15T01:39:02.601003+0000","last_undegraded":"2023-11-15T01:39:02.601003+0000","last_fullsized":"2023-11-15T01:39:02.601003+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609392+0000","last_change":"2023-11-15T01:39:02.607853+0000","last_active":"2023-11-15T01:39:02.609392+0000","last_peered":"2023-11-15T01:39:02.609392+0000","last_clean":"2023-11-15T01:39:02.609392+0000","last_became_active":"2023-11-15T01:39:02.607594+0000","last_became_peered":"2023-11-15T01:39:02.607594+0000","last_unstale":"2023-11-15T01:39:02.609392+0000","last_undegraded":"2023-11-15T01:39:02.609392+0000","last_fullsized":"2023-11-15T01:39:02.609392+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604067+0000","last_change":"2023-11-15T01:39:02.213094+0000","last_active":"2023-11-15T01:39:02.604067+0000","last_peered":"2023-11-15T01:39:02.604067+0000","last_clean":"2023-11-15T01:39:02.604067+0000","last_became_active":"2023-11-15T01:39:02.212785+0000","last_became_peered":"2023-11-15T01:39:02.212785+0000","last_unstale":"2023-11-15T01:39:02.604067+0000","last_undegraded":"2023-11-15T01:39:02.604067+0000","last_fullsized":"2023-11-15T01:39:02.604067+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603556+0000","last_change":"2023-11-15T01:39:02.601396+0000","last_active":"2023-11-15T01:39:02.603556+0000","last_peered":"2023-11-15T01:39:02.603556+0000","last_clean":"2023-11-15T01:39:02.603556+0000","last_became_active":"2023-11-15T01:39:02.601172+0000","last_became_peered":"2023-11-15T01:39:02.601172+0000","last_unstale":"2023-11-15T01:39:02.603556+0000","last_undegraded":"2023-11-15T01:39:02.603556+0000","last_fullsized":"2023-11-15T01:39:02.603556+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606548+0000","last_change":"2023-11-15T01:39:02.214549+0000","last_active":"2023-11-15T01:39:02.606548+0000","last_peered":"2023-11-15T01:39:02.606548+0000","last_clean":"2023-11-15T01:39:02.606548+0000","last_became_active":"2023-11-15T01:39:02.214264+0000","last_became_peered":"2023-11-15T01:39:02.214264+0000","last_unstale":"2023-11-15T01:39:02.606548+0000","last_undegraded":"2023-11-15T01:39:02.606548+0000","last_fullsized":"2023-11-15T01:39:02.606548+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619529+0000","last_change":"2023-11-15T01:39:02.614609+0000","last_active":"2023-11-15T01:39:02.619529+0000","last_peered":"2023-11-15T01:39:02.619529+0000","last_clean":"2023-11-15T01:39:02.619529+0000","last_became_active":"2023-11-15T01:39:02.614307+0000","last_became_peered":"2023-11-15T01:39:02.614307+0000","last_unstale":"2023-11-15T01:39:02.619529+0000","last_undegraded":"2023-11-15T01:39:02.619529+0000","last_fullsized":"2023-11-15T01:39:02.619529+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593584+0000","last_change":"2023-11-15T01:39:02.213334+0000","last_active":"2023-11-15T01:39:02.593584+0000","last_peered":"2023-11-15T01:39:02.593584+0000","last_clean":"2023-11-15T01:39:02.593584+0000","last_became_active":"2023-11-15T01:39:02.212950+0000","last_became_peered":"2023-11-15T01:39:02.212950+0000","last_unstale":"2023-11-15T01:39:02.593584+0000","last_undegraded":"2023-11-15T01:39:02.593584+0000","last_fullsized":"2023-11-15T01:39:02.593584+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607206+0000","last_change":"2023-11-15T01:39:02.605916+0000","last_active":"2023-11-15T01:39:02.607206+0000","last_peered":"2023-11-15T01:39:02.607206+0000","last_clean":"2023-11-15T01:39:02.607206+0000","last_became_active":"2023-11-15T01:39:02.605221+0000","last_became_peered":"2023-11-15T01:39:02.605221+0000","last_unstale":"2023-11-15T01:39:02.607206+0000","last_undegraded":"2023-11-15T01:39:02.607206+0000","last_fullsized":"2023-11-15T01:39:02.607206+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.592684+0000","last_change":"2023-11-15T01:39:02.214571+0000","last_active":"2023-11-15T01:39:02.592684+0000","last_peered":"2023-11-15T01:39:02.592684+0000","last_clean":"2023-11-15T01:39:02.592684+0000","last_became_active":"2023-11-15T01:39:02.214277+0000","last_became_peered":"2023-11-15T01:39:02.214277+0000","last_unstale":"2023-11-15T01:39:02.592684+0000","last_undegraded":"2023-11-15T01:39:02.592684+0000","last_fullsized":"2023-11-15T01:39:02.592684+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606587+0000","last_change":"2023-11-15T01:39:02.602418+0000","last_active":"2023-11-15T01:39:02.606587+0000","last_peered":"2023-11-15T01:39:02.606587+0000","last_clean":"2023-11-15T01:39:02.606587+0000","last_became_active":"2023-11-15T01:39:02.602063+0000","last_became_peered":"2023-11-15T01:39:02.602063+0000","last_unstale":"2023-11-15T01:39:02.606587+0000","last_undegraded":"2023-11-15T01:39:02.606587+0000","last_fullsized":"2023-11-15T01:39:02.606587+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.595019+0000","last_change":"2023-11-15T01:39:02.212659+0000","last_active":"2023-11-15T01:39:02.595019+0000","last_peered":"2023-11-15T01:39:02.595019+0000","last_clean":"2023-11-15T01:39:02.595019+0000","last_became_active":"2023-11-15T01:39:02.212415+0000","last_became_peered":"2023-11-15T01:39:02.212415+0000","last_unstale":"2023-11-15T01:39:02.595019+0000","last_undegraded":"2023-11-15T01:39:02.595019+0000","last_fullsized":"2023-11-15T01:39:02.595019+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.618320+0000","last_change":"2023-11-15T01:39:02.614637+0000","last_active":"2023-11-15T01:39:02.618320+0000","last_peered":"2023-11-15T01:39:02.618320+0000","last_clean":"2023-11-15T01:39:02.618320+0000","last_became_active":"2023-11-15T01:39:02.614343+0000","last_became_peered":"2023-11-15T01:39:02.614343+0000","last_unstale":"2023-11-15T01:39:02.618320+0000","last_undegraded":"2023-11-15T01:39:02.618320+0000","last_fullsized":"2023-11-15T01:39:02.618320+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588382+0000","last_change":"2023-11-15T01:39:02.216949+0000","last_active":"2023-11-15T01:39:02.588382+0000","last_peered":"2023-11-15T01:39:02.588382+0000","last_clean":"2023-11-15T01:39:02.588382+0000","last_became_active":"2023-11-15T01:39:02.216678+0000","last_became_peered":"2023-11-15T01:39:02.216678+0000","last_unstale":"2023-11-15T01:39:02.588382+0000","last_undegraded":"2023-11-15T01:39:02.588382+0000","last_fullsized":"2023-11-15T01:39:02.588382+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615337+0000","last_change":"2023-11-15T01:39:02.613451+0000","last_active":"2023-11-15T01:39:02.615337+0000","last_peered":"2023-11-15T01:39:02.615337+0000","last_clean":"2023-11-15T01:39:02.615337+0000","last_became_active":"2023-11-15T01:39:02.613039+0000","last_became_peered":"2023-11-15T01:39:02.613039+0000","last_unstale":"2023-11-15T01:39:02.615337+0000","last_undegraded":"2023-11-15T01:39:02.615337+0000","last_fullsized":"2023-11-15T01:39:02.615337+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611662+0000","last_change":"2023-11-15T01:39:02.221508+0000","last_active":"2023-11-15T01:39:02.611662+0000","last_peered":"2023-11-15T01:39:02.611662+0000","last_clean":"2023-11-15T01:39:02.611662+0000","last_became_active":"2023-11-15T01:39:02.221203+0000","last_became_peered":"2023-11-15T01:39:02.221203+0000","last_unstale":"2023-11-15T01:39:02.611662+0000","last_undegraded":"2023-11-15T01:39:02.611662+0000","last_fullsized":"2023-11-15T01:39:02.611662+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617294+0000","last_change":"2023-11-15T01:39:02.614533+0000","last_active":"2023-11-15T01:39:02.617294+0000","last_peered":"2023-11-15T01:39:02.617294+0000","last_clean":"2023-11-15T01:39:02.617294+0000","last_became_active":"2023-11-15T01:39:02.614181+0000","last_became_peered":"2023-11-15T01:39:02.614181+0000","last_unstale":"2023-11-15T01:39:02.617294+0000","last_undegraded":"2023-11-15T01:39:02.617294+0000","last_fullsized":"2023-11-15T01:39:02.617294+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611758+0000","last_change":"2023-11-15T01:39:02.215496+0000","last_active":"2023-11-15T01:39:02.611758+0000","last_peered":"2023-11-15T01:39:02.611758+0000","last_clean":"2023-11-15T01:39:02.611758+0000","last_became_active":"2023-11-15T01:39:02.215218+0000","last_became_peered":"2023-11-15T01:39:02.215218+0000","last_unstale":"2023-11-15T01:39:02.611758+0000","last_undegraded":"2023-11-15T01:39:02.611758+0000","last_fullsized":"2023-11-15T01:39:02.611758+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619900+0000","last_change":"2023-11-15T01:39:02.614359+0000","last_active":"2023-11-15T01:39:02.619900+0000","last_peered":"2023-11-15T01:39:02.619900+0000","last_clean":"2023-11-15T01:39:02.619900+0000","last_became_active":"2023-11-15T01:39:02.614072+0000","last_became_peered":"2023-11-15T01:39:02.614072+0000","last_unstale":"2023-11-15T01:39:02.619900+0000","last_undegraded":"2023-11-15T01:39:02.619900+0000","last_fullsized":"2023-11-15T01:39:02.619900+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613955+0000","last_change":"2023-11-15T01:39:02.218556+0000","last_active":"2023-11-15T01:39:02.613955+0000","last_peered":"2023-11-15T01:39:02.613955+0000","last_clean":"2023-11-15T01:39:02.613955+0000","last_became_active":"2023-11-15T01:39:02.218223+0000","last_became_peered":"2023-11-15T01:39:02.218223+0000","last_unstale":"2023-11-15T01:39:02.613955+0000","last_undegraded":"2023-11-15T01:39:02.613955+0000","last_fullsized":"2023-11-15T01:39:02.613955+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611507+0000","last_change":"2023-11-15T01:39:02.607095+0000","last_active":"2023-11-15T01:39:02.611507+0000","last_peered":"2023-11-15T01:39:02.611507+0000","last_clean":"2023-11-15T01:39:02.611507+0000","last_became_active":"2023-11-15T01:39:02.606862+0000","last_became_peered":"2023-11-15T01:39:02.606862+0000","last_unstale":"2023-11-15T01:39:02.611507+0000","last_undegraded":"2023-11-15T01:39:02.611507+0000","last_fullsized":"2023-11-15T01:39:02.611507+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.591994+0000","last_change":"2023-11-15T01:39:02.208100+0000","last_active":"2023-11-15T01:39:02.591994+0000","last_peered":"2023-11-15T01:39:02.591994+0000","last_clean":"2023-11-15T01:39:02.591994+0000","last_became_active":"2023-11-15T01:39:02.207787+0000","last_became_peered":"2023-11-15T01:39:02.207787+0000","last_unstale":"2023-11-15T01:39:02.591994+0000","last_undegraded":"2023-11-15T01:39:02.591994+0000","last_fullsized":"2023-11-15T01:39:02.591994+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.612658+0000","last_change":"2023-11-15T01:39:02.603012+0000","last_active":"2023-11-15T01:39:02.612658+0000","last_peered":"2023-11-15T01:39:02.612658+0000","last_clean":"2023-11-15T01:39:02.612658+0000","last_became_active":"2023-11-15T01:39:02.602782+0000","last_became_peered":"2023-11-15T01:39:02.602782+0000","last_unstale":"2023-11-15T01:39:02.612658+0000","last_undegraded":"2023-11-15T01:39:02.612658+0000","last_fullsized":"2023-11-15T01:39:02.612658+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593111+0000","last_change":"2023-11-15T01:39:02.211688+0000","last_active":"2023-11-15T01:39:02.593111+0000","last_peered":"2023-11-15T01:39:02.593111+0000","last_clean":"2023-11-15T01:39:02.593111+0000","last_became_active":"2023-11-15T01:39:02.211393+0000","last_became_peered":"2023-11-15T01:39:02.211393+0000","last_unstale":"2023-11-15T01:39:02.593111+0000","last_undegraded":"2023-11-15T01:39:02.593111+0000","last_fullsized":"2023-11-15T01:39:02.593111+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616897+0000","last_change":"2023-11-15T01:39:02.614804+0000","last_active":"2023-11-15T01:39:02.616897+0000","last_peered":"2023-11-15T01:39:02.616897+0000","last_clean":"2023-11-15T01:39:02.616897+0000","last_became_active":"2023-11-15T01:39:02.614516+0000","last_became_peered":"2023-11-15T01:39:02.614516+0000","last_unstale":"2023-11-15T01:39:02.616897+0000","last_undegraded":"2023-11-15T01:39:02.616897+0000","last_fullsized":"2023-11-15T01:39:02.616897+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607913+0000","last_change":"2023-11-15T01:39:02.212073+0000","last_active":"2023-11-15T01:39:02.607913+0000","last_peered":"2023-11-15T01:39:02.607913+0000","last_clean":"2023-11-15T01:39:02.607913+0000","last_became_active":"2023-11-15T01:39:02.211789+0000","last_became_peered":"2023-11-15T01:39:02.211789+0000","last_unstale":"2023-11-15T01:39:02.607913+0000","last_undegraded":"2023-11-15T01:39:02.607913+0000","last_fullsized":"2023-11-15T01:39:02.607913+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.599449+0000","last_change":"2023-11-15T01:39:02.597319+0000","last_active":"2023-11-15T01:39:02.599449+0000","last_peered":"2023-11-15T01:39:02.599449+0000","last_clean":"2023-11-15T01:39:02.599449+0000","last_became_active":"2023-11-15T01:39:02.597051+0000","last_became_peered":"2023-11-15T01:39:02.597051+0000","last_unstale":"2023-11-15T01:39:02.599449+0000","last_undegraded":"2023-11-15T01:39:02.599449+0000","last_fullsized":"2023-11-15T01:39:02.599449+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.614112+0000","last_change":"2023-11-15T01:39:02.213626+0000","last_active":"2023-11-15T01:39:02.614112+0000","last_peered":"2023-11-15T01:39:02.614112+0000","last_clean":"2023-11-15T01:39:02.614112+0000","last_became_active":"2023-11-15T01:39:02.213021+0000","last_became_peered":"2023-11-15T01:39:02.213021+0000","last_unstale":"2023-11-15T01:39:02.614112+0000","last_undegraded":"2023-11-15T01:39:02.614112+0000","last_fullsized":"2023-11-15T01:39:02.614112+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604865+0000","last_change":"2023-11-15T01:39:02.598955+0000","last_active":"2023-11-15T01:39:02.604865+0000","last_peered":"2023-11-15T01:39:02.604865+0000","last_clean":"2023-11-15T01:39:02.604865+0000","last_became_active":"2023-11-15T01:39:02.598657+0000","last_became_peered":"2023-11-15T01:39:02.598657+0000","last_unstale":"2023-11-15T01:39:02.604865+0000","last_undegraded":"2023-11-15T01:39:02.604865+0000","last_fullsized":"2023-11-15T01:39:02.604865+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588486+0000","last_change":"2023-11-15T01:39:02.212406+0000","last_active":"2023-11-15T01:39:02.588486+0000","last_peered":"2023-11-15T01:39:02.588486+0000","last_clean":"2023-11-15T01:39:02.588486+0000","last_became_active":"2023-11-15T01:39:02.212116+0000","last_became_peered":"2023-11-15T01:39:02.212116+0000","last_unstale":"2023-11-15T01:39:02.588486+0000","last_undegraded":"2023-11-15T01:39:02.588486+0000","last_fullsized":"2023-11-15T01:39:02.588486+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606629+0000","last_change":"2023-11-15T01:39:02.605182+0000","last_active":"2023-11-15T01:39:02.606629+0000","last_peered":"2023-11-15T01:39:02.606629+0000","last_clean":"2023-11-15T01:39:02.606629+0000","last_became_active":"2023-11-15T01:39:02.604892+0000","last_became_peered":"2023-11-15T01:39:02.604892+0000","last_unstale":"2023-11-15T01:39:02.606629+0000","last_undegraded":"2023-11-15T01:39:02.606629+0000","last_fullsized":"2023-11-15T01:39:02.606629+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597149+0000","last_change":"2023-11-15T01:39:02.210712+0000","last_active":"2023-11-15T01:39:02.597149+0000","last_peered":"2023-11-15T01:39:02.597149+0000","last_clean":"2023-11-15T01:39:02.597149+0000","last_became_active":"2023-11-15T01:39:02.210222+0000","last_became_peered":"2023-11-15T01:39:02.210222+0000","last_unstale":"2023-11-15T01:39:02.597149+0000","last_undegraded":"2023-11-15T01:39:02.597149+0000","last_fullsized":"2023-11-15T01:39:02.597149+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.620052+0000","last_change":"2023-11-15T01:39:02.615816+0000","last_active":"2023-11-15T01:39:02.620052+0000","last_peered":"2023-11-15T01:39:02.620052+0000","last_clean":"2023-11-15T01:39:02.620052+0000","last_became_active":"2023-11-15T01:39:02.615495+0000","last_became_peered":"2023-11-15T01:39:02.615495+0000","last_unstale":"2023-11-15T01:39:02.620052+0000","last_undegraded":"2023-11-15T01:39:02.620052+0000","last_fullsized":"2023-11-15T01:39:02.620052+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.601085+0000","last_change":"2023-11-15T01:39:02.213634+0000","last_active":"2023-11-15T01:39:02.601085+0000","last_peered":"2023-11-15T01:39:02.601085+0000","last_clean":"2023-11-15T01:39:02.601085+0000","last_became_active":"2023-11-15T01:39:02.213348+0000","last_became_peered":"2023-11-15T01:39:02.213348+0000","last_unstale":"2023-11-15T01:39:02.601085+0000","last_undegraded":"2023-11-15T01:39:02.601085+0000","last_fullsized":"2023-11-15T01:39:02.601085+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615584+0000","last_change":"2023-11-15T01:39:02.613224+0000","last_active":"2023-11-15T01:39:02.615584+0000","last_peered":"2023-11-15T01:39:02.615584+0000","last_clean":"2023-11-15T01:39:02.615584+0000","last_became_active":"2023-11-15T01:39:02.612879+0000","last_became_peered":"2023-11-15T01:39:02.612879+0000","last_unstale":"2023-11-15T01:39:02.615584+0000","last_undegraded":"2023-11-15T01:39:02.615584+0000","last_fullsized":"2023-11-15T01:39:02.615584+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.594724+0000","last_change":"2023-11-15T01:39:02.212971+0000","last_active":"2023-11-15T01:39:02.594724+0000","last_peered":"2023-11-15T01:39:02.594724+0000","last_clean":"2023-11-15T01:39:02.594724+0000","last_became_active":"2023-11-15T01:39:02.212667+0000","last_became_peered":"2023-11-15T01:39:02.212667+0000","last_unstale":"2023-11-15T01:39:02.594724+0000","last_undegraded":"2023-11-15T01:39:02.594724+0000","last_fullsized":"2023-11-15T01:39:02.594724+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615238+0000","last_change":"2023-11-15T01:39:02.613211+0000","last_active":"2023-11-15T01:39:02.615238+0000","last_peered":"2023-11-15T01:39:02.615238+0000","last_clean":"2023-11-15T01:39:02.615238+0000","last_became_active":"2023-11-15T01:39:02.612908+0000","last_became_peered":"2023-11-15T01:39:02.612908+0000","last_unstale":"2023-11-15T01:39:02.615238+0000","last_undegraded":"2023-11-15T01:39:02.615238+0000","last_fullsized":"2023-11-15T01:39:02.615238+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593625+0000","last_change":"2023-11-15T01:39:02.211682+0000","last_active":"2023-11-15T01:39:02.593625+0000","last_peered":"2023-11-15T01:39:02.593625+0000","last_clean":"2023-11-15T01:39:02.593625+0000","last_became_active":"2023-11-15T01:39:02.211336+0000","last_became_peered":"2023-11-15T01:39:02.211336+0000","last_unstale":"2023-11-15T01:39:02.593625+0000","last_undegraded":"2023-11-15T01:39:02.593625+0000","last_fullsized":"2023-11-15T01:39:02.593625+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619825+0000","last_change":"2023-11-15T01:39:02.616663+0000","last_active":"2023-11-15T01:39:02.619825+0000","last_peered":"2023-11-15T01:39:02.619825+0000","last_clean":"2023-11-15T01:39:02.619825+0000","last_became_active":"2023-11-15T01:39:02.616376+0000","last_became_peered":"2023-11-15T01:39:02.616376+0000","last_unstale":"2023-11-15T01:39:02.619825+0000","last_undegraded":"2023-11-15T01:39:02.619825+0000","last_fullsized":"2023-11-15T01:39:02.619825+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597448+0000","last_change":"2023-11-15T01:39:02.216677+0000","last_active":"2023-11-15T01:39:02.597448+0000","last_peered":"2023-11-15T01:39:02.597448+0000","last_clean":"2023-11-15T01:39:02.597448+0000","last_became_active":"2023-11-15T01:39:02.216244+0000","last_became_peered":"2023-11-15T01:39:02.216244+0000","last_unstale":"2023-11-15T01:39:02.597448+0000","last_undegraded":"2023-11-15T01:39:02.597448+0000","last_fullsized":"2023-11-15T01:39:02.597448+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619935+0000","last_change":"2023-11-15T01:39:02.614768+0000","last_active":"2023-11-15T01:39:02.619935+0000","last_peered":"2023-11-15T01:39:02.619935+0000","last_clean":"2023-11-15T01:39:02.619935+0000","last_became_active":"2023-11-15T01:39:02.614457+0000","last_became_peered":"2023-11-15T01:39:02.614457+0000","last_unstale":"2023-11-15T01:39:02.619935+0000","last_undegraded":"2023-11-15T01:39:02.619935+0000","last_fullsized":"2023-11-15T01:39:02.619935+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593206+0000","last_change":"2023-11-15T01:39:02.212115+0000","last_active":"2023-11-15T01:39:02.593206+0000","last_peered":"2023-11-15T01:39:02.593206+0000","last_clean":"2023-11-15T01:39:02.593206+0000","last_became_active":"2023-11-15T01:39:02.211847+0000","last_became_peered":"2023-11-15T01:39:02.211847+0000","last_unstale":"2023-11-15T01:39:02.593206+0000","last_undegraded":"2023-11-15T01:39:02.593206+0000","last_fullsized":"2023-11-15T01:39:02.593206+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606667+0000","last_change":"2023-11-15T01:39:02.604865+0000","last_active":"2023-11-15T01:39:02.606667+0000","last_peered":"2023-11-15T01:39:02.606667+0000","last_clean":"2023-11-15T01:39:02.606667+0000","last_became_active":"2023-11-15T01:39:02.604576+0000","last_became_peered":"2023-11-15T01:39:02.604576+0000","last_unstale":"2023-11-15T01:39:02.606667+0000","last_undegraded":"2023-11-15T01:39:02.606667+0000","last_fullsized":"2023-11-15T01:39:02.606667+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597373+0000","last_change":"2023-11-15T01:39:02.212456+0000","last_active":"2023-11-15T01:39:02.597373+0000","last_peered":"2023-11-15T01:39:02.597373+0000","last_clean":"2023-11-15T01:39:02.597373+0000","last_became_active":"2023-11-15T01:39:02.212123+0000","last_became_peered":"2023-11-15T01:39:02.212123+0000","last_unstale":"2023-11-15T01:39:02.597373+0000","last_undegraded":"2023-11-15T01:39:02.597373+0000","last_fullsized":"2023-11-15T01:39:02.597373+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.601148+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:39:02.601148+0000","last_peered":"2023-11-15T01:39:02.601148+0000","last_clean":"2023-11-15T01:39:02.601148+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:39:02.601148+0000","last_undegraded":"2023-11-15T01:39:02.601148+0000","last_fullsized":"2023-11-15T01:39:02.601148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.596932+0000","last_change":"2023-11-15T01:39:02.594932+0000","last_active":"2023-11-15T01:39:02.596932+0000","last_peered":"2023-11-15T01:39:02.596932+0000","last_clean":"2023-11-15T01:39:02.596932+0000","last_became_active":"2023-11-15T01:39:02.594643+0000","last_became_peered":"2023-11-15T01:39:02.594643+0000","last_unstale":"2023-11-15T01:39:02.596932+0000","last_undegraded":"2023-11-15T01:39:02.596932+0000","last_fullsized":"2023-11-15T01:39:02.596932+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611619+0000","last_change":"2023-11-15T01:39:02.210563+0000","last_active":"2023-11-15T01:39:02.611619+0000","last_peered":"2023-11-15T01:39:02.611619+0000","last_clean":"2023-11-15T01:39:02.611619+0000","last_became_active":"2023-11-15T01:39:02.210071+0000","last_became_peered":"2023-11-15T01:39:02.210071+0000","last_unstale":"2023-11-15T01:39:02.611619+0000","last_undegraded":"2023-11-15T01:39:02.611619+0000","last_fullsized":"2023-11-15T01:39:02.611619+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606635+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:39:02.606635+0000","last_peered":"2023-11-15T01:39:02.606635+0000","last_clean":"2023-11-15T01:39:02.606635+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:39:02.606635+0000","last_undegraded":"2023-11-15T01:39:02.606635+0000","last_fullsized":"2023-11-15T01:39:02.606635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611509+0000","last_change":"2023-11-15T01:39:02.610776+0000","last_active":"2023-11-15T01:39:02.611509+0000","last_peered":"2023-11-15T01:39:02.611509+0000","last_clean":"2023-11-15T01:39:02.611509+0000","last_became_active":"2023-11-15T01:39:02.610520+0000","last_became_peered":"2023-11-15T01:39:02.610520+0000","last_unstale":"2023-11-15T01:39:02.611509+0000","last_undegraded":"2023-11-15T01:39:02.611509+0000","last_fullsized":"2023-11-15T01:39:02.611509+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607127+0000","last_change":"2023-11-15T01:39:02.211202+0000","last_active":"2023-11-15T01:39:02.607127+0000","last_peered":"2023-11-15T01:39:02.607127+0000","last_clean":"2023-11-15T01:39:02.607127+0000","last_became_active":"2023-11-15T01:39:02.210846+0000","last_became_peered":"2023-11-15T01:39:02.210846+0000","last_unstale":"2023-11-15T01:39:02.607127+0000","last_undegraded":"2023-11-15T01:39:02.607127+0000","last_fullsized":"2023-11-15T01:39:02.607127+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593208+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:39:02.593208+0000","last_peered":"2023-11-15T01:39:02.593208+0000","last_clean":"2023-11-15T01:39:02.593208+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:39:02.593208+0000","last_undegraded":"2023-11-15T01:39:02.593208+0000","last_fullsized":"2023-11-15T01:39:02.593208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619122+0000","last_change":"2023-11-15T01:39:02.611202+0000","last_active":"2023-11-15T01:39:02.619122+0000","last_peered":"2023-11-15T01:39:02.619122+0000","last_clean":"2023-11-15T01:39:02.619122+0000","last_became_active":"2023-11-15T01:39:02.610885+0000","last_became_peered":"2023-11-15T01:39:02.610885+0000","last_unstale":"2023-11-15T01:39:02.619122+0000","last_undegraded":"2023-11-15T01:39:02.619122+0000","last_fullsized":"2023-11-15T01:39:02.619122+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.599145+0000","last_change":"2023-11-15T01:39:02.209388+0000","last_active":"2023-11-15T01:39:02.599145+0000","last_peered":"2023-11-15T01:39:02.599145+0000","last_clean":"2023-11-15T01:39:02.599145+0000","last_became_active":"2023-11-15T01:39:02.209125+0000","last_became_peered":"2023-11-15T01:39:02.209125+0000","last_unstale":"2023-11-15T01:39:02.599145+0000","last_undegraded":"2023-11-15T01:39:02.599145+0000","last_fullsized":"2023-11-15T01:39:02.599145+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607022+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:39:02.607022+0000","last_peered":"2023-11-15T01:39:02.607022+0000","last_clean":"2023-11-15T01:39:02.607022+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:39:02.607022+0000","last_undegraded":"2023-11-15T01:39:02.607022+0000","last_fullsized":"2023-11-15T01:39:02.607022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":98,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.602963+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:39:02.602963+0000","last_peered":"2023-11-15T01:39:02.602963+0000","last_clean":"2023-11-15T01:39:02.602963+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:39:02.602963+0000","last_undegraded":"2023-11-15T01:39:02.602963+0000","last_fullsized":"2023-11-15T01:39:02.602963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608911+0000","last_change":"2023-11-15T01:39:02.604538+0000","last_active":"2023-11-15T01:39:02.608911+0000","last_peered":"2023-11-15T01:39:02.608911+0000","last_clean":"2023-11-15T01:39:02.608911+0000","last_became_active":"2023-11-15T01:39:02.604164+0000","last_became_peered":"2023-11-15T01:39:02.604164+0000","last_unstale":"2023-11-15T01:39:02.608911+0000","last_undegraded":"2023-11-15T01:39:02.608911+0000","last_fullsized":"2023-11-15T01:39:02.608911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.605024+0000","last_change":"2023-11-15T01:39:02.213659+0000","last_active":"2023-11-15T01:39:02.605024+0000","last_peered":"2023-11-15T01:39:02.605024+0000","last_clean":"2023-11-15T01:39:02.605024+0000","last_became_active":"2023-11-15T01:39:02.213388+0000","last_became_peered":"2023-11-15T01:39:02.213388+0000","last_unstale":"2023-11-15T01:39:02.605024+0000","last_undegraded":"2023-11-15T01:39:02.605024+0000","last_fullsized":"2023-11-15T01:39:02.605024+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.602975+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:39:02.602975+0000","last_peered":"2023-11-15T01:39:02.602975+0000","last_clean":"2023-11-15T01:39:02.602975+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:39:02.602975+0000","last_undegraded":"2023-11-15T01:39:02.602975+0000","last_fullsized":"2023-11-15T01:39:02.602975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613936+0000","last_change":"2023-11-15T01:39:02.613124+0000","last_active":"2023-11-15T01:39:02.613936+0000","last_peered":"2023-11-15T01:39:02.613936+0000","last_clean":"2023-11-15T01:39:02.613936+0000","last_became_active":"2023-11-15T01:39:02.612807+0000","last_became_peered":"2023-11-15T01:39:02.612807+0000","last_unstale":"2023-11-15T01:39:02.613936+0000","last_undegraded":"2023-11-15T01:39:02.613936+0000","last_fullsized":"2023-11-15T01:39:02.613936+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593105+0000","last_change":"2023-11-15T01:39:02.208753+0000","last_active":"2023-11-15T01:39:02.593105+0000","last_peered":"2023-11-15T01:39:02.593105+0000","last_clean":"2023-11-15T01:39:02.593105+0000","last_became_active":"2023-11-15T01:39:02.208459+0000","last_became_peered":"2023-11-15T01:39:02.208459+0000","last_unstale":"2023-11-15T01:39:02.593105+0000","last_undegraded":"2023-11-15T01:39:02.593105+0000","last_fullsized":"2023-11-15T01:39:02.593105+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.605122+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:39:02.605122+0000","last_peered":"2023-11-15T01:39:02.605122+0000","last_clean":"2023-11-15T01:39:02.605122+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:39:02.605122+0000","last_undegraded":"2023-11-15T01:39:02.605122+0000","last_fullsized":"2023-11-15T01:39:02.605122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608614+0000","last_change":"2023-11-15T01:39:02.604992+0000","last_active":"2023-11-15T01:39:02.608614+0000","last_peered":"2023-11-15T01:39:02.608614+0000","last_clean":"2023-11-15T01:39:02.608614+0000","last_became_active":"2023-11-15T01:39:02.604731+0000","last_became_peered":"2023-11-15T01:39:02.604731+0000","last_unstale":"2023-11-15T01:39:02.608614+0000","last_undegraded":"2023-11-15T01:39:02.608614+0000","last_fullsized":"2023-11-15T01:39:02.608614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.596996+0000","last_change":"2023-11-15T01:39:02.215566+0000","last_active":"2023-11-15T01:39:02.596996+0000","last_peered":"2023-11-15T01:39:02.596996+0000","last_clean":"2023-11-15T01:39:02.596996+0000","last_became_active":"2023-11-15T01:39:02.215261+0000","last_became_peered":"2023-11-15T01:39:02.215261+0000","last_unstale":"2023-11-15T01:39:02.596996+0000","last_undegraded":"2023-11-15T01:39:02.596996+0000","last_fullsized":"2023-11-15T01:39:02.596996+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598969+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:39:02.598969+0000","last_peered":"2023-11-15T01:39:02.598969+0000","last_clean":"2023-11-15T01:39:02.598969+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:39:02.598969+0000","last_undegraded":"2023-11-15T01:39:02.598969+0000","last_fullsized":"2023-11-15T01:39:02.598969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609619+0000","last_change":"2023-11-15T01:39:02.607704+0000","last_active":"2023-11-15T01:39:02.609619+0000","last_peered":"2023-11-15T01:39:02.609619+0000","last_clean":"2023-11-15T01:39:02.609619+0000","last_became_active":"2023-11-15T01:39:02.607461+0000","last_became_peered":"2023-11-15T01:39:02.607461+0000","last_unstale":"2023-11-15T01:39:02.609619+0000","last_undegraded":"2023-11-15T01:39:02.609619+0000","last_fullsized":"2023-11-15T01:39:02.609619+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593520+0000","last_change":"2023-11-15T01:39:02.208524+0000","last_active":"2023-11-15T01:39:02.593520+0000","last_peered":"2023-11-15T01:39:02.593520+0000","last_clean":"2023-11-15T01:39:02.593520+0000","last_became_active":"2023-11-15T01:39:02.208211+0000","last_became_peered":"2023-11-15T01:39:02.208211+0000","last_unstale":"2023-11-15T01:39:02.593520+0000","last_undegraded":"2023-11-15T01:39:02.593520+0000","last_fullsized":"2023-11-15T01:39:02.593520+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598462+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:39:02.598462+0000","last_peered":"2023-11-15T01:39:02.598462+0000","last_clean":"2023-11-15T01:39:02.598462+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:39:02.598462+0000","last_undegraded":"2023-11-15T01:39:02.598462+0000","last_fullsized":"2023-11-15T01:39:02.598462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575056,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302716,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069124,"statfs":{"total":96636764160,"available":96326782976,"internally_reserved":0,"allocated":1560576,"data_stored":809406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.55100000000000005},"min":{"1min":0.29699999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67900000000000005,"5min":0.71199999999999997,"15min":0.82299999999999995},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.33800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.73699999999999999,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74399999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54200000000000004,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.34399999999999997,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.85899999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54100000000000004,"15min":0.56200000000000006},"min":{"1min":0.32700000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71099999999999997,"5min":0.79600000000000004,"15min":0.82599999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":0.58499999999999996},"min":{"1min":0.40699999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.875}]},{"osd":3,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.58099999999999996},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.76900000000000002,"5min":0.80700000000000005,"15min":0.85999999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78000000000000003,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.83499999999999996}]},{"osd":4,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64400000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.32500000000000001,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.77000000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.316,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.83099999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.70399999999999996,"5min":0.73899999999999999,"15min":0.78500000000000003},"last":0.71099999999999997}]},{"osd":6,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78400000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.85099999999999998},"last":0.88400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1568768,"data_stored":809982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.55600000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.30499999999999999},"max":{"1min":0.70999999999999996,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.41799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77800000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.58899999999999997}]},{"osd":1,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.83099999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.39100000000000001,"5min":0.33100000000000002,"15min":0.32100000000000001},"max":{"1min":0.79600000000000004,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.36699999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72499999999999998,"5min":1.746,"15min":1.746},"last":0.53800000000000003}]},{"osd":3,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.307},"max":{"1min":0.69999999999999996,"5min":0.77100000000000002,"15min":0.91300000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.52900000000000003}]},{"osd":4,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.44900000000000001,"15min":0.45000000000000001},"min":{"1min":0.29099999999999998,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.52200000000000002},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.25800000000000001},"max":{"1min":0.71199999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51900000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48199999999999998,"15min":0.48099999999999998},"min":{"1min":0.32200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63900000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.5},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57599999999999996}]},{"osd":7,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.496,"15min":0.5},"min":{"1min":0.35099999999999998,"5min":0.32500000000000001,"15min":0.29899999999999999},"max":{"1min":0.64800000000000002,"5min":0.875,"15min":0.875},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80800000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575058,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302728,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069112,"statfs":{"total":96636764160,"available":96326770688,"internally_reserved":0,"allocated":1572864,"data_stored":810866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.23999999999999999},"max":{"1min":0.50800000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.40300000000000002},"min":{"1min":0.26600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58699999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.25900000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.373,"15min":0.38900000000000001},"min":{"1min":0.27200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.57599999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.245},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.438},"min":{"1min":0.28199999999999997,"5min":0.27800000000000002,"15min":0.26200000000000001},"max":{"1min":0.68999999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.52400000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55700000000000005,"15min":0.52300000000000002},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60299999999999998,"5min":9.641,"15min":9.641},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53200000000000003,"15min":0.501},"min":{"1min":0.34200000000000003,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":0.63400000000000001,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.373}]},{"osd":4,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.42199999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.63600000000000001},"min":{"1min":0.49299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.875,"5min":1.006,"15min":1.006},"last":0.69799999999999995}]},{"osd":5,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.82299999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.432},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81200000000000006,"5min":1.111,"15min":1.111},"last":0.55700000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.67400000000000004},"min":{"1min":0.498,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":0.78000000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65700000000000003,"15min":0.68500000000000005},"min":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92800000000000005,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.59199999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.51100000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91800000000000004,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66500000000000004,"15min":0.68999999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94199999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575056,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1568768,"data_stored":810050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.375,"15min":0.371},"min":{"1min":0.27800000000000002,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.54200000000000004,"5min":2.024,"15min":2.024},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.26100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.64700000000000002,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.26100000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52400000000000002,"5min":1.768,"15min":1.768},"last":0.245},{"interface":"front","average":{"1min":0.436,"5min":0.439,"15min":0.44},"min":{"1min":0.28899999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.63500000000000001,"5min":1.982,"15min":1.982},"last":0.28899999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44,"15min":0.437},"min":{"1min":0.28100000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61299999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.67900000000000005,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.30599999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.45600000000000002,"5min":0.42199999999999999,"15min":0.40400000000000003},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98899999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.47599999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.624,"15min":0.629},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.38500000000000001},"max":{"1min":0.97899999999999998,"5min":1.881,"15min":1.881},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":1.056},"last":0.56000000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.42999999999999999,"15min":0.36499999999999999},"max":{"1min":1.04,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.5},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67000000000000004,"15min":0.67100000000000004},"min":{"1min":0.51100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.917,"15min":1.917},"last":0.52800000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69899999999999995,"15min":0.68999999999999995},"min":{"1min":0.53400000000000003,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0089999999999999,"5min":1.843,"15min":1.843},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67200000000000004,"15min":0.68700000000000006},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.40899999999999997},"max":{"1min":1.073,"5min":1.073,"15min":1.0960000000000001},"last":0.60599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575057,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306816,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065024,"statfs":{"total":96636764160,"available":96322584576,"internally_reserved":0,"allocated":1564672,"data_stored":809420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35499999999999998,"15min":0.36699999999999999},"min":{"1min":0.26900000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.46000000000000002,"5min":0.54800000000000004,"15min":0.61899999999999999},"last":0.252},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.40600000000000003},"min":{"1min":0.255,"5min":0.246,"15min":0.246},"max":{"1min":0.63200000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.35099999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.26900000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61799999999999999,"5min":0.745,"15min":0.75},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42699999999999999,"15min":0.438},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.56399999999999995,"5min":0.69799999999999995,"15min":0.92000000000000004},"last":0.318}]},{"osd":3,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.44400000000000001,"15min":0.45200000000000001},"min":{"1min":0.34899999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67400000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.439,"15min":0.443},"min":{"1min":0.34100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.30099999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.61799999999999999},"min":{"1min":0.42799999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79800000000000004,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80900000000000005,"5min":0.91100000000000003,"15min":0.95399999999999996},"last":0.51900000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.623,"15min":0.64200000000000002},"min":{"1min":0.495,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84799999999999998,"5min":1.032,"15min":1.032},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.60699999999999998,"15min":0.63600000000000001},"min":{"1min":0.48499999999999999,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":0.75,"5min":0.96699999999999997,"15min":0.99399999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64100000000000001,"15min":0.65700000000000003},"min":{"1min":0.49399999999999999,"5min":0.438,"15min":0.374},"max":{"1min":0.85799999999999998,"5min":1.002,"15min":1.0389999999999999},"last":0.499},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64500000000000002,"15min":0.67000000000000004},"min":{"1min":0.53800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56899999999999995}]},{"osd":7,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64800000000000002,"15min":0.66900000000000004},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":1.079,"15min":1.079},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66000000000000003,"15min":0.68999999999999995},"min":{"1min":0.52600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.82299999999999995,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.505}]}]},{"osd":3,"up_from":13,"seq":55834575058,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306808,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065032,"statfs":{"total":96636764160,"available":96322592768,"internally_reserved":0,"allocated":1556480,"data_stored":809316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35599999999999998,"15min":0.374},"min":{"1min":0.23200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.54500000000000004,"5min":0.65900000000000003,"15min":0.79900000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.374,"15min":0.40000000000000002},"min":{"1min":0.24199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.503,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.438}]},{"osd":1,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.36499999999999999,"15min":0.39000000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.24399999999999999},"max":{"1min":0.52500000000000002,"5min":0.57799999999999996,"15min":0.72899999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.44500000000000001},"min":{"1min":0.28699999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70199999999999996,"5min":0.72499999999999998,"15min":0.747},"last":0.48499999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41499999999999998,"15min":0.44800000000000001},"min":{"1min":0.29499999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.47699999999999998},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":0.69199999999999995,"15min":0.81999999999999995},"last":0.56499999999999995}]},{"osd":4,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56899999999999995,"15min":0.61599999999999999},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.80500000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.626},"min":{"1min":0.435,"5min":0.40600000000000003,"15min":0.39000000000000001},"max":{"1min":0.84799999999999998,"5min":0.89200000000000002,"15min":1.0589999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58799999999999997,"15min":0.63300000000000001},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.76800000000000002,"5min":0.92000000000000004,"15min":1.0569999999999999},"last":0.749},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.63900000000000001},"min":{"1min":0.41499999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73799999999999999,"5min":0.879,"15min":0.95999999999999996},"last":0.92600000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60199999999999998,"15min":0.64600000000000002},"min":{"1min":0.40899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.0980000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.67000000000000004},"min":{"1min":0.42899999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.95799999999999996,"15min":1.169},"last":0.80600000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.66600000000000004},"min":{"1min":0.48399999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":1.0429999999999999,"15min":1.071},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86099999999999999,"5min":0.996,"15min":1.1459999999999999},"last":0.97199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575056,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302720,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069120,"statfs":{"total":96636764160,"available":96326778880,"internally_reserved":0,"allocated":1564672,"data_stored":810230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.34499999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.84499999999999997,"15min":0.88},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.374,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.754,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.47499999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.42099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72499999999999998,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.432},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.45500000000000002,"5min":0.34799999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.59899999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.58699999999999997},"min":{"1min":0.44,"5min":0.34100000000000003,"15min":0.30299999999999999},"max":{"1min":0.70299999999999996,"5min":2.887,"15min":2.887},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.33100000000000002},"max":{"1min":0.77700000000000002,"5min":0.92300000000000004,"15min":0.96299999999999997},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.41299999999999998,"5min":0.35799999999999998,"15min":0.33100000000000002},"max":{"1min":0.71599999999999997,"5min":2.464,"15min":2.464},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.623,"15min":0.60699999999999998},"min":{"1min":0.47599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79400000000000004,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.67700000000000005}]},{"osd":5,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48399999999999999,"15min":0.46800000000000003},"min":{"1min":0.34499999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70499999999999996,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.27400000000000002},"max":{"1min":0.65800000000000003,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.66300000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52200000000000002,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.29699999999999999,"15min":0.28899999999999998},"max":{"1min":0.67800000000000005,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.82899999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.77300000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58499999999999996,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71799999999999997,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.73399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575056,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302716,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069124,"statfs":{"total":96636764160,"available":96326782976,"internally_reserved":0,"allocated":1560576,"data_stored":809870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52600000000000002,"15min":0.54900000000000004},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.63700000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.373},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.55000000000000004},"min":{"1min":0.32300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.73199999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.66700000000000004}]},{"osd":1,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.33300000000000002,"15min":0.32600000000000001},"max":{"1min":0.78500000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55200000000000005,"15min":0.56899999999999995},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.35099999999999998},"max":{"1min":0.72099999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.434}]},{"osd":2,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69699999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55400000000000005,"15min":0.57199999999999995},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.84599999999999997},"last":0.47699999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70099999999999996,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.495},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":0.58699999999999997},"min":{"1min":0.38800000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74399999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.52800000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.432,"15min":0.44400000000000001},"min":{"1min":0.32400000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57899999999999996,"5min":0.66500000000000004,"15min":0.76500000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.50800000000000001,"15min":0.51900000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67900000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.78700000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.31,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.47699999999999998,"15min":0.48899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.61099999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63800000000000001,"5min":0.72999999999999998,"15min":0.755},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:39:07.409 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-15T01:39:07.505 INFO:tasks.ceph.mds.d.smithi141.stderr:2023-11-15T01:39:07.505+0000 7f24acee8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T01:39:07.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.525+0000 7f7d564a4700 1 Processor -- start 2023-11-15T01:39:07.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.525+0000 7f7d564a4700 1 -- start start 2023-11-15T01:39:07.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.525+0000 7f7d564a4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d501542d0 0x7f7d500aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.525+0000 7f7d564a4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7d501546b0 0x7f7d500c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.525+0000 7f7d564a4700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7d500aa640 0x7f7d500c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.525+0000 7f7d564a4700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d500ab180 con 0x7f7d501546b0 2023-11-15T01:39:07.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.525+0000 7f7d564a4700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d500c81e0 con 0x7f7d500aa640 2023-11-15T01:39:07.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.525+0000 7f7d564a4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d501583b0 con 0x7f7d501542d0 2023-11-15T01:39:07.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.526+0000 7f7d4f7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7d501546b0 0x7f7d500c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.526+0000 7f7d4f7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7d501546b0 0x7f7d500c7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57738/0 (socket says 172.21.15.1:57738) 2023-11-15T01:39:07.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.526+0000 7f7d4f7fe700 1 -- 172.21.15.1:0/3649716068 learned_addr learned my addr 172.21.15.1:0/3649716068 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:07.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.526+0000 7f7d4ffff700 1 --2- 172.21.15.1:0/3649716068 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d501542d0 0x7f7d500aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.526+0000 7f7d54a41700 1 --2- 172.21.15.1:0/3649716068 >> v2:172.21.15.141:3300/0 conn(0x7f7d500aa640 0x7f7d500c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.526+0000 7f7d4f7fe700 1 -- 172.21.15.1:0/3649716068 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d501542d0 msgr2=0x7f7d500aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:07.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.526+0000 7f7d4f7fe700 1 --2- 172.21.15.1:0/3649716068 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d501542d0 0x7f7d500aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.526+0000 7f7d4f7fe700 1 -- 172.21.15.1:0/3649716068 >> v2:172.21.15.141:3300/0 conn(0x7f7d500aa640 msgr2=0x7f7d500c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:07.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.526+0000 7f7d4f7fe700 1 --2- 172.21.15.1:0/3649716068 >> v2:172.21.15.141:3300/0 conn(0x7f7d500aa640 0x7f7d500c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.526+0000 7f7d4f7fe700 1 -- 172.21.15.1:0/3649716068 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d50158690 con 0x7f7d501546b0 2023-11-15T01:39:07.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.526+0000 7f7d4f7fe700 1 --2- 172.21.15.1:0/3649716068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d501546b0 0x7f7d500c7800 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f7d500846d0 tx=0x7f7d440090f0).ready entity=mon.0 client_cookie=cbb430f01725e0c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:07.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.526+0000 7f7d4effd700 1 -- 172.21.15.1:0/3649716068 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400b600 con 0x7f7d501546b0 2023-11-15T01:39:07.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.526+0000 7f7d4effd700 1 -- 172.21.15.1:0/3649716068 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4400b760 con 0x7f7d501546b0 2023-11-15T01:39:07.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.526+0000 7f7d4effd700 1 -- 172.21.15.1:0/3649716068 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400bb00 con 0x7f7d501546b0 2023-11-15T01:39:07.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.527+0000 7f7d564a4700 1 -- 172.21.15.1:0/3649716068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d501546b0 msgr2=0x7f7d500c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:07.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.527+0000 7f7d564a4700 1 --2- 172.21.15.1:0/3649716068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d501546b0 0x7f7d500c7800 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f7d500846d0 tx=0x7f7d440090f0).stop 2023-11-15T01:39:07.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.527+0000 7f7d564a4700 1 -- 172.21.15.1:0/3649716068 shutdown_connections 2023-11-15T01:39:07.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.527+0000 7f7d564a4700 1 --2- 172.21.15.1:0/3649716068 >> v2:172.21.15.141:3300/0 conn(0x7f7d500aa640 0x7f7d500c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.527+0000 7f7d564a4700 1 --2- 172.21.15.1:0/3649716068 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d501542d0 0x7f7d500aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.527+0000 7f7d564a4700 1 --2- 172.21.15.1:0/3649716068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d501546b0 0x7f7d500c7800 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.527+0000 7f7d564a4700 1 -- 172.21.15.1:0/3649716068 >> 172.21.15.1:0/3649716068 conn(0x7f7d50069ee0 msgr2=0x7f7d5006a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:07.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.527+0000 7f7d564a4700 1 -- 172.21.15.1:0/3649716068 shutdown_connections 2023-11-15T01:39:07.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.527+0000 7f7d564a4700 1 -- 172.21.15.1:0/3649716068 wait complete. 2023-11-15T01:39:07.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.528+0000 7f7d564a4700 1 Processor -- start 2023-11-15T01:39:07.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.528+0000 7f7d564a4700 1 -- start start 2023-11-15T01:39:07.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d564a4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d500aa640 0x7f7d500b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d564a4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d501542d0 0x7f7d500ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d564a4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d501546b0 0x7f7d500ae730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d564a4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d500c37e0 con 0x7f7d501542d0 2023-11-15T01:39:07.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d564a4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d500c2bd0 con 0x7f7d501546b0 2023-11-15T01:39:07.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d564a4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d500c2eb0 con 0x7f7d500aa640 2023-11-15T01:39:07.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d4f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d501542d0 0x7f7d500ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d4f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d501542d0 0x7f7d500ae240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57746/0 (socket says 172.21.15.1:57746) 2023-11-15T01:39:07.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d4f7fe700 1 -- 172.21.15.1:0/1923407014 learned_addr learned my addr 172.21.15.1:0/1923407014 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:07.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d4ffff700 1 --2- 172.21.15.1:0/1923407014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d500aa640 0x7f7d500b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d54a41700 1 --2- 172.21.15.1:0/1923407014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d501546b0 0x7f7d500ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d4f7fe700 1 -- 172.21.15.1:0/1923407014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d500aa640 msgr2=0x7f7d500b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:07.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d4f7fe700 1 --2- 172.21.15.1:0/1923407014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d500aa640 0x7f7d500b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d4f7fe700 1 -- 172.21.15.1:0/1923407014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d501546b0 msgr2=0x7f7d500ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:07.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d4f7fe700 1 --2- 172.21.15.1:0/1923407014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d501546b0 0x7f7d500ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.529+0000 7f7d4f7fe700 1 -- 172.21.15.1:0/1923407014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d44009370 con 0x7f7d501542d0 2023-11-15T01:39:07.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.530+0000 7f7d4f7fe700 1 --2- 172.21.15.1:0/1923407014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d501542d0 0x7f7d500ae240 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f7d44011000 tx=0x7f7d44017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:07.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.530+0000 7f7d37fff700 1 -- 172.21.15.1:0/1923407014 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44006d90 con 0x7f7d501542d0 2023-11-15T01:39:07.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.530+0000 7f7d37fff700 1 -- 172.21.15.1:0/1923407014 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4400bec0 con 0x7f7d501542d0 2023-11-15T01:39:07.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.530+0000 7f7d564a4700 1 -- 172.21.15.1:0/1923407014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d500c3190 con 0x7f7d501542d0 2023-11-15T01:39:07.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.530+0000 7f7d37fff700 1 -- 172.21.15.1:0/1923407014 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400bb00 con 0x7f7d501542d0 2023-11-15T01:39:07.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.530+0000 7f7d564a4700 1 -- 172.21.15.1:0/1923407014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d500b0e00 con 0x7f7d501542d0 2023-11-15T01:39:07.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.531+0000 7f7d564a4700 1 -- 172.21.15.1:0/1923407014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5006c7e0 con 0x7f7d501542d0 2023-11-15T01:39:07.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.531+0000 7f7d37fff700 1 -- 172.21.15.1:0/1923407014 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7d4401d640 con 0x7f7d501542d0 2023-11-15T01:39:07.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.531+0000 7f7d37fff700 1 --2- 172.21.15.1:0/1923407014 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d3c05f270 0x7f7d3c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.532+0000 7f7d37fff700 1 -- 172.21.15.1:0/1923407014 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f7d4407bf20 con 0x7f7d501542d0 2023-11-15T01:39:07.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.532+0000 7f7d4ffff700 1 --2- 172.21.15.1:0/1923407014 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d3c05f270 0x7f7d3c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.532+0000 7f7d4ffff700 1 --2- 172.21.15.1:0/1923407014 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d3c05f270 0x7f7d3c061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7d4000bbc0 tx=0x7f7d40008040).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:07.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.536+0000 7f7d37fff700 1 -- 172.21.15.1:0/1923407014 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7d4404cec0 con 0x7f7d501542d0 2023-11-15T01:39:07.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.779+0000 7f7d564a4700 1 -- 172.21.15.1:0/1923407014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7d50158970 con 0x7f7d501542d0 2023-11-15T01:39:07.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.779+0000 7f7d37fff700 1 -- 172.21.15.1:0/1923407014 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+954 (secure 0 0 0) 0x7f7d44021020 con 0x7f7d501542d0 2023-11-15T01:39:07.781 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:39:07.781 INFO:teuthology.orchestra.run.smithi001.stdout:{"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1068,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":126,"num_osds":8,"num_up_osds":8,"osd_up_since":1700011287,"num_in_osds":8,"osd_in_since":1700011281,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":2488270848,"bytes_avail":770605842432,"bytes_total":773094113280},"fsmap":{"epoch":55,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":7629}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-11-15T01:38:44.087107+0000","services":{}},"progress_events":{}} 2023-11-15T01:39:07.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.781+0000 7f7d564a4700 1 -- 172.21.15.1:0/1923407014 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d3c05f270 msgr2=0x7f7d3c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:07.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.781+0000 7f7d564a4700 1 --2- 172.21.15.1:0/1923407014 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d3c05f270 0x7f7d3c061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7d4000bbc0 tx=0x7f7d40008040).stop 2023-11-15T01:39:07.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.781+0000 7f7d564a4700 1 -- 172.21.15.1:0/1923407014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d501542d0 msgr2=0x7f7d500ae240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:07.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.781+0000 7f7d564a4700 1 --2- 172.21.15.1:0/1923407014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d501542d0 0x7f7d500ae240 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f7d44011000 tx=0x7f7d44017000).stop 2023-11-15T01:39:07.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.781+0000 7f7d564a4700 1 -- 172.21.15.1:0/1923407014 shutdown_connections 2023-11-15T01:39:07.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.781+0000 7f7d564a4700 1 --2- 172.21.15.1:0/1923407014 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d3c05f270 0x7f7d3c061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.781+0000 7f7d564a4700 1 --2- 172.21.15.1:0/1923407014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d501546b0 0x7f7d500ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.781+0000 7f7d564a4700 1 --2- 172.21.15.1:0/1923407014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d500aa640 0x7f7d500b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.781+0000 7f7d564a4700 1 --2- 172.21.15.1:0/1923407014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d501542d0 0x7f7d500ae240 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.781+0000 7f7d564a4700 1 -- 172.21.15.1:0/1923407014 >> 172.21.15.1:0/1923407014 conn(0x7f7d50069ee0 msgr2=0x7f7d500c0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:07.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.781+0000 7f7d564a4700 1 -- 172.21.15.1:0/1923407014 shutdown_connections 2023-11-15T01:39:07.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.781+0000 7f7d564a4700 1 -- 172.21.15.1:0/1923407014 wait complete. 2023-11-15T01:39:07.796 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-15T01:39:07.797 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:39:07.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.914+0000 7fb292dec700 1 Processor -- start 2023-11-15T01:39:07.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.915+0000 7fb292dec700 1 -- start start 2023-11-15T01:39:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.915+0000 7fb292dec700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb28c154450 0x7fb28c0a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.915+0000 7fb292dec700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb28c0be520 0x7fb28c154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.915+0000 7fb292dec700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28c0a85e0 con 0x7fb28c0833a0 2023-11-15T01:39:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.915+0000 7fb292dec700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28c065940 con 0x7fb28c154450 2023-11-15T01:39:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.915+0000 7fb292dec700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c065660 con 0x7fb28c0be520 2023-11-15T01:39:07.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.916+0000 7fb290b88700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb28c154450 0x7fb28c0a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.916+0000 7fb290b88700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb28c154450 0x7fb28c0a7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38540/0 (socket says 172.21.15.1:38540) 2023-11-15T01:39:07.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.916+0000 7fb290b88700 1 -- 172.21.15.1:0/2486471817 learned_addr learned my addr 172.21.15.1:0/2486471817 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:07.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.916+0000 7fb290b88700 1 -- 172.21.15.1:0/2486471817 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb28c0be520 msgr2=0x7fb28c154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:07.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.916+0000 7fb290b88700 1 --2- 172.21.15.1:0/2486471817 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb28c0be520 0x7fb28c154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:39:07.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.916+0000 7fb290b88700 1 -- 172.21.15.1:0/2486471817 >> v1:172.21.15.141:6789/0 conn(0x7fb28c0833a0 legacy=0x7fb28c0bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:07.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.916+0000 7fb290b88700 1 -- 172.21.15.1:0/2486471817 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c0c6f50 con 0x7fb28c154450 2023-11-15T01:39:07.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.916+0000 7fb290b88700 1 --2- 172.21.15.1:0/2486471817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb28c154450 0x7fb28c0a7ef0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fb27c009810 tx=0x7fb27c009060).ready entity=mon.0 client_cookie=35798510a438a26b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:07.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.916+0000 7fb28b7fe700 1 -- 172.21.15.1:0/2486471817 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c005880 con 0x7fb28c154450 2023-11-15T01:39:07.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.916+0000 7fb28b7fe700 1 -- 172.21.15.1:0/2486471817 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27c0059e0 con 0x7fb28c154450 2023-11-15T01:39:07.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.916+0000 7fb28b7fe700 1 -- 172.21.15.1:0/2486471817 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c005d60 con 0x7fb28c154450 2023-11-15T01:39:07.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.917+0000 7fb292dec700 1 -- 172.21.15.1:0/2486471817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb28c154450 msgr2=0x7fb28c0a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:07.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.917+0000 7fb292dec700 1 --2- 172.21.15.1:0/2486471817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb28c154450 0x7fb28c0a7ef0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fb27c009810 tx=0x7fb27c009060).stop 2023-11-15T01:39:07.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.917+0000 7fb292dec700 1 -- 172.21.15.1:0/2486471817 shutdown_connections 2023-11-15T01:39:07.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.917+0000 7fb292dec700 1 --2- 172.21.15.1:0/2486471817 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb28c0be520 0x7fb28c154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:39:07.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.917+0000 7fb292dec700 1 --2- 172.21.15.1:0/2486471817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb28c154450 0x7fb28c0a7ef0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.917+0000 7fb292dec700 1 -- 172.21.15.1:0/2486471817 >> 172.21.15.1:0/2486471817 conn(0x7fb28c082f90 msgr2=0x7fb28c0c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:07.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.917+0000 7fb292dec700 1 -- 172.21.15.1:0/2486471817 shutdown_connections 2023-11-15T01:39:07.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.917+0000 7fb292dec700 1 -- 172.21.15.1:0/2486471817 wait complete. 2023-11-15T01:39:07.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.918+0000 7fb292dec700 1 Processor -- start 2023-11-15T01:39:07.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.918+0000 7fb292dec700 1 -- start start 2023-11-15T01:39:07.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb292dec700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb28c0833a0 0x7fb28c150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb292dec700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb28c0be520 0x7fb28c0a9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb292dec700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb28c154450 0x7fb28c0bfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb292dec700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c0ad7f0 con 0x7fb28c154450 2023-11-15T01:39:07.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb292dec700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c0ae090 con 0x7fb28c0833a0 2023-11-15T01:39:07.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb292dec700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c151340 con 0x7fb28c0be520 2023-11-15T01:39:07.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb291389700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb28c154450 0x7fb28c0bfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb291389700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb28c154450 0x7fb28c0bfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38550/0 (socket says 172.21.15.1:38550) 2023-11-15T01:39:07.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb291389700 1 -- 172.21.15.1:0/4084393762 learned_addr learned my addr 172.21.15.1:0/4084393762 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:07.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb290b88700 1 --2- 172.21.15.1:0/4084393762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb28c0833a0 0x7fb28c150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb28bfff700 1 --2- 172.21.15.1:0/4084393762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb28c0be520 0x7fb28c0a9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb291389700 1 -- 172.21.15.1:0/4084393762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb28c0be520 msgr2=0x7fb28c0a9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:07.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb291389700 1 --2- 172.21.15.1:0/4084393762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb28c0be520 0x7fb28c0a9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb291389700 1 -- 172.21.15.1:0/4084393762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb28c0833a0 msgr2=0x7fb28c150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:07.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb291389700 1 --2- 172.21.15.1:0/4084393762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb28c0833a0 0x7fb28c150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:07.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.919+0000 7fb291389700 1 -- 172.21.15.1:0/4084393762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c009300 con 0x7fb28c154450 2023-11-15T01:39:07.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.920+0000 7fb291389700 1 --2- 172.21.15.1:0/4084393762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb28c154450 0x7fb28c0bfd30 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fb28400bb90 tx=0x7fb284009810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:07.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.920+0000 7fb288ff9700 1 -- 172.21.15.1:0/4084393762 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400c8c0 con 0x7fb28c154450 2023-11-15T01:39:07.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.920+0000 7fb288ff9700 1 -- 172.21.15.1:0/4084393762 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28400ca40 con 0x7fb28c154450 2023-11-15T01:39:07.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.920+0000 7fb288ff9700 1 -- 172.21.15.1:0/4084393762 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400cbf0 con 0x7fb28c154450 2023-11-15T01:39:07.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.920+0000 7fb292dec700 1 -- 172.21.15.1:0/4084393762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28c0aa160 con 0x7fb28c154450 2023-11-15T01:39:07.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.920+0000 7fb292dec700 1 -- 172.21.15.1:0/4084393762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28c0add20 con 0x7fb28c154450 2023-11-15T01:39:07.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.921+0000 7fb292dec700 1 -- 172.21.15.1:0/4084393762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb28c0ae220 con 0x7fb28c154450 2023-11-15T01:39:07.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.921+0000 7fb288ff9700 1 -- 172.21.15.1:0/4084393762 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb284012020 con 0x7fb28c154450 2023-11-15T01:39:07.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.921+0000 7fb288ff9700 1 --2- 172.21.15.1:0/4084393762 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb27805f240 0x7fb278061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:07.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.922+0000 7fb288ff9700 1 -- 172.21.15.1:0/4084393762 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fb28407a4a0 con 0x7fb28c154450 2023-11-15T01:39:07.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.922+0000 7fb290b88700 1 --2- 172.21.15.1:0/4084393762 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb27805f240 0x7fb278061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:07.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.922+0000 7fb290b88700 1 --2- 172.21.15.1:0/4084393762 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb27805f240 0x7fb278061700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb27c00b3c0 tx=0x7fb27c016000).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:07.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:07.926+0000 7fb288ff9700 1 -- 172.21.15.1:0/4084393762 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb28404b4f0 con 0x7fb28c154450 2023-11-15T01:39:08.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:08.096+0000 7fb292dec700 1 -- 172.21.15.1:0/4084393762 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb28c065350 con 0x7fb27805f240 2023-11-15T01:39:08.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:08.106+0000 7fb288ff9700 1 -- 172.21.15.1:0/4084393762 <== mgr.6919 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361708 (secure 0 0 0) 0x7fb28c065350 con 0x7fb27805f240 2023-11-15T01:39:08.112 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:39:08.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:08.110+0000 7fb292dec700 1 -- 172.21.15.1:0/4084393762 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb27805f240 msgr2=0x7fb278061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:08.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:08.110+0000 7fb292dec700 1 --2- 172.21.15.1:0/4084393762 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb27805f240 0x7fb278061700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb27c00b3c0 tx=0x7fb27c016000).stop 2023-11-15T01:39:08.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:08.110+0000 7fb292dec700 1 -- 172.21.15.1:0/4084393762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb28c154450 msgr2=0x7fb28c0bfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:08.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:08.110+0000 7fb292dec700 1 --2- 172.21.15.1:0/4084393762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb28c154450 0x7fb28c0bfd30 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fb28400bb90 tx=0x7fb284009810).stop 2023-11-15T01:39:08.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:08.110+0000 7fb292dec700 1 -- 172.21.15.1:0/4084393762 shutdown_connections 2023-11-15T01:39:08.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:08.110+0000 7fb292dec700 1 --2- 172.21.15.1:0/4084393762 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb27805f240 0x7fb278061700 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:08.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:08.110+0000 7fb292dec700 1 --2- 172.21.15.1:0/4084393762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb28c154450 0x7fb28c0bfd30 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:08.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:08.110+0000 7fb292dec700 1 --2- 172.21.15.1:0/4084393762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb28c0833a0 0x7fb28c150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:08.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:08.110+0000 7fb292dec700 1 --2- 172.21.15.1:0/4084393762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb28c0be520 0x7fb28c0a9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:08.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:08.110+0000 7fb292dec700 1 -- 172.21.15.1:0/4084393762 >> 172.21.15.1:0/4084393762 conn(0x7fb28c082f90 msgr2=0x7fb28c0be950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:08.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:08.110+0000 7fb292dec700 1 -- 172.21.15.1:0/4084393762 shutdown_connections 2023-11-15T01:39:08.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:08.110+0000 7fb292dec700 1 -- 172.21.15.1:0/4084393762 wait complete. 2023-11-15T01:39:08.117 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:39:08.123 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T01:39:07.152065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2429952,"kb_used_data":12224,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752544768,"statfs":{"total":773094113280,"available":770605842432,"internally_reserved":0,"allocated":12517376,"data_stored":6479140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6722,"num_objects":-19,"num_object_clones":0,"num_object_copies":-38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-52,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.009730"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613925+0000","last_change":"2023-11-15T01:39:02.602396+0000","last_active":"2023-11-15T01:39:02.613925+0000","last_peered":"2023-11-15T01:39:02.613925+0000","last_clean":"2023-11-15T01:39:02.613925+0000","last_became_active":"2023-11-15T01:39:02.602116+0000","last_became_peered":"2023-11-15T01:39:02.602116+0000","last_unstale":"2023-11-15T01:39:02.613925+0000","last_undegraded":"2023-11-15T01:39:02.613925+0000","last_fullsized":"2023-11-15T01:39:02.613925+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616122+0000","last_change":"2023-11-15T01:39:02.218901+0000","last_active":"2023-11-15T01:39:02.616122+0000","last_peered":"2023-11-15T01:39:02.616122+0000","last_clean":"2023-11-15T01:39:02.616122+0000","last_became_active":"2023-11-15T01:39:02.218594+0000","last_became_peered":"2023-11-15T01:39:02.218594+0000","last_unstale":"2023-11-15T01:39:02.616122+0000","last_undegraded":"2023-11-15T01:39:02.616122+0000","last_fullsized":"2023-11-15T01:39:02.616122+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603572+0000","last_change":"2023-11-15T01:39:02.600412+0000","last_active":"2023-11-15T01:39:02.603572+0000","last_peered":"2023-11-15T01:39:02.603572+0000","last_clean":"2023-11-15T01:39:02.603572+0000","last_became_active":"2023-11-15T01:39:02.600184+0000","last_became_peered":"2023-11-15T01:39:02.600184+0000","last_unstale":"2023-11-15T01:39:02.603572+0000","last_undegraded":"2023-11-15T01:39:02.603572+0000","last_fullsized":"2023-11-15T01:39:02.603572+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588186+0000","last_change":"2023-11-15T01:39:02.212406+0000","last_active":"2023-11-15T01:39:02.588186+0000","last_peered":"2023-11-15T01:39:02.588186+0000","last_clean":"2023-11-15T01:39:02.588186+0000","last_became_active":"2023-11-15T01:39:02.212126+0000","last_became_peered":"2023-11-15T01:39:02.212126+0000","last_unstale":"2023-11-15T01:39:02.588186+0000","last_undegraded":"2023-11-15T01:39:02.588186+0000","last_fullsized":"2023-11-15T01:39:02.588186+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619501+0000","last_change":"2023-11-15T01:39:02.616063+0000","last_active":"2023-11-15T01:39:02.619501+0000","last_peered":"2023-11-15T01:39:02.619501+0000","last_clean":"2023-11-15T01:39:02.619501+0000","last_became_active":"2023-11-15T01:39:02.615758+0000","last_became_peered":"2023-11-15T01:39:02.615758+0000","last_unstale":"2023-11-15T01:39:02.619501+0000","last_undegraded":"2023-11-15T01:39:02.619501+0000","last_fullsized":"2023-11-15T01:39:02.619501+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.599254+0000","last_change":"2023-11-15T01:39:02.218897+0000","last_active":"2023-11-15T01:39:02.599254+0000","last_peered":"2023-11-15T01:39:02.599254+0000","last_clean":"2023-11-15T01:39:02.599254+0000","last_became_active":"2023-11-15T01:39:02.218572+0000","last_became_peered":"2023-11-15T01:39:02.218572+0000","last_unstale":"2023-11-15T01:39:02.599254+0000","last_undegraded":"2023-11-15T01:39:02.599254+0000","last_fullsized":"2023-11-15T01:39:02.599254+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613204+0000","last_change":"2023-11-15T01:39:02.604340+0000","last_active":"2023-11-15T01:39:02.613204+0000","last_peered":"2023-11-15T01:39:02.613204+0000","last_clean":"2023-11-15T01:39:02.613204+0000","last_became_active":"2023-11-15T01:39:02.604039+0000","last_became_peered":"2023-11-15T01:39:02.604039+0000","last_unstale":"2023-11-15T01:39:02.613204+0000","last_undegraded":"2023-11-15T01:39:02.613204+0000","last_fullsized":"2023-11-15T01:39:02.613204+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604468+0000","last_change":"2023-11-15T01:39:02.208432+0000","last_active":"2023-11-15T01:39:02.604468+0000","last_peered":"2023-11-15T01:39:02.604468+0000","last_clean":"2023-11-15T01:39:02.604468+0000","last_became_active":"2023-11-15T01:39:02.208125+0000","last_became_peered":"2023-11-15T01:39:02.208125+0000","last_unstale":"2023-11-15T01:39:02.604468+0000","last_undegraded":"2023-11-15T01:39:02.604468+0000","last_fullsized":"2023-11-15T01:39:02.604468+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619578+0000","last_change":"2023-11-15T01:39:02.615475+0000","last_active":"2023-11-15T01:39:02.619578+0000","last_peered":"2023-11-15T01:39:02.619578+0000","last_clean":"2023-11-15T01:39:02.619578+0000","last_became_active":"2023-11-15T01:39:02.615012+0000","last_became_peered":"2023-11-15T01:39:02.615012+0000","last_unstale":"2023-11-15T01:39:02.619578+0000","last_undegraded":"2023-11-15T01:39:02.619578+0000","last_fullsized":"2023-11-15T01:39:02.619578+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607240+0000","last_change":"2023-11-15T01:39:02.216489+0000","last_active":"2023-11-15T01:39:02.607240+0000","last_peered":"2023-11-15T01:39:02.607240+0000","last_clean":"2023-11-15T01:39:02.607240+0000","last_became_active":"2023-11-15T01:39:02.216208+0000","last_became_peered":"2023-11-15T01:39:02.216208+0000","last_unstale":"2023-11-15T01:39:02.607240+0000","last_undegraded":"2023-11-15T01:39:02.607240+0000","last_fullsized":"2023-11-15T01:39:02.607240+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619910+0000","last_change":"2023-11-15T01:39:02.614415+0000","last_active":"2023-11-15T01:39:02.619910+0000","last_peered":"2023-11-15T01:39:02.619910+0000","last_clean":"2023-11-15T01:39:02.619910+0000","last_became_active":"2023-11-15T01:39:02.614152+0000","last_became_peered":"2023-11-15T01:39:02.614152+0000","last_unstale":"2023-11-15T01:39:02.619910+0000","last_undegraded":"2023-11-15T01:39:02.619910+0000","last_fullsized":"2023-11-15T01:39:02.619910+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616182+0000","last_change":"2023-11-15T01:39:02.215445+0000","last_active":"2023-11-15T01:39:02.616182+0000","last_peered":"2023-11-15T01:39:02.616182+0000","last_clean":"2023-11-15T01:39:02.616182+0000","last_became_active":"2023-11-15T01:39:02.215164+0000","last_became_peered":"2023-11-15T01:39:02.215164+0000","last_unstale":"2023-11-15T01:39:02.616182+0000","last_undegraded":"2023-11-15T01:39:02.616182+0000","last_fullsized":"2023-11-15T01:39:02.616182+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617075+0000","last_change":"2023-11-15T01:39:02.612235+0000","last_active":"2023-11-15T01:39:02.617075+0000","last_peered":"2023-11-15T01:39:02.617075+0000","last_clean":"2023-11-15T01:39:02.617075+0000","last_became_active":"2023-11-15T01:39:02.611945+0000","last_became_peered":"2023-11-15T01:39:02.611945+0000","last_unstale":"2023-11-15T01:39:02.617075+0000","last_undegraded":"2023-11-15T01:39:02.617075+0000","last_fullsized":"2023-11-15T01:39:02.617075+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.600675+0000","last_change":"2023-11-15T01:39:02.212898+0000","last_active":"2023-11-15T01:39:02.600675+0000","last_peered":"2023-11-15T01:39:02.600675+0000","last_clean":"2023-11-15T01:39:02.600675+0000","last_became_active":"2023-11-15T01:39:02.211808+0000","last_became_peered":"2023-11-15T01:39:02.211808+0000","last_unstale":"2023-11-15T01:39:02.600675+0000","last_undegraded":"2023-11-15T01:39:02.600675+0000","last_fullsized":"2023-11-15T01:39:02.600675+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619471+0000","last_change":"2023-11-15T01:39:02.616010+0000","last_active":"2023-11-15T01:39:02.619471+0000","last_peered":"2023-11-15T01:39:02.619471+0000","last_clean":"2023-11-15T01:39:02.619471+0000","last_became_active":"2023-11-15T01:39:02.615676+0000","last_became_peered":"2023-11-15T01:39:02.615676+0000","last_unstale":"2023-11-15T01:39:02.619471+0000","last_undegraded":"2023-11-15T01:39:02.619471+0000","last_fullsized":"2023-11-15T01:39:02.619471+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587855+0000","last_change":"2023-11-15T01:39:02.215407+0000","last_active":"2023-11-15T01:39:02.587855+0000","last_peered":"2023-11-15T01:39:02.587855+0000","last_clean":"2023-11-15T01:39:02.587855+0000","last_became_active":"2023-11-15T01:39:02.214892+0000","last_became_peered":"2023-11-15T01:39:02.214892+0000","last_unstale":"2023-11-15T01:39:02.587855+0000","last_undegraded":"2023-11-15T01:39:02.587855+0000","last_fullsized":"2023-11-15T01:39:02.587855+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609760+0000","last_change":"2023-11-15T01:39:02.607451+0000","last_active":"2023-11-15T01:39:02.609760+0000","last_peered":"2023-11-15T01:39:02.609760+0000","last_clean":"2023-11-15T01:39:02.609760+0000","last_became_active":"2023-11-15T01:39:02.606494+0000","last_became_peered":"2023-11-15T01:39:02.606494+0000","last_unstale":"2023-11-15T01:39:02.609760+0000","last_undegraded":"2023-11-15T01:39:02.609760+0000","last_fullsized":"2023-11-15T01:39:02.609760+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.594989+0000","last_change":"2023-11-15T01:39:02.219867+0000","last_active":"2023-11-15T01:39:02.594989+0000","last_peered":"2023-11-15T01:39:02.594989+0000","last_clean":"2023-11-15T01:39:02.594989+0000","last_became_active":"2023-11-15T01:39:02.219549+0000","last_became_peered":"2023-11-15T01:39:02.219549+0000","last_unstale":"2023-11-15T01:39:02.594989+0000","last_undegraded":"2023-11-15T01:39:02.594989+0000","last_fullsized":"2023-11-15T01:39:02.594989+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615575+0000","last_change":"2023-11-15T01:39:02.614727+0000","last_active":"2023-11-15T01:39:02.615575+0000","last_peered":"2023-11-15T01:39:02.615575+0000","last_clean":"2023-11-15T01:39:02.615575+0000","last_became_active":"2023-11-15T01:39:02.614435+0000","last_became_peered":"2023-11-15T01:39:02.614435+0000","last_unstale":"2023-11-15T01:39:02.615575+0000","last_undegraded":"2023-11-15T01:39:02.615575+0000","last_fullsized":"2023-11-15T01:39:02.615575+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598319+0000","last_change":"2023-11-15T01:39:02.205172+0000","last_active":"2023-11-15T01:39:02.598319+0000","last_peered":"2023-11-15T01:39:02.598319+0000","last_clean":"2023-11-15T01:39:02.598319+0000","last_became_active":"2023-11-15T01:39:02.204880+0000","last_became_peered":"2023-11-15T01:39:02.204880+0000","last_unstale":"2023-11-15T01:39:02.598319+0000","last_undegraded":"2023-11-15T01:39:02.598319+0000","last_fullsized":"2023-11-15T01:39:02.598319+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.618919+0000","last_change":"2023-11-15T01:39:02.616562+0000","last_active":"2023-11-15T01:39:02.618919+0000","last_peered":"2023-11-15T01:39:02.618919+0000","last_clean":"2023-11-15T01:39:02.618919+0000","last_became_active":"2023-11-15T01:39:02.615953+0000","last_became_peered":"2023-11-15T01:39:02.615953+0000","last_unstale":"2023-11-15T01:39:02.618919+0000","last_undegraded":"2023-11-15T01:39:02.618919+0000","last_fullsized":"2023-11-15T01:39:02.618919+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.605080+0000","last_change":"2023-11-15T01:39:02.216519+0000","last_active":"2023-11-15T01:39:02.605080+0000","last_peered":"2023-11-15T01:39:02.605080+0000","last_clean":"2023-11-15T01:39:02.605080+0000","last_became_active":"2023-11-15T01:39:02.215863+0000","last_became_peered":"2023-11-15T01:39:02.215863+0000","last_unstale":"2023-11-15T01:39:02.605080+0000","last_undegraded":"2023-11-15T01:39:02.605080+0000","last_fullsized":"2023-11-15T01:39:02.605080+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617325+0000","last_change":"2023-11-15T01:39:02.616248+0000","last_active":"2023-11-15T01:39:02.617325+0000","last_peered":"2023-11-15T01:39:02.617325+0000","last_clean":"2023-11-15T01:39:02.617325+0000","last_became_active":"2023-11-15T01:39:02.615799+0000","last_became_peered":"2023-11-15T01:39:02.615799+0000","last_unstale":"2023-11-15T01:39:02.617325+0000","last_undegraded":"2023-11-15T01:39:02.617325+0000","last_fullsized":"2023-11-15T01:39:02.617325+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615681+0000","last_change":"2023-11-15T01:39:02.214198+0000","last_active":"2023-11-15T01:39:02.615681+0000","last_peered":"2023-11-15T01:39:02.615681+0000","last_clean":"2023-11-15T01:39:02.615681+0000","last_became_active":"2023-11-15T01:39:02.213807+0000","last_became_peered":"2023-11-15T01:39:02.213807+0000","last_unstale":"2023-11-15T01:39:02.615681+0000","last_undegraded":"2023-11-15T01:39:02.615681+0000","last_fullsized":"2023-11-15T01:39:02.615681+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608614+0000","last_change":"2023-11-15T01:39:02.603155+0000","last_active":"2023-11-15T01:39:02.608614+0000","last_peered":"2023-11-15T01:39:02.608614+0000","last_clean":"2023-11-15T01:39:02.608614+0000","last_became_active":"2023-11-15T01:39:02.602711+0000","last_became_peered":"2023-11-15T01:39:02.602711+0000","last_unstale":"2023-11-15T01:39:02.608614+0000","last_undegraded":"2023-11-15T01:39:02.608614+0000","last_fullsized":"2023-11-15T01:39:02.608614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604881+0000","last_change":"2023-11-15T01:39:02.216520+0000","last_active":"2023-11-15T01:39:02.604881+0000","last_peered":"2023-11-15T01:39:02.604881+0000","last_clean":"2023-11-15T01:39:02.604881+0000","last_became_active":"2023-11-15T01:39:02.216259+0000","last_became_peered":"2023-11-15T01:39:02.216259+0000","last_unstale":"2023-11-15T01:39:02.604881+0000","last_undegraded":"2023-11-15T01:39:02.604881+0000","last_fullsized":"2023-11-15T01:39:02.604881+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603577+0000","last_change":"2023-11-15T01:39:02.601591+0000","last_active":"2023-11-15T01:39:02.603577+0000","last_peered":"2023-11-15T01:39:02.603577+0000","last_clean":"2023-11-15T01:39:02.603577+0000","last_became_active":"2023-11-15T01:39:02.600935+0000","last_became_peered":"2023-11-15T01:39:02.600935+0000","last_unstale":"2023-11-15T01:39:02.603577+0000","last_undegraded":"2023-11-15T01:39:02.603577+0000","last_fullsized":"2023-11-15T01:39:02.603577+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593325+0000","last_change":"2023-11-15T01:39:02.208175+0000","last_active":"2023-11-15T01:39:02.593325+0000","last_peered":"2023-11-15T01:39:02.593325+0000","last_clean":"2023-11-15T01:39:02.593325+0000","last_became_active":"2023-11-15T01:39:02.206885+0000","last_became_peered":"2023-11-15T01:39:02.206885+0000","last_unstale":"2023-11-15T01:39:02.593325+0000","last_undegraded":"2023-11-15T01:39:02.593325+0000","last_fullsized":"2023-11-15T01:39:02.593325+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615601+0000","last_change":"2023-11-15T01:39:02.610080+0000","last_active":"2023-11-15T01:39:02.615601+0000","last_peered":"2023-11-15T01:39:02.615601+0000","last_clean":"2023-11-15T01:39:02.615601+0000","last_became_active":"2023-11-15T01:39:02.609739+0000","last_became_peered":"2023-11-15T01:39:02.609739+0000","last_unstale":"2023-11-15T01:39:02.615601+0000","last_undegraded":"2023-11-15T01:39:02.615601+0000","last_fullsized":"2023-11-15T01:39:02.615601+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.592262+0000","last_change":"2023-11-15T01:39:02.220136+0000","last_active":"2023-11-15T01:39:02.592262+0000","last_peered":"2023-11-15T01:39:02.592262+0000","last_clean":"2023-11-15T01:39:02.592262+0000","last_became_active":"2023-11-15T01:39:02.219849+0000","last_became_peered":"2023-11-15T01:39:02.219849+0000","last_unstale":"2023-11-15T01:39:02.592262+0000","last_undegraded":"2023-11-15T01:39:02.592262+0000","last_fullsized":"2023-11-15T01:39:02.592262+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617875+0000","last_change":"2023-11-15T01:39:02.617127+0000","last_active":"2023-11-15T01:39:02.617875+0000","last_peered":"2023-11-15T01:39:02.617875+0000","last_clean":"2023-11-15T01:39:02.617875+0000","last_became_active":"2023-11-15T01:39:02.616799+0000","last_became_peered":"2023-11-15T01:39:02.616799+0000","last_unstale":"2023-11-15T01:39:02.617875+0000","last_undegraded":"2023-11-15T01:39:02.617875+0000","last_fullsized":"2023-11-15T01:39:02.617875+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609923+0000","last_change":"2023-11-15T01:39:02.221702+0000","last_active":"2023-11-15T01:39:02.609923+0000","last_peered":"2023-11-15T01:39:02.609923+0000","last_clean":"2023-11-15T01:39:02.609923+0000","last_became_active":"2023-11-15T01:39:02.221488+0000","last_became_peered":"2023-11-15T01:39:02.221488+0000","last_unstale":"2023-11-15T01:39:02.609923+0000","last_undegraded":"2023-11-15T01:39:02.609923+0000","last_fullsized":"2023-11-15T01:39:02.609923+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619406+0000","last_change":"2023-11-15T01:39:02.615133+0000","last_active":"2023-11-15T01:39:02.619406+0000","last_peered":"2023-11-15T01:39:02.619406+0000","last_clean":"2023-11-15T01:39:02.619406+0000","last_became_active":"2023-11-15T01:39:02.614777+0000","last_became_peered":"2023-11-15T01:39:02.614777+0000","last_unstale":"2023-11-15T01:39:02.619406+0000","last_undegraded":"2023-11-15T01:39:02.619406+0000","last_fullsized":"2023-11-15T01:39:02.619406+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.589698+0000","last_change":"2023-11-15T01:39:02.218107+0000","last_active":"2023-11-15T01:39:02.589698+0000","last_peered":"2023-11-15T01:39:02.589698+0000","last_clean":"2023-11-15T01:39:02.589698+0000","last_became_active":"2023-11-15T01:39:02.217829+0000","last_became_peered":"2023-11-15T01:39:02.217829+0000","last_unstale":"2023-11-15T01:39:02.589698+0000","last_undegraded":"2023-11-15T01:39:02.589698+0000","last_fullsized":"2023-11-15T01:39:02.589698+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619811+0000","last_change":"2023-11-15T01:39:02.616657+0000","last_active":"2023-11-15T01:39:02.619811+0000","last_peered":"2023-11-15T01:39:02.619811+0000","last_clean":"2023-11-15T01:39:02.619811+0000","last_became_active":"2023-11-15T01:39:02.616181+0000","last_became_peered":"2023-11-15T01:39:02.616181+0000","last_unstale":"2023-11-15T01:39:02.619811+0000","last_undegraded":"2023-11-15T01:39:02.619811+0000","last_fullsized":"2023-11-15T01:39:02.619811+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.594904+0000","last_change":"2023-11-15T01:39:02.218103+0000","last_active":"2023-11-15T01:39:02.594904+0000","last_peered":"2023-11-15T01:39:02.594904+0000","last_clean":"2023-11-15T01:39:02.594904+0000","last_became_active":"2023-11-15T01:39:02.217828+0000","last_became_peered":"2023-11-15T01:39:02.217828+0000","last_unstale":"2023-11-15T01:39:02.594904+0000","last_undegraded":"2023-11-15T01:39:02.594904+0000","last_fullsized":"2023-11-15T01:39:02.594904+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613941+0000","last_change":"2023-11-15T01:39:02.610781+0000","last_active":"2023-11-15T01:39:02.613941+0000","last_peered":"2023-11-15T01:39:02.613941+0000","last_clean":"2023-11-15T01:39:02.613941+0000","last_became_active":"2023-11-15T01:39:02.610465+0000","last_became_peered":"2023-11-15T01:39:02.610465+0000","last_unstale":"2023-11-15T01:39:02.613941+0000","last_undegraded":"2023-11-15T01:39:02.613941+0000","last_fullsized":"2023-11-15T01:39:02.613941+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.605850+0000","last_change":"2023-11-15T01:39:02.207964+0000","last_active":"2023-11-15T01:39:02.605850+0000","last_peered":"2023-11-15T01:39:02.605850+0000","last_clean":"2023-11-15T01:39:02.605850+0000","last_became_active":"2023-11-15T01:39:02.206902+0000","last_became_peered":"2023-11-15T01:39:02.206902+0000","last_unstale":"2023-11-15T01:39:02.605850+0000","last_undegraded":"2023-11-15T01:39:02.605850+0000","last_fullsized":"2023-11-15T01:39:02.605850+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617013+0000","last_change":"2023-11-15T01:39:02.615878+0000","last_active":"2023-11-15T01:39:02.617013+0000","last_peered":"2023-11-15T01:39:02.617013+0000","last_clean":"2023-11-15T01:39:02.617013+0000","last_became_active":"2023-11-15T01:39:02.615584+0000","last_became_peered":"2023-11-15T01:39:02.615584+0000","last_unstale":"2023-11-15T01:39:02.617013+0000","last_undegraded":"2023-11-15T01:39:02.617013+0000","last_fullsized":"2023-11-15T01:39:02.617013+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.595065+0000","last_change":"2023-11-15T01:39:02.216952+0000","last_active":"2023-11-15T01:39:02.595065+0000","last_peered":"2023-11-15T01:39:02.595065+0000","last_clean":"2023-11-15T01:39:02.595065+0000","last_became_active":"2023-11-15T01:39:02.216649+0000","last_became_peered":"2023-11-15T01:39:02.216649+0000","last_unstale":"2023-11-15T01:39:02.595065+0000","last_undegraded":"2023-11-15T01:39:02.595065+0000","last_fullsized":"2023-11-15T01:39:02.595065+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608591+0000","last_change":"2023-11-15T01:39:02.602985+0000","last_active":"2023-11-15T01:39:02.608591+0000","last_peered":"2023-11-15T01:39:02.608591+0000","last_clean":"2023-11-15T01:39:02.608591+0000","last_became_active":"2023-11-15T01:39:02.602397+0000","last_became_peered":"2023-11-15T01:39:02.602397+0000","last_unstale":"2023-11-15T01:39:02.608591+0000","last_undegraded":"2023-11-15T01:39:02.608591+0000","last_fullsized":"2023-11-15T01:39:02.608591+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.602956+0000","last_change":"2023-11-15T01:39:02.206395+0000","last_active":"2023-11-15T01:39:02.602956+0000","last_peered":"2023-11-15T01:39:02.602956+0000","last_clean":"2023-11-15T01:39:02.602956+0000","last_became_active":"2023-11-15T01:39:02.206104+0000","last_became_peered":"2023-11-15T01:39:02.206104+0000","last_unstale":"2023-11-15T01:39:02.602956+0000","last_undegraded":"2023-11-15T01:39:02.602956+0000","last_fullsized":"2023-11-15T01:39:02.602956+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619975+0000","last_change":"2023-11-15T01:39:02.615104+0000","last_active":"2023-11-15T01:39:02.619975+0000","last_peered":"2023-11-15T01:39:02.619975+0000","last_clean":"2023-11-15T01:39:02.619975+0000","last_became_active":"2023-11-15T01:39:02.614137+0000","last_became_peered":"2023-11-15T01:39:02.614137+0000","last_unstale":"2023-11-15T01:39:02.619975+0000","last_undegraded":"2023-11-15T01:39:02.619975+0000","last_fullsized":"2023-11-15T01:39:02.619975+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587393+0000","last_change":"2023-11-15T01:39:02.211558+0000","last_active":"2023-11-15T01:39:02.587393+0000","last_peered":"2023-11-15T01:39:02.587393+0000","last_clean":"2023-11-15T01:39:02.587393+0000","last_became_active":"2023-11-15T01:39:02.211279+0000","last_became_peered":"2023-11-15T01:39:02.211279+0000","last_unstale":"2023-11-15T01:39:02.587393+0000","last_undegraded":"2023-11-15T01:39:02.587393+0000","last_fullsized":"2023-11-15T01:39:02.587393+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609748+0000","last_change":"2023-11-15T01:39:02.607093+0000","last_active":"2023-11-15T01:39:02.609748+0000","last_peered":"2023-11-15T01:39:02.609748+0000","last_clean":"2023-11-15T01:39:02.609748+0000","last_became_active":"2023-11-15T01:39:02.606809+0000","last_became_peered":"2023-11-15T01:39:02.606809+0000","last_unstale":"2023-11-15T01:39:02.609748+0000","last_undegraded":"2023-11-15T01:39:02.609748+0000","last_fullsized":"2023-11-15T01:39:02.609748+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587388+0000","last_change":"2023-11-15T01:39:02.211455+0000","last_active":"2023-11-15T01:39:02.587388+0000","last_peered":"2023-11-15T01:39:02.587388+0000","last_clean":"2023-11-15T01:39:02.587388+0000","last_became_active":"2023-11-15T01:39:02.211174+0000","last_became_peered":"2023-11-15T01:39:02.211174+0000","last_unstale":"2023-11-15T01:39:02.587388+0000","last_undegraded":"2023-11-15T01:39:02.587388+0000","last_fullsized":"2023-11-15T01:39:02.587388+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611523+0000","last_change":"2023-11-15T01:39:02.608672+0000","last_active":"2023-11-15T01:39:02.611523+0000","last_peered":"2023-11-15T01:39:02.611523+0000","last_clean":"2023-11-15T01:39:02.611523+0000","last_became_active":"2023-11-15T01:39:02.608345+0000","last_became_peered":"2023-11-15T01:39:02.608345+0000","last_unstale":"2023-11-15T01:39:02.611523+0000","last_undegraded":"2023-11-15T01:39:02.611523+0000","last_fullsized":"2023-11-15T01:39:02.611523+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.600509+0000","last_change":"2023-11-15T01:39:02.221210+0000","last_active":"2023-11-15T01:39:02.600509+0000","last_peered":"2023-11-15T01:39:02.600509+0000","last_clean":"2023-11-15T01:39:02.600509+0000","last_became_active":"2023-11-15T01:39:02.220954+0000","last_became_peered":"2023-11-15T01:39:02.220954+0000","last_unstale":"2023-11-15T01:39:02.600509+0000","last_undegraded":"2023-11-15T01:39:02.600509+0000","last_fullsized":"2023-11-15T01:39:02.600509+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616556+0000","last_change":"2023-11-15T01:39:02.613660+0000","last_active":"2023-11-15T01:39:02.616556+0000","last_peered":"2023-11-15T01:39:02.616556+0000","last_clean":"2023-11-15T01:39:02.616556+0000","last_became_active":"2023-11-15T01:39:02.613366+0000","last_became_peered":"2023-11-15T01:39:02.613366+0000","last_unstale":"2023-11-15T01:39:02.616556+0000","last_undegraded":"2023-11-15T01:39:02.616556+0000","last_fullsized":"2023-11-15T01:39:02.616556+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598361+0000","last_change":"2023-11-15T01:39:02.215823+0000","last_active":"2023-11-15T01:39:02.598361+0000","last_peered":"2023-11-15T01:39:02.598361+0000","last_clean":"2023-11-15T01:39:02.598361+0000","last_became_active":"2023-11-15T01:39:02.215525+0000","last_became_peered":"2023-11-15T01:39:02.215525+0000","last_unstale":"2023-11-15T01:39:02.598361+0000","last_undegraded":"2023-11-15T01:39:02.598361+0000","last_fullsized":"2023-11-15T01:39:02.598361+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.614005+0000","last_change":"2023-11-15T01:39:02.609396+0000","last_active":"2023-11-15T01:39:02.614005+0000","last_peered":"2023-11-15T01:39:02.614005+0000","last_clean":"2023-11-15T01:39:02.614005+0000","last_became_active":"2023-11-15T01:39:02.609124+0000","last_became_peered":"2023-11-15T01:39:02.609124+0000","last_unstale":"2023-11-15T01:39:02.614005+0000","last_undegraded":"2023-11-15T01:39:02.614005+0000","last_fullsized":"2023-11-15T01:39:02.614005+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588286+0000","last_change":"2023-11-15T01:39:02.216539+0000","last_active":"2023-11-15T01:39:02.588286+0000","last_peered":"2023-11-15T01:39:02.588286+0000","last_clean":"2023-11-15T01:39:02.588286+0000","last_became_active":"2023-11-15T01:39:02.216251+0000","last_became_peered":"2023-11-15T01:39:02.216251+0000","last_unstale":"2023-11-15T01:39:02.588286+0000","last_undegraded":"2023-11-15T01:39:02.588286+0000","last_fullsized":"2023-11-15T01:39:02.588286+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.614176+0000","last_change":"2023-11-15T01:39:02.610179+0000","last_active":"2023-11-15T01:39:02.614176+0000","last_peered":"2023-11-15T01:39:02.614176+0000","last_clean":"2023-11-15T01:39:02.614176+0000","last_became_active":"2023-11-15T01:39:02.609897+0000","last_became_peered":"2023-11-15T01:39:02.609897+0000","last_unstale":"2023-11-15T01:39:02.614176+0000","last_undegraded":"2023-11-15T01:39:02.614176+0000","last_fullsized":"2023-11-15T01:39:02.614176+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604810+0000","last_change":"2023-11-15T01:39:02.216694+0000","last_active":"2023-11-15T01:39:02.604810+0000","last_peered":"2023-11-15T01:39:02.604810+0000","last_clean":"2023-11-15T01:39:02.604810+0000","last_became_active":"2023-11-15T01:39:02.216225+0000","last_became_peered":"2023-11-15T01:39:02.216225+0000","last_unstale":"2023-11-15T01:39:02.604810+0000","last_undegraded":"2023-11-15T01:39:02.604810+0000","last_fullsized":"2023-11-15T01:39:02.604810+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609871+0000","last_change":"2023-11-15T01:39:02.608291+0000","last_active":"2023-11-15T01:39:02.609871+0000","last_peered":"2023-11-15T01:39:02.609871+0000","last_clean":"2023-11-15T01:39:02.609871+0000","last_became_active":"2023-11-15T01:39:02.608031+0000","last_became_peered":"2023-11-15T01:39:02.608031+0000","last_unstale":"2023-11-15T01:39:02.609871+0000","last_undegraded":"2023-11-15T01:39:02.609871+0000","last_fullsized":"2023-11-15T01:39:02.609871+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597800+0000","last_change":"2023-11-15T01:39:02.216727+0000","last_active":"2023-11-15T01:39:02.597800+0000","last_peered":"2023-11-15T01:39:02.597800+0000","last_clean":"2023-11-15T01:39:02.597800+0000","last_became_active":"2023-11-15T01:39:02.216418+0000","last_became_peered":"2023-11-15T01:39:02.216418+0000","last_unstale":"2023-11-15T01:39:02.597800+0000","last_undegraded":"2023-11-15T01:39:02.597800+0000","last_fullsized":"2023-11-15T01:39:02.597800+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609371+0000","last_change":"2023-11-15T01:39:02.607331+0000","last_active":"2023-11-15T01:39:02.609371+0000","last_peered":"2023-11-15T01:39:02.609371+0000","last_clean":"2023-11-15T01:39:02.609371+0000","last_became_active":"2023-11-15T01:39:02.605984+0000","last_became_peered":"2023-11-15T01:39:02.605984+0000","last_unstale":"2023-11-15T01:39:02.609371+0000","last_undegraded":"2023-11-15T01:39:02.609371+0000","last_fullsized":"2023-11-15T01:39:02.609371+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587486+0000","last_change":"2023-11-15T01:39:02.221244+0000","last_active":"2023-11-15T01:39:02.587486+0000","last_peered":"2023-11-15T01:39:02.587486+0000","last_clean":"2023-11-15T01:39:02.587486+0000","last_became_active":"2023-11-15T01:39:02.220925+0000","last_became_peered":"2023-11-15T01:39:02.220925+0000","last_unstale":"2023-11-15T01:39:02.587486+0000","last_undegraded":"2023-11-15T01:39:02.587486+0000","last_fullsized":"2023-11-15T01:39:02.587486+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617865+0000","last_change":"2023-11-15T01:39:02.617229+0000","last_active":"2023-11-15T01:39:02.617865+0000","last_peered":"2023-11-15T01:39:02.617865+0000","last_clean":"2023-11-15T01:39:02.617865+0000","last_became_active":"2023-11-15T01:39:02.616939+0000","last_became_peered":"2023-11-15T01:39:02.616939+0000","last_unstale":"2023-11-15T01:39:02.617865+0000","last_undegraded":"2023-11-15T01:39:02.617865+0000","last_fullsized":"2023-11-15T01:39:02.617865+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593426+0000","last_change":"2023-11-15T01:39:02.221666+0000","last_active":"2023-11-15T01:39:02.593426+0000","last_peered":"2023-11-15T01:39:02.593426+0000","last_clean":"2023-11-15T01:39:02.593426+0000","last_became_active":"2023-11-15T01:39:02.219800+0000","last_became_peered":"2023-11-15T01:39:02.219800+0000","last_unstale":"2023-11-15T01:39:02.593426+0000","last_undegraded":"2023-11-15T01:39:02.593426+0000","last_fullsized":"2023-11-15T01:39:02.593426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604011+0000","last_change":"2023-11-15T01:39:02.602358+0000","last_active":"2023-11-15T01:39:02.604011+0000","last_peered":"2023-11-15T01:39:02.604011+0000","last_clean":"2023-11-15T01:39:02.604011+0000","last_became_active":"2023-11-15T01:39:02.601545+0000","last_became_peered":"2023-11-15T01:39:02.601545+0000","last_unstale":"2023-11-15T01:39:02.604011+0000","last_undegraded":"2023-11-15T01:39:02.604011+0000","last_fullsized":"2023-11-15T01:39:02.604011+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.592380+0000","last_change":"2023-11-15T01:39:02.216213+0000","last_active":"2023-11-15T01:39:02.592380+0000","last_peered":"2023-11-15T01:39:02.592380+0000","last_clean":"2023-11-15T01:39:02.592380+0000","last_became_active":"2023-11-15T01:39:02.215899+0000","last_became_peered":"2023-11-15T01:39:02.215899+0000","last_unstale":"2023-11-15T01:39:02.592380+0000","last_undegraded":"2023-11-15T01:39:02.592380+0000","last_fullsized":"2023-11-15T01:39:02.592380+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608705+0000","last_change":"2023-11-15T01:39:02.604261+0000","last_active":"2023-11-15T01:39:02.608705+0000","last_peered":"2023-11-15T01:39:02.608705+0000","last_clean":"2023-11-15T01:39:02.608705+0000","last_became_active":"2023-11-15T01:39:02.603967+0000","last_became_peered":"2023-11-15T01:39:02.603967+0000","last_unstale":"2023-11-15T01:39:02.608705+0000","last_undegraded":"2023-11-15T01:39:02.608705+0000","last_fullsized":"2023-11-15T01:39:02.608705+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.600917+0000","last_change":"2023-11-15T01:39:02.212132+0000","last_active":"2023-11-15T01:39:02.600917+0000","last_peered":"2023-11-15T01:39:02.600917+0000","last_clean":"2023-11-15T01:39:02.600917+0000","last_became_active":"2023-11-15T01:39:02.210392+0000","last_became_peered":"2023-11-15T01:39:02.210392+0000","last_unstale":"2023-11-15T01:39:02.600917+0000","last_undegraded":"2023-11-15T01:39:02.600917+0000","last_fullsized":"2023-11-15T01:39:02.600917+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603584+0000","last_change":"2023-11-15T01:39:02.600884+0000","last_active":"2023-11-15T01:39:02.603584+0000","last_peered":"2023-11-15T01:39:02.603584+0000","last_clean":"2023-11-15T01:39:02.603584+0000","last_became_active":"2023-11-15T01:39:02.600570+0000","last_became_peered":"2023-11-15T01:39:02.600570+0000","last_unstale":"2023-11-15T01:39:02.603584+0000","last_undegraded":"2023-11-15T01:39:02.603584+0000","last_fullsized":"2023-11-15T01:39:02.603584+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604360+0000","last_change":"2023-11-15T01:39:02.216713+0000","last_active":"2023-11-15T01:39:02.604360+0000","last_peered":"2023-11-15T01:39:02.604360+0000","last_clean":"2023-11-15T01:39:02.604360+0000","last_became_active":"2023-11-15T01:39:02.216444+0000","last_became_peered":"2023-11-15T01:39:02.216444+0000","last_unstale":"2023-11-15T01:39:02.604360+0000","last_undegraded":"2023-11-15T01:39:02.604360+0000","last_fullsized":"2023-11-15T01:39:02.604360+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615377+0000","last_change":"2023-11-15T01:39:02.613239+0000","last_active":"2023-11-15T01:39:02.615377+0000","last_peered":"2023-11-15T01:39:02.615377+0000","last_clean":"2023-11-15T01:39:02.615377+0000","last_became_active":"2023-11-15T01:39:02.612946+0000","last_became_peered":"2023-11-15T01:39:02.612946+0000","last_unstale":"2023-11-15T01:39:02.615377+0000","last_undegraded":"2023-11-15T01:39:02.615377+0000","last_fullsized":"2023-11-15T01:39:02.615377+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.596143+0000","last_change":"2023-11-15T01:39:02.209925+0000","last_active":"2023-11-15T01:39:02.596143+0000","last_peered":"2023-11-15T01:39:02.596143+0000","last_clean":"2023-11-15T01:39:02.596143+0000","last_became_active":"2023-11-15T01:39:02.209663+0000","last_became_peered":"2023-11-15T01:39:02.209663+0000","last_unstale":"2023-11-15T01:39:02.596143+0000","last_undegraded":"2023-11-15T01:39:02.596143+0000","last_fullsized":"2023-11-15T01:39:02.596143+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609247+0000","last_change":"2023-11-15T01:39:02.608245+0000","last_active":"2023-11-15T01:39:02.609247+0000","last_peered":"2023-11-15T01:39:02.609247+0000","last_clean":"2023-11-15T01:39:02.609247+0000","last_became_active":"2023-11-15T01:39:02.607952+0000","last_became_peered":"2023-11-15T01:39:02.607952+0000","last_unstale":"2023-11-15T01:39:02.609247+0000","last_undegraded":"2023-11-15T01:39:02.609247+0000","last_fullsized":"2023-11-15T01:39:02.609247+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607666+0000","last_change":"2023-11-15T01:39:02.212445+0000","last_active":"2023-11-15T01:39:02.607666+0000","last_peered":"2023-11-15T01:39:02.607666+0000","last_clean":"2023-11-15T01:39:02.607666+0000","last_became_active":"2023-11-15T01:39:02.212161+0000","last_became_peered":"2023-11-15T01:39:02.212161+0000","last_unstale":"2023-11-15T01:39:02.607666+0000","last_undegraded":"2023-11-15T01:39:02.607666+0000","last_fullsized":"2023-11-15T01:39:02.607666+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.620038+0000","last_change":"2023-11-15T01:39:02.615695+0000","last_active":"2023-11-15T01:39:02.620038+0000","last_peered":"2023-11-15T01:39:02.620038+0000","last_clean":"2023-11-15T01:39:02.620038+0000","last_became_active":"2023-11-15T01:39:02.615400+0000","last_became_peered":"2023-11-15T01:39:02.615400+0000","last_unstale":"2023-11-15T01:39:02.620038+0000","last_undegraded":"2023-11-15T01:39:02.620038+0000","last_fullsized":"2023-11-15T01:39:02.620038+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.601003+0000","last_change":"2023-11-15T01:39:02.212296+0000","last_active":"2023-11-15T01:39:02.601003+0000","last_peered":"2023-11-15T01:39:02.601003+0000","last_clean":"2023-11-15T01:39:02.601003+0000","last_became_active":"2023-11-15T01:39:02.211995+0000","last_became_peered":"2023-11-15T01:39:02.211995+0000","last_unstale":"2023-11-15T01:39:02.601003+0000","last_undegraded":"2023-11-15T01:39:02.601003+0000","last_fullsized":"2023-11-15T01:39:02.601003+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609392+0000","last_change":"2023-11-15T01:39:02.607853+0000","last_active":"2023-11-15T01:39:02.609392+0000","last_peered":"2023-11-15T01:39:02.609392+0000","last_clean":"2023-11-15T01:39:02.609392+0000","last_became_active":"2023-11-15T01:39:02.607594+0000","last_became_peered":"2023-11-15T01:39:02.607594+0000","last_unstale":"2023-11-15T01:39:02.609392+0000","last_undegraded":"2023-11-15T01:39:02.609392+0000","last_fullsized":"2023-11-15T01:39:02.609392+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604067+0000","last_change":"2023-11-15T01:39:02.213094+0000","last_active":"2023-11-15T01:39:02.604067+0000","last_peered":"2023-11-15T01:39:02.604067+0000","last_clean":"2023-11-15T01:39:02.604067+0000","last_became_active":"2023-11-15T01:39:02.212785+0000","last_became_peered":"2023-11-15T01:39:02.212785+0000","last_unstale":"2023-11-15T01:39:02.604067+0000","last_undegraded":"2023-11-15T01:39:02.604067+0000","last_fullsized":"2023-11-15T01:39:02.604067+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603556+0000","last_change":"2023-11-15T01:39:02.601396+0000","last_active":"2023-11-15T01:39:02.603556+0000","last_peered":"2023-11-15T01:39:02.603556+0000","last_clean":"2023-11-15T01:39:02.603556+0000","last_became_active":"2023-11-15T01:39:02.601172+0000","last_became_peered":"2023-11-15T01:39:02.601172+0000","last_unstale":"2023-11-15T01:39:02.603556+0000","last_undegraded":"2023-11-15T01:39:02.603556+0000","last_fullsized":"2023-11-15T01:39:02.603556+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606548+0000","last_change":"2023-11-15T01:39:02.214549+0000","last_active":"2023-11-15T01:39:02.606548+0000","last_peered":"2023-11-15T01:39:02.606548+0000","last_clean":"2023-11-15T01:39:02.606548+0000","last_became_active":"2023-11-15T01:39:02.214264+0000","last_became_peered":"2023-11-15T01:39:02.214264+0000","last_unstale":"2023-11-15T01:39:02.606548+0000","last_undegraded":"2023-11-15T01:39:02.606548+0000","last_fullsized":"2023-11-15T01:39:02.606548+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619529+0000","last_change":"2023-11-15T01:39:02.614609+0000","last_active":"2023-11-15T01:39:02.619529+0000","last_peered":"2023-11-15T01:39:02.619529+0000","last_clean":"2023-11-15T01:39:02.619529+0000","last_became_active":"2023-11-15T01:39:02.614307+0000","last_became_peered":"2023-11-15T01:39:02.614307+0000","last_unstale":"2023-11-15T01:39:02.619529+0000","last_undegraded":"2023-11-15T01:39:02.619529+0000","last_fullsized":"2023-11-15T01:39:02.619529+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593584+0000","last_change":"2023-11-15T01:39:02.213334+0000","last_active":"2023-11-15T01:39:02.593584+0000","last_peered":"2023-11-15T01:39:02.593584+0000","last_clean":"2023-11-15T01:39:02.593584+0000","last_became_active":"2023-11-15T01:39:02.212950+0000","last_became_peered":"2023-11-15T01:39:02.212950+0000","last_unstale":"2023-11-15T01:39:02.593584+0000","last_undegraded":"2023-11-15T01:39:02.593584+0000","last_fullsized":"2023-11-15T01:39:02.593584+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607206+0000","last_change":"2023-11-15T01:39:02.605916+0000","last_active":"2023-11-15T01:39:02.607206+0000","last_peered":"2023-11-15T01:39:02.607206+0000","last_clean":"2023-11-15T01:39:02.607206+0000","last_became_active":"2023-11-15T01:39:02.605221+0000","last_became_peered":"2023-11-15T01:39:02.605221+0000","last_unstale":"2023-11-15T01:39:02.607206+0000","last_undegraded":"2023-11-15T01:39:02.607206+0000","last_fullsized":"2023-11-15T01:39:02.607206+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.592684+0000","last_change":"2023-11-15T01:39:02.214571+0000","last_active":"2023-11-15T01:39:02.592684+0000","last_peered":"2023-11-15T01:39:02.592684+0000","last_clean":"2023-11-15T01:39:02.592684+0000","last_became_active":"2023-11-15T01:39:02.214277+0000","last_became_peered":"2023-11-15T01:39:02.214277+0000","last_unstale":"2023-11-15T01:39:02.592684+0000","last_undegraded":"2023-11-15T01:39:02.592684+0000","last_fullsized":"2023-11-15T01:39:02.592684+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606587+0000","last_change":"2023-11-15T01:39:02.602418+0000","last_active":"2023-11-15T01:39:02.606587+0000","last_peered":"2023-11-15T01:39:02.606587+0000","last_clean":"2023-11-15T01:39:02.606587+0000","last_became_active":"2023-11-15T01:39:02.602063+0000","last_became_peered":"2023-11-15T01:39:02.602063+0000","last_unstale":"2023-11-15T01:39:02.606587+0000","last_undegraded":"2023-11-15T01:39:02.606587+0000","last_fullsized":"2023-11-15T01:39:02.606587+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.595019+0000","last_change":"2023-11-15T01:39:02.212659+0000","last_active":"2023-11-15T01:39:02.595019+0000","last_peered":"2023-11-15T01:39:02.595019+0000","last_clean":"2023-11-15T01:39:02.595019+0000","last_became_active":"2023-11-15T01:39:02.212415+0000","last_became_peered":"2023-11-15T01:39:02.212415+0000","last_unstale":"2023-11-15T01:39:02.595019+0000","last_undegraded":"2023-11-15T01:39:02.595019+0000","last_fullsized":"2023-11-15T01:39:02.595019+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.618320+0000","last_change":"2023-11-15T01:39:02.614637+0000","last_active":"2023-11-15T01:39:02.618320+0000","last_peered":"2023-11-15T01:39:02.618320+0000","last_clean":"2023-11-15T01:39:02.618320+0000","last_became_active":"2023-11-15T01:39:02.614343+0000","last_became_peered":"2023-11-15T01:39:02.614343+0000","last_unstale":"2023-11-15T01:39:02.618320+0000","last_undegraded":"2023-11-15T01:39:02.618320+0000","last_fullsized":"2023-11-15T01:39:02.618320+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588382+0000","last_change":"2023-11-15T01:39:02.216949+0000","last_active":"2023-11-15T01:39:02.588382+0000","last_peered":"2023-11-15T01:39:02.588382+0000","last_clean":"2023-11-15T01:39:02.588382+0000","last_became_active":"2023-11-15T01:39:02.216678+0000","last_became_peered":"2023-11-15T01:39:02.216678+0000","last_unstale":"2023-11-15T01:39:02.588382+0000","last_undegraded":"2023-11-15T01:39:02.588382+0000","last_fullsized":"2023-11-15T01:39:02.588382+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615337+0000","last_change":"2023-11-15T01:39:02.613451+0000","last_active":"2023-11-15T01:39:02.615337+0000","last_peered":"2023-11-15T01:39:02.615337+0000","last_clean":"2023-11-15T01:39:02.615337+0000","last_became_active":"2023-11-15T01:39:02.613039+0000","last_became_peered":"2023-11-15T01:39:02.613039+0000","last_unstale":"2023-11-15T01:39:02.615337+0000","last_undegraded":"2023-11-15T01:39:02.615337+0000","last_fullsized":"2023-11-15T01:39:02.615337+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611662+0000","last_change":"2023-11-15T01:39:02.221508+0000","last_active":"2023-11-15T01:39:02.611662+0000","last_peered":"2023-11-15T01:39:02.611662+0000","last_clean":"2023-11-15T01:39:02.611662+0000","last_became_active":"2023-11-15T01:39:02.221203+0000","last_became_peered":"2023-11-15T01:39:02.221203+0000","last_unstale":"2023-11-15T01:39:02.611662+0000","last_undegraded":"2023-11-15T01:39:02.611662+0000","last_fullsized":"2023-11-15T01:39:02.611662+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617294+0000","last_change":"2023-11-15T01:39:02.614533+0000","last_active":"2023-11-15T01:39:02.617294+0000","last_peered":"2023-11-15T01:39:02.617294+0000","last_clean":"2023-11-15T01:39:02.617294+0000","last_became_active":"2023-11-15T01:39:02.614181+0000","last_became_peered":"2023-11-15T01:39:02.614181+0000","last_unstale":"2023-11-15T01:39:02.617294+0000","last_undegraded":"2023-11-15T01:39:02.617294+0000","last_fullsized":"2023-11-15T01:39:02.617294+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611758+0000","last_change":"2023-11-15T01:39:02.215496+0000","last_active":"2023-11-15T01:39:02.611758+0000","last_peered":"2023-11-15T01:39:02.611758+0000","last_clean":"2023-11-15T01:39:02.611758+0000","last_became_active":"2023-11-15T01:39:02.215218+0000","last_became_peered":"2023-11-15T01:39:02.215218+0000","last_unstale":"2023-11-15T01:39:02.611758+0000","last_undegraded":"2023-11-15T01:39:02.611758+0000","last_fullsized":"2023-11-15T01:39:02.611758+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619900+0000","last_change":"2023-11-15T01:39:02.614359+0000","last_active":"2023-11-15T01:39:02.619900+0000","last_peered":"2023-11-15T01:39:02.619900+0000","last_clean":"2023-11-15T01:39:02.619900+0000","last_became_active":"2023-11-15T01:39:02.614072+0000","last_became_peered":"2023-11-15T01:39:02.614072+0000","last_unstale":"2023-11-15T01:39:02.619900+0000","last_undegraded":"2023-11-15T01:39:02.619900+0000","last_fullsized":"2023-11-15T01:39:02.619900+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613955+0000","last_change":"2023-11-15T01:39:02.218556+0000","last_active":"2023-11-15T01:39:02.613955+0000","last_peered":"2023-11-15T01:39:02.613955+0000","last_clean":"2023-11-15T01:39:02.613955+0000","last_became_active":"2023-11-15T01:39:02.218223+0000","last_became_peered":"2023-11-15T01:39:02.218223+0000","last_unstale":"2023-11-15T01:39:02.613955+0000","last_undegraded":"2023-11-15T01:39:02.613955+0000","last_fullsized":"2023-11-15T01:39:02.613955+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611507+0000","last_change":"2023-11-15T01:39:02.607095+0000","last_active":"2023-11-15T01:39:02.611507+0000","last_peered":"2023-11-15T01:39:02.611507+0000","last_clean":"2023-11-15T01:39:02.611507+0000","last_became_active":"2023-11-15T01:39:02.606862+0000","last_became_peered":"2023-11-15T01:39:02.606862+0000","last_unstale":"2023-11-15T01:39:02.611507+0000","last_undegraded":"2023-11-15T01:39:02.611507+0000","last_fullsized":"2023-11-15T01:39:02.611507+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.591994+0000","last_change":"2023-11-15T01:39:02.208100+0000","last_active":"2023-11-15T01:39:02.591994+0000","last_peered":"2023-11-15T01:39:02.591994+0000","last_clean":"2023-11-15T01:39:02.591994+0000","last_became_active":"2023-11-15T01:39:02.207787+0000","last_became_peered":"2023-11-15T01:39:02.207787+0000","last_unstale":"2023-11-15T01:39:02.591994+0000","last_undegraded":"2023-11-15T01:39:02.591994+0000","last_fullsized":"2023-11-15T01:39:02.591994+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.612658+0000","last_change":"2023-11-15T01:39:02.603012+0000","last_active":"2023-11-15T01:39:02.612658+0000","last_peered":"2023-11-15T01:39:02.612658+0000","last_clean":"2023-11-15T01:39:02.612658+0000","last_became_active":"2023-11-15T01:39:02.602782+0000","last_became_peered":"2023-11-15T01:39:02.602782+0000","last_unstale":"2023-11-15T01:39:02.612658+0000","last_undegraded":"2023-11-15T01:39:02.612658+0000","last_fullsized":"2023-11-15T01:39:02.612658+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593111+0000","last_change":"2023-11-15T01:39:02.211688+0000","last_active":"2023-11-15T01:39:02.593111+0000","last_peered":"2023-11-15T01:39:02.593111+0000","last_clean":"2023-11-15T01:39:02.593111+0000","last_became_active":"2023-11-15T01:39:02.211393+0000","last_became_peered":"2023-11-15T01:39:02.211393+0000","last_unstale":"2023-11-15T01:39:02.593111+0000","last_undegraded":"2023-11-15T01:39:02.593111+0000","last_fullsized":"2023-11-15T01:39:02.593111+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616897+0000","last_change":"2023-11-15T01:39:02.614804+0000","last_active":"2023-11-15T01:39:02.616897+0000","last_peered":"2023-11-15T01:39:02.616897+0000","last_clean":"2023-11-15T01:39:02.616897+0000","last_became_active":"2023-11-15T01:39:02.614516+0000","last_became_peered":"2023-11-15T01:39:02.614516+0000","last_unstale":"2023-11-15T01:39:02.616897+0000","last_undegraded":"2023-11-15T01:39:02.616897+0000","last_fullsized":"2023-11-15T01:39:02.616897+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607913+0000","last_change":"2023-11-15T01:39:02.212073+0000","last_active":"2023-11-15T01:39:02.607913+0000","last_peered":"2023-11-15T01:39:02.607913+0000","last_clean":"2023-11-15T01:39:02.607913+0000","last_became_active":"2023-11-15T01:39:02.211789+0000","last_became_peered":"2023-11-15T01:39:02.211789+0000","last_unstale":"2023-11-15T01:39:02.607913+0000","last_undegraded":"2023-11-15T01:39:02.607913+0000","last_fullsized":"2023-11-15T01:39:02.607913+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.599449+0000","last_change":"2023-11-15T01:39:02.597319+0000","last_active":"2023-11-15T01:39:02.599449+0000","last_peered":"2023-11-15T01:39:02.599449+0000","last_clean":"2023-11-15T01:39:02.599449+0000","last_became_active":"2023-11-15T01:39:02.597051+0000","last_became_peered":"2023-11-15T01:39:02.597051+0000","last_unstale":"2023-11-15T01:39:02.599449+0000","last_undegraded":"2023-11-15T01:39:02.599449+0000","last_fullsized":"2023-11-15T01:39:02.599449+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.614112+0000","last_change":"2023-11-15T01:39:02.213626+0000","last_active":"2023-11-15T01:39:02.614112+0000","last_peered":"2023-11-15T01:39:02.614112+0000","last_clean":"2023-11-15T01:39:02.614112+0000","last_became_active":"2023-11-15T01:39:02.213021+0000","last_became_peered":"2023-11-15T01:39:02.213021+0000","last_unstale":"2023-11-15T01:39:02.614112+0000","last_undegraded":"2023-11-15T01:39:02.614112+0000","last_fullsized":"2023-11-15T01:39:02.614112+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604865+0000","last_change":"2023-11-15T01:39:02.598955+0000","last_active":"2023-11-15T01:39:02.604865+0000","last_peered":"2023-11-15T01:39:02.604865+0000","last_clean":"2023-11-15T01:39:02.604865+0000","last_became_active":"2023-11-15T01:39:02.598657+0000","last_became_peered":"2023-11-15T01:39:02.598657+0000","last_unstale":"2023-11-15T01:39:02.604865+0000","last_undegraded":"2023-11-15T01:39:02.604865+0000","last_fullsized":"2023-11-15T01:39:02.604865+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588486+0000","last_change":"2023-11-15T01:39:02.212406+0000","last_active":"2023-11-15T01:39:02.588486+0000","last_peered":"2023-11-15T01:39:02.588486+0000","last_clean":"2023-11-15T01:39:02.588486+0000","last_became_active":"2023-11-15T01:39:02.212116+0000","last_became_peered":"2023-11-15T01:39:02.212116+0000","last_unstale":"2023-11-15T01:39:02.588486+0000","last_undegraded":"2023-11-15T01:39:02.588486+0000","last_fullsized":"2023-11-15T01:39:02.588486+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606629+0000","last_change":"2023-11-15T01:39:02.605182+0000","last_active":"2023-11-15T01:39:02.606629+0000","last_peered":"2023-11-15T01:39:02.606629+0000","last_clean":"2023-11-15T01:39:02.606629+0000","last_became_active":"2023-11-15T01:39:02.604892+0000","last_became_peered":"2023-11-15T01:39:02.604892+0000","last_unstale":"2023-11-15T01:39:02.606629+0000","last_undegraded":"2023-11-15T01:39:02.606629+0000","last_fullsized":"2023-11-15T01:39:02.606629+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597149+0000","last_change":"2023-11-15T01:39:02.210712+0000","last_active":"2023-11-15T01:39:02.597149+0000","last_peered":"2023-11-15T01:39:02.597149+0000","last_clean":"2023-11-15T01:39:02.597149+0000","last_became_active":"2023-11-15T01:39:02.210222+0000","last_became_peered":"2023-11-15T01:39:02.210222+0000","last_unstale":"2023-11-15T01:39:02.597149+0000","last_undegraded":"2023-11-15T01:39:02.597149+0000","last_fullsized":"2023-11-15T01:39:02.597149+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.620052+0000","last_change":"2023-11-15T01:39:02.615816+0000","last_active":"2023-11-15T01:39:02.620052+0000","last_peered":"2023-11-15T01:39:02.620052+0000","last_clean":"2023-11-15T01:39:02.620052+0000","last_became_active":"2023-11-15T01:39:02.615495+0000","last_became_peered":"2023-11-15T01:39:02.615495+0000","last_unstale":"2023-11-15T01:39:02.620052+0000","last_undegraded":"2023-11-15T01:39:02.620052+0000","last_fullsized":"2023-11-15T01:39:02.620052+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.601085+0000","last_change":"2023-11-15T01:39:02.213634+0000","last_active":"2023-11-15T01:39:02.601085+0000","last_peered":"2023-11-15T01:39:02.601085+0000","last_clean":"2023-11-15T01:39:02.601085+0000","last_became_active":"2023-11-15T01:39:02.213348+0000","last_became_peered":"2023-11-15T01:39:02.213348+0000","last_unstale":"2023-11-15T01:39:02.601085+0000","last_undegraded":"2023-11-15T01:39:02.601085+0000","last_fullsized":"2023-11-15T01:39:02.601085+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615584+0000","last_change":"2023-11-15T01:39:02.613224+0000","last_active":"2023-11-15T01:39:02.615584+0000","last_peered":"2023-11-15T01:39:02.615584+0000","last_clean":"2023-11-15T01:39:02.615584+0000","last_became_active":"2023-11-15T01:39:02.612879+0000","last_became_peered":"2023-11-15T01:39:02.612879+0000","last_unstale":"2023-11-15T01:39:02.615584+0000","last_undegraded":"2023-11-15T01:39:02.615584+0000","last_fullsized":"2023-11-15T01:39:02.615584+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.594724+0000","last_change":"2023-11-15T01:39:02.212971+0000","last_active":"2023-11-15T01:39:02.594724+0000","last_peered":"2023-11-15T01:39:02.594724+0000","last_clean":"2023-11-15T01:39:02.594724+0000","last_became_active":"2023-11-15T01:39:02.212667+0000","last_became_peered":"2023-11-15T01:39:02.212667+0000","last_unstale":"2023-11-15T01:39:02.594724+0000","last_undegraded":"2023-11-15T01:39:02.594724+0000","last_fullsized":"2023-11-15T01:39:02.594724+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615238+0000","last_change":"2023-11-15T01:39:02.613211+0000","last_active":"2023-11-15T01:39:02.615238+0000","last_peered":"2023-11-15T01:39:02.615238+0000","last_clean":"2023-11-15T01:39:02.615238+0000","last_became_active":"2023-11-15T01:39:02.612908+0000","last_became_peered":"2023-11-15T01:39:02.612908+0000","last_unstale":"2023-11-15T01:39:02.615238+0000","last_undegraded":"2023-11-15T01:39:02.615238+0000","last_fullsized":"2023-11-15T01:39:02.615238+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593625+0000","last_change":"2023-11-15T01:39:02.211682+0000","last_active":"2023-11-15T01:39:02.593625+0000","last_peered":"2023-11-15T01:39:02.593625+0000","last_clean":"2023-11-15T01:39:02.593625+0000","last_became_active":"2023-11-15T01:39:02.211336+0000","last_became_peered":"2023-11-15T01:39:02.211336+0000","last_unstale":"2023-11-15T01:39:02.593625+0000","last_undegraded":"2023-11-15T01:39:02.593625+0000","last_fullsized":"2023-11-15T01:39:02.593625+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619825+0000","last_change":"2023-11-15T01:39:02.616663+0000","last_active":"2023-11-15T01:39:02.619825+0000","last_peered":"2023-11-15T01:39:02.619825+0000","last_clean":"2023-11-15T01:39:02.619825+0000","last_became_active":"2023-11-15T01:39:02.616376+0000","last_became_peered":"2023-11-15T01:39:02.616376+0000","last_unstale":"2023-11-15T01:39:02.619825+0000","last_undegraded":"2023-11-15T01:39:02.619825+0000","last_fullsized":"2023-11-15T01:39:02.619825+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597448+0000","last_change":"2023-11-15T01:39:02.216677+0000","last_active":"2023-11-15T01:39:02.597448+0000","last_peered":"2023-11-15T01:39:02.597448+0000","last_clean":"2023-11-15T01:39:02.597448+0000","last_became_active":"2023-11-15T01:39:02.216244+0000","last_became_peered":"2023-11-15T01:39:02.216244+0000","last_unstale":"2023-11-15T01:39:02.597448+0000","last_undegraded":"2023-11-15T01:39:02.597448+0000","last_fullsized":"2023-11-15T01:39:02.597448+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619935+0000","last_change":"2023-11-15T01:39:02.614768+0000","last_active":"2023-11-15T01:39:02.619935+0000","last_peered":"2023-11-15T01:39:02.619935+0000","last_clean":"2023-11-15T01:39:02.619935+0000","last_became_active":"2023-11-15T01:39:02.614457+0000","last_became_peered":"2023-11-15T01:39:02.614457+0000","last_unstale":"2023-11-15T01:39:02.619935+0000","last_undegraded":"2023-11-15T01:39:02.619935+0000","last_fullsized":"2023-11-15T01:39:02.619935+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593206+0000","last_change":"2023-11-15T01:39:02.212115+0000","last_active":"2023-11-15T01:39:02.593206+0000","last_peered":"2023-11-15T01:39:02.593206+0000","last_clean":"2023-11-15T01:39:02.593206+0000","last_became_active":"2023-11-15T01:39:02.211847+0000","last_became_peered":"2023-11-15T01:39:02.211847+0000","last_unstale":"2023-11-15T01:39:02.593206+0000","last_undegraded":"2023-11-15T01:39:02.593206+0000","last_fullsized":"2023-11-15T01:39:02.593206+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606667+0000","last_change":"2023-11-15T01:39:02.604865+0000","last_active":"2023-11-15T01:39:02.606667+0000","last_peered":"2023-11-15T01:39:02.606667+0000","last_clean":"2023-11-15T01:39:02.606667+0000","last_became_active":"2023-11-15T01:39:02.604576+0000","last_became_peered":"2023-11-15T01:39:02.604576+0000","last_unstale":"2023-11-15T01:39:02.606667+0000","last_undegraded":"2023-11-15T01:39:02.606667+0000","last_fullsized":"2023-11-15T01:39:02.606667+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597373+0000","last_change":"2023-11-15T01:39:02.212456+0000","last_active":"2023-11-15T01:39:02.597373+0000","last_peered":"2023-11-15T01:39:02.597373+0000","last_clean":"2023-11-15T01:39:02.597373+0000","last_became_active":"2023-11-15T01:39:02.212123+0000","last_became_peered":"2023-11-15T01:39:02.212123+0000","last_unstale":"2023-11-15T01:39:02.597373+0000","last_undegraded":"2023-11-15T01:39:02.597373+0000","last_fullsized":"2023-11-15T01:39:02.597373+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.601148+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:39:02.601148+0000","last_peered":"2023-11-15T01:39:02.601148+0000","last_clean":"2023-11-15T01:39:02.601148+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:39:02.601148+0000","last_undegraded":"2023-11-15T01:39:02.601148+0000","last_fullsized":"2023-11-15T01:39:02.601148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.596932+0000","last_change":"2023-11-15T01:39:02.594932+0000","last_active":"2023-11-15T01:39:02.596932+0000","last_peered":"2023-11-15T01:39:02.596932+0000","last_clean":"2023-11-15T01:39:02.596932+0000","last_became_active":"2023-11-15T01:39:02.594643+0000","last_became_peered":"2023-11-15T01:39:02.594643+0000","last_unstale":"2023-11-15T01:39:02.596932+0000","last_undegraded":"2023-11-15T01:39:02.596932+0000","last_fullsized":"2023-11-15T01:39:02.596932+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611619+0000","last_change":"2023-11-15T01:39:02.210563+0000","last_active":"2023-11-15T01:39:02.611619+0000","last_peered":"2023-11-15T01:39:02.611619+0000","last_clean":"2023-11-15T01:39:02.611619+0000","last_became_active":"2023-11-15T01:39:02.210071+0000","last_became_peered":"2023-11-15T01:39:02.210071+0000","last_unstale":"2023-11-15T01:39:02.611619+0000","last_undegraded":"2023-11-15T01:39:02.611619+0000","last_fullsized":"2023-11-15T01:39:02.611619+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606635+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:39:02.606635+0000","last_peered":"2023-11-15T01:39:02.606635+0000","last_clean":"2023-11-15T01:39:02.606635+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:39:02.606635+0000","last_undegraded":"2023-11-15T01:39:02.606635+0000","last_fullsized":"2023-11-15T01:39:02.606635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611509+0000","last_change":"2023-11-15T01:39:02.610776+0000","last_active":"2023-11-15T01:39:02.611509+0000","last_peered":"2023-11-15T01:39:02.611509+0000","last_clean":"2023-11-15T01:39:02.611509+0000","last_became_active":"2023-11-15T01:39:02.610520+0000","last_became_peered":"2023-11-15T01:39:02.610520+0000","last_unstale":"2023-11-15T01:39:02.611509+0000","last_undegraded":"2023-11-15T01:39:02.611509+0000","last_fullsized":"2023-11-15T01:39:02.611509+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607127+0000","last_change":"2023-11-15T01:39:02.211202+0000","last_active":"2023-11-15T01:39:02.607127+0000","last_peered":"2023-11-15T01:39:02.607127+0000","last_clean":"2023-11-15T01:39:02.607127+0000","last_became_active":"2023-11-15T01:39:02.210846+0000","last_became_peered":"2023-11-15T01:39:02.210846+0000","last_unstale":"2023-11-15T01:39:02.607127+0000","last_undegraded":"2023-11-15T01:39:02.607127+0000","last_fullsized":"2023-11-15T01:39:02.607127+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593208+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:39:02.593208+0000","last_peered":"2023-11-15T01:39:02.593208+0000","last_clean":"2023-11-15T01:39:02.593208+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:39:02.593208+0000","last_undegraded":"2023-11-15T01:39:02.593208+0000","last_fullsized":"2023-11-15T01:39:02.593208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619122+0000","last_change":"2023-11-15T01:39:02.611202+0000","last_active":"2023-11-15T01:39:02.619122+0000","last_peered":"2023-11-15T01:39:02.619122+0000","last_clean":"2023-11-15T01:39:02.619122+0000","last_became_active":"2023-11-15T01:39:02.610885+0000","last_became_peered":"2023-11-15T01:39:02.610885+0000","last_unstale":"2023-11-15T01:39:02.619122+0000","last_undegraded":"2023-11-15T01:39:02.619122+0000","last_fullsized":"2023-11-15T01:39:02.619122+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.599145+0000","last_change":"2023-11-15T01:39:02.209388+0000","last_active":"2023-11-15T01:39:02.599145+0000","last_peered":"2023-11-15T01:39:02.599145+0000","last_clean":"2023-11-15T01:39:02.599145+0000","last_became_active":"2023-11-15T01:39:02.209125+0000","last_became_peered":"2023-11-15T01:39:02.209125+0000","last_unstale":"2023-11-15T01:39:02.599145+0000","last_undegraded":"2023-11-15T01:39:02.599145+0000","last_fullsized":"2023-11-15T01:39:02.599145+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607022+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:39:02.607022+0000","last_peered":"2023-11-15T01:39:02.607022+0000","last_clean":"2023-11-15T01:39:02.607022+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:39:02.607022+0000","last_undegraded":"2023-11-15T01:39:02.607022+0000","last_fullsized":"2023-11-15T01:39:02.607022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":98,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.602963+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:39:02.602963+0000","last_peered":"2023-11-15T01:39:02.602963+0000","last_clean":"2023-11-15T01:39:02.602963+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:39:02.602963+0000","last_undegraded":"2023-11-15T01:39:02.602963+0000","last_fullsized":"2023-11-15T01:39:02.602963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608911+0000","last_change":"2023-11-15T01:39:02.604538+0000","last_active":"2023-11-15T01:39:02.608911+0000","last_peered":"2023-11-15T01:39:02.608911+0000","last_clean":"2023-11-15T01:39:02.608911+0000","last_became_active":"2023-11-15T01:39:02.604164+0000","last_became_peered":"2023-11-15T01:39:02.604164+0000","last_unstale":"2023-11-15T01:39:02.608911+0000","last_undegraded":"2023-11-15T01:39:02.608911+0000","last_fullsized":"2023-11-15T01:39:02.608911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.605024+0000","last_change":"2023-11-15T01:39:02.213659+0000","last_active":"2023-11-15T01:39:02.605024+0000","last_peered":"2023-11-15T01:39:02.605024+0000","last_clean":"2023-11-15T01:39:02.605024+0000","last_became_active":"2023-11-15T01:39:02.213388+0000","last_became_peered":"2023-11-15T01:39:02.213388+0000","last_unstale":"2023-11-15T01:39:02.605024+0000","last_undegraded":"2023-11-15T01:39:02.605024+0000","last_fullsized":"2023-11-15T01:39:02.605024+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.602975+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:39:02.602975+0000","last_peered":"2023-11-15T01:39:02.602975+0000","last_clean":"2023-11-15T01:39:02.602975+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:39:02.602975+0000","last_undegraded":"2023-11-15T01:39:02.602975+0000","last_fullsized":"2023-11-15T01:39:02.602975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613936+0000","last_change":"2023-11-15T01:39:02.613124+0000","last_active":"2023-11-15T01:39:02.613936+0000","last_peered":"2023-11-15T01:39:02.613936+0000","last_clean":"2023-11-15T01:39:02.613936+0000","last_became_active":"2023-11-15T01:39:02.612807+0000","last_became_peered":"2023-11-15T01:39:02.612807+0000","last_unstale":"2023-11-15T01:39:02.613936+0000","last_undegraded":"2023-11-15T01:39:02.613936+0000","last_fullsized":"2023-11-15T01:39:02.613936+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593105+0000","last_change":"2023-11-15T01:39:02.208753+0000","last_active":"2023-11-15T01:39:02.593105+0000","last_peered":"2023-11-15T01:39:02.593105+0000","last_clean":"2023-11-15T01:39:02.593105+0000","last_became_active":"2023-11-15T01:39:02.208459+0000","last_became_peered":"2023-11-15T01:39:02.208459+0000","last_unstale":"2023-11-15T01:39:02.593105+0000","last_undegraded":"2023-11-15T01:39:02.593105+0000","last_fullsized":"2023-11-15T01:39:02.593105+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.605122+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:39:02.605122+0000","last_peered":"2023-11-15T01:39:02.605122+0000","last_clean":"2023-11-15T01:39:02.605122+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:39:02.605122+0000","last_undegraded":"2023-11-15T01:39:02.605122+0000","last_fullsized":"2023-11-15T01:39:02.605122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608614+0000","last_change":"2023-11-15T01:39:02.604992+0000","last_active":"2023-11-15T01:39:02.608614+0000","last_peered":"2023-11-15T01:39:02.608614+0000","last_clean":"2023-11-15T01:39:02.608614+0000","last_became_active":"2023-11-15T01:39:02.604731+0000","last_became_peered":"2023-11-15T01:39:02.604731+0000","last_unstale":"2023-11-15T01:39:02.608614+0000","last_undegraded":"2023-11-15T01:39:02.608614+0000","last_fullsized":"2023-11-15T01:39:02.608614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.596996+0000","last_change":"2023-11-15T01:39:02.215566+0000","last_active":"2023-11-15T01:39:02.596996+0000","last_peered":"2023-11-15T01:39:02.596996+0000","last_clean":"2023-11-15T01:39:02.596996+0000","last_became_active":"2023-11-15T01:39:02.215261+0000","last_became_peered":"2023-11-15T01:39:02.215261+0000","last_unstale":"2023-11-15T01:39:02.596996+0000","last_undegraded":"2023-11-15T01:39:02.596996+0000","last_fullsized":"2023-11-15T01:39:02.596996+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598969+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:39:02.598969+0000","last_peered":"2023-11-15T01:39:02.598969+0000","last_clean":"2023-11-15T01:39:02.598969+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:39:02.598969+0000","last_undegraded":"2023-11-15T01:39:02.598969+0000","last_fullsized":"2023-11-15T01:39:02.598969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609619+0000","last_change":"2023-11-15T01:39:02.607704+0000","last_active":"2023-11-15T01:39:02.609619+0000","last_peered":"2023-11-15T01:39:02.609619+0000","last_clean":"2023-11-15T01:39:02.609619+0000","last_became_active":"2023-11-15T01:39:02.607461+0000","last_became_peered":"2023-11-15T01:39:02.607461+0000","last_unstale":"2023-11-15T01:39:02.609619+0000","last_undegraded":"2023-11-15T01:39:02.609619+0000","last_fullsized":"2023-11-15T01:39:02.609619+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593520+0000","last_change":"2023-11-15T01:39:02.208524+0000","last_active":"2023-11-15T01:39:02.593520+0000","last_peered":"2023-11-15T01:39:02.593520+0000","last_clean":"2023-11-15T01:39:02.593520+0000","last_became_active":"2023-11-15T01:39:02.208211+0000","last_became_peered":"2023-11-15T01:39:02.208211+0000","last_unstale":"2023-11-15T01:39:02.593520+0000","last_undegraded":"2023-11-15T01:39:02.593520+0000","last_fullsized":"2023-11-15T01:39:02.593520+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598462+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:39:02.598462+0000","last_peered":"2023-11-15T01:39:02.598462+0000","last_clean":"2023-11-15T01:39:02.598462+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:39:02.598462+0000","last_undegraded":"2023-11-15T01:39:02.598462+0000","last_fullsized":"2023-11-15T01:39:02.598462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575056,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302716,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069124,"statfs":{"total":96636764160,"available":96326782976,"internally_reserved":0,"allocated":1560576,"data_stored":809406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.55100000000000005},"min":{"1min":0.29699999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.67900000000000005,"5min":0.71199999999999997,"15min":0.82299999999999995},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.33800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.73699999999999999,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74399999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54200000000000004,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.34399999999999997,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.85899999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54100000000000004,"15min":0.56200000000000006},"min":{"1min":0.32700000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71099999999999997,"5min":0.79600000000000004,"15min":0.82599999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":0.58499999999999996},"min":{"1min":0.40699999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.875}]},{"osd":3,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.58099999999999996},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.76900000000000002,"5min":0.80700000000000005,"15min":0.85999999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78000000000000003,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.83499999999999996}]},{"osd":4,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64400000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.32500000000000001,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.77000000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.316,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.83099999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.70399999999999996,"5min":0.73899999999999999,"15min":0.78500000000000003},"last":0.71099999999999997}]},{"osd":6,"last update":"Wed Nov 15 01:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78400000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.85099999999999998},"last":0.88400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1568768,"data_stored":809982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.55600000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.30499999999999999},"max":{"1min":0.70999999999999996,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.41799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77800000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.58899999999999997}]},{"osd":1,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.83099999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.39100000000000001,"5min":0.33100000000000002,"15min":0.32100000000000001},"max":{"1min":0.79600000000000004,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.36699999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72499999999999998,"5min":1.746,"15min":1.746},"last":0.53800000000000003}]},{"osd":3,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.307},"max":{"1min":0.69999999999999996,"5min":0.77100000000000002,"15min":0.91300000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.52900000000000003}]},{"osd":4,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.44900000000000001,"15min":0.45000000000000001},"min":{"1min":0.29099999999999998,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.52200000000000002},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.25800000000000001},"max":{"1min":0.71199999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51900000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48199999999999998,"15min":0.48099999999999998},"min":{"1min":0.32200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63900000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.5},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57599999999999996}]},{"osd":7,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.496,"15min":0.5},"min":{"1min":0.35099999999999998,"5min":0.32500000000000001,"15min":0.29899999999999999},"max":{"1min":0.64800000000000002,"5min":0.875,"15min":0.875},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80800000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575058,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302728,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069112,"statfs":{"total":96636764160,"available":96326770688,"internally_reserved":0,"allocated":1572864,"data_stored":810866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.23999999999999999},"max":{"1min":0.50800000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.40300000000000002},"min":{"1min":0.26600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58699999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.25900000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.373,"15min":0.38900000000000001},"min":{"1min":0.27200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.57599999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.245},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.438},"min":{"1min":0.28199999999999997,"5min":0.27800000000000002,"15min":0.26200000000000001},"max":{"1min":0.68999999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.52400000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55700000000000005,"15min":0.52300000000000002},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60299999999999998,"5min":9.641,"15min":9.641},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53200000000000003,"15min":0.501},"min":{"1min":0.34200000000000003,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":0.63400000000000001,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.373}]},{"osd":4,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.42199999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.63600000000000001},"min":{"1min":0.49299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.875,"5min":1.006,"15min":1.006},"last":0.69799999999999995}]},{"osd":5,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.82299999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.432},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81200000000000006,"5min":1.111,"15min":1.111},"last":0.55700000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.67400000000000004},"min":{"1min":0.498,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":0.78000000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65700000000000003,"15min":0.68500000000000005},"min":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92800000000000005,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.59199999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.51100000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91800000000000004,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66500000000000004,"15min":0.68999999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94199999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575056,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1568768,"data_stored":810050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.375,"15min":0.371},"min":{"1min":0.27800000000000002,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.54200000000000004,"5min":2.024,"15min":2.024},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.26100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.64700000000000002,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.26100000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52400000000000002,"5min":1.768,"15min":1.768},"last":0.245},{"interface":"front","average":{"1min":0.436,"5min":0.439,"15min":0.44},"min":{"1min":0.28899999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.63500000000000001,"5min":1.982,"15min":1.982},"last":0.28899999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44,"15min":0.437},"min":{"1min":0.28100000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61299999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.67900000000000005,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.30599999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.45600000000000002,"5min":0.42199999999999999,"15min":0.40400000000000003},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98899999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.47599999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.624,"15min":0.629},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.38500000000000001},"max":{"1min":0.97899999999999998,"5min":1.881,"15min":1.881},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":1.056},"last":0.56000000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.42999999999999999,"15min":0.36499999999999999},"max":{"1min":1.04,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.5},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67000000000000004,"15min":0.67100000000000004},"min":{"1min":0.51100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.917,"15min":1.917},"last":0.52800000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69899999999999995,"15min":0.68999999999999995},"min":{"1min":0.53400000000000003,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0089999999999999,"5min":1.843,"15min":1.843},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67200000000000004,"15min":0.68700000000000006},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.40899999999999997},"max":{"1min":1.073,"5min":1.073,"15min":1.0960000000000001},"last":0.60599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575057,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306816,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065024,"statfs":{"total":96636764160,"available":96322584576,"internally_reserved":0,"allocated":1564672,"data_stored":809420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35499999999999998,"15min":0.36699999999999999},"min":{"1min":0.26900000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.46000000000000002,"5min":0.54800000000000004,"15min":0.61899999999999999},"last":0.252},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.40600000000000003},"min":{"1min":0.255,"5min":0.246,"15min":0.246},"max":{"1min":0.63200000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.35099999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.26900000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61799999999999999,"5min":0.745,"15min":0.75},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42699999999999999,"15min":0.438},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.56399999999999995,"5min":0.69799999999999995,"15min":0.92000000000000004},"last":0.318}]},{"osd":3,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.44400000000000001,"15min":0.45200000000000001},"min":{"1min":0.34899999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67400000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.439,"15min":0.443},"min":{"1min":0.34100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.30099999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.61799999999999999},"min":{"1min":0.42799999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79800000000000004,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80900000000000005,"5min":0.91100000000000003,"15min":0.95399999999999996},"last":0.51900000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.623,"15min":0.64200000000000002},"min":{"1min":0.495,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84799999999999998,"5min":1.032,"15min":1.032},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.60699999999999998,"15min":0.63600000000000001},"min":{"1min":0.48499999999999999,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":0.75,"5min":0.96699999999999997,"15min":0.99399999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64100000000000001,"15min":0.65700000000000003},"min":{"1min":0.49399999999999999,"5min":0.438,"15min":0.374},"max":{"1min":0.85799999999999998,"5min":1.002,"15min":1.0389999999999999},"last":0.499},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64500000000000002,"15min":0.67000000000000004},"min":{"1min":0.53800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56899999999999995}]},{"osd":7,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64800000000000002,"15min":0.66900000000000004},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":1.079,"15min":1.079},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66000000000000003,"15min":0.68999999999999995},"min":{"1min":0.52600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.82299999999999995,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.505}]}]},{"osd":3,"up_from":13,"seq":55834575058,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306808,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065032,"statfs":{"total":96636764160,"available":96322592768,"internally_reserved":0,"allocated":1556480,"data_stored":809316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35599999999999998,"15min":0.374},"min":{"1min":0.23200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.54500000000000004,"5min":0.65900000000000003,"15min":0.79900000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.374,"15min":0.40000000000000002},"min":{"1min":0.24199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.503,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.438}]},{"osd":1,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.36499999999999999,"15min":0.39000000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.24399999999999999},"max":{"1min":0.52500000000000002,"5min":0.57799999999999996,"15min":0.72899999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.44500000000000001},"min":{"1min":0.28699999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70199999999999996,"5min":0.72499999999999998,"15min":0.747},"last":0.48499999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41499999999999998,"15min":0.44800000000000001},"min":{"1min":0.29499999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.47699999999999998},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":0.69199999999999995,"15min":0.81999999999999995},"last":0.56499999999999995}]},{"osd":4,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56899999999999995,"15min":0.61599999999999999},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.80500000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.626},"min":{"1min":0.435,"5min":0.40600000000000003,"15min":0.39000000000000001},"max":{"1min":0.84799999999999998,"5min":0.89200000000000002,"15min":1.0589999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58799999999999997,"15min":0.63300000000000001},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.76800000000000002,"5min":0.92000000000000004,"15min":1.0569999999999999},"last":0.749},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.63900000000000001},"min":{"1min":0.41499999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73799999999999999,"5min":0.879,"15min":0.95999999999999996},"last":0.92600000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60199999999999998,"15min":0.64600000000000002},"min":{"1min":0.40899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.0980000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.67000000000000004},"min":{"1min":0.42899999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.95799999999999996,"15min":1.169},"last":0.80600000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.66600000000000004},"min":{"1min":0.48399999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":1.0429999999999999,"15min":1.071},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86099999999999999,"5min":0.996,"15min":1.1459999999999999},"last":0.97199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575056,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302720,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069120,"statfs":{"total":96636764160,"available":96326778880,"internally_reserved":0,"allocated":1564672,"data_stored":810230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.34499999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.84499999999999997,"15min":0.88},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.374,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.754,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.47499999999999998}]},{"osd":1,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.42099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72499999999999998,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.432},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.45500000000000002,"5min":0.34799999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.59899999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.58699999999999997},"min":{"1min":0.44,"5min":0.34100000000000003,"15min":0.30299999999999999},"max":{"1min":0.70299999999999996,"5min":2.887,"15min":2.887},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.33100000000000002},"max":{"1min":0.77700000000000002,"5min":0.92300000000000004,"15min":0.96299999999999997},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.41299999999999998,"5min":0.35799999999999998,"15min":0.33100000000000002},"max":{"1min":0.71599999999999997,"5min":2.464,"15min":2.464},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.623,"15min":0.60699999999999998},"min":{"1min":0.47599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79400000000000004,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.67700000000000005}]},{"osd":5,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48399999999999999,"15min":0.46800000000000003},"min":{"1min":0.34499999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70499999999999996,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.27400000000000002},"max":{"1min":0.65800000000000003,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.66300000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52200000000000002,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.29699999999999999,"15min":0.28899999999999998},"max":{"1min":0.67800000000000005,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.82899999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.77300000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58499999999999996,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71799999999999997,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.73399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575056,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302716,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069124,"statfs":{"total":96636764160,"available":96326782976,"internally_reserved":0,"allocated":1560576,"data_stored":809870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52600000000000002,"15min":0.54900000000000004},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.63700000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.373},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.55000000000000004},"min":{"1min":0.32300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.73199999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.66700000000000004}]},{"osd":1,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.33300000000000002,"15min":0.32600000000000001},"max":{"1min":0.78500000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55200000000000005,"15min":0.56899999999999995},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.35099999999999998},"max":{"1min":0.72099999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.434}]},{"osd":2,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69699999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55400000000000005,"15min":0.57199999999999995},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.84599999999999997},"last":0.47699999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70099999999999996,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.495},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":0.58699999999999997},"min":{"1min":0.38800000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74399999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.52800000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.432,"15min":0.44400000000000001},"min":{"1min":0.32400000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57899999999999996,"5min":0.66500000000000004,"15min":0.76500000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.50800000000000001,"15min":0.51900000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67900000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.78700000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.31,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.47699999999999998,"15min":0.48899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.61099999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63800000000000001,"5min":0.72999999999999998,"15min":0.755},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:39:11.131 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:39:11.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.263+0000 7f300bcd6700 1 Processor -- start 2023-11-15T01:39:11.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.263+0000 7f300bcd6700 1 -- start start 2023-11-15T01:39:11.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.264+0000 7f300bcd6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3004154150 0x7f3004154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:11.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.264+0000 7f300bcd6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30040c06f0 con 0x7f30040ab1a0 2023-11-15T01:39:11.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.264+0000 7f300bcd6700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30040c09d0 con 0x7f30040aa060 2023-11-15T01:39:11.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.264+0000 7f300bcd6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3004158820 con 0x7f3004154150 2023-11-15T01:39:11.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.264+0000 7f3009271700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f30040ab1a0 0x7f3004158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59178/0 (socket says 172.21.15.1:59178) 2023-11-15T01:39:11.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.264+0000 7f3009271700 1 -- 172.21.15.1:0/2393963478 learned_addr learned my addr 172.21.15.1:0/2393963478 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:39:11.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.265+0000 7f3009a72700 1 --2- 172.21.15.1:0/2393963478 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3004154150 0x7f3004154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:11.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.265+0000 7f3008a70700 1 -- 172.21.15.1:0/2393963478 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660713890 0 0) 0x7f30040c06f0 con 0x7f30040ab1a0 2023-11-15T01:39:11.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.265+0000 7f3008a70700 1 -- 172.21.15.1:0/2393963478 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fec0033f0 con 0x7f30040ab1a0 2023-11-15T01:39:11.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.265+0000 7f3008a70700 1 -- 172.21.15.1:0/2393963478 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880193938 0 0) 0x7f30040c09d0 con 0x7f30040aa060 2023-11-15T01:39:11.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.265+0000 7f3008a70700 1 -- 172.21.15.1:0/2393963478 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30040c06f0 con 0x7f30040aa060 2023-11-15T01:39:11.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.265+0000 7f3009a72700 1 -- 172.21.15.1:0/2393963478 >> v1:172.21.15.141:6789/0 conn(0x7f30040aa060 legacy=0x7f30040c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:11.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.265+0000 7f3009a72700 1 -- 172.21.15.1:0/2393963478 >> v1:172.21.15.1:6789/0 conn(0x7f30040ab1a0 legacy=0x7f3004158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:11.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.265+0000 7f3009a72700 1 -- 172.21.15.1:0/2393963478 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3004158b00 con 0x7f3004154150 2023-11-15T01:39:11.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.265+0000 7f3009a72700 1 --2- 172.21.15.1:0/2393963478 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3004154150 0x7f3004154530 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f2ff4009790 tx=0x7f2ff4009060).ready entity=mon.2 client_cookie=46bf0c5336895828 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:11.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.265+0000 7f3008a70700 1 -- 172.21.15.1:0/2393963478 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff40090d0 con 0x7f3004154150 2023-11-15T01:39:11.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.265+0000 7f3008a70700 1 -- 172.21.15.1:0/2393963478 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff400f510 con 0x7f3004154150 2023-11-15T01:39:11.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.265+0000 7f3008a70700 1 -- 172.21.15.1:0/2393963478 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff400f890 con 0x7f3004154150 2023-11-15T01:39:11.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.266+0000 7f300bcd6700 1 -- 172.21.15.1:0/2393963478 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3004154150 msgr2=0x7f3004154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:11.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.266+0000 7f300bcd6700 1 --2- 172.21.15.1:0/2393963478 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3004154150 0x7f3004154530 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f2ff4009790 tx=0x7f2ff4009060).stop 2023-11-15T01:39:11.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.266+0000 7f300bcd6700 1 -- 172.21.15.1:0/2393963478 shutdown_connections 2023-11-15T01:39:11.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.266+0000 7f300bcd6700 1 --2- 172.21.15.1:0/2393963478 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3004154150 0x7f3004154530 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:11.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.266+0000 7f300bcd6700 1 -- 172.21.15.1:0/2393963478 >> 172.21.15.1:0/2393963478 conn(0x7f3004064aa0 msgr2=0x7f3004064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:11.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.266+0000 7f300bcd6700 1 -- 172.21.15.1:0/2393963478 shutdown_connections 2023-11-15T01:39:11.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.266+0000 7f300bcd6700 1 -- 172.21.15.1:0/2393963478 wait complete. 2023-11-15T01:39:11.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.267+0000 7f300bcd6700 1 Processor -- start 2023-11-15T01:39:11.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.267+0000 7f300bcd6700 1 -- start start 2023-11-15T01:39:11.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f300bcd6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30040aa060 0x7f300413b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:11.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f300bcd6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30040ab1a0 0x7f30040cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:11.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f300bcd6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3004154150 0x7f30040cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:11.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f300bcd6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30040cba60 con 0x7f30040aa060 2023-11-15T01:39:11.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f300bcd6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30040c5070 con 0x7f30040ab1a0 2023-11-15T01:39:11.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f300bcd6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30040c5350 con 0x7f3004154150 2023-11-15T01:39:11.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f3009a72700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30040aa060 0x7f300413b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:11.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f3009a72700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30040aa060 0x7f300413b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38562/0 (socket says 172.21.15.1:38562) 2023-11-15T01:39:11.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f3009a72700 1 -- 172.21.15.1:0/3925804301 learned_addr learned my addr 172.21.15.1:0/3925804301 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:11.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f3009271700 1 --2- 172.21.15.1:0/3925804301 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30040ab1a0 0x7f30040cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:11.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f300a273700 1 --2- 172.21.15.1:0/3925804301 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3004154150 0x7f30040cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:11.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f3009a72700 1 -- 172.21.15.1:0/3925804301 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3004154150 msgr2=0x7f30040cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:11.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f3009a72700 1 --2- 172.21.15.1:0/3925804301 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3004154150 0x7f30040cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:11.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f3009a72700 1 -- 172.21.15.1:0/3925804301 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30040ab1a0 msgr2=0x7f30040cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:11.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f3009a72700 1 --2- 172.21.15.1:0/3925804301 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30040ab1a0 0x7f30040cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:11.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.268+0000 7f3009a72700 1 -- 172.21.15.1:0/3925804301 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff40092a0 con 0x7f30040aa060 2023-11-15T01:39:11.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.269+0000 7f3009a72700 1 --2- 172.21.15.1:0/3925804301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30040aa060 0x7f300413b810 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f3004062af0 tx=0x7f2ff4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:11.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.269+0000 7f3001ffb700 1 -- 172.21.15.1:0/3925804301 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4006990 con 0x7f30040aa060 2023-11-15T01:39:11.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.269+0000 7f3001ffb700 1 -- 172.21.15.1:0/3925804301 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff400fc50 con 0x7f30040aa060 2023-11-15T01:39:11.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.269+0000 7f300bcd6700 1 -- 172.21.15.1:0/3925804301 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30040af100 con 0x7f30040aa060 2023-11-15T01:39:11.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.269+0000 7f3001ffb700 1 -- 172.21.15.1:0/3925804301 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff400f890 con 0x7f30040aa060 2023-11-15T01:39:11.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.269+0000 7f300bcd6700 1 -- 172.21.15.1:0/3925804301 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30040af6c0 con 0x7f30040aa060 2023-11-15T01:39:11.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.270+0000 7f300bcd6700 1 -- 172.21.15.1:0/3925804301 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300406c7e0 con 0x7f30040aa060 2023-11-15T01:39:11.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.270+0000 7f3001ffb700 1 -- 172.21.15.1:0/3925804301 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2ff401b620 con 0x7f30040aa060 2023-11-15T01:39:11.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.271+0000 7f3001ffb700 1 --2- 172.21.15.1:0/3925804301 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2ff005f270 0x7f2ff0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:11.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.271+0000 7f3001ffb700 1 -- 172.21.15.1:0/3925804301 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f2ff407bc80 con 0x7f30040aa060 2023-11-15T01:39:11.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.271+0000 7f3009271700 1 --2- 172.21.15.1:0/3925804301 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2ff005f270 0x7f2ff0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:11.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.271+0000 7f3009271700 1 --2- 172.21.15.1:0/3925804301 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2ff005f270 0x7f2ff0061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f30040ae470 tx=0x7f2ff8009040).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:11.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.275+0000 7f3001ffb700 1 -- 172.21.15.1:0/3925804301 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2ff404cc20 con 0x7f30040aa060 2023-11-15T01:39:11.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.443+0000 7f300bcd6700 1 -- 172.21.15.1:0/3925804301 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3004158de0 con 0x7f2ff005f270 2023-11-15T01:39:11.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.453+0000 7f3001ffb700 1 -- 172.21.15.1:0/3925804301 <== mgr.6919 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361548 (secure 0 0 0) 0x7f3004158de0 con 0x7f2ff005f270 2023-11-15T01:39:11.459 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:39:11.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.456+0000 7f300bcd6700 1 -- 172.21.15.1:0/3925804301 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2ff005f270 msgr2=0x7f2ff0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:11.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.456+0000 7f300bcd6700 1 --2- 172.21.15.1:0/3925804301 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2ff005f270 0x7f2ff0061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f30040ae470 tx=0x7f2ff8009040).stop 2023-11-15T01:39:11.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.456+0000 7f300bcd6700 1 -- 172.21.15.1:0/3925804301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30040aa060 msgr2=0x7f300413b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:11.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.456+0000 7f300bcd6700 1 --2- 172.21.15.1:0/3925804301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30040aa060 0x7f300413b810 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f3004062af0 tx=0x7f2ff4017000).stop 2023-11-15T01:39:11.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.457+0000 7f300bcd6700 1 -- 172.21.15.1:0/3925804301 shutdown_connections 2023-11-15T01:39:11.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.457+0000 7f300bcd6700 1 --2- 172.21.15.1:0/3925804301 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2ff005f270 0x7f2ff0061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:11.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.457+0000 7f300bcd6700 1 --2- 172.21.15.1:0/3925804301 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3004154150 0x7f30040cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:11.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.457+0000 7f300bcd6700 1 --2- 172.21.15.1:0/3925804301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30040aa060 0x7f300413b810 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:11.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.457+0000 7f300bcd6700 1 --2- 172.21.15.1:0/3925804301 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30040ab1a0 0x7f30040cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:11.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.457+0000 7f300bcd6700 1 -- 172.21.15.1:0/3925804301 >> 172.21.15.1:0/3925804301 conn(0x7f3004064aa0 msgr2=0x7f30040c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:11.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.457+0000 7f300bcd6700 1 -- 172.21.15.1:0/3925804301 shutdown_connections 2023-11-15T01:39:11.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.457+0000 7f300bcd6700 1 -- 172.21.15.1:0/3925804301 wait complete. 2023-11-15T01:39:11.464 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:39:11.470 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-11-15T01:39:11.153058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2429952,"kb_used_data":12224,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752544768,"statfs":{"total":773094113280,"available":770605842432,"internally_reserved":0,"allocated":12517376,"data_stored":6479140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6722,"num_objects":-18,"num_object_clones":0,"num_object_copies":-36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.010723"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613925+0000","last_change":"2023-11-15T01:39:02.602396+0000","last_active":"2023-11-15T01:39:02.613925+0000","last_peered":"2023-11-15T01:39:02.613925+0000","last_clean":"2023-11-15T01:39:02.613925+0000","last_became_active":"2023-11-15T01:39:02.602116+0000","last_became_peered":"2023-11-15T01:39:02.602116+0000","last_unstale":"2023-11-15T01:39:02.613925+0000","last_undegraded":"2023-11-15T01:39:02.613925+0000","last_fullsized":"2023-11-15T01:39:02.613925+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616122+0000","last_change":"2023-11-15T01:39:02.218901+0000","last_active":"2023-11-15T01:39:02.616122+0000","last_peered":"2023-11-15T01:39:02.616122+0000","last_clean":"2023-11-15T01:39:02.616122+0000","last_became_active":"2023-11-15T01:39:02.218594+0000","last_became_peered":"2023-11-15T01:39:02.218594+0000","last_unstale":"2023-11-15T01:39:02.616122+0000","last_undegraded":"2023-11-15T01:39:02.616122+0000","last_fullsized":"2023-11-15T01:39:02.616122+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603572+0000","last_change":"2023-11-15T01:39:02.600412+0000","last_active":"2023-11-15T01:39:02.603572+0000","last_peered":"2023-11-15T01:39:02.603572+0000","last_clean":"2023-11-15T01:39:02.603572+0000","last_became_active":"2023-11-15T01:39:02.600184+0000","last_became_peered":"2023-11-15T01:39:02.600184+0000","last_unstale":"2023-11-15T01:39:02.603572+0000","last_undegraded":"2023-11-15T01:39:02.603572+0000","last_fullsized":"2023-11-15T01:39:02.603572+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588186+0000","last_change":"2023-11-15T01:39:02.212406+0000","last_active":"2023-11-15T01:39:02.588186+0000","last_peered":"2023-11-15T01:39:02.588186+0000","last_clean":"2023-11-15T01:39:02.588186+0000","last_became_active":"2023-11-15T01:39:02.212126+0000","last_became_peered":"2023-11-15T01:39:02.212126+0000","last_unstale":"2023-11-15T01:39:02.588186+0000","last_undegraded":"2023-11-15T01:39:02.588186+0000","last_fullsized":"2023-11-15T01:39:02.588186+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619501+0000","last_change":"2023-11-15T01:39:02.616063+0000","last_active":"2023-11-15T01:39:02.619501+0000","last_peered":"2023-11-15T01:39:02.619501+0000","last_clean":"2023-11-15T01:39:02.619501+0000","last_became_active":"2023-11-15T01:39:02.615758+0000","last_became_peered":"2023-11-15T01:39:02.615758+0000","last_unstale":"2023-11-15T01:39:02.619501+0000","last_undegraded":"2023-11-15T01:39:02.619501+0000","last_fullsized":"2023-11-15T01:39:02.619501+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.599254+0000","last_change":"2023-11-15T01:39:02.218897+0000","last_active":"2023-11-15T01:39:02.599254+0000","last_peered":"2023-11-15T01:39:02.599254+0000","last_clean":"2023-11-15T01:39:02.599254+0000","last_became_active":"2023-11-15T01:39:02.218572+0000","last_became_peered":"2023-11-15T01:39:02.218572+0000","last_unstale":"2023-11-15T01:39:02.599254+0000","last_undegraded":"2023-11-15T01:39:02.599254+0000","last_fullsized":"2023-11-15T01:39:02.599254+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613204+0000","last_change":"2023-11-15T01:39:02.604340+0000","last_active":"2023-11-15T01:39:02.613204+0000","last_peered":"2023-11-15T01:39:02.613204+0000","last_clean":"2023-11-15T01:39:02.613204+0000","last_became_active":"2023-11-15T01:39:02.604039+0000","last_became_peered":"2023-11-15T01:39:02.604039+0000","last_unstale":"2023-11-15T01:39:02.613204+0000","last_undegraded":"2023-11-15T01:39:02.613204+0000","last_fullsized":"2023-11-15T01:39:02.613204+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604468+0000","last_change":"2023-11-15T01:39:02.208432+0000","last_active":"2023-11-15T01:39:02.604468+0000","last_peered":"2023-11-15T01:39:02.604468+0000","last_clean":"2023-11-15T01:39:02.604468+0000","last_became_active":"2023-11-15T01:39:02.208125+0000","last_became_peered":"2023-11-15T01:39:02.208125+0000","last_unstale":"2023-11-15T01:39:02.604468+0000","last_undegraded":"2023-11-15T01:39:02.604468+0000","last_fullsized":"2023-11-15T01:39:02.604468+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619578+0000","last_change":"2023-11-15T01:39:02.615475+0000","last_active":"2023-11-15T01:39:02.619578+0000","last_peered":"2023-11-15T01:39:02.619578+0000","last_clean":"2023-11-15T01:39:02.619578+0000","last_became_active":"2023-11-15T01:39:02.615012+0000","last_became_peered":"2023-11-15T01:39:02.615012+0000","last_unstale":"2023-11-15T01:39:02.619578+0000","last_undegraded":"2023-11-15T01:39:02.619578+0000","last_fullsized":"2023-11-15T01:39:02.619578+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607240+0000","last_change":"2023-11-15T01:39:02.216489+0000","last_active":"2023-11-15T01:39:02.607240+0000","last_peered":"2023-11-15T01:39:02.607240+0000","last_clean":"2023-11-15T01:39:02.607240+0000","last_became_active":"2023-11-15T01:39:02.216208+0000","last_became_peered":"2023-11-15T01:39:02.216208+0000","last_unstale":"2023-11-15T01:39:02.607240+0000","last_undegraded":"2023-11-15T01:39:02.607240+0000","last_fullsized":"2023-11-15T01:39:02.607240+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619910+0000","last_change":"2023-11-15T01:39:02.614415+0000","last_active":"2023-11-15T01:39:02.619910+0000","last_peered":"2023-11-15T01:39:02.619910+0000","last_clean":"2023-11-15T01:39:02.619910+0000","last_became_active":"2023-11-15T01:39:02.614152+0000","last_became_peered":"2023-11-15T01:39:02.614152+0000","last_unstale":"2023-11-15T01:39:02.619910+0000","last_undegraded":"2023-11-15T01:39:02.619910+0000","last_fullsized":"2023-11-15T01:39:02.619910+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616182+0000","last_change":"2023-11-15T01:39:02.215445+0000","last_active":"2023-11-15T01:39:02.616182+0000","last_peered":"2023-11-15T01:39:02.616182+0000","last_clean":"2023-11-15T01:39:02.616182+0000","last_became_active":"2023-11-15T01:39:02.215164+0000","last_became_peered":"2023-11-15T01:39:02.215164+0000","last_unstale":"2023-11-15T01:39:02.616182+0000","last_undegraded":"2023-11-15T01:39:02.616182+0000","last_fullsized":"2023-11-15T01:39:02.616182+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617075+0000","last_change":"2023-11-15T01:39:02.612235+0000","last_active":"2023-11-15T01:39:02.617075+0000","last_peered":"2023-11-15T01:39:02.617075+0000","last_clean":"2023-11-15T01:39:02.617075+0000","last_became_active":"2023-11-15T01:39:02.611945+0000","last_became_peered":"2023-11-15T01:39:02.611945+0000","last_unstale":"2023-11-15T01:39:02.617075+0000","last_undegraded":"2023-11-15T01:39:02.617075+0000","last_fullsized":"2023-11-15T01:39:02.617075+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.600675+0000","last_change":"2023-11-15T01:39:02.212898+0000","last_active":"2023-11-15T01:39:02.600675+0000","last_peered":"2023-11-15T01:39:02.600675+0000","last_clean":"2023-11-15T01:39:02.600675+0000","last_became_active":"2023-11-15T01:39:02.211808+0000","last_became_peered":"2023-11-15T01:39:02.211808+0000","last_unstale":"2023-11-15T01:39:02.600675+0000","last_undegraded":"2023-11-15T01:39:02.600675+0000","last_fullsized":"2023-11-15T01:39:02.600675+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619471+0000","last_change":"2023-11-15T01:39:02.616010+0000","last_active":"2023-11-15T01:39:02.619471+0000","last_peered":"2023-11-15T01:39:02.619471+0000","last_clean":"2023-11-15T01:39:02.619471+0000","last_became_active":"2023-11-15T01:39:02.615676+0000","last_became_peered":"2023-11-15T01:39:02.615676+0000","last_unstale":"2023-11-15T01:39:02.619471+0000","last_undegraded":"2023-11-15T01:39:02.619471+0000","last_fullsized":"2023-11-15T01:39:02.619471+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587855+0000","last_change":"2023-11-15T01:39:02.215407+0000","last_active":"2023-11-15T01:39:02.587855+0000","last_peered":"2023-11-15T01:39:02.587855+0000","last_clean":"2023-11-15T01:39:02.587855+0000","last_became_active":"2023-11-15T01:39:02.214892+0000","last_became_peered":"2023-11-15T01:39:02.214892+0000","last_unstale":"2023-11-15T01:39:02.587855+0000","last_undegraded":"2023-11-15T01:39:02.587855+0000","last_fullsized":"2023-11-15T01:39:02.587855+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609760+0000","last_change":"2023-11-15T01:39:02.607451+0000","last_active":"2023-11-15T01:39:02.609760+0000","last_peered":"2023-11-15T01:39:02.609760+0000","last_clean":"2023-11-15T01:39:02.609760+0000","last_became_active":"2023-11-15T01:39:02.606494+0000","last_became_peered":"2023-11-15T01:39:02.606494+0000","last_unstale":"2023-11-15T01:39:02.609760+0000","last_undegraded":"2023-11-15T01:39:02.609760+0000","last_fullsized":"2023-11-15T01:39:02.609760+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.594989+0000","last_change":"2023-11-15T01:39:02.219867+0000","last_active":"2023-11-15T01:39:02.594989+0000","last_peered":"2023-11-15T01:39:02.594989+0000","last_clean":"2023-11-15T01:39:02.594989+0000","last_became_active":"2023-11-15T01:39:02.219549+0000","last_became_peered":"2023-11-15T01:39:02.219549+0000","last_unstale":"2023-11-15T01:39:02.594989+0000","last_undegraded":"2023-11-15T01:39:02.594989+0000","last_fullsized":"2023-11-15T01:39:02.594989+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615575+0000","last_change":"2023-11-15T01:39:02.614727+0000","last_active":"2023-11-15T01:39:02.615575+0000","last_peered":"2023-11-15T01:39:02.615575+0000","last_clean":"2023-11-15T01:39:02.615575+0000","last_became_active":"2023-11-15T01:39:02.614435+0000","last_became_peered":"2023-11-15T01:39:02.614435+0000","last_unstale":"2023-11-15T01:39:02.615575+0000","last_undegraded":"2023-11-15T01:39:02.615575+0000","last_fullsized":"2023-11-15T01:39:02.615575+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598319+0000","last_change":"2023-11-15T01:39:02.205172+0000","last_active":"2023-11-15T01:39:02.598319+0000","last_peered":"2023-11-15T01:39:02.598319+0000","last_clean":"2023-11-15T01:39:02.598319+0000","last_became_active":"2023-11-15T01:39:02.204880+0000","last_became_peered":"2023-11-15T01:39:02.204880+0000","last_unstale":"2023-11-15T01:39:02.598319+0000","last_undegraded":"2023-11-15T01:39:02.598319+0000","last_fullsized":"2023-11-15T01:39:02.598319+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.618919+0000","last_change":"2023-11-15T01:39:02.616562+0000","last_active":"2023-11-15T01:39:02.618919+0000","last_peered":"2023-11-15T01:39:02.618919+0000","last_clean":"2023-11-15T01:39:02.618919+0000","last_became_active":"2023-11-15T01:39:02.615953+0000","last_became_peered":"2023-11-15T01:39:02.615953+0000","last_unstale":"2023-11-15T01:39:02.618919+0000","last_undegraded":"2023-11-15T01:39:02.618919+0000","last_fullsized":"2023-11-15T01:39:02.618919+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.605080+0000","last_change":"2023-11-15T01:39:02.216519+0000","last_active":"2023-11-15T01:39:02.605080+0000","last_peered":"2023-11-15T01:39:02.605080+0000","last_clean":"2023-11-15T01:39:02.605080+0000","last_became_active":"2023-11-15T01:39:02.215863+0000","last_became_peered":"2023-11-15T01:39:02.215863+0000","last_unstale":"2023-11-15T01:39:02.605080+0000","last_undegraded":"2023-11-15T01:39:02.605080+0000","last_fullsized":"2023-11-15T01:39:02.605080+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617325+0000","last_change":"2023-11-15T01:39:02.616248+0000","last_active":"2023-11-15T01:39:02.617325+0000","last_peered":"2023-11-15T01:39:02.617325+0000","last_clean":"2023-11-15T01:39:02.617325+0000","last_became_active":"2023-11-15T01:39:02.615799+0000","last_became_peered":"2023-11-15T01:39:02.615799+0000","last_unstale":"2023-11-15T01:39:02.617325+0000","last_undegraded":"2023-11-15T01:39:02.617325+0000","last_fullsized":"2023-11-15T01:39:02.617325+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615681+0000","last_change":"2023-11-15T01:39:02.214198+0000","last_active":"2023-11-15T01:39:02.615681+0000","last_peered":"2023-11-15T01:39:02.615681+0000","last_clean":"2023-11-15T01:39:02.615681+0000","last_became_active":"2023-11-15T01:39:02.213807+0000","last_became_peered":"2023-11-15T01:39:02.213807+0000","last_unstale":"2023-11-15T01:39:02.615681+0000","last_undegraded":"2023-11-15T01:39:02.615681+0000","last_fullsized":"2023-11-15T01:39:02.615681+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608614+0000","last_change":"2023-11-15T01:39:02.603155+0000","last_active":"2023-11-15T01:39:02.608614+0000","last_peered":"2023-11-15T01:39:02.608614+0000","last_clean":"2023-11-15T01:39:02.608614+0000","last_became_active":"2023-11-15T01:39:02.602711+0000","last_became_peered":"2023-11-15T01:39:02.602711+0000","last_unstale":"2023-11-15T01:39:02.608614+0000","last_undegraded":"2023-11-15T01:39:02.608614+0000","last_fullsized":"2023-11-15T01:39:02.608614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604881+0000","last_change":"2023-11-15T01:39:02.216520+0000","last_active":"2023-11-15T01:39:02.604881+0000","last_peered":"2023-11-15T01:39:02.604881+0000","last_clean":"2023-11-15T01:39:02.604881+0000","last_became_active":"2023-11-15T01:39:02.216259+0000","last_became_peered":"2023-11-15T01:39:02.216259+0000","last_unstale":"2023-11-15T01:39:02.604881+0000","last_undegraded":"2023-11-15T01:39:02.604881+0000","last_fullsized":"2023-11-15T01:39:02.604881+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603577+0000","last_change":"2023-11-15T01:39:02.601591+0000","last_active":"2023-11-15T01:39:02.603577+0000","last_peered":"2023-11-15T01:39:02.603577+0000","last_clean":"2023-11-15T01:39:02.603577+0000","last_became_active":"2023-11-15T01:39:02.600935+0000","last_became_peered":"2023-11-15T01:39:02.600935+0000","last_unstale":"2023-11-15T01:39:02.603577+0000","last_undegraded":"2023-11-15T01:39:02.603577+0000","last_fullsized":"2023-11-15T01:39:02.603577+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593325+0000","last_change":"2023-11-15T01:39:02.208175+0000","last_active":"2023-11-15T01:39:02.593325+0000","last_peered":"2023-11-15T01:39:02.593325+0000","last_clean":"2023-11-15T01:39:02.593325+0000","last_became_active":"2023-11-15T01:39:02.206885+0000","last_became_peered":"2023-11-15T01:39:02.206885+0000","last_unstale":"2023-11-15T01:39:02.593325+0000","last_undegraded":"2023-11-15T01:39:02.593325+0000","last_fullsized":"2023-11-15T01:39:02.593325+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615601+0000","last_change":"2023-11-15T01:39:02.610080+0000","last_active":"2023-11-15T01:39:02.615601+0000","last_peered":"2023-11-15T01:39:02.615601+0000","last_clean":"2023-11-15T01:39:02.615601+0000","last_became_active":"2023-11-15T01:39:02.609739+0000","last_became_peered":"2023-11-15T01:39:02.609739+0000","last_unstale":"2023-11-15T01:39:02.615601+0000","last_undegraded":"2023-11-15T01:39:02.615601+0000","last_fullsized":"2023-11-15T01:39:02.615601+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.592262+0000","last_change":"2023-11-15T01:39:02.220136+0000","last_active":"2023-11-15T01:39:02.592262+0000","last_peered":"2023-11-15T01:39:02.592262+0000","last_clean":"2023-11-15T01:39:02.592262+0000","last_became_active":"2023-11-15T01:39:02.219849+0000","last_became_peered":"2023-11-15T01:39:02.219849+0000","last_unstale":"2023-11-15T01:39:02.592262+0000","last_undegraded":"2023-11-15T01:39:02.592262+0000","last_fullsized":"2023-11-15T01:39:02.592262+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617875+0000","last_change":"2023-11-15T01:39:02.617127+0000","last_active":"2023-11-15T01:39:02.617875+0000","last_peered":"2023-11-15T01:39:02.617875+0000","last_clean":"2023-11-15T01:39:02.617875+0000","last_became_active":"2023-11-15T01:39:02.616799+0000","last_became_peered":"2023-11-15T01:39:02.616799+0000","last_unstale":"2023-11-15T01:39:02.617875+0000","last_undegraded":"2023-11-15T01:39:02.617875+0000","last_fullsized":"2023-11-15T01:39:02.617875+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609923+0000","last_change":"2023-11-15T01:39:02.221702+0000","last_active":"2023-11-15T01:39:02.609923+0000","last_peered":"2023-11-15T01:39:02.609923+0000","last_clean":"2023-11-15T01:39:02.609923+0000","last_became_active":"2023-11-15T01:39:02.221488+0000","last_became_peered":"2023-11-15T01:39:02.221488+0000","last_unstale":"2023-11-15T01:39:02.609923+0000","last_undegraded":"2023-11-15T01:39:02.609923+0000","last_fullsized":"2023-11-15T01:39:02.609923+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619406+0000","last_change":"2023-11-15T01:39:02.615133+0000","last_active":"2023-11-15T01:39:02.619406+0000","last_peered":"2023-11-15T01:39:02.619406+0000","last_clean":"2023-11-15T01:39:02.619406+0000","last_became_active":"2023-11-15T01:39:02.614777+0000","last_became_peered":"2023-11-15T01:39:02.614777+0000","last_unstale":"2023-11-15T01:39:02.619406+0000","last_undegraded":"2023-11-15T01:39:02.619406+0000","last_fullsized":"2023-11-15T01:39:02.619406+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.589698+0000","last_change":"2023-11-15T01:39:02.218107+0000","last_active":"2023-11-15T01:39:02.589698+0000","last_peered":"2023-11-15T01:39:02.589698+0000","last_clean":"2023-11-15T01:39:02.589698+0000","last_became_active":"2023-11-15T01:39:02.217829+0000","last_became_peered":"2023-11-15T01:39:02.217829+0000","last_unstale":"2023-11-15T01:39:02.589698+0000","last_undegraded":"2023-11-15T01:39:02.589698+0000","last_fullsized":"2023-11-15T01:39:02.589698+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619811+0000","last_change":"2023-11-15T01:39:02.616657+0000","last_active":"2023-11-15T01:39:02.619811+0000","last_peered":"2023-11-15T01:39:02.619811+0000","last_clean":"2023-11-15T01:39:02.619811+0000","last_became_active":"2023-11-15T01:39:02.616181+0000","last_became_peered":"2023-11-15T01:39:02.616181+0000","last_unstale":"2023-11-15T01:39:02.619811+0000","last_undegraded":"2023-11-15T01:39:02.619811+0000","last_fullsized":"2023-11-15T01:39:02.619811+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.594904+0000","last_change":"2023-11-15T01:39:02.218103+0000","last_active":"2023-11-15T01:39:02.594904+0000","last_peered":"2023-11-15T01:39:02.594904+0000","last_clean":"2023-11-15T01:39:02.594904+0000","last_became_active":"2023-11-15T01:39:02.217828+0000","last_became_peered":"2023-11-15T01:39:02.217828+0000","last_unstale":"2023-11-15T01:39:02.594904+0000","last_undegraded":"2023-11-15T01:39:02.594904+0000","last_fullsized":"2023-11-15T01:39:02.594904+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613941+0000","last_change":"2023-11-15T01:39:02.610781+0000","last_active":"2023-11-15T01:39:02.613941+0000","last_peered":"2023-11-15T01:39:02.613941+0000","last_clean":"2023-11-15T01:39:02.613941+0000","last_became_active":"2023-11-15T01:39:02.610465+0000","last_became_peered":"2023-11-15T01:39:02.610465+0000","last_unstale":"2023-11-15T01:39:02.613941+0000","last_undegraded":"2023-11-15T01:39:02.613941+0000","last_fullsized":"2023-11-15T01:39:02.613941+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.605850+0000","last_change":"2023-11-15T01:39:02.207964+0000","last_active":"2023-11-15T01:39:02.605850+0000","last_peered":"2023-11-15T01:39:02.605850+0000","last_clean":"2023-11-15T01:39:02.605850+0000","last_became_active":"2023-11-15T01:39:02.206902+0000","last_became_peered":"2023-11-15T01:39:02.206902+0000","last_unstale":"2023-11-15T01:39:02.605850+0000","last_undegraded":"2023-11-15T01:39:02.605850+0000","last_fullsized":"2023-11-15T01:39:02.605850+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617013+0000","last_change":"2023-11-15T01:39:02.615878+0000","last_active":"2023-11-15T01:39:02.617013+0000","last_peered":"2023-11-15T01:39:02.617013+0000","last_clean":"2023-11-15T01:39:02.617013+0000","last_became_active":"2023-11-15T01:39:02.615584+0000","last_became_peered":"2023-11-15T01:39:02.615584+0000","last_unstale":"2023-11-15T01:39:02.617013+0000","last_undegraded":"2023-11-15T01:39:02.617013+0000","last_fullsized":"2023-11-15T01:39:02.617013+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.595065+0000","last_change":"2023-11-15T01:39:02.216952+0000","last_active":"2023-11-15T01:39:02.595065+0000","last_peered":"2023-11-15T01:39:02.595065+0000","last_clean":"2023-11-15T01:39:02.595065+0000","last_became_active":"2023-11-15T01:39:02.216649+0000","last_became_peered":"2023-11-15T01:39:02.216649+0000","last_unstale":"2023-11-15T01:39:02.595065+0000","last_undegraded":"2023-11-15T01:39:02.595065+0000","last_fullsized":"2023-11-15T01:39:02.595065+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608591+0000","last_change":"2023-11-15T01:39:02.602985+0000","last_active":"2023-11-15T01:39:02.608591+0000","last_peered":"2023-11-15T01:39:02.608591+0000","last_clean":"2023-11-15T01:39:02.608591+0000","last_became_active":"2023-11-15T01:39:02.602397+0000","last_became_peered":"2023-11-15T01:39:02.602397+0000","last_unstale":"2023-11-15T01:39:02.608591+0000","last_undegraded":"2023-11-15T01:39:02.608591+0000","last_fullsized":"2023-11-15T01:39:02.608591+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.602956+0000","last_change":"2023-11-15T01:39:02.206395+0000","last_active":"2023-11-15T01:39:02.602956+0000","last_peered":"2023-11-15T01:39:02.602956+0000","last_clean":"2023-11-15T01:39:02.602956+0000","last_became_active":"2023-11-15T01:39:02.206104+0000","last_became_peered":"2023-11-15T01:39:02.206104+0000","last_unstale":"2023-11-15T01:39:02.602956+0000","last_undegraded":"2023-11-15T01:39:02.602956+0000","last_fullsized":"2023-11-15T01:39:02.602956+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619975+0000","last_change":"2023-11-15T01:39:02.615104+0000","last_active":"2023-11-15T01:39:02.619975+0000","last_peered":"2023-11-15T01:39:02.619975+0000","last_clean":"2023-11-15T01:39:02.619975+0000","last_became_active":"2023-11-15T01:39:02.614137+0000","last_became_peered":"2023-11-15T01:39:02.614137+0000","last_unstale":"2023-11-15T01:39:02.619975+0000","last_undegraded":"2023-11-15T01:39:02.619975+0000","last_fullsized":"2023-11-15T01:39:02.619975+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587393+0000","last_change":"2023-11-15T01:39:02.211558+0000","last_active":"2023-11-15T01:39:02.587393+0000","last_peered":"2023-11-15T01:39:02.587393+0000","last_clean":"2023-11-15T01:39:02.587393+0000","last_became_active":"2023-11-15T01:39:02.211279+0000","last_became_peered":"2023-11-15T01:39:02.211279+0000","last_unstale":"2023-11-15T01:39:02.587393+0000","last_undegraded":"2023-11-15T01:39:02.587393+0000","last_fullsized":"2023-11-15T01:39:02.587393+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609748+0000","last_change":"2023-11-15T01:39:02.607093+0000","last_active":"2023-11-15T01:39:02.609748+0000","last_peered":"2023-11-15T01:39:02.609748+0000","last_clean":"2023-11-15T01:39:02.609748+0000","last_became_active":"2023-11-15T01:39:02.606809+0000","last_became_peered":"2023-11-15T01:39:02.606809+0000","last_unstale":"2023-11-15T01:39:02.609748+0000","last_undegraded":"2023-11-15T01:39:02.609748+0000","last_fullsized":"2023-11-15T01:39:02.609748+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587388+0000","last_change":"2023-11-15T01:39:02.211455+0000","last_active":"2023-11-15T01:39:02.587388+0000","last_peered":"2023-11-15T01:39:02.587388+0000","last_clean":"2023-11-15T01:39:02.587388+0000","last_became_active":"2023-11-15T01:39:02.211174+0000","last_became_peered":"2023-11-15T01:39:02.211174+0000","last_unstale":"2023-11-15T01:39:02.587388+0000","last_undegraded":"2023-11-15T01:39:02.587388+0000","last_fullsized":"2023-11-15T01:39:02.587388+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611523+0000","last_change":"2023-11-15T01:39:02.608672+0000","last_active":"2023-11-15T01:39:02.611523+0000","last_peered":"2023-11-15T01:39:02.611523+0000","last_clean":"2023-11-15T01:39:02.611523+0000","last_became_active":"2023-11-15T01:39:02.608345+0000","last_became_peered":"2023-11-15T01:39:02.608345+0000","last_unstale":"2023-11-15T01:39:02.611523+0000","last_undegraded":"2023-11-15T01:39:02.611523+0000","last_fullsized":"2023-11-15T01:39:02.611523+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.600509+0000","last_change":"2023-11-15T01:39:02.221210+0000","last_active":"2023-11-15T01:39:02.600509+0000","last_peered":"2023-11-15T01:39:02.600509+0000","last_clean":"2023-11-15T01:39:02.600509+0000","last_became_active":"2023-11-15T01:39:02.220954+0000","last_became_peered":"2023-11-15T01:39:02.220954+0000","last_unstale":"2023-11-15T01:39:02.600509+0000","last_undegraded":"2023-11-15T01:39:02.600509+0000","last_fullsized":"2023-11-15T01:39:02.600509+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616556+0000","last_change":"2023-11-15T01:39:02.613660+0000","last_active":"2023-11-15T01:39:02.616556+0000","last_peered":"2023-11-15T01:39:02.616556+0000","last_clean":"2023-11-15T01:39:02.616556+0000","last_became_active":"2023-11-15T01:39:02.613366+0000","last_became_peered":"2023-11-15T01:39:02.613366+0000","last_unstale":"2023-11-15T01:39:02.616556+0000","last_undegraded":"2023-11-15T01:39:02.616556+0000","last_fullsized":"2023-11-15T01:39:02.616556+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598361+0000","last_change":"2023-11-15T01:39:02.215823+0000","last_active":"2023-11-15T01:39:02.598361+0000","last_peered":"2023-11-15T01:39:02.598361+0000","last_clean":"2023-11-15T01:39:02.598361+0000","last_became_active":"2023-11-15T01:39:02.215525+0000","last_became_peered":"2023-11-15T01:39:02.215525+0000","last_unstale":"2023-11-15T01:39:02.598361+0000","last_undegraded":"2023-11-15T01:39:02.598361+0000","last_fullsized":"2023-11-15T01:39:02.598361+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.614005+0000","last_change":"2023-11-15T01:39:02.609396+0000","last_active":"2023-11-15T01:39:02.614005+0000","last_peered":"2023-11-15T01:39:02.614005+0000","last_clean":"2023-11-15T01:39:02.614005+0000","last_became_active":"2023-11-15T01:39:02.609124+0000","last_became_peered":"2023-11-15T01:39:02.609124+0000","last_unstale":"2023-11-15T01:39:02.614005+0000","last_undegraded":"2023-11-15T01:39:02.614005+0000","last_fullsized":"2023-11-15T01:39:02.614005+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"126'1","reported_seq":11,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-11-15T01:39:03.805129+0000","last_change":"2023-11-15T01:39:02.216539+0000","last_active":"2023-11-15T01:39:03.805129+0000","last_peered":"2023-11-15T01:39:03.805129+0000","last_clean":"2023-11-15T01:39:03.805129+0000","last_became_active":"2023-11-15T01:39:02.216251+0000","last_became_peered":"2023-11-15T01:39:02.216251+0000","last_unstale":"2023-11-15T01:39:03.805129+0000","last_undegraded":"2023-11-15T01:39:03.805129+0000","last_fullsized":"2023-11-15T01:39:03.805129+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.614176+0000","last_change":"2023-11-15T01:39:02.610179+0000","last_active":"2023-11-15T01:39:02.614176+0000","last_peered":"2023-11-15T01:39:02.614176+0000","last_clean":"2023-11-15T01:39:02.614176+0000","last_became_active":"2023-11-15T01:39:02.609897+0000","last_became_peered":"2023-11-15T01:39:02.609897+0000","last_unstale":"2023-11-15T01:39:02.614176+0000","last_undegraded":"2023-11-15T01:39:02.614176+0000","last_fullsized":"2023-11-15T01:39:02.614176+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604810+0000","last_change":"2023-11-15T01:39:02.216694+0000","last_active":"2023-11-15T01:39:02.604810+0000","last_peered":"2023-11-15T01:39:02.604810+0000","last_clean":"2023-11-15T01:39:02.604810+0000","last_became_active":"2023-11-15T01:39:02.216225+0000","last_became_peered":"2023-11-15T01:39:02.216225+0000","last_unstale":"2023-11-15T01:39:02.604810+0000","last_undegraded":"2023-11-15T01:39:02.604810+0000","last_fullsized":"2023-11-15T01:39:02.604810+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609871+0000","last_change":"2023-11-15T01:39:02.608291+0000","last_active":"2023-11-15T01:39:02.609871+0000","last_peered":"2023-11-15T01:39:02.609871+0000","last_clean":"2023-11-15T01:39:02.609871+0000","last_became_active":"2023-11-15T01:39:02.608031+0000","last_became_peered":"2023-11-15T01:39:02.608031+0000","last_unstale":"2023-11-15T01:39:02.609871+0000","last_undegraded":"2023-11-15T01:39:02.609871+0000","last_fullsized":"2023-11-15T01:39:02.609871+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597800+0000","last_change":"2023-11-15T01:39:02.216727+0000","last_active":"2023-11-15T01:39:02.597800+0000","last_peered":"2023-11-15T01:39:02.597800+0000","last_clean":"2023-11-15T01:39:02.597800+0000","last_became_active":"2023-11-15T01:39:02.216418+0000","last_became_peered":"2023-11-15T01:39:02.216418+0000","last_unstale":"2023-11-15T01:39:02.597800+0000","last_undegraded":"2023-11-15T01:39:02.597800+0000","last_fullsized":"2023-11-15T01:39:02.597800+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609371+0000","last_change":"2023-11-15T01:39:02.607331+0000","last_active":"2023-11-15T01:39:02.609371+0000","last_peered":"2023-11-15T01:39:02.609371+0000","last_clean":"2023-11-15T01:39:02.609371+0000","last_became_active":"2023-11-15T01:39:02.605984+0000","last_became_peered":"2023-11-15T01:39:02.605984+0000","last_unstale":"2023-11-15T01:39:02.609371+0000","last_undegraded":"2023-11-15T01:39:02.609371+0000","last_fullsized":"2023-11-15T01:39:02.609371+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.587486+0000","last_change":"2023-11-15T01:39:02.221244+0000","last_active":"2023-11-15T01:39:02.587486+0000","last_peered":"2023-11-15T01:39:02.587486+0000","last_clean":"2023-11-15T01:39:02.587486+0000","last_became_active":"2023-11-15T01:39:02.220925+0000","last_became_peered":"2023-11-15T01:39:02.220925+0000","last_unstale":"2023-11-15T01:39:02.587486+0000","last_undegraded":"2023-11-15T01:39:02.587486+0000","last_fullsized":"2023-11-15T01:39:02.587486+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617865+0000","last_change":"2023-11-15T01:39:02.617229+0000","last_active":"2023-11-15T01:39:02.617865+0000","last_peered":"2023-11-15T01:39:02.617865+0000","last_clean":"2023-11-15T01:39:02.617865+0000","last_became_active":"2023-11-15T01:39:02.616939+0000","last_became_peered":"2023-11-15T01:39:02.616939+0000","last_unstale":"2023-11-15T01:39:02.617865+0000","last_undegraded":"2023-11-15T01:39:02.617865+0000","last_fullsized":"2023-11-15T01:39:02.617865+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593426+0000","last_change":"2023-11-15T01:39:02.221666+0000","last_active":"2023-11-15T01:39:02.593426+0000","last_peered":"2023-11-15T01:39:02.593426+0000","last_clean":"2023-11-15T01:39:02.593426+0000","last_became_active":"2023-11-15T01:39:02.219800+0000","last_became_peered":"2023-11-15T01:39:02.219800+0000","last_unstale":"2023-11-15T01:39:02.593426+0000","last_undegraded":"2023-11-15T01:39:02.593426+0000","last_fullsized":"2023-11-15T01:39:02.593426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604011+0000","last_change":"2023-11-15T01:39:02.602358+0000","last_active":"2023-11-15T01:39:02.604011+0000","last_peered":"2023-11-15T01:39:02.604011+0000","last_clean":"2023-11-15T01:39:02.604011+0000","last_became_active":"2023-11-15T01:39:02.601545+0000","last_became_peered":"2023-11-15T01:39:02.601545+0000","last_unstale":"2023-11-15T01:39:02.604011+0000","last_undegraded":"2023-11-15T01:39:02.604011+0000","last_fullsized":"2023-11-15T01:39:02.604011+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.592380+0000","last_change":"2023-11-15T01:39:02.216213+0000","last_active":"2023-11-15T01:39:02.592380+0000","last_peered":"2023-11-15T01:39:02.592380+0000","last_clean":"2023-11-15T01:39:02.592380+0000","last_became_active":"2023-11-15T01:39:02.215899+0000","last_became_peered":"2023-11-15T01:39:02.215899+0000","last_unstale":"2023-11-15T01:39:02.592380+0000","last_undegraded":"2023-11-15T01:39:02.592380+0000","last_fullsized":"2023-11-15T01:39:02.592380+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608705+0000","last_change":"2023-11-15T01:39:02.604261+0000","last_active":"2023-11-15T01:39:02.608705+0000","last_peered":"2023-11-15T01:39:02.608705+0000","last_clean":"2023-11-15T01:39:02.608705+0000","last_became_active":"2023-11-15T01:39:02.603967+0000","last_became_peered":"2023-11-15T01:39:02.603967+0000","last_unstale":"2023-11-15T01:39:02.608705+0000","last_undegraded":"2023-11-15T01:39:02.608705+0000","last_fullsized":"2023-11-15T01:39:02.608705+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.600917+0000","last_change":"2023-11-15T01:39:02.212132+0000","last_active":"2023-11-15T01:39:02.600917+0000","last_peered":"2023-11-15T01:39:02.600917+0000","last_clean":"2023-11-15T01:39:02.600917+0000","last_became_active":"2023-11-15T01:39:02.210392+0000","last_became_peered":"2023-11-15T01:39:02.210392+0000","last_unstale":"2023-11-15T01:39:02.600917+0000","last_undegraded":"2023-11-15T01:39:02.600917+0000","last_fullsized":"2023-11-15T01:39:02.600917+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603584+0000","last_change":"2023-11-15T01:39:02.600884+0000","last_active":"2023-11-15T01:39:02.603584+0000","last_peered":"2023-11-15T01:39:02.603584+0000","last_clean":"2023-11-15T01:39:02.603584+0000","last_became_active":"2023-11-15T01:39:02.600570+0000","last_became_peered":"2023-11-15T01:39:02.600570+0000","last_unstale":"2023-11-15T01:39:02.603584+0000","last_undegraded":"2023-11-15T01:39:02.603584+0000","last_fullsized":"2023-11-15T01:39:02.603584+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604360+0000","last_change":"2023-11-15T01:39:02.216713+0000","last_active":"2023-11-15T01:39:02.604360+0000","last_peered":"2023-11-15T01:39:02.604360+0000","last_clean":"2023-11-15T01:39:02.604360+0000","last_became_active":"2023-11-15T01:39:02.216444+0000","last_became_peered":"2023-11-15T01:39:02.216444+0000","last_unstale":"2023-11-15T01:39:02.604360+0000","last_undegraded":"2023-11-15T01:39:02.604360+0000","last_fullsized":"2023-11-15T01:39:02.604360+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615377+0000","last_change":"2023-11-15T01:39:02.613239+0000","last_active":"2023-11-15T01:39:02.615377+0000","last_peered":"2023-11-15T01:39:02.615377+0000","last_clean":"2023-11-15T01:39:02.615377+0000","last_became_active":"2023-11-15T01:39:02.612946+0000","last_became_peered":"2023-11-15T01:39:02.612946+0000","last_unstale":"2023-11-15T01:39:02.615377+0000","last_undegraded":"2023-11-15T01:39:02.615377+0000","last_fullsized":"2023-11-15T01:39:02.615377+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.596143+0000","last_change":"2023-11-15T01:39:02.209925+0000","last_active":"2023-11-15T01:39:02.596143+0000","last_peered":"2023-11-15T01:39:02.596143+0000","last_clean":"2023-11-15T01:39:02.596143+0000","last_became_active":"2023-11-15T01:39:02.209663+0000","last_became_peered":"2023-11-15T01:39:02.209663+0000","last_unstale":"2023-11-15T01:39:02.596143+0000","last_undegraded":"2023-11-15T01:39:02.596143+0000","last_fullsized":"2023-11-15T01:39:02.596143+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609247+0000","last_change":"2023-11-15T01:39:02.608245+0000","last_active":"2023-11-15T01:39:02.609247+0000","last_peered":"2023-11-15T01:39:02.609247+0000","last_clean":"2023-11-15T01:39:02.609247+0000","last_became_active":"2023-11-15T01:39:02.607952+0000","last_became_peered":"2023-11-15T01:39:02.607952+0000","last_unstale":"2023-11-15T01:39:02.609247+0000","last_undegraded":"2023-11-15T01:39:02.609247+0000","last_fullsized":"2023-11-15T01:39:02.609247+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607666+0000","last_change":"2023-11-15T01:39:02.212445+0000","last_active":"2023-11-15T01:39:02.607666+0000","last_peered":"2023-11-15T01:39:02.607666+0000","last_clean":"2023-11-15T01:39:02.607666+0000","last_became_active":"2023-11-15T01:39:02.212161+0000","last_became_peered":"2023-11-15T01:39:02.212161+0000","last_unstale":"2023-11-15T01:39:02.607666+0000","last_undegraded":"2023-11-15T01:39:02.607666+0000","last_fullsized":"2023-11-15T01:39:02.607666+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.620038+0000","last_change":"2023-11-15T01:39:02.615695+0000","last_active":"2023-11-15T01:39:02.620038+0000","last_peered":"2023-11-15T01:39:02.620038+0000","last_clean":"2023-11-15T01:39:02.620038+0000","last_became_active":"2023-11-15T01:39:02.615400+0000","last_became_peered":"2023-11-15T01:39:02.615400+0000","last_unstale":"2023-11-15T01:39:02.620038+0000","last_undegraded":"2023-11-15T01:39:02.620038+0000","last_fullsized":"2023-11-15T01:39:02.620038+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.601003+0000","last_change":"2023-11-15T01:39:02.212296+0000","last_active":"2023-11-15T01:39:02.601003+0000","last_peered":"2023-11-15T01:39:02.601003+0000","last_clean":"2023-11-15T01:39:02.601003+0000","last_became_active":"2023-11-15T01:39:02.211995+0000","last_became_peered":"2023-11-15T01:39:02.211995+0000","last_unstale":"2023-11-15T01:39:02.601003+0000","last_undegraded":"2023-11-15T01:39:02.601003+0000","last_fullsized":"2023-11-15T01:39:02.601003+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609392+0000","last_change":"2023-11-15T01:39:02.607853+0000","last_active":"2023-11-15T01:39:02.609392+0000","last_peered":"2023-11-15T01:39:02.609392+0000","last_clean":"2023-11-15T01:39:02.609392+0000","last_became_active":"2023-11-15T01:39:02.607594+0000","last_became_peered":"2023-11-15T01:39:02.607594+0000","last_unstale":"2023-11-15T01:39:02.609392+0000","last_undegraded":"2023-11-15T01:39:02.609392+0000","last_fullsized":"2023-11-15T01:39:02.609392+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604067+0000","last_change":"2023-11-15T01:39:02.213094+0000","last_active":"2023-11-15T01:39:02.604067+0000","last_peered":"2023-11-15T01:39:02.604067+0000","last_clean":"2023-11-15T01:39:02.604067+0000","last_became_active":"2023-11-15T01:39:02.212785+0000","last_became_peered":"2023-11-15T01:39:02.212785+0000","last_unstale":"2023-11-15T01:39:02.604067+0000","last_undegraded":"2023-11-15T01:39:02.604067+0000","last_fullsized":"2023-11-15T01:39:02.604067+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.603556+0000","last_change":"2023-11-15T01:39:02.601396+0000","last_active":"2023-11-15T01:39:02.603556+0000","last_peered":"2023-11-15T01:39:02.603556+0000","last_clean":"2023-11-15T01:39:02.603556+0000","last_became_active":"2023-11-15T01:39:02.601172+0000","last_became_peered":"2023-11-15T01:39:02.601172+0000","last_unstale":"2023-11-15T01:39:02.603556+0000","last_undegraded":"2023-11-15T01:39:02.603556+0000","last_fullsized":"2023-11-15T01:39:02.603556+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606548+0000","last_change":"2023-11-15T01:39:02.214549+0000","last_active":"2023-11-15T01:39:02.606548+0000","last_peered":"2023-11-15T01:39:02.606548+0000","last_clean":"2023-11-15T01:39:02.606548+0000","last_became_active":"2023-11-15T01:39:02.214264+0000","last_became_peered":"2023-11-15T01:39:02.214264+0000","last_unstale":"2023-11-15T01:39:02.606548+0000","last_undegraded":"2023-11-15T01:39:02.606548+0000","last_fullsized":"2023-11-15T01:39:02.606548+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619529+0000","last_change":"2023-11-15T01:39:02.614609+0000","last_active":"2023-11-15T01:39:02.619529+0000","last_peered":"2023-11-15T01:39:02.619529+0000","last_clean":"2023-11-15T01:39:02.619529+0000","last_became_active":"2023-11-15T01:39:02.614307+0000","last_became_peered":"2023-11-15T01:39:02.614307+0000","last_unstale":"2023-11-15T01:39:02.619529+0000","last_undegraded":"2023-11-15T01:39:02.619529+0000","last_fullsized":"2023-11-15T01:39:02.619529+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593584+0000","last_change":"2023-11-15T01:39:02.213334+0000","last_active":"2023-11-15T01:39:02.593584+0000","last_peered":"2023-11-15T01:39:02.593584+0000","last_clean":"2023-11-15T01:39:02.593584+0000","last_became_active":"2023-11-15T01:39:02.212950+0000","last_became_peered":"2023-11-15T01:39:02.212950+0000","last_unstale":"2023-11-15T01:39:02.593584+0000","last_undegraded":"2023-11-15T01:39:02.593584+0000","last_fullsized":"2023-11-15T01:39:02.593584+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607206+0000","last_change":"2023-11-15T01:39:02.605916+0000","last_active":"2023-11-15T01:39:02.607206+0000","last_peered":"2023-11-15T01:39:02.607206+0000","last_clean":"2023-11-15T01:39:02.607206+0000","last_became_active":"2023-11-15T01:39:02.605221+0000","last_became_peered":"2023-11-15T01:39:02.605221+0000","last_unstale":"2023-11-15T01:39:02.607206+0000","last_undegraded":"2023-11-15T01:39:02.607206+0000","last_fullsized":"2023-11-15T01:39:02.607206+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.592684+0000","last_change":"2023-11-15T01:39:02.214571+0000","last_active":"2023-11-15T01:39:02.592684+0000","last_peered":"2023-11-15T01:39:02.592684+0000","last_clean":"2023-11-15T01:39:02.592684+0000","last_became_active":"2023-11-15T01:39:02.214277+0000","last_became_peered":"2023-11-15T01:39:02.214277+0000","last_unstale":"2023-11-15T01:39:02.592684+0000","last_undegraded":"2023-11-15T01:39:02.592684+0000","last_fullsized":"2023-11-15T01:39:02.592684+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606587+0000","last_change":"2023-11-15T01:39:02.602418+0000","last_active":"2023-11-15T01:39:02.606587+0000","last_peered":"2023-11-15T01:39:02.606587+0000","last_clean":"2023-11-15T01:39:02.606587+0000","last_became_active":"2023-11-15T01:39:02.602063+0000","last_became_peered":"2023-11-15T01:39:02.602063+0000","last_unstale":"2023-11-15T01:39:02.606587+0000","last_undegraded":"2023-11-15T01:39:02.606587+0000","last_fullsized":"2023-11-15T01:39:02.606587+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.595019+0000","last_change":"2023-11-15T01:39:02.212659+0000","last_active":"2023-11-15T01:39:02.595019+0000","last_peered":"2023-11-15T01:39:02.595019+0000","last_clean":"2023-11-15T01:39:02.595019+0000","last_became_active":"2023-11-15T01:39:02.212415+0000","last_became_peered":"2023-11-15T01:39:02.212415+0000","last_unstale":"2023-11-15T01:39:02.595019+0000","last_undegraded":"2023-11-15T01:39:02.595019+0000","last_fullsized":"2023-11-15T01:39:02.595019+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.618320+0000","last_change":"2023-11-15T01:39:02.614637+0000","last_active":"2023-11-15T01:39:02.618320+0000","last_peered":"2023-11-15T01:39:02.618320+0000","last_clean":"2023-11-15T01:39:02.618320+0000","last_became_active":"2023-11-15T01:39:02.614343+0000","last_became_peered":"2023-11-15T01:39:02.614343+0000","last_unstale":"2023-11-15T01:39:02.618320+0000","last_undegraded":"2023-11-15T01:39:02.618320+0000","last_fullsized":"2023-11-15T01:39:02.618320+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588382+0000","last_change":"2023-11-15T01:39:02.216949+0000","last_active":"2023-11-15T01:39:02.588382+0000","last_peered":"2023-11-15T01:39:02.588382+0000","last_clean":"2023-11-15T01:39:02.588382+0000","last_became_active":"2023-11-15T01:39:02.216678+0000","last_became_peered":"2023-11-15T01:39:02.216678+0000","last_unstale":"2023-11-15T01:39:02.588382+0000","last_undegraded":"2023-11-15T01:39:02.588382+0000","last_fullsized":"2023-11-15T01:39:02.588382+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615337+0000","last_change":"2023-11-15T01:39:02.613451+0000","last_active":"2023-11-15T01:39:02.615337+0000","last_peered":"2023-11-15T01:39:02.615337+0000","last_clean":"2023-11-15T01:39:02.615337+0000","last_became_active":"2023-11-15T01:39:02.613039+0000","last_became_peered":"2023-11-15T01:39:02.613039+0000","last_unstale":"2023-11-15T01:39:02.615337+0000","last_undegraded":"2023-11-15T01:39:02.615337+0000","last_fullsized":"2023-11-15T01:39:02.615337+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611662+0000","last_change":"2023-11-15T01:39:02.221508+0000","last_active":"2023-11-15T01:39:02.611662+0000","last_peered":"2023-11-15T01:39:02.611662+0000","last_clean":"2023-11-15T01:39:02.611662+0000","last_became_active":"2023-11-15T01:39:02.221203+0000","last_became_peered":"2023-11-15T01:39:02.221203+0000","last_unstale":"2023-11-15T01:39:02.611662+0000","last_undegraded":"2023-11-15T01:39:02.611662+0000","last_fullsized":"2023-11-15T01:39:02.611662+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.617294+0000","last_change":"2023-11-15T01:39:02.614533+0000","last_active":"2023-11-15T01:39:02.617294+0000","last_peered":"2023-11-15T01:39:02.617294+0000","last_clean":"2023-11-15T01:39:02.617294+0000","last_became_active":"2023-11-15T01:39:02.614181+0000","last_became_peered":"2023-11-15T01:39:02.614181+0000","last_unstale":"2023-11-15T01:39:02.617294+0000","last_undegraded":"2023-11-15T01:39:02.617294+0000","last_fullsized":"2023-11-15T01:39:02.617294+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611758+0000","last_change":"2023-11-15T01:39:02.215496+0000","last_active":"2023-11-15T01:39:02.611758+0000","last_peered":"2023-11-15T01:39:02.611758+0000","last_clean":"2023-11-15T01:39:02.611758+0000","last_became_active":"2023-11-15T01:39:02.215218+0000","last_became_peered":"2023-11-15T01:39:02.215218+0000","last_unstale":"2023-11-15T01:39:02.611758+0000","last_undegraded":"2023-11-15T01:39:02.611758+0000","last_fullsized":"2023-11-15T01:39:02.611758+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619900+0000","last_change":"2023-11-15T01:39:02.614359+0000","last_active":"2023-11-15T01:39:02.619900+0000","last_peered":"2023-11-15T01:39:02.619900+0000","last_clean":"2023-11-15T01:39:02.619900+0000","last_became_active":"2023-11-15T01:39:02.614072+0000","last_became_peered":"2023-11-15T01:39:02.614072+0000","last_unstale":"2023-11-15T01:39:02.619900+0000","last_undegraded":"2023-11-15T01:39:02.619900+0000","last_fullsized":"2023-11-15T01:39:02.619900+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613955+0000","last_change":"2023-11-15T01:39:02.218556+0000","last_active":"2023-11-15T01:39:02.613955+0000","last_peered":"2023-11-15T01:39:02.613955+0000","last_clean":"2023-11-15T01:39:02.613955+0000","last_became_active":"2023-11-15T01:39:02.218223+0000","last_became_peered":"2023-11-15T01:39:02.218223+0000","last_unstale":"2023-11-15T01:39:02.613955+0000","last_undegraded":"2023-11-15T01:39:02.613955+0000","last_fullsized":"2023-11-15T01:39:02.613955+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611507+0000","last_change":"2023-11-15T01:39:02.607095+0000","last_active":"2023-11-15T01:39:02.611507+0000","last_peered":"2023-11-15T01:39:02.611507+0000","last_clean":"2023-11-15T01:39:02.611507+0000","last_became_active":"2023-11-15T01:39:02.606862+0000","last_became_peered":"2023-11-15T01:39:02.606862+0000","last_unstale":"2023-11-15T01:39:02.611507+0000","last_undegraded":"2023-11-15T01:39:02.611507+0000","last_fullsized":"2023-11-15T01:39:02.611507+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.591994+0000","last_change":"2023-11-15T01:39:02.208100+0000","last_active":"2023-11-15T01:39:02.591994+0000","last_peered":"2023-11-15T01:39:02.591994+0000","last_clean":"2023-11-15T01:39:02.591994+0000","last_became_active":"2023-11-15T01:39:02.207787+0000","last_became_peered":"2023-11-15T01:39:02.207787+0000","last_unstale":"2023-11-15T01:39:02.591994+0000","last_undegraded":"2023-11-15T01:39:02.591994+0000","last_fullsized":"2023-11-15T01:39:02.591994+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.612658+0000","last_change":"2023-11-15T01:39:02.603012+0000","last_active":"2023-11-15T01:39:02.612658+0000","last_peered":"2023-11-15T01:39:02.612658+0000","last_clean":"2023-11-15T01:39:02.612658+0000","last_became_active":"2023-11-15T01:39:02.602782+0000","last_became_peered":"2023-11-15T01:39:02.602782+0000","last_unstale":"2023-11-15T01:39:02.612658+0000","last_undegraded":"2023-11-15T01:39:02.612658+0000","last_fullsized":"2023-11-15T01:39:02.612658+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593111+0000","last_change":"2023-11-15T01:39:02.211688+0000","last_active":"2023-11-15T01:39:02.593111+0000","last_peered":"2023-11-15T01:39:02.593111+0000","last_clean":"2023-11-15T01:39:02.593111+0000","last_became_active":"2023-11-15T01:39:02.211393+0000","last_became_peered":"2023-11-15T01:39:02.211393+0000","last_unstale":"2023-11-15T01:39:02.593111+0000","last_undegraded":"2023-11-15T01:39:02.593111+0000","last_fullsized":"2023-11-15T01:39:02.593111+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.616897+0000","last_change":"2023-11-15T01:39:02.614804+0000","last_active":"2023-11-15T01:39:02.616897+0000","last_peered":"2023-11-15T01:39:02.616897+0000","last_clean":"2023-11-15T01:39:02.616897+0000","last_became_active":"2023-11-15T01:39:02.614516+0000","last_became_peered":"2023-11-15T01:39:02.614516+0000","last_unstale":"2023-11-15T01:39:02.616897+0000","last_undegraded":"2023-11-15T01:39:02.616897+0000","last_fullsized":"2023-11-15T01:39:02.616897+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607913+0000","last_change":"2023-11-15T01:39:02.212073+0000","last_active":"2023-11-15T01:39:02.607913+0000","last_peered":"2023-11-15T01:39:02.607913+0000","last_clean":"2023-11-15T01:39:02.607913+0000","last_became_active":"2023-11-15T01:39:02.211789+0000","last_became_peered":"2023-11-15T01:39:02.211789+0000","last_unstale":"2023-11-15T01:39:02.607913+0000","last_undegraded":"2023-11-15T01:39:02.607913+0000","last_fullsized":"2023-11-15T01:39:02.607913+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.599449+0000","last_change":"2023-11-15T01:39:02.597319+0000","last_active":"2023-11-15T01:39:02.599449+0000","last_peered":"2023-11-15T01:39:02.599449+0000","last_clean":"2023-11-15T01:39:02.599449+0000","last_became_active":"2023-11-15T01:39:02.597051+0000","last_became_peered":"2023-11-15T01:39:02.597051+0000","last_unstale":"2023-11-15T01:39:02.599449+0000","last_undegraded":"2023-11-15T01:39:02.599449+0000","last_fullsized":"2023-11-15T01:39:02.599449+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.614112+0000","last_change":"2023-11-15T01:39:02.213626+0000","last_active":"2023-11-15T01:39:02.614112+0000","last_peered":"2023-11-15T01:39:02.614112+0000","last_clean":"2023-11-15T01:39:02.614112+0000","last_became_active":"2023-11-15T01:39:02.213021+0000","last_became_peered":"2023-11-15T01:39:02.213021+0000","last_unstale":"2023-11-15T01:39:02.614112+0000","last_undegraded":"2023-11-15T01:39:02.614112+0000","last_fullsized":"2023-11-15T01:39:02.614112+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.604865+0000","last_change":"2023-11-15T01:39:02.598955+0000","last_active":"2023-11-15T01:39:02.604865+0000","last_peered":"2023-11-15T01:39:02.604865+0000","last_clean":"2023-11-15T01:39:02.604865+0000","last_became_active":"2023-11-15T01:39:02.598657+0000","last_became_peered":"2023-11-15T01:39:02.598657+0000","last_unstale":"2023-11-15T01:39:02.604865+0000","last_undegraded":"2023-11-15T01:39:02.604865+0000","last_fullsized":"2023-11-15T01:39:02.604865+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.588486+0000","last_change":"2023-11-15T01:39:02.212406+0000","last_active":"2023-11-15T01:39:02.588486+0000","last_peered":"2023-11-15T01:39:02.588486+0000","last_clean":"2023-11-15T01:39:02.588486+0000","last_became_active":"2023-11-15T01:39:02.212116+0000","last_became_peered":"2023-11-15T01:39:02.212116+0000","last_unstale":"2023-11-15T01:39:02.588486+0000","last_undegraded":"2023-11-15T01:39:02.588486+0000","last_fullsized":"2023-11-15T01:39:02.588486+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606629+0000","last_change":"2023-11-15T01:39:02.605182+0000","last_active":"2023-11-15T01:39:02.606629+0000","last_peered":"2023-11-15T01:39:02.606629+0000","last_clean":"2023-11-15T01:39:02.606629+0000","last_became_active":"2023-11-15T01:39:02.604892+0000","last_became_peered":"2023-11-15T01:39:02.604892+0000","last_unstale":"2023-11-15T01:39:02.606629+0000","last_undegraded":"2023-11-15T01:39:02.606629+0000","last_fullsized":"2023-11-15T01:39:02.606629+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597149+0000","last_change":"2023-11-15T01:39:02.210712+0000","last_active":"2023-11-15T01:39:02.597149+0000","last_peered":"2023-11-15T01:39:02.597149+0000","last_clean":"2023-11-15T01:39:02.597149+0000","last_became_active":"2023-11-15T01:39:02.210222+0000","last_became_peered":"2023-11-15T01:39:02.210222+0000","last_unstale":"2023-11-15T01:39:02.597149+0000","last_undegraded":"2023-11-15T01:39:02.597149+0000","last_fullsized":"2023-11-15T01:39:02.597149+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.620052+0000","last_change":"2023-11-15T01:39:02.615816+0000","last_active":"2023-11-15T01:39:02.620052+0000","last_peered":"2023-11-15T01:39:02.620052+0000","last_clean":"2023-11-15T01:39:02.620052+0000","last_became_active":"2023-11-15T01:39:02.615495+0000","last_became_peered":"2023-11-15T01:39:02.615495+0000","last_unstale":"2023-11-15T01:39:02.620052+0000","last_undegraded":"2023-11-15T01:39:02.620052+0000","last_fullsized":"2023-11-15T01:39:02.620052+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.601085+0000","last_change":"2023-11-15T01:39:02.213634+0000","last_active":"2023-11-15T01:39:02.601085+0000","last_peered":"2023-11-15T01:39:02.601085+0000","last_clean":"2023-11-15T01:39:02.601085+0000","last_became_active":"2023-11-15T01:39:02.213348+0000","last_became_peered":"2023-11-15T01:39:02.213348+0000","last_unstale":"2023-11-15T01:39:02.601085+0000","last_undegraded":"2023-11-15T01:39:02.601085+0000","last_fullsized":"2023-11-15T01:39:02.601085+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615584+0000","last_change":"2023-11-15T01:39:02.613224+0000","last_active":"2023-11-15T01:39:02.615584+0000","last_peered":"2023-11-15T01:39:02.615584+0000","last_clean":"2023-11-15T01:39:02.615584+0000","last_became_active":"2023-11-15T01:39:02.612879+0000","last_became_peered":"2023-11-15T01:39:02.612879+0000","last_unstale":"2023-11-15T01:39:02.615584+0000","last_undegraded":"2023-11-15T01:39:02.615584+0000","last_fullsized":"2023-11-15T01:39:02.615584+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.594724+0000","last_change":"2023-11-15T01:39:02.212971+0000","last_active":"2023-11-15T01:39:02.594724+0000","last_peered":"2023-11-15T01:39:02.594724+0000","last_clean":"2023-11-15T01:39:02.594724+0000","last_became_active":"2023-11-15T01:39:02.212667+0000","last_became_peered":"2023-11-15T01:39:02.212667+0000","last_unstale":"2023-11-15T01:39:02.594724+0000","last_undegraded":"2023-11-15T01:39:02.594724+0000","last_fullsized":"2023-11-15T01:39:02.594724+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.615238+0000","last_change":"2023-11-15T01:39:02.613211+0000","last_active":"2023-11-15T01:39:02.615238+0000","last_peered":"2023-11-15T01:39:02.615238+0000","last_clean":"2023-11-15T01:39:02.615238+0000","last_became_active":"2023-11-15T01:39:02.612908+0000","last_became_peered":"2023-11-15T01:39:02.612908+0000","last_unstale":"2023-11-15T01:39:02.615238+0000","last_undegraded":"2023-11-15T01:39:02.615238+0000","last_fullsized":"2023-11-15T01:39:02.615238+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593625+0000","last_change":"2023-11-15T01:39:02.211682+0000","last_active":"2023-11-15T01:39:02.593625+0000","last_peered":"2023-11-15T01:39:02.593625+0000","last_clean":"2023-11-15T01:39:02.593625+0000","last_became_active":"2023-11-15T01:39:02.211336+0000","last_became_peered":"2023-11-15T01:39:02.211336+0000","last_unstale":"2023-11-15T01:39:02.593625+0000","last_undegraded":"2023-11-15T01:39:02.593625+0000","last_fullsized":"2023-11-15T01:39:02.593625+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619825+0000","last_change":"2023-11-15T01:39:02.616663+0000","last_active":"2023-11-15T01:39:02.619825+0000","last_peered":"2023-11-15T01:39:02.619825+0000","last_clean":"2023-11-15T01:39:02.619825+0000","last_became_active":"2023-11-15T01:39:02.616376+0000","last_became_peered":"2023-11-15T01:39:02.616376+0000","last_unstale":"2023-11-15T01:39:02.619825+0000","last_undegraded":"2023-11-15T01:39:02.619825+0000","last_fullsized":"2023-11-15T01:39:02.619825+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597448+0000","last_change":"2023-11-15T01:39:02.216677+0000","last_active":"2023-11-15T01:39:02.597448+0000","last_peered":"2023-11-15T01:39:02.597448+0000","last_clean":"2023-11-15T01:39:02.597448+0000","last_became_active":"2023-11-15T01:39:02.216244+0000","last_became_peered":"2023-11-15T01:39:02.216244+0000","last_unstale":"2023-11-15T01:39:02.597448+0000","last_undegraded":"2023-11-15T01:39:02.597448+0000","last_fullsized":"2023-11-15T01:39:02.597448+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619935+0000","last_change":"2023-11-15T01:39:02.614768+0000","last_active":"2023-11-15T01:39:02.619935+0000","last_peered":"2023-11-15T01:39:02.619935+0000","last_clean":"2023-11-15T01:39:02.619935+0000","last_became_active":"2023-11-15T01:39:02.614457+0000","last_became_peered":"2023-11-15T01:39:02.614457+0000","last_unstale":"2023-11-15T01:39:02.619935+0000","last_undegraded":"2023-11-15T01:39:02.619935+0000","last_fullsized":"2023-11-15T01:39:02.619935+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593206+0000","last_change":"2023-11-15T01:39:02.212115+0000","last_active":"2023-11-15T01:39:02.593206+0000","last_peered":"2023-11-15T01:39:02.593206+0000","last_clean":"2023-11-15T01:39:02.593206+0000","last_became_active":"2023-11-15T01:39:02.211847+0000","last_became_peered":"2023-11-15T01:39:02.211847+0000","last_unstale":"2023-11-15T01:39:02.593206+0000","last_undegraded":"2023-11-15T01:39:02.593206+0000","last_fullsized":"2023-11-15T01:39:02.593206+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606667+0000","last_change":"2023-11-15T01:39:02.604865+0000","last_active":"2023-11-15T01:39:02.606667+0000","last_peered":"2023-11-15T01:39:02.606667+0000","last_clean":"2023-11-15T01:39:02.606667+0000","last_became_active":"2023-11-15T01:39:02.604576+0000","last_became_peered":"2023-11-15T01:39:02.604576+0000","last_unstale":"2023-11-15T01:39:02.606667+0000","last_undegraded":"2023-11-15T01:39:02.606667+0000","last_fullsized":"2023-11-15T01:39:02.606667+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.597373+0000","last_change":"2023-11-15T01:39:02.212456+0000","last_active":"2023-11-15T01:39:02.597373+0000","last_peered":"2023-11-15T01:39:02.597373+0000","last_clean":"2023-11-15T01:39:02.597373+0000","last_became_active":"2023-11-15T01:39:02.212123+0000","last_became_peered":"2023-11-15T01:39:02.212123+0000","last_unstale":"2023-11-15T01:39:02.597373+0000","last_undegraded":"2023-11-15T01:39:02.597373+0000","last_fullsized":"2023-11-15T01:39:02.597373+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.601148+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:39:02.601148+0000","last_peered":"2023-11-15T01:39:02.601148+0000","last_clean":"2023-11-15T01:39:02.601148+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:39:02.601148+0000","last_undegraded":"2023-11-15T01:39:02.601148+0000","last_fullsized":"2023-11-15T01:39:02.601148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.596932+0000","last_change":"2023-11-15T01:39:02.594932+0000","last_active":"2023-11-15T01:39:02.596932+0000","last_peered":"2023-11-15T01:39:02.596932+0000","last_clean":"2023-11-15T01:39:02.596932+0000","last_became_active":"2023-11-15T01:39:02.594643+0000","last_became_peered":"2023-11-15T01:39:02.594643+0000","last_unstale":"2023-11-15T01:39:02.596932+0000","last_undegraded":"2023-11-15T01:39:02.596932+0000","last_fullsized":"2023-11-15T01:39:02.596932+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611619+0000","last_change":"2023-11-15T01:39:02.210563+0000","last_active":"2023-11-15T01:39:02.611619+0000","last_peered":"2023-11-15T01:39:02.611619+0000","last_clean":"2023-11-15T01:39:02.611619+0000","last_became_active":"2023-11-15T01:39:02.210071+0000","last_became_peered":"2023-11-15T01:39:02.210071+0000","last_unstale":"2023-11-15T01:39:02.611619+0000","last_undegraded":"2023-11-15T01:39:02.611619+0000","last_fullsized":"2023-11-15T01:39:02.611619+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.606635+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:39:02.606635+0000","last_peered":"2023-11-15T01:39:02.606635+0000","last_clean":"2023-11-15T01:39:02.606635+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:39:02.606635+0000","last_undegraded":"2023-11-15T01:39:02.606635+0000","last_fullsized":"2023-11-15T01:39:02.606635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.611509+0000","last_change":"2023-11-15T01:39:02.610776+0000","last_active":"2023-11-15T01:39:02.611509+0000","last_peered":"2023-11-15T01:39:02.611509+0000","last_clean":"2023-11-15T01:39:02.611509+0000","last_became_active":"2023-11-15T01:39:02.610520+0000","last_became_peered":"2023-11-15T01:39:02.610520+0000","last_unstale":"2023-11-15T01:39:02.611509+0000","last_undegraded":"2023-11-15T01:39:02.611509+0000","last_fullsized":"2023-11-15T01:39:02.611509+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607127+0000","last_change":"2023-11-15T01:39:02.211202+0000","last_active":"2023-11-15T01:39:02.607127+0000","last_peered":"2023-11-15T01:39:02.607127+0000","last_clean":"2023-11-15T01:39:02.607127+0000","last_became_active":"2023-11-15T01:39:02.210846+0000","last_became_peered":"2023-11-15T01:39:02.210846+0000","last_unstale":"2023-11-15T01:39:02.607127+0000","last_undegraded":"2023-11-15T01:39:02.607127+0000","last_fullsized":"2023-11-15T01:39:02.607127+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593208+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:39:02.593208+0000","last_peered":"2023-11-15T01:39:02.593208+0000","last_clean":"2023-11-15T01:39:02.593208+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:39:02.593208+0000","last_undegraded":"2023-11-15T01:39:02.593208+0000","last_fullsized":"2023-11-15T01:39:02.593208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.619122+0000","last_change":"2023-11-15T01:39:02.611202+0000","last_active":"2023-11-15T01:39:02.619122+0000","last_peered":"2023-11-15T01:39:02.619122+0000","last_clean":"2023-11-15T01:39:02.619122+0000","last_became_active":"2023-11-15T01:39:02.610885+0000","last_became_peered":"2023-11-15T01:39:02.610885+0000","last_unstale":"2023-11-15T01:39:02.619122+0000","last_undegraded":"2023-11-15T01:39:02.619122+0000","last_fullsized":"2023-11-15T01:39:02.619122+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.599145+0000","last_change":"2023-11-15T01:39:02.209388+0000","last_active":"2023-11-15T01:39:02.599145+0000","last_peered":"2023-11-15T01:39:02.599145+0000","last_clean":"2023-11-15T01:39:02.599145+0000","last_became_active":"2023-11-15T01:39:02.209125+0000","last_became_peered":"2023-11-15T01:39:02.209125+0000","last_unstale":"2023-11-15T01:39:02.599145+0000","last_undegraded":"2023-11-15T01:39:02.599145+0000","last_fullsized":"2023-11-15T01:39:02.599145+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.607022+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:39:02.607022+0000","last_peered":"2023-11-15T01:39:02.607022+0000","last_clean":"2023-11-15T01:39:02.607022+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:39:02.607022+0000","last_undegraded":"2023-11-15T01:39:02.607022+0000","last_fullsized":"2023-11-15T01:39:02.607022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":98,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.602963+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:39:02.602963+0000","last_peered":"2023-11-15T01:39:02.602963+0000","last_clean":"2023-11-15T01:39:02.602963+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:39:02.602963+0000","last_undegraded":"2023-11-15T01:39:02.602963+0000","last_fullsized":"2023-11-15T01:39:02.602963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608911+0000","last_change":"2023-11-15T01:39:02.604538+0000","last_active":"2023-11-15T01:39:02.608911+0000","last_peered":"2023-11-15T01:39:02.608911+0000","last_clean":"2023-11-15T01:39:02.608911+0000","last_became_active":"2023-11-15T01:39:02.604164+0000","last_became_peered":"2023-11-15T01:39:02.604164+0000","last_unstale":"2023-11-15T01:39:02.608911+0000","last_undegraded":"2023-11-15T01:39:02.608911+0000","last_fullsized":"2023-11-15T01:39:02.608911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.605024+0000","last_change":"2023-11-15T01:39:02.213659+0000","last_active":"2023-11-15T01:39:02.605024+0000","last_peered":"2023-11-15T01:39:02.605024+0000","last_clean":"2023-11-15T01:39:02.605024+0000","last_became_active":"2023-11-15T01:39:02.213388+0000","last_became_peered":"2023-11-15T01:39:02.213388+0000","last_unstale":"2023-11-15T01:39:02.605024+0000","last_undegraded":"2023-11-15T01:39:02.605024+0000","last_fullsized":"2023-11-15T01:39:02.605024+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.602975+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:39:02.602975+0000","last_peered":"2023-11-15T01:39:02.602975+0000","last_clean":"2023-11-15T01:39:02.602975+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:39:02.602975+0000","last_undegraded":"2023-11-15T01:39:02.602975+0000","last_fullsized":"2023-11-15T01:39:02.602975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.613936+0000","last_change":"2023-11-15T01:39:02.613124+0000","last_active":"2023-11-15T01:39:02.613936+0000","last_peered":"2023-11-15T01:39:02.613936+0000","last_clean":"2023-11-15T01:39:02.613936+0000","last_became_active":"2023-11-15T01:39:02.612807+0000","last_became_peered":"2023-11-15T01:39:02.612807+0000","last_unstale":"2023-11-15T01:39:02.613936+0000","last_undegraded":"2023-11-15T01:39:02.613936+0000","last_fullsized":"2023-11-15T01:39:02.613936+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593105+0000","last_change":"2023-11-15T01:39:02.208753+0000","last_active":"2023-11-15T01:39:02.593105+0000","last_peered":"2023-11-15T01:39:02.593105+0000","last_clean":"2023-11-15T01:39:02.593105+0000","last_became_active":"2023-11-15T01:39:02.208459+0000","last_became_peered":"2023-11-15T01:39:02.208459+0000","last_unstale":"2023-11-15T01:39:02.593105+0000","last_undegraded":"2023-11-15T01:39:02.593105+0000","last_fullsized":"2023-11-15T01:39:02.593105+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.605122+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:39:02.605122+0000","last_peered":"2023-11-15T01:39:02.605122+0000","last_clean":"2023-11-15T01:39:02.605122+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:39:02.605122+0000","last_undegraded":"2023-11-15T01:39:02.605122+0000","last_fullsized":"2023-11-15T01:39:02.605122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.608614+0000","last_change":"2023-11-15T01:39:02.604992+0000","last_active":"2023-11-15T01:39:02.608614+0000","last_peered":"2023-11-15T01:39:02.608614+0000","last_clean":"2023-11-15T01:39:02.608614+0000","last_became_active":"2023-11-15T01:39:02.604731+0000","last_became_peered":"2023-11-15T01:39:02.604731+0000","last_unstale":"2023-11-15T01:39:02.608614+0000","last_undegraded":"2023-11-15T01:39:02.608614+0000","last_fullsized":"2023-11-15T01:39:02.608614+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.596996+0000","last_change":"2023-11-15T01:39:02.215566+0000","last_active":"2023-11-15T01:39:02.596996+0000","last_peered":"2023-11-15T01:39:02.596996+0000","last_clean":"2023-11-15T01:39:02.596996+0000","last_became_active":"2023-11-15T01:39:02.215261+0000","last_became_peered":"2023-11-15T01:39:02.215261+0000","last_unstale":"2023-11-15T01:39:02.596996+0000","last_undegraded":"2023-11-15T01:39:02.596996+0000","last_fullsized":"2023-11-15T01:39:02.596996+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598969+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:39:02.598969+0000","last_peered":"2023-11-15T01:39:02.598969+0000","last_clean":"2023-11-15T01:39:02.598969+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:39:02.598969+0000","last_undegraded":"2023-11-15T01:39:02.598969+0000","last_fullsized":"2023-11-15T01:39:02.598969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.609619+0000","last_change":"2023-11-15T01:39:02.607704+0000","last_active":"2023-11-15T01:39:02.609619+0000","last_peered":"2023-11-15T01:39:02.609619+0000","last_clean":"2023-11-15T01:39:02.609619+0000","last_became_active":"2023-11-15T01:39:02.607461+0000","last_became_peered":"2023-11-15T01:39:02.607461+0000","last_unstale":"2023-11-15T01:39:02.609619+0000","last_undegraded":"2023-11-15T01:39:02.609619+0000","last_fullsized":"2023-11-15T01:39:02.609619+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:02.186462+0000","last_clean_scrub_stamp":"2023-11-15T01:39:02.186462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.593520+0000","last_change":"2023-11-15T01:39:02.208524+0000","last_active":"2023-11-15T01:39:02.593520+0000","last_peered":"2023-11-15T01:39:02.593520+0000","last_clean":"2023-11-15T01:39:02.593520+0000","last_became_active":"2023-11-15T01:39:02.208211+0000","last_became_peered":"2023-11-15T01:39:02.208211+0000","last_unstale":"2023-11-15T01:39:02.593520+0000","last_undegraded":"2023-11-15T01:39:02.593520+0000","last_fullsized":"2023-11-15T01:39:02.593520+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:39:01.178176+0000","last_clean_scrub_stamp":"2023-11-15T01:39:01.178176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-11-15T01:39:02.598462+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:39:02.598462+0000","last_peered":"2023-11-15T01:39:02.598462+0000","last_clean":"2023-11-15T01:39:02.598462+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:39:02.598462+0000","last_undegraded":"2023-11-15T01:39:02.598462+0000","last_fullsized":"2023-11-15T01:39:02.598462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575057,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302716,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069124,"statfs":{"total":96636764160,"available":96326782976,"internally_reserved":0,"allocated":1560576,"data_stored":809406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53700000000000003,"15min":0.55400000000000005},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.248},"max":{"1min":0.74099999999999999,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.57199999999999995}]},{"osd":1,"last update":"Wed Nov 15 01:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.36799999999999999,"5min":0.34499999999999997,"15min":0.27500000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.625}]},{"osd":2,"last update":"Wed Nov 15 01:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.375,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82599999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.34899999999999998,"5min":0.33800000000000002,"15min":0.309},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.67700000000000005}]},{"osd":3,"last update":"Wed Nov 15 01:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.38900000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.752,"5min":0.80700000000000005,"15min":0.85999999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61399999999999999,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.373,"15min":0.35099999999999998},"max":{"1min":0.83499999999999996,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.69999999999999996}]},{"osd":4,"last update":"Wed Nov 15 01:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.47399999999999998,"15min":0.46600000000000003},"min":{"1min":0.32700000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55800000000000005,"15min":0.54300000000000004},"min":{"1min":0.433,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":0.77500000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.5,"15min":0.48499999999999999},"min":{"1min":0.28899999999999998,"5min":0.26500000000000001,"15min":0.23499999999999999},"max":{"1min":0.74199999999999999,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.35899999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54700000000000004}]},{"osd":6,"last update":"Wed Nov 15 01:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.41099999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80900000000000005,"5min":0.82999999999999996,"15min":1.0129999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.66300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575058,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1568768,"data_stored":809982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.55600000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.30499999999999999},"max":{"1min":0.70999999999999996,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.626},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.41799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77800000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.83099999999999996},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.39100000000000001,"5min":0.33100000000000002,"15min":0.32100000000000001},"max":{"1min":0.79600000000000004,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.65800000000000003}]},{"osd":2,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.36699999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72499999999999998,"5min":1.746,"15min":1.746},"last":0.69999999999999996}]},{"osd":3,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.307},"max":{"1min":0.69999999999999996,"5min":0.77100000000000002,"15min":0.91300000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.72699999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.44900000000000001,"15min":0.45000000000000001},"min":{"1min":0.29099999999999998,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.52200000000000002},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.25800000000000001},"max":{"1min":0.71199999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54600000000000004}]},{"osd":5,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48199999999999998,"15min":0.48099999999999998},"min":{"1min":0.32200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63900000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58899999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:38:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.496,"15min":0.5},"min":{"1min":0.35099999999999998,"5min":0.32500000000000001,"15min":0.29899999999999999},"max":{"1min":0.64800000000000002,"5min":0.875,"15min":0.875},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80800000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.68500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575059,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302728,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069112,"statfs":{"total":96636764160,"available":96326770688,"internally_reserved":0,"allocated":1572864,"data_stored":810866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.23999999999999999},"max":{"1min":0.50800000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.40300000000000002},"min":{"1min":0.26600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.58699999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.23699999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.373,"15min":0.38900000000000001},"min":{"1min":0.27200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.57599999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.438},"min":{"1min":0.28199999999999997,"5min":0.27800000000000002,"15min":0.26200000000000001},"max":{"1min":0.68999999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.371}]},{"osd":3,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55700000000000005,"15min":0.52300000000000002},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60299999999999998,"5min":9.641,"15min":9.641},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53200000000000003,"15min":0.501},"min":{"1min":0.34200000000000003,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":0.63400000000000001,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.32100000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.42199999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.63600000000000001},"min":{"1min":0.49299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.875,"5min":1.006,"15min":1.006},"last":0.52000000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.82299999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81200000000000006,"5min":1.111,"15min":1.111},"last":0.67500000000000004}]},{"osd":6,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.67400000000000004},"min":{"1min":0.498,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":0.78000000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65700000000000003,"15min":0.68500000000000005},"min":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92800000000000005,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72099999999999997}]},{"osd":7,"last update":"Wed Nov 15 01:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.51100000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91800000000000004,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66500000000000004,"15min":0.68999999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94199999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.68700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834575057,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1568768,"data_stored":810050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.375,"15min":0.371},"min":{"1min":0.27800000000000002,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.54200000000000004,"5min":2.024,"15min":2.024},"last":0.376},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.26100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.64700000000000002,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.28000000000000003}]},{"osd":2,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52400000000000002,"5min":1.768,"15min":1.768},"last":0.252},{"interface":"front","average":{"1min":0.436,"5min":0.439,"15min":0.44},"min":{"1min":0.28899999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.63500000000000001,"5min":1.982,"15min":1.982},"last":0.32700000000000001}]},{"osd":3,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44,"15min":0.437},"min":{"1min":0.28100000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61299999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.31},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.67900000000000005,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.36399999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.45600000000000002,"5min":0.42199999999999999,"15min":0.40400000000000003},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98899999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.443}]},{"osd":5,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.624,"15min":0.629},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.38500000000000001},"max":{"1min":0.97899999999999998,"5min":1.881,"15min":1.881},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":1.056},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.42999999999999999,"15min":0.36499999999999999},"max":{"1min":1.04,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67000000000000004,"15min":0.67100000000000004},"min":{"1min":0.51100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.917,"15min":1.917},"last":0.498}]},{"osd":7,"last update":"Wed Nov 15 01:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69899999999999995,"15min":0.68999999999999995},"min":{"1min":0.53400000000000003,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0089999999999999,"5min":1.843,"15min":1.843},"last":0.433},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67200000000000004,"15min":0.68700000000000006},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.40899999999999997},"max":{"1min":1.073,"5min":1.073,"15min":1.0960000000000001},"last":0.50800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575058,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306816,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065024,"statfs":{"total":96636764160,"available":96322584576,"internally_reserved":0,"allocated":1564672,"data_stored":809420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35499999999999998,"15min":0.36699999999999999},"min":{"1min":0.26900000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.46000000000000002,"5min":0.54800000000000004,"15min":0.61899999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.40600000000000003},"min":{"1min":0.255,"5min":0.246,"15min":0.246},"max":{"1min":0.63200000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.33500000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.26900000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61799999999999999,"5min":0.745,"15min":0.75},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42699999999999999,"15min":0.438},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.56399999999999995,"5min":0.69799999999999995,"15min":0.92000000000000004},"last":0.497}]},{"osd":3,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.44400000000000001,"15min":0.45200000000000001},"min":{"1min":0.34899999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67400000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.439,"15min":0.443},"min":{"1min":0.34100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.39500000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.61799999999999999},"min":{"1min":0.42799999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79800000000000004,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.63600000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80900000000000005,"5min":0.91100000000000003,"15min":0.95399999999999996},"last":0.71999999999999997}]},{"osd":5,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.623,"15min":0.64200000000000002},"min":{"1min":0.495,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84799999999999998,"5min":1.032,"15min":1.032},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.60699999999999998,"15min":0.63600000000000001},"min":{"1min":0.48499999999999999,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":0.75,"5min":0.96699999999999997,"15min":0.99399999999999999},"last":0.76600000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64100000000000001,"15min":0.65700000000000003},"min":{"1min":0.49399999999999999,"5min":0.438,"15min":0.374},"max":{"1min":0.85799999999999998,"5min":1.002,"15min":1.0389999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64500000000000002,"15min":0.67000000000000004},"min":{"1min":0.53800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.83199999999999996}]},{"osd":7,"last update":"Wed Nov 15 01:38:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64800000000000002,"15min":0.66900000000000004},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":1.079,"15min":1.079},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66000000000000003,"15min":0.68999999999999995},"min":{"1min":0.52600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.82299999999999995,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.79200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575059,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306808,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065032,"statfs":{"total":96636764160,"available":96322592768,"internally_reserved":0,"allocated":1556480,"data_stored":809316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35599999999999998,"15min":0.374},"min":{"1min":0.23200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.54500000000000004,"5min":0.65900000000000003,"15min":0.79900000000000004},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.374,"15min":0.40000000000000002},"min":{"1min":0.24199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.503,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.29999999999999999}]},{"osd":1,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.36499999999999999,"15min":0.39000000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.24399999999999999},"max":{"1min":0.52500000000000002,"5min":0.57799999999999996,"15min":0.72899999999999998},"last":0.312},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.44500000000000001},"min":{"1min":0.28699999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70199999999999996,"5min":0.72499999999999998,"15min":0.747},"last":0.20100000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41499999999999998,"15min":0.44800000000000001},"min":{"1min":0.29499999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.47699999999999998},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":0.69199999999999995,"15min":0.81999999999999995},"last":0.255}]},{"osd":4,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56899999999999995,"15min":0.61599999999999999},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.80500000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.626},"min":{"1min":0.435,"5min":0.40600000000000003,"15min":0.39000000000000001},"max":{"1min":0.84799999999999998,"5min":0.89200000000000002,"15min":1.0589999999999999},"last":0.376}]},{"osd":5,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58799999999999997,"15min":0.63300000000000001},"min":{"1min":0.41299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.76800000000000002,"5min":0.92000000000000004,"15min":1.0569999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.63900000000000001},"min":{"1min":0.41499999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73799999999999999,"5min":0.879,"15min":0.95999999999999996},"last":0.51300000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60199999999999998,"15min":0.64600000000000002},"min":{"1min":0.40899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.0980000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.67000000000000004},"min":{"1min":0.42899999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.95799999999999996,"15min":1.169},"last":0.41399999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.66600000000000004},"min":{"1min":0.48399999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":1.0429999999999999,"15min":1.071},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86099999999999999,"5min":0.996,"15min":1.1459999999999999},"last":0.43099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575057,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302720,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069120,"statfs":{"total":96636764160,"available":96326778880,"internally_reserved":0,"allocated":1564672,"data_stored":810230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.34499999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.84499999999999997,"15min":0.88},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.374,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.754,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.54900000000000004}]},{"osd":1,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.42099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72499999999999998,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.45500000000000002,"5min":0.34799999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.625}]},{"osd":2,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.58699999999999997},"min":{"1min":0.44,"5min":0.34100000000000003,"15min":0.30299999999999999},"max":{"1min":0.70299999999999996,"5min":2.887,"15min":2.887},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.33100000000000002},"max":{"1min":0.77700000000000002,"5min":0.92300000000000004,"15min":0.96299999999999997},"last":0.56000000000000005}]},{"osd":3,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.41299999999999998,"5min":0.35799999999999998,"15min":0.33100000000000002},"max":{"1min":0.71599999999999997,"5min":2.464,"15min":2.464},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.623,"15min":0.60699999999999998},"min":{"1min":0.47599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79400000000000004,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.74299999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48399999999999999,"15min":0.46800000000000003},"min":{"1min":0.34499999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70499999999999996,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.27400000000000002},"max":{"1min":0.65800000000000003,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.39800000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52200000000000002,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.29699999999999999,"15min":0.28899999999999998},"max":{"1min":0.67800000000000005,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.32400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.82899999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.442}]},{"osd":7,"last update":"Wed Nov 15 01:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58499999999999996,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71799999999999997,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.46200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575057,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302716,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069124,"statfs":{"total":96636764160,"available":96326782976,"internally_reserved":0,"allocated":1560576,"data_stored":809870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.35199999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72099999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53700000000000003,"15min":0.55300000000000005},"min":{"1min":0.39300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.76000000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.39300000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53300000000000003,"15min":0.55700000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.32600000000000001},"max":{"1min":0.73799999999999999,"5min":0.78500000000000003,"15min":0.83299999999999996},"last":0.435},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.56999999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76600000000000001,"5min":0.77400000000000002,"15min":0.80100000000000005},"last":0.34799999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54200000000000004,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76300000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.38700000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.84599999999999997},"last":0.47999999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.39400000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74299999999999999,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57399999999999995,"15min":0.58799999999999997},"min":{"1min":0.443,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77500000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.52900000000000003}]},{"osd":4,"last update":"Wed Nov 15 01:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.34399999999999997,"5min":0.26600000000000001,"15min":0.23899999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.76500000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52000000000000002,"15min":0.52300000000000002},"min":{"1min":0.439,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78700000000000003,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.55800000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.46899999999999997,"15min":0.47199999999999998},"min":{"1min":0.373,"5min":0.307,"15min":0.27600000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.83099999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.42899999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80100000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63700000000000001}]},{"osd":7,"last update":"Wed Nov 15 01:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.5,"15min":0.498},"min":{"1min":0.38400000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.626},{"interface":"front","average":{"1min":0.625,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.48499999999999999,"5min":0.40100000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":0.82399999999999995,"15min":0.85799999999999998},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:39:11.478 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-15T01:39:11.478 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-15T01:39:11.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.635+0000 7f554fd53700 1 Processor -- start 2023-11-15T01:39:11.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.635+0000 7f554fd53700 1 -- start start 2023-11-15T01:39:11.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.636+0000 7f554fd53700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f554813a980 0x7f5548069620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:11.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.636+0000 7f554fd53700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55480c1c80 0x7f55480bcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:11.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.636+0000 7f554fd53700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554806a810 con 0x7f55480bd210 2023-11-15T01:39:11.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.636+0000 7f554fd53700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554813ad60 con 0x7f554813a980 2023-11-15T01:39:11.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.636+0000 7f554fd53700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55480bd680 con 0x7f55480c1c80 2023-11-15T01:39:11.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.636+0000 7f554daef700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f554813a980 0x7f5548069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:11.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.636+0000 7f554e2f0700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f55480bd210 0x7f55480c48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59182/0 (socket says 172.21.15.1:59182) 2023-11-15T01:39:11.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.636+0000 7f554e2f0700 1 -- 172.21.15.1:0/1986106210 learned_addr learned my addr 172.21.15.1:0/1986106210 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:39:11.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.636+0000 7f554d2ee700 1 --2- 172.21.15.1:0/1986106210 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55480c1c80 0x7f55480bcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:11.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.636+0000 7f554daef700 1 -- 172.21.15.1:0/1986106210 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55480c1c80 msgr2=0x7f55480bcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:11.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.636+0000 7f554daef700 1 --2- 172.21.15.1:0/1986106210 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55480c1c80 0x7f55480bcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:11.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.636+0000 7f554daef700 1 -- 172.21.15.1:0/1986106210 >> v1:172.21.15.1:6789/0 conn(0x7f55480bd210 legacy=0x7f55480c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:11.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.636+0000 7f554daef700 1 -- 172.21.15.1:0/1986106210 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5548069c00 con 0x7f554813a980 2023-11-15T01:39:11.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.636+0000 7f554caed700 1 -- 172.21.15.1:0/1986106210 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310529396 0 0) 0x7f554806a810 con 0x7f55480bd210 2023-11-15T01:39:11.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.637+0000 7f554daef700 1 --2- 172.21.15.1:0/1986106210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f554813a980 0x7f5548069620 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f5544009760 tx=0x7f5544009060).ready entity=mon.0 client_cookie=4d23958f81d6553 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:11.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.637+0000 7f554caed700 1 -- 172.21.15.1:0/1986106210 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554400b580 con 0x7f554813a980 2023-11-15T01:39:11.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.637+0000 7f554caed700 1 -- 172.21.15.1:0/1986106210 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554400b6e0 con 0x7f554813a980 2023-11-15T01:39:11.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.637+0000 7f554caed700 1 -- 172.21.15.1:0/1986106210 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554400ba60 con 0x7f554813a980 2023-11-15T01:39:11.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.637+0000 7f554fd53700 1 -- 172.21.15.1:0/1986106210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f554813a980 msgr2=0x7f5548069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:11.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.637+0000 7f554fd53700 1 --2- 172.21.15.1:0/1986106210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f554813a980 0x7f5548069620 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f5544009760 tx=0x7f5544009060).stop 2023-11-15T01:39:11.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.637+0000 7f554fd53700 1 -- 172.21.15.1:0/1986106210 shutdown_connections 2023-11-15T01:39:11.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.637+0000 7f554fd53700 1 --2- 172.21.15.1:0/1986106210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f554813a980 0x7f5548069620 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:11.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.637+0000 7f554fd53700 1 --2- 172.21.15.1:0/1986106210 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55480c1c80 0x7f55480bcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:11.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.637+0000 7f554fd53700 1 -- 172.21.15.1:0/1986106210 >> 172.21.15.1:0/1986106210 conn(0x7f5548063280 msgr2=0x7f55480c6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:11.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.637+0000 7f554fd53700 1 -- 172.21.15.1:0/1986106210 shutdown_connections 2023-11-15T01:39:11.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.637+0000 7f554fd53700 1 -- 172.21.15.1:0/1986106210 wait complete. 2023-11-15T01:39:11.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.638+0000 7f554fd53700 1 Processor -- start 2023-11-15T01:39:11.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.639+0000 7f554fd53700 1 -- start start 2023-11-15T01:39:11.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.639+0000 7f554fd53700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55480bd210 0x7f55480a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:11.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.639+0000 7f554fd53700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55480c1c80 0x7f55480a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:11.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.639+0000 7f554fd53700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f554813a980 0x7f5548130850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:11.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.639+0000 7f554fd53700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55480a6db0 con 0x7f55480bd210 2023-11-15T01:39:11.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.639+0000 7f554fd53700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55480aa130 con 0x7f554813a980 2023-11-15T01:39:11.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.639+0000 7f554fd53700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55480bfef0 con 0x7f55480c1c80 2023-11-15T01:39:11.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.639+0000 7f554daef700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55480bd210 0x7f55480a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:11.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.639+0000 7f554daef700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55480bd210 0x7f55480a9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38586/0 (socket says 172.21.15.1:38586) 2023-11-15T01:39:11.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.639+0000 7f554daef700 1 -- 172.21.15.1:0/3121991033 learned_addr learned my addr 172.21.15.1:0/3121991033 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:11.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.640+0000 7f554daef700 1 -- 172.21.15.1:0/3121991033 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55480c1c80 msgr2=0x7f55480a8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:11.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.640+0000 7f554daef700 1 --2- 172.21.15.1:0/3121991033 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55480c1c80 0x7f55480a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:39:11.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.640+0000 7f554e2f0700 1 --2- 172.21.15.1:0/3121991033 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f554813a980 0x7f5548130850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:11.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.640+0000 7f554daef700 1 -- 172.21.15.1:0/3121991033 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f554813a980 msgr2=0x7f5548130850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:11.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.640+0000 7f554daef700 1 --2- 172.21.15.1:0/3121991033 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f554813a980 0x7f5548130850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:11.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.640+0000 7f554daef700 1 -- 172.21.15.1:0/3121991033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55440092a0 con 0x7f55480bd210 2023-11-15T01:39:11.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.640+0000 7f554daef700 1 --2- 172.21.15.1:0/3121991033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55480bd210 0x7f55480a9c40 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f5544009eb0 tx=0x7f5544017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:11.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.640+0000 7f553dffb700 1 -- 172.21.15.1:0/3121991033 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554400b850 con 0x7f55480bd210 2023-11-15T01:39:11.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.640+0000 7f553dffb700 1 -- 172.21.15.1:0/3121991033 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554400b9b0 con 0x7f55480bd210 2023-11-15T01:39:11.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.640+0000 7f554fd53700 1 -- 172.21.15.1:0/3121991033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55480be070 con 0x7f55480bd210 2023-11-15T01:39:11.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.640+0000 7f553dffb700 1 -- 172.21.15.1:0/3121991033 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554401b690 con 0x7f55480bd210 2023-11-15T01:39:11.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.640+0000 7f554fd53700 1 -- 172.21.15.1:0/3121991033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55480a6b50 con 0x7f55480bd210 2023-11-15T01:39:11.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.641+0000 7f554fd53700 1 -- 172.21.15.1:0/3121991033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554806c7e0 con 0x7f55480bd210 2023-11-15T01:39:11.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.642+0000 7f553dffb700 1 -- 172.21.15.1:0/3121991033 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f554401ba40 con 0x7f55480bd210 2023-11-15T01:39:11.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.642+0000 7f553dffb700 1 --2- 172.21.15.1:0/3121991033 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f552c05f270 0x7f552c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:11.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.642+0000 7f553dffb700 1 -- 172.21.15.1:0/3121991033 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f554407be00 con 0x7f55480bd210 2023-11-15T01:39:11.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.642+0000 7f554d2ee700 1 --2- 172.21.15.1:0/3121991033 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f552c05f270 0x7f552c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:11.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.643+0000 7f554d2ee700 1 --2- 172.21.15.1:0/3121991033 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f552c05f270 0x7f552c061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5548148240 tx=0x7f5538008040).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:11.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.646+0000 7f553dffb700 1 -- 172.21.15.1:0/3121991033 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f554404ce60 con 0x7f55480bd210 2023-11-15T01:39:11.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.900+0000 7f554fd53700 1 -- 172.21.15.1:0/3121991033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5548069ee0 con 0x7f55480bd210 2023-11-15T01:39:11.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.903+0000 7f553dffb700 1 -- 172.21.15.1:0/3121991033 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5544050480 con 0x7f55480bd210 2023-11-15T01:39:11.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.905+0000 7f554fd53700 1 -- 172.21.15.1:0/3121991033 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f552c05f270 msgr2=0x7f552c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:11.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.905+0000 7f554fd53700 1 --2- 172.21.15.1:0/3121991033 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f552c05f270 0x7f552c061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5548148240 tx=0x7f5538008040).stop 2023-11-15T01:39:11.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.905+0000 7f554fd53700 1 -- 172.21.15.1:0/3121991033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55480bd210 msgr2=0x7f55480a9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:11.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.905+0000 7f554fd53700 1 --2- 172.21.15.1:0/3121991033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55480bd210 0x7f55480a9c40 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f5544009eb0 tx=0x7f5544017000).stop 2023-11-15T01:39:11.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.905+0000 7f554fd53700 1 -- 172.21.15.1:0/3121991033 shutdown_connections 2023-11-15T01:39:11.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.905+0000 7f554fd53700 1 --2- 172.21.15.1:0/3121991033 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f552c05f270 0x7f552c061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:11.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.905+0000 7f554fd53700 1 --2- 172.21.15.1:0/3121991033 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f554813a980 0x7f5548130850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:11.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.905+0000 7f554fd53700 1 --2- 172.21.15.1:0/3121991033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55480bd210 0x7f55480a9c40 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:11.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.905+0000 7f554fd53700 1 --2- 172.21.15.1:0/3121991033 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55480c1c80 0x7f55480a8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:39:11.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.905+0000 7f554fd53700 1 -- 172.21.15.1:0/3121991033 >> 172.21.15.1:0/3121991033 conn(0x7f5548063280 msgr2=0x7f5548065d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:11.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.905+0000 7f554fd53700 1 -- 172.21.15.1:0/3121991033 shutdown_connections 2023-11-15T01:39:11.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:11.905+0000 7f554fd53700 1 -- 172.21.15.1:0/3121991033 wait complete. 2023-11-15T01:39:11.910 INFO:teuthology.orchestra.run.smithi001.stderr:updated caps for client.0 2023-11-15T01:39:11.919 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:39:12.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.035+0000 7f17867e0700 1 Processor -- start 2023-11-15T01:39:12.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.035+0000 7f17867e0700 1 -- start start 2023-11-15T01:39:12.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.036+0000 7f17867e0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1780155530 0x7f17800c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.036+0000 7f17867e0700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f17800c98b0 0x7f17800c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.036+0000 7f17867e0700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17800c7980 con 0x7f1780151e10 2023-11-15T01:39:12.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.036+0000 7f17867e0700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17800ca210 con 0x7f17800c98b0 2023-11-15T01:39:12.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.036+0000 7f17867e0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17800aa890 con 0x7f1780155530 2023-11-15T01:39:12.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.036+0000 7f17857de700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f1780151e10 0x7f17800aa0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59188/0 (socket says 172.21.15.1:59188) 2023-11-15T01:39:12.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.036+0000 7f17857de700 1 -- 172.21.15.1:0/732090464 learned_addr learned my addr 172.21.15.1:0/732090464 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:39:12.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.036+0000 7f1784fdd700 1 --2- 172.21.15.1:0/732090464 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1780155530 0x7f17800c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.036+0000 7f1785fdf700 1 --2- 172.21.15.1:0/732090464 >> v2:172.21.15.141:3300/0 conn(0x7f17800c98b0 0x7f17800c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.036+0000 7f177ffff700 1 -- 172.21.15.1:0/732090464 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236500490 0 0) 0x7f17800c7980 con 0x7f1780151e10 2023-11-15T01:39:12.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.036+0000 7f177ffff700 1 -- 172.21.15.1:0/732090464 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17680033f0 con 0x7f1780151e10 2023-11-15T01:39:12.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f177ffff700 1 -- 172.21.15.1:0/732090464 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 929562956 0 0) 0x7f17680033f0 con 0x7f1780151e10 2023-11-15T01:39:12.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f177ffff700 1 -- 172.21.15.1:0/732090464 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1780155530 msgr2=0x7f17800c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:12.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f177ffff700 1 --2- 172.21.15.1:0/732090464 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1780155530 0x7f17800c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f177ffff700 1 -- 172.21.15.1:0/732090464 >> v2:172.21.15.141:3300/0 conn(0x7f17800c98b0 msgr2=0x7f17800c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:12.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f177ffff700 1 --2- 172.21.15.1:0/732090464 >> v2:172.21.15.141:3300/0 conn(0x7f17800c98b0 0x7f17800c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f177ffff700 1 -- 172.21.15.1:0/732090464 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17800c7bd0 con 0x7f1780151e10 2023-11-15T01:39:12.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f177ffff700 1 -- 172.21.15.1:0/732090464 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f17780017f0 con 0x7f1780151e10 2023-11-15T01:39:12.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f177ffff700 1 -- 172.21.15.1:0/732090464 >> v1:172.21.15.1:6789/0 conn(0x7f1780151e10 legacy=0x7f17800aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f177ffff700 1 --2- 172.21.15.1:0/732090464 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17680038e0 0x7f1768003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f177ffff700 1 --2- 172.21.15.1:0/732090464 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1780155530 0x7f1768004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f177ffff700 1 --2- 172.21.15.1:0/732090464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1768004b80 0x7f1768005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f177ffff700 1 -- 172.21.15.1:0/732090464 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17800ca210 con 0x7f1768004b80 2023-11-15T01:39:12.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f177ffff700 1 -- 172.21.15.1:0/732090464 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17800aa890 con 0x7f17680038e0 2023-11-15T01:39:12.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f177ffff700 1 -- 172.21.15.1:0/732090464 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176800b8e0 con 0x7f1780155530 2023-11-15T01:39:12.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f1785fdf700 1 --2- 172.21.15.1:0/732090464 >> v2:172.21.15.141:3300/0 conn(0x7f17800c98b0 0x7f17800c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:39:12.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f17857de700 1 --2- 172.21.15.1:0/732090464 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17680038e0 0x7f1768003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f1785fdf700 1 --2- 172.21.15.1:0/732090464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1768004b80 0x7f1768005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f1784fdd700 1 --2- 172.21.15.1:0/732090464 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1780155530 0x7f1768004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f1785fdf700 1 -- 172.21.15.1:0/732090464 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1780155530 msgr2=0x7f1768004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:12.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f1785fdf700 1 --2- 172.21.15.1:0/732090464 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1780155530 0x7f1768004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f1785fdf700 1 -- 172.21.15.1:0/732090464 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17680038e0 msgr2=0x7f1768003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:12.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f1785fdf700 1 --2- 172.21.15.1:0/732090464 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17680038e0 0x7f1768003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f1785fdf700 1 -- 172.21.15.1:0/732090464 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17680033f0 con 0x7f1768004b80 2023-11-15T01:39:12.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.037+0000 7f1785fdf700 1 --2- 172.21.15.1:0/732090464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1768004b80 0x7f1768005000 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f1770009c30 tx=0x7f1770009060).ready entity=mon.0 client_cookie=2c33433502363cf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:12.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.038+0000 7f177ffff700 1 -- 172.21.15.1:0/732090464 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17700095c0 con 0x7f1768004b80 2023-11-15T01:39:12.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.038+0000 7f177ffff700 1 -- 172.21.15.1:0/732090464 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177000e710 con 0x7f1768004b80 2023-11-15T01:39:12.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.038+0000 7f177ffff700 1 -- 172.21.15.1:0/732090464 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177000ea90 con 0x7f1768004b80 2023-11-15T01:39:12.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.038+0000 7f17867e0700 1 -- 172.21.15.1:0/732090464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1768004b80 msgr2=0x7f1768005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.038+0000 7f17867e0700 1 --2- 172.21.15.1:0/732090464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1768004b80 0x7f1768005000 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f1770009c30 tx=0x7f1770009060).stop 2023-11-15T01:39:12.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.038+0000 7f1785fdf700 1 -- 172.21.15.1:0/732090464 reap_dead start 2023-11-15T01:39:12.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.038+0000 7f17867e0700 1 -- 172.21.15.1:0/732090464 shutdown_connections 2023-11-15T01:39:12.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.038+0000 7f17867e0700 1 -- 172.21.15.1:0/732090464 >> 172.21.15.1:0/732090464 conn(0x7f17800947e0 msgr2=0x7f178006a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:12.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.038+0000 7f17867e0700 1 -- 172.21.15.1:0/732090464 shutdown_connections 2023-11-15T01:39:12.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.038+0000 7f17867e0700 1 -- 172.21.15.1:0/732090464 wait complete. 2023-11-15T01:39:12.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.039+0000 7f17867e0700 1 Processor -- start 2023-11-15T01:39:12.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.040+0000 7f17867e0700 1 -- start start 2023-11-15T01:39:12.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.040+0000 7f17867e0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17800afe50 0x7f17800b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.040+0000 7f17867e0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1780167f80 0x7f17800ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.040+0000 7f17867e0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17800ae5a0 0x7f17801537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.040+0000 7f17867e0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17801684f0 con 0x7f1780167f80 2023-11-15T01:39:12.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.040+0000 7f17867e0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17801687d0 con 0x7f17800afe50 2023-11-15T01:39:12.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.040+0000 7f17867e0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1780168ab0 con 0x7f17800ae5a0 2023-11-15T01:39:12.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f1784fdd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1780167f80 0x7f17800ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f1784fdd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1780167f80 0x7f17800ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38612/0 (socket says 172.21.15.1:38612) 2023-11-15T01:39:12.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f1784fdd700 1 -- 172.21.15.1:0/528641740 learned_addr learned my addr 172.21.15.1:0/528641740 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:12.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f17857de700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17800afe50 0x7f17800b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f1785fdf700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17800ae5a0 0x7f17801537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f1784fdd700 1 -- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17800ae5a0 msgr2=0x7f17801537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f1784fdd700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17800ae5a0 0x7f17801537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f1784fdd700 1 -- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17800afe50 msgr2=0x7f17800b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f1784fdd700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17800afe50 0x7f17800b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f1784fdd700 1 -- 172.21.15.1:0/528641740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1780164ac0 con 0x7f1780167f80 2023-11-15T01:39:12.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f17857de700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17800afe50 0x7f17800b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:39:12.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f1785fdf700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17800ae5a0 0x7f17801537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:39:12.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f1784fdd700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1780167f80 0x7f17800ae0b0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f1774006940 tx=0x7f1774009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:12.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f177d7fa700 1 -- 172.21.15.1:0/528641740 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177400f940 con 0x7f1780167f80 2023-11-15T01:39:12.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f177d7fa700 1 -- 172.21.15.1:0/528641740 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177400faa0 con 0x7f1780167f80 2023-11-15T01:39:12.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f17867e0700 1 -- 172.21.15.1:0/528641740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1780168d90 con 0x7f1780167f80 2023-11-15T01:39:12.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f177d7fa700 1 -- 172.21.15.1:0/528641740 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177400fe20 con 0x7f1780167f80 2023-11-15T01:39:12.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.041+0000 7f17867e0700 1 -- 172.21.15.1:0/528641740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17800ad4d0 con 0x7f1780167f80 2023-11-15T01:39:12.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.042+0000 7f17867e0700 1 -- 172.21.15.1:0/528641740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1780164e30 con 0x7f1780167f80 2023-11-15T01:39:12.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.043+0000 7f177d7fa700 1 -- 172.21.15.1:0/528641740 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1774014650 con 0x7f1780167f80 2023-11-15T01:39:12.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.043+0000 7f177d7fa700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f176c05f270 0x7f176c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.043+0000 7f177d7fa700 1 -- 172.21.15.1:0/528641740 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f177407b1d0 con 0x7f1780167f80 2023-11-15T01:39:12.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.043+0000 7f17857de700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f176c05f270 0x7f176c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.044+0000 7f17857de700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f176c05f270 0x7f176c061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1778007be0 tx=0x7f1778009040).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:12.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.047+0000 7f177d7fa700 1 -- 172.21.15.1:0/528641740 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f177404c170 con 0x7f1780167f80 2023-11-15T01:39:12.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.261+0000 7f17867e0700 1 -- 172.21.15.1:0/528641740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1780164c50 con 0x7f1780167f80 2023-11-15T01:39:12.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.262+0000 7f177d7fa700 1 -- 172.21.15.1:0/528641740 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f1774018090 con 0x7f1780167f80 2023-11-15T01:39:12.263 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:39:12.264 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7614,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3754341822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3754341822},{"type":"v1","addr":"172.21.15.1:6834","nonce":3754341822}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7617,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2242100060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":2242100060},{"type":"v1","addr":"172.21.15.1:6835","nonce":2242100060}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/1053521790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":1053521790},{"type":"v1","addr":"172.21.15.141:6836","nonce":1053521790}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:39:02.583978+0000","modified":"2023-11-15T01:39:05.601021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7629":{"gid":7629,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/2390881160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":2390881160},{"type":"v1","addr":"172.21.15.141:6837","nonce":2390881160}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-11-15T01:39:12.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.263+0000 7f17867e0700 1 -- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f176c05f270 msgr2=0x7f176c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.263+0000 7f17867e0700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f176c05f270 0x7f176c061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1778007be0 tx=0x7f1778009040).stop 2023-11-15T01:39:12.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.263+0000 7f17867e0700 1 -- 172.21.15.1:0/528641740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1780167f80 msgr2=0x7f17800ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.263+0000 7f17867e0700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1780167f80 0x7f17800ae0b0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f1774006940 tx=0x7f1774009060).stop 2023-11-15T01:39:12.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.263+0000 7f17867e0700 1 -- 172.21.15.1:0/528641740 shutdown_connections 2023-11-15T01:39:12.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.263+0000 7f17867e0700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f176c05f270 0x7f176c061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.263+0000 7f17867e0700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17800ae5a0 0x7f17801537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.264+0000 7f17867e0700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17800afe50 0x7f17800b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.264+0000 7f17867e0700 1 --2- 172.21.15.1:0/528641740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1780167f80 0x7f17800ae0b0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.264+0000 7f17867e0700 1 -- 172.21.15.1:0/528641740 >> 172.21.15.1:0/528641740 conn(0x7f17800947e0 msgr2=0x7f17801503d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:12.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.264+0000 7f17867e0700 1 -- 172.21.15.1:0/528641740 shutdown_connections 2023-11-15T01:39:12.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.264+0000 7f17867e0700 1 -- 172.21.15.1:0/528641740 wait complete. 2023-11-15T01:39:12.268 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 55 2023-11-15T01:39:12.679 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-15T01:39:02.583978+0000', 'modified': '2023-11-15T01:39:05.601021+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7629}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7629': {'gid': 7629, 'name': 'd', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.141:6837/2390881160', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6835', 'nonce': 2390881160}, {'type': 'v1', 'addr': '172.21.15.141:6837', 'nonce': 2390881160}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-15T01:39:12.680 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-15T01:39:12.680 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-15T01:39:12.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.803+0000 7f44c759e700 1 Processor -- start 2023-11-15T01:39:12.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.803+0000 7f44c759e700 1 -- start start 2023-11-15T01:39:12.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.804+0000 7f44c759e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f44c80c9fc0 0x7f44c80c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.804+0000 7f44c759e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c80c7980 con 0x7f44c8155530 2023-11-15T01:39:12.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.804+0000 7f44c759e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c80aa890 con 0x7f44c8151e10 2023-11-15T01:39:12.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.804+0000 7f44c759e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c80c7bd0 con 0x7f44c80c9fc0 2023-11-15T01:39:12.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.804+0000 7f44c5d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f44c8155530 0x7f44c80c98b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59200/0 (socket says 172.21.15.1:59200) 2023-11-15T01:39:12.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.804+0000 7f44c5d9b700 1 -- 172.21.15.1:0/517382832 learned_addr learned my addr 172.21.15.1:0/517382832 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:39:12.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.804+0000 7f44c6d9d700 1 --2- 172.21.15.1:0/517382832 >> v2:172.21.15.141:3300/0 conn(0x7f44c80c9fc0 0x7f44c80c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.804+0000 7f44c559a700 1 -- 172.21.15.1:0/517382832 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547947817 0 0) 0x7f44c80c7980 con 0x7f44c8155530 2023-11-15T01:39:12.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.804+0000 7f44c559a700 1 -- 172.21.15.1:0/517382832 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44b40033f0 con 0x7f44c8155530 2023-11-15T01:39:12.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.805+0000 7f44c6d9d700 1 -- 172.21.15.1:0/517382832 >> v1:172.21.15.141:6789/0 conn(0x7f44c8151e10 legacy=0x7f44c80aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.805+0000 7f44c6d9d700 1 -- 172.21.15.1:0/517382832 >> v1:172.21.15.1:6789/0 conn(0x7f44c8155530 legacy=0x7f44c80c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.805+0000 7f44c6d9d700 1 -- 172.21.15.1:0/517382832 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c80c7eb0 con 0x7f44c80c9fc0 2023-11-15T01:39:12.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.805+0000 7f44c6d9d700 1 --2- 172.21.15.1:0/517382832 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44c80c9fc0 0x7f44c80c86b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f44c0009e60 tx=0x7f44c0009780).ready entity=mon.1 client_cookie=9e37e2fad5507b64 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:12.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.805+0000 7f44c559a700 1 -- 172.21.15.1:0/517382832 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c000e070 con 0x7f44c80c9fc0 2023-11-15T01:39:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.805+0000 7f44c559a700 1 -- 172.21.15.1:0/517382832 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c000bb60 con 0x7f44c80c9fc0 2023-11-15T01:39:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.805+0000 7f44c559a700 1 -- 172.21.15.1:0/517382832 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0012410 con 0x7f44c80c9fc0 2023-11-15T01:39:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.805+0000 7f44c759e700 1 -- 172.21.15.1:0/517382832 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44c80c9fc0 msgr2=0x7f44c80c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.805+0000 7f44c759e700 1 --2- 172.21.15.1:0/517382832 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44c80c9fc0 0x7f44c80c86b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f44c0009e60 tx=0x7f44c0009780).stop 2023-11-15T01:39:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.805+0000 7f44c759e700 1 -- 172.21.15.1:0/517382832 shutdown_connections 2023-11-15T01:39:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.806+0000 7f44c759e700 1 --2- 172.21.15.1:0/517382832 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44c80c9fc0 0x7f44c80c86b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.806+0000 7f44c759e700 1 -- 172.21.15.1:0/517382832 >> 172.21.15.1:0/517382832 conn(0x7f44c80947e0 msgr2=0x7f44c806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.806+0000 7f44c759e700 1 -- 172.21.15.1:0/517382832 shutdown_connections 2023-11-15T01:39:12.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.806+0000 7f44c759e700 1 -- 172.21.15.1:0/517382832 wait complete. 2023-11-15T01:39:12.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.807+0000 7f44c759e700 1 Processor -- start 2023-11-15T01:39:12.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.807+0000 7f44c759e700 1 -- start start 2023-11-15T01:39:12.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.807+0000 7f44c759e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44c80c9fc0 0x7f44c80b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.807+0000 7f44c759e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44c8151e10 0x7f44c814e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.807+0000 7f44c759e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44c8155530 0x7f44c8153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.807+0000 7f44c759e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80affe0 con 0x7f44c8155530 2023-11-15T01:39:12.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.807+0000 7f44c759e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c814ea40 con 0x7f44c80c9fc0 2023-11-15T01:39:12.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.807+0000 7f44c759e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80b0280 con 0x7f44c8151e10 2023-11-15T01:39:12.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44c6d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44c8155530 0x7f44c8153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44c6d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44c8155530 0x7f44c8153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38624/0 (socket says 172.21.15.1:38624) 2023-11-15T01:39:12.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44c6d9d700 1 -- 172.21.15.1:0/4113473857 learned_addr learned my addr 172.21.15.1:0/4113473857 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:12.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44c659c700 1 --2- 172.21.15.1:0/4113473857 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44c80c9fc0 0x7f44c80b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44c5d9b700 1 --2- 172.21.15.1:0/4113473857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44c8151e10 0x7f44c814e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44c6d9d700 1 -- 172.21.15.1:0/4113473857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44c8151e10 msgr2=0x7f44c814e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44c6d9d700 1 --2- 172.21.15.1:0/4113473857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44c8151e10 0x7f44c814e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44c6d9d700 1 -- 172.21.15.1:0/4113473857 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44c80c9fc0 msgr2=0x7f44c80b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44c6d9d700 1 --2- 172.21.15.1:0/4113473857 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44c80c9fc0 0x7f44c80b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44c6d9d700 1 -- 172.21.15.1:0/4113473857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c0009a20 con 0x7f44c8155530 2023-11-15T01:39:12.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44c6d9d700 1 --2- 172.21.15.1:0/4113473857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44c8155530 0x7f44c8153370 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f44c00094d0 tx=0x7f44c0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:12.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44be7fc700 1 -- 172.21.15.1:0/4113473857 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c001c660 con 0x7f44c8155530 2023-11-15T01:39:12.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44be7fc700 1 -- 172.21.15.1:0/4113473857 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c001c7c0 con 0x7f44c8155530 2023-11-15T01:39:12.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44be7fc700 1 -- 172.21.15.1:0/4113473857 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c001cb60 con 0x7f44c8155530 2023-11-15T01:39:12.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44c759e700 1 -- 172.21.15.1:0/4113473857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c80b0560 con 0x7f44c8155530 2023-11-15T01:39:12.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.808+0000 7f44c759e700 1 -- 172.21.15.1:0/4113473857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c81686e0 con 0x7f44c8155530 2023-11-15T01:39:12.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.810+0000 7f44be7fc700 1 -- 172.21.15.1:0/4113473857 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f44c0003040 con 0x7f44c8155530 2023-11-15T01:39:12.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.810+0000 7f44be7fc700 1 --2- 172.21.15.1:0/4113473857 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f44a805f270 0x7f44a8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.810+0000 7f44be7fc700 1 -- 172.21.15.1:0/4113473857 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f44c007c5a0 con 0x7f44c8155530 2023-11-15T01:39:12.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.811+0000 7f44c659c700 1 --2- 172.21.15.1:0/4113473857 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f44a805f270 0x7f44a8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.811+0000 7f44c659c700 1 --2- 172.21.15.1:0/4113473857 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f44a805f270 0x7f44a8061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f44b8003750 tx=0x7f44b8009040).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:12.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.812+0000 7f44de80eb80 1 Processor -- start 2023-11-15T01:39:12.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.812+0000 7f44de80eb80 1 -- start start 2023-11-15T01:39:12.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.813+0000 7f44de80eb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c24dde40 0x55d8c2721880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.813+0000 7f44de80eb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c276a4e0 0x55d8c2721d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.813+0000 7f44de80eb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c2749cf0 0x55d8c271c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.813+0000 7f44de80eb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c26e7060 con 0x55d8c276a4e0 2023-11-15T01:39:12.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.813+0000 7f44de80eb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c265e1f0 con 0x55d8c2749cf0 2023-11-15T01:39:12.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.813+0000 7f44de80eb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8c2673440 con 0x55d8c24dde40 2023-11-15T01:39:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.813+0000 7f44c5d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c276a4e0 0x55d8c2721d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.813+0000 7f44c5d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c276a4e0 0x55d8c2721d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38640/0 (socket says 172.21.15.1:38640) 2023-11-15T01:39:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.813+0000 7f44c5d9b700 1 -- 172.21.15.1:0/300505499 learned_addr learned my addr 172.21.15.1:0/300505499 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.813+0000 7f44c659c700 1 --2- 172.21.15.1:0/300505499 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c24dde40 0x55d8c2721880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.813+0000 7f44c5d9b700 1 -- 172.21.15.1:0/300505499 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c24dde40 msgr2=0x55d8c2721880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:12.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.813+0000 7f44c5d9b700 1 --2- 172.21.15.1:0/300505499 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c24dde40 0x55d8c2721880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.813+0000 7f44c6d9d700 1 --2- 172.21.15.1:0/300505499 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c2749cf0 0x55d8c271c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.813+0000 7f44c5d9b700 1 -- 172.21.15.1:0/300505499 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c2749cf0 msgr2=0x55d8c271c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:12.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.814+0000 7f44c5d9b700 1 --2- 172.21.15.1:0/300505499 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c2749cf0 0x55d8c271c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.814+0000 7f44c5d9b700 1 -- 172.21.15.1:0/300505499 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8c266c620 con 0x55d8c276a4e0 2023-11-15T01:39:12.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.814+0000 7f44c5d9b700 1 --2- 172.21.15.1:0/300505499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c276a4e0 0x55d8c2721d70 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f44b0005750 tx=0x7f44b0009040).ready entity=mon.0 client_cookie=9fa4c59276bd8325 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:12.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.814+0000 7f44a77fe700 1 -- 172.21.15.1:0/300505499 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b00070d0 con 0x55d8c276a4e0 2023-11-15T01:39:12.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.814+0000 7f44a77fe700 1 -- 172.21.15.1:0/300505499 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b0007230 con 0x55d8c276a4e0 2023-11-15T01:39:12.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.814+0000 7f44a77fe700 1 -- 172.21.15.1:0/300505499 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b00075b0 con 0x55d8c276a4e0 2023-11-15T01:39:12.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.814+0000 7f44de80eb80 1 -- 172.21.15.1:0/300505499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c276a4e0 msgr2=0x55d8c2721d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.814+0000 7f44de80eb80 1 --2- 172.21.15.1:0/300505499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c276a4e0 0x55d8c2721d70 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f44b0005750 tx=0x7f44b0009040).stop 2023-11-15T01:39:12.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.814+0000 7f44de80eb80 1 -- 172.21.15.1:0/300505499 shutdown_connections 2023-11-15T01:39:12.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.814+0000 7f44de80eb80 1 --2- 172.21.15.1:0/300505499 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c2749cf0 0x55d8c271c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.814+0000 7f44de80eb80 1 --2- 172.21.15.1:0/300505499 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c24dde40 0x55d8c2721880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.814+0000 7f44de80eb80 1 --2- 172.21.15.1:0/300505499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c276a4e0 0x55d8c2721d70 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.814+0000 7f44de80eb80 1 -- 172.21.15.1:0/300505499 >> 172.21.15.1:0/300505499 conn(0x55d8c258b4a0 msgr2=0x55d8c276a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:12.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.815+0000 7f44de80eb80 1 -- 172.21.15.1:0/300505499 shutdown_connections 2023-11-15T01:39:12.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.815+0000 7f44de80eb80 1 -- 172.21.15.1:0/300505499 wait complete. 2023-11-15T01:39:12.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.815+0000 7f44de80eb80 1 -- start start 2023-11-15T01:39:12.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.815+0000 7f44de80eb80 1 Processor -- start 2023-11-15T01:39:12.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.816+0000 7f44de80eb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c24dde40 0x55d8c27460d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.816+0000 7f44de80eb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c2749cf0 0x55d8c274eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.816+0000 7f44de80eb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c276a4e0 0x55d8c274f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.816+0000 7f44de80eb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c2673580 con 0x55d8c2749cf0 2023-11-15T01:39:12.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.816+0000 7f44de80eb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c2673800 con 0x55d8c276a4e0 2023-11-15T01:39:12.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.816+0000 7f44de80eb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8c263ee10 con 0x55d8c24dde40 2023-11-15T01:39:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.816+0000 7f44de80eb80 10 client.0 ll_register_callbacks cb 0x55d8c26e1640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:39:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.816+0000 7f44c5d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c2749cf0 0x55d8c274eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.816+0000 7f44c5d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c2749cf0 0x55d8c274eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38642/0 (socket says 172.21.15.1:38642) 2023-11-15T01:39:12.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.816+0000 7f44c5d9b700 1 -- 172.21.15.1:0/1749769090 learned_addr learned my addr 172.21.15.1:0/1749769090 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:12.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.816+0000 7f44c659c700 1 --2- 172.21.15.1:0/1749769090 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c24dde40 0x55d8c27460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.816+0000 7f44c6d9d700 1 --2- 172.21.15.1:0/1749769090 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c276a4e0 0x55d8c274f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44c5d9b700 1 -- 172.21.15.1:0/1749769090 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c24dde40 msgr2=0x55d8c27460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:12.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44c5d9b700 1 --2- 172.21.15.1:0/1749769090 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c24dde40 0x55d8c27460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44c5d9b700 1 -- 172.21.15.1:0/1749769090 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c276a4e0 msgr2=0x55d8c274f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:12.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44c5d9b700 1 --2- 172.21.15.1:0/1749769090 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c276a4e0 0x55d8c274f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44c5d9b700 1 -- 172.21.15.1:0/1749769090 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b000f040 con 0x55d8c2749cf0 2023-11-15T01:39:12.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44c6d9d700 1 --2- 172.21.15.1:0/1749769090 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c276a4e0 0x55d8c274f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:39:12.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44c5d9b700 1 --2- 172.21.15.1:0/1749769090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c2749cf0 0x55d8c274eb50 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f44b0006000 tx=0x55d8c27224d0).ready entity=mon.0 client_cookie=3ffcaed3cc81ca37 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:12.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:39:12.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44a4ff9700 1 -- 172.21.15.1:0/1749769090 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0005ae0 con 0x55d8c2749cf0 2023-11-15T01:39:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44a4ff9700 1 -- 172.21.15.1:0/1749769090 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f44b0005c40 con 0x55d8c2749cf0 2023-11-15T01:39:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44de80eb80 1 -- 172.21.15.1:0/1749769090 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8c2715720 con 0x55d8c2749cf0 2023-11-15T01:39:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44a4ff9700 1 -- 172.21.15.1:0/1749769090 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44b0005e00 con 0x55d8c2749cf0 2023-11-15T01:39:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44de80eb80 10 client.7785 fetch_fsmap learned FSMap version 55 2023-11-15T01:39:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44de80eb80 1 -- 172.21.15.1:0/1749769090 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55d8c26679c0 con 0x55d8c2749cf0 2023-11-15T01:39:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44a4ff9700 1 -- 172.21.15.1:0/1749769090 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8c2715720 con 0x55d8c2749cf0 2023-11-15T01:39:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44a4ff9700 1 -- 172.21.15.1:0/1749769090 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 55) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f44b0009c60 con 0x55d8c2749cf0 2023-11-15T01:39:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44de80eb80 10 client.7785 fetch_fsmap finished waiting for FSMap version 55 2023-11-15T01:39:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44de80eb80 10 client.7785 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-15T01:39:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44de80eb80 20 client.7785 populate_metadata read hostname 'smithi001' 2023-11-15T01:39:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1749769090 >> [v2:172.21.15.141:6835/2390881160,v1:172.21.15.141:6837/2390881160] conn(0x55d8c2765300 0x55d8c27656e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44de80eb80 4 client.7785 mds_command: new command op to 7629 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-15T01:39:12.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.817+0000 7f44de80eb80 1 -- 172.21.15.1:0/1749769090 --> [v2:172.21.15.141:6835/2390881160,v1:172.21.15.141:6837/2390881160] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8c24d9ca0 con 0x55d8c2765300 2023-11-15T01:39:12.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.818+0000 7f44c659c700 1 --2- 172.21.15.1:0/1749769090 >> [v2:172.21.15.141:6835/2390881160,v1:172.21.15.141:6837/2390881160] conn(0x55d8c2765300 0x55d8c27656e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.818+0000 7f44a4ff9700 10 client.7785 ms_handle_connect on v2:172.21.15.141:6835/2390881160 2023-11-15T01:39:12.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.818+0000 7f44c659c700 1 --2- 172.21.15.1:0/1749769090 >> [v2:172.21.15.141:6835/2390881160,v1:172.21.15.141:6837/2390881160] conn(0x55d8c2765300 0x55d8c27656e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f012079a9f1e0a8c server_cookie=2993fe18bfceaa87 in_seq=0 out_seq=0 2023-11-15T01:39:12.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.819+0000 7f44a4ff9700 1 -- 172.21.15.1:0/1749769090 <== mds.0 v2:172.21.15.141:6835/2390881160 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55d8c24d9ca0 con 0x55d8c2765300 2023-11-15T01:39:12.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.819+0000 7f44a4ff9700 10 client.7785 handle_command_reply: tid=0 2023-11-15T01:39:12.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.819+0000 7f44de80eb80 1 client.7785 shutdown 2023-11-15T01:39:12.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.819+0000 7f44de80eb80 1 -- 172.21.15.1:0/1749769090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c2749cf0 msgr2=0x55d8c274eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.819+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1749769090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c2749cf0 0x55d8c274eb50 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f44b0006000 tx=0x55d8c27224d0).stop 2023-11-15T01:39:12.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.819+0000 7f44de80eb80 1 -- 172.21.15.1:0/1749769090 shutdown_connections 2023-11-15T01:39:12.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.819+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1749769090 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c276a4e0 0x55d8c274f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.819+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1749769090 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c24dde40 0x55d8c27460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.819+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1749769090 >> [v2:172.21.15.141:6835/2390881160,v1:172.21.15.141:6837/2390881160] conn(0x55d8c2765300 0x55d8c27656e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.819+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1749769090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c2749cf0 0x55d8c274eb50 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.819+0000 7f44a4ff9700 0 client.7785 ms_handle_reset on v2:172.21.15.141:6835/2390881160 2023-11-15T01:39:12.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.819+0000 7f44de80eb80 1 -- 172.21.15.1:0/1749769090 >> 172.21.15.1:0/1749769090 conn(0x55d8c258b4a0 msgr2=0x55d8c271c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:12.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.819+0000 7f44de80eb80 1 -- 172.21.15.1:0/1749769090 shutdown_connections 2023-11-15T01:39:12.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.819+0000 7f44de80eb80 1 -- 172.21.15.1:0/1749769090 wait complete. 2023-11-15T01:39:12.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.819+0000 7f44de80eb80 20 client.7785 trim_cache size 0 max 16384 2023-11-15T01:39:12.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.836+0000 7f44de80eb80 1 Processor -- start 2023-11-15T01:39:12.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.836+0000 7f44de80eb80 1 -- start start 2023-11-15T01:39:12.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.836+0000 7f44de80eb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c24dde40 0x55d8c274ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44de80eb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c2749cf0 0x55d8c2762ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44de80eb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c276a4e0 0x55d8c27633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44de80eb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c274d4b0 con 0x55d8c24dde40 2023-11-15T01:39:12.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44de80eb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c2764980 con 0x55d8c276a4e0 2023-11-15T01:39:12.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44de80eb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8c2764d50 con 0x55d8c2749cf0 2023-11-15T01:39:12.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44c659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c24dde40 0x55d8c274ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44c659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c24dde40 0x55d8c274ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38652/0 (socket says 172.21.15.1:38652) 2023-11-15T01:39:12.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44c659c700 1 -- 172.21.15.1:0/1036650835 learned_addr learned my addr 172.21.15.1:0/1036650835 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:12.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44c659c700 1 -- 172.21.15.1:0/1036650835 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c2749cf0 msgr2=0x55d8c2762ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:12.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44c5d9b700 1 --2- 172.21.15.1:0/1036650835 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c2749cf0 0x55d8c2762ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44c659c700 1 --2- 172.21.15.1:0/1036650835 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c2749cf0 0x55d8c2762ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44c659c700 1 -- 172.21.15.1:0/1036650835 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c276a4e0 msgr2=0x55d8c27633e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:12.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44c659c700 1 --2- 172.21.15.1:0/1036650835 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c276a4e0 0x55d8c27633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:39:12.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44c659c700 1 -- 172.21.15.1:0/1036650835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8c2750ac0 con 0x55d8c24dde40 2023-11-15T01:39:12.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44c659c700 1 --2- 172.21.15.1:0/1036650835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c24dde40 0x55d8c274ea20 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x55d8c271d7d0 tx=0x7f44b8012000).ready entity=mon.0 client_cookie=ae501d8d624e08e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:12.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44a7fff700 1 -- 172.21.15.1:0/1036650835 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b80235c0 con 0x55d8c24dde40 2023-11-15T01:39:12.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44a7fff700 1 -- 172.21.15.1:0/1036650835 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b8023720 con 0x55d8c24dde40 2023-11-15T01:39:12.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.837+0000 7f44a7fff700 1 -- 172.21.15.1:0/1036650835 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8023aa0 con 0x55d8c24dde40 2023-11-15T01:39:12.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.838+0000 7f44de80eb80 1 -- 172.21.15.1:0/1036650835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c24dde40 msgr2=0x55d8c274ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.838+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1036650835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c24dde40 0x55d8c274ea20 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x55d8c271d7d0 tx=0x7f44b8012000).stop 2023-11-15T01:39:12.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.838+0000 7f44de80eb80 1 -- 172.21.15.1:0/1036650835 shutdown_connections 2023-11-15T01:39:12.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.838+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1036650835 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c276a4e0 0x55d8c27633e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:39:12.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.838+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1036650835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c24dde40 0x55d8c274ea20 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.838+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1036650835 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c2749cf0 0x55d8c2762ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.838+0000 7f44de80eb80 1 -- 172.21.15.1:0/1036650835 >> 172.21.15.1:0/1036650835 conn(0x55d8c258b4a0 msgr2=0x55d8c276a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:12.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.838+0000 7f44de80eb80 1 -- 172.21.15.1:0/1036650835 shutdown_connections 2023-11-15T01:39:12.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.838+0000 7f44de80eb80 1 -- 172.21.15.1:0/1036650835 wait complete. 2023-11-15T01:39:12.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.838+0000 7f44de80eb80 1 -- start start 2023-11-15T01:39:12.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.838+0000 7f44de80eb80 1 Processor -- start 2023-11-15T01:39:12.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.839+0000 7f44de80eb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c24dde40 0x55d8c2762ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.839+0000 7f44de80eb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c2749cf0 0x55d8c27cc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.839+0000 7f44de80eb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c276a4e0 0x55d8c271c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.839+0000 7f44de80eb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c27cd040 con 0x55d8c276a4e0 2023-11-15T01:39:12.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.839+0000 7f44de80eb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c2763970 con 0x55d8c2749cf0 2023-11-15T01:39:12.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.839+0000 7f44de80eb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8c27cc830 con 0x55d8c24dde40 2023-11-15T01:39:12.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.839+0000 7f44de80eb80 10 client.0 ll_register_callbacks cb 0x55d8c26e1640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:39:12.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.839+0000 7f44c6d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c276a4e0 0x55d8c271c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.839+0000 7f44c6d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c276a4e0 0x55d8c271c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38660/0 (socket says 172.21.15.1:38660) 2023-11-15T01:39:12.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.839+0000 7f44c6d9d700 1 -- 172.21.15.1:0/1921327800 learned_addr learned my addr 172.21.15.1:0/1921327800 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:12.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44c6d9d700 1 -- 172.21.15.1:0/1921327800 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c24dde40 msgr2=0x55d8c2762ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:12.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44c659c700 1 --2- 172.21.15.1:0/1921327800 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c24dde40 0x55d8c2762ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44c5d9b700 1 --2- 172.21.15.1:0/1921327800 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c2749cf0 0x55d8c27cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44c6d9d700 1 --2- 172.21.15.1:0/1921327800 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c24dde40 0x55d8c2762ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44c6d9d700 1 -- 172.21.15.1:0/1921327800 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c2749cf0 msgr2=0x55d8c27cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:12.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44c6d9d700 1 --2- 172.21.15.1:0/1921327800 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c2749cf0 0x55d8c27cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44c6d9d700 1 -- 172.21.15.1:0/1921327800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b801d040 con 0x55d8c276a4e0 2023-11-15T01:39:12.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44c6d9d700 1 --2- 172.21.15.1:0/1921327800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c276a4e0 0x55d8c271c120 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f44c0050e40 tx=0x7f44c0028040).ready entity=mon.0 client_cookie=cd5ac71cd024c884 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:12.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:39:12.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44a4ff9700 1 -- 172.21.15.1:0/1921327800 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0024520 con 0x55d8c276a4e0 2023-11-15T01:39:12.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44a4ff9700 1 -- 172.21.15.1:0/1921327800 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f44c0031e40 con 0x55d8c276a4e0 2023-11-15T01:39:12.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44de80eb80 1 -- 172.21.15.1:0/1921327800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f44b0007230 con 0x55d8c276a4e0 2023-11-15T01:39:12.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44a4ff9700 1 -- 172.21.15.1:0/1921327800 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44c0050840 con 0x55d8c276a4e0 2023-11-15T01:39:12.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44de80eb80 10 client.7791 fetch_fsmap learned FSMap version 55 2023-11-15T01:39:12.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44de80eb80 1 -- 172.21.15.1:0/1921327800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55d8c2667710 con 0x55d8c276a4e0 2023-11-15T01:39:12.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44a4ff9700 1 -- 172.21.15.1:0/1921327800 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b0007230 con 0x55d8c276a4e0 2023-11-15T01:39:12.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44a4ff9700 1 -- 172.21.15.1:0/1921327800 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 55) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f44c007c0b0 con 0x55d8c276a4e0 2023-11-15T01:39:12.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44de80eb80 10 client.7791 fetch_fsmap finished waiting for FSMap version 55 2023-11-15T01:39:12.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44de80eb80 10 client.7791 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-15T01:39:12.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44de80eb80 20 client.7791 populate_metadata read hostname 'smithi001' 2023-11-15T01:39:12.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1921327800 >> [v2:172.21.15.141:6835/2390881160,v1:172.21.15.141:6837/2390881160] conn(0x55d8c274eac0 0x55d8c274eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44de80eb80 4 client.7791 mds_command: new command op to 7629 tid=0[{"prefix": "status"}] 2023-11-15T01:39:12.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.840+0000 7f44de80eb80 1 -- 172.21.15.1:0/1921327800 --> [v2:172.21.15.141:6835/2390881160,v1:172.21.15.141:6837/2390881160] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d8c2510ca0 con 0x55d8c274eac0 2023-11-15T01:39:12.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.841+0000 7f44c659c700 1 --2- 172.21.15.1:0/1921327800 >> [v2:172.21.15.141:6835/2390881160,v1:172.21.15.141:6837/2390881160] conn(0x55d8c274eac0 0x55d8c274eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.841+0000 7f44a4ff9700 10 client.7791 ms_handle_connect on v2:172.21.15.141:6835/2390881160 2023-11-15T01:39:12.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.841+0000 7f44c659c700 1 --2- 172.21.15.1:0/1921327800 >> [v2:172.21.15.141:6835/2390881160,v1:172.21.15.141:6837/2390881160] conn(0x55d8c274eac0 0x55d8c274eea0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=41296df3093ff4a server_cookie=c0d0ade50551c977 in_seq=0 out_seq=0 2023-11-15T01:39:12.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.841+0000 7f44a4ff9700 1 -- 172.21.15.1:0/1921327800 <== mds.0 v2:172.21.15.141:6835/2390881160 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55d8c2510ca0 con 0x55d8c274eac0 2023-11-15T01:39:12.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.841+0000 7f44a4ff9700 10 client.7791 handle_command_reply: tid=0 2023-11-15T01:39:12.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.841+0000 7f44de80eb80 1 client.7791 shutdown 2023-11-15T01:39:12.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.841+0000 7f44de80eb80 1 -- 172.21.15.1:0/1921327800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c276a4e0 msgr2=0x55d8c271c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.841+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1921327800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c276a4e0 0x55d8c271c120 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f44c0050e40 tx=0x7f44c0028040).stop 2023-11-15T01:39:12.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.841+0000 7f44de80eb80 1 -- 172.21.15.1:0/1921327800 shutdown_connections 2023-11-15T01:39:12.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.841+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1921327800 >> [v2:172.21.15.141:6835/2390881160,v1:172.21.15.141:6837/2390881160] conn(0x55d8c274eac0 0x55d8c274eea0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.841+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1921327800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8c276a4e0 0x55d8c271c120 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.841+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1921327800 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8c24dde40 0x55d8c2762ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.841+0000 7f44de80eb80 1 --2- 172.21.15.1:0/1921327800 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8c2749cf0 0x55d8c27cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.841+0000 7f44a4ff9700 0 client.7791 ms_handle_reset on v2:172.21.15.141:6835/2390881160 2023-11-15T01:39:12.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.841+0000 7f44de80eb80 1 -- 172.21.15.1:0/1921327800 >> 172.21.15.1:0/1921327800 conn(0x55d8c258b4a0 msgr2=0x55d8c276afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:12.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.842+0000 7f44de80eb80 1 -- 172.21.15.1:0/1921327800 shutdown_connections 2023-11-15T01:39:12.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.842+0000 7f44de80eb80 1 -- 172.21.15.1:0/1921327800 wait complete. 2023-11-15T01:39:12.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.842+0000 7f44de80eb80 20 client.7791 trim_cache size 0 max 16384 2023-11-15T01:39:12.881 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T01:39:12.882 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "32ffb44b-12dc-4e79-bad7-24a9692dabf6", 2023-11-15T01:39:12.882 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2023-11-15T01:39:12.882 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 7629, 2023-11-15T01:39:12.882 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2023-11-15T01:39:12.883 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2023-11-15T01:39:12.883 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2023-11-15T01:39:12.883 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 10.257274368999999, 2023-11-15T01:39:12.883 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 55, 2023-11-15T01:39:12.883 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 126, 2023-11-15T01:39:12.884 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 126, 2023-11-15T01:39:12.884 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 15.749383375000001 2023-11-15T01:39:12.884 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T01:39:12.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.842+0000 7f44c759e700 1 -- 172.21.15.1:0/4113473857 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f44a805f270 msgr2=0x7f44a8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.842+0000 7f44c759e700 1 --2- 172.21.15.1:0/4113473857 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f44a805f270 0x7f44a8061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f44b8003750 tx=0x7f44b8009040).stop 2023-11-15T01:39:12.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.842+0000 7f44c759e700 1 -- 172.21.15.1:0/4113473857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44c8155530 msgr2=0x7f44c8153370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:12.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.842+0000 7f44c759e700 1 --2- 172.21.15.1:0/4113473857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44c8155530 0x7f44c8153370 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f44c00094d0 tx=0x7f44c0009780).stop 2023-11-15T01:39:12.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.842+0000 7f44c759e700 1 -- 172.21.15.1:0/4113473857 shutdown_connections 2023-11-15T01:39:12.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.842+0000 7f44c759e700 1 --2- 172.21.15.1:0/4113473857 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f44a805f270 0x7f44a8061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.842+0000 7f44c759e700 1 --2- 172.21.15.1:0/4113473857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44c8155530 0x7f44c8153370 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.842+0000 7f44c759e700 1 --2- 172.21.15.1:0/4113473857 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44c80c9fc0 0x7f44c80b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.842+0000 7f44c759e700 1 --2- 172.21.15.1:0/4113473857 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44c8151e10 0x7f44c814e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:12.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.842+0000 7f44c759e700 1 -- 172.21.15.1:0/4113473857 >> 172.21.15.1:0/4113473857 conn(0x7f44c80947e0 msgr2=0x7f44c814fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:12.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.842+0000 7f44c759e700 1 -- 172.21.15.1:0/4113473857 shutdown_connections 2023-11-15T01:39:12.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.842+0000 7f44c759e700 1 -- 172.21.15.1:0/4113473857 wait complete. 2023-11-15T01:39:12.888 DEBUG:teuthology.orchestra.run.smithi001:> ceph fs ls 2023-11-15T01:39:12.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.992+0000 7f0328f6d700 1 Processor -- start 2023-11-15T01:39:12.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.992+0000 7f0328f6d700 1 -- start start 2023-11-15T01:39:12.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.993+0000 7f0328f6d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0324062c10 0x7f03241585e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.993+0000 7f0328f6d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0324063140 0x7f0324158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:12.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.993+0000 7f0328f6d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0324158150 con 0x7f0324154410 2023-11-15T01:39:12.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.993+0000 7f0328f6d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0324158fc0 con 0x7f0324063140 2023-11-15T01:39:12.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.993+0000 7f0328f6d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0324063670 con 0x7f0324062c10 2023-11-15T01:39:12.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.993+0000 7f032259c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0324154410 0x7f03240ab090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59214/0 (socket says 172.21.15.1:59214) 2023-11-15T01:39:12.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.993+0000 7f032259c700 1 -- 172.21.15.1:0/106068155 learned_addr learned my addr 172.21.15.1:0/106068155 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:39:12.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f0321d9b700 1 --2- 172.21.15.1:0/106068155 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0324062c10 0x7f03241585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f0322d9d700 1 --2- 172.21.15.1:0/106068155 >> v2:172.21.15.141:3300/0 conn(0x7f0324063140 0x7f0324158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:12.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 -- 172.21.15.1:0/106068155 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132576163 0 0) 0x7f0324158150 con 0x7f0324154410 2023-11-15T01:39:12.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 -- 172.21.15.1:0/106068155 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03100033f0 con 0x7f0324154410 2023-11-15T01:39:12.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 -- 172.21.15.1:0/106068155 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3912702984 0 0) 0x7f03100033f0 con 0x7f0324154410 2023-11-15T01:39:13.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 -- 172.21.15.1:0/106068155 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0324062c10 msgr2=0x7f03241585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:13.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 --2- 172.21.15.1:0/106068155 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0324062c10 0x7f03241585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:13.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 -- 172.21.15.1:0/106068155 >> v2:172.21.15.141:3300/0 conn(0x7f0324063140 msgr2=0x7f0324158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:13.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 --2- 172.21.15.1:0/106068155 >> v2:172.21.15.141:3300/0 conn(0x7f0324063140 0x7f0324158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:13.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 -- 172.21.15.1:0/106068155 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0324063950 con 0x7f0324154410 2023-11-15T01:39:13.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 -- 172.21.15.1:0/106068155 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f03140017f0 con 0x7f0324154410 2023-11-15T01:39:13.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 -- 172.21.15.1:0/106068155 >> v1:172.21.15.1:6789/0 conn(0x7f0324154410 legacy=0x7f03240ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:13.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 --2- 172.21.15.1:0/106068155 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03100038e0 0x7f0310003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:13.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 --2- 172.21.15.1:0/106068155 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0324062c10 0x7f0310004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:13.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 --2- 172.21.15.1:0/106068155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0310004b80 0x7f0310005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:13.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 -- 172.21.15.1:0/106068155 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0324158fc0 con 0x7f0310004b80 2023-11-15T01:39:13.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 -- 172.21.15.1:0/106068155 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0324063670 con 0x7f03100038e0 2023-11-15T01:39:13.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032159a700 1 -- 172.21.15.1:0/106068155 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031000b8e0 con 0x7f0324062c10 2023-11-15T01:39:13.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f0322d9d700 1 --2- 172.21.15.1:0/106068155 >> v2:172.21.15.141:3300/0 conn(0x7f0324063140 0x7f0324158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:39:13.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f032259c700 1 --2- 172.21.15.1:0/106068155 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03100038e0 0x7f0310003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:13.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f0322d9d700 1 --2- 172.21.15.1:0/106068155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0310004b80 0x7f0310005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:13.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f0321d9b700 1 --2- 172.21.15.1:0/106068155 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0324062c10 0x7f0310004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:13.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f0322d9d700 1 -- 172.21.15.1:0/106068155 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0324062c10 msgr2=0x7f0310004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:13.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f0322d9d700 1 --2- 172.21.15.1:0/106068155 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0324062c10 0x7f0310004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:13.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f0322d9d700 1 -- 172.21.15.1:0/106068155 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03100038e0 msgr2=0x7f0310003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:13.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f0322d9d700 1 --2- 172.21.15.1:0/106068155 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03100038e0 0x7f0310003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:13.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.994+0000 7f0322d9d700 1 -- 172.21.15.1:0/106068155 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03100033f0 con 0x7f0310004b80 2023-11-15T01:39:13.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.995+0000 7f0322d9d700 1 --2- 172.21.15.1:0/106068155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0310004b80 0x7f0310005000 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f031c009c30 tx=0x7f031c009060).ready entity=mon.0 client_cookie=33190b9f163070ac server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:13.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.995+0000 7f032159a700 1 -- 172.21.15.1:0/106068155 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c0095c0 con 0x7f0310004b80 2023-11-15T01:39:13.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.995+0000 7f032159a700 1 -- 172.21.15.1:0/106068155 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031c00e710 con 0x7f0310004b80 2023-11-15T01:39:13.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.995+0000 7f032159a700 1 -- 172.21.15.1:0/106068155 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c00ea90 con 0x7f0310004b80 2023-11-15T01:39:13.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.995+0000 7f0328f6d700 1 -- 172.21.15.1:0/106068155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0310004b80 msgr2=0x7f0310005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:13.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.995+0000 7f0328f6d700 1 --2- 172.21.15.1:0/106068155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0310004b80 0x7f0310005000 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f031c009c30 tx=0x7f031c009060).stop 2023-11-15T01:39:13.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.995+0000 7f0322d9d700 1 -- 172.21.15.1:0/106068155 reap_dead start 2023-11-15T01:39:13.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.995+0000 7f0328f6d700 1 -- 172.21.15.1:0/106068155 shutdown_connections 2023-11-15T01:39:13.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.995+0000 7f0328f6d700 1 -- 172.21.15.1:0/106068155 >> 172.21.15.1:0/106068155 conn(0x7f03240cbbd0 msgr2=0x7f03240c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:13.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.995+0000 7f0328f6d700 1 -- 172.21.15.1:0/106068155 shutdown_connections 2023-11-15T01:39:13.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.995+0000 7f0328f6d700 1 -- 172.21.15.1:0/106068155 wait complete. 2023-11-15T01:39:13.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.996+0000 7f0328f6d700 1 Processor -- start 2023-11-15T01:39:13.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.997+0000 7f0328f6d700 1 -- start start 2023-11-15T01:39:13.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.997+0000 7f0328f6d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0310004b80 0x7f0324155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:13.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.997+0000 7f0328f6d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f032413d9f0 0x7f03241529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:13.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.997+0000 7f0328f6d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0324152ea0 0x7f03240afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:13.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.997+0000 7f0328f6d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0324151240 con 0x7f0310004b80 2023-11-15T01:39:13.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.997+0000 7f0328f6d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0324153320 con 0x7f0324152ea0 2023-11-15T01:39:13.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.997+0000 7f0328f6d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03240b0860 con 0x7f032413d9f0 2023-11-15T01:39:13.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.997+0000 7f032259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0310004b80 0x7f0324155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:13.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.997+0000 7f032259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0310004b80 0x7f0324155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38674/0 (socket says 172.21.15.1:38674) 2023-11-15T01:39:13.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.997+0000 7f032259c700 1 -- 172.21.15.1:0/4031588102 learned_addr learned my addr 172.21.15.1:0/4031588102 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:13.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.998+0000 7f0322d9d700 1 --2- 172.21.15.1:0/4031588102 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0324152ea0 0x7f03240afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:13.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.998+0000 7f0321d9b700 1 --2- 172.21.15.1:0/4031588102 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f032413d9f0 0x7f03241529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:13.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.998+0000 7f032259c700 1 -- 172.21.15.1:0/4031588102 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f032413d9f0 msgr2=0x7f03241529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:13.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.998+0000 7f032259c700 1 --2- 172.21.15.1:0/4031588102 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f032413d9f0 0x7f03241529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:13.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.998+0000 7f032259c700 1 -- 172.21.15.1:0/4031588102 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0324152ea0 msgr2=0x7f03240afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:13.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.998+0000 7f032259c700 1 --2- 172.21.15.1:0/4031588102 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0324152ea0 0x7f03240afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:13.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.998+0000 7f032259c700 1 -- 172.21.15.1:0/4031588102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0324150910 con 0x7f0310004b80 2023-11-15T01:39:13.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.998+0000 7f0322d9d700 1 --2- 172.21.15.1:0/4031588102 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0324152ea0 0x7f03240afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:39:13.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.998+0000 7f032259c700 1 --2- 172.21.15.1:0/4031588102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0310004b80 0x7f0324155970 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f03140077c0 tx=0x7f0314001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:13.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.998+0000 7f031a7fc700 1 -- 172.21.15.1:0/4031588102 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031400fa50 con 0x7f0310004b80 2023-11-15T01:39:13.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.998+0000 7f031a7fc700 1 -- 172.21.15.1:0/4031588102 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031400fbb0 con 0x7f0310004b80 2023-11-15T01:39:13.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.998+0000 7f0328f6d700 1 -- 172.21.15.1:0/4031588102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0324150bf0 con 0x7f0310004b80 2023-11-15T01:39:13.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.998+0000 7f031a7fc700 1 -- 172.21.15.1:0/4031588102 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314015410 con 0x7f0310004b80 2023-11-15T01:39:13.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.998+0000 7f0328f6d700 1 -- 172.21.15.1:0/4031588102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032413de70 con 0x7f0310004b80 2023-11-15T01:39:13.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.999+0000 7f0328f6d700 1 -- 172.21.15.1:0/4031588102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0324151520 con 0x7f0310004b80 2023-11-15T01:39:13.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:12.999+0000 7f031a7fc700 1 -- 172.21.15.1:0/4031588102 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0314015780 con 0x7f0310004b80 2023-11-15T01:39:13.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.000+0000 7f031a7fc700 1 --2- 172.21.15.1:0/4031588102 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f030405f270 0x7f0304061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:13.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.000+0000 7f031a7fc700 1 -- 172.21.15.1:0/4031588102 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f031407acd0 con 0x7f0310004b80 2023-11-15T01:39:13.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.000+0000 7f0321d9b700 1 --2- 172.21.15.1:0/4031588102 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f030405f270 0x7f0304061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:13.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.000+0000 7f0321d9b700 1 --2- 172.21.15.1:0/4031588102 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f030405f270 0x7f0304061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f030c006d80 tx=0x7f030c008040).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:13.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.004+0000 7f031a7fc700 1 -- 172.21.15.1:0/4031588102 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f031404bb50 con 0x7f0310004b80 2023-11-15T01:39:13.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.220+0000 7f0328f6d700 1 -- 172.21.15.1:0/4031588102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f032413e090 con 0x7f0310004b80 2023-11-15T01:39:13.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.220+0000 7f031a7fc700 1 -- 172.21.15.1:0/4031588102 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) v1 ==== 53+0+73 (secure 0 0 0) 0x7f031404f170 con 0x7f0310004b80 2023-11-15T01:39:13.222 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-15T01:39:13.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.222+0000 7f0328f6d700 1 -- 172.21.15.1:0/4031588102 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f030405f270 msgr2=0x7f0304061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:13.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.222+0000 7f0328f6d700 1 --2- 172.21.15.1:0/4031588102 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f030405f270 0x7f0304061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f030c006d80 tx=0x7f030c008040).stop 2023-11-15T01:39:13.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.222+0000 7f0328f6d700 1 -- 172.21.15.1:0/4031588102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0310004b80 msgr2=0x7f0324155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:13.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.222+0000 7f0328f6d700 1 --2- 172.21.15.1:0/4031588102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0310004b80 0x7f0324155970 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f03140077c0 tx=0x7f0314001d90).stop 2023-11-15T01:39:13.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.222+0000 7f0328f6d700 1 -- 172.21.15.1:0/4031588102 shutdown_connections 2023-11-15T01:39:13.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.222+0000 7f0328f6d700 1 --2- 172.21.15.1:0/4031588102 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f030405f270 0x7f0304061730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:13.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.222+0000 7f0328f6d700 1 --2- 172.21.15.1:0/4031588102 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0324152ea0 0x7f03240afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:13.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.222+0000 7f0328f6d700 1 --2- 172.21.15.1:0/4031588102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0310004b80 0x7f0324155970 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:13.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.222+0000 7f0328f6d700 1 --2- 172.21.15.1:0/4031588102 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f032413d9f0 0x7f03241529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:13.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.222+0000 7f0328f6d700 1 -- 172.21.15.1:0/4031588102 >> 172.21.15.1:0/4031588102 conn(0x7f03240cbbd0 msgr2=0x7f03240c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:13.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.222+0000 7f0328f6d700 1 -- 172.21.15.1:0/4031588102 shutdown_connections 2023-11-15T01:39:13.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.222+0000 7f0328f6d700 1 -- 172.21.15.1:0/4031588102 wait complete. 2023-11-15T01:39:13.234 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-15T01:39:13.235 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-15T01:39:13.235 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-11-15T01:39:13.236 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-15T01:39:13.236 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-15T01:39:13.236 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-15T01:39:13.237 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-15T01:39:13.237 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-15T01:39:13.237 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T01:39:13.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:39:13.238 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-11-15T01:39:13.255 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:39:13.256 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T01:39:13.256 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T01:39:13.256 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:39:13.257 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-11-15T01:39:13.257 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:39:13.257 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:39:13.258 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-11-15T01:39:13.258 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-11-15T01:39:13.258 INFO:teuthology.orchestra.run.smithi001.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-15T01:39:13.259 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:39:13.259 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-11-15T01:39:13.259 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-15T01:39:13.259 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 41452sec preferred_lft 41452sec 2023-11-15T01:39:13.259 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2023-11-15T01:39:13.260 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:39:13.260 INFO:teuthology.orchestra.run.smithi001.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:39:13.260 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-11-15T01:39:13.260 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-11-15T01:39:13.260 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:39:13.261 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:39:13.261 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-11-15T01:39:13.261 INFO:teuthology.orchestra.run.smithi001.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-15T01:39:13.261 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:39:13.261 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-15T01:39:13.262 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:39:13.262 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::74ff:4aff:fef6:c8f5/64 scope link 2023-11-15T01:39:13.262 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:39:13.262 INFO:teuthology.orchestra.run.smithi001.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:39:13.262 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-15T01:39:13.263 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::10ca:5cff:fe8a:9a23/64 scope link 2023-11-15T01:39:13.263 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:39:13.263 INFO:teuthology.orchestra.run.smithi001.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:39:13.263 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 92:7a:64:05:0f:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-15T01:39:13.263 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::907a:64ff:fe05:f37/64 scope link 2023-11-15T01:39:13.264 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:39:13.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:39:13.264 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-15T01:39:13.319 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-11-15T01:39:13.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:39:13.321 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-11-15T01:39:13.376 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-11-15T01:39:13.377 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-15T01:39:13.377 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-15T01:39:13.377 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-15T01:39:13.377 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-15T01:39:13.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:39:13.378 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:39:13.379 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:39:13.379 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-15T01:39:13.379 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-15T01:39:13.380 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-15T01:39:13.380 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:39:13.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:39:13.479 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T01:39:13.494 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-15T01:39:13.494 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-15T01:39:13.495 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T01:39:13.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:39:13.496 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2023-11-15T01:39:13.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:39:13.560 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-15T01:39:13.615 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-15T01:39:13.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:39:13.695 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:39:13.695 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:39:13.720 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:39:13.720 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:39:13.722 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-15T01:39:13.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:39:13.723 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-15T01:39:13.789 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-15T01:39:13.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.947+0000 7f844472d700 1 Processor -- start 2023-11-15T01:39:13.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.947+0000 7f844472d700 1 -- start start 2023-11-15T01:39:13.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.948+0000 7f844472d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f843c154150 0x7f843c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:13.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.948+0000 7f844472d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f843c0aa060 0x7f843c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:13.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.948+0000 7f844472d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843c0c06f0 con 0x7f843c0ab1a0 2023-11-15T01:39:13.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.948+0000 7f844472d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843c0c09d0 con 0x7f843c154150 2023-11-15T01:39:13.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.948+0000 7f844472d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c158820 con 0x7f843c0aa060 2023-11-15T01:39:13.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.949+0000 7f84424c9700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f843c154150 0x7f843c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:13.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.949+0000 7f84424c9700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f843c154150 0x7f843c154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:42370/0 (socket says 172.21.15.1:42370) 2023-11-15T01:39:13.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.949+0000 7f84424c9700 1 -- 172.21.15.1:0/329888360 learned_addr learned my addr 172.21.15.1:0/329888360 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:13.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.949+0000 7f8441cc8700 1 --1- 172.21.15.1:0/329888360 >> v1:172.21.15.141:6789/0 conn(0x7f843c0ab1a0 0x7f843c158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:51910/0 (socket says 172.21.15.1:51910) 2023-11-15T01:39:13.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.949+0000 7f8442cca700 1 --2- 172.21.15.1:0/329888360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f843c0aa060 0x7f843c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:13.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.949+0000 7f8442cca700 1 -- 172.21.15.1:0/329888360 >> v2:172.21.15.141:3300/0 conn(0x7f843c154150 msgr2=0x7f843c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:13.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.949+0000 7f8442cca700 1 --2- 172.21.15.1:0/329888360 >> v2:172.21.15.141:3300/0 conn(0x7f843c154150 0x7f843c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:13.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.949+0000 7f8442cca700 1 -- 172.21.15.1:0/329888360 >> v1:172.21.15.141:6789/0 conn(0x7f843c0ab1a0 legacy=0x7f843c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:13.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.949+0000 7f8442cca700 1 -- 172.21.15.1:0/329888360 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c158b00 con 0x7f843c0aa060 2023-11-15T01:39:13.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.949+0000 7f84424c9700 1 --2- 172.21.15.1:0/329888360 >> v2:172.21.15.141:3300/0 conn(0x7f843c154150 0x7f843c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:39:13.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.949+0000 7f8442cca700 1 --2- 172.21.15.1:0/329888360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f843c0aa060 0x7f843c0c5f10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f842c009e60 tx=0x7f842c009780).ready entity=mon.2 client_cookie=51552ce7189a89cc server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:13.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.950+0000 7f84414c7700 1 -- 172.21.15.1:0/329888360 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c00e070 con 0x7f843c0aa060 2023-11-15T01:39:13.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.950+0000 7f84414c7700 1 -- 172.21.15.1:0/329888360 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c00bb60 con 0x7f843c0aa060 2023-11-15T01:39:13.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.950+0000 7f84414c7700 1 -- 172.21.15.1:0/329888360 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c012410 con 0x7f843c0aa060 2023-11-15T01:39:13.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.950+0000 7f844472d700 1 -- 172.21.15.1:0/329888360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f843c0aa060 msgr2=0x7f843c0c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:13.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.950+0000 7f844472d700 1 --2- 172.21.15.1:0/329888360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f843c0aa060 0x7f843c0c5f10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f842c009e60 tx=0x7f842c009780).stop 2023-11-15T01:39:13.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.950+0000 7f844472d700 1 -- 172.21.15.1:0/329888360 shutdown_connections 2023-11-15T01:39:13.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.950+0000 7f844472d700 1 --2- 172.21.15.1:0/329888360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f843c0aa060 0x7f843c0c5f10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:13.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.950+0000 7f844472d700 1 --2- 172.21.15.1:0/329888360 >> v2:172.21.15.141:3300/0 conn(0x7f843c154150 0x7f843c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:13.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.950+0000 7f844472d700 1 -- 172.21.15.1:0/329888360 >> 172.21.15.1:0/329888360 conn(0x7f843c064aa0 msgr2=0x7f843c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:13.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.950+0000 7f844472d700 1 -- 172.21.15.1:0/329888360 shutdown_connections 2023-11-15T01:39:13.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.950+0000 7f844472d700 1 -- 172.21.15.1:0/329888360 wait complete. 2023-11-15T01:39:13.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.951+0000 7f844472d700 1 Processor -- start 2023-11-15T01:39:13.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.951+0000 7f844472d700 1 -- start start 2023-11-15T01:39:13.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.952+0000 7f844472d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f843c0aa060 0x7f843c063e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:13.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.952+0000 7f844472d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f843c0ab1a0 0x7f843c155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:13.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.952+0000 7f844472d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f843c154150 0x7f843c156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:13.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.952+0000 7f844472d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c064320 con 0x7f843c0ab1a0 2023-11-15T01:39:13.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.952+0000 7f844472d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c156370 con 0x7f843c154150 2023-11-15T01:39:13.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.952+0000 7f844472d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c157200 con 0x7f843c0aa060 2023-11-15T01:39:13.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.952+0000 7f8441cc8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f843c0ab1a0 0x7f843c155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:13.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.952+0000 7f8441cc8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f843c0ab1a0 0x7f843c155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38690/0 (socket says 172.21.15.1:38690) 2023-11-15T01:39:13.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.952+0000 7f8441cc8700 1 -- 172.21.15.1:0/2567825673 learned_addr learned my addr 172.21.15.1:0/2567825673 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:13.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.952+0000 7f84424c9700 1 --2- 172.21.15.1:0/2567825673 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f843c0aa060 0x7f843c063e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:13.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.952+0000 7f8442cca700 1 --2- 172.21.15.1:0/2567825673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f843c154150 0x7f843c156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:13.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.953+0000 7f8441cc8700 1 -- 172.21.15.1:0/2567825673 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f843c0aa060 msgr2=0x7f843c063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:13.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.953+0000 7f8441cc8700 1 --2- 172.21.15.1:0/2567825673 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f843c0aa060 0x7f843c063e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:13.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.953+0000 7f8441cc8700 1 -- 172.21.15.1:0/2567825673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f843c154150 msgr2=0x7f843c156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:13.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.953+0000 7f8441cc8700 1 --2- 172.21.15.1:0/2567825673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f843c154150 0x7f843c156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:13.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.953+0000 7f8441cc8700 1 -- 172.21.15.1:0/2567825673 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8434009370 con 0x7f843c0ab1a0 2023-11-15T01:39:13.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.953+0000 7f8441cc8700 1 --2- 172.21.15.1:0/2567825673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f843c0ab1a0 0x7f843c155e80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f8430007fd0 tx=0x7f8430007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:13.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.953+0000 7f843a7fc700 1 -- 172.21.15.1:0/2567825673 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300070d0 con 0x7f843c0ab1a0 2023-11-15T01:39:13.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.953+0000 7f843a7fc700 1 -- 172.21.15.1:0/2567825673 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8430007230 con 0x7f843c0ab1a0 2023-11-15T01:39:13.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.953+0000 7f843a7fc700 1 -- 172.21.15.1:0/2567825673 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300075b0 con 0x7f843c0ab1a0 2023-11-15T01:39:13.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.953+0000 7f844472d700 1 -- 172.21.15.1:0/2567825673 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842c009a20 con 0x7f843c0ab1a0 2023-11-15T01:39:13.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.953+0000 7f844472d700 1 -- 172.21.15.1:0/2567825673 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843c0c4e20 con 0x7f843c0ab1a0 2023-11-15T01:39:13.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.954+0000 7f844472d700 1 -- 172.21.15.1:0/2567825673 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843c153980 con 0x7f843c0ab1a0 2023-11-15T01:39:13.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.954+0000 7f843a7fc700 1 -- 172.21.15.1:0/2567825673 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f84300058f0 con 0x7f843c0ab1a0 2023-11-15T01:39:13.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.955+0000 7f843a7fc700 1 --2- 172.21.15.1:0/2567825673 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f842805f2a0 0x7f8428061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:13.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.955+0000 7f843a7fc700 1 -- 172.21.15.1:0/2567825673 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f8430079b50 con 0x7f843c0ab1a0 2023-11-15T01:39:13.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.955+0000 7f84424c9700 1 --2- 172.21.15.1:0/2567825673 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f842805f2a0 0x7f8428061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:13.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.955+0000 7f84424c9700 1 --2- 172.21.15.1:0/2567825673 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f842805f2a0 0x7f8428061760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f843c0645b0 tx=0x7f84340090f0).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:13.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:13.959+0000 7f843a7fc700 1 -- 172.21.15.1:0/2567825673 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f843004aaf0 con 0x7f843c0ab1a0 2023-11-15T01:39:14.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.158+0000 7f844472d700 1 -- 172.21.15.1:0/2567825673 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f843c158de0 con 0x7f842805f2a0 2023-11-15T01:39:14.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.160+0000 7f843a7fc700 1 -- 172.21.15.1:0/2567825673 <== mgr.6919 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f843c158de0 con 0x7f842805f2a0 2023-11-15T01:39:14.161 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T01:39:14.162 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:39:14.162 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephfs" 2023-11-15T01:39:14.162 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:39:14.163 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T01:39:14.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.161+0000 7f844472d700 1 -- 172.21.15.1:0/2567825673 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f842805f2a0 msgr2=0x7f8428061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:14.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.161+0000 7f844472d700 1 --2- 172.21.15.1:0/2567825673 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f842805f2a0 0x7f8428061760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f843c0645b0 tx=0x7f84340090f0).stop 2023-11-15T01:39:14.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.161+0000 7f844472d700 1 -- 172.21.15.1:0/2567825673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f843c0ab1a0 msgr2=0x7f843c155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:14.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.161+0000 7f844472d700 1 --2- 172.21.15.1:0/2567825673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f843c0ab1a0 0x7f843c155e80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f8430007fd0 tx=0x7f8430007df0).stop 2023-11-15T01:39:14.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.162+0000 7f844472d700 1 -- 172.21.15.1:0/2567825673 shutdown_connections 2023-11-15T01:39:14.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.162+0000 7f844472d700 1 --2- 172.21.15.1:0/2567825673 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f842805f2a0 0x7f8428061760 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:14.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.162+0000 7f844472d700 1 --2- 172.21.15.1:0/2567825673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f843c154150 0x7f843c156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:14.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.162+0000 7f844472d700 1 --2- 172.21.15.1:0/2567825673 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f843c0aa060 0x7f843c063e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:14.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.162+0000 7f844472d700 1 --2- 172.21.15.1:0/2567825673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f843c0ab1a0 0x7f843c155e80 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:14.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.162+0000 7f844472d700 1 -- 172.21.15.1:0/2567825673 >> 172.21.15.1:0/2567825673 conn(0x7f843c064aa0 msgr2=0x7f843c0c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:14.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.162+0000 7f844472d700 1 -- 172.21.15.1:0/2567825673 shutdown_connections 2023-11-15T01:39:14.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.162+0000 7f844472d700 1 -- 172.21.15.1:0/2567825673 wait complete. 2023-11-15T01:39:14.175 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-15T01:39:14.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.294+0000 7f3f1f4f8700 1 Processor -- start 2023-11-15T01:39:14.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.294+0000 7f3f1f4f8700 1 -- start start 2023-11-15T01:39:14.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.295+0000 7f3f1f4f8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3f180c6650 0x7f3f180aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:14.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.295+0000 7f3f1f4f8700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f180ca050 con 0x7f3f181540a0 2023-11-15T01:39:14.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.295+0000 7f3f1f4f8700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f180c9440 con 0x7f3f18154480 2023-11-15T01:39:14.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.295+0000 7f3f1f4f8700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f180c9720 con 0x7f3f180c6650 2023-11-15T01:39:14.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.295+0000 7f3f1da95700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3f180c6650 0x7f3f180aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:14.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.295+0000 7f3f1da95700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3f180c6650 0x7f3f180aaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38694/0 (socket says 172.21.15.1:38694) 2023-11-15T01:39:14.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.295+0000 7f3f1d294700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3f181540a0 0x7f3f180ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59230/0 (socket says 172.21.15.1:59230) 2023-11-15T01:39:14.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.295+0000 7f3f1da95700 1 -- 172.21.15.1:0/1703053361 learned_addr learned my addr 172.21.15.1:0/1703053361 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:14.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.296+0000 7f3f1da95700 1 -- 172.21.15.1:0/1703053361 >> v1:172.21.15.141:6789/0 conn(0x7f3f18154480 legacy=0x7f3f180c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:14.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.296+0000 7f3f1da95700 1 -- 172.21.15.1:0/1703053361 >> v1:172.21.15.1:6789/0 conn(0x7f3f181540a0 legacy=0x7f3f180ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:14.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.296+0000 7f3f17fff700 1 -- 172.21.15.1:0/1703053361 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139762187 0 0) 0x7f3f180ca050 con 0x7f3f181540a0 2023-11-15T01:39:14.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.296+0000 7f3f1da95700 1 -- 172.21.15.1:0/1703053361 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f180c9a00 con 0x7f3f180c6650 2023-11-15T01:39:14.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.296+0000 7f3f1da95700 1 --2- 172.21.15.1:0/1703053361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f180c6650 0x7f3f180aaf40 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f3f10006fd0 tx=0x7f3f100090f0).ready entity=mon.0 client_cookie=5f10355a45fe23c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:14.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.296+0000 7f3f17fff700 1 -- 172.21.15.1:0/1703053361 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1000b600 con 0x7f3f180c6650 2023-11-15T01:39:14.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.296+0000 7f3f17fff700 1 -- 172.21.15.1:0/1703053361 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1000b760 con 0x7f3f180c6650 2023-11-15T01:39:14.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.296+0000 7f3f17fff700 1 -- 172.21.15.1:0/1703053361 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1000bae0 con 0x7f3f180c6650 2023-11-15T01:39:14.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.296+0000 7f3f1f4f8700 1 -- 172.21.15.1:0/1703053361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f180c6650 msgr2=0x7f3f180aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:14.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.296+0000 7f3f1f4f8700 1 --2- 172.21.15.1:0/1703053361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f180c6650 0x7f3f180aaf40 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f3f10006fd0 tx=0x7f3f100090f0).stop 2023-11-15T01:39:14.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.296+0000 7f3f1f4f8700 1 -- 172.21.15.1:0/1703053361 shutdown_connections 2023-11-15T01:39:14.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.296+0000 7f3f1f4f8700 1 --2- 172.21.15.1:0/1703053361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f180c6650 0x7f3f180aaf40 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:14.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.296+0000 7f3f1f4f8700 1 -- 172.21.15.1:0/1703053361 >> 172.21.15.1:0/1703053361 conn(0x7f3f18064a70 msgr2=0x7f3f18064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:14.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.297+0000 7f3f1f4f8700 1 -- 172.21.15.1:0/1703053361 shutdown_connections 2023-11-15T01:39:14.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.297+0000 7f3f1f4f8700 1 -- 172.21.15.1:0/1703053361 wait complete. 2023-11-15T01:39:14.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.298+0000 7f3f1f4f8700 1 Processor -- start 2023-11-15T01:39:14.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.298+0000 7f3f1f4f8700 1 -- start start 2023-11-15T01:39:14.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.298+0000 7f3f1f4f8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f180c6650 0x7f3f18158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:14.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.298+0000 7f3f1f4f8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f181540a0 0x7f3f18155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1f4f8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f18154480 0x7f3f180ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1f4f8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1814d050 con 0x7f3f180c6650 2023-11-15T01:39:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1f4f8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f180aef20 con 0x7f3f18154480 2023-11-15T01:39:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1f4f8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f180aec40 con 0x7f3f181540a0 2023-11-15T01:39:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1d294700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f180c6650 0x7f3f18158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:14.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1d294700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f180c6650 0x7f3f18158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38700/0 (socket says 172.21.15.1:38700) 2023-11-15T01:39:14.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1d294700 1 -- 172.21.15.1:0/3861463181 learned_addr learned my addr 172.21.15.1:0/3861463181 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:14.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1da95700 1 --2- 172.21.15.1:0/3861463181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f18154480 0x7f3f180ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:14.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1ca93700 1 --2- 172.21.15.1:0/3861463181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f181540a0 0x7f3f18155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:14.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1d294700 1 -- 172.21.15.1:0/3861463181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f181540a0 msgr2=0x7f3f18155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:14.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1d294700 1 --2- 172.21.15.1:0/3861463181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f181540a0 0x7f3f18155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:14.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1d294700 1 -- 172.21.15.1:0/3861463181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f18154480 msgr2=0x7f3f180ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:14.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1d294700 1 --2- 172.21.15.1:0/3861463181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f18154480 0x7f3f180ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:14.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1d294700 1 -- 172.21.15.1:0/3861463181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f10009370 con 0x7f3f180c6650 2023-11-15T01:39:14.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1da95700 1 --2- 172.21.15.1:0/3861463181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f18154480 0x7f3f180ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:39:14.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f1d294700 1 --2- 172.21.15.1:0/3861463181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f180c6650 0x7f3f18158730 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f3f0800c810 tx=0x7f3f08007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:14.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f157fa700 1 -- 172.21.15.1:0/3861463181 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f08005c70 con 0x7f3f180c6650 2023-11-15T01:39:14.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f157fa700 1 -- 172.21.15.1:0/3861463181 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f08005dd0 con 0x7f3f180c6650 2023-11-15T01:39:14.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.299+0000 7f3f157fa700 1 -- 172.21.15.1:0/3861463181 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f08007340 con 0x7f3f180c6650 2023-11-15T01:39:14.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.300+0000 7f3f1f4f8700 1 -- 172.21.15.1:0/3861463181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f18157c50 con 0x7f3f180c6650 2023-11-15T01:39:14.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.300+0000 7f3f1f4f8700 1 -- 172.21.15.1:0/3861463181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f18158210 con 0x7f3f180c6650 2023-11-15T01:39:14.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.301+0000 7f3f1f4f8700 1 -- 172.21.15.1:0/3861463181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1806c7e0 con 0x7f3f180c6650 2023-11-15T01:39:14.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.301+0000 7f3f157fa700 1 -- 172.21.15.1:0/3861463181 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 48) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3f080076f0 con 0x7f3f180c6650 2023-11-15T01:39:14.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.301+0000 7f3f157fa700 1 --2- 172.21.15.1:0/3861463181 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3f0405f270 0x7f3f04061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:14.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.301+0000 7f3f157fa700 1 -- 172.21.15.1:0/3861463181 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f3f0807a5a0 con 0x7f3f180c6650 2023-11-15T01:39:14.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.301+0000 7f3f1ca93700 1 --2- 172.21.15.1:0/3861463181 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3f0405f270 0x7f3f04061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:14.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.302+0000 7f3f1ca93700 1 --2- 172.21.15.1:0/3861463181 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3f0405f270 0x7f3f04061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3f181578a0 tx=0x7f3f0c007d40).ready entity=mgr.6919 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:14.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.305+0000 7f3f157fa700 1 -- 172.21.15.1:0/3861463181 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3f0804b540 con 0x7f3f180c6650 2023-11-15T01:39:14.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.522+0000 7f3f1f4f8700 1 -- 172.21.15.1:0/3861463181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f3f180ae990 con 0x7f3f180c6650 2023-11-15T01:39:14.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.872+0000 7f3f157fa700 1 -- 172.21.15.1:0/3861463181 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 49) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f3f0801ad90 con 0x7f3f180c6650 2023-11-15T01:39:14.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.873+0000 7f3f157fa700 1 -- 172.21.15.1:0/3861463181 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v49) v1 ==== 92+0+0 (secure 0 0 0) 0x7f3f080733d0 con 0x7f3f180c6650 2023-11-15T01:39:14.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.875+0000 7f3f1f4f8700 1 -- 172.21.15.1:0/3861463181 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3f0405f270 msgr2=0x7f3f04061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:14.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.875+0000 7f3f1f4f8700 1 --2- 172.21.15.1:0/3861463181 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3f0405f270 0x7f3f04061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3f181578a0 tx=0x7f3f0c007d40).stop 2023-11-15T01:39:14.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.875+0000 7f3f1f4f8700 1 -- 172.21.15.1:0/3861463181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f180c6650 msgr2=0x7f3f18158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:14.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.875+0000 7f3f1f4f8700 1 --2- 172.21.15.1:0/3861463181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f180c6650 0x7f3f18158730 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f3f0800c810 tx=0x7f3f08007f90).stop 2023-11-15T01:39:14.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.875+0000 7f3f1f4f8700 1 -- 172.21.15.1:0/3861463181 shutdown_connections 2023-11-15T01:39:14.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.875+0000 7f3f1f4f8700 1 --2- 172.21.15.1:0/3861463181 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3f0405f270 0x7f3f04061730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:14.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.875+0000 7f3f1f4f8700 1 --2- 172.21.15.1:0/3861463181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f18154480 0x7f3f180ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:14.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.875+0000 7f3f1f4f8700 1 --2- 172.21.15.1:0/3861463181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f180c6650 0x7f3f18158730 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:14.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.875+0000 7f3f1f4f8700 1 --2- 172.21.15.1:0/3861463181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f181540a0 0x7f3f18155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:14.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.875+0000 7f3f1f4f8700 1 -- 172.21.15.1:0/3861463181 >> 172.21.15.1:0/3861463181 conn(0x7f3f18064a70 msgr2=0x7f3f180aaf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:14.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.875+0000 7f3f1f4f8700 1 -- 172.21.15.1:0/3861463181 shutdown_connections 2023-11-15T01:39:14.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:14.876+0000 7f3f1f4f8700 1 -- 172.21.15.1:0/3861463181 wait complete. 2023-11-15T01:39:14.891 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-15T01:39:15.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.014+0000 7f5b40237700 1 Processor -- start 2023-11-15T01:39:15.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.014+0000 7f5b40237700 1 -- start start 2023-11-15T01:39:15.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.015+0000 7f5b40237700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5b381540a0 0x7f5b380ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:15.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.015+0000 7f5b40237700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380c6650 0x7f5b380ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:15.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.015+0000 7f5b40237700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b380ca050 con 0x7f5b38154480 2023-11-15T01:39:15.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.015+0000 7f5b40237700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b380c9440 con 0x7f5b381540a0 2023-11-15T01:39:15.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.015+0000 7f5b40237700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380c9720 con 0x7f5b380c6650 2023-11-15T01:39:15.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.015+0000 7f5b3d7d2700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5b38154480 0x7f5b380c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59244/0 (socket says 172.21.15.1:59244) 2023-11-15T01:39:15.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.015+0000 7f5b3d7d2700 1 -- 172.21.15.1:0/4233461414 learned_addr learned my addr 172.21.15.1:0/4233461414 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:39:15.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.015+0000 7f5b3dfd3700 1 --2- 172.21.15.1:0/4233461414 >> v2:172.21.15.141:3300/0 conn(0x7f5b381540a0 0x7f5b380ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:15.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.016+0000 7f5b3e7d4700 1 --2- 172.21.15.1:0/4233461414 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380c6650 0x7f5b380ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:15.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.016+0000 7f5b3cfd1700 1 -- 172.21.15.1:0/4233461414 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812398548 0 0) 0x7f5b380ca050 con 0x7f5b38154480 2023-11-15T01:39:15.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.016+0000 7f5b3cfd1700 1 -- 172.21.15.1:0/4233461414 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b240033f0 con 0x7f5b38154480 2023-11-15T01:39:15.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.016+0000 7f5b3dfd3700 1 -- 172.21.15.1:0/4233461414 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380c6650 msgr2=0x7f5b380ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:15.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.016+0000 7f5b3dfd3700 1 --2- 172.21.15.1:0/4233461414 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380c6650 0x7f5b380ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:15.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.016+0000 7f5b3dfd3700 1 -- 172.21.15.1:0/4233461414 >> v1:172.21.15.1:6789/0 conn(0x7f5b38154480 legacy=0x7f5b380c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:15.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.016+0000 7f5b3dfd3700 1 -- 172.21.15.1:0/4233461414 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b380c9a00 con 0x7f5b381540a0 2023-11-15T01:39:15.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.016+0000 7f5b3e7d4700 1 --2- 172.21.15.1:0/4233461414 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380c6650 0x7f5b380ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:39:15.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.016+0000 7f5b3dfd3700 1 --2- 172.21.15.1:0/4233461414 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b381540a0 0x7f5b380ca4e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f5b2c009760 tx=0x7f5b2c009060).ready entity=mon.1 client_cookie=49ea158a26b12a4e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:15.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.016+0000 7f5b3cfd1700 1 -- 172.21.15.1:0/4233461414 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c00d4a0 con 0x7f5b381540a0 2023-11-15T01:39:15.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.016+0000 7f5b3cfd1700 1 -- 172.21.15.1:0/4233461414 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c00d600 con 0x7f5b381540a0 2023-11-15T01:39:15.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.016+0000 7f5b3cfd1700 1 -- 172.21.15.1:0/4233461414 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c00d980 con 0x7f5b381540a0 2023-11-15T01:39:15.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.017+0000 7f5b40237700 1 -- 172.21.15.1:0/4233461414 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b381540a0 msgr2=0x7f5b380ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:15.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.017+0000 7f5b40237700 1 --2- 172.21.15.1:0/4233461414 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b381540a0 0x7f5b380ca4e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f5b2c009760 tx=0x7f5b2c009060).stop 2023-11-15T01:39:15.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.017+0000 7f5b40237700 1 -- 172.21.15.1:0/4233461414 shutdown_connections 2023-11-15T01:39:15.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.017+0000 7f5b40237700 1 --2- 172.21.15.1:0/4233461414 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380c6650 0x7f5b380ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:15.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.017+0000 7f5b40237700 1 --2- 172.21.15.1:0/4233461414 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b381540a0 0x7f5b380ca4e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:15.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.017+0000 7f5b40237700 1 -- 172.21.15.1:0/4233461414 >> 172.21.15.1:0/4233461414 conn(0x7f5b38064a70 msgr2=0x7f5b38064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:15.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.017+0000 7f5b40237700 1 -- 172.21.15.1:0/4233461414 shutdown_connections 2023-11-15T01:39:15.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.017+0000 7f5b40237700 1 -- 172.21.15.1:0/4233461414 wait complete. 2023-11-15T01:39:15.025 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:15.017+0000 7f1a5b054680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:39:15.026 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:15.018+0000 7f882ea7d680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:39:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.018+0000 7f5b40237700 1 Processor -- start 2023-11-15T01:39:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.018+0000 7f5b40237700 1 -- start start 2023-11-15T01:39:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b40237700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380c6650 0x7f5b380c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b40237700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b381540a0 0x7f5b380ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b40237700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b38154480 0x7f5b3814f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b40237700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380ae5e0 con 0x7f5b38154480 2023-11-15T01:39:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b40237700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380c2800 con 0x7f5b381540a0 2023-11-15T01:39:15.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b40237700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380c2ae0 con 0x7f5b380c6650 2023-11-15T01:39:15.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b3e7d4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b38154480 0x7f5b3814f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:15.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b3e7d4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b38154480 0x7f5b3814f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38732/0 (socket says 172.21.15.1:38732) 2023-11-15T01:39:15.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b3d7d2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b381540a0 0x7f5b380ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:15.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b3e7d4700 1 -- 172.21.15.1:0/1414004345 learned_addr learned my addr 172.21.15.1:0/1414004345 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:15.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b3dfd3700 1 --2- 172.21.15.1:0/1414004345 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380c6650 0x7f5b380c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:15.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b3e7d4700 1 -- 172.21.15.1:0/1414004345 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380c6650 msgr2=0x7f5b380c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:15.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b3e7d4700 1 --2- 172.21.15.1:0/1414004345 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380c6650 0x7f5b380c2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:15.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b3e7d4700 1 -- 172.21.15.1:0/1414004345 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b381540a0 msgr2=0x7f5b380ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:15.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b3e7d4700 1 --2- 172.21.15.1:0/1414004345 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b381540a0 0x7f5b380ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:15.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b3e7d4700 1 -- 172.21.15.1:0/1414004345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b30009a20 con 0x7f5b38154480 2023-11-15T01:39:15.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b3d7d2700 1 --2- 172.21.15.1:0/1414004345 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b381540a0 0x7f5b380ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:39:15.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.019+0000 7f5b3e7d4700 1 --2- 172.21.15.1:0/1414004345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b38154480 0x7f5b3814f960 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f5b30009f50 tx=0x7f5b3000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:15.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.020+0000 7f5b29ffb700 1 -- 172.21.15.1:0/1414004345 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3000cb80 con 0x7f5b38154480 2023-11-15T01:39:15.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.020+0000 7f5b29ffb700 1 -- 172.21.15.1:0/1414004345 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3000f040 con 0x7f5b38154480 2023-11-15T01:39:15.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.020+0000 7f5b29ffb700 1 -- 172.21.15.1:0/1414004345 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30013400 con 0x7f5b38154480 2023-11-15T01:39:15.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.020+0000 7f5b40237700 1 -- 172.21.15.1:0/1414004345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c0092a0 con 0x7f5b38154480 2023-11-15T01:39:15.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.020+0000 7f5b40237700 1 -- 172.21.15.1:0/1414004345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b380c30a0 con 0x7f5b38154480 2023-11-15T01:39:15.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.021+0000 7f5b40237700 1 -- 172.21.15.1:0/1414004345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3806c7e0 con 0x7f5b38154480 2023-11-15T01:39:15.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.021+0000 7f5b29ffb700 1 -- 172.21.15.1:0/1414004345 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 49) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f5b300137f0 con 0x7f5b38154480 2023-11-15T01:39:15.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.021+0000 7f5b29ffb700 1 --2- 172.21.15.1:0/1414004345 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5b1c05f2c0 0x7f5b1c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:15.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.022+0000 7f5b3dfd3700 1 -- 172.21.15.1:0/1414004345 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5b1c05f2c0 msgr2=0x7f5b1c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:39:15.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.022+0000 7f5b29ffb700 1 -- 172.21.15.1:0/1414004345 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f5b3007ae90 con 0x7f5b38154480 2023-11-15T01:39:15.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.022+0000 7f5b3dfd3700 1 --2- 172.21.15.1:0/1414004345 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5b1c05f2c0 0x7f5b1c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:39:15.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.026+0000 7f5b29ffb700 1 -- 172.21.15.1:0/1414004345 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5b3004bef0 con 0x7f5b38154480 2023-11-15T01:39:15.082 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:15.082+0000 7f882ea7d680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:39:15.086 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:15.085+0000 7f1a5b054680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:39:15.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.202+0000 7f5b40237700 1 -- 172.21.15.1:0/1414004345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f5b380c9ce0 con 0x7f5b38154480 2023-11-15T01:39:15.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.205+0000 7f5b29ffb700 1 -- 172.21.15.1:0/1414004345 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5b3004f510 con 0x7f5b38154480 2023-11-15T01:39:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.207+0000 7f5b40237700 1 -- 172.21.15.1:0/1414004345 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5b1c05f2c0 msgr2=0x7f5b1c061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:39:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.207+0000 7f5b40237700 1 --2- 172.21.15.1:0/1414004345 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5b1c05f2c0 0x7f5b1c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:39:15.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.207+0000 7f5b40237700 1 -- 172.21.15.1:0/1414004345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b38154480 msgr2=0x7f5b3814f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:15.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.207+0000 7f5b40237700 1 --2- 172.21.15.1:0/1414004345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b38154480 0x7f5b3814f960 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f5b30009f50 tx=0x7f5b3000b040).stop 2023-11-15T01:39:15.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.207+0000 7f5b40237700 1 -- 172.21.15.1:0/1414004345 shutdown_connections 2023-11-15T01:39:15.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.207+0000 7f5b40237700 1 --2- 172.21.15.1:0/1414004345 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5b1c05f2c0 0x7f5b1c061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:39:15.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.207+0000 7f5b40237700 1 --2- 172.21.15.1:0/1414004345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b38154480 0x7f5b3814f960 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:15.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.207+0000 7f5b40237700 1 --2- 172.21.15.1:0/1414004345 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b380c6650 0x7f5b380c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:15.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.207+0000 7f5b40237700 1 --2- 172.21.15.1:0/1414004345 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b381540a0 0x7f5b380ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:15.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.207+0000 7f5b40237700 1 -- 172.21.15.1:0/1414004345 >> 172.21.15.1:0/1414004345 conn(0x7f5b38064a70 msgr2=0x7f5b380ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:15.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.208+0000 7f5b40237700 1 -- 172.21.15.1:0/1414004345 shutdown_connections 2023-11-15T01:39:15.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.208+0000 7f5b40237700 1 -- 172.21.15.1:0/1414004345 wait complete. 2023-11-15T01:39:15.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:15.222 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-15T01:39:15.244 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-11-15T01:39:15.358 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:15.357+0000 7f882ea7d680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:39:15.379 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:15.378+0000 7f1a5b054680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:39:15.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.407+0000 7f76ae413700 1 Processor -- start 2023-11-15T01:39:15.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.407+0000 7f76ae413700 1 -- start start 2023-11-15T01:39:15.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.408+0000 7f76ae413700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76a814e270 0x7f76a80627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:15.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.408+0000 7f76ae413700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f76a80be150 0x7f76a8062ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:15.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.408+0000 7f76ae413700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a80bd570 con 0x7f76a814e650 2023-11-15T01:39:15.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.408+0000 7f76ae413700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a8063ef0 con 0x7f76a80be150 2023-11-15T01:39:15.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.408+0000 7f76ae413700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8063270 con 0x7f76a814e270 2023-11-15T01:39:15.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.408+0000 7f76a77fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f76a814e650 0x7f76a80bda40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59252/0 (socket says 172.21.15.1:59252) 2023-11-15T01:39:15.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.408+0000 7f76ac9b0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f76a80be150 0x7f76a8062ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:15.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.408+0000 7f76a77fe700 1 -- 172.21.15.1:0/1224970660 learned_addr learned my addr 172.21.15.1:0/1224970660 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:39:15.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.409+0000 7f76a7fff700 1 --2- 172.21.15.1:0/1224970660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76a814e270 0x7f76a80627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:15.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.409+0000 7f76ac9b0700 1 -- 172.21.15.1:0/1224970660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76a814e270 msgr2=0x7f76a80627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:39:15.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.409+0000 7f76ac9b0700 1 --2- 172.21.15.1:0/1224970660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76a814e270 0x7f76a80627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:15.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.409+0000 7f76a6ffd700 1 -- 172.21.15.1:0/1224970660 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248959965 0 0) 0x7f76a80bd570 con 0x7f76a814e650 2023-11-15T01:39:15.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.409+0000 7f76ac9b0700 1 -- 172.21.15.1:0/1224970660 >> v1:172.21.15.1:6789/0 conn(0x7f76a814e650 legacy=0x7f76a80bda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:15.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.409+0000 7f76ac9b0700 1 -- 172.21.15.1:0/1224970660 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a8063550 con 0x7f76a80be150 2023-11-15T01:39:15.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.409+0000 7f76ac9b0700 1 --2- 172.21.15.1:0/1224970660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76a80be150 0x7f76a8062ca0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f76a0009e60 tx=0x7f76a0009780).ready entity=mon.0 client_cookie=e9d2645b402f5548 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:15.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.409+0000 7f76a6ffd700 1 -- 172.21.15.1:0/1224970660 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a000e070 con 0x7f76a80be150 2023-11-15T01:39:15.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.409+0000 7f76a6ffd700 1 -- 172.21.15.1:0/1224970660 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a000bb60 con 0x7f76a80be150 2023-11-15T01:39:15.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.409+0000 7f76a6ffd700 1 -- 172.21.15.1:0/1224970660 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a0012410 con 0x7f76a80be150 2023-11-15T01:39:15.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.410+0000 7f76ae413700 1 -- 172.21.15.1:0/1224970660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76a80be150 msgr2=0x7f76a8062ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:15.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.410+0000 7f76ae413700 1 --2- 172.21.15.1:0/1224970660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76a80be150 0x7f76a8062ca0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f76a0009e60 tx=0x7f76a0009780).stop 2023-11-15T01:39:15.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.410+0000 7f76ae413700 1 -- 172.21.15.1:0/1224970660 shutdown_connections 2023-11-15T01:39:15.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.410+0000 7f76ae413700 1 --2- 172.21.15.1:0/1224970660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76a80be150 0x7f76a8062ca0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:15.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.410+0000 7f76ae413700 1 --2- 172.21.15.1:0/1224970660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76a814e270 0x7f76a80627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:15.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.410+0000 7f76ae413700 1 -- 172.21.15.1:0/1224970660 >> 172.21.15.1:0/1224970660 conn(0x7f76a80c4010 msgr2=0x7f76a80c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:15.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.410+0000 7f76ae413700 1 -- 172.21.15.1:0/1224970660 shutdown_connections 2023-11-15T01:39:15.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.410+0000 7f76ae413700 1 -- 172.21.15.1:0/1224970660 wait complete. 2023-11-15T01:39:15.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.411+0000 7f76ae413700 1 Processor -- start 2023-11-15T01:39:15.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.411+0000 7f76ae413700 1 -- start start 2023-11-15T01:39:15.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76ae413700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76a80be150 0x7f76a80c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:15.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76ae413700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76a814e270 0x7f76a80be690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:15.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76ae413700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76a814e650 0x7f76a80beb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:15.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76ae413700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80bf070 con 0x7f76a814e650 2023-11-15T01:39:15.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76ae413700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8163410 con 0x7f76a814e270 2023-11-15T01:39:15.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76ae413700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8163cb0 con 0x7f76a80be150 2023-11-15T01:39:15.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76ac9b0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76a814e650 0x7f76a80beb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:15.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76ac9b0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76a814e650 0x7f76a80beb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38736/0 (socket says 172.21.15.1:38736) 2023-11-15T01:39:15.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76ac9b0700 1 -- 172.21.15.1:0/1444632182 learned_addr learned my addr 172.21.15.1:0/1444632182 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:15.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76a77fe700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76a814e270 0x7f76a80be690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:15.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76a7fff700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76a80be150 0x7f76a80c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:15.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76ac9b0700 1 -- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76a80be150 msgr2=0x7f76a80c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:15.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76ac9b0700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76a80be150 0x7f76a80c2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:15.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76ac9b0700 1 -- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76a814e270 msgr2=0x7f76a80be690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:15.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76ac9b0700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76a814e270 0x7f76a80be690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:15.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.412+0000 7f76ac9b0700 1 -- 172.21.15.1:0/1444632182 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a0009a20 con 0x7f76a814e650 2023-11-15T01:39:15.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.413+0000 7f76ac9b0700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76a814e650 0x7f76a80beb80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f76a0011000 tx=0x7f76a8067940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:15.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.413+0000 7f768ffff700 1 -- 172.21.15.1:0/1444632182 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a001d630 con 0x7f76a814e650 2023-11-15T01:39:15.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.413+0000 7f768ffff700 1 -- 172.21.15.1:0/1444632182 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a001d790 con 0x7f76a814e650 2023-11-15T01:39:15.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.413+0000 7f76ae413700 1 -- 172.21.15.1:0/1444632182 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a8163070 con 0x7f76a814e650 2023-11-15T01:39:15.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.413+0000 7f768ffff700 1 -- 172.21.15.1:0/1444632182 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a001db50 con 0x7f76a814e650 2023-11-15T01:39:15.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.413+0000 7f76ae413700 1 -- 172.21.15.1:0/1444632182 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a8163940 con 0x7f76a814e650 2023-11-15T01:39:15.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.414+0000 7f76ae413700 1 -- 172.21.15.1:0/1444632182 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a806c7e0 con 0x7f76a814e650 2023-11-15T01:39:15.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.414+0000 7f768ffff700 1 -- 172.21.15.1:0/1444632182 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 49) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f76a0003040 con 0x7f76a814e650 2023-11-15T01:39:15.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.415+0000 7f768ffff700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 0x7f7694061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:15.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.415+0000 7f768ffff700 1 -- 172.21.15.1:0/1444632182 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f76a007c460 con 0x7f76a814e650 2023-11-15T01:39:15.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.415+0000 7f76a7fff700 1 -- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 msgr2=0x7f7694061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:39:15.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.415+0000 7f76a7fff700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 0x7f7694061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:39:15.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.423+0000 7f768ffff700 1 -- 172.21.15.1:0/1444632182 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f76a004d400 con 0x7f76a814e650 2023-11-15T01:39:15.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.616+0000 7f76a7fff700 1 -- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 msgr2=0x7f7694061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:39:15.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.616+0000 7f76a7fff700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 0x7f7694061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:39:15.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:15.622+0000 7f76ae413700 1 -- 172.21.15.1:0/1444632182 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f76a8163df0 con 0x7f769405f2c0 2023-11-15T01:39:15.968 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:15.967+0000 7f882ea7d680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:39:16.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:16.017+0000 7f76a7fff700 1 -- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 msgr2=0x7f7694061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:39:16.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:16.017+0000 7f76a7fff700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 0x7f7694061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-15T01:39:16.208 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:16.039+0000 7f882ea7d680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:39:16.208 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:16.049+0000 7f1a5b054680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:39:16.208 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:16.118+0000 7f1a5b054680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:39:16.227 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:16.226+0000 7f882ea7d680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:39:16.314 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:16.312+0000 7f1a5b054680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:39:16.645 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:16.644+0000 7f882ea7d680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:39:16.749 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:16.749+0000 7f882ea7d680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:39:16.753 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:16.752+0000 7f1a5b054680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:39:16.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:16.818+0000 7f76a7fff700 1 -- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 msgr2=0x7f7694061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:39:16.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:16.818+0000 7f76a7fff700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 0x7f7694061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-15T01:39:16.862 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:16.861+0000 7f1a5b054680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:39:16.902 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:16.902+0000 7f882ea7d680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:39:16.976 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:16.976+0000 7f882ea7d680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:39:17.022 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:17.020+0000 7f1a5b054680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:39:17.043 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:17.043+0000 7f882ea7d680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:39:17.100 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:17.099+0000 7f1a5b054680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:39:17.170 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:17.169+0000 7f1a5b054680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:39:17.301 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:17.301+0000 7f882ea7d680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:39:17.443 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:17.442+0000 7f1a5b054680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:39:17.484 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:17.483+0000 7f882ea7d680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:39:17.635 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:17.634+0000 7f1a5b054680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:39:17.704 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:39:17.706 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:39:18.141 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:18.140+0000 7f882ea7d680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:39:18.210 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:18.209+0000 7f882ea7d680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:39:18.288 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:18.287+0000 7f882ea7d680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:39:18.325 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:18.324+0000 7f1a5b054680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:39:18.397 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:18.396+0000 7f1a5b054680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:39:18.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:18.420+0000 7f76a7fff700 1 -- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 msgr2=0x7f7694061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:39:18.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:18.420+0000 7f76a7fff700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 0x7f7694061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-15T01:39:18.434 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:18.433+0000 7f882ea7d680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:39:18.476 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:18.475+0000 7f1a5b054680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:39:18.504 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:18.504+0000 7f882ea7d680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:39:18.622 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:18.622+0000 7f882ea7d680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:39:18.631 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:18.630+0000 7f1a5b054680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:39:18.704 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:18.703+0000 7f1a5b054680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:39:18.730 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:18.730+0000 7f882ea7d680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:39:18.826 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:18.824+0000 7f1a5b054680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:39:18.939 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:18.938+0000 7f1a5b054680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:39:19.022 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:19.021+0000 7f882ea7d680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:39:19.093 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:19.092+0000 7f882ea7d680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:39:19.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:19.113+0000 7f768ffff700 1 -- 172.21.15.1:0/1444632182 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 50) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f76a0079f00 con 0x7f76a814e650 2023-11-15T01:39:19.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:19.113+0000 7f768ffff700 1 -- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 msgr2=0x7f7694061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:39:19.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:19.113+0000 7f768ffff700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 0x7f7694061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:39:19.176 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:19.175+0000 7f87a6208700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:39:19.176 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:19.175+0000 7f87a6208700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:39:19.176 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:19.175+0000 7f87a6208700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:39:19.176 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:19.175+0000 7f87a6208700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:39:19.177 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:19.175+0000 7f87a6208700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:39:19.177 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:19.175+0000 7f87a2a01700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:39:19.177 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:19.175+0000 7f87a2a01700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:39:19.177 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:19.175+0000 7f87a2a01700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:39:19.177 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:19.175+0000 7f87a2a01700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:39:19.178 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:39:19.175+0000 7f87a2a01700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:39:19.246 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:19.244+0000 7f1a5b054680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:39:19.320 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:39:19.319+0000 7f1a5b054680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:39:20.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.115+0000 7f768ffff700 1 -- 172.21.15.1:0/1444632182 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 51) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f76a007a280 con 0x7f76a814e650 2023-11-15T01:39:20.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.116+0000 7f768ffff700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 0x7f7694061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:20.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.116+0000 7f768ffff700 1 -- 172.21.15.1:0/1444632182 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f76a8163df0 con 0x7f769405f2c0 2023-11-15T01:39:20.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.116+0000 7f76a7fff700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 0x7f7694061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:20.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.118+0000 7f76a7fff700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 0x7f7694061700 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f76a8153e70 tx=0x7f769c009060).ready entity=mgr.6521 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:20.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.133+0000 7f768ffff700 1 -- 172.21.15.1:0/1444632182 <== mgr.6521 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f76a8163df0 con 0x7f769405f2c0 2023-11-15T01:39:20.135 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path snap_test_dir1 2023-11-15T01:39:20.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.135+0000 7f76ae413700 1 -- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 msgr2=0x7f7694061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:20.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.135+0000 7f76ae413700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 0x7f7694061700 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f76a8153e70 tx=0x7f769c009060).stop 2023-11-15T01:39:20.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.135+0000 7f76ae413700 1 -- 172.21.15.1:0/1444632182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76a814e650 msgr2=0x7f76a80beb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:20.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.135+0000 7f76ae413700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76a814e650 0x7f76a80beb80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f76a0011000 tx=0x7f76a8067940).stop 2023-11-15T01:39:20.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.135+0000 7f76ae413700 1 -- 172.21.15.1:0/1444632182 shutdown_connections 2023-11-15T01:39:20.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.135+0000 7f76ae413700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f769405f2c0 0x7f7694061700 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:20.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.135+0000 7f76ae413700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76a814e650 0x7f76a80beb80 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:20.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.135+0000 7f76ae413700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76a80be150 0x7f76a80c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:20.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.135+0000 7f76ae413700 1 --2- 172.21.15.1:0/1444632182 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76a814e270 0x7f76a80be690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:20.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.135+0000 7f76ae413700 1 -- 172.21.15.1:0/1444632182 >> 172.21.15.1:0/1444632182 conn(0x7f76a80c4010 msgr2=0x7f76a8152c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:20.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.135+0000 7f76ae413700 1 -- 172.21.15.1:0/1444632182 shutdown_connections 2023-11-15T01:39:20.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.135+0000 7f76ae413700 1 -- 172.21.15.1:0/1444632182 wait complete. 2023-11-15T01:39:20.152 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-11-15T01:39:20.152 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-11-15-01_40_00 in ~40s... 2023-11-15T01:39:20.152 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-11-15T01:39:20.153 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-11-15T01:39:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.280+0000 7f5ea06e6700 1 Processor -- start 2023-11-15T01:39:20.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.280+0000 7f5ea06e6700 1 -- start start 2023-11-15T01:39:20.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.281+0000 7f5ea06e6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5e98157660 0x7f5e98157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:20.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.281+0000 7f5ea06e6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e980c1820 con 0x7f5e980aa060 2023-11-15T01:39:20.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.281+0000 7f5ea06e6700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e980c0c30 con 0x7f5e980c1cb0 2023-11-15T01:39:20.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.281+0000 7f5ea06e6700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e980c7540 con 0x7f5e98157660 2023-11-15T01:39:20.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.281+0000 7f5e9e482700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5e98157660 0x7f5e98157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:20.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.281+0000 7f5e9ec83700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5e980aa060 0x7f5e980ab190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45478/0 (socket says 172.21.15.1:45478) 2023-11-15T01:39:20.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.281+0000 7f5e9ec83700 1 -- 172.21.15.1:0/1327027762 learned_addr learned my addr 172.21.15.1:0/1327027762 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:39:20.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.282+0000 7f5e9e482700 1 -- 172.21.15.1:0/1327027762 >> v1:172.21.15.141:6789/0 conn(0x7f5e980c1cb0 legacy=0x7f5e980c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:20.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.282+0000 7f5e9e482700 1 -- 172.21.15.1:0/1327027762 >> v1:172.21.15.1:6789/0 conn(0x7f5e980aa060 legacy=0x7f5e980ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:20.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.282+0000 7f5e9e482700 1 -- 172.21.15.1:0/1327027762 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e980c0ef0 con 0x7f5e98157660 2023-11-15T01:39:20.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.282+0000 7f5e9d480700 1 -- 172.21.15.1:0/1327027762 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730288110 0 0) 0x7f5e980c1820 con 0x7f5e980aa060 2023-11-15T01:39:20.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.282+0000 7f5e9e482700 1 --2- 172.21.15.1:0/1327027762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e98157660 0x7f5e98157a40 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f5e90009760 tx=0x7f5e90009060).ready entity=mon.0 client_cookie=987b66f8395f5549 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:20.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.282+0000 7f5e9d480700 1 -- 172.21.15.1:0/1327027762 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e90009120 con 0x7f5e98157660 2023-11-15T01:39:20.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.282+0000 7f5e9d480700 1 -- 172.21.15.1:0/1327027762 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9000b580 con 0x7f5e98157660 2023-11-15T01:39:20.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.282+0000 7f5e9d480700 1 -- 172.21.15.1:0/1327027762 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9000b900 con 0x7f5e98157660 2023-11-15T01:39:20.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.282+0000 7f5ea06e6700 1 -- 172.21.15.1:0/1327027762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e98157660 msgr2=0x7f5e98157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:20.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.282+0000 7f5ea06e6700 1 --2- 172.21.15.1:0/1327027762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e98157660 0x7f5e98157a40 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f5e90009760 tx=0x7f5e90009060).stop 2023-11-15T01:39:20.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.282+0000 7f5ea06e6700 1 -- 172.21.15.1:0/1327027762 shutdown_connections 2023-11-15T01:39:20.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.282+0000 7f5ea06e6700 1 --2- 172.21.15.1:0/1327027762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e98157660 0x7f5e98157a40 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:20.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.282+0000 7f5ea06e6700 1 -- 172.21.15.1:0/1327027762 >> 172.21.15.1:0/1327027762 conn(0x7f5e98064aa0 msgr2=0x7f5e98064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:20.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.283+0000 7f5ea06e6700 1 -- 172.21.15.1:0/1327027762 shutdown_connections 2023-11-15T01:39:20.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.283+0000 7f5ea06e6700 1 -- 172.21.15.1:0/1327027762 wait complete. 2023-11-15T01:39:20.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.284+0000 7f5ea06e6700 1 Processor -- start 2023-11-15T01:39:20.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.284+0000 7f5ea06e6700 1 -- start start 2023-11-15T01:39:20.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.284+0000 7f5ea06e6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e980aa060 0x7f5e981590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:20.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.284+0000 7f5ea06e6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e980c1cb0 0x7f5e98159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:20.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.284+0000 7f5ea06e6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e98157660 0x7f5e98147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:20.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.284+0000 7f5ea06e6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9814fe90 con 0x7f5e980c1cb0 2023-11-15T01:39:20.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.284+0000 7f5ea06e6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9814fa00 con 0x7f5e98157660 2023-11-15T01:39:20.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.284+0000 7f5ea06e6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9814f0d0 con 0x7f5e980aa060 2023-11-15T01:39:20.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e9dc81700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e980c1cb0 0x7f5e98159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:20.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e9dc81700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e980c1cb0 0x7f5e98159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38578/0 (socket says 172.21.15.1:38578) 2023-11-15T01:39:20.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e9dc81700 1 -- 172.21.15.1:0/2387380446 learned_addr learned my addr 172.21.15.1:0/2387380446 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:39:20.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e9ec83700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e98157660 0x7f5e98147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:20.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e9e482700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e980aa060 0x7f5e981590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:20.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e9dc81700 1 -- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e980aa060 msgr2=0x7f5e981590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:20.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e9dc81700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e980aa060 0x7f5e981590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:20.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e9dc81700 1 -- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e98157660 msgr2=0x7f5e98147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:20.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e9dc81700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e98157660 0x7f5e98147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:20.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e9dc81700 1 -- 172.21.15.1:0/2387380446 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e900092a0 con 0x7f5e980c1cb0 2023-11-15T01:39:20.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e9ec83700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e98157660 0x7f5e98147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:39:20.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e9e482700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e980aa060 0x7f5e981590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:39:20.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e9dc81700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e980c1cb0 0x7f5e98159700 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f5e8c00c4c0 tx=0x7f5e8c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:20.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e967fc700 1 -- 172.21.15.1:0/2387380446 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c007020 con 0x7f5e980c1cb0 2023-11-15T01:39:20.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e967fc700 1 -- 172.21.15.1:0/2387380446 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c001e90 con 0x7f5e980c1cb0 2023-11-15T01:39:20.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5ea06e6700 1 -- 172.21.15.1:0/2387380446 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9814f3b0 con 0x7f5e980c1cb0 2023-11-15T01:39:20.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5e967fc700 1 -- 172.21.15.1:0/2387380446 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c0073b0 con 0x7f5e980c1cb0 2023-11-15T01:39:20.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.285+0000 7f5ea06e6700 1 -- 172.21.15.1:0/2387380446 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e98159bf0 con 0x7f5e980c1cb0 2023-11-15T01:39:20.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.286+0000 7f5ea06e6700 1 -- 172.21.15.1:0/2387380446 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9806c7e0 con 0x7f5e980c1cb0 2023-11-15T01:39:20.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.287+0000 7f5e967fc700 1 -- 172.21.15.1:0/2387380446 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 51) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f5e8c0068b0 con 0x7f5e980c1cb0 2023-11-15T01:39:20.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.287+0000 7f5e967fc700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e8405f080 0x7f5e84061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:39:20.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.287+0000 7f5e967fc700 1 -- 172.21.15.1:0/2387380446 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f5e8c079bf0 con 0x7f5e980c1cb0 2023-11-15T01:39:20.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.287+0000 7f5e9e482700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e8405f080 0x7f5e84061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:39:20.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.288+0000 7f5e9e482700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e8405f080 0x7f5e84061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5e9000b340 tx=0x7f5e90017000).ready entity=mgr.6521 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:39:20.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.291+0000 7f5e967fc700 1 -- 172.21.15.1:0/2387380446 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5e8c04ade0 con 0x7f5e980c1cb0 2023-11-15T01:39:20.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.490+0000 7f5ea06e6700 1 -- 172.21.15.1:0/2387380446 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e9805f8b0 con 0x7f5e8405f080 2023-11-15T01:39:20.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.494+0000 7f5e967fc700 1 -- 172.21.15.1:0/2387380446 <== mgr.6521 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7f5e9805f8b0 con 0x7f5e8405f080 2023-11-15T01:39:20.494 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:39:20.495 INFO:teuthology.orchestra.run.smithi001.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-11-15T01:39:20.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.494+0000 7f5ea06e6700 1 -- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e8405f080 msgr2=0x7f5e84061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:20.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.494+0000 7f5ea06e6700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e8405f080 0x7f5e84061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5e9000b340 tx=0x7f5e90017000).stop 2023-11-15T01:39:20.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.495+0000 7f5ea06e6700 1 -- 172.21.15.1:0/2387380446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e980c1cb0 msgr2=0x7f5e98159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:39:20.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.495+0000 7f5ea06e6700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e980c1cb0 0x7f5e98159700 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f5e8c00c4c0 tx=0x7f5e8c007e00).stop 2023-11-15T01:39:20.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.495+0000 7f5ea06e6700 1 -- 172.21.15.1:0/2387380446 shutdown_connections 2023-11-15T01:39:20.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.495+0000 7f5ea06e6700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5e8405f080 0x7f5e84061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:20.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.495+0000 7f5ea06e6700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e98157660 0x7f5e98147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:20.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.495+0000 7f5ea06e6700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e980aa060 0x7f5e981590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:20.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.495+0000 7f5ea06e6700 1 --2- 172.21.15.1:0/2387380446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e980c1cb0 0x7f5e98159700 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:39:20.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.495+0000 7f5ea06e6700 1 -- 172.21.15.1:0/2387380446 >> 172.21.15.1:0/2387380446 conn(0x7f5e98064aa0 msgr2=0x7f5e98154d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:39:20.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.495+0000 7f5ea06e6700 1 -- 172.21.15.1:0/2387380446 shutdown_connections 2023-11-15T01:39:20.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:39:20.495+0000 7f5ea06e6700 1 -- 172.21.15.1:0/2387380446 wait complete. 2023-11-15T01:39:20.508 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-11-15T01:39:20.509 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-11-15T01:39:20.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:20.510 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:21.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:21.528 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:22.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:22.550 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:23.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:23.572 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:24.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:24.593 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:25.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:25.615 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:26.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:26.637 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:27.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:27.658 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:28.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:28.680 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:29.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:29.700 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:30.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:30.722 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:31.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:31.743 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:32.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:32.768 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:33.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:33.790 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:34.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:34.811 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:35.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:35.832 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:36.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:36.854 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:37.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:37.876 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:38.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:38.897 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:39.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:39.918 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:40.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:40.939 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:41.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:41.962 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:42.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:42.986 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:44.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:44.008 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:45.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:45.030 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:46.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:46.051 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:47.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:47.072 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:47.765 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:39:47.768 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:39:48.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:48.093 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:49.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:49.115 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:50.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:50.136 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:51.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:51.157 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:52.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:52.179 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:53.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:53.202 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:54.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:54.225 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:55.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:55.247 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:56.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:56.268 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:57.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:57.290 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:58.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:58.311 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:39:59.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:39:59.333 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:40:00.138 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:00.138+0000 7f87959e7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:00.139 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:00.138+0000 7f87959e7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:00.139 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:00.138+0000 7f87959e7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:00.139 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:00.138+0000 7f87959e7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:00.140 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:00.138+0000 7f87959e7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:00.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:40:00.353 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:40:00.374 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_40_00_UTC 2023-11-15T01:40:00.374 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-11-15-01_40_00_UTC'] 2023-11-15T01:40:00.374 DEBUG:tasks.cephfs.test_snap_schedules:exec=1700012360.152555, now = 1700012400.3747473, timo = 40 2023-11-15T01:40:01.376 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-11-15T01:40:01.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.511+0000 7f6b5cafa700 1 Processor -- start 2023-11-15T01:40:01.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.511+0000 7f6b5cafa700 1 -- start start 2023-11-15T01:40:01.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.512+0000 7f6b5cafa700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6b580c53b0 0x7f6b580c3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:01.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.512+0000 7f6b5cafa700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6b580c7f50 0x7f6b580c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:01.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.512+0000 7f6b5cafa700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b580835c0 con 0x7f6b580c88d0 2023-11-15T01:40:01.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.512+0000 7f6b5cafa700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b580c3a00 con 0x7f6b580c53b0 2023-11-15T01:40:01.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.512+0000 7f6b5cafa700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b580c5790 con 0x7f6b580c7f50 2023-11-15T01:40:01.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.512+0000 7f6b5659c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6b580c53b0 0x7f6b580c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:01.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.513+0000 7f6b56d9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6b580c88d0 0x7f6b580bde70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41750/0 (socket says 172.21.15.1:41750) 2023-11-15T01:40:01.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.513+0000 7f6b56d9d700 1 -- 172.21.15.1:0/3494378130 learned_addr learned my addr 172.21.15.1:0/3494378130 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:01.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.513+0000 7f6b55d9b700 1 --2- 172.21.15.1:0/3494378130 >> v2:172.21.15.141:3300/0 conn(0x7f6b580c7f50 0x7f6b580c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:01.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.513+0000 7f6b5659c700 1 -- 172.21.15.1:0/3494378130 >> v2:172.21.15.141:3300/0 conn(0x7f6b580c7f50 msgr2=0x7f6b580c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:01.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.513+0000 7f6b5659c700 1 --2- 172.21.15.1:0/3494378130 >> v2:172.21.15.141:3300/0 conn(0x7f6b580c7f50 0x7f6b580c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:01.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.513+0000 7f6b5659c700 1 -- 172.21.15.1:0/3494378130 >> v1:172.21.15.1:6789/0 conn(0x7f6b580c88d0 legacy=0x7f6b580bde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:01.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.513+0000 7f6b5559a700 1 -- 172.21.15.1:0/3494378130 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216286772 0 0) 0x7f6b580835c0 con 0x7f6b580c88d0 2023-11-15T01:40:01.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.513+0000 7f6b5659c700 1 -- 172.21.15.1:0/3494378130 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b580c6eb0 con 0x7f6b580c53b0 2023-11-15T01:40:01.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.513+0000 7f6b5659c700 1 --2- 172.21.15.1:0/3494378130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b580c53b0 0x7f6b580c3510 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f6b58097010 tx=0x7f6b50006f40).ready entity=mon.0 client_cookie=5aa7bd390a524110 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:01.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.513+0000 7f6b5559a700 1 -- 172.21.15.1:0/3494378130 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50005880 con 0x7f6b580c53b0 2023-11-15T01:40:01.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.513+0000 7f6b5559a700 1 -- 172.21.15.1:0/3494378130 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b500059e0 con 0x7f6b580c53b0 2023-11-15T01:40:01.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.513+0000 7f6b5559a700 1 -- 172.21.15.1:0/3494378130 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50005d60 con 0x7f6b580c53b0 2023-11-15T01:40:01.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.514+0000 7f6b5cafa700 1 -- 172.21.15.1:0/3494378130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b580c53b0 msgr2=0x7f6b580c3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:01.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.514+0000 7f6b5cafa700 1 --2- 172.21.15.1:0/3494378130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b580c53b0 0x7f6b580c3510 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f6b58097010 tx=0x7f6b50006f40).stop 2023-11-15T01:40:01.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.514+0000 7f6b5cafa700 1 -- 172.21.15.1:0/3494378130 shutdown_connections 2023-11-15T01:40:01.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.514+0000 7f6b5cafa700 1 --2- 172.21.15.1:0/3494378130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b580c53b0 0x7f6b580c3510 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:01.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.514+0000 7f6b5cafa700 1 --2- 172.21.15.1:0/3494378130 >> v2:172.21.15.141:3300/0 conn(0x7f6b580c7f50 0x7f6b580c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:01.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.514+0000 7f6b5cafa700 1 -- 172.21.15.1:0/3494378130 >> 172.21.15.1:0/3494378130 conn(0x7f6b58082f90 msgr2=0x7f6b580c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:01.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.514+0000 7f6b5cafa700 1 -- 172.21.15.1:0/3494378130 shutdown_connections 2023-11-15T01:40:01.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.514+0000 7f6b5cafa700 1 -- 172.21.15.1:0/3494378130 wait complete. 2023-11-15T01:40:01.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.515+0000 7f6b5cafa700 1 Processor -- start 2023-11-15T01:40:01.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.515+0000 7f6b5cafa700 1 -- start start 2023-11-15T01:40:01.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b5cafa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b580c53b0 0x7f6b580aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:01.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b5cafa700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b580c7f50 0x7f6b580bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:01.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b5cafa700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b580c88d0 0x7f6b580c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:01.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b5cafa700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580ab2c0 con 0x7f6b580c88d0 2023-11-15T01:40:01.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b5cafa700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580acb50 con 0x7f6b580c7f50 2023-11-15T01:40:01.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b5cafa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580abf40 con 0x7f6b580c53b0 2023-11-15T01:40:01.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b56d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b580c88d0 0x7f6b580c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:01.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b56d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b580c88d0 0x7f6b580c1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55344/0 (socket says 172.21.15.1:55344) 2023-11-15T01:40:01.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b56d9d700 1 -- 172.21.15.1:0/1075224559 learned_addr learned my addr 172.21.15.1:0/1075224559 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:01.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b5659c700 1 --2- 172.21.15.1:0/1075224559 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b580c53b0 0x7f6b580aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:01.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b55d9b700 1 --2- 172.21.15.1:0/1075224559 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b580c7f50 0x7f6b580bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:01.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b56d9d700 1 -- 172.21.15.1:0/1075224559 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b580c53b0 msgr2=0x7f6b580aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:01.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b56d9d700 1 --2- 172.21.15.1:0/1075224559 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b580c53b0 0x7f6b580aadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:01.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b56d9d700 1 -- 172.21.15.1:0/1075224559 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b580c7f50 msgr2=0x7f6b580bffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:01.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b56d9d700 1 --2- 172.21.15.1:0/1075224559 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b580c7f50 0x7f6b580bffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:01.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b56d9d700 1 -- 172.21.15.1:0/1075224559 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b50009250 con 0x7f6b580c88d0 2023-11-15T01:40:01.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.516+0000 7f6b56d9d700 1 --2- 172.21.15.1:0/1075224559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b580c88d0 0x7f6b580c1b90 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f6b4800c810 tx=0x7f6b480014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:01.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.517+0000 7f6b4e7fc700 1 -- 172.21.15.1:0/1075224559 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48005d30 con 0x7f6b580c88d0 2023-11-15T01:40:01.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.517+0000 7f6b4e7fc700 1 -- 172.21.15.1:0/1075224559 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b48005e90 con 0x7f6b580c88d0 2023-11-15T01:40:01.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.517+0000 7f6b5cafa700 1 -- 172.21.15.1:0/1075224559 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b580ac220 con 0x7f6b580c88d0 2023-11-15T01:40:01.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.517+0000 7f6b4e7fc700 1 -- 172.21.15.1:0/1075224559 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b480072e0 con 0x7f6b580c88d0 2023-11-15T01:40:01.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.517+0000 7f6b5cafa700 1 -- 172.21.15.1:0/1075224559 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b580ac7e0 con 0x7f6b580c88d0 2023-11-15T01:40:01.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.518+0000 7f6b5cafa700 1 -- 172.21.15.1:0/1075224559 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b5806c7e0 con 0x7f6b580c88d0 2023-11-15T01:40:01.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.518+0000 7f6b4e7fc700 1 -- 172.21.15.1:0/1075224559 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 52) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f6b48007710 con 0x7f6b580c88d0 2023-11-15T01:40:01.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.518+0000 7f6b4e7fc700 1 --2- 172.21.15.1:0/1075224559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b3805f350 0x7f6b38061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:01.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.518+0000 7f6b4e7fc700 1 -- 172.21.15.1:0/1075224559 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f6b4807a0c0 con 0x7f6b580c88d0 2023-11-15T01:40:01.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.519+0000 7f6b5659c700 1 --2- 172.21.15.1:0/1075224559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b3805f350 0x7f6b38061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:01.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.519+0000 7f6b5659c700 1 --2- 172.21.15.1:0/1075224559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b3805f350 0x7f6b38061810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6b50006fa0 tx=0x7f6b50016000).ready entity=mgr.6521 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:01.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.523+0000 7f6b4e7fc700 1 -- 172.21.15.1:0/1075224559 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6b4804aee0 con 0x7f6b580c88d0 2023-11-15T01:40:01.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.722+0000 7f6b5cafa700 1 -- 172.21.15.1:0/1075224559 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b580acc90 con 0x7f6b3805f350 2023-11-15T01:40:01.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.727+0000 7f6b4e7fc700 1 -- 172.21.15.1:0/1075224559 <== mgr.6521 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f6b580acc90 con 0x7f6b3805f350 2023-11-15T01:40:01.728 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path snap_test_dir1 2023-11-15T01:40:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.729+0000 7f6b5cafa700 1 -- 172.21.15.1:0/1075224559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b3805f350 msgr2=0x7f6b38061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.729+0000 7f6b5cafa700 1 --2- 172.21.15.1:0/1075224559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b3805f350 0x7f6b38061810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6b50006fa0 tx=0x7f6b50016000).stop 2023-11-15T01:40:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.729+0000 7f6b5cafa700 1 -- 172.21.15.1:0/1075224559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b580c88d0 msgr2=0x7f6b580c1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.729+0000 7f6b5cafa700 1 --2- 172.21.15.1:0/1075224559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b580c88d0 0x7f6b580c1b90 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f6b4800c810 tx=0x7f6b480014d0).stop 2023-11-15T01:40:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.729+0000 7f6b5cafa700 1 -- 172.21.15.1:0/1075224559 shutdown_connections 2023-11-15T01:40:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.729+0000 7f6b5cafa700 1 --2- 172.21.15.1:0/1075224559 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6b3805f350 0x7f6b38061810 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.729+0000 7f6b5cafa700 1 --2- 172.21.15.1:0/1075224559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b580c88d0 0x7f6b580c1b90 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.729+0000 7f6b5cafa700 1 --2- 172.21.15.1:0/1075224559 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b580c53b0 0x7f6b580aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.729+0000 7f6b5cafa700 1 --2- 172.21.15.1:0/1075224559 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b580c7f50 0x7f6b580bffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.729+0000 7f6b5cafa700 1 -- 172.21.15.1:0/1075224559 >> 172.21.15.1:0/1075224559 conn(0x7f6b58082f90 msgr2=0x7f6b58067560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.729+0000 7f6b5cafa700 1 -- 172.21.15.1:0/1075224559 shutdown_connections 2023-11-15T01:40:01.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:01.729+0000 7f6b5cafa700 1 -- 172.21.15.1:0/1075224559 wait complete. 2023-11-15T01:40:01.742 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-11-15T01:40:01.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:40:01.743 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T01:40:01.759 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_40_00_UTC 2023-11-15T01:40:01.759 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_40_00_UTC 2023-11-15T01:40:01.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:40:01.760 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_40_00_UTC) 2023-11-15T01:40:01.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:40:01.819 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-11-15T01:40:01.877 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-15T01:40:02.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.037+0000 7f615433b700 1 Processor -- start 2023-11-15T01:40:02.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.037+0000 7f615433b700 1 -- start start 2023-11-15T01:40:02.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.038+0000 7f615433b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f614c1564c0 0x7f614c0637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:02.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.038+0000 7f615433b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c0c5b30 con 0x7f614c0c6fd0 2023-11-15T01:40:02.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.038+0000 7f615433b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c0c5520 con 0x7f614c1520c0 2023-11-15T01:40:02.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.038+0000 7f615433b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614c063da0 con 0x7f614c1564c0 2023-11-15T01:40:02.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.038+0000 7f61528d8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f614c1564c0 0x7f614c0637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:02.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.038+0000 7f61528d8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f614c1564c0 0x7f614c0637c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55348/0 (socket says 172.21.15.1:55348) 2023-11-15T01:40:02.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.038+0000 7f61528d8700 1 -- 172.21.15.1:0/1642024337 learned_addr learned my addr 172.21.15.1:0/1642024337 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:02.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.038+0000 7f61518d6700 1 --1- 172.21.15.1:0/1642024337 >> v1:172.21.15.1:6789/0 conn(0x7f614c0c6fd0 0x7f614c155db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41756/0 (socket says 172.21.15.1:41756) 2023-11-15T01:40:02.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.039+0000 7f61528d8700 1 -- 172.21.15.1:0/1642024337 >> v1:172.21.15.141:6789/0 conn(0x7f614c1520c0 legacy=0x7f614c0c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:02.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.039+0000 7f61528d8700 1 -- 172.21.15.1:0/1642024337 >> v1:172.21.15.1:6789/0 conn(0x7f614c0c6fd0 legacy=0x7f614c155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:02.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.039+0000 7f61528d8700 1 -- 172.21.15.1:0/1642024337 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c0c57c0 con 0x7f614c1564c0 2023-11-15T01:40:02.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.039+0000 7f61528d8700 1 --2- 172.21.15.1:0/1642024337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f614c1564c0 0x7f614c0637c0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f613c006fd0 tx=0x7f613c0090f0).ready entity=mon.0 client_cookie=78b183f0b9d63ab6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:02.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.039+0000 7f61510d5700 1 -- 172.21.15.1:0/1642024337 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c00b600 con 0x7f614c1564c0 2023-11-15T01:40:02.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.039+0000 7f61510d5700 1 -- 172.21.15.1:0/1642024337 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c00b760 con 0x7f614c1564c0 2023-11-15T01:40:02.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.039+0000 7f61510d5700 1 -- 172.21.15.1:0/1642024337 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c00bae0 con 0x7f614c1564c0 2023-11-15T01:40:02.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.039+0000 7f615433b700 1 -- 172.21.15.1:0/1642024337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f614c1564c0 msgr2=0x7f614c0637c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:02.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.039+0000 7f615433b700 1 --2- 172.21.15.1:0/1642024337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f614c1564c0 0x7f614c0637c0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f613c006fd0 tx=0x7f613c0090f0).stop 2023-11-15T01:40:02.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.039+0000 7f615433b700 1 -- 172.21.15.1:0/1642024337 shutdown_connections 2023-11-15T01:40:02.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.039+0000 7f615433b700 1 --2- 172.21.15.1:0/1642024337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f614c1564c0 0x7f614c0637c0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:02.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.039+0000 7f615433b700 1 -- 172.21.15.1:0/1642024337 >> 172.21.15.1:0/1642024337 conn(0x7f614c0c8050 msgr2=0x7f614c0c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:02.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.040+0000 7f615433b700 1 -- 172.21.15.1:0/1642024337 shutdown_connections 2023-11-15T01:40:02.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.040+0000 7f615433b700 1 -- 172.21.15.1:0/1642024337 wait complete. 2023-11-15T01:40:02.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.041+0000 7f615433b700 1 Processor -- start 2023-11-15T01:40:02.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.041+0000 7f615433b700 1 -- start start 2023-11-15T01:40:02.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.041+0000 7f615433b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f614c0c6fd0 0x7f614c152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:02.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.041+0000 7f615433b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f614c1520c0 0x7f614c0ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:02.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.041+0000 7f615433b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f614c1564c0 0x7f614c141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:02.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.041+0000 7f615433b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c153a50 con 0x7f614c1564c0 2023-11-15T01:40:02.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.041+0000 7f615433b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c1635b0 con 0x7f614c1520c0 2023-11-15T01:40:02.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.041+0000 7f615433b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0aa6d0 con 0x7f614c0c6fd0 2023-11-15T01:40:02.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f61528d8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f614c1564c0 0x7f614c141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:02.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f61528d8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f614c1564c0 0x7f614c141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55350/0 (socket says 172.21.15.1:55350) 2023-11-15T01:40:02.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f61528d8700 1 -- 172.21.15.1:0/1708388095 learned_addr learned my addr 172.21.15.1:0/1708388095 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:02.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f61518d6700 1 --2- 172.21.15.1:0/1708388095 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f614c1520c0 0x7f614c0ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:02.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f61520d7700 1 --2- 172.21.15.1:0/1708388095 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f614c0c6fd0 0x7f614c152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:02.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f61528d8700 1 -- 172.21.15.1:0/1708388095 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f614c0c6fd0 msgr2=0x7f614c152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:02.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f61528d8700 1 --2- 172.21.15.1:0/1708388095 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f614c0c6fd0 0x7f614c152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:02.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f61528d8700 1 -- 172.21.15.1:0/1708388095 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f614c1520c0 msgr2=0x7f614c0ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:02.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f61528d8700 1 --2- 172.21.15.1:0/1708388095 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f614c1520c0 0x7f614c0ad070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:02.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f61528d8700 1 -- 172.21.15.1:0/1708388095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c009370 con 0x7f614c1564c0 2023-11-15T01:40:02.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f61528d8700 1 --2- 172.21.15.1:0/1708388095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f614c1564c0 0x7f614c141fc0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f613c011000 tx=0x7f613c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:02.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f614a7fc700 1 -- 172.21.15.1:0/1708388095 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c00bae0 con 0x7f614c1564c0 2023-11-15T01:40:02.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f614a7fc700 1 -- 172.21.15.1:0/1708388095 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c00bea0 con 0x7f614c1564c0 2023-11-15T01:40:02.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f614a7fc700 1 -- 172.21.15.1:0/1708388095 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c01b640 con 0x7f614c1564c0 2023-11-15T01:40:02.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f615433b700 1 -- 172.21.15.1:0/1708388095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c153490 con 0x7f614c1564c0 2023-11-15T01:40:02.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.042+0000 7f615433b700 1 -- 172.21.15.1:0/1708388095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c0aa970 con 0x7f614c1564c0 2023-11-15T01:40:02.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.043+0000 7f615433b700 1 -- 172.21.15.1:0/1708388095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614c0c1830 con 0x7f614c1564c0 2023-11-15T01:40:02.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.044+0000 7f614a7fc700 1 -- 172.21.15.1:0/1708388095 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 53) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f613c01b9b0 con 0x7f614c1564c0 2023-11-15T01:40:02.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.044+0000 7f614a7fc700 1 --2- 172.21.15.1:0/1708388095 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f613805f3e0 0x7f61380618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:02.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.044+0000 7f614a7fc700 1 -- 172.21.15.1:0/1708388095 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f613c07c300 con 0x7f614c1564c0 2023-11-15T01:40:02.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.045+0000 7f61520d7700 1 --2- 172.21.15.1:0/1708388095 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f613805f3e0 0x7f61380618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:02.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.045+0000 7f61520d7700 1 --2- 172.21.15.1:0/1708388095 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f613805f3e0 0x7f61380618a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f6144004290 tx=0x7f6144001560).ready entity=mgr.6521 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:02.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.048+0000 7f614a7fc700 1 -- 172.21.15.1:0/1708388095 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f613c04d020 con 0x7f614c1564c0 2023-11-15T01:40:02.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.269+0000 7f615433b700 1 -- 172.21.15.1:0/1708388095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f614c0aa530 con 0x7f614c1564c0 2023-11-15T01:40:02.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.925+0000 7f614a7fc700 1 -- 172.21.15.1:0/1708388095 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f613c079b20 con 0x7f614c1564c0 2023-11-15T01:40:02.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.926+0000 7f614a7fc700 1 -- 172.21.15.1:0/1708388095 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v54) v1 ==== 93+0+0 (secure 0 0 0) 0x7f613c041870 con 0x7f614c1564c0 2023-11-15T01:40:02.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.929+0000 7f615433b700 1 -- 172.21.15.1:0/1708388095 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f613805f3e0 msgr2=0x7f61380618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:02.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.929+0000 7f615433b700 1 --2- 172.21.15.1:0/1708388095 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f613805f3e0 0x7f61380618a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f6144004290 tx=0x7f6144001560).stop 2023-11-15T01:40:02.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.929+0000 7f615433b700 1 -- 172.21.15.1:0/1708388095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f614c1564c0 msgr2=0x7f614c141fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:02.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.929+0000 7f615433b700 1 --2- 172.21.15.1:0/1708388095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f614c1564c0 0x7f614c141fc0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f613c011000 tx=0x7f613c017000).stop 2023-11-15T01:40:02.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.929+0000 7f615433b700 1 -- 172.21.15.1:0/1708388095 shutdown_connections 2023-11-15T01:40:02.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.929+0000 7f615433b700 1 --2- 172.21.15.1:0/1708388095 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f613805f3e0 0x7f61380618a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:02.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.929+0000 7f615433b700 1 --2- 172.21.15.1:0/1708388095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f614c1564c0 0x7f614c141fc0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:02.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.929+0000 7f615433b700 1 --2- 172.21.15.1:0/1708388095 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f614c0c6fd0 0x7f614c152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:02.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.929+0000 7f615433b700 1 --2- 172.21.15.1:0/1708388095 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f614c1520c0 0x7f614c0ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:02.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.929+0000 7f615433b700 1 -- 172.21.15.1:0/1708388095 >> 172.21.15.1:0/1708388095 conn(0x7f614c0c8050 msgr2=0x7f614c065bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:02.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.929+0000 7f615433b700 1 -- 172.21.15.1:0/1708388095 shutdown_connections 2023-11-15T01:40:02.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:02.929+0000 7f615433b700 1 -- 172.21.15.1:0/1708388095 wait complete. 2023-11-15T01:40:02.945 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T01:40:02.946 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:40:02.989 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:40:03.027 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T01:40:03.028 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-15T01:40:03.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:40:03.029 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-15T01:40:03.068 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T01:40:03.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:40:03.069 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-15T01:40:03.076 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:03.076+0000 7fefa4f9a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:40:03.077 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:03.076+0000 7fe162273680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:40:03.093 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:40:03.139 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:03.138+0000 7fefa4f9a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:40:03.144 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:03.143+0000 7fe162273680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:40:03.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.252+0000 7f4c31935700 1 Processor -- start 2023-11-15T01:40:03.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.252+0000 7f4c31935700 1 -- start start 2023-11-15T01:40:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.253+0000 7f4c31935700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4c2c0bdf80 0x7f4c2c0632a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.253+0000 7f4c31935700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c2c0c1990 0x7f4c2c0c3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.253+0000 7f4c31935700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2c1558b0 con 0x7f4c2c0627b0 2023-11-15T01:40:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.253+0000 7f4c31935700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2c0c2e60 con 0x7f4c2c0bdf80 2023-11-15T01:40:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.253+0000 7f4c31935700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0bcae0 con 0x7f4c2c0c1990 2023-11-15T01:40:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.253+0000 7f4c2a7fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4c2c0bdf80 0x7f4c2c0632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.253+0000 7f4c2affd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4c2c0627b0 0x7f4c2c062b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41764/0 (socket says 172.21.15.1:41764) 2023-11-15T01:40:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.253+0000 7f4c2affd700 1 -- 172.21.15.1:0/2083849876 learned_addr learned my addr 172.21.15.1:0/2083849876 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.253+0000 7f4c2b7fe700 1 --2- 172.21.15.1:0/2083849876 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c2c0c1990 0x7f4c2c0c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.253+0000 7f4c2a7fc700 1 -- 172.21.15.1:0/2083849876 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c2c0c1990 msgr2=0x7f4c2c0c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.253+0000 7f4c2a7fc700 1 --2- 172.21.15.1:0/2083849876 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c2c0c1990 0x7f4c2c0c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.253+0000 7f4c2a7fc700 1 -- 172.21.15.1:0/2083849876 >> v1:172.21.15.1:6789/0 conn(0x7f4c2c0627b0 legacy=0x7f4c2c062b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:03.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.254+0000 7f4c2a7fc700 1 -- 172.21.15.1:0/2083849876 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c0c1f00 con 0x7f4c2c0bdf80 2023-11-15T01:40:03.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.253+0000 7f4c29ffb700 1 -- 172.21.15.1:0/2083849876 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144202909 0 0) 0x7f4c2c1558b0 con 0x7f4c2c0627b0 2023-11-15T01:40:03.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.254+0000 7f4c2b7fe700 1 --2- 172.21.15.1:0/2083849876 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c2c0c1990 0x7f4c2c0c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:03.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.254+0000 7f4c2a7fc700 1 --2- 172.21.15.1:0/2083849876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c2c0bdf80 0x7f4c2c0632a0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f4c1c009760 tx=0x7f4c1c009060).ready entity=mon.0 client_cookie=db50b08f2fafe96f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:03.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.254+0000 7f4c29ffb700 1 -- 172.21.15.1:0/2083849876 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c00b580 con 0x7f4c2c0bdf80 2023-11-15T01:40:03.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.254+0000 7f4c29ffb700 1 -- 172.21.15.1:0/2083849876 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c00b6e0 con 0x7f4c2c0bdf80 2023-11-15T01:40:03.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.254+0000 7f4c29ffb700 1 -- 172.21.15.1:0/2083849876 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c00ba60 con 0x7f4c2c0bdf80 2023-11-15T01:40:03.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.254+0000 7f4c31935700 1 -- 172.21.15.1:0/2083849876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c2c0bdf80 msgr2=0x7f4c2c0632a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:03.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.254+0000 7f4c31935700 1 --2- 172.21.15.1:0/2083849876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c2c0bdf80 0x7f4c2c0632a0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f4c1c009760 tx=0x7f4c1c009060).stop 2023-11-15T01:40:03.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.254+0000 7f4c31935700 1 -- 172.21.15.1:0/2083849876 shutdown_connections 2023-11-15T01:40:03.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.254+0000 7f4c31935700 1 --2- 172.21.15.1:0/2083849876 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c2c0c1990 0x7f4c2c0c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.254+0000 7f4c31935700 1 --2- 172.21.15.1:0/2083849876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c2c0bdf80 0x7f4c2c0632a0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.254+0000 7f4c31935700 1 -- 172.21.15.1:0/2083849876 >> 172.21.15.1:0/2083849876 conn(0x7f4c2c0c3e30 msgr2=0x7f4c2c0c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:03.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.254+0000 7f4c31935700 1 -- 172.21.15.1:0/2083849876 shutdown_connections 2023-11-15T01:40:03.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.254+0000 7f4c31935700 1 -- 172.21.15.1:0/2083849876 wait complete. 2023-11-15T01:40:03.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.256+0000 7f4c31935700 1 Processor -- start 2023-11-15T01:40:03.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.256+0000 7f4c31935700 1 -- start start 2023-11-15T01:40:03.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c31935700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4c2c0627b0 0x7f4c2c1678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c31935700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c2c0bdf80 0x7f4c2c0661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c31935700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c2c0c1990 0x7f4c2c134910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c31935700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0c5840 con 0x7f4c2c0c1990 2023-11-15T01:40:03.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c31935700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0c5510 con 0x7f4c2c0627b0 2023-11-15T01:40:03.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c31935700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c1681e0 con 0x7f4c2c0bdf80 2023-11-15T01:40:03.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c2b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c2c0c1990 0x7f4c2c134910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:03.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c2b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c2c0c1990 0x7f4c2c134910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55392/0 (socket says 172.21.15.1:55392) 2023-11-15T01:40:03.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c2b7fe700 1 -- 172.21.15.1:0/3638361453 learned_addr learned my addr 172.21.15.1:0/3638361453 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:03.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c2a7fc700 1 --2- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c2c0bdf80 0x7f4c2c0661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:03.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c2affd700 1 --2- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4c2c0627b0 0x7f4c2c1678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:03.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c2b7fe700 1 -- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c2c0bdf80 msgr2=0x7f4c2c0661c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:03.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c2b7fe700 1 --2- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c2c0bdf80 0x7f4c2c0661c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c2b7fe700 1 -- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4c2c0627b0 msgr2=0x7f4c2c1678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:03.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c2b7fe700 1 --2- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4c2c0627b0 0x7f4c2c1678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c2b7fe700 1 -- 172.21.15.1:0/3638361453 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0092a0 con 0x7f4c2c0c1990 2023-11-15T01:40:03.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c2b7fe700 1 --2- 172.21.15.1:0/3638361453 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c2c0c1990 0x7f4c2c134910 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f4c24009fc0 tx=0x7f4c240099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:03.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.258+0000 7f4c12ffd700 1 -- 172.21.15.1:0/3638361453 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2400dbe0 con 0x7f4c2c0c1990 2023-11-15T01:40:03.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.259+0000 7f4c12ffd700 1 -- 172.21.15.1:0/3638361453 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2400f040 con 0x7f4c2c0c1990 2023-11-15T01:40:03.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.259+0000 7f4c31935700 1 -- 172.21.15.1:0/3638361453 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2c1684c0 con 0x7f4c2c0c1990 2023-11-15T01:40:03.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.259+0000 7f4c12ffd700 1 -- 172.21.15.1:0/3638361453 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c240133f0 con 0x7f4c2c0c1990 2023-11-15T01:40:03.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.259+0000 7f4c31935700 1 -- 172.21.15.1:0/3638361453 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2c0bed10 con 0x7f4c2c0c1990 2023-11-15T01:40:03.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.260+0000 7f4c31935700 1 -- 172.21.15.1:0/3638361453 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2c0c59b0 con 0x7f4c2c0c1990 2023-11-15T01:40:03.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.260+0000 7f4c12ffd700 1 -- 172.21.15.1:0/3638361453 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f4c240137e0 con 0x7f4c2c0c1990 2023-11-15T01:40:03.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.260+0000 7f4c12ffd700 1 --2- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4c1805f360 0x7f4c18061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.261+0000 7f4c2affd700 1 -- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4c1805f360 msgr2=0x7f4c18061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:03.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.261+0000 7f4c12ffd700 1 -- 172.21.15.1:0/3638361453 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f4c2407aee0 con 0x7f4c2c0c1990 2023-11-15T01:40:03.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.261+0000 7f4c2affd700 1 --2- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4c1805f360 0x7f4c18061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:40:03.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.265+0000 7f4c12ffd700 1 -- 172.21.15.1:0/3638361453 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4c2404baf0 con 0x7f4c2c0c1990 2023-11-15T01:40:03.412 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:03.412+0000 7fefa4f9a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:40:03.438 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:03.437+0000 7fe162273680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:40:03.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.462+0000 7f4c2affd700 1 -- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4c1805f360 msgr2=0x7f4c18061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:03.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.462+0000 7f4c2affd700 1 --2- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4c1805f360 0x7f4c18061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:40:03.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.480+0000 7f4c31935700 1 -- 172.21.15.1:0/3638361453 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c2c0475e0 con 0x7f4c2c0c1990 2023-11-15T01:40:03.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.480+0000 7f4c12ffd700 1 -- 172.21.15.1:0/3638361453 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f4c2404f110 con 0x7f4c2c0c1990 2023-11-15T01:40:03.482 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:03.482 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7614,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3754341822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3754341822},{"type":"v1","addr":"172.21.15.1:6834","nonce":3754341822}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7617,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2242100060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":2242100060},{"type":"v1","addr":"172.21.15.1:6835","nonce":2242100060}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/1053521790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":1053521790},{"type":"v1","addr":"172.21.15.141:6836","nonce":1053521790}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:39:02.583978+0000","modified":"2023-11-15T01:39:05.601021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7629":{"gid":7629,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/2390881160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":2390881160},{"type":"v1","addr":"172.21.15.141:6837","nonce":2390881160}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-11-15T01:40:03.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.482+0000 7f4c31935700 1 -- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4c1805f360 msgr2=0x7f4c18061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:40:03.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.482+0000 7f4c31935700 1 --2- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4c1805f360 0x7f4c18061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:03.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.482+0000 7f4c31935700 1 -- 172.21.15.1:0/3638361453 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c2c0c1990 msgr2=0x7f4c2c134910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:03.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.482+0000 7f4c31935700 1 --2- 172.21.15.1:0/3638361453 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c2c0c1990 0x7f4c2c134910 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f4c24009fc0 tx=0x7f4c240099b0).stop 2023-11-15T01:40:03.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.482+0000 7f4c31935700 1 -- 172.21.15.1:0/3638361453 shutdown_connections 2023-11-15T01:40:03.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.482+0000 7f4c31935700 1 --2- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4c1805f360 0x7f4c18061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:03.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.482+0000 7f4c31935700 1 --2- 172.21.15.1:0/3638361453 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c2c0c1990 0x7f4c2c134910 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.482+0000 7f4c31935700 1 --2- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4c2c0627b0 0x7f4c2c1678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.482+0000 7f4c31935700 1 --2- 172.21.15.1:0/3638361453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4c2c0bdf80 0x7f4c2c0661c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.482+0000 7f4c31935700 1 -- 172.21.15.1:0/3638361453 >> 172.21.15.1:0/3638361453 conn(0x7f4c2c0c3e30 msgr2=0x7f4c2c062b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:03.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.483+0000 7f4c31935700 1 -- 172.21.15.1:0/3638361453 shutdown_connections 2023-11-15T01:40:03.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.483+0000 7f4c31935700 1 -- 172.21.15.1:0/3638361453 wait complete. 2023-11-15T01:40:03.487 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 55 2023-11-15T01:40:03.498 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:40:03.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.655+0000 7f7f4e3f7700 1 Processor -- start 2023-11-15T01:40:03.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.656+0000 7f7f4e3f7700 1 -- start start 2023-11-15T01:40:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.656+0000 7f7f4e3f7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7f480833a0 0x7f7f480a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.656+0000 7f7f4e3f7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7f480be520 0x7f7f48154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.656+0000 7f7f4e3f7700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f480a85e0 con 0x7f7f48154450 2023-11-15T01:40:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.656+0000 7f7f4e3f7700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f48065940 con 0x7f7f480be520 2023-11-15T01:40:03.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.656+0000 7f7f4e3f7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f48065660 con 0x7f7f480833a0 2023-11-15T01:40:03.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.657+0000 7f7f4c994700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7f480be520 0x7f7f48154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:03.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.657+0000 7f7f4c994700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7f480be520 0x7f7f48154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55394/0 (socket says 172.21.15.1:55394) 2023-11-15T01:40:03.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.657+0000 7f7f4c994700 1 -- 172.21.15.1:0/3183705466 learned_addr learned my addr 172.21.15.1:0/3183705466 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:03.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.657+0000 7f7f477fe700 1 --2- 172.21.15.1:0/3183705466 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7f480833a0 0x7f7f480a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:03.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.657+0000 7f7f4c994700 1 -- 172.21.15.1:0/3183705466 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7f480833a0 msgr2=0x7f7f480a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:03.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.657+0000 7f7f4c994700 1 --2- 172.21.15.1:0/3183705466 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7f480833a0 0x7f7f480a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.657+0000 7f7f4c994700 1 -- 172.21.15.1:0/3183705466 >> v1:172.21.15.1:6789/0 conn(0x7f7f48154450 legacy=0x7f7f480bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:03.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.657+0000 7f7f4c994700 1 -- 172.21.15.1:0/3183705466 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f480c6f50 con 0x7f7f480be520 2023-11-15T01:40:03.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.657+0000 7f7f46ffd700 1 -- 172.21.15.1:0/3183705466 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937046355 0 0) 0x7f7f480a85e0 con 0x7f7f48154450 2023-11-15T01:40:03.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.657+0000 7f7f477fe700 1 --2- 172.21.15.1:0/3183705466 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7f480833a0 0x7f7f480a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:03.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.657+0000 7f7f4c994700 1 --2- 172.21.15.1:0/3183705466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f480be520 0x7f7f48154830 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f7f40009f20 tx=0x7f7f40009840).ready entity=mon.0 client_cookie=7aca41bffe1e07b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:03.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.657+0000 7f7f46ffd700 1 -- 172.21.15.1:0/3183705466 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000e070 con 0x7f7f480be520 2023-11-15T01:40:03.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.657+0000 7f7f46ffd700 1 -- 172.21.15.1:0/3183705466 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4000ba80 con 0x7f7f480be520 2023-11-15T01:40:03.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.657+0000 7f7f46ffd700 1 -- 172.21.15.1:0/3183705466 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000be00 con 0x7f7f480be520 2023-11-15T01:40:03.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.658+0000 7f7f4e3f7700 1 -- 172.21.15.1:0/3183705466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f480be520 msgr2=0x7f7f48154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.658+0000 7f7f4e3f7700 1 --2- 172.21.15.1:0/3183705466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f480be520 0x7f7f48154830 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f7f40009f20 tx=0x7f7f40009840).stop 2023-11-15T01:40:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.658+0000 7f7f4e3f7700 1 -- 172.21.15.1:0/3183705466 shutdown_connections 2023-11-15T01:40:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.658+0000 7f7f4e3f7700 1 --2- 172.21.15.1:0/3183705466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f480be520 0x7f7f48154830 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.658+0000 7f7f4e3f7700 1 --2- 172.21.15.1:0/3183705466 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7f480833a0 0x7f7f480a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.658+0000 7f7f4e3f7700 1 -- 172.21.15.1:0/3183705466 >> 172.21.15.1:0/3183705466 conn(0x7f7f48082f90 msgr2=0x7f7f480c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:03.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.658+0000 7f7f4e3f7700 1 -- 172.21.15.1:0/3183705466 shutdown_connections 2023-11-15T01:40:03.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.658+0000 7f7f4e3f7700 1 -- 172.21.15.1:0/3183705466 wait complete. 2023-11-15T01:40:03.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.659+0000 7f7f4e3f7700 1 Processor -- start 2023-11-15T01:40:03.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.659+0000 7f7f4e3f7700 1 -- start start 2023-11-15T01:40:03.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f4e3f7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f480833a0 0x7f7f48150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f4e3f7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f480be520 0x7f7f480adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f4e3f7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7f48154450 0x7f7f480adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f4e3f7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f480ab530 con 0x7f7f480833a0 2023-11-15T01:40:03.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f4e3f7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f480966c0 con 0x7f7f480be520 2023-11-15T01:40:03.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f4e3f7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f480ae4c0 con 0x7f7f48154450 2023-11-15T01:40:03.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f47fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f480833a0 0x7f7f48150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:03.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f47fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f480833a0 0x7f7f48150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55408/0 (socket says 172.21.15.1:55408) 2023-11-15T01:40:03.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f47fff700 1 -- 172.21.15.1:0/261523025 learned_addr learned my addr 172.21.15.1:0/261523025 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:03.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f4c994700 1 --2- 172.21.15.1:0/261523025 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7f48154450 0x7f7f480adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:03.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f477fe700 1 --2- 172.21.15.1:0/261523025 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f480be520 0x7f7f480adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:03.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f47fff700 1 -- 172.21.15.1:0/261523025 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7f48154450 msgr2=0x7f7f480adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:03.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f47fff700 1 --2- 172.21.15.1:0/261523025 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7f48154450 0x7f7f480adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f47fff700 1 -- 172.21.15.1:0/261523025 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f480be520 msgr2=0x7f7f480adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:03.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f47fff700 1 --2- 172.21.15.1:0/261523025 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f480be520 0x7f7f480adae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f47fff700 1 -- 172.21.15.1:0/261523025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f40009ae0 con 0x7f7f480833a0 2023-11-15T01:40:03.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.660+0000 7f7f47fff700 1 --2- 172.21.15.1:0/261523025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f480833a0 0x7f7f48150410 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f7f3800c490 tx=0x7f7f38007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:03.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.661+0000 7f7f2ffff700 1 -- 172.21.15.1:0/261523025 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f38013450 con 0x7f7f480833a0 2023-11-15T01:40:03.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.661+0000 7f7f2ffff700 1 -- 172.21.15.1:0/261523025 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f380135d0 con 0x7f7f480833a0 2023-11-15T01:40:03.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.661+0000 7f7f4e3f7700 1 -- 172.21.15.1:0/261523025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f480ae6c0 con 0x7f7f480833a0 2023-11-15T01:40:03.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.661+0000 7f7f2ffff700 1 -- 172.21.15.1:0/261523025 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f38013990 con 0x7f7f480833a0 2023-11-15T01:40:03.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.661+0000 7f7f4e3f7700 1 -- 172.21.15.1:0/261523025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f480aae70 con 0x7f7f480833a0 2023-11-15T01:40:03.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.662+0000 7f7f2ffff700 1 -- 172.21.15.1:0/261523025 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f7f3801d3f0 con 0x7f7f480833a0 2023-11-15T01:40:03.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.662+0000 7f7f4e3f7700 1 -- 172.21.15.1:0/261523025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4806c7e0 con 0x7f7f480833a0 2023-11-15T01:40:03.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.662+0000 7f7f2ffff700 1 --2- 172.21.15.1:0/261523025 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7f3405f390 0x7f7f34061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.662+0000 7f7f2ffff700 1 -- 172.21.15.1:0/261523025 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f7f38079f50 con 0x7f7f480833a0 2023-11-15T01:40:03.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.662+0000 7f7f477fe700 1 -- 172.21.15.1:0/261523025 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7f3405f390 msgr2=0x7f7f34061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:03.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.662+0000 7f7f477fe700 1 --2- 172.21.15.1:0/261523025 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7f3405f390 0x7f7f34061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:40:03.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.667+0000 7f7f2ffff700 1 -- 172.21.15.1:0/261523025 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7f3804acd0 con 0x7f7f480833a0 2023-11-15T01:40:03.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.840+0000 7f7f4e3f7700 1 -- 172.21.15.1:0/261523025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f48151750 con 0x7f7f480833a0 2023-11-15T01:40:03.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.841+0000 7f7f2ffff700 1 -- 172.21.15.1:0/261523025 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+17910 (secure 0 0 0) 0x7f7f3804e2f0 con 0x7f7f480833a0 2023-11-15T01:40:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:03.844 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":127,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:39:19.106166+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:39:00.237361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-15T01:39:01.572293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/3877898493":"2023-11-16T01:39:19.106133+0000","172.21.15.141:0/252963828":"2023-11-16T01:39:19.106133+0000","172.21.15.141:0/798549701":"2023-11-16T01:39:19.106133+0000","172.21.15.141:6833/90546":"2023-11-16T01:39:19.106133+0000","172.21.15.141:6832/90546":"2023-11-16T01:39:19.106133+0000","172.21.15.141:0/1636101725":"2023-11-16T01:39:19.106133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:40:03.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.844+0000 7f7f4e3f7700 1 -- 172.21.15.1:0/261523025 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7f3405f390 msgr2=0x7f7f34061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:40:03.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.844+0000 7f7f4e3f7700 1 --2- 172.21.15.1:0/261523025 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7f3405f390 0x7f7f34061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:03.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.844+0000 7f7f4e3f7700 1 -- 172.21.15.1:0/261523025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f480833a0 msgr2=0x7f7f48150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:03.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.844+0000 7f7f4e3f7700 1 --2- 172.21.15.1:0/261523025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f480833a0 0x7f7f48150410 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f7f3800c490 tx=0x7f7f38007de0).stop 2023-11-15T01:40:03.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.844+0000 7f7f4e3f7700 1 -- 172.21.15.1:0/261523025 shutdown_connections 2023-11-15T01:40:03.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.844+0000 7f7f4e3f7700 1 --2- 172.21.15.1:0/261523025 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7f3405f390 0x7f7f34061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:03.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.844+0000 7f7f4e3f7700 1 --2- 172.21.15.1:0/261523025 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7f48154450 0x7f7f480adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.844+0000 7f7f4e3f7700 1 --2- 172.21.15.1:0/261523025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f480833a0 0x7f7f48150410 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.844+0000 7f7f4e3f7700 1 --2- 172.21.15.1:0/261523025 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7f480be520 0x7f7f480adae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.844+0000 7f7f4e3f7700 1 -- 172.21.15.1:0/261523025 >> 172.21.15.1:0/261523025 conn(0x7f7f48082f90 msgr2=0x7f7f480c61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:03.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.845+0000 7f7f4e3f7700 1 -- 172.21.15.1:0/261523025 shutdown_connections 2023-11-15T01:40:03.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.845+0000 7f7f4e3f7700 1 -- 172.21.15.1:0/261523025 wait complete. 2023-11-15T01:40:03.859 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T01:39:00.237361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T01:39:01.572293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T01:40:03.860 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:40:03.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.984+0000 7fc5925a6700 1 Processor -- start 2023-11-15T01:40:03.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.984+0000 7fc5925a6700 1 -- start start 2023-11-15T01:40:03.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.985+0000 7fc5925a6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc58c0bc410 0x7fc58c0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.985+0000 7fc5925a6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc58c0bd330 0x7fc58c0637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.985+0000 7fc5925a6700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c06bb50 con 0x7fc58c0c50b0 2023-11-15T01:40:03.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.985+0000 7fc5925a6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c0627b0 con 0x7fc58c0bc410 2023-11-15T01:40:03.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.985+0000 7fc5925a6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0bd7c0 con 0x7fc58c0bd330 2023-11-15T01:40:03.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.985+0000 7fc591da5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc58c0bd330 0x7fc58c0637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:03.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.985+0000 7fc590da3700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc58c0bc410 0x7fc58c0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:03.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.985+0000 7fc591da5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc58c0bd330 0x7fc58c0637c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:48744/0 (socket says 172.21.15.1:48744) 2023-11-15T01:40:03.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.985+0000 7fc590da3700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc58c0bc410 0x7fc58c0c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:55290/0 (socket says 172.21.15.1:55290) 2023-11-15T01:40:03.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.985+0000 7fc591da5700 1 -- 172.21.15.1:0/2162401138 learned_addr learned my addr 172.21.15.1:0/2162401138 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:03.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.986+0000 7fc590da3700 1 -- 172.21.15.1:0/2162401138 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc58c0bd330 msgr2=0x7fc58c0637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:03.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.986+0000 7fc590da3700 1 --2- 172.21.15.1:0/2162401138 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc58c0bd330 0x7fc58c0637c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.986+0000 7fc590da3700 1 -- 172.21.15.1:0/2162401138 >> v1:172.21.15.141:6789/0 conn(0x7fc58c0c50b0 legacy=0x7fc58c0c1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:03.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.986+0000 7fc590da3700 1 -- 172.21.15.1:0/2162401138 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c062a00 con 0x7fc58c0bc410 2023-11-15T01:40:03.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.986+0000 7fc591da5700 1 --2- 172.21.15.1:0/2162401138 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc58c0bd330 0x7fc58c0637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:03.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.986+0000 7fc590da3700 1 --2- 172.21.15.1:0/2162401138 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc58c0bc410 0x7fc58c0c5490 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fc588009760 tx=0x7fc588009060).ready entity=mon.1 client_cookie=1a2d4ccb3f64b1d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:03.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.986+0000 7fc583fff700 1 -- 172.21.15.1:0/2162401138 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58800f510 con 0x7fc58c0bc410 2023-11-15T01:40:03.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.986+0000 7fc583fff700 1 -- 172.21.15.1:0/2162401138 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58800f670 con 0x7fc58c0bc410 2023-11-15T01:40:03.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.986+0000 7fc583fff700 1 -- 172.21.15.1:0/2162401138 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58800f9f0 con 0x7fc58c0bc410 2023-11-15T01:40:03.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.987+0000 7fc5925a6700 1 -- 172.21.15.1:0/2162401138 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc58c0bc410 msgr2=0x7fc58c0c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:03.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.987+0000 7fc5925a6700 1 --2- 172.21.15.1:0/2162401138 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc58c0bc410 0x7fc58c0c5490 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fc588009760 tx=0x7fc588009060).stop 2023-11-15T01:40:03.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.987+0000 7fc5925a6700 1 -- 172.21.15.1:0/2162401138 shutdown_connections 2023-11-15T01:40:03.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.987+0000 7fc5925a6700 1 --2- 172.21.15.1:0/2162401138 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc58c0bd330 0x7fc58c0637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.987+0000 7fc5925a6700 1 --2- 172.21.15.1:0/2162401138 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc58c0bc410 0x7fc58c0c5490 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.987+0000 7fc5925a6700 1 -- 172.21.15.1:0/2162401138 >> 172.21.15.1:0/2162401138 conn(0x7fc58c0c3e30 msgr2=0x7fc58c0c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:03.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.987+0000 7fc5925a6700 1 -- 172.21.15.1:0/2162401138 shutdown_connections 2023-11-15T01:40:03.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.987+0000 7fc5925a6700 1 -- 172.21.15.1:0/2162401138 wait complete. 2023-11-15T01:40:03.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.988+0000 7fc5925a6700 1 Processor -- start 2023-11-15T01:40:03.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.988+0000 7fc5925a6700 1 -- start start 2023-11-15T01:40:03.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.989+0000 7fc5925a6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc58c0bc410 0x7fc58c0c1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.989+0000 7fc5925a6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc58c0bd330 0x7fc58c145ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.989+0000 7fc5925a6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc58c0c50b0 0x7fc58c065c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:03.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.989+0000 7fc5925a6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0c1610 con 0x7fc58c0c50b0 2023-11-15T01:40:03.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.989+0000 7fc5925a6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0c0080 con 0x7fc58c0bc410 2023-11-15T01:40:03.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.989+0000 7fc5925a6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0c0360 con 0x7fc58c0bd330 2023-11-15T01:40:03.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.989+0000 7fc591da5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc58c0c50b0 0x7fc58c065c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:03.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.989+0000 7fc591da5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc58c0c50b0 0x7fc58c065c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55420/0 (socket says 172.21.15.1:55420) 2023-11-15T01:40:03.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.989+0000 7fc591da5700 1 -- 172.21.15.1:0/2732860803 learned_addr learned my addr 172.21.15.1:0/2732860803 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:03.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.989+0000 7fc5915a4700 1 --2- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc58c0bc410 0x7fc58c0c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:03.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.989+0000 7fc590da3700 1 --2- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc58c0bd330 0x7fc58c145ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:03.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.990+0000 7fc591da5700 1 -- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc58c0bd330 msgr2=0x7fc58c145ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:03.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.990+0000 7fc591da5700 1 --2- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc58c0bd330 0x7fc58c145ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.990+0000 7fc591da5700 1 -- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc58c0bc410 msgr2=0x7fc58c0c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:03.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.990+0000 7fc591da5700 1 --2- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc58c0bc410 0x7fc58c0c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:03.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.990+0000 7fc591da5700 1 -- 172.21.15.1:0/2732860803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc584009ae0 con 0x7fc58c0c50b0 2023-11-15T01:40:03.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.990+0000 7fc591da5700 1 --2- 172.21.15.1:0/2732860803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc58c0c50b0 0x7fc58c065c60 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7fc584009fd0 tx=0x7fc58400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:03.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.990+0000 7fc5817fa700 1 -- 172.21.15.1:0/2732860803 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5840092e0 con 0x7fc58c0c50b0 2023-11-15T01:40:03.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.990+0000 7fc5817fa700 1 -- 172.21.15.1:0/2732860803 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58400f040 con 0x7fc58c0c50b0 2023-11-15T01:40:03.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.990+0000 7fc5817fa700 1 -- 172.21.15.1:0/2732860803 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58400cbd0 con 0x7fc58c0c50b0 2023-11-15T01:40:03.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.990+0000 7fc5925a6700 1 -- 172.21.15.1:0/2732860803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5880092a0 con 0x7fc58c0c50b0 2023-11-15T01:40:03.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.990+0000 7fc5925a6700 1 -- 172.21.15.1:0/2732860803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c0c0920 con 0x7fc58c0c50b0 2023-11-15T01:40:04.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.991+0000 7fc5925a6700 1 -- 172.21.15.1:0/2732860803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58c0475e0 con 0x7fc58c0c50b0 2023-11-15T01:40:04.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.991+0000 7fc5817fa700 1 -- 172.21.15.1:0/2732860803 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fc584007400 con 0x7fc58c0c50b0 2023-11-15T01:40:04.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.992+0000 7fc5817fa700 1 --2- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc57005f360 0x7fc570061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:04.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.992+0000 7fc5915a4700 1 -- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc57005f360 msgr2=0x7fc570061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:04.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.992+0000 7fc5817fa700 1 -- 172.21.15.1:0/2732860803 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fc58407a950 con 0x7fc58c0c50b0 2023-11-15T01:40:04.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.992+0000 7fc5915a4700 1 --2- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc57005f360 0x7fc570061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:40:04.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:03.996+0000 7fc5817fa700 1 -- 172.21.15.1:0/2732860803 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc58404aaf0 con 0x7fc58c0c50b0 2023-11-15T01:40:04.023 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:04.023+0000 7fefa4f9a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:40:04.095 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:04.095+0000 7fefa4f9a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:40:04.110 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:04.109+0000 7fe162273680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:40:04.181 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:04.180+0000 7fe162273680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:40:04.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.193+0000 7fc5915a4700 1 -- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc57005f360 msgr2=0x7fc570061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:04.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.193+0000 7fc5915a4700 1 --2- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc57005f360 0x7fc570061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:40:04.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.214+0000 7fc5925a6700 1 -- 172.21.15.1:0/2732860803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc58c062ce0 con 0x7fc58c0c50b0 2023-11-15T01:40:04.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.214+0000 7fc5817fa700 1 -- 172.21.15.1:0/2732860803 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v127) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc58404b5b0 con 0x7fc58c0c50b0 2023-11-15T01:40:04.216 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:40:04.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.217+0000 7fc5925a6700 1 -- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc57005f360 msgr2=0x7fc570061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:40:04.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.217+0000 7fc5925a6700 1 --2- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc57005f360 0x7fc570061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:04.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.217+0000 7fc5925a6700 1 -- 172.21.15.1:0/2732860803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc58c0c50b0 msgr2=0x7fc58c065c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:04.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.217+0000 7fc5925a6700 1 --2- 172.21.15.1:0/2732860803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc58c0c50b0 0x7fc58c065c60 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7fc584009fd0 tx=0x7fc58400b040).stop 2023-11-15T01:40:04.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.217+0000 7fc5925a6700 1 -- 172.21.15.1:0/2732860803 shutdown_connections 2023-11-15T01:40:04.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.217+0000 7fc5925a6700 1 --2- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc57005f360 0x7fc570061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:04.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.217+0000 7fc5925a6700 1 --2- 172.21.15.1:0/2732860803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc58c0c50b0 0x7fc58c065c60 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.217+0000 7fc5925a6700 1 --2- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc58c0bc410 0x7fc58c0c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.217+0000 7fc5925a6700 1 --2- 172.21.15.1:0/2732860803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc58c0bd330 0x7fc58c145ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.217+0000 7fc5925a6700 1 -- 172.21.15.1:0/2732860803 >> 172.21.15.1:0/2732860803 conn(0x7fc58c0c3e30 msgr2=0x7fc58c0c1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:04.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.218+0000 7fc5925a6700 1 -- 172.21.15.1:0/2732860803 shutdown_connections 2023-11-15T01:40:04.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.218+0000 7fc5925a6700 1 -- 172.21.15.1:0/2732860803 wait complete. 2023-11-15T01:40:04.237 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:40:04.281 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:04.280+0000 7fefa4f9a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:40:04.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.360+0000 7f9032f55700 1 Processor -- start 2023-11-15T01:40:04.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.360+0000 7f9032f55700 1 -- start start 2023-11-15T01:40:04.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f9032f55700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f902c14ec30 0x7f902c0638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:04.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f9032f55700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f902c063db0 0x7f902c154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:04.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f9032f55700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f902c1551a0 0x7f902c1516e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:04.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f9032f55700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902c0c5640 con 0x7f902c1551a0 2023-11-15T01:40:04.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f9032f55700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902c155610 con 0x7f902c063db0 2023-11-15T01:40:04.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f9032f55700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902c0c3e30 con 0x7f902c14ec30 2023-11-15T01:40:04.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f90314f2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f902c1551a0 0x7f902c1516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:04.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f90314f2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f902c1551a0 0x7f902c1516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55422/0 (socket says 172.21.15.1:55422) 2023-11-15T01:40:04.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f90314f2700 1 -- 172.21.15.1:0/538455435 learned_addr learned my addr 172.21.15.1:0/538455435 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:04.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f9030cf1700 1 --2- 172.21.15.1:0/538455435 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f902c14ec30 0x7f902c0638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:04.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f902bfff700 1 --2- 172.21.15.1:0/538455435 >> v2:172.21.15.141:3300/0 conn(0x7f902c063db0 0x7f902c154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:04.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f90314f2700 1 -- 172.21.15.1:0/538455435 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f902c14ec30 msgr2=0x7f902c0638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:04.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f90314f2700 1 --2- 172.21.15.1:0/538455435 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f902c14ec30 0x7f902c0638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f90314f2700 1 -- 172.21.15.1:0/538455435 >> v2:172.21.15.141:3300/0 conn(0x7f902c063db0 msgr2=0x7f902c154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f90314f2700 1 --2- 172.21.15.1:0/538455435 >> v2:172.21.15.141:3300/0 conn(0x7f902c063db0 0x7f902c154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.361+0000 7f90314f2700 1 -- 172.21.15.1:0/538455435 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c0c3590 con 0x7f902c1551a0 2023-11-15T01:40:04.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.362+0000 7f90314f2700 1 --2- 172.21.15.1:0/538455435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f902c1551a0 0x7f902c1516e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f902c0686a0 tx=0x7f9024009840).ready entity=mon.0 client_cookie=be0f02701e99162a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.362+0000 7f902b7fe700 1 -- 172.21.15.1:0/538455435 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400e070 con 0x7f902c1551a0 2023-11-15T01:40:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.362+0000 7f902b7fe700 1 -- 172.21.15.1:0/538455435 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902400b970 con 0x7f902c1551a0 2023-11-15T01:40:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.362+0000 7f902b7fe700 1 -- 172.21.15.1:0/538455435 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400bcf0 con 0x7f902c1551a0 2023-11-15T01:40:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.362+0000 7f9032f55700 1 -- 172.21.15.1:0/538455435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f902c1551a0 msgr2=0x7f902c1516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:04.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.362+0000 7f9032f55700 1 --2- 172.21.15.1:0/538455435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f902c1551a0 0x7f902c1516e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f902c0686a0 tx=0x7f9024009840).stop 2023-11-15T01:40:04.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.362+0000 7f9032f55700 1 -- 172.21.15.1:0/538455435 shutdown_connections 2023-11-15T01:40:04.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.362+0000 7f9032f55700 1 --2- 172.21.15.1:0/538455435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f902c1551a0 0x7f902c1516e0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.362+0000 7f9032f55700 1 --2- 172.21.15.1:0/538455435 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f902c14ec30 0x7f902c0638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.362+0000 7f9032f55700 1 --2- 172.21.15.1:0/538455435 >> v2:172.21.15.141:3300/0 conn(0x7f902c063db0 0x7f902c154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.362+0000 7f9032f55700 1 -- 172.21.15.1:0/538455435 >> 172.21.15.1:0/538455435 conn(0x7f902c0c8050 msgr2=0x7f902c0c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.362+0000 7f9032f55700 1 -- 172.21.15.1:0/538455435 shutdown_connections 2023-11-15T01:40:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.362+0000 7f9032f55700 1 -- 172.21.15.1:0/538455435 wait complete. 2023-11-15T01:40:04.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.364+0000 7f9032f55700 1 Processor -- start 2023-11-15T01:40:04.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.364+0000 7f9032f55700 1 -- start start 2023-11-15T01:40:04.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.364+0000 7f9032f55700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f902c063db0 0x7f902c14d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:04.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f9032f55700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f902c14ec30 0x7f902c0a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:04.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f9032f55700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f902c1551a0 0x7f902c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:04.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f9032f55700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c0a6700 con 0x7f902c14ec30 2023-11-15T01:40:04.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f9032f55700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c0a7850 con 0x7f902c063db0 2023-11-15T01:40:04.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f9032f55700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902c168760 con 0x7f902c1551a0 2023-11-15T01:40:04.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f902bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f902c14ec30 0x7f902c0a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:04.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f902bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f902c14ec30 0x7f902c0a5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55424/0 (socket says 172.21.15.1:55424) 2023-11-15T01:40:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f902bfff700 1 -- 172.21.15.1:0/1921543782 learned_addr learned my addr 172.21.15.1:0/1921543782 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f9030cf1700 1 --2- 172.21.15.1:0/1921543782 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f902c063db0 0x7f902c14d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f90314f2700 1 --2- 172.21.15.1:0/1921543782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f902c1551a0 0x7f902c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f902bfff700 1 -- 172.21.15.1:0/1921543782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f902c1551a0 msgr2=0x7f902c0a6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f902bfff700 1 --2- 172.21.15.1:0/1921543782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f902c1551a0 0x7f902c0a6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f902bfff700 1 -- 172.21.15.1:0/1921543782 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f902c063db0 msgr2=0x7f902c14d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f902bfff700 1 --2- 172.21.15.1:0/1921543782 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f902c063db0 0x7f902c14d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f902bfff700 1 -- 172.21.15.1:0/1921543782 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9024009ae0 con 0x7f902c14ec30 2023-11-15T01:40:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f9030cf1700 1 --2- 172.21.15.1:0/1921543782 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f902c063db0 0x7f902c14d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f902bfff700 1 --2- 172.21.15.1:0/1921543782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f902c14ec30 0x7f902c0a5d20 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f901800e900 tx=0x7f9018009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f9028ff9700 1 -- 172.21.15.1:0/1921543782 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018012600 con 0x7f902c14ec30 2023-11-15T01:40:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f9032f55700 1 -- 172.21.15.1:0/1921543782 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902c0a7200 con 0x7f902c14ec30 2023-11-15T01:40:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f9028ff9700 1 -- 172.21.15.1:0/1921543782 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9018012760 con 0x7f902c14ec30 2023-11-15T01:40:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f9028ff9700 1 -- 172.21.15.1:0/1921543782 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018012ae0 con 0x7f902c14ec30 2023-11-15T01:40:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.365+0000 7f9032f55700 1 -- 172.21.15.1:0/1921543782 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902c0aa710 con 0x7f902c14ec30 2023-11-15T01:40:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.367+0000 7f9032f55700 1 -- 172.21.15.1:0/1921543782 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902c0a79e0 con 0x7f902c14ec30 2023-11-15T01:40:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.367+0000 7f9028ff9700 1 -- 172.21.15.1:0/1921543782 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f901801b400 con 0x7f902c14ec30 2023-11-15T01:40:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.367+0000 7f9028ff9700 1 --2- 172.21.15.1:0/1921543782 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f901005f390 0x7f9010061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:04.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.367+0000 7f9030cf1700 1 -- 172.21.15.1:0/1921543782 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f901005f390 msgr2=0x7f9010061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:04.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.367+0000 7f9028ff9700 1 -- 172.21.15.1:0/1921543782 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f901807aac0 con 0x7f902c14ec30 2023-11-15T01:40:04.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.367+0000 7f9030cf1700 1 --2- 172.21.15.1:0/1921543782 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f901005f390 0x7f9010061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:40:04.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.371+0000 7f9028ff9700 1 -- 172.21.15.1:0/1921543782 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f901804b7e0 con 0x7f902c14ec30 2023-11-15T01:40:04.387 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:04.386+0000 7fe162273680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:40:04.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.544+0000 7f9032f55700 1 -- 172.21.15.1:0/1921543782 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f902c06c7e0 con 0x7f902c14ec30 2023-11-15T01:40:04.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.544+0000 7f9028ff9700 1 -- 172.21.15.1:0/1921543782 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v127) v1 ==== 92+0+10 (secure 0 0 0) 0x7f901804ee00 con 0x7f902c14ec30 2023-11-15T01:40:04.546 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:40:04.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.546+0000 7f9032f55700 1 -- 172.21.15.1:0/1921543782 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f901005f390 msgr2=0x7f9010061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:40:04.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.546+0000 7f9032f55700 1 --2- 172.21.15.1:0/1921543782 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f901005f390 0x7f9010061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:04.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.546+0000 7f9032f55700 1 -- 172.21.15.1:0/1921543782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f902c14ec30 msgr2=0x7f902c0a5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:04.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.546+0000 7f9032f55700 1 --2- 172.21.15.1:0/1921543782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f902c14ec30 0x7f902c0a5d20 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f901800e900 tx=0x7f9018009060).stop 2023-11-15T01:40:04.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.546+0000 7f9032f55700 1 -- 172.21.15.1:0/1921543782 shutdown_connections 2023-11-15T01:40:04.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.546+0000 7f9032f55700 1 --2- 172.21.15.1:0/1921543782 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f901005f390 0x7f9010061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:04.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.546+0000 7f9032f55700 1 --2- 172.21.15.1:0/1921543782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f902c1551a0 0x7f902c0a6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.546+0000 7f9032f55700 1 --2- 172.21.15.1:0/1921543782 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f902c063db0 0x7f902c14d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.546+0000 7f9032f55700 1 --2- 172.21.15.1:0/1921543782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f902c14ec30 0x7f902c0a5d20 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.546+0000 7f9032f55700 1 -- 172.21.15.1:0/1921543782 >> 172.21.15.1:0/1921543782 conn(0x7f902c0c8050 msgr2=0x7f902c14e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:04.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.546+0000 7f9032f55700 1 -- 172.21.15.1:0/1921543782 shutdown_connections 2023-11-15T01:40:04.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.546+0000 7f9032f55700 1 -- 172.21.15.1:0/1921543782 wait complete. 2023-11-15T01:40:04.560 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T01:40:04.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.683+0000 7f5c148b2700 1 Processor -- start 2023-11-15T01:40:04.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.684+0000 7f5c148b2700 1 -- start start 2023-11-15T01:40:04.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.684+0000 7f5c148b2700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5c1014e960 0x7f5c100bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:04.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.684+0000 7f5c148b2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c10063020 0x7f5c100c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:04.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.684+0000 7f5c148b2700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c100634b0 con 0x7f5c100bc9d0 2023-11-15T01:40:04.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.684+0000 7f5c148b2700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c100c5480 con 0x7f5c1014e960 2023-11-15T01:40:04.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.684+0000 7f5c148b2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100bce50 con 0x7f5c10063020 2023-11-15T01:40:04.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.685+0000 7f5c0ed9d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c10063020 0x7f5c100c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:04.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.685+0000 7f5c0e59c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5c1014e960 0x7f5c100bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:04.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.685+0000 7f5c0e59c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5c1014e960 0x7f5c100bc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:55326/0 (socket says 172.21.15.1:55326) 2023-11-15T01:40:04.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.685+0000 7f5c0ed9d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c10063020 0x7f5c100c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:48780/0 (socket says 172.21.15.1:48780) 2023-11-15T01:40:04.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.685+0000 7f5c0e59c700 1 -- 172.21.15.1:0/3465863042 learned_addr learned my addr 172.21.15.1:0/3465863042 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:04.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.685+0000 7f5c0dd9b700 1 --1- 172.21.15.1:0/3465863042 >> v1:172.21.15.141:6789/0 conn(0x7f5c100bc9d0 0x7f5c10062910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:52892/0 (socket says 172.21.15.1:52892) 2023-11-15T01:40:04.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.685+0000 7f5c0e59c700 1 -- 172.21.15.1:0/3465863042 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c10063020 msgr2=0x7f5c100c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.685+0000 7f5c0e59c700 1 --2- 172.21.15.1:0/3465863042 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c10063020 0x7f5c100c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.685+0000 7f5c0e59c700 1 -- 172.21.15.1:0/3465863042 >> v1:172.21.15.141:6789/0 conn(0x7f5c100bc9d0 legacy=0x7f5c10062910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.685+0000 7f5c0d59a700 1 -- 172.21.15.1:0/3465863042 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888391057 0 0) 0x7f5c100634b0 con 0x7f5c100bc9d0 2023-11-15T01:40:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.685+0000 7f5c0e59c700 1 -- 172.21.15.1:0/3465863042 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c100636e0 con 0x7f5c1014e960 2023-11-15T01:40:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.685+0000 7f5c0e59c700 1 --2- 172.21.15.1:0/3465863042 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c1014e960 0x7f5c100bc4e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f5c04006fd0 tx=0x7f5c040090f0).ready entity=mon.1 client_cookie=be1db99faa975874 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.686+0000 7f5c0d59a700 1 -- 172.21.15.1:0/3465863042 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0400b580 con 0x7f5c1014e960 2023-11-15T01:40:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.686+0000 7f5c0d59a700 1 -- 172.21.15.1:0/3465863042 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0400b6e0 con 0x7f5c1014e960 2023-11-15T01:40:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.686+0000 7f5c0d59a700 1 -- 172.21.15.1:0/3465863042 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0400ba60 con 0x7f5c1014e960 2023-11-15T01:40:04.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.686+0000 7f5c148b2700 1 -- 172.21.15.1:0/3465863042 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c1014e960 msgr2=0x7f5c100bc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:04.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.686+0000 7f5c148b2700 1 --2- 172.21.15.1:0/3465863042 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c1014e960 0x7f5c100bc4e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f5c04006fd0 tx=0x7f5c040090f0).stop 2023-11-15T01:40:04.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.686+0000 7f5c148b2700 1 -- 172.21.15.1:0/3465863042 shutdown_connections 2023-11-15T01:40:04.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.686+0000 7f5c148b2700 1 --2- 172.21.15.1:0/3465863042 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c10063020 0x7f5c100c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.686+0000 7f5c148b2700 1 --2- 172.21.15.1:0/3465863042 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c1014e960 0x7f5c100bc4e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.686+0000 7f5c148b2700 1 -- 172.21.15.1:0/3465863042 >> 172.21.15.1:0/3465863042 conn(0x7f5c100c8050 msgr2=0x7f5c100c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:04.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.686+0000 7f5c148b2700 1 -- 172.21.15.1:0/3465863042 shutdown_connections 2023-11-15T01:40:04.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.686+0000 7f5c148b2700 1 -- 172.21.15.1:0/3465863042 wait complete. 2023-11-15T01:40:04.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.687+0000 7f5c148b2700 1 Processor -- start 2023-11-15T01:40:04.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.687+0000 7f5c148b2700 1 -- start start 2023-11-15T01:40:04.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.688+0000 7f5c148b2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c10063020 0x7f5c100a7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:04.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.688+0000 7f5c148b2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c100bc9d0 0x7f5c1014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:04.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.688+0000 7f5c148b2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c1014e960 0x7f5c10137a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:04.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.688+0000 7f5c148b2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100a9510 con 0x7f5c10063020 2023-11-15T01:40:04.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.688+0000 7f5c148b2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100a8900 con 0x7f5c1014e960 2023-11-15T01:40:04.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.688+0000 7f5c148b2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100a8be0 con 0x7f5c100bc9d0 2023-11-15T01:40:04.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.688+0000 7f5c0e59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c10063020 0x7f5c100a7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:04.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.688+0000 7f5c0e59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c10063020 0x7f5c100a7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55436/0 (socket says 172.21.15.1:55436) 2023-11-15T01:40:04.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.688+0000 7f5c0e59c700 1 -- 172.21.15.1:0/526199472 learned_addr learned my addr 172.21.15.1:0/526199472 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:04.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.688+0000 7f5c0dd9b700 1 --2- 172.21.15.1:0/526199472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c100bc9d0 0x7f5c1014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:04.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.688+0000 7f5c0ed9d700 1 --2- 172.21.15.1:0/526199472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c1014e960 0x7f5c10137a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:04.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.689+0000 7f5c0e59c700 1 -- 172.21.15.1:0/526199472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c100bc9d0 msgr2=0x7f5c1014dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:04.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.689+0000 7f5c0e59c700 1 --2- 172.21.15.1:0/526199472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c100bc9d0 0x7f5c1014dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.689+0000 7f5c0e59c700 1 -- 172.21.15.1:0/526199472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c1014e960 msgr2=0x7f5c10137a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:04.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.689+0000 7f5c0e59c700 1 --2- 172.21.15.1:0/526199472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c1014e960 0x7f5c10137a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.689+0000 7f5c0e59c700 1 -- 172.21.15.1:0/526199472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c04009370 con 0x7f5c10063020 2023-11-15T01:40:04.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.689+0000 7f5c0ed9d700 1 --2- 172.21.15.1:0/526199472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c1014e960 0x7f5c10137a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:04.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.689+0000 7f5c0e59c700 1 --2- 172.21.15.1:0/526199472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c10063020 0x7f5c100a7f90 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f5c1006bd00 tx=0x7f5c04017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:04.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.689+0000 7f5bfe7fc700 1 -- 172.21.15.1:0/526199472 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04000bc0 con 0x7f5c10063020 2023-11-15T01:40:04.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.689+0000 7f5bfe7fc700 1 -- 172.21.15.1:0/526199472 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0400b850 con 0x7f5c10063020 2023-11-15T01:40:04.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.689+0000 7f5bfe7fc700 1 -- 172.21.15.1:0/526199472 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04000d20 con 0x7f5c10063020 2023-11-15T01:40:04.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.689+0000 7f5c148b2700 1 -- 172.21.15.1:0/526199472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c100a8ec0 con 0x7f5c10063020 2023-11-15T01:40:04.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.689+0000 7f5c148b2700 1 -- 172.21.15.1:0/526199472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1013ac40 con 0x7f5c10063020 2023-11-15T01:40:04.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.690+0000 7f5bfe7fc700 1 -- 172.21.15.1:0/526199472 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f5c0401c880 con 0x7f5c10063020 2023-11-15T01:40:04.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.690+0000 7f5c148b2700 1 -- 172.21.15.1:0/526199472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1006c7e0 con 0x7f5c10063020 2023-11-15T01:40:04.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.691+0000 7f5bfe7fc700 1 --2- 172.21.15.1:0/526199472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5bf005f390 0x7f5bf0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:04.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.691+0000 7f5c0dd9b700 1 -- 172.21.15.1:0/526199472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5bf005f390 msgr2=0x7f5bf0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:04.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.691+0000 7f5bfe7fc700 1 -- 172.21.15.1:0/526199472 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f5c0407ba20 con 0x7f5c10063020 2023-11-15T01:40:04.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.691+0000 7f5c0dd9b700 1 --2- 172.21.15.1:0/526199472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5bf005f390 0x7f5bf0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:40:04.703 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:04.702+0000 7fefa4f9a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:40:04.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.695+0000 7f5bfe7fc700 1 -- 172.21.15.1:0/526199472 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5c04050220 con 0x7f5c10063020 2023-11-15T01:40:04.806 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:04.805+0000 7fefa4f9a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:40:04.837 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:04.835+0000 7fe162273680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:40:04.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.868+0000 7f5c148b2700 1 -- 172.21.15.1:0/526199472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c100639c0 con 0x7f5c10063020 2023-11-15T01:40:04.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.869+0000 7f5bfe7fc700 1 -- 172.21.15.1:0/526199472 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v127) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5c04022020 con 0x7f5c10063020 2023-11-15T01:40:04.871 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:40:04.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.871+0000 7f5c148b2700 1 -- 172.21.15.1:0/526199472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5bf005f390 msgr2=0x7f5bf0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:40:04.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.871+0000 7f5c148b2700 1 --2- 172.21.15.1:0/526199472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5bf005f390 0x7f5bf0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:04.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.871+0000 7f5c148b2700 1 -- 172.21.15.1:0/526199472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c10063020 msgr2=0x7f5c100a7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:04.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.871+0000 7f5c148b2700 1 --2- 172.21.15.1:0/526199472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c10063020 0x7f5c100a7f90 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f5c1006bd00 tx=0x7f5c04017000).stop 2023-11-15T01:40:04.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.871+0000 7f5c148b2700 1 -- 172.21.15.1:0/526199472 shutdown_connections 2023-11-15T01:40:04.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.871+0000 7f5c148b2700 1 --2- 172.21.15.1:0/526199472 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5bf005f390 0x7f5bf0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:04.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.871+0000 7f5c148b2700 1 --2- 172.21.15.1:0/526199472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c1014e960 0x7f5c10137a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.871+0000 7f5c148b2700 1 --2- 172.21.15.1:0/526199472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c10063020 0x7f5c100a7f90 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.871+0000 7f5c148b2700 1 --2- 172.21.15.1:0/526199472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c100bc9d0 0x7f5c1014dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:04.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.871+0000 7f5c148b2700 1 -- 172.21.15.1:0/526199472 >> 172.21.15.1:0/526199472 conn(0x7f5c100c8050 msgr2=0x7f5c100a56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:04.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.871+0000 7f5c148b2700 1 -- 172.21.15.1:0/526199472 shutdown_connections 2023-11-15T01:40:04.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:04.871+0000 7f5c148b2700 1 -- 172.21.15.1:0/526199472 wait complete. 2023-11-15T01:40:04.889 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T01:40:04.956 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:04.954+0000 7fe162273680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:40:04.959 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:04.959+0000 7fefa4f9a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:40:05.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.010+0000 7f9ec3efe700 1 Processor -- start 2023-11-15T01:40:05.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.010+0000 7f9ec3efe700 1 -- start start 2023-11-15T01:40:05.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.011+0000 7f9ec3efe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9ebc066f80 0x7f9ebc137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.011+0000 7f9ec3efe700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ebc154ce0 con 0x7f9ebc1588e0 2023-11-15T01:40:05.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.011+0000 7f9ec3efe700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ebc154fc0 con 0x7f9ebc137030 2023-11-15T01:40:05.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.011+0000 7f9ec3efe700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ebc137900 con 0x7f9ebc066f80 2023-11-15T01:40:05.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.011+0000 7f9ec249b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9ebc1588e0 0x7f9ebc14e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41772/0 (socket says 172.21.15.1:41772) 2023-11-15T01:40:05.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.011+0000 7f9ec249b700 1 -- 172.21.15.1:0/1646178660 learned_addr learned my addr 172.21.15.1:0/1646178660 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:05.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.011+0000 7f9ec1499700 1 --2- 172.21.15.1:0/1646178660 >> v2:172.21.15.141:3300/0 conn(0x7f9ebc066f80 0x7f9ebc137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.011+0000 7f9ec0c98700 1 -- 172.21.15.1:0/1646178660 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164831781 0 0) 0x7f9ebc154ce0 con 0x7f9ebc1588e0 2023-11-15T01:40:05.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.011+0000 7f9ec0c98700 1 -- 172.21.15.1:0/1646178660 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ea80033f0 con 0x7f9ebc1588e0 2023-11-15T01:40:05.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.012+0000 7f9ec1499700 1 -- 172.21.15.1:0/1646178660 >> v1:172.21.15.141:6789/0 conn(0x7f9ebc137030 legacy=0x7f9ebc066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.012+0000 7f9ec1499700 1 -- 172.21.15.1:0/1646178660 >> v1:172.21.15.1:6789/0 conn(0x7f9ebc1588e0 legacy=0x7f9ebc14e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.012+0000 7f9ec0c98700 1 -- 172.21.15.1:0/1646178660 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1094553941 0 0) 0x7f9ea80033f0 con 0x7f9ebc1588e0 2023-11-15T01:40:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.012+0000 7f9ec1499700 1 -- 172.21.15.1:0/1646178660 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc1552a0 con 0x7f9ebc066f80 2023-11-15T01:40:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.012+0000 7f9ec1499700 1 --2- 172.21.15.1:0/1646178660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc066f80 0x7f9ebc137410 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f9eb8009760 tx=0x7f9eb8009060).ready entity=mon.1 client_cookie=cc6e8660a6b99b94 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.012+0000 7f9ec0c98700 1 -- 172.21.15.1:0/1646178660 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40017f0 con 0x7f9ebc066f80 2023-11-15T01:40:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.012+0000 7f9ec0c98700 1 -- 172.21.15.1:0/1646178660 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb8011400 con 0x7f9ebc066f80 2023-11-15T01:40:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.012+0000 7f9ec0c98700 1 -- 172.21.15.1:0/1646178660 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8011780 con 0x7f9ebc066f80 2023-11-15T01:40:05.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.013+0000 7f9ec3efe700 1 -- 172.21.15.1:0/1646178660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc066f80 msgr2=0x7f9ebc137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.013+0000 7f9ec3efe700 1 --2- 172.21.15.1:0/1646178660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc066f80 0x7f9ebc137410 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f9eb8009760 tx=0x7f9eb8009060).stop 2023-11-15T01:40:05.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.013+0000 7f9ec3efe700 1 -- 172.21.15.1:0/1646178660 shutdown_connections 2023-11-15T01:40:05.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.013+0000 7f9ec3efe700 1 --2- 172.21.15.1:0/1646178660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc066f80 0x7f9ebc137410 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.013+0000 7f9ec3efe700 1 -- 172.21.15.1:0/1646178660 >> 172.21.15.1:0/1646178660 conn(0x7f9ebc063280 msgr2=0x7f9ebc0c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:05.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.013+0000 7f9ec3efe700 1 -- 172.21.15.1:0/1646178660 shutdown_connections 2023-11-15T01:40:05.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.013+0000 7f9ec3efe700 1 -- 172.21.15.1:0/1646178660 wait complete. 2023-11-15T01:40:05.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.014+0000 7f9ec3efe700 1 Processor -- start 2023-11-15T01:40:05.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.014+0000 7f9ec3efe700 1 -- start start 2023-11-15T01:40:05.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec3efe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ebc066f80 0x7f9ebc13a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec3efe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc137030 0x7f9ebc0ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec3efe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ebc1588e0 0x7f9ebc0befe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec3efe700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc13a320 con 0x7f9ebc066f80 2023-11-15T01:40:05.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec3efe700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc1658e0 con 0x7f9ebc137030 2023-11-15T01:40:05.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec3efe700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc139a30 con 0x7f9ebc1588e0 2023-11-15T01:40:05.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec1c9a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ebc066f80 0x7f9ebc13a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec1c9a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ebc066f80 0x7f9ebc13a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55452/0 (socket says 172.21.15.1:55452) 2023-11-15T01:40:05.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec1c9a700 1 -- 172.21.15.1:0/528830999 learned_addr learned my addr 172.21.15.1:0/528830999 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:05.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec1499700 1 --2- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc137030 0x7f9ebc0ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec249b700 1 --2- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ebc1588e0 0x7f9ebc0befe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec1c9a700 1 -- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ebc1588e0 msgr2=0x7f9ebc0befe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec1c9a700 1 --2- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ebc1588e0 0x7f9ebc0befe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec1c9a700 1 -- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc137030 msgr2=0x7f9ebc0ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec1c9a700 1 --2- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc137030 0x7f9ebc0ab0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec1c9a700 1 -- 172.21.15.1:0/528830999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb80092a0 con 0x7f9ebc066f80 2023-11-15T01:40:05.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec1499700 1 --2- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc137030 0x7f9ebc0ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:05.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.015+0000 7f9ec1c9a700 1 --2- 172.21.15.1:0/528830999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ebc066f80 0x7f9ebc13a7b0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7f9eac00c4c0 tx=0x7f9eac007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:05.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.016+0000 7f9eb1ffb700 1 -- 172.21.15.1:0/528830999 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac00ce70 con 0x7f9ebc066f80 2023-11-15T01:40:05.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.016+0000 7f9eb1ffb700 1 -- 172.21.15.1:0/528830999 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eac001e90 con 0x7f9ebc066f80 2023-11-15T01:40:05.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.016+0000 7f9ec3efe700 1 -- 172.21.15.1:0/528830999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ebc168ce0 con 0x7f9ebc066f80 2023-11-15T01:40:05.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.016+0000 7f9eb1ffb700 1 -- 172.21.15.1:0/528830999 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac007250 con 0x7f9ebc066f80 2023-11-15T01:40:05.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.016+0000 7f9ec3efe700 1 -- 172.21.15.1:0/528830999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ebc139fb0 con 0x7f9ebc066f80 2023-11-15T01:40:05.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.017+0000 7f9ec3efe700 1 -- 172.21.15.1:0/528830999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ebc13a600 con 0x7f9ebc066f80 2023-11-15T01:40:05.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.017+0000 7f9eb1ffb700 1 -- 172.21.15.1:0/528830999 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f9eac0066a0 con 0x7f9ebc066f80 2023-11-15T01:40:05.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.017+0000 7f9eb1ffb700 1 --2- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9ea005f390 0x7f9ea0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.018+0000 7f9eb1ffb700 1 -- 172.21.15.1:0/528830999 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f9eac07a130 con 0x7f9ebc066f80 2023-11-15T01:40:05.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.018+0000 7f9ec1499700 1 -- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9ea005f390 msgr2=0x7f9ea0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:05.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.018+0000 7f9ec1499700 1 --2- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9ea005f390 0x7f9ea0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:40:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.022+0000 7f9eb1ffb700 1 -- 172.21.15.1:0/528830999 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9eac04ae50 con 0x7f9ebc066f80 2023-11-15T01:40:05.034 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:05.034+0000 7fefa4f9a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:40:05.102 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:05.101+0000 7fefa4f9a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:40:05.128 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:05.126+0000 7fe162273680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:40:05.209 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:05.208+0000 7fe162273680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:40:05.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.217+0000 7f9ec3efe700 1 -- 172.21.15.1:0/528830999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ebc06c7e0 con 0x7f9ebc066f80 2023-11-15T01:40:05.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.217+0000 7f9eb1ffb700 1 -- 172.21.15.1:0/528830999 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v127) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9eac04e470 con 0x7f9ebc066f80 2023-11-15T01:40:05.220 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T01:40:05.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.219+0000 7f9ec1499700 1 -- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9ea005f390 msgr2=0x7f9ea0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:05.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.219+0000 7f9ec1499700 1 --2- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9ea005f390 0x7f9ea0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:40:05.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.220+0000 7f9ec3efe700 1 -- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9ea005f390 msgr2=0x7f9ea0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:40:05.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.220+0000 7f9ec3efe700 1 --2- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9ea005f390 0x7f9ea0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:05.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.220+0000 7f9ec3efe700 1 -- 172.21.15.1:0/528830999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ebc066f80 msgr2=0x7f9ebc13a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.220+0000 7f9ec3efe700 1 --2- 172.21.15.1:0/528830999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ebc066f80 0x7f9ebc13a7b0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7f9eac00c4c0 tx=0x7f9eac007e00).stop 2023-11-15T01:40:05.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.220+0000 7f9ec3efe700 1 -- 172.21.15.1:0/528830999 shutdown_connections 2023-11-15T01:40:05.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.220+0000 7f9ec3efe700 1 --2- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9ea005f390 0x7f9ea0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:05.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.220+0000 7f9ec3efe700 1 --2- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ebc1588e0 0x7f9ebc0befe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.220+0000 7f9ec3efe700 1 --2- 172.21.15.1:0/528830999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ebc066f80 0x7f9ebc13a7b0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.220+0000 7f9ec3efe700 1 --2- 172.21.15.1:0/528830999 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ebc137030 0x7f9ebc0ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.220+0000 7f9ec3efe700 1 -- 172.21.15.1:0/528830999 >> 172.21.15.1:0/528830999 conn(0x7f9ebc063280 msgr2=0x7f9ebc150510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:05.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.220+0000 7f9ec3efe700 1 -- 172.21.15.1:0/528830999 shutdown_connections 2023-11-15T01:40:05.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.220+0000 7f9ec3efe700 1 -- 172.21.15.1:0/528830999 wait complete. 2023-11-15T01:40:05.234 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:40:05.283 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:05.282+0000 7fe162273680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:40:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.352+0000 7f16b09bd700 1 Processor -- start 2023-11-15T01:40:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.352+0000 7f16b09bd700 1 -- start start 2023-11-15T01:40:05.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.353+0000 7f16b09bd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f16ac150910 0x7f16ac062a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.353+0000 7f16b09bd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16ac062f40 0x7f16ac068dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.353+0000 7f16b09bd700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ac150d50 con 0x7f16ac150530 2023-11-15T01:40:05.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.353+0000 7f16b09bd700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ac0633d0 con 0x7f16ac150910 2023-11-15T01:40:05.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.353+0000 7f16b09bd700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac0c2290 con 0x7f16ac062f40 2023-11-15T01:40:05.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.353+0000 7f16a9d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f16ac150910 0x7f16ac062a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.353+0000 7f16a9d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f16ac150910 0x7f16ac062a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55454/0 (socket says 172.21.15.1:55454) 2023-11-15T01:40:05.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.353+0000 7f16a9d9b700 1 -- 172.21.15.1:0/4231258503 learned_addr learned my addr 172.21.15.1:0/4231258503 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:05.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.353+0000 7f16aad9d700 1 --2- 172.21.15.1:0/4231258503 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16ac062f40 0x7f16ac068dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.354+0000 7f16a9d9b700 1 -- 172.21.15.1:0/4231258503 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16ac062f40 msgr2=0x7f16ac068dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:05.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.354+0000 7f16a9d9b700 1 --2- 172.21.15.1:0/4231258503 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16ac062f40 0x7f16ac068dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.354+0000 7f16a9d9b700 1 -- 172.21.15.1:0/4231258503 >> v1:172.21.15.1:6789/0 conn(0x7f16ac150530 legacy=0x7f16ac0c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.354+0000 7f16a959a700 1 -- 172.21.15.1:0/4231258503 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803249726 0 0) 0x7f16ac150d50 con 0x7f16ac150530 2023-11-15T01:40:05.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.354+0000 7f16a9d9b700 1 -- 172.21.15.1:0/4231258503 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac0650f0 con 0x7f16ac150910 2023-11-15T01:40:05.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.354+0000 7f16aad9d700 1 --2- 172.21.15.1:0/4231258503 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16ac062f40 0x7f16ac068dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.354+0000 7f16a9d9b700 1 --2- 172.21.15.1:0/4231258503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16ac150910 0x7f16ac062a50 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f169c006fd0 tx=0x7f169c0090f0).ready entity=mon.0 client_cookie=cc1a1f5cdd9d09bb server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.354+0000 7f16a959a700 1 -- 172.21.15.1:0/4231258503 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c00b600 con 0x7f16ac150910 2023-11-15T01:40:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.354+0000 7f16a959a700 1 -- 172.21.15.1:0/4231258503 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c00b760 con 0x7f16ac150910 2023-11-15T01:40:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.354+0000 7f16a959a700 1 -- 172.21.15.1:0/4231258503 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c00bae0 con 0x7f16ac150910 2023-11-15T01:40:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.355+0000 7f16b09bd700 1 -- 172.21.15.1:0/4231258503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16ac150910 msgr2=0x7f16ac062a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.355+0000 7f16b09bd700 1 --2- 172.21.15.1:0/4231258503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16ac150910 0x7f16ac062a50 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f169c006fd0 tx=0x7f169c0090f0).stop 2023-11-15T01:40:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.355+0000 7f16b09bd700 1 -- 172.21.15.1:0/4231258503 shutdown_connections 2023-11-15T01:40:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.355+0000 7f16b09bd700 1 --2- 172.21.15.1:0/4231258503 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16ac062f40 0x7f16ac068dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.355+0000 7f16b09bd700 1 --2- 172.21.15.1:0/4231258503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16ac150910 0x7f16ac062a50 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.355+0000 7f16b09bd700 1 -- 172.21.15.1:0/4231258503 >> 172.21.15.1:0/4231258503 conn(0x7f16ac0c74f0 msgr2=0x7f16ac0c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:05.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.355+0000 7f16b09bd700 1 -- 172.21.15.1:0/4231258503 shutdown_connections 2023-11-15T01:40:05.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.355+0000 7f16b09bd700 1 -- 172.21.15.1:0/4231258503 wait complete. 2023-11-15T01:40:05.362 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:05.359+0000 7fefa4f9a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:40:05.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.356+0000 7f16b09bd700 1 Processor -- start 2023-11-15T01:40:05.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.356+0000 7f16b09bd700 1 -- start start 2023-11-15T01:40:05.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16b09bd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16ac062f40 0x7f16ac13f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16b09bd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16ac150530 0x7f16ac149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16b09bd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16ac150910 0x7f16ac14a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16b09bd700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac165d90 con 0x7f16ac062f40 2023-11-15T01:40:05.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16b09bd700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac165150 con 0x7f16ac150530 2023-11-15T01:40:05.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16b09bd700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac165460 con 0x7f16ac150910 2023-11-15T01:40:05.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16aa59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16ac062f40 0x7f16ac13f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16aa59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16ac062f40 0x7f16ac13f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55460/0 (socket says 172.21.15.1:55460) 2023-11-15T01:40:05.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16aa59c700 1 -- 172.21.15.1:0/248483475 learned_addr learned my addr 172.21.15.1:0/248483475 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:05.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16aad9d700 1 --2- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16ac150910 0x7f16ac14a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16a9d9b700 1 --2- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16ac150530 0x7f16ac149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16aa59c700 1 -- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16ac150910 msgr2=0x7f16ac14a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16aa59c700 1 --2- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16ac150910 0x7f16ac14a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16aa59c700 1 -- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16ac150530 msgr2=0x7f16ac149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16aa59c700 1 --2- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16ac150530 0x7f16ac149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16aa59c700 1 -- 172.21.15.1:0/248483475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c009370 con 0x7f16ac062f40 2023-11-15T01:40:05.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f16aa59c700 1 --2- 172.21.15.1:0/248483475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16ac062f40 0x7f16ac13f9f0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f16a0001eb0 tx=0x7f16a0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:05.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.357+0000 7f169a7fc700 1 -- 172.21.15.1:0/248483475 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a000ce60 con 0x7f16ac062f40 2023-11-15T01:40:05.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.358+0000 7f169a7fc700 1 -- 172.21.15.1:0/248483475 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a000f470 con 0x7f16ac062f40 2023-11-15T01:40:05.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.358+0000 7f16b09bd700 1 -- 172.21.15.1:0/248483475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ac165740 con 0x7f16ac062f40 2023-11-15T01:40:05.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.358+0000 7f169a7fc700 1 -- 172.21.15.1:0/248483475 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a000f810 con 0x7f16ac062f40 2023-11-15T01:40:05.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.358+0000 7f16b09bd700 1 -- 172.21.15.1:0/248483475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ac14a990 con 0x7f16ac062f40 2023-11-15T01:40:05.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.359+0000 7f16b09bd700 1 -- 172.21.15.1:0/248483475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ac06c7e0 con 0x7f16ac062f40 2023-11-15T01:40:05.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.359+0000 7f169a7fc700 1 -- 172.21.15.1:0/248483475 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f16a000fb80 con 0x7f16ac062f40 2023-11-15T01:40:05.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.359+0000 7f169a7fc700 1 --2- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f168c05f390 0x7f168c061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.359+0000 7f16a9d9b700 1 -- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f168c05f390 msgr2=0x7f168c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:05.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.359+0000 7f169a7fc700 1 -- 172.21.15.1:0/248483475 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f16a0079d80 con 0x7f16ac062f40 2023-11-15T01:40:05.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.359+0000 7f16a9d9b700 1 --2- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f168c05f390 0x7f168c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:40:05.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.364+0000 7f169a7fc700 1 -- 172.21.15.1:0/248483475 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f16a004aaa0 con 0x7f16ac062f40 2023-11-15T01:40:05.548 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:05.548+0000 7fefa4f9a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:40:05.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.560+0000 7f16a9d9b700 1 -- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f168c05f390 msgr2=0x7f168c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:05.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.560+0000 7f16a9d9b700 1 --2- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f168c05f390 0x7f168c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:40:05.562 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:05.560+0000 7fe162273680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:40:05.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.579+0000 7f16b09bd700 1 -- 172.21.15.1:0/248483475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16ac0635f0 con 0x7f16ac062f40 2023-11-15T01:40:05.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.579+0000 7f169a7fc700 1 -- 172.21.15.1:0/248483475 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f16a004e0c0 con 0x7f16ac062f40 2023-11-15T01:40:05.581 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:05.581 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7614,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3754341822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3754341822},{"type":"v1","addr":"172.21.15.1:6834","nonce":3754341822}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7617,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2242100060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":2242100060},{"type":"v1","addr":"172.21.15.1:6835","nonce":2242100060}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/1053521790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":1053521790},{"type":"v1","addr":"172.21.15.141:6836","nonce":1053521790}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:39:02.583978+0000","modified":"2023-11-15T01:39:05.601021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7629":{"gid":7629,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/2390881160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":2390881160},{"type":"v1","addr":"172.21.15.141:6837","nonce":2390881160}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-11-15T01:40:05.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.581+0000 7f16b09bd700 1 -- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f168c05f390 msgr2=0x7f168c061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:40:05.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.581+0000 7f16b09bd700 1 --2- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f168c05f390 0x7f168c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:05.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.581+0000 7f16b09bd700 1 -- 172.21.15.1:0/248483475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16ac062f40 msgr2=0x7f16ac13f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.581+0000 7f16b09bd700 1 --2- 172.21.15.1:0/248483475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16ac062f40 0x7f16ac13f9f0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f16a0001eb0 tx=0x7f16a0007c70).stop 2023-11-15T01:40:05.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.581+0000 7f16b09bd700 1 -- 172.21.15.1:0/248483475 shutdown_connections 2023-11-15T01:40:05.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.581+0000 7f16b09bd700 1 --2- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f168c05f390 0x7f168c061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:05.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.581+0000 7f16b09bd700 1 --2- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16ac150910 0x7f16ac14a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.581+0000 7f16b09bd700 1 --2- 172.21.15.1:0/248483475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16ac062f40 0x7f16ac13f9f0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.581+0000 7f16b09bd700 1 --2- 172.21.15.1:0/248483475 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16ac150530 0x7f16ac149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.581+0000 7f16b09bd700 1 -- 172.21.15.1:0/248483475 >> 172.21.15.1:0/248483475 conn(0x7f16ac0c74f0 msgr2=0x7f16ac0aaea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:05.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.581+0000 7f16b09bd700 1 -- 172.21.15.1:0/248483475 shutdown_connections 2023-11-15T01:40:05.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.581+0000 7f16b09bd700 1 -- 172.21.15.1:0/248483475 wait complete. 2023-11-15T01:40:05.586 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 55 2023-11-15T01:40:05.595 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:40:05.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.717+0000 7f606cdf4700 1 Processor -- start 2023-11-15T01:40:05.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.717+0000 7f606cdf4700 1 -- start start 2023-11-15T01:40:05.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.718+0000 7f606cdf4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60680bccd0 0x7f60680bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.718+0000 7f606cdf4700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606806a6b0 con 0x7f60680c60b0 2023-11-15T01:40:05.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.718+0000 7f606cdf4700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60680c3360 con 0x7f6068154680 2023-11-15T01:40:05.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.718+0000 7f606cdf4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60680bd620 con 0x7f60680bccd0 2023-11-15T01:40:05.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.718+0000 7f6066d9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f60680c60b0 0x7f60680c6540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41794/0 (socket says 172.21.15.1:41794) 2023-11-15T01:40:05.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.718+0000 7f6066d9d700 1 -- 172.21.15.1:0/1011063921 learned_addr learned my addr 172.21.15.1:0/1011063921 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:05.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.718+0000 7f6065d9b700 1 --2- 172.21.15.1:0/1011063921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60680bccd0 0x7f60680bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.718+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003610349 0 0) 0x7f606806a6b0 con 0x7f60680c60b0 2023-11-15T01:40:05.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.718+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60500033f0 con 0x7f60680c60b0 2023-11-15T01:40:05.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.718+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166429591 0 0) 0x7f60680c3360 con 0x7f6068154680 2023-11-15T01:40:05.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.718+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f606806a6b0 con 0x7f6068154680 2023-11-15T01:40:05.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2319574455 0 0) 0x7f60500033f0 con 0x7f60680c60b0 2023-11-15T01:40:05.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60680bccd0 msgr2=0x7f60680bd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:05.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 --2- 172.21.15.1:0/1011063921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60680bccd0 0x7f60680bd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 >> v1:172.21.15.141:6789/0 conn(0x7f6068154680 legacy=0x7f6068069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60680c2750 con 0x7f60680c60b0 2023-11-15T01:40:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f60600017f0 con 0x7f60680c60b0 2023-11-15T01:40:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f6065d9b700 1 --2- 172.21.15.1:0/1011063921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60680bccd0 0x7f60680bd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 >> v1:172.21.15.1:6789/0 conn(0x7f60680c60b0 legacy=0x7f60680c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 --2- 172.21.15.1:0/1011063921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6050003aa0 0x7f6050003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 --2- 172.21.15.1:0/1011063921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6050004690 0x7f6050004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 --2- 172.21.15.1:0/1011063921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60680bccd0 0x7f6050005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60680bd620 con 0x7f6050004690 2023-11-15T01:40:05.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605000b8e0 con 0x7f6050003aa0 2023-11-15T01:40:05.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605000ba70 con 0x7f60680bccd0 2023-11-15T01:40:05.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f6065d9b700 1 --2- 172.21.15.1:0/1011063921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6050004690 0x7f6050004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606659c700 1 --2- 172.21.15.1:0/1011063921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6050003aa0 0x7f6050003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f6066d9d700 1 --2- 172.21.15.1:0/1011063921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60680bccd0 0x7f6050005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f6065d9b700 1 -- 172.21.15.1:0/1011063921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60680bccd0 msgr2=0x7f6050005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:05.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f6065d9b700 1 --2- 172.21.15.1:0/1011063921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60680bccd0 0x7f6050005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f6065d9b700 1 -- 172.21.15.1:0/1011063921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6050003aa0 msgr2=0x7f6050003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:05.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f6065d9b700 1 --2- 172.21.15.1:0/1011063921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6050003aa0 0x7f6050003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f6065d9b700 1 -- 172.21.15.1:0/1011063921 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c0092a0 con 0x7f6050004690 2023-11-15T01:40:05.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f6065d9b700 1 --2- 172.21.15.1:0/1011063921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6050004690 0x7f6050004b10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f605c009c70 tx=0x7f605c009060).ready entity=mon.0 client_cookie=f9e4f4f0658ab82 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:05.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c0095c0 con 0x7f6050004690 2023-11-15T01:40:05.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c00e690 con 0x7f6050004690 2023-11-15T01:40:05.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.719+0000 7f606559a700 1 -- 172.21.15.1:0/1011063921 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c00ea10 con 0x7f6050004690 2023-11-15T01:40:05.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.720+0000 7f606cdf4700 1 -- 172.21.15.1:0/1011063921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6050004690 msgr2=0x7f6050004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.720+0000 7f606cdf4700 1 --2- 172.21.15.1:0/1011063921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6050004690 0x7f6050004b10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f605c009c70 tx=0x7f605c009060).stop 2023-11-15T01:40:05.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.720+0000 7f6066d9d700 1 -- 172.21.15.1:0/1011063921 reap_dead start 2023-11-15T01:40:05.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.720+0000 7f606cdf4700 1 -- 172.21.15.1:0/1011063921 shutdown_connections 2023-11-15T01:40:05.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.720+0000 7f606cdf4700 1 -- 172.21.15.1:0/1011063921 >> 172.21.15.1:0/1011063921 conn(0x7f60680c7d70 msgr2=0x7f60680c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:05.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.720+0000 7f606cdf4700 1 -- 172.21.15.1:0/1011063921 shutdown_connections 2023-11-15T01:40:05.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.720+0000 7f606cdf4700 1 -- 172.21.15.1:0/1011063921 wait complete. 2023-11-15T01:40:05.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.721+0000 7f606cdf4700 1 Processor -- start 2023-11-15T01:40:05.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.721+0000 7f606cdf4700 1 -- start start 2023-11-15T01:40:05.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.722+0000 7f606cdf4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6050004690 0x7f6068146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.722+0000 7f606cdf4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6068146ef0 0x7f60680a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.722+0000 7f606cdf4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60680abb80 0x7f60680a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.722+0000 7f606cdf4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60680aa370 con 0x7f60680abb80 2023-11-15T01:40:05.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.722+0000 7f606cdf4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60680bfd00 con 0x7f6050004690 2023-11-15T01:40:05.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.722+0000 7f606cdf4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60680aadc0 con 0x7f6068146ef0 2023-11-15T01:40:05.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.722+0000 7f6066d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60680abb80 0x7f60680a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.722+0000 7f6066d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60680abb80 0x7f60680a9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55480/0 (socket says 172.21.15.1:55480) 2023-11-15T01:40:05.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.722+0000 7f6066d9d700 1 -- 172.21.15.1:0/4266042250 learned_addr learned my addr 172.21.15.1:0/4266042250 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:05.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.722+0000 7f606659c700 1 --2- 172.21.15.1:0/4266042250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6050004690 0x7f6068146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.722+0000 7f6065d9b700 1 --2- 172.21.15.1:0/4266042250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6068146ef0 0x7f60680a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:05.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.723+0000 7f606659c700 1 -- 172.21.15.1:0/4266042250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6068146ef0 msgr2=0x7f60680a9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.723+0000 7f606659c700 1 --2- 172.21.15.1:0/4266042250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6068146ef0 0x7f60680a9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.723+0000 7f606659c700 1 -- 172.21.15.1:0/4266042250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60680abb80 msgr2=0x7f60680a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.723+0000 7f606659c700 1 --2- 172.21.15.1:0/4266042250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60680abb80 0x7f60680a9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.723+0000 7f606659c700 1 -- 172.21.15.1:0/4266042250 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60680ab0a0 con 0x7f6050004690 2023-11-15T01:40:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.723+0000 7f6066d9d700 1 --2- 172.21.15.1:0/4266042250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60680abb80 0x7f60680a9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.723+0000 7f606659c700 1 --2- 172.21.15.1:0/4266042250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6050004690 0x7f6068146a00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f6058002a20 tx=0x7f6058007bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.723+0000 7f60567fc700 1 -- 172.21.15.1:0/4266042250 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058002e00 con 0x7f6050004690 2023-11-15T01:40:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.723+0000 7f60567fc700 1 -- 172.21.15.1:0/4266042250 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605800f8d0 con 0x7f6050004690 2023-11-15T01:40:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.723+0000 7f606cdf4700 1 -- 172.21.15.1:0/4266042250 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60680ab380 con 0x7f6050004690 2023-11-15T01:40:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.723+0000 7f60567fc700 1 -- 172.21.15.1:0/4266042250 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605800fc50 con 0x7f6050004690 2023-11-15T01:40:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.723+0000 7f606cdf4700 1 -- 172.21.15.1:0/4266042250 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60680befa0 con 0x7f6050004690 2023-11-15T01:40:05.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.724+0000 7f606cdf4700 1 -- 172.21.15.1:0/4266042250 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60680ab8a0 con 0x7f6050004690 2023-11-15T01:40:05.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.724+0000 7f60567fc700 1 -- 172.21.15.1:0/4266042250 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f6058014450 con 0x7f6050004690 2023-11-15T01:40:05.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.725+0000 7f60567fc700 1 --2- 172.21.15.1:0/4266042250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f604805f390 0x7f6048061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:05.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.725+0000 7f60567fc700 1 -- 172.21.15.1:0/4266042250 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f605807a5d0 con 0x7f6050004690 2023-11-15T01:40:05.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.725+0000 7f6065d9b700 1 -- 172.21.15.1:0/4266042250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f604805f390 msgr2=0x7f6048061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.725+0000 7f6065d9b700 1 --2- 172.21.15.1:0/4266042250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f604805f390 0x7f6048061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:40:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.729+0000 7f60567fc700 1 -- 172.21.15.1:0/4266042250 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f605804aaf0 con 0x7f6050004690 2023-11-15T01:40:05.758 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:05.757+0000 7fe162273680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:40:05.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.904+0000 7f606cdf4700 1 -- 172.21.15.1:0/4266042250 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f606806c7e0 con 0x7f6050004690 2023-11-15T01:40:05.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.905+0000 7f60567fc700 1 -- 172.21.15.1:0/4266042250 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+17910 (secure 0 0 0) 0x7f60680ab8a0 con 0x7f6050004690 2023-11-15T01:40:05.909 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:05.910 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":127,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:39:19.106166+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:39:00.237361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-15T01:39:01.572293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/3877898493":"2023-11-16T01:39:19.106133+0000","172.21.15.141:0/252963828":"2023-11-16T01:39:19.106133+0000","172.21.15.141:0/798549701":"2023-11-16T01:39:19.106133+0000","172.21.15.141:6833/90546":"2023-11-16T01:39:19.106133+0000","172.21.15.141:6832/90546":"2023-11-16T01:39:19.106133+0000","172.21.15.141:0/1636101725":"2023-11-16T01:39:19.106133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:40:05.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.907+0000 7f606cdf4700 1 -- 172.21.15.1:0/4266042250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f604805f390 msgr2=0x7f6048061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:40:05.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.907+0000 7f606cdf4700 1 --2- 172.21.15.1:0/4266042250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f604805f390 0x7f6048061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:05.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.907+0000 7f606cdf4700 1 -- 172.21.15.1:0/4266042250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6050004690 msgr2=0x7f6068146a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:05.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.907+0000 7f606cdf4700 1 --2- 172.21.15.1:0/4266042250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6050004690 0x7f6068146a00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f6058002a20 tx=0x7f6058007bb0).stop 2023-11-15T01:40:05.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.907+0000 7f606cdf4700 1 -- 172.21.15.1:0/4266042250 shutdown_connections 2023-11-15T01:40:05.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.907+0000 7f606cdf4700 1 --2- 172.21.15.1:0/4266042250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f604805f390 0x7f6048061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:05.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.907+0000 7f606cdf4700 1 --2- 172.21.15.1:0/4266042250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60680abb80 0x7f60680a9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.907+0000 7f606cdf4700 1 --2- 172.21.15.1:0/4266042250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6050004690 0x7f6068146a00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.907+0000 7f606cdf4700 1 --2- 172.21.15.1:0/4266042250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6068146ef0 0x7f60680a9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:05.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.907+0000 7f606cdf4700 1 -- 172.21.15.1:0/4266042250 >> 172.21.15.1:0/4266042250 conn(0x7f60680c7d70 msgr2=0x7f606815a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:05.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.907+0000 7f606cdf4700 1 -- 172.21.15.1:0/4266042250 shutdown_connections 2023-11-15T01:40:05.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:05.907+0000 7f606cdf4700 1 -- 172.21.15.1:0/4266042250 wait complete. 2023-11-15T01:40:05.921 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-15T01:40:05.922 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:40:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.040+0000 7f922e676700 1 Processor -- start 2023-11-15T01:40:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.040+0000 7f922e676700 1 -- start start 2023-11-15T01:40:06.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.041+0000 7f922e676700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f92280c7290 0x7f92280bccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.041+0000 7f922e676700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f92281527a0 0x7f92280bd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.041+0000 7f922e676700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f922806a6b0 con 0x7f92281523c0 2023-11-15T01:40:06.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.041+0000 7f922e676700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92280ad9c0 con 0x7f92281527a0 2023-11-15T01:40:06.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.041+0000 7f922e676700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92280bd6b0 con 0x7f92280c7290 2023-11-15T01:40:06.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.041+0000 7f922cc13700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f92281527a0 0x7f92280bd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:06.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.041+0000 7f922cc13700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f92281527a0 0x7f92280bd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55488/0 (socket says 172.21.15.1:55488) 2023-11-15T01:40:06.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.041+0000 7f922cc13700 1 -- 172.21.15.1:0/1469285676 learned_addr learned my addr 172.21.15.1:0/1469285676 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:06.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.041+0000 7f92277fe700 1 --2- 172.21.15.1:0/1469285676 >> v2:172.21.15.141:3300/0 conn(0x7f92280c7290 0x7f92280bccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:06.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.042+0000 7f922cc13700 1 -- 172.21.15.1:0/1469285676 >> v2:172.21.15.141:3300/0 conn(0x7f92280c7290 msgr2=0x7f92280bccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:06.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.042+0000 7f922cc13700 1 --2- 172.21.15.1:0/1469285676 >> v2:172.21.15.141:3300/0 conn(0x7f92280c7290 0x7f92280bccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.042+0000 7f922cc13700 1 -- 172.21.15.1:0/1469285676 >> v1:172.21.15.141:6789/0 conn(0x7f92281523c0 legacy=0x7f9228069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:06.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.042+0000 7f922cc13700 1 -- 172.21.15.1:0/1469285676 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92280c61f0 con 0x7f92281527a0 2023-11-15T01:40:06.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.042+0000 7f922cc13700 1 --2- 172.21.15.1:0/1469285676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92281527a0 0x7f92280bd1c0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f922805fc60 tx=0x7f9220009840).ready entity=mon.0 client_cookie=2619e66e4467902d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:06.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.042+0000 7f9226ffd700 1 -- 172.21.15.1:0/1469285676 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922000e070 con 0x7f92281527a0 2023-11-15T01:40:06.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.042+0000 7f9226ffd700 1 -- 172.21.15.1:0/1469285676 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922000ba20 con 0x7f92281527a0 2023-11-15T01:40:06.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.042+0000 7f9226ffd700 1 -- 172.21.15.1:0/1469285676 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922000bda0 con 0x7f92281527a0 2023-11-15T01:40:06.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.043+0000 7f922e676700 1 -- 172.21.15.1:0/1469285676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92281527a0 msgr2=0x7f92280bd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:06.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.043+0000 7f922e676700 1 --2- 172.21.15.1:0/1469285676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92281527a0 0x7f92280bd1c0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f922805fc60 tx=0x7f9220009840).stop 2023-11-15T01:40:06.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.043+0000 7f922e676700 1 -- 172.21.15.1:0/1469285676 shutdown_connections 2023-11-15T01:40:06.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.043+0000 7f922e676700 1 --2- 172.21.15.1:0/1469285676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92281527a0 0x7f92280bd1c0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.043+0000 7f922e676700 1 --2- 172.21.15.1:0/1469285676 >> v2:172.21.15.141:3300/0 conn(0x7f92280c7290 0x7f92280bccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.043+0000 7f922e676700 1 -- 172.21.15.1:0/1469285676 >> 172.21.15.1:0/1469285676 conn(0x7f92280c7d70 msgr2=0x7f92280c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:06.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.043+0000 7f922e676700 1 -- 172.21.15.1:0/1469285676 shutdown_connections 2023-11-15T01:40:06.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.043+0000 7f922e676700 1 -- 172.21.15.1:0/1469285676 wait complete. 2023-11-15T01:40:06.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.044+0000 7f922e676700 1 Processor -- start 2023-11-15T01:40:06.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.044+0000 7f922e676700 1 -- start start 2023-11-15T01:40:06.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f922e676700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92281523c0 0x7f922814bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f922e676700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92281527a0 0x7f92280c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f922e676700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922814c510 0x7f922814c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f922e676700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922814c220 con 0x7f922814c510 2023-11-15T01:40:06.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f922e676700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922814ce80 con 0x7f92281523c0 2023-11-15T01:40:06.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f922e676700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9228150e70 con 0x7f92281527a0 2023-11-15T01:40:06.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f922cc13700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922814c510 0x7f922814c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:06.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f922cc13700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922814c510 0x7f922814c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55496/0 (socket says 172.21.15.1:55496) 2023-11-15T01:40:06.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f922cc13700 1 -- 172.21.15.1:0/1739632050 learned_addr learned my addr 172.21.15.1:0/1739632050 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:06.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f9227fff700 1 --2- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92281523c0 0x7f922814bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:06.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f92277fe700 1 --2- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92281527a0 0x7f92280c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:06.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f922cc13700 1 -- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92281527a0 msgr2=0x7f92280c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:06.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f922cc13700 1 --2- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92281527a0 0x7f92280c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f922cc13700 1 -- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92281523c0 msgr2=0x7f922814bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:06.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f922cc13700 1 --2- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92281523c0 0x7f922814bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f922cc13700 1 -- 172.21.15.1:0/1739632050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9220009ae0 con 0x7f922814c510 2023-11-15T01:40:06.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.045+0000 7f922cc13700 1 --2- 172.21.15.1:0/1739632050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922814c510 0x7f922814c990 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f922000bec0 tx=0x7f9220009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:06.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.046+0000 7f920ffff700 1 -- 172.21.15.1:0/1739632050 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220007170 con 0x7f922814c510 2023-11-15T01:40:06.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.046+0000 7f920ffff700 1 -- 172.21.15.1:0/1739632050 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92200092e0 con 0x7f922814c510 2023-11-15T01:40:06.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.046+0000 7f922e676700 1 -- 172.21.15.1:0/1739632050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9228151150 con 0x7f922814c510 2023-11-15T01:40:06.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.046+0000 7f920ffff700 1 -- 172.21.15.1:0/1739632050 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220007860 con 0x7f922814c510 2023-11-15T01:40:06.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.046+0000 7f922e676700 1 -- 172.21.15.1:0/1739632050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9228151710 con 0x7f922814c510 2023-11-15T01:40:06.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.047+0000 7f922e676700 1 -- 172.21.15.1:0/1739632050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922806c7e0 con 0x7f922814c510 2023-11-15T01:40:06.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.047+0000 7f920ffff700 1 -- 172.21.15.1:0/1739632050 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f9220003040 con 0x7f922814c510 2023-11-15T01:40:06.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.048+0000 7f920ffff700 1 --2- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f921405f390 0x7f9214061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.048+0000 7f9227fff700 1 -- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f921405f390 msgr2=0x7f9214061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:06.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.048+0000 7f920ffff700 1 -- 172.21.15.1:0/1739632050 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f922007c500 con 0x7f922814c510 2023-11-15T01:40:06.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.048+0000 7f9227fff700 1 --2- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f921405f390 0x7f9214061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:40:06.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.052+0000 7f920ffff700 1 -- 172.21.15.1:0/1739632050 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f922004d1c0 con 0x7f922814c510 2023-11-15T01:40:06.202 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:06.202+0000 7fefa4f9a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:40:06.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.249+0000 7f9227fff700 1 -- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f921405f390 msgr2=0x7f9214061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:06.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.249+0000 7f9227fff700 1 --2- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f921405f390 0x7f9214061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:40:06.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.272+0000 7f922e676700 1 -- 172.21.15.1:0/1739632050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92280c64d0 con 0x7f922814c510 2023-11-15T01:40:06.274 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:06.272+0000 7fefa4f9a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:40:06.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.272+0000 7f920ffff700 1 -- 172.21.15.1:0/1739632050 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f9220024020 con 0x7f922814c510 2023-11-15T01:40:06.274 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:06.275 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7614,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3754341822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3754341822},{"type":"v1","addr":"172.21.15.1:6834","nonce":3754341822}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7617,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2242100060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":2242100060},{"type":"v1","addr":"172.21.15.1:6835","nonce":2242100060}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/1053521790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":1053521790},{"type":"v1","addr":"172.21.15.141:6836","nonce":1053521790}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:39:02.583978+0000","modified":"2023-11-15T01:39:05.601021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7629":{"gid":7629,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/2390881160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":2390881160},{"type":"v1","addr":"172.21.15.141:6837","nonce":2390881160}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-11-15T01:40:06.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.274+0000 7f922e676700 1 -- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f921405f390 msgr2=0x7f9214061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:40:06.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.274+0000 7f922e676700 1 --2- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f921405f390 0x7f9214061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:06.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.274+0000 7f922e676700 1 -- 172.21.15.1:0/1739632050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922814c510 msgr2=0x7f922814c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:06.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.274+0000 7f922e676700 1 --2- 172.21.15.1:0/1739632050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922814c510 0x7f922814c990 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f922000bec0 tx=0x7f9220009840).stop 2023-11-15T01:40:06.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.274+0000 7f922e676700 1 -- 172.21.15.1:0/1739632050 shutdown_connections 2023-11-15T01:40:06.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.274+0000 7f922e676700 1 --2- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f921405f390 0x7f9214061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:06.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.274+0000 7f922e676700 1 --2- 172.21.15.1:0/1739632050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f922814c510 0x7f922814c990 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.274+0000 7f922e676700 1 --2- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92281523c0 0x7f922814bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.274+0000 7f922e676700 1 --2- 172.21.15.1:0/1739632050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92281527a0 0x7f92280c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.274+0000 7f922e676700 1 -- 172.21.15.1:0/1739632050 >> 172.21.15.1:0/1739632050 conn(0x7f92280c7d70 msgr2=0x7f9228062ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:06.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.274+0000 7f922e676700 1 -- 172.21.15.1:0/1739632050 shutdown_connections 2023-11-15T01:40:06.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.274+0000 7f922e676700 1 -- 172.21.15.1:0/1739632050 wait complete. 2023-11-15T01:40:06.279 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 55 2023-11-15T01:40:06.288 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:40:06.348 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:06.348+0000 7fefa4f9a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:40:06.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.410+0000 7fb0556f0700 1 Processor -- start 2023-11-15T01:40:06.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.410+0000 7fb0556f0700 1 -- start start 2023-11-15T01:40:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.411+0000 7fb0556f0700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb050154150 0x7fb050154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.411+0000 7fb0556f0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb0500ab1a0 0x7fb050158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.411+0000 7fb0556f0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0500aa060 0x7fb0500c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.411+0000 7fb0556f0700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0500c06f0 con 0x7fb0500ab1a0 2023-11-15T01:40:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.411+0000 7fb0556f0700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0500c09d0 con 0x7fb050154150 2023-11-15T01:40:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.411+0000 7fb0556f0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb050158820 con 0x7fb0500aa060 2023-11-15T01:40:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.411+0000 7fb04e7fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb0500ab1a0 0x7fb050158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:06.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.411+0000 7fb04e7fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb0500ab1a0 0x7fb050158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55510/0 (socket says 172.21.15.1:55510) 2023-11-15T01:40:06.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.411+0000 7fb04e7fc700 1 -- 172.21.15.1:0/1234888587 learned_addr learned my addr 172.21.15.1:0/1234888587 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:06.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.411+0000 7fb04effd700 1 --2- 172.21.15.1:0/1234888587 >> v2:172.21.15.141:3300/0 conn(0x7fb050154150 0x7fb050154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:06.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.411+0000 7fb04f7fe700 1 --2- 172.21.15.1:0/1234888587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0500aa060 0x7fb0500c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:06.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.412+0000 7fb04e7fc700 1 -- 172.21.15.1:0/1234888587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0500aa060 msgr2=0x7fb0500c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:06.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.412+0000 7fb04e7fc700 1 --2- 172.21.15.1:0/1234888587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0500aa060 0x7fb0500c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.412+0000 7fb04e7fc700 1 -- 172.21.15.1:0/1234888587 >> v2:172.21.15.141:3300/0 conn(0x7fb050154150 msgr2=0x7fb050154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:06.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.412+0000 7fb04e7fc700 1 --2- 172.21.15.1:0/1234888587 >> v2:172.21.15.141:3300/0 conn(0x7fb050154150 0x7fb050154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.412+0000 7fb04e7fc700 1 -- 172.21.15.1:0/1234888587 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050158b00 con 0x7fb0500ab1a0 2023-11-15T01:40:06.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.412+0000 7fb04e7fc700 1 --2- 172.21.15.1:0/1234888587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0500ab1a0 0x7fb050158040 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fb05006bfb0 tx=0x7fb0400090f0).ready entity=mon.0 client_cookie=d1709b46aa055d33 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:06.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.412+0000 7fb04dffb700 1 -- 172.21.15.1:0/1234888587 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04000f510 con 0x7fb0500ab1a0 2023-11-15T01:40:06.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.412+0000 7fb04dffb700 1 -- 172.21.15.1:0/1234888587 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04000f670 con 0x7fb0500ab1a0 2023-11-15T01:40:06.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.412+0000 7fb04dffb700 1 -- 172.21.15.1:0/1234888587 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04000fa10 con 0x7fb0500ab1a0 2023-11-15T01:40:06.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.412+0000 7fb0556f0700 1 -- 172.21.15.1:0/1234888587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0500ab1a0 msgr2=0x7fb050158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:06.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.412+0000 7fb0556f0700 1 --2- 172.21.15.1:0/1234888587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0500ab1a0 0x7fb050158040 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fb05006bfb0 tx=0x7fb0400090f0).stop 2023-11-15T01:40:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.413+0000 7fb0556f0700 1 -- 172.21.15.1:0/1234888587 shutdown_connections 2023-11-15T01:40:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.413+0000 7fb0556f0700 1 --2- 172.21.15.1:0/1234888587 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0500aa060 0x7fb0500c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.413+0000 7fb0556f0700 1 --2- 172.21.15.1:0/1234888587 >> v2:172.21.15.141:3300/0 conn(0x7fb050154150 0x7fb050154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.413+0000 7fb0556f0700 1 --2- 172.21.15.1:0/1234888587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0500ab1a0 0x7fb050158040 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.413+0000 7fb0556f0700 1 -- 172.21.15.1:0/1234888587 >> 172.21.15.1:0/1234888587 conn(0x7fb050064aa0 msgr2=0x7fb050064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.413+0000 7fb0556f0700 1 -- 172.21.15.1:0/1234888587 shutdown_connections 2023-11-15T01:40:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.413+0000 7fb0556f0700 1 -- 172.21.15.1:0/1234888587 wait complete. 2023-11-15T01:40:06.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.414+0000 7fb0556f0700 1 Processor -- start 2023-11-15T01:40:06.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.414+0000 7fb0556f0700 1 -- start start 2023-11-15T01:40:06.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb0556f0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0500aa060 0x7fb0500c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb0556f0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0500ab1a0 0x7fb050164720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb0556f0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb050154150 0x7fb05014c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb0556f0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb050167e70 con 0x7fb0500ab1a0 2023-11-15T01:40:06.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb0556f0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb050164d10 con 0x7fb050154150 2023-11-15T01:40:06.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb0556f0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb050164ff0 con 0x7fb0500aa060 2023-11-15T01:40:06.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb04e7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0500ab1a0 0x7fb050164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:06.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb04e7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0500ab1a0 0x7fb050164720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55516/0 (socket says 172.21.15.1:55516) 2023-11-15T01:40:06.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb04e7fc700 1 -- 172.21.15.1:0/212710628 learned_addr learned my addr 172.21.15.1:0/212710628 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:06.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb04effd700 1 --2- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0500aa060 0x7fb0500c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:06.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb04f7fe700 1 --2- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb050154150 0x7fb05014c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:06.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb04e7fc700 1 -- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0500aa060 msgr2=0x7fb0500c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:06.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb04e7fc700 1 --2- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0500aa060 0x7fb0500c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb04e7fc700 1 -- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb050154150 msgr2=0x7fb05014c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:06.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb04e7fc700 1 --2- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb050154150 0x7fb05014c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb04e7fc700 1 -- 172.21.15.1:0/212710628 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb040009370 con 0x7fb0500ab1a0 2023-11-15T01:40:06.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.415+0000 7fb04e7fc700 1 --2- 172.21.15.1:0/212710628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0500ab1a0 0x7fb050164720 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fb040006fd0 tx=0x7fb040016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:06.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.416+0000 7fb036ffd700 1 -- 172.21.15.1:0/212710628 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040006d90 con 0x7fb0500ab1a0 2023-11-15T01:40:06.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.416+0000 7fb036ffd700 1 -- 172.21.15.1:0/212710628 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb040000bc0 con 0x7fb0500ab1a0 2023-11-15T01:40:06.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.416+0000 7fb0556f0700 1 -- 172.21.15.1:0/212710628 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0501652d0 con 0x7fb0500ab1a0 2023-11-15T01:40:06.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.416+0000 7fb036ffd700 1 -- 172.21.15.1:0/212710628 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04000fa10 con 0x7fb0500ab1a0 2023-11-15T01:40:06.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.416+0000 7fb0556f0700 1 -- 172.21.15.1:0/212710628 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05014d050 con 0x7fb0500ab1a0 2023-11-15T01:40:06.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.417+0000 7fb0556f0700 1 -- 172.21.15.1:0/212710628 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb050167fe0 con 0x7fb0500ab1a0 2023-11-15T01:40:06.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.417+0000 7fb036ffd700 1 -- 172.21.15.1:0/212710628 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fb04001b640 con 0x7fb0500ab1a0 2023-11-15T01:40:06.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.417+0000 7fb036ffd700 1 --2- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb03c05f390 0x7fb03c061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.417+0000 7fb036ffd700 1 -- 172.21.15.1:0/212710628 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fb04007bf80 con 0x7fb0500ab1a0 2023-11-15T01:40:06.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.417+0000 7fb04effd700 1 -- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb03c05f390 msgr2=0x7fb03c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:06.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.417+0000 7fb04effd700 1 --2- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb03c05f390 0x7fb03c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:40:06.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.422+0000 7fb036ffd700 1 -- 172.21.15.1:0/212710628 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb0400aaaf0 con 0x7fb0500ab1a0 2023-11-15T01:40:06.462 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:06.461+0000 7fe162273680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:40:06.496 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:06.495+0000 7fefa4f9a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:40:06.535 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:06.534+0000 7fe162273680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:40:06.567 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:06.565+0000 7fefa4f9a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:40:06.617 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:06.616+0000 7fe162273680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:40:06.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.618+0000 7fb04effd700 1 -- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb03c05f390 msgr2=0x7fb03c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:06.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.618+0000 7fb04effd700 1 --2- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb03c05f390 0x7fb03c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:40:06.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.640+0000 7fb0556f0700 1 -- 172.21.15.1:0/212710628 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb050158de0 con 0x7fb0500ab1a0 2023-11-15T01:40:06.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.641+0000 7fb036ffd700 1 -- 172.21.15.1:0/212710628 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fb040028070 con 0x7fb0500ab1a0 2023-11-15T01:40:06.643 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:06.643 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7614,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3754341822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3754341822},{"type":"v1","addr":"172.21.15.1:6834","nonce":3754341822}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7617,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2242100060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":2242100060},{"type":"v1","addr":"172.21.15.1:6835","nonce":2242100060}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/1053521790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":1053521790},{"type":"v1","addr":"172.21.15.141:6836","nonce":1053521790}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:39:02.583978+0000","modified":"2023-11-15T01:39:05.601021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7629":{"gid":7629,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/2390881160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":2390881160},{"type":"v1","addr":"172.21.15.141:6837","nonce":2390881160}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-11-15T01:40:06.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.643+0000 7fb0556f0700 1 -- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb03c05f390 msgr2=0x7fb03c061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:40:06.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.643+0000 7fb0556f0700 1 --2- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb03c05f390 0x7fb03c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:06.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.643+0000 7fb0556f0700 1 -- 172.21.15.1:0/212710628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0500ab1a0 msgr2=0x7fb050164720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:06.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.643+0000 7fb0556f0700 1 --2- 172.21.15.1:0/212710628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0500ab1a0 0x7fb050164720 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fb040006fd0 tx=0x7fb040016000).stop 2023-11-15T01:40:06.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.643+0000 7fb0556f0700 1 -- 172.21.15.1:0/212710628 shutdown_connections 2023-11-15T01:40:06.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.643+0000 7fb0556f0700 1 --2- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb03c05f390 0x7fb03c061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:06.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.643+0000 7fb0556f0700 1 --2- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb050154150 0x7fb05014c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.643+0000 7fb0556f0700 1 --2- 172.21.15.1:0/212710628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0500aa060 0x7fb0500c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.643+0000 7fb0556f0700 1 --2- 172.21.15.1:0/212710628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0500ab1a0 0x7fb050164720 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.643+0000 7fb0556f0700 1 -- 172.21.15.1:0/212710628 >> 172.21.15.1:0/212710628 conn(0x7fb050064aa0 msgr2=0x7fb0500ad0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:06.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.643+0000 7fb0556f0700 1 -- 172.21.15.1:0/212710628 shutdown_connections 2023-11-15T01:40:06.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.643+0000 7fb0556f0700 1 -- 172.21.15.1:0/212710628 wait complete. 2023-11-15T01:40:06.647 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 55 2023-11-15T01:40:06.657 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:40:06.684 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:06.683+0000 7fefa4f9a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:40:06.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.775+0000 7f6823e7e700 1 Processor -- start 2023-11-15T01:40:06.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.776+0000 7f6823e7e700 1 -- start start 2023-11-15T01:40:06.778 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:06.776+0000 7fe162273680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:40:06.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.777+0000 7f6823e7e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f681c1523c0 0x7f681c069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.777+0000 7f6823e7e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681c0c61f0 con 0x7f681c0c7290 2023-11-15T01:40:06.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.777+0000 7f6823e7e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681c0c64d0 con 0x7f681c0bd3e0 2023-11-15T01:40:06.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.777+0000 7f6823e7e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681c0ad9c0 con 0x7f681c1523c0 2023-11-15T01:40:06.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.777+0000 7f6821419700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f681c0c7290 0x7f681c0bccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41810/0 (socket says 172.21.15.1:41810) 2023-11-15T01:40:06.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.777+0000 7f6821419700 1 -- 172.21.15.1:0/1489875695 learned_addr learned my addr 172.21.15.1:0/1489875695 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:06.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.777+0000 7f6821c1a700 1 --2- 172.21.15.1:0/1489875695 >> v2:172.21.15.141:3300/0 conn(0x7f681c1523c0 0x7f681c069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:06.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.778+0000 7f6820c18700 1 -- 172.21.15.1:0/1489875695 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052533418 0 0) 0x7f681c0c61f0 con 0x7f681c0c7290 2023-11-15T01:40:06.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.778+0000 7f6820c18700 1 -- 172.21.15.1:0/1489875695 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68080033f0 con 0x7f681c0c7290 2023-11-15T01:40:06.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.778+0000 7f6820c18700 1 -- 172.21.15.1:0/1489875695 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1037631433 0 0) 0x7f68080033f0 con 0x7f681c0c7290 2023-11-15T01:40:06.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.778+0000 7f6821c1a700 1 -- 172.21.15.1:0/1489875695 >> v1:172.21.15.141:6789/0 conn(0x7f681c0bd3e0 legacy=0x7f681c0aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:06.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.778+0000 7f6821c1a700 1 -- 172.21.15.1:0/1489875695 >> v1:172.21.15.1:6789/0 conn(0x7f681c0c7290 legacy=0x7f681c0bccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:06.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.778+0000 7f6821c1a700 1 -- 172.21.15.1:0/1489875695 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c0c67b0 con 0x7f681c1523c0 2023-11-15T01:40:06.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.778+0000 7f6821c1a700 1 --2- 172.21.15.1:0/1489875695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f681c1523c0 0x7f681c069fa0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f680c009760 tx=0x7f680c009060).ready entity=mon.1 client_cookie=e0222cc0c6cb292f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:06.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.778+0000 7f6820c18700 1 -- 172.21.15.1:0/1489875695 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6818001470 con 0x7f681c1523c0 2023-11-15T01:40:06.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.778+0000 7f6820c18700 1 -- 172.21.15.1:0/1489875695 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680c011400 con 0x7f681c1523c0 2023-11-15T01:40:06.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.778+0000 7f6820c18700 1 -- 172.21.15.1:0/1489875695 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c011780 con 0x7f681c1523c0 2023-11-15T01:40:06.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.779+0000 7f6823e7e700 1 -- 172.21.15.1:0/1489875695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f681c1523c0 msgr2=0x7f681c069fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:06.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.779+0000 7f6823e7e700 1 --2- 172.21.15.1:0/1489875695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f681c1523c0 0x7f681c069fa0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f680c009760 tx=0x7f680c009060).stop 2023-11-15T01:40:06.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.779+0000 7f6823e7e700 1 -- 172.21.15.1:0/1489875695 shutdown_connections 2023-11-15T01:40:06.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.779+0000 7f6823e7e700 1 --2- 172.21.15.1:0/1489875695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f681c1523c0 0x7f681c069fa0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.779+0000 7f6823e7e700 1 -- 172.21.15.1:0/1489875695 >> 172.21.15.1:0/1489875695 conn(0x7f681c0c7d70 msgr2=0x7f681c0c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:06.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.779+0000 7f6823e7e700 1 -- 172.21.15.1:0/1489875695 shutdown_connections 2023-11-15T01:40:06.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.779+0000 7f6823e7e700 1 -- 172.21.15.1:0/1489875695 wait complete. 2023-11-15T01:40:06.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.780+0000 7f6823e7e700 1 Processor -- start 2023-11-15T01:40:06.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.780+0000 7f6823e7e700 1 -- start start 2023-11-15T01:40:06.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6823e7e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f681c0bd3e0 0x7f681c141550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6823e7e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f681c1523c0 0x7f681c0a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6823e7e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f681c0a1320 0x7f681c0668b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6823e7e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681c163b70 con 0x7f681c0bd3e0 2023-11-15T01:40:06.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6823e7e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681c141a40 con 0x7f681c1523c0 2023-11-15T01:40:06.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6823e7e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681c164960 con 0x7f681c0a1320 2023-11-15T01:40:06.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6821c1a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f681c0bd3e0 0x7f681c141550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:06.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6821c1a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f681c0bd3e0 0x7f681c141550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55532/0 (socket says 172.21.15.1:55532) 2023-11-15T01:40:06.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6821c1a700 1 -- 172.21.15.1:0/497187939 learned_addr learned my addr 172.21.15.1:0/497187939 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:06.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6821419700 1 --2- 172.21.15.1:0/497187939 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f681c1523c0 0x7f681c0a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:06.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f682241b700 1 --2- 172.21.15.1:0/497187939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f681c0a1320 0x7f681c0668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:06.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6821c1a700 1 -- 172.21.15.1:0/497187939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f681c0a1320 msgr2=0x7f681c0668b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:06.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6821c1a700 1 --2- 172.21.15.1:0/497187939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f681c0a1320 0x7f681c0668b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6821c1a700 1 -- 172.21.15.1:0/497187939 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f681c1523c0 msgr2=0x7f681c0a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:06.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6821c1a700 1 --2- 172.21.15.1:0/497187939 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f681c1523c0 0x7f681c0a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6821c1a700 1 -- 172.21.15.1:0/497187939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c0092a0 con 0x7f681c0bd3e0 2023-11-15T01:40:06.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.781+0000 7f6821419700 1 --2- 172.21.15.1:0/497187939 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f681c1523c0 0x7f681c0a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:06.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.782+0000 7f6821c1a700 1 --2- 172.21.15.1:0/497187939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f681c0bd3e0 0x7f681c141550 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f680c0118a0 tx=0x7f680c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:06.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.782+0000 7f6811ffb700 1 -- 172.21.15.1:0/497187939 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c010800 con 0x7f681c0bd3e0 2023-11-15T01:40:06.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.782+0000 7f6811ffb700 1 -- 172.21.15.1:0/497187939 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680c010960 con 0x7f681c0bd3e0 2023-11-15T01:40:06.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.782+0000 7f6823e7e700 1 -- 172.21.15.1:0/497187939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681c14e2d0 con 0x7f681c0bd3e0 2023-11-15T01:40:06.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.782+0000 7f6811ffb700 1 -- 172.21.15.1:0/497187939 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c010d00 con 0x7f681c0bd3e0 2023-11-15T01:40:06.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.782+0000 7f6823e7e700 1 -- 172.21.15.1:0/497187939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681c164030 con 0x7f681c0bd3e0 2023-11-15T01:40:06.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.783+0000 7f6823e7e700 1 -- 172.21.15.1:0/497187939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681c06c7e0 con 0x7f681c0bd3e0 2023-11-15T01:40:06.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.784+0000 7f6811ffb700 1 -- 172.21.15.1:0/497187939 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f680c01d640 con 0x7f681c0bd3e0 2023-11-15T01:40:06.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.784+0000 7f6811ffb700 1 --2- 172.21.15.1:0/497187939 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f680005f390 0x7f6800061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:06.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.785+0000 7f6811ffb700 1 -- 172.21.15.1:0/497187939 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6803+0+0 (secure 0 0 0) 0x7f680c07c760 con 0x7f681c0bd3e0 2023-11-15T01:40:06.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.785+0000 7f6821419700 1 -- 172.21.15.1:0/497187939 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f680005f390 msgr2=0x7f6800061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:06.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.785+0000 7f6821419700 1 --2- 172.21.15.1:0/497187939 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f680005f390 0x7f6800061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:40:06.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.788+0000 7f6811ffb700 1 -- 172.21.15.1:0/497187939 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f680c04d480 con 0x7f681c0bd3e0 2023-11-15T01:40:06.793 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:06.792+0000 7fefa4f9a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:40:06.854 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:06.853+0000 7fe162273680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:40:06.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.963+0000 7f6823e7e700 1 -- 172.21.15.1:0/497187939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f681c0c6a90 con 0x7f681c0bd3e0 2023-11-15T01:40:06.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.964+0000 7f6811ffb700 1 -- 172.21.15.1:0/497187939 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+17910 (secure 0 0 0) 0x7f680c016070 con 0x7f681c0bd3e0 2023-11-15T01:40:06.965 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:06.966 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":127,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:39:19.106166+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:39:00.237361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-15T01:39:01.572293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/3877898493":"2023-11-16T01:39:19.106133+0000","172.21.15.141:0/252963828":"2023-11-16T01:39:19.106133+0000","172.21.15.141:0/798549701":"2023-11-16T01:39:19.106133+0000","172.21.15.141:6833/90546":"2023-11-16T01:39:19.106133+0000","172.21.15.141:6832/90546":"2023-11-16T01:39:19.106133+0000","172.21.15.141:0/1636101725":"2023-11-16T01:39:19.106133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:40:06.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.966+0000 7f6823e7e700 1 -- 172.21.15.1:0/497187939 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f680005f390 msgr2=0x7f6800061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:40:06.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.966+0000 7f6823e7e700 1 --2- 172.21.15.1:0/497187939 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f680005f390 0x7f6800061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:06.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.966+0000 7f6823e7e700 1 -- 172.21.15.1:0/497187939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f681c0bd3e0 msgr2=0x7f681c141550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:06.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.966+0000 7f6823e7e700 1 --2- 172.21.15.1:0/497187939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f681c0bd3e0 0x7f681c141550 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f680c0118a0 tx=0x7f680c014000).stop 2023-11-15T01:40:06.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.966+0000 7f6823e7e700 1 -- 172.21.15.1:0/497187939 shutdown_connections 2023-11-15T01:40:06.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.966+0000 7f6823e7e700 1 --2- 172.21.15.1:0/497187939 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f680005f390 0x7f6800061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:06.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.966+0000 7f6823e7e700 1 --2- 172.21.15.1:0/497187939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f681c0a1320 0x7f681c0668b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.966+0000 7f6823e7e700 1 --2- 172.21.15.1:0/497187939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f681c0bd3e0 0x7f681c141550 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.966+0000 7f6823e7e700 1 --2- 172.21.15.1:0/497187939 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f681c1523c0 0x7f681c0a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:06.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.966+0000 7f6823e7e700 1 -- 172.21.15.1:0/497187939 >> 172.21.15.1:0/497187939 conn(0x7f681c0c7d70 msgr2=0x7f681c14f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:06.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.966+0000 7f6823e7e700 1 -- 172.21.15.1:0/497187939 shutdown_connections 2023-11-15T01:40:06.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:06.966+0000 7f6823e7e700 1 -- 172.21.15.1:0/497187939 wait complete. 2023-11-15T01:40:06.978 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:06.977+0000 7fe162273680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:40:06.980 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-15T01:40:07.085 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:07.085+0000 7fefa4f9a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:40:07.096 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:07.095+0000 7fe162273680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:40:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.099+0000 7fbfe0832700 1 Processor -- start 2023-11-15T01:40:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.100+0000 7fbfe0832700 1 -- start start 2023-11-15T01:40:07.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.100+0000 7fbfe0832700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbfdc0bccd0 0x7fbfdc0bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:07.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.100+0000 7fbfe0832700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbfdc0c60b0 0x7fbfdc0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:07.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.101+0000 7fbfe0832700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc06a6b0 con 0x7fbfdc154680 2023-11-15T01:40:07.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.101+0000 7fbfe0832700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc0c3360 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.101+0000 7fbfe0832700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc0bd620 con 0x7fbfdc0c60b0 2023-11-15T01:40:07.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.101+0000 7fbfd9d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbfdc0bccd0 0x7fbfdc0bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:07.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.101+0000 7fbfd9d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbfdc0bccd0 0x7fbfdc0bd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55544/0 (socket says 172.21.15.1:55544) 2023-11-15T01:40:07.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.101+0000 7fbfd9d9b700 1 -- 172.21.15.1:0/2255431033 learned_addr learned my addr 172.21.15.1:0/2255431033 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:07.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.101+0000 7fbfdad9d700 1 --2- 172.21.15.1:0/2255431033 >> v2:172.21.15.141:3300/0 conn(0x7fbfdc0c60b0 0x7fbfdc0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:07.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.101+0000 7fbfd9d9b700 1 -- 172.21.15.1:0/2255431033 >> v2:172.21.15.141:3300/0 conn(0x7fbfdc0c60b0 msgr2=0x7fbfdc0c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:07.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.101+0000 7fbfd9d9b700 1 --2- 172.21.15.1:0/2255431033 >> v2:172.21.15.141:3300/0 conn(0x7fbfdc0c60b0 0x7fbfdc0c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:07.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.101+0000 7fbfd9d9b700 1 -- 172.21.15.1:0/2255431033 >> v1:172.21.15.141:6789/0 conn(0x7fbfdc154680 legacy=0x7fbfdc069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:07.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.101+0000 7fbfd9d9b700 1 -- 172.21.15.1:0/2255431033 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc0c2750 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.101+0000 7fbfd9d9b700 1 --2- 172.21.15.1:0/2255431033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfdc0bccd0 0x7fbfdc0bd130 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7fbfdc064cc0 tx=0x7fbfc40090f0).ready entity=mon.0 client_cookie=a1087ef3656dbd9c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:07.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.101+0000 7fbfd959a700 1 -- 172.21.15.1:0/2255431033 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc400b520 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.101+0000 7fbfd959a700 1 -- 172.21.15.1:0/2255431033 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc400b680 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.101+0000 7fbfd959a700 1 -- 172.21.15.1:0/2255431033 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc400ba00 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.102+0000 7fbfe0832700 1 -- 172.21.15.1:0/2255431033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfdc0bccd0 msgr2=0x7fbfdc0bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:07.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.102+0000 7fbfe0832700 1 --2- 172.21.15.1:0/2255431033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfdc0bccd0 0x7fbfdc0bd130 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7fbfdc064cc0 tx=0x7fbfc40090f0).stop 2023-11-15T01:40:07.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.102+0000 7fbfe0832700 1 -- 172.21.15.1:0/2255431033 shutdown_connections 2023-11-15T01:40:07.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.102+0000 7fbfe0832700 1 --2- 172.21.15.1:0/2255431033 >> v2:172.21.15.141:3300/0 conn(0x7fbfdc0c60b0 0x7fbfdc0c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:07.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.102+0000 7fbfe0832700 1 --2- 172.21.15.1:0/2255431033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfdc0bccd0 0x7fbfdc0bd130 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:07.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.102+0000 7fbfe0832700 1 -- 172.21.15.1:0/2255431033 >> 172.21.15.1:0/2255431033 conn(0x7fbfdc0c7d70 msgr2=0x7fbfdc0c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:07.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.102+0000 7fbfe0832700 1 -- 172.21.15.1:0/2255431033 shutdown_connections 2023-11-15T01:40:07.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.102+0000 7fbfe0832700 1 -- 172.21.15.1:0/2255431033 wait complete. 2023-11-15T01:40:07.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.103+0000 7fbfe0832700 1 Processor -- start 2023-11-15T01:40:07.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.103+0000 7fbfe0832700 1 -- start start 2023-11-15T01:40:07.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.104+0000 7fbfe0832700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfdc0bccd0 0x7fbfdc150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:07.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.104+0000 7fbfe0832700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfdc0c60b0 0x7fbfdc0c0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:07.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.104+0000 7fbfe0832700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfdc154680 0x7fbfdc0abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:07.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.104+0000 7fbfe0832700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0a94c0 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.104+0000 7fbfe0832700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0a88b0 con 0x7fbfdc0c60b0 2023-11-15T01:40:07.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.104+0000 7fbfe0832700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0a8b90 con 0x7fbfdc154680 2023-11-15T01:40:07.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.104+0000 7fbfda59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfdc0bccd0 0x7fbfdc150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:07.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.104+0000 7fbfda59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfdc0bccd0 0x7fbfdc150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55552/0 (socket says 172.21.15.1:55552) 2023-11-15T01:40:07.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.104+0000 7fbfda59c700 1 -- 172.21.15.1:0/4010277495 learned_addr learned my addr 172.21.15.1:0/4010277495 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:07.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.104+0000 7fbfd9d9b700 1 --2- 172.21.15.1:0/4010277495 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfdc0c60b0 0x7fbfdc0c0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:07.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.104+0000 7fbfdad9d700 1 --2- 172.21.15.1:0/4010277495 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfdc154680 0x7fbfdc0abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:07.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.105+0000 7fbfda59c700 1 -- 172.21.15.1:0/4010277495 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfdc154680 msgr2=0x7fbfdc0abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:07.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.105+0000 7fbfda59c700 1 --2- 172.21.15.1:0/4010277495 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfdc154680 0x7fbfdc0abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:07.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.105+0000 7fbfda59c700 1 -- 172.21.15.1:0/4010277495 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfdc0c60b0 msgr2=0x7fbfdc0c0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:07.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.105+0000 7fbfda59c700 1 --2- 172.21.15.1:0/4010277495 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfdc0c60b0 0x7fbfdc0c0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:07.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.105+0000 7fbfda59c700 1 -- 172.21.15.1:0/4010277495 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc4009370 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.105+0000 7fbfda59c700 1 --2- 172.21.15.1:0/4010277495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfdc0bccd0 0x7fbfdc150e00 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7fbfcc00c440 tx=0x7fbfcc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:07.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.105+0000 7fbfd27fc700 1 -- 172.21.15.1:0/4010277495 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc007020 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.105+0000 7fbfd27fc700 1 -- 172.21.15.1:0/4010277495 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc007180 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.105+0000 7fbfe0832700 1 -- 172.21.15.1:0/4010277495 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfdc0a8e70 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.105+0000 7fbfd27fc700 1 -- 172.21.15.1:0/4010277495 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc007520 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.105+0000 7fbfe0832700 1 -- 172.21.15.1:0/4010277495 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc168840 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.106+0000 7fbfe0832700 1 -- 172.21.15.1:0/4010277495 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc06c7e0 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.106+0000 7fbfd27fc700 1 -- 172.21.15.1:0/4010277495 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fbfcc0068b0 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.107+0000 7fbfd27fc700 1 --2- 172.21.15.1:0/4010277495 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbfbc05f390 0x7fbfbc061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:07.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.107+0000 7fbfd27fc700 1 -- 172.21.15.1:0/4010277495 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fbfcc079a90 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.107+0000 7fbfd9d9b700 1 -- 172.21.15.1:0/4010277495 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbfbc05f390 msgr2=0x7fbfbc061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:07.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.107+0000 7fbfd9d9b700 1 --2- 172.21.15.1:0/4010277495 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbfbc05f390 0x7fbfbc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:40:07.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.111+0000 7fbfd27fc700 1 -- 172.21.15.1:0/4010277495 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbfcc047af0 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.158 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:07.157+0000 7fefa4f9a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:40:07.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.179+0000 7fbfd27fc700 1 -- 172.21.15.1:0/4010277495 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 55) v1 ==== 75270+0+0 (secure 0 0 0) 0x7fbfcc0772b0 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.179+0000 7fbfd27fc700 1 -- 172.21.15.1:0/4010277495 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbfbc05f390 msgr2=0x7fbfbc061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:40:07.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.179+0000 7fbfd27fc700 1 --2- 172.21.15.1:0/4010277495 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbfbc05f390 0x7fbfbc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:07.240 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:07.240+0000 7fef1f72b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:07.240 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:07.240+0000 7fef1f72b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:07.241 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:07.240+0000 7fef1f72b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:07.241 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:07.240+0000 7fef1f72b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:07.241 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:07.240+0000 7fef1f72b700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:07.241 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:07.240+0000 7fef21f30700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:07.241 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:07.240+0000 7fef21f30700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:07.242 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:07.240+0000 7fef21f30700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:07.242 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:07.240+0000 7fef21f30700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:07.242 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:07.240+0000 7fef21f30700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:07.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:07.341+0000 7fbfe0832700 1 -- 172.21.15.1:0/4010277495 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbfdc0c2a30 con 0x7fbfdc0bccd0 2023-11-15T01:40:07.417 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:07.416+0000 7fe162273680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:40:07.492 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:07.491+0000 7fe162273680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:40:08.174 INFO:tasks.ceph.mon.a.smithi001.stderr:2023-11-15T01:40:08.173+0000 7f8072214700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-15T01:40:08.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.176+0000 7fbfd27fc700 1 -- 172.21.15.1:0/4010277495 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbfcc071540 con 0x7fbfdc0bccd0 2023-11-15T01:40:08.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.178+0000 7fbfe0832700 1 -- 172.21.15.1:0/4010277495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfdc0bccd0 msgr2=0x7fbfdc150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:08.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.178+0000 7fbfe0832700 1 --2- 172.21.15.1:0/4010277495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfdc0bccd0 0x7fbfdc150e00 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7fbfcc00c440 tx=0x7fbfcc007e00).stop 2023-11-15T01:40:08.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.178+0000 7fbfe0832700 1 -- 172.21.15.1:0/4010277495 shutdown_connections 2023-11-15T01:40:08.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.178+0000 7fbfe0832700 1 --2- 172.21.15.1:0/4010277495 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbfbc05f390 0x7fbfbc061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:08.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.178+0000 7fbfe0832700 1 --2- 172.21.15.1:0/4010277495 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfdc154680 0x7fbfdc0abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:08.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.178+0000 7fbfe0832700 1 --2- 172.21.15.1:0/4010277495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfdc0bccd0 0x7fbfdc150e00 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:08.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.178+0000 7fbfe0832700 1 --2- 172.21.15.1:0/4010277495 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfdc0c60b0 0x7fbfdc0c0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:08.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.179+0000 7fbfe0832700 1 -- 172.21.15.1:0/4010277495 >> 172.21.15.1:0/4010277495 conn(0x7fbfdc0c7d70 msgr2=0x7fbfdc0c4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:08.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.179+0000 7fbfe0832700 1 -- 172.21.15.1:0/4010277495 shutdown_connections 2023-11-15T01:40:08.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.179+0000 7fbfe0832700 1 -- 172.21.15.1:0/4010277495 wait complete. 2023-11-15T01:40:08.183 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-15T01:40:08.187 INFO:tasks.ceph.mds.d.smithi141.stderr: -7926> 2023-11-15T01:39:07.505+0000 7f24acee8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T01:40:08.197 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-15T01:40:08.216 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T01:40:08.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.319+0000 7fb845062700 1 Processor -- start 2023-11-15T01:40:08.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.319+0000 7fb845062700 1 -- start start 2023-11-15T01:40:08.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.320+0000 7fb845062700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb8400c6650 0x7fb8400aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:08.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.320+0000 7fb845062700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400ca050 con 0x7fb840154480 2023-11-15T01:40:08.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.320+0000 7fb845062700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400c9440 con 0x7fb8401540a0 2023-11-15T01:40:08.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.320+0000 7fb845062700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8400c9720 con 0x7fb8400c6650 2023-11-15T01:40:08.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.320+0000 7fb83e59c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb840154480 0x7fb8400c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58556/0 (socket says 172.21.15.1:58556) 2023-11-15T01:40:08.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.320+0000 7fb83e59c700 1 -- 172.21.15.1:0/588442821 learned_addr learned my addr 172.21.15.1:0/588442821 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:08.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.320+0000 7fb83f59e700 1 --2- 172.21.15.1:0/588442821 >> v2:172.21.15.141:3300/0 conn(0x7fb8400c6650 0x7fb8400aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:08.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.320+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906797644 0 0) 0x7fb8400ca050 con 0x7fb840154480 2023-11-15T01:40:08.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb82c0033f0 con 0x7fb840154480 2023-11-15T01:40:08.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019772241 0 0) 0x7fb8400c9440 con 0x7fb8401540a0 2023-11-15T01:40:08.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8400ca050 con 0x7fb8401540a0 2023-11-15T01:40:08.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 735629692 0 0) 0x7fb82c0033f0 con 0x7fb840154480 2023-11-15T01:40:08.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 >> v2:172.21.15.141:3300/0 conn(0x7fb8400c6650 msgr2=0x7fb8400aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:08.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 --2- 172.21.15.1:0/588442821 >> v2:172.21.15.141:3300/0 conn(0x7fb8400c6650 0x7fb8400aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:08.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 >> v1:172.21.15.141:6789/0 conn(0x7fb8401540a0 legacy=0x7fb8400ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:08.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400c9a00 con 0x7fb840154480 2023-11-15T01:40:08.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fb828001470 con 0x7fb840154480 2023-11-15T01:40:08.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83f59e700 1 --2- 172.21.15.1:0/588442821 >> v2:172.21.15.141:3300/0 conn(0x7fb8400c6650 0x7fb8400aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:08.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 >> v1:172.21.15.1:6789/0 conn(0x7fb840154480 legacy=0x7fb8400c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:08.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 --2- 172.21.15.1:0/588442821 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb82c003ac0 0x7fb82c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:08.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 --2- 172.21.15.1:0/588442821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c004690 0x7fb82c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:08.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 --2- 172.21.15.1:0/588442821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb82c005000 0x7fb82c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:08.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c9720 con 0x7fb82c004690 2023-11-15T01:40:08.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c00beb0 con 0x7fb82c003ac0 2023-11-15T01:40:08.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c00c070 con 0x7fb82c005000 2023-11-15T01:40:08.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83e59c700 1 --2- 172.21.15.1:0/588442821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c004690 0x7fb82c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:08.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83ed9d700 1 --2- 172.21.15.1:0/588442821 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb82c003ac0 0x7fb82c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:08.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83f59e700 1 --2- 172.21.15.1:0/588442821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb82c005000 0x7fb82c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:08.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83e59c700 1 -- 172.21.15.1:0/588442821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb82c005000 msgr2=0x7fb82c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:08.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83e59c700 1 --2- 172.21.15.1:0/588442821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb82c005000 0x7fb82c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:08.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83e59c700 1 -- 172.21.15.1:0/588442821 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb82c003ac0 msgr2=0x7fb82c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:08.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83e59c700 1 --2- 172.21.15.1:0/588442821 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb82c003ac0 0x7fb82c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:08.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83e59c700 1 -- 172.21.15.1:0/588442821 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c0033f0 con 0x7fb82c004690 2023-11-15T01:40:08.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83ed9d700 1 --2- 172.21.15.1:0/588442821 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb82c003ac0 0x7fb82c003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:08.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.321+0000 7fb83f59e700 1 -- 172.21.15.1:0/588442821 reap_dead start 2023-11-15T01:40:08.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.322+0000 7fb83e59c700 1 --2- 172.21.15.1:0/588442821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c004690 0x7fb82c004b10 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7fb828007f60 tx=0x7fb828001d40).ready entity=mon.0 client_cookie=55e238711647825b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:08.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.322+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82800c980 con 0x7fb82c004690 2023-11-15T01:40:08.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.322+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82800cae0 con 0x7fb82c004690 2023-11-15T01:40:08.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.322+0000 7fb83dd9b700 1 -- 172.21.15.1:0/588442821 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82800ce80 con 0x7fb82c004690 2023-11-15T01:40:08.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.322+0000 7fb845062700 1 -- 172.21.15.1:0/588442821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c004690 msgr2=0x7fb82c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:08.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.322+0000 7fb845062700 1 --2- 172.21.15.1:0/588442821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c004690 0x7fb82c004b10 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7fb828007f60 tx=0x7fb828001d40).stop 2023-11-15T01:40:08.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.322+0000 7fb845062700 1 -- 172.21.15.1:0/588442821 shutdown_connections 2023-11-15T01:40:08.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.322+0000 7fb845062700 1 --2- 172.21.15.1:0/588442821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c004690 0x7fb82c004b10 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:08.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.322+0000 7fb845062700 1 -- 172.21.15.1:0/588442821 >> 172.21.15.1:0/588442821 conn(0x7fb840064a70 msgr2=0x7fb840064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:08.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.322+0000 7fb845062700 1 -- 172.21.15.1:0/588442821 shutdown_connections 2023-11-15T01:40:08.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.322+0000 7fb845062700 1 -- 172.21.15.1:0/588442821 wait complete. 2023-11-15T01:40:08.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.323+0000 7fb845062700 1 Processor -- start 2023-11-15T01:40:08.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.324+0000 7fb845062700 1 -- start start 2023-11-15T01:40:08.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.324+0000 7fb845062700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c004690 0x7fb8400c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:08.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.324+0000 7fb845062700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb840167d70 0x7fb8400b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:08.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.324+0000 7fb845062700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb840156b00 0x7fb840156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:08.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.324+0000 7fb845062700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c3030 con 0x7fb82c004690 2023-11-15T01:40:08.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.324+0000 7fb845062700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400b0ca0 con 0x7fb840156b00 2023-11-15T01:40:08.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.324+0000 7fb845062700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb840168200 con 0x7fb840167d70 2023-11-15T01:40:08.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.324+0000 7fb83ed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c004690 0x7fb8400c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:08.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.324+0000 7fb83ed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c004690 0x7fb8400c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55600/0 (socket says 172.21.15.1:55600) 2023-11-15T01:40:08.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.324+0000 7fb83ed9d700 1 -- 172.21.15.1:0/1764001768 learned_addr learned my addr 172.21.15.1:0/1764001768 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:08.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.324+0000 7fb83e59c700 1 --2- 172.21.15.1:0/1764001768 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb840167d70 0x7fb8400b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:08.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.324+0000 7fb83f59e700 1 --2- 172.21.15.1:0/1764001768 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb840156b00 0x7fb840156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:08.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.325+0000 7fb83ed9d700 1 -- 172.21.15.1:0/1764001768 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb840167d70 msgr2=0x7fb8400b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:08.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.325+0000 7fb83ed9d700 1 --2- 172.21.15.1:0/1764001768 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb840167d70 0x7fb8400b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:08.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.325+0000 7fb83ed9d700 1 -- 172.21.15.1:0/1764001768 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb840156b00 msgr2=0x7fb840156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:08.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.325+0000 7fb83ed9d700 1 --2- 172.21.15.1:0/1764001768 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb840156b00 0x7fb840156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:08.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.325+0000 7fb83ed9d700 1 -- 172.21.15.1:0/1764001768 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8401684e0 con 0x7fb82c004690 2023-11-15T01:40:08.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.325+0000 7fb83ed9d700 1 --2- 172.21.15.1:0/1764001768 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c004690 0x7fb8400c2b40 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7fb838000c00 tx=0x7fb838007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:08.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.325+0000 7fb836ffd700 1 -- 172.21.15.1:0/1764001768 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838002240 con 0x7fb82c004690 2023-11-15T01:40:08.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.325+0000 7fb836ffd700 1 -- 172.21.15.1:0/1764001768 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8380023a0 con 0x7fb82c004690 2023-11-15T01:40:08.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.325+0000 7fb845062700 1 -- 172.21.15.1:0/1764001768 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8401687c0 con 0x7fb82c004690 2023-11-15T01:40:08.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.325+0000 7fb836ffd700 1 -- 172.21.15.1:0/1764001768 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838001760 con 0x7fb82c004690 2023-11-15T01:40:08.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.325+0000 7fb845062700 1 -- 172.21.15.1:0/1764001768 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb840158700 con 0x7fb82c004690 2023-11-15T01:40:08.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.326+0000 7fb845062700 1 -- 172.21.15.1:0/1764001768 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84006c7e0 con 0x7fb82c004690 2023-11-15T01:40:08.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.326+0000 7fb836ffd700 1 -- 172.21.15.1:0/1764001768 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 56) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fb838001ad0 con 0x7fb82c004690 2023-11-15T01:40:08.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.327+0000 7fb836ffd700 1 --2- 172.21.15.1:0/1764001768 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb82005f030 0x7fb8200614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:08.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.327+0000 7fb836ffd700 1 -- 172.21.15.1:0/1764001768 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7175+0+0 (secure 0 0 0) 0x7fb83807c1f0 con 0x7fb82c004690 2023-11-15T01:40:08.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.327+0000 7fb83e59c700 1 --2- 172.21.15.1:0/1764001768 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb82005f030 0x7fb8200614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:08.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.327+0000 7fb83e59c700 1 --2- 172.21.15.1:0/1764001768 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb82005f030 0x7fb8200614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fb828000c00 tx=0x7fb828013000).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:08.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.331+0000 7fb836ffd700 1 -- 172.21.15.1:0/1764001768 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb838049af0 con 0x7fb82c004690 2023-11-15T01:40:08.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:08.551+0000 7fb845062700 1 -- 172.21.15.1:0/1764001768 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb8400c9ce0 con 0x7fb82c004690 2023-11-15T01:40:09.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.184+0000 7fb836ffd700 1 -- 172.21.15.1:0/1764001768 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb83804ad00 con 0x7fb82c004690 2023-11-15T01:40:09.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.186+0000 7fb845062700 1 -- 172.21.15.1:0/1764001768 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb82005f030 msgr2=0x7fb8200614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:09.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.186+0000 7fb845062700 1 --2- 172.21.15.1:0/1764001768 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb82005f030 0x7fb8200614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fb828000c00 tx=0x7fb828013000).stop 2023-11-15T01:40:09.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.186+0000 7fb845062700 1 -- 172.21.15.1:0/1764001768 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c004690 msgr2=0x7fb8400c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:09.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.186+0000 7fb845062700 1 --2- 172.21.15.1:0/1764001768 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c004690 0x7fb8400c2b40 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7fb838000c00 tx=0x7fb838007bb0).stop 2023-11-15T01:40:09.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.186+0000 7fb845062700 1 -- 172.21.15.1:0/1764001768 shutdown_connections 2023-11-15T01:40:09.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.186+0000 7fb845062700 1 --2- 172.21.15.1:0/1764001768 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb82005f030 0x7fb8200614f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:09.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.186+0000 7fb845062700 1 --2- 172.21.15.1:0/1764001768 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb840156b00 0x7fb840156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:09.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.186+0000 7fb845062700 1 --2- 172.21.15.1:0/1764001768 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c004690 0x7fb8400c2b40 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:09.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.186+0000 7fb845062700 1 --2- 172.21.15.1:0/1764001768 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb840167d70 0x7fb8400b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:09.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.186+0000 7fb845062700 1 -- 172.21.15.1:0/1764001768 >> 172.21.15.1:0/1764001768 conn(0x7fb840064a70 msgr2=0x7fb8400ab910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:09.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.186+0000 7fb845062700 1 -- 172.21.15.1:0/1764001768 shutdown_connections 2023-11-15T01:40:09.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.186+0000 7fb845062700 1 -- 172.21.15.1:0/1764001768 wait complete. 2023-11-15T01:40:09.201 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-15T01:40:09.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.324+0000 7f8e5b750700 1 Processor -- start 2023-11-15T01:40:09.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.324+0000 7f8e5b750700 1 -- start start 2023-11-15T01:40:09.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.325+0000 7f8e5b750700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8e540c3510 0x7f8e540c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:09.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.325+0000 7f8e5b750700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8e54064660 0x7f8e54064ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:09.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.325+0000 7f8e5b750700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e540c39a0 con 0x7f8e540c53b0 2023-11-15T01:40:09.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.325+0000 7f8e5b750700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e540835c0 con 0x7f8e54064660 2023-11-15T01:40:09.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.325+0000 7f8e5b750700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e540c5790 con 0x7f8e540c3510 2023-11-15T01:40:09.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.325+0000 7f8e59ced700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8e54064660 0x7f8e54064ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:09.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.325+0000 7f8e594ec700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8e540c53b0 0x7f8e540c7f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58568/0 (socket says 172.21.15.1:58568) 2023-11-15T01:40:09.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.325+0000 7f8e594ec700 1 -- 172.21.15.1:0/796391493 learned_addr learned my addr 172.21.15.1:0/796391493 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:09.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.326+0000 7f8e58ceb700 1 --2- 172.21.15.1:0/796391493 >> v2:172.21.15.141:3300/0 conn(0x7f8e540c3510 0x7f8e540c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:09.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.326+0000 7f8e59ced700 1 -- 172.21.15.1:0/796391493 >> v2:172.21.15.141:3300/0 conn(0x7f8e540c3510 msgr2=0x7f8e540c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:09.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.326+0000 7f8e59ced700 1 --2- 172.21.15.1:0/796391493 >> v2:172.21.15.141:3300/0 conn(0x7f8e540c3510 0x7f8e540c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:09.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.326+0000 7f8e59ced700 1 -- 172.21.15.1:0/796391493 >> v1:172.21.15.1:6789/0 conn(0x7f8e540c53b0 legacy=0x7f8e540c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:09.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.326+0000 7f8e59ced700 1 -- 172.21.15.1:0/796391493 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e540c6eb0 con 0x7f8e54064660 2023-11-15T01:40:09.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.326+0000 7f8e59ced700 1 --2- 172.21.15.1:0/796391493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e54064660 0x7f8e54064ab0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f8e54097010 tx=0x7f8e4c009060).ready entity=mon.0 client_cookie=5c03f686204d7b5d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:09.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.326+0000 7f8e53fff700 1 -- 172.21.15.1:0/796391493 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00f510 con 0x7f8e54064660 2023-11-15T01:40:09.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.326+0000 7f8e53fff700 1 -- 172.21.15.1:0/796391493 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c00f670 con 0x7f8e54064660 2023-11-15T01:40:09.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.326+0000 7f8e53fff700 1 -- 172.21.15.1:0/796391493 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00f9f0 con 0x7f8e54064660 2023-11-15T01:40:09.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.327+0000 7f8e5b750700 1 -- 172.21.15.1:0/796391493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e54064660 msgr2=0x7f8e54064ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:09.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.327+0000 7f8e5b750700 1 --2- 172.21.15.1:0/796391493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e54064660 0x7f8e54064ab0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f8e54097010 tx=0x7f8e4c009060).stop 2023-11-15T01:40:09.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.327+0000 7f8e5b750700 1 -- 172.21.15.1:0/796391493 shutdown_connections 2023-11-15T01:40:09.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.327+0000 7f8e5b750700 1 --2- 172.21.15.1:0/796391493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e54064660 0x7f8e54064ab0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:09.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.327+0000 7f8e5b750700 1 --2- 172.21.15.1:0/796391493 >> v2:172.21.15.141:3300/0 conn(0x7f8e540c3510 0x7f8e540c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:09.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.327+0000 7f8e5b750700 1 -- 172.21.15.1:0/796391493 >> 172.21.15.1:0/796391493 conn(0x7f8e54082f90 msgr2=0x7f8e540c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:09.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.327+0000 7f8e5b750700 1 -- 172.21.15.1:0/796391493 shutdown_connections 2023-11-15T01:40:09.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.327+0000 7f8e5b750700 1 -- 172.21.15.1:0/796391493 wait complete. 2023-11-15T01:40:09.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.328+0000 7f8e5b750700 1 Processor -- start 2023-11-15T01:40:09.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.328+0000 7f8e5b750700 1 -- start start 2023-11-15T01:40:09.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e5b750700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e54064660 0x7f8e540c0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:09.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e5b750700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e540c3510 0x7f8e54153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:09.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e5b750700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e540c53b0 0x7f8e540a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:09.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e5b750700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e540c0550 con 0x7f8e54064660 2023-11-15T01:40:09.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e5b750700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e540ac950 con 0x7f8e540c3510 2023-11-15T01:40:09.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e5b750700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e540ac020 con 0x7f8e540c53b0 2023-11-15T01:40:09.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e594ec700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e54064660 0x7f8e540c0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:09.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e594ec700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e54064660 0x7f8e540c0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55614/0 (socket says 172.21.15.1:55614) 2023-11-15T01:40:09.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e594ec700 1 -- 172.21.15.1:0/178614892 learned_addr learned my addr 172.21.15.1:0/178614892 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:09.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e594ec700 1 -- 172.21.15.1:0/178614892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e540c53b0 msgr2=0x7f8e540a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:09.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e58ceb700 1 --2- 172.21.15.1:0/178614892 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e540c3510 0x7f8e54153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:09.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e594ec700 1 --2- 172.21.15.1:0/178614892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e540c53b0 0x7f8e540a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:09.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e594ec700 1 -- 172.21.15.1:0/178614892 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e540c3510 msgr2=0x7f8e54153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:09.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e594ec700 1 --2- 172.21.15.1:0/178614892 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e540c3510 0x7f8e54153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:09.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e594ec700 1 -- 172.21.15.1:0/178614892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c0092a0 con 0x7f8e54064660 2023-11-15T01:40:09.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e594ec700 1 --2- 172.21.15.1:0/178614892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e54064660 0x7f8e540c0060 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f8e4400c8b0 tx=0x7f8e440016d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:09.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e517fa700 1 -- 172.21.15.1:0/178614892 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44005c00 con 0x7f8e54064660 2023-11-15T01:40:09.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e517fa700 1 -- 172.21.15.1:0/178614892 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e44005d60 con 0x7f8e54064660 2023-11-15T01:40:09.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e517fa700 1 -- 172.21.15.1:0/178614892 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44007340 con 0x7f8e54064660 2023-11-15T01:40:09.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e5b750700 1 -- 172.21.15.1:0/178614892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e540ac300 con 0x7f8e54064660 2023-11-15T01:40:09.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.329+0000 7f8e5b750700 1 -- 172.21.15.1:0/178614892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e540ab0d0 con 0x7f8e54064660 2023-11-15T01:40:09.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.330+0000 7f8e5b750700 1 -- 172.21.15.1:0/178614892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5406c7e0 con 0x7f8e54064660 2023-11-15T01:40:09.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.331+0000 7f8e517fa700 1 -- 172.21.15.1:0/178614892 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 56) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f8e44007730 con 0x7f8e54064660 2023-11-15T01:40:09.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.331+0000 7f8e517fa700 1 --2- 172.21.15.1:0/178614892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e4005f030 0x7f8e400614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:09.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.331+0000 7f8e517fa700 1 -- 172.21.15.1:0/178614892 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 7175+0+0 (secure 0 0 0) 0x7f8e4407a630 con 0x7f8e54064660 2023-11-15T01:40:09.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.331+0000 7f8e58ceb700 1 --2- 172.21.15.1:0/178614892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e4005f030 0x7f8e400614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:09.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.332+0000 7f8e58ceb700 1 --2- 172.21.15.1:0/178614892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e4005f030 0x7f8e400614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8e48006fd0 tx=0x7f8e48008040).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:09.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.335+0000 7f8e517fa700 1 -- 172.21.15.1:0/178614892 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8e4404b6b0 con 0x7f8e54064660 2023-11-15T01:40:09.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:09.507+0000 7f8e5b750700 1 -- 172.21.15.1:0/178614892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8e540c7190 con 0x7f8e54064660 2023-11-15T01:40:10.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.187+0000 7f8e517fa700 1 -- 172.21.15.1:0/178614892 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8e440781b0 con 0x7f8e54064660 2023-11-15T01:40:10.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.194+0000 7f8e517fa700 1 -- 172.21.15.1:0/178614892 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v131) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8e440734c0 con 0x7f8e54064660 2023-11-15T01:40:10.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.198+0000 7f8e5b750700 1 -- 172.21.15.1:0/178614892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e4005f030 msgr2=0x7f8e400614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.198+0000 7f8e5b750700 1 --2- 172.21.15.1:0/178614892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e4005f030 0x7f8e400614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8e48006fd0 tx=0x7f8e48008040).stop 2023-11-15T01:40:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.198+0000 7f8e5b750700 1 -- 172.21.15.1:0/178614892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e54064660 msgr2=0x7f8e540c0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.198+0000 7f8e5b750700 1 --2- 172.21.15.1:0/178614892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e54064660 0x7f8e540c0060 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f8e4400c8b0 tx=0x7f8e440016d0).stop 2023-11-15T01:40:10.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.198+0000 7f8e5b750700 1 -- 172.21.15.1:0/178614892 shutdown_connections 2023-11-15T01:40:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.198+0000 7f8e5b750700 1 --2- 172.21.15.1:0/178614892 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e4005f030 0x7f8e400614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.198+0000 7f8e5b750700 1 --2- 172.21.15.1:0/178614892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e540c53b0 0x7f8e540a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.198+0000 7f8e5b750700 1 --2- 172.21.15.1:0/178614892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e54064660 0x7f8e540c0060 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.198+0000 7f8e5b750700 1 --2- 172.21.15.1:0/178614892 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e540c3510 0x7f8e54153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:10.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.198+0000 7f8e5b750700 1 -- 172.21.15.1:0/178614892 >> 172.21.15.1:0/178614892 conn(0x7f8e54082f90 msgr2=0x7f8e540674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:10.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.199+0000 7f8e5b750700 1 -- 172.21.15.1:0/178614892 shutdown_connections 2023-11-15T01:40:10.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.199+0000 7f8e5b750700 1 -- 172.21.15.1:0/178614892 wait complete. 2023-11-15T01:40:10.202 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2023-11-15T01:40:10.216 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-15T01:40:10.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.342+0000 7f229ffff700 1 Processor -- start 2023-11-15T01:40:10.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.342+0000 7f229ffff700 1 -- start start 2023-11-15T01:40:10.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.343+0000 7f229ffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f22a0137210 0x7f22a01552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:10.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.343+0000 7f229ffff700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f22a0066850 0x7f22a0066d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:10.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.343+0000 7f229ffff700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a00671f0 con 0x7f22a01375f0 2023-11-15T01:40:10.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.343+0000 7f229ffff700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a0158330 con 0x7f22a0137210 2023-11-15T01:40:10.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.343+0000 7f229ffff700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a0158610 con 0x7f22a0066850 2023-11-15T01:40:10.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.343+0000 7f229effd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f22a0137210 0x7f22a01552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:10.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.343+0000 7f229effd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f22a0137210 0x7f22a01552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55620/0 (socket says 172.21.15.1:55620) 2023-11-15T01:40:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.343+0000 7f229effd700 1 -- 172.21.15.1:0/3816258804 learned_addr learned my addr 172.21.15.1:0/3816258804 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.343+0000 7f229f7fe700 1 --2- 172.21.15.1:0/3816258804 >> v2:172.21.15.141:3300/0 conn(0x7f22a0066850 0x7f22a0066d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.343+0000 7f229effd700 1 -- 172.21.15.1:0/3816258804 >> v2:172.21.15.141:3300/0 conn(0x7f22a0066850 msgr2=0x7f22a0066d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.343+0000 7f229effd700 1 --2- 172.21.15.1:0/3816258804 >> v2:172.21.15.141:3300/0 conn(0x7f22a0066850 0x7f22a0066d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.343+0000 7f229effd700 1 -- 172.21.15.1:0/3816258804 >> v1:172.21.15.141:6789/0 conn(0x7f22a01375f0 legacy=0x7f22a014e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.343+0000 7f229effd700 1 -- 172.21.15.1:0/3816258804 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a01588f0 con 0x7f22a0137210 2023-11-15T01:40:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.343+0000 7f229effd700 1 --2- 172.21.15.1:0/3816258804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0137210 0x7f22a01552a0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f22a00c34b0 tx=0x7f22980090f0).ready entity=mon.0 client_cookie=41c76e2d91086bb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.344+0000 7f229dffb700 1 -- 172.21.15.1:0/3816258804 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229800b5a0 con 0x7f22a0137210 2023-11-15T01:40:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.344+0000 7f229dffb700 1 -- 172.21.15.1:0/3816258804 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229800b700 con 0x7f22a0137210 2023-11-15T01:40:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.344+0000 7f229dffb700 1 -- 172.21.15.1:0/3816258804 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229800ba80 con 0x7f22a0137210 2023-11-15T01:40:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.344+0000 7f229ffff700 1 -- 172.21.15.1:0/3816258804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0137210 msgr2=0x7f22a01552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.344+0000 7f229ffff700 1 --2- 172.21.15.1:0/3816258804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0137210 0x7f22a01552a0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f22a00c34b0 tx=0x7f22980090f0).stop 2023-11-15T01:40:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.344+0000 7f229ffff700 1 -- 172.21.15.1:0/3816258804 shutdown_connections 2023-11-15T01:40:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.344+0000 7f229ffff700 1 --2- 172.21.15.1:0/3816258804 >> v2:172.21.15.141:3300/0 conn(0x7f22a0066850 0x7f22a0066d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:10.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.344+0000 7f229ffff700 1 --2- 172.21.15.1:0/3816258804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0137210 0x7f22a01552a0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:10.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.344+0000 7f229ffff700 1 -- 172.21.15.1:0/3816258804 >> 172.21.15.1:0/3816258804 conn(0x7f22a0063280 msgr2=0x7f22a00c8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:10.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.344+0000 7f229ffff700 1 -- 172.21.15.1:0/3816258804 shutdown_connections 2023-11-15T01:40:10.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.344+0000 7f229ffff700 1 -- 172.21.15.1:0/3816258804 wait complete. 2023-11-15T01:40:10.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.345+0000 7f229ffff700 1 Processor -- start 2023-11-15T01:40:10.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.346+0000 7f229ffff700 1 -- start start 2023-11-15T01:40:10.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.346+0000 7f229ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0066850 0x7f22a0139de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:10.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.346+0000 7f229ffff700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22a0137210 0x7f22a013dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:10.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.346+0000 7f229ffff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22a01375f0 0x7f22a013bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:10.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.346+0000 7f229ffff700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a0137a50 con 0x7f22a0066850 2023-11-15T01:40:10.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.346+0000 7f229ffff700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a01382f0 con 0x7f22a0137210 2023-11-15T01:40:10.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.346+0000 7f229ffff700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00c5b60 con 0x7f22a01375f0 2023-11-15T01:40:10.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.346+0000 7f229effd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0066850 0x7f22a0139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:10.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.346+0000 7f229effd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0066850 0x7f22a0139de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55632/0 (socket says 172.21.15.1:55632) 2023-11-15T01:40:10.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.346+0000 7f229effd700 1 -- 172.21.15.1:0/329919793 learned_addr learned my addr 172.21.15.1:0/329919793 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:10.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.347+0000 7f229f7fe700 1 --2- 172.21.15.1:0/329919793 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22a01375f0 0x7f22a013bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:10.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.347+0000 7f229e7fc700 1 --2- 172.21.15.1:0/329919793 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22a0137210 0x7f22a013dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:10.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.347+0000 7f229effd700 1 -- 172.21.15.1:0/329919793 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22a01375f0 msgr2=0x7f22a013bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:10.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.347+0000 7f229effd700 1 --2- 172.21.15.1:0/329919793 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22a01375f0 0x7f22a013bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:10.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.347+0000 7f229effd700 1 -- 172.21.15.1:0/329919793 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22a0137210 msgr2=0x7f22a013dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:10.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.347+0000 7f229effd700 1 --2- 172.21.15.1:0/329919793 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22a0137210 0x7f22a013dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:10.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.347+0000 7f229effd700 1 -- 172.21.15.1:0/329919793 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2298009370 con 0x7f22a0066850 2023-11-15T01:40:10.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.347+0000 7f229effd700 1 --2- 172.21.15.1:0/329919793 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0066850 0x7f22a0139de0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f2298009130 tx=0x7f2298015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:10.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.347+0000 7f2296ffd700 1 -- 172.21.15.1:0/329919793 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229800b870 con 0x7f22a0066850 2023-11-15T01:40:10.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.347+0000 7f2296ffd700 1 -- 172.21.15.1:0/329919793 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229800b9d0 con 0x7f22a0066850 2023-11-15T01:40:10.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.347+0000 7f2296ffd700 1 -- 172.21.15.1:0/329919793 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22980246c0 con 0x7f22a0066850 2023-11-15T01:40:10.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.347+0000 7f229ffff700 1 -- 172.21.15.1:0/329919793 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a0137ca0 con 0x7f22a0066850 2023-11-15T01:40:10.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.347+0000 7f229ffff700 1 -- 172.21.15.1:0/329919793 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a013c0a0 con 0x7f22a0066850 2023-11-15T01:40:10.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.348+0000 7f229ffff700 1 -- 172.21.15.1:0/329919793 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a0155320 con 0x7f22a0066850 2023-11-15T01:40:10.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.348+0000 7f2296ffd700 1 -- 172.21.15.1:0/329919793 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2298021070 con 0x7f22a0066850 2023-11-15T01:40:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.349+0000 7f2296ffd700 1 --2- 172.21.15.1:0/329919793 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f228005f2a0 0x7f2280061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.349+0000 7f2296ffd700 1 -- 172.21.15.1:0/329919793 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6737+0+0 (secure 0 0 0) 0x7f229807c000 con 0x7f22a0066850 2023-11-15T01:40:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.349+0000 7f229e7fc700 1 --2- 172.21.15.1:0/329919793 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f228005f2a0 0x7f2280061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.349+0000 7f229e7fc700 1 --2- 172.21.15.1:0/329919793 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f228005f2a0 0x7f2280061760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f22a013a950 tx=0x7f2288008040).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:10.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.353+0000 7f2296ffd700 1 -- 172.21.15.1:0/329919793 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f229804cee0 con 0x7f22a0066850 2023-11-15T01:40:10.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:10.526+0000 7f229ffff700 1 -- 172.21.15.1:0/329919793 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f22a00671f0 con 0x7f22a0066850 2023-11-15T01:40:11.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.197+0000 7f2296ffd700 1 -- 172.21.15.1:0/329919793 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v132) v1 ==== 169+0+0 (secure 0 0 0) 0x7f22a00671f0 con 0x7f22a0066850 2023-11-15T01:40:11.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.200+0000 7f229ffff700 1 -- 172.21.15.1:0/329919793 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f228005f2a0 msgr2=0x7f2280061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:11.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.200+0000 7f229ffff700 1 --2- 172.21.15.1:0/329919793 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f228005f2a0 0x7f2280061760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f22a013a950 tx=0x7f2288008040).stop 2023-11-15T01:40:11.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.200+0000 7f229ffff700 1 -- 172.21.15.1:0/329919793 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0066850 msgr2=0x7f22a0139de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:11.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.200+0000 7f229ffff700 1 --2- 172.21.15.1:0/329919793 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0066850 0x7f22a0139de0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f2298009130 tx=0x7f2298015000).stop 2023-11-15T01:40:11.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.201+0000 7f229ffff700 1 -- 172.21.15.1:0/329919793 shutdown_connections 2023-11-15T01:40:11.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.201+0000 7f229ffff700 1 --2- 172.21.15.1:0/329919793 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f228005f2a0 0x7f2280061760 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.201+0000 7f229ffff700 1 --2- 172.21.15.1:0/329919793 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22a01375f0 0x7f22a013bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.201+0000 7f229ffff700 1 --2- 172.21.15.1:0/329919793 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0066850 0x7f22a0139de0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.201+0000 7f229ffff700 1 --2- 172.21.15.1:0/329919793 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22a0137210 0x7f22a013dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.201+0000 7f229ffff700 1 -- 172.21.15.1:0/329919793 >> 172.21.15.1:0/329919793 conn(0x7f22a0063280 msgr2=0x7f22a00bf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:11.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.201+0000 7f229ffff700 1 -- 172.21.15.1:0/329919793 shutdown_connections 2023-11-15T01:40:11.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.201+0000 7f229ffff700 1 -- 172.21.15.1:0/329919793 wait complete. 2023-11-15T01:40:11.205 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2023-11-15T01:40:11.218 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-15T01:40:11.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.340+0000 7f80ac97c700 1 Processor -- start 2023-11-15T01:40:11.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.340+0000 7f80ac97c700 1 -- start start 2023-11-15T01:40:11.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.341+0000 7f80ac97c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80a81541d0 0x7f80a81545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:11.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.341+0000 7f80ac97c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a8155830 con 0x7f80a80c8170 2023-11-15T01:40:11.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.341+0000 7f80ac97c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a8154c20 con 0x7f80a80c60d0 2023-11-15T01:40:11.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.341+0000 7f80ac97c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8158f40 con 0x7f80a81541d0 2023-11-15T01:40:11.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.341+0000 7f80a7fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f80a80c8170 0x7f80a80c9620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58570/0 (socket says 172.21.15.1:58570) 2023-11-15T01:40:11.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.341+0000 7f80a7fff700 1 -- 172.21.15.1:0/2541652935 learned_addr learned my addr 172.21.15.1:0/2541652935 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:11.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.341+0000 7f80a67fc700 1 -- 172.21.15.1:0/2541652935 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4009722119 0 0) 0x7f80a8155830 con 0x7f80a80c8170 2023-11-15T01:40:11.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.341+0000 7f80a67fc700 1 -- 172.21.15.1:0/2541652935 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80900033f0 con 0x7f80a80c8170 2023-11-15T01:40:11.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.341+0000 7f80a77fe700 1 --2- 172.21.15.1:0/2541652935 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80a81541d0 0x7f80a81545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:11.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.341+0000 7f80a67fc700 1 -- 172.21.15.1:0/2541652935 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3477552646 0 0) 0x7f80900033f0 con 0x7f80a80c8170 2023-11-15T01:40:11.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.341+0000 7f80a67fc700 1 -- 172.21.15.1:0/2541652935 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80a81541d0 msgr2=0x7f80a81545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:11.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.341+0000 7f80a67fc700 1 --2- 172.21.15.1:0/2541652935 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80a81541d0 0x7f80a81545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a67fc700 1 -- 172.21.15.1:0/2541652935 >> v1:172.21.15.141:6789/0 conn(0x7f80a80c60d0 legacy=0x7f80a80c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:11.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a67fc700 1 -- 172.21.15.1:0/2541652935 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a8154f00 con 0x7f80a80c8170 2023-11-15T01:40:11.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a67fc700 1 -- 172.21.15.1:0/2541652935 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f80a0001810 con 0x7f80a80c8170 2023-11-15T01:40:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a67fc700 1 -- 172.21.15.1:0/2541652935 >> v1:172.21.15.1:6789/0 conn(0x7f80a80c8170 legacy=0x7f80a80c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a67fc700 1 --2- 172.21.15.1:0/2541652935 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80a81541d0 0x7f8090003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a67fc700 1 --2- 172.21.15.1:0/2541652935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8090003e40 0x7f8090004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a67fc700 1 --2- 172.21.15.1:0/2541652935 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8090004b80 0x7f8090005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a67fc700 1 -- 172.21.15.1:0/2541652935 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809000b990 con 0x7f8090003e40 2023-11-15T01:40:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a67fc700 1 -- 172.21.15.1:0/2541652935 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809000bad0 con 0x7f8090004b80 2023-11-15T01:40:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a67fc700 1 -- 172.21.15.1:0/2541652935 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809000bc90 con 0x7f80a81541d0 2023-11-15T01:40:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a6ffd700 1 --2- 172.21.15.1:0/2541652935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8090003e40 0x7f8090004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a77fe700 1 --2- 172.21.15.1:0/2541652935 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80a81541d0 0x7f8090003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a7fff700 1 --2- 172.21.15.1:0/2541652935 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8090004b80 0x7f8090005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a6ffd700 1 -- 172.21.15.1:0/2541652935 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80a81541d0 msgr2=0x7f8090003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:11.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a6ffd700 1 --2- 172.21.15.1:0/2541652935 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80a81541d0 0x7f8090003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a6ffd700 1 -- 172.21.15.1:0/2541652935 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8090004b80 msgr2=0x7f8090005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:11.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a6ffd700 1 --2- 172.21.15.1:0/2541652935 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8090004b80 0x7f8090005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a6ffd700 1 -- 172.21.15.1:0/2541652935 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80900033f0 con 0x7f8090003e40 2023-11-15T01:40:11.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a7fff700 1 --2- 172.21.15.1:0/2541652935 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8090004b80 0x7f8090005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:11.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a6ffd700 1 --2- 172.21.15.1:0/2541652935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8090003e40 0x7f8090004690 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f809c001700 tx=0x7f809c007bb0).ready entity=mon.0 client_cookie=11fab7d87e90d95 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:11.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a67fc700 1 -- 172.21.15.1:0/2541652935 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c007020 con 0x7f8090003e40 2023-11-15T01:40:11.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a67fc700 1 -- 172.21.15.1:0/2541652935 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c007180 con 0x7f8090003e40 2023-11-15T01:40:11.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.342+0000 7f80a67fc700 1 -- 172.21.15.1:0/2541652935 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c007500 con 0x7f8090003e40 2023-11-15T01:40:11.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.343+0000 7f80ac97c700 1 -- 172.21.15.1:0/2541652935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8090003e40 msgr2=0x7f8090004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:11.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.343+0000 7f80ac97c700 1 --2- 172.21.15.1:0/2541652935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8090003e40 0x7f8090004690 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f809c001700 tx=0x7f809c007bb0).stop 2023-11-15T01:40:11.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.343+0000 7f80a7fff700 1 -- 172.21.15.1:0/2541652935 reap_dead start 2023-11-15T01:40:11.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.343+0000 7f80ac97c700 1 -- 172.21.15.1:0/2541652935 shutdown_connections 2023-11-15T01:40:11.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.343+0000 7f80ac97c700 1 -- 172.21.15.1:0/2541652935 >> 172.21.15.1:0/2541652935 conn(0x7f80a8069ee0 msgr2=0x7f80a806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:11.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.343+0000 7f80ac97c700 1 -- 172.21.15.1:0/2541652935 shutdown_connections 2023-11-15T01:40:11.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.343+0000 7f80ac97c700 1 -- 172.21.15.1:0/2541652935 wait complete. 2023-11-15T01:40:11.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.344+0000 7f80ac97c700 1 Processor -- start 2023-11-15T01:40:11.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.344+0000 7f80ac97c700 1 -- start start 2023-11-15T01:40:11.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80ac97c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8090003e40 0x7f80a8158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:11.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80ac97c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80a814c850 0x7f80a8159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:11.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80ac97c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f80a8167ce0 0x7f80a8168140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:11.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80ac97c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a80b0b20 con 0x7f8090003e40 2023-11-15T01:40:11.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80ac97c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a80aba20 con 0x7f80a8167ce0 2023-11-15T01:40:11.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80ac97c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8157540 con 0x7f80a814c850 2023-11-15T01:40:11.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80a77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8090003e40 0x7f80a8158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:11.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80a77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8090003e40 0x7f80a8158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55660/0 (socket says 172.21.15.1:55660) 2023-11-15T01:40:11.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80a77fe700 1 -- 172.21.15.1:0/1174605493 learned_addr learned my addr 172.21.15.1:0/1174605493 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:11.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80a6ffd700 1 --2- 172.21.15.1:0/1174605493 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80a814c850 0x7f80a8159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:11.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80a7fff700 1 --2- 172.21.15.1:0/1174605493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f80a8167ce0 0x7f80a8168140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:11.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80a77fe700 1 -- 172.21.15.1:0/1174605493 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80a814c850 msgr2=0x7f80a8159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:11.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80a77fe700 1 --2- 172.21.15.1:0/1174605493 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80a814c850 0x7f80a8159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80a77fe700 1 -- 172.21.15.1:0/1174605493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f80a8167ce0 msgr2=0x7f80a8168140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:11.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80a77fe700 1 --2- 172.21.15.1:0/1174605493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f80a8167ce0 0x7f80a8168140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.345+0000 7f80a77fe700 1 -- 172.21.15.1:0/1174605493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a8157820 con 0x7f8090003e40 2023-11-15T01:40:11.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.346+0000 7f80a77fe700 1 --2- 172.21.15.1:0/1174605493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8090003e40 0x7f80a8158f10 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f8098011a40 tx=0x7f8098009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.346+0000 7f808f7fe700 1 -- 172.21.15.1:0/1174605493 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8098009580 con 0x7f8090003e40 2023-11-15T01:40:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.346+0000 7f808f7fe700 1 -- 172.21.15.1:0/1174605493 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809800f8e0 con 0x7f8090003e40 2023-11-15T01:40:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.346+0000 7f808f7fe700 1 -- 172.21.15.1:0/1174605493 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809800fc60 con 0x7f8090003e40 2023-11-15T01:40:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.346+0000 7f80ac97c700 1 -- 172.21.15.1:0/1174605493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a80b0d70 con 0x7f8090003e40 2023-11-15T01:40:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.346+0000 7f80ac97c700 1 -- 172.21.15.1:0/1174605493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a80b1050 con 0x7f8090003e40 2023-11-15T01:40:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.347+0000 7f80ac97c700 1 -- 172.21.15.1:0/1174605493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a80475e0 con 0x7f8090003e40 2023-11-15T01:40:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.350+0000 7f808f7fe700 1 -- 172.21.15.1:0/1174605493 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8098014440 con 0x7f8090003e40 2023-11-15T01:40:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.351+0000 7f808f7fe700 1 --2- 172.21.15.1:0/1174605493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f809405f270 0x7f8094061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.351+0000 7f808f7fe700 1 -- 172.21.15.1:0/1174605493 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6323+0+0 (secure 0 0 0) 0x7f809807b100 con 0x7f8090003e40 2023-11-15T01:40:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.354+0000 7f80a6ffd700 1 --2- 172.21.15.1:0/1174605493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f809405f270 0x7f8094061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.354+0000 7f80a6ffd700 1 --2- 172.21.15.1:0/1174605493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f809405f270 0x7f8094061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f809c001010 tx=0x7f809c016000).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:11.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.355+0000 7f808f7fe700 1 -- 172.21.15.1:0/1174605493 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f809804c060 con 0x7f8090003e40 2023-11-15T01:40:11.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.533+0000 7f80ac97c700 1 -- 172.21.15.1:0/1174605493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f80a81551e0 con 0x7f8090003e40 2023-11-15T01:40:11.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.536+0000 7f808f7fe700 1 -- 172.21.15.1:0/1174605493 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f80980180a0 con 0x7f8090003e40 2023-11-15T01:40:11.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.538+0000 7f80ac97c700 1 -- 172.21.15.1:0/1174605493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f809405f270 msgr2=0x7f8094061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:11.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.538+0000 7f80ac97c700 1 --2- 172.21.15.1:0/1174605493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f809405f270 0x7f8094061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f809c001010 tx=0x7f809c016000).stop 2023-11-15T01:40:11.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.538+0000 7f80ac97c700 1 -- 172.21.15.1:0/1174605493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8090003e40 msgr2=0x7f80a8158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:11.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.538+0000 7f80ac97c700 1 --2- 172.21.15.1:0/1174605493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8090003e40 0x7f80a8158f10 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f8098011a40 tx=0x7f8098009060).stop 2023-11-15T01:40:11.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.538+0000 7f80ac97c700 1 -- 172.21.15.1:0/1174605493 shutdown_connections 2023-11-15T01:40:11.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.538+0000 7f80ac97c700 1 --2- 172.21.15.1:0/1174605493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f809405f270 0x7f8094061730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.538+0000 7f80ac97c700 1 --2- 172.21.15.1:0/1174605493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f80a8167ce0 0x7f80a8168140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.538+0000 7f80ac97c700 1 --2- 172.21.15.1:0/1174605493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8090003e40 0x7f80a8158f10 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.538+0000 7f80ac97c700 1 --2- 172.21.15.1:0/1174605493 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80a814c850 0x7f80a8159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.538+0000 7f80ac97c700 1 -- 172.21.15.1:0/1174605493 >> 172.21.15.1:0/1174605493 conn(0x7f80a8069ee0 msgr2=0x7f80a8063d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:11.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.538+0000 7f80ac97c700 1 -- 172.21.15.1:0/1174605493 shutdown_connections 2023-11-15T01:40:11.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.538+0000 7f80ac97c700 1 -- 172.21.15.1:0/1174605493 wait complete. 2023-11-15T01:40:11.551 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-15T01:40:11.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.669+0000 7f72c299a700 1 Processor -- start 2023-11-15T01:40:11.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.669+0000 7f72c299a700 1 -- start start 2023-11-15T01:40:11.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.670+0000 7f72c299a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f72bc154480 0x7f72bc0c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:11.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.670+0000 7f72c299a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f72bc0c6430 0x7f72bc0aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:11.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.670+0000 7f72c299a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72bc0ca050 con 0x7f72bc1540a0 2023-11-15T01:40:11.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.670+0000 7f72c299a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72bc0c68c0 con 0x7f72bc0c6430 2023-11-15T01:40:11.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.670+0000 7f72c299a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72bc0c9440 con 0x7f72bc154480 2023-11-15T01:40:11.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.670+0000 7f72c0f37700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f72bc0c6430 0x7f72bc0aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:11.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.670+0000 7f72c0f37700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f72bc0c6430 0x7f72bc0aaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55670/0 (socket says 172.21.15.1:55670) 2023-11-15T01:40:11.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.670+0000 7f72c0f37700 1 -- 172.21.15.1:0/3687715924 learned_addr learned my addr 172.21.15.1:0/3687715924 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:11.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.671+0000 7f72bb7fe700 1 --2- 172.21.15.1:0/3687715924 >> v2:172.21.15.141:3300/0 conn(0x7f72bc154480 0x7f72bc0c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:11.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.671+0000 7f72c0f37700 1 -- 172.21.15.1:0/3687715924 >> v2:172.21.15.141:3300/0 conn(0x7f72bc154480 msgr2=0x7f72bc0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:11.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.671+0000 7f72c0f37700 1 --2- 172.21.15.1:0/3687715924 >> v2:172.21.15.141:3300/0 conn(0x7f72bc154480 0x7f72bc0c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.671+0000 7f72c0f37700 1 -- 172.21.15.1:0/3687715924 >> v1:172.21.15.141:6789/0 conn(0x7f72bc1540a0 legacy=0x7f72bc0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.671+0000 7f72c0f37700 1 -- 172.21.15.1:0/3687715924 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc0c9720 con 0x7f72bc0c6430 2023-11-15T01:40:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.671+0000 7f72c0f37700 1 --2- 172.21.15.1:0/3687715924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72bc0c6430 0x7f72bc0aaf40 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f72bc0c88f0 tx=0x7f72b4009840).ready entity=mon.0 client_cookie=1a6a1f4bf0b14cb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.671+0000 7f72baffd700 1 -- 172.21.15.1:0/3687715924 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b400e070 con 0x7f72bc0c6430 2023-11-15T01:40:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.671+0000 7f72baffd700 1 -- 172.21.15.1:0/3687715924 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b400ba10 con 0x7f72bc0c6430 2023-11-15T01:40:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.671+0000 7f72baffd700 1 -- 172.21.15.1:0/3687715924 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b400bd90 con 0x7f72bc0c6430 2023-11-15T01:40:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.672+0000 7f72c299a700 1 -- 172.21.15.1:0/3687715924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72bc0c6430 msgr2=0x7f72bc0aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.672+0000 7f72c299a700 1 --2- 172.21.15.1:0/3687715924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72bc0c6430 0x7f72bc0aaf40 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f72bc0c88f0 tx=0x7f72b4009840).stop 2023-11-15T01:40:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.672+0000 7f72c299a700 1 -- 172.21.15.1:0/3687715924 shutdown_connections 2023-11-15T01:40:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.672+0000 7f72c299a700 1 --2- 172.21.15.1:0/3687715924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72bc0c6430 0x7f72bc0aaf40 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.672+0000 7f72c299a700 1 --2- 172.21.15.1:0/3687715924 >> v2:172.21.15.141:3300/0 conn(0x7f72bc154480 0x7f72bc0c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.672+0000 7f72c299a700 1 -- 172.21.15.1:0/3687715924 >> 172.21.15.1:0/3687715924 conn(0x7f72bc064a70 msgr2=0x7f72bc064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:11.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.672+0000 7f72c299a700 1 -- 172.21.15.1:0/3687715924 shutdown_connections 2023-11-15T01:40:11.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.672+0000 7f72c299a700 1 -- 172.21.15.1:0/3687715924 wait complete. 2023-11-15T01:40:11.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.673+0000 7f72c299a700 1 Processor -- start 2023-11-15T01:40:11.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.673+0000 7f72c299a700 1 -- start start 2023-11-15T01:40:11.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c299a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72bc0c6430 0x7f72bc14d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:11.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c299a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72bc1540a0 0x7f72bc153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:11.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c299a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72bc154480 0x7f72bc0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:11.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c299a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc150fe0 con 0x7f72bc154480 2023-11-15T01:40:11.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c299a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc0b08b0 con 0x7f72bc1540a0 2023-11-15T01:40:11.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c299a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc0afca0 con 0x7f72bc0c6430 2023-11-15T01:40:11.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c0f37700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72bc154480 0x7f72bc0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:11.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c0f37700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72bc154480 0x7f72bc0c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55686/0 (socket says 172.21.15.1:55686) 2023-11-15T01:40:11.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c0f37700 1 -- 172.21.15.1:0/1271403259 learned_addr learned my addr 172.21.15.1:0/1271403259 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:11.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72bb7fe700 1 --2- 172.21.15.1:0/1271403259 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72bc1540a0 0x7f72bc153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:11.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72bbfff700 1 --2- 172.21.15.1:0/1271403259 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72bc0c6430 0x7f72bc14d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c0f37700 1 -- 172.21.15.1:0/1271403259 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72bc0c6430 msgr2=0x7f72bc14d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c0f37700 1 --2- 172.21.15.1:0/1271403259 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72bc0c6430 0x7f72bc14d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c0f37700 1 -- 172.21.15.1:0/1271403259 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72bc1540a0 msgr2=0x7f72bc153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c0f37700 1 --2- 172.21.15.1:0/1271403259 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72bc1540a0 0x7f72bc153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c0f37700 1 -- 172.21.15.1:0/1271403259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4009ae0 con 0x7f72bc154480 2023-11-15T01:40:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72bb7fe700 1 --2- 172.21.15.1:0/1271403259 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72bc1540a0 0x7f72bc153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c0f37700 1 --2- 172.21.15.1:0/1271403259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72bc154480 0x7f72bc0c42c0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f72b4009fd0 tx=0x7f72b4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72b3fff700 1 -- 172.21.15.1:0/1271403259 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b40092e0 con 0x7f72bc154480 2023-11-15T01:40:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72b3fff700 1 -- 172.21.15.1:0/1271403259 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b401d410 con 0x7f72bc154480 2023-11-15T01:40:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c299a700 1 -- 172.21.15.1:0/1271403259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72bc0aff80 con 0x7f72bc154480 2023-11-15T01:40:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72b3fff700 1 -- 172.21.15.1:0/1271403259 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b401d790 con 0x7f72bc154480 2023-11-15T01:40:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.674+0000 7f72c299a700 1 -- 172.21.15.1:0/1271403259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72bc0b0540 con 0x7f72bc154480 2023-11-15T01:40:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.676+0000 7f72c299a700 1 -- 172.21.15.1:0/1271403259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72bc0b0a40 con 0x7f72bc154480 2023-11-15T01:40:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.676+0000 7f72b3fff700 1 -- 172.21.15.1:0/1271403259 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f72b401dbc0 con 0x7f72bc154480 2023-11-15T01:40:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.676+0000 7f72b3fff700 1 --2- 172.21.15.1:0/1271403259 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f729c05f270 0x7f729c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.676+0000 7f72b3fff700 1 -- 172.21.15.1:0/1271403259 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6323+0+0 (secure 0 0 0) 0x7f72b407c240 con 0x7f72bc154480 2023-11-15T01:40:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.677+0000 7f72bbfff700 1 --2- 172.21.15.1:0/1271403259 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f729c05f270 0x7f729c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.677+0000 7f72bbfff700 1 --2- 172.21.15.1:0/1271403259 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f729c05f270 0x7f729c061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f72a40036e0 tx=0x7f72a4009040).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.681+0000 7f72b3fff700 1 -- 172.21.15.1:0/1271403259 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f72b404d2c0 con 0x7f72bc154480 2023-11-15T01:40:11.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.859+0000 7f72c299a700 1 -- 172.21.15.1:0/1271403259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f72bc0b0a40 con 0x7f72bc154480 2023-11-15T01:40:11.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.863+0000 7f72b3fff700 1 -- 172.21.15.1:0/1271403259 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v25) v1 ==== 120+0+0 (secure 0 0 0) 0x7f72b40508e0 con 0x7f72bc154480 2023-11-15T01:40:11.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.865+0000 7f72c299a700 1 -- 172.21.15.1:0/1271403259 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f729c05f270 msgr2=0x7f729c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:11.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.865+0000 7f72c299a700 1 --2- 172.21.15.1:0/1271403259 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f729c05f270 0x7f729c061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f72a40036e0 tx=0x7f72a4009040).stop 2023-11-15T01:40:11.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.865+0000 7f72c299a700 1 -- 172.21.15.1:0/1271403259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72bc154480 msgr2=0x7f72bc0c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:11.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.865+0000 7f72c299a700 1 --2- 172.21.15.1:0/1271403259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72bc154480 0x7f72bc0c42c0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f72b4009fd0 tx=0x7f72b4009840).stop 2023-11-15T01:40:11.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.865+0000 7f72c299a700 1 -- 172.21.15.1:0/1271403259 shutdown_connections 2023-11-15T01:40:11.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.865+0000 7f72c299a700 1 --2- 172.21.15.1:0/1271403259 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f729c05f270 0x7f729c061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.865+0000 7f72c299a700 1 --2- 172.21.15.1:0/1271403259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72bc154480 0x7f72bc0c42c0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.865+0000 7f72c299a700 1 --2- 172.21.15.1:0/1271403259 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72bc0c6430 0x7f72bc14d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.865+0000 7f72c299a700 1 --2- 172.21.15.1:0/1271403259 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72bc1540a0 0x7f72bc153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:11.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.865+0000 7f72c299a700 1 -- 172.21.15.1:0/1271403259 >> 172.21.15.1:0/1271403259 conn(0x7f72bc064a70 msgr2=0x7f72bc0acf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:11.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.865+0000 7f72c299a700 1 -- 172.21.15.1:0/1271403259 shutdown_connections 2023-11-15T01:40:11.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.865+0000 7f72c299a700 1 -- 172.21.15.1:0/1271403259 wait complete. 2023-11-15T01:40:11.879 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-11-15T01:40:11.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.996+0000 7fea1e1cc700 1 Processor -- start 2023-11-15T01:40:11.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.996+0000 7fea1e1cc700 1 -- start start 2023-11-15T01:40:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.996+0000 7fea1e1cc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fea180c6620 0x7fea18154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.996+0000 7fea1e1cc700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180c06f0 con 0x7fea18154150 2023-11-15T01:40:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.996+0000 7fea1e1cc700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180c09d0 con 0x7fea180ab1a0 2023-11-15T01:40:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.996+0000 7fea1e1cc700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea18158820 con 0x7fea180c6620 2023-11-15T01:40:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.997+0000 7fea17fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fea180c6620 0x7fea18154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:12.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.997+0000 7fea177fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fea18154150 0x7fea18158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58576/0 (socket says 172.21.15.1:58576) 2023-11-15T01:40:12.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.997+0000 7fea177fe700 1 -- 172.21.15.1:0/418094306 learned_addr learned my addr 172.21.15.1:0/418094306 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:12.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.997+0000 7fea17fff700 1 -- 172.21.15.1:0/418094306 >> v1:172.21.15.141:6789/0 conn(0x7fea180ab1a0 legacy=0x7fea180c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:12.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.997+0000 7fea17fff700 1 -- 172.21.15.1:0/418094306 >> v1:172.21.15.1:6789/0 conn(0x7fea18154150 legacy=0x7fea18158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:12.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.997+0000 7fea167fc700 1 -- 172.21.15.1:0/418094306 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065958907 0 0) 0x7fea180c06f0 con 0x7fea18154150 2023-11-15T01:40:12.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.997+0000 7fea17fff700 1 -- 172.21.15.1:0/418094306 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea18158b00 con 0x7fea180c6620 2023-11-15T01:40:12.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.997+0000 7fea17fff700 1 --2- 172.21.15.1:0/418094306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea180c6620 0x7fea18154530 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fea10009760 tx=0x7fea10009060).ready entity=mon.0 client_cookie=22d539f8ae4d925c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:12.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.997+0000 7fea167fc700 1 -- 172.21.15.1:0/418094306 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10009120 con 0x7fea180c6620 2023-11-15T01:40:12.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.997+0000 7fea167fc700 1 -- 172.21.15.1:0/418094306 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1000b580 con 0x7fea180c6620 2023-11-15T01:40:12.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.997+0000 7fea167fc700 1 -- 172.21.15.1:0/418094306 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1000b900 con 0x7fea180c6620 2023-11-15T01:40:12.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.998+0000 7fea1e1cc700 1 -- 172.21.15.1:0/418094306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea180c6620 msgr2=0x7fea18154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:12.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.998+0000 7fea1e1cc700 1 --2- 172.21.15.1:0/418094306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea180c6620 0x7fea18154530 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fea10009760 tx=0x7fea10009060).stop 2023-11-15T01:40:12.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.998+0000 7fea1e1cc700 1 -- 172.21.15.1:0/418094306 shutdown_connections 2023-11-15T01:40:12.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.998+0000 7fea1e1cc700 1 --2- 172.21.15.1:0/418094306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea180c6620 0x7fea18154530 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:12.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.998+0000 7fea1e1cc700 1 -- 172.21.15.1:0/418094306 >> 172.21.15.1:0/418094306 conn(0x7fea18064aa0 msgr2=0x7fea18064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:12.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.998+0000 7fea1e1cc700 1 -- 172.21.15.1:0/418094306 shutdown_connections 2023-11-15T01:40:12.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.998+0000 7fea1e1cc700 1 -- 172.21.15.1:0/418094306 wait complete. 2023-11-15T01:40:12.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.999+0000 7fea1e1cc700 1 Processor -- start 2023-11-15T01:40:12.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:11.999+0000 7fea1e1cc700 1 -- start start 2023-11-15T01:40:12.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea1e1cc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea180ab1a0 0x7fea18147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:12.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea1e1cc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea180c6620 0x7fea18152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:12.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea1e1cc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea18154150 0x7fea180aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:12.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea1e1cc700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18151a20 con 0x7fea180ab1a0 2023-11-15T01:40:12.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea1e1cc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18151d00 con 0x7fea180c6620 2023-11-15T01:40:12.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea1e1cc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea18151fe0 con 0x7fea18154150 2023-11-15T01:40:12.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea177fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea180ab1a0 0x7fea18147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:12.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea177fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea180ab1a0 0x7fea18147ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55708/0 (socket says 172.21.15.1:55708) 2023-11-15T01:40:12.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea177fe700 1 -- 172.21.15.1:0/2752705034 learned_addr learned my addr 172.21.15.1:0/2752705034 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:12.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea16ffd700 1 --2- 172.21.15.1:0/2752705034 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea180c6620 0x7fea18152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:12.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea17fff700 1 --2- 172.21.15.1:0/2752705034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea18154150 0x7fea180aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:12.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea177fe700 1 -- 172.21.15.1:0/2752705034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea18154150 msgr2=0x7fea180aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:12.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea177fe700 1 --2- 172.21.15.1:0/2752705034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea18154150 0x7fea180aef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:12.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea177fe700 1 -- 172.21.15.1:0/2752705034 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea180c6620 msgr2=0x7fea18152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:12.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea177fe700 1 --2- 172.21.15.1:0/2752705034 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea180c6620 0x7fea18152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:12.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea177fe700 1 -- 172.21.15.1:0/2752705034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea100092a0 con 0x7fea180ab1a0 2023-11-15T01:40:12.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea16ffd700 1 --2- 172.21.15.1:0/2752705034 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea180c6620 0x7fea18152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:12.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.000+0000 7fea177fe700 1 --2- 172.21.15.1:0/2752705034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea180ab1a0 0x7fea18147ed0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fea0800c760 tx=0x7fea08001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:12.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.001+0000 7fea0f7fe700 1 -- 172.21.15.1:0/2752705034 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08005d30 con 0x7fea180ab1a0 2023-11-15T01:40:12.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.001+0000 7fea0f7fe700 1 -- 172.21.15.1:0/2752705034 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea08005e90 con 0x7fea180ab1a0 2023-11-15T01:40:12.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.001+0000 7fea0f7fe700 1 -- 172.21.15.1:0/2752705034 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08007320 con 0x7fea180ab1a0 2023-11-15T01:40:12.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.001+0000 7fea1e1cc700 1 -- 172.21.15.1:0/2752705034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea181522c0 con 0x7fea180ab1a0 2023-11-15T01:40:12.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.001+0000 7fea1e1cc700 1 -- 172.21.15.1:0/2752705034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea181483c0 con 0x7fea180ab1a0 2023-11-15T01:40:12.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.002+0000 7fea1e1cc700 1 -- 172.21.15.1:0/2752705034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea181527e0 con 0x7fea180ab1a0 2023-11-15T01:40:12.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.002+0000 7fea0f7fe700 1 -- 172.21.15.1:0/2752705034 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fea08007750 con 0x7fea180ab1a0 2023-11-15T01:40:12.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.002+0000 7fea0f7fe700 1 --2- 172.21.15.1:0/2752705034 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe9f805f270 0x7fe9f8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:12.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.003+0000 7fea0f7fe700 1 -- 172.21.15.1:0/2752705034 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6323+0+0 (secure 0 0 0) 0x7fea0807a4c0 con 0x7fea180ab1a0 2023-11-15T01:40:12.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.003+0000 7fea16ffd700 1 --2- 172.21.15.1:0/2752705034 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe9f805f270 0x7fe9f8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:12.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.003+0000 7fea16ffd700 1 --2- 172.21.15.1:0/2752705034 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe9f805f270 0x7fe9f8061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fea18157ca0 tx=0x7fea00009040).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:12.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.007+0000 7fea0f7fe700 1 -- 172.21.15.1:0/2752705034 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fea181527e0 con 0x7fea180ab1a0 2023-11-15T01:40:12.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:12.246+0000 7fea1e1cc700 1 -- 172.21.15.1:0/2752705034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7fea181527e0 con 0x7fea180ab1a0 2023-11-15T01:40:13.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.202+0000 7fea0f7fe700 1 -- 172.21.15.1:0/2752705034 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v695) v1 ==== 148+0+0 (secure 0 0 0) 0x7fea0804b540 con 0x7fea180ab1a0 2023-11-15T01:40:13.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.204+0000 7fea1e1cc700 1 -- 172.21.15.1:0/2752705034 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe9f805f270 msgr2=0x7fe9f8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:13.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.204+0000 7fea1e1cc700 1 --2- 172.21.15.1:0/2752705034 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe9f805f270 0x7fe9f8061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fea18157ca0 tx=0x7fea00009040).stop 2023-11-15T01:40:13.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.204+0000 7fea1e1cc700 1 -- 172.21.15.1:0/2752705034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea180ab1a0 msgr2=0x7fea18147ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:13.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.204+0000 7fea1e1cc700 1 --2- 172.21.15.1:0/2752705034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea180ab1a0 0x7fea18147ed0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fea0800c760 tx=0x7fea08001520).stop 2023-11-15T01:40:13.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.204+0000 7fea1e1cc700 1 -- 172.21.15.1:0/2752705034 shutdown_connections 2023-11-15T01:40:13.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.204+0000 7fea1e1cc700 1 --2- 172.21.15.1:0/2752705034 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe9f805f270 0x7fe9f8061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:13.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.204+0000 7fea1e1cc700 1 --2- 172.21.15.1:0/2752705034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea18154150 0x7fea180aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:13.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.204+0000 7fea1e1cc700 1 --2- 172.21.15.1:0/2752705034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea180ab1a0 0x7fea18147ed0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:13.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.204+0000 7fea1e1cc700 1 --2- 172.21.15.1:0/2752705034 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea180c6620 0x7fea18152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:13.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.204+0000 7fea1e1cc700 1 -- 172.21.15.1:0/2752705034 >> 172.21.15.1:0/2752705034 conn(0x7fea18064aa0 msgr2=0x7fea180ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:13.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.204+0000 7fea1e1cc700 1 -- 172.21.15.1:0/2752705034 shutdown_connections 2023-11-15T01:40:13.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.204+0000 7fea1e1cc700 1 -- 172.21.15.1:0/2752705034 wait complete. 2023-11-15T01:40:13.221 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-11-15T01:40:13.221 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that number of snaps retained are as per user spec. 2023-11-15T01:40:13.221 INFO:tasks.cephfs_test_runner:test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-15T01:40:13.222 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-11-15T01:40:13.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.347+0000 7f891539a700 1 Processor -- start 2023-11-15T01:40:13.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.347+0000 7f891539a700 1 -- start start 2023-11-15T01:40:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.347+0000 7f891539a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8910150c20 0x7f89100bcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.347+0000 7f891539a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89100c28d0 con 0x7f8910150840 2023-11-15T01:40:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.347+0000 7f891539a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8910069ab0 con 0x7f89100bd200 2023-11-15T01:40:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.347+0000 7f891539a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f891006a650 con 0x7f8910150c20 2023-11-15T01:40:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890effd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8910150840 0x7f8910069f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58582/0 (socket says 172.21.15.1:58582) 2023-11-15T01:40:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890effd700 1 -- 172.21.15.1:0/1816394293 learned_addr learned my addr 172.21.15.1:0/1816394293 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890dffb700 1 -- 172.21.15.1:0/1816394293 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963246339 0 0) 0x7f89100c28d0 con 0x7f8910150840 2023-11-15T01:40:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890dffb700 1 -- 172.21.15.1:0/1816394293 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88fc004500 con 0x7f8910150840 2023-11-15T01:40:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890e7fc700 1 --2- 172.21.15.1:0/1816394293 >> v2:172.21.15.141:3300/0 conn(0x7f8910150c20 0x7f89100bcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890dffb700 1 -- 172.21.15.1:0/1816394293 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3786192996 0 0) 0x7f88fc004500 con 0x7f8910150840 2023-11-15T01:40:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890dffb700 1 -- 172.21.15.1:0/1816394293 >> v2:172.21.15.141:3300/0 conn(0x7f8910150c20 msgr2=0x7f89100bcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890dffb700 1 --2- 172.21.15.1:0/1816394293 >> v2:172.21.15.141:3300/0 conn(0x7f8910150c20 0x7f89100bcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890dffb700 1 -- 172.21.15.1:0/1816394293 >> v1:172.21.15.141:6789/0 conn(0x7f89100bd200 legacy=0x7f89100c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890dffb700 1 -- 172.21.15.1:0/1816394293 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89100bd650 con 0x7f8910150840 2023-11-15T01:40:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890dffb700 1 -- 172.21.15.1:0/1816394293 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f89080015f0 con 0x7f8910150840 2023-11-15T01:40:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890e7fc700 1 --2- 172.21.15.1:0/1816394293 >> v2:172.21.15.141:3300/0 conn(0x7f8910150c20 0x7f89100bcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890dffb700 1 -- 172.21.15.1:0/1816394293 >> v1:172.21.15.1:6789/0 conn(0x7f8910150840 legacy=0x7f8910069f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890dffb700 1 --2- 172.21.15.1:0/1816394293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88fc0049f0 0x7f88fc004e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890dffb700 1 --2- 172.21.15.1:0/1816394293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88fc0057a0 0x7f88fc005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:13.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890dffb700 1 --2- 172.21.15.1:0/1816394293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f88fc006160 0x7f88fc00c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:13.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890dffb700 1 -- 172.21.15.1:0/1816394293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891006a650 con 0x7f88fc0057a0 2023-11-15T01:40:13.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890dffb700 1 -- 172.21.15.1:0/1816394293 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc00d040 con 0x7f88fc0049f0 2023-11-15T01:40:13.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890dffb700 1 -- 172.21.15.1:0/1816394293 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc00d200 con 0x7f88fc006160 2023-11-15T01:40:13.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890e7fc700 1 --2- 172.21.15.1:0/1816394293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88fc0057a0 0x7f88fc005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:13.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.348+0000 7f890effd700 1 --2- 172.21.15.1:0/1816394293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88fc0049f0 0x7f88fc004e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:13.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f890f7fe700 1 --2- 172.21.15.1:0/1816394293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f88fc006160 0x7f88fc00c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:13.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f890e7fc700 1 -- 172.21.15.1:0/1816394293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f88fc006160 msgr2=0x7f88fc00c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:13.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f890e7fc700 1 --2- 172.21.15.1:0/1816394293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f88fc006160 0x7f88fc00c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:13.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f890e7fc700 1 -- 172.21.15.1:0/1816394293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88fc0049f0 msgr2=0x7f88fc004e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:13.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f890e7fc700 1 --2- 172.21.15.1:0/1816394293 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88fc0049f0 0x7f88fc004e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:13.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f890e7fc700 1 -- 172.21.15.1:0/1816394293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc004500 con 0x7f88fc0057a0 2023-11-15T01:40:13.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f890f7fe700 1 -- 172.21.15.1:0/1816394293 reap_dead start 2023-11-15T01:40:13.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f890e7fc700 1 --2- 172.21.15.1:0/1816394293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88fc0057a0 0x7f88fc005c20 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f88f800bad0 tx=0x7f88f8008040).ready entity=mon.0 client_cookie=c80badd74d58a2d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:13.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f890dffb700 1 -- 172.21.15.1:0/1816394293 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f800b410 con 0x7f88fc0057a0 2023-11-15T01:40:13.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f890dffb700 1 -- 172.21.15.1:0/1816394293 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f800d5d0 con 0x7f88fc0057a0 2023-11-15T01:40:13.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f890dffb700 1 -- 172.21.15.1:0/1816394293 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f800d950 con 0x7f88fc0057a0 2023-11-15T01:40:13.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f891539a700 1 -- 172.21.15.1:0/1816394293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88fc0057a0 msgr2=0x7f88fc005c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:13.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f891539a700 1 --2- 172.21.15.1:0/1816394293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88fc0057a0 0x7f88fc005c20 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f88f800bad0 tx=0x7f88f8008040).stop 2023-11-15T01:40:13.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f891539a700 1 -- 172.21.15.1:0/1816394293 shutdown_connections 2023-11-15T01:40:13.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f891539a700 1 --2- 172.21.15.1:0/1816394293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88fc0057a0 0x7f88fc005c20 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:13.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f891539a700 1 -- 172.21.15.1:0/1816394293 >> 172.21.15.1:0/1816394293 conn(0x7f89100627b0 msgr2=0x7f8910062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:13.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.349+0000 7f891539a700 1 -- 172.21.15.1:0/1816394293 shutdown_connections 2023-11-15T01:40:13.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.350+0000 7f891539a700 1 -- 172.21.15.1:0/1816394293 wait complete. 2023-11-15T01:40:13.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.351+0000 7f891539a700 1 Processor -- start 2023-11-15T01:40:13.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.351+0000 7f891539a700 1 -- start start 2023-11-15T01:40:13.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f891539a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88fc0057a0 0x7f8910151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:13.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f891539a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f89101631d0 0x7f891014aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:13.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f891539a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89100a7c40 0x7f89100a80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:13.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f891539a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8910152670 con 0x7f89100a7c40 2023-11-15T01:40:13.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f891539a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89100a68e0 con 0x7f88fc0057a0 2023-11-15T01:40:13.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f891539a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891014afa0 con 0x7f89101631d0 2023-11-15T01:40:13.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f890f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89100a7c40 0x7f89100a80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:13.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f890f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89100a7c40 0x7f89100a80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55730/0 (socket says 172.21.15.1:55730) 2023-11-15T01:40:13.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f890f7fe700 1 -- 172.21.15.1:0/1162500987 learned_addr learned my addr 172.21.15.1:0/1162500987 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:13.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f890effd700 1 --2- 172.21.15.1:0/1162500987 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88fc0057a0 0x7f8910151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:13.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f890e7fc700 1 --2- 172.21.15.1:0/1162500987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f89101631d0 0x7f891014aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:13.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f890f7fe700 1 -- 172.21.15.1:0/1162500987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f89101631d0 msgr2=0x7f891014aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:13.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f890f7fe700 1 --2- 172.21.15.1:0/1162500987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f89101631d0 0x7f891014aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:13.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f890f7fe700 1 -- 172.21.15.1:0/1162500987 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88fc0057a0 msgr2=0x7f8910151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:13.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f890f7fe700 1 --2- 172.21.15.1:0/1162500987 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88fc0057a0 0x7f8910151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:13.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f890f7fe700 1 -- 172.21.15.1:0/1162500987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8910163650 con 0x7f89100a7c40 2023-11-15T01:40:13.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f890f7fe700 1 --2- 172.21.15.1:0/1162500987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89100a7c40 0x7f89100a80c0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f89100acef0 tx=0x7f8900009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:13.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f8906ffd700 1 -- 172.21.15.1:0/1162500987 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89000030d0 con 0x7f89100a7c40 2023-11-15T01:40:13.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f8906ffd700 1 -- 172.21.15.1:0/1162500987 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8900003230 con 0x7f89100a7c40 2023-11-15T01:40:13.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f891539a700 1 -- 172.21.15.1:0/1162500987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8910151dd0 con 0x7f89100a7c40 2023-11-15T01:40:13.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f8906ffd700 1 -- 172.21.15.1:0/1162500987 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8900001790 con 0x7f89100a7c40 2023-11-15T01:40:13.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.352+0000 7f891539a700 1 -- 172.21.15.1:0/1162500987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8910152390 con 0x7f89100a7c40 2023-11-15T01:40:13.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.353+0000 7f891539a700 1 -- 172.21.15.1:0/1162500987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f891006c7e0 con 0x7f89100a7c40 2023-11-15T01:40:13.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.354+0000 7f8906ffd700 1 -- 172.21.15.1:0/1162500987 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8900001b80 con 0x7f89100a7c40 2023-11-15T01:40:13.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.354+0000 7f8906ffd700 1 --2- 172.21.15.1:0/1162500987 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f88f005f270 0x7f88f0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:13.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.354+0000 7f8906ffd700 1 -- 172.21.15.1:0/1162500987 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6323+0+0 (secure 0 0 0) 0x7f8900079420 con 0x7f89100a7c40 2023-11-15T01:40:13.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.354+0000 7f890effd700 1 --2- 172.21.15.1:0/1162500987 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f88f005f270 0x7f88f0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:13.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.355+0000 7f890effd700 1 --2- 172.21.15.1:0/1162500987 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f88f005f270 0x7f88f0061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8908002e70 tx=0x7f8908009040).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:13.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.358+0000 7f8906ffd700 1 -- 172.21.15.1:0/1162500987 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f890004a4a0 con 0x7f89100a7c40 2023-11-15T01:40:13.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:13.599+0000 7f891539a700 1 -- 172.21.15.1:0/1162500987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7f89100a6a20 con 0x7f89100a7c40 2023-11-15T01:40:14.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.203+0000 7f8906ffd700 1 -- 172.21.15.1:0/1162500987 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v696) v1 ==== 181+0+0 (secure 0 0 0) 0x7f890004dac0 con 0x7f89100a7c40 2023-11-15T01:40:14.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.205+0000 7f891539a700 1 -- 172.21.15.1:0/1162500987 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f88f005f270 msgr2=0x7f88f0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:14.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.205+0000 7f891539a700 1 --2- 172.21.15.1:0/1162500987 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f88f005f270 0x7f88f0061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8908002e70 tx=0x7f8908009040).stop 2023-11-15T01:40:14.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.205+0000 7f891539a700 1 -- 172.21.15.1:0/1162500987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89100a7c40 msgr2=0x7f89100a80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:14.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.205+0000 7f891539a700 1 --2- 172.21.15.1:0/1162500987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89100a7c40 0x7f89100a80c0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f89100acef0 tx=0x7f8900009040).stop 2023-11-15T01:40:14.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.206+0000 7f891539a700 1 -- 172.21.15.1:0/1162500987 shutdown_connections 2023-11-15T01:40:14.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.206+0000 7f891539a700 1 --2- 172.21.15.1:0/1162500987 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f88f005f270 0x7f88f0061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.206+0000 7f891539a700 1 --2- 172.21.15.1:0/1162500987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89100a7c40 0x7f89100a80c0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.206+0000 7f891539a700 1 --2- 172.21.15.1:0/1162500987 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88fc0057a0 0x7f8910151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.206+0000 7f891539a700 1 --2- 172.21.15.1:0/1162500987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f89101631d0 0x7f891014aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.206+0000 7f891539a700 1 -- 172.21.15.1:0/1162500987 >> 172.21.15.1:0/1162500987 conn(0x7f89100627b0 msgr2=0x7f8910065330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:14.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.206+0000 7f891539a700 1 -- 172.21.15.1:0/1162500987 shutdown_connections 2023-11-15T01:40:14.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.206+0000 7f891539a700 1 -- 172.21.15.1:0/1162500987 wait complete. 2023-11-15T01:40:14.222 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-15T01:40:14.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.347+0000 7f6612a5f700 1 Processor -- start 2023-11-15T01:40:14.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.347+0000 7f6612a5f700 1 -- start start 2023-11-15T01:40:14.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.348+0000 7f6612a5f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f660c1545b0 0x7f660c0c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:14.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.348+0000 7f6612a5f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f660c0c7f50 0x7f660c0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:14.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.348+0000 7f6612a5f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660c155830 con 0x7f660c1541d0 2023-11-15T01:40:14.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.348+0000 7f6612a5f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660c158f40 con 0x7f660c0c7f50 2023-11-15T01:40:14.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.348+0000 7f6612a5f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c154a30 con 0x7f660c1545b0 2023-11-15T01:40:14.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.348+0000 7f661225e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f660c0c7f50 0x7f660c0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:14.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.348+0000 7f6611a5d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f660c1541d0 0x7f660c0c60d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58592/0 (socket says 172.21.15.1:58592) 2023-11-15T01:40:14.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.348+0000 7f6611a5d700 1 -- 172.21.15.1:0/3069071300 learned_addr learned my addr 172.21.15.1:0/3069071300 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:14.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.348+0000 7f661125c700 1 --2- 172.21.15.1:0/3069071300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f660c1545b0 0x7f660c0c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:14.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.348+0000 7f661225e700 1 -- 172.21.15.1:0/3069071300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f660c1545b0 msgr2=0x7f660c0c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:14.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.348+0000 7f661225e700 1 --2- 172.21.15.1:0/3069071300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f660c1545b0 0x7f660c0c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.348+0000 7f661225e700 1 -- 172.21.15.1:0/3069071300 >> v1:172.21.15.1:6789/0 conn(0x7f660c1541d0 legacy=0x7f660c0c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:14.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.348+0000 7f6610a5b700 1 -- 172.21.15.1:0/3069071300 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692171984 0 0) 0x7f660c155830 con 0x7f660c1541d0 2023-11-15T01:40:14.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.348+0000 7f661225e700 1 -- 172.21.15.1:0/3069071300 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c0c83a0 con 0x7f660c0c7f50 2023-11-15T01:40:14.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.349+0000 7f661225e700 1 --2- 172.21.15.1:0/3069071300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c0c7f50 0x7f660c0c9620 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f6604009e60 tx=0x7f6604009780).ready entity=mon.0 client_cookie=a8af9039998fd757 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:14.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.349+0000 7f6610a5b700 1 -- 172.21.15.1:0/3069071300 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660400e070 con 0x7f660c0c7f50 2023-11-15T01:40:14.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.349+0000 7f6610a5b700 1 -- 172.21.15.1:0/3069071300 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660400bb60 con 0x7f660c0c7f50 2023-11-15T01:40:14.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.349+0000 7f6610a5b700 1 -- 172.21.15.1:0/3069071300 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604012410 con 0x7f660c0c7f50 2023-11-15T01:40:14.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.349+0000 7f6612a5f700 1 -- 172.21.15.1:0/3069071300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c0c7f50 msgr2=0x7f660c0c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:14.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.349+0000 7f6612a5f700 1 --2- 172.21.15.1:0/3069071300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c0c7f50 0x7f660c0c9620 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f6604009e60 tx=0x7f6604009780).stop 2023-11-15T01:40:14.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.349+0000 7f6612a5f700 1 -- 172.21.15.1:0/3069071300 shutdown_connections 2023-11-15T01:40:14.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.349+0000 7f6612a5f700 1 --2- 172.21.15.1:0/3069071300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c0c7f50 0x7f660c0c9620 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.349+0000 7f6612a5f700 1 --2- 172.21.15.1:0/3069071300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f660c1545b0 0x7f660c0c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.349+0000 7f6612a5f700 1 -- 172.21.15.1:0/3069071300 >> 172.21.15.1:0/3069071300 conn(0x7f660c069ee0 msgr2=0x7f660c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:14.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.349+0000 7f6612a5f700 1 -- 172.21.15.1:0/3069071300 shutdown_connections 2023-11-15T01:40:14.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.349+0000 7f6612a5f700 1 -- 172.21.15.1:0/3069071300 wait complete. 2023-11-15T01:40:14.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.350+0000 7f6612a5f700 1 Processor -- start 2023-11-15T01:40:14.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.351+0000 7f6612a5f700 1 -- start start 2023-11-15T01:40:14.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.351+0000 7f6612a5f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f660c0c7f50 0x7f660c14cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:14.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.351+0000 7f6612a5f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c1541d0 0x7f660c155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:14.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.351+0000 7f6612a5f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f660c1545b0 0x7f660c0b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:14.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.351+0000 7f6612a5f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c0afd00 con 0x7f660c1541d0 2023-11-15T01:40:14.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.351+0000 7f6612a5f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c0af0f0 con 0x7f660c1545b0 2023-11-15T01:40:14.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.351+0000 7f6612a5f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c0af3d0 con 0x7f660c0c7f50 2023-11-15T01:40:14.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.351+0000 7f661125c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c1541d0 0x7f660c155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:14.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.351+0000 7f661125c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c1541d0 0x7f660c155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55758/0 (socket says 172.21.15.1:55758) 2023-11-15T01:40:14.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.351+0000 7f661125c700 1 -- 172.21.15.1:0/1351010513 learned_addr learned my addr 172.21.15.1:0/1351010513 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:14.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.352+0000 7f661125c700 1 -- 172.21.15.1:0/1351010513 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f660c0c7f50 msgr2=0x7f660c14cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:14.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.352+0000 7f661125c700 1 --2- 172.21.15.1:0/1351010513 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f660c0c7f50 0x7f660c14cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:14.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.352+0000 7f661125c700 1 -- 172.21.15.1:0/1351010513 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f660c1545b0 msgr2=0x7f660c0b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:14.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.352+0000 7f661125c700 1 --2- 172.21.15.1:0/1351010513 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f660c1545b0 0x7f660c0b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:14.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.352+0000 7f661125c700 1 -- 172.21.15.1:0/1351010513 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6604009a20 con 0x7f660c1541d0 2023-11-15T01:40:14.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.352+0000 7f661125c700 1 --2- 172.21.15.1:0/1351010513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c1541d0 0x7f660c155b10 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f65fc00e950 tx=0x7f65fc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:14.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.352+0000 7f6601ffb700 1 -- 172.21.15.1:0/1351010513 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc00c850 con 0x7f660c1541d0 2023-11-15T01:40:14.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.352+0000 7f6601ffb700 1 -- 172.21.15.1:0/1351010513 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc00c9b0 con 0x7f660c1541d0 2023-11-15T01:40:14.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.352+0000 7f6612a5f700 1 -- 172.21.15.1:0/1351010513 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660c0af6b0 con 0x7f660c1541d0 2023-11-15T01:40:14.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.352+0000 7f6601ffb700 1 -- 172.21.15.1:0/1351010513 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc00cd30 con 0x7f660c1541d0 2023-11-15T01:40:14.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.352+0000 7f6612a5f700 1 -- 172.21.15.1:0/1351010513 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660c0b0e60 con 0x7f660c1541d0 2023-11-15T01:40:14.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.353+0000 7f6612a5f700 1 -- 172.21.15.1:0/1351010513 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660c0475e0 con 0x7f660c1541d0 2023-11-15T01:40:14.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.353+0000 7f6601ffb700 1 -- 172.21.15.1:0/1351010513 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f65fc012600 con 0x7f660c1541d0 2023-11-15T01:40:14.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.354+0000 7f6601ffb700 1 --2- 172.21.15.1:0/1351010513 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65f005f270 0x7f65f0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:14.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.354+0000 7f6601ffb700 1 -- 172.21.15.1:0/1351010513 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6323+0+0 (secure 0 0 0) 0x7f65fc07aa40 con 0x7f660c1541d0 2023-11-15T01:40:14.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.354+0000 7f6611a5d700 1 --2- 172.21.15.1:0/1351010513 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65f005f270 0x7f65f0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:14.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.354+0000 7f6611a5d700 1 --2- 172.21.15.1:0/1351010513 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65f005f270 0x7f65f0061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f66080011e0 tx=0x7f6608007850).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:14.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.358+0000 7f6601ffb700 1 -- 172.21.15.1:0/1351010513 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f65fc04bac0 con 0x7f660c1541d0 2023-11-15T01:40:14.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.530+0000 7f6612a5f700 1 -- 172.21.15.1:0/1351010513 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f660c154c20 con 0x7f660c1541d0 2023-11-15T01:40:14.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.533+0000 7f6601ffb700 1 -- 172.21.15.1:0/1351010513 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f65fc016020 con 0x7f660c1541d0 2023-11-15T01:40:14.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.535+0000 7f6612a5f700 1 -- 172.21.15.1:0/1351010513 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65f005f270 msgr2=0x7f65f0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:14.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.535+0000 7f6612a5f700 1 --2- 172.21.15.1:0/1351010513 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65f005f270 0x7f65f0061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f66080011e0 tx=0x7f6608007850).stop 2023-11-15T01:40:14.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.535+0000 7f6612a5f700 1 -- 172.21.15.1:0/1351010513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c1541d0 msgr2=0x7f660c155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:14.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.535+0000 7f6612a5f700 1 --2- 172.21.15.1:0/1351010513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c1541d0 0x7f660c155b10 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f65fc00e950 tx=0x7f65fc009060).stop 2023-11-15T01:40:14.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.535+0000 7f6612a5f700 1 -- 172.21.15.1:0/1351010513 shutdown_connections 2023-11-15T01:40:14.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.535+0000 7f6612a5f700 1 --2- 172.21.15.1:0/1351010513 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65f005f270 0x7f65f0061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.535+0000 7f6612a5f700 1 --2- 172.21.15.1:0/1351010513 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f660c1545b0 0x7f660c0b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:14.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.535+0000 7f6612a5f700 1 --2- 172.21.15.1:0/1351010513 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f660c0c7f50 0x7f660c14cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:14.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.535+0000 7f6612a5f700 1 --2- 172.21.15.1:0/1351010513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f660c1541d0 0x7f660c155b10 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.535+0000 7f6612a5f700 1 -- 172.21.15.1:0/1351010513 >> 172.21.15.1:0/1351010513 conn(0x7f660c069ee0 msgr2=0x7f660c0aa3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:14.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.535+0000 7f6612a5f700 1 -- 172.21.15.1:0/1351010513 shutdown_connections 2023-11-15T01:40:14.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.535+0000 7f6612a5f700 1 -- 172.21.15.1:0/1351010513 wait complete. 2023-11-15T01:40:14.549 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T01:40:14.549 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:40:14.589 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T01:40:14.636 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T01:40:14.636 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-15T01:40:14.637 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:40:14.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.753+0000 7f1e8cdbe700 1 Processor -- start 2023-11-15T01:40:14.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.753+0000 7f1e8cdbe700 1 -- start start 2023-11-15T01:40:14.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.754+0000 7f1e8cdbe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1e880ab1a0 0x7f1e88154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:14.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.754+0000 7f1e8cdbe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1e880aa060 0x7f1e880c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:14.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.754+0000 7f1e8cdbe700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880c06f0 con 0x7f1e88154150 2023-11-15T01:40:14.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.754+0000 7f1e8cdbe700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e880c09d0 con 0x7f1e880aa060 2023-11-15T01:40:14.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.754+0000 7f1e8cdbe700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e88158820 con 0x7f1e880ab1a0 2023-11-15T01:40:14.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.754+0000 7f1e86d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1e880aa060 0x7f1e880c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:14.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.755+0000 7f1e86d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1e880aa060 0x7f1e880c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55774/0 (socket says 172.21.15.1:55774) 2023-11-15T01:40:14.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.755+0000 7f1e86d9d700 1 -- 172.21.15.1:0/1361329575 learned_addr learned my addr 172.21.15.1:0/1361329575 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:14.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.755+0000 7f1e85d9b700 1 --2- 172.21.15.1:0/1361329575 >> v2:172.21.15.141:3300/0 conn(0x7f1e880ab1a0 0x7f1e88154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:14.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.755+0000 7f1e86d9d700 1 -- 172.21.15.1:0/1361329575 >> v2:172.21.15.141:3300/0 conn(0x7f1e880ab1a0 msgr2=0x7f1e88154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:14.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.755+0000 7f1e86d9d700 1 --2- 172.21.15.1:0/1361329575 >> v2:172.21.15.141:3300/0 conn(0x7f1e880ab1a0 0x7f1e88154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.755+0000 7f1e86d9d700 1 -- 172.21.15.1:0/1361329575 >> v1:172.21.15.141:6789/0 conn(0x7f1e88154150 legacy=0x7f1e88158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:14.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.755+0000 7f1e86d9d700 1 -- 172.21.15.1:0/1361329575 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e88158b00 con 0x7f1e880aa060 2023-11-15T01:40:14.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.755+0000 7f1e86d9d700 1 --2- 172.21.15.1:0/1361329575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e880aa060 0x7f1e880c5f10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f1e88158750 tx=0x7f1e800090f0).ready entity=mon.0 client_cookie=c2534f5a4db355d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:14.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.755+0000 7f1e8559a700 1 -- 172.21.15.1:0/1361329575 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8000b600 con 0x7f1e880aa060 2023-11-15T01:40:14.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.755+0000 7f1e8559a700 1 -- 172.21.15.1:0/1361329575 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8000b760 con 0x7f1e880aa060 2023-11-15T01:40:14.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.755+0000 7f1e8559a700 1 -- 172.21.15.1:0/1361329575 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8000bb00 con 0x7f1e880aa060 2023-11-15T01:40:14.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.756+0000 7f1e8cdbe700 1 -- 172.21.15.1:0/1361329575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e880aa060 msgr2=0x7f1e880c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:14.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.756+0000 7f1e8cdbe700 1 --2- 172.21.15.1:0/1361329575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e880aa060 0x7f1e880c5f10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f1e88158750 tx=0x7f1e800090f0).stop 2023-11-15T01:40:14.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.756+0000 7f1e8cdbe700 1 -- 172.21.15.1:0/1361329575 shutdown_connections 2023-11-15T01:40:14.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.756+0000 7f1e8cdbe700 1 --2- 172.21.15.1:0/1361329575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e880aa060 0x7f1e880c5f10 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.756+0000 7f1e8cdbe700 1 --2- 172.21.15.1:0/1361329575 >> v2:172.21.15.141:3300/0 conn(0x7f1e880ab1a0 0x7f1e88154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.756+0000 7f1e8cdbe700 1 -- 172.21.15.1:0/1361329575 >> 172.21.15.1:0/1361329575 conn(0x7f1e88064aa0 msgr2=0x7f1e88064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:14.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.756+0000 7f1e8cdbe700 1 -- 172.21.15.1:0/1361329575 shutdown_connections 2023-11-15T01:40:14.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.756+0000 7f1e8cdbe700 1 -- 172.21.15.1:0/1361329575 wait complete. 2023-11-15T01:40:14.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.757+0000 7f1e8cdbe700 1 Processor -- start 2023-11-15T01:40:14.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.757+0000 7f1e8cdbe700 1 -- start start 2023-11-15T01:40:14.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e8cdbe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e880aa060 0x7f1e8813cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:14.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e8cdbe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e880ab1a0 0x7f1e880c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:14.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e8cdbe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e88154150 0x7f1e880c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:14.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e8cdbe700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880c4b30 con 0x7f1e88154150 2023-11-15T01:40:14.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e8cdbe700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880b0590 con 0x7f1e880aa060 2023-11-15T01:40:14.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e8cdbe700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880b0870 con 0x7f1e880ab1a0 2023-11-15T01:40:14.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e86d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e88154150 0x7f1e880c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:14.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e86d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e88154150 0x7f1e880c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55790/0 (socket says 172.21.15.1:55790) 2023-11-15T01:40:14.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e86d9d700 1 -- 172.21.15.1:0/2858418325 learned_addr learned my addr 172.21.15.1:0/2858418325 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:14.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e8659c700 1 --2- 172.21.15.1:0/2858418325 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e880aa060 0x7f1e8813cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:14.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e85d9b700 1 --2- 172.21.15.1:0/2858418325 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e880ab1a0 0x7f1e880c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:14.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e86d9d700 1 -- 172.21.15.1:0/2858418325 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e880ab1a0 msgr2=0x7f1e880c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:14.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e86d9d700 1 --2- 172.21.15.1:0/2858418325 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e880ab1a0 0x7f1e880c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e86d9d700 1 -- 172.21.15.1:0/2858418325 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e880aa060 msgr2=0x7f1e8813cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:14.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e86d9d700 1 --2- 172.21.15.1:0/2858418325 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e880aa060 0x7f1e8813cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e86d9d700 1 -- 172.21.15.1:0/2858418325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e80009370 con 0x7f1e88154150 2023-11-15T01:40:14.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e85d9b700 1 --2- 172.21.15.1:0/2858418325 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e880ab1a0 0x7f1e880c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:14.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e86d9d700 1 --2- 172.21.15.1:0/2858418325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e88154150 0x7f1e880c4640 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f1e80006fd0 tx=0x7f1e80017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:14.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e7e7fc700 1 -- 172.21.15.1:0/2858418325 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80006d90 con 0x7f1e88154150 2023-11-15T01:40:14.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e7e7fc700 1 -- 172.21.15.1:0/2858418325 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8000bec0 con 0x7f1e88154150 2023-11-15T01:40:14.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e8cdbe700 1 -- 172.21.15.1:0/2858418325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e880b0b50 con 0x7f1e88154150 2023-11-15T01:40:14.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e7e7fc700 1 -- 172.21.15.1:0/2858418325 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800246a0 con 0x7f1e88154150 2023-11-15T01:40:14.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.758+0000 7f1e8cdbe700 1 -- 172.21.15.1:0/2858418325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8813d150 con 0x7f1e88154150 2023-11-15T01:40:14.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.759+0000 7f1e8cdbe700 1 -- 172.21.15.1:0/2858418325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8806c7e0 con 0x7f1e88154150 2023-11-15T01:40:14.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.760+0000 7f1e7e7fc700 1 -- 172.21.15.1:0/2858418325 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1e80021070 con 0x7f1e88154150 2023-11-15T01:40:14.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.760+0000 7f1e7e7fc700 1 --2- 172.21.15.1:0/2858418325 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e6805f270 0x7f1e68061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:14.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.760+0000 7f1e7e7fc700 1 -- 172.21.15.1:0/2858418325 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6323+0+0 (secure 0 0 0) 0x7f1e8007c000 con 0x7f1e88154150 2023-11-15T01:40:14.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.760+0000 7f1e8659c700 1 --2- 172.21.15.1:0/2858418325 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e6805f270 0x7f1e68061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:14.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.761+0000 7f1e8659c700 1 --2- 172.21.15.1:0/2858418325 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e6805f270 0x7f1e68061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1e78004290 tx=0x7f1e780014c0).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:14.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.764+0000 7f1e7e7fc700 1 -- 172.21.15.1:0/2858418325 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1e8004d080 con 0x7f1e88154150 2023-11-15T01:40:14.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.982+0000 7f1e8cdbe700 1 -- 172.21.15.1:0/2858418325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e880c02a0 con 0x7f1e88154150 2023-11-15T01:40:14.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.982+0000 7f1e7e7fc700 1 -- 172.21.15.1:0/2858418325 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f1e80029070 con 0x7f1e88154150 2023-11-15T01:40:14.984 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:14.984 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6680,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/1281640724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1281640724},{"type":"v1","addr":"172.21.15.141:6837","nonce":1281640724}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7614,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/3754341822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3754341822},{"type":"v1","addr":"172.21.15.1:6834","nonce":3754341822}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7617,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2242100060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":2242100060},{"type":"v1","addr":"172.21.15.1:6835","nonce":2242100060}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7626,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/1053521790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":1053521790},{"type":"v1","addr":"172.21.15.141:6836","nonce":1053521790}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[]} 2023-11-15T01:40:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.984+0000 7f1e8cdbe700 1 -- 172.21.15.1:0/2858418325 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e6805f270 msgr2=0x7f1e68061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.984+0000 7f1e8cdbe700 1 --2- 172.21.15.1:0/2858418325 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e6805f270 0x7f1e68061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1e78004290 tx=0x7f1e780014c0).stop 2023-11-15T01:40:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.984+0000 7f1e8cdbe700 1 -- 172.21.15.1:0/2858418325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e88154150 msgr2=0x7f1e880c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.984+0000 7f1e8cdbe700 1 --2- 172.21.15.1:0/2858418325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e88154150 0x7f1e880c4640 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f1e80006fd0 tx=0x7f1e80017000).stop 2023-11-15T01:40:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.984+0000 7f1e8cdbe700 1 -- 172.21.15.1:0/2858418325 shutdown_connections 2023-11-15T01:40:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.984+0000 7f1e8cdbe700 1 --2- 172.21.15.1:0/2858418325 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1e6805f270 0x7f1e68061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.984+0000 7f1e8cdbe700 1 --2- 172.21.15.1:0/2858418325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e88154150 0x7f1e880c4640 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.984+0000 7f1e8cdbe700 1 --2- 172.21.15.1:0/2858418325 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e880aa060 0x7f1e8813cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.984+0000 7f1e8cdbe700 1 --2- 172.21.15.1:0/2858418325 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e880ab1a0 0x7f1e880c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.984+0000 7f1e8cdbe700 1 -- 172.21.15.1:0/2858418325 >> 172.21.15.1:0/2858418325 conn(0x7f1e88064aa0 msgr2=0x7f1e880c9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.984+0000 7f1e8cdbe700 1 -- 172.21.15.1:0/2858418325 shutdown_connections 2023-11-15T01:40:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:14.984+0000 7f1e8cdbe700 1 -- 172.21.15.1:0/2858418325 wait complete. 2023-11-15T01:40:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 57 2023-11-15T01:40:14.998 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-15T01:40:14.998 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-15T01:40:14.998 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-15T01:40:14.998 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:40:14.999 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-15T01:40:14.999 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-15T01:40:14.999 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-15T01:40:15.000 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:40:15.000 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-15T01:40:15.000 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-15T01:40:15.000 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-15T01:40:15.001 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:40:15.001 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-15T01:40:15.001 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-15T01:40:15.002 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-15T01:40:15.002 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T01:40:15.009 INFO:tasks.ceph.mds.a:Stopped 2023-11-15T01:40:15.009 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-15T01:40:15.010 INFO:tasks.ceph.mds.c:Stopped 2023-11-15T01:40:15.011 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-15T01:40:15.012 INFO:tasks.ceph.mds.b:Stopped 2023-11-15T01:40:15.012 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-15T01:40:15.013 INFO:tasks.ceph.mds.d:Stopped 2023-11-15T01:40:15.013 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-15T01:40:15.051 INFO:tasks.ceph.mds.a:Started 2023-11-15T01:40:15.052 DEBUG:teuthology.parallel:result is None 2023-11-15T01:40:15.053 INFO:tasks.ceph.mds.c:Started 2023-11-15T01:40:15.053 DEBUG:teuthology.parallel:result is None 2023-11-15T01:40:15.056 INFO:tasks.ceph.mds.b:Started 2023-11-15T01:40:15.056 DEBUG:teuthology.parallel:result is None 2023-11-15T01:40:15.057 INFO:tasks.ceph.mds.d:Started 2023-11-15T01:40:15.057 DEBUG:teuthology.parallel:result is None 2023-11-15T01:40:15.058 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-15T01:40:15.126 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T01:40:15.126 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-11-15T01:40:15.138 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-15T01:40:15.139 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T01:40:15.139 INFO:tasks.ceph.mds.d.smithi141.stderr:2023-11-15T01:40:15.139+0000 7f226667c700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-11-15T01:40:15.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.184+0000 7f09916c1700 1 Processor -- start 2023-11-15T01:40:15.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.184+0000 7f09916c1700 1 -- start start 2023-11-15T01:40:15.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.185+0000 7f09916c1700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f098c0aa700 0x7f098c15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:15.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.185+0000 7f09916c1700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c158ff0 con 0x7f098c154250 2023-11-15T01:40:15.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.185+0000 7f09916c1700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c158100 con 0x7f098c154630 2023-11-15T01:40:15.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.185+0000 7f09916c1700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c1583e0 con 0x7f098c0aa700 2023-11-15T01:40:15.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.185+0000 7f098affd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f098c154250 0x7f098c0c6110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58612/0 (socket says 172.21.15.1:58612) 2023-11-15T01:40:15.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.185+0000 7f098affd700 1 -- 172.21.15.1:0/1649056505 learned_addr learned my addr 172.21.15.1:0/1649056505 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:15.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.185+0000 7f098b7fe700 1 --2- 172.21.15.1:0/1649056505 >> v2:172.21.15.141:3300/0 conn(0x7f098c0aa700 0x7f098c15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:15.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.185+0000 7f0989ffb700 1 -- 172.21.15.1:0/1649056505 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921680880 0 0) 0x7f098c158ff0 con 0x7f098c154250 2023-11-15T01:40:15.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.185+0000 7f0989ffb700 1 -- 172.21.15.1:0/1649056505 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09740033f0 con 0x7f098c154250 2023-11-15T01:40:15.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.185+0000 7f0989ffb700 1 -- 172.21.15.1:0/1649056505 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903663062 0 0) 0x7f098c158100 con 0x7f098c154630 2023-11-15T01:40:15.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.185+0000 7f0989ffb700 1 -- 172.21.15.1:0/1649056505 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f098c158ff0 con 0x7f098c154630 2023-11-15T01:40:15.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.185+0000 7f0989ffb700 1 -- 172.21.15.1:0/1649056505 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2860776191 0 0) 0x7f09740033f0 con 0x7f098c154250 2023-11-15T01:40:15.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.185+0000 7f098b7fe700 1 -- 172.21.15.1:0/1649056505 >> v1:172.21.15.141:6789/0 conn(0x7f098c154630 legacy=0x7f098c0a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:15.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.185+0000 7f098b7fe700 1 -- 172.21.15.1:0/1649056505 >> v1:172.21.15.1:6789/0 conn(0x7f098c154250 legacy=0x7f098c0c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:15.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.185+0000 7f098b7fe700 1 -- 172.21.15.1:0/1649056505 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c1586c0 con 0x7f098c0aa700 2023-11-15T01:40:15.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.186+0000 7f098b7fe700 1 --2- 172.21.15.1:0/1649056505 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f098c0aa700 0x7f098c15f4a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f0984009e60 tx=0x7f0984009780).ready entity=mon.1 client_cookie=f57618f3e2ebe073 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:15.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.186+0000 7f0989ffb700 1 -- 172.21.15.1:0/1649056505 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098400e070 con 0x7f098c0aa700 2023-11-15T01:40:15.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.186+0000 7f0989ffb700 1 -- 172.21.15.1:0/1649056505 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098400b7a0 con 0x7f098c0aa700 2023-11-15T01:40:15.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.186+0000 7f0989ffb700 1 -- 172.21.15.1:0/1649056505 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c001470 con 0x7f098c0aa700 2023-11-15T01:40:15.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.186+0000 7f09916c1700 1 -- 172.21.15.1:0/1649056505 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f098c0aa700 msgr2=0x7f098c15f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:15.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.186+0000 7f09916c1700 1 --2- 172.21.15.1:0/1649056505 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f098c0aa700 0x7f098c15f4a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f0984009e60 tx=0x7f0984009780).stop 2023-11-15T01:40:15.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.186+0000 7f09916c1700 1 -- 172.21.15.1:0/1649056505 shutdown_connections 2023-11-15T01:40:15.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.186+0000 7f09916c1700 1 --2- 172.21.15.1:0/1649056505 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f098c0aa700 0x7f098c15f4a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:15.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.186+0000 7f09916c1700 1 -- 172.21.15.1:0/1649056505 >> 172.21.15.1:0/1649056505 conn(0x7f098c0c7b20 msgr2=0x7f098c0c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:15.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.186+0000 7f09916c1700 1 -- 172.21.15.1:0/1649056505 shutdown_connections 2023-11-15T01:40:15.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.186+0000 7f09916c1700 1 -- 172.21.15.1:0/1649056505 wait complete. 2023-11-15T01:40:15.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.188+0000 7f09916c1700 1 Processor -- start 2023-11-15T01:40:15.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.188+0000 7f09916c1700 1 -- start start 2023-11-15T01:40:15.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.188+0000 7f09916c1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f098c0aa700 0x7f098c0c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:15.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.188+0000 7f09916c1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f098c154250 0x7f098c147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:15.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.188+0000 7f09916c1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f098c154630 0x7f098c0ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:15.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.188+0000 7f09916c1700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0c3730 con 0x7f098c154630 2023-11-15T01:40:15.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.188+0000 7f09916c1700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c148350 con 0x7f098c154250 2023-11-15T01:40:15.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.188+0000 7f09916c1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0c39a0 con 0x7f098c0aa700 2023-11-15T01:40:15.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.188+0000 7f098b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f098c154630 0x7f098c0ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:15.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.188+0000 7f098b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f098c154630 0x7f098c0ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55814/0 (socket says 172.21.15.1:55814) 2023-11-15T01:40:15.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.189+0000 7f098b7fe700 1 -- 172.21.15.1:0/1098490404 learned_addr learned my addr 172.21.15.1:0/1098490404 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:15.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.189+0000 7f098a7fc700 1 --2- 172.21.15.1:0/1098490404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f098c154250 0x7f098c147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:15.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.189+0000 7f098affd700 1 --2- 172.21.15.1:0/1098490404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f098c0aa700 0x7f098c0c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:15.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.189+0000 7f098b7fe700 1 -- 172.21.15.1:0/1098490404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f098c0aa700 msgr2=0x7f098c0c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:15.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.189+0000 7f098b7fe700 1 --2- 172.21.15.1:0/1098490404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f098c0aa700 0x7f098c0c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:15.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.189+0000 7f098b7fe700 1 -- 172.21.15.1:0/1098490404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f098c154250 msgr2=0x7f098c147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:15.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.189+0000 7f098b7fe700 1 --2- 172.21.15.1:0/1098490404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f098c154250 0x7f098c147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:15.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.189+0000 7f098b7fe700 1 -- 172.21.15.1:0/1098490404 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0984009a20 con 0x7f098c154630 2023-11-15T01:40:15.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.189+0000 7f098a7fc700 1 --2- 172.21.15.1:0/1098490404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f098c154250 0x7f098c147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:15.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.189+0000 7f098b7fe700 1 --2- 172.21.15.1:0/1098490404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f098c154630 0x7f098c0ae030 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f098c0c2080 tx=0x7f098c158f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:15.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.189+0000 7f0972ffd700 1 -- 172.21.15.1:0/1098490404 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984009460 con 0x7f098c154630 2023-11-15T01:40:15.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.189+0000 7f0972ffd700 1 -- 172.21.15.1:0/1098490404 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098401d440 con 0x7f098c154630 2023-11-15T01:40:15.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.189+0000 7f0972ffd700 1 -- 172.21.15.1:0/1098490404 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098401d7c0 con 0x7f098c154630 2023-11-15T01:40:15.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.189+0000 7f09916c1700 1 -- 172.21.15.1:0/1098490404 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098c0c3c80 con 0x7f098c154630 2023-11-15T01:40:15.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.189+0000 7f09916c1700 1 -- 172.21.15.1:0/1098490404 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c0ae520 con 0x7f098c154630 2023-11-15T01:40:15.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.190+0000 7f09916c1700 1 -- 172.21.15.1:0/1098490404 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098c06c7e0 con 0x7f098c154630 2023-11-15T01:40:15.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.190+0000 7f0972ffd700 1 -- 172.21.15.1:0/1098490404 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f098401db30 con 0x7f098c154630 2023-11-15T01:40:15.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.191+0000 7f0972ffd700 1 --2- 172.21.15.1:0/1098490404 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f097805f270 0x7f0978061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:15.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.191+0000 7f0972ffd700 1 -- 172.21.15.1:0/1098490404 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6323+0+0 (secure 0 0 0) 0x7f098407c460 con 0x7f098c154630 2023-11-15T01:40:15.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.191+0000 7f098affd700 1 --2- 172.21.15.1:0/1098490404 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f097805f270 0x7f0978061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:15.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.191+0000 7f098affd700 1 --2- 172.21.15.1:0/1098490404 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f097805f270 0x7f0978061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f097c0015a0 tx=0x7f097c000bc0).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:15.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.195+0000 7f0972ffd700 1 -- 172.21.15.1:0/1098490404 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0984050f10 con 0x7f098c154630 2023-11-15T01:40:15.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:15.384+0000 7f09916c1700 1 -- 172.21.15.1:0/1098490404 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f098c0c9030 con 0x7f098c154630 2023-11-15T01:40:16.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.208+0000 7f0972ffd700 1 -- 172.21.15.1:0/1098490404 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v137) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0984050b00 con 0x7f098c154630 2023-11-15T01:40:16.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.211+0000 7f09916c1700 1 -- 172.21.15.1:0/1098490404 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f097805f270 msgr2=0x7f0978061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:16.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.211+0000 7f09916c1700 1 --2- 172.21.15.1:0/1098490404 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f097805f270 0x7f0978061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f097c0015a0 tx=0x7f097c000bc0).stop 2023-11-15T01:40:16.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.211+0000 7f09916c1700 1 -- 172.21.15.1:0/1098490404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f098c154630 msgr2=0x7f098c0ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:16.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.211+0000 7f09916c1700 1 --2- 172.21.15.1:0/1098490404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f098c154630 0x7f098c0ae030 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f098c0c2080 tx=0x7f098c158f60).stop 2023-11-15T01:40:16.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.211+0000 7f09916c1700 1 -- 172.21.15.1:0/1098490404 shutdown_connections 2023-11-15T01:40:16.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.211+0000 7f09916c1700 1 --2- 172.21.15.1:0/1098490404 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f097805f270 0x7f0978061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.211+0000 7f09916c1700 1 --2- 172.21.15.1:0/1098490404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f098c154630 0x7f098c0ae030 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.211+0000 7f09916c1700 1 --2- 172.21.15.1:0/1098490404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f098c0aa700 0x7f098c0c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.211+0000 7f09916c1700 1 --2- 172.21.15.1:0/1098490404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f098c154250 0x7f098c147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.211+0000 7f09916c1700 1 -- 172.21.15.1:0/1098490404 >> 172.21.15.1:0/1098490404 conn(0x7f098c0c7b20 msgr2=0x7f098c0c0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:16.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.211+0000 7f09916c1700 1 -- 172.21.15.1:0/1098490404 shutdown_connections 2023-11-15T01:40:16.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.211+0000 7f09916c1700 1 -- 172.21.15.1:0/1098490404 wait complete. 2023-11-15T01:40:16.216 INFO:teuthology.orchestra.run.smithi001.stderr: removed all blocklist entries 2023-11-15T01:40:16.228 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-15T01:40:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.354+0000 7fcfae3eb700 1 Processor -- start 2023-11-15T01:40:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.354+0000 7fcfae3eb700 1 -- start start 2023-11-15T01:40:16.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.355+0000 7fcfae3eb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcfa8154150 0x7fcfa8154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:16.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.355+0000 7fcfae3eb700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fcfa80ab1a0 0x7fcfa8158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:16.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.355+0000 7fcfae3eb700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa80c06f0 con 0x7fcfa80aa060 2023-11-15T01:40:16.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.355+0000 7fcfae3eb700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa80c09d0 con 0x7fcfa8154150 2023-11-15T01:40:16.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.355+0000 7fcfae3eb700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa8158820 con 0x7fcfa80ab1a0 2023-11-15T01:40:16.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.355+0000 7fcfa7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcfa8154150 0x7fcfa8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:16.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.355+0000 7fcfa7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcfa8154150 0x7fcfa8154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55818/0 (socket says 172.21.15.1:55818) 2023-11-15T01:40:16.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.355+0000 7fcfa7fff700 1 -- 172.21.15.1:0/1161925082 learned_addr learned my addr 172.21.15.1:0/1161925082 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:16.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.356+0000 7fcfa77fe700 1 --2- 172.21.15.1:0/1161925082 >> v2:172.21.15.141:3300/0 conn(0x7fcfa80ab1a0 0x7fcfa8158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:16.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.356+0000 7fcfa7fff700 1 -- 172.21.15.1:0/1161925082 >> v2:172.21.15.141:3300/0 conn(0x7fcfa80ab1a0 msgr2=0x7fcfa8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:16.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.356+0000 7fcfa7fff700 1 --2- 172.21.15.1:0/1161925082 >> v2:172.21.15.141:3300/0 conn(0x7fcfa80ab1a0 0x7fcfa8158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.356+0000 7fcfa7fff700 1 -- 172.21.15.1:0/1161925082 >> v1:172.21.15.141:6789/0 conn(0x7fcfa80aa060 legacy=0x7fcfa80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:16.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.356+0000 7fcfa7fff700 1 -- 172.21.15.1:0/1161925082 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa8158b00 con 0x7fcfa8154150 2023-11-15T01:40:16.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.356+0000 7fcfa7fff700 1 --2- 172.21.15.1:0/1161925082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa8154150 0x7fcfa8154530 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7fcfa80c0270 tx=0x7fcf980090f0).ready entity=mon.0 client_cookie=ed5f94b606bde43b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:16.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.356+0000 7fcfa6ffd700 1 -- 172.21.15.1:0/1161925082 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9800b600 con 0x7fcfa8154150 2023-11-15T01:40:16.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.356+0000 7fcfa6ffd700 1 -- 172.21.15.1:0/1161925082 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9800b760 con 0x7fcfa8154150 2023-11-15T01:40:16.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.356+0000 7fcfa6ffd700 1 -- 172.21.15.1:0/1161925082 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9800bb00 con 0x7fcfa8154150 2023-11-15T01:40:16.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.357+0000 7fcfae3eb700 1 -- 172.21.15.1:0/1161925082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa8154150 msgr2=0x7fcfa8154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:16.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.357+0000 7fcfae3eb700 1 --2- 172.21.15.1:0/1161925082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa8154150 0x7fcfa8154530 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7fcfa80c0270 tx=0x7fcf980090f0).stop 2023-11-15T01:40:16.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.357+0000 7fcfae3eb700 1 -- 172.21.15.1:0/1161925082 shutdown_connections 2023-11-15T01:40:16.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.357+0000 7fcfae3eb700 1 --2- 172.21.15.1:0/1161925082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa8154150 0x7fcfa8154530 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.357+0000 7fcfae3eb700 1 --2- 172.21.15.1:0/1161925082 >> v2:172.21.15.141:3300/0 conn(0x7fcfa80ab1a0 0x7fcfa8158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.357+0000 7fcfae3eb700 1 -- 172.21.15.1:0/1161925082 >> 172.21.15.1:0/1161925082 conn(0x7fcfa8064aa0 msgr2=0x7fcfa8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:16.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.357+0000 7fcfae3eb700 1 -- 172.21.15.1:0/1161925082 shutdown_connections 2023-11-15T01:40:16.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.357+0000 7fcfae3eb700 1 -- 172.21.15.1:0/1161925082 wait complete. 2023-11-15T01:40:16.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.358+0000 7fcfae3eb700 1 Processor -- start 2023-11-15T01:40:16.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.358+0000 7fcfae3eb700 1 -- start start 2023-11-15T01:40:16.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfae3eb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa80aa060 0x7fcfa8168b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:16.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfae3eb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa80ab1a0 0x7fcfa814ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:16.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfae3eb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfa8154150 0x7fcfa80ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:16.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfae3eb700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80ac2b0 con 0x7fcfa80ab1a0 2023-11-15T01:40:16.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfae3eb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa8169070 con 0x7fcfa8154150 2023-11-15T01:40:16.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfae3eb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80ab6a0 con 0x7fcfa80aa060 2023-11-15T01:40:16.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfa77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa80ab1a0 0x7fcfa814ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:16.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfa77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa80ab1a0 0x7fcfa814ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55820/0 (socket says 172.21.15.1:55820) 2023-11-15T01:40:16.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfa77fe700 1 -- 172.21.15.1:0/848357369 learned_addr learned my addr 172.21.15.1:0/848357369 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:16.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfa7fff700 1 --2- 172.21.15.1:0/848357369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa80aa060 0x7fcfa8168b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:16.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfac988700 1 --2- 172.21.15.1:0/848357369 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfa8154150 0x7fcfa80ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:16.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfa77fe700 1 -- 172.21.15.1:0/848357369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa80aa060 msgr2=0x7fcfa8168b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:16.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfa77fe700 1 --2- 172.21.15.1:0/848357369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa80aa060 0x7fcfa8168b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfa77fe700 1 -- 172.21.15.1:0/848357369 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfa8154150 msgr2=0x7fcfa80ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:16.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfa77fe700 1 --2- 172.21.15.1:0/848357369 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfa8154150 0x7fcfa80ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfa77fe700 1 -- 172.21.15.1:0/848357369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf98009370 con 0x7fcfa80ab1a0 2023-11-15T01:40:16.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.359+0000 7fcfa77fe700 1 --2- 172.21.15.1:0/848357369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa80ab1a0 0x7fcfa814ece0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7fcf9c00d890 tx=0x7fcf9c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:16.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.360+0000 7fcf8ffff700 1 -- 172.21.15.1:0/848357369 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c011590 con 0x7fcfa80ab1a0 2023-11-15T01:40:16.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.360+0000 7fcf8ffff700 1 -- 172.21.15.1:0/848357369 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c0116f0 con 0x7fcfa80ab1a0 2023-11-15T01:40:16.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.360+0000 7fcfae3eb700 1 -- 172.21.15.1:0/848357369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa80ab980 con 0x7fcfa80ab1a0 2023-11-15T01:40:16.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.360+0000 7fcf8ffff700 1 -- 172.21.15.1:0/848357369 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c011a70 con 0x7fcfa80ab1a0 2023-11-15T01:40:16.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.360+0000 7fcfae3eb700 1 -- 172.21.15.1:0/848357369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa80abf40 con 0x7fcfa80ab1a0 2023-11-15T01:40:16.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.361+0000 7fcfae3eb700 1 -- 172.21.15.1:0/848357369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa80ac420 con 0x7fcfa80ab1a0 2023-11-15T01:40:16.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.361+0000 7fcf8ffff700 1 -- 172.21.15.1:0/848357369 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcf9c012420 con 0x7fcfa80ab1a0 2023-11-15T01:40:16.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.361+0000 7fcf8ffff700 1 --2- 172.21.15.1:0/848357369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf9405f270 0x7fcf94061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:16.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.361+0000 7fcf8ffff700 1 -- 172.21.15.1:0/848357369 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fcf9c079bf0 con 0x7fcfa80ab1a0 2023-11-15T01:40:16.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.362+0000 7fcfa7fff700 1 --2- 172.21.15.1:0/848357369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf9405f270 0x7fcf94061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:16.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.362+0000 7fcfa7fff700 1 --2- 172.21.15.1:0/848357369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf9405f270 0x7fcf94061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fcf9800b3c0 tx=0x7fcf98017000).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:16.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.365+0000 7fcf8ffff700 1 -- 172.21.15.1:0/848357369 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcf9c080080 con 0x7fcfa80ab1a0 2023-11-15T01:40:16.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.604+0000 7fcfae3eb700 1 -- 172.21.15.1:0/848357369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcfa8158de0 con 0x7fcfa80ab1a0 2023-11-15T01:40:16.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.605+0000 7fcf8ffff700 1 -- 172.21.15.1:0/848357369 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fcf9c04ae70 con 0x7fcfa80ab1a0 2023-11-15T01:40:16.607 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:16.607 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T01:40:16.607 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_dump": [ 2023-11-15T01:40:16.607 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.608 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.a", 2023-11-15T01:40:16.608 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlmtf5GBAA2CojasXoquGQ9L5rKjVwTQ==", 2023-11-15T01:40:16.608 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.608 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:40:16.609 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:40:16.609 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:40:16.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:40:16.609 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.609 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.610 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.610 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.b", 2023-11-15T01:40:16.610 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl/Y5mJBAAz7iLl3kBJ8kSsyTetTZByw==", 2023-11-15T01:40:16.610 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.610 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:40:16.611 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:40:16.611 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:40:16.611 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:40:16.611 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.612 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.612 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.c", 2023-11-15T01:40:16.612 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlWTrwHxAAqLVpwNca0vAXUBFnWUN3pg==", 2023-11-15T01:40:16.612 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.613 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:40:16.613 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:40:16.613 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:40:16.613 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:40:16.613 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.614 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.614 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.d", 2023-11-15T01:40:16.614 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlVwUnKxAAhx2/mX1ljgQwJLagVpmZIA==", 2023-11-15T01:40:16.614 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.615 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:40:16.615 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:40:16.615 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:40:16.615 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:40:16.615 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.616 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.616 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.616 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.0", 2023-11-15T01:40:16.616 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDxHFRlII6rERAA/kvPPhTPHHy6pu5wSPsR/A==", 2023-11-15T01:40:16.616 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.617 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:40:16.617 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:40:16.617 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:40:16.617 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.617 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.617 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.618 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.1", 2023-11-15T01:40:16.618 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD0HFRlPkstEBAAqx31fnNonRCVh98eY6qbxQ==", 2023-11-15T01:40:16.618 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.618 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:40:16.618 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:40:16.619 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:40:16.619 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.619 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.619 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.620 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.2", 2023-11-15T01:40:16.620 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD3HFRl8e3nDRAAKigcbIo0/BFo0Qi6rV+amQ==", 2023-11-15T01:40:16.620 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.620 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:40:16.621 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:40:16.621 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:40:16.621 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.621 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.621 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.621 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.3", 2023-11-15T01:40:16.622 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD6HFRlbwDTCxAAkWv04RyNqW4p8pOqvYCS3A==", 2023-11-15T01:40:16.622 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.622 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:40:16.622 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:40:16.623 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:40:16.623 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.623 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.623 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.623 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.4", 2023-11-15T01:40:16.624 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAAHVRlTQihDxAA/HcZbSytP9qD5PsTjvJBoA==", 2023-11-15T01:40:16.624 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.624 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:40:16.624 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:40:16.624 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:40:16.625 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.625 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.625 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.625 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.5", 2023-11-15T01:40:16.625 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQADHVRlQ2hjDRAAFiI+hKubCPcZ/1AJVu1fvQ==", 2023-11-15T01:40:16.626 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.626 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:40:16.626 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:40:16.626 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:40:16.627 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.627 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.627 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.627 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.6", 2023-11-15T01:40:16.627 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAGHVRl/KEbCxAAmKTnRU4m4qNzX+SVcFY+Qw==", 2023-11-15T01:40:16.628 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.628 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:40:16.628 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:40:16.628 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:40:16.629 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.629 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.629 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.629 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.7", 2023-11-15T01:40:16.630 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAJHVRl4wOFCBAAAiGT4UPE5vSb2LjqgGgGFw==", 2023-11-15T01:40:16.630 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.630 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T01:40:16.630 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T01:40:16.630 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:40:16.631 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.631 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.631 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.631 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.0", 2023-11-15T01:40:16.632 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl2hkHLxAAxQE/Cslig6gmXR/xcVlRuw==", 2023-11-15T01:40:16.632 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.632 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:40:16.632 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow r", 2023-11-15T01:40:16.632 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-15T01:40:16.633 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.633 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.633 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.633 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.1", 2023-11-15T01:40:16.633 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRltolkNxAAXmQ4yXOlavwqKq2jFKwsYQ==", 2023-11-15T01:40:16.634 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.634 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:40:16.634 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:40:16.634 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:40:16.635 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:40:16.635 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.635 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.635 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.635 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.2", 2023-11-15T01:40:16.635 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlFrJvNBAAH97x7ERzuzpWrUALO+HvpA==", 2023-11-15T01:40:16.636 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.636 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:40:16.636 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:40:16.636 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:40:16.636 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:40:16.637 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.637 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.637 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.637 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.3", 2023-11-15T01:40:16.637 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDwHFRlko0ZARAA2RqeRJGwWns00DeWgd/9hA==", 2023-11-15T01:40:16.638 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.638 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T01:40:16.638 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T01:40:16.638 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T01:40:16.638 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T01:40:16.639 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.639 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.639 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.639 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.admin", 2023-11-15T01:40:16.639 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDuHFRlxIQDORAALrVIyQoaVSADkyv9yzMaZw==", 2023-11-15T01:40:16.640 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.640 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:40:16.640 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T01:40:16.640 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T01:40:16.640 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:40:16.641 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.641 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.641 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.641 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.x", 2023-11-15T01:40:16.641 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlnyjlFRAAjJwtxkAvJ0ZGmvOOawQseQ==", 2023-11-15T01:40:16.642 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.642 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:40:16.642 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T01:40:16.642 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:40:16.642 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.643 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:16.643 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:16.643 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.y", 2023-11-15T01:40:16.643 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl8nW3ERAA4CJQt/ZEZCJ9UaRRuEHfzw==", 2023-11-15T01:40:16.643 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T01:40:16.644 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T01:40:16.644 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T01:40:16.644 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T01:40:16.644 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.644 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:16.645 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2023-11-15T01:40:16.645 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T01:40:16.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.606+0000 7fcfae3eb700 1 -- 172.21.15.1:0/848357369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf9405f270 msgr2=0x7fcf94061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:16.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.606+0000 7fcfae3eb700 1 --2- 172.21.15.1:0/848357369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf9405f270 0x7fcf94061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fcf9800b3c0 tx=0x7fcf98017000).stop 2023-11-15T01:40:16.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.606+0000 7fcfae3eb700 1 -- 172.21.15.1:0/848357369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa80ab1a0 msgr2=0x7fcfa814ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:16.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.606+0000 7fcfae3eb700 1 --2- 172.21.15.1:0/848357369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa80ab1a0 0x7fcfa814ece0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7fcf9c00d890 tx=0x7fcf9c008040).stop 2023-11-15T01:40:16.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.606+0000 7fcfae3eb700 1 -- 172.21.15.1:0/848357369 shutdown_connections 2023-11-15T01:40:16.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.606+0000 7fcfae3eb700 1 --2- 172.21.15.1:0/848357369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf9405f270 0x7fcf94061730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.606+0000 7fcfae3eb700 1 --2- 172.21.15.1:0/848357369 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfa8154150 0x7fcfa80ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.606+0000 7fcfae3eb700 1 --2- 172.21.15.1:0/848357369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa80aa060 0x7fcfa8168b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.606+0000 7fcfae3eb700 1 --2- 172.21.15.1:0/848357369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa80ab1a0 0x7fcfa814ece0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.606+0000 7fcfae3eb700 1 -- 172.21.15.1:0/848357369 >> 172.21.15.1:0/848357369 conn(0x7fcfa8064aa0 msgr2=0x7fcfa80ad4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.607+0000 7fcfae3eb700 1 -- 172.21.15.1:0/848357369 shutdown_connections 2023-11-15T01:40:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.607+0000 7fcfae3eb700 1 -- 172.21.15.1:0/848357369 wait complete. 2023-11-15T01:40:16.649 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:40:16.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.766+0000 7fcf9255e700 1 Processor -- start 2023-11-15T01:40:16.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.766+0000 7fcf9255e700 1 -- start start 2023-11-15T01:40:16.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.767+0000 7fcf9255e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcf8c0ab1a0 0x7fcf8c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:16.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.767+0000 7fcf9255e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf8c0aa060 0x7fcf8c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:16.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.767+0000 7fcf9255e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf8c0c06f0 con 0x7fcf8c154150 2023-11-15T01:40:16.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.767+0000 7fcf9255e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8c0c09d0 con 0x7fcf8c0ab1a0 2023-11-15T01:40:16.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.767+0000 7fcf9255e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c158820 con 0x7fcf8c0aa060 2023-11-15T01:40:16.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.767+0000 7fcf8b7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcf8c0ab1a0 0x7fcf8c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:16.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.767+0000 7fcf8bfff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fcf8c154150 0x7fcf8c158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58626/0 (socket says 172.21.15.1:58626) 2023-11-15T01:40:16.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.767+0000 7fcf8bfff700 1 -- 172.21.15.1:0/1819974765 learned_addr learned my addr 172.21.15.1:0/1819974765 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:16.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf90afb700 1 --2- 172.21.15.1:0/1819974765 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf8c0aa060 0x7fcf8c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:16.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf8b7fe700 1 -- 172.21.15.1:0/1819974765 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf8c0aa060 msgr2=0x7fcf8c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:16.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf8b7fe700 1 --2- 172.21.15.1:0/1819974765 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf8c0aa060 0x7fcf8c0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf8b7fe700 1 -- 172.21.15.1:0/1819974765 >> v1:172.21.15.1:6789/0 conn(0x7fcf8c154150 legacy=0x7fcf8c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:16.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf8b7fe700 1 -- 172.21.15.1:0/1819974765 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8c158b00 con 0x7fcf8c0ab1a0 2023-11-15T01:40:16.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf8affd700 1 -- 172.21.15.1:0/1819974765 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250634377 0 0) 0x7fcf8c0c06f0 con 0x7fcf8c154150 2023-11-15T01:40:16.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf90afb700 1 --2- 172.21.15.1:0/1819974765 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf8c0aa060 0x7fcf8c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:40:16.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf8b7fe700 1 --2- 172.21.15.1:0/1819974765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf8c0ab1a0 0x7fcf8c154530 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7fcf7c009760 tx=0x7fcf7c009060).ready entity=mon.0 client_cookie=ea294f3ed381a5e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:16.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf8affd700 1 -- 172.21.15.1:0/1819974765 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0090d0 con 0x7fcf8c0ab1a0 2023-11-15T01:40:16.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf8affd700 1 -- 172.21.15.1:0/1819974765 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c00b580 con 0x7fcf8c0ab1a0 2023-11-15T01:40:16.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf8affd700 1 -- 172.21.15.1:0/1819974765 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00b900 con 0x7fcf8c0ab1a0 2023-11-15T01:40:16.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf9255e700 1 -- 172.21.15.1:0/1819974765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf8c0ab1a0 msgr2=0x7fcf8c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:16.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf9255e700 1 --2- 172.21.15.1:0/1819974765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf8c0ab1a0 0x7fcf8c154530 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7fcf7c009760 tx=0x7fcf7c009060).stop 2023-11-15T01:40:16.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf9255e700 1 -- 172.21.15.1:0/1819974765 shutdown_connections 2023-11-15T01:40:16.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf9255e700 1 --2- 172.21.15.1:0/1819974765 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf8c0aa060 0x7fcf8c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf9255e700 1 --2- 172.21.15.1:0/1819974765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf8c0ab1a0 0x7fcf8c154530 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf9255e700 1 -- 172.21.15.1:0/1819974765 >> 172.21.15.1:0/1819974765 conn(0x7fcf8c064aa0 msgr2=0x7fcf8c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:16.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.768+0000 7fcf9255e700 1 -- 172.21.15.1:0/1819974765 shutdown_connections 2023-11-15T01:40:16.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.769+0000 7fcf9255e700 1 -- 172.21.15.1:0/1819974765 wait complete. 2023-11-15T01:40:16.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.770+0000 7fcf9255e700 1 Processor -- start 2023-11-15T01:40:16.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.770+0000 7fcf9255e700 1 -- start start 2023-11-15T01:40:16.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf9255e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf8c0aa060 0x7fcf8c13dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:16.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf9255e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf8c0ab1a0 0x7fcf8c14c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:16.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf9255e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf8c154150 0x7fcf8c14e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:16.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf9255e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c0ae050 con 0x7fcf8c0aa060 2023-11-15T01:40:16.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf9255e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c0ae8b0 con 0x7fcf8c154150 2023-11-15T01:40:16.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf9255e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c0af8e0 con 0x7fcf8c0ab1a0 2023-11-15T01:40:16.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf8bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf8c0aa060 0x7fcf8c13dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:16.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf8bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf8c0aa060 0x7fcf8c13dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55838/0 (socket says 172.21.15.1:55838) 2023-11-15T01:40:16.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf8bfff700 1 -- 172.21.15.1:0/2445128459 learned_addr learned my addr 172.21.15.1:0/2445128459 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:16.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf90afb700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf8c154150 0x7fcf8c14e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:16.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf8b7fe700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf8c0ab1a0 0x7fcf8c14c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:16.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf8bfff700 1 -- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf8c0ab1a0 msgr2=0x7fcf8c14c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:16.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf8bfff700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf8c0ab1a0 0x7fcf8c14c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf8bfff700 1 -- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf8c154150 msgr2=0x7fcf8c14e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:16.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf8bfff700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf8c154150 0x7fcf8c14e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf8bfff700 1 -- 172.21.15.1:0/2445128459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c0092a0 con 0x7fcf8c0aa060 2023-11-15T01:40:16.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf8b7fe700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf8c0ab1a0 0x7fcf8c14c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:16.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf90afb700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf8c154150 0x7fcf8c14e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:16.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf8bfff700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf8c0aa060 0x7fcf8c13dac0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7fcf7400c460 tx=0x7fcf74007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:16.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf83fff700 1 -- 172.21.15.1:0/2445128459 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf740072e0 con 0x7fcf8c0aa060 2023-11-15T01:40:16.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf83fff700 1 -- 172.21.15.1:0/2445128459 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf74007440 con 0x7fcf8c0aa060 2023-11-15T01:40:16.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf83fff700 1 -- 172.21.15.1:0/2445128459 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf740057a0 con 0x7fcf8c0aa060 2023-11-15T01:40:16.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf9255e700 1 -- 172.21.15.1:0/2445128459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8c0ae260 con 0x7fcf8c0aa060 2023-11-15T01:40:16.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.771+0000 7fcf9255e700 1 -- 172.21.15.1:0/2445128459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8c13dfb0 con 0x7fcf8c0aa060 2023-11-15T01:40:16.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.772+0000 7fcf9255e700 1 -- 172.21.15.1:0/2445128459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8c06c7e0 con 0x7fcf8c0aa060 2023-11-15T01:40:16.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.773+0000 7fcf83fff700 1 -- 172.21.15.1:0/2445128459 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcf74005b90 con 0x7fcf8c0aa060 2023-11-15T01:40:16.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.773+0000 7fcf83fff700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf6c05f270 0x7fcf6c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:16.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.773+0000 7fcf83fff700 1 -- 172.21.15.1:0/2445128459 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fcf74079a20 con 0x7fcf8c0aa060 2023-11-15T01:40:16.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.773+0000 7fcf8b7fe700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf6c05f270 0x7fcf6c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:16.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.774+0000 7fcf8b7fe700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf6c05f270 0x7fcf6c061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fcf8c157c80 tx=0x7fcf7c017000).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:16.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.777+0000 7fcf83fff700 1 -- 172.21.15.1:0/2445128459 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcf7404ad00 con 0x7fcf8c0aa060 2023-11-15T01:40:16.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.949+0000 7fcf9255e700 1 -- 172.21.15.1:0/2445128459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf8c154800 con 0x7fcf8c0aa060 2023-11-15T01:40:16.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.949+0000 7fcf83fff700 1 -- 172.21.15.1:0/2445128459 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+14364 (secure 0 0 0) 0x7fcf7404e320 con 0x7fcf8c0aa060 2023-11-15T01:40:16.953 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:16.954 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":137,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:40:16.205041+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:40:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.951+0000 7fcf9255e700 1 -- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf6c05f270 msgr2=0x7fcf6c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.951+0000 7fcf9255e700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf6c05f270 0x7fcf6c061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fcf8c157c80 tx=0x7fcf7c017000).stop 2023-11-15T01:40:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.951+0000 7fcf9255e700 1 -- 172.21.15.1:0/2445128459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf8c0aa060 msgr2=0x7fcf8c13dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.951+0000 7fcf9255e700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf8c0aa060 0x7fcf8c13dac0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7fcf7400c460 tx=0x7fcf74007e90).stop 2023-11-15T01:40:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.951+0000 7fcf9255e700 1 -- 172.21.15.1:0/2445128459 shutdown_connections 2023-11-15T01:40:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.951+0000 7fcf9255e700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf6c05f270 0x7fcf6c061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.951+0000 7fcf9255e700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf8c154150 0x7fcf8c14e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.951+0000 7fcf9255e700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf8c0aa060 0x7fcf8c13dac0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.951+0000 7fcf9255e700 1 --2- 172.21.15.1:0/2445128459 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf8c0ab1a0 0x7fcf8c14c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.951+0000 7fcf9255e700 1 -- 172.21.15.1:0/2445128459 >> 172.21.15.1:0/2445128459 conn(0x7fcf8c064aa0 msgr2=0x7fcf8c0ab5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.952+0000 7fcf9255e700 1 -- 172.21.15.1:0/2445128459 shutdown_connections 2023-11-15T01:40:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:16.952+0000 7fcf9255e700 1 -- 172.21.15.1:0/2445128459 wait complete. 2023-11-15T01:40:16.965 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-15T01:40:16.966 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T01:40:17.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.085+0000 7f9e4e974700 1 Processor -- start 2023-11-15T01:40:17.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.085+0000 7f9e4e974700 1 -- start start 2023-11-15T01:40:17.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.086+0000 7f9e4e974700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9e4813bbe0 0x7f9e480c4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.086+0000 7f9e4e974700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e48156310 con 0x7f9e480661e0 2023-11-15T01:40:17.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.086+0000 7f9e4e974700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e48065a30 con 0x7f9e48062970 2023-11-15T01:40:17.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.086+0000 7f9e4e974700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4806a1c0 con 0x7f9e4813bbe0 2023-11-15T01:40:17.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.086+0000 7f9e477fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9e4813bbe0 0x7f9e480c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.086+0000 7f9e4cf11700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9e480661e0 0x7f9e480c2840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58632/0 (socket says 172.21.15.1:58632) 2023-11-15T01:40:17.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.086+0000 7f9e477fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9e4813bbe0 0x7f9e480c4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55852/0 (socket says 172.21.15.1:55852) 2023-11-15T01:40:17.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.086+0000 7f9e4cf11700 1 -- 172.21.15.1:0/3168883410 learned_addr learned my addr 172.21.15.1:0/3168883410 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:17.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.087+0000 7f9e477fe700 1 -- 172.21.15.1:0/3168883410 >> v1:172.21.15.141:6789/0 conn(0x7f9e48062970 legacy=0x7f9e4813b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.087+0000 7f9e477fe700 1 -- 172.21.15.1:0/3168883410 >> v1:172.21.15.1:6789/0 conn(0x7f9e480661e0 legacy=0x7f9e480c2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.087+0000 7f9e477fe700 1 -- 172.21.15.1:0/3168883410 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4806a460 con 0x7f9e4813bbe0 2023-11-15T01:40:17.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.087+0000 7f9e477fe700 1 --2- 172.21.15.1:0/3168883410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e4813bbe0 0x7f9e480c4360 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f9e3c009760 tx=0x7f9e3c009060).ready entity=mon.0 client_cookie=191ead99f5b72a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:17.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.087+0000 7f9e46ffd700 1 -- 172.21.15.1:0/3168883410 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c00b580 con 0x7f9e4813bbe0 2023-11-15T01:40:17.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.087+0000 7f9e46ffd700 1 -- 172.21.15.1:0/3168883410 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c00b6e0 con 0x7f9e4813bbe0 2023-11-15T01:40:17.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.087+0000 7f9e46ffd700 1 -- 172.21.15.1:0/3168883410 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c00ba60 con 0x7f9e4813bbe0 2023-11-15T01:40:17.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.088+0000 7f9e4e974700 1 -- 172.21.15.1:0/3168883410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e4813bbe0 msgr2=0x7f9e480c4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.088+0000 7f9e4e974700 1 --2- 172.21.15.1:0/3168883410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e4813bbe0 0x7f9e480c4360 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f9e3c009760 tx=0x7f9e3c009060).stop 2023-11-15T01:40:17.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.088+0000 7f9e4e974700 1 -- 172.21.15.1:0/3168883410 shutdown_connections 2023-11-15T01:40:17.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.088+0000 7f9e4e974700 1 --2- 172.21.15.1:0/3168883410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e4813bbe0 0x7f9e480c4360 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.088+0000 7f9e4e974700 1 -- 172.21.15.1:0/3168883410 >> 172.21.15.1:0/3168883410 conn(0x7f9e480c7dc0 msgr2=0x7f9e480c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:17.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.088+0000 7f9e4e974700 1 -- 172.21.15.1:0/3168883410 shutdown_connections 2023-11-15T01:40:17.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.088+0000 7f9e4e974700 1 -- 172.21.15.1:0/3168883410 wait complete. 2023-11-15T01:40:17.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.089+0000 7f9e4e974700 1 Processor -- start 2023-11-15T01:40:17.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.089+0000 7f9e4e974700 1 -- start start 2023-11-15T01:40:17.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e4e974700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9e48062970 0x7f9e480bee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e4e974700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e480661e0 0x7f9e48166cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e4e974700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e4813bbe0 0x7f9e48138e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e4e974700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e48166820 con 0x7f9e480661e0 2023-11-15T01:40:17.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e4e974700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e481664d0 con 0x7f9e48062970 2023-11-15T01:40:17.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e4e974700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e480bf6b0 con 0x7f9e4813bbe0 2023-11-15T01:40:17.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e477fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e480661e0 0x7f9e48166cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e477fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e480661e0 0x7f9e48166cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55862/0 (socket says 172.21.15.1:55862) 2023-11-15T01:40:17.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e477fe700 1 -- 172.21.15.1:0/3068008242 learned_addr learned my addr 172.21.15.1:0/3068008242 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:17.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e47fff700 1 --2- 172.21.15.1:0/3068008242 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9e48062970 0x7f9e480bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e4cf11700 1 --2- 172.21.15.1:0/3068008242 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e4813bbe0 0x7f9e48138e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e477fe700 1 -- 172.21.15.1:0/3068008242 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e4813bbe0 msgr2=0x7f9e48138e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e477fe700 1 --2- 172.21.15.1:0/3068008242 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e4813bbe0 0x7f9e48138e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e477fe700 1 -- 172.21.15.1:0/3068008242 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9e48062970 msgr2=0x7f9e480bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e477fe700 1 --2- 172.21.15.1:0/3068008242 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9e48062970 0x7f9e480bee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e477fe700 1 -- 172.21.15.1:0/3068008242 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c0092a0 con 0x7f9e480661e0 2023-11-15T01:40:17.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e477fe700 1 --2- 172.21.15.1:0/3068008242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e480661e0 0x7f9e48166cb0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f9e3c009eb0 tx=0x7f9e3c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:17.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e2ffff700 1 -- 172.21.15.1:0/3068008242 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c00b850 con 0x7f9e480661e0 2023-11-15T01:40:17.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e2ffff700 1 -- 172.21.15.1:0/3068008242 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c00b9b0 con 0x7f9e480661e0 2023-11-15T01:40:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e4e974700 1 -- 172.21.15.1:0/3068008242 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e480bf990 con 0x7f9e480661e0 2023-11-15T01:40:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.090+0000 7f9e2ffff700 1 -- 172.21.15.1:0/3068008242 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c01b620 con 0x7f9e480661e0 2023-11-15T01:40:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.091+0000 7f9e4e974700 1 -- 172.21.15.1:0/3068008242 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e480bf350 con 0x7f9e480661e0 2023-11-15T01:40:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.092+0000 7f9e4e974700 1 -- 172.21.15.1:0/3068008242 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e48155f00 con 0x7f9e480661e0 2023-11-15T01:40:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.092+0000 7f9e2ffff700 1 -- 172.21.15.1:0/3068008242 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9e3c01ba10 con 0x7f9e480661e0 2023-11-15T01:40:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.092+0000 7f9e2ffff700 1 --2- 172.21.15.1:0/3068008242 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9e3405f2a0 0x7f9e34061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.092+0000 7f9e2ffff700 1 -- 172.21.15.1:0/3068008242 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f9e3c07ba90 con 0x7f9e480661e0 2023-11-15T01:40:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.093+0000 7f9e47fff700 1 --2- 172.21.15.1:0/3068008242 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9e3405f2a0 0x7f9e34061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.093+0000 7f9e47fff700 1 --2- 172.21.15.1:0/3068008242 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9e3405f2a0 0x7f9e34061760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9e38003900 tx=0x7f9e38007d40).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:17.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.097+0000 7f9e2ffff700 1 -- 172.21.15.1:0/3068008242 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9e3c04cd70 con 0x7f9e480661e0 2023-11-15T01:40:17.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.271+0000 7f9e4e974700 1 -- 172.21.15.1:0/3068008242 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9e4806c7e0 con 0x7f9e480661e0 2023-11-15T01:40:17.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.271+0000 7f9e2ffff700 1 -- 172.21.15.1:0/3068008242 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v137) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9e3c050390 con 0x7f9e480661e0 2023-11-15T01:40:17.273 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T01:40:17.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.273+0000 7f9e4e974700 1 -- 172.21.15.1:0/3068008242 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9e3405f2a0 msgr2=0x7f9e34061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.273+0000 7f9e4e974700 1 --2- 172.21.15.1:0/3068008242 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9e3405f2a0 0x7f9e34061760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9e38003900 tx=0x7f9e38007d40).stop 2023-11-15T01:40:17.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.273+0000 7f9e4e974700 1 -- 172.21.15.1:0/3068008242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e480661e0 msgr2=0x7f9e48166cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.273+0000 7f9e4e974700 1 --2- 172.21.15.1:0/3068008242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e480661e0 0x7f9e48166cb0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f9e3c009eb0 tx=0x7f9e3c017000).stop 2023-11-15T01:40:17.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.273+0000 7f9e4e974700 1 -- 172.21.15.1:0/3068008242 shutdown_connections 2023-11-15T01:40:17.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.273+0000 7f9e4e974700 1 --2- 172.21.15.1:0/3068008242 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9e3405f2a0 0x7f9e34061760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.273+0000 7f9e4e974700 1 --2- 172.21.15.1:0/3068008242 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e4813bbe0 0x7f9e48138e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.273+0000 7f9e4e974700 1 --2- 172.21.15.1:0/3068008242 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9e48062970 0x7f9e480bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.273+0000 7f9e4e974700 1 --2- 172.21.15.1:0/3068008242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e480661e0 0x7f9e48166cb0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.273+0000 7f9e4e974700 1 -- 172.21.15.1:0/3068008242 >> 172.21.15.1:0/3068008242 conn(0x7f9e480c7dc0 msgr2=0x7f9e480bd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:17.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.274+0000 7f9e4e974700 1 -- 172.21.15.1:0/3068008242 shutdown_connections 2023-11-15T01:40:17.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.274+0000 7f9e4e974700 1 -- 172.21.15.1:0/3068008242 wait complete. 2023-11-15T01:40:17.287 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T01:40:17.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.407+0000 7f9eab8e0700 1 Processor -- start 2023-11-15T01:40:17.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.407+0000 7f9eab8e0700 1 -- start start 2023-11-15T01:40:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9eab8e0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9ea4154480 0x7f9ea40c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9eab8e0700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea40ca050 con 0x7f9ea41540a0 2023-11-15T01:40:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9eab8e0700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea40c68c0 con 0x7f9ea40c6430 2023-11-15T01:40:17.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9eab8e0700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea40c9440 con 0x7f9ea4154480 2023-11-15T01:40:17.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9ea8e7b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9ea4154480 0x7f9ea40c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9ea967c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9ea41540a0 0x7f9ea40ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58646/0 (socket says 172.21.15.1:58646) 2023-11-15T01:40:17.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9ea967c700 1 -- 172.21.15.1:0/3265570467 learned_addr learned my addr 172.21.15.1:0/3265570467 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:17.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9ea8e7b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9ea4154480 0x7f9ea40c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55870/0 (socket says 172.21.15.1:55870) 2023-11-15T01:40:17.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9ea8e7b700 1 -- 172.21.15.1:0/3265570467 >> v1:172.21.15.141:6789/0 conn(0x7f9ea40c6430 legacy=0x7f9ea40aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:17.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9ea8e7b700 1 -- 172.21.15.1:0/3265570467 >> v1:172.21.15.1:6789/0 conn(0x7f9ea41540a0 legacy=0x7f9ea40ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9ea3fff700 1 -- 172.21.15.1:0/3265570467 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901158643 0 0) 0x7f9ea40ca050 con 0x7f9ea41540a0 2023-11-15T01:40:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9ea8e7b700 1 -- 172.21.15.1:0/3265570467 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea40c9720 con 0x7f9ea4154480 2023-11-15T01:40:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9ea8e7b700 1 --2- 172.21.15.1:0/3265570467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ea4154480 0x7f9ea40c5f40 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f9e98009760 tx=0x7f9e98009060).ready entity=mon.0 client_cookie=b307c76cbb4f3157 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9ea3fff700 1 -- 172.21.15.1:0/3265570467 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800b520 con 0x7f9ea4154480 2023-11-15T01:40:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9ea3fff700 1 -- 172.21.15.1:0/3265570467 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9800b680 con 0x7f9ea4154480 2023-11-15T01:40:17.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.408+0000 7f9ea3fff700 1 -- 172.21.15.1:0/3265570467 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800ba00 con 0x7f9ea4154480 2023-11-15T01:40:17.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.409+0000 7f9eab8e0700 1 -- 172.21.15.1:0/3265570467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ea4154480 msgr2=0x7f9ea40c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.409+0000 7f9eab8e0700 1 --2- 172.21.15.1:0/3265570467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ea4154480 0x7f9ea40c5f40 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f9e98009760 tx=0x7f9e98009060).stop 2023-11-15T01:40:17.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.409+0000 7f9eab8e0700 1 -- 172.21.15.1:0/3265570467 shutdown_connections 2023-11-15T01:40:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.409+0000 7f9eab8e0700 1 --2- 172.21.15.1:0/3265570467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ea4154480 0x7f9ea40c5f40 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.409+0000 7f9eab8e0700 1 -- 172.21.15.1:0/3265570467 >> 172.21.15.1:0/3265570467 conn(0x7f9ea4064a70 msgr2=0x7f9ea4064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.409+0000 7f9eab8e0700 1 -- 172.21.15.1:0/3265570467 shutdown_connections 2023-11-15T01:40:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.409+0000 7f9eab8e0700 1 -- 172.21.15.1:0/3265570467 wait complete. 2023-11-15T01:40:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.410+0000 7f9eab8e0700 1 Processor -- start 2023-11-15T01:40:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.410+0000 7f9eab8e0700 1 -- start start 2023-11-15T01:40:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9eab8e0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ea40c6430 0x7f9ea40ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9eab8e0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ea41540a0 0x7f9ea4167da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9eab8e0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ea4154480 0x7f9ea414e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9eab8e0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea40ae590 con 0x7f9ea41540a0 2023-11-15T01:40:17.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9eab8e0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea4168cd0 con 0x7f9ea40c6430 2023-11-15T01:40:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9eab8e0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea4168710 con 0x7f9ea4154480 2023-11-15T01:40:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9ea8e7b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ea41540a0 0x7f9ea4167da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9ea8e7b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ea41540a0 0x7f9ea4167da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55880/0 (socket says 172.21.15.1:55880) 2023-11-15T01:40:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9ea8e7b700 1 -- 172.21.15.1:0/3390625137 learned_addr learned my addr 172.21.15.1:0/3390625137 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9ea967c700 1 --2- 172.21.15.1:0/3390625137 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ea40c6430 0x7f9ea40ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9ea9e7d700 1 --2- 172.21.15.1:0/3390625137 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ea4154480 0x7f9ea414e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9ea8e7b700 1 -- 172.21.15.1:0/3390625137 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ea4154480 msgr2=0x7f9ea414e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9ea8e7b700 1 --2- 172.21.15.1:0/3390625137 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ea4154480 0x7f9ea414e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9ea8e7b700 1 -- 172.21.15.1:0/3390625137 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ea40c6430 msgr2=0x7f9ea40ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9ea8e7b700 1 --2- 172.21.15.1:0/3390625137 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ea40c6430 0x7f9ea40ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.411+0000 7f9ea8e7b700 1 -- 172.21.15.1:0/3390625137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e980092a0 con 0x7f9ea41540a0 2023-11-15T01:40:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.412+0000 7f9ea9e7d700 1 --2- 172.21.15.1:0/3390625137 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ea4154480 0x7f9ea414e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.412+0000 7f9ea8e7b700 1 --2- 172.21.15.1:0/3390625137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ea41540a0 0x7f9ea4167da0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f9e98009eb0 tx=0x7f9e98017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.412+0000 7f9ea17fa700 1 -- 172.21.15.1:0/3390625137 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800b7f0 con 0x7f9ea41540a0 2023-11-15T01:40:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.412+0000 7f9ea17fa700 1 -- 172.21.15.1:0/3390625137 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9800b950 con 0x7f9ea41540a0 2023-11-15T01:40:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.412+0000 7f9eab8e0700 1 -- 172.21.15.1:0/3390625137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea41689f0 con 0x7f9ea41540a0 2023-11-15T01:40:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.412+0000 7f9ea17fa700 1 -- 172.21.15.1:0/3390625137 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9801b660 con 0x7f9ea41540a0 2023-11-15T01:40:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.412+0000 7f9eab8e0700 1 -- 172.21.15.1:0/3390625137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea40aeea0 con 0x7f9ea41540a0 2023-11-15T01:40:17.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.413+0000 7f9eab8e0700 1 -- 172.21.15.1:0/3390625137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea40ae6d0 con 0x7f9ea41540a0 2023-11-15T01:40:17.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.413+0000 7f9ea17fa700 1 -- 172.21.15.1:0/3390625137 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9e9801b9d0 con 0x7f9ea41540a0 2023-11-15T01:40:17.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.413+0000 7f9ea17fa700 1 --2- 172.21.15.1:0/3390625137 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9e9005f270 0x7f9e90061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.414+0000 7f9ea17fa700 1 -- 172.21.15.1:0/3390625137 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f9e9807bf20 con 0x7f9ea41540a0 2023-11-15T01:40:17.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.414+0000 7f9ea967c700 1 --2- 172.21.15.1:0/3390625137 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9e9005f270 0x7f9e90061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.414+0000 7f9ea967c700 1 --2- 172.21.15.1:0/3390625137 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9e9005f270 0x7f9e90061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9e9c0011e0 tx=0x7f9e9c007bb0).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:17.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.418+0000 7f9ea17fa700 1 -- 172.21.15.1:0/3390625137 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9ea40ae6d0 con 0x7f9ea41540a0 2023-11-15T01:40:17.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.587+0000 7f9eab8e0700 1 -- 172.21.15.1:0/3390625137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9ea40ae6d0 con 0x7f9ea41540a0 2023-11-15T01:40:17.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.587+0000 7f9ea17fa700 1 -- 172.21.15.1:0/3390625137 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v137) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9ea40ae6d0 con 0x7f9ea41540a0 2023-11-15T01:40:17.589 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T01:40:17.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.589+0000 7f9eab8e0700 1 -- 172.21.15.1:0/3390625137 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9e9005f270 msgr2=0x7f9e90061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.589+0000 7f9eab8e0700 1 --2- 172.21.15.1:0/3390625137 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9e9005f270 0x7f9e90061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9e9c0011e0 tx=0x7f9e9c007bb0).stop 2023-11-15T01:40:17.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.589+0000 7f9eab8e0700 1 -- 172.21.15.1:0/3390625137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ea41540a0 msgr2=0x7f9ea4167da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.589+0000 7f9eab8e0700 1 --2- 172.21.15.1:0/3390625137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ea41540a0 0x7f9ea4167da0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f9e98009eb0 tx=0x7f9e98017000).stop 2023-11-15T01:40:17.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.589+0000 7f9eab8e0700 1 -- 172.21.15.1:0/3390625137 shutdown_connections 2023-11-15T01:40:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.589+0000 7f9eab8e0700 1 --2- 172.21.15.1:0/3390625137 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9e9005f270 0x7f9e90061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.589+0000 7f9eab8e0700 1 --2- 172.21.15.1:0/3390625137 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ea4154480 0x7f9ea414e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.589+0000 7f9eab8e0700 1 --2- 172.21.15.1:0/3390625137 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ea40c6430 0x7f9ea40ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.589+0000 7f9eab8e0700 1 --2- 172.21.15.1:0/3390625137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ea41540a0 0x7f9ea4167da0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.589+0000 7f9eab8e0700 1 -- 172.21.15.1:0/3390625137 >> 172.21.15.1:0/3390625137 conn(0x7f9ea4064a70 msgr2=0x7f9ea414daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:17.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.589+0000 7f9eab8e0700 1 -- 172.21.15.1:0/3390625137 shutdown_connections 2023-11-15T01:40:17.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.589+0000 7f9eab8e0700 1 -- 172.21.15.1:0/3390625137 wait complete. 2023-11-15T01:40:17.603 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-15T01:40:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.720+0000 7f99780a9700 1 Processor -- start 2023-11-15T01:40:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.720+0000 7f99780a9700 1 -- start start 2023-11-15T01:40:17.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f99780a9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9970154450 0x7f99700a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f99780a9700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f99700be520 0x7f9970154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f99780a9700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99700a85e0 con 0x7f99700833a0 2023-11-15T01:40:17.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f99780a9700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9970065940 con 0x7f99700be520 2023-11-15T01:40:17.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f99780a9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9970065660 con 0x7f9970154450 2023-11-15T01:40:17.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f9976646700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f99700be520 0x7f9970154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f9976646700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f99700be520 0x7f9970154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59062/0 (socket says 172.21.15.1:59062) 2023-11-15T01:40:17.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f9976646700 1 -- 172.21.15.1:0/2918695306 learned_addr learned my addr 172.21.15.1:0/2918695306 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:17.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f9975e45700 1 --2- 172.21.15.1:0/2918695306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9970154450 0x7f99700a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f9976646700 1 -- 172.21.15.1:0/2918695306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9970154450 msgr2=0x7f99700a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:17.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f9976646700 1 --2- 172.21.15.1:0/2918695306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9970154450 0x7f99700a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f9976646700 1 -- 172.21.15.1:0/2918695306 >> v1:172.21.15.141:6789/0 conn(0x7f99700833a0 legacy=0x7f99700bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f9976646700 1 -- 172.21.15.1:0/2918695306 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99700c6f50 con 0x7f99700be520 2023-11-15T01:40:17.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f9976646700 1 --2- 172.21.15.1:0/2918695306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99700be520 0x7f9970154830 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f9960006fd0 tx=0x7f99600090f0).ready entity=mon.0 client_cookie=839a4794fd3c429b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:17.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f9974e43700 1 -- 172.21.15.1:0/2918695306 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996000b600 con 0x7f99700be520 2023-11-15T01:40:17.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f9974e43700 1 -- 172.21.15.1:0/2918695306 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996000b760 con 0x7f99700be520 2023-11-15T01:40:17.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.721+0000 7f9974e43700 1 -- 172.21.15.1:0/2918695306 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996000bae0 con 0x7f99700be520 2023-11-15T01:40:17.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.722+0000 7f99780a9700 1 -- 172.21.15.1:0/2918695306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99700be520 msgr2=0x7f9970154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.722+0000 7f99780a9700 1 --2- 172.21.15.1:0/2918695306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99700be520 0x7f9970154830 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f9960006fd0 tx=0x7f99600090f0).stop 2023-11-15T01:40:17.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.722+0000 7f99780a9700 1 -- 172.21.15.1:0/2918695306 shutdown_connections 2023-11-15T01:40:17.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.722+0000 7f99780a9700 1 --2- 172.21.15.1:0/2918695306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9970154450 0x7f99700a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.722+0000 7f99780a9700 1 --2- 172.21.15.1:0/2918695306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99700be520 0x7f9970154830 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.722+0000 7f99780a9700 1 -- 172.21.15.1:0/2918695306 >> 172.21.15.1:0/2918695306 conn(0x7f9970082f90 msgr2=0x7f99700c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:17.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.722+0000 7f99780a9700 1 -- 172.21.15.1:0/2918695306 shutdown_connections 2023-11-15T01:40:17.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.722+0000 7f99780a9700 1 -- 172.21.15.1:0/2918695306 wait complete. 2023-11-15T01:40:17.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.723+0000 7f99780a9700 1 Processor -- start 2023-11-15T01:40:17.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.723+0000 7f99780a9700 1 -- start start 2023-11-15T01:40:17.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f99780a9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99700833a0 0x7f99700c0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f99780a9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99700be520 0x7f99701639c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f99780a9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9970154450 0x7f9970150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f99780a9700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9970150370 con 0x7f99700be520 2023-11-15T01:40:17.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f99780a9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997014f6f0 con 0x7f99700833a0 2023-11-15T01:40:17.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f99780a9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997014f9d0 con 0x7f9970154450 2023-11-15T01:40:17.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f9975644700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99700be520 0x7f99701639c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f9975644700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99700be520 0x7f99701639c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59064/0 (socket says 172.21.15.1:59064) 2023-11-15T01:40:17.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f9975644700 1 -- 172.21.15.1:0/1075431018 learned_addr learned my addr 172.21.15.1:0/1075431018 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:17.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f9976646700 1 --2- 172.21.15.1:0/1075431018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9970154450 0x7f9970150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f9975e45700 1 --2- 172.21.15.1:0/1075431018 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99700833a0 0x7f99700c0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f9975644700 1 -- 172.21.15.1:0/1075431018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9970154450 msgr2=0x7f9970150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f9975644700 1 --2- 172.21.15.1:0/1075431018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9970154450 0x7f9970150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f9975644700 1 -- 172.21.15.1:0/1075431018 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99700833a0 msgr2=0x7f99700c0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f9975644700 1 --2- 172.21.15.1:0/1075431018 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99700833a0 0x7f99700c0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f9975644700 1 -- 172.21.15.1:0/1075431018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9960009370 con 0x7f99700be520 2023-11-15T01:40:17.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.724+0000 7f9975644700 1 --2- 172.21.15.1:0/1075431018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99700be520 0x7f99701639c0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f996400c440 tx=0x7f9964007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:17.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.725+0000 7f996dffb700 1 -- 172.21.15.1:0/1075431018 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9964007020 con 0x7f99700be520 2023-11-15T01:40:17.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.725+0000 7f996dffb700 1 -- 172.21.15.1:0/1075431018 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9964007180 con 0x7f99700be520 2023-11-15T01:40:17.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.725+0000 7f99780a9700 1 -- 172.21.15.1:0/1075431018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f997014fcb0 con 0x7f99700be520 2023-11-15T01:40:17.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.725+0000 7f996dffb700 1 -- 172.21.15.1:0/1075431018 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9964007540 con 0x7f99700be520 2023-11-15T01:40:17.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.725+0000 7f99780a9700 1 -- 172.21.15.1:0/1075431018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99700c0e50 con 0x7f99700be520 2023-11-15T01:40:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.726+0000 7f99780a9700 1 -- 172.21.15.1:0/1075431018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997006c7e0 con 0x7f99700be520 2023-11-15T01:40:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.726+0000 7f996dffb700 1 -- 172.21.15.1:0/1075431018 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f99640068b0 con 0x7f99700be520 2023-11-15T01:40:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.726+0000 7f996dffb700 1 --2- 172.21.15.1:0/1075431018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f995c05f240 0x7f995c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.726+0000 7f996dffb700 1 -- 172.21.15.1:0/1075431018 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f9964079ac0 con 0x7f99700be520 2023-11-15T01:40:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.727+0000 7f9975e45700 1 --2- 172.21.15.1:0/1075431018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f995c05f240 0x7f995c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.727+0000 7f9975e45700 1 --2- 172.21.15.1:0/1075431018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f995c05f240 0x7f995c061700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9968009fd0 tx=0x7f9968009800).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.731+0000 7f996dffb700 1 -- 172.21.15.1:0/1075431018 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f996404ada0 con 0x7f99700be520 2023-11-15T01:40:17.858 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:40:17.861 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:40:17.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.907+0000 7f99780a9700 1 -- 172.21.15.1:0/1075431018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9970065350 con 0x7f99700be520 2023-11-15T01:40:17.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.907+0000 7f996dffb700 1 -- 172.21.15.1:0/1075431018 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v137) v1 ==== 84+0+143 (secure 0 0 0) 0x7f996404e3c0 con 0x7f99700be520 2023-11-15T01:40:17.909 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:17.910 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T01:40:17.910 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:17.910 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2023-11-15T01:40:17.910 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "device_health_metrics" 2023-11-15T01:40:17.911 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T01:40:17.911 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:17.911 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 2, 2023-11-15T01:40:17.911 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "rbd" 2023-11-15T01:40:17.911 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:17.912 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T01:40:17.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.909+0000 7f99780a9700 1 -- 172.21.15.1:0/1075431018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f995c05f240 msgr2=0x7f995c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.909+0000 7f99780a9700 1 --2- 172.21.15.1:0/1075431018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f995c05f240 0x7f995c061700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9968009fd0 tx=0x7f9968009800).stop 2023-11-15T01:40:17.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.909+0000 7f99780a9700 1 -- 172.21.15.1:0/1075431018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99700be520 msgr2=0x7f99701639c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:17.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.909+0000 7f99780a9700 1 --2- 172.21.15.1:0/1075431018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99700be520 0x7f99701639c0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f996400c440 tx=0x7f9964007d40).stop 2023-11-15T01:40:17.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.910+0000 7f99780a9700 1 -- 172.21.15.1:0/1075431018 shutdown_connections 2023-11-15T01:40:17.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.910+0000 7f99780a9700 1 --2- 172.21.15.1:0/1075431018 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f995c05f240 0x7f995c061700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.910+0000 7f99780a9700 1 --2- 172.21.15.1:0/1075431018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9970154450 0x7f9970150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.910+0000 7f99780a9700 1 --2- 172.21.15.1:0/1075431018 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99700833a0 0x7f99700c0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.910+0000 7f99780a9700 1 --2- 172.21.15.1:0/1075431018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99700be520 0x7f99701639c0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:17.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.910+0000 7f99780a9700 1 -- 172.21.15.1:0/1075431018 >> 172.21.15.1:0/1075431018 conn(0x7f9970082f90 msgr2=0x7f99700bf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:17.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.910+0000 7f99780a9700 1 -- 172.21.15.1:0/1075431018 shutdown_connections 2023-11-15T01:40:17.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:17.910+0000 7f99780a9700 1 -- 172.21.15.1:0/1075431018 wait complete. 2023-11-15T01:40:17.966 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-15T01:40:17.967 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-15T01:40:18.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.088+0000 7f136d081700 1 Processor -- start 2023-11-15T01:40:18.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.088+0000 7f136d081700 1 -- start start 2023-11-15T01:40:18.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f136d081700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f136814b350 0x7f13680c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:18.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f136d081700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13680aa750 0x7f1368154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:18.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f136d081700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13681580d0 con 0x7f136814b730 2023-11-15T01:40:18.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f136d081700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1368155000 con 0x7f13680aa750 2023-11-15T01:40:18.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f136d081700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13681552e0 con 0x7f136814b350 2023-11-15T01:40:18.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f136759e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13680aa750 0x7f1368154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:18.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f136659c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f136814b730 0x7f13680aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34718/0 (socket says 172.21.15.1:34718) 2023-11-15T01:40:18.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f136659c700 1 -- 172.21.15.1:0/210339719 learned_addr learned my addr 172.21.15.1:0/210339719 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:18.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f1365d9b700 1 -- 172.21.15.1:0/210339719 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881146600 0 0) 0x7f13681580d0 con 0x7f136814b730 2023-11-15T01:40:18.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f1366d9d700 1 --2- 172.21.15.1:0/210339719 >> v2:172.21.15.141:3300/0 conn(0x7f136814b350 0x7f13680c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:18.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f1365d9b700 1 -- 172.21.15.1:0/210339719 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13540033f0 con 0x7f136814b730 2023-11-15T01:40:18.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f136759e700 1 -- 172.21.15.1:0/210339719 >> v2:172.21.15.141:3300/0 conn(0x7f136814b350 msgr2=0x7f13680c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:18.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f136759e700 1 --2- 172.21.15.1:0/210339719 >> v2:172.21.15.141:3300/0 conn(0x7f136814b350 0x7f13680c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:18.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f136759e700 1 -- 172.21.15.1:0/210339719 >> v1:172.21.15.1:6789/0 conn(0x7f136814b730 legacy=0x7f13680aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:18.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f136759e700 1 -- 172.21.15.1:0/210339719 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13681555c0 con 0x7f13680aa750 2023-11-15T01:40:18.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.089+0000 7f1366d9d700 1 --2- 172.21.15.1:0/210339719 >> v2:172.21.15.141:3300/0 conn(0x7f136814b350 0x7f13680c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:40:18.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.090+0000 7f136759e700 1 --2- 172.21.15.1:0/210339719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13680aa750 0x7f1368154a10 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f1368062ba0 tx=0x7f1360009060).ready entity=mon.0 client_cookie=5cec60f151f10039 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:18.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.090+0000 7f1365d9b700 1 -- 172.21.15.1:0/210339719 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136000f510 con 0x7f13680aa750 2023-11-15T01:40:18.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.090+0000 7f1365d9b700 1 -- 172.21.15.1:0/210339719 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136000f670 con 0x7f13680aa750 2023-11-15T01:40:18.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.090+0000 7f1365d9b700 1 -- 172.21.15.1:0/210339719 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136000f9f0 con 0x7f13680aa750 2023-11-15T01:40:18.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.090+0000 7f136d081700 1 -- 172.21.15.1:0/210339719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13680aa750 msgr2=0x7f1368154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:18.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.090+0000 7f136d081700 1 --2- 172.21.15.1:0/210339719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13680aa750 0x7f1368154a10 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f1368062ba0 tx=0x7f1360009060).stop 2023-11-15T01:40:18.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.090+0000 7f136d081700 1 -- 172.21.15.1:0/210339719 shutdown_connections 2023-11-15T01:40:18.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.090+0000 7f136d081700 1 --2- 172.21.15.1:0/210339719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13680aa750 0x7f1368154a10 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:18.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.090+0000 7f136d081700 1 --2- 172.21.15.1:0/210339719 >> v2:172.21.15.141:3300/0 conn(0x7f136814b350 0x7f13680c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:18.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.090+0000 7f136d081700 1 -- 172.21.15.1:0/210339719 >> 172.21.15.1:0/210339719 conn(0x7f1368069ee0 msgr2=0x7f136806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:18.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.090+0000 7f136d081700 1 -- 172.21.15.1:0/210339719 shutdown_connections 2023-11-15T01:40:18.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.090+0000 7f136d081700 1 -- 172.21.15.1:0/210339719 wait complete. 2023-11-15T01:40:18.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.092+0000 7f136d081700 1 Processor -- start 2023-11-15T01:40:18.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.092+0000 7f136d081700 1 -- start start 2023-11-15T01:40:18.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.092+0000 7f136d081700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13680aa750 0x7f13680aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:18.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.092+0000 7f136d081700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f136814b350 0x7f13680c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:18.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.092+0000 7f136d081700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f136814b730 0x7f13680c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:18.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.092+0000 7f136d081700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13680ae0b0 con 0x7f136814b350 2023-11-15T01:40:18.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.092+0000 7f136d081700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13680aeff0 con 0x7f13680aa750 2023-11-15T01:40:18.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.092+0000 7f136d081700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13680c3300 con 0x7f136814b730 2023-11-15T01:40:18.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.092+0000 7f136659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f136814b350 0x7f13680c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:18.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.092+0000 7f136659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f136814b350 0x7f13680c2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59084/0 (socket says 172.21.15.1:59084) 2023-11-15T01:40:18.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.092+0000 7f136659c700 1 -- 172.21.15.1:0/837094358 learned_addr learned my addr 172.21.15.1:0/837094358 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:18.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.093+0000 7f1366d9d700 1 --2- 172.21.15.1:0/837094358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13680aa750 0x7f13680aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:18.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.093+0000 7f136659c700 1 -- 172.21.15.1:0/837094358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f136814b730 msgr2=0x7f13680c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:18.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.093+0000 7f136659c700 1 --2- 172.21.15.1:0/837094358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f136814b730 0x7f13680c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:18.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.093+0000 7f136659c700 1 -- 172.21.15.1:0/837094358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13680aa750 msgr2=0x7f13680aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:18.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.093+0000 7f136659c700 1 --2- 172.21.15.1:0/837094358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13680aa750 0x7f13680aeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:18.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.093+0000 7f136659c700 1 -- 172.21.15.1:0/837094358 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600092a0 con 0x7f136814b350 2023-11-15T01:40:18.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.093+0000 7f136659c700 1 --2- 172.21.15.1:0/837094358 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f136814b350 0x7f13680c2e10 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f135000c450 tx=0x7f1350007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:18.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.093+0000 7f135effd700 1 -- 172.21.15.1:0/837094358 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13500072e0 con 0x7f136814b350 2023-11-15T01:40:18.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.093+0000 7f135effd700 1 -- 172.21.15.1:0/837094358 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1350007440 con 0x7f136814b350 2023-11-15T01:40:18.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.093+0000 7f135effd700 1 -- 172.21.15.1:0/837094358 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13500057a0 con 0x7f136814b350 2023-11-15T01:40:18.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.093+0000 7f136d081700 1 -- 172.21.15.1:0/837094358 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13680c3580 con 0x7f136814b350 2023-11-15T01:40:18.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.093+0000 7f136d081700 1 -- 172.21.15.1:0/837094358 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13680ae300 con 0x7f136814b350 2023-11-15T01:40:18.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.094+0000 7f136d081700 1 -- 172.21.15.1:0/837094358 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13680627b0 con 0x7f136814b350 2023-11-15T01:40:18.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.094+0000 7f135effd700 1 -- 172.21.15.1:0/837094358 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1350005bd0 con 0x7f136814b350 2023-11-15T01:40:18.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.095+0000 7f135effd700 1 --2- 172.21.15.1:0/837094358 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f134805f270 0x7f1348061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:18.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.095+0000 7f135effd700 1 -- 172.21.15.1:0/837094358 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f1350079a60 con 0x7f136814b350 2023-11-15T01:40:18.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.095+0000 7f1366d9d700 1 --2- 172.21.15.1:0/837094358 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f134805f270 0x7f1348061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:18.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.095+0000 7f1366d9d700 1 --2- 172.21.15.1:0/837094358 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f134805f270 0x7f1348061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f135800d560 tx=0x7f13580075a0).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:18.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.099+0000 7f135effd700 1 -- 172.21.15.1:0/837094358 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f135004ad40 con 0x7f136814b350 2023-11-15T01:40:18.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:18.273+0000 7f136d081700 1 -- 172.21.15.1:0/837094358 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f13680c61c0 con 0x7f136814b350 2023-11-15T01:40:19.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.219+0000 7f135effd700 1 -- 172.21.15.1:0/837094358 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v138) v1 ==== 152+0+0 (secure 0 0 0) 0x7f135004e360 con 0x7f136814b350 2023-11-15T01:40:19.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.223+0000 7f136d081700 1 -- 172.21.15.1:0/837094358 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f134805f270 msgr2=0x7f1348061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:19.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.223+0000 7f136d081700 1 --2- 172.21.15.1:0/837094358 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f134805f270 0x7f1348061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f135800d560 tx=0x7f13580075a0).stop 2023-11-15T01:40:19.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.223+0000 7f136d081700 1 -- 172.21.15.1:0/837094358 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f136814b350 msgr2=0x7f13680c2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:19.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.223+0000 7f136d081700 1 --2- 172.21.15.1:0/837094358 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f136814b350 0x7f13680c2e10 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f135000c450 tx=0x7f1350007c80).stop 2023-11-15T01:40:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.229+0000 7f136d081700 1 -- 172.21.15.1:0/837094358 shutdown_connections 2023-11-15T01:40:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.229+0000 7f136d081700 1 --2- 172.21.15.1:0/837094358 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f134805f270 0x7f1348061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.229+0000 7f136d081700 1 --2- 172.21.15.1:0/837094358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f136814b730 0x7f13680c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:19.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.229+0000 7f136d081700 1 --2- 172.21.15.1:0/837094358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13680aa750 0x7f13680aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:19.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.229+0000 7f136d081700 1 --2- 172.21.15.1:0/837094358 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f136814b350 0x7f13680c2e10 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:19.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.229+0000 7f136d081700 1 -- 172.21.15.1:0/837094358 >> 172.21.15.1:0/837094358 conn(0x7f1368069ee0 msgr2=0x7f136814a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:19.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.229+0000 7f136d081700 1 -- 172.21.15.1:0/837094358 shutdown_connections 2023-11-15T01:40:19.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.229+0000 7f136d081700 1 -- 172.21.15.1:0/837094358 wait complete. 2023-11-15T01:40:19.233 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2023-11-15T01:40:19.246 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-15T01:40:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.375+0000 7f7dde090700 1 Processor -- start 2023-11-15T01:40:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.375+0000 7f7dde090700 1 -- start start 2023-11-15T01:40:19.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.376+0000 7f7dde090700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7dd81540a0 0x7f7dd80ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:19.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.376+0000 7f7dde090700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7dd8154480 0x7f7dd80ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:19.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.376+0000 7f7dde090700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd80ca050 con 0x7f7dd80c5f40 2023-11-15T01:40:19.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.376+0000 7f7dde090700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd80c9440 con 0x7f7dd8154480 2023-11-15T01:40:19.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.376+0000 7f7dde090700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80c9720 con 0x7f7dd81540a0 2023-11-15T01:40:19.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.376+0000 7f7dd6ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7dd8154480 0x7f7dd80ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:19.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.376+0000 7f7dd7fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7dd80c5f40 0x7f7dd80aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34728/0 (socket says 172.21.15.1:34728) 2023-11-15T01:40:19.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.376+0000 7f7dd6ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7dd8154480 0x7f7dd80ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59096/0 (socket says 172.21.15.1:59096) 2023-11-15T01:40:19.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.376+0000 7f7dd7fff700 1 -- 172.21.15.1:0/3284231836 learned_addr learned my addr 172.21.15.1:0/3284231836 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:19.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dd77fe700 1 --2- 172.21.15.1:0/3284231836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7dd81540a0 0x7f7dd80ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:19.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dd6ffd700 1 -- 172.21.15.1:0/3284231836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7dd81540a0 msgr2=0x7f7dd80ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:19.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dd6ffd700 1 --2- 172.21.15.1:0/3284231836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7dd81540a0 0x7f7dd80ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:19.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dd6ffd700 1 -- 172.21.15.1:0/3284231836 >> v1:172.21.15.1:6789/0 conn(0x7f7dd80c5f40 legacy=0x7f7dd80aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:19.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dd67fc700 1 -- 172.21.15.1:0/3284231836 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608485845 0 0) 0x7f7dd80ca050 con 0x7f7dd80c5f40 2023-11-15T01:40:19.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dd6ffd700 1 -- 172.21.15.1:0/3284231836 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd80c9a00 con 0x7f7dd8154480 2023-11-15T01:40:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dd6ffd700 1 --2- 172.21.15.1:0/3284231836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7dd8154480 0x7f7dd80ca9d0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f7dcc009760 tx=0x7f7dcc009060).ready entity=mon.0 client_cookie=80443651fb85b72b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dd67fc700 1 -- 172.21.15.1:0/3284231836 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc00b580 con 0x7f7dd8154480 2023-11-15T01:40:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dd67fc700 1 -- 172.21.15.1:0/3284231836 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc00b6e0 con 0x7f7dd8154480 2023-11-15T01:40:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dd67fc700 1 -- 172.21.15.1:0/3284231836 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc00ba60 con 0x7f7dd8154480 2023-11-15T01:40:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dde090700 1 -- 172.21.15.1:0/3284231836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7dd8154480 msgr2=0x7f7dd80ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dde090700 1 --2- 172.21.15.1:0/3284231836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7dd8154480 0x7f7dd80ca9d0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f7dcc009760 tx=0x7f7dcc009060).stop 2023-11-15T01:40:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dde090700 1 -- 172.21.15.1:0/3284231836 shutdown_connections 2023-11-15T01:40:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dde090700 1 --2- 172.21.15.1:0/3284231836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7dd81540a0 0x7f7dd80ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dde090700 1 --2- 172.21.15.1:0/3284231836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7dd8154480 0x7f7dd80ca9d0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dde090700 1 -- 172.21.15.1:0/3284231836 >> 172.21.15.1:0/3284231836 conn(0x7f7dd8064a70 msgr2=0x7f7dd8064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.377+0000 7f7dde090700 1 -- 172.21.15.1:0/3284231836 shutdown_connections 2023-11-15T01:40:19.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.378+0000 7f7dde090700 1 -- 172.21.15.1:0/3284231836 wait complete. 2023-11-15T01:40:19.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.379+0000 7f7dde090700 1 Processor -- start 2023-11-15T01:40:19.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.379+0000 7f7dde090700 1 -- start start 2023-11-15T01:40:19.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.379+0000 7f7dde090700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7dd80c5f40 0x7f7dd80a7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:19.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.379+0000 7f7dde090700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7dd81540a0 0x7f7dd80af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:19.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.379+0000 7f7dde090700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dd8154480 0x7f7dd80a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:19.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.379+0000 7f7dde090700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80a39f0 con 0x7f7dd80c5f40 2023-11-15T01:40:19.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.379+0000 7f7dde090700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80a4570 con 0x7f7dd8154480 2023-11-15T01:40:19.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.379+0000 7f7dde090700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80a3c40 con 0x7f7dd81540a0 2023-11-15T01:40:19.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.380+0000 7f7dd77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7dd80c5f40 0x7f7dd80a7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:19.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.380+0000 7f7dd77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7dd80c5f40 0x7f7dd80a7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59110/0 (socket says 172.21.15.1:59110) 2023-11-15T01:40:19.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.380+0000 7f7dd77fe700 1 -- 172.21.15.1:0/3063120847 learned_addr learned my addr 172.21.15.1:0/3063120847 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:19.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.380+0000 7f7dd77fe700 1 -- 172.21.15.1:0/3063120847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7dd81540a0 msgr2=0x7f7dd80af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:19.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.380+0000 7f7dd77fe700 1 --2- 172.21.15.1:0/3063120847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7dd81540a0 0x7f7dd80af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:19.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.380+0000 7f7dd77fe700 1 -- 172.21.15.1:0/3063120847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dd8154480 msgr2=0x7f7dd80a5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:19.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.380+0000 7f7dd77fe700 1 --2- 172.21.15.1:0/3063120847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dd8154480 0x7f7dd80a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:19.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.380+0000 7f7dd77fe700 1 -- 172.21.15.1:0/3063120847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc0092a0 con 0x7f7dd80c5f40 2023-11-15T01:40:19.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.380+0000 7f7dd77fe700 1 --2- 172.21.15.1:0/3063120847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7dd80c5f40 0x7f7dd80a7ad0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f7dc800c680 tx=0x7f7dc8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:19.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.380+0000 7f7dbf7fe700 1 -- 172.21.15.1:0/3063120847 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8010580 con 0x7f7dd80c5f40 2023-11-15T01:40:19.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.380+0000 7f7dbf7fe700 1 -- 172.21.15.1:0/3063120847 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc80106e0 con 0x7f7dd80c5f40 2023-11-15T01:40:19.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.380+0000 7f7dbf7fe700 1 -- 172.21.15.1:0/3063120847 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8010a60 con 0x7f7dd80c5f40 2023-11-15T01:40:19.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.380+0000 7f7dde090700 1 -- 172.21.15.1:0/3063120847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd80a3f20 con 0x7f7dd80c5f40 2023-11-15T01:40:19.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.380+0000 7f7dde090700 1 -- 172.21.15.1:0/3063120847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd80afeb0 con 0x7f7dd80c5f40 2023-11-15T01:40:19.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.381+0000 7f7dde090700 1 -- 172.21.15.1:0/3063120847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd806c7e0 con 0x7f7dd80c5f40 2023-11-15T01:40:19.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.382+0000 7f7dbf7fe700 1 -- 172.21.15.1:0/3063120847 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7dc801b460 con 0x7f7dd80c5f40 2023-11-15T01:40:19.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.382+0000 7f7dbf7fe700 1 --2- 172.21.15.1:0/3063120847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7dc405f270 0x7f7dc4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:19.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.383+0000 7f7dbf7fe700 1 -- 172.21.15.1:0/3063120847 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f7dc807ad30 con 0x7f7dd80c5f40 2023-11-15T01:40:19.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.383+0000 7f7dd6ffd700 1 --2- 172.21.15.1:0/3063120847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7dc405f270 0x7f7dc4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:19.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.383+0000 7f7dd6ffd700 1 --2- 172.21.15.1:0/3063120847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7dc405f270 0x7f7dc4061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7dcc009760 tx=0x7f7dcc017000).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:19.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.386+0000 7f7dbf7fe700 1 -- 172.21.15.1:0/3063120847 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7dc804bf00 con 0x7f7dd80c5f40 2023-11-15T01:40:19.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:19.559+0000 7f7dde090700 1 -- 172.21.15.1:0/3063120847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7dd80c9ce0 con 0x7f7dd80c5f40 2023-11-15T01:40:20.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.222+0000 7f7dbf7fe700 1 -- 172.21.15.1:0/3063120847 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v139) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7dc804f520 con 0x7f7dd80c5f40 2023-11-15T01:40:20.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.228+0000 7f7dde090700 1 -- 172.21.15.1:0/3063120847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7dc405f270 msgr2=0x7f7dc4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:20.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.228+0000 7f7dde090700 1 --2- 172.21.15.1:0/3063120847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7dc405f270 0x7f7dc4061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7dcc009760 tx=0x7f7dcc017000).stop 2023-11-15T01:40:20.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.228+0000 7f7dde090700 1 -- 172.21.15.1:0/3063120847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7dd80c5f40 msgr2=0x7f7dd80a7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:20.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.228+0000 7f7dde090700 1 --2- 172.21.15.1:0/3063120847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7dd80c5f40 0x7f7dd80a7ad0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f7dc800c680 tx=0x7f7dc8008040).stop 2023-11-15T01:40:20.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.231+0000 7f7dde090700 1 -- 172.21.15.1:0/3063120847 shutdown_connections 2023-11-15T01:40:20.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.231+0000 7f7dde090700 1 --2- 172.21.15.1:0/3063120847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7dc405f270 0x7f7dc4061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.232+0000 7f7dde090700 1 --2- 172.21.15.1:0/3063120847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dd8154480 0x7f7dd80a5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:20.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.232+0000 7f7dde090700 1 --2- 172.21.15.1:0/3063120847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7dd80c5f40 0x7f7dd80a7ad0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.232+0000 7f7dde090700 1 --2- 172.21.15.1:0/3063120847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7dd81540a0 0x7f7dd80af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:20.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.232+0000 7f7dde090700 1 -- 172.21.15.1:0/3063120847 >> 172.21.15.1:0/3063120847 conn(0x7f7dd8064a70 msgr2=0x7f7dd80abc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:20.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.237+0000 7f7dde090700 1 -- 172.21.15.1:0/3063120847 shutdown_connections 2023-11-15T01:40:20.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.238+0000 7f7dde090700 1 -- 172.21.15.1:0/3063120847 wait complete. 2023-11-15T01:40:20.245 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2023-11-15T01:40:20.261 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-15T01:40:20.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.384+0000 7f4d696cf700 1 Processor -- start 2023-11-15T01:40:20.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.384+0000 7f4d696cf700 1 -- start start 2023-11-15T01:40:20.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.385+0000 7f4d696cf700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4d64137030 0x7f4d64137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:20.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.385+0000 7f4d696cf700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4d641588e0 0x7f4d64066870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:20.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.385+0000 7f4d696cf700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d640671b0 con 0x7f4d64066d60 2023-11-15T01:40:20.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.385+0000 7f4d696cf700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d64137900 con 0x7f4d64137030 2023-11-15T01:40:20.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.385+0000 7f4d696cf700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d64158d90 con 0x7f4d641588e0 2023-11-15T01:40:20.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.385+0000 7f4d62ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4d64137030 0x7f4d64137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:20.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.385+0000 7f4d637fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4d64066d60 0x7f4d6414e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34736/0 (socket says 172.21.15.1:34736) 2023-11-15T01:40:20.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.385+0000 7f4d637fe700 1 -- 172.21.15.1:0/753660125 learned_addr learned my addr 172.21.15.1:0/753660125 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:20.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.385+0000 7f4d627fc700 1 --2- 172.21.15.1:0/753660125 >> v2:172.21.15.141:3300/0 conn(0x7f4d641588e0 0x7f4d64066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:20.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.385+0000 7f4d62ffd700 1 -- 172.21.15.1:0/753660125 >> v2:172.21.15.141:3300/0 conn(0x7f4d641588e0 msgr2=0x7f4d64066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:20.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.385+0000 7f4d62ffd700 1 --2- 172.21.15.1:0/753660125 >> v2:172.21.15.141:3300/0 conn(0x7f4d641588e0 0x7f4d64066870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.385+0000 7f4d62ffd700 1 -- 172.21.15.1:0/753660125 >> v1:172.21.15.1:6789/0 conn(0x7f4d64066d60 legacy=0x7f4d6414e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:20.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.385+0000 7f4d61ffb700 1 -- 172.21.15.1:0/753660125 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935350191 0 0) 0x7f4d640671b0 con 0x7f4d64066d60 2023-11-15T01:40:20.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.385+0000 7f4d62ffd700 1 -- 172.21.15.1:0/753660125 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d64154ce0 con 0x7f4d64137030 2023-11-15T01:40:20.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.385+0000 7f4d62ffd700 1 --2- 172.21.15.1:0/753660125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d64137030 0x7f4d64137410 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f4d640c89d0 tx=0x7f4d5c009780).ready entity=mon.0 client_cookie=ddd5be07800a38b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:20.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.386+0000 7f4d61ffb700 1 -- 172.21.15.1:0/753660125 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00e070 con 0x7f4d64137030 2023-11-15T01:40:20.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.386+0000 7f4d61ffb700 1 -- 172.21.15.1:0/753660125 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c00bc30 con 0x7f4d64137030 2023-11-15T01:40:20.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.386+0000 7f4d61ffb700 1 -- 172.21.15.1:0/753660125 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c012410 con 0x7f4d64137030 2023-11-15T01:40:20.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.386+0000 7f4d696cf700 1 -- 172.21.15.1:0/753660125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d64137030 msgr2=0x7f4d64137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:20.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.386+0000 7f4d696cf700 1 --2- 172.21.15.1:0/753660125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d64137030 0x7f4d64137410 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f4d640c89d0 tx=0x7f4d5c009780).stop 2023-11-15T01:40:20.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.386+0000 7f4d696cf700 1 -- 172.21.15.1:0/753660125 shutdown_connections 2023-11-15T01:40:20.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.386+0000 7f4d696cf700 1 --2- 172.21.15.1:0/753660125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d64137030 0x7f4d64137410 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.386+0000 7f4d696cf700 1 --2- 172.21.15.1:0/753660125 >> v2:172.21.15.141:3300/0 conn(0x7f4d641588e0 0x7f4d64066870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.386+0000 7f4d696cf700 1 -- 172.21.15.1:0/753660125 >> 172.21.15.1:0/753660125 conn(0x7f4d64063280 msgr2=0x7f4d640c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:20.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.386+0000 7f4d696cf700 1 -- 172.21.15.1:0/753660125 shutdown_connections 2023-11-15T01:40:20.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.386+0000 7f4d696cf700 1 -- 172.21.15.1:0/753660125 wait complete. 2023-11-15T01:40:20.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.387+0000 7f4d696cf700 1 Processor -- start 2023-11-15T01:40:20.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.388+0000 7f4d696cf700 1 -- start start 2023-11-15T01:40:20.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.388+0000 7f4d696cf700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d64066d60 0x7f4d640ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:20.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.388+0000 7f4d696cf700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d64137030 0x7f4d640ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:20.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.388+0000 7f4d696cf700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d641588e0 0x7f4d64150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:20.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.388+0000 7f4d696cf700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d640aede0 con 0x7f4d641588e0 2023-11-15T01:40:20.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.388+0000 7f4d696cf700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d640addb0 con 0x7f4d64137030 2023-11-15T01:40:20.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.388+0000 7f4d696cf700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d64164450 con 0x7f4d64066d60 2023-11-15T01:40:20.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.388+0000 7f4d637fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d641588e0 0x7f4d64150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:20.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.388+0000 7f4d637fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d641588e0 0x7f4d64150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59132/0 (socket says 172.21.15.1:59132) 2023-11-15T01:40:20.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.388+0000 7f4d637fe700 1 -- 172.21.15.1:0/2286991437 learned_addr learned my addr 172.21.15.1:0/2286991437 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:20.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.389+0000 7f4d62ffd700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d64066d60 0x7f4d640ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:20.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.389+0000 7f4d627fc700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d64137030 0x7f4d640ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:20.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.389+0000 7f4d637fe700 1 -- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d64066d60 msgr2=0x7f4d640ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:20.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.389+0000 7f4d637fe700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d64066d60 0x7f4d640ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.389+0000 7f4d637fe700 1 -- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d64137030 msgr2=0x7f4d640ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:20.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.389+0000 7f4d637fe700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d64137030 0x7f4d640ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.389+0000 7f4d637fe700 1 -- 172.21.15.1:0/2286991437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c009a20 con 0x7f4d641588e0 2023-11-15T01:40:20.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.389+0000 7f4d627fc700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d64137030 0x7f4d640ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:20.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.389+0000 7f4d62ffd700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d64066d60 0x7f4d640ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:20.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.389+0000 7f4d637fe700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d641588e0 0x7f4d64150ff0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f4d5400c490 tx=0x7f4d54007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:20.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.389+0000 7f4d5affd700 1 -- 172.21.15.1:0/2286991437 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d540072e0 con 0x7f4d641588e0 2023-11-15T01:40:20.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.389+0000 7f4d5affd700 1 -- 172.21.15.1:0/2286991437 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d54007440 con 0x7f4d641588e0 2023-11-15T01:40:20.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.389+0000 7f4d5affd700 1 -- 172.21.15.1:0/2286991437 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d540057a0 con 0x7f4d641588e0 2023-11-15T01:40:20.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.389+0000 7f4d696cf700 1 -- 172.21.15.1:0/2286991437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d640ad510 con 0x7f4d641588e0 2023-11-15T01:40:20.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.389+0000 7f4d696cf700 1 -- 172.21.15.1:0/2286991437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d64164660 con 0x7f4d641588e0 2023-11-15T01:40:20.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.390+0000 7f4d696cf700 1 -- 172.21.15.1:0/2286991437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6406c7e0 con 0x7f4d641588e0 2023-11-15T01:40:20.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.391+0000 7f4d5affd700 1 -- 172.21.15.1:0/2286991437 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4d54005b50 con 0x7f4d641588e0 2023-11-15T01:40:20.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.391+0000 7f4d5affd700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4d4405f270 0x7f4d44061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:20.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.391+0000 7f4d5affd700 1 -- 172.21.15.1:0/2286991437 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6473+0+0 (secure 0 0 0) 0x7f4d54079bb0 con 0x7f4d641588e0 2023-11-15T01:40:20.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.391+0000 7f4d62ffd700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4d4405f270 0x7f4d44061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:20.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.392+0000 7f4d62ffd700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4d4405f270 0x7f4d44061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4d5c009fd0 tx=0x7f4d5c009780).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:20.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.395+0000 7f4d5affd700 1 -- 172.21.15.1:0/2286991437 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4d5404aba0 con 0x7f4d641588e0 2023-11-15T01:40:20.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.611+0000 7f4d696cf700 1 -- 172.21.15.1:0/2286991437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4d640c76a0 con 0x7f4d641588e0 2023-11-15T01:40:20.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.617+0000 7f4d5affd700 1 -- 172.21.15.1:0/2286991437 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v59) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4d5404e1c0 con 0x7f4d641588e0 2023-11-15T01:40:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.622+0000 7f4d696cf700 1 -- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4d4405f270 msgr2=0x7f4d44061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.622+0000 7f4d696cf700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4d4405f270 0x7f4d44061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4d5c009fd0 tx=0x7f4d5c009780).stop 2023-11-15T01:40:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.622+0000 7f4d696cf700 1 -- 172.21.15.1:0/2286991437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d641588e0 msgr2=0x7f4d64150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.622+0000 7f4d696cf700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d641588e0 0x7f4d64150ff0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f4d5400c490 tx=0x7f4d54007dd0).stop 2023-11-15T01:40:20.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.626+0000 7f4d696cf700 1 -- 172.21.15.1:0/2286991437 shutdown_connections 2023-11-15T01:40:20.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.626+0000 7f4d696cf700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4d4405f270 0x7f4d44061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.626+0000 7f4d696cf700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d641588e0 0x7f4d64150ff0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.626+0000 7f4d696cf700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d64066d60 0x7f4d640ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.626+0000 7f4d696cf700 1 --2- 172.21.15.1:0/2286991437 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d64137030 0x7f4d640ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.626+0000 7f4d696cf700 1 -- 172.21.15.1:0/2286991437 >> 172.21.15.1:0/2286991437 conn(0x7f4d64063280 msgr2=0x7f4d640c5980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:20.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.627+0000 7f4d696cf700 1 -- 172.21.15.1:0/2286991437 shutdown_connections 2023-11-15T01:40:20.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.627+0000 7f4d696cf700 1 -- 172.21.15.1:0/2286991437 wait complete. 2023-11-15T01:40:20.638 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 17 and data pool 18 2023-11-15T01:40:20.650 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:40:20.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.767+0000 7fdeb0a42700 1 Processor -- start 2023-11-15T01:40:20.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.767+0000 7fdeb0a42700 1 -- start start 2023-11-15T01:40:20.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.768+0000 7fdeb0a42700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdeac0bd130 0x7fdeac0c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:20.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.768+0000 7fdeb0a42700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac06a6b0 con 0x7fdeac0bccd0 2023-11-15T01:40:20.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.768+0000 7fdeb0a42700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac0c3360 con 0x7fdeac154680 2023-11-15T01:40:20.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.768+0000 7fdeb0a42700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac0c2750 con 0x7fdeac0bd130 2023-11-15T01:40:20.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.768+0000 7fdeaad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdeac0bd130 0x7fdeac0c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:20.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.768+0000 7fdeaad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdeac0bd130 0x7fdeac0c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59140/0 (socket says 172.21.15.1:59140) 2023-11-15T01:40:20.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.768+0000 7fdeaad9d700 1 -- 172.21.15.1:0/1570873225 learned_addr learned my addr 172.21.15.1:0/1570873225 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:20.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.768+0000 7fdea9d9b700 1 --1- 172.21.15.1:0/1570873225 >> v1:172.21.15.1:6789/0 conn(0x7fdeac0bccd0 0x7fdeac0c60b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34750/0 (socket says 172.21.15.1:34750) 2023-11-15T01:40:20.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.769+0000 7fdeaad9d700 1 -- 172.21.15.1:0/1570873225 >> v1:172.21.15.141:6789/0 conn(0x7fdeac154680 legacy=0x7fdeac069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:20.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.769+0000 7fdeaad9d700 1 -- 172.21.15.1:0/1570873225 >> v1:172.21.15.1:6789/0 conn(0x7fdeac0bccd0 legacy=0x7fdeac0c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:20.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.769+0000 7fdea959a700 1 -- 172.21.15.1:0/1570873225 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249592388 0 0) 0x7fdeac06a6b0 con 0x7fdeac0bccd0 2023-11-15T01:40:20.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.769+0000 7fdeaad9d700 1 -- 172.21.15.1:0/1570873225 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac0c2a30 con 0x7fdeac0bd130 2023-11-15T01:40:20.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.769+0000 7fdeaad9d700 1 --2- 172.21.15.1:0/1570873225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeac0bd130 0x7fdeac0c67c0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fde9c009f20 tx=0x7fde9c009840).ready entity=mon.0 client_cookie=ef65c1f545ae792a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:20.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.769+0000 7fdea959a700 1 -- 172.21.15.1:0/1570873225 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c00e070 con 0x7fdeac0bd130 2023-11-15T01:40:20.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.769+0000 7fdea959a700 1 -- 172.21.15.1:0/1570873225 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c00ba40 con 0x7fdeac0bd130 2023-11-15T01:40:20.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.769+0000 7fdea959a700 1 -- 172.21.15.1:0/1570873225 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c00bdc0 con 0x7fdeac0bd130 2023-11-15T01:40:20.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.769+0000 7fdeb0a42700 1 -- 172.21.15.1:0/1570873225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeac0bd130 msgr2=0x7fdeac0c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:20.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.769+0000 7fdeb0a42700 1 --2- 172.21.15.1:0/1570873225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeac0bd130 0x7fdeac0c67c0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fde9c009f20 tx=0x7fde9c009840).stop 2023-11-15T01:40:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.769+0000 7fdeb0a42700 1 -- 172.21.15.1:0/1570873225 shutdown_connections 2023-11-15T01:40:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.769+0000 7fdeb0a42700 1 --2- 172.21.15.1:0/1570873225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeac0bd130 0x7fdeac0c67c0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.769+0000 7fdeb0a42700 1 -- 172.21.15.1:0/1570873225 >> 172.21.15.1:0/1570873225 conn(0x7fdeac0c7d70 msgr2=0x7fdeac0c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.769+0000 7fdeb0a42700 1 -- 172.21.15.1:0/1570873225 shutdown_connections 2023-11-15T01:40:20.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.769+0000 7fdeb0a42700 1 -- 172.21.15.1:0/1570873225 wait complete. 2023-11-15T01:40:20.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.771+0000 7fdeb0a42700 1 Processor -- start 2023-11-15T01:40:20.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.771+0000 7fdeb0a42700 1 -- start start 2023-11-15T01:40:20.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.771+0000 7fdeb0a42700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdeac0bccd0 0x7fdeac0a7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:20.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.771+0000 7fdeb0a42700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeac0bd130 0x7fdeac151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:20.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.771+0000 7fdeb0a42700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdeac154680 0x7fdeac0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:20.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.771+0000 7fdeb0a42700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0acea0 con 0x7fdeac0bd130 2023-11-15T01:40:20.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.771+0000 7fdeb0a42700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0abfb0 con 0x7fdeac154680 2023-11-15T01:40:20.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.771+0000 7fdeb0a42700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0ac290 con 0x7fdeac0bccd0 2023-11-15T01:40:20.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.771+0000 7fdea9d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeac0bd130 0x7fdeac151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:20.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.771+0000 7fdea9d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeac0bd130 0x7fdeac151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59146/0 (socket says 172.21.15.1:59146) 2023-11-15T01:40:20.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.771+0000 7fdea9d9b700 1 -- 172.21.15.1:0/4277824764 learned_addr learned my addr 172.21.15.1:0/4277824764 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:20.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.772+0000 7fdeaa59c700 1 --2- 172.21.15.1:0/4277824764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdeac0bccd0 0x7fdeac0a7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:20.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.772+0000 7fdeaad9d700 1 --2- 172.21.15.1:0/4277824764 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdeac154680 0x7fdeac0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:20.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.772+0000 7fdea9d9b700 1 -- 172.21.15.1:0/4277824764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdeac0bccd0 msgr2=0x7fdeac0a7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:20.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.772+0000 7fdea9d9b700 1 --2- 172.21.15.1:0/4277824764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdeac0bccd0 0x7fdeac0a7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.772+0000 7fdea9d9b700 1 -- 172.21.15.1:0/4277824764 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdeac154680 msgr2=0x7fdeac0a5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:20.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.772+0000 7fdea9d9b700 1 --2- 172.21.15.1:0/4277824764 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdeac154680 0x7fdeac0a5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.772+0000 7fdea9d9b700 1 -- 172.21.15.1:0/4277824764 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c009ae0 con 0x7fdeac0bd130 2023-11-15T01:40:20.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.772+0000 7fdeaa59c700 1 --2- 172.21.15.1:0/4277824764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdeac0bccd0 0x7fdeac0a7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:20.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.772+0000 7fdea9d9b700 1 --2- 172.21.15.1:0/4277824764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeac0bd130 0x7fdeac151b00 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fde9400c560 tx=0x7fde94007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:20.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.772+0000 7fdea27fc700 1 -- 172.21.15.1:0/4277824764 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde940072e0 con 0x7fdeac0bd130 2023-11-15T01:40:20.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.772+0000 7fdea27fc700 1 -- 172.21.15.1:0/4277824764 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde94007440 con 0x7fdeac0bd130 2023-11-15T01:40:20.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.772+0000 7fdeb0a42700 1 -- 172.21.15.1:0/4277824764 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeac0ac570 con 0x7fdeac0bd130 2023-11-15T01:40:20.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.772+0000 7fdea27fc700 1 -- 172.21.15.1:0/4277824764 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde940058f0 con 0x7fdeac0bd130 2023-11-15T01:40:20.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.772+0000 7fdeb0a42700 1 -- 172.21.15.1:0/4277824764 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac0acb30 con 0x7fdeac0bd130 2023-11-15T01:40:20.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.773+0000 7fdeb0a42700 1 -- 172.21.15.1:0/4277824764 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac0ad050 con 0x7fdeac0bd130 2023-11-15T01:40:20.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.774+0000 7fdea27fc700 1 -- 172.21.15.1:0/4277824764 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fde94005ce0 con 0x7fdeac0bd130 2023-11-15T01:40:20.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.774+0000 7fdea27fc700 1 --2- 172.21.15.1:0/4277824764 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fde8c05f270 0x7fde8c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:20.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.774+0000 7fdea27fc700 1 -- 172.21.15.1:0/4277824764 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6573+0+0 (secure 0 0 0) 0x7fde94079ef0 con 0x7fdeac0bd130 2023-11-15T01:40:20.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.774+0000 7fdeaa59c700 1 --2- 172.21.15.1:0/4277824764 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fde8c05f270 0x7fde8c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:20.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.775+0000 7fdeaa59c700 1 --2- 172.21.15.1:0/4277824764 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fde8c05f270 0x7fde8c061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdea400b8b0 tx=0x7fdea4008040).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:20.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.778+0000 7fdea27fc700 1 -- 172.21.15.1:0/4277824764 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdeac0ad050 con 0x7fdeac0bd130 2023-11-15T01:40:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.950+0000 7fdeb0a42700 1 -- 172.21.15.1:0/4277824764 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdeac06c7e0 con 0x7fdeac0bd130 2023-11-15T01:40:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.951+0000 7fdea27fc700 1 -- 172.21.15.1:0/4277824764 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+17597 (secure 0 0 0) 0x7fde94018030 con 0x7fdeac0bd130 2023-11-15T01:40:20.953 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:20.953 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":140,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:40:20.612909+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:40:18.311095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-11-15T01:40:19.597093+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:40:20.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.953+0000 7fdeb0a42700 1 -- 172.21.15.1:0/4277824764 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fde8c05f270 msgr2=0x7fde8c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:20.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.953+0000 7fdeb0a42700 1 --2- 172.21.15.1:0/4277824764 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fde8c05f270 0x7fde8c061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdea400b8b0 tx=0x7fdea4008040).stop 2023-11-15T01:40:20.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.953+0000 7fdeb0a42700 1 -- 172.21.15.1:0/4277824764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeac0bd130 msgr2=0x7fdeac151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:20.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.953+0000 7fdeb0a42700 1 --2- 172.21.15.1:0/4277824764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeac0bd130 0x7fdeac151b00 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fde9400c560 tx=0x7fde94007c90).stop 2023-11-15T01:40:20.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.954+0000 7fdeb0a42700 1 -- 172.21.15.1:0/4277824764 shutdown_connections 2023-11-15T01:40:20.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.954+0000 7fdeb0a42700 1 --2- 172.21.15.1:0/4277824764 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fde8c05f270 0x7fde8c061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.954+0000 7fdeb0a42700 1 --2- 172.21.15.1:0/4277824764 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdeac154680 0x7fdeac0a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.954+0000 7fdeb0a42700 1 --2- 172.21.15.1:0/4277824764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdeac0bccd0 0x7fdeac0a7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.954+0000 7fdeb0a42700 1 --2- 172.21.15.1:0/4277824764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeac0bd130 0x7fdeac151b00 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:20.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.954+0000 7fdeb0a42700 1 -- 172.21.15.1:0/4277824764 >> 172.21.15.1:0/4277824764 conn(0x7fdeac0c7d70 msgr2=0x7fdeac153970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:20.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.954+0000 7fdeb0a42700 1 -- 172.21.15.1:0/4277824764 shutdown_connections 2023-11-15T01:40:20.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:20.954+0000 7fdeb0a42700 1 -- 172.21.15.1:0/4277824764 wait complete. 2023-11-15T01:40:20.967 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:40:21.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.084+0000 7f6639d9e700 1 Processor -- start 2023-11-15T01:40:21.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.084+0000 7f6639d9e700 1 -- start start 2023-11-15T01:40:21.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f6639d9e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f66340ab1a0 0x7f6634154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:21.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f6639d9e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66340aa060 0x7f66340c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:21.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f6639d9e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66340c06f0 con 0x7f6634154150 2023-11-15T01:40:21.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f6639d9e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66340c09d0 con 0x7f66340ab1a0 2023-11-15T01:40:21.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f6639d9e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6634158820 con 0x7f66340aa060 2023-11-15T01:40:21.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f6632ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f66340ab1a0 0x7f6634154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:21.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f66337fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6634154150 0x7f6634158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34752/0 (socket says 172.21.15.1:34752) 2023-11-15T01:40:21.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f6632ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f66340ab1a0 0x7f6634154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59152/0 (socket says 172.21.15.1:59152) 2023-11-15T01:40:21.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f66337fe700 1 -- 172.21.15.1:0/2866489248 learned_addr learned my addr 172.21.15.1:0/2866489248 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:21.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f6632ffd700 1 -- 172.21.15.1:0/2866489248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66340aa060 msgr2=0x7f66340c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:21.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f6633fff700 1 --2- 172.21.15.1:0/2866489248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66340aa060 0x7f66340c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:21.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f6632ffd700 1 --2- 172.21.15.1:0/2866489248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66340aa060 0x7f66340c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:21.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f66327fc700 1 -- 172.21.15.1:0/2866489248 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210649374 0 0) 0x7f66340c06f0 con 0x7f6634154150 2023-11-15T01:40:21.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f6632ffd700 1 -- 172.21.15.1:0/2866489248 >> v1:172.21.15.1:6789/0 conn(0x7f6634154150 legacy=0x7f6634158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:21.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f6632ffd700 1 -- 172.21.15.1:0/2866489248 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634158b00 con 0x7f66340ab1a0 2023-11-15T01:40:21.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f6632ffd700 1 --2- 172.21.15.1:0/2866489248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66340ab1a0 0x7f6634154530 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f661c009760 tx=0x7f661c009060).ready entity=mon.0 client_cookie=85006fd62b5d29d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:21.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f66327fc700 1 -- 172.21.15.1:0/2866489248 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c0090d0 con 0x7f66340ab1a0 2023-11-15T01:40:21.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f66327fc700 1 -- 172.21.15.1:0/2866489248 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c00b580 con 0x7f66340ab1a0 2023-11-15T01:40:21.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.085+0000 7f66327fc700 1 -- 172.21.15.1:0/2866489248 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c00b900 con 0x7f66340ab1a0 2023-11-15T01:40:21.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.086+0000 7f6639d9e700 1 -- 172.21.15.1:0/2866489248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66340ab1a0 msgr2=0x7f6634154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:21.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.086+0000 7f6639d9e700 1 --2- 172.21.15.1:0/2866489248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66340ab1a0 0x7f6634154530 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f661c009760 tx=0x7f661c009060).stop 2023-11-15T01:40:21.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.086+0000 7f6639d9e700 1 -- 172.21.15.1:0/2866489248 shutdown_connections 2023-11-15T01:40:21.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.086+0000 7f6639d9e700 1 --2- 172.21.15.1:0/2866489248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66340aa060 0x7f66340c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:21.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.086+0000 7f6639d9e700 1 --2- 172.21.15.1:0/2866489248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66340ab1a0 0x7f6634154530 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:21.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.086+0000 7f6639d9e700 1 -- 172.21.15.1:0/2866489248 >> 172.21.15.1:0/2866489248 conn(0x7f6634064aa0 msgr2=0x7f6634064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:21.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.086+0000 7f6639d9e700 1 -- 172.21.15.1:0/2866489248 shutdown_connections 2023-11-15T01:40:21.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.086+0000 7f6639d9e700 1 -- 172.21.15.1:0/2866489248 wait complete. 2023-11-15T01:40:21.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.087+0000 7f6639d9e700 1 Processor -- start 2023-11-15T01:40:21.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.087+0000 7f6639d9e700 1 -- start start 2023-11-15T01:40:21.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6639d9e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66340aa060 0x7f6634147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:21.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6639d9e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66340ab1a0 0x7f66340c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:21.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6639d9e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6634154150 0x7f66340c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:21.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6639d9e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66340c9890 con 0x7f66340ab1a0 2023-11-15T01:40:21.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6639d9e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6634156640 con 0x7f6634154150 2023-11-15T01:40:21.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6639d9e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66340ae180 con 0x7f66340aa060 2023-11-15T01:40:21.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6632ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66340ab1a0 0x7f66340c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:21.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6632ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66340ab1a0 0x7f66340c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59154/0 (socket says 172.21.15.1:59154) 2023-11-15T01:40:21.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6632ffd700 1 -- 172.21.15.1:0/3825134850 learned_addr learned my addr 172.21.15.1:0/3825134850 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:21.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f66337fe700 1 --2- 172.21.15.1:0/3825134850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66340aa060 0x7f6634147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:21.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6633fff700 1 --2- 172.21.15.1:0/3825134850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6634154150 0x7f66340c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:21.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6632ffd700 1 -- 172.21.15.1:0/3825134850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66340aa060 msgr2=0x7f6634147c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:21.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6632ffd700 1 --2- 172.21.15.1:0/3825134850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66340aa060 0x7f6634147c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:21.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6632ffd700 1 -- 172.21.15.1:0/3825134850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6634154150 msgr2=0x7f66340c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:21.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6632ffd700 1 --2- 172.21.15.1:0/3825134850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6634154150 0x7f66340c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:21.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6632ffd700 1 -- 172.21.15.1:0/3825134850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c0092a0 con 0x7f66340ab1a0 2023-11-15T01:40:21.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.088+0000 7f6633fff700 1 --2- 172.21.15.1:0/3825134850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6634154150 0x7f66340c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:40:21.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.089+0000 7f6632ffd700 1 --2- 172.21.15.1:0/3825134850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66340ab1a0 0x7f66340c8eb0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f661c009eb0 tx=0x7f661c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:21.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.089+0000 7f662b7fe700 1 -- 172.21.15.1:0/3825134850 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c00b6f0 con 0x7f66340ab1a0 2023-11-15T01:40:21.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.089+0000 7f662b7fe700 1 -- 172.21.15.1:0/3825134850 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c00b850 con 0x7f66340ab1a0 2023-11-15T01:40:21.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.089+0000 7f6639d9e700 1 -- 172.21.15.1:0/3825134850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6634148170 con 0x7f66340ab1a0 2023-11-15T01:40:21.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.089+0000 7f662b7fe700 1 -- 172.21.15.1:0/3825134850 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c01b410 con 0x7f66340ab1a0 2023-11-15T01:40:21.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.089+0000 7f6639d9e700 1 -- 172.21.15.1:0/3825134850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6634156080 con 0x7f66340ab1a0 2023-11-15T01:40:21.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.090+0000 7f6639d9e700 1 -- 172.21.15.1:0/3825134850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66340c5940 con 0x7f66340ab1a0 2023-11-15T01:40:21.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.090+0000 7f662b7fe700 1 -- 172.21.15.1:0/3825134850 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f661c01ba10 con 0x7f66340ab1a0 2023-11-15T01:40:21.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.091+0000 7f662b7fe700 1 --2- 172.21.15.1:0/3825134850 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f661405f270 0x7f6614061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:21.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.091+0000 7f662b7fe700 1 -- 172.21.15.1:0/3825134850 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f661c07c600 con 0x7f66340ab1a0 2023-11-15T01:40:21.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.091+0000 7f66337fe700 1 --2- 172.21.15.1:0/3825134850 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f661405f270 0x7f6614061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:21.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.091+0000 7f66337fe700 1 --2- 172.21.15.1:0/3825134850 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f661405f270 0x7f6614061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f662c007fd0 tx=0x7f662c009040).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:21.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.095+0000 7f662b7fe700 1 -- 172.21.15.1:0/3825134850 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f661c04d530 con 0x7f66340ab1a0 2023-11-15T01:40:21.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.270+0000 7f6639d9e700 1 -- 172.21.15.1:0/3825134850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f663406c7e0 con 0x7f66340ab1a0 2023-11-15T01:40:21.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.271+0000 7f662b7fe700 1 -- 172.21.15.1:0/3825134850 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+17597 (secure 0 0 0) 0x7f661c029090 con 0x7f66340ab1a0 2023-11-15T01:40:21.273 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:21.273 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":140,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:40:20.612909+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:40:18.311095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-11-15T01:40:19.597093+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:40:21.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.273+0000 7f6639d9e700 1 -- 172.21.15.1:0/3825134850 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f661405f270 msgr2=0x7f6614061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:21.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.273+0000 7f6639d9e700 1 --2- 172.21.15.1:0/3825134850 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f661405f270 0x7f6614061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f662c007fd0 tx=0x7f662c009040).stop 2023-11-15T01:40:21.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.273+0000 7f6639d9e700 1 -- 172.21.15.1:0/3825134850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66340ab1a0 msgr2=0x7f66340c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:21.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.273+0000 7f6639d9e700 1 --2- 172.21.15.1:0/3825134850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66340ab1a0 0x7f66340c8eb0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f661c009eb0 tx=0x7f661c017000).stop 2023-11-15T01:40:21.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.273+0000 7f6639d9e700 1 -- 172.21.15.1:0/3825134850 shutdown_connections 2023-11-15T01:40:21.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.273+0000 7f6639d9e700 1 --2- 172.21.15.1:0/3825134850 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f661405f270 0x7f6614061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:21.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.273+0000 7f6639d9e700 1 --2- 172.21.15.1:0/3825134850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6634154150 0x7f66340c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:21.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.273+0000 7f6639d9e700 1 --2- 172.21.15.1:0/3825134850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66340aa060 0x7f6634147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:21.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.273+0000 7f6639d9e700 1 --2- 172.21.15.1:0/3825134850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66340ab1a0 0x7f66340c8eb0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:21.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.273+0000 7f6639d9e700 1 -- 172.21.15.1:0/3825134850 >> 172.21.15.1:0/3825134850 conn(0x7f6634064aa0 msgr2=0x7f66340ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:21.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.273+0000 7f6639d9e700 1 -- 172.21.15.1:0/3825134850 shutdown_connections 2023-11-15T01:40:21.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.273+0000 7f6639d9e700 1 -- 172.21.15.1:0/3825134850 wait complete. 2023-11-15T01:40:21.287 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-15T01:40:21.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.406+0000 7f65cda10700 1 Processor -- start 2023-11-15T01:40:21.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.406+0000 7f65cda10700 1 -- start start 2023-11-15T01:40:21.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.407+0000 7f65cda10700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f65c81540a0 0x7f65c80ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:21.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.407+0000 7f65cda10700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f65c80c6650 0x7f65c80ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:21.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.407+0000 7f65cda10700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c80ca050 con 0x7f65c8154480 2023-11-15T01:40:21.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.407+0000 7f65cda10700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c80c9440 con 0x7f65c80c6650 2023-11-15T01:40:21.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.407+0000 7f65cda10700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c80c9720 con 0x7f65c81540a0 2023-11-15T01:40:21.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.407+0000 7f65c77fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f65c80c6650 0x7f65c80ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:21.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.407+0000 7f65c67fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f65c8154480 0x7f65c80c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34758/0 (socket says 172.21.15.1:34758) 2023-11-15T01:40:21.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.407+0000 7f65c67fc700 1 -- 172.21.15.1:0/3797351264 learned_addr learned my addr 172.21.15.1:0/3797351264 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:21.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65c6ffd700 1 --2- 172.21.15.1:0/3797351264 >> v2:172.21.15.141:3300/0 conn(0x7f65c81540a0 0x7f65c80ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:21.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65c77fe700 1 -- 172.21.15.1:0/3797351264 >> v2:172.21.15.141:3300/0 conn(0x7f65c81540a0 msgr2=0x7f65c80ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:21.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65c77fe700 1 --2- 172.21.15.1:0/3797351264 >> v2:172.21.15.141:3300/0 conn(0x7f65c81540a0 0x7f65c80ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:21.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65c77fe700 1 -- 172.21.15.1:0/3797351264 >> v1:172.21.15.1:6789/0 conn(0x7f65c8154480 legacy=0x7f65c80c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:21.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65c5ffb700 1 -- 172.21.15.1:0/3797351264 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438909765 0 0) 0x7f65c80ca050 con 0x7f65c8154480 2023-11-15T01:40:21.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65c77fe700 1 -- 172.21.15.1:0/3797351264 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c80c9a00 con 0x7f65c80c6650 2023-11-15T01:40:21.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65c77fe700 1 --2- 172.21.15.1:0/3797351264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65c80c6650 0x7f65c80ca9d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f65c805ff40 tx=0x7f65b8009060).ready entity=mon.0 client_cookie=79c53f75227f3d9e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:21.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65c5ffb700 1 -- 172.21.15.1:0/3797351264 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b800b580 con 0x7f65c80c6650 2023-11-15T01:40:21.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65c5ffb700 1 -- 172.21.15.1:0/3797351264 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b800b6e0 con 0x7f65c80c6650 2023-11-15T01:40:21.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65c5ffb700 1 -- 172.21.15.1:0/3797351264 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b800ba60 con 0x7f65c80c6650 2023-11-15T01:40:21.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65cda10700 1 -- 172.21.15.1:0/3797351264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65c80c6650 msgr2=0x7f65c80ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:21.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65cda10700 1 --2- 172.21.15.1:0/3797351264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65c80c6650 0x7f65c80ca9d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f65c805ff40 tx=0x7f65b8009060).stop 2023-11-15T01:40:21.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65cda10700 1 -- 172.21.15.1:0/3797351264 shutdown_connections 2023-11-15T01:40:21.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65cda10700 1 --2- 172.21.15.1:0/3797351264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65c80c6650 0x7f65c80ca9d0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:21.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65cda10700 1 --2- 172.21.15.1:0/3797351264 >> v2:172.21.15.141:3300/0 conn(0x7f65c81540a0 0x7f65c80ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:21.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65cda10700 1 -- 172.21.15.1:0/3797351264 >> 172.21.15.1:0/3797351264 conn(0x7f65c8064a70 msgr2=0x7f65c8064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:21.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65cda10700 1 -- 172.21.15.1:0/3797351264 shutdown_connections 2023-11-15T01:40:21.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.408+0000 7f65cda10700 1 -- 172.21.15.1:0/3797351264 wait complete. 2023-11-15T01:40:21.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.410+0000 7f65cda10700 1 Processor -- start 2023-11-15T01:40:21.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.410+0000 7f65cda10700 1 -- start start 2023-11-15T01:40:21.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.410+0000 7f65cda10700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65c80c6650 0x7f65c8147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:21.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.410+0000 7f65cda10700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65c81540a0 0x7f65c814f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:21.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.410+0000 7f65cda10700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65c8154480 0x7f65c814f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:21.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.410+0000 7f65cda10700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c814fa90 con 0x7f65c8154480 2023-11-15T01:40:21.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.410+0000 7f65cda10700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c814aa60 con 0x7f65c81540a0 2023-11-15T01:40:21.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.410+0000 7f65cda10700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c814ad40 con 0x7f65c80c6650 2023-11-15T01:40:21.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65c77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65c8154480 0x7f65c814f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:21.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65c77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65c8154480 0x7f65c814f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59166/0 (socket says 172.21.15.1:59166) 2023-11-15T01:40:21.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65c77fe700 1 -- 172.21.15.1:0/4269963816 learned_addr learned my addr 172.21.15.1:0/4269963816 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:21.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65c6ffd700 1 --2- 172.21.15.1:0/4269963816 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65c80c6650 0x7f65c8147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:21.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65c67fc700 1 --2- 172.21.15.1:0/4269963816 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65c81540a0 0x7f65c814f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:21.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65c77fe700 1 -- 172.21.15.1:0/4269963816 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65c80c6650 msgr2=0x7f65c8147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:21.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65c77fe700 1 --2- 172.21.15.1:0/4269963816 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65c80c6650 0x7f65c8147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:21.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65c77fe700 1 -- 172.21.15.1:0/4269963816 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65c81540a0 msgr2=0x7f65c814f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:21.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65c77fe700 1 --2- 172.21.15.1:0/4269963816 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65c81540a0 0x7f65c814f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:21.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65c77fe700 1 -- 172.21.15.1:0/4269963816 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b80092a0 con 0x7f65c8154480 2023-11-15T01:40:21.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65c6ffd700 1 --2- 172.21.15.1:0/4269963816 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65c80c6650 0x7f65c8147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:21.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65c77fe700 1 --2- 172.21.15.1:0/4269963816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65c8154480 0x7f65c814f5a0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f65c80c2070 tx=0x7f65b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:21.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65beffd700 1 -- 172.21.15.1:0/4269963816 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b800ba60 con 0x7f65c8154480 2023-11-15T01:40:21.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65beffd700 1 -- 172.21.15.1:0/4269963816 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b801b410 con 0x7f65c8154480 2023-11-15T01:40:21.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65beffd700 1 -- 172.21.15.1:0/4269963816 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b801b790 con 0x7f65c8154480 2023-11-15T01:40:21.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65cda10700 1 -- 172.21.15.1:0/4269963816 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c814b020 con 0x7f65c8154480 2023-11-15T01:40:21.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.411+0000 7f65cda10700 1 -- 172.21.15.1:0/4269963816 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c814b5e0 con 0x7f65c8154480 2023-11-15T01:40:21.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.412+0000 7f65cda10700 1 -- 172.21.15.1:0/4269963816 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c814b800 con 0x7f65c8154480 2023-11-15T01:40:21.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.413+0000 7f65beffd700 1 -- 172.21.15.1:0/4269963816 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f65b801bb80 con 0x7f65c8154480 2023-11-15T01:40:21.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.413+0000 7f65beffd700 1 --2- 172.21.15.1:0/4269963816 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65a805f240 0x7f65a8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:21.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.413+0000 7f65beffd700 1 -- 172.21.15.1:0/4269963816 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f65b807c2b0 con 0x7f65c8154480 2023-11-15T01:40:21.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.413+0000 7f65c6ffd700 1 --2- 172.21.15.1:0/4269963816 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65a805f240 0x7f65a8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:21.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.414+0000 7f65c6ffd700 1 --2- 172.21.15.1:0/4269963816 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65a805f240 0x7f65a8061700 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f65c0007540 tx=0x7f65c000b040).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:21.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.417+0000 7f65beffd700 1 -- 172.21.15.1:0/4269963816 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f65b804d300 con 0x7f65c8154480 2023-11-15T01:40:21.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:21.636+0000 7f65cda10700 1 -- 172.21.15.1:0/4269963816 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f65c806c7e0 con 0x7f65c8154480 2023-11-15T01:40:22.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.624+0000 7f65beffd700 1 -- 172.21.15.1:0/4269963816 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v62) v1 ==== 118+0+0 (secure 0 0 0) 0x7f65b801f0b0 con 0x7f65c8154480 2023-11-15T01:40:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.626+0000 7f65cda10700 1 -- 172.21.15.1:0/4269963816 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65a805f240 msgr2=0x7f65a8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.626+0000 7f65cda10700 1 --2- 172.21.15.1:0/4269963816 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65a805f240 0x7f65a8061700 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f65c0007540 tx=0x7f65c000b040).stop 2023-11-15T01:40:22.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.627+0000 7f65cda10700 1 -- 172.21.15.1:0/4269963816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65c8154480 msgr2=0x7f65c814f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:22.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.627+0000 7f65cda10700 1 --2- 172.21.15.1:0/4269963816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65c8154480 0x7f65c814f5a0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f65c80c2070 tx=0x7f65b8017000).stop 2023-11-15T01:40:22.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.627+0000 7f65cda10700 1 -- 172.21.15.1:0/4269963816 shutdown_connections 2023-11-15T01:40:22.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.627+0000 7f65cda10700 1 --2- 172.21.15.1:0/4269963816 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f65a805f240 0x7f65a8061700 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:22.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.627+0000 7f65cda10700 1 --2- 172.21.15.1:0/4269963816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65c8154480 0x7f65c814f5a0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:22.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.627+0000 7f65cda10700 1 --2- 172.21.15.1:0/4269963816 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f65c80c6650 0x7f65c8147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:22.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.627+0000 7f65cda10700 1 --2- 172.21.15.1:0/4269963816 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f65c81540a0 0x7f65c814f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:22.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.627+0000 7f65cda10700 1 -- 172.21.15.1:0/4269963816 >> 172.21.15.1:0/4269963816 conn(0x7f65c8064a70 msgr2=0x7f65c8063ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:22.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.627+0000 7f65cda10700 1 -- 172.21.15.1:0/4269963816 shutdown_connections 2023-11-15T01:40:22.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.627+0000 7f65cda10700 1 -- 172.21.15.1:0/4269963816 wait complete. 2023-11-15T01:40:22.643 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-15T01:40:22.643 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-15T01:40:22.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.770+0000 7fcfea664700 1 Processor -- start 2023-11-15T01:40:22.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.770+0000 7fcfea664700 1 -- start start 2023-11-15T01:40:22.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.771+0000 7fcfea664700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fcfe4062ec0 0x7fcfe414eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:22.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.771+0000 7fcfea664700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcfe4155370 0x7fcfe40c6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:22.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.771+0000 7fcfea664700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe4158e40 con 0x7fcfe414e6e0 2023-11-15T01:40:22.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.771+0000 7fcfea664700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe4158230 con 0x7fcfe4155370 2023-11-15T01:40:22.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.771+0000 7fcfea664700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe4158510 con 0x7fcfe4062ec0 2023-11-15T01:40:22.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.771+0000 7fcfe8c01700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcfe4155370 0x7fcfe40c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:22.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.771+0000 7fcfe8c01700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcfe4155370 0x7fcfe40c6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59168/0 (socket says 172.21.15.1:59168) 2023-11-15T01:40:22.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.771+0000 7fcfe8c01700 1 -- 172.21.15.1:0/2779441491 learned_addr learned my addr 172.21.15.1:0/2779441491 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:22.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.771+0000 7fcfe37fe700 1 --2- 172.21.15.1:0/2779441491 >> v2:172.21.15.141:3300/0 conn(0x7fcfe4062ec0 0x7fcfe414eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:22.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfe8c01700 1 -- 172.21.15.1:0/2779441491 >> v2:172.21.15.141:3300/0 conn(0x7fcfe4062ec0 msgr2=0x7fcfe414eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:22.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfe8c01700 1 --2- 172.21.15.1:0/2779441491 >> v2:172.21.15.141:3300/0 conn(0x7fcfe4062ec0 0x7fcfe414eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:22.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfe8c01700 1 -- 172.21.15.1:0/2779441491 >> v1:172.21.15.141:6789/0 conn(0x7fcfe414e6e0 legacy=0x7fcfe40627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:22.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfe8c01700 1 -- 172.21.15.1:0/2779441491 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe41587f0 con 0x7fcfe4155370 2023-11-15T01:40:22.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfe8c01700 1 --2- 172.21.15.1:0/2779441491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe4155370 0x7fcfe40c6480 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fcfe40c5d20 tx=0x7fcfdc009840).ready entity=mon.0 client_cookie=de1fee9f0c5a0cf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:22.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfe2ffd700 1 -- 172.21.15.1:0/2779441491 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc00e070 con 0x7fcfe4155370 2023-11-15T01:40:22.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfe2ffd700 1 -- 172.21.15.1:0/2779441491 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfdc00ba20 con 0x7fcfe4155370 2023-11-15T01:40:22.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfe2ffd700 1 -- 172.21.15.1:0/2779441491 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc00bda0 con 0x7fcfe4155370 2023-11-15T01:40:22.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfea664700 1 -- 172.21.15.1:0/2779441491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe4155370 msgr2=0x7fcfe40c6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:22.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfea664700 1 --2- 172.21.15.1:0/2779441491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe4155370 0x7fcfe40c6480 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fcfe40c5d20 tx=0x7fcfdc009840).stop 2023-11-15T01:40:22.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfea664700 1 -- 172.21.15.1:0/2779441491 shutdown_connections 2023-11-15T01:40:22.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfea664700 1 --2- 172.21.15.1:0/2779441491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe4155370 0x7fcfe40c6480 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:22.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfea664700 1 --2- 172.21.15.1:0/2779441491 >> v2:172.21.15.141:3300/0 conn(0x7fcfe4062ec0 0x7fcfe414eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:22.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfea664700 1 -- 172.21.15.1:0/2779441491 >> 172.21.15.1:0/2779441491 conn(0x7fcfe40c7dc0 msgr2=0x7fcfe40c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:22.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfea664700 1 -- 172.21.15.1:0/2779441491 shutdown_connections 2023-11-15T01:40:22.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.772+0000 7fcfea664700 1 -- 172.21.15.1:0/2779441491 wait complete. 2023-11-15T01:40:22.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.773+0000 7fcfea664700 1 Processor -- start 2023-11-15T01:40:22.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.774+0000 7fcfea664700 1 -- start start 2023-11-15T01:40:22.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.774+0000 7fcfea664700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe4062ec0 0x7fcfe40a5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:22.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.774+0000 7fcfea664700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfe414e6e0 0x7fcfe40a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:22.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.774+0000 7fcfea664700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe4155370 0x7fcfe40670c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:22.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.774+0000 7fcfea664700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40a5180 con 0x7fcfe4062ec0 2023-11-15T01:40:22.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.774+0000 7fcfea664700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40a4870 con 0x7fcfe414e6e0 2023-11-15T01:40:22.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.774+0000 7fcfea664700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe4164cf0 con 0x7fcfe4155370 2023-11-15T01:40:22.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfe3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe4062ec0 0x7fcfe40a5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:22.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfe3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe4062ec0 0x7fcfe40a5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59182/0 (socket says 172.21.15.1:59182) 2023-11-15T01:40:22.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfe3fff700 1 -- 172.21.15.1:0/3904314041 learned_addr learned my addr 172.21.15.1:0/3904314041 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:22.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfe37fe700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfe414e6e0 0x7fcfe40a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:22.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfe8c01700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe4155370 0x7fcfe40670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:22.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfe3fff700 1 -- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe4155370 msgr2=0x7fcfe40670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:22.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfe3fff700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe4155370 0x7fcfe40670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:22.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfe3fff700 1 -- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfe414e6e0 msgr2=0x7fcfe40a6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:22.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfe3fff700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfe414e6e0 0x7fcfe40a6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:22.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfe3fff700 1 -- 172.21.15.1:0/3904314041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc009ae0 con 0x7fcfe4062ec0 2023-11-15T01:40:22.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfe8c01700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe4155370 0x7fcfe40670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:40:22.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfe37fe700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfe414e6e0 0x7fcfe40a6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:40:22.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfe3fff700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe4062ec0 0x7fcfe40a5610 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fcfcc00c4c0 tx=0x7fcfcc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:22.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfdbfff700 1 -- 172.21.15.1:0/3904314041 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc007020 con 0x7fcfe4062ec0 2023-11-15T01:40:22.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfdbfff700 1 -- 172.21.15.1:0/3904314041 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc001e90 con 0x7fcfe4062ec0 2023-11-15T01:40:22.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfea664700 1 -- 172.21.15.1:0/3904314041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe40a4b30 con 0x7fcfe4062ec0 2023-11-15T01:40:22.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfdbfff700 1 -- 172.21.15.1:0/3904314041 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0073b0 con 0x7fcfe4062ec0 2023-11-15T01:40:22.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.775+0000 7fcfea664700 1 -- 172.21.15.1:0/3904314041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe40a74b0 con 0x7fcfe4062ec0 2023-11-15T01:40:22.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.776+0000 7fcfea664700 1 -- 172.21.15.1:0/3904314041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe406c7e0 con 0x7fcfe4062ec0 2023-11-15T01:40:22.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.777+0000 7fcfdbfff700 1 -- 172.21.15.1:0/3904314041 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcfcc0068b0 con 0x7fcfe4062ec0 2023-11-15T01:40:22.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.778+0000 7fcfdbfff700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfc405f270 0x7fcfc4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:22.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.778+0000 7fcfdbfff700 1 -- 172.21.15.1:0/3904314041 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7fcfcc07a650 con 0x7fcfe4062ec0 2023-11-15T01:40:22.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.778+0000 7fcfe37fe700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfc405f270 0x7fcfc4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:22.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.778+0000 7fcfe37fe700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfc405f270 0x7fcfc4061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fcfd4006d80 tx=0x7fcfd4008040).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:22.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:22.781+0000 7fcfdbfff700 1 -- 172.21.15.1:0/3904314041 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcfcc04b5a0 con 0x7fcfe4062ec0 2023-11-15T01:40:23.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.001+0000 7fcfea664700 1 -- 172.21.15.1:0/3904314041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcfe4158ad0 con 0x7fcfe4062ec0 2023-11-15T01:40:23.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.628+0000 7fcfdbfff700 1 -- 172.21.15.1:0/3904314041 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v63) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcfcc04ebc0 con 0x7fcfe4062ec0 2023-11-15T01:40:23.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.631+0000 7fcfea664700 1 -- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfc405f270 msgr2=0x7fcfc4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:23.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.631+0000 7fcfea664700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfc405f270 0x7fcfc4061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fcfd4006d80 tx=0x7fcfd4008040).stop 2023-11-15T01:40:23.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.631+0000 7fcfea664700 1 -- 172.21.15.1:0/3904314041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe4062ec0 msgr2=0x7fcfe40a5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:23.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.631+0000 7fcfea664700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe4062ec0 0x7fcfe40a5610 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fcfcc00c4c0 tx=0x7fcfcc007e00).stop 2023-11-15T01:40:23.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.631+0000 7fcfea664700 1 -- 172.21.15.1:0/3904314041 shutdown_connections 2023-11-15T01:40:23.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.631+0000 7fcfea664700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcfc405f270 0x7fcfc4061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:23.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.631+0000 7fcfea664700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfe4155370 0x7fcfe40670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:23.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.631+0000 7fcfea664700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfe4062ec0 0x7fcfe40a5610 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:23.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.631+0000 7fcfea664700 1 --2- 172.21.15.1:0/3904314041 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfe414e6e0 0x7fcfe40a6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:23.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.631+0000 7fcfea664700 1 -- 172.21.15.1:0/3904314041 >> 172.21.15.1:0/3904314041 conn(0x7fcfe40c7dc0 msgr2=0x7fcfe40c7130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:23.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.631+0000 7fcfea664700 1 -- 172.21.15.1:0/3904314041 shutdown_connections 2023-11-15T01:40:23.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.631+0000 7fcfea664700 1 -- 172.21.15.1:0/3904314041 wait complete. 2023-11-15T01:40:23.647 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-15T01:40:23.647 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:40:23.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.770+0000 7f546636c700 1 Processor -- start 2023-11-15T01:40:23.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.770+0000 7f546636c700 1 -- start start 2023-11-15T01:40:23.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f546636c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5460151e10 0x7f5460155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:23.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f546636c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f54600c98b0 0x7f54600c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:23.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f546636c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54600c7980 con 0x7f54600c86b0 2023-11-15T01:40:23.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f546636c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54600c8b10 con 0x7f5460151e10 2023-11-15T01:40:23.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f546636c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54600aa890 con 0x7f54600c98b0 2023-11-15T01:40:23.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f546536a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5460151e10 0x7f5460155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:23.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f546536a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5460151e10 0x7f5460155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59188/0 (socket says 172.21.15.1:59188) 2023-11-15T01:40:23.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f546536a700 1 -- 172.21.15.1:0/380783624 learned_addr learned my addr 172.21.15.1:0/380783624 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f5464b69700 1 --1- 172.21.15.1:0/380783624 >> v1:172.21.15.1:6789/0 conn(0x7f54600c86b0 0x7f54600aa0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34766/0 (socket says 172.21.15.1:34766) 2023-11-15T01:40:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f5465b6b700 1 --2- 172.21.15.1:0/380783624 >> v2:172.21.15.141:3300/0 conn(0x7f54600c98b0 0x7f54600c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f546536a700 1 -- 172.21.15.1:0/380783624 >> v2:172.21.15.141:3300/0 conn(0x7f54600c98b0 msgr2=0x7f54600c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f546536a700 1 --2- 172.21.15.1:0/380783624 >> v2:172.21.15.141:3300/0 conn(0x7f54600c98b0 0x7f54600c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f546536a700 1 -- 172.21.15.1:0/380783624 >> v1:172.21.15.1:6789/0 conn(0x7f54600c86b0 legacy=0x7f54600aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:23.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f545ffff700 1 -- 172.21.15.1:0/380783624 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273841206 0 0) 0x7f54600c7980 con 0x7f54600c86b0 2023-11-15T01:40:23.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f546536a700 1 -- 172.21.15.1:0/380783624 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54600c7bd0 con 0x7f5460151e10 2023-11-15T01:40:23.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.771+0000 7f546536a700 1 --2- 172.21.15.1:0/380783624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5460151e10 0x7f5460155530 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f54600c9730 tx=0x7f5450009840).ready entity=mon.0 client_cookie=5aa70e3a30936fff server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:23.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.772+0000 7f545ffff700 1 -- 172.21.15.1:0/380783624 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545000e070 con 0x7f5460151e10 2023-11-15T01:40:23.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.772+0000 7f545ffff700 1 -- 172.21.15.1:0/380783624 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545000ba50 con 0x7f5460151e10 2023-11-15T01:40:23.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.772+0000 7f545ffff700 1 -- 172.21.15.1:0/380783624 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545000bdd0 con 0x7f5460151e10 2023-11-15T01:40:23.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.772+0000 7f546636c700 1 -- 172.21.15.1:0/380783624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5460151e10 msgr2=0x7f5460155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:23.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.772+0000 7f546636c700 1 --2- 172.21.15.1:0/380783624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5460151e10 0x7f5460155530 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f54600c9730 tx=0x7f5450009840).stop 2023-11-15T01:40:23.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.772+0000 7f546636c700 1 -- 172.21.15.1:0/380783624 shutdown_connections 2023-11-15T01:40:23.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.772+0000 7f546636c700 1 --2- 172.21.15.1:0/380783624 >> v2:172.21.15.141:3300/0 conn(0x7f54600c98b0 0x7f54600c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:23.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.772+0000 7f546636c700 1 --2- 172.21.15.1:0/380783624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5460151e10 0x7f5460155530 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:23.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.772+0000 7f546636c700 1 -- 172.21.15.1:0/380783624 >> 172.21.15.1:0/380783624 conn(0x7f54600947e0 msgr2=0x7f546006a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:23.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.772+0000 7f546636c700 1 -- 172.21.15.1:0/380783624 shutdown_connections 2023-11-15T01:40:23.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.772+0000 7f546636c700 1 -- 172.21.15.1:0/380783624 wait complete. 2023-11-15T01:40:23.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.773+0000 7f546636c700 1 Processor -- start 2023-11-15T01:40:23.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.773+0000 7f546636c700 1 -- start start 2023-11-15T01:40:23.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.774+0000 7f546636c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f54600c86b0 0x7f5460163e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:23.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.774+0000 7f546636c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600c98b0 0x7f54600b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:23.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.774+0000 7f546636c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5460151e10 0x7f54600ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:23.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.774+0000 7f546636c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54600ab6d0 con 0x7f54600c98b0 2023-11-15T01:40:23.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.774+0000 7f546636c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54600aada0 con 0x7f54600c86b0 2023-11-15T01:40:23.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.774+0000 7f546636c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54600ab080 con 0x7f5460151e10 2023-11-15T01:40:23.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.774+0000 7f5464b69700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600c98b0 0x7f54600b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:23.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.774+0000 7f5464b69700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600c98b0 0x7f54600b0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59190/0 (socket says 172.21.15.1:59190) 2023-11-15T01:40:23.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.774+0000 7f5464b69700 1 -- 172.21.15.1:0/1321494966 learned_addr learned my addr 172.21.15.1:0/1321494966 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:23.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.775+0000 7f546536a700 1 --2- 172.21.15.1:0/1321494966 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f54600c86b0 0x7f5460163e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:23.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.775+0000 7f5465b6b700 1 --2- 172.21.15.1:0/1321494966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5460151e10 0x7f54600ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:23.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.775+0000 7f5464b69700 1 -- 172.21.15.1:0/1321494966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5460151e10 msgr2=0x7f54600ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:23.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.775+0000 7f5464b69700 1 --2- 172.21.15.1:0/1321494966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5460151e10 0x7f54600ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:23.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.775+0000 7f5464b69700 1 -- 172.21.15.1:0/1321494966 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f54600c86b0 msgr2=0x7f5460163e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:23.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.775+0000 7f5464b69700 1 --2- 172.21.15.1:0/1321494966 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f54600c86b0 0x7f5460163e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:23.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.775+0000 7f5464b69700 1 -- 172.21.15.1:0/1321494966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5450009ae0 con 0x7f54600c98b0 2023-11-15T01:40:23.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.775+0000 7f5464b69700 1 --2- 172.21.15.1:0/1321494966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600c98b0 0x7f54600b0160 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f545400c560 tx=0x7f5454007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:23.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.775+0000 7f545d7fa700 1 -- 172.21.15.1:0/1321494966 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54540072e0 con 0x7f54600c98b0 2023-11-15T01:40:23.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.775+0000 7f545d7fa700 1 -- 172.21.15.1:0/1321494966 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5454007440 con 0x7f54600c98b0 2023-11-15T01:40:23.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.775+0000 7f546636c700 1 -- 172.21.15.1:0/1321494966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54600ab360 con 0x7f54600c98b0 2023-11-15T01:40:23.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.775+0000 7f545d7fa700 1 -- 172.21.15.1:0/1321494966 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54540058f0 con 0x7f54600c98b0 2023-11-15T01:40:23.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.775+0000 7f546636c700 1 -- 172.21.15.1:0/1321494966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54600b0650 con 0x7f54600c98b0 2023-11-15T01:40:23.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.776+0000 7f546636c700 1 -- 172.21.15.1:0/1321494966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54600ab880 con 0x7f54600c98b0 2023-11-15T01:40:23.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.776+0000 7f545d7fa700 1 -- 172.21.15.1:0/1321494966 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5454005ce0 con 0x7f54600c98b0 2023-11-15T01:40:23.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.777+0000 7f545d7fa700 1 --2- 172.21.15.1:0/1321494966 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f544c05f270 0x7f544c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:23.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.777+0000 7f545d7fa700 1 -- 172.21.15.1:0/1321494966 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f5454079f70 con 0x7f54600c98b0 2023-11-15T01:40:23.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.777+0000 7f546536a700 1 --2- 172.21.15.1:0/1321494966 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f544c05f270 0x7f544c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:23.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.777+0000 7f546536a700 1 --2- 172.21.15.1:0/1321494966 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f544c05f270 0x7f544c061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f54500070b0 tx=0x7f5450009840).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:23.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.781+0000 7f545d7fa700 1 -- 172.21.15.1:0/1321494966 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f54600ab880 con 0x7f54600c98b0 2023-11-15T01:40:23.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.996+0000 7f546636c700 1 -- 172.21.15.1:0/1321494966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54600b0870 con 0x7f54600c98b0 2023-11-15T01:40:23.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.997+0000 7f545d7fa700 1 -- 172.21.15.1:0/1321494966 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f5454018030 con 0x7f54600c98b0 2023-11-15T01:40:23.999 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:23.999 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/2941509435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":2941509435},{"type":"v1","addr":"172.21.15.141:6837","nonce":2941509435}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/698727670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":698727670},{"type":"v1","addr":"172.21.15.141:6836","nonce":698727670}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2035210342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2035210342},{"type":"v1","addr":"172.21.15.1:6834","nonce":2035210342}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:40:20.613231+0000","modified":"2023-11-15T01:40:23.624230+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/2320712503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":2320712503},{"type":"v1","addr":"172.21.15.1:6835","nonce":2320712503}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-11-15T01:40:24.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.999+0000 7f546636c700 1 -- 172.21.15.1:0/1321494966 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f544c05f270 msgr2=0x7f544c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.999+0000 7f546636c700 1 --2- 172.21.15.1:0/1321494966 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f544c05f270 0x7f544c061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f54500070b0 tx=0x7f5450009840).stop 2023-11-15T01:40:24.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.999+0000 7f546636c700 1 -- 172.21.15.1:0/1321494966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600c98b0 msgr2=0x7f54600b0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.999+0000 7f546636c700 1 --2- 172.21.15.1:0/1321494966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600c98b0 0x7f54600b0160 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f545400c560 tx=0x7f5454007c90).stop 2023-11-15T01:40:24.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.999+0000 7f546636c700 1 -- 172.21.15.1:0/1321494966 shutdown_connections 2023-11-15T01:40:24.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.999+0000 7f546636c700 1 --2- 172.21.15.1:0/1321494966 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f544c05f270 0x7f544c061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.999+0000 7f546636c700 1 --2- 172.21.15.1:0/1321494966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5460151e10 0x7f54600ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.999+0000 7f546636c700 1 --2- 172.21.15.1:0/1321494966 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f54600c86b0 0x7f5460163e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.999+0000 7f546636c700 1 --2- 172.21.15.1:0/1321494966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600c98b0 0x7f54600b0160 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.999+0000 7f546636c700 1 -- 172.21.15.1:0/1321494966 >> 172.21.15.1:0/1321494966 conn(0x7f54600947e0 msgr2=0x7f54600c6160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:24.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.999+0000 7f546636c700 1 -- 172.21.15.1:0/1321494966 shutdown_connections 2023-11-15T01:40:24.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:23.999+0000 7f546636c700 1 -- 172.21.15.1:0/1321494966 wait complete. 2023-11-15T01:40:24.003 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 63 2023-11-15T01:40:24.012 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T01:40:24.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.129+0000 7f5f8d41e700 1 Processor -- start 2023-11-15T01:40:24.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.129+0000 7f5f8d41e700 1 -- start start 2023-11-15T01:40:24.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f8d41e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5f880ca9b0 0x7f5f880c0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f8d41e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f8806a6c0 0x7f5f880c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f8d41e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f881559e0 con 0x7f5f880c8390 2023-11-15T01:40:24.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f8d41e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f880c15b0 con 0x7f5f880ca9b0 2023-11-15T01:40:24.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f8d41e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880c7560 con 0x7f5f8806a6c0 2023-11-15T01:40:24.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f86ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5f880ca9b0 0x7f5f880c0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f867fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5f880c8390 0x7f5f8814e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34772/0 (socket says 172.21.15.1:34772) 2023-11-15T01:40:24.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f867fc700 1 -- 172.21.15.1:0/3119681496 learned_addr learned my addr 172.21.15.1:0/3119681496 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:24.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f877fe700 1 --2- 172.21.15.1:0/3119681496 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f8806a6c0 0x7f5f880c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f86ffd700 1 -- 172.21.15.1:0/3119681496 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f8806a6c0 msgr2=0x7f5f880c10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:24.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f86ffd700 1 --2- 172.21.15.1:0/3119681496 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f8806a6c0 0x7f5f880c10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f86ffd700 1 -- 172.21.15.1:0/3119681496 >> v1:172.21.15.1:6789/0 conn(0x7f5f880c8390 legacy=0x7f5f8814e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f86ffd700 1 -- 172.21.15.1:0/3119681496 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f88154dd0 con 0x7f5f880ca9b0 2023-11-15T01:40:24.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f877fe700 1 --2- 172.21.15.1:0/3119681496 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f8806a6c0 0x7f5f880c10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:24.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f85ffb700 1 -- 172.21.15.1:0/3119681496 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083492976 0 0) 0x7f5f881559e0 con 0x7f5f880c8390 2023-11-15T01:40:24.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.130+0000 7f5f86ffd700 1 --2- 172.21.15.1:0/3119681496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f880ca9b0 0x7f5f880c0bd0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f5f80009eb0 tx=0x7f5f80009780).ready entity=mon.0 client_cookie=bdfc0305e067c1cd server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:24.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.131+0000 7f5f85ffb700 1 -- 172.21.15.1:0/3119681496 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8000e070 con 0x7f5f880ca9b0 2023-11-15T01:40:24.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.131+0000 7f5f85ffb700 1 -- 172.21.15.1:0/3119681496 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8000bc30 con 0x7f5f880ca9b0 2023-11-15T01:40:24.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.131+0000 7f5f85ffb700 1 -- 172.21.15.1:0/3119681496 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80012410 con 0x7f5f880ca9b0 2023-11-15T01:40:24.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.131+0000 7f5f8d41e700 1 -- 172.21.15.1:0/3119681496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f880ca9b0 msgr2=0x7f5f880c0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.131+0000 7f5f8d41e700 1 --2- 172.21.15.1:0/3119681496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f880ca9b0 0x7f5f880c0bd0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f5f80009eb0 tx=0x7f5f80009780).stop 2023-11-15T01:40:24.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.131+0000 7f5f8d41e700 1 -- 172.21.15.1:0/3119681496 shutdown_connections 2023-11-15T01:40:24.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.131+0000 7f5f8d41e700 1 --2- 172.21.15.1:0/3119681496 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f8806a6c0 0x7f5f880c10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.131+0000 7f5f8d41e700 1 --2- 172.21.15.1:0/3119681496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f880ca9b0 0x7f5f880c0bd0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.131+0000 7f5f8d41e700 1 -- 172.21.15.1:0/3119681496 >> 172.21.15.1:0/3119681496 conn(0x7f5f88084ec0 msgr2=0x7f5f880947e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:24.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.131+0000 7f5f8d41e700 1 -- 172.21.15.1:0/3119681496 shutdown_connections 2023-11-15T01:40:24.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.131+0000 7f5f8d41e700 1 -- 172.21.15.1:0/3119681496 wait complete. 2023-11-15T01:40:24.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.132+0000 7f5f8d41e700 1 Processor -- start 2023-11-15T01:40:24.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.132+0000 7f5f8d41e700 1 -- start start 2023-11-15T01:40:24.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.133+0000 7f5f8d41e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f8806a6c0 0x7f5f88151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.133+0000 7f5f8d41e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f880c8390 0x7f5f880c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.133+0000 7f5f8d41e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f880ca9b0 0x7f5f880c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.133+0000 7f5f8d41e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880c4910 con 0x7f5f880c8390 2023-11-15T01:40:24.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.133+0000 7f5f8d41e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f88159c20 con 0x7f5f880ca9b0 2023-11-15T01:40:24.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.133+0000 7f5f8d41e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f88155c30 con 0x7f5f8806a6c0 2023-11-15T01:40:24.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.133+0000 7f5f867fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f880c8390 0x7f5f880c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.133+0000 7f5f867fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f880c8390 0x7f5f880c3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59198/0 (socket says 172.21.15.1:59198) 2023-11-15T01:40:24.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.133+0000 7f5f867fc700 1 -- 172.21.15.1:0/3503579915 learned_addr learned my addr 172.21.15.1:0/3503579915 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:24.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.134+0000 7f5f86ffd700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f8806a6c0 0x7f5f88151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.134+0000 7f5f877fe700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f880ca9b0 0x7f5f880c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.134+0000 7f5f867fc700 1 -- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f8806a6c0 msgr2=0x7f5f88151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.134+0000 7f5f867fc700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f8806a6c0 0x7f5f88151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.134+0000 7f5f867fc700 1 -- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f880ca9b0 msgr2=0x7f5f880c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.134+0000 7f5f867fc700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f880ca9b0 0x7f5f880c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.134+0000 7f5f867fc700 1 -- 172.21.15.1:0/3503579915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f80009a20 con 0x7f5f880c8390 2023-11-15T01:40:24.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.134+0000 7f5f86ffd700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f8806a6c0 0x7f5f88151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:40:24.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.134+0000 7f5f877fe700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f880ca9b0 0x7f5f880c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:40:24.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.134+0000 7f5f867fc700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f880c8390 0x7f5f880c3f30 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f5f7000c4e0 tx=0x7f5f70007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:24.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.134+0000 7f5f7effd700 1 -- 172.21.15.1:0/3503579915 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f700072e0 con 0x7f5f880c8390 2023-11-15T01:40:24.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.134+0000 7f5f7effd700 1 -- 172.21.15.1:0/3503579915 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f70007440 con 0x7f5f880c8390 2023-11-15T01:40:24.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.134+0000 7f5f8d41e700 1 -- 172.21.15.1:0/3503579915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f88155f10 con 0x7f5f880c8390 2023-11-15T01:40:24.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.134+0000 7f5f7effd700 1 -- 172.21.15.1:0/3503579915 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f700057a0 con 0x7f5f880c8390 2023-11-15T01:40:24.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.134+0000 7f5f8d41e700 1 -- 172.21.15.1:0/3503579915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f881564d0 con 0x7f5f880c8390 2023-11-15T01:40:24.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.135+0000 7f5f8d41e700 1 -- 172.21.15.1:0/3503579915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f880475e0 con 0x7f5f880c8390 2023-11-15T01:40:24.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.135+0000 7f5f7effd700 1 -- 172.21.15.1:0/3503579915 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5f70005bd0 con 0x7f5f880c8390 2023-11-15T01:40:24.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.136+0000 7f5f7effd700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f6805f270 0x7f5f68061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.136+0000 7f5f7effd700 1 -- 172.21.15.1:0/3503579915 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f5f70079fc0 con 0x7f5f880c8390 2023-11-15T01:40:24.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.136+0000 7f5f86ffd700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f6805f270 0x7f5f68061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.137+0000 7f5f86ffd700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f6805f270 0x7f5f68061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5f800097c0 tx=0x7f5f80017000).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:24.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.140+0000 7f5f7effd700 1 -- 172.21.15.1:0/3503579915 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5f7004af50 con 0x7f5f880c8390 2023-11-15T01:40:24.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.316+0000 7f5f8d41e700 1 -- 172.21.15.1:0/3503579915 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f8805f8b0 con 0x7f5f880c8390 2023-11-15T01:40:24.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.317+0000 7f5f7effd700 1 -- 172.21.15.1:0/3503579915 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+17584 (secure 0 0 0) 0x7f5f70018070 con 0x7f5f880c8390 2023-11-15T01:40:24.319 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:24.319 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":141,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T01:40:21.614875+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:40:18.311095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-11-15T01:40:19.597093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T01:40:24.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.319+0000 7f5f8d41e700 1 -- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f6805f270 msgr2=0x7f5f68061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.319+0000 7f5f8d41e700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f6805f270 0x7f5f68061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5f800097c0 tx=0x7f5f80017000).stop 2023-11-15T01:40:24.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.319+0000 7f5f8d41e700 1 -- 172.21.15.1:0/3503579915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f880c8390 msgr2=0x7f5f880c3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.319+0000 7f5f8d41e700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f880c8390 0x7f5f880c3f30 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f5f7000c4e0 tx=0x7f5f70007c70).stop 2023-11-15T01:40:24.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.319+0000 7f5f8d41e700 1 -- 172.21.15.1:0/3503579915 shutdown_connections 2023-11-15T01:40:24.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.319+0000 7f5f8d41e700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f6805f270 0x7f5f68061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.319+0000 7f5f8d41e700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f880ca9b0 0x7f5f880c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.320+0000 7f5f8d41e700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f8806a6c0 0x7f5f88151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.320+0000 7f5f8d41e700 1 --2- 172.21.15.1:0/3503579915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f880c8390 0x7f5f880c3f30 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.320+0000 7f5f8d41e700 1 -- 172.21.15.1:0/3503579915 >> 172.21.15.1:0/3503579915 conn(0x7f5f88084ec0 msgr2=0x7f5f88064b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:24.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.320+0000 7f5f8d41e700 1 -- 172.21.15.1:0/3503579915 shutdown_connections 2023-11-15T01:40:24.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.320+0000 7f5f8d41e700 1 -- 172.21.15.1:0/3503579915 wait complete. 2023-11-15T01:40:24.333 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-15T01:40:24.334 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:40:24.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.450+0000 7f12b5444700 1 Processor -- start 2023-11-15T01:40:24.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.450+0000 7f12b5444700 1 -- start start 2023-11-15T01:40:24.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.451+0000 7f12b5444700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f12b00be390 0x7f12b00bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.451+0000 7f12b5444700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f12b00bd8f0 0x7f12b0154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.451+0000 7f12b5444700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b00ad5e0 con 0x7f12b00bdfb0 2023-11-15T01:40:24.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.451+0000 7f12b5444700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b00bccd0 con 0x7f12b00be390 2023-11-15T01:40:24.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.451+0000 7f12b5444700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b00ad8c0 con 0x7f12b00bd8f0 2023-11-15T01:40:24.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.451+0000 7f12ae7fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f12b00be390 0x7f12b00bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.451+0000 7f12aeffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f12b00bdfb0 0x7f12b00c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34784/0 (socket says 172.21.15.1:34784) 2023-11-15T01:40:24.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.451+0000 7f12aeffd700 1 -- 172.21.15.1:0/719353822 learned_addr learned my addr 172.21.15.1:0/719353822 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:24.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.451+0000 7f12ae7fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f12b00be390 0x7f12b00bd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59204/0 (socket says 172.21.15.1:59204) 2023-11-15T01:40:24.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.452+0000 7f12af7fe700 1 --2- 172.21.15.1:0/719353822 >> v2:172.21.15.141:3300/0 conn(0x7f12b00bd8f0 0x7f12b0154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.452+0000 7f12ae7fc700 1 -- 172.21.15.1:0/719353822 >> v2:172.21.15.141:3300/0 conn(0x7f12b00bd8f0 msgr2=0x7f12b0154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:24.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.452+0000 7f12ae7fc700 1 --2- 172.21.15.1:0/719353822 >> v2:172.21.15.141:3300/0 conn(0x7f12b00bd8f0 0x7f12b0154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.452+0000 7f12ae7fc700 1 -- 172.21.15.1:0/719353822 >> v1:172.21.15.1:6789/0 conn(0x7f12b00bdfb0 legacy=0x7f12b00c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.452+0000 7f12ae7fc700 1 -- 172.21.15.1:0/719353822 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b00adba0 con 0x7f12b00be390 2023-11-15T01:40:24.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.452+0000 7f12adffb700 1 -- 172.21.15.1:0/719353822 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692542841 0 0) 0x7f12b00ad5e0 con 0x7f12b00bdfb0 2023-11-15T01:40:24.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.452+0000 7f12ae7fc700 1 --2- 172.21.15.1:0/719353822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12b00be390 0x7f12b00bd400 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f12b0155f70 tx=0x7f129800b300).ready entity=mon.0 client_cookie=746376830a670a7f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:24.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.452+0000 7f12adffb700 1 -- 172.21.15.1:0/719353822 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129800da70 con 0x7f12b00be390 2023-11-15T01:40:24.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.452+0000 7f12adffb700 1 -- 172.21.15.1:0/719353822 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129800dbd0 con 0x7f12b00be390 2023-11-15T01:40:24.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.452+0000 7f12adffb700 1 -- 172.21.15.1:0/719353822 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298016520 con 0x7f12b00be390 2023-11-15T01:40:24.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.452+0000 7f12b5444700 1 -- 172.21.15.1:0/719353822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12b00be390 msgr2=0x7f12b00bd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.452+0000 7f12b5444700 1 --2- 172.21.15.1:0/719353822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12b00be390 0x7f12b00bd400 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f12b0155f70 tx=0x7f129800b300).stop 2023-11-15T01:40:24.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.453+0000 7f12b5444700 1 -- 172.21.15.1:0/719353822 shutdown_connections 2023-11-15T01:40:24.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.453+0000 7f12b5444700 1 --2- 172.21.15.1:0/719353822 >> v2:172.21.15.141:3300/0 conn(0x7f12b00bd8f0 0x7f12b0154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.453+0000 7f12b5444700 1 --2- 172.21.15.1:0/719353822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12b00be390 0x7f12b00bd400 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.453+0000 7f12b5444700 1 -- 172.21.15.1:0/719353822 >> 172.21.15.1:0/719353822 conn(0x7f12b00c7d70 msgr2=0x7f12b00c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:24.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.453+0000 7f12b5444700 1 -- 172.21.15.1:0/719353822 shutdown_connections 2023-11-15T01:40:24.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.453+0000 7f12b5444700 1 -- 172.21.15.1:0/719353822 wait complete. 2023-11-15T01:40:24.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.454+0000 7f12b5444700 1 Processor -- start 2023-11-15T01:40:24.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.454+0000 7f12b5444700 1 -- start start 2023-11-15T01:40:24.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12b5444700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12b00bd8f0 0x7f12b013eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12b5444700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12b00bdfb0 0x7f12b00a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12b5444700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12b00be390 0x7f12b00c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12b5444700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b00befa0 con 0x7f12b00bdfb0 2023-11-15T01:40:24.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12b5444700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b013efe0 con 0x7f12b00bd8f0 2023-11-15T01:40:24.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12b5444700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b00aa1a0 con 0x7f12b00be390 2023-11-15T01:40:24.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12ae7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12b00bdfb0 0x7f12b00a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12ae7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12b00bdfb0 0x7f12b00a76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59212/0 (socket says 172.21.15.1:59212) 2023-11-15T01:40:24.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12ae7fc700 1 -- 172.21.15.1:0/4007342083 learned_addr learned my addr 172.21.15.1:0/4007342083 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:24.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12af7fe700 1 --2- 172.21.15.1:0/4007342083 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12b00be390 0x7f12b00c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12aeffd700 1 --2- 172.21.15.1:0/4007342083 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12b00bd8f0 0x7f12b013eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12ae7fc700 1 -- 172.21.15.1:0/4007342083 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12b00be390 msgr2=0x7f12b00c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12ae7fc700 1 --2- 172.21.15.1:0/4007342083 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12b00be390 0x7f12b00c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12ae7fc700 1 -- 172.21.15.1:0/4007342083 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12b00bd8f0 msgr2=0x7f12b013eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12ae7fc700 1 --2- 172.21.15.1:0/4007342083 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12b00bd8f0 0x7f12b013eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12ae7fc700 1 -- 172.21.15.1:0/4007342083 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129800b540 con 0x7f12b00bdfb0 2023-11-15T01:40:24.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12ae7fc700 1 --2- 172.21.15.1:0/4007342083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12b00bdfb0 0x7f12b00a76e0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f12b00c5880 tx=0x7f129801b000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:24.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12a6ffd700 1 -- 172.21.15.1:0/4007342083 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298010470 con 0x7f12b00bdfb0 2023-11-15T01:40:24.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12a6ffd700 1 -- 172.21.15.1:0/4007342083 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12980105d0 con 0x7f12b00bdfb0 2023-11-15T01:40:24.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12b5444700 1 -- 172.21.15.1:0/4007342083 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b00aa480 con 0x7f12b00bdfb0 2023-11-15T01:40:24.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12a6ffd700 1 -- 172.21.15.1:0/4007342083 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298010990 con 0x7f12b00bdfb0 2023-11-15T01:40:24.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.455+0000 7f12b5444700 1 -- 172.21.15.1:0/4007342083 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b00bf490 con 0x7f12b00bdfb0 2023-11-15T01:40:24.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.457+0000 7f12b5444700 1 -- 172.21.15.1:0/4007342083 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b00aa640 con 0x7f12b00bdfb0 2023-11-15T01:40:24.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.457+0000 7f12a6ffd700 1 -- 172.21.15.1:0/4007342083 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1298010d00 con 0x7f12b00bdfb0 2023-11-15T01:40:24.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.457+0000 7f12a6ffd700 1 --2- 172.21.15.1:0/4007342083 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f129005f270 0x7f1290061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.457+0000 7f12a6ffd700 1 -- 172.21.15.1:0/4007342083 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f12980801f0 con 0x7f12b00bdfb0 2023-11-15T01:40:24.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.457+0000 7f12aeffd700 1 --2- 172.21.15.1:0/4007342083 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f129005f270 0x7f1290061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.458+0000 7f12aeffd700 1 --2- 172.21.15.1:0/4007342083 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f129005f270 0x7f1290061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f12b00c62d0 tx=0x7f12a8009040).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:24.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.461+0000 7f12a6ffd700 1 -- 172.21.15.1:0/4007342083 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1298051200 con 0x7f12b00bdfb0 2023-11-15T01:40:24.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.629+0000 7f12b5444700 1 -- 172.21.15.1:0/4007342083 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12b006c7e0 con 0x7f129005f270 2023-11-15T01:40:24.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.644+0000 7f12a6ffd700 1 -- 172.21.15.1:0/4007342083 <== mgr.6590 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358778 (secure 0 0 0) 0x7f12b006c7e0 con 0x7f129005f270 2023-11-15T01:40:24.650 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:24.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.649+0000 7f12b5444700 1 -- 172.21.15.1:0/4007342083 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f129005f270 msgr2=0x7f1290061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.649+0000 7f12b5444700 1 --2- 172.21.15.1:0/4007342083 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f129005f270 0x7f1290061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f12b00c62d0 tx=0x7f12a8009040).stop 2023-11-15T01:40:24.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.649+0000 7f12b5444700 1 -- 172.21.15.1:0/4007342083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12b00bdfb0 msgr2=0x7f12b00a76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.649+0000 7f12b5444700 1 --2- 172.21.15.1:0/4007342083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12b00bdfb0 0x7f12b00a76e0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f12b00c5880 tx=0x7f129801b000).stop 2023-11-15T01:40:24.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.649+0000 7f12b5444700 1 -- 172.21.15.1:0/4007342083 shutdown_connections 2023-11-15T01:40:24.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.649+0000 7f12b5444700 1 --2- 172.21.15.1:0/4007342083 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f129005f270 0x7f1290061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.649+0000 7f12b5444700 1 --2- 172.21.15.1:0/4007342083 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12b00be390 0x7f12b00c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.649+0000 7f12b5444700 1 --2- 172.21.15.1:0/4007342083 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12b00bd8f0 0x7f12b013eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.649+0000 7f12b5444700 1 --2- 172.21.15.1:0/4007342083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12b00bdfb0 0x7f12b00a76e0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.649+0000 7f12b5444700 1 -- 172.21.15.1:0/4007342083 >> 172.21.15.1:0/4007342083 conn(0x7f12b00c7d70 msgr2=0x7f12b014cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:24.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.649+0000 7f12b5444700 1 -- 172.21.15.1:0/4007342083 shutdown_connections 2023-11-15T01:40:24.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.649+0000 7f12b5444700 1 -- 172.21.15.1:0/4007342083 wait complete. 2023-11-15T01:40:24.656 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:40:24.671 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T01:40:23.192723+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2146,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":206,"acting":206,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2431344,"kb_used_data":13616,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752543376,"statfs":{"total":773094113280,"available":770604417024,"internally_reserved":0,"allocated":13942784,"data_stored":7268826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23363,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-75,"num_write_kb":-52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.002658"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3f","version":"140'3","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641930+0000","last_change":"2023-11-15T01:40:20.242944+0000","last_active":"2023-11-15T01:40:20.641930+0000","last_peered":"2023-11-15T01:40:20.641930+0000","last_clean":"2023-11-15T01:40:20.641930+0000","last_became_active":"2023-11-15T01:40:20.242665+0000","last_became_peered":"2023-11-15T01:40:20.242665+0000","last_unstale":"2023-11-15T01:40:20.641930+0000","last_undegraded":"2023-11-15T01:40:20.641930+0000","last_fullsized":"2023-11-15T01:40:20.641930+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646740+0000","last_change":"2023-11-15T01:40:20.642233+0000","last_active":"2023-11-15T01:40:20.646740+0000","last_peered":"2023-11-15T01:40:20.646740+0000","last_clean":"2023-11-15T01:40:20.646740+0000","last_became_active":"2023-11-15T01:40:20.641850+0000","last_became_peered":"2023-11-15T01:40:20.641850+0000","last_unstale":"2023-11-15T01:40:20.646740+0000","last_undegraded":"2023-11-15T01:40:20.646740+0000","last_fullsized":"2023-11-15T01:40:20.646740+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625020+0000","last_change":"2023-11-15T01:40:20.245583+0000","last_active":"2023-11-15T01:40:20.625020+0000","last_peered":"2023-11-15T01:40:20.625020+0000","last_clean":"2023-11-15T01:40:20.625020+0000","last_became_active":"2023-11-15T01:40:20.245315+0000","last_became_peered":"2023-11-15T01:40:20.245315+0000","last_unstale":"2023-11-15T01:40:20.625020+0000","last_undegraded":"2023-11-15T01:40:20.625020+0000","last_fullsized":"2023-11-15T01:40:20.625020+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647364+0000","last_change":"2023-11-15T01:40:20.643893+0000","last_active":"2023-11-15T01:40:20.647364+0000","last_peered":"2023-11-15T01:40:20.647364+0000","last_clean":"2023-11-15T01:40:20.647364+0000","last_became_active":"2023-11-15T01:40:20.643255+0000","last_became_peered":"2023-11-15T01:40:20.643255+0000","last_unstale":"2023-11-15T01:40:20.647364+0000","last_undegraded":"2023-11-15T01:40:20.647364+0000","last_fullsized":"2023-11-15T01:40:20.647364+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636409+0000","last_change":"2023-11-15T01:40:20.632940+0000","last_active":"2023-11-15T01:40:20.636409+0000","last_peered":"2023-11-15T01:40:20.636409+0000","last_clean":"2023-11-15T01:40:20.636409+0000","last_became_active":"2023-11-15T01:40:20.632656+0000","last_became_peered":"2023-11-15T01:40:20.632656+0000","last_unstale":"2023-11-15T01:40:20.636409+0000","last_undegraded":"2023-11-15T01:40:20.636409+0000","last_fullsized":"2023-11-15T01:40:20.636409+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643570+0000","last_change":"2023-11-15T01:40:20.241907+0000","last_active":"2023-11-15T01:40:20.643570+0000","last_peered":"2023-11-15T01:40:20.643570+0000","last_clean":"2023-11-15T01:40:20.643570+0000","last_became_active":"2023-11-15T01:40:20.241464+0000","last_became_peered":"2023-11-15T01:40:20.241464+0000","last_unstale":"2023-11-15T01:40:20.643570+0000","last_undegraded":"2023-11-15T01:40:20.643570+0000","last_fullsized":"2023-11-15T01:40:20.643570+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.639154+0000","last_change":"2023-11-15T01:40:20.632696+0000","last_active":"2023-11-15T01:40:20.639154+0000","last_peered":"2023-11-15T01:40:20.639154+0000","last_clean":"2023-11-15T01:40:20.639154+0000","last_became_active":"2023-11-15T01:40:20.632485+0000","last_became_peered":"2023-11-15T01:40:20.632485+0000","last_unstale":"2023-11-15T01:40:20.639154+0000","last_undegraded":"2023-11-15T01:40:20.639154+0000","last_fullsized":"2023-11-15T01:40:20.639154+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.631160+0000","last_change":"2023-11-15T01:40:20.241330+0000","last_active":"2023-11-15T01:40:20.631160+0000","last_peered":"2023-11-15T01:40:20.631160+0000","last_clean":"2023-11-15T01:40:20.631160+0000","last_became_active":"2023-11-15T01:40:20.240407+0000","last_became_peered":"2023-11-15T01:40:20.240407+0000","last_unstale":"2023-11-15T01:40:20.631160+0000","last_undegraded":"2023-11-15T01:40:20.631160+0000","last_fullsized":"2023-11-15T01:40:20.631160+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.644143+0000","last_change":"2023-11-15T01:40:20.641396+0000","last_active":"2023-11-15T01:40:20.644143+0000","last_peered":"2023-11-15T01:40:20.644143+0000","last_clean":"2023-11-15T01:40:20.644143+0000","last_became_active":"2023-11-15T01:40:20.641053+0000","last_became_peered":"2023-11-15T01:40:20.641053+0000","last_unstale":"2023-11-15T01:40:20.644143+0000","last_undegraded":"2023-11-15T01:40:20.644143+0000","last_fullsized":"2023-11-15T01:40:20.644143+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.638608+0000","last_change":"2023-11-15T01:40:20.244269+0000","last_active":"2023-11-15T01:40:20.638608+0000","last_peered":"2023-11-15T01:40:20.638608+0000","last_clean":"2023-11-15T01:40:20.638608+0000","last_became_active":"2023-11-15T01:40:20.243976+0000","last_became_peered":"2023-11-15T01:40:20.243976+0000","last_unstale":"2023-11-15T01:40:20.638608+0000","last_undegraded":"2023-11-15T01:40:20.638608+0000","last_fullsized":"2023-11-15T01:40:20.638608+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640654+0000","last_change":"2023-11-15T01:40:20.638613+0000","last_active":"2023-11-15T01:40:20.640654+0000","last_peered":"2023-11-15T01:40:20.640654+0000","last_clean":"2023-11-15T01:40:20.640654+0000","last_became_active":"2023-11-15T01:40:20.638313+0000","last_became_peered":"2023-11-15T01:40:20.638313+0000","last_unstale":"2023-11-15T01:40:20.640654+0000","last_undegraded":"2023-11-15T01:40:20.640654+0000","last_fullsized":"2023-11-15T01:40:20.640654+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636934+0000","last_change":"2023-11-15T01:40:20.634524+0000","last_active":"2023-11-15T01:40:20.636934+0000","last_peered":"2023-11-15T01:40:20.636934+0000","last_clean":"2023-11-15T01:40:20.636934+0000","last_became_active":"2023-11-15T01:40:20.634242+0000","last_became_peered":"2023-11-15T01:40:20.634242+0000","last_unstale":"2023-11-15T01:40:20.636934+0000","last_undegraded":"2023-11-15T01:40:20.636934+0000","last_fullsized":"2023-11-15T01:40:20.636934+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645055+0000","last_change":"2023-11-15T01:40:20.642990+0000","last_active":"2023-11-15T01:40:20.645055+0000","last_peered":"2023-11-15T01:40:20.645055+0000","last_clean":"2023-11-15T01:40:20.645055+0000","last_became_active":"2023-11-15T01:40:20.642491+0000","last_became_peered":"2023-11-15T01:40:20.642491+0000","last_unstale":"2023-11-15T01:40:20.645055+0000","last_undegraded":"2023-11-15T01:40:20.645055+0000","last_fullsized":"2023-11-15T01:40:20.645055+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621002+0000","last_change":"2023-11-15T01:40:20.246917+0000","last_active":"2023-11-15T01:40:20.621002+0000","last_peered":"2023-11-15T01:40:20.621002+0000","last_clean":"2023-11-15T01:40:20.621002+0000","last_became_active":"2023-11-15T01:40:20.245824+0000","last_became_peered":"2023-11-15T01:40:20.245824+0000","last_unstale":"2023-11-15T01:40:20.621002+0000","last_undegraded":"2023-11-15T01:40:20.621002+0000","last_fullsized":"2023-11-15T01:40:20.621002+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636954+0000","last_change":"2023-11-15T01:40:20.633914+0000","last_active":"2023-11-15T01:40:20.636954+0000","last_peered":"2023-11-15T01:40:20.636954+0000","last_clean":"2023-11-15T01:40:20.636954+0000","last_became_active":"2023-11-15T01:40:20.633572+0000","last_became_peered":"2023-11-15T01:40:20.633572+0000","last_unstale":"2023-11-15T01:40:20.636954+0000","last_undegraded":"2023-11-15T01:40:20.636954+0000","last_fullsized":"2023-11-15T01:40:20.636954+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621433+0000","last_change":"2023-11-15T01:40:20.242145+0000","last_active":"2023-11-15T01:40:20.621433+0000","last_peered":"2023-11-15T01:40:20.621433+0000","last_clean":"2023-11-15T01:40:20.621433+0000","last_became_active":"2023-11-15T01:40:20.241777+0000","last_became_peered":"2023-11-15T01:40:20.241777+0000","last_unstale":"2023-11-15T01:40:20.621433+0000","last_undegraded":"2023-11-15T01:40:20.621433+0000","last_fullsized":"2023-11-15T01:40:20.621433+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.644654+0000","last_change":"2023-11-15T01:40:20.643000+0000","last_active":"2023-11-15T01:40:20.644654+0000","last_peered":"2023-11-15T01:40:20.644654+0000","last_clean":"2023-11-15T01:40:20.644654+0000","last_became_active":"2023-11-15T01:40:20.642729+0000","last_became_peered":"2023-11-15T01:40:20.642729+0000","last_unstale":"2023-11-15T01:40:20.644654+0000","last_undegraded":"2023-11-15T01:40:20.644654+0000","last_fullsized":"2023-11-15T01:40:20.644654+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624849+0000","last_change":"2023-11-15T01:40:20.241858+0000","last_active":"2023-11-15T01:40:20.624849+0000","last_peered":"2023-11-15T01:40:20.624849+0000","last_clean":"2023-11-15T01:40:20.624849+0000","last_became_active":"2023-11-15T01:40:20.241543+0000","last_became_peered":"2023-11-15T01:40:20.241543+0000","last_unstale":"2023-11-15T01:40:20.624849+0000","last_undegraded":"2023-11-15T01:40:20.624849+0000","last_fullsized":"2023-11-15T01:40:20.624849+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646769+0000","last_change":"2023-11-15T01:40:20.240545+0000","last_active":"2023-11-15T01:40:20.646769+0000","last_peered":"2023-11-15T01:40:20.646769+0000","last_clean":"2023-11-15T01:40:20.646769+0000","last_became_active":"2023-11-15T01:40:20.239042+0000","last_became_peered":"2023-11-15T01:40:20.239042+0000","last_unstale":"2023-11-15T01:40:20.646769+0000","last_undegraded":"2023-11-15T01:40:20.646769+0000","last_fullsized":"2023-11-15T01:40:20.646769+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.635197+0000","last_change":"2023-11-15T01:40:20.631387+0000","last_active":"2023-11-15T01:40:20.635197+0000","last_peered":"2023-11-15T01:40:20.635197+0000","last_clean":"2023-11-15T01:40:20.635197+0000","last_became_active":"2023-11-15T01:40:20.631109+0000","last_became_peered":"2023-11-15T01:40:20.631109+0000","last_unstale":"2023-11-15T01:40:20.635197+0000","last_undegraded":"2023-11-15T01:40:20.635197+0000","last_fullsized":"2023-11-15T01:40:20.635197+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636721+0000","last_change":"2023-11-15T01:40:20.633661+0000","last_active":"2023-11-15T01:40:20.636721+0000","last_peered":"2023-11-15T01:40:20.636721+0000","last_clean":"2023-11-15T01:40:20.636721+0000","last_became_active":"2023-11-15T01:40:20.633445+0000","last_became_peered":"2023-11-15T01:40:20.633445+0000","last_unstale":"2023-11-15T01:40:20.636721+0000","last_undegraded":"2023-11-15T01:40:20.636721+0000","last_fullsized":"2023-11-15T01:40:20.636721+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646676+0000","last_change":"2023-11-15T01:40:20.637875+0000","last_active":"2023-11-15T01:40:20.646676+0000","last_peered":"2023-11-15T01:40:20.646676+0000","last_clean":"2023-11-15T01:40:20.646676+0000","last_became_active":"2023-11-15T01:40:20.637585+0000","last_became_peered":"2023-11-15T01:40:20.637585+0000","last_unstale":"2023-11-15T01:40:20.646676+0000","last_undegraded":"2023-11-15T01:40:20.646676+0000","last_fullsized":"2023-11-15T01:40:20.646676+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625633+0000","last_change":"2023-11-15T01:40:20.244237+0000","last_active":"2023-11-15T01:40:20.625633+0000","last_peered":"2023-11-15T01:40:20.625633+0000","last_clean":"2023-11-15T01:40:20.625633+0000","last_became_active":"2023-11-15T01:40:20.243903+0000","last_became_peered":"2023-11-15T01:40:20.243903+0000","last_unstale":"2023-11-15T01:40:20.625633+0000","last_undegraded":"2023-11-15T01:40:20.625633+0000","last_fullsized":"2023-11-15T01:40:20.625633+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641596+0000","last_change":"2023-11-15T01:40:20.637723+0000","last_active":"2023-11-15T01:40:20.641596+0000","last_peered":"2023-11-15T01:40:20.641596+0000","last_clean":"2023-11-15T01:40:20.641596+0000","last_became_active":"2023-11-15T01:40:20.637283+0000","last_became_peered":"2023-11-15T01:40:20.637283+0000","last_unstale":"2023-11-15T01:40:20.641596+0000","last_undegraded":"2023-11-15T01:40:20.641596+0000","last_fullsized":"2023-11-15T01:40:20.641596+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643228+0000","last_change":"2023-11-15T01:40:20.247664+0000","last_active":"2023-11-15T01:40:20.643228+0000","last_peered":"2023-11-15T01:40:20.643228+0000","last_clean":"2023-11-15T01:40:20.643228+0000","last_became_active":"2023-11-15T01:40:20.247230+0000","last_became_peered":"2023-11-15T01:40:20.247230+0000","last_unstale":"2023-11-15T01:40:20.643228+0000","last_undegraded":"2023-11-15T01:40:20.643228+0000","last_fullsized":"2023-11-15T01:40:20.643228+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643756+0000","last_change":"2023-11-15T01:40:20.641306+0000","last_active":"2023-11-15T01:40:20.643756+0000","last_peered":"2023-11-15T01:40:20.643756+0000","last_clean":"2023-11-15T01:40:20.643756+0000","last_became_active":"2023-11-15T01:40:20.641035+0000","last_became_peered":"2023-11-15T01:40:20.641035+0000","last_unstale":"2023-11-15T01:40:20.643756+0000","last_undegraded":"2023-11-15T01:40:20.643756+0000","last_fullsized":"2023-11-15T01:40:20.643756+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625156+0000","last_change":"2023-11-15T01:40:20.251493+0000","last_active":"2023-11-15T01:40:20.625156+0000","last_peered":"2023-11-15T01:40:20.625156+0000","last_clean":"2023-11-15T01:40:20.625156+0000","last_became_active":"2023-11-15T01:40:20.251199+0000","last_became_peered":"2023-11-15T01:40:20.251199+0000","last_unstale":"2023-11-15T01:40:20.625156+0000","last_undegraded":"2023-11-15T01:40:20.625156+0000","last_fullsized":"2023-11-15T01:40:20.625156+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645240+0000","last_change":"2023-11-15T01:40:20.638898+0000","last_active":"2023-11-15T01:40:20.645240+0000","last_peered":"2023-11-15T01:40:20.645240+0000","last_clean":"2023-11-15T01:40:20.645240+0000","last_became_active":"2023-11-15T01:40:20.638586+0000","last_became_peered":"2023-11-15T01:40:20.638586+0000","last_unstale":"2023-11-15T01:40:20.645240+0000","last_undegraded":"2023-11-15T01:40:20.645240+0000","last_fullsized":"2023-11-15T01:40:20.645240+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623288+0000","last_change":"2023-11-15T01:40:20.241464+0000","last_active":"2023-11-15T01:40:20.623288+0000","last_peered":"2023-11-15T01:40:20.623288+0000","last_clean":"2023-11-15T01:40:20.623288+0000","last_became_active":"2023-11-15T01:40:20.241198+0000","last_became_peered":"2023-11-15T01:40:20.241198+0000","last_unstale":"2023-11-15T01:40:20.623288+0000","last_undegraded":"2023-11-15T01:40:20.623288+0000","last_fullsized":"2023-11-15T01:40:20.623288+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647379+0000","last_change":"2023-11-15T01:40:20.644058+0000","last_active":"2023-11-15T01:40:20.647379+0000","last_peered":"2023-11-15T01:40:20.647379+0000","last_clean":"2023-11-15T01:40:20.647379+0000","last_became_active":"2023-11-15T01:40:20.643626+0000","last_became_peered":"2023-11-15T01:40:20.643626+0000","last_unstale":"2023-11-15T01:40:20.647379+0000","last_undegraded":"2023-11-15T01:40:20.647379+0000","last_fullsized":"2023-11-15T01:40:20.647379+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641162+0000","last_change":"2023-11-15T01:40:20.636946+0000","last_active":"2023-11-15T01:40:20.641162+0000","last_peered":"2023-11-15T01:40:20.641162+0000","last_clean":"2023-11-15T01:40:20.641162+0000","last_became_active":"2023-11-15T01:40:20.636691+0000","last_became_peered":"2023-11-15T01:40:20.636691+0000","last_unstale":"2023-11-15T01:40:20.641162+0000","last_undegraded":"2023-11-15T01:40:20.641162+0000","last_fullsized":"2023-11-15T01:40:20.641162+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623449+0000","last_change":"2023-11-15T01:40:20.246711+0000","last_active":"2023-11-15T01:40:20.623449+0000","last_peered":"2023-11-15T01:40:20.623449+0000","last_clean":"2023-11-15T01:40:20.623449+0000","last_became_active":"2023-11-15T01:40:20.246122+0000","last_became_peered":"2023-11-15T01:40:20.246122+0000","last_unstale":"2023-11-15T01:40:20.623449+0000","last_undegraded":"2023-11-15T01:40:20.623449+0000","last_fullsized":"2023-11-15T01:40:20.623449+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641958+0000","last_change":"2023-11-15T01:40:20.241698+0000","last_active":"2023-11-15T01:40:20.641958+0000","last_peered":"2023-11-15T01:40:20.641958+0000","last_clean":"2023-11-15T01:40:20.641958+0000","last_became_active":"2023-11-15T01:40:20.241234+0000","last_became_peered":"2023-11-15T01:40:20.241234+0000","last_unstale":"2023-11-15T01:40:20.641958+0000","last_undegraded":"2023-11-15T01:40:20.641958+0000","last_fullsized":"2023-11-15T01:40:20.641958+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626753+0000","last_change":"2023-11-15T01:40:20.237581+0000","last_active":"2023-11-15T01:40:20.626753+0000","last_peered":"2023-11-15T01:40:20.626753+0000","last_clean":"2023-11-15T01:40:20.626753+0000","last_became_active":"2023-11-15T01:40:20.237275+0000","last_became_peered":"2023-11-15T01:40:20.237275+0000","last_unstale":"2023-11-15T01:40:20.626753+0000","last_undegraded":"2023-11-15T01:40:20.626753+0000","last_fullsized":"2023-11-15T01:40:20.626753+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.648077+0000","last_change":"2023-11-15T01:40:20.642674+0000","last_active":"2023-11-15T01:40:20.648077+0000","last_peered":"2023-11-15T01:40:20.648077+0000","last_clean":"2023-11-15T01:40:20.648077+0000","last_became_active":"2023-11-15T01:40:20.642262+0000","last_became_peered":"2023-11-15T01:40:20.642262+0000","last_unstale":"2023-11-15T01:40:20.648077+0000","last_undegraded":"2023-11-15T01:40:20.648077+0000","last_fullsized":"2023-11-15T01:40:20.648077+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623200+0000","last_change":"2023-11-15T01:40:20.244798+0000","last_active":"2023-11-15T01:40:20.623200+0000","last_peered":"2023-11-15T01:40:20.623200+0000","last_clean":"2023-11-15T01:40:20.623200+0000","last_became_active":"2023-11-15T01:40:20.244394+0000","last_became_peered":"2023-11-15T01:40:20.244394+0000","last_unstale":"2023-11-15T01:40:20.623200+0000","last_undegraded":"2023-11-15T01:40:20.623200+0000","last_fullsized":"2023-11-15T01:40:20.623200+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623850+0000","last_change":"2023-11-15T01:40:20.248505+0000","last_active":"2023-11-15T01:40:20.623850+0000","last_peered":"2023-11-15T01:40:20.623850+0000","last_clean":"2023-11-15T01:40:20.623850+0000","last_became_active":"2023-11-15T01:40:20.248152+0000","last_became_peered":"2023-11-15T01:40:20.248152+0000","last_unstale":"2023-11-15T01:40:20.623850+0000","last_undegraded":"2023-11-15T01:40:20.623850+0000","last_fullsized":"2023-11-15T01:40:20.623850+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645073+0000","last_change":"2023-11-15T01:40:20.643161+0000","last_active":"2023-11-15T01:40:20.645073+0000","last_peered":"2023-11-15T01:40:20.645073+0000","last_clean":"2023-11-15T01:40:20.645073+0000","last_became_active":"2023-11-15T01:40:20.642562+0000","last_became_peered":"2023-11-15T01:40:20.642562+0000","last_unstale":"2023-11-15T01:40:20.645073+0000","last_undegraded":"2023-11-15T01:40:20.645073+0000","last_fullsized":"2023-11-15T01:40:20.645073+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625167+0000","last_change":"2023-11-15T01:40:20.242250+0000","last_active":"2023-11-15T01:40:20.625167+0000","last_peered":"2023-11-15T01:40:20.625167+0000","last_clean":"2023-11-15T01:40:20.625167+0000","last_became_active":"2023-11-15T01:40:20.242006+0000","last_became_peered":"2023-11-15T01:40:20.242006+0000","last_unstale":"2023-11-15T01:40:20.625167+0000","last_undegraded":"2023-11-15T01:40:20.625167+0000","last_fullsized":"2023-11-15T01:40:20.625167+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645367+0000","last_change":"2023-11-15T01:40:20.639227+0000","last_active":"2023-11-15T01:40:20.645367+0000","last_peered":"2023-11-15T01:40:20.645367+0000","last_clean":"2023-11-15T01:40:20.645367+0000","last_became_active":"2023-11-15T01:40:20.638956+0000","last_became_peered":"2023-11-15T01:40:20.638956+0000","last_unstale":"2023-11-15T01:40:20.645367+0000","last_undegraded":"2023-11-15T01:40:20.645367+0000","last_fullsized":"2023-11-15T01:40:20.645367+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621391+0000","last_change":"2023-11-15T01:40:20.241565+0000","last_active":"2023-11-15T01:40:20.621391+0000","last_peered":"2023-11-15T01:40:20.621391+0000","last_clean":"2023-11-15T01:40:20.621391+0000","last_became_active":"2023-11-15T01:40:20.241253+0000","last_became_peered":"2023-11-15T01:40:20.241253+0000","last_unstale":"2023-11-15T01:40:20.621391+0000","last_undegraded":"2023-11-15T01:40:20.621391+0000","last_fullsized":"2023-11-15T01:40:20.621391+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634580+0000","last_change":"2023-11-15T01:40:20.631271+0000","last_active":"2023-11-15T01:40:20.634580+0000","last_peered":"2023-11-15T01:40:20.634580+0000","last_clean":"2023-11-15T01:40:20.634580+0000","last_became_active":"2023-11-15T01:40:20.630984+0000","last_became_peered":"2023-11-15T01:40:20.630984+0000","last_unstale":"2023-11-15T01:40:20.634580+0000","last_undegraded":"2023-11-15T01:40:20.634580+0000","last_fullsized":"2023-11-15T01:40:20.634580+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625566+0000","last_change":"2023-11-15T01:40:20.245556+0000","last_active":"2023-11-15T01:40:20.625566+0000","last_peered":"2023-11-15T01:40:20.625566+0000","last_clean":"2023-11-15T01:40:20.625566+0000","last_became_active":"2023-11-15T01:40:20.245270+0000","last_became_peered":"2023-11-15T01:40:20.245270+0000","last_unstale":"2023-11-15T01:40:20.625566+0000","last_undegraded":"2023-11-15T01:40:20.625566+0000","last_fullsized":"2023-11-15T01:40:20.625566+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623365+0000","last_change":"2023-11-15T01:40:20.240505+0000","last_active":"2023-11-15T01:40:20.623365+0000","last_peered":"2023-11-15T01:40:20.623365+0000","last_clean":"2023-11-15T01:40:20.623365+0000","last_became_active":"2023-11-15T01:40:20.240212+0000","last_became_peered":"2023-11-15T01:40:20.240212+0000","last_unstale":"2023-11-15T01:40:20.623365+0000","last_undegraded":"2023-11-15T01:40:20.623365+0000","last_fullsized":"2023-11-15T01:40:20.623365+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623047+0000","last_change":"2023-11-15T01:40:20.246872+0000","last_active":"2023-11-15T01:40:20.623047+0000","last_peered":"2023-11-15T01:40:20.623047+0000","last_clean":"2023-11-15T01:40:20.623047+0000","last_became_active":"2023-11-15T01:40:20.246537+0000","last_became_peered":"2023-11-15T01:40:20.246537+0000","last_unstale":"2023-11-15T01:40:20.623047+0000","last_undegraded":"2023-11-15T01:40:20.623047+0000","last_fullsized":"2023-11-15T01:40:20.623047+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647040+0000","last_change":"2023-11-15T01:40:20.645113+0000","last_active":"2023-11-15T01:40:20.647040+0000","last_peered":"2023-11-15T01:40:20.647040+0000","last_clean":"2023-11-15T01:40:20.647040+0000","last_became_active":"2023-11-15T01:40:20.644570+0000","last_became_peered":"2023-11-15T01:40:20.644570+0000","last_unstale":"2023-11-15T01:40:20.647040+0000","last_undegraded":"2023-11-15T01:40:20.647040+0000","last_fullsized":"2023-11-15T01:40:20.647040+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.620507+0000","last_change":"2023-11-15T01:40:20.238797+0000","last_active":"2023-11-15T01:40:20.620507+0000","last_peered":"2023-11-15T01:40:20.620507+0000","last_clean":"2023-11-15T01:40:20.620507+0000","last_became_active":"2023-11-15T01:40:20.238516+0000","last_became_peered":"2023-11-15T01:40:20.238516+0000","last_unstale":"2023-11-15T01:40:20.620507+0000","last_undegraded":"2023-11-15T01:40:20.620507+0000","last_fullsized":"2023-11-15T01:40:20.620507+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.635078+0000","last_change":"2023-11-15T01:40:20.631036+0000","last_active":"2023-11-15T01:40:20.635078+0000","last_peered":"2023-11-15T01:40:20.635078+0000","last_clean":"2023-11-15T01:40:20.635078+0000","last_became_active":"2023-11-15T01:40:20.630762+0000","last_became_peered":"2023-11-15T01:40:20.630762+0000","last_unstale":"2023-11-15T01:40:20.635078+0000","last_undegraded":"2023-11-15T01:40:20.635078+0000","last_fullsized":"2023-11-15T01:40:20.635078+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625588+0000","last_change":"2023-11-15T01:40:20.244705+0000","last_active":"2023-11-15T01:40:20.625588+0000","last_peered":"2023-11-15T01:40:20.625588+0000","last_clean":"2023-11-15T01:40:20.625588+0000","last_became_active":"2023-11-15T01:40:20.244432+0000","last_became_peered":"2023-11-15T01:40:20.244432+0000","last_unstale":"2023-11-15T01:40:20.625588+0000","last_undegraded":"2023-11-15T01:40:20.625588+0000","last_fullsized":"2023-11-15T01:40:20.625588+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645095+0000","last_change":"2023-11-15T01:40:20.643897+0000","last_active":"2023-11-15T01:40:20.645095+0000","last_peered":"2023-11-15T01:40:20.645095+0000","last_clean":"2023-11-15T01:40:20.645095+0000","last_became_active":"2023-11-15T01:40:20.643619+0000","last_became_peered":"2023-11-15T01:40:20.643619+0000","last_unstale":"2023-11-15T01:40:20.645095+0000","last_undegraded":"2023-11-15T01:40:20.645095+0000","last_fullsized":"2023-11-15T01:40:20.645095+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.631561+0000","last_change":"2023-11-15T01:40:20.245866+0000","last_active":"2023-11-15T01:40:20.631561+0000","last_peered":"2023-11-15T01:40:20.631561+0000","last_clean":"2023-11-15T01:40:20.631561+0000","last_became_active":"2023-11-15T01:40:20.245176+0000","last_became_peered":"2023-11-15T01:40:20.245176+0000","last_unstale":"2023-11-15T01:40:20.631561+0000","last_undegraded":"2023-11-15T01:40:20.631561+0000","last_fullsized":"2023-11-15T01:40:20.631561+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.632732+0000","last_change":"2023-11-15T01:40:20.630832+0000","last_active":"2023-11-15T01:40:20.632732+0000","last_peered":"2023-11-15T01:40:20.632732+0000","last_clean":"2023-11-15T01:40:20.632732+0000","last_became_active":"2023-11-15T01:40:20.630527+0000","last_became_peered":"2023-11-15T01:40:20.630527+0000","last_unstale":"2023-11-15T01:40:20.632732+0000","last_undegraded":"2023-11-15T01:40:20.632732+0000","last_fullsized":"2023-11-15T01:40:20.632732+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636373+0000","last_change":"2023-11-15T01:40:20.239525+0000","last_active":"2023-11-15T01:40:20.636373+0000","last_peered":"2023-11-15T01:40:20.636373+0000","last_clean":"2023-11-15T01:40:20.636373+0000","last_became_active":"2023-11-15T01:40:20.239187+0000","last_became_peered":"2023-11-15T01:40:20.239187+0000","last_unstale":"2023-11-15T01:40:20.636373+0000","last_undegraded":"2023-11-15T01:40:20.636373+0000","last_fullsized":"2023-11-15T01:40:20.636373+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626997+0000","last_change":"2023-11-15T01:40:20.244328+0000","last_active":"2023-11-15T01:40:20.626997+0000","last_peered":"2023-11-15T01:40:20.626997+0000","last_clean":"2023-11-15T01:40:20.626997+0000","last_became_active":"2023-11-15T01:40:20.243358+0000","last_became_peered":"2023-11-15T01:40:20.243358+0000","last_unstale":"2023-11-15T01:40:20.626997+0000","last_undegraded":"2023-11-15T01:40:20.626997+0000","last_fullsized":"2023-11-15T01:40:20.626997+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640451+0000","last_change":"2023-11-15T01:40:20.636332+0000","last_active":"2023-11-15T01:40:20.640451+0000","last_peered":"2023-11-15T01:40:20.640451+0000","last_clean":"2023-11-15T01:40:20.640451+0000","last_became_active":"2023-11-15T01:40:20.636042+0000","last_became_peered":"2023-11-15T01:40:20.636042+0000","last_unstale":"2023-11-15T01:40:20.640451+0000","last_undegraded":"2023-11-15T01:40:20.640451+0000","last_fullsized":"2023-11-15T01:40:20.640451+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623071+0000","last_change":"2023-11-15T01:40:20.248987+0000","last_active":"2023-11-15T01:40:20.623071+0000","last_peered":"2023-11-15T01:40:20.623071+0000","last_clean":"2023-11-15T01:40:20.623071+0000","last_became_active":"2023-11-15T01:40:20.248720+0000","last_became_peered":"2023-11-15T01:40:20.248720+0000","last_unstale":"2023-11-15T01:40:20.623071+0000","last_undegraded":"2023-11-15T01:40:20.623071+0000","last_fullsized":"2023-11-15T01:40:20.623071+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.644975+0000","last_change":"2023-11-15T01:40:20.638835+0000","last_active":"2023-11-15T01:40:20.644975+0000","last_peered":"2023-11-15T01:40:20.644975+0000","last_clean":"2023-11-15T01:40:20.644975+0000","last_became_active":"2023-11-15T01:40:20.638503+0000","last_became_peered":"2023-11-15T01:40:20.638503+0000","last_unstale":"2023-11-15T01:40:20.644975+0000","last_undegraded":"2023-11-15T01:40:20.644975+0000","last_fullsized":"2023-11-15T01:40:20.644975+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621337+0000","last_change":"2023-11-15T01:40:20.244973+0000","last_active":"2023-11-15T01:40:20.621337+0000","last_peered":"2023-11-15T01:40:20.621337+0000","last_clean":"2023-11-15T01:40:20.621337+0000","last_became_active":"2023-11-15T01:40:20.244693+0000","last_became_peered":"2023-11-15T01:40:20.244693+0000","last_unstale":"2023-11-15T01:40:20.621337+0000","last_undegraded":"2023-11-15T01:40:20.621337+0000","last_fullsized":"2023-11-15T01:40:20.621337+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646635+0000","last_change":"2023-11-15T01:40:20.637751+0000","last_active":"2023-11-15T01:40:20.646635+0000","last_peered":"2023-11-15T01:40:20.646635+0000","last_clean":"2023-11-15T01:40:20.646635+0000","last_became_active":"2023-11-15T01:40:20.637065+0000","last_became_peered":"2023-11-15T01:40:20.637065+0000","last_unstale":"2023-11-15T01:40:20.646635+0000","last_undegraded":"2023-11-15T01:40:20.646635+0000","last_fullsized":"2023-11-15T01:40:20.646635+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637071+0000","last_change":"2023-11-15T01:40:20.632019+0000","last_active":"2023-11-15T01:40:20.637071+0000","last_peered":"2023-11-15T01:40:20.637071+0000","last_clean":"2023-11-15T01:40:20.637071+0000","last_became_active":"2023-11-15T01:40:20.631739+0000","last_became_peered":"2023-11-15T01:40:20.631739+0000","last_unstale":"2023-11-15T01:40:20.637071+0000","last_undegraded":"2023-11-15T01:40:20.637071+0000","last_fullsized":"2023-11-15T01:40:20.637071+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621235+0000","last_change":"2023-11-15T01:40:20.241452+0000","last_active":"2023-11-15T01:40:20.621235+0000","last_peered":"2023-11-15T01:40:20.621235+0000","last_clean":"2023-11-15T01:40:20.621235+0000","last_became_active":"2023-11-15T01:40:20.241153+0000","last_became_peered":"2023-11-15T01:40:20.241153+0000","last_unstale":"2023-11-15T01:40:20.621235+0000","last_undegraded":"2023-11-15T01:40:20.621235+0000","last_fullsized":"2023-11-15T01:40:20.621235+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.642580+0000","last_change":"2023-11-15T01:40:20.240160+0000","last_active":"2023-11-15T01:40:20.642580+0000","last_peered":"2023-11-15T01:40:20.642580+0000","last_clean":"2023-11-15T01:40:20.642580+0000","last_became_active":"2023-11-15T01:40:20.239856+0000","last_became_peered":"2023-11-15T01:40:20.239856+0000","last_unstale":"2023-11-15T01:40:20.642580+0000","last_undegraded":"2023-11-15T01:40:20.642580+0000","last_fullsized":"2023-11-15T01:40:20.642580+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634603+0000","last_change":"2023-11-15T01:40:20.631436+0000","last_active":"2023-11-15T01:40:20.634603+0000","last_peered":"2023-11-15T01:40:20.634603+0000","last_clean":"2023-11-15T01:40:20.634603+0000","last_became_active":"2023-11-15T01:40:20.631020+0000","last_became_peered":"2023-11-15T01:40:20.631020+0000","last_unstale":"2023-11-15T01:40:20.634603+0000","last_undegraded":"2023-11-15T01:40:20.634603+0000","last_fullsized":"2023-11-15T01:40:20.634603+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640104+0000","last_change":"2023-11-15T01:40:20.243673+0000","last_active":"2023-11-15T01:40:20.640104+0000","last_peered":"2023-11-15T01:40:20.640104+0000","last_clean":"2023-11-15T01:40:20.640104+0000","last_became_active":"2023-11-15T01:40:20.243237+0000","last_became_peered":"2023-11-15T01:40:20.243237+0000","last_unstale":"2023-11-15T01:40:20.640104+0000","last_undegraded":"2023-11-15T01:40:20.640104+0000","last_fullsized":"2023-11-15T01:40:20.640104+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641997+0000","last_change":"2023-11-15T01:40:20.636870+0000","last_active":"2023-11-15T01:40:20.641997+0000","last_peered":"2023-11-15T01:40:20.641997+0000","last_clean":"2023-11-15T01:40:20.641997+0000","last_became_active":"2023-11-15T01:40:20.636598+0000","last_became_peered":"2023-11-15T01:40:20.636598+0000","last_unstale":"2023-11-15T01:40:20.641997+0000","last_undegraded":"2023-11-15T01:40:20.641997+0000","last_fullsized":"2023-11-15T01:40:20.641997+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640933+0000","last_change":"2023-11-15T01:40:20.638425+0000","last_active":"2023-11-15T01:40:20.640933+0000","last_peered":"2023-11-15T01:40:20.640933+0000","last_clean":"2023-11-15T01:40:20.640933+0000","last_became_active":"2023-11-15T01:40:20.638126+0000","last_became_peered":"2023-11-15T01:40:20.638126+0000","last_unstale":"2023-11-15T01:40:20.640933+0000","last_undegraded":"2023-11-15T01:40:20.640933+0000","last_fullsized":"2023-11-15T01:40:20.640933+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634331+0000","last_change":"2023-11-15T01:40:20.247847+0000","last_active":"2023-11-15T01:40:20.634331+0000","last_peered":"2023-11-15T01:40:20.634331+0000","last_clean":"2023-11-15T01:40:20.634331+0000","last_became_active":"2023-11-15T01:40:20.247546+0000","last_became_peered":"2023-11-15T01:40:20.247546+0000","last_unstale":"2023-11-15T01:40:20.634331+0000","last_undegraded":"2023-11-15T01:40:20.634331+0000","last_fullsized":"2023-11-15T01:40:20.634331+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.639125+0000","last_change":"2023-11-15T01:40:20.634983+0000","last_active":"2023-11-15T01:40:20.639125+0000","last_peered":"2023-11-15T01:40:20.639125+0000","last_clean":"2023-11-15T01:40:20.639125+0000","last_became_active":"2023-11-15T01:40:20.634686+0000","last_became_peered":"2023-11-15T01:40:20.634686+0000","last_unstale":"2023-11-15T01:40:20.639125+0000","last_undegraded":"2023-11-15T01:40:20.639125+0000","last_fullsized":"2023-11-15T01:40:20.639125+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646657+0000","last_change":"2023-11-15T01:40:20.637803+0000","last_active":"2023-11-15T01:40:20.646657+0000","last_peered":"2023-11-15T01:40:20.646657+0000","last_clean":"2023-11-15T01:40:20.646657+0000","last_became_active":"2023-11-15T01:40:20.637531+0000","last_became_peered":"2023-11-15T01:40:20.637531+0000","last_unstale":"2023-11-15T01:40:20.646657+0000","last_undegraded":"2023-11-15T01:40:20.646657+0000","last_fullsized":"2023-11-15T01:40:20.646657+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623955+0000","last_change":"2023-11-15T01:40:20.241323+0000","last_active":"2023-11-15T01:40:20.623955+0000","last_peered":"2023-11-15T01:40:20.623955+0000","last_clean":"2023-11-15T01:40:20.623955+0000","last_became_active":"2023-11-15T01:40:20.241039+0000","last_became_peered":"2023-11-15T01:40:20.241039+0000","last_unstale":"2023-11-15T01:40:20.623955+0000","last_undegraded":"2023-11-15T01:40:20.623955+0000","last_fullsized":"2023-11-15T01:40:20.623955+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643154+0000","last_change":"2023-11-15T01:40:20.639732+0000","last_active":"2023-11-15T01:40:20.643154+0000","last_peered":"2023-11-15T01:40:20.643154+0000","last_clean":"2023-11-15T01:40:20.643154+0000","last_became_active":"2023-11-15T01:40:20.638787+0000","last_became_peered":"2023-11-15T01:40:20.638787+0000","last_unstale":"2023-11-15T01:40:20.643154+0000","last_undegraded":"2023-11-15T01:40:20.643154+0000","last_fullsized":"2023-11-15T01:40:20.643154+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.633299+0000","last_change":"2023-11-15T01:40:20.243269+0000","last_active":"2023-11-15T01:40:20.633299+0000","last_peered":"2023-11-15T01:40:20.633299+0000","last_clean":"2023-11-15T01:40:20.633299+0000","last_became_active":"2023-11-15T01:40:20.241757+0000","last_became_peered":"2023-11-15T01:40:20.241757+0000","last_unstale":"2023-11-15T01:40:20.633299+0000","last_undegraded":"2023-11-15T01:40:20.633299+0000","last_fullsized":"2023-11-15T01:40:20.633299+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640383+0000","last_change":"2023-11-15T01:40:20.635969+0000","last_active":"2023-11-15T01:40:20.640383+0000","last_peered":"2023-11-15T01:40:20.640383+0000","last_clean":"2023-11-15T01:40:20.640383+0000","last_became_active":"2023-11-15T01:40:20.635682+0000","last_became_peered":"2023-11-15T01:40:20.635682+0000","last_unstale":"2023-11-15T01:40:20.640383+0000","last_undegraded":"2023-11-15T01:40:20.640383+0000","last_fullsized":"2023-11-15T01:40:20.640383+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623421+0000","last_change":"2023-11-15T01:40:20.244894+0000","last_active":"2023-11-15T01:40:20.623421+0000","last_peered":"2023-11-15T01:40:20.623421+0000","last_clean":"2023-11-15T01:40:20.623421+0000","last_became_active":"2023-11-15T01:40:20.244195+0000","last_became_peered":"2023-11-15T01:40:20.244195+0000","last_unstale":"2023-11-15T01:40:20.623421+0000","last_undegraded":"2023-11-15T01:40:20.623421+0000","last_fullsized":"2023-11-15T01:40:20.623421+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624405+0000","last_change":"2023-11-15T01:40:20.244674+0000","last_active":"2023-11-15T01:40:20.624405+0000","last_peered":"2023-11-15T01:40:20.624405+0000","last_clean":"2023-11-15T01:40:20.624405+0000","last_became_active":"2023-11-15T01:40:20.244188+0000","last_became_peered":"2023-11-15T01:40:20.244188+0000","last_unstale":"2023-11-15T01:40:20.624405+0000","last_undegraded":"2023-11-15T01:40:20.624405+0000","last_fullsized":"2023-11-15T01:40:20.624405+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641364+0000","last_change":"2023-11-15T01:40:20.636297+0000","last_active":"2023-11-15T01:40:20.641364+0000","last_peered":"2023-11-15T01:40:20.641364+0000","last_clean":"2023-11-15T01:40:20.641364+0000","last_became_active":"2023-11-15T01:40:20.635914+0000","last_became_peered":"2023-11-15T01:40:20.635914+0000","last_unstale":"2023-11-15T01:40:20.641364+0000","last_undegraded":"2023-11-15T01:40:20.641364+0000","last_fullsized":"2023-11-15T01:40:20.641364+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623546+0000","last_change":"2023-11-15T01:40:20.249114+0000","last_active":"2023-11-15T01:40:20.623546+0000","last_peered":"2023-11-15T01:40:20.623546+0000","last_clean":"2023-11-15T01:40:20.623546+0000","last_became_active":"2023-11-15T01:40:20.248806+0000","last_became_peered":"2023-11-15T01:40:20.248806+0000","last_unstale":"2023-11-15T01:40:20.623546+0000","last_undegraded":"2023-11-15T01:40:20.623546+0000","last_fullsized":"2023-11-15T01:40:20.623546+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640914+0000","last_change":"2023-11-15T01:40:20.634111+0000","last_active":"2023-11-15T01:40:20.640914+0000","last_peered":"2023-11-15T01:40:20.640914+0000","last_clean":"2023-11-15T01:40:20.640914+0000","last_became_active":"2023-11-15T01:40:20.633828+0000","last_became_peered":"2023-11-15T01:40:20.633828+0000","last_unstale":"2023-11-15T01:40:20.640914+0000","last_undegraded":"2023-11-15T01:40:20.640914+0000","last_fullsized":"2023-11-15T01:40:20.640914+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623178+0000","last_change":"2023-11-15T01:40:20.243830+0000","last_active":"2023-11-15T01:40:20.623178+0000","last_peered":"2023-11-15T01:40:20.623178+0000","last_clean":"2023-11-15T01:40:20.623178+0000","last_became_active":"2023-11-15T01:40:20.243522+0000","last_became_peered":"2023-11-15T01:40:20.243522+0000","last_unstale":"2023-11-15T01:40:20.623178+0000","last_undegraded":"2023-11-15T01:40:20.623178+0000","last_fullsized":"2023-11-15T01:40:20.623178+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646619+0000","last_change":"2023-11-15T01:40:20.637658+0000","last_active":"2023-11-15T01:40:20.646619+0000","last_peered":"2023-11-15T01:40:20.646619+0000","last_clean":"2023-11-15T01:40:20.646619+0000","last_became_active":"2023-11-15T01:40:20.637349+0000","last_became_peered":"2023-11-15T01:40:20.637349+0000","last_unstale":"2023-11-15T01:40:20.646619+0000","last_undegraded":"2023-11-15T01:40:20.646619+0000","last_fullsized":"2023-11-15T01:40:20.646619+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.622664+0000","last_change":"2023-11-15T01:40:20.246311+0000","last_active":"2023-11-15T01:40:20.622664+0000","last_peered":"2023-11-15T01:40:20.622664+0000","last_clean":"2023-11-15T01:40:20.622664+0000","last_became_active":"2023-11-15T01:40:20.245907+0000","last_became_peered":"2023-11-15T01:40:20.245907+0000","last_unstale":"2023-11-15T01:40:20.622664+0000","last_undegraded":"2023-11-15T01:40:20.622664+0000","last_fullsized":"2023-11-15T01:40:20.622664+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.620564+0000","last_change":"2023-11-15T01:40:20.249564+0000","last_active":"2023-11-15T01:40:20.620564+0000","last_peered":"2023-11-15T01:40:20.620564+0000","last_clean":"2023-11-15T01:40:20.620564+0000","last_became_active":"2023-11-15T01:40:20.249234+0000","last_became_peered":"2023-11-15T01:40:20.249234+0000","last_unstale":"2023-11-15T01:40:20.620564+0000","last_undegraded":"2023-11-15T01:40:20.620564+0000","last_fullsized":"2023-11-15T01:40:20.620564+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641575+0000","last_change":"2023-11-15T01:40:20.637554+0000","last_active":"2023-11-15T01:40:20.641575+0000","last_peered":"2023-11-15T01:40:20.641575+0000","last_clean":"2023-11-15T01:40:20.641575+0000","last_became_active":"2023-11-15T01:40:20.636661+0000","last_became_peered":"2023-11-15T01:40:20.636661+0000","last_unstale":"2023-11-15T01:40:20.641575+0000","last_undegraded":"2023-11-15T01:40:20.641575+0000","last_fullsized":"2023-11-15T01:40:20.641575+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640421+0000","last_change":"2023-11-15T01:40:20.634926+0000","last_active":"2023-11-15T01:40:20.640421+0000","last_peered":"2023-11-15T01:40:20.640421+0000","last_clean":"2023-11-15T01:40:20.640421+0000","last_became_active":"2023-11-15T01:40:20.634638+0000","last_became_peered":"2023-11-15T01:40:20.634638+0000","last_unstale":"2023-11-15T01:40:20.640421+0000","last_undegraded":"2023-11-15T01:40:20.640421+0000","last_fullsized":"2023-11-15T01:40:20.640421+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623813+0000","last_change":"2023-11-15T01:40:20.245508+0000","last_active":"2023-11-15T01:40:20.623813+0000","last_peered":"2023-11-15T01:40:20.623813+0000","last_clean":"2023-11-15T01:40:20.623813+0000","last_became_active":"2023-11-15T01:40:20.243956+0000","last_became_peered":"2023-11-15T01:40:20.243956+0000","last_unstale":"2023-11-15T01:40:20.623813+0000","last_undegraded":"2023-11-15T01:40:20.623813+0000","last_fullsized":"2023-11-15T01:40:20.623813+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626981+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:40:20.626981+0000","last_peered":"2023-11-15T01:40:20.626981+0000","last_clean":"2023-11-15T01:40:20.626981+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:40:20.626981+0000","last_undegraded":"2023-11-15T01:40:20.626981+0000","last_fullsized":"2023-11-15T01:40:20.626981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.629120+0000","last_change":"2023-11-15T01:40:20.625014+0000","last_active":"2023-11-15T01:40:20.629120+0000","last_peered":"2023-11-15T01:40:20.629120+0000","last_clean":"2023-11-15T01:40:20.629120+0000","last_became_active":"2023-11-15T01:40:20.624716+0000","last_became_peered":"2023-11-15T01:40:20.624716+0000","last_unstale":"2023-11-15T01:40:20.629120+0000","last_undegraded":"2023-11-15T01:40:20.629120+0000","last_fullsized":"2023-11-15T01:40:20.629120+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623840+0000","last_change":"2023-11-15T01:40:20.242768+0000","last_active":"2023-11-15T01:40:20.623840+0000","last_peered":"2023-11-15T01:40:20.623840+0000","last_clean":"2023-11-15T01:40:20.623840+0000","last_became_active":"2023-11-15T01:40:20.242476+0000","last_became_peered":"2023-11-15T01:40:20.242476+0000","last_unstale":"2023-11-15T01:40:20.623840+0000","last_undegraded":"2023-11-15T01:40:20.623840+0000","last_fullsized":"2023-11-15T01:40:20.623840+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-11-15T01:40:15.885299+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:40:15.885299+0000","last_peered":"2023-11-15T01:40:15.885299+0000","last_clean":"2023-11-15T01:40:15.885299+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:40:15.885299+0000","last_undegraded":"2023-11-15T01:40:15.885299+0000","last_fullsized":"2023-11-15T01:40:15.885299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641810+0000","last_change":"2023-11-15T01:40:20.639491+0000","last_active":"2023-11-15T01:40:20.641810+0000","last_peered":"2023-11-15T01:40:20.641810+0000","last_clean":"2023-11-15T01:40:20.641810+0000","last_became_active":"2023-11-15T01:40:20.639223+0000","last_became_peered":"2023-11-15T01:40:20.639223+0000","last_unstale":"2023-11-15T01:40:20.641810+0000","last_undegraded":"2023-11-15T01:40:20.641810+0000","last_fullsized":"2023-11-15T01:40:20.641810+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.627927+0000","last_change":"2023-11-15T01:40:20.232634+0000","last_active":"2023-11-15T01:40:20.627927+0000","last_peered":"2023-11-15T01:40:20.627927+0000","last_clean":"2023-11-15T01:40:20.627927+0000","last_became_active":"2023-11-15T01:40:20.232339+0000","last_became_peered":"2023-11-15T01:40:20.232339+0000","last_unstale":"2023-11-15T01:40:20.627927+0000","last_undegraded":"2023-11-15T01:40:20.627927+0000","last_fullsized":"2023-11-15T01:40:20.627927+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":123,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.616573+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:40:20.616573+0000","last_peered":"2023-11-15T01:40:20.616573+0000","last_clean":"2023-11-15T01:40:20.616573+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:40:20.616573+0000","last_undegraded":"2023-11-15T01:40:20.616573+0000","last_fullsized":"2023-11-15T01:40:20.616573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645299+0000","last_change":"2023-11-15T01:40:20.243969+0000","last_active":"2023-11-15T01:40:20.645299+0000","last_peered":"2023-11-15T01:40:20.645299+0000","last_clean":"2023-11-15T01:40:20.645299+0000","last_became_active":"2023-11-15T01:40:20.243703+0000","last_became_peered":"2023-11-15T01:40:20.243703+0000","last_unstale":"2023-11-15T01:40:20.645299+0000","last_undegraded":"2023-11-15T01:40:20.645299+0000","last_fullsized":"2023-11-15T01:40:20.645299+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":110,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-11-15T01:40:15.885298+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:40:15.885298+0000","last_peered":"2023-11-15T01:40:15.885298+0000","last_clean":"2023-11-15T01:40:15.885298+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:40:15.885298+0000","last_undegraded":"2023-11-15T01:40:15.885298+0000","last_fullsized":"2023-11-15T01:40:15.885298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-11-15T01:40:15.250436+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:40:15.250436+0000","last_peered":"2023-11-15T01:40:15.250436+0000","last_clean":"2023-11-15T01:40:15.250436+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:40:15.250436+0000","last_undegraded":"2023-11-15T01:40:15.250436+0000","last_fullsized":"2023-11-15T01:40:15.250436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.638169+0000","last_change":"2023-11-15T01:40:20.633092+0000","last_active":"2023-11-15T01:40:20.638169+0000","last_peered":"2023-11-15T01:40:20.638169+0000","last_clean":"2023-11-15T01:40:20.638169+0000","last_became_active":"2023-11-15T01:40:20.632795+0000","last_became_peered":"2023-11-15T01:40:20.632795+0000","last_unstale":"2023-11-15T01:40:20.638169+0000","last_undegraded":"2023-11-15T01:40:20.638169+0000","last_fullsized":"2023-11-15T01:40:20.638169+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634086+0000","last_change":"2023-11-15T01:40:20.246780+0000","last_active":"2023-11-15T01:40:20.634086+0000","last_peered":"2023-11-15T01:40:20.634086+0000","last_clean":"2023-11-15T01:40:20.634086+0000","last_became_active":"2023-11-15T01:40:20.246469+0000","last_became_peered":"2023-11-15T01:40:20.246469+0000","last_unstale":"2023-11-15T01:40:20.634086+0000","last_undegraded":"2023-11-15T01:40:20.634086+0000","last_fullsized":"2023-11-15T01:40:20.634086+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-11-15T01:40:15.250438+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:40:15.250438+0000","last_peered":"2023-11-15T01:40:15.250438+0000","last_clean":"2023-11-15T01:40:15.250438+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:40:15.250438+0000","last_undegraded":"2023-11-15T01:40:15.250438+0000","last_fullsized":"2023-11-15T01:40:15.250438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-11-15T01:40:15.250453+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:40:15.250453+0000","last_peered":"2023-11-15T01:40:15.250453+0000","last_clean":"2023-11-15T01:40:15.250453+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:40:15.250453+0000","last_undegraded":"2023-11-15T01:40:15.250453+0000","last_fullsized":"2023-11-15T01:40:15.250453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647346+0000","last_change":"2023-11-15T01:40:20.638187+0000","last_active":"2023-11-15T01:40:20.647346+0000","last_peered":"2023-11-15T01:40:20.647346+0000","last_clean":"2023-11-15T01:40:20.647346+0000","last_became_active":"2023-11-15T01:40:20.637942+0000","last_became_peered":"2023-11-15T01:40:20.637942+0000","last_unstale":"2023-11-15T01:40:20.647346+0000","last_undegraded":"2023-11-15T01:40:20.647346+0000","last_fullsized":"2023-11-15T01:40:20.647346+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.628283+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:40:20.628283+0000","last_peered":"2023-11-15T01:40:20.628283+0000","last_clean":"2023-11-15T01:40:20.628283+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:40:20.628283+0000","last_undegraded":"2023-11-15T01:40:20.628283+0000","last_fullsized":"2023-11-15T01:40:20.628283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646627+0000","last_change":"2023-11-15T01:40:20.242601+0000","last_active":"2023-11-15T01:40:20.646627+0000","last_peered":"2023-11-15T01:40:20.646627+0000","last_clean":"2023-11-15T01:40:20.646627+0000","last_became_active":"2023-11-15T01:40:20.242275+0000","last_became_peered":"2023-11-15T01:40:20.242275+0000","last_unstale":"2023-11-15T01:40:20.646627+0000","last_undegraded":"2023-11-15T01:40:20.646627+0000","last_fullsized":"2023-11-15T01:40:20.646627+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":128,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625034+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:40:20.625034+0000","last_peered":"2023-11-15T01:40:20.625034+0000","last_clean":"2023-11-15T01:40:20.625034+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:40:20.625034+0000","last_undegraded":"2023-11-15T01:40:20.625034+0000","last_fullsized":"2023-11-15T01:40:20.625034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":92,"acting":92,"num_store_stats":6},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2146,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":96,"acting":96,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575069,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302852,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068988,"statfs":{"total":96636764160,"available":96326643712,"internally_reserved":0,"allocated":1699840,"data_stored":886619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71999999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.33800000000000002,"15min":0.248},"max":{"1min":0.751,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.747,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.42799999999999999,"5min":0.34499999999999997,"15min":0.27500000000000002},"max":{"1min":0.76300000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.51200000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.38200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82599999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.309},"max":{"1min":0.77300000000000002,"5min":0.875,"15min":0.875},"last":0.60399999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.85999999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.373,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.63200000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47699999999999998,"15min":0.46700000000000003},"min":{"1min":0.28399999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67400000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.316},"max":{"1min":0.77000000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.317,"5min":0.26500000000000001,"15min":0.23499999999999999},"max":{"1min":0.75,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.317,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66800000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56499999999999995}]},{"osd":6,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.82999999999999996,"15min":1.0129999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.34200000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79400000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575071,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1753088,"data_stored":915764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.42899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72499999999999998,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73099999999999998,"5min":0.77800000000000002,"15min":0.89000000000000001},"last":0.66900000000000004}]},{"osd":1,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.39000000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.83099999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.33100000000000002,"15min":0.32100000000000001},"max":{"1min":0.72999999999999998,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.69699999999999995}]},{"osd":2,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73399999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.46100000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76300000000000001,"5min":1.746,"15min":1.746},"last":0.73399999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.38,"5min":0.371,"15min":0.307},"max":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.91300000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.78400000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.68000000000000005}]},{"osd":4,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.32400000000000001,"5min":0.28899999999999998,"15min":0.26600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.52400000000000002},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.25800000000000001},"max":{"1min":0.79700000000000004,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.46800000000000003}]},{"osd":5,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76800000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.38900000000000001,"5min":0.32000000000000001,"15min":0.30399999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.82599999999999996},"last":0.49399999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.504,"15min":0.503},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.29899999999999999},"max":{"1min":0.83699999999999997,"5min":0.875,"15min":0.875},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80700000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.504}]}]},{"osd":1,"up_from":13,"seq":55834575072,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1753088,"data_stored":915232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.36099999999999999,"15min":0.376},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.24299999999999999},"max":{"1min":0.55000000000000004,"5min":0.59099999999999997,"15min":0.73699999999999999},"last":0.253},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.40200000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.35499999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.375,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58399999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42799999999999999,"15min":0.438},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.26200000000000001},"max":{"1min":0.66300000000000003,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.32600000000000001}]},{"osd":3,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.55800000000000005,"15min":0.52200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71099999999999997,"5min":9.641,"15min":9.641},"last":0.371},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53500000000000003,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.28599999999999998},"max":{"1min":0.71799999999999997,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.40000000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.45100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1,"5min":1,"15min":1},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.61599999999999999,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.90800000000000003,"5min":1.006,"15min":1.006},"last":0.56799999999999995}]},{"osd":5,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61199999999999999,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.45300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0009999999999999,"5min":1.111,"15min":1.111},"last":0.44600000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0449999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.48399999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66100000000000003,"15min":0.68799999999999994},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0169999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.67800000000000005,"15min":0.69099999999999995},"min":{"1min":0.501,"5min":0.434,"15min":0.434},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.55600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575070,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302912,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068928,"statfs":{"total":96636764160,"available":96326582272,"internally_reserved":0,"allocated":1761280,"data_stored":916678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.371},"min":{"1min":0.27300000000000002,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.495,"5min":0.54200000000000004,"15min":2.024},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.39600000000000002,"15min":0.41499999999999998},"min":{"1min":0.24399999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52200000000000002,"5min":0.64700000000000002,"15min":1.9490000000000001},"last":0.29699999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36299999999999999,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":1.768},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41299999999999998,"15min":0.437},"min":{"1min":0.28000000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":1.982},"last":0.33500000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42199999999999999,"15min":0.435},"min":{"1min":0.30199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58999999999999997,"5min":0.63100000000000001,"15min":2.0579999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.30199999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.64900000000000002,"5min":0.67900000000000005,"15min":1.7989999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40400000000000003},"max":{"1min":0.83599999999999997,"5min":1.018,"15min":1.018},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63300000000000001,"15min":0.65300000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79600000000000004,"5min":0.98899999999999999,"15min":1.7250000000000001},"last":0.64000000000000001}]},{"osd":5,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82899999999999996,"5min":0.97899999999999998,"15min":1.881},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":1.056},"last":0.72899999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.36499999999999999},"max":{"1min":0.84499999999999997,"5min":1.04,"15min":1.6830000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64700000000000002,"15min":0.67000000000000004},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90800000000000003,"5min":0.94099999999999995,"15min":1.917},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.67000000000000004,"15min":0.68700000000000006},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88100000000000001,"5min":1.0089999999999999,"15min":1.843},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.68700000000000006},"min":{"1min":0.47599999999999998,"5min":0.46999999999999997,"15min":0.40899999999999997},"max":{"1min":0.90300000000000002,"5min":1.073,"15min":1.0960000000000001},"last":0.76500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575071,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307004,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064836,"statfs":{"total":96636764160,"available":96322392064,"internally_reserved":0,"allocated":1757184,"data_stored":916172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35499999999999998,"15min":0.36599999999999999},"min":{"1min":0.248,"5min":0.186,"15min":0.186},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.61899999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56000000000000005,"5min":0.63900000000000001,"15min":0.74299999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.59199999999999997,"5min":0.745,"15min":0.745},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.58199999999999996,"5min":0.69799999999999995,"15min":0.73499999999999999},"last":0.434}]},{"osd":3,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.436,"15min":0.44900000000000001},"min":{"1min":0.32300000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53000000000000003,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.436,"15min":0.441},"min":{"1min":0.24399999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57199999999999995,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.37}]},{"osd":4,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.47299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77300000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61799999999999999,"15min":0.63300000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79000000000000004,"5min":0.91100000000000003,"15min":0.95399999999999996},"last":0.57599999999999996}]},{"osd":5,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.47899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89800000000000002,"5min":1.032,"15min":1.032},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.63500000000000001},"min":{"1min":0.47499999999999998,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":0.81200000000000006,"5min":0.96699999999999997,"15min":0.99399999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.374},"max":{"1min":0.83699999999999997,"5min":1.002,"15min":1.0389999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.64200000000000002,"15min":0.66500000000000004},"min":{"1min":0.46100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.83199999999999996,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.45400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.92200000000000004,"5min":1.079,"15min":1.079},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65600000000000003,"15min":0.68500000000000005},"min":{"1min":0.434,"5min":0.374,"15min":0.374},"max":{"1min":0.82399999999999995,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.73199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575072,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307008,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064832,"statfs":{"total":96636764160,"available":96322387968,"internally_reserved":0,"allocated":1761280,"data_stored":915888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.36399999999999999,"15min":0.374},"min":{"1min":0.27500000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.79900000000000004},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.377,"15min":0.39700000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.49199999999999999,"5min":0.60699999999999998,"15min":0.71499999999999997},"last":0.30099999999999999}]},{"osd":1,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.39000000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51500000000000001,"5min":0.63400000000000001,"15min":0.72899999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.41899999999999998,"15min":0.442},"min":{"1min":0.33000000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.56200000000000006,"5min":0.72499999999999998,"15min":0.747},"last":0.29399999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.32200000000000001,"5min":0.27300000000000002,"15min":0.23200000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.37},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.47299999999999998},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.622,"5min":0.69199999999999995,"15min":0.81999999999999995},"last":0.38100000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57599999999999996,"15min":0.60999999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84999999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60599999999999998,"15min":0.625},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":1.389,"15min":1.389},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.63100000000000001},"min":{"1min":0.47199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93600000000000005,"5min":1.512,"15min":1.512},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61399999999999999,"15min":0.63700000000000001},"min":{"1min":0.42099999999999999,"5min":0.374,"15min":0.373},"max":{"1min":0.82299999999999995,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92700000000000005,"5min":0.94199999999999995,"15min":1.0980000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.66100000000000003},"min":{"1min":0.45200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.0900000000000001},"last":0.80600000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.66400000000000003},"min":{"1min":0.443,"5min":0.39900000000000002,"15min":0.38700000000000001},"max":{"1min":0.94999999999999996,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64200000000000002,"15min":0.67600000000000005},"min":{"1min":0.48999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90600000000000003,"5min":1.069,"15min":1.1319999999999999},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575070,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302908,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068932,"statfs":{"total":96636764160,"available":96326586368,"internally_reserved":0,"allocated":1757184,"data_stored":915854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.30399999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.84499999999999997,"15min":0.88},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.749,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.68999999999999995}]},{"osd":1,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.39400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81000000000000005,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.34799999999999998,"15min":0.34699999999999998},"max":{"1min":0.68000000000000005,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.72299999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.58499999999999996},"min":{"1min":0.373,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72199999999999998,"5min":2.887,"15min":2.887},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.45800000000000002,"5min":0.37,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":0.92300000000000004,"15min":0.96299999999999997},"last":0.55000000000000004}]},{"osd":3,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.33100000000000002},"max":{"1min":0.73399999999999999,"5min":2.464,"15min":2.464},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63400000000000001,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84799999999999998,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48599999999999999,"15min":0.46899999999999997},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68500000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.434},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.49199999999999999},"min":{"1min":0.38900000000000001,"5min":0.29899999999999999,"15min":0.27400000000000002},"max":{"1min":0.66300000000000003,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.44400000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52300000000000002,"15min":0.495},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.28899999999999998},"max":{"1min":0.72199999999999998,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.379},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55000000000000004,"15min":0.52900000000000003},"min":{"1min":0.42599999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.47399999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.42099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71799999999999997,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.502},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59199999999999997,"15min":0.56699999999999995},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.46200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575069,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302852,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068988,"statfs":{"total":96636764160,"available":96326643712,"internally_reserved":0,"allocated":1699840,"data_stored":886619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53100000000000003,"15min":0.54500000000000004},"min":{"1min":0.42699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.72199999999999998,"5min":0.78500000000000003,"15min":0.79200000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.78100000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.505}]},{"osd":1,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.53500000000000003,"15min":0.55900000000000005},"min":{"1min":0.35699999999999998,"5min":0.33300000000000002,"15min":0.32600000000000001},"max":{"1min":0.75,"5min":0.78500000000000003,"15min":0.83299999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.42599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.80100000000000005},"last":0.42099999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81200000000000006,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68000000000000005,"5min":0.77100000000000002,"15min":0.84599999999999997},"last":0.45900000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67900000000000005,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77600000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57099999999999995}]},{"osd":4,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.29499999999999998,"5min":0.26600000000000001,"15min":0.23899999999999999},"max":{"1min":0.59299999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65500000000000003,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.67400000000000004}]},{"osd":6,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.27600000000000002},"max":{"1min":0.54600000000000004,"5min":0.81599999999999995,"15min":0.83099999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63700000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59799999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.497},"min":{"1min":0.378,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.627},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.45300000000000001,"5min":0.40100000000000002,"15min":0.33600000000000002},"max":{"1min":0.71099999999999997,"5min":0.82399999999999995,"15min":0.85799999999999998},"last":0.65500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:40:24.679 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:40:24.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.827+0000 7f58e55d2700 1 Processor -- start 2023-11-15T01:40:24.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.827+0000 7f58e55d2700 1 -- start start 2023-11-15T01:40:24.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.828+0000 7f58e55d2700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f58e0154e70 0x7f58e0155270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.828+0000 7f58e55d2700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e00ad5e0 con 0x7f58e00be390 2023-11-15T01:40:24.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.828+0000 7f58e55d2700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e00ad8c0 con 0x7f58e00bdfb0 2023-11-15T01:40:24.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.828+0000 7f58e55d2700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e00bccd0 con 0x7f58e0154e70 2023-11-15T01:40:24.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.828+0000 7f58de7fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f58e00be390 0x7f58e00bd400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34790/0 (socket says 172.21.15.1:34790) 2023-11-15T01:40:24.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.828+0000 7f58de7fc700 1 -- 172.21.15.1:0/3348554695 learned_addr learned my addr 172.21.15.1:0/3348554695 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:24.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58df7fe700 1 --2- 172.21.15.1:0/3348554695 >> v2:172.21.15.141:3300/0 conn(0x7f58e0154e70 0x7f58e0155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717881500 0 0) 0x7f58e00ad5e0 con 0x7f58e00be390 2023-11-15T01:40:24.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58cc0033f0 con 0x7f58e00be390 2023-11-15T01:40:24.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669564115 0 0) 0x7f58e00ad8c0 con 0x7f58e00bdfb0 2023-11-15T01:40:24.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58e00ad5e0 con 0x7f58e00bdfb0 2023-11-15T01:40:24.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3945612752 0 0) 0x7f58cc0033f0 con 0x7f58e00be390 2023-11-15T01:40:24.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 >> v2:172.21.15.141:3300/0 conn(0x7f58e0154e70 msgr2=0x7f58e0155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:24.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 --2- 172.21.15.1:0/3348554695 >> v2:172.21.15.141:3300/0 conn(0x7f58e0154e70 0x7f58e0155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 >> v1:172.21.15.141:6789/0 conn(0x7f58e00bdfb0 legacy=0x7f58e00c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e00adba0 con 0x7f58e00be390 2023-11-15T01:40:24.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f58c8001470 con 0x7f58e00be390 2023-11-15T01:40:24.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58df7fe700 1 --2- 172.21.15.1:0/3348554695 >> v2:172.21.15.141:3300/0 conn(0x7f58e0154e70 0x7f58e0155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:24.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 >> v1:172.21.15.1:6789/0 conn(0x7f58e00be390 legacy=0x7f58e00bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 --2- 172.21.15.1:0/3348554695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58cc003a70 0x7f58cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 --2- 172.21.15.1:0/3348554695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58cc004690 0x7f58cc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 --2- 172.21.15.1:0/3348554695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58cc005000 0x7f58cc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e00bccd0 con 0x7f58cc005000 2023-11-15T01:40:24.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc00be80 con 0x7f58cc004690 2023-11-15T01:40:24.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc00c040 con 0x7f58cc003a70 2023-11-15T01:40:24.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58df7fe700 1 --2- 172.21.15.1:0/3348554695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58cc005000 0x7f58cc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58deffd700 1 --2- 172.21.15.1:0/3348554695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58cc003a70 0x7f58cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58df7fe700 1 -- 172.21.15.1:0/3348554695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58cc003a70 msgr2=0x7f58cc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:24.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58df7fe700 1 --2- 172.21.15.1:0/3348554695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58cc003a70 0x7f58cc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58df7fe700 1 -- 172.21.15.1:0/3348554695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58cc004690 msgr2=0x7f58cc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:24.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58df7fe700 1 --2- 172.21.15.1:0/3348554695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58cc004690 0x7f58cc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:24.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.829+0000 7f58df7fe700 1 -- 172.21.15.1:0/3348554695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc0033f0 con 0x7f58cc005000 2023-11-15T01:40:24.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.830+0000 7f58df7fe700 1 -- 172.21.15.1:0/3348554695 reap_dead start 2023-11-15T01:40:24.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.830+0000 7f58df7fe700 1 --2- 172.21.15.1:0/3348554695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58cc005000 0x7f58cc00b8e0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f58d0006d80 tx=0x7f58d0009060).ready entity=mon.0 client_cookie=6e4f49ca75b1376 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:24.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.830+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0009660 con 0x7f58cc005000 2023-11-15T01:40:24.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.830+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d000e710 con 0x7f58cc005000 2023-11-15T01:40:24.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.830+0000 7f58ddffb700 1 -- 172.21.15.1:0/3348554695 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d000ea90 con 0x7f58cc005000 2023-11-15T01:40:24.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.830+0000 7f58e55d2700 1 -- 172.21.15.1:0/3348554695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58cc005000 msgr2=0x7f58cc00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.830+0000 7f58e55d2700 1 --2- 172.21.15.1:0/3348554695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58cc005000 0x7f58cc00b8e0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f58d0006d80 tx=0x7f58d0009060).stop 2023-11-15T01:40:24.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.830+0000 7f58e55d2700 1 -- 172.21.15.1:0/3348554695 shutdown_connections 2023-11-15T01:40:24.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.830+0000 7f58e55d2700 1 --2- 172.21.15.1:0/3348554695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58cc005000 0x7f58cc00b8e0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.830+0000 7f58e55d2700 1 -- 172.21.15.1:0/3348554695 >> 172.21.15.1:0/3348554695 conn(0x7f58e00c7d70 msgr2=0x7f58e00c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:24.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.830+0000 7f58e55d2700 1 -- 172.21.15.1:0/3348554695 shutdown_connections 2023-11-15T01:40:24.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.830+0000 7f58e55d2700 1 -- 172.21.15.1:0/3348554695 wait complete. 2023-11-15T01:40:24.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.832+0000 7f58e55d2700 1 Processor -- start 2023-11-15T01:40:24.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.832+0000 7f58e55d2700 1 -- start start 2023-11-15T01:40:24.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.832+0000 7f58e55d2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58cc005000 0x7f58e00a8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.832+0000 7f58e55d2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58e00a8f60 0x7f58e0141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.832+0000 7f58e55d2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58e0141d40 0x7f58e014e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.832+0000 7f58e55d2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e00aa000 con 0x7f58cc005000 2023-11-15T01:40:24.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.832+0000 7f58e55d2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e00a93f0 con 0x7f58e00a8f60 2023-11-15T01:40:24.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.832+0000 7f58e55d2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e00a96d0 con 0x7f58e0141d40 2023-11-15T01:40:24.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.832+0000 7f58deffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58cc005000 0x7f58e00a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.832+0000 7f58deffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58cc005000 0x7f58e00a8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59220/0 (socket says 172.21.15.1:59220) 2023-11-15T01:40:24.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.832+0000 7f58deffd700 1 -- 172.21.15.1:0/4013832456 learned_addr learned my addr 172.21.15.1:0/4013832456 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:24.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.833+0000 7f58df7fe700 1 --2- 172.21.15.1:0/4013832456 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58e0141d40 0x7f58e014e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.833+0000 7f58deffd700 1 -- 172.21.15.1:0/4013832456 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58e0141d40 msgr2=0x7f58e014e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.833+0000 7f58deffd700 1 --2- 172.21.15.1:0/4013832456 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58e0141d40 0x7f58e014e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:24.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.833+0000 7f58deffd700 1 -- 172.21.15.1:0/4013832456 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58e00a8f60 msgr2=0x7f58e0141850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:24.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.833+0000 7f58deffd700 1 --2- 172.21.15.1:0/4013832456 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58e00a8f60 0x7f58e0141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:24.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.833+0000 7f58deffd700 1 -- 172.21.15.1:0/4013832456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e00a99b0 con 0x7f58cc005000 2023-11-15T01:40:24.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.833+0000 7f58deffd700 1 --2- 172.21.15.1:0/4013832456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58cc005000 0x7f58e00a8840 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f58d800eb10 tx=0x7f58d8007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:24.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.833+0000 7f58d6ffd700 1 -- 172.21.15.1:0/4013832456 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d800c830 con 0x7f58cc005000 2023-11-15T01:40:24.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.833+0000 7f58d6ffd700 1 -- 172.21.15.1:0/4013832456 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d800c990 con 0x7f58cc005000 2023-11-15T01:40:24.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.833+0000 7f58e55d2700 1 -- 172.21.15.1:0/4013832456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e00a9c90 con 0x7f58cc005000 2023-11-15T01:40:24.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.833+0000 7f58d6ffd700 1 -- 172.21.15.1:0/4013832456 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d800cd30 con 0x7f58cc005000 2023-11-15T01:40:24.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.833+0000 7f58e55d2700 1 -- 172.21.15.1:0/4013832456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e00aa490 con 0x7f58cc005000 2023-11-15T01:40:24.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.834+0000 7f58e55d2700 1 -- 172.21.15.1:0/4013832456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e00aa680 con 0x7f58cc005000 2023-11-15T01:40:24.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.834+0000 7f58d6ffd700 1 -- 172.21.15.1:0/4013832456 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f58d8013630 con 0x7f58cc005000 2023-11-15T01:40:24.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.835+0000 7f58d6ffd700 1 --2- 172.21.15.1:0/4013832456 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f58c005f2a0 0x7f58c0061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:24.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.835+0000 7f58d6ffd700 1 -- 172.21.15.1:0/4013832456 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f58d807a910 con 0x7f58cc005000 2023-11-15T01:40:24.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.835+0000 7f58de7fc700 1 --2- 172.21.15.1:0/4013832456 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f58c005f2a0 0x7f58c0061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:24.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.836+0000 7f58de7fc700 1 --2- 172.21.15.1:0/4013832456 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f58c005f2a0 0x7f58c0061760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f58c8001010 tx=0x7f58c8000d00).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:24.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:24.839+0000 7f58d6ffd700 1 -- 172.21.15.1:0/4013832456 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f58d804b8a0 con 0x7f58cc005000 2023-11-15T01:40:25.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.007+0000 7f58e55d2700 1 -- 172.21.15.1:0/4013832456 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58e00aa140 con 0x7f58c005f2a0 2023-11-15T01:40:25.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.017+0000 7f58d6ffd700 1 -- 172.21.15.1:0/4013832456 <== mgr.6590 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358778 (secure 0 0 0) 0x7f58c8007170 con 0x7f58c005f2a0 2023-11-15T01:40:25.023 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:25.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.020+0000 7f58e55d2700 1 -- 172.21.15.1:0/4013832456 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f58c005f2a0 msgr2=0x7f58c0061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.020+0000 7f58e55d2700 1 --2- 172.21.15.1:0/4013832456 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f58c005f2a0 0x7f58c0061760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f58c8001010 tx=0x7f58c8000d00).stop 2023-11-15T01:40:25.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.020+0000 7f58e55d2700 1 -- 172.21.15.1:0/4013832456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58cc005000 msgr2=0x7f58e00a8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.020+0000 7f58e55d2700 1 --2- 172.21.15.1:0/4013832456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58cc005000 0x7f58e00a8840 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f58d800eb10 tx=0x7f58d8007f30).stop 2023-11-15T01:40:25.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.020+0000 7f58e55d2700 1 -- 172.21.15.1:0/4013832456 shutdown_connections 2023-11-15T01:40:25.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.020+0000 7f58e55d2700 1 --2- 172.21.15.1:0/4013832456 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f58c005f2a0 0x7f58c0061760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.020+0000 7f58e55d2700 1 --2- 172.21.15.1:0/4013832456 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58e0141d40 0x7f58e014e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.020+0000 7f58e55d2700 1 --2- 172.21.15.1:0/4013832456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58cc005000 0x7f58e00a8840 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.020+0000 7f58e55d2700 1 --2- 172.21.15.1:0/4013832456 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58e00a8f60 0x7f58e0141850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:25.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.021+0000 7f58e55d2700 1 -- 172.21.15.1:0/4013832456 >> 172.21.15.1:0/4013832456 conn(0x7f58e00c7d70 msgr2=0x7f58e014dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:25.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.021+0000 7f58e55d2700 1 -- 172.21.15.1:0/4013832456 shutdown_connections 2023-11-15T01:40:25.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.021+0000 7f58e55d2700 1 -- 172.21.15.1:0/4013832456 wait complete. 2023-11-15T01:40:25.029 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:40:25.034 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T01:40:23.192723+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2146,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":206,"acting":206,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2431344,"kb_used_data":13616,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752543376,"statfs":{"total":773094113280,"available":770604417024,"internally_reserved":0,"allocated":13942784,"data_stored":7268826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23363,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-75,"num_write_kb":-52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.002658"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3f","version":"140'3","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641930+0000","last_change":"2023-11-15T01:40:20.242944+0000","last_active":"2023-11-15T01:40:20.641930+0000","last_peered":"2023-11-15T01:40:20.641930+0000","last_clean":"2023-11-15T01:40:20.641930+0000","last_became_active":"2023-11-15T01:40:20.242665+0000","last_became_peered":"2023-11-15T01:40:20.242665+0000","last_unstale":"2023-11-15T01:40:20.641930+0000","last_undegraded":"2023-11-15T01:40:20.641930+0000","last_fullsized":"2023-11-15T01:40:20.641930+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646740+0000","last_change":"2023-11-15T01:40:20.642233+0000","last_active":"2023-11-15T01:40:20.646740+0000","last_peered":"2023-11-15T01:40:20.646740+0000","last_clean":"2023-11-15T01:40:20.646740+0000","last_became_active":"2023-11-15T01:40:20.641850+0000","last_became_peered":"2023-11-15T01:40:20.641850+0000","last_unstale":"2023-11-15T01:40:20.646740+0000","last_undegraded":"2023-11-15T01:40:20.646740+0000","last_fullsized":"2023-11-15T01:40:20.646740+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625020+0000","last_change":"2023-11-15T01:40:20.245583+0000","last_active":"2023-11-15T01:40:20.625020+0000","last_peered":"2023-11-15T01:40:20.625020+0000","last_clean":"2023-11-15T01:40:20.625020+0000","last_became_active":"2023-11-15T01:40:20.245315+0000","last_became_peered":"2023-11-15T01:40:20.245315+0000","last_unstale":"2023-11-15T01:40:20.625020+0000","last_undegraded":"2023-11-15T01:40:20.625020+0000","last_fullsized":"2023-11-15T01:40:20.625020+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647364+0000","last_change":"2023-11-15T01:40:20.643893+0000","last_active":"2023-11-15T01:40:20.647364+0000","last_peered":"2023-11-15T01:40:20.647364+0000","last_clean":"2023-11-15T01:40:20.647364+0000","last_became_active":"2023-11-15T01:40:20.643255+0000","last_became_peered":"2023-11-15T01:40:20.643255+0000","last_unstale":"2023-11-15T01:40:20.647364+0000","last_undegraded":"2023-11-15T01:40:20.647364+0000","last_fullsized":"2023-11-15T01:40:20.647364+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636409+0000","last_change":"2023-11-15T01:40:20.632940+0000","last_active":"2023-11-15T01:40:20.636409+0000","last_peered":"2023-11-15T01:40:20.636409+0000","last_clean":"2023-11-15T01:40:20.636409+0000","last_became_active":"2023-11-15T01:40:20.632656+0000","last_became_peered":"2023-11-15T01:40:20.632656+0000","last_unstale":"2023-11-15T01:40:20.636409+0000","last_undegraded":"2023-11-15T01:40:20.636409+0000","last_fullsized":"2023-11-15T01:40:20.636409+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643570+0000","last_change":"2023-11-15T01:40:20.241907+0000","last_active":"2023-11-15T01:40:20.643570+0000","last_peered":"2023-11-15T01:40:20.643570+0000","last_clean":"2023-11-15T01:40:20.643570+0000","last_became_active":"2023-11-15T01:40:20.241464+0000","last_became_peered":"2023-11-15T01:40:20.241464+0000","last_unstale":"2023-11-15T01:40:20.643570+0000","last_undegraded":"2023-11-15T01:40:20.643570+0000","last_fullsized":"2023-11-15T01:40:20.643570+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.639154+0000","last_change":"2023-11-15T01:40:20.632696+0000","last_active":"2023-11-15T01:40:20.639154+0000","last_peered":"2023-11-15T01:40:20.639154+0000","last_clean":"2023-11-15T01:40:20.639154+0000","last_became_active":"2023-11-15T01:40:20.632485+0000","last_became_peered":"2023-11-15T01:40:20.632485+0000","last_unstale":"2023-11-15T01:40:20.639154+0000","last_undegraded":"2023-11-15T01:40:20.639154+0000","last_fullsized":"2023-11-15T01:40:20.639154+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.631160+0000","last_change":"2023-11-15T01:40:20.241330+0000","last_active":"2023-11-15T01:40:20.631160+0000","last_peered":"2023-11-15T01:40:20.631160+0000","last_clean":"2023-11-15T01:40:20.631160+0000","last_became_active":"2023-11-15T01:40:20.240407+0000","last_became_peered":"2023-11-15T01:40:20.240407+0000","last_unstale":"2023-11-15T01:40:20.631160+0000","last_undegraded":"2023-11-15T01:40:20.631160+0000","last_fullsized":"2023-11-15T01:40:20.631160+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.644143+0000","last_change":"2023-11-15T01:40:20.641396+0000","last_active":"2023-11-15T01:40:20.644143+0000","last_peered":"2023-11-15T01:40:20.644143+0000","last_clean":"2023-11-15T01:40:20.644143+0000","last_became_active":"2023-11-15T01:40:20.641053+0000","last_became_peered":"2023-11-15T01:40:20.641053+0000","last_unstale":"2023-11-15T01:40:20.644143+0000","last_undegraded":"2023-11-15T01:40:20.644143+0000","last_fullsized":"2023-11-15T01:40:20.644143+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.638608+0000","last_change":"2023-11-15T01:40:20.244269+0000","last_active":"2023-11-15T01:40:20.638608+0000","last_peered":"2023-11-15T01:40:20.638608+0000","last_clean":"2023-11-15T01:40:20.638608+0000","last_became_active":"2023-11-15T01:40:20.243976+0000","last_became_peered":"2023-11-15T01:40:20.243976+0000","last_unstale":"2023-11-15T01:40:20.638608+0000","last_undegraded":"2023-11-15T01:40:20.638608+0000","last_fullsized":"2023-11-15T01:40:20.638608+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640654+0000","last_change":"2023-11-15T01:40:20.638613+0000","last_active":"2023-11-15T01:40:20.640654+0000","last_peered":"2023-11-15T01:40:20.640654+0000","last_clean":"2023-11-15T01:40:20.640654+0000","last_became_active":"2023-11-15T01:40:20.638313+0000","last_became_peered":"2023-11-15T01:40:20.638313+0000","last_unstale":"2023-11-15T01:40:20.640654+0000","last_undegraded":"2023-11-15T01:40:20.640654+0000","last_fullsized":"2023-11-15T01:40:20.640654+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636934+0000","last_change":"2023-11-15T01:40:20.634524+0000","last_active":"2023-11-15T01:40:20.636934+0000","last_peered":"2023-11-15T01:40:20.636934+0000","last_clean":"2023-11-15T01:40:20.636934+0000","last_became_active":"2023-11-15T01:40:20.634242+0000","last_became_peered":"2023-11-15T01:40:20.634242+0000","last_unstale":"2023-11-15T01:40:20.636934+0000","last_undegraded":"2023-11-15T01:40:20.636934+0000","last_fullsized":"2023-11-15T01:40:20.636934+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645055+0000","last_change":"2023-11-15T01:40:20.642990+0000","last_active":"2023-11-15T01:40:20.645055+0000","last_peered":"2023-11-15T01:40:20.645055+0000","last_clean":"2023-11-15T01:40:20.645055+0000","last_became_active":"2023-11-15T01:40:20.642491+0000","last_became_peered":"2023-11-15T01:40:20.642491+0000","last_unstale":"2023-11-15T01:40:20.645055+0000","last_undegraded":"2023-11-15T01:40:20.645055+0000","last_fullsized":"2023-11-15T01:40:20.645055+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621002+0000","last_change":"2023-11-15T01:40:20.246917+0000","last_active":"2023-11-15T01:40:20.621002+0000","last_peered":"2023-11-15T01:40:20.621002+0000","last_clean":"2023-11-15T01:40:20.621002+0000","last_became_active":"2023-11-15T01:40:20.245824+0000","last_became_peered":"2023-11-15T01:40:20.245824+0000","last_unstale":"2023-11-15T01:40:20.621002+0000","last_undegraded":"2023-11-15T01:40:20.621002+0000","last_fullsized":"2023-11-15T01:40:20.621002+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636954+0000","last_change":"2023-11-15T01:40:20.633914+0000","last_active":"2023-11-15T01:40:20.636954+0000","last_peered":"2023-11-15T01:40:20.636954+0000","last_clean":"2023-11-15T01:40:20.636954+0000","last_became_active":"2023-11-15T01:40:20.633572+0000","last_became_peered":"2023-11-15T01:40:20.633572+0000","last_unstale":"2023-11-15T01:40:20.636954+0000","last_undegraded":"2023-11-15T01:40:20.636954+0000","last_fullsized":"2023-11-15T01:40:20.636954+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621433+0000","last_change":"2023-11-15T01:40:20.242145+0000","last_active":"2023-11-15T01:40:20.621433+0000","last_peered":"2023-11-15T01:40:20.621433+0000","last_clean":"2023-11-15T01:40:20.621433+0000","last_became_active":"2023-11-15T01:40:20.241777+0000","last_became_peered":"2023-11-15T01:40:20.241777+0000","last_unstale":"2023-11-15T01:40:20.621433+0000","last_undegraded":"2023-11-15T01:40:20.621433+0000","last_fullsized":"2023-11-15T01:40:20.621433+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.644654+0000","last_change":"2023-11-15T01:40:20.643000+0000","last_active":"2023-11-15T01:40:20.644654+0000","last_peered":"2023-11-15T01:40:20.644654+0000","last_clean":"2023-11-15T01:40:20.644654+0000","last_became_active":"2023-11-15T01:40:20.642729+0000","last_became_peered":"2023-11-15T01:40:20.642729+0000","last_unstale":"2023-11-15T01:40:20.644654+0000","last_undegraded":"2023-11-15T01:40:20.644654+0000","last_fullsized":"2023-11-15T01:40:20.644654+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624849+0000","last_change":"2023-11-15T01:40:20.241858+0000","last_active":"2023-11-15T01:40:20.624849+0000","last_peered":"2023-11-15T01:40:20.624849+0000","last_clean":"2023-11-15T01:40:20.624849+0000","last_became_active":"2023-11-15T01:40:20.241543+0000","last_became_peered":"2023-11-15T01:40:20.241543+0000","last_unstale":"2023-11-15T01:40:20.624849+0000","last_undegraded":"2023-11-15T01:40:20.624849+0000","last_fullsized":"2023-11-15T01:40:20.624849+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646769+0000","last_change":"2023-11-15T01:40:20.240545+0000","last_active":"2023-11-15T01:40:20.646769+0000","last_peered":"2023-11-15T01:40:20.646769+0000","last_clean":"2023-11-15T01:40:20.646769+0000","last_became_active":"2023-11-15T01:40:20.239042+0000","last_became_peered":"2023-11-15T01:40:20.239042+0000","last_unstale":"2023-11-15T01:40:20.646769+0000","last_undegraded":"2023-11-15T01:40:20.646769+0000","last_fullsized":"2023-11-15T01:40:20.646769+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.635197+0000","last_change":"2023-11-15T01:40:20.631387+0000","last_active":"2023-11-15T01:40:20.635197+0000","last_peered":"2023-11-15T01:40:20.635197+0000","last_clean":"2023-11-15T01:40:20.635197+0000","last_became_active":"2023-11-15T01:40:20.631109+0000","last_became_peered":"2023-11-15T01:40:20.631109+0000","last_unstale":"2023-11-15T01:40:20.635197+0000","last_undegraded":"2023-11-15T01:40:20.635197+0000","last_fullsized":"2023-11-15T01:40:20.635197+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636721+0000","last_change":"2023-11-15T01:40:20.633661+0000","last_active":"2023-11-15T01:40:20.636721+0000","last_peered":"2023-11-15T01:40:20.636721+0000","last_clean":"2023-11-15T01:40:20.636721+0000","last_became_active":"2023-11-15T01:40:20.633445+0000","last_became_peered":"2023-11-15T01:40:20.633445+0000","last_unstale":"2023-11-15T01:40:20.636721+0000","last_undegraded":"2023-11-15T01:40:20.636721+0000","last_fullsized":"2023-11-15T01:40:20.636721+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646676+0000","last_change":"2023-11-15T01:40:20.637875+0000","last_active":"2023-11-15T01:40:20.646676+0000","last_peered":"2023-11-15T01:40:20.646676+0000","last_clean":"2023-11-15T01:40:20.646676+0000","last_became_active":"2023-11-15T01:40:20.637585+0000","last_became_peered":"2023-11-15T01:40:20.637585+0000","last_unstale":"2023-11-15T01:40:20.646676+0000","last_undegraded":"2023-11-15T01:40:20.646676+0000","last_fullsized":"2023-11-15T01:40:20.646676+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625633+0000","last_change":"2023-11-15T01:40:20.244237+0000","last_active":"2023-11-15T01:40:20.625633+0000","last_peered":"2023-11-15T01:40:20.625633+0000","last_clean":"2023-11-15T01:40:20.625633+0000","last_became_active":"2023-11-15T01:40:20.243903+0000","last_became_peered":"2023-11-15T01:40:20.243903+0000","last_unstale":"2023-11-15T01:40:20.625633+0000","last_undegraded":"2023-11-15T01:40:20.625633+0000","last_fullsized":"2023-11-15T01:40:20.625633+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641596+0000","last_change":"2023-11-15T01:40:20.637723+0000","last_active":"2023-11-15T01:40:20.641596+0000","last_peered":"2023-11-15T01:40:20.641596+0000","last_clean":"2023-11-15T01:40:20.641596+0000","last_became_active":"2023-11-15T01:40:20.637283+0000","last_became_peered":"2023-11-15T01:40:20.637283+0000","last_unstale":"2023-11-15T01:40:20.641596+0000","last_undegraded":"2023-11-15T01:40:20.641596+0000","last_fullsized":"2023-11-15T01:40:20.641596+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643228+0000","last_change":"2023-11-15T01:40:20.247664+0000","last_active":"2023-11-15T01:40:20.643228+0000","last_peered":"2023-11-15T01:40:20.643228+0000","last_clean":"2023-11-15T01:40:20.643228+0000","last_became_active":"2023-11-15T01:40:20.247230+0000","last_became_peered":"2023-11-15T01:40:20.247230+0000","last_unstale":"2023-11-15T01:40:20.643228+0000","last_undegraded":"2023-11-15T01:40:20.643228+0000","last_fullsized":"2023-11-15T01:40:20.643228+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643756+0000","last_change":"2023-11-15T01:40:20.641306+0000","last_active":"2023-11-15T01:40:20.643756+0000","last_peered":"2023-11-15T01:40:20.643756+0000","last_clean":"2023-11-15T01:40:20.643756+0000","last_became_active":"2023-11-15T01:40:20.641035+0000","last_became_peered":"2023-11-15T01:40:20.641035+0000","last_unstale":"2023-11-15T01:40:20.643756+0000","last_undegraded":"2023-11-15T01:40:20.643756+0000","last_fullsized":"2023-11-15T01:40:20.643756+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625156+0000","last_change":"2023-11-15T01:40:20.251493+0000","last_active":"2023-11-15T01:40:20.625156+0000","last_peered":"2023-11-15T01:40:20.625156+0000","last_clean":"2023-11-15T01:40:20.625156+0000","last_became_active":"2023-11-15T01:40:20.251199+0000","last_became_peered":"2023-11-15T01:40:20.251199+0000","last_unstale":"2023-11-15T01:40:20.625156+0000","last_undegraded":"2023-11-15T01:40:20.625156+0000","last_fullsized":"2023-11-15T01:40:20.625156+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645240+0000","last_change":"2023-11-15T01:40:20.638898+0000","last_active":"2023-11-15T01:40:20.645240+0000","last_peered":"2023-11-15T01:40:20.645240+0000","last_clean":"2023-11-15T01:40:20.645240+0000","last_became_active":"2023-11-15T01:40:20.638586+0000","last_became_peered":"2023-11-15T01:40:20.638586+0000","last_unstale":"2023-11-15T01:40:20.645240+0000","last_undegraded":"2023-11-15T01:40:20.645240+0000","last_fullsized":"2023-11-15T01:40:20.645240+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623288+0000","last_change":"2023-11-15T01:40:20.241464+0000","last_active":"2023-11-15T01:40:20.623288+0000","last_peered":"2023-11-15T01:40:20.623288+0000","last_clean":"2023-11-15T01:40:20.623288+0000","last_became_active":"2023-11-15T01:40:20.241198+0000","last_became_peered":"2023-11-15T01:40:20.241198+0000","last_unstale":"2023-11-15T01:40:20.623288+0000","last_undegraded":"2023-11-15T01:40:20.623288+0000","last_fullsized":"2023-11-15T01:40:20.623288+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647379+0000","last_change":"2023-11-15T01:40:20.644058+0000","last_active":"2023-11-15T01:40:20.647379+0000","last_peered":"2023-11-15T01:40:20.647379+0000","last_clean":"2023-11-15T01:40:20.647379+0000","last_became_active":"2023-11-15T01:40:20.643626+0000","last_became_peered":"2023-11-15T01:40:20.643626+0000","last_unstale":"2023-11-15T01:40:20.647379+0000","last_undegraded":"2023-11-15T01:40:20.647379+0000","last_fullsized":"2023-11-15T01:40:20.647379+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641162+0000","last_change":"2023-11-15T01:40:20.636946+0000","last_active":"2023-11-15T01:40:20.641162+0000","last_peered":"2023-11-15T01:40:20.641162+0000","last_clean":"2023-11-15T01:40:20.641162+0000","last_became_active":"2023-11-15T01:40:20.636691+0000","last_became_peered":"2023-11-15T01:40:20.636691+0000","last_unstale":"2023-11-15T01:40:20.641162+0000","last_undegraded":"2023-11-15T01:40:20.641162+0000","last_fullsized":"2023-11-15T01:40:20.641162+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623449+0000","last_change":"2023-11-15T01:40:20.246711+0000","last_active":"2023-11-15T01:40:20.623449+0000","last_peered":"2023-11-15T01:40:20.623449+0000","last_clean":"2023-11-15T01:40:20.623449+0000","last_became_active":"2023-11-15T01:40:20.246122+0000","last_became_peered":"2023-11-15T01:40:20.246122+0000","last_unstale":"2023-11-15T01:40:20.623449+0000","last_undegraded":"2023-11-15T01:40:20.623449+0000","last_fullsized":"2023-11-15T01:40:20.623449+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641958+0000","last_change":"2023-11-15T01:40:20.241698+0000","last_active":"2023-11-15T01:40:20.641958+0000","last_peered":"2023-11-15T01:40:20.641958+0000","last_clean":"2023-11-15T01:40:20.641958+0000","last_became_active":"2023-11-15T01:40:20.241234+0000","last_became_peered":"2023-11-15T01:40:20.241234+0000","last_unstale":"2023-11-15T01:40:20.641958+0000","last_undegraded":"2023-11-15T01:40:20.641958+0000","last_fullsized":"2023-11-15T01:40:20.641958+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626753+0000","last_change":"2023-11-15T01:40:20.237581+0000","last_active":"2023-11-15T01:40:20.626753+0000","last_peered":"2023-11-15T01:40:20.626753+0000","last_clean":"2023-11-15T01:40:20.626753+0000","last_became_active":"2023-11-15T01:40:20.237275+0000","last_became_peered":"2023-11-15T01:40:20.237275+0000","last_unstale":"2023-11-15T01:40:20.626753+0000","last_undegraded":"2023-11-15T01:40:20.626753+0000","last_fullsized":"2023-11-15T01:40:20.626753+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.648077+0000","last_change":"2023-11-15T01:40:20.642674+0000","last_active":"2023-11-15T01:40:20.648077+0000","last_peered":"2023-11-15T01:40:20.648077+0000","last_clean":"2023-11-15T01:40:20.648077+0000","last_became_active":"2023-11-15T01:40:20.642262+0000","last_became_peered":"2023-11-15T01:40:20.642262+0000","last_unstale":"2023-11-15T01:40:20.648077+0000","last_undegraded":"2023-11-15T01:40:20.648077+0000","last_fullsized":"2023-11-15T01:40:20.648077+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623200+0000","last_change":"2023-11-15T01:40:20.244798+0000","last_active":"2023-11-15T01:40:20.623200+0000","last_peered":"2023-11-15T01:40:20.623200+0000","last_clean":"2023-11-15T01:40:20.623200+0000","last_became_active":"2023-11-15T01:40:20.244394+0000","last_became_peered":"2023-11-15T01:40:20.244394+0000","last_unstale":"2023-11-15T01:40:20.623200+0000","last_undegraded":"2023-11-15T01:40:20.623200+0000","last_fullsized":"2023-11-15T01:40:20.623200+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623850+0000","last_change":"2023-11-15T01:40:20.248505+0000","last_active":"2023-11-15T01:40:20.623850+0000","last_peered":"2023-11-15T01:40:20.623850+0000","last_clean":"2023-11-15T01:40:20.623850+0000","last_became_active":"2023-11-15T01:40:20.248152+0000","last_became_peered":"2023-11-15T01:40:20.248152+0000","last_unstale":"2023-11-15T01:40:20.623850+0000","last_undegraded":"2023-11-15T01:40:20.623850+0000","last_fullsized":"2023-11-15T01:40:20.623850+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645073+0000","last_change":"2023-11-15T01:40:20.643161+0000","last_active":"2023-11-15T01:40:20.645073+0000","last_peered":"2023-11-15T01:40:20.645073+0000","last_clean":"2023-11-15T01:40:20.645073+0000","last_became_active":"2023-11-15T01:40:20.642562+0000","last_became_peered":"2023-11-15T01:40:20.642562+0000","last_unstale":"2023-11-15T01:40:20.645073+0000","last_undegraded":"2023-11-15T01:40:20.645073+0000","last_fullsized":"2023-11-15T01:40:20.645073+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625167+0000","last_change":"2023-11-15T01:40:20.242250+0000","last_active":"2023-11-15T01:40:20.625167+0000","last_peered":"2023-11-15T01:40:20.625167+0000","last_clean":"2023-11-15T01:40:20.625167+0000","last_became_active":"2023-11-15T01:40:20.242006+0000","last_became_peered":"2023-11-15T01:40:20.242006+0000","last_unstale":"2023-11-15T01:40:20.625167+0000","last_undegraded":"2023-11-15T01:40:20.625167+0000","last_fullsized":"2023-11-15T01:40:20.625167+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645367+0000","last_change":"2023-11-15T01:40:20.639227+0000","last_active":"2023-11-15T01:40:20.645367+0000","last_peered":"2023-11-15T01:40:20.645367+0000","last_clean":"2023-11-15T01:40:20.645367+0000","last_became_active":"2023-11-15T01:40:20.638956+0000","last_became_peered":"2023-11-15T01:40:20.638956+0000","last_unstale":"2023-11-15T01:40:20.645367+0000","last_undegraded":"2023-11-15T01:40:20.645367+0000","last_fullsized":"2023-11-15T01:40:20.645367+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621391+0000","last_change":"2023-11-15T01:40:20.241565+0000","last_active":"2023-11-15T01:40:20.621391+0000","last_peered":"2023-11-15T01:40:20.621391+0000","last_clean":"2023-11-15T01:40:20.621391+0000","last_became_active":"2023-11-15T01:40:20.241253+0000","last_became_peered":"2023-11-15T01:40:20.241253+0000","last_unstale":"2023-11-15T01:40:20.621391+0000","last_undegraded":"2023-11-15T01:40:20.621391+0000","last_fullsized":"2023-11-15T01:40:20.621391+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634580+0000","last_change":"2023-11-15T01:40:20.631271+0000","last_active":"2023-11-15T01:40:20.634580+0000","last_peered":"2023-11-15T01:40:20.634580+0000","last_clean":"2023-11-15T01:40:20.634580+0000","last_became_active":"2023-11-15T01:40:20.630984+0000","last_became_peered":"2023-11-15T01:40:20.630984+0000","last_unstale":"2023-11-15T01:40:20.634580+0000","last_undegraded":"2023-11-15T01:40:20.634580+0000","last_fullsized":"2023-11-15T01:40:20.634580+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625566+0000","last_change":"2023-11-15T01:40:20.245556+0000","last_active":"2023-11-15T01:40:20.625566+0000","last_peered":"2023-11-15T01:40:20.625566+0000","last_clean":"2023-11-15T01:40:20.625566+0000","last_became_active":"2023-11-15T01:40:20.245270+0000","last_became_peered":"2023-11-15T01:40:20.245270+0000","last_unstale":"2023-11-15T01:40:20.625566+0000","last_undegraded":"2023-11-15T01:40:20.625566+0000","last_fullsized":"2023-11-15T01:40:20.625566+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623365+0000","last_change":"2023-11-15T01:40:20.240505+0000","last_active":"2023-11-15T01:40:20.623365+0000","last_peered":"2023-11-15T01:40:20.623365+0000","last_clean":"2023-11-15T01:40:20.623365+0000","last_became_active":"2023-11-15T01:40:20.240212+0000","last_became_peered":"2023-11-15T01:40:20.240212+0000","last_unstale":"2023-11-15T01:40:20.623365+0000","last_undegraded":"2023-11-15T01:40:20.623365+0000","last_fullsized":"2023-11-15T01:40:20.623365+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623047+0000","last_change":"2023-11-15T01:40:20.246872+0000","last_active":"2023-11-15T01:40:20.623047+0000","last_peered":"2023-11-15T01:40:20.623047+0000","last_clean":"2023-11-15T01:40:20.623047+0000","last_became_active":"2023-11-15T01:40:20.246537+0000","last_became_peered":"2023-11-15T01:40:20.246537+0000","last_unstale":"2023-11-15T01:40:20.623047+0000","last_undegraded":"2023-11-15T01:40:20.623047+0000","last_fullsized":"2023-11-15T01:40:20.623047+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647040+0000","last_change":"2023-11-15T01:40:20.645113+0000","last_active":"2023-11-15T01:40:20.647040+0000","last_peered":"2023-11-15T01:40:20.647040+0000","last_clean":"2023-11-15T01:40:20.647040+0000","last_became_active":"2023-11-15T01:40:20.644570+0000","last_became_peered":"2023-11-15T01:40:20.644570+0000","last_unstale":"2023-11-15T01:40:20.647040+0000","last_undegraded":"2023-11-15T01:40:20.647040+0000","last_fullsized":"2023-11-15T01:40:20.647040+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.620507+0000","last_change":"2023-11-15T01:40:20.238797+0000","last_active":"2023-11-15T01:40:20.620507+0000","last_peered":"2023-11-15T01:40:20.620507+0000","last_clean":"2023-11-15T01:40:20.620507+0000","last_became_active":"2023-11-15T01:40:20.238516+0000","last_became_peered":"2023-11-15T01:40:20.238516+0000","last_unstale":"2023-11-15T01:40:20.620507+0000","last_undegraded":"2023-11-15T01:40:20.620507+0000","last_fullsized":"2023-11-15T01:40:20.620507+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.635078+0000","last_change":"2023-11-15T01:40:20.631036+0000","last_active":"2023-11-15T01:40:20.635078+0000","last_peered":"2023-11-15T01:40:20.635078+0000","last_clean":"2023-11-15T01:40:20.635078+0000","last_became_active":"2023-11-15T01:40:20.630762+0000","last_became_peered":"2023-11-15T01:40:20.630762+0000","last_unstale":"2023-11-15T01:40:20.635078+0000","last_undegraded":"2023-11-15T01:40:20.635078+0000","last_fullsized":"2023-11-15T01:40:20.635078+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625588+0000","last_change":"2023-11-15T01:40:20.244705+0000","last_active":"2023-11-15T01:40:20.625588+0000","last_peered":"2023-11-15T01:40:20.625588+0000","last_clean":"2023-11-15T01:40:20.625588+0000","last_became_active":"2023-11-15T01:40:20.244432+0000","last_became_peered":"2023-11-15T01:40:20.244432+0000","last_unstale":"2023-11-15T01:40:20.625588+0000","last_undegraded":"2023-11-15T01:40:20.625588+0000","last_fullsized":"2023-11-15T01:40:20.625588+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645095+0000","last_change":"2023-11-15T01:40:20.643897+0000","last_active":"2023-11-15T01:40:20.645095+0000","last_peered":"2023-11-15T01:40:20.645095+0000","last_clean":"2023-11-15T01:40:20.645095+0000","last_became_active":"2023-11-15T01:40:20.643619+0000","last_became_peered":"2023-11-15T01:40:20.643619+0000","last_unstale":"2023-11-15T01:40:20.645095+0000","last_undegraded":"2023-11-15T01:40:20.645095+0000","last_fullsized":"2023-11-15T01:40:20.645095+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.631561+0000","last_change":"2023-11-15T01:40:20.245866+0000","last_active":"2023-11-15T01:40:20.631561+0000","last_peered":"2023-11-15T01:40:20.631561+0000","last_clean":"2023-11-15T01:40:20.631561+0000","last_became_active":"2023-11-15T01:40:20.245176+0000","last_became_peered":"2023-11-15T01:40:20.245176+0000","last_unstale":"2023-11-15T01:40:20.631561+0000","last_undegraded":"2023-11-15T01:40:20.631561+0000","last_fullsized":"2023-11-15T01:40:20.631561+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.632732+0000","last_change":"2023-11-15T01:40:20.630832+0000","last_active":"2023-11-15T01:40:20.632732+0000","last_peered":"2023-11-15T01:40:20.632732+0000","last_clean":"2023-11-15T01:40:20.632732+0000","last_became_active":"2023-11-15T01:40:20.630527+0000","last_became_peered":"2023-11-15T01:40:20.630527+0000","last_unstale":"2023-11-15T01:40:20.632732+0000","last_undegraded":"2023-11-15T01:40:20.632732+0000","last_fullsized":"2023-11-15T01:40:20.632732+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636373+0000","last_change":"2023-11-15T01:40:20.239525+0000","last_active":"2023-11-15T01:40:20.636373+0000","last_peered":"2023-11-15T01:40:20.636373+0000","last_clean":"2023-11-15T01:40:20.636373+0000","last_became_active":"2023-11-15T01:40:20.239187+0000","last_became_peered":"2023-11-15T01:40:20.239187+0000","last_unstale":"2023-11-15T01:40:20.636373+0000","last_undegraded":"2023-11-15T01:40:20.636373+0000","last_fullsized":"2023-11-15T01:40:20.636373+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626997+0000","last_change":"2023-11-15T01:40:20.244328+0000","last_active":"2023-11-15T01:40:20.626997+0000","last_peered":"2023-11-15T01:40:20.626997+0000","last_clean":"2023-11-15T01:40:20.626997+0000","last_became_active":"2023-11-15T01:40:20.243358+0000","last_became_peered":"2023-11-15T01:40:20.243358+0000","last_unstale":"2023-11-15T01:40:20.626997+0000","last_undegraded":"2023-11-15T01:40:20.626997+0000","last_fullsized":"2023-11-15T01:40:20.626997+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640451+0000","last_change":"2023-11-15T01:40:20.636332+0000","last_active":"2023-11-15T01:40:20.640451+0000","last_peered":"2023-11-15T01:40:20.640451+0000","last_clean":"2023-11-15T01:40:20.640451+0000","last_became_active":"2023-11-15T01:40:20.636042+0000","last_became_peered":"2023-11-15T01:40:20.636042+0000","last_unstale":"2023-11-15T01:40:20.640451+0000","last_undegraded":"2023-11-15T01:40:20.640451+0000","last_fullsized":"2023-11-15T01:40:20.640451+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623071+0000","last_change":"2023-11-15T01:40:20.248987+0000","last_active":"2023-11-15T01:40:20.623071+0000","last_peered":"2023-11-15T01:40:20.623071+0000","last_clean":"2023-11-15T01:40:20.623071+0000","last_became_active":"2023-11-15T01:40:20.248720+0000","last_became_peered":"2023-11-15T01:40:20.248720+0000","last_unstale":"2023-11-15T01:40:20.623071+0000","last_undegraded":"2023-11-15T01:40:20.623071+0000","last_fullsized":"2023-11-15T01:40:20.623071+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.644975+0000","last_change":"2023-11-15T01:40:20.638835+0000","last_active":"2023-11-15T01:40:20.644975+0000","last_peered":"2023-11-15T01:40:20.644975+0000","last_clean":"2023-11-15T01:40:20.644975+0000","last_became_active":"2023-11-15T01:40:20.638503+0000","last_became_peered":"2023-11-15T01:40:20.638503+0000","last_unstale":"2023-11-15T01:40:20.644975+0000","last_undegraded":"2023-11-15T01:40:20.644975+0000","last_fullsized":"2023-11-15T01:40:20.644975+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621337+0000","last_change":"2023-11-15T01:40:20.244973+0000","last_active":"2023-11-15T01:40:20.621337+0000","last_peered":"2023-11-15T01:40:20.621337+0000","last_clean":"2023-11-15T01:40:20.621337+0000","last_became_active":"2023-11-15T01:40:20.244693+0000","last_became_peered":"2023-11-15T01:40:20.244693+0000","last_unstale":"2023-11-15T01:40:20.621337+0000","last_undegraded":"2023-11-15T01:40:20.621337+0000","last_fullsized":"2023-11-15T01:40:20.621337+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646635+0000","last_change":"2023-11-15T01:40:20.637751+0000","last_active":"2023-11-15T01:40:20.646635+0000","last_peered":"2023-11-15T01:40:20.646635+0000","last_clean":"2023-11-15T01:40:20.646635+0000","last_became_active":"2023-11-15T01:40:20.637065+0000","last_became_peered":"2023-11-15T01:40:20.637065+0000","last_unstale":"2023-11-15T01:40:20.646635+0000","last_undegraded":"2023-11-15T01:40:20.646635+0000","last_fullsized":"2023-11-15T01:40:20.646635+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637071+0000","last_change":"2023-11-15T01:40:20.632019+0000","last_active":"2023-11-15T01:40:20.637071+0000","last_peered":"2023-11-15T01:40:20.637071+0000","last_clean":"2023-11-15T01:40:20.637071+0000","last_became_active":"2023-11-15T01:40:20.631739+0000","last_became_peered":"2023-11-15T01:40:20.631739+0000","last_unstale":"2023-11-15T01:40:20.637071+0000","last_undegraded":"2023-11-15T01:40:20.637071+0000","last_fullsized":"2023-11-15T01:40:20.637071+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621235+0000","last_change":"2023-11-15T01:40:20.241452+0000","last_active":"2023-11-15T01:40:20.621235+0000","last_peered":"2023-11-15T01:40:20.621235+0000","last_clean":"2023-11-15T01:40:20.621235+0000","last_became_active":"2023-11-15T01:40:20.241153+0000","last_became_peered":"2023-11-15T01:40:20.241153+0000","last_unstale":"2023-11-15T01:40:20.621235+0000","last_undegraded":"2023-11-15T01:40:20.621235+0000","last_fullsized":"2023-11-15T01:40:20.621235+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.642580+0000","last_change":"2023-11-15T01:40:20.240160+0000","last_active":"2023-11-15T01:40:20.642580+0000","last_peered":"2023-11-15T01:40:20.642580+0000","last_clean":"2023-11-15T01:40:20.642580+0000","last_became_active":"2023-11-15T01:40:20.239856+0000","last_became_peered":"2023-11-15T01:40:20.239856+0000","last_unstale":"2023-11-15T01:40:20.642580+0000","last_undegraded":"2023-11-15T01:40:20.642580+0000","last_fullsized":"2023-11-15T01:40:20.642580+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634603+0000","last_change":"2023-11-15T01:40:20.631436+0000","last_active":"2023-11-15T01:40:20.634603+0000","last_peered":"2023-11-15T01:40:20.634603+0000","last_clean":"2023-11-15T01:40:20.634603+0000","last_became_active":"2023-11-15T01:40:20.631020+0000","last_became_peered":"2023-11-15T01:40:20.631020+0000","last_unstale":"2023-11-15T01:40:20.634603+0000","last_undegraded":"2023-11-15T01:40:20.634603+0000","last_fullsized":"2023-11-15T01:40:20.634603+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640104+0000","last_change":"2023-11-15T01:40:20.243673+0000","last_active":"2023-11-15T01:40:20.640104+0000","last_peered":"2023-11-15T01:40:20.640104+0000","last_clean":"2023-11-15T01:40:20.640104+0000","last_became_active":"2023-11-15T01:40:20.243237+0000","last_became_peered":"2023-11-15T01:40:20.243237+0000","last_unstale":"2023-11-15T01:40:20.640104+0000","last_undegraded":"2023-11-15T01:40:20.640104+0000","last_fullsized":"2023-11-15T01:40:20.640104+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641997+0000","last_change":"2023-11-15T01:40:20.636870+0000","last_active":"2023-11-15T01:40:20.641997+0000","last_peered":"2023-11-15T01:40:20.641997+0000","last_clean":"2023-11-15T01:40:20.641997+0000","last_became_active":"2023-11-15T01:40:20.636598+0000","last_became_peered":"2023-11-15T01:40:20.636598+0000","last_unstale":"2023-11-15T01:40:20.641997+0000","last_undegraded":"2023-11-15T01:40:20.641997+0000","last_fullsized":"2023-11-15T01:40:20.641997+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640933+0000","last_change":"2023-11-15T01:40:20.638425+0000","last_active":"2023-11-15T01:40:20.640933+0000","last_peered":"2023-11-15T01:40:20.640933+0000","last_clean":"2023-11-15T01:40:20.640933+0000","last_became_active":"2023-11-15T01:40:20.638126+0000","last_became_peered":"2023-11-15T01:40:20.638126+0000","last_unstale":"2023-11-15T01:40:20.640933+0000","last_undegraded":"2023-11-15T01:40:20.640933+0000","last_fullsized":"2023-11-15T01:40:20.640933+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634331+0000","last_change":"2023-11-15T01:40:20.247847+0000","last_active":"2023-11-15T01:40:20.634331+0000","last_peered":"2023-11-15T01:40:20.634331+0000","last_clean":"2023-11-15T01:40:20.634331+0000","last_became_active":"2023-11-15T01:40:20.247546+0000","last_became_peered":"2023-11-15T01:40:20.247546+0000","last_unstale":"2023-11-15T01:40:20.634331+0000","last_undegraded":"2023-11-15T01:40:20.634331+0000","last_fullsized":"2023-11-15T01:40:20.634331+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.639125+0000","last_change":"2023-11-15T01:40:20.634983+0000","last_active":"2023-11-15T01:40:20.639125+0000","last_peered":"2023-11-15T01:40:20.639125+0000","last_clean":"2023-11-15T01:40:20.639125+0000","last_became_active":"2023-11-15T01:40:20.634686+0000","last_became_peered":"2023-11-15T01:40:20.634686+0000","last_unstale":"2023-11-15T01:40:20.639125+0000","last_undegraded":"2023-11-15T01:40:20.639125+0000","last_fullsized":"2023-11-15T01:40:20.639125+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646657+0000","last_change":"2023-11-15T01:40:20.637803+0000","last_active":"2023-11-15T01:40:20.646657+0000","last_peered":"2023-11-15T01:40:20.646657+0000","last_clean":"2023-11-15T01:40:20.646657+0000","last_became_active":"2023-11-15T01:40:20.637531+0000","last_became_peered":"2023-11-15T01:40:20.637531+0000","last_unstale":"2023-11-15T01:40:20.646657+0000","last_undegraded":"2023-11-15T01:40:20.646657+0000","last_fullsized":"2023-11-15T01:40:20.646657+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623955+0000","last_change":"2023-11-15T01:40:20.241323+0000","last_active":"2023-11-15T01:40:20.623955+0000","last_peered":"2023-11-15T01:40:20.623955+0000","last_clean":"2023-11-15T01:40:20.623955+0000","last_became_active":"2023-11-15T01:40:20.241039+0000","last_became_peered":"2023-11-15T01:40:20.241039+0000","last_unstale":"2023-11-15T01:40:20.623955+0000","last_undegraded":"2023-11-15T01:40:20.623955+0000","last_fullsized":"2023-11-15T01:40:20.623955+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643154+0000","last_change":"2023-11-15T01:40:20.639732+0000","last_active":"2023-11-15T01:40:20.643154+0000","last_peered":"2023-11-15T01:40:20.643154+0000","last_clean":"2023-11-15T01:40:20.643154+0000","last_became_active":"2023-11-15T01:40:20.638787+0000","last_became_peered":"2023-11-15T01:40:20.638787+0000","last_unstale":"2023-11-15T01:40:20.643154+0000","last_undegraded":"2023-11-15T01:40:20.643154+0000","last_fullsized":"2023-11-15T01:40:20.643154+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.633299+0000","last_change":"2023-11-15T01:40:20.243269+0000","last_active":"2023-11-15T01:40:20.633299+0000","last_peered":"2023-11-15T01:40:20.633299+0000","last_clean":"2023-11-15T01:40:20.633299+0000","last_became_active":"2023-11-15T01:40:20.241757+0000","last_became_peered":"2023-11-15T01:40:20.241757+0000","last_unstale":"2023-11-15T01:40:20.633299+0000","last_undegraded":"2023-11-15T01:40:20.633299+0000","last_fullsized":"2023-11-15T01:40:20.633299+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640383+0000","last_change":"2023-11-15T01:40:20.635969+0000","last_active":"2023-11-15T01:40:20.640383+0000","last_peered":"2023-11-15T01:40:20.640383+0000","last_clean":"2023-11-15T01:40:20.640383+0000","last_became_active":"2023-11-15T01:40:20.635682+0000","last_became_peered":"2023-11-15T01:40:20.635682+0000","last_unstale":"2023-11-15T01:40:20.640383+0000","last_undegraded":"2023-11-15T01:40:20.640383+0000","last_fullsized":"2023-11-15T01:40:20.640383+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623421+0000","last_change":"2023-11-15T01:40:20.244894+0000","last_active":"2023-11-15T01:40:20.623421+0000","last_peered":"2023-11-15T01:40:20.623421+0000","last_clean":"2023-11-15T01:40:20.623421+0000","last_became_active":"2023-11-15T01:40:20.244195+0000","last_became_peered":"2023-11-15T01:40:20.244195+0000","last_unstale":"2023-11-15T01:40:20.623421+0000","last_undegraded":"2023-11-15T01:40:20.623421+0000","last_fullsized":"2023-11-15T01:40:20.623421+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624405+0000","last_change":"2023-11-15T01:40:20.244674+0000","last_active":"2023-11-15T01:40:20.624405+0000","last_peered":"2023-11-15T01:40:20.624405+0000","last_clean":"2023-11-15T01:40:20.624405+0000","last_became_active":"2023-11-15T01:40:20.244188+0000","last_became_peered":"2023-11-15T01:40:20.244188+0000","last_unstale":"2023-11-15T01:40:20.624405+0000","last_undegraded":"2023-11-15T01:40:20.624405+0000","last_fullsized":"2023-11-15T01:40:20.624405+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641364+0000","last_change":"2023-11-15T01:40:20.636297+0000","last_active":"2023-11-15T01:40:20.641364+0000","last_peered":"2023-11-15T01:40:20.641364+0000","last_clean":"2023-11-15T01:40:20.641364+0000","last_became_active":"2023-11-15T01:40:20.635914+0000","last_became_peered":"2023-11-15T01:40:20.635914+0000","last_unstale":"2023-11-15T01:40:20.641364+0000","last_undegraded":"2023-11-15T01:40:20.641364+0000","last_fullsized":"2023-11-15T01:40:20.641364+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623546+0000","last_change":"2023-11-15T01:40:20.249114+0000","last_active":"2023-11-15T01:40:20.623546+0000","last_peered":"2023-11-15T01:40:20.623546+0000","last_clean":"2023-11-15T01:40:20.623546+0000","last_became_active":"2023-11-15T01:40:20.248806+0000","last_became_peered":"2023-11-15T01:40:20.248806+0000","last_unstale":"2023-11-15T01:40:20.623546+0000","last_undegraded":"2023-11-15T01:40:20.623546+0000","last_fullsized":"2023-11-15T01:40:20.623546+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640914+0000","last_change":"2023-11-15T01:40:20.634111+0000","last_active":"2023-11-15T01:40:20.640914+0000","last_peered":"2023-11-15T01:40:20.640914+0000","last_clean":"2023-11-15T01:40:20.640914+0000","last_became_active":"2023-11-15T01:40:20.633828+0000","last_became_peered":"2023-11-15T01:40:20.633828+0000","last_unstale":"2023-11-15T01:40:20.640914+0000","last_undegraded":"2023-11-15T01:40:20.640914+0000","last_fullsized":"2023-11-15T01:40:20.640914+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623178+0000","last_change":"2023-11-15T01:40:20.243830+0000","last_active":"2023-11-15T01:40:20.623178+0000","last_peered":"2023-11-15T01:40:20.623178+0000","last_clean":"2023-11-15T01:40:20.623178+0000","last_became_active":"2023-11-15T01:40:20.243522+0000","last_became_peered":"2023-11-15T01:40:20.243522+0000","last_unstale":"2023-11-15T01:40:20.623178+0000","last_undegraded":"2023-11-15T01:40:20.623178+0000","last_fullsized":"2023-11-15T01:40:20.623178+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646619+0000","last_change":"2023-11-15T01:40:20.637658+0000","last_active":"2023-11-15T01:40:20.646619+0000","last_peered":"2023-11-15T01:40:20.646619+0000","last_clean":"2023-11-15T01:40:20.646619+0000","last_became_active":"2023-11-15T01:40:20.637349+0000","last_became_peered":"2023-11-15T01:40:20.637349+0000","last_unstale":"2023-11-15T01:40:20.646619+0000","last_undegraded":"2023-11-15T01:40:20.646619+0000","last_fullsized":"2023-11-15T01:40:20.646619+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.622664+0000","last_change":"2023-11-15T01:40:20.246311+0000","last_active":"2023-11-15T01:40:20.622664+0000","last_peered":"2023-11-15T01:40:20.622664+0000","last_clean":"2023-11-15T01:40:20.622664+0000","last_became_active":"2023-11-15T01:40:20.245907+0000","last_became_peered":"2023-11-15T01:40:20.245907+0000","last_unstale":"2023-11-15T01:40:20.622664+0000","last_undegraded":"2023-11-15T01:40:20.622664+0000","last_fullsized":"2023-11-15T01:40:20.622664+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.620564+0000","last_change":"2023-11-15T01:40:20.249564+0000","last_active":"2023-11-15T01:40:20.620564+0000","last_peered":"2023-11-15T01:40:20.620564+0000","last_clean":"2023-11-15T01:40:20.620564+0000","last_became_active":"2023-11-15T01:40:20.249234+0000","last_became_peered":"2023-11-15T01:40:20.249234+0000","last_unstale":"2023-11-15T01:40:20.620564+0000","last_undegraded":"2023-11-15T01:40:20.620564+0000","last_fullsized":"2023-11-15T01:40:20.620564+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641575+0000","last_change":"2023-11-15T01:40:20.637554+0000","last_active":"2023-11-15T01:40:20.641575+0000","last_peered":"2023-11-15T01:40:20.641575+0000","last_clean":"2023-11-15T01:40:20.641575+0000","last_became_active":"2023-11-15T01:40:20.636661+0000","last_became_peered":"2023-11-15T01:40:20.636661+0000","last_unstale":"2023-11-15T01:40:20.641575+0000","last_undegraded":"2023-11-15T01:40:20.641575+0000","last_fullsized":"2023-11-15T01:40:20.641575+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640421+0000","last_change":"2023-11-15T01:40:20.634926+0000","last_active":"2023-11-15T01:40:20.640421+0000","last_peered":"2023-11-15T01:40:20.640421+0000","last_clean":"2023-11-15T01:40:20.640421+0000","last_became_active":"2023-11-15T01:40:20.634638+0000","last_became_peered":"2023-11-15T01:40:20.634638+0000","last_unstale":"2023-11-15T01:40:20.640421+0000","last_undegraded":"2023-11-15T01:40:20.640421+0000","last_fullsized":"2023-11-15T01:40:20.640421+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623813+0000","last_change":"2023-11-15T01:40:20.245508+0000","last_active":"2023-11-15T01:40:20.623813+0000","last_peered":"2023-11-15T01:40:20.623813+0000","last_clean":"2023-11-15T01:40:20.623813+0000","last_became_active":"2023-11-15T01:40:20.243956+0000","last_became_peered":"2023-11-15T01:40:20.243956+0000","last_unstale":"2023-11-15T01:40:20.623813+0000","last_undegraded":"2023-11-15T01:40:20.623813+0000","last_fullsized":"2023-11-15T01:40:20.623813+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626981+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:40:20.626981+0000","last_peered":"2023-11-15T01:40:20.626981+0000","last_clean":"2023-11-15T01:40:20.626981+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:40:20.626981+0000","last_undegraded":"2023-11-15T01:40:20.626981+0000","last_fullsized":"2023-11-15T01:40:20.626981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.629120+0000","last_change":"2023-11-15T01:40:20.625014+0000","last_active":"2023-11-15T01:40:20.629120+0000","last_peered":"2023-11-15T01:40:20.629120+0000","last_clean":"2023-11-15T01:40:20.629120+0000","last_became_active":"2023-11-15T01:40:20.624716+0000","last_became_peered":"2023-11-15T01:40:20.624716+0000","last_unstale":"2023-11-15T01:40:20.629120+0000","last_undegraded":"2023-11-15T01:40:20.629120+0000","last_fullsized":"2023-11-15T01:40:20.629120+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623840+0000","last_change":"2023-11-15T01:40:20.242768+0000","last_active":"2023-11-15T01:40:20.623840+0000","last_peered":"2023-11-15T01:40:20.623840+0000","last_clean":"2023-11-15T01:40:20.623840+0000","last_became_active":"2023-11-15T01:40:20.242476+0000","last_became_peered":"2023-11-15T01:40:20.242476+0000","last_unstale":"2023-11-15T01:40:20.623840+0000","last_undegraded":"2023-11-15T01:40:20.623840+0000","last_fullsized":"2023-11-15T01:40:20.623840+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-11-15T01:40:15.885299+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:40:15.885299+0000","last_peered":"2023-11-15T01:40:15.885299+0000","last_clean":"2023-11-15T01:40:15.885299+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:40:15.885299+0000","last_undegraded":"2023-11-15T01:40:15.885299+0000","last_fullsized":"2023-11-15T01:40:15.885299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641810+0000","last_change":"2023-11-15T01:40:20.639491+0000","last_active":"2023-11-15T01:40:20.641810+0000","last_peered":"2023-11-15T01:40:20.641810+0000","last_clean":"2023-11-15T01:40:20.641810+0000","last_became_active":"2023-11-15T01:40:20.639223+0000","last_became_peered":"2023-11-15T01:40:20.639223+0000","last_unstale":"2023-11-15T01:40:20.641810+0000","last_undegraded":"2023-11-15T01:40:20.641810+0000","last_fullsized":"2023-11-15T01:40:20.641810+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.627927+0000","last_change":"2023-11-15T01:40:20.232634+0000","last_active":"2023-11-15T01:40:20.627927+0000","last_peered":"2023-11-15T01:40:20.627927+0000","last_clean":"2023-11-15T01:40:20.627927+0000","last_became_active":"2023-11-15T01:40:20.232339+0000","last_became_peered":"2023-11-15T01:40:20.232339+0000","last_unstale":"2023-11-15T01:40:20.627927+0000","last_undegraded":"2023-11-15T01:40:20.627927+0000","last_fullsized":"2023-11-15T01:40:20.627927+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":123,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.616573+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:40:20.616573+0000","last_peered":"2023-11-15T01:40:20.616573+0000","last_clean":"2023-11-15T01:40:20.616573+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:40:20.616573+0000","last_undegraded":"2023-11-15T01:40:20.616573+0000","last_fullsized":"2023-11-15T01:40:20.616573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645299+0000","last_change":"2023-11-15T01:40:20.243969+0000","last_active":"2023-11-15T01:40:20.645299+0000","last_peered":"2023-11-15T01:40:20.645299+0000","last_clean":"2023-11-15T01:40:20.645299+0000","last_became_active":"2023-11-15T01:40:20.243703+0000","last_became_peered":"2023-11-15T01:40:20.243703+0000","last_unstale":"2023-11-15T01:40:20.645299+0000","last_undegraded":"2023-11-15T01:40:20.645299+0000","last_fullsized":"2023-11-15T01:40:20.645299+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":110,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-11-15T01:40:15.885298+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:40:15.885298+0000","last_peered":"2023-11-15T01:40:15.885298+0000","last_clean":"2023-11-15T01:40:15.885298+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:40:15.885298+0000","last_undegraded":"2023-11-15T01:40:15.885298+0000","last_fullsized":"2023-11-15T01:40:15.885298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-11-15T01:40:15.250436+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:40:15.250436+0000","last_peered":"2023-11-15T01:40:15.250436+0000","last_clean":"2023-11-15T01:40:15.250436+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:40:15.250436+0000","last_undegraded":"2023-11-15T01:40:15.250436+0000","last_fullsized":"2023-11-15T01:40:15.250436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.638169+0000","last_change":"2023-11-15T01:40:20.633092+0000","last_active":"2023-11-15T01:40:20.638169+0000","last_peered":"2023-11-15T01:40:20.638169+0000","last_clean":"2023-11-15T01:40:20.638169+0000","last_became_active":"2023-11-15T01:40:20.632795+0000","last_became_peered":"2023-11-15T01:40:20.632795+0000","last_unstale":"2023-11-15T01:40:20.638169+0000","last_undegraded":"2023-11-15T01:40:20.638169+0000","last_fullsized":"2023-11-15T01:40:20.638169+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634086+0000","last_change":"2023-11-15T01:40:20.246780+0000","last_active":"2023-11-15T01:40:20.634086+0000","last_peered":"2023-11-15T01:40:20.634086+0000","last_clean":"2023-11-15T01:40:20.634086+0000","last_became_active":"2023-11-15T01:40:20.246469+0000","last_became_peered":"2023-11-15T01:40:20.246469+0000","last_unstale":"2023-11-15T01:40:20.634086+0000","last_undegraded":"2023-11-15T01:40:20.634086+0000","last_fullsized":"2023-11-15T01:40:20.634086+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-11-15T01:40:15.250438+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:40:15.250438+0000","last_peered":"2023-11-15T01:40:15.250438+0000","last_clean":"2023-11-15T01:40:15.250438+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:40:15.250438+0000","last_undegraded":"2023-11-15T01:40:15.250438+0000","last_fullsized":"2023-11-15T01:40:15.250438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-11-15T01:40:15.250453+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:40:15.250453+0000","last_peered":"2023-11-15T01:40:15.250453+0000","last_clean":"2023-11-15T01:40:15.250453+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:40:15.250453+0000","last_undegraded":"2023-11-15T01:40:15.250453+0000","last_fullsized":"2023-11-15T01:40:15.250453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647346+0000","last_change":"2023-11-15T01:40:20.638187+0000","last_active":"2023-11-15T01:40:20.647346+0000","last_peered":"2023-11-15T01:40:20.647346+0000","last_clean":"2023-11-15T01:40:20.647346+0000","last_became_active":"2023-11-15T01:40:20.637942+0000","last_became_peered":"2023-11-15T01:40:20.637942+0000","last_unstale":"2023-11-15T01:40:20.647346+0000","last_undegraded":"2023-11-15T01:40:20.647346+0000","last_fullsized":"2023-11-15T01:40:20.647346+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:19.214384+0000","last_change":"2023-11-15T01:40:19.214384+0000","last_active":"2023-11-15T01:40:19.214384+0000","last_peered":"2023-11-15T01:40:19.214384+0000","last_clean":"2023-11-15T01:40:19.214384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:19.214384+0000","last_undegraded":"2023-11-15T01:40:19.214384+0000","last_fullsized":"2023-11-15T01:40:19.214384+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.628283+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:40:20.628283+0000","last_peered":"2023-11-15T01:40:20.628283+0000","last_clean":"2023-11-15T01:40:20.628283+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:40:20.628283+0000","last_undegraded":"2023-11-15T01:40:20.628283+0000","last_fullsized":"2023-11-15T01:40:20.628283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T01:40:20.218542+0000","last_change":"2023-11-15T01:40:20.218542+0000","last_active":"2023-11-15T01:40:20.218542+0000","last_peered":"2023-11-15T01:40:20.218542+0000","last_clean":"2023-11-15T01:40:20.218542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T01:40:20.218542+0000","last_undegraded":"2023-11-15T01:40:20.218542+0000","last_fullsized":"2023-11-15T01:40:20.218542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646627+0000","last_change":"2023-11-15T01:40:20.242601+0000","last_active":"2023-11-15T01:40:20.646627+0000","last_peered":"2023-11-15T01:40:20.646627+0000","last_clean":"2023-11-15T01:40:20.646627+0000","last_became_active":"2023-11-15T01:40:20.242275+0000","last_became_peered":"2023-11-15T01:40:20.242275+0000","last_unstale":"2023-11-15T01:40:20.646627+0000","last_undegraded":"2023-11-15T01:40:20.646627+0000","last_fullsized":"2023-11-15T01:40:20.646627+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":128,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625034+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:40:20.625034+0000","last_peered":"2023-11-15T01:40:20.625034+0000","last_clean":"2023-11-15T01:40:20.625034+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:40:20.625034+0000","last_undegraded":"2023-11-15T01:40:20.625034+0000","last_fullsized":"2023-11-15T01:40:20.625034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":92,"acting":92,"num_store_stats":6},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2146,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":96,"acting":96,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575069,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302852,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068988,"statfs":{"total":96636764160,"available":96326643712,"internally_reserved":0,"allocated":1699840,"data_stored":886619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71999999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.33800000000000002,"15min":0.248},"max":{"1min":0.751,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.747,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.42799999999999999,"5min":0.34499999999999997,"15min":0.27500000000000002},"max":{"1min":0.76300000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.51200000000000001}]},{"osd":2,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.38200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82599999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.309},"max":{"1min":0.77300000000000002,"5min":0.875,"15min":0.875},"last":0.60399999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.85999999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.373,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.63200000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47699999999999998,"15min":0.46700000000000003},"min":{"1min":0.28399999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67400000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.316},"max":{"1min":0.77000000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.317,"5min":0.26500000000000001,"15min":0.23499999999999999},"max":{"1min":0.75,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.317,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66800000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56499999999999995}]},{"osd":6,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.82999999999999996,"15min":1.0129999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.34200000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79400000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575071,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1753088,"data_stored":915764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.42899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72499999999999998,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73099999999999998,"5min":0.77800000000000002,"15min":0.89000000000000001},"last":0.66900000000000004}]},{"osd":1,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.39000000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.83099999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.33100000000000002,"15min":0.32100000000000001},"max":{"1min":0.72999999999999998,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.69699999999999995}]},{"osd":2,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73399999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.46100000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76300000000000001,"5min":1.746,"15min":1.746},"last":0.73399999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.38,"5min":0.371,"15min":0.307},"max":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.91300000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.78400000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.68000000000000005}]},{"osd":4,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.32400000000000001,"5min":0.28899999999999998,"15min":0.26600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.52400000000000002},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.25800000000000001},"max":{"1min":0.79700000000000004,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.46800000000000003}]},{"osd":5,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76800000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.38900000000000001,"5min":0.32000000000000001,"15min":0.30399999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.82599999999999996},"last":0.49399999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.504,"15min":0.503},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.29899999999999999},"max":{"1min":0.83699999999999997,"5min":0.875,"15min":0.875},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80700000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.504}]}]},{"osd":1,"up_from":13,"seq":55834575072,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1753088,"data_stored":915232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.36099999999999999,"15min":0.376},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.24299999999999999},"max":{"1min":0.55000000000000004,"5min":0.59099999999999997,"15min":0.73699999999999999},"last":0.253},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.40200000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.35499999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.375,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58399999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42799999999999999,"15min":0.438},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.26200000000000001},"max":{"1min":0.66300000000000003,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.32600000000000001}]},{"osd":3,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.55800000000000005,"15min":0.52200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71099999999999997,"5min":9.641,"15min":9.641},"last":0.371},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53500000000000003,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.28599999999999998},"max":{"1min":0.71799999999999997,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.40000000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.45100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1,"5min":1,"15min":1},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.61599999999999999,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.90800000000000003,"5min":1.006,"15min":1.006},"last":0.56799999999999995}]},{"osd":5,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61199999999999999,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.45300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0009999999999999,"5min":1.111,"15min":1.111},"last":0.44600000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0449999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.48399999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66100000000000003,"15min":0.68799999999999994},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0169999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.67800000000000005,"15min":0.69099999999999995},"min":{"1min":0.501,"5min":0.434,"15min":0.434},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.55600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575070,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302912,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068928,"statfs":{"total":96636764160,"available":96326582272,"internally_reserved":0,"allocated":1761280,"data_stored":916678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.371},"min":{"1min":0.27300000000000002,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.495,"5min":0.54200000000000004,"15min":2.024},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.39600000000000002,"15min":0.41499999999999998},"min":{"1min":0.24399999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52200000000000002,"5min":0.64700000000000002,"15min":1.9490000000000001},"last":0.29699999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36299999999999999,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":1.768},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41299999999999998,"15min":0.437},"min":{"1min":0.28000000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":1.982},"last":0.33500000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42199999999999999,"15min":0.435},"min":{"1min":0.30199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58999999999999997,"5min":0.63100000000000001,"15min":2.0579999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.30199999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.64900000000000002,"5min":0.67900000000000005,"15min":1.7989999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40400000000000003},"max":{"1min":0.83599999999999997,"5min":1.018,"15min":1.018},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63300000000000001,"15min":0.65300000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79600000000000004,"5min":0.98899999999999999,"15min":1.7250000000000001},"last":0.64000000000000001}]},{"osd":5,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82899999999999996,"5min":0.97899999999999998,"15min":1.881},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":1.056},"last":0.72899999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.36499999999999999},"max":{"1min":0.84499999999999997,"5min":1.04,"15min":1.6830000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64700000000000002,"15min":0.67000000000000004},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90800000000000003,"5min":0.94099999999999995,"15min":1.917},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.67000000000000004,"15min":0.68700000000000006},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88100000000000001,"5min":1.0089999999999999,"15min":1.843},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.68700000000000006},"min":{"1min":0.47599999999999998,"5min":0.46999999999999997,"15min":0.40899999999999997},"max":{"1min":0.90300000000000002,"5min":1.073,"15min":1.0960000000000001},"last":0.76500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575071,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307004,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064836,"statfs":{"total":96636764160,"available":96322392064,"internally_reserved":0,"allocated":1757184,"data_stored":916172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35499999999999998,"15min":0.36599999999999999},"min":{"1min":0.248,"5min":0.186,"15min":0.186},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.61899999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56000000000000005,"5min":0.63900000000000001,"15min":0.74299999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.59199999999999997,"5min":0.745,"15min":0.745},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.58199999999999996,"5min":0.69799999999999995,"15min":0.73499999999999999},"last":0.434}]},{"osd":3,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.436,"15min":0.44900000000000001},"min":{"1min":0.32300000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53000000000000003,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.436,"15min":0.441},"min":{"1min":0.24399999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57199999999999995,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.37}]},{"osd":4,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.47299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77300000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61799999999999999,"15min":0.63300000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79000000000000004,"5min":0.91100000000000003,"15min":0.95399999999999996},"last":0.57599999999999996}]},{"osd":5,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.47899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89800000000000002,"5min":1.032,"15min":1.032},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.63500000000000001},"min":{"1min":0.47499999999999998,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":0.81200000000000006,"5min":0.96699999999999997,"15min":0.99399999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.374},"max":{"1min":0.83699999999999997,"5min":1.002,"15min":1.0389999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.64200000000000002,"15min":0.66500000000000004},"min":{"1min":0.46100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.83199999999999996,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.45400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.92200000000000004,"5min":1.079,"15min":1.079},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65600000000000003,"15min":0.68500000000000005},"min":{"1min":0.434,"5min":0.374,"15min":0.374},"max":{"1min":0.82399999999999995,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.73199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575072,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307008,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064832,"statfs":{"total":96636764160,"available":96322387968,"internally_reserved":0,"allocated":1761280,"data_stored":915888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.36399999999999999,"15min":0.374},"min":{"1min":0.27500000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.79900000000000004},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.377,"15min":0.39700000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.49199999999999999,"5min":0.60699999999999998,"15min":0.71499999999999997},"last":0.30099999999999999}]},{"osd":1,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.39000000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51500000000000001,"5min":0.63400000000000001,"15min":0.72899999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.41899999999999998,"15min":0.442},"min":{"1min":0.33000000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.56200000000000006,"5min":0.72499999999999998,"15min":0.747},"last":0.29399999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.32200000000000001,"5min":0.27300000000000002,"15min":0.23200000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.37},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.47299999999999998},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.622,"5min":0.69199999999999995,"15min":0.81999999999999995},"last":0.38100000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57599999999999996,"15min":0.60999999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84999999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60599999999999998,"15min":0.625},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":1.389,"15min":1.389},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.63100000000000001},"min":{"1min":0.47199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93600000000000005,"5min":1.512,"15min":1.512},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61399999999999999,"15min":0.63700000000000001},"min":{"1min":0.42099999999999999,"5min":0.374,"15min":0.373},"max":{"1min":0.82299999999999995,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92700000000000005,"5min":0.94199999999999995,"15min":1.0980000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.66100000000000003},"min":{"1min":0.45200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.0900000000000001},"last":0.80600000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.66400000000000003},"min":{"1min":0.443,"5min":0.39900000000000002,"15min":0.38700000000000001},"max":{"1min":0.94999999999999996,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64200000000000002,"15min":0.67600000000000005},"min":{"1min":0.48999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90600000000000003,"5min":1.069,"15min":1.1319999999999999},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575070,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302908,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068932,"statfs":{"total":96636764160,"available":96326586368,"internally_reserved":0,"allocated":1757184,"data_stored":915854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.30399999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.84499999999999997,"15min":0.88},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.749,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.68999999999999995}]},{"osd":1,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.39400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81000000000000005,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.34799999999999998,"15min":0.34699999999999998},"max":{"1min":0.68000000000000005,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.72299999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.58499999999999996},"min":{"1min":0.373,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72199999999999998,"5min":2.887,"15min":2.887},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.45800000000000002,"5min":0.37,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":0.92300000000000004,"15min":0.96299999999999997},"last":0.55000000000000004}]},{"osd":3,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.33100000000000002},"max":{"1min":0.73399999999999999,"5min":2.464,"15min":2.464},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63400000000000001,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84799999999999998,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48599999999999999,"15min":0.46899999999999997},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68500000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.434},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.49199999999999999},"min":{"1min":0.38900000000000001,"5min":0.29899999999999999,"15min":0.27400000000000002},"max":{"1min":0.66300000000000003,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.44400000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52300000000000002,"15min":0.495},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.28899999999999998},"max":{"1min":0.72199999999999998,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.379},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55000000000000004,"15min":0.52900000000000003},"min":{"1min":0.42599999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.47399999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.42099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71799999999999997,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.502},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59199999999999997,"15min":0.56699999999999995},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.46200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575069,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302852,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068988,"statfs":{"total":96636764160,"available":96326643712,"internally_reserved":0,"allocated":1699840,"data_stored":886619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53100000000000003,"15min":0.54500000000000004},"min":{"1min":0.42699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.72199999999999998,"5min":0.78500000000000003,"15min":0.79200000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.78100000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.505}]},{"osd":1,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.53500000000000003,"15min":0.55900000000000005},"min":{"1min":0.35699999999999998,"5min":0.33300000000000002,"15min":0.32600000000000001},"max":{"1min":0.75,"5min":0.78500000000000003,"15min":0.83299999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.42599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.80100000000000005},"last":0.42099999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81200000000000006,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68000000000000005,"5min":0.77100000000000002,"15min":0.84599999999999997},"last":0.45900000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67900000000000005,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77600000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57099999999999995}]},{"osd":4,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.29499999999999998,"5min":0.26600000000000001,"15min":0.23899999999999999},"max":{"1min":0.59299999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65500000000000003,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.67400000000000004}]},{"osd":6,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.27600000000000002},"max":{"1min":0.54600000000000004,"5min":0.81599999999999995,"15min":0.83099999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63700000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59799999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.497},"min":{"1min":0.378,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.627},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.45300000000000001,"5min":0.40100000000000002,"15min":0.33600000000000002},"max":{"1min":0.71099999999999997,"5min":0.82399999999999995,"15min":0.85799999999999998},"last":0.65500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:40:25.041 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:40:25.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.191+0000 7f494088c700 1 Processor -- start 2023-11-15T01:40:25.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.191+0000 7f494088c700 1 -- start start 2023-11-15T01:40:25.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.192+0000 7f494088c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f493c154150 0x7f493c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.192+0000 7f494088c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f493c0ab1a0 0x7f493c158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.192+0000 7f494088c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f493c0aa060 0x7f493c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.192+0000 7f494088c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493c0c06f0 con 0x7f493c0aa060 2023-11-15T01:40:25.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.192+0000 7f494088c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493c0c09d0 con 0x7f493c0ab1a0 2023-11-15T01:40:25.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.192+0000 7f494088c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c158820 con 0x7f493c154150 2023-11-15T01:40:25.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.192+0000 7f493ad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f493c0aa060 0x7f493c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.192+0000 7f493ad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f493c0aa060 0x7f493c0c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59222/0 (socket says 172.21.15.1:59222) 2023-11-15T01:40:25.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.192+0000 7f493a59c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f493c154150 0x7f493c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.192+0000 7f493ad9d700 1 -- 172.21.15.1:0/2615488482 learned_addr learned my addr 172.21.15.1:0/2615488482 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:25.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.192+0000 7f4939d9b700 1 --2- 172.21.15.1:0/2615488482 >> v2:172.21.15.141:3300/0 conn(0x7f493c0ab1a0 0x7f493c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.193+0000 7f493ad9d700 1 -- 172.21.15.1:0/2615488482 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f493c154150 msgr2=0x7f493c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:25.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.193+0000 7f493ad9d700 1 --2- 172.21.15.1:0/2615488482 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f493c154150 0x7f493c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.193+0000 7f493ad9d700 1 -- 172.21.15.1:0/2615488482 >> v2:172.21.15.141:3300/0 conn(0x7f493c0ab1a0 msgr2=0x7f493c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.193+0000 7f493ad9d700 1 --2- 172.21.15.1:0/2615488482 >> v2:172.21.15.141:3300/0 conn(0x7f493c0ab1a0 0x7f493c158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.193+0000 7f493ad9d700 1 -- 172.21.15.1:0/2615488482 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c158b00 con 0x7f493c0aa060 2023-11-15T01:40:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.193+0000 7f493ad9d700 1 --2- 172.21.15.1:0/2615488482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c0aa060 0x7f493c0c5f10 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f493c0cc110 tx=0x7f4934009840).ready entity=mon.0 client_cookie=8f5302bf6869286a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.193+0000 7f493959a700 1 -- 172.21.15.1:0/2615488482 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400e070 con 0x7f493c0aa060 2023-11-15T01:40:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.193+0000 7f493959a700 1 -- 172.21.15.1:0/2615488482 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400b970 con 0x7f493c0aa060 2023-11-15T01:40:25.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.193+0000 7f493959a700 1 -- 172.21.15.1:0/2615488482 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400bcf0 con 0x7f493c0aa060 2023-11-15T01:40:25.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.194+0000 7f494088c700 1 -- 172.21.15.1:0/2615488482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c0aa060 msgr2=0x7f493c0c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.194+0000 7f494088c700 1 --2- 172.21.15.1:0/2615488482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c0aa060 0x7f493c0c5f10 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f493c0cc110 tx=0x7f4934009840).stop 2023-11-15T01:40:25.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.194+0000 7f494088c700 1 -- 172.21.15.1:0/2615488482 shutdown_connections 2023-11-15T01:40:25.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.194+0000 7f494088c700 1 --2- 172.21.15.1:0/2615488482 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c0aa060 0x7f493c0c5f10 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.194+0000 7f494088c700 1 --2- 172.21.15.1:0/2615488482 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f493c154150 0x7f493c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.194+0000 7f494088c700 1 --2- 172.21.15.1:0/2615488482 >> v2:172.21.15.141:3300/0 conn(0x7f493c0ab1a0 0x7f493c158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.194+0000 7f494088c700 1 -- 172.21.15.1:0/2615488482 >> 172.21.15.1:0/2615488482 conn(0x7f493c064aa0 msgr2=0x7f493c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:25.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.194+0000 7f494088c700 1 -- 172.21.15.1:0/2615488482 shutdown_connections 2023-11-15T01:40:25.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.194+0000 7f494088c700 1 -- 172.21.15.1:0/2615488482 wait complete. 2023-11-15T01:40:25.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.195+0000 7f494088c700 1 Processor -- start 2023-11-15T01:40:25.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.195+0000 7f494088c700 1 -- start start 2023-11-15T01:40:25.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f494088c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f493c0aa060 0x7f493c0cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f494088c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c0ab1a0 0x7f493c156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f494088c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f493c154150 0x7f493c0c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f494088c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0ca400 con 0x7f493c0ab1a0 2023-11-15T01:40:25.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f494088c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0ca6e0 con 0x7f493c154150 2023-11-15T01:40:25.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f494088c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0ca9c0 con 0x7f493c0aa060 2023-11-15T01:40:25.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f4939d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c0ab1a0 0x7f493c156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f4939d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c0ab1a0 0x7f493c156450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59238/0 (socket says 172.21.15.1:59238) 2023-11-15T01:40:25.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f4939d9b700 1 -- 172.21.15.1:0/3447519641 learned_addr learned my addr 172.21.15.1:0/3447519641 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:25.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f493a59c700 1 --2- 172.21.15.1:0/3447519641 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f493c0aa060 0x7f493c0cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f493ad9d700 1 --2- 172.21.15.1:0/3447519641 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f493c154150 0x7f493c0c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f4939d9b700 1 -- 172.21.15.1:0/3447519641 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f493c0aa060 msgr2=0x7f493c0cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f4939d9b700 1 --2- 172.21.15.1:0/3447519641 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f493c0aa060 0x7f493c0cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f4939d9b700 1 -- 172.21.15.1:0/3447519641 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f493c154150 msgr2=0x7f493c0c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f4939d9b700 1 --2- 172.21.15.1:0/3447519641 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f493c154150 0x7f493c0c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f4939d9b700 1 -- 172.21.15.1:0/3447519641 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4934009ae0 con 0x7f493c0ab1a0 2023-11-15T01:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f4939d9b700 1 --2- 172.21.15.1:0/3447519641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c0ab1a0 0x7f493c156450 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f492400e8d0 tx=0x7f4924009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f49327fc700 1 -- 172.21.15.1:0/3447519641 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924012600 con 0x7f493c0ab1a0 2023-11-15T01:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f49327fc700 1 -- 172.21.15.1:0/3447519641 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4924012760 con 0x7f493c0ab1a0 2023-11-15T01:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f494088c700 1 -- 172.21.15.1:0/3447519641 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c0caca0 con 0x7f493c0ab1a0 2023-11-15T01:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f49327fc700 1 -- 172.21.15.1:0/3447519641 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924012ae0 con 0x7f493c0ab1a0 2023-11-15T01:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.196+0000 7f494088c700 1 -- 172.21.15.1:0/3447519641 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c1573f0 con 0x7f493c0ab1a0 2023-11-15T01:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.197+0000 7f494088c700 1 -- 172.21.15.1:0/3447519641 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493c06c7e0 con 0x7f493c0ab1a0 2023-11-15T01:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.198+0000 7f49327fc700 1 -- 172.21.15.1:0/3447519641 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f492401b400 con 0x7f493c0ab1a0 2023-11-15T01:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.198+0000 7f49327fc700 1 --2- 172.21.15.1:0/3447519641 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f491c05f270 0x7f491c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.198+0000 7f49327fc700 1 -- 172.21.15.1:0/3447519641 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f492407a9b0 con 0x7f493c0ab1a0 2023-11-15T01:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.198+0000 7f493a59c700 1 --2- 172.21.15.1:0/3447519641 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f491c05f270 0x7f491c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.199+0000 7f493a59c700 1 --2- 172.21.15.1:0/3447519641 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f491c05f270 0x7f491c061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f492c009c30 tx=0x7f492c009060).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.202+0000 7f49327fc700 1 -- 172.21.15.1:0/3447519641 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f492404b940 con 0x7f493c0ab1a0 2023-11-15T01:40:25.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.371+0000 7f494088c700 1 -- 172.21.15.1:0/3447519641 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f493c0aca00 con 0x7f491c05f270 2023-11-15T01:40:25.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.382+0000 7f49327fc700 1 -- 172.21.15.1:0/3447519641 <== mgr.6590 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361814 (secure 0 0 0) 0x7f493c0aca00 con 0x7f491c05f270 2023-11-15T01:40:25.388 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:25.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.385+0000 7f494088c700 1 -- 172.21.15.1:0/3447519641 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f491c05f270 msgr2=0x7f491c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.385+0000 7f494088c700 1 --2- 172.21.15.1:0/3447519641 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f491c05f270 0x7f491c061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f492c009c30 tx=0x7f492c009060).stop 2023-11-15T01:40:25.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.385+0000 7f494088c700 1 -- 172.21.15.1:0/3447519641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c0ab1a0 msgr2=0x7f493c156450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.385+0000 7f494088c700 1 --2- 172.21.15.1:0/3447519641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c0ab1a0 0x7f493c156450 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f492400e8d0 tx=0x7f4924009060).stop 2023-11-15T01:40:25.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.385+0000 7f494088c700 1 -- 172.21.15.1:0/3447519641 shutdown_connections 2023-11-15T01:40:25.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.385+0000 7f494088c700 1 --2- 172.21.15.1:0/3447519641 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f491c05f270 0x7f491c061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.385+0000 7f494088c700 1 --2- 172.21.15.1:0/3447519641 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f493c154150 0x7f493c0c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.385+0000 7f494088c700 1 --2- 172.21.15.1:0/3447519641 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f493c0aa060 0x7f493c0cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.385+0000 7f494088c700 1 --2- 172.21.15.1:0/3447519641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f493c0ab1a0 0x7f493c156450 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.385+0000 7f494088c700 1 -- 172.21.15.1:0/3447519641 >> 172.21.15.1:0/3447519641 conn(0x7f493c064aa0 msgr2=0x7f493c0ae030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:25.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.385+0000 7f494088c700 1 -- 172.21.15.1:0/3447519641 shutdown_connections 2023-11-15T01:40:25.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.385+0000 7f494088c700 1 -- 172.21.15.1:0/3447519641 wait complete. 2023-11-15T01:40:25.394 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:40:25.399 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T01:40:25.193311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2431456,"kb_used_data":13728,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752543264,"statfs":{"total":773094113280,"available":770604302336,"internally_reserved":0,"allocated":14057472,"data_stored":7326292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23203,"num_objects":-18,"num_object_clones":0,"num_object_copies":-36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-65,"num_write_kb":-45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.003245"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647817+0000","last_change":"2023-11-15T01:40:20.643068+0000","last_active":"2023-11-15T01:40:20.647817+0000","last_peered":"2023-11-15T01:40:20.647817+0000","last_clean":"2023-11-15T01:40:20.647817+0000","last_became_active":"2023-11-15T01:40:20.642755+0000","last_became_peered":"2023-11-15T01:40:20.642755+0000","last_unstale":"2023-11-15T01:40:20.647817+0000","last_undegraded":"2023-11-15T01:40:20.647817+0000","last_fullsized":"2023-11-15T01:40:20.647817+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"140'3","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641930+0000","last_change":"2023-11-15T01:40:20.242944+0000","last_active":"2023-11-15T01:40:20.641930+0000","last_peered":"2023-11-15T01:40:20.641930+0000","last_clean":"2023-11-15T01:40:20.641930+0000","last_became_active":"2023-11-15T01:40:20.242665+0000","last_became_peered":"2023-11-15T01:40:20.242665+0000","last_unstale":"2023-11-15T01:40:20.641930+0000","last_undegraded":"2023-11-15T01:40:20.641930+0000","last_fullsized":"2023-11-15T01:40:20.641930+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646740+0000","last_change":"2023-11-15T01:40:20.642233+0000","last_active":"2023-11-15T01:40:20.646740+0000","last_peered":"2023-11-15T01:40:20.646740+0000","last_clean":"2023-11-15T01:40:20.646740+0000","last_became_active":"2023-11-15T01:40:20.641850+0000","last_became_peered":"2023-11-15T01:40:20.641850+0000","last_unstale":"2023-11-15T01:40:20.646740+0000","last_undegraded":"2023-11-15T01:40:20.646740+0000","last_fullsized":"2023-11-15T01:40:20.646740+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625020+0000","last_change":"2023-11-15T01:40:20.245583+0000","last_active":"2023-11-15T01:40:20.625020+0000","last_peered":"2023-11-15T01:40:20.625020+0000","last_clean":"2023-11-15T01:40:20.625020+0000","last_became_active":"2023-11-15T01:40:20.245315+0000","last_became_peered":"2023-11-15T01:40:20.245315+0000","last_unstale":"2023-11-15T01:40:20.625020+0000","last_undegraded":"2023-11-15T01:40:20.625020+0000","last_fullsized":"2023-11-15T01:40:20.625020+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647364+0000","last_change":"2023-11-15T01:40:20.643893+0000","last_active":"2023-11-15T01:40:20.647364+0000","last_peered":"2023-11-15T01:40:20.647364+0000","last_clean":"2023-11-15T01:40:20.647364+0000","last_became_active":"2023-11-15T01:40:20.643255+0000","last_became_peered":"2023-11-15T01:40:20.643255+0000","last_unstale":"2023-11-15T01:40:20.647364+0000","last_undegraded":"2023-11-15T01:40:20.647364+0000","last_fullsized":"2023-11-15T01:40:20.647364+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.633975+0000","last_change":"2023-11-15T01:40:20.251469+0000","last_active":"2023-11-15T01:40:20.633975+0000","last_peered":"2023-11-15T01:40:20.633975+0000","last_clean":"2023-11-15T01:40:20.633975+0000","last_became_active":"2023-11-15T01:40:20.251211+0000","last_became_peered":"2023-11-15T01:40:20.251211+0000","last_unstale":"2023-11-15T01:40:20.633975+0000","last_undegraded":"2023-11-15T01:40:20.633975+0000","last_fullsized":"2023-11-15T01:40:20.633975+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636409+0000","last_change":"2023-11-15T01:40:20.632940+0000","last_active":"2023-11-15T01:40:20.636409+0000","last_peered":"2023-11-15T01:40:20.636409+0000","last_clean":"2023-11-15T01:40:20.636409+0000","last_became_active":"2023-11-15T01:40:20.632656+0000","last_became_peered":"2023-11-15T01:40:20.632656+0000","last_unstale":"2023-11-15T01:40:20.636409+0000","last_undegraded":"2023-11-15T01:40:20.636409+0000","last_fullsized":"2023-11-15T01:40:20.636409+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643570+0000","last_change":"2023-11-15T01:40:20.241907+0000","last_active":"2023-11-15T01:40:20.643570+0000","last_peered":"2023-11-15T01:40:20.643570+0000","last_clean":"2023-11-15T01:40:20.643570+0000","last_became_active":"2023-11-15T01:40:20.241464+0000","last_became_peered":"2023-11-15T01:40:20.241464+0000","last_unstale":"2023-11-15T01:40:20.643570+0000","last_undegraded":"2023-11-15T01:40:20.643570+0000","last_fullsized":"2023-11-15T01:40:20.643570+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.639154+0000","last_change":"2023-11-15T01:40:20.632696+0000","last_active":"2023-11-15T01:40:20.639154+0000","last_peered":"2023-11-15T01:40:20.639154+0000","last_clean":"2023-11-15T01:40:20.639154+0000","last_became_active":"2023-11-15T01:40:20.632485+0000","last_became_peered":"2023-11-15T01:40:20.632485+0000","last_unstale":"2023-11-15T01:40:20.639154+0000","last_undegraded":"2023-11-15T01:40:20.639154+0000","last_fullsized":"2023-11-15T01:40:20.639154+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.631160+0000","last_change":"2023-11-15T01:40:20.241330+0000","last_active":"2023-11-15T01:40:20.631160+0000","last_peered":"2023-11-15T01:40:20.631160+0000","last_clean":"2023-11-15T01:40:20.631160+0000","last_became_active":"2023-11-15T01:40:20.240407+0000","last_became_peered":"2023-11-15T01:40:20.240407+0000","last_unstale":"2023-11-15T01:40:20.631160+0000","last_undegraded":"2023-11-15T01:40:20.631160+0000","last_fullsized":"2023-11-15T01:40:20.631160+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.644143+0000","last_change":"2023-11-15T01:40:20.641396+0000","last_active":"2023-11-15T01:40:20.644143+0000","last_peered":"2023-11-15T01:40:20.644143+0000","last_clean":"2023-11-15T01:40:20.644143+0000","last_became_active":"2023-11-15T01:40:20.641053+0000","last_became_peered":"2023-11-15T01:40:20.641053+0000","last_unstale":"2023-11-15T01:40:20.644143+0000","last_undegraded":"2023-11-15T01:40:20.644143+0000","last_fullsized":"2023-11-15T01:40:20.644143+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.638608+0000","last_change":"2023-11-15T01:40:20.244269+0000","last_active":"2023-11-15T01:40:20.638608+0000","last_peered":"2023-11-15T01:40:20.638608+0000","last_clean":"2023-11-15T01:40:20.638608+0000","last_became_active":"2023-11-15T01:40:20.243976+0000","last_became_peered":"2023-11-15T01:40:20.243976+0000","last_unstale":"2023-11-15T01:40:20.638608+0000","last_undegraded":"2023-11-15T01:40:20.638608+0000","last_fullsized":"2023-11-15T01:40:20.638608+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640654+0000","last_change":"2023-11-15T01:40:20.638613+0000","last_active":"2023-11-15T01:40:20.640654+0000","last_peered":"2023-11-15T01:40:20.640654+0000","last_clean":"2023-11-15T01:40:20.640654+0000","last_became_active":"2023-11-15T01:40:20.638313+0000","last_became_peered":"2023-11-15T01:40:20.638313+0000","last_unstale":"2023-11-15T01:40:20.640654+0000","last_undegraded":"2023-11-15T01:40:20.640654+0000","last_fullsized":"2023-11-15T01:40:20.640654+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626158+0000","last_change":"2023-11-15T01:40:20.241409+0000","last_active":"2023-11-15T01:40:20.626158+0000","last_peered":"2023-11-15T01:40:20.626158+0000","last_clean":"2023-11-15T01:40:20.626158+0000","last_became_active":"2023-11-15T01:40:20.240944+0000","last_became_peered":"2023-11-15T01:40:20.240944+0000","last_unstale":"2023-11-15T01:40:20.626158+0000","last_undegraded":"2023-11-15T01:40:20.626158+0000","last_fullsized":"2023-11-15T01:40:20.626158+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636934+0000","last_change":"2023-11-15T01:40:20.634524+0000","last_active":"2023-11-15T01:40:20.636934+0000","last_peered":"2023-11-15T01:40:20.636934+0000","last_clean":"2023-11-15T01:40:20.636934+0000","last_became_active":"2023-11-15T01:40:20.634242+0000","last_became_peered":"2023-11-15T01:40:20.634242+0000","last_unstale":"2023-11-15T01:40:20.636934+0000","last_undegraded":"2023-11-15T01:40:20.636934+0000","last_fullsized":"2023-11-15T01:40:20.636934+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630202+0000","last_change":"2023-11-15T01:40:20.248540+0000","last_active":"2023-11-15T01:40:20.630202+0000","last_peered":"2023-11-15T01:40:20.630202+0000","last_clean":"2023-11-15T01:40:20.630202+0000","last_became_active":"2023-11-15T01:40:20.246981+0000","last_became_peered":"2023-11-15T01:40:20.246981+0000","last_unstale":"2023-11-15T01:40:20.630202+0000","last_undegraded":"2023-11-15T01:40:20.630202+0000","last_fullsized":"2023-11-15T01:40:20.630202+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645055+0000","last_change":"2023-11-15T01:40:20.642990+0000","last_active":"2023-11-15T01:40:20.645055+0000","last_peered":"2023-11-15T01:40:20.645055+0000","last_clean":"2023-11-15T01:40:20.645055+0000","last_became_active":"2023-11-15T01:40:20.642491+0000","last_became_peered":"2023-11-15T01:40:20.642491+0000","last_unstale":"2023-11-15T01:40:20.645055+0000","last_undegraded":"2023-11-15T01:40:20.645055+0000","last_fullsized":"2023-11-15T01:40:20.645055+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621002+0000","last_change":"2023-11-15T01:40:20.246917+0000","last_active":"2023-11-15T01:40:20.621002+0000","last_peered":"2023-11-15T01:40:20.621002+0000","last_clean":"2023-11-15T01:40:20.621002+0000","last_became_active":"2023-11-15T01:40:20.245824+0000","last_became_peered":"2023-11-15T01:40:20.245824+0000","last_unstale":"2023-11-15T01:40:20.621002+0000","last_undegraded":"2023-11-15T01:40:20.621002+0000","last_fullsized":"2023-11-15T01:40:20.621002+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636954+0000","last_change":"2023-11-15T01:40:20.633914+0000","last_active":"2023-11-15T01:40:20.636954+0000","last_peered":"2023-11-15T01:40:20.636954+0000","last_clean":"2023-11-15T01:40:20.636954+0000","last_became_active":"2023-11-15T01:40:20.633572+0000","last_became_peered":"2023-11-15T01:40:20.633572+0000","last_unstale":"2023-11-15T01:40:20.636954+0000","last_undegraded":"2023-11-15T01:40:20.636954+0000","last_fullsized":"2023-11-15T01:40:20.636954+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621433+0000","last_change":"2023-11-15T01:40:20.242145+0000","last_active":"2023-11-15T01:40:20.621433+0000","last_peered":"2023-11-15T01:40:20.621433+0000","last_clean":"2023-11-15T01:40:20.621433+0000","last_became_active":"2023-11-15T01:40:20.241777+0000","last_became_peered":"2023-11-15T01:40:20.241777+0000","last_unstale":"2023-11-15T01:40:20.621433+0000","last_undegraded":"2023-11-15T01:40:20.621433+0000","last_fullsized":"2023-11-15T01:40:20.621433+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.644654+0000","last_change":"2023-11-15T01:40:20.643000+0000","last_active":"2023-11-15T01:40:20.644654+0000","last_peered":"2023-11-15T01:40:20.644654+0000","last_clean":"2023-11-15T01:40:20.644654+0000","last_became_active":"2023-11-15T01:40:20.642729+0000","last_became_peered":"2023-11-15T01:40:20.642729+0000","last_unstale":"2023-11-15T01:40:20.644654+0000","last_undegraded":"2023-11-15T01:40:20.644654+0000","last_fullsized":"2023-11-15T01:40:20.644654+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624849+0000","last_change":"2023-11-15T01:40:20.241858+0000","last_active":"2023-11-15T01:40:20.624849+0000","last_peered":"2023-11-15T01:40:20.624849+0000","last_clean":"2023-11-15T01:40:20.624849+0000","last_became_active":"2023-11-15T01:40:20.241543+0000","last_became_peered":"2023-11-15T01:40:20.241543+0000","last_unstale":"2023-11-15T01:40:20.624849+0000","last_undegraded":"2023-11-15T01:40:20.624849+0000","last_fullsized":"2023-11-15T01:40:20.624849+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.649329+0000","last_change":"2023-11-15T01:40:20.648125+0000","last_active":"2023-11-15T01:40:20.649329+0000","last_peered":"2023-11-15T01:40:20.649329+0000","last_clean":"2023-11-15T01:40:20.649329+0000","last_became_active":"2023-11-15T01:40:20.647748+0000","last_became_peered":"2023-11-15T01:40:20.647748+0000","last_unstale":"2023-11-15T01:40:20.649329+0000","last_undegraded":"2023-11-15T01:40:20.649329+0000","last_fullsized":"2023-11-15T01:40:20.649329+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646769+0000","last_change":"2023-11-15T01:40:20.240545+0000","last_active":"2023-11-15T01:40:20.646769+0000","last_peered":"2023-11-15T01:40:20.646769+0000","last_clean":"2023-11-15T01:40:20.646769+0000","last_became_active":"2023-11-15T01:40:20.239042+0000","last_became_peered":"2023-11-15T01:40:20.239042+0000","last_unstale":"2023-11-15T01:40:20.646769+0000","last_undegraded":"2023-11-15T01:40:20.646769+0000","last_fullsized":"2023-11-15T01:40:20.646769+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.635197+0000","last_change":"2023-11-15T01:40:20.631387+0000","last_active":"2023-11-15T01:40:20.635197+0000","last_peered":"2023-11-15T01:40:20.635197+0000","last_clean":"2023-11-15T01:40:20.635197+0000","last_became_active":"2023-11-15T01:40:20.631109+0000","last_became_peered":"2023-11-15T01:40:20.631109+0000","last_unstale":"2023-11-15T01:40:20.635197+0000","last_undegraded":"2023-11-15T01:40:20.635197+0000","last_fullsized":"2023-11-15T01:40:20.635197+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643174+0000","last_change":"2023-11-15T01:40:20.248558+0000","last_active":"2023-11-15T01:40:20.643174+0000","last_peered":"2023-11-15T01:40:20.643174+0000","last_clean":"2023-11-15T01:40:20.643174+0000","last_became_active":"2023-11-15T01:40:20.248001+0000","last_became_peered":"2023-11-15T01:40:20.248001+0000","last_unstale":"2023-11-15T01:40:20.643174+0000","last_undegraded":"2023-11-15T01:40:20.643174+0000","last_fullsized":"2023-11-15T01:40:20.643174+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636721+0000","last_change":"2023-11-15T01:40:20.633661+0000","last_active":"2023-11-15T01:40:20.636721+0000","last_peered":"2023-11-15T01:40:20.636721+0000","last_clean":"2023-11-15T01:40:20.636721+0000","last_became_active":"2023-11-15T01:40:20.633445+0000","last_became_peered":"2023-11-15T01:40:20.633445+0000","last_unstale":"2023-11-15T01:40:20.636721+0000","last_undegraded":"2023-11-15T01:40:20.636721+0000","last_fullsized":"2023-11-15T01:40:20.636721+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630551+0000","last_change":"2023-11-15T01:40:20.250629+0000","last_active":"2023-11-15T01:40:20.630551+0000","last_peered":"2023-11-15T01:40:20.630551+0000","last_clean":"2023-11-15T01:40:20.630551+0000","last_became_active":"2023-11-15T01:40:20.250297+0000","last_became_peered":"2023-11-15T01:40:20.250297+0000","last_unstale":"2023-11-15T01:40:20.630551+0000","last_undegraded":"2023-11-15T01:40:20.630551+0000","last_fullsized":"2023-11-15T01:40:20.630551+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646676+0000","last_change":"2023-11-15T01:40:20.637875+0000","last_active":"2023-11-15T01:40:20.646676+0000","last_peered":"2023-11-15T01:40:20.646676+0000","last_clean":"2023-11-15T01:40:20.646676+0000","last_became_active":"2023-11-15T01:40:20.637585+0000","last_became_peered":"2023-11-15T01:40:20.637585+0000","last_unstale":"2023-11-15T01:40:20.646676+0000","last_undegraded":"2023-11-15T01:40:20.646676+0000","last_fullsized":"2023-11-15T01:40:20.646676+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625633+0000","last_change":"2023-11-15T01:40:20.244237+0000","last_active":"2023-11-15T01:40:20.625633+0000","last_peered":"2023-11-15T01:40:20.625633+0000","last_clean":"2023-11-15T01:40:20.625633+0000","last_became_active":"2023-11-15T01:40:20.243903+0000","last_became_peered":"2023-11-15T01:40:20.243903+0000","last_unstale":"2023-11-15T01:40:20.625633+0000","last_undegraded":"2023-11-15T01:40:20.625633+0000","last_fullsized":"2023-11-15T01:40:20.625633+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641596+0000","last_change":"2023-11-15T01:40:20.637723+0000","last_active":"2023-11-15T01:40:20.641596+0000","last_peered":"2023-11-15T01:40:20.641596+0000","last_clean":"2023-11-15T01:40:20.641596+0000","last_became_active":"2023-11-15T01:40:20.637283+0000","last_became_peered":"2023-11-15T01:40:20.637283+0000","last_unstale":"2023-11-15T01:40:20.641596+0000","last_undegraded":"2023-11-15T01:40:20.641596+0000","last_fullsized":"2023-11-15T01:40:20.641596+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643228+0000","last_change":"2023-11-15T01:40:20.247664+0000","last_active":"2023-11-15T01:40:20.643228+0000","last_peered":"2023-11-15T01:40:20.643228+0000","last_clean":"2023-11-15T01:40:20.643228+0000","last_became_active":"2023-11-15T01:40:20.247230+0000","last_became_peered":"2023-11-15T01:40:20.247230+0000","last_unstale":"2023-11-15T01:40:20.643228+0000","last_undegraded":"2023-11-15T01:40:20.643228+0000","last_fullsized":"2023-11-15T01:40:20.643228+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643756+0000","last_change":"2023-11-15T01:40:20.641306+0000","last_active":"2023-11-15T01:40:20.643756+0000","last_peered":"2023-11-15T01:40:20.643756+0000","last_clean":"2023-11-15T01:40:20.643756+0000","last_became_active":"2023-11-15T01:40:20.641035+0000","last_became_peered":"2023-11-15T01:40:20.641035+0000","last_unstale":"2023-11-15T01:40:20.643756+0000","last_undegraded":"2023-11-15T01:40:20.643756+0000","last_fullsized":"2023-11-15T01:40:20.643756+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625156+0000","last_change":"2023-11-15T01:40:20.251493+0000","last_active":"2023-11-15T01:40:20.625156+0000","last_peered":"2023-11-15T01:40:20.625156+0000","last_clean":"2023-11-15T01:40:20.625156+0000","last_became_active":"2023-11-15T01:40:20.251199+0000","last_became_peered":"2023-11-15T01:40:20.251199+0000","last_unstale":"2023-11-15T01:40:20.625156+0000","last_undegraded":"2023-11-15T01:40:20.625156+0000","last_fullsized":"2023-11-15T01:40:20.625156+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645240+0000","last_change":"2023-11-15T01:40:20.638898+0000","last_active":"2023-11-15T01:40:20.645240+0000","last_peered":"2023-11-15T01:40:20.645240+0000","last_clean":"2023-11-15T01:40:20.645240+0000","last_became_active":"2023-11-15T01:40:20.638586+0000","last_became_peered":"2023-11-15T01:40:20.638586+0000","last_unstale":"2023-11-15T01:40:20.645240+0000","last_undegraded":"2023-11-15T01:40:20.645240+0000","last_fullsized":"2023-11-15T01:40:20.645240+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623288+0000","last_change":"2023-11-15T01:40:20.241464+0000","last_active":"2023-11-15T01:40:20.623288+0000","last_peered":"2023-11-15T01:40:20.623288+0000","last_clean":"2023-11-15T01:40:20.623288+0000","last_became_active":"2023-11-15T01:40:20.241198+0000","last_became_peered":"2023-11-15T01:40:20.241198+0000","last_unstale":"2023-11-15T01:40:20.623288+0000","last_undegraded":"2023-11-15T01:40:20.623288+0000","last_fullsized":"2023-11-15T01:40:20.623288+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647379+0000","last_change":"2023-11-15T01:40:20.644058+0000","last_active":"2023-11-15T01:40:20.647379+0000","last_peered":"2023-11-15T01:40:20.647379+0000","last_clean":"2023-11-15T01:40:20.647379+0000","last_became_active":"2023-11-15T01:40:20.643626+0000","last_became_peered":"2023-11-15T01:40:20.643626+0000","last_unstale":"2023-11-15T01:40:20.647379+0000","last_undegraded":"2023-11-15T01:40:20.647379+0000","last_fullsized":"2023-11-15T01:40:20.647379+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.642845+0000","last_change":"2023-11-15T01:40:20.248972+0000","last_active":"2023-11-15T01:40:20.642845+0000","last_peered":"2023-11-15T01:40:20.642845+0000","last_clean":"2023-11-15T01:40:20.642845+0000","last_became_active":"2023-11-15T01:40:20.248254+0000","last_became_peered":"2023-11-15T01:40:20.248254+0000","last_unstale":"2023-11-15T01:40:20.642845+0000","last_undegraded":"2023-11-15T01:40:20.642845+0000","last_fullsized":"2023-11-15T01:40:20.642845+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641162+0000","last_change":"2023-11-15T01:40:20.636946+0000","last_active":"2023-11-15T01:40:20.641162+0000","last_peered":"2023-11-15T01:40:20.641162+0000","last_clean":"2023-11-15T01:40:20.641162+0000","last_became_active":"2023-11-15T01:40:20.636691+0000","last_became_peered":"2023-11-15T01:40:20.636691+0000","last_unstale":"2023-11-15T01:40:20.641162+0000","last_undegraded":"2023-11-15T01:40:20.641162+0000","last_fullsized":"2023-11-15T01:40:20.641162+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623449+0000","last_change":"2023-11-15T01:40:20.246711+0000","last_active":"2023-11-15T01:40:20.623449+0000","last_peered":"2023-11-15T01:40:20.623449+0000","last_clean":"2023-11-15T01:40:20.623449+0000","last_became_active":"2023-11-15T01:40:20.246122+0000","last_became_peered":"2023-11-15T01:40:20.246122+0000","last_unstale":"2023-11-15T01:40:20.623449+0000","last_undegraded":"2023-11-15T01:40:20.623449+0000","last_fullsized":"2023-11-15T01:40:20.623449+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640242+0000","last_change":"2023-11-15T01:40:20.636518+0000","last_active":"2023-11-15T01:40:20.640242+0000","last_peered":"2023-11-15T01:40:20.640242+0000","last_clean":"2023-11-15T01:40:20.640242+0000","last_became_active":"2023-11-15T01:40:20.636230+0000","last_became_peered":"2023-11-15T01:40:20.636230+0000","last_unstale":"2023-11-15T01:40:20.640242+0000","last_undegraded":"2023-11-15T01:40:20.640242+0000","last_fullsized":"2023-11-15T01:40:20.640242+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641958+0000","last_change":"2023-11-15T01:40:20.241698+0000","last_active":"2023-11-15T01:40:20.641958+0000","last_peered":"2023-11-15T01:40:20.641958+0000","last_clean":"2023-11-15T01:40:20.641958+0000","last_became_active":"2023-11-15T01:40:20.241234+0000","last_became_peered":"2023-11-15T01:40:20.241234+0000","last_unstale":"2023-11-15T01:40:20.641958+0000","last_undegraded":"2023-11-15T01:40:20.641958+0000","last_fullsized":"2023-11-15T01:40:20.641958+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643406+0000","last_change":"2023-11-15T01:40:20.638600+0000","last_active":"2023-11-15T01:40:20.643406+0000","last_peered":"2023-11-15T01:40:20.643406+0000","last_clean":"2023-11-15T01:40:20.643406+0000","last_became_active":"2023-11-15T01:40:20.638321+0000","last_became_peered":"2023-11-15T01:40:20.638321+0000","last_unstale":"2023-11-15T01:40:20.643406+0000","last_undegraded":"2023-11-15T01:40:20.643406+0000","last_fullsized":"2023-11-15T01:40:20.643406+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626753+0000","last_change":"2023-11-15T01:40:20.237581+0000","last_active":"2023-11-15T01:40:20.626753+0000","last_peered":"2023-11-15T01:40:20.626753+0000","last_clean":"2023-11-15T01:40:20.626753+0000","last_became_active":"2023-11-15T01:40:20.237275+0000","last_became_peered":"2023-11-15T01:40:20.237275+0000","last_unstale":"2023-11-15T01:40:20.626753+0000","last_undegraded":"2023-11-15T01:40:20.626753+0000","last_fullsized":"2023-11-15T01:40:20.626753+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.648077+0000","last_change":"2023-11-15T01:40:20.642674+0000","last_active":"2023-11-15T01:40:20.648077+0000","last_peered":"2023-11-15T01:40:20.648077+0000","last_clean":"2023-11-15T01:40:20.648077+0000","last_became_active":"2023-11-15T01:40:20.642262+0000","last_became_peered":"2023-11-15T01:40:20.642262+0000","last_unstale":"2023-11-15T01:40:20.648077+0000","last_undegraded":"2023-11-15T01:40:20.648077+0000","last_fullsized":"2023-11-15T01:40:20.648077+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623200+0000","last_change":"2023-11-15T01:40:20.244798+0000","last_active":"2023-11-15T01:40:20.623200+0000","last_peered":"2023-11-15T01:40:20.623200+0000","last_clean":"2023-11-15T01:40:20.623200+0000","last_became_active":"2023-11-15T01:40:20.244394+0000","last_became_peered":"2023-11-15T01:40:20.244394+0000","last_unstale":"2023-11-15T01:40:20.623200+0000","last_undegraded":"2023-11-15T01:40:20.623200+0000","last_fullsized":"2023-11-15T01:40:20.623200+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645638+0000","last_change":"2023-11-15T01:40:20.642368+0000","last_active":"2023-11-15T01:40:20.645638+0000","last_peered":"2023-11-15T01:40:20.645638+0000","last_clean":"2023-11-15T01:40:20.645638+0000","last_became_active":"2023-11-15T01:40:20.642012+0000","last_became_peered":"2023-11-15T01:40:20.642012+0000","last_unstale":"2023-11-15T01:40:20.645638+0000","last_undegraded":"2023-11-15T01:40:20.645638+0000","last_fullsized":"2023-11-15T01:40:20.645638+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623850+0000","last_change":"2023-11-15T01:40:20.248505+0000","last_active":"2023-11-15T01:40:20.623850+0000","last_peered":"2023-11-15T01:40:20.623850+0000","last_clean":"2023-11-15T01:40:20.623850+0000","last_became_active":"2023-11-15T01:40:20.248152+0000","last_became_peered":"2023-11-15T01:40:20.248152+0000","last_unstale":"2023-11-15T01:40:20.623850+0000","last_undegraded":"2023-11-15T01:40:20.623850+0000","last_fullsized":"2023-11-15T01:40:20.623850+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645073+0000","last_change":"2023-11-15T01:40:20.643161+0000","last_active":"2023-11-15T01:40:20.645073+0000","last_peered":"2023-11-15T01:40:20.645073+0000","last_clean":"2023-11-15T01:40:20.645073+0000","last_became_active":"2023-11-15T01:40:20.642562+0000","last_became_peered":"2023-11-15T01:40:20.642562+0000","last_unstale":"2023-11-15T01:40:20.645073+0000","last_undegraded":"2023-11-15T01:40:20.645073+0000","last_fullsized":"2023-11-15T01:40:20.645073+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625167+0000","last_change":"2023-11-15T01:40:20.242250+0000","last_active":"2023-11-15T01:40:20.625167+0000","last_peered":"2023-11-15T01:40:20.625167+0000","last_clean":"2023-11-15T01:40:20.625167+0000","last_became_active":"2023-11-15T01:40:20.242006+0000","last_became_peered":"2023-11-15T01:40:20.242006+0000","last_unstale":"2023-11-15T01:40:20.625167+0000","last_undegraded":"2023-11-15T01:40:20.625167+0000","last_fullsized":"2023-11-15T01:40:20.625167+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645367+0000","last_change":"2023-11-15T01:40:20.639227+0000","last_active":"2023-11-15T01:40:20.645367+0000","last_peered":"2023-11-15T01:40:20.645367+0000","last_clean":"2023-11-15T01:40:20.645367+0000","last_became_active":"2023-11-15T01:40:20.638956+0000","last_became_peered":"2023-11-15T01:40:20.638956+0000","last_unstale":"2023-11-15T01:40:20.645367+0000","last_undegraded":"2023-11-15T01:40:20.645367+0000","last_fullsized":"2023-11-15T01:40:20.645367+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621391+0000","last_change":"2023-11-15T01:40:20.241565+0000","last_active":"2023-11-15T01:40:20.621391+0000","last_peered":"2023-11-15T01:40:20.621391+0000","last_clean":"2023-11-15T01:40:20.621391+0000","last_became_active":"2023-11-15T01:40:20.241253+0000","last_became_peered":"2023-11-15T01:40:20.241253+0000","last_unstale":"2023-11-15T01:40:20.621391+0000","last_undegraded":"2023-11-15T01:40:20.621391+0000","last_fullsized":"2023-11-15T01:40:20.621391+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634580+0000","last_change":"2023-11-15T01:40:20.631271+0000","last_active":"2023-11-15T01:40:20.634580+0000","last_peered":"2023-11-15T01:40:20.634580+0000","last_clean":"2023-11-15T01:40:20.634580+0000","last_became_active":"2023-11-15T01:40:20.630984+0000","last_became_peered":"2023-11-15T01:40:20.630984+0000","last_unstale":"2023-11-15T01:40:20.634580+0000","last_undegraded":"2023-11-15T01:40:20.634580+0000","last_fullsized":"2023-11-15T01:40:20.634580+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625566+0000","last_change":"2023-11-15T01:40:20.245556+0000","last_active":"2023-11-15T01:40:20.625566+0000","last_peered":"2023-11-15T01:40:20.625566+0000","last_clean":"2023-11-15T01:40:20.625566+0000","last_became_active":"2023-11-15T01:40:20.245270+0000","last_became_peered":"2023-11-15T01:40:20.245270+0000","last_unstale":"2023-11-15T01:40:20.625566+0000","last_undegraded":"2023-11-15T01:40:20.625566+0000","last_fullsized":"2023-11-15T01:40:20.625566+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637960+0000","last_change":"2023-11-15T01:40:20.634050+0000","last_active":"2023-11-15T01:40:20.637960+0000","last_peered":"2023-11-15T01:40:20.637960+0000","last_clean":"2023-11-15T01:40:20.637960+0000","last_became_active":"2023-11-15T01:40:20.633782+0000","last_became_peered":"2023-11-15T01:40:20.633782+0000","last_unstale":"2023-11-15T01:40:20.637960+0000","last_undegraded":"2023-11-15T01:40:20.637960+0000","last_fullsized":"2023-11-15T01:40:20.637960+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623365+0000","last_change":"2023-11-15T01:40:20.240505+0000","last_active":"2023-11-15T01:40:20.623365+0000","last_peered":"2023-11-15T01:40:20.623365+0000","last_clean":"2023-11-15T01:40:20.623365+0000","last_became_active":"2023-11-15T01:40:20.240212+0000","last_became_peered":"2023-11-15T01:40:20.240212+0000","last_unstale":"2023-11-15T01:40:20.623365+0000","last_undegraded":"2023-11-15T01:40:20.623365+0000","last_fullsized":"2023-11-15T01:40:20.623365+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640225+0000","last_change":"2023-11-15T01:40:20.636132+0000","last_active":"2023-11-15T01:40:20.640225+0000","last_peered":"2023-11-15T01:40:20.640225+0000","last_clean":"2023-11-15T01:40:20.640225+0000","last_became_active":"2023-11-15T01:40:20.635832+0000","last_became_peered":"2023-11-15T01:40:20.635832+0000","last_unstale":"2023-11-15T01:40:20.640225+0000","last_undegraded":"2023-11-15T01:40:20.640225+0000","last_fullsized":"2023-11-15T01:40:20.640225+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623047+0000","last_change":"2023-11-15T01:40:20.246872+0000","last_active":"2023-11-15T01:40:20.623047+0000","last_peered":"2023-11-15T01:40:20.623047+0000","last_clean":"2023-11-15T01:40:20.623047+0000","last_became_active":"2023-11-15T01:40:20.246537+0000","last_became_peered":"2023-11-15T01:40:20.246537+0000","last_unstale":"2023-11-15T01:40:20.623047+0000","last_undegraded":"2023-11-15T01:40:20.623047+0000","last_fullsized":"2023-11-15T01:40:20.623047+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634263+0000","last_change":"2023-11-15T01:40:20.630681+0000","last_active":"2023-11-15T01:40:20.634263+0000","last_peered":"2023-11-15T01:40:20.634263+0000","last_clean":"2023-11-15T01:40:20.634263+0000","last_became_active":"2023-11-15T01:40:20.630373+0000","last_became_peered":"2023-11-15T01:40:20.630373+0000","last_unstale":"2023-11-15T01:40:20.634263+0000","last_undegraded":"2023-11-15T01:40:20.634263+0000","last_fullsized":"2023-11-15T01:40:20.634263+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624478+0000","last_change":"2023-11-15T01:40:20.244238+0000","last_active":"2023-11-15T01:40:20.624478+0000","last_peered":"2023-11-15T01:40:20.624478+0000","last_clean":"2023-11-15T01:40:20.624478+0000","last_became_active":"2023-11-15T01:40:20.243936+0000","last_became_peered":"2023-11-15T01:40:20.243936+0000","last_unstale":"2023-11-15T01:40:20.624478+0000","last_undegraded":"2023-11-15T01:40:20.624478+0000","last_fullsized":"2023-11-15T01:40:20.624478+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647040+0000","last_change":"2023-11-15T01:40:20.645113+0000","last_active":"2023-11-15T01:40:20.647040+0000","last_peered":"2023-11-15T01:40:20.647040+0000","last_clean":"2023-11-15T01:40:20.647040+0000","last_became_active":"2023-11-15T01:40:20.644570+0000","last_became_peered":"2023-11-15T01:40:20.644570+0000","last_unstale":"2023-11-15T01:40:20.647040+0000","last_undegraded":"2023-11-15T01:40:20.647040+0000","last_fullsized":"2023-11-15T01:40:20.647040+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.620507+0000","last_change":"2023-11-15T01:40:20.238797+0000","last_active":"2023-11-15T01:40:20.620507+0000","last_peered":"2023-11-15T01:40:20.620507+0000","last_clean":"2023-11-15T01:40:20.620507+0000","last_became_active":"2023-11-15T01:40:20.238516+0000","last_became_peered":"2023-11-15T01:40:20.238516+0000","last_unstale":"2023-11-15T01:40:20.620507+0000","last_undegraded":"2023-11-15T01:40:20.620507+0000","last_fullsized":"2023-11-15T01:40:20.620507+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.635078+0000","last_change":"2023-11-15T01:40:20.631036+0000","last_active":"2023-11-15T01:40:20.635078+0000","last_peered":"2023-11-15T01:40:20.635078+0000","last_clean":"2023-11-15T01:40:20.635078+0000","last_became_active":"2023-11-15T01:40:20.630762+0000","last_became_peered":"2023-11-15T01:40:20.630762+0000","last_unstale":"2023-11-15T01:40:20.635078+0000","last_undegraded":"2023-11-15T01:40:20.635078+0000","last_fullsized":"2023-11-15T01:40:20.635078+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625588+0000","last_change":"2023-11-15T01:40:20.244705+0000","last_active":"2023-11-15T01:40:20.625588+0000","last_peered":"2023-11-15T01:40:20.625588+0000","last_clean":"2023-11-15T01:40:20.625588+0000","last_became_active":"2023-11-15T01:40:20.244432+0000","last_became_peered":"2023-11-15T01:40:20.244432+0000","last_unstale":"2023-11-15T01:40:20.625588+0000","last_undegraded":"2023-11-15T01:40:20.625588+0000","last_fullsized":"2023-11-15T01:40:20.625588+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645095+0000","last_change":"2023-11-15T01:40:20.643897+0000","last_active":"2023-11-15T01:40:20.645095+0000","last_peered":"2023-11-15T01:40:20.645095+0000","last_clean":"2023-11-15T01:40:20.645095+0000","last_became_active":"2023-11-15T01:40:20.643619+0000","last_became_peered":"2023-11-15T01:40:20.643619+0000","last_unstale":"2023-11-15T01:40:20.645095+0000","last_undegraded":"2023-11-15T01:40:20.645095+0000","last_fullsized":"2023-11-15T01:40:20.645095+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.631561+0000","last_change":"2023-11-15T01:40:20.245866+0000","last_active":"2023-11-15T01:40:20.631561+0000","last_peered":"2023-11-15T01:40:20.631561+0000","last_clean":"2023-11-15T01:40:20.631561+0000","last_became_active":"2023-11-15T01:40:20.245176+0000","last_became_peered":"2023-11-15T01:40:20.245176+0000","last_unstale":"2023-11-15T01:40:20.631561+0000","last_undegraded":"2023-11-15T01:40:20.631561+0000","last_fullsized":"2023-11-15T01:40:20.631561+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.632732+0000","last_change":"2023-11-15T01:40:20.630832+0000","last_active":"2023-11-15T01:40:20.632732+0000","last_peered":"2023-11-15T01:40:20.632732+0000","last_clean":"2023-11-15T01:40:20.632732+0000","last_became_active":"2023-11-15T01:40:20.630527+0000","last_became_peered":"2023-11-15T01:40:20.630527+0000","last_unstale":"2023-11-15T01:40:20.632732+0000","last_undegraded":"2023-11-15T01:40:20.632732+0000","last_fullsized":"2023-11-15T01:40:20.632732+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636373+0000","last_change":"2023-11-15T01:40:20.239525+0000","last_active":"2023-11-15T01:40:20.636373+0000","last_peered":"2023-11-15T01:40:20.636373+0000","last_clean":"2023-11-15T01:40:20.636373+0000","last_became_active":"2023-11-15T01:40:20.239187+0000","last_became_peered":"2023-11-15T01:40:20.239187+0000","last_unstale":"2023-11-15T01:40:20.636373+0000","last_undegraded":"2023-11-15T01:40:20.636373+0000","last_fullsized":"2023-11-15T01:40:20.636373+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647658+0000","last_change":"2023-11-15T01:40:20.643078+0000","last_active":"2023-11-15T01:40:20.647658+0000","last_peered":"2023-11-15T01:40:20.647658+0000","last_clean":"2023-11-15T01:40:20.647658+0000","last_became_active":"2023-11-15T01:40:20.642797+0000","last_became_peered":"2023-11-15T01:40:20.642797+0000","last_unstale":"2023-11-15T01:40:20.647658+0000","last_undegraded":"2023-11-15T01:40:20.647658+0000","last_fullsized":"2023-11-15T01:40:20.647658+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.642978+0000","last_change":"2023-11-15T01:40:20.249171+0000","last_active":"2023-11-15T01:40:20.642978+0000","last_peered":"2023-11-15T01:40:20.642978+0000","last_clean":"2023-11-15T01:40:20.642978+0000","last_became_active":"2023-11-15T01:40:20.248520+0000","last_became_peered":"2023-11-15T01:40:20.248520+0000","last_unstale":"2023-11-15T01:40:20.642978+0000","last_undegraded":"2023-11-15T01:40:20.642978+0000","last_fullsized":"2023-11-15T01:40:20.642978+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.648016+0000","last_change":"2023-11-15T01:40:20.643351+0000","last_active":"2023-11-15T01:40:20.648016+0000","last_peered":"2023-11-15T01:40:20.648016+0000","last_clean":"2023-11-15T01:40:20.648016+0000","last_became_active":"2023-11-15T01:40:20.643053+0000","last_became_peered":"2023-11-15T01:40:20.643053+0000","last_unstale":"2023-11-15T01:40:20.648016+0000","last_undegraded":"2023-11-15T01:40:20.648016+0000","last_fullsized":"2023-11-15T01:40:20.648016+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626997+0000","last_change":"2023-11-15T01:40:20.244328+0000","last_active":"2023-11-15T01:40:20.626997+0000","last_peered":"2023-11-15T01:40:20.626997+0000","last_clean":"2023-11-15T01:40:20.626997+0000","last_became_active":"2023-11-15T01:40:20.243358+0000","last_became_peered":"2023-11-15T01:40:20.243358+0000","last_unstale":"2023-11-15T01:40:20.626997+0000","last_undegraded":"2023-11-15T01:40:20.626997+0000","last_fullsized":"2023-11-15T01:40:20.626997+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640451+0000","last_change":"2023-11-15T01:40:20.636332+0000","last_active":"2023-11-15T01:40:20.640451+0000","last_peered":"2023-11-15T01:40:20.640451+0000","last_clean":"2023-11-15T01:40:20.640451+0000","last_became_active":"2023-11-15T01:40:20.636042+0000","last_became_peered":"2023-11-15T01:40:20.636042+0000","last_unstale":"2023-11-15T01:40:20.640451+0000","last_undegraded":"2023-11-15T01:40:20.640451+0000","last_fullsized":"2023-11-15T01:40:20.640451+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623071+0000","last_change":"2023-11-15T01:40:20.248987+0000","last_active":"2023-11-15T01:40:20.623071+0000","last_peered":"2023-11-15T01:40:20.623071+0000","last_clean":"2023-11-15T01:40:20.623071+0000","last_became_active":"2023-11-15T01:40:20.248720+0000","last_became_peered":"2023-11-15T01:40:20.248720+0000","last_unstale":"2023-11-15T01:40:20.623071+0000","last_undegraded":"2023-11-15T01:40:20.623071+0000","last_fullsized":"2023-11-15T01:40:20.623071+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.644975+0000","last_change":"2023-11-15T01:40:20.638835+0000","last_active":"2023-11-15T01:40:20.644975+0000","last_peered":"2023-11-15T01:40:20.644975+0000","last_clean":"2023-11-15T01:40:20.644975+0000","last_became_active":"2023-11-15T01:40:20.638503+0000","last_became_peered":"2023-11-15T01:40:20.638503+0000","last_unstale":"2023-11-15T01:40:20.644975+0000","last_undegraded":"2023-11-15T01:40:20.644975+0000","last_fullsized":"2023-11-15T01:40:20.644975+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621337+0000","last_change":"2023-11-15T01:40:20.244973+0000","last_active":"2023-11-15T01:40:20.621337+0000","last_peered":"2023-11-15T01:40:20.621337+0000","last_clean":"2023-11-15T01:40:20.621337+0000","last_became_active":"2023-11-15T01:40:20.244693+0000","last_became_peered":"2023-11-15T01:40:20.244693+0000","last_unstale":"2023-11-15T01:40:20.621337+0000","last_undegraded":"2023-11-15T01:40:20.621337+0000","last_fullsized":"2023-11-15T01:40:20.621337+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646635+0000","last_change":"2023-11-15T01:40:20.637751+0000","last_active":"2023-11-15T01:40:20.646635+0000","last_peered":"2023-11-15T01:40:20.646635+0000","last_clean":"2023-11-15T01:40:20.646635+0000","last_became_active":"2023-11-15T01:40:20.637065+0000","last_became_peered":"2023-11-15T01:40:20.637065+0000","last_unstale":"2023-11-15T01:40:20.646635+0000","last_undegraded":"2023-11-15T01:40:20.646635+0000","last_fullsized":"2023-11-15T01:40:20.646635+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626264+0000","last_change":"2023-11-15T01:40:20.241275+0000","last_active":"2023-11-15T01:40:20.626264+0000","last_peered":"2023-11-15T01:40:20.626264+0000","last_clean":"2023-11-15T01:40:20.626264+0000","last_became_active":"2023-11-15T01:40:20.240634+0000","last_became_peered":"2023-11-15T01:40:20.240634+0000","last_unstale":"2023-11-15T01:40:20.626264+0000","last_undegraded":"2023-11-15T01:40:20.626264+0000","last_fullsized":"2023-11-15T01:40:20.626264+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637071+0000","last_change":"2023-11-15T01:40:20.632019+0000","last_active":"2023-11-15T01:40:20.637071+0000","last_peered":"2023-11-15T01:40:20.637071+0000","last_clean":"2023-11-15T01:40:20.637071+0000","last_became_active":"2023-11-15T01:40:20.631739+0000","last_became_peered":"2023-11-15T01:40:20.631739+0000","last_unstale":"2023-11-15T01:40:20.637071+0000","last_undegraded":"2023-11-15T01:40:20.637071+0000","last_fullsized":"2023-11-15T01:40:20.637071+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621235+0000","last_change":"2023-11-15T01:40:20.241452+0000","last_active":"2023-11-15T01:40:20.621235+0000","last_peered":"2023-11-15T01:40:20.621235+0000","last_clean":"2023-11-15T01:40:20.621235+0000","last_became_active":"2023-11-15T01:40:20.241153+0000","last_became_peered":"2023-11-15T01:40:20.241153+0000","last_unstale":"2023-11-15T01:40:20.621235+0000","last_undegraded":"2023-11-15T01:40:20.621235+0000","last_fullsized":"2023-11-15T01:40:20.621235+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647985+0000","last_change":"2023-11-15T01:40:20.644991+0000","last_active":"2023-11-15T01:40:20.647985+0000","last_peered":"2023-11-15T01:40:20.647985+0000","last_clean":"2023-11-15T01:40:20.647985+0000","last_became_active":"2023-11-15T01:40:20.644730+0000","last_became_peered":"2023-11-15T01:40:20.644730+0000","last_unstale":"2023-11-15T01:40:20.647985+0000","last_undegraded":"2023-11-15T01:40:20.647985+0000","last_fullsized":"2023-11-15T01:40:20.647985+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.642580+0000","last_change":"2023-11-15T01:40:20.240160+0000","last_active":"2023-11-15T01:40:20.642580+0000","last_peered":"2023-11-15T01:40:20.642580+0000","last_clean":"2023-11-15T01:40:20.642580+0000","last_became_active":"2023-11-15T01:40:20.239856+0000","last_became_peered":"2023-11-15T01:40:20.239856+0000","last_unstale":"2023-11-15T01:40:20.642580+0000","last_undegraded":"2023-11-15T01:40:20.642580+0000","last_fullsized":"2023-11-15T01:40:20.642580+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634603+0000","last_change":"2023-11-15T01:40:20.631436+0000","last_active":"2023-11-15T01:40:20.634603+0000","last_peered":"2023-11-15T01:40:20.634603+0000","last_clean":"2023-11-15T01:40:20.634603+0000","last_became_active":"2023-11-15T01:40:20.631020+0000","last_became_peered":"2023-11-15T01:40:20.631020+0000","last_unstale":"2023-11-15T01:40:20.634603+0000","last_undegraded":"2023-11-15T01:40:20.634603+0000","last_fullsized":"2023-11-15T01:40:20.634603+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640104+0000","last_change":"2023-11-15T01:40:20.243673+0000","last_active":"2023-11-15T01:40:20.640104+0000","last_peered":"2023-11-15T01:40:20.640104+0000","last_clean":"2023-11-15T01:40:20.640104+0000","last_became_active":"2023-11-15T01:40:20.243237+0000","last_became_peered":"2023-11-15T01:40:20.243237+0000","last_unstale":"2023-11-15T01:40:20.640104+0000","last_undegraded":"2023-11-15T01:40:20.640104+0000","last_fullsized":"2023-11-15T01:40:20.640104+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641997+0000","last_change":"2023-11-15T01:40:20.636870+0000","last_active":"2023-11-15T01:40:20.641997+0000","last_peered":"2023-11-15T01:40:20.641997+0000","last_clean":"2023-11-15T01:40:20.641997+0000","last_became_active":"2023-11-15T01:40:20.636598+0000","last_became_peered":"2023-11-15T01:40:20.636598+0000","last_unstale":"2023-11-15T01:40:20.641997+0000","last_undegraded":"2023-11-15T01:40:20.641997+0000","last_fullsized":"2023-11-15T01:40:20.641997+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634311+0000","last_change":"2023-11-15T01:40:20.249753+0000","last_active":"2023-11-15T01:40:20.634311+0000","last_peered":"2023-11-15T01:40:20.634311+0000","last_clean":"2023-11-15T01:40:20.634311+0000","last_became_active":"2023-11-15T01:40:20.249476+0000","last_became_peered":"2023-11-15T01:40:20.249476+0000","last_unstale":"2023-11-15T01:40:20.634311+0000","last_undegraded":"2023-11-15T01:40:20.634311+0000","last_fullsized":"2023-11-15T01:40:20.634311+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645086+0000","last_change":"2023-11-15T01:40:20.639606+0000","last_active":"2023-11-15T01:40:20.645086+0000","last_peered":"2023-11-15T01:40:20.645086+0000","last_clean":"2023-11-15T01:40:20.645086+0000","last_became_active":"2023-11-15T01:40:20.639330+0000","last_became_peered":"2023-11-15T01:40:20.639330+0000","last_unstale":"2023-11-15T01:40:20.645086+0000","last_undegraded":"2023-11-15T01:40:20.645086+0000","last_fullsized":"2023-11-15T01:40:20.645086+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.633537+0000","last_change":"2023-11-15T01:40:20.249519+0000","last_active":"2023-11-15T01:40:20.633537+0000","last_peered":"2023-11-15T01:40:20.633537+0000","last_clean":"2023-11-15T01:40:20.633537+0000","last_became_active":"2023-11-15T01:40:20.249242+0000","last_became_peered":"2023-11-15T01:40:20.249242+0000","last_unstale":"2023-11-15T01:40:20.633537+0000","last_undegraded":"2023-11-15T01:40:20.633537+0000","last_fullsized":"2023-11-15T01:40:20.633537+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640933+0000","last_change":"2023-11-15T01:40:20.638425+0000","last_active":"2023-11-15T01:40:20.640933+0000","last_peered":"2023-11-15T01:40:20.640933+0000","last_clean":"2023-11-15T01:40:20.640933+0000","last_became_active":"2023-11-15T01:40:20.638126+0000","last_became_peered":"2023-11-15T01:40:20.638126+0000","last_unstale":"2023-11-15T01:40:20.640933+0000","last_undegraded":"2023-11-15T01:40:20.640933+0000","last_fullsized":"2023-11-15T01:40:20.640933+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634331+0000","last_change":"2023-11-15T01:40:20.247847+0000","last_active":"2023-11-15T01:40:20.634331+0000","last_peered":"2023-11-15T01:40:20.634331+0000","last_clean":"2023-11-15T01:40:20.634331+0000","last_became_active":"2023-11-15T01:40:20.247546+0000","last_became_peered":"2023-11-15T01:40:20.247546+0000","last_unstale":"2023-11-15T01:40:20.634331+0000","last_undegraded":"2023-11-15T01:40:20.634331+0000","last_fullsized":"2023-11-15T01:40:20.634331+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.639125+0000","last_change":"2023-11-15T01:40:20.634983+0000","last_active":"2023-11-15T01:40:20.639125+0000","last_peered":"2023-11-15T01:40:20.639125+0000","last_clean":"2023-11-15T01:40:20.639125+0000","last_became_active":"2023-11-15T01:40:20.634686+0000","last_became_peered":"2023-11-15T01:40:20.634686+0000","last_unstale":"2023-11-15T01:40:20.639125+0000","last_undegraded":"2023-11-15T01:40:20.639125+0000","last_fullsized":"2023-11-15T01:40:20.639125+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630653+0000","last_change":"2023-11-15T01:40:20.251483+0000","last_active":"2023-11-15T01:40:20.630653+0000","last_peered":"2023-11-15T01:40:20.630653+0000","last_clean":"2023-11-15T01:40:20.630653+0000","last_became_active":"2023-11-15T01:40:20.251225+0000","last_became_peered":"2023-11-15T01:40:20.251225+0000","last_unstale":"2023-11-15T01:40:20.630653+0000","last_undegraded":"2023-11-15T01:40:20.630653+0000","last_fullsized":"2023-11-15T01:40:20.630653+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646657+0000","last_change":"2023-11-15T01:40:20.637803+0000","last_active":"2023-11-15T01:40:20.646657+0000","last_peered":"2023-11-15T01:40:20.646657+0000","last_clean":"2023-11-15T01:40:20.646657+0000","last_became_active":"2023-11-15T01:40:20.637531+0000","last_became_peered":"2023-11-15T01:40:20.637531+0000","last_unstale":"2023-11-15T01:40:20.646657+0000","last_undegraded":"2023-11-15T01:40:20.646657+0000","last_fullsized":"2023-11-15T01:40:20.646657+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623955+0000","last_change":"2023-11-15T01:40:20.241323+0000","last_active":"2023-11-15T01:40:20.623955+0000","last_peered":"2023-11-15T01:40:20.623955+0000","last_clean":"2023-11-15T01:40:20.623955+0000","last_became_active":"2023-11-15T01:40:20.241039+0000","last_became_peered":"2023-11-15T01:40:20.241039+0000","last_unstale":"2023-11-15T01:40:20.623955+0000","last_undegraded":"2023-11-15T01:40:20.623955+0000","last_fullsized":"2023-11-15T01:40:20.623955+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637650+0000","last_change":"2023-11-15T01:40:20.632327+0000","last_active":"2023-11-15T01:40:20.637650+0000","last_peered":"2023-11-15T01:40:20.637650+0000","last_clean":"2023-11-15T01:40:20.637650+0000","last_became_active":"2023-11-15T01:40:20.631981+0000","last_became_peered":"2023-11-15T01:40:20.631981+0000","last_unstale":"2023-11-15T01:40:20.637650+0000","last_undegraded":"2023-11-15T01:40:20.637650+0000","last_fullsized":"2023-11-15T01:40:20.637650+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630313+0000","last_change":"2023-11-15T01:40:20.248328+0000","last_active":"2023-11-15T01:40:20.630313+0000","last_peered":"2023-11-15T01:40:20.630313+0000","last_clean":"2023-11-15T01:40:20.630313+0000","last_became_active":"2023-11-15T01:40:20.247702+0000","last_became_peered":"2023-11-15T01:40:20.247702+0000","last_unstale":"2023-11-15T01:40:20.630313+0000","last_undegraded":"2023-11-15T01:40:20.630313+0000","last_fullsized":"2023-11-15T01:40:20.630313+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643154+0000","last_change":"2023-11-15T01:40:20.639732+0000","last_active":"2023-11-15T01:40:20.643154+0000","last_peered":"2023-11-15T01:40:20.643154+0000","last_clean":"2023-11-15T01:40:20.643154+0000","last_became_active":"2023-11-15T01:40:20.638787+0000","last_became_peered":"2023-11-15T01:40:20.638787+0000","last_unstale":"2023-11-15T01:40:20.643154+0000","last_undegraded":"2023-11-15T01:40:20.643154+0000","last_fullsized":"2023-11-15T01:40:20.643154+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.633299+0000","last_change":"2023-11-15T01:40:20.243269+0000","last_active":"2023-11-15T01:40:20.633299+0000","last_peered":"2023-11-15T01:40:20.633299+0000","last_clean":"2023-11-15T01:40:20.633299+0000","last_became_active":"2023-11-15T01:40:20.241757+0000","last_became_peered":"2023-11-15T01:40:20.241757+0000","last_unstale":"2023-11-15T01:40:20.633299+0000","last_undegraded":"2023-11-15T01:40:20.633299+0000","last_fullsized":"2023-11-15T01:40:20.633299+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640383+0000","last_change":"2023-11-15T01:40:20.635969+0000","last_active":"2023-11-15T01:40:20.640383+0000","last_peered":"2023-11-15T01:40:20.640383+0000","last_clean":"2023-11-15T01:40:20.640383+0000","last_became_active":"2023-11-15T01:40:20.635682+0000","last_became_peered":"2023-11-15T01:40:20.635682+0000","last_unstale":"2023-11-15T01:40:20.640383+0000","last_undegraded":"2023-11-15T01:40:20.640383+0000","last_fullsized":"2023-11-15T01:40:20.640383+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623421+0000","last_change":"2023-11-15T01:40:20.244894+0000","last_active":"2023-11-15T01:40:20.623421+0000","last_peered":"2023-11-15T01:40:20.623421+0000","last_clean":"2023-11-15T01:40:20.623421+0000","last_became_active":"2023-11-15T01:40:20.244195+0000","last_became_peered":"2023-11-15T01:40:20.244195+0000","last_unstale":"2023-11-15T01:40:20.623421+0000","last_undegraded":"2023-11-15T01:40:20.623421+0000","last_fullsized":"2023-11-15T01:40:20.623421+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647931+0000","last_change":"2023-11-15T01:40:20.644255+0000","last_active":"2023-11-15T01:40:20.647931+0000","last_peered":"2023-11-15T01:40:20.647931+0000","last_clean":"2023-11-15T01:40:20.647931+0000","last_became_active":"2023-11-15T01:40:20.643951+0000","last_became_peered":"2023-11-15T01:40:20.643951+0000","last_unstale":"2023-11-15T01:40:20.647931+0000","last_undegraded":"2023-11-15T01:40:20.647931+0000","last_fullsized":"2023-11-15T01:40:20.647931+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624405+0000","last_change":"2023-11-15T01:40:20.244674+0000","last_active":"2023-11-15T01:40:20.624405+0000","last_peered":"2023-11-15T01:40:20.624405+0000","last_clean":"2023-11-15T01:40:20.624405+0000","last_became_active":"2023-11-15T01:40:20.244188+0000","last_became_peered":"2023-11-15T01:40:20.244188+0000","last_unstale":"2023-11-15T01:40:20.624405+0000","last_undegraded":"2023-11-15T01:40:20.624405+0000","last_fullsized":"2023-11-15T01:40:20.624405+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641364+0000","last_change":"2023-11-15T01:40:20.636297+0000","last_active":"2023-11-15T01:40:20.641364+0000","last_peered":"2023-11-15T01:40:20.641364+0000","last_clean":"2023-11-15T01:40:20.641364+0000","last_became_active":"2023-11-15T01:40:20.635914+0000","last_became_peered":"2023-11-15T01:40:20.635914+0000","last_unstale":"2023-11-15T01:40:20.641364+0000","last_undegraded":"2023-11-15T01:40:20.641364+0000","last_fullsized":"2023-11-15T01:40:20.641364+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623546+0000","last_change":"2023-11-15T01:40:20.249114+0000","last_active":"2023-11-15T01:40:20.623546+0000","last_peered":"2023-11-15T01:40:20.623546+0000","last_clean":"2023-11-15T01:40:20.623546+0000","last_became_active":"2023-11-15T01:40:20.248806+0000","last_became_peered":"2023-11-15T01:40:20.248806+0000","last_unstale":"2023-11-15T01:40:20.623546+0000","last_undegraded":"2023-11-15T01:40:20.623546+0000","last_fullsized":"2023-11-15T01:40:20.623546+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640914+0000","last_change":"2023-11-15T01:40:20.634111+0000","last_active":"2023-11-15T01:40:20.640914+0000","last_peered":"2023-11-15T01:40:20.640914+0000","last_clean":"2023-11-15T01:40:20.640914+0000","last_became_active":"2023-11-15T01:40:20.633828+0000","last_became_peered":"2023-11-15T01:40:20.633828+0000","last_unstale":"2023-11-15T01:40:20.640914+0000","last_undegraded":"2023-11-15T01:40:20.640914+0000","last_fullsized":"2023-11-15T01:40:20.640914+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623178+0000","last_change":"2023-11-15T01:40:20.243830+0000","last_active":"2023-11-15T01:40:20.623178+0000","last_peered":"2023-11-15T01:40:20.623178+0000","last_clean":"2023-11-15T01:40:20.623178+0000","last_became_active":"2023-11-15T01:40:20.243522+0000","last_became_peered":"2023-11-15T01:40:20.243522+0000","last_unstale":"2023-11-15T01:40:20.623178+0000","last_undegraded":"2023-11-15T01:40:20.623178+0000","last_fullsized":"2023-11-15T01:40:20.623178+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646619+0000","last_change":"2023-11-15T01:40:20.637658+0000","last_active":"2023-11-15T01:40:20.646619+0000","last_peered":"2023-11-15T01:40:20.646619+0000","last_clean":"2023-11-15T01:40:20.646619+0000","last_became_active":"2023-11-15T01:40:20.637349+0000","last_became_peered":"2023-11-15T01:40:20.637349+0000","last_unstale":"2023-11-15T01:40:20.646619+0000","last_undegraded":"2023-11-15T01:40:20.646619+0000","last_fullsized":"2023-11-15T01:40:20.646619+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.622664+0000","last_change":"2023-11-15T01:40:20.246311+0000","last_active":"2023-11-15T01:40:20.622664+0000","last_peered":"2023-11-15T01:40:20.622664+0000","last_clean":"2023-11-15T01:40:20.622664+0000","last_became_active":"2023-11-15T01:40:20.245907+0000","last_became_peered":"2023-11-15T01:40:20.245907+0000","last_unstale":"2023-11-15T01:40:20.622664+0000","last_undegraded":"2023-11-15T01:40:20.622664+0000","last_fullsized":"2023-11-15T01:40:20.622664+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645550+0000","last_change":"2023-11-15T01:40:20.641099+0000","last_active":"2023-11-15T01:40:20.645550+0000","last_peered":"2023-11-15T01:40:20.645550+0000","last_clean":"2023-11-15T01:40:20.645550+0000","last_became_active":"2023-11-15T01:40:20.639935+0000","last_became_peered":"2023-11-15T01:40:20.639935+0000","last_unstale":"2023-11-15T01:40:20.645550+0000","last_undegraded":"2023-11-15T01:40:20.645550+0000","last_fullsized":"2023-11-15T01:40:20.645550+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.620564+0000","last_change":"2023-11-15T01:40:20.249564+0000","last_active":"2023-11-15T01:40:20.620564+0000","last_peered":"2023-11-15T01:40:20.620564+0000","last_clean":"2023-11-15T01:40:20.620564+0000","last_became_active":"2023-11-15T01:40:20.249234+0000","last_became_peered":"2023-11-15T01:40:20.249234+0000","last_unstale":"2023-11-15T01:40:20.620564+0000","last_undegraded":"2023-11-15T01:40:20.620564+0000","last_fullsized":"2023-11-15T01:40:20.620564+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641575+0000","last_change":"2023-11-15T01:40:20.637554+0000","last_active":"2023-11-15T01:40:20.641575+0000","last_peered":"2023-11-15T01:40:20.641575+0000","last_clean":"2023-11-15T01:40:20.641575+0000","last_became_active":"2023-11-15T01:40:20.636661+0000","last_became_peered":"2023-11-15T01:40:20.636661+0000","last_unstale":"2023-11-15T01:40:20.641575+0000","last_undegraded":"2023-11-15T01:40:20.641575+0000","last_fullsized":"2023-11-15T01:40:20.641575+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630434+0000","last_change":"2023-11-15T01:40:20.245202+0000","last_active":"2023-11-15T01:40:20.630434+0000","last_peered":"2023-11-15T01:40:20.630434+0000","last_clean":"2023-11-15T01:40:20.630434+0000","last_became_active":"2023-11-15T01:40:20.244906+0000","last_became_peered":"2023-11-15T01:40:20.244906+0000","last_unstale":"2023-11-15T01:40:20.630434+0000","last_undegraded":"2023-11-15T01:40:20.630434+0000","last_fullsized":"2023-11-15T01:40:20.630434+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640421+0000","last_change":"2023-11-15T01:40:20.634926+0000","last_active":"2023-11-15T01:40:20.640421+0000","last_peered":"2023-11-15T01:40:20.640421+0000","last_clean":"2023-11-15T01:40:20.640421+0000","last_became_active":"2023-11-15T01:40:20.634638+0000","last_became_peered":"2023-11-15T01:40:20.634638+0000","last_unstale":"2023-11-15T01:40:20.640421+0000","last_undegraded":"2023-11-15T01:40:20.640421+0000","last_fullsized":"2023-11-15T01:40:20.640421+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623813+0000","last_change":"2023-11-15T01:40:20.245508+0000","last_active":"2023-11-15T01:40:20.623813+0000","last_peered":"2023-11-15T01:40:20.623813+0000","last_clean":"2023-11-15T01:40:20.623813+0000","last_became_active":"2023-11-15T01:40:20.243956+0000","last_became_peered":"2023-11-15T01:40:20.243956+0000","last_unstale":"2023-11-15T01:40:20.623813+0000","last_undegraded":"2023-11-15T01:40:20.623813+0000","last_fullsized":"2023-11-15T01:40:20.623813+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626981+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:40:20.626981+0000","last_peered":"2023-11-15T01:40:20.626981+0000","last_clean":"2023-11-15T01:40:20.626981+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:40:20.626981+0000","last_undegraded":"2023-11-15T01:40:20.626981+0000","last_fullsized":"2023-11-15T01:40:20.626981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.629120+0000","last_change":"2023-11-15T01:40:20.625014+0000","last_active":"2023-11-15T01:40:20.629120+0000","last_peered":"2023-11-15T01:40:20.629120+0000","last_clean":"2023-11-15T01:40:20.629120+0000","last_became_active":"2023-11-15T01:40:20.624716+0000","last_became_peered":"2023-11-15T01:40:20.624716+0000","last_unstale":"2023-11-15T01:40:20.629120+0000","last_undegraded":"2023-11-15T01:40:20.629120+0000","last_fullsized":"2023-11-15T01:40:20.629120+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623840+0000","last_change":"2023-11-15T01:40:20.242768+0000","last_active":"2023-11-15T01:40:20.623840+0000","last_peered":"2023-11-15T01:40:20.623840+0000","last_clean":"2023-11-15T01:40:20.623840+0000","last_became_active":"2023-11-15T01:40:20.242476+0000","last_became_peered":"2023-11-15T01:40:20.242476+0000","last_unstale":"2023-11-15T01:40:20.623840+0000","last_undegraded":"2023-11-15T01:40:20.623840+0000","last_fullsized":"2023-11-15T01:40:20.623840+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624574+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:40:20.624574+0000","last_peered":"2023-11-15T01:40:20.624574+0000","last_clean":"2023-11-15T01:40:20.624574+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:40:20.624574+0000","last_undegraded":"2023-11-15T01:40:20.624574+0000","last_fullsized":"2023-11-15T01:40:20.624574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641810+0000","last_change":"2023-11-15T01:40:20.639491+0000","last_active":"2023-11-15T01:40:20.641810+0000","last_peered":"2023-11-15T01:40:20.641810+0000","last_clean":"2023-11-15T01:40:20.641810+0000","last_became_active":"2023-11-15T01:40:20.639223+0000","last_became_peered":"2023-11-15T01:40:20.639223+0000","last_unstale":"2023-11-15T01:40:20.641810+0000","last_undegraded":"2023-11-15T01:40:20.641810+0000","last_fullsized":"2023-11-15T01:40:20.641810+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.627927+0000","last_change":"2023-11-15T01:40:20.232634+0000","last_active":"2023-11-15T01:40:20.627927+0000","last_peered":"2023-11-15T01:40:20.627927+0000","last_clean":"2023-11-15T01:40:20.627927+0000","last_became_active":"2023-11-15T01:40:20.232339+0000","last_became_peered":"2023-11-15T01:40:20.232339+0000","last_unstale":"2023-11-15T01:40:20.627927+0000","last_undegraded":"2023-11-15T01:40:20.627927+0000","last_fullsized":"2023-11-15T01:40:20.627927+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":123,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.616573+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:40:20.616573+0000","last_peered":"2023-11-15T01:40:20.616573+0000","last_clean":"2023-11-15T01:40:20.616573+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:40:20.616573+0000","last_undegraded":"2023-11-15T01:40:20.616573+0000","last_fullsized":"2023-11-15T01:40:20.616573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645587+0000","last_change":"2023-11-15T01:40:20.641425+0000","last_active":"2023-11-15T01:40:20.645587+0000","last_peered":"2023-11-15T01:40:20.645587+0000","last_clean":"2023-11-15T01:40:20.645587+0000","last_became_active":"2023-11-15T01:40:20.641221+0000","last_became_peered":"2023-11-15T01:40:20.641221+0000","last_unstale":"2023-11-15T01:40:20.645587+0000","last_undegraded":"2023-11-15T01:40:20.645587+0000","last_fullsized":"2023-11-15T01:40:20.645587+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645299+0000","last_change":"2023-11-15T01:40:20.243969+0000","last_active":"2023-11-15T01:40:20.645299+0000","last_peered":"2023-11-15T01:40:20.645299+0000","last_clean":"2023-11-15T01:40:20.645299+0000","last_became_active":"2023-11-15T01:40:20.243703+0000","last_became_peered":"2023-11-15T01:40:20.243703+0000","last_unstale":"2023-11-15T01:40:20.645299+0000","last_undegraded":"2023-11-15T01:40:20.645299+0000","last_fullsized":"2023-11-15T01:40:20.645299+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.627293+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:40:20.627293+0000","last_peered":"2023-11-15T01:40:20.627293+0000","last_clean":"2023-11-15T01:40:20.627293+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:40:20.627293+0000","last_undegraded":"2023-11-15T01:40:20.627293+0000","last_fullsized":"2023-11-15T01:40:20.627293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":111,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630613+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:40:20.630613+0000","last_peered":"2023-11-15T01:40:20.630613+0000","last_clean":"2023-11-15T01:40:20.630613+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:40:20.630613+0000","last_undegraded":"2023-11-15T01:40:20.630613+0000","last_fullsized":"2023-11-15T01:40:20.630613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.638169+0000","last_change":"2023-11-15T01:40:20.633092+0000","last_active":"2023-11-15T01:40:20.638169+0000","last_peered":"2023-11-15T01:40:20.638169+0000","last_clean":"2023-11-15T01:40:20.638169+0000","last_became_active":"2023-11-15T01:40:20.632795+0000","last_became_peered":"2023-11-15T01:40:20.632795+0000","last_unstale":"2023-11-15T01:40:20.638169+0000","last_undegraded":"2023-11-15T01:40:20.638169+0000","last_fullsized":"2023-11-15T01:40:20.638169+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634086+0000","last_change":"2023-11-15T01:40:20.246780+0000","last_active":"2023-11-15T01:40:20.634086+0000","last_peered":"2023-11-15T01:40:20.634086+0000","last_clean":"2023-11-15T01:40:20.634086+0000","last_became_active":"2023-11-15T01:40:20.246469+0000","last_became_peered":"2023-11-15T01:40:20.246469+0000","last_unstale":"2023-11-15T01:40:20.634086+0000","last_undegraded":"2023-11-15T01:40:20.634086+0000","last_fullsized":"2023-11-15T01:40:20.634086+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630698+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:40:20.630698+0000","last_peered":"2023-11-15T01:40:20.630698+0000","last_clean":"2023-11-15T01:40:20.630698+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:40:20.630698+0000","last_undegraded":"2023-11-15T01:40:20.630698+0000","last_fullsized":"2023-11-15T01:40:20.630698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637913+0000","last_change":"2023-11-15T01:40:20.633216+0000","last_active":"2023-11-15T01:40:20.637913+0000","last_peered":"2023-11-15T01:40:20.637913+0000","last_clean":"2023-11-15T01:40:20.637913+0000","last_became_active":"2023-11-15T01:40:20.632940+0000","last_became_peered":"2023-11-15T01:40:20.632940+0000","last_unstale":"2023-11-15T01:40:20.637913+0000","last_undegraded":"2023-11-15T01:40:20.637913+0000","last_fullsized":"2023-11-15T01:40:20.637913+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.628043+0000","last_change":"2023-11-15T01:40:20.238543+0000","last_active":"2023-11-15T01:40:20.628043+0000","last_peered":"2023-11-15T01:40:20.628043+0000","last_clean":"2023-11-15T01:40:20.628043+0000","last_became_active":"2023-11-15T01:40:20.238077+0000","last_became_peered":"2023-11-15T01:40:20.238077+0000","last_unstale":"2023-11-15T01:40:20.628043+0000","last_undegraded":"2023-11-15T01:40:20.628043+0000","last_fullsized":"2023-11-15T01:40:20.628043+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634389+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:40:20.634389+0000","last_peered":"2023-11-15T01:40:20.634389+0000","last_clean":"2023-11-15T01:40:20.634389+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:40:20.634389+0000","last_undegraded":"2023-11-15T01:40:20.634389+0000","last_fullsized":"2023-11-15T01:40:20.634389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647346+0000","last_change":"2023-11-15T01:40:20.638187+0000","last_active":"2023-11-15T01:40:20.647346+0000","last_peered":"2023-11-15T01:40:20.647346+0000","last_clean":"2023-11-15T01:40:20.647346+0000","last_became_active":"2023-11-15T01:40:20.637942+0000","last_became_peered":"2023-11-15T01:40:20.637942+0000","last_unstale":"2023-11-15T01:40:20.647346+0000","last_undegraded":"2023-11-15T01:40:20.647346+0000","last_fullsized":"2023-11-15T01:40:20.647346+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"140'3","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645808+0000","last_change":"2023-11-15T01:40:20.247727+0000","last_active":"2023-11-15T01:40:20.645808+0000","last_peered":"2023-11-15T01:40:20.645808+0000","last_clean":"2023-11-15T01:40:20.645808+0000","last_became_active":"2023-11-15T01:40:20.247443+0000","last_became_peered":"2023-11-15T01:40:20.247443+0000","last_unstale":"2023-11-15T01:40:20.645808+0000","last_undegraded":"2023-11-15T01:40:20.645808+0000","last_fullsized":"2023-11-15T01:40:20.645808+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.628283+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:40:20.628283+0000","last_peered":"2023-11-15T01:40:20.628283+0000","last_clean":"2023-11-15T01:40:20.628283+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:40:20.628283+0000","last_undegraded":"2023-11-15T01:40:20.628283+0000","last_fullsized":"2023-11-15T01:40:20.628283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637942+0000","last_change":"2023-11-15T01:40:20.632398+0000","last_active":"2023-11-15T01:40:20.637942+0000","last_peered":"2023-11-15T01:40:20.637942+0000","last_clean":"2023-11-15T01:40:20.637942+0000","last_became_active":"2023-11-15T01:40:20.632020+0000","last_became_peered":"2023-11-15T01:40:20.632020+0000","last_unstale":"2023-11-15T01:40:20.637942+0000","last_undegraded":"2023-11-15T01:40:20.637942+0000","last_fullsized":"2023-11-15T01:40:20.637942+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646627+0000","last_change":"2023-11-15T01:40:20.242601+0000","last_active":"2023-11-15T01:40:20.646627+0000","last_peered":"2023-11-15T01:40:20.646627+0000","last_clean":"2023-11-15T01:40:20.646627+0000","last_became_active":"2023-11-15T01:40:20.242275+0000","last_became_peered":"2023-11-15T01:40:20.242275+0000","last_unstale":"2023-11-15T01:40:20.646627+0000","last_undegraded":"2023-11-15T01:40:20.646627+0000","last_fullsized":"2023-11-15T01:40:20.646627+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":128,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625034+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:40:20.625034+0000","last_peered":"2023-11-15T01:40:20.625034+0000","last_clean":"2023-11-15T01:40:20.625034+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:40:20.625034+0000","last_undegraded":"2023-11-15T01:40:20.625034+0000","last_fullsized":"2023-11-15T01:40:20.625034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575070,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302912,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068928,"statfs":{"total":96636764160,"available":96326582272,"internally_reserved":0,"allocated":1761280,"data_stored":915404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71999999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.33800000000000002,"15min":0.248},"max":{"1min":0.751,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.70699999999999996}]},{"osd":1,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.747,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.42799999999999999,"5min":0.34499999999999997,"15min":0.27500000000000002},"max":{"1min":0.76300000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.746}]},{"osd":2,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.38200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82599999999999996},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.309},"max":{"1min":0.77300000000000002,"5min":0.875,"15min":0.875},"last":0.60099999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.85999999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.373,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.80200000000000005}]},{"osd":4,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47699999999999998,"15min":0.46700000000000003},"min":{"1min":0.28399999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67400000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.437},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.316},"max":{"1min":0.77000000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52600000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.317,"5min":0.26500000000000001,"15min":0.23499999999999999},"max":{"1min":0.75,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.317,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66800000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57099999999999995}]},{"osd":6,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.82999999999999996,"15min":1.0129999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.34200000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79400000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.72799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575071,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1753088,"data_stored":915764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.42899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72499999999999998,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73099999999999998,"5min":0.77800000000000002,"15min":0.89000000000000001},"last":0.66900000000000004}]},{"osd":1,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.39000000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.83099999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.33100000000000002,"15min":0.32100000000000001},"max":{"1min":0.72999999999999998,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.69699999999999995}]},{"osd":2,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73399999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.46100000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76300000000000001,"5min":1.746,"15min":1.746},"last":0.73399999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.38,"5min":0.371,"15min":0.307},"max":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.91300000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.78400000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.68000000000000005}]},{"osd":4,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.32400000000000001,"5min":0.28899999999999998,"15min":0.26600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.52400000000000002},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.25800000000000001},"max":{"1min":0.79700000000000004,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.46800000000000003}]},{"osd":5,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76800000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.38900000000000001,"5min":0.32000000000000001,"15min":0.30399999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.82599999999999996},"last":0.49399999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.504,"15min":0.503},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.29899999999999999},"max":{"1min":0.83699999999999997,"5min":0.875,"15min":0.875},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80700000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.504}]}]},{"osd":1,"up_from":13,"seq":55834575072,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1753088,"data_stored":915232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.36099999999999999,"15min":0.376},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.24299999999999999},"max":{"1min":0.55000000000000004,"5min":0.59099999999999997,"15min":0.73699999999999999},"last":0.253},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.40200000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.35499999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.375,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58399999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42799999999999999,"15min":0.438},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.26200000000000001},"max":{"1min":0.66300000000000003,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.32600000000000001}]},{"osd":3,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.55800000000000005,"15min":0.52200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71099999999999997,"5min":9.641,"15min":9.641},"last":0.371},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53500000000000003,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.28599999999999998},"max":{"1min":0.71799999999999997,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.40000000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.45100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1,"5min":1,"15min":1},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.61599999999999999,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.90800000000000003,"5min":1.006,"15min":1.006},"last":0.56799999999999995}]},{"osd":5,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61199999999999999,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.45300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0009999999999999,"5min":1.111,"15min":1.111},"last":0.44600000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0449999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.48399999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66100000000000003,"15min":0.68799999999999994},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0169999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.67800000000000005,"15min":0.69099999999999995},"min":{"1min":0.501,"5min":0.434,"15min":0.434},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.55600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575070,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302912,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068928,"statfs":{"total":96636764160,"available":96326582272,"internally_reserved":0,"allocated":1761280,"data_stored":916678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.371},"min":{"1min":0.27300000000000002,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.495,"5min":0.54200000000000004,"15min":2.024},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.39600000000000002,"15min":0.41499999999999998},"min":{"1min":0.24399999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52200000000000002,"5min":0.64700000000000002,"15min":1.9490000000000001},"last":0.29699999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36299999999999999,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":1.768},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41299999999999998,"15min":0.437},"min":{"1min":0.28000000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":1.982},"last":0.33500000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42199999999999999,"15min":0.435},"min":{"1min":0.30199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58999999999999997,"5min":0.63100000000000001,"15min":2.0579999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.30199999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.64900000000000002,"5min":0.67900000000000005,"15min":1.7989999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40400000000000003},"max":{"1min":0.83599999999999997,"5min":1.018,"15min":1.018},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63300000000000001,"15min":0.65300000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79600000000000004,"5min":0.98899999999999999,"15min":1.7250000000000001},"last":0.64000000000000001}]},{"osd":5,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82899999999999996,"5min":0.97899999999999998,"15min":1.881},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":1.056},"last":0.72899999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.36499999999999999},"max":{"1min":0.84499999999999997,"5min":1.04,"15min":1.6830000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64700000000000002,"15min":0.67000000000000004},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90800000000000003,"5min":0.94099999999999995,"15min":1.917},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.67000000000000004,"15min":0.68700000000000006},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88100000000000001,"5min":1.0089999999999999,"15min":1.843},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.68700000000000006},"min":{"1min":0.47599999999999998,"5min":0.46999999999999997,"15min":0.40899999999999997},"max":{"1min":0.90300000000000002,"5min":1.073,"15min":1.0960000000000001},"last":0.76500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575071,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307004,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064836,"statfs":{"total":96636764160,"available":96322392064,"internally_reserved":0,"allocated":1757184,"data_stored":916172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35499999999999998,"15min":0.36599999999999999},"min":{"1min":0.248,"5min":0.186,"15min":0.186},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.61899999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56000000000000005,"5min":0.63900000000000001,"15min":0.74299999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.59199999999999997,"5min":0.745,"15min":0.745},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.58199999999999996,"5min":0.69799999999999995,"15min":0.73499999999999999},"last":0.434}]},{"osd":3,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.436,"15min":0.44900000000000001},"min":{"1min":0.32300000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53000000000000003,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.436,"15min":0.441},"min":{"1min":0.24399999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57199999999999995,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.37}]},{"osd":4,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.47299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77300000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61799999999999999,"15min":0.63300000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79000000000000004,"5min":0.91100000000000003,"15min":0.95399999999999996},"last":0.57599999999999996}]},{"osd":5,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.47899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89800000000000002,"5min":1.032,"15min":1.032},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.63500000000000001},"min":{"1min":0.47499999999999998,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":0.81200000000000006,"5min":0.96699999999999997,"15min":0.99399999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.374},"max":{"1min":0.83699999999999997,"5min":1.002,"15min":1.0389999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.64200000000000002,"15min":0.66500000000000004},"min":{"1min":0.46100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.83199999999999996,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.45400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.92200000000000004,"5min":1.079,"15min":1.079},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65600000000000003,"15min":0.68500000000000005},"min":{"1min":0.434,"5min":0.374,"15min":0.374},"max":{"1min":0.82399999999999995,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.73199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575072,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307008,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064832,"statfs":{"total":96636764160,"available":96322387968,"internally_reserved":0,"allocated":1761280,"data_stored":915888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.36399999999999999,"15min":0.374},"min":{"1min":0.27500000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.79900000000000004},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.377,"15min":0.39700000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.49199999999999999,"5min":0.60699999999999998,"15min":0.71499999999999997},"last":0.30099999999999999}]},{"osd":1,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.39000000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51500000000000001,"5min":0.63400000000000001,"15min":0.72899999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.41899999999999998,"15min":0.442},"min":{"1min":0.33000000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.56200000000000006,"5min":0.72499999999999998,"15min":0.747},"last":0.29399999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.32200000000000001,"5min":0.27300000000000002,"15min":0.23200000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.37},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.47299999999999998},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.622,"5min":0.69199999999999995,"15min":0.81999999999999995},"last":0.38100000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57599999999999996,"15min":0.60999999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84999999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60599999999999998,"15min":0.625},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":1.389,"15min":1.389},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.63100000000000001},"min":{"1min":0.47199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93600000000000005,"5min":1.512,"15min":1.512},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61399999999999999,"15min":0.63700000000000001},"min":{"1min":0.42099999999999999,"5min":0.374,"15min":0.373},"max":{"1min":0.82299999999999995,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92700000000000005,"5min":0.94199999999999995,"15min":1.0980000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.66100000000000003},"min":{"1min":0.45200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.0900000000000001},"last":0.80600000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.66400000000000003},"min":{"1min":0.443,"5min":0.39900000000000002,"15min":0.38700000000000001},"max":{"1min":0.94999999999999996,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64200000000000002,"15min":0.67600000000000005},"min":{"1min":0.48999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90600000000000003,"5min":1.069,"15min":1.1319999999999999},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575070,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302908,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068932,"statfs":{"total":96636764160,"available":96326586368,"internally_reserved":0,"allocated":1757184,"data_stored":915854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.30399999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.84499999999999997,"15min":0.88},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.749,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.68999999999999995}]},{"osd":1,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.39400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81000000000000005,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.34799999999999998,"15min":0.34699999999999998},"max":{"1min":0.68000000000000005,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.72299999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.58499999999999996},"min":{"1min":0.373,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72199999999999998,"5min":2.887,"15min":2.887},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.45800000000000002,"5min":0.37,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":0.92300000000000004,"15min":0.96299999999999997},"last":0.55000000000000004}]},{"osd":3,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.33100000000000002},"max":{"1min":0.73399999999999999,"5min":2.464,"15min":2.464},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63400000000000001,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84799999999999998,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48599999999999999,"15min":0.46899999999999997},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68500000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.434},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.49199999999999999},"min":{"1min":0.38900000000000001,"5min":0.29899999999999999,"15min":0.27400000000000002},"max":{"1min":0.66300000000000003,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.44400000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52300000000000002,"15min":0.495},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.28899999999999998},"max":{"1min":0.72199999999999998,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.379},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55000000000000004,"15min":0.52900000000000003},"min":{"1min":0.42599999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.47399999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.42099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71799999999999997,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.502},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59199999999999997,"15min":0.56699999999999995},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.46200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575070,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1753088,"data_stored":915300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53100000000000003,"15min":0.54500000000000004},"min":{"1min":0.42699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.72199999999999998,"5min":0.78500000000000003,"15min":0.79200000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.78100000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.434}]},{"osd":1,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.53500000000000003,"15min":0.55900000000000005},"min":{"1min":0.35699999999999998,"5min":0.33300000000000002,"15min":0.32600000000000001},"max":{"1min":0.75,"5min":0.78500000000000003,"15min":0.83299999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.42599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.80100000000000005},"last":0.42099999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81200000000000006,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68000000000000005,"5min":0.77100000000000002,"15min":0.84599999999999997},"last":0.48699999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67900000000000005,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.5},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77600000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.29499999999999998,"5min":0.26600000000000001,"15min":0.23899999999999999},"max":{"1min":0.59299999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65500000000000003,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.52200000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.27600000000000002},"max":{"1min":0.54600000000000004,"5min":0.81599999999999995,"15min":0.83099999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63700000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46400000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.497},"min":{"1min":0.378,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.45300000000000001,"5min":0.40100000000000002,"15min":0.33600000000000002},"max":{"1min":0.71099999999999997,"5min":0.82399999999999995,"15min":0.85799999999999998},"last":0.53500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:40:25.407 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-15T01:40:25.540 INFO:tasks.ceph.mds.c.smithi001.stderr:2023-11-15T01:40:25.539+0000 7fcab6385700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T01:40:25.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.554+0000 7fbecf545700 1 Processor -- start 2023-11-15T01:40:25.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.554+0000 7fbecf545700 1 -- start start 2023-11-15T01:40:25.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.555+0000 7fbecf545700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbec80be500 0x7fbec80a8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.555+0000 7fbecf545700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbec8154930 0x7fbec80c7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.555+0000 7fbecf545700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec80c7480 con 0x7fbec8154550 2023-11-15T01:40:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.555+0000 7fbecf545700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec80a7d50 con 0x7fbec80be500 2023-11-15T01:40:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.555+0000 7fbecf545700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec8065580 con 0x7fbec8154930 2023-11-15T01:40:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.555+0000 7fbeccae0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbec80be500 0x7fbec80a8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.556+0000 7fbeccae0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbec80be500 0x7fbec80a8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59250/0 (socket says 172.21.15.1:59250) 2023-11-15T01:40:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.556+0000 7fbeccae0700 1 -- 172.21.15.1:0/1492214809 learned_addr learned my addr 172.21.15.1:0/1492214809 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.556+0000 7fbecdae2700 1 --2- 172.21.15.1:0/1492214809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbec8154930 0x7fbec80c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.556+0000 7fbeccae0700 1 -- 172.21.15.1:0/1492214809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbec8154930 msgr2=0x7fbec80c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:25.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.556+0000 7fbeccae0700 1 --2- 172.21.15.1:0/1492214809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbec8154930 0x7fbec80c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.556+0000 7fbeccae0700 1 -- 172.21.15.1:0/1492214809 >> v1:172.21.15.141:6789/0 conn(0x7fbec8154550 legacy=0x7fbec80bddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.556+0000 7fbeccae0700 1 -- 172.21.15.1:0/1492214809 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec8065860 con 0x7fbec80be500 2023-11-15T01:40:25.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.556+0000 7fbecdae2700 1 --2- 172.21.15.1:0/1492214809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbec8154930 0x7fbec80c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:25.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.556+0000 7fbeccae0700 1 --2- 172.21.15.1:0/1492214809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbec80be500 0x7fbec80a8420 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fbebc009810 tx=0x7fbebc009060).ready entity=mon.0 client_cookie=a67921851b2d7765 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:25.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.556+0000 7fbec7fff700 1 -- 172.21.15.1:0/1492214809 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc005880 con 0x7fbec80be500 2023-11-15T01:40:25.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.556+0000 7fbec7fff700 1 -- 172.21.15.1:0/1492214809 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc0059e0 con 0x7fbec80be500 2023-11-15T01:40:25.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.556+0000 7fbec7fff700 1 -- 172.21.15.1:0/1492214809 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc005d60 con 0x7fbec80be500 2023-11-15T01:40:25.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.557+0000 7fbecf545700 1 -- 172.21.15.1:0/1492214809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbec80be500 msgr2=0x7fbec80a8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.557+0000 7fbecf545700 1 --2- 172.21.15.1:0/1492214809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbec80be500 0x7fbec80a8420 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fbebc009810 tx=0x7fbebc009060).stop 2023-11-15T01:40:25.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.557+0000 7fbecf545700 1 -- 172.21.15.1:0/1492214809 shutdown_connections 2023-11-15T01:40:25.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.557+0000 7fbecf545700 1 --2- 172.21.15.1:0/1492214809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbec8154930 0x7fbec80c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.557+0000 7fbecf545700 1 --2- 172.21.15.1:0/1492214809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbec80be500 0x7fbec80a8420 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.557+0000 7fbecf545700 1 -- 172.21.15.1:0/1492214809 >> 172.21.15.1:0/1492214809 conn(0x7fbec8082f90 msgr2=0x7fbec80c8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:25.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.557+0000 7fbecf545700 1 -- 172.21.15.1:0/1492214809 shutdown_connections 2023-11-15T01:40:25.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.557+0000 7fbecf545700 1 -- 172.21.15.1:0/1492214809 wait complete. 2023-11-15T01:40:25.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.558+0000 7fbecf545700 1 Processor -- start 2023-11-15T01:40:25.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.558+0000 7fbecf545700 1 -- start start 2023-11-15T01:40:25.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbecf545700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbec80be500 0x7fbec8142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbecf545700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbec8154550 0x7fbec81648d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbecf545700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbec8154930 0x7fbec8164dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbecf545700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec8165430 con 0x7fbec8154550 2023-11-15T01:40:25.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbecf545700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec8165710 con 0x7fbec8154930 2023-11-15T01:40:25.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbecf545700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec8167eb0 con 0x7fbec80be500 2023-11-15T01:40:25.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbeccae0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbec8154550 0x7fbec81648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbeccae0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbec8154550 0x7fbec81648d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59252/0 (socket says 172.21.15.1:59252) 2023-11-15T01:40:25.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbeccae0700 1 -- 172.21.15.1:0/3684600434 learned_addr learned my addr 172.21.15.1:0/3684600434 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:25.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbecdae2700 1 --2- 172.21.15.1:0/3684600434 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbec8154930 0x7fbec8164dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbecd2e1700 1 --2- 172.21.15.1:0/3684600434 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbec80be500 0x7fbec8142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbeccae0700 1 -- 172.21.15.1:0/3684600434 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbec80be500 msgr2=0x7fbec8142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbeccae0700 1 --2- 172.21.15.1:0/3684600434 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbec80be500 0x7fbec8142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbeccae0700 1 -- 172.21.15.1:0/3684600434 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbec8154930 msgr2=0x7fbec8164dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbeccae0700 1 --2- 172.21.15.1:0/3684600434 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbec8154930 0x7fbec8164dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbeccae0700 1 -- 172.21.15.1:0/3684600434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc009300 con 0x7fbec8154550 2023-11-15T01:40:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.559+0000 7fbeccae0700 1 --2- 172.21.15.1:0/3684600434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbec8154550 0x7fbec81648d0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7fbebc00b400 tx=0x7fbebc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.560+0000 7fbec57fa700 1 -- 172.21.15.1:0/3684600434 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc005880 con 0x7fbec8154550 2023-11-15T01:40:25.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.560+0000 7fbec57fa700 1 -- 172.21.15.1:0/3684600434 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc00b850 con 0x7fbec8154550 2023-11-15T01:40:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.560+0000 7fbecf545700 1 -- 172.21.15.1:0/3684600434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec8168190 con 0x7fbec8154550 2023-11-15T01:40:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.560+0000 7fbec57fa700 1 -- 172.21.15.1:0/3684600434 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc00bc10 con 0x7fbec8154550 2023-11-15T01:40:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.560+0000 7fbecf545700 1 -- 172.21.15.1:0/3684600434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec8143170 con 0x7fbec8154550 2023-11-15T01:40:25.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.561+0000 7fbecf545700 1 -- 172.21.15.1:0/3684600434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec8168630 con 0x7fbec8154550 2023-11-15T01:40:25.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.561+0000 7fbec57fa700 1 -- 172.21.15.1:0/3684600434 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fbebc025460 con 0x7fbec8154550 2023-11-15T01:40:25.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.561+0000 7fbec57fa700 1 --2- 172.21.15.1:0/3684600434 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbeb405f270 0x7fbeb4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.561+0000 7fbec57fa700 1 -- 172.21.15.1:0/3684600434 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7fbebc07b960 con 0x7fbec8154550 2023-11-15T01:40:25.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.562+0000 7fbecd2e1700 1 --2- 172.21.15.1:0/3684600434 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbeb405f270 0x7fbeb4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.562+0000 7fbecd2e1700 1 --2- 172.21.15.1:0/3684600434 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbeb405f270 0x7fbeb4061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fbec0002d20 tx=0x7fbec00015b0).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:25.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.566+0000 7fbec57fa700 1 -- 172.21.15.1:0/3684600434 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbebc04c7d0 con 0x7fbec8154550 2023-11-15T01:40:25.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.806+0000 7fbecf545700 1 -- 172.21.15.1:0/3684600434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbec806c7e0 con 0x7fbec8154550 2023-11-15T01:40:25.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.807+0000 7fbec57fa700 1 -- 172.21.15.1:0/3684600434 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+954 (secure 0 0 0) 0x7fbebc04fdf0 con 0x7fbec8154550 2023-11-15T01:40:25.809 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:25.809 INFO:teuthology.orchestra.run.smithi001.stdout:{"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1146,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":141,"num_osds":8,"num_up_osds":8,"osd_up_since":1700011287,"num_in_osds":8,"osd_in_since":1700011281,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":2489810944,"bytes_avail":770604302336,"bytes_total":773094113280},"fsmap":{"epoch":63,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8091}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-11-15T01:38:44.087107+0000","services":{}},"progress_events":{}} 2023-11-15T01:40:25.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.808+0000 7fbecf545700 1 -- 172.21.15.1:0/3684600434 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbeb405f270 msgr2=0x7fbeb4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.808+0000 7fbecf545700 1 --2- 172.21.15.1:0/3684600434 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbeb405f270 0x7fbeb4061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fbec0002d20 tx=0x7fbec00015b0).stop 2023-11-15T01:40:25.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.808+0000 7fbecf545700 1 -- 172.21.15.1:0/3684600434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbec8154550 msgr2=0x7fbec81648d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.808+0000 7fbecf545700 1 --2- 172.21.15.1:0/3684600434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbec8154550 0x7fbec81648d0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7fbebc00b400 tx=0x7fbebc016000).stop 2023-11-15T01:40:25.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.808+0000 7fbecf545700 1 -- 172.21.15.1:0/3684600434 shutdown_connections 2023-11-15T01:40:25.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.808+0000 7fbecf545700 1 --2- 172.21.15.1:0/3684600434 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbeb405f270 0x7fbeb4061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.808+0000 7fbecf545700 1 --2- 172.21.15.1:0/3684600434 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbec8154930 0x7fbec8164dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.808+0000 7fbecf545700 1 --2- 172.21.15.1:0/3684600434 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbec80be500 0x7fbec8142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.808+0000 7fbecf545700 1 --2- 172.21.15.1:0/3684600434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbec8154550 0x7fbec81648d0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.808+0000 7fbecf545700 1 -- 172.21.15.1:0/3684600434 >> 172.21.15.1:0/3684600434 conn(0x7fbec8082f90 msgr2=0x7fbec815aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:25.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.808+0000 7fbecf545700 1 -- 172.21.15.1:0/3684600434 shutdown_connections 2023-11-15T01:40:25.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.808+0000 7fbecf545700 1 -- 172.21.15.1:0/3684600434 wait complete. 2023-11-15T01:40:25.822 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-15T01:40:25.822 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:40:25.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.938+0000 7fc254e50700 1 Processor -- start 2023-11-15T01:40:25.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.938+0000 7fc254e50700 1 -- start start 2023-11-15T01:40:25.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.939+0000 7fc254e50700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc250154150 0x7fc250154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.939+0000 7fc254e50700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc2500ab1a0 0x7fc250158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.939+0000 7fc254e50700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2500c06f0 con 0x7fc2500aa060 2023-11-15T01:40:25.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.939+0000 7fc254e50700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2500c09d0 con 0x7fc250154150 2023-11-15T01:40:25.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.939+0000 7fc254e50700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc250158820 con 0x7fc2500ab1a0 2023-11-15T01:40:25.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.939+0000 7fc24e59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc250154150 0x7fc250154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.939+0000 7fc24ed9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc2500aa060 0x7fc2500c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:34804/0 (socket says 172.21.15.1:34804) 2023-11-15T01:40:25.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.939+0000 7fc24ed9d700 1 -- 172.21.15.1:0/15815361 learned_addr learned my addr 172.21.15.1:0/15815361 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:25.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.940+0000 7fc24dd9b700 1 --2- 172.21.15.1:0/15815361 >> v2:172.21.15.141:3300/0 conn(0x7fc2500ab1a0 0x7fc250158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.940+0000 7fc24e59c700 1 -- 172.21.15.1:0/15815361 >> v2:172.21.15.141:3300/0 conn(0x7fc2500ab1a0 msgr2=0x7fc250158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:25.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.940+0000 7fc24e59c700 1 --2- 172.21.15.1:0/15815361 >> v2:172.21.15.141:3300/0 conn(0x7fc2500ab1a0 0x7fc250158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.940+0000 7fc24e59c700 1 -- 172.21.15.1:0/15815361 >> v1:172.21.15.1:6789/0 conn(0x7fc2500aa060 legacy=0x7fc2500c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.940+0000 7fc24d59a700 1 -- 172.21.15.1:0/15815361 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411557542 0 0) 0x7fc2500c06f0 con 0x7fc2500aa060 2023-11-15T01:40:25.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.940+0000 7fc24e59c700 1 -- 172.21.15.1:0/15815361 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc250158b00 con 0x7fc250154150 2023-11-15T01:40:25.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.940+0000 7fc24dd9b700 1 --2- 172.21.15.1:0/15815361 >> v2:172.21.15.141:3300/0 conn(0x7fc2500ab1a0 0x7fc250158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:40:25.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.940+0000 7fc24e59c700 1 --2- 172.21.15.1:0/15815361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc250154150 0x7fc250154530 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fc2500c0270 tx=0x7fc248009060).ready entity=mon.0 client_cookie=9e4f7e7170b10f3d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:25.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.940+0000 7fc24d59a700 1 -- 172.21.15.1:0/15815361 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2480090d0 con 0x7fc250154150 2023-11-15T01:40:25.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.940+0000 7fc24d59a700 1 -- 172.21.15.1:0/15815361 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24800b580 con 0x7fc250154150 2023-11-15T01:40:25.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.940+0000 7fc24d59a700 1 -- 172.21.15.1:0/15815361 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24800b900 con 0x7fc250154150 2023-11-15T01:40:25.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.940+0000 7fc254e50700 1 -- 172.21.15.1:0/15815361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc250154150 msgr2=0x7fc250154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.940+0000 7fc254e50700 1 --2- 172.21.15.1:0/15815361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc250154150 0x7fc250154530 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fc2500c0270 tx=0x7fc248009060).stop 2023-11-15T01:40:25.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.941+0000 7fc254e50700 1 -- 172.21.15.1:0/15815361 shutdown_connections 2023-11-15T01:40:25.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.941+0000 7fc254e50700 1 --2- 172.21.15.1:0/15815361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc250154150 0x7fc250154530 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.941+0000 7fc254e50700 1 --2- 172.21.15.1:0/15815361 >> v2:172.21.15.141:3300/0 conn(0x7fc2500ab1a0 0x7fc250158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.941+0000 7fc254e50700 1 -- 172.21.15.1:0/15815361 >> 172.21.15.1:0/15815361 conn(0x7fc250064aa0 msgr2=0x7fc250064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:25.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.941+0000 7fc254e50700 1 -- 172.21.15.1:0/15815361 shutdown_connections 2023-11-15T01:40:25.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.941+0000 7fc254e50700 1 -- 172.21.15.1:0/15815361 wait complete. 2023-11-15T01:40:25.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.942+0000 7fc254e50700 1 Processor -- start 2023-11-15T01:40:25.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.942+0000 7fc254e50700 1 -- start start 2023-11-15T01:40:25.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.942+0000 7fc254e50700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2500aa060 0x7fc250147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.942+0000 7fc254e50700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2500ab1a0 0x7fc250164880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.942+0000 7fc254e50700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc250154150 0x7fc250164d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.942+0000 7fc254e50700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc250155d00 con 0x7fc250154150 2023-11-15T01:40:25.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.942+0000 7fc254e50700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc250156250 con 0x7fc2500aa060 2023-11-15T01:40:25.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.942+0000 7fc254e50700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc250148160 con 0x7fc2500ab1a0 2023-11-15T01:40:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc24ed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc250154150 0x7fc250164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc24ed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc250154150 0x7fc250164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59270/0 (socket says 172.21.15.1:59270) 2023-11-15T01:40:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc24ed9d700 1 -- 172.21.15.1:0/308352590 learned_addr learned my addr 172.21.15.1:0/308352590 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc24e59c700 1 --2- 172.21.15.1:0/308352590 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2500aa060 0x7fc250147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc24dd9b700 1 --2- 172.21.15.1:0/308352590 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2500ab1a0 0x7fc250164880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc24ed9d700 1 -- 172.21.15.1:0/308352590 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2500ab1a0 msgr2=0x7fc250164880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc24ed9d700 1 --2- 172.21.15.1:0/308352590 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2500ab1a0 0x7fc250164880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc24ed9d700 1 -- 172.21.15.1:0/308352590 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2500aa060 msgr2=0x7fc250147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:25.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc24ed9d700 1 --2- 172.21.15.1:0/308352590 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2500aa060 0x7fc250147c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:25.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc24ed9d700 1 -- 172.21.15.1:0/308352590 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2480092a0 con 0x7fc250154150 2023-11-15T01:40:25.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc24ed9d700 1 --2- 172.21.15.1:0/308352590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc250154150 0x7fc250164d70 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fc24000c7e0 tx=0x7fc240007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:25.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc2467fc700 1 -- 172.21.15.1:0/308352590 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240005d30 con 0x7fc250154150 2023-11-15T01:40:25.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc2467fc700 1 -- 172.21.15.1:0/308352590 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc240005e90 con 0x7fc250154150 2023-11-15T01:40:25.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc254e50700 1 -- 172.21.15.1:0/308352590 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc250165370 con 0x7fc250154150 2023-11-15T01:40:25.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc2467fc700 1 -- 172.21.15.1:0/308352590 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240007320 con 0x7fc250154150 2023-11-15T01:40:25.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.943+0000 7fc254e50700 1 -- 172.21.15.1:0/308352590 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc250155ee0 con 0x7fc250154150 2023-11-15T01:40:25.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.944+0000 7fc254e50700 1 -- 172.21.15.1:0/308352590 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc250165890 con 0x7fc250154150 2023-11-15T01:40:25.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.945+0000 7fc2467fc700 1 -- 172.21.15.1:0/308352590 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc2400076d0 con 0x7fc250154150 2023-11-15T01:40:25.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.945+0000 7fc2467fc700 1 --2- 172.21.15.1:0/308352590 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc23005f270 0x7fc230061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:25.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.945+0000 7fc2467fc700 1 -- 172.21.15.1:0/308352590 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7fc24007a5e0 con 0x7fc250154150 2023-11-15T01:40:25.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.945+0000 7fc24e59c700 1 --2- 172.21.15.1:0/308352590 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc23005f270 0x7fc230061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:25.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.946+0000 7fc24e59c700 1 --2- 172.21.15.1:0/308352590 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc23005f270 0x7fc230061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc248009fd0 tx=0x7fc248017000).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:25.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:25.949+0000 7fc2467fc700 1 -- 172.21.15.1:0/308352590 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc250165890 con 0x7fc250154150 2023-11-15T01:40:26.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:26.116+0000 7fc254e50700 1 -- 172.21.15.1:0/308352590 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc250165890 con 0x7fc23005f270 2023-11-15T01:40:26.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:26.128+0000 7fc2467fc700 1 -- 172.21.15.1:0/308352590 <== mgr.6590 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361814 (secure 0 0 0) 0x7fc250165890 con 0x7fc23005f270 2023-11-15T01:40:26.133 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:26.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:26.131+0000 7fc254e50700 1 -- 172.21.15.1:0/308352590 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc23005f270 msgr2=0x7fc230061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:26.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:26.131+0000 7fc254e50700 1 --2- 172.21.15.1:0/308352590 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc23005f270 0x7fc230061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc248009fd0 tx=0x7fc248017000).stop 2023-11-15T01:40:26.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:26.132+0000 7fc254e50700 1 -- 172.21.15.1:0/308352590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc250154150 msgr2=0x7fc250164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:26.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:26.132+0000 7fc254e50700 1 --2- 172.21.15.1:0/308352590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc250154150 0x7fc250164d70 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fc24000c7e0 tx=0x7fc240007f90).stop 2023-11-15T01:40:26.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:26.132+0000 7fc254e50700 1 -- 172.21.15.1:0/308352590 shutdown_connections 2023-11-15T01:40:26.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:26.132+0000 7fc254e50700 1 --2- 172.21.15.1:0/308352590 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc23005f270 0x7fc230061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:26.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:26.132+0000 7fc254e50700 1 --2- 172.21.15.1:0/308352590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc250154150 0x7fc250164d70 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:26.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:26.132+0000 7fc254e50700 1 --2- 172.21.15.1:0/308352590 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2500aa060 0x7fc250147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:26.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:26.132+0000 7fc254e50700 1 --2- 172.21.15.1:0/308352590 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2500ab1a0 0x7fc250164880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:26.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:26.132+0000 7fc254e50700 1 -- 172.21.15.1:0/308352590 >> 172.21.15.1:0/308352590 conn(0x7fc250064aa0 msgr2=0x7fc2500c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:26.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:26.132+0000 7fc254e50700 1 -- 172.21.15.1:0/308352590 shutdown_connections 2023-11-15T01:40:26.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:26.132+0000 7fc254e50700 1 -- 172.21.15.1:0/308352590 wait complete. 2023-11-15T01:40:26.139 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:40:26.145 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T01:40:25.193311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2431456,"kb_used_data":13728,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752543264,"statfs":{"total":773094113280,"available":770604302336,"internally_reserved":0,"allocated":14057472,"data_stored":7326292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23203,"num_objects":-18,"num_object_clones":0,"num_object_copies":-36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-65,"num_write_kb":-45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.003245"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647817+0000","last_change":"2023-11-15T01:40:20.643068+0000","last_active":"2023-11-15T01:40:20.647817+0000","last_peered":"2023-11-15T01:40:20.647817+0000","last_clean":"2023-11-15T01:40:20.647817+0000","last_became_active":"2023-11-15T01:40:20.642755+0000","last_became_peered":"2023-11-15T01:40:20.642755+0000","last_unstale":"2023-11-15T01:40:20.647817+0000","last_undegraded":"2023-11-15T01:40:20.647817+0000","last_fullsized":"2023-11-15T01:40:20.647817+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"140'3","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641930+0000","last_change":"2023-11-15T01:40:20.242944+0000","last_active":"2023-11-15T01:40:20.641930+0000","last_peered":"2023-11-15T01:40:20.641930+0000","last_clean":"2023-11-15T01:40:20.641930+0000","last_became_active":"2023-11-15T01:40:20.242665+0000","last_became_peered":"2023-11-15T01:40:20.242665+0000","last_unstale":"2023-11-15T01:40:20.641930+0000","last_undegraded":"2023-11-15T01:40:20.641930+0000","last_fullsized":"2023-11-15T01:40:20.641930+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646740+0000","last_change":"2023-11-15T01:40:20.642233+0000","last_active":"2023-11-15T01:40:20.646740+0000","last_peered":"2023-11-15T01:40:20.646740+0000","last_clean":"2023-11-15T01:40:20.646740+0000","last_became_active":"2023-11-15T01:40:20.641850+0000","last_became_peered":"2023-11-15T01:40:20.641850+0000","last_unstale":"2023-11-15T01:40:20.646740+0000","last_undegraded":"2023-11-15T01:40:20.646740+0000","last_fullsized":"2023-11-15T01:40:20.646740+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625020+0000","last_change":"2023-11-15T01:40:20.245583+0000","last_active":"2023-11-15T01:40:20.625020+0000","last_peered":"2023-11-15T01:40:20.625020+0000","last_clean":"2023-11-15T01:40:20.625020+0000","last_became_active":"2023-11-15T01:40:20.245315+0000","last_became_peered":"2023-11-15T01:40:20.245315+0000","last_unstale":"2023-11-15T01:40:20.625020+0000","last_undegraded":"2023-11-15T01:40:20.625020+0000","last_fullsized":"2023-11-15T01:40:20.625020+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647364+0000","last_change":"2023-11-15T01:40:20.643893+0000","last_active":"2023-11-15T01:40:20.647364+0000","last_peered":"2023-11-15T01:40:20.647364+0000","last_clean":"2023-11-15T01:40:20.647364+0000","last_became_active":"2023-11-15T01:40:20.643255+0000","last_became_peered":"2023-11-15T01:40:20.643255+0000","last_unstale":"2023-11-15T01:40:20.647364+0000","last_undegraded":"2023-11-15T01:40:20.647364+0000","last_fullsized":"2023-11-15T01:40:20.647364+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.633975+0000","last_change":"2023-11-15T01:40:20.251469+0000","last_active":"2023-11-15T01:40:20.633975+0000","last_peered":"2023-11-15T01:40:20.633975+0000","last_clean":"2023-11-15T01:40:20.633975+0000","last_became_active":"2023-11-15T01:40:20.251211+0000","last_became_peered":"2023-11-15T01:40:20.251211+0000","last_unstale":"2023-11-15T01:40:20.633975+0000","last_undegraded":"2023-11-15T01:40:20.633975+0000","last_fullsized":"2023-11-15T01:40:20.633975+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636409+0000","last_change":"2023-11-15T01:40:20.632940+0000","last_active":"2023-11-15T01:40:20.636409+0000","last_peered":"2023-11-15T01:40:20.636409+0000","last_clean":"2023-11-15T01:40:20.636409+0000","last_became_active":"2023-11-15T01:40:20.632656+0000","last_became_peered":"2023-11-15T01:40:20.632656+0000","last_unstale":"2023-11-15T01:40:20.636409+0000","last_undegraded":"2023-11-15T01:40:20.636409+0000","last_fullsized":"2023-11-15T01:40:20.636409+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643570+0000","last_change":"2023-11-15T01:40:20.241907+0000","last_active":"2023-11-15T01:40:20.643570+0000","last_peered":"2023-11-15T01:40:20.643570+0000","last_clean":"2023-11-15T01:40:20.643570+0000","last_became_active":"2023-11-15T01:40:20.241464+0000","last_became_peered":"2023-11-15T01:40:20.241464+0000","last_unstale":"2023-11-15T01:40:20.643570+0000","last_undegraded":"2023-11-15T01:40:20.643570+0000","last_fullsized":"2023-11-15T01:40:20.643570+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.639154+0000","last_change":"2023-11-15T01:40:20.632696+0000","last_active":"2023-11-15T01:40:20.639154+0000","last_peered":"2023-11-15T01:40:20.639154+0000","last_clean":"2023-11-15T01:40:20.639154+0000","last_became_active":"2023-11-15T01:40:20.632485+0000","last_became_peered":"2023-11-15T01:40:20.632485+0000","last_unstale":"2023-11-15T01:40:20.639154+0000","last_undegraded":"2023-11-15T01:40:20.639154+0000","last_fullsized":"2023-11-15T01:40:20.639154+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.631160+0000","last_change":"2023-11-15T01:40:20.241330+0000","last_active":"2023-11-15T01:40:20.631160+0000","last_peered":"2023-11-15T01:40:20.631160+0000","last_clean":"2023-11-15T01:40:20.631160+0000","last_became_active":"2023-11-15T01:40:20.240407+0000","last_became_peered":"2023-11-15T01:40:20.240407+0000","last_unstale":"2023-11-15T01:40:20.631160+0000","last_undegraded":"2023-11-15T01:40:20.631160+0000","last_fullsized":"2023-11-15T01:40:20.631160+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.644143+0000","last_change":"2023-11-15T01:40:20.641396+0000","last_active":"2023-11-15T01:40:20.644143+0000","last_peered":"2023-11-15T01:40:20.644143+0000","last_clean":"2023-11-15T01:40:20.644143+0000","last_became_active":"2023-11-15T01:40:20.641053+0000","last_became_peered":"2023-11-15T01:40:20.641053+0000","last_unstale":"2023-11-15T01:40:20.644143+0000","last_undegraded":"2023-11-15T01:40:20.644143+0000","last_fullsized":"2023-11-15T01:40:20.644143+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.638608+0000","last_change":"2023-11-15T01:40:20.244269+0000","last_active":"2023-11-15T01:40:20.638608+0000","last_peered":"2023-11-15T01:40:20.638608+0000","last_clean":"2023-11-15T01:40:20.638608+0000","last_became_active":"2023-11-15T01:40:20.243976+0000","last_became_peered":"2023-11-15T01:40:20.243976+0000","last_unstale":"2023-11-15T01:40:20.638608+0000","last_undegraded":"2023-11-15T01:40:20.638608+0000","last_fullsized":"2023-11-15T01:40:20.638608+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640654+0000","last_change":"2023-11-15T01:40:20.638613+0000","last_active":"2023-11-15T01:40:20.640654+0000","last_peered":"2023-11-15T01:40:20.640654+0000","last_clean":"2023-11-15T01:40:20.640654+0000","last_became_active":"2023-11-15T01:40:20.638313+0000","last_became_peered":"2023-11-15T01:40:20.638313+0000","last_unstale":"2023-11-15T01:40:20.640654+0000","last_undegraded":"2023-11-15T01:40:20.640654+0000","last_fullsized":"2023-11-15T01:40:20.640654+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626158+0000","last_change":"2023-11-15T01:40:20.241409+0000","last_active":"2023-11-15T01:40:20.626158+0000","last_peered":"2023-11-15T01:40:20.626158+0000","last_clean":"2023-11-15T01:40:20.626158+0000","last_became_active":"2023-11-15T01:40:20.240944+0000","last_became_peered":"2023-11-15T01:40:20.240944+0000","last_unstale":"2023-11-15T01:40:20.626158+0000","last_undegraded":"2023-11-15T01:40:20.626158+0000","last_fullsized":"2023-11-15T01:40:20.626158+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636934+0000","last_change":"2023-11-15T01:40:20.634524+0000","last_active":"2023-11-15T01:40:20.636934+0000","last_peered":"2023-11-15T01:40:20.636934+0000","last_clean":"2023-11-15T01:40:20.636934+0000","last_became_active":"2023-11-15T01:40:20.634242+0000","last_became_peered":"2023-11-15T01:40:20.634242+0000","last_unstale":"2023-11-15T01:40:20.636934+0000","last_undegraded":"2023-11-15T01:40:20.636934+0000","last_fullsized":"2023-11-15T01:40:20.636934+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630202+0000","last_change":"2023-11-15T01:40:20.248540+0000","last_active":"2023-11-15T01:40:20.630202+0000","last_peered":"2023-11-15T01:40:20.630202+0000","last_clean":"2023-11-15T01:40:20.630202+0000","last_became_active":"2023-11-15T01:40:20.246981+0000","last_became_peered":"2023-11-15T01:40:20.246981+0000","last_unstale":"2023-11-15T01:40:20.630202+0000","last_undegraded":"2023-11-15T01:40:20.630202+0000","last_fullsized":"2023-11-15T01:40:20.630202+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645055+0000","last_change":"2023-11-15T01:40:20.642990+0000","last_active":"2023-11-15T01:40:20.645055+0000","last_peered":"2023-11-15T01:40:20.645055+0000","last_clean":"2023-11-15T01:40:20.645055+0000","last_became_active":"2023-11-15T01:40:20.642491+0000","last_became_peered":"2023-11-15T01:40:20.642491+0000","last_unstale":"2023-11-15T01:40:20.645055+0000","last_undegraded":"2023-11-15T01:40:20.645055+0000","last_fullsized":"2023-11-15T01:40:20.645055+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621002+0000","last_change":"2023-11-15T01:40:20.246917+0000","last_active":"2023-11-15T01:40:20.621002+0000","last_peered":"2023-11-15T01:40:20.621002+0000","last_clean":"2023-11-15T01:40:20.621002+0000","last_became_active":"2023-11-15T01:40:20.245824+0000","last_became_peered":"2023-11-15T01:40:20.245824+0000","last_unstale":"2023-11-15T01:40:20.621002+0000","last_undegraded":"2023-11-15T01:40:20.621002+0000","last_fullsized":"2023-11-15T01:40:20.621002+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636954+0000","last_change":"2023-11-15T01:40:20.633914+0000","last_active":"2023-11-15T01:40:20.636954+0000","last_peered":"2023-11-15T01:40:20.636954+0000","last_clean":"2023-11-15T01:40:20.636954+0000","last_became_active":"2023-11-15T01:40:20.633572+0000","last_became_peered":"2023-11-15T01:40:20.633572+0000","last_unstale":"2023-11-15T01:40:20.636954+0000","last_undegraded":"2023-11-15T01:40:20.636954+0000","last_fullsized":"2023-11-15T01:40:20.636954+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621433+0000","last_change":"2023-11-15T01:40:20.242145+0000","last_active":"2023-11-15T01:40:20.621433+0000","last_peered":"2023-11-15T01:40:20.621433+0000","last_clean":"2023-11-15T01:40:20.621433+0000","last_became_active":"2023-11-15T01:40:20.241777+0000","last_became_peered":"2023-11-15T01:40:20.241777+0000","last_unstale":"2023-11-15T01:40:20.621433+0000","last_undegraded":"2023-11-15T01:40:20.621433+0000","last_fullsized":"2023-11-15T01:40:20.621433+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.644654+0000","last_change":"2023-11-15T01:40:20.643000+0000","last_active":"2023-11-15T01:40:20.644654+0000","last_peered":"2023-11-15T01:40:20.644654+0000","last_clean":"2023-11-15T01:40:20.644654+0000","last_became_active":"2023-11-15T01:40:20.642729+0000","last_became_peered":"2023-11-15T01:40:20.642729+0000","last_unstale":"2023-11-15T01:40:20.644654+0000","last_undegraded":"2023-11-15T01:40:20.644654+0000","last_fullsized":"2023-11-15T01:40:20.644654+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624849+0000","last_change":"2023-11-15T01:40:20.241858+0000","last_active":"2023-11-15T01:40:20.624849+0000","last_peered":"2023-11-15T01:40:20.624849+0000","last_clean":"2023-11-15T01:40:20.624849+0000","last_became_active":"2023-11-15T01:40:20.241543+0000","last_became_peered":"2023-11-15T01:40:20.241543+0000","last_unstale":"2023-11-15T01:40:20.624849+0000","last_undegraded":"2023-11-15T01:40:20.624849+0000","last_fullsized":"2023-11-15T01:40:20.624849+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.649329+0000","last_change":"2023-11-15T01:40:20.648125+0000","last_active":"2023-11-15T01:40:20.649329+0000","last_peered":"2023-11-15T01:40:20.649329+0000","last_clean":"2023-11-15T01:40:20.649329+0000","last_became_active":"2023-11-15T01:40:20.647748+0000","last_became_peered":"2023-11-15T01:40:20.647748+0000","last_unstale":"2023-11-15T01:40:20.649329+0000","last_undegraded":"2023-11-15T01:40:20.649329+0000","last_fullsized":"2023-11-15T01:40:20.649329+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646769+0000","last_change":"2023-11-15T01:40:20.240545+0000","last_active":"2023-11-15T01:40:20.646769+0000","last_peered":"2023-11-15T01:40:20.646769+0000","last_clean":"2023-11-15T01:40:20.646769+0000","last_became_active":"2023-11-15T01:40:20.239042+0000","last_became_peered":"2023-11-15T01:40:20.239042+0000","last_unstale":"2023-11-15T01:40:20.646769+0000","last_undegraded":"2023-11-15T01:40:20.646769+0000","last_fullsized":"2023-11-15T01:40:20.646769+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.635197+0000","last_change":"2023-11-15T01:40:20.631387+0000","last_active":"2023-11-15T01:40:20.635197+0000","last_peered":"2023-11-15T01:40:20.635197+0000","last_clean":"2023-11-15T01:40:20.635197+0000","last_became_active":"2023-11-15T01:40:20.631109+0000","last_became_peered":"2023-11-15T01:40:20.631109+0000","last_unstale":"2023-11-15T01:40:20.635197+0000","last_undegraded":"2023-11-15T01:40:20.635197+0000","last_fullsized":"2023-11-15T01:40:20.635197+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643174+0000","last_change":"2023-11-15T01:40:20.248558+0000","last_active":"2023-11-15T01:40:20.643174+0000","last_peered":"2023-11-15T01:40:20.643174+0000","last_clean":"2023-11-15T01:40:20.643174+0000","last_became_active":"2023-11-15T01:40:20.248001+0000","last_became_peered":"2023-11-15T01:40:20.248001+0000","last_unstale":"2023-11-15T01:40:20.643174+0000","last_undegraded":"2023-11-15T01:40:20.643174+0000","last_fullsized":"2023-11-15T01:40:20.643174+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636721+0000","last_change":"2023-11-15T01:40:20.633661+0000","last_active":"2023-11-15T01:40:20.636721+0000","last_peered":"2023-11-15T01:40:20.636721+0000","last_clean":"2023-11-15T01:40:20.636721+0000","last_became_active":"2023-11-15T01:40:20.633445+0000","last_became_peered":"2023-11-15T01:40:20.633445+0000","last_unstale":"2023-11-15T01:40:20.636721+0000","last_undegraded":"2023-11-15T01:40:20.636721+0000","last_fullsized":"2023-11-15T01:40:20.636721+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630551+0000","last_change":"2023-11-15T01:40:20.250629+0000","last_active":"2023-11-15T01:40:20.630551+0000","last_peered":"2023-11-15T01:40:20.630551+0000","last_clean":"2023-11-15T01:40:20.630551+0000","last_became_active":"2023-11-15T01:40:20.250297+0000","last_became_peered":"2023-11-15T01:40:20.250297+0000","last_unstale":"2023-11-15T01:40:20.630551+0000","last_undegraded":"2023-11-15T01:40:20.630551+0000","last_fullsized":"2023-11-15T01:40:20.630551+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646676+0000","last_change":"2023-11-15T01:40:20.637875+0000","last_active":"2023-11-15T01:40:20.646676+0000","last_peered":"2023-11-15T01:40:20.646676+0000","last_clean":"2023-11-15T01:40:20.646676+0000","last_became_active":"2023-11-15T01:40:20.637585+0000","last_became_peered":"2023-11-15T01:40:20.637585+0000","last_unstale":"2023-11-15T01:40:20.646676+0000","last_undegraded":"2023-11-15T01:40:20.646676+0000","last_fullsized":"2023-11-15T01:40:20.646676+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625633+0000","last_change":"2023-11-15T01:40:20.244237+0000","last_active":"2023-11-15T01:40:20.625633+0000","last_peered":"2023-11-15T01:40:20.625633+0000","last_clean":"2023-11-15T01:40:20.625633+0000","last_became_active":"2023-11-15T01:40:20.243903+0000","last_became_peered":"2023-11-15T01:40:20.243903+0000","last_unstale":"2023-11-15T01:40:20.625633+0000","last_undegraded":"2023-11-15T01:40:20.625633+0000","last_fullsized":"2023-11-15T01:40:20.625633+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641596+0000","last_change":"2023-11-15T01:40:20.637723+0000","last_active":"2023-11-15T01:40:20.641596+0000","last_peered":"2023-11-15T01:40:20.641596+0000","last_clean":"2023-11-15T01:40:20.641596+0000","last_became_active":"2023-11-15T01:40:20.637283+0000","last_became_peered":"2023-11-15T01:40:20.637283+0000","last_unstale":"2023-11-15T01:40:20.641596+0000","last_undegraded":"2023-11-15T01:40:20.641596+0000","last_fullsized":"2023-11-15T01:40:20.641596+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643228+0000","last_change":"2023-11-15T01:40:20.247664+0000","last_active":"2023-11-15T01:40:20.643228+0000","last_peered":"2023-11-15T01:40:20.643228+0000","last_clean":"2023-11-15T01:40:20.643228+0000","last_became_active":"2023-11-15T01:40:20.247230+0000","last_became_peered":"2023-11-15T01:40:20.247230+0000","last_unstale":"2023-11-15T01:40:20.643228+0000","last_undegraded":"2023-11-15T01:40:20.643228+0000","last_fullsized":"2023-11-15T01:40:20.643228+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643756+0000","last_change":"2023-11-15T01:40:20.641306+0000","last_active":"2023-11-15T01:40:20.643756+0000","last_peered":"2023-11-15T01:40:20.643756+0000","last_clean":"2023-11-15T01:40:20.643756+0000","last_became_active":"2023-11-15T01:40:20.641035+0000","last_became_peered":"2023-11-15T01:40:20.641035+0000","last_unstale":"2023-11-15T01:40:20.643756+0000","last_undegraded":"2023-11-15T01:40:20.643756+0000","last_fullsized":"2023-11-15T01:40:20.643756+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625156+0000","last_change":"2023-11-15T01:40:20.251493+0000","last_active":"2023-11-15T01:40:20.625156+0000","last_peered":"2023-11-15T01:40:20.625156+0000","last_clean":"2023-11-15T01:40:20.625156+0000","last_became_active":"2023-11-15T01:40:20.251199+0000","last_became_peered":"2023-11-15T01:40:20.251199+0000","last_unstale":"2023-11-15T01:40:20.625156+0000","last_undegraded":"2023-11-15T01:40:20.625156+0000","last_fullsized":"2023-11-15T01:40:20.625156+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645240+0000","last_change":"2023-11-15T01:40:20.638898+0000","last_active":"2023-11-15T01:40:20.645240+0000","last_peered":"2023-11-15T01:40:20.645240+0000","last_clean":"2023-11-15T01:40:20.645240+0000","last_became_active":"2023-11-15T01:40:20.638586+0000","last_became_peered":"2023-11-15T01:40:20.638586+0000","last_unstale":"2023-11-15T01:40:20.645240+0000","last_undegraded":"2023-11-15T01:40:20.645240+0000","last_fullsized":"2023-11-15T01:40:20.645240+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623288+0000","last_change":"2023-11-15T01:40:20.241464+0000","last_active":"2023-11-15T01:40:20.623288+0000","last_peered":"2023-11-15T01:40:20.623288+0000","last_clean":"2023-11-15T01:40:20.623288+0000","last_became_active":"2023-11-15T01:40:20.241198+0000","last_became_peered":"2023-11-15T01:40:20.241198+0000","last_unstale":"2023-11-15T01:40:20.623288+0000","last_undegraded":"2023-11-15T01:40:20.623288+0000","last_fullsized":"2023-11-15T01:40:20.623288+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647379+0000","last_change":"2023-11-15T01:40:20.644058+0000","last_active":"2023-11-15T01:40:20.647379+0000","last_peered":"2023-11-15T01:40:20.647379+0000","last_clean":"2023-11-15T01:40:20.647379+0000","last_became_active":"2023-11-15T01:40:20.643626+0000","last_became_peered":"2023-11-15T01:40:20.643626+0000","last_unstale":"2023-11-15T01:40:20.647379+0000","last_undegraded":"2023-11-15T01:40:20.647379+0000","last_fullsized":"2023-11-15T01:40:20.647379+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.642845+0000","last_change":"2023-11-15T01:40:20.248972+0000","last_active":"2023-11-15T01:40:20.642845+0000","last_peered":"2023-11-15T01:40:20.642845+0000","last_clean":"2023-11-15T01:40:20.642845+0000","last_became_active":"2023-11-15T01:40:20.248254+0000","last_became_peered":"2023-11-15T01:40:20.248254+0000","last_unstale":"2023-11-15T01:40:20.642845+0000","last_undegraded":"2023-11-15T01:40:20.642845+0000","last_fullsized":"2023-11-15T01:40:20.642845+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641162+0000","last_change":"2023-11-15T01:40:20.636946+0000","last_active":"2023-11-15T01:40:20.641162+0000","last_peered":"2023-11-15T01:40:20.641162+0000","last_clean":"2023-11-15T01:40:20.641162+0000","last_became_active":"2023-11-15T01:40:20.636691+0000","last_became_peered":"2023-11-15T01:40:20.636691+0000","last_unstale":"2023-11-15T01:40:20.641162+0000","last_undegraded":"2023-11-15T01:40:20.641162+0000","last_fullsized":"2023-11-15T01:40:20.641162+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623449+0000","last_change":"2023-11-15T01:40:20.246711+0000","last_active":"2023-11-15T01:40:20.623449+0000","last_peered":"2023-11-15T01:40:20.623449+0000","last_clean":"2023-11-15T01:40:20.623449+0000","last_became_active":"2023-11-15T01:40:20.246122+0000","last_became_peered":"2023-11-15T01:40:20.246122+0000","last_unstale":"2023-11-15T01:40:20.623449+0000","last_undegraded":"2023-11-15T01:40:20.623449+0000","last_fullsized":"2023-11-15T01:40:20.623449+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640242+0000","last_change":"2023-11-15T01:40:20.636518+0000","last_active":"2023-11-15T01:40:20.640242+0000","last_peered":"2023-11-15T01:40:20.640242+0000","last_clean":"2023-11-15T01:40:20.640242+0000","last_became_active":"2023-11-15T01:40:20.636230+0000","last_became_peered":"2023-11-15T01:40:20.636230+0000","last_unstale":"2023-11-15T01:40:20.640242+0000","last_undegraded":"2023-11-15T01:40:20.640242+0000","last_fullsized":"2023-11-15T01:40:20.640242+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641958+0000","last_change":"2023-11-15T01:40:20.241698+0000","last_active":"2023-11-15T01:40:20.641958+0000","last_peered":"2023-11-15T01:40:20.641958+0000","last_clean":"2023-11-15T01:40:20.641958+0000","last_became_active":"2023-11-15T01:40:20.241234+0000","last_became_peered":"2023-11-15T01:40:20.241234+0000","last_unstale":"2023-11-15T01:40:20.641958+0000","last_undegraded":"2023-11-15T01:40:20.641958+0000","last_fullsized":"2023-11-15T01:40:20.641958+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643406+0000","last_change":"2023-11-15T01:40:20.638600+0000","last_active":"2023-11-15T01:40:20.643406+0000","last_peered":"2023-11-15T01:40:20.643406+0000","last_clean":"2023-11-15T01:40:20.643406+0000","last_became_active":"2023-11-15T01:40:20.638321+0000","last_became_peered":"2023-11-15T01:40:20.638321+0000","last_unstale":"2023-11-15T01:40:20.643406+0000","last_undegraded":"2023-11-15T01:40:20.643406+0000","last_fullsized":"2023-11-15T01:40:20.643406+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626753+0000","last_change":"2023-11-15T01:40:20.237581+0000","last_active":"2023-11-15T01:40:20.626753+0000","last_peered":"2023-11-15T01:40:20.626753+0000","last_clean":"2023-11-15T01:40:20.626753+0000","last_became_active":"2023-11-15T01:40:20.237275+0000","last_became_peered":"2023-11-15T01:40:20.237275+0000","last_unstale":"2023-11-15T01:40:20.626753+0000","last_undegraded":"2023-11-15T01:40:20.626753+0000","last_fullsized":"2023-11-15T01:40:20.626753+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.648077+0000","last_change":"2023-11-15T01:40:20.642674+0000","last_active":"2023-11-15T01:40:20.648077+0000","last_peered":"2023-11-15T01:40:20.648077+0000","last_clean":"2023-11-15T01:40:20.648077+0000","last_became_active":"2023-11-15T01:40:20.642262+0000","last_became_peered":"2023-11-15T01:40:20.642262+0000","last_unstale":"2023-11-15T01:40:20.648077+0000","last_undegraded":"2023-11-15T01:40:20.648077+0000","last_fullsized":"2023-11-15T01:40:20.648077+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623200+0000","last_change":"2023-11-15T01:40:20.244798+0000","last_active":"2023-11-15T01:40:20.623200+0000","last_peered":"2023-11-15T01:40:20.623200+0000","last_clean":"2023-11-15T01:40:20.623200+0000","last_became_active":"2023-11-15T01:40:20.244394+0000","last_became_peered":"2023-11-15T01:40:20.244394+0000","last_unstale":"2023-11-15T01:40:20.623200+0000","last_undegraded":"2023-11-15T01:40:20.623200+0000","last_fullsized":"2023-11-15T01:40:20.623200+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645638+0000","last_change":"2023-11-15T01:40:20.642368+0000","last_active":"2023-11-15T01:40:20.645638+0000","last_peered":"2023-11-15T01:40:20.645638+0000","last_clean":"2023-11-15T01:40:20.645638+0000","last_became_active":"2023-11-15T01:40:20.642012+0000","last_became_peered":"2023-11-15T01:40:20.642012+0000","last_unstale":"2023-11-15T01:40:20.645638+0000","last_undegraded":"2023-11-15T01:40:20.645638+0000","last_fullsized":"2023-11-15T01:40:20.645638+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623850+0000","last_change":"2023-11-15T01:40:20.248505+0000","last_active":"2023-11-15T01:40:20.623850+0000","last_peered":"2023-11-15T01:40:20.623850+0000","last_clean":"2023-11-15T01:40:20.623850+0000","last_became_active":"2023-11-15T01:40:20.248152+0000","last_became_peered":"2023-11-15T01:40:20.248152+0000","last_unstale":"2023-11-15T01:40:20.623850+0000","last_undegraded":"2023-11-15T01:40:20.623850+0000","last_fullsized":"2023-11-15T01:40:20.623850+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645073+0000","last_change":"2023-11-15T01:40:20.643161+0000","last_active":"2023-11-15T01:40:20.645073+0000","last_peered":"2023-11-15T01:40:20.645073+0000","last_clean":"2023-11-15T01:40:20.645073+0000","last_became_active":"2023-11-15T01:40:20.642562+0000","last_became_peered":"2023-11-15T01:40:20.642562+0000","last_unstale":"2023-11-15T01:40:20.645073+0000","last_undegraded":"2023-11-15T01:40:20.645073+0000","last_fullsized":"2023-11-15T01:40:20.645073+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625167+0000","last_change":"2023-11-15T01:40:20.242250+0000","last_active":"2023-11-15T01:40:20.625167+0000","last_peered":"2023-11-15T01:40:20.625167+0000","last_clean":"2023-11-15T01:40:20.625167+0000","last_became_active":"2023-11-15T01:40:20.242006+0000","last_became_peered":"2023-11-15T01:40:20.242006+0000","last_unstale":"2023-11-15T01:40:20.625167+0000","last_undegraded":"2023-11-15T01:40:20.625167+0000","last_fullsized":"2023-11-15T01:40:20.625167+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645367+0000","last_change":"2023-11-15T01:40:20.639227+0000","last_active":"2023-11-15T01:40:20.645367+0000","last_peered":"2023-11-15T01:40:20.645367+0000","last_clean":"2023-11-15T01:40:20.645367+0000","last_became_active":"2023-11-15T01:40:20.638956+0000","last_became_peered":"2023-11-15T01:40:20.638956+0000","last_unstale":"2023-11-15T01:40:20.645367+0000","last_undegraded":"2023-11-15T01:40:20.645367+0000","last_fullsized":"2023-11-15T01:40:20.645367+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621391+0000","last_change":"2023-11-15T01:40:20.241565+0000","last_active":"2023-11-15T01:40:20.621391+0000","last_peered":"2023-11-15T01:40:20.621391+0000","last_clean":"2023-11-15T01:40:20.621391+0000","last_became_active":"2023-11-15T01:40:20.241253+0000","last_became_peered":"2023-11-15T01:40:20.241253+0000","last_unstale":"2023-11-15T01:40:20.621391+0000","last_undegraded":"2023-11-15T01:40:20.621391+0000","last_fullsized":"2023-11-15T01:40:20.621391+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634580+0000","last_change":"2023-11-15T01:40:20.631271+0000","last_active":"2023-11-15T01:40:20.634580+0000","last_peered":"2023-11-15T01:40:20.634580+0000","last_clean":"2023-11-15T01:40:20.634580+0000","last_became_active":"2023-11-15T01:40:20.630984+0000","last_became_peered":"2023-11-15T01:40:20.630984+0000","last_unstale":"2023-11-15T01:40:20.634580+0000","last_undegraded":"2023-11-15T01:40:20.634580+0000","last_fullsized":"2023-11-15T01:40:20.634580+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625566+0000","last_change":"2023-11-15T01:40:20.245556+0000","last_active":"2023-11-15T01:40:20.625566+0000","last_peered":"2023-11-15T01:40:20.625566+0000","last_clean":"2023-11-15T01:40:20.625566+0000","last_became_active":"2023-11-15T01:40:20.245270+0000","last_became_peered":"2023-11-15T01:40:20.245270+0000","last_unstale":"2023-11-15T01:40:20.625566+0000","last_undegraded":"2023-11-15T01:40:20.625566+0000","last_fullsized":"2023-11-15T01:40:20.625566+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637960+0000","last_change":"2023-11-15T01:40:20.634050+0000","last_active":"2023-11-15T01:40:20.637960+0000","last_peered":"2023-11-15T01:40:20.637960+0000","last_clean":"2023-11-15T01:40:20.637960+0000","last_became_active":"2023-11-15T01:40:20.633782+0000","last_became_peered":"2023-11-15T01:40:20.633782+0000","last_unstale":"2023-11-15T01:40:20.637960+0000","last_undegraded":"2023-11-15T01:40:20.637960+0000","last_fullsized":"2023-11-15T01:40:20.637960+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623365+0000","last_change":"2023-11-15T01:40:20.240505+0000","last_active":"2023-11-15T01:40:20.623365+0000","last_peered":"2023-11-15T01:40:20.623365+0000","last_clean":"2023-11-15T01:40:20.623365+0000","last_became_active":"2023-11-15T01:40:20.240212+0000","last_became_peered":"2023-11-15T01:40:20.240212+0000","last_unstale":"2023-11-15T01:40:20.623365+0000","last_undegraded":"2023-11-15T01:40:20.623365+0000","last_fullsized":"2023-11-15T01:40:20.623365+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640225+0000","last_change":"2023-11-15T01:40:20.636132+0000","last_active":"2023-11-15T01:40:20.640225+0000","last_peered":"2023-11-15T01:40:20.640225+0000","last_clean":"2023-11-15T01:40:20.640225+0000","last_became_active":"2023-11-15T01:40:20.635832+0000","last_became_peered":"2023-11-15T01:40:20.635832+0000","last_unstale":"2023-11-15T01:40:20.640225+0000","last_undegraded":"2023-11-15T01:40:20.640225+0000","last_fullsized":"2023-11-15T01:40:20.640225+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623047+0000","last_change":"2023-11-15T01:40:20.246872+0000","last_active":"2023-11-15T01:40:20.623047+0000","last_peered":"2023-11-15T01:40:20.623047+0000","last_clean":"2023-11-15T01:40:20.623047+0000","last_became_active":"2023-11-15T01:40:20.246537+0000","last_became_peered":"2023-11-15T01:40:20.246537+0000","last_unstale":"2023-11-15T01:40:20.623047+0000","last_undegraded":"2023-11-15T01:40:20.623047+0000","last_fullsized":"2023-11-15T01:40:20.623047+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634263+0000","last_change":"2023-11-15T01:40:20.630681+0000","last_active":"2023-11-15T01:40:20.634263+0000","last_peered":"2023-11-15T01:40:20.634263+0000","last_clean":"2023-11-15T01:40:20.634263+0000","last_became_active":"2023-11-15T01:40:20.630373+0000","last_became_peered":"2023-11-15T01:40:20.630373+0000","last_unstale":"2023-11-15T01:40:20.634263+0000","last_undegraded":"2023-11-15T01:40:20.634263+0000","last_fullsized":"2023-11-15T01:40:20.634263+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624478+0000","last_change":"2023-11-15T01:40:20.244238+0000","last_active":"2023-11-15T01:40:20.624478+0000","last_peered":"2023-11-15T01:40:20.624478+0000","last_clean":"2023-11-15T01:40:20.624478+0000","last_became_active":"2023-11-15T01:40:20.243936+0000","last_became_peered":"2023-11-15T01:40:20.243936+0000","last_unstale":"2023-11-15T01:40:20.624478+0000","last_undegraded":"2023-11-15T01:40:20.624478+0000","last_fullsized":"2023-11-15T01:40:20.624478+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647040+0000","last_change":"2023-11-15T01:40:20.645113+0000","last_active":"2023-11-15T01:40:20.647040+0000","last_peered":"2023-11-15T01:40:20.647040+0000","last_clean":"2023-11-15T01:40:20.647040+0000","last_became_active":"2023-11-15T01:40:20.644570+0000","last_became_peered":"2023-11-15T01:40:20.644570+0000","last_unstale":"2023-11-15T01:40:20.647040+0000","last_undegraded":"2023-11-15T01:40:20.647040+0000","last_fullsized":"2023-11-15T01:40:20.647040+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.620507+0000","last_change":"2023-11-15T01:40:20.238797+0000","last_active":"2023-11-15T01:40:20.620507+0000","last_peered":"2023-11-15T01:40:20.620507+0000","last_clean":"2023-11-15T01:40:20.620507+0000","last_became_active":"2023-11-15T01:40:20.238516+0000","last_became_peered":"2023-11-15T01:40:20.238516+0000","last_unstale":"2023-11-15T01:40:20.620507+0000","last_undegraded":"2023-11-15T01:40:20.620507+0000","last_fullsized":"2023-11-15T01:40:20.620507+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.635078+0000","last_change":"2023-11-15T01:40:20.631036+0000","last_active":"2023-11-15T01:40:20.635078+0000","last_peered":"2023-11-15T01:40:20.635078+0000","last_clean":"2023-11-15T01:40:20.635078+0000","last_became_active":"2023-11-15T01:40:20.630762+0000","last_became_peered":"2023-11-15T01:40:20.630762+0000","last_unstale":"2023-11-15T01:40:20.635078+0000","last_undegraded":"2023-11-15T01:40:20.635078+0000","last_fullsized":"2023-11-15T01:40:20.635078+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625588+0000","last_change":"2023-11-15T01:40:20.244705+0000","last_active":"2023-11-15T01:40:20.625588+0000","last_peered":"2023-11-15T01:40:20.625588+0000","last_clean":"2023-11-15T01:40:20.625588+0000","last_became_active":"2023-11-15T01:40:20.244432+0000","last_became_peered":"2023-11-15T01:40:20.244432+0000","last_unstale":"2023-11-15T01:40:20.625588+0000","last_undegraded":"2023-11-15T01:40:20.625588+0000","last_fullsized":"2023-11-15T01:40:20.625588+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645095+0000","last_change":"2023-11-15T01:40:20.643897+0000","last_active":"2023-11-15T01:40:20.645095+0000","last_peered":"2023-11-15T01:40:20.645095+0000","last_clean":"2023-11-15T01:40:20.645095+0000","last_became_active":"2023-11-15T01:40:20.643619+0000","last_became_peered":"2023-11-15T01:40:20.643619+0000","last_unstale":"2023-11-15T01:40:20.645095+0000","last_undegraded":"2023-11-15T01:40:20.645095+0000","last_fullsized":"2023-11-15T01:40:20.645095+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.631561+0000","last_change":"2023-11-15T01:40:20.245866+0000","last_active":"2023-11-15T01:40:20.631561+0000","last_peered":"2023-11-15T01:40:20.631561+0000","last_clean":"2023-11-15T01:40:20.631561+0000","last_became_active":"2023-11-15T01:40:20.245176+0000","last_became_peered":"2023-11-15T01:40:20.245176+0000","last_unstale":"2023-11-15T01:40:20.631561+0000","last_undegraded":"2023-11-15T01:40:20.631561+0000","last_fullsized":"2023-11-15T01:40:20.631561+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.632732+0000","last_change":"2023-11-15T01:40:20.630832+0000","last_active":"2023-11-15T01:40:20.632732+0000","last_peered":"2023-11-15T01:40:20.632732+0000","last_clean":"2023-11-15T01:40:20.632732+0000","last_became_active":"2023-11-15T01:40:20.630527+0000","last_became_peered":"2023-11-15T01:40:20.630527+0000","last_unstale":"2023-11-15T01:40:20.632732+0000","last_undegraded":"2023-11-15T01:40:20.632732+0000","last_fullsized":"2023-11-15T01:40:20.632732+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636373+0000","last_change":"2023-11-15T01:40:20.239525+0000","last_active":"2023-11-15T01:40:20.636373+0000","last_peered":"2023-11-15T01:40:20.636373+0000","last_clean":"2023-11-15T01:40:20.636373+0000","last_became_active":"2023-11-15T01:40:20.239187+0000","last_became_peered":"2023-11-15T01:40:20.239187+0000","last_unstale":"2023-11-15T01:40:20.636373+0000","last_undegraded":"2023-11-15T01:40:20.636373+0000","last_fullsized":"2023-11-15T01:40:20.636373+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647658+0000","last_change":"2023-11-15T01:40:20.643078+0000","last_active":"2023-11-15T01:40:20.647658+0000","last_peered":"2023-11-15T01:40:20.647658+0000","last_clean":"2023-11-15T01:40:20.647658+0000","last_became_active":"2023-11-15T01:40:20.642797+0000","last_became_peered":"2023-11-15T01:40:20.642797+0000","last_unstale":"2023-11-15T01:40:20.647658+0000","last_undegraded":"2023-11-15T01:40:20.647658+0000","last_fullsized":"2023-11-15T01:40:20.647658+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.642978+0000","last_change":"2023-11-15T01:40:20.249171+0000","last_active":"2023-11-15T01:40:20.642978+0000","last_peered":"2023-11-15T01:40:20.642978+0000","last_clean":"2023-11-15T01:40:20.642978+0000","last_became_active":"2023-11-15T01:40:20.248520+0000","last_became_peered":"2023-11-15T01:40:20.248520+0000","last_unstale":"2023-11-15T01:40:20.642978+0000","last_undegraded":"2023-11-15T01:40:20.642978+0000","last_fullsized":"2023-11-15T01:40:20.642978+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.648016+0000","last_change":"2023-11-15T01:40:20.643351+0000","last_active":"2023-11-15T01:40:20.648016+0000","last_peered":"2023-11-15T01:40:20.648016+0000","last_clean":"2023-11-15T01:40:20.648016+0000","last_became_active":"2023-11-15T01:40:20.643053+0000","last_became_peered":"2023-11-15T01:40:20.643053+0000","last_unstale":"2023-11-15T01:40:20.648016+0000","last_undegraded":"2023-11-15T01:40:20.648016+0000","last_fullsized":"2023-11-15T01:40:20.648016+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626997+0000","last_change":"2023-11-15T01:40:20.244328+0000","last_active":"2023-11-15T01:40:20.626997+0000","last_peered":"2023-11-15T01:40:20.626997+0000","last_clean":"2023-11-15T01:40:20.626997+0000","last_became_active":"2023-11-15T01:40:20.243358+0000","last_became_peered":"2023-11-15T01:40:20.243358+0000","last_unstale":"2023-11-15T01:40:20.626997+0000","last_undegraded":"2023-11-15T01:40:20.626997+0000","last_fullsized":"2023-11-15T01:40:20.626997+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640451+0000","last_change":"2023-11-15T01:40:20.636332+0000","last_active":"2023-11-15T01:40:20.640451+0000","last_peered":"2023-11-15T01:40:20.640451+0000","last_clean":"2023-11-15T01:40:20.640451+0000","last_became_active":"2023-11-15T01:40:20.636042+0000","last_became_peered":"2023-11-15T01:40:20.636042+0000","last_unstale":"2023-11-15T01:40:20.640451+0000","last_undegraded":"2023-11-15T01:40:20.640451+0000","last_fullsized":"2023-11-15T01:40:20.640451+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623071+0000","last_change":"2023-11-15T01:40:20.248987+0000","last_active":"2023-11-15T01:40:20.623071+0000","last_peered":"2023-11-15T01:40:20.623071+0000","last_clean":"2023-11-15T01:40:20.623071+0000","last_became_active":"2023-11-15T01:40:20.248720+0000","last_became_peered":"2023-11-15T01:40:20.248720+0000","last_unstale":"2023-11-15T01:40:20.623071+0000","last_undegraded":"2023-11-15T01:40:20.623071+0000","last_fullsized":"2023-11-15T01:40:20.623071+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.644975+0000","last_change":"2023-11-15T01:40:20.638835+0000","last_active":"2023-11-15T01:40:20.644975+0000","last_peered":"2023-11-15T01:40:20.644975+0000","last_clean":"2023-11-15T01:40:20.644975+0000","last_became_active":"2023-11-15T01:40:20.638503+0000","last_became_peered":"2023-11-15T01:40:20.638503+0000","last_unstale":"2023-11-15T01:40:20.644975+0000","last_undegraded":"2023-11-15T01:40:20.644975+0000","last_fullsized":"2023-11-15T01:40:20.644975+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621337+0000","last_change":"2023-11-15T01:40:20.244973+0000","last_active":"2023-11-15T01:40:20.621337+0000","last_peered":"2023-11-15T01:40:20.621337+0000","last_clean":"2023-11-15T01:40:20.621337+0000","last_became_active":"2023-11-15T01:40:20.244693+0000","last_became_peered":"2023-11-15T01:40:20.244693+0000","last_unstale":"2023-11-15T01:40:20.621337+0000","last_undegraded":"2023-11-15T01:40:20.621337+0000","last_fullsized":"2023-11-15T01:40:20.621337+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646635+0000","last_change":"2023-11-15T01:40:20.637751+0000","last_active":"2023-11-15T01:40:20.646635+0000","last_peered":"2023-11-15T01:40:20.646635+0000","last_clean":"2023-11-15T01:40:20.646635+0000","last_became_active":"2023-11-15T01:40:20.637065+0000","last_became_peered":"2023-11-15T01:40:20.637065+0000","last_unstale":"2023-11-15T01:40:20.646635+0000","last_undegraded":"2023-11-15T01:40:20.646635+0000","last_fullsized":"2023-11-15T01:40:20.646635+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626264+0000","last_change":"2023-11-15T01:40:20.241275+0000","last_active":"2023-11-15T01:40:20.626264+0000","last_peered":"2023-11-15T01:40:20.626264+0000","last_clean":"2023-11-15T01:40:20.626264+0000","last_became_active":"2023-11-15T01:40:20.240634+0000","last_became_peered":"2023-11-15T01:40:20.240634+0000","last_unstale":"2023-11-15T01:40:20.626264+0000","last_undegraded":"2023-11-15T01:40:20.626264+0000","last_fullsized":"2023-11-15T01:40:20.626264+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637071+0000","last_change":"2023-11-15T01:40:20.632019+0000","last_active":"2023-11-15T01:40:20.637071+0000","last_peered":"2023-11-15T01:40:20.637071+0000","last_clean":"2023-11-15T01:40:20.637071+0000","last_became_active":"2023-11-15T01:40:20.631739+0000","last_became_peered":"2023-11-15T01:40:20.631739+0000","last_unstale":"2023-11-15T01:40:20.637071+0000","last_undegraded":"2023-11-15T01:40:20.637071+0000","last_fullsized":"2023-11-15T01:40:20.637071+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621235+0000","last_change":"2023-11-15T01:40:20.241452+0000","last_active":"2023-11-15T01:40:20.621235+0000","last_peered":"2023-11-15T01:40:20.621235+0000","last_clean":"2023-11-15T01:40:20.621235+0000","last_became_active":"2023-11-15T01:40:20.241153+0000","last_became_peered":"2023-11-15T01:40:20.241153+0000","last_unstale":"2023-11-15T01:40:20.621235+0000","last_undegraded":"2023-11-15T01:40:20.621235+0000","last_fullsized":"2023-11-15T01:40:20.621235+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647985+0000","last_change":"2023-11-15T01:40:20.644991+0000","last_active":"2023-11-15T01:40:20.647985+0000","last_peered":"2023-11-15T01:40:20.647985+0000","last_clean":"2023-11-15T01:40:20.647985+0000","last_became_active":"2023-11-15T01:40:20.644730+0000","last_became_peered":"2023-11-15T01:40:20.644730+0000","last_unstale":"2023-11-15T01:40:20.647985+0000","last_undegraded":"2023-11-15T01:40:20.647985+0000","last_fullsized":"2023-11-15T01:40:20.647985+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.642580+0000","last_change":"2023-11-15T01:40:20.240160+0000","last_active":"2023-11-15T01:40:20.642580+0000","last_peered":"2023-11-15T01:40:20.642580+0000","last_clean":"2023-11-15T01:40:20.642580+0000","last_became_active":"2023-11-15T01:40:20.239856+0000","last_became_peered":"2023-11-15T01:40:20.239856+0000","last_unstale":"2023-11-15T01:40:20.642580+0000","last_undegraded":"2023-11-15T01:40:20.642580+0000","last_fullsized":"2023-11-15T01:40:20.642580+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634603+0000","last_change":"2023-11-15T01:40:20.631436+0000","last_active":"2023-11-15T01:40:20.634603+0000","last_peered":"2023-11-15T01:40:20.634603+0000","last_clean":"2023-11-15T01:40:20.634603+0000","last_became_active":"2023-11-15T01:40:20.631020+0000","last_became_peered":"2023-11-15T01:40:20.631020+0000","last_unstale":"2023-11-15T01:40:20.634603+0000","last_undegraded":"2023-11-15T01:40:20.634603+0000","last_fullsized":"2023-11-15T01:40:20.634603+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640104+0000","last_change":"2023-11-15T01:40:20.243673+0000","last_active":"2023-11-15T01:40:20.640104+0000","last_peered":"2023-11-15T01:40:20.640104+0000","last_clean":"2023-11-15T01:40:20.640104+0000","last_became_active":"2023-11-15T01:40:20.243237+0000","last_became_peered":"2023-11-15T01:40:20.243237+0000","last_unstale":"2023-11-15T01:40:20.640104+0000","last_undegraded":"2023-11-15T01:40:20.640104+0000","last_fullsized":"2023-11-15T01:40:20.640104+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641997+0000","last_change":"2023-11-15T01:40:20.636870+0000","last_active":"2023-11-15T01:40:20.641997+0000","last_peered":"2023-11-15T01:40:20.641997+0000","last_clean":"2023-11-15T01:40:20.641997+0000","last_became_active":"2023-11-15T01:40:20.636598+0000","last_became_peered":"2023-11-15T01:40:20.636598+0000","last_unstale":"2023-11-15T01:40:20.641997+0000","last_undegraded":"2023-11-15T01:40:20.641997+0000","last_fullsized":"2023-11-15T01:40:20.641997+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634311+0000","last_change":"2023-11-15T01:40:20.249753+0000","last_active":"2023-11-15T01:40:20.634311+0000","last_peered":"2023-11-15T01:40:20.634311+0000","last_clean":"2023-11-15T01:40:20.634311+0000","last_became_active":"2023-11-15T01:40:20.249476+0000","last_became_peered":"2023-11-15T01:40:20.249476+0000","last_unstale":"2023-11-15T01:40:20.634311+0000","last_undegraded":"2023-11-15T01:40:20.634311+0000","last_fullsized":"2023-11-15T01:40:20.634311+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645086+0000","last_change":"2023-11-15T01:40:20.639606+0000","last_active":"2023-11-15T01:40:20.645086+0000","last_peered":"2023-11-15T01:40:20.645086+0000","last_clean":"2023-11-15T01:40:20.645086+0000","last_became_active":"2023-11-15T01:40:20.639330+0000","last_became_peered":"2023-11-15T01:40:20.639330+0000","last_unstale":"2023-11-15T01:40:20.645086+0000","last_undegraded":"2023-11-15T01:40:20.645086+0000","last_fullsized":"2023-11-15T01:40:20.645086+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.633537+0000","last_change":"2023-11-15T01:40:20.249519+0000","last_active":"2023-11-15T01:40:20.633537+0000","last_peered":"2023-11-15T01:40:20.633537+0000","last_clean":"2023-11-15T01:40:20.633537+0000","last_became_active":"2023-11-15T01:40:20.249242+0000","last_became_peered":"2023-11-15T01:40:20.249242+0000","last_unstale":"2023-11-15T01:40:20.633537+0000","last_undegraded":"2023-11-15T01:40:20.633537+0000","last_fullsized":"2023-11-15T01:40:20.633537+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640933+0000","last_change":"2023-11-15T01:40:20.638425+0000","last_active":"2023-11-15T01:40:20.640933+0000","last_peered":"2023-11-15T01:40:20.640933+0000","last_clean":"2023-11-15T01:40:20.640933+0000","last_became_active":"2023-11-15T01:40:20.638126+0000","last_became_peered":"2023-11-15T01:40:20.638126+0000","last_unstale":"2023-11-15T01:40:20.640933+0000","last_undegraded":"2023-11-15T01:40:20.640933+0000","last_fullsized":"2023-11-15T01:40:20.640933+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634331+0000","last_change":"2023-11-15T01:40:20.247847+0000","last_active":"2023-11-15T01:40:20.634331+0000","last_peered":"2023-11-15T01:40:20.634331+0000","last_clean":"2023-11-15T01:40:20.634331+0000","last_became_active":"2023-11-15T01:40:20.247546+0000","last_became_peered":"2023-11-15T01:40:20.247546+0000","last_unstale":"2023-11-15T01:40:20.634331+0000","last_undegraded":"2023-11-15T01:40:20.634331+0000","last_fullsized":"2023-11-15T01:40:20.634331+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.639125+0000","last_change":"2023-11-15T01:40:20.634983+0000","last_active":"2023-11-15T01:40:20.639125+0000","last_peered":"2023-11-15T01:40:20.639125+0000","last_clean":"2023-11-15T01:40:20.639125+0000","last_became_active":"2023-11-15T01:40:20.634686+0000","last_became_peered":"2023-11-15T01:40:20.634686+0000","last_unstale":"2023-11-15T01:40:20.639125+0000","last_undegraded":"2023-11-15T01:40:20.639125+0000","last_fullsized":"2023-11-15T01:40:20.639125+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630653+0000","last_change":"2023-11-15T01:40:20.251483+0000","last_active":"2023-11-15T01:40:20.630653+0000","last_peered":"2023-11-15T01:40:20.630653+0000","last_clean":"2023-11-15T01:40:20.630653+0000","last_became_active":"2023-11-15T01:40:20.251225+0000","last_became_peered":"2023-11-15T01:40:20.251225+0000","last_unstale":"2023-11-15T01:40:20.630653+0000","last_undegraded":"2023-11-15T01:40:20.630653+0000","last_fullsized":"2023-11-15T01:40:20.630653+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646657+0000","last_change":"2023-11-15T01:40:20.637803+0000","last_active":"2023-11-15T01:40:20.646657+0000","last_peered":"2023-11-15T01:40:20.646657+0000","last_clean":"2023-11-15T01:40:20.646657+0000","last_became_active":"2023-11-15T01:40:20.637531+0000","last_became_peered":"2023-11-15T01:40:20.637531+0000","last_unstale":"2023-11-15T01:40:20.646657+0000","last_undegraded":"2023-11-15T01:40:20.646657+0000","last_fullsized":"2023-11-15T01:40:20.646657+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623955+0000","last_change":"2023-11-15T01:40:20.241323+0000","last_active":"2023-11-15T01:40:20.623955+0000","last_peered":"2023-11-15T01:40:20.623955+0000","last_clean":"2023-11-15T01:40:20.623955+0000","last_became_active":"2023-11-15T01:40:20.241039+0000","last_became_peered":"2023-11-15T01:40:20.241039+0000","last_unstale":"2023-11-15T01:40:20.623955+0000","last_undegraded":"2023-11-15T01:40:20.623955+0000","last_fullsized":"2023-11-15T01:40:20.623955+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637650+0000","last_change":"2023-11-15T01:40:20.632327+0000","last_active":"2023-11-15T01:40:20.637650+0000","last_peered":"2023-11-15T01:40:20.637650+0000","last_clean":"2023-11-15T01:40:20.637650+0000","last_became_active":"2023-11-15T01:40:20.631981+0000","last_became_peered":"2023-11-15T01:40:20.631981+0000","last_unstale":"2023-11-15T01:40:20.637650+0000","last_undegraded":"2023-11-15T01:40:20.637650+0000","last_fullsized":"2023-11-15T01:40:20.637650+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630313+0000","last_change":"2023-11-15T01:40:20.248328+0000","last_active":"2023-11-15T01:40:20.630313+0000","last_peered":"2023-11-15T01:40:20.630313+0000","last_clean":"2023-11-15T01:40:20.630313+0000","last_became_active":"2023-11-15T01:40:20.247702+0000","last_became_peered":"2023-11-15T01:40:20.247702+0000","last_unstale":"2023-11-15T01:40:20.630313+0000","last_undegraded":"2023-11-15T01:40:20.630313+0000","last_fullsized":"2023-11-15T01:40:20.630313+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643154+0000","last_change":"2023-11-15T01:40:20.639732+0000","last_active":"2023-11-15T01:40:20.643154+0000","last_peered":"2023-11-15T01:40:20.643154+0000","last_clean":"2023-11-15T01:40:20.643154+0000","last_became_active":"2023-11-15T01:40:20.638787+0000","last_became_peered":"2023-11-15T01:40:20.638787+0000","last_unstale":"2023-11-15T01:40:20.643154+0000","last_undegraded":"2023-11-15T01:40:20.643154+0000","last_fullsized":"2023-11-15T01:40:20.643154+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.633299+0000","last_change":"2023-11-15T01:40:20.243269+0000","last_active":"2023-11-15T01:40:20.633299+0000","last_peered":"2023-11-15T01:40:20.633299+0000","last_clean":"2023-11-15T01:40:20.633299+0000","last_became_active":"2023-11-15T01:40:20.241757+0000","last_became_peered":"2023-11-15T01:40:20.241757+0000","last_unstale":"2023-11-15T01:40:20.633299+0000","last_undegraded":"2023-11-15T01:40:20.633299+0000","last_fullsized":"2023-11-15T01:40:20.633299+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640383+0000","last_change":"2023-11-15T01:40:20.635969+0000","last_active":"2023-11-15T01:40:20.640383+0000","last_peered":"2023-11-15T01:40:20.640383+0000","last_clean":"2023-11-15T01:40:20.640383+0000","last_became_active":"2023-11-15T01:40:20.635682+0000","last_became_peered":"2023-11-15T01:40:20.635682+0000","last_unstale":"2023-11-15T01:40:20.640383+0000","last_undegraded":"2023-11-15T01:40:20.640383+0000","last_fullsized":"2023-11-15T01:40:20.640383+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623421+0000","last_change":"2023-11-15T01:40:20.244894+0000","last_active":"2023-11-15T01:40:20.623421+0000","last_peered":"2023-11-15T01:40:20.623421+0000","last_clean":"2023-11-15T01:40:20.623421+0000","last_became_active":"2023-11-15T01:40:20.244195+0000","last_became_peered":"2023-11-15T01:40:20.244195+0000","last_unstale":"2023-11-15T01:40:20.623421+0000","last_undegraded":"2023-11-15T01:40:20.623421+0000","last_fullsized":"2023-11-15T01:40:20.623421+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647931+0000","last_change":"2023-11-15T01:40:20.644255+0000","last_active":"2023-11-15T01:40:20.647931+0000","last_peered":"2023-11-15T01:40:20.647931+0000","last_clean":"2023-11-15T01:40:20.647931+0000","last_became_active":"2023-11-15T01:40:20.643951+0000","last_became_peered":"2023-11-15T01:40:20.643951+0000","last_unstale":"2023-11-15T01:40:20.647931+0000","last_undegraded":"2023-11-15T01:40:20.647931+0000","last_fullsized":"2023-11-15T01:40:20.647931+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624405+0000","last_change":"2023-11-15T01:40:20.244674+0000","last_active":"2023-11-15T01:40:20.624405+0000","last_peered":"2023-11-15T01:40:20.624405+0000","last_clean":"2023-11-15T01:40:20.624405+0000","last_became_active":"2023-11-15T01:40:20.244188+0000","last_became_peered":"2023-11-15T01:40:20.244188+0000","last_unstale":"2023-11-15T01:40:20.624405+0000","last_undegraded":"2023-11-15T01:40:20.624405+0000","last_fullsized":"2023-11-15T01:40:20.624405+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641364+0000","last_change":"2023-11-15T01:40:20.636297+0000","last_active":"2023-11-15T01:40:20.641364+0000","last_peered":"2023-11-15T01:40:20.641364+0000","last_clean":"2023-11-15T01:40:20.641364+0000","last_became_active":"2023-11-15T01:40:20.635914+0000","last_became_peered":"2023-11-15T01:40:20.635914+0000","last_unstale":"2023-11-15T01:40:20.641364+0000","last_undegraded":"2023-11-15T01:40:20.641364+0000","last_fullsized":"2023-11-15T01:40:20.641364+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623546+0000","last_change":"2023-11-15T01:40:20.249114+0000","last_active":"2023-11-15T01:40:20.623546+0000","last_peered":"2023-11-15T01:40:20.623546+0000","last_clean":"2023-11-15T01:40:20.623546+0000","last_became_active":"2023-11-15T01:40:20.248806+0000","last_became_peered":"2023-11-15T01:40:20.248806+0000","last_unstale":"2023-11-15T01:40:20.623546+0000","last_undegraded":"2023-11-15T01:40:20.623546+0000","last_fullsized":"2023-11-15T01:40:20.623546+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640914+0000","last_change":"2023-11-15T01:40:20.634111+0000","last_active":"2023-11-15T01:40:20.640914+0000","last_peered":"2023-11-15T01:40:20.640914+0000","last_clean":"2023-11-15T01:40:20.640914+0000","last_became_active":"2023-11-15T01:40:20.633828+0000","last_became_peered":"2023-11-15T01:40:20.633828+0000","last_unstale":"2023-11-15T01:40:20.640914+0000","last_undegraded":"2023-11-15T01:40:20.640914+0000","last_fullsized":"2023-11-15T01:40:20.640914+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623178+0000","last_change":"2023-11-15T01:40:20.243830+0000","last_active":"2023-11-15T01:40:20.623178+0000","last_peered":"2023-11-15T01:40:20.623178+0000","last_clean":"2023-11-15T01:40:20.623178+0000","last_became_active":"2023-11-15T01:40:20.243522+0000","last_became_peered":"2023-11-15T01:40:20.243522+0000","last_unstale":"2023-11-15T01:40:20.623178+0000","last_undegraded":"2023-11-15T01:40:20.623178+0000","last_fullsized":"2023-11-15T01:40:20.623178+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646619+0000","last_change":"2023-11-15T01:40:20.637658+0000","last_active":"2023-11-15T01:40:20.646619+0000","last_peered":"2023-11-15T01:40:20.646619+0000","last_clean":"2023-11-15T01:40:20.646619+0000","last_became_active":"2023-11-15T01:40:20.637349+0000","last_became_peered":"2023-11-15T01:40:20.637349+0000","last_unstale":"2023-11-15T01:40:20.646619+0000","last_undegraded":"2023-11-15T01:40:20.646619+0000","last_fullsized":"2023-11-15T01:40:20.646619+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.622664+0000","last_change":"2023-11-15T01:40:20.246311+0000","last_active":"2023-11-15T01:40:20.622664+0000","last_peered":"2023-11-15T01:40:20.622664+0000","last_clean":"2023-11-15T01:40:20.622664+0000","last_became_active":"2023-11-15T01:40:20.245907+0000","last_became_peered":"2023-11-15T01:40:20.245907+0000","last_unstale":"2023-11-15T01:40:20.622664+0000","last_undegraded":"2023-11-15T01:40:20.622664+0000","last_fullsized":"2023-11-15T01:40:20.622664+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645550+0000","last_change":"2023-11-15T01:40:20.641099+0000","last_active":"2023-11-15T01:40:20.645550+0000","last_peered":"2023-11-15T01:40:20.645550+0000","last_clean":"2023-11-15T01:40:20.645550+0000","last_became_active":"2023-11-15T01:40:20.639935+0000","last_became_peered":"2023-11-15T01:40:20.639935+0000","last_unstale":"2023-11-15T01:40:20.645550+0000","last_undegraded":"2023-11-15T01:40:20.645550+0000","last_fullsized":"2023-11-15T01:40:20.645550+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.620564+0000","last_change":"2023-11-15T01:40:20.249564+0000","last_active":"2023-11-15T01:40:20.620564+0000","last_peered":"2023-11-15T01:40:20.620564+0000","last_clean":"2023-11-15T01:40:20.620564+0000","last_became_active":"2023-11-15T01:40:20.249234+0000","last_became_peered":"2023-11-15T01:40:20.249234+0000","last_unstale":"2023-11-15T01:40:20.620564+0000","last_undegraded":"2023-11-15T01:40:20.620564+0000","last_fullsized":"2023-11-15T01:40:20.620564+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641575+0000","last_change":"2023-11-15T01:40:20.637554+0000","last_active":"2023-11-15T01:40:20.641575+0000","last_peered":"2023-11-15T01:40:20.641575+0000","last_clean":"2023-11-15T01:40:20.641575+0000","last_became_active":"2023-11-15T01:40:20.636661+0000","last_became_peered":"2023-11-15T01:40:20.636661+0000","last_unstale":"2023-11-15T01:40:20.641575+0000","last_undegraded":"2023-11-15T01:40:20.641575+0000","last_fullsized":"2023-11-15T01:40:20.641575+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630434+0000","last_change":"2023-11-15T01:40:20.245202+0000","last_active":"2023-11-15T01:40:20.630434+0000","last_peered":"2023-11-15T01:40:20.630434+0000","last_clean":"2023-11-15T01:40:20.630434+0000","last_became_active":"2023-11-15T01:40:20.244906+0000","last_became_peered":"2023-11-15T01:40:20.244906+0000","last_unstale":"2023-11-15T01:40:20.630434+0000","last_undegraded":"2023-11-15T01:40:20.630434+0000","last_fullsized":"2023-11-15T01:40:20.630434+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640421+0000","last_change":"2023-11-15T01:40:20.634926+0000","last_active":"2023-11-15T01:40:20.640421+0000","last_peered":"2023-11-15T01:40:20.640421+0000","last_clean":"2023-11-15T01:40:20.640421+0000","last_became_active":"2023-11-15T01:40:20.634638+0000","last_became_peered":"2023-11-15T01:40:20.634638+0000","last_unstale":"2023-11-15T01:40:20.640421+0000","last_undegraded":"2023-11-15T01:40:20.640421+0000","last_fullsized":"2023-11-15T01:40:20.640421+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623813+0000","last_change":"2023-11-15T01:40:20.245508+0000","last_active":"2023-11-15T01:40:20.623813+0000","last_peered":"2023-11-15T01:40:20.623813+0000","last_clean":"2023-11-15T01:40:20.623813+0000","last_became_active":"2023-11-15T01:40:20.243956+0000","last_became_peered":"2023-11-15T01:40:20.243956+0000","last_unstale":"2023-11-15T01:40:20.623813+0000","last_undegraded":"2023-11-15T01:40:20.623813+0000","last_fullsized":"2023-11-15T01:40:20.623813+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626981+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:40:20.626981+0000","last_peered":"2023-11-15T01:40:20.626981+0000","last_clean":"2023-11-15T01:40:20.626981+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:40:20.626981+0000","last_undegraded":"2023-11-15T01:40:20.626981+0000","last_fullsized":"2023-11-15T01:40:20.626981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.629120+0000","last_change":"2023-11-15T01:40:20.625014+0000","last_active":"2023-11-15T01:40:20.629120+0000","last_peered":"2023-11-15T01:40:20.629120+0000","last_clean":"2023-11-15T01:40:20.629120+0000","last_became_active":"2023-11-15T01:40:20.624716+0000","last_became_peered":"2023-11-15T01:40:20.624716+0000","last_unstale":"2023-11-15T01:40:20.629120+0000","last_undegraded":"2023-11-15T01:40:20.629120+0000","last_fullsized":"2023-11-15T01:40:20.629120+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623840+0000","last_change":"2023-11-15T01:40:20.242768+0000","last_active":"2023-11-15T01:40:20.623840+0000","last_peered":"2023-11-15T01:40:20.623840+0000","last_clean":"2023-11-15T01:40:20.623840+0000","last_became_active":"2023-11-15T01:40:20.242476+0000","last_became_peered":"2023-11-15T01:40:20.242476+0000","last_unstale":"2023-11-15T01:40:20.623840+0000","last_undegraded":"2023-11-15T01:40:20.623840+0000","last_fullsized":"2023-11-15T01:40:20.623840+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624574+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:40:20.624574+0000","last_peered":"2023-11-15T01:40:20.624574+0000","last_clean":"2023-11-15T01:40:20.624574+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:40:20.624574+0000","last_undegraded":"2023-11-15T01:40:20.624574+0000","last_fullsized":"2023-11-15T01:40:20.624574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641810+0000","last_change":"2023-11-15T01:40:20.639491+0000","last_active":"2023-11-15T01:40:20.641810+0000","last_peered":"2023-11-15T01:40:20.641810+0000","last_clean":"2023-11-15T01:40:20.641810+0000","last_became_active":"2023-11-15T01:40:20.639223+0000","last_became_peered":"2023-11-15T01:40:20.639223+0000","last_unstale":"2023-11-15T01:40:20.641810+0000","last_undegraded":"2023-11-15T01:40:20.641810+0000","last_fullsized":"2023-11-15T01:40:20.641810+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.627927+0000","last_change":"2023-11-15T01:40:20.232634+0000","last_active":"2023-11-15T01:40:20.627927+0000","last_peered":"2023-11-15T01:40:20.627927+0000","last_clean":"2023-11-15T01:40:20.627927+0000","last_became_active":"2023-11-15T01:40:20.232339+0000","last_became_peered":"2023-11-15T01:40:20.232339+0000","last_unstale":"2023-11-15T01:40:20.627927+0000","last_undegraded":"2023-11-15T01:40:20.627927+0000","last_fullsized":"2023-11-15T01:40:20.627927+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":123,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.616573+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:40:20.616573+0000","last_peered":"2023-11-15T01:40:20.616573+0000","last_clean":"2023-11-15T01:40:20.616573+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:40:20.616573+0000","last_undegraded":"2023-11-15T01:40:20.616573+0000","last_fullsized":"2023-11-15T01:40:20.616573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645587+0000","last_change":"2023-11-15T01:40:20.641425+0000","last_active":"2023-11-15T01:40:20.645587+0000","last_peered":"2023-11-15T01:40:20.645587+0000","last_clean":"2023-11-15T01:40:20.645587+0000","last_became_active":"2023-11-15T01:40:20.641221+0000","last_became_peered":"2023-11-15T01:40:20.641221+0000","last_unstale":"2023-11-15T01:40:20.645587+0000","last_undegraded":"2023-11-15T01:40:20.645587+0000","last_fullsized":"2023-11-15T01:40:20.645587+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645299+0000","last_change":"2023-11-15T01:40:20.243969+0000","last_active":"2023-11-15T01:40:20.645299+0000","last_peered":"2023-11-15T01:40:20.645299+0000","last_clean":"2023-11-15T01:40:20.645299+0000","last_became_active":"2023-11-15T01:40:20.243703+0000","last_became_peered":"2023-11-15T01:40:20.243703+0000","last_unstale":"2023-11-15T01:40:20.645299+0000","last_undegraded":"2023-11-15T01:40:20.645299+0000","last_fullsized":"2023-11-15T01:40:20.645299+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.627293+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:40:20.627293+0000","last_peered":"2023-11-15T01:40:20.627293+0000","last_clean":"2023-11-15T01:40:20.627293+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:40:20.627293+0000","last_undegraded":"2023-11-15T01:40:20.627293+0000","last_fullsized":"2023-11-15T01:40:20.627293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":111,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630613+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:40:20.630613+0000","last_peered":"2023-11-15T01:40:20.630613+0000","last_clean":"2023-11-15T01:40:20.630613+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:40:20.630613+0000","last_undegraded":"2023-11-15T01:40:20.630613+0000","last_fullsized":"2023-11-15T01:40:20.630613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.638169+0000","last_change":"2023-11-15T01:40:20.633092+0000","last_active":"2023-11-15T01:40:20.638169+0000","last_peered":"2023-11-15T01:40:20.638169+0000","last_clean":"2023-11-15T01:40:20.638169+0000","last_became_active":"2023-11-15T01:40:20.632795+0000","last_became_peered":"2023-11-15T01:40:20.632795+0000","last_unstale":"2023-11-15T01:40:20.638169+0000","last_undegraded":"2023-11-15T01:40:20.638169+0000","last_fullsized":"2023-11-15T01:40:20.638169+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634086+0000","last_change":"2023-11-15T01:40:20.246780+0000","last_active":"2023-11-15T01:40:20.634086+0000","last_peered":"2023-11-15T01:40:20.634086+0000","last_clean":"2023-11-15T01:40:20.634086+0000","last_became_active":"2023-11-15T01:40:20.246469+0000","last_became_peered":"2023-11-15T01:40:20.246469+0000","last_unstale":"2023-11-15T01:40:20.634086+0000","last_undegraded":"2023-11-15T01:40:20.634086+0000","last_fullsized":"2023-11-15T01:40:20.634086+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630698+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:40:20.630698+0000","last_peered":"2023-11-15T01:40:20.630698+0000","last_clean":"2023-11-15T01:40:20.630698+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:40:20.630698+0000","last_undegraded":"2023-11-15T01:40:20.630698+0000","last_fullsized":"2023-11-15T01:40:20.630698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637913+0000","last_change":"2023-11-15T01:40:20.633216+0000","last_active":"2023-11-15T01:40:20.637913+0000","last_peered":"2023-11-15T01:40:20.637913+0000","last_clean":"2023-11-15T01:40:20.637913+0000","last_became_active":"2023-11-15T01:40:20.632940+0000","last_became_peered":"2023-11-15T01:40:20.632940+0000","last_unstale":"2023-11-15T01:40:20.637913+0000","last_undegraded":"2023-11-15T01:40:20.637913+0000","last_fullsized":"2023-11-15T01:40:20.637913+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.628043+0000","last_change":"2023-11-15T01:40:20.238543+0000","last_active":"2023-11-15T01:40:20.628043+0000","last_peered":"2023-11-15T01:40:20.628043+0000","last_clean":"2023-11-15T01:40:20.628043+0000","last_became_active":"2023-11-15T01:40:20.238077+0000","last_became_peered":"2023-11-15T01:40:20.238077+0000","last_unstale":"2023-11-15T01:40:20.628043+0000","last_undegraded":"2023-11-15T01:40:20.628043+0000","last_fullsized":"2023-11-15T01:40:20.628043+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634389+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:40:20.634389+0000","last_peered":"2023-11-15T01:40:20.634389+0000","last_clean":"2023-11-15T01:40:20.634389+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:40:20.634389+0000","last_undegraded":"2023-11-15T01:40:20.634389+0000","last_fullsized":"2023-11-15T01:40:20.634389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647346+0000","last_change":"2023-11-15T01:40:20.638187+0000","last_active":"2023-11-15T01:40:20.647346+0000","last_peered":"2023-11-15T01:40:20.647346+0000","last_clean":"2023-11-15T01:40:20.647346+0000","last_became_active":"2023-11-15T01:40:20.637942+0000","last_became_peered":"2023-11-15T01:40:20.637942+0000","last_unstale":"2023-11-15T01:40:20.647346+0000","last_undegraded":"2023-11-15T01:40:20.647346+0000","last_fullsized":"2023-11-15T01:40:20.647346+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"140'3","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645808+0000","last_change":"2023-11-15T01:40:20.247727+0000","last_active":"2023-11-15T01:40:20.645808+0000","last_peered":"2023-11-15T01:40:20.645808+0000","last_clean":"2023-11-15T01:40:20.645808+0000","last_became_active":"2023-11-15T01:40:20.247443+0000","last_became_peered":"2023-11-15T01:40:20.247443+0000","last_unstale":"2023-11-15T01:40:20.645808+0000","last_undegraded":"2023-11-15T01:40:20.645808+0000","last_fullsized":"2023-11-15T01:40:20.645808+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.628283+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:40:20.628283+0000","last_peered":"2023-11-15T01:40:20.628283+0000","last_clean":"2023-11-15T01:40:20.628283+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:40:20.628283+0000","last_undegraded":"2023-11-15T01:40:20.628283+0000","last_fullsized":"2023-11-15T01:40:20.628283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637942+0000","last_change":"2023-11-15T01:40:20.632398+0000","last_active":"2023-11-15T01:40:20.637942+0000","last_peered":"2023-11-15T01:40:20.637942+0000","last_clean":"2023-11-15T01:40:20.637942+0000","last_became_active":"2023-11-15T01:40:20.632020+0000","last_became_peered":"2023-11-15T01:40:20.632020+0000","last_unstale":"2023-11-15T01:40:20.637942+0000","last_undegraded":"2023-11-15T01:40:20.637942+0000","last_fullsized":"2023-11-15T01:40:20.637942+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646627+0000","last_change":"2023-11-15T01:40:20.242601+0000","last_active":"2023-11-15T01:40:20.646627+0000","last_peered":"2023-11-15T01:40:20.646627+0000","last_clean":"2023-11-15T01:40:20.646627+0000","last_became_active":"2023-11-15T01:40:20.242275+0000","last_became_peered":"2023-11-15T01:40:20.242275+0000","last_unstale":"2023-11-15T01:40:20.646627+0000","last_undegraded":"2023-11-15T01:40:20.646627+0000","last_fullsized":"2023-11-15T01:40:20.646627+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":128,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625034+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:40:20.625034+0000","last_peered":"2023-11-15T01:40:20.625034+0000","last_clean":"2023-11-15T01:40:20.625034+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:40:20.625034+0000","last_undegraded":"2023-11-15T01:40:20.625034+0000","last_fullsized":"2023-11-15T01:40:20.625034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575070,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302912,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068928,"statfs":{"total":96636764160,"available":96326582272,"internally_reserved":0,"allocated":1761280,"data_stored":915404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71999999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.33800000000000002,"15min":0.248},"max":{"1min":0.751,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.70699999999999996}]},{"osd":1,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.747,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.42799999999999999,"5min":0.34499999999999997,"15min":0.27500000000000002},"max":{"1min":0.76300000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.746}]},{"osd":2,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.38200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82599999999999996},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.309},"max":{"1min":0.77300000000000002,"5min":0.875,"15min":0.875},"last":0.60099999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.85999999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.373,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.80200000000000005}]},{"osd":4,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47699999999999998,"15min":0.46700000000000003},"min":{"1min":0.28399999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67400000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.437},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.316},"max":{"1min":0.77000000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52600000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.317,"5min":0.26500000000000001,"15min":0.23499999999999999},"max":{"1min":0.75,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.317,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66800000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57099999999999995}]},{"osd":6,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.82999999999999996,"15min":1.0129999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.34200000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79400000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.72799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575071,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1753088,"data_stored":915764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.42899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72499999999999998,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73099999999999998,"5min":0.77800000000000002,"15min":0.89000000000000001},"last":0.66900000000000004}]},{"osd":1,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.39000000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.83099999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.33100000000000002,"15min":0.32100000000000001},"max":{"1min":0.72999999999999998,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.69699999999999995}]},{"osd":2,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73399999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.46100000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76300000000000001,"5min":1.746,"15min":1.746},"last":0.73399999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.38,"5min":0.371,"15min":0.307},"max":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.91300000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.78400000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.68000000000000005}]},{"osd":4,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.32400000000000001,"5min":0.28899999999999998,"15min":0.26600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.52400000000000002},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.25800000000000001},"max":{"1min":0.79700000000000004,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.46800000000000003}]},{"osd":5,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76800000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.38900000000000001,"5min":0.32000000000000001,"15min":0.30399999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.82599999999999996},"last":0.49399999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.504,"15min":0.503},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.29899999999999999},"max":{"1min":0.83699999999999997,"5min":0.875,"15min":0.875},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80700000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.504}]}]},{"osd":1,"up_from":13,"seq":55834575072,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1753088,"data_stored":915232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.36099999999999999,"15min":0.376},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.24299999999999999},"max":{"1min":0.55000000000000004,"5min":0.59099999999999997,"15min":0.73699999999999999},"last":0.253},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.40200000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.35499999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.375,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58399999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42799999999999999,"15min":0.438},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.26200000000000001},"max":{"1min":0.66300000000000003,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.32600000000000001}]},{"osd":3,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.55800000000000005,"15min":0.52200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71099999999999997,"5min":9.641,"15min":9.641},"last":0.371},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53500000000000003,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.28599999999999998},"max":{"1min":0.71799999999999997,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.40000000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.45100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1,"5min":1,"15min":1},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.61599999999999999,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.90800000000000003,"5min":1.006,"15min":1.006},"last":0.56799999999999995}]},{"osd":5,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61199999999999999,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.45300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0009999999999999,"5min":1.111,"15min":1.111},"last":0.44600000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0449999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.48399999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66100000000000003,"15min":0.68799999999999994},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0169999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.67800000000000005,"15min":0.69099999999999995},"min":{"1min":0.501,"5min":0.434,"15min":0.434},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.55600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575070,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302912,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068928,"statfs":{"total":96636764160,"available":96326582272,"internally_reserved":0,"allocated":1761280,"data_stored":916678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.371},"min":{"1min":0.27300000000000002,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.495,"5min":0.54200000000000004,"15min":2.024},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.39600000000000002,"15min":0.41499999999999998},"min":{"1min":0.24399999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52200000000000002,"5min":0.64700000000000002,"15min":1.9490000000000001},"last":0.29699999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36299999999999999,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":1.768},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41299999999999998,"15min":0.437},"min":{"1min":0.28000000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":1.982},"last":0.33500000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42199999999999999,"15min":0.435},"min":{"1min":0.30199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58999999999999997,"5min":0.63100000000000001,"15min":2.0579999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.30199999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.64900000000000002,"5min":0.67900000000000005,"15min":1.7989999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40400000000000003},"max":{"1min":0.83599999999999997,"5min":1.018,"15min":1.018},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63300000000000001,"15min":0.65300000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79600000000000004,"5min":0.98899999999999999,"15min":1.7250000000000001},"last":0.64000000000000001}]},{"osd":5,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82899999999999996,"5min":0.97899999999999998,"15min":1.881},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":1.056},"last":0.72899999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.36499999999999999},"max":{"1min":0.84499999999999997,"5min":1.04,"15min":1.6830000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64700000000000002,"15min":0.67000000000000004},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90800000000000003,"5min":0.94099999999999995,"15min":1.917},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.67000000000000004,"15min":0.68700000000000006},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88100000000000001,"5min":1.0089999999999999,"15min":1.843},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.68700000000000006},"min":{"1min":0.47599999999999998,"5min":0.46999999999999997,"15min":0.40899999999999997},"max":{"1min":0.90300000000000002,"5min":1.073,"15min":1.0960000000000001},"last":0.76500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575071,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307004,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064836,"statfs":{"total":96636764160,"available":96322392064,"internally_reserved":0,"allocated":1757184,"data_stored":916172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35499999999999998,"15min":0.36599999999999999},"min":{"1min":0.248,"5min":0.186,"15min":0.186},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.61899999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56000000000000005,"5min":0.63900000000000001,"15min":0.74299999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.59199999999999997,"5min":0.745,"15min":0.745},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.58199999999999996,"5min":0.69799999999999995,"15min":0.73499999999999999},"last":0.434}]},{"osd":3,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.436,"15min":0.44900000000000001},"min":{"1min":0.32300000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53000000000000003,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.436,"15min":0.441},"min":{"1min":0.24399999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57199999999999995,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.37}]},{"osd":4,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.47299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77300000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61799999999999999,"15min":0.63300000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79000000000000004,"5min":0.91100000000000003,"15min":0.95399999999999996},"last":0.57599999999999996}]},{"osd":5,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.47899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89800000000000002,"5min":1.032,"15min":1.032},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.63500000000000001},"min":{"1min":0.47499999999999998,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":0.81200000000000006,"5min":0.96699999999999997,"15min":0.99399999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.374},"max":{"1min":0.83699999999999997,"5min":1.002,"15min":1.0389999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.64200000000000002,"15min":0.66500000000000004},"min":{"1min":0.46100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.83199999999999996,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.45400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.92200000000000004,"5min":1.079,"15min":1.079},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65600000000000003,"15min":0.68500000000000005},"min":{"1min":0.434,"5min":0.374,"15min":0.374},"max":{"1min":0.82399999999999995,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.73199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575072,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307008,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064832,"statfs":{"total":96636764160,"available":96322387968,"internally_reserved":0,"allocated":1761280,"data_stored":915888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.36399999999999999,"15min":0.374},"min":{"1min":0.27500000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.79900000000000004},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.377,"15min":0.39700000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.49199999999999999,"5min":0.60699999999999998,"15min":0.71499999999999997},"last":0.30099999999999999}]},{"osd":1,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.39000000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51500000000000001,"5min":0.63400000000000001,"15min":0.72899999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.41899999999999998,"15min":0.442},"min":{"1min":0.33000000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.56200000000000006,"5min":0.72499999999999998,"15min":0.747},"last":0.29399999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.32200000000000001,"5min":0.27300000000000002,"15min":0.23200000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.37},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.47299999999999998},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.622,"5min":0.69199999999999995,"15min":0.81999999999999995},"last":0.38100000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57599999999999996,"15min":0.60999999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84999999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60599999999999998,"15min":0.625},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":1.389,"15min":1.389},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.63100000000000001},"min":{"1min":0.47199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93600000000000005,"5min":1.512,"15min":1.512},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61399999999999999,"15min":0.63700000000000001},"min":{"1min":0.42099999999999999,"5min":0.374,"15min":0.373},"max":{"1min":0.82299999999999995,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92700000000000005,"5min":0.94199999999999995,"15min":1.0980000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.66100000000000003},"min":{"1min":0.45200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.0900000000000001},"last":0.80600000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.66400000000000003},"min":{"1min":0.443,"5min":0.39900000000000002,"15min":0.38700000000000001},"max":{"1min":0.94999999999999996,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64200000000000002,"15min":0.67600000000000005},"min":{"1min":0.48999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90600000000000003,"5min":1.069,"15min":1.1319999999999999},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575070,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302908,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068932,"statfs":{"total":96636764160,"available":96326586368,"internally_reserved":0,"allocated":1757184,"data_stored":915854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.30399999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.84499999999999997,"15min":0.88},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.749,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.68999999999999995}]},{"osd":1,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.39400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81000000000000005,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.34799999999999998,"15min":0.34699999999999998},"max":{"1min":0.68000000000000005,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.72299999999999998}]},{"osd":2,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.58499999999999996},"min":{"1min":0.373,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72199999999999998,"5min":2.887,"15min":2.887},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.45800000000000002,"5min":0.37,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":0.92300000000000004,"15min":0.96299999999999997},"last":0.55000000000000004}]},{"osd":3,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.33100000000000002},"max":{"1min":0.73399999999999999,"5min":2.464,"15min":2.464},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63400000000000001,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84799999999999998,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48599999999999999,"15min":0.46899999999999997},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68500000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.434},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.49199999999999999},"min":{"1min":0.38900000000000001,"5min":0.29899999999999999,"15min":0.27400000000000002},"max":{"1min":0.66300000000000003,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.44400000000000001}]},{"osd":6,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52300000000000002,"15min":0.495},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.28899999999999998},"max":{"1min":0.72199999999999998,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.379},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55000000000000004,"15min":0.52900000000000003},"min":{"1min":0.42599999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.47399999999999998}]},{"osd":7,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.42099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71799999999999997,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.502},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59199999999999997,"15min":0.56699999999999995},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.46200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575070,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1753088,"data_stored":915300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53100000000000003,"15min":0.54500000000000004},"min":{"1min":0.42699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.72199999999999998,"5min":0.78500000000000003,"15min":0.79200000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.78100000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.434}]},{"osd":1,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.53500000000000003,"15min":0.55900000000000005},"min":{"1min":0.35699999999999998,"5min":0.33300000000000002,"15min":0.32600000000000001},"max":{"1min":0.75,"5min":0.78500000000000003,"15min":0.83299999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.42599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.80100000000000005},"last":0.42099999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81200000000000006,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68000000000000005,"5min":0.77100000000000002,"15min":0.84599999999999997},"last":0.48699999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67900000000000005,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.5},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77600000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.29499999999999998,"5min":0.26600000000000001,"15min":0.23899999999999999},"max":{"1min":0.59299999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65500000000000003,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.52200000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.27600000000000002},"max":{"1min":0.54600000000000004,"5min":0.81599999999999995,"15min":0.83099999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63700000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46400000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.497},"min":{"1min":0.378,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.45300000000000001,"5min":0.40100000000000002,"15min":0.33600000000000002},"max":{"1min":0.71099999999999997,"5min":0.82399999999999995,"15min":0.85799999999999998},"last":0.53500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:40:29.160 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T01:40:29.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.292+0000 7f3956a14700 1 Processor -- start 2023-11-15T01:40:29.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.292+0000 7f3956a14700 1 -- start start 2023-11-15T01:40:29.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.292+0000 7f3956a14700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3950154180 0x7f3950158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:29.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.292+0000 7f3956a14700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39500aa640 0x7f39500c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:29.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.292+0000 7f3956a14700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3950064e80 con 0x7f3950154560 2023-11-15T01:40:29.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.292+0000 7f3956a14700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39501585e0 con 0x7f3950154180 2023-11-15T01:40:29.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.292+0000 7f3956a14700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39501588c0 con 0x7f39500aa640 2023-11-15T01:40:29.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.293+0000 7f394ffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3950154180 0x7f3950158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:29.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.293+0000 7f394ffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3950154180 0x7f3950158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58578/0 (socket says 172.21.15.1:58578) 2023-11-15T01:40:29.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.293+0000 7f394ffff700 1 -- 172.21.15.1:0/1451776476 learned_addr learned my addr 172.21.15.1:0/1451776476 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:29.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.293+0000 7f3954fb1700 1 --2- 172.21.15.1:0/1451776476 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39500aa640 0x7f39500c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:29.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.293+0000 7f394ffff700 1 -- 172.21.15.1:0/1451776476 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39500aa640 msgr2=0x7f39500c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:29.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.293+0000 7f394ffff700 1 --2- 172.21.15.1:0/1451776476 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39500aa640 0x7f39500c1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.293+0000 7f394ffff700 1 -- 172.21.15.1:0/1451776476 >> v1:172.21.15.141:6789/0 conn(0x7f3950154560 legacy=0x7f3950063bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:29.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.293+0000 7f394ffff700 1 -- 172.21.15.1:0/1451776476 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3950158ba0 con 0x7f3950154180 2023-11-15T01:40:29.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.293+0000 7f394ffff700 1 --2- 172.21.15.1:0/1451776476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950154180 0x7f3950158000 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f3940006fd0 tx=0x7f39400090f0).ready entity=mon.0 client_cookie=588ef533c0cdde78 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:29.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.293+0000 7f394effd700 1 -- 172.21.15.1:0/1451776476 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394000b580 con 0x7f3950154180 2023-11-15T01:40:29.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.293+0000 7f394effd700 1 -- 172.21.15.1:0/1451776476 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394000b6e0 con 0x7f3950154180 2023-11-15T01:40:29.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.293+0000 7f394effd700 1 -- 172.21.15.1:0/1451776476 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394000ba60 con 0x7f3950154180 2023-11-15T01:40:29.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.294+0000 7f3956a14700 1 -- 172.21.15.1:0/1451776476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950154180 msgr2=0x7f3950158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:29.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.294+0000 7f3956a14700 1 --2- 172.21.15.1:0/1451776476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950154180 0x7f3950158000 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f3940006fd0 tx=0x7f39400090f0).stop 2023-11-15T01:40:29.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.294+0000 7f3956a14700 1 -- 172.21.15.1:0/1451776476 shutdown_connections 2023-11-15T01:40:29.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.294+0000 7f3956a14700 1 --2- 172.21.15.1:0/1451776476 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39500aa640 0x7f39500c1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.294+0000 7f3956a14700 1 --2- 172.21.15.1:0/1451776476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950154180 0x7f3950158000 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.294+0000 7f3956a14700 1 -- 172.21.15.1:0/1451776476 >> 172.21.15.1:0/1451776476 conn(0x7f39500c74f0 msgr2=0x7f39500c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:29.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.294+0000 7f3956a14700 1 -- 172.21.15.1:0/1451776476 shutdown_connections 2023-11-15T01:40:29.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.294+0000 7f3956a14700 1 -- 172.21.15.1:0/1451776476 wait complete. 2023-11-15T01:40:29.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.295+0000 7f3956a14700 1 Processor -- start 2023-11-15T01:40:29.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.295+0000 7f3956a14700 1 -- start start 2023-11-15T01:40:29.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.296+0000 7f3956a14700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39500aa640 0x7f3950151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:29.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.296+0000 7f3956a14700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950154180 0x7f39500a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:29.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.296+0000 7f3956a14700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3950154560 0x7f39500a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:29.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.296+0000 7f3956a14700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39500a79f0 con 0x7f3950154180 2023-11-15T01:40:29.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.296+0000 7f3956a14700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3950164650 con 0x7f39500aa640 2023-11-15T01:40:29.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.296+0000 7f3956a14700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3950156100 con 0x7f3950154560 2023-11-15T01:40:29.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.296+0000 7f394f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950154180 0x7f39500a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:29.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.296+0000 7f394f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950154180 0x7f39500a4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58588/0 (socket says 172.21.15.1:58588) 2023-11-15T01:40:29.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.296+0000 7f394f7fe700 1 -- 172.21.15.1:0/841683201 learned_addr learned my addr 172.21.15.1:0/841683201 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:29.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.296+0000 7f394ffff700 1 --2- 172.21.15.1:0/841683201 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39500aa640 0x7f3950151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.296+0000 7f3954fb1700 1 --2- 172.21.15.1:0/841683201 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3950154560 0x7f39500a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.296+0000 7f394f7fe700 1 -- 172.21.15.1:0/841683201 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3950154560 msgr2=0x7f39500a5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.297+0000 7f394f7fe700 1 --2- 172.21.15.1:0/841683201 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3950154560 0x7f39500a5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.297+0000 7f394f7fe700 1 -- 172.21.15.1:0/841683201 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39500aa640 msgr2=0x7f3950151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.297+0000 7f394f7fe700 1 --2- 172.21.15.1:0/841683201 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39500aa640 0x7f3950151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.297+0000 7f394f7fe700 1 -- 172.21.15.1:0/841683201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3940009370 con 0x7f3950154180 2023-11-15T01:40:29.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.297+0000 7f394f7fe700 1 --2- 172.21.15.1:0/841683201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950154180 0x7f39500a4e00 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f394400c440 tx=0x7f3944007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:29.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.297+0000 7f3937fff700 1 -- 172.21.15.1:0/841683201 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944007020 con 0x7f3950154180 2023-11-15T01:40:29.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.297+0000 7f3937fff700 1 -- 172.21.15.1:0/841683201 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3944007180 con 0x7f3950154180 2023-11-15T01:40:29.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.297+0000 7f3956a14700 1 -- 172.21.15.1:0/841683201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39500a7bd0 con 0x7f3950154180 2023-11-15T01:40:29.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.297+0000 7f3937fff700 1 -- 172.21.15.1:0/841683201 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944007520 con 0x7f3950154180 2023-11-15T01:40:29.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.297+0000 7f3956a14700 1 -- 172.21.15.1:0/841683201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39500a8190 con 0x7f3950154180 2023-11-15T01:40:29.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.298+0000 7f3956a14700 1 -- 172.21.15.1:0/841683201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395006c7e0 con 0x7f3950154180 2023-11-15T01:40:29.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.298+0000 7f3937fff700 1 -- 172.21.15.1:0/841683201 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f39440068b0 con 0x7f3950154180 2023-11-15T01:40:29.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.299+0000 7f3937fff700 1 --2- 172.21.15.1:0/841683201 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f393c05f270 0x7f393c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:29.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.299+0000 7f3937fff700 1 -- 172.21.15.1:0/841683201 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f3944079810 con 0x7f3950154180 2023-11-15T01:40:29.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.299+0000 7f394ffff700 1 --2- 172.21.15.1:0/841683201 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f393c05f270 0x7f393c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:29.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.299+0000 7f394ffff700 1 --2- 172.21.15.1:0/841683201 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f393c05f270 0x7f393c061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3940009fd0 tx=0x7f3940017000).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:29.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.303+0000 7f3937fff700 1 -- 172.21.15.1:0/841683201 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3944047af0 con 0x7f3950154180 2023-11-15T01:40:29.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.470+0000 7f3956a14700 1 -- 172.21.15.1:0/841683201 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3950158e80 con 0x7f393c05f270 2023-11-15T01:40:29.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.480+0000 7f3937fff700 1 -- 172.21.15.1:0/841683201 <== mgr.6590 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361706 (secure 0 0 0) 0x7f3950158e80 con 0x7f393c05f270 2023-11-15T01:40:29.486 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:29.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.483+0000 7f3956a14700 1 -- 172.21.15.1:0/841683201 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f393c05f270 msgr2=0x7f393c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:29.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.483+0000 7f3956a14700 1 --2- 172.21.15.1:0/841683201 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f393c05f270 0x7f393c061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3940009fd0 tx=0x7f3940017000).stop 2023-11-15T01:40:29.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.483+0000 7f3956a14700 1 -- 172.21.15.1:0/841683201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950154180 msgr2=0x7f39500a4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:29.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.483+0000 7f3956a14700 1 --2- 172.21.15.1:0/841683201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950154180 0x7f39500a4e00 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f394400c440 tx=0x7f3944007e00).stop 2023-11-15T01:40:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.484+0000 7f3956a14700 1 -- 172.21.15.1:0/841683201 shutdown_connections 2023-11-15T01:40:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.484+0000 7f3956a14700 1 --2- 172.21.15.1:0/841683201 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f393c05f270 0x7f393c061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.484+0000 7f3956a14700 1 --2- 172.21.15.1:0/841683201 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3950154560 0x7f39500a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.484+0000 7f3956a14700 1 --2- 172.21.15.1:0/841683201 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39500aa640 0x7f3950151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.484+0000 7f3956a14700 1 --2- 172.21.15.1:0/841683201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950154180 0x7f39500a4e00 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.484+0000 7f3956a14700 1 -- 172.21.15.1:0/841683201 >> 172.21.15.1:0/841683201 conn(0x7f39500c74f0 msgr2=0x7f39500627b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:29.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.484+0000 7f3956a14700 1 -- 172.21.15.1:0/841683201 shutdown_connections 2023-11-15T01:40:29.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.484+0000 7f3956a14700 1 -- 172.21.15.1:0/841683201 wait complete. 2023-11-15T01:40:29.491 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T01:40:29.497 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-11-15T01:40:29.194412+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2431456,"kb_used_data":13728,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752543264,"statfs":{"total":773094113280,"available":770604302336,"internally_reserved":0,"allocated":14057472,"data_stored":7326292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23203,"num_objects":-17,"num_object_clones":0,"num_object_copies":-34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-64,"num_write_kb":-45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004347"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647817+0000","last_change":"2023-11-15T01:40:20.643068+0000","last_active":"2023-11-15T01:40:20.647817+0000","last_peered":"2023-11-15T01:40:20.647817+0000","last_clean":"2023-11-15T01:40:20.647817+0000","last_became_active":"2023-11-15T01:40:20.642755+0000","last_became_peered":"2023-11-15T01:40:20.642755+0000","last_unstale":"2023-11-15T01:40:20.647817+0000","last_undegraded":"2023-11-15T01:40:20.647817+0000","last_fullsized":"2023-11-15T01:40:20.647817+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"140'3","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641930+0000","last_change":"2023-11-15T01:40:20.242944+0000","last_active":"2023-11-15T01:40:20.641930+0000","last_peered":"2023-11-15T01:40:20.641930+0000","last_clean":"2023-11-15T01:40:20.641930+0000","last_became_active":"2023-11-15T01:40:20.242665+0000","last_became_peered":"2023-11-15T01:40:20.242665+0000","last_unstale":"2023-11-15T01:40:20.641930+0000","last_undegraded":"2023-11-15T01:40:20.641930+0000","last_fullsized":"2023-11-15T01:40:20.641930+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646740+0000","last_change":"2023-11-15T01:40:20.642233+0000","last_active":"2023-11-15T01:40:20.646740+0000","last_peered":"2023-11-15T01:40:20.646740+0000","last_clean":"2023-11-15T01:40:20.646740+0000","last_became_active":"2023-11-15T01:40:20.641850+0000","last_became_peered":"2023-11-15T01:40:20.641850+0000","last_unstale":"2023-11-15T01:40:20.646740+0000","last_undegraded":"2023-11-15T01:40:20.646740+0000","last_fullsized":"2023-11-15T01:40:20.646740+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625020+0000","last_change":"2023-11-15T01:40:20.245583+0000","last_active":"2023-11-15T01:40:20.625020+0000","last_peered":"2023-11-15T01:40:20.625020+0000","last_clean":"2023-11-15T01:40:20.625020+0000","last_became_active":"2023-11-15T01:40:20.245315+0000","last_became_peered":"2023-11-15T01:40:20.245315+0000","last_unstale":"2023-11-15T01:40:20.625020+0000","last_undegraded":"2023-11-15T01:40:20.625020+0000","last_fullsized":"2023-11-15T01:40:20.625020+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647364+0000","last_change":"2023-11-15T01:40:20.643893+0000","last_active":"2023-11-15T01:40:20.647364+0000","last_peered":"2023-11-15T01:40:20.647364+0000","last_clean":"2023-11-15T01:40:20.647364+0000","last_became_active":"2023-11-15T01:40:20.643255+0000","last_became_peered":"2023-11-15T01:40:20.643255+0000","last_unstale":"2023-11-15T01:40:20.647364+0000","last_undegraded":"2023-11-15T01:40:20.647364+0000","last_fullsized":"2023-11-15T01:40:20.647364+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.633975+0000","last_change":"2023-11-15T01:40:20.251469+0000","last_active":"2023-11-15T01:40:20.633975+0000","last_peered":"2023-11-15T01:40:20.633975+0000","last_clean":"2023-11-15T01:40:20.633975+0000","last_became_active":"2023-11-15T01:40:20.251211+0000","last_became_peered":"2023-11-15T01:40:20.251211+0000","last_unstale":"2023-11-15T01:40:20.633975+0000","last_undegraded":"2023-11-15T01:40:20.633975+0000","last_fullsized":"2023-11-15T01:40:20.633975+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636409+0000","last_change":"2023-11-15T01:40:20.632940+0000","last_active":"2023-11-15T01:40:20.636409+0000","last_peered":"2023-11-15T01:40:20.636409+0000","last_clean":"2023-11-15T01:40:20.636409+0000","last_became_active":"2023-11-15T01:40:20.632656+0000","last_became_peered":"2023-11-15T01:40:20.632656+0000","last_unstale":"2023-11-15T01:40:20.636409+0000","last_undegraded":"2023-11-15T01:40:20.636409+0000","last_fullsized":"2023-11-15T01:40:20.636409+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643570+0000","last_change":"2023-11-15T01:40:20.241907+0000","last_active":"2023-11-15T01:40:20.643570+0000","last_peered":"2023-11-15T01:40:20.643570+0000","last_clean":"2023-11-15T01:40:20.643570+0000","last_became_active":"2023-11-15T01:40:20.241464+0000","last_became_peered":"2023-11-15T01:40:20.241464+0000","last_unstale":"2023-11-15T01:40:20.643570+0000","last_undegraded":"2023-11-15T01:40:20.643570+0000","last_fullsized":"2023-11-15T01:40:20.643570+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.639154+0000","last_change":"2023-11-15T01:40:20.632696+0000","last_active":"2023-11-15T01:40:20.639154+0000","last_peered":"2023-11-15T01:40:20.639154+0000","last_clean":"2023-11-15T01:40:20.639154+0000","last_became_active":"2023-11-15T01:40:20.632485+0000","last_became_peered":"2023-11-15T01:40:20.632485+0000","last_unstale":"2023-11-15T01:40:20.639154+0000","last_undegraded":"2023-11-15T01:40:20.639154+0000","last_fullsized":"2023-11-15T01:40:20.639154+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.631160+0000","last_change":"2023-11-15T01:40:20.241330+0000","last_active":"2023-11-15T01:40:20.631160+0000","last_peered":"2023-11-15T01:40:20.631160+0000","last_clean":"2023-11-15T01:40:20.631160+0000","last_became_active":"2023-11-15T01:40:20.240407+0000","last_became_peered":"2023-11-15T01:40:20.240407+0000","last_unstale":"2023-11-15T01:40:20.631160+0000","last_undegraded":"2023-11-15T01:40:20.631160+0000","last_fullsized":"2023-11-15T01:40:20.631160+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.644143+0000","last_change":"2023-11-15T01:40:20.641396+0000","last_active":"2023-11-15T01:40:20.644143+0000","last_peered":"2023-11-15T01:40:20.644143+0000","last_clean":"2023-11-15T01:40:20.644143+0000","last_became_active":"2023-11-15T01:40:20.641053+0000","last_became_peered":"2023-11-15T01:40:20.641053+0000","last_unstale":"2023-11-15T01:40:20.644143+0000","last_undegraded":"2023-11-15T01:40:20.644143+0000","last_fullsized":"2023-11-15T01:40:20.644143+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.638608+0000","last_change":"2023-11-15T01:40:20.244269+0000","last_active":"2023-11-15T01:40:20.638608+0000","last_peered":"2023-11-15T01:40:20.638608+0000","last_clean":"2023-11-15T01:40:20.638608+0000","last_became_active":"2023-11-15T01:40:20.243976+0000","last_became_peered":"2023-11-15T01:40:20.243976+0000","last_unstale":"2023-11-15T01:40:20.638608+0000","last_undegraded":"2023-11-15T01:40:20.638608+0000","last_fullsized":"2023-11-15T01:40:20.638608+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640654+0000","last_change":"2023-11-15T01:40:20.638613+0000","last_active":"2023-11-15T01:40:20.640654+0000","last_peered":"2023-11-15T01:40:20.640654+0000","last_clean":"2023-11-15T01:40:20.640654+0000","last_became_active":"2023-11-15T01:40:20.638313+0000","last_became_peered":"2023-11-15T01:40:20.638313+0000","last_unstale":"2023-11-15T01:40:20.640654+0000","last_undegraded":"2023-11-15T01:40:20.640654+0000","last_fullsized":"2023-11-15T01:40:20.640654+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626158+0000","last_change":"2023-11-15T01:40:20.241409+0000","last_active":"2023-11-15T01:40:20.626158+0000","last_peered":"2023-11-15T01:40:20.626158+0000","last_clean":"2023-11-15T01:40:20.626158+0000","last_became_active":"2023-11-15T01:40:20.240944+0000","last_became_peered":"2023-11-15T01:40:20.240944+0000","last_unstale":"2023-11-15T01:40:20.626158+0000","last_undegraded":"2023-11-15T01:40:20.626158+0000","last_fullsized":"2023-11-15T01:40:20.626158+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636934+0000","last_change":"2023-11-15T01:40:20.634524+0000","last_active":"2023-11-15T01:40:20.636934+0000","last_peered":"2023-11-15T01:40:20.636934+0000","last_clean":"2023-11-15T01:40:20.636934+0000","last_became_active":"2023-11-15T01:40:20.634242+0000","last_became_peered":"2023-11-15T01:40:20.634242+0000","last_unstale":"2023-11-15T01:40:20.636934+0000","last_undegraded":"2023-11-15T01:40:20.636934+0000","last_fullsized":"2023-11-15T01:40:20.636934+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630202+0000","last_change":"2023-11-15T01:40:20.248540+0000","last_active":"2023-11-15T01:40:20.630202+0000","last_peered":"2023-11-15T01:40:20.630202+0000","last_clean":"2023-11-15T01:40:20.630202+0000","last_became_active":"2023-11-15T01:40:20.246981+0000","last_became_peered":"2023-11-15T01:40:20.246981+0000","last_unstale":"2023-11-15T01:40:20.630202+0000","last_undegraded":"2023-11-15T01:40:20.630202+0000","last_fullsized":"2023-11-15T01:40:20.630202+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645055+0000","last_change":"2023-11-15T01:40:20.642990+0000","last_active":"2023-11-15T01:40:20.645055+0000","last_peered":"2023-11-15T01:40:20.645055+0000","last_clean":"2023-11-15T01:40:20.645055+0000","last_became_active":"2023-11-15T01:40:20.642491+0000","last_became_peered":"2023-11-15T01:40:20.642491+0000","last_unstale":"2023-11-15T01:40:20.645055+0000","last_undegraded":"2023-11-15T01:40:20.645055+0000","last_fullsized":"2023-11-15T01:40:20.645055+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621002+0000","last_change":"2023-11-15T01:40:20.246917+0000","last_active":"2023-11-15T01:40:20.621002+0000","last_peered":"2023-11-15T01:40:20.621002+0000","last_clean":"2023-11-15T01:40:20.621002+0000","last_became_active":"2023-11-15T01:40:20.245824+0000","last_became_peered":"2023-11-15T01:40:20.245824+0000","last_unstale":"2023-11-15T01:40:20.621002+0000","last_undegraded":"2023-11-15T01:40:20.621002+0000","last_fullsized":"2023-11-15T01:40:20.621002+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636954+0000","last_change":"2023-11-15T01:40:20.633914+0000","last_active":"2023-11-15T01:40:20.636954+0000","last_peered":"2023-11-15T01:40:20.636954+0000","last_clean":"2023-11-15T01:40:20.636954+0000","last_became_active":"2023-11-15T01:40:20.633572+0000","last_became_peered":"2023-11-15T01:40:20.633572+0000","last_unstale":"2023-11-15T01:40:20.636954+0000","last_undegraded":"2023-11-15T01:40:20.636954+0000","last_fullsized":"2023-11-15T01:40:20.636954+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621433+0000","last_change":"2023-11-15T01:40:20.242145+0000","last_active":"2023-11-15T01:40:20.621433+0000","last_peered":"2023-11-15T01:40:20.621433+0000","last_clean":"2023-11-15T01:40:20.621433+0000","last_became_active":"2023-11-15T01:40:20.241777+0000","last_became_peered":"2023-11-15T01:40:20.241777+0000","last_unstale":"2023-11-15T01:40:20.621433+0000","last_undegraded":"2023-11-15T01:40:20.621433+0000","last_fullsized":"2023-11-15T01:40:20.621433+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.644654+0000","last_change":"2023-11-15T01:40:20.643000+0000","last_active":"2023-11-15T01:40:20.644654+0000","last_peered":"2023-11-15T01:40:20.644654+0000","last_clean":"2023-11-15T01:40:20.644654+0000","last_became_active":"2023-11-15T01:40:20.642729+0000","last_became_peered":"2023-11-15T01:40:20.642729+0000","last_unstale":"2023-11-15T01:40:20.644654+0000","last_undegraded":"2023-11-15T01:40:20.644654+0000","last_fullsized":"2023-11-15T01:40:20.644654+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624849+0000","last_change":"2023-11-15T01:40:20.241858+0000","last_active":"2023-11-15T01:40:20.624849+0000","last_peered":"2023-11-15T01:40:20.624849+0000","last_clean":"2023-11-15T01:40:20.624849+0000","last_became_active":"2023-11-15T01:40:20.241543+0000","last_became_peered":"2023-11-15T01:40:20.241543+0000","last_unstale":"2023-11-15T01:40:20.624849+0000","last_undegraded":"2023-11-15T01:40:20.624849+0000","last_fullsized":"2023-11-15T01:40:20.624849+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.649329+0000","last_change":"2023-11-15T01:40:20.648125+0000","last_active":"2023-11-15T01:40:20.649329+0000","last_peered":"2023-11-15T01:40:20.649329+0000","last_clean":"2023-11-15T01:40:20.649329+0000","last_became_active":"2023-11-15T01:40:20.647748+0000","last_became_peered":"2023-11-15T01:40:20.647748+0000","last_unstale":"2023-11-15T01:40:20.649329+0000","last_undegraded":"2023-11-15T01:40:20.649329+0000","last_fullsized":"2023-11-15T01:40:20.649329+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646769+0000","last_change":"2023-11-15T01:40:20.240545+0000","last_active":"2023-11-15T01:40:20.646769+0000","last_peered":"2023-11-15T01:40:20.646769+0000","last_clean":"2023-11-15T01:40:20.646769+0000","last_became_active":"2023-11-15T01:40:20.239042+0000","last_became_peered":"2023-11-15T01:40:20.239042+0000","last_unstale":"2023-11-15T01:40:20.646769+0000","last_undegraded":"2023-11-15T01:40:20.646769+0000","last_fullsized":"2023-11-15T01:40:20.646769+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.635197+0000","last_change":"2023-11-15T01:40:20.631387+0000","last_active":"2023-11-15T01:40:20.635197+0000","last_peered":"2023-11-15T01:40:20.635197+0000","last_clean":"2023-11-15T01:40:20.635197+0000","last_became_active":"2023-11-15T01:40:20.631109+0000","last_became_peered":"2023-11-15T01:40:20.631109+0000","last_unstale":"2023-11-15T01:40:20.635197+0000","last_undegraded":"2023-11-15T01:40:20.635197+0000","last_fullsized":"2023-11-15T01:40:20.635197+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643174+0000","last_change":"2023-11-15T01:40:20.248558+0000","last_active":"2023-11-15T01:40:20.643174+0000","last_peered":"2023-11-15T01:40:20.643174+0000","last_clean":"2023-11-15T01:40:20.643174+0000","last_became_active":"2023-11-15T01:40:20.248001+0000","last_became_peered":"2023-11-15T01:40:20.248001+0000","last_unstale":"2023-11-15T01:40:20.643174+0000","last_undegraded":"2023-11-15T01:40:20.643174+0000","last_fullsized":"2023-11-15T01:40:20.643174+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636721+0000","last_change":"2023-11-15T01:40:20.633661+0000","last_active":"2023-11-15T01:40:20.636721+0000","last_peered":"2023-11-15T01:40:20.636721+0000","last_clean":"2023-11-15T01:40:20.636721+0000","last_became_active":"2023-11-15T01:40:20.633445+0000","last_became_peered":"2023-11-15T01:40:20.633445+0000","last_unstale":"2023-11-15T01:40:20.636721+0000","last_undegraded":"2023-11-15T01:40:20.636721+0000","last_fullsized":"2023-11-15T01:40:20.636721+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630551+0000","last_change":"2023-11-15T01:40:20.250629+0000","last_active":"2023-11-15T01:40:20.630551+0000","last_peered":"2023-11-15T01:40:20.630551+0000","last_clean":"2023-11-15T01:40:20.630551+0000","last_became_active":"2023-11-15T01:40:20.250297+0000","last_became_peered":"2023-11-15T01:40:20.250297+0000","last_unstale":"2023-11-15T01:40:20.630551+0000","last_undegraded":"2023-11-15T01:40:20.630551+0000","last_fullsized":"2023-11-15T01:40:20.630551+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646676+0000","last_change":"2023-11-15T01:40:20.637875+0000","last_active":"2023-11-15T01:40:20.646676+0000","last_peered":"2023-11-15T01:40:20.646676+0000","last_clean":"2023-11-15T01:40:20.646676+0000","last_became_active":"2023-11-15T01:40:20.637585+0000","last_became_peered":"2023-11-15T01:40:20.637585+0000","last_unstale":"2023-11-15T01:40:20.646676+0000","last_undegraded":"2023-11-15T01:40:20.646676+0000","last_fullsized":"2023-11-15T01:40:20.646676+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625633+0000","last_change":"2023-11-15T01:40:20.244237+0000","last_active":"2023-11-15T01:40:20.625633+0000","last_peered":"2023-11-15T01:40:20.625633+0000","last_clean":"2023-11-15T01:40:20.625633+0000","last_became_active":"2023-11-15T01:40:20.243903+0000","last_became_peered":"2023-11-15T01:40:20.243903+0000","last_unstale":"2023-11-15T01:40:20.625633+0000","last_undegraded":"2023-11-15T01:40:20.625633+0000","last_fullsized":"2023-11-15T01:40:20.625633+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641596+0000","last_change":"2023-11-15T01:40:20.637723+0000","last_active":"2023-11-15T01:40:20.641596+0000","last_peered":"2023-11-15T01:40:20.641596+0000","last_clean":"2023-11-15T01:40:20.641596+0000","last_became_active":"2023-11-15T01:40:20.637283+0000","last_became_peered":"2023-11-15T01:40:20.637283+0000","last_unstale":"2023-11-15T01:40:20.641596+0000","last_undegraded":"2023-11-15T01:40:20.641596+0000","last_fullsized":"2023-11-15T01:40:20.641596+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643228+0000","last_change":"2023-11-15T01:40:20.247664+0000","last_active":"2023-11-15T01:40:20.643228+0000","last_peered":"2023-11-15T01:40:20.643228+0000","last_clean":"2023-11-15T01:40:20.643228+0000","last_became_active":"2023-11-15T01:40:20.247230+0000","last_became_peered":"2023-11-15T01:40:20.247230+0000","last_unstale":"2023-11-15T01:40:20.643228+0000","last_undegraded":"2023-11-15T01:40:20.643228+0000","last_fullsized":"2023-11-15T01:40:20.643228+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643756+0000","last_change":"2023-11-15T01:40:20.641306+0000","last_active":"2023-11-15T01:40:20.643756+0000","last_peered":"2023-11-15T01:40:20.643756+0000","last_clean":"2023-11-15T01:40:20.643756+0000","last_became_active":"2023-11-15T01:40:20.641035+0000","last_became_peered":"2023-11-15T01:40:20.641035+0000","last_unstale":"2023-11-15T01:40:20.643756+0000","last_undegraded":"2023-11-15T01:40:20.643756+0000","last_fullsized":"2023-11-15T01:40:20.643756+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625156+0000","last_change":"2023-11-15T01:40:20.251493+0000","last_active":"2023-11-15T01:40:20.625156+0000","last_peered":"2023-11-15T01:40:20.625156+0000","last_clean":"2023-11-15T01:40:20.625156+0000","last_became_active":"2023-11-15T01:40:20.251199+0000","last_became_peered":"2023-11-15T01:40:20.251199+0000","last_unstale":"2023-11-15T01:40:20.625156+0000","last_undegraded":"2023-11-15T01:40:20.625156+0000","last_fullsized":"2023-11-15T01:40:20.625156+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645240+0000","last_change":"2023-11-15T01:40:20.638898+0000","last_active":"2023-11-15T01:40:20.645240+0000","last_peered":"2023-11-15T01:40:20.645240+0000","last_clean":"2023-11-15T01:40:20.645240+0000","last_became_active":"2023-11-15T01:40:20.638586+0000","last_became_peered":"2023-11-15T01:40:20.638586+0000","last_unstale":"2023-11-15T01:40:20.645240+0000","last_undegraded":"2023-11-15T01:40:20.645240+0000","last_fullsized":"2023-11-15T01:40:20.645240+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623288+0000","last_change":"2023-11-15T01:40:20.241464+0000","last_active":"2023-11-15T01:40:20.623288+0000","last_peered":"2023-11-15T01:40:20.623288+0000","last_clean":"2023-11-15T01:40:20.623288+0000","last_became_active":"2023-11-15T01:40:20.241198+0000","last_became_peered":"2023-11-15T01:40:20.241198+0000","last_unstale":"2023-11-15T01:40:20.623288+0000","last_undegraded":"2023-11-15T01:40:20.623288+0000","last_fullsized":"2023-11-15T01:40:20.623288+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647379+0000","last_change":"2023-11-15T01:40:20.644058+0000","last_active":"2023-11-15T01:40:20.647379+0000","last_peered":"2023-11-15T01:40:20.647379+0000","last_clean":"2023-11-15T01:40:20.647379+0000","last_became_active":"2023-11-15T01:40:20.643626+0000","last_became_peered":"2023-11-15T01:40:20.643626+0000","last_unstale":"2023-11-15T01:40:20.647379+0000","last_undegraded":"2023-11-15T01:40:20.647379+0000","last_fullsized":"2023-11-15T01:40:20.647379+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.642845+0000","last_change":"2023-11-15T01:40:20.248972+0000","last_active":"2023-11-15T01:40:20.642845+0000","last_peered":"2023-11-15T01:40:20.642845+0000","last_clean":"2023-11-15T01:40:20.642845+0000","last_became_active":"2023-11-15T01:40:20.248254+0000","last_became_peered":"2023-11-15T01:40:20.248254+0000","last_unstale":"2023-11-15T01:40:20.642845+0000","last_undegraded":"2023-11-15T01:40:20.642845+0000","last_fullsized":"2023-11-15T01:40:20.642845+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641162+0000","last_change":"2023-11-15T01:40:20.636946+0000","last_active":"2023-11-15T01:40:20.641162+0000","last_peered":"2023-11-15T01:40:20.641162+0000","last_clean":"2023-11-15T01:40:20.641162+0000","last_became_active":"2023-11-15T01:40:20.636691+0000","last_became_peered":"2023-11-15T01:40:20.636691+0000","last_unstale":"2023-11-15T01:40:20.641162+0000","last_undegraded":"2023-11-15T01:40:20.641162+0000","last_fullsized":"2023-11-15T01:40:20.641162+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623449+0000","last_change":"2023-11-15T01:40:20.246711+0000","last_active":"2023-11-15T01:40:20.623449+0000","last_peered":"2023-11-15T01:40:20.623449+0000","last_clean":"2023-11-15T01:40:20.623449+0000","last_became_active":"2023-11-15T01:40:20.246122+0000","last_became_peered":"2023-11-15T01:40:20.246122+0000","last_unstale":"2023-11-15T01:40:20.623449+0000","last_undegraded":"2023-11-15T01:40:20.623449+0000","last_fullsized":"2023-11-15T01:40:20.623449+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640242+0000","last_change":"2023-11-15T01:40:20.636518+0000","last_active":"2023-11-15T01:40:20.640242+0000","last_peered":"2023-11-15T01:40:20.640242+0000","last_clean":"2023-11-15T01:40:20.640242+0000","last_became_active":"2023-11-15T01:40:20.636230+0000","last_became_peered":"2023-11-15T01:40:20.636230+0000","last_unstale":"2023-11-15T01:40:20.640242+0000","last_undegraded":"2023-11-15T01:40:20.640242+0000","last_fullsized":"2023-11-15T01:40:20.640242+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641958+0000","last_change":"2023-11-15T01:40:20.241698+0000","last_active":"2023-11-15T01:40:20.641958+0000","last_peered":"2023-11-15T01:40:20.641958+0000","last_clean":"2023-11-15T01:40:20.641958+0000","last_became_active":"2023-11-15T01:40:20.241234+0000","last_became_peered":"2023-11-15T01:40:20.241234+0000","last_unstale":"2023-11-15T01:40:20.641958+0000","last_undegraded":"2023-11-15T01:40:20.641958+0000","last_fullsized":"2023-11-15T01:40:20.641958+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643406+0000","last_change":"2023-11-15T01:40:20.638600+0000","last_active":"2023-11-15T01:40:20.643406+0000","last_peered":"2023-11-15T01:40:20.643406+0000","last_clean":"2023-11-15T01:40:20.643406+0000","last_became_active":"2023-11-15T01:40:20.638321+0000","last_became_peered":"2023-11-15T01:40:20.638321+0000","last_unstale":"2023-11-15T01:40:20.643406+0000","last_undegraded":"2023-11-15T01:40:20.643406+0000","last_fullsized":"2023-11-15T01:40:20.643406+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626753+0000","last_change":"2023-11-15T01:40:20.237581+0000","last_active":"2023-11-15T01:40:20.626753+0000","last_peered":"2023-11-15T01:40:20.626753+0000","last_clean":"2023-11-15T01:40:20.626753+0000","last_became_active":"2023-11-15T01:40:20.237275+0000","last_became_peered":"2023-11-15T01:40:20.237275+0000","last_unstale":"2023-11-15T01:40:20.626753+0000","last_undegraded":"2023-11-15T01:40:20.626753+0000","last_fullsized":"2023-11-15T01:40:20.626753+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.648077+0000","last_change":"2023-11-15T01:40:20.642674+0000","last_active":"2023-11-15T01:40:20.648077+0000","last_peered":"2023-11-15T01:40:20.648077+0000","last_clean":"2023-11-15T01:40:20.648077+0000","last_became_active":"2023-11-15T01:40:20.642262+0000","last_became_peered":"2023-11-15T01:40:20.642262+0000","last_unstale":"2023-11-15T01:40:20.648077+0000","last_undegraded":"2023-11-15T01:40:20.648077+0000","last_fullsized":"2023-11-15T01:40:20.648077+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623200+0000","last_change":"2023-11-15T01:40:20.244798+0000","last_active":"2023-11-15T01:40:20.623200+0000","last_peered":"2023-11-15T01:40:20.623200+0000","last_clean":"2023-11-15T01:40:20.623200+0000","last_became_active":"2023-11-15T01:40:20.244394+0000","last_became_peered":"2023-11-15T01:40:20.244394+0000","last_unstale":"2023-11-15T01:40:20.623200+0000","last_undegraded":"2023-11-15T01:40:20.623200+0000","last_fullsized":"2023-11-15T01:40:20.623200+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645638+0000","last_change":"2023-11-15T01:40:20.642368+0000","last_active":"2023-11-15T01:40:20.645638+0000","last_peered":"2023-11-15T01:40:20.645638+0000","last_clean":"2023-11-15T01:40:20.645638+0000","last_became_active":"2023-11-15T01:40:20.642012+0000","last_became_peered":"2023-11-15T01:40:20.642012+0000","last_unstale":"2023-11-15T01:40:20.645638+0000","last_undegraded":"2023-11-15T01:40:20.645638+0000","last_fullsized":"2023-11-15T01:40:20.645638+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623850+0000","last_change":"2023-11-15T01:40:20.248505+0000","last_active":"2023-11-15T01:40:20.623850+0000","last_peered":"2023-11-15T01:40:20.623850+0000","last_clean":"2023-11-15T01:40:20.623850+0000","last_became_active":"2023-11-15T01:40:20.248152+0000","last_became_peered":"2023-11-15T01:40:20.248152+0000","last_unstale":"2023-11-15T01:40:20.623850+0000","last_undegraded":"2023-11-15T01:40:20.623850+0000","last_fullsized":"2023-11-15T01:40:20.623850+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645073+0000","last_change":"2023-11-15T01:40:20.643161+0000","last_active":"2023-11-15T01:40:20.645073+0000","last_peered":"2023-11-15T01:40:20.645073+0000","last_clean":"2023-11-15T01:40:20.645073+0000","last_became_active":"2023-11-15T01:40:20.642562+0000","last_became_peered":"2023-11-15T01:40:20.642562+0000","last_unstale":"2023-11-15T01:40:20.645073+0000","last_undegraded":"2023-11-15T01:40:20.645073+0000","last_fullsized":"2023-11-15T01:40:20.645073+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625167+0000","last_change":"2023-11-15T01:40:20.242250+0000","last_active":"2023-11-15T01:40:20.625167+0000","last_peered":"2023-11-15T01:40:20.625167+0000","last_clean":"2023-11-15T01:40:20.625167+0000","last_became_active":"2023-11-15T01:40:20.242006+0000","last_became_peered":"2023-11-15T01:40:20.242006+0000","last_unstale":"2023-11-15T01:40:20.625167+0000","last_undegraded":"2023-11-15T01:40:20.625167+0000","last_fullsized":"2023-11-15T01:40:20.625167+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645367+0000","last_change":"2023-11-15T01:40:20.639227+0000","last_active":"2023-11-15T01:40:20.645367+0000","last_peered":"2023-11-15T01:40:20.645367+0000","last_clean":"2023-11-15T01:40:20.645367+0000","last_became_active":"2023-11-15T01:40:20.638956+0000","last_became_peered":"2023-11-15T01:40:20.638956+0000","last_unstale":"2023-11-15T01:40:20.645367+0000","last_undegraded":"2023-11-15T01:40:20.645367+0000","last_fullsized":"2023-11-15T01:40:20.645367+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-11-15T01:40:22.152665+0000","last_change":"2023-11-15T01:40:20.241565+0000","last_active":"2023-11-15T01:40:22.152665+0000","last_peered":"2023-11-15T01:40:22.152665+0000","last_clean":"2023-11-15T01:40:22.152665+0000","last_became_active":"2023-11-15T01:40:20.241253+0000","last_became_peered":"2023-11-15T01:40:20.241253+0000","last_unstale":"2023-11-15T01:40:22.152665+0000","last_undegraded":"2023-11-15T01:40:22.152665+0000","last_fullsized":"2023-11-15T01:40:22.152665+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634580+0000","last_change":"2023-11-15T01:40:20.631271+0000","last_active":"2023-11-15T01:40:20.634580+0000","last_peered":"2023-11-15T01:40:20.634580+0000","last_clean":"2023-11-15T01:40:20.634580+0000","last_became_active":"2023-11-15T01:40:20.630984+0000","last_became_peered":"2023-11-15T01:40:20.630984+0000","last_unstale":"2023-11-15T01:40:20.634580+0000","last_undegraded":"2023-11-15T01:40:20.634580+0000","last_fullsized":"2023-11-15T01:40:20.634580+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625566+0000","last_change":"2023-11-15T01:40:20.245556+0000","last_active":"2023-11-15T01:40:20.625566+0000","last_peered":"2023-11-15T01:40:20.625566+0000","last_clean":"2023-11-15T01:40:20.625566+0000","last_became_active":"2023-11-15T01:40:20.245270+0000","last_became_peered":"2023-11-15T01:40:20.245270+0000","last_unstale":"2023-11-15T01:40:20.625566+0000","last_undegraded":"2023-11-15T01:40:20.625566+0000","last_fullsized":"2023-11-15T01:40:20.625566+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637960+0000","last_change":"2023-11-15T01:40:20.634050+0000","last_active":"2023-11-15T01:40:20.637960+0000","last_peered":"2023-11-15T01:40:20.637960+0000","last_clean":"2023-11-15T01:40:20.637960+0000","last_became_active":"2023-11-15T01:40:20.633782+0000","last_became_peered":"2023-11-15T01:40:20.633782+0000","last_unstale":"2023-11-15T01:40:20.637960+0000","last_undegraded":"2023-11-15T01:40:20.637960+0000","last_fullsized":"2023-11-15T01:40:20.637960+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623365+0000","last_change":"2023-11-15T01:40:20.240505+0000","last_active":"2023-11-15T01:40:20.623365+0000","last_peered":"2023-11-15T01:40:20.623365+0000","last_clean":"2023-11-15T01:40:20.623365+0000","last_became_active":"2023-11-15T01:40:20.240212+0000","last_became_peered":"2023-11-15T01:40:20.240212+0000","last_unstale":"2023-11-15T01:40:20.623365+0000","last_undegraded":"2023-11-15T01:40:20.623365+0000","last_fullsized":"2023-11-15T01:40:20.623365+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640225+0000","last_change":"2023-11-15T01:40:20.636132+0000","last_active":"2023-11-15T01:40:20.640225+0000","last_peered":"2023-11-15T01:40:20.640225+0000","last_clean":"2023-11-15T01:40:20.640225+0000","last_became_active":"2023-11-15T01:40:20.635832+0000","last_became_peered":"2023-11-15T01:40:20.635832+0000","last_unstale":"2023-11-15T01:40:20.640225+0000","last_undegraded":"2023-11-15T01:40:20.640225+0000","last_fullsized":"2023-11-15T01:40:20.640225+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623047+0000","last_change":"2023-11-15T01:40:20.246872+0000","last_active":"2023-11-15T01:40:20.623047+0000","last_peered":"2023-11-15T01:40:20.623047+0000","last_clean":"2023-11-15T01:40:20.623047+0000","last_became_active":"2023-11-15T01:40:20.246537+0000","last_became_peered":"2023-11-15T01:40:20.246537+0000","last_unstale":"2023-11-15T01:40:20.623047+0000","last_undegraded":"2023-11-15T01:40:20.623047+0000","last_fullsized":"2023-11-15T01:40:20.623047+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634263+0000","last_change":"2023-11-15T01:40:20.630681+0000","last_active":"2023-11-15T01:40:20.634263+0000","last_peered":"2023-11-15T01:40:20.634263+0000","last_clean":"2023-11-15T01:40:20.634263+0000","last_became_active":"2023-11-15T01:40:20.630373+0000","last_became_peered":"2023-11-15T01:40:20.630373+0000","last_unstale":"2023-11-15T01:40:20.634263+0000","last_undegraded":"2023-11-15T01:40:20.634263+0000","last_fullsized":"2023-11-15T01:40:20.634263+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624478+0000","last_change":"2023-11-15T01:40:20.244238+0000","last_active":"2023-11-15T01:40:20.624478+0000","last_peered":"2023-11-15T01:40:20.624478+0000","last_clean":"2023-11-15T01:40:20.624478+0000","last_became_active":"2023-11-15T01:40:20.243936+0000","last_became_peered":"2023-11-15T01:40:20.243936+0000","last_unstale":"2023-11-15T01:40:20.624478+0000","last_undegraded":"2023-11-15T01:40:20.624478+0000","last_fullsized":"2023-11-15T01:40:20.624478+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647040+0000","last_change":"2023-11-15T01:40:20.645113+0000","last_active":"2023-11-15T01:40:20.647040+0000","last_peered":"2023-11-15T01:40:20.647040+0000","last_clean":"2023-11-15T01:40:20.647040+0000","last_became_active":"2023-11-15T01:40:20.644570+0000","last_became_peered":"2023-11-15T01:40:20.644570+0000","last_unstale":"2023-11-15T01:40:20.647040+0000","last_undegraded":"2023-11-15T01:40:20.647040+0000","last_fullsized":"2023-11-15T01:40:20.647040+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.620507+0000","last_change":"2023-11-15T01:40:20.238797+0000","last_active":"2023-11-15T01:40:20.620507+0000","last_peered":"2023-11-15T01:40:20.620507+0000","last_clean":"2023-11-15T01:40:20.620507+0000","last_became_active":"2023-11-15T01:40:20.238516+0000","last_became_peered":"2023-11-15T01:40:20.238516+0000","last_unstale":"2023-11-15T01:40:20.620507+0000","last_undegraded":"2023-11-15T01:40:20.620507+0000","last_fullsized":"2023-11-15T01:40:20.620507+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.635078+0000","last_change":"2023-11-15T01:40:20.631036+0000","last_active":"2023-11-15T01:40:20.635078+0000","last_peered":"2023-11-15T01:40:20.635078+0000","last_clean":"2023-11-15T01:40:20.635078+0000","last_became_active":"2023-11-15T01:40:20.630762+0000","last_became_peered":"2023-11-15T01:40:20.630762+0000","last_unstale":"2023-11-15T01:40:20.635078+0000","last_undegraded":"2023-11-15T01:40:20.635078+0000","last_fullsized":"2023-11-15T01:40:20.635078+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625588+0000","last_change":"2023-11-15T01:40:20.244705+0000","last_active":"2023-11-15T01:40:20.625588+0000","last_peered":"2023-11-15T01:40:20.625588+0000","last_clean":"2023-11-15T01:40:20.625588+0000","last_became_active":"2023-11-15T01:40:20.244432+0000","last_became_peered":"2023-11-15T01:40:20.244432+0000","last_unstale":"2023-11-15T01:40:20.625588+0000","last_undegraded":"2023-11-15T01:40:20.625588+0000","last_fullsized":"2023-11-15T01:40:20.625588+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645095+0000","last_change":"2023-11-15T01:40:20.643897+0000","last_active":"2023-11-15T01:40:20.645095+0000","last_peered":"2023-11-15T01:40:20.645095+0000","last_clean":"2023-11-15T01:40:20.645095+0000","last_became_active":"2023-11-15T01:40:20.643619+0000","last_became_peered":"2023-11-15T01:40:20.643619+0000","last_unstale":"2023-11-15T01:40:20.645095+0000","last_undegraded":"2023-11-15T01:40:20.645095+0000","last_fullsized":"2023-11-15T01:40:20.645095+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.631561+0000","last_change":"2023-11-15T01:40:20.245866+0000","last_active":"2023-11-15T01:40:20.631561+0000","last_peered":"2023-11-15T01:40:20.631561+0000","last_clean":"2023-11-15T01:40:20.631561+0000","last_became_active":"2023-11-15T01:40:20.245176+0000","last_became_peered":"2023-11-15T01:40:20.245176+0000","last_unstale":"2023-11-15T01:40:20.631561+0000","last_undegraded":"2023-11-15T01:40:20.631561+0000","last_fullsized":"2023-11-15T01:40:20.631561+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.632732+0000","last_change":"2023-11-15T01:40:20.630832+0000","last_active":"2023-11-15T01:40:20.632732+0000","last_peered":"2023-11-15T01:40:20.632732+0000","last_clean":"2023-11-15T01:40:20.632732+0000","last_became_active":"2023-11-15T01:40:20.630527+0000","last_became_peered":"2023-11-15T01:40:20.630527+0000","last_unstale":"2023-11-15T01:40:20.632732+0000","last_undegraded":"2023-11-15T01:40:20.632732+0000","last_fullsized":"2023-11-15T01:40:20.632732+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.636373+0000","last_change":"2023-11-15T01:40:20.239525+0000","last_active":"2023-11-15T01:40:20.636373+0000","last_peered":"2023-11-15T01:40:20.636373+0000","last_clean":"2023-11-15T01:40:20.636373+0000","last_became_active":"2023-11-15T01:40:20.239187+0000","last_became_peered":"2023-11-15T01:40:20.239187+0000","last_unstale":"2023-11-15T01:40:20.636373+0000","last_undegraded":"2023-11-15T01:40:20.636373+0000","last_fullsized":"2023-11-15T01:40:20.636373+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647658+0000","last_change":"2023-11-15T01:40:20.643078+0000","last_active":"2023-11-15T01:40:20.647658+0000","last_peered":"2023-11-15T01:40:20.647658+0000","last_clean":"2023-11-15T01:40:20.647658+0000","last_became_active":"2023-11-15T01:40:20.642797+0000","last_became_peered":"2023-11-15T01:40:20.642797+0000","last_unstale":"2023-11-15T01:40:20.647658+0000","last_undegraded":"2023-11-15T01:40:20.647658+0000","last_fullsized":"2023-11-15T01:40:20.647658+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.642978+0000","last_change":"2023-11-15T01:40:20.249171+0000","last_active":"2023-11-15T01:40:20.642978+0000","last_peered":"2023-11-15T01:40:20.642978+0000","last_clean":"2023-11-15T01:40:20.642978+0000","last_became_active":"2023-11-15T01:40:20.248520+0000","last_became_peered":"2023-11-15T01:40:20.248520+0000","last_unstale":"2023-11-15T01:40:20.642978+0000","last_undegraded":"2023-11-15T01:40:20.642978+0000","last_fullsized":"2023-11-15T01:40:20.642978+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.648016+0000","last_change":"2023-11-15T01:40:20.643351+0000","last_active":"2023-11-15T01:40:20.648016+0000","last_peered":"2023-11-15T01:40:20.648016+0000","last_clean":"2023-11-15T01:40:20.648016+0000","last_became_active":"2023-11-15T01:40:20.643053+0000","last_became_peered":"2023-11-15T01:40:20.643053+0000","last_unstale":"2023-11-15T01:40:20.648016+0000","last_undegraded":"2023-11-15T01:40:20.648016+0000","last_fullsized":"2023-11-15T01:40:20.648016+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626997+0000","last_change":"2023-11-15T01:40:20.244328+0000","last_active":"2023-11-15T01:40:20.626997+0000","last_peered":"2023-11-15T01:40:20.626997+0000","last_clean":"2023-11-15T01:40:20.626997+0000","last_became_active":"2023-11-15T01:40:20.243358+0000","last_became_peered":"2023-11-15T01:40:20.243358+0000","last_unstale":"2023-11-15T01:40:20.626997+0000","last_undegraded":"2023-11-15T01:40:20.626997+0000","last_fullsized":"2023-11-15T01:40:20.626997+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640451+0000","last_change":"2023-11-15T01:40:20.636332+0000","last_active":"2023-11-15T01:40:20.640451+0000","last_peered":"2023-11-15T01:40:20.640451+0000","last_clean":"2023-11-15T01:40:20.640451+0000","last_became_active":"2023-11-15T01:40:20.636042+0000","last_became_peered":"2023-11-15T01:40:20.636042+0000","last_unstale":"2023-11-15T01:40:20.640451+0000","last_undegraded":"2023-11-15T01:40:20.640451+0000","last_fullsized":"2023-11-15T01:40:20.640451+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623071+0000","last_change":"2023-11-15T01:40:20.248987+0000","last_active":"2023-11-15T01:40:20.623071+0000","last_peered":"2023-11-15T01:40:20.623071+0000","last_clean":"2023-11-15T01:40:20.623071+0000","last_became_active":"2023-11-15T01:40:20.248720+0000","last_became_peered":"2023-11-15T01:40:20.248720+0000","last_unstale":"2023-11-15T01:40:20.623071+0000","last_undegraded":"2023-11-15T01:40:20.623071+0000","last_fullsized":"2023-11-15T01:40:20.623071+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.644975+0000","last_change":"2023-11-15T01:40:20.638835+0000","last_active":"2023-11-15T01:40:20.644975+0000","last_peered":"2023-11-15T01:40:20.644975+0000","last_clean":"2023-11-15T01:40:20.644975+0000","last_became_active":"2023-11-15T01:40:20.638503+0000","last_became_peered":"2023-11-15T01:40:20.638503+0000","last_unstale":"2023-11-15T01:40:20.644975+0000","last_undegraded":"2023-11-15T01:40:20.644975+0000","last_fullsized":"2023-11-15T01:40:20.644975+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621337+0000","last_change":"2023-11-15T01:40:20.244973+0000","last_active":"2023-11-15T01:40:20.621337+0000","last_peered":"2023-11-15T01:40:20.621337+0000","last_clean":"2023-11-15T01:40:20.621337+0000","last_became_active":"2023-11-15T01:40:20.244693+0000","last_became_peered":"2023-11-15T01:40:20.244693+0000","last_unstale":"2023-11-15T01:40:20.621337+0000","last_undegraded":"2023-11-15T01:40:20.621337+0000","last_fullsized":"2023-11-15T01:40:20.621337+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646635+0000","last_change":"2023-11-15T01:40:20.637751+0000","last_active":"2023-11-15T01:40:20.646635+0000","last_peered":"2023-11-15T01:40:20.646635+0000","last_clean":"2023-11-15T01:40:20.646635+0000","last_became_active":"2023-11-15T01:40:20.637065+0000","last_became_peered":"2023-11-15T01:40:20.637065+0000","last_unstale":"2023-11-15T01:40:20.646635+0000","last_undegraded":"2023-11-15T01:40:20.646635+0000","last_fullsized":"2023-11-15T01:40:20.646635+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626264+0000","last_change":"2023-11-15T01:40:20.241275+0000","last_active":"2023-11-15T01:40:20.626264+0000","last_peered":"2023-11-15T01:40:20.626264+0000","last_clean":"2023-11-15T01:40:20.626264+0000","last_became_active":"2023-11-15T01:40:20.240634+0000","last_became_peered":"2023-11-15T01:40:20.240634+0000","last_unstale":"2023-11-15T01:40:20.626264+0000","last_undegraded":"2023-11-15T01:40:20.626264+0000","last_fullsized":"2023-11-15T01:40:20.626264+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637071+0000","last_change":"2023-11-15T01:40:20.632019+0000","last_active":"2023-11-15T01:40:20.637071+0000","last_peered":"2023-11-15T01:40:20.637071+0000","last_clean":"2023-11-15T01:40:20.637071+0000","last_became_active":"2023-11-15T01:40:20.631739+0000","last_became_peered":"2023-11-15T01:40:20.631739+0000","last_unstale":"2023-11-15T01:40:20.637071+0000","last_undegraded":"2023-11-15T01:40:20.637071+0000","last_fullsized":"2023-11-15T01:40:20.637071+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.621235+0000","last_change":"2023-11-15T01:40:20.241452+0000","last_active":"2023-11-15T01:40:20.621235+0000","last_peered":"2023-11-15T01:40:20.621235+0000","last_clean":"2023-11-15T01:40:20.621235+0000","last_became_active":"2023-11-15T01:40:20.241153+0000","last_became_peered":"2023-11-15T01:40:20.241153+0000","last_unstale":"2023-11-15T01:40:20.621235+0000","last_undegraded":"2023-11-15T01:40:20.621235+0000","last_fullsized":"2023-11-15T01:40:20.621235+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647985+0000","last_change":"2023-11-15T01:40:20.644991+0000","last_active":"2023-11-15T01:40:20.647985+0000","last_peered":"2023-11-15T01:40:20.647985+0000","last_clean":"2023-11-15T01:40:20.647985+0000","last_became_active":"2023-11-15T01:40:20.644730+0000","last_became_peered":"2023-11-15T01:40:20.644730+0000","last_unstale":"2023-11-15T01:40:20.647985+0000","last_undegraded":"2023-11-15T01:40:20.647985+0000","last_fullsized":"2023-11-15T01:40:20.647985+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.642580+0000","last_change":"2023-11-15T01:40:20.240160+0000","last_active":"2023-11-15T01:40:20.642580+0000","last_peered":"2023-11-15T01:40:20.642580+0000","last_clean":"2023-11-15T01:40:20.642580+0000","last_became_active":"2023-11-15T01:40:20.239856+0000","last_became_peered":"2023-11-15T01:40:20.239856+0000","last_unstale":"2023-11-15T01:40:20.642580+0000","last_undegraded":"2023-11-15T01:40:20.642580+0000","last_fullsized":"2023-11-15T01:40:20.642580+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634603+0000","last_change":"2023-11-15T01:40:20.631436+0000","last_active":"2023-11-15T01:40:20.634603+0000","last_peered":"2023-11-15T01:40:20.634603+0000","last_clean":"2023-11-15T01:40:20.634603+0000","last_became_active":"2023-11-15T01:40:20.631020+0000","last_became_peered":"2023-11-15T01:40:20.631020+0000","last_unstale":"2023-11-15T01:40:20.634603+0000","last_undegraded":"2023-11-15T01:40:20.634603+0000","last_fullsized":"2023-11-15T01:40:20.634603+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640104+0000","last_change":"2023-11-15T01:40:20.243673+0000","last_active":"2023-11-15T01:40:20.640104+0000","last_peered":"2023-11-15T01:40:20.640104+0000","last_clean":"2023-11-15T01:40:20.640104+0000","last_became_active":"2023-11-15T01:40:20.243237+0000","last_became_peered":"2023-11-15T01:40:20.243237+0000","last_unstale":"2023-11-15T01:40:20.640104+0000","last_undegraded":"2023-11-15T01:40:20.640104+0000","last_fullsized":"2023-11-15T01:40:20.640104+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641997+0000","last_change":"2023-11-15T01:40:20.636870+0000","last_active":"2023-11-15T01:40:20.641997+0000","last_peered":"2023-11-15T01:40:20.641997+0000","last_clean":"2023-11-15T01:40:20.641997+0000","last_became_active":"2023-11-15T01:40:20.636598+0000","last_became_peered":"2023-11-15T01:40:20.636598+0000","last_unstale":"2023-11-15T01:40:20.641997+0000","last_undegraded":"2023-11-15T01:40:20.641997+0000","last_fullsized":"2023-11-15T01:40:20.641997+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634311+0000","last_change":"2023-11-15T01:40:20.249753+0000","last_active":"2023-11-15T01:40:20.634311+0000","last_peered":"2023-11-15T01:40:20.634311+0000","last_clean":"2023-11-15T01:40:20.634311+0000","last_became_active":"2023-11-15T01:40:20.249476+0000","last_became_peered":"2023-11-15T01:40:20.249476+0000","last_unstale":"2023-11-15T01:40:20.634311+0000","last_undegraded":"2023-11-15T01:40:20.634311+0000","last_fullsized":"2023-11-15T01:40:20.634311+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645086+0000","last_change":"2023-11-15T01:40:20.639606+0000","last_active":"2023-11-15T01:40:20.645086+0000","last_peered":"2023-11-15T01:40:20.645086+0000","last_clean":"2023-11-15T01:40:20.645086+0000","last_became_active":"2023-11-15T01:40:20.639330+0000","last_became_peered":"2023-11-15T01:40:20.639330+0000","last_unstale":"2023-11-15T01:40:20.645086+0000","last_undegraded":"2023-11-15T01:40:20.645086+0000","last_fullsized":"2023-11-15T01:40:20.645086+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.633537+0000","last_change":"2023-11-15T01:40:20.249519+0000","last_active":"2023-11-15T01:40:20.633537+0000","last_peered":"2023-11-15T01:40:20.633537+0000","last_clean":"2023-11-15T01:40:20.633537+0000","last_became_active":"2023-11-15T01:40:20.249242+0000","last_became_peered":"2023-11-15T01:40:20.249242+0000","last_unstale":"2023-11-15T01:40:20.633537+0000","last_undegraded":"2023-11-15T01:40:20.633537+0000","last_fullsized":"2023-11-15T01:40:20.633537+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640933+0000","last_change":"2023-11-15T01:40:20.638425+0000","last_active":"2023-11-15T01:40:20.640933+0000","last_peered":"2023-11-15T01:40:20.640933+0000","last_clean":"2023-11-15T01:40:20.640933+0000","last_became_active":"2023-11-15T01:40:20.638126+0000","last_became_peered":"2023-11-15T01:40:20.638126+0000","last_unstale":"2023-11-15T01:40:20.640933+0000","last_undegraded":"2023-11-15T01:40:20.640933+0000","last_fullsized":"2023-11-15T01:40:20.640933+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634331+0000","last_change":"2023-11-15T01:40:20.247847+0000","last_active":"2023-11-15T01:40:20.634331+0000","last_peered":"2023-11-15T01:40:20.634331+0000","last_clean":"2023-11-15T01:40:20.634331+0000","last_became_active":"2023-11-15T01:40:20.247546+0000","last_became_peered":"2023-11-15T01:40:20.247546+0000","last_unstale":"2023-11-15T01:40:20.634331+0000","last_undegraded":"2023-11-15T01:40:20.634331+0000","last_fullsized":"2023-11-15T01:40:20.634331+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.639125+0000","last_change":"2023-11-15T01:40:20.634983+0000","last_active":"2023-11-15T01:40:20.639125+0000","last_peered":"2023-11-15T01:40:20.639125+0000","last_clean":"2023-11-15T01:40:20.639125+0000","last_became_active":"2023-11-15T01:40:20.634686+0000","last_became_peered":"2023-11-15T01:40:20.634686+0000","last_unstale":"2023-11-15T01:40:20.639125+0000","last_undegraded":"2023-11-15T01:40:20.639125+0000","last_fullsized":"2023-11-15T01:40:20.639125+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630653+0000","last_change":"2023-11-15T01:40:20.251483+0000","last_active":"2023-11-15T01:40:20.630653+0000","last_peered":"2023-11-15T01:40:20.630653+0000","last_clean":"2023-11-15T01:40:20.630653+0000","last_became_active":"2023-11-15T01:40:20.251225+0000","last_became_peered":"2023-11-15T01:40:20.251225+0000","last_unstale":"2023-11-15T01:40:20.630653+0000","last_undegraded":"2023-11-15T01:40:20.630653+0000","last_fullsized":"2023-11-15T01:40:20.630653+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646657+0000","last_change":"2023-11-15T01:40:20.637803+0000","last_active":"2023-11-15T01:40:20.646657+0000","last_peered":"2023-11-15T01:40:20.646657+0000","last_clean":"2023-11-15T01:40:20.646657+0000","last_became_active":"2023-11-15T01:40:20.637531+0000","last_became_peered":"2023-11-15T01:40:20.637531+0000","last_unstale":"2023-11-15T01:40:20.646657+0000","last_undegraded":"2023-11-15T01:40:20.646657+0000","last_fullsized":"2023-11-15T01:40:20.646657+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623955+0000","last_change":"2023-11-15T01:40:20.241323+0000","last_active":"2023-11-15T01:40:20.623955+0000","last_peered":"2023-11-15T01:40:20.623955+0000","last_clean":"2023-11-15T01:40:20.623955+0000","last_became_active":"2023-11-15T01:40:20.241039+0000","last_became_peered":"2023-11-15T01:40:20.241039+0000","last_unstale":"2023-11-15T01:40:20.623955+0000","last_undegraded":"2023-11-15T01:40:20.623955+0000","last_fullsized":"2023-11-15T01:40:20.623955+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637650+0000","last_change":"2023-11-15T01:40:20.632327+0000","last_active":"2023-11-15T01:40:20.637650+0000","last_peered":"2023-11-15T01:40:20.637650+0000","last_clean":"2023-11-15T01:40:20.637650+0000","last_became_active":"2023-11-15T01:40:20.631981+0000","last_became_peered":"2023-11-15T01:40:20.631981+0000","last_unstale":"2023-11-15T01:40:20.637650+0000","last_undegraded":"2023-11-15T01:40:20.637650+0000","last_fullsized":"2023-11-15T01:40:20.637650+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630313+0000","last_change":"2023-11-15T01:40:20.248328+0000","last_active":"2023-11-15T01:40:20.630313+0000","last_peered":"2023-11-15T01:40:20.630313+0000","last_clean":"2023-11-15T01:40:20.630313+0000","last_became_active":"2023-11-15T01:40:20.247702+0000","last_became_peered":"2023-11-15T01:40:20.247702+0000","last_unstale":"2023-11-15T01:40:20.630313+0000","last_undegraded":"2023-11-15T01:40:20.630313+0000","last_fullsized":"2023-11-15T01:40:20.630313+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.643154+0000","last_change":"2023-11-15T01:40:20.639732+0000","last_active":"2023-11-15T01:40:20.643154+0000","last_peered":"2023-11-15T01:40:20.643154+0000","last_clean":"2023-11-15T01:40:20.643154+0000","last_became_active":"2023-11-15T01:40:20.638787+0000","last_became_peered":"2023-11-15T01:40:20.638787+0000","last_unstale":"2023-11-15T01:40:20.643154+0000","last_undegraded":"2023-11-15T01:40:20.643154+0000","last_fullsized":"2023-11-15T01:40:20.643154+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.633299+0000","last_change":"2023-11-15T01:40:20.243269+0000","last_active":"2023-11-15T01:40:20.633299+0000","last_peered":"2023-11-15T01:40:20.633299+0000","last_clean":"2023-11-15T01:40:20.633299+0000","last_became_active":"2023-11-15T01:40:20.241757+0000","last_became_peered":"2023-11-15T01:40:20.241757+0000","last_unstale":"2023-11-15T01:40:20.633299+0000","last_undegraded":"2023-11-15T01:40:20.633299+0000","last_fullsized":"2023-11-15T01:40:20.633299+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640383+0000","last_change":"2023-11-15T01:40:20.635969+0000","last_active":"2023-11-15T01:40:20.640383+0000","last_peered":"2023-11-15T01:40:20.640383+0000","last_clean":"2023-11-15T01:40:20.640383+0000","last_became_active":"2023-11-15T01:40:20.635682+0000","last_became_peered":"2023-11-15T01:40:20.635682+0000","last_unstale":"2023-11-15T01:40:20.640383+0000","last_undegraded":"2023-11-15T01:40:20.640383+0000","last_fullsized":"2023-11-15T01:40:20.640383+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623421+0000","last_change":"2023-11-15T01:40:20.244894+0000","last_active":"2023-11-15T01:40:20.623421+0000","last_peered":"2023-11-15T01:40:20.623421+0000","last_clean":"2023-11-15T01:40:20.623421+0000","last_became_active":"2023-11-15T01:40:20.244195+0000","last_became_peered":"2023-11-15T01:40:20.244195+0000","last_unstale":"2023-11-15T01:40:20.623421+0000","last_undegraded":"2023-11-15T01:40:20.623421+0000","last_fullsized":"2023-11-15T01:40:20.623421+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647931+0000","last_change":"2023-11-15T01:40:20.644255+0000","last_active":"2023-11-15T01:40:20.647931+0000","last_peered":"2023-11-15T01:40:20.647931+0000","last_clean":"2023-11-15T01:40:20.647931+0000","last_became_active":"2023-11-15T01:40:20.643951+0000","last_became_peered":"2023-11-15T01:40:20.643951+0000","last_unstale":"2023-11-15T01:40:20.647931+0000","last_undegraded":"2023-11-15T01:40:20.647931+0000","last_fullsized":"2023-11-15T01:40:20.647931+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624405+0000","last_change":"2023-11-15T01:40:20.244674+0000","last_active":"2023-11-15T01:40:20.624405+0000","last_peered":"2023-11-15T01:40:20.624405+0000","last_clean":"2023-11-15T01:40:20.624405+0000","last_became_active":"2023-11-15T01:40:20.244188+0000","last_became_peered":"2023-11-15T01:40:20.244188+0000","last_unstale":"2023-11-15T01:40:20.624405+0000","last_undegraded":"2023-11-15T01:40:20.624405+0000","last_fullsized":"2023-11-15T01:40:20.624405+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641364+0000","last_change":"2023-11-15T01:40:20.636297+0000","last_active":"2023-11-15T01:40:20.641364+0000","last_peered":"2023-11-15T01:40:20.641364+0000","last_clean":"2023-11-15T01:40:20.641364+0000","last_became_active":"2023-11-15T01:40:20.635914+0000","last_became_peered":"2023-11-15T01:40:20.635914+0000","last_unstale":"2023-11-15T01:40:20.641364+0000","last_undegraded":"2023-11-15T01:40:20.641364+0000","last_fullsized":"2023-11-15T01:40:20.641364+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623546+0000","last_change":"2023-11-15T01:40:20.249114+0000","last_active":"2023-11-15T01:40:20.623546+0000","last_peered":"2023-11-15T01:40:20.623546+0000","last_clean":"2023-11-15T01:40:20.623546+0000","last_became_active":"2023-11-15T01:40:20.248806+0000","last_became_peered":"2023-11-15T01:40:20.248806+0000","last_unstale":"2023-11-15T01:40:20.623546+0000","last_undegraded":"2023-11-15T01:40:20.623546+0000","last_fullsized":"2023-11-15T01:40:20.623546+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640914+0000","last_change":"2023-11-15T01:40:20.634111+0000","last_active":"2023-11-15T01:40:20.640914+0000","last_peered":"2023-11-15T01:40:20.640914+0000","last_clean":"2023-11-15T01:40:20.640914+0000","last_became_active":"2023-11-15T01:40:20.633828+0000","last_became_peered":"2023-11-15T01:40:20.633828+0000","last_unstale":"2023-11-15T01:40:20.640914+0000","last_undegraded":"2023-11-15T01:40:20.640914+0000","last_fullsized":"2023-11-15T01:40:20.640914+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623178+0000","last_change":"2023-11-15T01:40:20.243830+0000","last_active":"2023-11-15T01:40:20.623178+0000","last_peered":"2023-11-15T01:40:20.623178+0000","last_clean":"2023-11-15T01:40:20.623178+0000","last_became_active":"2023-11-15T01:40:20.243522+0000","last_became_peered":"2023-11-15T01:40:20.243522+0000","last_unstale":"2023-11-15T01:40:20.623178+0000","last_undegraded":"2023-11-15T01:40:20.623178+0000","last_fullsized":"2023-11-15T01:40:20.623178+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646619+0000","last_change":"2023-11-15T01:40:20.637658+0000","last_active":"2023-11-15T01:40:20.646619+0000","last_peered":"2023-11-15T01:40:20.646619+0000","last_clean":"2023-11-15T01:40:20.646619+0000","last_became_active":"2023-11-15T01:40:20.637349+0000","last_became_peered":"2023-11-15T01:40:20.637349+0000","last_unstale":"2023-11-15T01:40:20.646619+0000","last_undegraded":"2023-11-15T01:40:20.646619+0000","last_fullsized":"2023-11-15T01:40:20.646619+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.622664+0000","last_change":"2023-11-15T01:40:20.246311+0000","last_active":"2023-11-15T01:40:20.622664+0000","last_peered":"2023-11-15T01:40:20.622664+0000","last_clean":"2023-11-15T01:40:20.622664+0000","last_became_active":"2023-11-15T01:40:20.245907+0000","last_became_peered":"2023-11-15T01:40:20.245907+0000","last_unstale":"2023-11-15T01:40:20.622664+0000","last_undegraded":"2023-11-15T01:40:20.622664+0000","last_fullsized":"2023-11-15T01:40:20.622664+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645550+0000","last_change":"2023-11-15T01:40:20.641099+0000","last_active":"2023-11-15T01:40:20.645550+0000","last_peered":"2023-11-15T01:40:20.645550+0000","last_clean":"2023-11-15T01:40:20.645550+0000","last_became_active":"2023-11-15T01:40:20.639935+0000","last_became_peered":"2023-11-15T01:40:20.639935+0000","last_unstale":"2023-11-15T01:40:20.645550+0000","last_undegraded":"2023-11-15T01:40:20.645550+0000","last_fullsized":"2023-11-15T01:40:20.645550+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.620564+0000","last_change":"2023-11-15T01:40:20.249564+0000","last_active":"2023-11-15T01:40:20.620564+0000","last_peered":"2023-11-15T01:40:20.620564+0000","last_clean":"2023-11-15T01:40:20.620564+0000","last_became_active":"2023-11-15T01:40:20.249234+0000","last_became_peered":"2023-11-15T01:40:20.249234+0000","last_unstale":"2023-11-15T01:40:20.620564+0000","last_undegraded":"2023-11-15T01:40:20.620564+0000","last_fullsized":"2023-11-15T01:40:20.620564+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641575+0000","last_change":"2023-11-15T01:40:20.637554+0000","last_active":"2023-11-15T01:40:20.641575+0000","last_peered":"2023-11-15T01:40:20.641575+0000","last_clean":"2023-11-15T01:40:20.641575+0000","last_became_active":"2023-11-15T01:40:20.636661+0000","last_became_peered":"2023-11-15T01:40:20.636661+0000","last_unstale":"2023-11-15T01:40:20.641575+0000","last_undegraded":"2023-11-15T01:40:20.641575+0000","last_fullsized":"2023-11-15T01:40:20.641575+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630434+0000","last_change":"2023-11-15T01:40:20.245202+0000","last_active":"2023-11-15T01:40:20.630434+0000","last_peered":"2023-11-15T01:40:20.630434+0000","last_clean":"2023-11-15T01:40:20.630434+0000","last_became_active":"2023-11-15T01:40:20.244906+0000","last_became_peered":"2023-11-15T01:40:20.244906+0000","last_unstale":"2023-11-15T01:40:20.630434+0000","last_undegraded":"2023-11-15T01:40:20.630434+0000","last_fullsized":"2023-11-15T01:40:20.630434+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.640421+0000","last_change":"2023-11-15T01:40:20.634926+0000","last_active":"2023-11-15T01:40:20.640421+0000","last_peered":"2023-11-15T01:40:20.640421+0000","last_clean":"2023-11-15T01:40:20.640421+0000","last_became_active":"2023-11-15T01:40:20.634638+0000","last_became_peered":"2023-11-15T01:40:20.634638+0000","last_unstale":"2023-11-15T01:40:20.640421+0000","last_undegraded":"2023-11-15T01:40:20.640421+0000","last_fullsized":"2023-11-15T01:40:20.640421+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623813+0000","last_change":"2023-11-15T01:40:20.245508+0000","last_active":"2023-11-15T01:40:20.623813+0000","last_peered":"2023-11-15T01:40:20.623813+0000","last_clean":"2023-11-15T01:40:20.623813+0000","last_became_active":"2023-11-15T01:40:20.243956+0000","last_became_peered":"2023-11-15T01:40:20.243956+0000","last_unstale":"2023-11-15T01:40:20.623813+0000","last_undegraded":"2023-11-15T01:40:20.623813+0000","last_fullsized":"2023-11-15T01:40:20.623813+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.626981+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T01:40:20.626981+0000","last_peered":"2023-11-15T01:40:20.626981+0000","last_clean":"2023-11-15T01:40:20.626981+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T01:40:20.626981+0000","last_undegraded":"2023-11-15T01:40:20.626981+0000","last_fullsized":"2023-11-15T01:40:20.626981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.629120+0000","last_change":"2023-11-15T01:40:20.625014+0000","last_active":"2023-11-15T01:40:20.629120+0000","last_peered":"2023-11-15T01:40:20.629120+0000","last_clean":"2023-11-15T01:40:20.629120+0000","last_became_active":"2023-11-15T01:40:20.624716+0000","last_became_peered":"2023-11-15T01:40:20.624716+0000","last_unstale":"2023-11-15T01:40:20.629120+0000","last_undegraded":"2023-11-15T01:40:20.629120+0000","last_fullsized":"2023-11-15T01:40:20.629120+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.623840+0000","last_change":"2023-11-15T01:40:20.242768+0000","last_active":"2023-11-15T01:40:20.623840+0000","last_peered":"2023-11-15T01:40:20.623840+0000","last_clean":"2023-11-15T01:40:20.623840+0000","last_became_active":"2023-11-15T01:40:20.242476+0000","last_became_peered":"2023-11-15T01:40:20.242476+0000","last_unstale":"2023-11-15T01:40:20.623840+0000","last_undegraded":"2023-11-15T01:40:20.623840+0000","last_fullsized":"2023-11-15T01:40:20.623840+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.624574+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T01:40:20.624574+0000","last_peered":"2023-11-15T01:40:20.624574+0000","last_clean":"2023-11-15T01:40:20.624574+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T01:40:20.624574+0000","last_undegraded":"2023-11-15T01:40:20.624574+0000","last_fullsized":"2023-11-15T01:40:20.624574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.641810+0000","last_change":"2023-11-15T01:40:20.639491+0000","last_active":"2023-11-15T01:40:20.641810+0000","last_peered":"2023-11-15T01:40:20.641810+0000","last_clean":"2023-11-15T01:40:20.641810+0000","last_became_active":"2023-11-15T01:40:20.639223+0000","last_became_peered":"2023-11-15T01:40:20.639223+0000","last_unstale":"2023-11-15T01:40:20.641810+0000","last_undegraded":"2023-11-15T01:40:20.641810+0000","last_fullsized":"2023-11-15T01:40:20.641810+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.627927+0000","last_change":"2023-11-15T01:40:20.232634+0000","last_active":"2023-11-15T01:40:20.627927+0000","last_peered":"2023-11-15T01:40:20.627927+0000","last_clean":"2023-11-15T01:40:20.627927+0000","last_became_active":"2023-11-15T01:40:20.232339+0000","last_became_peered":"2023-11-15T01:40:20.232339+0000","last_unstale":"2023-11-15T01:40:20.627927+0000","last_undegraded":"2023-11-15T01:40:20.627927+0000","last_fullsized":"2023-11-15T01:40:20.627927+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":123,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.616573+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T01:40:20.616573+0000","last_peered":"2023-11-15T01:40:20.616573+0000","last_clean":"2023-11-15T01:40:20.616573+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T01:40:20.616573+0000","last_undegraded":"2023-11-15T01:40:20.616573+0000","last_fullsized":"2023-11-15T01:40:20.616573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645587+0000","last_change":"2023-11-15T01:40:20.641425+0000","last_active":"2023-11-15T01:40:20.645587+0000","last_peered":"2023-11-15T01:40:20.645587+0000","last_clean":"2023-11-15T01:40:20.645587+0000","last_became_active":"2023-11-15T01:40:20.641221+0000","last_became_peered":"2023-11-15T01:40:20.641221+0000","last_unstale":"2023-11-15T01:40:20.645587+0000","last_undegraded":"2023-11-15T01:40:20.645587+0000","last_fullsized":"2023-11-15T01:40:20.645587+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645299+0000","last_change":"2023-11-15T01:40:20.243969+0000","last_active":"2023-11-15T01:40:20.645299+0000","last_peered":"2023-11-15T01:40:20.645299+0000","last_clean":"2023-11-15T01:40:20.645299+0000","last_became_active":"2023-11-15T01:40:20.243703+0000","last_became_peered":"2023-11-15T01:40:20.243703+0000","last_unstale":"2023-11-15T01:40:20.645299+0000","last_undegraded":"2023-11-15T01:40:20.645299+0000","last_fullsized":"2023-11-15T01:40:20.645299+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.627293+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T01:40:20.627293+0000","last_peered":"2023-11-15T01:40:20.627293+0000","last_clean":"2023-11-15T01:40:20.627293+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T01:40:20.627293+0000","last_undegraded":"2023-11-15T01:40:20.627293+0000","last_fullsized":"2023-11-15T01:40:20.627293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":111,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630613+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T01:40:20.630613+0000","last_peered":"2023-11-15T01:40:20.630613+0000","last_clean":"2023-11-15T01:40:20.630613+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T01:40:20.630613+0000","last_undegraded":"2023-11-15T01:40:20.630613+0000","last_fullsized":"2023-11-15T01:40:20.630613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.638169+0000","last_change":"2023-11-15T01:40:20.633092+0000","last_active":"2023-11-15T01:40:20.638169+0000","last_peered":"2023-11-15T01:40:20.638169+0000","last_clean":"2023-11-15T01:40:20.638169+0000","last_became_active":"2023-11-15T01:40:20.632795+0000","last_became_peered":"2023-11-15T01:40:20.632795+0000","last_unstale":"2023-11-15T01:40:20.638169+0000","last_undegraded":"2023-11-15T01:40:20.638169+0000","last_fullsized":"2023-11-15T01:40:20.638169+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634086+0000","last_change":"2023-11-15T01:40:20.246780+0000","last_active":"2023-11-15T01:40:20.634086+0000","last_peered":"2023-11-15T01:40:20.634086+0000","last_clean":"2023-11-15T01:40:20.634086+0000","last_became_active":"2023-11-15T01:40:20.246469+0000","last_became_peered":"2023-11-15T01:40:20.246469+0000","last_unstale":"2023-11-15T01:40:20.634086+0000","last_undegraded":"2023-11-15T01:40:20.634086+0000","last_fullsized":"2023-11-15T01:40:20.634086+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.630698+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T01:40:20.630698+0000","last_peered":"2023-11-15T01:40:20.630698+0000","last_clean":"2023-11-15T01:40:20.630698+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T01:40:20.630698+0000","last_undegraded":"2023-11-15T01:40:20.630698+0000","last_fullsized":"2023-11-15T01:40:20.630698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637913+0000","last_change":"2023-11-15T01:40:20.633216+0000","last_active":"2023-11-15T01:40:20.637913+0000","last_peered":"2023-11-15T01:40:20.637913+0000","last_clean":"2023-11-15T01:40:20.637913+0000","last_became_active":"2023-11-15T01:40:20.632940+0000","last_became_peered":"2023-11-15T01:40:20.632940+0000","last_unstale":"2023-11-15T01:40:20.637913+0000","last_undegraded":"2023-11-15T01:40:20.637913+0000","last_fullsized":"2023-11-15T01:40:20.637913+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.628043+0000","last_change":"2023-11-15T01:40:20.238543+0000","last_active":"2023-11-15T01:40:20.628043+0000","last_peered":"2023-11-15T01:40:20.628043+0000","last_clean":"2023-11-15T01:40:20.628043+0000","last_became_active":"2023-11-15T01:40:20.238077+0000","last_became_peered":"2023-11-15T01:40:20.238077+0000","last_unstale":"2023-11-15T01:40:20.628043+0000","last_undegraded":"2023-11-15T01:40:20.628043+0000","last_fullsized":"2023-11-15T01:40:20.628043+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.634389+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T01:40:20.634389+0000","last_peered":"2023-11-15T01:40:20.634389+0000","last_clean":"2023-11-15T01:40:20.634389+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T01:40:20.634389+0000","last_undegraded":"2023-11-15T01:40:20.634389+0000","last_fullsized":"2023-11-15T01:40:20.634389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.647346+0000","last_change":"2023-11-15T01:40:20.638187+0000","last_active":"2023-11-15T01:40:20.647346+0000","last_peered":"2023-11-15T01:40:20.647346+0000","last_clean":"2023-11-15T01:40:20.647346+0000","last_became_active":"2023-11-15T01:40:20.637942+0000","last_became_peered":"2023-11-15T01:40:20.637942+0000","last_unstale":"2023-11-15T01:40:20.647346+0000","last_undegraded":"2023-11-15T01:40:20.647346+0000","last_fullsized":"2023-11-15T01:40:20.647346+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"140'3","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.645808+0000","last_change":"2023-11-15T01:40:20.247727+0000","last_active":"2023-11-15T01:40:20.645808+0000","last_peered":"2023-11-15T01:40:20.645808+0000","last_clean":"2023-11-15T01:40:20.645808+0000","last_became_active":"2023-11-15T01:40:20.247443+0000","last_became_peered":"2023-11-15T01:40:20.247443+0000","last_unstale":"2023-11-15T01:40:20.645808+0000","last_undegraded":"2023-11-15T01:40:20.645808+0000","last_fullsized":"2023-11-15T01:40:20.645808+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.628283+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T01:40:20.628283+0000","last_peered":"2023-11-15T01:40:20.628283+0000","last_clean":"2023-11-15T01:40:20.628283+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T01:40:20.628283+0000","last_undegraded":"2023-11-15T01:40:20.628283+0000","last_fullsized":"2023-11-15T01:40:20.628283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.637942+0000","last_change":"2023-11-15T01:40:20.632398+0000","last_active":"2023-11-15T01:40:20.637942+0000","last_peered":"2023-11-15T01:40:20.637942+0000","last_clean":"2023-11-15T01:40:20.637942+0000","last_became_active":"2023-11-15T01:40:20.632020+0000","last_became_peered":"2023-11-15T01:40:20.632020+0000","last_unstale":"2023-11-15T01:40:20.637942+0000","last_undegraded":"2023-11-15T01:40:20.637942+0000","last_fullsized":"2023-11-15T01:40:20.637942+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:20.218542+0000","last_clean_scrub_stamp":"2023-11-15T01:40:20.218542+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.646627+0000","last_change":"2023-11-15T01:40:20.242601+0000","last_active":"2023-11-15T01:40:20.646627+0000","last_peered":"2023-11-15T01:40:20.646627+0000","last_clean":"2023-11-15T01:40:20.646627+0000","last_became_active":"2023-11-15T01:40:20.242275+0000","last_became_peered":"2023-11-15T01:40:20.242275+0000","last_unstale":"2023-11-15T01:40:20.646627+0000","last_undegraded":"2023-11-15T01:40:20.646627+0000","last_fullsized":"2023-11-15T01:40:20.646627+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:40:19.214384+0000","last_clean_scrub_stamp":"2023-11-15T01:40:19.214384+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":128,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-11-15T01:40:20.625034+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T01:40:20.625034+0000","last_peered":"2023-11-15T01:40:20.625034+0000","last_clean":"2023-11-15T01:40:20.625034+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T01:40:20.625034+0000","last_undegraded":"2023-11-15T01:40:20.625034+0000","last_fullsized":"2023-11-15T01:40:20.625034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575071,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302912,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068928,"statfs":{"total":96636764160,"available":96326582272,"internally_reserved":0,"allocated":1761280,"data_stored":915404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71999999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.505},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.33800000000000002,"15min":0.248},"max":{"1min":0.751,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.63800000000000001}]},{"osd":1,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.28999999999999998},"max":{"1min":0.747,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.42799999999999999,"5min":0.34499999999999997,"15min":0.27500000000000002},"max":{"1min":0.76300000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.38200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73699999999999999,"5min":0.82299999999999995,"15min":0.82599999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.309},"max":{"1min":0.77300000000000002,"5min":0.875,"15min":0.875},"last":0.56000000000000005}]},{"osd":3,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.85999999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.44800000000000001,"5min":0.373,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.59699999999999998}]},{"osd":4,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47699999999999998,"15min":0.46700000000000003},"min":{"1min":0.28399999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.67400000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.316},"max":{"1min":0.77000000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.624}]},{"osd":5,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.317,"5min":0.26500000000000001,"15min":0.23499999999999999},"max":{"1min":0.75,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.317,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66800000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.61099999999999999}]},{"osd":6,"last update":"Wed Nov 15 01:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.82999999999999996,"15min":1.0129999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.34200000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79400000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575072,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1753088,"data_stored":915764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.42899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72499999999999998,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.503},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73099999999999998,"5min":0.77800000000000002,"15min":0.89000000000000001},"last":0.39700000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.39000000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.83099999999999996},"last":0.439},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.33100000000000002,"15min":0.32100000000000001},"max":{"1min":0.72999999999999998,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73399999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.46100000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76300000000000001,"5min":1.746,"15min":1.746},"last":0.41399999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.38,"5min":0.371,"15min":0.307},"max":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.91300000000000003},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.78400000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51800000000000002}]},{"osd":4,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.32400000000000001,"5min":0.28899999999999998,"15min":0.26600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.52400000000000002},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.25800000000000001},"max":{"1min":0.79700000000000004,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.48999999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76800000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.38},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.38900000000000001,"5min":0.32000000000000001,"15min":0.30399999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.82599999999999996},"last":0.56200000000000006}]},{"osd":7,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.504,"15min":0.503},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.29899999999999999},"max":{"1min":0.83699999999999997,"5min":0.875,"15min":0.875},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80700000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575073,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1753088,"data_stored":915232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.36099999999999999,"15min":0.376},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.24299999999999999},"max":{"1min":0.55000000000000004,"5min":0.59099999999999997,"15min":0.73699999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.40200000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.34399999999999997}]},{"osd":2,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.375,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58399999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42799999999999999,"15min":0.438},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.26200000000000001},"max":{"1min":0.66300000000000003,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.29299999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.55800000000000005,"15min":0.52200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71099999999999997,"5min":9.641,"15min":9.641},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53500000000000003,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.28599999999999998},"max":{"1min":0.71799999999999997,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.312}]},{"osd":4,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.45100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1,"5min":1,"15min":1},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.61599999999999999,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.90800000000000003,"5min":1.006,"15min":1.006},"last":0.57699999999999996}]},{"osd":5,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61199999999999999,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.45300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0009999999999999,"5min":1.111,"15min":1.111},"last":0.55900000000000005}]},{"osd":6,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.44,"15min":0.42799999999999999},"max":{"1min":1.0349999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0449999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.54100000000000004}]},{"osd":7,"last update":"Wed Nov 15 01:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66100000000000003,"15min":0.68799999999999994},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0169999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.67800000000000005,"15min":0.69099999999999995},"min":{"1min":0.501,"5min":0.434,"15min":0.434},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.79200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575071,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302912,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068928,"statfs":{"total":96636764160,"available":96326582272,"internally_reserved":0,"allocated":1761280,"data_stored":916678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.371},"min":{"1min":0.27300000000000002,"5min":0.22600000000000001,"15min":0.20499999999999999},"max":{"1min":0.495,"5min":0.54200000000000004,"15min":2.024},"last":0.375},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.39600000000000002,"15min":0.41499999999999998},"min":{"1min":0.24399999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52200000000000002,"5min":0.64700000000000002,"15min":1.9490000000000001},"last":0.26900000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36299999999999999,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":1.768},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41299999999999998,"15min":0.437},"min":{"1min":0.28000000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":1.982},"last":0.33500000000000002}]},{"osd":3,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42199999999999999,"15min":0.435},"min":{"1min":0.30199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58999999999999997,"5min":0.63100000000000001,"15min":2.0579999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.30199999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.64900000000000002,"5min":0.67900000000000005,"15min":1.7989999999999999},"last":0.32500000000000001}]},{"osd":4,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40400000000000003},"max":{"1min":0.83599999999999997,"5min":1.018,"15min":1.018},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63300000000000001,"15min":0.65300000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79600000000000004,"5min":0.98899999999999999,"15min":1.7250000000000001},"last":0.61299999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82899999999999996,"5min":0.97899999999999998,"15min":1.881},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":1.056},"last":0.52200000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.36499999999999999},"max":{"1min":0.84499999999999997,"5min":1.04,"15min":1.6830000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64700000000000002,"15min":0.67000000000000004},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90800000000000003,"5min":0.94099999999999995,"15min":1.917},"last":0.55400000000000005}]},{"osd":7,"last update":"Wed Nov 15 01:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.67000000000000004,"15min":0.68700000000000006},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88100000000000001,"5min":1.0089999999999999,"15min":1.843},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.68700000000000006},"min":{"1min":0.47599999999999998,"5min":0.46999999999999997,"15min":0.40899999999999997},"max":{"1min":0.90300000000000002,"5min":1.073,"15min":1.0960000000000001},"last":0.47899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575072,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307004,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064836,"statfs":{"total":96636764160,"available":96322392064,"internally_reserved":0,"allocated":1757184,"data_stored":916172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35499999999999998,"15min":0.36599999999999999},"min":{"1min":0.248,"5min":0.186,"15min":0.186},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.61899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.38,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.56000000000000005,"5min":0.63900000000000001,"15min":0.74299999999999999},"last":0.53700000000000003}]},{"osd":1,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.59199999999999997,"5min":0.745,"15min":0.745},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.58199999999999996,"5min":0.69799999999999995,"15min":0.73499999999999999},"last":0.41099999999999998}]},{"osd":3,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.436,"15min":0.44900000000000001},"min":{"1min":0.32300000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53000000000000003,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.436,"15min":0.441},"min":{"1min":0.24399999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57199999999999995,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.57099999999999995}]},{"osd":4,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.47299999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77300000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61799999999999999,"15min":0.63300000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79000000000000004,"5min":0.91100000000000003,"15min":0.95399999999999996},"last":0.63300000000000001}]},{"osd":5,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.47899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89800000000000002,"5min":1.032,"15min":1.032},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.63500000000000001},"min":{"1min":0.47499999999999998,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":0.81200000000000006,"5min":0.96699999999999997,"15min":0.99399999999999999},"last":0.66500000000000004}]},{"osd":6,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.374},"max":{"1min":0.83699999999999997,"5min":1.002,"15min":1.0389999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.64200000000000002,"15min":0.66500000000000004},"min":{"1min":0.46100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.83199999999999996,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Wed Nov 15 01:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.45400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.92200000000000004,"5min":1.079,"15min":1.079},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65600000000000003,"15min":0.68500000000000005},"min":{"1min":0.434,"5min":0.374,"15min":0.374},"max":{"1min":0.82399999999999995,"5min":0.97899999999999998,"15min":1.0640000000000001},"last":0.78700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575073,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307008,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064832,"statfs":{"total":96636764160,"available":96322387968,"internally_reserved":0,"allocated":1761280,"data_stored":915888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.36399999999999999,"15min":0.374},"min":{"1min":0.27500000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.79900000000000004},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.377,"15min":0.39700000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.49199999999999999,"5min":0.60699999999999998,"15min":0.71499999999999997},"last":0.39300000000000002}]},{"osd":1,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.39000000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51500000000000001,"5min":0.63400000000000001,"15min":0.72899999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.41899999999999998,"15min":0.442},"min":{"1min":0.33000000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.56200000000000006,"5min":0.72499999999999998,"15min":0.747},"last":0.45900000000000002}]},{"osd":2,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.32200000000000001,"5min":0.27300000000000002,"15min":0.23200000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.47299999999999998},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.622,"5min":0.69199999999999995,"15min":0.81999999999999995},"last":0.503}]},{"osd":4,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57599999999999996,"15min":0.60999999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84999999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60599999999999998,"15min":0.625},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":1.389,"15min":1.389},"last":0.81100000000000005}]},{"osd":5,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.63100000000000001},"min":{"1min":0.47199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93600000000000005,"5min":1.512,"15min":1.512},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61399999999999999,"15min":0.63700000000000001},"min":{"1min":0.42099999999999999,"5min":0.374,"15min":0.373},"max":{"1min":0.82299999999999995,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.77700000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92700000000000005,"5min":0.94199999999999995,"15min":1.0980000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.66100000000000003},"min":{"1min":0.45200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.0900000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Wed Nov 15 01:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.66400000000000003},"min":{"1min":0.443,"5min":0.39900000000000002,"15min":0.38700000000000001},"max":{"1min":0.94999999999999996,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64200000000000002,"15min":0.67600000000000005},"min":{"1min":0.48999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90600000000000003,"5min":1.069,"15min":1.1319999999999999},"last":0.76600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575071,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302908,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068932,"statfs":{"total":96636764160,"available":96326586368,"internally_reserved":0,"allocated":1757184,"data_stored":915854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.30399999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74299999999999999,"5min":0.84499999999999997,"15min":0.88},"last":0.313},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.29299999999999998},"max":{"1min":0.749,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.34100000000000003}]},{"osd":1,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.39400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81000000000000005,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.34799999999999998,"15min":0.34699999999999998},"max":{"1min":0.68000000000000005,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.439}]},{"osd":2,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.58499999999999996},"min":{"1min":0.373,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72199999999999998,"5min":2.887,"15min":2.887},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.45800000000000002,"5min":0.37,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":0.92300000000000004,"15min":0.96299999999999997},"last":0.40600000000000003}]},{"osd":3,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.33100000000000002},"max":{"1min":0.73399999999999999,"5min":2.464,"15min":2.464},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63400000000000001,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84799999999999998,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48599999999999999,"15min":0.46899999999999997},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68500000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.49199999999999999},"min":{"1min":0.38900000000000001,"5min":0.29899999999999999,"15min":0.27400000000000002},"max":{"1min":0.66300000000000003,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.42099999999999999}]},{"osd":6,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52300000000000002,"15min":0.495},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.28899999999999998},"max":{"1min":0.72199999999999998,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55000000000000004,"15min":0.52900000000000003},"min":{"1min":0.42599999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.50800000000000001}]},{"osd":7,"last update":"Wed Nov 15 01:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.42099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71799999999999997,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59199999999999997,"15min":0.56699999999999995},"min":{"1min":0.46200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":2.9169999999999998,"15min":2.9169999999999998},"last":0.52000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575071,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1753088,"data_stored":915300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53100000000000003,"15min":0.54500000000000004},"min":{"1min":0.42699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.72199999999999998,"5min":0.78500000000000003,"15min":0.79200000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.78100000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.434}]},{"osd":1,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.53500000000000003,"15min":0.55900000000000005},"min":{"1min":0.35699999999999998,"5min":0.33300000000000002,"15min":0.32600000000000001},"max":{"1min":0.75,"5min":0.78500000000000003,"15min":0.83299999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.42599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.80100000000000005},"last":0.42099999999999999}]},{"osd":2,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53900000000000003,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81200000000000006,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68000000000000005,"5min":0.77100000000000002,"15min":0.84599999999999997},"last":0.48699999999999999}]},{"osd":3,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67900000000000005,"5min":0.77100000000000002,"15min":0.78100000000000003},"last":0.5},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77600000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.29499999999999998,"5min":0.26600000000000001,"15min":0.23899999999999999},"max":{"1min":0.59299999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65500000000000003,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.52200000000000002}]},{"osd":6,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.27600000000000002},"max":{"1min":0.54600000000000004,"5min":0.81599999999999995,"15min":0.83099999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63700000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46400000000000002}]},{"osd":7,"last update":"Wed Nov 15 01:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.497},"min":{"1min":0.378,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.45300000000000001,"5min":0.40100000000000002,"15min":0.33600000000000002},"max":{"1min":0.71099999999999997,"5min":0.82399999999999995,"15min":0.85799999999999998},"last":0.53500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T01:40:29.504 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-15T01:40:29.505 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-15T01:40:29.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.660+0000 7f5032bbe700 1 Processor -- start 2023-11-15T01:40:29.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.661+0000 7f5032bbe700 1 -- start start 2023-11-15T01:40:29.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.661+0000 7f5032bbe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f502c1540a0 0x7f502c0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:29.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.661+0000 7f5032bbe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f502c154480 0x7f502c0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:29.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.661+0000 7f5032bbe700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502c0ca050 con 0x7f502c0c5f40 2023-11-15T01:40:29.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.661+0000 7f5032bbe700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502c0c9440 con 0x7f502c154480 2023-11-15T01:40:29.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.661+0000 7f5032bbe700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c0c9720 con 0x7f502c1540a0 2023-11-15T01:40:29.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.662+0000 7f502bfff700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f502c154480 0x7f502c0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:29.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.662+0000 7f503095a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f502c1540a0 0x7f502c0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:29.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.662+0000 7f502bfff700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f502c154480 0x7f502c0ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:36066/0 (socket says 172.21.15.1:36066) 2023-11-15T01:40:29.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.662+0000 7f502bfff700 1 -- 172.21.15.1:0/2261718432 learned_addr learned my addr 172.21.15.1:0/2261718432 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:29.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.662+0000 7f503095a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f502c1540a0 0x7f502c0ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:36698/0 (socket says 172.21.15.1:36698) 2023-11-15T01:40:29.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.662+0000 7f503115b700 1 --1- 172.21.15.1:0/2261718432 >> v1:172.21.15.141:6789/0 conn(0x7f502c0c5f40 0x7f502c0aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:52234/0 (socket says 172.21.15.1:52234) 2023-11-15T01:40:29.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.662+0000 7f503095a700 1 -- 172.21.15.1:0/2261718432 >> v2:172.21.15.141:3300/0 conn(0x7f502c154480 msgr2=0x7f502c0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:29.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.662+0000 7f503095a700 1 --2- 172.21.15.1:0/2261718432 >> v2:172.21.15.141:3300/0 conn(0x7f502c154480 0x7f502c0ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.662+0000 7f503095a700 1 -- 172.21.15.1:0/2261718432 >> v1:172.21.15.141:6789/0 conn(0x7f502c0c5f40 legacy=0x7f502c0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:29.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.662+0000 7f503095a700 1 -- 172.21.15.1:0/2261718432 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c0c9a00 con 0x7f502c1540a0 2023-11-15T01:40:29.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.662+0000 7f502b7fe700 1 -- 172.21.15.1:0/2261718432 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259213333 0 0) 0x7f502c0ca050 con 0x7f502c0c5f40 2023-11-15T01:40:29.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.662+0000 7f502bfff700 1 --2- 172.21.15.1:0/2261718432 >> v2:172.21.15.141:3300/0 conn(0x7f502c154480 0x7f502c0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:29.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.662+0000 7f503095a700 1 --2- 172.21.15.1:0/2261718432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f502c1540a0 0x7f502c0ca4e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f501c009760 tx=0x7f501c009060).ready entity=mon.2 client_cookie=ab23b5afbe4e0ff7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:29.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.662+0000 7f502b7fe700 1 -- 172.21.15.1:0/2261718432 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c00f510 con 0x7f502c1540a0 2023-11-15T01:40:29.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.663+0000 7f502b7fe700 1 -- 172.21.15.1:0/2261718432 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c00f670 con 0x7f502c1540a0 2023-11-15T01:40:29.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.663+0000 7f502b7fe700 1 -- 172.21.15.1:0/2261718432 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c00f9f0 con 0x7f502c1540a0 2023-11-15T01:40:29.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.663+0000 7f5032bbe700 1 -- 172.21.15.1:0/2261718432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f502c1540a0 msgr2=0x7f502c0ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:29.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.663+0000 7f5032bbe700 1 --2- 172.21.15.1:0/2261718432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f502c1540a0 0x7f502c0ca4e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f501c009760 tx=0x7f501c009060).stop 2023-11-15T01:40:29.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.663+0000 7f5032bbe700 1 -- 172.21.15.1:0/2261718432 shutdown_connections 2023-11-15T01:40:29.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.663+0000 7f5032bbe700 1 --2- 172.21.15.1:0/2261718432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f502c1540a0 0x7f502c0ca4e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.663+0000 7f5032bbe700 1 --2- 172.21.15.1:0/2261718432 >> v2:172.21.15.141:3300/0 conn(0x7f502c154480 0x7f502c0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.663+0000 7f5032bbe700 1 -- 172.21.15.1:0/2261718432 >> 172.21.15.1:0/2261718432 conn(0x7f502c064a70 msgr2=0x7f502c064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:29.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.663+0000 7f5032bbe700 1 -- 172.21.15.1:0/2261718432 shutdown_connections 2023-11-15T01:40:29.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.663+0000 7f5032bbe700 1 -- 172.21.15.1:0/2261718432 wait complete. 2023-11-15T01:40:29.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.664+0000 7f5032bbe700 1 Processor -- start 2023-11-15T01:40:29.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.664+0000 7f5032bbe700 1 -- start start 2023-11-15T01:40:29.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.665+0000 7f5032bbe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f502c0c5f40 0x7f502c14ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:29.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.665+0000 7f5032bbe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f502c1540a0 0x7f502c1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:29.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.665+0000 7f5032bbe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f502c154480 0x7f502c154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:29.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.665+0000 7f5032bbe700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c13c7f0 con 0x7f502c154480 2023-11-15T01:40:29.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.665+0000 7f5032bbe700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c1572b0 con 0x7f502c0c5f40 2023-11-15T01:40:29.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.665+0000 7f5032bbe700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c157590 con 0x7f502c1540a0 2023-11-15T01:40:29.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.665+0000 7f503115b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f502c154480 0x7f502c154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:29.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.665+0000 7f503115b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f502c154480 0x7f502c154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58598/0 (socket says 172.21.15.1:58598) 2023-11-15T01:40:29.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.665+0000 7f503115b700 1 -- 172.21.15.1:0/2465790493 learned_addr learned my addr 172.21.15.1:0/2465790493 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:29.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.665+0000 7f502bfff700 1 --2- 172.21.15.1:0/2465790493 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f502c1540a0 0x7f502c1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:29.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.665+0000 7f503095a700 1 --2- 172.21.15.1:0/2465790493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f502c0c5f40 0x7f502c14ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:29.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.666+0000 7f503115b700 1 -- 172.21.15.1:0/2465790493 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f502c1540a0 msgr2=0x7f502c1569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:29.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.666+0000 7f503115b700 1 --2- 172.21.15.1:0/2465790493 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f502c1540a0 0x7f502c1569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.666+0000 7f503115b700 1 -- 172.21.15.1:0/2465790493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f502c0c5f40 msgr2=0x7f502c14ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:29.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.666+0000 7f503115b700 1 --2- 172.21.15.1:0/2465790493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f502c0c5f40 0x7f502c14ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.666+0000 7f503115b700 1 -- 172.21.15.1:0/2465790493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020009370 con 0x7f502c154480 2023-11-15T01:40:29.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.666+0000 7f503115b700 1 --2- 172.21.15.1:0/2465790493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f502c154480 0x7f502c154ee0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f502400c810 tx=0x7f50240014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:29.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.666+0000 7f5028ff9700 1 -- 172.21.15.1:0/2465790493 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024005c70 con 0x7f502c154480 2023-11-15T01:40:29.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.666+0000 7f5028ff9700 1 -- 172.21.15.1:0/2465790493 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5024005df0 con 0x7f502c154480 2023-11-15T01:40:29.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.666+0000 7f5032bbe700 1 -- 172.21.15.1:0/2465790493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501c0092a0 con 0x7f502c154480 2023-11-15T01:40:29.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.666+0000 7f5028ff9700 1 -- 172.21.15.1:0/2465790493 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024007320 con 0x7f502c154480 2023-11-15T01:40:29.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.666+0000 7f5032bbe700 1 -- 172.21.15.1:0/2465790493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502c157b50 con 0x7f502c154480 2023-11-15T01:40:29.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.667+0000 7f5032bbe700 1 -- 172.21.15.1:0/2465790493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502c06c7e0 con 0x7f502c154480 2023-11-15T01:40:29.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.667+0000 7f5028ff9700 1 -- 172.21.15.1:0/2465790493 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5024007710 con 0x7f502c154480 2023-11-15T01:40:29.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.668+0000 7f5028ff9700 1 --2- 172.21.15.1:0/2465790493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f501805f2c0 0x7f5018061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:29.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.668+0000 7f5028ff9700 1 -- 172.21.15.1:0/2465790493 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f5024079ec0 con 0x7f502c154480 2023-11-15T01:40:29.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.668+0000 7f503095a700 1 --2- 172.21.15.1:0/2465790493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f501805f2c0 0x7f5018061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:29.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.668+0000 7f503095a700 1 --2- 172.21.15.1:0/2465790493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f501805f2c0 0x7f5018061780 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f501c009fd0 tx=0x7f501c017000).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:29.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.672+0000 7f5028ff9700 1 -- 172.21.15.1:0/2465790493 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f502404af10 con 0x7f502c154480 2023-11-15T01:40:29.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.915+0000 7f5032bbe700 1 -- 172.21.15.1:0/2465790493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f502c0c9ce0 con 0x7f502c154480 2023-11-15T01:40:29.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.918+0000 7f5028ff9700 1 -- 172.21.15.1:0/2465790493 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5024018030 con 0x7f502c154480 2023-11-15T01:40:29.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.920+0000 7f5032bbe700 1 -- 172.21.15.1:0/2465790493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f501805f2c0 msgr2=0x7f5018061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:29.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.920+0000 7f5032bbe700 1 --2- 172.21.15.1:0/2465790493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f501805f2c0 0x7f5018061780 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f501c009fd0 tx=0x7f501c017000).stop 2023-11-15T01:40:29.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.920+0000 7f5032bbe700 1 -- 172.21.15.1:0/2465790493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f502c154480 msgr2=0x7f502c154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:29.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.920+0000 7f5032bbe700 1 --2- 172.21.15.1:0/2465790493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f502c154480 0x7f502c154ee0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f502400c810 tx=0x7f50240014a0).stop 2023-11-15T01:40:29.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.920+0000 7f5032bbe700 1 -- 172.21.15.1:0/2465790493 shutdown_connections 2023-11-15T01:40:29.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.920+0000 7f5032bbe700 1 --2- 172.21.15.1:0/2465790493 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f501805f2c0 0x7f5018061780 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.920+0000 7f5032bbe700 1 --2- 172.21.15.1:0/2465790493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f502c154480 0x7f502c154ee0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.920+0000 7f5032bbe700 1 --2- 172.21.15.1:0/2465790493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f502c0c5f40 0x7f502c14ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.920+0000 7f5032bbe700 1 --2- 172.21.15.1:0/2465790493 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f502c1540a0 0x7f502c1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:29.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.920+0000 7f5032bbe700 1 -- 172.21.15.1:0/2465790493 >> 172.21.15.1:0/2465790493 conn(0x7f502c064a70 msgr2=0x7f502c0ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:29.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.920+0000 7f5032bbe700 1 -- 172.21.15.1:0/2465790493 shutdown_connections 2023-11-15T01:40:29.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:29.920+0000 7f5032bbe700 1 -- 172.21.15.1:0/2465790493 wait complete. 2023-11-15T01:40:29.924 INFO:teuthology.orchestra.run.smithi001.stderr:updated caps for client.0 2023-11-15T01:40:29.934 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T01:40:30.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.051+0000 7f907f230700 1 Processor -- start 2023-11-15T01:40:30.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.051+0000 7f907f230700 1 -- start start 2023-11-15T01:40:30.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.051+0000 7f907f230700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9078154150 0x7f9078154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.051+0000 7f907f230700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f90780ab1a0 0x7f9078158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.052+0000 7f907f230700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90780c06f0 con 0x7f90780aa060 2023-11-15T01:40:30.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.052+0000 7f907f230700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90780c09d0 con 0x7f90780ab1a0 2023-11-15T01:40:30.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.052+0000 7f907f230700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9078158820 con 0x7f9078154150 2023-11-15T01:40:30.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.052+0000 7f9077fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f90780ab1a0 0x7f9078158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.052+0000 7f9077fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f90780ab1a0 0x7f9078158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58614/0 (socket says 172.21.15.1:58614) 2023-11-15T01:40:30.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.052+0000 7f9077fff700 1 -- 172.21.15.1:0/3814801805 learned_addr learned my addr 172.21.15.1:0/3814801805 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:30.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.052+0000 7f907cfcc700 1 --2- 172.21.15.1:0/3814801805 >> v2:172.21.15.141:3300/0 conn(0x7f9078154150 0x7f9078154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.052+0000 7f9077fff700 1 -- 172.21.15.1:0/3814801805 >> v2:172.21.15.141:3300/0 conn(0x7f9078154150 msgr2=0x7f9078154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:30.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.052+0000 7f9077fff700 1 --2- 172.21.15.1:0/3814801805 >> v2:172.21.15.141:3300/0 conn(0x7f9078154150 0x7f9078154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.052+0000 7f9077fff700 1 -- 172.21.15.1:0/3814801805 >> v1:172.21.15.141:6789/0 conn(0x7f90780aa060 legacy=0x7f90780c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.052+0000 7f9077fff700 1 -- 172.21.15.1:0/3814801805 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9078158b00 con 0x7f90780ab1a0 2023-11-15T01:40:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.052+0000 7f9077fff700 1 --2- 172.21.15.1:0/3814801805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90780ab1a0 0x7f9078158040 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f907806bfb0 tx=0x7f90680090f0).ready entity=mon.0 client_cookie=460eff9ded250c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.052+0000 7f90777fe700 1 -- 172.21.15.1:0/3814801805 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906800b600 con 0x7f90780ab1a0 2023-11-15T01:40:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.052+0000 7f90777fe700 1 -- 172.21.15.1:0/3814801805 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906800b760 con 0x7f90780ab1a0 2023-11-15T01:40:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.052+0000 7f90777fe700 1 -- 172.21.15.1:0/3814801805 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906800bb00 con 0x7f90780ab1a0 2023-11-15T01:40:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.053+0000 7f907f230700 1 -- 172.21.15.1:0/3814801805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90780ab1a0 msgr2=0x7f9078158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.053+0000 7f907f230700 1 --2- 172.21.15.1:0/3814801805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90780ab1a0 0x7f9078158040 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f907806bfb0 tx=0x7f90680090f0).stop 2023-11-15T01:40:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.053+0000 7f907f230700 1 -- 172.21.15.1:0/3814801805 shutdown_connections 2023-11-15T01:40:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.053+0000 7f907f230700 1 --2- 172.21.15.1:0/3814801805 >> v2:172.21.15.141:3300/0 conn(0x7f9078154150 0x7f9078154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.053+0000 7f907f230700 1 --2- 172.21.15.1:0/3814801805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90780ab1a0 0x7f9078158040 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.053+0000 7f907f230700 1 -- 172.21.15.1:0/3814801805 >> 172.21.15.1:0/3814801805 conn(0x7f9078064aa0 msgr2=0x7f9078064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.053+0000 7f907f230700 1 -- 172.21.15.1:0/3814801805 shutdown_connections 2023-11-15T01:40:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.053+0000 7f907f230700 1 -- 172.21.15.1:0/3814801805 wait complete. 2023-11-15T01:40:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.054+0000 7f907f230700 1 Processor -- start 2023-11-15T01:40:30.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.054+0000 7f907f230700 1 -- start start 2023-11-15T01:40:30.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.055+0000 7f907f230700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90780aa060 0x7f90780b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.055+0000 7f907f230700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90780ab1a0 0x7f90780aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.055+0000 7f907f230700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9078154150 0x7f9078142950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.055+0000 7f907f230700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90781685d0 con 0x7f9078154150 2023-11-15T01:40:30.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.055+0000 7f907f230700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90780af080 con 0x7f90780ab1a0 2023-11-15T01:40:30.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.055+0000 7f907f230700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9078156690 con 0x7f90780aa060 2023-11-15T01:40:30.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.055+0000 7f907d7cd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9078154150 0x7f9078142950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.055+0000 7f907d7cd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9078154150 0x7f9078142950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58626/0 (socket says 172.21.15.1:58626) 2023-11-15T01:40:30.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.055+0000 7f907d7cd700 1 -- 172.21.15.1:0/3624913888 learned_addr learned my addr 172.21.15.1:0/3624913888 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:30.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.055+0000 7f9077fff700 1 --2- 172.21.15.1:0/3624913888 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90780ab1a0 0x7f90780aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.055+0000 7f907cfcc700 1 --2- 172.21.15.1:0/3624913888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90780aa060 0x7f90780b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.056+0000 7f907d7cd700 1 -- 172.21.15.1:0/3624913888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90780aa060 msgr2=0x7f90780b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.056+0000 7f907d7cd700 1 --2- 172.21.15.1:0/3624913888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90780aa060 0x7f90780b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.056+0000 7f907d7cd700 1 -- 172.21.15.1:0/3624913888 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90780ab1a0 msgr2=0x7f90780aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.056+0000 7f907d7cd700 1 --2- 172.21.15.1:0/3624913888 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90780ab1a0 0x7f90780aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.056+0000 7f907d7cd700 1 -- 172.21.15.1:0/3624913888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9068009370 con 0x7f9078154150 2023-11-15T01:40:30.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.056+0000 7f907d7cd700 1 --2- 172.21.15.1:0/3624913888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9078154150 0x7f9078142950 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f906000c470 tx=0x7f9060007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:30.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.056+0000 7f9074ff9700 1 -- 172.21.15.1:0/3624913888 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90600123f0 con 0x7f9078154150 2023-11-15T01:40:30.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.056+0000 7f9074ff9700 1 -- 172.21.15.1:0/3624913888 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9060001e90 con 0x7f9078154150 2023-11-15T01:40:30.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.056+0000 7f907f230700 1 -- 172.21.15.1:0/3624913888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90781687b0 con 0x7f9078154150 2023-11-15T01:40:30.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.056+0000 7f9074ff9700 1 -- 172.21.15.1:0/3624913888 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060012760 con 0x7f9078154150 2023-11-15T01:40:30.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.056+0000 7f907f230700 1 -- 172.21.15.1:0/3624913888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90780ae840 con 0x7f9078154150 2023-11-15T01:40:30.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.057+0000 7f907f230700 1 -- 172.21.15.1:0/3624913888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9078156b40 con 0x7f9078154150 2023-11-15T01:40:30.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.057+0000 7f9074ff9700 1 -- 172.21.15.1:0/3624913888 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f90600113a0 con 0x7f9078154150 2023-11-15T01:40:30.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.057+0000 7f9074ff9700 1 --2- 172.21.15.1:0/3624913888 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f905805f270 0x7f9058061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.058+0000 7f9074ff9700 1 -- 172.21.15.1:0/3624913888 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f9060079a70 con 0x7f9078154150 2023-11-15T01:40:30.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.058+0000 7f907cfcc700 1 --2- 172.21.15.1:0/3624913888 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f905805f270 0x7f9058061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.058+0000 7f907cfcc700 1 --2- 172.21.15.1:0/3624913888 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f905805f270 0x7f9058061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f90700075a0 tx=0x7f90700097b0).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:30.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.061+0000 7f9074ff9700 1 -- 172.21.15.1:0/3624913888 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9060047af0 con 0x7f9078154150 2023-11-15T01:40:30.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.277+0000 7f907f230700 1 -- 172.21.15.1:0/3624913888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f907806c7e0 con 0x7f9078154150 2023-11-15T01:40:30.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.278+0000 7f9074ff9700 1 -- 172.21.15.1:0/3624913888 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f9078156b40 con 0x7f9078154150 2023-11-15T01:40:30.279 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:30.280 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/2941509435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":2941509435},{"type":"v1","addr":"172.21.15.141:6837","nonce":2941509435}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/698727670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":698727670},{"type":"v1","addr":"172.21.15.141:6836","nonce":698727670}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2035210342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2035210342},{"type":"v1","addr":"172.21.15.1:6834","nonce":2035210342}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:40:20.613231+0000","modified":"2023-11-15T01:40:23.624230+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/2320712503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":2320712503},{"type":"v1","addr":"172.21.15.1:6835","nonce":2320712503}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-11-15T01:40:30.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.279+0000 7f907f230700 1 -- 172.21.15.1:0/3624913888 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f905805f270 msgr2=0x7f9058061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.279+0000 7f907f230700 1 --2- 172.21.15.1:0/3624913888 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f905805f270 0x7f9058061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f90700075a0 tx=0x7f90700097b0).stop 2023-11-15T01:40:30.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.279+0000 7f907f230700 1 -- 172.21.15.1:0/3624913888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9078154150 msgr2=0x7f9078142950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.279+0000 7f907f230700 1 --2- 172.21.15.1:0/3624913888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9078154150 0x7f9078142950 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f906000c470 tx=0x7f9060007d70).stop 2023-11-15T01:40:30.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.280+0000 7f907f230700 1 -- 172.21.15.1:0/3624913888 shutdown_connections 2023-11-15T01:40:30.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.280+0000 7f907f230700 1 --2- 172.21.15.1:0/3624913888 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f905805f270 0x7f9058061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.280+0000 7f907f230700 1 --2- 172.21.15.1:0/3624913888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9078154150 0x7f9078142950 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.280+0000 7f907f230700 1 --2- 172.21.15.1:0/3624913888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90780aa060 0x7f90780b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.280+0000 7f907f230700 1 --2- 172.21.15.1:0/3624913888 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90780ab1a0 0x7f90780aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.280+0000 7f907f230700 1 -- 172.21.15.1:0/3624913888 >> 172.21.15.1:0/3624913888 conn(0x7f9078064aa0 msgr2=0x7f9078152ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:30.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.280+0000 7f907f230700 1 -- 172.21.15.1:0/3624913888 shutdown_connections 2023-11-15T01:40:30.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.280+0000 7f907f230700 1 -- 172.21.15.1:0/3624913888 wait complete. 2023-11-15T01:40:30.284 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 63 2023-11-15T01:40:30.696 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-15T01:40:20.613231+0000', 'modified': '2023-11-15T01:40:23.624230+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8091}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8091': {'gid': 8091, 'name': 'c', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.1:6835/2320712503', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6833', 'nonce': 2320712503}, {'type': 'v1', 'addr': '172.21.15.1:6835', 'nonce': 2320712503}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-15T01:40:30.696 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-15T01:40:30.697 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-15T01:40:30.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.817+0000 7f58c0d0c700 1 Processor -- start 2023-11-15T01:40:30.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.817+0000 7f58c0d0c700 1 -- start start 2023-11-15T01:40:30.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58c0d0c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f58bc151e10 0x7f58bc155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58c0d0c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f58bc0c86b0 0x7f58bc0aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58c0d0c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58bc0c7980 con 0x7f58bc0c98b0 2023-11-15T01:40:30.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58c0d0c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58bc0c8b10 con 0x7f58bc0c86b0 2023-11-15T01:40:30.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58c0d0c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58bc0aa5c0 con 0x7f58bc151e10 2023-11-15T01:40:30.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58baffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f58bc0c86b0 0x7f58bc0aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58bbfff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f58bc0c98b0 0x7f58bc0c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51962/0 (socket says 172.21.15.1:51962) 2023-11-15T01:40:30.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58bbfff700 1 -- 172.21.15.1:0/1334617914 learned_addr learned my addr 172.21.15.1:0/1334617914 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:30.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/1334617914 >> v2:172.21.15.141:3300/0 conn(0x7f58bc151e10 0x7f58bc155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58baffd700 1 -- 172.21.15.1:0/1334617914 >> v2:172.21.15.141:3300/0 conn(0x7f58bc151e10 msgr2=0x7f58bc155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:30.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58baffd700 1 --2- 172.21.15.1:0/1334617914 >> v2:172.21.15.141:3300/0 conn(0x7f58bc151e10 0x7f58bc155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58baffd700 1 -- 172.21.15.1:0/1334617914 >> v1:172.21.15.1:6789/0 conn(0x7f58bc0c98b0 legacy=0x7f58bc0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58ba7fc700 1 -- 172.21.15.1:0/1334617914 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886902657 0 0) 0x7f58bc0c7980 con 0x7f58bc0c98b0 2023-11-15T01:40:30.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58baffd700 1 -- 172.21.15.1:0/1334617914 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc0aa890 con 0x7f58bc0c86b0 2023-11-15T01:40:30.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/1334617914 >> v2:172.21.15.141:3300/0 conn(0x7f58bc151e10 0x7f58bc155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:40:30.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.818+0000 7f58baffd700 1 --2- 172.21.15.1:0/1334617914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58bc0c86b0 0x7f58bc0aa0d0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f58bc084780 tx=0x7f58b0009060).ready entity=mon.0 client_cookie=f0a229f30a5b4235 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:30.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.819+0000 7f58ba7fc700 1 -- 172.21.15.1:0/1334617914 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b000b580 con 0x7f58bc0c86b0 2023-11-15T01:40:30.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.819+0000 7f58ba7fc700 1 -- 172.21.15.1:0/1334617914 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b000b6e0 con 0x7f58bc0c86b0 2023-11-15T01:40:30.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.819+0000 7f58ba7fc700 1 -- 172.21.15.1:0/1334617914 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b000ba60 con 0x7f58bc0c86b0 2023-11-15T01:40:30.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.819+0000 7f58c0d0c700 1 -- 172.21.15.1:0/1334617914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58bc0c86b0 msgr2=0x7f58bc0aa0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.819+0000 7f58c0d0c700 1 --2- 172.21.15.1:0/1334617914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58bc0c86b0 0x7f58bc0aa0d0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f58bc084780 tx=0x7f58b0009060).stop 2023-11-15T01:40:30.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.819+0000 7f58c0d0c700 1 -- 172.21.15.1:0/1334617914 shutdown_connections 2023-11-15T01:40:30.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.819+0000 7f58c0d0c700 1 --2- 172.21.15.1:0/1334617914 >> v2:172.21.15.141:3300/0 conn(0x7f58bc151e10 0x7f58bc155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.819+0000 7f58c0d0c700 1 --2- 172.21.15.1:0/1334617914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58bc0c86b0 0x7f58bc0aa0d0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.819+0000 7f58c0d0c700 1 -- 172.21.15.1:0/1334617914 >> 172.21.15.1:0/1334617914 conn(0x7f58bc0947e0 msgr2=0x7f58bc06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:30.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.819+0000 7f58c0d0c700 1 -- 172.21.15.1:0/1334617914 shutdown_connections 2023-11-15T01:40:30.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.819+0000 7f58c0d0c700 1 -- 172.21.15.1:0/1334617914 wait complete. 2023-11-15T01:40:30.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.820+0000 7f58c0d0c700 1 Processor -- start 2023-11-15T01:40:30.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.820+0000 7f58c0d0c700 1 -- start start 2023-11-15T01:40:30.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.821+0000 7f58c0d0c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58bc0c86b0 0x7f58bc13dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.821+0000 7f58c0d0c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58bc0c98b0 0x7f58bc0afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.821+0000 7f58c0d0c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58bc151e10 0x7f58bc0b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.821+0000 7f58c0d0c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0b1110 con 0x7f58bc151e10 2023-11-15T01:40:30.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.821+0000 7f58c0d0c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0ab040 con 0x7f58bc0c98b0 2023-11-15T01:40:30.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.821+0000 7f58c0d0c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0b0870 con 0x7f58bc0c86b0 2023-11-15T01:40:30.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.821+0000 7f58bbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58bc151e10 0x7f58bc0b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.821+0000 7f58bbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58bc151e10 0x7f58bc0b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58648/0 (socket says 172.21.15.1:58648) 2023-11-15T01:40:30.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.821+0000 7f58bbfff700 1 -- 172.21.15.1:0/813329064 learned_addr learned my addr 172.21.15.1:0/813329064 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:30.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.821+0000 7f58baffd700 1 --2- 172.21.15.1:0/813329064 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58bc0c98b0 0x7f58bc0afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.821+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/813329064 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58bc0c86b0 0x7f58bc13dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.822+0000 7f58bbfff700 1 -- 172.21.15.1:0/813329064 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58bc0c86b0 msgr2=0x7f58bc13dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.822+0000 7f58bbfff700 1 --2- 172.21.15.1:0/813329064 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58bc0c86b0 0x7f58bc13dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.822+0000 7f58bbfff700 1 -- 172.21.15.1:0/813329064 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58bc0c98b0 msgr2=0x7f58bc0afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.822+0000 7f58bbfff700 1 --2- 172.21.15.1:0/813329064 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58bc0c98b0 0x7f58bc0afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.822+0000 7f58bbfff700 1 -- 172.21.15.1:0/813329064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b00092a0 con 0x7f58bc151e10 2023-11-15T01:40:30.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.822+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/813329064 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58bc0c86b0 0x7f58bc13dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:30.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.822+0000 7f58bbfff700 1 --2- 172.21.15.1:0/813329064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58bc151e10 0x7f58bc0b0210 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f58b400c810 tx=0x7f58b4007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:30.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.822+0000 7f58a37fe700 1 -- 172.21.15.1:0/813329064 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4005d30 con 0x7f58bc151e10 2023-11-15T01:40:30.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.822+0000 7f58a37fe700 1 -- 172.21.15.1:0/813329064 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b4005e90 con 0x7f58bc151e10 2023-11-15T01:40:30.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.822+0000 7f58c0d0c700 1 -- 172.21.15.1:0/813329064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58bc0b0b50 con 0x7f58bc151e10 2023-11-15T01:40:30.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.822+0000 7f58a37fe700 1 -- 172.21.15.1:0/813329064 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4007360 con 0x7f58bc151e10 2023-11-15T01:40:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.822+0000 7f58c0d0c700 1 -- 172.21.15.1:0/813329064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc0ae270 con 0x7f58bc151e10 2023-11-15T01:40:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.823+0000 7f58a37fe700 1 -- 172.21.15.1:0/813329064 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f58b4007750 con 0x7f58bc151e10 2023-11-15T01:40:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.824+0000 7f58a37fe700 1 --2- 172.21.15.1:0/813329064 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f58a805f270 0x7f58a8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.824+0000 7f58a37fe700 1 -- 172.21.15.1:0/813329064 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f58b407a5a0 con 0x7f58bc151e10 2023-11-15T01:40:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.824+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/813329064 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f58a805f270 0x7f58a8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.824+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/813329064 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f58a805f270 0x7f58a8061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f58ac006fd0 tx=0x7f58ac008040).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:30.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.826+0000 7f58d3907b80 1 Processor -- start 2023-11-15T01:40:30.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.826+0000 7f58d3907b80 1 -- start start 2023-11-15T01:40:30.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58d3907b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x560661041e40 0x560661285880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58d3907b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5606612ce4e0 0x560661285d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58d3907b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612adcf0 0x5606612807e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58d3907b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x56066124b060 con 0x5606612adcf0 2023-11-15T01:40:30.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58d3907b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606611c21f0 con 0x560661041e40 2023-11-15T01:40:30.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58d3907b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606611d7440 con 0x5606612ce4e0 2023-11-15T01:40:30.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58bbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612adcf0 0x5606612807e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58bbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612adcf0 0x5606612807e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58660/0 (socket says 172.21.15.1:58660) 2023-11-15T01:40:30.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58bbfff700 1 -- 172.21.15.1:0/1305913904 learned_addr learned my addr 172.21.15.1:0/1305913904 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:30.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/1305913904 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x560661041e40 0x560661285880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58baffd700 1 --2- 172.21.15.1:0/1305913904 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5606612ce4e0 0x560661285d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58bbfff700 1 -- 172.21.15.1:0/1305913904 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5606612ce4e0 msgr2=0x560661285d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:30.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58bbfff700 1 --2- 172.21.15.1:0/1305913904 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5606612ce4e0 0x560661285d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58bbfff700 1 -- 172.21.15.1:0/1305913904 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x560661041e40 msgr2=0x560661285880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:30.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58bbfff700 1 --2- 172.21.15.1:0/1305913904 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x560661041e40 0x560661285880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58bbfff700 1 -- 172.21.15.1:0/1305913904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606611d0620 con 0x5606612adcf0 2023-11-15T01:40:30.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58baffd700 1 --2- 172.21.15.1:0/1305913904 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5606612ce4e0 0x560661285d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:40:30.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/1305913904 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x560661041e40 0x560661285880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:40:30.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58bbfff700 1 --2- 172.21.15.1:0/1305913904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612adcf0 0x5606612807e0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f58b4078790 tx=0x7f58b400f000).ready entity=mon.0 client_cookie=83dfb47598049d47 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:30.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58a0ff9700 1 -- 172.21.15.1:0/1305913904 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4058030 con 0x5606612adcf0 2023-11-15T01:40:30.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58a0ff9700 1 -- 172.21.15.1:0/1305913904 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b404d330 con 0x5606612adcf0 2023-11-15T01:40:30.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.827+0000 7f58a0ff9700 1 -- 172.21.15.1:0/1305913904 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b404d590 con 0x5606612adcf0 2023-11-15T01:40:30.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.828+0000 7f58d3907b80 1 -- 172.21.15.1:0/1305913904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612adcf0 msgr2=0x5606612807e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.828+0000 7f58d3907b80 1 --2- 172.21.15.1:0/1305913904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612adcf0 0x5606612807e0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f58b4078790 tx=0x7f58b400f000).stop 2023-11-15T01:40:30.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.828+0000 7f58d3907b80 1 -- 172.21.15.1:0/1305913904 shutdown_connections 2023-11-15T01:40:30.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.828+0000 7f58d3907b80 1 --2- 172.21.15.1:0/1305913904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612adcf0 0x5606612807e0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.828+0000 7f58d3907b80 1 --2- 172.21.15.1:0/1305913904 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x560661041e40 0x560661285880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.828+0000 7f58d3907b80 1 --2- 172.21.15.1:0/1305913904 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5606612ce4e0 0x560661285d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.828+0000 7f58d3907b80 1 -- 172.21.15.1:0/1305913904 >> 172.21.15.1:0/1305913904 conn(0x5606610ef4a0 msgr2=0x5606612ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:30.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.828+0000 7f58d3907b80 1 -- 172.21.15.1:0/1305913904 shutdown_connections 2023-11-15T01:40:30.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.828+0000 7f58d3907b80 1 -- 172.21.15.1:0/1305913904 wait complete. 2023-11-15T01:40:30.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.829+0000 7f58d3907b80 1 -- start start 2023-11-15T01:40:30.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.829+0000 7f58d3907b80 1 Processor -- start 2023-11-15T01:40:30.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58d3907b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x560661041e40 0x5606612ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58d3907b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5606612adcf0 0x5606612ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58d3907b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612ce4e0 0x5606612ab710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58d3907b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606611d7580 con 0x5606612ce4e0 2023-11-15T01:40:30.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58d3907b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606611d7800 con 0x560661041e40 2023-11-15T01:40:30.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58d3907b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606611a2e10 con 0x5606612adcf0 2023-11-15T01:40:30.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58d3907b80 10 client.0 ll_register_callbacks cb 0x560661245640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:40:30.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58bbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612ce4e0 0x5606612ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58bbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612ce4e0 0x5606612ab710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58664/0 (socket says 172.21.15.1:58664) 2023-11-15T01:40:30.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58bbfff700 1 -- 172.21.15.1:0/934774661 learned_addr learned my addr 172.21.15.1:0/934774661 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:30.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/934774661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x560661041e40 0x5606612ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58baffd700 1 --2- 172.21.15.1:0/934774661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5606612adcf0 0x5606612ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58bbfff700 1 -- 172.21.15.1:0/934774661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5606612adcf0 msgr2=0x5606612ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:30.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58bbfff700 1 --2- 172.21.15.1:0/934774661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5606612adcf0 0x5606612ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58bbfff700 1 -- 172.21.15.1:0/934774661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x560661041e40 msgr2=0x5606612ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:30.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58bbfff700 1 --2- 172.21.15.1:0/934774661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x560661041e40 0x5606612ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58bbfff700 1 -- 172.21.15.1:0/934774661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc0ae270 con 0x5606612ce4e0 2023-11-15T01:40:30.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58bbfff700 1 --2- 172.21.15.1:0/934774661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612ce4e0 0x5606612ab710 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f58b4078840 tx=0x7f58b4051000).ready entity=mon.0 client_cookie=5a2a07e392311558 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:30.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f5899ffb700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:40:30.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f5899ffb700 1 -- 172.21.15.1:0/934774661 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4058020 con 0x5606612ce4e0 2023-11-15T01:40:30.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f5899ffb700 1 -- 172.21.15.1:0/934774661 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f58b4059070 con 0x5606612ce4e0 2023-11-15T01:40:30.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58d3907b80 1 -- 172.21.15.1:0/934774661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560661279720 con 0x5606612ce4e0 2023-11-15T01:40:30.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f5899ffb700 1 -- 172.21.15.1:0/934774661 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58b4011e40 con 0x5606612ce4e0 2023-11-15T01:40:30.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58d3907b80 10 client.8286 fetch_fsmap learned FSMap version 63 2023-11-15T01:40:30.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.830+0000 7f58d3907b80 1 -- 172.21.15.1:0/934774661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x5606611cb9c0 con 0x5606612ce4e0 2023-11-15T01:40:30.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.831+0000 7f5899ffb700 1 -- 172.21.15.1:0/934774661 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560661279720 con 0x5606612ce4e0 2023-11-15T01:40:30.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.831+0000 7f5899ffb700 1 -- 172.21.15.1:0/934774661 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 63) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f58b404e6e0 con 0x5606612ce4e0 2023-11-15T01:40:30.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.831+0000 7f58d3907b80 10 client.8286 fetch_fsmap finished waiting for FSMap version 63 2023-11-15T01:40:30.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.831+0000 7f58d3907b80 10 client.8286 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-15T01:40:30.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.831+0000 7f58d3907b80 20 client.8286 populate_metadata read hostname 'smithi001' 2023-11-15T01:40:30.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.831+0000 7f58d3907b80 1 --2- 172.21.15.1:0/934774661 >> [v2:172.21.15.1:6833/2320712503,v1:172.21.15.1:6835/2320712503] conn(0x5606612b07b0 0x5606612aa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.831+0000 7f58d3907b80 4 client.8286 mds_command: new command op to 8091 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-15T01:40:30.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.831+0000 7f58d3907b80 1 -- 172.21.15.1:0/934774661 --> [v2:172.21.15.1:6833/2320712503,v1:172.21.15.1:6835/2320712503] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56066103dca0 con 0x5606612b07b0 2023-11-15T01:40:30.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.831+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/934774661 >> [v2:172.21.15.1:6833/2320712503,v1:172.21.15.1:6835/2320712503] conn(0x5606612b07b0 0x5606612aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.831+0000 7f5899ffb700 10 client.8286 ms_handle_connect on v2:172.21.15.1:6833/2320712503 2023-11-15T01:40:30.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.831+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/934774661 >> [v2:172.21.15.1:6833/2320712503,v1:172.21.15.1:6835/2320712503] conn(0x5606612b07b0 0x5606612aa450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9d7340c57d7836a3 server_cookie=9451f81651a79db0 in_seq=0 out_seq=0 2023-11-15T01:40:30.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.832+0000 7f5899ffb700 1 -- 172.21.15.1:0/934774661 <== mds.0 v2:172.21.15.1:6833/2320712503 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x56066103dca0 con 0x5606612b07b0 2023-11-15T01:40:30.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.832+0000 7f5899ffb700 10 client.8286 handle_command_reply: tid=0 2023-11-15T01:40:30.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.832+0000 7f58d3907b80 1 client.8286 shutdown 2023-11-15T01:40:30.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.832+0000 7f58d3907b80 1 -- 172.21.15.1:0/934774661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612ce4e0 msgr2=0x5606612ab710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.832+0000 7f58d3907b80 1 --2- 172.21.15.1:0/934774661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612ce4e0 0x5606612ab710 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f58b4078840 tx=0x7f58b4051000).stop 2023-11-15T01:40:30.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.832+0000 7f58d3907b80 1 -- 172.21.15.1:0/934774661 shutdown_connections 2023-11-15T01:40:30.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.832+0000 7f58d3907b80 1 --2- 172.21.15.1:0/934774661 >> [v2:172.21.15.1:6833/2320712503,v1:172.21.15.1:6835/2320712503] conn(0x5606612b07b0 0x5606612aa450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.832+0000 7f58d3907b80 1 --2- 172.21.15.1:0/934774661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612ce4e0 0x5606612ab710 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.832+0000 7f58d3907b80 1 --2- 172.21.15.1:0/934774661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x560661041e40 0x5606612ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.832+0000 7f58d3907b80 1 --2- 172.21.15.1:0/934774661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5606612adcf0 0x5606612ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.832+0000 7f5899ffb700 0 client.8286 ms_handle_reset on v2:172.21.15.1:6833/2320712503 2023-11-15T01:40:30.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.832+0000 7f58d3907b80 1 -- 172.21.15.1:0/934774661 >> 172.21.15.1:0/934774661 conn(0x5606610ef4a0 msgr2=0x560661286b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:30.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.832+0000 7f58d3907b80 1 -- 172.21.15.1:0/934774661 shutdown_connections 2023-11-15T01:40:30.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.832+0000 7f58d3907b80 1 -- 172.21.15.1:0/934774661 wait complete. 2023-11-15T01:40:30.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.832+0000 7f58d3907b80 20 client.8286 trim_cache size 0 max 16384 2023-11-15T01:40:30.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.849+0000 7f58d3907b80 1 Processor -- start 2023-11-15T01:40:30.864 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.849+0000 7f58d3907b80 1 -- start start 2023-11-15T01:40:30.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.849+0000 7f58d3907b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x560661041e40 0x560661282990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.849+0000 7f58d3907b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612adcf0 0x56066127fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.849+0000 7f58d3907b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5606612ce4e0 0x5606612afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.849+0000 7f58d3907b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x560661282e80 con 0x5606612adcf0 2023-11-15T01:40:30.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.849+0000 7f58d3907b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606612dd140 con 0x5606612ce4e0 2023-11-15T01:40:30.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.849+0000 7f58d3907b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606612af3f0 con 0x560661041e40 2023-11-15T01:40:30.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58baffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612adcf0 0x56066127fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58baffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612adcf0 0x56066127fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58666/0 (socket says 172.21.15.1:58666) 2023-11-15T01:40:30.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58baffd700 1 -- 172.21.15.1:0/1321605906 learned_addr learned my addr 172.21.15.1:0/1321605906 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:30.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/1321605906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x560661041e40 0x560661282990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58bbfff700 1 --2- 172.21.15.1:0/1321605906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5606612ce4e0 0x5606612afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58baffd700 1 -- 172.21.15.1:0/1321605906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x560661041e40 msgr2=0x560661282990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:30.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58baffd700 1 --2- 172.21.15.1:0/1321605906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x560661041e40 0x560661282990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58baffd700 1 -- 172.21.15.1:0/1321605906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5606612ce4e0 msgr2=0x5606612afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:30.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58baffd700 1 --2- 172.21.15.1:0/1321605906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5606612ce4e0 0x5606612afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58baffd700 1 -- 172.21.15.1:0/1321605906 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606611cb710 con 0x5606612adcf0 2023-11-15T01:40:30.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/1321605906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x560661041e40 0x560661282990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:40:30.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58bbfff700 1 --2- 172.21.15.1:0/1321605906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5606612ce4e0 0x5606612afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T01:40:30.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58baffd700 1 --2- 172.21.15.1:0/1321605906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612adcf0 0x56066127fd90 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f58b000b6b0 tx=0x7f58b0017000).ready entity=mon.0 client_cookie=b57d3c6d8c224781 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:30.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58a17fa700 1 -- 172.21.15.1:0/1321605906 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0021070 con 0x5606612adcf0 2023-11-15T01:40:30.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58a17fa700 1 -- 172.21.15.1:0/1321605906 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b0000bc0 con 0x5606612adcf0 2023-11-15T01:40:30.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.850+0000 7f58a17fa700 1 -- 172.21.15.1:0/1321605906 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b000ba60 con 0x5606612adcf0 2023-11-15T01:40:30.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.851+0000 7f58d3907b80 1 -- 172.21.15.1:0/1321605906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612adcf0 msgr2=0x56066127fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.851+0000 7f58d3907b80 1 --2- 172.21.15.1:0/1321605906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612adcf0 0x56066127fd90 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f58b000b6b0 tx=0x7f58b0017000).stop 2023-11-15T01:40:30.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.851+0000 7f58d3907b80 1 -- 172.21.15.1:0/1321605906 shutdown_connections 2023-11-15T01:40:30.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.851+0000 7f58d3907b80 1 --2- 172.21.15.1:0/1321605906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5606612ce4e0 0x5606612afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.851+0000 7f58d3907b80 1 --2- 172.21.15.1:0/1321605906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x560661041e40 0x560661282990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.851+0000 7f58d3907b80 1 --2- 172.21.15.1:0/1321605906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612adcf0 0x56066127fd90 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.851+0000 7f58d3907b80 1 -- 172.21.15.1:0/1321605906 >> 172.21.15.1:0/1321605906 conn(0x5606610ef4a0 msgr2=0x56066127ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:30.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.851+0000 7f58d3907b80 1 -- 172.21.15.1:0/1321605906 shutdown_connections 2023-11-15T01:40:30.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.851+0000 7f58d3907b80 1 -- 172.21.15.1:0/1321605906 wait complete. 2023-11-15T01:40:30.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.851+0000 7f58d3907b80 1 -- start start 2023-11-15T01:40:30.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.851+0000 7f58d3907b80 1 Processor -- start 2023-11-15T01:40:30.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58d3907b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x560661041e40 0x5606612ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58d3907b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5606612adcf0 0x5606612afb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58d3907b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612ce4e0 0x5606612b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58d3907b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606612dcfa0 con 0x5606612ce4e0 2023-11-15T01:40:30.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58d3907b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606612b0540 con 0x5606612adcf0 2023-11-15T01:40:30.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58d3907b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606612dc7d0 con 0x560661041e40 2023-11-15T01:40:30.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58d3907b80 10 client.0 ll_register_callbacks cb 0x560661245640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T01:40:30.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58bbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612ce4e0 0x5606612b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58bbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612ce4e0 0x5606612b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58680/0 (socket says 172.21.15.1:58680) 2023-11-15T01:40:30.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58bbfff700 1 -- 172.21.15.1:0/3915701956 learned_addr learned my addr 172.21.15.1:0/3915701956 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:30.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58baffd700 1 --2- 172.21.15.1:0/3915701956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5606612adcf0 0x5606612afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/3915701956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x560661041e40 0x5606612ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58bbfff700 1 -- 172.21.15.1:0/3915701956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x560661041e40 msgr2=0x5606612ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:30.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58bbfff700 1 --2- 172.21.15.1:0/3915701956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x560661041e40 0x5606612ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58bbfff700 1 -- 172.21.15.1:0/3915701956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5606612adcf0 msgr2=0x5606612afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:30.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58bbfff700 1 --2- 172.21.15.1:0/3915701956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5606612adcf0 0x5606612afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.852+0000 7f58bbfff700 1 -- 172.21.15.1:0/3915701956 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc0aa890 con 0x5606612ce4e0 2023-11-15T01:40:30.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f58bbfff700 1 --2- 172.21.15.1:0/3915701956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612ce4e0 0x5606612b0050 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f58b404bc10 tx=0x7f58b405e000).ready entity=mon.0 client_cookie=d67bfab8f12690f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:30.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f5899ffb700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T01:40:30.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f5899ffb700 1 -- 172.21.15.1:0/3915701956 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b404ef60 con 0x5606612ce4e0 2023-11-15T01:40:30.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f5899ffb700 1 -- 172.21.15.1:0/3915701956 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f58b4011e40 con 0x5606612ce4e0 2023-11-15T01:40:30.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f58d3907b80 1 -- 172.21.15.1:0/3915701956 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58b404d330 con 0x5606612ce4e0 2023-11-15T01:40:30.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f5899ffb700 1 -- 172.21.15.1:0/3915701956 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58b404d590 con 0x5606612ce4e0 2023-11-15T01:40:30.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f58d3907b80 10 client.8292 fetch_fsmap learned FSMap version 63 2023-11-15T01:40:30.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f58d3907b80 1 -- 172.21.15.1:0/3915701956 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x560661042f80 con 0x5606612ce4e0 2023-11-15T01:40:30.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f5899ffb700 1 -- 172.21.15.1:0/3915701956 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b404d330 con 0x5606612ce4e0 2023-11-15T01:40:30.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f5899ffb700 1 -- 172.21.15.1:0/3915701956 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 63) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f58b404e6e0 con 0x5606612ce4e0 2023-11-15T01:40:30.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f58d3907b80 10 client.8292 fetch_fsmap finished waiting for FSMap version 63 2023-11-15T01:40:30.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f58d3907b80 10 client.8292 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-15T01:40:30.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f58d3907b80 20 client.8292 populate_metadata read hostname 'smithi001' 2023-11-15T01:40:30.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f58d3907b80 1 --2- 172.21.15.1:0/3915701956 >> [v2:172.21.15.1:6833/2320712503,v1:172.21.15.1:6835/2320712503] conn(0x560661332bd0 0x560661332fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f58d3907b80 4 client.8292 mds_command: new command op to 8091 tid=0[{"prefix": "status"}] 2023-11-15T01:40:30.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f58d3907b80 1 -- 172.21.15.1:0/3915701956 --> [v2:172.21.15.1:6833/2320712503,v1:172.21.15.1:6835/2320712503] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560661074ca0 con 0x560661332bd0 2023-11-15T01:40:30.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/3915701956 >> [v2:172.21.15.1:6833/2320712503,v1:172.21.15.1:6835/2320712503] conn(0x560661332bd0 0x560661332fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f5899ffb700 10 client.8292 ms_handle_connect on v2:172.21.15.1:6833/2320712503 2023-11-15T01:40:30.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.853+0000 7f58bb7fe700 1 --2- 172.21.15.1:0/3915701956 >> [v2:172.21.15.1:6833/2320712503,v1:172.21.15.1:6835/2320712503] conn(0x560661332bd0 0x560661332fb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2a518470f256ca5f server_cookie=16d5159823a55f02 in_seq=0 out_seq=0 2023-11-15T01:40:30.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f5899ffb700 1 -- 172.21.15.1:0/3915701956 <== mds.0 v2:172.21.15.1:6833/2320712503 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x560661074ca0 con 0x560661332bd0 2023-11-15T01:40:30.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f5899ffb700 10 client.8292 handle_command_reply: tid=0 2023-11-15T01:40:30.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58d3907b80 1 client.8292 shutdown 2023-11-15T01:40:30.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58d3907b80 1 -- 172.21.15.1:0/3915701956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612ce4e0 msgr2=0x5606612b0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58d3907b80 1 --2- 172.21.15.1:0/3915701956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612ce4e0 0x5606612b0050 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f58b404bc10 tx=0x7f58b405e000).stop 2023-11-15T01:40:30.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58d3907b80 1 -- 172.21.15.1:0/3915701956 shutdown_connections 2023-11-15T01:40:30.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58d3907b80 1 --2- 172.21.15.1:0/3915701956 >> [v2:172.21.15.1:6833/2320712503,v1:172.21.15.1:6835/2320712503] conn(0x560661332bd0 0x560661332fb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58d3907b80 1 --2- 172.21.15.1:0/3915701956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5606612ce4e0 0x5606612b0050 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58d3907b80 1 --2- 172.21.15.1:0/3915701956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x560661041e40 0x5606612ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58d3907b80 1 --2- 172.21.15.1:0/3915701956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5606612adcf0 0x5606612afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f5899ffb700 0 client.8292 ms_handle_reset on v2:172.21.15.1:6833/2320712503 2023-11-15T01:40:30.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58d3907b80 1 -- 172.21.15.1:0/3915701956 >> 172.21.15.1:0/3915701956 conn(0x5606610ef4a0 msgr2=0x56066127ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:30.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58d3907b80 1 -- 172.21.15.1:0/3915701956 shutdown_connections 2023-11-15T01:40:30.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58d3907b80 1 -- 172.21.15.1:0/3915701956 wait complete. 2023-11-15T01:40:30.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58d3907b80 20 client.8292 trim_cache size 0 max 16384 2023-11-15T01:40:30.881 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T01:40:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "32ffb44b-12dc-4e79-bad7-24a9692dabf6", 2023-11-15T01:40:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2023-11-15T01:40:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 8091, 2023-11-15T01:40:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2023-11-15T01:40:30.881 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2023-11-15T01:40:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2023-11-15T01:40:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 10.240479759999999, 2023-11-15T01:40:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 63, 2023-11-15T01:40:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 141, 2023-11-15T01:40:30.882 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 141, 2023-11-15T01:40:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 15.727428366 2023-11-15T01:40:30.883 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T01:40:30.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58c0d0c700 1 -- 172.21.15.1:0/813329064 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f58a805f270 msgr2=0x7f58a8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58c0d0c700 1 --2- 172.21.15.1:0/813329064 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f58a805f270 0x7f58a8061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f58ac006fd0 tx=0x7f58ac008040).stop 2023-11-15T01:40:30.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58c0d0c700 1 -- 172.21.15.1:0/813329064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58bc151e10 msgr2=0x7f58bc0b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58c0d0c700 1 --2- 172.21.15.1:0/813329064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58bc151e10 0x7f58bc0b0210 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f58b400c810 tx=0x7f58b4007f90).stop 2023-11-15T01:40:30.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58c0d0c700 1 -- 172.21.15.1:0/813329064 shutdown_connections 2023-11-15T01:40:30.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58c0d0c700 1 --2- 172.21.15.1:0/813329064 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f58a805f270 0x7f58a8061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58c0d0c700 1 --2- 172.21.15.1:0/813329064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58bc151e10 0x7f58bc0b0210 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58c0d0c700 1 --2- 172.21.15.1:0/813329064 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58bc0c86b0 0x7f58bc13dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.854+0000 7f58c0d0c700 1 --2- 172.21.15.1:0/813329064 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f58bc0c98b0 0x7f58bc0afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.855+0000 7f58c0d0c700 1 -- 172.21.15.1:0/813329064 >> 172.21.15.1:0/813329064 conn(0x7f58bc0947e0 msgr2=0x7f58bc14f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:30.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.855+0000 7f58c0d0c700 1 -- 172.21.15.1:0/813329064 shutdown_connections 2023-11-15T01:40:30.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.855+0000 7f58c0d0c700 1 -- 172.21.15.1:0/813329064 wait complete. 2023-11-15T01:40:30.887 DEBUG:teuthology.orchestra.run.smithi001:> ceph fs ls 2023-11-15T01:40:30.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.991+0000 7f593368f700 1 Processor -- start 2023-11-15T01:40:30.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.991+0000 7f593368f700 1 -- start start 2023-11-15T01:40:30.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.992+0000 7f593368f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f592c154410 0x7f592c0ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.992+0000 7f593368f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f592c158cf0 0x7f592c0ab580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:30.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.992+0000 7f593368f700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c158150 con 0x7f592c062c10 2023-11-15T01:40:30.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.992+0000 7f593368f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c063670 con 0x7f592c158cf0 2023-11-15T01:40:30.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.992+0000 7f593368f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c063950 con 0x7f592c154410 2023-11-15T01:40:30.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.992+0000 7f5931c2c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f592c158cf0 0x7f592c0ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.992+0000 7f5931c2c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f592c158cf0 0x7f592c0ab580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58684/0 (socket says 172.21.15.1:58684) 2023-11-15T01:40:30.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.992+0000 7f5931c2c700 1 -- 172.21.15.1:0/3800140997 learned_addr learned my addr 172.21.15.1:0/3800140997 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:30.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.992+0000 7f593142b700 1 --2- 172.21.15.1:0/3800140997 >> v2:172.21.15.141:3300/0 conn(0x7f592c154410 0x7f592c0ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:30.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.992+0000 7f5931c2c700 1 -- 172.21.15.1:0/3800140997 >> v2:172.21.15.141:3300/0 conn(0x7f592c154410 msgr2=0x7f592c0ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:30.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.992+0000 7f5931c2c700 1 --2- 172.21.15.1:0/3800140997 >> v2:172.21.15.141:3300/0 conn(0x7f592c154410 0x7f592c0ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.992+0000 7f5931c2c700 1 -- 172.21.15.1:0/3800140997 >> v1:172.21.15.141:6789/0 conn(0x7f592c062c10 legacy=0x7f592c1585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:30.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.992+0000 7f5931c2c700 1 -- 172.21.15.1:0/3800140997 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c063c30 con 0x7f592c158cf0 2023-11-15T01:40:30.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.992+0000 7f5931c2c700 1 --2- 172.21.15.1:0/3800140997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f592c158cf0 0x7f592c0ab580 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f592c083b60 tx=0x7f5924009840).ready entity=mon.0 client_cookie=83f1a56ccb82a9bf server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:30.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.993+0000 7f5923fff700 1 -- 172.21.15.1:0/3800140997 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592400e070 con 0x7f592c158cf0 2023-11-15T01:40:30.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.993+0000 7f5923fff700 1 -- 172.21.15.1:0/3800140997 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592400ba10 con 0x7f592c158cf0 2023-11-15T01:40:30.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.993+0000 7f5923fff700 1 -- 172.21.15.1:0/3800140997 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592400bd90 con 0x7f592c158cf0 2023-11-15T01:40:30.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.993+0000 7f593368f700 1 -- 172.21.15.1:0/3800140997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f592c158cf0 msgr2=0x7f592c0ab580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:30.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.993+0000 7f593368f700 1 --2- 172.21.15.1:0/3800140997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f592c158cf0 0x7f592c0ab580 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f592c083b60 tx=0x7f5924009840).stop 2023-11-15T01:40:30.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.993+0000 7f593368f700 1 -- 172.21.15.1:0/3800140997 shutdown_connections 2023-11-15T01:40:30.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.993+0000 7f593368f700 1 --2- 172.21.15.1:0/3800140997 >> v2:172.21.15.141:3300/0 conn(0x7f592c154410 0x7f592c0ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.993+0000 7f593368f700 1 --2- 172.21.15.1:0/3800140997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f592c158cf0 0x7f592c0ab580 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:30.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.993+0000 7f593368f700 1 -- 172.21.15.1:0/3800140997 >> 172.21.15.1:0/3800140997 conn(0x7f592c0cbbd0 msgr2=0x7f592c0c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:30.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.993+0000 7f593368f700 1 -- 172.21.15.1:0/3800140997 shutdown_connections 2023-11-15T01:40:30.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.993+0000 7f593368f700 1 -- 172.21.15.1:0/3800140997 wait complete. 2023-11-15T01:40:31.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.994+0000 7f593368f700 1 Processor -- start 2023-11-15T01:40:31.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.994+0000 7f593368f700 1 -- start start 2023-11-15T01:40:31.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.995+0000 7f593368f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f592c062c10 0x7f592c0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:31.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.995+0000 7f593368f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f592c154410 0x7f592c14bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:31.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.995+0000 7f593368f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f592c158cf0 0x7f592c0c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:31.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.995+0000 7f593368f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c14c050 con 0x7f592c154410 2023-11-15T01:40:31.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.995+0000 7f593368f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0af2f0 con 0x7f592c158cf0 2023-11-15T01:40:31.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.995+0000 7f593368f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0c3080 con 0x7f592c062c10 2023-11-15T01:40:31.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.995+0000 7f5930c2a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f592c154410 0x7f592c14bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:31.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.995+0000 7f5930c2a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f592c154410 0x7f592c14bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58686/0 (socket says 172.21.15.1:58686) 2023-11-15T01:40:31.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.995+0000 7f5930c2a700 1 -- 172.21.15.1:0/767673728 learned_addr learned my addr 172.21.15.1:0/767673728 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:31.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.996+0000 7f5930c2a700 1 -- 172.21.15.1:0/767673728 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f592c062c10 msgr2=0x7f592c0ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:31.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.996+0000 7f5930c2a700 1 --2- 172.21.15.1:0/767673728 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f592c062c10 0x7f592c0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:31.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.996+0000 7f5931c2c700 1 --2- 172.21.15.1:0/767673728 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f592c158cf0 0x7f592c0c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:31.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.996+0000 7f5930c2a700 1 -- 172.21.15.1:0/767673728 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f592c158cf0 msgr2=0x7f592c0c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:31.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.996+0000 7f5930c2a700 1 --2- 172.21.15.1:0/767673728 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f592c158cf0 0x7f592c0c2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:31.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.996+0000 7f5930c2a700 1 -- 172.21.15.1:0/767673728 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5924009ae0 con 0x7f592c154410 2023-11-15T01:40:31.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.996+0000 7f5930c2a700 1 --2- 172.21.15.1:0/767673728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f592c154410 0x7f592c14bb60 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f591c00c470 tx=0x7f591c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:31.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.996+0000 7f59217fa700 1 -- 172.21.15.1:0/767673728 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c00f470 con 0x7f592c154410 2023-11-15T01:40:31.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.996+0000 7f59217fa700 1 -- 172.21.15.1:0/767673728 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c00f5f0 con 0x7f592c154410 2023-11-15T01:40:31.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.996+0000 7f593368f700 1 -- 172.21.15.1:0/767673728 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c0ae6e0 con 0x7f592c154410 2023-11-15T01:40:31.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.996+0000 7f59217fa700 1 -- 172.21.15.1:0/767673728 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c00f9b0 con 0x7f592c154410 2023-11-15T01:40:31.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.996+0000 7f593368f700 1 -- 172.21.15.1:0/767673728 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c0aeca0 con 0x7f592c154410 2023-11-15T01:40:31.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.997+0000 7f593368f700 1 -- 172.21.15.1:0/767673728 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592c0475e0 con 0x7f592c154410 2023-11-15T01:40:31.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.997+0000 7f59217fa700 1 -- 172.21.15.1:0/767673728 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f591c012400 con 0x7f592c154410 2023-11-15T01:40:31.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.998+0000 7f59217fa700 1 --2- 172.21.15.1:0/767673728 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f591005f270 0x7f5910061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:31.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.998+0000 7f59217fa700 1 -- 172.21.15.1:0/767673728 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f591c079aa0 con 0x7f592c154410 2023-11-15T01:40:31.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.998+0000 7f593142b700 1 --2- 172.21.15.1:0/767673728 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f591005f270 0x7f5910061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:31.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:30.998+0000 7f593142b700 1 --2- 172.21.15.1:0/767673728 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f591005f270 0x7f5910061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f592c158cc0 tx=0x7f5928008040).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:31.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.002+0000 7f59217fa700 1 -- 172.21.15.1:0/767673728 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f591c048af0 con 0x7f592c154410 2023-11-15T01:40:31.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.220+0000 7f593368f700 1 -- 172.21.15.1:0/767673728 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f592c0af480 con 0x7f592c154410 2023-11-15T01:40:31.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.220+0000 7f59217fa700 1 -- 172.21.15.1:0/767673728 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v63) v1 ==== 53+0+73 (secure 0 0 0) 0x7f591c04a9c0 con 0x7f592c154410 2023-11-15T01:40:31.223 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-15T01:40:31.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.222+0000 7f593368f700 1 -- 172.21.15.1:0/767673728 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f591005f270 msgr2=0x7f5910061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:31.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.222+0000 7f593368f700 1 --2- 172.21.15.1:0/767673728 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f591005f270 0x7f5910061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f592c158cc0 tx=0x7f5928008040).stop 2023-11-15T01:40:31.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.222+0000 7f593368f700 1 -- 172.21.15.1:0/767673728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f592c154410 msgr2=0x7f592c14bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:31.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.222+0000 7f593368f700 1 --2- 172.21.15.1:0/767673728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f592c154410 0x7f592c14bb60 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f591c00c470 tx=0x7f591c007de0).stop 2023-11-15T01:40:31.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.222+0000 7f593368f700 1 -- 172.21.15.1:0/767673728 shutdown_connections 2023-11-15T01:40:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.222+0000 7f593368f700 1 --2- 172.21.15.1:0/767673728 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f591005f270 0x7f5910061730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.222+0000 7f593368f700 1 --2- 172.21.15.1:0/767673728 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f592c158cf0 0x7f592c0c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.222+0000 7f593368f700 1 --2- 172.21.15.1:0/767673728 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f592c062c10 0x7f592c0ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.222+0000 7f593368f700 1 --2- 172.21.15.1:0/767673728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f592c154410 0x7f592c14bb60 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:31.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.222+0000 7f593368f700 1 -- 172.21.15.1:0/767673728 >> 172.21.15.1:0/767673728 conn(0x7f592c0cbbd0 msgr2=0x7f592c1537d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.222+0000 7f593368f700 1 -- 172.21.15.1:0/767673728 shutdown_connections 2023-11-15T01:40:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.222+0000 7f593368f700 1 -- 172.21.15.1:0/767673728 wait complete. 2023-11-15T01:40:31.234 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-15T01:40:31.235 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-15T01:40:31.235 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-11-15T01:40:31.235 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-15T01:40:31.236 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-15T01:40:31.236 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-15T01:40:31.236 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-15T01:40:31.236 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-15T01:40:31.237 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T01:40:31.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:40:31.238 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-11-15T01:40:31.253 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T01:40:31.253 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T01:40:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T01:40:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:40:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-11-15T01:40:31.254 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:40:31.255 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:40:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-11-15T01:40:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-11-15T01:40:31.255 INFO:teuthology.orchestra.run.smithi001.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-15T01:40:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:40:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-11-15T01:40:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-15T01:40:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 41374sec preferred_lft 41374sec 2023-11-15T01:40:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2023-11-15T01:40:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:40:31.257 INFO:teuthology.orchestra.run.smithi001.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:40:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-11-15T01:40:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-11-15T01:40:31.257 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T01:40:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:40:31.257 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-11-15T01:40:31.258 INFO:teuthology.orchestra.run.smithi001.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-15T01:40:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff 2023-11-15T01:40:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-15T01:40:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:40:31.258 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::74ff:4aff:fef6:c8f5/64 scope link 2023-11-15T01:40:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:40:31.259 INFO:teuthology.orchestra.run.smithi001.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:40:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-15T01:40:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::10ca:5cff:fe8a:9a23/64 scope link 2023-11-15T01:40:31.259 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:40:31.260 INFO:teuthology.orchestra.run.smithi001.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T01:40:31.260 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 92:7a:64:05:0f:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-15T01:40:31.260 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::907a:64ff:fe05:f37/64 scope link 2023-11-15T01:40:31.260 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T01:40:31.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:40:31.261 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-15T01:40:31.317 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-11-15T01:40:31.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:40:31.319 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-11-15T01:40:31.375 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-11-15T01:40:31.375 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-15T01:40:31.375 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-15T01:40:31.375 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-15T01:40:31.376 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-15T01:40:31.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:40:31.377 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T01:40:31.377 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T01:40:31.378 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-15T01:40:31.378 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-15T01:40:31.378 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-15T01:40:31.379 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T01:40:31.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:40:31.478 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T01:40:31.495 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-15T01:40:31.495 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-15T01:40:31.496 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T01:40:31.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:40:31.497 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2023-11-15T01:40:31.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:40:31.561 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-15T01:40:31.615 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-15T01:40:31.615 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:40:31.695 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:40:31.696 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:40:31.721 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T01:40:31.721 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T01:40:31.723 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-15T01:40:31.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T01:40:31.724 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-15T01:40:31.789 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-15T01:40:31.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.946+0000 7f9443641700 1 Processor -- start 2023-11-15T01:40:31.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.946+0000 7f9443641700 1 -- start start 2023-11-15T01:40:31.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.947+0000 7f9443641700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f943c0bccd0 0x7f943c0bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:31.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.947+0000 7f9443641700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943c06a6b0 con 0x7f943c0c60b0 2023-11-15T01:40:31.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.947+0000 7f9443641700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943c0c3360 con 0x7f943c154680 2023-11-15T01:40:31.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.947+0000 7f9443641700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c0bd620 con 0x7f943c0bccd0 2023-11-15T01:40:31.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.947+0000 7f9441bde700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f943c0c60b0 0x7f943c0c6500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51968/0 (socket says 172.21.15.1:51968) 2023-11-15T01:40:31.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.947+0000 7f9441bde700 1 -- 172.21.15.1:0/3126411391 learned_addr learned my addr 172.21.15.1:0/3126411391 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:31.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f9440bdc700 1 --2- 172.21.15.1:0/3126411391 >> v2:172.21.15.141:3300/0 conn(0x7f943c0bccd0 0x7f943c0bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:31.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f943bfff700 1 -- 172.21.15.1:0/3126411391 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272821956 0 0) 0x7f943c06a6b0 con 0x7f943c0c60b0 2023-11-15T01:40:31.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f943bfff700 1 -- 172.21.15.1:0/3126411391 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94240033f0 con 0x7f943c0c60b0 2023-11-15T01:40:31.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f943bfff700 1 -- 172.21.15.1:0/3126411391 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 685506889 0 0) 0x7f94240033f0 con 0x7f943c0c60b0 2023-11-15T01:40:31.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f943bfff700 1 -- 172.21.15.1:0/3126411391 >> v2:172.21.15.141:3300/0 conn(0x7f943c0bccd0 msgr2=0x7f943c0bd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:31.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f943bfff700 1 --2- 172.21.15.1:0/3126411391 >> v2:172.21.15.141:3300/0 conn(0x7f943c0bccd0 0x7f943c0bd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:31.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f943bfff700 1 -- 172.21.15.1:0/3126411391 >> v1:172.21.15.141:6789/0 conn(0x7f943c154680 legacy=0x7f943c069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:31.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f943bfff700 1 -- 172.21.15.1:0/3126411391 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c0c2750 con 0x7f943c0c60b0 2023-11-15T01:40:31.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f943bfff700 1 -- 172.21.15.1:0/3126411391 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f942c0017f0 con 0x7f943c0c60b0 2023-11-15T01:40:31.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f943bfff700 1 -- 172.21.15.1:0/3126411391 >> v1:172.21.15.1:6789/0 conn(0x7f943c0c60b0 legacy=0x7f943c0c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:31.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f943bfff700 1 --2- 172.21.15.1:0/3126411391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f94240038e0 0x7f9424003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:31.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f943bfff700 1 --2- 172.21.15.1:0/3126411391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9424004690 0x7f9424004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:31.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f943bfff700 1 --2- 172.21.15.1:0/3126411391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9424005000 0x7f942400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:31.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f943bfff700 1 -- 172.21.15.1:0/3126411391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0bd620 con 0x7f9424005000 2023-11-15T01:40:31.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f943bfff700 1 -- 172.21.15.1:0/3126411391 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942400beb0 con 0x7f94240038e0 2023-11-15T01:40:31.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f943bfff700 1 -- 172.21.15.1:0/3126411391 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942400c070 con 0x7f9424004690 2023-11-15T01:40:31.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f9441bde700 1 --2- 172.21.15.1:0/3126411391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9424005000 0x7f942400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:31.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f94413dd700 1 --2- 172.21.15.1:0/3126411391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f94240038e0 0x7f9424003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:31.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.948+0000 7f9440bdc700 1 --2- 172.21.15.1:0/3126411391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9424004690 0x7f9424004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:31.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.949+0000 7f9441bde700 1 -- 172.21.15.1:0/3126411391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9424004690 msgr2=0x7f9424004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:31.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.949+0000 7f9441bde700 1 --2- 172.21.15.1:0/3126411391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9424004690 0x7f9424004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:31.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.949+0000 7f9441bde700 1 -- 172.21.15.1:0/3126411391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f94240038e0 msgr2=0x7f9424003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:31.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.949+0000 7f9441bde700 1 --2- 172.21.15.1:0/3126411391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f94240038e0 0x7f9424003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:31.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.949+0000 7f9441bde700 1 -- 172.21.15.1:0/3126411391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94240033f0 con 0x7f9424005000 2023-11-15T01:40:31.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.949+0000 7f9441bde700 1 -- 172.21.15.1:0/3126411391 reap_dead start 2023-11-15T01:40:31.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.949+0000 7f9441bde700 1 --2- 172.21.15.1:0/3126411391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9424005000 0x7f942400b8e0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f942c00c480 tx=0x7f942c00c790).ready entity=mon.0 client_cookie=bc25607f0331afe4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:31.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.949+0000 7f943bfff700 1 -- 172.21.15.1:0/3126411391 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c002030 con 0x7f9424005000 2023-11-15T01:40:31.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.949+0000 7f943bfff700 1 -- 172.21.15.1:0/3126411391 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c00ce20 con 0x7f9424005000 2023-11-15T01:40:31.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.949+0000 7f943bfff700 1 -- 172.21.15.1:0/3126411391 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c005d70 con 0x7f9424005000 2023-11-15T01:40:31.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.949+0000 7f9443641700 1 -- 172.21.15.1:0/3126411391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9424005000 msgr2=0x7f942400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:31.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.949+0000 7f9443641700 1 --2- 172.21.15.1:0/3126411391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9424005000 0x7f942400b8e0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f942c00c480 tx=0x7f942c00c790).stop 2023-11-15T01:40:31.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.949+0000 7f9443641700 1 -- 172.21.15.1:0/3126411391 shutdown_connections 2023-11-15T01:40:31.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.949+0000 7f9443641700 1 --2- 172.21.15.1:0/3126411391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9424005000 0x7f942400b8e0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:31.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.949+0000 7f9443641700 1 -- 172.21.15.1:0/3126411391 >> 172.21.15.1:0/3126411391 conn(0x7f943c0c7d70 msgr2=0x7f943c0c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:31.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.950+0000 7f9443641700 1 -- 172.21.15.1:0/3126411391 shutdown_connections 2023-11-15T01:40:31.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.950+0000 7f9443641700 1 -- 172.21.15.1:0/3126411391 wait complete. 2023-11-15T01:40:31.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.951+0000 7f9443641700 1 Processor -- start 2023-11-15T01:40:31.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.951+0000 7f9443641700 1 -- start start 2023-11-15T01:40:31.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.951+0000 7f9443641700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9424005000 0x7f943c0bee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:31.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.951+0000 7f9443641700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f943c0aa1a0 0x7f943c0ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:31.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f9443641700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f943c065a10 0x7f943c065e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:31.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f9443641700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0aad20 con 0x7f9424005000 2023-11-15T01:40:31.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f9443641700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0c00b0 con 0x7f943c0aa1a0 2023-11-15T01:40:31.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f9443641700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c066360 con 0x7f943c065a10 2023-11-15T01:40:31.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f94413dd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9424005000 0x7f943c0bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:31.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f94413dd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9424005000 0x7f943c0bee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58712/0 (socket says 172.21.15.1:58712) 2023-11-15T01:40:31.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f94413dd700 1 -- 172.21.15.1:0/4158747268 learned_addr learned my addr 172.21.15.1:0/4158747268 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:31.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f94413dd700 1 -- 172.21.15.1:0/4158747268 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f943c065a10 msgr2=0x7f943c065e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:31.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f94413dd700 1 --2- 172.21.15.1:0/4158747268 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f943c065a10 0x7f943c065e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:31.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f94413dd700 1 -- 172.21.15.1:0/4158747268 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f943c0aa1a0 msgr2=0x7f943c0ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:31.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f94413dd700 1 --2- 172.21.15.1:0/4158747268 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f943c0aa1a0 0x7f943c0ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:31.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f94413dd700 1 -- 172.21.15.1:0/4158747268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c0bf480 con 0x7f9424005000 2023-11-15T01:40:31.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f94413dd700 1 --2- 172.21.15.1:0/4158747268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9424005000 0x7f943c0bee10 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f94340028c0 tx=0x7f9434007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:31.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f94397fa700 1 -- 172.21.15.1:0/4158747268 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943400f6c0 con 0x7f9424005000 2023-11-15T01:40:31.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f94397fa700 1 -- 172.21.15.1:0/4158747268 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943400f820 con 0x7f9424005000 2023-11-15T01:40:31.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f9443641700 1 -- 172.21.15.1:0/4158747268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943c0bf760 con 0x7f9424005000 2023-11-15T01:40:31.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f94397fa700 1 -- 172.21.15.1:0/4158747268 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943400fba0 con 0x7f9424005000 2023-11-15T01:40:31.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.952+0000 7f9443641700 1 -- 172.21.15.1:0/4158747268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c0aa620 con 0x7f9424005000 2023-11-15T01:40:31.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.953+0000 7f9443641700 1 -- 172.21.15.1:0/4158747268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943c06c7e0 con 0x7f9424005000 2023-11-15T01:40:31.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.953+0000 7f94397fa700 1 -- 172.21.15.1:0/4158747268 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f943401d3b0 con 0x7f9424005000 2023-11-15T01:40:31.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.954+0000 7f94397fa700 1 --2- 172.21.15.1:0/4158747268 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f942805f270 0x7f9428061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:31.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.954+0000 7f94397fa700 1 -- 172.21.15.1:0/4158747268 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f943407a230 con 0x7f9424005000 2023-11-15T01:40:31.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.954+0000 7f9440bdc700 1 --2- 172.21.15.1:0/4158747268 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f942805f270 0x7f9428061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:31.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.955+0000 7f9440bdc700 1 --2- 172.21.15.1:0/4158747268 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f942805f270 0x7f9428061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9430006f70 tx=0x7f9430009060).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:31.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:31.958+0000 7f94397fa700 1 -- 172.21.15.1:0/4158747268 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f943404b210 con 0x7f9424005000 2023-11-15T01:40:32.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.160+0000 7f9443641700 1 -- 172.21.15.1:0/4158747268 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f943c0c2a30 con 0x7f942805f270 2023-11-15T01:40:32.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.163+0000 7f94397fa700 1 -- 172.21.15.1:0/4158747268 <== mgr.6590 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f943c0c2a30 con 0x7f942805f270 2023-11-15T01:40:32.163 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T01:40:32.164 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T01:40:32.164 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephfs" 2023-11-15T01:40:32.164 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T01:40:32.164 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T01:40:32.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.164+0000 7f9443641700 1 -- 172.21.15.1:0/4158747268 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f942805f270 msgr2=0x7f9428061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:32.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.164+0000 7f9443641700 1 --2- 172.21.15.1:0/4158747268 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f942805f270 0x7f9428061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9430006f70 tx=0x7f9430009060).stop 2023-11-15T01:40:32.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.164+0000 7f9443641700 1 -- 172.21.15.1:0/4158747268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9424005000 msgr2=0x7f943c0bee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:32.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.164+0000 7f9443641700 1 --2- 172.21.15.1:0/4158747268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9424005000 0x7f943c0bee10 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f94340028c0 tx=0x7f9434007bb0).stop 2023-11-15T01:40:32.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.164+0000 7f9443641700 1 -- 172.21.15.1:0/4158747268 shutdown_connections 2023-11-15T01:40:32.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.164+0000 7f9443641700 1 --2- 172.21.15.1:0/4158747268 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f942805f270 0x7f9428061730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:32.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.164+0000 7f9443641700 1 --2- 172.21.15.1:0/4158747268 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f943c065a10 0x7f943c065e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:32.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.164+0000 7f9443641700 1 --2- 172.21.15.1:0/4158747268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9424005000 0x7f943c0bee10 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:32.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.164+0000 7f9443641700 1 --2- 172.21.15.1:0/4158747268 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f943c0aa1a0 0x7f943c0ad650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:32.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.164+0000 7f9443641700 1 -- 172.21.15.1:0/4158747268 >> 172.21.15.1:0/4158747268 conn(0x7f943c0c7d70 msgr2=0x7f943c0a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:32.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.164+0000 7f9443641700 1 -- 172.21.15.1:0/4158747268 shutdown_connections 2023-11-15T01:40:32.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.164+0000 7f9443641700 1 -- 172.21.15.1:0/4158747268 wait complete. 2023-11-15T01:40:32.177 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-15T01:40:32.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.296+0000 7ff59558b700 1 Processor -- start 2023-11-15T01:40:32.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.296+0000 7ff59558b700 1 -- start start 2023-11-15T01:40:32.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff59558b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff590155b00 0x7ff59006b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:32.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff59558b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff59014f1c0 0x7ff59014f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:32.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff59558b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5900a9c00 con 0x7ff5900c1990 2023-11-15T01:40:32.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff59558b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff590063c00 con 0x7ff59014f1c0 2023-11-15T01:40:32.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff59558b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59006bbc0 con 0x7ff590155b00 2023-11-15T01:40:32.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff58f7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff5900c1990 0x7ff590155ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51982/0 (socket says 172.21.15.1:51982) 2023-11-15T01:40:32.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff58f7fe700 1 -- 172.21.15.1:0/2875468784 learned_addr learned my addr 172.21.15.1:0/2875468784 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:32.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff58ffff700 1 --2- 172.21.15.1:0/2875468784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff590155b00 0x7ff59006b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:32.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff594d8a700 1 --2- 172.21.15.1:0/2875468784 >> v2:172.21.15.141:3300/0 conn(0x7ff59014f1c0 0x7ff59014f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:32.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff58effd700 1 -- 172.21.15.1:0/2875468784 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595734403 0 0) 0x7ff5900a9c00 con 0x7ff5900c1990 2023-11-15T01:40:32.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff58effd700 1 -- 172.21.15.1:0/2875468784 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5780033f0 con 0x7ff5900c1990 2023-11-15T01:40:32.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff58effd700 1 -- 172.21.15.1:0/2875468784 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3987606060 0 0) 0x7ff5780033f0 con 0x7ff5900c1990 2023-11-15T01:40:32.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff58effd700 1 -- 172.21.15.1:0/2875468784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff590155b00 msgr2=0x7ff59006b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:32.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff58effd700 1 --2- 172.21.15.1:0/2875468784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff590155b00 0x7ff59006b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:32.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff58effd700 1 -- 172.21.15.1:0/2875468784 >> v2:172.21.15.141:3300/0 conn(0x7ff59014f1c0 msgr2=0x7ff59014f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:32.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff58effd700 1 --2- 172.21.15.1:0/2875468784 >> v2:172.21.15.141:3300/0 conn(0x7ff59014f1c0 0x7ff59014f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:32.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.297+0000 7ff58effd700 1 -- 172.21.15.1:0/2875468784 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5900c1e10 con 0x7ff5900c1990 2023-11-15T01:40:32.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58effd700 1 -- 172.21.15.1:0/2875468784 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7ff584001470 con 0x7ff5900c1990 2023-11-15T01:40:32.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58effd700 1 -- 172.21.15.1:0/2875468784 >> v1:172.21.15.1:6789/0 conn(0x7ff5900c1990 legacy=0x7ff590155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:32.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58effd700 1 --2- 172.21.15.1:0/2875468784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5780038e0 0x7ff578003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:32.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58effd700 1 --2- 172.21.15.1:0/2875468784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff578004690 0x7ff578004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:32.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58effd700 1 --2- 172.21.15.1:0/2875468784 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff578005000 0x7ff57800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:32.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58effd700 1 -- 172.21.15.1:0/2875468784 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff590063c00 con 0x7ff5780038e0 2023-11-15T01:40:32.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58effd700 1 -- 172.21.15.1:0/2875468784 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59006bbc0 con 0x7ff578005000 2023-11-15T01:40:32.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58effd700 1 -- 172.21.15.1:0/2875468784 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57800bdd0 con 0x7ff578004690 2023-11-15T01:40:32.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58ffff700 1 --2- 172.21.15.1:0/2875468784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff590155b00 0x7ff59006b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:32.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff594d8a700 1 --2- 172.21.15.1:0/2875468784 >> v2:172.21.15.141:3300/0 conn(0x7ff59014f1c0 0x7ff59014f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:32.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58ffff700 1 --2- 172.21.15.1:0/2875468784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5780038e0 0x7ff578003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:32.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58f7fe700 1 --2- 172.21.15.1:0/2875468784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff578004690 0x7ff578004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:32.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff594d8a700 1 --2- 172.21.15.1:0/2875468784 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff578005000 0x7ff57800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:32.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58ffff700 1 -- 172.21.15.1:0/2875468784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff578004690 msgr2=0x7ff578004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:32.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58ffff700 1 --2- 172.21.15.1:0/2875468784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff578004690 0x7ff578004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:32.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58ffff700 1 -- 172.21.15.1:0/2875468784 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff578005000 msgr2=0x7ff57800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:32.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58ffff700 1 --2- 172.21.15.1:0/2875468784 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff578005000 0x7ff57800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:32.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58ffff700 1 -- 172.21.15.1:0/2875468784 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5780033f0 con 0x7ff5780038e0 2023-11-15T01:40:32.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58ffff700 1 --2- 172.21.15.1:0/2875468784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5780038e0 0x7ff578003d00 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7ff580009ad0 tx=0x7ff580009060).ready entity=mon.0 client_cookie=9cd3ac82267911a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:32.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58effd700 1 -- 172.21.15.1:0/2875468784 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5800094d0 con 0x7ff5780038e0 2023-11-15T01:40:32.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58effd700 1 -- 172.21.15.1:0/2875468784 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58000e640 con 0x7ff5780038e0 2023-11-15T01:40:32.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.298+0000 7ff58effd700 1 -- 172.21.15.1:0/2875468784 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58000ea00 con 0x7ff5780038e0 2023-11-15T01:40:32.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.299+0000 7ff59558b700 1 -- 172.21.15.1:0/2875468784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5780038e0 msgr2=0x7ff578003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:32.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.299+0000 7ff59558b700 1 --2- 172.21.15.1:0/2875468784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5780038e0 0x7ff578003d00 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7ff580009ad0 tx=0x7ff580009060).stop 2023-11-15T01:40:32.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.299+0000 7ff594d8a700 1 -- 172.21.15.1:0/2875468784 reap_dead start 2023-11-15T01:40:32.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.299+0000 7ff59558b700 1 -- 172.21.15.1:0/2875468784 shutdown_connections 2023-11-15T01:40:32.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.299+0000 7ff59558b700 1 -- 172.21.15.1:0/2875468784 >> 172.21.15.1:0/2875468784 conn(0x7ff5900c3e30 msgr2=0x7ff5900c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:32.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.299+0000 7ff59558b700 1 -- 172.21.15.1:0/2875468784 shutdown_connections 2023-11-15T01:40:32.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.299+0000 7ff59558b700 1 -- 172.21.15.1:0/2875468784 wait complete. 2023-11-15T01:40:32.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.300+0000 7ff59558b700 1 Processor -- start 2023-11-15T01:40:32.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.300+0000 7ff59558b700 1 -- start start 2023-11-15T01:40:32.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff59558b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5780038e0 0x7ff590132ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:32.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff59558b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5900c5900 0x7ff5900c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:32.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff59558b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5901543b0 0x7ff590154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:32.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff59558b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900bf400 con 0x7ff5901543b0 2023-11-15T01:40:32.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff59558b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900c6270 con 0x7ff5900c5900 2023-11-15T01:40:32.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff59558b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff590155120 con 0x7ff5780038e0 2023-11-15T01:40:32.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff594d8a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5901543b0 0x7ff590154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:32.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff594d8a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5901543b0 0x7ff590154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58736/0 (socket says 172.21.15.1:58736) 2023-11-15T01:40:32.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff594d8a700 1 -- 172.21.15.1:0/1469784763 learned_addr learned my addr 172.21.15.1:0/1469784763 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:32.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff58f7fe700 1 --2- 172.21.15.1:0/1469784763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5900c5900 0x7ff5900c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:32.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff58ffff700 1 --2- 172.21.15.1:0/1469784763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5780038e0 0x7ff590132ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:32.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff594d8a700 1 -- 172.21.15.1:0/1469784763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5780038e0 msgr2=0x7ff590132ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:32.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff594d8a700 1 --2- 172.21.15.1:0/1469784763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5780038e0 0x7ff590132ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:32.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff594d8a700 1 -- 172.21.15.1:0/1469784763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5900c5900 msgr2=0x7ff5900c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:32.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff594d8a700 1 --2- 172.21.15.1:0/1469784763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5900c5900 0x7ff5900c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:32.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.301+0000 7ff594d8a700 1 -- 172.21.15.1:0/1469784763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5900bf5e0 con 0x7ff5901543b0 2023-11-15T01:40:32.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.302+0000 7ff594d8a700 1 --2- 172.21.15.1:0/1469784763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5901543b0 0x7ff590154830 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7ff5900c7100 tx=0x7ff58800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:32.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.302+0000 7ff577fff700 1 -- 172.21.15.1:0/1469784763 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58800e040 con 0x7ff5901543b0 2023-11-15T01:40:32.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.302+0000 7ff577fff700 1 -- 172.21.15.1:0/1469784763 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58800f040 con 0x7ff5901543b0 2023-11-15T01:40:32.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.302+0000 7ff59558b700 1 -- 172.21.15.1:0/1469784763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5900bf8c0 con 0x7ff5901543b0 2023-11-15T01:40:32.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.302+0000 7ff577fff700 1 -- 172.21.15.1:0/1469784763 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58800fd70 con 0x7ff5901543b0 2023-11-15T01:40:32.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.302+0000 7ff59558b700 1 -- 172.21.15.1:0/1469784763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5901333d0 con 0x7ff5901543b0 2023-11-15T01:40:32.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.303+0000 7ff59558b700 1 -- 172.21.15.1:0/1469784763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5900475e0 con 0x7ff5901543b0 2023-11-15T01:40:32.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.303+0000 7ff577fff700 1 -- 172.21.15.1:0/1469784763 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 57) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff588015660 con 0x7ff5901543b0 2023-11-15T01:40:32.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.303+0000 7ff577fff700 1 --2- 172.21.15.1:0/1469784763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff57c05f270 0x7ff57c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:32.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.303+0000 7ff577fff700 1 -- 172.21.15.1:0/1469784763 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7ff58807afe0 con 0x7ff5901543b0 2023-11-15T01:40:32.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.304+0000 7ff58ffff700 1 --2- 172.21.15.1:0/1469784763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff57c05f270 0x7ff57c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:32.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.304+0000 7ff58ffff700 1 --2- 172.21.15.1:0/1469784763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff57c05f270 0x7ff57c061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff580006a10 tx=0x7ff580019000).ready entity=mgr.6590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:32.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.307+0000 7ff577fff700 1 -- 172.21.15.1:0/1469784763 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff58804bf70 con 0x7ff5901543b0 2023-11-15T01:40:32.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.525+0000 7ff59558b700 1 -- 172.21.15.1:0/1469784763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7ff5900c20e0 con 0x7ff5901543b0 2023-11-15T01:40:32.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.881+0000 7ff577fff700 1 -- 172.21.15.1:0/1469784763 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 58) v1 ==== 75565+0+0 (secure 0 0 0) 0x7ff588078a70 con 0x7ff5901543b0 2023-11-15T01:40:32.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.882+0000 7ff577fff700 1 -- 172.21.15.1:0/1469784763 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v58) v1 ==== 92+0+0 (secure 0 0 0) 0x7ff588070660 con 0x7ff5901543b0 2023-11-15T01:40:32.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.884+0000 7ff59558b700 1 -- 172.21.15.1:0/1469784763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff57c05f270 msgr2=0x7ff57c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:32.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.884+0000 7ff59558b700 1 --2- 172.21.15.1:0/1469784763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff57c05f270 0x7ff57c061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff580006a10 tx=0x7ff580019000).stop 2023-11-15T01:40:32.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.884+0000 7ff59558b700 1 -- 172.21.15.1:0/1469784763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5901543b0 msgr2=0x7ff590154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:32.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.884+0000 7ff59558b700 1 --2- 172.21.15.1:0/1469784763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5901543b0 0x7ff590154830 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7ff5900c7100 tx=0x7ff58800b040).stop 2023-11-15T01:40:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.884+0000 7ff59558b700 1 -- 172.21.15.1:0/1469784763 shutdown_connections 2023-11-15T01:40:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.884+0000 7ff59558b700 1 --2- 172.21.15.1:0/1469784763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff57c05f270 0x7ff57c061730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.884+0000 7ff59558b700 1 --2- 172.21.15.1:0/1469784763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5901543b0 0x7ff590154830 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:32.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.884+0000 7ff59558b700 1 --2- 172.21.15.1:0/1469784763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5780038e0 0x7ff590132ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:32.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.884+0000 7ff59558b700 1 --2- 172.21.15.1:0/1469784763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5900c5900 0x7ff5900c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:32.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.884+0000 7ff59558b700 1 -- 172.21.15.1:0/1469784763 >> 172.21.15.1:0/1469784763 conn(0x7ff5900c3e30 msgr2=0x7ff59014e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:32.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.886+0000 7ff59558b700 1 -- 172.21.15.1:0/1469784763 shutdown_connections 2023-11-15T01:40:32.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:32.886+0000 7ff59558b700 1 -- 172.21.15.1:0/1469784763 wait complete. 2023-11-15T01:40:32.900 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-15T01:40:33.026 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:33.025+0000 7f15862dd680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:40:33.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.025+0000 7f37cc4bc700 1 Processor -- start 2023-11-15T01:40:33.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.026+0000 7f37cc4bc700 1 -- start start 2023-11-15T01:40:33.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37cc4bc700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f37c41540a0 0x7f37c40ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:33.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37cc4bc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f37c40c6650 0x7f37c40ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:33.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37cc4bc700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c40ca050 con 0x7f37c4154480 2023-11-15T01:40:33.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37cc4bc700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c40c9440 con 0x7f37c40c6650 2023-11-15T01:40:33.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37cc4bc700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c40c9720 con 0x7f37c41540a0 2023-11-15T01:40:33.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37caa59700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f37c40c6650 0x7f37c40ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:33.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37caa59700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f37c40c6650 0x7f37c40ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58766/0 (socket says 172.21.15.1:58766) 2023-11-15T01:40:33.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37caa59700 1 -- 172.21.15.1:0/1071786677 learned_addr learned my addr 172.21.15.1:0/1071786677 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:33.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37ca258700 1 --2- 172.21.15.1:0/1071786677 >> v2:172.21.15.141:3300/0 conn(0x7f37c41540a0 0x7f37c40ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:33.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37caa59700 1 -- 172.21.15.1:0/1071786677 >> v2:172.21.15.141:3300/0 conn(0x7f37c41540a0 msgr2=0x7f37c40ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:33.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37caa59700 1 --2- 172.21.15.1:0/1071786677 >> v2:172.21.15.141:3300/0 conn(0x7f37c41540a0 0x7f37c40ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:33.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37caa59700 1 -- 172.21.15.1:0/1071786677 >> v1:172.21.15.141:6789/0 conn(0x7f37c4154480 legacy=0x7f37c40c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:33.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37caa59700 1 -- 172.21.15.1:0/1071786677 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c40c9a00 con 0x7f37c40c6650 2023-11-15T01:40:33.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37caa59700 1 --2- 172.21.15.1:0/1071786677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c40c6650 0x7f37c40ca9d0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f37c405ff40 tx=0x7f37bc009840).ready entity=mon.0 client_cookie=3969fceed5122847 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:33.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37c9256700 1 -- 172.21.15.1:0/1071786677 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc00e070 con 0x7f37c40c6650 2023-11-15T01:40:33.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37c9256700 1 -- 172.21.15.1:0/1071786677 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37bc00ba20 con 0x7f37c40c6650 2023-11-15T01:40:33.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.027+0000 7f37c9256700 1 -- 172.21.15.1:0/1071786677 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc00bda0 con 0x7f37c40c6650 2023-11-15T01:40:33.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.028+0000 7f37cc4bc700 1 -- 172.21.15.1:0/1071786677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c40c6650 msgr2=0x7f37c40ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:33.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.028+0000 7f37cc4bc700 1 --2- 172.21.15.1:0/1071786677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c40c6650 0x7f37c40ca9d0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f37c405ff40 tx=0x7f37bc009840).stop 2023-11-15T01:40:33.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.028+0000 7f37cc4bc700 1 -- 172.21.15.1:0/1071786677 shutdown_connections 2023-11-15T01:40:33.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.028+0000 7f37cc4bc700 1 --2- 172.21.15.1:0/1071786677 >> v2:172.21.15.141:3300/0 conn(0x7f37c41540a0 0x7f37c40ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:33.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.028+0000 7f37cc4bc700 1 --2- 172.21.15.1:0/1071786677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c40c6650 0x7f37c40ca9d0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:33.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.028+0000 7f37cc4bc700 1 -- 172.21.15.1:0/1071786677 >> 172.21.15.1:0/1071786677 conn(0x7f37c4064a70 msgr2=0x7f37c4064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:33.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.028+0000 7f37cc4bc700 1 -- 172.21.15.1:0/1071786677 shutdown_connections 2023-11-15T01:40:33.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.028+0000 7f37cc4bc700 1 -- 172.21.15.1:0/1071786677 wait complete. 2023-11-15T01:40:33.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.029+0000 7f37cc4bc700 1 Processor -- start 2023-11-15T01:40:33.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.029+0000 7f37cc4bc700 1 -- start start 2023-11-15T01:40:33.036 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:33.030+0000 7f11b8b9a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T01:40:33.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.030+0000 7f37cc4bc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c40c6650 0x7f37c4154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:33.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.030+0000 7f37cc4bc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37c41540a0 0x7f37c4151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:33.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.030+0000 7f37cc4bc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37c4154480 0x7f37c4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:33.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.030+0000 7f37cc4bc700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c4165300 con 0x7f37c40c6650 2023-11-15T01:40:33.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.030+0000 7f37cc4bc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c41552e0 con 0x7f37c41540a0 2023-11-15T01:40:33.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.030+0000 7f37cc4bc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c4151f90 con 0x7f37c4154480 2023-11-15T01:40:33.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.030+0000 7f37ca258700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c40c6650 0x7f37c4154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:33.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.030+0000 7f37ca258700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c40c6650 0x7f37c4154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58770/0 (socket says 172.21.15.1:58770) 2023-11-15T01:40:33.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.030+0000 7f37ca258700 1 -- 172.21.15.1:0/1810061979 learned_addr learned my addr 172.21.15.1:0/1810061979 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:33.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.030+0000 7f37c9a57700 1 --2- 172.21.15.1:0/1810061979 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37c41540a0 0x7f37c4151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:33.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.030+0000 7f37caa59700 1 --2- 172.21.15.1:0/1810061979 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37c4154480 0x7f37c4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:33.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.031+0000 7f37ca258700 1 -- 172.21.15.1:0/1810061979 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37c4154480 msgr2=0x7f37c4152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:33.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.031+0000 7f37ca258700 1 --2- 172.21.15.1:0/1810061979 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37c4154480 0x7f37c4152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:33.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.031+0000 7f37ca258700 1 -- 172.21.15.1:0/1810061979 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37c41540a0 msgr2=0x7f37c4151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:33.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.031+0000 7f37ca258700 1 --2- 172.21.15.1:0/1810061979 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37c41540a0 0x7f37c4151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:33.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.031+0000 7f37ca258700 1 -- 172.21.15.1:0/1810061979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc009ae0 con 0x7f37c40c6650 2023-11-15T01:40:33.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.031+0000 7f37ca258700 1 --2- 172.21.15.1:0/1810061979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c40c6650 0x7f37c4154df0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f37c000e930 tx=0x7f37c0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:33.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.031+0000 7f37b67fc700 1 -- 172.21.15.1:0/1810061979 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c0012600 con 0x7f37c40c6650 2023-11-15T01:40:33.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.031+0000 7f37b67fc700 1 -- 172.21.15.1:0/1810061979 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c0012760 con 0x7f37c40c6650 2023-11-15T01:40:33.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.031+0000 7f37b67fc700 1 -- 172.21.15.1:0/1810061979 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c0012ae0 con 0x7f37c40c6650 2023-11-15T01:40:33.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.031+0000 7f37cc4bc700 1 -- 172.21.15.1:0/1810061979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c4152270 con 0x7f37c40c6650 2023-11-15T01:40:33.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.031+0000 7f37cc4bc700 1 -- 172.21.15.1:0/1810061979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c4151c50 con 0x7f37c40c6650 2023-11-15T01:40:33.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.032+0000 7f37cc4bc700 1 -- 172.21.15.1:0/1810061979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c406c7e0 con 0x7f37c40c6650 2023-11-15T01:40:33.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.032+0000 7f37b67fc700 1 -- 172.21.15.1:0/1810061979 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 58) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f37c001b400 con 0x7f37c40c6650 2023-11-15T01:40:33.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.033+0000 7f37b67fc700 1 --2- 172.21.15.1:0/1810061979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f37a805f2c0 0x7f37a8061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:33.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.033+0000 7f37c9a57700 1 -- 172.21.15.1:0/1810061979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f37a805f2c0 msgr2=0x7f37a8061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:33.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.033+0000 7f37b67fc700 1 -- 172.21.15.1:0/1810061979 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f37c007aa80 con 0x7f37c40c6650 2023-11-15T01:40:33.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.033+0000 7f37c9a57700 1 --2- 172.21.15.1:0/1810061979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f37a805f2c0 0x7f37a8061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:40:33.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.037+0000 7f37b67fc700 1 -- 172.21.15.1:0/1810061979 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f37c004b9b0 con 0x7f37c40c6650 2023-11-15T01:40:33.090 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:33.089+0000 7f15862dd680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:40:33.098 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:33.097+0000 7f11b8b9a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T01:40:33.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.213+0000 7f37cc4bc700 1 -- 172.21.15.1:0/1810061979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f37c40c9ce0 con 0x7f37c40c6650 2023-11-15T01:40:33.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.216+0000 7f37b67fc700 1 -- 172.21.15.1:0/1810061979 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v27)=0 v27) v1 ==== 138+0+0 (secure 0 0 0) 0x7f37c004efd0 con 0x7f37c40c6650 2023-11-15T01:40:33.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.218+0000 7f37cc4bc700 1 -- 172.21.15.1:0/1810061979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f37a805f2c0 msgr2=0x7f37a8061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:40:33.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.218+0000 7f37cc4bc700 1 --2- 172.21.15.1:0/1810061979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f37a805f2c0 0x7f37a8061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:33.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.218+0000 7f37cc4bc700 1 -- 172.21.15.1:0/1810061979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c40c6650 msgr2=0x7f37c4154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:33.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.218+0000 7f37cc4bc700 1 --2- 172.21.15.1:0/1810061979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c40c6650 0x7f37c4154df0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f37c000e930 tx=0x7f37c0009060).stop 2023-11-15T01:40:33.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.218+0000 7f37cc4bc700 1 -- 172.21.15.1:0/1810061979 shutdown_connections 2023-11-15T01:40:33.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.218+0000 7f37cc4bc700 1 --2- 172.21.15.1:0/1810061979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f37a805f2c0 0x7f37a8061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:33.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.218+0000 7f37cc4bc700 1 --2- 172.21.15.1:0/1810061979 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37c4154480 0x7f37c4152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:33.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.218+0000 7f37cc4bc700 1 --2- 172.21.15.1:0/1810061979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c40c6650 0x7f37c4154df0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:33.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.218+0000 7f37cc4bc700 1 --2- 172.21.15.1:0/1810061979 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37c41540a0 0x7f37c4151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:33.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.218+0000 7f37cc4bc700 1 -- 172.21.15.1:0/1810061979 >> 172.21.15.1:0/1810061979 conn(0x7f37c4064a70 msgr2=0x7f37c40ab320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:33.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.218+0000 7f37cc4bc700 1 -- 172.21.15.1:0/1810061979 shutdown_connections 2023-11-15T01:40:33.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.218+0000 7f37cc4bc700 1 -- 172.21.15.1:0/1810061979 wait complete. 2023-11-15T01:40:33.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T01:40:33.233 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-15T01:40:33.254 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1 1M 2023-11-15T01:40:33.362 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:33.361+0000 7f15862dd680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:40:33.392 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:33.390+0000 7f11b8b9a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T01:40:33.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.418+0000 7fbb6f214700 1 Processor -- start 2023-11-15T01:40:33.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.418+0000 7fbb6f214700 1 -- start start 2023-11-15T01:40:33.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.419+0000 7fbb6f214700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbb680bcd20 0x7fbb68152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:33.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.419+0000 7fbb6f214700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb68156e70 con 0x7fbb681521a0 2023-11-15T01:40:33.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.419+0000 7fbb6f214700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb68156260 con 0x7fbb680627b0 2023-11-15T01:40:33.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.419+0000 7fbb6f214700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb68156540 con 0x7fbb680bcd20 2023-11-15T01:40:33.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.419+0000 7fbb6cfb0700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fbb681521a0 0x7fbb680aa130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51984/0 (socket says 172.21.15.1:51984) 2023-11-15T01:40:33.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.419+0000 7fbb6cfb0700 1 -- 172.21.15.1:0/2284020084 learned_addr learned my addr 172.21.15.1:0/2284020084 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:33.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.419+0000 7fbb67fff700 1 --2- 172.21.15.1:0/2284020084 >> v2:172.21.15.141:3300/0 conn(0x7fbb680bcd20 0x7fbb68152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:33.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.420+0000 7fbb677fe700 1 -- 172.21.15.1:0/2284020084 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937418192 0 0) 0x7fbb68156e70 con 0x7fbb681521a0 2023-11-15T01:40:33.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.420+0000 7fbb677fe700 1 -- 172.21.15.1:0/2284020084 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb580033f0 con 0x7fbb681521a0 2023-11-15T01:40:33.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.420+0000 7fbb67fff700 1 -- 172.21.15.1:0/2284020084 >> v1:172.21.15.141:6789/0 conn(0x7fbb680627b0 legacy=0x7fbb68152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:33.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.420+0000 7fbb677fe700 1 -- 172.21.15.1:0/2284020084 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686272795 0 0) 0x7fbb68156260 con 0x7fbb680627b0 2023-11-15T01:40:33.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.420+0000 7fbb67fff700 1 -- 172.21.15.1:0/2284020084 >> v1:172.21.15.1:6789/0 conn(0x7fbb681521a0 legacy=0x7fbb680aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:33.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.420+0000 7fbb67fff700 1 -- 172.21.15.1:0/2284020084 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb68156820 con 0x7fbb680bcd20 2023-11-15T01:40:33.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.420+0000 7fbb67fff700 1 --2- 172.21.15.1:0/2284020084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb680bcd20 0x7fbb68152580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fbb54009760 tx=0x7fbb54009060).ready entity=mon.1 client_cookie=5e59bb4730c7208c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:33.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.420+0000 7fbb677fe700 1 -- 172.21.15.1:0/2284020084 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c001470 con 0x7fbb680bcd20 2023-11-15T01:40:33.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.420+0000 7fbb677fe700 1 -- 172.21.15.1:0/2284020084 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb54012410 con 0x7fbb680bcd20 2023-11-15T01:40:33.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.420+0000 7fbb677fe700 1 -- 172.21.15.1:0/2284020084 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb54012790 con 0x7fbb680bcd20 2023-11-15T01:40:33.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.421+0000 7fbb6f214700 1 -- 172.21.15.1:0/2284020084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb680bcd20 msgr2=0x7fbb68152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:33.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.421+0000 7fbb6f214700 1 --2- 172.21.15.1:0/2284020084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb680bcd20 0x7fbb68152580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fbb54009760 tx=0x7fbb54009060).stop 2023-11-15T01:40:33.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.421+0000 7fbb6f214700 1 -- 172.21.15.1:0/2284020084 shutdown_connections 2023-11-15T01:40:33.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.421+0000 7fbb6f214700 1 --2- 172.21.15.1:0/2284020084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb680bcd20 0x7fbb68152580 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:33.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.421+0000 7fbb6f214700 1 -- 172.21.15.1:0/2284020084 >> 172.21.15.1:0/2284020084 conn(0x7fbb680c7dc0 msgr2=0x7fbb680c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:33.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.421+0000 7fbb6f214700 1 -- 172.21.15.1:0/2284020084 shutdown_connections 2023-11-15T01:40:33.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.421+0000 7fbb6f214700 1 -- 172.21.15.1:0/2284020084 wait complete. 2023-11-15T01:40:33.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.422+0000 7fbb6f214700 1 Processor -- start 2023-11-15T01:40:33.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.422+0000 7fbb6f214700 1 -- start start 2023-11-15T01:40:33.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6f214700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb680627b0 0x7fbb68137110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:33.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6f214700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb680bcd20 0x7fbb68066680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:33.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6f214700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb681521a0 0x7fbb68066b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:33.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6f214700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb68067060 con 0x7fbb681521a0 2023-11-15T01:40:33.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6f214700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb680bf940 con 0x7fbb680627b0 2023-11-15T01:40:33.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6f214700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb68137600 con 0x7fbb680bcd20 2023-11-15T01:40:33.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6d7b1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb681521a0 0x7fbb68066b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:33.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6d7b1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb681521a0 0x7fbb68066b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58786/0 (socket says 172.21.15.1:58786) 2023-11-15T01:40:33.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6d7b1700 1 -- 172.21.15.1:0/2537272561 learned_addr learned my addr 172.21.15.1:0/2537272561 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:33.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb67fff700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb680bcd20 0x7fbb68066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:33.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6cfb0700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb680627b0 0x7fbb68137110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:33.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6d7b1700 1 -- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb680bcd20 msgr2=0x7fbb68066680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:33.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6d7b1700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb680bcd20 0x7fbb68066680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:33.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6d7b1700 1 -- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb680627b0 msgr2=0x7fbb68137110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:33.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6d7b1700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb680627b0 0x7fbb68137110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:33.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6d7b1700 1 -- 172.21.15.1:0/2537272561 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb540092a0 con 0x7fbb681521a0 2023-11-15T01:40:33.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb67fff700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb680bcd20 0x7fbb68066680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:33.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.423+0000 7fbb6d7b1700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb681521a0 0x7fbb68066b70 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7fbb60002230 tx=0x7fbb60007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:33.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.424+0000 7fbb64ff9700 1 -- 172.21.15.1:0/2537272561 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb60010510 con 0x7fbb681521a0 2023-11-15T01:40:33.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.424+0000 7fbb64ff9700 1 -- 172.21.15.1:0/2537272561 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb60010670 con 0x7fbb681521a0 2023-11-15T01:40:33.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.424+0000 7fbb64ff9700 1 -- 172.21.15.1:0/2537272561 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb60010a10 con 0x7fbb681521a0 2023-11-15T01:40:33.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.424+0000 7fbb6f214700 1 -- 172.21.15.1:0/2537272561 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb68166ac0 con 0x7fbb681521a0 2023-11-15T01:40:33.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.424+0000 7fbb6f214700 1 -- 172.21.15.1:0/2537272561 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb680c1410 con 0x7fbb681521a0 2023-11-15T01:40:33.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.425+0000 7fbb6f214700 1 -- 172.21.15.1:0/2537272561 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6806c7e0 con 0x7fbb681521a0 2023-11-15T01:40:33.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.426+0000 7fbb64ff9700 1 -- 172.21.15.1:0/2537272561 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 58) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fbb6001b400 con 0x7fbb681521a0 2023-11-15T01:40:33.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.426+0000 7fbb64ff9700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 0x7fbb4c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:33.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.426+0000 7fbb64ff9700 1 -- 172.21.15.1:0/2537272561 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6573+0+0 (secure 0 0 0) 0x7fbb6007a360 con 0x7fbb681521a0 2023-11-15T01:40:33.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.426+0000 7fbb6cfb0700 1 -- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 msgr2=0x7fbb4c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:33.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.426+0000 7fbb6cfb0700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 0x7fbb4c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T01:40:33.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.430+0000 7fbb64ff9700 1 -- 172.21.15.1:0/2537272561 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbb6004b290 con 0x7fbb681521a0 2023-11-15T01:40:33.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.627+0000 7fbb6cfb0700 1 -- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 msgr2=0x7fbb4c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:33.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.627+0000 7fbb6cfb0700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 0x7fbb4c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T01:40:33.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:33.632+0000 7fbb6f214700 1 -- 172.21.15.1:0/2537272561 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb68156b00 con 0x7fbb4c05f2c0 2023-11-15T01:40:33.975 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:33.974+0000 7f15862dd680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:40:34.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:34.028+0000 7fbb6cfb0700 1 -- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 msgr2=0x7fbb4c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:34.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:34.028+0000 7fbb6cfb0700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 0x7fbb4c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-15T01:40:34.046 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:34.046+0000 7f15862dd680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:40:34.059 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:34.058+0000 7f11b8b9a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T01:40:34.128 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:34.126+0000 7f11b8b9a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T01:40:34.234 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:34.233+0000 7f15862dd680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:40:34.322 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:34.321+0000 7f11b8b9a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T01:40:34.654 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:34.654+0000 7f15862dd680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:40:34.757 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:34.757+0000 7f15862dd680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:40:34.762 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:34.761+0000 7f11b8b9a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T01:40:34.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:34.829+0000 7fbb6cfb0700 1 -- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 msgr2=0x7fbb4c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:34.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:34.829+0000 7fbb6cfb0700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 0x7fbb4c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-15T01:40:34.871 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:34.869+0000 7f11b8b9a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:40:34.911 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:34.910+0000 7f15862dd680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:40:34.985 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:34.984+0000 7f15862dd680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:40:35.030 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:35.028+0000 7f11b8b9a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T01:40:35.052 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:35.051+0000 7f15862dd680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:40:35.107 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:35.106+0000 7f11b8b9a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T01:40:35.179 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:35.177+0000 7f11b8b9a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T01:40:35.310 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:35.309+0000 7f15862dd680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:40:35.451 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:35.450+0000 7f11b8b9a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T01:40:35.493 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:35.493+0000 7f15862dd680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:40:35.642 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:35.641+0000 7f11b8b9a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T01:40:36.143 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:36.142+0000 7f15862dd680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:40:36.212 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:36.211+0000 7f15862dd680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:40:36.290 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:36.289+0000 7f15862dd680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:40:36.328 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:36.327+0000 7f11b8b9a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T01:40:36.401 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:36.400+0000 7f11b8b9a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T01:40:36.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:36.431+0000 7fbb6cfb0700 1 -- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 msgr2=0x7fbb4c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T01:40:36.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:36.431+0000 7fbb6cfb0700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 0x7fbb4c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-15T01:40:36.435 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:36.434+0000 7f15862dd680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:40:36.480 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:36.478+0000 7f11b8b9a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T01:40:36.506 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:36.505+0000 7f15862dd680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:40:36.622 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:36.621+0000 7f15862dd680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:40:36.634 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:36.632+0000 7f11b8b9a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T01:40:36.709 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:36.708+0000 7f11b8b9a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T01:40:36.734 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:36.733+0000 7f15862dd680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:40:36.830 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:36.829+0000 7f11b8b9a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T01:40:36.943 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:36.942+0000 7f11b8b9a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T01:40:37.026 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:37.025+0000 7f15862dd680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:40:37.098 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:37.097+0000 7f15862dd680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:40:37.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:37.119+0000 7fbb64ff9700 1 -- 172.21.15.1:0/2537272561 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 59) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fbb60018d60 con 0x7fbb681521a0 2023-11-15T01:40:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:37.119+0000 7fbb64ff9700 1 -- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 msgr2=0x7fbb4c061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T01:40:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:37.119+0000 7fbb64ff9700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 0x7fbb4c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T01:40:37.185 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:37.184+0000 7f14fda68700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:37.185 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:37.184+0000 7f14f9a60700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:37.185 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:37.184+0000 7f14fda68700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:37.185 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:37.184+0000 7f14f9a60700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:37.186 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:37.184+0000 7f14fda68700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:37.186 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:37.184+0000 7f14f9a60700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:37.186 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:37.184+0000 7f14fda68700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:37.186 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:37.184+0000 7f14f9a60700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:37.187 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:37.184+0000 7f14fda68700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:37.187 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:40:37.184+0000 7f14f9a60700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:40:37.254 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:37.252+0000 7f11b8b9a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T01:40:37.328 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T01:40:37.327+0000 7f11b8b9a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T01:40:38.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.121+0000 7fbb64ff9700 1 -- 172.21.15.1:0/2537272561 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 60) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fbb60078170 con 0x7fbb681521a0 2023-11-15T01:40:38.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.122+0000 7fbb64ff9700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 0x7fbb4c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.122+0000 7fbb64ff9700 1 -- 172.21.15.1:0/2537272561 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb68156b00 con 0x7fbb4c05f2c0 2023-11-15T01:40:38.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.122+0000 7fbb6cfb0700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 0x7fbb4c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.123+0000 7fbb6cfb0700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 0x7fbb4c061700 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fbb5c0011e0 tx=0x7fbb5c000bc0).ready entity=mgr.6827 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:38.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.136+0000 7fbb64ff9700 1 -- 172.21.15.1:0/2537272561 <== mgr.6827 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fbb68156b00 con 0x7fbb4c05f2c0 2023-11-15T01:40:38.138 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path /snap_test_dir1 2023-11-15T01:40:38.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.139+0000 7fbb6f214700 1 -- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 msgr2=0x7fbb4c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:38.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.139+0000 7fbb6f214700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 0x7fbb4c061700 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fbb5c0011e0 tx=0x7fbb5c000bc0).stop 2023-11-15T01:40:38.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.139+0000 7fbb6f214700 1 -- 172.21.15.1:0/2537272561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb681521a0 msgr2=0x7fbb68066b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:38.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.139+0000 7fbb6f214700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb681521a0 0x7fbb68066b70 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7fbb60002230 tx=0x7fbb60007f70).stop 2023-11-15T01:40:38.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.139+0000 7fbb6f214700 1 -- 172.21.15.1:0/2537272561 shutdown_connections 2023-11-15T01:40:38.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.139+0000 7fbb6f214700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbb4c05f2c0 0x7fbb4c061700 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.139+0000 7fbb6f214700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb681521a0 0x7fbb68066b70 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.139+0000 7fbb6f214700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb680627b0 0x7fbb68137110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.139+0000 7fbb6f214700 1 --2- 172.21.15.1:0/2537272561 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb680bcd20 0x7fbb68066680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.139+0000 7fbb6f214700 1 -- 172.21.15.1:0/2537272561 >> 172.21.15.1:0/2537272561 conn(0x7fbb680c7dc0 msgr2=0x7fbb68065820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:38.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.139+0000 7fbb6f214700 1 -- 172.21.15.1:0/2537272561 shutdown_connections 2023-11-15T01:40:38.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.139+0000 7fbb6f214700 1 -- 172.21.15.1:0/2537272561 wait complete. 2023-11-15T01:40:38.155 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1 2023-11-15T01:40:38.155 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs /snap_test_dir1 55n 2023-11-15T01:40:38.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.284+0000 7f033f59e700 1 Processor -- start 2023-11-15T01:40:38.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.284+0000 7f033f59e700 1 -- start start 2023-11-15T01:40:38.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033f59e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f03401541d0 0x7f03401545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033f59e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03400c60d0 0x7f03400c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033f59e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f03400c7a60 0x7f03400c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033f59e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0340158f40 con 0x7f03401541d0 2023-11-15T01:40:38.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033f59e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0340155830 con 0x7f03400c7a60 2023-11-15T01:40:38.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033f59e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03400c83a0 con 0x7f03400c60d0 2023-11-15T01:40:38.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033e59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f03401541d0 0x7f03401545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033e59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f03401541d0 0x7f03401545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54432/0 (socket says 172.21.15.1:54432) 2023-11-15T01:40:38.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033e59c700 1 -- 172.21.15.1:0/3619253015 learned_addr learned my addr 172.21.15.1:0/3619253015 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:38.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033ed9d700 1 --2- 172.21.15.1:0/3619253015 >> v2:172.21.15.141:3300/0 conn(0x7f03400c7a60 0x7f03400c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033dd9b700 1 --2- 172.21.15.1:0/3619253015 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03400c60d0 0x7f03400c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033e59c700 1 -- 172.21.15.1:0/3619253015 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03400c60d0 msgr2=0x7f03400c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:38.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033e59c700 1 --2- 172.21.15.1:0/3619253015 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03400c60d0 0x7f03400c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033e59c700 1 -- 172.21.15.1:0/3619253015 >> v2:172.21.15.141:3300/0 conn(0x7f03400c7a60 msgr2=0x7f03400c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:38.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033e59c700 1 --2- 172.21.15.1:0/3619253015 >> v2:172.21.15.141:3300/0 conn(0x7f03400c7a60 0x7f03400c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033e59c700 1 -- 172.21.15.1:0/3619253015 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0340154c20 con 0x7f03401541d0 2023-11-15T01:40:38.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033ed9d700 1 --2- 172.21.15.1:0/3619253015 >> v2:172.21.15.141:3300/0 conn(0x7f03400c7a60 0x7f03400c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:38.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.285+0000 7f033e59c700 1 --2- 172.21.15.1:0/3619253015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03401541d0 0x7f03401545b0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f03400cb0d0 tx=0x7f03300090f0).ready entity=mon.0 client_cookie=54beb19b940346f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:38.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.286+0000 7f033d59a700 1 -- 172.21.15.1:0/3619253015 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033000b520 con 0x7f03401541d0 2023-11-15T01:40:38.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.286+0000 7f033d59a700 1 -- 172.21.15.1:0/3619253015 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033000b680 con 0x7f03401541d0 2023-11-15T01:40:38.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.286+0000 7f033d59a700 1 -- 172.21.15.1:0/3619253015 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033000ba00 con 0x7f03401541d0 2023-11-15T01:40:38.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.286+0000 7f033f59e700 1 -- 172.21.15.1:0/3619253015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03401541d0 msgr2=0x7f03401545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:38.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.286+0000 7f033f59e700 1 --2- 172.21.15.1:0/3619253015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03401541d0 0x7f03401545b0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f03400cb0d0 tx=0x7f03300090f0).stop 2023-11-15T01:40:38.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.286+0000 7f033f59e700 1 -- 172.21.15.1:0/3619253015 shutdown_connections 2023-11-15T01:40:38.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.286+0000 7f033f59e700 1 --2- 172.21.15.1:0/3619253015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03401541d0 0x7f03401545b0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.286+0000 7f033f59e700 1 --2- 172.21.15.1:0/3619253015 >> v2:172.21.15.141:3300/0 conn(0x7f03400c7a60 0x7f03400c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.286+0000 7f033f59e700 1 --2- 172.21.15.1:0/3619253015 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03400c60d0 0x7f03400c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.286+0000 7f033f59e700 1 -- 172.21.15.1:0/3619253015 >> 172.21.15.1:0/3619253015 conn(0x7f0340069ee0 msgr2=0x7f034006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:38.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.286+0000 7f033f59e700 1 -- 172.21.15.1:0/3619253015 shutdown_connections 2023-11-15T01:40:38.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.286+0000 7f033f59e700 1 -- 172.21.15.1:0/3619253015 wait complete. 2023-11-15T01:40:38.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.287+0000 7f033f59e700 1 Processor -- start 2023-11-15T01:40:38.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.287+0000 7f033f59e700 1 -- start start 2023-11-15T01:40:38.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.288+0000 7f033f59e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03400c60d0 0x7f034014db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.288+0000 7f033f59e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03400c7a60 0x7f0340155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.288+0000 7f033f59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03401541d0 0x7f0340156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.288+0000 7f033f59e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03400ae0d0 con 0x7f03401541d0 2023-11-15T01:40:38.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.288+0000 7f033f59e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0340157200 con 0x7f03400c60d0 2023-11-15T01:40:38.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.288+0000 7f033f59e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03401565f0 con 0x7f03400c7a60 2023-11-15T01:40:38.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.288+0000 7f033ed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03401541d0 0x7f0340156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.288+0000 7f033ed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03401541d0 0x7f0340156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54442/0 (socket says 172.21.15.1:54442) 2023-11-15T01:40:38.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.288+0000 7f033ed9d700 1 -- 172.21.15.1:0/4135937369 learned_addr learned my addr 172.21.15.1:0/4135937369 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:38.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.288+0000 7f033dd9b700 1 --2- 172.21.15.1:0/4135937369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03400c7a60 0x7f0340155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.288+0000 7f033e59c700 1 --2- 172.21.15.1:0/4135937369 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03400c60d0 0x7f034014db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.289+0000 7f033ed9d700 1 -- 172.21.15.1:0/4135937369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03400c7a60 msgr2=0x7f0340155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:38.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.289+0000 7f033ed9d700 1 --2- 172.21.15.1:0/4135937369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03400c7a60 0x7f0340155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.289+0000 7f033ed9d700 1 -- 172.21.15.1:0/4135937369 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03400c60d0 msgr2=0x7f034014db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:38.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.289+0000 7f033ed9d700 1 --2- 172.21.15.1:0/4135937369 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03400c60d0 0x7f034014db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.289+0000 7f033ed9d700 1 -- 172.21.15.1:0/4135937369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0330009370 con 0x7f03401541d0 2023-11-15T01:40:38.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.289+0000 7f033ed9d700 1 --2- 172.21.15.1:0/4135937369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03401541d0 0x7f0340156020 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f033800d180 tx=0x7f0338009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:38.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.289+0000 7f032e7fc700 1 -- 172.21.15.1:0/4135937369 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033800dcc0 con 0x7f03401541d0 2023-11-15T01:40:38.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.289+0000 7f032e7fc700 1 -- 172.21.15.1:0/4135937369 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033800f040 con 0x7f03401541d0 2023-11-15T01:40:38.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.289+0000 7f033f59e700 1 -- 172.21.15.1:0/4135937369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03401568d0 con 0x7f03401541d0 2023-11-15T01:40:38.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.289+0000 7f032e7fc700 1 -- 172.21.15.1:0/4135937369 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338013600 con 0x7f03401541d0 2023-11-15T01:40:38.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.289+0000 7f033f59e700 1 -- 172.21.15.1:0/4135937369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0340156e90 con 0x7f03401541d0 2023-11-15T01:40:38.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.290+0000 7f033f59e700 1 -- 172.21.15.1:0/4135937369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03401573b0 con 0x7f03401541d0 2023-11-15T01:40:38.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.290+0000 7f032e7fc700 1 -- 172.21.15.1:0/4135937369 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 60) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f03380139b0 con 0x7f03401541d0 2023-11-15T01:40:38.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.290+0000 7f032e7fc700 1 --2- 172.21.15.1:0/4135937369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f032005f080 0x7f0320061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.291+0000 7f032e7fc700 1 -- 172.21.15.1:0/4135937369 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6831+0+0 (secure 0 0 0) 0x7f033807a8a0 con 0x7f03401541d0 2023-11-15T01:40:38.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.291+0000 7f033e59c700 1 --2- 172.21.15.1:0/4135937369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f032005f080 0x7f0320061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.291+0000 7f033e59c700 1 --2- 172.21.15.1:0/4135937369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f032005f080 0x7f0320061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0330009130 tx=0x7f0330017000).ready entity=mgr.6827 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:38.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.295+0000 7f032e7fc700 1 -- 172.21.15.1:0/4135937369 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f03401573b0 con 0x7f03401541d0 2023-11-15T01:40:38.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.496+0000 7f033f59e700 1 -- 172.21.15.1:0/4135937369 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/snap_test_dir1", "retention_spec_or_period": "55n", "target": ["mon-mgr", ""]}) v1 -- 0x7f0340153890 con 0x7f032005f080 2023-11-15T01:40:38.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.501+0000 7f032e7fc700 1 -- 172.21.15.1:0/4135937369 <== mgr.6827 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+40 (secure 0 0 0) 0x7f0340153890 con 0x7f032005f080 2023-11-15T01:40:38.502 INFO:teuthology.orchestra.run.smithi001.stdout:Retention added to path /snap_test_dir1 2023-11-15T01:40:38.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.503+0000 7f033f59e700 1 -- 172.21.15.1:0/4135937369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f032005f080 msgr2=0x7f0320061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:38.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.503+0000 7f033f59e700 1 --2- 172.21.15.1:0/4135937369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f032005f080 0x7f0320061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0330009130 tx=0x7f0330017000).stop 2023-11-15T01:40:38.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.503+0000 7f033f59e700 1 -- 172.21.15.1:0/4135937369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03401541d0 msgr2=0x7f0340156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:38.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.503+0000 7f033f59e700 1 --2- 172.21.15.1:0/4135937369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03401541d0 0x7f0340156020 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f033800d180 tx=0x7f0338009a50).stop 2023-11-15T01:40:38.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.503+0000 7f033f59e700 1 -- 172.21.15.1:0/4135937369 shutdown_connections 2023-11-15T01:40:38.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.503+0000 7f033f59e700 1 --2- 172.21.15.1:0/4135937369 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f032005f080 0x7f0320061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.503+0000 7f033f59e700 1 --2- 172.21.15.1:0/4135937369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03401541d0 0x7f0340156020 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.503+0000 7f033f59e700 1 --2- 172.21.15.1:0/4135937369 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03400c60d0 0x7f034014db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.503+0000 7f033f59e700 1 --2- 172.21.15.1:0/4135937369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03400c7a60 0x7f0340155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.503+0000 7f033f59e700 1 -- 172.21.15.1:0/4135937369 >> 172.21.15.1:0/4135937369 conn(0x7f0340069ee0 msgr2=0x7f0340153180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:38.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.503+0000 7f033f59e700 1 -- 172.21.15.1:0/4135937369 shutdown_connections 2023-11-15T01:40:38.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.503+0000 7f033f59e700 1 -- 172.21.15.1:0/4135937369 wait complete. 2023-11-15T01:40:38.517 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path /snap_test_dir1 2023-11-15T01:40:38.517 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-11-15T01:40:38.518 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json /snap_test_dir1 2023-11-15T01:40:38.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.638+0000 7fcf3b5e7700 1 Processor -- start 2023-11-15T01:40:38.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.638+0000 7fcf3b5e7700 1 -- start start 2023-11-15T01:40:38.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.639+0000 7fcf3b5e7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fcf340c1cb0 0x7fcf34157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.639+0000 7fcf3b5e7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf340aa060 0x7fcf340aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.639+0000 7fcf3b5e7700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf340c1820 con 0x7fcf34157660 2023-11-15T01:40:38.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.639+0000 7fcf3b5e7700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf340c7540 con 0x7fcf340c1cb0 2023-11-15T01:40:38.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.639+0000 7fcf3b5e7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340aa9e0 con 0x7fcf340aa060 2023-11-15T01:40:38.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.639+0000 7fcf39383700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fcf34157660 0x7fcf340c6280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:50328/0 (socket says 172.21.15.1:50328) 2023-11-15T01:40:38.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.639+0000 7fcf39383700 1 -- 172.21.15.1:0/3332167410 learned_addr learned my addr 172.21.15.1:0/3332167410 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T01:40:38.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.639+0000 7fcf38b82700 1 --2- 172.21.15.1:0/3332167410 >> v2:172.21.15.141:3300/0 conn(0x7fcf340c1cb0 0x7fcf34157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.639+0000 7fcf39b84700 1 --2- 172.21.15.1:0/3332167410 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf340aa060 0x7fcf340aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.639+0000 7fcf33fff700 1 -- 172.21.15.1:0/3332167410 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644592702 0 0) 0x7fcf340c1820 con 0x7fcf34157660 2023-11-15T01:40:38.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.639+0000 7fcf33fff700 1 -- 172.21.15.1:0/3332167410 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf1c0033f0 con 0x7fcf34157660 2023-11-15T01:40:38.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf33fff700 1 -- 172.21.15.1:0/3332167410 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2353106733 0 0) 0x7fcf1c0033f0 con 0x7fcf34157660 2023-11-15T01:40:38.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf33fff700 1 -- 172.21.15.1:0/3332167410 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf340aa060 msgr2=0x7fcf340aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:38.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf33fff700 1 --2- 172.21.15.1:0/3332167410 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf340aa060 0x7fcf340aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf33fff700 1 -- 172.21.15.1:0/3332167410 >> v2:172.21.15.141:3300/0 conn(0x7fcf340c1cb0 msgr2=0x7fcf34157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:38.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf33fff700 1 --2- 172.21.15.1:0/3332167410 >> v2:172.21.15.141:3300/0 conn(0x7fcf340c1cb0 0x7fcf34157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf33fff700 1 -- 172.21.15.1:0/3332167410 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf340c0c30 con 0x7fcf34157660 2023-11-15T01:40:38.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf33fff700 1 -- 172.21.15.1:0/3332167410 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fcf2c001470 con 0x7fcf34157660 2023-11-15T01:40:38.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf33fff700 1 -- 172.21.15.1:0/3332167410 >> v1:172.21.15.1:6789/0 conn(0x7fcf34157660 legacy=0x7fcf340c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:38.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf33fff700 1 --2- 172.21.15.1:0/3332167410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf1c0038e0 0x7fcf1c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf33fff700 1 --2- 172.21.15.1:0/3332167410 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf1c004690 0x7fcf1c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf33fff700 1 --2- 172.21.15.1:0/3332167410 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf1c005000 0x7fcf1c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf33fff700 1 -- 172.21.15.1:0/3332167410 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340aa9e0 con 0x7fcf1c0038e0 2023-11-15T01:40:38.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf33fff700 1 -- 172.21.15.1:0/3332167410 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c00bdd0 con 0x7fcf1c004690 2023-11-15T01:40:38.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf33fff700 1 -- 172.21.15.1:0/3332167410 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c00bf40 con 0x7fcf1c005000 2023-11-15T01:40:38.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf38b82700 1 --2- 172.21.15.1:0/3332167410 >> v2:172.21.15.141:3300/0 conn(0x7fcf340c1cb0 0x7fcf34157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:38.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf39b84700 1 --2- 172.21.15.1:0/3332167410 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf340aa060 0x7fcf340aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T01:40:38.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf39383700 1 --2- 172.21.15.1:0/3332167410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf1c0038e0 0x7fcf1c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf38b82700 1 --2- 172.21.15.1:0/3332167410 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf1c004690 0x7fcf1c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf39b84700 1 --2- 172.21.15.1:0/3332167410 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf1c005000 0x7fcf1c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf39383700 1 -- 172.21.15.1:0/3332167410 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf1c005000 msgr2=0x7fcf1c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:38.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf39383700 1 --2- 172.21.15.1:0/3332167410 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf1c005000 0x7fcf1c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf39383700 1 -- 172.21.15.1:0/3332167410 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf1c004690 msgr2=0x7fcf1c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T01:40:38.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf39383700 1 --2- 172.21.15.1:0/3332167410 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf1c004690 0x7fcf1c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf39383700 1 -- 172.21.15.1:0/3332167410 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c0033f0 con 0x7fcf1c0038e0 2023-11-15T01:40:38.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf39b84700 1 --2- 172.21.15.1:0/3332167410 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf1c005000 0x7fcf1c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T01:40:38.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.640+0000 7fcf39383700 1 --2- 172.21.15.1:0/3332167410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf1c0038e0 0x7fcf1c003d00 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7fcf2c00c210 tx=0x7fcf2c001e90).ready entity=mon.0 client_cookie=616f7c15b6ba8ae7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:38.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.641+0000 7fcf33fff700 1 -- 172.21.15.1:0/3332167410 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c007a60 con 0x7fcf1c0038e0 2023-11-15T01:40:38.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.641+0000 7fcf33fff700 1 -- 172.21.15.1:0/3332167410 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c00ca80 con 0x7fcf1c0038e0 2023-11-15T01:40:38.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.641+0000 7fcf33fff700 1 -- 172.21.15.1:0/3332167410 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c00ce20 con 0x7fcf1c0038e0 2023-11-15T01:40:38.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.641+0000 7fcf3b5e7700 1 -- 172.21.15.1:0/3332167410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf1c0038e0 msgr2=0x7fcf1c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:38.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.641+0000 7fcf3b5e7700 1 --2- 172.21.15.1:0/3332167410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf1c0038e0 0x7fcf1c003d00 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7fcf2c00c210 tx=0x7fcf2c001e90).stop 2023-11-15T01:40:38.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.641+0000 7fcf39b84700 1 -- 172.21.15.1:0/3332167410 reap_dead start 2023-11-15T01:40:38.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.641+0000 7fcf3b5e7700 1 -- 172.21.15.1:0/3332167410 shutdown_connections 2023-11-15T01:40:38.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.641+0000 7fcf3b5e7700 1 -- 172.21.15.1:0/3332167410 >> 172.21.15.1:0/3332167410 conn(0x7fcf34064aa0 msgr2=0x7fcf34064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:38.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.641+0000 7fcf3b5e7700 1 -- 172.21.15.1:0/3332167410 shutdown_connections 2023-11-15T01:40:38.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.641+0000 7fcf3b5e7700 1 -- 172.21.15.1:0/3332167410 wait complete. 2023-11-15T01:40:38.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.642+0000 7fcf3b5e7700 1 Processor -- start 2023-11-15T01:40:38.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.642+0000 7fcf3b5e7700 1 -- start start 2023-11-15T01:40:38.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.643+0000 7fcf3b5e7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf1c0038e0 0x7fcf340c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.643+0000 7fcf3b5e7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf34149c70 0x7fcf340ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.643+0000 7fcf3b5e7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf340aead0 0x7fcf34151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.643+0000 7fcf3b5e7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340aef50 con 0x7fcf1c0038e0 2023-11-15T01:40:38.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.643+0000 7fcf3b5e7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340c3fc0 con 0x7fcf340aead0 2023-11-15T01:40:38.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.643+0000 7fcf3b5e7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340c5120 con 0x7fcf34149c70 2023-11-15T01:40:38.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.643+0000 7fcf39383700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf1c0038e0 0x7fcf340c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.643+0000 7fcf39383700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf1c0038e0 0x7fcf340c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54450/0 (socket says 172.21.15.1:54450) 2023-11-15T01:40:38.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.643+0000 7fcf39383700 1 -- 172.21.15.1:0/3310791115 learned_addr learned my addr 172.21.15.1:0/3310791115 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T01:40:38.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.643+0000 7fcf38b82700 1 --2- 172.21.15.1:0/3310791115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf34149c70 0x7fcf340ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.643+0000 7fcf39b84700 1 --2- 172.21.15.1:0/3310791115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf340aead0 0x7fcf34151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.644+0000 7fcf39383700 1 -- 172.21.15.1:0/3310791115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf34149c70 msgr2=0x7fcf340ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:38.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.644+0000 7fcf39383700 1 --2- 172.21.15.1:0/3310791115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf34149c70 0x7fcf340ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.644+0000 7fcf39383700 1 -- 172.21.15.1:0/3310791115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf340aead0 msgr2=0x7fcf34151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:38.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.644+0000 7fcf39383700 1 --2- 172.21.15.1:0/3310791115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf340aead0 0x7fcf34151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.644+0000 7fcf39383700 1 -- 172.21.15.1:0/3310791115 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf340c3690 con 0x7fcf1c0038e0 2023-11-15T01:40:38.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.644+0000 7fcf39383700 1 --2- 172.21.15.1:0/3310791115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf1c0038e0 0x7fcf340c4450 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7fcf2c00c800 tx=0x7fcf2c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:38.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.644+0000 7fcf317fa700 1 -- 172.21.15.1:0/3310791115 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0074f0 con 0x7fcf1c0038e0 2023-11-15T01:40:38.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.644+0000 7fcf317fa700 1 -- 172.21.15.1:0/3310791115 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c007650 con 0x7fcf1c0038e0 2023-11-15T01:40:38.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.644+0000 7fcf3b5e7700 1 -- 172.21.15.1:0/3310791115 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf340c3970 con 0x7fcf1c0038e0 2023-11-15T01:40:38.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.644+0000 7fcf317fa700 1 -- 172.21.15.1:0/3310791115 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c004900 con 0x7fcf1c0038e0 2023-11-15T01:40:38.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.644+0000 7fcf3b5e7700 1 -- 172.21.15.1:0/3310791115 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf340c4940 con 0x7fcf1c0038e0 2023-11-15T01:40:38.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.645+0000 7fcf3b5e7700 1 -- 172.21.15.1:0/3310791115 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf340c42a0 con 0x7fcf1c0038e0 2023-11-15T01:40:38.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.645+0000 7fcf317fa700 1 -- 172.21.15.1:0/3310791115 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 60) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fcf2c004c70 con 0x7fcf1c0038e0 2023-11-15T01:40:38.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.646+0000 7fcf317fa700 1 --2- 172.21.15.1:0/3310791115 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf2005f080 0x7fcf20061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T01:40:38.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.646+0000 7fcf317fa700 1 -- 172.21.15.1:0/3310791115 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6831+0+0 (secure 0 0 0) 0x7fcf2c019020 con 0x7fcf1c0038e0 2023-11-15T01:40:38.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.646+0000 7fcf38b82700 1 --2- 172.21.15.1:0/3310791115 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf2005f080 0x7fcf20061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T01:40:38.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.646+0000 7fcf38b82700 1 --2- 172.21.15.1:0/3310791115 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf2005f080 0x7fcf20061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fcf34065aa0 tx=0x7fcf28009060).ready entity=mgr.6827 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T01:40:38.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.650+0000 7fcf317fa700 1 -- 172.21.15.1:0/3310791115 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcf2c04c880 con 0x7fcf1c0038e0 2023-11-15T01:40:38.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.849+0000 7fcf3b5e7700 1 -- 172.21.15.1:0/3310791115 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf340aeeb0 con 0x7fcf2005f080 2023-11-15T01:40:38.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.852+0000 7fcf317fa700 1 -- 172.21.15.1:0/3310791115 <== mgr.6827 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+74 (secure 0 0 0) 0x7fcf340aeeb0 con 0x7fcf2005f080 2023-11-15T01:40:38.853 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T01:40:38.853 INFO:teuthology.orchestra.run.smithi001.stdout:{"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-11-15T01:40:38.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.853+0000 7fcf3b5e7700 1 -- 172.21.15.1:0/3310791115 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf2005f080 msgr2=0x7fcf20061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:38.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.853+0000 7fcf3b5e7700 1 --2- 172.21.15.1:0/3310791115 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf2005f080 0x7fcf20061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fcf34065aa0 tx=0x7fcf28009060).stop 2023-11-15T01:40:38.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.853+0000 7fcf3b5e7700 1 -- 172.21.15.1:0/3310791115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf1c0038e0 msgr2=0x7fcf340c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T01:40:38.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.853+0000 7fcf3b5e7700 1 --2- 172.21.15.1:0/3310791115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf1c0038e0 0x7fcf340c4450 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7fcf2c00c800 tx=0x7fcf2c015000).stop 2023-11-15T01:40:38.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.853+0000 7fcf3b5e7700 1 -- 172.21.15.1:0/3310791115 shutdown_connections 2023-11-15T01:40:38.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.853+0000 7fcf3b5e7700 1 --2- 172.21.15.1:0/3310791115 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf2005f080 0x7fcf20061540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.853+0000 7fcf3b5e7700 1 --2- 172.21.15.1:0/3310791115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf340aead0 0x7fcf34151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.853+0000 7fcf3b5e7700 1 --2- 172.21.15.1:0/3310791115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf1c0038e0 0x7fcf340c4450 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.853+0000 7fcf3b5e7700 1 --2- 172.21.15.1:0/3310791115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf34149c70 0x7fcf340ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T01:40:38.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.853+0000 7fcf3b5e7700 1 -- 172.21.15.1:0/3310791115 >> 172.21.15.1:0/3310791115 conn(0x7fcf34064aa0 msgr2=0x7fcf34154b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T01:40:38.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.853+0000 7fcf3b5e7700 1 -- 172.21.15.1:0/3310791115 shutdown_connections 2023-11-15T01:40:38.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T01:40:38.853+0000 7fcf3b5e7700 1 -- 172.21.15.1:0/3310791115 wait complete. 2023-11-15T01:40:38.866 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-11-15T01:40:38.867 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': '/snap_test_dir1', 'schedule': ['1M'], 'retention': [{'n': 55}]} 2023-11-15T01:40:47.966 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:40:47.969 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:41:00.507 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:41:00.506+0000 7f14eca46700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:41:00.507 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:41:00.506+0000 7f14eca46700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:41:00.507 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:41:00.506+0000 7f14eca46700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:41:00.507 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:41:00.506+0000 7f14eca46700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:41:00.508 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T01:41:00.506+0000 7f14eca46700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T01:41:18.048 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:41:18.051 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:41:48.143 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:41:48.146 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:42:18.211 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:42:18.214 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:42:48.269 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:42:48.272 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:43:18.372 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:43:18.375 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:43:48.447 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:43:48.450 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:44:18.517 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:44:18.520 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:44:48.607 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:44:48.611 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:45:18.693 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:45:18.696 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:45:48.765 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:45:48.768 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:46:18.832 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:46:18.835 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:46:48.898 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:46:48.902 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:47:18.977 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:47:18.981 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:47:49.066 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:47:49.069 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:48:19.186 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:48:19.189 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:48:49.324 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:48:49.328 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:49:19.469 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:49:19.473 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:49:49.607 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:49:49.611 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:50:19.737 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:50:19.740 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:50:49.808 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:50:49.811 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:51:19.938 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:51:19.942 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:51:50.092 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:51:50.095 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:52:20.221 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:52:20.224 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:52:50.351 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:52:50.355 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:53:20.496 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:53:20.499 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:53:50.643 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:53:50.647 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:54:20.713 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:54:20.716 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:54:50.772 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:54:50.776 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:55:20.913 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:55:20.916 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:55:51.043 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:55:51.047 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:56:21.189 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:56:21.193 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:56:51.253 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:56:51.257 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:57:21.390 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:57:21.393 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:57:51.510 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:57:51.514 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:58:21.648 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:58:21.651 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:58:51.710 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:58:51.713 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:59:21.865 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:59:21.868 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:59:52.002 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T01:59:52.005 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:00:22.132 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:00:22.137 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:00:52.261 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:00:52.264 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:01:22.391 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:01:22.395 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:01:52.463 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:01:52.467 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:02:22.544 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:02:22.547 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:02:52.612 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:02:52.615 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:03:22.680 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:03:22.683 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:03:52.820 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:03:52.823 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:04:22.925 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:04:22.928 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:04:53.062 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:04:53.065 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:05:23.208 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:05:23.212 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:05:53.331 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:05:53.334 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:06:23.391 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:06:23.394 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:06:53.521 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:06:53.525 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:07:23.663 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:07:23.666 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:07:53.788 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:07:53.792 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:08:23.968 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:08:23.971 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:08:54.089 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:08:54.093 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:09:24.210 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:09:24.214 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:09:54.290 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:09:54.294 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:10:24.444 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:10:24.448 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:10:54.508 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:10:54.511 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:11:24.629 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:11:24.634 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:11:54.775 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:11:54.778 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:12:24.920 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:12:24.923 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:12:55.058 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:12:55.062 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:13:25.203 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:13:25.207 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:13:55.325 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:13:55.328 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:14:25.396 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:14:25.399 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:14:55.525 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:14:55.528 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:15:25.620 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:15:25.625 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:15:55.685 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:15:55.688 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:16:25.884 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:16:25.888 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:16:55.976 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:16:55.982 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:17:26.139 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:17:26.159 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:17:56.277 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:17:56.280 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:18:26.434 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:18:26.438 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:18:56.590 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:18:56.593 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:19:26.736 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:19:26.739 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:19:56.890 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:19:56.894 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:20:27.020 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:20:27.024 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:20:57.157 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:20:57.161 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:21:27.270 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:21:27.274 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:21:57.408 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:21:57.411 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:22:27.546 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:22:27.550 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:22:57.617 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:22:57.620 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:23:27.730 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:23:27.733 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:23:57.876 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:23:57.880 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:24:27.939 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:24:27.942 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:24:58.093 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:24:58.096 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:25:28.232 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:25:28.235 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:25:58.360 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:25:58.363 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:26:28.490 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:26:28.493 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:26:58.619 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:26:58.623 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:27:28.694 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:27:28.698 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:27:58.820 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:27:58.823 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:28:28.983 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:28:28.986 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:28:59.113 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:28:59.116 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:29:29.175 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:29:29.179 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:29:59.239 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:29:59.242 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:30:29.304 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:30:29.307 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:30:59.430 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:30:59.433 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:31:29.585 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:31:29.588 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:31:59.706 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:31:59.710 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:32:29.819 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:32:29.822 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:32:59.973 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:32:59.976 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:33:30.118 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:33:30.122 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:34:00.266 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:34:00.270 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:34:30.411 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:34:30.414 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:35:00.556 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:35:00.560 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:35:30.741 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:35:30.745 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:36:00.823 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:36:00.827 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:36:15.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:15.870 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:36:15.893 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_42_00_UTC 2023-11-15T02:36:15.893 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_43_00_UTC 2023-11-15T02:36:15.893 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_44_00_UTC 2023-11-15T02:36:15.893 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_45_00_UTC 2023-11-15T02:36:15.894 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_46_00_UTC 2023-11-15T02:36:15.894 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_47_00_UTC 2023-11-15T02:36:15.894 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_48_00_UTC 2023-11-15T02:36:15.894 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_49_00_UTC 2023-11-15T02:36:15.895 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_50_00_UTC 2023-11-15T02:36:15.895 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_51_00_UTC 2023-11-15T02:36:15.895 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_52_00_UTC 2023-11-15T02:36:15.895 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_53_00_UTC 2023-11-15T02:36:15.895 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_54_00_UTC 2023-11-15T02:36:15.896 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_55_00_UTC 2023-11-15T02:36:15.896 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_56_00_UTC 2023-11-15T02:36:15.896 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_57_00_UTC 2023-11-15T02:36:15.896 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_58_00_UTC 2023-11-15T02:36:15.896 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_59_00_UTC 2023-11-15T02:36:15.897 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_00_00_UTC 2023-11-15T02:36:15.897 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_01_00_UTC 2023-11-15T02:36:15.897 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_02_00_UTC 2023-11-15T02:36:15.897 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_03_00_UTC 2023-11-15T02:36:15.897 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_04_00_UTC 2023-11-15T02:36:15.898 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_05_00_UTC 2023-11-15T02:36:15.898 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_06_00_UTC 2023-11-15T02:36:15.898 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_07_00_UTC 2023-11-15T02:36:15.898 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_08_00_UTC 2023-11-15T02:36:15.898 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_09_00_UTC 2023-11-15T02:36:15.899 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_10_00_UTC 2023-11-15T02:36:15.899 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_11_00_UTC 2023-11-15T02:36:15.899 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_12_00_UTC 2023-11-15T02:36:15.899 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_13_00_UTC 2023-11-15T02:36:15.899 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_14_00_UTC 2023-11-15T02:36:15.899 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_15_00_UTC 2023-11-15T02:36:15.900 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_16_00_UTC 2023-11-15T02:36:15.900 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_17_00_UTC 2023-11-15T02:36:15.900 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_18_00_UTC 2023-11-15T02:36:15.900 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_19_00_UTC 2023-11-15T02:36:15.900 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_20_00_UTC 2023-11-15T02:36:15.901 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_21_00_UTC 2023-11-15T02:36:15.901 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_22_00_UTC 2023-11-15T02:36:15.901 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_23_00_UTC 2023-11-15T02:36:15.901 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_24_00_UTC 2023-11-15T02:36:15.901 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_25_00_UTC 2023-11-15T02:36:15.902 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_26_00_UTC 2023-11-15T02:36:15.902 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_27_00_UTC 2023-11-15T02:36:15.902 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_28_00_UTC 2023-11-15T02:36:15.902 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_29_00_UTC 2023-11-15T02:36:15.902 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_30_00_UTC 2023-11-15T02:36:15.903 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_31_00_UTC 2023-11-15T02:36:15.903 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_32_00_UTC 2023-11-15T02:36:15.903 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_33_00_UTC 2023-11-15T02:36:15.903 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_34_00_UTC 2023-11-15T02:36:15.903 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_35_00_UTC 2023-11-15T02:36:15.904 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_36_00_UTC 2023-11-15T02:36:15.904 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-15-01_42_00_UTC', 'scheduled-2023-11-15-01_43_00_UTC', 'scheduled-2023-11-15-01_44_00_UTC', 'scheduled-2023-11-15-01_45_00_UTC', 'scheduled-2023-11-15-01_46_00_UTC', 'scheduled-2023-11-15-01_47_00_UTC', 'scheduled-2023-11-15-01_48_00_UTC', 'scheduled-2023-11-15-01_49_00_UTC', 'scheduled-2023-11-15-01_50_00_UTC', 'scheduled-2023-11-15-01_51_00_UTC', 'scheduled-2023-11-15-01_52_00_UTC', 'scheduled-2023-11-15-01_53_00_UTC', 'scheduled-2023-11-15-01_54_00_UTC', 'scheduled-2023-11-15-01_55_00_UTC', 'scheduled-2023-11-15-01_56_00_UTC', 'scheduled-2023-11-15-01_57_00_UTC', 'scheduled-2023-11-15-01_58_00_UTC', 'scheduled-2023-11-15-01_59_00_UTC', 'scheduled-2023-11-15-02_00_00_UTC', 'scheduled-2023-11-15-02_01_00_UTC', 'scheduled-2023-11-15-02_02_00_UTC', 'scheduled-2023-11-15-02_03_00_UTC', 'scheduled-2023-11-15-02_04_00_UTC', 'scheduled-2023-11-15-02_05_00_UTC', 'scheduled-2023-11-15-02_06_00_UTC', 'scheduled-2023-11-15-02_07_00_UTC', 'scheduled-2023-11-15-02_08_00_UTC', 'scheduled-2023-11-15-02_09_00_UTC', 'scheduled-2023-11-15-02_10_00_UTC', 'scheduled-2023-11-15-02_11_00_UTC', 'scheduled-2023-11-15-02_12_00_UTC', 'scheduled-2023-11-15-02_13_00_UTC', 'scheduled-2023-11-15-02_14_00_UTC', 'scheduled-2023-11-15-02_15_00_UTC', 'scheduled-2023-11-15-02_16_00_UTC', 'scheduled-2023-11-15-02_17_00_UTC', 'scheduled-2023-11-15-02_18_00_UTC', 'scheduled-2023-11-15-02_19_00_UTC', 'scheduled-2023-11-15-02_20_00_UTC', 'scheduled-2023-11-15-02_21_00_UTC', 'scheduled-2023-11-15-02_22_00_UTC', 'scheduled-2023-11-15-02_23_00_UTC', 'scheduled-2023-11-15-02_24_00_UTC', 'scheduled-2023-11-15-02_25_00_UTC', 'scheduled-2023-11-15-02_26_00_UTC', 'scheduled-2023-11-15-02_27_00_UTC', 'scheduled-2023-11-15-02_28_00_UTC', 'scheduled-2023-11-15-02_29_00_UTC', 'scheduled-2023-11-15-02_30_00_UTC', 'scheduled-2023-11-15-02_31_00_UTC', 'scheduled-2023-11-15-02_32_00_UTC', 'scheduled-2023-11-15-02_33_00_UTC', 'scheduled-2023-11-15-02_34_00_UTC', 'scheduled-2023-11-15-02_35_00_UTC', 'scheduled-2023-11-15-02_36_00_UTC'] 2023-11-15T02:36:15.904 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1 2023-11-15T02:36:16.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.067+0000 7fc4b4519700 1 Processor -- start 2023-11-15T02:36:16.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.067+0000 7fc4b4519700 1 -- start start 2023-11-15T02:36:16.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.068+0000 7fc4b4519700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc4ac13a320 0x7fc4ac13a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:16.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.068+0000 7fc4b4519700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ac06a610 con 0x7fc4ac062970 2023-11-15T02:36:16.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.068+0000 7fc4b4519700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ac065790 con 0x7fc4ac062d50 2023-11-15T02:36:16.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.068+0000 7fc4b4519700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ac0c2ae0 con 0x7fc4ac13a320 2023-11-15T02:36:16.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b22b5700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc4ac062970 0x7fc4ac0c23d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:40816/0 (socket says 172.21.15.1:40816) 2023-11-15T02:36:16.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b22b5700 1 -- 172.21.15.1:0/951453393 learned_addr learned my addr 172.21.15.1:0/951453393 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:16.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b2ab6700 1 --2- 172.21.15.1:0/951453393 >> v2:172.21.15.141:3300/0 conn(0x7fc4ac13a320 0x7fc4ac13a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:16.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b12b3700 1 -- 172.21.15.1:0/951453393 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21178174 0 0) 0x7fc4ac06a610 con 0x7fc4ac062970 2023-11-15T02:36:16.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b12b3700 1 -- 172.21.15.1:0/951453393 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4940033f0 con 0x7fc4ac062970 2023-11-15T02:36:16.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b12b3700 1 -- 172.21.15.1:0/951453393 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3101995683 0 0) 0x7fc4940033f0 con 0x7fc4ac062970 2023-11-15T02:36:16.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b12b3700 1 -- 172.21.15.1:0/951453393 >> v2:172.21.15.141:3300/0 conn(0x7fc4ac13a320 msgr2=0x7fc4ac13a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:16.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b12b3700 1 --2- 172.21.15.1:0/951453393 >> v2:172.21.15.141:3300/0 conn(0x7fc4ac13a320 0x7fc4ac13a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b12b3700 1 -- 172.21.15.1:0/951453393 >> v1:172.21.15.141:6789/0 conn(0x7fc4ac062d50 legacy=0x7fc4ac0c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:16.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b12b3700 1 -- 172.21.15.1:0/951453393 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac065a30 con 0x7fc4ac062970 2023-11-15T02:36:16.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b12b3700 1 -- 172.21.15.1:0/951453393 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fc4a4001470 con 0x7fc4ac062970 2023-11-15T02:36:16.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b12b3700 1 -- 172.21.15.1:0/951453393 >> v1:172.21.15.1:6789/0 conn(0x7fc4ac062970 legacy=0x7fc4ac0c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:16.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b12b3700 1 --2- 172.21.15.1:0/951453393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4940038e0 0x7fc494003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:16.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b12b3700 1 --2- 172.21.15.1:0/951453393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc494004690 0x7fc494004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:16.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b12b3700 1 --2- 172.21.15.1:0/951453393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc494005000 0x7fc49400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:16.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b12b3700 1 -- 172.21.15.1:0/951453393 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac0c2ae0 con 0x7fc4940038e0 2023-11-15T02:36:16.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b12b3700 1 -- 172.21.15.1:0/951453393 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49400beb0 con 0x7fc494005000 2023-11-15T02:36:16.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b12b3700 1 -- 172.21.15.1:0/951453393 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49400c070 con 0x7fc494004690 2023-11-15T02:36:16.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.069+0000 7fc4b22b5700 1 --2- 172.21.15.1:0/951453393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4940038e0 0x7fc494003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:16.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.070+0000 7fc4b1ab4700 1 --2- 172.21.15.1:0/951453393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc494004690 0x7fc494004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:16.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.070+0000 7fc4b2ab6700 1 --2- 172.21.15.1:0/951453393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc494005000 0x7fc49400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:16.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.070+0000 7fc4b22b5700 1 -- 172.21.15.1:0/951453393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc494004690 msgr2=0x7fc494004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:16.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.070+0000 7fc4b22b5700 1 --2- 172.21.15.1:0/951453393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc494004690 0x7fc494004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.070+0000 7fc4b22b5700 1 -- 172.21.15.1:0/951453393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc494005000 msgr2=0x7fc49400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:16.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.070+0000 7fc4b22b5700 1 --2- 172.21.15.1:0/951453393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc494005000 0x7fc49400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.070+0000 7fc4b2ab6700 1 -- 172.21.15.1:0/951453393 reap_dead start 2023-11-15T02:36:16.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.070+0000 7fc4b22b5700 1 -- 172.21.15.1:0/951453393 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4940033f0 con 0x7fc4940038e0 2023-11-15T02:36:16.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.070+0000 7fc4b22b5700 1 --2- 172.21.15.1:0/951453393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4940038e0 0x7fc494003d00 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fc4a400c160 tx=0x7fc4ac06a7a0).ready entity=mon.0 client_cookie=ef022d1633b711a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:16.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.070+0000 7fc4b12b3700 1 -- 172.21.15.1:0/951453393 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a400ca10 con 0x7fc4940038e0 2023-11-15T02:36:16.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.070+0000 7fc4b12b3700 1 -- 172.21.15.1:0/951453393 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a400cb70 con 0x7fc4940038e0 2023-11-15T02:36:16.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.070+0000 7fc4b12b3700 1 -- 172.21.15.1:0/951453393 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40070d0 con 0x7fc4940038e0 2023-11-15T02:36:16.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.071+0000 7fc4b4519700 1 -- 172.21.15.1:0/951453393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4940038e0 msgr2=0x7fc494003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:16.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.071+0000 7fc4b4519700 1 --2- 172.21.15.1:0/951453393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4940038e0 0x7fc494003d00 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fc4a400c160 tx=0x7fc4ac06a7a0).stop 2023-11-15T02:36:16.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.071+0000 7fc4b4519700 1 -- 172.21.15.1:0/951453393 shutdown_connections 2023-11-15T02:36:16.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.071+0000 7fc4b4519700 1 --2- 172.21.15.1:0/951453393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4940038e0 0x7fc494003d00 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.071+0000 7fc4b4519700 1 -- 172.21.15.1:0/951453393 >> 172.21.15.1:0/951453393 conn(0x7fc4ac0c7dd0 msgr2=0x7fc4ac0c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:16.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.071+0000 7fc4b4519700 1 -- 172.21.15.1:0/951453393 shutdown_connections 2023-11-15T02:36:16.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.071+0000 7fc4b4519700 1 -- 172.21.15.1:0/951453393 wait complete. 2023-11-15T02:36:16.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.072+0000 7fc4b4519700 1 Processor -- start 2023-11-15T02:36:16.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.072+0000 7fc4b4519700 1 -- start start 2023-11-15T02:36:16.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b4519700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4940038e0 0x7fc4ac13c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:16.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b4519700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4ac0c0450 0x7fc4ac153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:16.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b4519700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4ac1540e0 0x7fc4ac0c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:16.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b4519700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac13d4a0 con 0x7fc4940038e0 2023-11-15T02:36:16.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b4519700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac13c890 con 0x7fc4ac1540e0 2023-11-15T02:36:16.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b4519700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac13cb70 con 0x7fc4ac0c0450 2023-11-15T02:36:16.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b22b5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4940038e0 0x7fc4ac13c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:16.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b22b5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4940038e0 0x7fc4ac13c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35904/0 (socket says 172.21.15.1:35904) 2023-11-15T02:36:16.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b22b5700 1 -- 172.21.15.1:0/557624267 learned_addr learned my addr 172.21.15.1:0/557624267 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:16.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b1ab4700 1 --2- 172.21.15.1:0/557624267 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4ac0c0450 0x7fc4ac153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:16.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b2ab6700 1 --2- 172.21.15.1:0/557624267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4ac1540e0 0x7fc4ac0c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:16.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b22b5700 1 -- 172.21.15.1:0/557624267 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4ac0c0450 msgr2=0x7fc4ac153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:16.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b22b5700 1 --2- 172.21.15.1:0/557624267 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4ac0c0450 0x7fc4ac153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b22b5700 1 -- 172.21.15.1:0/557624267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4ac1540e0 msgr2=0x7fc4ac0c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:16.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b22b5700 1 --2- 172.21.15.1:0/557624267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4ac1540e0 0x7fc4ac0c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b22b5700 1 -- 172.21.15.1:0/557624267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac13ce50 con 0x7fc4940038e0 2023-11-15T02:36:16.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4b22b5700 1 --2- 172.21.15.1:0/557624267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4940038e0 0x7fc4ac13c060 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fc4a400c750 tx=0x7fc4a4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:16.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4aa7fc700 1 -- 172.21.15.1:0/557624267 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a400cce0 con 0x7fc4940038e0 2023-11-15T02:36:16.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4aa7fc700 1 -- 172.21.15.1:0/557624267 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a400ce40 con 0x7fc4940038e0 2023-11-15T02:36:16.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.073+0000 7fc4aa7fc700 1 -- 172.21.15.1:0/557624267 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40048c0 con 0x7fc4940038e0 2023-11-15T02:36:16.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.074+0000 7fc4b4519700 1 -- 172.21.15.1:0/557624267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ac13d130 con 0x7fc4940038e0 2023-11-15T02:36:16.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.074+0000 7fc4b4519700 1 -- 172.21.15.1:0/557624267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ac13c550 con 0x7fc4940038e0 2023-11-15T02:36:16.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.075+0000 7fc4b4519700 1 -- 172.21.15.1:0/557624267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ac06c7e0 con 0x7fc4940038e0 2023-11-15T02:36:16.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.075+0000 7fc4aa7fc700 1 -- 172.21.15.1:0/557624267 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 63) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fc4a401c020 con 0x7fc4940038e0 2023-11-15T02:36:16.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.075+0000 7fc4aa7fc700 1 --2- 172.21.15.1:0/557624267 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc49805f2c0 0x7fc498061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:16.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.075+0000 7fc4aa7fc700 1 -- 172.21.15.1:0/557624267 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6933+0+0 (secure 0 0 0) 0x7fc4a407ab20 con 0x7fc4940038e0 2023-11-15T02:36:16.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.076+0000 7fc4b1ab4700 1 --2- 172.21.15.1:0/557624267 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc49805f2c0 0x7fc498061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:16.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.076+0000 7fc4b1ab4700 1 --2- 172.21.15.1:0/557624267 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc49805f2c0 0x7fc498061780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fc4ac0c24d0 tx=0x7fc4a0009040).ready entity=mgr.6827 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:16.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.080+0000 7fc4aa7fc700 1 -- 172.21.15.1:0/557624267 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc4a404b940 con 0x7fc4940038e0 2023-11-15T02:36:16.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.279+0000 7fc4b4519700 1 -- 172.21.15.1:0/557624267 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4ac13d5e0 con 0x7fc49805f2c0 2023-11-15T02:36:16.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.281+0000 7fc4aa7fc700 1 -- 172.21.15.1:0/557624267 <== mgr.6827 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fc4a0003740 con 0x7fc49805f2c0 2023-11-15T02:36:16.282 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:16.282 INFO:teuthology.orchestra.run.smithi001.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:40:38", "first": "2023-11-15T01:41:00", "last": "2023-11-15T02:36:00", "last_pruned": "2023-11-15T02:36:01", "created_count": 56, "pruned_count": 1, "active": true}] 2023-11-15T02:36:16.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.283+0000 7fc4b4519700 1 -- 172.21.15.1:0/557624267 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc49805f2c0 msgr2=0x7fc498061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:16.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.283+0000 7fc4b4519700 1 --2- 172.21.15.1:0/557624267 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc49805f2c0 0x7fc498061780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fc4ac0c24d0 tx=0x7fc4a0009040).stop 2023-11-15T02:36:16.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.283+0000 7fc4b4519700 1 -- 172.21.15.1:0/557624267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4940038e0 msgr2=0x7fc4ac13c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:16.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.283+0000 7fc4b4519700 1 --2- 172.21.15.1:0/557624267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4940038e0 0x7fc4ac13c060 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fc4a400c750 tx=0x7fc4a4015000).stop 2023-11-15T02:36:16.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.283+0000 7fc4b4519700 1 -- 172.21.15.1:0/557624267 shutdown_connections 2023-11-15T02:36:16.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.283+0000 7fc4b4519700 1 --2- 172.21.15.1:0/557624267 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc49805f2c0 0x7fc498061780 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.283+0000 7fc4b4519700 1 --2- 172.21.15.1:0/557624267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4ac1540e0 0x7fc4ac0c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.283+0000 7fc4b4519700 1 --2- 172.21.15.1:0/557624267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4940038e0 0x7fc4ac13c060 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.283+0000 7fc4b4519700 1 --2- 172.21.15.1:0/557624267 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4ac0c0450 0x7fc4ac153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.283+0000 7fc4b4519700 1 -- 172.21.15.1:0/557624267 >> 172.21.15.1:0/557624267 conn(0x7fc4ac0c7dd0 msgr2=0x7fc4ac139030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.283+0000 7fc4b4519700 1 -- 172.21.15.1:0/557624267 shutdown_connections 2023-11-15T02:36:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.284+0000 7fc4b4519700 1 -- 172.21.15.1:0/557624267 wait complete. 2023-11-15T02:36:16.296 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T01:40:38", "first": "2023-11-15T01:41:00", "last": "2023-11-15T02:36:00", "last_pruned": "2023-11-15T02:36:01", "created_count": 56, "pruned_count": 1, "active": true}] 2023-11-15T02:36:16.296 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1', 'rel_path': '/snap_test_dir1', 'schedule': '1M', 'retention': {'n': 55}, 'start': '2023-11-15T00:00:00', 'created': '2023-11-15T01:40:38', 'first': '2023-11-15T01:41:00', 'last': '2023-11-15T02:36:00', 'last_pruned': '2023-11-15T02:36:01', 'created_count': 56, 'pruned_count': 1, 'active': True} 2023-11-15T02:36:16.296 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 55 2023-11-15T02:36:16.297 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 56 2023-11-15T02:36:16.297 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1 2023-11-15T02:36:16.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.418+0000 7fe0dbc93700 1 Processor -- start 2023-11-15T02:36:16.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.419+0000 7fe0dbc93700 1 -- start start 2023-11-15T02:36:16.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.419+0000 7fe0dbc93700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0d40aa750 0x7fe0d40c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:16.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.419+0000 7fe0dbc93700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe0d414b730 0x7fe0d4154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:16.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.419+0000 7fe0dbc93700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d41580d0 con 0x7fe0d414b350 2023-11-15T02:36:16.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.419+0000 7fe0dbc93700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d4155000 con 0x7fe0d414b730 2023-11-15T02:36:16.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.419+0000 7fe0dbc93700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d41552e0 con 0x7fe0d40aa750 2023-11-15T02:36:16.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.419+0000 7fe0da230700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe0d414b730 0x7fe0d4154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:16.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.420+0000 7fe0da230700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe0d414b730 0x7fe0d4154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35906/0 (socket says 172.21.15.1:35906) 2023-11-15T02:36:16.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.420+0000 7fe0d9a2f700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe0d414b350 0x7fe0d40aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:40818/0 (socket says 172.21.15.1:40818) 2023-11-15T02:36:16.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.420+0000 7fe0da230700 1 -- 172.21.15.1:0/2294615738 learned_addr learned my addr 172.21.15.1:0/2294615738 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:16.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.420+0000 7fe0d922e700 1 --2- 172.21.15.1:0/2294615738 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0d40aa750 0x7fe0d40c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:16.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.420+0000 7fe0da230700 1 -- 172.21.15.1:0/2294615738 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0d40aa750 msgr2=0x7fe0d40c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:16.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.420+0000 7fe0da230700 1 --2- 172.21.15.1:0/2294615738 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0d40aa750 0x7fe0d40c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.420+0000 7fe0da230700 1 -- 172.21.15.1:0/2294615738 >> v1:172.21.15.1:6789/0 conn(0x7fe0d414b350 legacy=0x7fe0d40aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:16.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.420+0000 7fe0da230700 1 -- 172.21.15.1:0/2294615738 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d41555c0 con 0x7fe0d414b730 2023-11-15T02:36:16.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.420+0000 7fe0d8a2d700 1 -- 172.21.15.1:0/2294615738 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756560847 0 0) 0x7fe0d41580d0 con 0x7fe0d414b350 2023-11-15T02:36:16.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.420+0000 7fe0da230700 1 --2- 172.21.15.1:0/2294615738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d414b730 0x7fe0d4154a10 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7fe0c4009f20 tx=0x7fe0c4009840).ready entity=mon.0 client_cookie=9b99147ecfbf54dc server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:16.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.420+0000 7fe0d8a2d700 1 -- 172.21.15.1:0/2294615738 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c400e070 con 0x7fe0d414b730 2023-11-15T02:36:16.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.420+0000 7fe0d8a2d700 1 -- 172.21.15.1:0/2294615738 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c400ba80 con 0x7fe0d414b730 2023-11-15T02:36:16.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.420+0000 7fe0d8a2d700 1 -- 172.21.15.1:0/2294615738 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c400be00 con 0x7fe0d414b730 2023-11-15T02:36:16.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.421+0000 7fe0dbc93700 1 -- 172.21.15.1:0/2294615738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d414b730 msgr2=0x7fe0d4154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:16.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.421+0000 7fe0dbc93700 1 --2- 172.21.15.1:0/2294615738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d414b730 0x7fe0d4154a10 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7fe0c4009f20 tx=0x7fe0c4009840).stop 2023-11-15T02:36:16.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.421+0000 7fe0dbc93700 1 -- 172.21.15.1:0/2294615738 shutdown_connections 2023-11-15T02:36:16.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.421+0000 7fe0dbc93700 1 --2- 172.21.15.1:0/2294615738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d414b730 0x7fe0d4154a10 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.421+0000 7fe0dbc93700 1 --2- 172.21.15.1:0/2294615738 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0d40aa750 0x7fe0d40c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.421+0000 7fe0dbc93700 1 -- 172.21.15.1:0/2294615738 >> 172.21.15.1:0/2294615738 conn(0x7fe0d4069ee0 msgr2=0x7fe0d406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:16.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.421+0000 7fe0dbc93700 1 -- 172.21.15.1:0/2294615738 shutdown_connections 2023-11-15T02:36:16.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.421+0000 7fe0dbc93700 1 -- 172.21.15.1:0/2294615738 wait complete. 2023-11-15T02:36:16.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.422+0000 7fe0dbc93700 1 Processor -- start 2023-11-15T02:36:16.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.422+0000 7fe0dbc93700 1 -- start start 2023-11-15T02:36:16.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.422+0000 7fe0dbc93700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0d40aa750 0x7fe0d4161d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:16.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.422+0000 7fe0dbc93700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d414b350 0x7fe0d4168770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:16.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0dbc93700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0d414b730 0x7fe0d41567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:16.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0dbc93700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d41657c0 con 0x7fe0d414b350 2023-11-15T02:36:16.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0dbc93700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4162230 con 0x7fe0d414b730 2023-11-15T02:36:16.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0dbc93700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4168c60 con 0x7fe0d40aa750 2023-11-15T02:36:16.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0d922e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d414b350 0x7fe0d4168770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:16.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0d922e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d414b350 0x7fe0d4168770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35912/0 (socket says 172.21.15.1:35912) 2023-11-15T02:36:16.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0d922e700 1 -- 172.21.15.1:0/3679982544 learned_addr learned my addr 172.21.15.1:0/3679982544 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:16.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0da230700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0d414b730 0x7fe0d41567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:16.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0d922e700 1 -- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0d40aa750 msgr2=0x7fe0d4161d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:16.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0d9a2f700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0d40aa750 0x7fe0d4161d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:16.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0d922e700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0d40aa750 0x7fe0d4161d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0d922e700 1 -- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0d414b730 msgr2=0x7fe0d41567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:16.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0d922e700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0d414b730 0x7fe0d41567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0d922e700 1 -- 172.21.15.1:0/3679982544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c4009ae0 con 0x7fe0d414b350 2023-11-15T02:36:16.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0da230700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0d414b730 0x7fe0d41567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:16.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0d9a2f700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0d40aa750 0x7fe0d4161d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:16.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0d922e700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d414b350 0x7fe0d4168770 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fe0c8006980 tx=0x7fe0c8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:16.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0d1ffb700 1 -- 172.21.15.1:0/3679982544 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8011590 con 0x7fe0d414b350 2023-11-15T02:36:16.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0d1ffb700 1 -- 172.21.15.1:0/3679982544 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c80116f0 con 0x7fe0d414b350 2023-11-15T02:36:16.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0dbc93700 1 -- 172.21.15.1:0/3679982544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d4164bb0 con 0x7fe0d414b350 2023-11-15T02:36:16.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.423+0000 7fe0d1ffb700 1 -- 172.21.15.1:0/3679982544 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8011a70 con 0x7fe0d414b350 2023-11-15T02:36:16.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.424+0000 7fe0dbc93700 1 -- 172.21.15.1:0/3679982544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d4165170 con 0x7fe0d414b350 2023-11-15T02:36:16.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.425+0000 7fe0dbc93700 1 -- 172.21.15.1:0/3679982544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d406c7e0 con 0x7fe0d414b350 2023-11-15T02:36:16.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.425+0000 7fe0d1ffb700 1 -- 172.21.15.1:0/3679982544 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 63) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fe0c8012420 con 0x7fe0d414b350 2023-11-15T02:36:16.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.425+0000 7fe0d1ffb700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe0c005f290 0x7fe0c0061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:16.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.425+0000 7fe0d1ffb700 1 -- 172.21.15.1:0/3679982544 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6933+0+0 (secure 0 0 0) 0x7fe0c807a1f0 con 0x7fe0d414b350 2023-11-15T02:36:16.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.425+0000 7fe0d9a2f700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe0c005f290 0x7fe0c0061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:16.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.426+0000 7fe0d9a2f700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe0c005f290 0x7fe0c0061750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe0cc001750 tx=0x7fe0cc009040).ready entity=mgr.6827 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:16.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.429+0000 7fe0d1ffb700 1 -- 172.21.15.1:0/3679982544 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe0c804afb0 con 0x7fe0d414b350 2023-11-15T02:36:16.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.628+0000 7fe0dbc93700 1 -- 172.21.15.1:0/3679982544 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0d40ad670 con 0x7fe0c005f290 2023-11-15T02:36:16.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.632+0000 7fe0d1ffb700 1 -- 172.21.15.1:0/3679982544 <== mgr.6827 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+42 (secure 0 0 0) 0x7fe0d40ad670 con 0x7fe0c005f290 2023-11-15T02:36:16.633 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path /snap_test_dir1 2023-11-15T02:36:16.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.634+0000 7fe0dbc93700 1 -- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe0c005f290 msgr2=0x7fe0c0061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:16.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.634+0000 7fe0dbc93700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe0c005f290 0x7fe0c0061750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe0cc001750 tx=0x7fe0cc009040).stop 2023-11-15T02:36:16.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.634+0000 7fe0dbc93700 1 -- 172.21.15.1:0/3679982544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d414b350 msgr2=0x7fe0d4168770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:16.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.634+0000 7fe0dbc93700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d414b350 0x7fe0d4168770 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fe0c8006980 tx=0x7fe0c8008040).stop 2023-11-15T02:36:16.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.634+0000 7fe0dbc93700 1 -- 172.21.15.1:0/3679982544 shutdown_connections 2023-11-15T02:36:16.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.634+0000 7fe0dbc93700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe0c005f290 0x7fe0c0061750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.634+0000 7fe0dbc93700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0d414b730 0x7fe0d41567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.634+0000 7fe0dbc93700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0d40aa750 0x7fe0d4161d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.634+0000 7fe0dbc93700 1 --2- 172.21.15.1:0/3679982544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0d414b350 0x7fe0d4168770 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:16.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.634+0000 7fe0dbc93700 1 -- 172.21.15.1:0/3679982544 >> 172.21.15.1:0/3679982544 conn(0x7fe0d4069ee0 msgr2=0x7fe0d4149960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:16.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.634+0000 7fe0dbc93700 1 -- 172.21.15.1:0/3679982544 shutdown_connections 2023-11-15T02:36:16.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:16.634+0000 7fe0dbc93700 1 -- 172.21.15.1:0/3679982544 wait complete. 2023-11-15T02:36:16.647 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1 2023-11-15T02:36:16.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:16.647 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:36:16.665 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_42_00_UTC 2023-11-15T02:36:16.665 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_43_00_UTC 2023-11-15T02:36:16.665 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_44_00_UTC 2023-11-15T02:36:16.666 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_45_00_UTC 2023-11-15T02:36:16.666 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_46_00_UTC 2023-11-15T02:36:16.666 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_47_00_UTC 2023-11-15T02:36:16.666 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_48_00_UTC 2023-11-15T02:36:16.666 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_49_00_UTC 2023-11-15T02:36:16.667 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_50_00_UTC 2023-11-15T02:36:16.667 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_51_00_UTC 2023-11-15T02:36:16.667 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_52_00_UTC 2023-11-15T02:36:16.667 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_53_00_UTC 2023-11-15T02:36:16.668 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_54_00_UTC 2023-11-15T02:36:16.668 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_55_00_UTC 2023-11-15T02:36:16.668 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_56_00_UTC 2023-11-15T02:36:16.668 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_57_00_UTC 2023-11-15T02:36:16.668 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_58_00_UTC 2023-11-15T02:36:16.668 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-01_59_00_UTC 2023-11-15T02:36:16.669 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_00_00_UTC 2023-11-15T02:36:16.669 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_01_00_UTC 2023-11-15T02:36:16.669 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_02_00_UTC 2023-11-15T02:36:16.669 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_03_00_UTC 2023-11-15T02:36:16.669 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_04_00_UTC 2023-11-15T02:36:16.670 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_05_00_UTC 2023-11-15T02:36:16.670 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_06_00_UTC 2023-11-15T02:36:16.670 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_07_00_UTC 2023-11-15T02:36:16.670 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_08_00_UTC 2023-11-15T02:36:16.671 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_09_00_UTC 2023-11-15T02:36:16.671 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_10_00_UTC 2023-11-15T02:36:16.671 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_11_00_UTC 2023-11-15T02:36:16.671 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_12_00_UTC 2023-11-15T02:36:16.671 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_13_00_UTC 2023-11-15T02:36:16.672 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_14_00_UTC 2023-11-15T02:36:16.672 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_15_00_UTC 2023-11-15T02:36:16.672 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_16_00_UTC 2023-11-15T02:36:16.672 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_17_00_UTC 2023-11-15T02:36:16.672 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_18_00_UTC 2023-11-15T02:36:16.672 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_19_00_UTC 2023-11-15T02:36:16.673 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_20_00_UTC 2023-11-15T02:36:16.673 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_21_00_UTC 2023-11-15T02:36:16.673 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_22_00_UTC 2023-11-15T02:36:16.673 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_23_00_UTC 2023-11-15T02:36:16.673 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_24_00_UTC 2023-11-15T02:36:16.674 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_25_00_UTC 2023-11-15T02:36:16.674 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_26_00_UTC 2023-11-15T02:36:16.674 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_27_00_UTC 2023-11-15T02:36:16.674 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_28_00_UTC 2023-11-15T02:36:16.674 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_29_00_UTC 2023-11-15T02:36:16.675 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_30_00_UTC 2023-11-15T02:36:16.675 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_31_00_UTC 2023-11-15T02:36:16.675 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_32_00_UTC 2023-11-15T02:36:16.675 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_33_00_UTC 2023-11-15T02:36:16.675 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_34_00_UTC 2023-11-15T02:36:16.676 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_35_00_UTC 2023-11-15T02:36:16.676 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_36_00_UTC 2023-11-15T02:36:16.676 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_42_00_UTC 2023-11-15T02:36:16.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:16.677 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_42_00_UTC) 2023-11-15T02:36:16.726 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_43_00_UTC 2023-11-15T02:36:16.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:16.727 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_43_00_UTC) 2023-11-15T02:36:16.786 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_44_00_UTC 2023-11-15T02:36:16.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:16.787 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_44_00_UTC) 2023-11-15T02:36:16.847 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_45_00_UTC 2023-11-15T02:36:16.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:16.848 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_45_00_UTC) 2023-11-15T02:36:16.908 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_46_00_UTC 2023-11-15T02:36:16.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:16.909 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_46_00_UTC) 2023-11-15T02:36:16.969 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_47_00_UTC 2023-11-15T02:36:16.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:16.970 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_47_00_UTC) 2023-11-15T02:36:17.029 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_48_00_UTC 2023-11-15T02:36:17.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.030 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_48_00_UTC) 2023-11-15T02:36:17.089 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_49_00_UTC 2023-11-15T02:36:17.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.090 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_49_00_UTC) 2023-11-15T02:36:17.150 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_50_00_UTC 2023-11-15T02:36:17.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.151 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_50_00_UTC) 2023-11-15T02:36:17.211 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_51_00_UTC 2023-11-15T02:36:17.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.212 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_51_00_UTC) 2023-11-15T02:36:17.271 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_52_00_UTC 2023-11-15T02:36:17.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.272 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_52_00_UTC) 2023-11-15T02:36:17.332 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_53_00_UTC 2023-11-15T02:36:17.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.333 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_53_00_UTC) 2023-11-15T02:36:17.392 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_54_00_UTC 2023-11-15T02:36:17.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.393 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_54_00_UTC) 2023-11-15T02:36:17.452 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_55_00_UTC 2023-11-15T02:36:17.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.453 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_55_00_UTC) 2023-11-15T02:36:17.513 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_56_00_UTC 2023-11-15T02:36:17.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.514 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_56_00_UTC) 2023-11-15T02:36:17.574 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_57_00_UTC 2023-11-15T02:36:17.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.575 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_57_00_UTC) 2023-11-15T02:36:17.634 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_58_00_UTC 2023-11-15T02:36:17.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.635 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_58_00_UTC) 2023-11-15T02:36:17.694 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-01_59_00_UTC 2023-11-15T02:36:17.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.695 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-01_59_00_UTC) 2023-11-15T02:36:17.755 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_00_00_UTC 2023-11-15T02:36:17.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.756 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_00_00_UTC) 2023-11-15T02:36:17.815 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_01_00_UTC 2023-11-15T02:36:17.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.816 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_01_00_UTC) 2023-11-15T02:36:17.876 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_02_00_UTC 2023-11-15T02:36:17.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.877 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_02_00_UTC) 2023-11-15T02:36:17.937 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_03_00_UTC 2023-11-15T02:36:17.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.939 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_03_00_UTC) 2023-11-15T02:36:17.998 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_04_00_UTC 2023-11-15T02:36:17.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:17.999 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_04_00_UTC) 2023-11-15T02:36:18.060 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_05_00_UTC 2023-11-15T02:36:18.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.062 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_05_00_UTC) 2023-11-15T02:36:18.121 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_06_00_UTC 2023-11-15T02:36:18.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.122 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_06_00_UTC) 2023-11-15T02:36:18.182 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_07_00_UTC 2023-11-15T02:36:18.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.184 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_07_00_UTC) 2023-11-15T02:36:18.243 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_08_00_UTC 2023-11-15T02:36:18.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.244 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_08_00_UTC) 2023-11-15T02:36:18.304 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_09_00_UTC 2023-11-15T02:36:18.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.305 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_09_00_UTC) 2023-11-15T02:36:18.365 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_10_00_UTC 2023-11-15T02:36:18.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.366 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_10_00_UTC) 2023-11-15T02:36:18.426 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_11_00_UTC 2023-11-15T02:36:18.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.427 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_11_00_UTC) 2023-11-15T02:36:18.486 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_12_00_UTC 2023-11-15T02:36:18.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.487 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_12_00_UTC) 2023-11-15T02:36:18.546 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_13_00_UTC 2023-11-15T02:36:18.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.547 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_13_00_UTC) 2023-11-15T02:36:18.607 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_14_00_UTC 2023-11-15T02:36:18.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.608 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_14_00_UTC) 2023-11-15T02:36:18.668 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_15_00_UTC 2023-11-15T02:36:18.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.668 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_15_00_UTC) 2023-11-15T02:36:18.728 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_16_00_UTC 2023-11-15T02:36:18.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.729 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_16_00_UTC) 2023-11-15T02:36:18.789 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_17_00_UTC 2023-11-15T02:36:18.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.790 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_17_00_UTC) 2023-11-15T02:36:18.849 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_18_00_UTC 2023-11-15T02:36:18.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.850 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_18_00_UTC) 2023-11-15T02:36:18.910 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_19_00_UTC 2023-11-15T02:36:18.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.912 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_19_00_UTC) 2023-11-15T02:36:18.970 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_20_00_UTC 2023-11-15T02:36:18.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:18.971 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_20_00_UTC) 2023-11-15T02:36:19.030 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_21_00_UTC 2023-11-15T02:36:19.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.031 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_21_00_UTC) 2023-11-15T02:36:19.090 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_22_00_UTC 2023-11-15T02:36:19.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.091 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_22_00_UTC) 2023-11-15T02:36:19.151 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_23_00_UTC 2023-11-15T02:36:19.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.152 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_23_00_UTC) 2023-11-15T02:36:19.211 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_24_00_UTC 2023-11-15T02:36:19.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.212 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_24_00_UTC) 2023-11-15T02:36:19.271 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_25_00_UTC 2023-11-15T02:36:19.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.272 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_25_00_UTC) 2023-11-15T02:36:19.331 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_26_00_UTC 2023-11-15T02:36:19.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.332 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_26_00_UTC) 2023-11-15T02:36:19.391 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_27_00_UTC 2023-11-15T02:36:19.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.392 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_27_00_UTC) 2023-11-15T02:36:19.451 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_28_00_UTC 2023-11-15T02:36:19.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.452 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_28_00_UTC) 2023-11-15T02:36:19.511 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_29_00_UTC 2023-11-15T02:36:19.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.512 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_29_00_UTC) 2023-11-15T02:36:19.571 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_30_00_UTC 2023-11-15T02:36:19.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.572 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_30_00_UTC) 2023-11-15T02:36:19.631 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_31_00_UTC 2023-11-15T02:36:19.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.632 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_31_00_UTC) 2023-11-15T02:36:19.691 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_32_00_UTC 2023-11-15T02:36:19.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.692 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_32_00_UTC) 2023-11-15T02:36:19.751 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_33_00_UTC 2023-11-15T02:36:19.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.752 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_33_00_UTC) 2023-11-15T02:36:19.811 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_34_00_UTC 2023-11-15T02:36:19.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.812 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_34_00_UTC) 2023-11-15T02:36:19.871 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_35_00_UTC 2023-11-15T02:36:19.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.872 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_35_00_UTC) 2023-11-15T02:36:19.931 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_36_00_UTC 2023-11-15T02:36:19.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.932 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_36_00_UTC) 2023-11-15T02:36:19.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:19.993 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-11-15T02:36:20.049 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-15T02:36:20.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.209+0000 7ff0ab59e700 1 Processor -- start 2023-11-15T02:36:20.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.209+0000 7ff0ab59e700 1 -- start start 2023-11-15T02:36:20.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.211+0000 7ff0ab59e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff0ac0c50b0 0x7ff0ac0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:20.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.211+0000 7ff0ab59e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ac06bb50 con 0x7ff0ac0bc410 2023-11-15T02:36:20.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.211+0000 7ff0ab59e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ac0627b0 con 0x7ff0ac0bd330 2023-11-15T02:36:20.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.211+0000 7ff0ab59e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ac0bd780 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.211+0000 7ff0aa59c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff0ac0c50b0 0x7ff0ac0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:20.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.211+0000 7ff0a9d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff0ac0bc410 0x7ff0ac0c1990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52576/0 (socket says 172.21.15.1:52576) 2023-11-15T02:36:20.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.211+0000 7ff0a9d9b700 1 -- 172.21.15.1:0/1072398460 learned_addr learned my addr 172.21.15.1:0/1072398460 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:20.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.211+0000 7ff0aa59c700 1 -- 172.21.15.1:0/1072398460 >> v1:172.21.15.141:6789/0 conn(0x7ff0ac0bd330 legacy=0x7ff0ac0637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:20.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.211+0000 7ff0aa59c700 1 -- 172.21.15.1:0/1072398460 >> v1:172.21.15.1:6789/0 conn(0x7ff0ac0bc410 legacy=0x7ff0ac0c1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:20.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.211+0000 7ff0aa59c700 1 -- 172.21.15.1:0/1072398460 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac062a00 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.211+0000 7ff0a959a700 1 -- 172.21.15.1:0/1072398460 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012736550 0 0) 0x7ff0ac06bb50 con 0x7ff0ac0bc410 2023-11-15T02:36:20.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.211+0000 7ff0aa59c700 1 --2- 172.21.15.1:0/1072398460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0ac0c50b0 0x7ff0ac0c5490 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7ff09c009760 tx=0x7ff09c009060).ready entity=mon.0 client_cookie=1b54f3eadf60209e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:20.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.212+0000 7ff0a959a700 1 -- 172.21.15.1:0/1072398460 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c00b580 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.212+0000 7ff0a959a700 1 -- 172.21.15.1:0/1072398460 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09c00b6e0 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.212+0000 7ff0a959a700 1 -- 172.21.15.1:0/1072398460 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c00ba60 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.212+0000 7ff0ab59e700 1 -- 172.21.15.1:0/1072398460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0ac0c50b0 msgr2=0x7ff0ac0c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:20.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.212+0000 7ff0ab59e700 1 --2- 172.21.15.1:0/1072398460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0ac0c50b0 0x7ff0ac0c5490 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7ff09c009760 tx=0x7ff09c009060).stop 2023-11-15T02:36:20.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.212+0000 7ff0ab59e700 1 -- 172.21.15.1:0/1072398460 shutdown_connections 2023-11-15T02:36:20.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.212+0000 7ff0ab59e700 1 --2- 172.21.15.1:0/1072398460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0ac0c50b0 0x7ff0ac0c5490 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:20.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.212+0000 7ff0ab59e700 1 -- 172.21.15.1:0/1072398460 >> 172.21.15.1:0/1072398460 conn(0x7ff0ac0c3e30 msgr2=0x7ff0ac0c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:20.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.212+0000 7ff0ab59e700 1 -- 172.21.15.1:0/1072398460 shutdown_connections 2023-11-15T02:36:20.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.212+0000 7ff0ab59e700 1 -- 172.21.15.1:0/1072398460 wait complete. 2023-11-15T02:36:20.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.213+0000 7ff0ab59e700 1 Processor -- start 2023-11-15T02:36:20.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.213+0000 7ff0ab59e700 1 -- start start 2023-11-15T02:36:20.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.214+0000 7ff0ab59e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0ac0bc410 0x7ff0ac1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:20.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.214+0000 7ff0ab59e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0ac0bd330 0x7ff0ac1650d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:20.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.214+0000 7ff0ab59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0ac0c50b0 0x7ff0ac0a8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:20.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.214+0000 7ff0ab59e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac0a7da0 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.214+0000 7ff0ab59e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac158820 con 0x7ff0ac0bc410 2023-11-15T02:36:20.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.214+0000 7ff0ab59e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac1655c0 con 0x7ff0ac0bd330 2023-11-15T02:36:20.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.214+0000 7ff0aad9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0ac0c50b0 0x7ff0ac0a8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:20.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.214+0000 7ff0aad9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0ac0c50b0 0x7ff0ac0a8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52782/0 (socket says 172.21.15.1:52782) 2023-11-15T02:36:20.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.214+0000 7ff0aad9d700 1 -- 172.21.15.1:0/2815958680 learned_addr learned my addr 172.21.15.1:0/2815958680 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:20.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.215+0000 7ff0aa59c700 1 --2- 172.21.15.1:0/2815958680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0ac0bc410 0x7ff0ac1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:20.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.215+0000 7ff0a9d9b700 1 --2- 172.21.15.1:0/2815958680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0ac0bd330 0x7ff0ac1650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:20.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.215+0000 7ff0aad9d700 1 -- 172.21.15.1:0/2815958680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0ac0bd330 msgr2=0x7ff0ac1650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:20.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.215+0000 7ff0aad9d700 1 --2- 172.21.15.1:0/2815958680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0ac0bd330 0x7ff0ac1650d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:20.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.215+0000 7ff0aad9d700 1 -- 172.21.15.1:0/2815958680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0ac0bc410 msgr2=0x7ff0ac1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:20.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.215+0000 7ff0aad9d700 1 --2- 172.21.15.1:0/2815958680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0ac0bc410 0x7ff0ac1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:20.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.215+0000 7ff0aad9d700 1 -- 172.21.15.1:0/2815958680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c0092a0 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.215+0000 7ff0aa59c700 1 --2- 172.21.15.1:0/2815958680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0ac0bc410 0x7ff0ac1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:20.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.215+0000 7ff0aad9d700 1 --2- 172.21.15.1:0/2815958680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0ac0c50b0 0x7ff0ac0a8230 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7ff0a400c790 tx=0x7ff0a40015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:20.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.215+0000 7ff09a7fc700 1 -- 172.21.15.1:0/2815958680 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4010510 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.215+0000 7ff09a7fc700 1 -- 172.21.15.1:0/2815958680 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a4010670 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.215+0000 7ff0ab59e700 1 -- 172.21.15.1:0/2815958680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ac0a7190 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.215+0000 7ff09a7fc700 1 -- 172.21.15.1:0/2815958680 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40109f0 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.215+0000 7ff0ab59e700 1 -- 172.21.15.1:0/2815958680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ac0a7750 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.216+0000 7ff0ab59e700 1 -- 172.21.15.1:0/2815958680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ac0a7f10 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.216+0000 7ff09a7fc700 1 -- 172.21.15.1:0/2815958680 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 63) v1 ==== 75577+0+0 (secure 0 0 0) 0x7ff0a401b400 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.217+0000 7ff09a7fc700 1 --2- 172.21.15.1:0/2815958680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff08c05f2c0 0x7ff08c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:20.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.217+0000 7ff09a7fc700 1 -- 172.21.15.1:0/2815958680 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6933+0+0 (secure 0 0 0) 0x7ff0a407a5a0 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.217+0000 7ff0aa59c700 1 --2- 172.21.15.1:0/2815958680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff08c05f2c0 0x7ff08c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:20.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.217+0000 7ff0aa59c700 1 --2- 172.21.15.1:0/2815958680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff08c05f2c0 0x7ff08c061780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff09c00b340 tx=0x7ff09c017000).ready entity=mgr.6827 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:20.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.221+0000 7ff09a7fc700 1 -- 172.21.15.1:0/2815958680 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff0a404b360 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.443+0000 7ff0ab59e700 1 -- 172.21.15.1:0/2815958680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7ff0ac0475e0 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.607+0000 7ff09a7fc700 1 -- 172.21.15.1:0/2815958680 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7ff0a4077ec0 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.608+0000 7ff09a7fc700 1 -- 172.21.15.1:0/2815958680 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v64) v1 ==== 93+0+0 (secure 0 0 0) 0x7ff0a40727e0 con 0x7ff0ac0c50b0 2023-11-15T02:36:20.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.611+0000 7ff0ab59e700 1 -- 172.21.15.1:0/2815958680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff08c05f2c0 msgr2=0x7ff08c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:20.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.611+0000 7ff0ab59e700 1 --2- 172.21.15.1:0/2815958680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff08c05f2c0 0x7ff08c061780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff09c00b340 tx=0x7ff09c017000).stop 2023-11-15T02:36:20.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.611+0000 7ff0ab59e700 1 -- 172.21.15.1:0/2815958680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0ac0c50b0 msgr2=0x7ff0ac0a8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:20.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.611+0000 7ff0ab59e700 1 --2- 172.21.15.1:0/2815958680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0ac0c50b0 0x7ff0ac0a8230 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7ff0a400c790 tx=0x7ff0a40015e0).stop 2023-11-15T02:36:20.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.612+0000 7ff0ab59e700 1 -- 172.21.15.1:0/2815958680 shutdown_connections 2023-11-15T02:36:20.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.612+0000 7ff0ab59e700 1 --2- 172.21.15.1:0/2815958680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff08c05f2c0 0x7ff08c061780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:20.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.612+0000 7ff0ab59e700 1 --2- 172.21.15.1:0/2815958680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0ac0c50b0 0x7ff0ac0a8230 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:20.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.612+0000 7ff0ab59e700 1 --2- 172.21.15.1:0/2815958680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0ac0bc410 0x7ff0ac1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:20.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.612+0000 7ff0ab59e700 1 --2- 172.21.15.1:0/2815958680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0ac0bd330 0x7ff0ac1650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:20.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.612+0000 7ff0ab59e700 1 -- 172.21.15.1:0/2815958680 >> 172.21.15.1:0/2815958680 conn(0x7ff0ac0c3e30 msgr2=0x7ff0ac152ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:20.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.612+0000 7ff0ab59e700 1 -- 172.21.15.1:0/2815958680 shutdown_connections 2023-11-15T02:36:20.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:20.612+0000 7ff0ab59e700 1 -- 172.21.15.1:0/2815958680 wait complete. 2023-11-15T02:36:20.632 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T02:36:20.632 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:36:20.697 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:36:20.769 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T02:36:20.770 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-15T02:36:20.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:20.770 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-15T02:36:20.859 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:20.858+0000 7f934234b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:36:20.867 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:20.867+0000 7f9affaaf680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:36:20.954 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T02:36:20.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:36:20.956 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-15T02:36:20.982 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:20.980+0000 7f934234b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:36:21.013 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:21.012+0000 7f9affaaf680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:36:21.025 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:36:21.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.216+0000 7f3944dbe700 1 Processor -- start 2023-11-15T02:36:21.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.216+0000 7f3944dbe700 1 -- start start 2023-11-15T02:36:21.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.217+0000 7f3944dbe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f39400c2a70 0x7f39401518f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.217+0000 7f3944dbe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3940065d60 0x7f39400c1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.217+0000 7f3944dbe700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39400bce80 con 0x7f39400c2e50 2023-11-15T02:36:21.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.217+0000 7f3944dbe700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39400695a0 con 0x7f3940065d60 2023-11-15T02:36:21.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.217+0000 7f3944dbe700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3940069710 con 0x7f39400c2a70 2023-11-15T02:36:21.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.217+0000 7f393ed9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3940065d60 0x7f39400c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:21.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.217+0000 7f393dd9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f39400c2e50 0x7f3940065650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52592/0 (socket says 172.21.15.1:52592) 2023-11-15T02:36:21.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.217+0000 7f393dd9b700 1 -- 172.21.15.1:0/1786096277 learned_addr learned my addr 172.21.15.1:0/1786096277 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:21.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.217+0000 7f393e59c700 1 --2- 172.21.15.1:0/1786096277 >> v2:172.21.15.141:3300/0 conn(0x7f39400c2a70 0x7f39401518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:21.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.217+0000 7f393ed9d700 1 -- 172.21.15.1:0/1786096277 >> v2:172.21.15.141:3300/0 conn(0x7f39400c2a70 msgr2=0x7f39401518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:21.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.217+0000 7f393ed9d700 1 --2- 172.21.15.1:0/1786096277 >> v2:172.21.15.141:3300/0 conn(0x7f39400c2a70 0x7f39401518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.217+0000 7f393ed9d700 1 -- 172.21.15.1:0/1786096277 >> v1:172.21.15.1:6789/0 conn(0x7f39400c2e50 legacy=0x7f3940065650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:21.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.217+0000 7f393d59a700 1 -- 172.21.15.1:0/1786096277 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036564135 0 0) 0x7f39400bce80 con 0x7f39400c2e50 2023-11-15T02:36:21.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.217+0000 7f393ed9d700 1 -- 172.21.15.1:0/1786096277 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3940151e80 con 0x7f3940065d60 2023-11-15T02:36:21.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.217+0000 7f393ed9d700 1 --2- 172.21.15.1:0/1786096277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3940065d60 0x7f39400c1260 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f39400c7cd0 tx=0x7f3938009780).ready entity=mon.0 client_cookie=3c55f886ef07ad36 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:21.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.218+0000 7f393d59a700 1 -- 172.21.15.1:0/1786096277 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393800e070 con 0x7f3940065d60 2023-11-15T02:36:21.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.218+0000 7f393d59a700 1 -- 172.21.15.1:0/1786096277 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393800bb60 con 0x7f3940065d60 2023-11-15T02:36:21.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.218+0000 7f393d59a700 1 -- 172.21.15.1:0/1786096277 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938012410 con 0x7f3940065d60 2023-11-15T02:36:21.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.218+0000 7f3944dbe700 1 -- 172.21.15.1:0/1786096277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3940065d60 msgr2=0x7f39400c1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:21.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.218+0000 7f3944dbe700 1 --2- 172.21.15.1:0/1786096277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3940065d60 0x7f39400c1260 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f39400c7cd0 tx=0x7f3938009780).stop 2023-11-15T02:36:21.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.218+0000 7f3944dbe700 1 -- 172.21.15.1:0/1786096277 shutdown_connections 2023-11-15T02:36:21.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.218+0000 7f3944dbe700 1 --2- 172.21.15.1:0/1786096277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3940065d60 0x7f39400c1260 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.218+0000 7f3944dbe700 1 --2- 172.21.15.1:0/1786096277 >> v2:172.21.15.141:3300/0 conn(0x7f39400c2a70 0x7f39401518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.218+0000 7f3944dbe700 1 -- 172.21.15.1:0/1786096277 >> 172.21.15.1:0/1786096277 conn(0x7f39400627b0 msgr2=0x7f3940062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:21.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.218+0000 7f3944dbe700 1 -- 172.21.15.1:0/1786096277 shutdown_connections 2023-11-15T02:36:21.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.218+0000 7f3944dbe700 1 -- 172.21.15.1:0/1786096277 wait complete. 2023-11-15T02:36:21.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.220+0000 7f3944dbe700 1 Processor -- start 2023-11-15T02:36:21.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.220+0000 7f3944dbe700 1 -- start start 2023-11-15T02:36:21.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f3944dbe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3940065d60 0x7f3940136ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f3944dbe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39400c2a70 0x7f39400a9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f3944dbe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39400c2e50 0x7f39400c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f3944dbe700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39400a8600 con 0x7f39400c2a70 2023-11-15T02:36:21.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f3944dbe700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39400a79f0 con 0x7f3940065d60 2023-11-15T02:36:21.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f3944dbe700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39400a7cd0 con 0x7f39400c2e50 2023-11-15T02:36:21.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f393dd9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39400c2a70 0x7f39400a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:21.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f393dd9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39400c2a70 0x7f39400a9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52828/0 (socket says 172.21.15.1:52828) 2023-11-15T02:36:21.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f393dd9b700 1 -- 172.21.15.1:0/2787178426 learned_addr learned my addr 172.21.15.1:0/2787178426 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:21.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f393e59c700 1 --2- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3940065d60 0x7f3940136ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:21.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f393ed9d700 1 --2- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39400c2e50 0x7f39400c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:21.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f393dd9b700 1 -- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39400c2e50 msgr2=0x7f39400c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:21.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f393dd9b700 1 --2- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39400c2e50 0x7f39400c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f393dd9b700 1 -- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3940065d60 msgr2=0x7f3940136ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:21.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f393dd9b700 1 --2- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3940065d60 0x7f3940136ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f393dd9b700 1 -- 172.21.15.1:0/2787178426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3938009a20 con 0x7f39400c2a70 2023-11-15T02:36:21.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f393dd9b700 1 --2- 172.21.15.1:0/2787178426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39400c2a70 0x7f39400a9010 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f3934001eb0 tx=0x7f3934007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:21.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f392e7fc700 1 -- 172.21.15.1:0/2787178426 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340070d0 con 0x7f39400c2a70 2023-11-15T02:36:21.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.221+0000 7f392e7fc700 1 -- 172.21.15.1:0/2787178426 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3934007230 con 0x7f39400c2a70 2023-11-15T02:36:21.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.222+0000 7f3944dbe700 1 -- 172.21.15.1:0/2787178426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39400a7fb0 con 0x7f39400c2a70 2023-11-15T02:36:21.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.222+0000 7f392e7fc700 1 -- 172.21.15.1:0/2787178426 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340075d0 con 0x7f39400c2a70 2023-11-15T02:36:21.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.222+0000 7f3944dbe700 1 -- 172.21.15.1:0/2787178426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3940137b10 con 0x7f39400c2a70 2023-11-15T02:36:21.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.223+0000 7f3944dbe700 1 -- 172.21.15.1:0/2787178426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39400a8740 con 0x7f39400c2a70 2023-11-15T02:36:21.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.223+0000 7f392e7fc700 1 -- 172.21.15.1:0/2787178426 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f3934005bc0 con 0x7f39400c2a70 2023-11-15T02:36:21.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.223+0000 7f392e7fc700 1 --2- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f392005f240 0x7f3920061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.223+0000 7f392e7fc700 1 -- 172.21.15.1:0/2787178426 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f393407a010 con 0x7f39400c2a70 2023-11-15T02:36:21.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.223+0000 7f393e59c700 1 -- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f392005f240 msgr2=0x7f3920061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:21.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.223+0000 7f393e59c700 1 --2- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f392005f240 0x7f3920061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:21.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.232+0000 7f392e7fc700 1 -- 172.21.15.1:0/2787178426 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f39400a8740 con 0x7f39400c2a70 2023-11-15T02:36:21.308 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:21.307+0000 7f934234b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:36:21.373 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:21.372+0000 7f9affaaf680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:36:21.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.424+0000 7f393e59c700 1 -- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f392005f240 msgr2=0x7f3920061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:21.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.424+0000 7f393e59c700 1 --2- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f392005f240 0x7f3920061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:36:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.449+0000 7f3944dbe700 1 -- 172.21.15.1:0/2787178426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39400a8740 con 0x7f39400c2a70 2023-11-15T02:36:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.450+0000 7f392e7fc700 1 -- 172.21.15.1:0/2787178426 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f39400a8740 con 0x7f39400c2a70 2023-11-15T02:36:21.451 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:21.451 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/2941509435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":2941509435},{"type":"v1","addr":"172.21.15.141:6837","nonce":2941509435}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/698727670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":698727670},{"type":"v1","addr":"172.21.15.141:6836","nonce":698727670}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2035210342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2035210342},{"type":"v1","addr":"172.21.15.1:6834","nonce":2035210342}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:40:20.613231+0000","modified":"2023-11-15T01:40:23.624230+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/2320712503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":2320712503},{"type":"v1","addr":"172.21.15.1:6835","nonce":2320712503}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-11-15T02:36:21.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.452+0000 7f3944dbe700 1 -- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f392005f240 msgr2=0x7f3920061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:21.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.452+0000 7f3944dbe700 1 --2- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f392005f240 0x7f3920061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.452+0000 7f3944dbe700 1 -- 172.21.15.1:0/2787178426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39400c2a70 msgr2=0x7f39400a9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.452+0000 7f3944dbe700 1 --2- 172.21.15.1:0/2787178426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39400c2a70 0x7f39400a9010 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f3934001eb0 tx=0x7f3934007e90).stop 2023-11-15T02:36:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.452+0000 7f3944dbe700 1 -- 172.21.15.1:0/2787178426 shutdown_connections 2023-11-15T02:36:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.452+0000 7f3944dbe700 1 --2- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f392005f240 0x7f3920061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.452+0000 7f3944dbe700 1 --2- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39400c2e50 0x7f39400c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.452+0000 7f3944dbe700 1 --2- 172.21.15.1:0/2787178426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3940065d60 0x7f3940136ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.452+0000 7f3944dbe700 1 --2- 172.21.15.1:0/2787178426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39400c2a70 0x7f39400a9010 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.452+0000 7f3944dbe700 1 -- 172.21.15.1:0/2787178426 >> 172.21.15.1:0/2787178426 conn(0x7f39400627b0 msgr2=0x7f39400c4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.452+0000 7f3944dbe700 1 -- 172.21.15.1:0/2787178426 shutdown_connections 2023-11-15T02:36:21.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.452+0000 7f3944dbe700 1 -- 172.21.15.1:0/2787178426 wait complete. 2023-11-15T02:36:21.456 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 63 2023-11-15T02:36:21.466 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:36:21.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.586+0000 7f4acb903700 1 Processor -- start 2023-11-15T02:36:21.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.586+0000 7f4acb903700 1 -- start start 2023-11-15T02:36:21.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.587+0000 7f4acb903700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4ac40aad50 0x7f4ac40627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.587+0000 7f4acb903700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac40acee0 con 0x7f4ac4155610 2023-11-15T02:36:21.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.587+0000 7f4acb903700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac4069820 con 0x7f4ac40ad370 2023-11-15T02:36:21.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.587+0000 7f4acb903700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac40ac890 con 0x7f4ac40aad50 2023-11-15T02:36:21.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.587+0000 7f4ac9ea0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4ac40aad50 0x7f4ac40627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:21.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.587+0000 7f4ac969f700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4ac4155610 0x7f4ac4068dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52602/0 (socket says 172.21.15.1:52602) 2023-11-15T02:36:21.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.587+0000 7f4ac969f700 1 -- 172.21.15.1:0/1991053855 learned_addr learned my addr 172.21.15.1:0/1991053855 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:21.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.587+0000 7f4ac9ea0700 1 -- 172.21.15.1:0/1991053855 >> v1:172.21.15.141:6789/0 conn(0x7f4ac40ad370 legacy=0x7f4ac40aa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:21.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.587+0000 7f4ac9ea0700 1 -- 172.21.15.1:0/1991053855 >> v1:172.21.15.1:6789/0 conn(0x7f4ac4155610 legacy=0x7f4ac4068dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:21.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.587+0000 7f4abbfff700 1 -- 172.21.15.1:0/1991053855 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364070602 0 0) 0x7f4ac40acee0 con 0x7f4ac4155610 2023-11-15T02:36:21.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.587+0000 7f4ac9ea0700 1 -- 172.21.15.1:0/1991053855 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac40acb70 con 0x7f4ac40aad50 2023-11-15T02:36:21.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.587+0000 7f4ac9ea0700 1 --2- 172.21.15.1:0/1991053855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ac40aad50 0x7f4ac40627b0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f4abc009e60 tx=0x7f4abc009780).ready entity=mon.0 client_cookie=5ac5f89a0b720e39 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:21.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.588+0000 7f4abbfff700 1 -- 172.21.15.1:0/1991053855 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc00e070 con 0x7f4ac40aad50 2023-11-15T02:36:21.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.588+0000 7f4abbfff700 1 -- 172.21.15.1:0/1991053855 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc00bc30 con 0x7f4ac40aad50 2023-11-15T02:36:21.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.588+0000 7f4abbfff700 1 -- 172.21.15.1:0/1991053855 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc012410 con 0x7f4ac40aad50 2023-11-15T02:36:21.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.588+0000 7f4acb903700 1 -- 172.21.15.1:0/1991053855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ac40aad50 msgr2=0x7f4ac40627b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:21.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.588+0000 7f4acb903700 1 --2- 172.21.15.1:0/1991053855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ac40aad50 0x7f4ac40627b0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f4abc009e60 tx=0x7f4abc009780).stop 2023-11-15T02:36:21.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.588+0000 7f4acb903700 1 -- 172.21.15.1:0/1991053855 shutdown_connections 2023-11-15T02:36:21.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.588+0000 7f4acb903700 1 --2- 172.21.15.1:0/1991053855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ac40aad50 0x7f4ac40627b0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.588+0000 7f4acb903700 1 -- 172.21.15.1:0/1991053855 >> 172.21.15.1:0/1991053855 conn(0x7f4ac40c74f0 msgr2=0x7f4ac40c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:21.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.588+0000 7f4acb903700 1 -- 172.21.15.1:0/1991053855 shutdown_connections 2023-11-15T02:36:21.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.588+0000 7f4acb903700 1 -- 172.21.15.1:0/1991053855 wait complete. 2023-11-15T02:36:21.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.589+0000 7f4acb903700 1 Processor -- start 2023-11-15T02:36:21.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.589+0000 7f4acb903700 1 -- start start 2023-11-15T02:36:21.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.590+0000 7f4acb903700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ac40aad50 0x7f4ac4165f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.590+0000 7f4acb903700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ac40ad370 0x7f4ac4146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.590+0000 7f4acb903700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ac4155610 0x7f4ac4161f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.590+0000 7f4acb903700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4165540 con 0x7f4ac40aad50 2023-11-15T02:36:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.590+0000 7f4acb903700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4165b00 con 0x7f4ac40ad370 2023-11-15T02:36:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.590+0000 7f4acb903700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac41629e0 con 0x7f4ac4155610 2023-11-15T02:36:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.590+0000 7f4ac969f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ac40aad50 0x7f4ac4165f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.591+0000 7f4ac969f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ac40aad50 0x7f4ac4165f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52858/0 (socket says 172.21.15.1:52858) 2023-11-15T02:36:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.591+0000 7f4ac969f700 1 -- 172.21.15.1:0/2225788337 learned_addr learned my addr 172.21.15.1:0/2225788337 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.591+0000 7f4ac9ea0700 1 --2- 172.21.15.1:0/2225788337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ac4155610 0x7f4ac4161f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.591+0000 7f4ac8e9e700 1 --2- 172.21.15.1:0/2225788337 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ac40ad370 0x7f4ac4146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.591+0000 7f4ac969f700 1 -- 172.21.15.1:0/2225788337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ac4155610 msgr2=0x7f4ac4161f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.591+0000 7f4ac969f700 1 --2- 172.21.15.1:0/2225788337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ac4155610 0x7f4ac4161f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.591+0000 7f4ac969f700 1 -- 172.21.15.1:0/2225788337 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ac40ad370 msgr2=0x7f4ac4146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.591+0000 7f4ac969f700 1 --2- 172.21.15.1:0/2225788337 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ac40ad370 0x7f4ac4146880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.591+0000 7f4ac969f700 1 -- 172.21.15.1:0/2225788337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc009a20 con 0x7f4ac40aad50 2023-11-15T02:36:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.591+0000 7f4ac969f700 1 --2- 172.21.15.1:0/2225788337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ac40aad50 0x7f4ac4165f90 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f4ac000c4c0 tx=0x7f4ac0007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.591+0000 7f4ab97fa700 1 -- 172.21.15.1:0/2225788337 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac00070d0 con 0x7f4ac40aad50 2023-11-15T02:36:21.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.591+0000 7f4ab97fa700 1 -- 172.21.15.1:0/2225788337 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac0007250 con 0x7f4ac40aad50 2023-11-15T02:36:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.591+0000 7f4acb903700 1 -- 172.21.15.1:0/2225788337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac4162cc0 con 0x7f4ac40aad50 2023-11-15T02:36:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.591+0000 7f4ab97fa700 1 -- 172.21.15.1:0/2225788337 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0007610 con 0x7f4ac40aad50 2023-11-15T02:36:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.591+0000 7f4acb903700 1 -- 172.21.15.1:0/2225788337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac4146d70 con 0x7f4ac40aad50 2023-11-15T02:36:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.592+0000 7f4acb903700 1 -- 172.21.15.1:0/2225788337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac4165de0 con 0x7f4ac40aad50 2023-11-15T02:36:21.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.593+0000 7f4ab97fa700 1 -- 172.21.15.1:0/2225788337 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f4ac00059b0 con 0x7f4ac40aad50 2023-11-15T02:36:21.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.593+0000 7f4ab97fa700 1 --2- 172.21.15.1:0/2225788337 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4aa805f240 0x7f4aa8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.593+0000 7f4ab97fa700 1 -- 172.21.15.1:0/2225788337 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f4ac0079d10 con 0x7f4ac40aad50 2023-11-15T02:36:21.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.593+0000 7f4ac8e9e700 1 -- 172.21.15.1:0/2225788337 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4aa805f240 msgr2=0x7f4aa8061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:21.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.593+0000 7f4ac8e9e700 1 --2- 172.21.15.1:0/2225788337 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4aa805f240 0x7f4aa8061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:21.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.597+0000 7f4ab97fa700 1 -- 172.21.15.1:0/2225788337 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4ac007f020 con 0x7f4ac40aad50 2023-11-15T02:36:21.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.776+0000 7f4acb903700 1 -- 172.21.15.1:0/2225788337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ac406c7e0 con 0x7f4ac40aad50 2023-11-15T02:36:21.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.777+0000 7f4ab97fa700 1 -- 172.21.15.1:0/2225788337 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+18218 (secure 0 0 0) 0x7f4ac004aa40 con 0x7f4ac40aad50 2023-11-15T02:36:21.778 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:21.779 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":148,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:36:21.602593+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:40:18.311095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-11-15T01:40:19.597093+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":148,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":2}]},{"pgid":"17.e","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/2372281288":"2023-11-16T01:40:37.112405+0000","172.21.15.141:6833/90546":"2023-11-16T01:40:37.112405+0000","172.21.15.141:0/2781353446":"2023-11-16T01:40:37.112405+0000","172.21.15.141:6832/90546":"2023-11-16T01:40:37.112405+0000","172.21.15.141:0/4271499177":"2023-11-16T01:40:37.112405+0000","172.21.15.141:0/320812430":"2023-11-16T01:40:37.112405+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:36:21.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.779+0000 7f4acb903700 1 -- 172.21.15.1:0/2225788337 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4aa805f240 msgr2=0x7f4aa8061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:21.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.779+0000 7f4acb903700 1 --2- 172.21.15.1:0/2225788337 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4aa805f240 0x7f4aa8061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:21.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.779+0000 7f4acb903700 1 -- 172.21.15.1:0/2225788337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ac40aad50 msgr2=0x7f4ac4165f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:21.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.779+0000 7f4acb903700 1 --2- 172.21.15.1:0/2225788337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ac40aad50 0x7f4ac4165f90 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f4ac000c4c0 tx=0x7f4ac0007e40).stop 2023-11-15T02:36:21.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.779+0000 7f4acb903700 1 -- 172.21.15.1:0/2225788337 shutdown_connections 2023-11-15T02:36:21.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.779+0000 7f4acb903700 1 --2- 172.21.15.1:0/2225788337 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4aa805f240 0x7f4aa8061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:21.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.779+0000 7f4acb903700 1 --2- 172.21.15.1:0/2225788337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ac4155610 0x7f4ac4161f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.779+0000 7f4acb903700 1 --2- 172.21.15.1:0/2225788337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ac40aad50 0x7f4ac4165f90 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.779+0000 7f4acb903700 1 --2- 172.21.15.1:0/2225788337 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ac40ad370 0x7f4ac4146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.779+0000 7f4acb903700 1 -- 172.21.15.1:0/2225788337 >> 172.21.15.1:0/2225788337 conn(0x7f4ac40c74f0 msgr2=0x7f4ac40c6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:21.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.779+0000 7f4acb903700 1 -- 172.21.15.1:0/2225788337 shutdown_connections 2023-11-15T02:36:21.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.779+0000 7f4acb903700 1 -- 172.21.15.1:0/2225788337 wait complete. 2023-11-15T02:36:21.792 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T01:40:18.311095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '140', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T01:40:19.597093+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 113, 'snap_epoch': 148, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T02:36:21.793 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T02:36:21.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.918+0000 7f5f4261a700 1 Processor -- start 2023-11-15T02:36:21.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.918+0000 7f5f4261a700 1 -- start start 2023-11-15T02:36:21.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.919+0000 7f5f4261a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5f3c154480 0x7f5f3c0c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.919+0000 7f5f4261a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f3c0c6430 0x7f5f3c0aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.919+0000 7f5f4261a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c0ca050 con 0x7f5f3c1540a0 2023-11-15T02:36:21.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.919+0000 7f5f4261a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c0c68c0 con 0x7f5f3c154480 2023-11-15T02:36:21.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.919+0000 7f5f4261a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0c9440 con 0x7f5f3c0c6430 2023-11-15T02:36:21.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.919+0000 7f5f3b7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5f3c154480 0x7f5f3c0c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:21.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.919+0000 7f5f3b7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5f3c154480 0x7f5f3c0c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52866/0 (socket says 172.21.15.1:52866) 2023-11-15T02:36:21.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.919+0000 7f5f3b7fe700 1 -- 172.21.15.1:0/1897312342 learned_addr learned my addr 172.21.15.1:0/1897312342 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:21.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.919+0000 7f5f40bb7700 1 --2- 172.21.15.1:0/1897312342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f3c0c6430 0x7f5f3c0aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:21.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.920+0000 7f5f3b7fe700 1 -- 172.21.15.1:0/1897312342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f3c0c6430 msgr2=0x7f5f3c0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:21.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.920+0000 7f5f3b7fe700 1 --2- 172.21.15.1:0/1897312342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f3c0c6430 0x7f5f3c0aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.920+0000 7f5f3b7fe700 1 -- 172.21.15.1:0/1897312342 >> v1:172.21.15.141:6789/0 conn(0x7f5f3c1540a0 legacy=0x7f5f3c0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:21.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.920+0000 7f5f3b7fe700 1 -- 172.21.15.1:0/1897312342 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c0c9720 con 0x7f5f3c154480 2023-11-15T02:36:21.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.920+0000 7f5f3b7fe700 1 --2- 172.21.15.1:0/1897312342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f3c154480 0x7f5f3c0c5f40 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f5f2c006fd0 tx=0x7f5f2c0090f0).ready entity=mon.0 client_cookie=269f089a0b5ff56e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:21.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.920+0000 7f5f3affd700 1 -- 172.21.15.1:0/1897312342 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c00b580 con 0x7f5f3c154480 2023-11-15T02:36:21.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.920+0000 7f5f3affd700 1 -- 172.21.15.1:0/1897312342 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c00b6e0 con 0x7f5f3c154480 2023-11-15T02:36:21.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.920+0000 7f5f3affd700 1 -- 172.21.15.1:0/1897312342 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c00ba60 con 0x7f5f3c154480 2023-11-15T02:36:21.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.921+0000 7f5f4261a700 1 -- 172.21.15.1:0/1897312342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f3c154480 msgr2=0x7f5f3c0c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:21.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.921+0000 7f5f4261a700 1 --2- 172.21.15.1:0/1897312342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f3c154480 0x7f5f3c0c5f40 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f5f2c006fd0 tx=0x7f5f2c0090f0).stop 2023-11-15T02:36:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.921+0000 7f5f4261a700 1 -- 172.21.15.1:0/1897312342 shutdown_connections 2023-11-15T02:36:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.921+0000 7f5f4261a700 1 --2- 172.21.15.1:0/1897312342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f3c0c6430 0x7f5f3c0aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.921+0000 7f5f4261a700 1 --2- 172.21.15.1:0/1897312342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f3c154480 0x7f5f3c0c5f40 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.921+0000 7f5f4261a700 1 -- 172.21.15.1:0/1897312342 >> 172.21.15.1:0/1897312342 conn(0x7f5f3c064a70 msgr2=0x7f5f3c064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.921+0000 7f5f4261a700 1 -- 172.21.15.1:0/1897312342 shutdown_connections 2023-11-15T02:36:21.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.921+0000 7f5f4261a700 1 -- 172.21.15.1:0/1897312342 wait complete. 2023-11-15T02:36:21.927 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:21.925+0000 7f934234b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:36:21.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.922+0000 7f5f4261a700 1 Processor -- start 2023-11-15T02:36:21.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.922+0000 7f5f4261a700 1 -- start start 2023-11-15T02:36:21.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f4261a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f3c0c6430 0x7f5f3c164eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f4261a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f3c1540a0 0x7f5f3c1582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f4261a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f3c154480 0x7f5f3c0c1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f4261a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c167d90 con 0x7f5f3c154480 2023-11-15T02:36:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f4261a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c168070 con 0x7f5f3c0c6430 2023-11-15T02:36:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f4261a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c168350 con 0x7f5f3c1540a0 2023-11-15T02:36:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f40bb7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f3c154480 0x7f5f3c0c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f40bb7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f3c154480 0x7f5f3c0c1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52870/0 (socket says 172.21.15.1:52870) 2023-11-15T02:36:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f40bb7700 1 -- 172.21.15.1:0/316631960 learned_addr learned my addr 172.21.15.1:0/316631960 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f3bfff700 1 --2- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f3c0c6430 0x7f5f3c164eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f3b7fe700 1 --2- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f3c1540a0 0x7f5f3c1582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f40bb7700 1 -- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f3c1540a0 msgr2=0x7f5f3c1582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f40bb7700 1 --2- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f3c1540a0 0x7f5f3c1582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f40bb7700 1 -- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f3c0c6430 msgr2=0x7f5f3c164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f40bb7700 1 --2- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f3c0c6430 0x7f5f3c164eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f40bb7700 1 -- 172.21.15.1:0/316631960 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c009370 con 0x7f5f3c154480 2023-11-15T02:36:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.923+0000 7f5f40bb7700 1 --2- 172.21.15.1:0/316631960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f3c154480 0x7f5f3c0c1100 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f5f34009e90 tx=0x7f5f3400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.924+0000 7f5f33fff700 1 -- 172.21.15.1:0/316631960 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3400caa0 con 0x7f5f3c154480 2023-11-15T02:36:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.924+0000 7f5f33fff700 1 -- 172.21.15.1:0/316631960 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3400f040 con 0x7f5f3c154480 2023-11-15T02:36:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.924+0000 7f5f4261a700 1 -- 172.21.15.1:0/316631960 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c168630 con 0x7f5f3c154480 2023-11-15T02:36:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.924+0000 7f5f33fff700 1 -- 172.21.15.1:0/316631960 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3400ce10 con 0x7f5f3c154480 2023-11-15T02:36:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.924+0000 7f5f4261a700 1 -- 172.21.15.1:0/316631960 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c167a20 con 0x7f5f3c154480 2023-11-15T02:36:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.925+0000 7f5f4261a700 1 -- 172.21.15.1:0/316631960 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c1655f0 con 0x7f5f3c154480 2023-11-15T02:36:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.925+0000 7f5f33fff700 1 -- 172.21.15.1:0/316631960 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f5f34013610 con 0x7f5f3c154480 2023-11-15T02:36:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.926+0000 7f5f33fff700 1 --2- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f1c05f270 0x7f5f1c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.926+0000 7f5f3bfff700 1 -- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f1c05f270 msgr2=0x7f5f1c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.926+0000 7f5f33fff700 1 -- 172.21.15.1:0/316631960 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f5f3407af30 con 0x7f5f3c154480 2023-11-15T02:36:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.926+0000 7f5f3bfff700 1 --2- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f1c05f270 0x7f5f1c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:21.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:21.930+0000 7f5f33fff700 1 -- 172.21.15.1:0/316631960 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5f3404bd20 con 0x7f5f3c154480 2023-11-15T02:36:21.998 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:21.997+0000 7f934234b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:36:22.059 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:22.055+0000 7f9affaaf680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:36:22.126 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:22.126+0000 7f9affaaf680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:36:22.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.127+0000 7f5f3bfff700 1 -- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f1c05f270 msgr2=0x7f5f1c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:22.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.127+0000 7f5f3bfff700 1 --2- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f1c05f270 0x7f5f1c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:36:22.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.149+0000 7f5f4261a700 1 -- 172.21.15.1:0/316631960 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5f3c06c7e0 con 0x7f5f3c154480 2023-11-15T02:36:22.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.149+0000 7f5f33fff700 1 -- 172.21.15.1:0/316631960 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v148) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5f3404f340 con 0x7f5f3c154480 2023-11-15T02:36:22.151 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T02:36:22.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.151+0000 7f5f4261a700 1 -- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f1c05f270 msgr2=0x7f5f1c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:22.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.151+0000 7f5f4261a700 1 --2- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f1c05f270 0x7f5f1c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:22.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.151+0000 7f5f4261a700 1 -- 172.21.15.1:0/316631960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f3c154480 msgr2=0x7f5f3c0c1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:22.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.151+0000 7f5f4261a700 1 --2- 172.21.15.1:0/316631960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f3c154480 0x7f5f3c0c1100 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f5f34009e90 tx=0x7f5f3400b040).stop 2023-11-15T02:36:22.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.152+0000 7f5f4261a700 1 -- 172.21.15.1:0/316631960 shutdown_connections 2023-11-15T02:36:22.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.152+0000 7f5f4261a700 1 --2- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5f1c05f270 0x7f5f1c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:22.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.152+0000 7f5f4261a700 1 --2- 172.21.15.1:0/316631960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f3c154480 0x7f5f3c0c1100 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.152+0000 7f5f4261a700 1 --2- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f3c0c6430 0x7f5f3c164eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.152+0000 7f5f4261a700 1 --2- 172.21.15.1:0/316631960 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f3c1540a0 0x7f5f3c1582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.152+0000 7f5f4261a700 1 -- 172.21.15.1:0/316631960 >> 172.21.15.1:0/316631960 conn(0x7f5f3c064a70 msgr2=0x7f5f3c0aaf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:22.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.152+0000 7f5f4261a700 1 -- 172.21.15.1:0/316631960 shutdown_connections 2023-11-15T02:36:22.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.152+0000 7f5f4261a700 1 -- 172.21.15.1:0/316631960 wait complete. 2023-11-15T02:36:22.165 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T02:36:22.188 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:22.187+0000 7f934234b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:36:22.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.287+0000 7f36b47f4700 1 Processor -- start 2023-11-15T02:36:22.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.287+0000 7f36b47f4700 1 -- start start 2023-11-15T02:36:22.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.288+0000 7f36b47f4700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f36ac13bd70 0x7f36ac1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.288+0000 7f36b47f4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f36ac0a8ab0 0x7f36ac0c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.288+0000 7f36b47f4700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac0c7760 con 0x7f36ac13b990 2023-11-15T02:36:22.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.288+0000 7f36b47f4700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac067340 con 0x7f36ac0a8ab0 2023-11-15T02:36:22.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.288+0000 7f36b47f4700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac067060 con 0x7f36ac13bd70 2023-11-15T02:36:22.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.289+0000 7f36b2d91700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f36ac0a8ab0 0x7f36ac0c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:22.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.289+0000 7f36b2d91700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f36ac0a8ab0 0x7f36ac0c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52878/0 (socket says 172.21.15.1:52878) 2023-11-15T02:36:22.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.289+0000 7f36b2d91700 1 -- 172.21.15.1:0/3596651061 learned_addr learned my addr 172.21.15.1:0/3596651061 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:22.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.289+0000 7f36b1d8f700 1 --2- 172.21.15.1:0/3596651061 >> v2:172.21.15.141:3300/0 conn(0x7f36ac13bd70 0x7f36ac1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:22.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.289+0000 7f36b2d91700 1 -- 172.21.15.1:0/3596651061 >> v2:172.21.15.141:3300/0 conn(0x7f36ac13bd70 msgr2=0x7f36ac1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:22.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.289+0000 7f36b2d91700 1 --2- 172.21.15.1:0/3596651061 >> v2:172.21.15.141:3300/0 conn(0x7f36ac13bd70 0x7f36ac1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.289+0000 7f36b2d91700 1 -- 172.21.15.1:0/3596651061 >> v1:172.21.15.141:6789/0 conn(0x7f36ac13b990 legacy=0x7f36ac066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:22.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.289+0000 7f36b2d91700 1 -- 172.21.15.1:0/3596651061 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac0c7110 con 0x7f36ac0a8ab0 2023-11-15T02:36:22.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.289+0000 7f36b2d91700 1 --2- 172.21.15.1:0/3596651061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36ac0a8ab0 0x7f36ac0c3500 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f36ac06a250 tx=0x7f36a4009840).ready entity=mon.0 client_cookie=9477a1afa253ef10 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:22.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.289+0000 7f36b158e700 1 -- 172.21.15.1:0/3596651061 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a400e070 con 0x7f36ac0a8ab0 2023-11-15T02:36:22.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.289+0000 7f36b158e700 1 -- 172.21.15.1:0/3596651061 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a400ba50 con 0x7f36ac0a8ab0 2023-11-15T02:36:22.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.289+0000 7f36b158e700 1 -- 172.21.15.1:0/3596651061 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a400bdd0 con 0x7f36ac0a8ab0 2023-11-15T02:36:22.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.290+0000 7f36b47f4700 1 -- 172.21.15.1:0/3596651061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36ac0a8ab0 msgr2=0x7f36ac0c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:22.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.290+0000 7f36b47f4700 1 --2- 172.21.15.1:0/3596651061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36ac0a8ab0 0x7f36ac0c3500 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f36ac06a250 tx=0x7f36a4009840).stop 2023-11-15T02:36:22.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.290+0000 7f36b47f4700 1 -- 172.21.15.1:0/3596651061 shutdown_connections 2023-11-15T02:36:22.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.290+0000 7f36b47f4700 1 --2- 172.21.15.1:0/3596651061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36ac0a8ab0 0x7f36ac0c3500 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.290+0000 7f36b47f4700 1 --2- 172.21.15.1:0/3596651061 >> v2:172.21.15.141:3300/0 conn(0x7f36ac13bd70 0x7f36ac1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.290+0000 7f36b47f4700 1 -- 172.21.15.1:0/3596651061 >> 172.21.15.1:0/3596651061 conn(0x7f36ac063280 msgr2=0x7f36ac0c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:22.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.290+0000 7f36b47f4700 1 -- 172.21.15.1:0/3596651061 shutdown_connections 2023-11-15T02:36:22.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.290+0000 7f36b47f4700 1 -- 172.21.15.1:0/3596651061 wait complete. 2023-11-15T02:36:22.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.291+0000 7f36b47f4700 1 Processor -- start 2023-11-15T02:36:22.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.291+0000 7f36b47f4700 1 -- start start 2023-11-15T02:36:22.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b47f4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36ac0a8ab0 0x7f36ac138f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b47f4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36ac13b990 0x7f36ac0c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b47f4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36ac0c1e60 0x7f36ac154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b47f4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0c86d0 con 0x7f36ac13b990 2023-11-15T02:36:22.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b47f4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0c19d0 con 0x7f36ac0a8ab0 2023-11-15T02:36:22.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b47f4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0c83f0 con 0x7f36ac0c1e60 2023-11-15T02:36:22.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b1d8f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36ac13b990 0x7f36ac0c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:22.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b1d8f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36ac13b990 0x7f36ac0c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52886/0 (socket says 172.21.15.1:52886) 2023-11-15T02:36:22.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b1d8f700 1 -- 172.21.15.1:0/984308931 learned_addr learned my addr 172.21.15.1:0/984308931 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:22.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b2590700 1 --2- 172.21.15.1:0/984308931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36ac0a8ab0 0x7f36ac138f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:22.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b2d91700 1 --2- 172.21.15.1:0/984308931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36ac0c1e60 0x7f36ac154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:22.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b1d8f700 1 -- 172.21.15.1:0/984308931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36ac0c1e60 msgr2=0x7f36ac154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:22.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b1d8f700 1 --2- 172.21.15.1:0/984308931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36ac0c1e60 0x7f36ac154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b1d8f700 1 -- 172.21.15.1:0/984308931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36ac0a8ab0 msgr2=0x7f36ac138f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:22.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b1d8f700 1 --2- 172.21.15.1:0/984308931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36ac0a8ab0 0x7f36ac138f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b1d8f700 1 -- 172.21.15.1:0/984308931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a4009ae0 con 0x7f36ac13b990 2023-11-15T02:36:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.292+0000 7f36b1d8f700 1 --2- 172.21.15.1:0/984308931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36ac13b990 0x7f36ac0c7af0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f36a800d8c0 tx=0x7f36a8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.293+0000 7f36a27fc700 1 -- 172.21.15.1:0/984308931 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8011590 con 0x7f36ac13b990 2023-11-15T02:36:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.293+0000 7f36a27fc700 1 -- 172.21.15.1:0/984308931 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a80116f0 con 0x7f36ac13b990 2023-11-15T02:36:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.293+0000 7f36a27fc700 1 -- 172.21.15.1:0/984308931 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8011a70 con 0x7f36ac13b990 2023-11-15T02:36:22.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.293+0000 7f36b47f4700 1 -- 172.21.15.1:0/984308931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac0c1380 con 0x7f36ac13b990 2023-11-15T02:36:22.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.293+0000 7f36b47f4700 1 -- 172.21.15.1:0/984308931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac0c7fe0 con 0x7f36ac13b990 2023-11-15T02:36:22.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.294+0000 7f36b47f4700 1 -- 172.21.15.1:0/984308931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac0c1b60 con 0x7f36ac13b990 2023-11-15T02:36:22.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.294+0000 7f36a27fc700 1 -- 172.21.15.1:0/984308931 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f36a8012420 con 0x7f36ac13b990 2023-11-15T02:36:22.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.294+0000 7f36a27fc700 1 --2- 172.21.15.1:0/984308931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f369005f270 0x7f3690061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.295+0000 7f36b2590700 1 -- 172.21.15.1:0/984308931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f369005f270 msgr2=0x7f3690061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:22.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.295+0000 7f36a27fc700 1 -- 172.21.15.1:0/984308931 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f36a807a080 con 0x7f36ac13b990 2023-11-15T02:36:22.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.295+0000 7f36b2590700 1 --2- 172.21.15.1:0/984308931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f369005f270 0x7f3690061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:22.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.299+0000 7f36a27fc700 1 -- 172.21.15.1:0/984308931 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f36a804ae10 con 0x7f36ac13b990 2023-11-15T02:36:22.325 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:22.325+0000 7f9affaaf680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:36:22.473 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.472+0000 7f36b47f4700 1 -- 172.21.15.1:0/984308931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f36ac06c7e0 con 0x7f36ac13b990 2023-11-15T02:36:22.473 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.473+0000 7f36a27fc700 1 -- 172.21.15.1:0/984308931 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v148) v1 ==== 92+0+10 (secure 0 0 0) 0x7f36a804e430 con 0x7f36ac13b990 2023-11-15T02:36:22.474 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T02:36:22.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.475+0000 7f36b47f4700 1 -- 172.21.15.1:0/984308931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f369005f270 msgr2=0x7f3690061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:22.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.475+0000 7f36b47f4700 1 --2- 172.21.15.1:0/984308931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f369005f270 0x7f3690061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:22.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.475+0000 7f36b47f4700 1 -- 172.21.15.1:0/984308931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36ac13b990 msgr2=0x7f36ac0c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:22.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.475+0000 7f36b47f4700 1 --2- 172.21.15.1:0/984308931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36ac13b990 0x7f36ac0c7af0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f36a800d8c0 tx=0x7f36a8008040).stop 2023-11-15T02:36:22.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.475+0000 7f36b47f4700 1 -- 172.21.15.1:0/984308931 shutdown_connections 2023-11-15T02:36:22.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.475+0000 7f36b47f4700 1 --2- 172.21.15.1:0/984308931 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f369005f270 0x7f3690061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:22.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.475+0000 7f36b47f4700 1 --2- 172.21.15.1:0/984308931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f36ac0c1e60 0x7f36ac154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.475+0000 7f36b47f4700 1 --2- 172.21.15.1:0/984308931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f36ac0a8ab0 0x7f36ac138f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.475+0000 7f36b47f4700 1 --2- 172.21.15.1:0/984308931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36ac13b990 0x7f36ac0c7af0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.475+0000 7f36b47f4700 1 -- 172.21.15.1:0/984308931 >> 172.21.15.1:0/984308931 conn(0x7f36ac063280 msgr2=0x7f36ac0bed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:22.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.475+0000 7f36b47f4700 1 -- 172.21.15.1:0/984308931 shutdown_connections 2023-11-15T02:36:22.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.475+0000 7f36b47f4700 1 -- 172.21.15.1:0/984308931 wait complete. 2023-11-15T02:36:22.488 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T02:36:22.607 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:22.606+0000 7f934234b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:36:22.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.612+0000 7f96ec371700 1 Processor -- start 2023-11-15T02:36:22.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.613+0000 7f96ec371700 1 -- start start 2023-11-15T02:36:22.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96ec371700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f96e41540a0 0x7f96e40ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96ec371700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96e40c6650 0x7f96e40ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96ec371700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e40ca050 con 0x7f96e4154480 2023-11-15T02:36:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96ec371700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e40c9440 con 0x7f96e41540a0 2023-11-15T02:36:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96ec371700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40c9720 con 0x7f96e40c6650 2023-11-15T02:36:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96ea10d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f96e41540a0 0x7f96e40ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96ea10d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f96e41540a0 0x7f96e40ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52894/0 (socket says 172.21.15.1:52894) 2023-11-15T02:36:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96ea10d700 1 -- 172.21.15.1:0/1898826356 learned_addr learned my addr 172.21.15.1:0/1898826356 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96ea90e700 1 --2- 172.21.15.1:0/1898826356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96e40c6650 0x7f96e40ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96ea10d700 1 -- 172.21.15.1:0/1898826356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96e40c6650 msgr2=0x7f96e40ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96ea10d700 1 --2- 172.21.15.1:0/1898826356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96e40c6650 0x7f96e40ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96ea10d700 1 -- 172.21.15.1:0/1898826356 >> v1:172.21.15.141:6789/0 conn(0x7f96e4154480 legacy=0x7f96e40c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:22.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96ea10d700 1 -- 172.21.15.1:0/1898826356 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e40c9a00 con 0x7f96e41540a0 2023-11-15T02:36:22.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96ea10d700 1 --2- 172.21.15.1:0/1898826356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e41540a0 0x7f96e40ca4e0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7f96d4006fd0 tx=0x7f96d40090f0).ready entity=mon.0 client_cookie=ee25f99345b423e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:22.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96e910b700 1 -- 172.21.15.1:0/1898826356 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d400b580 con 0x7f96e41540a0 2023-11-15T02:36:22.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96e910b700 1 -- 172.21.15.1:0/1898826356 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d400b6e0 con 0x7f96e41540a0 2023-11-15T02:36:22.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.614+0000 7f96e910b700 1 -- 172.21.15.1:0/1898826356 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d400ba60 con 0x7f96e41540a0 2023-11-15T02:36:22.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.615+0000 7f96ec371700 1 -- 172.21.15.1:0/1898826356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e41540a0 msgr2=0x7f96e40ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:22.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.615+0000 7f96ec371700 1 --2- 172.21.15.1:0/1898826356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e41540a0 0x7f96e40ca4e0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7f96d4006fd0 tx=0x7f96d40090f0).stop 2023-11-15T02:36:22.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.615+0000 7f96ec371700 1 -- 172.21.15.1:0/1898826356 shutdown_connections 2023-11-15T02:36:22.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.615+0000 7f96ec371700 1 --2- 172.21.15.1:0/1898826356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96e40c6650 0x7f96e40ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.615+0000 7f96ec371700 1 --2- 172.21.15.1:0/1898826356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e41540a0 0x7f96e40ca4e0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.615+0000 7f96ec371700 1 -- 172.21.15.1:0/1898826356 >> 172.21.15.1:0/1898826356 conn(0x7f96e4064a70 msgr2=0x7f96e4064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:22.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.615+0000 7f96ec371700 1 -- 172.21.15.1:0/1898826356 shutdown_connections 2023-11-15T02:36:22.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.615+0000 7f96ec371700 1 -- 172.21.15.1:0/1898826356 wait complete. 2023-11-15T02:36:22.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.616+0000 7f96ec371700 1 Processor -- start 2023-11-15T02:36:22.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.616+0000 7f96ec371700 1 -- start start 2023-11-15T02:36:22.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ec371700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96e40c6650 0x7f96e40c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ec371700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96e41540a0 0x7f96e4142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ec371700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e4154480 0x7f96e4156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ec371700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40af1e0 con 0x7f96e4154480 2023-11-15T02:36:22.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ec371700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40ae5d0 con 0x7f96e40c6650 2023-11-15T02:36:22.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ec371700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40ae8b0 con 0x7f96e41540a0 2023-11-15T02:36:22.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ea90e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e4154480 0x7f96e4156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:22.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ea90e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e4154480 0x7f96e4156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52910/0 (socket says 172.21.15.1:52910) 2023-11-15T02:36:22.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ea90e700 1 -- 172.21.15.1:0/605945784 learned_addr learned my addr 172.21.15.1:0/605945784 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:22.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ea10d700 1 --2- 172.21.15.1:0/605945784 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96e40c6650 0x7f96e40c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:22.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96e990c700 1 --2- 172.21.15.1:0/605945784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96e41540a0 0x7f96e4142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:22.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ea90e700 1 -- 172.21.15.1:0/605945784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96e41540a0 msgr2=0x7f96e4142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:22.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ea90e700 1 --2- 172.21.15.1:0/605945784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96e41540a0 0x7f96e4142a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ea90e700 1 -- 172.21.15.1:0/605945784 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96e40c6650 msgr2=0x7f96e40c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:22.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ea90e700 1 --2- 172.21.15.1:0/605945784 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96e40c6650 0x7f96e40c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ea90e700 1 -- 172.21.15.1:0/605945784 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d4009370 con 0x7f96e4154480 2023-11-15T02:36:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.617+0000 7f96ea90e700 1 --2- 172.21.15.1:0/605945784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e4154480 0x7f96e4156d40 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f96dc009ef0 tx=0x7f96dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.618+0000 7f96da7fc700 1 -- 172.21.15.1:0/605945784 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc00cb70 con 0x7f96e4154480 2023-11-15T02:36:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.618+0000 7f96da7fc700 1 -- 172.21.15.1:0/605945784 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc00f040 con 0x7f96e4154480 2023-11-15T02:36:22.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.618+0000 7f96ec371700 1 -- 172.21.15.1:0/605945784 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e40aeb90 con 0x7f96e4154480 2023-11-15T02:36:22.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.618+0000 7f96da7fc700 1 -- 172.21.15.1:0/605945784 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc013400 con 0x7f96e4154480 2023-11-15T02:36:22.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.618+0000 7f96ec371700 1 -- 172.21.15.1:0/605945784 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e40c44f0 con 0x7f96e4154480 2023-11-15T02:36:22.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.619+0000 7f96ec371700 1 -- 172.21.15.1:0/605945784 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e406c7e0 con 0x7f96e4154480 2023-11-15T02:36:22.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.619+0000 7f96da7fc700 1 -- 172.21.15.1:0/605945784 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f96dc013770 con 0x7f96e4154480 2023-11-15T02:36:22.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.620+0000 7f96da7fc700 1 --2- 172.21.15.1:0/605945784 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96c805f270 0x7f96c8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.620+0000 7f96ea10d700 1 -- 172.21.15.1:0/605945784 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96c805f270 msgr2=0x7f96c8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:22.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.620+0000 7f96da7fc700 1 -- 172.21.15.1:0/605945784 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f96dc07af10 con 0x7f96e4154480 2023-11-15T02:36:22.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.620+0000 7f96ea10d700 1 --2- 172.21.15.1:0/605945784 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96c805f270 0x7f96c8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:22.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.624+0000 7f96da7fc700 1 -- 172.21.15.1:0/605945784 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f96dc04bd00 con 0x7f96e4154480 2023-11-15T02:36:22.712 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:22.711+0000 7f934234b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:36:22.772 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:22.771+0000 7f9affaaf680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:36:22.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.796+0000 7f96ec371700 1 -- 172.21.15.1:0/605945784 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96e40c9ce0 con 0x7f96e4154480 2023-11-15T02:36:22.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.796+0000 7f96da7fc700 1 -- 172.21.15.1:0/605945784 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v148) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96dc04f320 con 0x7f96e4154480 2023-11-15T02:36:22.798 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T02:36:22.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.798+0000 7f96ec371700 1 -- 172.21.15.1:0/605945784 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96c805f270 msgr2=0x7f96c8061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:22.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.798+0000 7f96ec371700 1 --2- 172.21.15.1:0/605945784 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96c805f270 0x7f96c8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:22.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.798+0000 7f96ec371700 1 -- 172.21.15.1:0/605945784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e4154480 msgr2=0x7f96e4156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:22.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.798+0000 7f96ec371700 1 --2- 172.21.15.1:0/605945784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e4154480 0x7f96e4156d40 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f96dc009ef0 tx=0x7f96dc00b040).stop 2023-11-15T02:36:22.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.799+0000 7f96ec371700 1 -- 172.21.15.1:0/605945784 shutdown_connections 2023-11-15T02:36:22.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.799+0000 7f96ec371700 1 --2- 172.21.15.1:0/605945784 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f96c805f270 0x7f96c8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:22.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.799+0000 7f96ec371700 1 --2- 172.21.15.1:0/605945784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96e4154480 0x7f96e4156d40 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.799+0000 7f96ec371700 1 --2- 172.21.15.1:0/605945784 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96e40c6650 0x7f96e40c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.799+0000 7f96ec371700 1 --2- 172.21.15.1:0/605945784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96e41540a0 0x7f96e4142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.799+0000 7f96ec371700 1 -- 172.21.15.1:0/605945784 >> 172.21.15.1:0/605945784 conn(0x7f96e4064a70 msgr2=0x7f96e40abc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:22.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.799+0000 7f96ec371700 1 -- 172.21.15.1:0/605945784 shutdown_connections 2023-11-15T02:36:22.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.799+0000 7f96ec371700 1 -- 172.21.15.1:0/605945784 wait complete. 2023-11-15T02:36:22.812 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T02:36:22.864 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:22.863+0000 7f934234b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:36:22.887 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:22.887+0000 7f9affaaf680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:36:22.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.936+0000 7fbe0c5c8700 1 Processor -- start 2023-11-15T02:36:22.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.936+0000 7fbe0c5c8700 1 -- start start 2023-11-15T02:36:22.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe0c5c8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbe040c3e30 0x7fbe040c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe0c5c8700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbe04069ba0 0x7fbe04154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe0c5c8700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe041550e0 con 0x7fbe04066cd0 2023-11-15T02:36:22.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe0c5c8700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe04155bc0 con 0x7fbe040c3e30 2023-11-15T02:36:22.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe0c5c8700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0406a020 con 0x7fbe04069ba0 2023-11-15T02:36:22.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe0a364700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbe040c3e30 0x7fbe040c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:22.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe0ab65700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fbe04066cd0 0x7fbe0413a550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52610/0 (socket says 172.21.15.1:52610) 2023-11-15T02:36:22.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe0ab65700 1 -- 172.21.15.1:0/3201339975 learned_addr learned my addr 172.21.15.1:0/3201339975 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:22.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe09b63700 1 --2- 172.21.15.1:0/3201339975 >> v2:172.21.15.141:3300/0 conn(0x7fbe04069ba0 0x7fbe04154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:22.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe0a364700 1 -- 172.21.15.1:0/3201339975 >> v2:172.21.15.141:3300/0 conn(0x7fbe04069ba0 msgr2=0x7fbe04154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:22.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe09362700 1 -- 172.21.15.1:0/3201339975 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776245978 0 0) 0x7fbdfc001490 con 0x7fbe04066cd0 2023-11-15T02:36:22.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe0a364700 1 --2- 172.21.15.1:0/3201339975 >> v2:172.21.15.141:3300/0 conn(0x7fbe04069ba0 0x7fbe04154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe0a364700 1 -- 172.21.15.1:0/3201339975 >> v1:172.21.15.1:6789/0 conn(0x7fbe04066cd0 legacy=0x7fbe0413a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe0a364700 1 -- 172.21.15.1:0/3201339975 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe04155320 con 0x7fbe040c3e30 2023-11-15T02:36:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe0a364700 1 --2- 172.21.15.1:0/3201339975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe040c3e30 0x7fbe040c4210 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7fbe040c8e30 tx=0x7fbdf4009060).ready entity=mon.0 client_cookie=7a1966ee4b09291 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe09362700 1 -- 172.21.15.1:0/3201339975 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400f510 con 0x7fbe040c3e30 2023-11-15T02:36:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe09362700 1 -- 172.21.15.1:0/3201339975 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf400f670 con 0x7fbe040c3e30 2023-11-15T02:36:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.937+0000 7fbe09362700 1 -- 172.21.15.1:0/3201339975 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400f9f0 con 0x7fbe040c3e30 2023-11-15T02:36:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.938+0000 7fbe0c5c8700 1 -- 172.21.15.1:0/3201339975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe040c3e30 msgr2=0x7fbe040c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.938+0000 7fbe0c5c8700 1 --2- 172.21.15.1:0/3201339975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe040c3e30 0x7fbe040c4210 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7fbe040c8e30 tx=0x7fbdf4009060).stop 2023-11-15T02:36:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.938+0000 7fbe0c5c8700 1 -- 172.21.15.1:0/3201339975 shutdown_connections 2023-11-15T02:36:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.938+0000 7fbe0c5c8700 1 --2- 172.21.15.1:0/3201339975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe040c3e30 0x7fbe040c4210 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.938+0000 7fbe0c5c8700 1 --2- 172.21.15.1:0/3201339975 >> v2:172.21.15.141:3300/0 conn(0x7fbe04069ba0 0x7fbe04154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.938+0000 7fbe0c5c8700 1 -- 172.21.15.1:0/3201339975 >> 172.21.15.1:0/3201339975 conn(0x7fbe040c7dc0 msgr2=0x7fbe040c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.938+0000 7fbe0c5c8700 1 -- 172.21.15.1:0/3201339975 shutdown_connections 2023-11-15T02:36:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.938+0000 7fbe0c5c8700 1 -- 172.21.15.1:0/3201339975 wait complete. 2023-11-15T02:36:22.945 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:22.938+0000 7f934234b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:36:22.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.939+0000 7fbe0c5c8700 1 Processor -- start 2023-11-15T02:36:22.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.939+0000 7fbe0c5c8700 1 -- start start 2023-11-15T02:36:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe0c5c8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe04066cd0 0x7fbe04153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe0c5c8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe04069ba0 0x7fbe04165fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe0c5c8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe040c3e30 0x7fbe041664d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe0c5c8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe041669c0 con 0x7fbe040c3e30 2023-11-15T02:36:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe0c5c8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe04166e70 con 0x7fbe04066cd0 2023-11-15T02:36:22.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe0c5c8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe041520d0 con 0x7fbe04069ba0 2023-11-15T02:36:22.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe0ab65700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe040c3e30 0x7fbe041664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:22.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe0ab65700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe040c3e30 0x7fbe041664d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52926/0 (socket says 172.21.15.1:52926) 2023-11-15T02:36:22.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe0ab65700 1 -- 172.21.15.1:0/2525504052 learned_addr learned my addr 172.21.15.1:0/2525504052 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:22.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe0a364700 1 --2- 172.21.15.1:0/2525504052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe04066cd0 0x7fbe04153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:22.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe09b63700 1 --2- 172.21.15.1:0/2525504052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe04069ba0 0x7fbe04165fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:22.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe0ab65700 1 -- 172.21.15.1:0/2525504052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe04069ba0 msgr2=0x7fbe04165fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:22.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe0ab65700 1 --2- 172.21.15.1:0/2525504052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe04069ba0 0x7fbe04165fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe0ab65700 1 -- 172.21.15.1:0/2525504052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe04066cd0 msgr2=0x7fbe04153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:22.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe0ab65700 1 --2- 172.21.15.1:0/2525504052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe04066cd0 0x7fbe04153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:22.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.940+0000 7fbe0ab65700 1 -- 172.21.15.1:0/2525504052 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf40092a0 con 0x7fbe040c3e30 2023-11-15T02:36:22.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.941+0000 7fbe0ab65700 1 --2- 172.21.15.1:0/2525504052 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe040c3e30 0x7fbe041664d0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fbdfc00c810 tx=0x7fbdfc007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:22.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.941+0000 7fbdfa7fc700 1 -- 172.21.15.1:0/2525504052 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc005d30 con 0x7fbe040c3e30 2023-11-15T02:36:22.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.941+0000 7fbdfa7fc700 1 -- 172.21.15.1:0/2525504052 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc005e90 con 0x7fbe040c3e30 2023-11-15T02:36:22.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.941+0000 7fbe0c5c8700 1 -- 172.21.15.1:0/2525504052 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe04152370 con 0x7fbe040c3e30 2023-11-15T02:36:22.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.941+0000 7fbdfa7fc700 1 -- 172.21.15.1:0/2525504052 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc007320 con 0x7fbe040c3e30 2023-11-15T02:36:22.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.941+0000 7fbe0c5c8700 1 -- 172.21.15.1:0/2525504052 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe04152c10 con 0x7fbe040c3e30 2023-11-15T02:36:22.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.942+0000 7fbe0c5c8700 1 -- 172.21.15.1:0/2525504052 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe041549e0 con 0x7fbe040c3e30 2023-11-15T02:36:22.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.942+0000 7fbdfa7fc700 1 -- 172.21.15.1:0/2525504052 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fbdfc007710 con 0x7fbe040c3e30 2023-11-15T02:36:22.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.943+0000 7fbdfa7fc700 1 --2- 172.21.15.1:0/2525504052 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbde805f240 0x7fbde8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:22.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.943+0000 7fbdfa7fc700 1 -- 172.21.15.1:0/2525504052 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6977+0+0 (secure 0 0 0) 0x7fbdfc07a450 con 0x7fbe040c3e30 2023-11-15T02:36:22.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.943+0000 7fbe0a364700 1 -- 172.21.15.1:0/2525504052 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbde805f240 msgr2=0x7fbde8061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:22.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.943+0000 7fbe0a364700 1 --2- 172.21.15.1:0/2525504052 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbde805f240 0x7fbde8061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:22.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:22.947+0000 7fbdfa7fc700 1 -- 172.21.15.1:0/2525504052 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbe041549e0 con 0x7fbe040c3e30 2023-11-15T02:36:23.007 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:23.006+0000 7f934234b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:36:23.048 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:23.048+0000 7f9affaaf680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:36:23.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.121+0000 7fbe0c5c8700 1 -- 172.21.15.1:0/2525504052 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe041550e0 con 0x7fbe040c3e30 2023-11-15T02:36:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.121+0000 7fbdfa7fc700 1 -- 172.21.15.1:0/2525504052 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v148) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe041550e0 con 0x7fbe040c3e30 2023-11-15T02:36:23.122 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T02:36:23.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.123+0000 7fbe0c5c8700 1 -- 172.21.15.1:0/2525504052 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbde805f240 msgr2=0x7fbde8061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:23.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.123+0000 7fbe0c5c8700 1 --2- 172.21.15.1:0/2525504052 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbde805f240 0x7fbde8061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:23.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.123+0000 7fbe0c5c8700 1 -- 172.21.15.1:0/2525504052 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe040c3e30 msgr2=0x7fbe041664d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:23.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.123+0000 7fbe0c5c8700 1 --2- 172.21.15.1:0/2525504052 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe040c3e30 0x7fbe041664d0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fbdfc00c810 tx=0x7fbdfc007d90).stop 2023-11-15T02:36:23.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.123+0000 7fbe0c5c8700 1 -- 172.21.15.1:0/2525504052 shutdown_connections 2023-11-15T02:36:23.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.123+0000 7fbe0c5c8700 1 --2- 172.21.15.1:0/2525504052 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbde805f240 0x7fbde8061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:23.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.123+0000 7fbe0c5c8700 1 --2- 172.21.15.1:0/2525504052 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe040c3e30 0x7fbe041664d0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.123+0000 7fbe0c5c8700 1 --2- 172.21.15.1:0/2525504052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe04066cd0 0x7fbe04153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.123+0000 7fbe0c5c8700 1 --2- 172.21.15.1:0/2525504052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe04069ba0 0x7fbe04165fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.123+0000 7fbe0c5c8700 1 -- 172.21.15.1:0/2525504052 >> 172.21.15.1:0/2525504052 conn(0x7fbe040c7dc0 msgr2=0x7fbe040ac480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:23.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.123+0000 7fbe0c5c8700 1 -- 172.21.15.1:0/2525504052 shutdown_connections 2023-11-15T02:36:23.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.123+0000 7fbe0c5c8700 1 -- 172.21.15.1:0/2525504052 wait complete. 2023-11-15T02:36:23.127 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:23.127+0000 7f9affaaf680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:36:23.136 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:36:23.200 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:23.200+0000 7f9affaaf680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:36:23.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.255+0000 7f044c1e0700 1 Processor -- start 2023-11-15T02:36:23.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.256+0000 7f044c1e0700 1 -- start start 2023-11-15T02:36:23.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.256+0000 7f044c1e0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04440ad370 0x7f04440aa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.256+0000 7f044c1e0700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f04440aab30 0x7f04440627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.256+0000 7f044c1e0700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04440acee0 con 0x7f0444155610 2023-11-15T02:36:23.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.256+0000 7f044c1e0700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0444069820 con 0x7f04440aab30 2023-11-15T02:36:23.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.256+0000 7f044c1e0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04440ac890 con 0x7f04440ad370 2023-11-15T02:36:23.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.257+0000 7f0449f7c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0444155610 0x7f0444068dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52624/0 (socket says 172.21.15.1:52624) 2023-11-15T02:36:23.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.257+0000 7f0449f7c700 1 -- 172.21.15.1:0/1318521769 learned_addr learned my addr 172.21.15.1:0/1318521769 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:23.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.257+0000 7f044a77d700 1 --2- 172.21.15.1:0/1318521769 >> v2:172.21.15.141:3300/0 conn(0x7f04440aab30 0x7f04440627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:23.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.257+0000 7f044977b700 1 --2- 172.21.15.1:0/1318521769 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04440ad370 0x7f04440aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:23.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.257+0000 7f0448f7a700 1 -- 172.21.15.1:0/1318521769 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211688523 0 0) 0x7f04440acee0 con 0x7f0444155610 2023-11-15T02:36:23.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.257+0000 7f0448f7a700 1 -- 172.21.15.1:0/1318521769 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04300033f0 con 0x7f0444155610 2023-11-15T02:36:23.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.257+0000 7f044a77d700 1 -- 172.21.15.1:0/1318521769 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04440ad370 msgr2=0x7f04440aa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:23.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.257+0000 7f044a77d700 1 --2- 172.21.15.1:0/1318521769 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04440ad370 0x7f04440aa640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.257+0000 7f044a77d700 1 -- 172.21.15.1:0/1318521769 >> v1:172.21.15.1:6789/0 conn(0x7f0444155610 legacy=0x7f0444068dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:23.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.257+0000 7f044a77d700 1 -- 172.21.15.1:0/1318521769 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04440acb70 con 0x7f04440aab30 2023-11-15T02:36:23.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.257+0000 7f044977b700 1 --2- 172.21.15.1:0/1318521769 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04440ad370 0x7f04440aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:23.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.257+0000 7f044a77d700 1 --2- 172.21.15.1:0/1318521769 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04440aab30 0x7f04440627b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f043c009e60 tx=0x7f043c009780).ready entity=mon.1 client_cookie=a52c8e130b97811c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:23.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.257+0000 7f0448f7a700 1 -- 172.21.15.1:0/1318521769 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c00e070 con 0x7f04440aab30 2023-11-15T02:36:23.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.257+0000 7f0448f7a700 1 -- 172.21.15.1:0/1318521769 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c00bab0 con 0x7f04440aab30 2023-11-15T02:36:23.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.257+0000 7f0448f7a700 1 -- 172.21.15.1:0/1318521769 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c00be30 con 0x7f04440aab30 2023-11-15T02:36:23.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.258+0000 7f044c1e0700 1 -- 172.21.15.1:0/1318521769 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04440aab30 msgr2=0x7f04440627b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:23.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.258+0000 7f044c1e0700 1 --2- 172.21.15.1:0/1318521769 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04440aab30 0x7f04440627b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f043c009e60 tx=0x7f043c009780).stop 2023-11-15T02:36:23.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.258+0000 7f044c1e0700 1 -- 172.21.15.1:0/1318521769 shutdown_connections 2023-11-15T02:36:23.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.258+0000 7f044c1e0700 1 --2- 172.21.15.1:0/1318521769 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04440aab30 0x7f04440627b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.258+0000 7f044c1e0700 1 --2- 172.21.15.1:0/1318521769 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04440ad370 0x7f04440aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.258+0000 7f044c1e0700 1 -- 172.21.15.1:0/1318521769 >> 172.21.15.1:0/1318521769 conn(0x7f04440c74f0 msgr2=0x7f04440c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:23.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.258+0000 7f044c1e0700 1 -- 172.21.15.1:0/1318521769 shutdown_connections 2023-11-15T02:36:23.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.258+0000 7f044c1e0700 1 -- 172.21.15.1:0/1318521769 wait complete. 2023-11-15T02:36:23.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.259+0000 7f044c1e0700 1 Processor -- start 2023-11-15T02:36:23.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.259+0000 7f044c1e0700 1 -- start start 2023-11-15T02:36:23.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f044c1e0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04440aab30 0x7f0444150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f044c1e0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04440ad370 0x7f04440a9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f044c1e0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0444155610 0x7f044414f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f044c1e0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0444150780 con 0x7f04440aab30 2023-11-15T02:36:23.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f044c1e0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044414fb70 con 0x7f0444155610 2023-11-15T02:36:23.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f044c1e0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044414fe50 con 0x7f04440ad370 2023-11-15T02:36:23.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f0449f7c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04440aab30 0x7f0444150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:23.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f0449f7c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04440aab30 0x7f0444150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52932/0 (socket says 172.21.15.1:52932) 2023-11-15T02:36:23.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f0449f7c700 1 -- 172.21.15.1:0/2761582966 learned_addr learned my addr 172.21.15.1:0/2761582966 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:23.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f044977b700 1 --2- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04440ad370 0x7f04440a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:23.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f044a77d700 1 --2- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0444155610 0x7f044414f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:23.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f0449f7c700 1 -- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04440ad370 msgr2=0x7f04440a9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:23.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f0449f7c700 1 --2- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04440ad370 0x7f04440a9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f0449f7c700 1 -- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0444155610 msgr2=0x7f044414f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:23.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f0449f7c700 1 --2- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0444155610 0x7f044414f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.260+0000 7f0449f7c700 1 -- 172.21.15.1:0/2761582966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04400092a0 con 0x7f04440aab30 2023-11-15T02:36:23.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.261+0000 7f0449f7c700 1 --2- 172.21.15.1:0/2761582966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04440aab30 0x7f0444150c10 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f043400c420 tx=0x7f0434007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:23.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.261+0000 7f0439ffb700 1 -- 172.21.15.1:0/2761582966 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04340070d0 con 0x7f04440aab30 2023-11-15T02:36:23.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.261+0000 7f0439ffb700 1 -- 172.21.15.1:0/2761582966 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0434007230 con 0x7f04440aab30 2023-11-15T02:36:23.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.261+0000 7f044c1e0700 1 -- 172.21.15.1:0/2761582966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c009a20 con 0x7f04440aab30 2023-11-15T02:36:23.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.261+0000 7f0439ffb700 1 -- 172.21.15.1:0/2761582966 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04340075b0 con 0x7f04440aab30 2023-11-15T02:36:23.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.261+0000 7f044c1e0700 1 -- 172.21.15.1:0/2761582966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0444150410 con 0x7f04440aab30 2023-11-15T02:36:23.273 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:23.263+0000 7f934234b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:36:23.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.262+0000 7f0439ffb700 1 -- 172.21.15.1:0/2761582966 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f04340059b0 con 0x7f04440aab30 2023-11-15T02:36:23.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.262+0000 7f044c1e0700 1 -- 172.21.15.1:0/2761582966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044406c7e0 con 0x7f04440aab30 2023-11-15T02:36:23.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.262+0000 7f0439ffb700 1 --2- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f042805f270 0x7f0428061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.263+0000 7f0439ffb700 1 -- 172.21.15.1:0/2761582966 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f0434079e40 con 0x7f04440aab30 2023-11-15T02:36:23.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.263+0000 7f044977b700 1 -- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f042805f270 msgr2=0x7f0428061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:23.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.263+0000 7f044977b700 1 --2- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f042805f270 0x7f0428061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:23.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.267+0000 7f0439ffb700 1 -- 172.21.15.1:0/2761582966 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f043404ac30 con 0x7f04440aab30 2023-11-15T02:36:23.448 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:23.447+0000 7f934234b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:36:23.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.464+0000 7f044977b700 1 -- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f042805f270 msgr2=0x7f0428061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:23.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.464+0000 7f044977b700 1 --2- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f042805f270 0x7f0428061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:36:23.478 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:23.478+0000 7f9affaaf680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:36:23.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.483+0000 7f044c1e0700 1 -- 172.21.15.1:0/2761582966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04440694e0 con 0x7f04440aab30 2023-11-15T02:36:23.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.484+0000 7f0439ffb700 1 -- 172.21.15.1:0/2761582966 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f0434018030 con 0x7f04440aab30 2023-11-15T02:36:23.485 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:23.485 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/2941509435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":2941509435},{"type":"v1","addr":"172.21.15.141:6837","nonce":2941509435}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/698727670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":698727670},{"type":"v1","addr":"172.21.15.141:6836","nonce":698727670}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2035210342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2035210342},{"type":"v1","addr":"172.21.15.1:6834","nonce":2035210342}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:40:20.613231+0000","modified":"2023-11-15T01:40:23.624230+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/2320712503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":2320712503},{"type":"v1","addr":"172.21.15.1:6835","nonce":2320712503}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-11-15T02:36:23.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.486+0000 7f044c1e0700 1 -- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f042805f270 msgr2=0x7f0428061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:23.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.486+0000 7f044c1e0700 1 --2- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f042805f270 0x7f0428061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:23.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.486+0000 7f044c1e0700 1 -- 172.21.15.1:0/2761582966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04440aab30 msgr2=0x7f0444150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:23.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.486+0000 7f044c1e0700 1 --2- 172.21.15.1:0/2761582966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04440aab30 0x7f0444150c10 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f043400c420 tx=0x7f0434007c80).stop 2023-11-15T02:36:23.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.486+0000 7f044c1e0700 1 -- 172.21.15.1:0/2761582966 shutdown_connections 2023-11-15T02:36:23.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.486+0000 7f044c1e0700 1 --2- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f042805f270 0x7f0428061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:23.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.486+0000 7f044c1e0700 1 --2- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0444155610 0x7f044414f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.486+0000 7f044c1e0700 1 --2- 172.21.15.1:0/2761582966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04440aab30 0x7f0444150c10 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.486+0000 7f044c1e0700 1 --2- 172.21.15.1:0/2761582966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04440ad370 0x7f04440a9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.486+0000 7f044c1e0700 1 -- 172.21.15.1:0/2761582966 >> 172.21.15.1:0/2761582966 conn(0x7f04440c74f0 msgr2=0x7f04440c6420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:23.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.486+0000 7f044c1e0700 1 -- 172.21.15.1:0/2761582966 shutdown_connections 2023-11-15T02:36:23.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.486+0000 7f044c1e0700 1 -- 172.21.15.1:0/2761582966 wait complete. 2023-11-15T02:36:23.489 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 63 2023-11-15T02:36:23.499 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:36:23.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.621+0000 7feea7ccd700 1 Processor -- start 2023-11-15T02:36:23.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.622+0000 7feea7ccd700 1 -- start start 2023-11-15T02:36:23.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.622+0000 7feea7ccd700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7feea00629e0 0x7feea00c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.622+0000 7feea7ccd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feea00c3400 0x7feea00ab430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.622+0000 7feea7ccd700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea00a9f60 con 0x7feea00ab920 2023-11-15T02:36:23.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.622+0000 7feea7ccd700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea00c3880 con 0x7feea00c3400 2023-11-15T02:36:23.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.622+0000 7feea7ccd700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea0151700 con 0x7feea00629e0 2023-11-15T02:36:23.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.623+0000 7feea5268700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feea00c3400 0x7feea00ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:23.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.623+0000 7feea626a700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7feea00ab920 0x7feea0064df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52636/0 (socket says 172.21.15.1:52636) 2023-11-15T02:36:23.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.623+0000 7feea626a700 1 -- 172.21.15.1:0/1069468720 learned_addr learned my addr 172.21.15.1:0/1069468720 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:23.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.623+0000 7feea5a69700 1 --2- 172.21.15.1:0/1069468720 >> v2:172.21.15.141:3300/0 conn(0x7feea00629e0 0x7feea00c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:23.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.623+0000 7feea5268700 1 -- 172.21.15.1:0/1069468720 >> v2:172.21.15.141:3300/0 conn(0x7feea00629e0 msgr2=0x7feea00c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:23.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.623+0000 7feea5268700 1 --2- 172.21.15.1:0/1069468720 >> v2:172.21.15.141:3300/0 conn(0x7feea00629e0 0x7feea00c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.623+0000 7feea5268700 1 -- 172.21.15.1:0/1069468720 >> v1:172.21.15.1:6789/0 conn(0x7feea00ab920 legacy=0x7feea0064df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:23.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.623+0000 7feea5268700 1 -- 172.21.15.1:0/1069468720 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea00c2a80 con 0x7feea00c3400 2023-11-15T02:36:23.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.623+0000 7feea4a67700 1 -- 172.21.15.1:0/1069468720 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163462992 0 0) 0x7feea00a9f60 con 0x7feea00ab920 2023-11-15T02:36:23.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.623+0000 7feea5268700 1 --2- 172.21.15.1:0/1069468720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feea00c3400 0x7feea00ab430 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7feea00c7400 tx=0x7fee9c009060).ready entity=mon.0 client_cookie=63a4c32f1d83270a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:23.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.623+0000 7feea4a67700 1 -- 172.21.15.1:0/1069468720 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00f510 con 0x7feea00c3400 2023-11-15T02:36:23.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.623+0000 7feea4a67700 1 -- 172.21.15.1:0/1069468720 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c00f670 con 0x7feea00c3400 2023-11-15T02:36:23.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.623+0000 7feea4a67700 1 -- 172.21.15.1:0/1069468720 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00f9f0 con 0x7feea00c3400 2023-11-15T02:36:23.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.624+0000 7feea7ccd700 1 -- 172.21.15.1:0/1069468720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feea00c3400 msgr2=0x7feea00ab430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:23.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.624+0000 7feea7ccd700 1 --2- 172.21.15.1:0/1069468720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feea00c3400 0x7feea00ab430 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7feea00c7400 tx=0x7fee9c009060).stop 2023-11-15T02:36:23.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.624+0000 7feea7ccd700 1 -- 172.21.15.1:0/1069468720 shutdown_connections 2023-11-15T02:36:23.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.624+0000 7feea7ccd700 1 --2- 172.21.15.1:0/1069468720 >> v2:172.21.15.141:3300/0 conn(0x7feea00629e0 0x7feea00c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.624+0000 7feea7ccd700 1 --2- 172.21.15.1:0/1069468720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feea00c3400 0x7feea00ab430 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.624+0000 7feea7ccd700 1 -- 172.21.15.1:0/1069468720 >> 172.21.15.1:0/1069468720 conn(0x7feea00c74f0 msgr2=0x7feea00c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:23.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.624+0000 7feea7ccd700 1 -- 172.21.15.1:0/1069468720 shutdown_connections 2023-11-15T02:36:23.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.624+0000 7feea7ccd700 1 -- 172.21.15.1:0/1069468720 wait complete. 2023-11-15T02:36:23.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.625+0000 7feea7ccd700 1 Processor -- start 2023-11-15T02:36:23.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.625+0000 7feea7ccd700 1 -- start start 2023-11-15T02:36:23.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.626+0000 7feea7ccd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feea00629e0 0x7feea00c1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.626+0000 7feea7ccd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea00ab920 0x7feea01681b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.626+0000 7feea7ccd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feea00c3400 0x7feea01539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.626+0000 7feea7ccd700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea0169150 con 0x7feea00c3400 2023-11-15T02:36:23.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.626+0000 7feea7ccd700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea01686a0 con 0x7feea00629e0 2023-11-15T02:36:23.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.626+0000 7feea7ccd700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea014f240 con 0x7feea00ab920 2023-11-15T02:36:23.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.626+0000 7feea626a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feea00c3400 0x7feea01539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:23.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.626+0000 7feea5a69700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feea00629e0 0x7feea00c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:23.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.626+0000 7feea626a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feea00c3400 0x7feea01539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52940/0 (socket says 172.21.15.1:52940) 2023-11-15T02:36:23.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.626+0000 7feea626a700 1 -- 172.21.15.1:0/2666958092 learned_addr learned my addr 172.21.15.1:0/2666958092 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:23.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.626+0000 7feea5268700 1 --2- 172.21.15.1:0/2666958092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea00ab920 0x7feea01681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:23.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.627+0000 7feea5a69700 1 -- 172.21.15.1:0/2666958092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea00ab920 msgr2=0x7feea01681b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:23.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.627+0000 7feea5a69700 1 --2- 172.21.15.1:0/2666958092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea00ab920 0x7feea01681b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.627+0000 7feea5a69700 1 -- 172.21.15.1:0/2666958092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feea00c3400 msgr2=0x7feea01539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:23.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.627+0000 7feea5a69700 1 --2- 172.21.15.1:0/2666958092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feea00c3400 0x7feea01539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.627+0000 7feea5a69700 1 -- 172.21.15.1:0/2666958092 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c0092a0 con 0x7feea00629e0 2023-11-15T02:36:23.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.627+0000 7feea5a69700 1 --2- 172.21.15.1:0/2666958092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feea00629e0 0x7feea00c1200 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fee9000e6d0 tx=0x7fee90009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:23.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.627+0000 7fee95ffb700 1 -- 172.21.15.1:0/2666958092 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90012600 con 0x7feea00629e0 2023-11-15T02:36:23.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.627+0000 7fee95ffb700 1 -- 172.21.15.1:0/2666958092 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee90012760 con 0x7feea00629e0 2023-11-15T02:36:23.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.627+0000 7fee95ffb700 1 -- 172.21.15.1:0/2666958092 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90012ae0 con 0x7feea00629e0 2023-11-15T02:36:23.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.627+0000 7feea7ccd700 1 -- 172.21.15.1:0/2666958092 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea01688b0 con 0x7feea00629e0 2023-11-15T02:36:23.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.627+0000 7feea7ccd700 1 -- 172.21.15.1:0/2666958092 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea0168e70 con 0x7feea00629e0 2023-11-15T02:36:23.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.629+0000 7feea7ccd700 1 -- 172.21.15.1:0/2666958092 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea006c7e0 con 0x7feea00629e0 2023-11-15T02:36:23.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.629+0000 7fee95ffb700 1 -- 172.21.15.1:0/2666958092 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fee9001b400 con 0x7feea00629e0 2023-11-15T02:36:23.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.629+0000 7fee95ffb700 1 --2- 172.21.15.1:0/2666958092 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fee8405f270 0x7fee84061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.629+0000 7fee95ffb700 1 -- 172.21.15.1:0/2666958092 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6977+0+0 (secure 0 0 0) 0x7fee9007a980 con 0x7feea00629e0 2023-11-15T02:36:23.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.629+0000 7feea5268700 1 -- 172.21.15.1:0/2666958092 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fee8405f270 msgr2=0x7fee84061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:23.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.629+0000 7feea5268700 1 --2- 172.21.15.1:0/2666958092 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fee8405f270 0x7fee84061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:23.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.633+0000 7fee95ffb700 1 -- 172.21.15.1:0/2666958092 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fee9004b7d0 con 0x7feea00629e0 2023-11-15T02:36:23.672 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:23.672+0000 7f9affaaf680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:36:23.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.808+0000 7feea7ccd700 1 -- 172.21.15.1:0/2666958092 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feea00c8350 con 0x7feea00629e0 2023-11-15T02:36:23.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.809+0000 7fee95ffb700 1 -- 172.21.15.1:0/2666958092 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+18218 (secure 0 0 0) 0x7fee90016020 con 0x7feea00629e0 2023-11-15T02:36:23.812 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:23.812 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":148,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:36:21.602593+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:40:18.311095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-11-15T01:40:19.597093+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":148,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":2}]},{"pgid":"17.e","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/2372281288":"2023-11-16T01:40:37.112405+0000","172.21.15.141:6833/90546":"2023-11-16T01:40:37.112405+0000","172.21.15.141:0/2781353446":"2023-11-16T01:40:37.112405+0000","172.21.15.141:6832/90546":"2023-11-16T01:40:37.112405+0000","172.21.15.141:0/4271499177":"2023-11-16T01:40:37.112405+0000","172.21.15.141:0/320812430":"2023-11-16T01:40:37.112405+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:36:23.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.811+0000 7feea7ccd700 1 -- 172.21.15.1:0/2666958092 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fee8405f270 msgr2=0x7fee84061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:23.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.811+0000 7feea7ccd700 1 --2- 172.21.15.1:0/2666958092 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fee8405f270 0x7fee84061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:23.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.811+0000 7feea7ccd700 1 -- 172.21.15.1:0/2666958092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feea00629e0 msgr2=0x7feea00c1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:23.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.811+0000 7feea7ccd700 1 --2- 172.21.15.1:0/2666958092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feea00629e0 0x7feea00c1200 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fee9000e6d0 tx=0x7fee90009060).stop 2023-11-15T02:36:23.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.811+0000 7feea7ccd700 1 -- 172.21.15.1:0/2666958092 shutdown_connections 2023-11-15T02:36:23.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.811+0000 7feea7ccd700 1 --2- 172.21.15.1:0/2666958092 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fee8405f270 0x7fee84061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:23.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.811+0000 7feea7ccd700 1 --2- 172.21.15.1:0/2666958092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feea00c3400 0x7feea01539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.811+0000 7feea7ccd700 1 --2- 172.21.15.1:0/2666958092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feea00629e0 0x7feea00c1200 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.811+0000 7feea7ccd700 1 --2- 172.21.15.1:0/2666958092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea00ab920 0x7feea01681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.811+0000 7feea7ccd700 1 -- 172.21.15.1:0/2666958092 >> 172.21.15.1:0/2666958092 conn(0x7feea00c74f0 msgr2=0x7feea00acae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:23.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.812+0000 7feea7ccd700 1 -- 172.21.15.1:0/2666958092 shutdown_connections 2023-11-15T02:36:23.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.812+0000 7feea7ccd700 1 -- 172.21.15.1:0/2666958092 wait complete. 2023-11-15T02:36:23.826 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-15T02:36:23.827 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:36:23.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.951+0000 7fe2e6fe8700 1 Processor -- start 2023-11-15T02:36:23.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.951+0000 7fe2e6fe8700 1 -- start start 2023-11-15T02:36:23.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.952+0000 7fe2e6fe8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe2e0154300 0x7fe2e00c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.952+0000 7fe2e6fe8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2e01546e0 0x7fe2e00bc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.952+0000 7fe2e6fe8700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e0069640 con 0x7fe2e0158b30 2023-11-15T02:36:23.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.952+0000 7fe2e6fe8700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e006a1e0 con 0x7fe2e0154300 2023-11-15T02:36:23.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.952+0000 7fe2e6fe8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e006bac0 con 0x7fe2e01546e0 2023-11-15T02:36:23.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.952+0000 7fe2e5fe6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe2e0154300 0x7fe2e00c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:23.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.952+0000 7fe2e5fe6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe2e0154300 0x7fe2e00c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52944/0 (socket says 172.21.15.1:52944) 2023-11-15T02:36:23.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.952+0000 7fe2e5fe6700 1 -- 172.21.15.1:0/438516836 learned_addr learned my addr 172.21.15.1:0/438516836 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:23.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.952+0000 7fe2e67e7700 1 --2- 172.21.15.1:0/438516836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2e01546e0 0x7fe2e00bc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:23.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.953+0000 7fe2e5fe6700 1 -- 172.21.15.1:0/438516836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2e01546e0 msgr2=0x7fe2e00bc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:23.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.953+0000 7fe2e5fe6700 1 --2- 172.21.15.1:0/438516836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2e01546e0 0x7fe2e00bc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.953+0000 7fe2e5fe6700 1 -- 172.21.15.1:0/438516836 >> v1:172.21.15.141:6789/0 conn(0x7fe2e0158b30 legacy=0x7fe2e0069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:23.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.953+0000 7fe2e5fe6700 1 -- 172.21.15.1:0/438516836 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e0068d10 con 0x7fe2e0154300 2023-11-15T02:36:23.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.953+0000 7fe2e5fe6700 1 --2- 172.21.15.1:0/438516836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0154300 0x7fe2e00c45d0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7fe2d0006fd0 tx=0x7fe2d00090f0).ready entity=mon.0 client_cookie=514cc8bfcaeda17e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:23.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.953+0000 7fe2e4fe4700 1 -- 172.21.15.1:0/438516836 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d000b580 con 0x7fe2e0154300 2023-11-15T02:36:23.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.953+0000 7fe2e4fe4700 1 -- 172.21.15.1:0/438516836 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d000b6e0 con 0x7fe2e0154300 2023-11-15T02:36:23.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.953+0000 7fe2e4fe4700 1 -- 172.21.15.1:0/438516836 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d000ba60 con 0x7fe2e0154300 2023-11-15T02:36:23.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.953+0000 7fe2e6fe8700 1 -- 172.21.15.1:0/438516836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0154300 msgr2=0x7fe2e00c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:23.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.953+0000 7fe2e6fe8700 1 --2- 172.21.15.1:0/438516836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0154300 0x7fe2e00c45d0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7fe2d0006fd0 tx=0x7fe2d00090f0).stop 2023-11-15T02:36:23.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.954+0000 7fe2e6fe8700 1 -- 172.21.15.1:0/438516836 shutdown_connections 2023-11-15T02:36:23.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.954+0000 7fe2e6fe8700 1 --2- 172.21.15.1:0/438516836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2e01546e0 0x7fe2e00bc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.954+0000 7fe2e6fe8700 1 --2- 172.21.15.1:0/438516836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0154300 0x7fe2e00c45d0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.954+0000 7fe2e6fe8700 1 -- 172.21.15.1:0/438516836 >> 172.21.15.1:0/438516836 conn(0x7fe2e00c7e00 msgr2=0x7fe2e00c3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:23.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.954+0000 7fe2e6fe8700 1 -- 172.21.15.1:0/438516836 shutdown_connections 2023-11-15T02:36:23.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.954+0000 7fe2e6fe8700 1 -- 172.21.15.1:0/438516836 wait complete. 2023-11-15T02:36:23.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.955+0000 7fe2e6fe8700 1 Processor -- start 2023-11-15T02:36:23.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.955+0000 7fe2e6fe8700 1 -- start start 2023-11-15T02:36:23.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e6fe8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2e0154300 0x7fe2e013cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e6fe8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2e01546e0 0x7fe2e00c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e6fe8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0158b30 0x7fe2e00c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e6fe8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00c46a0 con 0x7fe2e0158b30 2023-11-15T02:36:23.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e6fe8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00c6b50 con 0x7fe2e0154300 2023-11-15T02:36:23.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e6fe8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00c40e0 con 0x7fe2e01546e0 2023-11-15T02:36:23.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e67e7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0158b30 0x7fe2e00c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:23.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e67e7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0158b30 0x7fe2e00c6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52956/0 (socket says 172.21.15.1:52956) 2023-11-15T02:36:23.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e67e7700 1 -- 172.21.15.1:0/3527276045 learned_addr learned my addr 172.21.15.1:0/3527276045 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:23.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e5fe6700 1 --2- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2e0154300 0x7fe2e013cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:23.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e57e5700 1 --2- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2e01546e0 0x7fe2e00c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:23.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e67e7700 1 -- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2e01546e0 msgr2=0x7fe2e00c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:23.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e67e7700 1 --2- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2e01546e0 0x7fe2e00c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e67e7700 1 -- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2e0154300 msgr2=0x7fe2e013cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:23.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e67e7700 1 --2- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2e0154300 0x7fe2e013cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:23.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e67e7700 1 -- 172.21.15.1:0/3527276045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d0009370 con 0x7fe2e0158b30 2023-11-15T02:36:23.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e67e7700 1 --2- 172.21.15.1:0/3527276045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0158b30 0x7fe2e00c6660 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fe2d8009e90 tx=0x7fe2d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:23.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2d5ffb700 1 -- 172.21.15.1:0/3527276045 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d800caa0 con 0x7fe2e0158b30 2023-11-15T02:36:23.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2d5ffb700 1 -- 172.21.15.1:0/3527276045 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d800f040 con 0x7fe2e0158b30 2023-11-15T02:36:23.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2e6fe8700 1 -- 172.21.15.1:0/3527276045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e00c43c0 con 0x7fe2e0158b30 2023-11-15T02:36:23.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.956+0000 7fe2d5ffb700 1 -- 172.21.15.1:0/3527276045 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d800ce10 con 0x7fe2e0158b30 2023-11-15T02:36:23.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.957+0000 7fe2e6fe8700 1 -- 172.21.15.1:0/3527276045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e00be8b0 con 0x7fe2e0158b30 2023-11-15T02:36:23.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.958+0000 7fe2d5ffb700 1 -- 172.21.15.1:0/3527276045 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fe2d8013610 con 0x7fe2e0158b30 2023-11-15T02:36:23.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.958+0000 7fe2e6fe8700 1 -- 172.21.15.1:0/3527276045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e00be430 con 0x7fe2e0158b30 2023-11-15T02:36:23.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.958+0000 7fe2d5ffb700 1 --2- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2c405f270 0x7fe2c4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:23.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.958+0000 7fe2d5ffb700 1 -- 172.21.15.1:0/3527276045 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6977+0+0 (secure 0 0 0) 0x7fe2d807af70 con 0x7fe2e0158b30 2023-11-15T02:36:23.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.958+0000 7fe2e5fe6700 1 -- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2c405f270 msgr2=0x7fe2c4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:23.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.958+0000 7fe2e5fe6700 1 --2- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2c405f270 0x7fe2c4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:23.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:23.963+0000 7fe2d5ffb700 1 -- 172.21.15.1:0/3527276045 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe2d80a9af0 con 0x7fe2e0158b30 2023-11-15T02:36:24.102 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:24.100+0000 7f934234b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:36:24.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.159+0000 7fe2e5fe6700 1 -- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2c405f270 msgr2=0x7fe2c4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:24.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.159+0000 7fe2e5fe6700 1 --2- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2c405f270 0x7fe2c4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:36:24.170 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:24.168+0000 7f934234b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:36:24.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.180+0000 7fe2e6fe8700 1 -- 172.21.15.1:0/3527276045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2e00abf40 con 0x7fe2e0158b30 2023-11-15T02:36:24.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.181+0000 7fe2d5ffb700 1 -- 172.21.15.1:0/3527276045 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4488 (secure 0 0 0) 0x7fe2e00be430 con 0x7fe2e0158b30 2023-11-15T02:36:24.182 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:24.182 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/2941509435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":2941509435},{"type":"v1","addr":"172.21.15.141:6837","nonce":2941509435}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/698727670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":698727670},{"type":"v1","addr":"172.21.15.141:6836","nonce":698727670}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2035210342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2035210342},{"type":"v1","addr":"172.21.15.1:6834","nonce":2035210342}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:40:20.613231+0000","modified":"2023-11-15T01:40:23.624230+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/2320712503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":2320712503},{"type":"v1","addr":"172.21.15.1:6835","nonce":2320712503}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-11-15T02:36:24.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.183+0000 7fe2e6fe8700 1 -- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2c405f270 msgr2=0x7fe2c4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:24.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.183+0000 7fe2e6fe8700 1 --2- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2c405f270 0x7fe2c4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:24.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.183+0000 7fe2e6fe8700 1 -- 172.21.15.1:0/3527276045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0158b30 msgr2=0x7fe2e00c6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:24.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.183+0000 7fe2e6fe8700 1 --2- 172.21.15.1:0/3527276045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0158b30 0x7fe2e00c6660 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fe2d8009e90 tx=0x7fe2d800b040).stop 2023-11-15T02:36:24.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.183+0000 7fe2e6fe8700 1 -- 172.21.15.1:0/3527276045 shutdown_connections 2023-11-15T02:36:24.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.183+0000 7fe2e6fe8700 1 --2- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe2c405f270 0x7fe2c4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:24.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.183+0000 7fe2e6fe8700 1 --2- 172.21.15.1:0/3527276045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0158b30 0x7fe2e00c6660 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.183+0000 7fe2e6fe8700 1 --2- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe2e0154300 0x7fe2e013cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.183+0000 7fe2e6fe8700 1 --2- 172.21.15.1:0/3527276045 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2e01546e0 0x7fe2e00c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.183+0000 7fe2e6fe8700 1 -- 172.21.15.1:0/3527276045 >> 172.21.15.1:0/3527276045 conn(0x7fe2e00c7e00 msgr2=0x7fe2e01513f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:24.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.183+0000 7fe2e6fe8700 1 -- 172.21.15.1:0/3527276045 shutdown_connections 2023-11-15T02:36:24.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.183+0000 7fe2e6fe8700 1 -- 172.21.15.1:0/3527276045 wait complete. 2023-11-15T02:36:24.187 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 63 2023-11-15T02:36:24.197 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:36:24.244 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:24.243+0000 7f934234b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:36:24.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.320+0000 7f87243a0700 1 Processor -- start 2023-11-15T02:36:24.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.320+0000 7f87243a0700 1 -- start start 2023-11-15T02:36:24.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.321+0000 7f87243a0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f871c0bccd0 0x7f871c0bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:24.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.321+0000 7f87243a0700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f871c0c60b0 0x7f871c0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:24.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.321+0000 7f87243a0700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871c06a6b0 con 0x7f871c154680 2023-11-15T02:36:24.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.321+0000 7f87243a0700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871c0c3360 con 0x7f871c0bccd0 2023-11-15T02:36:24.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.321+0000 7f87243a0700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871c0bd620 con 0x7f871c0c60b0 2023-11-15T02:36:24.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.321+0000 7f872193b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f871c0bccd0 0x7f871c0bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:24.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.321+0000 7f872193b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f871c0bccd0 0x7f871c0bd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52972/0 (socket says 172.21.15.1:52972) 2023-11-15T02:36:24.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.321+0000 7f872193b700 1 -- 172.21.15.1:0/3813295426 learned_addr learned my addr 172.21.15.1:0/3813295426 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:24.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.321+0000 7f872293d700 1 --2- 172.21.15.1:0/3813295426 >> v2:172.21.15.141:3300/0 conn(0x7f871c0c60b0 0x7f871c0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:24.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.322+0000 7f872193b700 1 -- 172.21.15.1:0/3813295426 >> v2:172.21.15.141:3300/0 conn(0x7f871c0c60b0 msgr2=0x7f871c0c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:24.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.322+0000 7f872193b700 1 --2- 172.21.15.1:0/3813295426 >> v2:172.21.15.141:3300/0 conn(0x7f871c0c60b0 0x7f871c0c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.322+0000 7f872193b700 1 -- 172.21.15.1:0/3813295426 >> v1:172.21.15.141:6789/0 conn(0x7f871c154680 legacy=0x7f871c069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:24.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.322+0000 7f872193b700 1 -- 172.21.15.1:0/3813295426 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c0c2750 con 0x7f871c0bccd0 2023-11-15T02:36:24.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.322+0000 7f872193b700 1 --2- 172.21.15.1:0/3813295426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f871c0bccd0 0x7f871c0bd130 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f871c064cc0 tx=0x7f87180090f0).ready entity=mon.0 client_cookie=3072ff6ed9f45815 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:24.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.322+0000 7f872113a700 1 -- 172.21.15.1:0/3813295426 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871800b600 con 0x7f871c0bccd0 2023-11-15T02:36:24.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.322+0000 7f872113a700 1 -- 172.21.15.1:0/3813295426 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871800b760 con 0x7f871c0bccd0 2023-11-15T02:36:24.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.322+0000 7f872113a700 1 -- 172.21.15.1:0/3813295426 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871800bae0 con 0x7f871c0bccd0 2023-11-15T02:36:24.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.322+0000 7f87243a0700 1 -- 172.21.15.1:0/3813295426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f871c0bccd0 msgr2=0x7f871c0bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:24.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.322+0000 7f87243a0700 1 --2- 172.21.15.1:0/3813295426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f871c0bccd0 0x7f871c0bd130 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f871c064cc0 tx=0x7f87180090f0).stop 2023-11-15T02:36:24.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.323+0000 7f87243a0700 1 -- 172.21.15.1:0/3813295426 shutdown_connections 2023-11-15T02:36:24.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.323+0000 7f87243a0700 1 --2- 172.21.15.1:0/3813295426 >> v2:172.21.15.141:3300/0 conn(0x7f871c0c60b0 0x7f871c0c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.323+0000 7f87243a0700 1 --2- 172.21.15.1:0/3813295426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f871c0bccd0 0x7f871c0bd130 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.323+0000 7f87243a0700 1 -- 172.21.15.1:0/3813295426 >> 172.21.15.1:0/3813295426 conn(0x7f871c0c7d70 msgr2=0x7f871c0c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:24.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.323+0000 7f87243a0700 1 -- 172.21.15.1:0/3813295426 shutdown_connections 2023-11-15T02:36:24.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.323+0000 7f87243a0700 1 -- 172.21.15.1:0/3813295426 wait complete. 2023-11-15T02:36:24.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.324+0000 7f87243a0700 1 Processor -- start 2023-11-15T02:36:24.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.324+0000 7f87243a0700 1 -- start start 2023-11-15T02:36:24.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.324+0000 7f87243a0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f871c0bccd0 0x7f871c0c0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:24.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.324+0000 7f87243a0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f871c0c60b0 0x7f871c14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:24.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.324+0000 7f87243a0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f871c154680 0x7f871c0bf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:24.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.324+0000 7f87243a0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c0abc70 con 0x7f871c154680 2023-11-15T02:36:24.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.324+0000 7f87243a0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c14d8d0 con 0x7f871c0c60b0 2023-11-15T02:36:24.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.324+0000 7f87243a0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c0c0d90 con 0x7f871c0bccd0 2023-11-15T02:36:24.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f872293d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f871c154680 0x7f871c0bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:24.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f872293d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f871c154680 0x7f871c0bf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52978/0 (socket says 172.21.15.1:52978) 2023-11-15T02:36:24.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f872293d700 1 -- 172.21.15.1:0/1547821432 learned_addr learned my addr 172.21.15.1:0/1547821432 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:24.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f872193b700 1 --2- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f871c0c60b0 0x7f871c14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:24.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f872213c700 1 --2- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f871c0bccd0 0x7f871c0c0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:24.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f872293d700 1 -- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f871c0bccd0 msgr2=0x7f871c0c0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:24.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f872293d700 1 --2- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f871c0bccd0 0x7f871c0c0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f872293d700 1 -- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f871c0c60b0 msgr2=0x7f871c14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:24.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f872293d700 1 --2- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f871c0c60b0 0x7f871c14d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f872293d700 1 -- 172.21.15.1:0/1547821432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8718009370 con 0x7f871c154680 2023-11-15T02:36:24.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f872193b700 1 --2- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f871c0c60b0 0x7f871c14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:24.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f872293d700 1 --2- 172.21.15.1:0/1547821432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f871c154680 0x7f871c0bf730 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f8714009fa0 tx=0x7f8714009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:24.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f87127fc700 1 -- 172.21.15.1:0/1547821432 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871400ebc0 con 0x7f871c154680 2023-11-15T02:36:24.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f87127fc700 1 -- 172.21.15.1:0/1547821432 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871400ed20 con 0x7f871c154680 2023-11-15T02:36:24.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f87127fc700 1 -- 172.21.15.1:0/1547821432 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714014610 con 0x7f871c154680 2023-11-15T02:36:24.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.325+0000 7f87243a0700 1 -- 172.21.15.1:0/1547821432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871c0c1070 con 0x7f871c154680 2023-11-15T02:36:24.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.326+0000 7f87243a0700 1 -- 172.21.15.1:0/1547821432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871c0c1630 con 0x7f871c154680 2023-11-15T02:36:24.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.326+0000 7f87243a0700 1 -- 172.21.15.1:0/1547821432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871c0aba40 con 0x7f871c154680 2023-11-15T02:36:24.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.327+0000 7f87127fc700 1 -- 172.21.15.1:0/1547821432 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f871401d3b0 con 0x7f871c154680 2023-11-15T02:36:24.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.327+0000 7f87127fc700 1 --2- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f870005f240 0x7f8700061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:24.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.327+0000 7f87127fc700 1 -- 172.21.15.1:0/1547821432 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f871407abc0 con 0x7f871c154680 2023-11-15T02:36:24.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.327+0000 7f872213c700 1 -- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f870005f240 msgr2=0x7f8700061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:24.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.327+0000 7f872213c700 1 --2- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f870005f240 0x7f8700061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:24.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.331+0000 7f87127fc700 1 -- 172.21.15.1:0/1547821432 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f871c0aba40 con 0x7f871c154680 2023-11-15T02:36:24.369 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:24.368+0000 7f9affaaf680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:36:24.391 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:24.390+0000 7f934234b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:36:24.441 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:24.441+0000 7f9affaaf680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:36:24.461 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:24.460+0000 7f934234b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:36:24.519 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:24.519+0000 7f9affaaf680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:36:24.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.528+0000 7f872213c700 1 -- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f870005f240 msgr2=0x7f8700061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:24.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.528+0000 7f872213c700 1 --2- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f870005f240 0x7f8700061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:36:24.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.550+0000 7f87243a0700 1 -- 172.21.15.1:0/1547821432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f871c0aba40 con 0x7f871c154680 2023-11-15T02:36:24.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.550+0000 7f87127fc700 1 -- 172.21.15.1:0/1547821432 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4488 (secure 0 0 0) 0x7f871c0aba40 con 0x7f871c154680 2023-11-15T02:36:24.552 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:24.552 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/2941509435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":2941509435},{"type":"v1","addr":"172.21.15.141:6837","nonce":2941509435}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/698727670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":698727670},{"type":"v1","addr":"172.21.15.141:6836","nonce":698727670}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2035210342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2035210342},{"type":"v1","addr":"172.21.15.1:6834","nonce":2035210342}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T01:40:20.613231+0000","modified":"2023-11-15T01:40:23.624230+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/2320712503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":2320712503},{"type":"v1","addr":"172.21.15.1:6835","nonce":2320712503}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-11-15T02:36:24.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.552+0000 7f87243a0700 1 -- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f870005f240 msgr2=0x7f8700061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:24.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.552+0000 7f87243a0700 1 --2- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f870005f240 0x7f8700061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:24.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.552+0000 7f87243a0700 1 -- 172.21.15.1:0/1547821432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f871c154680 msgr2=0x7f871c0bf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:24.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.552+0000 7f87243a0700 1 --2- 172.21.15.1:0/1547821432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f871c154680 0x7f871c0bf730 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f8714009fa0 tx=0x7f8714009900).stop 2023-11-15T02:36:24.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.552+0000 7f87243a0700 1 -- 172.21.15.1:0/1547821432 shutdown_connections 2023-11-15T02:36:24.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.552+0000 7f87243a0700 1 --2- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f870005f240 0x7f8700061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:24.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.552+0000 7f87243a0700 1 --2- 172.21.15.1:0/1547821432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f871c154680 0x7f871c0bf730 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.552+0000 7f87243a0700 1 --2- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f871c0bccd0 0x7f871c0c0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.552+0000 7f87243a0700 1 --2- 172.21.15.1:0/1547821432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f871c0c60b0 0x7f871c14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.552+0000 7f87243a0700 1 -- 172.21.15.1:0/1547821432 >> 172.21.15.1:0/1547821432 conn(0x7f871c0c7d70 msgr2=0x7f871c0c36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:24.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.552+0000 7f87243a0700 1 -- 172.21.15.1:0/1547821432 shutdown_connections 2023-11-15T02:36:24.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.552+0000 7f87243a0700 1 -- 172.21.15.1:0/1547821432 wait complete. 2023-11-15T02:36:24.556 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 63 2023-11-15T02:36:24.565 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:36:24.576 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:24.575+0000 7f934234b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:36:24.680 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:24.680+0000 7f9affaaf680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:36:24.686 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:24.685+0000 7f934234b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:36:24.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.688+0000 7ff8b8a81700 1 Processor -- start 2023-11-15T02:36:24.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.688+0000 7ff8b8a81700 1 -- start start 2023-11-15T02:36:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.689+0000 7ff8b8a81700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff8b4154680 0x7ff8b4069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.689+0000 7ff8b8a81700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b40c70c0 0x7ff8b40bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:24.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.689+0000 7ff8b8a81700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b40c3360 con 0x7ff8b40bccd0 2023-11-15T02:36:24.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.689+0000 7ff8b8a81700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b40bd620 con 0x7ff8b4154680 2023-11-15T02:36:24.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.689+0000 7ff8b8a81700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40c2750 con 0x7ff8b40c70c0 2023-11-15T02:36:24.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.689+0000 7ff8b259c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff8b4154680 0x7ff8b4069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:24.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.689+0000 7ff8b259c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff8b4154680 0x7ff8b4069fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52988/0 (socket says 172.21.15.1:52988) 2023-11-15T02:36:24.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.689+0000 7ff8b259c700 1 -- 172.21.15.1:0/831491303 learned_addr learned my addr 172.21.15.1:0/831491303 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:24.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.689+0000 7ff8b2d9d700 1 --2- 172.21.15.1:0/831491303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b40c70c0 0x7ff8b40bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:24.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.690+0000 7ff8b259c700 1 -- 172.21.15.1:0/831491303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b40c70c0 msgr2=0x7ff8b40bd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:24.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.690+0000 7ff8b259c700 1 --2- 172.21.15.1:0/831491303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b40c70c0 0x7ff8b40bd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.690+0000 7ff8b259c700 1 -- 172.21.15.1:0/831491303 >> v1:172.21.15.141:6789/0 conn(0x7ff8b40bccd0 legacy=0x7ff8b40627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:24.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.690+0000 7ff8b259c700 1 -- 172.21.15.1:0/831491303 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b40c2a30 con 0x7ff8b4154680 2023-11-15T02:36:24.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.690+0000 7ff8b259c700 1 --2- 172.21.15.1:0/831491303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b4154680 0x7ff8b4069fa0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7ff8a4006fd0 tx=0x7ff8a40090f0).ready entity=mon.0 client_cookie=74843390d49bdaad server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:24.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.690+0000 7ff8b159a700 1 -- 172.21.15.1:0/831491303 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a400b580 con 0x7ff8b4154680 2023-11-15T02:36:24.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.690+0000 7ff8b159a700 1 -- 172.21.15.1:0/831491303 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a400b6e0 con 0x7ff8b4154680 2023-11-15T02:36:24.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.690+0000 7ff8b159a700 1 -- 172.21.15.1:0/831491303 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a400ba60 con 0x7ff8b4154680 2023-11-15T02:36:24.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.691+0000 7ff8b8a81700 1 -- 172.21.15.1:0/831491303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b4154680 msgr2=0x7ff8b4069fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:24.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.691+0000 7ff8b8a81700 1 --2- 172.21.15.1:0/831491303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b4154680 0x7ff8b4069fa0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7ff8a4006fd0 tx=0x7ff8a40090f0).stop 2023-11-15T02:36:24.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.691+0000 7ff8b8a81700 1 -- 172.21.15.1:0/831491303 shutdown_connections 2023-11-15T02:36:24.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.691+0000 7ff8b8a81700 1 --2- 172.21.15.1:0/831491303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b40c70c0 0x7ff8b40bd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.691+0000 7ff8b8a81700 1 --2- 172.21.15.1:0/831491303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b4154680 0x7ff8b4069fa0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.691+0000 7ff8b8a81700 1 -- 172.21.15.1:0/831491303 >> 172.21.15.1:0/831491303 conn(0x7ff8b40c7d70 msgr2=0x7ff8b40c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:24.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.691+0000 7ff8b8a81700 1 -- 172.21.15.1:0/831491303 shutdown_connections 2023-11-15T02:36:24.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.691+0000 7ff8b8a81700 1 -- 172.21.15.1:0/831491303 wait complete. 2023-11-15T02:36:24.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.692+0000 7ff8b8a81700 1 Processor -- start 2023-11-15T02:36:24.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.692+0000 7ff8b8a81700 1 -- start start 2023-11-15T02:36:24.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b8a81700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b40bccd0 0x7ff8b40ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:24.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b8a81700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b40c70c0 0x7ff8b40a7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:24.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b8a81700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b4154680 0x7ff8b4149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:24.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b8a81700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40a7d50 con 0x7ff8b40c70c0 2023-11-15T02:36:24.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b8a81700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40a8b50 con 0x7ff8b4154680 2023-11-15T02:36:24.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b8a81700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40a7f40 con 0x7ff8b40bccd0 2023-11-15T02:36:24.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b1d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b40c70c0 0x7ff8b40a7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:24.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b1d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b40c70c0 0x7ff8b40a7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52992/0 (socket says 172.21.15.1:52992) 2023-11-15T02:36:24.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b1d9b700 1 -- 172.21.15.1:0/2373474306 learned_addr learned my addr 172.21.15.1:0/2373474306 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:24.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b259c700 1 --2- 172.21.15.1:0/2373474306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b40bccd0 0x7ff8b40ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:24.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b2d9d700 1 --2- 172.21.15.1:0/2373474306 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b4154680 0x7ff8b4149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:24.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b1d9b700 1 -- 172.21.15.1:0/2373474306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b40bccd0 msgr2=0x7ff8b40ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:24.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b1d9b700 1 --2- 172.21.15.1:0/2373474306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b40bccd0 0x7ff8b40ab630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b1d9b700 1 -- 172.21.15.1:0/2373474306 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b4154680 msgr2=0x7ff8b4149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:24.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b1d9b700 1 --2- 172.21.15.1:0/2373474306 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b4154680 0x7ff8b4149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b1d9b700 1 -- 172.21.15.1:0/2373474306 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a4009370 con 0x7ff8b40c70c0 2023-11-15T02:36:24.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b1d9b700 1 --2- 172.21.15.1:0/2373474306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b40c70c0 0x7ff8b40a7860 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7ff89c00c4c0 tx=0x7ff89c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:24.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8aa7fc700 1 -- 172.21.15.1:0/2373474306 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c00ce70 con 0x7ff8b40c70c0 2023-11-15T02:36:24.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8aa7fc700 1 -- 172.21.15.1:0/2373474306 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c001e90 con 0x7ff8b40c70c0 2023-11-15T02:36:24.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b8a81700 1 -- 172.21.15.1:0/2373474306 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b40a8220 con 0x7ff8b40c70c0 2023-11-15T02:36:24.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8aa7fc700 1 -- 172.21.15.1:0/2373474306 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c007250 con 0x7ff8b40c70c0 2023-11-15T02:36:24.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.693+0000 7ff8b8a81700 1 -- 172.21.15.1:0/2373474306 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b40a87e0 con 0x7ff8b40c70c0 2023-11-15T02:36:24.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.694+0000 7ff8b8a81700 1 -- 172.21.15.1:0/2373474306 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b40a8d00 con 0x7ff8b40c70c0 2023-11-15T02:36:24.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.695+0000 7ff8aa7fc700 1 -- 172.21.15.1:0/2373474306 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7ff89c0066a0 con 0x7ff8b40c70c0 2023-11-15T02:36:24.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.695+0000 7ff8aa7fc700 1 --2- 172.21.15.1:0/2373474306 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff89405f240 0x7ff894061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:24.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.695+0000 7ff8aa7fc700 1 -- 172.21.15.1:0/2373474306 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6977+0+0 (secure 0 0 0) 0x7ff89c079f20 con 0x7ff8b40c70c0 2023-11-15T02:36:24.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.695+0000 7ff8b259c700 1 -- 172.21.15.1:0/2373474306 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff89405f240 msgr2=0x7ff894061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:24.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.695+0000 7ff8b259c700 1 --2- 172.21.15.1:0/2373474306 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff89405f240 0x7ff894061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:24.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.699+0000 7ff8aa7fc700 1 -- 172.21.15.1:0/2373474306 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff8b40a8d00 con 0x7ff8b40c70c0 2023-11-15T02:36:24.757 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:24.756+0000 7f9affaaf680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:36:24.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.873+0000 7ff8b8a81700 1 -- 172.21.15.1:0/2373474306 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8b40a8cc0 con 0x7ff8b40c70c0 2023-11-15T02:36:24.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.874+0000 7ff8aa7fc700 1 -- 172.21.15.1:0/2373474306 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+18218 (secure 0 0 0) 0x7ff89c04e740 con 0x7ff8b40c70c0 2023-11-15T02:36:24.876 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:24.878 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":148,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:36:21.602593+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-11-15T01:40:18.311095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-11-15T01:40:19.597093+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":148,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":2}]},{"pgid":"17.e","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/2372281288":"2023-11-16T01:40:37.112405+0000","172.21.15.141:6833/90546":"2023-11-16T01:40:37.112405+0000","172.21.15.141:0/2781353446":"2023-11-16T01:40:37.112405+0000","172.21.15.141:6832/90546":"2023-11-16T01:40:37.112405+0000","172.21.15.141:0/4271499177":"2023-11-16T01:40:37.112405+0000","172.21.15.141:0/320812430":"2023-11-16T01:40:37.112405+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:36:24.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.876+0000 7ff8b8a81700 1 -- 172.21.15.1:0/2373474306 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff89405f240 msgr2=0x7ff894061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:24.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.876+0000 7ff8b8a81700 1 --2- 172.21.15.1:0/2373474306 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff89405f240 0x7ff894061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:24.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.876+0000 7ff8b8a81700 1 -- 172.21.15.1:0/2373474306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b40c70c0 msgr2=0x7ff8b40a7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:24.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.876+0000 7ff8b8a81700 1 --2- 172.21.15.1:0/2373474306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b40c70c0 0x7ff8b40a7860 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7ff89c00c4c0 tx=0x7ff89c007e00).stop 2023-11-15T02:36:24.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.876+0000 7ff8b8a81700 1 -- 172.21.15.1:0/2373474306 shutdown_connections 2023-11-15T02:36:24.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.876+0000 7ff8b8a81700 1 --2- 172.21.15.1:0/2373474306 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff89405f240 0x7ff894061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:24.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.876+0000 7ff8b8a81700 1 --2- 172.21.15.1:0/2373474306 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b4154680 0x7ff8b4149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.876+0000 7ff8b8a81700 1 --2- 172.21.15.1:0/2373474306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b40bccd0 0x7ff8b40ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.876+0000 7ff8b8a81700 1 --2- 172.21.15.1:0/2373474306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b40c70c0 0x7ff8b40a7860 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:24.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.876+0000 7ff8b8a81700 1 -- 172.21.15.1:0/2373474306 >> 172.21.15.1:0/2373474306 conn(0x7ff8b40c7d70 msgr2=0x7ff8b4066110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:24.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.876+0000 7ff8b8a81700 1 -- 172.21.15.1:0/2373474306 shutdown_connections 2023-11-15T02:36:24.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:24.876+0000 7ff8b8a81700 1 -- 172.21.15.1:0/2373474306 wait complete. 2023-11-15T02:36:24.882 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:24.878+0000 7f9affaaf680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:36:24.890 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-15T02:36:24.979 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:24.978+0000 7f934234b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:36:24.994 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:24.994+0000 7f9affaaf680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:36:25.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.010+0000 7fdb19dd1700 1 Processor -- start 2023-11-15T02:36:25.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.010+0000 7fdb19dd1700 1 -- start start 2023-11-15T02:36:25.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.011+0000 7fdb19dd1700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdb140aa7d0 0x7fdb140c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:25.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.011+0000 7fdb19dd1700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdb140c3b10 0x7fdb140bd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:25.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.011+0000 7fdb19dd1700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb140c4330 con 0x7fdb141511a0 2023-11-15T02:36:25.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.011+0000 7fdb19dd1700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb140c48f0 con 0x7fdb140c3b10 2023-11-15T02:36:25.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.011+0000 7fdb19dd1700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb14069b10 con 0x7fdb140aa7d0 2023-11-15T02:36:25.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.011+0000 7fdb137fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fdb141511a0 0x7fdb140aa0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52638/0 (socket says 172.21.15.1:52638) 2023-11-15T02:36:25.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.011+0000 7fdb13fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdb140c3b10 0x7fdb140bd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:25.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.012+0000 7fdb137fe700 1 -- 172.21.15.1:0/2136839526 learned_addr learned my addr 172.21.15.1:0/2136839526 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:25.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.012+0000 7fdb12ffd700 1 --2- 172.21.15.1:0/2136839526 >> v2:172.21.15.141:3300/0 conn(0x7fdb140aa7d0 0x7fdb140c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:25.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.012+0000 7fdb127fc700 1 -- 172.21.15.1:0/2136839526 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344282070 0 0) 0x7fdb140c4330 con 0x7fdb141511a0 2023-11-15T02:36:25.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.012+0000 7fdb127fc700 1 -- 172.21.15.1:0/2136839526 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdafc0033f0 con 0x7fdb141511a0 2023-11-15T02:36:25.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.012+0000 7fdb13fff700 1 -- 172.21.15.1:0/2136839526 >> v2:172.21.15.141:3300/0 conn(0x7fdb140aa7d0 msgr2=0x7fdb140c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:25.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.012+0000 7fdb13fff700 1 --2- 172.21.15.1:0/2136839526 >> v2:172.21.15.141:3300/0 conn(0x7fdb140aa7d0 0x7fdb140c3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:25.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.012+0000 7fdb13fff700 1 -- 172.21.15.1:0/2136839526 >> v1:172.21.15.1:6789/0 conn(0x7fdb141511a0 legacy=0x7fdb140aa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:25.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.012+0000 7fdb13fff700 1 -- 172.21.15.1:0/2136839526 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb140c4610 con 0x7fdb140c3b10 2023-11-15T02:36:25.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.012+0000 7fdb13fff700 1 --2- 172.21.15.1:0/2136839526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb140c3b10 0x7fdb140bd8e0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fdb14068390 tx=0x7fdb0c009780).ready entity=mon.0 client_cookie=e5532a80d8cdc802 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:25.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.012+0000 7fdb127fc700 1 -- 172.21.15.1:0/2136839526 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c00e070 con 0x7fdb140c3b10 2023-11-15T02:36:25.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.012+0000 7fdb127fc700 1 -- 172.21.15.1:0/2136839526 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c00ba70 con 0x7fdb140c3b10 2023-11-15T02:36:25.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.012+0000 7fdb127fc700 1 -- 172.21.15.1:0/2136839526 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c00bdf0 con 0x7fdb140c3b10 2023-11-15T02:36:25.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.013+0000 7fdb19dd1700 1 -- 172.21.15.1:0/2136839526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb140c3b10 msgr2=0x7fdb140bd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:25.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.013+0000 7fdb19dd1700 1 --2- 172.21.15.1:0/2136839526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb140c3b10 0x7fdb140bd8e0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fdb14068390 tx=0x7fdb0c009780).stop 2023-11-15T02:36:25.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.013+0000 7fdb19dd1700 1 -- 172.21.15.1:0/2136839526 shutdown_connections 2023-11-15T02:36:25.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.013+0000 7fdb19dd1700 1 --2- 172.21.15.1:0/2136839526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb140c3b10 0x7fdb140bd8e0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:25.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.013+0000 7fdb19dd1700 1 --2- 172.21.15.1:0/2136839526 >> v2:172.21.15.141:3300/0 conn(0x7fdb140aa7d0 0x7fdb140c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:25.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.013+0000 7fdb19dd1700 1 -- 172.21.15.1:0/2136839526 >> 172.21.15.1:0/2136839526 conn(0x7fdb140c8ab0 msgr2=0x7fdb140c4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:25.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.013+0000 7fdb19dd1700 1 -- 172.21.15.1:0/2136839526 shutdown_connections 2023-11-15T02:36:25.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.013+0000 7fdb19dd1700 1 -- 172.21.15.1:0/2136839526 wait complete. 2023-11-15T02:36:25.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.014+0000 7fdb19dd1700 1 Processor -- start 2023-11-15T02:36:25.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.014+0000 7fdb19dd1700 1 -- start start 2023-11-15T02:36:25.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.015+0000 7fdb19dd1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdb140aa7d0 0x7fdb1414d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:25.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.015+0000 7fdb19dd1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb140c3b10 0x7fdb14152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:25.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.015+0000 7fdb19dd1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdb141511a0 0x7fdb14164ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:25.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.015+0000 7fdb19dd1700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb14164e30 con 0x7fdb140c3b10 2023-11-15T02:36:25.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.015+0000 7fdb19dd1700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1414dc90 con 0x7fdb141511a0 2023-11-15T02:36:25.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.015+0000 7fdb19dd1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb14152860 con 0x7fdb140aa7d0 2023-11-15T02:36:25.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.015+0000 7fdb12ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb140c3b10 0x7fdb14152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:25.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.015+0000 7fdb12ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb140c3b10 0x7fdb14152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53012/0 (socket says 172.21.15.1:53012) 2023-11-15T02:36:25.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.015+0000 7fdb12ffd700 1 -- 172.21.15.1:0/548673734 learned_addr learned my addr 172.21.15.1:0/548673734 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:25.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.015+0000 7fdb137fe700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdb140aa7d0 0x7fdb1414d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:25.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.015+0000 7fdb13fff700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdb141511a0 0x7fdb14164ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:25.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.016+0000 7fdb12ffd700 1 -- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdb140aa7d0 msgr2=0x7fdb1414d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:25.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.016+0000 7fdb12ffd700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdb140aa7d0 0x7fdb1414d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:25.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.016+0000 7fdb12ffd700 1 -- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdb141511a0 msgr2=0x7fdb14164ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:25.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.016+0000 7fdb12ffd700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdb141511a0 0x7fdb14164ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:25.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.016+0000 7fdb12ffd700 1 -- 172.21.15.1:0/548673734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c009a20 con 0x7fdb140c3b10 2023-11-15T02:36:25.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.016+0000 7fdb12ffd700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb140c3b10 0x7fdb14152cf0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fdb0800e900 tx=0x7fdb08009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:25.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.016+0000 7fdafb7fe700 1 -- 172.21.15.1:0/548673734 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08012600 con 0x7fdb140c3b10 2023-11-15T02:36:25.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.016+0000 7fdafb7fe700 1 -- 172.21.15.1:0/548673734 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb08012760 con 0x7fdb140c3b10 2023-11-15T02:36:25.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.016+0000 7fdb19dd1700 1 -- 172.21.15.1:0/548673734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb14151f30 con 0x7fdb140c3b10 2023-11-15T02:36:25.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.016+0000 7fdafb7fe700 1 -- 172.21.15.1:0/548673734 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08012ae0 con 0x7fdb140c3b10 2023-11-15T02:36:25.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.016+0000 7fdb19dd1700 1 -- 172.21.15.1:0/548673734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb141524f0 con 0x7fdb140c3b10 2023-11-15T02:36:25.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.017+0000 7fdb19dd1700 1 -- 172.21.15.1:0/548673734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb14152a10 con 0x7fdb140c3b10 2023-11-15T02:36:25.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.017+0000 7fdafb7fe700 1 -- 172.21.15.1:0/548673734 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fdb0801b400 con 0x7fdb140c3b10 2023-11-15T02:36:25.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.018+0000 7fdafb7fe700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdb0005f270 0x7fdb00061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:25.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.018+0000 7fdafb7fe700 1 -- 172.21.15.1:0/548673734 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6977+0+0 (secure 0 0 0) 0x7fdb0807aae0 con 0x7fdb140c3b10 2023-11-15T02:36:25.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.018+0000 7fdb137fe700 1 -- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdb0005f270 msgr2=0x7fdb00061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:25.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.018+0000 7fdb137fe700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdb0005f270 0x7fdb00061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:25.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.022+0000 7fdafb7fe700 1 -- 172.21.15.1:0/548673734 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdb14152a10 con 0x7fdb140c3b10 2023-11-15T02:36:25.050 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:25.049+0000 7f934234b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:36:25.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.069+0000 7fdafb7fe700 1 -- 172.21.15.1:0/548673734 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 65) v1 ==== 75270+0+0 (secure 0 0 0) 0x7fdb080783d0 con 0x7fdb140c3b10 2023-11-15T02:36:25.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.069+0000 7fdafb7fe700 1 -- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdb0005f270 msgr2=0x7fdb00061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:25.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.069+0000 7fdafb7fe700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdb0005f270 0x7fdb00061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:25.125 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:25.123+0000 7f92bc2db700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:25.125 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:25.123+0000 7f92bc2db700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:25.125 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:25.123+0000 7f92bc2db700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:25.126 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:25.123+0000 7f92bc2db700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:25.126 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:25.123+0000 7f92bc2db700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:25.126 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:25.124+0000 7f92bfae2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:25.126 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:25.124+0000 7f92bfae2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:25.126 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:25.124+0000 7f92bfae2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:25.127 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:25.124+0000 7f92bfae2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:25.127 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:25.124+0000 7f92bfae2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:25.250+0000 7fdb19dd1700 1 -- 172.21.15.1:0/548673734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdb14153600 con 0x7fdb140c3b10 2023-11-15T02:36:25.307 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:25.306+0000 7f9affaaf680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:36:25.381 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:25.381+0000 7f9affaaf680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:36:26.066 INFO:tasks.ceph.mon.a.smithi001.stderr:2023-11-15T02:36:26.065+0000 7f8072214700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-15T02:36:26.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.071+0000 7fdafb7fe700 1 -- 172.21.15.1:0/548673734 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 66) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fdb08078750 con 0x7fdb140c3b10 2023-11-15T02:36:26.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.071+0000 7fdafb7fe700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdb0005f270 0x7fdb000616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:26.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.072+0000 7fdb137fe700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdb0005f270 0x7fdb000616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:26.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.073+0000 7fdb137fe700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdb0005f270 0x7fdb000616b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fdb04000fd0 tx=0x7fdb04009040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:26.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.080+0000 7fdafb7fe700 1 -- 172.21.15.1:0/548673734 <== mon.0 v2:172.21.15.1:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdb0804c880 con 0x7fdb140c3b10 2023-11-15T02:36:26.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.083+0000 7fdb19dd1700 1 -- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdb0005f270 msgr2=0x7fdb000616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:26.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.083+0000 7fdb19dd1700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdb0005f270 0x7fdb000616b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fdb04000fd0 tx=0x7fdb04009040).stop 2023-11-15T02:36:26.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.083+0000 7fdb19dd1700 1 -- 172.21.15.1:0/548673734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb140c3b10 msgr2=0x7fdb14152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:26.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.083+0000 7fdb19dd1700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb140c3b10 0x7fdb14152cf0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fdb0800e900 tx=0x7fdb08009060).stop 2023-11-15T02:36:26.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.083+0000 7fdb19dd1700 1 -- 172.21.15.1:0/548673734 shutdown_connections 2023-11-15T02:36:26.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.083+0000 7fdb19dd1700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdb0005f270 0x7fdb000616b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:26.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.083+0000 7fdb19dd1700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdb141511a0 0x7fdb14164ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:26.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.083+0000 7fdb19dd1700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdb140aa7d0 0x7fdb1414d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:26.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.083+0000 7fdb19dd1700 1 --2- 172.21.15.1:0/548673734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb140c3b10 0x7fdb14152cf0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:26.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.084+0000 7fdb19dd1700 1 -- 172.21.15.1:0/548673734 >> 172.21.15.1:0/548673734 conn(0x7fdb140c8ab0 msgr2=0x7fdb14156d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:26.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.084+0000 7fdb19dd1700 1 -- 172.21.15.1:0/548673734 shutdown_connections 2023-11-15T02:36:26.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.084+0000 7fdb19dd1700 1 -- 172.21.15.1:0/548673734 wait complete. 2023-11-15T02:36:26.087 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-15T02:36:26.102 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-15T02:36:26.123 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-11-15T02:36:26.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.225+0000 7f3c58a2f700 1 Processor -- start 2023-11-15T02:36:26.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.225+0000 7f3c58a2f700 1 -- start start 2023-11-15T02:36:26.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.226+0000 7f3c58a2f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3c5414e960 0x7f3c540bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:26.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.226+0000 7f3c58a2f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c54063020 0x7f3c540c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:26.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.226+0000 7f3c58a2f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c540634b0 con 0x7f3c540bc9d0 2023-11-15T02:36:26.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.226+0000 7f3c58a2f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c540c5480 con 0x7f3c5414e960 2023-11-15T02:36:26.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.226+0000 7f3c58a2f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540bce50 con 0x7f3c54063020 2023-11-15T02:36:26.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.226+0000 7f3c51d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3c540bc9d0 0x7f3c54062910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52664/0 (socket says 172.21.15.1:52664) 2023-11-15T02:36:26.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.226+0000 7f3c51d9b700 1 -- 172.21.15.1:0/2125679731 learned_addr learned my addr 172.21.15.1:0/2125679731 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:26.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.227+0000 7f3c52d9d700 1 --2- 172.21.15.1:0/2125679731 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c54063020 0x7f3c540c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:26.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.227+0000 7f3c5259c700 1 --2- 172.21.15.1:0/2125679731 >> v2:172.21.15.141:3300/0 conn(0x7f3c5414e960 0x7f3c540bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:26.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.227+0000 7f3c5159a700 1 -- 172.21.15.1:0/2125679731 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816686690 0 0) 0x7f3c540634b0 con 0x7f3c540bc9d0 2023-11-15T02:36:26.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.227+0000 7f3c5159a700 1 -- 172.21.15.1:0/2125679731 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c400033f0 con 0x7f3c540bc9d0 2023-11-15T02:36:26.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.227+0000 7f3c5159a700 1 -- 172.21.15.1:0/2125679731 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1580787842 0 0) 0x7f3c400033f0 con 0x7f3c540bc9d0 2023-11-15T02:36:26.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.227+0000 7f3c52d9d700 1 -- 172.21.15.1:0/2125679731 >> v2:172.21.15.141:3300/0 conn(0x7f3c5414e960 msgr2=0x7f3c540bc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:26.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.227+0000 7f3c52d9d700 1 --2- 172.21.15.1:0/2125679731 >> v2:172.21.15.141:3300/0 conn(0x7f3c5414e960 0x7f3c540bc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:26.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.227+0000 7f3c52d9d700 1 -- 172.21.15.1:0/2125679731 >> v1:172.21.15.1:6789/0 conn(0x7f3c540bc9d0 legacy=0x7f3c54062910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:26.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.227+0000 7f3c52d9d700 1 -- 172.21.15.1:0/2125679731 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c540636e0 con 0x7f3c54063020 2023-11-15T02:36:26.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.227+0000 7f3c5259c700 1 --2- 172.21.15.1:0/2125679731 >> v2:172.21.15.141:3300/0 conn(0x7f3c5414e960 0x7f3c540bc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:26.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.227+0000 7f3c52d9d700 1 --2- 172.21.15.1:0/2125679731 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c54063020 0x7f3c540c5910 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f3c44009e60 tx=0x7f3c44009780).ready entity=mon.2 client_cookie=efcecb2723bf7664 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:26.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.227+0000 7f3c5159a700 1 -- 172.21.15.1:0/2125679731 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4400e070 con 0x7f3c54063020 2023-11-15T02:36:26.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.227+0000 7f3c5159a700 1 -- 172.21.15.1:0/2125679731 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4400b7a0 con 0x7f3c54063020 2023-11-15T02:36:26.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.227+0000 7f3c5159a700 1 -- 172.21.15.1:0/2125679731 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c001470 con 0x7f3c54063020 2023-11-15T02:36:26.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.228+0000 7f3c58a2f700 1 -- 172.21.15.1:0/2125679731 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c54063020 msgr2=0x7f3c540c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:26.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.228+0000 7f3c58a2f700 1 --2- 172.21.15.1:0/2125679731 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c54063020 0x7f3c540c5910 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f3c44009e60 tx=0x7f3c44009780).stop 2023-11-15T02:36:26.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.228+0000 7f3c58a2f700 1 -- 172.21.15.1:0/2125679731 shutdown_connections 2023-11-15T02:36:26.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.228+0000 7f3c58a2f700 1 --2- 172.21.15.1:0/2125679731 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c54063020 0x7f3c540c5910 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:26.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.228+0000 7f3c58a2f700 1 --2- 172.21.15.1:0/2125679731 >> v2:172.21.15.141:3300/0 conn(0x7f3c5414e960 0x7f3c540bc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:26.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.228+0000 7f3c58a2f700 1 -- 172.21.15.1:0/2125679731 >> 172.21.15.1:0/2125679731 conn(0x7f3c540c8050 msgr2=0x7f3c540c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:26.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.228+0000 7f3c58a2f700 1 -- 172.21.15.1:0/2125679731 shutdown_connections 2023-11-15T02:36:26.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.228+0000 7f3c58a2f700 1 -- 172.21.15.1:0/2125679731 wait complete. 2023-11-15T02:36:26.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.229+0000 7f3c58a2f700 1 Processor -- start 2023-11-15T02:36:26.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.229+0000 7f3c58a2f700 1 -- start start 2023-11-15T02:36:26.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c58a2f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c54063020 0x7f3c5413a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:26.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c58a2f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c540bc9d0 0x7f3c54137a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:26.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c58a2f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c5414e960 0x7f3c54064e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:26.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c58a2f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540abb00 con 0x7f3c5414e960 2023-11-15T02:36:26.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c58a2f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c541383d0 con 0x7f3c54063020 2023-11-15T02:36:26.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c58a2f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c541386b0 con 0x7f3c540bc9d0 2023-11-15T02:36:26.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c52d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c5414e960 0x7f3c54064e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:26.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c52d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c5414e960 0x7f3c54064e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53034/0 (socket says 172.21.15.1:53034) 2023-11-15T02:36:26.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c52d9d700 1 -- 172.21.15.1:0/1485257088 learned_addr learned my addr 172.21.15.1:0/1485257088 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:26.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c51d9b700 1 --2- 172.21.15.1:0/1485257088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c540bc9d0 0x7f3c54137a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:26.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c5259c700 1 --2- 172.21.15.1:0/1485257088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c54063020 0x7f3c5413a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:26.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c52d9d700 1 -- 172.21.15.1:0/1485257088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c540bc9d0 msgr2=0x7f3c54137a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:26.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c52d9d700 1 --2- 172.21.15.1:0/1485257088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c540bc9d0 0x7f3c54137a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:26.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c52d9d700 1 -- 172.21.15.1:0/1485257088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c54063020 msgr2=0x7f3c5413a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:26.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c52d9d700 1 --2- 172.21.15.1:0/1485257088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c54063020 0x7f3c5413a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:26.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c52d9d700 1 -- 172.21.15.1:0/1485257088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c0092a0 con 0x7f3c5414e960 2023-11-15T02:36:26.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.230+0000 7f3c52d9d700 1 --2- 172.21.15.1:0/1485257088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c5414e960 0x7f3c54064e80 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f3c4400b610 tx=0x7f3c44009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:26.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.231+0000 7f3c4a7fc700 1 -- 172.21.15.1:0/1485257088 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4401d420 con 0x7f3c5414e960 2023-11-15T02:36:26.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.231+0000 7f3c4a7fc700 1 -- 172.21.15.1:0/1485257088 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4401d580 con 0x7f3c5414e960 2023-11-15T02:36:26.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.231+0000 7f3c58a2f700 1 -- 172.21.15.1:0/1485257088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c44009a20 con 0x7f3c5414e960 2023-11-15T02:36:26.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.231+0000 7f3c4a7fc700 1 -- 172.21.15.1:0/1485257088 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4401d940 con 0x7f3c5414e960 2023-11-15T02:36:26.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.231+0000 7f3c58a2f700 1 -- 172.21.15.1:0/1485257088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5413a9a0 con 0x7f3c5414e960 2023-11-15T02:36:26.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.232+0000 7f3c58a2f700 1 -- 172.21.15.1:0/1485257088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c54046de0 con 0x7f3c5414e960 2023-11-15T02:36:26.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.232+0000 7f3c4a7fc700 1 -- 172.21.15.1:0/1485257088 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 66) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f3c44003040 con 0x7f3c5414e960 2023-11-15T02:36:26.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.232+0000 7f3c4a7fc700 1 --2- 172.21.15.1:0/1485257088 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3c3405f030 0x7f3c340614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:26.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.232+0000 7f3c4a7fc700 1 -- 172.21.15.1:0/1485257088 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 7191+0+0 (secure 0 0 0) 0x7f3c4407bf50 con 0x7f3c5414e960 2023-11-15T02:36:26.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.232+0000 7f3c5259c700 1 --2- 172.21.15.1:0/1485257088 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3c3405f030 0x7f3c340614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:26.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.233+0000 7f3c5259c700 1 --2- 172.21.15.1:0/1485257088 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3c3405f030 0x7f3c340614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3c4c009d20 tx=0x7f3c4c009060).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:26.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.236+0000 7f3c4a7fc700 1 -- 172.21.15.1:0/1485257088 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3c440aaaf0 con 0x7f3c5414e960 2023-11-15T02:36:26.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:26.454+0000 7f3c58a2f700 1 -- 172.21.15.1:0/1485257088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3c5406c7e0 con 0x7f3c5414e960 2023-11-15T02:36:27.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.083+0000 7f3c4a7fc700 1 -- 172.21.15.1:0/1485257088 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3c4404cfc0 con 0x7f3c5414e960 2023-11-15T02:36:27.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.085+0000 7f3c58a2f700 1 -- 172.21.15.1:0/1485257088 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3c3405f030 msgr2=0x7f3c340614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:27.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.085+0000 7f3c58a2f700 1 --2- 172.21.15.1:0/1485257088 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3c3405f030 0x7f3c340614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3c4c009d20 tx=0x7f3c4c009060).stop 2023-11-15T02:36:27.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.085+0000 7f3c58a2f700 1 -- 172.21.15.1:0/1485257088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c5414e960 msgr2=0x7f3c54064e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:27.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.085+0000 7f3c58a2f700 1 --2- 172.21.15.1:0/1485257088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c5414e960 0x7f3c54064e80 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f3c4400b610 tx=0x7f3c44009780).stop 2023-11-15T02:36:27.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.085+0000 7f3c58a2f700 1 -- 172.21.15.1:0/1485257088 shutdown_connections 2023-11-15T02:36:27.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.085+0000 7f3c58a2f700 1 --2- 172.21.15.1:0/1485257088 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3c3405f030 0x7f3c340614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:27.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.085+0000 7f3c58a2f700 1 --2- 172.21.15.1:0/1485257088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c5414e960 0x7f3c54064e80 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:27.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.085+0000 7f3c58a2f700 1 --2- 172.21.15.1:0/1485257088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c54063020 0x7f3c5413a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:27.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.085+0000 7f3c58a2f700 1 --2- 172.21.15.1:0/1485257088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c540bc9d0 0x7f3c54137a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:27.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.085+0000 7f3c58a2f700 1 -- 172.21.15.1:0/1485257088 >> 172.21.15.1:0/1485257088 conn(0x7f3c540c8050 msgr2=0x7f3c54136e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:27.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.085+0000 7f3c58a2f700 1 -- 172.21.15.1:0/1485257088 shutdown_connections 2023-11-15T02:36:27.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.086+0000 7f3c58a2f700 1 -- 172.21.15.1:0/1485257088 wait complete. 2023-11-15T02:36:27.100 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-15T02:36:27.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.265+0000 7f5006e4e700 1 Processor -- start 2023-11-15T02:36:27.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.265+0000 7f5006e4e700 1 -- start start 2023-11-15T02:36:27.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.265+0000 7f5006e4e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f500014b350 0x7f50000c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:27.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.265+0000 7f5006e4e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f50000aa750 0x7f5000154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:27.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f5006e4e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50001580d0 con 0x7f500014b730 2023-11-15T02:36:27.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f5006e4e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5000155000 con 0x7f50000aa750 2023-11-15T02:36:27.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f5006e4e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50001552e0 con 0x7f500014b350 2023-11-15T02:36:27.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f50053eb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f50000aa750 0x7f5000154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:27.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f4ffffff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f500014b730 0x7f50000aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52666/0 (socket says 172.21.15.1:52666) 2023-11-15T02:36:27.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f4ffffff700 1 -- 172.21.15.1:0/3366765764 learned_addr learned my addr 172.21.15.1:0/3366765764 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:27.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f4fff7fe700 1 -- 172.21.15.1:0/3366765764 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874299778 0 0) 0x7f50001580d0 con 0x7f500014b730 2023-11-15T02:36:27.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f5004bea700 1 --2- 172.21.15.1:0/3366765764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f500014b350 0x7f50000c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f4fff7fe700 1 -- 172.21.15.1:0/3366765764 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ff00033f0 con 0x7f500014b730 2023-11-15T02:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f50053eb700 1 -- 172.21.15.1:0/3366765764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f500014b350 msgr2=0x7f50000c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f50053eb700 1 --2- 172.21.15.1:0/3366765764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f500014b350 0x7f50000c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f50053eb700 1 -- 172.21.15.1:0/3366765764 >> v1:172.21.15.1:6789/0 conn(0x7f500014b730 legacy=0x7f50000aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f50053eb700 1 -- 172.21.15.1:0/3366765764 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50001555c0 con 0x7f50000aa750 2023-11-15T02:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f50053eb700 1 --2- 172.21.15.1:0/3366765764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50000aa750 0x7f5000154a10 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f4ff8009e60 tx=0x7f4ff8009780).ready entity=mon.0 client_cookie=1aea462b29a0e856 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f4fff7fe700 1 -- 172.21.15.1:0/3366765764 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800e070 con 0x7f50000aa750 2023-11-15T02:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f4fff7fe700 1 -- 172.21.15.1:0/3366765764 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff800bb60 con 0x7f50000aa750 2023-11-15T02:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.266+0000 7f4fff7fe700 1 -- 172.21.15.1:0/3366765764 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8012410 con 0x7f50000aa750 2023-11-15T02:36:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.267+0000 7f5006e4e700 1 -- 172.21.15.1:0/3366765764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50000aa750 msgr2=0x7f5000154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.267+0000 7f5006e4e700 1 --2- 172.21.15.1:0/3366765764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50000aa750 0x7f5000154a10 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f4ff8009e60 tx=0x7f4ff8009780).stop 2023-11-15T02:36:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.267+0000 7f5006e4e700 1 -- 172.21.15.1:0/3366765764 shutdown_connections 2023-11-15T02:36:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.267+0000 7f5006e4e700 1 --2- 172.21.15.1:0/3366765764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f50000aa750 0x7f5000154a10 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.267+0000 7f5006e4e700 1 --2- 172.21.15.1:0/3366765764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f500014b350 0x7f50000c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.267+0000 7f5006e4e700 1 -- 172.21.15.1:0/3366765764 >> 172.21.15.1:0/3366765764 conn(0x7f5000069ee0 msgr2=0x7f500006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.267+0000 7f5006e4e700 1 -- 172.21.15.1:0/3366765764 shutdown_connections 2023-11-15T02:36:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.267+0000 7f5006e4e700 1 -- 172.21.15.1:0/3366765764 wait complete. 2023-11-15T02:36:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.268+0000 7f5006e4e700 1 Processor -- start 2023-11-15T02:36:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.268+0000 7f5006e4e700 1 -- start start 2023-11-15T02:36:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.269+0000 7f5006e4e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50000aa750 0x7f5000146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:27.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.269+0000 7f5006e4e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f500014b350 0x7f5000148d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:27.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.269+0000 7f5006e4e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f500014b730 0x7f50001491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:27.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.269+0000 7f5006e4e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50000ae0b0 con 0x7f500014b350 2023-11-15T02:36:27.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.269+0000 7f5006e4e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50000aef10 con 0x7f500014b730 2023-11-15T02:36:27.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.269+0000 7f5006e4e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50000af3a0 con 0x7f50000aa750 2023-11-15T02:36:27.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.269+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f500014b350 0x7f5000148d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:27.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.269+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f500014b350 0x7f5000148d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53050/0 (socket says 172.21.15.1:53050) 2023-11-15T02:36:27.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.269+0000 7f4ffffff700 1 -- 172.21.15.1:0/609783763 learned_addr learned my addr 172.21.15.1:0/609783763 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:27.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.269+0000 7f5004bea700 1 --2- 172.21.15.1:0/609783763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50000aa750 0x7f5000146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:27.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.269+0000 7f50053eb700 1 --2- 172.21.15.1:0/609783763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f500014b730 0x7f50001491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:27.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.270+0000 7f4ffffff700 1 -- 172.21.15.1:0/609783763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50000aa750 msgr2=0x7f5000146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:27.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.270+0000 7f4ffffff700 1 --2- 172.21.15.1:0/609783763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50000aa750 0x7f5000146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:27.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.270+0000 7f4ffffff700 1 -- 172.21.15.1:0/609783763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f500014b730 msgr2=0x7f50001491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:27.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.270+0000 7f4ffffff700 1 --2- 172.21.15.1:0/609783763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f500014b730 0x7f50001491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:27.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.270+0000 7f4ffffff700 1 -- 172.21.15.1:0/609783763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff8009a20 con 0x7f500014b350 2023-11-15T02:36:27.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.270+0000 7f5004bea700 1 --2- 172.21.15.1:0/609783763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50000aa750 0x7f5000146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:27.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.270+0000 7f4ffffff700 1 --2- 172.21.15.1:0/609783763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f500014b350 0x7f5000148d00 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f4fec00c410 tx=0x7f4fec007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:27.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.270+0000 7f4ffcff9700 1 -- 172.21.15.1:0/609783763 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0072e0 con 0x7f500014b350 2023-11-15T02:36:27.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.270+0000 7f4ffcff9700 1 -- 172.21.15.1:0/609783763 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec007440 con 0x7f500014b350 2023-11-15T02:36:27.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.270+0000 7f5006e4e700 1 -- 172.21.15.1:0/609783763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50000ae300 con 0x7f500014b350 2023-11-15T02:36:27.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.270+0000 7f4ffcff9700 1 -- 172.21.15.1:0/609783763 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0057a0 con 0x7f500014b350 2023-11-15T02:36:27.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.270+0000 7f5006e4e700 1 -- 172.21.15.1:0/609783763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50000ae8c0 con 0x7f500014b350 2023-11-15T02:36:27.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.271+0000 7f5006e4e700 1 -- 172.21.15.1:0/609783763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50000af080 con 0x7f500014b350 2023-11-15T02:36:27.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.271+0000 7f4ffcff9700 1 -- 172.21.15.1:0/609783763 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 66) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f4fec005bd0 con 0x7f500014b350 2023-11-15T02:36:27.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.271+0000 7f4ffcff9700 1 --2- 172.21.15.1:0/609783763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4fe405f000 0x7f4fe40614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:27.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.272+0000 7f4ffcff9700 1 -- 172.21.15.1:0/609783763 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 7191+0+0 (secure 0 0 0) 0x7f4fec079ac0 con 0x7f500014b350 2023-11-15T02:36:27.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.272+0000 7f5004bea700 1 --2- 172.21.15.1:0/609783763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4fe405f000 0x7f4fe40614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:27.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.272+0000 7f5004bea700 1 --2- 172.21.15.1:0/609783763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4fe405f000 0x7f4fe40614c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4ff400bb60 tx=0x7f4ff4008040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:27.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.276+0000 7f4ffcff9700 1 -- 172.21.15.1:0/609783763 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4fec04aad0 con 0x7f500014b350 2023-11-15T02:36:27.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.450+0000 7f5006e4e700 1 -- 172.21.15.1:0/609783763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f50000c61c0 con 0x7f500014b350 2023-11-15T02:36:27.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:27.619+0000 7f4ffcff9700 1 -- 172.21.15.1:0/609783763 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4fec077630 con 0x7f500014b350 2023-11-15T02:36:28.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.088+0000 7f4ffcff9700 1 -- 172.21.15.1:0/609783763 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v152) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4fec01d660 con 0x7f500014b350 2023-11-15T02:36:28.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.091+0000 7f5006e4e700 1 -- 172.21.15.1:0/609783763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4fe405f000 msgr2=0x7f4fe40614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:28.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.091+0000 7f5006e4e700 1 --2- 172.21.15.1:0/609783763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4fe405f000 0x7f4fe40614c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4ff400bb60 tx=0x7f4ff4008040).stop 2023-11-15T02:36:28.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.091+0000 7f5006e4e700 1 -- 172.21.15.1:0/609783763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f500014b350 msgr2=0x7f5000148d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:28.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.091+0000 7f5006e4e700 1 --2- 172.21.15.1:0/609783763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f500014b350 0x7f5000148d00 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f4fec00c410 tx=0x7f4fec007c30).stop 2023-11-15T02:36:28.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.091+0000 7f5006e4e700 1 -- 172.21.15.1:0/609783763 shutdown_connections 2023-11-15T02:36:28.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.091+0000 7f5006e4e700 1 --2- 172.21.15.1:0/609783763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4fe405f000 0x7f4fe40614c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:28.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.091+0000 7f5006e4e700 1 --2- 172.21.15.1:0/609783763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f500014b730 0x7f50001491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:28.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.091+0000 7f5006e4e700 1 --2- 172.21.15.1:0/609783763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50000aa750 0x7f5000146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:28.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.091+0000 7f5006e4e700 1 --2- 172.21.15.1:0/609783763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f500014b350 0x7f5000148d00 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:28.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.091+0000 7f5006e4e700 1 -- 172.21.15.1:0/609783763 >> 172.21.15.1:0/609783763 conn(0x7f5000069ee0 msgr2=0x7f500006a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:28.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.091+0000 7f5006e4e700 1 -- 172.21.15.1:0/609783763 shutdown_connections 2023-11-15T02:36:28.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.091+0000 7f5006e4e700 1 -- 172.21.15.1:0/609783763 wait complete. 2023-11-15T02:36:28.094 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2023-11-15T02:36:28.107 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-15T02:36:28.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.230+0000 7f9d83520700 1 Processor -- start 2023-11-15T02:36:28.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.230+0000 7f9d83520700 1 -- start start 2023-11-15T02:36:28.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.231+0000 7f9d83520700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9d7c14b350 0x7f9d7c0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:28.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.231+0000 7f9d83520700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d7c14b730 0x7f9d7c154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:28.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.231+0000 7f9d83520700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c1580d0 con 0x7f9d7c0aa040 2023-11-15T02:36:28.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.231+0000 7f9d83520700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7c155000 con 0x7f9d7c14b350 2023-11-15T02:36:28.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.231+0000 7f9d83520700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c1552e0 con 0x7f9d7c14b730 2023-11-15T02:36:28.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.231+0000 7f9d812bc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9d7c14b350 0x7f9d7c0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:28.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.231+0000 7f9d81abd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9d7c0aa040 0x7f9d7c158560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41116/0 (socket says 172.21.15.1:41116) 2023-11-15T02:36:28.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.231+0000 7f9d81abd700 1 -- 172.21.15.1:0/2554288305 learned_addr learned my addr 172.21.15.1:0/2554288305 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:28.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d80abb700 1 --2- 172.21.15.1:0/2554288305 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d7c14b730 0x7f9d7c154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:28.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d812bc700 1 -- 172.21.15.1:0/2554288305 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d7c14b730 msgr2=0x7f9d7c154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:28.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d812bc700 1 --2- 172.21.15.1:0/2554288305 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d7c14b730 0x7f9d7c154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:28.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d812bc700 1 -- 172.21.15.1:0/2554288305 >> v1:172.21.15.1:6789/0 conn(0x7f9d7c0aa040 legacy=0x7f9d7c158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:28.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d7bfff700 1 -- 172.21.15.1:0/2554288305 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359096793 0 0) 0x7f9d7c1580d0 con 0x7f9d7c0aa040 2023-11-15T02:36:28.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d812bc700 1 -- 172.21.15.1:0/2554288305 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c1555c0 con 0x7f9d7c14b350 2023-11-15T02:36:28.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d812bc700 1 --2- 172.21.15.1:0/2554288305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d7c14b350 0x7f9d7c0c8290 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f9d6c009e60 tx=0x7f9d6c009780).ready entity=mon.0 client_cookie=bf92a782ec1f4690 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:28.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d7bfff700 1 -- 172.21.15.1:0/2554288305 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c00e070 con 0x7f9d7c14b350 2023-11-15T02:36:28.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d7bfff700 1 -- 172.21.15.1:0/2554288305 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c00bc30 con 0x7f9d7c14b350 2023-11-15T02:36:28.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d7bfff700 1 -- 172.21.15.1:0/2554288305 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c012410 con 0x7f9d7c14b350 2023-11-15T02:36:28.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d83520700 1 -- 172.21.15.1:0/2554288305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d7c14b350 msgr2=0x7f9d7c0c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:28.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d83520700 1 --2- 172.21.15.1:0/2554288305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d7c14b350 0x7f9d7c0c8290 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f9d6c009e60 tx=0x7f9d6c009780).stop 2023-11-15T02:36:28.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d83520700 1 -- 172.21.15.1:0/2554288305 shutdown_connections 2023-11-15T02:36:28.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d83520700 1 --2- 172.21.15.1:0/2554288305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d7c14b350 0x7f9d7c0c8290 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:28.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d83520700 1 --2- 172.21.15.1:0/2554288305 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d7c14b730 0x7f9d7c154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:28.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.232+0000 7f9d83520700 1 -- 172.21.15.1:0/2554288305 >> 172.21.15.1:0/2554288305 conn(0x7f9d7c069ee0 msgr2=0x7f9d7c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:28.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.233+0000 7f9d83520700 1 -- 172.21.15.1:0/2554288305 shutdown_connections 2023-11-15T02:36:28.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.233+0000 7f9d83520700 1 -- 172.21.15.1:0/2554288305 wait complete. 2023-11-15T02:36:28.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.234+0000 7f9d83520700 1 Processor -- start 2023-11-15T02:36:28.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.234+0000 7f9d83520700 1 -- start start 2023-11-15T02:36:28.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.234+0000 7f9d83520700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d7c0aa040 0x7f9d7c1444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:28.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d83520700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d7c14b350 0x7f9d7c14bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:28.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d83520700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d7c14b730 0x7f9d7c14d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:28.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d83520700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0c5160 con 0x7f9d7c0aa040 2023-11-15T02:36:28.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d83520700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c1589d0 con 0x7f9d7c14b730 2023-11-15T02:36:28.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d83520700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c145330 con 0x7f9d7c14b350 2023-11-15T02:36:28.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d812bc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d7c0aa040 0x7f9d7c1444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:28.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d812bc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d7c0aa040 0x7f9d7c1444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43822/0 (socket says 172.21.15.1:43822) 2023-11-15T02:36:28.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d812bc700 1 -- 172.21.15.1:0/263017535 learned_addr learned my addr 172.21.15.1:0/263017535 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:28.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d812bc700 1 -- 172.21.15.1:0/263017535 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d7c14b350 msgr2=0x7f9d7c14bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:28.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d812bc700 1 --2- 172.21.15.1:0/263017535 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d7c14b350 0x7f9d7c14bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:28.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d812bc700 1 -- 172.21.15.1:0/263017535 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d7c14b730 msgr2=0x7f9d7c14d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:28.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d812bc700 1 --2- 172.21.15.1:0/263017535 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d7c14b730 0x7f9d7c14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:28.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d812bc700 1 -- 172.21.15.1:0/263017535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c009a20 con 0x7f9d7c0aa040 2023-11-15T02:36:28.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d812bc700 1 --2- 172.21.15.1:0/263017535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d7c0aa040 0x7f9d7c1444a0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f9d6c007080 tx=0x7f9d6c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:28.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d797fa700 1 -- 172.21.15.1:0/263017535 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c01d630 con 0x7f9d7c0aa040 2023-11-15T02:36:28.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d797fa700 1 -- 172.21.15.1:0/263017535 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c01d790 con 0x7f9d7c0aa040 2023-11-15T02:36:28.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d83520700 1 -- 172.21.15.1:0/263017535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c144990 con 0x7f9d7c0aa040 2023-11-15T02:36:28.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d797fa700 1 -- 172.21.15.1:0/263017535 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c01db10 con 0x7f9d7c0aa040 2023-11-15T02:36:28.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.235+0000 7f9d83520700 1 -- 172.21.15.1:0/263017535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c14e3d0 con 0x7f9d7c0aa040 2023-11-15T02:36:28.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.236+0000 7f9d83520700 1 -- 172.21.15.1:0/263017535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c0abad0 con 0x7f9d7c0aa040 2023-11-15T02:36:28.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.237+0000 7f9d797fa700 1 -- 172.21.15.1:0/263017535 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9d6c003040 con 0x7f9d7c0aa040 2023-11-15T02:36:28.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.237+0000 7f9d797fa700 1 --2- 172.21.15.1:0/263017535 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d6805f270 0x7f9d68061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:28.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.237+0000 7f9d797fa700 1 -- 172.21.15.1:0/263017535 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6695+0+0 (secure 0 0 0) 0x7f9d6c07c320 con 0x7f9d7c0aa040 2023-11-15T02:36:28.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.237+0000 7f9d80abb700 1 --2- 172.21.15.1:0/263017535 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d6805f270 0x7f9d68061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:28.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.238+0000 7f9d80abb700 1 --2- 172.21.15.1:0/263017535 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d6805f270 0x7f9d68061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9d7c0ad2d0 tx=0x7f9d70008040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:28.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.241+0000 7f9d797fa700 1 -- 172.21.15.1:0/263017535 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9d7c0abad0 con 0x7f9d7c0aa040 2023-11-15T02:36:28.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:28.416+0000 7f9d83520700 1 -- 172.21.15.1:0/263017535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9d7c0abad0 con 0x7f9d7c0aa040 2023-11-15T02:36:29.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.088+0000 7f9d797fa700 1 -- 172.21.15.1:0/263017535 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v153) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9d7c0abad0 con 0x7f9d7c0aa040 2023-11-15T02:36:29.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.093+0000 7f9d83520700 1 -- 172.21.15.1:0/263017535 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d6805f270 msgr2=0x7f9d68061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.093+0000 7f9d83520700 1 --2- 172.21.15.1:0/263017535 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d6805f270 0x7f9d68061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9d7c0ad2d0 tx=0x7f9d70008040).stop 2023-11-15T02:36:29.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.093+0000 7f9d83520700 1 -- 172.21.15.1:0/263017535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d7c0aa040 msgr2=0x7f9d7c1444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.093+0000 7f9d83520700 1 --2- 172.21.15.1:0/263017535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d7c0aa040 0x7f9d7c1444a0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f9d6c007080 tx=0x7f9d6c009780).stop 2023-11-15T02:36:29.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.093+0000 7f9d83520700 1 -- 172.21.15.1:0/263017535 shutdown_connections 2023-11-15T02:36:29.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.093+0000 7f9d83520700 1 --2- 172.21.15.1:0/263017535 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f9d6805f270 0x7f9d68061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.093+0000 7f9d83520700 1 --2- 172.21.15.1:0/263017535 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9d7c14b730 0x7f9d7c14d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:29.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.093+0000 7f9d83520700 1 --2- 172.21.15.1:0/263017535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d7c0aa040 0x7f9d7c1444a0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.093+0000 7f9d83520700 1 --2- 172.21.15.1:0/263017535 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9d7c14b350 0x7f9d7c14bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:29.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.093+0000 7f9d83520700 1 -- 172.21.15.1:0/263017535 >> 172.21.15.1:0/263017535 conn(0x7f9d7c069ee0 msgr2=0x7f9d7c157270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:29.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.093+0000 7f9d83520700 1 -- 172.21.15.1:0/263017535 shutdown_connections 2023-11-15T02:36:29.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.093+0000 7f9d83520700 1 -- 172.21.15.1:0/263017535 wait complete. 2023-11-15T02:36:29.097 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2023-11-15T02:36:29.109 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-15T02:36:29.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.231+0000 7f8bbdd55700 1 Processor -- start 2023-11-15T02:36:29.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.231+0000 7f8bbdd55700 1 -- start start 2023-11-15T02:36:29.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bbdd55700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8bb8154480 0x7f8bb80c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bbdd55700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8bb80c6430 0x7f8bb80aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bbdd55700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb80ca050 con 0x7f8bb81540a0 2023-11-15T02:36:29.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bbdd55700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb80c68c0 con 0x7f8bb80c6430 2023-11-15T02:36:29.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bbdd55700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb80c9440 con 0x7f8bb8154480 2023-11-15T02:36:29.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bb7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8bb80c6430 0x7f8bb80aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bb7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8bb80c6430 0x7f8bb80aaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43828/0 (socket says 172.21.15.1:43828) 2023-11-15T02:36:29.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bb7fff700 1 -- 172.21.15.1:0/3507914147 learned_addr learned my addr 172.21.15.1:0/3507914147 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:29.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bb6ffd700 1 --2- 172.21.15.1:0/3507914147 >> v2:172.21.15.141:3300/0 conn(0x7f8bb8154480 0x7f8bb80c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bb7fff700 1 -- 172.21.15.1:0/3507914147 >> v2:172.21.15.141:3300/0 conn(0x7f8bb8154480 msgr2=0x7f8bb80c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:29.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bb7fff700 1 --2- 172.21.15.1:0/3507914147 >> v2:172.21.15.141:3300/0 conn(0x7f8bb8154480 0x7f8bb80c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bb7fff700 1 -- 172.21.15.1:0/3507914147 >> v1:172.21.15.141:6789/0 conn(0x7f8bb81540a0 legacy=0x7f8bb80ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bb7fff700 1 -- 172.21.15.1:0/3507914147 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb80c9720 con 0x7f8bb80c6430 2023-11-15T02:36:29.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bb7fff700 1 --2- 172.21.15.1:0/3507914147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bb80c6430 0x7f8bb80aaf40 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f8bb80c88f0 tx=0x7f8bb00090f0).ready entity=mon.0 client_cookie=62ac391226fe62a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:29.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bb67fc700 1 -- 172.21.15.1:0/3507914147 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000b600 con 0x7f8bb80c6430 2023-11-15T02:36:29.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bb67fc700 1 -- 172.21.15.1:0/3507914147 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb000b760 con 0x7f8bb80c6430 2023-11-15T02:36:29.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.232+0000 7f8bb67fc700 1 -- 172.21.15.1:0/3507914147 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000bae0 con 0x7f8bb80c6430 2023-11-15T02:36:29.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.233+0000 7f8bbdd55700 1 -- 172.21.15.1:0/3507914147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bb80c6430 msgr2=0x7f8bb80aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.233+0000 7f8bbdd55700 1 --2- 172.21.15.1:0/3507914147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bb80c6430 0x7f8bb80aaf40 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f8bb80c88f0 tx=0x7f8bb00090f0).stop 2023-11-15T02:36:29.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.233+0000 7f8bbdd55700 1 -- 172.21.15.1:0/3507914147 shutdown_connections 2023-11-15T02:36:29.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.233+0000 7f8bbdd55700 1 --2- 172.21.15.1:0/3507914147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bb80c6430 0x7f8bb80aaf40 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.233+0000 7f8bbdd55700 1 --2- 172.21.15.1:0/3507914147 >> v2:172.21.15.141:3300/0 conn(0x7f8bb8154480 0x7f8bb80c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.233+0000 7f8bbdd55700 1 -- 172.21.15.1:0/3507914147 >> 172.21.15.1:0/3507914147 conn(0x7f8bb8064a70 msgr2=0x7f8bb8064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:29.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.233+0000 7f8bbdd55700 1 -- 172.21.15.1:0/3507914147 shutdown_connections 2023-11-15T02:36:29.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.233+0000 7f8bbdd55700 1 -- 172.21.15.1:0/3507914147 wait complete. 2023-11-15T02:36:29.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.234+0000 7f8bbdd55700 1 Processor -- start 2023-11-15T02:36:29.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.234+0000 7f8bbdd55700 1 -- start start 2023-11-15T02:36:29.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bbdd55700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bb80c6430 0x7f8bb813c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bbdd55700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8bb81540a0 0x7f8bb80b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bbdd55700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bb8154480 0x7f8bb8155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bbdd55700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80c31d0 con 0x7f8bb80c6430 2023-11-15T02:36:29.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bbdd55700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80ae2e0 con 0x7f8bb8154480 2023-11-15T02:36:29.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bbdd55700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80c25c0 con 0x7f8bb81540a0 2023-11-15T02:36:29.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bb77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bb80c6430 0x7f8bb813c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bb77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bb80c6430 0x7f8bb813c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43840/0 (socket says 172.21.15.1:43840) 2023-11-15T02:36:29.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bb77fe700 1 -- 172.21.15.1:0/4219357852 learned_addr learned my addr 172.21.15.1:0/4219357852 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:29.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bb7fff700 1 --2- 172.21.15.1:0/4219357852 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bb8154480 0x7f8bb8155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bb6ffd700 1 --2- 172.21.15.1:0/4219357852 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8bb81540a0 0x7f8bb80b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bb77fe700 1 -- 172.21.15.1:0/4219357852 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8bb81540a0 msgr2=0x7f8bb80b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bb77fe700 1 --2- 172.21.15.1:0/4219357852 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8bb81540a0 0x7f8bb80b0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bb77fe700 1 -- 172.21.15.1:0/4219357852 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bb8154480 msgr2=0x7f8bb8155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bb77fe700 1 --2- 172.21.15.1:0/4219357852 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bb8154480 0x7f8bb8155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.235+0000 7f8bb77fe700 1 -- 172.21.15.1:0/4219357852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0009370 con 0x7f8bb80c6430 2023-11-15T02:36:29.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.236+0000 7f8bb77fe700 1 --2- 172.21.15.1:0/4219357852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bb80c6430 0x7f8bb813c620 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f8ba800c840 tx=0x7f8ba8001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:29.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.236+0000 7f8baf7fe700 1 -- 172.21.15.1:0/4219357852 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8006a20 con 0x7f8bb80c6430 2023-11-15T02:36:29.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.236+0000 7f8baf7fe700 1 -- 172.21.15.1:0/4219357852 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba8006b80 con 0x7f8bb80c6430 2023-11-15T02:36:29.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.236+0000 7f8bbdd55700 1 -- 172.21.15.1:0/4219357852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb80c28a0 con 0x7f8bb80c6430 2023-11-15T02:36:29.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.236+0000 7f8baf7fe700 1 -- 172.21.15.1:0/4219357852 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8007020 con 0x7f8bb80c6430 2023-11-15T02:36:29.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.236+0000 7f8bbdd55700 1 -- 172.21.15.1:0/4219357852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb80c2e60 con 0x7f8bb80c6430 2023-11-15T02:36:29.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.237+0000 7f8bbdd55700 1 -- 172.21.15.1:0/4219357852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb806c7e0 con 0x7f8bb80c6430 2023-11-15T02:36:29.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.237+0000 7f8baf7fe700 1 -- 172.21.15.1:0/4219357852 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8ba8007410 con 0x7f8bb80c6430 2023-11-15T02:36:29.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.237+0000 7f8baf7fe700 1 --2- 172.21.15.1:0/4219357852 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b9805f2a0 0x7f8b98061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.237+0000 7f8baf7fe700 1 -- 172.21.15.1:0/4219357852 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6281+0+0 (secure 0 0 0) 0x7f8ba807a110 con 0x7f8bb80c6430 2023-11-15T02:36:29.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.238+0000 7f8bb6ffd700 1 --2- 172.21.15.1:0/4219357852 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b9805f2a0 0x7f8b98061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.238+0000 7f8bb6ffd700 1 --2- 172.21.15.1:0/4219357852 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b9805f2a0 0x7f8b98061760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8ba0006fd0 tx=0x7f8ba0008040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:29.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.242+0000 7f8baf7fe700 1 -- 172.21.15.1:0/4219357852 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8ba804b1c0 con 0x7f8bb80c6430 2023-11-15T02:36:29.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.413+0000 7f8bbdd55700 1 -- 172.21.15.1:0/4219357852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8bb80c9a00 con 0x7f8bb80c6430 2023-11-15T02:36:29.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.416+0000 7f8baf7fe700 1 -- 172.21.15.1:0/4219357852 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8ba804e7e0 con 0x7f8bb80c6430 2023-11-15T02:36:29.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.418+0000 7f8bbdd55700 1 -- 172.21.15.1:0/4219357852 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b9805f2a0 msgr2=0x7f8b98061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.418+0000 7f8bbdd55700 1 --2- 172.21.15.1:0/4219357852 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b9805f2a0 0x7f8b98061760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8ba0006fd0 tx=0x7f8ba0008040).stop 2023-11-15T02:36:29.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.418+0000 7f8bbdd55700 1 -- 172.21.15.1:0/4219357852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bb80c6430 msgr2=0x7f8bb813c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.418+0000 7f8bbdd55700 1 --2- 172.21.15.1:0/4219357852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bb80c6430 0x7f8bb813c620 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f8ba800c840 tx=0x7f8ba8001660).stop 2023-11-15T02:36:29.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.418+0000 7f8bbdd55700 1 -- 172.21.15.1:0/4219357852 shutdown_connections 2023-11-15T02:36:29.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.418+0000 7f8bbdd55700 1 --2- 172.21.15.1:0/4219357852 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b9805f2a0 0x7f8b98061760 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.418+0000 7f8bbdd55700 1 --2- 172.21.15.1:0/4219357852 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8bb8154480 0x7f8bb8155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.418+0000 7f8bbdd55700 1 --2- 172.21.15.1:0/4219357852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bb80c6430 0x7f8bb813c620 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.418+0000 7f8bbdd55700 1 --2- 172.21.15.1:0/4219357852 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8bb81540a0 0x7f8bb80b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.418+0000 7f8bbdd55700 1 -- 172.21.15.1:0/4219357852 >> 172.21.15.1:0/4219357852 conn(0x7f8bb8064a70 msgr2=0x7f8bb80c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:29.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.419+0000 7f8bbdd55700 1 -- 172.21.15.1:0/4219357852 shutdown_connections 2023-11-15T02:36:29.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.419+0000 7f8bbdd55700 1 -- 172.21.15.1:0/4219357852 wait complete. 2023-11-15T02:36:29.431 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-15T02:36:29.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.551+0000 7f9272bf5700 1 Processor -- start 2023-11-15T02:36:29.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.551+0000 7f9272bf5700 1 -- start start 2023-11-15T02:36:29.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.551+0000 7f9272bf5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f926c13b990 0x7f926c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.551+0000 7f9272bf5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f926c13bd70 0x7f926c066870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.551+0000 7f9272bf5700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926c0c7760 con 0x7f926c0a8ab0 2023-11-15T02:36:29.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.551+0000 7f9272bf5700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926c067340 con 0x7f926c13b990 2023-11-15T02:36:29.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.551+0000 7f9272bf5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c067060 con 0x7f926c13bd70 2023-11-15T02:36:29.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.552+0000 7f9270991700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f926c13b990 0x7f926c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.552+0000 7f9271192700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f926c0a8ab0 0x7f926c0c3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41130/0 (socket says 172.21.15.1:41130) 2023-11-15T02:36:29.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.552+0000 7f9270991700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f926c13b990 0x7f926c1568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43842/0 (socket says 172.21.15.1:43842) 2023-11-15T02:36:29.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.552+0000 7f9271192700 1 -- 172.21.15.1:0/2417494193 learned_addr learned my addr 172.21.15.1:0/2417494193 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:29.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.552+0000 7f926bfff700 1 --2- 172.21.15.1:0/2417494193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f926c13bd70 0x7f926c066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.552+0000 7f9270991700 1 -- 172.21.15.1:0/2417494193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f926c13bd70 msgr2=0x7f926c066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:29.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.552+0000 7f9270991700 1 --2- 172.21.15.1:0/2417494193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f926c13bd70 0x7f926c066870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.552+0000 7f9270991700 1 -- 172.21.15.1:0/2417494193 >> v1:172.21.15.1:6789/0 conn(0x7f926c0a8ab0 legacy=0x7f926c0c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.552+0000 7f9270991700 1 -- 172.21.15.1:0/2417494193 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c0c7110 con 0x7f926c13b990 2023-11-15T02:36:29.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.552+0000 7f926b7fe700 1 -- 172.21.15.1:0/2417494193 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742221073 0 0) 0x7f926c0c7760 con 0x7f926c0a8ab0 2023-11-15T02:36:29.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.552+0000 7f9270991700 1 --2- 172.21.15.1:0/2417494193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f926c13b990 0x7f926c1568c0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f9264009e60 tx=0x7f9264009780).ready entity=mon.0 client_cookie=f85b86d3a077462c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:29.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.552+0000 7f926b7fe700 1 -- 172.21.15.1:0/2417494193 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926400e070 con 0x7f926c13b990 2023-11-15T02:36:29.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.552+0000 7f926b7fe700 1 -- 172.21.15.1:0/2417494193 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926400bb60 con 0x7f926c13b990 2023-11-15T02:36:29.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.552+0000 7f926b7fe700 1 -- 172.21.15.1:0/2417494193 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264012410 con 0x7f926c13b990 2023-11-15T02:36:29.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.553+0000 7f9272bf5700 1 -- 172.21.15.1:0/2417494193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f926c13b990 msgr2=0x7f926c1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.553+0000 7f9272bf5700 1 --2- 172.21.15.1:0/2417494193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f926c13b990 0x7f926c1568c0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f9264009e60 tx=0x7f9264009780).stop 2023-11-15T02:36:29.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.553+0000 7f9272bf5700 1 -- 172.21.15.1:0/2417494193 shutdown_connections 2023-11-15T02:36:29.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.553+0000 7f9272bf5700 1 --2- 172.21.15.1:0/2417494193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f926c13b990 0x7f926c1568c0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.553+0000 7f9272bf5700 1 --2- 172.21.15.1:0/2417494193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f926c13bd70 0x7f926c066870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.553+0000 7f9272bf5700 1 -- 172.21.15.1:0/2417494193 >> 172.21.15.1:0/2417494193 conn(0x7f926c063280 msgr2=0x7f926c0c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:29.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.553+0000 7f9272bf5700 1 -- 172.21.15.1:0/2417494193 shutdown_connections 2023-11-15T02:36:29.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.553+0000 7f9272bf5700 1 -- 172.21.15.1:0/2417494193 wait complete. 2023-11-15T02:36:29.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.554+0000 7f9272bf5700 1 Processor -- start 2023-11-15T02:36:29.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.554+0000 7f9272bf5700 1 -- start start 2023-11-15T02:36:29.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f9272bf5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f926c0a8ab0 0x7f926c1377f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f9272bf5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f926c13b990 0x7f926c0abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f9272bf5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f926c0ac3a0 0x7f926c139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f9272bf5700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0ac800 con 0x7f926c13b990 2023-11-15T02:36:29.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f9272bf5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0ad630 con 0x7f926c0ac3a0 2023-11-15T02:36:29.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f9272bf5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c151f00 con 0x7f926c0a8ab0 2023-11-15T02:36:29.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f926bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f926c13b990 0x7f926c0abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f926bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f926c13b990 0x7f926c0abeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43852/0 (socket says 172.21.15.1:43852) 2023-11-15T02:36:29.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f926bfff700 1 -- 172.21.15.1:0/681073549 learned_addr learned my addr 172.21.15.1:0/681073549 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:29.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f9270991700 1 --2- 172.21.15.1:0/681073549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f926c0a8ab0 0x7f926c1377f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f9271192700 1 --2- 172.21.15.1:0/681073549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f926c0ac3a0 0x7f926c139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f926bfff700 1 -- 172.21.15.1:0/681073549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f926c0a8ab0 msgr2=0x7f926c1377f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f926bfff700 1 --2- 172.21.15.1:0/681073549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f926c0a8ab0 0x7f926c1377f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f926bfff700 1 -- 172.21.15.1:0/681073549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f926c0ac3a0 msgr2=0x7f926c139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f926bfff700 1 --2- 172.21.15.1:0/681073549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f926c0ac3a0 0x7f926c139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f926bfff700 1 -- 172.21.15.1:0/681073549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9264009a20 con 0x7f926c13b990 2023-11-15T02:36:29.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.555+0000 7f926bfff700 1 --2- 172.21.15.1:0/681073549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f926c13b990 0x7f926c0abeb0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f925c00e960 tx=0x7f925c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:29.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.556+0000 7f9268ff9700 1 -- 172.21.15.1:0/681073549 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00c850 con 0x7f926c13b990 2023-11-15T02:36:29.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.556+0000 7f9268ff9700 1 -- 172.21.15.1:0/681073549 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c00c9b0 con 0x7f926c13b990 2023-11-15T02:36:29.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.556+0000 7f9272bf5700 1 -- 172.21.15.1:0/681073549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926c0aca20 con 0x7f926c13b990 2023-11-15T02:36:29.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.556+0000 7f9268ff9700 1 -- 172.21.15.1:0/681073549 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00cd30 con 0x7f926c13b990 2023-11-15T02:36:29.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.556+0000 7f9272bf5700 1 -- 172.21.15.1:0/681073549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926c0acfe0 con 0x7f926c13b990 2023-11-15T02:36:29.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.557+0000 7f9272bf5700 1 -- 172.21.15.1:0/681073549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926c06c7e0 con 0x7f926c13b990 2023-11-15T02:36:29.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.557+0000 7f9268ff9700 1 -- 172.21.15.1:0/681073549 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f925c012600 con 0x7f926c13b990 2023-11-15T02:36:29.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.557+0000 7f9268ff9700 1 --2- 172.21.15.1:0/681073549 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f924c05f270 0x7f924c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.557+0000 7f9268ff9700 1 -- 172.21.15.1:0/681073549 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6281+0+0 (secure 0 0 0) 0x7f925c07a9d0 con 0x7f926c13b990 2023-11-15T02:36:29.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.558+0000 7f9270991700 1 --2- 172.21.15.1:0/681073549 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f924c05f270 0x7f924c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.558+0000 7f9270991700 1 --2- 172.21.15.1:0/681073549 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f924c05f270 0x7f924c061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f9264009e60 tx=0x7f9264009780).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:29.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.561+0000 7f9268ff9700 1 -- 172.21.15.1:0/681073549 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f925c04ba80 con 0x7f926c13b990 2023-11-15T02:36:29.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.746+0000 7f9272bf5700 1 -- 172.21.15.1:0/681073549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f926c0c73f0 con 0x7f926c13b990 2023-11-15T02:36:29.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.749+0000 7f9268ff9700 1 -- 172.21.15.1:0/681073549 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v29) v1 ==== 120+0+0 (secure 0 0 0) 0x7f925c04f0a0 con 0x7f926c13b990 2023-11-15T02:36:29.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.751+0000 7f9272bf5700 1 -- 172.21.15.1:0/681073549 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f924c05f270 msgr2=0x7f924c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.751+0000 7f9272bf5700 1 --2- 172.21.15.1:0/681073549 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f924c05f270 0x7f924c061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f9264009e60 tx=0x7f9264009780).stop 2023-11-15T02:36:29.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.751+0000 7f9272bf5700 1 -- 172.21.15.1:0/681073549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f926c13b990 msgr2=0x7f926c0abeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.751+0000 7f9272bf5700 1 --2- 172.21.15.1:0/681073549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f926c13b990 0x7f926c0abeb0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f925c00e960 tx=0x7f925c009060).stop 2023-11-15T02:36:29.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.751+0000 7f9272bf5700 1 -- 172.21.15.1:0/681073549 shutdown_connections 2023-11-15T02:36:29.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.751+0000 7f9272bf5700 1 --2- 172.21.15.1:0/681073549 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f924c05f270 0x7f924c061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.751+0000 7f9272bf5700 1 --2- 172.21.15.1:0/681073549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f926c0ac3a0 0x7f926c139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.751+0000 7f9272bf5700 1 --2- 172.21.15.1:0/681073549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f926c0a8ab0 0x7f926c1377f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.751+0000 7f9272bf5700 1 --2- 172.21.15.1:0/681073549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f926c13b990 0x7f926c0abeb0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.751+0000 7f9272bf5700 1 -- 172.21.15.1:0/681073549 >> 172.21.15.1:0/681073549 conn(0x7f926c063280 msgr2=0x7f926c138730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:29.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.752+0000 7f9272bf5700 1 -- 172.21.15.1:0/681073549 shutdown_connections 2023-11-15T02:36:29.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.752+0000 7f9272bf5700 1 -- 172.21.15.1:0/681073549 wait complete. 2023-11-15T02:36:29.764 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-11-15T02:36:29.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.882+0000 7f6eee86a700 1 Processor -- start 2023-11-15T02:36:29.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.882+0000 7f6eee86a700 1 -- start start 2023-11-15T02:36:29.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.882+0000 7f6eee86a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee8154450 0x7f6ee80a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.882+0000 7f6eee86a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee80a85e0 con 0x7f6ee80833a0 2023-11-15T02:36:29.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6eee86a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee8065660 con 0x7f6ee80be520 2023-11-15T02:36:29.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6eee86a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee8065940 con 0x7f6ee8154450 2023-11-15T02:36:29.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee77fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6ee80833a0 0x7f6ee80bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41142/0 (socket says 172.21.15.1:41142) 2023-11-15T02:36:29.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee77fe700 1 -- 172.21.15.1:0/2060564671 learned_addr learned my addr 172.21.15.1:0/2060564671 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:29.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee7fff700 1 --2- 172.21.15.1:0/2060564671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee8154450 0x7f6ee80a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975438169 0 0) 0x7f6ee80a85e0 con 0x7f6ee80833a0 2023-11-15T02:36:29.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ed00033f0 con 0x7f6ee80833a0 2023-11-15T02:36:29.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942916285 0 0) 0x7f6ee8065660 con 0x7f6ee80be520 2023-11-15T02:36:29.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ee80a85e0 con 0x7f6ee80be520 2023-11-15T02:36:29.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 205335019 0 0) 0x7f6ed00033f0 con 0x7f6ee80833a0 2023-11-15T02:36:29.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee8154450 msgr2=0x7f6ee80a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:29.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 --2- 172.21.15.1:0/2060564671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee8154450 0x7f6ee80a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 >> v1:172.21.15.141:6789/0 conn(0x7f6ee80be520 legacy=0x7f6ee80c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee80c6f50 con 0x7f6ee80833a0 2023-11-15T02:36:29.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f6ed8001470 con 0x7f6ee80833a0 2023-11-15T02:36:29.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 >> v1:172.21.15.1:6789/0 conn(0x7f6ee80833a0 legacy=0x7f6ee80bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 --2- 172.21.15.1:0/2060564671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ed0003aa0 0x7f6ed0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 --2- 172.21.15.1:0/2060564671 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ed0004690 0x7f6ed0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 --2- 172.21.15.1:0/2060564671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee8154450 0x7f6ed0005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee8065940 con 0x7f6ed0003aa0 2023-11-15T02:36:29.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed000b990 con 0x7f6ed0004690 2023-11-15T02:36:29.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.883+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed000bb20 con 0x7f6ee8154450 2023-11-15T02:36:29.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.884+0000 7f6ee7fff700 1 --2- 172.21.15.1:0/2060564671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ed0003aa0 0x7f6ed0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.884+0000 7f6ee77fe700 1 --2- 172.21.15.1:0/2060564671 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ed0004690 0x7f6ed0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.884+0000 7f6eece07700 1 --2- 172.21.15.1:0/2060564671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee8154450 0x7f6ed0005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.884+0000 7f6ee7fff700 1 -- 172.21.15.1:0/2060564671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee8154450 msgr2=0x7f6ed0005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:29.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.884+0000 7f6ee7fff700 1 --2- 172.21.15.1:0/2060564671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee8154450 0x7f6ed0005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.884+0000 7f6ee7fff700 1 -- 172.21.15.1:0/2060564671 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ed0004690 msgr2=0x7f6ed0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:29.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.884+0000 7f6ee7fff700 1 --2- 172.21.15.1:0/2060564671 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ed0004690 0x7f6ed0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.884+0000 7f6ee7fff700 1 -- 172.21.15.1:0/2060564671 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed00033f0 con 0x7f6ed0003aa0 2023-11-15T02:36:29.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.884+0000 7f6ee7fff700 1 --2- 172.21.15.1:0/2060564671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ed0003aa0 0x7f6ed0003ea0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f6edc009aa0 tx=0x7f6edc006f40).ready entity=mon.0 client_cookie=ef70030b87f3085 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:29.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.884+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc009430 con 0x7f6ed0003aa0 2023-11-15T02:36:29.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.884+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc00e640 con 0x7f6ed0003aa0 2023-11-15T02:36:29.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.884+0000 7f6ee6ffd700 1 -- 172.21.15.1:0/2060564671 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc00e9c0 con 0x7f6ed0003aa0 2023-11-15T02:36:29.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.885+0000 7f6eee86a700 1 -- 172.21.15.1:0/2060564671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ed0003aa0 msgr2=0x7f6ed0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.885+0000 7f6eee86a700 1 --2- 172.21.15.1:0/2060564671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ed0003aa0 0x7f6ed0003ea0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f6edc009aa0 tx=0x7f6edc006f40).stop 2023-11-15T02:36:29.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.885+0000 7f6eece07700 1 -- 172.21.15.1:0/2060564671 reap_dead start 2023-11-15T02:36:29.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.885+0000 7f6eee86a700 1 -- 172.21.15.1:0/2060564671 shutdown_connections 2023-11-15T02:36:29.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.885+0000 7f6eee86a700 1 -- 172.21.15.1:0/2060564671 >> 172.21.15.1:0/2060564671 conn(0x7f6ee8082f90 msgr2=0x7f6ee80c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:29.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.885+0000 7f6eee86a700 1 -- 172.21.15.1:0/2060564671 shutdown_connections 2023-11-15T02:36:29.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.885+0000 7f6eee86a700 1 -- 172.21.15.1:0/2060564671 wait complete. 2023-11-15T02:36:29.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.886+0000 7f6eee86a700 1 Processor -- start 2023-11-15T02:36:29.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.886+0000 7f6eee86a700 1 -- start start 2023-11-15T02:36:29.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6eee86a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ed0003aa0 0x7f6ee80c0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6eee86a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8167eb0 0x7f6ee814fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6eee86a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee8165ab0 0x7f6ee80668e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6eee86a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee8164a00 con 0x7f6ee8167eb0 2023-11-15T02:36:29.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6eee86a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80c01e0 con 0x7f6ee8165ab0 2023-11-15T02:36:29.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6eee86a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee81683b0 con 0x7f6ed0003aa0 2023-11-15T02:36:29.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6ee77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8167eb0 0x7f6ee814fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6ee77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8167eb0 0x7f6ee814fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43870/0 (socket says 172.21.15.1:43870) 2023-11-15T02:36:29.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6ee77fe700 1 -- 172.21.15.1:0/3963010108 learned_addr learned my addr 172.21.15.1:0/3963010108 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:29.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6ee7fff700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ed0003aa0 0x7f6ee80c0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6eece07700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee8165ab0 0x7f6ee80668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6ee77fe700 1 -- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ed0003aa0 msgr2=0x7f6ee80c0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6ee77fe700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ed0003aa0 0x7f6ee80c0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6ee77fe700 1 -- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee8165ab0 msgr2=0x7f6ee80668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:29.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6ee77fe700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee8165ab0 0x7f6ee80668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:29.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6ee77fe700 1 -- 172.21.15.1:0/3963010108 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8168690 con 0x7f6ee8167eb0 2023-11-15T02:36:29.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6ee7fff700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ed0003aa0 0x7f6ee80c0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:29.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6eece07700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee8165ab0 0x7f6ee80668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:29.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6ee77fe700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8167eb0 0x7f6ee814fd90 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f6ed8001120 tx=0x7f6ed8001d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:29.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6ecffff700 1 -- 172.21.15.1:0/3963010108 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8011590 con 0x7f6ee8167eb0 2023-11-15T02:36:29.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6ecffff700 1 -- 172.21.15.1:0/3963010108 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed80116f0 con 0x7f6ee8167eb0 2023-11-15T02:36:29.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6eee86a700 1 -- 172.21.15.1:0/3963010108 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee8168970 con 0x7f6ee8167eb0 2023-11-15T02:36:29.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6ecffff700 1 -- 172.21.15.1:0/3963010108 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8011a70 con 0x7f6ee8167eb0 2023-11-15T02:36:29.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.887+0000 7f6eee86a700 1 -- 172.21.15.1:0/3963010108 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee80c0af0 con 0x7f6ee8167eb0 2023-11-15T02:36:29.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.889+0000 7f6eee86a700 1 -- 172.21.15.1:0/3963010108 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee806c7e0 con 0x7f6ee8167eb0 2023-11-15T02:36:29.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.889+0000 7f6ecffff700 1 -- 172.21.15.1:0/3963010108 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6ed801d3b0 con 0x7f6ee8167eb0 2023-11-15T02:36:29.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.889+0000 7f6ecffff700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ed405f270 0x7f6ed4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:29.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.889+0000 7f6ecffff700 1 -- 172.21.15.1:0/3963010108 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6281+0+0 (secure 0 0 0) 0x7f6ed807a020 con 0x7f6ee8167eb0 2023-11-15T02:36:29.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.889+0000 7f6ee7fff700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ed405f270 0x7f6ed4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:29.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.890+0000 7f6ee7fff700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ed405f270 0x7f6ed4061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6edc006fa0 tx=0x7f6edc01a000).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:29.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:29.893+0000 7f6ecffff700 1 -- 172.21.15.1:0/3963010108 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6ed804b070 con 0x7f6ee8167eb0 2023-11-15T02:36:30.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:30.135+0000 7f6eee86a700 1 -- 172.21.15.1:0/3963010108 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7f6ee8065350 con 0x7f6ee8167eb0 2023-11-15T02:36:30.970 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:36:30.973 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:36:31.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.093+0000 7f6ecffff700 1 -- 172.21.15.1:0/3963010108 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v2403) v1 ==== 178+0+0 (secure 0 0 0) 0x7f6ed8019030 con 0x7f6ee8167eb0 2023-11-15T02:36:31.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.095+0000 7f6eee86a700 1 -- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ed405f270 msgr2=0x7f6ed4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:31.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.095+0000 7f6eee86a700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ed405f270 0x7f6ed4061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6edc006fa0 tx=0x7f6edc01a000).stop 2023-11-15T02:36:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.095+0000 7f6eee86a700 1 -- 172.21.15.1:0/3963010108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8167eb0 msgr2=0x7f6ee814fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.095+0000 7f6eee86a700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8167eb0 0x7f6ee814fd90 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f6ed8001120 tx=0x7f6ed8001d60).stop 2023-11-15T02:36:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.095+0000 7f6eee86a700 1 -- 172.21.15.1:0/3963010108 shutdown_connections 2023-11-15T02:36:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.095+0000 7f6eee86a700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ed405f270 0x7f6ed4061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.095+0000 7f6eee86a700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee8165ab0 0x7f6ee80668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.095+0000 7f6eee86a700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ed0003aa0 0x7f6ee80c0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.095+0000 7f6eee86a700 1 --2- 172.21.15.1:0/3963010108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8167eb0 0x7f6ee814fd90 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.095+0000 7f6eee86a700 1 -- 172.21.15.1:0/3963010108 >> 172.21.15.1:0/3963010108 conn(0x7f6ee8082f90 msgr2=0x7f6ee80678e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.095+0000 7f6eee86a700 1 -- 172.21.15.1:0/3963010108 shutdown_connections 2023-11-15T02:36:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.095+0000 7f6eee86a700 1 -- 172.21.15.1:0/3963010108 wait complete. 2023-11-15T02:36:31.111 INFO:tasks.cephfs_test_runner:Test that number of snaps retained are as per user spec. ... ok 2023-11-15T02:36:31.111 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-11-15T02:36:31.111 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-15T02:36:31.112 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-11-15T02:36:31.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.236+0000 7fd29997b700 1 Processor -- start 2023-11-15T02:36:31.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.236+0000 7fd29997b700 1 -- start start 2023-11-15T02:36:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.237+0000 7fd29997b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd294150660 0x7fd2940c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.237+0000 7fd29997b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd2940c2260 0x7fd2940c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.237+0000 7fd29997b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd294063460 con 0x7fd294150280 2023-11-15T02:36:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.237+0000 7fd29997b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2940c26f0 con 0x7fd2940c2260 2023-11-15T02:36:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.237+0000 7fd29997b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd294062850 con 0x7fd294150660 2023-11-15T02:36:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.237+0000 7fd2937fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd2940c2260 0x7fd2940c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.237+0000 7fd292ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd294150280 0x7fd2940638f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41146/0 (socket says 172.21.15.1:41146) 2023-11-15T02:36:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.237+0000 7fd292ffd700 1 -- 172.21.15.1:0/1163208711 learned_addr learned my addr 172.21.15.1:0/1163208711 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.238+0000 7fd2937fe700 1 -- 172.21.15.1:0/1163208711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd294150660 msgr2=0x7fd2940c1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.238+0000 7fd2937fe700 1 --2- 172.21.15.1:0/1163208711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd294150660 0x7fd2940c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.238+0000 7fd2937fe700 1 -- 172.21.15.1:0/1163208711 >> v1:172.21.15.1:6789/0 conn(0x7fd294150280 legacy=0x7fd2940638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.238+0000 7fd2937fe700 1 -- 172.21.15.1:0/1163208711 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd294062b30 con 0x7fd2940c2260 2023-11-15T02:36:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.238+0000 7fd291ffb700 1 -- 172.21.15.1:0/1163208711 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410372135 0 0) 0x7fd294063460 con 0x7fd294150280 2023-11-15T02:36:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.238+0000 7fd2937fe700 1 --2- 172.21.15.1:0/1163208711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2940c2260 0x7fd2940c55c0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7fd284009e60 tx=0x7fd284009780).ready entity=mon.0 client_cookie=82b025d56a49402a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:31.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.238+0000 7fd291ffb700 1 -- 172.21.15.1:0/1163208711 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28400e070 con 0x7fd2940c2260 2023-11-15T02:36:31.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.238+0000 7fd291ffb700 1 -- 172.21.15.1:0/1163208711 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28400bc30 con 0x7fd2940c2260 2023-11-15T02:36:31.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.238+0000 7fd291ffb700 1 -- 172.21.15.1:0/1163208711 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284012410 con 0x7fd2940c2260 2023-11-15T02:36:31.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.238+0000 7fd29997b700 1 -- 172.21.15.1:0/1163208711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2940c2260 msgr2=0x7fd2940c55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:31.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.238+0000 7fd29997b700 1 --2- 172.21.15.1:0/1163208711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2940c2260 0x7fd2940c55c0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7fd284009e60 tx=0x7fd284009780).stop 2023-11-15T02:36:31.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.239+0000 7fd29997b700 1 -- 172.21.15.1:0/1163208711 shutdown_connections 2023-11-15T02:36:31.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.239+0000 7fd29997b700 1 --2- 172.21.15.1:0/1163208711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2940c2260 0x7fd2940c55c0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:31.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.239+0000 7fd29997b700 1 --2- 172.21.15.1:0/1163208711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd294150660 0x7fd2940c1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:31.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.239+0000 7fd29997b700 1 -- 172.21.15.1:0/1163208711 >> 172.21.15.1:0/1163208711 conn(0x7fd2940c3e30 msgr2=0x7fd2940c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:31.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.239+0000 7fd29997b700 1 -- 172.21.15.1:0/1163208711 shutdown_connections 2023-11-15T02:36:31.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.239+0000 7fd29997b700 1 -- 172.21.15.1:0/1163208711 wait complete. 2023-11-15T02:36:31.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.240+0000 7fd29997b700 1 Processor -- start 2023-11-15T02:36:31.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.240+0000 7fd29997b700 1 -- start start 2023-11-15T02:36:31.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd29997b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2940c2260 0x7fd2940a9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:31.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd29997b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd294150280 0x7fd294142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:31.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd29997b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd294150660 0x7fd2940a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:31.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd29997b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd294143450 con 0x7fd2940c2260 2023-11-15T02:36:31.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd29997b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2940a9400 con 0x7fd294150280 2023-11-15T02:36:31.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd29997b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2940a87f0 con 0x7fd294150660 2023-11-15T02:36:31.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd292ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2940c2260 0x7fd2940a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:31.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd292ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2940c2260 0x7fd2940a9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43892/0 (socket says 172.21.15.1:43892) 2023-11-15T02:36:31.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd292ffd700 1 -- 172.21.15.1:0/642464983 learned_addr learned my addr 172.21.15.1:0/642464983 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:31.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd292ffd700 1 -- 172.21.15.1:0/642464983 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd294150660 msgr2=0x7fd2940a7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:31.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd2937fe700 1 --2- 172.21.15.1:0/642464983 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd294150660 0x7fd2940a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:31.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd292ffd700 1 --2- 172.21.15.1:0/642464983 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd294150660 0x7fd2940a7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:31.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd2927fc700 1 --2- 172.21.15.1:0/642464983 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd294150280 0x7fd294142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:31.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd292ffd700 1 -- 172.21.15.1:0/642464983 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd294150280 msgr2=0x7fd294142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:31.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd292ffd700 1 --2- 172.21.15.1:0/642464983 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd294150280 0x7fd294142f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:31.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd292ffd700 1 -- 172.21.15.1:0/642464983 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284009a20 con 0x7fd2940c2260 2023-11-15T02:36:31.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd292ffd700 1 --2- 172.21.15.1:0/642464983 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2940c2260 0x7fd2940a9890 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fd28c00c4c0 tx=0x7fd28c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:31.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd28affd700 1 -- 172.21.15.1:0/642464983 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0072e0 con 0x7fd2940c2260 2023-11-15T02:36:31.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd28affd700 1 -- 172.21.15.1:0/642464983 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c007440 con 0x7fd2940c2260 2023-11-15T02:36:31.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd29997b700 1 -- 172.21.15.1:0/642464983 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2940a8ad0 con 0x7fd2940c2260 2023-11-15T02:36:31.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd28affd700 1 -- 172.21.15.1:0/642464983 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0057a0 con 0x7fd2940c2260 2023-11-15T02:36:31.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.241+0000 7fd29997b700 1 -- 172.21.15.1:0/642464983 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2940a9090 con 0x7fd2940c2260 2023-11-15T02:36:31.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.243+0000 7fd29997b700 1 -- 172.21.15.1:0/642464983 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2940a96e0 con 0x7fd2940c2260 2023-11-15T02:36:31.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.243+0000 7fd28affd700 1 -- 172.21.15.1:0/642464983 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd28c005b90 con 0x7fd2940c2260 2023-11-15T02:36:31.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.243+0000 7fd28affd700 1 --2- 172.21.15.1:0/642464983 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd27405f270 0x7fd274061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:31.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.243+0000 7fd28affd700 1 -- 172.21.15.1:0/642464983 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6281+0+0 (secure 0 0 0) 0x7fd28c079d20 con 0x7fd2940c2260 2023-11-15T02:36:31.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.243+0000 7fd2927fc700 1 --2- 172.21.15.1:0/642464983 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd27405f270 0x7fd274061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:31.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.244+0000 7fd2927fc700 1 --2- 172.21.15.1:0/642464983 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd27405f270 0x7fd274061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fd2940acc20 tx=0x7fd27c008040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:31.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.247+0000 7fd28affd700 1 -- 172.21.15.1:0/642464983 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd28c04add0 con 0x7fd2940c2260 2023-11-15T02:36:31.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:31.492+0000 7fd29997b700 1 -- 172.21.15.1:0/642464983 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7fd2940475e0 con 0x7fd2940c2260 2023-11-15T02:36:32.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.095+0000 7fd28affd700 1 -- 172.21.15.1:0/642464983 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2404) v1 ==== 177+0+0 (secure 0 0 0) 0x7fd28c018030 con 0x7fd2940c2260 2023-11-15T02:36:32.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.097+0000 7fd29997b700 1 -- 172.21.15.1:0/642464983 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd27405f270 msgr2=0x7fd274061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:32.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.097+0000 7fd29997b700 1 --2- 172.21.15.1:0/642464983 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd27405f270 0x7fd274061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fd2940acc20 tx=0x7fd27c008040).stop 2023-11-15T02:36:32.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.097+0000 7fd29997b700 1 -- 172.21.15.1:0/642464983 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2940c2260 msgr2=0x7fd2940a9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:32.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.097+0000 7fd29997b700 1 --2- 172.21.15.1:0/642464983 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2940c2260 0x7fd2940a9890 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fd28c00c4c0 tx=0x7fd28c007c10).stop 2023-11-15T02:36:32.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.097+0000 7fd29997b700 1 -- 172.21.15.1:0/642464983 shutdown_connections 2023-11-15T02:36:32.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.097+0000 7fd29997b700 1 --2- 172.21.15.1:0/642464983 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd27405f270 0x7fd274061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.097+0000 7fd29997b700 1 --2- 172.21.15.1:0/642464983 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd294150660 0x7fd2940a7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.097+0000 7fd29997b700 1 --2- 172.21.15.1:0/642464983 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2940c2260 0x7fd2940a9890 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.097+0000 7fd29997b700 1 --2- 172.21.15.1:0/642464983 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd294150280 0x7fd294142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.097+0000 7fd29997b700 1 -- 172.21.15.1:0/642464983 >> 172.21.15.1:0/642464983 conn(0x7fd2940c3e30 msgr2=0x7fd2940638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:32.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.097+0000 7fd29997b700 1 -- 172.21.15.1:0/642464983 shutdown_connections 2023-11-15T02:36:32.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.097+0000 7fd29997b700 1 -- 172.21.15.1:0/642464983 wait complete. 2023-11-15T02:36:32.111 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-15T02:36:32.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.234+0000 7f53f6b97700 1 Processor -- start 2023-11-15T02:36:32.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.234+0000 7f53f6b97700 1 -- start start 2023-11-15T02:36:32.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.235+0000 7f53f6b97700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f53f01541d0 0x7f53f01545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:32.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.235+0000 7f53f6b97700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f53f00c8170 0x7f53f00c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:32.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.235+0000 7f53f6b97700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f0155830 con 0x7f53f00c60d0 2023-11-15T02:36:32.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.235+0000 7f53f6b97700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f0158f40 con 0x7f53f01541d0 2023-11-15T02:36:32.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.235+0000 7f53f6b97700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f0154c20 con 0x7f53f00c8170 2023-11-15T02:36:32.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.235+0000 7f53f5b95700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f53f01541d0 0x7f53f01545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:32.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.235+0000 7f53f5b95700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f53f01541d0 0x7f53f01545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43908/0 (socket says 172.21.15.1:43908) 2023-11-15T02:36:32.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.235+0000 7f53f5b95700 1 -- 172.21.15.1:0/323543584 learned_addr learned my addr 172.21.15.1:0/323543584 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:32.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.235+0000 7f53f6396700 1 --2- 172.21.15.1:0/323543584 >> v2:172.21.15.141:3300/0 conn(0x7f53f00c8170 0x7f53f00c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:32.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.235+0000 7f53f5b95700 1 -- 172.21.15.1:0/323543584 >> v2:172.21.15.141:3300/0 conn(0x7f53f00c8170 msgr2=0x7f53f00c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:32.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.235+0000 7f53f5b95700 1 --2- 172.21.15.1:0/323543584 >> v2:172.21.15.141:3300/0 conn(0x7f53f00c8170 0x7f53f00c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.235+0000 7f53f5b95700 1 -- 172.21.15.1:0/323543584 >> v1:172.21.15.141:6789/0 conn(0x7f53f00c60d0 legacy=0x7f53f00c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:32.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.235+0000 7f53f5b95700 1 -- 172.21.15.1:0/323543584 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f0154f00 con 0x7f53f01541d0 2023-11-15T02:36:32.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.235+0000 7f53f5b95700 1 --2- 172.21.15.1:0/323543584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53f01541d0 0x7f53f01545b0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f53f00c56d0 tx=0x7f53ec0090f0).ready entity=mon.0 client_cookie=e706bf2abbc9c0e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:32.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.235+0000 7f53f4b93700 1 -- 172.21.15.1:0/323543584 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec00b520 con 0x7f53f01541d0 2023-11-15T02:36:32.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.236+0000 7f53f4b93700 1 -- 172.21.15.1:0/323543584 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec00b680 con 0x7f53f01541d0 2023-11-15T02:36:32.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.236+0000 7f53f4b93700 1 -- 172.21.15.1:0/323543584 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec00ba00 con 0x7f53f01541d0 2023-11-15T02:36:32.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.236+0000 7f53f6b97700 1 -- 172.21.15.1:0/323543584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53f01541d0 msgr2=0x7f53f01545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:32.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.236+0000 7f53f6b97700 1 --2- 172.21.15.1:0/323543584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53f01541d0 0x7f53f01545b0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f53f00c56d0 tx=0x7f53ec0090f0).stop 2023-11-15T02:36:32.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.236+0000 7f53f6b97700 1 -- 172.21.15.1:0/323543584 shutdown_connections 2023-11-15T02:36:32.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.236+0000 7f53f6b97700 1 --2- 172.21.15.1:0/323543584 >> v2:172.21.15.141:3300/0 conn(0x7f53f00c8170 0x7f53f00c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.236+0000 7f53f6b97700 1 --2- 172.21.15.1:0/323543584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53f01541d0 0x7f53f01545b0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.236+0000 7f53f6b97700 1 -- 172.21.15.1:0/323543584 >> 172.21.15.1:0/323543584 conn(0x7f53f0069ee0 msgr2=0x7f53f006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:32.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.236+0000 7f53f6b97700 1 -- 172.21.15.1:0/323543584 shutdown_connections 2023-11-15T02:36:32.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.236+0000 7f53f6b97700 1 -- 172.21.15.1:0/323543584 wait complete. 2023-11-15T02:36:32.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.237+0000 7f53f6b97700 1 Processor -- start 2023-11-15T02:36:32.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.237+0000 7f53f6b97700 1 -- start start 2023-11-15T02:36:32.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f6b97700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f53f00c60d0 0x7f53f0164630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:32.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f6b97700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53f00c8170 0x7f53f00af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:32.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f6b97700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53f01541d0 0x7f53f0156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:32.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f6b97700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f00ae330 con 0x7f53f01541d0 2023-11-15T02:36:32.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f6b97700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f00af150 con 0x7f53f00c60d0 2023-11-15T02:36:32.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f6b97700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f00ae540 con 0x7f53f00c8170 2023-11-15T02:36:32.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f6396700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53f01541d0 0x7f53f0156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:32.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f6396700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53f01541d0 0x7f53f0156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43912/0 (socket says 172.21.15.1:43912) 2023-11-15T02:36:32.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f6396700 1 -- 172.21.15.1:0/974917402 learned_addr learned my addr 172.21.15.1:0/974917402 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:32.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f5b95700 1 --2- 172.21.15.1:0/974917402 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f53f00c60d0 0x7f53f0164630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:32.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f5394700 1 --2- 172.21.15.1:0/974917402 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53f00c8170 0x7f53f00af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:32.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f6396700 1 -- 172.21.15.1:0/974917402 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53f00c8170 msgr2=0x7f53f00af5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:32.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f6396700 1 --2- 172.21.15.1:0/974917402 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53f00c8170 0x7f53f00af5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f6396700 1 -- 172.21.15.1:0/974917402 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f53f00c60d0 msgr2=0x7f53f0164630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:32.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f6396700 1 --2- 172.21.15.1:0/974917402 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f53f00c60d0 0x7f53f0164630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f6396700 1 -- 172.21.15.1:0/974917402 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec009370 con 0x7f53f01541d0 2023-11-15T02:36:32.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f5394700 1 --2- 172.21.15.1:0/974917402 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53f00c8170 0x7f53f00af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:32.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.238+0000 7f53f6396700 1 --2- 172.21.15.1:0/974917402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53f01541d0 0x7f53f0156bf0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f53e8009e90 tx=0x7f53e800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:32.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.239+0000 7f53e5ffb700 1 -- 172.21.15.1:0/974917402 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e800caf0 con 0x7f53f01541d0 2023-11-15T02:36:32.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.239+0000 7f53e5ffb700 1 -- 172.21.15.1:0/974917402 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e800f040 con 0x7f53f01541d0 2023-11-15T02:36:32.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.239+0000 7f53f6b97700 1 -- 172.21.15.1:0/974917402 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f00ae820 con 0x7f53f01541d0 2023-11-15T02:36:32.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.239+0000 7f53e5ffb700 1 -- 172.21.15.1:0/974917402 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e800ce60 con 0x7f53f01541d0 2023-11-15T02:36:32.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.239+0000 7f53f6b97700 1 -- 172.21.15.1:0/974917402 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f00aede0 con 0x7f53f01541d0 2023-11-15T02:36:32.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.240+0000 7f53f6b97700 1 -- 172.21.15.1:0/974917402 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f00475e0 con 0x7f53f01541d0 2023-11-15T02:36:32.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.240+0000 7f53e5ffb700 1 -- 172.21.15.1:0/974917402 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f53e8013610 con 0x7f53f01541d0 2023-11-15T02:36:32.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.241+0000 7f53e5ffb700 1 --2- 172.21.15.1:0/974917402 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f53d405f270 0x7f53d4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:32.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.241+0000 7f53e5ffb700 1 -- 172.21.15.1:0/974917402 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6281+0+0 (secure 0 0 0) 0x7f53e807acf0 con 0x7f53f01541d0 2023-11-15T02:36:32.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.241+0000 7f53f5b95700 1 --2- 172.21.15.1:0/974917402 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f53d405f270 0x7f53d4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:32.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.241+0000 7f53f5b95700 1 --2- 172.21.15.1:0/974917402 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f53d405f270 0x7f53d4061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f53ec009130 tx=0x7f53ec017000).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:32.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.245+0000 7f53e5ffb700 1 -- 172.21.15.1:0/974917402 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f53e804f7d0 con 0x7f53f01541d0 2023-11-15T02:36:32.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.415+0000 7f53f6b97700 1 -- 172.21.15.1:0/974917402 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f53f01551e0 con 0x7f53f01541d0 2023-11-15T02:36:32.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.419+0000 7f53e5ffb700 1 -- 172.21.15.1:0/974917402 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f53e804f3c0 con 0x7f53f01541d0 2023-11-15T02:36:32.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.421+0000 7f53f6b97700 1 -- 172.21.15.1:0/974917402 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f53d405f270 msgr2=0x7f53d4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:32.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.421+0000 7f53f6b97700 1 --2- 172.21.15.1:0/974917402 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f53d405f270 0x7f53d4061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f53ec009130 tx=0x7f53ec017000).stop 2023-11-15T02:36:32.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.421+0000 7f53f6b97700 1 -- 172.21.15.1:0/974917402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53f01541d0 msgr2=0x7f53f0156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:32.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.421+0000 7f53f6b97700 1 --2- 172.21.15.1:0/974917402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53f01541d0 0x7f53f0156bf0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f53e8009e90 tx=0x7f53e800b040).stop 2023-11-15T02:36:32.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.421+0000 7f53f6b97700 1 -- 172.21.15.1:0/974917402 shutdown_connections 2023-11-15T02:36:32.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.421+0000 7f53f6b97700 1 --2- 172.21.15.1:0/974917402 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f53d405f270 0x7f53d4061730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.421+0000 7f53f6b97700 1 --2- 172.21.15.1:0/974917402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53f01541d0 0x7f53f0156bf0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.421+0000 7f53f6b97700 1 --2- 172.21.15.1:0/974917402 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f53f00c60d0 0x7f53f0164630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.421+0000 7f53f6b97700 1 --2- 172.21.15.1:0/974917402 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53f00c8170 0x7f53f00af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.421+0000 7f53f6b97700 1 -- 172.21.15.1:0/974917402 >> 172.21.15.1:0/974917402 conn(0x7f53f0069ee0 msgr2=0x7f53f00c08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:32.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.421+0000 7f53f6b97700 1 -- 172.21.15.1:0/974917402 shutdown_connections 2023-11-15T02:36:32.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.421+0000 7f53f6b97700 1 -- 172.21.15.1:0/974917402 wait complete. 2023-11-15T02:36:32.434 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T02:36:32.434 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:36:32.480 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:36:32.527 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T02:36:32.528 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-15T02:36:32.528 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:36:32.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.646+0000 7fb26b7b1700 1 Processor -- start 2023-11-15T02:36:32.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.647+0000 7fb26b7b1700 1 -- start start 2023-11-15T02:36:32.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.647+0000 7fb26b7b1700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb264154450 0x7fb2640a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:32.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.647+0000 7fb26b7b1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2640be520 0x7fb264154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:32.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.647+0000 7fb26b7b1700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2640a85e0 con 0x7fb2640833a0 2023-11-15T02:36:32.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.647+0000 7fb26b7b1700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb264065940 con 0x7fb264154450 2023-11-15T02:36:32.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.647+0000 7fb26b7b1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb264065660 con 0x7fb2640be520 2023-11-15T02:36:32.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.647+0000 7fb268d4c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb2640833a0 0x7fb2640bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41162/0 (socket says 172.21.15.1:41162) 2023-11-15T02:36:32.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb268d4c700 1 -- 172.21.15.1:0/3527086512 learned_addr learned my addr 172.21.15.1:0/3527086512 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:32.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb269d4e700 1 --2- 172.21.15.1:0/3527086512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2640be520 0x7fb264154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:32.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb26954d700 1 --2- 172.21.15.1:0/3527086512 >> v2:172.21.15.141:3300/0 conn(0x7fb264154450 0x7fb2640a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:32.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 -- 172.21.15.1:0/3527086512 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927964726 0 0) 0x7fb2640a85e0 con 0x7fb2640833a0 2023-11-15T02:36:32.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 -- 172.21.15.1:0/3527086512 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb24c0033f0 con 0x7fb2640833a0 2023-11-15T02:36:32.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 -- 172.21.15.1:0/3527086512 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2555394898 0 0) 0x7fb24c0033f0 con 0x7fb2640833a0 2023-11-15T02:36:32.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 -- 172.21.15.1:0/3527086512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2640be520 msgr2=0x7fb264154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:32.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 --2- 172.21.15.1:0/3527086512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2640be520 0x7fb264154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 -- 172.21.15.1:0/3527086512 >> v2:172.21.15.141:3300/0 conn(0x7fb264154450 msgr2=0x7fb2640a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:32.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 --2- 172.21.15.1:0/3527086512 >> v2:172.21.15.141:3300/0 conn(0x7fb264154450 0x7fb2640a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 -- 172.21.15.1:0/3527086512 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2640c6f50 con 0x7fb2640833a0 2023-11-15T02:36:32.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 -- 172.21.15.1:0/3527086512 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fb258001470 con 0x7fb2640833a0 2023-11-15T02:36:32.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb26954d700 1 --2- 172.21.15.1:0/3527086512 >> v2:172.21.15.141:3300/0 conn(0x7fb264154450 0x7fb2640a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:32.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 -- 172.21.15.1:0/3527086512 >> v1:172.21.15.1:6789/0 conn(0x7fb2640833a0 legacy=0x7fb2640bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:32.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 --2- 172.21.15.1:0/3527086512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2640be520 0x7fb24c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:32.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 --2- 172.21.15.1:0/3527086512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb24c003e10 0x7fb24c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:32.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 --2- 172.21.15.1:0/3527086512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb24c004b80 0x7fb24c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:32.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 -- 172.21.15.1:0/3527086512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb264065940 con 0x7fb24c003e10 2023-11-15T02:36:32.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 -- 172.21.15.1:0/3527086512 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb264065660 con 0x7fb24c004b80 2023-11-15T02:36:32.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb263fff700 1 -- 172.21.15.1:0/3527086512 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c00b8e0 con 0x7fb2640be520 2023-11-15T02:36:32.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb268d4c700 1 --2- 172.21.15.1:0/3527086512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb24c003e10 0x7fb24c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:32.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb26954d700 1 --2- 172.21.15.1:0/3527086512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2640be520 0x7fb24c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:32.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.648+0000 7fb269d4e700 1 --2- 172.21.15.1:0/3527086512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb24c004b80 0x7fb24c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:32.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.649+0000 7fb268d4c700 1 -- 172.21.15.1:0/3527086512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2640be520 msgr2=0x7fb24c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:32.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.649+0000 7fb268d4c700 1 --2- 172.21.15.1:0/3527086512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2640be520 0x7fb24c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.649+0000 7fb268d4c700 1 -- 172.21.15.1:0/3527086512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb24c004b80 msgr2=0x7fb24c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:32.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.649+0000 7fb268d4c700 1 --2- 172.21.15.1:0/3527086512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb24c004b80 0x7fb24c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.649+0000 7fb268d4c700 1 -- 172.21.15.1:0/3527086512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c0033f0 con 0x7fb24c003e10 2023-11-15T02:36:32.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.649+0000 7fb268d4c700 1 --2- 172.21.15.1:0/3527086512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb24c003e10 0x7fb24c004690 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fb25800c240 tx=0x7fb258001e90).ready entity=mon.0 client_cookie=4ea36af85afb6c98 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:32.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.649+0000 7fb263fff700 1 -- 172.21.15.1:0/3527086512 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258007a60 con 0x7fb24c003e10 2023-11-15T02:36:32.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.649+0000 7fb263fff700 1 -- 172.21.15.1:0/3527086512 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25800cad0 con 0x7fb24c003e10 2023-11-15T02:36:32.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.649+0000 7fb263fff700 1 -- 172.21.15.1:0/3527086512 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25800ce50 con 0x7fb24c003e10 2023-11-15T02:36:32.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.649+0000 7fb26b7b1700 1 -- 172.21.15.1:0/3527086512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb24c003e10 msgr2=0x7fb24c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:32.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.649+0000 7fb26b7b1700 1 --2- 172.21.15.1:0/3527086512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb24c003e10 0x7fb24c004690 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fb25800c240 tx=0x7fb258001e90).stop 2023-11-15T02:36:32.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.649+0000 7fb269d4e700 1 -- 172.21.15.1:0/3527086512 reap_dead start 2023-11-15T02:36:32.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.649+0000 7fb26b7b1700 1 -- 172.21.15.1:0/3527086512 shutdown_connections 2023-11-15T02:36:32.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.649+0000 7fb26b7b1700 1 -- 172.21.15.1:0/3527086512 >> 172.21.15.1:0/3527086512 conn(0x7fb264082f90 msgr2=0x7fb2640c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:32.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.650+0000 7fb26b7b1700 1 -- 172.21.15.1:0/3527086512 shutdown_connections 2023-11-15T02:36:32.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.650+0000 7fb26b7b1700 1 -- 172.21.15.1:0/3527086512 wait complete. 2023-11-15T02:36:32.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.651+0000 7fb26b7b1700 1 Processor -- start 2023-11-15T02:36:32.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.651+0000 7fb26b7b1700 1 -- start start 2023-11-15T02:36:32.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.651+0000 7fb26b7b1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb24c003e10 0x7fb264145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:32.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb26b7b1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2641462b0 0x7fb2641657d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:32.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb26b7b1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb264165cc0 0x7fb264152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:32.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb26b7b1700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb264152610 con 0x7fb264165cc0 2023-11-15T02:36:32.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb26b7b1700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb264151a00 con 0x7fb2641462b0 2023-11-15T02:36:32.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb26b7b1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb264151ce0 con 0x7fb24c003e10 2023-11-15T02:36:32.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb269d4e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb264165cc0 0x7fb264152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:32.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb269d4e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb264165cc0 0x7fb264152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43930/0 (socket says 172.21.15.1:43930) 2023-11-15T02:36:32.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb269d4e700 1 -- 172.21.15.1:0/1402784680 learned_addr learned my addr 172.21.15.1:0/1402784680 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:32.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb268d4c700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2641462b0 0x7fb2641657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:32.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb26954d700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb24c003e10 0x7fb264145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:32.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb269d4e700 1 -- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb24c003e10 msgr2=0x7fb264145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:32.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb269d4e700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb24c003e10 0x7fb264145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb269d4e700 1 -- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2641462b0 msgr2=0x7fb2641657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:32.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb269d4e700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2641462b0 0x7fb2641657d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb269d4e700 1 -- 172.21.15.1:0/1402784680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb264151fc0 con 0x7fb264165cc0 2023-11-15T02:36:32.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb268d4c700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2641462b0 0x7fb2641657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:32.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb26954d700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb24c003e10 0x7fb264145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:32.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb269d4e700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb264165cc0 0x7fb264152aa0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fb2540094d0 tx=0x7fb25400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:32.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb2617fa700 1 -- 172.21.15.1:0/1402784680 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25400e040 con 0x7fb264165cc0 2023-11-15T02:36:32.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb2617fa700 1 -- 172.21.15.1:0/1402784680 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25400f040 con 0x7fb264165cc0 2023-11-15T02:36:32.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb2617fa700 1 -- 172.21.15.1:0/1402784680 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25400fe20 con 0x7fb264165cc0 2023-11-15T02:36:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb26b7b1700 1 -- 172.21.15.1:0/1402784680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2641522a0 con 0x7fb264165cc0 2023-11-15T02:36:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.652+0000 7fb26b7b1700 1 -- 172.21.15.1:0/1402784680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2641531d0 con 0x7fb264165cc0 2023-11-15T02:36:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.653+0000 7fb26b7b1700 1 -- 172.21.15.1:0/1402784680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb264063fa0 con 0x7fb264165cc0 2023-11-15T02:36:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.654+0000 7fb2617fa700 1 -- 172.21.15.1:0/1402784680 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb254015660 con 0x7fb264165cc0 2023-11-15T02:36:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.654+0000 7fb2617fa700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb25005f270 0x7fb250061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:32.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.654+0000 7fb2617fa700 1 -- 172.21.15.1:0/1402784680 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6281+0+0 (secure 0 0 0) 0x7fb25407af10 con 0x7fb264165cc0 2023-11-15T02:36:32.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.654+0000 7fb26954d700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb25005f270 0x7fb250061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:32.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.655+0000 7fb26954d700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb25005f270 0x7fb250061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb25c009220 tx=0x7fb25c008040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:32.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.658+0000 7fb2617fa700 1 -- 172.21.15.1:0/1402784680 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb25404bfc0 con 0x7fb264165cc0 2023-11-15T02:36:32.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.873+0000 7fb26b7b1700 1 -- 172.21.15.1:0/1402784680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb264065350 con 0x7fb264165cc0 2023-11-15T02:36:32.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.873+0000 7fb2617fa700 1 -- 172.21.15.1:0/1402784680 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fb25404f5e0 con 0x7fb264165cc0 2023-11-15T02:36:32.875 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:32.875 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":65,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/2941509435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":2941509435},{"type":"v1","addr":"172.21.15.141:6837","nonce":2941509435}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/698727670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":698727670},{"type":"v1","addr":"172.21.15.141:6836","nonce":698727670}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2035210342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2035210342},{"type":"v1","addr":"172.21.15.1:6834","nonce":2035210342}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2759266764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":2759266764},{"type":"v1","addr":"172.21.15.1:6835","nonce":2759266764}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[]} 2023-11-15T02:36:32.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.875+0000 7fb26b7b1700 1 -- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb25005f270 msgr2=0x7fb250061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:32.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.875+0000 7fb26b7b1700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb25005f270 0x7fb250061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb25c009220 tx=0x7fb25c008040).stop 2023-11-15T02:36:32.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.875+0000 7fb26b7b1700 1 -- 172.21.15.1:0/1402784680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb264165cc0 msgr2=0x7fb264152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:32.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.875+0000 7fb26b7b1700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb264165cc0 0x7fb264152aa0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fb2540094d0 tx=0x7fb25400b040).stop 2023-11-15T02:36:32.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.875+0000 7fb26b7b1700 1 -- 172.21.15.1:0/1402784680 shutdown_connections 2023-11-15T02:36:32.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.875+0000 7fb26b7b1700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb25005f270 0x7fb250061730 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.875+0000 7fb26b7b1700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb264165cc0 0x7fb264152aa0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.875+0000 7fb26b7b1700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb24c003e10 0x7fb264145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.875+0000 7fb26b7b1700 1 --2- 172.21.15.1:0/1402784680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2641462b0 0x7fb2641657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:32.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.875+0000 7fb26b7b1700 1 -- 172.21.15.1:0/1402784680 >> 172.21.15.1:0/1402784680 conn(0x7fb264082f90 msgr2=0x7fb264067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:32.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.875+0000 7fb26b7b1700 1 -- 172.21.15.1:0/1402784680 shutdown_connections 2023-11-15T02:36:32.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:32.875+0000 7fb26b7b1700 1 -- 172.21.15.1:0/1402784680 wait complete. 2023-11-15T02:36:32.879 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 65 2023-11-15T02:36:32.888 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-15T02:36:32.889 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-15T02:36:32.889 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-15T02:36:32.889 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:36:32.890 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-15T02:36:32.890 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-15T02:36:32.890 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-15T02:36:32.890 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:36:32.891 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-15T02:36:32.891 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-15T02:36:32.891 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-15T02:36:32.891 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:36:32.892 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-15T02:36:32.892 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-15T02:36:32.892 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-15T02:36:32.893 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:36:32.898 INFO:tasks.ceph.mds.a:Stopped 2023-11-15T02:36:32.899 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-15T02:36:32.900 INFO:tasks.ceph.mds.c:Stopped 2023-11-15T02:36:32.900 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-15T02:36:32.903 INFO:tasks.ceph.mds.b:Stopped 2023-11-15T02:36:32.903 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-15T02:36:32.904 INFO:tasks.ceph.mds.d:Stopped 2023-11-15T02:36:32.904 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-15T02:36:32.941 INFO:tasks.ceph.mds.a:Started 2023-11-15T02:36:32.941 DEBUG:teuthology.parallel:result is None 2023-11-15T02:36:32.942 INFO:tasks.ceph.mds.c:Started 2023-11-15T02:36:32.942 DEBUG:teuthology.parallel:result is None 2023-11-15T02:36:32.945 INFO:tasks.ceph.mds.b:Started 2023-11-15T02:36:32.945 DEBUG:teuthology.parallel:result is None 2023-11-15T02:36:32.946 INFO:tasks.ceph.mds.d:Started 2023-11-15T02:36:32.946 DEBUG:teuthology.parallel:result is None 2023-11-15T02:36:32.947 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-15T02:36:33.017 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-11-15T02:36:33.017 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T02:36:33.023 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T02:36:33.023 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-15T02:36:33.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.073+0000 7f02f6638700 1 Processor -- start 2023-11-15T02:36:33.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.073+0000 7f02f6638700 1 -- start start 2023-11-15T02:36:33.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.074+0000 7f02f6638700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f0154630 0x7f02f00a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:33.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.074+0000 7f02f6638700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f02f00aa4e0 0x7f02f00c9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:33.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.074+0000 7f02f6638700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f0158ff0 con 0x7f02f0154250 2023-11-15T02:36:33.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.074+0000 7f02f6638700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f00aa970 con 0x7f02f00aa4e0 2023-11-15T02:36:33.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.074+0000 7f02f6638700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f0158100 con 0x7f02f0154630 2023-11-15T02:36:33.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.074+0000 7f02f4bd5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f02f00aa4e0 0x7f02f00c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:33.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.074+0000 7f02f4bd5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f02f00aa4e0 0x7f02f00c9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43966/0 (socket says 172.21.15.1:43966) 2023-11-15T02:36:33.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.074+0000 7f02f4bd5700 1 -- 172.21.15.1:0/2930497181 learned_addr learned my addr 172.21.15.1:0/2930497181 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:33.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.074+0000 7f02ef7fe700 1 --2- 172.21.15.1:0/2930497181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f0154630 0x7f02f00a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:33.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.074+0000 7f02f4bd5700 1 -- 172.21.15.1:0/2930497181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f0154630 msgr2=0x7f02f00a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:33.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.074+0000 7f02f4bd5700 1 --2- 172.21.15.1:0/2930497181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f0154630 0x7f02f00a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:33.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.074+0000 7f02f4bd5700 1 -- 172.21.15.1:0/2930497181 >> v1:172.21.15.141:6789/0 conn(0x7f02f0154250 legacy=0x7f02f00c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:33.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.074+0000 7f02f4bd5700 1 -- 172.21.15.1:0/2930497181 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f01583e0 con 0x7f02f00aa4e0 2023-11-15T02:36:33.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.074+0000 7f02f4bd5700 1 --2- 172.21.15.1:0/2930497181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00aa4e0 0x7f02f00c9780 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f02e8009f20 tx=0x7f02e8009840).ready entity=mon.0 client_cookie=51d1008d99b3ebec server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:33.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.074+0000 7f02eeffd700 1 -- 172.21.15.1:0/2930497181 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800e070 con 0x7f02f00aa4e0 2023-11-15T02:36:33.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.075+0000 7f02eeffd700 1 -- 172.21.15.1:0/2930497181 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e800b9d0 con 0x7f02f00aa4e0 2023-11-15T02:36:33.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.075+0000 7f02eeffd700 1 -- 172.21.15.1:0/2930497181 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800bd50 con 0x7f02f00aa4e0 2023-11-15T02:36:33.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.075+0000 7f02f6638700 1 -- 172.21.15.1:0/2930497181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00aa4e0 msgr2=0x7f02f00c9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:33.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.075+0000 7f02f6638700 1 --2- 172.21.15.1:0/2930497181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00aa4e0 0x7f02f00c9780 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f02e8009f20 tx=0x7f02e8009840).stop 2023-11-15T02:36:33.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.075+0000 7f02f6638700 1 -- 172.21.15.1:0/2930497181 shutdown_connections 2023-11-15T02:36:33.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.075+0000 7f02f6638700 1 --2- 172.21.15.1:0/2930497181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00aa4e0 0x7f02f00c9780 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:33.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.075+0000 7f02f6638700 1 --2- 172.21.15.1:0/2930497181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f0154630 0x7f02f00a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:33.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.075+0000 7f02f6638700 1 -- 172.21.15.1:0/2930497181 >> 172.21.15.1:0/2930497181 conn(0x7f02f00c7b20 msgr2=0x7f02f00c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:33.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.075+0000 7f02f6638700 1 -- 172.21.15.1:0/2930497181 shutdown_connections 2023-11-15T02:36:33.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.075+0000 7f02f6638700 1 -- 172.21.15.1:0/2930497181 wait complete. 2023-11-15T02:36:33.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.076+0000 7f02f6638700 1 Processor -- start 2023-11-15T02:36:33.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.076+0000 7f02f6638700 1 -- start start 2023-11-15T02:36:33.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02f6638700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00aa4e0 0x7f02f00aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:33.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02f6638700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f0154250 0x7f02f00aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:33.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02f6638700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02f0154630 0x7f02f0063650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:33.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02f6638700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00b0130 con 0x7f02f00aa4e0 2023-11-15T02:36:33.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02f6638700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f01569a0 con 0x7f02f0154630 2023-11-15T02:36:33.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02f6638700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f0164940 con 0x7f02f0154250 2023-11-15T02:36:33.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02effff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00aa4e0 0x7f02f00aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:33.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02effff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00aa4e0 0x7f02f00aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43978/0 (socket says 172.21.15.1:43978) 2023-11-15T02:36:33.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02effff700 1 -- 172.21.15.1:0/3476175419 learned_addr learned my addr 172.21.15.1:0/3476175419 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:33.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02ef7fe700 1 --2- 172.21.15.1:0/3476175419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f0154250 0x7f02f00aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:33.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02f4bd5700 1 --2- 172.21.15.1:0/3476175419 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02f0154630 0x7f02f0063650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:33.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02effff700 1 -- 172.21.15.1:0/3476175419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f0154250 msgr2=0x7f02f00aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:33.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02effff700 1 --2- 172.21.15.1:0/3476175419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f0154250 0x7f02f00aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:33.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02effff700 1 -- 172.21.15.1:0/3476175419 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02f0154630 msgr2=0x7f02f0063650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:33.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02effff700 1 --2- 172.21.15.1:0/3476175419 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02f0154630 0x7f02f0063650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.077+0000 7f02effff700 1 -- 172.21.15.1:0/3476175419 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e8009ae0 con 0x7f02f00aa4e0 2023-11-15T02:36:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.078+0000 7f02effff700 1 --2- 172.21.15.1:0/3476175419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00aa4e0 0x7f02f00aea40 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f02e000c4c0 tx=0x7f02e0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.078+0000 7f02d7fff700 1 -- 172.21.15.1:0/3476175419 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e000ce70 con 0x7f02f00aa4e0 2023-11-15T02:36:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.078+0000 7f02d7fff700 1 -- 172.21.15.1:0/3476175419 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e0001e90 con 0x7f02f00aa4e0 2023-11-15T02:36:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.078+0000 7f02f6638700 1 -- 172.21.15.1:0/3476175419 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f00af5b0 con 0x7f02f00aa4e0 2023-11-15T02:36:33.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.078+0000 7f02d7fff700 1 -- 172.21.15.1:0/3476175419 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0007250 con 0x7f02f00aa4e0 2023-11-15T02:36:33.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.078+0000 7f02f6638700 1 -- 172.21.15.1:0/3476175419 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f00afb70 con 0x7f02f00aa4e0 2023-11-15T02:36:33.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.079+0000 7f02f6638700 1 -- 172.21.15.1:0/3476175419 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f006c7e0 con 0x7f02f00aa4e0 2023-11-15T02:36:33.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.079+0000 7f02d7fff700 1 -- 172.21.15.1:0/3476175419 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f02e00066a0 con 0x7f02f00aa4e0 2023-11-15T02:36:33.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.080+0000 7f02d7fff700 1 --2- 172.21.15.1:0/3476175419 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f02dc05f270 0x7f02dc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.080+0000 7f02d7fff700 1 -- 172.21.15.1:0/3476175419 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6281+0+0 (secure 0 0 0) 0x7f02e0079ce0 con 0x7f02f00aa4e0 2023-11-15T02:36:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.080+0000 7f02ef7fe700 1 --2- 172.21.15.1:0/3476175419 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f02dc05f270 0x7f02dc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.080+0000 7f02ef7fe700 1 --2- 172.21.15.1:0/3476175419 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f02dc05f270 0x7f02dc061730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f02f0157ba0 tx=0x7f02e4009060).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.084+0000 7f02d7fff700 1 -- 172.21.15.1:0/3476175419 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f02e007e070 con 0x7f02f00aa4e0 2023-11-15T02:36:33.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:33.271+0000 7f02f6638700 1 -- 172.21.15.1:0/3476175419 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f02f00c9030 con 0x7f02f00aa4e0 2023-11-15T02:36:34.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.100+0000 7f02d7fff700 1 -- 172.21.15.1:0/3476175419 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v158) v1 ==== 97+0+0 (secure 0 0 0) 0x7f02e004ad90 con 0x7f02f00aa4e0 2023-11-15T02:36:34.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.102+0000 7f02f6638700 1 -- 172.21.15.1:0/3476175419 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f02dc05f270 msgr2=0x7f02dc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.102+0000 7f02f6638700 1 --2- 172.21.15.1:0/3476175419 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f02dc05f270 0x7f02dc061730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f02f0157ba0 tx=0x7f02e4009060).stop 2023-11-15T02:36:34.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.102+0000 7f02f6638700 1 -- 172.21.15.1:0/3476175419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00aa4e0 msgr2=0x7f02f00aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.102+0000 7f02f6638700 1 --2- 172.21.15.1:0/3476175419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00aa4e0 0x7f02f00aea40 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f02e000c4c0 tx=0x7f02e0007e00).stop 2023-11-15T02:36:34.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.102+0000 7f02f6638700 1 -- 172.21.15.1:0/3476175419 shutdown_connections 2023-11-15T02:36:34.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.102+0000 7f02f6638700 1 --2- 172.21.15.1:0/3476175419 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f02dc05f270 0x7f02dc061730 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.102+0000 7f02f6638700 1 --2- 172.21.15.1:0/3476175419 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02f0154630 0x7f02f0063650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.102+0000 7f02f6638700 1 --2- 172.21.15.1:0/3476175419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00aa4e0 0x7f02f00aea40 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.102+0000 7f02f6638700 1 --2- 172.21.15.1:0/3476175419 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f0154250 0x7f02f00aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.102+0000 7f02f6638700 1 -- 172.21.15.1:0/3476175419 >> 172.21.15.1:0/3476175419 conn(0x7f02f00c7b20 msgr2=0x7f02f00c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:34.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.102+0000 7f02f6638700 1 -- 172.21.15.1:0/3476175419 shutdown_connections 2023-11-15T02:36:34.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.102+0000 7f02f6638700 1 -- 172.21.15.1:0/3476175419 wait complete. 2023-11-15T02:36:34.106 INFO:teuthology.orchestra.run.smithi001.stderr: removed all blocklist entries 2023-11-15T02:36:34.117 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-15T02:36:34.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.240+0000 7f76142d6700 1 Processor -- start 2023-11-15T02:36:34.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.240+0000 7f76142d6700 1 -- start start 2023-11-15T02:36:34.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.241+0000 7f76142d6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f760c0ab1a0 0x7f760c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.241+0000 7f76142d6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0c06f0 con 0x7f760c154150 2023-11-15T02:36:34.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.241+0000 7f76142d6700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0c09d0 con 0x7f760c0aa060 2023-11-15T02:36:34.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.241+0000 7f76142d6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c158820 con 0x7f760c0ab1a0 2023-11-15T02:36:34.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.241+0000 7f7612072700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f760c154150 0x7f760c158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41178/0 (socket says 172.21.15.1:41178) 2023-11-15T02:36:34.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.241+0000 7f7612072700 1 -- 172.21.15.1:0/1384809480 learned_addr learned my addr 172.21.15.1:0/1384809480 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:34.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.241+0000 7f7611070700 1 -- 172.21.15.1:0/1384809480 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887700873 0 0) 0x7f760c0c06f0 con 0x7f760c154150 2023-11-15T02:36:34.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.241+0000 7f7611871700 1 --2- 172.21.15.1:0/1384809480 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f760c0ab1a0 0x7f760c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7611070700 1 -- 172.21.15.1:0/1384809480 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f40033f0 con 0x7f760c154150 2023-11-15T02:36:34.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7611070700 1 -- 172.21.15.1:0/1384809480 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3274185608 0 0) 0x7f75f40033f0 con 0x7f760c154150 2023-11-15T02:36:34.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7611070700 1 -- 172.21.15.1:0/1384809480 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f760c0ab1a0 msgr2=0x7f760c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:34.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7611070700 1 --2- 172.21.15.1:0/1384809480 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f760c0ab1a0 0x7f760c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7611070700 1 -- 172.21.15.1:0/1384809480 >> v1:172.21.15.141:6789/0 conn(0x7f760c0aa060 legacy=0x7f760c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7611070700 1 -- 172.21.15.1:0/1384809480 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c158b00 con 0x7f760c154150 2023-11-15T02:36:34.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7611070700 1 -- 172.21.15.1:0/1384809480 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f76040017f0 con 0x7f760c154150 2023-11-15T02:36:34.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7611070700 1 -- 172.21.15.1:0/1384809480 >> v1:172.21.15.1:6789/0 conn(0x7f760c154150 legacy=0x7f760c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7611070700 1 --2- 172.21.15.1:0/1384809480 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75f4003910 0x7f75f4003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7611070700 1 --2- 172.21.15.1:0/1384809480 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f760c0ab1a0 0x7f75f4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7611070700 1 --2- 172.21.15.1:0/1384809480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f4004b80 0x7f75f4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7611070700 1 -- 172.21.15.1:0/1384809480 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c158820 con 0x7f75f4004b80 2023-11-15T02:36:34.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7611070700 1 -- 172.21.15.1:0/1384809480 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f400b990 con 0x7f75f4003910 2023-11-15T02:36:34.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7611070700 1 -- 172.21.15.1:0/1384809480 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f400bb00 con 0x7f760c0ab1a0 2023-11-15T02:36:34.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7612873700 1 --2- 172.21.15.1:0/1384809480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f4004b80 0x7f75f4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7612072700 1 --2- 172.21.15.1:0/1384809480 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75f4003910 0x7f75f4003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7611871700 1 --2- 172.21.15.1:0/1384809480 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f760c0ab1a0 0x7f75f4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7612873700 1 -- 172.21.15.1:0/1384809480 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f760c0ab1a0 msgr2=0x7f75f4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:34.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7612873700 1 --2- 172.21.15.1:0/1384809480 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f760c0ab1a0 0x7f75f4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7612873700 1 -- 172.21.15.1:0/1384809480 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75f4003910 msgr2=0x7f75f4003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:34.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7612873700 1 --2- 172.21.15.1:0/1384809480 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75f4003910 0x7f75f4003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7612873700 1 -- 172.21.15.1:0/1384809480 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f40033f0 con 0x7f75f4004b80 2023-11-15T02:36:34.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.242+0000 7f7612873700 1 --2- 172.21.15.1:0/1384809480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f4004b80 0x7f75f4005000 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f75fc0017f0 tx=0x7f75fc007b90).ready entity=mon.0 client_cookie=f1600571e88eb2ae server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:34.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.243+0000 7f7611070700 1 -- 172.21.15.1:0/1384809480 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc007ea0 con 0x7f75f4004b80 2023-11-15T02:36:34.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.243+0000 7f7611070700 1 -- 172.21.15.1:0/1384809480 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc012400 con 0x7f75f4004b80 2023-11-15T02:36:34.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.243+0000 7f7611070700 1 -- 172.21.15.1:0/1384809480 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc012780 con 0x7f75f4004b80 2023-11-15T02:36:34.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.243+0000 7f76142d6700 1 -- 172.21.15.1:0/1384809480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f4004b80 msgr2=0x7f75f4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.243+0000 7f76142d6700 1 --2- 172.21.15.1:0/1384809480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f4004b80 0x7f75f4005000 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f75fc0017f0 tx=0x7f75fc007b90).stop 2023-11-15T02:36:34.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.243+0000 7f7612873700 1 -- 172.21.15.1:0/1384809480 reap_dead start 2023-11-15T02:36:34.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.243+0000 7f76142d6700 1 -- 172.21.15.1:0/1384809480 shutdown_connections 2023-11-15T02:36:34.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.243+0000 7f76142d6700 1 -- 172.21.15.1:0/1384809480 >> 172.21.15.1:0/1384809480 conn(0x7f760c064aa0 msgr2=0x7f760c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:34.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.243+0000 7f76142d6700 1 -- 172.21.15.1:0/1384809480 shutdown_connections 2023-11-15T02:36:34.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.243+0000 7f76142d6700 1 -- 172.21.15.1:0/1384809480 wait complete. 2023-11-15T02:36:34.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.244+0000 7f76142d6700 1 Processor -- start 2023-11-15T02:36:34.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.244+0000 7f76142d6700 1 -- start start 2023-11-15T02:36:34.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f76142d6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f4004b80 0x7f760c0c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f76142d6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f760c0c4b30 0x7f760c147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f76142d6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f760c152a40 0x7f760c152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f76142d6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0afb00 con 0x7f75f4004b80 2023-11-15T02:36:34.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f76142d6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0c9ca0 con 0x7f760c152a40 2023-11-15T02:36:34.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f76142d6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0c9f40 con 0x7f760c0c4b30 2023-11-15T02:36:34.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f7612072700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f4004b80 0x7f760c0c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f7612072700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f4004b80 0x7f760c0c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44002/0 (socket says 172.21.15.1:44002) 2023-11-15T02:36:34.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f7612072700 1 -- 172.21.15.1:0/2249103562 learned_addr learned my addr 172.21.15.1:0/2249103562 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:34.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f7611871700 1 --2- 172.21.15.1:0/2249103562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f760c0c4b30 0x7f760c147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f7612873700 1 --2- 172.21.15.1:0/2249103562 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f760c152a40 0x7f760c152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f7612072700 1 -- 172.21.15.1:0/2249103562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f760c0c4b30 msgr2=0x7f760c147a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f7612072700 1 --2- 172.21.15.1:0/2249103562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f760c0c4b30 0x7f760c147a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f7612072700 1 -- 172.21.15.1:0/2249103562 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f760c152a40 msgr2=0x7f760c152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f7612072700 1 --2- 172.21.15.1:0/2249103562 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f760c152a40 0x7f760c152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.245+0000 7f7612072700 1 -- 172.21.15.1:0/2249103562 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0ca220 con 0x7f75f4004b80 2023-11-15T02:36:34.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.246+0000 7f7612072700 1 --2- 172.21.15.1:0/2249103562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f4004b80 0x7f760c0c50e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f7604007e30 tx=0x7f7604001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:34.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.246+0000 7f760a7fc700 1 -- 172.21.15.1:0/2249103562 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400f8a0 con 0x7f75f4004b80 2023-11-15T02:36:34.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.246+0000 7f760a7fc700 1 -- 172.21.15.1:0/2249103562 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760400fa00 con 0x7f75f4004b80 2023-11-15T02:36:34.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.246+0000 7f760a7fc700 1 -- 172.21.15.1:0/2249103562 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400fda0 con 0x7f75f4004b80 2023-11-15T02:36:34.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.246+0000 7f76142d6700 1 -- 172.21.15.1:0/2249103562 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c0af790 con 0x7f75f4004b80 2023-11-15T02:36:34.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.246+0000 7f76142d6700 1 -- 172.21.15.1:0/2249103562 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c0c2140 con 0x7f75f4004b80 2023-11-15T02:36:34.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.247+0000 7f76142d6700 1 -- 172.21.15.1:0/2249103562 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c0af5f0 con 0x7f75f4004b80 2023-11-15T02:36:34.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.247+0000 7f760a7fc700 1 -- 172.21.15.1:0/2249103562 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7604012560 con 0x7f75f4004b80 2023-11-15T02:36:34.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.247+0000 7f760a7fc700 1 --2- 172.21.15.1:0/2249103562 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75f805f2a0 0x7f75f8061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.247+0000 7f760a7fc700 1 -- 172.21.15.1:0/2249103562 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f7604079ee0 con 0x7f75f4004b80 2023-11-15T02:36:34.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.248+0000 7f7611871700 1 --2- 172.21.15.1:0/2249103562 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75f805f2a0 0x7f75f8061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.248+0000 7f7611871700 1 --2- 172.21.15.1:0/2249103562 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75f805f2a0 0x7f75f8061760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7600006d80 tx=0x7f7600009060).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:34.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.252+0000 7f760a7fc700 1 -- 172.21.15.1:0/2249103562 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f760c0af5f0 con 0x7f75f4004b80 2023-11-15T02:36:34.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.491+0000 7f76142d6700 1 -- 172.21.15.1:0/2249103562 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f760c0af5f0 con 0x7f75f4004b80 2023-11-15T02:36:34.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.491+0000 7f760a7fc700 1 -- 172.21.15.1:0/2249103562 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v41) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f760c0af5f0 con 0x7f75f4004b80 2023-11-15T02:36:34.493 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:34.494 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:36:34.494 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_dump": [ 2023-11-15T02:36:34.494 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.495 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.a", 2023-11-15T02:36:34.495 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlmtf5GBAA2CojasXoquGQ9L5rKjVwTQ==", 2023-11-15T02:36:34.495 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.496 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:36:34.497 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:36:34.497 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:36:34.497 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:36:34.498 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.498 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.498 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.499 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.b", 2023-11-15T02:36:34.499 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl/Y5mJBAAz7iLl3kBJ8kSsyTetTZByw==", 2023-11-15T02:36:34.500 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.500 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:36:34.500 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:36:34.501 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:36:34.501 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:36:34.501 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.502 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.502 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.502 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.c", 2023-11-15T02:36:34.502 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlWTrwHxAAqLVpwNca0vAXUBFnWUN3pg==", 2023-11-15T02:36:34.503 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.503 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:36:34.503 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:36:34.504 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:36:34.504 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:36:34.504 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.505 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.505 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.505 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.d", 2023-11-15T02:36:34.505 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlVwUnKxAAhx2/mX1ljgQwJLagVpmZIA==", 2023-11-15T02:36:34.506 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.506 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:36:34.506 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:36:34.506 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:36:34.506 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:36:34.507 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.507 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.507 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.507 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.0", 2023-11-15T02:36:34.507 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDxHFRlII6rERAA/kvPPhTPHHy6pu5wSPsR/A==", 2023-11-15T02:36:34.508 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.508 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:36:34.508 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:36:34.508 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:36:34.508 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.508 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.509 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.509 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.1", 2023-11-15T02:36:34.509 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD0HFRlPkstEBAAqx31fnNonRCVh98eY6qbxQ==", 2023-11-15T02:36:34.509 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.510 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:36:34.510 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:36:34.511 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:36:34.511 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.511 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.511 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.511 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.2", 2023-11-15T02:36:34.512 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD3HFRl8e3nDRAAKigcbIo0/BFo0Qi6rV+amQ==", 2023-11-15T02:36:34.512 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.512 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:36:34.512 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:36:34.512 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:36:34.513 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.513 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.513 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.513 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.3", 2023-11-15T02:36:34.513 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD6HFRlbwDTCxAAkWv04RyNqW4p8pOqvYCS3A==", 2023-11-15T02:36:34.514 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.514 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:36:34.514 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:36:34.514 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:36:34.515 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.515 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.515 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.516 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.4", 2023-11-15T02:36:34.516 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAAHVRlTQihDxAA/HcZbSytP9qD5PsTjvJBoA==", 2023-11-15T02:36:34.516 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.516 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:36:34.516 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:36:34.517 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:36:34.517 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.517 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.517 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.517 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.5", 2023-11-15T02:36:34.518 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQADHVRlQ2hjDRAAFiI+hKubCPcZ/1AJVu1fvQ==", 2023-11-15T02:36:34.518 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.518 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:36:34.518 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:36:34.518 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:36:34.519 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.519 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.519 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.519 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.6", 2023-11-15T02:36:34.519 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAGHVRl/KEbCxAAmKTnRU4m4qNzX+SVcFY+Qw==", 2023-11-15T02:36:34.520 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.520 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:36:34.520 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:36:34.520 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:36:34.520 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.520 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.521 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.521 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.7", 2023-11-15T02:36:34.521 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAJHVRl4wOFCBAAAiGT4UPE5vSb2LjqgGgGFw==", 2023-11-15T02:36:34.521 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.521 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:36:34.522 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:36:34.522 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:36:34.522 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.522 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.523 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.523 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.0", 2023-11-15T02:36:34.523 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl2hkHLxAAxQE/Cslig6gmXR/xcVlRuw==", 2023-11-15T02:36:34.524 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.524 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:36:34.524 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow r", 2023-11-15T02:36:34.524 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-15T02:36:34.525 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.525 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.525 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.526 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.1", 2023-11-15T02:36:34.526 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRltolkNxAAXmQ4yXOlavwqKq2jFKwsYQ==", 2023-11-15T02:36:34.526 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.526 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:36:34.526 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T02:36:34.527 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T02:36:34.527 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T02:36:34.527 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.527 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.527 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.528 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.2", 2023-11-15T02:36:34.528 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlFrJvNBAAH97x7ERzuzpWrUALO+HvpA==", 2023-11-15T02:36:34.528 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.528 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:36:34.528 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T02:36:34.528 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T02:36:34.529 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T02:36:34.529 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.529 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.529 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.529 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.3", 2023-11-15T02:36:34.530 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDwHFRlko0ZARAA2RqeRJGwWns00DeWgd/9hA==", 2023-11-15T02:36:34.530 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.530 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:36:34.530 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T02:36:34.530 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T02:36:34.531 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T02:36:34.531 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.531 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.531 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.531 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.admin", 2023-11-15T02:36:34.531 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDuHFRlxIQDORAALrVIyQoaVSADkyv9yzMaZw==", 2023-11-15T02:36:34.532 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.532 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T02:36:34.532 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:36:34.532 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:36:34.532 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:36:34.533 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.533 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.533 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.534 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.x", 2023-11-15T02:36:34.534 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlnyjlFRAAjJwtxkAvJ0ZGmvOOawQseQ==", 2023-11-15T02:36:34.534 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.534 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T02:36:34.535 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T02:36:34.535 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:36:34.535 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.535 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:34.535 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:34.536 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.y", 2023-11-15T02:36:34.536 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl8nW3ERAA4CJQt/ZEZCJ9UaRRuEHfzw==", 2023-11-15T02:36:34.536 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:36:34.536 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T02:36:34.536 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T02:36:34.537 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:36:34.537 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.537 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:34.537 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2023-11-15T02:36:34.537 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:36:34.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.493+0000 7f76142d6700 1 -- 172.21.15.1:0/2249103562 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75f805f2a0 msgr2=0x7f75f8061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.493+0000 7f76142d6700 1 --2- 172.21.15.1:0/2249103562 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75f805f2a0 0x7f75f8061760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7600006d80 tx=0x7f7600009060).stop 2023-11-15T02:36:34.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.493+0000 7f76142d6700 1 -- 172.21.15.1:0/2249103562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f4004b80 msgr2=0x7f760c0c50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.493+0000 7f76142d6700 1 --2- 172.21.15.1:0/2249103562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f4004b80 0x7f760c0c50e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f7604007e30 tx=0x7f7604001d90).stop 2023-11-15T02:36:34.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.493+0000 7f76142d6700 1 -- 172.21.15.1:0/2249103562 shutdown_connections 2023-11-15T02:36:34.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.493+0000 7f76142d6700 1 --2- 172.21.15.1:0/2249103562 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f75f805f2a0 0x7f75f8061760 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.493+0000 7f76142d6700 1 --2- 172.21.15.1:0/2249103562 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f760c152a40 0x7f760c152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.493+0000 7f76142d6700 1 --2- 172.21.15.1:0/2249103562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f4004b80 0x7f760c0c50e0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.493+0000 7f76142d6700 1 --2- 172.21.15.1:0/2249103562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f760c0c4b30 0x7f760c147a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.493+0000 7f76142d6700 1 -- 172.21.15.1:0/2249103562 >> 172.21.15.1:0/2249103562 conn(0x7f760c064aa0 msgr2=0x7f760c0acc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:34.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.493+0000 7f76142d6700 1 -- 172.21.15.1:0/2249103562 shutdown_connections 2023-11-15T02:36:34.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.493+0000 7f76142d6700 1 -- 172.21.15.1:0/2249103562 wait complete. 2023-11-15T02:36:34.542 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:36:34.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.660+0000 7f7efce12700 1 Processor -- start 2023-11-15T02:36:34.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.660+0000 7f7efce12700 1 -- start start 2023-11-15T02:36:34.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.661+0000 7f7efce12700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ef8154150 0x7f7ef8154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.661+0000 7f7efce12700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef80c06f0 con 0x7f7ef80ab1a0 2023-11-15T02:36:34.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.661+0000 7f7efce12700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef80c09d0 con 0x7f7ef80aa060 2023-11-15T02:36:34.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.661+0000 7f7efce12700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef8158820 con 0x7f7ef8154150 2023-11-15T02:36:34.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.661+0000 7f7ef5d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7ef80ab1a0 0x7f7ef8158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41192/0 (socket says 172.21.15.1:41192) 2023-11-15T02:36:34.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.661+0000 7f7ef5d9b700 1 -- 172.21.15.1:0/1352507772 learned_addr learned my addr 172.21.15.1:0/1352507772 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:34.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.661+0000 7f7ef659c700 1 --2- 172.21.15.1:0/1352507772 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ef8154150 0x7f7ef8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.661+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435932469 0 0) 0x7f7ef80c06f0 con 0x7f7ef80ab1a0 2023-11-15T02:36:34.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.661+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ee40033f0 con 0x7f7ef80ab1a0 2023-11-15T02:36:34.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660856683 0 0) 0x7f7ef80c09d0 con 0x7f7ef80aa060 2023-11-15T02:36:34.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ef80c06f0 con 0x7f7ef80aa060 2023-11-15T02:36:34.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3275583515 0 0) 0x7f7ee40033f0 con 0x7f7ef80ab1a0 2023-11-15T02:36:34.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ef8154150 msgr2=0x7f7ef8154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:34.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef559a700 1 --2- 172.21.15.1:0/1352507772 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ef8154150 0x7f7ef8154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 >> v1:172.21.15.141:6789/0 conn(0x7f7ef80aa060 legacy=0x7f7ef80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef8158b00 con 0x7f7ef80ab1a0 2023-11-15T02:36:34.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f7ee0001470 con 0x7f7ef80ab1a0 2023-11-15T02:36:34.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef659c700 1 --2- 172.21.15.1:0/1352507772 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ef8154150 0x7f7ef8154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:34.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 >> v1:172.21.15.1:6789/0 conn(0x7f7ef80ab1a0 legacy=0x7f7ef8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef559a700 1 --2- 172.21.15.1:0/1352507772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee4003aa0 0x7f7ee4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef559a700 1 --2- 172.21.15.1:0/1352507772 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ef8154150 0x7f7ee4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef559a700 1 --2- 172.21.15.1:0/1352507772 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ee4004b80 0x7f7ee4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef8158820 con 0x7f7ee4003aa0 2023-11-15T02:36:34.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee400b990 con 0x7f7ee4004b80 2023-11-15T02:36:34.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee400bb20 con 0x7f7ef8154150 2023-11-15T02:36:34.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef659c700 1 --2- 172.21.15.1:0/1352507772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee4003aa0 0x7f7ee4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef5d9b700 1 --2- 172.21.15.1:0/1352507772 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ef8154150 0x7f7ee4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef6d9d700 1 --2- 172.21.15.1:0/1352507772 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ee4004b80 0x7f7ee4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef659c700 1 -- 172.21.15.1:0/1352507772 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ef8154150 msgr2=0x7f7ee4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:34.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef659c700 1 --2- 172.21.15.1:0/1352507772 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ef8154150 0x7f7ee4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef659c700 1 -- 172.21.15.1:0/1352507772 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ee4004b80 msgr2=0x7f7ee4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:34.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef659c700 1 --2- 172.21.15.1:0/1352507772 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ee4004b80 0x7f7ee4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef659c700 1 -- 172.21.15.1:0/1352507772 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef0009a20 con 0x7f7ee4003aa0 2023-11-15T02:36:34.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef6d9d700 1 --2- 172.21.15.1:0/1352507772 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ee4004b80 0x7f7ee4005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:34.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef5d9b700 1 --2- 172.21.15.1:0/1352507772 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ef8154150 0x7f7ee4004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:34.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.662+0000 7f7ef659c700 1 --2- 172.21.15.1:0/1352507772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee4003aa0 0x7f7ee4003ea0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f7ef000e3c0 tx=0x7f7ef000b040).ready entity=mon.0 client_cookie=4a5ae48f013c9134 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:34.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.663+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0009c50 con 0x7f7ee4003aa0 2023-11-15T02:36:34.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.663+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef000f040 con 0x7f7ee4003aa0 2023-11-15T02:36:34.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.663+0000 7f7ef559a700 1 -- 172.21.15.1:0/1352507772 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef000ee80 con 0x7f7ee4003aa0 2023-11-15T02:36:34.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.663+0000 7f7efce12700 1 -- 172.21.15.1:0/1352507772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee4003aa0 msgr2=0x7f7ee4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.663+0000 7f7efce12700 1 --2- 172.21.15.1:0/1352507772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee4003aa0 0x7f7ee4003ea0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f7ef000e3c0 tx=0x7f7ef000b040).stop 2023-11-15T02:36:34.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.663+0000 7f7ef6d9d700 1 -- 172.21.15.1:0/1352507772 reap_dead start 2023-11-15T02:36:34.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.663+0000 7f7efce12700 1 -- 172.21.15.1:0/1352507772 shutdown_connections 2023-11-15T02:36:34.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.663+0000 7f7efce12700 1 -- 172.21.15.1:0/1352507772 >> 172.21.15.1:0/1352507772 conn(0x7f7ef8064aa0 msgr2=0x7f7ef8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:34.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.663+0000 7f7efce12700 1 -- 172.21.15.1:0/1352507772 shutdown_connections 2023-11-15T02:36:34.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.663+0000 7f7efce12700 1 -- 172.21.15.1:0/1352507772 wait complete. 2023-11-15T02:36:34.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.664+0000 7f7efce12700 1 Processor -- start 2023-11-15T02:36:34.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.664+0000 7f7efce12700 1 -- start start 2023-11-15T02:36:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7efce12700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee4003aa0 0x7f7ef80acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7efce12700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ef81555c0 0x7f7ef814dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7efce12700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ef8156fa0 0x7f7ef8157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7efce12700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80ad020 con 0x7f7ee4003aa0 2023-11-15T02:36:34.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7efce12700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80adab0 con 0x7f7ef8156fa0 2023-11-15T02:36:34.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7efce12700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80ca0a0 con 0x7f7ef81555c0 2023-11-15T02:36:34.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7ef659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee4003aa0 0x7f7ef80acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7ef659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee4003aa0 0x7f7ef80acb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44032/0 (socket says 172.21.15.1:44032) 2023-11-15T02:36:34.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7ef659c700 1 -- 172.21.15.1:0/3883051416 learned_addr learned my addr 172.21.15.1:0/3883051416 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:34.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7ef5d9b700 1 --2- 172.21.15.1:0/3883051416 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ef81555c0 0x7f7ef814dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7ef6d9d700 1 --2- 172.21.15.1:0/3883051416 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ef8156fa0 0x7f7ef8157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7ef659c700 1 -- 172.21.15.1:0/3883051416 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ef81555c0 msgr2=0x7f7ef814dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7ef659c700 1 --2- 172.21.15.1:0/3883051416 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ef81555c0 0x7f7ef814dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7ef659c700 1 -- 172.21.15.1:0/3883051416 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ef8156fa0 msgr2=0x7f7ef8157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7ef659c700 1 --2- 172.21.15.1:0/3883051416 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ef8156fa0 0x7f7ef8157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7ef659c700 1 -- 172.21.15.1:0/3883051416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef8155a00 con 0x7f7ee4003aa0 2023-11-15T02:36:34.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7ef6d9d700 1 --2- 172.21.15.1:0/3883051416 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ef8156fa0 0x7f7ef8157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:34.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.665+0000 7f7ef659c700 1 --2- 172.21.15.1:0/3883051416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee4003aa0 0x7f7ef80acb30 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f7ef000e9b0 tx=0x7f7ef001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:34.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.666+0000 7f7eee7fc700 1 -- 172.21.15.1:0/3883051416 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef001c450 con 0x7f7ee4003aa0 2023-11-15T02:36:34.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.666+0000 7f7eee7fc700 1 -- 172.21.15.1:0/3883051416 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef0023070 con 0x7f7ee4003aa0 2023-11-15T02:36:34.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.666+0000 7f7efce12700 1 -- 172.21.15.1:0/3883051416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef80ad210 con 0x7f7ee4003aa0 2023-11-15T02:36:34.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.666+0000 7f7eee7fc700 1 -- 172.21.15.1:0/3883051416 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef001c5f0 con 0x7f7ee4003aa0 2023-11-15T02:36:34.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.666+0000 7f7efce12700 1 -- 172.21.15.1:0/3883051416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef80ad7d0 con 0x7f7ee4003aa0 2023-11-15T02:36:34.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.667+0000 7f7efce12700 1 -- 172.21.15.1:0/3883051416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef806c7e0 con 0x7f7ee4003aa0 2023-11-15T02:36:34.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.667+0000 7f7eee7fc700 1 -- 172.21.15.1:0/3883051416 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7ef0003040 con 0x7f7ee4003aa0 2023-11-15T02:36:34.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.668+0000 7f7eee7fc700 1 --2- 172.21.15.1:0/3883051416 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7ed805f270 0x7f7ed8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.668+0000 7f7eee7fc700 1 -- 172.21.15.1:0/3883051416 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f7ef007c430 con 0x7f7ee4003aa0 2023-11-15T02:36:34.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.668+0000 7f7ef5d9b700 1 --2- 172.21.15.1:0/3883051416 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7ed805f270 0x7f7ed8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.668+0000 7f7ef5d9b700 1 --2- 172.21.15.1:0/3883051416 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7ed805f270 0x7f7ed8061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7ee00015a0 tx=0x7f7ee0009040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:34.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.672+0000 7f7eee7fc700 1 -- 172.21.15.1:0/3883051416 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7ef004d680 con 0x7f7ee4003aa0 2023-11-15T02:36:34.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.848+0000 7f7efce12700 1 -- 172.21.15.1:0/3883051416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ef8158de0 con 0x7f7ee4003aa0 2023-11-15T02:36:34.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.849+0000 7f7eee7fc700 1 -- 172.21.15.1:0/3883051416 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+14435 (secure 0 0 0) 0x7f7ef002d090 con 0x7f7ee4003aa0 2023-11-15T02:36:34.850 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:34.850 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":158,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:36:34.095296+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:36:34.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.851+0000 7f7efce12700 1 -- 172.21.15.1:0/3883051416 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7ed805f270 msgr2=0x7f7ed8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.851+0000 7f7efce12700 1 --2- 172.21.15.1:0/3883051416 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7ed805f270 0x7f7ed8061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7ee00015a0 tx=0x7f7ee0009040).stop 2023-11-15T02:36:34.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.851+0000 7f7efce12700 1 -- 172.21.15.1:0/3883051416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee4003aa0 msgr2=0x7f7ef80acb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.851+0000 7f7efce12700 1 --2- 172.21.15.1:0/3883051416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee4003aa0 0x7f7ef80acb30 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f7ef000e9b0 tx=0x7f7ef001a000).stop 2023-11-15T02:36:34.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.851+0000 7f7efce12700 1 -- 172.21.15.1:0/3883051416 shutdown_connections 2023-11-15T02:36:34.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.851+0000 7f7efce12700 1 --2- 172.21.15.1:0/3883051416 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7ed805f270 0x7f7ed8061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.851+0000 7f7efce12700 1 --2- 172.21.15.1:0/3883051416 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7ef8156fa0 0x7f7ef8157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.851+0000 7f7efce12700 1 --2- 172.21.15.1:0/3883051416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee4003aa0 0x7f7ef80acb30 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.851+0000 7f7efce12700 1 --2- 172.21.15.1:0/3883051416 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ef81555c0 0x7f7ef814dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.851+0000 7f7efce12700 1 -- 172.21.15.1:0/3883051416 >> 172.21.15.1:0/3883051416 conn(0x7f7ef8064aa0 msgr2=0x7f7ef814e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:34.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.851+0000 7f7efce12700 1 -- 172.21.15.1:0/3883051416 shutdown_connections 2023-11-15T02:36:34.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.851+0000 7f7efce12700 1 -- 172.21.15.1:0/3883051416 wait complete. 2023-11-15T02:36:34.864 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '151', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-15T02:36:34.865 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T02:36:34.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.986+0000 7f6a808d1700 1 Processor -- start 2023-11-15T02:36:34.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.986+0000 7f6a808d1700 1 -- start start 2023-11-15T02:36:34.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a808d1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7c1545b0 0x7f6a7c0c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a808d1700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6a7c0c7f50 0x7f6a7c0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a808d1700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7c155830 con 0x7f6a7c1541d0 2023-11-15T02:36:34.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a808d1700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7c158f40 con 0x7f6a7c0c7f50 2023-11-15T02:36:34.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a808d1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c154a30 con 0x7f6a7c1545b0 2023-11-15T02:36:34.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a7ad9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6a7c1541d0 0x7f6a7c0c60d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41200/0 (socket says 172.21.15.1:41200) 2023-11-15T02:36:34.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a7ad9d700 1 -- 172.21.15.1:0/2016854255 learned_addr learned my addr 172.21.15.1:0/2016854255 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:34.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 -- 172.21.15.1:0/2016854255 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611861313 0 0) 0x7f6a7c155830 con 0x7f6a7c1541d0 2023-11-15T02:36:34.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a7a59c700 1 --2- 172.21.15.1:0/2016854255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7c1545b0 0x7f6a7c0c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a7b59e700 1 --2- 172.21.15.1:0/2016854255 >> v2:172.21.15.141:3300/0 conn(0x7f6a7c0c7f50 0x7f6a7c0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 -- 172.21.15.1:0/2016854255 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a680033f0 con 0x7f6a7c1541d0 2023-11-15T02:36:34.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 -- 172.21.15.1:0/2016854255 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1645425279 0 0) 0x7f6a680033f0 con 0x7f6a7c1541d0 2023-11-15T02:36:34.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 -- 172.21.15.1:0/2016854255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7c1545b0 msgr2=0x7f6a7c0c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:34.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 --2- 172.21.15.1:0/2016854255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7c1545b0 0x7f6a7c0c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 -- 172.21.15.1:0/2016854255 >> v2:172.21.15.141:3300/0 conn(0x7f6a7c0c7f50 msgr2=0x7f6a7c0c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:34.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 --2- 172.21.15.1:0/2016854255 >> v2:172.21.15.141:3300/0 conn(0x7f6a7c0c7f50 0x7f6a7c0c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:34.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 -- 172.21.15.1:0/2016854255 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c0c83a0 con 0x7f6a7c1541d0 2023-11-15T02:36:34.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 -- 172.21.15.1:0/2016854255 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f6a740017f0 con 0x7f6a7c1541d0 2023-11-15T02:36:34.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a7b59e700 1 --2- 172.21.15.1:0/2016854255 >> v2:172.21.15.141:3300/0 conn(0x7f6a7c0c7f50 0x7f6a7c0c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:34.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 -- 172.21.15.1:0/2016854255 >> v1:172.21.15.1:6789/0 conn(0x7f6a7c1541d0 legacy=0x7f6a7c0c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:34.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 --2- 172.21.15.1:0/2016854255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a680038e0 0x7f6a68003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 --2- 172.21.15.1:0/2016854255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7c1545b0 0x7f6a68004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 --2- 172.21.15.1:0/2016854255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a68004b80 0x7f6a68005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:34.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 -- 172.21.15.1:0/2016854255 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6800b8e0 con 0x7f6a68004b80 2023-11-15T02:36:34.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 -- 172.21.15.1:0/2016854255 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6800ba20 con 0x7f6a680038e0 2023-11-15T02:36:34.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.987+0000 7f6a79d9b700 1 -- 172.21.15.1:0/2016854255 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6800bbb0 con 0x7f6a7c1545b0 2023-11-15T02:36:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.988+0000 7f6a7b59e700 1 --2- 172.21.15.1:0/2016854255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a68004b80 0x7f6a68005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.988+0000 7f6a7ad9d700 1 --2- 172.21.15.1:0/2016854255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a680038e0 0x7f6a68003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.988+0000 7f6a7a59c700 1 --2- 172.21.15.1:0/2016854255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7c1545b0 0x7f6a68004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.988+0000 7f6a7b59e700 1 -- 172.21.15.1:0/2016854255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7c1545b0 msgr2=0x7f6a68004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:34.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.988+0000 7f6a7b59e700 1 --2- 172.21.15.1:0/2016854255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7c1545b0 0x7f6a68004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.988+0000 7f6a7b59e700 1 -- 172.21.15.1:0/2016854255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a680038e0 msgr2=0x7f6a68003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:35.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.988+0000 7f6a7b59e700 1 --2- 172.21.15.1:0/2016854255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a680038e0 0x7f6a68003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.988+0000 7f6a7b59e700 1 -- 172.21.15.1:0/2016854255 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a680033f0 con 0x7f6a68004b80 2023-11-15T02:36:35.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.988+0000 7f6a7b59e700 1 --2- 172.21.15.1:0/2016854255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a68004b80 0x7f6a68005000 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f6a6c00bad0 tx=0x7f6a6c008040).ready entity=mon.0 client_cookie=80bf9bd2c42211f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:35.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.988+0000 7f6a79d9b700 1 -- 172.21.15.1:0/2016854255 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c00b410 con 0x7f6a68004b80 2023-11-15T02:36:35.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.988+0000 7f6a79d9b700 1 -- 172.21.15.1:0/2016854255 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c00d5d0 con 0x7f6a68004b80 2023-11-15T02:36:35.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.988+0000 7f6a79d9b700 1 -- 172.21.15.1:0/2016854255 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c00d950 con 0x7f6a68004b80 2023-11-15T02:36:35.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.989+0000 7f6a808d1700 1 -- 172.21.15.1:0/2016854255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a68004b80 msgr2=0x7f6a68005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.989+0000 7f6a808d1700 1 --2- 172.21.15.1:0/2016854255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a68004b80 0x7f6a68005000 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f6a6c00bad0 tx=0x7f6a6c008040).stop 2023-11-15T02:36:35.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.989+0000 7f6a7b59e700 1 -- 172.21.15.1:0/2016854255 reap_dead start 2023-11-15T02:36:35.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.989+0000 7f6a808d1700 1 -- 172.21.15.1:0/2016854255 shutdown_connections 2023-11-15T02:36:35.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.989+0000 7f6a808d1700 1 -- 172.21.15.1:0/2016854255 >> 172.21.15.1:0/2016854255 conn(0x7f6a7c069ee0 msgr2=0x7f6a7c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:35.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.989+0000 7f6a808d1700 1 -- 172.21.15.1:0/2016854255 shutdown_connections 2023-11-15T02:36:35.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.989+0000 7f6a808d1700 1 -- 172.21.15.1:0/2016854255 wait complete. 2023-11-15T02:36:35.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.990+0000 7f6a808d1700 1 Processor -- start 2023-11-15T02:36:35.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.990+0000 7f6a808d1700 1 -- start start 2023-11-15T02:36:35.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a808d1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a7c0aa440 0x7f6a7c14c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a808d1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7c0aa820 0x7f6a7c14e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a808d1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a7c14e570 0x7f6a7c167da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a808d1700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0b02e0 con 0x7f6a7c14e570 2023-11-15T02:36:35.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a808d1700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0b1140 con 0x7f6a7c0aa440 2023-11-15T02:36:35.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a808d1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0b0530 con 0x7f6a7c0aa820 2023-11-15T02:36:35.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a7b59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a7c14e570 0x7f6a7c167da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a7b59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a7c14e570 0x7f6a7c167da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44054/0 (socket says 172.21.15.1:44054) 2023-11-15T02:36:35.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a7b59e700 1 -- 172.21.15.1:0/1890776574 learned_addr learned my addr 172.21.15.1:0/1890776574 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:35.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a7a59c700 1 --2- 172.21.15.1:0/1890776574 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7c0aa820 0x7f6a7c14e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a7ad9d700 1 --2- 172.21.15.1:0/1890776574 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a7c0aa440 0x7f6a7c14c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a7b59e700 1 -- 172.21.15.1:0/1890776574 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7c0aa820 msgr2=0x7f6a7c14e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a7b59e700 1 --2- 172.21.15.1:0/1890776574 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7c0aa820 0x7f6a7c14e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a7b59e700 1 -- 172.21.15.1:0/1890776574 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a7c0aa440 msgr2=0x7f6a7c14c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a7b59e700 1 --2- 172.21.15.1:0/1890776574 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a7c0aa440 0x7f6a7c14c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a7b59e700 1 -- 172.21.15.1:0/1890776574 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c0b0810 con 0x7f6a7c14e570 2023-11-15T02:36:35.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a7b59e700 1 --2- 172.21.15.1:0/1890776574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a7c14e570 0x7f6a7c167da0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f6a6c013000 tx=0x7f6a6c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:35.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a72ffd700 1 -- 172.21.15.1:0/1890776574 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c00b410 con 0x7f6a7c14e570 2023-11-15T02:36:35.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a72ffd700 1 -- 172.21.15.1:0/1890776574 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c012630 con 0x7f6a7c14e570 2023-11-15T02:36:35.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a808d1700 1 -- 172.21.15.1:0/1890776574 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7c0b02e0 con 0x7f6a7c14e570 2023-11-15T02:36:35.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a72ffd700 1 -- 172.21.15.1:0/1890776574 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0127a0 con 0x7f6a7c14e570 2023-11-15T02:36:35.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.991+0000 7f6a808d1700 1 -- 172.21.15.1:0/1890776574 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7c0b0dd0 con 0x7f6a7c14e570 2023-11-15T02:36:35.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.992+0000 7f6a808d1700 1 -- 172.21.15.1:0/1890776574 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7c0475e0 con 0x7f6a7c14e570 2023-11-15T02:36:35.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.993+0000 7f6a72ffd700 1 -- 172.21.15.1:0/1890776574 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6a6c022030 con 0x7f6a7c14e570 2023-11-15T02:36:35.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.993+0000 7f6a72ffd700 1 --2- 172.21.15.1:0/1890776574 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a5c05f240 0x7f6a5c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.993+0000 7f6a72ffd700 1 -- 172.21.15.1:0/1890776574 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f6a6c000e40 con 0x7f6a7c14e570 2023-11-15T02:36:35.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.993+0000 7f6a7ad9d700 1 --2- 172.21.15.1:0/1890776574 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a5c05f240 0x7f6a5c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.993+0000 7f6a7ad9d700 1 --2- 172.21.15.1:0/1890776574 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a5c05f240 0x7f6a5c061700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6a74007be0 tx=0x7f6a7c1557a0).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:35.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:34.997+0000 7f6a72ffd700 1 -- 172.21.15.1:0/1890776574 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6a6c04c4d0 con 0x7f6a7c14e570 2023-11-15T02:36:35.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.170+0000 7f6a808d1700 1 -- 172.21.15.1:0/1890776574 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6a7c154c20 con 0x7f6a7c14e570 2023-11-15T02:36:35.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.170+0000 7f6a72ffd700 1 -- 172.21.15.1:0/1890776574 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v158) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6a6c02a020 con 0x7f6a7c14e570 2023-11-15T02:36:35.171 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T02:36:35.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.172+0000 7f6a808d1700 1 -- 172.21.15.1:0/1890776574 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a5c05f240 msgr2=0x7f6a5c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.172+0000 7f6a808d1700 1 --2- 172.21.15.1:0/1890776574 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a5c05f240 0x7f6a5c061700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6a74007be0 tx=0x7f6a7c1557a0).stop 2023-11-15T02:36:35.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.172+0000 7f6a808d1700 1 -- 172.21.15.1:0/1890776574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a7c14e570 msgr2=0x7f6a7c167da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.172+0000 7f6a808d1700 1 --2- 172.21.15.1:0/1890776574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a7c14e570 0x7f6a7c167da0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f6a6c013000 tx=0x7f6a6c008040).stop 2023-11-15T02:36:35.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.172+0000 7f6a808d1700 1 -- 172.21.15.1:0/1890776574 shutdown_connections 2023-11-15T02:36:35.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.172+0000 7f6a808d1700 1 --2- 172.21.15.1:0/1890776574 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a5c05f240 0x7f6a5c061700 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.172+0000 7f6a808d1700 1 --2- 172.21.15.1:0/1890776574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a7c14e570 0x7f6a7c167da0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.172+0000 7f6a808d1700 1 --2- 172.21.15.1:0/1890776574 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a7c0aa440 0x7f6a7c14c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.172+0000 7f6a808d1700 1 --2- 172.21.15.1:0/1890776574 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7c0aa820 0x7f6a7c14e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.172+0000 7f6a808d1700 1 -- 172.21.15.1:0/1890776574 >> 172.21.15.1:0/1890776574 conn(0x7f6a7c069ee0 msgr2=0x7f6a7c0cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:35.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.172+0000 7f6a808d1700 1 -- 172.21.15.1:0/1890776574 shutdown_connections 2023-11-15T02:36:35.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.172+0000 7f6a808d1700 1 -- 172.21.15.1:0/1890776574 wait complete. 2023-11-15T02:36:35.185 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T02:36:35.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.305+0000 7f3e849c0700 1 Processor -- start 2023-11-15T02:36:35.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.305+0000 7f3e849c0700 1 -- start start 2023-11-15T02:36:35.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.306+0000 7f3e849c0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e801545b0 0x7f3e800c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.306+0000 7f3e849c0700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3e800c7f50 0x7f3e800c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.306+0000 7f3e849c0700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e80155830 con 0x7f3e801541d0 2023-11-15T02:36:35.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.306+0000 7f3e849c0700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e80158f40 con 0x7f3e800c7f50 2023-11-15T02:36:35.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.306+0000 7f3e849c0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e80154a30 con 0x7f3e801545b0 2023-11-15T02:36:35.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.306+0000 7f3e7f7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3e801541d0 0x7f3e800c60d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41216/0 (socket says 172.21.15.1:41216) 2023-11-15T02:36:35.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.306+0000 7f3e7f7fe700 1 -- 172.21.15.1:0/3157847650 learned_addr learned my addr 172.21.15.1:0/3157847650 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:35.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.306+0000 7f3e7ffff700 1 --2- 172.21.15.1:0/3157847650 >> v2:172.21.15.141:3300/0 conn(0x7f3e800c7f50 0x7f3e800c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.306+0000 7f3e7effd700 1 --2- 172.21.15.1:0/3157847650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e801545b0 0x7f3e800c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.306+0000 7f3e7e7fc700 1 -- 172.21.15.1:0/3157847650 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095724775 0 0) 0x7f3e80155830 con 0x7f3e801541d0 2023-11-15T02:36:35.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.306+0000 7f3e7e7fc700 1 -- 172.21.15.1:0/3157847650 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e680033f0 con 0x7f3e801541d0 2023-11-15T02:36:35.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 -- 172.21.15.1:0/3157847650 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 725382648 0 0) 0x7f3e680033f0 con 0x7f3e801541d0 2023-11-15T02:36:35.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 -- 172.21.15.1:0/3157847650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e801545b0 msgr2=0x7f3e800c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:35.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 --2- 172.21.15.1:0/3157847650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e801545b0 0x7f3e800c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 -- 172.21.15.1:0/3157847650 >> v2:172.21.15.141:3300/0 conn(0x7f3e800c7f50 msgr2=0x7f3e800c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:35.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 --2- 172.21.15.1:0/3157847650 >> v2:172.21.15.141:3300/0 conn(0x7f3e800c7f50 0x7f3e800c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 -- 172.21.15.1:0/3157847650 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e800c83a0 con 0x7f3e801541d0 2023-11-15T02:36:35.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 -- 172.21.15.1:0/3157847650 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f3e70001470 con 0x7f3e801541d0 2023-11-15T02:36:35.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 -- 172.21.15.1:0/3157847650 >> v1:172.21.15.1:6789/0 conn(0x7f3e801541d0 legacy=0x7f3e800c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 --2- 172.21.15.1:0/3157847650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e680038e0 0x7f3e68003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 --2- 172.21.15.1:0/3157847650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e68004690 0x7f3e68004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 --2- 172.21.15.1:0/3157847650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e801545b0 0x7f3e68005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 -- 172.21.15.1:0/3157847650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e68004480 con 0x7f3e680038e0 2023-11-15T02:36:35.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 -- 172.21.15.1:0/3157847650 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6800b8e0 con 0x7f3e68004690 2023-11-15T02:36:35.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 -- 172.21.15.1:0/3157847650 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6800ba50 con 0x7f3e801545b0 2023-11-15T02:36:35.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7f7fe700 1 --2- 172.21.15.1:0/3157847650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e680038e0 0x7f3e68003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7effd700 1 --2- 172.21.15.1:0/3157847650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e68004690 0x7f3e68004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7ffff700 1 --2- 172.21.15.1:0/3157847650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e801545b0 0x7f3e68005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7f7fe700 1 -- 172.21.15.1:0/3157847650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e801545b0 msgr2=0x7f3e68005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:35.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7f7fe700 1 --2- 172.21.15.1:0/3157847650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e801545b0 0x7f3e68005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7f7fe700 1 -- 172.21.15.1:0/3157847650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e68004690 msgr2=0x7f3e68004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:35.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7f7fe700 1 --2- 172.21.15.1:0/3157847650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e68004690 0x7f3e68004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7f7fe700 1 -- 172.21.15.1:0/3157847650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e680033f0 con 0x7f3e680038e0 2023-11-15T02:36:35.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7f7fe700 1 --2- 172.21.15.1:0/3157847650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e680038e0 0x7f3e68003d00 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f3e7000c210 tx=0x7f3e801557a0).ready entity=mon.0 client_cookie=5ed7327a890af070 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:35.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 -- 172.21.15.1:0/3157847650 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70007a60 con 0x7f3e680038e0 2023-11-15T02:36:35.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 -- 172.21.15.1:0/3157847650 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7000cae0 con 0x7f3e680038e0 2023-11-15T02:36:35.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.307+0000 7f3e7e7fc700 1 -- 172.21.15.1:0/3157847650 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000ce80 con 0x7f3e680038e0 2023-11-15T02:36:35.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.308+0000 7f3e849c0700 1 -- 172.21.15.1:0/3157847650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e680038e0 msgr2=0x7f3e68003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.308+0000 7f3e849c0700 1 --2- 172.21.15.1:0/3157847650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e680038e0 0x7f3e68003d00 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f3e7000c210 tx=0x7f3e801557a0).stop 2023-11-15T02:36:35.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.308+0000 7f3e7ffff700 1 -- 172.21.15.1:0/3157847650 reap_dead start 2023-11-15T02:36:35.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.308+0000 7f3e849c0700 1 -- 172.21.15.1:0/3157847650 shutdown_connections 2023-11-15T02:36:35.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.308+0000 7f3e849c0700 1 -- 172.21.15.1:0/3157847650 >> 172.21.15.1:0/3157847650 conn(0x7f3e80069ee0 msgr2=0x7f3e8006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:35.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.308+0000 7f3e849c0700 1 -- 172.21.15.1:0/3157847650 shutdown_connections 2023-11-15T02:36:35.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.308+0000 7f3e849c0700 1 -- 172.21.15.1:0/3157847650 wait complete. 2023-11-15T02:36:35.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.309+0000 7f3e849c0700 1 Processor -- start 2023-11-15T02:36:35.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.309+0000 7f3e849c0700 1 -- start start 2023-11-15T02:36:35.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e849c0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e680038e0 0x7f3e800ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e849c0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e80168930 0x7f3e800aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e849c0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e800abf30 0x7f3e80167ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e849c0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800ae970 con 0x7f3e680038e0 2023-11-15T02:36:35.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e849c0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800ad1b0 con 0x7f3e800abf30 2023-11-15T02:36:35.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e849c0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800ac410 con 0x7f3e80168930 2023-11-15T02:36:35.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e7f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e680038e0 0x7f3e800ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e7f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e680038e0 0x7f3e800ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44072/0 (socket says 172.21.15.1:44072) 2023-11-15T02:36:35.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e7f7fe700 1 -- 172.21.15.1:0/1571617151 learned_addr learned my addr 172.21.15.1:0/1571617151 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:35.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e7effd700 1 --2- 172.21.15.1:0/1571617151 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e80168930 0x7f3e800aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e7ffff700 1 --2- 172.21.15.1:0/1571617151 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e800abf30 0x7f3e80167ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e7f7fe700 1 -- 172.21.15.1:0/1571617151 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e80168930 msgr2=0x7f3e800aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e7f7fe700 1 --2- 172.21.15.1:0/1571617151 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e80168930 0x7f3e800aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e7f7fe700 1 -- 172.21.15.1:0/1571617151 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e800abf30 msgr2=0x7f3e80167ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e7f7fe700 1 --2- 172.21.15.1:0/1571617151 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e800abf30 0x7f3e80167ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e7f7fe700 1 -- 172.21.15.1:0/1571617151 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e800ac6d0 con 0x7f3e680038e0 2023-11-15T02:36:35.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.310+0000 7f3e7f7fe700 1 --2- 172.21.15.1:0/1571617151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e680038e0 0x7f3e800ae0b0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f3e7000c800 tx=0x7f3e70015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:35.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.311+0000 7f3e677fe700 1 -- 172.21.15.1:0/1571617151 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e700074f0 con 0x7f3e680038e0 2023-11-15T02:36:35.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.311+0000 7f3e677fe700 1 -- 172.21.15.1:0/1571617151 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e70007650 con 0x7f3e680038e0 2023-11-15T02:36:35.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.311+0000 7f3e849c0700 1 -- 172.21.15.1:0/1571617151 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e800ac9b0 con 0x7f3e680038e0 2023-11-15T02:36:35.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.311+0000 7f3e677fe700 1 -- 172.21.15.1:0/1571617151 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e700048c0 con 0x7f3e680038e0 2023-11-15T02:36:35.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.311+0000 7f3e849c0700 1 -- 172.21.15.1:0/1571617151 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e800ae5a0 con 0x7f3e680038e0 2023-11-15T02:36:35.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.312+0000 7f3e849c0700 1 -- 172.21.15.1:0/1571617151 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e800475e0 con 0x7f3e680038e0 2023-11-15T02:36:35.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.312+0000 7f3e677fe700 1 -- 172.21.15.1:0/1571617151 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3e70004cb0 con 0x7f3e680038e0 2023-11-15T02:36:35.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.312+0000 7f3e677fe700 1 --2- 172.21.15.1:0/1571617151 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e6c05f270 0x7f3e6c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.312+0000 7f3e677fe700 1 -- 172.21.15.1:0/1571617151 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f3e7001c040 con 0x7f3e680038e0 2023-11-15T02:36:35.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.313+0000 7f3e7effd700 1 --2- 172.21.15.1:0/1571617151 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e6c05f270 0x7f3e6c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.313+0000 7f3e7effd700 1 --2- 172.21.15.1:0/1571617151 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e6c05f270 0x7f3e6c061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3e80148710 tx=0x7f3e74009060).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:35.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.317+0000 7f3e677fe700 1 -- 172.21.15.1:0/1571617151 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3e700a9af0 con 0x7f3e680038e0 2023-11-15T02:36:35.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.490+0000 7f3e849c0700 1 -- 172.21.15.1:0/1571617151 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3e80154c20 con 0x7f3e680038e0 2023-11-15T02:36:35.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.491+0000 7f3e677fe700 1 -- 172.21.15.1:0/1571617151 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v158) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3e70026070 con 0x7f3e680038e0 2023-11-15T02:36:35.492 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T02:36:35.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.493+0000 7f3e849c0700 1 -- 172.21.15.1:0/1571617151 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e6c05f270 msgr2=0x7f3e6c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.493+0000 7f3e849c0700 1 --2- 172.21.15.1:0/1571617151 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e6c05f270 0x7f3e6c061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3e80148710 tx=0x7f3e74009060).stop 2023-11-15T02:36:35.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.493+0000 7f3e849c0700 1 -- 172.21.15.1:0/1571617151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e680038e0 msgr2=0x7f3e800ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.493+0000 7f3e849c0700 1 --2- 172.21.15.1:0/1571617151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e680038e0 0x7f3e800ae0b0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f3e7000c800 tx=0x7f3e70015000).stop 2023-11-15T02:36:35.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.493+0000 7f3e849c0700 1 -- 172.21.15.1:0/1571617151 shutdown_connections 2023-11-15T02:36:35.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.493+0000 7f3e849c0700 1 --2- 172.21.15.1:0/1571617151 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3e6c05f270 0x7f3e6c061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.493+0000 7f3e849c0700 1 --2- 172.21.15.1:0/1571617151 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3e800abf30 0x7f3e80167ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.493+0000 7f3e849c0700 1 --2- 172.21.15.1:0/1571617151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e680038e0 0x7f3e800ae0b0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.493+0000 7f3e849c0700 1 --2- 172.21.15.1:0/1571617151 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3e80168930 0x7f3e800aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.493+0000 7f3e849c0700 1 -- 172.21.15.1:0/1571617151 >> 172.21.15.1:0/1571617151 conn(0x7f3e80069ee0 msgr2=0x7f3e800cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:35.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.493+0000 7f3e849c0700 1 -- 172.21.15.1:0/1571617151 shutdown_connections 2023-11-15T02:36:35.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.493+0000 7f3e849c0700 1 -- 172.21.15.1:0/1571617151 wait complete. 2023-11-15T02:36:35.506 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-15T02:36:35.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.624+0000 7f2463129700 1 Processor -- start 2023-11-15T02:36:35.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.624+0000 7f2463129700 1 -- start start 2023-11-15T02:36:35.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2463129700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f245c151e10 0x7f245c155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2463129700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f245c0c86b0 0x7f245c0aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2463129700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f245c0c98b0 0x7f245c0c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2463129700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245c0c7980 con 0x7f245c151e10 2023-11-15T02:36:35.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2463129700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245c0c8b10 con 0x7f245c0c98b0 2023-11-15T02:36:35.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2463129700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0ca210 con 0x7f245c0c86b0 2023-11-15T02:36:35.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2462127700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f245c151e10 0x7f245c155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2462127700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f245c151e10 0x7f245c155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44082/0 (socket says 172.21.15.1:44082) 2023-11-15T02:36:35.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2462127700 1 -- 172.21.15.1:0/2617117417 learned_addr learned my addr 172.21.15.1:0/2617117417 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:35.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2462127700 1 -- 172.21.15.1:0/2617117417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f245c0c86b0 msgr2=0x7f245c0aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:35.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2462928700 1 --2- 172.21.15.1:0/2617117417 >> v2:172.21.15.141:3300/0 conn(0x7f245c0c98b0 0x7f245c0c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2461926700 1 --2- 172.21.15.1:0/2617117417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f245c0c86b0 0x7f245c0aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2462127700 1 --2- 172.21.15.1:0/2617117417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f245c0c86b0 0x7f245c0aa0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2462127700 1 -- 172.21.15.1:0/2617117417 >> v2:172.21.15.141:3300/0 conn(0x7f245c0c98b0 msgr2=0x7f245c0c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:35.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2462127700 1 --2- 172.21.15.1:0/2617117417 >> v2:172.21.15.141:3300/0 conn(0x7f245c0c98b0 0x7f245c0c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2462127700 1 -- 172.21.15.1:0/2617117417 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c0aa5c0 con 0x7f245c151e10 2023-11-15T02:36:35.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.625+0000 7f2462928700 1 --2- 172.21.15.1:0/2617117417 >> v2:172.21.15.141:3300/0 conn(0x7f245c0c98b0 0x7f245c0c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:35.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.626+0000 7f2462127700 1 --2- 172.21.15.1:0/2617117417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f245c151e10 0x7f245c155530 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f245c083a20 tx=0x7f24540090f0).ready entity=mon.0 client_cookie=57aaa909abd65b6a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:35.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.626+0000 7f2461125700 1 -- 172.21.15.1:0/2617117417 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400b600 con 0x7f245c151e10 2023-11-15T02:36:35.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.626+0000 7f2461125700 1 -- 172.21.15.1:0/2617117417 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245400b760 con 0x7f245c151e10 2023-11-15T02:36:35.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.626+0000 7f2461125700 1 -- 172.21.15.1:0/2617117417 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400bae0 con 0x7f245c151e10 2023-11-15T02:36:35.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.626+0000 7f2463129700 1 -- 172.21.15.1:0/2617117417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f245c151e10 msgr2=0x7f245c155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.626+0000 7f2463129700 1 --2- 172.21.15.1:0/2617117417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f245c151e10 0x7f245c155530 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f245c083a20 tx=0x7f24540090f0).stop 2023-11-15T02:36:35.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.626+0000 7f2463129700 1 -- 172.21.15.1:0/2617117417 shutdown_connections 2023-11-15T02:36:35.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.626+0000 7f2463129700 1 --2- 172.21.15.1:0/2617117417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f245c151e10 0x7f245c155530 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.626+0000 7f2463129700 1 --2- 172.21.15.1:0/2617117417 >> v2:172.21.15.141:3300/0 conn(0x7f245c0c98b0 0x7f245c0c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.626+0000 7f2463129700 1 --2- 172.21.15.1:0/2617117417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f245c0c86b0 0x7f245c0aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.626+0000 7f2463129700 1 -- 172.21.15.1:0/2617117417 >> 172.21.15.1:0/2617117417 conn(0x7f245c0947e0 msgr2=0x7f245c06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:35.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.626+0000 7f2463129700 1 -- 172.21.15.1:0/2617117417 shutdown_connections 2023-11-15T02:36:35.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.626+0000 7f2463129700 1 -- 172.21.15.1:0/2617117417 wait complete. 2023-11-15T02:36:35.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.627+0000 7f2463129700 1 Processor -- start 2023-11-15T02:36:35.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.627+0000 7f2463129700 1 -- start start 2023-11-15T02:36:35.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.628+0000 7f2463129700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f245c0c86b0 0x7f245c14fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.628+0000 7f2463129700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f245c0c98b0 0x7f245c0abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.628+0000 7f2463129700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f245c151e10 0x7f245c0ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.628+0000 7f2463129700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c154880 con 0x7f245c0c86b0 2023-11-15T02:36:35.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.628+0000 7f2463129700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0ae5c0 con 0x7f245c151e10 2023-11-15T02:36:35.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.628+0000 7f2463129700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0b08f0 con 0x7f245c0c98b0 2023-11-15T02:36:35.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.628+0000 7f2462127700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f245c0c86b0 0x7f245c14fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.628+0000 7f2462127700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f245c0c86b0 0x7f245c14fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44094/0 (socket says 172.21.15.1:44094) 2023-11-15T02:36:35.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.628+0000 7f2462127700 1 -- 172.21.15.1:0/1681178172 learned_addr learned my addr 172.21.15.1:0/1681178172 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:35.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.628+0000 7f2461926700 1 --2- 172.21.15.1:0/1681178172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f245c0c98b0 0x7f245c0abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.628+0000 7f2462928700 1 --2- 172.21.15.1:0/1681178172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f245c151e10 0x7f245c0ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.629+0000 7f2462127700 1 -- 172.21.15.1:0/1681178172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f245c0c98b0 msgr2=0x7f245c0abbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.629+0000 7f2462127700 1 --2- 172.21.15.1:0/1681178172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f245c0c98b0 0x7f245c0abbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.629+0000 7f2462127700 1 -- 172.21.15.1:0/1681178172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f245c151e10 msgr2=0x7f245c0ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.629+0000 7f2462127700 1 --2- 172.21.15.1:0/1681178172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f245c151e10 0x7f245c0ac0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.629+0000 7f2462127700 1 -- 172.21.15.1:0/1681178172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2454009370 con 0x7f245c0c86b0 2023-11-15T02:36:35.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.629+0000 7f2462928700 1 --2- 172.21.15.1:0/1681178172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f245c151e10 0x7f245c0ac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:35.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.629+0000 7f2462127700 1 --2- 172.21.15.1:0/1681178172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f245c0c86b0 0x7f245c14fe50 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f2454009130 tx=0x7f2454017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:35.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.629+0000 7f245a7fc700 1 -- 172.21.15.1:0/1681178172 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400bae0 con 0x7f245c0c86b0 2023-11-15T02:36:35.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.629+0000 7f245a7fc700 1 -- 172.21.15.1:0/1681178172 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2454000c90 con 0x7f245c0c86b0 2023-11-15T02:36:35.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.629+0000 7f245a7fc700 1 -- 172.21.15.1:0/1681178172 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245401b660 con 0x7f245c0c86b0 2023-11-15T02:36:35.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.629+0000 7f2463129700 1 -- 172.21.15.1:0/1681178172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245c0b0bd0 con 0x7f245c0c86b0 2023-11-15T02:36:35.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.629+0000 7f2463129700 1 -- 172.21.15.1:0/1681178172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245c150340 con 0x7f245c0c86b0 2023-11-15T02:36:35.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.630+0000 7f2463129700 1 -- 172.21.15.1:0/1681178172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245c0ae8a0 con 0x7f245c0c86b0 2023-11-15T02:36:35.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.630+0000 7f245a7fc700 1 -- 172.21.15.1:0/1681178172 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f245401ba10 con 0x7f245c0c86b0 2023-11-15T02:36:35.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.631+0000 7f245a7fc700 1 --2- 172.21.15.1:0/1681178172 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f244805f270 0x7f2448061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.631+0000 7f245a7fc700 1 -- 172.21.15.1:0/1681178172 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f245407b850 con 0x7f245c0c86b0 2023-11-15T02:36:35.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.631+0000 7f2461926700 1 --2- 172.21.15.1:0/1681178172 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f244805f270 0x7f2448061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.631+0000 7f2461926700 1 --2- 172.21.15.1:0/1681178172 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f244805f270 0x7f2448061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2450006fd0 tx=0x7f2450008040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:35.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.635+0000 7f245a7fc700 1 -- 172.21.15.1:0/1681178172 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f245404cb00 con 0x7f245c0c86b0 2023-11-15T02:36:35.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.812+0000 7f2463129700 1 -- 172.21.15.1:0/1681178172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f245c0ae0b0 con 0x7f245c0c86b0 2023-11-15T02:36:35.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.812+0000 7f245a7fc700 1 -- 172.21.15.1:0/1681178172 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v158) v1 ==== 84+0+143 (secure 0 0 0) 0x7f245c0ae0b0 con 0x7f245c0c86b0 2023-11-15T02:36:35.813 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:35.814 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T02:36:35.814 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:35.814 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2023-11-15T02:36:35.814 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "device_health_metrics" 2023-11-15T02:36:35.814 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:36:35.815 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:35.815 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 2, 2023-11-15T02:36:35.815 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "rbd" 2023-11-15T02:36:35.815 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:35.815 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T02:36:35.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.814+0000 7f2463129700 1 -- 172.21.15.1:0/1681178172 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f244805f270 msgr2=0x7f2448061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.814+0000 7f2463129700 1 --2- 172.21.15.1:0/1681178172 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f244805f270 0x7f2448061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2450006fd0 tx=0x7f2450008040).stop 2023-11-15T02:36:35.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.814+0000 7f2463129700 1 -- 172.21.15.1:0/1681178172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f245c0c86b0 msgr2=0x7f245c14fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.814+0000 7f2463129700 1 --2- 172.21.15.1:0/1681178172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f245c0c86b0 0x7f245c14fe50 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f2454009130 tx=0x7f2454017000).stop 2023-11-15T02:36:35.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.814+0000 7f2463129700 1 -- 172.21.15.1:0/1681178172 shutdown_connections 2023-11-15T02:36:35.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.814+0000 7f2463129700 1 --2- 172.21.15.1:0/1681178172 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f244805f270 0x7f2448061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.814+0000 7f2463129700 1 --2- 172.21.15.1:0/1681178172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f245c151e10 0x7f245c0ac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.814+0000 7f2463129700 1 --2- 172.21.15.1:0/1681178172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f245c0c86b0 0x7f245c14fe50 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.814+0000 7f2463129700 1 --2- 172.21.15.1:0/1681178172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f245c0c98b0 0x7f245c0abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.814+0000 7f2463129700 1 -- 172.21.15.1:0/1681178172 >> 172.21.15.1:0/1681178172 conn(0x7f245c0947e0 msgr2=0x7f245c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:35.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.814+0000 7f2463129700 1 -- 172.21.15.1:0/1681178172 shutdown_connections 2023-11-15T02:36:35.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.814+0000 7f2463129700 1 -- 172.21.15.1:0/1681178172 wait complete. 2023-11-15T02:36:35.827 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-15T02:36:35.827 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-15T02:36:35.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.949+0000 7f31cfa90700 1 Processor -- start 2023-11-15T02:36:35.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.949+0000 7f31cfa90700 1 -- start start 2023-11-15T02:36:35.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.950+0000 7f31cfa90700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f31c80c1cb0 0x7f31c8157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.950+0000 7f31cfa90700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c80c1820 con 0x7f31c8157660 2023-11-15T02:36:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.950+0000 7f31cfa90700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c80c0c30 con 0x7f31c80aa060 2023-11-15T02:36:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.950+0000 7f31cfa90700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c80c7540 con 0x7f31c80c1cb0 2023-11-15T02:36:35.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.950+0000 7f31cd82c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f31c8157660 0x7f31c80c6280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41226/0 (socket says 172.21.15.1:41226) 2023-11-15T02:36:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.950+0000 7f31cd82c700 1 -- 172.21.15.1:0/1101937831 learned_addr learned my addr 172.21.15.1:0/1101937831 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.950+0000 7f31cc82a700 1 -- 172.21.15.1:0/1101937831 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545959212 0 0) 0x7f31c80c1820 con 0x7f31c8157660 2023-11-15T02:36:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.950+0000 7f31cd02b700 1 --2- 172.21.15.1:0/1101937831 >> v2:172.21.15.141:3300/0 conn(0x7f31c80c1cb0 0x7f31c8157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.950+0000 7f31cc82a700 1 -- 172.21.15.1:0/1101937831 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b00033f0 con 0x7f31c8157660 2023-11-15T02:36:35.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cc82a700 1 -- 172.21.15.1:0/1101937831 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2632051522 0 0) 0x7f31b00033f0 con 0x7f31c8157660 2023-11-15T02:36:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cc82a700 1 -- 172.21.15.1:0/1101937831 >> v2:172.21.15.141:3300/0 conn(0x7f31c80c1cb0 msgr2=0x7f31c8157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cc82a700 1 --2- 172.21.15.1:0/1101937831 >> v2:172.21.15.141:3300/0 conn(0x7f31c80c1cb0 0x7f31c8157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cc82a700 1 -- 172.21.15.1:0/1101937831 >> v1:172.21.15.141:6789/0 conn(0x7f31c80aa060 legacy=0x7f31c80ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cc82a700 1 -- 172.21.15.1:0/1101937831 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c80c0ef0 con 0x7f31c8157660 2023-11-15T02:36:35.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cc82a700 1 -- 172.21.15.1:0/1101937831 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f31b8001470 con 0x7f31c8157660 2023-11-15T02:36:35.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cc82a700 1 -- 172.21.15.1:0/1101937831 >> v1:172.21.15.1:6789/0 conn(0x7f31c8157660 legacy=0x7f31c80c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cc82a700 1 --2- 172.21.15.1:0/1101937831 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31b00038e0 0x7f31b0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cc82a700 1 --2- 172.21.15.1:0/1101937831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31b0004690 0x7f31b0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cc82a700 1 --2- 172.21.15.1:0/1101937831 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31b0005050 0x7f31b000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cc82a700 1 -- 172.21.15.1:0/1101937831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b000bfb0 con 0x7f31b0004690 2023-11-15T02:36:35.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cc82a700 1 -- 172.21.15.1:0/1101937831 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b000c120 con 0x7f31b0005050 2023-11-15T02:36:35.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cc82a700 1 -- 172.21.15.1:0/1101937831 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b000c2e0 con 0x7f31b00038e0 2023-11-15T02:36:35.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cd02b700 1 --2- 172.21.15.1:0/1101937831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31b0004690 0x7f31b0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cd82c700 1 --2- 172.21.15.1:0/1101937831 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31b00038e0 0x7f31b0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31ce02d700 1 --2- 172.21.15.1:0/1101937831 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31b0005050 0x7f31b000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cd02b700 1 -- 172.21.15.1:0/1101937831 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31b00038e0 msgr2=0x7f31b0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:35.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cd02b700 1 --2- 172.21.15.1:0/1101937831 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31b00038e0 0x7f31b0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cd02b700 1 -- 172.21.15.1:0/1101937831 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31b0005050 msgr2=0x7f31b000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:35.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cd02b700 1 --2- 172.21.15.1:0/1101937831 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31b0005050 0x7f31b000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31ce02d700 1 -- 172.21.15.1:0/1101937831 reap_dead start 2023-11-15T02:36:35.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cd02b700 1 -- 172.21.15.1:0/1101937831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b00033f0 con 0x7f31b0004690 2023-11-15T02:36:35.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cd02b700 1 --2- 172.21.15.1:0/1101937831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31b0004690 0x7f31b0004b10 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f31bc006d80 tx=0x7f31bc009060).ready entity=mon.0 client_cookie=5ede3272a00cd627 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:35.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.951+0000 7f31cc82a700 1 -- 172.21.15.1:0/1101937831 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc009e90 con 0x7f31b0004690 2023-11-15T02:36:35.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.952+0000 7f31cc82a700 1 -- 172.21.15.1:0/1101937831 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc00e640 con 0x7f31b0004690 2023-11-15T02:36:35.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.952+0000 7f31cc82a700 1 -- 172.21.15.1:0/1101937831 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00ea00 con 0x7f31b0004690 2023-11-15T02:36:35.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.952+0000 7f31cfa90700 1 -- 172.21.15.1:0/1101937831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31b0004690 msgr2=0x7f31b0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.952+0000 7f31cfa90700 1 --2- 172.21.15.1:0/1101937831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31b0004690 0x7f31b0004b10 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f31bc006d80 tx=0x7f31bc009060).stop 2023-11-15T02:36:35.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.952+0000 7f31cfa90700 1 -- 172.21.15.1:0/1101937831 shutdown_connections 2023-11-15T02:36:35.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.952+0000 7f31cfa90700 1 --2- 172.21.15.1:0/1101937831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31b0004690 0x7f31b0004b10 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.952+0000 7f31cfa90700 1 -- 172.21.15.1:0/1101937831 >> 172.21.15.1:0/1101937831 conn(0x7f31c8064aa0 msgr2=0x7f31c8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:35.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.952+0000 7f31cfa90700 1 -- 172.21.15.1:0/1101937831 shutdown_connections 2023-11-15T02:36:35.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.952+0000 7f31cfa90700 1 -- 172.21.15.1:0/1101937831 wait complete. 2023-11-15T02:36:35.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.953+0000 7f31cfa90700 1 Processor -- start 2023-11-15T02:36:35.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.953+0000 7f31cfa90700 1 -- start start 2023-11-15T02:36:35.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31cfa90700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31b0004690 0x7f31c81528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31cfa90700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c81593a0 0x7f31c80aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31cfa90700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31c80b0360 0x7f31c80b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31cfa90700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c8158f10 con 0x7f31c81593a0 2023-11-15T02:36:35.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31cfa90700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c8152de0 con 0x7f31c80b0360 2023-11-15T02:36:35.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31cfa90700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80b0cd0 con 0x7f31b0004690 2023-11-15T02:36:35.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31cd02b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c81593a0 0x7f31c80aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31cd02b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c81593a0 0x7f31c80aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44100/0 (socket says 172.21.15.1:44100) 2023-11-15T02:36:35.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31cd02b700 1 -- 172.21.15.1:0/591841884 learned_addr learned my addr 172.21.15.1:0/591841884 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:35.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31cd82c700 1 --2- 172.21.15.1:0/591841884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31b0004690 0x7f31c81528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31ce02d700 1 --2- 172.21.15.1:0/591841884 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31c80b0360 0x7f31c80b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31cd02b700 1 -- 172.21.15.1:0/591841884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31b0004690 msgr2=0x7f31c81528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31cd02b700 1 --2- 172.21.15.1:0/591841884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31b0004690 0x7f31c81528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31cd02b700 1 -- 172.21.15.1:0/591841884 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31c80b0360 msgr2=0x7f31c80b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:35.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31cd02b700 1 --2- 172.21.15.1:0/591841884 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31c80b0360 0x7f31c80b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:35.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.954+0000 7f31cd02b700 1 -- 172.21.15.1:0/591841884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c8158300 con 0x7f31c81593a0 2023-11-15T02:36:35.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.955+0000 7f31cd02b700 1 --2- 172.21.15.1:0/591841884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c81593a0 0x7f31c80aef70 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f31bc01cdd0 tx=0x7f31bc01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:35.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.955+0000 7f31c5ffb700 1 -- 172.21.15.1:0/591841884 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc009e90 con 0x7f31c81593a0 2023-11-15T02:36:35.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.955+0000 7f31c5ffb700 1 -- 172.21.15.1:0/591841884 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc00e9c0 con 0x7f31c81593a0 2023-11-15T02:36:35.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.955+0000 7f31cfa90700 1 -- 172.21.15.1:0/591841884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c81585e0 con 0x7f31c81593a0 2023-11-15T02:36:35.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.955+0000 7f31c5ffb700 1 -- 172.21.15.1:0/591841884 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0243f0 con 0x7f31c81593a0 2023-11-15T02:36:35.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.955+0000 7f31cfa90700 1 -- 172.21.15.1:0/591841884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c8158ba0 con 0x7f31c81593a0 2023-11-15T02:36:35.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.956+0000 7f31cfa90700 1 -- 172.21.15.1:0/591841884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c806c7e0 con 0x7f31c81593a0 2023-11-15T02:36:35.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.956+0000 7f31c5ffb700 1 -- 172.21.15.1:0/591841884 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f31bc0247e0 con 0x7f31c81593a0 2023-11-15T02:36:35.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.957+0000 7f31c5ffb700 1 --2- 172.21.15.1:0/591841884 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31b405f270 0x7f31b4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:35.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.957+0000 7f31c5ffb700 1 -- 172.21.15.1:0/591841884 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f31bc07b5a0 con 0x7f31c81593a0 2023-11-15T02:36:35.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.957+0000 7f31cd82c700 1 --2- 172.21.15.1:0/591841884 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31b405f270 0x7f31b4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:35.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.957+0000 7f31cd82c700 1 --2- 172.21.15.1:0/591841884 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31b405f270 0x7f31b4061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f31b8007dd0 tx=0x7f31b8001e50).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:35.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:35.961+0000 7f31c5ffb700 1 -- 172.21.15.1:0/591841884 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f31bc04c8c0 con 0x7f31c81593a0 2023-11-15T02:36:36.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:36.136+0000 7f31cfa90700 1 -- 172.21.15.1:0/591841884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f31c80c11d0 con 0x7f31c81593a0 2023-11-15T02:36:37.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.108+0000 7f31c5ffb700 1 -- 172.21.15.1:0/591841884 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v159) v1 ==== 152+0+0 (secure 0 0 0) 0x7f31bc0160c0 con 0x7f31c81593a0 2023-11-15T02:36:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.113+0000 7f31cfa90700 1 -- 172.21.15.1:0/591841884 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31b405f270 msgr2=0x7f31b4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.113+0000 7f31cfa90700 1 --2- 172.21.15.1:0/591841884 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31b405f270 0x7f31b4061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f31b8007dd0 tx=0x7f31b8001e50).stop 2023-11-15T02:36:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.113+0000 7f31cfa90700 1 -- 172.21.15.1:0/591841884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c81593a0 msgr2=0x7f31c80aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.113+0000 7f31cfa90700 1 --2- 172.21.15.1:0/591841884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c81593a0 0x7f31c80aef70 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f31bc01cdd0 tx=0x7f31bc01a000).stop 2023-11-15T02:36:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.115+0000 7f31cfa90700 1 -- 172.21.15.1:0/591841884 shutdown_connections 2023-11-15T02:36:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.115+0000 7f31cfa90700 1 --2- 172.21.15.1:0/591841884 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f31b405f270 0x7f31b4061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.115+0000 7f31cfa90700 1 --2- 172.21.15.1:0/591841884 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f31c80b0360 0x7f31c80b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.115+0000 7f31cfa90700 1 --2- 172.21.15.1:0/591841884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f31b0004690 0x7f31c81528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.115+0000 7f31cfa90700 1 --2- 172.21.15.1:0/591841884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c81593a0 0x7f31c80aef70 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.115+0000 7f31cfa90700 1 -- 172.21.15.1:0/591841884 >> 172.21.15.1:0/591841884 conn(0x7f31c8064aa0 msgr2=0x7f31c80ca900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.116+0000 7f31cfa90700 1 -- 172.21.15.1:0/591841884 shutdown_connections 2023-11-15T02:36:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.117+0000 7f31cfa90700 1 -- 172.21.15.1:0/591841884 wait complete. 2023-11-15T02:36:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2023-11-15T02:36:37.133 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-15T02:36:37.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.263+0000 7fe4fd25c700 1 Processor -- start 2023-11-15T02:36:37.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.263+0000 7fe4fd25c700 1 -- start start 2023-11-15T02:36:37.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.264+0000 7fe4fd25c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe4f81540a0 0x7fe4f80ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:37.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.264+0000 7fe4fd25c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4f80c6650 0x7fe4f80ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:37.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.264+0000 7fe4fd25c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f80ca050 con 0x7fe4f8154480 2023-11-15T02:36:37.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.264+0000 7fe4fd25c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f80c9440 con 0x7fe4f81540a0 2023-11-15T02:36:37.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.264+0000 7fe4fd25c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80c9720 con 0x7fe4f80c6650 2023-11-15T02:36:37.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.264+0000 7fe4f6d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe4f81540a0 0x7fe4f80ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:37.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.264+0000 7fe4f6d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe4f81540a0 0x7fe4f80ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44112/0 (socket says 172.21.15.1:44112) 2023-11-15T02:36:37.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.264+0000 7fe4f6d9d700 1 -- 172.21.15.1:0/4168108036 learned_addr learned my addr 172.21.15.1:0/4168108036 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:37.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.264+0000 7fe4f6d9d700 1 -- 172.21.15.1:0/4168108036 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4f80c6650 msgr2=0x7fe4f80ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:37.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.264+0000 7fe4f6d9d700 1 --2- 172.21.15.1:0/4168108036 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4f80c6650 0x7fe4f80ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:37.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.264+0000 7fe4f6d9d700 1 -- 172.21.15.1:0/4168108036 >> v1:172.21.15.141:6789/0 conn(0x7fe4f8154480 legacy=0x7fe4f80c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:37.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.264+0000 7fe4f6d9d700 1 -- 172.21.15.1:0/4168108036 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80c9a00 con 0x7fe4f81540a0 2023-11-15T02:36:37.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.265+0000 7fe4f6d9d700 1 --2- 172.21.15.1:0/4168108036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4f81540a0 0x7fe4f80ca4e0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7fe4f0006fd0 tx=0x7fe4f00090f0).ready entity=mon.0 client_cookie=bec998414f325853 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:37.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.265+0000 7fe4f5d9b700 1 -- 172.21.15.1:0/4168108036 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f000b600 con 0x7fe4f81540a0 2023-11-15T02:36:37.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.265+0000 7fe4f5d9b700 1 -- 172.21.15.1:0/4168108036 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f000b760 con 0x7fe4f81540a0 2023-11-15T02:36:37.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.265+0000 7fe4f5d9b700 1 -- 172.21.15.1:0/4168108036 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f000bae0 con 0x7fe4f81540a0 2023-11-15T02:36:37.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.265+0000 7fe4fd25c700 1 -- 172.21.15.1:0/4168108036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4f81540a0 msgr2=0x7fe4f80ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:37.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.265+0000 7fe4fd25c700 1 --2- 172.21.15.1:0/4168108036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4f81540a0 0x7fe4f80ca4e0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7fe4f0006fd0 tx=0x7fe4f00090f0).stop 2023-11-15T02:36:37.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.265+0000 7fe4fd25c700 1 -- 172.21.15.1:0/4168108036 shutdown_connections 2023-11-15T02:36:37.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.265+0000 7fe4fd25c700 1 --2- 172.21.15.1:0/4168108036 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4f80c6650 0x7fe4f80ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:37.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.265+0000 7fe4fd25c700 1 --2- 172.21.15.1:0/4168108036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4f81540a0 0x7fe4f80ca4e0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:37.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.265+0000 7fe4fd25c700 1 -- 172.21.15.1:0/4168108036 >> 172.21.15.1:0/4168108036 conn(0x7fe4f8064a70 msgr2=0x7fe4f8064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:37.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.265+0000 7fe4fd25c700 1 -- 172.21.15.1:0/4168108036 shutdown_connections 2023-11-15T02:36:37.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.265+0000 7fe4fd25c700 1 -- 172.21.15.1:0/4168108036 wait complete. 2023-11-15T02:36:37.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.266+0000 7fe4fd25c700 1 Processor -- start 2023-11-15T02:36:37.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.267+0000 7fe4fd25c700 1 -- start start 2023-11-15T02:36:37.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.267+0000 7fe4fd25c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4f80c6650 0x7fe4f8151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:37.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.267+0000 7fe4fd25c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4f81540a0 0x7fe4f80ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:37.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.267+0000 7fe4fd25c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4f8154480 0x7fe4f8141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:37.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.267+0000 7fe4fd25c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f81525f0 con 0x7fe4f80c6650 2023-11-15T02:36:37.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.267+0000 7fe4fd25c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f81519e0 con 0x7fe4f81540a0 2023-11-15T02:36:37.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.267+0000 7fe4fd25c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f8151cc0 con 0x7fe4f8154480 2023-11-15T02:36:37.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.267+0000 7fe4f6d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4f80c6650 0x7fe4f8151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:37.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.267+0000 7fe4f6d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4f80c6650 0x7fe4f8151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44124/0 (socket says 172.21.15.1:44124) 2023-11-15T02:36:37.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.267+0000 7fe4f6d9d700 1 -- 172.21.15.1:0/421443460 learned_addr learned my addr 172.21.15.1:0/421443460 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:37.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.268+0000 7fe4f659c700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4f81540a0 0x7fe4f80ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:37.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.268+0000 7fe4f759e700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4f8154480 0x7fe4f8141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:37.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.268+0000 7fe4f6d9d700 1 -- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4f8154480 msgr2=0x7fe4f8141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:37.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.268+0000 7fe4f6d9d700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4f8154480 0x7fe4f8141950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:37.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.268+0000 7fe4f6d9d700 1 -- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4f81540a0 msgr2=0x7fe4f80ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:37.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.268+0000 7fe4f6d9d700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4f81540a0 0x7fe4f80ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:37.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.268+0000 7fe4f6d9d700 1 -- 172.21.15.1:0/421443460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f0009370 con 0x7fe4f80c6650 2023-11-15T02:36:37.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.268+0000 7fe4f659c700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4f81540a0 0x7fe4f80ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:37.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.268+0000 7fe4f759e700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4f8154480 0x7fe4f8141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:37.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.268+0000 7fe4f6d9d700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4f80c6650 0x7fe4f8151000 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7fe4f80c2070 tx=0x7fe4f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:37.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.268+0000 7fe4eeffd700 1 -- 172.21.15.1:0/421443460 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f000b8d0 con 0x7fe4f80c6650 2023-11-15T02:36:37.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.268+0000 7fe4eeffd700 1 -- 172.21.15.1:0/421443460 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f000ba30 con 0x7fe4f80c6650 2023-11-15T02:36:37.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.268+0000 7fe4fd25c700 1 -- 172.21.15.1:0/421443460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f8151fa0 con 0x7fe4f80c6650 2023-11-15T02:36:37.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.268+0000 7fe4eeffd700 1 -- 172.21.15.1:0/421443460 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f00246c0 con 0x7fe4f80c6650 2023-11-15T02:36:37.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.268+0000 7fe4fd25c700 1 -- 172.21.15.1:0/421443460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f80a1f30 con 0x7fe4f80c6650 2023-11-15T02:36:37.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.269+0000 7fe4fd25c700 1 -- 172.21.15.1:0/421443460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f80a2150 con 0x7fe4f80c6650 2023-11-15T02:36:37.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.269+0000 7fe4eeffd700 1 -- 172.21.15.1:0/421443460 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe4f0021070 con 0x7fe4f80c6650 2023-11-15T02:36:37.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.270+0000 7fe4eeffd700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe4d805f270 0x7fe4d8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:37.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.270+0000 7fe4eeffd700 1 -- 172.21.15.1:0/421443460 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6135+0+0 (secure 0 0 0) 0x7fe4f007c000 con 0x7fe4f80c6650 2023-11-15T02:36:37.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.270+0000 7fe4f659c700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe4d805f270 0x7fe4d8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:37.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.271+0000 7fe4f659c700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe4d805f270 0x7fe4d8061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe4e000b8b0 tx=0x7fe4e0008040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:37.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.274+0000 7fe4eeffd700 1 -- 172.21.15.1:0/421443460 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe4f80a2150 con 0x7fe4f80c6650 2023-11-15T02:36:37.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:37.448+0000 7fe4fd25c700 1 -- 172.21.15.1:0/421443460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe4f80a2150 con 0x7fe4f80c6650 2023-11-15T02:36:38.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.114+0000 7fe4eeffd700 1 -- 172.21.15.1:0/421443460 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v160) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe4f80a2150 con 0x7fe4f80c6650 2023-11-15T02:36:38.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.122+0000 7fe4fd25c700 1 -- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe4d805f270 msgr2=0x7fe4d8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.122+0000 7fe4fd25c700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe4d805f270 0x7fe4d8061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe4e000b8b0 tx=0x7fe4e0008040).stop 2023-11-15T02:36:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.122+0000 7fe4fd25c700 1 -- 172.21.15.1:0/421443460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4f80c6650 msgr2=0x7fe4f8151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.122+0000 7fe4fd25c700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4f80c6650 0x7fe4f8151000 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7fe4f80c2070 tx=0x7fe4f0017000).stop 2023-11-15T02:36:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.123+0000 7fe4fd25c700 1 -- 172.21.15.1:0/421443460 shutdown_connections 2023-11-15T02:36:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.123+0000 7fe4fd25c700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe4d805f270 0x7fe4d8061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.123+0000 7fe4fd25c700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4f8154480 0x7fe4f8141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.123+0000 7fe4fd25c700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4f80c6650 0x7fe4f8151000 secure :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0x7fe4f80c2070 tx=0x7fe4f0017000).stop 2023-11-15T02:36:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.123+0000 7fe4fd25c700 1 --2- 172.21.15.1:0/421443460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4f81540a0 0x7fe4f80ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.123+0000 7fe4fd25c700 1 -- 172.21.15.1:0/421443460 >> 172.21.15.1:0/421443460 conn(0x7fe4f8064a70 msgr2=0x7fe4f80c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:38.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.139+0000 7fe4fd25c700 1 -- 172.21.15.1:0/421443460 shutdown_connections 2023-11-15T02:36:38.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.139+0000 7fe4fd25c700 1 -- 172.21.15.1:0/421443460 wait complete. 2023-11-15T02:36:38.141 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2023-11-15T02:36:38.154 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-15T02:36:38.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.276+0000 7f5d3e884700 1 Processor -- start 2023-11-15T02:36:38.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.276+0000 7f5d3e884700 1 -- start start 2023-11-15T02:36:38.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.277+0000 7f5d3e884700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5d380c3e30 0x7f5d380c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.277+0000 7f5d3e884700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d38154bf0 0x7f5d3813a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.277+0000 7f5d3e884700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3806a020 con 0x7f5d38069ba0 2023-11-15T02:36:38.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.277+0000 7f5d3e884700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d38155bc0 con 0x7f5d380c3e30 2023-11-15T02:36:38.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.277+0000 7f5d3e884700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d38155080 con 0x7f5d38154bf0 2023-11-15T02:36:38.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.278+0000 7f5d37fff700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5d380c3e30 0x7f5d380c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.278+0000 7f5d3ce21700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d38154bf0 0x7f5d3813a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.278+0000 7f5d37fff700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5d380c3e30 0x7f5d380c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:40750/0 (socket says 172.21.15.1:40750) 2023-11-15T02:36:38.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.278+0000 7f5d37fff700 1 -- 172.21.15.1:0/4284877455 learned_addr learned my addr 172.21.15.1:0/4284877455 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:38.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.278+0000 7f5d37fff700 1 -- 172.21.15.1:0/4284877455 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d38154bf0 msgr2=0x7f5d3813a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:38.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.278+0000 7f5d37fff700 1 --2- 172.21.15.1:0/4284877455 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d38154bf0 0x7f5d3813a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.278+0000 7f5d37fff700 1 -- 172.21.15.1:0/4284877455 >> v1:172.21.15.141:6789/0 conn(0x7f5d38069ba0 legacy=0x7f5d38066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.278+0000 7f5d37fff700 1 -- 172.21.15.1:0/4284877455 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d38155320 con 0x7f5d380c3e30 2023-11-15T02:36:38.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.278+0000 7f5d3ce21700 1 --2- 172.21.15.1:0/4284877455 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d38154bf0 0x7f5d3813a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:38.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.278+0000 7f5d37fff700 1 --2- 172.21.15.1:0/4284877455 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d380c3e30 0x7f5d380c4210 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f5d28006fd0 tx=0x7f5d280090f0).ready entity=mon.1 client_cookie=4d82807caf7a2f97 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:38.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.278+0000 7f5d36ffd700 1 -- 172.21.15.1:0/4284877455 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800b580 con 0x7f5d380c3e30 2023-11-15T02:36:38.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.278+0000 7f5d36ffd700 1 -- 172.21.15.1:0/4284877455 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2800b6e0 con 0x7f5d380c3e30 2023-11-15T02:36:38.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.278+0000 7f5d36ffd700 1 -- 172.21.15.1:0/4284877455 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800ba60 con 0x7f5d380c3e30 2023-11-15T02:36:38.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.279+0000 7f5d3e884700 1 -- 172.21.15.1:0/4284877455 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d380c3e30 msgr2=0x7f5d380c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.279+0000 7f5d3e884700 1 --2- 172.21.15.1:0/4284877455 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d380c3e30 0x7f5d380c4210 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f5d28006fd0 tx=0x7f5d280090f0).stop 2023-11-15T02:36:38.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.279+0000 7f5d3e884700 1 -- 172.21.15.1:0/4284877455 shutdown_connections 2023-11-15T02:36:38.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.279+0000 7f5d3e884700 1 --2- 172.21.15.1:0/4284877455 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d38154bf0 0x7f5d3813a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.279+0000 7f5d3e884700 1 --2- 172.21.15.1:0/4284877455 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d380c3e30 0x7f5d380c4210 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.279+0000 7f5d3e884700 1 -- 172.21.15.1:0/4284877455 >> 172.21.15.1:0/4284877455 conn(0x7f5d380c7dc0 msgr2=0x7f5d380c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:38.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.279+0000 7f5d3e884700 1 -- 172.21.15.1:0/4284877455 shutdown_connections 2023-11-15T02:36:38.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.279+0000 7f5d3e884700 1 -- 172.21.15.1:0/4284877455 wait complete. 2023-11-15T02:36:38.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.280+0000 7f5d3e884700 1 Processor -- start 2023-11-15T02:36:38.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.280+0000 7f5d3e884700 1 -- start start 2023-11-15T02:36:38.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d3e884700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d38069ba0 0x7f5d381516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d3e884700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d380c3e30 0x7f5d38138c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d3e884700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d38154bf0 0x7f5d38150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d3e884700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380bfd50 con 0x7f5d380c3e30 2023-11-15T02:36:38.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d3e884700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d38152920 con 0x7f5d38069ba0 2023-11-15T02:36:38.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d3e884700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380bfa20 con 0x7f5d38154bf0 2023-11-15T02:36:38.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d377fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d380c3e30 0x7f5d38138c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d377fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d380c3e30 0x7f5d38138c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52960/0 (socket says 172.21.15.1:52960) 2023-11-15T02:36:38.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d377fe700 1 -- 172.21.15.1:0/1374068379 learned_addr learned my addr 172.21.15.1:0/1374068379 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:38.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d3ce21700 1 --2- 172.21.15.1:0/1374068379 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d38154bf0 0x7f5d38150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d37fff700 1 --2- 172.21.15.1:0/1374068379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d38069ba0 0x7f5d381516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d377fe700 1 -- 172.21.15.1:0/1374068379 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d38154bf0 msgr2=0x7f5d38150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d377fe700 1 --2- 172.21.15.1:0/1374068379 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d38154bf0 0x7f5d38150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d377fe700 1 -- 172.21.15.1:0/1374068379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d38069ba0 msgr2=0x7f5d381516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d377fe700 1 --2- 172.21.15.1:0/1374068379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d38069ba0 0x7f5d381516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d377fe700 1 -- 172.21.15.1:0/1374068379 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d30009a20 con 0x7f5d380c3e30 2023-11-15T02:36:38.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.281+0000 7f5d377fe700 1 --2- 172.21.15.1:0/1374068379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d380c3e30 0x7f5d38138c60 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f5d2c00c470 tx=0x7f5d2c007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:38.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.282+0000 7f5d1ffff700 1 -- 172.21.15.1:0/1374068379 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c012400 con 0x7f5d380c3e30 2023-11-15T02:36:38.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.282+0000 7f5d1ffff700 1 -- 172.21.15.1:0/1374068379 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2c012560 con 0x7f5d380c3e30 2023-11-15T02:36:38.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.282+0000 7f5d3e884700 1 -- 172.21.15.1:0/1374068379 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d28009370 con 0x7f5d380c3e30 2023-11-15T02:36:38.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.282+0000 7f5d1ffff700 1 -- 172.21.15.1:0/1374068379 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c012900 con 0x7f5d380c3e30 2023-11-15T02:36:38.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.282+0000 7f5d3e884700 1 -- 172.21.15.1:0/1374068379 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d38152640 con 0x7f5d380c3e30 2023-11-15T02:36:38.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.283+0000 7f5d3e884700 1 -- 172.21.15.1:0/1374068379 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3806c7e0 con 0x7f5d380c3e30 2023-11-15T02:36:38.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.283+0000 7f5d1ffff700 1 -- 172.21.15.1:0/1374068379 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5d2c01b3b0 con 0x7f5d380c3e30 2023-11-15T02:36:38.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.283+0000 7f5d1ffff700 1 --2- 172.21.15.1:0/1374068379 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5d2405f270 0x7f5d24061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.283+0000 7f5d1ffff700 1 -- 172.21.15.1:0/1374068379 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f5d2c079ce0 con 0x7f5d380c3e30 2023-11-15T02:36:38.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.284+0000 7f5d37fff700 1 --2- 172.21.15.1:0/1374068379 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5d2405f270 0x7f5d24061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.284+0000 7f5d37fff700 1 --2- 172.21.15.1:0/1374068379 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5d2405f270 0x7f5d24061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f5d28009130 tx=0x7f5d28017000).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:38.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.288+0000 7f5d1ffff700 1 -- 172.21.15.1:0/1374068379 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5d2c07e070 con 0x7f5d380c3e30 2023-11-15T02:36:38.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.504+0000 7f5d3e884700 1 -- 172.21.15.1:0/1374068379 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5d38155600 con 0x7f5d380c3e30 2023-11-15T02:36:38.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.509+0000 7f5d1ffff700 1 -- 172.21.15.1:0/1374068379 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v67) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5d2c04e670 con 0x7f5d380c3e30 2023-11-15T02:36:38.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.513+0000 7f5d3e884700 1 -- 172.21.15.1:0/1374068379 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5d2405f270 msgr2=0x7f5d24061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.513+0000 7f5d3e884700 1 --2- 172.21.15.1:0/1374068379 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5d2405f270 0x7f5d24061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f5d28009130 tx=0x7f5d28017000).stop 2023-11-15T02:36:38.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.513+0000 7f5d3e884700 1 -- 172.21.15.1:0/1374068379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d380c3e30 msgr2=0x7f5d38138c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.513+0000 7f5d3e884700 1 --2- 172.21.15.1:0/1374068379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d380c3e30 0x7f5d38138c60 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f5d2c00c470 tx=0x7f5d2c007db0).stop 2023-11-15T02:36:38.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.517+0000 7f5d3e884700 1 -- 172.21.15.1:0/1374068379 shutdown_connections 2023-11-15T02:36:38.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.517+0000 7f5d3e884700 1 --2- 172.21.15.1:0/1374068379 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f5d2405f270 0x7f5d24061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.517+0000 7f5d3e884700 1 --2- 172.21.15.1:0/1374068379 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d38154bf0 0x7f5d38150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.517+0000 7f5d3e884700 1 --2- 172.21.15.1:0/1374068379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d38069ba0 0x7f5d381516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.517+0000 7f5d3e884700 1 --2- 172.21.15.1:0/1374068379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d380c3e30 0x7f5d38138c60 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.517+0000 7f5d3e884700 1 -- 172.21.15.1:0/1374068379 >> 172.21.15.1:0/1374068379 conn(0x7f5d380c7dc0 msgr2=0x7f5d380acd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.517+0000 7f5d3e884700 1 -- 172.21.15.1:0/1374068379 shutdown_connections 2023-11-15T02:36:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.518+0000 7f5d3e884700 1 -- 172.21.15.1:0/1374068379 wait complete. 2023-11-15T02:36:38.522 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 19 and data pool 20 2023-11-15T02:36:38.542 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:36:38.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.659+0000 7f67fdee1700 1 Processor -- start 2023-11-15T02:36:38.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.659+0000 7f67fdee1700 1 -- start start 2023-11-15T02:36:38.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.660+0000 7f67fdee1700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f67f80c6620 0x7f67f8154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.660+0000 7f67fdee1700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f80c06f0 con 0x7f67f8154150 2023-11-15T02:36:38.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.660+0000 7f67fdee1700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f80c09d0 con 0x7f67f80ab1a0 2023-11-15T02:36:38.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.660+0000 7f67fdee1700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f8158820 con 0x7f67f80c6620 2023-11-15T02:36:38.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.660+0000 7f67f7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f67f80c6620 0x7f67f8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.660+0000 7f67f77fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f67f8154150 0x7f67f8158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41676/0 (socket says 172.21.15.1:41676) 2023-11-15T02:36:38.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.660+0000 7f67f77fe700 1 -- 172.21.15.1:0/3374862219 learned_addr learned my addr 172.21.15.1:0/3374862219 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:38.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.660+0000 7f67f7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f67f80c6620 0x7f67f8154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52970/0 (socket says 172.21.15.1:52970) 2023-11-15T02:36:38.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.661+0000 7f67f7fff700 1 -- 172.21.15.1:0/3374862219 >> v1:172.21.15.141:6789/0 conn(0x7f67f80ab1a0 legacy=0x7f67f80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.661+0000 7f67f7fff700 1 -- 172.21.15.1:0/3374862219 >> v1:172.21.15.1:6789/0 conn(0x7f67f8154150 legacy=0x7f67f8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.661+0000 7f67f7fff700 1 -- 172.21.15.1:0/3374862219 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f8158b00 con 0x7f67f80c6620 2023-11-15T02:36:38.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.661+0000 7f67f67fc700 1 -- 172.21.15.1:0/3374862219 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807426229 0 0) 0x7f67f80c06f0 con 0x7f67f8154150 2023-11-15T02:36:38.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.661+0000 7f67f7fff700 1 --2- 172.21.15.1:0/3374862219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67f80c6620 0x7f67f8154530 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f67f0009e60 tx=0x7f67f0009780).ready entity=mon.0 client_cookie=e95457cd9b534b60 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:38.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.661+0000 7f67f67fc700 1 -- 172.21.15.1:0/3374862219 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f000e070 con 0x7f67f80c6620 2023-11-15T02:36:38.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.661+0000 7f67f67fc700 1 -- 172.21.15.1:0/3374862219 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f000bc30 con 0x7f67f80c6620 2023-11-15T02:36:38.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.661+0000 7f67f67fc700 1 -- 172.21.15.1:0/3374862219 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0012410 con 0x7f67f80c6620 2023-11-15T02:36:38.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.661+0000 7f67fdee1700 1 -- 172.21.15.1:0/3374862219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67f80c6620 msgr2=0x7f67f8154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.661+0000 7f67fdee1700 1 --2- 172.21.15.1:0/3374862219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67f80c6620 0x7f67f8154530 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f67f0009e60 tx=0x7f67f0009780).stop 2023-11-15T02:36:38.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.661+0000 7f67fdee1700 1 -- 172.21.15.1:0/3374862219 shutdown_connections 2023-11-15T02:36:38.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.661+0000 7f67fdee1700 1 --2- 172.21.15.1:0/3374862219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67f80c6620 0x7f67f8154530 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.661+0000 7f67fdee1700 1 -- 172.21.15.1:0/3374862219 >> 172.21.15.1:0/3374862219 conn(0x7f67f8064aa0 msgr2=0x7f67f8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:38.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.661+0000 7f67fdee1700 1 -- 172.21.15.1:0/3374862219 shutdown_connections 2023-11-15T02:36:38.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.662+0000 7f67fdee1700 1 -- 172.21.15.1:0/3374862219 wait complete. 2023-11-15T02:36:38.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.663+0000 7f67fdee1700 1 Processor -- start 2023-11-15T02:36:38.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.663+0000 7f67fdee1700 1 -- start start 2023-11-15T02:36:38.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.663+0000 7f67fdee1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67f80ab1a0 0x7f67f81648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.663+0000 7f67fdee1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f67f80c6620 0x7f67f8152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.663+0000 7f67fdee1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67f8154150 0x7f67f8152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.663+0000 7f67fdee1700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f8168780 con 0x7f67f8154150 2023-11-15T02:36:38.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.663+0000 7f67fdee1700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f81651f0 con 0x7f67f80ab1a0 2023-11-15T02:36:38.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.663+0000 7f67fdee1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f81682f0 con 0x7f67f80c6620 2023-11-15T02:36:38.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.664+0000 7f67f7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67f8154150 0x7f67f8152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.664+0000 7f67f7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67f8154150 0x7f67f8152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52984/0 (socket says 172.21.15.1:52984) 2023-11-15T02:36:38.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.664+0000 7f67f7fff700 1 -- 172.21.15.1:0/85214831 learned_addr learned my addr 172.21.15.1:0/85214831 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:38.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.664+0000 7f67f7fff700 1 -- 172.21.15.1:0/85214831 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f67f80c6620 msgr2=0x7f67f8152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.664+0000 7f67f7fff700 1 --2- 172.21.15.1:0/85214831 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f67f80c6620 0x7f67f8152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:38.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.664+0000 7f67f7fff700 1 -- 172.21.15.1:0/85214831 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67f80ab1a0 msgr2=0x7f67f81648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.664+0000 7f67f77fe700 1 --2- 172.21.15.1:0/85214831 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67f80ab1a0 0x7f67f81648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.664+0000 7f67f7fff700 1 --2- 172.21.15.1:0/85214831 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67f80ab1a0 0x7f67f81648a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.664+0000 7f67f7fff700 1 -- 172.21.15.1:0/85214831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f0009a20 con 0x7f67f8154150 2023-11-15T02:36:38.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.664+0000 7f67f7fff700 1 --2- 172.21.15.1:0/85214831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67f8154150 0x7f67f8152e10 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f67f000b6c0 tx=0x7f67f80c0940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:38.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.664+0000 7f67df7fe700 1 -- 172.21.15.1:0/85214831 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f00070a0 con 0x7f67f8154150 2023-11-15T02:36:38.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.664+0000 7f67df7fe700 1 -- 172.21.15.1:0/85214831 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f0011750 con 0x7f67f8154150 2023-11-15T02:36:38.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.664+0000 7f67fdee1700 1 -- 172.21.15.1:0/85214831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f81679c0 con 0x7f67f8154150 2023-11-15T02:36:38.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.664+0000 7f67df7fe700 1 -- 172.21.15.1:0/85214831 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0011b10 con 0x7f67f8154150 2023-11-15T02:36:38.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.664+0000 7f67fdee1700 1 -- 172.21.15.1:0/85214831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f8167f80 con 0x7f67f8154150 2023-11-15T02:36:38.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.665+0000 7f67fdee1700 1 -- 172.21.15.1:0/85214831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f806c7e0 con 0x7f67f8154150 2023-11-15T02:36:38.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.666+0000 7f67df7fe700 1 -- 172.21.15.1:0/85214831 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f67f0003040 con 0x7f67f8154150 2023-11-15T02:36:38.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.666+0000 7f67df7fe700 1 --2- 172.21.15.1:0/85214831 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f67e405f270 0x7f67e4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.666+0000 7f67df7fe700 1 -- 172.21.15.1:0/85214831 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f67f007c530 con 0x7f67f8154150 2023-11-15T02:36:38.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.666+0000 7f67f77fe700 1 --2- 172.21.15.1:0/85214831 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f67e405f270 0x7f67e4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.667+0000 7f67f77fe700 1 --2- 172.21.15.1:0/85214831 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f67e405f270 0x7f67e4061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f67e8001660 tx=0x7f67e8009040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:38.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.670+0000 7f67df7fe700 1 -- 172.21.15.1:0/85214831 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f67f004d490 con 0x7f67f8154150 2023-11-15T02:36:38.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.842+0000 7f67fdee1700 1 -- 172.21.15.1:0/85214831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67f8158de0 con 0x7f67f8154150 2023-11-15T02:36:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.843+0000 7f67df7fe700 1 -- 172.21.15.1:0/85214831 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+17668 (secure 0 0 0) 0x7f67f0050ab0 con 0x7f67f8154150 2023-11-15T02:36:38.844 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:38.844 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":161,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:36:38.505048+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:36:36.177693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-11-15T02:36:37.489367+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:36:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.844+0000 7f67fdee1700 1 -- 172.21.15.1:0/85214831 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f67e405f270 msgr2=0x7f67e4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.844+0000 7f67fdee1700 1 --2- 172.21.15.1:0/85214831 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f67e405f270 0x7f67e4061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f67e8001660 tx=0x7f67e8009040).stop 2023-11-15T02:36:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.844+0000 7f67fdee1700 1 -- 172.21.15.1:0/85214831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67f8154150 msgr2=0x7f67f8152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.844+0000 7f67fdee1700 1 --2- 172.21.15.1:0/85214831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67f8154150 0x7f67f8152e10 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f67f000b6c0 tx=0x7f67f80c0940).stop 2023-11-15T02:36:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.844+0000 7f67fdee1700 1 -- 172.21.15.1:0/85214831 shutdown_connections 2023-11-15T02:36:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.844+0000 7f67fdee1700 1 --2- 172.21.15.1:0/85214831 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f67e405f270 0x7f67e4061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.844+0000 7f67fdee1700 1 --2- 172.21.15.1:0/85214831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67f8154150 0x7f67f8152e10 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.844+0000 7f67fdee1700 1 --2- 172.21.15.1:0/85214831 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67f80ab1a0 0x7f67f81648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.844+0000 7f67fdee1700 1 --2- 172.21.15.1:0/85214831 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f67f80c6620 0x7f67f8152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.845+0000 7f67fdee1700 1 -- 172.21.15.1:0/85214831 >> 172.21.15.1:0/85214831 conn(0x7f67f8064aa0 msgr2=0x7f67f80c7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.845+0000 7f67fdee1700 1 -- 172.21.15.1:0/85214831 shutdown_connections 2023-11-15T02:36:38.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.845+0000 7f67fdee1700 1 -- 172.21.15.1:0/85214831 wait complete. 2023-11-15T02:36:38.858 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:36:38.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.975+0000 7f24823ac700 1 Processor -- start 2023-11-15T02:36:38.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.976+0000 7f24823ac700 1 -- start start 2023-11-15T02:36:38.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.976+0000 7f24823ac700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f247c0bdfb0 0x7f247c0be390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.976+0000 7f24823ac700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f247c0c6d10 0x7f247c0bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.976+0000 7f24823ac700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f247c0bd8f0 0x7f247c154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.976+0000 7f24823ac700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247c0bccd0 con 0x7f247c0bdfb0 2023-11-15T02:36:38.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.976+0000 7f24823ac700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247c0ad5e0 con 0x7f247c0bd8f0 2023-11-15T02:36:38.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.976+0000 7f24823ac700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c0ad8c0 con 0x7f247c0c6d10 2023-11-15T02:36:38.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f247bfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f247c0bdfb0 0x7f247c0be390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f247bfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f247c0bdfb0 0x7f247c0be390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52990/0 (socket says 172.21.15.1:52990) 2023-11-15T02:36:38.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f247bfff700 1 -- 172.21.15.1:0/1326791409 learned_addr learned my addr 172.21.15.1:0/1326791409 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:38.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f2480949700 1 --2- 172.21.15.1:0/1326791409 >> v2:172.21.15.141:3300/0 conn(0x7f247c0bd8f0 0x7f247c154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f247b7fe700 1 --2- 172.21.15.1:0/1326791409 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f247c0c6d10 0x7f247c0bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f247bfff700 1 -- 172.21.15.1:0/1326791409 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f247c0c6d10 msgr2=0x7f247c0bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:38.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f247bfff700 1 --2- 172.21.15.1:0/1326791409 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f247c0c6d10 0x7f247c0bd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f247bfff700 1 -- 172.21.15.1:0/1326791409 >> v2:172.21.15.141:3300/0 conn(0x7f247c0bd8f0 msgr2=0x7f247c154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:38.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f247bfff700 1 --2- 172.21.15.1:0/1326791409 >> v2:172.21.15.141:3300/0 conn(0x7f247c0bd8f0 0x7f247c154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f247bfff700 1 -- 172.21.15.1:0/1326791409 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c0adba0 con 0x7f247c0bdfb0 2023-11-15T02:36:38.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f247b7fe700 1 --2- 172.21.15.1:0/1326791409 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f247c0c6d10 0x7f247c0bd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:38.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f2480949700 1 --2- 172.21.15.1:0/1326791409 >> v2:172.21.15.141:3300/0 conn(0x7f247c0bd8f0 0x7f247c154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:38.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f247bfff700 1 --2- 172.21.15.1:0/1326791409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247c0bdfb0 0x7f247c0be390 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f247c0c5b50 tx=0x7f246c0090f0).ready entity=mon.0 client_cookie=1544a78c4795ab95 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:38.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f247affd700 1 -- 172.21.15.1:0/1326791409 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c00f6b0 con 0x7f247c0bdfb0 2023-11-15T02:36:38.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f247affd700 1 -- 172.21.15.1:0/1326791409 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246c00f810 con 0x7f247c0bdfb0 2023-11-15T02:36:38.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.977+0000 7f247affd700 1 -- 172.21.15.1:0/1326791409 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c00fb90 con 0x7f247c0bdfb0 2023-11-15T02:36:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.978+0000 7f24823ac700 1 -- 172.21.15.1:0/1326791409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247c0bdfb0 msgr2=0x7f247c0be390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.978+0000 7f24823ac700 1 --2- 172.21.15.1:0/1326791409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247c0bdfb0 0x7f247c0be390 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f247c0c5b50 tx=0x7f246c0090f0).stop 2023-11-15T02:36:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.978+0000 7f24823ac700 1 -- 172.21.15.1:0/1326791409 shutdown_connections 2023-11-15T02:36:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.978+0000 7f24823ac700 1 --2- 172.21.15.1:0/1326791409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247c0bdfb0 0x7f247c0be390 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.978+0000 7f24823ac700 1 --2- 172.21.15.1:0/1326791409 >> v2:172.21.15.141:3300/0 conn(0x7f247c0bd8f0 0x7f247c154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.978+0000 7f24823ac700 1 --2- 172.21.15.1:0/1326791409 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f247c0c6d10 0x7f247c0bd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.978+0000 7f24823ac700 1 -- 172.21.15.1:0/1326791409 >> 172.21.15.1:0/1326791409 conn(0x7f247c0c7d70 msgr2=0x7f247c0c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:38.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.978+0000 7f24823ac700 1 -- 172.21.15.1:0/1326791409 shutdown_connections 2023-11-15T02:36:38.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.978+0000 7f24823ac700 1 -- 172.21.15.1:0/1326791409 wait complete. 2023-11-15T02:36:38.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.979+0000 7f24823ac700 1 Processor -- start 2023-11-15T02:36:38.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.979+0000 7f24823ac700 1 -- start start 2023-11-15T02:36:38.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f24823ac700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f247c0bd8f0 0x7f247c16cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f24823ac700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f247c0bdfb0 0x7f247c0a94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f24823ac700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247c0c6d10 0x7f247c1408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f24823ac700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c168b10 con 0x7f247c0c6d10 2023-11-15T02:36:38.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f24823ac700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c0a9d30 con 0x7f247c0bd8f0 2023-11-15T02:36:38.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f24823ac700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c0aa010 con 0x7f247c0bdfb0 2023-11-15T02:36:38.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f2480949700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247c0c6d10 0x7f247c1408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f2480949700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247c0c6d10 0x7f247c1408e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52994/0 (socket says 172.21.15.1:52994) 2023-11-15T02:36:38.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f2480949700 1 -- 172.21.15.1:0/3755878626 learned_addr learned my addr 172.21.15.1:0/3755878626 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:38.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f247bfff700 1 --2- 172.21.15.1:0/3755878626 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f247c0bd8f0 0x7f247c16cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f247b7fe700 1 --2- 172.21.15.1:0/3755878626 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f247c0bdfb0 0x7f247c0a94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f2480949700 1 -- 172.21.15.1:0/3755878626 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f247c0bdfb0 msgr2=0x7f247c0a94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f2480949700 1 --2- 172.21.15.1:0/3755878626 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f247c0bdfb0 0x7f247c0a94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f2480949700 1 -- 172.21.15.1:0/3755878626 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f247c0bd8f0 msgr2=0x7f247c16cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:38.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f2480949700 1 --2- 172.21.15.1:0/3755878626 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f247c0bd8f0 0x7f247c16cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:38.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f2480949700 1 -- 172.21.15.1:0/3755878626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c009370 con 0x7f247c0c6d10 2023-11-15T02:36:38.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f2480949700 1 --2- 172.21.15.1:0/3755878626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247c0c6d10 0x7f247c1408e0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f247400cef0 tx=0x7f2474007830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:38.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f2463fff700 1 -- 172.21.15.1:0/3755878626 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247400acb0 con 0x7f247c0c6d10 2023-11-15T02:36:38.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.980+0000 7f2463fff700 1 -- 172.21.15.1:0/3755878626 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247400ae10 con 0x7f247c0c6d10 2023-11-15T02:36:38.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.981+0000 7f24823ac700 1 -- 172.21.15.1:0/3755878626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247c0aa2f0 con 0x7f247c0c6d10 2023-11-15T02:36:38.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.981+0000 7f2463fff700 1 -- 172.21.15.1:0/3755878626 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474016610 con 0x7f247c0c6d10 2023-11-15T02:36:38.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.981+0000 7f24823ac700 1 -- 172.21.15.1:0/3755878626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247c0aa8b0 con 0x7f247c0c6d10 2023-11-15T02:36:38.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.981+0000 7f24823ac700 1 -- 172.21.15.1:0/3755878626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247c0bf190 con 0x7f247c0c6d10 2023-11-15T02:36:38.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.982+0000 7f2463fff700 1 -- 172.21.15.1:0/3755878626 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f247401f3f0 con 0x7f247c0c6d10 2023-11-15T02:36:38.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.982+0000 7f2463fff700 1 --2- 172.21.15.1:0/3755878626 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f246805f270 0x7f2468061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:38.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.982+0000 7f2463fff700 1 -- 172.21.15.1:0/3755878626 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f247407ac70 con 0x7f247c0c6d10 2023-11-15T02:36:38.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.982+0000 7f247bfff700 1 --2- 172.21.15.1:0/3755878626 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f246805f270 0x7f2468061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:38.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.983+0000 7f247bfff700 1 --2- 172.21.15.1:0/3755878626 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f246805f270 0x7f2468061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f246c009130 tx=0x7f246c019000).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:38.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:38.986+0000 7f2463fff700 1 -- 172.21.15.1:0/3755878626 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f247c0bf190 con 0x7f247c0c6d10 2023-11-15T02:36:39.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.162+0000 7f24823ac700 1 -- 172.21.15.1:0/3755878626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f247c0bf190 con 0x7f247c0c6d10 2023-11-15T02:36:39.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.163+0000 7f2463fff700 1 -- 172.21.15.1:0/3755878626 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+17668 (secure 0 0 0) 0x7f247c0bf190 con 0x7f247c0c6d10 2023-11-15T02:36:39.164 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:39.164 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":161,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:36:38.505048+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:36:36.177693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-11-15T02:36:37.489367+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:36:39.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.164+0000 7f24823ac700 1 -- 172.21.15.1:0/3755878626 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f246805f270 msgr2=0x7f2468061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:39.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.164+0000 7f24823ac700 1 --2- 172.21.15.1:0/3755878626 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f246805f270 0x7f2468061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f246c009130 tx=0x7f246c019000).stop 2023-11-15T02:36:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.164+0000 7f24823ac700 1 -- 172.21.15.1:0/3755878626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247c0c6d10 msgr2=0x7f247c1408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.164+0000 7f24823ac700 1 --2- 172.21.15.1:0/3755878626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247c0c6d10 0x7f247c1408e0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f247400cef0 tx=0x7f2474007830).stop 2023-11-15T02:36:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.164+0000 7f24823ac700 1 -- 172.21.15.1:0/3755878626 shutdown_connections 2023-11-15T02:36:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.164+0000 7f24823ac700 1 --2- 172.21.15.1:0/3755878626 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f246805f270 0x7f2468061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.164+0000 7f24823ac700 1 --2- 172.21.15.1:0/3755878626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247c0c6d10 0x7f247c1408e0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.164+0000 7f24823ac700 1 --2- 172.21.15.1:0/3755878626 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f247c0bd8f0 0x7f247c16cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.164+0000 7f24823ac700 1 --2- 172.21.15.1:0/3755878626 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f247c0bdfb0 0x7f247c0a94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.164+0000 7f24823ac700 1 -- 172.21.15.1:0/3755878626 >> 172.21.15.1:0/3755878626 conn(0x7f247c0c7d70 msgr2=0x7f247c066f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.165+0000 7f24823ac700 1 -- 172.21.15.1:0/3755878626 shutdown_connections 2023-11-15T02:36:39.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.165+0000 7f24823ac700 1 -- 172.21.15.1:0/3755878626 wait complete. 2023-11-15T02:36:39.178 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-15T02:36:39.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.298+0000 7f121688e700 1 Processor -- start 2023-11-15T02:36:39.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.298+0000 7f121688e700 1 -- start start 2023-11-15T02:36:39.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.299+0000 7f121688e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f12100c6650 0x7f12100aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:39.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.299+0000 7f121688e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12100ca050 con 0x7f1210154480 2023-11-15T02:36:39.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.299+0000 7f121688e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12100c9440 con 0x7f12101540a0 2023-11-15T02:36:39.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.299+0000 7f121688e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12100c9720 con 0x7f12100c6650 2023-11-15T02:36:39.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.299+0000 7f1214e2b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f12100c6650 0x7f12100aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:39.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.300+0000 7f120f7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f1210154480 0x7f12100c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41682/0 (socket says 172.21.15.1:41682) 2023-11-15T02:36:39.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.300+0000 7f120f7fe700 1 -- 172.21.15.1:0/470483600 learned_addr learned my addr 172.21.15.1:0/470483600 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:39.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.300+0000 7f1214e2b700 1 -- 172.21.15.1:0/470483600 >> v1:172.21.15.141:6789/0 conn(0x7f12101540a0 legacy=0x7f12100ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:39.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.300+0000 7f1214e2b700 1 -- 172.21.15.1:0/470483600 >> v1:172.21.15.1:6789/0 conn(0x7f1210154480 legacy=0x7f12100c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:39.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.300+0000 7f1214e2b700 1 -- 172.21.15.1:0/470483600 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12100c9a00 con 0x7f12100c6650 2023-11-15T02:36:39.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.300+0000 7f120effd700 1 -- 172.21.15.1:0/470483600 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154308782 0 0) 0x7f12100ca050 con 0x7f1210154480 2023-11-15T02:36:39.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.300+0000 7f1214e2b700 1 --2- 172.21.15.1:0/470483600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12100c6650 0x7f12100aaf40 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f1208009e60 tx=0x7f1208009780).ready entity=mon.0 client_cookie=ad729f4c4aa8f0b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:39.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.300+0000 7f120effd700 1 -- 172.21.15.1:0/470483600 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120800e070 con 0x7f12100c6650 2023-11-15T02:36:39.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.300+0000 7f120effd700 1 -- 172.21.15.1:0/470483600 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120800bc30 con 0x7f12100c6650 2023-11-15T02:36:39.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.300+0000 7f120effd700 1 -- 172.21.15.1:0/470483600 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1208012410 con 0x7f12100c6650 2023-11-15T02:36:39.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.301+0000 7f121688e700 1 -- 172.21.15.1:0/470483600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12100c6650 msgr2=0x7f12100aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:39.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.301+0000 7f121688e700 1 --2- 172.21.15.1:0/470483600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12100c6650 0x7f12100aaf40 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f1208009e60 tx=0x7f1208009780).stop 2023-11-15T02:36:39.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.301+0000 7f121688e700 1 -- 172.21.15.1:0/470483600 shutdown_connections 2023-11-15T02:36:39.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.301+0000 7f121688e700 1 --2- 172.21.15.1:0/470483600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12100c6650 0x7f12100aaf40 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:39.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.301+0000 7f121688e700 1 -- 172.21.15.1:0/470483600 >> 172.21.15.1:0/470483600 conn(0x7f1210064a70 msgr2=0x7f1210064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:39.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.301+0000 7f121688e700 1 -- 172.21.15.1:0/470483600 shutdown_connections 2023-11-15T02:36:39.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.301+0000 7f121688e700 1 -- 172.21.15.1:0/470483600 wait complete. 2023-11-15T02:36:39.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.302+0000 7f121688e700 1 Processor -- start 2023-11-15T02:36:39.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.302+0000 7f121688e700 1 -- start start 2023-11-15T02:36:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f121688e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12100c6650 0x7f121014af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f121688e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12101540a0 0x7f12100c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f121688e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1210154480 0x7f12100ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f121688e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12100aeda0 con 0x7f12101540a0 2023-11-15T02:36:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f121688e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12100ae190 con 0x7f1210154480 2023-11-15T02:36:39.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f121688e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12100ae470 con 0x7f12100c6650 2023-11-15T02:36:39.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f120f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12101540a0 0x7f12100c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:39.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f120f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12101540a0 0x7f12100c3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53014/0 (socket says 172.21.15.1:53014) 2023-11-15T02:36:39.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f120f7fe700 1 -- 172.21.15.1:0/751974025 learned_addr learned my addr 172.21.15.1:0/751974025 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:39.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f1214e2b700 1 --2- 172.21.15.1:0/751974025 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1210154480 0x7f12100ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:39.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f120ffff700 1 --2- 172.21.15.1:0/751974025 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12100c6650 0x7f121014af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:39.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f120f7fe700 1 -- 172.21.15.1:0/751974025 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12100c6650 msgr2=0x7f121014af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:39.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f120f7fe700 1 --2- 172.21.15.1:0/751974025 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12100c6650 0x7f121014af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:39.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f120f7fe700 1 -- 172.21.15.1:0/751974025 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1210154480 msgr2=0x7f12100ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:39.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f120f7fe700 1 --2- 172.21.15.1:0/751974025 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1210154480 0x7f12100ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:39.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f120f7fe700 1 -- 172.21.15.1:0/751974025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1208009a20 con 0x7f12101540a0 2023-11-15T02:36:39.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f1214e2b700 1 --2- 172.21.15.1:0/751974025 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1210154480 0x7f12100ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:39.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.303+0000 7f120f7fe700 1 --2- 172.21.15.1:0/751974025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12101540a0 0x7f12100c3f10 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f120400c490 tx=0x7f1204007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:39.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.304+0000 7f11f7fff700 1 -- 172.21.15.1:0/751974025 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12040072e0 con 0x7f12101540a0 2023-11-15T02:36:39.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.304+0000 7f11f7fff700 1 -- 172.21.15.1:0/751974025 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1204007440 con 0x7f12101540a0 2023-11-15T02:36:39.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.304+0000 7f11f7fff700 1 -- 172.21.15.1:0/751974025 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12040057a0 con 0x7f12101540a0 2023-11-15T02:36:39.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.304+0000 7f121688e700 1 -- 172.21.15.1:0/751974025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12100ae750 con 0x7f12101540a0 2023-11-15T02:36:39.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.304+0000 7f121688e700 1 -- 172.21.15.1:0/751974025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121014b420 con 0x7f12101540a0 2023-11-15T02:36:39.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.305+0000 7f121688e700 1 -- 172.21.15.1:0/751974025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121014b610 con 0x7f12101540a0 2023-11-15T02:36:39.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.305+0000 7f11f7fff700 1 -- 172.21.15.1:0/751974025 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1204005b90 con 0x7f12101540a0 2023-11-15T02:36:39.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.305+0000 7f11f7fff700 1 --2- 172.21.15.1:0/751974025 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f11fc05f240 0x7f11fc061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:39.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.305+0000 7f11f7fff700 1 -- 172.21.15.1:0/751974025 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f1204079d10 con 0x7f12101540a0 2023-11-15T02:36:39.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.306+0000 7f120ffff700 1 --2- 172.21.15.1:0/751974025 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f11fc05f240 0x7f11fc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:39.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.306+0000 7f120ffff700 1 --2- 172.21.15.1:0/751974025 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f11fc05f240 0x7f11fc061700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f12000036d0 tx=0x7f1200009040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:39.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.309+0000 7f11f7fff700 1 -- 172.21.15.1:0/751974025 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f120404ac70 con 0x7f12101540a0 2023-11-15T02:36:39.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:39.528+0000 7f121688e700 1 -- 172.21.15.1:0/751974025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f121006c7e0 con 0x7f12101540a0 2023-11-15T02:36:40.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.520+0000 7f11f7fff700 1 -- 172.21.15.1:0/751974025 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v70) v1 ==== 118+0+0 (secure 0 0 0) 0x7f120404e290 con 0x7f12101540a0 2023-11-15T02:36:40.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.523+0000 7f121688e700 1 -- 172.21.15.1:0/751974025 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f11fc05f240 msgr2=0x7f11fc061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:40.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.523+0000 7f121688e700 1 --2- 172.21.15.1:0/751974025 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f11fc05f240 0x7f11fc061700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f12000036d0 tx=0x7f1200009040).stop 2023-11-15T02:36:40.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.523+0000 7f121688e700 1 -- 172.21.15.1:0/751974025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12101540a0 msgr2=0x7f12100c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:40.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.523+0000 7f121688e700 1 --2- 172.21.15.1:0/751974025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12101540a0 0x7f12100c3f10 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f120400c490 tx=0x7f1204007e40).stop 2023-11-15T02:36:40.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.523+0000 7f121688e700 1 -- 172.21.15.1:0/751974025 shutdown_connections 2023-11-15T02:36:40.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.523+0000 7f121688e700 1 --2- 172.21.15.1:0/751974025 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f11fc05f240 0x7f11fc061700 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:40.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.523+0000 7f121688e700 1 --2- 172.21.15.1:0/751974025 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1210154480 0x7f12100ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:40.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.523+0000 7f121688e700 1 --2- 172.21.15.1:0/751974025 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12100c6650 0x7f121014af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:40.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.523+0000 7f121688e700 1 --2- 172.21.15.1:0/751974025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12101540a0 0x7f12100c3f10 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:40.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.523+0000 7f121688e700 1 -- 172.21.15.1:0/751974025 >> 172.21.15.1:0/751974025 conn(0x7f1210064a70 msgr2=0x7f12100c0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:40.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.523+0000 7f121688e700 1 -- 172.21.15.1:0/751974025 shutdown_connections 2023-11-15T02:36:40.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.523+0000 7f121688e700 1 -- 172.21.15.1:0/751974025 wait complete. 2023-11-15T02:36:40.539 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-15T02:36:40.540 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-15T02:36:40.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.666+0000 7f8e20383700 1 Processor -- start 2023-11-15T02:36:40.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.666+0000 7f8e20383700 1 -- start start 2023-11-15T02:36:40.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.667+0000 7f8e20383700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e181540a0 0x7f8e180ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:40.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.667+0000 7f8e20383700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e180ca050 con 0x7f8e180c6650 2023-11-15T02:36:40.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.667+0000 7f8e20383700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e180c9440 con 0x7f8e18154480 2023-11-15T02:36:40.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.667+0000 7f8e20383700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180c9720 con 0x7f8e181540a0 2023-11-15T02:36:40.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.667+0000 7f8e1e920700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8e180c6650 0x7f8e180aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41694/0 (socket says 172.21.15.1:41694) 2023-11-15T02:36:40.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.667+0000 7f8e1e920700 1 -- 172.21.15.1:0/802032093 learned_addr learned my addr 172.21.15.1:0/802032093 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:40.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.667+0000 7f8e1e11f700 1 --2- 172.21.15.1:0/802032093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e181540a0 0x7f8e180ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:40.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48195550 0 0) 0x7f8e180ca050 con 0x7f8e180c6650 2023-11-15T02:36:40.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e000033f0 con 0x7f8e180c6650 2023-11-15T02:36:40.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145806420 0 0) 0x7f8e180c9440 con 0x7f8e18154480 2023-11-15T02:36:40.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e180ca050 con 0x7f8e18154480 2023-11-15T02:36:40.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2980293644 0 0) 0x7f8e000033f0 con 0x7f8e180c6650 2023-11-15T02:36:40.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e181540a0 msgr2=0x7f8e180ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:40.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 --2- 172.21.15.1:0/802032093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e181540a0 0x7f8e180ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:40.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 >> v1:172.21.15.141:6789/0 conn(0x7f8e18154480 legacy=0x7f8e180c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:40.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e180c9a00 con 0x7f8e180c6650 2023-11-15T02:36:40.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f8e080017f0 con 0x7f8e180c6650 2023-11-15T02:36:40.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1e11f700 1 --2- 172.21.15.1:0/802032093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e181540a0 0x7f8e180ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:40.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 >> v1:172.21.15.1:6789/0 conn(0x7f8e180c6650 legacy=0x7f8e180aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:40.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 --2- 172.21.15.1:0/802032093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e00003aa0 0x7f8e00003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:40.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 --2- 172.21.15.1:0/802032093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e181540a0 0x7f8e00004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:40.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 --2- 172.21.15.1:0/802032093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e00004b80 0x7f8e00005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:40.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180c9720 con 0x7f8e00004b80 2023-11-15T02:36:40.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0000b8e0 con 0x7f8e00003aa0 2023-11-15T02:36:40.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0000ba70 con 0x7f8e181540a0 2023-11-15T02:36:40.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1e920700 1 --2- 172.21.15.1:0/802032093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e00004b80 0x7f8e00005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:40.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1e11f700 1 --2- 172.21.15.1:0/802032093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e00003aa0 0x7f8e00003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:40.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1d91e700 1 --2- 172.21.15.1:0/802032093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e181540a0 0x7f8e00004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:40.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1e920700 1 -- 172.21.15.1:0/802032093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e181540a0 msgr2=0x7f8e00004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:40.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1e920700 1 --2- 172.21.15.1:0/802032093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e181540a0 0x7f8e00004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:40.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1e920700 1 -- 172.21.15.1:0/802032093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e00003aa0 msgr2=0x7f8e00003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:40.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1e920700 1 --2- 172.21.15.1:0/802032093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e00003aa0 0x7f8e00003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:40.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.668+0000 7f8e1e920700 1 -- 172.21.15.1:0/802032093 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e100092a0 con 0x7f8e00004b80 2023-11-15T02:36:40.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.669+0000 7f8e1e920700 1 --2- 172.21.15.1:0/802032093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e00004b80 0x7f8e00005000 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f8e18084910 tx=0x7f8e08007f40).ready entity=mon.0 client_cookie=a2cd67aa2b6ea953 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:40.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.669+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800cd90 con 0x7f8e00004b80 2023-11-15T02:36:40.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.669+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e08005b20 con 0x7f8e00004b80 2023-11-15T02:36:40.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.669+0000 7f8e1d11d700 1 -- 172.21.15.1:0/802032093 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08005ea0 con 0x7f8e00004b80 2023-11-15T02:36:40.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.669+0000 7f8e20383700 1 -- 172.21.15.1:0/802032093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e00004b80 msgr2=0x7f8e00005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:40.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.669+0000 7f8e20383700 1 --2- 172.21.15.1:0/802032093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e00004b80 0x7f8e00005000 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f8e18084910 tx=0x7f8e08007f40).stop 2023-11-15T02:36:40.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.669+0000 7f8e1e920700 1 -- 172.21.15.1:0/802032093 reap_dead start 2023-11-15T02:36:40.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.669+0000 7f8e20383700 1 -- 172.21.15.1:0/802032093 shutdown_connections 2023-11-15T02:36:40.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.669+0000 7f8e20383700 1 -- 172.21.15.1:0/802032093 >> 172.21.15.1:0/802032093 conn(0x7f8e18064a70 msgr2=0x7f8e18064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:40.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.669+0000 7f8e20383700 1 -- 172.21.15.1:0/802032093 shutdown_connections 2023-11-15T02:36:40.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.669+0000 7f8e20383700 1 -- 172.21.15.1:0/802032093 wait complete. 2023-11-15T02:36:40.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.670+0000 7f8e20383700 1 Processor -- start 2023-11-15T02:36:40.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.671+0000 7f8e20383700 1 -- start start 2023-11-15T02:36:40.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.671+0000 7f8e20383700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e00004b80 0x7f8e1813c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:40.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.671+0000 7f8e20383700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e180b0dc0 0x7f8e180ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:40.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.671+0000 7f8e20383700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e180c79a0 0x7f8e180c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:40.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.671+0000 7f8e20383700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180c3950 con 0x7f8e180b0dc0 2023-11-15T02:36:40.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.671+0000 7f8e20383700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180c8310 con 0x7f8e00004b80 2023-11-15T02:36:40.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.671+0000 7f8e20383700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180c3020 con 0x7f8e180c79a0 2023-11-15T02:36:40.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.671+0000 7f8e1d91e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e180b0dc0 0x7f8e180ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:40.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.671+0000 7f8e1d91e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e180b0dc0 0x7f8e180ae260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53036/0 (socket says 172.21.15.1:53036) 2023-11-15T02:36:40.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.671+0000 7f8e1d91e700 1 -- 172.21.15.1:0/566925480 learned_addr learned my addr 172.21.15.1:0/566925480 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:40.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.672+0000 7f8e1e11f700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e00004b80 0x7f8e1813c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:40.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.672+0000 7f8e1e920700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e180c79a0 0x7f8e180c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:40.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.672+0000 7f8e1d91e700 1 -- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e180c79a0 msgr2=0x7f8e180c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:40.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.672+0000 7f8e1d91e700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e180c79a0 0x7f8e180c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:40.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.672+0000 7f8e1d91e700 1 -- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e00004b80 msgr2=0x7f8e1813c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:40.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.672+0000 7f8e1d91e700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e00004b80 0x7f8e1813c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:40.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.672+0000 7f8e1d91e700 1 -- 172.21.15.1:0/566925480 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e180c3300 con 0x7f8e180b0dc0 2023-11-15T02:36:40.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.672+0000 7f8e1e11f700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e00004b80 0x7f8e1813c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:40.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.672+0000 7f8e1e920700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e180c79a0 0x7f8e180c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:40.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.672+0000 7f8e1d91e700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e180b0dc0 0x7f8e180ae260 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f8e0c007900 tx=0x7f8e0c007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:40.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.672+0000 7f8e167fc700 1 -- 172.21.15.1:0/566925480 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c00f8d0 con 0x7f8e180b0dc0 2023-11-15T02:36:40.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.672+0000 7f8e167fc700 1 -- 172.21.15.1:0/566925480 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c00fa50 con 0x7f8e180b0dc0 2023-11-15T02:36:40.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.672+0000 7f8e20383700 1 -- 172.21.15.1:0/566925480 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e180c35e0 con 0x7f8e180b0dc0 2023-11-15T02:36:40.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.672+0000 7f8e167fc700 1 -- 172.21.15.1:0/566925480 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c00fe10 con 0x7f8e180b0dc0 2023-11-15T02:36:40.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.672+0000 7f8e20383700 1 -- 172.21.15.1:0/566925480 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e18151490 con 0x7f8e180b0dc0 2023-11-15T02:36:40.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.673+0000 7f8e20383700 1 -- 172.21.15.1:0/566925480 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e180c3b00 con 0x7f8e180b0dc0 2023-11-15T02:36:40.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.673+0000 7f8e167fc700 1 -- 172.21.15.1:0/566925480 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8e0c01d3b0 con 0x7f8e180b0dc0 2023-11-15T02:36:40.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.674+0000 7f8e167fc700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e0405f270 0x7f8e04061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:40.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.674+0000 7f8e167fc700 1 -- 172.21.15.1:0/566925480 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f8e0c07a510 con 0x7f8e180b0dc0 2023-11-15T02:36:40.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.674+0000 7f8e1e11f700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e0405f270 0x7f8e04061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:40.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.674+0000 7f8e1e11f700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e0405f270 0x7f8e04061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f8e10006d80 tx=0x7f8e10008040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:40.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.678+0000 7f8e167fc700 1 -- 172.21.15.1:0/566925480 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8e180c3b00 con 0x7f8e180b0dc0 2023-11-15T02:36:40.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:40.897+0000 7f8e20383700 1 -- 172.21.15.1:0/566925480 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8e180c3b00 con 0x7f8e180b0dc0 2023-11-15T02:36:41.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.527+0000 7f8e167fc700 1 -- 172.21.15.1:0/566925480 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v71) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8e180c3b00 con 0x7f8e180b0dc0 2023-11-15T02:36:41.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.529+0000 7f8e20383700 1 -- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e0405f270 msgr2=0x7f8e04061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:41.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.529+0000 7f8e20383700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e0405f270 0x7f8e04061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f8e10006d80 tx=0x7f8e10008040).stop 2023-11-15T02:36:41.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.529+0000 7f8e20383700 1 -- 172.21.15.1:0/566925480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e180b0dc0 msgr2=0x7f8e180ae260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:41.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.529+0000 7f8e20383700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e180b0dc0 0x7f8e180ae260 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f8e0c007900 tx=0x7f8e0c007bb0).stop 2023-11-15T02:36:41.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.529+0000 7f8e20383700 1 -- 172.21.15.1:0/566925480 shutdown_connections 2023-11-15T02:36:41.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.529+0000 7f8e20383700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8e0405f270 0x7f8e04061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:41.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.529+0000 7f8e20383700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e180c79a0 0x7f8e180c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:41.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.529+0000 7f8e20383700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e00004b80 0x7f8e1813c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:41.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.529+0000 7f8e20383700 1 --2- 172.21.15.1:0/566925480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e180b0dc0 0x7f8e180ae260 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:41.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.530+0000 7f8e20383700 1 -- 172.21.15.1:0/566925480 >> 172.21.15.1:0/566925480 conn(0x7f8e18064a70 msgr2=0x7f8e18159fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:41.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.530+0000 7f8e20383700 1 -- 172.21.15.1:0/566925480 shutdown_connections 2023-11-15T02:36:41.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.530+0000 7f8e20383700 1 -- 172.21.15.1:0/566925480 wait complete. 2023-11-15T02:36:41.545 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-15T02:36:41.545 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:36:41.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.665+0000 7f7d460bf700 1 Processor -- start 2023-11-15T02:36:41.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.665+0000 7f7d460bf700 1 -- start start 2023-11-15T02:36:41.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.665+0000 7f7d460bf700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7d400bdfb0 0x7f7d400be390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:41.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d460bf700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d400ad5e0 con 0x7f7d400c6d10 2023-11-15T02:36:41.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d460bf700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d400ad8c0 con 0x7f7d40154e70 2023-11-15T02:36:41.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d460bf700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d400bccd0 con 0x7f7d400bdfb0 2023-11-15T02:36:41.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3effd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7d400c6d10 0x7f7d400bd400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41708/0 (socket says 172.21.15.1:41708) 2023-11-15T02:36:41.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3effd700 1 -- 172.21.15.1:0/3063012021 learned_addr learned my addr 172.21.15.1:0/3063012021 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:41.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3e7fc700 1 -- 172.21.15.1:0/3063012021 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963803463 0 0) 0x7f7d400ad5e0 con 0x7f7d400c6d10 2023-11-15T02:36:41.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3e7fc700 1 -- 172.21.15.1:0/3063012021 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d280033f0 con 0x7f7d400c6d10 2023-11-15T02:36:41.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3f7fe700 1 --2- 172.21.15.1:0/3063012021 >> v2:172.21.15.141:3300/0 conn(0x7f7d400bdfb0 0x7f7d400be390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:41.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3e7fc700 1 -- 172.21.15.1:0/3063012021 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 930551817 0 0) 0x7f7d280033f0 con 0x7f7d400c6d10 2023-11-15T02:36:41.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3e7fc700 1 -- 172.21.15.1:0/3063012021 >> v2:172.21.15.141:3300/0 conn(0x7f7d400bdfb0 msgr2=0x7f7d400be390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:41.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3e7fc700 1 --2- 172.21.15.1:0/3063012021 >> v2:172.21.15.141:3300/0 conn(0x7f7d400bdfb0 0x7f7d400be390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:41.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3e7fc700 1 -- 172.21.15.1:0/3063012021 >> v1:172.21.15.141:6789/0 conn(0x7f7d40154e70 legacy=0x7f7d40155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:41.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3e7fc700 1 -- 172.21.15.1:0/3063012021 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400adba0 con 0x7f7d400c6d10 2023-11-15T02:36:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3e7fc700 1 -- 172.21.15.1:0/3063012021 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f7d34001470 con 0x7f7d400c6d10 2023-11-15T02:36:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3e7fc700 1 -- 172.21.15.1:0/3063012021 >> v1:172.21.15.1:6789/0 conn(0x7f7d400c6d10 legacy=0x7f7d400bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3e7fc700 1 --2- 172.21.15.1:0/3063012021 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d280038e0 0x7f7d28003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3e7fc700 1 --2- 172.21.15.1:0/3063012021 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d28004690 0x7f7d28004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3e7fc700 1 --2- 172.21.15.1:0/3063012021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d28005000 0x7f7d2800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:41.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3e7fc700 1 -- 172.21.15.1:0/3063012021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400bccd0 con 0x7f7d28005000 2023-11-15T02:36:41.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3e7fc700 1 -- 172.21.15.1:0/3063012021 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2800beb0 con 0x7f7d28004690 2023-11-15T02:36:41.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.666+0000 7f7d3e7fc700 1 -- 172.21.15.1:0/3063012021 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2800e280 con 0x7f7d280038e0 2023-11-15T02:36:41.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.667+0000 7f7d3effd700 1 --2- 172.21.15.1:0/3063012021 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d28004690 0x7f7d28004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:41.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.667+0000 7f7d3ffff700 1 --2- 172.21.15.1:0/3063012021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d28005000 0x7f7d2800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:41.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.667+0000 7f7d3f7fe700 1 --2- 172.21.15.1:0/3063012021 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d280038e0 0x7f7d28003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:41.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.667+0000 7f7d3ffff700 1 -- 172.21.15.1:0/3063012021 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d280038e0 msgr2=0x7f7d28003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:41.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.667+0000 7f7d3ffff700 1 --2- 172.21.15.1:0/3063012021 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d280038e0 0x7f7d28003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:41.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.667+0000 7f7d3ffff700 1 -- 172.21.15.1:0/3063012021 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d28004690 msgr2=0x7f7d28004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:41.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.667+0000 7f7d3ffff700 1 --2- 172.21.15.1:0/3063012021 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d28004690 0x7f7d28004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:41.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.667+0000 7f7d3ffff700 1 -- 172.21.15.1:0/3063012021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d280033f0 con 0x7f7d28005000 2023-11-15T02:36:41.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.667+0000 7f7d3ffff700 1 -- 172.21.15.1:0/3063012021 reap_dead start 2023-11-15T02:36:41.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.667+0000 7f7d3ffff700 1 --2- 172.21.15.1:0/3063012021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d28005000 0x7f7d2800b8e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f7d38001e30 tx=0x7f7d38007f30).ready entity=mon.0 client_cookie=553b72f48f03b633 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:41.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.667+0000 7f7d3e7fc700 1 -- 172.21.15.1:0/3063012021 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38006a20 con 0x7f7d28005000 2023-11-15T02:36:41.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.667+0000 7f7d3e7fc700 1 -- 172.21.15.1:0/3063012021 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d38006b80 con 0x7f7d28005000 2023-11-15T02:36:41.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.667+0000 7f7d3e7fc700 1 -- 172.21.15.1:0/3063012021 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3800c5d0 con 0x7f7d28005000 2023-11-15T02:36:41.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.668+0000 7f7d460bf700 1 -- 172.21.15.1:0/3063012021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d28005000 msgr2=0x7f7d2800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:41.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.668+0000 7f7d460bf700 1 --2- 172.21.15.1:0/3063012021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d28005000 0x7f7d2800b8e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f7d38001e30 tx=0x7f7d38007f30).stop 2023-11-15T02:36:41.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.668+0000 7f7d460bf700 1 -- 172.21.15.1:0/3063012021 shutdown_connections 2023-11-15T02:36:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.668+0000 7f7d460bf700 1 --2- 172.21.15.1:0/3063012021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d28005000 0x7f7d2800b8e0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.668+0000 7f7d460bf700 1 -- 172.21.15.1:0/3063012021 >> 172.21.15.1:0/3063012021 conn(0x7f7d400c7d70 msgr2=0x7f7d400c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.668+0000 7f7d460bf700 1 -- 172.21.15.1:0/3063012021 shutdown_connections 2023-11-15T02:36:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.668+0000 7f7d460bf700 1 -- 172.21.15.1:0/3063012021 wait complete. 2023-11-15T02:36:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.669+0000 7f7d460bf700 1 Processor -- start 2023-11-15T02:36:41.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.669+0000 7f7d460bf700 1 -- start start 2023-11-15T02:36:41.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d460bf700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d28005000 0x7f7d40142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:41.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d460bf700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d400bf7e0 0x7f7d400bfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:41.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d460bf700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d400aad20 0x7f7d400ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:41.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d460bf700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400a97a0 con 0x7f7d28005000 2023-11-15T02:36:41.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d460bf700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400a8e70 con 0x7f7d400aad20 2023-11-15T02:36:41.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d460bf700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400a9150 con 0x7f7d400bf7e0 2023-11-15T02:36:41.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d3f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d28005000 0x7f7d40142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:41.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d3f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d28005000 0x7f7d40142fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53060/0 (socket says 172.21.15.1:53060) 2023-11-15T02:36:41.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d3f7fe700 1 -- 172.21.15.1:0/3657822512 learned_addr learned my addr 172.21.15.1:0/3657822512 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:41.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d3effd700 1 --2- 172.21.15.1:0/3657822512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d400bf7e0 0x7f7d400bfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:41.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d3ffff700 1 --2- 172.21.15.1:0/3657822512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d400aad20 0x7f7d400ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:41.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d3f7fe700 1 -- 172.21.15.1:0/3657822512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d400bf7e0 msgr2=0x7f7d400bfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:41.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d3f7fe700 1 --2- 172.21.15.1:0/3657822512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d400bf7e0 0x7f7d400bfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:41.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d3f7fe700 1 -- 172.21.15.1:0/3657822512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d400aad20 msgr2=0x7f7d400ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:41.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d3f7fe700 1 --2- 172.21.15.1:0/3657822512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d400aad20 0x7f7d400ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:41.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d3f7fe700 1 -- 172.21.15.1:0/3657822512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400a9430 con 0x7f7d28005000 2023-11-15T02:36:41.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d3ffff700 1 --2- 172.21.15.1:0/3657822512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d400aad20 0x7f7d400ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:41.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d3f7fe700 1 --2- 172.21.15.1:0/3657822512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d28005000 0x7f7d40142fe0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f7d300119c0 tx=0x7f7d30009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:41.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d277fe700 1 -- 172.21.15.1:0/3657822512 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30011e50 con 0x7f7d28005000 2023-11-15T02:36:41.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.670+0000 7f7d277fe700 1 -- 172.21.15.1:0/3657822512 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3000f940 con 0x7f7d28005000 2023-11-15T02:36:41.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.671+0000 7f7d460bf700 1 -- 172.21.15.1:0/3657822512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d400a8b20 con 0x7f7d28005000 2023-11-15T02:36:41.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.671+0000 7f7d277fe700 1 -- 172.21.15.1:0/3657822512 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3000fd00 con 0x7f7d28005000 2023-11-15T02:36:41.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.671+0000 7f7d460bf700 1 -- 172.21.15.1:0/3657822512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d401434d0 con 0x7f7d28005000 2023-11-15T02:36:41.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.672+0000 7f7d460bf700 1 -- 172.21.15.1:0/3657822512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d400a9a80 con 0x7f7d28005000 2023-11-15T02:36:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.672+0000 7f7d277fe700 1 -- 172.21.15.1:0/3657822512 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7d30014650 con 0x7f7d28005000 2023-11-15T02:36:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.672+0000 7f7d277fe700 1 --2- 172.21.15.1:0/3657822512 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d2c05f270 0x7f7d2c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.672+0000 7f7d277fe700 1 -- 172.21.15.1:0/3657822512 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f7d3007b140 con 0x7f7d28005000 2023-11-15T02:36:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.672+0000 7f7d3effd700 1 --2- 172.21.15.1:0/3657822512 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d2c05f270 0x7f7d2c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.673+0000 7f7d3effd700 1 --2- 172.21.15.1:0/3657822512 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d2c05f270 0x7f7d2c061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7d400c1240 tx=0x7f7d34001e50).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:41.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.676+0000 7f7d277fe700 1 -- 172.21.15.1:0/3657822512 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7d3004c010 con 0x7f7d28005000 2023-11-15T02:36:41.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.894+0000 7f7d460bf700 1 -- 172.21.15.1:0/3657822512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d4006c7e0 con 0x7f7d28005000 2023-11-15T02:36:41.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.895+0000 7f7d277fe700 1 -- 172.21.15.1:0/3657822512 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f7d3004f630 con 0x7f7d28005000 2023-11-15T02:36:41.897 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:41.897 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7019,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3898250637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3898250637},{"type":"v1","addr":"172.21.15.141:6836","nonce":3898250637}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7022,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3709207600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3709207600},{"type":"v1","addr":"172.21.15.141:6837","nonce":3709207600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1212884558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1212884558},{"type":"v1","addr":"172.21.15.1:6835","nonce":1212884558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:36:38.505394+0000","modified":"2023-11-15T02:36:41.520212+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8619":{"gid":8619,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6834/1968331775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1968331775},{"type":"v1","addr":"172.21.15.1:6834","nonce":1968331775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-11-15T02:36:41.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.897+0000 7f7d460bf700 1 -- 172.21.15.1:0/3657822512 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d2c05f270 msgr2=0x7f7d2c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:41.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.897+0000 7f7d460bf700 1 --2- 172.21.15.1:0/3657822512 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d2c05f270 0x7f7d2c061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7d400c1240 tx=0x7f7d34001e50).stop 2023-11-15T02:36:41.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.897+0000 7f7d460bf700 1 -- 172.21.15.1:0/3657822512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d28005000 msgr2=0x7f7d40142fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:41.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.897+0000 7f7d460bf700 1 --2- 172.21.15.1:0/3657822512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d28005000 0x7f7d40142fe0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f7d300119c0 tx=0x7f7d30009060).stop 2023-11-15T02:36:41.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.897+0000 7f7d460bf700 1 -- 172.21.15.1:0/3657822512 shutdown_connections 2023-11-15T02:36:41.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.897+0000 7f7d460bf700 1 --2- 172.21.15.1:0/3657822512 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d2c05f270 0x7f7d2c061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:41.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.897+0000 7f7d460bf700 1 --2- 172.21.15.1:0/3657822512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d400aad20 0x7f7d400ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:41.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.897+0000 7f7d460bf700 1 --2- 172.21.15.1:0/3657822512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d28005000 0x7f7d40142fe0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:41.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.897+0000 7f7d460bf700 1 --2- 172.21.15.1:0/3657822512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d400bf7e0 0x7f7d400bfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:41.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.897+0000 7f7d460bf700 1 -- 172.21.15.1:0/3657822512 >> 172.21.15.1:0/3657822512 conn(0x7f7d400c7d70 msgr2=0x7f7d4014ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:41.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.897+0000 7f7d460bf700 1 -- 172.21.15.1:0/3657822512 shutdown_connections 2023-11-15T02:36:41.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:41.897+0000 7f7d460bf700 1 -- 172.21.15.1:0/3657822512 wait complete. 2023-11-15T02:36:41.902 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 71 2023-11-15T02:36:41.911 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:36:42.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.028+0000 7f13c9c69700 1 Processor -- start 2023-11-15T02:36:42.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.028+0000 7f13c9c69700 1 -- start start 2023-11-15T02:36:42.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.029+0000 7f13c9c69700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f13c4154150 0x7f13c4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.029+0000 7f13c9c69700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13c40aa060 0x7f13c40c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.029+0000 7f13c9c69700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c40c06f0 con 0x7f13c40ab1a0 2023-11-15T02:36:42.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.029+0000 7f13c9c69700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c40c09d0 con 0x7f13c40aa060 2023-11-15T02:36:42.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.029+0000 7f13c9c69700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c4158820 con 0x7f13c4154150 2023-11-15T02:36:42.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.029+0000 7f13c3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13c40aa060 0x7f13c40c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.029+0000 7f13c3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13c40aa060 0x7f13c40c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53072/0 (socket says 172.21.15.1:53072) 2023-11-15T02:36:42.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.029+0000 7f13c3fff700 1 -- 172.21.15.1:0/3556121907 learned_addr learned my addr 172.21.15.1:0/3556121907 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:42.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.029+0000 7f13c37fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f13c4154150 0x7f13c4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.029+0000 7f13c3fff700 1 -- 172.21.15.1:0/3556121907 >> v2:172.21.15.141:3300/0 conn(0x7f13c4154150 msgr2=0x7f13c4154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:42.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.029+0000 7f13c3fff700 1 --2- 172.21.15.1:0/3556121907 >> v2:172.21.15.141:3300/0 conn(0x7f13c4154150 0x7f13c4154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.029+0000 7f13c3fff700 1 -- 172.21.15.1:0/3556121907 >> v1:172.21.15.141:6789/0 conn(0x7f13c40ab1a0 legacy=0x7f13c4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.029+0000 7f13c3fff700 1 -- 172.21.15.1:0/3556121907 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c4158b00 con 0x7f13c40aa060 2023-11-15T02:36:42.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.029+0000 7f13c3fff700 1 --2- 172.21.15.1:0/3556121907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c40aa060 0x7f13c40c5f10 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f13c406bfb0 tx=0x7f13bc009840).ready entity=mon.0 client_cookie=1c85c170b0a71c93 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:42.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.030+0000 7f13c27fc700 1 -- 172.21.15.1:0/3556121907 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00e070 con 0x7f13c40aa060 2023-11-15T02:36:42.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.030+0000 7f13c27fc700 1 -- 172.21.15.1:0/3556121907 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc00ba20 con 0x7f13c40aa060 2023-11-15T02:36:42.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.030+0000 7f13c27fc700 1 -- 172.21.15.1:0/3556121907 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00bda0 con 0x7f13c40aa060 2023-11-15T02:36:42.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.030+0000 7f13c9c69700 1 -- 172.21.15.1:0/3556121907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c40aa060 msgr2=0x7f13c40c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.030+0000 7f13c9c69700 1 --2- 172.21.15.1:0/3556121907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c40aa060 0x7f13c40c5f10 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f13c406bfb0 tx=0x7f13bc009840).stop 2023-11-15T02:36:42.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.030+0000 7f13c9c69700 1 -- 172.21.15.1:0/3556121907 shutdown_connections 2023-11-15T02:36:42.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.030+0000 7f13c9c69700 1 --2- 172.21.15.1:0/3556121907 >> v2:172.21.15.141:3300/0 conn(0x7f13c4154150 0x7f13c4154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.030+0000 7f13c9c69700 1 --2- 172.21.15.1:0/3556121907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c40aa060 0x7f13c40c5f10 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.030+0000 7f13c9c69700 1 -- 172.21.15.1:0/3556121907 >> 172.21.15.1:0/3556121907 conn(0x7f13c4064aa0 msgr2=0x7f13c4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:42.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.030+0000 7f13c9c69700 1 -- 172.21.15.1:0/3556121907 shutdown_connections 2023-11-15T02:36:42.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.030+0000 7f13c9c69700 1 -- 172.21.15.1:0/3556121907 wait complete. 2023-11-15T02:36:42.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.031+0000 7f13c9c69700 1 Processor -- start 2023-11-15T02:36:42.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.031+0000 7f13c9c69700 1 -- start start 2023-11-15T02:36:42.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.032+0000 7f13c9c69700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c40aa060 0x7f13c40ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.032+0000 7f13c9c69700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13c40ab1a0 0x7f13c4144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.032+0000 7f13c9c69700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c4154150 0x7f13c414e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.032+0000 7f13c9c69700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c40ae930 con 0x7f13c4154150 2023-11-15T02:36:42.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.032+0000 7f13c9c69700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c40aec10 con 0x7f13c40ab1a0 2023-11-15T02:36:42.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.032+0000 7f13c9c69700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c40aeef0 con 0x7f13c40aa060 2023-11-15T02:36:42.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.032+0000 7f13c3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c4154150 0x7f13c414e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.032+0000 7f13c3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c4154150 0x7f13c414e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53084/0 (socket says 172.21.15.1:53084) 2023-11-15T02:36:42.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.032+0000 7f13c3fff700 1 -- 172.21.15.1:0/1701537927 learned_addr learned my addr 172.21.15.1:0/1701537927 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:42.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.032+0000 7f13c2ffd700 1 --2- 172.21.15.1:0/1701537927 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13c40ab1a0 0x7f13c4144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.032+0000 7f13c37fe700 1 --2- 172.21.15.1:0/1701537927 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c40aa060 0x7f13c40ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.033+0000 7f13c3fff700 1 -- 172.21.15.1:0/1701537927 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c40aa060 msgr2=0x7f13c40ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.033+0000 7f13c3fff700 1 --2- 172.21.15.1:0/1701537927 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c40aa060 0x7f13c40ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.033+0000 7f13c3fff700 1 -- 172.21.15.1:0/1701537927 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13c40ab1a0 msgr2=0x7f13c4144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.033+0000 7f13c3fff700 1 --2- 172.21.15.1:0/1701537927 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13c40ab1a0 0x7f13c4144a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.033+0000 7f13c3fff700 1 -- 172.21.15.1:0/1701537927 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc009ae0 con 0x7f13c4154150 2023-11-15T02:36:42.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.033+0000 7f13c3fff700 1 --2- 172.21.15.1:0/1701537927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c4154150 0x7f13c414e550 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f13bc00b6c0 tx=0x7f13bc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:42.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.033+0000 7f13ab7fe700 1 -- 172.21.15.1:0/1701537927 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0092e0 con 0x7f13c4154150 2023-11-15T02:36:42.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.033+0000 7f13ab7fe700 1 -- 172.21.15.1:0/1701537927 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc01e470 con 0x7f13c4154150 2023-11-15T02:36:42.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.033+0000 7f13c9c69700 1 -- 172.21.15.1:0/1701537927 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c40c2950 con 0x7f13c4154150 2023-11-15T02:36:42.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.033+0000 7f13ab7fe700 1 -- 172.21.15.1:0/1701537927 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc01e810 con 0x7f13c4154150 2023-11-15T02:36:42.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.033+0000 7f13c9c69700 1 -- 172.21.15.1:0/1701537927 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c40ae520 con 0x7f13c4154150 2023-11-15T02:36:42.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.034+0000 7f13c9c69700 1 -- 172.21.15.1:0/1701537927 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c40c2b90 con 0x7f13c4154150 2023-11-15T02:36:42.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.034+0000 7f13ab7fe700 1 -- 172.21.15.1:0/1701537927 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f13bc003040 con 0x7f13c4154150 2023-11-15T02:36:42.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.035+0000 7f13ab7fe700 1 --2- 172.21.15.1:0/1701537927 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f270 0x7f13b0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.035+0000 7f13ab7fe700 1 -- 172.21.15.1:0/1701537927 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f13bc07ba10 con 0x7f13c4154150 2023-11-15T02:36:42.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.035+0000 7f13c37fe700 1 --2- 172.21.15.1:0/1701537927 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f270 0x7f13b0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.035+0000 7f13c37fe700 1 --2- 172.21.15.1:0/1701537927 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f270 0x7f13b0061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f13b4009b90 tx=0x7f13b4009060).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:42.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.039+0000 7f13ab7fe700 1 -- 172.21.15.1:0/1701537927 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f13bc04ca20 con 0x7f13c4154150 2023-11-15T02:36:42.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.210+0000 7f13c9c69700 1 -- 172.21.15.1:0/1701537927 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13c406c7e0 con 0x7f13c4154150 2023-11-15T02:36:42.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.211+0000 7f13ab7fe700 1 -- 172.21.15.1:0/1701537927 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+17655 (secure 0 0 0) 0x7f13bc023070 con 0x7f13c4154150 2023-11-15T02:36:42.213 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:42.214 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":162,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:36:39.507194+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:36:36.177693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-11-15T02:36:37.489367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:36:42.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.213+0000 7f13c9c69700 1 -- 172.21.15.1:0/1701537927 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f270 msgr2=0x7f13b0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.213+0000 7f13c9c69700 1 --2- 172.21.15.1:0/1701537927 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f270 0x7f13b0061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f13b4009b90 tx=0x7f13b4009060).stop 2023-11-15T02:36:42.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.213+0000 7f13c9c69700 1 -- 172.21.15.1:0/1701537927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c4154150 msgr2=0x7f13c414e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.213+0000 7f13c9c69700 1 --2- 172.21.15.1:0/1701537927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c4154150 0x7f13c414e550 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f13bc00b6c0 tx=0x7f13bc009840).stop 2023-11-15T02:36:42.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.213+0000 7f13c9c69700 1 -- 172.21.15.1:0/1701537927 shutdown_connections 2023-11-15T02:36:42.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.213+0000 7f13c9c69700 1 --2- 172.21.15.1:0/1701537927 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f13b005f270 0x7f13b0061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.213+0000 7f13c9c69700 1 --2- 172.21.15.1:0/1701537927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13c4154150 0x7f13c414e550 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.213+0000 7f13c9c69700 1 --2- 172.21.15.1:0/1701537927 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13c40aa060 0x7f13c40ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.213+0000 7f13c9c69700 1 --2- 172.21.15.1:0/1701537927 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13c40ab1a0 0x7f13c4144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.213+0000 7f13c9c69700 1 -- 172.21.15.1:0/1701537927 >> 172.21.15.1:0/1701537927 conn(0x7f13c4064aa0 msgr2=0x7f13c4063d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.213+0000 7f13c9c69700 1 -- 172.21.15.1:0/1701537927 shutdown_connections 2023-11-15T02:36:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.213+0000 7f13c9c69700 1 -- 172.21.15.1:0/1701537927 wait complete. 2023-11-15T02:36:42.227 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-15T02:36:42.228 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:36:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.344+0000 7ff1598fc700 1 Processor -- start 2023-11-15T02:36:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.344+0000 7ff1598fc700 1 -- start start 2023-11-15T02:36:42.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.345+0000 7ff1598fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff154154150 0x7ff154154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.345+0000 7ff1598fc700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff1540aa060 0x7ff1540c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.345+0000 7ff1598fc700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1540c06f0 con 0x7ff1540ab1a0 2023-11-15T02:36:42.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.345+0000 7ff1598fc700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1540c09d0 con 0x7ff154154150 2023-11-15T02:36:42.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.345+0000 7ff1598fc700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff154158820 con 0x7ff1540aa060 2023-11-15T02:36:42.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.345+0000 7ff152ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff154154150 0x7ff154154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.345+0000 7ff1527fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff1540ab1a0 0x7ff154158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41722/0 (socket says 172.21.15.1:41722) 2023-11-15T02:36:42.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.345+0000 7ff1527fc700 1 -- 172.21.15.1:0/238528077 learned_addr learned my addr 172.21.15.1:0/238528077 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:42.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.345+0000 7ff152ffd700 1 --2- 172.21.15.1:0/238528077 >> v2:172.21.15.1:3300/0 conn(0x7ff154154150 0x7ff154154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53098/0 (socket says 172.21.15.1:53098) 2023-11-15T02:36:42.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.345+0000 7ff1537fe700 1 --2- 172.21.15.1:0/238528077 >> v2:172.21.15.141:3300/0 conn(0x7ff1540aa060 0x7ff1540c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff152ffd700 1 -- 172.21.15.1:0/238528077 >> v2:172.21.15.141:3300/0 conn(0x7ff1540aa060 msgr2=0x7ff1540c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:42.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff152ffd700 1 --2- 172.21.15.1:0/238528077 >> v2:172.21.15.141:3300/0 conn(0x7ff1540aa060 0x7ff1540c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff152ffd700 1 -- 172.21.15.1:0/238528077 >> v1:172.21.15.1:6789/0 conn(0x7ff1540ab1a0 legacy=0x7ff154158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff152ffd700 1 -- 172.21.15.1:0/238528077 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff154158b00 con 0x7ff154154150 2023-11-15T02:36:42.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff151ffb700 1 -- 172.21.15.1:0/238528077 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718214216 0 0) 0x7ff1540c06f0 con 0x7ff1540ab1a0 2023-11-15T02:36:42.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff1537fe700 1 --2- 172.21.15.1:0/238528077 >> v2:172.21.15.141:3300/0 conn(0x7ff1540aa060 0x7ff1540c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:42.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff152ffd700 1 --2- 172.21.15.1:0/238528077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff154154150 0x7ff154154530 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7ff154157f80 tx=0x7ff14c009060).ready entity=mon.0 client_cookie=58ef183e0e861dbe server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:42.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff151ffb700 1 -- 172.21.15.1:0/238528077 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0090d0 con 0x7ff154154150 2023-11-15T02:36:42.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff151ffb700 1 -- 172.21.15.1:0/238528077 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c00b580 con 0x7ff154154150 2023-11-15T02:36:42.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff151ffb700 1 -- 172.21.15.1:0/238528077 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c00b900 con 0x7ff154154150 2023-11-15T02:36:42.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff1598fc700 1 -- 172.21.15.1:0/238528077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff154154150 msgr2=0x7ff154154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff1598fc700 1 --2- 172.21.15.1:0/238528077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff154154150 0x7ff154154530 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7ff154157f80 tx=0x7ff14c009060).stop 2023-11-15T02:36:42.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff1598fc700 1 -- 172.21.15.1:0/238528077 shutdown_connections 2023-11-15T02:36:42.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff1598fc700 1 --2- 172.21.15.1:0/238528077 >> v2:172.21.15.141:3300/0 conn(0x7ff1540aa060 0x7ff1540c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff1598fc700 1 --2- 172.21.15.1:0/238528077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff154154150 0x7ff154154530 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff1598fc700 1 -- 172.21.15.1:0/238528077 >> 172.21.15.1:0/238528077 conn(0x7ff154064aa0 msgr2=0x7ff154064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:42.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff1598fc700 1 -- 172.21.15.1:0/238528077 shutdown_connections 2023-11-15T02:36:42.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.346+0000 7ff1598fc700 1 -- 172.21.15.1:0/238528077 wait complete. 2023-11-15T02:36:42.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.348+0000 7ff1598fc700 1 Processor -- start 2023-11-15T02:36:42.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.348+0000 7ff1598fc700 1 -- start start 2023-11-15T02:36:42.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.348+0000 7ff1598fc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1540aa060 0x7ff15414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.348+0000 7ff1598fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1540ab1a0 0x7ff154156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.348+0000 7ff1598fc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff154154150 0x7ff1540c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.348+0000 7ff1598fc700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540c2260 con 0x7ff1540ab1a0 2023-11-15T02:36:42.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.348+0000 7ff1598fc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540c2540 con 0x7ff1540aa060 2023-11-15T02:36:42.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.348+0000 7ff1598fc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff154156d50 con 0x7ff154154150 2023-11-15T02:36:42.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff1527fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1540ab1a0 0x7ff154156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff1527fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1540ab1a0 0x7ff154156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53102/0 (socket says 172.21.15.1:53102) 2023-11-15T02:36:42.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff1527fc700 1 -- 172.21.15.1:0/1543055853 learned_addr learned my addr 172.21.15.1:0/1543055853 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:42.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff1537fe700 1 --2- 172.21.15.1:0/1543055853 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff154154150 0x7ff1540c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff152ffd700 1 --2- 172.21.15.1:0/1543055853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1540aa060 0x7ff15414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff1527fc700 1 -- 172.21.15.1:0/1543055853 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff154154150 msgr2=0x7ff1540c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff1527fc700 1 --2- 172.21.15.1:0/1543055853 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff154154150 0x7ff1540c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff1527fc700 1 -- 172.21.15.1:0/1543055853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1540aa060 msgr2=0x7ff15414fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff1527fc700 1 --2- 172.21.15.1:0/1543055853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1540aa060 0x7ff15414fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff1527fc700 1 -- 172.21.15.1:0/1543055853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0092a0 con 0x7ff1540ab1a0 2023-11-15T02:36:42.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff152ffd700 1 --2- 172.21.15.1:0/1543055853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1540aa060 0x7ff15414fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:42.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff1527fc700 1 --2- 172.21.15.1:0/1543055853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1540ab1a0 0x7ff154156440 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7ff13c00c510 tx=0x7ff13c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:42.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff14affd700 1 -- 172.21.15.1:0/1543055853 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c0072e0 con 0x7ff1540ab1a0 2023-11-15T02:36:42.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff14affd700 1 -- 172.21.15.1:0/1543055853 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c007440 con 0x7ff1540ab1a0 2023-11-15T02:36:42.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff1598fc700 1 -- 172.21.15.1:0/1543055853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff154157030 con 0x7ff1540ab1a0 2023-11-15T02:36:42.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff14affd700 1 -- 172.21.15.1:0/1543055853 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c0057a0 con 0x7ff1540ab1a0 2023-11-15T02:36:42.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.349+0000 7ff1598fc700 1 -- 172.21.15.1:0/1543055853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff154150160 con 0x7ff1540ab1a0 2023-11-15T02:36:42.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.350+0000 7ff1598fc700 1 -- 172.21.15.1:0/1543055853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15406c7e0 con 0x7ff1540ab1a0 2023-11-15T02:36:42.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.351+0000 7ff14affd700 1 -- 172.21.15.1:0/1543055853 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff13c005bd0 con 0x7ff1540ab1a0 2023-11-15T02:36:42.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.351+0000 7ff14affd700 1 --2- 172.21.15.1:0/1543055853 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff13405f240 0x7ff134061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.351+0000 7ff14affd700 1 -- 172.21.15.1:0/1543055853 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6617+0+0 (secure 0 0 0) 0x7ff13c079ec0 con 0x7ff1540ab1a0 2023-11-15T02:36:42.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.351+0000 7ff152ffd700 1 --2- 172.21.15.1:0/1543055853 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff13405f240 0x7ff134061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.352+0000 7ff152ffd700 1 --2- 172.21.15.1:0/1543055853 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff13405f240 0x7ff134061700 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff14c00b340 tx=0x7ff14c017000).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:42.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.355+0000 7ff14affd700 1 -- 172.21.15.1:0/1543055853 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff13c04ae20 con 0x7ff1540ab1a0 2023-11-15T02:36:42.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.525+0000 7ff1598fc700 1 -- 172.21.15.1:0/1543055853 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1540c02a0 con 0x7ff13405f240 2023-11-15T02:36:42.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.537+0000 7ff14affd700 1 -- 172.21.15.1:0/1543055853 <== mgr.8421 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361927 (secure 0 0 0) 0x7ff1540c02a0 con 0x7ff13405f240 2023-11-15T02:36:42.543 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:42.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.540+0000 7ff1598fc700 1 -- 172.21.15.1:0/1543055853 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff13405f240 msgr2=0x7ff134061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.540+0000 7ff1598fc700 1 --2- 172.21.15.1:0/1543055853 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff13405f240 0x7ff134061700 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff14c00b340 tx=0x7ff14c017000).stop 2023-11-15T02:36:42.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.540+0000 7ff1598fc700 1 -- 172.21.15.1:0/1543055853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1540ab1a0 msgr2=0x7ff154156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.540+0000 7ff1598fc700 1 --2- 172.21.15.1:0/1543055853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1540ab1a0 0x7ff154156440 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7ff13c00c510 tx=0x7ff13c007c70).stop 2023-11-15T02:36:42.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.540+0000 7ff1598fc700 1 -- 172.21.15.1:0/1543055853 shutdown_connections 2023-11-15T02:36:42.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.540+0000 7ff1598fc700 1 --2- 172.21.15.1:0/1543055853 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff13405f240 0x7ff134061700 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.540+0000 7ff1598fc700 1 --2- 172.21.15.1:0/1543055853 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff154154150 0x7ff1540c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.540+0000 7ff1598fc700 1 --2- 172.21.15.1:0/1543055853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1540aa060 0x7ff15414fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.540+0000 7ff1598fc700 1 --2- 172.21.15.1:0/1543055853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1540ab1a0 0x7ff154156440 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.540+0000 7ff1598fc700 1 -- 172.21.15.1:0/1543055853 >> 172.21.15.1:0/1543055853 conn(0x7ff154064aa0 msgr2=0x7ff1540ad400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:42.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.541+0000 7ff1598fc700 1 -- 172.21.15.1:0/1543055853 shutdown_connections 2023-11-15T02:36:42.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.541+0000 7ff1598fc700 1 -- 172.21.15.1:0/1543055853 wait complete. 2023-11-15T02:36:42.548 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:36:42.555 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T02:36:41.079528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":215,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2458100,"kb_used_data":15796,"kb_used_omap":0,"kb_used_meta":2442240,"kb_avail":752516620,"statfs":{"total":773094113280,"available":770577018880,"internally_reserved":0,"allocated":16175104,"data_stored":8518780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2500853760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5038930,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-523,"num_write_kb":-5315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.007987"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.530640+0000","last_change":"2023-11-15T02:36:38.523238+0000","last_active":"2023-11-15T02:36:38.530640+0000","last_peered":"2023-11-15T02:36:38.530640+0000","last_clean":"2023-11-15T02:36:38.530640+0000","last_became_active":"2023-11-15T02:36:38.522979+0000","last_became_peered":"2023-11-15T02:36:38.522979+0000","last_unstale":"2023-11-15T02:36:38.530640+0000","last_undegraded":"2023-11-15T02:36:38.530640+0000","last_fullsized":"2023-11-15T02:36:38.530640+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"161'3","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.531313+0000","last_change":"2023-11-15T02:36:38.129621+0000","last_active":"2023-11-15T02:36:38.531313+0000","last_peered":"2023-11-15T02:36:38.531313+0000","last_clean":"2023-11-15T02:36:38.531313+0000","last_became_active":"2023-11-15T02:36:38.129281+0000","last_became_peered":"2023-11-15T02:36:38.129281+0000","last_unstale":"2023-11-15T02:36:38.531313+0000","last_undegraded":"2023-11-15T02:36:38.531313+0000","last_fullsized":"2023-11-15T02:36:38.531313+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.544023+0000","last_change":"2023-11-15T02:36:38.537227+0000","last_active":"2023-11-15T02:36:38.544023+0000","last_peered":"2023-11-15T02:36:38.544023+0000","last_clean":"2023-11-15T02:36:38.544023+0000","last_became_active":"2023-11-15T02:36:38.536918+0000","last_became_peered":"2023-11-15T02:36:38.536918+0000","last_unstale":"2023-11-15T02:36:38.544023+0000","last_undegraded":"2023-11-15T02:36:38.544023+0000","last_fullsized":"2023-11-15T02:36:38.544023+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516543+0000","last_change":"2023-11-15T02:36:38.130936+0000","last_active":"2023-11-15T02:36:38.516543+0000","last_peered":"2023-11-15T02:36:38.516543+0000","last_clean":"2023-11-15T02:36:38.516543+0000","last_became_active":"2023-11-15T02:36:38.130482+0000","last_became_peered":"2023-11-15T02:36:38.130482+0000","last_unstale":"2023-11-15T02:36:38.516543+0000","last_undegraded":"2023-11-15T02:36:38.516543+0000","last_fullsized":"2023-11-15T02:36:38.516543+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.539129+0000","last_change":"2023-11-15T02:36:38.536967+0000","last_active":"2023-11-15T02:36:38.539129+0000","last_peered":"2023-11-15T02:36:38.539129+0000","last_clean":"2023-11-15T02:36:38.539129+0000","last_became_active":"2023-11-15T02:36:38.536671+0000","last_became_peered":"2023-11-15T02:36:38.536671+0000","last_unstale":"2023-11-15T02:36:38.539129+0000","last_undegraded":"2023-11-15T02:36:38.539129+0000","last_fullsized":"2023-11-15T02:36:38.539129+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.512538+0000","last_change":"2023-11-15T02:36:38.130129+0000","last_active":"2023-11-15T02:36:38.512538+0000","last_peered":"2023-11-15T02:36:38.512538+0000","last_clean":"2023-11-15T02:36:38.512538+0000","last_became_active":"2023-11-15T02:36:38.129804+0000","last_became_peered":"2023-11-15T02:36:38.129804+0000","last_unstale":"2023-11-15T02:36:38.512538+0000","last_undegraded":"2023-11-15T02:36:38.512538+0000","last_fullsized":"2023-11-15T02:36:38.512538+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.528209+0000","last_change":"2023-11-15T02:36:38.527123+0000","last_active":"2023-11-15T02:36:38.528209+0000","last_peered":"2023-11-15T02:36:38.528209+0000","last_clean":"2023-11-15T02:36:38.528209+0000","last_became_active":"2023-11-15T02:36:38.526871+0000","last_became_peered":"2023-11-15T02:36:38.526871+0000","last_unstale":"2023-11-15T02:36:38.528209+0000","last_undegraded":"2023-11-15T02:36:38.528209+0000","last_fullsized":"2023-11-15T02:36:38.528209+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"161'2","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533964+0000","last_change":"2023-11-15T02:36:38.133630+0000","last_active":"2023-11-15T02:36:38.533964+0000","last_peered":"2023-11-15T02:36:38.533964+0000","last_clean":"2023-11-15T02:36:38.533964+0000","last_became_active":"2023-11-15T02:36:38.133346+0000","last_became_peered":"2023-11-15T02:36:38.133346+0000","last_unstale":"2023-11-15T02:36:38.533964+0000","last_undegraded":"2023-11-15T02:36:38.533964+0000","last_fullsized":"2023-11-15T02:36:38.533964+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.529696+0000","last_change":"2023-11-15T02:36:38.524988+0000","last_active":"2023-11-15T02:36:38.529696+0000","last_peered":"2023-11-15T02:36:38.529696+0000","last_clean":"2023-11-15T02:36:38.529696+0000","last_became_active":"2023-11-15T02:36:38.524686+0000","last_became_peered":"2023-11-15T02:36:38.524686+0000","last_unstale":"2023-11-15T02:36:38.529696+0000","last_undegraded":"2023-11-15T02:36:38.529696+0000","last_fullsized":"2023-11-15T02:36:38.529696+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532970+0000","last_change":"2023-11-15T02:36:38.136361+0000","last_active":"2023-11-15T02:36:38.532970+0000","last_peered":"2023-11-15T02:36:38.532970+0000","last_clean":"2023-11-15T02:36:38.532970+0000","last_became_active":"2023-11-15T02:36:38.136076+0000","last_became_peered":"2023-11-15T02:36:38.136076+0000","last_unstale":"2023-11-15T02:36:38.532970+0000","last_undegraded":"2023-11-15T02:36:38.532970+0000","last_fullsized":"2023-11-15T02:36:38.532970+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536238+0000","last_change":"2023-11-15T02:36:38.520882+0000","last_active":"2023-11-15T02:36:38.536238+0000","last_peered":"2023-11-15T02:36:38.536238+0000","last_clean":"2023-11-15T02:36:38.536238+0000","last_became_active":"2023-11-15T02:36:38.520468+0000","last_became_peered":"2023-11-15T02:36:38.520468+0000","last_unstale":"2023-11-15T02:36:38.536238+0000","last_undegraded":"2023-11-15T02:36:38.536238+0000","last_fullsized":"2023-11-15T02:36:38.536238+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.534234+0000","last_change":"2023-11-15T02:36:38.125483+0000","last_active":"2023-11-15T02:36:38.534234+0000","last_peered":"2023-11-15T02:36:38.534234+0000","last_clean":"2023-11-15T02:36:38.534234+0000","last_became_active":"2023-11-15T02:36:38.125209+0000","last_became_peered":"2023-11-15T02:36:38.125209+0000","last_unstale":"2023-11-15T02:36:38.534234+0000","last_undegraded":"2023-11-15T02:36:38.534234+0000","last_fullsized":"2023-11-15T02:36:38.534234+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.535817+0000","last_change":"2023-11-15T02:36:38.531809+0000","last_active":"2023-11-15T02:36:38.535817+0000","last_peered":"2023-11-15T02:36:38.535817+0000","last_clean":"2023-11-15T02:36:38.535817+0000","last_became_active":"2023-11-15T02:36:38.531380+0000","last_became_peered":"2023-11-15T02:36:38.531380+0000","last_unstale":"2023-11-15T02:36:38.535817+0000","last_undegraded":"2023-11-15T02:36:38.535817+0000","last_fullsized":"2023-11-15T02:36:38.535817+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.517774+0000","last_change":"2023-11-15T02:36:38.128258+0000","last_active":"2023-11-15T02:36:38.517774+0000","last_peered":"2023-11-15T02:36:38.517774+0000","last_clean":"2023-11-15T02:36:38.517774+0000","last_became_active":"2023-11-15T02:36:38.127987+0000","last_became_peered":"2023-11-15T02:36:38.127987+0000","last_unstale":"2023-11-15T02:36:38.517774+0000","last_undegraded":"2023-11-15T02:36:38.517774+0000","last_fullsized":"2023-11-15T02:36:38.517774+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.539205+0000","last_change":"2023-11-15T02:36:38.534236+0000","last_active":"2023-11-15T02:36:38.539205+0000","last_peered":"2023-11-15T02:36:38.539205+0000","last_clean":"2023-11-15T02:36:38.539205+0000","last_became_active":"2023-11-15T02:36:38.533377+0000","last_became_peered":"2023-11-15T02:36:38.533377+0000","last_unstale":"2023-11-15T02:36:38.539205+0000","last_undegraded":"2023-11-15T02:36:38.539205+0000","last_fullsized":"2023-11-15T02:36:38.539205+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.511931+0000","last_change":"2023-11-15T02:36:38.134731+0000","last_active":"2023-11-15T02:36:38.511931+0000","last_peered":"2023-11-15T02:36:38.511931+0000","last_clean":"2023-11-15T02:36:38.511931+0000","last_became_active":"2023-11-15T02:36:38.134147+0000","last_became_peered":"2023-11-15T02:36:38.134147+0000","last_unstale":"2023-11-15T02:36:38.511931+0000","last_undegraded":"2023-11-15T02:36:38.511931+0000","last_fullsized":"2023-11-15T02:36:38.511931+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.539113+0000","last_change":"2023-11-15T02:36:38.535890+0000","last_active":"2023-11-15T02:36:38.539113+0000","last_peered":"2023-11-15T02:36:38.539113+0000","last_clean":"2023-11-15T02:36:38.539113+0000","last_became_active":"2023-11-15T02:36:38.535318+0000","last_became_peered":"2023-11-15T02:36:38.535318+0000","last_unstale":"2023-11-15T02:36:38.539113+0000","last_undegraded":"2023-11-15T02:36:38.539113+0000","last_fullsized":"2023-11-15T02:36:38.539113+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.510889+0000","last_change":"2023-11-15T02:36:38.132447+0000","last_active":"2023-11-15T02:36:38.510889+0000","last_peered":"2023-11-15T02:36:38.510889+0000","last_clean":"2023-11-15T02:36:38.510889+0000","last_became_active":"2023-11-15T02:36:38.132191+0000","last_became_peered":"2023-11-15T02:36:38.132191+0000","last_unstale":"2023-11-15T02:36:38.510889+0000","last_undegraded":"2023-11-15T02:36:38.510889+0000","last_fullsized":"2023-11-15T02:36:38.510889+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.538801+0000","last_change":"2023-11-15T02:36:38.530987+0000","last_active":"2023-11-15T02:36:38.538801+0000","last_peered":"2023-11-15T02:36:38.538801+0000","last_clean":"2023-11-15T02:36:38.538801+0000","last_became_active":"2023-11-15T02:36:38.530697+0000","last_became_peered":"2023-11-15T02:36:38.530697+0000","last_unstale":"2023-11-15T02:36:38.538801+0000","last_undegraded":"2023-11-15T02:36:38.538801+0000","last_fullsized":"2023-11-15T02:36:38.538801+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516639+0000","last_change":"2023-11-15T02:36:38.130764+0000","last_active":"2023-11-15T02:36:38.516639+0000","last_peered":"2023-11-15T02:36:38.516639+0000","last_clean":"2023-11-15T02:36:38.516639+0000","last_became_active":"2023-11-15T02:36:38.130097+0000","last_became_peered":"2023-11-15T02:36:38.130097+0000","last_unstale":"2023-11-15T02:36:38.516639+0000","last_undegraded":"2023-11-15T02:36:38.516639+0000","last_fullsized":"2023-11-15T02:36:38.516639+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.539169+0000","last_change":"2023-11-15T02:36:38.533914+0000","last_active":"2023-11-15T02:36:38.539169+0000","last_peered":"2023-11-15T02:36:38.539169+0000","last_clean":"2023-11-15T02:36:38.539169+0000","last_became_active":"2023-11-15T02:36:38.533649+0000","last_became_peered":"2023-11-15T02:36:38.533649+0000","last_unstale":"2023-11-15T02:36:38.539169+0000","last_undegraded":"2023-11-15T02:36:38.539169+0000","last_fullsized":"2023-11-15T02:36:38.539169+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.514860+0000","last_change":"2023-11-15T02:36:38.126960+0000","last_active":"2023-11-15T02:36:38.514860+0000","last_peered":"2023-11-15T02:36:38.514860+0000","last_clean":"2023-11-15T02:36:38.514860+0000","last_became_active":"2023-11-15T02:36:38.126672+0000","last_became_peered":"2023-11-15T02:36:38.126672+0000","last_unstale":"2023-11-15T02:36:38.514860+0000","last_undegraded":"2023-11-15T02:36:38.514860+0000","last_fullsized":"2023-11-15T02:36:38.514860+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.530275+0000","last_change":"2023-11-15T02:36:38.519709+0000","last_active":"2023-11-15T02:36:38.530275+0000","last_peered":"2023-11-15T02:36:38.530275+0000","last_clean":"2023-11-15T02:36:38.530275+0000","last_became_active":"2023-11-15T02:36:38.519250+0000","last_became_peered":"2023-11-15T02:36:38.519250+0000","last_unstale":"2023-11-15T02:36:38.530275+0000","last_undegraded":"2023-11-15T02:36:38.530275+0000","last_fullsized":"2023-11-15T02:36:38.530275+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"161'4","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.544291+0000","last_change":"2023-11-15T02:36:38.132303+0000","last_active":"2023-11-15T02:36:38.544291+0000","last_peered":"2023-11-15T02:36:38.544291+0000","last_clean":"2023-11-15T02:36:38.544291+0000","last_became_active":"2023-11-15T02:36:38.132035+0000","last_became_peered":"2023-11-15T02:36:38.132035+0000","last_unstale":"2023-11-15T02:36:38.544291+0000","last_undegraded":"2023-11-15T02:36:38.544291+0000","last_fullsized":"2023-11-15T02:36:38.544291+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533759+0000","last_change":"2023-11-15T02:36:38.529173+0000","last_active":"2023-11-15T02:36:38.533759+0000","last_peered":"2023-11-15T02:36:38.533759+0000","last_clean":"2023-11-15T02:36:38.533759+0000","last_became_active":"2023-11-15T02:36:38.528908+0000","last_became_peered":"2023-11-15T02:36:38.528908+0000","last_unstale":"2023-11-15T02:36:38.533759+0000","last_undegraded":"2023-11-15T02:36:38.533759+0000","last_fullsized":"2023-11-15T02:36:38.533759+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.33","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.530558+0000","last_change":"2023-11-15T02:36:38.132001+0000","last_active":"2023-11-15T02:36:38.530558+0000","last_peered":"2023-11-15T02:36:38.530558+0000","last_clean":"2023-11-15T02:36:38.530558+0000","last_became_active":"2023-11-15T02:36:38.131694+0000","last_became_peered":"2023-11-15T02:36:38.131694+0000","last_unstale":"2023-11-15T02:36:38.530558+0000","last_undegraded":"2023-11-15T02:36:38.530558+0000","last_fullsized":"2023-11-15T02:36:38.530558+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.527717+0000","last_change":"2023-11-15T02:36:38.519152+0000","last_active":"2023-11-15T02:36:38.527717+0000","last_peered":"2023-11-15T02:36:38.527717+0000","last_clean":"2023-11-15T02:36:38.527717+0000","last_became_active":"2023-11-15T02:36:38.518619+0000","last_became_peered":"2023-11-15T02:36:38.518619+0000","last_unstale":"2023-11-15T02:36:38.527717+0000","last_undegraded":"2023-11-15T02:36:38.527717+0000","last_fullsized":"2023-11-15T02:36:38.527717+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516038+0000","last_change":"2023-11-15T02:36:38.136850+0000","last_active":"2023-11-15T02:36:38.516038+0000","last_peered":"2023-11-15T02:36:38.516038+0000","last_clean":"2023-11-15T02:36:38.516038+0000","last_became_active":"2023-11-15T02:36:38.136545+0000","last_became_peered":"2023-11-15T02:36:38.136545+0000","last_unstale":"2023-11-15T02:36:38.516038+0000","last_undegraded":"2023-11-15T02:36:38.516038+0000","last_fullsized":"2023-11-15T02:36:38.516038+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532658+0000","last_change":"2023-11-15T02:36:38.531948+0000","last_active":"2023-11-15T02:36:38.532658+0000","last_peered":"2023-11-15T02:36:38.532658+0000","last_clean":"2023-11-15T02:36:38.532658+0000","last_became_active":"2023-11-15T02:36:38.531670+0000","last_became_peered":"2023-11-15T02:36:38.531670+0000","last_unstale":"2023-11-15T02:36:38.532658+0000","last_undegraded":"2023-11-15T02:36:38.532658+0000","last_fullsized":"2023-11-15T02:36:38.532658+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516834+0000","last_change":"2023-11-15T02:36:38.134607+0000","last_active":"2023-11-15T02:36:38.516834+0000","last_peered":"2023-11-15T02:36:38.516834+0000","last_clean":"2023-11-15T02:36:38.516834+0000","last_became_active":"2023-11-15T02:36:38.134316+0000","last_became_peered":"2023-11-15T02:36:38.134316+0000","last_unstale":"2023-11-15T02:36:38.516834+0000","last_undegraded":"2023-11-15T02:36:38.516834+0000","last_fullsized":"2023-11-15T02:36:38.516834+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533192+0000","last_change":"2023-11-15T02:36:38.526754+0000","last_active":"2023-11-15T02:36:38.533192+0000","last_peered":"2023-11-15T02:36:38.533192+0000","last_clean":"2023-11-15T02:36:38.533192+0000","last_became_active":"2023-11-15T02:36:38.526486+0000","last_became_peered":"2023-11-15T02:36:38.526486+0000","last_unstale":"2023-11-15T02:36:38.533192+0000","last_undegraded":"2023-11-15T02:36:38.533192+0000","last_fullsized":"2023-11-15T02:36:38.533192+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.30","version":"161'4","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.539091+0000","last_change":"2023-11-15T02:36:38.136456+0000","last_active":"2023-11-15T02:36:38.539091+0000","last_peered":"2023-11-15T02:36:38.539091+0000","last_clean":"2023-11-15T02:36:38.539091+0000","last_became_active":"2023-11-15T02:36:38.136170+0000","last_became_peered":"2023-11-15T02:36:38.136170+0000","last_unstale":"2023-11-15T02:36:38.539091+0000","last_undegraded":"2023-11-15T02:36:38.539091+0000","last_fullsized":"2023-11-15T02:36:38.539091+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532179+0000","last_change":"2023-11-15T02:36:38.526795+0000","last_active":"2023-11-15T02:36:38.532179+0000","last_peered":"2023-11-15T02:36:38.532179+0000","last_clean":"2023-11-15T02:36:38.532179+0000","last_became_active":"2023-11-15T02:36:38.526532+0000","last_became_peered":"2023-11-15T02:36:38.526532+0000","last_unstale":"2023-11-15T02:36:38.532179+0000","last_undegraded":"2023-11-15T02:36:38.532179+0000","last_fullsized":"2023-11-15T02:36:38.532179+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.521994+0000","last_change":"2023-11-15T02:36:38.132091+0000","last_active":"2023-11-15T02:36:38.521994+0000","last_peered":"2023-11-15T02:36:38.521994+0000","last_clean":"2023-11-15T02:36:38.521994+0000","last_became_active":"2023-11-15T02:36:38.131693+0000","last_became_peered":"2023-11-15T02:36:38.131693+0000","last_unstale":"2023-11-15T02:36:38.521994+0000","last_undegraded":"2023-11-15T02:36:38.521994+0000","last_fullsized":"2023-11-15T02:36:38.521994+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.529663+0000","last_change":"2023-11-15T02:36:38.525912+0000","last_active":"2023-11-15T02:36:38.529663+0000","last_peered":"2023-11-15T02:36:38.529663+0000","last_clean":"2023-11-15T02:36:38.529663+0000","last_became_active":"2023-11-15T02:36:38.525617+0000","last_became_peered":"2023-11-15T02:36:38.525617+0000","last_unstale":"2023-11-15T02:36:38.529663+0000","last_undegraded":"2023-11-15T02:36:38.529663+0000","last_fullsized":"2023-11-15T02:36:38.529663+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.512251+0000","last_change":"2023-11-15T02:36:38.131436+0000","last_active":"2023-11-15T02:36:38.512251+0000","last_peered":"2023-11-15T02:36:38.512251+0000","last_clean":"2023-11-15T02:36:38.512251+0000","last_became_active":"2023-11-15T02:36:38.130761+0000","last_became_peered":"2023-11-15T02:36:38.130761+0000","last_unstale":"2023-11-15T02:36:38.512251+0000","last_undegraded":"2023-11-15T02:36:38.512251+0000","last_fullsized":"2023-11-15T02:36:38.512251+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.527383+0000","last_change":"2023-11-15T02:36:38.522506+0000","last_active":"2023-11-15T02:36:38.527383+0000","last_peered":"2023-11-15T02:36:38.527383+0000","last_clean":"2023-11-15T02:36:38.527383+0000","last_became_active":"2023-11-15T02:36:38.522212+0000","last_became_peered":"2023-11-15T02:36:38.522212+0000","last_unstale":"2023-11-15T02:36:38.527383+0000","last_undegraded":"2023-11-15T02:36:38.527383+0000","last_fullsized":"2023-11-15T02:36:38.527383+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2d","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533804+0000","last_change":"2023-11-15T02:36:38.129495+0000","last_active":"2023-11-15T02:36:38.533804+0000","last_peered":"2023-11-15T02:36:38.533804+0000","last_clean":"2023-11-15T02:36:38.533804+0000","last_became_active":"2023-11-15T02:36:38.129202+0000","last_became_peered":"2023-11-15T02:36:38.129202+0000","last_unstale":"2023-11-15T02:36:38.533804+0000","last_undegraded":"2023-11-15T02:36:38.533804+0000","last_fullsized":"2023-11-15T02:36:38.533804+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.528085+0000","last_change":"2023-11-15T02:36:38.520750+0000","last_active":"2023-11-15T02:36:38.528085+0000","last_peered":"2023-11-15T02:36:38.528085+0000","last_clean":"2023-11-15T02:36:38.528085+0000","last_became_active":"2023-11-15T02:36:38.520447+0000","last_became_peered":"2023-11-15T02:36:38.520447+0000","last_unstale":"2023-11-15T02:36:38.528085+0000","last_undegraded":"2023-11-15T02:36:38.528085+0000","last_fullsized":"2023-11-15T02:36:38.528085+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.510001+0000","last_change":"2023-11-15T02:36:38.131235+0000","last_active":"2023-11-15T02:36:38.510001+0000","last_peered":"2023-11-15T02:36:38.510001+0000","last_clean":"2023-11-15T02:36:38.510001+0000","last_became_active":"2023-11-15T02:36:38.130841+0000","last_became_peered":"2023-11-15T02:36:38.130841+0000","last_unstale":"2023-11-15T02:36:38.510001+0000","last_undegraded":"2023-11-15T02:36:38.510001+0000","last_fullsized":"2023-11-15T02:36:38.510001+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536316+0000","last_change":"2023-11-15T02:36:38.530116+0000","last_active":"2023-11-15T02:36:38.536316+0000","last_peered":"2023-11-15T02:36:38.536316+0000","last_clean":"2023-11-15T02:36:38.536316+0000","last_became_active":"2023-11-15T02:36:38.529845+0000","last_became_peered":"2023-11-15T02:36:38.529845+0000","last_unstale":"2023-11-15T02:36:38.536316+0000","last_undegraded":"2023-11-15T02:36:38.536316+0000","last_fullsized":"2023-11-15T02:36:38.536316+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533055+0000","last_change":"2023-11-15T02:36:38.136834+0000","last_active":"2023-11-15T02:36:38.533055+0000","last_peered":"2023-11-15T02:36:38.533055+0000","last_clean":"2023-11-15T02:36:38.533055+0000","last_became_active":"2023-11-15T02:36:38.136494+0000","last_became_peered":"2023-11-15T02:36:38.136494+0000","last_unstale":"2023-11-15T02:36:38.533055+0000","last_undegraded":"2023-11-15T02:36:38.533055+0000","last_fullsized":"2023-11-15T02:36:38.533055+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.535923+0000","last_change":"2023-11-15T02:36:38.532581+0000","last_active":"2023-11-15T02:36:38.535923+0000","last_peered":"2023-11-15T02:36:38.535923+0000","last_clean":"2023-11-15T02:36:38.535923+0000","last_became_active":"2023-11-15T02:36:38.532275+0000","last_became_peered":"2023-11-15T02:36:38.532275+0000","last_unstale":"2023-11-15T02:36:38.535923+0000","last_undegraded":"2023-11-15T02:36:38.535923+0000","last_fullsized":"2023-11-15T02:36:38.535923+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.514757+0000","last_change":"2023-11-15T02:36:38.126854+0000","last_active":"2023-11-15T02:36:38.514757+0000","last_peered":"2023-11-15T02:36:38.514757+0000","last_clean":"2023-11-15T02:36:38.514757+0000","last_became_active":"2023-11-15T02:36:38.126560+0000","last_became_peered":"2023-11-15T02:36:38.126560+0000","last_unstale":"2023-11-15T02:36:38.514757+0000","last_undegraded":"2023-11-15T02:36:38.514757+0000","last_fullsized":"2023-11-15T02:36:38.514757+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536533+0000","last_change":"2023-11-15T02:36:38.535888+0000","last_active":"2023-11-15T02:36:38.536533+0000","last_peered":"2023-11-15T02:36:38.536533+0000","last_clean":"2023-11-15T02:36:38.536533+0000","last_became_active":"2023-11-15T02:36:38.534234+0000","last_became_peered":"2023-11-15T02:36:38.534234+0000","last_unstale":"2023-11-15T02:36:38.536533+0000","last_undegraded":"2023-11-15T02:36:38.536533+0000","last_fullsized":"2023-11-15T02:36:38.536533+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.512665+0000","last_change":"2023-11-15T02:36:38.133098+0000","last_active":"2023-11-15T02:36:38.512665+0000","last_peered":"2023-11-15T02:36:38.512665+0000","last_clean":"2023-11-15T02:36:38.512665+0000","last_became_active":"2023-11-15T02:36:38.132824+0000","last_became_peered":"2023-11-15T02:36:38.132824+0000","last_unstale":"2023-11-15T02:36:38.512665+0000","last_undegraded":"2023-11-15T02:36:38.512665+0000","last_fullsized":"2023-11-15T02:36:38.512665+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533214+0000","last_change":"2023-11-15T02:36:38.529342+0000","last_active":"2023-11-15T02:36:38.533214+0000","last_peered":"2023-11-15T02:36:38.533214+0000","last_clean":"2023-11-15T02:36:38.533214+0000","last_became_active":"2023-11-15T02:36:38.529061+0000","last_became_peered":"2023-11-15T02:36:38.529061+0000","last_unstale":"2023-11-15T02:36:38.533214+0000","last_undegraded":"2023-11-15T02:36:38.533214+0000","last_fullsized":"2023-11-15T02:36:38.533214+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.514634+0000","last_change":"2023-11-15T02:36:38.132009+0000","last_active":"2023-11-15T02:36:38.514634+0000","last_peered":"2023-11-15T02:36:38.514634+0000","last_clean":"2023-11-15T02:36:38.514634+0000","last_became_active":"2023-11-15T02:36:38.131713+0000","last_became_peered":"2023-11-15T02:36:38.131713+0000","last_unstale":"2023-11-15T02:36:38.514634+0000","last_undegraded":"2023-11-15T02:36:38.514634+0000","last_fullsized":"2023-11-15T02:36:38.514634+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.530845+0000","last_change":"2023-11-15T02:36:38.525423+0000","last_active":"2023-11-15T02:36:38.530845+0000","last_peered":"2023-11-15T02:36:38.530845+0000","last_clean":"2023-11-15T02:36:38.530845+0000","last_became_active":"2023-11-15T02:36:38.525166+0000","last_became_peered":"2023-11-15T02:36:38.525166+0000","last_unstale":"2023-11-15T02:36:38.530845+0000","last_undegraded":"2023-11-15T02:36:38.530845+0000","last_fullsized":"2023-11-15T02:36:38.530845+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.517272+0000","last_change":"2023-11-15T02:36:38.136600+0000","last_active":"2023-11-15T02:36:38.517272+0000","last_peered":"2023-11-15T02:36:38.517272+0000","last_clean":"2023-11-15T02:36:38.517272+0000","last_became_active":"2023-11-15T02:36:38.135938+0000","last_became_peered":"2023-11-15T02:36:38.135938+0000","last_unstale":"2023-11-15T02:36:38.517272+0000","last_undegraded":"2023-11-15T02:36:38.517272+0000","last_fullsized":"2023-11-15T02:36:38.517272+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.535660+0000","last_change":"2023-11-15T02:36:38.530519+0000","last_active":"2023-11-15T02:36:38.535660+0000","last_peered":"2023-11-15T02:36:38.535660+0000","last_clean":"2023-11-15T02:36:38.535660+0000","last_became_active":"2023-11-15T02:36:38.530210+0000","last_became_peered":"2023-11-15T02:36:38.530210+0000","last_unstale":"2023-11-15T02:36:38.535660+0000","last_undegraded":"2023-11-15T02:36:38.535660+0000","last_fullsized":"2023-11-15T02:36:38.535660+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.512348+0000","last_change":"2023-11-15T02:36:38.137713+0000","last_active":"2023-11-15T02:36:38.512348+0000","last_peered":"2023-11-15T02:36:38.512348+0000","last_clean":"2023-11-15T02:36:38.512348+0000","last_became_active":"2023-11-15T02:36:38.137384+0000","last_became_peered":"2023-11-15T02:36:38.137384+0000","last_unstale":"2023-11-15T02:36:38.512348+0000","last_undegraded":"2023-11-15T02:36:38.512348+0000","last_fullsized":"2023-11-15T02:36:38.512348+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537346+0000","last_change":"2023-11-15T02:36:38.526945+0000","last_active":"2023-11-15T02:36:38.537346+0000","last_peered":"2023-11-15T02:36:38.537346+0000","last_clean":"2023-11-15T02:36:38.537346+0000","last_became_active":"2023-11-15T02:36:38.526678+0000","last_became_peered":"2023-11-15T02:36:38.526678+0000","last_unstale":"2023-11-15T02:36:38.537346+0000","last_undegraded":"2023-11-15T02:36:38.537346+0000","last_fullsized":"2023-11-15T02:36:38.537346+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.517505+0000","last_change":"2023-11-15T02:36:38.131914+0000","last_active":"2023-11-15T02:36:38.517505+0000","last_peered":"2023-11-15T02:36:38.517505+0000","last_clean":"2023-11-15T02:36:38.517505+0000","last_became_active":"2023-11-15T02:36:38.131633+0000","last_became_peered":"2023-11-15T02:36:38.131633+0000","last_unstale":"2023-11-15T02:36:38.517505+0000","last_undegraded":"2023-11-15T02:36:38.517505+0000","last_fullsized":"2023-11-15T02:36:38.517505+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536056+0000","last_change":"2023-11-15T02:36:38.520080+0000","last_active":"2023-11-15T02:36:38.536056+0000","last_peered":"2023-11-15T02:36:38.536056+0000","last_clean":"2023-11-15T02:36:38.536056+0000","last_became_active":"2023-11-15T02:36:38.519775+0000","last_became_peered":"2023-11-15T02:36:38.519775+0000","last_unstale":"2023-11-15T02:36:38.536056+0000","last_undegraded":"2023-11-15T02:36:38.536056+0000","last_fullsized":"2023-11-15T02:36:38.536056+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.510844+0000","last_change":"2023-11-15T02:36:38.133259+0000","last_active":"2023-11-15T02:36:38.510844+0000","last_peered":"2023-11-15T02:36:38.510844+0000","last_clean":"2023-11-15T02:36:38.510844+0000","last_became_active":"2023-11-15T02:36:38.132960+0000","last_became_peered":"2023-11-15T02:36:38.132960+0000","last_unstale":"2023-11-15T02:36:38.510844+0000","last_undegraded":"2023-11-15T02:36:38.510844+0000","last_fullsized":"2023-11-15T02:36:38.510844+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532484+0000","last_change":"2023-11-15T02:36:38.531903+0000","last_active":"2023-11-15T02:36:38.532484+0000","last_peered":"2023-11-15T02:36:38.532484+0000","last_clean":"2023-11-15T02:36:38.532484+0000","last_became_active":"2023-11-15T02:36:38.531620+0000","last_became_peered":"2023-11-15T02:36:38.531620+0000","last_unstale":"2023-11-15T02:36:38.532484+0000","last_undegraded":"2023-11-15T02:36:38.532484+0000","last_fullsized":"2023-11-15T02:36:38.532484+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.514263+0000","last_change":"2023-11-15T02:36:38.135315+0000","last_active":"2023-11-15T02:36:38.514263+0000","last_peered":"2023-11-15T02:36:38.514263+0000","last_clean":"2023-11-15T02:36:38.514263+0000","last_became_active":"2023-11-15T02:36:38.135011+0000","last_became_peered":"2023-11-15T02:36:38.135011+0000","last_unstale":"2023-11-15T02:36:38.514263+0000","last_undegraded":"2023-11-15T02:36:38.514263+0000","last_fullsized":"2023-11-15T02:36:38.514263+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533851+0000","last_change":"2023-11-15T02:36:38.528473+0000","last_active":"2023-11-15T02:36:38.533851+0000","last_peered":"2023-11-15T02:36:38.533851+0000","last_clean":"2023-11-15T02:36:38.533851+0000","last_became_active":"2023-11-15T02:36:38.528172+0000","last_became_peered":"2023-11-15T02:36:38.528172+0000","last_unstale":"2023-11-15T02:36:38.533851+0000","last_undegraded":"2023-11-15T02:36:38.533851+0000","last_fullsized":"2023-11-15T02:36:38.533851+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.515490+0000","last_change":"2023-11-15T02:36:38.135831+0000","last_active":"2023-11-15T02:36:38.515490+0000","last_peered":"2023-11-15T02:36:38.515490+0000","last_clean":"2023-11-15T02:36:38.515490+0000","last_became_active":"2023-11-15T02:36:38.135454+0000","last_became_peered":"2023-11-15T02:36:38.135454+0000","last_unstale":"2023-11-15T02:36:38.515490+0000","last_undegraded":"2023-11-15T02:36:38.515490+0000","last_fullsized":"2023-11-15T02:36:38.515490+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536671+0000","last_change":"2023-11-15T02:36:38.526590+0000","last_active":"2023-11-15T02:36:38.536671+0000","last_peered":"2023-11-15T02:36:38.536671+0000","last_clean":"2023-11-15T02:36:38.536671+0000","last_became_active":"2023-11-15T02:36:38.526286+0000","last_became_peered":"2023-11-15T02:36:38.526286+0000","last_unstale":"2023-11-15T02:36:38.536671+0000","last_undegraded":"2023-11-15T02:36:38.536671+0000","last_fullsized":"2023-11-15T02:36:38.536671+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.526677+0000","last_change":"2023-11-15T02:36:38.137658+0000","last_active":"2023-11-15T02:36:38.526677+0000","last_peered":"2023-11-15T02:36:38.526677+0000","last_clean":"2023-11-15T02:36:38.526677+0000","last_became_active":"2023-11-15T02:36:38.137336+0000","last_became_peered":"2023-11-15T02:36:38.137336+0000","last_unstale":"2023-11-15T02:36:38.526677+0000","last_undegraded":"2023-11-15T02:36:38.526677+0000","last_fullsized":"2023-11-15T02:36:38.526677+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536918+0000","last_change":"2023-11-15T02:36:38.532975+0000","last_active":"2023-11-15T02:36:38.536918+0000","last_peered":"2023-11-15T02:36:38.536918+0000","last_clean":"2023-11-15T02:36:38.536918+0000","last_became_active":"2023-11-15T02:36:38.532570+0000","last_became_peered":"2023-11-15T02:36:38.532570+0000","last_unstale":"2023-11-15T02:36:38.536918+0000","last_undegraded":"2023-11-15T02:36:38.536918+0000","last_fullsized":"2023-11-15T02:36:38.536918+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.522542+0000","last_change":"2023-11-15T02:36:38.129261+0000","last_active":"2023-11-15T02:36:38.522542+0000","last_peered":"2023-11-15T02:36:38.522542+0000","last_clean":"2023-11-15T02:36:38.522542+0000","last_became_active":"2023-11-15T02:36:38.128989+0000","last_became_peered":"2023-11-15T02:36:38.128989+0000","last_unstale":"2023-11-15T02:36:38.522542+0000","last_undegraded":"2023-11-15T02:36:38.522542+0000","last_fullsized":"2023-11-15T02:36:38.522542+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.535862+0000","last_change":"2023-11-15T02:36:38.530551+0000","last_active":"2023-11-15T02:36:38.535862+0000","last_peered":"2023-11-15T02:36:38.535862+0000","last_clean":"2023-11-15T02:36:38.535862+0000","last_became_active":"2023-11-15T02:36:38.530265+0000","last_became_peered":"2023-11-15T02:36:38.530265+0000","last_unstale":"2023-11-15T02:36:38.535862+0000","last_undegraded":"2023-11-15T02:36:38.535862+0000","last_fullsized":"2023-11-15T02:36:38.535862+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536406+0000","last_change":"2023-11-15T02:36:38.136385+0000","last_active":"2023-11-15T02:36:38.536406+0000","last_peered":"2023-11-15T02:36:38.536406+0000","last_clean":"2023-11-15T02:36:38.536406+0000","last_became_active":"2023-11-15T02:36:38.136092+0000","last_became_peered":"2023-11-15T02:36:38.136092+0000","last_unstale":"2023-11-15T02:36:38.536406+0000","last_undegraded":"2023-11-15T02:36:38.536406+0000","last_fullsized":"2023-11-15T02:36:38.536406+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533595+0000","last_change":"2023-11-15T02:36:38.529091+0000","last_active":"2023-11-15T02:36:38.533595+0000","last_peered":"2023-11-15T02:36:38.533595+0000","last_clean":"2023-11-15T02:36:38.533595+0000","last_became_active":"2023-11-15T02:36:38.528825+0000","last_became_peered":"2023-11-15T02:36:38.528825+0000","last_unstale":"2023-11-15T02:36:38.533595+0000","last_undegraded":"2023-11-15T02:36:38.533595+0000","last_fullsized":"2023-11-15T02:36:38.533595+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536042+0000","last_change":"2023-11-15T02:36:38.128076+0000","last_active":"2023-11-15T02:36:38.536042+0000","last_peered":"2023-11-15T02:36:38.536042+0000","last_clean":"2023-11-15T02:36:38.536042+0000","last_became_active":"2023-11-15T02:36:38.127571+0000","last_became_peered":"2023-11-15T02:36:38.127571+0000","last_unstale":"2023-11-15T02:36:38.536042+0000","last_undegraded":"2023-11-15T02:36:38.536042+0000","last_fullsized":"2023-11-15T02:36:38.536042+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.535645+0000","last_change":"2023-11-15T02:36:38.530103+0000","last_active":"2023-11-15T02:36:38.535645+0000","last_peered":"2023-11-15T02:36:38.535645+0000","last_clean":"2023-11-15T02:36:38.535645+0000","last_became_active":"2023-11-15T02:36:38.529751+0000","last_became_peered":"2023-11-15T02:36:38.529751+0000","last_unstale":"2023-11-15T02:36:38.535645+0000","last_undegraded":"2023-11-15T02:36:38.535645+0000","last_fullsized":"2023-11-15T02:36:38.535645+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"161'2","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.531631+0000","last_change":"2023-11-15T02:36:38.137782+0000","last_active":"2023-11-15T02:36:38.531631+0000","last_peered":"2023-11-15T02:36:38.531631+0000","last_clean":"2023-11-15T02:36:38.531631+0000","last_became_active":"2023-11-15T02:36:38.135905+0000","last_became_peered":"2023-11-15T02:36:38.135905+0000","last_unstale":"2023-11-15T02:36:38.531631+0000","last_undegraded":"2023-11-15T02:36:38.531631+0000","last_fullsized":"2023-11-15T02:36:38.531631+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.539081+0000","last_change":"2023-11-15T02:36:38.532286+0000","last_active":"2023-11-15T02:36:38.539081+0000","last_peered":"2023-11-15T02:36:38.539081+0000","last_clean":"2023-11-15T02:36:38.539081+0000","last_became_active":"2023-11-15T02:36:38.530211+0000","last_became_peered":"2023-11-15T02:36:38.530211+0000","last_unstale":"2023-11-15T02:36:38.539081+0000","last_undegraded":"2023-11-15T02:36:38.539081+0000","last_fullsized":"2023-11-15T02:36:38.539081+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.519838+0000","last_change":"2023-11-15T02:36:38.137504+0000","last_active":"2023-11-15T02:36:38.519838+0000","last_peered":"2023-11-15T02:36:38.519838+0000","last_clean":"2023-11-15T02:36:38.519838+0000","last_became_active":"2023-11-15T02:36:38.137296+0000","last_became_peered":"2023-11-15T02:36:38.137296+0000","last_unstale":"2023-11-15T02:36:38.519838+0000","last_undegraded":"2023-11-15T02:36:38.519838+0000","last_fullsized":"2023-11-15T02:36:38.519838+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532929+0000","last_change":"2023-11-15T02:36:38.526036+0000","last_active":"2023-11-15T02:36:38.532929+0000","last_peered":"2023-11-15T02:36:38.532929+0000","last_clean":"2023-11-15T02:36:38.532929+0000","last_became_active":"2023-11-15T02:36:38.525740+0000","last_became_peered":"2023-11-15T02:36:38.525740+0000","last_unstale":"2023-11-15T02:36:38.532929+0000","last_undegraded":"2023-11-15T02:36:38.532929+0000","last_fullsized":"2023-11-15T02:36:38.532929+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.520565+0000","last_change":"2023-11-15T02:36:38.131960+0000","last_active":"2023-11-15T02:36:38.520565+0000","last_peered":"2023-11-15T02:36:38.520565+0000","last_clean":"2023-11-15T02:36:38.520565+0000","last_became_active":"2023-11-15T02:36:38.131641+0000","last_became_peered":"2023-11-15T02:36:38.131641+0000","last_unstale":"2023-11-15T02:36:38.520565+0000","last_undegraded":"2023-11-15T02:36:38.520565+0000","last_fullsized":"2023-11-15T02:36:38.520565+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.535933+0000","last_change":"2023-11-15T02:36:38.531784+0000","last_active":"2023-11-15T02:36:38.535933+0000","last_peered":"2023-11-15T02:36:38.535933+0000","last_clean":"2023-11-15T02:36:38.535933+0000","last_became_active":"2023-11-15T02:36:38.531506+0000","last_became_peered":"2023-11-15T02:36:38.531506+0000","last_unstale":"2023-11-15T02:36:38.535933+0000","last_undegraded":"2023-11-15T02:36:38.535933+0000","last_fullsized":"2023-11-15T02:36:38.535933+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.509565+0000","last_change":"2023-11-15T02:36:38.128521+0000","last_active":"2023-11-15T02:36:38.509565+0000","last_peered":"2023-11-15T02:36:38.509565+0000","last_clean":"2023-11-15T02:36:38.509565+0000","last_became_active":"2023-11-15T02:36:38.127970+0000","last_became_peered":"2023-11-15T02:36:38.127970+0000","last_unstale":"2023-11-15T02:36:38.509565+0000","last_undegraded":"2023-11-15T02:36:38.509565+0000","last_fullsized":"2023-11-15T02:36:38.509565+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536394+0000","last_change":"2023-11-15T02:36:38.531098+0000","last_active":"2023-11-15T02:36:38.536394+0000","last_peered":"2023-11-15T02:36:38.536394+0000","last_clean":"2023-11-15T02:36:38.536394+0000","last_became_active":"2023-11-15T02:36:38.530793+0000","last_became_peered":"2023-11-15T02:36:38.530793+0000","last_unstale":"2023-11-15T02:36:38.536394+0000","last_undegraded":"2023-11-15T02:36:38.536394+0000","last_fullsized":"2023-11-15T02:36:38.536394+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516300+0000","last_change":"2023-11-15T02:36:38.133056+0000","last_active":"2023-11-15T02:36:38.516300+0000","last_peered":"2023-11-15T02:36:38.516300+0000","last_clean":"2023-11-15T02:36:38.516300+0000","last_became_active":"2023-11-15T02:36:38.132695+0000","last_became_peered":"2023-11-15T02:36:38.132695+0000","last_unstale":"2023-11-15T02:36:38.516300+0000","last_undegraded":"2023-11-15T02:36:38.516300+0000","last_fullsized":"2023-11-15T02:36:38.516300+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537357+0000","last_change":"2023-11-15T02:36:38.534476+0000","last_active":"2023-11-15T02:36:38.537357+0000","last_peered":"2023-11-15T02:36:38.537357+0000","last_clean":"2023-11-15T02:36:38.537357+0000","last_became_active":"2023-11-15T02:36:38.534239+0000","last_became_peered":"2023-11-15T02:36:38.534239+0000","last_unstale":"2023-11-15T02:36:38.537357+0000","last_undegraded":"2023-11-15T02:36:38.537357+0000","last_fullsized":"2023-11-15T02:36:38.537357+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.512011+0000","last_change":"2023-11-15T02:36:38.134553+0000","last_active":"2023-11-15T02:36:38.512011+0000","last_peered":"2023-11-15T02:36:38.512011+0000","last_clean":"2023-11-15T02:36:38.512011+0000","last_became_active":"2023-11-15T02:36:38.133755+0000","last_became_peered":"2023-11-15T02:36:38.133755+0000","last_unstale":"2023-11-15T02:36:38.512011+0000","last_undegraded":"2023-11-15T02:36:38.512011+0000","last_fullsized":"2023-11-15T02:36:38.512011+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.544155+0000","last_change":"2023-11-15T02:36:38.536457+0000","last_active":"2023-11-15T02:36:38.544155+0000","last_peered":"2023-11-15T02:36:38.544155+0000","last_clean":"2023-11-15T02:36:38.544155+0000","last_became_active":"2023-11-15T02:36:38.536087+0000","last_became_peered":"2023-11-15T02:36:38.536087+0000","last_unstale":"2023-11-15T02:36:38.544155+0000","last_undegraded":"2023-11-15T02:36:38.544155+0000","last_fullsized":"2023-11-15T02:36:38.544155+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.531672+0000","last_change":"2023-11-15T02:36:38.137398+0000","last_active":"2023-11-15T02:36:38.531672+0000","last_peered":"2023-11-15T02:36:38.531672+0000","last_clean":"2023-11-15T02:36:38.531672+0000","last_became_active":"2023-11-15T02:36:38.136941+0000","last_became_peered":"2023-11-15T02:36:38.136941+0000","last_unstale":"2023-11-15T02:36:38.531672+0000","last_undegraded":"2023-11-15T02:36:38.531672+0000","last_fullsized":"2023-11-15T02:36:38.531672+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533094+0000","last_change":"2023-11-15T02:36:38.528802+0000","last_active":"2023-11-15T02:36:38.533094+0000","last_peered":"2023-11-15T02:36:38.533094+0000","last_clean":"2023-11-15T02:36:38.533094+0000","last_became_active":"2023-11-15T02:36:38.528492+0000","last_became_peered":"2023-11-15T02:36:38.528492+0000","last_unstale":"2023-11-15T02:36:38.533094+0000","last_undegraded":"2023-11-15T02:36:38.533094+0000","last_fullsized":"2023-11-15T02:36:38.533094+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"161'2","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536369+0000","last_change":"2023-11-15T02:36:38.136200+0000","last_active":"2023-11-15T02:36:38.536369+0000","last_peered":"2023-11-15T02:36:38.536369+0000","last_clean":"2023-11-15T02:36:38.536369+0000","last_became_active":"2023-11-15T02:36:38.135767+0000","last_became_peered":"2023-11-15T02:36:38.135767+0000","last_unstale":"2023-11-15T02:36:38.536369+0000","last_undegraded":"2023-11-15T02:36:38.536369+0000","last_fullsized":"2023-11-15T02:36:38.536369+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537123+0000","last_change":"2023-11-15T02:36:38.533855+0000","last_active":"2023-11-15T02:36:38.537123+0000","last_peered":"2023-11-15T02:36:38.537123+0000","last_clean":"2023-11-15T02:36:38.537123+0000","last_became_active":"2023-11-15T02:36:38.533542+0000","last_became_peered":"2023-11-15T02:36:38.533542+0000","last_unstale":"2023-11-15T02:36:38.537123+0000","last_undegraded":"2023-11-15T02:36:38.537123+0000","last_fullsized":"2023-11-15T02:36:38.537123+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.518308+0000","last_change":"2023-11-15T02:36:38.133001+0000","last_active":"2023-11-15T02:36:38.518308+0000","last_peered":"2023-11-15T02:36:38.518308+0000","last_clean":"2023-11-15T02:36:38.518308+0000","last_became_active":"2023-11-15T02:36:38.132583+0000","last_became_peered":"2023-11-15T02:36:38.132583+0000","last_unstale":"2023-11-15T02:36:38.518308+0000","last_undegraded":"2023-11-15T02:36:38.518308+0000","last_fullsized":"2023-11-15T02:36:38.518308+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537562+0000","last_change":"2023-11-15T02:36:38.537049+0000","last_active":"2023-11-15T02:36:38.537562+0000","last_peered":"2023-11-15T02:36:38.537562+0000","last_clean":"2023-11-15T02:36:38.537562+0000","last_became_active":"2023-11-15T02:36:38.536762+0000","last_became_peered":"2023-11-15T02:36:38.536762+0000","last_unstale":"2023-11-15T02:36:38.537562+0000","last_undegraded":"2023-11-15T02:36:38.537562+0000","last_fullsized":"2023-11-15T02:36:38.537562+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.510069+0000","last_change":"2023-11-15T02:36:38.137424+0000","last_active":"2023-11-15T02:36:38.510069+0000","last_peered":"2023-11-15T02:36:38.510069+0000","last_clean":"2023-11-15T02:36:38.510069+0000","last_became_active":"2023-11-15T02:36:38.136582+0000","last_became_peered":"2023-11-15T02:36:38.136582+0000","last_unstale":"2023-11-15T02:36:38.510069+0000","last_undegraded":"2023-11-15T02:36:38.510069+0000","last_fullsized":"2023-11-15T02:36:38.510069+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.528265+0000","last_change":"2023-11-15T02:36:38.526069+0000","last_active":"2023-11-15T02:36:38.528265+0000","last_peered":"2023-11-15T02:36:38.528265+0000","last_clean":"2023-11-15T02:36:38.528265+0000","last_became_active":"2023-11-15T02:36:38.525831+0000","last_became_peered":"2023-11-15T02:36:38.525831+0000","last_unstale":"2023-11-15T02:36:38.528265+0000","last_undegraded":"2023-11-15T02:36:38.528265+0000","last_fullsized":"2023-11-15T02:36:38.528265+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537946+0000","last_change":"2023-11-15T02:36:38.128304+0000","last_active":"2023-11-15T02:36:38.537946+0000","last_peered":"2023-11-15T02:36:38.537946+0000","last_clean":"2023-11-15T02:36:38.537946+0000","last_became_active":"2023-11-15T02:36:38.128009+0000","last_became_peered":"2023-11-15T02:36:38.128009+0000","last_unstale":"2023-11-15T02:36:38.537946+0000","last_undegraded":"2023-11-15T02:36:38.537946+0000","last_fullsized":"2023-11-15T02:36:38.537946+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.538754+0000","last_change":"2023-11-15T02:36:38.530739+0000","last_active":"2023-11-15T02:36:38.538754+0000","last_peered":"2023-11-15T02:36:38.538754+0000","last_clean":"2023-11-15T02:36:38.538754+0000","last_became_active":"2023-11-15T02:36:38.530229+0000","last_became_peered":"2023-11-15T02:36:38.530229+0000","last_unstale":"2023-11-15T02:36:38.538754+0000","last_undegraded":"2023-11-15T02:36:38.538754+0000","last_fullsized":"2023-11-15T02:36:38.538754+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.515585+0000","last_change":"2023-11-15T02:36:38.129911+0000","last_active":"2023-11-15T02:36:38.515585+0000","last_peered":"2023-11-15T02:36:38.515585+0000","last_clean":"2023-11-15T02:36:38.515585+0000","last_became_active":"2023-11-15T02:36:38.129420+0000","last_became_peered":"2023-11-15T02:36:38.129420+0000","last_unstale":"2023-11-15T02:36:38.515585+0000","last_undegraded":"2023-11-15T02:36:38.515585+0000","last_fullsized":"2023-11-15T02:36:38.515585+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.527941+0000","last_change":"2023-11-15T02:36:38.519921+0000","last_active":"2023-11-15T02:36:38.527941+0000","last_peered":"2023-11-15T02:36:38.527941+0000","last_clean":"2023-11-15T02:36:38.527941+0000","last_became_active":"2023-11-15T02:36:38.519647+0000","last_became_peered":"2023-11-15T02:36:38.519647+0000","last_unstale":"2023-11-15T02:36:38.527941+0000","last_undegraded":"2023-11-15T02:36:38.527941+0000","last_fullsized":"2023-11-15T02:36:38.527941+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.521624+0000","last_change":"2023-11-15T02:36:38.137554+0000","last_active":"2023-11-15T02:36:38.521624+0000","last_peered":"2023-11-15T02:36:38.521624+0000","last_clean":"2023-11-15T02:36:38.521624+0000","last_became_active":"2023-11-15T02:36:38.137261+0000","last_became_peered":"2023-11-15T02:36:38.137261+0000","last_unstale":"2023-11-15T02:36:38.521624+0000","last_undegraded":"2023-11-15T02:36:38.521624+0000","last_fullsized":"2023-11-15T02:36:38.521624+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.527655+0000","last_change":"2023-11-15T02:36:38.518417+0000","last_active":"2023-11-15T02:36:38.527655+0000","last_peered":"2023-11-15T02:36:38.527655+0000","last_clean":"2023-11-15T02:36:38.527655+0000","last_became_active":"2023-11-15T02:36:38.518121+0000","last_became_peered":"2023-11-15T02:36:38.518121+0000","last_unstale":"2023-11-15T02:36:38.527655+0000","last_undegraded":"2023-11-15T02:36:38.527655+0000","last_fullsized":"2023-11-15T02:36:38.527655+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.514807+0000","last_change":"2023-11-15T02:36:38.133930+0000","last_active":"2023-11-15T02:36:38.514807+0000","last_peered":"2023-11-15T02:36:38.514807+0000","last_clean":"2023-11-15T02:36:38.514807+0000","last_became_active":"2023-11-15T02:36:38.133459+0000","last_became_peered":"2023-11-15T02:36:38.133459+0000","last_unstale":"2023-11-15T02:36:38.514807+0000","last_undegraded":"2023-11-15T02:36:38.514807+0000","last_fullsized":"2023-11-15T02:36:38.514807+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536976+0000","last_change":"2023-11-15T02:36:38.534645+0000","last_active":"2023-11-15T02:36:38.536976+0000","last_peered":"2023-11-15T02:36:38.536976+0000","last_clean":"2023-11-15T02:36:38.536976+0000","last_became_active":"2023-11-15T02:36:38.531118+0000","last_became_peered":"2023-11-15T02:36:38.531118+0000","last_unstale":"2023-11-15T02:36:38.536976+0000","last_undegraded":"2023-11-15T02:36:38.536976+0000","last_fullsized":"2023-11-15T02:36:38.536976+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"161'2","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537578+0000","last_change":"2023-11-15T02:36:38.132673+0000","last_active":"2023-11-15T02:36:38.537578+0000","last_peered":"2023-11-15T02:36:38.537578+0000","last_clean":"2023-11-15T02:36:38.537578+0000","last_became_active":"2023-11-15T02:36:38.132093+0000","last_became_peered":"2023-11-15T02:36:38.132093+0000","last_unstale":"2023-11-15T02:36:38.537578+0000","last_undegraded":"2023-11-15T02:36:38.537578+0000","last_fullsized":"2023-11-15T02:36:38.537578+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.535968+0000","last_change":"2023-11-15T02:36:38.519616+0000","last_active":"2023-11-15T02:36:38.535968+0000","last_peered":"2023-11-15T02:36:38.535968+0000","last_clean":"2023-11-15T02:36:38.535968+0000","last_became_active":"2023-11-15T02:36:38.519278+0000","last_became_peered":"2023-11-15T02:36:38.519278+0000","last_unstale":"2023-11-15T02:36:38.535968+0000","last_undegraded":"2023-11-15T02:36:38.535968+0000","last_fullsized":"2023-11-15T02:36:38.535968+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.521477+0000","last_change":"2023-11-15T02:36:38.126939+0000","last_active":"2023-11-15T02:36:38.521477+0000","last_peered":"2023-11-15T02:36:38.521477+0000","last_clean":"2023-11-15T02:36:38.521477+0000","last_became_active":"2023-11-15T02:36:38.126661+0000","last_became_peered":"2023-11-15T02:36:38.126661+0000","last_unstale":"2023-11-15T02:36:38.521477+0000","last_undegraded":"2023-11-15T02:36:38.521477+0000","last_fullsized":"2023-11-15T02:36:38.521477+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.544015+0000","last_change":"2023-11-15T02:36:38.537229+0000","last_active":"2023-11-15T02:36:38.544015+0000","last_peered":"2023-11-15T02:36:38.544015+0000","last_clean":"2023-11-15T02:36:38.544015+0000","last_became_active":"2023-11-15T02:36:38.536925+0000","last_became_peered":"2023-11-15T02:36:38.536925+0000","last_unstale":"2023-11-15T02:36:38.544015+0000","last_undegraded":"2023-11-15T02:36:38.544015+0000","last_fullsized":"2023-11-15T02:36:38.544015+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.522256+0000","last_change":"2023-11-15T02:36:38.136053+0000","last_active":"2023-11-15T02:36:38.522256+0000","last_peered":"2023-11-15T02:36:38.522256+0000","last_clean":"2023-11-15T02:36:38.522256+0000","last_became_active":"2023-11-15T02:36:38.135751+0000","last_became_peered":"2023-11-15T02:36:38.135751+0000","last_unstale":"2023-11-15T02:36:38.522256+0000","last_undegraded":"2023-11-15T02:36:38.522256+0000","last_fullsized":"2023-11-15T02:36:38.522256+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532856+0000","last_change":"2023-11-15T02:36:38.531938+0000","last_active":"2023-11-15T02:36:38.532856+0000","last_peered":"2023-11-15T02:36:38.532856+0000","last_clean":"2023-11-15T02:36:38.532856+0000","last_became_active":"2023-11-15T02:36:38.531604+0000","last_became_peered":"2023-11-15T02:36:38.531604+0000","last_unstale":"2023-11-15T02:36:38.532856+0000","last_undegraded":"2023-11-15T02:36:38.532856+0000","last_fullsized":"2023-11-15T02:36:38.532856+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516591+0000","last_change":"2023-11-15T02:36:38.138280+0000","last_active":"2023-11-15T02:36:38.516591+0000","last_peered":"2023-11-15T02:36:38.516591+0000","last_clean":"2023-11-15T02:36:38.516591+0000","last_became_active":"2023-11-15T02:36:38.138007+0000","last_became_peered":"2023-11-15T02:36:38.138007+0000","last_unstale":"2023-11-15T02:36:38.516591+0000","last_undegraded":"2023-11-15T02:36:38.516591+0000","last_fullsized":"2023-11-15T02:36:38.516591+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532520+0000","last_change":"2023-11-15T02:36:38.523516+0000","last_active":"2023-11-15T02:36:38.532520+0000","last_peered":"2023-11-15T02:36:38.532520+0000","last_clean":"2023-11-15T02:36:38.532520+0000","last_became_active":"2023-11-15T02:36:38.523218+0000","last_became_peered":"2023-11-15T02:36:38.523218+0000","last_unstale":"2023-11-15T02:36:38.532520+0000","last_undegraded":"2023-11-15T02:36:38.532520+0000","last_fullsized":"2023-11-15T02:36:38.532520+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.513064+0000","last_change":"2023-11-15T02:36:38.138606+0000","last_active":"2023-11-15T02:36:38.513064+0000","last_peered":"2023-11-15T02:36:38.513064+0000","last_clean":"2023-11-15T02:36:38.513064+0000","last_became_active":"2023-11-15T02:36:38.138337+0000","last_became_peered":"2023-11-15T02:36:38.138337+0000","last_unstale":"2023-11-15T02:36:38.513064+0000","last_undegraded":"2023-11-15T02:36:38.513064+0000","last_fullsized":"2023-11-15T02:36:38.513064+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.531121+0000","last_change":"2023-11-15T02:36:38.525151+0000","last_active":"2023-11-15T02:36:38.531121+0000","last_peered":"2023-11-15T02:36:38.531121+0000","last_clean":"2023-11-15T02:36:38.531121+0000","last_became_active":"2023-11-15T02:36:38.524361+0000","last_became_peered":"2023-11-15T02:36:38.524361+0000","last_unstale":"2023-11-15T02:36:38.531121+0000","last_undegraded":"2023-11-15T02:36:38.531121+0000","last_fullsized":"2023-11-15T02:36:38.531121+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.526985+0000","last_change":"2023-11-15T02:36:38.138980+0000","last_active":"2023-11-15T02:36:38.526985+0000","last_peered":"2023-11-15T02:36:38.526985+0000","last_clean":"2023-11-15T02:36:38.526985+0000","last_became_active":"2023-11-15T02:36:38.138651+0000","last_became_peered":"2023-11-15T02:36:38.138651+0000","last_unstale":"2023-11-15T02:36:38.526985+0000","last_undegraded":"2023-11-15T02:36:38.526985+0000","last_fullsized":"2023-11-15T02:36:38.526985+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532061+0000","last_change":"2023-11-15T02:36:38.530046+0000","last_active":"2023-11-15T02:36:38.532061+0000","last_peered":"2023-11-15T02:36:38.532061+0000","last_clean":"2023-11-15T02:36:38.532061+0000","last_became_active":"2023-11-15T02:36:38.529767+0000","last_became_peered":"2023-11-15T02:36:38.529767+0000","last_unstale":"2023-11-15T02:36:38.532061+0000","last_undegraded":"2023-11-15T02:36:38.532061+0000","last_fullsized":"2023-11-15T02:36:38.532061+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516409+0000","last_change":"2023-11-15T02:36:38.136265+0000","last_active":"2023-11-15T02:36:38.516409+0000","last_peered":"2023-11-15T02:36:38.516409+0000","last_clean":"2023-11-15T02:36:38.516409+0000","last_became_active":"2023-11-15T02:36:38.135988+0000","last_became_peered":"2023-11-15T02:36:38.135988+0000","last_unstale":"2023-11-15T02:36:38.516409+0000","last_undegraded":"2023-11-15T02:36:38.516409+0000","last_fullsized":"2023-11-15T02:36:38.516409+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.544052+0000","last_change":"2023-11-15T02:36:38.537910+0000","last_active":"2023-11-15T02:36:38.544052+0000","last_peered":"2023-11-15T02:36:38.544052+0000","last_clean":"2023-11-15T02:36:38.544052+0000","last_became_active":"2023-11-15T02:36:38.537535+0000","last_became_peered":"2023-11-15T02:36:38.537535+0000","last_unstale":"2023-11-15T02:36:38.544052+0000","last_undegraded":"2023-11-15T02:36:38.544052+0000","last_fullsized":"2023-11-15T02:36:38.544052+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.509423+0000","last_change":"2023-11-15T02:36:38.132549+0000","last_active":"2023-11-15T02:36:38.509423+0000","last_peered":"2023-11-15T02:36:38.509423+0000","last_clean":"2023-11-15T02:36:38.509423+0000","last_became_active":"2023-11-15T02:36:38.131056+0000","last_became_peered":"2023-11-15T02:36:38.131056+0000","last_unstale":"2023-11-15T02:36:38.509423+0000","last_undegraded":"2023-11-15T02:36:38.509423+0000","last_fullsized":"2023-11-15T02:36:38.509423+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.530459+0000","last_change":"2023-11-15T02:36:38.518241+0000","last_active":"2023-11-15T02:36:38.530459+0000","last_peered":"2023-11-15T02:36:38.530459+0000","last_clean":"2023-11-15T02:36:38.530459+0000","last_became_active":"2023-11-15T02:36:38.517955+0000","last_became_peered":"2023-11-15T02:36:38.517955+0000","last_unstale":"2023-11-15T02:36:38.530459+0000","last_undegraded":"2023-11-15T02:36:38.530459+0000","last_fullsized":"2023-11-15T02:36:38.530459+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"161'3","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537395+0000","last_change":"2023-11-15T02:36:38.131164+0000","last_active":"2023-11-15T02:36:38.537395+0000","last_peered":"2023-11-15T02:36:38.537395+0000","last_clean":"2023-11-15T02:36:38.537395+0000","last_became_active":"2023-11-15T02:36:38.130878+0000","last_became_peered":"2023-11-15T02:36:38.130878+0000","last_unstale":"2023-11-15T02:36:38.537395+0000","last_undegraded":"2023-11-15T02:36:38.537395+0000","last_fullsized":"2023-11-15T02:36:38.537395+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516669+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:36:38.516669+0000","last_peered":"2023-11-15T02:36:38.516669+0000","last_clean":"2023-11-15T02:36:38.516669+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:36:38.516669+0000","last_undegraded":"2023-11-15T02:36:38.516669+0000","last_fullsized":"2023-11-15T02:36:38.516669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.530613+0000","last_change":"2023-11-15T02:36:38.523967+0000","last_active":"2023-11-15T02:36:38.530613+0000","last_peered":"2023-11-15T02:36:38.530613+0000","last_clean":"2023-11-15T02:36:38.530613+0000","last_became_active":"2023-11-15T02:36:38.523736+0000","last_became_peered":"2023-11-15T02:36:38.523736+0000","last_unstale":"2023-11-15T02:36:38.530613+0000","last_undegraded":"2023-11-15T02:36:38.530613+0000","last_fullsized":"2023-11-15T02:36:38.530613+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533483+0000","last_change":"2023-11-15T02:36:38.131656+0000","last_active":"2023-11-15T02:36:38.533483+0000","last_peered":"2023-11-15T02:36:38.533483+0000","last_clean":"2023-11-15T02:36:38.533483+0000","last_became_active":"2023-11-15T02:36:38.131365+0000","last_became_peered":"2023-11-15T02:36:38.131365+0000","last_unstale":"2023-11-15T02:36:38.533483+0000","last_undegraded":"2023-11-15T02:36:38.533483+0000","last_fullsized":"2023-11-15T02:36:38.533483+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":133,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.511477+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:36:38.511477+0000","last_peered":"2023-11-15T02:36:38.511477+0000","last_clean":"2023-11-15T02:36:38.511477+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:36:38.511477+0000","last_undegraded":"2023-11-15T02:36:38.511477+0000","last_fullsized":"2023-11-15T02:36:38.511477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536357+0000","last_change":"2023-11-15T02:36:38.530209+0000","last_active":"2023-11-15T02:36:38.536357+0000","last_peered":"2023-11-15T02:36:38.536357+0000","last_clean":"2023-11-15T02:36:38.536357+0000","last_became_active":"2023-11-15T02:36:38.529709+0000","last_became_peered":"2023-11-15T02:36:38.529709+0000","last_unstale":"2023-11-15T02:36:38.536357+0000","last_undegraded":"2023-11-15T02:36:38.536357+0000","last_fullsized":"2023-11-15T02:36:38.536357+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"161'4","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537161+0000","last_change":"2023-11-15T02:36:38.133751+0000","last_active":"2023-11-15T02:36:38.537161+0000","last_peered":"2023-11-15T02:36:38.537161+0000","last_clean":"2023-11-15T02:36:38.537161+0000","last_became_active":"2023-11-15T02:36:38.132964+0000","last_became_peered":"2023-11-15T02:36:38.132964+0000","last_unstale":"2023-11-15T02:36:38.537161+0000","last_undegraded":"2023-11-15T02:36:38.537161+0000","last_fullsized":"2023-11-15T02:36:38.537161+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":142,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516913+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:36:38.516913+0000","last_peered":"2023-11-15T02:36:38.516913+0000","last_clean":"2023-11-15T02:36:38.516913+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:36:38.516913+0000","last_undegraded":"2023-11-15T02:36:38.516913+0000","last_fullsized":"2023-11-15T02:36:38.516913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536060+0000","last_change":"2023-11-15T02:36:38.520559+0000","last_active":"2023-11-15T02:36:38.536060+0000","last_peered":"2023-11-15T02:36:38.536060+0000","last_clean":"2023-11-15T02:36:38.536060+0000","last_became_active":"2023-11-15T02:36:38.520256+0000","last_became_peered":"2023-11-15T02:36:38.520256+0000","last_unstale":"2023-11-15T02:36:38.536060+0000","last_undegraded":"2023-11-15T02:36:38.536060+0000","last_fullsized":"2023-11-15T02:36:38.536060+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.526875+0000","last_change":"2023-11-15T02:36:38.139742+0000","last_active":"2023-11-15T02:36:38.526875+0000","last_peered":"2023-11-15T02:36:38.526875+0000","last_clean":"2023-11-15T02:36:38.526875+0000","last_became_active":"2023-11-15T02:36:38.139448+0000","last_became_peered":"2023-11-15T02:36:38.139448+0000","last_unstale":"2023-11-15T02:36:38.526875+0000","last_undegraded":"2023-11-15T02:36:38.526875+0000","last_fullsized":"2023-11-15T02:36:38.526875+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.513025+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:36:38.513025+0000","last_peered":"2023-11-15T02:36:38.513025+0000","last_clean":"2023-11-15T02:36:38.513025+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:36:38.513025+0000","last_undegraded":"2023-11-15T02:36:38.513025+0000","last_fullsized":"2023-11-15T02:36:38.513025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":130,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.518795+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:36:38.518795+0000","last_peered":"2023-11-15T02:36:38.518795+0000","last_clean":"2023-11-15T02:36:38.518795+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:36:38.518795+0000","last_undegraded":"2023-11-15T02:36:38.518795+0000","last_fullsized":"2023-11-15T02:36:38.518795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533074+0000","last_change":"2023-11-15T02:36:38.528559+0000","last_active":"2023-11-15T02:36:38.533074+0000","last_peered":"2023-11-15T02:36:38.533074+0000","last_clean":"2023-11-15T02:36:38.533074+0000","last_became_active":"2023-11-15T02:36:38.528245+0000","last_became_peered":"2023-11-15T02:36:38.528245+0000","last_unstale":"2023-11-15T02:36:38.533074+0000","last_undegraded":"2023-11-15T02:36:38.533074+0000","last_fullsized":"2023-11-15T02:36:38.533074+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.512753+0000","last_change":"2023-11-15T02:36:38.134038+0000","last_active":"2023-11-15T02:36:38.512753+0000","last_peered":"2023-11-15T02:36:38.512753+0000","last_clean":"2023-11-15T02:36:38.512753+0000","last_became_active":"2023-11-15T02:36:38.133738+0000","last_became_peered":"2023-11-15T02:36:38.133738+0000","last_unstale":"2023-11-15T02:36:38.512753+0000","last_undegraded":"2023-11-15T02:36:38.512753+0000","last_fullsized":"2023-11-15T02:36:38.512753+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.518886+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:36:38.518886+0000","last_peered":"2023-11-15T02:36:38.518886+0000","last_clean":"2023-11-15T02:36:38.518886+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:36:38.518886+0000","last_undegraded":"2023-11-15T02:36:38.518886+0000","last_fullsized":"2023-11-15T02:36:38.518886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536576+0000","last_change":"2023-11-15T02:36:38.526352+0000","last_active":"2023-11-15T02:36:38.536576+0000","last_peered":"2023-11-15T02:36:38.536576+0000","last_clean":"2023-11-15T02:36:38.536576+0000","last_became_active":"2023-11-15T02:36:38.526013+0000","last_became_peered":"2023-11-15T02:36:38.526013+0000","last_unstale":"2023-11-15T02:36:38.536576+0000","last_undegraded":"2023-11-15T02:36:38.536576+0000","last_fullsized":"2023-11-15T02:36:38.536576+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"161'2","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533265+0000","last_change":"2023-11-15T02:36:38.133858+0000","last_active":"2023-11-15T02:36:38.533265+0000","last_peered":"2023-11-15T02:36:38.533265+0000","last_clean":"2023-11-15T02:36:38.533265+0000","last_became_active":"2023-11-15T02:36:38.133560+0000","last_became_peered":"2023-11-15T02:36:38.133560+0000","last_unstale":"2023-11-15T02:36:38.533265+0000","last_undegraded":"2023-11-15T02:36:38.533265+0000","last_fullsized":"2023-11-15T02:36:38.533265+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.519340+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:36:38.519340+0000","last_peered":"2023-11-15T02:36:38.519340+0000","last_clean":"2023-11-15T02:36:38.519340+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:36:38.519340+0000","last_undegraded":"2023-11-15T02:36:38.519340+0000","last_fullsized":"2023-11-15T02:36:38.519340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.527303+0000","last_change":"2023-11-15T02:36:38.521699+0000","last_active":"2023-11-15T02:36:38.527303+0000","last_peered":"2023-11-15T02:36:38.527303+0000","last_clean":"2023-11-15T02:36:38.527303+0000","last_became_active":"2023-11-15T02:36:38.521389+0000","last_became_peered":"2023-11-15T02:36:38.521389+0000","last_unstale":"2023-11-15T02:36:38.527303+0000","last_undegraded":"2023-11-15T02:36:38.527303+0000","last_fullsized":"2023-11-15T02:36:38.527303+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.511919+0000","last_change":"2023-11-15T02:36:38.132885+0000","last_active":"2023-11-15T02:36:38.511919+0000","last_peered":"2023-11-15T02:36:38.511919+0000","last_clean":"2023-11-15T02:36:38.511919+0000","last_became_active":"2023-11-15T02:36:38.132615+0000","last_became_peered":"2023-11-15T02:36:38.132615+0000","last_unstale":"2023-11-15T02:36:38.511919+0000","last_undegraded":"2023-11-15T02:36:38.511919+0000","last_fullsized":"2023-11-15T02:36:38.511919+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":132,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516738+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:36:38.516738+0000","last_peered":"2023-11-15T02:36:38.516738+0000","last_clean":"2023-11-15T02:36:38.516738+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:36:38.516738+0000","last_undegraded":"2023-11-15T02:36:38.516738+0000","last_fullsized":"2023-11-15T02:36:38.516738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532149+0000","last_change":"2023-11-15T02:36:38.530950+0000","last_active":"2023-11-15T02:36:38.532149+0000","last_peered":"2023-11-15T02:36:38.532149+0000","last_clean":"2023-11-15T02:36:38.532149+0000","last_became_active":"2023-11-15T02:36:38.530676+0000","last_became_peered":"2023-11-15T02:36:38.530676+0000","last_unstale":"2023-11-15T02:36:38.532149+0000","last_undegraded":"2023-11-15T02:36:38.532149+0000","last_fullsized":"2023-11-15T02:36:38.532149+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.514848+0000","last_change":"2023-11-15T02:36:38.128896+0000","last_active":"2023-11-15T02:36:38.514848+0000","last_peered":"2023-11-15T02:36:38.514848+0000","last_clean":"2023-11-15T02:36:38.514848+0000","last_became_active":"2023-11-15T02:36:38.128531+0000","last_became_peered":"2023-11-15T02:36:38.128531+0000","last_unstale":"2023-11-15T02:36:38.514848+0000","last_undegraded":"2023-11-15T02:36:38.514848+0000","last_fullsized":"2023-11-15T02:36:38.514848+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":148,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.511091+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:36:38.511091+0000","last_peered":"2023-11-15T02:36:38.511091+0000","last_clean":"2023-11-15T02:36:38.511091+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:36:38.511091+0000","last_undegraded":"2023-11-15T02:36:38.511091+0000","last_fullsized":"2023-11-15T02:36:38.511091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575744,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303172,"kb_used_data":1980,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068668,"statfs":{"total":96636764160,"available":96326316032,"internally_reserved":0,"allocated":2027520,"data_stored":1065905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58699999999999997,"15min":0.57299999999999995},"min":{"1min":0.47099999999999997,"5min":0.35899999999999999,"15min":0.34399999999999997},"max":{"1min":0.748,"5min":1.0680000000000001,"15min":1.121},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.46500000000000002,"5min":0.36099999999999999,"15min":0.316},"max":{"1min":0.80100000000000005,"5min":0.94499999999999995,"15min":1.129},"last":0.35199999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.376,"15min":0.36099999999999999},"max":{"1min":0.78600000000000003,"5min":0.997,"15min":1.173},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.434,"5min":0.39500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72299999999999998,"5min":0.93700000000000006,"15min":1.1990000000000001},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58699999999999997,"15min":0.58399999999999996},"min":{"1min":0.45400000000000001,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":0.72099999999999997,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82199999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.60899999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.48699999999999999,"5min":0.40899999999999997,"15min":0.38800000000000001},"max":{"1min":0.76100000000000001,"5min":0.97999999999999998,"15min":1.212},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.504,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73099999999999998,"5min":1.101,"15min":1.101},"last":0.56999999999999995}]},{"osd":4,"last update":"Wed Nov 15 02:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47699999999999998,"15min":0.47599999999999998},"min":{"1min":0.34200000000000003,"5min":0.317,"15min":0.27300000000000002},"max":{"1min":0.64400000000000002,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.441,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78300000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Nov 15 02:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47799999999999998,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.65300000000000002,"5min":0.70599999999999996,"15min":0.78800000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.498,"15min":0.51500000000000001},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.33100000000000002},"max":{"1min":0.67600000000000005,"5min":0.75,"15min":0.82799999999999996},"last":0.49399999999999999}]},{"osd":6,"last update":"Wed Nov 15 02:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.31},"max":{"1min":0.64100000000000001,"5min":0.73299999999999998,"15min":0.86299999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55000000000000004,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.34499999999999997,"15min":0.29999999999999999},"max":{"1min":0.67200000000000004,"5min":0.77400000000000002,"15min":0.85699999999999998},"last":0.59699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575745,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307264,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064576,"statfs":{"total":96636764160,"available":96322125824,"internally_reserved":0,"allocated":2023424,"data_stored":1066153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.44900000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.341},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.48699999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.76500000000000001,"5min":0.82899999999999996,"15min":1.4039999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed Nov 15 02:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.47899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73299999999999998,"5min":0.86099999999999999,"15min":1.325},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.499,"5min":0.36799999999999999,"15min":0.34300000000000003},"max":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":1.458},"last":0.51000000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.49199999999999999,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":0.77900000000000003,"5min":0.83199999999999996,"15min":1.482},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.47299999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.754,"5min":0.78800000000000003,"15min":1.333},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.52800000000000002,"5min":0.41999999999999998,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":0.83599999999999997,"15min":1.4390000000000001},"last":0.57899999999999996}]},{"osd":4,"last update":"Wed Nov 15 02:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.44900000000000001},"min":{"1min":0.307,"5min":0.27300000000000002,"15min":0.26100000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.437},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.39100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.63900000000000001}]},{"osd":5,"last update":"Wed Nov 15 02:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.47999999999999998},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.29999999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.626},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.40699999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60899999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51400000000000001,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.28799999999999998},"max":{"1min":0.81000000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.45100000000000001,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.66400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575746,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307256,"kb_used_data":1968,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064584,"statfs":{"total":96636764160,"available":96322134016,"internally_reserved":0,"allocated":2015232,"data_stored":1065171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.45600000000000002,"5min":0.66000000000000003,"15min":0.66800000000000004},"last":0.251},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.52500000000000002,"5min":0.64200000000000002,"15min":0.65800000000000003},"last":0.28000000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.26900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.46300000000000002,"5min":0.59799999999999998,"15min":0.63100000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.44400000000000001,"15min":0.45500000000000002},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.27100000000000002},"max":{"1min":0.56599999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.30599999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.30599999999999999},"max":{"1min":0.61799999999999999,"5min":0.69799999999999995,"15min":0.74299999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.48499999999999999,"15min":0.49199999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55500000000000005,"5min":0.70899999999999996,"15min":0.77100000000000002},"last":0.33400000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":0.89800000000000002,"15min":1.097},"last":0.37},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.96499999999999997,"15min":1.014},"last":0.438}]},{"osd":5,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":0.89200000000000002,"15min":0.98699999999999999},"last":0.379},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.95399999999999996,"15min":1.024},"last":0.45100000000000001}]},{"osd":6,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.47899999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.94399999999999995,"15min":0.96799999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88400000000000001,"5min":0.93200000000000005,"15min":1.143},"last":0.48899999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90500000000000003,"5min":0.95799999999999996,"15min":1.111},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":0.97999999999999998,"15min":1.0129999999999999},"last":0.498}]}]},{"osd":0,"up_from":13,"seq":55834575744,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307268,"kb_used_data":1980,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064572,"statfs":{"total":96636764160,"available":96322121728,"internally_reserved":0,"allocated":2027520,"data_stored":1065297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41399999999999998,"15min":0.42299999999999999},"min":{"1min":0.28799999999999998,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.56299999999999994,"5min":0.63700000000000001,"15min":0.67300000000000004},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.40000000000000002,"15min":0.39900000000000002},"min":{"1min":0.313,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.48599999999999999,"5min":0.60099999999999998,"15min":0.83799999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.44800000000000001},"min":{"1min":0.36199999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.627,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.63}]},{"osd":3,"last update":"Wed Nov 15 02:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44700000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":0.55900000000000005,"5min":0.66200000000000003,"15min":0.69799999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.38700000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.55700000000000005,"5min":0.67200000000000004,"15min":0.71599999999999997},"last":0.65000000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68000000000000005,"15min":0.67800000000000005},"min":{"1min":0.499,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88700000000000001,"5min":1.004,"15min":1.004},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.53000000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.81599999999999995}]},{"osd":5,"last update":"Wed Nov 15 02:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.52000000000000002,"5min":0.45200000000000001,"15min":0.40699999999999997},"max":{"1min":0.80200000000000005,"5min":0.98699999999999999,"15min":1.05},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.66600000000000004},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.44900000000000001},"max":{"1min":0.84599999999999997,"5min":0.92600000000000005,"15min":1.004},"last":0.91200000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.46300000000000002,"15min":0.42699999999999999},"max":{"1min":0.84799999999999998,"5min":0.94999999999999996,"15min":1.026},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.51600000000000001,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":0.84299999999999997,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68999999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70599999999999996,"15min":0.70899999999999996},"min":{"1min":0.59399999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.871,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.54500000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91800000000000004,"5min":0.95699999999999996,"15min":1.0409999999999999},"last":0.997}]}]},{"osd":2,"up_from":13,"seq":55834575745,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311348,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060492,"statfs":{"total":96636764160,"available":96317943808,"internally_reserved":0,"allocated":2011136,"data_stored":1058559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.248,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56499999999999995,"5min":0.69699999999999995,"15min":0.83999999999999997},"last":0.248},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.25900000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.63500000000000001,"5min":0.69199999999999995,"15min":0.85899999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39400000000000002,"15min":0.40600000000000003},"min":{"1min":0.28699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.52200000000000002,"5min":0.68999999999999995,"15min":0.91000000000000003},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45600000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55700000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.40000000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.33500000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64800000000000002,"5min":0.755,"15min":0.79800000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":0.65600000000000003,"5min":0.69499999999999995,"15min":1.113},"last":0.35399999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67100000000000004,"15min":0.65500000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.89000000000000001,"5min":1.0069999999999999,"15min":1.2170000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91100000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.41899999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.153},"last":0.497},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69299999999999995,"15min":0.68300000000000005},"min":{"1min":0.497,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.996},"last":0.53000000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.442},"max":{"1min":0.85699999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.70599999999999996},"min":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.438},"max":{"1min":0.97299999999999998,"5min":1.079,"15min":1.079},"last":0.63100000000000001}]},{"osd":7,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95099999999999996,"5min":1.0940000000000001,"15min":1.7270000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.72199999999999998},"min":{"1min":0.495,"5min":0.46800000000000003,"15min":0.45800000000000002},"max":{"1min":0.90900000000000003,"5min":1.038,"15min":1.038},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575746,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311360,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060480,"statfs":{"total":96636764160,"available":96317931520,"internally_reserved":0,"allocated":2023424,"data_stored":1065815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.39500000000000002},"min":{"1min":0.26000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.56299999999999994,"5min":0.66400000000000003,"15min":0.67700000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.42099999999999999},"min":{"1min":0.29299999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.67400000000000004},"last":0.52100000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40400000000000003,"15min":0.41999999999999998},"min":{"1min":0.27500000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.59799999999999998,"5min":0.68600000000000005,"15min":0.81399999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.45300000000000001,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.75800000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.38600000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.60699999999999998,"5min":0.73399999999999999,"15min":0.76900000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.5,"15min":0.503},"min":{"1min":0.36499999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.75600000000000001},"last":0.64200000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63300000000000001,"15min":0.66300000000000003},"min":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.306},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63500000000000001,"15min":0.65800000000000003},"min":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89100000000000001,"5min":0.94999999999999996,"15min":1.0529999999999999},"last":0.95699999999999996}]},{"osd":5,"last update":"Wed Nov 15 02:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65300000000000002,"15min":0.68000000000000005},"min":{"1min":0.45300000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98999999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64800000000000002,"15min":0.67200000000000004},"min":{"1min":0.5,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":1.129},"last":0.94799999999999995}]},{"osd":6,"last update":"Wed Nov 15 02:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.45400000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96799999999999997,"15min":1.27},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.68700000000000006,"15min":0.71199999999999997},"min":{"1min":0.48999999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.0840000000000001},"last":0.97599999999999998}]},{"osd":7,"last update":"Wed Nov 15 02:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.47899999999999998,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.256},"last":1.024},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.51400000000000001,"5min":0.46700000000000003,"15min":0.46200000000000002},"max":{"1min":0.93899999999999995,"5min":1.004,"15min":1.1699999999999999},"last":0.92300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575744,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303168,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068672,"statfs":{"total":96636764160,"available":96326320128,"internally_reserved":0,"allocated":2023424,"data_stored":1065795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.32000000000000001},"max":{"1min":0.748,"5min":0.76800000000000002,"15min":0.80800000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.56599999999999995},"min":{"1min":0.38400000000000001,"5min":0.32500000000000001,"15min":0.313},"max":{"1min":0.755,"5min":0.78000000000000003,"15min":1.1919999999999999},"last":0.56999999999999995}]},{"osd":1,"last update":"Wed Nov 15 02:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56699999999999995,"15min":0.58299999999999996},"min":{"1min":0.379,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.76400000000000001,"5min":0.81599999999999995,"15min":0.82399999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.495,"5min":0.39400000000000002,"15min":0.38900000000000001},"max":{"1min":0.82199999999999995,"5min":0.82799999999999996,"15min":1.2},"last":0.58299999999999996}]},{"osd":2,"last update":"Wed Nov 15 02:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59399999999999997,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.39000000000000001,"15min":0.36599999999999999},"max":{"1min":0.70799999999999996,"5min":0.78300000000000003,"15min":1.272},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.70699999999999996,"5min":0.81899999999999995,"15min":0.95999999999999996},"last":0.434}]},{"osd":3,"last update":"Wed Nov 15 02:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.435,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71899999999999997,"5min":0.74399999999999999,"15min":0.82999999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.51600000000000001,"5min":0.41399999999999998,"15min":0.40899999999999997},"max":{"1min":0.76100000000000001,"5min":0.78400000000000003,"15min":1.3109999999999999},"last":0.40500000000000003}]},{"osd":5,"last update":"Wed Nov 15 02:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47899999999999998,"15min":0.46600000000000003},"min":{"1min":0.36899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68100000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.497,"15min":0.48599999999999999},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.28299999999999997},"max":{"1min":0.747,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.38}]},{"osd":6,"last update":"Wed Nov 15 02:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.497},"min":{"1min":0.35099999999999998,"5min":0.33800000000000002,"15min":0.32400000000000001},"max":{"1min":0.752,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77600000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.61199999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53900000000000003,"15min":0.52600000000000002},"min":{"1min":0.40600000000000003,"5min":0.34999999999999998,"15min":0.34100000000000003},"max":{"1min":0.79900000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36799999999999999},"max":{"1min":0.79100000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575744,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307264,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064576,"statfs":{"total":96636764160,"available":96322125824,"internally_reserved":0,"allocated":2023424,"data_stored":1066085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.748,"5min":0.77700000000000002,"15min":1.1379999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.374,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.623,"5min":0.79500000000000004,"15min":1.0169999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Wed Nov 15 02:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.57099999999999995},"min":{"1min":0.371,"5min":0.34499999999999997,"15min":0.33500000000000002},"max":{"1min":0.78300000000000003,"5min":0.84299999999999997,"15min":1.0109999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.27600000000000002},"max":{"1min":0.75600000000000001,"5min":0.81499999999999995,"15min":1.135},"last":0.49399999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65400000000000003,"5min":0.79200000000000004,"15min":1.155},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75900000000000001,"5min":0.81999999999999995,"15min":1.0369999999999999},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed Nov 15 02:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":1.1779999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.59499999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":1.171},"last":0.60599999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46700000000000003,"15min":0.45800000000000002},"min":{"1min":0.34699999999999998,"5min":0.32100000000000001,"15min":0.27800000000000002},"max":{"1min":0.61799999999999999,"5min":0.67600000000000005,"15min":0.72399999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.77900000000000003,"15min":0.78600000000000003},"last":0.44}]},{"osd":6,"last update":"Wed Nov 15 02:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47599999999999998,"15min":0.47099999999999997},"min":{"1min":0.33400000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.63,"5min":0.70499999999999996,"15min":0.80900000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.504,"15min":0.498},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.316},"max":{"1min":0.64400000000000002,"5min":0.76500000000000001,"15min":0.81899999999999995},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed Nov 15 02:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.505,"15min":0.497},"min":{"1min":0.35799999999999998,"5min":0.33400000000000002,"15min":0.312},"max":{"1min":0.69999999999999996,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58899999999999997,"15min":0.58199999999999996},"min":{"1min":0.443,"5min":0.39700000000000002,"15min":0.36299999999999999},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:36:42.563 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:36:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.711+0000 7f1f1141c700 1 Processor -- start 2023-11-15T02:36:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.711+0000 7f1f1141c700 1 -- start start 2023-11-15T02:36:42.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.712+0000 7f1f1141c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1f0c154150 0x7f1f0c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.712+0000 7f1f1141c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f0c0aa060 0x7f1f0c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.712+0000 7f1f1141c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f0c0c06f0 con 0x7f1f0c0ab1a0 2023-11-15T02:36:42.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.712+0000 7f1f1141c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f0c0c09d0 con 0x7f1f0c154150 2023-11-15T02:36:42.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.712+0000 7f1f1141c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c158820 con 0x7f1f0c0aa060 2023-11-15T02:36:42.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.712+0000 7f1f0a7fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f1f0c0ab1a0 0x7f1f0c158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41734/0 (socket says 172.21.15.1:41734) 2023-11-15T02:36:42.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.712+0000 7f1f0a7fc700 1 -- 172.21.15.1:0/1724944948 learned_addr learned my addr 172.21.15.1:0/1724944948 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:42.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.712+0000 7f1f0affd700 1 --2- 172.21.15.1:0/1724944948 >> v2:172.21.15.141:3300/0 conn(0x7f1f0c154150 0x7f1f0c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.712+0000 7f1f0b7fe700 1 --2- 172.21.15.1:0/1724944948 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f0c0aa060 0x7f1f0c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 -- 172.21.15.1:0/1724944948 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541596987 0 0) 0x7f1f0c0c06f0 con 0x7f1f0c0ab1a0 2023-11-15T02:36:42.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 -- 172.21.15.1:0/1724944948 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ef80033f0 con 0x7f1f0c0ab1a0 2023-11-15T02:36:42.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 -- 172.21.15.1:0/1724944948 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2493051478 0 0) 0x7f1ef80033f0 con 0x7f1f0c0ab1a0 2023-11-15T02:36:42.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 -- 172.21.15.1:0/1724944948 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f0c0aa060 msgr2=0x7f1f0c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:42.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 --2- 172.21.15.1:0/1724944948 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f0c0aa060 0x7f1f0c0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 -- 172.21.15.1:0/1724944948 >> v2:172.21.15.141:3300/0 conn(0x7f1f0c154150 msgr2=0x7f1f0c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:42.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 --2- 172.21.15.1:0/1724944948 >> v2:172.21.15.141:3300/0 conn(0x7f1f0c154150 0x7f1f0c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 -- 172.21.15.1:0/1724944948 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0c158b00 con 0x7f1f0c0ab1a0 2023-11-15T02:36:42.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 -- 172.21.15.1:0/1724944948 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f1ef4001470 con 0x7f1f0c0ab1a0 2023-11-15T02:36:42.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 -- 172.21.15.1:0/1724944948 >> v1:172.21.15.1:6789/0 conn(0x7f1f0c0ab1a0 legacy=0x7f1f0c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 --2- 172.21.15.1:0/1724944948 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f0c0aa060 0x7f1ef80038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 --2- 172.21.15.1:0/1724944948 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ef8003e10 0x7f1ef8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 --2- 172.21.15.1:0/1724944948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ef8004b80 0x7f1ef8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 -- 172.21.15.1:0/1724944948 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c0c09d0 con 0x7f1ef8004b80 2023-11-15T02:36:42.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 -- 172.21.15.1:0/1724944948 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c158820 con 0x7f1ef8003e10 2023-11-15T02:36:42.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f09ffb700 1 -- 172.21.15.1:0/1724944948 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef800b8e0 con 0x7f1f0c0aa060 2023-11-15T02:36:42.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f0affd700 1 --2- 172.21.15.1:0/1724944948 >> v2:172.21.15.141:3300/0 conn(0x7f1f0c154150 0x7f1f0c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:42.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f0b7fe700 1 --2- 172.21.15.1:0/1724944948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ef8004b80 0x7f1ef8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f0a7fc700 1 --2- 172.21.15.1:0/1724944948 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ef8003e10 0x7f1ef8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f0affd700 1 --2- 172.21.15.1:0/1724944948 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f0c0aa060 0x7f1ef80038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f0b7fe700 1 -- 172.21.15.1:0/1724944948 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f0c0aa060 msgr2=0x7f1ef80038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:42.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f0b7fe700 1 --2- 172.21.15.1:0/1724944948 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f0c0aa060 0x7f1ef80038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f0b7fe700 1 -- 172.21.15.1:0/1724944948 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ef8003e10 msgr2=0x7f1ef8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:42.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f0b7fe700 1 --2- 172.21.15.1:0/1724944948 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ef8003e10 0x7f1ef8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f0b7fe700 1 -- 172.21.15.1:0/1724944948 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef80033f0 con 0x7f1ef8004b80 2023-11-15T02:36:42.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.713+0000 7f1f0a7fc700 1 --2- 172.21.15.1:0/1724944948 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ef8003e10 0x7f1ef8004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:42.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.714+0000 7f1f0b7fe700 1 --2- 172.21.15.1:0/1724944948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ef8004b80 0x7f1ef8005000 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f1efc009a80 tx=0x7f1efc009060).ready entity=mon.0 client_cookie=80203f3f09b1d42e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:42.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.714+0000 7f1f09ffb700 1 -- 172.21.15.1:0/1724944948 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc009430 con 0x7f1ef8004b80 2023-11-15T02:36:42.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.714+0000 7f1f09ffb700 1 -- 172.21.15.1:0/1724944948 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc00e640 con 0x7f1ef8004b80 2023-11-15T02:36:42.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.714+0000 7f1f09ffb700 1 -- 172.21.15.1:0/1724944948 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00e9c0 con 0x7f1ef8004b80 2023-11-15T02:36:42.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.714+0000 7f1f1141c700 1 -- 172.21.15.1:0/1724944948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ef8004b80 msgr2=0x7f1ef8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.714+0000 7f1f1141c700 1 --2- 172.21.15.1:0/1724944948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ef8004b80 0x7f1ef8005000 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f1efc009a80 tx=0x7f1efc009060).stop 2023-11-15T02:36:42.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.714+0000 7f1f0b7fe700 1 -- 172.21.15.1:0/1724944948 reap_dead start 2023-11-15T02:36:42.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.714+0000 7f1f1141c700 1 -- 172.21.15.1:0/1724944948 shutdown_connections 2023-11-15T02:36:42.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.714+0000 7f1f1141c700 1 -- 172.21.15.1:0/1724944948 >> 172.21.15.1:0/1724944948 conn(0x7f1f0c064aa0 msgr2=0x7f1f0c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:42.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.714+0000 7f1f1141c700 1 -- 172.21.15.1:0/1724944948 shutdown_connections 2023-11-15T02:36:42.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.714+0000 7f1f1141c700 1 -- 172.21.15.1:0/1724944948 wait complete. 2023-11-15T02:36:42.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.715+0000 7f1f1141c700 1 Processor -- start 2023-11-15T02:36:42.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.716+0000 7f1f1141c700 1 -- start start 2023-11-15T02:36:42.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.716+0000 7f1f1141c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ef8004b80 0x7f1f0c157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.716+0000 7f1f1141c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f0c0b0450 0x7f1f0c0ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.716+0000 7f1f1141c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f0c1476a0 0x7f1f0c0acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.716+0000 7f1f1141c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c0b1190 con 0x7f1f0c1476a0 2023-11-15T02:36:42.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.716+0000 7f1f1141c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c157b30 con 0x7f1ef8004b80 2023-11-15T02:36:42.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.716+0000 7f1f1141c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c0acfb0 con 0x7f1f0c0b0450 2023-11-15T02:36:42.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.716+0000 7f1f0b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f0c1476a0 0x7f1f0c0acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.716+0000 7f1f0b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f0c1476a0 0x7f1f0c0acac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53126/0 (socket says 172.21.15.1:53126) 2023-11-15T02:36:42.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.716+0000 7f1f0b7fe700 1 -- 172.21.15.1:0/4090241734 learned_addr learned my addr 172.21.15.1:0/4090241734 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:42.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.717+0000 7f1f0affd700 1 --2- 172.21.15.1:0/4090241734 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ef8004b80 0x7f1f0c157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.717+0000 7f1f0b7fe700 1 -- 172.21.15.1:0/4090241734 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f0c0b0450 msgr2=0x7f1f0c0ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.717+0000 7f1f0b7fe700 1 --2- 172.21.15.1:0/4090241734 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f0c0b0450 0x7f1f0c0ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:42.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.717+0000 7f1f0b7fe700 1 -- 172.21.15.1:0/4090241734 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ef8004b80 msgr2=0x7f1f0c157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.717+0000 7f1f0b7fe700 1 --2- 172.21.15.1:0/4090241734 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ef8004b80 0x7f1f0c157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.717+0000 7f1f0b7fe700 1 -- 172.21.15.1:0/4090241734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0c154ce0 con 0x7f1f0c1476a0 2023-11-15T02:36:42.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.717+0000 7f1f0b7fe700 1 --2- 172.21.15.1:0/4090241734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f0c1476a0 0x7f1f0c0acac0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f1ef8004580 tx=0x7f1efc01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:42.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.717+0000 7f1f02ffd700 1 -- 172.21.15.1:0/4090241734 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00e7b0 con 0x7f1f0c1476a0 2023-11-15T02:36:42.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.717+0000 7f1f02ffd700 1 -- 172.21.15.1:0/4090241734 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc00e910 con 0x7f1f0c1476a0 2023-11-15T02:36:42.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.717+0000 7f1f1141c700 1 -- 172.21.15.1:0/4090241734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f0c0b08f0 con 0x7f1f0c1476a0 2023-11-15T02:36:42.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.717+0000 7f1f02ffd700 1 -- 172.21.15.1:0/4090241734 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc01b680 con 0x7f1f0c1476a0 2023-11-15T02:36:42.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.717+0000 7f1f1141c700 1 -- 172.21.15.1:0/4090241734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0c0b0eb0 con 0x7f1f0c1476a0 2023-11-15T02:36:42.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.718+0000 7f1f1141c700 1 -- 172.21.15.1:0/4090241734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f0c154ab0 con 0x7f1f0c1476a0 2023-11-15T02:36:42.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.718+0000 7f1f02ffd700 1 -- 172.21.15.1:0/4090241734 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1efc01bab0 con 0x7f1f0c1476a0 2023-11-15T02:36:42.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.719+0000 7f1f02ffd700 1 --2- 172.21.15.1:0/4090241734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1eec05f270 0x7f1eec061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:42.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.719+0000 7f1f02ffd700 1 -- 172.21.15.1:0/4090241734 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f1efc000e40 con 0x7f1f0c1476a0 2023-11-15T02:36:42.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.719+0000 7f1f0affd700 1 --2- 172.21.15.1:0/4090241734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1eec05f270 0x7f1eec061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:42.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.719+0000 7f1f0affd700 1 --2- 172.21.15.1:0/4090241734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1eec05f270 0x7f1eec061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1f0c0ad970 tx=0x7f1f0400b040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:42.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.723+0000 7f1f02ffd700 1 -- 172.21.15.1:0/4090241734 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1f0c154ab0 con 0x7f1f0c1476a0 2023-11-15T02:36:42.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.893+0000 7f1f1141c700 1 -- 172.21.15.1:0/4090241734 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f0c154ab0 con 0x7f1eec05f270 2023-11-15T02:36:42.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.904+0000 7f1f02ffd700 1 -- 172.21.15.1:0/4090241734 <== mgr.8421 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361927 (secure 0 0 0) 0x7f1f0c154ab0 con 0x7f1eec05f270 2023-11-15T02:36:42.910 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:42.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.908+0000 7f1f1141c700 1 -- 172.21.15.1:0/4090241734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1eec05f270 msgr2=0x7f1eec061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.908+0000 7f1f1141c700 1 --2- 172.21.15.1:0/4090241734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1eec05f270 0x7f1eec061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1f0c0ad970 tx=0x7f1f0400b040).stop 2023-11-15T02:36:42.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.908+0000 7f1f1141c700 1 -- 172.21.15.1:0/4090241734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f0c1476a0 msgr2=0x7f1f0c0acac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:42.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.908+0000 7f1f1141c700 1 --2- 172.21.15.1:0/4090241734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f0c1476a0 0x7f1f0c0acac0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f1ef8004580 tx=0x7f1efc01a000).stop 2023-11-15T02:36:42.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.908+0000 7f1f1141c700 1 -- 172.21.15.1:0/4090241734 shutdown_connections 2023-11-15T02:36:42.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.908+0000 7f1f1141c700 1 --2- 172.21.15.1:0/4090241734 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1eec05f270 0x7f1eec061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.908+0000 7f1f1141c700 1 --2- 172.21.15.1:0/4090241734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f0c1476a0 0x7f1f0c0acac0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.908+0000 7f1f1141c700 1 --2- 172.21.15.1:0/4090241734 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ef8004b80 0x7f1f0c157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:42.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.908+0000 7f1f1141c700 1 --2- 172.21.15.1:0/4090241734 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f0c0b0450 0x7f1f0c0ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:42.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.908+0000 7f1f1141c700 1 -- 172.21.15.1:0/4090241734 >> 172.21.15.1:0/4090241734 conn(0x7f1f0c064aa0 msgr2=0x7f1f0c063460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:42.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.908+0000 7f1f1141c700 1 -- 172.21.15.1:0/4090241734 shutdown_connections 2023-11-15T02:36:42.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:42.908+0000 7f1f1141c700 1 -- 172.21.15.1:0/4090241734 wait complete. 2023-11-15T02:36:42.916 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:36:42.922 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T02:36:41.079528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":215,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2458100,"kb_used_data":15796,"kb_used_omap":0,"kb_used_meta":2442240,"kb_avail":752516620,"statfs":{"total":773094113280,"available":770577018880,"internally_reserved":0,"allocated":16175104,"data_stored":8518780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2500853760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5038930,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-523,"num_write_kb":-5315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.007987"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.530640+0000","last_change":"2023-11-15T02:36:38.523238+0000","last_active":"2023-11-15T02:36:38.530640+0000","last_peered":"2023-11-15T02:36:38.530640+0000","last_clean":"2023-11-15T02:36:38.530640+0000","last_became_active":"2023-11-15T02:36:38.522979+0000","last_became_peered":"2023-11-15T02:36:38.522979+0000","last_unstale":"2023-11-15T02:36:38.530640+0000","last_undegraded":"2023-11-15T02:36:38.530640+0000","last_fullsized":"2023-11-15T02:36:38.530640+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"161'3","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.531313+0000","last_change":"2023-11-15T02:36:38.129621+0000","last_active":"2023-11-15T02:36:38.531313+0000","last_peered":"2023-11-15T02:36:38.531313+0000","last_clean":"2023-11-15T02:36:38.531313+0000","last_became_active":"2023-11-15T02:36:38.129281+0000","last_became_peered":"2023-11-15T02:36:38.129281+0000","last_unstale":"2023-11-15T02:36:38.531313+0000","last_undegraded":"2023-11-15T02:36:38.531313+0000","last_fullsized":"2023-11-15T02:36:38.531313+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.544023+0000","last_change":"2023-11-15T02:36:38.537227+0000","last_active":"2023-11-15T02:36:38.544023+0000","last_peered":"2023-11-15T02:36:38.544023+0000","last_clean":"2023-11-15T02:36:38.544023+0000","last_became_active":"2023-11-15T02:36:38.536918+0000","last_became_peered":"2023-11-15T02:36:38.536918+0000","last_unstale":"2023-11-15T02:36:38.544023+0000","last_undegraded":"2023-11-15T02:36:38.544023+0000","last_fullsized":"2023-11-15T02:36:38.544023+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516543+0000","last_change":"2023-11-15T02:36:38.130936+0000","last_active":"2023-11-15T02:36:38.516543+0000","last_peered":"2023-11-15T02:36:38.516543+0000","last_clean":"2023-11-15T02:36:38.516543+0000","last_became_active":"2023-11-15T02:36:38.130482+0000","last_became_peered":"2023-11-15T02:36:38.130482+0000","last_unstale":"2023-11-15T02:36:38.516543+0000","last_undegraded":"2023-11-15T02:36:38.516543+0000","last_fullsized":"2023-11-15T02:36:38.516543+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.539129+0000","last_change":"2023-11-15T02:36:38.536967+0000","last_active":"2023-11-15T02:36:38.539129+0000","last_peered":"2023-11-15T02:36:38.539129+0000","last_clean":"2023-11-15T02:36:38.539129+0000","last_became_active":"2023-11-15T02:36:38.536671+0000","last_became_peered":"2023-11-15T02:36:38.536671+0000","last_unstale":"2023-11-15T02:36:38.539129+0000","last_undegraded":"2023-11-15T02:36:38.539129+0000","last_fullsized":"2023-11-15T02:36:38.539129+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.512538+0000","last_change":"2023-11-15T02:36:38.130129+0000","last_active":"2023-11-15T02:36:38.512538+0000","last_peered":"2023-11-15T02:36:38.512538+0000","last_clean":"2023-11-15T02:36:38.512538+0000","last_became_active":"2023-11-15T02:36:38.129804+0000","last_became_peered":"2023-11-15T02:36:38.129804+0000","last_unstale":"2023-11-15T02:36:38.512538+0000","last_undegraded":"2023-11-15T02:36:38.512538+0000","last_fullsized":"2023-11-15T02:36:38.512538+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.528209+0000","last_change":"2023-11-15T02:36:38.527123+0000","last_active":"2023-11-15T02:36:38.528209+0000","last_peered":"2023-11-15T02:36:38.528209+0000","last_clean":"2023-11-15T02:36:38.528209+0000","last_became_active":"2023-11-15T02:36:38.526871+0000","last_became_peered":"2023-11-15T02:36:38.526871+0000","last_unstale":"2023-11-15T02:36:38.528209+0000","last_undegraded":"2023-11-15T02:36:38.528209+0000","last_fullsized":"2023-11-15T02:36:38.528209+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"161'2","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533964+0000","last_change":"2023-11-15T02:36:38.133630+0000","last_active":"2023-11-15T02:36:38.533964+0000","last_peered":"2023-11-15T02:36:38.533964+0000","last_clean":"2023-11-15T02:36:38.533964+0000","last_became_active":"2023-11-15T02:36:38.133346+0000","last_became_peered":"2023-11-15T02:36:38.133346+0000","last_unstale":"2023-11-15T02:36:38.533964+0000","last_undegraded":"2023-11-15T02:36:38.533964+0000","last_fullsized":"2023-11-15T02:36:38.533964+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.529696+0000","last_change":"2023-11-15T02:36:38.524988+0000","last_active":"2023-11-15T02:36:38.529696+0000","last_peered":"2023-11-15T02:36:38.529696+0000","last_clean":"2023-11-15T02:36:38.529696+0000","last_became_active":"2023-11-15T02:36:38.524686+0000","last_became_peered":"2023-11-15T02:36:38.524686+0000","last_unstale":"2023-11-15T02:36:38.529696+0000","last_undegraded":"2023-11-15T02:36:38.529696+0000","last_fullsized":"2023-11-15T02:36:38.529696+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532970+0000","last_change":"2023-11-15T02:36:38.136361+0000","last_active":"2023-11-15T02:36:38.532970+0000","last_peered":"2023-11-15T02:36:38.532970+0000","last_clean":"2023-11-15T02:36:38.532970+0000","last_became_active":"2023-11-15T02:36:38.136076+0000","last_became_peered":"2023-11-15T02:36:38.136076+0000","last_unstale":"2023-11-15T02:36:38.532970+0000","last_undegraded":"2023-11-15T02:36:38.532970+0000","last_fullsized":"2023-11-15T02:36:38.532970+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536238+0000","last_change":"2023-11-15T02:36:38.520882+0000","last_active":"2023-11-15T02:36:38.536238+0000","last_peered":"2023-11-15T02:36:38.536238+0000","last_clean":"2023-11-15T02:36:38.536238+0000","last_became_active":"2023-11-15T02:36:38.520468+0000","last_became_peered":"2023-11-15T02:36:38.520468+0000","last_unstale":"2023-11-15T02:36:38.536238+0000","last_undegraded":"2023-11-15T02:36:38.536238+0000","last_fullsized":"2023-11-15T02:36:38.536238+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.534234+0000","last_change":"2023-11-15T02:36:38.125483+0000","last_active":"2023-11-15T02:36:38.534234+0000","last_peered":"2023-11-15T02:36:38.534234+0000","last_clean":"2023-11-15T02:36:38.534234+0000","last_became_active":"2023-11-15T02:36:38.125209+0000","last_became_peered":"2023-11-15T02:36:38.125209+0000","last_unstale":"2023-11-15T02:36:38.534234+0000","last_undegraded":"2023-11-15T02:36:38.534234+0000","last_fullsized":"2023-11-15T02:36:38.534234+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.535817+0000","last_change":"2023-11-15T02:36:38.531809+0000","last_active":"2023-11-15T02:36:38.535817+0000","last_peered":"2023-11-15T02:36:38.535817+0000","last_clean":"2023-11-15T02:36:38.535817+0000","last_became_active":"2023-11-15T02:36:38.531380+0000","last_became_peered":"2023-11-15T02:36:38.531380+0000","last_unstale":"2023-11-15T02:36:38.535817+0000","last_undegraded":"2023-11-15T02:36:38.535817+0000","last_fullsized":"2023-11-15T02:36:38.535817+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.517774+0000","last_change":"2023-11-15T02:36:38.128258+0000","last_active":"2023-11-15T02:36:38.517774+0000","last_peered":"2023-11-15T02:36:38.517774+0000","last_clean":"2023-11-15T02:36:38.517774+0000","last_became_active":"2023-11-15T02:36:38.127987+0000","last_became_peered":"2023-11-15T02:36:38.127987+0000","last_unstale":"2023-11-15T02:36:38.517774+0000","last_undegraded":"2023-11-15T02:36:38.517774+0000","last_fullsized":"2023-11-15T02:36:38.517774+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.539205+0000","last_change":"2023-11-15T02:36:38.534236+0000","last_active":"2023-11-15T02:36:38.539205+0000","last_peered":"2023-11-15T02:36:38.539205+0000","last_clean":"2023-11-15T02:36:38.539205+0000","last_became_active":"2023-11-15T02:36:38.533377+0000","last_became_peered":"2023-11-15T02:36:38.533377+0000","last_unstale":"2023-11-15T02:36:38.539205+0000","last_undegraded":"2023-11-15T02:36:38.539205+0000","last_fullsized":"2023-11-15T02:36:38.539205+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.511931+0000","last_change":"2023-11-15T02:36:38.134731+0000","last_active":"2023-11-15T02:36:38.511931+0000","last_peered":"2023-11-15T02:36:38.511931+0000","last_clean":"2023-11-15T02:36:38.511931+0000","last_became_active":"2023-11-15T02:36:38.134147+0000","last_became_peered":"2023-11-15T02:36:38.134147+0000","last_unstale":"2023-11-15T02:36:38.511931+0000","last_undegraded":"2023-11-15T02:36:38.511931+0000","last_fullsized":"2023-11-15T02:36:38.511931+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.539113+0000","last_change":"2023-11-15T02:36:38.535890+0000","last_active":"2023-11-15T02:36:38.539113+0000","last_peered":"2023-11-15T02:36:38.539113+0000","last_clean":"2023-11-15T02:36:38.539113+0000","last_became_active":"2023-11-15T02:36:38.535318+0000","last_became_peered":"2023-11-15T02:36:38.535318+0000","last_unstale":"2023-11-15T02:36:38.539113+0000","last_undegraded":"2023-11-15T02:36:38.539113+0000","last_fullsized":"2023-11-15T02:36:38.539113+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.510889+0000","last_change":"2023-11-15T02:36:38.132447+0000","last_active":"2023-11-15T02:36:38.510889+0000","last_peered":"2023-11-15T02:36:38.510889+0000","last_clean":"2023-11-15T02:36:38.510889+0000","last_became_active":"2023-11-15T02:36:38.132191+0000","last_became_peered":"2023-11-15T02:36:38.132191+0000","last_unstale":"2023-11-15T02:36:38.510889+0000","last_undegraded":"2023-11-15T02:36:38.510889+0000","last_fullsized":"2023-11-15T02:36:38.510889+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.538801+0000","last_change":"2023-11-15T02:36:38.530987+0000","last_active":"2023-11-15T02:36:38.538801+0000","last_peered":"2023-11-15T02:36:38.538801+0000","last_clean":"2023-11-15T02:36:38.538801+0000","last_became_active":"2023-11-15T02:36:38.530697+0000","last_became_peered":"2023-11-15T02:36:38.530697+0000","last_unstale":"2023-11-15T02:36:38.538801+0000","last_undegraded":"2023-11-15T02:36:38.538801+0000","last_fullsized":"2023-11-15T02:36:38.538801+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516639+0000","last_change":"2023-11-15T02:36:38.130764+0000","last_active":"2023-11-15T02:36:38.516639+0000","last_peered":"2023-11-15T02:36:38.516639+0000","last_clean":"2023-11-15T02:36:38.516639+0000","last_became_active":"2023-11-15T02:36:38.130097+0000","last_became_peered":"2023-11-15T02:36:38.130097+0000","last_unstale":"2023-11-15T02:36:38.516639+0000","last_undegraded":"2023-11-15T02:36:38.516639+0000","last_fullsized":"2023-11-15T02:36:38.516639+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.539169+0000","last_change":"2023-11-15T02:36:38.533914+0000","last_active":"2023-11-15T02:36:38.539169+0000","last_peered":"2023-11-15T02:36:38.539169+0000","last_clean":"2023-11-15T02:36:38.539169+0000","last_became_active":"2023-11-15T02:36:38.533649+0000","last_became_peered":"2023-11-15T02:36:38.533649+0000","last_unstale":"2023-11-15T02:36:38.539169+0000","last_undegraded":"2023-11-15T02:36:38.539169+0000","last_fullsized":"2023-11-15T02:36:38.539169+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.514860+0000","last_change":"2023-11-15T02:36:38.126960+0000","last_active":"2023-11-15T02:36:38.514860+0000","last_peered":"2023-11-15T02:36:38.514860+0000","last_clean":"2023-11-15T02:36:38.514860+0000","last_became_active":"2023-11-15T02:36:38.126672+0000","last_became_peered":"2023-11-15T02:36:38.126672+0000","last_unstale":"2023-11-15T02:36:38.514860+0000","last_undegraded":"2023-11-15T02:36:38.514860+0000","last_fullsized":"2023-11-15T02:36:38.514860+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.530275+0000","last_change":"2023-11-15T02:36:38.519709+0000","last_active":"2023-11-15T02:36:38.530275+0000","last_peered":"2023-11-15T02:36:38.530275+0000","last_clean":"2023-11-15T02:36:38.530275+0000","last_became_active":"2023-11-15T02:36:38.519250+0000","last_became_peered":"2023-11-15T02:36:38.519250+0000","last_unstale":"2023-11-15T02:36:38.530275+0000","last_undegraded":"2023-11-15T02:36:38.530275+0000","last_fullsized":"2023-11-15T02:36:38.530275+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"161'4","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.544291+0000","last_change":"2023-11-15T02:36:38.132303+0000","last_active":"2023-11-15T02:36:38.544291+0000","last_peered":"2023-11-15T02:36:38.544291+0000","last_clean":"2023-11-15T02:36:38.544291+0000","last_became_active":"2023-11-15T02:36:38.132035+0000","last_became_peered":"2023-11-15T02:36:38.132035+0000","last_unstale":"2023-11-15T02:36:38.544291+0000","last_undegraded":"2023-11-15T02:36:38.544291+0000","last_fullsized":"2023-11-15T02:36:38.544291+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533759+0000","last_change":"2023-11-15T02:36:38.529173+0000","last_active":"2023-11-15T02:36:38.533759+0000","last_peered":"2023-11-15T02:36:38.533759+0000","last_clean":"2023-11-15T02:36:38.533759+0000","last_became_active":"2023-11-15T02:36:38.528908+0000","last_became_peered":"2023-11-15T02:36:38.528908+0000","last_unstale":"2023-11-15T02:36:38.533759+0000","last_undegraded":"2023-11-15T02:36:38.533759+0000","last_fullsized":"2023-11-15T02:36:38.533759+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.33","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.530558+0000","last_change":"2023-11-15T02:36:38.132001+0000","last_active":"2023-11-15T02:36:38.530558+0000","last_peered":"2023-11-15T02:36:38.530558+0000","last_clean":"2023-11-15T02:36:38.530558+0000","last_became_active":"2023-11-15T02:36:38.131694+0000","last_became_peered":"2023-11-15T02:36:38.131694+0000","last_unstale":"2023-11-15T02:36:38.530558+0000","last_undegraded":"2023-11-15T02:36:38.530558+0000","last_fullsized":"2023-11-15T02:36:38.530558+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.527717+0000","last_change":"2023-11-15T02:36:38.519152+0000","last_active":"2023-11-15T02:36:38.527717+0000","last_peered":"2023-11-15T02:36:38.527717+0000","last_clean":"2023-11-15T02:36:38.527717+0000","last_became_active":"2023-11-15T02:36:38.518619+0000","last_became_peered":"2023-11-15T02:36:38.518619+0000","last_unstale":"2023-11-15T02:36:38.527717+0000","last_undegraded":"2023-11-15T02:36:38.527717+0000","last_fullsized":"2023-11-15T02:36:38.527717+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516038+0000","last_change":"2023-11-15T02:36:38.136850+0000","last_active":"2023-11-15T02:36:38.516038+0000","last_peered":"2023-11-15T02:36:38.516038+0000","last_clean":"2023-11-15T02:36:38.516038+0000","last_became_active":"2023-11-15T02:36:38.136545+0000","last_became_peered":"2023-11-15T02:36:38.136545+0000","last_unstale":"2023-11-15T02:36:38.516038+0000","last_undegraded":"2023-11-15T02:36:38.516038+0000","last_fullsized":"2023-11-15T02:36:38.516038+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532658+0000","last_change":"2023-11-15T02:36:38.531948+0000","last_active":"2023-11-15T02:36:38.532658+0000","last_peered":"2023-11-15T02:36:38.532658+0000","last_clean":"2023-11-15T02:36:38.532658+0000","last_became_active":"2023-11-15T02:36:38.531670+0000","last_became_peered":"2023-11-15T02:36:38.531670+0000","last_unstale":"2023-11-15T02:36:38.532658+0000","last_undegraded":"2023-11-15T02:36:38.532658+0000","last_fullsized":"2023-11-15T02:36:38.532658+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516834+0000","last_change":"2023-11-15T02:36:38.134607+0000","last_active":"2023-11-15T02:36:38.516834+0000","last_peered":"2023-11-15T02:36:38.516834+0000","last_clean":"2023-11-15T02:36:38.516834+0000","last_became_active":"2023-11-15T02:36:38.134316+0000","last_became_peered":"2023-11-15T02:36:38.134316+0000","last_unstale":"2023-11-15T02:36:38.516834+0000","last_undegraded":"2023-11-15T02:36:38.516834+0000","last_fullsized":"2023-11-15T02:36:38.516834+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533192+0000","last_change":"2023-11-15T02:36:38.526754+0000","last_active":"2023-11-15T02:36:38.533192+0000","last_peered":"2023-11-15T02:36:38.533192+0000","last_clean":"2023-11-15T02:36:38.533192+0000","last_became_active":"2023-11-15T02:36:38.526486+0000","last_became_peered":"2023-11-15T02:36:38.526486+0000","last_unstale":"2023-11-15T02:36:38.533192+0000","last_undegraded":"2023-11-15T02:36:38.533192+0000","last_fullsized":"2023-11-15T02:36:38.533192+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.30","version":"161'4","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.539091+0000","last_change":"2023-11-15T02:36:38.136456+0000","last_active":"2023-11-15T02:36:38.539091+0000","last_peered":"2023-11-15T02:36:38.539091+0000","last_clean":"2023-11-15T02:36:38.539091+0000","last_became_active":"2023-11-15T02:36:38.136170+0000","last_became_peered":"2023-11-15T02:36:38.136170+0000","last_unstale":"2023-11-15T02:36:38.539091+0000","last_undegraded":"2023-11-15T02:36:38.539091+0000","last_fullsized":"2023-11-15T02:36:38.539091+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532179+0000","last_change":"2023-11-15T02:36:38.526795+0000","last_active":"2023-11-15T02:36:38.532179+0000","last_peered":"2023-11-15T02:36:38.532179+0000","last_clean":"2023-11-15T02:36:38.532179+0000","last_became_active":"2023-11-15T02:36:38.526532+0000","last_became_peered":"2023-11-15T02:36:38.526532+0000","last_unstale":"2023-11-15T02:36:38.532179+0000","last_undegraded":"2023-11-15T02:36:38.532179+0000","last_fullsized":"2023-11-15T02:36:38.532179+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.521994+0000","last_change":"2023-11-15T02:36:38.132091+0000","last_active":"2023-11-15T02:36:38.521994+0000","last_peered":"2023-11-15T02:36:38.521994+0000","last_clean":"2023-11-15T02:36:38.521994+0000","last_became_active":"2023-11-15T02:36:38.131693+0000","last_became_peered":"2023-11-15T02:36:38.131693+0000","last_unstale":"2023-11-15T02:36:38.521994+0000","last_undegraded":"2023-11-15T02:36:38.521994+0000","last_fullsized":"2023-11-15T02:36:38.521994+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.529663+0000","last_change":"2023-11-15T02:36:38.525912+0000","last_active":"2023-11-15T02:36:38.529663+0000","last_peered":"2023-11-15T02:36:38.529663+0000","last_clean":"2023-11-15T02:36:38.529663+0000","last_became_active":"2023-11-15T02:36:38.525617+0000","last_became_peered":"2023-11-15T02:36:38.525617+0000","last_unstale":"2023-11-15T02:36:38.529663+0000","last_undegraded":"2023-11-15T02:36:38.529663+0000","last_fullsized":"2023-11-15T02:36:38.529663+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.512251+0000","last_change":"2023-11-15T02:36:38.131436+0000","last_active":"2023-11-15T02:36:38.512251+0000","last_peered":"2023-11-15T02:36:38.512251+0000","last_clean":"2023-11-15T02:36:38.512251+0000","last_became_active":"2023-11-15T02:36:38.130761+0000","last_became_peered":"2023-11-15T02:36:38.130761+0000","last_unstale":"2023-11-15T02:36:38.512251+0000","last_undegraded":"2023-11-15T02:36:38.512251+0000","last_fullsized":"2023-11-15T02:36:38.512251+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.527383+0000","last_change":"2023-11-15T02:36:38.522506+0000","last_active":"2023-11-15T02:36:38.527383+0000","last_peered":"2023-11-15T02:36:38.527383+0000","last_clean":"2023-11-15T02:36:38.527383+0000","last_became_active":"2023-11-15T02:36:38.522212+0000","last_became_peered":"2023-11-15T02:36:38.522212+0000","last_unstale":"2023-11-15T02:36:38.527383+0000","last_undegraded":"2023-11-15T02:36:38.527383+0000","last_fullsized":"2023-11-15T02:36:38.527383+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2d","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533804+0000","last_change":"2023-11-15T02:36:38.129495+0000","last_active":"2023-11-15T02:36:38.533804+0000","last_peered":"2023-11-15T02:36:38.533804+0000","last_clean":"2023-11-15T02:36:38.533804+0000","last_became_active":"2023-11-15T02:36:38.129202+0000","last_became_peered":"2023-11-15T02:36:38.129202+0000","last_unstale":"2023-11-15T02:36:38.533804+0000","last_undegraded":"2023-11-15T02:36:38.533804+0000","last_fullsized":"2023-11-15T02:36:38.533804+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.528085+0000","last_change":"2023-11-15T02:36:38.520750+0000","last_active":"2023-11-15T02:36:38.528085+0000","last_peered":"2023-11-15T02:36:38.528085+0000","last_clean":"2023-11-15T02:36:38.528085+0000","last_became_active":"2023-11-15T02:36:38.520447+0000","last_became_peered":"2023-11-15T02:36:38.520447+0000","last_unstale":"2023-11-15T02:36:38.528085+0000","last_undegraded":"2023-11-15T02:36:38.528085+0000","last_fullsized":"2023-11-15T02:36:38.528085+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.510001+0000","last_change":"2023-11-15T02:36:38.131235+0000","last_active":"2023-11-15T02:36:38.510001+0000","last_peered":"2023-11-15T02:36:38.510001+0000","last_clean":"2023-11-15T02:36:38.510001+0000","last_became_active":"2023-11-15T02:36:38.130841+0000","last_became_peered":"2023-11-15T02:36:38.130841+0000","last_unstale":"2023-11-15T02:36:38.510001+0000","last_undegraded":"2023-11-15T02:36:38.510001+0000","last_fullsized":"2023-11-15T02:36:38.510001+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536316+0000","last_change":"2023-11-15T02:36:38.530116+0000","last_active":"2023-11-15T02:36:38.536316+0000","last_peered":"2023-11-15T02:36:38.536316+0000","last_clean":"2023-11-15T02:36:38.536316+0000","last_became_active":"2023-11-15T02:36:38.529845+0000","last_became_peered":"2023-11-15T02:36:38.529845+0000","last_unstale":"2023-11-15T02:36:38.536316+0000","last_undegraded":"2023-11-15T02:36:38.536316+0000","last_fullsized":"2023-11-15T02:36:38.536316+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533055+0000","last_change":"2023-11-15T02:36:38.136834+0000","last_active":"2023-11-15T02:36:38.533055+0000","last_peered":"2023-11-15T02:36:38.533055+0000","last_clean":"2023-11-15T02:36:38.533055+0000","last_became_active":"2023-11-15T02:36:38.136494+0000","last_became_peered":"2023-11-15T02:36:38.136494+0000","last_unstale":"2023-11-15T02:36:38.533055+0000","last_undegraded":"2023-11-15T02:36:38.533055+0000","last_fullsized":"2023-11-15T02:36:38.533055+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.535923+0000","last_change":"2023-11-15T02:36:38.532581+0000","last_active":"2023-11-15T02:36:38.535923+0000","last_peered":"2023-11-15T02:36:38.535923+0000","last_clean":"2023-11-15T02:36:38.535923+0000","last_became_active":"2023-11-15T02:36:38.532275+0000","last_became_peered":"2023-11-15T02:36:38.532275+0000","last_unstale":"2023-11-15T02:36:38.535923+0000","last_undegraded":"2023-11-15T02:36:38.535923+0000","last_fullsized":"2023-11-15T02:36:38.535923+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.514757+0000","last_change":"2023-11-15T02:36:38.126854+0000","last_active":"2023-11-15T02:36:38.514757+0000","last_peered":"2023-11-15T02:36:38.514757+0000","last_clean":"2023-11-15T02:36:38.514757+0000","last_became_active":"2023-11-15T02:36:38.126560+0000","last_became_peered":"2023-11-15T02:36:38.126560+0000","last_unstale":"2023-11-15T02:36:38.514757+0000","last_undegraded":"2023-11-15T02:36:38.514757+0000","last_fullsized":"2023-11-15T02:36:38.514757+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536533+0000","last_change":"2023-11-15T02:36:38.535888+0000","last_active":"2023-11-15T02:36:38.536533+0000","last_peered":"2023-11-15T02:36:38.536533+0000","last_clean":"2023-11-15T02:36:38.536533+0000","last_became_active":"2023-11-15T02:36:38.534234+0000","last_became_peered":"2023-11-15T02:36:38.534234+0000","last_unstale":"2023-11-15T02:36:38.536533+0000","last_undegraded":"2023-11-15T02:36:38.536533+0000","last_fullsized":"2023-11-15T02:36:38.536533+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.512665+0000","last_change":"2023-11-15T02:36:38.133098+0000","last_active":"2023-11-15T02:36:38.512665+0000","last_peered":"2023-11-15T02:36:38.512665+0000","last_clean":"2023-11-15T02:36:38.512665+0000","last_became_active":"2023-11-15T02:36:38.132824+0000","last_became_peered":"2023-11-15T02:36:38.132824+0000","last_unstale":"2023-11-15T02:36:38.512665+0000","last_undegraded":"2023-11-15T02:36:38.512665+0000","last_fullsized":"2023-11-15T02:36:38.512665+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533214+0000","last_change":"2023-11-15T02:36:38.529342+0000","last_active":"2023-11-15T02:36:38.533214+0000","last_peered":"2023-11-15T02:36:38.533214+0000","last_clean":"2023-11-15T02:36:38.533214+0000","last_became_active":"2023-11-15T02:36:38.529061+0000","last_became_peered":"2023-11-15T02:36:38.529061+0000","last_unstale":"2023-11-15T02:36:38.533214+0000","last_undegraded":"2023-11-15T02:36:38.533214+0000","last_fullsized":"2023-11-15T02:36:38.533214+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.514634+0000","last_change":"2023-11-15T02:36:38.132009+0000","last_active":"2023-11-15T02:36:38.514634+0000","last_peered":"2023-11-15T02:36:38.514634+0000","last_clean":"2023-11-15T02:36:38.514634+0000","last_became_active":"2023-11-15T02:36:38.131713+0000","last_became_peered":"2023-11-15T02:36:38.131713+0000","last_unstale":"2023-11-15T02:36:38.514634+0000","last_undegraded":"2023-11-15T02:36:38.514634+0000","last_fullsized":"2023-11-15T02:36:38.514634+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.530845+0000","last_change":"2023-11-15T02:36:38.525423+0000","last_active":"2023-11-15T02:36:38.530845+0000","last_peered":"2023-11-15T02:36:38.530845+0000","last_clean":"2023-11-15T02:36:38.530845+0000","last_became_active":"2023-11-15T02:36:38.525166+0000","last_became_peered":"2023-11-15T02:36:38.525166+0000","last_unstale":"2023-11-15T02:36:38.530845+0000","last_undegraded":"2023-11-15T02:36:38.530845+0000","last_fullsized":"2023-11-15T02:36:38.530845+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.517272+0000","last_change":"2023-11-15T02:36:38.136600+0000","last_active":"2023-11-15T02:36:38.517272+0000","last_peered":"2023-11-15T02:36:38.517272+0000","last_clean":"2023-11-15T02:36:38.517272+0000","last_became_active":"2023-11-15T02:36:38.135938+0000","last_became_peered":"2023-11-15T02:36:38.135938+0000","last_unstale":"2023-11-15T02:36:38.517272+0000","last_undegraded":"2023-11-15T02:36:38.517272+0000","last_fullsized":"2023-11-15T02:36:38.517272+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.535660+0000","last_change":"2023-11-15T02:36:38.530519+0000","last_active":"2023-11-15T02:36:38.535660+0000","last_peered":"2023-11-15T02:36:38.535660+0000","last_clean":"2023-11-15T02:36:38.535660+0000","last_became_active":"2023-11-15T02:36:38.530210+0000","last_became_peered":"2023-11-15T02:36:38.530210+0000","last_unstale":"2023-11-15T02:36:38.535660+0000","last_undegraded":"2023-11-15T02:36:38.535660+0000","last_fullsized":"2023-11-15T02:36:38.535660+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.512348+0000","last_change":"2023-11-15T02:36:38.137713+0000","last_active":"2023-11-15T02:36:38.512348+0000","last_peered":"2023-11-15T02:36:38.512348+0000","last_clean":"2023-11-15T02:36:38.512348+0000","last_became_active":"2023-11-15T02:36:38.137384+0000","last_became_peered":"2023-11-15T02:36:38.137384+0000","last_unstale":"2023-11-15T02:36:38.512348+0000","last_undegraded":"2023-11-15T02:36:38.512348+0000","last_fullsized":"2023-11-15T02:36:38.512348+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537346+0000","last_change":"2023-11-15T02:36:38.526945+0000","last_active":"2023-11-15T02:36:38.537346+0000","last_peered":"2023-11-15T02:36:38.537346+0000","last_clean":"2023-11-15T02:36:38.537346+0000","last_became_active":"2023-11-15T02:36:38.526678+0000","last_became_peered":"2023-11-15T02:36:38.526678+0000","last_unstale":"2023-11-15T02:36:38.537346+0000","last_undegraded":"2023-11-15T02:36:38.537346+0000","last_fullsized":"2023-11-15T02:36:38.537346+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.517505+0000","last_change":"2023-11-15T02:36:38.131914+0000","last_active":"2023-11-15T02:36:38.517505+0000","last_peered":"2023-11-15T02:36:38.517505+0000","last_clean":"2023-11-15T02:36:38.517505+0000","last_became_active":"2023-11-15T02:36:38.131633+0000","last_became_peered":"2023-11-15T02:36:38.131633+0000","last_unstale":"2023-11-15T02:36:38.517505+0000","last_undegraded":"2023-11-15T02:36:38.517505+0000","last_fullsized":"2023-11-15T02:36:38.517505+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536056+0000","last_change":"2023-11-15T02:36:38.520080+0000","last_active":"2023-11-15T02:36:38.536056+0000","last_peered":"2023-11-15T02:36:38.536056+0000","last_clean":"2023-11-15T02:36:38.536056+0000","last_became_active":"2023-11-15T02:36:38.519775+0000","last_became_peered":"2023-11-15T02:36:38.519775+0000","last_unstale":"2023-11-15T02:36:38.536056+0000","last_undegraded":"2023-11-15T02:36:38.536056+0000","last_fullsized":"2023-11-15T02:36:38.536056+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.510844+0000","last_change":"2023-11-15T02:36:38.133259+0000","last_active":"2023-11-15T02:36:38.510844+0000","last_peered":"2023-11-15T02:36:38.510844+0000","last_clean":"2023-11-15T02:36:38.510844+0000","last_became_active":"2023-11-15T02:36:38.132960+0000","last_became_peered":"2023-11-15T02:36:38.132960+0000","last_unstale":"2023-11-15T02:36:38.510844+0000","last_undegraded":"2023-11-15T02:36:38.510844+0000","last_fullsized":"2023-11-15T02:36:38.510844+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532484+0000","last_change":"2023-11-15T02:36:38.531903+0000","last_active":"2023-11-15T02:36:38.532484+0000","last_peered":"2023-11-15T02:36:38.532484+0000","last_clean":"2023-11-15T02:36:38.532484+0000","last_became_active":"2023-11-15T02:36:38.531620+0000","last_became_peered":"2023-11-15T02:36:38.531620+0000","last_unstale":"2023-11-15T02:36:38.532484+0000","last_undegraded":"2023-11-15T02:36:38.532484+0000","last_fullsized":"2023-11-15T02:36:38.532484+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.514263+0000","last_change":"2023-11-15T02:36:38.135315+0000","last_active":"2023-11-15T02:36:38.514263+0000","last_peered":"2023-11-15T02:36:38.514263+0000","last_clean":"2023-11-15T02:36:38.514263+0000","last_became_active":"2023-11-15T02:36:38.135011+0000","last_became_peered":"2023-11-15T02:36:38.135011+0000","last_unstale":"2023-11-15T02:36:38.514263+0000","last_undegraded":"2023-11-15T02:36:38.514263+0000","last_fullsized":"2023-11-15T02:36:38.514263+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533851+0000","last_change":"2023-11-15T02:36:38.528473+0000","last_active":"2023-11-15T02:36:38.533851+0000","last_peered":"2023-11-15T02:36:38.533851+0000","last_clean":"2023-11-15T02:36:38.533851+0000","last_became_active":"2023-11-15T02:36:38.528172+0000","last_became_peered":"2023-11-15T02:36:38.528172+0000","last_unstale":"2023-11-15T02:36:38.533851+0000","last_undegraded":"2023-11-15T02:36:38.533851+0000","last_fullsized":"2023-11-15T02:36:38.533851+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.515490+0000","last_change":"2023-11-15T02:36:38.135831+0000","last_active":"2023-11-15T02:36:38.515490+0000","last_peered":"2023-11-15T02:36:38.515490+0000","last_clean":"2023-11-15T02:36:38.515490+0000","last_became_active":"2023-11-15T02:36:38.135454+0000","last_became_peered":"2023-11-15T02:36:38.135454+0000","last_unstale":"2023-11-15T02:36:38.515490+0000","last_undegraded":"2023-11-15T02:36:38.515490+0000","last_fullsized":"2023-11-15T02:36:38.515490+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536671+0000","last_change":"2023-11-15T02:36:38.526590+0000","last_active":"2023-11-15T02:36:38.536671+0000","last_peered":"2023-11-15T02:36:38.536671+0000","last_clean":"2023-11-15T02:36:38.536671+0000","last_became_active":"2023-11-15T02:36:38.526286+0000","last_became_peered":"2023-11-15T02:36:38.526286+0000","last_unstale":"2023-11-15T02:36:38.536671+0000","last_undegraded":"2023-11-15T02:36:38.536671+0000","last_fullsized":"2023-11-15T02:36:38.536671+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.526677+0000","last_change":"2023-11-15T02:36:38.137658+0000","last_active":"2023-11-15T02:36:38.526677+0000","last_peered":"2023-11-15T02:36:38.526677+0000","last_clean":"2023-11-15T02:36:38.526677+0000","last_became_active":"2023-11-15T02:36:38.137336+0000","last_became_peered":"2023-11-15T02:36:38.137336+0000","last_unstale":"2023-11-15T02:36:38.526677+0000","last_undegraded":"2023-11-15T02:36:38.526677+0000","last_fullsized":"2023-11-15T02:36:38.526677+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536918+0000","last_change":"2023-11-15T02:36:38.532975+0000","last_active":"2023-11-15T02:36:38.536918+0000","last_peered":"2023-11-15T02:36:38.536918+0000","last_clean":"2023-11-15T02:36:38.536918+0000","last_became_active":"2023-11-15T02:36:38.532570+0000","last_became_peered":"2023-11-15T02:36:38.532570+0000","last_unstale":"2023-11-15T02:36:38.536918+0000","last_undegraded":"2023-11-15T02:36:38.536918+0000","last_fullsized":"2023-11-15T02:36:38.536918+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.522542+0000","last_change":"2023-11-15T02:36:38.129261+0000","last_active":"2023-11-15T02:36:38.522542+0000","last_peered":"2023-11-15T02:36:38.522542+0000","last_clean":"2023-11-15T02:36:38.522542+0000","last_became_active":"2023-11-15T02:36:38.128989+0000","last_became_peered":"2023-11-15T02:36:38.128989+0000","last_unstale":"2023-11-15T02:36:38.522542+0000","last_undegraded":"2023-11-15T02:36:38.522542+0000","last_fullsized":"2023-11-15T02:36:38.522542+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.535862+0000","last_change":"2023-11-15T02:36:38.530551+0000","last_active":"2023-11-15T02:36:38.535862+0000","last_peered":"2023-11-15T02:36:38.535862+0000","last_clean":"2023-11-15T02:36:38.535862+0000","last_became_active":"2023-11-15T02:36:38.530265+0000","last_became_peered":"2023-11-15T02:36:38.530265+0000","last_unstale":"2023-11-15T02:36:38.535862+0000","last_undegraded":"2023-11-15T02:36:38.535862+0000","last_fullsized":"2023-11-15T02:36:38.535862+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536406+0000","last_change":"2023-11-15T02:36:38.136385+0000","last_active":"2023-11-15T02:36:38.536406+0000","last_peered":"2023-11-15T02:36:38.536406+0000","last_clean":"2023-11-15T02:36:38.536406+0000","last_became_active":"2023-11-15T02:36:38.136092+0000","last_became_peered":"2023-11-15T02:36:38.136092+0000","last_unstale":"2023-11-15T02:36:38.536406+0000","last_undegraded":"2023-11-15T02:36:38.536406+0000","last_fullsized":"2023-11-15T02:36:38.536406+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533595+0000","last_change":"2023-11-15T02:36:38.529091+0000","last_active":"2023-11-15T02:36:38.533595+0000","last_peered":"2023-11-15T02:36:38.533595+0000","last_clean":"2023-11-15T02:36:38.533595+0000","last_became_active":"2023-11-15T02:36:38.528825+0000","last_became_peered":"2023-11-15T02:36:38.528825+0000","last_unstale":"2023-11-15T02:36:38.533595+0000","last_undegraded":"2023-11-15T02:36:38.533595+0000","last_fullsized":"2023-11-15T02:36:38.533595+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536042+0000","last_change":"2023-11-15T02:36:38.128076+0000","last_active":"2023-11-15T02:36:38.536042+0000","last_peered":"2023-11-15T02:36:38.536042+0000","last_clean":"2023-11-15T02:36:38.536042+0000","last_became_active":"2023-11-15T02:36:38.127571+0000","last_became_peered":"2023-11-15T02:36:38.127571+0000","last_unstale":"2023-11-15T02:36:38.536042+0000","last_undegraded":"2023-11-15T02:36:38.536042+0000","last_fullsized":"2023-11-15T02:36:38.536042+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.535645+0000","last_change":"2023-11-15T02:36:38.530103+0000","last_active":"2023-11-15T02:36:38.535645+0000","last_peered":"2023-11-15T02:36:38.535645+0000","last_clean":"2023-11-15T02:36:38.535645+0000","last_became_active":"2023-11-15T02:36:38.529751+0000","last_became_peered":"2023-11-15T02:36:38.529751+0000","last_unstale":"2023-11-15T02:36:38.535645+0000","last_undegraded":"2023-11-15T02:36:38.535645+0000","last_fullsized":"2023-11-15T02:36:38.535645+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"161'2","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.531631+0000","last_change":"2023-11-15T02:36:38.137782+0000","last_active":"2023-11-15T02:36:38.531631+0000","last_peered":"2023-11-15T02:36:38.531631+0000","last_clean":"2023-11-15T02:36:38.531631+0000","last_became_active":"2023-11-15T02:36:38.135905+0000","last_became_peered":"2023-11-15T02:36:38.135905+0000","last_unstale":"2023-11-15T02:36:38.531631+0000","last_undegraded":"2023-11-15T02:36:38.531631+0000","last_fullsized":"2023-11-15T02:36:38.531631+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.539081+0000","last_change":"2023-11-15T02:36:38.532286+0000","last_active":"2023-11-15T02:36:38.539081+0000","last_peered":"2023-11-15T02:36:38.539081+0000","last_clean":"2023-11-15T02:36:38.539081+0000","last_became_active":"2023-11-15T02:36:38.530211+0000","last_became_peered":"2023-11-15T02:36:38.530211+0000","last_unstale":"2023-11-15T02:36:38.539081+0000","last_undegraded":"2023-11-15T02:36:38.539081+0000","last_fullsized":"2023-11-15T02:36:38.539081+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.519838+0000","last_change":"2023-11-15T02:36:38.137504+0000","last_active":"2023-11-15T02:36:38.519838+0000","last_peered":"2023-11-15T02:36:38.519838+0000","last_clean":"2023-11-15T02:36:38.519838+0000","last_became_active":"2023-11-15T02:36:38.137296+0000","last_became_peered":"2023-11-15T02:36:38.137296+0000","last_unstale":"2023-11-15T02:36:38.519838+0000","last_undegraded":"2023-11-15T02:36:38.519838+0000","last_fullsized":"2023-11-15T02:36:38.519838+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532929+0000","last_change":"2023-11-15T02:36:38.526036+0000","last_active":"2023-11-15T02:36:38.532929+0000","last_peered":"2023-11-15T02:36:38.532929+0000","last_clean":"2023-11-15T02:36:38.532929+0000","last_became_active":"2023-11-15T02:36:38.525740+0000","last_became_peered":"2023-11-15T02:36:38.525740+0000","last_unstale":"2023-11-15T02:36:38.532929+0000","last_undegraded":"2023-11-15T02:36:38.532929+0000","last_fullsized":"2023-11-15T02:36:38.532929+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.520565+0000","last_change":"2023-11-15T02:36:38.131960+0000","last_active":"2023-11-15T02:36:38.520565+0000","last_peered":"2023-11-15T02:36:38.520565+0000","last_clean":"2023-11-15T02:36:38.520565+0000","last_became_active":"2023-11-15T02:36:38.131641+0000","last_became_peered":"2023-11-15T02:36:38.131641+0000","last_unstale":"2023-11-15T02:36:38.520565+0000","last_undegraded":"2023-11-15T02:36:38.520565+0000","last_fullsized":"2023-11-15T02:36:38.520565+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.535933+0000","last_change":"2023-11-15T02:36:38.531784+0000","last_active":"2023-11-15T02:36:38.535933+0000","last_peered":"2023-11-15T02:36:38.535933+0000","last_clean":"2023-11-15T02:36:38.535933+0000","last_became_active":"2023-11-15T02:36:38.531506+0000","last_became_peered":"2023-11-15T02:36:38.531506+0000","last_unstale":"2023-11-15T02:36:38.535933+0000","last_undegraded":"2023-11-15T02:36:38.535933+0000","last_fullsized":"2023-11-15T02:36:38.535933+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.509565+0000","last_change":"2023-11-15T02:36:38.128521+0000","last_active":"2023-11-15T02:36:38.509565+0000","last_peered":"2023-11-15T02:36:38.509565+0000","last_clean":"2023-11-15T02:36:38.509565+0000","last_became_active":"2023-11-15T02:36:38.127970+0000","last_became_peered":"2023-11-15T02:36:38.127970+0000","last_unstale":"2023-11-15T02:36:38.509565+0000","last_undegraded":"2023-11-15T02:36:38.509565+0000","last_fullsized":"2023-11-15T02:36:38.509565+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536394+0000","last_change":"2023-11-15T02:36:38.531098+0000","last_active":"2023-11-15T02:36:38.536394+0000","last_peered":"2023-11-15T02:36:38.536394+0000","last_clean":"2023-11-15T02:36:38.536394+0000","last_became_active":"2023-11-15T02:36:38.530793+0000","last_became_peered":"2023-11-15T02:36:38.530793+0000","last_unstale":"2023-11-15T02:36:38.536394+0000","last_undegraded":"2023-11-15T02:36:38.536394+0000","last_fullsized":"2023-11-15T02:36:38.536394+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516300+0000","last_change":"2023-11-15T02:36:38.133056+0000","last_active":"2023-11-15T02:36:38.516300+0000","last_peered":"2023-11-15T02:36:38.516300+0000","last_clean":"2023-11-15T02:36:38.516300+0000","last_became_active":"2023-11-15T02:36:38.132695+0000","last_became_peered":"2023-11-15T02:36:38.132695+0000","last_unstale":"2023-11-15T02:36:38.516300+0000","last_undegraded":"2023-11-15T02:36:38.516300+0000","last_fullsized":"2023-11-15T02:36:38.516300+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537357+0000","last_change":"2023-11-15T02:36:38.534476+0000","last_active":"2023-11-15T02:36:38.537357+0000","last_peered":"2023-11-15T02:36:38.537357+0000","last_clean":"2023-11-15T02:36:38.537357+0000","last_became_active":"2023-11-15T02:36:38.534239+0000","last_became_peered":"2023-11-15T02:36:38.534239+0000","last_unstale":"2023-11-15T02:36:38.537357+0000","last_undegraded":"2023-11-15T02:36:38.537357+0000","last_fullsized":"2023-11-15T02:36:38.537357+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.512011+0000","last_change":"2023-11-15T02:36:38.134553+0000","last_active":"2023-11-15T02:36:38.512011+0000","last_peered":"2023-11-15T02:36:38.512011+0000","last_clean":"2023-11-15T02:36:38.512011+0000","last_became_active":"2023-11-15T02:36:38.133755+0000","last_became_peered":"2023-11-15T02:36:38.133755+0000","last_unstale":"2023-11-15T02:36:38.512011+0000","last_undegraded":"2023-11-15T02:36:38.512011+0000","last_fullsized":"2023-11-15T02:36:38.512011+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.544155+0000","last_change":"2023-11-15T02:36:38.536457+0000","last_active":"2023-11-15T02:36:38.544155+0000","last_peered":"2023-11-15T02:36:38.544155+0000","last_clean":"2023-11-15T02:36:38.544155+0000","last_became_active":"2023-11-15T02:36:38.536087+0000","last_became_peered":"2023-11-15T02:36:38.536087+0000","last_unstale":"2023-11-15T02:36:38.544155+0000","last_undegraded":"2023-11-15T02:36:38.544155+0000","last_fullsized":"2023-11-15T02:36:38.544155+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.531672+0000","last_change":"2023-11-15T02:36:38.137398+0000","last_active":"2023-11-15T02:36:38.531672+0000","last_peered":"2023-11-15T02:36:38.531672+0000","last_clean":"2023-11-15T02:36:38.531672+0000","last_became_active":"2023-11-15T02:36:38.136941+0000","last_became_peered":"2023-11-15T02:36:38.136941+0000","last_unstale":"2023-11-15T02:36:38.531672+0000","last_undegraded":"2023-11-15T02:36:38.531672+0000","last_fullsized":"2023-11-15T02:36:38.531672+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533094+0000","last_change":"2023-11-15T02:36:38.528802+0000","last_active":"2023-11-15T02:36:38.533094+0000","last_peered":"2023-11-15T02:36:38.533094+0000","last_clean":"2023-11-15T02:36:38.533094+0000","last_became_active":"2023-11-15T02:36:38.528492+0000","last_became_peered":"2023-11-15T02:36:38.528492+0000","last_unstale":"2023-11-15T02:36:38.533094+0000","last_undegraded":"2023-11-15T02:36:38.533094+0000","last_fullsized":"2023-11-15T02:36:38.533094+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"161'2","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536369+0000","last_change":"2023-11-15T02:36:38.136200+0000","last_active":"2023-11-15T02:36:38.536369+0000","last_peered":"2023-11-15T02:36:38.536369+0000","last_clean":"2023-11-15T02:36:38.536369+0000","last_became_active":"2023-11-15T02:36:38.135767+0000","last_became_peered":"2023-11-15T02:36:38.135767+0000","last_unstale":"2023-11-15T02:36:38.536369+0000","last_undegraded":"2023-11-15T02:36:38.536369+0000","last_fullsized":"2023-11-15T02:36:38.536369+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537123+0000","last_change":"2023-11-15T02:36:38.533855+0000","last_active":"2023-11-15T02:36:38.537123+0000","last_peered":"2023-11-15T02:36:38.537123+0000","last_clean":"2023-11-15T02:36:38.537123+0000","last_became_active":"2023-11-15T02:36:38.533542+0000","last_became_peered":"2023-11-15T02:36:38.533542+0000","last_unstale":"2023-11-15T02:36:38.537123+0000","last_undegraded":"2023-11-15T02:36:38.537123+0000","last_fullsized":"2023-11-15T02:36:38.537123+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.518308+0000","last_change":"2023-11-15T02:36:38.133001+0000","last_active":"2023-11-15T02:36:38.518308+0000","last_peered":"2023-11-15T02:36:38.518308+0000","last_clean":"2023-11-15T02:36:38.518308+0000","last_became_active":"2023-11-15T02:36:38.132583+0000","last_became_peered":"2023-11-15T02:36:38.132583+0000","last_unstale":"2023-11-15T02:36:38.518308+0000","last_undegraded":"2023-11-15T02:36:38.518308+0000","last_fullsized":"2023-11-15T02:36:38.518308+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537562+0000","last_change":"2023-11-15T02:36:38.537049+0000","last_active":"2023-11-15T02:36:38.537562+0000","last_peered":"2023-11-15T02:36:38.537562+0000","last_clean":"2023-11-15T02:36:38.537562+0000","last_became_active":"2023-11-15T02:36:38.536762+0000","last_became_peered":"2023-11-15T02:36:38.536762+0000","last_unstale":"2023-11-15T02:36:38.537562+0000","last_undegraded":"2023-11-15T02:36:38.537562+0000","last_fullsized":"2023-11-15T02:36:38.537562+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.510069+0000","last_change":"2023-11-15T02:36:38.137424+0000","last_active":"2023-11-15T02:36:38.510069+0000","last_peered":"2023-11-15T02:36:38.510069+0000","last_clean":"2023-11-15T02:36:38.510069+0000","last_became_active":"2023-11-15T02:36:38.136582+0000","last_became_peered":"2023-11-15T02:36:38.136582+0000","last_unstale":"2023-11-15T02:36:38.510069+0000","last_undegraded":"2023-11-15T02:36:38.510069+0000","last_fullsized":"2023-11-15T02:36:38.510069+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.528265+0000","last_change":"2023-11-15T02:36:38.526069+0000","last_active":"2023-11-15T02:36:38.528265+0000","last_peered":"2023-11-15T02:36:38.528265+0000","last_clean":"2023-11-15T02:36:38.528265+0000","last_became_active":"2023-11-15T02:36:38.525831+0000","last_became_peered":"2023-11-15T02:36:38.525831+0000","last_unstale":"2023-11-15T02:36:38.528265+0000","last_undegraded":"2023-11-15T02:36:38.528265+0000","last_fullsized":"2023-11-15T02:36:38.528265+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537946+0000","last_change":"2023-11-15T02:36:38.128304+0000","last_active":"2023-11-15T02:36:38.537946+0000","last_peered":"2023-11-15T02:36:38.537946+0000","last_clean":"2023-11-15T02:36:38.537946+0000","last_became_active":"2023-11-15T02:36:38.128009+0000","last_became_peered":"2023-11-15T02:36:38.128009+0000","last_unstale":"2023-11-15T02:36:38.537946+0000","last_undegraded":"2023-11-15T02:36:38.537946+0000","last_fullsized":"2023-11-15T02:36:38.537946+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.538754+0000","last_change":"2023-11-15T02:36:38.530739+0000","last_active":"2023-11-15T02:36:38.538754+0000","last_peered":"2023-11-15T02:36:38.538754+0000","last_clean":"2023-11-15T02:36:38.538754+0000","last_became_active":"2023-11-15T02:36:38.530229+0000","last_became_peered":"2023-11-15T02:36:38.530229+0000","last_unstale":"2023-11-15T02:36:38.538754+0000","last_undegraded":"2023-11-15T02:36:38.538754+0000","last_fullsized":"2023-11-15T02:36:38.538754+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.515585+0000","last_change":"2023-11-15T02:36:38.129911+0000","last_active":"2023-11-15T02:36:38.515585+0000","last_peered":"2023-11-15T02:36:38.515585+0000","last_clean":"2023-11-15T02:36:38.515585+0000","last_became_active":"2023-11-15T02:36:38.129420+0000","last_became_peered":"2023-11-15T02:36:38.129420+0000","last_unstale":"2023-11-15T02:36:38.515585+0000","last_undegraded":"2023-11-15T02:36:38.515585+0000","last_fullsized":"2023-11-15T02:36:38.515585+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.527941+0000","last_change":"2023-11-15T02:36:38.519921+0000","last_active":"2023-11-15T02:36:38.527941+0000","last_peered":"2023-11-15T02:36:38.527941+0000","last_clean":"2023-11-15T02:36:38.527941+0000","last_became_active":"2023-11-15T02:36:38.519647+0000","last_became_peered":"2023-11-15T02:36:38.519647+0000","last_unstale":"2023-11-15T02:36:38.527941+0000","last_undegraded":"2023-11-15T02:36:38.527941+0000","last_fullsized":"2023-11-15T02:36:38.527941+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.521624+0000","last_change":"2023-11-15T02:36:38.137554+0000","last_active":"2023-11-15T02:36:38.521624+0000","last_peered":"2023-11-15T02:36:38.521624+0000","last_clean":"2023-11-15T02:36:38.521624+0000","last_became_active":"2023-11-15T02:36:38.137261+0000","last_became_peered":"2023-11-15T02:36:38.137261+0000","last_unstale":"2023-11-15T02:36:38.521624+0000","last_undegraded":"2023-11-15T02:36:38.521624+0000","last_fullsized":"2023-11-15T02:36:38.521624+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.527655+0000","last_change":"2023-11-15T02:36:38.518417+0000","last_active":"2023-11-15T02:36:38.527655+0000","last_peered":"2023-11-15T02:36:38.527655+0000","last_clean":"2023-11-15T02:36:38.527655+0000","last_became_active":"2023-11-15T02:36:38.518121+0000","last_became_peered":"2023-11-15T02:36:38.518121+0000","last_unstale":"2023-11-15T02:36:38.527655+0000","last_undegraded":"2023-11-15T02:36:38.527655+0000","last_fullsized":"2023-11-15T02:36:38.527655+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.514807+0000","last_change":"2023-11-15T02:36:38.133930+0000","last_active":"2023-11-15T02:36:38.514807+0000","last_peered":"2023-11-15T02:36:38.514807+0000","last_clean":"2023-11-15T02:36:38.514807+0000","last_became_active":"2023-11-15T02:36:38.133459+0000","last_became_peered":"2023-11-15T02:36:38.133459+0000","last_unstale":"2023-11-15T02:36:38.514807+0000","last_undegraded":"2023-11-15T02:36:38.514807+0000","last_fullsized":"2023-11-15T02:36:38.514807+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536976+0000","last_change":"2023-11-15T02:36:38.534645+0000","last_active":"2023-11-15T02:36:38.536976+0000","last_peered":"2023-11-15T02:36:38.536976+0000","last_clean":"2023-11-15T02:36:38.536976+0000","last_became_active":"2023-11-15T02:36:38.531118+0000","last_became_peered":"2023-11-15T02:36:38.531118+0000","last_unstale":"2023-11-15T02:36:38.536976+0000","last_undegraded":"2023-11-15T02:36:38.536976+0000","last_fullsized":"2023-11-15T02:36:38.536976+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"161'2","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537578+0000","last_change":"2023-11-15T02:36:38.132673+0000","last_active":"2023-11-15T02:36:38.537578+0000","last_peered":"2023-11-15T02:36:38.537578+0000","last_clean":"2023-11-15T02:36:38.537578+0000","last_became_active":"2023-11-15T02:36:38.132093+0000","last_became_peered":"2023-11-15T02:36:38.132093+0000","last_unstale":"2023-11-15T02:36:38.537578+0000","last_undegraded":"2023-11-15T02:36:38.537578+0000","last_fullsized":"2023-11-15T02:36:38.537578+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.535968+0000","last_change":"2023-11-15T02:36:38.519616+0000","last_active":"2023-11-15T02:36:38.535968+0000","last_peered":"2023-11-15T02:36:38.535968+0000","last_clean":"2023-11-15T02:36:38.535968+0000","last_became_active":"2023-11-15T02:36:38.519278+0000","last_became_peered":"2023-11-15T02:36:38.519278+0000","last_unstale":"2023-11-15T02:36:38.535968+0000","last_undegraded":"2023-11-15T02:36:38.535968+0000","last_fullsized":"2023-11-15T02:36:38.535968+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.521477+0000","last_change":"2023-11-15T02:36:38.126939+0000","last_active":"2023-11-15T02:36:38.521477+0000","last_peered":"2023-11-15T02:36:38.521477+0000","last_clean":"2023-11-15T02:36:38.521477+0000","last_became_active":"2023-11-15T02:36:38.126661+0000","last_became_peered":"2023-11-15T02:36:38.126661+0000","last_unstale":"2023-11-15T02:36:38.521477+0000","last_undegraded":"2023-11-15T02:36:38.521477+0000","last_fullsized":"2023-11-15T02:36:38.521477+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.544015+0000","last_change":"2023-11-15T02:36:38.537229+0000","last_active":"2023-11-15T02:36:38.544015+0000","last_peered":"2023-11-15T02:36:38.544015+0000","last_clean":"2023-11-15T02:36:38.544015+0000","last_became_active":"2023-11-15T02:36:38.536925+0000","last_became_peered":"2023-11-15T02:36:38.536925+0000","last_unstale":"2023-11-15T02:36:38.544015+0000","last_undegraded":"2023-11-15T02:36:38.544015+0000","last_fullsized":"2023-11-15T02:36:38.544015+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.522256+0000","last_change":"2023-11-15T02:36:38.136053+0000","last_active":"2023-11-15T02:36:38.522256+0000","last_peered":"2023-11-15T02:36:38.522256+0000","last_clean":"2023-11-15T02:36:38.522256+0000","last_became_active":"2023-11-15T02:36:38.135751+0000","last_became_peered":"2023-11-15T02:36:38.135751+0000","last_unstale":"2023-11-15T02:36:38.522256+0000","last_undegraded":"2023-11-15T02:36:38.522256+0000","last_fullsized":"2023-11-15T02:36:38.522256+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532856+0000","last_change":"2023-11-15T02:36:38.531938+0000","last_active":"2023-11-15T02:36:38.532856+0000","last_peered":"2023-11-15T02:36:38.532856+0000","last_clean":"2023-11-15T02:36:38.532856+0000","last_became_active":"2023-11-15T02:36:38.531604+0000","last_became_peered":"2023-11-15T02:36:38.531604+0000","last_unstale":"2023-11-15T02:36:38.532856+0000","last_undegraded":"2023-11-15T02:36:38.532856+0000","last_fullsized":"2023-11-15T02:36:38.532856+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516591+0000","last_change":"2023-11-15T02:36:38.138280+0000","last_active":"2023-11-15T02:36:38.516591+0000","last_peered":"2023-11-15T02:36:38.516591+0000","last_clean":"2023-11-15T02:36:38.516591+0000","last_became_active":"2023-11-15T02:36:38.138007+0000","last_became_peered":"2023-11-15T02:36:38.138007+0000","last_unstale":"2023-11-15T02:36:38.516591+0000","last_undegraded":"2023-11-15T02:36:38.516591+0000","last_fullsized":"2023-11-15T02:36:38.516591+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532520+0000","last_change":"2023-11-15T02:36:38.523516+0000","last_active":"2023-11-15T02:36:38.532520+0000","last_peered":"2023-11-15T02:36:38.532520+0000","last_clean":"2023-11-15T02:36:38.532520+0000","last_became_active":"2023-11-15T02:36:38.523218+0000","last_became_peered":"2023-11-15T02:36:38.523218+0000","last_unstale":"2023-11-15T02:36:38.532520+0000","last_undegraded":"2023-11-15T02:36:38.532520+0000","last_fullsized":"2023-11-15T02:36:38.532520+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.513064+0000","last_change":"2023-11-15T02:36:38.138606+0000","last_active":"2023-11-15T02:36:38.513064+0000","last_peered":"2023-11-15T02:36:38.513064+0000","last_clean":"2023-11-15T02:36:38.513064+0000","last_became_active":"2023-11-15T02:36:38.138337+0000","last_became_peered":"2023-11-15T02:36:38.138337+0000","last_unstale":"2023-11-15T02:36:38.513064+0000","last_undegraded":"2023-11-15T02:36:38.513064+0000","last_fullsized":"2023-11-15T02:36:38.513064+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.531121+0000","last_change":"2023-11-15T02:36:38.525151+0000","last_active":"2023-11-15T02:36:38.531121+0000","last_peered":"2023-11-15T02:36:38.531121+0000","last_clean":"2023-11-15T02:36:38.531121+0000","last_became_active":"2023-11-15T02:36:38.524361+0000","last_became_peered":"2023-11-15T02:36:38.524361+0000","last_unstale":"2023-11-15T02:36:38.531121+0000","last_undegraded":"2023-11-15T02:36:38.531121+0000","last_fullsized":"2023-11-15T02:36:38.531121+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.526985+0000","last_change":"2023-11-15T02:36:38.138980+0000","last_active":"2023-11-15T02:36:38.526985+0000","last_peered":"2023-11-15T02:36:38.526985+0000","last_clean":"2023-11-15T02:36:38.526985+0000","last_became_active":"2023-11-15T02:36:38.138651+0000","last_became_peered":"2023-11-15T02:36:38.138651+0000","last_unstale":"2023-11-15T02:36:38.526985+0000","last_undegraded":"2023-11-15T02:36:38.526985+0000","last_fullsized":"2023-11-15T02:36:38.526985+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532061+0000","last_change":"2023-11-15T02:36:38.530046+0000","last_active":"2023-11-15T02:36:38.532061+0000","last_peered":"2023-11-15T02:36:38.532061+0000","last_clean":"2023-11-15T02:36:38.532061+0000","last_became_active":"2023-11-15T02:36:38.529767+0000","last_became_peered":"2023-11-15T02:36:38.529767+0000","last_unstale":"2023-11-15T02:36:38.532061+0000","last_undegraded":"2023-11-15T02:36:38.532061+0000","last_fullsized":"2023-11-15T02:36:38.532061+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516409+0000","last_change":"2023-11-15T02:36:38.136265+0000","last_active":"2023-11-15T02:36:38.516409+0000","last_peered":"2023-11-15T02:36:38.516409+0000","last_clean":"2023-11-15T02:36:38.516409+0000","last_became_active":"2023-11-15T02:36:38.135988+0000","last_became_peered":"2023-11-15T02:36:38.135988+0000","last_unstale":"2023-11-15T02:36:38.516409+0000","last_undegraded":"2023-11-15T02:36:38.516409+0000","last_fullsized":"2023-11-15T02:36:38.516409+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.544052+0000","last_change":"2023-11-15T02:36:38.537910+0000","last_active":"2023-11-15T02:36:38.544052+0000","last_peered":"2023-11-15T02:36:38.544052+0000","last_clean":"2023-11-15T02:36:38.544052+0000","last_became_active":"2023-11-15T02:36:38.537535+0000","last_became_peered":"2023-11-15T02:36:38.537535+0000","last_unstale":"2023-11-15T02:36:38.544052+0000","last_undegraded":"2023-11-15T02:36:38.544052+0000","last_fullsized":"2023-11-15T02:36:38.544052+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.509423+0000","last_change":"2023-11-15T02:36:38.132549+0000","last_active":"2023-11-15T02:36:38.509423+0000","last_peered":"2023-11-15T02:36:38.509423+0000","last_clean":"2023-11-15T02:36:38.509423+0000","last_became_active":"2023-11-15T02:36:38.131056+0000","last_became_peered":"2023-11-15T02:36:38.131056+0000","last_unstale":"2023-11-15T02:36:38.509423+0000","last_undegraded":"2023-11-15T02:36:38.509423+0000","last_fullsized":"2023-11-15T02:36:38.509423+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.530459+0000","last_change":"2023-11-15T02:36:38.518241+0000","last_active":"2023-11-15T02:36:38.530459+0000","last_peered":"2023-11-15T02:36:38.530459+0000","last_clean":"2023-11-15T02:36:38.530459+0000","last_became_active":"2023-11-15T02:36:38.517955+0000","last_became_peered":"2023-11-15T02:36:38.517955+0000","last_unstale":"2023-11-15T02:36:38.530459+0000","last_undegraded":"2023-11-15T02:36:38.530459+0000","last_fullsized":"2023-11-15T02:36:38.530459+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"161'3","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537395+0000","last_change":"2023-11-15T02:36:38.131164+0000","last_active":"2023-11-15T02:36:38.537395+0000","last_peered":"2023-11-15T02:36:38.537395+0000","last_clean":"2023-11-15T02:36:38.537395+0000","last_became_active":"2023-11-15T02:36:38.130878+0000","last_became_peered":"2023-11-15T02:36:38.130878+0000","last_unstale":"2023-11-15T02:36:38.537395+0000","last_undegraded":"2023-11-15T02:36:38.537395+0000","last_fullsized":"2023-11-15T02:36:38.537395+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516669+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:36:38.516669+0000","last_peered":"2023-11-15T02:36:38.516669+0000","last_clean":"2023-11-15T02:36:38.516669+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:36:38.516669+0000","last_undegraded":"2023-11-15T02:36:38.516669+0000","last_fullsized":"2023-11-15T02:36:38.516669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.530613+0000","last_change":"2023-11-15T02:36:38.523967+0000","last_active":"2023-11-15T02:36:38.530613+0000","last_peered":"2023-11-15T02:36:38.530613+0000","last_clean":"2023-11-15T02:36:38.530613+0000","last_became_active":"2023-11-15T02:36:38.523736+0000","last_became_peered":"2023-11-15T02:36:38.523736+0000","last_unstale":"2023-11-15T02:36:38.530613+0000","last_undegraded":"2023-11-15T02:36:38.530613+0000","last_fullsized":"2023-11-15T02:36:38.530613+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"161'1","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533483+0000","last_change":"2023-11-15T02:36:38.131656+0000","last_active":"2023-11-15T02:36:38.533483+0000","last_peered":"2023-11-15T02:36:38.533483+0000","last_clean":"2023-11-15T02:36:38.533483+0000","last_became_active":"2023-11-15T02:36:38.131365+0000","last_became_peered":"2023-11-15T02:36:38.131365+0000","last_unstale":"2023-11-15T02:36:38.533483+0000","last_undegraded":"2023-11-15T02:36:38.533483+0000","last_fullsized":"2023-11-15T02:36:38.533483+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":133,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.511477+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:36:38.511477+0000","last_peered":"2023-11-15T02:36:38.511477+0000","last_clean":"2023-11-15T02:36:38.511477+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:36:38.511477+0000","last_undegraded":"2023-11-15T02:36:38.511477+0000","last_fullsized":"2023-11-15T02:36:38.511477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536357+0000","last_change":"2023-11-15T02:36:38.530209+0000","last_active":"2023-11-15T02:36:38.536357+0000","last_peered":"2023-11-15T02:36:38.536357+0000","last_clean":"2023-11-15T02:36:38.536357+0000","last_became_active":"2023-11-15T02:36:38.529709+0000","last_became_peered":"2023-11-15T02:36:38.529709+0000","last_unstale":"2023-11-15T02:36:38.536357+0000","last_undegraded":"2023-11-15T02:36:38.536357+0000","last_fullsized":"2023-11-15T02:36:38.536357+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"161'4","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.537161+0000","last_change":"2023-11-15T02:36:38.133751+0000","last_active":"2023-11-15T02:36:38.537161+0000","last_peered":"2023-11-15T02:36:38.537161+0000","last_clean":"2023-11-15T02:36:38.537161+0000","last_became_active":"2023-11-15T02:36:38.132964+0000","last_became_peered":"2023-11-15T02:36:38.132964+0000","last_unstale":"2023-11-15T02:36:38.537161+0000","last_undegraded":"2023-11-15T02:36:38.537161+0000","last_fullsized":"2023-11-15T02:36:38.537161+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":142,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516913+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:36:38.516913+0000","last_peered":"2023-11-15T02:36:38.516913+0000","last_clean":"2023-11-15T02:36:38.516913+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:36:38.516913+0000","last_undegraded":"2023-11-15T02:36:38.516913+0000","last_fullsized":"2023-11-15T02:36:38.516913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536060+0000","last_change":"2023-11-15T02:36:38.520559+0000","last_active":"2023-11-15T02:36:38.536060+0000","last_peered":"2023-11-15T02:36:38.536060+0000","last_clean":"2023-11-15T02:36:38.536060+0000","last_became_active":"2023-11-15T02:36:38.520256+0000","last_became_peered":"2023-11-15T02:36:38.520256+0000","last_unstale":"2023-11-15T02:36:38.536060+0000","last_undegraded":"2023-11-15T02:36:38.536060+0000","last_fullsized":"2023-11-15T02:36:38.536060+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.526875+0000","last_change":"2023-11-15T02:36:38.139742+0000","last_active":"2023-11-15T02:36:38.526875+0000","last_peered":"2023-11-15T02:36:38.526875+0000","last_clean":"2023-11-15T02:36:38.526875+0000","last_became_active":"2023-11-15T02:36:38.139448+0000","last_became_peered":"2023-11-15T02:36:38.139448+0000","last_unstale":"2023-11-15T02:36:38.526875+0000","last_undegraded":"2023-11-15T02:36:38.526875+0000","last_fullsized":"2023-11-15T02:36:38.526875+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.513025+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:36:38.513025+0000","last_peered":"2023-11-15T02:36:38.513025+0000","last_clean":"2023-11-15T02:36:38.513025+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:36:38.513025+0000","last_undegraded":"2023-11-15T02:36:38.513025+0000","last_fullsized":"2023-11-15T02:36:38.513025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":130,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.518795+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:36:38.518795+0000","last_peered":"2023-11-15T02:36:38.518795+0000","last_clean":"2023-11-15T02:36:38.518795+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:36:38.518795+0000","last_undegraded":"2023-11-15T02:36:38.518795+0000","last_fullsized":"2023-11-15T02:36:38.518795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533074+0000","last_change":"2023-11-15T02:36:38.528559+0000","last_active":"2023-11-15T02:36:38.533074+0000","last_peered":"2023-11-15T02:36:38.533074+0000","last_clean":"2023-11-15T02:36:38.533074+0000","last_became_active":"2023-11-15T02:36:38.528245+0000","last_became_peered":"2023-11-15T02:36:38.528245+0000","last_unstale":"2023-11-15T02:36:38.533074+0000","last_undegraded":"2023-11-15T02:36:38.533074+0000","last_fullsized":"2023-11-15T02:36:38.533074+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.512753+0000","last_change":"2023-11-15T02:36:38.134038+0000","last_active":"2023-11-15T02:36:38.512753+0000","last_peered":"2023-11-15T02:36:38.512753+0000","last_clean":"2023-11-15T02:36:38.512753+0000","last_became_active":"2023-11-15T02:36:38.133738+0000","last_became_peered":"2023-11-15T02:36:38.133738+0000","last_unstale":"2023-11-15T02:36:38.512753+0000","last_undegraded":"2023-11-15T02:36:38.512753+0000","last_fullsized":"2023-11-15T02:36:38.512753+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.518886+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:36:38.518886+0000","last_peered":"2023-11-15T02:36:38.518886+0000","last_clean":"2023-11-15T02:36:38.518886+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:36:38.518886+0000","last_undegraded":"2023-11-15T02:36:38.518886+0000","last_fullsized":"2023-11-15T02:36:38.518886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.536576+0000","last_change":"2023-11-15T02:36:38.526352+0000","last_active":"2023-11-15T02:36:38.536576+0000","last_peered":"2023-11-15T02:36:38.536576+0000","last_clean":"2023-11-15T02:36:38.536576+0000","last_became_active":"2023-11-15T02:36:38.526013+0000","last_became_peered":"2023-11-15T02:36:38.526013+0000","last_unstale":"2023-11-15T02:36:38.536576+0000","last_undegraded":"2023-11-15T02:36:38.536576+0000","last_fullsized":"2023-11-15T02:36:38.536576+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"161'2","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.533265+0000","last_change":"2023-11-15T02:36:38.133858+0000","last_active":"2023-11-15T02:36:38.533265+0000","last_peered":"2023-11-15T02:36:38.533265+0000","last_clean":"2023-11-15T02:36:38.533265+0000","last_became_active":"2023-11-15T02:36:38.133560+0000","last_became_peered":"2023-11-15T02:36:38.133560+0000","last_unstale":"2023-11-15T02:36:38.533265+0000","last_undegraded":"2023-11-15T02:36:38.533265+0000","last_fullsized":"2023-11-15T02:36:38.533265+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.519340+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:36:38.519340+0000","last_peered":"2023-11-15T02:36:38.519340+0000","last_clean":"2023-11-15T02:36:38.519340+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:36:38.519340+0000","last_undegraded":"2023-11-15T02:36:38.519340+0000","last_fullsized":"2023-11-15T02:36:38.519340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.527303+0000","last_change":"2023-11-15T02:36:38.521699+0000","last_active":"2023-11-15T02:36:38.527303+0000","last_peered":"2023-11-15T02:36:38.527303+0000","last_clean":"2023-11-15T02:36:38.527303+0000","last_became_active":"2023-11-15T02:36:38.521389+0000","last_became_peered":"2023-11-15T02:36:38.521389+0000","last_unstale":"2023-11-15T02:36:38.527303+0000","last_undegraded":"2023-11-15T02:36:38.527303+0000","last_fullsized":"2023-11-15T02:36:38.527303+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.511919+0000","last_change":"2023-11-15T02:36:38.132885+0000","last_active":"2023-11-15T02:36:38.511919+0000","last_peered":"2023-11-15T02:36:38.511919+0000","last_clean":"2023-11-15T02:36:38.511919+0000","last_became_active":"2023-11-15T02:36:38.132615+0000","last_became_peered":"2023-11-15T02:36:38.132615+0000","last_unstale":"2023-11-15T02:36:38.511919+0000","last_undegraded":"2023-11-15T02:36:38.511919+0000","last_fullsized":"2023-11-15T02:36:38.511919+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":132,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.516738+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:36:38.516738+0000","last_peered":"2023-11-15T02:36:38.516738+0000","last_clean":"2023-11-15T02:36:38.516738+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:36:38.516738+0000","last_undegraded":"2023-11-15T02:36:38.516738+0000","last_fullsized":"2023-11-15T02:36:38.516738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.532149+0000","last_change":"2023-11-15T02:36:38.530950+0000","last_active":"2023-11-15T02:36:38.532149+0000","last_peered":"2023-11-15T02:36:38.532149+0000","last_clean":"2023-11-15T02:36:38.532149+0000","last_became_active":"2023-11-15T02:36:38.530676+0000","last_became_peered":"2023-11-15T02:36:38.530676+0000","last_unstale":"2023-11-15T02:36:38.532149+0000","last_undegraded":"2023-11-15T02:36:38.532149+0000","last_fullsized":"2023-11-15T02:36:38.532149+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:38.106937+0000","last_clean_scrub_stamp":"2023-11-15T02:36:38.106937+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.514848+0000","last_change":"2023-11-15T02:36:38.128896+0000","last_active":"2023-11-15T02:36:38.514848+0000","last_peered":"2023-11-15T02:36:38.514848+0000","last_clean":"2023-11-15T02:36:38.514848+0000","last_became_active":"2023-11-15T02:36:38.128531+0000","last_became_peered":"2023-11-15T02:36:38.128531+0000","last_unstale":"2023-11-15T02:36:38.514848+0000","last_undegraded":"2023-11-15T02:36:38.514848+0000","last_fullsized":"2023-11-15T02:36:38.514848+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:36:37.101755+0000","last_clean_scrub_stamp":"2023-11-15T02:36:37.101755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":148,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-11-15T02:36:38.511091+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:36:38.511091+0000","last_peered":"2023-11-15T02:36:38.511091+0000","last_clean":"2023-11-15T02:36:38.511091+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:36:38.511091+0000","last_undegraded":"2023-11-15T02:36:38.511091+0000","last_fullsized":"2023-11-15T02:36:38.511091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575744,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303172,"kb_used_data":1980,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068668,"statfs":{"total":96636764160,"available":96326316032,"internally_reserved":0,"allocated":2027520,"data_stored":1065905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58699999999999997,"15min":0.57299999999999995},"min":{"1min":0.47099999999999997,"5min":0.35899999999999999,"15min":0.34399999999999997},"max":{"1min":0.748,"5min":1.0680000000000001,"15min":1.121},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.46500000000000002,"5min":0.36099999999999999,"15min":0.316},"max":{"1min":0.80100000000000005,"5min":0.94499999999999995,"15min":1.129},"last":0.35199999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.376,"15min":0.36099999999999999},"max":{"1min":0.78600000000000003,"5min":0.997,"15min":1.173},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.434,"5min":0.39500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72299999999999998,"5min":0.93700000000000006,"15min":1.1990000000000001},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58699999999999997,"15min":0.58399999999999996},"min":{"1min":0.45400000000000001,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":0.72099999999999997,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82199999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.60899999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.48699999999999999,"5min":0.40899999999999997,"15min":0.38800000000000001},"max":{"1min":0.76100000000000001,"5min":0.97999999999999998,"15min":1.212},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.504,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73099999999999998,"5min":1.101,"15min":1.101},"last":0.56999999999999995}]},{"osd":4,"last update":"Wed Nov 15 02:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47699999999999998,"15min":0.47599999999999998},"min":{"1min":0.34200000000000003,"5min":0.317,"15min":0.27300000000000002},"max":{"1min":0.64400000000000002,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.441,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78300000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Nov 15 02:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47799999999999998,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.65300000000000002,"5min":0.70599999999999996,"15min":0.78800000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.498,"15min":0.51500000000000001},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.33100000000000002},"max":{"1min":0.67600000000000005,"5min":0.75,"15min":0.82799999999999996},"last":0.49399999999999999}]},{"osd":6,"last update":"Wed Nov 15 02:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.31},"max":{"1min":0.64100000000000001,"5min":0.73299999999999998,"15min":0.86299999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55000000000000004,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.34499999999999997,"15min":0.29999999999999999},"max":{"1min":0.67200000000000004,"5min":0.77400000000000002,"15min":0.85699999999999998},"last":0.59699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575745,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307264,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064576,"statfs":{"total":96636764160,"available":96322125824,"internally_reserved":0,"allocated":2023424,"data_stored":1066153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.44900000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.341},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.48699999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.76500000000000001,"5min":0.82899999999999996,"15min":1.4039999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed Nov 15 02:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.47899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73299999999999998,"5min":0.86099999999999999,"15min":1.325},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.499,"5min":0.36799999999999999,"15min":0.34300000000000003},"max":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":1.458},"last":0.51000000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.49199999999999999,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":0.77900000000000003,"5min":0.83199999999999996,"15min":1.482},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.47299999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.754,"5min":0.78800000000000003,"15min":1.333},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.52800000000000002,"5min":0.41999999999999998,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":0.83599999999999997,"15min":1.4390000000000001},"last":0.57899999999999996}]},{"osd":4,"last update":"Wed Nov 15 02:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.44900000000000001},"min":{"1min":0.307,"5min":0.27300000000000002,"15min":0.26100000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.437},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.39100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.63900000000000001}]},{"osd":5,"last update":"Wed Nov 15 02:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.47999999999999998},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.29999999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.626},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.40699999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60899999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51400000000000001,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.28799999999999998},"max":{"1min":0.81000000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.45100000000000001,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.66400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575746,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307256,"kb_used_data":1968,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064584,"statfs":{"total":96636764160,"available":96322134016,"internally_reserved":0,"allocated":2015232,"data_stored":1065171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.45600000000000002,"5min":0.66000000000000003,"15min":0.66800000000000004},"last":0.251},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.52500000000000002,"5min":0.64200000000000002,"15min":0.65800000000000003},"last":0.28000000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.26900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.46300000000000002,"5min":0.59799999999999998,"15min":0.63100000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.44400000000000001,"15min":0.45500000000000002},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.27100000000000002},"max":{"1min":0.56599999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.30599999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.30599999999999999},"max":{"1min":0.61799999999999999,"5min":0.69799999999999995,"15min":0.74299999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.48499999999999999,"15min":0.49199999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55500000000000005,"5min":0.70899999999999996,"15min":0.77100000000000002},"last":0.33400000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":0.89800000000000002,"15min":1.097},"last":0.37},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.96499999999999997,"15min":1.014},"last":0.438}]},{"osd":5,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":0.89200000000000002,"15min":0.98699999999999999},"last":0.379},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.95399999999999996,"15min":1.024},"last":0.45100000000000001}]},{"osd":6,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.47899999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.94399999999999995,"15min":0.96799999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88400000000000001,"5min":0.93200000000000005,"15min":1.143},"last":0.48899999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90500000000000003,"5min":0.95799999999999996,"15min":1.111},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":0.97999999999999998,"15min":1.0129999999999999},"last":0.498}]}]},{"osd":0,"up_from":13,"seq":55834575744,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307268,"kb_used_data":1980,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064572,"statfs":{"total":96636764160,"available":96322121728,"internally_reserved":0,"allocated":2027520,"data_stored":1065297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41399999999999998,"15min":0.42299999999999999},"min":{"1min":0.28799999999999998,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.56299999999999994,"5min":0.63700000000000001,"15min":0.67300000000000004},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.40000000000000002,"15min":0.39900000000000002},"min":{"1min":0.313,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.48599999999999999,"5min":0.60099999999999998,"15min":0.83799999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.44800000000000001},"min":{"1min":0.36199999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.627,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.63}]},{"osd":3,"last update":"Wed Nov 15 02:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44700000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":0.55900000000000005,"5min":0.66200000000000003,"15min":0.69799999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.38700000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.55700000000000005,"5min":0.67200000000000004,"15min":0.71599999999999997},"last":0.65000000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68000000000000005,"15min":0.67800000000000005},"min":{"1min":0.499,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88700000000000001,"5min":1.004,"15min":1.004},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.53000000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.81599999999999995}]},{"osd":5,"last update":"Wed Nov 15 02:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.52000000000000002,"5min":0.45200000000000001,"15min":0.40699999999999997},"max":{"1min":0.80200000000000005,"5min":0.98699999999999999,"15min":1.05},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.66600000000000004},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.44900000000000001},"max":{"1min":0.84599999999999997,"5min":0.92600000000000005,"15min":1.004},"last":0.91200000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.46300000000000002,"15min":0.42699999999999999},"max":{"1min":0.84799999999999998,"5min":0.94999999999999996,"15min":1.026},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.51600000000000001,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":0.84299999999999997,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68999999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70599999999999996,"15min":0.70899999999999996},"min":{"1min":0.59399999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.871,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.54500000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91800000000000004,"5min":0.95699999999999996,"15min":1.0409999999999999},"last":0.997}]}]},{"osd":2,"up_from":13,"seq":55834575745,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311348,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060492,"statfs":{"total":96636764160,"available":96317943808,"internally_reserved":0,"allocated":2011136,"data_stored":1058559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.248,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56499999999999995,"5min":0.69699999999999995,"15min":0.83999999999999997},"last":0.248},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.25900000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.63500000000000001,"5min":0.69199999999999995,"15min":0.85899999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39400000000000002,"15min":0.40600000000000003},"min":{"1min":0.28699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.52200000000000002,"5min":0.68999999999999995,"15min":0.91000000000000003},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45600000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55700000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.40000000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.33500000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64800000000000002,"5min":0.755,"15min":0.79800000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":0.65600000000000003,"5min":0.69499999999999995,"15min":1.113},"last":0.35399999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67100000000000004,"15min":0.65500000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.89000000000000001,"5min":1.0069999999999999,"15min":1.2170000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91100000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.41899999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.153},"last":0.497},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69299999999999995,"15min":0.68300000000000005},"min":{"1min":0.497,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.996},"last":0.53000000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.442},"max":{"1min":0.85699999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.70599999999999996},"min":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.438},"max":{"1min":0.97299999999999998,"5min":1.079,"15min":1.079},"last":0.63100000000000001}]},{"osd":7,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95099999999999996,"5min":1.0940000000000001,"15min":1.7270000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.72199999999999998},"min":{"1min":0.495,"5min":0.46800000000000003,"15min":0.45800000000000002},"max":{"1min":0.90900000000000003,"5min":1.038,"15min":1.038},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575746,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311360,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060480,"statfs":{"total":96636764160,"available":96317931520,"internally_reserved":0,"allocated":2023424,"data_stored":1065815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38100000000000001,"15min":0.39500000000000002},"min":{"1min":0.26000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.56299999999999994,"5min":0.66400000000000003,"15min":0.67700000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.42099999999999999},"min":{"1min":0.29299999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.67400000000000004},"last":0.52100000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40400000000000003,"15min":0.41999999999999998},"min":{"1min":0.27500000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.59799999999999998,"5min":0.68600000000000005,"15min":0.81399999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.45300000000000001,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.75800000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.38600000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.60699999999999998,"5min":0.73399999999999999,"15min":0.76900000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.5,"15min":0.503},"min":{"1min":0.36499999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.75600000000000001},"last":0.64200000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63300000000000001,"15min":0.66300000000000003},"min":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.306},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63500000000000001,"15min":0.65800000000000003},"min":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89100000000000001,"5min":0.94999999999999996,"15min":1.0529999999999999},"last":0.95699999999999996}]},{"osd":5,"last update":"Wed Nov 15 02:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65300000000000002,"15min":0.68000000000000005},"min":{"1min":0.45300000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98999999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64800000000000002,"15min":0.67200000000000004},"min":{"1min":0.5,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":1.129},"last":0.94799999999999995}]},{"osd":6,"last update":"Wed Nov 15 02:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.45400000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96799999999999997,"15min":1.27},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.68700000000000006,"15min":0.71199999999999997},"min":{"1min":0.48999999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.0840000000000001},"last":0.97599999999999998}]},{"osd":7,"last update":"Wed Nov 15 02:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.47899999999999998,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.256},"last":1.024},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.51400000000000001,"5min":0.46700000000000003,"15min":0.46200000000000002},"max":{"1min":0.93899999999999995,"5min":1.004,"15min":1.1699999999999999},"last":0.92300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575744,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303168,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068672,"statfs":{"total":96636764160,"available":96326320128,"internally_reserved":0,"allocated":2023424,"data_stored":1065795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.32000000000000001},"max":{"1min":0.748,"5min":0.76800000000000002,"15min":0.80800000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.56599999999999995},"min":{"1min":0.38400000000000001,"5min":0.32500000000000001,"15min":0.313},"max":{"1min":0.755,"5min":0.78000000000000003,"15min":1.1919999999999999},"last":0.56999999999999995}]},{"osd":1,"last update":"Wed Nov 15 02:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56699999999999995,"15min":0.58299999999999996},"min":{"1min":0.379,"5min":0.375,"15min":0.36599999999999999},"max":{"1min":0.76400000000000001,"5min":0.81599999999999995,"15min":0.82399999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.495,"5min":0.39400000000000002,"15min":0.38900000000000001},"max":{"1min":0.82199999999999995,"5min":0.82799999999999996,"15min":1.2},"last":0.58299999999999996}]},{"osd":2,"last update":"Wed Nov 15 02:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59399999999999997,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.39000000000000001,"15min":0.36599999999999999},"max":{"1min":0.70799999999999996,"5min":0.78300000000000003,"15min":1.272},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.45100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.70699999999999996,"5min":0.81899999999999995,"15min":0.95999999999999996},"last":0.434}]},{"osd":3,"last update":"Wed Nov 15 02:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.435,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71899999999999997,"5min":0.74399999999999999,"15min":0.82999999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.51600000000000001,"5min":0.41399999999999998,"15min":0.40899999999999997},"max":{"1min":0.76100000000000001,"5min":0.78400000000000003,"15min":1.3109999999999999},"last":0.40500000000000003}]},{"osd":5,"last update":"Wed Nov 15 02:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47899999999999998,"15min":0.46600000000000003},"min":{"1min":0.36899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68100000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.497,"15min":0.48599999999999999},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.28299999999999997},"max":{"1min":0.747,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.38}]},{"osd":6,"last update":"Wed Nov 15 02:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.497},"min":{"1min":0.35099999999999998,"5min":0.33800000000000002,"15min":0.32400000000000001},"max":{"1min":0.752,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77600000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.61199999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53900000000000003,"15min":0.52600000000000002},"min":{"1min":0.40600000000000003,"5min":0.34999999999999998,"15min":0.34100000000000003},"max":{"1min":0.79900000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36799999999999999},"max":{"1min":0.79100000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575744,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307264,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064576,"statfs":{"total":96636764160,"available":96322125824,"internally_reserved":0,"allocated":2023424,"data_stored":1066085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.748,"5min":0.77700000000000002,"15min":1.1379999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.374,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.623,"5min":0.79500000000000004,"15min":1.0169999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Wed Nov 15 02:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.57099999999999995},"min":{"1min":0.371,"5min":0.34499999999999997,"15min":0.33500000000000002},"max":{"1min":0.78300000000000003,"5min":0.84299999999999997,"15min":1.0109999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.27600000000000002},"max":{"1min":0.75600000000000001,"5min":0.81499999999999995,"15min":1.135},"last":0.49399999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65400000000000003,"5min":0.79200000000000004,"15min":1.155},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75900000000000001,"5min":0.81999999999999995,"15min":1.0369999999999999},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed Nov 15 02:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":1.1779999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.59499999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69699999999999995,"5min":0.79900000000000004,"15min":1.171},"last":0.60599999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46700000000000003,"15min":0.45800000000000002},"min":{"1min":0.34699999999999998,"5min":0.32100000000000001,"15min":0.27800000000000002},"max":{"1min":0.61799999999999999,"5min":0.67600000000000005,"15min":0.72399999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.77900000000000003,"15min":0.78600000000000003},"last":0.44}]},{"osd":6,"last update":"Wed Nov 15 02:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47599999999999998,"15min":0.47099999999999997},"min":{"1min":0.33400000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.63,"5min":0.70499999999999996,"15min":0.80900000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.504,"15min":0.498},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.316},"max":{"1min":0.64400000000000002,"5min":0.76500000000000001,"15min":0.81899999999999995},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed Nov 15 02:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.505,"15min":0.497},"min":{"1min":0.35799999999999998,"5min":0.33400000000000002,"15min":0.312},"max":{"1min":0.69999999999999996,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58899999999999997,"15min":0.58199999999999996},"min":{"1min":0.443,"5min":0.39700000000000002,"15min":0.36299999999999999},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:36:42.930 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-15T02:36:42.930 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-15T02:36:43.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.086+0000 7fc8393f4700 1 Processor -- start 2023-11-15T02:36:43.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.086+0000 7fc8393f4700 1 -- start start 2023-11-15T02:36:43.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.087+0000 7fc8393f4700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc83413ac60 0x7fc834069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.087+0000 7fc8393f4700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc834155320 con 0x7fc8340c4210 2023-11-15T02:36:43.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.087+0000 7fc8393f4700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc834155600 con 0x7fc8340c3e30 2023-11-15T02:36:43.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.087+0000 7fc8393f4700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc834155bc0 con 0x7fc83413ac60 2023-11-15T02:36:43.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.087+0000 7fc8327fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc8340c4210 0x7fc83413a550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41744/0 (socket says 172.21.15.1:41744) 2023-11-15T02:36:43.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.087+0000 7fc8327fc700 1 -- 172.21.15.1:0/4166224340 learned_addr learned my addr 172.21.15.1:0/4166224340 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:43.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc831ffb700 1 -- 172.21.15.1:0/4166224340 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856632281 0 0) 0x7fc834155320 con 0x7fc8340c4210 2023-11-15T02:36:43.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc831ffb700 1 -- 172.21.15.1:0/4166224340 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8200033f0 con 0x7fc8340c4210 2023-11-15T02:36:43.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc8337fe700 1 --2- 172.21.15.1:0/4166224340 >> v2:172.21.15.141:3300/0 conn(0x7fc83413ac60 0x7fc834069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc831ffb700 1 -- 172.21.15.1:0/4166224340 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 989337651 0 0) 0x7fc8200033f0 con 0x7fc8340c4210 2023-11-15T02:36:43.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc831ffb700 1 -- 172.21.15.1:0/4166224340 >> v2:172.21.15.141:3300/0 conn(0x7fc83413ac60 msgr2=0x7fc834069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:43.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc831ffb700 1 --2- 172.21.15.1:0/4166224340 >> v2:172.21.15.141:3300/0 conn(0x7fc83413ac60 0x7fc834069ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc831ffb700 1 -- 172.21.15.1:0/4166224340 >> v1:172.21.15.141:6789/0 conn(0x7fc8340c3e30 legacy=0x7fc834066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:43.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc831ffb700 1 -- 172.21.15.1:0/4166224340 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8341558e0 con 0x7fc8340c4210 2023-11-15T02:36:43.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc831ffb700 1 -- 172.21.15.1:0/4166224340 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fc81c001470 con 0x7fc8340c4210 2023-11-15T02:36:43.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc831ffb700 1 -- 172.21.15.1:0/4166224340 >> v1:172.21.15.1:6789/0 conn(0x7fc8340c4210 legacy=0x7fc83413a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:43.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc831ffb700 1 --2- 172.21.15.1:0/4166224340 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8200038e0 0x7fc820003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc831ffb700 1 --2- 172.21.15.1:0/4166224340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc820004690 0x7fc820004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc831ffb700 1 --2- 172.21.15.1:0/4166224340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc820005000 0x7fc82000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc831ffb700 1 -- 172.21.15.1:0/4166224340 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc834155bc0 con 0x7fc820004690 2023-11-15T02:36:43.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc831ffb700 1 -- 172.21.15.1:0/4166224340 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82000bee0 con 0x7fc8200038e0 2023-11-15T02:36:43.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc831ffb700 1 -- 172.21.15.1:0/4166224340 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82000c0a0 con 0x7fc820005000 2023-11-15T02:36:43.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc8327fc700 1 --2- 172.21.15.1:0/4166224340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc820004690 0x7fc820004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc832ffd700 1 --2- 172.21.15.1:0/4166224340 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8200038e0 0x7fc820003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc8337fe700 1 --2- 172.21.15.1:0/4166224340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc820005000 0x7fc82000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc8327fc700 1 -- 172.21.15.1:0/4166224340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc820005000 msgr2=0x7fc82000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:43.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc8327fc700 1 --2- 172.21.15.1:0/4166224340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc820005000 0x7fc82000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc8327fc700 1 -- 172.21.15.1:0/4166224340 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8200038e0 msgr2=0x7fc820003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:43.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.088+0000 7fc8327fc700 1 --2- 172.21.15.1:0/4166224340 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8200038e0 0x7fc820003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.089+0000 7fc8327fc700 1 -- 172.21.15.1:0/4166224340 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8200033f0 con 0x7fc820004690 2023-11-15T02:36:43.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.089+0000 7fc8337fe700 1 --2- 172.21.15.1:0/4166224340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc820005000 0x7fc82000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:43.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.089+0000 7fc8337fe700 1 -- 172.21.15.1:0/4166224340 reap_dead start 2023-11-15T02:36:43.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.089+0000 7fc8327fc700 1 --2- 172.21.15.1:0/4166224340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc820004690 0x7fc820004b10 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7fc81c007fd0 tx=0x7fc81c0077c0).ready entity=mon.0 client_cookie=2e82ed897166b941 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:43.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.089+0000 7fc831ffb700 1 -- 172.21.15.1:0/4166224340 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c00cae0 con 0x7fc820004690 2023-11-15T02:36:43.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.089+0000 7fc831ffb700 1 -- 172.21.15.1:0/4166224340 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c00cc40 con 0x7fc820004690 2023-11-15T02:36:43.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.089+0000 7fc831ffb700 1 -- 172.21.15.1:0/4166224340 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0070d0 con 0x7fc820004690 2023-11-15T02:36:43.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.089+0000 7fc8393f4700 1 -- 172.21.15.1:0/4166224340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc820004690 msgr2=0x7fc820004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:43.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.089+0000 7fc8393f4700 1 --2- 172.21.15.1:0/4166224340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc820004690 0x7fc820004b10 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7fc81c007fd0 tx=0x7fc81c0077c0).stop 2023-11-15T02:36:43.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.089+0000 7fc8393f4700 1 -- 172.21.15.1:0/4166224340 shutdown_connections 2023-11-15T02:36:43.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.089+0000 7fc8393f4700 1 --2- 172.21.15.1:0/4166224340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc820004690 0x7fc820004b10 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.089+0000 7fc8393f4700 1 -- 172.21.15.1:0/4166224340 >> 172.21.15.1:0/4166224340 conn(0x7fc8340c7dc0 msgr2=0x7fc8340c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:43.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.089+0000 7fc8393f4700 1 -- 172.21.15.1:0/4166224340 shutdown_connections 2023-11-15T02:36:43.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.089+0000 7fc8393f4700 1 -- 172.21.15.1:0/4166224340 wait complete. 2023-11-15T02:36:43.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.091+0000 7fc8393f4700 1 Processor -- start 2023-11-15T02:36:43.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.091+0000 7fc8393f4700 1 -- start start 2023-11-15T02:36:43.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.091+0000 7fc8393f4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc820004690 0x7fc8340a8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.091+0000 7fc8393f4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc834131b30 0x7fc8340a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.091+0000 7fc8393f4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc834131460 0x7fc8340ab200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.091+0000 7fc8393f4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83406a090 con 0x7fc834131b30 2023-11-15T02:36:43.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.091+0000 7fc8393f4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc834153010 con 0x7fc834131460 2023-11-15T02:36:43.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.091+0000 7fc8393f4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340a9b70 con 0x7fc820004690 2023-11-15T02:36:43.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc8327fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc834131b30 0x7fc8340a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc8327fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc834131b30 0x7fc8340a8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53142/0 (socket says 172.21.15.1:53142) 2023-11-15T02:36:43.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc8327fc700 1 -- 172.21.15.1:0/920003104 learned_addr learned my addr 172.21.15.1:0/920003104 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:43.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc832ffd700 1 --2- 172.21.15.1:0/920003104 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc820004690 0x7fc8340a8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc8337fe700 1 --2- 172.21.15.1:0/920003104 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc834131460 0x7fc8340ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc8327fc700 1 -- 172.21.15.1:0/920003104 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc820004690 msgr2=0x7fc8340a8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:43.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc8327fc700 1 --2- 172.21.15.1:0/920003104 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc820004690 0x7fc8340a8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc8327fc700 1 -- 172.21.15.1:0/920003104 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc834131460 msgr2=0x7fc8340ab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:43.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc8327fc700 1 --2- 172.21.15.1:0/920003104 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc834131460 0x7fc8340ab200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc8327fc700 1 -- 172.21.15.1:0/920003104 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340aa000 con 0x7fc834131b30 2023-11-15T02:36:43.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc8327fc700 1 --2- 172.21.15.1:0/920003104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc834131b30 0x7fc8340a8f80 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7fc81c000c00 tx=0x7fc81c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:43.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc82affd700 1 -- 172.21.15.1:0/920003104 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0046b0 con 0x7fc834131b30 2023-11-15T02:36:43.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc82affd700 1 -- 172.21.15.1:0/920003104 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c004810 con 0x7fc834131b30 2023-11-15T02:36:43.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc8393f4700 1 -- 172.21.15.1:0/920003104 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc834152a50 con 0x7fc834131b30 2023-11-15T02:36:43.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc82affd700 1 -- 172.21.15.1:0/920003104 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c004bd0 con 0x7fc834131b30 2023-11-15T02:36:43.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.092+0000 7fc8393f4700 1 -- 172.21.15.1:0/920003104 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8340a9800 con 0x7fc834131b30 2023-11-15T02:36:43.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.093+0000 7fc8393f4700 1 -- 172.21.15.1:0/920003104 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8340a9d00 con 0x7fc834131b30 2023-11-15T02:36:43.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.094+0000 7fc82affd700 1 -- 172.21.15.1:0/920003104 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc81c013450 con 0x7fc834131b30 2023-11-15T02:36:43.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.094+0000 7fc82affd700 1 --2- 172.21.15.1:0/920003104 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc81405f270 0x7fc814061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.094+0000 7fc82affd700 1 -- 172.21.15.1:0/920003104 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fc81c07b260 con 0x7fc834131b30 2023-11-15T02:36:43.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.094+0000 7fc832ffd700 1 --2- 172.21.15.1:0/920003104 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc81405f270 0x7fc814061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.095+0000 7fc832ffd700 1 --2- 172.21.15.1:0/920003104 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc81405f270 0x7fc814061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc82c007fd0 tx=0x7fc82c009040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:43.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.098+0000 7fc82affd700 1 -- 172.21.15.1:0/920003104 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc81c04c160 con 0x7fc834131b30 2023-11-15T02:36:43.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.339+0000 7fc8393f4700 1 -- 172.21.15.1:0/920003104 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc83406c7e0 con 0x7fc834131b30 2023-11-15T02:36:43.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.343+0000 7fc82affd700 1 -- 172.21.15.1:0/920003104 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v42) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc81c025020 con 0x7fc834131b30 2023-11-15T02:36:43.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.345+0000 7fc8393f4700 1 -- 172.21.15.1:0/920003104 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc81405f270 msgr2=0x7fc814061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:43.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.345+0000 7fc8393f4700 1 --2- 172.21.15.1:0/920003104 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc81405f270 0x7fc814061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc82c007fd0 tx=0x7fc82c009040).stop 2023-11-15T02:36:43.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.345+0000 7fc8393f4700 1 -- 172.21.15.1:0/920003104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc834131b30 msgr2=0x7fc8340a8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:43.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.345+0000 7fc8393f4700 1 --2- 172.21.15.1:0/920003104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc834131b30 0x7fc8340a8f80 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7fc81c000c00 tx=0x7fc81c015000).stop 2023-11-15T02:36:43.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.345+0000 7fc8393f4700 1 -- 172.21.15.1:0/920003104 shutdown_connections 2023-11-15T02:36:43.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.345+0000 7fc8393f4700 1 --2- 172.21.15.1:0/920003104 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc81405f270 0x7fc814061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.345+0000 7fc8393f4700 1 --2- 172.21.15.1:0/920003104 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc834131460 0x7fc8340ab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.345+0000 7fc8393f4700 1 --2- 172.21.15.1:0/920003104 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc820004690 0x7fc8340a8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.345+0000 7fc8393f4700 1 --2- 172.21.15.1:0/920003104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc834131b30 0x7fc8340a8f80 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.345+0000 7fc8393f4700 1 -- 172.21.15.1:0/920003104 >> 172.21.15.1:0/920003104 conn(0x7fc8340c7dc0 msgr2=0x7fc8340c4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:43.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.345+0000 7fc8393f4700 1 -- 172.21.15.1:0/920003104 shutdown_connections 2023-11-15T02:36:43.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.345+0000 7fc8393f4700 1 -- 172.21.15.1:0/920003104 wait complete. 2023-11-15T02:36:43.350 INFO:teuthology.orchestra.run.smithi001.stderr:updated caps for client.0 2023-11-15T02:36:43.359 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:36:43.424 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-11-15T02:36:43.423+0000 7f32c7852700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T02:36:43.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.476+0000 7faa6ac75700 1 Processor -- start 2023-11-15T02:36:43.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.476+0000 7faa6ac75700 1 -- start start 2023-11-15T02:36:43.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.477+0000 7faa6ac75700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa64151e10 0x7faa64155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.477+0000 7faa6ac75700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7faa640c98b0 0x7faa640c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.477+0000 7faa6ac75700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa640c7980 con 0x7faa640c86b0 2023-11-15T02:36:43.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.477+0000 7faa6ac75700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa640c8b10 con 0x7faa640c98b0 2023-11-15T02:36:43.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.477+0000 7faa6ac75700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa640ca230 con 0x7faa64151e10 2023-11-15T02:36:43.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.477+0000 7faa69472700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7faa640c86b0 0x7faa640aa0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41760/0 (socket says 172.21.15.1:41760) 2023-11-15T02:36:43.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.477+0000 7faa69472700 1 -- 172.21.15.1:0/262339916 learned_addr learned my addr 172.21.15.1:0/262339916 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:43.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.477+0000 7faa6a474700 1 --2- 172.21.15.1:0/262339916 >> v2:172.21.15.141:3300/0 conn(0x7faa640c98b0 0x7faa640c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.477+0000 7faa69c73700 1 --2- 172.21.15.1:0/262339916 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa64151e10 0x7faa64155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.477+0000 7faa68c71700 1 -- 172.21.15.1:0/262339916 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444673284 0 0) 0x7faa640c7980 con 0x7faa640c86b0 2023-11-15T02:36:43.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.477+0000 7faa68c71700 1 -- 172.21.15.1:0/262339916 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa4c0033f0 con 0x7faa640c86b0 2023-11-15T02:36:43.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 -- 172.21.15.1:0/262339916 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 864019695 0 0) 0x7faa4c0033f0 con 0x7faa640c86b0 2023-11-15T02:36:43.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 -- 172.21.15.1:0/262339916 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa64151e10 msgr2=0x7faa64155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:43.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 --2- 172.21.15.1:0/262339916 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa64151e10 0x7faa64155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 -- 172.21.15.1:0/262339916 >> v2:172.21.15.141:3300/0 conn(0x7faa640c98b0 msgr2=0x7faa640c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:43.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 --2- 172.21.15.1:0/262339916 >> v2:172.21.15.141:3300/0 conn(0x7faa640c98b0 0x7faa640c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 -- 172.21.15.1:0/262339916 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa640aa890 con 0x7faa640c86b0 2023-11-15T02:36:43.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 -- 172.21.15.1:0/262339916 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7faa58001470 con 0x7faa640c86b0 2023-11-15T02:36:43.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa6a474700 1 --2- 172.21.15.1:0/262339916 >> v2:172.21.15.141:3300/0 conn(0x7faa640c98b0 0x7faa640c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:43.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 -- 172.21.15.1:0/262339916 >> v1:172.21.15.1:6789/0 conn(0x7faa640c86b0 legacy=0x7faa640aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:43.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 --2- 172.21.15.1:0/262339916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa4c0038e0 0x7faa4c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 --2- 172.21.15.1:0/262339916 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa4c004690 0x7faa4c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 --2- 172.21.15.1:0/262339916 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa64151e10 0x7faa4c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 -- 172.21.15.1:0/262339916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa640c8b10 con 0x7faa4c0038e0 2023-11-15T02:36:43.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 -- 172.21.15.1:0/262339916 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa640ca230 con 0x7faa4c004690 2023-11-15T02:36:43.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 -- 172.21.15.1:0/262339916 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c00b8e0 con 0x7faa64151e10 2023-11-15T02:36:43.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa69c73700 1 --2- 172.21.15.1:0/262339916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa4c0038e0 0x7faa4c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa69472700 1 --2- 172.21.15.1:0/262339916 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa4c004690 0x7faa4c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa6a474700 1 --2- 172.21.15.1:0/262339916 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa64151e10 0x7faa4c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa69c73700 1 -- 172.21.15.1:0/262339916 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa64151e10 msgr2=0x7faa4c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:43.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa69c73700 1 --2- 172.21.15.1:0/262339916 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa64151e10 0x7faa4c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa69c73700 1 -- 172.21.15.1:0/262339916 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa4c004690 msgr2=0x7faa4c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:43.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa69c73700 1 --2- 172.21.15.1:0/262339916 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa4c004690 0x7faa4c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa69c73700 1 -- 172.21.15.1:0/262339916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c0033f0 con 0x7faa4c0038e0 2023-11-15T02:36:43.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa69c73700 1 --2- 172.21.15.1:0/262339916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa4c0038e0 0x7faa4c003d00 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7faa5c009a60 tx=0x7faa5c009060).ready entity=mon.0 client_cookie=a7ffe61f02bd1b7a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:43.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 -- 172.21.15.1:0/262339916 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c009ea0 con 0x7faa4c0038e0 2023-11-15T02:36:43.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 -- 172.21.15.1:0/262339916 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c009430 con 0x7faa4c0038e0 2023-11-15T02:36:43.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.478+0000 7faa68c71700 1 -- 172.21.15.1:0/262339916 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00e870 con 0x7faa4c0038e0 2023-11-15T02:36:43.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.479+0000 7faa6ac75700 1 -- 172.21.15.1:0/262339916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa4c0038e0 msgr2=0x7faa4c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:43.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.479+0000 7faa6ac75700 1 --2- 172.21.15.1:0/262339916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa4c0038e0 0x7faa4c003d00 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7faa5c009a60 tx=0x7faa5c009060).stop 2023-11-15T02:36:43.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.479+0000 7faa6a474700 1 -- 172.21.15.1:0/262339916 reap_dead start 2023-11-15T02:36:43.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.479+0000 7faa6ac75700 1 -- 172.21.15.1:0/262339916 shutdown_connections 2023-11-15T02:36:43.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.479+0000 7faa6ac75700 1 -- 172.21.15.1:0/262339916 >> 172.21.15.1:0/262339916 conn(0x7faa640947e0 msgr2=0x7faa6406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:43.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.479+0000 7faa6ac75700 1 -- 172.21.15.1:0/262339916 shutdown_connections 2023-11-15T02:36:43.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.479+0000 7faa6ac75700 1 -- 172.21.15.1:0/262339916 wait complete. 2023-11-15T02:36:43.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.480+0000 7faa6ac75700 1 Processor -- start 2023-11-15T02:36:43.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.480+0000 7faa6ac75700 1 -- start start 2023-11-15T02:36:43.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa6ac75700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa4c0038e0 0x7faa640ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa6ac75700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa64149bf0 0x7faa640c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa6ac75700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa6414a070 0x7faa640c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa6ac75700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa641534e0 con 0x7faa64149bf0 2023-11-15T02:36:43.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa6ac75700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa640c6b40 con 0x7faa4c0038e0 2023-11-15T02:36:43.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa6ac75700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa641521f0 con 0x7faa6414a070 2023-11-15T02:36:43.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa69472700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa64149bf0 0x7faa640c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa69472700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa64149bf0 0x7faa640c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53168/0 (socket says 172.21.15.1:53168) 2023-11-15T02:36:43.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa69472700 1 -- 172.21.15.1:0/2572137229 learned_addr learned my addr 172.21.15.1:0/2572137229 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:43.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa6a474700 1 --2- 172.21.15.1:0/2572137229 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa6414a070 0x7faa640c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa69c73700 1 --2- 172.21.15.1:0/2572137229 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa4c0038e0 0x7faa640ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa69472700 1 -- 172.21.15.1:0/2572137229 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa6414a070 msgr2=0x7faa640c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:43.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa69472700 1 --2- 172.21.15.1:0/2572137229 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa6414a070 0x7faa640c6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa69472700 1 -- 172.21.15.1:0/2572137229 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa4c0038e0 msgr2=0x7faa640ac0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:43.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa69472700 1 --2- 172.21.15.1:0/2572137229 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa4c0038e0 0x7faa640ac0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.481+0000 7faa69472700 1 -- 172.21.15.1:0/2572137229 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa64152440 con 0x7faa64149bf0 2023-11-15T02:36:43.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.482+0000 7faa69472700 1 --2- 172.21.15.1:0/2572137229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa64149bf0 0x7faa640c6160 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7faa5800e7b0 tx=0x7faa58000bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:43.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.482+0000 7faa61ffb700 1 -- 172.21.15.1:0/2572137229 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58010450 con 0x7faa64149bf0 2023-11-15T02:36:43.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.482+0000 7faa61ffb700 1 -- 172.21.15.1:0/2572137229 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa580105b0 con 0x7faa64149bf0 2023-11-15T02:36:43.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.482+0000 7faa6ac75700 1 -- 172.21.15.1:0/2572137229 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa64152720 con 0x7faa64149bf0 2023-11-15T02:36:43.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.482+0000 7faa61ffb700 1 -- 172.21.15.1:0/2572137229 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58010930 con 0x7faa64149bf0 2023-11-15T02:36:43.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.482+0000 7faa6ac75700 1 -- 172.21.15.1:0/2572137229 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa64152d60 con 0x7faa64149bf0 2023-11-15T02:36:43.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.483+0000 7faa6ac75700 1 -- 172.21.15.1:0/2572137229 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa640475e0 con 0x7faa64149bf0 2023-11-15T02:36:43.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.483+0000 7faa61ffb700 1 -- 172.21.15.1:0/2572137229 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7faa58010ca0 con 0x7faa64149bf0 2023-11-15T02:36:43.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.484+0000 7faa61ffb700 1 --2- 172.21.15.1:0/2572137229 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faa5005f270 0x7faa50061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:43.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.484+0000 7faa61ffb700 1 -- 172.21.15.1:0/2572137229 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6617+0+0 (secure 0 0 0) 0x7faa5807a5b0 con 0x7faa64149bf0 2023-11-15T02:36:43.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.484+0000 7faa69c73700 1 --2- 172.21.15.1:0/2572137229 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faa5005f270 0x7faa50061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:43.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.484+0000 7faa69c73700 1 --2- 172.21.15.1:0/2572137229 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faa5005f270 0x7faa50061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7faa5c006d50 tx=0x7faa5c01a000).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:43.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.488+0000 7faa61ffb700 1 -- 172.21.15.1:0/2572137229 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7faa5804b450 con 0x7faa64149bf0 2023-11-15T02:36:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.708+0000 7faa6ac75700 1 -- 172.21.15.1:0/2572137229 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa640c7bd0 con 0x7faa64149bf0 2023-11-15T02:36:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.708+0000 7faa61ffb700 1 -- 172.21.15.1:0/2572137229 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4491 (secure 0 0 0) 0x7faa5804ea70 con 0x7faa64149bf0 2023-11-15T02:36:43.711 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:43.711 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7019,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3898250637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3898250637},{"type":"v1","addr":"172.21.15.141:6836","nonce":3898250637}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7022,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3709207600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3709207600},{"type":"v1","addr":"172.21.15.141:6837","nonce":3709207600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1212884558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1212884558},{"type":"v1","addr":"172.21.15.1:6835","nonce":1212884558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:36:38.505394+0000","modified":"2023-11-15T02:36:41.520212+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8619":{"gid":8619,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6834/1968331775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1968331775},{"type":"v1","addr":"172.21.15.1:6834","nonce":1968331775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-11-15T02:36:43.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.710+0000 7faa6ac75700 1 -- 172.21.15.1:0/2572137229 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faa5005f270 msgr2=0x7faa50061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:43.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.710+0000 7faa6ac75700 1 --2- 172.21.15.1:0/2572137229 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faa5005f270 0x7faa50061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7faa5c006d50 tx=0x7faa5c01a000).stop 2023-11-15T02:36:43.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.710+0000 7faa6ac75700 1 -- 172.21.15.1:0/2572137229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa64149bf0 msgr2=0x7faa640c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:43.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.710+0000 7faa6ac75700 1 --2- 172.21.15.1:0/2572137229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa64149bf0 0x7faa640c6160 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7faa5800e7b0 tx=0x7faa58000bc0).stop 2023-11-15T02:36:43.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.710+0000 7faa6ac75700 1 -- 172.21.15.1:0/2572137229 shutdown_connections 2023-11-15T02:36:43.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.710+0000 7faa6ac75700 1 --2- 172.21.15.1:0/2572137229 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7faa5005f270 0x7faa50061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.710+0000 7faa6ac75700 1 --2- 172.21.15.1:0/2572137229 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa6414a070 0x7faa640c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.710+0000 7faa6ac75700 1 --2- 172.21.15.1:0/2572137229 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa4c0038e0 0x7faa640ac0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.710+0000 7faa6ac75700 1 --2- 172.21.15.1:0/2572137229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa64149bf0 0x7faa640c6160 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:43.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.710+0000 7faa6ac75700 1 -- 172.21.15.1:0/2572137229 >> 172.21.15.1:0/2572137229 conn(0x7faa640947e0 msgr2=0x7faa640a99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:43.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.710+0000 7faa6ac75700 1 -- 172.21.15.1:0/2572137229 shutdown_connections 2023-11-15T02:36:43.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:43.710+0000 7faa6ac75700 1 -- 172.21.15.1:0/2572137229 wait complete. 2023-11-15T02:36:43.718 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 71 2023-11-15T02:36:44.126 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-15T02:36:38.505394+0000', 'modified': '2023-11-15T02:36:41.520212+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8619}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8619': {'gid': 8619, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.1:6834/1968331775', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6832', 'nonce': 1968331775}, {'type': 'v1', 'addr': '172.21.15.1:6834', 'nonce': 1968331775}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-15T02:36:44.127 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-15T02:36:44.127 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-15T02:36:44.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.247+0000 7f4ba9a86700 1 Processor -- start 2023-11-15T02:36:44.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.247+0000 7f4ba9a86700 1 -- start start 2023-11-15T02:36:44.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.248+0000 7f4ba9a86700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4ba4154250 0x7f4ba4154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.248+0000 7f4ba9a86700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ba40aa700 0x7f4ba40c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.248+0000 7f4ba9a86700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba4158ff0 con 0x7f4ba40c6110 2023-11-15T02:36:44.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.248+0000 7f4ba9a86700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba4158100 con 0x7f4ba4154250 2023-11-15T02:36:44.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.248+0000 7f4ba9a86700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba41583e0 con 0x7f4ba40aa700 2023-11-15T02:36:44.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.248+0000 7f4ba37fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4ba4154250 0x7f4ba4154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.248+0000 7f4ba37fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4ba4154250 0x7f4ba4154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53180/0 (socket says 172.21.15.1:53180) 2023-11-15T02:36:44.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.248+0000 7f4ba37fe700 1 -- 172.21.15.1:0/3627125012 learned_addr learned my addr 172.21.15.1:0/3627125012 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:44.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.248+0000 7f4ba2ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4ba40c6110 0x7f4ba40a9ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41766/0 (socket says 172.21.15.1:41766) 2023-11-15T02:36:44.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba3fff700 1 --2- 172.21.15.1:0/3627125012 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ba40aa700 0x7f4ba40c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba37fe700 1 -- 172.21.15.1:0/3627125012 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ba40aa700 msgr2=0x7f4ba40c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:44.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/3627125012 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ba40aa700 0x7f4ba40c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba37fe700 1 -- 172.21.15.1:0/3627125012 >> v1:172.21.15.1:6789/0 conn(0x7f4ba40c6110 legacy=0x7f4ba40a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba27fc700 1 -- 172.21.15.1:0/3627125012 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557408129 0 0) 0x7f4ba4158ff0 con 0x7f4ba40c6110 2023-11-15T02:36:44.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba37fe700 1 -- 172.21.15.1:0/3627125012 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba41586c0 con 0x7f4ba4154250 2023-11-15T02:36:44.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba3fff700 1 --2- 172.21.15.1:0/3627125012 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ba40aa700 0x7f4ba40c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:44.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/3627125012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ba4154250 0x7f4ba4154630 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f4b94006fd0 tx=0x7f4b940090f0).ready entity=mon.0 client_cookie=7ea326e89814447f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:44.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba27fc700 1 -- 172.21.15.1:0/3627125012 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400b600 con 0x7f4ba4154250 2023-11-15T02:36:44.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba27fc700 1 -- 172.21.15.1:0/3627125012 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9400b760 con 0x7f4ba4154250 2023-11-15T02:36:44.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba27fc700 1 -- 172.21.15.1:0/3627125012 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400bae0 con 0x7f4ba4154250 2023-11-15T02:36:44.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba9a86700 1 -- 172.21.15.1:0/3627125012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ba4154250 msgr2=0x7f4ba4154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba9a86700 1 --2- 172.21.15.1:0/3627125012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ba4154250 0x7f4ba4154630 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f4b94006fd0 tx=0x7f4b940090f0).stop 2023-11-15T02:36:44.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba9a86700 1 -- 172.21.15.1:0/3627125012 shutdown_connections 2023-11-15T02:36:44.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba9a86700 1 --2- 172.21.15.1:0/3627125012 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ba40aa700 0x7f4ba40c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba9a86700 1 --2- 172.21.15.1:0/3627125012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ba4154250 0x7f4ba4154630 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba9a86700 1 -- 172.21.15.1:0/3627125012 >> 172.21.15.1:0/3627125012 conn(0x7f4ba40c7b20 msgr2=0x7f4ba40c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:44.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.249+0000 7f4ba9a86700 1 -- 172.21.15.1:0/3627125012 shutdown_connections 2023-11-15T02:36:44.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.250+0000 7f4ba9a86700 1 -- 172.21.15.1:0/3627125012 wait complete. 2023-11-15T02:36:44.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.251+0000 7f4ba9a86700 1 Processor -- start 2023-11-15T02:36:44.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.251+0000 7f4ba9a86700 1 -- start start 2023-11-15T02:36:44.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.251+0000 7f4ba9a86700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ba40aa700 0x7f4ba41686d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba9a86700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ba40c6110 0x7f4ba4157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba9a86700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ba4154250 0x7f4ba414beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba9a86700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba4168bc0 con 0x7f4ba4154250 2023-11-15T02:36:44.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba9a86700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba4157920 con 0x7f4ba40c6110 2023-11-15T02:36:44.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba9a86700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba414cd80 con 0x7f4ba40aa700 2023-11-15T02:36:44.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ba4154250 0x7f4ba414beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ba4154250 0x7f4ba414beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53196/0 (socket says 172.21.15.1:53196) 2023-11-15T02:36:44.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba3fff700 1 -- 172.21.15.1:0/144112899 learned_addr learned my addr 172.21.15.1:0/144112899 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:44.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/144112899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ba40aa700 0x7f4ba41686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba3fff700 1 -- 172.21.15.1:0/144112899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ba40aa700 msgr2=0x7f4ba41686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba3fff700 1 --2- 172.21.15.1:0/144112899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ba40aa700 0x7f4ba41686d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba3fff700 1 -- 172.21.15.1:0/144112899 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ba40c6110 msgr2=0x7f4ba4157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba2ffd700 1 --2- 172.21.15.1:0/144112899 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ba40c6110 0x7f4ba4157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba3fff700 1 --2- 172.21.15.1:0/144112899 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ba40c6110 0x7f4ba4157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba3fff700 1 -- 172.21.15.1:0/144112899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b94009370 con 0x7f4ba4154250 2023-11-15T02:36:44.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba3fff700 1 --2- 172.21.15.1:0/144112899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ba4154250 0x7f4ba414beb0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f4b9c00ce20 tx=0x7f4b9c0077f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:44.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4b8b7fe700 1 -- 172.21.15.1:0/144112899 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00ae30 con 0x7f4ba4154250 2023-11-15T02:36:44.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4b8b7fe700 1 -- 172.21.15.1:0/144112899 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c016400 con 0x7f4ba4154250 2023-11-15T02:36:44.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba9a86700 1 -- 172.21.15.1:0/144112899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba4155a60 con 0x7f4ba4154250 2023-11-15T02:36:44.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4b8b7fe700 1 -- 172.21.15.1:0/144112899 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c016780 con 0x7f4ba4154250 2023-11-15T02:36:44.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.252+0000 7f4ba9a86700 1 -- 172.21.15.1:0/144112899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba4154e50 con 0x7f4ba4154250 2023-11-15T02:36:44.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.254+0000 7f4b8b7fe700 1 -- 172.21.15.1:0/144112899 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4b9c016bb0 con 0x7f4ba4154250 2023-11-15T02:36:44.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.254+0000 7f4b8b7fe700 1 --2- 172.21.15.1:0/144112899 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4b9005f240 0x7f4b90061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.254+0000 7f4b8b7fe700 1 -- 172.21.15.1:0/144112899 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f4b9c07af80 con 0x7f4ba4154250 2023-11-15T02:36:44.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.255+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/144112899 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4b9005f240 0x7f4b90061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.255+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/144112899 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4b9005f240 0x7f4b90061700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4ba40aa260 tx=0x7f4b94017000).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:44.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.256+0000 7f4bbb41fb80 1 Processor -- start 2023-11-15T02:36:44.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.257+0000 7f4bbb41fb80 1 -- start start 2023-11-15T02:36:44.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.257+0000 7f4bbb41fb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a24efe40 0x55a5a275bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.257+0000 7f4bbb41fb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a277cea0 0x55a5a27337c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.257+0000 7f4bbb41fb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a2733cb0 0x55a5a272e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.257+0000 7f4bbb41fb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5a26f9060 con 0x55a5a24efe40 2023-11-15T02:36:44.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.257+0000 7f4bbb41fb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5a26701f0 con 0x55a5a2733cb0 2023-11-15T02:36:44.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.257+0000 7f4bbb41fb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5a2685440 con 0x55a5a277cea0 2023-11-15T02:36:44.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.257+0000 7f4ba37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a24efe40 0x55a5a275bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.257+0000 7f4ba37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a24efe40 0x55a5a275bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53210/0 (socket says 172.21.15.1:53210) 2023-11-15T02:36:44.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.257+0000 7f4ba37fe700 1 -- 172.21.15.1:0/873929580 learned_addr learned my addr 172.21.15.1:0/873929580 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:44.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.258+0000 7f4ba3fff700 1 --2- 172.21.15.1:0/873929580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a2733cb0 0x55a5a272e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.258+0000 7f4ba2ffd700 1 --2- 172.21.15.1:0/873929580 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a277cea0 0x55a5a27337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.258+0000 7f4ba37fe700 1 -- 172.21.15.1:0/873929580 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a277cea0 msgr2=0x55a5a27337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:44.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.258+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/873929580 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a277cea0 0x55a5a27337c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.258+0000 7f4ba37fe700 1 -- 172.21.15.1:0/873929580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a2733cb0 msgr2=0x55a5a272e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:44.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.258+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/873929580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a2733cb0 0x55a5a272e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.258+0000 7f4ba37fe700 1 -- 172.21.15.1:0/873929580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5a267e620 con 0x55a5a24efe40 2023-11-15T02:36:44.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.258+0000 7f4ba3fff700 1 --2- 172.21.15.1:0/873929580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a2733cb0 0x55a5a272e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:44.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.258+0000 7f4ba2ffd700 1 --2- 172.21.15.1:0/873929580 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a277cea0 0x55a5a27337c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:44.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.258+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/873929580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a24efe40 0x55a5a275bd90 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f4ba40c2080 tx=0x7f4b9401f070).ready entity=mon.0 client_cookie=e5e09d0f634fd144 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:44.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.258+0000 7f4b88ff9700 1 -- 172.21.15.1:0/873929580 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94006990 con 0x55a5a24efe40 2023-11-15T02:36:44.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.258+0000 7f4b88ff9700 1 -- 172.21.15.1:0/873929580 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9401d890 con 0x55a5a24efe40 2023-11-15T02:36:44.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.258+0000 7f4b88ff9700 1 -- 172.21.15.1:0/873929580 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9401dc10 con 0x55a5a24efe40 2023-11-15T02:36:44.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.259+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/873929580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a24efe40 msgr2=0x55a5a275bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.259+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/873929580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a24efe40 0x55a5a275bd90 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f4ba40c2080 tx=0x7f4b9401f070).stop 2023-11-15T02:36:44.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.259+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/873929580 shutdown_connections 2023-11-15T02:36:44.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.259+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/873929580 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a2733cb0 0x55a5a272e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.259+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/873929580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a24efe40 0x55a5a275bd90 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.259+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/873929580 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a277cea0 0x55a5a27337c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.259+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/873929580 >> 172.21.15.1:0/873929580 conn(0x55a5a259d4a0 msgr2=0x55a5a277c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:44.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.259+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/873929580 shutdown_connections 2023-11-15T02:36:44.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.259+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/873929580 wait complete. 2023-11-15T02:36:44.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.259+0000 7f4bbb41fb80 1 -- start start 2023-11-15T02:36:44.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.259+0000 7f4bbb41fb80 1 Processor -- start 2023-11-15T02:36:44.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.260+0000 7f4bbb41fb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a24efe40 0x55a5a275b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.260+0000 7f4bbb41fb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a2733cb0 0x55a5a278b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.260+0000 7f4bbb41fb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a277cea0 0x55a5a27781d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.260+0000 7f4bbb41fb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5a2685580 con 0x55a5a2733cb0 2023-11-15T02:36:44.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.260+0000 7f4bbb41fb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5a2685800 con 0x55a5a24efe40 2023-11-15T02:36:44.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.260+0000 7f4bbb41fb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5a2650e10 con 0x55a5a277cea0 2023-11-15T02:36:44.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.260+0000 7f4bbb41fb80 10 client.0 ll_register_callbacks cb 0x55a5a26f3460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T02:36:44.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.260+0000 7f4ba2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a2733cb0 0x55a5a278b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.260+0000 7f4ba2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a2733cb0 0x55a5a278b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53212/0 (socket says 172.21.15.1:53212) 2023-11-15T02:36:44.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.260+0000 7f4ba2ffd700 1 -- 172.21.15.1:0/2348581451 learned_addr learned my addr 172.21.15.1:0/2348581451 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:44.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/2348581451 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a24efe40 0x55a5a275b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4ba3fff700 1 --2- 172.21.15.1:0/2348581451 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a277cea0 0x55a5a27781d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4ba2ffd700 1 -- 172.21.15.1:0/2348581451 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a277cea0 msgr2=0x55a5a27781d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:44.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4ba2ffd700 1 --2- 172.21.15.1:0/2348581451 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a277cea0 0x55a5a27781d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4ba2ffd700 1 -- 172.21.15.1:0/2348581451 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a24efe40 msgr2=0x55a5a275b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:44.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4ba2ffd700 1 --2- 172.21.15.1:0/2348581451 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a24efe40 0x55a5a275b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4ba2ffd700 1 -- 172.21.15.1:0/2348581451 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba41586c0 con 0x55a5a2733cb0 2023-11-15T02:36:44.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/2348581451 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a24efe40 0x55a5a275b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:44.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4ba2ffd700 1 --2- 172.21.15.1:0/2348581451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a2733cb0 0x55a5a278b8a0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f4b98007f60 tx=0x7f4b98009040).ready entity=mon.0 client_cookie=33da60d8bcafc237 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:44.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4b81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T02:36:44.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4b81ffb700 1 -- 172.21.15.1:0/2348581451 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9800edd0 con 0x55a5a2733cb0 2023-11-15T02:36:44.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4b81ffb700 1 -- 172.21.15.1:0/2348581451 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(162..162 src has 1..162) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f4b98012d90 con 0x55a5a2733cb0 2023-11-15T02:36:44.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/2348581451 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5a2727720 con 0x55a5a2733cb0 2023-11-15T02:36:44.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4b81ffb700 1 -- 172.21.15.1:0/2348581451 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b98007380 con 0x55a5a2733cb0 2023-11-15T02:36:44.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4bbb41fb80 10 client.8769 fetch_fsmap learned FSMap version 71 2023-11-15T02:36:44.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/2348581451 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55a5a26799c0 con 0x55a5a2733cb0 2023-11-15T02:36:44.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4b81ffb700 1 -- 172.21.15.1:0/2348581451 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5a2727720 con 0x55a5a2733cb0 2023-11-15T02:36:44.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4b81ffb700 1 -- 172.21.15.1:0/2348581451 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 71) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4b9801c020 con 0x55a5a2733cb0 2023-11-15T02:36:44.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4bbb41fb80 10 client.8769 fetch_fsmap finished waiting for FSMap version 71 2023-11-15T02:36:44.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4bbb41fb80 10 client.8769 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-15T02:36:44.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4bbb41fb80 20 client.8769 populate_metadata read hostname 'smithi001' 2023-11-15T02:36:44.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/2348581451 >> [v2:172.21.15.1:6832/1968331775,v1:172.21.15.1:6834/1968331775] conn(0x55a5a2760d60 0x55a5a2761140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4bbb41fb80 4 client.8769 mds_command: new command op to 8619 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-15T02:36:44.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/2348581451 --> [v2:172.21.15.1:6832/1968331775,v1:172.21.15.1:6834/1968331775] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5a24ebca0 con 0x55a5a2760d60 2023-11-15T02:36:44.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.261+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/2348581451 >> [v2:172.21.15.1:6832/1968331775,v1:172.21.15.1:6834/1968331775] conn(0x55a5a2760d60 0x55a5a2761140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.262+0000 7f4b81ffb700 10 client.8769 ms_handle_connect on v2:172.21.15.1:6832/1968331775 2023-11-15T02:36:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.262+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/2348581451 >> [v2:172.21.15.1:6832/1968331775,v1:172.21.15.1:6834/1968331775] conn(0x55a5a2760d60 0x55a5a2761140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2c48bfbc07255111 server_cookie=e87864b6ce5a40d8 in_seq=0 out_seq=0 2023-11-15T02:36:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.262+0000 7f4b81ffb700 1 -- 172.21.15.1:0/2348581451 <== mds.0 v2:172.21.15.1:6832/1968331775 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55a5a24ebca0 con 0x55a5a2760d60 2023-11-15T02:36:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.262+0000 7f4b81ffb700 10 client.8769 handle_command_reply: tid=0 2023-11-15T02:36:44.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.262+0000 7f4bbb41fb80 1 client.8769 shutdown 2023-11-15T02:36:44.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.263+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/2348581451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a2733cb0 msgr2=0x55a5a278b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.263+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/2348581451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a2733cb0 0x55a5a278b8a0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f4b98007f60 tx=0x7f4b98009040).stop 2023-11-15T02:36:44.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.263+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/2348581451 shutdown_connections 2023-11-15T02:36:44.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.263+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/2348581451 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a277cea0 0x55a5a27781d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.263+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/2348581451 >> [v2:172.21.15.1:6832/1968331775,v1:172.21.15.1:6834/1968331775] conn(0x55a5a2760d60 0x55a5a2761140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.263+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/2348581451 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a24efe40 0x55a5a275b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.263+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/2348581451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a2733cb0 0x55a5a278b8a0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.263+0000 7f4b81ffb700 0 client.8769 ms_handle_reset on v2:172.21.15.1:6832/1968331775 2023-11-15T02:36:44.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.263+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/2348581451 >> 172.21.15.1:0/2348581451 conn(0x55a5a259d4a0 msgr2=0x55a5a2734130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:44.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.263+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/2348581451 shutdown_connections 2023-11-15T02:36:44.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.263+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/2348581451 wait complete. 2023-11-15T02:36:44.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.263+0000 7f4bbb41fb80 20 client.8769 trim_cache size 0 max 16384 2023-11-15T02:36:44.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.279+0000 7f4bbb41fb80 1 Processor -- start 2023-11-15T02:36:44.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.280+0000 7f4bbb41fb80 1 -- start start 2023-11-15T02:36:44.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.280+0000 7f4bbb41fb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a24efe40 0x55a5a2730670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.280+0000 7f4bbb41fb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a2733cb0 0x55a5a2775270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.280+0000 7f4bbb41fb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a277cea0 0x55a5a27314c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.280+0000 7f4bbb41fb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5a272ba30 con 0x55a5a277cea0 2023-11-15T02:36:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.280+0000 7f4bbb41fb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5a272fa60 con 0x55a5a24efe40 2023-11-15T02:36:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.280+0000 7f4bbb41fb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5a2778bd0 con 0x55a5a2733cb0 2023-11-15T02:36:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.280+0000 7f4ba3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a277cea0 0x55a5a27314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.280+0000 7f4ba3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a277cea0 0x55a5a27314c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53218/0 (socket says 172.21.15.1:53218) 2023-11-15T02:36:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.280+0000 7f4ba3fff700 1 -- 172.21.15.1:0/1395979934 learned_addr learned my addr 172.21.15.1:0/1395979934 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/1395979934 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a24efe40 0x55a5a2730670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4ba2ffd700 1 --2- 172.21.15.1:0/1395979934 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a2733cb0 0x55a5a2775270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4ba3fff700 1 -- 172.21.15.1:0/1395979934 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a2733cb0 msgr2=0x55a5a2775270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4ba3fff700 1 --2- 172.21.15.1:0/1395979934 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a2733cb0 0x55a5a2775270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4ba3fff700 1 -- 172.21.15.1:0/1395979934 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a24efe40 msgr2=0x55a5a2730670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:44.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4ba3fff700 1 --2- 172.21.15.1:0/1395979934 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a24efe40 0x55a5a2730670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4ba3fff700 1 -- 172.21.15.1:0/1395979934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5a2779d20 con 0x55a5a277cea0 2023-11-15T02:36:44.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4ba2ffd700 1 --2- 172.21.15.1:0/1395979934 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a2733cb0 0x55a5a2775270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:36:44.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4ba3fff700 1 --2- 172.21.15.1:0/1395979934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a277cea0 0x55a5a27314c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f4b9c079140 tx=0x7f4b9c051040).ready entity=mon.0 client_cookie=51f610a79ba7e196 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4b897fa700 1 -- 172.21.15.1:0/1395979934 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c054040 con 0x55a5a277cea0 2023-11-15T02:36:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4b897fa700 1 -- 172.21.15.1:0/1395979934 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c04dce0 con 0x55a5a277cea0 2023-11-15T02:36:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4b897fa700 1 -- 172.21.15.1:0/1395979934 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c078d60 con 0x55a5a277cea0 2023-11-15T02:36:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/1395979934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a277cea0 msgr2=0x55a5a27314c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/1395979934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a277cea0 0x55a5a27314c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f4b9c079140 tx=0x7f4b9c051040).stop 2023-11-15T02:36:44.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/1395979934 shutdown_connections 2023-11-15T02:36:44.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/1395979934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a277cea0 0x55a5a27314c0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/1395979934 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a24efe40 0x55a5a2730670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/1395979934 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a2733cb0 0x55a5a2775270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.281+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/1395979934 >> 172.21.15.1:0/1395979934 conn(0x55a5a259d4a0 msgr2=0x55a5a275b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:44.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.282+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/1395979934 shutdown_connections 2023-11-15T02:36:44.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.282+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/1395979934 wait complete. 2023-11-15T02:36:44.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.282+0000 7f4bbb41fb80 1 -- start start 2023-11-15T02:36:44.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.282+0000 7f4bbb41fb80 1 Processor -- start 2023-11-15T02:36:44.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4bbb41fb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a24efe40 0x55a5a27db740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4bbb41fb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a2733cb0 0x55a5a27ddff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4bbb41fb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a277cea0 0x55a5a27de4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4bbb41fb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5a27df5d0 con 0x55a5a2733cb0 2023-11-15T02:36:44.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4bbb41fb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5a27deb40 con 0x55a5a277cea0 2023-11-15T02:36:44.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4bbb41fb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5a27dee20 con 0x55a5a24efe40 2023-11-15T02:36:44.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4bbb41fb80 10 client.0 ll_register_callbacks cb 0x55a5a26f3460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T02:36:44.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4ba2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a2733cb0 0x55a5a27ddff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4ba2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a2733cb0 0x55a5a27ddff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53232/0 (socket says 172.21.15.1:53232) 2023-11-15T02:36:44.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4ba2ffd700 1 -- 172.21.15.1:0/540775042 learned_addr learned my addr 172.21.15.1:0/540775042 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:44.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/540775042 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a24efe40 0x55a5a27db740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4ba3fff700 1 --2- 172.21.15.1:0/540775042 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a277cea0 0x55a5a27de4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4ba2ffd700 1 -- 172.21.15.1:0/540775042 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a24efe40 msgr2=0x55a5a27db740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:44.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4ba2ffd700 1 --2- 172.21.15.1:0/540775042 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a24efe40 0x55a5a27db740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4ba2ffd700 1 -- 172.21.15.1:0/540775042 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a277cea0 msgr2=0x55a5a27de4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:44.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4ba2ffd700 1 --2- 172.21.15.1:0/540775042 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a277cea0 0x55a5a27de4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4ba2ffd700 1 -- 172.21.15.1:0/540775042 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba4154e50 con 0x55a5a2733cb0 2023-11-15T02:36:44.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4ba3fff700 1 --2- 172.21.15.1:0/540775042 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a277cea0 0x55a5a27de4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:44.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4ba2ffd700 1 --2- 172.21.15.1:0/540775042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a2733cb0 0x55a5a27ddff0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f4b9800f010 tx=0x7f4b9801b000).ready entity=mon.0 client_cookie=a24944176708274d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:44.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.283+0000 7f4b81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T02:36:44.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4b81ffb700 1 -- 172.21.15.1:0/540775042 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98000e40 con 0x55a5a2733cb0 2023-11-15T02:36:44.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4b81ffb700 1 -- 172.21.15.1:0/540775042 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(162..162 src has 1..162) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f4b98001d30 con 0x55a5a2733cb0 2023-11-15T02:36:44.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/540775042 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5a277d5e0 con 0x55a5a2733cb0 2023-11-15T02:36:44.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4b81ffb700 1 -- 172.21.15.1:0/540775042 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b9800e8e0 con 0x55a5a2733cb0 2023-11-15T02:36:44.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4bbb41fb80 10 client.8775 fetch_fsmap learned FSMap version 71 2023-11-15T02:36:44.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/540775042 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55a5a2679710 con 0x55a5a2733cb0 2023-11-15T02:36:44.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4b81ffb700 1 -- 172.21.15.1:0/540775042 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5a277d5e0 con 0x55a5a2733cb0 2023-11-15T02:36:44.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4b81ffb700 1 -- 172.21.15.1:0/540775042 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 71) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4b98027340 con 0x55a5a2733cb0 2023-11-15T02:36:44.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4bbb41fb80 10 client.8775 fetch_fsmap finished waiting for FSMap version 71 2023-11-15T02:36:44.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4bbb41fb80 10 client.8775 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-15T02:36:44.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4bbb41fb80 20 client.8775 populate_metadata read hostname 'smithi001' 2023-11-15T02:36:44.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/540775042 >> [v2:172.21.15.1:6832/1968331775,v1:172.21.15.1:6834/1968331775] conn(0x55a5a2777160 0x55a5a2777540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4bbb41fb80 4 client.8775 mds_command: new command op to 8619 tid=0[{"prefix": "status"}] 2023-11-15T02:36:44.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/540775042 --> [v2:172.21.15.1:6832/1968331775,v1:172.21.15.1:6834/1968331775] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f4b9401d890 con 0x55a5a2777160 2023-11-15T02:36:44.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/540775042 >> [v2:172.21.15.1:6832/1968331775,v1:172.21.15.1:6834/1968331775] conn(0x55a5a2777160 0x55a5a2777540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4b81ffb700 10 client.8775 ms_handle_connect on v2:172.21.15.1:6832/1968331775 2023-11-15T02:36:44.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.284+0000 7f4ba37fe700 1 --2- 172.21.15.1:0/540775042 >> [v2:172.21.15.1:6832/1968331775,v1:172.21.15.1:6834/1968331775] conn(0x55a5a2777160 0x55a5a2777540 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=df0d00ee213fc5ba server_cookie=10fbcc5ac25bf661 in_seq=0 out_seq=0 2023-11-15T02:36:44.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4b81ffb700 1 -- 172.21.15.1:0/540775042 <== mds.0 v2:172.21.15.1:6832/1968331775 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x7f4b9401d890 con 0x55a5a2777160 2023-11-15T02:36:44.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4b81ffb700 10 client.8775 handle_command_reply: tid=0 2023-11-15T02:36:44.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4bbb41fb80 1 client.8775 shutdown 2023-11-15T02:36:44.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/540775042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a2733cb0 msgr2=0x55a5a27ddff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/540775042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a2733cb0 0x55a5a27ddff0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f4b9800f010 tx=0x7f4b9801b000).stop 2023-11-15T02:36:44.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/540775042 shutdown_connections 2023-11-15T02:36:44.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/540775042 >> [v2:172.21.15.1:6832/1968331775,v1:172.21.15.1:6834/1968331775] conn(0x55a5a2777160 0x55a5a2777540 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/540775042 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5a277cea0 0x55a5a27de4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/540775042 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5a24efe40 0x55a5a27db740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4bbb41fb80 1 --2- 172.21.15.1:0/540775042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5a2733cb0 0x55a5a27ddff0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4b81ffb700 0 client.8775 ms_handle_reset on v2:172.21.15.1:6832/1968331775 2023-11-15T02:36:44.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/540775042 >> 172.21.15.1:0/540775042 conn(0x55a5a259d4a0 msgr2=0x55a5a275b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:44.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/540775042 shutdown_connections 2023-11-15T02:36:44.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4bbb41fb80 1 -- 172.21.15.1:0/540775042 wait complete. 2023-11-15T02:36:44.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4bbb41fb80 20 client.8775 trim_cache size 0 max 16384 2023-11-15T02:36:44.317 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:36:44.317 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "32ffb44b-12dc-4e79-bad7-24a9692dabf6", 2023-11-15T02:36:44.318 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2023-11-15T02:36:44.318 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 8619, 2023-11-15T02:36:44.318 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2023-11-15T02:36:44.318 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2023-11-15T02:36:44.318 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2023-11-15T02:36:44.319 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 5.7791130830000004, 2023-11-15T02:36:44.319 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 71, 2023-11-15T02:36:44.319 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 162, 2023-11-15T02:36:44.319 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 162, 2023-11-15T02:36:44.319 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 11.268082980999999 2023-11-15T02:36:44.320 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:36:44.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4ba9a86700 1 -- 172.21.15.1:0/144112899 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4b9005f240 msgr2=0x7f4b90061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4ba9a86700 1 --2- 172.21.15.1:0/144112899 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4b9005f240 0x7f4b90061700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4ba40aa260 tx=0x7f4b94017000).stop 2023-11-15T02:36:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4ba9a86700 1 -- 172.21.15.1:0/144112899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ba4154250 msgr2=0x7f4ba414beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4ba9a86700 1 --2- 172.21.15.1:0/144112899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ba4154250 0x7f4ba414beb0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f4b9c00ce20 tx=0x7f4b9c0077f0).stop 2023-11-15T02:36:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4ba9a86700 1 -- 172.21.15.1:0/144112899 shutdown_connections 2023-11-15T02:36:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4ba9a86700 1 --2- 172.21.15.1:0/144112899 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4b9005f240 0x7f4b90061700 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4ba9a86700 1 --2- 172.21.15.1:0/144112899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ba4154250 0x7f4ba414beb0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4ba9a86700 1 --2- 172.21.15.1:0/144112899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ba40aa700 0x7f4ba41686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4ba9a86700 1 --2- 172.21.15.1:0/144112899 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ba40c6110 0x7f4ba4157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.285+0000 7f4ba9a86700 1 -- 172.21.15.1:0/144112899 >> 172.21.15.1:0/144112899 conn(0x7f4ba40c7b20 msgr2=0x7f4ba40bffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.286+0000 7f4ba9a86700 1 -- 172.21.15.1:0/144112899 shutdown_connections 2023-11-15T02:36:44.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.286+0000 7f4ba9a86700 1 -- 172.21.15.1:0/144112899 wait complete. 2023-11-15T02:36:44.324 DEBUG:teuthology.orchestra.run.smithi001:> ceph fs ls 2023-11-15T02:36:44.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.427+0000 7fa1c4d3d700 1 Processor -- start 2023-11-15T02:36:44.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.427+0000 7fa1c4d3d700 1 -- start start 2023-11-15T02:36:44.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.428+0000 7fa1c4d3d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1c00bc2d0 0x7fa1c00bd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.428+0000 7fa1c4d3d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa1c0150880 0x7fa1c00c1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.428+0000 7fa1c4d3d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c0063280 con 0x7fa1c01504a0 2023-11-15T02:36:44.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.428+0000 7fa1c4d3d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c00bd7d0 con 0x7fa1c0150880 2023-11-15T02:36:44.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.428+0000 7fa1c4d3d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c0150d10 con 0x7fa1c00bc2d0 2023-11-15T02:36:44.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.429+0000 7fa1bdd9b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1c00bc2d0 0x7fa1c00bd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.429+0000 7fa1bed9d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa1c0150880 0x7fa1c00c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.429+0000 7fa1bdd9b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1c00bc2d0 0x7fa1c00bd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:33124/0 (socket says 172.21.15.1:33124) 2023-11-15T02:36:44.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.429+0000 7fa1bed9d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa1c0150880 0x7fa1c00c1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:40946/0 (socket says 172.21.15.1:40946) 2023-11-15T02:36:44.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.429+0000 7fa1bdd9b700 1 -- 172.21.15.1:0/3012330937 learned_addr learned my addr 172.21.15.1:0/3012330937 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:44.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.429+0000 7fa1bdd9b700 1 -- 172.21.15.1:0/3012330937 >> v2:172.21.15.141:3300/0 conn(0x7fa1c0150880 msgr2=0x7fa1c00c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:44.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.429+0000 7fa1bdd9b700 1 --2- 172.21.15.1:0/3012330937 >> v2:172.21.15.141:3300/0 conn(0x7fa1c0150880 0x7fa1c00c1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.429+0000 7fa1bdd9b700 1 -- 172.21.15.1:0/3012330937 >> v1:172.21.15.141:6789/0 conn(0x7fa1c01504a0 legacy=0x7fa1c0068cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.429+0000 7fa1bdd9b700 1 -- 172.21.15.1:0/3012330937 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c0062950 con 0x7fa1c00bc2d0 2023-11-15T02:36:44.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.429+0000 7fa1bdd9b700 1 --2- 172.21.15.1:0/3012330937 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1c00bc2d0 0x7fa1c00bd190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fa1a8006fd0 tx=0x7fa1a80090f0).ready entity=mon.2 client_cookie=4dee113a59a340f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:44.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.429+0000 7fa1bd59a700 1 -- 172.21.15.1:0/3012330937 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a800b580 con 0x7fa1c00bc2d0 2023-11-15T02:36:44.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.429+0000 7fa1bd59a700 1 -- 172.21.15.1:0/3012330937 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a800b6e0 con 0x7fa1c00bc2d0 2023-11-15T02:36:44.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.429+0000 7fa1bd59a700 1 -- 172.21.15.1:0/3012330937 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a800ba60 con 0x7fa1c00bc2d0 2023-11-15T02:36:44.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.430+0000 7fa1c4d3d700 1 -- 172.21.15.1:0/3012330937 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1c00bc2d0 msgr2=0x7fa1c00bd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.430+0000 7fa1c4d3d700 1 --2- 172.21.15.1:0/3012330937 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1c00bc2d0 0x7fa1c00bd190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fa1a8006fd0 tx=0x7fa1a80090f0).stop 2023-11-15T02:36:44.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.430+0000 7fa1c4d3d700 1 -- 172.21.15.1:0/3012330937 shutdown_connections 2023-11-15T02:36:44.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.430+0000 7fa1c4d3d700 1 --2- 172.21.15.1:0/3012330937 >> v2:172.21.15.141:3300/0 conn(0x7fa1c0150880 0x7fa1c00c1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.430+0000 7fa1c4d3d700 1 --2- 172.21.15.1:0/3012330937 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1c00bc2d0 0x7fa1c00bd190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.430+0000 7fa1c4d3d700 1 -- 172.21.15.1:0/3012330937 >> 172.21.15.1:0/3012330937 conn(0x7fa1c00c3750 msgr2=0x7fa1c00c3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:44.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.430+0000 7fa1c4d3d700 1 -- 172.21.15.1:0/3012330937 shutdown_connections 2023-11-15T02:36:44.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.430+0000 7fa1c4d3d700 1 -- 172.21.15.1:0/3012330937 wait complete. 2023-11-15T02:36:44.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.431+0000 7fa1c4d3d700 1 Processor -- start 2023-11-15T02:36:44.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.431+0000 7fa1c4d3d700 1 -- start start 2023-11-15T02:36:44.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1c4d3d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1c00bc2d0 0x7fa1c0143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1c4d3d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1c01504a0 0x7fa1c00a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1c4d3d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1c0150880 0x7fa1c00a94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1c4d3d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c00c0bd0 con 0x7fa1c0150880 2023-11-15T02:36:44.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1c4d3d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c00c1060 con 0x7fa1c00bc2d0 2023-11-15T02:36:44.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1c4d3d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c00bffc0 con 0x7fa1c01504a0 2023-11-15T02:36:44.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1bed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1c0150880 0x7fa1c00a94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1bed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1c0150880 0x7fa1c00a94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53242/0 (socket says 172.21.15.1:53242) 2023-11-15T02:36:44.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1bed9d700 1 -- 172.21.15.1:0/4028403388 learned_addr learned my addr 172.21.15.1:0/4028403388 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:44.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1be59c700 1 --2- 172.21.15.1:0/4028403388 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1c00bc2d0 0x7fa1c0143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1bdd9b700 1 --2- 172.21.15.1:0/4028403388 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1c01504a0 0x7fa1c00a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1bed9d700 1 -- 172.21.15.1:0/4028403388 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1c01504a0 msgr2=0x7fa1c00a8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1bed9d700 1 --2- 172.21.15.1:0/4028403388 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1c01504a0 0x7fa1c00a8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1bed9d700 1 -- 172.21.15.1:0/4028403388 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1c00bc2d0 msgr2=0x7fa1c0143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1bed9d700 1 --2- 172.21.15.1:0/4028403388 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1c00bc2d0 0x7fa1c0143540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1bed9d700 1 -- 172.21.15.1:0/4028403388 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a8009370 con 0x7fa1c0150880 2023-11-15T02:36:44.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.432+0000 7fa1bed9d700 1 --2- 172.21.15.1:0/4028403388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1c0150880 0x7fa1c00a94e0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7fa1b000e900 tx=0x7fa1b0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:44.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.433+0000 7fa1b67fc700 1 -- 172.21.15.1:0/4028403388 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00093b0 con 0x7fa1c0150880 2023-11-15T02:36:44.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.433+0000 7fa1b67fc700 1 -- 172.21.15.1:0/4028403388 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b0012600 con 0x7fa1c0150880 2023-11-15T02:36:44.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.433+0000 7fa1c4d3d700 1 -- 172.21.15.1:0/4028403388 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c00c02a0 con 0x7fa1c0150880 2023-11-15T02:36:44.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.433+0000 7fa1b67fc700 1 -- 172.21.15.1:0/4028403388 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0012980 con 0x7fa1c0150880 2023-11-15T02:36:44.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.433+0000 7fa1c4d3d700 1 -- 172.21.15.1:0/4028403388 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c00c0860 con 0x7fa1c0150880 2023-11-15T02:36:44.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.434+0000 7fa1c4d3d700 1 -- 172.21.15.1:0/4028403388 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c00475e0 con 0x7fa1c0150880 2023-11-15T02:36:44.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.434+0000 7fa1b67fc700 1 -- 172.21.15.1:0/4028403388 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa1b0012d30 con 0x7fa1c0150880 2023-11-15T02:36:44.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.434+0000 7fa1b67fc700 1 --2- 172.21.15.1:0/4028403388 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa1a005f270 0x7fa1a0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:44.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.434+0000 7fa1b67fc700 1 -- 172.21.15.1:0/4028403388 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fa1b007a730 con 0x7fa1c0150880 2023-11-15T02:36:44.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.435+0000 7fa1be59c700 1 --2- 172.21.15.1:0/4028403388 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa1a005f270 0x7fa1a0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:44.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.435+0000 7fa1be59c700 1 --2- 172.21.15.1:0/4028403388 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa1a005f270 0x7fa1a0061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa1b8004290 tx=0x7fa1b8001560).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:44.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.438+0000 7fa1b67fc700 1 -- 172.21.15.1:0/4028403388 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa1b004b690 con 0x7fa1c0150880 2023-11-15T02:36:44.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.654+0000 7fa1c4d3d700 1 -- 172.21.15.1:0/4028403388 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa1c0062c30 con 0x7fa1c0150880 2023-11-15T02:36:44.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.654+0000 7fa1b67fc700 1 -- 172.21.15.1:0/4028403388 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v71) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa1b004ecb0 con 0x7fa1c0150880 2023-11-15T02:36:44.657 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-15T02:36:44.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.656+0000 7fa1c4d3d700 1 -- 172.21.15.1:0/4028403388 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa1a005f270 msgr2=0x7fa1a0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.656+0000 7fa1c4d3d700 1 --2- 172.21.15.1:0/4028403388 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa1a005f270 0x7fa1a0061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa1b8004290 tx=0x7fa1b8001560).stop 2023-11-15T02:36:44.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.656+0000 7fa1c4d3d700 1 -- 172.21.15.1:0/4028403388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1c0150880 msgr2=0x7fa1c00a94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:44.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.656+0000 7fa1c4d3d700 1 --2- 172.21.15.1:0/4028403388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1c0150880 0x7fa1c00a94e0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7fa1b000e900 tx=0x7fa1b0009060).stop 2023-11-15T02:36:44.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.657+0000 7fa1c4d3d700 1 -- 172.21.15.1:0/4028403388 shutdown_connections 2023-11-15T02:36:44.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.657+0000 7fa1c4d3d700 1 --2- 172.21.15.1:0/4028403388 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fa1a005f270 0x7fa1a0061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.657+0000 7fa1c4d3d700 1 --2- 172.21.15.1:0/4028403388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1c0150880 0x7fa1c00a94e0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.657+0000 7fa1c4d3d700 1 --2- 172.21.15.1:0/4028403388 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1c00bc2d0 0x7fa1c0143540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.657+0000 7fa1c4d3d700 1 --2- 172.21.15.1:0/4028403388 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1c01504a0 0x7fa1c00a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:44.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.657+0000 7fa1c4d3d700 1 -- 172.21.15.1:0/4028403388 >> 172.21.15.1:0/4028403388 conn(0x7fa1c00c3750 msgr2=0x7fa1c0063560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:44.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.657+0000 7fa1c4d3d700 1 -- 172.21.15.1:0/4028403388 shutdown_connections 2023-11-15T02:36:44.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:44.657+0000 7fa1c4d3d700 1 -- 172.21.15.1:0/4028403388 wait complete. 2023-11-15T02:36:44.669 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-15T02:36:44.669 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-15T02:36:44.670 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-11-15T02:36:44.670 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-15T02:36:44.670 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-15T02:36:44.671 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-15T02:36:44.671 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-15T02:36:44.671 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-15T02:36:44.672 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T02:36:44.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:36:44.673 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-11-15T02:36:44.689 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T02:36:44.689 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T02:36:44.689 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T02:36:44.689 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:36:44.689 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-11-15T02:36:44.690 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:36:44.690 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T02:36:44.690 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-11-15T02:36:44.690 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-11-15T02:36:44.690 INFO:teuthology.orchestra.run.smithi001.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-15T02:36:44.691 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-11-15T02:36:44.691 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-11-15T02:36:44.691 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-15T02:36:44.691 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 38000sec preferred_lft 38000sec 2023-11-15T02:36:44.691 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2023-11-15T02:36:44.692 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:36:44.692 INFO:teuthology.orchestra.run.smithi001.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T02:36:44.692 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-11-15T02:36:44.692 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-11-15T02:36:44.692 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T02:36:44.693 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-11-15T02:36:44.693 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-11-15T02:36:44.693 INFO:teuthology.orchestra.run.smithi001.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-15T02:36:44.693 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff 2023-11-15T02:36:44.693 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-15T02:36:44.693 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:36:44.694 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::74ff:4aff:fef6:c8f5/64 scope link 2023-11-15T02:36:44.694 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:36:44.694 INFO:teuthology.orchestra.run.smithi001.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T02:36:44.694 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-15T02:36:44.694 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::10ca:5cff:fe8a:9a23/64 scope link 2023-11-15T02:36:44.695 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:36:44.695 INFO:teuthology.orchestra.run.smithi001.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T02:36:44.695 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 92:7a:64:05:0f:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-15T02:36:44.695 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::907a:64ff:fe05:f37/64 scope link 2023-11-15T02:36:44.695 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:36:44.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:36:44.697 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-15T02:36:44.753 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-11-15T02:36:44.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:36:44.755 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-11-15T02:36:44.812 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-11-15T02:36:44.812 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-15T02:36:44.813 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-15T02:36:44.813 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-15T02:36:44.813 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-15T02:36:44.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:36:44.814 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T02:36:44.814 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T02:36:44.815 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-15T02:36:44.815 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-15T02:36:44.816 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-15T02:36:44.816 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T02:36:44.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:36:44.915 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T02:36:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-15T02:36:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-15T02:36:44.931 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T02:36:44.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:36:44.935 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2023-11-15T02:36:44.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:36:44.996 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-15T02:36:45.051 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-15T02:36:45.051 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T02:36:45.132 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T02:36:45.132 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T02:36:45.158 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T02:36:45.158 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T02:36:45.160 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-15T02:36:45.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:36:45.161 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-15T02:36:45.227 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-15T02:36:45.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.384+0000 7f0ca1319700 1 Processor -- start 2023-11-15T02:36:45.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.384+0000 7f0ca1319700 1 -- start start 2023-11-15T02:36:45.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.384+0000 7f0ca1319700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0c9c154150 0x7f0c9c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:45.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.384+0000 7f0ca1319700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0c9c0ab1a0 0x7f0c9c158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:45.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.384+0000 7f0ca1319700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9c0c06f0 con 0x7f0c9c0aa060 2023-11-15T02:36:45.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.384+0000 7f0ca1319700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c0c09d0 con 0x7f0c9c0ab1a0 2023-11-15T02:36:45.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.384+0000 7f0ca1319700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c158820 con 0x7f0c9c154150 2023-11-15T02:36:45.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.385+0000 7f0c9a7fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0c9c0ab1a0 0x7f0c9c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:45.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.385+0000 7f0c9a7fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0c9c0ab1a0 0x7f0c9c158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53246/0 (socket says 172.21.15.1:53246) 2023-11-15T02:36:45.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.385+0000 7f0c9a7fc700 1 -- 172.21.15.1:0/3123338591 learned_addr learned my addr 172.21.15.1:0/3123338591 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:45.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.385+0000 7f0c9affd700 1 --2- 172.21.15.1:0/3123338591 >> v2:172.21.15.141:3300/0 conn(0x7f0c9c154150 0x7f0c9c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:45.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.385+0000 7f0c9a7fc700 1 -- 172.21.15.1:0/3123338591 >> v2:172.21.15.141:3300/0 conn(0x7f0c9c154150 msgr2=0x7f0c9c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:45.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.385+0000 7f0c9a7fc700 1 --2- 172.21.15.1:0/3123338591 >> v2:172.21.15.141:3300/0 conn(0x7f0c9c154150 0x7f0c9c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:45.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.385+0000 7f0c9a7fc700 1 -- 172.21.15.1:0/3123338591 >> v1:172.21.15.141:6789/0 conn(0x7f0c9c0aa060 legacy=0x7f0c9c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:45.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.385+0000 7f0c9a7fc700 1 -- 172.21.15.1:0/3123338591 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c158b00 con 0x7f0c9c0ab1a0 2023-11-15T02:36:45.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.385+0000 7f0c9a7fc700 1 --2- 172.21.15.1:0/3123338591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9c0ab1a0 0x7f0c9c158040 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f0c9c06bfb0 tx=0x7f0c840090f0).ready entity=mon.0 client_cookie=7add03e09ce10850 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:45.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.385+0000 7f0c99ffb700 1 -- 172.21.15.1:0/3123338591 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8400b5a0 con 0x7f0c9c0ab1a0 2023-11-15T02:36:45.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.385+0000 7f0c99ffb700 1 -- 172.21.15.1:0/3123338591 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8400b700 con 0x7f0c9c0ab1a0 2023-11-15T02:36:45.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.385+0000 7f0c99ffb700 1 -- 172.21.15.1:0/3123338591 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8400baa0 con 0x7f0c9c0ab1a0 2023-11-15T02:36:45.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.386+0000 7f0ca1319700 1 -- 172.21.15.1:0/3123338591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9c0ab1a0 msgr2=0x7f0c9c158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:45.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.386+0000 7f0ca1319700 1 --2- 172.21.15.1:0/3123338591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9c0ab1a0 0x7f0c9c158040 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f0c9c06bfb0 tx=0x7f0c840090f0).stop 2023-11-15T02:36:45.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.386+0000 7f0ca1319700 1 -- 172.21.15.1:0/3123338591 shutdown_connections 2023-11-15T02:36:45.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.386+0000 7f0ca1319700 1 --2- 172.21.15.1:0/3123338591 >> v2:172.21.15.141:3300/0 conn(0x7f0c9c154150 0x7f0c9c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.386+0000 7f0ca1319700 1 --2- 172.21.15.1:0/3123338591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9c0ab1a0 0x7f0c9c158040 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.386+0000 7f0ca1319700 1 -- 172.21.15.1:0/3123338591 >> 172.21.15.1:0/3123338591 conn(0x7f0c9c064aa0 msgr2=0x7f0c9c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.386+0000 7f0ca1319700 1 -- 172.21.15.1:0/3123338591 shutdown_connections 2023-11-15T02:36:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.386+0000 7f0ca1319700 1 -- 172.21.15.1:0/3123338591 wait complete. 2023-11-15T02:36:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.387+0000 7f0ca1319700 1 Processor -- start 2023-11-15T02:36:45.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.387+0000 7f0ca1319700 1 -- start start 2023-11-15T02:36:45.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0ca1319700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c9c0aa060 0x7f0c9c144830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:45.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0ca1319700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c9c0ab1a0 0x7f0c9c0af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:45.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0ca1319700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9c154150 0x7f0c9c0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:45.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0ca1319700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c0af0f0 con 0x7f0c9c154150 2023-11-15T02:36:45.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0ca1319700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c0ae4e0 con 0x7f0c9c0aa060 2023-11-15T02:36:45.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0ca1319700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c0ae7c0 con 0x7f0c9c0ab1a0 2023-11-15T02:36:45.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0c9b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9c154150 0x7f0c9c0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:45.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0c9affd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c9c0aa060 0x7f0c9c144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:45.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0c9b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9c154150 0x7f0c9c0afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53252/0 (socket says 172.21.15.1:53252) 2023-11-15T02:36:45.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0c9affd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c9c0aa060 0x7f0c9c144830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:40970/0 (socket says 172.21.15.1:40970) 2023-11-15T02:36:45.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0c9b7fe700 1 -- 172.21.15.1:0/1762403085 learned_addr learned my addr 172.21.15.1:0/1762403085 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:45.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0c9a7fc700 1 --2- 172.21.15.1:0/1762403085 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c9c0ab1a0 0x7f0c9c0af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:45.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0c9b7fe700 1 -- 172.21.15.1:0/1762403085 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c9c0ab1a0 msgr2=0x7f0c9c0af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:45.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0c9b7fe700 1 --2- 172.21.15.1:0/1762403085 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c9c0ab1a0 0x7f0c9c0af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:45.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0c9b7fe700 1 -- 172.21.15.1:0/1762403085 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c9c0aa060 msgr2=0x7f0c9c144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:45.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0c9b7fe700 1 --2- 172.21.15.1:0/1762403085 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c9c0aa060 0x7f0c9c144830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:45.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.388+0000 7f0c9b7fe700 1 -- 172.21.15.1:0/1762403085 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c84009370 con 0x7f0c9c154150 2023-11-15T02:36:45.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.389+0000 7f0c9b7fe700 1 --2- 172.21.15.1:0/1762403085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9c154150 0x7f0c9c0afa70 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f0c9400c810 tx=0x7f0c94002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:45.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.389+0000 7f0c92ffd700 1 -- 172.21.15.1:0/1762403085 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94010510 con 0x7f0c9c154150 2023-11-15T02:36:45.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.389+0000 7f0c92ffd700 1 -- 172.21.15.1:0/1762403085 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c94010690 con 0x7f0c9c154150 2023-11-15T02:36:45.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.389+0000 7f0ca1319700 1 -- 172.21.15.1:0/1762403085 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9c0aeaa0 con 0x7f0c9c154150 2023-11-15T02:36:45.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.389+0000 7f0c92ffd700 1 -- 172.21.15.1:0/1762403085 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94010a50 con 0x7f0c9c154150 2023-11-15T02:36:45.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.389+0000 7f0ca1319700 1 -- 172.21.15.1:0/1762403085 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c0ae050 con 0x7f0c9c154150 2023-11-15T02:36:45.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.390+0000 7f0ca1319700 1 -- 172.21.15.1:0/1762403085 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c0aef40 con 0x7f0c9c154150 2023-11-15T02:36:45.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.390+0000 7f0c92ffd700 1 -- 172.21.15.1:0/1762403085 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0c94012440 con 0x7f0c9c154150 2023-11-15T02:36:45.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.390+0000 7f0c92ffd700 1 --2- 172.21.15.1:0/1762403085 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0c7c05f270 0x7f0c7c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:45.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.390+0000 7f0c92ffd700 1 -- 172.21.15.1:0/1762403085 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f0c94079e70 con 0x7f0c9c154150 2023-11-15T02:36:45.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.391+0000 7f0c9affd700 1 --2- 172.21.15.1:0/1762403085 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0c7c05f270 0x7f0c7c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:45.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.391+0000 7f0c9affd700 1 --2- 172.21.15.1:0/1762403085 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0c7c05f270 0x7f0c7c061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0c9c0c6d00 tx=0x7f0c8c008040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:45.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.395+0000 7f0c92ffd700 1 -- 172.21.15.1:0/1762403085 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0c94048af0 con 0x7f0c9c154150 2023-11-15T02:36:45.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.596+0000 7f0ca1319700 1 -- 172.21.15.1:0/1762403085 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c9c06c7e0 con 0x7f0c7c05f270 2023-11-15T02:36:45.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.597+0000 7f0c92ffd700 1 -- 172.21.15.1:0/1762403085 <== mgr.8421 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0c9c06c7e0 con 0x7f0c7c05f270 2023-11-15T02:36:45.599 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T02:36:45.599 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:36:45.600 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephfs" 2023-11-15T02:36:45.600 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:36:45.600 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T02:36:45.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.599+0000 7f0ca1319700 1 -- 172.21.15.1:0/1762403085 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0c7c05f270 msgr2=0x7f0c7c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:45.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.599+0000 7f0ca1319700 1 --2- 172.21.15.1:0/1762403085 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0c7c05f270 0x7f0c7c061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0c9c0c6d00 tx=0x7f0c8c008040).stop 2023-11-15T02:36:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.599+0000 7f0ca1319700 1 -- 172.21.15.1:0/1762403085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9c154150 msgr2=0x7f0c9c0afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.599+0000 7f0ca1319700 1 --2- 172.21.15.1:0/1762403085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9c154150 0x7f0c9c0afa70 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f0c9400c810 tx=0x7f0c94002560).stop 2023-11-15T02:36:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.599+0000 7f0ca1319700 1 -- 172.21.15.1:0/1762403085 shutdown_connections 2023-11-15T02:36:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.599+0000 7f0ca1319700 1 --2- 172.21.15.1:0/1762403085 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0c7c05f270 0x7f0c7c061730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.599+0000 7f0ca1319700 1 --2- 172.21.15.1:0/1762403085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9c154150 0x7f0c9c0afa70 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:45.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.599+0000 7f0ca1319700 1 --2- 172.21.15.1:0/1762403085 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c9c0aa060 0x7f0c9c144830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:45.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.599+0000 7f0ca1319700 1 --2- 172.21.15.1:0/1762403085 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c9c0ab1a0 0x7f0c9c0af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:45.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.599+0000 7f0ca1319700 1 -- 172.21.15.1:0/1762403085 >> 172.21.15.1:0/1762403085 conn(0x7f0c9c064aa0 msgr2=0x7f0c9c0c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:45.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.599+0000 7f0ca1319700 1 -- 172.21.15.1:0/1762403085 shutdown_connections 2023-11-15T02:36:45.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.599+0000 7f0ca1319700 1 -- 172.21.15.1:0/1762403085 wait complete. 2023-11-15T02:36:45.614 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-15T02:36:45.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.732+0000 7f03f9ee2700 1 Processor -- start 2023-11-15T02:36:45.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.733+0000 7f03f9ee2700 1 -- start start 2023-11-15T02:36:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.733+0000 7f03f9ee2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f03f413b990 0x7f03f41568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.733+0000 7f03f9ee2700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f03f40a8ab0 0x7f03f40c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:45.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.733+0000 7f03f9ee2700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f40c7760 con 0x7f03f413bd70 2023-11-15T02:36:45.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.733+0000 7f03f9ee2700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f4067340 con 0x7f03f413b990 2023-11-15T02:36:45.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.733+0000 7f03f9ee2700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f4067060 con 0x7f03f40a8ab0 2023-11-15T02:36:45.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.734+0000 7f03f37fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f03f413b990 0x7f03f41568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:45.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.734+0000 7f03f37fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f03f413b990 0x7f03f41568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53266/0 (socket says 172.21.15.1:53266) 2023-11-15T02:36:45.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.734+0000 7f03f37fe700 1 -- 172.21.15.1:0/3372427503 learned_addr learned my addr 172.21.15.1:0/3372427503 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:45.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.734+0000 7f03f3fff700 1 --2- 172.21.15.1:0/3372427503 >> v2:172.21.15.141:3300/0 conn(0x7f03f40a8ab0 0x7f03f40c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:45.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.734+0000 7f03f37fe700 1 -- 172.21.15.1:0/3372427503 >> v2:172.21.15.141:3300/0 conn(0x7f03f40a8ab0 msgr2=0x7f03f40c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:45.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.734+0000 7f03f37fe700 1 --2- 172.21.15.1:0/3372427503 >> v2:172.21.15.141:3300/0 conn(0x7f03f40a8ab0 0x7f03f40c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:45.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.734+0000 7f03f37fe700 1 -- 172.21.15.1:0/3372427503 >> v1:172.21.15.1:6789/0 conn(0x7f03f413bd70 legacy=0x7f03f4066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:45.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.734+0000 7f03f37fe700 1 -- 172.21.15.1:0/3372427503 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f40c7110 con 0x7f03f413b990 2023-11-15T02:36:45.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.734+0000 7f03f27fc700 1 -- 172.21.15.1:0/3372427503 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763086746 0 0) 0x7f03f40c7760 con 0x7f03f413bd70 2023-11-15T02:36:45.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.734+0000 7f03f37fe700 1 --2- 172.21.15.1:0/3372427503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03f413b990 0x7f03f41568c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f03f40c6ea0 tx=0x7f03e40090f0).ready entity=mon.0 client_cookie=2a84ed2fcfcc8d24 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:45.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.734+0000 7f03f27fc700 1 -- 172.21.15.1:0/3372427503 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e400b600 con 0x7f03f413b990 2023-11-15T02:36:45.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.734+0000 7f03f27fc700 1 -- 172.21.15.1:0/3372427503 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e400b760 con 0x7f03f413b990 2023-11-15T02:36:45.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.734+0000 7f03f27fc700 1 -- 172.21.15.1:0/3372427503 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e400bae0 con 0x7f03f413b990 2023-11-15T02:36:45.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.735+0000 7f03f9ee2700 1 -- 172.21.15.1:0/3372427503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03f413b990 msgr2=0x7f03f41568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:45.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.735+0000 7f03f9ee2700 1 --2- 172.21.15.1:0/3372427503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03f413b990 0x7f03f41568c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f03f40c6ea0 tx=0x7f03e40090f0).stop 2023-11-15T02:36:45.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.735+0000 7f03f9ee2700 1 -- 172.21.15.1:0/3372427503 shutdown_connections 2023-11-15T02:36:45.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.735+0000 7f03f9ee2700 1 --2- 172.21.15.1:0/3372427503 >> v2:172.21.15.141:3300/0 conn(0x7f03f40a8ab0 0x7f03f40c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:45.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.735+0000 7f03f9ee2700 1 --2- 172.21.15.1:0/3372427503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03f413b990 0x7f03f41568c0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:45.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.735+0000 7f03f9ee2700 1 -- 172.21.15.1:0/3372427503 >> 172.21.15.1:0/3372427503 conn(0x7f03f4063280 msgr2=0x7f03f40c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:45.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.735+0000 7f03f9ee2700 1 -- 172.21.15.1:0/3372427503 shutdown_connections 2023-11-15T02:36:45.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.735+0000 7f03f9ee2700 1 -- 172.21.15.1:0/3372427503 wait complete. 2023-11-15T02:36:45.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.736+0000 7f03f9ee2700 1 Processor -- start 2023-11-15T02:36:45.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.736+0000 7f03f9ee2700 1 -- start start 2023-11-15T02:36:45.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f9ee2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03f40a8ab0 0x7f03f4151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:45.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f9ee2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f413b990 0x7f03f40aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:45.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f9ee2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03f40c17f0 0x7f03f4139550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:45.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f9ee2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40ac040 con 0x7f03f40a8ab0 2023-11-15T02:36:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f9ee2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4151c30 con 0x7f03f40c17f0 2023-11-15T02:36:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f9ee2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40c28e0 con 0x7f03f413b990 2023-11-15T02:36:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03f40a8ab0 0x7f03f4151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03f40a8ab0 0x7f03f4151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53282/0 (socket says 172.21.15.1:53282) 2023-11-15T02:36:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f37fe700 1 -- 172.21.15.1:0/1443211760 learned_addr learned my addr 172.21.15.1:0/1443211760 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f2ffd700 1 --2- 172.21.15.1:0/1443211760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f413b990 0x7f03f40aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f3fff700 1 --2- 172.21.15.1:0/1443211760 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03f40c17f0 0x7f03f4139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f37fe700 1 -- 172.21.15.1:0/1443211760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f413b990 msgr2=0x7f03f40aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:45.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f37fe700 1 --2- 172.21.15.1:0/1443211760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f413b990 0x7f03f40aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:45.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f37fe700 1 -- 172.21.15.1:0/1443211760 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03f40c17f0 msgr2=0x7f03f4139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:45.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f37fe700 1 --2- 172.21.15.1:0/1443211760 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03f40c17f0 0x7f03f4139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:45.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f37fe700 1 -- 172.21.15.1:0/1443211760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e4009370 con 0x7f03f40a8ab0 2023-11-15T02:36:45.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f2ffd700 1 --2- 172.21.15.1:0/1443211760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f413b990 0x7f03f40aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:45.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03f37fe700 1 --2- 172.21.15.1:0/1443211760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03f40a8ab0 0x7f03f4151740 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f03e4009130 tx=0x7f03e4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:45.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.737+0000 7f03db7fe700 1 -- 172.21.15.1:0/1443211760 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e400bae0 con 0x7f03f40a8ab0 2023-11-15T02:36:45.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.738+0000 7f03db7fe700 1 -- 172.21.15.1:0/1443211760 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e4000c90 con 0x7f03f40a8ab0 2023-11-15T02:36:45.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.738+0000 7f03db7fe700 1 -- 172.21.15.1:0/1443211760 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e401c670 con 0x7f03f40a8ab0 2023-11-15T02:36:45.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.738+0000 7f03f9ee2700 1 -- 172.21.15.1:0/1443211760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f4137de0 con 0x7f03f40a8ab0 2023-11-15T02:36:45.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.738+0000 7f03f9ee2700 1 -- 172.21.15.1:0/1443211760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f40c1fb0 con 0x7f03f40a8ab0 2023-11-15T02:36:45.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.739+0000 7f03f9ee2700 1 -- 172.21.15.1:0/1443211760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f406c7e0 con 0x7f03f40a8ab0 2023-11-15T02:36:45.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.739+0000 7f03db7fe700 1 -- 172.21.15.1:0/1443211760 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f03e401ca20 con 0x7f03f40a8ab0 2023-11-15T02:36:45.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.740+0000 7f03db7fe700 1 --2- 172.21.15.1:0/1443211760 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f03e005f270 0x7f03e0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:45.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.740+0000 7f03db7fe700 1 -- 172.21.15.1:0/1443211760 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f03e407c320 con 0x7f03f40a8ab0 2023-11-15T02:36:45.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.740+0000 7f03f2ffd700 1 --2- 172.21.15.1:0/1443211760 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f03e005f270 0x7f03e0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:45.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.740+0000 7f03f2ffd700 1 --2- 172.21.15.1:0/1443211760 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f03e005f270 0x7f03e0061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f03e8007fd0 tx=0x7f03e8009040).ready entity=mgr.8421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:45.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.744+0000 7f03db7fe700 1 -- 172.21.15.1:0/1443211760 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f03e404d280 con 0x7f03f40a8ab0 2023-11-15T02:36:45.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:45.962+0000 7f03f9ee2700 1 -- 172.21.15.1:0/1443211760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f03f40c73f0 con 0x7f03f40a8ab0 2023-11-15T02:36:46.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.609+0000 7f03db7fe700 1 -- 172.21.15.1:0/1443211760 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 68) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f03e4079d80 con 0x7f03f40a8ab0 2023-11-15T02:36:46.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.611+0000 7f03db7fe700 1 -- 172.21.15.1:0/1443211760 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v68) v1 ==== 92+0+0 (secure 0 0 0) 0x7f03e4043160 con 0x7f03f40a8ab0 2023-11-15T02:36:46.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.614+0000 7f03f9ee2700 1 -- 172.21.15.1:0/1443211760 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f03e005f270 msgr2=0x7f03e0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:46.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.614+0000 7f03f9ee2700 1 --2- 172.21.15.1:0/1443211760 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f03e005f270 0x7f03e0061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f03e8007fd0 tx=0x7f03e8009040).stop 2023-11-15T02:36:46.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.614+0000 7f03f9ee2700 1 -- 172.21.15.1:0/1443211760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03f40a8ab0 msgr2=0x7f03f4151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:46.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.614+0000 7f03f9ee2700 1 --2- 172.21.15.1:0/1443211760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03f40a8ab0 0x7f03f4151740 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f03e4009130 tx=0x7f03e4017000).stop 2023-11-15T02:36:46.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.614+0000 7f03f9ee2700 1 -- 172.21.15.1:0/1443211760 shutdown_connections 2023-11-15T02:36:46.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.614+0000 7f03f9ee2700 1 --2- 172.21.15.1:0/1443211760 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f03e005f270 0x7f03e0061730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:46.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.614+0000 7f03f9ee2700 1 --2- 172.21.15.1:0/1443211760 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03f40c17f0 0x7f03f4139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:46.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.614+0000 7f03f9ee2700 1 --2- 172.21.15.1:0/1443211760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03f40a8ab0 0x7f03f4151740 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:46.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.614+0000 7f03f9ee2700 1 --2- 172.21.15.1:0/1443211760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f413b990 0x7f03f40aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:46.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.614+0000 7f03f9ee2700 1 -- 172.21.15.1:0/1443211760 >> 172.21.15.1:0/1443211760 conn(0x7f03f4063280 msgr2=0x7f03f40bf620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:46.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.614+0000 7f03f9ee2700 1 -- 172.21.15.1:0/1443211760 shutdown_connections 2023-11-15T02:36:46.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.614+0000 7f03f9ee2700 1 -- 172.21.15.1:0/1443211760 wait complete. 2023-11-15T02:36:46.631 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-15T02:36:46.756 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:46.754+0000 7f11fa175680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:36:46.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.757+0000 7effe7f75700 1 Processor -- start 2023-11-15T02:36:46.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.757+0000 7effe7f75700 1 -- start start 2023-11-15T02:36:46.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.758+0000 7effe7f75700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7effe01540a0 0x7effe00ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:46.760 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:46.758+0000 7f77cfd24680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:36:46.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.758+0000 7effe7f75700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7effe0154480 0x7effe00ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:46.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.758+0000 7effe7f75700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe00ca050 con 0x7effe00c5f40 2023-11-15T02:36:46.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.758+0000 7effe7f75700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe00c9440 con 0x7effe01540a0 2023-11-15T02:36:46.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.758+0000 7effe7f75700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe00c9720 con 0x7effe0154480 2023-11-15T02:36:46.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.758+0000 7effe5d11700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7effe01540a0 0x7effe00ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:46.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.758+0000 7effe5d11700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7effe01540a0 0x7effe00ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53294/0 (socket says 172.21.15.1:53294) 2023-11-15T02:36:46.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.758+0000 7effe5d11700 1 -- 172.21.15.1:0/1434196761 learned_addr learned my addr 172.21.15.1:0/1434196761 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:46.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.759+0000 7effe5510700 1 --2- 172.21.15.1:0/1434196761 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7effe0154480 0x7effe00ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:46.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.759+0000 7effe5d11700 1 -- 172.21.15.1:0/1434196761 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7effe0154480 msgr2=0x7effe00ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:46.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.759+0000 7effe5d11700 1 --2- 172.21.15.1:0/1434196761 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7effe0154480 0x7effe00ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:46.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.759+0000 7effe5d11700 1 -- 172.21.15.1:0/1434196761 >> v1:172.21.15.141:6789/0 conn(0x7effe00c5f40 legacy=0x7effe00aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:46.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.759+0000 7effe4d0f700 1 -- 172.21.15.1:0/1434196761 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613207076 0 0) 0x7effe00ca050 con 0x7effe00c5f40 2023-11-15T02:36:46.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.759+0000 7effe5d11700 1 -- 172.21.15.1:0/1434196761 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe00c9a00 con 0x7effe01540a0 2023-11-15T02:36:46.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.759+0000 7effe5d11700 1 --2- 172.21.15.1:0/1434196761 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe01540a0 0x7effe00ca4e0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7effd0006fd0 tx=0x7effd00090f0).ready entity=mon.0 client_cookie=377c072081806d1b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:46.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.759+0000 7effe4d0f700 1 -- 172.21.15.1:0/1434196761 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd000b580 con 0x7effe01540a0 2023-11-15T02:36:46.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.759+0000 7effe4d0f700 1 -- 172.21.15.1:0/1434196761 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd000b6e0 con 0x7effe01540a0 2023-11-15T02:36:46.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.759+0000 7effe4d0f700 1 -- 172.21.15.1:0/1434196761 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd000ba60 con 0x7effe01540a0 2023-11-15T02:36:46.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.760+0000 7effe7f75700 1 -- 172.21.15.1:0/1434196761 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe01540a0 msgr2=0x7effe00ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:46.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.760+0000 7effe7f75700 1 --2- 172.21.15.1:0/1434196761 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe01540a0 0x7effe00ca4e0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7effd0006fd0 tx=0x7effd00090f0).stop 2023-11-15T02:36:46.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.760+0000 7effe7f75700 1 -- 172.21.15.1:0/1434196761 shutdown_connections 2023-11-15T02:36:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.760+0000 7effe7f75700 1 --2- 172.21.15.1:0/1434196761 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe01540a0 0x7effe00ca4e0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.760+0000 7effe7f75700 1 --2- 172.21.15.1:0/1434196761 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7effe0154480 0x7effe00ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.760+0000 7effe7f75700 1 -- 172.21.15.1:0/1434196761 >> 172.21.15.1:0/1434196761 conn(0x7effe0064a70 msgr2=0x7effe0064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.760+0000 7effe7f75700 1 -- 172.21.15.1:0/1434196761 shutdown_connections 2023-11-15T02:36:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.760+0000 7effe7f75700 1 -- 172.21.15.1:0/1434196761 wait complete. 2023-11-15T02:36:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.761+0000 7effe7f75700 1 Processor -- start 2023-11-15T02:36:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.761+0000 7effe7f75700 1 -- start start 2023-11-15T02:36:46.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe7f75700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7effe00c5f40 0x7effe0152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:46.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe7f75700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe01540a0 0x7effe00ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:46.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe7f75700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7effe0154480 0x7effe00c0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:46.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe7f75700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe0159ba0 con 0x7effe01540a0 2023-11-15T02:36:46.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe7f75700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe0152f90 con 0x7effe0154480 2023-11-15T02:36:46.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe7f75700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe0158f90 con 0x7effe00c5f40 2023-11-15T02:36:46.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe5510700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe01540a0 0x7effe00ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:46.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe5510700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe01540a0 0x7effe00ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53300/0 (socket says 172.21.15.1:53300) 2023-11-15T02:36:46.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe5510700 1 -- 172.21.15.1:0/2952402453 learned_addr learned my addr 172.21.15.1:0/2952402453 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:46.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe6512700 1 --2- 172.21.15.1:0/2952402453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7effe0154480 0x7effe00c0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:46.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe5d11700 1 --2- 172.21.15.1:0/2952402453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7effe00c5f40 0x7effe0152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:46.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe5510700 1 -- 172.21.15.1:0/2952402453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7effe00c5f40 msgr2=0x7effe0152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:46.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe5510700 1 --2- 172.21.15.1:0/2952402453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7effe00c5f40 0x7effe0152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:46.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe5510700 1 -- 172.21.15.1:0/2952402453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7effe0154480 msgr2=0x7effe00c0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:46.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe5510700 1 --2- 172.21.15.1:0/2952402453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7effe0154480 0x7effe00c0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:46.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe5510700 1 -- 172.21.15.1:0/2952402453 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd0009370 con 0x7effe01540a0 2023-11-15T02:36:46.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effe5510700 1 --2- 172.21.15.1:0/2952402453 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe01540a0 0x7effe00ae8c0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7effdc00e980 tx=0x7effdc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:46.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.762+0000 7effd5ffb700 1 -- 172.21.15.1:0/2952402453 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc012600 con 0x7effe01540a0 2023-11-15T02:36:46.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.763+0000 7effd5ffb700 1 -- 172.21.15.1:0/2952402453 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc012760 con 0x7effe01540a0 2023-11-15T02:36:46.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.763+0000 7effd5ffb700 1 -- 172.21.15.1:0/2952402453 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc012ae0 con 0x7effe01540a0 2023-11-15T02:36:46.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.763+0000 7effe7f75700 1 -- 172.21.15.1:0/2952402453 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe0159270 con 0x7effe01540a0 2023-11-15T02:36:46.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.763+0000 7effe7f75700 1 -- 172.21.15.1:0/2952402453 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe0159830 con 0x7effe01540a0 2023-11-15T02:36:46.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.764+0000 7effe7f75700 1 -- 172.21.15.1:0/2952402453 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe006c7e0 con 0x7effe01540a0 2023-11-15T02:36:46.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.764+0000 7effd5ffb700 1 -- 172.21.15.1:0/2952402453 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 68) v1 ==== 75565+0+0 (secure 0 0 0) 0x7effdc01b400 con 0x7effe01540a0 2023-11-15T02:36:46.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.764+0000 7effd5ffb700 1 --2- 172.21.15.1:0/2952402453 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7effc405f290 0x7effc4061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:46.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.765+0000 7effd5ffb700 1 -- 172.21.15.1:0/2952402453 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6617+0+0 (secure 0 0 0) 0x7effdc07aaa0 con 0x7effe01540a0 2023-11-15T02:36:46.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.765+0000 7effe5d11700 1 -- 172.21.15.1:0/2952402453 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7effc405f290 msgr2=0x7effc4061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:46.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.765+0000 7effe5d11700 1 --2- 172.21.15.1:0/2952402453 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7effc405f290 0x7effc4061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:46.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.769+0000 7effd5ffb700 1 -- 172.21.15.1:0/2952402453 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7effdc04ba00 con 0x7effe01540a0 2023-11-15T02:36:46.820 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:46.818+0000 7f11fa175680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:36:46.827 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:46.826+0000 7f77cfd24680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:36:46.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.946+0000 7effe7f75700 1 -- 172.21.15.1:0/2952402453 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7effe00c9ce0 con 0x7effe01540a0 2023-11-15T02:36:46.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.950+0000 7effd5ffb700 1 -- 172.21.15.1:0/2952402453 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7effdc016020 con 0x7effe01540a0 2023-11-15T02:36:46.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.952+0000 7effe7f75700 1 -- 172.21.15.1:0/2952402453 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7effc405f290 msgr2=0x7effc4061750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:46.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.952+0000 7effe7f75700 1 --2- 172.21.15.1:0/2952402453 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7effc405f290 0x7effc4061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:46.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.952+0000 7effe7f75700 1 -- 172.21.15.1:0/2952402453 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe01540a0 msgr2=0x7effe00ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:46.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.952+0000 7effe7f75700 1 --2- 172.21.15.1:0/2952402453 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe01540a0 0x7effe00ae8c0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7effdc00e980 tx=0x7effdc009060).stop 2023-11-15T02:36:46.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.952+0000 7effe7f75700 1 -- 172.21.15.1:0/2952402453 shutdown_connections 2023-11-15T02:36:46.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.952+0000 7effe7f75700 1 --2- 172.21.15.1:0/2952402453 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7effc405f290 0x7effc4061750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:46.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.952+0000 7effe7f75700 1 --2- 172.21.15.1:0/2952402453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7effe0154480 0x7effe00c0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:46.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.952+0000 7effe7f75700 1 --2- 172.21.15.1:0/2952402453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7effe00c5f40 0x7effe0152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:46.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.952+0000 7effe7f75700 1 --2- 172.21.15.1:0/2952402453 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7effe01540a0 0x7effe00ae8c0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:46.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.952+0000 7effe7f75700 1 -- 172.21.15.1:0/2952402453 >> 172.21.15.1:0/2952402453 conn(0x7effe0064a70 msgr2=0x7effe00c1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:46.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.952+0000 7effe7f75700 1 -- 172.21.15.1:0/2952402453 shutdown_connections 2023-11-15T02:36:46.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:46.952+0000 7effe7f75700 1 -- 172.21.15.1:0/2952402453 wait complete. 2023-11-15T02:36:46.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:46.967 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-15T02:36:46.987 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-11-15T02:36:47.093 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:47.091+0000 7f11fa175680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:36:47.121 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:47.119+0000 7f77cfd24680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:36:47.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.150+0000 7f6a6aeec700 1 Processor -- start 2023-11-15T02:36:47.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.150+0000 7f6a6aeec700 1 -- start start 2023-11-15T02:36:47.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.151+0000 7f6a6aeec700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a64157660 0x7f6a64157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:47.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.151+0000 7f6a6aeec700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6a640c1cb0 0x7f6a640c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:47.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.151+0000 7f6a6aeec700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a640c1820 con 0x7f6a640c6770 2023-11-15T02:36:47.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.151+0000 7f6a6aeec700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a640c7540 con 0x7f6a640c1cb0 2023-11-15T02:36:47.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.151+0000 7f6a6aeec700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640c0c30 con 0x7f6a64157660 2023-11-15T02:36:47.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.151+0000 7f6a63fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6a640c1cb0 0x7f6a640c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:47.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.151+0000 7f6a63fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6a640c1cb0 0x7f6a640c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53304/0 (socket says 172.21.15.1:53304) 2023-11-15T02:36:47.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.151+0000 7f6a63fff700 1 -- 172.21.15.1:0/3980217186 learned_addr learned my addr 172.21.15.1:0/3980217186 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:47.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.151+0000 7f6a69489700 1 --1- 172.21.15.1:0/3980217186 >> v1:172.21.15.1:6789/0 conn(0x7f6a640c6770 0x7f6a640aa060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41790/0 (socket says 172.21.15.1:41790) 2023-11-15T02:36:47.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.151+0000 7f6a68c88700 1 --2- 172.21.15.1:0/3980217186 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a64157660 0x7f6a64157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.151+0000 7f6a63fff700 1 -- 172.21.15.1:0/3980217186 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a64157660 msgr2=0x7f6a64157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.151+0000 7f6a63fff700 1 --2- 172.21.15.1:0/3980217186 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a64157660 0x7f6a64157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.151+0000 7f6a63fff700 1 -- 172.21.15.1:0/3980217186 >> v1:172.21.15.1:6789/0 conn(0x7f6a640c6770 legacy=0x7f6a640aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.151+0000 7f6a63fff700 1 -- 172.21.15.1:0/3980217186 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a640c0ef0 con 0x7f6a640c1cb0 2023-11-15T02:36:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.151+0000 7f6a637fe700 1 -- 172.21.15.1:0/3980217186 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302527253 0 0) 0x7f6a640c1820 con 0x7f6a640c6770 2023-11-15T02:36:47.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.152+0000 7f6a63fff700 1 --2- 172.21.15.1:0/3980217186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a640c1cb0 0x7f6a640c6280 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f6a50006fd0 tx=0x7f6a500090f0).ready entity=mon.0 client_cookie=1ad44b6de3f774f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:47.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.152+0000 7f6a637fe700 1 -- 172.21.15.1:0/3980217186 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000b580 con 0x7f6a640c1cb0 2023-11-15T02:36:47.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.152+0000 7f6a637fe700 1 -- 172.21.15.1:0/3980217186 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5000b6e0 con 0x7f6a640c1cb0 2023-11-15T02:36:47.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.152+0000 7f6a637fe700 1 -- 172.21.15.1:0/3980217186 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000ba80 con 0x7f6a640c1cb0 2023-11-15T02:36:47.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.152+0000 7f6a6aeec700 1 -- 172.21.15.1:0/3980217186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a640c1cb0 msgr2=0x7f6a640c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:47.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.152+0000 7f6a6aeec700 1 --2- 172.21.15.1:0/3980217186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a640c1cb0 0x7f6a640c6280 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f6a50006fd0 tx=0x7f6a500090f0).stop 2023-11-15T02:36:47.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.152+0000 7f6a6aeec700 1 -- 172.21.15.1:0/3980217186 shutdown_connections 2023-11-15T02:36:47.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.152+0000 7f6a6aeec700 1 --2- 172.21.15.1:0/3980217186 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a64157660 0x7f6a64157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.152+0000 7f6a6aeec700 1 --2- 172.21.15.1:0/3980217186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a640c1cb0 0x7f6a640c6280 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.152+0000 7f6a6aeec700 1 -- 172.21.15.1:0/3980217186 >> 172.21.15.1:0/3980217186 conn(0x7f6a64064aa0 msgr2=0x7f6a64064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.152+0000 7f6a6aeec700 1 -- 172.21.15.1:0/3980217186 shutdown_connections 2023-11-15T02:36:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.152+0000 7f6a6aeec700 1 -- 172.21.15.1:0/3980217186 wait complete. 2023-11-15T02:36:47.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.154+0000 7f6a6aeec700 1 Processor -- start 2023-11-15T02:36:47.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.154+0000 7f6a6aeec700 1 -- start start 2023-11-15T02:36:47.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.154+0000 7f6a6aeec700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a640c1cb0 0x7f6a640b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:47.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.154+0000 7f6a6aeec700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a640c6770 0x7f6a640aa500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:47.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.154+0000 7f6a6aeec700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a64157660 0x7f6a64167640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:47.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.154+0000 7f6a6aeec700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640aeec0 con 0x7f6a64157660 2023-11-15T02:36:47.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.154+0000 7f6a6aeec700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640b1050 con 0x7f6a640c1cb0 2023-11-15T02:36:47.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.154+0000 7f6a6aeec700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640af660 con 0x7f6a640c6770 2023-11-15T02:36:47.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a69489700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a64157660 0x7f6a64167640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:47.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a69489700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a64157660 0x7f6a64167640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53312/0 (socket says 172.21.15.1:53312) 2023-11-15T02:36:47.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a69489700 1 -- 172.21.15.1:0/4223933979 learned_addr learned my addr 172.21.15.1:0/4223933979 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:47.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a63fff700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a640c6770 0x7f6a640aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:47.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a68c88700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a640c1cb0 0x7f6a640b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:47.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a69489700 1 -- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a640c6770 msgr2=0x7f6a640aa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:47.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a69489700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a640c6770 0x7f6a640aa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:47.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a69489700 1 -- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a640c1cb0 msgr2=0x7f6a640b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:47.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a69489700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a640c1cb0 0x7f6a640b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:47.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a69489700 1 -- 172.21.15.1:0/4223933979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a50009370 con 0x7f6a64157660 2023-11-15T02:36:47.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a68c88700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a640c1cb0 0x7f6a640b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:47.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a69489700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a64157660 0x7f6a64167640 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f6a5c00c7e0 tx=0x7f6a5c007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:47.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a60ff9700 1 -- 172.21.15.1:0/4223933979 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c005c70 con 0x7f6a64157660 2023-11-15T02:36:47.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a60ff9700 1 -- 172.21.15.1:0/4223933979 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c005dd0 con 0x7f6a64157660 2023-11-15T02:36:47.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a60ff9700 1 -- 172.21.15.1:0/4223933979 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c007320 con 0x7f6a64157660 2023-11-15T02:36:47.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a6aeec700 1 -- 172.21.15.1:0/4223933979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a64159470 con 0x7f6a64157660 2023-11-15T02:36:47.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.155+0000 7f6a6aeec700 1 -- 172.21.15.1:0/4223933979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a641596c0 con 0x7f6a64157660 2023-11-15T02:36:47.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.156+0000 7f6a6aeec700 1 -- 172.21.15.1:0/4223933979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a641598b0 con 0x7f6a64157660 2023-11-15T02:36:47.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.157+0000 7f6a60ff9700 1 -- 172.21.15.1:0/4223933979 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 68) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f6a5c007710 con 0x7f6a64157660 2023-11-15T02:36:47.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.157+0000 7f6a60ff9700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 0x7f6a48061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:47.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.157+0000 7f6a60ff9700 1 -- 172.21.15.1:0/4223933979 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f6a5c07a520 con 0x7f6a64157660 2023-11-15T02:36:47.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.157+0000 7f6a68c88700 1 -- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 msgr2=0x7f6a48061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:47.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.157+0000 7f6a68c88700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 0x7f6a48061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:47.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.165+0000 7f6a60ff9700 1 -- 172.21.15.1:0/4223933979 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6a5c04b420 con 0x7f6a64157660 2023-11-15T02:36:47.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.358+0000 7f6a68c88700 1 -- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 msgr2=0x7f6a48061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:47.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.358+0000 7f6a68c88700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 0x7f6a48061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:36:47.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.366+0000 7f6a6aeec700 1 -- 172.21.15.1:0/4223933979 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a640af210 con 0x7f6a4805f2c0 2023-11-15T02:36:47.701 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:47.699+0000 7f11fa175680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:36:47.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.759+0000 7f6a68c88700 1 -- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 msgr2=0x7f6a48061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:47.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:47.759+0000 7f6a68c88700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 0x7f6a48061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-15T02:36:47.773 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:47.771+0000 7f11fa175680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:36:47.793 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:47.791+0000 7f77cfd24680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:36:47.861 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:47.860+0000 7f77cfd24680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:36:47.957 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:47.956+0000 7f11fa175680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:36:48.056 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:48.054+0000 7f77cfd24680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:36:48.375 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:48.374+0000 7f11fa175680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:36:48.477 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:48.476+0000 7f11fa175680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:36:48.494 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:48.492+0000 7f77cfd24680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:36:48.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:48.560+0000 7f6a68c88700 1 -- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 msgr2=0x7f6a48061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:48.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:48.560+0000 7f6a68c88700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 0x7f6a48061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-15T02:36:48.603 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:48.601+0000 7f77cfd24680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:36:48.629 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:48.628+0000 7f11fa175680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:36:48.703 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:48.702+0000 7f11fa175680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:36:48.762 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:48.760+0000 7f77cfd24680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:36:48.769 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:48.768+0000 7f11fa175680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:36:48.840 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:48.838+0000 7f77cfd24680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:36:48.910 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:48.908+0000 7f77cfd24680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:36:49.025 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:49.024+0000 7f11fa175680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:36:49.183 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:49.181+0000 7f77cfd24680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:36:49.208 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:49.207+0000 7f11fa175680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:36:49.373 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:49.371+0000 7f77cfd24680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:36:49.854 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:49.853+0000 7f11fa175680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:36:49.922 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:49.921+0000 7f11fa175680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:36:49.997 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:49.996+0000 7f11fa175680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:36:50.057 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:50.055+0000 7f77cfd24680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:36:50.128 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:50.127+0000 7f77cfd24680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:36:50.142 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.141+0000 7f11fa175680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:36:50.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:50.162+0000 7f6a68c88700 1 -- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 msgr2=0x7f6a48061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:50.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:50.162+0000 7f6a68c88700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 0x7f6a48061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-15T02:36:50.206 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:50.205+0000 7f77cfd24680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:36:50.212 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.211+0000 7f11fa175680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:36:50.327 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.326+0000 7f11fa175680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:36:50.359 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:50.357+0000 7f77cfd24680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:36:50.432 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:50.430+0000 7f77cfd24680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:36:50.434 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.433+0000 7f11fa175680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:36:50.552 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:50.550+0000 7f77cfd24680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:36:50.664 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:50.662+0000 7f77cfd24680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:36:50.724 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.723+0000 7f11fa175680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:36:50.795 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.794+0000 7f11fa175680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:36:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:50.813+0000 7f6a60ff9700 1 -- 172.21.15.1:0/4223933979 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 69) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f6a5c077f80 con 0x7f6a64157660 2023-11-15T02:36:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:50.813+0000 7f6a60ff9700 1 -- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 msgr2=0x7f6a48061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:50.813+0000 7f6a60ff9700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 0x7f6a48061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:50.880 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.878+0000 7f116e8fa700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:50.880 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.878+0000 7f116e8fa700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:50.881 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.878+0000 7f116e8fa700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:50.881 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.878+0000 7f116e8fa700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:50.881 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.878+0000 7f11710ff700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:50.882 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.878+0000 7f11710ff700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:50.882 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.878+0000 7f11710ff700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:50.882 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.878+0000 7f11710ff700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:50.883 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.878+0000 7f11710ff700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:50.883 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:50.878+0000 7f116e8fa700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:50.970 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:50.969+0000 7f77cfd24680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:36:51.045 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:51.043+0000 7f77cfd24680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:36:51.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.817+0000 7f6a60ff9700 1 -- 172.21.15.1:0/4223933979 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 70) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f6a5c078300 con 0x7f6a64157660 2023-11-15T02:36:51.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.817+0000 7f6a60ff9700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 0x7f6a48061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:51.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.817+0000 7f6a60ff9700 1 -- 172.21.15.1:0/4223933979 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a640af210 con 0x7f6a4805f2c0 2023-11-15T02:36:51.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.819+0000 7f6a68c88700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 0x7f6a48061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:51.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.821+0000 7f6a68c88700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 0x7f6a48061700 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f6a58009880 tx=0x7f6a58009060).ready entity=mgr.8035 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:51.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.833+0000 7f6a60ff9700 1 -- 172.21.15.1:0/4223933979 <== mgr.8035 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6a640af210 con 0x7f6a4805f2c0 2023-11-15T02:36:51.834 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path snap_test_dir1 2023-11-15T02:36:51.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.835+0000 7f6a6aeec700 1 -- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 msgr2=0x7f6a48061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:51.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.835+0000 7f6a6aeec700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 0x7f6a48061700 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f6a58009880 tx=0x7f6a58009060).stop 2023-11-15T02:36:51.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.835+0000 7f6a6aeec700 1 -- 172.21.15.1:0/4223933979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a64157660 msgr2=0x7f6a64167640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:51.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.835+0000 7f6a6aeec700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a64157660 0x7f6a64167640 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f6a5c00c7e0 tx=0x7f6a5c007f60).stop 2023-11-15T02:36:51.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.835+0000 7f6a6aeec700 1 -- 172.21.15.1:0/4223933979 shutdown_connections 2023-11-15T02:36:51.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.835+0000 7f6a6aeec700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6a4805f2c0 0x7f6a48061700 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:51.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.835+0000 7f6a6aeec700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a64157660 0x7f6a64167640 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:51.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.835+0000 7f6a6aeec700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a640c1cb0 0x7f6a640b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:51.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.835+0000 7f6a6aeec700 1 --2- 172.21.15.1:0/4223933979 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a640c6770 0x7f6a640aa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:51.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.835+0000 7f6a6aeec700 1 -- 172.21.15.1:0/4223933979 >> 172.21.15.1:0/4223933979 conn(0x7f6a64064aa0 msgr2=0x7f6a64153580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:51.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.835+0000 7f6a6aeec700 1 -- 172.21.15.1:0/4223933979 shutdown_connections 2023-11-15T02:36:51.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.835+0000 7f6a6aeec700 1 -- 172.21.15.1:0/4223933979 wait complete. 2023-11-15T02:36:51.851 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-11-15T02:36:51.852 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-11-15T02:36:51.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.980+0000 7f048f59e700 1 Processor -- start 2023-11-15T02:36:51.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.980+0000 7f048f59e700 1 -- start start 2023-11-15T02:36:51.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.981+0000 7f048f59e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f04900ada30 0x7f04900c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:51.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.981+0000 7f048f59e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04900c67d0 0x7f04900aba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:51.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.981+0000 7f048f59e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04900caee0 con 0x7f04900ca400 2023-11-15T02:36:51.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.981+0000 7f048f59e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0490154850 con 0x7f04900ada30 2023-11-15T02:36:51.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.981+0000 7f048f59e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04900ca920 con 0x7f04900c67d0 2023-11-15T02:36:51.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.981+0000 7f048ed9d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04900c67d0 0x7f04900aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:51.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.981+0000 7f048e59c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f04900ada30 0x7f04900c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:51.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.981+0000 7f048dd9b700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f04900ca400 0x7f04900c60c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:58286/0 (socket says 172.21.15.1:58286) 2023-11-15T02:36:51.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.981+0000 7f048ed9d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04900c67d0 0x7f04900aba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:51324/0 (socket says 172.21.15.1:51324) 2023-11-15T02:36:51.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.981+0000 7f048dd9b700 1 -- 172.21.15.1:0/464759811 learned_addr learned my addr 172.21.15.1:0/464759811 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:51.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.981+0000 7f048e59c700 1 -- 172.21.15.1:0/464759811 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04900c67d0 msgr2=0x7f04900aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:51.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.981+0000 7f048e59c700 1 --2- 172.21.15.1:0/464759811 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04900c67d0 0x7f04900aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:51.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.982+0000 7f048e59c700 1 -- 172.21.15.1:0/464759811 >> v1:172.21.15.141:6789/0 conn(0x7f04900ca400 legacy=0x7f04900c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:51.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.982+0000 7f048d59a700 1 -- 172.21.15.1:0/464759811 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314068756 0 0) 0x7f04900caee0 con 0x7f04900ca400 2023-11-15T02:36:51.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.982+0000 7f048e59c700 1 -- 172.21.15.1:0/464759811 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04900cac00 con 0x7f04900ada30 2023-11-15T02:36:51.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.982+0000 7f048ed9d700 1 --2- 172.21.15.1:0/464759811 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04900c67d0 0x7f04900aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:51.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.982+0000 7f048e59c700 1 --2- 172.21.15.1:0/464759811 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04900ada30 0x7f04900c9f10 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f0480009760 tx=0x7f0480009060).ready entity=mon.1 client_cookie=f54ec156b5b735e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:51.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.982+0000 7f048d59a700 1 -- 172.21.15.1:0/464759811 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048000f510 con 0x7f04900ada30 2023-11-15T02:36:51.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.982+0000 7f048d59a700 1 -- 172.21.15.1:0/464759811 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048000f670 con 0x7f04900ada30 2023-11-15T02:36:51.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.982+0000 7f048d59a700 1 -- 172.21.15.1:0/464759811 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048000f9f0 con 0x7f04900ada30 2023-11-15T02:36:51.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.982+0000 7f048f59e700 1 -- 172.21.15.1:0/464759811 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04900ada30 msgr2=0x7f04900c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:51.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.982+0000 7f048f59e700 1 --2- 172.21.15.1:0/464759811 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04900ada30 0x7f04900c9f10 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f0480009760 tx=0x7f0480009060).stop 2023-11-15T02:36:51.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.982+0000 7f048f59e700 1 -- 172.21.15.1:0/464759811 shutdown_connections 2023-11-15T02:36:51.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.982+0000 7f048f59e700 1 --2- 172.21.15.1:0/464759811 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04900c67d0 0x7f04900aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:51.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.982+0000 7f048f59e700 1 --2- 172.21.15.1:0/464759811 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04900ada30 0x7f04900c9f10 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:51.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.982+0000 7f048f59e700 1 -- 172.21.15.1:0/464759811 >> 172.21.15.1:0/464759811 conn(0x7f0490064a60 msgr2=0x7f0490064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:51.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.983+0000 7f048f59e700 1 -- 172.21.15.1:0/464759811 shutdown_connections 2023-11-15T02:36:51.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.983+0000 7f048f59e700 1 -- 172.21.15.1:0/464759811 wait complete. 2023-11-15T02:36:51.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.984+0000 7f048f59e700 1 Processor -- start 2023-11-15T02:36:51.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.984+0000 7f048f59e700 1 -- start start 2023-11-15T02:36:51.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.984+0000 7f048f59e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04900ada30 0x7f0490151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:51.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.984+0000 7f048f59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04900c67d0 0x7f04900ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:51.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.984+0000 7f048f59e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04900ca400 0x7f04900c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:51.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.984+0000 7f048f59e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900c21b0 con 0x7f04900c67d0 2023-11-15T02:36:51.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.984+0000 7f048f59e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900ae9a0 con 0x7f04900ada30 2023-11-15T02:36:51.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.984+0000 7f048f59e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04900aec80 con 0x7f04900ca400 2023-11-15T02:36:51.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.984+0000 7f048dd9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04900c67d0 0x7f04900ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:51.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.985+0000 7f048dd9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04900c67d0 0x7f04900ae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57594/0 (socket says 172.21.15.1:57594) 2023-11-15T02:36:51.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.985+0000 7f048dd9b700 1 -- 172.21.15.1:0/382047074 learned_addr learned my addr 172.21.15.1:0/382047074 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:51.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.985+0000 7f048ed9d700 1 --2- 172.21.15.1:0/382047074 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04900ca400 0x7f04900c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:51.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.985+0000 7f048e59c700 1 --2- 172.21.15.1:0/382047074 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04900ada30 0x7f0490151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:51.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.985+0000 7f048dd9b700 1 -- 172.21.15.1:0/382047074 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04900ca400 msgr2=0x7f04900c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:51.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.985+0000 7f048dd9b700 1 --2- 172.21.15.1:0/382047074 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04900ca400 0x7f04900c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:51.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.985+0000 7f048dd9b700 1 -- 172.21.15.1:0/382047074 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04900ada30 msgr2=0x7f0490151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:51.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.985+0000 7f048dd9b700 1 --2- 172.21.15.1:0/382047074 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04900ada30 0x7f0490151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:51.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.985+0000 7f048dd9b700 1 -- 172.21.15.1:0/382047074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0488009a20 con 0x7f04900c67d0 2023-11-15T02:36:51.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.985+0000 7f048dd9b700 1 --2- 172.21.15.1:0/382047074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04900c67d0 0x7f04900ae0a0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f0484001eb0 tx=0x7f0484007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:51.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.985+0000 7f047e7fc700 1 -- 172.21.15.1:0/382047074 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04840072e0 con 0x7f04900c67d0 2023-11-15T02:36:51.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.985+0000 7f047e7fc700 1 -- 172.21.15.1:0/382047074 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0484007440 con 0x7f04900c67d0 2023-11-15T02:36:51.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.985+0000 7f047e7fc700 1 -- 172.21.15.1:0/382047074 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04840057a0 con 0x7f04900c67d0 2023-11-15T02:36:51.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.985+0000 7f048f59e700 1 -- 172.21.15.1:0/382047074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04800092a0 con 0x7f04900c67d0 2023-11-15T02:36:51.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.985+0000 7f048f59e700 1 -- 172.21.15.1:0/382047074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04900af240 con 0x7f04900c67d0 2023-11-15T02:36:51.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.986+0000 7f048f59e700 1 -- 172.21.15.1:0/382047074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04900c2320 con 0x7f04900c67d0 2023-11-15T02:36:51.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.986+0000 7f047e7fc700 1 -- 172.21.15.1:0/382047074 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 70) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f0484005bd0 con 0x7f04900c67d0 2023-11-15T02:36:51.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.987+0000 7f047e7fc700 1 --2- 172.21.15.1:0/382047074 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f047005f0b0 0x7f0470061570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:51.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.987+0000 7f047e7fc700 1 -- 172.21.15.1:0/382047074 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f04840799d0 con 0x7f04900c67d0 2023-11-15T02:36:51.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.987+0000 7f048e59c700 1 --2- 172.21.15.1:0/382047074 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f047005f0b0 0x7f0470061570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:51.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.987+0000 7f048e59c700 1 --2- 172.21.15.1:0/382047074 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f047005f0b0 0x7f0470061570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0480009fd0 tx=0x7f0480017000).ready entity=mgr.8035 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:51.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:51.991+0000 7f047e7fc700 1 -- 172.21.15.1:0/382047074 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f048404ab80 con 0x7f04900c67d0 2023-11-15T02:36:52.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.191+0000 7f048f59e700 1 -- 172.21.15.1:0/382047074 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f04900b03e0 con 0x7f047005f0b0 2023-11-15T02:36:52.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.195+0000 7f047e7fc700 1 -- 172.21.15.1:0/382047074 <== mgr.8035 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f048001f070 con 0x7f047005f0b0 2023-11-15T02:36:52.197 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path snap_test_dir1 2023-11-15T02:36:52.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.197+0000 7f048f59e700 1 -- 172.21.15.1:0/382047074 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f047005f0b0 msgr2=0x7f0470061570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:52.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.197+0000 7f048f59e700 1 --2- 172.21.15.1:0/382047074 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f047005f0b0 0x7f0470061570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0480009fd0 tx=0x7f0480017000).stop 2023-11-15T02:36:52.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.197+0000 7f048f59e700 1 -- 172.21.15.1:0/382047074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04900c67d0 msgr2=0x7f04900ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:52.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.197+0000 7f048f59e700 1 --2- 172.21.15.1:0/382047074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04900c67d0 0x7f04900ae0a0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f0484001eb0 tx=0x7f0484007e90).stop 2023-11-15T02:36:52.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.197+0000 7f048f59e700 1 -- 172.21.15.1:0/382047074 shutdown_connections 2023-11-15T02:36:52.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.197+0000 7f048f59e700 1 --2- 172.21.15.1:0/382047074 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f047005f0b0 0x7f0470061570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:52.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.197+0000 7f048f59e700 1 --2- 172.21.15.1:0/382047074 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04900ca400 0x7f04900c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:52.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.197+0000 7f048f59e700 1 --2- 172.21.15.1:0/382047074 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04900ada30 0x7f0490151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:52.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.197+0000 7f048f59e700 1 --2- 172.21.15.1:0/382047074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04900c67d0 0x7f04900ae0a0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:52.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.197+0000 7f048f59e700 1 -- 172.21.15.1:0/382047074 >> 172.21.15.1:0/382047074 conn(0x7f0490064a60 msgr2=0x7f04901569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:52.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.197+0000 7f048f59e700 1 -- 172.21.15.1:0/382047074 shutdown_connections 2023-11-15T02:36:52.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.197+0000 7f048f59e700 1 -- 172.21.15.1:0/382047074 wait complete. 2023-11-15T02:36:52.211 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-11-15T02:36:52.211 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-11-15T02:36:52.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.331+0000 7f6ee6d66700 1 Processor -- start 2023-11-15T02:36:52.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.331+0000 7f6ee6d66700 1 -- start start 2023-11-15T02:36:52.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.332+0000 7f6ee6d66700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6ee0154150 0x7f6ee0154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.332+0000 7f6ee6d66700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee00c06f0 con 0x7f6ee00aa060 2023-11-15T02:36:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.332+0000 7f6ee6d66700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee00c09d0 con 0x7f6ee00ab1a0 2023-11-15T02:36:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.332+0000 7f6ee6d66700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee0158820 con 0x7f6ee0154150 2023-11-15T02:36:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.332+0000 7f6ee4b02700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6ee0154150 0x7f6ee0154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:52.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.332+0000 7f6ee4b02700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6ee0154150 0x7f6ee0154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57610/0 (socket says 172.21.15.1:57610) 2023-11-15T02:36:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.332+0000 7f6ee5303700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6ee00aa060 0x7f6ee00c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:40188/0 (socket says 172.21.15.1:40188) 2023-11-15T02:36:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.332+0000 7f6ee4b02700 1 -- 172.21.15.1:0/2647662639 learned_addr learned my addr 172.21.15.1:0/2647662639 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:52.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.332+0000 7f6ee4b02700 1 -- 172.21.15.1:0/2647662639 >> v1:172.21.15.141:6789/0 conn(0x7f6ee00ab1a0 legacy=0x7f6ee0158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.332+0000 7f6ee4b02700 1 -- 172.21.15.1:0/2647662639 >> v1:172.21.15.1:6789/0 conn(0x7f6ee00aa060 legacy=0x7f6ee00c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.333+0000 7f6ee4b02700 1 -- 172.21.15.1:0/2647662639 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee0158b00 con 0x7f6ee0154150 2023-11-15T02:36:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.333+0000 7f6ee4b02700 1 --2- 172.21.15.1:0/2647662639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee0154150 0x7f6ee0154530 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f6ed8009f20 tx=0x7f6ed8009840).ready entity=mon.0 client_cookie=2c65fea586cafd2e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:52.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.333+0000 7f6edf7fe700 1 -- 172.21.15.1:0/2647662639 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800e070 con 0x7f6ee0154150 2023-11-15T02:36:52.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.333+0000 7f6edf7fe700 1 -- 172.21.15.1:0/2647662639 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed800ba40 con 0x7f6ee0154150 2023-11-15T02:36:52.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.333+0000 7f6edf7fe700 1 -- 172.21.15.1:0/2647662639 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800bdc0 con 0x7f6ee0154150 2023-11-15T02:36:52.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.333+0000 7f6ee6d66700 1 -- 172.21.15.1:0/2647662639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee0154150 msgr2=0x7f6ee0154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:52.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.333+0000 7f6ee6d66700 1 --2- 172.21.15.1:0/2647662639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee0154150 0x7f6ee0154530 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f6ed8009f20 tx=0x7f6ed8009840).stop 2023-11-15T02:36:52.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.333+0000 7f6ee6d66700 1 -- 172.21.15.1:0/2647662639 shutdown_connections 2023-11-15T02:36:52.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.333+0000 7f6ee6d66700 1 --2- 172.21.15.1:0/2647662639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee0154150 0x7f6ee0154530 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:52.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.333+0000 7f6ee6d66700 1 -- 172.21.15.1:0/2647662639 >> 172.21.15.1:0/2647662639 conn(0x7f6ee0064aa0 msgr2=0x7f6ee0064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:52.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.333+0000 7f6ee6d66700 1 -- 172.21.15.1:0/2647662639 shutdown_connections 2023-11-15T02:36:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.333+0000 7f6ee6d66700 1 -- 172.21.15.1:0/2647662639 wait complete. 2023-11-15T02:36:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.334+0000 7f6ee6d66700 1 Processor -- start 2023-11-15T02:36:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.335+0000 7f6ee6d66700 1 -- start start 2023-11-15T02:36:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.335+0000 7f6ee6d66700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee00aa060 0x7f6ee00c2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:52.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.335+0000 7f6ee6d66700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee00ab1a0 0x7f6ee0165a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.335+0000 7f6ee6d66700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee0154150 0x7f6ee0153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.335+0000 7f6ee6d66700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00c3f40 con 0x7f6ee0154150 2023-11-15T02:36:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.335+0000 7f6ee6d66700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee0164ea0 con 0x7f6ee00aa060 2023-11-15T02:36:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.335+0000 7f6ee6d66700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee0165180 con 0x7f6ee00ab1a0 2023-11-15T02:36:52.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.335+0000 7f6ee5303700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee0154150 0x7f6ee0153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6ee5303700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee0154150 0x7f6ee0153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57618/0 (socket says 172.21.15.1:57618) 2023-11-15T02:36:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6ee5303700 1 -- 172.21.15.1:0/1110905309 learned_addr learned my addr 172.21.15.1:0/1110905309 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6ee4b02700 1 --2- 172.21.15.1:0/1110905309 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee00aa060 0x7f6ee00c2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6edffff700 1 --2- 172.21.15.1:0/1110905309 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee00ab1a0 0x7f6ee0165a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:52.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6ee5303700 1 -- 172.21.15.1:0/1110905309 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee00ab1a0 msgr2=0x7f6ee0165a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6ee5303700 1 --2- 172.21.15.1:0/1110905309 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ee00ab1a0 0x7f6ee0165a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6ee5303700 1 -- 172.21.15.1:0/1110905309 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee00aa060 msgr2=0x7f6ee00c2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6ee5303700 1 --2- 172.21.15.1:0/1110905309 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee00aa060 0x7f6ee00c2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6ee5303700 1 -- 172.21.15.1:0/1110905309 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed8009ae0 con 0x7f6ee0154150 2023-11-15T02:36:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6ee4b02700 1 --2- 172.21.15.1:0/1110905309 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ee00aa060 0x7f6ee00c2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6ee5303700 1 --2- 172.21.15.1:0/1110905309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee0154150 0x7f6ee0153190 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f6ec800c410 tx=0x7f6ec8007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6edcff9700 1 -- 172.21.15.1:0/1110905309 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec80072e0 con 0x7f6ee0154150 2023-11-15T02:36:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6edcff9700 1 -- 172.21.15.1:0/1110905309 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec8007440 con 0x7f6ee0154150 2023-11-15T02:36:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6ee6d66700 1 -- 172.21.15.1:0/1110905309 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee0165460 con 0x7f6ee0154150 2023-11-15T02:36:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6edcff9700 1 -- 172.21.15.1:0/1110905309 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec80058f0 con 0x7f6ee0154150 2023-11-15T02:36:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.336+0000 7f6ee6d66700 1 -- 172.21.15.1:0/1110905309 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee01657f0 con 0x7f6ee0154150 2023-11-15T02:36:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.337+0000 7f6ee6d66700 1 -- 172.21.15.1:0/1110905309 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee006c7e0 con 0x7f6ee0154150 2023-11-15T02:36:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.337+0000 7f6edcff9700 1 -- 172.21.15.1:0/1110905309 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 70) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f6ec8005ca0 con 0x7f6ee0154150 2023-11-15T02:36:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.338+0000 7f6edcff9700 1 --2- 172.21.15.1:0/1110905309 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ec005f080 0x7f6ec0061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:52.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.338+0000 7f6edcff9700 1 -- 172.21.15.1:0/1110905309 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f6ec8079a40 con 0x7f6ee0154150 2023-11-15T02:36:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.338+0000 7f6ee4b02700 1 --2- 172.21.15.1:0/1110905309 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ec005f080 0x7f6ec0061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.338+0000 7f6ee4b02700 1 --2- 172.21.15.1:0/1110905309 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ec005f080 0x7f6ec0061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6ed8009930 tx=0x7f6ed8009840).ready entity=mgr.8035 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:52.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.342+0000 7f6edcff9700 1 -- 172.21.15.1:0/1110905309 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6ec804abf0 con 0x7f6ee0154150 2023-11-15T02:36:52.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.539+0000 7f6ee6d66700 1 -- 172.21.15.1:0/1110905309 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ee0158de0 con 0x7f6ec005f080 2023-11-15T02:36:52.541 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:52.540+0000 7f1179910700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-11-15T02:36:52.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.540+0000 7f6edcff9700 1 -- 172.21.15.1:0/1110905309 <== mgr.8035 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f6ee0158de0 con 0x7f6ec005f080 2023-11-15T02:36:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-11-15T02:36:52.546 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-11-15T02:36:52.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:52.547 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-11-15T02:36:52.566 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-15T02:36:52.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.724+0000 7f52547e2700 1 Processor -- start 2023-11-15T02:36:52.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.724+0000 7f52547e2700 1 -- start start 2023-11-15T02:36:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.725+0000 7f52547e2700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f524c1540a0 0x7f524c0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.725+0000 7f52547e2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f524c154480 0x7f524c0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.725+0000 7f52547e2700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524c0ca050 con 0x7f524c0c5f40 2023-11-15T02:36:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.725+0000 7f52547e2700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524c0c9440 con 0x7f524c1540a0 2023-11-15T02:36:52.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.725+0000 7f52547e2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524c0c9720 con 0x7f524c154480 2023-11-15T02:36:52.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.726+0000 7f5251d7d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f524c154480 0x7f524c0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:52.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.726+0000 7f5251d7d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f524c154480 0x7f524c0ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:51348/0 (socket says 172.21.15.1:51348) 2023-11-15T02:36:52.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.726+0000 7f5251d7d700 1 -- 172.21.15.1:0/2741133358 learned_addr learned my addr 172.21.15.1:0/2741133358 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:52.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.726+0000 7f525257e700 1 --2- 172.21.15.1:0/2741133358 >> v2:172.21.15.141:3300/0 conn(0x7f524c1540a0 0x7f524c0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:52.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.726+0000 7f525157c700 1 -- 172.21.15.1:0/2741133358 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362307129 0 0) 0x7f524c0ca050 con 0x7f524c0c5f40 2023-11-15T02:36:52.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.726+0000 7f525157c700 1 -- 172.21.15.1:0/2741133358 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52340033f0 con 0x7f524c0c5f40 2023-11-15T02:36:52.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.726+0000 7f5251d7d700 1 -- 172.21.15.1:0/2741133358 >> v2:172.21.15.141:3300/0 conn(0x7f524c1540a0 msgr2=0x7f524c0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:52.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.726+0000 7f5251d7d700 1 --2- 172.21.15.1:0/2741133358 >> v2:172.21.15.141:3300/0 conn(0x7f524c1540a0 0x7f524c0ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:52.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.726+0000 7f5251d7d700 1 -- 172.21.15.1:0/2741133358 >> v1:172.21.15.141:6789/0 conn(0x7f524c0c5f40 legacy=0x7f524c0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:52.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.726+0000 7f5251d7d700 1 -- 172.21.15.1:0/2741133358 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c0c9a00 con 0x7f524c154480 2023-11-15T02:36:52.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.726+0000 7f5251d7d700 1 --2- 172.21.15.1:0/2741133358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f524c154480 0x7f524c0ca9d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f5240006fd0 tx=0x7f52400090f0).ready entity=mon.2 client_cookie=6850936ee2be1e55 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:52.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.726+0000 7f525157c700 1 -- 172.21.15.1:0/2741133358 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524000f510 con 0x7f524c154480 2023-11-15T02:36:52.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.726+0000 7f525157c700 1 -- 172.21.15.1:0/2741133358 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524000f670 con 0x7f524c154480 2023-11-15T02:36:52.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.726+0000 7f525157c700 1 -- 172.21.15.1:0/2741133358 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524000f9f0 con 0x7f524c154480 2023-11-15T02:36:52.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.727+0000 7f52547e2700 1 -- 172.21.15.1:0/2741133358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f524c154480 msgr2=0x7f524c0ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:52.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.727+0000 7f52547e2700 1 --2- 172.21.15.1:0/2741133358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f524c154480 0x7f524c0ca9d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f5240006fd0 tx=0x7f52400090f0).stop 2023-11-15T02:36:52.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.727+0000 7f52547e2700 1 -- 172.21.15.1:0/2741133358 shutdown_connections 2023-11-15T02:36:52.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.727+0000 7f52547e2700 1 --2- 172.21.15.1:0/2741133358 >> v2:172.21.15.141:3300/0 conn(0x7f524c1540a0 0x7f524c0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:52.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.727+0000 7f52547e2700 1 --2- 172.21.15.1:0/2741133358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f524c154480 0x7f524c0ca9d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:52.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.727+0000 7f52547e2700 1 -- 172.21.15.1:0/2741133358 >> 172.21.15.1:0/2741133358 conn(0x7f524c064a70 msgr2=0x7f524c064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:52.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.727+0000 7f52547e2700 1 -- 172.21.15.1:0/2741133358 shutdown_connections 2023-11-15T02:36:52.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.727+0000 7f52547e2700 1 -- 172.21.15.1:0/2741133358 wait complete. 2023-11-15T02:36:52.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.728+0000 7f52547e2700 1 Processor -- start 2023-11-15T02:36:52.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.728+0000 7f52547e2700 1 -- start start 2023-11-15T02:36:52.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f52547e2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f524c0c5f40 0x7f524c13d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:52.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f52547e2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f524c1540a0 0x7f524c1581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:52.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f52547e2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f524c154480 0x7f524c156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:52.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f52547e2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c13ed20 con 0x7f524c1540a0 2023-11-15T02:36:52.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f52547e2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c13de40 con 0x7f524c154480 2023-11-15T02:36:52.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f52547e2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524c13e110 con 0x7f524c0c5f40 2023-11-15T02:36:52.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f5251d7d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f524c1540a0 0x7f524c1581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:52.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f5251d7d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f524c1540a0 0x7f524c1581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57624/0 (socket says 172.21.15.1:57624) 2023-11-15T02:36:52.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f5251d7d700 1 -- 172.21.15.1:0/1277946348 learned_addr learned my addr 172.21.15.1:0/1277946348 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:52.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f525257e700 1 --2- 172.21.15.1:0/1277946348 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f524c0c5f40 0x7f524c13d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:52.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f5252d7f700 1 --2- 172.21.15.1:0/1277946348 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f524c154480 0x7f524c156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:52.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f5251d7d700 1 -- 172.21.15.1:0/1277946348 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f524c0c5f40 msgr2=0x7f524c13d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:52.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f5251d7d700 1 --2- 172.21.15.1:0/1277946348 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f524c0c5f40 0x7f524c13d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:52.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f5251d7d700 1 -- 172.21.15.1:0/1277946348 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f524c154480 msgr2=0x7f524c156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:52.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f5251d7d700 1 --2- 172.21.15.1:0/1277946348 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f524c154480 0x7f524c156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:52.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f5251d7d700 1 -- 172.21.15.1:0/1277946348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5240009370 con 0x7f524c1540a0 2023-11-15T02:36:52.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f5252d7f700 1 --2- 172.21.15.1:0/1277946348 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f524c154480 0x7f524c156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:52.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.729+0000 7f5251d7d700 1 --2- 172.21.15.1:0/1277946348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f524c1540a0 0x7f524c1581d0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f524c0c9860 tx=0x7f5240017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:52.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.730+0000 7f524a7fc700 1 -- 172.21.15.1:0/1277946348 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524000fe80 con 0x7f524c1540a0 2023-11-15T02:36:52.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.730+0000 7f524a7fc700 1 -- 172.21.15.1:0/1277946348 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524000f7e0 con 0x7f524c1540a0 2023-11-15T02:36:52.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.730+0000 7f52547e2700 1 -- 172.21.15.1:0/1277946348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524c13e3f0 con 0x7f524c1540a0 2023-11-15T02:36:52.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.730+0000 7f524a7fc700 1 -- 172.21.15.1:0/1277946348 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524000f970 con 0x7f524c1540a0 2023-11-15T02:36:52.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.730+0000 7f52547e2700 1 -- 172.21.15.1:0/1277946348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524c13e9b0 con 0x7f524c1540a0 2023-11-15T02:36:52.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.731+0000 7f52547e2700 1 -- 172.21.15.1:0/1277946348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524c06c7e0 con 0x7f524c1540a0 2023-11-15T02:36:52.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.731+0000 7f524a7fc700 1 -- 172.21.15.1:0/1277946348 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 70) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f5240022020 con 0x7f524c1540a0 2023-11-15T02:36:52.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.731+0000 7f524a7fc700 1 --2- 172.21.15.1:0/1277946348 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f523805f080 0x7f5238061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:52.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.731+0000 7f524a7fc700 1 -- 172.21.15.1:0/1277946348 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f524007bae0 con 0x7f524c1540a0 2023-11-15T02:36:52.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.732+0000 7f525257e700 1 --2- 172.21.15.1:0/1277946348 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f523805f080 0x7f5238061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:52.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.732+0000 7f525257e700 1 --2- 172.21.15.1:0/1277946348 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f523805f080 0x7f5238061540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f524400f570 tx=0x7f524400b040).ready entity=mgr.8035 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:52.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.735+0000 7f524a7fc700 1 -- 172.21.15.1:0/1277946348 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f524004cc90 con 0x7f524c1540a0 2023-11-15T02:36:52.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:52.957+0000 7f52547e2700 1 -- 172.21.15.1:0/1277946348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f524c0c9ce0 con 0x7f524c1540a0 2023-11-15T02:36:53.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:53.825+0000 7f524a7fc700 1 -- 172.21.15.1:0/1277946348 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f5240079790 con 0x7f524c1540a0 2023-11-15T02:36:53.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:53.826+0000 7f524a7fc700 1 -- 172.21.15.1:0/1277946348 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v71) v1 ==== 93+0+0 (secure 0 0 0) 0x7f5240042b80 con 0x7f524c1540a0 2023-11-15T02:36:53.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:53.829+0000 7f52547e2700 1 -- 172.21.15.1:0/1277946348 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f523805f080 msgr2=0x7f5238061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:53.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:53.829+0000 7f52547e2700 1 --2- 172.21.15.1:0/1277946348 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f523805f080 0x7f5238061540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f524400f570 tx=0x7f524400b040).stop 2023-11-15T02:36:53.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:53.829+0000 7f52547e2700 1 -- 172.21.15.1:0/1277946348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f524c1540a0 msgr2=0x7f524c1581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:53.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:53.829+0000 7f52547e2700 1 --2- 172.21.15.1:0/1277946348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f524c1540a0 0x7f524c1581d0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f524c0c9860 tx=0x7f5240017000).stop 2023-11-15T02:36:53.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:53.829+0000 7f52547e2700 1 -- 172.21.15.1:0/1277946348 shutdown_connections 2023-11-15T02:36:53.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:53.829+0000 7f52547e2700 1 --2- 172.21.15.1:0/1277946348 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f523805f080 0x7f5238061540 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:53.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:53.829+0000 7f52547e2700 1 --2- 172.21.15.1:0/1277946348 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f524c154480 0x7f524c156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:53.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:53.829+0000 7f52547e2700 1 --2- 172.21.15.1:0/1277946348 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f524c0c5f40 0x7f524c13d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:53.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:53.829+0000 7f52547e2700 1 --2- 172.21.15.1:0/1277946348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f524c1540a0 0x7f524c1581d0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:53.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:53.829+0000 7f52547e2700 1 -- 172.21.15.1:0/1277946348 >> 172.21.15.1:0/1277946348 conn(0x7f524c064a70 msgr2=0x7f524c064e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:53.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:53.829+0000 7f52547e2700 1 -- 172.21.15.1:0/1277946348 shutdown_connections 2023-11-15T02:36:53.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:53.829+0000 7f52547e2700 1 -- 172.21.15.1:0/1277946348 wait complete. 2023-11-15T02:36:53.848 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T02:36:53.850 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:36:53.898 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:36:53.935 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T02:36:53.936 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-15T02:36:53.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:36:53.937 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-15T02:36:53.974 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T02:36:53.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:36:53.975 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-15T02:36:53.976 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:53.974+0000 7fc334ea7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:36:53.982 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:53.979+0000 7f9d45edf680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:36:53.996 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:36:54.038 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:54.037+0000 7fc334ea7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:36:54.048 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:54.046+0000 7f9d45edf680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:36:54.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.157+0000 7f0614d5e700 1 Processor -- start 2023-11-15T02:36:54.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.157+0000 7f0614d5e700 1 -- start start 2023-11-15T02:36:54.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.158+0000 7f0614d5e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0610154680 0x7f0610069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.158+0000 7f0614d5e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06100c70c0 0x7f06100bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.158+0000 7f0614d5e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06100c3360 con 0x7f06100bccd0 2023-11-15T02:36:54.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.158+0000 7f0614d5e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06100bd620 con 0x7f0610154680 2023-11-15T02:36:54.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.158+0000 7f0614d5e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06100c2750 con 0x7f06100c70c0 2023-11-15T02:36:54.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.158+0000 7f060dd9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f06100bccd0 0x7f06100627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:40202/0 (socket says 172.21.15.1:40202) 2023-11-15T02:36:54.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.158+0000 7f060dd9b700 1 -- 172.21.15.1:0/435467097 learned_addr learned my addr 172.21.15.1:0/435467097 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:54.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.158+0000 7f060e59c700 1 --2- 172.21.15.1:0/435467097 >> v2:172.21.15.141:3300/0 conn(0x7f0610154680 0x7f0610069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.158+0000 7f060ed9d700 1 --2- 172.21.15.1:0/435467097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06100c70c0 0x7f06100bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.159+0000 7f060d59a700 1 -- 172.21.15.1:0/435467097 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833748121 0 0) 0x7f06100c3360 con 0x7f06100bccd0 2023-11-15T02:36:54.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.159+0000 7f060d59a700 1 -- 172.21.15.1:0/435467097 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05f80033f0 con 0x7f06100bccd0 2023-11-15T02:36:54.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.159+0000 7f060ed9d700 1 -- 172.21.15.1:0/435467097 >> v2:172.21.15.141:3300/0 conn(0x7f0610154680 msgr2=0x7f0610069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:54.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.159+0000 7f060ed9d700 1 --2- 172.21.15.1:0/435467097 >> v2:172.21.15.141:3300/0 conn(0x7f0610154680 0x7f0610069fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.159+0000 7f060ed9d700 1 -- 172.21.15.1:0/435467097 >> v1:172.21.15.1:6789/0 conn(0x7f06100bccd0 legacy=0x7f06100627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:54.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.159+0000 7f060ed9d700 1 -- 172.21.15.1:0/435467097 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06100c2a30 con 0x7f06100c70c0 2023-11-15T02:36:54.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.159+0000 7f060e59c700 1 --2- 172.21.15.1:0/435467097 >> v2:172.21.15.141:3300/0 conn(0x7f0610154680 0x7f0610069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:54.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.159+0000 7f060ed9d700 1 --2- 172.21.15.1:0/435467097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06100c70c0 0x7f06100bd130 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f0608009e60 tx=0x7f0608009780).ready entity=mon.2 client_cookie=881d62dd621843b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:54.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.159+0000 7f060d59a700 1 -- 172.21.15.1:0/435467097 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060800e070 con 0x7f06100c70c0 2023-11-15T02:36:54.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.159+0000 7f060d59a700 1 -- 172.21.15.1:0/435467097 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060800bab0 con 0x7f06100c70c0 2023-11-15T02:36:54.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.159+0000 7f060d59a700 1 -- 172.21.15.1:0/435467097 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060800be30 con 0x7f06100c70c0 2023-11-15T02:36:54.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.160+0000 7f0614d5e700 1 -- 172.21.15.1:0/435467097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06100c70c0 msgr2=0x7f06100bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:54.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.160+0000 7f0614d5e700 1 --2- 172.21.15.1:0/435467097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06100c70c0 0x7f06100bd130 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f0608009e60 tx=0x7f0608009780).stop 2023-11-15T02:36:54.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.160+0000 7f0614d5e700 1 -- 172.21.15.1:0/435467097 shutdown_connections 2023-11-15T02:36:54.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.160+0000 7f0614d5e700 1 --2- 172.21.15.1:0/435467097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06100c70c0 0x7f06100bd130 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.160+0000 7f0614d5e700 1 --2- 172.21.15.1:0/435467097 >> v2:172.21.15.141:3300/0 conn(0x7f0610154680 0x7f0610069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.160+0000 7f0614d5e700 1 -- 172.21.15.1:0/435467097 >> 172.21.15.1:0/435467097 conn(0x7f06100c7d70 msgr2=0x7f06100c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:54.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.160+0000 7f0614d5e700 1 -- 172.21.15.1:0/435467097 shutdown_connections 2023-11-15T02:36:54.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.160+0000 7f0614d5e700 1 -- 172.21.15.1:0/435467097 wait complete. 2023-11-15T02:36:54.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.161+0000 7f0614d5e700 1 Processor -- start 2023-11-15T02:36:54.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.161+0000 7f0614d5e700 1 -- start start 2023-11-15T02:36:54.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f0614d5e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06100bccd0 0x7f0610150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f0614d5e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06100c70c0 0x7f0610062a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f0614d5e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0610154680 0x7f0610062f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f0614d5e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0610063450 con 0x7f06100bccd0 2023-11-15T02:36:54.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f0614d5e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0610165350 con 0x7f06100c70c0 2023-11-15T02:36:54.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f0614d5e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06100abad0 con 0x7f0610154680 2023-11-15T02:36:54.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f060e59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06100bccd0 0x7f0610150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f060e59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06100bccd0 0x7f0610150d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57654/0 (socket says 172.21.15.1:57654) 2023-11-15T02:36:54.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f060e59c700 1 -- 172.21.15.1:0/3388659553 learned_addr learned my addr 172.21.15.1:0/3388659553 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:54.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f060dd9b700 1 --2- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06100c70c0 0x7f0610062a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f060ed9d700 1 --2- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0610154680 0x7f0610062f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f060e59c700 1 -- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0610154680 msgr2=0x7f0610062f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:54.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f060e59c700 1 --2- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0610154680 0x7f0610062f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f060e59c700 1 -- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06100c70c0 msgr2=0x7f0610062a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:54.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f060e59c700 1 --2- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06100c70c0 0x7f0610062a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f060e59c700 1 -- 172.21.15.1:0/3388659553 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06040092a0 con 0x7f06100bccd0 2023-11-15T02:36:54.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.162+0000 7f060e59c700 1 --2- 172.21.15.1:0/3388659553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06100bccd0 0x7f0610150d30 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f060400e980 tx=0x7f0604009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:54.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.163+0000 7f05fe7fc700 1 -- 172.21.15.1:0/3388659553 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604012600 con 0x7f06100bccd0 2023-11-15T02:36:54.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.163+0000 7f05fe7fc700 1 -- 172.21.15.1:0/3388659553 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0604012760 con 0x7f06100bccd0 2023-11-15T02:36:54.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.163+0000 7f0614d5e700 1 -- 172.21.15.1:0/3388659553 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0608009a20 con 0x7f06100bccd0 2023-11-15T02:36:54.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.163+0000 7f05fe7fc700 1 -- 172.21.15.1:0/3388659553 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604012ae0 con 0x7f06100bccd0 2023-11-15T02:36:54.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.163+0000 7f0614d5e700 1 -- 172.21.15.1:0/3388659553 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0610164d00 con 0x7f06100bccd0 2023-11-15T02:36:54.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.164+0000 7f0614d5e700 1 -- 172.21.15.1:0/3388659553 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0610165630 con 0x7f06100bccd0 2023-11-15T02:36:54.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.164+0000 7f05fe7fc700 1 -- 172.21.15.1:0/3388659553 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f060401b400 con 0x7f06100bccd0 2023-11-15T02:36:54.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.165+0000 7f05fe7fc700 1 --2- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05f005f2d0 0x7f05f0061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.165+0000 7f05fe7fc700 1 -- 172.21.15.1:0/3388659553 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f060407b180 con 0x7f06100bccd0 2023-11-15T02:36:54.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.165+0000 7f060dd9b700 1 -- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05f005f2d0 msgr2=0x7f05f0061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:54.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.165+0000 7f060dd9b700 1 --2- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05f005f2d0 0x7f05f0061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:54.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.169+0000 7f05fe7fc700 1 -- 172.21.15.1:0/3388659553 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f060404bf80 con 0x7f06100bccd0 2023-11-15T02:36:54.315 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:54.314+0000 7fc334ea7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:36:54.345 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:54.343+0000 7f9d45edf680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:36:54.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.366+0000 7f060dd9b700 1 -- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05f005f2d0 msgr2=0x7f05f0061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:54.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.366+0000 7f060dd9b700 1 --2- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05f005f2d0 0x7f05f0061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:36:54.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.388+0000 7f0614d5e700 1 -- 172.21.15.1:0/3388659553 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f061006c7e0 con 0x7f06100bccd0 2023-11-15T02:36:54.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.388+0000 7f05fe7fc700 1 -- 172.21.15.1:0/3388659553 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f060404f5a0 con 0x7f06100bccd0 2023-11-15T02:36:54.391 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:54.391 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7019,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3898250637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3898250637},{"type":"v1","addr":"172.21.15.141:6836","nonce":3898250637}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7022,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3709207600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3709207600},{"type":"v1","addr":"172.21.15.141:6837","nonce":3709207600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1212884558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1212884558},{"type":"v1","addr":"172.21.15.1:6835","nonce":1212884558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:36:38.505394+0000","modified":"2023-11-15T02:36:41.520212+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8619":{"gid":8619,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6834/1968331775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1968331775},{"type":"v1","addr":"172.21.15.1:6834","nonce":1968331775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-11-15T02:36:54.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.390+0000 7f0614d5e700 1 -- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05f005f2d0 msgr2=0x7f05f0061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:54.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.390+0000 7f0614d5e700 1 --2- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05f005f2d0 0x7f05f0061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:54.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.390+0000 7f0614d5e700 1 -- 172.21.15.1:0/3388659553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06100bccd0 msgr2=0x7f0610150d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:54.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.390+0000 7f0614d5e700 1 --2- 172.21.15.1:0/3388659553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06100bccd0 0x7f0610150d30 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f060400e980 tx=0x7f0604009060).stop 2023-11-15T02:36:54.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.390+0000 7f0614d5e700 1 -- 172.21.15.1:0/3388659553 shutdown_connections 2023-11-15T02:36:54.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.390+0000 7f0614d5e700 1 --2- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05f005f2d0 0x7f05f0061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:54.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.390+0000 7f0614d5e700 1 --2- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0610154680 0x7f0610062f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.390+0000 7f0614d5e700 1 --2- 172.21.15.1:0/3388659553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06100bccd0 0x7f0610150d30 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.390+0000 7f0614d5e700 1 --2- 172.21.15.1:0/3388659553 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06100c70c0 0x7f0610062a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.390+0000 7f0614d5e700 1 -- 172.21.15.1:0/3388659553 >> 172.21.15.1:0/3388659553 conn(0x7f06100c7d70 msgr2=0x7f0610066420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:54.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.390+0000 7f0614d5e700 1 -- 172.21.15.1:0/3388659553 shutdown_connections 2023-11-15T02:36:54.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.390+0000 7f0614d5e700 1 -- 172.21.15.1:0/3388659553 wait complete. 2023-11-15T02:36:54.397 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 71 2023-11-15T02:36:54.405 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:36:54.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.567+0000 7f2b15ba7700 1 Processor -- start 2023-11-15T02:36:54.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.567+0000 7f2b15ba7700 1 -- start start 2023-11-15T02:36:54.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.568+0000 7f2b15ba7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2b10155790 0x7f2b100a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.568+0000 7f2b15ba7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2b10155b70 0x7f2b100c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.568+0000 7f2b15ba7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b100a61b0 0x7f2b100c8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.568+0000 7f2b15ba7700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b100c5420 con 0x7f2b10155b70 2023-11-15T02:36:54.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.568+0000 7f2b15ba7700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b10083630 con 0x7f2b10155790 2023-11-15T02:36:54.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.568+0000 7f2b15ba7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100c7c90 con 0x7f2b100a61b0 2023-11-15T02:36:54.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.569+0000 7f2b0effd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2b10155b70 0x7f2b100c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.569+0000 7f2b0effd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2b10155b70 0x7f2b100c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57658/0 (socket says 172.21.15.1:57658) 2023-11-15T02:36:54.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.569+0000 7f2b0effd700 1 -- 172.21.15.1:0/2970829186 learned_addr learned my addr 172.21.15.1:0/2970829186 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:54.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.569+0000 7f2b0f7fe700 1 --2- 172.21.15.1:0/2970829186 >> v2:172.21.15.141:3300/0 conn(0x7f2b10155790 0x7f2b100a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.569+0000 7f2b0ffff700 1 --2- 172.21.15.1:0/2970829186 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b100a61b0 0x7f2b100c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.569+0000 7f2b0effd700 1 -- 172.21.15.1:0/2970829186 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b100a61b0 msgr2=0x7f2b100c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:54.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.569+0000 7f2b0effd700 1 --2- 172.21.15.1:0/2970829186 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b100a61b0 0x7f2b100c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.569+0000 7f2b0effd700 1 -- 172.21.15.1:0/2970829186 >> v2:172.21.15.141:3300/0 conn(0x7f2b10155790 msgr2=0x7f2b100a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:54.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.569+0000 7f2b0effd700 1 --2- 172.21.15.1:0/2970829186 >> v2:172.21.15.141:3300/0 conn(0x7f2b10155790 0x7f2b100a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.569+0000 7f2b0effd700 1 -- 172.21.15.1:0/2970829186 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b100c8b00 con 0x7f2b10155b70 2023-11-15T02:36:54.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.569+0000 7f2b0effd700 1 --2- 172.21.15.1:0/2970829186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b10155b70 0x7f2b100c8120 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f2b10066140 tx=0x7f2b040090f0).ready entity=mon.0 client_cookie=cbc1a4e0fd5c2d88 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:54.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.569+0000 7f2b0e7fc700 1 -- 172.21.15.1:0/2970829186 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400f510 con 0x7f2b10155b70 2023-11-15T02:36:54.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.569+0000 7f2b0e7fc700 1 -- 172.21.15.1:0/2970829186 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0400f670 con 0x7f2b10155b70 2023-11-15T02:36:54.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.569+0000 7f2b0e7fc700 1 -- 172.21.15.1:0/2970829186 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400f9f0 con 0x7f2b10155b70 2023-11-15T02:36:54.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.570+0000 7f2b15ba7700 1 -- 172.21.15.1:0/2970829186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b10155b70 msgr2=0x7f2b100c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:54.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.570+0000 7f2b15ba7700 1 --2- 172.21.15.1:0/2970829186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b10155b70 0x7f2b100c8120 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f2b10066140 tx=0x7f2b040090f0).stop 2023-11-15T02:36:54.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.570+0000 7f2b15ba7700 1 -- 172.21.15.1:0/2970829186 shutdown_connections 2023-11-15T02:36:54.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.570+0000 7f2b15ba7700 1 --2- 172.21.15.1:0/2970829186 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b100a61b0 0x7f2b100c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.570+0000 7f2b15ba7700 1 --2- 172.21.15.1:0/2970829186 >> v2:172.21.15.141:3300/0 conn(0x7f2b10155790 0x7f2b100a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.570+0000 7f2b15ba7700 1 --2- 172.21.15.1:0/2970829186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b10155b70 0x7f2b100c8120 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.570+0000 7f2b15ba7700 1 -- 172.21.15.1:0/2970829186 >> 172.21.15.1:0/2970829186 conn(0x7f2b10082f90 msgr2=0x7f2b100c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:54.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.570+0000 7f2b15ba7700 1 -- 172.21.15.1:0/2970829186 shutdown_connections 2023-11-15T02:36:54.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.570+0000 7f2b15ba7700 1 -- 172.21.15.1:0/2970829186 wait complete. 2023-11-15T02:36:54.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.571+0000 7f2b15ba7700 1 Processor -- start 2023-11-15T02:36:54.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.571+0000 7f2b15ba7700 1 -- start start 2023-11-15T02:36:54.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b15ba7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b100a61b0 0x7f2b100c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b15ba7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b10155790 0x7f2b1014ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b15ba7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b10155b70 0x7f2b10154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b15ba7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100c27d0 con 0x7f2b100a61b0 2023-11-15T02:36:54.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b15ba7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100c03d0 con 0x7f2b10155b70 2023-11-15T02:36:54.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b15ba7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100c2210 con 0x7f2b10155790 2023-11-15T02:36:54.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b0f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b100a61b0 0x7f2b100c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b0f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b100a61b0 0x7f2b100c1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57674/0 (socket says 172.21.15.1:57674) 2023-11-15T02:36:54.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b0f7fe700 1 -- 172.21.15.1:0/4213963692 learned_addr learned my addr 172.21.15.1:0/4213963692 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:54.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b0effd700 1 --2- 172.21.15.1:0/4213963692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b10155790 0x7f2b1014ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b0ffff700 1 --2- 172.21.15.1:0/4213963692 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b10155b70 0x7f2b10154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b0f7fe700 1 -- 172.21.15.1:0/4213963692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b10155790 msgr2=0x7f2b1014ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:54.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b0f7fe700 1 --2- 172.21.15.1:0/4213963692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b10155790 0x7f2b1014ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b0f7fe700 1 -- 172.21.15.1:0/4213963692 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b10155b70 msgr2=0x7f2b10154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:54.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b0f7fe700 1 --2- 172.21.15.1:0/4213963692 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b10155b70 0x7f2b10154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b0f7fe700 1 -- 172.21.15.1:0/4213963692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b04009370 con 0x7f2b100a61b0 2023-11-15T02:36:54.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.572+0000 7f2b0effd700 1 --2- 172.21.15.1:0/4213963692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b10155790 0x7f2b1014ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:54.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.573+0000 7f2b0f7fe700 1 --2- 172.21.15.1:0/4213963692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b100a61b0 0x7f2b100c1c30 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f2b0000e900 tx=0x7f2b00006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:54.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.573+0000 7f2af77fe700 1 -- 172.21.15.1:0/4213963692 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00009450 con 0x7f2b100a61b0 2023-11-15T02:36:54.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.573+0000 7f2af77fe700 1 -- 172.21.15.1:0/4213963692 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b00012600 con 0x7f2b100a61b0 2023-11-15T02:36:54.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.573+0000 7f2af77fe700 1 -- 172.21.15.1:0/4213963692 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00012980 con 0x7f2b100a61b0 2023-11-15T02:36:54.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.573+0000 7f2b15ba7700 1 -- 172.21.15.1:0/4213963692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b100c24f0 con 0x7f2b100a61b0 2023-11-15T02:36:54.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.573+0000 7f2b15ba7700 1 -- 172.21.15.1:0/4213963692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1014f250 con 0x7f2b100a61b0 2023-11-15T02:36:54.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.574+0000 7f2b15ba7700 1 -- 172.21.15.1:0/4213963692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1006c7e0 con 0x7f2b100a61b0 2023-11-15T02:36:54.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.574+0000 7f2af77fe700 1 -- 172.21.15.1:0/4213963692 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f2b00012cf0 con 0x7f2b100a61b0 2023-11-15T02:36:54.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.574+0000 7f2af77fe700 1 --2- 172.21.15.1:0/4213963692 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2afc05f300 0x7f2afc0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.574+0000 7f2b0effd700 1 -- 172.21.15.1:0/4213963692 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2afc05f300 msgr2=0x7f2afc0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:54.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.574+0000 7f2af77fe700 1 -- 172.21.15.1:0/4213963692 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f2b0007aaa0 con 0x7f2b100a61b0 2023-11-15T02:36:54.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.574+0000 7f2b0effd700 1 --2- 172.21.15.1:0/4213963692 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2afc05f300 0x7f2afc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:54.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.579+0000 7f2af77fe700 1 -- 172.21.15.1:0/4213963692 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2b0004f2b0 con 0x7f2b100a61b0 2023-11-15T02:36:54.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.754+0000 7f2b15ba7700 1 -- 172.21.15.1:0/4213963692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b1006aaf0 con 0x7f2b100a61b0 2023-11-15T02:36:54.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.755+0000 7f2af77fe700 1 -- 172.21.15.1:0/4213963692 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+18028 (secure 0 0 0) 0x7f2b00016090 con 0x7f2b100a61b0 2023-11-15T02:36:54.757 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:54.758 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":163,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:36:50.808631+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:36:36.177693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-11-15T02:36:37.489367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/3216709054":"2023-11-16T02:36:50.808565+0000","172.21.15.141:6833/90546":"2023-11-16T02:36:50.808565+0000","172.21.15.141:6832/90546":"2023-11-16T02:36:50.808565+0000","172.21.15.141:0/2743114853":"2023-11-16T02:36:50.808565+0000","172.21.15.141:0/1483799851":"2023-11-16T02:36:50.808565+0000","172.21.15.141:0/3821362961":"2023-11-16T02:36:50.808565+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:36:54.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.756+0000 7f2b15ba7700 1 -- 172.21.15.1:0/4213963692 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2afc05f300 msgr2=0x7f2afc0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:54.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.756+0000 7f2b15ba7700 1 --2- 172.21.15.1:0/4213963692 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2afc05f300 0x7f2afc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:54.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.756+0000 7f2b15ba7700 1 -- 172.21.15.1:0/4213963692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b100a61b0 msgr2=0x7f2b100c1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:54.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.756+0000 7f2b15ba7700 1 --2- 172.21.15.1:0/4213963692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b100a61b0 0x7f2b100c1c30 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f2b0000e900 tx=0x7f2b00006f40).stop 2023-11-15T02:36:54.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.757+0000 7f2b15ba7700 1 -- 172.21.15.1:0/4213963692 shutdown_connections 2023-11-15T02:36:54.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.757+0000 7f2b15ba7700 1 --2- 172.21.15.1:0/4213963692 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2afc05f300 0x7f2afc0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:54.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.757+0000 7f2b15ba7700 1 --2- 172.21.15.1:0/4213963692 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b10155b70 0x7f2b10154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.757+0000 7f2b15ba7700 1 --2- 172.21.15.1:0/4213963692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b100a61b0 0x7f2b100c1c30 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.757+0000 7f2b15ba7700 1 --2- 172.21.15.1:0/4213963692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b10155790 0x7f2b1014ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.757+0000 7f2b15ba7700 1 -- 172.21.15.1:0/4213963692 >> 172.21.15.1:0/4213963692 conn(0x7f2b10082f90 msgr2=0x7f2b100c8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:54.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.757+0000 7f2b15ba7700 1 -- 172.21.15.1:0/4213963692 shutdown_connections 2023-11-15T02:36:54.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.757+0000 7f2b15ba7700 1 -- 172.21.15.1:0/4213963692 wait complete. 2023-11-15T02:36:54.775 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '151', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T02:36:36.177693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '161', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T02:36:37.489367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '162', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T02:36:54.776 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T02:36:54.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.900+0000 7fd26f80f700 1 Processor -- start 2023-11-15T02:36:54.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.900+0000 7fd26f80f700 1 -- start start 2023-11-15T02:36:54.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26f80f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd26814e960 0x7fd2680bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26f80f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd2680bc9d0 0x7fd268062910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26f80f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd268062e00 0x7fd268157f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26f80f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2680c5480 con 0x7fd26814e960 2023-11-15T02:36:54.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26f80f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2680bce50 con 0x7fd268062e00 2023-11-15T02:36:54.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26f80f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2680636e0 con 0x7fd2680bc9d0 2023-11-15T02:36:54.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26d5ab700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd26814e960 0x7fd2680bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26d5ab700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd26814e960 0x7fd2680bc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57680/0 (socket says 172.21.15.1:57680) 2023-11-15T02:36:54.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26d5ab700 1 -- 172.21.15.1:0/2087190483 learned_addr learned my addr 172.21.15.1:0/2087190483 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:54.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26cdaa700 1 --2- 172.21.15.1:0/2087190483 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd2680bc9d0 0x7fd268062910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26ddac700 1 --2- 172.21.15.1:0/2087190483 >> v2:172.21.15.141:3300/0 conn(0x7fd268062e00 0x7fd268157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26d5ab700 1 -- 172.21.15.1:0/2087190483 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd2680bc9d0 msgr2=0x7fd268062910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:54.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26d5ab700 1 --2- 172.21.15.1:0/2087190483 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd2680bc9d0 0x7fd268062910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26d5ab700 1 -- 172.21.15.1:0/2087190483 >> v2:172.21.15.141:3300/0 conn(0x7fd268062e00 msgr2=0x7fd268157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:54.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26d5ab700 1 --2- 172.21.15.1:0/2087190483 >> v2:172.21.15.141:3300/0 conn(0x7fd268062e00 0x7fd268157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26d5ab700 1 -- 172.21.15.1:0/2087190483 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2680639c0 con 0x7fd26814e960 2023-11-15T02:36:54.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd26d5ab700 1 --2- 172.21.15.1:0/2087190483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd26814e960 0x7fd2680bc4e0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7fd268137a30 tx=0x7fd2580090f0).ready entity=mon.0 client_cookie=c4934d39331bd79a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:54.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.901+0000 7fd25ffff700 1 -- 172.21.15.1:0/2087190483 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25800f510 con 0x7fd26814e960 2023-11-15T02:36:54.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.902+0000 7fd25ffff700 1 -- 172.21.15.1:0/2087190483 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25800f670 con 0x7fd26814e960 2023-11-15T02:36:54.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.902+0000 7fd25ffff700 1 -- 172.21.15.1:0/2087190483 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25800f9f0 con 0x7fd26814e960 2023-11-15T02:36:54.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.902+0000 7fd26f80f700 1 -- 172.21.15.1:0/2087190483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd26814e960 msgr2=0x7fd2680bc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:54.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.902+0000 7fd26f80f700 1 --2- 172.21.15.1:0/2087190483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd26814e960 0x7fd2680bc4e0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7fd268137a30 tx=0x7fd2580090f0).stop 2023-11-15T02:36:54.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.902+0000 7fd26f80f700 1 -- 172.21.15.1:0/2087190483 shutdown_connections 2023-11-15T02:36:54.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.902+0000 7fd26f80f700 1 --2- 172.21.15.1:0/2087190483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd26814e960 0x7fd2680bc4e0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.902+0000 7fd26f80f700 1 --2- 172.21.15.1:0/2087190483 >> v2:172.21.15.141:3300/0 conn(0x7fd268062e00 0x7fd268157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.902+0000 7fd26f80f700 1 --2- 172.21.15.1:0/2087190483 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd2680bc9d0 0x7fd268062910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.902+0000 7fd26f80f700 1 -- 172.21.15.1:0/2087190483 >> 172.21.15.1:0/2087190483 conn(0x7fd2680c8050 msgr2=0x7fd2680c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:54.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.902+0000 7fd26f80f700 1 -- 172.21.15.1:0/2087190483 shutdown_connections 2023-11-15T02:36:54.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.902+0000 7fd26f80f700 1 -- 172.21.15.1:0/2087190483 wait complete. 2023-11-15T02:36:54.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.903+0000 7fd26f80f700 1 Processor -- start 2023-11-15T02:36:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.903+0000 7fd26f80f700 1 -- start start 2023-11-15T02:36:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.904+0000 7fd26f80f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd268062e00 0x7fd268136f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.904+0000 7fd26f80f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2680bc9d0 0x7fd268137f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.904+0000 7fd26f80f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26814e960 0x7fd268138460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.904+0000 7fd26f80f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd268139380 con 0x7fd268062e00 2023-11-15T02:36:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.904+0000 7fd26f80f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2680abb80 con 0x7fd2680bc9d0 2023-11-15T02:36:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.904+0000 7fd26f80f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26813ab70 con 0x7fd26814e960 2023-11-15T02:36:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.904+0000 7fd26d5ab700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd268062e00 0x7fd268136f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.904+0000 7fd26d5ab700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd268062e00 0x7fd268136f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57690/0 (socket says 172.21.15.1:57690) 2023-11-15T02:36:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.905+0000 7fd26d5ab700 1 -- 172.21.15.1:0/4257556928 learned_addr learned my addr 172.21.15.1:0/4257556928 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.905+0000 7fd26ddac700 1 --2- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26814e960 0x7fd268138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.905+0000 7fd26cdaa700 1 --2- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2680bc9d0 0x7fd268137f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.905+0000 7fd26d5ab700 1 -- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26814e960 msgr2=0x7fd268138460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.905+0000 7fd26d5ab700 1 --2- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26814e960 0x7fd268138460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.905+0000 7fd26d5ab700 1 -- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2680bc9d0 msgr2=0x7fd268137f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.905+0000 7fd26d5ab700 1 --2- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2680bc9d0 0x7fd268137f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:54.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.905+0000 7fd26d5ab700 1 -- 172.21.15.1:0/4257556928 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd258009370 con 0x7fd268062e00 2023-11-15T02:36:54.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.905+0000 7fd26d5ab700 1 --2- 172.21.15.1:0/4257556928 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd268062e00 0x7fd268136f80 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7fd258006fd0 tx=0x7fd258017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:54.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.905+0000 7fd25d7fa700 1 -- 172.21.15.1:0/4257556928 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25800f7e0 con 0x7fd268062e00 2023-11-15T02:36:54.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.905+0000 7fd25d7fa700 1 -- 172.21.15.1:0/4257556928 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25800f940 con 0x7fd268062e00 2023-11-15T02:36:54.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.905+0000 7fd26f80f700 1 -- 172.21.15.1:0/4257556928 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2680abe20 con 0x7fd268062e00 2023-11-15T02:36:54.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.905+0000 7fd25d7fa700 1 -- 172.21.15.1:0/4257556928 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25801b660 con 0x7fd268062e00 2023-11-15T02:36:54.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.905+0000 7fd26f80f700 1 -- 172.21.15.1:0/4257556928 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd268138dc0 con 0x7fd268062e00 2023-11-15T02:36:54.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.906+0000 7fd26f80f700 1 -- 172.21.15.1:0/4257556928 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26806c7e0 con 0x7fd268062e00 2023-11-15T02:36:54.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.907+0000 7fd25d7fa700 1 -- 172.21.15.1:0/4257556928 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fd25801ba50 con 0x7fd268062e00 2023-11-15T02:36:54.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.907+0000 7fd25d7fa700 1 --2- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd24c05f300 0x7fd24c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:54.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.907+0000 7fd26cdaa700 1 -- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd24c05f300 msgr2=0x7fd24c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:54.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.907+0000 7fd25d7fa700 1 -- 172.21.15.1:0/4257556928 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fd25807bfd0 con 0x7fd268062e00 2023-11-15T02:36:54.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.907+0000 7fd26cdaa700 1 --2- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd24c05f300 0x7fd24c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:54.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:54.911+0000 7fd25d7fa700 1 -- 172.21.15.1:0/4257556928 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd25804ce60 con 0x7fd268062e00 2023-11-15T02:36:54.932 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:54.931+0000 7fc334ea7680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:36:55.003 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:55.002+0000 7fc334ea7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:36:55.023 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:55.021+0000 7f9d45edf680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:36:55.094 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:55.093+0000 7f9d45edf680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:36:55.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.108+0000 7fd26cdaa700 1 -- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd24c05f300 msgr2=0x7fd24c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:55.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.108+0000 7fd26cdaa700 1 --2- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd24c05f300 0x7fd24c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:36:55.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.132+0000 7fd26f80f700 1 -- 172.21.15.1:0/4257556928 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd268063ca0 con 0x7fd268062e00 2023-11-15T02:36:55.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.133+0000 7fd25d7fa700 1 -- 172.21.15.1:0/4257556928 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v163) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd25801f020 con 0x7fd268062e00 2023-11-15T02:36:55.135 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T02:36:55.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.135+0000 7fd26f80f700 1 -- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd24c05f300 msgr2=0x7fd24c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:55.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.135+0000 7fd26f80f700 1 --2- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd24c05f300 0x7fd24c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:55.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.135+0000 7fd26f80f700 1 -- 172.21.15.1:0/4257556928 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd268062e00 msgr2=0x7fd268136f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.135+0000 7fd26f80f700 1 --2- 172.21.15.1:0/4257556928 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd268062e00 0x7fd268136f80 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7fd258006fd0 tx=0x7fd258017000).stop 2023-11-15T02:36:55.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.135+0000 7fd26f80f700 1 -- 172.21.15.1:0/4257556928 shutdown_connections 2023-11-15T02:36:55.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.135+0000 7fd26f80f700 1 --2- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd24c05f300 0x7fd24c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:55.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.135+0000 7fd26f80f700 1 --2- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26814e960 0x7fd268138460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.135+0000 7fd26f80f700 1 --2- 172.21.15.1:0/4257556928 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd268062e00 0x7fd268136f80 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.135+0000 7fd26f80f700 1 --2- 172.21.15.1:0/4257556928 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2680bc9d0 0x7fd268137f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.135+0000 7fd26f80f700 1 -- 172.21.15.1:0/4257556928 >> 172.21.15.1:0/4257556928 conn(0x7fd2680c8050 msgr2=0x7fd268069590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:55.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.135+0000 7fd26f80f700 1 -- 172.21.15.1:0/4257556928 shutdown_connections 2023-11-15T02:36:55.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.135+0000 7fd26f80f700 1 -- 172.21.15.1:0/4257556928 wait complete. 2023-11-15T02:36:55.150 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T02:36:55.188 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:55.188+0000 7fc334ea7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:36:55.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.272+0000 7f611efe8700 1 Processor -- start 2023-11-15T02:36:55.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.272+0000 7f611efe8700 1 -- start start 2023-11-15T02:36:55.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.273+0000 7f611efe8700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f61180c8170 0x7f611815f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.273+0000 7f611efe8700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6118155830 con 0x7f61181541d0 2023-11-15T02:36:55.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.273+0000 7f611efe8700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6118154c20 con 0x7f61181545b0 2023-11-15T02:36:55.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.273+0000 7f611efe8700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6118158f40 con 0x7f61180c8170 2023-11-15T02:36:55.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.273+0000 7f611dfe6700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f61181541d0 0x7f61180c60d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:40206/0 (socket says 172.21.15.1:40206) 2023-11-15T02:36:55.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.273+0000 7f611dfe6700 1 -- 172.21.15.1:0/791925501 learned_addr learned my addr 172.21.15.1:0/791925501 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:55.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.273+0000 7f611e7e7700 1 --2- 172.21.15.1:0/791925501 >> v2:172.21.15.141:3300/0 conn(0x7f61180c8170 0x7f611815f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:55.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.273+0000 7f611cfe4700 1 -- 172.21.15.1:0/791925501 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430745164 0 0) 0x7f6118155830 con 0x7f61181541d0 2023-11-15T02:36:55.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.273+0000 7f611cfe4700 1 -- 172.21.15.1:0/791925501 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61040033f0 con 0x7f61181541d0 2023-11-15T02:36:55.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.273+0000 7f611e7e7700 1 -- 172.21.15.1:0/791925501 >> v1:172.21.15.141:6789/0 conn(0x7f61181545b0 legacy=0x7f61180c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.273+0000 7f611e7e7700 1 -- 172.21.15.1:0/791925501 >> v1:172.21.15.1:6789/0 conn(0x7f61181541d0 legacy=0x7f61180c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.273+0000 7f611e7e7700 1 -- 172.21.15.1:0/791925501 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6118154f00 con 0x7f61180c8170 2023-11-15T02:36:55.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.274+0000 7f611e7e7700 1 --2- 172.21.15.1:0/791925501 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61180c8170 0x7f611815f2d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f6110009e60 tx=0x7f6110009780).ready entity=mon.1 client_cookie=ce506dd1cb7598d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:55.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.274+0000 7f611cfe4700 1 -- 172.21.15.1:0/791925501 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611000e070 con 0x7f61180c8170 2023-11-15T02:36:55.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.274+0000 7f611cfe4700 1 -- 172.21.15.1:0/791925501 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611000bb60 con 0x7f61180c8170 2023-11-15T02:36:55.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.274+0000 7f611cfe4700 1 -- 172.21.15.1:0/791925501 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110012410 con 0x7f61180c8170 2023-11-15T02:36:55.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.274+0000 7f611efe8700 1 -- 172.21.15.1:0/791925501 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61180c8170 msgr2=0x7f611815f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.274+0000 7f611efe8700 1 --2- 172.21.15.1:0/791925501 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61180c8170 0x7f611815f2d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f6110009e60 tx=0x7f6110009780).stop 2023-11-15T02:36:55.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.274+0000 7f611efe8700 1 -- 172.21.15.1:0/791925501 shutdown_connections 2023-11-15T02:36:55.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.274+0000 7f611efe8700 1 --2- 172.21.15.1:0/791925501 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61180c8170 0x7f611815f2d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.274+0000 7f611efe8700 1 -- 172.21.15.1:0/791925501 >> 172.21.15.1:0/791925501 conn(0x7f6118069ee0 msgr2=0x7f611806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:55.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.274+0000 7f611efe8700 1 -- 172.21.15.1:0/791925501 shutdown_connections 2023-11-15T02:36:55.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.274+0000 7f611efe8700 1 -- 172.21.15.1:0/791925501 wait complete. 2023-11-15T02:36:55.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.276+0000 7f611efe8700 1 Processor -- start 2023-11-15T02:36:55.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.276+0000 7f611efe8700 1 -- start start 2023-11-15T02:36:55.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.276+0000 7f611efe8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61180c8170 0x7f61180aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.276+0000 7f611efe8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61181541d0 0x7f611814cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.276+0000 7f611efe8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61181545b0 0x7f6118157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.276+0000 7f611efe8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6118158b10 con 0x7f61181541d0 2023-11-15T02:36:55.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.276+0000 7f611efe8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61180c43b0 con 0x7f61180c8170 2023-11-15T02:36:55.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.276+0000 7f611efe8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61180c4690 con 0x7f61181545b0 2023-11-15T02:36:55.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f611d7e5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61181541d0 0x7f611814cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:55.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f611d7e5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61181541d0 0x7f611814cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57698/0 (socket says 172.21.15.1:57698) 2023-11-15T02:36:55.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f611d7e5700 1 -- 172.21.15.1:0/2251273365 learned_addr learned my addr 172.21.15.1:0/2251273365 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:55.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f611e7e7700 1 --2- 172.21.15.1:0/2251273365 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61181545b0 0x7f6118157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:55.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f611dfe6700 1 --2- 172.21.15.1:0/2251273365 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61180c8170 0x7f61180aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:55.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f611d7e5700 1 -- 172.21.15.1:0/2251273365 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61181545b0 msgr2=0x7f6118157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f611d7e5700 1 --2- 172.21.15.1:0/2251273365 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61181545b0 0x7f6118157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f611d7e5700 1 -- 172.21.15.1:0/2251273365 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61180c8170 msgr2=0x7f61180aa020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f611d7e5700 1 --2- 172.21.15.1:0/2251273365 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61180c8170 0x7f61180aa020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f611d7e5700 1 -- 172.21.15.1:0/2251273365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110009a20 con 0x7f61181541d0 2023-11-15T02:36:55.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f611d7e5700 1 --2- 172.21.15.1:0/2251273365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61181541d0 0x7f611814cc10 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f610800c440 tx=0x7f6108007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:55.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f610dffb700 1 -- 172.21.15.1:0/2251273365 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108007020 con 0x7f61181541d0 2023-11-15T02:36:55.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f610dffb700 1 -- 172.21.15.1:0/2251273365 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6108007180 con 0x7f61181541d0 2023-11-15T02:36:55.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f611efe8700 1 -- 172.21.15.1:0/2251273365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61180c4970 con 0x7f61181541d0 2023-11-15T02:36:55.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f610dffb700 1 -- 172.21.15.1:0/2251273365 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108007520 con 0x7f61181541d0 2023-11-15T02:36:55.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.277+0000 7f611efe8700 1 -- 172.21.15.1:0/2251273365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611814d100 con 0x7f61181541d0 2023-11-15T02:36:55.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.279+0000 7f611efe8700 1 -- 172.21.15.1:0/2251273365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61180c4b60 con 0x7f61181541d0 2023-11-15T02:36:55.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.279+0000 7f610dffb700 1 -- 172.21.15.1:0/2251273365 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f61080068b0 con 0x7f61181541d0 2023-11-15T02:36:55.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.279+0000 7f610dffb700 1 --2- 172.21.15.1:0/2251273365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60fc05f300 0x7f60fc0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.279+0000 7f610dffb700 1 -- 172.21.15.1:0/2251273365 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f61080799a0 con 0x7f61181541d0 2023-11-15T02:36:55.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.279+0000 7f611dfe6700 1 -- 172.21.15.1:0/2251273365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60fc05f300 msgr2=0x7f60fc0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:55.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.279+0000 7f611dfe6700 1 --2- 172.21.15.1:0/2251273365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60fc05f300 0x7f60fc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:55.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.283+0000 7f610dffb700 1 -- 172.21.15.1:0/2251273365 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6108047af0 con 0x7f61181541d0 2023-11-15T02:36:55.298 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:55.294+0000 7f9d45edf680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:36:55.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.458+0000 7f611efe8700 1 -- 172.21.15.1:0/2251273365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f611814d350 con 0x7f61181541d0 2023-11-15T02:36:55.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.459+0000 7f610dffb700 1 -- 172.21.15.1:0/2251273365 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v163) v1 ==== 92+0+10 (secure 0 0 0) 0x7f610804a780 con 0x7f61181541d0 2023-11-15T02:36:55.461 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T02:36:55.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.461+0000 7f611efe8700 1 -- 172.21.15.1:0/2251273365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60fc05f300 msgr2=0x7f60fc0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:55.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.461+0000 7f611efe8700 1 --2- 172.21.15.1:0/2251273365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60fc05f300 0x7f60fc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:55.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.461+0000 7f611efe8700 1 -- 172.21.15.1:0/2251273365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61181541d0 msgr2=0x7f611814cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.461+0000 7f611efe8700 1 --2- 172.21.15.1:0/2251273365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61181541d0 0x7f611814cc10 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f610800c440 tx=0x7f6108007e00).stop 2023-11-15T02:36:55.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.461+0000 7f611efe8700 1 -- 172.21.15.1:0/2251273365 shutdown_connections 2023-11-15T02:36:55.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.461+0000 7f611efe8700 1 --2- 172.21.15.1:0/2251273365 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60fc05f300 0x7f60fc0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:55.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.461+0000 7f611efe8700 1 --2- 172.21.15.1:0/2251273365 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61181545b0 0x7f6118157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.461+0000 7f611efe8700 1 --2- 172.21.15.1:0/2251273365 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61180c8170 0x7f61180aa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.461+0000 7f611efe8700 1 --2- 172.21.15.1:0/2251273365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61181541d0 0x7f611814cc10 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.461+0000 7f611efe8700 1 -- 172.21.15.1:0/2251273365 >> 172.21.15.1:0/2251273365 conn(0x7f6118069ee0 msgr2=0x7f61180c1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:55.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.461+0000 7f611efe8700 1 -- 172.21.15.1:0/2251273365 shutdown_connections 2023-11-15T02:36:55.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.461+0000 7f611efe8700 1 -- 172.21.15.1:0/2251273365 wait complete. 2023-11-15T02:36:55.475 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T02:36:55.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.598+0000 7fcfaec84700 1 Processor -- start 2023-11-15T02:36:55.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.598+0000 7fcfaec84700 1 -- start start 2023-11-15T02:36:55.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.599+0000 7fcfaec84700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa80c6650 0x7fcfa80aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.599+0000 7fcfaec84700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa80ca050 con 0x7fcfa8154480 2023-11-15T02:36:55.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.599+0000 7fcfaec84700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa80c9440 con 0x7fcfa81540a0 2023-11-15T02:36:55.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.599+0000 7fcfaec84700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80c9720 con 0x7fcfa80c6650 2023-11-15T02:36:55.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.599+0000 7fcfa7fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fcfa8154480 0x7fcfa80c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:40220/0 (socket says 172.21.15.1:40220) 2023-11-15T02:36:55.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.599+0000 7fcfa7fff700 1 -- 172.21.15.1:0/3323624692 learned_addr learned my addr 172.21.15.1:0/3323624692 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:55.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.599+0000 7fcfad221700 1 --2- 172.21.15.1:0/3323624692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa80c6650 0x7fcfa80aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:55.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.599+0000 7fcfa77fe700 1 -- 172.21.15.1:0/3323624692 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224174277 0 0) 0x7fcfa80ca050 con 0x7fcfa8154480 2023-11-15T02:36:55.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.599+0000 7fcfa77fe700 1 -- 172.21.15.1:0/3323624692 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf980033f0 con 0x7fcfa8154480 2023-11-15T02:36:55.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.599+0000 7fcfa77fe700 1 -- 172.21.15.1:0/3323624692 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271697167 0 0) 0x7fcfa80c9440 con 0x7fcfa81540a0 2023-11-15T02:36:55.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.599+0000 7fcfa77fe700 1 -- 172.21.15.1:0/3323624692 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfa80ca050 con 0x7fcfa81540a0 2023-11-15T02:36:55.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.599+0000 7fcfad221700 1 -- 172.21.15.1:0/3323624692 >> v1:172.21.15.141:6789/0 conn(0x7fcfa81540a0 legacy=0x7fcfa80ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.599+0000 7fcfad221700 1 -- 172.21.15.1:0/3323624692 >> v1:172.21.15.1:6789/0 conn(0x7fcfa8154480 legacy=0x7fcfa80c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.599+0000 7fcfad221700 1 -- 172.21.15.1:0/3323624692 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa80c9a00 con 0x7fcfa80c6650 2023-11-15T02:36:55.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.600+0000 7fcfad221700 1 --2- 172.21.15.1:0/3323624692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa80c6650 0x7fcfa80aaf40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fcfa0009e90 tx=0x7fcfa0009780).ready entity=mon.2 client_cookie=1736190364705ef9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:55.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.600+0000 7fcfa77fe700 1 -- 172.21.15.1:0/3323624692 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000e070 con 0x7fcfa80c6650 2023-11-15T02:36:55.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.600+0000 7fcfa77fe700 1 -- 172.21.15.1:0/3323624692 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa000bab0 con 0x7fcfa80c6650 2023-11-15T02:36:55.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.600+0000 7fcfa77fe700 1 -- 172.21.15.1:0/3323624692 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000be30 con 0x7fcfa80c6650 2023-11-15T02:36:55.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.600+0000 7fcfaec84700 1 -- 172.21.15.1:0/3323624692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa80c6650 msgr2=0x7fcfa80aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.600+0000 7fcfaec84700 1 --2- 172.21.15.1:0/3323624692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa80c6650 0x7fcfa80aaf40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fcfa0009e90 tx=0x7fcfa0009780).stop 2023-11-15T02:36:55.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.600+0000 7fcfaec84700 1 -- 172.21.15.1:0/3323624692 shutdown_connections 2023-11-15T02:36:55.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.600+0000 7fcfaec84700 1 --2- 172.21.15.1:0/3323624692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa80c6650 0x7fcfa80aaf40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.600+0000 7fcfaec84700 1 -- 172.21.15.1:0/3323624692 >> 172.21.15.1:0/3323624692 conn(0x7fcfa8064a70 msgr2=0x7fcfa8064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:55.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.601+0000 7fcfaec84700 1 -- 172.21.15.1:0/3323624692 shutdown_connections 2023-11-15T02:36:55.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.601+0000 7fcfaec84700 1 -- 172.21.15.1:0/3323624692 wait complete. 2023-11-15T02:36:55.608 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:55.606+0000 7fc334ea7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:36:55.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.602+0000 7fcfaec84700 1 Processor -- start 2023-11-15T02:36:55.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.602+0000 7fcfaec84700 1 -- start start 2023-11-15T02:36:55.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfaec84700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfa80c6650 0x7fcfa80aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfaec84700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa81540a0 0x7fcfa80b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfaec84700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa8154480 0x7fcfa8167ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfaec84700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80c4ad0 con 0x7fcfa8154480 2023-11-15T02:36:55.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfaec84700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80af350 con 0x7fcfa80c6650 2023-11-15T02:36:55.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfaec84700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80c3ec0 con 0x7fcfa81540a0 2023-11-15T02:36:55.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfad221700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa8154480 0x7fcfa8167ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:55.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfad221700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa8154480 0x7fcfa8167ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57706/0 (socket says 172.21.15.1:57706) 2023-11-15T02:36:55.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfad221700 1 -- 172.21.15.1:0/1975573813 learned_addr learned my addr 172.21.15.1:0/1975573813 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:55.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfa7fff700 1 --2- 172.21.15.1:0/1975573813 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa81540a0 0x7fcfa80b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:55.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfaca20700 1 --2- 172.21.15.1:0/1975573813 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfa80c6650 0x7fcfa80aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:55.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfad221700 1 -- 172.21.15.1:0/1975573813 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa81540a0 msgr2=0x7fcfa80b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfad221700 1 --2- 172.21.15.1:0/1975573813 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa81540a0 0x7fcfa80b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfad221700 1 -- 172.21.15.1:0/1975573813 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfa80c6650 msgr2=0x7fcfa80aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfad221700 1 --2- 172.21.15.1:0/1975573813 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfa80c6650 0x7fcfa80aa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfad221700 1 -- 172.21.15.1:0/1975573813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0009a20 con 0x7fcfa8154480 2023-11-15T02:36:55.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfad221700 1 --2- 172.21.15.1:0/1975573813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa8154480 0x7fcfa8167ea0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7fcfa000b610 tx=0x7fcfa0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:55.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.603+0000 7fcfa4ff9700 1 -- 172.21.15.1:0/1975573813 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0013e90 con 0x7fcfa8154480 2023-11-15T02:36:55.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.604+0000 7fcfa4ff9700 1 -- 172.21.15.1:0/1975573813 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa001d630 con 0x7fcfa8154480 2023-11-15T02:36:55.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.604+0000 7fcfaec84700 1 -- 172.21.15.1:0/1975573813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa80c41a0 con 0x7fcfa8154480 2023-11-15T02:36:55.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.604+0000 7fcfa4ff9700 1 -- 172.21.15.1:0/1975573813 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa001d9f0 con 0x7fcfa8154480 2023-11-15T02:36:55.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.604+0000 7fcfaec84700 1 -- 172.21.15.1:0/1975573813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa80c4760 con 0x7fcfa8154480 2023-11-15T02:36:55.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.605+0000 7fcfaec84700 1 -- 172.21.15.1:0/1975573813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa806c7e0 con 0x7fcfa8154480 2023-11-15T02:36:55.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.605+0000 7fcfa4ff9700 1 -- 172.21.15.1:0/1975573813 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fcfa0003040 con 0x7fcfa8154480 2023-11-15T02:36:55.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.605+0000 7fcfa4ff9700 1 --2- 172.21.15.1:0/1975573813 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf8c05f300 0x7fcf8c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.605+0000 7fcfaca20700 1 -- 172.21.15.1:0/1975573813 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf8c05f300 msgr2=0x7fcf8c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:55.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.605+0000 7fcfa4ff9700 1 -- 172.21.15.1:0/1975573813 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fcfa007c6c0 con 0x7fcfa8154480 2023-11-15T02:36:55.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.605+0000 7fcfaca20700 1 --2- 172.21.15.1:0/1975573813 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf8c05f300 0x7fcf8c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:55.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.610+0000 7fcfa4ff9700 1 -- 172.21.15.1:0/1975573813 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcfa0050dc0 con 0x7fcfa8154480 2023-11-15T02:36:55.711 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:55.710+0000 7fc334ea7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:36:55.745 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:55.744+0000 7f9d45edf680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:36:55.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.783+0000 7fcfaec84700 1 -- 172.21.15.1:0/1975573813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcfa80c9ce0 con 0x7fcfa8154480 2023-11-15T02:36:55.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.783+0000 7fcfa4ff9700 1 -- 172.21.15.1:0/1975573813 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v163) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcfa00509b0 con 0x7fcfa8154480 2023-11-15T02:36:55.786 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T02:36:55.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.785+0000 7fcfaec84700 1 -- 172.21.15.1:0/1975573813 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf8c05f300 msgr2=0x7fcf8c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:55.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.785+0000 7fcfaec84700 1 --2- 172.21.15.1:0/1975573813 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf8c05f300 0x7fcf8c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:55.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.785+0000 7fcfaec84700 1 -- 172.21.15.1:0/1975573813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa8154480 msgr2=0x7fcfa8167ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.785+0000 7fcfaec84700 1 --2- 172.21.15.1:0/1975573813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa8154480 0x7fcfa8167ea0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7fcfa000b610 tx=0x7fcfa0009780).stop 2023-11-15T02:36:55.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.785+0000 7fcfaec84700 1 -- 172.21.15.1:0/1975573813 shutdown_connections 2023-11-15T02:36:55.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.785+0000 7fcfaec84700 1 --2- 172.21.15.1:0/1975573813 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcf8c05f300 0x7fcf8c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:55.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.785+0000 7fcfaec84700 1 --2- 172.21.15.1:0/1975573813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcfa8154480 0x7fcfa8167ea0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.785+0000 7fcfaec84700 1 --2- 172.21.15.1:0/1975573813 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcfa80c6650 0x7fcfa80aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.785+0000 7fcfaec84700 1 --2- 172.21.15.1:0/1975573813 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcfa81540a0 0x7fcfa80b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.785+0000 7fcfaec84700 1 -- 172.21.15.1:0/1975573813 >> 172.21.15.1:0/1975573813 conn(0x7fcfa8064a70 msgr2=0x7fcfa8064e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:55.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.786+0000 7fcfaec84700 1 -- 172.21.15.1:0/1975573813 shutdown_connections 2023-11-15T02:36:55.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.786+0000 7fcfaec84700 1 -- 172.21.15.1:0/1975573813 wait complete. 2023-11-15T02:36:55.800 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T02:36:55.858 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:55.856+0000 7f9d45edf680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:36:55.864 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:55.863+0000 7fc334ea7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:36:55.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.920+0000 7f4a2cd35700 1 Processor -- start 2023-11-15T02:36:55.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.920+0000 7f4a2cd35700 1 -- start start 2023-11-15T02:36:55.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.921+0000 7f4a2cd35700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4a281520c0 0x7f4a280c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.921+0000 7f4a2cd35700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4a28155db0 0x7f4a28156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.921+0000 7f4a2cd35700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a280c5b30 con 0x7f4a280c5fc0 2023-11-15T02:36:55.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.921+0000 7f4a2cd35700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a28156720 con 0x7f4a28155db0 2023-11-15T02:36:55.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.921+0000 7f4a2cd35700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a280c5520 con 0x7f4a281520c0 2023-11-15T02:36:55.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.921+0000 7f4a25d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4a28155db0 0x7f4a28156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:55.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.921+0000 7f4a26d9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4a280c5fc0 0x7f4a280c63f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:40228/0 (socket says 172.21.15.1:40228) 2023-11-15T02:36:55.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.921+0000 7f4a25d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4a28155db0 0x7f4a28156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57710/0 (socket says 172.21.15.1:57710) 2023-11-15T02:36:55.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.921+0000 7f4a26d9d700 1 -- 172.21.15.1:0/2668464638 learned_addr learned my addr 172.21.15.1:0/2668464638 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:55.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.921+0000 7f4a2659c700 1 --2- 172.21.15.1:0/2668464638 >> v2:172.21.15.141:3300/0 conn(0x7f4a281520c0 0x7f4a280c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:55.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.922+0000 7f4a25d9b700 1 -- 172.21.15.1:0/2668464638 >> v2:172.21.15.141:3300/0 conn(0x7f4a281520c0 msgr2=0x7f4a280c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:55.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.922+0000 7f4a25d9b700 1 --2- 172.21.15.1:0/2668464638 >> v2:172.21.15.141:3300/0 conn(0x7f4a281520c0 0x7f4a280c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.922+0000 7f4a25d9b700 1 -- 172.21.15.1:0/2668464638 >> v1:172.21.15.1:6789/0 conn(0x7f4a280c5fc0 legacy=0x7f4a280c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.922+0000 7f4a25d9b700 1 -- 172.21.15.1:0/2668464638 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a280c4f10 con 0x7f4a28155db0 2023-11-15T02:36:55.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.922+0000 7f4a2559a700 1 -- 172.21.15.1:0/2668464638 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261079943 0 0) 0x7f4a280c5b30 con 0x7f4a280c5fc0 2023-11-15T02:36:55.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.922+0000 7f4a25d9b700 1 --2- 172.21.15.1:0/2668464638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a28155db0 0x7f4a28156230 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f4a28156ee0 tx=0x7f4a18009060).ready entity=mon.0 client_cookie=365cf31dc7475bbc server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:55.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.922+0000 7f4a2559a700 1 -- 172.21.15.1:0/2668464638 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800f510 con 0x7f4a28155db0 2023-11-15T02:36:55.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.922+0000 7f4a2559a700 1 -- 172.21.15.1:0/2668464638 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1800f670 con 0x7f4a28155db0 2023-11-15T02:36:55.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.922+0000 7f4a2559a700 1 -- 172.21.15.1:0/2668464638 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800f9f0 con 0x7f4a28155db0 2023-11-15T02:36:55.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.923+0000 7f4a2cd35700 1 -- 172.21.15.1:0/2668464638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a28155db0 msgr2=0x7f4a28156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.923+0000 7f4a2cd35700 1 --2- 172.21.15.1:0/2668464638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a28155db0 0x7f4a28156230 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f4a28156ee0 tx=0x7f4a18009060).stop 2023-11-15T02:36:55.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.923+0000 7f4a2cd35700 1 -- 172.21.15.1:0/2668464638 shutdown_connections 2023-11-15T02:36:55.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.923+0000 7f4a2cd35700 1 --2- 172.21.15.1:0/2668464638 >> v2:172.21.15.141:3300/0 conn(0x7f4a281520c0 0x7f4a280c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.923+0000 7f4a2cd35700 1 --2- 172.21.15.1:0/2668464638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a28155db0 0x7f4a28156230 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.923+0000 7f4a2cd35700 1 -- 172.21.15.1:0/2668464638 >> 172.21.15.1:0/2668464638 conn(0x7f4a280c8050 msgr2=0x7f4a280c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:55.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.923+0000 7f4a2cd35700 1 -- 172.21.15.1:0/2668464638 shutdown_connections 2023-11-15T02:36:55.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.923+0000 7f4a2cd35700 1 -- 172.21.15.1:0/2668464638 wait complete. 2023-11-15T02:36:55.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.924+0000 7f4a2cd35700 1 Processor -- start 2023-11-15T02:36:55.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.924+0000 7f4a2cd35700 1 -- start start 2023-11-15T02:36:55.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a2cd35700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4a280c5fc0 0x7f4a280ab100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a2cd35700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a281520c0 0x7f4a280be5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a2cd35700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4a28155db0 0x7f4a28144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a2cd35700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280ab5f0 con 0x7f4a281520c0 2023-11-15T02:36:55.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a2cd35700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280beae0 con 0x7f4a28155db0 2023-11-15T02:36:55.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a2cd35700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280bed20 con 0x7f4a280c5fc0 2023-11-15T02:36:55.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a25d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a281520c0 0x7f4a280be5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:55.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a25d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a281520c0 0x7f4a280be5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57726/0 (socket says 172.21.15.1:57726) 2023-11-15T02:36:55.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a25d9b700 1 -- 172.21.15.1:0/4259680273 learned_addr learned my addr 172.21.15.1:0/4259680273 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:55.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a2659c700 1 --2- 172.21.15.1:0/4259680273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4a280c5fc0 0x7f4a280ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:55.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a26d9d700 1 --2- 172.21.15.1:0/4259680273 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4a28155db0 0x7f4a28144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:55.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a25d9b700 1 -- 172.21.15.1:0/4259680273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4a280c5fc0 msgr2=0x7f4a280ab100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a25d9b700 1 --2- 172.21.15.1:0/4259680273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4a280c5fc0 0x7f4a280ab100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a25d9b700 1 -- 172.21.15.1:0/4259680273 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4a28155db0 msgr2=0x7f4a28144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:55.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a25d9b700 1 --2- 172.21.15.1:0/4259680273 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4a28155db0 0x7f4a28144e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:55.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a25d9b700 1 -- 172.21.15.1:0/4259680273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a180092a0 con 0x7f4a281520c0 2023-11-15T02:36:55.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a26d9d700 1 --2- 172.21.15.1:0/4259680273 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4a28155db0 0x7f4a28144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:55.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a25d9b700 1 --2- 172.21.15.1:0/4259680273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a281520c0 0x7f4a280be5f0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f4a18009dd0 tx=0x7f4a18017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:55.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a167fc700 1 -- 172.21.15.1:0/4259680273 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800f7e0 con 0x7f4a281520c0 2023-11-15T02:36:55.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a167fc700 1 -- 172.21.15.1:0/4259680273 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1800f940 con 0x7f4a281520c0 2023-11-15T02:36:55.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a2cd35700 1 -- 172.21.15.1:0/4259680273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a280bf000 con 0x7f4a281520c0 2023-11-15T02:36:55.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.925+0000 7f4a167fc700 1 -- 172.21.15.1:0/4259680273 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1801b640 con 0x7f4a281520c0 2023-11-15T02:36:55.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.926+0000 7f4a2cd35700 1 -- 172.21.15.1:0/4259680273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a280bf640 con 0x7f4a281520c0 2023-11-15T02:36:55.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.927+0000 7f4a2cd35700 1 -- 172.21.15.1:0/4259680273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2806c7e0 con 0x7f4a281520c0 2023-11-15T02:36:55.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.927+0000 7f4a167fc700 1 -- 172.21.15.1:0/4259680273 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f4a1801ba30 con 0x7f4a281520c0 2023-11-15T02:36:55.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.927+0000 7f4a167fc700 1 --2- 172.21.15.1:0/4259680273 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4a0805f2d0 0x7f4a08061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:55.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.927+0000 7f4a167fc700 1 -- 172.21.15.1:0/4259680273 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f4a1807bc40 con 0x7f4a281520c0 2023-11-15T02:36:55.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.927+0000 7f4a2659c700 1 -- 172.21.15.1:0/4259680273 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4a0805f2d0 msgr2=0x7f4a08061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:55.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.927+0000 7f4a2659c700 1 --2- 172.21.15.1:0/4259680273 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4a0805f2d0 0x7f4a08061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:55.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:55.932+0000 7f4a167fc700 1 -- 172.21.15.1:0/4259680273 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4a1804ca20 con 0x7f4a281520c0 2023-11-15T02:36:55.941 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:55.938+0000 7fc334ea7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:36:56.007 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:56.007+0000 7fc334ea7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:36:56.032 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:56.031+0000 7f9d45edf680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:36:56.111 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:56.110+0000 7f9d45edf680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:36:56.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.119+0000 7f4a2cd35700 1 -- 172.21.15.1:0/4259680273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a28063da0 con 0x7f4a281520c0 2023-11-15T02:36:56.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.120+0000 7f4a167fc700 1 -- 172.21.15.1:0/4259680273 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v163) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a18050040 con 0x7f4a281520c0 2023-11-15T02:36:56.122 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T02:36:56.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.121+0000 7f4a2cd35700 1 -- 172.21.15.1:0/4259680273 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4a0805f2d0 msgr2=0x7f4a08061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:56.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.121+0000 7f4a2cd35700 1 --2- 172.21.15.1:0/4259680273 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4a0805f2d0 0x7f4a08061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:56.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.121+0000 7f4a2cd35700 1 -- 172.21.15.1:0/4259680273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a281520c0 msgr2=0x7f4a280be5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.121+0000 7f4a2cd35700 1 --2- 172.21.15.1:0/4259680273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a281520c0 0x7f4a280be5f0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f4a18009dd0 tx=0x7f4a18017000).stop 2023-11-15T02:36:56.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.121+0000 7f4a2cd35700 1 -- 172.21.15.1:0/4259680273 shutdown_connections 2023-11-15T02:36:56.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.121+0000 7f4a2cd35700 1 --2- 172.21.15.1:0/4259680273 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4a0805f2d0 0x7f4a08061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:56.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.121+0000 7f4a2cd35700 1 --2- 172.21.15.1:0/4259680273 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4a28155db0 0x7f4a28144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.121+0000 7f4a2cd35700 1 --2- 172.21.15.1:0/4259680273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4a280c5fc0 0x7f4a280ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.121+0000 7f4a2cd35700 1 --2- 172.21.15.1:0/4259680273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a281520c0 0x7f4a280be5f0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.121+0000 7f4a2cd35700 1 -- 172.21.15.1:0/4259680273 >> 172.21.15.1:0/4259680273 conn(0x7f4a280c8050 msgr2=0x7f4a280698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:56.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.122+0000 7f4a2cd35700 1 -- 172.21.15.1:0/4259680273 shutdown_connections 2023-11-15T02:36:56.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.122+0000 7f4a2cd35700 1 -- 172.21.15.1:0/4259680273 wait complete. 2023-11-15T02:36:56.136 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:36:56.185 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:56.183+0000 7f9d45edf680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:36:56.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.253+0000 7fbfef67c700 1 Processor -- start 2023-11-15T02:36:56.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.254+0000 7fbfef67c700 1 -- start start 2023-11-15T02:36:56.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.254+0000 7fbfef67c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbfe81375a0 0x7fbfe80667a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.255+0000 7fbfef67c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe8155d10 con 0x7fbfe81371c0 2023-11-15T02:36:56.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.255+0000 7fbfef67c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe8068290 con 0x7fbfe8067d90 2023-11-15T02:36:56.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.255+0000 7fbfef67c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe80c6e30 con 0x7fbfe81375a0 2023-11-15T02:36:56.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.255+0000 7fbfed418700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fbfe81371c0 0x7fbfe81552a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:40240/0 (socket says 172.21.15.1:40240) 2023-11-15T02:36:56.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.255+0000 7fbfed418700 1 -- 172.21.15.1:0/2336998542 learned_addr learned my addr 172.21.15.1:0/2336998542 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:56.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.255+0000 7fbfecc17700 1 --2- 172.21.15.1:0/2336998542 >> v2:172.21.15.141:3300/0 conn(0x7fbfe81375a0 0x7fbfe80667a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:56.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.255+0000 7fbfdbfff700 1 -- 172.21.15.1:0/2336998542 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661445115 0 0) 0x7fbfe8155d10 con 0x7fbfe81371c0 2023-11-15T02:36:56.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.255+0000 7fbfdbfff700 1 -- 172.21.15.1:0/2336998542 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfd40033f0 con 0x7fbfe81371c0 2023-11-15T02:36:56.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.255+0000 7fbfecc17700 1 -- 172.21.15.1:0/2336998542 >> v1:172.21.15.141:6789/0 conn(0x7fbfe8067d90 legacy=0x7fbfe814e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.255+0000 7fbfdbfff700 1 -- 172.21.15.1:0/2336998542 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767778853 0 0) 0x7fbfe8068290 con 0x7fbfe8067d90 2023-11-15T02:36:56.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.255+0000 7fbfecc17700 1 -- 172.21.15.1:0/2336998542 >> v1:172.21.15.1:6789/0 conn(0x7fbfe81371c0 legacy=0x7fbfe81552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.255+0000 7fbfecc17700 1 -- 172.21.15.1:0/2336998542 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe8068570 con 0x7fbfe81375a0 2023-11-15T02:36:56.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.255+0000 7fbfecc17700 1 --2- 172.21.15.1:0/2336998542 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfe81375a0 0x7fbfe80667a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fbfe4009760 tx=0x7fbfe4009060).ready entity=mon.1 client_cookie=c799108e05bad046 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:56.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.255+0000 7fbfdbfff700 1 -- 172.21.15.1:0/2336998542 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe400f510 con 0x7fbfe81375a0 2023-11-15T02:36:56.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.256+0000 7fbfdbfff700 1 -- 172.21.15.1:0/2336998542 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe400f670 con 0x7fbfe81375a0 2023-11-15T02:36:56.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.256+0000 7fbfdbfff700 1 -- 172.21.15.1:0/2336998542 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe400f9f0 con 0x7fbfe81375a0 2023-11-15T02:36:56.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.256+0000 7fbfef67c700 1 -- 172.21.15.1:0/2336998542 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfe81375a0 msgr2=0x7fbfe80667a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.256+0000 7fbfef67c700 1 --2- 172.21.15.1:0/2336998542 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfe81375a0 0x7fbfe80667a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fbfe4009760 tx=0x7fbfe4009060).stop 2023-11-15T02:36:56.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.256+0000 7fbfef67c700 1 -- 172.21.15.1:0/2336998542 shutdown_connections 2023-11-15T02:36:56.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.256+0000 7fbfef67c700 1 --2- 172.21.15.1:0/2336998542 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfe81375a0 0x7fbfe80667a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.256+0000 7fbfef67c700 1 -- 172.21.15.1:0/2336998542 >> 172.21.15.1:0/2336998542 conn(0x7fbfe80c8ed0 msgr2=0x7fbfe80c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:56.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.256+0000 7fbfef67c700 1 -- 172.21.15.1:0/2336998542 shutdown_connections 2023-11-15T02:36:56.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.256+0000 7fbfef67c700 1 -- 172.21.15.1:0/2336998542 wait complete. 2023-11-15T02:36:56.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.257+0000 7fbfef67c700 1 Processor -- start 2023-11-15T02:36:56.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.257+0000 7fbfef67c700 1 -- start start 2023-11-15T02:36:56.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.258+0000 7fbfef67c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfe8067d90 0x7fbfe80ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.258+0000 7fbfef67c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfe81371c0 0x7fbfe80ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.258+0000 7fbfef67c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfe81375a0 0x7fbfe8136840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.258+0000 7fbfef67c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe81379e0 con 0x7fbfe8067d90 2023-11-15T02:36:56.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.258+0000 7fbfef67c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe8138280 con 0x7fbfe81371c0 2023-11-15T02:36:56.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.258+0000 7fbfef67c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe80aed00 con 0x7fbfe81375a0 2023-11-15T02:36:56.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.258+0000 7fbfed418700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfe8067d90 0x7fbfe80ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:56.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.258+0000 7fbfed418700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfe8067d90 0x7fbfe80ad490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57730/0 (socket says 172.21.15.1:57730) 2023-11-15T02:36:56.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.258+0000 7fbfed418700 1 -- 172.21.15.1:0/986351294 learned_addr learned my addr 172.21.15.1:0/986351294 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:56.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.258+0000 7fbfedc19700 1 --2- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfe81375a0 0x7fbfe8136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:56.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.259+0000 7fbfecc17700 1 --2- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfe81371c0 0x7fbfe80ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:56.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.259+0000 7fbfed418700 1 -- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfe81375a0 msgr2=0x7fbfe8136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.259+0000 7fbfed418700 1 --2- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfe81375a0 0x7fbfe8136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.259+0000 7fbfed418700 1 -- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfe81371c0 msgr2=0x7fbfe80ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.259+0000 7fbfed418700 1 --2- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfe81371c0 0x7fbfe80ae4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.259+0000 7fbfed418700 1 -- 172.21.15.1:0/986351294 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe40092a0 con 0x7fbfe8067d90 2023-11-15T02:36:56.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.259+0000 7fbfed418700 1 --2- 172.21.15.1:0/986351294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfe8067d90 0x7fbfe80ad490 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fbfdc00c410 tx=0x7fbfdc007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:56.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.259+0000 7fbfd97fa700 1 -- 172.21.15.1:0/986351294 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc0070d0 con 0x7fbfe8067d90 2023-11-15T02:36:56.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.259+0000 7fbfd97fa700 1 -- 172.21.15.1:0/986351294 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc007230 con 0x7fbfe8067d90 2023-11-15T02:36:56.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.259+0000 7fbfef67c700 1 -- 172.21.15.1:0/986351294 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe8137c30 con 0x7fbfe8067d90 2023-11-15T02:36:56.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.259+0000 7fbfd97fa700 1 -- 172.21.15.1:0/986351294 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc0075d0 con 0x7fbfe8067d90 2023-11-15T02:36:56.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.259+0000 7fbfef67c700 1 -- 172.21.15.1:0/986351294 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe80ae9a0 con 0x7fbfe8067d90 2023-11-15T02:36:56.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.260+0000 7fbfef67c700 1 -- 172.21.15.1:0/986351294 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe806c7e0 con 0x7fbfe8067d90 2023-11-15T02:36:56.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.260+0000 7fbfd97fa700 1 -- 172.21.15.1:0/986351294 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fbfdc0059b0 con 0x7fbfe8067d90 2023-11-15T02:36:56.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.261+0000 7fbfd97fa700 1 --2- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbfcc05f300 0x7fbfcc0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.261+0000 7fbfd97fa700 1 -- 172.21.15.1:0/986351294 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6875+0+0 (secure 0 0 0) 0x7fbfdc079cc0 con 0x7fbfe8067d90 2023-11-15T02:36:56.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.261+0000 7fbfecc17700 1 -- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbfcc05f300 msgr2=0x7fbfcc0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:56.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.261+0000 7fbfecc17700 1 --2- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbfcc05f300 0x7fbfcc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:56.272 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:56.264+0000 7fc334ea7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:36:56.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.265+0000 7fbfd97fa700 1 -- 172.21.15.1:0/986351294 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbfdc04aaa0 con 0x7fbfe8067d90 2023-11-15T02:36:56.448 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:56.447+0000 7fc334ea7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:36:56.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.462+0000 7fbfecc17700 1 -- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbfcc05f300 msgr2=0x7fbfcc0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:56.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.462+0000 7fbfecc17700 1 --2- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbfcc05f300 0x7fbfcc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:36:56.464 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:56.463+0000 7f9d45edf680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:36:56.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.481+0000 7fbfef67c700 1 -- 172.21.15.1:0/986351294 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbfe8068850 con 0x7fbfe8067d90 2023-11-15T02:36:56.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.481+0000 7fbfd97fa700 1 -- 172.21.15.1:0/986351294 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fbfdc077e60 con 0x7fbfe8067d90 2023-11-15T02:36:56.484 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:56.484 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7019,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3898250637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3898250637},{"type":"v1","addr":"172.21.15.141:6836","nonce":3898250637}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7022,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3709207600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3709207600},{"type":"v1","addr":"172.21.15.141:6837","nonce":3709207600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1212884558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1212884558},{"type":"v1","addr":"172.21.15.1:6835","nonce":1212884558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:36:38.505394+0000","modified":"2023-11-15T02:36:41.520212+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8619":{"gid":8619,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6834/1968331775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1968331775},{"type":"v1","addr":"172.21.15.1:6834","nonce":1968331775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-11-15T02:36:56.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.483+0000 7fbfef67c700 1 -- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbfcc05f300 msgr2=0x7fbfcc0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:56.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.483+0000 7fbfef67c700 1 --2- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbfcc05f300 0x7fbfcc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:56.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.483+0000 7fbfef67c700 1 -- 172.21.15.1:0/986351294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfe8067d90 msgr2=0x7fbfe80ad490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.483+0000 7fbfef67c700 1 --2- 172.21.15.1:0/986351294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfe8067d90 0x7fbfe80ad490 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fbfdc00c410 tx=0x7fbfdc007c70).stop 2023-11-15T02:36:56.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.484+0000 7fbfef67c700 1 -- 172.21.15.1:0/986351294 shutdown_connections 2023-11-15T02:36:56.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.484+0000 7fbfef67c700 1 --2- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbfcc05f300 0x7fbfcc0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:56.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.484+0000 7fbfef67c700 1 --2- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfe81375a0 0x7fbfe8136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.484+0000 7fbfef67c700 1 --2- 172.21.15.1:0/986351294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfe8067d90 0x7fbfe80ad490 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.484+0000 7fbfef67c700 1 --2- 172.21.15.1:0/986351294 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfe81371c0 0x7fbfe80ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.484+0000 7fbfef67c700 1 -- 172.21.15.1:0/986351294 >> 172.21.15.1:0/986351294 conn(0x7fbfe80c8ed0 msgr2=0x7fbfe80667a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:56.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.484+0000 7fbfef67c700 1 -- 172.21.15.1:0/986351294 shutdown_connections 2023-11-15T02:36:56.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.484+0000 7fbfef67c700 1 -- 172.21.15.1:0/986351294 wait complete. 2023-11-15T02:36:56.488 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 71 2023-11-15T02:36:56.498 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:36:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.621+0000 7f154cb12700 1 Processor -- start 2023-11-15T02:36:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.621+0000 7f154cb12700 1 -- start start 2023-11-15T02:36:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.622+0000 7f154cb12700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1548154150 0x7f1548154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.622+0000 7f154cb12700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f15480ab1a0 0x7f1548158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.622+0000 7f154cb12700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15480c06f0 con 0x7f15480aa060 2023-11-15T02:36:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.622+0000 7f154cb12700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15480c09d0 con 0x7f15480ab1a0 2023-11-15T02:36:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.622+0000 7f154cb12700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1548158820 con 0x7f1548154150 2023-11-15T02:36:56.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f1545d9b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f15480ab1a0 0x7f1548158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:56.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f154659c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1548154150 0x7f1548154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:56.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f154659c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1548154150 0x7f1548154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:51478/0 (socket says 172.21.15.1:51478) 2023-11-15T02:36:56.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f1546d9d700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f15480aa060 0x7f15480c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:58348/0 (socket says 172.21.15.1:58348) 2023-11-15T02:36:56.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f154659c700 1 -- 172.21.15.1:0/1553228393 learned_addr learned my addr 172.21.15.1:0/1553228393 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:56.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f1545d9b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f15480ab1a0 0x7f1548158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:43064/0 (socket says 172.21.15.1:43064) 2023-11-15T02:36:56.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f1545d9b700 1 -- 172.21.15.1:0/1553228393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1548154150 msgr2=0x7f1548154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:56.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f1545d9b700 1 --2- 172.21.15.1:0/1553228393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1548154150 0x7f1548154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f1545d9b700 1 -- 172.21.15.1:0/1553228393 >> v1:172.21.15.141:6789/0 conn(0x7f15480aa060 legacy=0x7f15480c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f1545d9b700 1 -- 172.21.15.1:0/1553228393 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1548158b00 con 0x7f15480ab1a0 2023-11-15T02:36:56.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f154559a700 1 -- 172.21.15.1:0/1553228393 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399641894 0 0) 0x7f15480c06f0 con 0x7f15480aa060 2023-11-15T02:36:56.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f154659c700 1 --2- 172.21.15.1:0/1553228393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1548154150 0x7f1548154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:56.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f1545d9b700 1 --2- 172.21.15.1:0/1553228393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f15480ab1a0 0x7f1548158040 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f153c009760 tx=0x7f153c009060).ready entity=mon.1 client_cookie=43288798a71b8711 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:56.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f154559a700 1 -- 172.21.15.1:0/1553228393 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c0090d0 con 0x7f15480ab1a0 2023-11-15T02:36:56.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f154559a700 1 -- 172.21.15.1:0/1553228393 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c00f510 con 0x7f15480ab1a0 2023-11-15T02:36:56.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.623+0000 7f154559a700 1 -- 172.21.15.1:0/1553228393 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c00f890 con 0x7f15480ab1a0 2023-11-15T02:36:56.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.624+0000 7f154cb12700 1 -- 172.21.15.1:0/1553228393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f15480ab1a0 msgr2=0x7f1548158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.624+0000 7f154cb12700 1 --2- 172.21.15.1:0/1553228393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f15480ab1a0 0x7f1548158040 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f153c009760 tx=0x7f153c009060).stop 2023-11-15T02:36:56.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.624+0000 7f154cb12700 1 -- 172.21.15.1:0/1553228393 shutdown_connections 2023-11-15T02:36:56.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.624+0000 7f154cb12700 1 --2- 172.21.15.1:0/1553228393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1548154150 0x7f1548154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.624+0000 7f154cb12700 1 --2- 172.21.15.1:0/1553228393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f15480ab1a0 0x7f1548158040 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.624+0000 7f154cb12700 1 -- 172.21.15.1:0/1553228393 >> 172.21.15.1:0/1553228393 conn(0x7f1548064aa0 msgr2=0x7f1548064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:56.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.624+0000 7f154cb12700 1 -- 172.21.15.1:0/1553228393 shutdown_connections 2023-11-15T02:36:56.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.624+0000 7f154cb12700 1 -- 172.21.15.1:0/1553228393 wait complete. 2023-11-15T02:36:56.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.625+0000 7f154cb12700 1 Processor -- start 2023-11-15T02:36:56.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.625+0000 7f154cb12700 1 -- start start 2023-11-15T02:36:56.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.626+0000 7f154cb12700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15480aa060 0x7f1548150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.626+0000 7f154cb12700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f15480ab1a0 0x7f15480cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.626+0000 7f154cb12700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1548154150 0x7f15480cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.626+0000 7f154cb12700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15480cbdb0 con 0x7f1548154150 2023-11-15T02:36:56.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.626+0000 7f154cb12700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15480c9500 con 0x7f15480ab1a0 2023-11-15T02:36:56.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.626+0000 7f154cb12700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15480aed20 con 0x7f15480aa060 2023-11-15T02:36:56.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.626+0000 7f1546d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1548154150 0x7f15480cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:56.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.626+0000 7f1546d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1548154150 0x7f15480cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57742/0 (socket says 172.21.15.1:57742) 2023-11-15T02:36:56.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.626+0000 7f1546d9d700 1 -- 172.21.15.1:0/2149972288 learned_addr learned my addr 172.21.15.1:0/2149972288 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:56.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.626+0000 7f1545d9b700 1 --2- 172.21.15.1:0/2149972288 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f15480ab1a0 0x7f15480cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:56.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.626+0000 7f154659c700 1 --2- 172.21.15.1:0/2149972288 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15480aa060 0x7f1548150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:56.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.627+0000 7f1546d9d700 1 -- 172.21.15.1:0/2149972288 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15480aa060 msgr2=0x7f1548150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.627+0000 7f1546d9d700 1 --2- 172.21.15.1:0/2149972288 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15480aa060 0x7f1548150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.627+0000 7f1546d9d700 1 -- 172.21.15.1:0/2149972288 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f15480ab1a0 msgr2=0x7f15480cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.627+0000 7f1546d9d700 1 --2- 172.21.15.1:0/2149972288 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f15480ab1a0 0x7f15480cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.627+0000 7f1546d9d700 1 -- 172.21.15.1:0/2149972288 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1538009370 con 0x7f1548154150 2023-11-15T02:36:56.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.627+0000 7f1545d9b700 1 --2- 172.21.15.1:0/2149972288 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f15480ab1a0 0x7f15480cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:56.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.627+0000 7f1546d9d700 1 --2- 172.21.15.1:0/2149972288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1548154150 0x7f15480cb8c0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f154000c810 tx=0x7f1540007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:56.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.627+0000 7f15367fc700 1 -- 172.21.15.1:0/2149972288 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540005c70 con 0x7f1548154150 2023-11-15T02:36:56.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.627+0000 7f15367fc700 1 -- 172.21.15.1:0/2149972288 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1540005dd0 con 0x7f1548154150 2023-11-15T02:36:56.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.627+0000 7f15367fc700 1 -- 172.21.15.1:0/2149972288 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540007360 con 0x7f1548154150 2023-11-15T02:36:56.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.627+0000 7f154cb12700 1 -- 172.21.15.1:0/2149972288 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153c0092a0 con 0x7f1548154150 2023-11-15T02:36:56.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.627+0000 7f154cb12700 1 -- 172.21.15.1:0/2149972288 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15480c8eb0 con 0x7f1548154150 2023-11-15T02:36:56.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.628+0000 7f154cb12700 1 -- 172.21.15.1:0/2149972288 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154806c7e0 con 0x7f1548154150 2023-11-15T02:36:56.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.628+0000 7f15367fc700 1 -- 172.21.15.1:0/2149972288 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f15400076d0 con 0x7f1548154150 2023-11-15T02:36:56.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.629+0000 7f15367fc700 1 --2- 172.21.15.1:0/2149972288 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f152805f330 0x7f15280617f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.629+0000 7f154659c700 1 -- 172.21.15.1:0/2149972288 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f152805f330 msgr2=0x7f15280617f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:56.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.629+0000 7f15367fc700 1 -- 172.21.15.1:0/2149972288 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f154007a610 con 0x7f1548154150 2023-11-15T02:36:56.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.629+0000 7f154659c700 1 --2- 172.21.15.1:0/2149972288 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f152805f330 0x7f15280617f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:56.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.633+0000 7f15367fc700 1 -- 172.21.15.1:0/2149972288 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f154004b3f0 con 0x7f1548154150 2023-11-15T02:36:56.660 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:56.658+0000 7f9d45edf680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:36:56.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.808+0000 7f154cb12700 1 -- 172.21.15.1:0/2149972288 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15480c02a0 con 0x7f1548154150 2023-11-15T02:36:56.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.809+0000 7f15367fc700 1 -- 172.21.15.1:0/2149972288 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+18028 (secure 0 0 0) 0x7f154004ea10 con 0x7f1548154150 2023-11-15T02:36:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:56.811 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":163,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:36:50.808631+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:36:36.177693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-11-15T02:36:37.489367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/3216709054":"2023-11-16T02:36:50.808565+0000","172.21.15.141:6833/90546":"2023-11-16T02:36:50.808565+0000","172.21.15.141:6832/90546":"2023-11-16T02:36:50.808565+0000","172.21.15.141:0/2743114853":"2023-11-16T02:36:50.808565+0000","172.21.15.141:0/1483799851":"2023-11-16T02:36:50.808565+0000","172.21.15.141:0/3821362961":"2023-11-16T02:36:50.808565+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:36:56.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.811+0000 7f154cb12700 1 -- 172.21.15.1:0/2149972288 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f152805f330 msgr2=0x7f15280617f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.811+0000 7f154cb12700 1 --2- 172.21.15.1:0/2149972288 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f152805f330 0x7f15280617f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.811+0000 7f154cb12700 1 -- 172.21.15.1:0/2149972288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1548154150 msgr2=0x7f15480cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.811+0000 7f154cb12700 1 --2- 172.21.15.1:0/2149972288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1548154150 0x7f15480cb8c0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f154000c810 tx=0x7f1540007f30).stop 2023-11-15T02:36:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.811+0000 7f154cb12700 1 -- 172.21.15.1:0/2149972288 shutdown_connections 2023-11-15T02:36:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.811+0000 7f154cb12700 1 --2- 172.21.15.1:0/2149972288 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f152805f330 0x7f15280617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.811+0000 7f154cb12700 1 --2- 172.21.15.1:0/2149972288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1548154150 0x7f15480cb8c0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.811+0000 7f154cb12700 1 --2- 172.21.15.1:0/2149972288 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15480aa060 0x7f1548150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.811+0000 7f154cb12700 1 --2- 172.21.15.1:0/2149972288 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f15480ab1a0 0x7f15480cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.811+0000 7f154cb12700 1 -- 172.21.15.1:0/2149972288 >> 172.21.15.1:0/2149972288 conn(0x7f1548064aa0 msgr2=0x7f15480ad2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:56.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.811+0000 7f154cb12700 1 -- 172.21.15.1:0/2149972288 shutdown_connections 2023-11-15T02:36:56.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.811+0000 7f154cb12700 1 -- 172.21.15.1:0/2149972288 wait complete. 2023-11-15T02:36:56.825 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-15T02:36:56.826 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:36:56.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.945+0000 7f18cbbc1700 1 Processor -- start 2023-11-15T02:36:56.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.946+0000 7f18cbbc1700 1 -- start start 2023-11-15T02:36:56.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.947+0000 7f18cbbc1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18c4154150 0x7f18c4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.947+0000 7f18cbbc1700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f18c40aa060 0x7f18c40c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.947+0000 7f18cbbc1700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c40c06f0 con 0x7f18c40ab1a0 2023-11-15T02:36:56.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.947+0000 7f18cbbc1700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c40c09d0 con 0x7f18c40aa060 2023-11-15T02:36:56.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.947+0000 7f18cbbc1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c4158820 con 0x7f18c4154150 2023-11-15T02:36:56.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.947+0000 7f18ca15e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f18c40aa060 0x7f18c40c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:56.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.947+0000 7f18c915c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f18c40ab1a0 0x7f18c4158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:40252/0 (socket says 172.21.15.1:40252) 2023-11-15T02:36:56.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.947+0000 7f18c915c700 1 -- 172.21.15.1:0/3251127904 learned_addr learned my addr 172.21.15.1:0/3251127904 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:56.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.947+0000 7f18c995d700 1 --2- 172.21.15.1:0/3251127904 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18c4154150 0x7f18c4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:56.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.948+0000 7f18ca15e700 1 -- 172.21.15.1:0/3251127904 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18c4154150 msgr2=0x7f18c4154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:56.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.948+0000 7f18ca15e700 1 --2- 172.21.15.1:0/3251127904 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18c4154150 0x7f18c4154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.948+0000 7f18ca15e700 1 -- 172.21.15.1:0/3251127904 >> v1:172.21.15.1:6789/0 conn(0x7f18c40ab1a0 legacy=0x7f18c4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.948+0000 7f18ca15e700 1 -- 172.21.15.1:0/3251127904 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4158b00 con 0x7f18c40aa060 2023-11-15T02:36:56.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.948+0000 7f18c895b700 1 -- 172.21.15.1:0/3251127904 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005099426 0 0) 0x7f18c40c06f0 con 0x7f18c40ab1a0 2023-11-15T02:36:56.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.948+0000 7f18ca15e700 1 --2- 172.21.15.1:0/3251127904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c40aa060 0x7f18c40c5f10 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f18bc009e60 tx=0x7f18bc009780).ready entity=mon.0 client_cookie=950cd0c9a48ddb2d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:56.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.948+0000 7f18c895b700 1 -- 172.21.15.1:0/3251127904 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc00e070 con 0x7f18c40aa060 2023-11-15T02:36:56.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.948+0000 7f18c895b700 1 -- 172.21.15.1:0/3251127904 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18bc00bc30 con 0x7f18c40aa060 2023-11-15T02:36:56.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.948+0000 7f18c895b700 1 -- 172.21.15.1:0/3251127904 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc012410 con 0x7f18c40aa060 2023-11-15T02:36:56.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.948+0000 7f18cbbc1700 1 -- 172.21.15.1:0/3251127904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c40aa060 msgr2=0x7f18c40c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.948+0000 7f18cbbc1700 1 --2- 172.21.15.1:0/3251127904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c40aa060 0x7f18c40c5f10 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f18bc009e60 tx=0x7f18bc009780).stop 2023-11-15T02:36:56.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.948+0000 7f18cbbc1700 1 -- 172.21.15.1:0/3251127904 shutdown_connections 2023-11-15T02:36:56.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.948+0000 7f18cbbc1700 1 --2- 172.21.15.1:0/3251127904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c40aa060 0x7f18c40c5f10 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.948+0000 7f18cbbc1700 1 --2- 172.21.15.1:0/3251127904 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18c4154150 0x7f18c4154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.948+0000 7f18cbbc1700 1 -- 172.21.15.1:0/3251127904 >> 172.21.15.1:0/3251127904 conn(0x7f18c4064aa0 msgr2=0x7f18c4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:56.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.949+0000 7f18cbbc1700 1 -- 172.21.15.1:0/3251127904 shutdown_connections 2023-11-15T02:36:56.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.949+0000 7f18cbbc1700 1 -- 172.21.15.1:0/3251127904 wait complete. 2023-11-15T02:36:56.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.950+0000 7f18cbbc1700 1 Processor -- start 2023-11-15T02:36:56.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.950+0000 7f18cbbc1700 1 -- start start 2023-11-15T02:36:56.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.950+0000 7f18cbbc1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18c40aa060 0x7f18c4151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.950+0000 7f18cbbc1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c40ab1a0 0x7f18c41520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18cbbc1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18c4154150 0x7f18c414efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18cbbc1700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c40cbf50 con 0x7f18c40ab1a0 2023-11-15T02:36:56.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18cbbc1700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c4152dc0 con 0x7f18c4154150 2023-11-15T02:36:56.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18cbbc1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c4150cd0 con 0x7f18c40aa060 2023-11-15T02:36:56.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18c915c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c40ab1a0 0x7f18c41520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:56.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18c915c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c40ab1a0 0x7f18c41520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57748/0 (socket says 172.21.15.1:57748) 2023-11-15T02:36:56.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18c915c700 1 -- 172.21.15.1:0/2287291763 learned_addr learned my addr 172.21.15.1:0/2287291763 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:56.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18c995d700 1 --2- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18c40aa060 0x7f18c4151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:56.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18ca15e700 1 --2- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18c4154150 0x7f18c414efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:56.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18c915c700 1 -- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18c40aa060 msgr2=0x7f18c4151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18c915c700 1 --2- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18c40aa060 0x7f18c4151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18c915c700 1 -- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18c4154150 msgr2=0x7f18c414efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:56.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18c915c700 1 --2- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18c4154150 0x7f18c414efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:56.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18c915c700 1 -- 172.21.15.1:0/2287291763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc009a20 con 0x7f18c40ab1a0 2023-11-15T02:36:56.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18c915c700 1 --2- 172.21.15.1:0/2287291763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c40ab1a0 0x7f18c41520d0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f18b800c4e0 tx=0x7f18b8007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:56.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18b5ffb700 1 -- 172.21.15.1:0/2287291763 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b800ce10 con 0x7f18c40ab1a0 2023-11-15T02:36:56.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18b5ffb700 1 -- 172.21.15.1:0/2287291763 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b80072e0 con 0x7f18c40ab1a0 2023-11-15T02:36:56.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18cbbc1700 1 -- 172.21.15.1:0/2287291763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c4152ae0 con 0x7f18c40ab1a0 2023-11-15T02:36:56.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.951+0000 7f18b5ffb700 1 -- 172.21.15.1:0/2287291763 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b8007660 con 0x7f18c40ab1a0 2023-11-15T02:36:56.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.952+0000 7f18cbbc1700 1 -- 172.21.15.1:0/2287291763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c4150960 con 0x7f18c40ab1a0 2023-11-15T02:36:56.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.953+0000 7f18cbbc1700 1 -- 172.21.15.1:0/2287291763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c406c7e0 con 0x7f18c40ab1a0 2023-11-15T02:36:56.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.953+0000 7f18b5ffb700 1 -- 172.21.15.1:0/2287291763 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f18b80059b0 con 0x7f18c40ab1a0 2023-11-15T02:36:56.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.953+0000 7f18b5ffb700 1 --2- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f18a805f300 0x7f18a80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:56.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.953+0000 7f18b5ffb700 1 -- 172.21.15.1:0/2287291763 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f18b8079ed0 con 0x7f18c40ab1a0 2023-11-15T02:36:56.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.953+0000 7f18c995d700 1 -- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f18a805f300 msgr2=0x7f18a80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:56.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.953+0000 7f18c995d700 1 --2- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f18a805f300 0x7f18a80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:56.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:56.957+0000 7f18b5ffb700 1 -- 172.21.15.1:0/2287291763 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f18b804acb0 con 0x7f18c40ab1a0 2023-11-15T02:36:57.098 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:57.097+0000 7fc334ea7680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:36:57.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.154+0000 7f18c995d700 1 -- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f18a805f300 msgr2=0x7f18a80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:57.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.154+0000 7f18c995d700 1 --2- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f18a805f300 0x7f18a80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:36:57.166 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:57.165+0000 7fc334ea7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:36:57.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.174+0000 7f18cbbc1700 1 -- 172.21.15.1:0/2287291763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18c4158de0 con 0x7f18c40ab1a0 2023-11-15T02:36:57.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.174+0000 7f18b5ffb700 1 -- 172.21.15.1:0/2287291763 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f18b804e2d0 con 0x7f18c40ab1a0 2023-11-15T02:36:57.176 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:57.177 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7019,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3898250637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3898250637},{"type":"v1","addr":"172.21.15.141:6836","nonce":3898250637}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7022,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3709207600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3709207600},{"type":"v1","addr":"172.21.15.141:6837","nonce":3709207600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1212884558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1212884558},{"type":"v1","addr":"172.21.15.1:6835","nonce":1212884558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:36:38.505394+0000","modified":"2023-11-15T02:36:41.520212+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8619":{"gid":8619,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6834/1968331775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1968331775},{"type":"v1","addr":"172.21.15.1:6834","nonce":1968331775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-11-15T02:36:57.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.176+0000 7f18cbbc1700 1 -- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f18a805f300 msgr2=0x7f18a80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:57.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.176+0000 7f18cbbc1700 1 --2- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f18a805f300 0x7f18a80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:57.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.176+0000 7f18cbbc1700 1 -- 172.21.15.1:0/2287291763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c40ab1a0 msgr2=0x7f18c41520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:57.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.176+0000 7f18cbbc1700 1 --2- 172.21.15.1:0/2287291763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c40ab1a0 0x7f18c41520d0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f18b800c4e0 tx=0x7f18b8007c10).stop 2023-11-15T02:36:57.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.176+0000 7f18cbbc1700 1 -- 172.21.15.1:0/2287291763 shutdown_connections 2023-11-15T02:36:57.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.176+0000 7f18cbbc1700 1 --2- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f18a805f300 0x7f18a80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:57.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.176+0000 7f18cbbc1700 1 --2- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18c4154150 0x7f18c414efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:57.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.176+0000 7f18cbbc1700 1 --2- 172.21.15.1:0/2287291763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18c40aa060 0x7f18c4151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:57.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.176+0000 7f18cbbc1700 1 --2- 172.21.15.1:0/2287291763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c40ab1a0 0x7f18c41520d0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:57.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.176+0000 7f18cbbc1700 1 -- 172.21.15.1:0/2287291763 >> 172.21.15.1:0/2287291763 conn(0x7f18c4064aa0 msgr2=0x7f18c40c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:57.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.176+0000 7f18cbbc1700 1 -- 172.21.15.1:0/2287291763 shutdown_connections 2023-11-15T02:36:57.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.176+0000 7f18cbbc1700 1 -- 172.21.15.1:0/2287291763 wait complete. 2023-11-15T02:36:57.181 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 71 2023-11-15T02:36:57.191 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:36:57.241 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:57.240+0000 7fc334ea7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:36:57.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.312+0000 7f126915d700 1 Processor -- start 2023-11-15T02:36:57.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.312+0000 7f126915d700 1 -- start start 2023-11-15T02:36:57.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.313+0000 7f126915d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1264154680 0x7f1264069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:57.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.313+0000 7f126915d700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12640c3360 con 0x7f12640c70c0 2023-11-15T02:36:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.313+0000 7f126915d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12640635d0 con 0x7f12640bccd0 2023-11-15T02:36:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.313+0000 7f126915d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12640c2750 con 0x7f1264154680 2023-11-15T02:36:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.313+0000 7f126359e700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f12640c70c0 0x7f1264062ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:40266/0 (socket says 172.21.15.1:40266) 2023-11-15T02:36:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.313+0000 7f126359e700 1 -- 172.21.15.1:0/3229437681 learned_addr learned my addr 172.21.15.1:0/3229437681 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.314+0000 7f1262d9d700 1 --2- 172.21.15.1:0/3229437681 >> v2:172.21.15.141:3300/0 conn(0x7f1264154680 0x7f1264069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.314+0000 7f1261d9b700 1 -- 172.21.15.1:0/3229437681 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301634717 0 0) 0x7f12640c3360 con 0x7f12640c70c0 2023-11-15T02:36:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.314+0000 7f1261d9b700 1 -- 172.21.15.1:0/3229437681 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12500033f0 con 0x7f12640c70c0 2023-11-15T02:36:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.314+0000 7f1261d9b700 1 -- 172.21.15.1:0/3229437681 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1674752048 0 0) 0x7f12500033f0 con 0x7f12640c70c0 2023-11-15T02:36:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.314+0000 7f1262d9d700 1 -- 172.21.15.1:0/3229437681 >> v1:172.21.15.141:6789/0 conn(0x7f12640bccd0 legacy=0x7f12640627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.314+0000 7f1262d9d700 1 -- 172.21.15.1:0/3229437681 >> v1:172.21.15.1:6789/0 conn(0x7f12640c70c0 legacy=0x7f1264062ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.314+0000 7f1262d9d700 1 -- 172.21.15.1:0/3229437681 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12640c2a30 con 0x7f1264154680 2023-11-15T02:36:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.314+0000 7f1262d9d700 1 --2- 172.21.15.1:0/3229437681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1264154680 0x7f1264069fa0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f1254009760 tx=0x7f1254009060).ready entity=mon.1 client_cookie=c2292fbd3358db48 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.314+0000 7f1261d9b700 1 -- 172.21.15.1:0/3229437681 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c0017f0 con 0x7f1264154680 2023-11-15T02:36:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.314+0000 7f1261d9b700 1 -- 172.21.15.1:0/3229437681 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1254011400 con 0x7f1264154680 2023-11-15T02:36:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.314+0000 7f1261d9b700 1 -- 172.21.15.1:0/3229437681 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1254011780 con 0x7f1264154680 2023-11-15T02:36:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.315+0000 7f126915d700 1 -- 172.21.15.1:0/3229437681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1264154680 msgr2=0x7f1264069fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.315+0000 7f126915d700 1 --2- 172.21.15.1:0/3229437681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1264154680 0x7f1264069fa0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f1254009760 tx=0x7f1254009060).stop 2023-11-15T02:36:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.315+0000 7f126915d700 1 -- 172.21.15.1:0/3229437681 shutdown_connections 2023-11-15T02:36:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.315+0000 7f126915d700 1 --2- 172.21.15.1:0/3229437681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1264154680 0x7f1264069fa0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.315+0000 7f126915d700 1 -- 172.21.15.1:0/3229437681 >> 172.21.15.1:0/3229437681 conn(0x7f12640c7d70 msgr2=0x7f12640c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.315+0000 7f126915d700 1 -- 172.21.15.1:0/3229437681 shutdown_connections 2023-11-15T02:36:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.315+0000 7f126915d700 1 -- 172.21.15.1:0/3229437681 wait complete. 2023-11-15T02:36:57.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.316+0000 7f126915d700 1 Processor -- start 2023-11-15T02:36:57.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.316+0000 7f126915d700 1 -- start start 2023-11-15T02:36:57.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f126915d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640bccd0 0x7f1264152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f126915d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12640c70c0 0x7f12640aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f126915d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1264154680 0x7f12641458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f126915d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12640bf850 con 0x7f12640bccd0 2023-11-15T02:36:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f126915d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1264152d10 con 0x7f1264154680 2023-11-15T02:36:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f126915d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12640bfc70 con 0x7f12640c70c0 2023-11-15T02:36:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f1262d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640bccd0 0x7f1264152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f1262d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640bccd0 0x7f1264152f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57760/0 (socket says 172.21.15.1:57760) 2023-11-15T02:36:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f1262d9d700 1 -- 172.21.15.1:0/4234325694 learned_addr learned my addr 172.21.15.1:0/4234325694 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f126359e700 1 --2- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1264154680 0x7f12641458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:57.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f126259c700 1 --2- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12640c70c0 0x7f12640aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:57.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f1262d9d700 1 -- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12640c70c0 msgr2=0x7f12640aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:57.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f1262d9d700 1 --2- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12640c70c0 0x7f12640aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:57.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f1262d9d700 1 -- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1264154680 msgr2=0x7f12641458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:57.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f1262d9d700 1 --2- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1264154680 0x7f12641458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:57.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.317+0000 7f1262d9d700 1 -- 172.21.15.1:0/4234325694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12540092a0 con 0x7f12640bccd0 2023-11-15T02:36:57.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.318+0000 7f126359e700 1 --2- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1264154680 0x7f12641458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:57.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.318+0000 7f1262d9d700 1 --2- 172.21.15.1:0/4234325694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640bccd0 0x7f1264152f40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f1254009e00 tx=0x7f1254014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:57.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.318+0000 7f125affd700 1 -- 172.21.15.1:0/4234325694 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12540107c0 con 0x7f12640bccd0 2023-11-15T02:36:57.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.318+0000 7f126915d700 1 -- 172.21.15.1:0/4234325694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1264152a30 con 0x7f12640bccd0 2023-11-15T02:36:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.318+0000 7f125affd700 1 -- 172.21.15.1:0/4234325694 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1254010920 con 0x7f12640bccd0 2023-11-15T02:36:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.318+0000 7f125affd700 1 -- 172.21.15.1:0/4234325694 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1254010ca0 con 0x7f12640bccd0 2023-11-15T02:36:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.318+0000 7f126915d700 1 -- 172.21.15.1:0/4234325694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12640bf190 con 0x7f12640bccd0 2023-11-15T02:36:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.319+0000 7f126915d700 1 -- 172.21.15.1:0/4234325694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12640bfac0 con 0x7f12640bccd0 2023-11-15T02:36:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.319+0000 7f125affd700 1 -- 172.21.15.1:0/4234325694 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f125401d640 con 0x7f12640bccd0 2023-11-15T02:36:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.320+0000 7f125affd700 1 --2- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f124405f300 0x7f12440617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.320+0000 7f125affd700 1 -- 172.21.15.1:0/4234325694 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f125407bcf0 con 0x7f12640bccd0 2023-11-15T02:36:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.320+0000 7f126259c700 1 -- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f124405f300 msgr2=0x7f12440617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.320+0000 7f126259c700 1 --2- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f124405f300 0x7f12440617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.328+0000 7f125affd700 1 -- 172.21.15.1:0/4234325694 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f125404cad0 con 0x7f12640bccd0 2023-11-15T02:36:57.366 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:57.363+0000 7f9d45edf680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:36:57.389 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:57.388+0000 7fc334ea7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:36:57.437 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:57.436+0000 7f9d45edf680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:36:57.459 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:57.458+0000 7fc334ea7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:36:57.517 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:57.515+0000 7f9d45edf680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:36:57.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.521+0000 7f126259c700 1 -- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f124405f300 msgr2=0x7f12440617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:57.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.521+0000 7f126259c700 1 --2- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f124405f300 0x7f12440617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:36:57.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.544+0000 7f126915d700 1 -- 172.21.15.1:0/4234325694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f126406c7e0 con 0x7f12640bccd0 2023-11-15T02:36:57.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.545+0000 7f125affd700 1 -- 172.21.15.1:0/4234325694 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f1254016070 con 0x7f12640bccd0 2023-11-15T02:36:57.547 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:57.548 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7019,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3898250637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3898250637},{"type":"v1","addr":"172.21.15.141:6836","nonce":3898250637}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7022,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3709207600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3709207600},{"type":"v1","addr":"172.21.15.141:6837","nonce":3709207600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1212884558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1212884558},{"type":"v1","addr":"172.21.15.1:6835","nonce":1212884558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:36:38.505394+0000","modified":"2023-11-15T02:36:41.520212+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8619":{"gid":8619,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6834/1968331775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1968331775},{"type":"v1","addr":"172.21.15.1:6834","nonce":1968331775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-11-15T02:36:57.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.547+0000 7f126915d700 1 -- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f124405f300 msgr2=0x7f12440617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:57.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.547+0000 7f126915d700 1 --2- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f124405f300 0x7f12440617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:57.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.547+0000 7f126915d700 1 -- 172.21.15.1:0/4234325694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640bccd0 msgr2=0x7f1264152f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:57.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.547+0000 7f126915d700 1 --2- 172.21.15.1:0/4234325694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640bccd0 0x7f1264152f40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f1254009e00 tx=0x7f1254014000).stop 2023-11-15T02:36:57.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.547+0000 7f126915d700 1 -- 172.21.15.1:0/4234325694 shutdown_connections 2023-11-15T02:36:57.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.547+0000 7f126915d700 1 --2- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f124405f300 0x7f12440617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:57.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.547+0000 7f126915d700 1 --2- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1264154680 0x7f12641458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:57.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.547+0000 7f126915d700 1 --2- 172.21.15.1:0/4234325694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12640bccd0 0x7f1264152f40 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:57.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.547+0000 7f126915d700 1 --2- 172.21.15.1:0/4234325694 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f12640c70c0 0x7f12640aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:57.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.547+0000 7f126915d700 1 -- 172.21.15.1:0/4234325694 >> 172.21.15.1:0/4234325694 conn(0x7f12640c7d70 msgr2=0x7f12640c36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:57.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.547+0000 7f126915d700 1 -- 172.21.15.1:0/4234325694 shutdown_connections 2023-11-15T02:36:57.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.547+0000 7f126915d700 1 -- 172.21.15.1:0/4234325694 wait complete. 2023-11-15T02:36:57.552 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 71 2023-11-15T02:36:57.561 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:36:57.573 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:57.572+0000 7fc334ea7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:36:57.677 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:57.676+0000 7f9d45edf680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:36:57.679 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:57.678+0000 7fc334ea7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:36:57.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.680+0000 7f27201d1700 1 Processor -- start 2023-11-15T02:36:57.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.680+0000 7f27201d1700 1 -- start start 2023-11-15T02:36:57.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.681+0000 7f27201d1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27180bccd0 0x7f27180bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:57.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.681+0000 7f27201d1700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271806a6b0 con 0x7f2718154680 2023-11-15T02:36:57.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.681+0000 7f27201d1700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27180c3360 con 0x7f27180c60b0 2023-11-15T02:36:57.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.681+0000 7f27201d1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27180bd620 con 0x7f27180bccd0 2023-11-15T02:36:57.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.681+0000 7f271df6d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2718154680 0x7f2718069fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53848/0 (socket says 172.21.15.1:53848) 2023-11-15T02:36:57.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.681+0000 7f271df6d700 1 -- 172.21.15.1:0/403670212 learned_addr learned my addr 172.21.15.1:0/403670212 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:57.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.681+0000 7f271d76c700 1 --2- 172.21.15.1:0/403670212 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27180bccd0 0x7f27180bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:57.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.681+0000 7f271cf6b700 1 -- 172.21.15.1:0/403670212 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844196230 0 0) 0x7f271806a6b0 con 0x7f2718154680 2023-11-15T02:36:57.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.681+0000 7f271cf6b700 1 -- 172.21.15.1:0/403670212 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27040033f0 con 0x7f2718154680 2023-11-15T02:36:57.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.681+0000 7f271cf6b700 1 -- 172.21.15.1:0/403670212 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845364677 0 0) 0x7f27180c3360 con 0x7f27180c60b0 2023-11-15T02:36:57.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.681+0000 7f271cf6b700 1 -- 172.21.15.1:0/403670212 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f271806a6b0 con 0x7f27180c60b0 2023-11-15T02:36:57.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.681+0000 7f271d76c700 1 -- 172.21.15.1:0/403670212 >> v1:172.21.15.141:6789/0 conn(0x7f27180c60b0 legacy=0x7f27180c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:57.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.681+0000 7f271d76c700 1 -- 172.21.15.1:0/403670212 >> v1:172.21.15.1:6789/0 conn(0x7f2718154680 legacy=0x7f2718069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:57.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.681+0000 7f271d76c700 1 -- 172.21.15.1:0/403670212 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27180c2750 con 0x7f27180bccd0 2023-11-15T02:36:57.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.681+0000 7f271d76c700 1 --2- 172.21.15.1:0/403670212 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27180bccd0 0x7f27180bd130 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f2708009790 tx=0x7f2708009060).ready entity=mon.2 client_cookie=a769d6e68d92cb0b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:57.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.682+0000 7f271cf6b700 1 -- 172.21.15.1:0/403670212 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270800f510 con 0x7f27180bccd0 2023-11-15T02:36:57.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.682+0000 7f271cf6b700 1 -- 172.21.15.1:0/403670212 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270800f670 con 0x7f27180bccd0 2023-11-15T02:36:57.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.682+0000 7f271cf6b700 1 -- 172.21.15.1:0/403670212 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270800f9f0 con 0x7f27180bccd0 2023-11-15T02:36:57.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.682+0000 7f27201d1700 1 -- 172.21.15.1:0/403670212 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27180bccd0 msgr2=0x7f27180bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:57.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.682+0000 7f27201d1700 1 --2- 172.21.15.1:0/403670212 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27180bccd0 0x7f27180bd130 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f2708009790 tx=0x7f2708009060).stop 2023-11-15T02:36:57.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.682+0000 7f27201d1700 1 -- 172.21.15.1:0/403670212 shutdown_connections 2023-11-15T02:36:57.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.682+0000 7f27201d1700 1 --2- 172.21.15.1:0/403670212 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27180bccd0 0x7f27180bd130 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:57.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.682+0000 7f27201d1700 1 -- 172.21.15.1:0/403670212 >> 172.21.15.1:0/403670212 conn(0x7f27180c7d70 msgr2=0x7f27180c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:57.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.682+0000 7f27201d1700 1 -- 172.21.15.1:0/403670212 shutdown_connections 2023-11-15T02:36:57.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.682+0000 7f27201d1700 1 -- 172.21.15.1:0/403670212 wait complete. 2023-11-15T02:36:57.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.683+0000 7f27201d1700 1 Processor -- start 2023-11-15T02:36:57.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.684+0000 7f27201d1700 1 -- start start 2023-11-15T02:36:57.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.684+0000 7f27201d1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27180bccd0 0x7f271814c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:57.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.684+0000 7f27201d1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27180c60b0 0x7f27180ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:57.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.684+0000 7f27201d1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2718154680 0x7f27180ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:57.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.684+0000 7f27201d1700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2718164880 con 0x7f27180c60b0 2023-11-15T02:36:57.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.684+0000 7f27201d1700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271814cc90 con 0x7f2718154680 2023-11-15T02:36:57.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.684+0000 7f27201d1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27180adda0 con 0x7f27180bccd0 2023-11-15T02:36:57.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.684+0000 7f271d76c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27180c60b0 0x7f27180ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:57.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.684+0000 7f271d76c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27180c60b0 0x7f27180ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41360/0 (socket says 172.21.15.1:41360) 2023-11-15T02:36:57.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.684+0000 7f271d76c700 1 -- 172.21.15.1:0/1714442442 learned_addr learned my addr 172.21.15.1:0/1714442442 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:57.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.684+0000 7f271df6d700 1 --2- 172.21.15.1:0/1714442442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27180bccd0 0x7f271814c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:57.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.684+0000 7f271e76e700 1 --2- 172.21.15.1:0/1714442442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2718154680 0x7f27180ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:57.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.685+0000 7f271d76c700 1 -- 172.21.15.1:0/1714442442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27180bccd0 msgr2=0x7f271814c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:57.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.685+0000 7f271d76c700 1 --2- 172.21.15.1:0/1714442442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27180bccd0 0x7f271814c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:57.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.685+0000 7f271d76c700 1 -- 172.21.15.1:0/1714442442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2718154680 msgr2=0x7f27180ac390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:57.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.685+0000 7f271d76c700 1 --2- 172.21.15.1:0/1714442442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2718154680 0x7f27180ac390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:57.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.685+0000 7f271d76c700 1 -- 172.21.15.1:0/1714442442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080092a0 con 0x7f27180c60b0 2023-11-15T02:36:57.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.685+0000 7f271d76c700 1 --2- 172.21.15.1:0/1714442442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27180c60b0 0x7f27180ad8b0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f27180c5880 tx=0x7f2708017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:57.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.685+0000 7f270dffb700 1 -- 172.21.15.1:0/1714442442 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270800fe80 con 0x7f27180c60b0 2023-11-15T02:36:57.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.685+0000 7f270dffb700 1 -- 172.21.15.1:0/1714442442 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270800f7e0 con 0x7f27180c60b0 2023-11-15T02:36:57.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.685+0000 7f27201d1700 1 -- 172.21.15.1:0/1714442442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27180abf00 con 0x7f27180c60b0 2023-11-15T02:36:57.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.685+0000 7f270dffb700 1 -- 172.21.15.1:0/1714442442 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270801b640 con 0x7f27180c60b0 2023-11-15T02:36:57.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.685+0000 7f27201d1700 1 -- 172.21.15.1:0/1714442442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27180ad490 con 0x7f27180c60b0 2023-11-15T02:36:57.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.686+0000 7f27201d1700 1 -- 172.21.15.1:0/1714442442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27180ac1e0 con 0x7f27180c60b0 2023-11-15T02:36:57.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.687+0000 7f270dffb700 1 -- 172.21.15.1:0/1714442442 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f270801b9b0 con 0x7f27180c60b0 2023-11-15T02:36:57.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.687+0000 7f270dffb700 1 --2- 172.21.15.1:0/1714442442 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f26fc05f300 0x7f26fc0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:57.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.687+0000 7f270dffb700 1 -- 172.21.15.1:0/1714442442 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f270807c110 con 0x7f27180c60b0 2023-11-15T02:36:57.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.687+0000 7f271df6d700 1 -- 172.21.15.1:0/1714442442 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f26fc05f300 msgr2=0x7f26fc0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:57.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.687+0000 7f271df6d700 1 --2- 172.21.15.1:0/1714442442 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f26fc05f300 0x7f26fc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:57.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.691+0000 7f270dffb700 1 -- 172.21.15.1:0/1714442442 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f270804cef0 con 0x7f27180c60b0 2023-11-15T02:36:57.754 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:57.752+0000 7f9d45edf680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:36:57.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.866+0000 7f27201d1700 1 -- 172.21.15.1:0/1714442442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2718068e90 con 0x7f27180c60b0 2023-11-15T02:36:57.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.868+0000 7f270dffb700 1 -- 172.21.15.1:0/1714442442 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+18028 (secure 0 0 0) 0x7f2708028020 con 0x7f27180c60b0 2023-11-15T02:36:57.871 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:36:57.871 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":163,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:36:50.808631+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:36:36.177693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-11-15T02:36:37.489367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/3216709054":"2023-11-16T02:36:50.808565+0000","172.21.15.141:6833/90546":"2023-11-16T02:36:50.808565+0000","172.21.15.141:6832/90546":"2023-11-16T02:36:50.808565+0000","172.21.15.141:0/2743114853":"2023-11-16T02:36:50.808565+0000","172.21.15.141:0/1483799851":"2023-11-16T02:36:50.808565+0000","172.21.15.141:0/3821362961":"2023-11-16T02:36:50.808565+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:36:57.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.869+0000 7f27201d1700 1 -- 172.21.15.1:0/1714442442 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f26fc05f300 msgr2=0x7f26fc0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:57.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.870+0000 7f27201d1700 1 --2- 172.21.15.1:0/1714442442 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f26fc05f300 0x7f26fc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:57.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.870+0000 7f27201d1700 1 -- 172.21.15.1:0/1714442442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27180c60b0 msgr2=0x7f27180ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:57.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.870+0000 7f27201d1700 1 --2- 172.21.15.1:0/1714442442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27180c60b0 0x7f27180ad8b0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f27180c5880 tx=0x7f2708017000).stop 2023-11-15T02:36:57.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.870+0000 7f27201d1700 1 -- 172.21.15.1:0/1714442442 shutdown_connections 2023-11-15T02:36:57.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.870+0000 7f27201d1700 1 --2- 172.21.15.1:0/1714442442 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f26fc05f300 0x7f26fc0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:57.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.870+0000 7f27201d1700 1 --2- 172.21.15.1:0/1714442442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2718154680 0x7f27180ac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:57.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.870+0000 7f27201d1700 1 --2- 172.21.15.1:0/1714442442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27180bccd0 0x7f271814c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:57.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.870+0000 7f27201d1700 1 --2- 172.21.15.1:0/1714442442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27180c60b0 0x7f27180ad8b0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:57.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.870+0000 7f27201d1700 1 -- 172.21.15.1:0/1714442442 >> 172.21.15.1:0/1714442442 conn(0x7f27180c7d70 msgr2=0x7f2718066310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:57.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.870+0000 7f27201d1700 1 -- 172.21.15.1:0/1714442442 shutdown_connections 2023-11-15T02:36:57.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:57.870+0000 7f27201d1700 1 -- 172.21.15.1:0/1714442442 wait complete. 2023-11-15T02:36:57.879 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:57.878+0000 7f9d45edf680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:36:57.884 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-15T02:36:57.971 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:57.970+0000 7fc334ea7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:36:57.996 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:57.995+0000 7f9d45edf680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:36:58.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.003+0000 7f30a2169700 1 Processor -- start 2023-11-15T02:36:58.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.003+0000 7f30a2169700 1 -- start start 2023-11-15T02:36:58.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f30a2169700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309c14b620 0x7f309c1522b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:58.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f30a2169700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f309c154e00 0x7f309c0c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:58.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f30a2169700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f309c14ba00 0x7f309c0c7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:58.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f30a2169700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309c1527a0 con 0x7f309c154e00 2023-11-15T02:36:58.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f30a2169700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309c0c7520 con 0x7f309c14ba00 2023-11-15T02:36:58.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f30a2169700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309c155290 con 0x7f309c14b620 2023-11-15T02:36:58.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f309affd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f309c154e00 0x7f309c0c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:58.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f309affd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f309c154e00 0x7f309c0c6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41364/0 (socket says 172.21.15.1:41364) 2023-11-15T02:36:58.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f309affd700 1 -- 172.21.15.1:0/1163953204 learned_addr learned my addr 172.21.15.1:0/1163953204 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:58.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f309b7fe700 1 --2- 172.21.15.1:0/1163953204 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309c14b620 0x7f309c1522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:58.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f309bfff700 1 --2- 172.21.15.1:0/1163953204 >> v2:172.21.15.141:3300/0 conn(0x7f309c14ba00 0x7f309c0c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:58.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f309affd700 1 -- 172.21.15.1:0/1163953204 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309c14b620 msgr2=0x7f309c1522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:58.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f309affd700 1 --2- 172.21.15.1:0/1163953204 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309c14b620 0x7f309c1522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:58.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f309affd700 1 -- 172.21.15.1:0/1163953204 >> v2:172.21.15.141:3300/0 conn(0x7f309c14ba00 msgr2=0x7f309c0c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:58.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f309affd700 1 --2- 172.21.15.1:0/1163953204 >> v2:172.21.15.141:3300/0 conn(0x7f309c14ba00 0x7f309c0c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:58.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.004+0000 7f309affd700 1 -- 172.21.15.1:0/1163953204 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c155570 con 0x7f309c154e00 2023-11-15T02:36:58.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.005+0000 7f309affd700 1 --2- 172.21.15.1:0/1163953204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309c154e00 0x7f309c0c6b40 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f309c0c2370 tx=0x7f30900090f0).ready entity=mon.0 client_cookie=9a3e9ad89f58377d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:58.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.005+0000 7f309a7fc700 1 -- 172.21.15.1:0/1163953204 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309000f6b0 con 0x7f309c154e00 2023-11-15T02:36:58.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.005+0000 7f309a7fc700 1 -- 172.21.15.1:0/1163953204 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309000f810 con 0x7f309c154e00 2023-11-15T02:36:58.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.005+0000 7f309a7fc700 1 -- 172.21.15.1:0/1163953204 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309000fb90 con 0x7f309c154e00 2023-11-15T02:36:58.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.005+0000 7f30a2169700 1 -- 172.21.15.1:0/1163953204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309c154e00 msgr2=0x7f309c0c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:58.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.005+0000 7f30a2169700 1 --2- 172.21.15.1:0/1163953204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309c154e00 0x7f309c0c6b40 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f309c0c2370 tx=0x7f30900090f0).stop 2023-11-15T02:36:58.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.006+0000 7f30a2169700 1 -- 172.21.15.1:0/1163953204 shutdown_connections 2023-11-15T02:36:58.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.006+0000 7f30a2169700 1 --2- 172.21.15.1:0/1163953204 >> v2:172.21.15.141:3300/0 conn(0x7f309c14ba00 0x7f309c0c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:58.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.006+0000 7f30a2169700 1 --2- 172.21.15.1:0/1163953204 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309c14b620 0x7f309c1522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:58.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.006+0000 7f30a2169700 1 --2- 172.21.15.1:0/1163953204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309c154e00 0x7f309c0c6b40 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:58.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.006+0000 7f30a2169700 1 -- 172.21.15.1:0/1163953204 >> 172.21.15.1:0/1163953204 conn(0x7f309c0c7dc0 msgr2=0x7f309c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:58.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.006+0000 7f30a2169700 1 -- 172.21.15.1:0/1163953204 shutdown_connections 2023-11-15T02:36:58.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.006+0000 7f30a2169700 1 -- 172.21.15.1:0/1163953204 wait complete. 2023-11-15T02:36:58.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.007+0000 7f30a2169700 1 Processor -- start 2023-11-15T02:36:58.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.007+0000 7f30a2169700 1 -- start start 2023-11-15T02:36:58.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.008+0000 7f30a2169700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f309c14b620 0x7f309c1319d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:58.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.008+0000 7f30a2169700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309c14ba00 0x7f309c0acca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:58.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.008+0000 7f30a2169700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309c0ad190 0x7f309c150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:58.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.008+0000 7f30a2169700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c0c3980 con 0x7f309c0ad190 2023-11-15T02:36:58.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.008+0000 7f30a2169700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c0c3c60 con 0x7f309c14b620 2023-11-15T02:36:58.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.008+0000 7f30a2169700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309c0c3f40 con 0x7f309c14ba00 2023-11-15T02:36:58.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.008+0000 7f309bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309c0ad190 0x7f309c150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:58.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.008+0000 7f309bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309c0ad190 0x7f309c150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41370/0 (socket says 172.21.15.1:41370) 2023-11-15T02:36:58.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.008+0000 7f309bfff700 1 -- 172.21.15.1:0/2613810998 learned_addr learned my addr 172.21.15.1:0/2613810998 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:58.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.008+0000 7f309affd700 1 --2- 172.21.15.1:0/2613810998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309c14ba00 0x7f309c0acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:58.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.008+0000 7f309b7fe700 1 --2- 172.21.15.1:0/2613810998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f309c14b620 0x7f309c1319d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:58.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.009+0000 7f309bfff700 1 -- 172.21.15.1:0/2613810998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309c14ba00 msgr2=0x7f309c0acca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:58.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.009+0000 7f309bfff700 1 --2- 172.21.15.1:0/2613810998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309c14ba00 0x7f309c0acca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:58.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.009+0000 7f309bfff700 1 -- 172.21.15.1:0/2613810998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f309c14b620 msgr2=0x7f309c1319d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:58.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.009+0000 7f309bfff700 1 --2- 172.21.15.1:0/2613810998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f309c14b620 0x7f309c1319d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:58.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.009+0000 7f309bfff700 1 -- 172.21.15.1:0/2613810998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3090009370 con 0x7f309c0ad190 2023-11-15T02:36:58.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.009+0000 7f309b7fe700 1 --2- 172.21.15.1:0/2613810998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f309c14b620 0x7f309c1319d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:58.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.009+0000 7f309bfff700 1 --2- 172.21.15.1:0/2613810998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309c0ad190 0x7f309c150260 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7f3094009e90 tx=0x7f309400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:58.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.009+0000 7f30837fe700 1 -- 172.21.15.1:0/2613810998 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309400caa0 con 0x7f309c0ad190 2023-11-15T02:36:58.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.009+0000 7f30a2169700 1 -- 172.21.15.1:0/2613810998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309c0c4220 con 0x7f309c0ad190 2023-11-15T02:36:58.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.009+0000 7f30837fe700 1 -- 172.21.15.1:0/2613810998 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309400f040 con 0x7f309c0ad190 2023-11-15T02:36:58.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.009+0000 7f30837fe700 1 -- 172.21.15.1:0/2613810998 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309400ce10 con 0x7f309c0ad190 2023-11-15T02:36:58.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.009+0000 7f30a2169700 1 -- 172.21.15.1:0/2613810998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309c0c3650 con 0x7f309c0ad190 2023-11-15T02:36:58.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.010+0000 7f30a2169700 1 -- 172.21.15.1:0/2613810998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309c06c7e0 con 0x7f309c0ad190 2023-11-15T02:36:58.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.011+0000 7f30837fe700 1 -- 172.21.15.1:0/2613810998 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f3094013610 con 0x7f309c0ad190 2023-11-15T02:36:58.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.011+0000 7f30837fe700 1 --2- 172.21.15.1:0/2613810998 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f308805f300 0x7f30880617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:58.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.011+0000 7f309b7fe700 1 -- 172.21.15.1:0/2613810998 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f308805f300 msgr2=0x7f30880617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:36:58.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.011+0000 7f30837fe700 1 -- 172.21.15.1:0/2613810998 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f309407b160 con 0x7f309c0ad190 2023-11-15T02:36:58.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.011+0000 7f309b7fe700 1 --2- 172.21.15.1:0/2613810998 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f308805f300 0x7f30880617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:36:58.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.015+0000 7f30837fe700 1 -- 172.21.15.1:0/2613810998 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f309404be30 con 0x7f309c0ad190 2023-11-15T02:36:58.044 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:58.043+0000 7fc334ea7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:36:58.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.065+0000 7f30837fe700 1 -- 172.21.15.1:0/2613810998 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 72) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f3094078930 con 0x7f309c0ad190 2023-11-15T02:36:58.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.065+0000 7f30837fe700 1 -- 172.21.15.1:0/2613810998 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f308805f300 msgr2=0x7f30880617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:36:58.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.065+0000 7f30837fe700 1 --2- 172.21.15.1:0/2613810998 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f308805f300 0x7f30880617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:58.122 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:58.121+0000 7fc2ae636700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:58.122 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:58.121+0000 7fc2ae636700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:58.123 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:58.121+0000 7fc2ae636700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:58.123 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:58.121+0000 7fc2ae636700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:58.123 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:58.121+0000 7fc2ae636700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:58.123 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:58.121+0000 7fc2b263e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:58.123 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:58.121+0000 7fc2b263e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:58.124 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:58.121+0000 7fc2b263e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:58.124 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:58.121+0000 7fc2b263e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:58.124 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:36:58.121+0000 7fc2b263e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:36:58.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:58.244+0000 7f30a2169700 1 -- 172.21.15.1:0/2613810998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f309c155850 con 0x7f309c0ad190 2023-11-15T02:36:58.310 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:58.308+0000 7f9d45edf680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:36:58.384 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:36:58.382+0000 7f9d45edf680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:36:59.061 INFO:tasks.ceph.mon.a.smithi001.stderr:2023-11-15T02:36:59.060+0000 7f8072214700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-15T02:36:59.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.063+0000 7f30837fe700 1 -- 172.21.15.1:0/2613810998 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v72) v1 ==== 161+0+0 (secure 0 0 0) 0x7f309406d5e0 con 0x7f309c0ad190 2023-11-15T02:36:59.067 INFO:tasks.ceph.mds.a.smithi001.stderr: -2678> 2023-11-15T02:36:43.423+0000 7f32c7852700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T02:36:59.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.066+0000 7f30a2169700 1 -- 172.21.15.1:0/2613810998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309c0ad190 msgr2=0x7f309c150260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:59.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.066+0000 7f30a2169700 1 --2- 172.21.15.1:0/2613810998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309c0ad190 0x7f309c150260 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7f3094009e90 tx=0x7f309400b040).stop 2023-11-15T02:36:59.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.066+0000 7f30a2169700 1 -- 172.21.15.1:0/2613810998 shutdown_connections 2023-11-15T02:36:59.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.066+0000 7f30a2169700 1 --2- 172.21.15.1:0/2613810998 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f308805f300 0x7f30880617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:36:59.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.066+0000 7f30a2169700 1 --2- 172.21.15.1:0/2613810998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309c0ad190 0x7f309c150260 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:59.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.066+0000 7f30a2169700 1 --2- 172.21.15.1:0/2613810998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f309c14b620 0x7f309c1319d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:59.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.066+0000 7f30a2169700 1 --2- 172.21.15.1:0/2613810998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309c14ba00 0x7f309c0acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:59.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.066+0000 7f30a2169700 1 -- 172.21.15.1:0/2613810998 >> 172.21.15.1:0/2613810998 conn(0x7f309c0c7dc0 msgr2=0x7f309c133900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:59.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.066+0000 7f30a2169700 1 -- 172.21.15.1:0/2613810998 shutdown_connections 2023-11-15T02:36:59.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.066+0000 7f30a2169700 1 -- 172.21.15.1:0/2613810998 wait complete. 2023-11-15T02:36:59.071 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-15T02:36:59.088 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-15T02:36:59.097 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T02:36:59.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.214+0000 7f05ec8b3700 1 Processor -- start 2023-11-15T02:36:59.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.214+0000 7f05ec8b3700 1 -- start start 2023-11-15T02:36:59.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.215+0000 7f05ec8b3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e81541d0 0x7f05e81545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:59.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.215+0000 7f05ec8b3700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f05e80c8170 0x7f05e80c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:59.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.215+0000 7f05ec8b3700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e8155830 con 0x7f05e80c60d0 2023-11-15T02:36:59.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.215+0000 7f05ec8b3700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e8158f40 con 0x7f05e80c8170 2023-11-15T02:36:59.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.215+0000 7f05ec8b3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8154c20 con 0x7f05e81541d0 2023-11-15T02:36:59.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.215+0000 7f05e6ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f05e80c60d0 0x7f05e80c7a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53862/0 (socket says 172.21.15.1:53862) 2023-11-15T02:36:59.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.215+0000 7f05e6ffd700 1 -- 172.21.15.1:0/2903300078 learned_addr learned my addr 172.21.15.1:0/2903300078 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:36:59.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.215+0000 7f05e77fe700 1 --2- 172.21.15.1:0/2903300078 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e81541d0 0x7f05e81545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:59.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.215+0000 7f05e7fff700 1 --2- 172.21.15.1:0/2903300078 >> v2:172.21.15.141:3300/0 conn(0x7f05e80c8170 0x7f05e80c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:59.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.215+0000 7f05e67fc700 1 -- 172.21.15.1:0/2903300078 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922829807 0 0) 0x7f05e8155830 con 0x7f05e80c60d0 2023-11-15T02:36:59.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.215+0000 7f05e67fc700 1 -- 172.21.15.1:0/2903300078 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05d00033f0 con 0x7f05e80c60d0 2023-11-15T02:36:59.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05e67fc700 1 -- 172.21.15.1:0/2903300078 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1992257496 0 0) 0x7f05d00033f0 con 0x7f05e80c60d0 2023-11-15T02:36:59.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05e77fe700 1 -- 172.21.15.1:0/2903300078 >> v2:172.21.15.141:3300/0 conn(0x7f05e80c8170 msgr2=0x7f05e80c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:36:59.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05e77fe700 1 --2- 172.21.15.1:0/2903300078 >> v2:172.21.15.141:3300/0 conn(0x7f05e80c8170 0x7f05e80c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:59.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05e77fe700 1 -- 172.21.15.1:0/2903300078 >> v1:172.21.15.1:6789/0 conn(0x7f05e80c60d0 legacy=0x7f05e80c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:59.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05e77fe700 1 -- 172.21.15.1:0/2903300078 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e8154f00 con 0x7f05e81541d0 2023-11-15T02:36:59.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05e7fff700 1 --2- 172.21.15.1:0/2903300078 >> v2:172.21.15.141:3300/0 conn(0x7f05e80c8170 0x7f05e80c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:36:59.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05e77fe700 1 --2- 172.21.15.1:0/2903300078 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e81541d0 0x7f05e81545b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f05d8009760 tx=0x7f05d8009060).ready entity=mon.2 client_cookie=fafc723fbb74e26 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:59.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05e67fc700 1 -- 172.21.15.1:0/2903300078 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc001470 con 0x7f05e81541d0 2023-11-15T02:36:59.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05e67fc700 1 -- 172.21.15.1:0/2903300078 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d8011400 con 0x7f05e81541d0 2023-11-15T02:36:59.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05e67fc700 1 -- 172.21.15.1:0/2903300078 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8011780 con 0x7f05e81541d0 2023-11-15T02:36:59.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05ec8b3700 1 -- 172.21.15.1:0/2903300078 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e81541d0 msgr2=0x7f05e81545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:59.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05ec8b3700 1 --2- 172.21.15.1:0/2903300078 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e81541d0 0x7f05e81545b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f05d8009760 tx=0x7f05d8009060).stop 2023-11-15T02:36:59.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05ec8b3700 1 -- 172.21.15.1:0/2903300078 shutdown_connections 2023-11-15T02:36:59.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05ec8b3700 1 --2- 172.21.15.1:0/2903300078 >> v2:172.21.15.141:3300/0 conn(0x7f05e80c8170 0x7f05e80c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:59.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05ec8b3700 1 --2- 172.21.15.1:0/2903300078 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e81541d0 0x7f05e81545b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:59.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05ec8b3700 1 -- 172.21.15.1:0/2903300078 >> 172.21.15.1:0/2903300078 conn(0x7f05e8069ee0 msgr2=0x7f05e806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:36:59.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05ec8b3700 1 -- 172.21.15.1:0/2903300078 shutdown_connections 2023-11-15T02:36:59.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.216+0000 7f05ec8b3700 1 -- 172.21.15.1:0/2903300078 wait complete. 2023-11-15T02:36:59.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.218+0000 7f05ec8b3700 1 Processor -- start 2023-11-15T02:36:59.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.218+0000 7f05ec8b3700 1 -- start start 2023-11-15T02:36:59.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.218+0000 7f05ec8b3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e80c60d0 0x7f05e81525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:59.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.218+0000 7f05ec8b3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e80c8170 0x7f05e81563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:59.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.218+0000 7f05ec8b3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05e81541d0 0x7f05e8164970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:59.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.218+0000 7f05ec8b3700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e80aa850 con 0x7f05e80c60d0 2023-11-15T02:36:59.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.218+0000 7f05ec8b3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8152a90 con 0x7f05e81541d0 2023-11-15T02:36:59.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.218+0000 7f05ec8b3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e80ae1e0 con 0x7f05e80c8170 2023-11-15T02:36:59.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05e77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e80c60d0 0x7f05e81525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:59.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05e77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e80c60d0 0x7f05e81525a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41382/0 (socket says 172.21.15.1:41382) 2023-11-15T02:36:59.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05e77fe700 1 -- 172.21.15.1:0/3386190542 learned_addr learned my addr 172.21.15.1:0/3386190542 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:36:59.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05e7fff700 1 --2- 172.21.15.1:0/3386190542 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05e81541d0 0x7f05e8164970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:59.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05e6ffd700 1 --2- 172.21.15.1:0/3386190542 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e80c8170 0x7f05e81563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:59.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05e77fe700 1 -- 172.21.15.1:0/3386190542 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e80c8170 msgr2=0x7f05e81563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:59.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05e77fe700 1 --2- 172.21.15.1:0/3386190542 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e80c8170 0x7f05e81563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:59.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05e77fe700 1 -- 172.21.15.1:0/3386190542 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05e81541d0 msgr2=0x7f05e8164970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:36:59.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05e77fe700 1 --2- 172.21.15.1:0/3386190542 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05e81541d0 0x7f05e8164970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:36:59.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05e77fe700 1 -- 172.21.15.1:0/3386190542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e0009a20 con 0x7f05e80c60d0 2023-11-15T02:36:59.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05e6ffd700 1 --2- 172.21.15.1:0/3386190542 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e80c8170 0x7f05e81563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:36:59.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05e77fe700 1 --2- 172.21.15.1:0/3386190542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e80c60d0 0x7f05e81525a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f05d8009d50 tx=0x7f05d8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:59.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05cf7fe700 1 -- 172.21.15.1:0/3386190542 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d80108a0 con 0x7f05e80c60d0 2023-11-15T02:36:59.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05cf7fe700 1 -- 172.21.15.1:0/3386190542 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d8010a00 con 0x7f05e80c60d0 2023-11-15T02:36:59.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05ec8b3700 1 -- 172.21.15.1:0/3386190542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d80092a0 con 0x7f05e80c60d0 2023-11-15T02:36:59.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05cf7fe700 1 -- 172.21.15.1:0/3386190542 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8010da0 con 0x7f05e80c60d0 2023-11-15T02:36:59.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.219+0000 7f05ec8b3700 1 -- 172.21.15.1:0/3386190542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e80ae7a0 con 0x7f05e80c60d0 2023-11-15T02:36:59.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.220+0000 7f05ec8b3700 1 -- 172.21.15.1:0/3386190542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e80475e0 con 0x7f05e80c60d0 2023-11-15T02:36:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.221+0000 7f05cf7fe700 1 -- 172.21.15.1:0/3386190542 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 73) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f05d8018030 con 0x7f05e80c60d0 2023-11-15T02:36:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.221+0000 7f05cf7fe700 1 --2- 172.21.15.1:0/3386190542 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05d405f000 0x7f05d40614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:36:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.221+0000 7f05cf7fe700 1 -- 172.21.15.1:0/3386190542 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 7176+0+0 (secure 0 0 0) 0x7f05d807b590 con 0x7f05e80c60d0 2023-11-15T02:36:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.221+0000 7f05e6ffd700 1 --2- 172.21.15.1:0/3386190542 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05d405f000 0x7f05d40614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:36:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.222+0000 7f05e6ffd700 1 --2- 172.21.15.1:0/3386190542 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05d405f000 0x7f05d40614c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f05e80b0640 tx=0x7f05dc009040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:36:59.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.225+0000 7f05cf7fe700 1 -- 172.21.15.1:0/3386190542 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f05d804c610 con 0x7f05e80c60d0 2023-11-15T02:36:59.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:36:59.446+0000 7f05ec8b3700 1 -- 172.21.15.1:0/3386190542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f05e81551e0 con 0x7f05e80c60d0 2023-11-15T02:37:00.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.070+0000 7f05cf7fe700 1 -- 172.21.15.1:0/3386190542 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v73) v1 ==== 104+0+0 (secure 0 0 0) 0x7f05d804fc30 con 0x7f05e80c60d0 2023-11-15T02:37:00.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.073+0000 7f05ec8b3700 1 -- 172.21.15.1:0/3386190542 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05d405f000 msgr2=0x7f05d40614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:00.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.073+0000 7f05ec8b3700 1 --2- 172.21.15.1:0/3386190542 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05d405f000 0x7f05d40614c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f05e80b0640 tx=0x7f05dc009040).stop 2023-11-15T02:37:00.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.073+0000 7f05ec8b3700 1 -- 172.21.15.1:0/3386190542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e80c60d0 msgr2=0x7f05e81525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:00.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.073+0000 7f05ec8b3700 1 --2- 172.21.15.1:0/3386190542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e80c60d0 0x7f05e81525a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f05d8009d50 tx=0x7f05d8016000).stop 2023-11-15T02:37:00.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.073+0000 7f05ec8b3700 1 -- 172.21.15.1:0/3386190542 shutdown_connections 2023-11-15T02:37:00.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.073+0000 7f05ec8b3700 1 --2- 172.21.15.1:0/3386190542 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f05d405f000 0x7f05d40614c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:00.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.073+0000 7f05ec8b3700 1 --2- 172.21.15.1:0/3386190542 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f05e81541d0 0x7f05e8164970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:00.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.073+0000 7f05ec8b3700 1 --2- 172.21.15.1:0/3386190542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05e80c60d0 0x7f05e81525a0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:00.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.073+0000 7f05ec8b3700 1 --2- 172.21.15.1:0/3386190542 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f05e80c8170 0x7f05e81563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:00.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.073+0000 7f05ec8b3700 1 -- 172.21.15.1:0/3386190542 >> 172.21.15.1:0/3386190542 conn(0x7f05e8069ee0 msgr2=0x7f05e81532e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:00.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.073+0000 7f05ec8b3700 1 -- 172.21.15.1:0/3386190542 shutdown_connections 2023-11-15T02:37:00.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.073+0000 7f05ec8b3700 1 -- 172.21.15.1:0/3386190542 wait complete. 2023-11-15T02:37:00.088 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-15T02:37:00.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.260+0000 7f60b9efd700 1 Processor -- start 2023-11-15T02:37:00.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.260+0000 7f60b9efd700 1 -- start start 2023-11-15T02:37:00.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.261+0000 7f60b9efd700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f60b4157660 0x7f60b4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:00.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.261+0000 7f60b9efd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f60b40aa060 0x7f60b40aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:00.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.261+0000 7f60b9efd700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b40c1820 con 0x7f60b40c1cb0 2023-11-15T02:37:00.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.261+0000 7f60b9efd700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b40c7540 con 0x7f60b40aa060 2023-11-15T02:37:00.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.261+0000 7f60b9efd700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b40aa9e0 con 0x7f60b4157660 2023-11-15T02:37:00.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.261+0000 7f60b3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f60b40aa060 0x7f60b40aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:00.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.261+0000 7f60b2ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f60b40c1cb0 0x7f60b40c6280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53878/0 (socket says 172.21.15.1:53878) 2023-11-15T02:37:00.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.261+0000 7f60b2ffd700 1 -- 172.21.15.1:0/4172915249 learned_addr learned my addr 172.21.15.1:0/4172915249 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:00.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.261+0000 7f60b37fe700 1 --2- 172.21.15.1:0/4172915249 >> v2:172.21.15.141:3300/0 conn(0x7f60b4157660 0x7f60b4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:00.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.261+0000 7f60b3fff700 1 -- 172.21.15.1:0/4172915249 >> v2:172.21.15.141:3300/0 conn(0x7f60b4157660 msgr2=0x7f60b4157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:00.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.261+0000 7f60b3fff700 1 --2- 172.21.15.1:0/4172915249 >> v2:172.21.15.141:3300/0 conn(0x7f60b4157660 0x7f60b4157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:00.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.261+0000 7f60b3fff700 1 -- 172.21.15.1:0/4172915249 >> v1:172.21.15.1:6789/0 conn(0x7f60b40c1cb0 legacy=0x7f60b40c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:00.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.261+0000 7f60b27fc700 1 -- 172.21.15.1:0/4172915249 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830945260 0 0) 0x7f60b40c1820 con 0x7f60b40c1cb0 2023-11-15T02:37:00.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.261+0000 7f60b3fff700 1 -- 172.21.15.1:0/4172915249 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b40c0c30 con 0x7f60b40aa060 2023-11-15T02:37:00.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.261+0000 7f60b37fe700 1 --2- 172.21.15.1:0/4172915249 >> v2:172.21.15.141:3300/0 conn(0x7f60b4157660 0x7f60b4157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:00.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.262+0000 7f60b3fff700 1 --2- 172.21.15.1:0/4172915249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b40aa060 0x7f60b40aa4f0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f60b40cc160 tx=0x7f60ac009780).ready entity=mon.0 client_cookie=6a37959925a03e6c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:00.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.262+0000 7f60b27fc700 1 -- 172.21.15.1:0/4172915249 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00e070 con 0x7f60b40aa060 2023-11-15T02:37:00.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.262+0000 7f60b27fc700 1 -- 172.21.15.1:0/4172915249 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac00bc30 con 0x7f60b40aa060 2023-11-15T02:37:00.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.262+0000 7f60b27fc700 1 -- 172.21.15.1:0/4172915249 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac012410 con 0x7f60b40aa060 2023-11-15T02:37:00.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.262+0000 7f60b9efd700 1 -- 172.21.15.1:0/4172915249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b40aa060 msgr2=0x7f60b40aa4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:00.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.262+0000 7f60b9efd700 1 --2- 172.21.15.1:0/4172915249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b40aa060 0x7f60b40aa4f0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f60b40cc160 tx=0x7f60ac009780).stop 2023-11-15T02:37:00.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.262+0000 7f60b9efd700 1 -- 172.21.15.1:0/4172915249 shutdown_connections 2023-11-15T02:37:00.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.262+0000 7f60b9efd700 1 --2- 172.21.15.1:0/4172915249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b40aa060 0x7f60b40aa4f0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:00.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.262+0000 7f60b9efd700 1 --2- 172.21.15.1:0/4172915249 >> v2:172.21.15.141:3300/0 conn(0x7f60b4157660 0x7f60b4157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:00.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.262+0000 7f60b9efd700 1 -- 172.21.15.1:0/4172915249 >> 172.21.15.1:0/4172915249 conn(0x7f60b4064aa0 msgr2=0x7f60b4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:00.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.262+0000 7f60b9efd700 1 -- 172.21.15.1:0/4172915249 shutdown_connections 2023-11-15T02:37:00.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.262+0000 7f60b9efd700 1 -- 172.21.15.1:0/4172915249 wait complete. 2023-11-15T02:37:00.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.264+0000 7f60b9efd700 1 Processor -- start 2023-11-15T02:37:00.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.264+0000 7f60b9efd700 1 -- start start 2023-11-15T02:37:00.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.264+0000 7f60b9efd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60b40aa060 0x7f60b4165160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:00.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.264+0000 7f60b9efd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b40c1cb0 0x7f60b40c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.264+0000 7f60b9efd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4157660 0x7f60b4163f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.264+0000 7f60b9efd700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4164f10 con 0x7f60b4157660 2023-11-15T02:37:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.264+0000 7f60b9efd700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b40ae4e0 con 0x7f60b40aa060 2023-11-15T02:37:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.264+0000 7f60b9efd700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4164950 con 0x7f60b40c1cb0 2023-11-15T02:37:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.264+0000 7f60b3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4157660 0x7f60b4163f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.264+0000 7f60b3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4157660 0x7f60b4163f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41402/0 (socket says 172.21.15.1:41402) 2023-11-15T02:37:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.264+0000 7f60b3fff700 1 -- 172.21.15.1:0/2032370665 learned_addr learned my addr 172.21.15.1:0/2032370665 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.265+0000 7f60b37fe700 1 --2- 172.21.15.1:0/2032370665 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60b40aa060 0x7f60b4165160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.265+0000 7f60b2ffd700 1 --2- 172.21.15.1:0/2032370665 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b40c1cb0 0x7f60b40c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:00.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.265+0000 7f60b3fff700 1 -- 172.21.15.1:0/2032370665 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b40c1cb0 msgr2=0x7f60b40c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:00.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.265+0000 7f60b3fff700 1 --2- 172.21.15.1:0/2032370665 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b40c1cb0 0x7f60b40c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:00.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.265+0000 7f60b3fff700 1 -- 172.21.15.1:0/2032370665 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60b40aa060 msgr2=0x7f60b4165160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:00.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.265+0000 7f60b3fff700 1 --2- 172.21.15.1:0/2032370665 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60b40aa060 0x7f60b4165160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:00.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.265+0000 7f60b3fff700 1 -- 172.21.15.1:0/2032370665 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac009a20 con 0x7f60b4157660 2023-11-15T02:37:00.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.265+0000 7f60b37fe700 1 --2- 172.21.15.1:0/2032370665 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60b40aa060 0x7f60b4165160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:00.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.265+0000 7f60b3fff700 1 --2- 172.21.15.1:0/2032370665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4157660 0x7f60b4163f60 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f60b4083ed0 tx=0x7f60ac009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:00.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.265+0000 7f609b7fe700 1 -- 172.21.15.1:0/2032370665 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac012410 con 0x7f60b4157660 2023-11-15T02:37:00.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.265+0000 7f609b7fe700 1 -- 172.21.15.1:0/2032370665 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac00b6f0 con 0x7f60b4157660 2023-11-15T02:37:00.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.265+0000 7f60b9efd700 1 -- 172.21.15.1:0/2032370665 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b4164c30 con 0x7f60b4157660 2023-11-15T02:37:00.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.265+0000 7f609b7fe700 1 -- 172.21.15.1:0/2032370665 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac011de0 con 0x7f60b4157660 2023-11-15T02:37:00.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.265+0000 7f60b9efd700 1 -- 172.21.15.1:0/2032370665 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b4165650 con 0x7f60b4157660 2023-11-15T02:37:00.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.266+0000 7f60b9efd700 1 -- 172.21.15.1:0/2032370665 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b406c7e0 con 0x7f60b4157660 2023-11-15T02:37:00.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.267+0000 7f609b7fe700 1 -- 172.21.15.1:0/2032370665 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 73) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f60ac003040 con 0x7f60b4157660 2023-11-15T02:37:00.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.267+0000 7f609b7fe700 1 --2- 172.21.15.1:0/2032370665 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60a005f030 0x7f60a00614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:00.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.267+0000 7f609b7fe700 1 -- 172.21.15.1:0/2032370665 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 7176+0+0 (secure 0 0 0) 0x7f60ac07c320 con 0x7f60b4157660 2023-11-15T02:37:00.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.267+0000 7f60b37fe700 1 --2- 172.21.15.1:0/2032370665 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60a005f030 0x7f60a00614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:00.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.267+0000 7f60b37fe700 1 --2- 172.21.15.1:0/2032370665 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60a005f030 0x7f60a00614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f60a4006fd0 tx=0x7f60a4008040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:00.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.271+0000 7f609b7fe700 1 -- 172.21.15.1:0/2032370665 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f60ac04d3a0 con 0x7f60b4157660 2023-11-15T02:37:00.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:00.443+0000 7f60b9efd700 1 -- 172.21.15.1:0/2032370665 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f60b405f8b0 con 0x7f60b4157660 2023-11-15T02:37:01.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.078+0000 7f609b7fe700 1 -- 172.21.15.1:0/2032370665 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f60ac079ea0 con 0x7f60b4157660 2023-11-15T02:37:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.080+0000 7f609b7fe700 1 -- 172.21.15.1:0/2032370665 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v167) v1 ==== 181+0+0 (secure 0 0 0) 0x7f60ac043c80 con 0x7f60b4157660 2023-11-15T02:37:01.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.085+0000 7f60b9efd700 1 -- 172.21.15.1:0/2032370665 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60a005f030 msgr2=0x7f60a00614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:01.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.085+0000 7f60b9efd700 1 --2- 172.21.15.1:0/2032370665 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60a005f030 0x7f60a00614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f60a4006fd0 tx=0x7f60a4008040).stop 2023-11-15T02:37:01.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.085+0000 7f60b9efd700 1 -- 172.21.15.1:0/2032370665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4157660 msgr2=0x7f60b4163f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:01.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.085+0000 7f60b9efd700 1 --2- 172.21.15.1:0/2032370665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4157660 0x7f60b4163f60 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f60b4083ed0 tx=0x7f60ac009780).stop 2023-11-15T02:37:01.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.086+0000 7f60b9efd700 1 -- 172.21.15.1:0/2032370665 shutdown_connections 2023-11-15T02:37:01.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.086+0000 7f60b9efd700 1 --2- 172.21.15.1:0/2032370665 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f60a005f030 0x7f60a00614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:01.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.086+0000 7f60b9efd700 1 --2- 172.21.15.1:0/2032370665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4157660 0x7f60b4163f60 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:01.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.086+0000 7f60b9efd700 1 --2- 172.21.15.1:0/2032370665 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60b40aa060 0x7f60b4165160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:01.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.086+0000 7f60b9efd700 1 --2- 172.21.15.1:0/2032370665 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b40c1cb0 0x7f60b40c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:01.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.086+0000 7f60b9efd700 1 -- 172.21.15.1:0/2032370665 >> 172.21.15.1:0/2032370665 conn(0x7f60b4064aa0 msgr2=0x7f60b4063460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:01.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.086+0000 7f60b9efd700 1 -- 172.21.15.1:0/2032370665 shutdown_connections 2023-11-15T02:37:01.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.086+0000 7f60b9efd700 1 -- 172.21.15.1:0/2032370665 wait complete. 2023-11-15T02:37:01.091 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:37:01.091 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2023-11-15T02:37:01.093 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:37:01.104 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-15T02:37:01.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.266+0000 7f0aee7e8700 1 Processor -- start 2023-11-15T02:37:01.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.266+0000 7f0aee7e8700 1 -- start start 2023-11-15T02:37:01.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.267+0000 7f0aee7e8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0ae8154150 0x7f0ae8154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:01.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.267+0000 7f0aee7e8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ae80ab1a0 0x7f0ae8158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:01.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.267+0000 7f0aee7e8700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae80c06f0 con 0x7f0ae80aa060 2023-11-15T02:37:01.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.267+0000 7f0aee7e8700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae80c09d0 con 0x7f0ae8154150 2023-11-15T02:37:01.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.267+0000 7f0aee7e8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8158820 con 0x7f0ae80ab1a0 2023-11-15T02:37:01.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.267+0000 7f0ae7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0ae8154150 0x7f0ae8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:01.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.267+0000 7f0ae7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0ae8154150 0x7f0ae8154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41416/0 (socket says 172.21.15.1:41416) 2023-11-15T02:37:01.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.267+0000 7f0ae7fff700 1 -- 172.21.15.1:0/3830269917 learned_addr learned my addr 172.21.15.1:0/3830269917 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:01.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.267+0000 7f0aecd85700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0ae80aa060 0x7f0ae80c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53886/0 (socket says 172.21.15.1:53886) 2023-11-15T02:37:01.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.267+0000 7f0ae77fe700 1 --2- 172.21.15.1:0/3830269917 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ae80ab1a0 0x7f0ae8158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:01.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.267+0000 7f0ae7fff700 1 -- 172.21.15.1:0/3830269917 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ae80ab1a0 msgr2=0x7f0ae8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:01.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.267+0000 7f0ae7fff700 1 --2- 172.21.15.1:0/3830269917 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ae80ab1a0 0x7f0ae8158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:01.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.268+0000 7f0ae7fff700 1 -- 172.21.15.1:0/3830269917 >> v1:172.21.15.1:6789/0 conn(0x7f0ae80aa060 legacy=0x7f0ae80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:01.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.268+0000 7f0ae6ffd700 1 -- 172.21.15.1:0/3830269917 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657725839 0 0) 0x7f0ae80c06f0 con 0x7f0ae80aa060 2023-11-15T02:37:01.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.268+0000 7f0ae7fff700 1 -- 172.21.15.1:0/3830269917 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae8158b00 con 0x7f0ae8154150 2023-11-15T02:37:01.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.268+0000 7f0ae7fff700 1 --2- 172.21.15.1:0/3830269917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ae8154150 0x7f0ae8154530 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f0ad8006fd0 tx=0x7f0ad80090f0).ready entity=mon.0 client_cookie=644525455e10c40a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:01.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.268+0000 7f0ae6ffd700 1 -- 172.21.15.1:0/3830269917 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad800b600 con 0x7f0ae8154150 2023-11-15T02:37:01.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.268+0000 7f0ae6ffd700 1 -- 172.21.15.1:0/3830269917 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad800b760 con 0x7f0ae8154150 2023-11-15T02:37:01.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.268+0000 7f0ae6ffd700 1 -- 172.21.15.1:0/3830269917 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad800bb00 con 0x7f0ae8154150 2023-11-15T02:37:01.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.268+0000 7f0aee7e8700 1 -- 172.21.15.1:0/3830269917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ae8154150 msgr2=0x7f0ae8154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:01.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.268+0000 7f0aee7e8700 1 --2- 172.21.15.1:0/3830269917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ae8154150 0x7f0ae8154530 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f0ad8006fd0 tx=0x7f0ad80090f0).stop 2023-11-15T02:37:01.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.268+0000 7f0aee7e8700 1 -- 172.21.15.1:0/3830269917 shutdown_connections 2023-11-15T02:37:01.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.268+0000 7f0aee7e8700 1 --2- 172.21.15.1:0/3830269917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ae8154150 0x7f0ae8154530 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:01.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.268+0000 7f0aee7e8700 1 --2- 172.21.15.1:0/3830269917 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ae80ab1a0 0x7f0ae8158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:01.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.268+0000 7f0aee7e8700 1 -- 172.21.15.1:0/3830269917 >> 172.21.15.1:0/3830269917 conn(0x7f0ae8064aa0 msgr2=0x7f0ae8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:01.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.268+0000 7f0aee7e8700 1 -- 172.21.15.1:0/3830269917 shutdown_connections 2023-11-15T02:37:01.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.268+0000 7f0aee7e8700 1 -- 172.21.15.1:0/3830269917 wait complete. 2023-11-15T02:37:01.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.270+0000 7f0aee7e8700 1 Processor -- start 2023-11-15T02:37:01.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.270+0000 7f0aee7e8700 1 -- start start 2023-11-15T02:37:01.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.270+0000 7f0aee7e8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ae80aa060 0x7f0ae814cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:01.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.270+0000 7f0aee7e8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ae80ab1a0 0x7f0ae8152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:01.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.270+0000 7f0aee7e8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ae8154150 0x7f0ae8152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:01.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0aee7e8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8153490 con 0x7f0ae80aa060 2023-11-15T02:37:01.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0aee7e8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae80ae460 con 0x7f0ae8154150 2023-11-15T02:37:01.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0aee7e8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae814d240 con 0x7f0ae80ab1a0 2023-11-15T02:37:01.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0ae7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ae80aa060 0x7f0ae814cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:01.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0ae7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ae80aa060 0x7f0ae814cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41426/0 (socket says 172.21.15.1:41426) 2023-11-15T02:37:01.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0ae7fff700 1 -- 172.21.15.1:0/3616116795 learned_addr learned my addr 172.21.15.1:0/3616116795 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:01.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0ae77fe700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ae80ab1a0 0x7f0ae8152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:01.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0ae7fff700 1 -- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ae80ab1a0 msgr2=0x7f0ae8152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:01.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0aecd85700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ae8154150 0x7f0ae8152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:01.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0ae7fff700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ae80ab1a0 0x7f0ae8152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:01.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0ae7fff700 1 -- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ae8154150 msgr2=0x7f0ae8152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:01.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0ae7fff700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ae8154150 0x7f0ae8152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:01.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0ae7fff700 1 -- 172.21.15.1:0/3616116795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad8009370 con 0x7f0ae80aa060 2023-11-15T02:37:01.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0ae77fe700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ae80ab1a0 0x7f0ae8152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:01.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0aecd85700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ae8154150 0x7f0ae8152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:01.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0ae7fff700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ae80aa060 0x7f0ae814cd50 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f0ad8009f50 tx=0x7f0ad8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:01.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0acffff700 1 -- 172.21.15.1:0/3616116795 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad800bec0 con 0x7f0ae80aa060 2023-11-15T02:37:01.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0acffff700 1 -- 172.21.15.1:0/3616116795 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad800b8d0 con 0x7f0ae80aa060 2023-11-15T02:37:01.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0acffff700 1 -- 172.21.15.1:0/3616116795 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8024470 con 0x7f0ae80aa060 2023-11-15T02:37:01.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0aee7e8700 1 -- 172.21.15.1:0/3616116795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae81525b0 con 0x7f0ae80aa060 2023-11-15T02:37:01.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.271+0000 7f0aee7e8700 1 -- 172.21.15.1:0/3616116795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae81522d0 con 0x7f0ae80aa060 2023-11-15T02:37:01.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.272+0000 7f0aee7e8700 1 -- 172.21.15.1:0/3616116795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae806c7e0 con 0x7f0ae80aa060 2023-11-15T02:37:01.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.273+0000 7f0acffff700 1 -- 172.21.15.1:0/3616116795 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0ad8021070 con 0x7f0ae80aa060 2023-11-15T02:37:01.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.273+0000 7f0acffff700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ad405f270 0x7f0ad4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:01.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.273+0000 7f0acffff700 1 -- 172.21.15.1:0/3616116795 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6738+0+0 (secure 0 0 0) 0x7f0ad807c0b0 con 0x7f0ae80aa060 2023-11-15T02:37:01.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.273+0000 7f0ae77fe700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ad405f270 0x7f0ad4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:01.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.274+0000 7f0ae77fe700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ad405f270 0x7f0ad4061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0ae80cafa0 tx=0x7f0adc008040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:01.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.277+0000 7f0acffff700 1 -- 172.21.15.1:0/3616116795 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0ad804cf90 con 0x7f0ae80aa060 2023-11-15T02:37:01.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:01.448+0000 7f0aee7e8700 1 -- 172.21.15.1:0/3616116795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ae8158de0 con 0x7f0ae80aa060 2023-11-15T02:37:02.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.081+0000 7f0acffff700 1 -- 172.21.15.1:0/3616116795 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v168) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0ad8029070 con 0x7f0ae80aa060 2023-11-15T02:37:02.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.084+0000 7f0aee7e8700 1 -- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ad405f270 msgr2=0x7f0ad4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.084+0000 7f0aee7e8700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ad405f270 0x7f0ad4061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0ae80cafa0 tx=0x7f0adc008040).stop 2023-11-15T02:37:02.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.084+0000 7f0aee7e8700 1 -- 172.21.15.1:0/3616116795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ae80aa060 msgr2=0x7f0ae814cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.084+0000 7f0aee7e8700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ae80aa060 0x7f0ae814cd50 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f0ad8009f50 tx=0x7f0ad8017000).stop 2023-11-15T02:37:02.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.085+0000 7f0aee7e8700 1 -- 172.21.15.1:0/3616116795 shutdown_connections 2023-11-15T02:37:02.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.085+0000 7f0aee7e8700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ad405f270 0x7f0ad4061730 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.085+0000 7f0aee7e8700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ae8154150 0x7f0ae8152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.085+0000 7f0aee7e8700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ae80aa060 0x7f0ae814cd50 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.085+0000 7f0aee7e8700 1 --2- 172.21.15.1:0/3616116795 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ae80ab1a0 0x7f0ae8152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.085+0000 7f0aee7e8700 1 -- 172.21.15.1:0/3616116795 >> 172.21.15.1:0/3616116795 conn(0x7f0ae8064aa0 msgr2=0x7f0ae8156da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:02.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.085+0000 7f0aee7e8700 1 -- 172.21.15.1:0/3616116795 shutdown_connections 2023-11-15T02:37:02.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.085+0000 7f0aee7e8700 1 -- 172.21.15.1:0/3616116795 wait complete. 2023-11-15T02:37:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2023-11-15T02:37:02.102 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-15T02:37:02.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.224+0000 7f6e1b2ef700 1 Processor -- start 2023-11-15T02:37:02.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.224+0000 7f6e1b2ef700 1 -- start start 2023-11-15T02:37:02.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.225+0000 7f6e1b2ef700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e141540a0 0x7f6e140ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.225+0000 7f6e1b2ef700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6e14154480 0x7f6e140ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.225+0000 7f6e1b2ef700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e140ca050 con 0x7f6e140c5f40 2023-11-15T02:37:02.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.225+0000 7f6e1b2ef700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e140c9440 con 0x7f6e14154480 2023-11-15T02:37:02.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.225+0000 7f6e1b2ef700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e140c9720 con 0x7f6e141540a0 2023-11-15T02:37:02.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.225+0000 7f6e1888a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6e14154480 0x7f6e140ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.225+0000 7f6e1908b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e141540a0 0x7f6e140ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.225+0000 7f6e1908b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e141540a0 0x7f6e140ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:42984/0 (socket says 172.21.15.1:42984) 2023-11-15T02:37:02.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.225+0000 7f6e1888a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6e14154480 0x7f6e140ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:59706/0 (socket says 172.21.15.1:59706) 2023-11-15T02:37:02.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.225+0000 7f6e1908b700 1 -- 172.21.15.1:0/3667412141 learned_addr learned my addr 172.21.15.1:0/3667412141 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:02.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.225+0000 7f6e1988c700 1 --1- 172.21.15.1:0/3667412141 >> v1:172.21.15.141:6789/0 conn(0x7f6e140c5f40 0x7f6e140aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:50988/0 (socket says 172.21.15.1:50988) 2023-11-15T02:37:02.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.225+0000 7f6e1908b700 1 -- 172.21.15.1:0/3667412141 >> v2:172.21.15.141:3300/0 conn(0x7f6e14154480 msgr2=0x7f6e140ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:02.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.225+0000 7f6e1908b700 1 --2- 172.21.15.1:0/3667412141 >> v2:172.21.15.141:3300/0 conn(0x7f6e14154480 0x7f6e140ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.225+0000 7f6e1908b700 1 -- 172.21.15.1:0/3667412141 >> v1:172.21.15.141:6789/0 conn(0x7f6e140c5f40 legacy=0x7f6e140aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.226+0000 7f6e0bfff700 1 -- 172.21.15.1:0/3667412141 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633878045 0 0) 0x7f6e140ca050 con 0x7f6e140c5f40 2023-11-15T02:37:02.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.226+0000 7f6e1908b700 1 -- 172.21.15.1:0/3667412141 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e140c9a00 con 0x7f6e141540a0 2023-11-15T02:37:02.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.226+0000 7f6e1888a700 1 --2- 172.21.15.1:0/3667412141 >> v2:172.21.15.141:3300/0 conn(0x7f6e14154480 0x7f6e140ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:37:02.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.226+0000 7f6e1908b700 1 --2- 172.21.15.1:0/3667412141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e141540a0 0x7f6e140ca4e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f6e10006fd0 tx=0x7f6e100090f0).ready entity=mon.2 client_cookie=7f236df66184b769 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:02.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.226+0000 7f6e0bfff700 1 -- 172.21.15.1:0/3667412141 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000b580 con 0x7f6e141540a0 2023-11-15T02:37:02.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.226+0000 7f6e0bfff700 1 -- 172.21.15.1:0/3667412141 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1000b6e0 con 0x7f6e141540a0 2023-11-15T02:37:02.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.226+0000 7f6e0bfff700 1 -- 172.21.15.1:0/3667412141 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000ba60 con 0x7f6e141540a0 2023-11-15T02:37:02.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.226+0000 7f6e1b2ef700 1 -- 172.21.15.1:0/3667412141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e141540a0 msgr2=0x7f6e140ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.226+0000 7f6e1b2ef700 1 --2- 172.21.15.1:0/3667412141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e141540a0 0x7f6e140ca4e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f6e10006fd0 tx=0x7f6e100090f0).stop 2023-11-15T02:37:02.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.226+0000 7f6e1b2ef700 1 -- 172.21.15.1:0/3667412141 shutdown_connections 2023-11-15T02:37:02.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.226+0000 7f6e1b2ef700 1 --2- 172.21.15.1:0/3667412141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e141540a0 0x7f6e140ca4e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.226+0000 7f6e1b2ef700 1 --2- 172.21.15.1:0/3667412141 >> v2:172.21.15.141:3300/0 conn(0x7f6e14154480 0x7f6e140ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.226+0000 7f6e1b2ef700 1 -- 172.21.15.1:0/3667412141 >> 172.21.15.1:0/3667412141 conn(0x7f6e14064a70 msgr2=0x7f6e14064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:02.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.226+0000 7f6e1b2ef700 1 -- 172.21.15.1:0/3667412141 shutdown_connections 2023-11-15T02:37:02.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.226+0000 7f6e1b2ef700 1 -- 172.21.15.1:0/3667412141 wait complete. 2023-11-15T02:37:02.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.228+0000 7f6e1b2ef700 1 Processor -- start 2023-11-15T02:37:02.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.228+0000 7f6e1b2ef700 1 -- start start 2023-11-15T02:37:02.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.228+0000 7f6e1b2ef700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e140c5f40 0x7f6e1414ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1b2ef700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e141540a0 0x7f6e141569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1b2ef700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e14154480 0x7f6e14154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1b2ef700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1413c7f0 con 0x7f6e140c5f40 2023-11-15T02:37:02.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1b2ef700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e141572b0 con 0x7f6e141540a0 2023-11-15T02:37:02.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1b2ef700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e14157590 con 0x7f6e14154480 2023-11-15T02:37:02.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1908b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e140c5f40 0x7f6e1414ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1908b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e140c5f40 0x7f6e1414ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41430/0 (socket says 172.21.15.1:41430) 2023-11-15T02:37:02.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1908b700 1 -- 172.21.15.1:0/3959545635 learned_addr learned my addr 172.21.15.1:0/3959545635 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:02.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1888a700 1 --2- 172.21.15.1:0/3959545635 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e141540a0 0x7f6e141569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1988c700 1 --2- 172.21.15.1:0/3959545635 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e14154480 0x7f6e14154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1908b700 1 -- 172.21.15.1:0/3959545635 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e14154480 msgr2=0x7f6e14154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1908b700 1 --2- 172.21.15.1:0/3959545635 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e14154480 0x7f6e14154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1908b700 1 -- 172.21.15.1:0/3959545635 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e141540a0 msgr2=0x7f6e141569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1908b700 1 --2- 172.21.15.1:0/3959545635 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e141540a0 0x7f6e141569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1908b700 1 -- 172.21.15.1:0/3959545635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e040092a0 con 0x7f6e140c5f40 2023-11-15T02:37:02.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1988c700 1 --2- 172.21.15.1:0/3959545635 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e14154480 0x7f6e14154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:02.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1908b700 1 --2- 172.21.15.1:0/3959545635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e140c5f40 0x7f6e1414ff20 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f6e140c9860 tx=0x7f6e10017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:02.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e097fa700 1 -- 172.21.15.1:0/3959545635 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000b850 con 0x7f6e140c5f40 2023-11-15T02:37:02.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e097fa700 1 -- 172.21.15.1:0/3959545635 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1000b9b0 con 0x7f6e140c5f40 2023-11-15T02:37:02.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1b2ef700 1 -- 172.21.15.1:0/3959545635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e10009370 con 0x7f6e140c5f40 2023-11-15T02:37:02.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e097fa700 1 -- 172.21.15.1:0/3959545635 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1001b660 con 0x7f6e140c5f40 2023-11-15T02:37:02.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.229+0000 7f6e1b2ef700 1 -- 172.21.15.1:0/3959545635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e14157b50 con 0x7f6e140c5f40 2023-11-15T02:37:02.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.230+0000 7f6e1b2ef700 1 -- 172.21.15.1:0/3959545635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1406c7e0 con 0x7f6e140c5f40 2023-11-15T02:37:02.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.231+0000 7f6e097fa700 1 -- 172.21.15.1:0/3959545635 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6e1001ba10 con 0x7f6e140c5f40 2023-11-15T02:37:02.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.231+0000 7f6e097fa700 1 --2- 172.21.15.1:0/3959545635 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6df805f270 0x7f6df8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.231+0000 7f6e097fa700 1 -- 172.21.15.1:0/3959545635 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6e1007bf00 con 0x7f6e140c5f40 2023-11-15T02:37:02.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.232+0000 7f6e1888a700 1 --2- 172.21.15.1:0/3959545635 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6df805f270 0x7f6df8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.232+0000 7f6e1888a700 1 --2- 172.21.15.1:0/3959545635 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6df805f270 0x7f6df8061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6e04009270 tx=0x7f6e04008040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:02.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.236+0000 7f6e097fa700 1 -- 172.21.15.1:0/3959545635 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6e1004cf80 con 0x7f6e140c5f40 2023-11-15T02:37:02.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.410+0000 7f6e1b2ef700 1 -- 172.21.15.1:0/3959545635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6e140c9ce0 con 0x7f6e140c5f40 2023-11-15T02:37:02.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.413+0000 7f6e097fa700 1 -- 172.21.15.1:0/3959545635 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6e1001f020 con 0x7f6e140c5f40 2023-11-15T02:37:02.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.415+0000 7f6e1b2ef700 1 -- 172.21.15.1:0/3959545635 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6df805f270 msgr2=0x7f6df8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.415+0000 7f6e1b2ef700 1 --2- 172.21.15.1:0/3959545635 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6df805f270 0x7f6df8061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6e04009270 tx=0x7f6e04008040).stop 2023-11-15T02:37:02.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.415+0000 7f6e1b2ef700 1 -- 172.21.15.1:0/3959545635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e140c5f40 msgr2=0x7f6e1414ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.415+0000 7f6e1b2ef700 1 --2- 172.21.15.1:0/3959545635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e140c5f40 0x7f6e1414ff20 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f6e140c9860 tx=0x7f6e10017000).stop 2023-11-15T02:37:02.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.416+0000 7f6e1b2ef700 1 -- 172.21.15.1:0/3959545635 shutdown_connections 2023-11-15T02:37:02.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.416+0000 7f6e1b2ef700 1 --2- 172.21.15.1:0/3959545635 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6df805f270 0x7f6df8061730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.416+0000 7f6e1b2ef700 1 --2- 172.21.15.1:0/3959545635 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e14154480 0x7f6e14154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.416+0000 7f6e1b2ef700 1 --2- 172.21.15.1:0/3959545635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e140c5f40 0x7f6e1414ff20 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.416+0000 7f6e1b2ef700 1 --2- 172.21.15.1:0/3959545635 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e141540a0 0x7f6e141569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.416+0000 7f6e1b2ef700 1 -- 172.21.15.1:0/3959545635 >> 172.21.15.1:0/3959545635 conn(0x7f6e14064a70 msgr2=0x7f6e140ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:02.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.416+0000 7f6e1b2ef700 1 -- 172.21.15.1:0/3959545635 shutdown_connections 2023-11-15T02:37:02.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.416+0000 7f6e1b2ef700 1 -- 172.21.15.1:0/3959545635 wait complete. 2023-11-15T02:37:02.429 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-15T02:37:02.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.550+0000 7f7db7e37700 1 Processor -- start 2023-11-15T02:37:02.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.550+0000 7f7db7e37700 1 -- start start 2023-11-15T02:37:02.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.551+0000 7f7db7e37700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db01540a0 0x7f7db00ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.551+0000 7f7db7e37700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7db0154480 0x7f7db00ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.551+0000 7f7db7e37700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db00ca050 con 0x7f7db00c5f40 2023-11-15T02:37:02.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.551+0000 7f7db7e37700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db00c9440 con 0x7f7db0154480 2023-11-15T02:37:02.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.551+0000 7f7db7e37700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00c9720 con 0x7f7db01540a0 2023-11-15T02:37:02.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.551+0000 7f7db53d2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7db0154480 0x7f7db00ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.551+0000 7f7db53d2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7db0154480 0x7f7db00ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41442/0 (socket says 172.21.15.1:41442) 2023-11-15T02:37:02.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.551+0000 7f7db53d2700 1 -- 172.21.15.1:0/791492294 learned_addr learned my addr 172.21.15.1:0/791492294 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:02.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.551+0000 7f7db5bd3700 1 --2- 172.21.15.1:0/791492294 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db01540a0 0x7f7db00ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.551+0000 7f7db53d2700 1 -- 172.21.15.1:0/791492294 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db01540a0 msgr2=0x7f7db00ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:02.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.551+0000 7f7db53d2700 1 --2- 172.21.15.1:0/791492294 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db01540a0 0x7f7db00ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.551+0000 7f7db53d2700 1 -- 172.21.15.1:0/791492294 >> v1:172.21.15.141:6789/0 conn(0x7f7db00c5f40 legacy=0x7f7db00aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.551+0000 7f7db53d2700 1 -- 172.21.15.1:0/791492294 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db00c9a00 con 0x7f7db0154480 2023-11-15T02:37:02.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.551+0000 7f7db53d2700 1 --2- 172.21.15.1:0/791492294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7db0154480 0x7f7db00ca9d0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f7da4006fd0 tx=0x7f7da40090f0).ready entity=mon.0 client_cookie=8898893a8a52f211 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:02.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.552+0000 7f7db4bd1700 1 -- 172.21.15.1:0/791492294 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da400b600 con 0x7f7db0154480 2023-11-15T02:37:02.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.552+0000 7f7db4bd1700 1 -- 172.21.15.1:0/791492294 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da400b760 con 0x7f7db0154480 2023-11-15T02:37:02.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.552+0000 7f7db4bd1700 1 -- 172.21.15.1:0/791492294 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da400bae0 con 0x7f7db0154480 2023-11-15T02:37:02.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.552+0000 7f7db7e37700 1 -- 172.21.15.1:0/791492294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7db0154480 msgr2=0x7f7db00ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.552+0000 7f7db7e37700 1 --2- 172.21.15.1:0/791492294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7db0154480 0x7f7db00ca9d0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f7da4006fd0 tx=0x7f7da40090f0).stop 2023-11-15T02:37:02.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.552+0000 7f7db7e37700 1 -- 172.21.15.1:0/791492294 shutdown_connections 2023-11-15T02:37:02.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.552+0000 7f7db7e37700 1 --2- 172.21.15.1:0/791492294 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db01540a0 0x7f7db00ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.552+0000 7f7db7e37700 1 --2- 172.21.15.1:0/791492294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7db0154480 0x7f7db00ca9d0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.552+0000 7f7db7e37700 1 -- 172.21.15.1:0/791492294 >> 172.21.15.1:0/791492294 conn(0x7f7db0064a70 msgr2=0x7f7db0064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:02.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.552+0000 7f7db7e37700 1 -- 172.21.15.1:0/791492294 shutdown_connections 2023-11-15T02:37:02.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.552+0000 7f7db7e37700 1 -- 172.21.15.1:0/791492294 wait complete. 2023-11-15T02:37:02.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.553+0000 7f7db7e37700 1 Processor -- start 2023-11-15T02:37:02.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.553+0000 7f7db7e37700 1 -- start start 2023-11-15T02:37:02.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.554+0000 7f7db7e37700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db00c5f40 0x7f7db0153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.554+0000 7f7db7e37700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7db01540a0 0x7f7db0150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.554+0000 7f7db7e37700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7db0154480 0x7f7db00a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.554+0000 7f7db7e37700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00afa20 con 0x7f7db01540a0 2023-11-15T02:37:02.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.554+0000 7f7db7e37700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db0151020 con 0x7f7db0154480 2023-11-15T02:37:02.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.554+0000 7f7db7e37700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00b09c0 con 0x7f7db00c5f40 2023-11-15T02:37:02.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.554+0000 7f7db53d2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7db01540a0 0x7f7db0150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.554+0000 7f7db53d2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7db01540a0 0x7f7db0150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41448/0 (socket says 172.21.15.1:41448) 2023-11-15T02:37:02.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.554+0000 7f7db53d2700 1 -- 172.21.15.1:0/3392440199 learned_addr learned my addr 172.21.15.1:0/3392440199 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:02.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.555+0000 7f7db5bd3700 1 --2- 172.21.15.1:0/3392440199 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db00c5f40 0x7f7db0153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.555+0000 7f7db63d4700 1 --2- 172.21.15.1:0/3392440199 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7db0154480 0x7f7db00a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.555+0000 7f7db53d2700 1 -- 172.21.15.1:0/3392440199 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db00c5f40 msgr2=0x7f7db0153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.555+0000 7f7db53d2700 1 --2- 172.21.15.1:0/3392440199 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db00c5f40 0x7f7db0153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.555+0000 7f7db53d2700 1 -- 172.21.15.1:0/3392440199 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7db0154480 msgr2=0x7f7db00a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.555+0000 7f7db53d2700 1 --2- 172.21.15.1:0/3392440199 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7db0154480 0x7f7db00a9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.555+0000 7f7db53d2700 1 -- 172.21.15.1:0/3392440199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da4009370 con 0x7f7db01540a0 2023-11-15T02:37:02.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.555+0000 7f7db63d4700 1 --2- 172.21.15.1:0/3392440199 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7db0154480 0x7f7db00a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:02.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.555+0000 7f7db53d2700 1 --2- 172.21.15.1:0/3392440199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7db01540a0 0x7f7db0150860 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f7db00c2070 tx=0x7f7da4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:02.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.555+0000 7f7dadffb700 1 -- 172.21.15.1:0/3392440199 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da400b8d0 con 0x7f7db01540a0 2023-11-15T02:37:02.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.555+0000 7f7dadffb700 1 -- 172.21.15.1:0/3392440199 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da400ba30 con 0x7f7db01540a0 2023-11-15T02:37:02.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.555+0000 7f7db7e37700 1 -- 172.21.15.1:0/3392440199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db00b0530 con 0x7f7db01540a0 2023-11-15T02:37:02.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.555+0000 7f7dadffb700 1 -- 172.21.15.1:0/3392440199 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da401a430 con 0x7f7db01540a0 2023-11-15T02:37:02.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.555+0000 7f7db7e37700 1 -- 172.21.15.1:0/3392440199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db00afc80 con 0x7f7db01540a0 2023-11-15T02:37:02.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.556+0000 7f7db7e37700 1 -- 172.21.15.1:0/3392440199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db00b06c0 con 0x7f7db01540a0 2023-11-15T02:37:02.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.556+0000 7f7dadffb700 1 -- 172.21.15.1:0/3392440199 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7da4021020 con 0x7f7db01540a0 2023-11-15T02:37:02.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.557+0000 7f7dadffb700 1 --2- 172.21.15.1:0/3392440199 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d9c05f270 0x7f7d9c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.557+0000 7f7dadffb700 1 -- 172.21.15.1:0/3392440199 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7da407ba90 con 0x7f7db01540a0 2023-11-15T02:37:02.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.557+0000 7f7db5bd3700 1 --2- 172.21.15.1:0/3392440199 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d9c05f270 0x7f7d9c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.557+0000 7f7db5bd3700 1 --2- 172.21.15.1:0/3392440199 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d9c05f270 0x7f7d9c061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f7da0007460 tx=0x7f7da000b040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:02.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.561+0000 7f7dadffb700 1 -- 172.21.15.1:0/3392440199 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7da404cb10 con 0x7f7db01540a0 2023-11-15T02:37:02.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.737+0000 7f7db7e37700 1 -- 172.21.15.1:0/3392440199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f7db00c9ce0 con 0x7f7db01540a0 2023-11-15T02:37:02.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.741+0000 7f7dadffb700 1 -- 172.21.15.1:0/3392440199 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v33) v1 ==== 120+0+0 (secure 0 0 0) 0x7f7da4029070 con 0x7f7db01540a0 2023-11-15T02:37:02.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.743+0000 7f7db7e37700 1 -- 172.21.15.1:0/3392440199 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d9c05f270 msgr2=0x7f7d9c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.743+0000 7f7db7e37700 1 --2- 172.21.15.1:0/3392440199 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d9c05f270 0x7f7d9c061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f7da0007460 tx=0x7f7da000b040).stop 2023-11-15T02:37:02.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.743+0000 7f7db7e37700 1 -- 172.21.15.1:0/3392440199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7db01540a0 msgr2=0x7f7db0150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.743+0000 7f7db7e37700 1 --2- 172.21.15.1:0/3392440199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7db01540a0 0x7f7db0150860 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f7db00c2070 tx=0x7f7da4017000).stop 2023-11-15T02:37:02.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.743+0000 7f7db7e37700 1 -- 172.21.15.1:0/3392440199 shutdown_connections 2023-11-15T02:37:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.743+0000 7f7db7e37700 1 --2- 172.21.15.1:0/3392440199 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f7d9c05f270 0x7f7d9c061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.743+0000 7f7db7e37700 1 --2- 172.21.15.1:0/3392440199 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7db0154480 0x7f7db00a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.743+0000 7f7db7e37700 1 --2- 172.21.15.1:0/3392440199 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db00c5f40 0x7f7db0153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.743+0000 7f7db7e37700 1 --2- 172.21.15.1:0/3392440199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7db01540a0 0x7f7db0150860 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.743+0000 7f7db7e37700 1 -- 172.21.15.1:0/3392440199 >> 172.21.15.1:0/3392440199 conn(0x7f7db0064a70 msgr2=0x7f7db00c43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:02.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.743+0000 7f7db7e37700 1 -- 172.21.15.1:0/3392440199 shutdown_connections 2023-11-15T02:37:02.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.743+0000 7f7db7e37700 1 -- 172.21.15.1:0/3392440199 wait complete. 2023-11-15T02:37:02.757 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-11-15T02:37:02.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.873+0000 7fdd19b83700 1 Processor -- start 2023-11-15T02:37:02.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.874+0000 7fdd19b83700 1 -- start start 2023-11-15T02:37:02.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.874+0000 7fdd19b83700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdd14154450 0x7fdd140a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.874+0000 7fdd19b83700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdd140be520 0x7fdd14154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.874+0000 7fdd19b83700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd140a85e0 con 0x7fdd140833a0 2023-11-15T02:37:02.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.874+0000 7fdd19b83700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd14065940 con 0x7fdd14154450 2023-11-15T02:37:02.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.874+0000 7fdd19b83700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14065660 con 0x7fdd140be520 2023-11-15T02:37:02.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.875+0000 7fdd137fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdd14154450 0x7fdd140a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.875+0000 7fdd12ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fdd140833a0 0x7fdd140bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53902/0 (socket says 172.21.15.1:53902) 2023-11-15T02:37:02.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.875+0000 7fdd12ffd700 1 -- 172.21.15.1:0/2198781299 learned_addr learned my addr 172.21.15.1:0/2198781299 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:02.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.875+0000 7fdd13fff700 1 --2- 172.21.15.1:0/2198781299 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdd140be520 0x7fdd14154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.875+0000 7fdd137fe700 1 -- 172.21.15.1:0/2198781299 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdd140be520 msgr2=0x7fdd14154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:02.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.875+0000 7fdd137fe700 1 --2- 172.21.15.1:0/2198781299 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdd140be520 0x7fdd14154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.875+0000 7fdd137fe700 1 -- 172.21.15.1:0/2198781299 >> v1:172.21.15.1:6789/0 conn(0x7fdd140833a0 legacy=0x7fdd140bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.875+0000 7fdd127fc700 1 -- 172.21.15.1:0/2198781299 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907509057 0 0) 0x7fdd140a85e0 con 0x7fdd140833a0 2023-11-15T02:37:02.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.875+0000 7fdd137fe700 1 -- 172.21.15.1:0/2198781299 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd140c6f50 con 0x7fdd14154450 2023-11-15T02:37:02.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.875+0000 7fdd137fe700 1 --2- 172.21.15.1:0/2198781299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd14154450 0x7fdd140a7ef0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7fdd04006fd0 tx=0x7fdd04006f40).ready entity=mon.0 client_cookie=121a6094bb0c7e4b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:02.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.875+0000 7fdd127fc700 1 -- 172.21.15.1:0/2198781299 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04005880 con 0x7fdd14154450 2023-11-15T02:37:02.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.875+0000 7fdd127fc700 1 -- 172.21.15.1:0/2198781299 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd040059e0 con 0x7fdd14154450 2023-11-15T02:37:02.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.875+0000 7fdd127fc700 1 -- 172.21.15.1:0/2198781299 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04005d60 con 0x7fdd14154450 2023-11-15T02:37:02.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.876+0000 7fdd19b83700 1 -- 172.21.15.1:0/2198781299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd14154450 msgr2=0x7fdd140a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.876+0000 7fdd19b83700 1 --2- 172.21.15.1:0/2198781299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd14154450 0x7fdd140a7ef0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7fdd04006fd0 tx=0x7fdd04006f40).stop 2023-11-15T02:37:02.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.876+0000 7fdd19b83700 1 -- 172.21.15.1:0/2198781299 shutdown_connections 2023-11-15T02:37:02.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.876+0000 7fdd19b83700 1 --2- 172.21.15.1:0/2198781299 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdd140be520 0x7fdd14154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.876+0000 7fdd19b83700 1 --2- 172.21.15.1:0/2198781299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd14154450 0x7fdd140a7ef0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.876+0000 7fdd19b83700 1 -- 172.21.15.1:0/2198781299 >> 172.21.15.1:0/2198781299 conn(0x7fdd14082f90 msgr2=0x7fdd140c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:02.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.876+0000 7fdd19b83700 1 -- 172.21.15.1:0/2198781299 shutdown_connections 2023-11-15T02:37:02.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.876+0000 7fdd19b83700 1 -- 172.21.15.1:0/2198781299 wait complete. 2023-11-15T02:37:02.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.877+0000 7fdd19b83700 1 Processor -- start 2023-11-15T02:37:02.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.877+0000 7fdd19b83700 1 -- start start 2023-11-15T02:37:02.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd19b83700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdd140833a0 0x7fdd140a9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd19b83700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdd140be520 0x7fdd14164120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd19b83700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd14154450 0x7fdd140ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd19b83700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14165140 con 0x7fdd14154450 2023-11-15T02:37:02.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd19b83700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd140aba50 con 0x7fdd140833a0 2023-11-15T02:37:02.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd19b83700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14167930 con 0x7fdd140be520 2023-11-15T02:37:02.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd13fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd14154450 0x7fdd140ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd13fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd14154450 0x7fdd140ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41466/0 (socket says 172.21.15.1:41466) 2023-11-15T02:37:02.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd13fff700 1 -- 172.21.15.1:0/2767750327 learned_addr learned my addr 172.21.15.1:0/2767750327 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:02.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd12ffd700 1 --2- 172.21.15.1:0/2767750327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdd140be520 0x7fdd14164120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd137fe700 1 --2- 172.21.15.1:0/2767750327 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdd140833a0 0x7fdd140a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd13fff700 1 -- 172.21.15.1:0/2767750327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdd140be520 msgr2=0x7fdd14164120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd13fff700 1 --2- 172.21.15.1:0/2767750327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdd140be520 0x7fdd14164120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd13fff700 1 -- 172.21.15.1:0/2767750327 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdd140833a0 msgr2=0x7fdd140a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:02.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd13fff700 1 --2- 172.21.15.1:0/2767750327 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdd140833a0 0x7fdd140a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:02.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd13fff700 1 -- 172.21.15.1:0/2767750327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04009250 con 0x7fdd14154450 2023-11-15T02:37:02.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.878+0000 7fdd13fff700 1 --2- 172.21.15.1:0/2767750327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd14154450 0x7fdd140ae890 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7fdd0c007f30 tx=0x7fdd0c0098e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:02.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.879+0000 7fdcfb7fe700 1 -- 172.21.15.1:0/2767750327 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c00eb90 con 0x7fdd14154450 2023-11-15T02:37:02.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.879+0000 7fdcfb7fe700 1 -- 172.21.15.1:0/2767750327 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c00ecf0 con 0x7fdd14154450 2023-11-15T02:37:02.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.879+0000 7fdd19b83700 1 -- 172.21.15.1:0/2767750327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd14164610 con 0x7fdd14154450 2023-11-15T02:37:02.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.879+0000 7fdcfb7fe700 1 -- 172.21.15.1:0/2767750327 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c014610 con 0x7fdd14154450 2023-11-15T02:37:02.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.879+0000 7fdd19b83700 1 -- 172.21.15.1:0/2767750327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd14164b80 con 0x7fdd14154450 2023-11-15T02:37:02.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.880+0000 7fdd19b83700 1 -- 172.21.15.1:0/2767750327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1406c7e0 con 0x7fdd14154450 2023-11-15T02:37:02.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.880+0000 7fdcfb7fe700 1 -- 172.21.15.1:0/2767750327 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdd0c0149c0 con 0x7fdd14154450 2023-11-15T02:37:02.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.880+0000 7fdcfb7fe700 1 --2- 172.21.15.1:0/2767750327 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdd0005f270 0x7fdd00061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:02.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.881+0000 7fdcfb7fe700 1 -- 172.21.15.1:0/2767750327 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fdd0c07a8f0 con 0x7fdd14154450 2023-11-15T02:37:02.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.881+0000 7fdd137fe700 1 --2- 172.21.15.1:0/2767750327 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdd0005f270 0x7fdd00061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:02.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.881+0000 7fdd137fe700 1 --2- 172.21.15.1:0/2767750327 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdd0005f270 0x7fdd00061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fdd04006f80 tx=0x7fdd04016000).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:02.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:02.885+0000 7fdcfb7fe700 1 -- 172.21.15.1:0/2767750327 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdd0c04b970 con 0x7fdd14154450 2023-11-15T02:37:03.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:03.132+0000 7fdd19b83700 1 -- 172.21.15.1:0/2767750327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7fdd14065350 con 0x7fdd14154450 2023-11-15T02:37:04.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.086+0000 7fdcfb7fe700 1 -- 172.21.15.1:0/2767750327 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2433) v1 ==== 174+0+0 (secure 0 0 0) 0x7fdd0c00ee60 con 0x7fdd14154450 2023-11-15T02:37:04.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.089+0000 7fdd19b83700 1 -- 172.21.15.1:0/2767750327 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdd0005f270 msgr2=0x7fdd00061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:04.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.089+0000 7fdd19b83700 1 --2- 172.21.15.1:0/2767750327 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdd0005f270 0x7fdd00061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fdd04006f80 tx=0x7fdd04016000).stop 2023-11-15T02:37:04.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.089+0000 7fdd19b83700 1 -- 172.21.15.1:0/2767750327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd14154450 msgr2=0x7fdd140ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:04.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.089+0000 7fdd19b83700 1 --2- 172.21.15.1:0/2767750327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd14154450 0x7fdd140ae890 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7fdd0c007f30 tx=0x7fdd0c0098e0).stop 2023-11-15T02:37:04.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.089+0000 7fdd19b83700 1 -- 172.21.15.1:0/2767750327 shutdown_connections 2023-11-15T02:37:04.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.089+0000 7fdd19b83700 1 --2- 172.21.15.1:0/2767750327 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fdd0005f270 0x7fdd00061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:04.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.089+0000 7fdd19b83700 1 --2- 172.21.15.1:0/2767750327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd14154450 0x7fdd140ae890 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:04.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.089+0000 7fdd19b83700 1 --2- 172.21.15.1:0/2767750327 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdd140833a0 0x7fdd140a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:04.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.089+0000 7fdd19b83700 1 --2- 172.21.15.1:0/2767750327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdd140be520 0x7fdd14164120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:04.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.089+0000 7fdd19b83700 1 -- 172.21.15.1:0/2767750327 >> 172.21.15.1:0/2767750327 conn(0x7fdd14082f90 msgr2=0x7fdd140c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:04.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.089+0000 7fdd19b83700 1 -- 172.21.15.1:0/2767750327 shutdown_connections 2023-11-15T02:37:04.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.089+0000 7fdd19b83700 1 -- 172.21.15.1:0/2767750327 wait complete. 2023-11-15T02:37:04.106 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-11-15T02:37:04.106 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-11-15T02:37:04.107 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-15T02:37:04.107 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-11-15T02:37:04.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.231+0000 7fb204f19700 1 Processor -- start 2023-11-15T02:37:04.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.231+0000 7fb204f19700 1 -- start start 2023-11-15T02:37:04.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.232+0000 7fb204f19700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb200154150 0x7fb200154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:04.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.232+0000 7fb204f19700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2000ab1a0 0x7fb200158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:04.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.232+0000 7fb204f19700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb2000aa060 0x7fb2000c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:04.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.232+0000 7fb204f19700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2000c06f0 con 0x7fb2000aa060 2023-11-15T02:37:04.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.232+0000 7fb204f19700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2000c09d0 con 0x7fb200154150 2023-11-15T02:37:04.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.232+0000 7fb204f19700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb200158820 con 0x7fb2000ab1a0 2023-11-15T02:37:04.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.232+0000 7fb1fed9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb2000aa060 0x7fb2000c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:04.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.232+0000 7fb1fed9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb2000aa060 0x7fb2000c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41482/0 (socket says 172.21.15.1:41482) 2023-11-15T02:37:04.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.232+0000 7fb1fed9d700 1 -- 172.21.15.1:0/3232399747 learned_addr learned my addr 172.21.15.1:0/3232399747 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:04.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.232+0000 7fb1fe59c700 1 --2- 172.21.15.1:0/3232399747 >> v2:172.21.15.141:3300/0 conn(0x7fb200154150 0x7fb200154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:04.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.232+0000 7fb1fdd9b700 1 --2- 172.21.15.1:0/3232399747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2000ab1a0 0x7fb200158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:04.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb1fed9d700 1 -- 172.21.15.1:0/3232399747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2000ab1a0 msgr2=0x7fb200158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:04.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb1fed9d700 1 --2- 172.21.15.1:0/3232399747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2000ab1a0 0x7fb200158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:04.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb1fed9d700 1 -- 172.21.15.1:0/3232399747 >> v2:172.21.15.141:3300/0 conn(0x7fb200154150 msgr2=0x7fb200154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:04.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb1fed9d700 1 --2- 172.21.15.1:0/3232399747 >> v2:172.21.15.141:3300/0 conn(0x7fb200154150 0x7fb200154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:04.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb1fed9d700 1 -- 172.21.15.1:0/3232399747 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb200158b00 con 0x7fb2000aa060 2023-11-15T02:37:04.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb1fdd9b700 1 --2- 172.21.15.1:0/3232399747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2000ab1a0 0x7fb200158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:04.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb1fed9d700 1 --2- 172.21.15.1:0/3232399747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2000aa060 0x7fb2000c5f10 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7fb20006bfb0 tx=0x7fb1f0009840).ready entity=mon.0 client_cookie=cb4acac4096449ac server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:04.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb1fd59a700 1 -- 172.21.15.1:0/3232399747 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f000e070 con 0x7fb2000aa060 2023-11-15T02:37:04.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb1fd59a700 1 -- 172.21.15.1:0/3232399747 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f000ba50 con 0x7fb2000aa060 2023-11-15T02:37:04.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb1fd59a700 1 -- 172.21.15.1:0/3232399747 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f000bdd0 con 0x7fb2000aa060 2023-11-15T02:37:04.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb204f19700 1 -- 172.21.15.1:0/3232399747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2000aa060 msgr2=0x7fb2000c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:04.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb204f19700 1 --2- 172.21.15.1:0/3232399747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2000aa060 0x7fb2000c5f10 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7fb20006bfb0 tx=0x7fb1f0009840).stop 2023-11-15T02:37:04.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb204f19700 1 -- 172.21.15.1:0/3232399747 shutdown_connections 2023-11-15T02:37:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb204f19700 1 --2- 172.21.15.1:0/3232399747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2000aa060 0x7fb2000c5f10 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb204f19700 1 --2- 172.21.15.1:0/3232399747 >> v2:172.21.15.141:3300/0 conn(0x7fb200154150 0x7fb200154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb204f19700 1 --2- 172.21.15.1:0/3232399747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2000ab1a0 0x7fb200158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb204f19700 1 -- 172.21.15.1:0/3232399747 >> 172.21.15.1:0/3232399747 conn(0x7fb200064aa0 msgr2=0x7fb200064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.233+0000 7fb204f19700 1 -- 172.21.15.1:0/3232399747 shutdown_connections 2023-11-15T02:37:04.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.234+0000 7fb204f19700 1 -- 172.21.15.1:0/3232399747 wait complete. 2023-11-15T02:37:04.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.235+0000 7fb204f19700 1 Processor -- start 2023-11-15T02:37:04.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.235+0000 7fb204f19700 1 -- start start 2023-11-15T02:37:04.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.235+0000 7fb204f19700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2000aa060 0x7fb20014c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:04.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.235+0000 7fb204f19700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2000ab1a0 0x7fb2001554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:04.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.235+0000 7fb204f19700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb200154150 0x7fb2000af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:04.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.235+0000 7fb204f19700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb200163bb0 con 0x7fb200154150 2023-11-15T02:37:04.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.235+0000 7fb204f19700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000ae160 con 0x7fb2000aa060 2023-11-15T02:37:04.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.235+0000 7fb204f19700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000ae440 con 0x7fb2000ab1a0 2023-11-15T02:37:04.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.235+0000 7fb1fed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb200154150 0x7fb2000af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:04.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.235+0000 7fb1fed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb200154150 0x7fb2000af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41496/0 (socket says 172.21.15.1:41496) 2023-11-15T02:37:04.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.235+0000 7fb1fed9d700 1 -- 172.21.15.1:0/200386757 learned_addr learned my addr 172.21.15.1:0/200386757 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:04.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.236+0000 7fb1fed9d700 1 -- 172.21.15.1:0/200386757 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2000ab1a0 msgr2=0x7fb2001554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:04.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.236+0000 7fb1fed9d700 1 --2- 172.21.15.1:0/200386757 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2000ab1a0 0x7fb2001554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:37:04.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.236+0000 7fb1fed9d700 1 -- 172.21.15.1:0/200386757 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2000aa060 msgr2=0x7fb20014c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:04.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.236+0000 7fb1fed9d700 1 --2- 172.21.15.1:0/200386757 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2000aa060 0x7fb20014c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:37:04.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.236+0000 7fb1fed9d700 1 -- 172.21.15.1:0/200386757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f0009ae0 con 0x7fb200154150 2023-11-15T02:37:04.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.236+0000 7fb1fed9d700 1 --2- 172.21.15.1:0/200386757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb200154150 0x7fb2000af200 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7fb200062af0 tx=0x7fb1f0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:04.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.236+0000 7fb1f67fc700 1 -- 172.21.15.1:0/200386757 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0007080 con 0x7fb200154150 2023-11-15T02:37:04.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.236+0000 7fb1f67fc700 1 -- 172.21.15.1:0/200386757 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f00092e0 con 0x7fb200154150 2023-11-15T02:37:04.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.236+0000 7fb204f19700 1 -- 172.21.15.1:0/200386757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2000ae720 con 0x7fb200154150 2023-11-15T02:37:04.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.236+0000 7fb1f67fc700 1 -- 172.21.15.1:0/200386757 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f001e680 con 0x7fb200154150 2023-11-15T02:37:04.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.236+0000 7fb204f19700 1 -- 172.21.15.1:0/200386757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2000aece0 con 0x7fb200154150 2023-11-15T02:37:04.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.237+0000 7fb204f19700 1 -- 172.21.15.1:0/200386757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2000aef00 con 0x7fb200154150 2023-11-15T02:37:04.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.237+0000 7fb1f67fc700 1 -- 172.21.15.1:0/200386757 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb1f0003040 con 0x7fb200154150 2023-11-15T02:37:04.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.238+0000 7fb1f67fc700 1 --2- 172.21.15.1:0/200386757 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1e005f270 0x7fb1e0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:04.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.238+0000 7fb1f67fc700 1 -- 172.21.15.1:0/200386757 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb1f007b910 con 0x7fb200154150 2023-11-15T02:37:04.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.238+0000 7fb1fe59c700 1 --2- 172.21.15.1:0/200386757 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1e005f270 0x7fb1e0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:04.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.238+0000 7fb1fe59c700 1 --2- 172.21.15.1:0/200386757 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1e005f270 0x7fb1e0061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb1f800b850 tx=0x7fb1f8008040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:04.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.242+0000 7fb1f67fc700 1 -- 172.21.15.1:0/200386757 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb1f004ca40 con 0x7fb200154150 2023-11-15T02:37:04.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:04.482+0000 7fb204f19700 1 -- 172.21.15.1:0/200386757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7fb20006c7e0 con 0x7fb200154150 2023-11-15T02:37:05.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.088+0000 7fb1f67fc700 1 -- 172.21.15.1:0/200386757 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2434) v1 ==== 168+0+0 (secure 0 0 0) 0x7fb1f0023020 con 0x7fb200154150 2023-11-15T02:37:05.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.090+0000 7fb204f19700 1 -- 172.21.15.1:0/200386757 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1e005f270 msgr2=0x7fb1e0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:05.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.090+0000 7fb204f19700 1 --2- 172.21.15.1:0/200386757 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1e005f270 0x7fb1e0061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb1f800b850 tx=0x7fb1f8008040).stop 2023-11-15T02:37:05.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.090+0000 7fb204f19700 1 -- 172.21.15.1:0/200386757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb200154150 msgr2=0x7fb2000af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:05.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.090+0000 7fb204f19700 1 --2- 172.21.15.1:0/200386757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb200154150 0x7fb2000af200 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7fb200062af0 tx=0x7fb1f0009840).stop 2023-11-15T02:37:05.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.090+0000 7fb204f19700 1 -- 172.21.15.1:0/200386757 shutdown_connections 2023-11-15T02:37:05.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.090+0000 7fb204f19700 1 --2- 172.21.15.1:0/200386757 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1e005f270 0x7fb1e0061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.090+0000 7fb204f19700 1 --2- 172.21.15.1:0/200386757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb200154150 0x7fb2000af200 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.090+0000 7fb204f19700 1 --2- 172.21.15.1:0/200386757 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2000aa060 0x7fb20014c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:37:05.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.090+0000 7fb204f19700 1 --2- 172.21.15.1:0/200386757 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2000ab1a0 0x7fb2001554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:37:05.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.090+0000 7fb204f19700 1 -- 172.21.15.1:0/200386757 >> 172.21.15.1:0/200386757 conn(0x7fb200064aa0 msgr2=0x7fb200158070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:05.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.090+0000 7fb204f19700 1 -- 172.21.15.1:0/200386757 shutdown_connections 2023-11-15T02:37:05.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.090+0000 7fb204f19700 1 -- 172.21.15.1:0/200386757 wait complete. 2023-11-15T02:37:05.106 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-15T02:37:05.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.229+0000 7fb8b75fa700 1 Processor -- start 2023-11-15T02:37:05.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.229+0000 7fb8b75fa700 1 -- start start 2023-11-15T02:37:05.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.230+0000 7fb8b75fa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b014ebd0 0x7fb8b0137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:05.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.230+0000 7fb8b75fa700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b0154ce0 con 0x7fb8b0137030 2023-11-15T02:37:05.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.230+0000 7fb8b75fa700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b0154fc0 con 0x7fb8b0066f80 2023-11-15T02:37:05.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.230+0000 7fb8b75fa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0137900 con 0x7fb8b014ebd0 2023-11-15T02:37:05.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.230+0000 7fb8b5396700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb8b0137030 0x7fb8b0066870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:53910/0 (socket says 172.21.15.1:53910) 2023-11-15T02:37:05.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.230+0000 7fb8b5396700 1 -- 172.21.15.1:0/433493492 learned_addr learned my addr 172.21.15.1:0/433493492 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:05.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8b5b97700 1 --2- 172.21.15.1:0/433493492 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b014ebd0 0x7fb8b0137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:05.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8affff700 1 -- 172.21.15.1:0/433493492 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388957254 0 0) 0x7fb8b0154ce0 con 0x7fb8b0137030 2023-11-15T02:37:05.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8affff700 1 -- 172.21.15.1:0/433493492 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8980033f0 con 0x7fb8b0137030 2023-11-15T02:37:05.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8affff700 1 -- 172.21.15.1:0/433493492 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2961042051 0 0) 0x7fb8980033f0 con 0x7fb8b0137030 2023-11-15T02:37:05.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8affff700 1 -- 172.21.15.1:0/433493492 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b014ebd0 msgr2=0x7fb8b0137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:05.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8affff700 1 --2- 172.21.15.1:0/433493492 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b014ebd0 0x7fb8b0137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8affff700 1 -- 172.21.15.1:0/433493492 >> v1:172.21.15.141:6789/0 conn(0x7fb8b0066f80 legacy=0x7fb8b014e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:05.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8affff700 1 -- 172.21.15.1:0/433493492 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b01552a0 con 0x7fb8b0137030 2023-11-15T02:37:05.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8affff700 1 -- 172.21.15.1:0/433493492 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fb8a00017f0 con 0x7fb8b0137030 2023-11-15T02:37:05.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8affff700 1 -- 172.21.15.1:0/433493492 >> v1:172.21.15.1:6789/0 conn(0x7fb8b0137030 legacy=0x7fb8b0066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:05.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8affff700 1 --2- 172.21.15.1:0/433493492 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b014ebd0 0x7fb898003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:05.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8affff700 1 --2- 172.21.15.1:0/433493492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb898003e00 0x7fb898004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:05.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8affff700 1 --2- 172.21.15.1:0/433493492 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb898004b80 0x7fb898005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:05.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8affff700 1 -- 172.21.15.1:0/433493492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0137900 con 0x7fb898003e00 2023-11-15T02:37:05.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8affff700 1 -- 172.21.15.1:0/433493492 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89800b8e0 con 0x7fb898004b80 2023-11-15T02:37:05.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8affff700 1 -- 172.21.15.1:0/433493492 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89800baa0 con 0x7fb8b014ebd0 2023-11-15T02:37:05.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8b4b95700 1 --2- 172.21.15.1:0/433493492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb898003e00 0x7fb898004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:05.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8b5396700 1 --2- 172.21.15.1:0/433493492 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b014ebd0 0x7fb898003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:05.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.231+0000 7fb8b5b97700 1 --2- 172.21.15.1:0/433493492 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb898004b80 0x7fb898005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:05.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.232+0000 7fb8b4b95700 1 -- 172.21.15.1:0/433493492 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b014ebd0 msgr2=0x7fb898003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:05.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.232+0000 7fb8b4b95700 1 --2- 172.21.15.1:0/433493492 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b014ebd0 0x7fb898003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.232+0000 7fb8b4b95700 1 -- 172.21.15.1:0/433493492 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb898004b80 msgr2=0x7fb898005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:05.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.232+0000 7fb8b4b95700 1 --2- 172.21.15.1:0/433493492 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb898004b80 0x7fb898005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.232+0000 7fb8b4b95700 1 -- 172.21.15.1:0/433493492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8980033f0 con 0x7fb898003e00 2023-11-15T02:37:05.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.232+0000 7fb8b5396700 1 --2- 172.21.15.1:0/433493492 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b014ebd0 0x7fb898003910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:37:05.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.232+0000 7fb8b4b95700 1 --2- 172.21.15.1:0/433493492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb898003e00 0x7fb898004690 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7fb8b0152520 tx=0x7fb8a4007b90).ready entity=mon.0 client_cookie=95678ac12bf1853b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:05.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.232+0000 7fb8affff700 1 -- 172.21.15.1:0/433493492 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4007ea0 con 0x7fb898003e00 2023-11-15T02:37:05.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.232+0000 7fb8affff700 1 -- 172.21.15.1:0/433493492 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a4012400 con 0x7fb898003e00 2023-11-15T02:37:05.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.232+0000 7fb8affff700 1 -- 172.21.15.1:0/433493492 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a40127a0 con 0x7fb898003e00 2023-11-15T02:37:05.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.232+0000 7fb8b75fa700 1 -- 172.21.15.1:0/433493492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb898003e00 msgr2=0x7fb898004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:05.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.232+0000 7fb8b75fa700 1 --2- 172.21.15.1:0/433493492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb898003e00 0x7fb898004690 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7fb8b0152520 tx=0x7fb8a4007b90).stop 2023-11-15T02:37:05.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.232+0000 7fb8b5b97700 1 -- 172.21.15.1:0/433493492 reap_dead start 2023-11-15T02:37:05.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.232+0000 7fb8b75fa700 1 -- 172.21.15.1:0/433493492 shutdown_connections 2023-11-15T02:37:05.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.232+0000 7fb8b75fa700 1 -- 172.21.15.1:0/433493492 >> 172.21.15.1:0/433493492 conn(0x7fb8b0063280 msgr2=0x7fb8b00c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:05.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.233+0000 7fb8b75fa700 1 -- 172.21.15.1:0/433493492 shutdown_connections 2023-11-15T02:37:05.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.233+0000 7fb8b75fa700 1 -- 172.21.15.1:0/433493492 wait complete. 2023-11-15T02:37:05.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.234+0000 7fb8b75fa700 1 Processor -- start 2023-11-15T02:37:05.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.234+0000 7fb8b75fa700 1 -- start start 2023-11-15T02:37:05.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b75fa700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb898003e00 0x7fb8b01509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:05.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b75fa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b0150ee0 0x7fb8b0167940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:05.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b75fa700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8b0167e30 0x7fb8b01669c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:05.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b75fa700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0151990 con 0x7fb898003e00 2023-11-15T02:37:05.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b75fa700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00ac800 con 0x7fb8b0167e30 2023-11-15T02:37:05.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b75fa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0168290 con 0x7fb8b0150ee0 2023-11-15T02:37:05.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b5396700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb898003e00 0x7fb8b01509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:05.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b5396700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb898003e00 0x7fb8b01509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41508/0 (socket says 172.21.15.1:41508) 2023-11-15T02:37:05.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b5396700 1 -- 172.21.15.1:0/244030491 learned_addr learned my addr 172.21.15.1:0/244030491 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:05.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b5b97700 1 --2- 172.21.15.1:0/244030491 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8b0167e30 0x7fb8b01669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:05.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b4b95700 1 --2- 172.21.15.1:0/244030491 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b0150ee0 0x7fb8b0167940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:05.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b5396700 1 -- 172.21.15.1:0/244030491 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b0150ee0 msgr2=0x7fb8b0167940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:05.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b5396700 1 --2- 172.21.15.1:0/244030491 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b0150ee0 0x7fb8b0167940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b5396700 1 -- 172.21.15.1:0/244030491 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8b0167e30 msgr2=0x7fb8b01669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:05.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b5396700 1 --2- 172.21.15.1:0/244030491 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8b0167e30 0x7fb8b01669c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b5396700 1 -- 172.21.15.1:0/244030491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b01513d0 con 0x7fb898003e00 2023-11-15T02:37:05.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b4b95700 1 --2- 172.21.15.1:0/244030491 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b0150ee0 0x7fb8b0167940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:05.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b5396700 1 --2- 172.21.15.1:0/244030491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb898003e00 0x7fb8b01509f0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7fb8a0007710 tx=0x7fb8a0001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:05.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8ad7fa700 1 -- 172.21.15.1:0/244030491 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a000c990 con 0x7fb898003e00 2023-11-15T02:37:05.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8ad7fa700 1 -- 172.21.15.1:0/244030491 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a000caf0 con 0x7fb898003e00 2023-11-15T02:37:05.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b75fa700 1 -- 172.21.15.1:0/244030491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b01516b0 con 0x7fb898003e00 2023-11-15T02:37:05.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8ad7fa700 1 -- 172.21.15.1:0/244030491 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a000ce90 con 0x7fb898003e00 2023-11-15T02:37:05.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.235+0000 7fb8b75fa700 1 -- 172.21.15.1:0/244030491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b014e110 con 0x7fb898003e00 2023-11-15T02:37:05.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.236+0000 7fb8b75fa700 1 -- 172.21.15.1:0/244030491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b00ac2f0 con 0x7fb898003e00 2023-11-15T02:37:05.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.237+0000 7fb8ad7fa700 1 -- 172.21.15.1:0/244030491 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb8a0012560 con 0x7fb898003e00 2023-11-15T02:37:05.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.237+0000 7fb8ad7fa700 1 --2- 172.21.15.1:0/244030491 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb89c05f270 0x7fb89c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:05.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.237+0000 7fb8ad7fa700 1 -- 172.21.15.1:0/244030491 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb8a007a360 con 0x7fb898003e00 2023-11-15T02:37:05.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.238+0000 7fb8b4b95700 1 --2- 172.21.15.1:0/244030491 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb89c05f270 0x7fb89c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:05.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.238+0000 7fb8b4b95700 1 --2- 172.21.15.1:0/244030491 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb89c05f270 0x7fb89c061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fb8b00ac240 tx=0x7fb8a4017000).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:05.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.241+0000 7fb8ad7fa700 1 -- 172.21.15.1:0/244030491 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb8a004aaf0 con 0x7fb898003e00 2023-11-15T02:37:05.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.413+0000 7fb8b75fa700 1 -- 172.21.15.1:0/244030491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb8b0152340 con 0x7fb898003e00 2023-11-15T02:37:05.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.417+0000 7fb8ad7fa700 1 -- 172.21.15.1:0/244030491 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb8b00ac2f0 con 0x7fb898003e00 2023-11-15T02:37:05.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.418+0000 7fb8b75fa700 1 -- 172.21.15.1:0/244030491 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb89c05f270 msgr2=0x7fb89c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:05.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.419+0000 7fb8b75fa700 1 --2- 172.21.15.1:0/244030491 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb89c05f270 0x7fb89c061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fb8b00ac240 tx=0x7fb8a4017000).stop 2023-11-15T02:37:05.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.419+0000 7fb8b75fa700 1 -- 172.21.15.1:0/244030491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb898003e00 msgr2=0x7fb8b01509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:05.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.419+0000 7fb8b75fa700 1 --2- 172.21.15.1:0/244030491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb898003e00 0x7fb8b01509f0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7fb8a0007710 tx=0x7fb8a0001d90).stop 2023-11-15T02:37:05.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.419+0000 7fb8b75fa700 1 -- 172.21.15.1:0/244030491 shutdown_connections 2023-11-15T02:37:05.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.419+0000 7fb8b75fa700 1 --2- 172.21.15.1:0/244030491 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb89c05f270 0x7fb89c061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.419+0000 7fb8b75fa700 1 --2- 172.21.15.1:0/244030491 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8b0167e30 0x7fb8b01669c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.419+0000 7fb8b75fa700 1 --2- 172.21.15.1:0/244030491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb898003e00 0x7fb8b01509f0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.419+0000 7fb8b75fa700 1 --2- 172.21.15.1:0/244030491 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b0150ee0 0x7fb8b0167940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.419+0000 7fb8b75fa700 1 -- 172.21.15.1:0/244030491 >> 172.21.15.1:0/244030491 conn(0x7fb8b0063280 msgr2=0x7fb8b0063aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:05.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.419+0000 7fb8b75fa700 1 -- 172.21.15.1:0/244030491 shutdown_connections 2023-11-15T02:37:05.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.419+0000 7fb8b75fa700 1 -- 172.21.15.1:0/244030491 wait complete. 2023-11-15T02:37:05.432 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T02:37:05.433 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:37:05.471 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:37:05.523 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T02:37:05.524 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-15T02:37:05.524 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:37:05.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.640+0000 7fce0b6e2700 1 Processor -- start 2023-11-15T02:37:05.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.641+0000 7fce0b6e2700 1 -- start start 2023-11-15T02:37:05.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.641+0000 7fce0b6e2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce04154680 0x7fce04069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:05.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.641+0000 7fce0b6e2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce040bccd0 0x7fce040bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:05.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.641+0000 7fce0b6e2700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce040c3360 con 0x7fce040627b0 2023-11-15T02:37:05.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.641+0000 7fce0b6e2700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce040bd620 con 0x7fce040bccd0 2023-11-15T02:37:05.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.641+0000 7fce0b6e2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce040c2750 con 0x7fce04154680 2023-11-15T02:37:05.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.642+0000 7fce08c7d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce040bccd0 0x7fce040bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:05.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.642+0000 7fce08c7d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce040bccd0 0x7fce040bd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41518/0 (socket says 172.21.15.1:41518) 2023-11-15T02:37:05.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.642+0000 7fce08c7d700 1 -- 172.21.15.1:0/3201042141 learned_addr learned my addr 172.21.15.1:0/3201042141 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:05.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.642+0000 7fce0947e700 1 --2- 172.21.15.1:0/3201042141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce04154680 0x7fce04069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:05.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.642+0000 7fce08c7d700 1 -- 172.21.15.1:0/3201042141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce04154680 msgr2=0x7fce04069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:05.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.642+0000 7fce08c7d700 1 --2- 172.21.15.1:0/3201042141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce04154680 0x7fce04069fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.642+0000 7fce08c7d700 1 -- 172.21.15.1:0/3201042141 >> v1:172.21.15.141:6789/0 conn(0x7fce040627b0 legacy=0x7fce04062c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:05.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.642+0000 7fce08c7d700 1 -- 172.21.15.1:0/3201042141 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce040c2a30 con 0x7fce040bccd0 2023-11-15T02:37:05.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.642+0000 7fce0947e700 1 --2- 172.21.15.1:0/3201042141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce04154680 0x7fce04069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:05.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.642+0000 7fce08c7d700 1 --2- 172.21.15.1:0/3201042141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce040bccd0 0x7fce040bd130 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7fcdf8006fd0 tx=0x7fcdf80090f0).ready entity=mon.0 client_cookie=d9b1c7bc669ca1c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:05.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.642+0000 7fce03fff700 1 -- 172.21.15.1:0/3201042141 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800b600 con 0x7fce040bccd0 2023-11-15T02:37:05.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.642+0000 7fce03fff700 1 -- 172.21.15.1:0/3201042141 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf800b760 con 0x7fce040bccd0 2023-11-15T02:37:05.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.642+0000 7fce03fff700 1 -- 172.21.15.1:0/3201042141 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800bae0 con 0x7fce040bccd0 2023-11-15T02:37:05.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.643+0000 7fce0b6e2700 1 -- 172.21.15.1:0/3201042141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce040bccd0 msgr2=0x7fce040bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:05.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.643+0000 7fce0b6e2700 1 --2- 172.21.15.1:0/3201042141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce040bccd0 0x7fce040bd130 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7fcdf8006fd0 tx=0x7fcdf80090f0).stop 2023-11-15T02:37:05.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.643+0000 7fce0b6e2700 1 -- 172.21.15.1:0/3201042141 shutdown_connections 2023-11-15T02:37:05.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.643+0000 7fce0b6e2700 1 --2- 172.21.15.1:0/3201042141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce04154680 0x7fce04069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.643+0000 7fce0b6e2700 1 --2- 172.21.15.1:0/3201042141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce040bccd0 0x7fce040bd130 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.643+0000 7fce0b6e2700 1 -- 172.21.15.1:0/3201042141 >> 172.21.15.1:0/3201042141 conn(0x7fce040c7d70 msgr2=0x7fce040c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:05.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.643+0000 7fce0b6e2700 1 -- 172.21.15.1:0/3201042141 shutdown_connections 2023-11-15T02:37:05.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.643+0000 7fce0b6e2700 1 -- 172.21.15.1:0/3201042141 wait complete. 2023-11-15T02:37:05.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.644+0000 7fce0b6e2700 1 Processor -- start 2023-11-15T02:37:05.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.644+0000 7fce0b6e2700 1 -- start start 2023-11-15T02:37:05.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce0b6e2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce040627b0 0x7fce0414a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:05.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce0b6e2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce040bccd0 0x7fce040a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:05.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce0b6e2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce04154680 0x7fce04158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:05.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce0b6e2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce040c0030 con 0x7fce040627b0 2023-11-15T02:37:05.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce0b6e2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce040c0bb0 con 0x7fce04154680 2023-11-15T02:37:05.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce0b6e2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce040c0280 con 0x7fce040bccd0 2023-11-15T02:37:05.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce0947e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce040627b0 0x7fce0414a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:05.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce0947e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce040627b0 0x7fce0414a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41528/0 (socket says 172.21.15.1:41528) 2023-11-15T02:37:05.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce0947e700 1 -- 172.21.15.1:0/2800474891 learned_addr learned my addr 172.21.15.1:0/2800474891 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:05.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce08c7d700 1 --2- 172.21.15.1:0/2800474891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce040bccd0 0x7fce040a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:05.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce09c7f700 1 --2- 172.21.15.1:0/2800474891 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce04154680 0x7fce04158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:05.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce0947e700 1 -- 172.21.15.1:0/2800474891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce040bccd0 msgr2=0x7fce040a6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:05.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce0947e700 1 --2- 172.21.15.1:0/2800474891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce040bccd0 0x7fce040a6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce0947e700 1 -- 172.21.15.1:0/2800474891 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce04154680 msgr2=0x7fce04158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:05.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce0947e700 1 --2- 172.21.15.1:0/2800474891 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce04154680 0x7fce04158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce0947e700 1 -- 172.21.15.1:0/2800474891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf8009370 con 0x7fce040627b0 2023-11-15T02:37:05.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.645+0000 7fce0947e700 1 --2- 172.21.15.1:0/2800474891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce040627b0 0x7fce0414a3b0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fcdf400c880 tx=0x7fcdf4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:05.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.646+0000 7fce017fa700 1 -- 172.21.15.1:0/2800474891 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4010580 con 0x7fce040627b0 2023-11-15T02:37:05.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.646+0000 7fce017fa700 1 -- 172.21.15.1:0/2800474891 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40106e0 con 0x7fce040627b0 2023-11-15T02:37:05.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.646+0000 7fce0b6e2700 1 -- 172.21.15.1:0/2800474891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce040c0560 con 0x7fce040627b0 2023-11-15T02:37:05.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.646+0000 7fce017fa700 1 -- 172.21.15.1:0/2800474891 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4010a60 con 0x7fce040627b0 2023-11-15T02:37:05.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.646+0000 7fce0b6e2700 1 -- 172.21.15.1:0/2800474891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0414a8a0 con 0x7fce040627b0 2023-11-15T02:37:05.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.647+0000 7fce0b6e2700 1 -- 172.21.15.1:0/2800474891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce04157d00 con 0x7fce040627b0 2023-11-15T02:37:05.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.647+0000 7fce017fa700 1 -- 172.21.15.1:0/2800474891 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcdf401b460 con 0x7fce040627b0 2023-11-15T02:37:05.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.647+0000 7fce017fa700 1 --2- 172.21.15.1:0/2800474891 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcdf005f270 0x7fcdf0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:05.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.648+0000 7fce017fa700 1 -- 172.21.15.1:0/2800474891 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcdf407a270 con 0x7fce040627b0 2023-11-15T02:37:05.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.648+0000 7fce08c7d700 1 --2- 172.21.15.1:0/2800474891 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcdf005f270 0x7fcdf0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:05.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.648+0000 7fce08c7d700 1 --2- 172.21.15.1:0/2800474891 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcdf005f270 0x7fcdf0061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fcdf8006fd0 tx=0x7fcdf8017000).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:05.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.652+0000 7fce017fa700 1 -- 172.21.15.1:0/2800474891 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcdf404b290 con 0x7fce040627b0 2023-11-15T02:37:05.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.869+0000 7fce0b6e2700 1 -- 172.21.15.1:0/2800474891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce0406c7e0 con 0x7fce040627b0 2023-11-15T02:37:05.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.869+0000 7fce017fa700 1 -- 172.21.15.1:0/2800474891 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fcdf404e8b0 con 0x7fce040627b0 2023-11-15T02:37:05.871 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:37:05.872 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":73,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7019,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3898250637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3898250637},{"type":"v1","addr":"172.21.15.141:6836","nonce":3898250637}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7022,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3709207600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3709207600},{"type":"v1","addr":"172.21.15.141:6837","nonce":3709207600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1212884558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":1212884558},{"type":"v1","addr":"172.21.15.1:6835","nonce":1212884558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8985,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/939610327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":939610327},{"type":"v1","addr":"172.21.15.1:6834","nonce":939610327}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[]} 2023-11-15T02:37:05.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.871+0000 7fce0b6e2700 1 -- 172.21.15.1:0/2800474891 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcdf005f270 msgr2=0x7fcdf0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:05.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.871+0000 7fce0b6e2700 1 --2- 172.21.15.1:0/2800474891 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcdf005f270 0x7fcdf0061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fcdf8006fd0 tx=0x7fcdf8017000).stop 2023-11-15T02:37:05.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.871+0000 7fce0b6e2700 1 -- 172.21.15.1:0/2800474891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce040627b0 msgr2=0x7fce0414a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:05.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.871+0000 7fce0b6e2700 1 --2- 172.21.15.1:0/2800474891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce040627b0 0x7fce0414a3b0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fcdf400c880 tx=0x7fcdf4008040).stop 2023-11-15T02:37:05.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.871+0000 7fce0b6e2700 1 -- 172.21.15.1:0/2800474891 shutdown_connections 2023-11-15T02:37:05.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.871+0000 7fce0b6e2700 1 --2- 172.21.15.1:0/2800474891 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcdf005f270 0x7fcdf0061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.871+0000 7fce0b6e2700 1 --2- 172.21.15.1:0/2800474891 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce04154680 0x7fce04158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.871+0000 7fce0b6e2700 1 --2- 172.21.15.1:0/2800474891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce040627b0 0x7fce0414a3b0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.871+0000 7fce0b6e2700 1 --2- 172.21.15.1:0/2800474891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce040bccd0 0x7fce040a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:05.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.871+0000 7fce0b6e2700 1 -- 172.21.15.1:0/2800474891 >> 172.21.15.1:0/2800474891 conn(0x7fce040c7d70 msgr2=0x7fce04066c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:05.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.871+0000 7fce0b6e2700 1 -- 172.21.15.1:0/2800474891 shutdown_connections 2023-11-15T02:37:05.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:05.871+0000 7fce0b6e2700 1 -- 172.21.15.1:0/2800474891 wait complete. 2023-11-15T02:37:05.875 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 73 2023-11-15T02:37:05.885 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-15T02:37:05.885 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-15T02:37:05.886 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-15T02:37:05.886 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:37:05.886 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-15T02:37:05.886 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-15T02:37:05.887 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-15T02:37:05.887 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:37:05.887 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-15T02:37:05.887 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-15T02:37:05.888 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-15T02:37:05.888 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:37:05.888 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-15T02:37:05.889 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-15T02:37:05.889 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-15T02:37:05.889 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:37:05.894 INFO:tasks.ceph.mds.a:Stopped 2023-11-15T02:37:05.894 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-15T02:37:05.896 INFO:tasks.ceph.mds.c:Stopped 2023-11-15T02:37:05.896 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-15T02:37:05.899 INFO:tasks.ceph.mds.b:Stopped 2023-11-15T02:37:05.899 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-15T02:37:05.900 INFO:tasks.ceph.mds.d:Stopped 2023-11-15T02:37:05.900 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-15T02:37:05.937 INFO:tasks.ceph.mds.a:Started 2023-11-15T02:37:05.938 DEBUG:teuthology.parallel:result is None 2023-11-15T02:37:05.939 INFO:tasks.ceph.mds.c:Started 2023-11-15T02:37:05.939 DEBUG:teuthology.parallel:result is None 2023-11-15T02:37:05.941 INFO:tasks.ceph.mds.b:Started 2023-11-15T02:37:05.942 DEBUG:teuthology.parallel:result is None 2023-11-15T02:37:05.942 INFO:tasks.ceph.mds.d:Started 2023-11-15T02:37:05.943 DEBUG:teuthology.parallel:result is None 2023-11-15T02:37:05.943 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-15T02:37:06.013 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-11-15T02:37:06.013 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T02:37:06.022 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-15T02:37:06.024 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T02:37:06.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.070+0000 7f0b0d666700 1 Processor -- start 2023-11-15T02:37:06.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.070+0000 7f0b0d666700 1 -- start start 2023-11-15T02:37:06.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.071+0000 7f0b0d666700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0b080c8390 0x7f0b0814e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:06.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.071+0000 7f0b0d666700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0b080c12e0 0x7f0b0814e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:06.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.071+0000 7f0b0d666700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b081559e0 con 0x7f0b080ca9b0 2023-11-15T02:37:06.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.071+0000 7f0b0d666700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b080c7560 con 0x7f0b080c12e0 2023-11-15T02:37:06.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.071+0000 7f0b0d666700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b08154dd0 con 0x7f0b080c8390 2023-11-15T02:37:06.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.071+0000 7f0b077fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0b080c12e0 0x7f0b0814e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:06.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.071+0000 7f0b077fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0b080c12e0 0x7f0b0814e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41602/0 (socket says 172.21.15.1:41602) 2023-11-15T02:37:06.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.071+0000 7f0b077fe700 1 -- 172.21.15.1:0/1533111376 learned_addr learned my addr 172.21.15.1:0/1533111376 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:06.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.071+0000 7f0b067fc700 1 --2- 172.21.15.1:0/1533111376 >> v2:172.21.15.141:3300/0 conn(0x7f0b080c8390 0x7f0b0814e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:06.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.071+0000 7f0b077fe700 1 -- 172.21.15.1:0/1533111376 >> v2:172.21.15.141:3300/0 conn(0x7f0b080c8390 msgr2=0x7f0b0814e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:06.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.071+0000 7f0b077fe700 1 --2- 172.21.15.1:0/1533111376 >> v2:172.21.15.141:3300/0 conn(0x7f0b080c8390 0x7f0b0814e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:06.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.071+0000 7f0b077fe700 1 -- 172.21.15.1:0/1533111376 >> v1:172.21.15.141:6789/0 conn(0x7f0b080ca9b0 legacy=0x7f0b080c0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:06.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.071+0000 7f0b077fe700 1 -- 172.21.15.1:0/1533111376 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b081550b0 con 0x7f0b080c12e0 2023-11-15T02:37:06.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.071+0000 7f0b077fe700 1 --2- 172.21.15.1:0/1533111376 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b080c12e0 0x7f0b0814e8c0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f0b08157f80 tx=0x7f0af80090f0).ready entity=mon.0 client_cookie=1446c39d928e7a7a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:06.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.072+0000 7f0b05ffb700 1 -- 172.21.15.1:0/1533111376 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af800b520 con 0x7f0b080c12e0 2023-11-15T02:37:06.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.072+0000 7f0b05ffb700 1 -- 172.21.15.1:0/1533111376 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af800b680 con 0x7f0b080c12e0 2023-11-15T02:37:06.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.072+0000 7f0b05ffb700 1 -- 172.21.15.1:0/1533111376 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af800ba00 con 0x7f0b080c12e0 2023-11-15T02:37:06.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.072+0000 7f0b0d666700 1 -- 172.21.15.1:0/1533111376 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b080c12e0 msgr2=0x7f0b0814e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:06.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.072+0000 7f0b0d666700 1 --2- 172.21.15.1:0/1533111376 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b080c12e0 0x7f0b0814e8c0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f0b08157f80 tx=0x7f0af80090f0).stop 2023-11-15T02:37:06.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.072+0000 7f0b0d666700 1 -- 172.21.15.1:0/1533111376 shutdown_connections 2023-11-15T02:37:06.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.072+0000 7f0b0d666700 1 --2- 172.21.15.1:0/1533111376 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b080c12e0 0x7f0b0814e8c0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:06.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.072+0000 7f0b0d666700 1 --2- 172.21.15.1:0/1533111376 >> v2:172.21.15.141:3300/0 conn(0x7f0b080c8390 0x7f0b0814e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:06.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.072+0000 7f0b0d666700 1 -- 172.21.15.1:0/1533111376 >> 172.21.15.1:0/1533111376 conn(0x7f0b08084ec0 msgr2=0x7f0b080947e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:06.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.072+0000 7f0b0d666700 1 -- 172.21.15.1:0/1533111376 shutdown_connections 2023-11-15T02:37:06.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.072+0000 7f0b0d666700 1 -- 172.21.15.1:0/1533111376 wait complete. 2023-11-15T02:37:06.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.073+0000 7f0b0d666700 1 Processor -- start 2023-11-15T02:37:06.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.073+0000 7f0b0d666700 1 -- start start 2023-11-15T02:37:06.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.074+0000 7f0b0d666700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b080c12e0 0x7f0b080b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:06.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.074+0000 7f0b0d666700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b080c8390 0x7f0b08150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:06.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.074+0000 7f0b0d666700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b080ca9b0 0x7f0b080aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:06.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.074+0000 7f0b0d666700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b08151490 con 0x7f0b080c8390 2023-11-15T02:37:06.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.074+0000 7f0b0d666700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b080af8a0 con 0x7f0b080c12e0 2023-11-15T02:37:06.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.074+0000 7f0b0d666700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b080c35e0 con 0x7f0b080ca9b0 2023-11-15T02:37:06.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.074+0000 7f0b067fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b080c8390 0x7f0b08150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:06.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.074+0000 7f0b067fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b080c8390 0x7f0b08150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41610/0 (socket says 172.21.15.1:41610) 2023-11-15T02:37:06.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.074+0000 7f0b06ffd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b080c12e0 0x7f0b080b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:06.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.074+0000 7f0b067fc700 1 -- 172.21.15.1:0/3384970717 learned_addr learned my addr 172.21.15.1:0/3384970717 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:06.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.074+0000 7f0b077fe700 1 --2- 172.21.15.1:0/3384970717 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b080ca9b0 0x7f0b080aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:06.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.075+0000 7f0b067fc700 1 -- 172.21.15.1:0/3384970717 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b080ca9b0 msgr2=0x7f0b080aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:06.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.075+0000 7f0b067fc700 1 --2- 172.21.15.1:0/3384970717 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b080ca9b0 0x7f0b080aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:06.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.075+0000 7f0b067fc700 1 -- 172.21.15.1:0/3384970717 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b080c12e0 msgr2=0x7f0b080b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:06.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.075+0000 7f0b067fc700 1 --2- 172.21.15.1:0/3384970717 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b080c12e0 0x7f0b080b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:06.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.075+0000 7f0b067fc700 1 -- 172.21.15.1:0/3384970717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af8009370 con 0x7f0b080c8390 2023-11-15T02:37:06.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.075+0000 7f0b06ffd700 1 --2- 172.21.15.1:0/3384970717 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b080c12e0 0x7f0b080b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:37:06.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.075+0000 7f0b067fc700 1 --2- 172.21.15.1:0/3384970717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b080c8390 0x7f0b08150fa0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f0af000e950 tx=0x7f0af0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:06.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.075+0000 7f0afeffd700 1 -- 172.21.15.1:0/3384970717 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0009530 con 0x7f0b080c8390 2023-11-15T02:37:06.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.075+0000 7f0afeffd700 1 -- 172.21.15.1:0/3384970717 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af0012600 con 0x7f0b080c8390 2023-11-15T02:37:06.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.075+0000 7f0b0d666700 1 -- 172.21.15.1:0/3384970717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b080af2e0 con 0x7f0b080c8390 2023-11-15T02:37:06.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.075+0000 7f0afeffd700 1 -- 172.21.15.1:0/3384970717 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0012980 con 0x7f0b080c8390 2023-11-15T02:37:06.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.075+0000 7f0b0d666700 1 -- 172.21.15.1:0/3384970717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b080c3270 con 0x7f0b080c8390 2023-11-15T02:37:06.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.076+0000 7f0b0d666700 1 -- 172.21.15.1:0/3384970717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b080475e0 con 0x7f0b080c8390 2023-11-15T02:37:06.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.076+0000 7f0afeffd700 1 -- 172.21.15.1:0/3384970717 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0af0012d30 con 0x7f0b080c8390 2023-11-15T02:37:06.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.077+0000 7f0afeffd700 1 --2- 172.21.15.1:0/3384970717 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ae805f270 0x7f0ae8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:06.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.077+0000 7f0afeffd700 1 -- 172.21.15.1:0/3384970717 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0af007a9a0 con 0x7f0b080c8390 2023-11-15T02:37:06.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.077+0000 7f0b06ffd700 1 --2- 172.21.15.1:0/3384970717 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ae805f270 0x7f0ae8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:06.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.077+0000 7f0b06ffd700 1 --2- 172.21.15.1:0/3384970717 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ae805f270 0x7f0ae8061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0b08098a10 tx=0x7f0b00009040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:06.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.081+0000 7f0afeffd700 1 -- 172.21.15.1:0/3384970717 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0af004ba20 con 0x7f0b080c8390 2023-11-15T02:37:06.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:06.274+0000 7f0b0d666700 1 -- 172.21.15.1:0/3384970717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0b080c3720 con 0x7f0b080c8390 2023-11-15T02:37:07.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.094+0000 7f0afeffd700 1 -- 172.21.15.1:0/3384970717 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v173) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0af004f040 con 0x7f0b080c8390 2023-11-15T02:37:07.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.096+0000 7f0b0d666700 1 -- 172.21.15.1:0/3384970717 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ae805f270 msgr2=0x7f0ae8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.096+0000 7f0b0d666700 1 --2- 172.21.15.1:0/3384970717 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ae805f270 0x7f0ae8061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0b08098a10 tx=0x7f0b00009040).stop 2023-11-15T02:37:07.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.096+0000 7f0b0d666700 1 -- 172.21.15.1:0/3384970717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b080c8390 msgr2=0x7f0b08150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.096+0000 7f0b0d666700 1 --2- 172.21.15.1:0/3384970717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b080c8390 0x7f0b08150fa0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f0af000e950 tx=0x7f0af0009060).stop 2023-11-15T02:37:07.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.096+0000 7f0b0d666700 1 -- 172.21.15.1:0/3384970717 shutdown_connections 2023-11-15T02:37:07.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.096+0000 7f0b0d666700 1 --2- 172.21.15.1:0/3384970717 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0ae805f270 0x7f0ae8061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.096+0000 7f0b0d666700 1 --2- 172.21.15.1:0/3384970717 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b080ca9b0 0x7f0b080aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.096+0000 7f0b0d666700 1 --2- 172.21.15.1:0/3384970717 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b080c12e0 0x7f0b080b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.096+0000 7f0b0d666700 1 --2- 172.21.15.1:0/3384970717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b080c8390 0x7f0b08150fa0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.096+0000 7f0b0d666700 1 -- 172.21.15.1:0/3384970717 >> 172.21.15.1:0/3384970717 conn(0x7f0b08084ec0 msgr2=0x7f0b08151c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.097+0000 7f0b0d666700 1 -- 172.21.15.1:0/3384970717 shutdown_connections 2023-11-15T02:37:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.097+0000 7f0b0d666700 1 -- 172.21.15.1:0/3384970717 wait complete. 2023-11-15T02:37:07.101 INFO:teuthology.orchestra.run.smithi001.stderr: removed all blocklist entries 2023-11-15T02:37:07.113 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-15T02:37:07.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.236+0000 7f4ebab0e700 1 Processor -- start 2023-11-15T02:37:07.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.236+0000 7f4ebab0e700 1 -- start start 2023-11-15T02:37:07.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.237+0000 7f4ebab0e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4eb4154150 0x7f4eb4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.237+0000 7f4ebab0e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4eb40ab1a0 0x7f4eb4158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.237+0000 7f4ebab0e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4eb40aa060 0x7f4eb40c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.237+0000 7f4ebab0e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb40c06f0 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.237+0000 7f4ebab0e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb40c09d0 con 0x7f4eb4154150 2023-11-15T02:37:07.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.237+0000 7f4ebab0e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb4158820 con 0x7f4eb40aa060 2023-11-15T02:37:07.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.237+0000 7f4eb3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4eb40ab1a0 0x7f4eb4158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.237+0000 7f4eb3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4eb40ab1a0 0x7f4eb4158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41618/0 (socket says 172.21.15.1:41618) 2023-11-15T02:37:07.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.237+0000 7f4eb3fff700 1 -- 172.21.15.1:0/2825972849 learned_addr learned my addr 172.21.15.1:0/2825972849 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:07.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.238+0000 7f4eb88aa700 1 --2- 172.21.15.1:0/2825972849 >> v2:172.21.15.141:3300/0 conn(0x7f4eb4154150 0x7f4eb4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.237+0000 7f4eb90ab700 1 --2- 172.21.15.1:0/2825972849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4eb40aa060 0x7f4eb40c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.238+0000 7f4eb3fff700 1 -- 172.21.15.1:0/2825972849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4eb40aa060 msgr2=0x7f4eb40c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:07.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.238+0000 7f4eb3fff700 1 --2- 172.21.15.1:0/2825972849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4eb40aa060 0x7f4eb40c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.238+0000 7f4eb3fff700 1 -- 172.21.15.1:0/2825972849 >> v2:172.21.15.141:3300/0 conn(0x7f4eb4154150 msgr2=0x7f4eb4154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:07.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.238+0000 7f4eb3fff700 1 --2- 172.21.15.1:0/2825972849 >> v2:172.21.15.141:3300/0 conn(0x7f4eb4154150 0x7f4eb4154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.238+0000 7f4eb3fff700 1 -- 172.21.15.1:0/2825972849 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb4158b00 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.238+0000 7f4eb88aa700 1 --2- 172.21.15.1:0/2825972849 >> v2:172.21.15.141:3300/0 conn(0x7f4eb4154150 0x7f4eb4154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:07.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.238+0000 7f4eb3fff700 1 --2- 172.21.15.1:0/2825972849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb40ab1a0 0x7f4eb4158040 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f4eb406bfb0 tx=0x7f4ea4009840).ready entity=mon.0 client_cookie=bb3b2d22e736c25c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:07.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.238+0000 7f4eb37fe700 1 -- 172.21.15.1:0/2825972849 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea400e070 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.238+0000 7f4eb37fe700 1 -- 172.21.15.1:0/2825972849 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea400ba50 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.238+0000 7f4eb37fe700 1 -- 172.21.15.1:0/2825972849 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea400bdd0 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.238+0000 7f4ebab0e700 1 -- 172.21.15.1:0/2825972849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb40ab1a0 msgr2=0x7f4eb4158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.238+0000 7f4ebab0e700 1 --2- 172.21.15.1:0/2825972849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb40ab1a0 0x7f4eb4158040 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f4eb406bfb0 tx=0x7f4ea4009840).stop 2023-11-15T02:37:07.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.239+0000 7f4ebab0e700 1 -- 172.21.15.1:0/2825972849 shutdown_connections 2023-11-15T02:37:07.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.239+0000 7f4ebab0e700 1 --2- 172.21.15.1:0/2825972849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4eb40aa060 0x7f4eb40c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.239+0000 7f4ebab0e700 1 --2- 172.21.15.1:0/2825972849 >> v2:172.21.15.141:3300/0 conn(0x7f4eb4154150 0x7f4eb4154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.239+0000 7f4ebab0e700 1 --2- 172.21.15.1:0/2825972849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb40ab1a0 0x7f4eb4158040 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.239+0000 7f4ebab0e700 1 -- 172.21.15.1:0/2825972849 >> 172.21.15.1:0/2825972849 conn(0x7f4eb4064aa0 msgr2=0x7f4eb4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:07.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.239+0000 7f4ebab0e700 1 -- 172.21.15.1:0/2825972849 shutdown_connections 2023-11-15T02:37:07.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.239+0000 7f4ebab0e700 1 -- 172.21.15.1:0/2825972849 wait complete. 2023-11-15T02:37:07.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.240+0000 7f4ebab0e700 1 Processor -- start 2023-11-15T02:37:07.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.240+0000 7f4ebab0e700 1 -- start start 2023-11-15T02:37:07.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4ebab0e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4eb40aa060 0x7f4eb414cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4ebab0e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb40ab1a0 0x7f4eb4154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4ebab0e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4eb4154150 0x7f4eb40c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4ebab0e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40c3640 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4ebab0e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb4155940 con 0x7f4eb4154150 2023-11-15T02:37:07.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4ebab0e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb4155c20 con 0x7f4eb40aa060 2023-11-15T02:37:07.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4eb3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb40ab1a0 0x7f4eb4154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4eb3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb40ab1a0 0x7f4eb4154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41626/0 (socket says 172.21.15.1:41626) 2023-11-15T02:37:07.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4eb3fff700 1 -- 172.21.15.1:0/2133258356 learned_addr learned my addr 172.21.15.1:0/2133258356 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:07.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4eb88aa700 1 --2- 172.21.15.1:0/2133258356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4eb40aa060 0x7f4eb414cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4eb90ab700 1 --2- 172.21.15.1:0/2133258356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4eb4154150 0x7f4eb40c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4eb3fff700 1 -- 172.21.15.1:0/2133258356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4eb40aa060 msgr2=0x7f4eb414cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4eb3fff700 1 --2- 172.21.15.1:0/2133258356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4eb40aa060 0x7f4eb414cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4eb3fff700 1 -- 172.21.15.1:0/2133258356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4eb4154150 msgr2=0x7f4eb40c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4eb3fff700 1 --2- 172.21.15.1:0/2133258356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4eb4154150 0x7f4eb40c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4eb3fff700 1 -- 172.21.15.1:0/2133258356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea4009ae0 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4eb90ab700 1 --2- 172.21.15.1:0/2133258356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4eb4154150 0x7f4eb40c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:07.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4eb3fff700 1 --2- 172.21.15.1:0/2133258356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb40ab1a0 0x7f4eb4154f80 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f4ea4009fd0 tx=0x7f4ea4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:07.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4eb0ff9700 1 -- 172.21.15.1:0/2133258356 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40032f0 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4eb0ff9700 1 -- 172.21.15.1:0/2133258356 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea400bbc0 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4eb0ff9700 1 -- 172.21.15.1:0/2133258356 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea401e470 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.241+0000 7f4ebab0e700 1 -- 172.21.15.1:0/2133258356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb4155f00 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.242+0000 7f4ebab0e700 1 -- 172.21.15.1:0/2133258356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb40c31f0 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.242+0000 7f4ebab0e700 1 -- 172.21.15.1:0/2133258356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb40c37f0 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.243+0000 7f4eb0ff9700 1 -- 172.21.15.1:0/2133258356 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4ea4003040 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.243+0000 7f4eb0ff9700 1 --2- 172.21.15.1:0/2133258356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4e9405f270 0x7f4e94061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.243+0000 7f4eb0ff9700 1 -- 172.21.15.1:0/2133258356 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f4ea407b4f0 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.243+0000 7f4eb88aa700 1 --2- 172.21.15.1:0/2133258356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4e9405f270 0x7f4e94061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.244+0000 7f4eb88aa700 1 --2- 172.21.15.1:0/2133258356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4e9405f270 0x7f4e94061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f4e9c006d80 tx=0x7f4e9c008040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:07.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.247+0000 7f4eb0ff9700 1 -- 172.21.15.1:0/2133258356 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4eb40c37f0 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.491+0000 7f4ebab0e700 1 -- 172.21.15.1:0/2133258356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4eb406c7e0 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.492+0000 7f4eb0ff9700 1 -- 172.21.15.1:0/2133258356 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v42) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4ea4023020 con 0x7f4eb40ab1a0 2023-11-15T02:37:07.494 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:37:07.494 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:37:07.494 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_dump": [ 2023-11-15T02:37:07.495 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.495 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.a", 2023-11-15T02:37:07.495 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlmtf5GBAA2CojasXoquGQ9L5rKjVwTQ==", 2023-11-15T02:37:07.495 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.496 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:37:07.496 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:37:07.496 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:37:07.496 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:37:07.496 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.497 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.497 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.497 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.b", 2023-11-15T02:37:07.497 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl/Y5mJBAAz7iLl3kBJ8kSsyTetTZByw==", 2023-11-15T02:37:07.497 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.498 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:37:07.498 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:37:07.498 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:37:07.498 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:37:07.498 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.499 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.499 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.499 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.c", 2023-11-15T02:37:07.499 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlWTrwHxAAqLVpwNca0vAXUBFnWUN3pg==", 2023-11-15T02:37:07.499 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.500 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:37:07.500 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:37:07.500 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:37:07.500 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:37:07.500 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.501 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.501 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.501 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.d", 2023-11-15T02:37:07.501 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlVwUnKxAAhx2/mX1ljgQwJLagVpmZIA==", 2023-11-15T02:37:07.501 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.502 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:37:07.502 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:37:07.502 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:37:07.502 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:37:07.502 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.503 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.503 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.503 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.0", 2023-11-15T02:37:07.503 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDxHFRlII6rERAA/kvPPhTPHHy6pu5wSPsR/A==", 2023-11-15T02:37:07.503 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.504 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:37:07.504 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:37:07.504 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:37:07.504 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.504 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.504 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.505 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.1", 2023-11-15T02:37:07.505 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD0HFRlPkstEBAAqx31fnNonRCVh98eY6qbxQ==", 2023-11-15T02:37:07.505 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.506 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:37:07.506 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:37:07.506 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:37:07.506 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.506 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.507 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.507 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.2", 2023-11-15T02:37:07.507 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD3HFRl8e3nDRAAKigcbIo0/BFo0Qi6rV+amQ==", 2023-11-15T02:37:07.507 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.507 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:37:07.508 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:37:07.508 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:37:07.508 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.508 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.508 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.508 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.3", 2023-11-15T02:37:07.509 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD6HFRlbwDTCxAAkWv04RyNqW4p8pOqvYCS3A==", 2023-11-15T02:37:07.509 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.509 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:37:07.509 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:37:07.509 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:37:07.510 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.510 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.510 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.510 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.4", 2023-11-15T02:37:07.510 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAAHVRlTQihDxAA/HcZbSytP9qD5PsTjvJBoA==", 2023-11-15T02:37:07.511 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.511 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:37:07.511 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:37:07.511 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:37:07.511 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.512 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.512 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.512 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.5", 2023-11-15T02:37:07.512 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQADHVRlQ2hjDRAAFiI+hKubCPcZ/1AJVu1fvQ==", 2023-11-15T02:37:07.512 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.512 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:37:07.513 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:37:07.513 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:37:07.513 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.513 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.513 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.514 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.6", 2023-11-15T02:37:07.514 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAGHVRl/KEbCxAAmKTnRU4m4qNzX+SVcFY+Qw==", 2023-11-15T02:37:07.514 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.514 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:37:07.514 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:37:07.515 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:37:07.515 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.515 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.515 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.515 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.7", 2023-11-15T02:37:07.516 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAJHVRl4wOFCBAAAiGT4UPE5vSb2LjqgGgGFw==", 2023-11-15T02:37:07.516 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.516 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:37:07.516 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:37:07.516 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:37:07.517 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.517 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.517 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.517 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.0", 2023-11-15T02:37:07.517 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl2hkHLxAAxQE/Cslig6gmXR/xcVlRuw==", 2023-11-15T02:37:07.518 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.518 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:37:07.518 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow r", 2023-11-15T02:37:07.518 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-15T02:37:07.518 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.519 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.519 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.519 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.1", 2023-11-15T02:37:07.519 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRltolkNxAAXmQ4yXOlavwqKq2jFKwsYQ==", 2023-11-15T02:37:07.519 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.519 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:37:07.520 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T02:37:07.520 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T02:37:07.520 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T02:37:07.520 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.520 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.521 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.521 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.2", 2023-11-15T02:37:07.521 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlFrJvNBAAH97x7ERzuzpWrUALO+HvpA==", 2023-11-15T02:37:07.521 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.521 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:37:07.522 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T02:37:07.522 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T02:37:07.522 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T02:37:07.522 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.522 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.523 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.523 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.3", 2023-11-15T02:37:07.523 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDwHFRlko0ZARAA2RqeRJGwWns00DeWgd/9hA==", 2023-11-15T02:37:07.523 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.523 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:37:07.523 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T02:37:07.524 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T02:37:07.524 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T02:37:07.524 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.524 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.525 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.525 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.admin", 2023-11-15T02:37:07.525 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDuHFRlxIQDORAALrVIyQoaVSADkyv9yzMaZw==", 2023-11-15T02:37:07.525 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.525 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T02:37:07.525 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:37:07.526 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:37:07.526 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:37:07.526 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.526 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.527 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.527 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.x", 2023-11-15T02:37:07.527 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlnyjlFRAAjJwtxkAvJ0ZGmvOOawQseQ==", 2023-11-15T02:37:07.527 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.527 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T02:37:07.527 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T02:37:07.528 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:37:07.528 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.528 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:07.528 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:07.528 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.y", 2023-11-15T02:37:07.529 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl8nW3ERAA4CJQt/ZEZCJ9UaRRuEHfzw==", 2023-11-15T02:37:07.529 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:37:07.529 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T02:37:07.529 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T02:37:07.529 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:37:07.530 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.530 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:07.530 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2023-11-15T02:37:07.530 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:37:07.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.494+0000 7f4ebab0e700 1 -- 172.21.15.1:0/2133258356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4e9405f270 msgr2=0x7f4e94061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.494+0000 7f4ebab0e700 1 --2- 172.21.15.1:0/2133258356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4e9405f270 0x7f4e94061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f4e9c006d80 tx=0x7f4e9c008040).stop 2023-11-15T02:37:07.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.494+0000 7f4ebab0e700 1 -- 172.21.15.1:0/2133258356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb40ab1a0 msgr2=0x7f4eb4154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.494+0000 7f4ebab0e700 1 --2- 172.21.15.1:0/2133258356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb40ab1a0 0x7f4eb4154f80 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f4ea4009fd0 tx=0x7f4ea4009840).stop 2023-11-15T02:37:07.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.494+0000 7f4ebab0e700 1 -- 172.21.15.1:0/2133258356 shutdown_connections 2023-11-15T02:37:07.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.494+0000 7f4ebab0e700 1 --2- 172.21.15.1:0/2133258356 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4e9405f270 0x7f4e94061730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.494+0000 7f4ebab0e700 1 --2- 172.21.15.1:0/2133258356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4eb4154150 0x7f4eb40c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.494+0000 7f4ebab0e700 1 --2- 172.21.15.1:0/2133258356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4eb40aa060 0x7f4eb414cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.494+0000 7f4ebab0e700 1 --2- 172.21.15.1:0/2133258356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb40ab1a0 0x7f4eb4154f80 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.494+0000 7f4ebab0e700 1 -- 172.21.15.1:0/2133258356 >> 172.21.15.1:0/2133258356 conn(0x7f4eb4064aa0 msgr2=0x7f4eb40acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:07.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.494+0000 7f4ebab0e700 1 -- 172.21.15.1:0/2133258356 shutdown_connections 2023-11-15T02:37:07.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.494+0000 7f4ebab0e700 1 -- 172.21.15.1:0/2133258356 wait complete. 2023-11-15T02:37:07.535 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:37:07.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.651+0000 7f1ff0838700 1 Processor -- start 2023-11-15T02:37:07.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.651+0000 7f1ff0838700 1 -- start start 2023-11-15T02:37:07.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.652+0000 7f1ff0838700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1fec0833a0 0x7f1fec0a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.652+0000 7f1ff0838700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec0a85e0 con 0x7f1fec0be520 2023-11-15T02:37:07.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.652+0000 7f1ff0838700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec065660 con 0x7f1fec154450 2023-11-15T02:37:07.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.652+0000 7f1ff0838700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec065940 con 0x7f1fec0833a0 2023-11-15T02:37:07.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fead9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f1fec0be520 0x7f1fec0c7470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58620/0 (socket says 172.21.15.1:58620) 2023-11-15T02:37:07.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fead9d700 1 -- 172.21.15.1:0/1239511070 learned_addr learned my addr 172.21.15.1:0/1239511070 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:07.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe9d9b700 1 --2- 172.21.15.1:0/1239511070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1fec0833a0 0x7f1fec0a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe959a700 1 -- 172.21.15.1:0/1239511070 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115278163 0 0) 0x7f1fec0a85e0 con 0x7f1fec0be520 2023-11-15T02:37:07.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe959a700 1 -- 172.21.15.1:0/1239511070 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fd80033f0 con 0x7f1fec0be520 2023-11-15T02:37:07.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe959a700 1 -- 172.21.15.1:0/1239511070 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4151288569 0 0) 0x7f1fd80033f0 con 0x7f1fec0be520 2023-11-15T02:37:07.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe959a700 1 -- 172.21.15.1:0/1239511070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1fec0833a0 msgr2=0x7f1fec0a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:07.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe959a700 1 --2- 172.21.15.1:0/1239511070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1fec0833a0 0x7f1fec0a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe959a700 1 -- 172.21.15.1:0/1239511070 >> v1:172.21.15.141:6789/0 conn(0x7f1fec154450 legacy=0x7f1fec0bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe959a700 1 -- 172.21.15.1:0/1239511070 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec0c6f50 con 0x7f1fec0be520 2023-11-15T02:37:07.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe959a700 1 -- 172.21.15.1:0/1239511070 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f1fe4001470 con 0x7f1fec0be520 2023-11-15T02:37:07.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe959a700 1 -- 172.21.15.1:0/1239511070 >> v1:172.21.15.1:6789/0 conn(0x7f1fec0be520 legacy=0x7f1fec0c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe959a700 1 --2- 172.21.15.1:0/1239511070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1fd8003910 0x7f1fd8003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe959a700 1 --2- 172.21.15.1:0/1239511070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fd8004690 0x7f1fd8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe959a700 1 --2- 172.21.15.1:0/1239511070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1fec0833a0 0x7f1fd8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe959a700 1 -- 172.21.15.1:0/1239511070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec065940 con 0x7f1fd8004690 2023-11-15T02:37:07.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe959a700 1 -- 172.21.15.1:0/1239511070 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd800b910 con 0x7f1fd8003910 2023-11-15T02:37:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe959a700 1 -- 172.21.15.1:0/1239511070 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd800bad0 con 0x7f1fec0833a0 2023-11-15T02:37:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.653+0000 7f1fe9d9b700 1 --2- 172.21.15.1:0/1239511070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fd8004690 0x7f1fd8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.654+0000 7f1fea59c700 1 --2- 172.21.15.1:0/1239511070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1fd8003910 0x7f1fd8003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.654+0000 7f1fead9d700 1 --2- 172.21.15.1:0/1239511070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1fec0833a0 0x7f1fd8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.654+0000 7f1fe9d9b700 1 -- 172.21.15.1:0/1239511070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1fec0833a0 msgr2=0x7f1fd8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:07.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.654+0000 7f1fe9d9b700 1 --2- 172.21.15.1:0/1239511070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1fec0833a0 0x7f1fd8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.654+0000 7f1fe9d9b700 1 -- 172.21.15.1:0/1239511070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1fd8003910 msgr2=0x7f1fd8003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:07.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.654+0000 7f1fe9d9b700 1 --2- 172.21.15.1:0/1239511070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1fd8003910 0x7f1fd8003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.654+0000 7f1fe9d9b700 1 -- 172.21.15.1:0/1239511070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd80033f0 con 0x7f1fd8004690 2023-11-15T02:37:07.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.654+0000 7f1fead9d700 1 --2- 172.21.15.1:0/1239511070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1fec0833a0 0x7f1fd8005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:07.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.654+0000 7f1fe9d9b700 1 --2- 172.21.15.1:0/1239511070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fd8004690 0x7f1fd8004b10 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f1fd4009a80 tx=0x7f1fd4009060).ready entity=mon.0 client_cookie=a6e6671da5609f6a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:07.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.654+0000 7f1fe959a700 1 -- 172.21.15.1:0/1239511070 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4009430 con 0x7f1fd8004690 2023-11-15T02:37:07.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.654+0000 7f1fe959a700 1 -- 172.21.15.1:0/1239511070 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd400e640 con 0x7f1fd8004690 2023-11-15T02:37:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.654+0000 7f1fe959a700 1 -- 172.21.15.1:0/1239511070 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd400e9c0 con 0x7f1fd8004690 2023-11-15T02:37:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.655+0000 7f1ff0838700 1 -- 172.21.15.1:0/1239511070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fd8004690 msgr2=0x7f1fd8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.655+0000 7f1ff0838700 1 --2- 172.21.15.1:0/1239511070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fd8004690 0x7f1fd8004b10 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f1fd4009a80 tx=0x7f1fd4009060).stop 2023-11-15T02:37:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.655+0000 7f1fead9d700 1 -- 172.21.15.1:0/1239511070 reap_dead start 2023-11-15T02:37:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.655+0000 7f1ff0838700 1 -- 172.21.15.1:0/1239511070 shutdown_connections 2023-11-15T02:37:07.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.655+0000 7f1ff0838700 1 -- 172.21.15.1:0/1239511070 >> 172.21.15.1:0/1239511070 conn(0x7f1fec082f90 msgr2=0x7f1fec0c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:07.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.655+0000 7f1ff0838700 1 -- 172.21.15.1:0/1239511070 shutdown_connections 2023-11-15T02:37:07.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.655+0000 7f1ff0838700 1 -- 172.21.15.1:0/1239511070 wait complete. 2023-11-15T02:37:07.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.656+0000 7f1ff0838700 1 Processor -- start 2023-11-15T02:37:07.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.656+0000 7f1ff0838700 1 -- start start 2023-11-15T02:37:07.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1ff0838700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1fd8004690 0x7f1fec150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1ff0838700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fec0abe60 0x7f1fec0acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1ff0838700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1fec153590 0x7f1fec0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1ff0838700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0ad490 con 0x7f1fec0abe60 2023-11-15T02:37:07.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1ff0838700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec1679d0 con 0x7f1fd8004690 2023-11-15T02:37:07.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1ff0838700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec167cb0 con 0x7f1fec153590 2023-11-15T02:37:07.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fe9d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fec0abe60 0x7f1fec0acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fe9d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fec0abe60 0x7f1fec0acab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37780/0 (socket says 172.21.15.1:37780) 2023-11-15T02:37:07.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fe9d9b700 1 -- 172.21.15.1:0/1789253039 learned_addr learned my addr 172.21.15.1:0/1789253039 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:07.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fea59c700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1fd8004690 0x7f1fec150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fead9d700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1fec153590 0x7f1fec0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fe9d9b700 1 -- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1fec153590 msgr2=0x7f1fec0acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fe9d9b700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1fec153590 0x7f1fec0acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fe9d9b700 1 -- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1fd8004690 msgr2=0x7f1fec150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fe9d9b700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1fd8004690 0x7f1fec150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fe9d9b700 1 -- 172.21.15.1:0/1789253039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec167f90 con 0x7f1fec0abe60 2023-11-15T02:37:07.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fead9d700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1fec153590 0x7f1fec0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:07.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fea59c700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1fd8004690 0x7f1fec150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:07.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fe9d9b700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fec0abe60 0x7f1fec0acab0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f1fd800b8e0 tx=0x7f1fd401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:07.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fe27fc700 1 -- 172.21.15.1:0/1789253039 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd400ed30 con 0x7f1fec0abe60 2023-11-15T02:37:07.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fe27fc700 1 -- 172.21.15.1:0/1789253039 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd400eeb0 con 0x7f1fec0abe60 2023-11-15T02:37:07.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1ff0838700 1 -- 172.21.15.1:0/1789253039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fec168270 con 0x7f1fec0abe60 2023-11-15T02:37:07.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1fe27fc700 1 -- 172.21.15.1:0/1789253039 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd401b450 con 0x7f1fec0abe60 2023-11-15T02:37:07.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.657+0000 7f1ff0838700 1 -- 172.21.15.1:0/1789253039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec150e10 con 0x7f1fec0abe60 2023-11-15T02:37:07.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.658+0000 7f1ff0838700 1 -- 172.21.15.1:0/1789253039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fec153c60 con 0x7f1fec0abe60 2023-11-15T02:37:07.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.659+0000 7f1fe27fc700 1 -- 172.21.15.1:0/1789253039 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1fd401b800 con 0x7f1fec0abe60 2023-11-15T02:37:07.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.659+0000 7f1fe27fc700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1fcc05f270 0x7f1fcc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.659+0000 7f1fe27fc700 1 -- 172.21.15.1:0/1789253039 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f1fd407bcf0 con 0x7f1fec0abe60 2023-11-15T02:37:07.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.659+0000 7f1fea59c700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1fcc05f270 0x7f1fcc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.660+0000 7f1fea59c700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1fcc05f270 0x7f1fcc061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1fdc0042e0 tx=0x7f1fdc007d60).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:07.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.663+0000 7f1fe27fc700 1 -- 172.21.15.1:0/1789253039 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1fd404cf40 con 0x7f1fec0abe60 2023-11-15T02:37:07.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.836+0000 7f1ff0838700 1 -- 172.21.15.1:0/1789253039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fec06c7e0 con 0x7f1fec0abe60 2023-11-15T02:37:07.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.837+0000 7f1fe27fc700 1 -- 172.21.15.1:0/1789253039 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+14435 (secure 0 0 0) 0x7f1fd4016030 con 0x7f1fec0abe60 2023-11-15T02:37:07.839 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:37:07.839 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":173,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:37:07.089794+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:37:07.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.839+0000 7f1ff0838700 1 -- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1fcc05f270 msgr2=0x7f1fcc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.839+0000 7f1ff0838700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1fcc05f270 0x7f1fcc061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1fdc0042e0 tx=0x7f1fdc007d60).stop 2023-11-15T02:37:07.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.839+0000 7f1ff0838700 1 -- 172.21.15.1:0/1789253039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fec0abe60 msgr2=0x7f1fec0acab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.839+0000 7f1ff0838700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fec0abe60 0x7f1fec0acab0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f1fd800b8e0 tx=0x7f1fd401a000).stop 2023-11-15T02:37:07.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.839+0000 7f1ff0838700 1 -- 172.21.15.1:0/1789253039 shutdown_connections 2023-11-15T02:37:07.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.839+0000 7f1ff0838700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1fcc05f270 0x7f1fcc061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.839+0000 7f1ff0838700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1fec153590 0x7f1fec0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.839+0000 7f1ff0838700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1fd8004690 0x7f1fec150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.839+0000 7f1ff0838700 1 --2- 172.21.15.1:0/1789253039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fec0abe60 0x7f1fec0acab0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.839+0000 7f1ff0838700 1 -- 172.21.15.1:0/1789253039 >> 172.21.15.1:0/1789253039 conn(0x7f1fec082f90 msgr2=0x7f1fec0bde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:07.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.839+0000 7f1ff0838700 1 -- 172.21.15.1:0/1789253039 shutdown_connections 2023-11-15T02:37:07.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.839+0000 7f1ff0838700 1 -- 172.21.15.1:0/1789253039 wait complete. 2023-11-15T02:37:07.853 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '166', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-15T02:37:07.854 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T02:37:07.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.973+0000 7fb200dca700 1 Processor -- start 2023-11-15T02:37:07.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.973+0000 7fb200dca700 1 -- start start 2023-11-15T02:37:07.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.974+0000 7fb200dca700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1fc062970 0x7fb1fc0c4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.974+0000 7fb200dca700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb1fc0661e0 0x7fb1fc062d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.974+0000 7fb200dca700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc156310 con 0x7fb1fc1567a0 2023-11-15T02:37:07.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.974+0000 7fb200dca700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1fc156c50 con 0x7fb1fc0661e0 2023-11-15T02:37:07.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.974+0000 7fb200dca700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc065a30 con 0x7fb1fc062970 2023-11-15T02:37:07.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.974+0000 7fb1fad9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb1fc1567a0 0x7fb1fc13b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58624/0 (socket says 172.21.15.1:58624) 2023-11-15T02:37:07.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.974+0000 7fb1fad9d700 1 -- 172.21.15.1:0/2078579814 learned_addr learned my addr 172.21.15.1:0/2078579814 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:07.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.975+0000 7fb1fa59c700 1 --2- 172.21.15.1:0/2078579814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1fc062970 0x7fb1fc0c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.975+0000 7fb1f9d9b700 1 --2- 172.21.15.1:0/2078579814 >> v2:172.21.15.141:3300/0 conn(0x7fb1fc0661e0 0x7fb1fc062d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.975+0000 7fb1f959a700 1 -- 172.21.15.1:0/2078579814 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221347994 0 0) 0x7fb1fc156310 con 0x7fb1fc1567a0 2023-11-15T02:37:07.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.975+0000 7fb1f959a700 1 -- 172.21.15.1:0/2078579814 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e80033f0 con 0x7fb1fc1567a0 2023-11-15T02:37:07.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.975+0000 7fb1fa59c700 1 -- 172.21.15.1:0/2078579814 >> v2:172.21.15.141:3300/0 conn(0x7fb1fc0661e0 msgr2=0x7fb1fc062d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:07.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.975+0000 7fb1fa59c700 1 --2- 172.21.15.1:0/2078579814 >> v2:172.21.15.141:3300/0 conn(0x7fb1fc0661e0 0x7fb1fc062d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.975+0000 7fb1fa59c700 1 -- 172.21.15.1:0/2078579814 >> v1:172.21.15.1:6789/0 conn(0x7fb1fc1567a0 legacy=0x7fb1fc13b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.975+0000 7fb1fa59c700 1 -- 172.21.15.1:0/2078579814 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc06a1c0 con 0x7fb1fc062970 2023-11-15T02:37:07.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.975+0000 7fb1fa59c700 1 --2- 172.21.15.1:0/2078579814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1fc062970 0x7fb1fc0c4360 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fb1f4009760 tx=0x7fb1f4009060).ready entity=mon.2 client_cookie=12837cb022d06f84 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:07.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.975+0000 7fb1f959a700 1 -- 172.21.15.1:0/2078579814 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400d4a0 con 0x7fb1fc062970 2023-11-15T02:37:07.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.975+0000 7fb1f959a700 1 -- 172.21.15.1:0/2078579814 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f400d600 con 0x7fb1fc062970 2023-11-15T02:37:07.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.975+0000 7fb1f959a700 1 -- 172.21.15.1:0/2078579814 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400d980 con 0x7fb1fc062970 2023-11-15T02:37:07.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.976+0000 7fb200dca700 1 -- 172.21.15.1:0/2078579814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1fc062970 msgr2=0x7fb1fc0c4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.976+0000 7fb200dca700 1 --2- 172.21.15.1:0/2078579814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1fc062970 0x7fb1fc0c4360 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fb1f4009760 tx=0x7fb1f4009060).stop 2023-11-15T02:37:07.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.976+0000 7fb200dca700 1 -- 172.21.15.1:0/2078579814 shutdown_connections 2023-11-15T02:37:07.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.976+0000 7fb200dca700 1 --2- 172.21.15.1:0/2078579814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1fc062970 0x7fb1fc0c4360 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.976+0000 7fb200dca700 1 --2- 172.21.15.1:0/2078579814 >> v2:172.21.15.141:3300/0 conn(0x7fb1fc0661e0 0x7fb1fc062d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.976+0000 7fb200dca700 1 -- 172.21.15.1:0/2078579814 >> 172.21.15.1:0/2078579814 conn(0x7fb1fc0c7dc0 msgr2=0x7fb1fc0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:07.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.976+0000 7fb200dca700 1 -- 172.21.15.1:0/2078579814 shutdown_connections 2023-11-15T02:37:07.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.976+0000 7fb200dca700 1 -- 172.21.15.1:0/2078579814 wait complete. 2023-11-15T02:37:07.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.977+0000 7fb200dca700 1 Processor -- start 2023-11-15T02:37:07.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.977+0000 7fb200dca700 1 -- start start 2023-11-15T02:37:07.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb200dca700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1fc062970 0x7fb1fc151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb200dca700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1fc0661e0 0x7fb1fc0aa270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb200dca700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1fc1567a0 0x7fb1fc13b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb200dca700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0abe40 con 0x7fb1fc062970 2023-11-15T02:37:07.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb200dca700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0ab230 con 0x7fb1fc1567a0 2023-11-15T02:37:07.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb200dca700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0ab510 con 0x7fb1fc0661e0 2023-11-15T02:37:07.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb1fa59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1fc062970 0x7fb1fc151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb1fa59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1fc062970 0x7fb1fc151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37784/0 (socket says 172.21.15.1:37784) 2023-11-15T02:37:07.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb1fa59c700 1 -- 172.21.15.1:0/521179368 learned_addr learned my addr 172.21.15.1:0/521179368 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:07.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb1f9d9b700 1 --2- 172.21.15.1:0/521179368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1fc0661e0 0x7fb1fc0aa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb1fad9d700 1 --2- 172.21.15.1:0/521179368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1fc1567a0 0x7fb1fc13b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb1fa59c700 1 -- 172.21.15.1:0/521179368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1fc0661e0 msgr2=0x7fb1fc0aa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb1fa59c700 1 --2- 172.21.15.1:0/521179368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1fc0661e0 0x7fb1fc0aa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb1fa59c700 1 -- 172.21.15.1:0/521179368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1fc1567a0 msgr2=0x7fb1fc13b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:07.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb1fa59c700 1 --2- 172.21.15.1:0/521179368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1fc1567a0 0x7fb1fc13b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:07.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb1fa59c700 1 -- 172.21.15.1:0/521179368 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f40092a0 con 0x7fb1fc062970 2023-11-15T02:37:07.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.978+0000 7fb1fa59c700 1 --2- 172.21.15.1:0/521179368 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1fc062970 0x7fb1fc151a50 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7fb1f4009d50 tx=0x7fb1f4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:07.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.979+0000 7fb1f27fc700 1 -- 172.21.15.1:0/521179368 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400dd40 con 0x7fb1fc062970 2023-11-15T02:37:07.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.979+0000 7fb1f27fc700 1 -- 172.21.15.1:0/521179368 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f400d770 con 0x7fb1fc062970 2023-11-15T02:37:07.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.979+0000 7fb200dca700 1 -- 172.21.15.1:0/521179368 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1fc0ab7f0 con 0x7fb1fc062970 2023-11-15T02:37:07.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.979+0000 7fb1f27fc700 1 -- 172.21.15.1:0/521179368 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400dea0 con 0x7fb1fc062970 2023-11-15T02:37:07.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.979+0000 7fb200dca700 1 -- 172.21.15.1:0/521179368 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc151f40 con 0x7fb1fc062970 2023-11-15T02:37:07.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.980+0000 7fb200dca700 1 -- 172.21.15.1:0/521179368 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1fc06c7e0 con 0x7fb1fc062970 2023-11-15T02:37:07.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.980+0000 7fb1f27fc700 1 -- 172.21.15.1:0/521179368 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb1f4018070 con 0x7fb1fc062970 2023-11-15T02:37:07.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.980+0000 7fb1f27fc700 1 --2- 172.21.15.1:0/521179368 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1dc05f270 0x7fb1dc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:07.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.980+0000 7fb1f27fc700 1 -- 172.21.15.1:0/521179368 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fb1f407ba10 con 0x7fb1fc062970 2023-11-15T02:37:07.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.981+0000 7fb1f9d9b700 1 --2- 172.21.15.1:0/521179368 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1dc05f270 0x7fb1dc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:07.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.981+0000 7fb1f9d9b700 1 --2- 172.21.15.1:0/521179368 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1dc05f270 0x7fb1dc061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb1fc139bd0 tx=0x7fb1e4009060).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:07.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:07.985+0000 7fb1f27fc700 1 -- 172.21.15.1:0/521179368 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb1f404ccc0 con 0x7fb1fc062970 2023-11-15T02:37:08.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.157+0000 7fb200dca700 1 -- 172.21.15.1:0/521179368 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb1fc06a460 con 0x7fb1fc062970 2023-11-15T02:37:08.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.158+0000 7fb1f27fc700 1 -- 172.21.15.1:0/521179368 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v173) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb1f40502e0 con 0x7fb1fc062970 2023-11-15T02:37:08.160 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T02:37:08.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.160+0000 7fb200dca700 1 -- 172.21.15.1:0/521179368 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1dc05f270 msgr2=0x7fb1dc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.160+0000 7fb200dca700 1 --2- 172.21.15.1:0/521179368 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1dc05f270 0x7fb1dc061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb1fc139bd0 tx=0x7fb1e4009060).stop 2023-11-15T02:37:08.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.160+0000 7fb200dca700 1 -- 172.21.15.1:0/521179368 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1fc062970 msgr2=0x7fb1fc151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.160+0000 7fb200dca700 1 --2- 172.21.15.1:0/521179368 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1fc062970 0x7fb1fc151a50 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7fb1f4009d50 tx=0x7fb1f4016000).stop 2023-11-15T02:37:08.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.160+0000 7fb200dca700 1 -- 172.21.15.1:0/521179368 shutdown_connections 2023-11-15T02:37:08.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.160+0000 7fb200dca700 1 --2- 172.21.15.1:0/521179368 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb1dc05f270 0x7fb1dc061730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.160+0000 7fb200dca700 1 --2- 172.21.15.1:0/521179368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1fc1567a0 0x7fb1fc13b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.160+0000 7fb200dca700 1 --2- 172.21.15.1:0/521179368 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1fc062970 0x7fb1fc151a50 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.160+0000 7fb200dca700 1 --2- 172.21.15.1:0/521179368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1fc0661e0 0x7fb1fc0aa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.160+0000 7fb200dca700 1 -- 172.21.15.1:0/521179368 >> 172.21.15.1:0/521179368 conn(0x7fb1fc0c7dc0 msgr2=0x7fb1fc13a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:08.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.160+0000 7fb200dca700 1 -- 172.21.15.1:0/521179368 shutdown_connections 2023-11-15T02:37:08.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.160+0000 7fb200dca700 1 -- 172.21.15.1:0/521179368 wait complete. 2023-11-15T02:37:08.174 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T02:37:08.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.293+0000 7f3dc6024700 1 Processor -- start 2023-11-15T02:37:08.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.293+0000 7f3dc6024700 1 -- start start 2023-11-15T02:37:08.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.294+0000 7f3dc6024700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3dc0151cc0 0x7f3dc01520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.294+0000 7f3dc6024700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3dc0062ec0 0x7f3dc01553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.294+0000 7f3dc6024700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc0065670 con 0x7f3dc00c4300 2023-11-15T02:37:08.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.294+0000 7f3dc6024700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc00a7560 con 0x7f3dc0062ec0 2023-11-15T02:37:08.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.294+0000 7f3dc6024700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc01558b0 con 0x7f3dc0151cc0 2023-11-15T02:37:08.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.294+0000 7f3dc5823700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3dc0062ec0 0x7f3dc01553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.294+0000 7f3dc5823700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3dc0062ec0 0x7f3dc01553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37788/0 (socket says 172.21.15.1:37788) 2023-11-15T02:37:08.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.294+0000 7f3dc5823700 1 -- 172.21.15.1:0/3685565857 learned_addr learned my addr 172.21.15.1:0/3685565857 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:08.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.294+0000 7f3dc5022700 1 --2- 172.21.15.1:0/3685565857 >> v2:172.21.15.141:3300/0 conn(0x7f3dc0151cc0 0x7f3dc01520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.294+0000 7f3dc5823700 1 -- 172.21.15.1:0/3685565857 >> v2:172.21.15.141:3300/0 conn(0x7f3dc0151cc0 msgr2=0x7f3dc01520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:08.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.294+0000 7f3dc5823700 1 --2- 172.21.15.1:0/3685565857 >> v2:172.21.15.141:3300/0 conn(0x7f3dc0151cc0 0x7f3dc01520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.294+0000 7f3dc5823700 1 -- 172.21.15.1:0/3685565857 >> v1:172.21.15.141:6789/0 conn(0x7f3dc00c4300 legacy=0x7f3dc00627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:08.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.294+0000 7f3dc5823700 1 -- 172.21.15.1:0/3685565857 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc00658c0 con 0x7f3dc0062ec0 2023-11-15T02:37:08.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.294+0000 7f3dc5823700 1 --2- 172.21.15.1:0/3685565857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc0062ec0 0x7f3dc01553c0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f3dc005e880 tx=0x7f3db8009840).ready entity=mon.0 client_cookie=25180cf607964a75 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:08.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.295+0000 7f3dbffff700 1 -- 172.21.15.1:0/3685565857 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db800e070 con 0x7f3dc0062ec0 2023-11-15T02:37:08.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.295+0000 7f3dbffff700 1 -- 172.21.15.1:0/3685565857 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db800ba10 con 0x7f3dc0062ec0 2023-11-15T02:37:08.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.295+0000 7f3dbffff700 1 -- 172.21.15.1:0/3685565857 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db800bd90 con 0x7f3dc0062ec0 2023-11-15T02:37:08.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.295+0000 7f3dc6024700 1 -- 172.21.15.1:0/3685565857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc0062ec0 msgr2=0x7f3dc01553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.295+0000 7f3dc6024700 1 --2- 172.21.15.1:0/3685565857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc0062ec0 0x7f3dc01553c0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f3dc005e880 tx=0x7f3db8009840).stop 2023-11-15T02:37:08.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.295+0000 7f3dc6024700 1 -- 172.21.15.1:0/3685565857 shutdown_connections 2023-11-15T02:37:08.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.295+0000 7f3dc6024700 1 --2- 172.21.15.1:0/3685565857 >> v2:172.21.15.141:3300/0 conn(0x7f3dc0151cc0 0x7f3dc01520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.295+0000 7f3dc6024700 1 --2- 172.21.15.1:0/3685565857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc0062ec0 0x7f3dc01553c0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.295+0000 7f3dc6024700 1 -- 172.21.15.1:0/3685565857 >> 172.21.15.1:0/3685565857 conn(0x7f3dc0064390 msgr2=0x7f3dc00c7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:08.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.295+0000 7f3dc6024700 1 -- 172.21.15.1:0/3685565857 shutdown_connections 2023-11-15T02:37:08.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.295+0000 7f3dc6024700 1 -- 172.21.15.1:0/3685565857 wait complete. 2023-11-15T02:37:08.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.296+0000 7f3dc6024700 1 Processor -- start 2023-11-15T02:37:08.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.296+0000 7f3dc6024700 1 -- start start 2023-11-15T02:37:08.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.297+0000 7f3dc6024700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dc0062ec0 0x7f3dc013de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.297+0000 7f3dc6024700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dc00c4300 0x7f3dc00a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.297+0000 7f3dc6024700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc0151cc0 0x7f3dc00a9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.297+0000 7f3dc6024700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc0152f90 con 0x7f3dc0151cc0 2023-11-15T02:37:08.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.297+0000 7f3dc6024700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc00c3c00 con 0x7f3dc0062ec0 2023-11-15T02:37:08.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.297+0000 7f3dc6024700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc01520a0 con 0x7f3dc00c4300 2023-11-15T02:37:08.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.297+0000 7f3dc5823700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc0151cc0 0x7f3dc00a9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.297+0000 7f3dc5823700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc0151cc0 0x7f3dc00a9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37802/0 (socket says 172.21.15.1:37802) 2023-11-15T02:37:08.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.297+0000 7f3dc5823700 1 -- 172.21.15.1:0/1776135341 learned_addr learned my addr 172.21.15.1:0/1776135341 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:08.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.298+0000 7f3dc5022700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dc0062ec0 0x7f3dc013de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.298+0000 7f3dc4821700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dc00c4300 0x7f3dc00a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.298+0000 7f3dc5823700 1 -- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dc00c4300 msgr2=0x7f3dc00a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.298+0000 7f3dc5823700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dc00c4300 0x7f3dc00a7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.298+0000 7f3dc5823700 1 -- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dc0062ec0 msgr2=0x7f3dc013de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.298+0000 7f3dc5823700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dc0062ec0 0x7f3dc013de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.298+0000 7f3dc5823700 1 -- 172.21.15.1:0/1776135341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db8009ae0 con 0x7f3dc0151cc0 2023-11-15T02:37:08.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.298+0000 7f3dc5022700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dc0062ec0 0x7f3dc013de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:08.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.298+0000 7f3dc4821700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dc00c4300 0x7f3dc00a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:08.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.298+0000 7f3dc5823700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc0151cc0 0x7f3dc00a9340 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f3db8009540 tx=0x7f3db8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:08.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.298+0000 7f3dbd7fa700 1 -- 172.21.15.1:0/1776135341 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db80092e0 con 0x7f3dc0151cc0 2023-11-15T02:37:08.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.298+0000 7f3dbd7fa700 1 -- 172.21.15.1:0/1776135341 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db801d410 con 0x7f3dc0151cc0 2023-11-15T02:37:08.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.298+0000 7f3dc6024700 1 -- 172.21.15.1:0/1776135341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc0152380 con 0x7f3dc0151cc0 2023-11-15T02:37:08.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.298+0000 7f3dbd7fa700 1 -- 172.21.15.1:0/1776135341 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db801d7b0 con 0x7f3dc0151cc0 2023-11-15T02:37:08.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.298+0000 7f3dc6024700 1 -- 172.21.15.1:0/1776135341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc0152940 con 0x7f3dc0151cc0 2023-11-15T02:37:08.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.299+0000 7f3dc6024700 1 -- 172.21.15.1:0/1776135341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc0153100 con 0x7f3dc0151cc0 2023-11-15T02:37:08.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.299+0000 7f3dbd7fa700 1 -- 172.21.15.1:0/1776135341 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3db801db20 con 0x7f3dc0151cc0 2023-11-15T02:37:08.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.300+0000 7f3dbd7fa700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3dac05f270 0x7f3dac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.300+0000 7f3dbd7fa700 1 -- 172.21.15.1:0/1776135341 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f3db807bf50 con 0x7f3dc0151cc0 2023-11-15T02:37:08.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.300+0000 7f3dc5022700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3dac05f270 0x7f3dac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.300+0000 7f3dc5022700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3dac05f270 0x7f3dac061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3db0009810 tx=0x7f3db0008040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:08.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.304+0000 7f3dbd7fa700 1 -- 172.21.15.1:0/1776135341 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3db804d200 con 0x7f3dc0151cc0 2023-11-15T02:37:08.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.477+0000 7f3dc6024700 1 -- 172.21.15.1:0/1776135341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3dc01530d0 con 0x7f3dc0151cc0 2023-11-15T02:37:08.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.477+0000 7f3dbd7fa700 1 -- 172.21.15.1:0/1776135341 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v173) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3db8050820 con 0x7f3dc0151cc0 2023-11-15T02:37:08.479 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T02:37:08.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.479+0000 7f3dc6024700 1 -- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3dac05f270 msgr2=0x7f3dac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.479+0000 7f3dc6024700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3dac05f270 0x7f3dac061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3db0009810 tx=0x7f3db0008040).stop 2023-11-15T02:37:08.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.479+0000 7f3dc6024700 1 -- 172.21.15.1:0/1776135341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc0151cc0 msgr2=0x7f3dc00a9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.479+0000 7f3dc6024700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc0151cc0 0x7f3dc00a9340 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f3db8009540 tx=0x7f3db8009840).stop 2023-11-15T02:37:08.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.479+0000 7f3dc6024700 1 -- 172.21.15.1:0/1776135341 shutdown_connections 2023-11-15T02:37:08.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.479+0000 7f3dc6024700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3dac05f270 0x7f3dac061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.479+0000 7f3dc6024700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc0151cc0 0x7f3dc00a9340 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.479+0000 7f3dc6024700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dc0062ec0 0x7f3dc013de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.479+0000 7f3dc6024700 1 --2- 172.21.15.1:0/1776135341 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dc00c4300 0x7f3dc00a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.479+0000 7f3dc6024700 1 -- 172.21.15.1:0/1776135341 >> 172.21.15.1:0/1776135341 conn(0x7f3dc0064390 msgr2=0x7f3dc00c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:08.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.479+0000 7f3dc6024700 1 -- 172.21.15.1:0/1776135341 shutdown_connections 2023-11-15T02:37:08.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.479+0000 7f3dc6024700 1 -- 172.21.15.1:0/1776135341 wait complete. 2023-11-15T02:37:08.493 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-15T02:37:08.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.609+0000 7f00166ab700 1 Processor -- start 2023-11-15T02:37:08.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.610+0000 7f00166ab700 1 -- start start 2023-11-15T02:37:08.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.610+0000 7f00166ab700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00100be520 0x7f00100a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.610+0000 7f00166ab700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00100a85e0 con 0x7f0010154450 2023-11-15T02:37:08.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.610+0000 7f00166ab700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0010065660 con 0x7f00100833a0 2023-11-15T02:37:08.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.610+0000 7f00166ab700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0010065940 con 0x7f00100be520 2023-11-15T02:37:08.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.610+0000 7f000ffff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0010154450 0x7f00100bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58626/0 (socket says 172.21.15.1:58626) 2023-11-15T02:37:08.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000ffff700 1 -- 172.21.15.1:0/2142637382 learned_addr learned my addr 172.21.15.1:0/2142637382 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:08.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f0014c48700 1 --2- 172.21.15.1:0/2142637382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00100be520 0x7f00100a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000effd700 1 -- 172.21.15.1:0/2142637382 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389440499 0 0) 0x7f00100a85e0 con 0x7f0010154450 2023-11-15T02:37:08.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000effd700 1 -- 172.21.15.1:0/2142637382 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff80033f0 con 0x7f0010154450 2023-11-15T02:37:08.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000effd700 1 -- 172.21.15.1:0/2142637382 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2283918147 0 0) 0x7efff80033f0 con 0x7f0010154450 2023-11-15T02:37:08.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000effd700 1 -- 172.21.15.1:0/2142637382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00100be520 msgr2=0x7f00100a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:08.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000effd700 1 --2- 172.21.15.1:0/2142637382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00100be520 0x7f00100a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000effd700 1 -- 172.21.15.1:0/2142637382 >> v1:172.21.15.141:6789/0 conn(0x7f00100833a0 legacy=0x7f00100c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000effd700 1 -- 172.21.15.1:0/2142637382 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00100c6f50 con 0x7f0010154450 2023-11-15T02:37:08.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000effd700 1 -- 172.21.15.1:0/2142637382 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f00000015f0 con 0x7f0010154450 2023-11-15T02:37:08.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000effd700 1 -- 172.21.15.1:0/2142637382 >> v1:172.21.15.1:6789/0 conn(0x7f0010154450 legacy=0x7f00100bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000effd700 1 --2- 172.21.15.1:0/2142637382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00100be520 0x7efff8003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000effd700 1 --2- 172.21.15.1:0/2142637382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efff8003e40 0x7efff8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000effd700 1 --2- 172.21.15.1:0/2142637382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efff8004b80 0x7efff8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000effd700 1 -- 172.21.15.1:0/2142637382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0010065940 con 0x7efff8004b80 2023-11-15T02:37:08.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000effd700 1 -- 172.21.15.1:0/2142637382 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff800b990 con 0x7efff8003e40 2023-11-15T02:37:08.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000effd700 1 -- 172.21.15.1:0/2142637382 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff800bb50 con 0x7f00100be520 2023-11-15T02:37:08.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f0014c48700 1 --2- 172.21.15.1:0/2142637382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efff8004b80 0x7efff8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000ffff700 1 --2- 172.21.15.1:0/2142637382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00100be520 0x7efff8003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.611+0000 7f000f7fe700 1 --2- 172.21.15.1:0/2142637382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efff8003e40 0x7efff8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.612+0000 7f0014c48700 1 -- 172.21.15.1:0/2142637382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00100be520 msgr2=0x7efff8003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:08.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.612+0000 7f0014c48700 1 --2- 172.21.15.1:0/2142637382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00100be520 0x7efff8003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.612+0000 7f0014c48700 1 -- 172.21.15.1:0/2142637382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efff8003e40 msgr2=0x7efff8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:08.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.612+0000 7f0014c48700 1 --2- 172.21.15.1:0/2142637382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efff8003e40 0x7efff8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.612+0000 7f0014c48700 1 -- 172.21.15.1:0/2142637382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff80033f0 con 0x7efff8004b80 2023-11-15T02:37:08.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.612+0000 7f0014c48700 1 --2- 172.21.15.1:0/2142637382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efff8004b80 0x7efff8005000 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f00100be920 tx=0x7f000800b040).ready entity=mon.0 client_cookie=8b56dcf43a2f1500 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:08.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.612+0000 7f000effd700 1 -- 172.21.15.1:0/2142637382 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008009ac0 con 0x7efff8004b80 2023-11-15T02:37:08.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.612+0000 7f000effd700 1 -- 172.21.15.1:0/2142637382 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000800f040 con 0x7efff8004b80 2023-11-15T02:37:08.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.612+0000 7f000effd700 1 -- 172.21.15.1:0/2142637382 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000800eca0 con 0x7efff8004b80 2023-11-15T02:37:08.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.612+0000 7f00166ab700 1 -- 172.21.15.1:0/2142637382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efff8004b80 msgr2=0x7efff8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.612+0000 7f00166ab700 1 --2- 172.21.15.1:0/2142637382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efff8004b80 0x7efff8005000 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f00100be920 tx=0x7f000800b040).stop 2023-11-15T02:37:08.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.612+0000 7f0014c48700 1 -- 172.21.15.1:0/2142637382 reap_dead start 2023-11-15T02:37:08.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.612+0000 7f00166ab700 1 -- 172.21.15.1:0/2142637382 shutdown_connections 2023-11-15T02:37:08.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.612+0000 7f00166ab700 1 -- 172.21.15.1:0/2142637382 >> 172.21.15.1:0/2142637382 conn(0x7f0010082f90 msgr2=0x7f00100c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:08.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.612+0000 7f00166ab700 1 -- 172.21.15.1:0/2142637382 shutdown_connections 2023-11-15T02:37:08.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.613+0000 7f00166ab700 1 -- 172.21.15.1:0/2142637382 wait complete. 2023-11-15T02:37:08.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.614+0000 7f00166ab700 1 Processor -- start 2023-11-15T02:37:08.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.614+0000 7f00166ab700 1 -- start start 2023-11-15T02:37:08.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.614+0000 7f00166ab700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00100c26d0 0x7f00100acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.614+0000 7f00166ab700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00100acfe0 0x7f00100a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.614+0000 7f00166ab700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f00100a7310 0x7f00100bfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.614+0000 7f00166ab700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0010168b20 con 0x7f00100c26d0 2023-11-15T02:37:08.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.614+0000 7f00166ab700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00100ad460 con 0x7f00100a7310 2023-11-15T02:37:08.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.614+0000 7f00166ab700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0010167f10 con 0x7f00100acfe0 2023-11-15T02:37:08.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7f000ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00100c26d0 0x7f00100acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7f000ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00100c26d0 0x7f00100acaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37830/0 (socket says 172.21.15.1:37830) 2023-11-15T02:37:08.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7f000ffff700 1 -- 172.21.15.1:0/180378396 learned_addr learned my addr 172.21.15.1:0/180378396 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:08.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7f000f7fe700 1 --2- 172.21.15.1:0/180378396 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00100acfe0 0x7f00100a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7f0014c48700 1 --2- 172.21.15.1:0/180378396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f00100a7310 0x7f00100bfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7f000ffff700 1 -- 172.21.15.1:0/180378396 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00100acfe0 msgr2=0x7f00100a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7f000ffff700 1 --2- 172.21.15.1:0/180378396 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00100acfe0 0x7f00100a6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7f000ffff700 1 -- 172.21.15.1:0/180378396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f00100a7310 msgr2=0x7f00100bfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7f000ffff700 1 --2- 172.21.15.1:0/180378396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f00100a7310 0x7f00100bfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7f000ffff700 1 -- 172.21.15.1:0/180378396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00101681f0 con 0x7f00100c26d0 2023-11-15T02:37:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7f000f7fe700 1 --2- 172.21.15.1:0/180378396 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00100acfe0 0x7f00100a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7f000ffff700 1 --2- 172.21.15.1:0/180378396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00100c26d0 0x7f00100acaf0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f0000001580 tx=0x7f0000009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7efff7fff700 1 -- 172.21.15.1:0/180378396 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000fee0 con 0x7f00100c26d0 2023-11-15T02:37:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7efff7fff700 1 -- 172.21.15.1:0/180378396 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00000070d0 con 0x7f00100c26d0 2023-11-15T02:37:08.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7efff7fff700 1 -- 172.21.15.1:0/180378396 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000007490 con 0x7f00100c26d0 2023-11-15T02:37:08.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7f00166ab700 1 -- 172.21.15.1:0/180378396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00101684d0 con 0x7f00100c26d0 2023-11-15T02:37:08.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.615+0000 7f00166ab700 1 -- 172.21.15.1:0/180378396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00100c2ab0 con 0x7f00100c26d0 2023-11-15T02:37:08.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.616+0000 7f00166ab700 1 -- 172.21.15.1:0/180378396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001006c7e0 con 0x7f00100c26d0 2023-11-15T02:37:08.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.617+0000 7efff7fff700 1 -- 172.21.15.1:0/180378396 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0000005a90 con 0x7f00100c26d0 2023-11-15T02:37:08.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.617+0000 7efff7fff700 1 --2- 172.21.15.1:0/180378396 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efffc05f270 0x7efffc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.617+0000 7efff7fff700 1 -- 172.21.15.1:0/180378396 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f0000079db0 con 0x7f00100c26d0 2023-11-15T02:37:08.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.617+0000 7f000f7fe700 1 --2- 172.21.15.1:0/180378396 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efffc05f270 0x7efffc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.618+0000 7f000f7fe700 1 --2- 172.21.15.1:0/180378396 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efffc05f270 0x7efffc061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0004007cc0 tx=0x7f0004009040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:08.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.621+0000 7efff7fff700 1 -- 172.21.15.1:0/180378396 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f000004b060 con 0x7f00100c26d0 2023-11-15T02:37:08.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.796+0000 7f00166ab700 1 -- 172.21.15.1:0/180378396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0010065350 con 0x7f00100c26d0 2023-11-15T02:37:08.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.797+0000 7efff7fff700 1 -- 172.21.15.1:0/180378396 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v173) v1 ==== 84+0+143 (secure 0 0 0) 0x7f0000018030 con 0x7f00100c26d0 2023-11-15T02:37:08.799 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:37:08.799 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T02:37:08.799 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:08.800 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2023-11-15T02:37:08.800 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "device_health_metrics" 2023-11-15T02:37:08.800 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:37:08.800 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:08.800 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 2, 2023-11-15T02:37:08.801 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "rbd" 2023-11-15T02:37:08.801 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:08.801 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T02:37:08.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.799+0000 7f00166ab700 1 -- 172.21.15.1:0/180378396 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efffc05f270 msgr2=0x7efffc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.799+0000 7f00166ab700 1 --2- 172.21.15.1:0/180378396 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efffc05f270 0x7efffc061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0004007cc0 tx=0x7f0004009040).stop 2023-11-15T02:37:08.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.799+0000 7f00166ab700 1 -- 172.21.15.1:0/180378396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00100c26d0 msgr2=0x7f00100acaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.799+0000 7f00166ab700 1 --2- 172.21.15.1:0/180378396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00100c26d0 0x7f00100acaf0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f0000001580 tx=0x7f0000009040).stop 2023-11-15T02:37:08.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.799+0000 7f00166ab700 1 -- 172.21.15.1:0/180378396 shutdown_connections 2023-11-15T02:37:08.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.799+0000 7f00166ab700 1 --2- 172.21.15.1:0/180378396 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7efffc05f270 0x7efffc061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.799+0000 7f00166ab700 1 --2- 172.21.15.1:0/180378396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f00100a7310 0x7f00100bfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.799+0000 7f00166ab700 1 --2- 172.21.15.1:0/180378396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00100c26d0 0x7f00100acaf0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.799+0000 7f00166ab700 1 --2- 172.21.15.1:0/180378396 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00100acfe0 0x7f00100a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.799+0000 7f00166ab700 1 -- 172.21.15.1:0/180378396 >> 172.21.15.1:0/180378396 conn(0x7f0010082f90 msgr2=0x7f00100bf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:08.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.799+0000 7f00166ab700 1 -- 172.21.15.1:0/180378396 shutdown_connections 2023-11-15T02:37:08.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.799+0000 7f00166ab700 1 -- 172.21.15.1:0/180378396 wait complete. 2023-11-15T02:37:08.813 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-15T02:37:08.813 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-15T02:37:08.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.935+0000 7f1b4d6fb700 1 Processor -- start 2023-11-15T02:37:08.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.935+0000 7f1b4d6fb700 1 -- start start 2023-11-15T02:37:08.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.936+0000 7f1b4d6fb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b4814b350 0x7f1b480c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.936+0000 7f1b4d6fb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1b4814b730 0x7f1b48154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.936+0000 7f1b4d6fb700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b481580d0 con 0x7f1b480aa040 2023-11-15T02:37:08.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.936+0000 7f1b4d6fb700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b48155000 con 0x7f1b4814b730 2023-11-15T02:37:08.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.936+0000 7f1b4d6fb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b481552e0 con 0x7f1b4814b350 2023-11-15T02:37:08.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.936+0000 7f1b467fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1b4814b730 0x7f1b48154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.936+0000 7f1b477fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f1b480aa040 0x7f1b48158560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58630/0 (socket says 172.21.15.1:58630) 2023-11-15T02:37:08.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.936+0000 7f1b477fe700 1 -- 172.21.15.1:0/707194817 learned_addr learned my addr 172.21.15.1:0/707194817 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:08.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.936+0000 7f1b46ffd700 1 --2- 172.21.15.1:0/707194817 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b4814b350 0x7f1b480c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.936+0000 7f1b467fc700 1 -- 172.21.15.1:0/707194817 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b4814b350 msgr2=0x7f1b480c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:08.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.936+0000 7f1b467fc700 1 --2- 172.21.15.1:0/707194817 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b4814b350 0x7f1b480c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.936+0000 7f1b467fc700 1 -- 172.21.15.1:0/707194817 >> v1:172.21.15.1:6789/0 conn(0x7f1b480aa040 legacy=0x7f1b48158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.936+0000 7f1b45ffb700 1 -- 172.21.15.1:0/707194817 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286494191 0 0) 0x7f1b481580d0 con 0x7f1b480aa040 2023-11-15T02:37:08.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.936+0000 7f1b467fc700 1 -- 172.21.15.1:0/707194817 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b481555c0 con 0x7f1b4814b730 2023-11-15T02:37:08.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.936+0000 7f1b467fc700 1 --2- 172.21.15.1:0/707194817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b4814b730 0x7f1b48154a10 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f1b3c009760 tx=0x7f1b3c009060).ready entity=mon.0 client_cookie=e11e1ae7fa7bf677 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:08.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.937+0000 7f1b45ffb700 1 -- 172.21.15.1:0/707194817 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c00b580 con 0x7f1b4814b730 2023-11-15T02:37:08.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.937+0000 7f1b45ffb700 1 -- 172.21.15.1:0/707194817 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c00b6e0 con 0x7f1b4814b730 2023-11-15T02:37:08.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.937+0000 7f1b45ffb700 1 -- 172.21.15.1:0/707194817 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c00ba60 con 0x7f1b4814b730 2023-11-15T02:37:08.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.937+0000 7f1b4d6fb700 1 -- 172.21.15.1:0/707194817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b4814b730 msgr2=0x7f1b48154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.937+0000 7f1b4d6fb700 1 --2- 172.21.15.1:0/707194817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b4814b730 0x7f1b48154a10 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f1b3c009760 tx=0x7f1b3c009060).stop 2023-11-15T02:37:08.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.937+0000 7f1b4d6fb700 1 -- 172.21.15.1:0/707194817 shutdown_connections 2023-11-15T02:37:08.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.937+0000 7f1b4d6fb700 1 --2- 172.21.15.1:0/707194817 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b4814b350 0x7f1b480c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.937+0000 7f1b4d6fb700 1 --2- 172.21.15.1:0/707194817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b4814b730 0x7f1b48154a10 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.937+0000 7f1b4d6fb700 1 -- 172.21.15.1:0/707194817 >> 172.21.15.1:0/707194817 conn(0x7f1b48069ee0 msgr2=0x7f1b4806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:08.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.937+0000 7f1b4d6fb700 1 -- 172.21.15.1:0/707194817 shutdown_connections 2023-11-15T02:37:08.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.937+0000 7f1b4d6fb700 1 -- 172.21.15.1:0/707194817 wait complete. 2023-11-15T02:37:08.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.938+0000 7f1b4d6fb700 1 Processor -- start 2023-11-15T02:37:08.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.938+0000 7f1b4d6fb700 1 -- start start 2023-11-15T02:37:08.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.939+0000 7f1b4d6fb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b480aa040 0x7f1b480c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.939+0000 7f1b4d6fb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b4814b350 0x7f1b480b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.939+0000 7f1b4d6fb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b4814b730 0x7f1b48155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.939+0000 7f1b4d6fb700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480af1a0 con 0x7f1b4814b350 2023-11-15T02:37:08.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.939+0000 7f1b4d6fb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480c4fe0 con 0x7f1b4814b730 2023-11-15T02:37:08.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.939+0000 7f1b4d6fb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480ae590 con 0x7f1b480aa040 2023-11-15T02:37:08.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.939+0000 7f1b467fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b4814b350 0x7f1b480b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.939+0000 7f1b467fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b4814b350 0x7f1b480b0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37844/0 (socket says 172.21.15.1:37844) 2023-11-15T02:37:08.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.939+0000 7f1b467fc700 1 -- 172.21.15.1:0/1087814806 learned_addr learned my addr 172.21.15.1:0/1087814806 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:08.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.939+0000 7f1b46ffd700 1 --2- 172.21.15.1:0/1087814806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b480aa040 0x7f1b480c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.939+0000 7f1b477fe700 1 --2- 172.21.15.1:0/1087814806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b4814b730 0x7f1b48155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.939+0000 7f1b467fc700 1 -- 172.21.15.1:0/1087814806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b480aa040 msgr2=0x7f1b480c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.939+0000 7f1b467fc700 1 --2- 172.21.15.1:0/1087814806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b480aa040 0x7f1b480c4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.940+0000 7f1b467fc700 1 -- 172.21.15.1:0/1087814806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b4814b730 msgr2=0x7f1b48155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:08.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.940+0000 7f1b467fc700 1 --2- 172.21.15.1:0/1087814806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b4814b730 0x7f1b48155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:08.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.940+0000 7f1b467fc700 1 -- 172.21.15.1:0/1087814806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0092a0 con 0x7f1b4814b350 2023-11-15T02:37:08.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.940+0000 7f1b477fe700 1 --2- 172.21.15.1:0/1087814806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b4814b730 0x7f1b48155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:08.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.940+0000 7f1b467fc700 1 --2- 172.21.15.1:0/1087814806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b4814b350 0x7f1b480b0090 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f1b48083e50 tx=0x7f1b3c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:08.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.940+0000 7f1b2effd700 1 -- 172.21.15.1:0/1087814806 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c00b850 con 0x7f1b4814b350 2023-11-15T02:37:08.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.940+0000 7f1b2effd700 1 -- 172.21.15.1:0/1087814806 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c00b9b0 con 0x7f1b4814b350 2023-11-15T02:37:08.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.940+0000 7f1b4d6fb700 1 -- 172.21.15.1:0/1087814806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b480ae870 con 0x7f1b4814b350 2023-11-15T02:37:08.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.940+0000 7f1b2effd700 1 -- 172.21.15.1:0/1087814806 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c01b660 con 0x7f1b4814b350 2023-11-15T02:37:08.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.940+0000 7f1b4d6fb700 1 -- 172.21.15.1:0/1087814806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b480aee30 con 0x7f1b4814b350 2023-11-15T02:37:08.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.941+0000 7f1b4d6fb700 1 -- 172.21.15.1:0/1087814806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4806c7e0 con 0x7f1b4814b350 2023-11-15T02:37:08.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.941+0000 7f1b2effd700 1 -- 172.21.15.1:0/1087814806 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1b3c01ba90 con 0x7f1b4814b350 2023-11-15T02:37:08.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.941+0000 7f1b2effd700 1 --2- 172.21.15.1:0/1087814806 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b3405f270 0x7f1b34061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:08.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.942+0000 7f1b2effd700 1 -- 172.21.15.1:0/1087814806 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f1b3c07bd10 con 0x7f1b4814b350 2023-11-15T02:37:08.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.942+0000 7f1b46ffd700 1 --2- 172.21.15.1:0/1087814806 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b3405f270 0x7f1b34061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:08.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.942+0000 7f1b46ffd700 1 --2- 172.21.15.1:0/1087814806 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b3405f270 0x7f1b34061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1b38006fd0 tx=0x7f1b38008040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:08.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:08.946+0000 7f1b2effd700 1 -- 172.21.15.1:0/1087814806 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1b3c04cfc0 con 0x7f1b4814b350 2023-11-15T02:37:09.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:09.121+0000 7f1b4d6fb700 1 -- 172.21.15.1:0/1087814806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f1b48154410 con 0x7f1b4814b350 2023-11-15T02:37:10.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.107+0000 7f1b2effd700 1 -- 172.21.15.1:0/1087814806 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v174) v1 ==== 152+0+0 (secure 0 0 0) 0x7f1b3c01f020 con 0x7f1b4814b350 2023-11-15T02:37:10.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.110+0000 7f1b4d6fb700 1 -- 172.21.15.1:0/1087814806 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b3405f270 msgr2=0x7f1b34061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:10.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.110+0000 7f1b4d6fb700 1 --2- 172.21.15.1:0/1087814806 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b3405f270 0x7f1b34061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1b38006fd0 tx=0x7f1b38008040).stop 2023-11-15T02:37:10.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.110+0000 7f1b4d6fb700 1 -- 172.21.15.1:0/1087814806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b4814b350 msgr2=0x7f1b480b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:10.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.110+0000 7f1b4d6fb700 1 --2- 172.21.15.1:0/1087814806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b4814b350 0x7f1b480b0090 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f1b48083e50 tx=0x7f1b3c017000).stop 2023-11-15T02:37:10.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.110+0000 7f1b4d6fb700 1 -- 172.21.15.1:0/1087814806 shutdown_connections 2023-11-15T02:37:10.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.110+0000 7f1b4d6fb700 1 --2- 172.21.15.1:0/1087814806 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f1b3405f270 0x7f1b34061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:10.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.110+0000 7f1b4d6fb700 1 --2- 172.21.15.1:0/1087814806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b4814b730 0x7f1b48155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:10.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.110+0000 7f1b4d6fb700 1 --2- 172.21.15.1:0/1087814806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b480aa040 0x7f1b480c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:10.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.110+0000 7f1b4d6fb700 1 --2- 172.21.15.1:0/1087814806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b4814b350 0x7f1b480b0090 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:10.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.110+0000 7f1b4d6fb700 1 -- 172.21.15.1:0/1087814806 >> 172.21.15.1:0/1087814806 conn(0x7f1b48069ee0 msgr2=0x7f1b480c1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:10.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.110+0000 7f1b4d6fb700 1 -- 172.21.15.1:0/1087814806 shutdown_connections 2023-11-15T02:37:10.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.110+0000 7f1b4d6fb700 1 -- 172.21.15.1:0/1087814806 wait complete. 2023-11-15T02:37:10.115 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2023-11-15T02:37:10.132 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-15T02:37:10.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.259+0000 7f8b30896700 1 Processor -- start 2023-11-15T02:37:10.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.259+0000 7f8b30896700 1 -- start start 2023-11-15T02:37:10.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.260+0000 7f8b30896700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b2c137030 0x7f8b2c137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:10.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.260+0000 7f8b30896700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8b2c1588e0 0x7f8b2c066870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.260+0000 7f8b30896700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2c0671d0 con 0x7f8b2c066d60 2023-11-15T02:37:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.260+0000 7f8b30896700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2c137900 con 0x7f8b2c1588e0 2023-11-15T02:37:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.260+0000 7f8b30896700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c154ce0 con 0x7f8b2c137030 2023-11-15T02:37:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.260+0000 7f8b2ad9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8b2c066d60 0x7f8b2c14e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58646/0 (socket says 172.21.15.1:58646) 2023-11-15T02:37:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.260+0000 7f8b2ad9d700 1 -- 172.21.15.1:0/752628776 learned_addr learned my addr 172.21.15.1:0/752628776 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.260+0000 7f8b29d9b700 1 --2- 172.21.15.1:0/752628776 >> v2:172.21.15.141:3300/0 conn(0x7f8b2c1588e0 0x7f8b2c066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.260+0000 7f8b2a59c700 1 --2- 172.21.15.1:0/752628776 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b2c137030 0x7f8b2c137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.260+0000 7f8b2959a700 1 -- 172.21.15.1:0/752628776 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662332593 0 0) 0x7f8b2c0671d0 con 0x7f8b2c066d60 2023-11-15T02:37:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.261+0000 7f8b2959a700 1 -- 172.21.15.1:0/752628776 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b140033f0 con 0x7f8b2c066d60 2023-11-15T02:37:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.261+0000 7f8b2959a700 1 -- 172.21.15.1:0/752628776 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4126504085 0 0) 0x7f8b140033f0 con 0x7f8b2c066d60 2023-11-15T02:37:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.261+0000 7f8b29d9b700 1 -- 172.21.15.1:0/752628776 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b2c137030 msgr2=0x7f8b2c137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.261+0000 7f8b29d9b700 1 --2- 172.21.15.1:0/752628776 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b2c137030 0x7f8b2c137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.261+0000 7f8b29d9b700 1 -- 172.21.15.1:0/752628776 >> v1:172.21.15.1:6789/0 conn(0x7f8b2c066d60 legacy=0x7f8b2c14e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.261+0000 7f8b29d9b700 1 -- 172.21.15.1:0/752628776 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c154fc0 con 0x7f8b2c1588e0 2023-11-15T02:37:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.261+0000 7f8b2a59c700 1 --2- 172.21.15.1:0/752628776 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b2c137030 0x7f8b2c137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:37:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.261+0000 7f8b29d9b700 1 --2- 172.21.15.1:0/752628776 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b2c1588e0 0x7f8b2c066870 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f8b20009760 tx=0x7f8b20009060).ready entity=mon.1 client_cookie=1ac6184d1bb30c05 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.261+0000 7f8b2959a700 1 -- 172.21.15.1:0/752628776 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b240017f0 con 0x7f8b2c1588e0 2023-11-15T02:37:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.261+0000 7f8b2959a700 1 -- 172.21.15.1:0/752628776 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b20011400 con 0x7f8b2c1588e0 2023-11-15T02:37:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.261+0000 7f8b2959a700 1 -- 172.21.15.1:0/752628776 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20011780 con 0x7f8b2c1588e0 2023-11-15T02:37:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.262+0000 7f8b30896700 1 -- 172.21.15.1:0/752628776 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b2c1588e0 msgr2=0x7f8b2c066870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.262+0000 7f8b30896700 1 --2- 172.21.15.1:0/752628776 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b2c1588e0 0x7f8b2c066870 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f8b20009760 tx=0x7f8b20009060).stop 2023-11-15T02:37:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.262+0000 7f8b30896700 1 -- 172.21.15.1:0/752628776 shutdown_connections 2023-11-15T02:37:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.262+0000 7f8b30896700 1 --2- 172.21.15.1:0/752628776 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b2c137030 0x7f8b2c137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.262+0000 7f8b30896700 1 --2- 172.21.15.1:0/752628776 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b2c1588e0 0x7f8b2c066870 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.262+0000 7f8b30896700 1 -- 172.21.15.1:0/752628776 >> 172.21.15.1:0/752628776 conn(0x7f8b2c063280 msgr2=0x7f8b2c0c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.262+0000 7f8b30896700 1 -- 172.21.15.1:0/752628776 shutdown_connections 2023-11-15T02:37:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.262+0000 7f8b30896700 1 -- 172.21.15.1:0/752628776 wait complete. 2023-11-15T02:37:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.263+0000 7f8b30896700 1 Processor -- start 2023-11-15T02:37:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.263+0000 7f8b30896700 1 -- start start 2023-11-15T02:37:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b30896700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b2c066d60 0x7f8b2c138bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b30896700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b2c137030 0x7f8b2c0ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b30896700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b2c1588e0 0x7f8b2c167490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b30896700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c1503c0 con 0x7f8b2c137030 2023-11-15T02:37:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b30896700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c1390e0 con 0x7f8b2c1588e0 2023-11-15T02:37:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b30896700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c0aecc0 con 0x7f8b2c066d60 2023-11-15T02:37:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b29d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b2c137030 0x7f8b2c0ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b29d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b2c137030 0x7f8b2c0ae7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37856/0 (socket says 172.21.15.1:37856) 2023-11-15T02:37:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b29d9b700 1 -- 172.21.15.1:0/58257300 learned_addr learned my addr 172.21.15.1:0/58257300 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b2a59c700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b2c066d60 0x7f8b2c138bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b2ad9d700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b2c1588e0 0x7f8b2c167490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b29d9b700 1 -- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b2c066d60 msgr2=0x7f8b2c138bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b29d9b700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b2c066d60 0x7f8b2c138bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b29d9b700 1 -- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b2c1588e0 msgr2=0x7f8b2c167490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b29d9b700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b2c1588e0 0x7f8b2c167490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:10.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b29d9b700 1 -- 172.21.15.1:0/58257300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c0092a0 con 0x7f8b2c137030 2023-11-15T02:37:10.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b2a59c700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b2c066d60 0x7f8b2c138bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:10.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b2ad9d700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b2c1588e0 0x7f8b2c167490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:10.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b29d9b700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b2c137030 0x7f8b2c0ae7d0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f8b200118a0 tx=0x7f8b20016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:10.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b1a7fc700 1 -- 172.21.15.1:0/58257300 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20010950 con 0x7f8b2c137030 2023-11-15T02:37:10.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b1a7fc700 1 -- 172.21.15.1:0/58257300 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b20010ab0 con 0x7f8b2c137030 2023-11-15T02:37:10.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b30896700 1 -- 172.21.15.1:0/58257300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b200092a0 con 0x7f8b2c137030 2023-11-15T02:37:10.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b1a7fc700 1 -- 172.21.15.1:0/58257300 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20010e50 con 0x7f8b2c137030 2023-11-15T02:37:10.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.264+0000 7f8b30896700 1 -- 172.21.15.1:0/58257300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2c14fa90 con 0x7f8b2c137030 2023-11-15T02:37:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.265+0000 7f8b30896700 1 -- 172.21.15.1:0/58257300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2c06c7e0 con 0x7f8b2c137030 2023-11-15T02:37:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.266+0000 7f8b1a7fc700 1 -- 172.21.15.1:0/58257300 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8b200263b0 con 0x7f8b2c137030 2023-11-15T02:37:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.266+0000 7f8b1a7fc700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b0c05f270 0x7f8b0c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.266+0000 7f8b1a7fc700 1 -- 172.21.15.1:0/58257300 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6135+0+0 (secure 0 0 0) 0x7f8b2007b160 con 0x7f8b2c137030 2023-11-15T02:37:10.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.266+0000 7f8b2a59c700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b0c05f270 0x7f8b0c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:10.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.267+0000 7f8b2a59c700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b0c05f270 0x7f8b0c061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8b1c009270 tx=0x7f8b1c008040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:10.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.271+0000 7f8b1a7fc700 1 -- 172.21.15.1:0/58257300 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8b2004c2f0 con 0x7f8b2c137030 2023-11-15T02:37:10.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:10.444+0000 7f8b30896700 1 -- 172.21.15.1:0/58257300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8b2c0c76a0 con 0x7f8b2c137030 2023-11-15T02:37:11.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.119+0000 7f8b1a7fc700 1 -- 172.21.15.1:0/58257300 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v175) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8b2004f910 con 0x7f8b2c137030 2023-11-15T02:37:11.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.129+0000 7f8b30896700 1 -- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b0c05f270 msgr2=0x7f8b0c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.129+0000 7f8b30896700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b0c05f270 0x7f8b0c061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8b1c009270 tx=0x7f8b1c008040).stop 2023-11-15T02:37:11.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.129+0000 7f8b30896700 1 -- 172.21.15.1:0/58257300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b2c137030 msgr2=0x7f8b2c0ae7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.129+0000 7f8b30896700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b2c137030 0x7f8b2c0ae7d0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f8b200118a0 tx=0x7f8b20016000).stop 2023-11-15T02:37:11.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.129+0000 7f8b30896700 1 -- 172.21.15.1:0/58257300 shutdown_connections 2023-11-15T02:37:11.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.129+0000 7f8b30896700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8b0c05f270 0x7f8b0c061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.129+0000 7f8b30896700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b2c1588e0 0x7f8b2c167490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.129+0000 7f8b30896700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b2c066d60 0x7f8b2c138bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.129+0000 7f8b30896700 1 --2- 172.21.15.1:0/58257300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b2c137030 0x7f8b2c0ae7d0 secure :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0x7f8b200118a0 tx=0x7f8b20016000).stop 2023-11-15T02:37:11.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.130+0000 7f8b30896700 1 -- 172.21.15.1:0/58257300 >> 172.21.15.1:0/58257300 conn(0x7f8b2c063280 msgr2=0x7f8b2c156140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:11.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.132+0000 7f8b30896700 1 -- 172.21.15.1:0/58257300 shutdown_connections 2023-11-15T02:37:11.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.133+0000 7f8b30896700 1 -- 172.21.15.1:0/58257300 wait complete. 2023-11-15T02:37:11.140 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2023-11-15T02:37:11.154 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-15T02:37:11.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.275+0000 7f3c304b5700 1 Processor -- start 2023-11-15T02:37:11.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.275+0000 7f3c304b5700 1 -- start start 2023-11-15T02:37:11.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c304b5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3c28062ec0 0x7f3c2814eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c304b5700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3c28155370 0x7f3c280c6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c304b5700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c28158e40 con 0x7f3c2814e6e0 2023-11-15T02:37:11.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c304b5700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c28158230 con 0x7f3c28062ec0 2023-11-15T02:37:11.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c304b5700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c28158510 con 0x7f3c28155370 2023-11-15T02:37:11.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c2da50700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3c28062ec0 0x7f3c2814eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c2e251700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3c2814e6e0 0x7f3c280627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58654/0 (socket says 172.21.15.1:58654) 2023-11-15T02:37:11.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c2da50700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3c28062ec0 0x7f3c2814eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37864/0 (socket says 172.21.15.1:37864) 2023-11-15T02:37:11.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c2e251700 1 -- 172.21.15.1:0/2172139197 learned_addr learned my addr 172.21.15.1:0/2172139197 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:11.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c2da50700 1 -- 172.21.15.1:0/2172139197 >> v2:172.21.15.141:3300/0 conn(0x7f3c28155370 msgr2=0x7f3c280c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:11.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c2ea52700 1 --2- 172.21.15.1:0/2172139197 >> v2:172.21.15.141:3300/0 conn(0x7f3c28155370 0x7f3c280c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c2da50700 1 --2- 172.21.15.1:0/2172139197 >> v2:172.21.15.141:3300/0 conn(0x7f3c28155370 0x7f3c280c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c2d24f700 1 -- 172.21.15.1:0/2172139197 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412154271 0 0) 0x7f3c28158e40 con 0x7f3c2814e6e0 2023-11-15T02:37:11.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c2da50700 1 -- 172.21.15.1:0/2172139197 >> v1:172.21.15.1:6789/0 conn(0x7f3c2814e6e0 legacy=0x7f3c280627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c2da50700 1 -- 172.21.15.1:0/2172139197 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c281587f0 con 0x7f3c28062ec0 2023-11-15T02:37:11.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.276+0000 7f3c2ea52700 1 --2- 172.21.15.1:0/2172139197 >> v2:172.21.15.141:3300/0 conn(0x7f3c28155370 0x7f3c280c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:11.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.277+0000 7f3c2da50700 1 --2- 172.21.15.1:0/2172139197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c28062ec0 0x7f3c2814eac0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f3c2814efb0 tx=0x7f3c18009060).ready entity=mon.0 client_cookie=27938fff73580a40 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:11.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.277+0000 7f3c2d24f700 1 -- 172.21.15.1:0/2172139197 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800b580 con 0x7f3c28062ec0 2023-11-15T02:37:11.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.277+0000 7f3c2d24f700 1 -- 172.21.15.1:0/2172139197 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1800b6e0 con 0x7f3c28062ec0 2023-11-15T02:37:11.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.277+0000 7f3c2d24f700 1 -- 172.21.15.1:0/2172139197 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800ba60 con 0x7f3c28062ec0 2023-11-15T02:37:11.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.277+0000 7f3c304b5700 1 -- 172.21.15.1:0/2172139197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c28062ec0 msgr2=0x7f3c2814eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.277+0000 7f3c304b5700 1 --2- 172.21.15.1:0/2172139197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c28062ec0 0x7f3c2814eac0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f3c2814efb0 tx=0x7f3c18009060).stop 2023-11-15T02:37:11.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.277+0000 7f3c304b5700 1 -- 172.21.15.1:0/2172139197 shutdown_connections 2023-11-15T02:37:11.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.277+0000 7f3c304b5700 1 --2- 172.21.15.1:0/2172139197 >> v2:172.21.15.141:3300/0 conn(0x7f3c28155370 0x7f3c280c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.277+0000 7f3c304b5700 1 --2- 172.21.15.1:0/2172139197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c28062ec0 0x7f3c2814eac0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.277+0000 7f3c304b5700 1 -- 172.21.15.1:0/2172139197 >> 172.21.15.1:0/2172139197 conn(0x7f3c280c7dc0 msgr2=0x7f3c280c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:11.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.277+0000 7f3c304b5700 1 -- 172.21.15.1:0/2172139197 shutdown_connections 2023-11-15T02:37:11.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.277+0000 7f3c304b5700 1 -- 172.21.15.1:0/2172139197 wait complete. 2023-11-15T02:37:11.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.279+0000 7f3c304b5700 1 Processor -- start 2023-11-15T02:37:11.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.279+0000 7f3c304b5700 1 -- start start 2023-11-15T02:37:11.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.279+0000 7f3c304b5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c28062ec0 0x7f3c28138050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.279+0000 7f3c304b5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c2814e6e0 0x7f3c280a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.279+0000 7f3c304b5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c28155370 0x7f3c28138890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.279+0000 7f3c304b5700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280a6970 con 0x7f3c28155370 2023-11-15T02:37:11.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.279+0000 7f3c304b5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280a5d60 con 0x7f3c28062ec0 2023-11-15T02:37:11.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.279+0000 7f3c304b5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280a6040 con 0x7f3c2814e6e0 2023-11-15T02:37:11.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.279+0000 7f3c2ea52700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c28155370 0x7f3c28138890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.280+0000 7f3c2ea52700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c28155370 0x7f3c28138890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37880/0 (socket says 172.21.15.1:37880) 2023-11-15T02:37:11.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.280+0000 7f3c2ea52700 1 -- 172.21.15.1:0/479256595 learned_addr learned my addr 172.21.15.1:0/479256595 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:11.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.280+0000 7f3c2e251700 1 --2- 172.21.15.1:0/479256595 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c28062ec0 0x7f3c28138050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.280+0000 7f3c2da50700 1 --2- 172.21.15.1:0/479256595 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c2814e6e0 0x7f3c280a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.280+0000 7f3c2ea52700 1 -- 172.21.15.1:0/479256595 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c2814e6e0 msgr2=0x7f3c280a6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.280+0000 7f3c2ea52700 1 --2- 172.21.15.1:0/479256595 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c2814e6e0 0x7f3c280a6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.280+0000 7f3c2ea52700 1 -- 172.21.15.1:0/479256595 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c28062ec0 msgr2=0x7f3c28138050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.280+0000 7f3c2ea52700 1 --2- 172.21.15.1:0/479256595 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c28062ec0 0x7f3c28138050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.280+0000 7f3c2ea52700 1 -- 172.21.15.1:0/479256595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c180092a0 con 0x7f3c28155370 2023-11-15T02:37:11.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.280+0000 7f3c2ea52700 1 --2- 172.21.15.1:0/479256595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c28155370 0x7f3c28138890 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f3c2000cef0 tx=0x7f3c20007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:11.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.280+0000 7f3c1e7fc700 1 -- 172.21.15.1:0/479256595 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2000ae00 con 0x7f3c28155370 2023-11-15T02:37:11.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.280+0000 7f3c1e7fc700 1 -- 172.21.15.1:0/479256595 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c20016400 con 0x7f3c28155370 2023-11-15T02:37:11.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.280+0000 7f3c304b5700 1 -- 172.21.15.1:0/479256595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c280a6320 con 0x7f3c28155370 2023-11-15T02:37:11.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.280+0000 7f3c1e7fc700 1 -- 172.21.15.1:0/479256595 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20016780 con 0x7f3c28155370 2023-11-15T02:37:11.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.280+0000 7f3c304b5700 1 -- 172.21.15.1:0/479256595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c280a5a10 con 0x7f3c28155370 2023-11-15T02:37:11.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.281+0000 7f3c304b5700 1 -- 172.21.15.1:0/479256595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c280a6ae0 con 0x7f3c28155370 2023-11-15T02:37:11.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.282+0000 7f3c1e7fc700 1 -- 172.21.15.1:0/479256595 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3c2001f3f0 con 0x7f3c28155370 2023-11-15T02:37:11.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.282+0000 7f3c1e7fc700 1 --2- 172.21.15.1:0/479256595 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3c0c05f270 0x7f3c0c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.282+0000 7f3c1e7fc700 1 -- 172.21.15.1:0/479256595 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f3c2007b1c0 con 0x7f3c28155370 2023-11-15T02:37:11.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.282+0000 7f3c2e251700 1 --2- 172.21.15.1:0/479256595 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3c0c05f270 0x7f3c0c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.283+0000 7f3c2e251700 1 --2- 172.21.15.1:0/479256595 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3c0c05f270 0x7f3c0c061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f3c240011e0 tx=0x7f3c24009040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:11.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.286+0000 7f3c1e7fc700 1 -- 172.21.15.1:0/479256595 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3c2004c0e0 con 0x7f3c28155370 2023-11-15T02:37:11.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.503+0000 7f3c304b5700 1 -- 172.21.15.1:0/479256595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3c2806c7e0 con 0x7f3c28155370 2023-11-15T02:37:11.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.509+0000 7f3c1e7fc700 1 -- 172.21.15.1:0/479256595 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v75) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3c2004f700 con 0x7f3c28155370 2023-11-15T02:37:11.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.514+0000 7f3c304b5700 1 -- 172.21.15.1:0/479256595 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3c0c05f270 msgr2=0x7f3c0c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.514+0000 7f3c304b5700 1 --2- 172.21.15.1:0/479256595 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3c0c05f270 0x7f3c0c061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f3c240011e0 tx=0x7f3c24009040).stop 2023-11-15T02:37:11.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.514+0000 7f3c304b5700 1 -- 172.21.15.1:0/479256595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c28155370 msgr2=0x7f3c28138890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.514+0000 7f3c304b5700 1 --2- 172.21.15.1:0/479256595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c28155370 0x7f3c28138890 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f3c2000cef0 tx=0x7f3c20007860).stop 2023-11-15T02:37:11.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.516+0000 7f3c304b5700 1 -- 172.21.15.1:0/479256595 shutdown_connections 2023-11-15T02:37:11.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.516+0000 7f3c304b5700 1 --2- 172.21.15.1:0/479256595 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3c0c05f270 0x7f3c0c061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.516+0000 7f3c304b5700 1 --2- 172.21.15.1:0/479256595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c28155370 0x7f3c28138890 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.516+0000 7f3c304b5700 1 --2- 172.21.15.1:0/479256595 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c28062ec0 0x7f3c28138050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.516+0000 7f3c304b5700 1 --2- 172.21.15.1:0/479256595 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c2814e6e0 0x7f3c280a6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.516+0000 7f3c304b5700 1 -- 172.21.15.1:0/479256595 >> 172.21.15.1:0/479256595 conn(0x7f3c280c7dc0 msgr2=0x7f3c28154180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:11.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.516+0000 7f3c304b5700 1 -- 172.21.15.1:0/479256595 shutdown_connections 2023-11-15T02:37:11.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.517+0000 7f3c304b5700 1 -- 172.21.15.1:0/479256595 wait complete. 2023-11-15T02:37:11.530 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 21 and data pool 22 2023-11-15T02:37:11.543 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:37:11.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.660+0000 7f8cb2191700 1 Processor -- start 2023-11-15T02:37:11.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.660+0000 7f8cb2191700 1 -- start start 2023-11-15T02:37:11.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.660+0000 7f8cb2191700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8cac0ab1a0 0x7f8cac154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.660+0000 7f8cb2191700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cac0c06f0 con 0x7f8cac154150 2023-11-15T02:37:11.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.660+0000 7f8cb2191700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cac0c09d0 con 0x7f8cac0aa060 2023-11-15T02:37:11.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.660+0000 7f8cb2191700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cac158820 con 0x7f8cac0ab1a0 2023-11-15T02:37:11.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8cab7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8cac154150 0x7f8cac158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58656/0 (socket says 172.21.15.1:58656) 2023-11-15T02:37:11.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8cab7fe700 1 -- 172.21.15.1:0/3200274313 learned_addr learned my addr 172.21.15.1:0/3200274313 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:11.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caaffd700 1 --2- 172.21.15.1:0/3200274313 >> v2:172.21.15.141:3300/0 conn(0x7f8cac0ab1a0 0x7f8cac154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caa7fc700 1 -- 172.21.15.1:0/3200274313 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588186001 0 0) 0x7f8cac0c06f0 con 0x7f8cac154150 2023-11-15T02:37:11.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caa7fc700 1 -- 172.21.15.1:0/3200274313 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c940033f0 con 0x7f8cac154150 2023-11-15T02:37:11.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caa7fc700 1 -- 172.21.15.1:0/3200274313 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3113808014 0 0) 0x7f8c940033f0 con 0x7f8cac154150 2023-11-15T02:37:11.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caa7fc700 1 -- 172.21.15.1:0/3200274313 >> v2:172.21.15.141:3300/0 conn(0x7f8cac0ab1a0 msgr2=0x7f8cac154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:11.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caa7fc700 1 --2- 172.21.15.1:0/3200274313 >> v2:172.21.15.141:3300/0 conn(0x7f8cac0ab1a0 0x7f8cac154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caa7fc700 1 -- 172.21.15.1:0/3200274313 >> v1:172.21.15.141:6789/0 conn(0x7f8cac0aa060 legacy=0x7f8cac0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caa7fc700 1 -- 172.21.15.1:0/3200274313 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac158b00 con 0x7f8cac154150 2023-11-15T02:37:11.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caa7fc700 1 -- 172.21.15.1:0/3200274313 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f8c9c001470 con 0x7f8cac154150 2023-11-15T02:37:11.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caa7fc700 1 -- 172.21.15.1:0/3200274313 >> v1:172.21.15.1:6789/0 conn(0x7f8cac154150 legacy=0x7f8cac158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caa7fc700 1 --2- 172.21.15.1:0/3200274313 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c940038e0 0x7f8c94003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caa7fc700 1 --2- 172.21.15.1:0/3200274313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c94004690 0x7f8c94004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caa7fc700 1 --2- 172.21.15.1:0/3200274313 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c94005050 0x7f8c9400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caa7fc700 1 -- 172.21.15.1:0/3200274313 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac158820 con 0x7f8c940038e0 2023-11-15T02:37:11.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caa7fc700 1 -- 172.21.15.1:0/3200274313 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9400bfe0 con 0x7f8c94004690 2023-11-15T02:37:11.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caa7fc700 1 -- 172.21.15.1:0/3200274313 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9400c1a0 con 0x7f8c94005050 2023-11-15T02:37:11.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8cab7fe700 1 --2- 172.21.15.1:0/3200274313 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c940038e0 0x7f8c94003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8caaffd700 1 --2- 172.21.15.1:0/3200274313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c94004690 0x7f8c94004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.661+0000 7f8cabfff700 1 --2- 172.21.15.1:0/3200274313 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c94005050 0x7f8c9400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8cab7fe700 1 -- 172.21.15.1:0/3200274313 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c94005050 msgr2=0x7f8c9400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:11.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8cab7fe700 1 --2- 172.21.15.1:0/3200274313 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c94005050 0x7f8c9400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8cab7fe700 1 -- 172.21.15.1:0/3200274313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c94004690 msgr2=0x7f8c94004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:11.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8cab7fe700 1 --2- 172.21.15.1:0/3200274313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c94004690 0x7f8c94004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8cab7fe700 1 -- 172.21.15.1:0/3200274313 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c940033f0 con 0x7f8c940038e0 2023-11-15T02:37:11.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8cabfff700 1 -- 172.21.15.1:0/3200274313 reap_dead start 2023-11-15T02:37:11.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8cab7fe700 1 --2- 172.21.15.1:0/3200274313 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c940038e0 0x7f8c94003d00 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f8c9c00c160 tx=0x7f8c9c001e50).ready entity=mon.0 client_cookie=2a2ad4f91b5da987 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:11.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8caa7fc700 1 -- 172.21.15.1:0/3200274313 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c007a20 con 0x7f8c940038e0 2023-11-15T02:37:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8caa7fc700 1 -- 172.21.15.1:0/3200274313 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c00ca90 con 0x7f8c940038e0 2023-11-15T02:37:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8caa7fc700 1 -- 172.21.15.1:0/3200274313 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c00ce10 con 0x7f8c940038e0 2023-11-15T02:37:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8cb2191700 1 -- 172.21.15.1:0/3200274313 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c940038e0 msgr2=0x7f8c94003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8cb2191700 1 --2- 172.21.15.1:0/3200274313 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c940038e0 0x7f8c94003d00 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f8c9c00c160 tx=0x7f8c9c001e50).stop 2023-11-15T02:37:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8cb2191700 1 -- 172.21.15.1:0/3200274313 shutdown_connections 2023-11-15T02:37:11.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8cb2191700 1 --2- 172.21.15.1:0/3200274313 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c940038e0 0x7f8c94003d00 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8cb2191700 1 -- 172.21.15.1:0/3200274313 >> 172.21.15.1:0/3200274313 conn(0x7f8cac064aa0 msgr2=0x7f8cac064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:11.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8cb2191700 1 -- 172.21.15.1:0/3200274313 shutdown_connections 2023-11-15T02:37:11.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.662+0000 7f8cb2191700 1 -- 172.21.15.1:0/3200274313 wait complete. 2023-11-15T02:37:11.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.664+0000 7f8cb2191700 1 Processor -- start 2023-11-15T02:37:11.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.664+0000 7f8cb2191700 1 -- start start 2023-11-15T02:37:11.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.664+0000 7f8cb2191700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c940038e0 0x7f8cac14b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.664+0000 7f8cb2191700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cac147470 0x7f8cac149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.664+0000 7f8cb2191700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cac1498f0 0x7f8cac0af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.664+0000 7f8cb2191700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac14b9c0 con 0x7f8cac1498f0 2023-11-15T02:37:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.664+0000 7f8cb2191700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac148f70 con 0x7f8cac147470 2023-11-15T02:37:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.664+0000 7f8cb2191700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac14b6e0 con 0x7f8c940038e0 2023-11-15T02:37:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8cabfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cac1498f0 0x7f8cac0af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8cabfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cac1498f0 0x7f8cac0af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37896/0 (socket says 172.21.15.1:37896) 2023-11-15T02:37:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8cabfff700 1 -- 172.21.15.1:0/2308963838 learned_addr learned my addr 172.21.15.1:0/2308963838 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8caaffd700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cac147470 0x7f8cac149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8cab7fe700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c940038e0 0x7f8cac14b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8cabfff700 1 -- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c940038e0 msgr2=0x7f8cac14b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8cabfff700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c940038e0 0x7f8cac14b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8cabfff700 1 -- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cac147470 msgr2=0x7f8cac149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8cabfff700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cac147470 0x7f8cac149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8cabfff700 1 -- 172.21.15.1:0/2308963838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac148920 con 0x7f8cac1498f0 2023-11-15T02:37:11.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8caaffd700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cac147470 0x7f8cac149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:11.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8cab7fe700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c940038e0 0x7f8cac14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:11.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8cabfff700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cac1498f0 0x7f8cac0af110 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f8cac083f30 tx=0x7f8ca4007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:11.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8c937fe700 1 -- 172.21.15.1:0/2308963838 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4006c30 con 0x7f8cac1498f0 2023-11-15T02:37:11.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8c937fe700 1 -- 172.21.15.1:0/2308963838 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4006d90 con 0x7f8cac1498f0 2023-11-15T02:37:11.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8cb2191700 1 -- 172.21.15.1:0/2308963838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac148c00 con 0x7f8cac1498f0 2023-11-15T02:37:11.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8c937fe700 1 -- 172.21.15.1:0/2308963838 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40072a0 con 0x7f8cac1498f0 2023-11-15T02:37:11.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.665+0000 7f8cb2191700 1 -- 172.21.15.1:0/2308963838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac1478f0 con 0x7f8cac1498f0 2023-11-15T02:37:11.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.666+0000 7f8cb2191700 1 -- 172.21.15.1:0/2308963838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac149120 con 0x7f8cac1498f0 2023-11-15T02:37:11.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.667+0000 7f8c937fe700 1 -- 172.21.15.1:0/2308963838 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8ca4007610 con 0x7f8cac1498f0 2023-11-15T02:37:11.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.667+0000 7f8c937fe700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8c9805f270 0x7f8c98061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.667+0000 7f8c937fe700 1 -- 172.21.15.1:0/2308963838 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f8ca4079cd0 con 0x7f8cac1498f0 2023-11-15T02:37:11.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.667+0000 7f8cab7fe700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8c9805f270 0x7f8c98061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.668+0000 7f8cab7fe700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8c9805f270 0x7f8c98061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f8c9c0010e0 tx=0x7f8c9c015000).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:11.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.671+0000 7f8c937fe700 1 -- 172.21.15.1:0/2308963838 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8cac149120 con 0x7f8cac1498f0 2023-11-15T02:37:11.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.842+0000 7f8cb2191700 1 -- 172.21.15.1:0/2308963838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cac1490e0 con 0x7f8cac1498f0 2023-11-15T02:37:11.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.843+0000 7f8c937fe700 1 -- 172.21.15.1:0/2308963838 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+17668 (secure 0 0 0) 0x7f8ca404ac30 con 0x7f8cac1498f0 2023-11-15T02:37:11.845 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:37:11.845 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":176,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:37:11.505046+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:37:09.163204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-11-15T02:37:10.486624+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:37:11.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.844+0000 7f8cb2191700 1 -- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8c9805f270 msgr2=0x7f8c98061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.844+0000 7f8cb2191700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8c9805f270 0x7f8c98061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f8c9c0010e0 tx=0x7f8c9c015000).stop 2023-11-15T02:37:11.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.844+0000 7f8cb2191700 1 -- 172.21.15.1:0/2308963838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cac1498f0 msgr2=0x7f8cac0af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.844+0000 7f8cb2191700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cac1498f0 0x7f8cac0af110 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f8cac083f30 tx=0x7f8ca4007f30).stop 2023-11-15T02:37:11.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.844+0000 7f8cb2191700 1 -- 172.21.15.1:0/2308963838 shutdown_connections 2023-11-15T02:37:11.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.844+0000 7f8cb2191700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8c9805f270 0x7f8c98061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.844+0000 7f8cb2191700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cac1498f0 0x7f8cac0af110 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.844+0000 7f8cb2191700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c940038e0 0x7f8cac14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.845+0000 7f8cb2191700 1 --2- 172.21.15.1:0/2308963838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cac147470 0x7f8cac149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.845+0000 7f8cb2191700 1 -- 172.21.15.1:0/2308963838 >> 172.21.15.1:0/2308963838 conn(0x7f8cac064aa0 msgr2=0x7f8cac14e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:11.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.845+0000 7f8cb2191700 1 -- 172.21.15.1:0/2308963838 shutdown_connections 2023-11-15T02:37:11.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.845+0000 7f8cb2191700 1 -- 172.21.15.1:0/2308963838 wait complete. 2023-11-15T02:37:11.859 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:37:11.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.976+0000 7fba72dd7700 1 Processor -- start 2023-11-15T02:37:11.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.976+0000 7fba72dd7700 1 -- start start 2023-11-15T02:37:11.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.976+0000 7fba72dd7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fba6c0bdfb0 0x7fba6c0be390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.976+0000 7fba72dd7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fba6c154e70 0x7fba6c155270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.976+0000 7fba72dd7700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba6c0ad5e0 con 0x7fba6c0c6d10 2023-11-15T02:37:11.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.976+0000 7fba72dd7700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba6c0bccd0 con 0x7fba6c154e70 2023-11-15T02:37:11.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.976+0000 7fba72dd7700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba6c0ad8c0 con 0x7fba6c0bdfb0 2023-11-15T02:37:11.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.977+0000 7fba71374700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fba6c154e70 0x7fba6c155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.977+0000 7fba6bfff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fba6c0c6d10 0x7fba6c0bd400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58668/0 (socket says 172.21.15.1:58668) 2023-11-15T02:37:11.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.977+0000 7fba6bfff700 1 -- 172.21.15.1:0/1704103981 learned_addr learned my addr 172.21.15.1:0/1704103981 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:11.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.977+0000 7fba70b73700 1 --2- 172.21.15.1:0/1704103981 >> v2:172.21.15.141:3300/0 conn(0x7fba6c0bdfb0 0x7fba6c0be390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.977+0000 7fba71374700 1 -- 172.21.15.1:0/1704103981 >> v2:172.21.15.141:3300/0 conn(0x7fba6c0bdfb0 msgr2=0x7fba6c0be390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:11.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.977+0000 7fba71374700 1 --2- 172.21.15.1:0/1704103981 >> v2:172.21.15.141:3300/0 conn(0x7fba6c0bdfb0 0x7fba6c0be390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.977+0000 7fba71374700 1 -- 172.21.15.1:0/1704103981 >> v1:172.21.15.1:6789/0 conn(0x7fba6c0c6d10 legacy=0x7fba6c0bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.977+0000 7fba6b7fe700 1 -- 172.21.15.1:0/1704103981 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731691109 0 0) 0x7fba6c0ad5e0 con 0x7fba6c0c6d10 2023-11-15T02:37:11.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.977+0000 7fba71374700 1 -- 172.21.15.1:0/1704103981 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c0adba0 con 0x7fba6c154e70 2023-11-15T02:37:11.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.977+0000 7fba71374700 1 --2- 172.21.15.1:0/1704103981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba6c154e70 0x7fba6c155270 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fba6c0690a0 tx=0x7fba64009780).ready entity=mon.0 client_cookie=10b43ba90ea10ca3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:11.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.977+0000 7fba6b7fe700 1 -- 172.21.15.1:0/1704103981 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6400e070 con 0x7fba6c154e70 2023-11-15T02:37:11.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.977+0000 7fba6b7fe700 1 -- 172.21.15.1:0/1704103981 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6400bc30 con 0x7fba6c154e70 2023-11-15T02:37:11.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.977+0000 7fba6b7fe700 1 -- 172.21.15.1:0/1704103981 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64012410 con 0x7fba6c154e70 2023-11-15T02:37:11.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.978+0000 7fba72dd7700 1 -- 172.21.15.1:0/1704103981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba6c154e70 msgr2=0x7fba6c155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.978+0000 7fba72dd7700 1 --2- 172.21.15.1:0/1704103981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba6c154e70 0x7fba6c155270 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fba6c0690a0 tx=0x7fba64009780).stop 2023-11-15T02:37:11.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.978+0000 7fba72dd7700 1 -- 172.21.15.1:0/1704103981 shutdown_connections 2023-11-15T02:37:11.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.978+0000 7fba72dd7700 1 --2- 172.21.15.1:0/1704103981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba6c154e70 0x7fba6c155270 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.978+0000 7fba72dd7700 1 --2- 172.21.15.1:0/1704103981 >> v2:172.21.15.141:3300/0 conn(0x7fba6c0bdfb0 0x7fba6c0be390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.978+0000 7fba72dd7700 1 -- 172.21.15.1:0/1704103981 >> 172.21.15.1:0/1704103981 conn(0x7fba6c0c7d70 msgr2=0x7fba6c0c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:11.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.978+0000 7fba72dd7700 1 -- 172.21.15.1:0/1704103981 shutdown_connections 2023-11-15T02:37:11.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.978+0000 7fba72dd7700 1 -- 172.21.15.1:0/1704103981 wait complete. 2023-11-15T02:37:11.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.979+0000 7fba72dd7700 1 Processor -- start 2023-11-15T02:37:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.979+0000 7fba72dd7700 1 -- start start 2023-11-15T02:37:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba72dd7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fba6c0bdfb0 0x7fba6c0aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba72dd7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba6c0c6d10 0x7fba6c1385f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba72dd7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba6c154e70 0x7fba6c14fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba72dd7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c1506f0 con 0x7fba6c154e70 2023-11-15T02:37:11.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba72dd7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c0bfb30 con 0x7fba6c0c6d10 2023-11-15T02:37:11.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba72dd7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c0bfe10 con 0x7fba6c0bdfb0 2023-11-15T02:37:11.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba71374700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba6c154e70 0x7fba6c14fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba71374700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba6c154e70 0x7fba6c14fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37914/0 (socket says 172.21.15.1:37914) 2023-11-15T02:37:11.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba71374700 1 -- 172.21.15.1:0/179769829 learned_addr learned my addr 172.21.15.1:0/179769829 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:11.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba6bfff700 1 --2- 172.21.15.1:0/179769829 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba6c0c6d10 0x7fba6c1385f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba70b73700 1 --2- 172.21.15.1:0/179769829 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fba6c0bdfb0 0x7fba6c0aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba71374700 1 -- 172.21.15.1:0/179769829 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fba6c0bdfb0 msgr2=0x7fba6c0aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba71374700 1 --2- 172.21.15.1:0/179769829 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fba6c0bdfb0 0x7fba6c0aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba71374700 1 -- 172.21.15.1:0/179769829 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba6c0c6d10 msgr2=0x7fba6c1385f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:11.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba71374700 1 --2- 172.21.15.1:0/179769829 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba6c0c6d10 0x7fba6c1385f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:11.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba71374700 1 -- 172.21.15.1:0/179769829 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba64009a20 con 0x7fba6c154e70 2023-11-15T02:37:11.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba71374700 1 --2- 172.21.15.1:0/179769829 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba6c154e70 0x7fba6c14fc60 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7fba6c0c5880 tx=0x7fba64009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:11.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.980+0000 7fba68ff9700 1 -- 172.21.15.1:0/179769829 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba640117d0 con 0x7fba6c154e70 2023-11-15T02:37:11.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.981+0000 7fba68ff9700 1 -- 172.21.15.1:0/179769829 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba64011930 con 0x7fba6c154e70 2023-11-15T02:37:11.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.981+0000 7fba72dd7700 1 -- 172.21.15.1:0/179769829 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba6c0c00f0 con 0x7fba6c154e70 2023-11-15T02:37:11.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.981+0000 7fba68ff9700 1 -- 172.21.15.1:0/179769829 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64011cf0 con 0x7fba6c154e70 2023-11-15T02:37:11.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.981+0000 7fba72dd7700 1 -- 172.21.15.1:0/179769829 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba6c0ab210 con 0x7fba6c154e70 2023-11-15T02:37:11.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.982+0000 7fba72dd7700 1 -- 172.21.15.1:0/179769829 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6c06c7e0 con 0x7fba6c154e70 2023-11-15T02:37:11.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.982+0000 7fba68ff9700 1 -- 172.21.15.1:0/179769829 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fba64003040 con 0x7fba6c154e70 2023-11-15T02:37:11.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.982+0000 7fba68ff9700 1 --2- 172.21.15.1:0/179769829 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fba4c05f270 0x7fba4c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:11.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.982+0000 7fba68ff9700 1 -- 172.21.15.1:0/179769829 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fba6407c650 con 0x7fba6c154e70 2023-11-15T02:37:11.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.983+0000 7fba70b73700 1 --2- 172.21.15.1:0/179769829 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fba4c05f270 0x7fba4c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:11.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.983+0000 7fba70b73700 1 --2- 172.21.15.1:0/179769829 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fba4c05f270 0x7fba4c061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fba5c006fd0 tx=0x7fba5c008040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:11.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:11.987+0000 7fba68ff9700 1 -- 172.21.15.1:0/179769829 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fba6404d4f0 con 0x7fba6c154e70 2023-11-15T02:37:12.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.163+0000 7fba72dd7700 1 -- 172.21.15.1:0/179769829 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba6c06a530 con 0x7fba6c154e70 2023-11-15T02:37:12.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.163+0000 7fba68ff9700 1 -- 172.21.15.1:0/179769829 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+17668 (secure 0 0 0) 0x7fba64050b10 con 0x7fba6c154e70 2023-11-15T02:37:12.165 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:37:12.166 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":176,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:37:11.505046+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:37:09.163204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-11-15T02:37:10.486624+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:37:12.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.165+0000 7fba72dd7700 1 -- 172.21.15.1:0/179769829 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fba4c05f270 msgr2=0x7fba4c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:12.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.165+0000 7fba72dd7700 1 --2- 172.21.15.1:0/179769829 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fba4c05f270 0x7fba4c061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fba5c006fd0 tx=0x7fba5c008040).stop 2023-11-15T02:37:12.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.166+0000 7fba72dd7700 1 -- 172.21.15.1:0/179769829 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba6c154e70 msgr2=0x7fba6c14fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:12.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.166+0000 7fba72dd7700 1 --2- 172.21.15.1:0/179769829 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba6c154e70 0x7fba6c14fc60 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7fba6c0c5880 tx=0x7fba64009780).stop 2023-11-15T02:37:12.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.166+0000 7fba72dd7700 1 -- 172.21.15.1:0/179769829 shutdown_connections 2023-11-15T02:37:12.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.166+0000 7fba72dd7700 1 --2- 172.21.15.1:0/179769829 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fba4c05f270 0x7fba4c061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:12.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.166+0000 7fba72dd7700 1 --2- 172.21.15.1:0/179769829 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba6c154e70 0x7fba6c14fc60 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:12.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.166+0000 7fba72dd7700 1 --2- 172.21.15.1:0/179769829 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fba6c0bdfb0 0x7fba6c0aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:12.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.166+0000 7fba72dd7700 1 --2- 172.21.15.1:0/179769829 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba6c0c6d10 0x7fba6c1385f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:12.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.166+0000 7fba72dd7700 1 -- 172.21.15.1:0/179769829 >> 172.21.15.1:0/179769829 conn(0x7fba6c0c7d70 msgr2=0x7fba6c066bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:12.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.166+0000 7fba72dd7700 1 -- 172.21.15.1:0/179769829 shutdown_connections 2023-11-15T02:37:12.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.166+0000 7fba72dd7700 1 -- 172.21.15.1:0/179769829 wait complete. 2023-11-15T02:37:12.180 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-15T02:37:12.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.298+0000 7f0209d70700 1 Processor -- start 2023-11-15T02:37:12.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.298+0000 7f0209d70700 1 -- start start 2023-11-15T02:37:12.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.299+0000 7f0209d70700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0204062970 0x7f02040c4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:12.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.299+0000 7f0209d70700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f02040661e0 0x7f0204062d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:12.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.299+0000 7f0209d70700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f02041567a0 0x7f020413b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:12.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.299+0000 7f0209d70700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0204156c50 con 0x7f02040661e0 2023-11-15T02:37:12.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.299+0000 7f0209d70700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0204156310 con 0x7f02041567a0 2023-11-15T02:37:12.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.299+0000 7f0209d70700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0204065a30 con 0x7f0204062970 2023-11-15T02:37:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.299+0000 7f0202ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f02040661e0 0x7f0204062d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.300+0000 7f0202ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f02040661e0 0x7f0204062d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37924/0 (socket says 172.21.15.1:37924) 2023-11-15T02:37:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.300+0000 7f0202ffd700 1 -- 172.21.15.1:0/3914423892 learned_addr learned my addr 172.21.15.1:0/3914423892 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.300+0000 7f02037fe700 1 --2- 172.21.15.1:0/3914423892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0204062970 0x7f02040c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:12.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.300+0000 7f0203fff700 1 --2- 172.21.15.1:0/3914423892 >> v2:172.21.15.141:3300/0 conn(0x7f02041567a0 0x7f020413b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:12.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.300+0000 7f0202ffd700 1 -- 172.21.15.1:0/3914423892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0204062970 msgr2=0x7f02040c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:12.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.300+0000 7f0202ffd700 1 --2- 172.21.15.1:0/3914423892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0204062970 0x7f02040c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:12.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.300+0000 7f0202ffd700 1 -- 172.21.15.1:0/3914423892 >> v2:172.21.15.141:3300/0 conn(0x7f02041567a0 msgr2=0x7f020413b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:12.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.300+0000 7f0202ffd700 1 --2- 172.21.15.1:0/3914423892 >> v2:172.21.15.141:3300/0 conn(0x7f02041567a0 0x7f020413b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:12.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.300+0000 7f0202ffd700 1 -- 172.21.15.1:0/3914423892 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020406a1c0 con 0x7f02040661e0 2023-11-15T02:37:12.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.300+0000 7f02037fe700 1 --2- 172.21.15.1:0/3914423892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0204062970 0x7f02040c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:12.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.300+0000 7f0203fff700 1 --2- 172.21.15.1:0/3914423892 >> v2:172.21.15.141:3300/0 conn(0x7f02041567a0 0x7f020413b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:12.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.300+0000 7f0202ffd700 1 --2- 172.21.15.1:0/3914423892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02040661e0 0x7f0204062d50 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f0204155c20 tx=0x7f01f80090f0).ready entity=mon.0 client_cookie=f07ac2945512053c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:12.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.300+0000 7f02027fc700 1 -- 172.21.15.1:0/3914423892 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800b600 con 0x7f02040661e0 2023-11-15T02:37:12.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.300+0000 7f02027fc700 1 -- 172.21.15.1:0/3914423892 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f800b760 con 0x7f02040661e0 2023-11-15T02:37:12.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.300+0000 7f02027fc700 1 -- 172.21.15.1:0/3914423892 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800bae0 con 0x7f02040661e0 2023-11-15T02:37:12.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.301+0000 7f0209d70700 1 -- 172.21.15.1:0/3914423892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02040661e0 msgr2=0x7f0204062d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:12.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.301+0000 7f0209d70700 1 --2- 172.21.15.1:0/3914423892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02040661e0 0x7f0204062d50 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f0204155c20 tx=0x7f01f80090f0).stop 2023-11-15T02:37:12.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.301+0000 7f0209d70700 1 -- 172.21.15.1:0/3914423892 shutdown_connections 2023-11-15T02:37:12.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.301+0000 7f0209d70700 1 --2- 172.21.15.1:0/3914423892 >> v2:172.21.15.141:3300/0 conn(0x7f02041567a0 0x7f020413b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:12.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.301+0000 7f0209d70700 1 --2- 172.21.15.1:0/3914423892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0204062970 0x7f02040c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:12.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.301+0000 7f0209d70700 1 --2- 172.21.15.1:0/3914423892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02040661e0 0x7f0204062d50 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:12.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.301+0000 7f0209d70700 1 -- 172.21.15.1:0/3914423892 >> 172.21.15.1:0/3914423892 conn(0x7f02040c7dc0 msgr2=0x7f02040c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:12.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.301+0000 7f0209d70700 1 -- 172.21.15.1:0/3914423892 shutdown_connections 2023-11-15T02:37:12.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.301+0000 7f0209d70700 1 -- 172.21.15.1:0/3914423892 wait complete. 2023-11-15T02:37:12.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.302+0000 7f0209d70700 1 Processor -- start 2023-11-15T02:37:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.302+0000 7f0209d70700 1 -- start start 2023-11-15T02:37:12.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0209d70700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0204062970 0x7f02040c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:12.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0209d70700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02040661e0 0x7f02041550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:12.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0209d70700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02041567a0 0x7f02040be050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:12.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0209d70700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0204162e30 con 0x7f02040661e0 2023-11-15T02:37:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0209d70700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0204155590 con 0x7f02041567a0 2023-11-15T02:37:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0209d70700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02040c1e70 con 0x7f0204062970 2023-11-15T02:37:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0202ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02040661e0 0x7f02041550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0202ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02040661e0 0x7f02041550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37934/0 (socket says 172.21.15.1:37934) 2023-11-15T02:37:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0202ffd700 1 -- 172.21.15.1:0/2266308399 learned_addr learned my addr 172.21.15.1:0/2266308399 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f02037fe700 1 --2- 172.21.15.1:0/2266308399 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0204062970 0x7f02040c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0203fff700 1 --2- 172.21.15.1:0/2266308399 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02041567a0 0x7f02040be050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:12.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0202ffd700 1 -- 172.21.15.1:0/2266308399 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0204062970 msgr2=0x7f02040c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:12.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0202ffd700 1 --2- 172.21.15.1:0/2266308399 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0204062970 0x7f02040c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:12.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0202ffd700 1 -- 172.21.15.1:0/2266308399 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02041567a0 msgr2=0x7f02040be050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:12.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0202ffd700 1 --2- 172.21.15.1:0/2266308399 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02041567a0 0x7f02040be050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:12.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0202ffd700 1 -- 172.21.15.1:0/2266308399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f8009370 con 0x7f02040661e0 2023-11-15T02:37:12.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f02037fe700 1 --2- 172.21.15.1:0/2266308399 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0204062970 0x7f02040c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:12.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f0202ffd700 1 --2- 172.21.15.1:0/2266308399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02040661e0 0x7f02041550a0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f01f8006fd0 tx=0x7f01f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:12.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f01eb7fe700 1 -- 172.21.15.1:0/2266308399 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800b8d0 con 0x7f02040661e0 2023-11-15T02:37:12.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.303+0000 7f01eb7fe700 1 -- 172.21.15.1:0/2266308399 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f800ba30 con 0x7f02040661e0 2023-11-15T02:37:12.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.304+0000 7f0209d70700 1 -- 172.21.15.1:0/2266308399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02041627e0 con 0x7f02040661e0 2023-11-15T02:37:12.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.304+0000 7f01eb7fe700 1 -- 172.21.15.1:0/2266308399 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f801b660 con 0x7f02040661e0 2023-11-15T02:37:12.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.304+0000 7f0209d70700 1 -- 172.21.15.1:0/2266308399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02041624f0 con 0x7f02040661e0 2023-11-15T02:37:12.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.305+0000 7f0209d70700 1 -- 172.21.15.1:0/2266308399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020406c7e0 con 0x7f02040661e0 2023-11-15T02:37:12.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.305+0000 7f01eb7fe700 1 -- 172.21.15.1:0/2266308399 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f01f801ba10 con 0x7f02040661e0 2023-11-15T02:37:12.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.305+0000 7f01eb7fe700 1 --2- 172.21.15.1:0/2266308399 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f01f005f270 0x7f01f0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:12.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.305+0000 7f01eb7fe700 1 -- 172.21.15.1:0/2266308399 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f01f807bf30 con 0x7f02040661e0 2023-11-15T02:37:12.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.305+0000 7f02037fe700 1 --2- 172.21.15.1:0/2266308399 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f01f005f270 0x7f01f0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:12.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.306+0000 7f02037fe700 1 --2- 172.21.15.1:0/2266308399 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f01f005f270 0x7f01f0061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f01f4006fd0 tx=0x7f01f4008040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:12.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.309+0000 7f01eb7fe700 1 -- 172.21.15.1:0/2266308399 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f01f804ce90 con 0x7f02040661e0 2023-11-15T02:37:12.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:12.529+0000 7f0209d70700 1 -- 172.21.15.1:0/2266308399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0204152510 con 0x7f02040661e0 2023-11-15T02:37:13.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.518+0000 7f01eb7fe700 1 -- 172.21.15.1:0/2266308399 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v78) v1 ==== 118+0+0 (secure 0 0 0) 0x7f01f801f070 con 0x7f02040661e0 2023-11-15T02:37:13.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.520+0000 7f0209d70700 1 -- 172.21.15.1:0/2266308399 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f01f005f270 msgr2=0x7f01f0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:13.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.520+0000 7f0209d70700 1 --2- 172.21.15.1:0/2266308399 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f01f005f270 0x7f01f0061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f01f4006fd0 tx=0x7f01f4008040).stop 2023-11-15T02:37:13.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.520+0000 7f0209d70700 1 -- 172.21.15.1:0/2266308399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02040661e0 msgr2=0x7f02041550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:13.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.520+0000 7f0209d70700 1 --2- 172.21.15.1:0/2266308399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02040661e0 0x7f02041550a0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f01f8006fd0 tx=0x7f01f8017000).stop 2023-11-15T02:37:13.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.520+0000 7f0209d70700 1 -- 172.21.15.1:0/2266308399 shutdown_connections 2023-11-15T02:37:13.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.520+0000 7f0209d70700 1 --2- 172.21.15.1:0/2266308399 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f01f005f270 0x7f01f0061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:13.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.520+0000 7f0209d70700 1 --2- 172.21.15.1:0/2266308399 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02041567a0 0x7f02040be050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:13.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.520+0000 7f0209d70700 1 --2- 172.21.15.1:0/2266308399 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0204062970 0x7f02040c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:13.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.520+0000 7f0209d70700 1 --2- 172.21.15.1:0/2266308399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02040661e0 0x7f02041550a0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:13.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.520+0000 7f0209d70700 1 -- 172.21.15.1:0/2266308399 >> 172.21.15.1:0/2266308399 conn(0x7f02040c7dc0 msgr2=0x7f0204138a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:13.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.521+0000 7f0209d70700 1 -- 172.21.15.1:0/2266308399 shutdown_connections 2023-11-15T02:37:13.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.521+0000 7f0209d70700 1 -- 172.21.15.1:0/2266308399 wait complete. 2023-11-15T02:37:13.537 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-15T02:37:13.538 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-15T02:37:13.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.664+0000 7f4ed4196700 1 Processor -- start 2023-11-15T02:37:13.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.664+0000 7f4ed4196700 1 -- start start 2023-11-15T02:37:13.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed4196700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4ecc1540a0 0x7f4ecc0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:13.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed4196700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4ecc0c6650 0x7f4ecc0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:13.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed4196700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ecc0ca050 con 0x7f4ecc154480 2023-11-15T02:37:13.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed4196700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ecc0c9440 con 0x7f4ecc0c6650 2023-11-15T02:37:13.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed4196700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ecc0c9720 con 0x7f4ecc1540a0 2023-11-15T02:37:13.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed2733700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4ecc0c6650 0x7f4ecc0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:13.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed2733700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4ecc0c6650 0x7f4ecc0ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37948/0 (socket says 172.21.15.1:37948) 2023-11-15T02:37:13.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed2733700 1 -- 172.21.15.1:0/820001692 learned_addr learned my addr 172.21.15.1:0/820001692 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:13.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed2733700 1 -- 172.21.15.1:0/820001692 >> v2:172.21.15.141:3300/0 conn(0x7f4ecc1540a0 msgr2=0x7f4ecc0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:13.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed1f32700 1 --2- 172.21.15.1:0/820001692 >> v2:172.21.15.141:3300/0 conn(0x7f4ecc1540a0 0x7f4ecc0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:13.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed2733700 1 --2- 172.21.15.1:0/820001692 >> v2:172.21.15.141:3300/0 conn(0x7f4ecc1540a0 0x7f4ecc0ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:13.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed2733700 1 -- 172.21.15.1:0/820001692 >> v1:172.21.15.141:6789/0 conn(0x7f4ecc154480 legacy=0x7f4ecc0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:13.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed2733700 1 -- 172.21.15.1:0/820001692 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc0c9a00 con 0x7f4ecc0c6650 2023-11-15T02:37:13.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed1f32700 1 --2- 172.21.15.1:0/820001692 >> v2:172.21.15.141:3300/0 conn(0x7f4ecc1540a0 0x7f4ecc0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:13.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed2733700 1 --2- 172.21.15.1:0/820001692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ecc0c6650 0x7f4ecc0ca9d0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f4ecc05ff40 tx=0x7f4ec4009840).ready entity=mon.0 client_cookie=c7dc8fb9a350d59e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:13.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed0f30700 1 -- 172.21.15.1:0/820001692 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec400e070 con 0x7f4ecc0c6650 2023-11-15T02:37:13.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed0f30700 1 -- 172.21.15.1:0/820001692 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec400ba10 con 0x7f4ecc0c6650 2023-11-15T02:37:13.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.665+0000 7f4ed0f30700 1 -- 172.21.15.1:0/820001692 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec400bd90 con 0x7f4ecc0c6650 2023-11-15T02:37:13.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.666+0000 7f4ed4196700 1 -- 172.21.15.1:0/820001692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ecc0c6650 msgr2=0x7f4ecc0ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:13.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.666+0000 7f4ed4196700 1 --2- 172.21.15.1:0/820001692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ecc0c6650 0x7f4ecc0ca9d0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f4ecc05ff40 tx=0x7f4ec4009840).stop 2023-11-15T02:37:13.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.666+0000 7f4ed4196700 1 -- 172.21.15.1:0/820001692 shutdown_connections 2023-11-15T02:37:13.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.666+0000 7f4ed4196700 1 --2- 172.21.15.1:0/820001692 >> v2:172.21.15.141:3300/0 conn(0x7f4ecc1540a0 0x7f4ecc0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:13.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.666+0000 7f4ed4196700 1 --2- 172.21.15.1:0/820001692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ecc0c6650 0x7f4ecc0ca9d0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:13.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.666+0000 7f4ed4196700 1 -- 172.21.15.1:0/820001692 >> 172.21.15.1:0/820001692 conn(0x7f4ecc064a70 msgr2=0x7f4ecc064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:13.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.666+0000 7f4ed4196700 1 -- 172.21.15.1:0/820001692 shutdown_connections 2023-11-15T02:37:13.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.666+0000 7f4ed4196700 1 -- 172.21.15.1:0/820001692 wait complete. 2023-11-15T02:37:13.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.667+0000 7f4ed4196700 1 Processor -- start 2023-11-15T02:37:13.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.667+0000 7f4ed4196700 1 -- start start 2023-11-15T02:37:13.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed4196700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ecc0c6650 0x7f4ecc156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:13.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed4196700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ecc1540a0 0x7f4ecc14bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:13.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed4196700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ecc154480 0x7f4ecc1651a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:13.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed4196700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc14c040 con 0x7f4ecc1540a0 2023-11-15T02:37:13.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed4196700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc1577e0 con 0x7f4ecc154480 2023-11-15T02:37:13.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed4196700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc165690 con 0x7f4ecc0c6650 2023-11-15T02:37:13.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed1731700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ecc1540a0 0x7f4ecc14bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:13.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed1731700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ecc1540a0 0x7f4ecc14bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37960/0 (socket says 172.21.15.1:37960) 2023-11-15T02:37:13.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed1731700 1 -- 172.21.15.1:0/2374382251 learned_addr learned my addr 172.21.15.1:0/2374382251 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:13.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed2733700 1 --2- 172.21.15.1:0/2374382251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ecc154480 0x7f4ecc1651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:13.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed1f32700 1 --2- 172.21.15.1:0/2374382251 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ecc0c6650 0x7f4ecc156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:13.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed1731700 1 -- 172.21.15.1:0/2374382251 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ecc0c6650 msgr2=0x7f4ecc156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:13.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed1731700 1 --2- 172.21.15.1:0/2374382251 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ecc0c6650 0x7f4ecc156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:13.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed1731700 1 -- 172.21.15.1:0/2374382251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ecc154480 msgr2=0x7f4ecc1651a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:13.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed1731700 1 --2- 172.21.15.1:0/2374382251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ecc154480 0x7f4ecc1651a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed1731700 1 -- 172.21.15.1:0/2374382251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4009ae0 con 0x7f4ecc1540a0 2023-11-15T02:37:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.668+0000 7f4ed1731700 1 --2- 172.21.15.1:0/2374382251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ecc1540a0 0x7f4ecc14bb50 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f4ebc00b460 tx=0x7f4ebc006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.669+0000 7f4ec1ffb700 1 -- 172.21.15.1:0/2374382251 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc012410 con 0x7f4ecc1540a0 2023-11-15T02:37:13.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.669+0000 7f4ec1ffb700 1 -- 172.21.15.1:0/2374382251 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc012590 con 0x7f4ecc1540a0 2023-11-15T02:37:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.669+0000 7f4ec1ffb700 1 -- 172.21.15.1:0/2374382251 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc012950 con 0x7f4ecc1540a0 2023-11-15T02:37:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.669+0000 7f4ed4196700 1 -- 172.21.15.1:0/2374382251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ecc156bd0 con 0x7f4ecc1540a0 2023-11-15T02:37:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.669+0000 7f4ed4196700 1 -- 172.21.15.1:0/2374382251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ecc157190 con 0x7f4ecc1540a0 2023-11-15T02:37:13.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.670+0000 7f4ed4196700 1 -- 172.21.15.1:0/2374382251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ecc0c8920 con 0x7f4ecc1540a0 2023-11-15T02:37:13.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.670+0000 7f4ec1ffb700 1 -- 172.21.15.1:0/2374382251 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4ebc012cc0 con 0x7f4ecc1540a0 2023-11-15T02:37:13.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.670+0000 7f4ec1ffb700 1 --2- 172.21.15.1:0/2374382251 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4eb005f270 0x7f4eb0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:13.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.670+0000 7f4ec1ffb700 1 -- 172.21.15.1:0/2374382251 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f4ebc07a270 con 0x7f4ecc1540a0 2023-11-15T02:37:13.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.671+0000 7f4ed1f32700 1 --2- 172.21.15.1:0/2374382251 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4eb005f270 0x7f4eb0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:13.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.671+0000 7f4ed1f32700 1 --2- 172.21.15.1:0/2374382251 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4eb005f270 0x7f4eb0061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4ec800abd0 tx=0x7f4ec8008040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:13.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.675+0000 7f4ec1ffb700 1 -- 172.21.15.1:0/2374382251 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4ebc04b1d0 con 0x7f4ecc1540a0 2023-11-15T02:37:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:13.895+0000 7f4ed4196700 1 -- 172.21.15.1:0/2374382251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4ecc157970 con 0x7f4ecc1540a0 2023-11-15T02:37:14.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.522+0000 7f4ec1ffb700 1 -- 172.21.15.1:0/2374382251 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v79) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4ebc04e7f0 con 0x7f4ecc1540a0 2023-11-15T02:37:14.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.524+0000 7f4ed4196700 1 -- 172.21.15.1:0/2374382251 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4eb005f270 msgr2=0x7f4eb0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:14.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.524+0000 7f4ed4196700 1 --2- 172.21.15.1:0/2374382251 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4eb005f270 0x7f4eb0061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4ec800abd0 tx=0x7f4ec8008040).stop 2023-11-15T02:37:14.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.524+0000 7f4ed4196700 1 -- 172.21.15.1:0/2374382251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ecc1540a0 msgr2=0x7f4ecc14bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:14.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.524+0000 7f4ed4196700 1 --2- 172.21.15.1:0/2374382251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ecc1540a0 0x7f4ecc14bb50 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f4ebc00b460 tx=0x7f4ebc006f20).stop 2023-11-15T02:37:14.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.524+0000 7f4ed4196700 1 -- 172.21.15.1:0/2374382251 shutdown_connections 2023-11-15T02:37:14.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.524+0000 7f4ed4196700 1 --2- 172.21.15.1:0/2374382251 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f4eb005f270 0x7f4eb0061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:14.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.524+0000 7f4ed4196700 1 --2- 172.21.15.1:0/2374382251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4ecc154480 0x7f4ecc1651a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:14.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.524+0000 7f4ed4196700 1 --2- 172.21.15.1:0/2374382251 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4ecc0c6650 0x7f4ecc156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:14.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.524+0000 7f4ed4196700 1 --2- 172.21.15.1:0/2374382251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ecc1540a0 0x7f4ecc14bb50 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:14.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.524+0000 7f4ed4196700 1 -- 172.21.15.1:0/2374382251 >> 172.21.15.1:0/2374382251 conn(0x7f4ecc064a70 msgr2=0x7f4ecc14d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:14.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.524+0000 7f4ed4196700 1 -- 172.21.15.1:0/2374382251 shutdown_connections 2023-11-15T02:37:14.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.524+0000 7f4ed4196700 1 -- 172.21.15.1:0/2374382251 wait complete. 2023-11-15T02:37:14.539 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-15T02:37:14.540 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:37:14.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.660+0000 7f8c180fd700 1 Processor -- start 2023-11-15T02:37:14.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.660+0000 7f8c180fd700 1 -- start start 2023-11-15T02:37:14.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c180fd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8c10154450 0x7f8c100a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:14.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c180fd700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8c100be520 0x7f8c10154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:14.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c180fd700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c100a85e0 con 0x7f8c100833a0 2023-11-15T02:37:14.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c180fd700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c10065940 con 0x7f8c10154450 2023-11-15T02:37:14.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c180fd700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c10065660 con 0x7f8c100be520 2023-11-15T02:37:14.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c15e99700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8c10154450 0x7f8c100a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:14.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c15698700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8c100833a0 0x7f8c100bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58674/0 (socket says 172.21.15.1:58674) 2023-11-15T02:37:14.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c15e99700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8c10154450 0x7f8c100a7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37970/0 (socket says 172.21.15.1:37970) 2023-11-15T02:37:14.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c15698700 1 -- 172.21.15.1:0/699276621 learned_addr learned my addr 172.21.15.1:0/699276621 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:14.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c15e99700 1 -- 172.21.15.1:0/699276621 >> v2:172.21.15.141:3300/0 conn(0x7f8c100be520 msgr2=0x7f8c10154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:14.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c15e99700 1 --2- 172.21.15.1:0/699276621 >> v2:172.21.15.141:3300/0 conn(0x7f8c100be520 0x7f8c10154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T02:37:14.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c15e99700 1 -- 172.21.15.1:0/699276621 >> v1:172.21.15.1:6789/0 conn(0x7f8c100833a0 legacy=0x7f8c100bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:14.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c14e97700 1 -- 172.21.15.1:0/699276621 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950181280 0 0) 0x7f8c100a85e0 con 0x7f8c100833a0 2023-11-15T02:37:14.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c15e99700 1 -- 172.21.15.1:0/699276621 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c100c6f50 con 0x7f8c10154450 2023-11-15T02:37:14.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c15e99700 1 --2- 172.21.15.1:0/699276621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c10154450 0x7f8c100a7ef0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f8c1006a610 tx=0x7f8c00009780).ready entity=mon.0 client_cookie=aa1004e7db26deb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:14.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.661+0000 7f8c14e97700 1 -- 172.21.15.1:0/699276621 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0000e070 con 0x7f8c10154450 2023-11-15T02:37:14.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.662+0000 7f8c14e97700 1 -- 172.21.15.1:0/699276621 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0000bc30 con 0x7f8c10154450 2023-11-15T02:37:14.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.662+0000 7f8c14e97700 1 -- 172.21.15.1:0/699276621 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00012410 con 0x7f8c10154450 2023-11-15T02:37:14.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.662+0000 7f8c180fd700 1 -- 172.21.15.1:0/699276621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c10154450 msgr2=0x7f8c100a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:14.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.662+0000 7f8c180fd700 1 --2- 172.21.15.1:0/699276621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c10154450 0x7f8c100a7ef0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f8c1006a610 tx=0x7f8c00009780).stop 2023-11-15T02:37:14.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.662+0000 7f8c180fd700 1 -- 172.21.15.1:0/699276621 shutdown_connections 2023-11-15T02:37:14.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.662+0000 7f8c180fd700 1 --2- 172.21.15.1:0/699276621 >> v2:172.21.15.141:3300/0 conn(0x7f8c100be520 0x7f8c10154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T02:37:14.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.662+0000 7f8c180fd700 1 --2- 172.21.15.1:0/699276621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c10154450 0x7f8c100a7ef0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:14.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.662+0000 7f8c180fd700 1 -- 172.21.15.1:0/699276621 >> 172.21.15.1:0/699276621 conn(0x7f8c10082f90 msgr2=0x7f8c100c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:14.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.662+0000 7f8c180fd700 1 -- 172.21.15.1:0/699276621 shutdown_connections 2023-11-15T02:37:14.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.662+0000 7f8c180fd700 1 -- 172.21.15.1:0/699276621 wait complete. 2023-11-15T02:37:14.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.663+0000 7f8c180fd700 1 Processor -- start 2023-11-15T02:37:14.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.663+0000 7f8c180fd700 1 -- start start 2023-11-15T02:37:14.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c180fd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c100833a0 0x7f8c10150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:14.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c180fd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c100be520 0x7f8c100aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:14.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c180fd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c10154450 0x7f8c101526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:14.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c180fd700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100a8de0 con 0x7f8c100be520 2023-11-15T02:37:14.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c180fd700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100a90c0 con 0x7f8c100833a0 2023-11-15T02:37:14.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c180fd700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100a93a0 con 0x7f8c10154450 2023-11-15T02:37:14.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c15698700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c100be520 0x7f8c100aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:14.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c15698700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c100be520 0x7f8c100aca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37986/0 (socket says 172.21.15.1:37986) 2023-11-15T02:37:14.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c15698700 1 -- 172.21.15.1:0/6331847 learned_addr learned my addr 172.21.15.1:0/6331847 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:14.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c15e99700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c100833a0 0x7f8c10150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:14.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c1669a700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c10154450 0x7f8c101526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:14.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c15698700 1 -- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c10154450 msgr2=0x7f8c101526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:14.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c15698700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c10154450 0x7f8c101526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:14.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c15698700 1 -- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c100833a0 msgr2=0x7f8c10150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:14.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c15698700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c100833a0 0x7f8c10150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:14.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c15698700 1 -- 172.21.15.1:0/6331847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c00009a20 con 0x7f8c100be520 2023-11-15T02:37:14.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c1669a700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c10154450 0x7f8c101526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:14.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.664+0000 7f8c15e99700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c100833a0 0x7f8c10150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:14.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.665+0000 7f8c15698700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c100be520 0x7f8c100aca40 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f8c0400c4e0 tx=0x7f8c04007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:14.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.665+0000 7f8c0dffb700 1 -- 172.21.15.1:0/6331847 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040072e0 con 0x7f8c100be520 2023-11-15T02:37:14.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.665+0000 7f8c0dffb700 1 -- 172.21.15.1:0/6331847 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c04007440 con 0x7f8c100be520 2023-11-15T02:37:14.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.665+0000 7f8c180fd700 1 -- 172.21.15.1:0/6331847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c100a9680 con 0x7f8c100be520 2023-11-15T02:37:14.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.665+0000 7f8c0dffb700 1 -- 172.21.15.1:0/6331847 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040057a0 con 0x7f8c100be520 2023-11-15T02:37:14.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.665+0000 7f8c180fd700 1 -- 172.21.15.1:0/6331847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c10151270 con 0x7f8c100be520 2023-11-15T02:37:14.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.666+0000 7f8c180fd700 1 -- 172.21.15.1:0/6331847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1006c7e0 con 0x7f8c100be520 2023-11-15T02:37:14.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.666+0000 7f8c0dffb700 1 -- 172.21.15.1:0/6331847 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8c04005bd0 con 0x7f8c100be520 2023-11-15T02:37:14.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.666+0000 7f8c0dffb700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8bfc05f270 0x7f8bfc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:14.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.667+0000 7f8c0dffb700 1 -- 172.21.15.1:0/6331847 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f8c0407a010 con 0x7f8c100be520 2023-11-15T02:37:14.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.667+0000 7f8c15e99700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8bfc05f270 0x7f8bfc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:14.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.667+0000 7f8c15e99700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8bfc05f270 0x7f8bfc061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8c0000b9f0 tx=0x7f8c00009780).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:14.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.671+0000 7f8c0dffb700 1 -- 172.21.15.1:0/6331847 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8c0404af70 con 0x7f8c100be520 2023-11-15T02:37:14.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.886+0000 7f8c180fd700 1 -- 172.21.15.1:0/6331847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c1005f8b0 con 0x7f8c100be520 2023-11-15T02:37:14.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.886+0000 7f8c0dffb700 1 -- 172.21.15.1:0/6331847 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f8c0404ee60 con 0x7f8c100be520 2023-11-15T02:37:14.889 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:37:14.889 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3282299930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3282299930},{"type":"v1","addr":"172.21.15.141:6837","nonce":3282299930}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":8281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3059700101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3059700101},{"type":"v1","addr":"172.21.15.141:6836","nonce":3059700101}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9057,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2954825492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2954825492},{"type":"v1","addr":"172.21.15.1:6834","nonce":2954825492}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:37:11.505391+0000","modified":"2023-11-15T02:37:14.517313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9060":{"gid":9060,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3330049946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3330049946},{"type":"v1","addr":"172.21.15.1:6835","nonce":3330049946}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-11-15T02:37:14.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.888+0000 7f8c180fd700 1 -- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8bfc05f270 msgr2=0x7f8bfc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:14.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.888+0000 7f8c180fd700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8bfc05f270 0x7f8bfc061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8c0000b9f0 tx=0x7f8c00009780).stop 2023-11-15T02:37:14.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.888+0000 7f8c180fd700 1 -- 172.21.15.1:0/6331847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c100be520 msgr2=0x7f8c100aca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:14.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.888+0000 7f8c180fd700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c100be520 0x7f8c100aca40 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f8c0400c4e0 tx=0x7f8c04007c70).stop 2023-11-15T02:37:14.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.888+0000 7f8c180fd700 1 -- 172.21.15.1:0/6331847 shutdown_connections 2023-11-15T02:37:14.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.888+0000 7f8c180fd700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8bfc05f270 0x7f8bfc061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:14.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.888+0000 7f8c180fd700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c10154450 0x7f8c101526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:14.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.888+0000 7f8c180fd700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c100833a0 0x7f8c10150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:14.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.888+0000 7f8c180fd700 1 --2- 172.21.15.1:0/6331847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c100be520 0x7f8c100aca40 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:14.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.888+0000 7f8c180fd700 1 -- 172.21.15.1:0/6331847 >> 172.21.15.1:0/6331847 conn(0x7f8c10082f90 msgr2=0x7f8c100c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:14.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.888+0000 7f8c180fd700 1 -- 172.21.15.1:0/6331847 shutdown_connections 2023-11-15T02:37:14.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:14.889+0000 7f8c180fd700 1 -- 172.21.15.1:0/6331847 wait complete. 2023-11-15T02:37:14.893 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 79 2023-11-15T02:37:14.902 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:37:15.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.019+0000 7f2f299a8700 1 Processor -- start 2023-11-15T02:37:15.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.019+0000 7f2f299a8700 1 -- start start 2023-11-15T02:37:15.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.019+0000 7f2f299a8700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2f24154150 0x7f2f24154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.019+0000 7f2f299a8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f240ab1a0 0x7f2f24158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.019+0000 7f2f299a8700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f240c06f0 con 0x7f2f240aa060 2023-11-15T02:37:15.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.019+0000 7f2f299a8700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f240c09d0 con 0x7f2f24154150 2023-11-15T02:37:15.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.019+0000 7f2f299a8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f24158820 con 0x7f2f240ab1a0 2023-11-15T02:37:15.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.020+0000 7f2f237fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2f240aa060 0x7f2f240c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58690/0 (socket says 172.21.15.1:58690) 2023-11-15T02:37:15.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.020+0000 7f2f237fe700 1 -- 172.21.15.1:0/406645650 learned_addr learned my addr 172.21.15.1:0/406645650 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:15.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.020+0000 7f2f22ffd700 1 --2- 172.21.15.1:0/406645650 >> v2:172.21.15.141:3300/0 conn(0x7f2f24154150 0x7f2f24154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.020+0000 7f2f227fc700 1 --2- 172.21.15.1:0/406645650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f240ab1a0 0x7f2f24158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.020+0000 7f2f21ffb700 1 -- 172.21.15.1:0/406645650 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231248760 0 0) 0x7f2f240c06f0 con 0x7f2f240aa060 2023-11-15T02:37:15.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.020+0000 7f2f21ffb700 1 -- 172.21.15.1:0/406645650 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f100033f0 con 0x7f2f240aa060 2023-11-15T02:37:15.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.020+0000 7f2f227fc700 1 -- 172.21.15.1:0/406645650 >> v2:172.21.15.141:3300/0 conn(0x7f2f24154150 msgr2=0x7f2f24154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:15.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.020+0000 7f2f227fc700 1 --2- 172.21.15.1:0/406645650 >> v2:172.21.15.141:3300/0 conn(0x7f2f24154150 0x7f2f24154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.020+0000 7f2f227fc700 1 -- 172.21.15.1:0/406645650 >> v1:172.21.15.1:6789/0 conn(0x7f2f240aa060 legacy=0x7f2f240c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.020+0000 7f2f21ffb700 1 -- 172.21.15.1:0/406645650 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 679768858 0 0) 0x7f2f100033f0 con 0x7f2f240aa060 2023-11-15T02:37:15.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.020+0000 7f2f227fc700 1 -- 172.21.15.1:0/406645650 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f24158b00 con 0x7f2f240ab1a0 2023-11-15T02:37:15.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.020+0000 7f2f22ffd700 1 --2- 172.21.15.1:0/406645650 >> v2:172.21.15.141:3300/0 conn(0x7f2f24154150 0x7f2f24154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:37:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.020+0000 7f2f227fc700 1 --2- 172.21.15.1:0/406645650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f240ab1a0 0x7f2f24158040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f2f0c009760 tx=0x7f2f0c009060).ready entity=mon.2 client_cookie=4969399c90e70ea3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.021+0000 7f2f21ffb700 1 -- 172.21.15.1:0/406645650 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0090d0 con 0x7f2f240ab1a0 2023-11-15T02:37:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.021+0000 7f2f21ffb700 1 -- 172.21.15.1:0/406645650 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c00d4a0 con 0x7f2f240ab1a0 2023-11-15T02:37:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.021+0000 7f2f21ffb700 1 -- 172.21.15.1:0/406645650 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c00d820 con 0x7f2f240ab1a0 2023-11-15T02:37:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.021+0000 7f2f299a8700 1 -- 172.21.15.1:0/406645650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f240ab1a0 msgr2=0x7f2f24158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.021+0000 7f2f299a8700 1 --2- 172.21.15.1:0/406645650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f240ab1a0 0x7f2f24158040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f2f0c009760 tx=0x7f2f0c009060).stop 2023-11-15T02:37:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.021+0000 7f2f299a8700 1 -- 172.21.15.1:0/406645650 shutdown_connections 2023-11-15T02:37:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.021+0000 7f2f299a8700 1 --2- 172.21.15.1:0/406645650 >> v2:172.21.15.141:3300/0 conn(0x7f2f24154150 0x7f2f24154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.021+0000 7f2f299a8700 1 --2- 172.21.15.1:0/406645650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f240ab1a0 0x7f2f24158040 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.021+0000 7f2f299a8700 1 -- 172.21.15.1:0/406645650 >> 172.21.15.1:0/406645650 conn(0x7f2f24064aa0 msgr2=0x7f2f24064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.021+0000 7f2f299a8700 1 -- 172.21.15.1:0/406645650 shutdown_connections 2023-11-15T02:37:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.021+0000 7f2f299a8700 1 -- 172.21.15.1:0/406645650 wait complete. 2023-11-15T02:37:15.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.022+0000 7f2f299a8700 1 Processor -- start 2023-11-15T02:37:15.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.022+0000 7f2f299a8700 1 -- start start 2023-11-15T02:37:15.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.023+0000 7f2f299a8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f240aa060 0x7f2f24157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.023+0000 7f2f299a8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f240ab1a0 0x7f2f240c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.023+0000 7f2f299a8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f24154150 0x7f2f240abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.023+0000 7f2f299a8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f240c4a50 con 0x7f2f240aa060 2023-11-15T02:37:15.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.023+0000 7f2f299a8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f240c53d0 con 0x7f2f24154150 2023-11-15T02:37:15.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.023+0000 7f2f299a8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f240c3e40 con 0x7f2f240ab1a0 2023-11-15T02:37:15.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.023+0000 7f2f22ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f240aa060 0x7f2f24157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.023+0000 7f2f22ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f240aa060 0x7f2f24157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38002/0 (socket says 172.21.15.1:38002) 2023-11-15T02:37:15.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.023+0000 7f2f22ffd700 1 -- 172.21.15.1:0/1308745484 learned_addr learned my addr 172.21.15.1:0/1308745484 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:15.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.023+0000 7f2f227fc700 1 --2- 172.21.15.1:0/1308745484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f240ab1a0 0x7f2f240c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.023+0000 7f2f237fe700 1 --2- 172.21.15.1:0/1308745484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f24154150 0x7f2f240abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.024+0000 7f2f22ffd700 1 -- 172.21.15.1:0/1308745484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f240ab1a0 msgr2=0x7f2f240c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.024+0000 7f2f22ffd700 1 --2- 172.21.15.1:0/1308745484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f240ab1a0 0x7f2f240c4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.024+0000 7f2f22ffd700 1 -- 172.21.15.1:0/1308745484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f24154150 msgr2=0x7f2f240abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.024+0000 7f2f22ffd700 1 --2- 172.21.15.1:0/1308745484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f24154150 0x7f2f240abfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.024+0000 7f2f22ffd700 1 -- 172.21.15.1:0/1308745484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c0092a0 con 0x7f2f240aa060 2023-11-15T02:37:15.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.024+0000 7f2f22ffd700 1 --2- 172.21.15.1:0/1308745484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f240aa060 0x7f2f24157690 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7f2f1c00e9b0 tx=0x7f2f1c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:15.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.024+0000 7f2f1affd700 1 -- 172.21.15.1:0/1308745484 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c00c670 con 0x7f2f240aa060 2023-11-15T02:37:15.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.024+0000 7f2f1affd700 1 -- 172.21.15.1:0/1308745484 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c00c7d0 con 0x7f2f240aa060 2023-11-15T02:37:15.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.024+0000 7f2f299a8700 1 -- 172.21.15.1:0/1308745484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0c0092a0 con 0x7f2f240aa060 2023-11-15T02:37:15.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.024+0000 7f2f1affd700 1 -- 172.21.15.1:0/1308745484 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c00cb50 con 0x7f2f240aa060 2023-11-15T02:37:15.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.024+0000 7f2f299a8700 1 -- 172.21.15.1:0/1308745484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f240c4400 con 0x7f2f240aa060 2023-11-15T02:37:15.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.025+0000 7f2f299a8700 1 -- 172.21.15.1:0/1308745484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2406c7e0 con 0x7f2f240aa060 2023-11-15T02:37:15.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.025+0000 7f2f1affd700 1 -- 172.21.15.1:0/1308745484 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2f1c01b400 con 0x7f2f240aa060 2023-11-15T02:37:15.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.026+0000 7f2f1affd700 1 --2- 172.21.15.1:0/1308745484 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2f0405f270 0x7f2f04061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.026+0000 7f2f1affd700 1 -- 172.21.15.1:0/1308745484 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f2f1c07aa20 con 0x7f2f240aa060 2023-11-15T02:37:15.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.026+0000 7f2f227fc700 1 --2- 172.21.15.1:0/1308745484 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2f0405f270 0x7f2f04061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.026+0000 7f2f227fc700 1 --2- 172.21.15.1:0/1308745484 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2f0405f270 0x7f2f04061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2f0c00d260 tx=0x7f2f0c016000).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:15.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.030+0000 7f2f1affd700 1 -- 172.21.15.1:0/1308745484 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2f1c04b9d0 con 0x7f2f240aa060 2023-11-15T02:37:15.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.204+0000 7f2f299a8700 1 -- 172.21.15.1:0/1308745484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f240c4d30 con 0x7f2f240aa060 2023-11-15T02:37:15.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.205+0000 7f2f1affd700 1 -- 172.21.15.1:0/1308745484 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+17655 (secure 0 0 0) 0x7f2f1c04eff0 con 0x7f2f240aa060 2023-11-15T02:37:15.208 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:37:15.208 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":177,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:37:12.506957+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:37:09.163204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-11-15T02:37:10.486624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:37:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.207+0000 7f2f299a8700 1 -- 172.21.15.1:0/1308745484 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2f0405f270 msgr2=0x7f2f04061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.207+0000 7f2f299a8700 1 --2- 172.21.15.1:0/1308745484 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2f0405f270 0x7f2f04061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2f0c00d260 tx=0x7f2f0c016000).stop 2023-11-15T02:37:15.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.207+0000 7f2f299a8700 1 -- 172.21.15.1:0/1308745484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f240aa060 msgr2=0x7f2f24157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.207+0000 7f2f299a8700 1 --2- 172.21.15.1:0/1308745484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f240aa060 0x7f2f24157690 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7f2f1c00e9b0 tx=0x7f2f1c009060).stop 2023-11-15T02:37:15.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.207+0000 7f2f299a8700 1 -- 172.21.15.1:0/1308745484 shutdown_connections 2023-11-15T02:37:15.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.207+0000 7f2f299a8700 1 --2- 172.21.15.1:0/1308745484 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f2f0405f270 0x7f2f04061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.207+0000 7f2f299a8700 1 --2- 172.21.15.1:0/1308745484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f24154150 0x7f2f240abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.207+0000 7f2f299a8700 1 --2- 172.21.15.1:0/1308745484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f240aa060 0x7f2f24157690 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.207+0000 7f2f299a8700 1 --2- 172.21.15.1:0/1308745484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f240ab1a0 0x7f2f240c4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.207+0000 7f2f299a8700 1 -- 172.21.15.1:0/1308745484 >> 172.21.15.1:0/1308745484 conn(0x7f2f24064aa0 msgr2=0x7f2f2414d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:15.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.207+0000 7f2f299a8700 1 -- 172.21.15.1:0/1308745484 shutdown_connections 2023-11-15T02:37:15.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.207+0000 7f2f299a8700 1 -- 172.21.15.1:0/1308745484 wait complete. 2023-11-15T02:37:15.222 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-15T02:37:15.222 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:37:15.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.338+0000 7fb941833700 1 Processor -- start 2023-11-15T02:37:15.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.338+0000 7fb941833700 1 -- start start 2023-11-15T02:37:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.339+0000 7fb941833700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb93c154150 0x7fb93c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.339+0000 7fb941833700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb93c0ab1a0 0x7fb93c158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.339+0000 7fb941833700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c0c06f0 con 0x7fb93c0aa060 2023-11-15T02:37:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.339+0000 7fb941833700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93c0c09d0 con 0x7fb93c154150 2023-11-15T02:37:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.339+0000 7fb941833700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c158820 con 0x7fb93c0ab1a0 2023-11-15T02:37:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb93a7fc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb93c0ab1a0 0x7fb93c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb93affd700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb93c154150 0x7fb93c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb93b7fe700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fb93c0aa060 0x7fb93c0c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:51560/0 (socket says 172.21.15.1:51560) 2023-11-15T02:37:15.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb93b7fe700 1 -- 172.21.15.1:0/418577507 learned_addr learned my addr 172.21.15.1:0/418577507 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:15.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb93a7fc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb93c0ab1a0 0x7fb93c158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:33044/0 (socket says 172.21.15.1:33044) 2023-11-15T02:37:15.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb93affd700 1 --2- 172.21.15.1:0/418577507 >> v2:172.21.15.141:3300/0 conn(0x7fb93c154150 0x7fb93c154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:46548/0 (socket says 172.21.15.1:46548) 2023-11-15T02:37:15.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb93a7fc700 1 -- 172.21.15.1:0/418577507 >> v2:172.21.15.141:3300/0 conn(0x7fb93c154150 msgr2=0x7fb93c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:15.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb93a7fc700 1 --2- 172.21.15.1:0/418577507 >> v2:172.21.15.141:3300/0 conn(0x7fb93c154150 0x7fb93c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb93a7fc700 1 -- 172.21.15.1:0/418577507 >> v1:172.21.15.141:6789/0 conn(0x7fb93c0aa060 legacy=0x7fb93c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb93a7fc700 1 -- 172.21.15.1:0/418577507 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c158b00 con 0x7fb93c0ab1a0 2023-11-15T02:37:15.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb939ffb700 1 -- 172.21.15.1:0/418577507 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932610044 0 0) 0x7fb93c0c06f0 con 0x7fb93c0aa060 2023-11-15T02:37:15.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb93affd700 1 --2- 172.21.15.1:0/418577507 >> v2:172.21.15.141:3300/0 conn(0x7fb93c154150 0x7fb93c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:37:15.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb93a7fc700 1 --2- 172.21.15.1:0/418577507 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb93c0ab1a0 0x7fb93c158040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fb924009760 tx=0x7fb924009060).ready entity=mon.2 client_cookie=24fe797d69babe60 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:15.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb939ffb700 1 -- 172.21.15.1:0/418577507 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9240090d0 con 0x7fb93c0ab1a0 2023-11-15T02:37:15.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb939ffb700 1 -- 172.21.15.1:0/418577507 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92400f510 con 0x7fb93c0ab1a0 2023-11-15T02:37:15.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.340+0000 7fb939ffb700 1 -- 172.21.15.1:0/418577507 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92400f890 con 0x7fb93c0ab1a0 2023-11-15T02:37:15.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.341+0000 7fb941833700 1 -- 172.21.15.1:0/418577507 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb93c0ab1a0 msgr2=0x7fb93c158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.341+0000 7fb941833700 1 --2- 172.21.15.1:0/418577507 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb93c0ab1a0 0x7fb93c158040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fb924009760 tx=0x7fb924009060).stop 2023-11-15T02:37:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.341+0000 7fb941833700 1 -- 172.21.15.1:0/418577507 shutdown_connections 2023-11-15T02:37:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.341+0000 7fb941833700 1 --2- 172.21.15.1:0/418577507 >> v2:172.21.15.141:3300/0 conn(0x7fb93c154150 0x7fb93c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.341+0000 7fb941833700 1 --2- 172.21.15.1:0/418577507 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb93c0ab1a0 0x7fb93c158040 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.341+0000 7fb941833700 1 -- 172.21.15.1:0/418577507 >> 172.21.15.1:0/418577507 conn(0x7fb93c064aa0 msgr2=0x7fb93c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.341+0000 7fb941833700 1 -- 172.21.15.1:0/418577507 shutdown_connections 2023-11-15T02:37:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.341+0000 7fb941833700 1 -- 172.21.15.1:0/418577507 wait complete. 2023-11-15T02:37:15.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.342+0000 7fb941833700 1 Processor -- start 2023-11-15T02:37:15.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.342+0000 7fb941833700 1 -- start start 2023-11-15T02:37:15.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb941833700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb93c0aa060 0x7fb93c0c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb941833700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb93c0ab1a0 0x7fb93c167830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb941833700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb93c154150 0x7fb93c0c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb941833700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0b00d0 con 0x7fb93c0aa060 2023-11-15T02:37:15.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb941833700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0af4e0 con 0x7fb93c154150 2023-11-15T02:37:15.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb941833700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0af730 con 0x7fb93c0ab1a0 2023-11-15T02:37:15.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb93affd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb93c0aa060 0x7fb93c0c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb93affd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb93c0aa060 0x7fb93c0c5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38014/0 (socket says 172.21.15.1:38014) 2023-11-15T02:37:15.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb93affd700 1 -- 172.21.15.1:0/1088123194 learned_addr learned my addr 172.21.15.1:0/1088123194 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:15.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb93b7fe700 1 --2- 172.21.15.1:0/1088123194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb93c154150 0x7fb93c0c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb93a7fc700 1 --2- 172.21.15.1:0/1088123194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb93c0ab1a0 0x7fb93c167830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb93affd700 1 -- 172.21.15.1:0/1088123194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb93c0ab1a0 msgr2=0x7fb93c167830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb93affd700 1 --2- 172.21.15.1:0/1088123194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb93c0ab1a0 0x7fb93c167830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb93affd700 1 -- 172.21.15.1:0/1088123194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb93c154150 msgr2=0x7fb93c0c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb93affd700 1 --2- 172.21.15.1:0/1088123194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb93c154150 0x7fb93c0c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.343+0000 7fb93affd700 1 -- 172.21.15.1:0/1088123194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9340092a0 con 0x7fb93c0aa060 2023-11-15T02:37:15.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.344+0000 7fb93affd700 1 --2- 172.21.15.1:0/1088123194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb93c0aa060 0x7fb93c0c5030 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fb93400e9b0 tx=0x7fb934009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:15.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.344+0000 7fb932ffd700 1 -- 172.21.15.1:0/1088123194 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93400c670 con 0x7fb93c0aa060 2023-11-15T02:37:15.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.344+0000 7fb941833700 1 -- 172.21.15.1:0/1088123194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9240092a0 con 0x7fb93c0aa060 2023-11-15T02:37:15.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.344+0000 7fb941833700 1 -- 172.21.15.1:0/1088123194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c0afcf0 con 0x7fb93c0aa060 2023-11-15T02:37:15.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.344+0000 7fb932ffd700 1 -- 172.21.15.1:0/1088123194 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93400c9e0 con 0x7fb93c0aa060 2023-11-15T02:37:15.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.344+0000 7fb932ffd700 1 -- 172.21.15.1:0/1088123194 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93400cb50 con 0x7fb93c0aa060 2023-11-15T02:37:15.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.345+0000 7fb941833700 1 -- 172.21.15.1:0/1088123194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb920005120 con 0x7fb93c0aa060 2023-11-15T02:37:15.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.345+0000 7fb932ffd700 1 -- 172.21.15.1:0/1088123194 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb93400ccb0 con 0x7fb93c0aa060 2023-11-15T02:37:15.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.346+0000 7fb932ffd700 1 --2- 172.21.15.1:0/1088123194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb91c05f270 0x7fb91c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.346+0000 7fb932ffd700 1 -- 172.21.15.1:0/1088123194 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fb93407a880 con 0x7fb93c0aa060 2023-11-15T02:37:15.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.346+0000 7fb93a7fc700 1 --2- 172.21.15.1:0/1088123194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb91c05f270 0x7fb91c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.346+0000 7fb93a7fc700 1 --2- 172.21.15.1:0/1088123194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb91c05f270 0x7fb91c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fb93c063e00 tx=0x7fb924017000).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:15.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.350+0000 7fb932ffd700 1 -- 172.21.15.1:0/1088123194 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb93404b7e0 con 0x7fb93c0aa060 2023-11-15T02:37:15.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.516+0000 7fb941833700 1 -- 172.21.15.1:0/1088123194 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb920000bc0 con 0x7fb91c05f270 2023-11-15T02:37:15.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.528+0000 7fb932ffd700 1 -- 172.21.15.1:0/1088123194 <== mgr.8110 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352494 (secure 0 0 0) 0x7fb920000bc0 con 0x7fb91c05f270 2023-11-15T02:37:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:37:15.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.531+0000 7fb941833700 1 -- 172.21.15.1:0/1088123194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb91c05f270 msgr2=0x7fb91c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.531+0000 7fb941833700 1 --2- 172.21.15.1:0/1088123194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb91c05f270 0x7fb91c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fb93c063e00 tx=0x7fb924017000).stop 2023-11-15T02:37:15.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.531+0000 7fb941833700 1 -- 172.21.15.1:0/1088123194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb93c0aa060 msgr2=0x7fb93c0c5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.531+0000 7fb941833700 1 --2- 172.21.15.1:0/1088123194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb93c0aa060 0x7fb93c0c5030 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7fb93400e9b0 tx=0x7fb934009060).stop 2023-11-15T02:37:15.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.531+0000 7fb941833700 1 -- 172.21.15.1:0/1088123194 shutdown_connections 2023-11-15T02:37:15.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.531+0000 7fb941833700 1 --2- 172.21.15.1:0/1088123194 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fb91c05f270 0x7fb91c061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.531+0000 7fb941833700 1 --2- 172.21.15.1:0/1088123194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb93c154150 0x7fb93c0c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.531+0000 7fb941833700 1 --2- 172.21.15.1:0/1088123194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb93c0aa060 0x7fb93c0c5030 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.531+0000 7fb941833700 1 --2- 172.21.15.1:0/1088123194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb93c0ab1a0 0x7fb93c167830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.531+0000 7fb941833700 1 -- 172.21.15.1:0/1088123194 >> 172.21.15.1:0/1088123194 conn(0x7fb93c064aa0 msgr2=0x7fb93c159150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:15.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.531+0000 7fb941833700 1 -- 172.21.15.1:0/1088123194 shutdown_connections 2023-11-15T02:37:15.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.531+0000 7fb941833700 1 -- 172.21.15.1:0/1088123194 wait complete. 2023-11-15T02:37:15.539 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:37:15.545 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T02:37:14.076760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":756,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":62,"acting":62,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2459292,"kb_used_data":16988,"kb_used_omap":0,"kb_used_meta":2442240,"kb_avail":752515428,"statfs":{"total":773094113280,"available":770575798272,"internally_reserved":0,"allocated":17395712,"data_stored":9195076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2500853760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13567,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-67,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.001709"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512060+0000","last_change":"2023-11-15T02:37:11.129365+0000","last_active":"2023-11-15T02:37:11.512060+0000","last_peered":"2023-11-15T02:37:11.512060+0000","last_clean":"2023-11-15T02:37:11.512060+0000","last_became_active":"2023-11-15T02:37:11.128680+0000","last_became_peered":"2023-11-15T02:37:11.128680+0000","last_unstale":"2023-11-15T02:37:11.512060+0000","last_undegraded":"2023-11-15T02:37:11.512060+0000","last_fullsized":"2023-11-15T02:37:11.512060+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536120+0000","last_change":"2023-11-15T02:37:11.534908+0000","last_active":"2023-11-15T02:37:11.536120+0000","last_peered":"2023-11-15T02:37:11.536120+0000","last_clean":"2023-11-15T02:37:11.536120+0000","last_became_active":"2023-11-15T02:37:11.534296+0000","last_became_peered":"2023-11-15T02:37:11.534296+0000","last_unstale":"2023-11-15T02:37:11.536120+0000","last_undegraded":"2023-11-15T02:37:11.536120+0000","last_fullsized":"2023-11-15T02:37:11.536120+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528961+0000","last_change":"2023-11-15T02:37:11.136371+0000","last_active":"2023-11-15T02:37:11.528961+0000","last_peered":"2023-11-15T02:37:11.528961+0000","last_clean":"2023-11-15T02:37:11.528961+0000","last_became_active":"2023-11-15T02:37:11.136083+0000","last_became_peered":"2023-11-15T02:37:11.136083+0000","last_unstale":"2023-11-15T02:37:11.528961+0000","last_undegraded":"2023-11-15T02:37:11.528961+0000","last_fullsized":"2023-11-15T02:37:11.528961+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534844+0000","last_change":"2023-11-15T02:37:11.526164+0000","last_active":"2023-11-15T02:37:11.534844+0000","last_peered":"2023-11-15T02:37:11.534844+0000","last_clean":"2023-11-15T02:37:11.534844+0000","last_became_active":"2023-11-15T02:37:11.525902+0000","last_became_peered":"2023-11-15T02:37:11.525902+0000","last_unstale":"2023-11-15T02:37:11.534844+0000","last_undegraded":"2023-11-15T02:37:11.534844+0000","last_fullsized":"2023-11-15T02:37:11.534844+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524936+0000","last_change":"2023-11-15T02:37:11.521807+0000","last_active":"2023-11-15T02:37:11.524936+0000","last_peered":"2023-11-15T02:37:11.524936+0000","last_clean":"2023-11-15T02:37:11.524936+0000","last_became_active":"2023-11-15T02:37:11.521312+0000","last_became_peered":"2023-11-15T02:37:11.521312+0000","last_unstale":"2023-11-15T02:37:11.524936+0000","last_undegraded":"2023-11-15T02:37:11.524936+0000","last_fullsized":"2023-11-15T02:37:11.524936+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510123+0000","last_change":"2023-11-15T02:37:11.136684+0000","last_active":"2023-11-15T02:37:11.510123+0000","last_peered":"2023-11-15T02:37:11.510123+0000","last_clean":"2023-11-15T02:37:11.510123+0000","last_became_active":"2023-11-15T02:37:11.135923+0000","last_became_peered":"2023-11-15T02:37:11.135923+0000","last_unstale":"2023-11-15T02:37:11.510123+0000","last_undegraded":"2023-11-15T02:37:11.510123+0000","last_fullsized":"2023-11-15T02:37:11.510123+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533629+0000","last_change":"2023-11-15T02:37:11.533016+0000","last_active":"2023-11-15T02:37:11.533629+0000","last_peered":"2023-11-15T02:37:11.533629+0000","last_clean":"2023-11-15T02:37:11.533629+0000","last_became_active":"2023-11-15T02:37:11.532722+0000","last_became_peered":"2023-11-15T02:37:11.532722+0000","last_unstale":"2023-11-15T02:37:11.533629+0000","last_undegraded":"2023-11-15T02:37:11.533629+0000","last_fullsized":"2023-11-15T02:37:11.533629+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524601+0000","last_change":"2023-11-15T02:37:11.520452+0000","last_active":"2023-11-15T02:37:11.524601+0000","last_peered":"2023-11-15T02:37:11.524601+0000","last_clean":"2023-11-15T02:37:11.524601+0000","last_became_active":"2023-11-15T02:37:11.520186+0000","last_became_peered":"2023-11-15T02:37:11.520186+0000","last_unstale":"2023-11-15T02:37:11.524601+0000","last_undegraded":"2023-11-15T02:37:11.524601+0000","last_fullsized":"2023-11-15T02:37:11.524601+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510527+0000","last_change":"2023-11-15T02:37:11.132982+0000","last_active":"2023-11-15T02:37:11.510527+0000","last_peered":"2023-11-15T02:37:11.510527+0000","last_clean":"2023-11-15T02:37:11.510527+0000","last_became_active":"2023-11-15T02:37:11.132658+0000","last_became_peered":"2023-11-15T02:37:11.132658+0000","last_unstale":"2023-11-15T02:37:11.510527+0000","last_undegraded":"2023-11-15T02:37:11.510527+0000","last_fullsized":"2023-11-15T02:37:11.510527+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510715+0000","last_change":"2023-11-15T02:37:11.133547+0000","last_active":"2023-11-15T02:37:11.510715+0000","last_peered":"2023-11-15T02:37:11.510715+0000","last_clean":"2023-11-15T02:37:11.510715+0000","last_became_active":"2023-11-15T02:37:11.133276+0000","last_became_peered":"2023-11-15T02:37:11.133276+0000","last_unstale":"2023-11-15T02:37:11.510715+0000","last_undegraded":"2023-11-15T02:37:11.510715+0000","last_fullsized":"2023-11-15T02:37:11.510715+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514923+0000","last_change":"2023-11-15T02:37:11.127060+0000","last_active":"2023-11-15T02:37:11.514923+0000","last_peered":"2023-11-15T02:37:11.514923+0000","last_clean":"2023-11-15T02:37:11.514923+0000","last_became_active":"2023-11-15T02:37:11.126765+0000","last_became_peered":"2023-11-15T02:37:11.126765+0000","last_unstale":"2023-11-15T02:37:11.514923+0000","last_undegraded":"2023-11-15T02:37:11.514923+0000","last_fullsized":"2023-11-15T02:37:11.514923+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524311+0000","last_change":"2023-11-15T02:37:11.516462+0000","last_active":"2023-11-15T02:37:11.524311+0000","last_peered":"2023-11-15T02:37:11.524311+0000","last_clean":"2023-11-15T02:37:11.524311+0000","last_became_active":"2023-11-15T02:37:11.516173+0000","last_became_peered":"2023-11-15T02:37:11.516173+0000","last_unstale":"2023-11-15T02:37:11.524311+0000","last_undegraded":"2023-11-15T02:37:11.524311+0000","last_fullsized":"2023-11-15T02:37:11.524311+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.508592+0000","last_change":"2023-11-15T02:37:11.135042+0000","last_active":"2023-11-15T02:37:11.508592+0000","last_peered":"2023-11-15T02:37:11.508592+0000","last_clean":"2023-11-15T02:37:11.508592+0000","last_became_active":"2023-11-15T02:37:11.134750+0000","last_became_peered":"2023-11-15T02:37:11.134750+0000","last_unstale":"2023-11-15T02:37:11.508592+0000","last_undegraded":"2023-11-15T02:37:11.508592+0000","last_fullsized":"2023-11-15T02:37:11.508592+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535745+0000","last_change":"2023-11-15T02:37:11.530506+0000","last_active":"2023-11-15T02:37:11.535745+0000","last_peered":"2023-11-15T02:37:11.535745+0000","last_clean":"2023-11-15T02:37:11.535745+0000","last_became_active":"2023-11-15T02:37:11.530121+0000","last_became_peered":"2023-11-15T02:37:11.530121+0000","last_unstale":"2023-11-15T02:37:11.535745+0000","last_undegraded":"2023-11-15T02:37:11.535745+0000","last_fullsized":"2023-11-15T02:37:11.535745+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533909+0000","last_change":"2023-11-15T02:37:11.142894+0000","last_active":"2023-11-15T02:37:11.533909+0000","last_peered":"2023-11-15T02:37:11.533909+0000","last_clean":"2023-11-15T02:37:11.533909+0000","last_became_active":"2023-11-15T02:37:11.142437+0000","last_became_peered":"2023-11-15T02:37:11.142437+0000","last_unstale":"2023-11-15T02:37:11.533909+0000","last_undegraded":"2023-11-15T02:37:11.533909+0000","last_fullsized":"2023-11-15T02:37:11.533909+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.519877+0000","last_change":"2023-11-15T02:37:11.132042+0000","last_active":"2023-11-15T02:37:11.519877+0000","last_peered":"2023-11-15T02:37:11.519877+0000","last_clean":"2023-11-15T02:37:11.519877+0000","last_became_active":"2023-11-15T02:37:11.131721+0000","last_became_peered":"2023-11-15T02:37:11.131721+0000","last_unstale":"2023-11-15T02:37:11.519877+0000","last_undegraded":"2023-11-15T02:37:11.519877+0000","last_fullsized":"2023-11-15T02:37:11.519877+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512133+0000","last_change":"2023-11-15T02:37:11.129579+0000","last_active":"2023-11-15T02:37:11.512133+0000","last_peered":"2023-11-15T02:37:11.512133+0000","last_clean":"2023-11-15T02:37:11.512133+0000","last_became_active":"2023-11-15T02:37:11.129102+0000","last_became_peered":"2023-11-15T02:37:11.129102+0000","last_unstale":"2023-11-15T02:37:11.512133+0000","last_undegraded":"2023-11-15T02:37:11.512133+0000","last_fullsized":"2023-11-15T02:37:11.512133+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.509580+0000","last_change":"2023-11-15T02:37:11.132901+0000","last_active":"2023-11-15T02:37:11.509580+0000","last_peered":"2023-11-15T02:37:11.509580+0000","last_clean":"2023-11-15T02:37:11.509580+0000","last_became_active":"2023-11-15T02:37:11.132583+0000","last_became_peered":"2023-11-15T02:37:11.132583+0000","last_unstale":"2023-11-15T02:37:11.509580+0000","last_undegraded":"2023-11-15T02:37:11.509580+0000","last_fullsized":"2023-11-15T02:37:11.509580+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":141,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.131666+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:37:06.131666+0000","last_peered":"2023-11-15T02:37:06.131666+0000","last_clean":"2023-11-15T02:37:06.131666+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:37:06.131666+0000","last_undegraded":"2023-11-15T02:37:06.131666+0000","last_fullsized":"2023-11-15T02:37:06.131666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524918+0000","last_change":"2023-11-15T02:37:11.521619+0000","last_active":"2023-11-15T02:37:11.524918+0000","last_peered":"2023-11-15T02:37:11.524918+0000","last_clean":"2023-11-15T02:37:11.524918+0000","last_became_active":"2023-11-15T02:37:11.520927+0000","last_became_peered":"2023-11-15T02:37:11.520927+0000","last_unstale":"2023-11-15T02:37:11.524918+0000","last_undegraded":"2023-11-15T02:37:11.524918+0000","last_fullsized":"2023-11-15T02:37:11.524918+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"176'3","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535460+0000","last_change":"2023-11-15T02:37:11.130795+0000","last_active":"2023-11-15T02:37:11.535460+0000","last_peered":"2023-11-15T02:37:11.535460+0000","last_clean":"2023-11-15T02:37:11.535460+0000","last_became_active":"2023-11-15T02:37:11.130494+0000","last_became_peered":"2023-11-15T02:37:11.130494+0000","last_unstale":"2023-11-15T02:37:11.535460+0000","last_undegraded":"2023-11-15T02:37:11.535460+0000","last_fullsized":"2023-11-15T02:37:11.535460+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":142,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.046593+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:37:06.046593+0000","last_peered":"2023-11-15T02:37:06.046593+0000","last_clean":"2023-11-15T02:37:06.046593+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:37:06.046593+0000","last_undegraded":"2023-11-15T02:37:06.046593+0000","last_fullsized":"2023-11-15T02:37:06.046593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536132+0000","last_change":"2023-11-15T02:37:11.535066+0000","last_active":"2023-11-15T02:37:11.536132+0000","last_peered":"2023-11-15T02:37:11.536132+0000","last_clean":"2023-11-15T02:37:11.536132+0000","last_became_active":"2023-11-15T02:37:11.534648+0000","last_became_peered":"2023-11-15T02:37:11.534648+0000","last_unstale":"2023-11-15T02:37:11.536132+0000","last_undegraded":"2023-11-15T02:37:11.536132+0000","last_fullsized":"2023-11-15T02:37:11.536132+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":155,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.509104+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:37:11.509104+0000","last_peered":"2023-11-15T02:37:11.509104+0000","last_clean":"2023-11-15T02:37:11.509104+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:37:11.509104+0000","last_undegraded":"2023-11-15T02:37:11.509104+0000","last_fullsized":"2023-11-15T02:37:11.509104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.529462+0000","last_change":"2023-11-15T02:37:11.132331+0000","last_active":"2023-11-15T02:37:11.529462+0000","last_peered":"2023-11-15T02:37:11.529462+0000","last_clean":"2023-11-15T02:37:11.529462+0000","last_became_active":"2023-11-15T02:37:11.131991+0000","last_became_peered":"2023-11-15T02:37:11.131991+0000","last_unstale":"2023-11-15T02:37:11.529462+0000","last_undegraded":"2023-11-15T02:37:11.529462+0000","last_fullsized":"2023-11-15T02:37:11.529462+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":142,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.046627+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:37:06.046627+0000","last_peered":"2023-11-15T02:37:06.046627+0000","last_clean":"2023-11-15T02:37:06.046627+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:37:06.046627+0000","last_undegraded":"2023-11-15T02:37:06.046627+0000","last_fullsized":"2023-11-15T02:37:06.046627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":138,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.131903+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:37:06.131903+0000","last_peered":"2023-11-15T02:37:06.131903+0000","last_clean":"2023-11-15T02:37:06.131903+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:37:06.131903+0000","last_undegraded":"2023-11-15T02:37:06.131903+0000","last_fullsized":"2023-11-15T02:37:06.131903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":136,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.131891+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:37:06.131891+0000","last_peered":"2023-11-15T02:37:06.131891+0000","last_clean":"2023-11-15T02:37:06.131891+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:37:06.131891+0000","last_undegraded":"2023-11-15T02:37:06.131891+0000","last_fullsized":"2023-11-15T02:37:06.131891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":136,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.131945+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:37:06.131945+0000","last_peered":"2023-11-15T02:37:06.131945+0000","last_clean":"2023-11-15T02:37:06.131945+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:37:06.131945+0000","last_undegraded":"2023-11-15T02:37:06.131945+0000","last_fullsized":"2023-11-15T02:37:06.131945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":141,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.131652+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:37:06.131652+0000","last_peered":"2023-11-15T02:37:06.131652+0000","last_clean":"2023-11-15T02:37:06.131652+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:37:06.131652+0000","last_undegraded":"2023-11-15T02:37:06.131652+0000","last_fullsized":"2023-11-15T02:37:06.131652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":159,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.046925+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:37:06.046925+0000","last_peered":"2023-11-15T02:37:06.046925+0000","last_clean":"2023-11-15T02:37:06.046925+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:37:06.046925+0000","last_undegraded":"2023-11-15T02:37:06.046925+0000","last_fullsized":"2023-11-15T02:37:06.046925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":756,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":26,"acting":26,"num_store_stats":2},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575749,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303300,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068540,"statfs":{"total":96636764160,"available":96326184960,"internally_reserved":0,"allocated":2158592,"data_stored":1142074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.375}]},{"osd":1,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":0.997,"15min":0.997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33500000000000002},"max":{"1min":0.74199999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":0.80200000000000005,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78000000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.77400000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.437},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79600000000000004,"5min":1.101,"15min":1.101},"last":0.53000000000000003}]},{"osd":4,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.33000000000000002,"15min":0.27300000000000002},"max":{"1min":0.68799999999999994,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.749,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.45800000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48899999999999999,"15min":0.5},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.70499999999999996,"5min":0.70599999999999996,"15min":0.78800000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.371,"15min":0.33100000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.82799999999999996},"last":0.47299999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.54900000000000004},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.31},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.86299999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.29999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.85699999999999998},"last":0.50700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575750,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307396,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064444,"statfs":{"total":96636764160,"available":96321990656,"internally_reserved":0,"allocated":2158592,"data_stored":1142074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68500000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.33700000000000002,"5min":0.317,"15min":0.308},"max":{"1min":0.755,"5min":0.78900000000000003,"15min":0.82899999999999996},"last":0.438}]},{"osd":1,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32100000000000001},"max":{"1min":0.70399999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.34300000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.45200000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.35299999999999998},"max":{"1min":0.746,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.61299999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78800000000000003,"15min":0.80700000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.38700000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60199999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.307,"5min":0.28599999999999998,"15min":0.26100000000000001},"max":{"1min":0.65800000000000003,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.39600000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.626}]},{"osd":5,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56000000000000005,"15min":0.54700000000000004},"min":{"1min":0.35399999999999998,"5min":0.314,"15min":0.30599999999999999},"max":{"1min":0.74399999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.70299999999999996}]},{"osd":7,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.502},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.28799999999999998},"max":{"1min":0.66800000000000004,"5min":0.81000000000000005,"15min":0.81699999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.41999999999999998,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.83499999999999996,"5min":0.876,"15min":0.876},"last":0.72699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575751,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307396,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064444,"statfs":{"total":96636764160,"available":96321990656,"internally_reserved":0,"allocated":2158592,"data_stored":1142074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.45600000000000002,"5min":0.66000000000000003,"15min":0.66800000000000004},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.52500000000000002,"5min":0.64200000000000002,"15min":0.65800000000000003},"last":0.249}]},{"osd":2,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.26900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.46300000000000002,"5min":0.59799999999999998,"15min":0.63100000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.44400000000000001,"15min":0.45500000000000002},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.27100000000000002},"max":{"1min":0.56599999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.26600000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.30599999999999999},"max":{"1min":0.61799999999999999,"5min":0.69799999999999995,"15min":0.74299999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.48499999999999999,"15min":0.49199999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55500000000000005,"5min":0.70899999999999996,"15min":0.77100000000000002},"last":0.33400000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":0.89800000000000002,"15min":1.097},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.96499999999999997,"15min":1.014},"last":0.66400000000000003}]},{"osd":5,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":0.89200000000000002,"15min":0.98699999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.95399999999999996,"15min":1.024},"last":0.60899999999999999}]},{"osd":6,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.47899999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.94399999999999995,"15min":0.96799999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88400000000000001,"5min":0.93200000000000005,"15min":1.143},"last":0.77300000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90500000000000003,"5min":0.95799999999999996,"15min":1.111},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":0.97999999999999998,"15min":1.0129999999999999},"last":0.60099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575750,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307460,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064380,"statfs":{"total":96636764160,"available":96321925120,"internally_reserved":0,"allocated":2224128,"data_stored":1171609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60299999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.42299999999999999},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.57999999999999996,"5min":0.63700000000000001,"15min":0.64200000000000002},"last":0.35999999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39400000000000002,"15min":0.39900000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53600000000000003,"5min":0.60099999999999998,"15min":0.83799999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.72499999999999998},"last":0.31}]},{"osd":3,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.44,"15min":0.44600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.28899999999999998},"max":{"1min":0.58599999999999997,"5min":0.64700000000000002,"15min":0.69799999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.71599999999999997},"last":0.435}]},{"osd":4,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66800000000000004,"15min":0.67600000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.39100000000000001},"max":{"1min":0.92100000000000004,"5min":0.96599999999999997,"15min":1.004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89100000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80500000000000005,"5min":0.88300000000000001,"15min":1.05},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65500000000000003,"15min":0.66500000000000004},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.44900000000000001},"max":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":1.004},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64700000000000002,"15min":0.66300000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.42699999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":1.026},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.68200000000000005},"min":{"1min":0.49199999999999999,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.0309999999999999},"last":0.51800000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69199999999999995,"15min":0.70799999999999996},"min":{"1min":0.53700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85399999999999998,"5min":0.93200000000000005,"15min":1.0600000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.72199999999999998},"min":{"1min":0.53600000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.997,"5min":0.997,"15min":1.0409999999999999},"last":0.749}]}]},{"osd":2,"up_from":13,"seq":55834575751,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311552,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060288,"statfs":{"total":96636764160,"available":96317734912,"internally_reserved":0,"allocated":2220032,"data_stored":1171023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.248,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56499999999999995,"5min":0.69699999999999995,"15min":0.83999999999999997},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.25900000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.63500000000000001,"5min":0.69199999999999995,"15min":0.85899999999999999},"last":0.28599999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39400000000000002,"15min":0.40600000000000003},"min":{"1min":0.28699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.52200000000000002,"5min":0.68999999999999995,"15min":0.91000000000000003},"last":0.316},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45600000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55700000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34300000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.33500000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64800000000000002,"5min":0.755,"15min":0.79800000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":0.65600000000000003,"5min":0.69499999999999995,"15min":1.113},"last":0.35699999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67100000000000004,"15min":0.65500000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.89000000000000001,"5min":1.0069999999999999,"15min":1.2170000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91100000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.74299999999999999}]},{"osd":5,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.41899999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.153},"last":0.755},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69299999999999995,"15min":0.68300000000000005},"min":{"1min":0.497,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.996},"last":0.68400000000000005}]},{"osd":6,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.442},"max":{"1min":0.85699999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.628},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.70599999999999996},"min":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.438},"max":{"1min":0.97299999999999998,"5min":1.079,"15min":1.079},"last":0.69299999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95099999999999996,"5min":1.0940000000000001,"15min":1.7270000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.72199999999999998},"min":{"1min":0.495,"5min":0.46800000000000003,"15min":0.45800000000000002},"max":{"1min":0.90900000000000003,"5min":1.038,"15min":1.038},"last":0.78200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575751,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":2158592,"data_stored":1142074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.26400000000000001,"5min":0.24099999999999999,"15min":0.222},"max":{"1min":0.55900000000000005,"5min":0.56299999999999994,"15min":0.67700000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.40699999999999997,"15min":0.41799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.24199999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.67400000000000004},"last":0.46500000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.40200000000000002,"15min":0.41899999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56899999999999995,"5min":0.622,"15min":0.81399999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.25800000000000001},"max":{"1min":0.64900000000000002,"5min":0.746,"15min":0.75800000000000001},"last":0.39100000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.71499999999999997,"15min":0.76900000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.497,"15min":0.501},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.75600000000000001},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.432,"5min":0.41899999999999998,"15min":0.40500000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.306},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.49299999999999999}]},{"osd":5,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66500000000000004,"15min":0.68000000000000005},"min":{"1min":0.48099999999999998,"5min":0.42899999999999999,"15min":0.39100000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.46999999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.129},"last":0.5}]},{"osd":6,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.496,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.46100000000000002,"15min":0.438},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.439},"max":{"1min":1.159,"5min":1.159,"15min":1.256},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.61899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575749,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303300,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068540,"statfs":{"total":96636764160,"available":96326184960,"internally_reserved":0,"allocated":2158592,"data_stored":1142074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.32000000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.80800000000000005},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.67600000000000005,"5min":0.78000000000000003,"15min":1.1919999999999999},"last":0.38600000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.45400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.42999999999999999,"5min":0.39400000000000002,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.82199999999999995,"15min":1.2},"last":0.374}]},{"osd":2,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.59899999999999998},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.36599999999999999},"max":{"1min":0.74299999999999999,"5min":0.752,"15min":1.272},"last":0.441},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.434,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79800000000000004,"5min":0.81899999999999995,"15min":0.95999999999999996},"last":0.43099999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.40500000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.3109999999999999},"last":0.33500000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.53400000000000003,"15min":0.48599999999999999},"min":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.30299999999999999},"max":{"1min":4.8230000000000004,"5min":4.8230000000000004,"15min":4.8230000000000004},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.28299999999999997},"max":{"1min":0.71499999999999997,"5min":0.747,"15min":0.79000000000000004},"last":0.35199999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.56100000000000005,"15min":0.51800000000000002},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.32900000000000001},"max":{"1min":4.8689999999999998,"5min":4.8689999999999998,"15min":4.8689999999999998},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.38500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72099999999999997,"5min":0.78800000000000003,"15min":0.85399999999999998},"last":0.39400000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.58099999999999996,"15min":0.54400000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":4.4569999999999999,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.36799999999999999},"max":{"1min":0.75,"5min":0.79100000000000004,"15min":0.83299999999999996},"last":0.36599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575749,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307396,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064444,"statfs":{"total":96636764160,"available":96321990656,"internally_reserved":0,"allocated":2158592,"data_stored":1142074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67300000000000004,"5min":0.76900000000000002,"15min":1.1379999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79000000000000004,"5min":0.79500000000000004,"15min":1.0169999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68899999999999995,"5min":0.84299999999999997,"15min":1.0109999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.55900000000000005,"15min":0.56799999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":1.135},"last":0.39900000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":1.155},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76700000000000002,"5min":0.81999999999999995,"15min":1.0369999999999999},"last":0.48599999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.77800000000000002,"5min":0.79200000000000004,"15min":1.1779999999999999},"last":0.499},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69899999999999995,"5min":0.79900000000000004,"15min":1.171},"last":0.54200000000000004}]},{"osd":4,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45700000000000002,"15min":0.45900000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.72399999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.313},"max":{"1min":0.68799999999999994,"5min":0.77900000000000003,"15min":0.78600000000000003},"last":0.57899999999999996}]},{"osd":6,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.317,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.80900000000000005},"last":0.625},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.497,"15min":0.498},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64600000000000002,"5min":0.76500000000000001,"15min":0.81899999999999995},"last":0.53400000000000003}]},{"osd":7,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.499,"15min":0.495},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63900000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.36299999999999999},"max":{"1min":0.73999999999999999,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:37:15.553 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:37:15.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.701+0000 7f778ce89700 1 Processor -- start 2023-11-15T02:37:15.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.701+0000 7f778ce89700 1 -- start start 2023-11-15T02:37:15.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.702+0000 7f778ce89700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7788155790 0x7f77880a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.702+0000 7f778ce89700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7788083630 con 0x7f7788155b70 2023-11-15T02:37:15.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.702+0000 7f778ce89700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77880c7c90 con 0x7f77880a61b0 2023-11-15T02:37:15.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.702+0000 7f778ce89700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77880c5420 con 0x7f7788155790 2023-11-15T02:37:15.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.702+0000 7f7785d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7788155b70 0x7f77880c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58700/0 (socket says 172.21.15.1:58700) 2023-11-15T02:37:15.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.702+0000 7f7785d9b700 1 -- 172.21.15.1:0/847764164 learned_addr learned my addr 172.21.15.1:0/847764164 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:15.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778659c700 1 --2- 172.21.15.1:0/847764164 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7788155790 0x7f77880a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154253661 0 0) 0x7f7788083630 con 0x7f7788155b70 2023-11-15T02:37:15.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77740033f0 con 0x7f7788155b70 2023-11-15T02:37:15.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222869723 0 0) 0x7f77880c7c90 con 0x7f77880a61b0 2023-11-15T02:37:15.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7788083630 con 0x7f77880a61b0 2023-11-15T02:37:15.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1231151895 0 0) 0x7f77740033f0 con 0x7f7788155b70 2023-11-15T02:37:15.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7788155790 msgr2=0x7f77880a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:15.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 --2- 172.21.15.1:0/847764164 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7788155790 0x7f77880a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 >> v1:172.21.15.141:6789/0 conn(0x7f77880a61b0 legacy=0x7f77880bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77880c7960 con 0x7f7788155b70 2023-11-15T02:37:15.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f7770001470 con 0x7f7788155b70 2023-11-15T02:37:15.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 >> v1:172.21.15.1:6789/0 conn(0x7f7788155b70 legacy=0x7f77880c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 --2- 172.21.15.1:0/847764164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7774003aa0 0x7f7774003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 --2- 172.21.15.1:0/847764164 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7788155790 0x7f7774004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 --2- 172.21.15.1:0/847764164 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7774004b80 0x7f7774005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77880c5420 con 0x7f7774003aa0 2023-11-15T02:37:15.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777400b910 con 0x7f7774004b80 2023-11-15T02:37:15.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777400bad0 con 0x7f7788155790 2023-11-15T02:37:15.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778659c700 1 --2- 172.21.15.1:0/847764164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7774003aa0 0x7f7774003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f7785d9b700 1 --2- 172.21.15.1:0/847764164 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7788155790 0x7f7774004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f7786d9d700 1 --2- 172.21.15.1:0/847764164 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7774004b80 0x7f7774005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.703+0000 7f778659c700 1 -- 172.21.15.1:0/847764164 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7788155790 msgr2=0x7f7774004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.704+0000 7f778659c700 1 --2- 172.21.15.1:0/847764164 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7788155790 0x7f7774004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.704+0000 7f778659c700 1 -- 172.21.15.1:0/847764164 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7774004b80 msgr2=0x7f7774005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.704+0000 7f778659c700 1 --2- 172.21.15.1:0/847764164 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7774004b80 0x7f7774005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.704+0000 7f778659c700 1 -- 172.21.15.1:0/847764164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77740033f0 con 0x7f7774003aa0 2023-11-15T02:37:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.704+0000 7f778659c700 1 --2- 172.21.15.1:0/847764164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7774003aa0 0x7f7774003ea0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f7780006fd0 tx=0x7f7780006f40).ready entity=mon.0 client_cookie=efc96c8462c4f3e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.704+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780009430 con 0x7f7774003aa0 2023-11-15T02:37:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.704+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778000e640 con 0x7f7774003aa0 2023-11-15T02:37:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.704+0000 7f778559a700 1 -- 172.21.15.1:0/847764164 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778000e9c0 con 0x7f7774003aa0 2023-11-15T02:37:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.704+0000 7f778ce89700 1 -- 172.21.15.1:0/847764164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7774003aa0 msgr2=0x7f7774003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.704+0000 7f778ce89700 1 --2- 172.21.15.1:0/847764164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7774003aa0 0x7f7774003ea0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f7780006fd0 tx=0x7f7780006f40).stop 2023-11-15T02:37:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.704+0000 7f7786d9d700 1 -- 172.21.15.1:0/847764164 reap_dead start 2023-11-15T02:37:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.704+0000 7f778ce89700 1 -- 172.21.15.1:0/847764164 shutdown_connections 2023-11-15T02:37:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.704+0000 7f778ce89700 1 -- 172.21.15.1:0/847764164 >> 172.21.15.1:0/847764164 conn(0x7f7788082f90 msgr2=0x7f77880c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.704+0000 7f778ce89700 1 -- 172.21.15.1:0/847764164 shutdown_connections 2023-11-15T02:37:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.704+0000 7f778ce89700 1 -- 172.21.15.1:0/847764164 wait complete. 2023-11-15T02:37:15.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.705+0000 7f778ce89700 1 Processor -- start 2023-11-15T02:37:15.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.706+0000 7f778ce89700 1 -- start start 2023-11-15T02:37:15.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.706+0000 7f778ce89700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7774003aa0 0x7f77881622b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.706+0000 7f778ce89700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f778814b440 0x7f778814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.706+0000 7f778ce89700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7788152910 0x7f77880c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.706+0000 7f778ce89700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77881658d0 con 0x7f778814b440 2023-11-15T02:37:15.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.706+0000 7f778ce89700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7788162890 con 0x7f7774003aa0 2023-11-15T02:37:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.706+0000 7f778ce89700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7788162b70 con 0x7f7788152910 2023-11-15T02:37:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.706+0000 7f7785d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f778814b440 0x7f778814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.706+0000 7f7785d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f778814b440 0x7f778814abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38032/0 (socket says 172.21.15.1:38032) 2023-11-15T02:37:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.706+0000 7f7785d9b700 1 -- 172.21.15.1:0/1660890363 learned_addr learned my addr 172.21.15.1:0/1660890363 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.707+0000 7f7786d9d700 1 --2- 172.21.15.1:0/1660890363 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7788152910 0x7f77880c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.707+0000 7f778659c700 1 --2- 172.21.15.1:0/1660890363 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7774003aa0 0x7f77881622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.707+0000 7f7785d9b700 1 -- 172.21.15.1:0/1660890363 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7788152910 msgr2=0x7f77880c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.707+0000 7f7785d9b700 1 --2- 172.21.15.1:0/1660890363 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7788152910 0x7f77880c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.707+0000 7f7785d9b700 1 -- 172.21.15.1:0/1660890363 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7774003aa0 msgr2=0x7f77881622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.707+0000 7f7785d9b700 1 --2- 172.21.15.1:0/1660890363 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7774003aa0 0x7f77881622b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.707+0000 7f7785d9b700 1 -- 172.21.15.1:0/1660890363 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7788162e50 con 0x7f778814b440 2023-11-15T02:37:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.707+0000 7f7785d9b700 1 --2- 172.21.15.1:0/1660890363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f778814b440 0x7f778814abe0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f7770000c00 tx=0x7f7770001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.707+0000 7f777e7fc700 1 -- 172.21.15.1:0/1660890363 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777000f870 con 0x7f778814b440 2023-11-15T02:37:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.707+0000 7f777e7fc700 1 -- 172.21.15.1:0/1660890363 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777000f9d0 con 0x7f778814b440 2023-11-15T02:37:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.707+0000 7f777e7fc700 1 -- 172.21.15.1:0/1660890363 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777000fd50 con 0x7f778814b440 2023-11-15T02:37:15.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.707+0000 7f778ce89700 1 -- 172.21.15.1:0/1660890363 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7788163130 con 0x7f778814b440 2023-11-15T02:37:15.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.707+0000 7f778ce89700 1 -- 172.21.15.1:0/1660890363 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778814b0d0 con 0x7f778814b440 2023-11-15T02:37:15.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.708+0000 7f778ce89700 1 -- 172.21.15.1:0/1660890363 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778806c7e0 con 0x7f778814b440 2023-11-15T02:37:15.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.708+0000 7f777e7fc700 1 -- 172.21.15.1:0/1660890363 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7770012560 con 0x7f778814b440 2023-11-15T02:37:15.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.709+0000 7f777e7fc700 1 --2- 172.21.15.1:0/1660890363 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f776805f270 0x7f7768061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:15.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.709+0000 7f777e7fc700 1 -- 172.21.15.1:0/1660890363 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f777007a100 con 0x7f778814b440 2023-11-15T02:37:15.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.709+0000 7f778659c700 1 --2- 172.21.15.1:0/1660890363 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f776805f270 0x7f7768061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:15.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.709+0000 7f778659c700 1 --2- 172.21.15.1:0/1660890363 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f776805f270 0x7f7768061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7780006cf0 tx=0x7f778001a000).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:15.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.713+0000 7f777e7fc700 1 -- 172.21.15.1:0/1660890363 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f777004b110 con 0x7f778814b440 2023-11-15T02:37:15.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.884+0000 7f778ce89700 1 -- 172.21.15.1:0/1660890363 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f778805f8b0 con 0x7f776805f270 2023-11-15T02:37:15.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.894+0000 7f777e7fc700 1 -- 172.21.15.1:0/1660890363 <== mgr.8110 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352494 (secure 0 0 0) 0x7f778805f8b0 con 0x7f776805f270 2023-11-15T02:37:15.899 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:37:15.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.897+0000 7f778ce89700 1 -- 172.21.15.1:0/1660890363 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f776805f270 msgr2=0x7f7768061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.897+0000 7f778ce89700 1 --2- 172.21.15.1:0/1660890363 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f776805f270 0x7f7768061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7780006cf0 tx=0x7f778001a000).stop 2023-11-15T02:37:15.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.897+0000 7f778ce89700 1 -- 172.21.15.1:0/1660890363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f778814b440 msgr2=0x7f778814abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:15.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.897+0000 7f778ce89700 1 --2- 172.21.15.1:0/1660890363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f778814b440 0x7f778814abe0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f7770000c00 tx=0x7f7770001e10).stop 2023-11-15T02:37:15.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.897+0000 7f778ce89700 1 -- 172.21.15.1:0/1660890363 shutdown_connections 2023-11-15T02:37:15.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.897+0000 7f778ce89700 1 --2- 172.21.15.1:0/1660890363 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f776805f270 0x7f7768061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.897+0000 7f778ce89700 1 --2- 172.21.15.1:0/1660890363 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7788152910 0x7f77880c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.897+0000 7f778ce89700 1 --2- 172.21.15.1:0/1660890363 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7774003aa0 0x7f77881622b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.897+0000 7f778ce89700 1 --2- 172.21.15.1:0/1660890363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f778814b440 0x7f778814abe0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:15.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.897+0000 7f778ce89700 1 -- 172.21.15.1:0/1660890363 >> 172.21.15.1:0/1660890363 conn(0x7f7788082f90 msgr2=0x7f7788067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:15.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.897+0000 7f778ce89700 1 -- 172.21.15.1:0/1660890363 shutdown_connections 2023-11-15T02:37:15.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:15.897+0000 7f778ce89700 1 -- 172.21.15.1:0/1660890363 wait complete. 2023-11-15T02:37:15.906 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:37:15.911 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T02:37:14.076760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":756,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":62,"acting":62,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2459292,"kb_used_data":16988,"kb_used_omap":0,"kb_used_meta":2442240,"kb_avail":752515428,"statfs":{"total":773094113280,"available":770575798272,"internally_reserved":0,"allocated":17395712,"data_stored":9195076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2500853760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13567,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-67,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.001709"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512060+0000","last_change":"2023-11-15T02:37:11.129365+0000","last_active":"2023-11-15T02:37:11.512060+0000","last_peered":"2023-11-15T02:37:11.512060+0000","last_clean":"2023-11-15T02:37:11.512060+0000","last_became_active":"2023-11-15T02:37:11.128680+0000","last_became_peered":"2023-11-15T02:37:11.128680+0000","last_unstale":"2023-11-15T02:37:11.512060+0000","last_undegraded":"2023-11-15T02:37:11.512060+0000","last_fullsized":"2023-11-15T02:37:11.512060+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536120+0000","last_change":"2023-11-15T02:37:11.534908+0000","last_active":"2023-11-15T02:37:11.536120+0000","last_peered":"2023-11-15T02:37:11.536120+0000","last_clean":"2023-11-15T02:37:11.536120+0000","last_became_active":"2023-11-15T02:37:11.534296+0000","last_became_peered":"2023-11-15T02:37:11.534296+0000","last_unstale":"2023-11-15T02:37:11.536120+0000","last_undegraded":"2023-11-15T02:37:11.536120+0000","last_fullsized":"2023-11-15T02:37:11.536120+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528961+0000","last_change":"2023-11-15T02:37:11.136371+0000","last_active":"2023-11-15T02:37:11.528961+0000","last_peered":"2023-11-15T02:37:11.528961+0000","last_clean":"2023-11-15T02:37:11.528961+0000","last_became_active":"2023-11-15T02:37:11.136083+0000","last_became_peered":"2023-11-15T02:37:11.136083+0000","last_unstale":"2023-11-15T02:37:11.528961+0000","last_undegraded":"2023-11-15T02:37:11.528961+0000","last_fullsized":"2023-11-15T02:37:11.528961+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534844+0000","last_change":"2023-11-15T02:37:11.526164+0000","last_active":"2023-11-15T02:37:11.534844+0000","last_peered":"2023-11-15T02:37:11.534844+0000","last_clean":"2023-11-15T02:37:11.534844+0000","last_became_active":"2023-11-15T02:37:11.525902+0000","last_became_peered":"2023-11-15T02:37:11.525902+0000","last_unstale":"2023-11-15T02:37:11.534844+0000","last_undegraded":"2023-11-15T02:37:11.534844+0000","last_fullsized":"2023-11-15T02:37:11.534844+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524936+0000","last_change":"2023-11-15T02:37:11.521807+0000","last_active":"2023-11-15T02:37:11.524936+0000","last_peered":"2023-11-15T02:37:11.524936+0000","last_clean":"2023-11-15T02:37:11.524936+0000","last_became_active":"2023-11-15T02:37:11.521312+0000","last_became_peered":"2023-11-15T02:37:11.521312+0000","last_unstale":"2023-11-15T02:37:11.524936+0000","last_undegraded":"2023-11-15T02:37:11.524936+0000","last_fullsized":"2023-11-15T02:37:11.524936+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510123+0000","last_change":"2023-11-15T02:37:11.136684+0000","last_active":"2023-11-15T02:37:11.510123+0000","last_peered":"2023-11-15T02:37:11.510123+0000","last_clean":"2023-11-15T02:37:11.510123+0000","last_became_active":"2023-11-15T02:37:11.135923+0000","last_became_peered":"2023-11-15T02:37:11.135923+0000","last_unstale":"2023-11-15T02:37:11.510123+0000","last_undegraded":"2023-11-15T02:37:11.510123+0000","last_fullsized":"2023-11-15T02:37:11.510123+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533629+0000","last_change":"2023-11-15T02:37:11.533016+0000","last_active":"2023-11-15T02:37:11.533629+0000","last_peered":"2023-11-15T02:37:11.533629+0000","last_clean":"2023-11-15T02:37:11.533629+0000","last_became_active":"2023-11-15T02:37:11.532722+0000","last_became_peered":"2023-11-15T02:37:11.532722+0000","last_unstale":"2023-11-15T02:37:11.533629+0000","last_undegraded":"2023-11-15T02:37:11.533629+0000","last_fullsized":"2023-11-15T02:37:11.533629+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524601+0000","last_change":"2023-11-15T02:37:11.520452+0000","last_active":"2023-11-15T02:37:11.524601+0000","last_peered":"2023-11-15T02:37:11.524601+0000","last_clean":"2023-11-15T02:37:11.524601+0000","last_became_active":"2023-11-15T02:37:11.520186+0000","last_became_peered":"2023-11-15T02:37:11.520186+0000","last_unstale":"2023-11-15T02:37:11.524601+0000","last_undegraded":"2023-11-15T02:37:11.524601+0000","last_fullsized":"2023-11-15T02:37:11.524601+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510527+0000","last_change":"2023-11-15T02:37:11.132982+0000","last_active":"2023-11-15T02:37:11.510527+0000","last_peered":"2023-11-15T02:37:11.510527+0000","last_clean":"2023-11-15T02:37:11.510527+0000","last_became_active":"2023-11-15T02:37:11.132658+0000","last_became_peered":"2023-11-15T02:37:11.132658+0000","last_unstale":"2023-11-15T02:37:11.510527+0000","last_undegraded":"2023-11-15T02:37:11.510527+0000","last_fullsized":"2023-11-15T02:37:11.510527+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510715+0000","last_change":"2023-11-15T02:37:11.133547+0000","last_active":"2023-11-15T02:37:11.510715+0000","last_peered":"2023-11-15T02:37:11.510715+0000","last_clean":"2023-11-15T02:37:11.510715+0000","last_became_active":"2023-11-15T02:37:11.133276+0000","last_became_peered":"2023-11-15T02:37:11.133276+0000","last_unstale":"2023-11-15T02:37:11.510715+0000","last_undegraded":"2023-11-15T02:37:11.510715+0000","last_fullsized":"2023-11-15T02:37:11.510715+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514923+0000","last_change":"2023-11-15T02:37:11.127060+0000","last_active":"2023-11-15T02:37:11.514923+0000","last_peered":"2023-11-15T02:37:11.514923+0000","last_clean":"2023-11-15T02:37:11.514923+0000","last_became_active":"2023-11-15T02:37:11.126765+0000","last_became_peered":"2023-11-15T02:37:11.126765+0000","last_unstale":"2023-11-15T02:37:11.514923+0000","last_undegraded":"2023-11-15T02:37:11.514923+0000","last_fullsized":"2023-11-15T02:37:11.514923+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524311+0000","last_change":"2023-11-15T02:37:11.516462+0000","last_active":"2023-11-15T02:37:11.524311+0000","last_peered":"2023-11-15T02:37:11.524311+0000","last_clean":"2023-11-15T02:37:11.524311+0000","last_became_active":"2023-11-15T02:37:11.516173+0000","last_became_peered":"2023-11-15T02:37:11.516173+0000","last_unstale":"2023-11-15T02:37:11.524311+0000","last_undegraded":"2023-11-15T02:37:11.524311+0000","last_fullsized":"2023-11-15T02:37:11.524311+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.508592+0000","last_change":"2023-11-15T02:37:11.135042+0000","last_active":"2023-11-15T02:37:11.508592+0000","last_peered":"2023-11-15T02:37:11.508592+0000","last_clean":"2023-11-15T02:37:11.508592+0000","last_became_active":"2023-11-15T02:37:11.134750+0000","last_became_peered":"2023-11-15T02:37:11.134750+0000","last_unstale":"2023-11-15T02:37:11.508592+0000","last_undegraded":"2023-11-15T02:37:11.508592+0000","last_fullsized":"2023-11-15T02:37:11.508592+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535745+0000","last_change":"2023-11-15T02:37:11.530506+0000","last_active":"2023-11-15T02:37:11.535745+0000","last_peered":"2023-11-15T02:37:11.535745+0000","last_clean":"2023-11-15T02:37:11.535745+0000","last_became_active":"2023-11-15T02:37:11.530121+0000","last_became_peered":"2023-11-15T02:37:11.530121+0000","last_unstale":"2023-11-15T02:37:11.535745+0000","last_undegraded":"2023-11-15T02:37:11.535745+0000","last_fullsized":"2023-11-15T02:37:11.535745+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533909+0000","last_change":"2023-11-15T02:37:11.142894+0000","last_active":"2023-11-15T02:37:11.533909+0000","last_peered":"2023-11-15T02:37:11.533909+0000","last_clean":"2023-11-15T02:37:11.533909+0000","last_became_active":"2023-11-15T02:37:11.142437+0000","last_became_peered":"2023-11-15T02:37:11.142437+0000","last_unstale":"2023-11-15T02:37:11.533909+0000","last_undegraded":"2023-11-15T02:37:11.533909+0000","last_fullsized":"2023-11-15T02:37:11.533909+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.519877+0000","last_change":"2023-11-15T02:37:11.132042+0000","last_active":"2023-11-15T02:37:11.519877+0000","last_peered":"2023-11-15T02:37:11.519877+0000","last_clean":"2023-11-15T02:37:11.519877+0000","last_became_active":"2023-11-15T02:37:11.131721+0000","last_became_peered":"2023-11-15T02:37:11.131721+0000","last_unstale":"2023-11-15T02:37:11.519877+0000","last_undegraded":"2023-11-15T02:37:11.519877+0000","last_fullsized":"2023-11-15T02:37:11.519877+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512133+0000","last_change":"2023-11-15T02:37:11.129579+0000","last_active":"2023-11-15T02:37:11.512133+0000","last_peered":"2023-11-15T02:37:11.512133+0000","last_clean":"2023-11-15T02:37:11.512133+0000","last_became_active":"2023-11-15T02:37:11.129102+0000","last_became_peered":"2023-11-15T02:37:11.129102+0000","last_unstale":"2023-11-15T02:37:11.512133+0000","last_undegraded":"2023-11-15T02:37:11.512133+0000","last_fullsized":"2023-11-15T02:37:11.512133+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.509580+0000","last_change":"2023-11-15T02:37:11.132901+0000","last_active":"2023-11-15T02:37:11.509580+0000","last_peered":"2023-11-15T02:37:11.509580+0000","last_clean":"2023-11-15T02:37:11.509580+0000","last_became_active":"2023-11-15T02:37:11.132583+0000","last_became_peered":"2023-11-15T02:37:11.132583+0000","last_unstale":"2023-11-15T02:37:11.509580+0000","last_undegraded":"2023-11-15T02:37:11.509580+0000","last_fullsized":"2023-11-15T02:37:11.509580+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":141,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.131666+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:37:06.131666+0000","last_peered":"2023-11-15T02:37:06.131666+0000","last_clean":"2023-11-15T02:37:06.131666+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:37:06.131666+0000","last_undegraded":"2023-11-15T02:37:06.131666+0000","last_fullsized":"2023-11-15T02:37:06.131666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524918+0000","last_change":"2023-11-15T02:37:11.521619+0000","last_active":"2023-11-15T02:37:11.524918+0000","last_peered":"2023-11-15T02:37:11.524918+0000","last_clean":"2023-11-15T02:37:11.524918+0000","last_became_active":"2023-11-15T02:37:11.520927+0000","last_became_peered":"2023-11-15T02:37:11.520927+0000","last_unstale":"2023-11-15T02:37:11.524918+0000","last_undegraded":"2023-11-15T02:37:11.524918+0000","last_fullsized":"2023-11-15T02:37:11.524918+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"176'3","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535460+0000","last_change":"2023-11-15T02:37:11.130795+0000","last_active":"2023-11-15T02:37:11.535460+0000","last_peered":"2023-11-15T02:37:11.535460+0000","last_clean":"2023-11-15T02:37:11.535460+0000","last_became_active":"2023-11-15T02:37:11.130494+0000","last_became_peered":"2023-11-15T02:37:11.130494+0000","last_unstale":"2023-11-15T02:37:11.535460+0000","last_undegraded":"2023-11-15T02:37:11.535460+0000","last_fullsized":"2023-11-15T02:37:11.535460+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":142,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.046593+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:37:06.046593+0000","last_peered":"2023-11-15T02:37:06.046593+0000","last_clean":"2023-11-15T02:37:06.046593+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:37:06.046593+0000","last_undegraded":"2023-11-15T02:37:06.046593+0000","last_fullsized":"2023-11-15T02:37:06.046593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536132+0000","last_change":"2023-11-15T02:37:11.535066+0000","last_active":"2023-11-15T02:37:11.536132+0000","last_peered":"2023-11-15T02:37:11.536132+0000","last_clean":"2023-11-15T02:37:11.536132+0000","last_became_active":"2023-11-15T02:37:11.534648+0000","last_became_peered":"2023-11-15T02:37:11.534648+0000","last_unstale":"2023-11-15T02:37:11.536132+0000","last_undegraded":"2023-11-15T02:37:11.536132+0000","last_fullsized":"2023-11-15T02:37:11.536132+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":155,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.509104+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:37:11.509104+0000","last_peered":"2023-11-15T02:37:11.509104+0000","last_clean":"2023-11-15T02:37:11.509104+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:37:11.509104+0000","last_undegraded":"2023-11-15T02:37:11.509104+0000","last_fullsized":"2023-11-15T02:37:11.509104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.529462+0000","last_change":"2023-11-15T02:37:11.132331+0000","last_active":"2023-11-15T02:37:11.529462+0000","last_peered":"2023-11-15T02:37:11.529462+0000","last_clean":"2023-11-15T02:37:11.529462+0000","last_became_active":"2023-11-15T02:37:11.131991+0000","last_became_peered":"2023-11-15T02:37:11.131991+0000","last_unstale":"2023-11-15T02:37:11.529462+0000","last_undegraded":"2023-11-15T02:37:11.529462+0000","last_fullsized":"2023-11-15T02:37:11.529462+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":142,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.046627+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:37:06.046627+0000","last_peered":"2023-11-15T02:37:06.046627+0000","last_clean":"2023-11-15T02:37:06.046627+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:37:06.046627+0000","last_undegraded":"2023-11-15T02:37:06.046627+0000","last_fullsized":"2023-11-15T02:37:06.046627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":138,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.131903+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:37:06.131903+0000","last_peered":"2023-11-15T02:37:06.131903+0000","last_clean":"2023-11-15T02:37:06.131903+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:37:06.131903+0000","last_undegraded":"2023-11-15T02:37:06.131903+0000","last_fullsized":"2023-11-15T02:37:06.131903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":136,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.131891+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:37:06.131891+0000","last_peered":"2023-11-15T02:37:06.131891+0000","last_clean":"2023-11-15T02:37:06.131891+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:37:06.131891+0000","last_undegraded":"2023-11-15T02:37:06.131891+0000","last_fullsized":"2023-11-15T02:37:06.131891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":136,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.131945+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:37:06.131945+0000","last_peered":"2023-11-15T02:37:06.131945+0000","last_clean":"2023-11-15T02:37:06.131945+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:37:06.131945+0000","last_undegraded":"2023-11-15T02:37:06.131945+0000","last_fullsized":"2023-11-15T02:37:06.131945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":141,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.131652+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:37:06.131652+0000","last_peered":"2023-11-15T02:37:06.131652+0000","last_clean":"2023-11-15T02:37:06.131652+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:37:06.131652+0000","last_undegraded":"2023-11-15T02:37:06.131652+0000","last_fullsized":"2023-11-15T02:37:06.131652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:11.107922+0000","last_change":"2023-11-15T02:37:11.107922+0000","last_active":"2023-11-15T02:37:11.107922+0000","last_peered":"2023-11-15T02:37:11.107922+0000","last_clean":"2023-11-15T02:37:11.107922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:11.107922+0000","last_undegraded":"2023-11-15T02:37:11.107922+0000","last_fullsized":"2023-11-15T02:37:11.107922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:37:10.102661+0000","last_change":"2023-11-15T02:37:10.102661+0000","last_active":"2023-11-15T02:37:10.102661+0000","last_peered":"2023-11-15T02:37:10.102661+0000","last_clean":"2023-11-15T02:37:10.102661+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:37:10.102661+0000","last_undegraded":"2023-11-15T02:37:10.102661+0000","last_fullsized":"2023-11-15T02:37:10.102661+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":159,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-11-15T02:37:06.046925+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:37:06.046925+0000","last_peered":"2023-11-15T02:37:06.046925+0000","last_clean":"2023-11-15T02:37:06.046925+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:37:06.046925+0000","last_undegraded":"2023-11-15T02:37:06.046925+0000","last_fullsized":"2023-11-15T02:37:06.046925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":756,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":26,"acting":26,"num_store_stats":2},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575749,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303300,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068540,"statfs":{"total":96636764160,"available":96326184960,"internally_reserved":0,"allocated":2158592,"data_stored":1142074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.375}]},{"osd":1,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":0.997,"15min":0.997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33500000000000002},"max":{"1min":0.74199999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":0.80200000000000005,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78000000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.77400000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.437},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79600000000000004,"5min":1.101,"15min":1.101},"last":0.53000000000000003}]},{"osd":4,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.33000000000000002,"15min":0.27300000000000002},"max":{"1min":0.68799999999999994,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.749,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.45800000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48899999999999999,"15min":0.5},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.70499999999999996,"5min":0.70599999999999996,"15min":0.78800000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.371,"15min":0.33100000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.82799999999999996},"last":0.47299999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.54900000000000004},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.31},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.86299999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.29999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.85699999999999998},"last":0.50700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575750,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307396,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064444,"statfs":{"total":96636764160,"available":96321990656,"internally_reserved":0,"allocated":2158592,"data_stored":1142074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68500000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.33700000000000002,"5min":0.317,"15min":0.308},"max":{"1min":0.755,"5min":0.78900000000000003,"15min":0.82899999999999996},"last":0.438}]},{"osd":1,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32100000000000001},"max":{"1min":0.70399999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.34300000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.45200000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.35299999999999998},"max":{"1min":0.746,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.61299999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78800000000000003,"15min":0.80700000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.38700000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60199999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.307,"5min":0.28599999999999998,"15min":0.26100000000000001},"max":{"1min":0.65800000000000003,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.39600000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.626}]},{"osd":5,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56000000000000005,"15min":0.54700000000000004},"min":{"1min":0.35399999999999998,"5min":0.314,"15min":0.30599999999999999},"max":{"1min":0.74399999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.70299999999999996}]},{"osd":7,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.502},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.28799999999999998},"max":{"1min":0.66800000000000004,"5min":0.81000000000000005,"15min":0.81699999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.41999999999999998,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.83499999999999996,"5min":0.876,"15min":0.876},"last":0.72699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575751,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307396,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064444,"statfs":{"total":96636764160,"available":96321990656,"internally_reserved":0,"allocated":2158592,"data_stored":1142074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.45600000000000002,"5min":0.66000000000000003,"15min":0.66800000000000004},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.52500000000000002,"5min":0.64200000000000002,"15min":0.65800000000000003},"last":0.249}]},{"osd":2,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.26900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.46300000000000002,"5min":0.59799999999999998,"15min":0.63100000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.44400000000000001,"15min":0.45500000000000002},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.27100000000000002},"max":{"1min":0.56599999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.26600000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.30599999999999999},"max":{"1min":0.61799999999999999,"5min":0.69799999999999995,"15min":0.74299999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.48499999999999999,"15min":0.49199999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55500000000000005,"5min":0.70899999999999996,"15min":0.77100000000000002},"last":0.33400000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":0.89800000000000002,"15min":1.097},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.96499999999999997,"15min":1.014},"last":0.66400000000000003}]},{"osd":5,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":0.89200000000000002,"15min":0.98699999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.95399999999999996,"15min":1.024},"last":0.60899999999999999}]},{"osd":6,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.47899999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.94399999999999995,"15min":0.96799999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88400000000000001,"5min":0.93200000000000005,"15min":1.143},"last":0.77300000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90500000000000003,"5min":0.95799999999999996,"15min":1.111},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":0.97999999999999998,"15min":1.0129999999999999},"last":0.60099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575750,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307460,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064380,"statfs":{"total":96636764160,"available":96321925120,"internally_reserved":0,"allocated":2224128,"data_stored":1171609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60299999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.42299999999999999},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.57999999999999996,"5min":0.63700000000000001,"15min":0.64200000000000002},"last":0.35999999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39400000000000002,"15min":0.39900000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53600000000000003,"5min":0.60099999999999998,"15min":0.83799999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.72499999999999998},"last":0.31}]},{"osd":3,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.44,"15min":0.44600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.28899999999999998},"max":{"1min":0.58599999999999997,"5min":0.64700000000000002,"15min":0.69799999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.71599999999999997},"last":0.435}]},{"osd":4,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66800000000000004,"15min":0.67600000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.39100000000000001},"max":{"1min":0.92100000000000004,"5min":0.96599999999999997,"15min":1.004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89100000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80500000000000005,"5min":0.88300000000000001,"15min":1.05},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65500000000000003,"15min":0.66500000000000004},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.44900000000000001},"max":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":1.004},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64700000000000002,"15min":0.66300000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.42699999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":1.026},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.68200000000000005},"min":{"1min":0.49199999999999999,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.0309999999999999},"last":0.51800000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69199999999999995,"15min":0.70799999999999996},"min":{"1min":0.53700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85399999999999998,"5min":0.93200000000000005,"15min":1.0600000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.72199999999999998},"min":{"1min":0.53600000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.997,"5min":0.997,"15min":1.0409999999999999},"last":0.749}]}]},{"osd":2,"up_from":13,"seq":55834575751,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311552,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060288,"statfs":{"total":96636764160,"available":96317734912,"internally_reserved":0,"allocated":2220032,"data_stored":1171023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.248,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56499999999999995,"5min":0.69699999999999995,"15min":0.83999999999999997},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.25900000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.63500000000000001,"5min":0.69199999999999995,"15min":0.85899999999999999},"last":0.28599999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39400000000000002,"15min":0.40600000000000003},"min":{"1min":0.28699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.52200000000000002,"5min":0.68999999999999995,"15min":0.91000000000000003},"last":0.316},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45600000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55700000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34300000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.33500000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64800000000000002,"5min":0.755,"15min":0.79800000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":0.65600000000000003,"5min":0.69499999999999995,"15min":1.113},"last":0.35699999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67100000000000004,"15min":0.65500000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.89000000000000001,"5min":1.0069999999999999,"15min":1.2170000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91100000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.74299999999999999}]},{"osd":5,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.41899999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.153},"last":0.755},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69299999999999995,"15min":0.68300000000000005},"min":{"1min":0.497,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.996},"last":0.68400000000000005}]},{"osd":6,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.442},"max":{"1min":0.85699999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.628},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.70599999999999996},"min":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.438},"max":{"1min":0.97299999999999998,"5min":1.079,"15min":1.079},"last":0.69299999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95099999999999996,"5min":1.0940000000000001,"15min":1.7270000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.72199999999999998},"min":{"1min":0.495,"5min":0.46800000000000003,"15min":0.45800000000000002},"max":{"1min":0.90900000000000003,"5min":1.038,"15min":1.038},"last":0.78200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575751,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311492,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060348,"statfs":{"total":96636764160,"available":96317796352,"internally_reserved":0,"allocated":2158592,"data_stored":1142074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.26400000000000001,"5min":0.24099999999999999,"15min":0.222},"max":{"1min":0.55900000000000005,"5min":0.56299999999999994,"15min":0.67700000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.40699999999999997,"15min":0.41799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.24199999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.67400000000000004},"last":0.46500000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.40200000000000002,"15min":0.41899999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56899999999999995,"5min":0.622,"15min":0.81399999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.25800000000000001},"max":{"1min":0.64900000000000002,"5min":0.746,"15min":0.75800000000000001},"last":0.39100000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.71499999999999997,"15min":0.76900000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.497,"15min":0.501},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.75600000000000001},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.432,"5min":0.41899999999999998,"15min":0.40500000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.306},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.49299999999999999}]},{"osd":5,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66500000000000004,"15min":0.68000000000000005},"min":{"1min":0.48099999999999998,"5min":0.42899999999999999,"15min":0.39100000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.46999999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.129},"last":0.5}]},{"osd":6,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.496,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.46100000000000002,"15min":0.438},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.439},"max":{"1min":1.159,"5min":1.159,"15min":1.256},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.61899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575749,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303300,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068540,"statfs":{"total":96636764160,"available":96326184960,"internally_reserved":0,"allocated":2158592,"data_stored":1142074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.32000000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.80800000000000005},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.67600000000000005,"5min":0.78000000000000003,"15min":1.1919999999999999},"last":0.38600000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.45400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.42999999999999999,"5min":0.39400000000000002,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.82199999999999995,"15min":1.2},"last":0.374}]},{"osd":2,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.59899999999999998},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.36599999999999999},"max":{"1min":0.74299999999999999,"5min":0.752,"15min":1.272},"last":0.441},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.434,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79800000000000004,"5min":0.81899999999999995,"15min":0.95999999999999996},"last":0.43099999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.40500000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.3109999999999999},"last":0.33500000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.53400000000000003,"15min":0.48599999999999999},"min":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.30299999999999999},"max":{"1min":4.8230000000000004,"5min":4.8230000000000004,"15min":4.8230000000000004},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.28299999999999997},"max":{"1min":0.71499999999999997,"5min":0.747,"15min":0.79000000000000004},"last":0.35199999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.56100000000000005,"15min":0.51800000000000002},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.32900000000000001},"max":{"1min":4.8689999999999998,"5min":4.8689999999999998,"15min":4.8689999999999998},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.38500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72099999999999997,"5min":0.78800000000000003,"15min":0.85399999999999998},"last":0.39400000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.58099999999999996,"15min":0.54400000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":4.4569999999999999,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.36799999999999999},"max":{"1min":0.75,"5min":0.79100000000000004,"15min":0.83299999999999996},"last":0.36599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575749,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307396,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064444,"statfs":{"total":96636764160,"available":96321990656,"internally_reserved":0,"allocated":2158592,"data_stored":1142074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67300000000000004,"5min":0.76900000000000002,"15min":1.1379999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79000000000000004,"5min":0.79500000000000004,"15min":1.0169999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68899999999999995,"5min":0.84299999999999997,"15min":1.0109999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.55900000000000005,"15min":0.56799999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":1.135},"last":0.39900000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":1.155},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76700000000000002,"5min":0.81999999999999995,"15min":1.0369999999999999},"last":0.48599999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.77800000000000002,"5min":0.79200000000000004,"15min":1.1779999999999999},"last":0.499},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69899999999999995,"5min":0.79900000000000004,"15min":1.171},"last":0.54200000000000004}]},{"osd":4,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45700000000000002,"15min":0.45900000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.72399999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.313},"max":{"1min":0.68799999999999994,"5min":0.77900000000000003,"15min":0.78600000000000003},"last":0.57899999999999996}]},{"osd":6,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.317,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.80900000000000005},"last":0.625},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.497,"15min":0.498},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64600000000000002,"5min":0.76500000000000001,"15min":0.81899999999999995},"last":0.53400000000000003}]},{"osd":7,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.499,"15min":0.495},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63900000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.36299999999999999},"max":{"1min":0.73999999999999999,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:37:15.918 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:37:16.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.069+0000 7fe35cb04700 1 Processor -- start 2023-11-15T02:37:16.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.069+0000 7fe35cb04700 1 -- start start 2023-11-15T02:37:16.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.070+0000 7fe35cb04700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe3580bd130 0x7fe3580c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.070+0000 7fe35cb04700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35806a6b0 con 0x7fe358154680 2023-11-15T02:37:16.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.070+0000 7fe35cb04700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3580c3360 con 0x7fe3580bccd0 2023-11-15T02:37:16.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.070+0000 7fe35cb04700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3580c2750 con 0x7fe3580bd130 2023-11-15T02:37:16.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.070+0000 7fe35659c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe358154680 0x7fe358069fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58712/0 (socket says 172.21.15.1:58712) 2023-11-15T02:37:16.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.070+0000 7fe35659c700 1 -- 172.21.15.1:0/432384991 learned_addr learned my addr 172.21.15.1:0/432384991 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:16.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe356d9d700 1 --2- 172.21.15.1:0/432384991 >> v2:172.21.15.141:3300/0 conn(0x7fe3580bd130 0x7fe3580c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35559a700 1 -- 172.21.15.1:0/432384991 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256423856 0 0) 0x7fe35806a6b0 con 0x7fe358154680 2023-11-15T02:37:16.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35559a700 1 -- 172.21.15.1:0/432384991 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3440033f0 con 0x7fe358154680 2023-11-15T02:37:16.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35559a700 1 -- 172.21.15.1:0/432384991 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1889597191 0 0) 0x7fe3440033f0 con 0x7fe358154680 2023-11-15T02:37:16.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35559a700 1 -- 172.21.15.1:0/432384991 >> v2:172.21.15.141:3300/0 conn(0x7fe3580bd130 msgr2=0x7fe3580c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:16.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35559a700 1 --2- 172.21.15.1:0/432384991 >> v2:172.21.15.141:3300/0 conn(0x7fe3580bd130 0x7fe3580c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35559a700 1 -- 172.21.15.1:0/432384991 >> v1:172.21.15.141:6789/0 conn(0x7fe3580bccd0 legacy=0x7fe3580c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35559a700 1 -- 172.21.15.1:0/432384991 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3580c2a30 con 0x7fe358154680 2023-11-15T02:37:16.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35559a700 1 -- 172.21.15.1:0/432384991 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fe3500017f0 con 0x7fe358154680 2023-11-15T02:37:16.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35559a700 1 -- 172.21.15.1:0/432384991 >> v1:172.21.15.1:6789/0 conn(0x7fe358154680 legacy=0x7fe358069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35559a700 1 --2- 172.21.15.1:0/432384991 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3440038e0 0x7fe344003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35559a700 1 --2- 172.21.15.1:0/432384991 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe344004690 0x7fe344004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35559a700 1 --2- 172.21.15.1:0/432384991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe344005000 0x7fe34400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35559a700 1 -- 172.21.15.1:0/432384991 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580c2750 con 0x7fe344005000 2023-11-15T02:37:16.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35559a700 1 -- 172.21.15.1:0/432384991 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34400be00 con 0x7fe3440038e0 2023-11-15T02:37:16.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35559a700 1 -- 172.21.15.1:0/432384991 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34400bfc0 con 0x7fe344004690 2023-11-15T02:37:16.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe356d9d700 1 --2- 172.21.15.1:0/432384991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe344005000 0x7fe34400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe35659c700 1 --2- 172.21.15.1:0/432384991 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3440038e0 0x7fe344003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.071+0000 7fe355d9b700 1 --2- 172.21.15.1:0/432384991 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe344004690 0x7fe344004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.072+0000 7fe356d9d700 1 -- 172.21.15.1:0/432384991 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe344004690 msgr2=0x7fe344004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:16.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.072+0000 7fe356d9d700 1 --2- 172.21.15.1:0/432384991 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe344004690 0x7fe344004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.072+0000 7fe356d9d700 1 -- 172.21.15.1:0/432384991 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3440038e0 msgr2=0x7fe344003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:16.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.072+0000 7fe356d9d700 1 --2- 172.21.15.1:0/432384991 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3440038e0 0x7fe344003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.072+0000 7fe356d9d700 1 -- 172.21.15.1:0/432384991 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3440033f0 con 0x7fe344005000 2023-11-15T02:37:16.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.072+0000 7fe356d9d700 1 -- 172.21.15.1:0/432384991 reap_dead start 2023-11-15T02:37:16.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.072+0000 7fe356d9d700 1 --2- 172.21.15.1:0/432384991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe344005000 0x7fe34400b8e0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fe348009a60 tx=0x7fe348009060).ready entity=mon.0 client_cookie=93c7782a4a28deea server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:16.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.072+0000 7fe35559a700 1 -- 172.21.15.1:0/432384991 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348009ea0 con 0x7fe344005000 2023-11-15T02:37:16.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.072+0000 7fe35559a700 1 -- 172.21.15.1:0/432384991 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe348009430 con 0x7fe344005000 2023-11-15T02:37:16.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.072+0000 7fe35559a700 1 -- 172.21.15.1:0/432384991 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34800e890 con 0x7fe344005000 2023-11-15T02:37:16.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.072+0000 7fe35cb04700 1 -- 172.21.15.1:0/432384991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe344005000 msgr2=0x7fe34400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.072+0000 7fe35cb04700 1 --2- 172.21.15.1:0/432384991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe344005000 0x7fe34400b8e0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fe348009a60 tx=0x7fe348009060).stop 2023-11-15T02:37:16.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.073+0000 7fe35cb04700 1 -- 172.21.15.1:0/432384991 shutdown_connections 2023-11-15T02:37:16.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.073+0000 7fe35cb04700 1 --2- 172.21.15.1:0/432384991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe344005000 0x7fe34400b8e0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.073+0000 7fe35cb04700 1 -- 172.21.15.1:0/432384991 >> 172.21.15.1:0/432384991 conn(0x7fe3580c7d70 msgr2=0x7fe3580c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:16.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.073+0000 7fe35cb04700 1 -- 172.21.15.1:0/432384991 shutdown_connections 2023-11-15T02:37:16.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.073+0000 7fe35cb04700 1 -- 172.21.15.1:0/432384991 wait complete. 2023-11-15T02:37:16.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.074+0000 7fe35cb04700 1 Processor -- start 2023-11-15T02:37:16.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.074+0000 7fe35cb04700 1 -- start start 2023-11-15T02:37:16.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.074+0000 7fe35cb04700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe344005000 0x7fe358145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.074+0000 7fe35cb04700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe358155a30 0x7fe358155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.074+0000 7fe35cb04700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3580a88e0 0x7fe3580a8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe35cb04700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580abcb0 con 0x7fe358155a30 2023-11-15T02:37:16.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe35cb04700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580ac630 con 0x7fe3580a88e0 2023-11-15T02:37:16.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe35cb04700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580ad1b0 con 0x7fe344005000 2023-11-15T02:37:16.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe355d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe358155a30 0x7fe358155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe355d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe358155a30 0x7fe358155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38038/0 (socket says 172.21.15.1:38038) 2023-11-15T02:37:16.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe355d9b700 1 -- 172.21.15.1:0/3610448774 learned_addr learned my addr 172.21.15.1:0/3610448774 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:16.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe35659c700 1 --2- 172.21.15.1:0/3610448774 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe344005000 0x7fe358145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe356d9d700 1 --2- 172.21.15.1:0/3610448774 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3580a88e0 0x7fe3580a8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe355d9b700 1 -- 172.21.15.1:0/3610448774 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe344005000 msgr2=0x7fe358145b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe355d9b700 1 --2- 172.21.15.1:0/3610448774 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe344005000 0x7fe358145b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe355d9b700 1 -- 172.21.15.1:0/3610448774 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3580a88e0 msgr2=0x7fe3580a8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe355d9b700 1 --2- 172.21.15.1:0/3610448774 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3580a88e0 0x7fe3580a8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe355d9b700 1 -- 172.21.15.1:0/3610448774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3581563a0 con 0x7fe358155a30 2023-11-15T02:37:16.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe356d9d700 1 --2- 172.21.15.1:0/3610448774 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3580a88e0 0x7fe3580a8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:16.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe355d9b700 1 --2- 172.21.15.1:0/3610448774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe358155a30 0x7fe358155eb0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fe340002a30 tx=0x7fe340007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:16.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe34e7fc700 1 -- 172.21.15.1:0/3610448774 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340003d70 con 0x7fe358155a30 2023-11-15T02:37:16.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe34e7fc700 1 -- 172.21.15.1:0/3610448774 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34000f960 con 0x7fe358155a30 2023-11-15T02:37:16.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe35cb04700 1 -- 172.21.15.1:0/3610448774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3580ac880 con 0x7fe358155a30 2023-11-15T02:37:16.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe34e7fc700 1 -- 172.21.15.1:0/3610448774 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34000fce0 con 0x7fe358155a30 2023-11-15T02:37:16.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.075+0000 7fe35cb04700 1 -- 172.21.15.1:0/3610448774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3580ace40 con 0x7fe358155a30 2023-11-15T02:37:16.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.076+0000 7fe35cb04700 1 -- 172.21.15.1:0/3610448774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3580c4500 con 0x7fe358155a30 2023-11-15T02:37:16.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.077+0000 7fe34e7fc700 1 -- 172.21.15.1:0/3610448774 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe340014660 con 0x7fe358155a30 2023-11-15T02:37:16.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.077+0000 7fe34e7fc700 1 --2- 172.21.15.1:0/3610448774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe33805f2a0 0x7fe338061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.077+0000 7fe34e7fc700 1 -- 172.21.15.1:0/3610448774 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fe34007a3a0 con 0x7fe358155a30 2023-11-15T02:37:16.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.077+0000 7fe35659c700 1 --2- 172.21.15.1:0/3610448774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe33805f2a0 0x7fe338061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.078+0000 7fe35659c700 1 --2- 172.21.15.1:0/3610448774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe33805f2a0 0x7fe338061760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe350001920 tx=0x7fe350009040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:16.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.081+0000 7fe34e7fc700 1 -- 172.21.15.1:0/3610448774 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe34004aaf0 con 0x7fe358155a30 2023-11-15T02:37:16.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.249+0000 7fe35cb04700 1 -- 172.21.15.1:0/3610448774 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe35806c7e0 con 0x7fe33805f2a0 2023-11-15T02:37:16.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.259+0000 7fe34e7fc700 1 -- 172.21.15.1:0/3610448774 <== mgr.8110 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362000 (secure 0 0 0) 0x7fe35806c7e0 con 0x7fe33805f2a0 2023-11-15T02:37:16.266 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:37:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.263+0000 7fe35cb04700 1 -- 172.21.15.1:0/3610448774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe33805f2a0 msgr2=0x7fe338061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.263+0000 7fe35cb04700 1 --2- 172.21.15.1:0/3610448774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe33805f2a0 0x7fe338061760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe350001920 tx=0x7fe350009040).stop 2023-11-15T02:37:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.263+0000 7fe35cb04700 1 -- 172.21.15.1:0/3610448774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe358155a30 msgr2=0x7fe358155eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.263+0000 7fe35cb04700 1 --2- 172.21.15.1:0/3610448774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe358155a30 0x7fe358155eb0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fe340002a30 tx=0x7fe340007b90).stop 2023-11-15T02:37:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.263+0000 7fe35cb04700 1 -- 172.21.15.1:0/3610448774 shutdown_connections 2023-11-15T02:37:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.263+0000 7fe35cb04700 1 --2- 172.21.15.1:0/3610448774 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fe33805f2a0 0x7fe338061760 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.263+0000 7fe35cb04700 1 --2- 172.21.15.1:0/3610448774 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3580a88e0 0x7fe3580a8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.263+0000 7fe35cb04700 1 --2- 172.21.15.1:0/3610448774 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe344005000 0x7fe358145b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.263+0000 7fe35cb04700 1 --2- 172.21.15.1:0/3610448774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe358155a30 0x7fe358155eb0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.263+0000 7fe35cb04700 1 -- 172.21.15.1:0/3610448774 >> 172.21.15.1:0/3610448774 conn(0x7fe3580c7d70 msgr2=0x7fe358065690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:16.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.263+0000 7fe35cb04700 1 -- 172.21.15.1:0/3610448774 shutdown_connections 2023-11-15T02:37:16.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.263+0000 7fe35cb04700 1 -- 172.21.15.1:0/3610448774 wait complete. 2023-11-15T02:37:16.273 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:37:16.277 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T02:37:16.077199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2459616,"kb_used_data":17312,"kb_used_omap":0,"kb_used_meta":2442240,"kb_avail":752515104,"statfs":{"total":773094113280,"available":770575466496,"internally_reserved":0,"allocated":17727488,"data_stored":9371340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2500853760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12017,"num_objects":-11,"num_object_clones":0,"num_object_copies":-22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-37,"num_write_kb":-28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.002148"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.525965+0000","last_change":"2023-11-15T02:37:11.523042+0000","last_active":"2023-11-15T02:37:11.525965+0000","last_peered":"2023-11-15T02:37:11.525965+0000","last_clean":"2023-11-15T02:37:11.525965+0000","last_became_active":"2023-11-15T02:37:11.522722+0000","last_became_peered":"2023-11-15T02:37:11.522722+0000","last_unstale":"2023-11-15T02:37:11.525965+0000","last_undegraded":"2023-11-15T02:37:11.525965+0000","last_fullsized":"2023-11-15T02:37:11.525965+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"176'3","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534737+0000","last_change":"2023-11-15T02:37:11.142538+0000","last_active":"2023-11-15T02:37:11.534737+0000","last_peered":"2023-11-15T02:37:11.534737+0000","last_clean":"2023-11-15T02:37:11.534737+0000","last_became_active":"2023-11-15T02:37:11.142134+0000","last_became_peered":"2023-11-15T02:37:11.142134+0000","last_unstale":"2023-11-15T02:37:11.534737+0000","last_undegraded":"2023-11-15T02:37:11.534737+0000","last_fullsized":"2023-11-15T02:37:11.534737+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536585+0000","last_change":"2023-11-15T02:37:11.534444+0000","last_active":"2023-11-15T02:37:11.536585+0000","last_peered":"2023-11-15T02:37:11.536585+0000","last_clean":"2023-11-15T02:37:11.536585+0000","last_became_active":"2023-11-15T02:37:11.534171+0000","last_became_peered":"2023-11-15T02:37:11.534171+0000","last_unstale":"2023-11-15T02:37:11.536585+0000","last_undegraded":"2023-11-15T02:37:11.536585+0000","last_fullsized":"2023-11-15T02:37:11.536585+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.519894+0000","last_change":"2023-11-15T02:37:11.130593+0000","last_active":"2023-11-15T02:37:11.519894+0000","last_peered":"2023-11-15T02:37:11.519894+0000","last_clean":"2023-11-15T02:37:11.519894+0000","last_became_active":"2023-11-15T02:37:11.130310+0000","last_became_peered":"2023-11-15T02:37:11.130310+0000","last_unstale":"2023-11-15T02:37:11.519894+0000","last_undegraded":"2023-11-15T02:37:11.519894+0000","last_fullsized":"2023-11-15T02:37:11.519894+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.530599+0000","last_change":"2023-11-15T02:37:11.527684+0000","last_active":"2023-11-15T02:37:11.530599+0000","last_peered":"2023-11-15T02:37:11.530599+0000","last_clean":"2023-11-15T02:37:11.530599+0000","last_became_active":"2023-11-15T02:37:11.527423+0000","last_became_peered":"2023-11-15T02:37:11.527423+0000","last_unstale":"2023-11-15T02:37:11.530599+0000","last_undegraded":"2023-11-15T02:37:11.530599+0000","last_fullsized":"2023-11-15T02:37:11.530599+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.511815+0000","last_change":"2023-11-15T02:37:11.134804+0000","last_active":"2023-11-15T02:37:11.511815+0000","last_peered":"2023-11-15T02:37:11.511815+0000","last_clean":"2023-11-15T02:37:11.511815+0000","last_became_active":"2023-11-15T02:37:11.134447+0000","last_became_peered":"2023-11-15T02:37:11.134447+0000","last_unstale":"2023-11-15T02:37:11.511815+0000","last_undegraded":"2023-11-15T02:37:11.511815+0000","last_fullsized":"2023-11-15T02:37:11.511815+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528360+0000","last_change":"2023-11-15T02:37:11.522004+0000","last_active":"2023-11-15T02:37:11.528360+0000","last_peered":"2023-11-15T02:37:11.528360+0000","last_clean":"2023-11-15T02:37:11.528360+0000","last_became_active":"2023-11-15T02:37:11.521683+0000","last_became_peered":"2023-11-15T02:37:11.521683+0000","last_unstale":"2023-11-15T02:37:11.528360+0000","last_undegraded":"2023-11-15T02:37:11.528360+0000","last_fullsized":"2023-11-15T02:37:11.528360+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526446+0000","last_change":"2023-11-15T02:37:11.134204+0000","last_active":"2023-11-15T02:37:11.526446+0000","last_peered":"2023-11-15T02:37:11.526446+0000","last_clean":"2023-11-15T02:37:11.526446+0000","last_became_active":"2023-11-15T02:37:11.133597+0000","last_became_peered":"2023-11-15T02:37:11.133597+0000","last_unstale":"2023-11-15T02:37:11.526446+0000","last_undegraded":"2023-11-15T02:37:11.526446+0000","last_fullsized":"2023-11-15T02:37:11.526446+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.529851+0000","last_change":"2023-11-15T02:37:11.527099+0000","last_active":"2023-11-15T02:37:11.529851+0000","last_peered":"2023-11-15T02:37:11.529851+0000","last_clean":"2023-11-15T02:37:11.529851+0000","last_became_active":"2023-11-15T02:37:11.526802+0000","last_became_peered":"2023-11-15T02:37:11.526802+0000","last_unstale":"2023-11-15T02:37:11.529851+0000","last_undegraded":"2023-11-15T02:37:11.529851+0000","last_fullsized":"2023-11-15T02:37:11.529851+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535140+0000","last_change":"2023-11-15T02:37:11.136474+0000","last_active":"2023-11-15T02:37:11.535140+0000","last_peered":"2023-11-15T02:37:11.535140+0000","last_clean":"2023-11-15T02:37:11.535140+0000","last_became_active":"2023-11-15T02:37:11.135966+0000","last_became_peered":"2023-11-15T02:37:11.135966+0000","last_unstale":"2023-11-15T02:37:11.535140+0000","last_undegraded":"2023-11-15T02:37:11.535140+0000","last_fullsized":"2023-11-15T02:37:11.535140+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535001+0000","last_change":"2023-11-15T02:37:11.533006+0000","last_active":"2023-11-15T02:37:11.535001+0000","last_peered":"2023-11-15T02:37:11.535001+0000","last_clean":"2023-11-15T02:37:11.535001+0000","last_became_active":"2023-11-15T02:37:11.531957+0000","last_became_peered":"2023-11-15T02:37:11.531957+0000","last_unstale":"2023-11-15T02:37:11.535001+0000","last_undegraded":"2023-11-15T02:37:11.535001+0000","last_fullsized":"2023-11-15T02:37:11.535001+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.527349+0000","last_change":"2023-11-15T02:37:11.134579+0000","last_active":"2023-11-15T02:37:11.527349+0000","last_peered":"2023-11-15T02:37:11.527349+0000","last_clean":"2023-11-15T02:37:11.527349+0000","last_became_active":"2023-11-15T02:37:11.134246+0000","last_became_peered":"2023-11-15T02:37:11.134246+0000","last_unstale":"2023-11-15T02:37:11.527349+0000","last_undegraded":"2023-11-15T02:37:11.527349+0000","last_fullsized":"2023-11-15T02:37:11.527349+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.532195+0000","last_change":"2023-11-15T02:37:11.522330+0000","last_active":"2023-11-15T02:37:11.532195+0000","last_peered":"2023-11-15T02:37:11.532195+0000","last_clean":"2023-11-15T02:37:11.532195+0000","last_became_active":"2023-11-15T02:37:11.522087+0000","last_became_peered":"2023-11-15T02:37:11.522087+0000","last_unstale":"2023-11-15T02:37:11.532195+0000","last_undegraded":"2023-11-15T02:37:11.532195+0000","last_fullsized":"2023-11-15T02:37:11.532195+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512060+0000","last_change":"2023-11-15T02:37:11.129365+0000","last_active":"2023-11-15T02:37:11.512060+0000","last_peered":"2023-11-15T02:37:11.512060+0000","last_clean":"2023-11-15T02:37:11.512060+0000","last_became_active":"2023-11-15T02:37:11.128680+0000","last_became_peered":"2023-11-15T02:37:11.128680+0000","last_unstale":"2023-11-15T02:37:11.512060+0000","last_undegraded":"2023-11-15T02:37:11.512060+0000","last_fullsized":"2023-11-15T02:37:11.512060+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534138+0000","last_change":"2023-11-15T02:37:11.532558+0000","last_active":"2023-11-15T02:37:11.534138+0000","last_peered":"2023-11-15T02:37:11.534138+0000","last_clean":"2023-11-15T02:37:11.534138+0000","last_became_active":"2023-11-15T02:37:11.532227+0000","last_became_peered":"2023-11-15T02:37:11.532227+0000","last_unstale":"2023-11-15T02:37:11.534138+0000","last_undegraded":"2023-11-15T02:37:11.534138+0000","last_fullsized":"2023-11-15T02:37:11.534138+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.511676+0000","last_change":"2023-11-15T02:37:11.138579+0000","last_active":"2023-11-15T02:37:11.511676+0000","last_peered":"2023-11-15T02:37:11.511676+0000","last_clean":"2023-11-15T02:37:11.511676+0000","last_became_active":"2023-11-15T02:37:11.138283+0000","last_became_peered":"2023-11-15T02:37:11.138283+0000","last_unstale":"2023-11-15T02:37:11.511676+0000","last_undegraded":"2023-11-15T02:37:11.511676+0000","last_fullsized":"2023-11-15T02:37:11.511676+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526806+0000","last_change":"2023-11-15T02:37:11.523782+0000","last_active":"2023-11-15T02:37:11.526806+0000","last_peered":"2023-11-15T02:37:11.526806+0000","last_clean":"2023-11-15T02:37:11.526806+0000","last_became_active":"2023-11-15T02:37:11.523313+0000","last_became_peered":"2023-11-15T02:37:11.523313+0000","last_unstale":"2023-11-15T02:37:11.526806+0000","last_undegraded":"2023-11-15T02:37:11.526806+0000","last_fullsized":"2023-11-15T02:37:11.526806+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.520621+0000","last_change":"2023-11-15T02:37:11.136706+0000","last_active":"2023-11-15T02:37:11.520621+0000","last_peered":"2023-11-15T02:37:11.520621+0000","last_clean":"2023-11-15T02:37:11.520621+0000","last_became_active":"2023-11-15T02:37:11.136365+0000","last_became_peered":"2023-11-15T02:37:11.136365+0000","last_unstale":"2023-11-15T02:37:11.520621+0000","last_undegraded":"2023-11-15T02:37:11.520621+0000","last_fullsized":"2023-11-15T02:37:11.520621+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536120+0000","last_change":"2023-11-15T02:37:11.534908+0000","last_active":"2023-11-15T02:37:11.536120+0000","last_peered":"2023-11-15T02:37:11.536120+0000","last_clean":"2023-11-15T02:37:11.536120+0000","last_became_active":"2023-11-15T02:37:11.534296+0000","last_became_peered":"2023-11-15T02:37:11.534296+0000","last_unstale":"2023-11-15T02:37:11.536120+0000","last_undegraded":"2023-11-15T02:37:11.536120+0000","last_fullsized":"2023-11-15T02:37:11.536120+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.517981+0000","last_change":"2023-11-15T02:37:11.142063+0000","last_active":"2023-11-15T02:37:11.517981+0000","last_peered":"2023-11-15T02:37:11.517981+0000","last_clean":"2023-11-15T02:37:11.517981+0000","last_became_active":"2023-11-15T02:37:11.141752+0000","last_became_peered":"2023-11-15T02:37:11.141752+0000","last_unstale":"2023-11-15T02:37:11.517981+0000","last_undegraded":"2023-11-15T02:37:11.517981+0000","last_fullsized":"2023-11-15T02:37:11.517981+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.532742+0000","last_change":"2023-11-15T02:37:11.525977+0000","last_active":"2023-11-15T02:37:11.532742+0000","last_peered":"2023-11-15T02:37:11.532742+0000","last_clean":"2023-11-15T02:37:11.532742+0000","last_became_active":"2023-11-15T02:37:11.525610+0000","last_became_peered":"2023-11-15T02:37:11.525610+0000","last_unstale":"2023-11-15T02:37:11.532742+0000","last_undegraded":"2023-11-15T02:37:11.532742+0000","last_fullsized":"2023-11-15T02:37:11.532742+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514259+0000","last_change":"2023-11-15T02:37:11.138297+0000","last_active":"2023-11-15T02:37:11.514259+0000","last_peered":"2023-11-15T02:37:11.514259+0000","last_clean":"2023-11-15T02:37:11.514259+0000","last_became_active":"2023-11-15T02:37:11.137977+0000","last_became_peered":"2023-11-15T02:37:11.137977+0000","last_unstale":"2023-11-15T02:37:11.514259+0000","last_undegraded":"2023-11-15T02:37:11.514259+0000","last_fullsized":"2023-11-15T02:37:11.514259+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534096+0000","last_change":"2023-11-15T02:37:11.532839+0000","last_active":"2023-11-15T02:37:11.534096+0000","last_peered":"2023-11-15T02:37:11.534096+0000","last_clean":"2023-11-15T02:37:11.534096+0000","last_became_active":"2023-11-15T02:37:11.532575+0000","last_became_peered":"2023-11-15T02:37:11.532575+0000","last_unstale":"2023-11-15T02:37:11.534096+0000","last_undegraded":"2023-11-15T02:37:11.534096+0000","last_fullsized":"2023-11-15T02:37:11.534096+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.539052+0000","last_change":"2023-11-15T02:37:11.142218+0000","last_active":"2023-11-15T02:37:11.539052+0000","last_peered":"2023-11-15T02:37:11.539052+0000","last_clean":"2023-11-15T02:37:11.539052+0000","last_became_active":"2023-11-15T02:37:11.141926+0000","last_became_peered":"2023-11-15T02:37:11.141926+0000","last_unstale":"2023-11-15T02:37:11.539052+0000","last_undegraded":"2023-11-15T02:37:11.539052+0000","last_fullsized":"2023-11-15T02:37:11.539052+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533648+0000","last_change":"2023-11-15T02:37:11.528785+0000","last_active":"2023-11-15T02:37:11.533648+0000","last_peered":"2023-11-15T02:37:11.533648+0000","last_clean":"2023-11-15T02:37:11.533648+0000","last_became_active":"2023-11-15T02:37:11.528476+0000","last_became_peered":"2023-11-15T02:37:11.528476+0000","last_unstale":"2023-11-15T02:37:11.533648+0000","last_undegraded":"2023-11-15T02:37:11.533648+0000","last_fullsized":"2023-11-15T02:37:11.533648+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535039+0000","last_change":"2023-11-15T02:37:11.136220+0000","last_active":"2023-11-15T02:37:11.535039+0000","last_peered":"2023-11-15T02:37:11.535039+0000","last_clean":"2023-11-15T02:37:11.535039+0000","last_became_active":"2023-11-15T02:37:11.135610+0000","last_became_peered":"2023-11-15T02:37:11.135610+0000","last_unstale":"2023-11-15T02:37:11.535039+0000","last_undegraded":"2023-11-15T02:37:11.535039+0000","last_fullsized":"2023-11-15T02:37:11.535039+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.530918+0000","last_change":"2023-11-15T02:37:11.527794+0000","last_active":"2023-11-15T02:37:11.530918+0000","last_peered":"2023-11-15T02:37:11.530918+0000","last_clean":"2023-11-15T02:37:11.530918+0000","last_became_active":"2023-11-15T02:37:11.527527+0000","last_became_peered":"2023-11-15T02:37:11.527527+0000","last_unstale":"2023-11-15T02:37:11.530918+0000","last_undegraded":"2023-11-15T02:37:11.530918+0000","last_fullsized":"2023-11-15T02:37:11.530918+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513230+0000","last_change":"2023-11-15T02:37:11.135916+0000","last_active":"2023-11-15T02:37:11.513230+0000","last_peered":"2023-11-15T02:37:11.513230+0000","last_clean":"2023-11-15T02:37:11.513230+0000","last_became_active":"2023-11-15T02:37:11.135590+0000","last_became_peered":"2023-11-15T02:37:11.135590+0000","last_unstale":"2023-11-15T02:37:11.513230+0000","last_undegraded":"2023-11-15T02:37:11.513230+0000","last_fullsized":"2023-11-15T02:37:11.513230+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534550+0000","last_change":"2023-11-15T02:37:11.532197+0000","last_active":"2023-11-15T02:37:11.534550+0000","last_peered":"2023-11-15T02:37:11.534550+0000","last_clean":"2023-11-15T02:37:11.534550+0000","last_became_active":"2023-11-15T02:37:11.531860+0000","last_became_peered":"2023-11-15T02:37:11.531860+0000","last_unstale":"2023-11-15T02:37:11.534550+0000","last_undegraded":"2023-11-15T02:37:11.534550+0000","last_fullsized":"2023-11-15T02:37:11.534550+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.521034+0000","last_change":"2023-11-15T02:37:11.142090+0000","last_active":"2023-11-15T02:37:11.521034+0000","last_peered":"2023-11-15T02:37:11.521034+0000","last_clean":"2023-11-15T02:37:11.521034+0000","last_became_active":"2023-11-15T02:37:11.141803+0000","last_became_peered":"2023-11-15T02:37:11.141803+0000","last_unstale":"2023-11-15T02:37:11.521034+0000","last_undegraded":"2023-11-15T02:37:11.521034+0000","last_fullsized":"2023-11-15T02:37:11.521034+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534210+0000","last_change":"2023-11-15T02:37:11.532532+0000","last_active":"2023-11-15T02:37:11.534210+0000","last_peered":"2023-11-15T02:37:11.534210+0000","last_clean":"2023-11-15T02:37:11.534210+0000","last_became_active":"2023-11-15T02:37:11.532199+0000","last_became_peered":"2023-11-15T02:37:11.532199+0000","last_unstale":"2023-11-15T02:37:11.534210+0000","last_undegraded":"2023-11-15T02:37:11.534210+0000","last_fullsized":"2023-11-15T02:37:11.534210+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528961+0000","last_change":"2023-11-15T02:37:11.136371+0000","last_active":"2023-11-15T02:37:11.528961+0000","last_peered":"2023-11-15T02:37:11.528961+0000","last_clean":"2023-11-15T02:37:11.528961+0000","last_became_active":"2023-11-15T02:37:11.136083+0000","last_became_peered":"2023-11-15T02:37:11.136083+0000","last_unstale":"2023-11-15T02:37:11.528961+0000","last_undegraded":"2023-11-15T02:37:11.528961+0000","last_fullsized":"2023-11-15T02:37:11.528961+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534844+0000","last_change":"2023-11-15T02:37:11.526164+0000","last_active":"2023-11-15T02:37:11.534844+0000","last_peered":"2023-11-15T02:37:11.534844+0000","last_clean":"2023-11-15T02:37:11.534844+0000","last_became_active":"2023-11-15T02:37:11.525902+0000","last_became_peered":"2023-11-15T02:37:11.525902+0000","last_unstale":"2023-11-15T02:37:11.534844+0000","last_undegraded":"2023-11-15T02:37:11.534844+0000","last_fullsized":"2023-11-15T02:37:11.534844+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.517994+0000","last_change":"2023-11-15T02:37:11.144956+0000","last_active":"2023-11-15T02:37:11.517994+0000","last_peered":"2023-11-15T02:37:11.517994+0000","last_clean":"2023-11-15T02:37:11.517994+0000","last_became_active":"2023-11-15T02:37:11.143804+0000","last_became_peered":"2023-11-15T02:37:11.143804+0000","last_unstale":"2023-11-15T02:37:11.517994+0000","last_undegraded":"2023-11-15T02:37:11.517994+0000","last_fullsized":"2023-11-15T02:37:11.517994+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535716+0000","last_change":"2023-11-15T02:37:11.533485+0000","last_active":"2023-11-15T02:37:11.535716+0000","last_peered":"2023-11-15T02:37:11.535716+0000","last_clean":"2023-11-15T02:37:11.535716+0000","last_became_active":"2023-11-15T02:37:11.533046+0000","last_became_peered":"2023-11-15T02:37:11.533046+0000","last_unstale":"2023-11-15T02:37:11.535716+0000","last_undegraded":"2023-11-15T02:37:11.535716+0000","last_fullsized":"2023-11-15T02:37:11.535716+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510921+0000","last_change":"2023-11-15T02:37:11.138410+0000","last_active":"2023-11-15T02:37:11.510921+0000","last_peered":"2023-11-15T02:37:11.510921+0000","last_clean":"2023-11-15T02:37:11.510921+0000","last_became_active":"2023-11-15T02:37:11.138131+0000","last_became_peered":"2023-11-15T02:37:11.138131+0000","last_unstale":"2023-11-15T02:37:11.510921+0000","last_undegraded":"2023-11-15T02:37:11.510921+0000","last_fullsized":"2023-11-15T02:37:11.510921+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524936+0000","last_change":"2023-11-15T02:37:11.521807+0000","last_active":"2023-11-15T02:37:11.524936+0000","last_peered":"2023-11-15T02:37:11.524936+0000","last_clean":"2023-11-15T02:37:11.524936+0000","last_became_active":"2023-11-15T02:37:11.521312+0000","last_became_peered":"2023-11-15T02:37:11.521312+0000","last_unstale":"2023-11-15T02:37:11.524936+0000","last_undegraded":"2023-11-15T02:37:11.524936+0000","last_fullsized":"2023-11-15T02:37:11.524936+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526411+0000","last_change":"2023-11-15T02:37:11.137674+0000","last_active":"2023-11-15T02:37:11.526411+0000","last_peered":"2023-11-15T02:37:11.526411+0000","last_clean":"2023-11-15T02:37:11.526411+0000","last_became_active":"2023-11-15T02:37:11.136376+0000","last_became_peered":"2023-11-15T02:37:11.136376+0000","last_unstale":"2023-11-15T02:37:11.526411+0000","last_undegraded":"2023-11-15T02:37:11.526411+0000","last_fullsized":"2023-11-15T02:37:11.526411+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.525888+0000","last_change":"2023-11-15T02:37:11.520614+0000","last_active":"2023-11-15T02:37:11.525888+0000","last_peered":"2023-11-15T02:37:11.525888+0000","last_clean":"2023-11-15T02:37:11.525888+0000","last_became_active":"2023-11-15T02:37:11.520282+0000","last_became_peered":"2023-11-15T02:37:11.520282+0000","last_unstale":"2023-11-15T02:37:11.525888+0000","last_undegraded":"2023-11-15T02:37:11.525888+0000","last_fullsized":"2023-11-15T02:37:11.525888+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510123+0000","last_change":"2023-11-15T02:37:11.136684+0000","last_active":"2023-11-15T02:37:11.510123+0000","last_peered":"2023-11-15T02:37:11.510123+0000","last_clean":"2023-11-15T02:37:11.510123+0000","last_became_active":"2023-11-15T02:37:11.135923+0000","last_became_peered":"2023-11-15T02:37:11.135923+0000","last_unstale":"2023-11-15T02:37:11.510123+0000","last_undegraded":"2023-11-15T02:37:11.510123+0000","last_fullsized":"2023-11-15T02:37:11.510123+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533629+0000","last_change":"2023-11-15T02:37:11.533016+0000","last_active":"2023-11-15T02:37:11.533629+0000","last_peered":"2023-11-15T02:37:11.533629+0000","last_clean":"2023-11-15T02:37:11.533629+0000","last_became_active":"2023-11-15T02:37:11.532722+0000","last_became_peered":"2023-11-15T02:37:11.532722+0000","last_unstale":"2023-11-15T02:37:11.533629+0000","last_undegraded":"2023-11-15T02:37:11.533629+0000","last_fullsized":"2023-11-15T02:37:11.533629+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.531510+0000","last_change":"2023-11-15T02:37:11.144826+0000","last_active":"2023-11-15T02:37:11.531510+0000","last_peered":"2023-11-15T02:37:11.531510+0000","last_clean":"2023-11-15T02:37:11.531510+0000","last_became_active":"2023-11-15T02:37:11.144233+0000","last_became_peered":"2023-11-15T02:37:11.144233+0000","last_unstale":"2023-11-15T02:37:11.531510+0000","last_undegraded":"2023-11-15T02:37:11.531510+0000","last_fullsized":"2023-11-15T02:37:11.531510+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524044+0000","last_change":"2023-11-15T02:37:11.521563+0000","last_active":"2023-11-15T02:37:11.524044+0000","last_peered":"2023-11-15T02:37:11.524044+0000","last_clean":"2023-11-15T02:37:11.524044+0000","last_became_active":"2023-11-15T02:37:11.521253+0000","last_became_peered":"2023-11-15T02:37:11.521253+0000","last_unstale":"2023-11-15T02:37:11.524044+0000","last_undegraded":"2023-11-15T02:37:11.524044+0000","last_fullsized":"2023-11-15T02:37:11.524044+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513350+0000","last_change":"2023-11-15T02:37:11.138606+0000","last_active":"2023-11-15T02:37:11.513350+0000","last_peered":"2023-11-15T02:37:11.513350+0000","last_clean":"2023-11-15T02:37:11.513350+0000","last_became_active":"2023-11-15T02:37:11.138304+0000","last_became_peered":"2023-11-15T02:37:11.138304+0000","last_unstale":"2023-11-15T02:37:11.513350+0000","last_undegraded":"2023-11-15T02:37:11.513350+0000","last_fullsized":"2023-11-15T02:37:11.513350+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533878+0000","last_change":"2023-11-15T02:37:11.532201+0000","last_active":"2023-11-15T02:37:11.533878+0000","last_peered":"2023-11-15T02:37:11.533878+0000","last_clean":"2023-11-15T02:37:11.533878+0000","last_became_active":"2023-11-15T02:37:11.531882+0000","last_became_peered":"2023-11-15T02:37:11.531882+0000","last_unstale":"2023-11-15T02:37:11.533878+0000","last_undegraded":"2023-11-15T02:37:11.533878+0000","last_fullsized":"2023-11-15T02:37:11.533878+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513376+0000","last_change":"2023-11-15T02:37:11.131935+0000","last_active":"2023-11-15T02:37:11.513376+0000","last_peered":"2023-11-15T02:37:11.513376+0000","last_clean":"2023-11-15T02:37:11.513376+0000","last_became_active":"2023-11-15T02:37:11.131648+0000","last_became_peered":"2023-11-15T02:37:11.131648+0000","last_unstale":"2023-11-15T02:37:11.513376+0000","last_undegraded":"2023-11-15T02:37:11.513376+0000","last_fullsized":"2023-11-15T02:37:11.513376+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534119+0000","last_change":"2023-11-15T02:37:11.531957+0000","last_active":"2023-11-15T02:37:11.534119+0000","last_peered":"2023-11-15T02:37:11.534119+0000","last_clean":"2023-11-15T02:37:11.534119+0000","last_became_active":"2023-11-15T02:37:11.531708+0000","last_became_peered":"2023-11-15T02:37:11.531708+0000","last_unstale":"2023-11-15T02:37:11.534119+0000","last_undegraded":"2023-11-15T02:37:11.534119+0000","last_fullsized":"2023-11-15T02:37:11.534119+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.522736+0000","last_change":"2023-11-15T02:37:11.144563+0000","last_active":"2023-11-15T02:37:11.522736+0000","last_peered":"2023-11-15T02:37:11.522736+0000","last_clean":"2023-11-15T02:37:11.522736+0000","last_became_active":"2023-11-15T02:37:11.144211+0000","last_became_peered":"2023-11-15T02:37:11.144211+0000","last_unstale":"2023-11-15T02:37:11.522736+0000","last_undegraded":"2023-11-15T02:37:11.522736+0000","last_fullsized":"2023-11-15T02:37:11.522736+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524601+0000","last_change":"2023-11-15T02:37:11.520452+0000","last_active":"2023-11-15T02:37:11.524601+0000","last_peered":"2023-11-15T02:37:11.524601+0000","last_clean":"2023-11-15T02:37:11.524601+0000","last_became_active":"2023-11-15T02:37:11.520186+0000","last_became_peered":"2023-11-15T02:37:11.520186+0000","last_unstale":"2023-11-15T02:37:11.524601+0000","last_undegraded":"2023-11-15T02:37:11.524601+0000","last_fullsized":"2023-11-15T02:37:11.524601+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510527+0000","last_change":"2023-11-15T02:37:11.132982+0000","last_active":"2023-11-15T02:37:11.510527+0000","last_peered":"2023-11-15T02:37:11.510527+0000","last_clean":"2023-11-15T02:37:11.510527+0000","last_became_active":"2023-11-15T02:37:11.132658+0000","last_became_peered":"2023-11-15T02:37:11.132658+0000","last_unstale":"2023-11-15T02:37:11.510527+0000","last_undegraded":"2023-11-15T02:37:11.510527+0000","last_fullsized":"2023-11-15T02:37:11.510527+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534072+0000","last_change":"2023-11-15T02:37:11.532754+0000","last_active":"2023-11-15T02:37:11.534072+0000","last_peered":"2023-11-15T02:37:11.534072+0000","last_clean":"2023-11-15T02:37:11.534072+0000","last_became_active":"2023-11-15T02:37:11.532482+0000","last_became_peered":"2023-11-15T02:37:11.532482+0000","last_unstale":"2023-11-15T02:37:11.534072+0000","last_undegraded":"2023-11-15T02:37:11.534072+0000","last_fullsized":"2023-11-15T02:37:11.534072+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513593+0000","last_change":"2023-11-15T02:37:11.137869+0000","last_active":"2023-11-15T02:37:11.513593+0000","last_peered":"2023-11-15T02:37:11.513593+0000","last_clean":"2023-11-15T02:37:11.513593+0000","last_became_active":"2023-11-15T02:37:11.137555+0000","last_became_peered":"2023-11-15T02:37:11.137555+0000","last_unstale":"2023-11-15T02:37:11.513593+0000","last_undegraded":"2023-11-15T02:37:11.513593+0000","last_fullsized":"2023-11-15T02:37:11.513593+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528578+0000","last_change":"2023-11-15T02:37:11.525346+0000","last_active":"2023-11-15T02:37:11.528578+0000","last_peered":"2023-11-15T02:37:11.528578+0000","last_clean":"2023-11-15T02:37:11.528578+0000","last_became_active":"2023-11-15T02:37:11.525079+0000","last_became_peered":"2023-11-15T02:37:11.525079+0000","last_unstale":"2023-11-15T02:37:11.528578+0000","last_undegraded":"2023-11-15T02:37:11.528578+0000","last_fullsized":"2023-11-15T02:37:11.528578+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510715+0000","last_change":"2023-11-15T02:37:11.133547+0000","last_active":"2023-11-15T02:37:11.510715+0000","last_peered":"2023-11-15T02:37:11.510715+0000","last_clean":"2023-11-15T02:37:11.510715+0000","last_became_active":"2023-11-15T02:37:11.133276+0000","last_became_peered":"2023-11-15T02:37:11.133276+0000","last_unstale":"2023-11-15T02:37:11.510715+0000","last_undegraded":"2023-11-15T02:37:11.510715+0000","last_fullsized":"2023-11-15T02:37:11.510715+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.522175+0000","last_change":"2023-11-15T02:37:11.520512+0000","last_active":"2023-11-15T02:37:11.522175+0000","last_peered":"2023-11-15T02:37:11.522175+0000","last_clean":"2023-11-15T02:37:11.522175+0000","last_became_active":"2023-11-15T02:37:11.520227+0000","last_became_peered":"2023-11-15T02:37:11.520227+0000","last_unstale":"2023-11-15T02:37:11.522175+0000","last_undegraded":"2023-11-15T02:37:11.522175+0000","last_fullsized":"2023-11-15T02:37:11.522175+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514923+0000","last_change":"2023-11-15T02:37:11.127060+0000","last_active":"2023-11-15T02:37:11.514923+0000","last_peered":"2023-11-15T02:37:11.514923+0000","last_clean":"2023-11-15T02:37:11.514923+0000","last_became_active":"2023-11-15T02:37:11.126765+0000","last_became_peered":"2023-11-15T02:37:11.126765+0000","last_unstale":"2023-11-15T02:37:11.514923+0000","last_undegraded":"2023-11-15T02:37:11.514923+0000","last_fullsized":"2023-11-15T02:37:11.514923+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.529831+0000","last_change":"2023-11-15T02:37:11.527043+0000","last_active":"2023-11-15T02:37:11.529831+0000","last_peered":"2023-11-15T02:37:11.529831+0000","last_clean":"2023-11-15T02:37:11.529831+0000","last_became_active":"2023-11-15T02:37:11.526062+0000","last_became_peered":"2023-11-15T02:37:11.526062+0000","last_unstale":"2023-11-15T02:37:11.529831+0000","last_undegraded":"2023-11-15T02:37:11.529831+0000","last_fullsized":"2023-11-15T02:37:11.529831+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512158+0000","last_change":"2023-11-15T02:37:11.135020+0000","last_active":"2023-11-15T02:37:11.512158+0000","last_peered":"2023-11-15T02:37:11.512158+0000","last_clean":"2023-11-15T02:37:11.512158+0000","last_became_active":"2023-11-15T02:37:11.134736+0000","last_became_peered":"2023-11-15T02:37:11.134736+0000","last_unstale":"2023-11-15T02:37:11.512158+0000","last_undegraded":"2023-11-15T02:37:11.512158+0000","last_fullsized":"2023-11-15T02:37:11.512158+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533074+0000","last_change":"2023-11-15T02:37:11.526058+0000","last_active":"2023-11-15T02:37:11.533074+0000","last_peered":"2023-11-15T02:37:11.533074+0000","last_clean":"2023-11-15T02:37:11.533074+0000","last_became_active":"2023-11-15T02:37:11.525787+0000","last_became_peered":"2023-11-15T02:37:11.525787+0000","last_unstale":"2023-11-15T02:37:11.533074+0000","last_undegraded":"2023-11-15T02:37:11.533074+0000","last_fullsized":"2023-11-15T02:37:11.533074+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513463+0000","last_change":"2023-11-15T02:37:11.142039+0000","last_active":"2023-11-15T02:37:11.513463+0000","last_peered":"2023-11-15T02:37:11.513463+0000","last_clean":"2023-11-15T02:37:11.513463+0000","last_became_active":"2023-11-15T02:37:11.138870+0000","last_became_peered":"2023-11-15T02:37:11.138870+0000","last_unstale":"2023-11-15T02:37:11.513463+0000","last_undegraded":"2023-11-15T02:37:11.513463+0000","last_fullsized":"2023-11-15T02:37:11.513463+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524311+0000","last_change":"2023-11-15T02:37:11.516462+0000","last_active":"2023-11-15T02:37:11.524311+0000","last_peered":"2023-11-15T02:37:11.524311+0000","last_clean":"2023-11-15T02:37:11.524311+0000","last_became_active":"2023-11-15T02:37:11.516173+0000","last_became_peered":"2023-11-15T02:37:11.516173+0000","last_unstale":"2023-11-15T02:37:11.524311+0000","last_undegraded":"2023-11-15T02:37:11.524311+0000","last_fullsized":"2023-11-15T02:37:11.524311+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.516846+0000","last_change":"2023-11-15T02:37:11.131463+0000","last_active":"2023-11-15T02:37:11.516846+0000","last_peered":"2023-11-15T02:37:11.516846+0000","last_clean":"2023-11-15T02:37:11.516846+0000","last_became_active":"2023-11-15T02:37:11.131169+0000","last_became_peered":"2023-11-15T02:37:11.131169+0000","last_unstale":"2023-11-15T02:37:11.516846+0000","last_undegraded":"2023-11-15T02:37:11.516846+0000","last_fullsized":"2023-11-15T02:37:11.516846+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535324+0000","last_change":"2023-11-15T02:37:11.533241+0000","last_active":"2023-11-15T02:37:11.535324+0000","last_peered":"2023-11-15T02:37:11.535324+0000","last_clean":"2023-11-15T02:37:11.535324+0000","last_became_active":"2023-11-15T02:37:11.532946+0000","last_became_peered":"2023-11-15T02:37:11.532946+0000","last_unstale":"2023-11-15T02:37:11.535324+0000","last_undegraded":"2023-11-15T02:37:11.535324+0000","last_fullsized":"2023-11-15T02:37:11.535324+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.508592+0000","last_change":"2023-11-15T02:37:11.135042+0000","last_active":"2023-11-15T02:37:11.508592+0000","last_peered":"2023-11-15T02:37:11.508592+0000","last_clean":"2023-11-15T02:37:11.508592+0000","last_became_active":"2023-11-15T02:37:11.134750+0000","last_became_peered":"2023-11-15T02:37:11.134750+0000","last_unstale":"2023-11-15T02:37:11.508592+0000","last_undegraded":"2023-11-15T02:37:11.508592+0000","last_fullsized":"2023-11-15T02:37:11.508592+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534117+0000","last_change":"2023-11-15T02:37:11.531934+0000","last_active":"2023-11-15T02:37:11.534117+0000","last_peered":"2023-11-15T02:37:11.534117+0000","last_clean":"2023-11-15T02:37:11.534117+0000","last_became_active":"2023-11-15T02:37:11.531488+0000","last_became_peered":"2023-11-15T02:37:11.531488+0000","last_unstale":"2023-11-15T02:37:11.534117+0000","last_undegraded":"2023-11-15T02:37:11.534117+0000","last_fullsized":"2023-11-15T02:37:11.534117+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.531593+0000","last_change":"2023-11-15T02:37:11.131225+0000","last_active":"2023-11-15T02:37:11.531593+0000","last_peered":"2023-11-15T02:37:11.531593+0000","last_clean":"2023-11-15T02:37:11.531593+0000","last_became_active":"2023-11-15T02:37:11.130952+0000","last_became_peered":"2023-11-15T02:37:11.130952+0000","last_unstale":"2023-11-15T02:37:11.531593+0000","last_undegraded":"2023-11-15T02:37:11.531593+0000","last_fullsized":"2023-11-15T02:37:11.531593+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.531108+0000","last_change":"2023-11-15T02:37:11.529835+0000","last_active":"2023-11-15T02:37:11.531108+0000","last_peered":"2023-11-15T02:37:11.531108+0000","last_clean":"2023-11-15T02:37:11.531108+0000","last_became_active":"2023-11-15T02:37:11.529617+0000","last_became_peered":"2023-11-15T02:37:11.529617+0000","last_unstale":"2023-11-15T02:37:11.531108+0000","last_undegraded":"2023-11-15T02:37:11.531108+0000","last_fullsized":"2023-11-15T02:37:11.531108+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536892+0000","last_change":"2023-11-15T02:37:11.145324+0000","last_active":"2023-11-15T02:37:11.536892+0000","last_peered":"2023-11-15T02:37:11.536892+0000","last_clean":"2023-11-15T02:37:11.536892+0000","last_became_active":"2023-11-15T02:37:11.144842+0000","last_became_peered":"2023-11-15T02:37:11.144842+0000","last_unstale":"2023-11-15T02:37:11.536892+0000","last_undegraded":"2023-11-15T02:37:11.536892+0000","last_fullsized":"2023-11-15T02:37:11.536892+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.519519+0000","last_change":"2023-11-15T02:37:11.518532+0000","last_active":"2023-11-15T02:37:11.519519+0000","last_peered":"2023-11-15T02:37:11.519519+0000","last_clean":"2023-11-15T02:37:11.519519+0000","last_became_active":"2023-11-15T02:37:11.518235+0000","last_became_peered":"2023-11-15T02:37:11.518235+0000","last_unstale":"2023-11-15T02:37:11.519519+0000","last_undegraded":"2023-11-15T02:37:11.519519+0000","last_fullsized":"2023-11-15T02:37:11.519519+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.537111+0000","last_change":"2023-11-15T02:37:11.146378+0000","last_active":"2023-11-15T02:37:11.537111+0000","last_peered":"2023-11-15T02:37:11.537111+0000","last_clean":"2023-11-15T02:37:11.537111+0000","last_became_active":"2023-11-15T02:37:11.146096+0000","last_became_peered":"2023-11-15T02:37:11.146096+0000","last_unstale":"2023-11-15T02:37:11.537111+0000","last_undegraded":"2023-11-15T02:37:11.537111+0000","last_fullsized":"2023-11-15T02:37:11.537111+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.537964+0000","last_change":"2023-11-15T02:37:11.537305+0000","last_active":"2023-11-15T02:37:11.537964+0000","last_peered":"2023-11-15T02:37:11.537964+0000","last_clean":"2023-11-15T02:37:11.537964+0000","last_became_active":"2023-11-15T02:37:11.537004+0000","last_became_peered":"2023-11-15T02:37:11.537004+0000","last_unstale":"2023-11-15T02:37:11.537964+0000","last_undegraded":"2023-11-15T02:37:11.537964+0000","last_fullsized":"2023-11-15T02:37:11.537964+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512534+0000","last_change":"2023-11-15T02:37:11.139083+0000","last_active":"2023-11-15T02:37:11.512534+0000","last_peered":"2023-11-15T02:37:11.512534+0000","last_clean":"2023-11-15T02:37:11.512534+0000","last_became_active":"2023-11-15T02:37:11.138796+0000","last_became_peered":"2023-11-15T02:37:11.138796+0000","last_unstale":"2023-11-15T02:37:11.512534+0000","last_undegraded":"2023-11-15T02:37:11.512534+0000","last_fullsized":"2023-11-15T02:37:11.512534+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535745+0000","last_change":"2023-11-15T02:37:11.530506+0000","last_active":"2023-11-15T02:37:11.535745+0000","last_peered":"2023-11-15T02:37:11.535745+0000","last_clean":"2023-11-15T02:37:11.535745+0000","last_became_active":"2023-11-15T02:37:11.530121+0000","last_became_peered":"2023-11-15T02:37:11.530121+0000","last_unstale":"2023-11-15T02:37:11.535745+0000","last_undegraded":"2023-11-15T02:37:11.535745+0000","last_fullsized":"2023-11-15T02:37:11.535745+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513258+0000","last_change":"2023-11-15T02:37:11.133202+0000","last_active":"2023-11-15T02:37:11.513258+0000","last_peered":"2023-11-15T02:37:11.513258+0000","last_clean":"2023-11-15T02:37:11.513258+0000","last_became_active":"2023-11-15T02:37:11.132905+0000","last_became_peered":"2023-11-15T02:37:11.132905+0000","last_unstale":"2023-11-15T02:37:11.513258+0000","last_undegraded":"2023-11-15T02:37:11.513258+0000","last_fullsized":"2023-11-15T02:37:11.513258+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526983+0000","last_change":"2023-11-15T02:37:11.523616+0000","last_active":"2023-11-15T02:37:11.526983+0000","last_peered":"2023-11-15T02:37:11.526983+0000","last_clean":"2023-11-15T02:37:11.526983+0000","last_became_active":"2023-11-15T02:37:11.523194+0000","last_became_peered":"2023-11-15T02:37:11.523194+0000","last_unstale":"2023-11-15T02:37:11.526983+0000","last_undegraded":"2023-11-15T02:37:11.526983+0000","last_fullsized":"2023-11-15T02:37:11.526983+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.518581+0000","last_change":"2023-11-15T02:37:11.129805+0000","last_active":"2023-11-15T02:37:11.518581+0000","last_peered":"2023-11-15T02:37:11.518581+0000","last_clean":"2023-11-15T02:37:11.518581+0000","last_became_active":"2023-11-15T02:37:11.129553+0000","last_became_peered":"2023-11-15T02:37:11.129553+0000","last_unstale":"2023-11-15T02:37:11.518581+0000","last_undegraded":"2023-11-15T02:37:11.518581+0000","last_fullsized":"2023-11-15T02:37:11.518581+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.523127+0000","last_change":"2023-11-15T02:37:11.522333+0000","last_active":"2023-11-15T02:37:11.523127+0000","last_peered":"2023-11-15T02:37:11.523127+0000","last_clean":"2023-11-15T02:37:11.523127+0000","last_became_active":"2023-11-15T02:37:11.522063+0000","last_became_peered":"2023-11-15T02:37:11.522063+0000","last_unstale":"2023-11-15T02:37:11.523127+0000","last_undegraded":"2023-11-15T02:37:11.523127+0000","last_fullsized":"2023-11-15T02:37:11.523127+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.517303+0000","last_change":"2023-11-15T02:37:11.140912+0000","last_active":"2023-11-15T02:37:11.517303+0000","last_peered":"2023-11-15T02:37:11.517303+0000","last_clean":"2023-11-15T02:37:11.517303+0000","last_became_active":"2023-11-15T02:37:11.140606+0000","last_became_peered":"2023-11-15T02:37:11.140606+0000","last_unstale":"2023-11-15T02:37:11.517303+0000","last_undegraded":"2023-11-15T02:37:11.517303+0000","last_fullsized":"2023-11-15T02:37:11.517303+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526732+0000","last_change":"2023-11-15T02:37:11.521507+0000","last_active":"2023-11-15T02:37:11.526732+0000","last_peered":"2023-11-15T02:37:11.526732+0000","last_clean":"2023-11-15T02:37:11.526732+0000","last_became_active":"2023-11-15T02:37:11.521206+0000","last_became_peered":"2023-11-15T02:37:11.521206+0000","last_unstale":"2023-11-15T02:37:11.526732+0000","last_undegraded":"2023-11-15T02:37:11.526732+0000","last_fullsized":"2023-11-15T02:37:11.526732+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.520647+0000","last_change":"2023-11-15T02:37:11.131674+0000","last_active":"2023-11-15T02:37:11.520647+0000","last_peered":"2023-11-15T02:37:11.520647+0000","last_clean":"2023-11-15T02:37:11.520647+0000","last_became_active":"2023-11-15T02:37:11.131350+0000","last_became_peered":"2023-11-15T02:37:11.131350+0000","last_unstale":"2023-11-15T02:37:11.520647+0000","last_undegraded":"2023-11-15T02:37:11.520647+0000","last_fullsized":"2023-11-15T02:37:11.520647+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536488+0000","last_change":"2023-11-15T02:37:11.534702+0000","last_active":"2023-11-15T02:37:11.536488+0000","last_peered":"2023-11-15T02:37:11.536488+0000","last_clean":"2023-11-15T02:37:11.536488+0000","last_became_active":"2023-11-15T02:37:11.534388+0000","last_became_peered":"2023-11-15T02:37:11.534388+0000","last_unstale":"2023-11-15T02:37:11.536488+0000","last_undegraded":"2023-11-15T02:37:11.536488+0000","last_fullsized":"2023-11-15T02:37:11.536488+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533909+0000","last_change":"2023-11-15T02:37:11.142894+0000","last_active":"2023-11-15T02:37:11.533909+0000","last_peered":"2023-11-15T02:37:11.533909+0000","last_clean":"2023-11-15T02:37:11.533909+0000","last_became_active":"2023-11-15T02:37:11.142437+0000","last_became_peered":"2023-11-15T02:37:11.142437+0000","last_unstale":"2023-11-15T02:37:11.533909+0000","last_undegraded":"2023-11-15T02:37:11.533909+0000","last_fullsized":"2023-11-15T02:37:11.533909+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535692+0000","last_change":"2023-11-15T02:37:11.533321+0000","last_active":"2023-11-15T02:37:11.535692+0000","last_peered":"2023-11-15T02:37:11.535692+0000","last_clean":"2023-11-15T02:37:11.535692+0000","last_became_active":"2023-11-15T02:37:11.532667+0000","last_became_peered":"2023-11-15T02:37:11.532667+0000","last_unstale":"2023-11-15T02:37:11.535692+0000","last_undegraded":"2023-11-15T02:37:11.535692+0000","last_fullsized":"2023-11-15T02:37:11.535692+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536254+0000","last_change":"2023-11-15T02:37:11.144931+0000","last_active":"2023-11-15T02:37:11.536254+0000","last_peered":"2023-11-15T02:37:11.536254+0000","last_clean":"2023-11-15T02:37:11.536254+0000","last_became_active":"2023-11-15T02:37:11.144570+0000","last_became_peered":"2023-11-15T02:37:11.144570+0000","last_unstale":"2023-11-15T02:37:11.536254+0000","last_undegraded":"2023-11-15T02:37:11.536254+0000","last_fullsized":"2023-11-15T02:37:11.536254+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528891+0000","last_change":"2023-11-15T02:37:11.526949+0000","last_active":"2023-11-15T02:37:11.528891+0000","last_peered":"2023-11-15T02:37:11.528891+0000","last_clean":"2023-11-15T02:37:11.528891+0000","last_became_active":"2023-11-15T02:37:11.526662+0000","last_became_peered":"2023-11-15T02:37:11.526662+0000","last_unstale":"2023-11-15T02:37:11.528891+0000","last_undegraded":"2023-11-15T02:37:11.528891+0000","last_fullsized":"2023-11-15T02:37:11.528891+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514456+0000","last_change":"2023-11-15T02:37:11.133572+0000","last_active":"2023-11-15T02:37:11.514456+0000","last_peered":"2023-11-15T02:37:11.514456+0000","last_clean":"2023-11-15T02:37:11.514456+0000","last_became_active":"2023-11-15T02:37:11.133210+0000","last_became_peered":"2023-11-15T02:37:11.133210+0000","last_unstale":"2023-11-15T02:37:11.514456+0000","last_undegraded":"2023-11-15T02:37:11.514456+0000","last_fullsized":"2023-11-15T02:37:11.514456+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528637+0000","last_change":"2023-11-15T02:37:11.526321+0000","last_active":"2023-11-15T02:37:11.528637+0000","last_peered":"2023-11-15T02:37:11.528637+0000","last_clean":"2023-11-15T02:37:11.528637+0000","last_became_active":"2023-11-15T02:37:11.526038+0000","last_became_peered":"2023-11-15T02:37:11.526038+0000","last_unstale":"2023-11-15T02:37:11.528637+0000","last_undegraded":"2023-11-15T02:37:11.528637+0000","last_fullsized":"2023-11-15T02:37:11.528637+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512409+0000","last_change":"2023-11-15T02:37:11.132885+0000","last_active":"2023-11-15T02:37:11.512409+0000","last_peered":"2023-11-15T02:37:11.512409+0000","last_clean":"2023-11-15T02:37:11.512409+0000","last_became_active":"2023-11-15T02:37:11.132493+0000","last_became_peered":"2023-11-15T02:37:11.132493+0000","last_unstale":"2023-11-15T02:37:11.512409+0000","last_undegraded":"2023-11-15T02:37:11.512409+0000","last_fullsized":"2023-11-15T02:37:11.512409+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535940+0000","last_change":"2023-11-15T02:37:11.533007+0000","last_active":"2023-11-15T02:37:11.535940+0000","last_peered":"2023-11-15T02:37:11.535940+0000","last_clean":"2023-11-15T02:37:11.535940+0000","last_became_active":"2023-11-15T02:37:11.532711+0000","last_became_peered":"2023-11-15T02:37:11.532711+0000","last_unstale":"2023-11-15T02:37:11.535940+0000","last_undegraded":"2023-11-15T02:37:11.535940+0000","last_fullsized":"2023-11-15T02:37:11.535940+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.519877+0000","last_change":"2023-11-15T02:37:11.132042+0000","last_active":"2023-11-15T02:37:11.519877+0000","last_peered":"2023-11-15T02:37:11.519877+0000","last_clean":"2023-11-15T02:37:11.519877+0000","last_became_active":"2023-11-15T02:37:11.131721+0000","last_became_peered":"2023-11-15T02:37:11.131721+0000","last_unstale":"2023-11-15T02:37:11.519877+0000","last_undegraded":"2023-11-15T02:37:11.519877+0000","last_fullsized":"2023-11-15T02:37:11.519877+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524036+0000","last_change":"2023-11-15T02:37:11.522744+0000","last_active":"2023-11-15T02:37:11.524036+0000","last_peered":"2023-11-15T02:37:11.524036+0000","last_clean":"2023-11-15T02:37:11.524036+0000","last_became_active":"2023-11-15T02:37:11.522359+0000","last_became_peered":"2023-11-15T02:37:11.522359+0000","last_unstale":"2023-11-15T02:37:11.524036+0000","last_undegraded":"2023-11-15T02:37:11.524036+0000","last_fullsized":"2023-11-15T02:37:11.524036+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513564+0000","last_change":"2023-11-15T02:37:11.139252+0000","last_active":"2023-11-15T02:37:11.513564+0000","last_peered":"2023-11-15T02:37:11.513564+0000","last_clean":"2023-11-15T02:37:11.513564+0000","last_became_active":"2023-11-15T02:37:11.138855+0000","last_became_peered":"2023-11-15T02:37:11.138855+0000","last_unstale":"2023-11-15T02:37:11.513564+0000","last_undegraded":"2023-11-15T02:37:11.513564+0000","last_fullsized":"2023-11-15T02:37:11.513564+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535771+0000","last_change":"2023-11-15T02:37:11.533811+0000","last_active":"2023-11-15T02:37:11.535771+0000","last_peered":"2023-11-15T02:37:11.535771+0000","last_clean":"2023-11-15T02:37:11.535771+0000","last_became_active":"2023-11-15T02:37:11.533437+0000","last_became_peered":"2023-11-15T02:37:11.533437+0000","last_unstale":"2023-11-15T02:37:11.535771+0000","last_undegraded":"2023-11-15T02:37:11.535771+0000","last_fullsized":"2023-11-15T02:37:11.535771+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512133+0000","last_change":"2023-11-15T02:37:11.129579+0000","last_active":"2023-11-15T02:37:11.512133+0000","last_peered":"2023-11-15T02:37:11.512133+0000","last_clean":"2023-11-15T02:37:11.512133+0000","last_became_active":"2023-11-15T02:37:11.129102+0000","last_became_peered":"2023-11-15T02:37:11.129102+0000","last_unstale":"2023-11-15T02:37:11.512133+0000","last_undegraded":"2023-11-15T02:37:11.512133+0000","last_fullsized":"2023-11-15T02:37:11.512133+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.522568+0000","last_change":"2023-11-15T02:37:11.517937+0000","last_active":"2023-11-15T02:37:11.522568+0000","last_peered":"2023-11-15T02:37:11.522568+0000","last_clean":"2023-11-15T02:37:11.522568+0000","last_became_active":"2023-11-15T02:37:11.517664+0000","last_became_peered":"2023-11-15T02:37:11.517664+0000","last_unstale":"2023-11-15T02:37:11.522568+0000","last_undegraded":"2023-11-15T02:37:11.522568+0000","last_fullsized":"2023-11-15T02:37:11.522568+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514490+0000","last_change":"2023-11-15T02:37:11.131730+0000","last_active":"2023-11-15T02:37:11.514490+0000","last_peered":"2023-11-15T02:37:11.514490+0000","last_clean":"2023-11-15T02:37:11.514490+0000","last_became_active":"2023-11-15T02:37:11.131437+0000","last_became_peered":"2023-11-15T02:37:11.131437+0000","last_unstale":"2023-11-15T02:37:11.514490+0000","last_undegraded":"2023-11-15T02:37:11.514490+0000","last_fullsized":"2023-11-15T02:37:11.514490+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.531631+0000","last_change":"2023-11-15T02:37:11.522292+0000","last_active":"2023-11-15T02:37:11.531631+0000","last_peered":"2023-11-15T02:37:11.531631+0000","last_clean":"2023-11-15T02:37:11.531631+0000","last_became_active":"2023-11-15T02:37:11.522044+0000","last_became_peered":"2023-11-15T02:37:11.522044+0000","last_unstale":"2023-11-15T02:37:11.531631+0000","last_undegraded":"2023-11-15T02:37:11.531631+0000","last_fullsized":"2023-11-15T02:37:11.531631+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528185+0000","last_change":"2023-11-15T02:37:11.132610+0000","last_active":"2023-11-15T02:37:11.528185+0000","last_peered":"2023-11-15T02:37:11.528185+0000","last_clean":"2023-11-15T02:37:11.528185+0000","last_became_active":"2023-11-15T02:37:11.132317+0000","last_became_peered":"2023-11-15T02:37:11.132317+0000","last_unstale":"2023-11-15T02:37:11.528185+0000","last_undegraded":"2023-11-15T02:37:11.528185+0000","last_fullsized":"2023-11-15T02:37:11.528185+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534578+0000","last_change":"2023-11-15T02:37:11.532374+0000","last_active":"2023-11-15T02:37:11.534578+0000","last_peered":"2023-11-15T02:37:11.534578+0000","last_clean":"2023-11-15T02:37:11.534578+0000","last_became_active":"2023-11-15T02:37:11.531978+0000","last_became_peered":"2023-11-15T02:37:11.531978+0000","last_unstale":"2023-11-15T02:37:11.534578+0000","last_undegraded":"2023-11-15T02:37:11.534578+0000","last_fullsized":"2023-11-15T02:37:11.534578+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.518343+0000","last_change":"2023-11-15T02:37:11.143661+0000","last_active":"2023-11-15T02:37:11.518343+0000","last_peered":"2023-11-15T02:37:11.518343+0000","last_clean":"2023-11-15T02:37:11.518343+0000","last_became_active":"2023-11-15T02:37:11.143395+0000","last_became_peered":"2023-11-15T02:37:11.143395+0000","last_unstale":"2023-11-15T02:37:11.518343+0000","last_undegraded":"2023-11-15T02:37:11.518343+0000","last_fullsized":"2023-11-15T02:37:11.518343+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.527851+0000","last_change":"2023-11-15T02:37:11.521941+0000","last_active":"2023-11-15T02:37:11.527851+0000","last_peered":"2023-11-15T02:37:11.527851+0000","last_clean":"2023-11-15T02:37:11.527851+0000","last_became_active":"2023-11-15T02:37:11.521648+0000","last_became_peered":"2023-11-15T02:37:11.521648+0000","last_unstale":"2023-11-15T02:37:11.527851+0000","last_undegraded":"2023-11-15T02:37:11.527851+0000","last_fullsized":"2023-11-15T02:37:11.527851+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514553+0000","last_change":"2023-11-15T02:37:11.136397+0000","last_active":"2023-11-15T02:37:11.514553+0000","last_peered":"2023-11-15T02:37:11.514553+0000","last_clean":"2023-11-15T02:37:11.514553+0000","last_became_active":"2023-11-15T02:37:11.136081+0000","last_became_peered":"2023-11-15T02:37:11.136081+0000","last_unstale":"2023-11-15T02:37:11.514553+0000","last_undegraded":"2023-11-15T02:37:11.514553+0000","last_fullsized":"2023-11-15T02:37:11.514553+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533360+0000","last_change":"2023-11-15T02:37:11.527925+0000","last_active":"2023-11-15T02:37:11.533360+0000","last_peered":"2023-11-15T02:37:11.533360+0000","last_clean":"2023-11-15T02:37:11.533360+0000","last_became_active":"2023-11-15T02:37:11.526688+0000","last_became_peered":"2023-11-15T02:37:11.526688+0000","last_unstale":"2023-11-15T02:37:11.533360+0000","last_undegraded":"2023-11-15T02:37:11.533360+0000","last_fullsized":"2023-11-15T02:37:11.533360+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.518084+0000","last_change":"2023-11-15T02:37:11.135021+0000","last_active":"2023-11-15T02:37:11.518084+0000","last_peered":"2023-11-15T02:37:11.518084+0000","last_clean":"2023-11-15T02:37:11.518084+0000","last_became_active":"2023-11-15T02:37:11.133753+0000","last_became_peered":"2023-11-15T02:37:11.133753+0000","last_unstale":"2023-11-15T02:37:11.518084+0000","last_undegraded":"2023-11-15T02:37:11.518084+0000","last_fullsized":"2023-11-15T02:37:11.518084+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524071+0000","last_change":"2023-11-15T02:37:11.521924+0000","last_active":"2023-11-15T02:37:11.524071+0000","last_peered":"2023-11-15T02:37:11.524071+0000","last_clean":"2023-11-15T02:37:11.524071+0000","last_became_active":"2023-11-15T02:37:11.521625+0000","last_became_peered":"2023-11-15T02:37:11.521625+0000","last_unstale":"2023-11-15T02:37:11.524071+0000","last_undegraded":"2023-11-15T02:37:11.524071+0000","last_fullsized":"2023-11-15T02:37:11.524071+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.517021+0000","last_change":"2023-11-15T02:37:11.134111+0000","last_active":"2023-11-15T02:37:11.517021+0000","last_peered":"2023-11-15T02:37:11.517021+0000","last_clean":"2023-11-15T02:37:11.517021+0000","last_became_active":"2023-11-15T02:37:11.133797+0000","last_became_peered":"2023-11-15T02:37:11.133797+0000","last_unstale":"2023-11-15T02:37:11.517021+0000","last_undegraded":"2023-11-15T02:37:11.517021+0000","last_fullsized":"2023-11-15T02:37:11.517021+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.530553+0000","last_change":"2023-11-15T02:37:11.526898+0000","last_active":"2023-11-15T02:37:11.530553+0000","last_peered":"2023-11-15T02:37:11.530553+0000","last_clean":"2023-11-15T02:37:11.530553+0000","last_became_active":"2023-11-15T02:37:11.526610+0000","last_became_peered":"2023-11-15T02:37:11.526610+0000","last_unstale":"2023-11-15T02:37:11.530553+0000","last_undegraded":"2023-11-15T02:37:11.530553+0000","last_fullsized":"2023-11-15T02:37:11.530553+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.509580+0000","last_change":"2023-11-15T02:37:11.132901+0000","last_active":"2023-11-15T02:37:11.509580+0000","last_peered":"2023-11-15T02:37:11.509580+0000","last_clean":"2023-11-15T02:37:11.509580+0000","last_became_active":"2023-11-15T02:37:11.132583+0000","last_became_peered":"2023-11-15T02:37:11.132583+0000","last_unstale":"2023-11-15T02:37:11.509580+0000","last_undegraded":"2023-11-15T02:37:11.509580+0000","last_fullsized":"2023-11-15T02:37:11.509580+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.523106+0000","last_change":"2023-11-15T02:37:11.521103+0000","last_active":"2023-11-15T02:37:11.523106+0000","last_peered":"2023-11-15T02:37:11.523106+0000","last_clean":"2023-11-15T02:37:11.523106+0000","last_became_active":"2023-11-15T02:37:11.520591+0000","last_became_peered":"2023-11-15T02:37:11.520591+0000","last_unstale":"2023-11-15T02:37:11.523106+0000","last_undegraded":"2023-11-15T02:37:11.523106+0000","last_fullsized":"2023-11-15T02:37:11.523106+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.516861+0000","last_change":"2023-11-15T02:37:11.137659+0000","last_active":"2023-11-15T02:37:11.516861+0000","last_peered":"2023-11-15T02:37:11.516861+0000","last_clean":"2023-11-15T02:37:11.516861+0000","last_became_active":"2023-11-15T02:37:11.137320+0000","last_became_peered":"2023-11-15T02:37:11.137320+0000","last_unstale":"2023-11-15T02:37:11.516861+0000","last_undegraded":"2023-11-15T02:37:11.516861+0000","last_fullsized":"2023-11-15T02:37:11.516861+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536414+0000","last_change":"2023-11-15T02:37:11.535225+0000","last_active":"2023-11-15T02:37:11.536414+0000","last_peered":"2023-11-15T02:37:11.536414+0000","last_clean":"2023-11-15T02:37:11.536414+0000","last_became_active":"2023-11-15T02:37:11.534718+0000","last_became_peered":"2023-11-15T02:37:11.534718+0000","last_unstale":"2023-11-15T02:37:11.536414+0000","last_undegraded":"2023-11-15T02:37:11.536414+0000","last_fullsized":"2023-11-15T02:37:11.536414+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.523332+0000","last_change":"2023-11-15T02:37:11.142425+0000","last_active":"2023-11-15T02:37:11.523332+0000","last_peered":"2023-11-15T02:37:11.523332+0000","last_clean":"2023-11-15T02:37:11.523332+0000","last_became_active":"2023-11-15T02:37:11.141843+0000","last_became_peered":"2023-11-15T02:37:11.141843+0000","last_unstale":"2023-11-15T02:37:11.523332+0000","last_undegraded":"2023-11-15T02:37:11.523332+0000","last_fullsized":"2023-11-15T02:37:11.523332+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536556+0000","last_change":"2023-11-15T02:37:11.535377+0000","last_active":"2023-11-15T02:37:11.536556+0000","last_peered":"2023-11-15T02:37:11.536556+0000","last_clean":"2023-11-15T02:37:11.536556+0000","last_became_active":"2023-11-15T02:37:11.535019+0000","last_became_peered":"2023-11-15T02:37:11.535019+0000","last_unstale":"2023-11-15T02:37:11.536556+0000","last_undegraded":"2023-11-15T02:37:11.536556+0000","last_fullsized":"2023-11-15T02:37:11.536556+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535527+0000","last_change":"2023-11-15T02:37:11.132912+0000","last_active":"2023-11-15T02:37:11.535527+0000","last_peered":"2023-11-15T02:37:11.535527+0000","last_clean":"2023-11-15T02:37:11.535527+0000","last_became_active":"2023-11-15T02:37:11.132624+0000","last_became_peered":"2023-11-15T02:37:11.132624+0000","last_unstale":"2023-11-15T02:37:11.535527+0000","last_undegraded":"2023-11-15T02:37:11.535527+0000","last_fullsized":"2023-11-15T02:37:11.535527+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512622+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:37:11.512622+0000","last_peered":"2023-11-15T02:37:11.512622+0000","last_clean":"2023-11-15T02:37:11.512622+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:37:11.512622+0000","last_undegraded":"2023-11-15T02:37:11.512622+0000","last_fullsized":"2023-11-15T02:37:11.512622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524918+0000","last_change":"2023-11-15T02:37:11.521619+0000","last_active":"2023-11-15T02:37:11.524918+0000","last_peered":"2023-11-15T02:37:11.524918+0000","last_clean":"2023-11-15T02:37:11.524918+0000","last_became_active":"2023-11-15T02:37:11.520927+0000","last_became_peered":"2023-11-15T02:37:11.520927+0000","last_unstale":"2023-11-15T02:37:11.524918+0000","last_undegraded":"2023-11-15T02:37:11.524918+0000","last_fullsized":"2023-11-15T02:37:11.524918+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"176'3","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535460+0000","last_change":"2023-11-15T02:37:11.130795+0000","last_active":"2023-11-15T02:37:11.535460+0000","last_peered":"2023-11-15T02:37:11.535460+0000","last_clean":"2023-11-15T02:37:11.535460+0000","last_became_active":"2023-11-15T02:37:11.130494+0000","last_became_peered":"2023-11-15T02:37:11.130494+0000","last_unstale":"2023-11-15T02:37:11.535460+0000","last_undegraded":"2023-11-15T02:37:11.535460+0000","last_fullsized":"2023-11-15T02:37:11.535460+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":146,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.516694+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:37:11.516694+0000","last_peered":"2023-11-15T02:37:11.516694+0000","last_clean":"2023-11-15T02:37:11.516694+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:37:11.516694+0000","last_undegraded":"2023-11-15T02:37:11.516694+0000","last_fullsized":"2023-11-15T02:37:11.516694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536132+0000","last_change":"2023-11-15T02:37:11.535066+0000","last_active":"2023-11-15T02:37:11.536132+0000","last_peered":"2023-11-15T02:37:11.536132+0000","last_clean":"2023-11-15T02:37:11.536132+0000","last_became_active":"2023-11-15T02:37:11.534648+0000","last_became_peered":"2023-11-15T02:37:11.534648+0000","last_unstale":"2023-11-15T02:37:11.536132+0000","last_undegraded":"2023-11-15T02:37:11.536132+0000","last_fullsized":"2023-11-15T02:37:11.536132+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.518450+0000","last_change":"2023-11-15T02:37:11.137646+0000","last_active":"2023-11-15T02:37:11.518450+0000","last_peered":"2023-11-15T02:37:11.518450+0000","last_clean":"2023-11-15T02:37:11.518450+0000","last_became_active":"2023-11-15T02:37:11.137307+0000","last_became_peered":"2023-11-15T02:37:11.137307+0000","last_unstale":"2023-11-15T02:37:11.518450+0000","last_undegraded":"2023-11-15T02:37:11.518450+0000","last_fullsized":"2023-11-15T02:37:11.518450+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":155,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.509104+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:37:11.509104+0000","last_peered":"2023-11-15T02:37:11.509104+0000","last_clean":"2023-11-15T02:37:11.509104+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:37:11.509104+0000","last_undegraded":"2023-11-15T02:37:11.509104+0000","last_fullsized":"2023-11-15T02:37:11.509104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526543+0000","last_change":"2023-11-15T02:37:11.524654+0000","last_active":"2023-11-15T02:37:11.526543+0000","last_peered":"2023-11-15T02:37:11.526543+0000","last_clean":"2023-11-15T02:37:11.526543+0000","last_became_active":"2023-11-15T02:37:11.524322+0000","last_became_peered":"2023-11-15T02:37:11.524322+0000","last_unstale":"2023-11-15T02:37:11.526543+0000","last_undegraded":"2023-11-15T02:37:11.526543+0000","last_fullsized":"2023-11-15T02:37:11.526543+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.529462+0000","last_change":"2023-11-15T02:37:11.132331+0000","last_active":"2023-11-15T02:37:11.529462+0000","last_peered":"2023-11-15T02:37:11.529462+0000","last_clean":"2023-11-15T02:37:11.529462+0000","last_became_active":"2023-11-15T02:37:11.131991+0000","last_became_peered":"2023-11-15T02:37:11.131991+0000","last_unstale":"2023-11-15T02:37:11.529462+0000","last_undegraded":"2023-11-15T02:37:11.529462+0000","last_fullsized":"2023-11-15T02:37:11.529462+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":146,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.517104+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:37:11.517104+0000","last_peered":"2023-11-15T02:37:11.517104+0000","last_clean":"2023-11-15T02:37:11.517104+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:37:11.517104+0000","last_undegraded":"2023-11-15T02:37:11.517104+0000","last_fullsized":"2023-11-15T02:37:11.517104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":142,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.523425+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:37:11.523425+0000","last_peered":"2023-11-15T02:37:11.523425+0000","last_clean":"2023-11-15T02:37:11.523425+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:37:11.523425+0000","last_undegraded":"2023-11-15T02:37:11.523425+0000","last_fullsized":"2023-11-15T02:37:11.523425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.531464+0000","last_change":"2023-11-15T02:37:11.529970+0000","last_active":"2023-11-15T02:37:11.531464+0000","last_peered":"2023-11-15T02:37:11.531464+0000","last_clean":"2023-11-15T02:37:11.531464+0000","last_became_active":"2023-11-15T02:37:11.529785+0000","last_became_peered":"2023-11-15T02:37:11.529785+0000","last_unstale":"2023-11-15T02:37:11.531464+0000","last_undegraded":"2023-11-15T02:37:11.531464+0000","last_fullsized":"2023-11-15T02:37:11.531464+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.519017+0000","last_change":"2023-11-15T02:37:11.145012+0000","last_active":"2023-11-15T02:37:11.519017+0000","last_peered":"2023-11-15T02:37:11.519017+0000","last_clean":"2023-11-15T02:37:11.519017+0000","last_became_active":"2023-11-15T02:37:11.144138+0000","last_became_peered":"2023-11-15T02:37:11.144138+0000","last_unstale":"2023-11-15T02:37:11.519017+0000","last_undegraded":"2023-11-15T02:37:11.519017+0000","last_fullsized":"2023-11-15T02:37:11.519017+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":140,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.523484+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:37:11.523484+0000","last_peered":"2023-11-15T02:37:11.523484+0000","last_clean":"2023-11-15T02:37:11.523484+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:37:11.523484+0000","last_undegraded":"2023-11-15T02:37:11.523484+0000","last_fullsized":"2023-11-15T02:37:11.523484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.530895+0000","last_change":"2023-11-15T02:37:11.527609+0000","last_active":"2023-11-15T02:37:11.530895+0000","last_peered":"2023-11-15T02:37:11.530895+0000","last_clean":"2023-11-15T02:37:11.530895+0000","last_became_active":"2023-11-15T02:37:11.527253+0000","last_became_peered":"2023-11-15T02:37:11.527253+0000","last_unstale":"2023-11-15T02:37:11.530895+0000","last_undegraded":"2023-11-15T02:37:11.530895+0000","last_fullsized":"2023-11-15T02:37:11.530895+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512511+0000","last_change":"2023-11-15T02:37:11.132820+0000","last_active":"2023-11-15T02:37:11.512511+0000","last_peered":"2023-11-15T02:37:11.512511+0000","last_clean":"2023-11-15T02:37:11.512511+0000","last_became_active":"2023-11-15T02:37:11.132506+0000","last_became_peered":"2023-11-15T02:37:11.132506+0000","last_unstale":"2023-11-15T02:37:11.512511+0000","last_undegraded":"2023-11-15T02:37:11.512511+0000","last_fullsized":"2023-11-15T02:37:11.512511+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528979+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:37:11.528979+0000","last_peered":"2023-11-15T02:37:11.528979+0000","last_clean":"2023-11-15T02:37:11.528979+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:37:11.528979+0000","last_undegraded":"2023-11-15T02:37:11.528979+0000","last_fullsized":"2023-11-15T02:37:11.528979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.532924+0000","last_change":"2023-11-15T02:37:11.525701+0000","last_active":"2023-11-15T02:37:11.532924+0000","last_peered":"2023-11-15T02:37:11.532924+0000","last_clean":"2023-11-15T02:37:11.532924+0000","last_became_active":"2023-11-15T02:37:11.525421+0000","last_became_peered":"2023-11-15T02:37:11.525421+0000","last_unstale":"2023-11-15T02:37:11.532924+0000","last_undegraded":"2023-11-15T02:37:11.532924+0000","last_fullsized":"2023-11-15T02:37:11.532924+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.511500+0000","last_change":"2023-11-15T02:37:11.136268+0000","last_active":"2023-11-15T02:37:11.511500+0000","last_peered":"2023-11-15T02:37:11.511500+0000","last_clean":"2023-11-15T02:37:11.511500+0000","last_became_active":"2023-11-15T02:37:11.135994+0000","last_became_peered":"2023-11-15T02:37:11.135994+0000","last_unstale":"2023-11-15T02:37:11.511500+0000","last_undegraded":"2023-11-15T02:37:11.511500+0000","last_fullsized":"2023-11-15T02:37:11.511500+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513675+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:37:11.513675+0000","last_peered":"2023-11-15T02:37:11.513675+0000","last_clean":"2023-11-15T02:37:11.513675+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:37:11.513675+0000","last_undegraded":"2023-11-15T02:37:11.513675+0000","last_fullsized":"2023-11-15T02:37:11.513675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536274+0000","last_change":"2023-11-15T02:37:11.533494+0000","last_active":"2023-11-15T02:37:11.536274+0000","last_peered":"2023-11-15T02:37:11.536274+0000","last_clean":"2023-11-15T02:37:11.536274+0000","last_became_active":"2023-11-15T02:37:11.533146+0000","last_became_peered":"2023-11-15T02:37:11.533146+0000","last_unstale":"2023-11-15T02:37:11.536274+0000","last_undegraded":"2023-11-15T02:37:11.536274+0000","last_fullsized":"2023-11-15T02:37:11.536274+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.537265+0000","last_change":"2023-11-15T02:37:11.142673+0000","last_active":"2023-11-15T02:37:11.537265+0000","last_peered":"2023-11-15T02:37:11.537265+0000","last_clean":"2023-11-15T02:37:11.537265+0000","last_became_active":"2023-11-15T02:37:11.142366+0000","last_became_peered":"2023-11-15T02:37:11.142366+0000","last_unstale":"2023-11-15T02:37:11.537265+0000","last_undegraded":"2023-11-15T02:37:11.537265+0000","last_fullsized":"2023-11-15T02:37:11.537265+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.511103+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:37:11.511103+0000","last_peered":"2023-11-15T02:37:11.511103+0000","last_clean":"2023-11-15T02:37:11.511103+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:37:11.511103+0000","last_undegraded":"2023-11-15T02:37:11.511103+0000","last_fullsized":"2023-11-15T02:37:11.511103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575750,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303360,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068480,"statfs":{"total":96636764160,"available":96326123520,"internally_reserved":0,"allocated":2220032,"data_stored":1172309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55400000000000005}]},{"osd":1,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":0.997,"15min":0.997},"last":0.621},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33500000000000002},"max":{"1min":0.74199999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.60899999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":0.80200000000000005,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78000000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.77400000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79600000000000004,"5min":1.101,"15min":1.101},"last":0.58599999999999997}]},{"osd":4,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.33000000000000002,"15min":0.27300000000000002},"max":{"1min":0.68799999999999994,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.44},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.749,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59999999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48899999999999999,"15min":0.5},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.70499999999999996,"5min":0.70599999999999996,"15min":0.78800000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.371,"15min":0.33100000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.82799999999999996},"last":0.52400000000000002}]},{"osd":6,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.54900000000000004},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.31},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.86299999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.29999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.85699999999999998},"last":0.63100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575751,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307444,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064396,"statfs":{"total":96636764160,"available":96321941504,"internally_reserved":0,"allocated":2207744,"data_stored":1170841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68500000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.33700000000000002,"5min":0.317,"15min":0.308},"max":{"1min":0.755,"5min":0.78900000000000003,"15min":0.82899999999999996},"last":0.52400000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32100000000000001},"max":{"1min":0.70399999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.503},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.34300000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.35299999999999998},"max":{"1min":0.746,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46800000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78800000000000003,"15min":0.80700000000000005},"last":0.437},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.38700000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.307,"5min":0.28599999999999998,"15min":0.26100000000000001},"max":{"1min":0.65800000000000003,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.39600000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48499999999999999}]},{"osd":5,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56000000000000005,"15min":0.54700000000000004},"min":{"1min":0.35399999999999998,"5min":0.314,"15min":0.30599999999999999},"max":{"1min":0.74399999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57299999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.502},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.28799999999999998},"max":{"1min":0.66800000000000004,"5min":0.81000000000000005,"15min":0.81699999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.41999999999999998,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.83499999999999996,"5min":0.876,"15min":0.876},"last":0.56100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575752,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307452,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064388,"statfs":{"total":96636764160,"available":96321933312,"internally_reserved":0,"allocated":2215936,"data_stored":1171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.45600000000000002,"5min":0.66000000000000003,"15min":0.66800000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.52500000000000002,"5min":0.64200000000000002,"15min":0.65800000000000003},"last":0.34100000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.26900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.46300000000000002,"5min":0.59799999999999998,"15min":0.63100000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.44400000000000001,"15min":0.45500000000000002},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.27100000000000002},"max":{"1min":0.56599999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.35399999999999998}]},{"osd":3,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.30599999999999999},"max":{"1min":0.61799999999999999,"5min":0.69799999999999995,"15min":0.74299999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.48499999999999999,"15min":0.49199999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55500000000000005,"5min":0.70899999999999996,"15min":0.77100000000000002},"last":0.41599999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":0.89800000000000002,"15min":1.097},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.96499999999999997,"15min":1.014},"last":0.56299999999999994}]},{"osd":5,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":0.89200000000000002,"15min":0.98699999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.95399999999999996,"15min":1.024},"last":0.57999999999999996}]},{"osd":6,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.47899999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.94399999999999995,"15min":0.96799999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88400000000000001,"5min":0.93200000000000005,"15min":1.143},"last":0.65200000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90500000000000003,"5min":0.95799999999999996,"15min":1.111},"last":0.629},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":0.97999999999999998,"15min":1.0129999999999999},"last":0.59199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575750,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307460,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064380,"statfs":{"total":96636764160,"available":96321925120,"internally_reserved":0,"allocated":2224128,"data_stored":1171609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60299999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.42299999999999999},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.57999999999999996,"5min":0.63700000000000001,"15min":0.64200000000000002},"last":0.35999999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39400000000000002,"15min":0.39900000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53600000000000003,"5min":0.60099999999999998,"15min":0.83799999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.72499999999999998},"last":0.31}]},{"osd":3,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.44,"15min":0.44600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.28899999999999998},"max":{"1min":0.58599999999999997,"5min":0.64700000000000002,"15min":0.69799999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.71599999999999997},"last":0.435}]},{"osd":4,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66800000000000004,"15min":0.67600000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.39100000000000001},"max":{"1min":0.92100000000000004,"5min":0.96599999999999997,"15min":1.004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89100000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80500000000000005,"5min":0.88300000000000001,"15min":1.05},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65500000000000003,"15min":0.66500000000000004},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.44900000000000001},"max":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":1.004},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64700000000000002,"15min":0.66300000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.42699999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":1.026},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.68200000000000005},"min":{"1min":0.49199999999999999,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.0309999999999999},"last":0.51800000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69199999999999995,"15min":0.70799999999999996},"min":{"1min":0.53700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85399999999999998,"5min":0.93200000000000005,"15min":1.0600000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.72199999999999998},"min":{"1min":0.53600000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.997,"5min":0.997,"15min":1.0409999999999999},"last":0.749}]}]},{"osd":2,"up_from":13,"seq":55834575751,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311552,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060288,"statfs":{"total":96636764160,"available":96317734912,"internally_reserved":0,"allocated":2220032,"data_stored":1171023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.248,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56499999999999995,"5min":0.69699999999999995,"15min":0.83999999999999997},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.25900000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.63500000000000001,"5min":0.69199999999999995,"15min":0.85899999999999999},"last":0.28599999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39400000000000002,"15min":0.40600000000000003},"min":{"1min":0.28699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.52200000000000002,"5min":0.68999999999999995,"15min":0.91000000000000003},"last":0.316},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45600000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55700000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34300000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.33500000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64800000000000002,"5min":0.755,"15min":0.79800000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":0.65600000000000003,"5min":0.69499999999999995,"15min":1.113},"last":0.35699999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67100000000000004,"15min":0.65500000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.89000000000000001,"5min":1.0069999999999999,"15min":1.2170000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91100000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.74299999999999999}]},{"osd":5,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.41899999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.153},"last":0.755},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69299999999999995,"15min":0.68300000000000005},"min":{"1min":0.497,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.996},"last":0.68400000000000005}]},{"osd":6,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.442},"max":{"1min":0.85699999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.628},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.70599999999999996},"min":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.438},"max":{"1min":0.97299999999999998,"5min":1.079,"15min":1.079},"last":0.69299999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95099999999999996,"5min":1.0940000000000001,"15min":1.7270000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.72199999999999998},"min":{"1min":0.495,"5min":0.46800000000000003,"15min":0.45800000000000002},"max":{"1min":0.90900000000000003,"5min":1.038,"15min":1.038},"last":0.78200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575752,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311544,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060296,"statfs":{"total":96636764160,"available":96317743104,"internally_reserved":0,"allocated":2211840,"data_stored":1170875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.26400000000000001,"5min":0.24099999999999999,"15min":0.222},"max":{"1min":0.55900000000000005,"5min":0.56299999999999994,"15min":0.67700000000000005},"last":0.252},{"interface":"front","average":{"1min":0.378,"5min":0.40699999999999997,"15min":0.41799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.24199999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.67400000000000004},"last":0.28299999999999997}]},{"osd":1,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.40200000000000002,"15min":0.41899999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56899999999999995,"5min":0.622,"15min":0.81399999999999995},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.25800000000000001},"max":{"1min":0.64900000000000002,"5min":0.746,"15min":0.75800000000000001},"last":0.32700000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.71499999999999997,"15min":0.76900000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.497,"15min":0.501},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.75600000000000001},"last":0.36099999999999999}]},{"osd":4,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.432,"5min":0.41899999999999998,"15min":0.40500000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.306},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.75900000000000001}]},{"osd":5,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66500000000000004,"15min":0.68000000000000005},"min":{"1min":0.48099999999999998,"5min":0.42899999999999999,"15min":0.39100000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.46999999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.129},"last":0.71599999999999997}]},{"osd":6,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.496,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.46100000000000002,"15min":0.438},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.69499999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.439},"max":{"1min":1.159,"5min":1.159,"15min":1.256},"last":0.751},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575750,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1171485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.32000000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.80800000000000005},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.67600000000000005,"5min":0.78000000000000003,"15min":1.1919999999999999},"last":0.40799999999999997}]},{"osd":1,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.45400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.42999999999999999,"5min":0.39400000000000002,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.82199999999999995,"15min":1.2},"last":0.77300000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.59899999999999998},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.36599999999999999},"max":{"1min":0.74299999999999999,"5min":0.752,"15min":1.272},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.434,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79800000000000004,"5min":0.81899999999999995,"15min":0.95999999999999996},"last":0.80300000000000005}]},{"osd":3,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.40500000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.3109999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.53400000000000003,"15min":0.48599999999999999},"min":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.30299999999999999},"max":{"1min":4.8230000000000004,"5min":4.8230000000000004,"15min":4.8230000000000004},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.28299999999999997},"max":{"1min":0.71499999999999997,"5min":0.747,"15min":0.79000000000000004},"last":0.45600000000000002}]},{"osd":6,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.56100000000000005,"15min":0.51800000000000002},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.32900000000000001},"max":{"1min":4.8689999999999998,"5min":4.8689999999999998,"15min":4.8689999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.38500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72099999999999997,"5min":0.78800000000000003,"15min":0.85399999999999998},"last":0.874}]},{"osd":7,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.58099999999999996,"15min":0.54400000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":4.4569999999999999,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.36799999999999999},"max":{"1min":0.75,"5min":0.79100000000000004,"15min":0.83299999999999996},"last":0.69599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575750,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307448,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064392,"statfs":{"total":96636764160,"available":96321937408,"internally_reserved":0,"allocated":2211840,"data_stored":1171733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67300000000000004,"5min":0.76900000000000002,"15min":1.1379999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79000000000000004,"5min":0.79500000000000004,"15min":1.0169999999999999},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68899999999999995,"5min":0.84299999999999997,"15min":1.0109999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.55900000000000005,"15min":0.56799999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":1.135},"last":0.53600000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":1.155},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76700000000000002,"5min":0.81999999999999995,"15min":1.0369999999999999},"last":0.64000000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.77800000000000002,"5min":0.79200000000000004,"15min":1.1779999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69899999999999995,"5min":0.79900000000000004,"15min":1.171},"last":0.60799999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45700000000000002,"15min":0.45900000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.72399999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.313},"max":{"1min":0.68799999999999994,"5min":0.77900000000000003,"15min":0.78600000000000003},"last":0.59999999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.317,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.80900000000000005},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.497,"15min":0.498},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64600000000000002,"5min":0.76500000000000001,"15min":0.81899999999999995},"last":0.61899999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.499,"15min":0.495},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63900000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.36299999999999999},"max":{"1min":0.73999999999999999,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:37:16.285 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-15T02:37:16.423 INFO:tasks.ceph.mds.c.smithi001.stderr:2023-11-15T02:37:16.422+0000 7fa636f6c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T02:37:16.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.432+0000 7f579648f700 1 Processor -- start 2023-11-15T02:37:16.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.432+0000 7f579648f700 1 -- start start 2023-11-15T02:37:16.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.433+0000 7f579648f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f579014e940 0x7f5790155510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.433+0000 7f579648f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f57900c8140 0x7f57900c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.433+0000 7f579648f700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5790155080 con 0x7f57900c0af0 2023-11-15T02:37:16.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.433+0000 7f579648f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5790155a00 con 0x7f579014e940 2023-11-15T02:37:16.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.433+0000 7f579648f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57900c1470 con 0x7f57900c8140 2023-11-15T02:37:16.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.433+0000 7f579548d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f579014e940 0x7f5790155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.433+0000 7f579548d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f579014e940 0x7f5790155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38042/0 (socket says 172.21.15.1:38042) 2023-11-15T02:37:16.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.433+0000 7f579548d700 1 -- 172.21.15.1:0/3050271022 learned_addr learned my addr 172.21.15.1:0/3050271022 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:16.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.433+0000 7f5795c8e700 1 --2- 172.21.15.1:0/3050271022 >> v2:172.21.15.141:3300/0 conn(0x7f57900c8140 0x7f57900c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.433+0000 7f579548d700 1 -- 172.21.15.1:0/3050271022 >> v2:172.21.15.141:3300/0 conn(0x7f57900c8140 msgr2=0x7f57900c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:16.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.433+0000 7f579548d700 1 --2- 172.21.15.1:0/3050271022 >> v2:172.21.15.141:3300/0 conn(0x7f57900c8140 0x7f57900c0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.433+0000 7f579548d700 1 -- 172.21.15.1:0/3050271022 >> v1:172.21.15.141:6789/0 conn(0x7f57900c0af0 legacy=0x7f57900c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:16.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.433+0000 7f579548d700 1 -- 172.21.15.1:0/3050271022 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57900c1710 con 0x7f579014e940 2023-11-15T02:37:16.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.434+0000 7f579548d700 1 --2- 172.21.15.1:0/3050271022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f579014e940 0x7f5790155510 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f5780009f70 tx=0x7f5780009840).ready entity=mon.0 client_cookie=8a0257489759ad90 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:16.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.434+0000 7f578ffff700 1 -- 172.21.15.1:0/3050271022 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578000e070 con 0x7f579014e940 2023-11-15T02:37:16.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.434+0000 7f578ffff700 1 -- 172.21.15.1:0/3050271022 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578000ba50 con 0x7f579014e940 2023-11-15T02:37:16.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.434+0000 7f578ffff700 1 -- 172.21.15.1:0/3050271022 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578000bdd0 con 0x7f579014e940 2023-11-15T02:37:16.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.434+0000 7f579648f700 1 -- 172.21.15.1:0/3050271022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f579014e940 msgr2=0x7f5790155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.434+0000 7f579648f700 1 --2- 172.21.15.1:0/3050271022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f579014e940 0x7f5790155510 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f5780009f70 tx=0x7f5780009840).stop 2023-11-15T02:37:16.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.434+0000 7f579648f700 1 -- 172.21.15.1:0/3050271022 shutdown_connections 2023-11-15T02:37:16.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.434+0000 7f579648f700 1 --2- 172.21.15.1:0/3050271022 >> v2:172.21.15.141:3300/0 conn(0x7f57900c8140 0x7f57900c0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.434+0000 7f579648f700 1 --2- 172.21.15.1:0/3050271022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f579014e940 0x7f5790155510 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.434+0000 7f579648f700 1 -- 172.21.15.1:0/3050271022 >> 172.21.15.1:0/3050271022 conn(0x7f5790084ea0 msgr2=0x7f57900947c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:16.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.434+0000 7f579648f700 1 -- 172.21.15.1:0/3050271022 shutdown_connections 2023-11-15T02:37:16.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.434+0000 7f579648f700 1 -- 172.21.15.1:0/3050271022 wait complete. 2023-11-15T02:37:16.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.436+0000 7f579648f700 1 Processor -- start 2023-11-15T02:37:16.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.436+0000 7f579648f700 1 -- start start 2023-11-15T02:37:16.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.436+0000 7f579648f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57900c0af0 0x7f579014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.436+0000 7f579648f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f57900c8140 0x7f5790150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.436+0000 7f579648f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f579014e940 0x7f5790150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f579648f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57901518e0 con 0x7f57900c0af0 2023-11-15T02:37:16.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f579648f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900ac560 con 0x7f579014e940 2023-11-15T02:37:16.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f579648f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5790150fb0 con 0x7f57900c8140 2023-11-15T02:37:16.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f579548d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57900c0af0 0x7f579014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f579548d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57900c0af0 0x7f579014cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38046/0 (socket says 172.21.15.1:38046) 2023-11-15T02:37:16.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f579548d700 1 -- 172.21.15.1:0/581534563 learned_addr learned my addr 172.21.15.1:0/581534563 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:16.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f5795c8e700 1 --2- 172.21.15.1:0/581534563 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f579014e940 0x7f5790150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f5794c8c700 1 --2- 172.21.15.1:0/581534563 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f57900c8140 0x7f5790150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f579548d700 1 -- 172.21.15.1:0/581534563 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f57900c8140 msgr2=0x7f5790150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f579548d700 1 --2- 172.21.15.1:0/581534563 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f57900c8140 0x7f5790150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f579548d700 1 -- 172.21.15.1:0/581534563 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f579014e940 msgr2=0x7f5790150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f579548d700 1 --2- 172.21.15.1:0/581534563 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f579014e940 0x7f5790150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f579548d700 1 -- 172.21.15.1:0/581534563 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780009ae0 con 0x7f57900c0af0 2023-11-15T02:37:16.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f579548d700 1 --2- 172.21.15.1:0/581534563 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57900c0af0 0x7f579014cc40 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f5790062a50 tx=0x7f57900c18a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:16.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f578d7fa700 1 -- 172.21.15.1:0/581534563 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5780013bb0 con 0x7f57900c0af0 2023-11-15T02:37:16.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f578d7fa700 1 -- 172.21.15.1:0/581534563 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5780013d10 con 0x7f57900c0af0 2023-11-15T02:37:16.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f579648f700 1 -- 172.21.15.1:0/581534563 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5790151290 con 0x7f57900c0af0 2023-11-15T02:37:16.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f578d7fa700 1 -- 172.21.15.1:0/581534563 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578001c630 con 0x7f57900c0af0 2023-11-15T02:37:16.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.437+0000 7f579648f700 1 -- 172.21.15.1:0/581534563 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5790150c40 con 0x7f57900c0af0 2023-11-15T02:37:16.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.438+0000 7f579648f700 1 -- 172.21.15.1:0/581534563 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57900475e0 con 0x7f57900c0af0 2023-11-15T02:37:16.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.439+0000 7f578d7fa700 1 -- 172.21.15.1:0/581534563 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f578001ca20 con 0x7f57900c0af0 2023-11-15T02:37:16.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.439+0000 7f578d7fa700 1 --2- 172.21.15.1:0/581534563 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f577c05f270 0x7f577c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.439+0000 7f578d7fa700 1 -- 172.21.15.1:0/581534563 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f578007bef0 con 0x7f57900c0af0 2023-11-15T02:37:16.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.439+0000 7f5794c8c700 1 --2- 172.21.15.1:0/581534563 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f577c05f270 0x7f577c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.440+0000 7f5794c8c700 1 --2- 172.21.15.1:0/581534563 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f577c05f270 0x7f577c061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f57900ad140 tx=0x7f5784009040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:16.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.443+0000 7f578d7fa700 1 -- 172.21.15.1:0/581534563 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f578004ce50 con 0x7f57900c0af0 2023-11-15T02:37:16.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.688+0000 7f579648f700 1 -- 172.21.15.1:0/581534563 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f57900475e0 con 0x7f57900c0af0 2023-11-15T02:37:16.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.688+0000 7f578d7fa700 1 -- 172.21.15.1:0/581534563 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3152 (secure 0 0 0) 0x7f5780050470 con 0x7f57900c0af0 2023-11-15T02:37:16.691 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:37:16.691 INFO:teuthology.orchestra.run.smithi001.stdout:{"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":4557,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":177,"num_osds":8,"num_up_osds":8,"osd_up_since":1700011287,"num_in_osds":8,"osd_in_since":1700011281,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":2518646784,"bytes_avail":770575466496,"bytes_total":773094113280},"fsmap":{"epoch":79,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9060}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-11-15T02:36:59.079803+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-15T02:37:16.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.690+0000 7f579648f700 1 -- 172.21.15.1:0/581534563 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f577c05f270 msgr2=0x7f577c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.690+0000 7f579648f700 1 --2- 172.21.15.1:0/581534563 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f577c05f270 0x7f577c061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f57900ad140 tx=0x7f5784009040).stop 2023-11-15T02:37:16.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.690+0000 7f579648f700 1 -- 172.21.15.1:0/581534563 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57900c0af0 msgr2=0x7f579014cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.690+0000 7f579648f700 1 --2- 172.21.15.1:0/581534563 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57900c0af0 0x7f579014cc40 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f5790062a50 tx=0x7f57900c18a0).stop 2023-11-15T02:37:16.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.690+0000 7f579648f700 1 -- 172.21.15.1:0/581534563 shutdown_connections 2023-11-15T02:37:16.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.690+0000 7f579648f700 1 --2- 172.21.15.1:0/581534563 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f577c05f270 0x7f577c061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.690+0000 7f579648f700 1 --2- 172.21.15.1:0/581534563 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f579014e940 0x7f5790150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.690+0000 7f579648f700 1 --2- 172.21.15.1:0/581534563 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57900c0af0 0x7f579014cc40 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.690+0000 7f579648f700 1 --2- 172.21.15.1:0/581534563 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f57900c8140 0x7f5790150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.690+0000 7f579648f700 1 -- 172.21.15.1:0/581534563 >> 172.21.15.1:0/581534563 conn(0x7f5790084ea0 msgr2=0x7f57901531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:16.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.691+0000 7f579648f700 1 -- 172.21.15.1:0/581534563 shutdown_connections 2023-11-15T02:37:16.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.691+0000 7f579648f700 1 -- 172.21.15.1:0/581534563 wait complete. 2023-11-15T02:37:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-15T02:37:16.705 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:37:16.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.821+0000 7f8ccbbeb700 1 Processor -- start 2023-11-15T02:37:16.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.821+0000 7f8ccbbeb700 1 -- start start 2023-11-15T02:37:16.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.822+0000 7f8ccbbeb700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8cc4154150 0x7f8cc4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.822+0000 7f8ccbbeb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8cc40aa060 0x7f8cc40c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.822+0000 7f8ccbbeb700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc40c06f0 con 0x7f8cc40ab1a0 2023-11-15T02:37:16.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.822+0000 7f8ccbbeb700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc40c09d0 con 0x7f8cc4154150 2023-11-15T02:37:16.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.822+0000 7f8ccbbeb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4158820 con 0x7f8cc40aa060 2023-11-15T02:37:16.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.822+0000 7f8cc9186700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8cc40ab1a0 0x7f8cc4158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58718/0 (socket says 172.21.15.1:58718) 2023-11-15T02:37:16.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.822+0000 7f8cc9186700 1 -- 172.21.15.1:0/2341450801 learned_addr learned my addr 172.21.15.1:0/2341450801 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:16.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc9987700 1 --2- 172.21.15.1:0/2341450801 >> v2:172.21.15.141:3300/0 conn(0x7f8cc4154150 0x7f8cc4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cca188700 1 --2- 172.21.15.1:0/2341450801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8cc40aa060 0x7f8cc40c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 -- 172.21.15.1:0/2341450801 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799374530 0 0) 0x7f8cc40c06f0 con 0x7f8cc40ab1a0 2023-11-15T02:37:16.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 -- 172.21.15.1:0/2341450801 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cac0033f0 con 0x7f8cc40ab1a0 2023-11-15T02:37:16.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 -- 172.21.15.1:0/2341450801 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1764084948 0 0) 0x7f8cac0033f0 con 0x7f8cc40ab1a0 2023-11-15T02:37:16.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 -- 172.21.15.1:0/2341450801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8cc40aa060 msgr2=0x7f8cc40c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:16.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 --2- 172.21.15.1:0/2341450801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8cc40aa060 0x7f8cc40c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 -- 172.21.15.1:0/2341450801 >> v2:172.21.15.141:3300/0 conn(0x7f8cc4154150 msgr2=0x7f8cc4154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:16.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 --2- 172.21.15.1:0/2341450801 >> v2:172.21.15.141:3300/0 conn(0x7f8cc4154150 0x7f8cc4154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 -- 172.21.15.1:0/2341450801 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc4158b00 con 0x7f8cc40ab1a0 2023-11-15T02:37:16.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 -- 172.21.15.1:0/2341450801 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f8cb8001470 con 0x7f8cc40ab1a0 2023-11-15T02:37:16.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 -- 172.21.15.1:0/2341450801 >> v1:172.21.15.1:6789/0 conn(0x7f8cc40ab1a0 legacy=0x7f8cc4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 --2- 172.21.15.1:0/2341450801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8cc40aa060 0x7f8cac0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 --2- 172.21.15.1:0/2341450801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cac003e10 0x7f8cac004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 --2- 172.21.15.1:0/2341450801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cac004b80 0x7f8cac005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 -- 172.21.15.1:0/2341450801 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40c09d0 con 0x7f8cac003e10 2023-11-15T02:37:16.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 -- 172.21.15.1:0/2341450801 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4158820 con 0x7f8cac004b80 2023-11-15T02:37:16.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc8985700 1 -- 172.21.15.1:0/2341450801 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac00b8e0 con 0x7f8cc40aa060 2023-11-15T02:37:16.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc9186700 1 --2- 172.21.15.1:0/2341450801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cac003e10 0x7f8cac004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cc9987700 1 --2- 172.21.15.1:0/2341450801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8cc40aa060 0x7f8cac0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.823+0000 7f8cca188700 1 --2- 172.21.15.1:0/2341450801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cac004b80 0x7f8cac005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8cc9186700 1 -- 172.21.15.1:0/2341450801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8cc40aa060 msgr2=0x7f8cac0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:16.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8cc9186700 1 --2- 172.21.15.1:0/2341450801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8cc40aa060 0x7f8cac0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8cc9186700 1 -- 172.21.15.1:0/2341450801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cac004b80 msgr2=0x7f8cac005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:16.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8cc9186700 1 --2- 172.21.15.1:0/2341450801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cac004b80 0x7f8cac005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8cc9186700 1 -- 172.21.15.1:0/2341450801 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0033f0 con 0x7f8cac003e10 2023-11-15T02:37:16.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8cc9987700 1 --2- 172.21.15.1:0/2341450801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8cc40aa060 0x7f8cac0038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:37:16.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8cc9186700 1 --2- 172.21.15.1:0/2341450801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cac003e10 0x7f8cac004690 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f8cb800c240 tx=0x7f8cb8001e90).ready entity=mon.0 client_cookie=fe6207bb324f05c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:16.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8cc8985700 1 -- 172.21.15.1:0/2341450801 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8007a60 con 0x7f8cac003e10 2023-11-15T02:37:16.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8cc8985700 1 -- 172.21.15.1:0/2341450801 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb800cad0 con 0x7f8cac003e10 2023-11-15T02:37:16.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8cc8985700 1 -- 172.21.15.1:0/2341450801 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb800ce50 con 0x7f8cac003e10 2023-11-15T02:37:16.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8ccbbeb700 1 -- 172.21.15.1:0/2341450801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cac003e10 msgr2=0x7f8cac004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8ccbbeb700 1 --2- 172.21.15.1:0/2341450801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cac003e10 0x7f8cac004690 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f8cb800c240 tx=0x7f8cb8001e90).stop 2023-11-15T02:37:16.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8cca188700 1 -- 172.21.15.1:0/2341450801 reap_dead start 2023-11-15T02:37:16.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8ccbbeb700 1 -- 172.21.15.1:0/2341450801 shutdown_connections 2023-11-15T02:37:16.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8ccbbeb700 1 -- 172.21.15.1:0/2341450801 >> 172.21.15.1:0/2341450801 conn(0x7f8cc4064aa0 msgr2=0x7f8cc4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:16.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8ccbbeb700 1 -- 172.21.15.1:0/2341450801 shutdown_connections 2023-11-15T02:37:16.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.824+0000 7f8ccbbeb700 1 -- 172.21.15.1:0/2341450801 wait complete. 2023-11-15T02:37:16.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.826+0000 7f8ccbbeb700 1 Processor -- start 2023-11-15T02:37:16.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.826+0000 7f8ccbbeb700 1 -- start start 2023-11-15T02:37:16.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.826+0000 7f8ccbbeb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8cac003e10 0x7f8cc413b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.826+0000 7f8ccbbeb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc40c4a00 0x7f8cc40c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.826+0000 7f8ccbbeb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cc40c75e0 0x7f8cc40c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.826+0000 7f8ccbbeb700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40c54a0 con 0x7f8cc40c4a00 2023-11-15T02:37:16.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.826+0000 7f8ccbbeb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40c7f50 con 0x7f8cc40c75e0 2023-11-15T02:37:16.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.826+0000 7f8ccbbeb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40ae8c0 con 0x7f8cac003e10 2023-11-15T02:37:16.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.826+0000 7f8cc9186700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc40c4a00 0x7f8cc40c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.826+0000 7f8cc9186700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc40c4a00 0x7f8cc40c4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38066/0 (socket says 172.21.15.1:38066) 2023-11-15T02:37:16.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.826+0000 7f8cc9186700 1 -- 172.21.15.1:0/1704612884 learned_addr learned my addr 172.21.15.1:0/1704612884 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:16.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.827+0000 7f8cc9186700 1 -- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8cac003e10 msgr2=0x7f8cc413b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.827+0000 7f8cc9987700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8cac003e10 0x7f8cc413b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.827+0000 7f8cca188700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cc40c75e0 0x7f8cc40c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.827+0000 7f8cc9186700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8cac003e10 0x7f8cc413b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.827+0000 7f8cc9186700 1 -- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cc40c75e0 msgr2=0x7f8cc40c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:16.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.827+0000 7f8cc9186700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cc40c75e0 0x7f8cc40c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:16.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.827+0000 7f8cc9186700 1 -- 172.21.15.1:0/1704612884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc40aeba0 con 0x7f8cc40c4a00 2023-11-15T02:37:16.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.827+0000 7f8cc9987700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8cac003e10 0x7f8cc413b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:16.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.827+0000 7f8cca188700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cc40c75e0 0x7f8cc40c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:16.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.827+0000 7f8cc9186700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc40c4a00 0x7f8cc40c4e80 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f8cb800c830 tx=0x7f8cb8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:16.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.827+0000 7f8cc1ffb700 1 -- 172.21.15.1:0/1704612884 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8007640 con 0x7f8cc40c4a00 2023-11-15T02:37:16.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.827+0000 7f8cc1ffb700 1 -- 172.21.15.1:0/1704612884 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb80046b0 con 0x7f8cc40c4a00 2023-11-15T02:37:16.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.827+0000 7f8ccbbeb700 1 -- 172.21.15.1:0/1704612884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc40aee80 con 0x7f8cc40c4a00 2023-11-15T02:37:16.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.827+0000 7f8cc1ffb700 1 -- 172.21.15.1:0/1704612884 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8004a70 con 0x7f8cc40c4a00 2023-11-15T02:37:16.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.827+0000 7f8ccbbeb700 1 -- 172.21.15.1:0/1704612884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc40c2300 con 0x7f8cc40c4a00 2023-11-15T02:37:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.828+0000 7f8ccbbeb700 1 -- 172.21.15.1:0/1704612884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc40af4d0 con 0x7f8cc40c4a00 2023-11-15T02:37:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.828+0000 7f8cc1ffb700 1 -- 172.21.15.1:0/1704612884 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8cb8020450 con 0x7f8cc40c4a00 2023-11-15T02:37:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.829+0000 7f8cc1ffb700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8cb005f270 0x7f8cb0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.829+0000 7f8cc1ffb700 1 -- 172.21.15.1:0/1704612884 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f8cb807b860 con 0x7f8cc40c4a00 2023-11-15T02:37:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.829+0000 7f8cc9987700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8cb005f270 0x7f8cb0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.829+0000 7f8cc9987700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8cb005f270 0x7f8cb0061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f8cbc0099f0 tx=0x7f8cbc00b040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:16.833+0000 7f8cc1ffb700 1 -- 172.21.15.1:0/1704612884 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8cb804c760 con 0x7f8cc40c4a00 2023-11-15T02:37:17.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:17.003+0000 7f8ccbbeb700 1 -- 172.21.15.1:0/1704612884 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8cc406c7e0 con 0x7f8cb005f270 2023-11-15T02:37:17.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:17.016+0000 7f8cc1ffb700 1 -- 172.21.15.1:0/1704612884 <== mgr.8110 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362000 (secure 0 0 0) 0x7f8cc406c7e0 con 0x7f8cb005f270 2023-11-15T02:37:17.023 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:37:17.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:17.019+0000 7f8ccbbeb700 1 -- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8cb005f270 msgr2=0x7f8cb0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:17.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:17.019+0000 7f8ccbbeb700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8cb005f270 0x7f8cb0061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f8cbc0099f0 tx=0x7f8cbc00b040).stop 2023-11-15T02:37:17.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:17.019+0000 7f8ccbbeb700 1 -- 172.21.15.1:0/1704612884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc40c4a00 msgr2=0x7f8cc40c4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:17.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:17.019+0000 7f8ccbbeb700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc40c4a00 0x7f8cc40c4e80 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f8cb800c830 tx=0x7f8cb8015000).stop 2023-11-15T02:37:17.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:17.020+0000 7f8ccbbeb700 1 -- 172.21.15.1:0/1704612884 shutdown_connections 2023-11-15T02:37:17.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:17.020+0000 7f8ccbbeb700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f8cb005f270 0x7f8cb0061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:17.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:17.020+0000 7f8ccbbeb700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8cc40c75e0 0x7f8cc40c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:17.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:17.020+0000 7f8ccbbeb700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8cac003e10 0x7f8cc413b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:17.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:17.020+0000 7f8ccbbeb700 1 --2- 172.21.15.1:0/1704612884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc40c4a00 0x7f8cc40c4e80 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:17.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:17.020+0000 7f8ccbbeb700 1 -- 172.21.15.1:0/1704612884 >> 172.21.15.1:0/1704612884 conn(0x7f8cc4064aa0 msgr2=0x7f8cc414d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:17.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:17.020+0000 7f8ccbbeb700 1 -- 172.21.15.1:0/1704612884 shutdown_connections 2023-11-15T02:37:17.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:17.020+0000 7f8ccbbeb700 1 -- 172.21.15.1:0/1704612884 wait complete. 2023-11-15T02:37:17.030 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:37:17.034 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T02:37:16.077199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2459616,"kb_used_data":17312,"kb_used_omap":0,"kb_used_meta":2442240,"kb_avail":752515104,"statfs":{"total":773094113280,"available":770575466496,"internally_reserved":0,"allocated":17727488,"data_stored":9371340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2500853760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12017,"num_objects":-11,"num_object_clones":0,"num_object_copies":-22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-37,"num_write_kb":-28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.002148"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.525965+0000","last_change":"2023-11-15T02:37:11.523042+0000","last_active":"2023-11-15T02:37:11.525965+0000","last_peered":"2023-11-15T02:37:11.525965+0000","last_clean":"2023-11-15T02:37:11.525965+0000","last_became_active":"2023-11-15T02:37:11.522722+0000","last_became_peered":"2023-11-15T02:37:11.522722+0000","last_unstale":"2023-11-15T02:37:11.525965+0000","last_undegraded":"2023-11-15T02:37:11.525965+0000","last_fullsized":"2023-11-15T02:37:11.525965+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"176'3","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534737+0000","last_change":"2023-11-15T02:37:11.142538+0000","last_active":"2023-11-15T02:37:11.534737+0000","last_peered":"2023-11-15T02:37:11.534737+0000","last_clean":"2023-11-15T02:37:11.534737+0000","last_became_active":"2023-11-15T02:37:11.142134+0000","last_became_peered":"2023-11-15T02:37:11.142134+0000","last_unstale":"2023-11-15T02:37:11.534737+0000","last_undegraded":"2023-11-15T02:37:11.534737+0000","last_fullsized":"2023-11-15T02:37:11.534737+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536585+0000","last_change":"2023-11-15T02:37:11.534444+0000","last_active":"2023-11-15T02:37:11.536585+0000","last_peered":"2023-11-15T02:37:11.536585+0000","last_clean":"2023-11-15T02:37:11.536585+0000","last_became_active":"2023-11-15T02:37:11.534171+0000","last_became_peered":"2023-11-15T02:37:11.534171+0000","last_unstale":"2023-11-15T02:37:11.536585+0000","last_undegraded":"2023-11-15T02:37:11.536585+0000","last_fullsized":"2023-11-15T02:37:11.536585+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.519894+0000","last_change":"2023-11-15T02:37:11.130593+0000","last_active":"2023-11-15T02:37:11.519894+0000","last_peered":"2023-11-15T02:37:11.519894+0000","last_clean":"2023-11-15T02:37:11.519894+0000","last_became_active":"2023-11-15T02:37:11.130310+0000","last_became_peered":"2023-11-15T02:37:11.130310+0000","last_unstale":"2023-11-15T02:37:11.519894+0000","last_undegraded":"2023-11-15T02:37:11.519894+0000","last_fullsized":"2023-11-15T02:37:11.519894+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.530599+0000","last_change":"2023-11-15T02:37:11.527684+0000","last_active":"2023-11-15T02:37:11.530599+0000","last_peered":"2023-11-15T02:37:11.530599+0000","last_clean":"2023-11-15T02:37:11.530599+0000","last_became_active":"2023-11-15T02:37:11.527423+0000","last_became_peered":"2023-11-15T02:37:11.527423+0000","last_unstale":"2023-11-15T02:37:11.530599+0000","last_undegraded":"2023-11-15T02:37:11.530599+0000","last_fullsized":"2023-11-15T02:37:11.530599+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.511815+0000","last_change":"2023-11-15T02:37:11.134804+0000","last_active":"2023-11-15T02:37:11.511815+0000","last_peered":"2023-11-15T02:37:11.511815+0000","last_clean":"2023-11-15T02:37:11.511815+0000","last_became_active":"2023-11-15T02:37:11.134447+0000","last_became_peered":"2023-11-15T02:37:11.134447+0000","last_unstale":"2023-11-15T02:37:11.511815+0000","last_undegraded":"2023-11-15T02:37:11.511815+0000","last_fullsized":"2023-11-15T02:37:11.511815+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528360+0000","last_change":"2023-11-15T02:37:11.522004+0000","last_active":"2023-11-15T02:37:11.528360+0000","last_peered":"2023-11-15T02:37:11.528360+0000","last_clean":"2023-11-15T02:37:11.528360+0000","last_became_active":"2023-11-15T02:37:11.521683+0000","last_became_peered":"2023-11-15T02:37:11.521683+0000","last_unstale":"2023-11-15T02:37:11.528360+0000","last_undegraded":"2023-11-15T02:37:11.528360+0000","last_fullsized":"2023-11-15T02:37:11.528360+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526446+0000","last_change":"2023-11-15T02:37:11.134204+0000","last_active":"2023-11-15T02:37:11.526446+0000","last_peered":"2023-11-15T02:37:11.526446+0000","last_clean":"2023-11-15T02:37:11.526446+0000","last_became_active":"2023-11-15T02:37:11.133597+0000","last_became_peered":"2023-11-15T02:37:11.133597+0000","last_unstale":"2023-11-15T02:37:11.526446+0000","last_undegraded":"2023-11-15T02:37:11.526446+0000","last_fullsized":"2023-11-15T02:37:11.526446+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.529851+0000","last_change":"2023-11-15T02:37:11.527099+0000","last_active":"2023-11-15T02:37:11.529851+0000","last_peered":"2023-11-15T02:37:11.529851+0000","last_clean":"2023-11-15T02:37:11.529851+0000","last_became_active":"2023-11-15T02:37:11.526802+0000","last_became_peered":"2023-11-15T02:37:11.526802+0000","last_unstale":"2023-11-15T02:37:11.529851+0000","last_undegraded":"2023-11-15T02:37:11.529851+0000","last_fullsized":"2023-11-15T02:37:11.529851+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535140+0000","last_change":"2023-11-15T02:37:11.136474+0000","last_active":"2023-11-15T02:37:11.535140+0000","last_peered":"2023-11-15T02:37:11.535140+0000","last_clean":"2023-11-15T02:37:11.535140+0000","last_became_active":"2023-11-15T02:37:11.135966+0000","last_became_peered":"2023-11-15T02:37:11.135966+0000","last_unstale":"2023-11-15T02:37:11.535140+0000","last_undegraded":"2023-11-15T02:37:11.535140+0000","last_fullsized":"2023-11-15T02:37:11.535140+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535001+0000","last_change":"2023-11-15T02:37:11.533006+0000","last_active":"2023-11-15T02:37:11.535001+0000","last_peered":"2023-11-15T02:37:11.535001+0000","last_clean":"2023-11-15T02:37:11.535001+0000","last_became_active":"2023-11-15T02:37:11.531957+0000","last_became_peered":"2023-11-15T02:37:11.531957+0000","last_unstale":"2023-11-15T02:37:11.535001+0000","last_undegraded":"2023-11-15T02:37:11.535001+0000","last_fullsized":"2023-11-15T02:37:11.535001+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.527349+0000","last_change":"2023-11-15T02:37:11.134579+0000","last_active":"2023-11-15T02:37:11.527349+0000","last_peered":"2023-11-15T02:37:11.527349+0000","last_clean":"2023-11-15T02:37:11.527349+0000","last_became_active":"2023-11-15T02:37:11.134246+0000","last_became_peered":"2023-11-15T02:37:11.134246+0000","last_unstale":"2023-11-15T02:37:11.527349+0000","last_undegraded":"2023-11-15T02:37:11.527349+0000","last_fullsized":"2023-11-15T02:37:11.527349+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.532195+0000","last_change":"2023-11-15T02:37:11.522330+0000","last_active":"2023-11-15T02:37:11.532195+0000","last_peered":"2023-11-15T02:37:11.532195+0000","last_clean":"2023-11-15T02:37:11.532195+0000","last_became_active":"2023-11-15T02:37:11.522087+0000","last_became_peered":"2023-11-15T02:37:11.522087+0000","last_unstale":"2023-11-15T02:37:11.532195+0000","last_undegraded":"2023-11-15T02:37:11.532195+0000","last_fullsized":"2023-11-15T02:37:11.532195+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512060+0000","last_change":"2023-11-15T02:37:11.129365+0000","last_active":"2023-11-15T02:37:11.512060+0000","last_peered":"2023-11-15T02:37:11.512060+0000","last_clean":"2023-11-15T02:37:11.512060+0000","last_became_active":"2023-11-15T02:37:11.128680+0000","last_became_peered":"2023-11-15T02:37:11.128680+0000","last_unstale":"2023-11-15T02:37:11.512060+0000","last_undegraded":"2023-11-15T02:37:11.512060+0000","last_fullsized":"2023-11-15T02:37:11.512060+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534138+0000","last_change":"2023-11-15T02:37:11.532558+0000","last_active":"2023-11-15T02:37:11.534138+0000","last_peered":"2023-11-15T02:37:11.534138+0000","last_clean":"2023-11-15T02:37:11.534138+0000","last_became_active":"2023-11-15T02:37:11.532227+0000","last_became_peered":"2023-11-15T02:37:11.532227+0000","last_unstale":"2023-11-15T02:37:11.534138+0000","last_undegraded":"2023-11-15T02:37:11.534138+0000","last_fullsized":"2023-11-15T02:37:11.534138+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.511676+0000","last_change":"2023-11-15T02:37:11.138579+0000","last_active":"2023-11-15T02:37:11.511676+0000","last_peered":"2023-11-15T02:37:11.511676+0000","last_clean":"2023-11-15T02:37:11.511676+0000","last_became_active":"2023-11-15T02:37:11.138283+0000","last_became_peered":"2023-11-15T02:37:11.138283+0000","last_unstale":"2023-11-15T02:37:11.511676+0000","last_undegraded":"2023-11-15T02:37:11.511676+0000","last_fullsized":"2023-11-15T02:37:11.511676+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526806+0000","last_change":"2023-11-15T02:37:11.523782+0000","last_active":"2023-11-15T02:37:11.526806+0000","last_peered":"2023-11-15T02:37:11.526806+0000","last_clean":"2023-11-15T02:37:11.526806+0000","last_became_active":"2023-11-15T02:37:11.523313+0000","last_became_peered":"2023-11-15T02:37:11.523313+0000","last_unstale":"2023-11-15T02:37:11.526806+0000","last_undegraded":"2023-11-15T02:37:11.526806+0000","last_fullsized":"2023-11-15T02:37:11.526806+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.520621+0000","last_change":"2023-11-15T02:37:11.136706+0000","last_active":"2023-11-15T02:37:11.520621+0000","last_peered":"2023-11-15T02:37:11.520621+0000","last_clean":"2023-11-15T02:37:11.520621+0000","last_became_active":"2023-11-15T02:37:11.136365+0000","last_became_peered":"2023-11-15T02:37:11.136365+0000","last_unstale":"2023-11-15T02:37:11.520621+0000","last_undegraded":"2023-11-15T02:37:11.520621+0000","last_fullsized":"2023-11-15T02:37:11.520621+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536120+0000","last_change":"2023-11-15T02:37:11.534908+0000","last_active":"2023-11-15T02:37:11.536120+0000","last_peered":"2023-11-15T02:37:11.536120+0000","last_clean":"2023-11-15T02:37:11.536120+0000","last_became_active":"2023-11-15T02:37:11.534296+0000","last_became_peered":"2023-11-15T02:37:11.534296+0000","last_unstale":"2023-11-15T02:37:11.536120+0000","last_undegraded":"2023-11-15T02:37:11.536120+0000","last_fullsized":"2023-11-15T02:37:11.536120+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.517981+0000","last_change":"2023-11-15T02:37:11.142063+0000","last_active":"2023-11-15T02:37:11.517981+0000","last_peered":"2023-11-15T02:37:11.517981+0000","last_clean":"2023-11-15T02:37:11.517981+0000","last_became_active":"2023-11-15T02:37:11.141752+0000","last_became_peered":"2023-11-15T02:37:11.141752+0000","last_unstale":"2023-11-15T02:37:11.517981+0000","last_undegraded":"2023-11-15T02:37:11.517981+0000","last_fullsized":"2023-11-15T02:37:11.517981+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.532742+0000","last_change":"2023-11-15T02:37:11.525977+0000","last_active":"2023-11-15T02:37:11.532742+0000","last_peered":"2023-11-15T02:37:11.532742+0000","last_clean":"2023-11-15T02:37:11.532742+0000","last_became_active":"2023-11-15T02:37:11.525610+0000","last_became_peered":"2023-11-15T02:37:11.525610+0000","last_unstale":"2023-11-15T02:37:11.532742+0000","last_undegraded":"2023-11-15T02:37:11.532742+0000","last_fullsized":"2023-11-15T02:37:11.532742+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514259+0000","last_change":"2023-11-15T02:37:11.138297+0000","last_active":"2023-11-15T02:37:11.514259+0000","last_peered":"2023-11-15T02:37:11.514259+0000","last_clean":"2023-11-15T02:37:11.514259+0000","last_became_active":"2023-11-15T02:37:11.137977+0000","last_became_peered":"2023-11-15T02:37:11.137977+0000","last_unstale":"2023-11-15T02:37:11.514259+0000","last_undegraded":"2023-11-15T02:37:11.514259+0000","last_fullsized":"2023-11-15T02:37:11.514259+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534096+0000","last_change":"2023-11-15T02:37:11.532839+0000","last_active":"2023-11-15T02:37:11.534096+0000","last_peered":"2023-11-15T02:37:11.534096+0000","last_clean":"2023-11-15T02:37:11.534096+0000","last_became_active":"2023-11-15T02:37:11.532575+0000","last_became_peered":"2023-11-15T02:37:11.532575+0000","last_unstale":"2023-11-15T02:37:11.534096+0000","last_undegraded":"2023-11-15T02:37:11.534096+0000","last_fullsized":"2023-11-15T02:37:11.534096+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.539052+0000","last_change":"2023-11-15T02:37:11.142218+0000","last_active":"2023-11-15T02:37:11.539052+0000","last_peered":"2023-11-15T02:37:11.539052+0000","last_clean":"2023-11-15T02:37:11.539052+0000","last_became_active":"2023-11-15T02:37:11.141926+0000","last_became_peered":"2023-11-15T02:37:11.141926+0000","last_unstale":"2023-11-15T02:37:11.539052+0000","last_undegraded":"2023-11-15T02:37:11.539052+0000","last_fullsized":"2023-11-15T02:37:11.539052+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533648+0000","last_change":"2023-11-15T02:37:11.528785+0000","last_active":"2023-11-15T02:37:11.533648+0000","last_peered":"2023-11-15T02:37:11.533648+0000","last_clean":"2023-11-15T02:37:11.533648+0000","last_became_active":"2023-11-15T02:37:11.528476+0000","last_became_peered":"2023-11-15T02:37:11.528476+0000","last_unstale":"2023-11-15T02:37:11.533648+0000","last_undegraded":"2023-11-15T02:37:11.533648+0000","last_fullsized":"2023-11-15T02:37:11.533648+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535039+0000","last_change":"2023-11-15T02:37:11.136220+0000","last_active":"2023-11-15T02:37:11.535039+0000","last_peered":"2023-11-15T02:37:11.535039+0000","last_clean":"2023-11-15T02:37:11.535039+0000","last_became_active":"2023-11-15T02:37:11.135610+0000","last_became_peered":"2023-11-15T02:37:11.135610+0000","last_unstale":"2023-11-15T02:37:11.535039+0000","last_undegraded":"2023-11-15T02:37:11.535039+0000","last_fullsized":"2023-11-15T02:37:11.535039+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.530918+0000","last_change":"2023-11-15T02:37:11.527794+0000","last_active":"2023-11-15T02:37:11.530918+0000","last_peered":"2023-11-15T02:37:11.530918+0000","last_clean":"2023-11-15T02:37:11.530918+0000","last_became_active":"2023-11-15T02:37:11.527527+0000","last_became_peered":"2023-11-15T02:37:11.527527+0000","last_unstale":"2023-11-15T02:37:11.530918+0000","last_undegraded":"2023-11-15T02:37:11.530918+0000","last_fullsized":"2023-11-15T02:37:11.530918+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513230+0000","last_change":"2023-11-15T02:37:11.135916+0000","last_active":"2023-11-15T02:37:11.513230+0000","last_peered":"2023-11-15T02:37:11.513230+0000","last_clean":"2023-11-15T02:37:11.513230+0000","last_became_active":"2023-11-15T02:37:11.135590+0000","last_became_peered":"2023-11-15T02:37:11.135590+0000","last_unstale":"2023-11-15T02:37:11.513230+0000","last_undegraded":"2023-11-15T02:37:11.513230+0000","last_fullsized":"2023-11-15T02:37:11.513230+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534550+0000","last_change":"2023-11-15T02:37:11.532197+0000","last_active":"2023-11-15T02:37:11.534550+0000","last_peered":"2023-11-15T02:37:11.534550+0000","last_clean":"2023-11-15T02:37:11.534550+0000","last_became_active":"2023-11-15T02:37:11.531860+0000","last_became_peered":"2023-11-15T02:37:11.531860+0000","last_unstale":"2023-11-15T02:37:11.534550+0000","last_undegraded":"2023-11-15T02:37:11.534550+0000","last_fullsized":"2023-11-15T02:37:11.534550+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.521034+0000","last_change":"2023-11-15T02:37:11.142090+0000","last_active":"2023-11-15T02:37:11.521034+0000","last_peered":"2023-11-15T02:37:11.521034+0000","last_clean":"2023-11-15T02:37:11.521034+0000","last_became_active":"2023-11-15T02:37:11.141803+0000","last_became_peered":"2023-11-15T02:37:11.141803+0000","last_unstale":"2023-11-15T02:37:11.521034+0000","last_undegraded":"2023-11-15T02:37:11.521034+0000","last_fullsized":"2023-11-15T02:37:11.521034+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534210+0000","last_change":"2023-11-15T02:37:11.532532+0000","last_active":"2023-11-15T02:37:11.534210+0000","last_peered":"2023-11-15T02:37:11.534210+0000","last_clean":"2023-11-15T02:37:11.534210+0000","last_became_active":"2023-11-15T02:37:11.532199+0000","last_became_peered":"2023-11-15T02:37:11.532199+0000","last_unstale":"2023-11-15T02:37:11.534210+0000","last_undegraded":"2023-11-15T02:37:11.534210+0000","last_fullsized":"2023-11-15T02:37:11.534210+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528961+0000","last_change":"2023-11-15T02:37:11.136371+0000","last_active":"2023-11-15T02:37:11.528961+0000","last_peered":"2023-11-15T02:37:11.528961+0000","last_clean":"2023-11-15T02:37:11.528961+0000","last_became_active":"2023-11-15T02:37:11.136083+0000","last_became_peered":"2023-11-15T02:37:11.136083+0000","last_unstale":"2023-11-15T02:37:11.528961+0000","last_undegraded":"2023-11-15T02:37:11.528961+0000","last_fullsized":"2023-11-15T02:37:11.528961+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534844+0000","last_change":"2023-11-15T02:37:11.526164+0000","last_active":"2023-11-15T02:37:11.534844+0000","last_peered":"2023-11-15T02:37:11.534844+0000","last_clean":"2023-11-15T02:37:11.534844+0000","last_became_active":"2023-11-15T02:37:11.525902+0000","last_became_peered":"2023-11-15T02:37:11.525902+0000","last_unstale":"2023-11-15T02:37:11.534844+0000","last_undegraded":"2023-11-15T02:37:11.534844+0000","last_fullsized":"2023-11-15T02:37:11.534844+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.517994+0000","last_change":"2023-11-15T02:37:11.144956+0000","last_active":"2023-11-15T02:37:11.517994+0000","last_peered":"2023-11-15T02:37:11.517994+0000","last_clean":"2023-11-15T02:37:11.517994+0000","last_became_active":"2023-11-15T02:37:11.143804+0000","last_became_peered":"2023-11-15T02:37:11.143804+0000","last_unstale":"2023-11-15T02:37:11.517994+0000","last_undegraded":"2023-11-15T02:37:11.517994+0000","last_fullsized":"2023-11-15T02:37:11.517994+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535716+0000","last_change":"2023-11-15T02:37:11.533485+0000","last_active":"2023-11-15T02:37:11.535716+0000","last_peered":"2023-11-15T02:37:11.535716+0000","last_clean":"2023-11-15T02:37:11.535716+0000","last_became_active":"2023-11-15T02:37:11.533046+0000","last_became_peered":"2023-11-15T02:37:11.533046+0000","last_unstale":"2023-11-15T02:37:11.535716+0000","last_undegraded":"2023-11-15T02:37:11.535716+0000","last_fullsized":"2023-11-15T02:37:11.535716+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510921+0000","last_change":"2023-11-15T02:37:11.138410+0000","last_active":"2023-11-15T02:37:11.510921+0000","last_peered":"2023-11-15T02:37:11.510921+0000","last_clean":"2023-11-15T02:37:11.510921+0000","last_became_active":"2023-11-15T02:37:11.138131+0000","last_became_peered":"2023-11-15T02:37:11.138131+0000","last_unstale":"2023-11-15T02:37:11.510921+0000","last_undegraded":"2023-11-15T02:37:11.510921+0000","last_fullsized":"2023-11-15T02:37:11.510921+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524936+0000","last_change":"2023-11-15T02:37:11.521807+0000","last_active":"2023-11-15T02:37:11.524936+0000","last_peered":"2023-11-15T02:37:11.524936+0000","last_clean":"2023-11-15T02:37:11.524936+0000","last_became_active":"2023-11-15T02:37:11.521312+0000","last_became_peered":"2023-11-15T02:37:11.521312+0000","last_unstale":"2023-11-15T02:37:11.524936+0000","last_undegraded":"2023-11-15T02:37:11.524936+0000","last_fullsized":"2023-11-15T02:37:11.524936+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526411+0000","last_change":"2023-11-15T02:37:11.137674+0000","last_active":"2023-11-15T02:37:11.526411+0000","last_peered":"2023-11-15T02:37:11.526411+0000","last_clean":"2023-11-15T02:37:11.526411+0000","last_became_active":"2023-11-15T02:37:11.136376+0000","last_became_peered":"2023-11-15T02:37:11.136376+0000","last_unstale":"2023-11-15T02:37:11.526411+0000","last_undegraded":"2023-11-15T02:37:11.526411+0000","last_fullsized":"2023-11-15T02:37:11.526411+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.525888+0000","last_change":"2023-11-15T02:37:11.520614+0000","last_active":"2023-11-15T02:37:11.525888+0000","last_peered":"2023-11-15T02:37:11.525888+0000","last_clean":"2023-11-15T02:37:11.525888+0000","last_became_active":"2023-11-15T02:37:11.520282+0000","last_became_peered":"2023-11-15T02:37:11.520282+0000","last_unstale":"2023-11-15T02:37:11.525888+0000","last_undegraded":"2023-11-15T02:37:11.525888+0000","last_fullsized":"2023-11-15T02:37:11.525888+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510123+0000","last_change":"2023-11-15T02:37:11.136684+0000","last_active":"2023-11-15T02:37:11.510123+0000","last_peered":"2023-11-15T02:37:11.510123+0000","last_clean":"2023-11-15T02:37:11.510123+0000","last_became_active":"2023-11-15T02:37:11.135923+0000","last_became_peered":"2023-11-15T02:37:11.135923+0000","last_unstale":"2023-11-15T02:37:11.510123+0000","last_undegraded":"2023-11-15T02:37:11.510123+0000","last_fullsized":"2023-11-15T02:37:11.510123+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533629+0000","last_change":"2023-11-15T02:37:11.533016+0000","last_active":"2023-11-15T02:37:11.533629+0000","last_peered":"2023-11-15T02:37:11.533629+0000","last_clean":"2023-11-15T02:37:11.533629+0000","last_became_active":"2023-11-15T02:37:11.532722+0000","last_became_peered":"2023-11-15T02:37:11.532722+0000","last_unstale":"2023-11-15T02:37:11.533629+0000","last_undegraded":"2023-11-15T02:37:11.533629+0000","last_fullsized":"2023-11-15T02:37:11.533629+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.531510+0000","last_change":"2023-11-15T02:37:11.144826+0000","last_active":"2023-11-15T02:37:11.531510+0000","last_peered":"2023-11-15T02:37:11.531510+0000","last_clean":"2023-11-15T02:37:11.531510+0000","last_became_active":"2023-11-15T02:37:11.144233+0000","last_became_peered":"2023-11-15T02:37:11.144233+0000","last_unstale":"2023-11-15T02:37:11.531510+0000","last_undegraded":"2023-11-15T02:37:11.531510+0000","last_fullsized":"2023-11-15T02:37:11.531510+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524044+0000","last_change":"2023-11-15T02:37:11.521563+0000","last_active":"2023-11-15T02:37:11.524044+0000","last_peered":"2023-11-15T02:37:11.524044+0000","last_clean":"2023-11-15T02:37:11.524044+0000","last_became_active":"2023-11-15T02:37:11.521253+0000","last_became_peered":"2023-11-15T02:37:11.521253+0000","last_unstale":"2023-11-15T02:37:11.524044+0000","last_undegraded":"2023-11-15T02:37:11.524044+0000","last_fullsized":"2023-11-15T02:37:11.524044+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513350+0000","last_change":"2023-11-15T02:37:11.138606+0000","last_active":"2023-11-15T02:37:11.513350+0000","last_peered":"2023-11-15T02:37:11.513350+0000","last_clean":"2023-11-15T02:37:11.513350+0000","last_became_active":"2023-11-15T02:37:11.138304+0000","last_became_peered":"2023-11-15T02:37:11.138304+0000","last_unstale":"2023-11-15T02:37:11.513350+0000","last_undegraded":"2023-11-15T02:37:11.513350+0000","last_fullsized":"2023-11-15T02:37:11.513350+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533878+0000","last_change":"2023-11-15T02:37:11.532201+0000","last_active":"2023-11-15T02:37:11.533878+0000","last_peered":"2023-11-15T02:37:11.533878+0000","last_clean":"2023-11-15T02:37:11.533878+0000","last_became_active":"2023-11-15T02:37:11.531882+0000","last_became_peered":"2023-11-15T02:37:11.531882+0000","last_unstale":"2023-11-15T02:37:11.533878+0000","last_undegraded":"2023-11-15T02:37:11.533878+0000","last_fullsized":"2023-11-15T02:37:11.533878+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513376+0000","last_change":"2023-11-15T02:37:11.131935+0000","last_active":"2023-11-15T02:37:11.513376+0000","last_peered":"2023-11-15T02:37:11.513376+0000","last_clean":"2023-11-15T02:37:11.513376+0000","last_became_active":"2023-11-15T02:37:11.131648+0000","last_became_peered":"2023-11-15T02:37:11.131648+0000","last_unstale":"2023-11-15T02:37:11.513376+0000","last_undegraded":"2023-11-15T02:37:11.513376+0000","last_fullsized":"2023-11-15T02:37:11.513376+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534119+0000","last_change":"2023-11-15T02:37:11.531957+0000","last_active":"2023-11-15T02:37:11.534119+0000","last_peered":"2023-11-15T02:37:11.534119+0000","last_clean":"2023-11-15T02:37:11.534119+0000","last_became_active":"2023-11-15T02:37:11.531708+0000","last_became_peered":"2023-11-15T02:37:11.531708+0000","last_unstale":"2023-11-15T02:37:11.534119+0000","last_undegraded":"2023-11-15T02:37:11.534119+0000","last_fullsized":"2023-11-15T02:37:11.534119+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.522736+0000","last_change":"2023-11-15T02:37:11.144563+0000","last_active":"2023-11-15T02:37:11.522736+0000","last_peered":"2023-11-15T02:37:11.522736+0000","last_clean":"2023-11-15T02:37:11.522736+0000","last_became_active":"2023-11-15T02:37:11.144211+0000","last_became_peered":"2023-11-15T02:37:11.144211+0000","last_unstale":"2023-11-15T02:37:11.522736+0000","last_undegraded":"2023-11-15T02:37:11.522736+0000","last_fullsized":"2023-11-15T02:37:11.522736+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524601+0000","last_change":"2023-11-15T02:37:11.520452+0000","last_active":"2023-11-15T02:37:11.524601+0000","last_peered":"2023-11-15T02:37:11.524601+0000","last_clean":"2023-11-15T02:37:11.524601+0000","last_became_active":"2023-11-15T02:37:11.520186+0000","last_became_peered":"2023-11-15T02:37:11.520186+0000","last_unstale":"2023-11-15T02:37:11.524601+0000","last_undegraded":"2023-11-15T02:37:11.524601+0000","last_fullsized":"2023-11-15T02:37:11.524601+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510527+0000","last_change":"2023-11-15T02:37:11.132982+0000","last_active":"2023-11-15T02:37:11.510527+0000","last_peered":"2023-11-15T02:37:11.510527+0000","last_clean":"2023-11-15T02:37:11.510527+0000","last_became_active":"2023-11-15T02:37:11.132658+0000","last_became_peered":"2023-11-15T02:37:11.132658+0000","last_unstale":"2023-11-15T02:37:11.510527+0000","last_undegraded":"2023-11-15T02:37:11.510527+0000","last_fullsized":"2023-11-15T02:37:11.510527+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534072+0000","last_change":"2023-11-15T02:37:11.532754+0000","last_active":"2023-11-15T02:37:11.534072+0000","last_peered":"2023-11-15T02:37:11.534072+0000","last_clean":"2023-11-15T02:37:11.534072+0000","last_became_active":"2023-11-15T02:37:11.532482+0000","last_became_peered":"2023-11-15T02:37:11.532482+0000","last_unstale":"2023-11-15T02:37:11.534072+0000","last_undegraded":"2023-11-15T02:37:11.534072+0000","last_fullsized":"2023-11-15T02:37:11.534072+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513593+0000","last_change":"2023-11-15T02:37:11.137869+0000","last_active":"2023-11-15T02:37:11.513593+0000","last_peered":"2023-11-15T02:37:11.513593+0000","last_clean":"2023-11-15T02:37:11.513593+0000","last_became_active":"2023-11-15T02:37:11.137555+0000","last_became_peered":"2023-11-15T02:37:11.137555+0000","last_unstale":"2023-11-15T02:37:11.513593+0000","last_undegraded":"2023-11-15T02:37:11.513593+0000","last_fullsized":"2023-11-15T02:37:11.513593+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528578+0000","last_change":"2023-11-15T02:37:11.525346+0000","last_active":"2023-11-15T02:37:11.528578+0000","last_peered":"2023-11-15T02:37:11.528578+0000","last_clean":"2023-11-15T02:37:11.528578+0000","last_became_active":"2023-11-15T02:37:11.525079+0000","last_became_peered":"2023-11-15T02:37:11.525079+0000","last_unstale":"2023-11-15T02:37:11.528578+0000","last_undegraded":"2023-11-15T02:37:11.528578+0000","last_fullsized":"2023-11-15T02:37:11.528578+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510715+0000","last_change":"2023-11-15T02:37:11.133547+0000","last_active":"2023-11-15T02:37:11.510715+0000","last_peered":"2023-11-15T02:37:11.510715+0000","last_clean":"2023-11-15T02:37:11.510715+0000","last_became_active":"2023-11-15T02:37:11.133276+0000","last_became_peered":"2023-11-15T02:37:11.133276+0000","last_unstale":"2023-11-15T02:37:11.510715+0000","last_undegraded":"2023-11-15T02:37:11.510715+0000","last_fullsized":"2023-11-15T02:37:11.510715+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.522175+0000","last_change":"2023-11-15T02:37:11.520512+0000","last_active":"2023-11-15T02:37:11.522175+0000","last_peered":"2023-11-15T02:37:11.522175+0000","last_clean":"2023-11-15T02:37:11.522175+0000","last_became_active":"2023-11-15T02:37:11.520227+0000","last_became_peered":"2023-11-15T02:37:11.520227+0000","last_unstale":"2023-11-15T02:37:11.522175+0000","last_undegraded":"2023-11-15T02:37:11.522175+0000","last_fullsized":"2023-11-15T02:37:11.522175+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514923+0000","last_change":"2023-11-15T02:37:11.127060+0000","last_active":"2023-11-15T02:37:11.514923+0000","last_peered":"2023-11-15T02:37:11.514923+0000","last_clean":"2023-11-15T02:37:11.514923+0000","last_became_active":"2023-11-15T02:37:11.126765+0000","last_became_peered":"2023-11-15T02:37:11.126765+0000","last_unstale":"2023-11-15T02:37:11.514923+0000","last_undegraded":"2023-11-15T02:37:11.514923+0000","last_fullsized":"2023-11-15T02:37:11.514923+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.529831+0000","last_change":"2023-11-15T02:37:11.527043+0000","last_active":"2023-11-15T02:37:11.529831+0000","last_peered":"2023-11-15T02:37:11.529831+0000","last_clean":"2023-11-15T02:37:11.529831+0000","last_became_active":"2023-11-15T02:37:11.526062+0000","last_became_peered":"2023-11-15T02:37:11.526062+0000","last_unstale":"2023-11-15T02:37:11.529831+0000","last_undegraded":"2023-11-15T02:37:11.529831+0000","last_fullsized":"2023-11-15T02:37:11.529831+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512158+0000","last_change":"2023-11-15T02:37:11.135020+0000","last_active":"2023-11-15T02:37:11.512158+0000","last_peered":"2023-11-15T02:37:11.512158+0000","last_clean":"2023-11-15T02:37:11.512158+0000","last_became_active":"2023-11-15T02:37:11.134736+0000","last_became_peered":"2023-11-15T02:37:11.134736+0000","last_unstale":"2023-11-15T02:37:11.512158+0000","last_undegraded":"2023-11-15T02:37:11.512158+0000","last_fullsized":"2023-11-15T02:37:11.512158+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533074+0000","last_change":"2023-11-15T02:37:11.526058+0000","last_active":"2023-11-15T02:37:11.533074+0000","last_peered":"2023-11-15T02:37:11.533074+0000","last_clean":"2023-11-15T02:37:11.533074+0000","last_became_active":"2023-11-15T02:37:11.525787+0000","last_became_peered":"2023-11-15T02:37:11.525787+0000","last_unstale":"2023-11-15T02:37:11.533074+0000","last_undegraded":"2023-11-15T02:37:11.533074+0000","last_fullsized":"2023-11-15T02:37:11.533074+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513463+0000","last_change":"2023-11-15T02:37:11.142039+0000","last_active":"2023-11-15T02:37:11.513463+0000","last_peered":"2023-11-15T02:37:11.513463+0000","last_clean":"2023-11-15T02:37:11.513463+0000","last_became_active":"2023-11-15T02:37:11.138870+0000","last_became_peered":"2023-11-15T02:37:11.138870+0000","last_unstale":"2023-11-15T02:37:11.513463+0000","last_undegraded":"2023-11-15T02:37:11.513463+0000","last_fullsized":"2023-11-15T02:37:11.513463+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524311+0000","last_change":"2023-11-15T02:37:11.516462+0000","last_active":"2023-11-15T02:37:11.524311+0000","last_peered":"2023-11-15T02:37:11.524311+0000","last_clean":"2023-11-15T02:37:11.524311+0000","last_became_active":"2023-11-15T02:37:11.516173+0000","last_became_peered":"2023-11-15T02:37:11.516173+0000","last_unstale":"2023-11-15T02:37:11.524311+0000","last_undegraded":"2023-11-15T02:37:11.524311+0000","last_fullsized":"2023-11-15T02:37:11.524311+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.516846+0000","last_change":"2023-11-15T02:37:11.131463+0000","last_active":"2023-11-15T02:37:11.516846+0000","last_peered":"2023-11-15T02:37:11.516846+0000","last_clean":"2023-11-15T02:37:11.516846+0000","last_became_active":"2023-11-15T02:37:11.131169+0000","last_became_peered":"2023-11-15T02:37:11.131169+0000","last_unstale":"2023-11-15T02:37:11.516846+0000","last_undegraded":"2023-11-15T02:37:11.516846+0000","last_fullsized":"2023-11-15T02:37:11.516846+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535324+0000","last_change":"2023-11-15T02:37:11.533241+0000","last_active":"2023-11-15T02:37:11.535324+0000","last_peered":"2023-11-15T02:37:11.535324+0000","last_clean":"2023-11-15T02:37:11.535324+0000","last_became_active":"2023-11-15T02:37:11.532946+0000","last_became_peered":"2023-11-15T02:37:11.532946+0000","last_unstale":"2023-11-15T02:37:11.535324+0000","last_undegraded":"2023-11-15T02:37:11.535324+0000","last_fullsized":"2023-11-15T02:37:11.535324+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.508592+0000","last_change":"2023-11-15T02:37:11.135042+0000","last_active":"2023-11-15T02:37:11.508592+0000","last_peered":"2023-11-15T02:37:11.508592+0000","last_clean":"2023-11-15T02:37:11.508592+0000","last_became_active":"2023-11-15T02:37:11.134750+0000","last_became_peered":"2023-11-15T02:37:11.134750+0000","last_unstale":"2023-11-15T02:37:11.508592+0000","last_undegraded":"2023-11-15T02:37:11.508592+0000","last_fullsized":"2023-11-15T02:37:11.508592+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534117+0000","last_change":"2023-11-15T02:37:11.531934+0000","last_active":"2023-11-15T02:37:11.534117+0000","last_peered":"2023-11-15T02:37:11.534117+0000","last_clean":"2023-11-15T02:37:11.534117+0000","last_became_active":"2023-11-15T02:37:11.531488+0000","last_became_peered":"2023-11-15T02:37:11.531488+0000","last_unstale":"2023-11-15T02:37:11.534117+0000","last_undegraded":"2023-11-15T02:37:11.534117+0000","last_fullsized":"2023-11-15T02:37:11.534117+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.531593+0000","last_change":"2023-11-15T02:37:11.131225+0000","last_active":"2023-11-15T02:37:11.531593+0000","last_peered":"2023-11-15T02:37:11.531593+0000","last_clean":"2023-11-15T02:37:11.531593+0000","last_became_active":"2023-11-15T02:37:11.130952+0000","last_became_peered":"2023-11-15T02:37:11.130952+0000","last_unstale":"2023-11-15T02:37:11.531593+0000","last_undegraded":"2023-11-15T02:37:11.531593+0000","last_fullsized":"2023-11-15T02:37:11.531593+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.531108+0000","last_change":"2023-11-15T02:37:11.529835+0000","last_active":"2023-11-15T02:37:11.531108+0000","last_peered":"2023-11-15T02:37:11.531108+0000","last_clean":"2023-11-15T02:37:11.531108+0000","last_became_active":"2023-11-15T02:37:11.529617+0000","last_became_peered":"2023-11-15T02:37:11.529617+0000","last_unstale":"2023-11-15T02:37:11.531108+0000","last_undegraded":"2023-11-15T02:37:11.531108+0000","last_fullsized":"2023-11-15T02:37:11.531108+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536892+0000","last_change":"2023-11-15T02:37:11.145324+0000","last_active":"2023-11-15T02:37:11.536892+0000","last_peered":"2023-11-15T02:37:11.536892+0000","last_clean":"2023-11-15T02:37:11.536892+0000","last_became_active":"2023-11-15T02:37:11.144842+0000","last_became_peered":"2023-11-15T02:37:11.144842+0000","last_unstale":"2023-11-15T02:37:11.536892+0000","last_undegraded":"2023-11-15T02:37:11.536892+0000","last_fullsized":"2023-11-15T02:37:11.536892+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.519519+0000","last_change":"2023-11-15T02:37:11.518532+0000","last_active":"2023-11-15T02:37:11.519519+0000","last_peered":"2023-11-15T02:37:11.519519+0000","last_clean":"2023-11-15T02:37:11.519519+0000","last_became_active":"2023-11-15T02:37:11.518235+0000","last_became_peered":"2023-11-15T02:37:11.518235+0000","last_unstale":"2023-11-15T02:37:11.519519+0000","last_undegraded":"2023-11-15T02:37:11.519519+0000","last_fullsized":"2023-11-15T02:37:11.519519+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.537111+0000","last_change":"2023-11-15T02:37:11.146378+0000","last_active":"2023-11-15T02:37:11.537111+0000","last_peered":"2023-11-15T02:37:11.537111+0000","last_clean":"2023-11-15T02:37:11.537111+0000","last_became_active":"2023-11-15T02:37:11.146096+0000","last_became_peered":"2023-11-15T02:37:11.146096+0000","last_unstale":"2023-11-15T02:37:11.537111+0000","last_undegraded":"2023-11-15T02:37:11.537111+0000","last_fullsized":"2023-11-15T02:37:11.537111+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.537964+0000","last_change":"2023-11-15T02:37:11.537305+0000","last_active":"2023-11-15T02:37:11.537964+0000","last_peered":"2023-11-15T02:37:11.537964+0000","last_clean":"2023-11-15T02:37:11.537964+0000","last_became_active":"2023-11-15T02:37:11.537004+0000","last_became_peered":"2023-11-15T02:37:11.537004+0000","last_unstale":"2023-11-15T02:37:11.537964+0000","last_undegraded":"2023-11-15T02:37:11.537964+0000","last_fullsized":"2023-11-15T02:37:11.537964+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512534+0000","last_change":"2023-11-15T02:37:11.139083+0000","last_active":"2023-11-15T02:37:11.512534+0000","last_peered":"2023-11-15T02:37:11.512534+0000","last_clean":"2023-11-15T02:37:11.512534+0000","last_became_active":"2023-11-15T02:37:11.138796+0000","last_became_peered":"2023-11-15T02:37:11.138796+0000","last_unstale":"2023-11-15T02:37:11.512534+0000","last_undegraded":"2023-11-15T02:37:11.512534+0000","last_fullsized":"2023-11-15T02:37:11.512534+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535745+0000","last_change":"2023-11-15T02:37:11.530506+0000","last_active":"2023-11-15T02:37:11.535745+0000","last_peered":"2023-11-15T02:37:11.535745+0000","last_clean":"2023-11-15T02:37:11.535745+0000","last_became_active":"2023-11-15T02:37:11.530121+0000","last_became_peered":"2023-11-15T02:37:11.530121+0000","last_unstale":"2023-11-15T02:37:11.535745+0000","last_undegraded":"2023-11-15T02:37:11.535745+0000","last_fullsized":"2023-11-15T02:37:11.535745+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513258+0000","last_change":"2023-11-15T02:37:11.133202+0000","last_active":"2023-11-15T02:37:11.513258+0000","last_peered":"2023-11-15T02:37:11.513258+0000","last_clean":"2023-11-15T02:37:11.513258+0000","last_became_active":"2023-11-15T02:37:11.132905+0000","last_became_peered":"2023-11-15T02:37:11.132905+0000","last_unstale":"2023-11-15T02:37:11.513258+0000","last_undegraded":"2023-11-15T02:37:11.513258+0000","last_fullsized":"2023-11-15T02:37:11.513258+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526983+0000","last_change":"2023-11-15T02:37:11.523616+0000","last_active":"2023-11-15T02:37:11.526983+0000","last_peered":"2023-11-15T02:37:11.526983+0000","last_clean":"2023-11-15T02:37:11.526983+0000","last_became_active":"2023-11-15T02:37:11.523194+0000","last_became_peered":"2023-11-15T02:37:11.523194+0000","last_unstale":"2023-11-15T02:37:11.526983+0000","last_undegraded":"2023-11-15T02:37:11.526983+0000","last_fullsized":"2023-11-15T02:37:11.526983+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.518581+0000","last_change":"2023-11-15T02:37:11.129805+0000","last_active":"2023-11-15T02:37:11.518581+0000","last_peered":"2023-11-15T02:37:11.518581+0000","last_clean":"2023-11-15T02:37:11.518581+0000","last_became_active":"2023-11-15T02:37:11.129553+0000","last_became_peered":"2023-11-15T02:37:11.129553+0000","last_unstale":"2023-11-15T02:37:11.518581+0000","last_undegraded":"2023-11-15T02:37:11.518581+0000","last_fullsized":"2023-11-15T02:37:11.518581+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.523127+0000","last_change":"2023-11-15T02:37:11.522333+0000","last_active":"2023-11-15T02:37:11.523127+0000","last_peered":"2023-11-15T02:37:11.523127+0000","last_clean":"2023-11-15T02:37:11.523127+0000","last_became_active":"2023-11-15T02:37:11.522063+0000","last_became_peered":"2023-11-15T02:37:11.522063+0000","last_unstale":"2023-11-15T02:37:11.523127+0000","last_undegraded":"2023-11-15T02:37:11.523127+0000","last_fullsized":"2023-11-15T02:37:11.523127+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.517303+0000","last_change":"2023-11-15T02:37:11.140912+0000","last_active":"2023-11-15T02:37:11.517303+0000","last_peered":"2023-11-15T02:37:11.517303+0000","last_clean":"2023-11-15T02:37:11.517303+0000","last_became_active":"2023-11-15T02:37:11.140606+0000","last_became_peered":"2023-11-15T02:37:11.140606+0000","last_unstale":"2023-11-15T02:37:11.517303+0000","last_undegraded":"2023-11-15T02:37:11.517303+0000","last_fullsized":"2023-11-15T02:37:11.517303+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526732+0000","last_change":"2023-11-15T02:37:11.521507+0000","last_active":"2023-11-15T02:37:11.526732+0000","last_peered":"2023-11-15T02:37:11.526732+0000","last_clean":"2023-11-15T02:37:11.526732+0000","last_became_active":"2023-11-15T02:37:11.521206+0000","last_became_peered":"2023-11-15T02:37:11.521206+0000","last_unstale":"2023-11-15T02:37:11.526732+0000","last_undegraded":"2023-11-15T02:37:11.526732+0000","last_fullsized":"2023-11-15T02:37:11.526732+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.520647+0000","last_change":"2023-11-15T02:37:11.131674+0000","last_active":"2023-11-15T02:37:11.520647+0000","last_peered":"2023-11-15T02:37:11.520647+0000","last_clean":"2023-11-15T02:37:11.520647+0000","last_became_active":"2023-11-15T02:37:11.131350+0000","last_became_peered":"2023-11-15T02:37:11.131350+0000","last_unstale":"2023-11-15T02:37:11.520647+0000","last_undegraded":"2023-11-15T02:37:11.520647+0000","last_fullsized":"2023-11-15T02:37:11.520647+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536488+0000","last_change":"2023-11-15T02:37:11.534702+0000","last_active":"2023-11-15T02:37:11.536488+0000","last_peered":"2023-11-15T02:37:11.536488+0000","last_clean":"2023-11-15T02:37:11.536488+0000","last_became_active":"2023-11-15T02:37:11.534388+0000","last_became_peered":"2023-11-15T02:37:11.534388+0000","last_unstale":"2023-11-15T02:37:11.536488+0000","last_undegraded":"2023-11-15T02:37:11.536488+0000","last_fullsized":"2023-11-15T02:37:11.536488+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533909+0000","last_change":"2023-11-15T02:37:11.142894+0000","last_active":"2023-11-15T02:37:11.533909+0000","last_peered":"2023-11-15T02:37:11.533909+0000","last_clean":"2023-11-15T02:37:11.533909+0000","last_became_active":"2023-11-15T02:37:11.142437+0000","last_became_peered":"2023-11-15T02:37:11.142437+0000","last_unstale":"2023-11-15T02:37:11.533909+0000","last_undegraded":"2023-11-15T02:37:11.533909+0000","last_fullsized":"2023-11-15T02:37:11.533909+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535692+0000","last_change":"2023-11-15T02:37:11.533321+0000","last_active":"2023-11-15T02:37:11.535692+0000","last_peered":"2023-11-15T02:37:11.535692+0000","last_clean":"2023-11-15T02:37:11.535692+0000","last_became_active":"2023-11-15T02:37:11.532667+0000","last_became_peered":"2023-11-15T02:37:11.532667+0000","last_unstale":"2023-11-15T02:37:11.535692+0000","last_undegraded":"2023-11-15T02:37:11.535692+0000","last_fullsized":"2023-11-15T02:37:11.535692+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536254+0000","last_change":"2023-11-15T02:37:11.144931+0000","last_active":"2023-11-15T02:37:11.536254+0000","last_peered":"2023-11-15T02:37:11.536254+0000","last_clean":"2023-11-15T02:37:11.536254+0000","last_became_active":"2023-11-15T02:37:11.144570+0000","last_became_peered":"2023-11-15T02:37:11.144570+0000","last_unstale":"2023-11-15T02:37:11.536254+0000","last_undegraded":"2023-11-15T02:37:11.536254+0000","last_fullsized":"2023-11-15T02:37:11.536254+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528891+0000","last_change":"2023-11-15T02:37:11.526949+0000","last_active":"2023-11-15T02:37:11.528891+0000","last_peered":"2023-11-15T02:37:11.528891+0000","last_clean":"2023-11-15T02:37:11.528891+0000","last_became_active":"2023-11-15T02:37:11.526662+0000","last_became_peered":"2023-11-15T02:37:11.526662+0000","last_unstale":"2023-11-15T02:37:11.528891+0000","last_undegraded":"2023-11-15T02:37:11.528891+0000","last_fullsized":"2023-11-15T02:37:11.528891+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514456+0000","last_change":"2023-11-15T02:37:11.133572+0000","last_active":"2023-11-15T02:37:11.514456+0000","last_peered":"2023-11-15T02:37:11.514456+0000","last_clean":"2023-11-15T02:37:11.514456+0000","last_became_active":"2023-11-15T02:37:11.133210+0000","last_became_peered":"2023-11-15T02:37:11.133210+0000","last_unstale":"2023-11-15T02:37:11.514456+0000","last_undegraded":"2023-11-15T02:37:11.514456+0000","last_fullsized":"2023-11-15T02:37:11.514456+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528637+0000","last_change":"2023-11-15T02:37:11.526321+0000","last_active":"2023-11-15T02:37:11.528637+0000","last_peered":"2023-11-15T02:37:11.528637+0000","last_clean":"2023-11-15T02:37:11.528637+0000","last_became_active":"2023-11-15T02:37:11.526038+0000","last_became_peered":"2023-11-15T02:37:11.526038+0000","last_unstale":"2023-11-15T02:37:11.528637+0000","last_undegraded":"2023-11-15T02:37:11.528637+0000","last_fullsized":"2023-11-15T02:37:11.528637+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512409+0000","last_change":"2023-11-15T02:37:11.132885+0000","last_active":"2023-11-15T02:37:11.512409+0000","last_peered":"2023-11-15T02:37:11.512409+0000","last_clean":"2023-11-15T02:37:11.512409+0000","last_became_active":"2023-11-15T02:37:11.132493+0000","last_became_peered":"2023-11-15T02:37:11.132493+0000","last_unstale":"2023-11-15T02:37:11.512409+0000","last_undegraded":"2023-11-15T02:37:11.512409+0000","last_fullsized":"2023-11-15T02:37:11.512409+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535940+0000","last_change":"2023-11-15T02:37:11.533007+0000","last_active":"2023-11-15T02:37:11.535940+0000","last_peered":"2023-11-15T02:37:11.535940+0000","last_clean":"2023-11-15T02:37:11.535940+0000","last_became_active":"2023-11-15T02:37:11.532711+0000","last_became_peered":"2023-11-15T02:37:11.532711+0000","last_unstale":"2023-11-15T02:37:11.535940+0000","last_undegraded":"2023-11-15T02:37:11.535940+0000","last_fullsized":"2023-11-15T02:37:11.535940+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.519877+0000","last_change":"2023-11-15T02:37:11.132042+0000","last_active":"2023-11-15T02:37:11.519877+0000","last_peered":"2023-11-15T02:37:11.519877+0000","last_clean":"2023-11-15T02:37:11.519877+0000","last_became_active":"2023-11-15T02:37:11.131721+0000","last_became_peered":"2023-11-15T02:37:11.131721+0000","last_unstale":"2023-11-15T02:37:11.519877+0000","last_undegraded":"2023-11-15T02:37:11.519877+0000","last_fullsized":"2023-11-15T02:37:11.519877+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524036+0000","last_change":"2023-11-15T02:37:11.522744+0000","last_active":"2023-11-15T02:37:11.524036+0000","last_peered":"2023-11-15T02:37:11.524036+0000","last_clean":"2023-11-15T02:37:11.524036+0000","last_became_active":"2023-11-15T02:37:11.522359+0000","last_became_peered":"2023-11-15T02:37:11.522359+0000","last_unstale":"2023-11-15T02:37:11.524036+0000","last_undegraded":"2023-11-15T02:37:11.524036+0000","last_fullsized":"2023-11-15T02:37:11.524036+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513564+0000","last_change":"2023-11-15T02:37:11.139252+0000","last_active":"2023-11-15T02:37:11.513564+0000","last_peered":"2023-11-15T02:37:11.513564+0000","last_clean":"2023-11-15T02:37:11.513564+0000","last_became_active":"2023-11-15T02:37:11.138855+0000","last_became_peered":"2023-11-15T02:37:11.138855+0000","last_unstale":"2023-11-15T02:37:11.513564+0000","last_undegraded":"2023-11-15T02:37:11.513564+0000","last_fullsized":"2023-11-15T02:37:11.513564+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535771+0000","last_change":"2023-11-15T02:37:11.533811+0000","last_active":"2023-11-15T02:37:11.535771+0000","last_peered":"2023-11-15T02:37:11.535771+0000","last_clean":"2023-11-15T02:37:11.535771+0000","last_became_active":"2023-11-15T02:37:11.533437+0000","last_became_peered":"2023-11-15T02:37:11.533437+0000","last_unstale":"2023-11-15T02:37:11.535771+0000","last_undegraded":"2023-11-15T02:37:11.535771+0000","last_fullsized":"2023-11-15T02:37:11.535771+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512133+0000","last_change":"2023-11-15T02:37:11.129579+0000","last_active":"2023-11-15T02:37:11.512133+0000","last_peered":"2023-11-15T02:37:11.512133+0000","last_clean":"2023-11-15T02:37:11.512133+0000","last_became_active":"2023-11-15T02:37:11.129102+0000","last_became_peered":"2023-11-15T02:37:11.129102+0000","last_unstale":"2023-11-15T02:37:11.512133+0000","last_undegraded":"2023-11-15T02:37:11.512133+0000","last_fullsized":"2023-11-15T02:37:11.512133+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.522568+0000","last_change":"2023-11-15T02:37:11.517937+0000","last_active":"2023-11-15T02:37:11.522568+0000","last_peered":"2023-11-15T02:37:11.522568+0000","last_clean":"2023-11-15T02:37:11.522568+0000","last_became_active":"2023-11-15T02:37:11.517664+0000","last_became_peered":"2023-11-15T02:37:11.517664+0000","last_unstale":"2023-11-15T02:37:11.522568+0000","last_undegraded":"2023-11-15T02:37:11.522568+0000","last_fullsized":"2023-11-15T02:37:11.522568+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514490+0000","last_change":"2023-11-15T02:37:11.131730+0000","last_active":"2023-11-15T02:37:11.514490+0000","last_peered":"2023-11-15T02:37:11.514490+0000","last_clean":"2023-11-15T02:37:11.514490+0000","last_became_active":"2023-11-15T02:37:11.131437+0000","last_became_peered":"2023-11-15T02:37:11.131437+0000","last_unstale":"2023-11-15T02:37:11.514490+0000","last_undegraded":"2023-11-15T02:37:11.514490+0000","last_fullsized":"2023-11-15T02:37:11.514490+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.531631+0000","last_change":"2023-11-15T02:37:11.522292+0000","last_active":"2023-11-15T02:37:11.531631+0000","last_peered":"2023-11-15T02:37:11.531631+0000","last_clean":"2023-11-15T02:37:11.531631+0000","last_became_active":"2023-11-15T02:37:11.522044+0000","last_became_peered":"2023-11-15T02:37:11.522044+0000","last_unstale":"2023-11-15T02:37:11.531631+0000","last_undegraded":"2023-11-15T02:37:11.531631+0000","last_fullsized":"2023-11-15T02:37:11.531631+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528185+0000","last_change":"2023-11-15T02:37:11.132610+0000","last_active":"2023-11-15T02:37:11.528185+0000","last_peered":"2023-11-15T02:37:11.528185+0000","last_clean":"2023-11-15T02:37:11.528185+0000","last_became_active":"2023-11-15T02:37:11.132317+0000","last_became_peered":"2023-11-15T02:37:11.132317+0000","last_unstale":"2023-11-15T02:37:11.528185+0000","last_undegraded":"2023-11-15T02:37:11.528185+0000","last_fullsized":"2023-11-15T02:37:11.528185+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534578+0000","last_change":"2023-11-15T02:37:11.532374+0000","last_active":"2023-11-15T02:37:11.534578+0000","last_peered":"2023-11-15T02:37:11.534578+0000","last_clean":"2023-11-15T02:37:11.534578+0000","last_became_active":"2023-11-15T02:37:11.531978+0000","last_became_peered":"2023-11-15T02:37:11.531978+0000","last_unstale":"2023-11-15T02:37:11.534578+0000","last_undegraded":"2023-11-15T02:37:11.534578+0000","last_fullsized":"2023-11-15T02:37:11.534578+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.518343+0000","last_change":"2023-11-15T02:37:11.143661+0000","last_active":"2023-11-15T02:37:11.518343+0000","last_peered":"2023-11-15T02:37:11.518343+0000","last_clean":"2023-11-15T02:37:11.518343+0000","last_became_active":"2023-11-15T02:37:11.143395+0000","last_became_peered":"2023-11-15T02:37:11.143395+0000","last_unstale":"2023-11-15T02:37:11.518343+0000","last_undegraded":"2023-11-15T02:37:11.518343+0000","last_fullsized":"2023-11-15T02:37:11.518343+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.527851+0000","last_change":"2023-11-15T02:37:11.521941+0000","last_active":"2023-11-15T02:37:11.527851+0000","last_peered":"2023-11-15T02:37:11.527851+0000","last_clean":"2023-11-15T02:37:11.527851+0000","last_became_active":"2023-11-15T02:37:11.521648+0000","last_became_peered":"2023-11-15T02:37:11.521648+0000","last_unstale":"2023-11-15T02:37:11.527851+0000","last_undegraded":"2023-11-15T02:37:11.527851+0000","last_fullsized":"2023-11-15T02:37:11.527851+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514553+0000","last_change":"2023-11-15T02:37:11.136397+0000","last_active":"2023-11-15T02:37:11.514553+0000","last_peered":"2023-11-15T02:37:11.514553+0000","last_clean":"2023-11-15T02:37:11.514553+0000","last_became_active":"2023-11-15T02:37:11.136081+0000","last_became_peered":"2023-11-15T02:37:11.136081+0000","last_unstale":"2023-11-15T02:37:11.514553+0000","last_undegraded":"2023-11-15T02:37:11.514553+0000","last_fullsized":"2023-11-15T02:37:11.514553+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533360+0000","last_change":"2023-11-15T02:37:11.527925+0000","last_active":"2023-11-15T02:37:11.533360+0000","last_peered":"2023-11-15T02:37:11.533360+0000","last_clean":"2023-11-15T02:37:11.533360+0000","last_became_active":"2023-11-15T02:37:11.526688+0000","last_became_peered":"2023-11-15T02:37:11.526688+0000","last_unstale":"2023-11-15T02:37:11.533360+0000","last_undegraded":"2023-11-15T02:37:11.533360+0000","last_fullsized":"2023-11-15T02:37:11.533360+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.518084+0000","last_change":"2023-11-15T02:37:11.135021+0000","last_active":"2023-11-15T02:37:11.518084+0000","last_peered":"2023-11-15T02:37:11.518084+0000","last_clean":"2023-11-15T02:37:11.518084+0000","last_became_active":"2023-11-15T02:37:11.133753+0000","last_became_peered":"2023-11-15T02:37:11.133753+0000","last_unstale":"2023-11-15T02:37:11.518084+0000","last_undegraded":"2023-11-15T02:37:11.518084+0000","last_fullsized":"2023-11-15T02:37:11.518084+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524071+0000","last_change":"2023-11-15T02:37:11.521924+0000","last_active":"2023-11-15T02:37:11.524071+0000","last_peered":"2023-11-15T02:37:11.524071+0000","last_clean":"2023-11-15T02:37:11.524071+0000","last_became_active":"2023-11-15T02:37:11.521625+0000","last_became_peered":"2023-11-15T02:37:11.521625+0000","last_unstale":"2023-11-15T02:37:11.524071+0000","last_undegraded":"2023-11-15T02:37:11.524071+0000","last_fullsized":"2023-11-15T02:37:11.524071+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.517021+0000","last_change":"2023-11-15T02:37:11.134111+0000","last_active":"2023-11-15T02:37:11.517021+0000","last_peered":"2023-11-15T02:37:11.517021+0000","last_clean":"2023-11-15T02:37:11.517021+0000","last_became_active":"2023-11-15T02:37:11.133797+0000","last_became_peered":"2023-11-15T02:37:11.133797+0000","last_unstale":"2023-11-15T02:37:11.517021+0000","last_undegraded":"2023-11-15T02:37:11.517021+0000","last_fullsized":"2023-11-15T02:37:11.517021+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.530553+0000","last_change":"2023-11-15T02:37:11.526898+0000","last_active":"2023-11-15T02:37:11.530553+0000","last_peered":"2023-11-15T02:37:11.530553+0000","last_clean":"2023-11-15T02:37:11.530553+0000","last_became_active":"2023-11-15T02:37:11.526610+0000","last_became_peered":"2023-11-15T02:37:11.526610+0000","last_unstale":"2023-11-15T02:37:11.530553+0000","last_undegraded":"2023-11-15T02:37:11.530553+0000","last_fullsized":"2023-11-15T02:37:11.530553+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.509580+0000","last_change":"2023-11-15T02:37:11.132901+0000","last_active":"2023-11-15T02:37:11.509580+0000","last_peered":"2023-11-15T02:37:11.509580+0000","last_clean":"2023-11-15T02:37:11.509580+0000","last_became_active":"2023-11-15T02:37:11.132583+0000","last_became_peered":"2023-11-15T02:37:11.132583+0000","last_unstale":"2023-11-15T02:37:11.509580+0000","last_undegraded":"2023-11-15T02:37:11.509580+0000","last_fullsized":"2023-11-15T02:37:11.509580+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.523106+0000","last_change":"2023-11-15T02:37:11.521103+0000","last_active":"2023-11-15T02:37:11.523106+0000","last_peered":"2023-11-15T02:37:11.523106+0000","last_clean":"2023-11-15T02:37:11.523106+0000","last_became_active":"2023-11-15T02:37:11.520591+0000","last_became_peered":"2023-11-15T02:37:11.520591+0000","last_unstale":"2023-11-15T02:37:11.523106+0000","last_undegraded":"2023-11-15T02:37:11.523106+0000","last_fullsized":"2023-11-15T02:37:11.523106+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.516861+0000","last_change":"2023-11-15T02:37:11.137659+0000","last_active":"2023-11-15T02:37:11.516861+0000","last_peered":"2023-11-15T02:37:11.516861+0000","last_clean":"2023-11-15T02:37:11.516861+0000","last_became_active":"2023-11-15T02:37:11.137320+0000","last_became_peered":"2023-11-15T02:37:11.137320+0000","last_unstale":"2023-11-15T02:37:11.516861+0000","last_undegraded":"2023-11-15T02:37:11.516861+0000","last_fullsized":"2023-11-15T02:37:11.516861+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536414+0000","last_change":"2023-11-15T02:37:11.535225+0000","last_active":"2023-11-15T02:37:11.536414+0000","last_peered":"2023-11-15T02:37:11.536414+0000","last_clean":"2023-11-15T02:37:11.536414+0000","last_became_active":"2023-11-15T02:37:11.534718+0000","last_became_peered":"2023-11-15T02:37:11.534718+0000","last_unstale":"2023-11-15T02:37:11.536414+0000","last_undegraded":"2023-11-15T02:37:11.536414+0000","last_fullsized":"2023-11-15T02:37:11.536414+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.523332+0000","last_change":"2023-11-15T02:37:11.142425+0000","last_active":"2023-11-15T02:37:11.523332+0000","last_peered":"2023-11-15T02:37:11.523332+0000","last_clean":"2023-11-15T02:37:11.523332+0000","last_became_active":"2023-11-15T02:37:11.141843+0000","last_became_peered":"2023-11-15T02:37:11.141843+0000","last_unstale":"2023-11-15T02:37:11.523332+0000","last_undegraded":"2023-11-15T02:37:11.523332+0000","last_fullsized":"2023-11-15T02:37:11.523332+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536556+0000","last_change":"2023-11-15T02:37:11.535377+0000","last_active":"2023-11-15T02:37:11.536556+0000","last_peered":"2023-11-15T02:37:11.536556+0000","last_clean":"2023-11-15T02:37:11.536556+0000","last_became_active":"2023-11-15T02:37:11.535019+0000","last_became_peered":"2023-11-15T02:37:11.535019+0000","last_unstale":"2023-11-15T02:37:11.536556+0000","last_undegraded":"2023-11-15T02:37:11.536556+0000","last_fullsized":"2023-11-15T02:37:11.536556+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535527+0000","last_change":"2023-11-15T02:37:11.132912+0000","last_active":"2023-11-15T02:37:11.535527+0000","last_peered":"2023-11-15T02:37:11.535527+0000","last_clean":"2023-11-15T02:37:11.535527+0000","last_became_active":"2023-11-15T02:37:11.132624+0000","last_became_peered":"2023-11-15T02:37:11.132624+0000","last_unstale":"2023-11-15T02:37:11.535527+0000","last_undegraded":"2023-11-15T02:37:11.535527+0000","last_fullsized":"2023-11-15T02:37:11.535527+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512622+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:37:11.512622+0000","last_peered":"2023-11-15T02:37:11.512622+0000","last_clean":"2023-11-15T02:37:11.512622+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:37:11.512622+0000","last_undegraded":"2023-11-15T02:37:11.512622+0000","last_fullsized":"2023-11-15T02:37:11.512622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524918+0000","last_change":"2023-11-15T02:37:11.521619+0000","last_active":"2023-11-15T02:37:11.524918+0000","last_peered":"2023-11-15T02:37:11.524918+0000","last_clean":"2023-11-15T02:37:11.524918+0000","last_became_active":"2023-11-15T02:37:11.520927+0000","last_became_peered":"2023-11-15T02:37:11.520927+0000","last_unstale":"2023-11-15T02:37:11.524918+0000","last_undegraded":"2023-11-15T02:37:11.524918+0000","last_fullsized":"2023-11-15T02:37:11.524918+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"176'3","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535460+0000","last_change":"2023-11-15T02:37:11.130795+0000","last_active":"2023-11-15T02:37:11.535460+0000","last_peered":"2023-11-15T02:37:11.535460+0000","last_clean":"2023-11-15T02:37:11.535460+0000","last_became_active":"2023-11-15T02:37:11.130494+0000","last_became_peered":"2023-11-15T02:37:11.130494+0000","last_unstale":"2023-11-15T02:37:11.535460+0000","last_undegraded":"2023-11-15T02:37:11.535460+0000","last_fullsized":"2023-11-15T02:37:11.535460+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":146,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.516694+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:37:11.516694+0000","last_peered":"2023-11-15T02:37:11.516694+0000","last_clean":"2023-11-15T02:37:11.516694+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:37:11.516694+0000","last_undegraded":"2023-11-15T02:37:11.516694+0000","last_fullsized":"2023-11-15T02:37:11.516694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536132+0000","last_change":"2023-11-15T02:37:11.535066+0000","last_active":"2023-11-15T02:37:11.536132+0000","last_peered":"2023-11-15T02:37:11.536132+0000","last_clean":"2023-11-15T02:37:11.536132+0000","last_became_active":"2023-11-15T02:37:11.534648+0000","last_became_peered":"2023-11-15T02:37:11.534648+0000","last_unstale":"2023-11-15T02:37:11.536132+0000","last_undegraded":"2023-11-15T02:37:11.536132+0000","last_fullsized":"2023-11-15T02:37:11.536132+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.518450+0000","last_change":"2023-11-15T02:37:11.137646+0000","last_active":"2023-11-15T02:37:11.518450+0000","last_peered":"2023-11-15T02:37:11.518450+0000","last_clean":"2023-11-15T02:37:11.518450+0000","last_became_active":"2023-11-15T02:37:11.137307+0000","last_became_peered":"2023-11-15T02:37:11.137307+0000","last_unstale":"2023-11-15T02:37:11.518450+0000","last_undegraded":"2023-11-15T02:37:11.518450+0000","last_fullsized":"2023-11-15T02:37:11.518450+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":155,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.509104+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:37:11.509104+0000","last_peered":"2023-11-15T02:37:11.509104+0000","last_clean":"2023-11-15T02:37:11.509104+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:37:11.509104+0000","last_undegraded":"2023-11-15T02:37:11.509104+0000","last_fullsized":"2023-11-15T02:37:11.509104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526543+0000","last_change":"2023-11-15T02:37:11.524654+0000","last_active":"2023-11-15T02:37:11.526543+0000","last_peered":"2023-11-15T02:37:11.526543+0000","last_clean":"2023-11-15T02:37:11.526543+0000","last_became_active":"2023-11-15T02:37:11.524322+0000","last_became_peered":"2023-11-15T02:37:11.524322+0000","last_unstale":"2023-11-15T02:37:11.526543+0000","last_undegraded":"2023-11-15T02:37:11.526543+0000","last_fullsized":"2023-11-15T02:37:11.526543+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.529462+0000","last_change":"2023-11-15T02:37:11.132331+0000","last_active":"2023-11-15T02:37:11.529462+0000","last_peered":"2023-11-15T02:37:11.529462+0000","last_clean":"2023-11-15T02:37:11.529462+0000","last_became_active":"2023-11-15T02:37:11.131991+0000","last_became_peered":"2023-11-15T02:37:11.131991+0000","last_unstale":"2023-11-15T02:37:11.529462+0000","last_undegraded":"2023-11-15T02:37:11.529462+0000","last_fullsized":"2023-11-15T02:37:11.529462+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":146,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.517104+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:37:11.517104+0000","last_peered":"2023-11-15T02:37:11.517104+0000","last_clean":"2023-11-15T02:37:11.517104+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:37:11.517104+0000","last_undegraded":"2023-11-15T02:37:11.517104+0000","last_fullsized":"2023-11-15T02:37:11.517104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":142,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.523425+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:37:11.523425+0000","last_peered":"2023-11-15T02:37:11.523425+0000","last_clean":"2023-11-15T02:37:11.523425+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:37:11.523425+0000","last_undegraded":"2023-11-15T02:37:11.523425+0000","last_fullsized":"2023-11-15T02:37:11.523425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.531464+0000","last_change":"2023-11-15T02:37:11.529970+0000","last_active":"2023-11-15T02:37:11.531464+0000","last_peered":"2023-11-15T02:37:11.531464+0000","last_clean":"2023-11-15T02:37:11.531464+0000","last_became_active":"2023-11-15T02:37:11.529785+0000","last_became_peered":"2023-11-15T02:37:11.529785+0000","last_unstale":"2023-11-15T02:37:11.531464+0000","last_undegraded":"2023-11-15T02:37:11.531464+0000","last_fullsized":"2023-11-15T02:37:11.531464+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.519017+0000","last_change":"2023-11-15T02:37:11.145012+0000","last_active":"2023-11-15T02:37:11.519017+0000","last_peered":"2023-11-15T02:37:11.519017+0000","last_clean":"2023-11-15T02:37:11.519017+0000","last_became_active":"2023-11-15T02:37:11.144138+0000","last_became_peered":"2023-11-15T02:37:11.144138+0000","last_unstale":"2023-11-15T02:37:11.519017+0000","last_undegraded":"2023-11-15T02:37:11.519017+0000","last_fullsized":"2023-11-15T02:37:11.519017+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":140,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.523484+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:37:11.523484+0000","last_peered":"2023-11-15T02:37:11.523484+0000","last_clean":"2023-11-15T02:37:11.523484+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:37:11.523484+0000","last_undegraded":"2023-11-15T02:37:11.523484+0000","last_fullsized":"2023-11-15T02:37:11.523484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.530895+0000","last_change":"2023-11-15T02:37:11.527609+0000","last_active":"2023-11-15T02:37:11.530895+0000","last_peered":"2023-11-15T02:37:11.530895+0000","last_clean":"2023-11-15T02:37:11.530895+0000","last_became_active":"2023-11-15T02:37:11.527253+0000","last_became_peered":"2023-11-15T02:37:11.527253+0000","last_unstale":"2023-11-15T02:37:11.530895+0000","last_undegraded":"2023-11-15T02:37:11.530895+0000","last_fullsized":"2023-11-15T02:37:11.530895+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512511+0000","last_change":"2023-11-15T02:37:11.132820+0000","last_active":"2023-11-15T02:37:11.512511+0000","last_peered":"2023-11-15T02:37:11.512511+0000","last_clean":"2023-11-15T02:37:11.512511+0000","last_became_active":"2023-11-15T02:37:11.132506+0000","last_became_peered":"2023-11-15T02:37:11.132506+0000","last_unstale":"2023-11-15T02:37:11.512511+0000","last_undegraded":"2023-11-15T02:37:11.512511+0000","last_fullsized":"2023-11-15T02:37:11.512511+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528979+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:37:11.528979+0000","last_peered":"2023-11-15T02:37:11.528979+0000","last_clean":"2023-11-15T02:37:11.528979+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:37:11.528979+0000","last_undegraded":"2023-11-15T02:37:11.528979+0000","last_fullsized":"2023-11-15T02:37:11.528979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.532924+0000","last_change":"2023-11-15T02:37:11.525701+0000","last_active":"2023-11-15T02:37:11.532924+0000","last_peered":"2023-11-15T02:37:11.532924+0000","last_clean":"2023-11-15T02:37:11.532924+0000","last_became_active":"2023-11-15T02:37:11.525421+0000","last_became_peered":"2023-11-15T02:37:11.525421+0000","last_unstale":"2023-11-15T02:37:11.532924+0000","last_undegraded":"2023-11-15T02:37:11.532924+0000","last_fullsized":"2023-11-15T02:37:11.532924+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.511500+0000","last_change":"2023-11-15T02:37:11.136268+0000","last_active":"2023-11-15T02:37:11.511500+0000","last_peered":"2023-11-15T02:37:11.511500+0000","last_clean":"2023-11-15T02:37:11.511500+0000","last_became_active":"2023-11-15T02:37:11.135994+0000","last_became_peered":"2023-11-15T02:37:11.135994+0000","last_unstale":"2023-11-15T02:37:11.511500+0000","last_undegraded":"2023-11-15T02:37:11.511500+0000","last_fullsized":"2023-11-15T02:37:11.511500+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513675+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:37:11.513675+0000","last_peered":"2023-11-15T02:37:11.513675+0000","last_clean":"2023-11-15T02:37:11.513675+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:37:11.513675+0000","last_undegraded":"2023-11-15T02:37:11.513675+0000","last_fullsized":"2023-11-15T02:37:11.513675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536274+0000","last_change":"2023-11-15T02:37:11.533494+0000","last_active":"2023-11-15T02:37:11.536274+0000","last_peered":"2023-11-15T02:37:11.536274+0000","last_clean":"2023-11-15T02:37:11.536274+0000","last_became_active":"2023-11-15T02:37:11.533146+0000","last_became_peered":"2023-11-15T02:37:11.533146+0000","last_unstale":"2023-11-15T02:37:11.536274+0000","last_undegraded":"2023-11-15T02:37:11.536274+0000","last_fullsized":"2023-11-15T02:37:11.536274+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.537265+0000","last_change":"2023-11-15T02:37:11.142673+0000","last_active":"2023-11-15T02:37:11.537265+0000","last_peered":"2023-11-15T02:37:11.537265+0000","last_clean":"2023-11-15T02:37:11.537265+0000","last_became_active":"2023-11-15T02:37:11.142366+0000","last_became_peered":"2023-11-15T02:37:11.142366+0000","last_unstale":"2023-11-15T02:37:11.537265+0000","last_undegraded":"2023-11-15T02:37:11.537265+0000","last_fullsized":"2023-11-15T02:37:11.537265+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.511103+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:37:11.511103+0000","last_peered":"2023-11-15T02:37:11.511103+0000","last_clean":"2023-11-15T02:37:11.511103+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:37:11.511103+0000","last_undegraded":"2023-11-15T02:37:11.511103+0000","last_fullsized":"2023-11-15T02:37:11.511103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575750,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303360,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068480,"statfs":{"total":96636764160,"available":96326123520,"internally_reserved":0,"allocated":2220032,"data_stored":1172309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55400000000000005}]},{"osd":1,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":0.997,"15min":0.997},"last":0.621},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33500000000000002},"max":{"1min":0.74199999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.60899999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":0.80200000000000005,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78000000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.77400000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79600000000000004,"5min":1.101,"15min":1.101},"last":0.58599999999999997}]},{"osd":4,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.33000000000000002,"15min":0.27300000000000002},"max":{"1min":0.68799999999999994,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.44},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.749,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59999999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48899999999999999,"15min":0.5},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.70499999999999996,"5min":0.70599999999999996,"15min":0.78800000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.371,"15min":0.33100000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.82799999999999996},"last":0.52400000000000002}]},{"osd":6,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.54900000000000004},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.31},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.86299999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.29999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.85699999999999998},"last":0.63100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575751,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307444,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064396,"statfs":{"total":96636764160,"available":96321941504,"internally_reserved":0,"allocated":2207744,"data_stored":1170841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68500000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.33700000000000002,"5min":0.317,"15min":0.308},"max":{"1min":0.755,"5min":0.78900000000000003,"15min":0.82899999999999996},"last":0.52400000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32100000000000001},"max":{"1min":0.70399999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.503},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.34300000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.35299999999999998},"max":{"1min":0.746,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46800000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78800000000000003,"15min":0.80700000000000005},"last":0.437},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.38700000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.307,"5min":0.28599999999999998,"15min":0.26100000000000001},"max":{"1min":0.65800000000000003,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.39600000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48499999999999999}]},{"osd":5,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56000000000000005,"15min":0.54700000000000004},"min":{"1min":0.35399999999999998,"5min":0.314,"15min":0.30599999999999999},"max":{"1min":0.74399999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57299999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.502},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.28799999999999998},"max":{"1min":0.66800000000000004,"5min":0.81000000000000005,"15min":0.81699999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.41999999999999998,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.83499999999999996,"5min":0.876,"15min":0.876},"last":0.56100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575752,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307452,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064388,"statfs":{"total":96636764160,"available":96321933312,"internally_reserved":0,"allocated":2215936,"data_stored":1171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.45600000000000002,"5min":0.66000000000000003,"15min":0.66800000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.52500000000000002,"5min":0.64200000000000002,"15min":0.65800000000000003},"last":0.34100000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.26900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.46300000000000002,"5min":0.59799999999999998,"15min":0.63100000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.44400000000000001,"15min":0.45500000000000002},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.27100000000000002},"max":{"1min":0.56599999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.35399999999999998}]},{"osd":3,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.30599999999999999},"max":{"1min":0.61799999999999999,"5min":0.69799999999999995,"15min":0.74299999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.48499999999999999,"15min":0.49199999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55500000000000005,"5min":0.70899999999999996,"15min":0.77100000000000002},"last":0.41599999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":0.89800000000000002,"15min":1.097},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.96499999999999997,"15min":1.014},"last":0.56299999999999994}]},{"osd":5,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":0.89200000000000002,"15min":0.98699999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.95399999999999996,"15min":1.024},"last":0.57999999999999996}]},{"osd":6,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.47899999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.94399999999999995,"15min":0.96799999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88400000000000001,"5min":0.93200000000000005,"15min":1.143},"last":0.65200000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90500000000000003,"5min":0.95799999999999996,"15min":1.111},"last":0.629},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":0.97999999999999998,"15min":1.0129999999999999},"last":0.59199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575750,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307460,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064380,"statfs":{"total":96636764160,"available":96321925120,"internally_reserved":0,"allocated":2224128,"data_stored":1171609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60299999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.42299999999999999},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.57999999999999996,"5min":0.63700000000000001,"15min":0.64200000000000002},"last":0.35999999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39400000000000002,"15min":0.39900000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53600000000000003,"5min":0.60099999999999998,"15min":0.83799999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.72499999999999998},"last":0.31}]},{"osd":3,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.44,"15min":0.44600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.28899999999999998},"max":{"1min":0.58599999999999997,"5min":0.64700000000000002,"15min":0.69799999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.71599999999999997},"last":0.435}]},{"osd":4,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66800000000000004,"15min":0.67600000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.39100000000000001},"max":{"1min":0.92100000000000004,"5min":0.96599999999999997,"15min":1.004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89100000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80500000000000005,"5min":0.88300000000000001,"15min":1.05},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65500000000000003,"15min":0.66500000000000004},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.44900000000000001},"max":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":1.004},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64700000000000002,"15min":0.66300000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.42699999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":1.026},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.68200000000000005},"min":{"1min":0.49199999999999999,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.0309999999999999},"last":0.51800000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69199999999999995,"15min":0.70799999999999996},"min":{"1min":0.53700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85399999999999998,"5min":0.93200000000000005,"15min":1.0600000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.72199999999999998},"min":{"1min":0.53600000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.997,"5min":0.997,"15min":1.0409999999999999},"last":0.749}]}]},{"osd":2,"up_from":13,"seq":55834575751,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311552,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060288,"statfs":{"total":96636764160,"available":96317734912,"internally_reserved":0,"allocated":2220032,"data_stored":1171023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.248,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56499999999999995,"5min":0.69699999999999995,"15min":0.83999999999999997},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.25900000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.63500000000000001,"5min":0.69199999999999995,"15min":0.85899999999999999},"last":0.28599999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39400000000000002,"15min":0.40600000000000003},"min":{"1min":0.28699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.52200000000000002,"5min":0.68999999999999995,"15min":0.91000000000000003},"last":0.316},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45600000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55700000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34300000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.33500000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64800000000000002,"5min":0.755,"15min":0.79800000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":0.65600000000000003,"5min":0.69499999999999995,"15min":1.113},"last":0.35699999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67100000000000004,"15min":0.65500000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.89000000000000001,"5min":1.0069999999999999,"15min":1.2170000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91100000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.74299999999999999}]},{"osd":5,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.41899999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.153},"last":0.755},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69299999999999995,"15min":0.68300000000000005},"min":{"1min":0.497,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.996},"last":0.68400000000000005}]},{"osd":6,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.442},"max":{"1min":0.85699999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.628},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.70599999999999996},"min":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.438},"max":{"1min":0.97299999999999998,"5min":1.079,"15min":1.079},"last":0.69299999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95099999999999996,"5min":1.0940000000000001,"15min":1.7270000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.72199999999999998},"min":{"1min":0.495,"5min":0.46800000000000003,"15min":0.45800000000000002},"max":{"1min":0.90900000000000003,"5min":1.038,"15min":1.038},"last":0.78200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575752,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311544,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060296,"statfs":{"total":96636764160,"available":96317743104,"internally_reserved":0,"allocated":2211840,"data_stored":1170875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.26400000000000001,"5min":0.24099999999999999,"15min":0.222},"max":{"1min":0.55900000000000005,"5min":0.56299999999999994,"15min":0.67700000000000005},"last":0.252},{"interface":"front","average":{"1min":0.378,"5min":0.40699999999999997,"15min":0.41799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.24199999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.67400000000000004},"last":0.28299999999999997}]},{"osd":1,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.40200000000000002,"15min":0.41899999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56899999999999995,"5min":0.622,"15min":0.81399999999999995},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.25800000000000001},"max":{"1min":0.64900000000000002,"5min":0.746,"15min":0.75800000000000001},"last":0.32700000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.71499999999999997,"15min":0.76900000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.497,"15min":0.501},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.75600000000000001},"last":0.36099999999999999}]},{"osd":4,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.432,"5min":0.41899999999999998,"15min":0.40500000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.306},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.75900000000000001}]},{"osd":5,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66500000000000004,"15min":0.68000000000000005},"min":{"1min":0.48099999999999998,"5min":0.42899999999999999,"15min":0.39100000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.46999999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.129},"last":0.71599999999999997}]},{"osd":6,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.496,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.46100000000000002,"15min":0.438},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.69499999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.439},"max":{"1min":1.159,"5min":1.159,"15min":1.256},"last":0.751},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575750,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1171485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.32000000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.80800000000000005},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.67600000000000005,"5min":0.78000000000000003,"15min":1.1919999999999999},"last":0.40799999999999997}]},{"osd":1,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.45400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.42999999999999999,"5min":0.39400000000000002,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.82199999999999995,"15min":1.2},"last":0.77300000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.59899999999999998},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.36599999999999999},"max":{"1min":0.74299999999999999,"5min":0.752,"15min":1.272},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.434,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79800000000000004,"5min":0.81899999999999995,"15min":0.95999999999999996},"last":0.80300000000000005}]},{"osd":3,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.40500000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.3109999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.53400000000000003,"15min":0.48599999999999999},"min":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.30299999999999999},"max":{"1min":4.8230000000000004,"5min":4.8230000000000004,"15min":4.8230000000000004},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.28299999999999997},"max":{"1min":0.71499999999999997,"5min":0.747,"15min":0.79000000000000004},"last":0.45600000000000002}]},{"osd":6,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.56100000000000005,"15min":0.51800000000000002},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.32900000000000001},"max":{"1min":4.8689999999999998,"5min":4.8689999999999998,"15min":4.8689999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.38500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72099999999999997,"5min":0.78800000000000003,"15min":0.85399999999999998},"last":0.874}]},{"osd":7,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.58099999999999996,"15min":0.54400000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":4.4569999999999999,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.36799999999999999},"max":{"1min":0.75,"5min":0.79100000000000004,"15min":0.83299999999999996},"last":0.69599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575750,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307448,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064392,"statfs":{"total":96636764160,"available":96321937408,"internally_reserved":0,"allocated":2211840,"data_stored":1171733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67300000000000004,"5min":0.76900000000000002,"15min":1.1379999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79000000000000004,"5min":0.79500000000000004,"15min":1.0169999999999999},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68899999999999995,"5min":0.84299999999999997,"15min":1.0109999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.55900000000000005,"15min":0.56799999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":1.135},"last":0.53600000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":1.155},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76700000000000002,"5min":0.81999999999999995,"15min":1.0369999999999999},"last":0.64000000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.77800000000000002,"5min":0.79200000000000004,"15min":1.1779999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69899999999999995,"5min":0.79900000000000004,"15min":1.171},"last":0.60799999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45700000000000002,"15min":0.45900000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.72399999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.313},"max":{"1min":0.68799999999999994,"5min":0.77900000000000003,"15min":0.78600000000000003},"last":0.59999999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.317,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.80900000000000005},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.497,"15min":0.498},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64600000000000002,"5min":0.76500000000000001,"15min":0.81899999999999995},"last":0.61899999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.499,"15min":0.495},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63900000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.36299999999999999},"max":{"1min":0.73999999999999999,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:37:20.043 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:37:20.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.175+0000 7f628e582700 1 Processor -- start 2023-11-15T02:37:20.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.175+0000 7f628e582700 1 -- start start 2023-11-15T02:37:20.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.176+0000 7f628e582700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62880be520 0x7f62880a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.176+0000 7f628e582700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62880a85e0 con 0x7f6288154450 2023-11-15T02:37:20.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.176+0000 7f628e582700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6288065660 con 0x7f62880833a0 2023-11-15T02:37:20.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.176+0000 7f628e582700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6288065940 con 0x7f62880be520 2023-11-15T02:37:20.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.176+0000 7f6287fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6288154450 0x7f62880bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44772/0 (socket says 172.21.15.1:44772) 2023-11-15T02:37:20.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.177+0000 7f6287fff700 1 -- 172.21.15.1:0/1206429648 learned_addr learned my addr 172.21.15.1:0/1206429648 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:20.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.177+0000 7f628cb1f700 1 --2- 172.21.15.1:0/1206429648 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62880be520 0x7f62880a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.177+0000 7f6286ffd700 1 -- 172.21.15.1:0/1206429648 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608287919 0 0) 0x7f62880a85e0 con 0x7f6288154450 2023-11-15T02:37:20.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.177+0000 7f6286ffd700 1 -- 172.21.15.1:0/1206429648 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62740033f0 con 0x7f6288154450 2023-11-15T02:37:20.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.177+0000 7f6286ffd700 1 -- 172.21.15.1:0/1206429648 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227438963 0 0) 0x7f6288065660 con 0x7f62880833a0 2023-11-15T02:37:20.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.177+0000 7f6286ffd700 1 -- 172.21.15.1:0/1206429648 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62880a85e0 con 0x7f62880833a0 2023-11-15T02:37:20.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.177+0000 7f628cb1f700 1 -- 172.21.15.1:0/1206429648 >> v1:172.21.15.141:6789/0 conn(0x7f62880833a0 legacy=0x7f62880c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.177+0000 7f628cb1f700 1 -- 172.21.15.1:0/1206429648 >> v1:172.21.15.1:6789/0 conn(0x7f6288154450 legacy=0x7f62880bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.177+0000 7f628cb1f700 1 -- 172.21.15.1:0/1206429648 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62880c6f50 con 0x7f62880be520 2023-11-15T02:37:20.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.177+0000 7f628cb1f700 1 --2- 172.21.15.1:0/1206429648 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62880be520 0x7f62880a7ef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f6280009e90 tx=0x7f6280009780).ready entity=mon.2 client_cookie=f3763c956131cf95 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:20.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.177+0000 7f6286ffd700 1 -- 172.21.15.1:0/1206429648 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628000e070 con 0x7f62880be520 2023-11-15T02:37:20.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.177+0000 7f6286ffd700 1 -- 172.21.15.1:0/1206429648 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628000bab0 con 0x7f62880be520 2023-11-15T02:37:20.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.177+0000 7f6286ffd700 1 -- 172.21.15.1:0/1206429648 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628000be30 con 0x7f62880be520 2023-11-15T02:37:20.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.178+0000 7f628e582700 1 -- 172.21.15.1:0/1206429648 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62880be520 msgr2=0x7f62880a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.178+0000 7f628e582700 1 --2- 172.21.15.1:0/1206429648 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62880be520 0x7f62880a7ef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f6280009e90 tx=0x7f6280009780).stop 2023-11-15T02:37:20.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.178+0000 7f628e582700 1 -- 172.21.15.1:0/1206429648 shutdown_connections 2023-11-15T02:37:20.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.178+0000 7f628e582700 1 --2- 172.21.15.1:0/1206429648 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62880be520 0x7f62880a7ef0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.178+0000 7f628e582700 1 -- 172.21.15.1:0/1206429648 >> 172.21.15.1:0/1206429648 conn(0x7f6288082f90 msgr2=0x7f62880c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:20.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.178+0000 7f628e582700 1 -- 172.21.15.1:0/1206429648 shutdown_connections 2023-11-15T02:37:20.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.178+0000 7f628e582700 1 -- 172.21.15.1:0/1206429648 wait complete. 2023-11-15T02:37:20.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.179+0000 7f628e582700 1 Processor -- start 2023-11-15T02:37:20.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.179+0000 7f628e582700 1 -- start start 2023-11-15T02:37:20.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.180+0000 7f628e582700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62880833a0 0x7f62881512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.180+0000 7f628e582700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62880be520 0x7f628814f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.180+0000 7f628e582700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6288154450 0x7f628814fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.180+0000 7f628e582700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628814ffa0 con 0x7f6288154450 2023-11-15T02:37:20.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.180+0000 7f628e582700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628814e9a0 con 0x7f62880be520 2023-11-15T02:37:20.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.180+0000 7f628e582700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6288150240 con 0x7f62880833a0 2023-11-15T02:37:20.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.180+0000 7f628cb1f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6288154450 0x7f628814fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.180+0000 7f628cb1f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6288154450 0x7f628814fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43306/0 (socket says 172.21.15.1:43306) 2023-11-15T02:37:20.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.180+0000 7f628cb1f700 1 -- 172.21.15.1:0/2945209141 learned_addr learned my addr 172.21.15.1:0/2945209141 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:20.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.180+0000 7f6287fff700 1 --2- 172.21.15.1:0/2945209141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62880833a0 0x7f62881512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.180+0000 7f62877fe700 1 --2- 172.21.15.1:0/2945209141 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62880be520 0x7f628814f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.181+0000 7f628cb1f700 1 -- 172.21.15.1:0/2945209141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62880833a0 msgr2=0x7f62881512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.181+0000 7f628cb1f700 1 --2- 172.21.15.1:0/2945209141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62880833a0 0x7f62881512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.181+0000 7f628cb1f700 1 -- 172.21.15.1:0/2945209141 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62880be520 msgr2=0x7f628814f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.181+0000 7f628cb1f700 1 --2- 172.21.15.1:0/2945209141 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62880be520 0x7f628814f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.181+0000 7f628cb1f700 1 -- 172.21.15.1:0/2945209141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6280009a20 con 0x7f6288154450 2023-11-15T02:37:20.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.181+0000 7f628cb1f700 1 --2- 172.21.15.1:0/2945209141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6288154450 0x7f628814fab0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f62880665a0 tx=0x7f6280009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:20.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.181+0000 7f627ffff700 1 -- 172.21.15.1:0/2945209141 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6280013e60 con 0x7f6288154450 2023-11-15T02:37:20.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.181+0000 7f627ffff700 1 -- 172.21.15.1:0/2945209141 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628001d630 con 0x7f6288154450 2023-11-15T02:37:20.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.181+0000 7f628e582700 1 -- 172.21.15.1:0/2945209141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6288150520 con 0x7f6288154450 2023-11-15T02:37:20.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.181+0000 7f627ffff700 1 -- 172.21.15.1:0/2945209141 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628001d9f0 con 0x7f6288154450 2023-11-15T02:37:20.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.181+0000 7f628e582700 1 -- 172.21.15.1:0/2945209141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6288150ae0 con 0x7f6288154450 2023-11-15T02:37:20.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.182+0000 7f628e582700 1 -- 172.21.15.1:0/2945209141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62880c7b40 con 0x7f6288154450 2023-11-15T02:37:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.182+0000 7f627ffff700 1 -- 172.21.15.1:0/2945209141 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6280003040 con 0x7f6288154450 2023-11-15T02:37:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.183+0000 7f627ffff700 1 --2- 172.21.15.1:0/2945209141 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f626805f270 0x7f6268061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.183+0000 7f627ffff700 1 -- 172.21.15.1:0/2945209141 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f628007c340 con 0x7f6288154450 2023-11-15T02:37:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.183+0000 7f6287fff700 1 --2- 172.21.15.1:0/2945209141 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f626805f270 0x7f6268061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.184+0000 7f6287fff700 1 --2- 172.21.15.1:0/2945209141 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f626805f270 0x7f6268061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6270001360 tx=0x7f6270009040).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:20.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.187+0000 7f627ffff700 1 -- 172.21.15.1:0/2945209141 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6280050cd0 con 0x7f6288154450 2023-11-15T02:37:20.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.356+0000 7f628e582700 1 -- 172.21.15.1:0/2945209141 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f628806c7e0 con 0x7f626805f270 2023-11-15T02:37:20.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.366+0000 7f627ffff700 1 -- 172.21.15.1:0/2945209141 <== mgr.8110 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361960 (secure 0 0 0) 0x7f628806c7e0 con 0x7f626805f270 2023-11-15T02:37:20.372 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:37:20.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.369+0000 7f628e582700 1 -- 172.21.15.1:0/2945209141 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f626805f270 msgr2=0x7f6268061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.369+0000 7f628e582700 1 --2- 172.21.15.1:0/2945209141 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f626805f270 0x7f6268061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6270001360 tx=0x7f6270009040).stop 2023-11-15T02:37:20.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.369+0000 7f628e582700 1 -- 172.21.15.1:0/2945209141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6288154450 msgr2=0x7f628814fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.369+0000 7f628e582700 1 --2- 172.21.15.1:0/2945209141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6288154450 0x7f628814fab0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f62880665a0 tx=0x7f6280009780).stop 2023-11-15T02:37:20.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.369+0000 7f628e582700 1 -- 172.21.15.1:0/2945209141 shutdown_connections 2023-11-15T02:37:20.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.369+0000 7f628e582700 1 --2- 172.21.15.1:0/2945209141 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f626805f270 0x7f6268061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.369+0000 7f628e582700 1 --2- 172.21.15.1:0/2945209141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6288154450 0x7f628814fab0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.369+0000 7f628e582700 1 --2- 172.21.15.1:0/2945209141 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62880833a0 0x7f62881512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.369+0000 7f628e582700 1 --2- 172.21.15.1:0/2945209141 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62880be520 0x7f628814f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.369+0000 7f628e582700 1 -- 172.21.15.1:0/2945209141 >> 172.21.15.1:0/2945209141 conn(0x7f6288082f90 msgr2=0x7f62880c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:20.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.370+0000 7f628e582700 1 -- 172.21.15.1:0/2945209141 shutdown_connections 2023-11-15T02:37:20.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.370+0000 7f628e582700 1 -- 172.21.15.1:0/2945209141 wait complete. 2023-11-15T02:37:20.378 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:37:20.383 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-11-15T02:37:20.078125+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2459616,"kb_used_data":17312,"kb_used_omap":0,"kb_used_meta":2442240,"kb_avail":752515104,"statfs":{"total":773094113280,"available":770575466496,"internally_reserved":0,"allocated":17727488,"data_stored":9371340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2500853760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12017,"num_objects":-10,"num_object_clones":0,"num_object_copies":-20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-36,"num_write_kb":-28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003074"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.525965+0000","last_change":"2023-11-15T02:37:11.523042+0000","last_active":"2023-11-15T02:37:11.525965+0000","last_peered":"2023-11-15T02:37:11.525965+0000","last_clean":"2023-11-15T02:37:11.525965+0000","last_became_active":"2023-11-15T02:37:11.522722+0000","last_became_peered":"2023-11-15T02:37:11.522722+0000","last_unstale":"2023-11-15T02:37:11.525965+0000","last_undegraded":"2023-11-15T02:37:11.525965+0000","last_fullsized":"2023-11-15T02:37:11.525965+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"176'3","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534737+0000","last_change":"2023-11-15T02:37:11.142538+0000","last_active":"2023-11-15T02:37:11.534737+0000","last_peered":"2023-11-15T02:37:11.534737+0000","last_clean":"2023-11-15T02:37:11.534737+0000","last_became_active":"2023-11-15T02:37:11.142134+0000","last_became_peered":"2023-11-15T02:37:11.142134+0000","last_unstale":"2023-11-15T02:37:11.534737+0000","last_undegraded":"2023-11-15T02:37:11.534737+0000","last_fullsized":"2023-11-15T02:37:11.534737+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536585+0000","last_change":"2023-11-15T02:37:11.534444+0000","last_active":"2023-11-15T02:37:11.536585+0000","last_peered":"2023-11-15T02:37:11.536585+0000","last_clean":"2023-11-15T02:37:11.536585+0000","last_became_active":"2023-11-15T02:37:11.534171+0000","last_became_peered":"2023-11-15T02:37:11.534171+0000","last_unstale":"2023-11-15T02:37:11.536585+0000","last_undegraded":"2023-11-15T02:37:11.536585+0000","last_fullsized":"2023-11-15T02:37:11.536585+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.519894+0000","last_change":"2023-11-15T02:37:11.130593+0000","last_active":"2023-11-15T02:37:11.519894+0000","last_peered":"2023-11-15T02:37:11.519894+0000","last_clean":"2023-11-15T02:37:11.519894+0000","last_became_active":"2023-11-15T02:37:11.130310+0000","last_became_peered":"2023-11-15T02:37:11.130310+0000","last_unstale":"2023-11-15T02:37:11.519894+0000","last_undegraded":"2023-11-15T02:37:11.519894+0000","last_fullsized":"2023-11-15T02:37:11.519894+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.530599+0000","last_change":"2023-11-15T02:37:11.527684+0000","last_active":"2023-11-15T02:37:11.530599+0000","last_peered":"2023-11-15T02:37:11.530599+0000","last_clean":"2023-11-15T02:37:11.530599+0000","last_became_active":"2023-11-15T02:37:11.527423+0000","last_became_peered":"2023-11-15T02:37:11.527423+0000","last_unstale":"2023-11-15T02:37:11.530599+0000","last_undegraded":"2023-11-15T02:37:11.530599+0000","last_fullsized":"2023-11-15T02:37:11.530599+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.511815+0000","last_change":"2023-11-15T02:37:11.134804+0000","last_active":"2023-11-15T02:37:11.511815+0000","last_peered":"2023-11-15T02:37:11.511815+0000","last_clean":"2023-11-15T02:37:11.511815+0000","last_became_active":"2023-11-15T02:37:11.134447+0000","last_became_peered":"2023-11-15T02:37:11.134447+0000","last_unstale":"2023-11-15T02:37:11.511815+0000","last_undegraded":"2023-11-15T02:37:11.511815+0000","last_fullsized":"2023-11-15T02:37:11.511815+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528360+0000","last_change":"2023-11-15T02:37:11.522004+0000","last_active":"2023-11-15T02:37:11.528360+0000","last_peered":"2023-11-15T02:37:11.528360+0000","last_clean":"2023-11-15T02:37:11.528360+0000","last_became_active":"2023-11-15T02:37:11.521683+0000","last_became_peered":"2023-11-15T02:37:11.521683+0000","last_unstale":"2023-11-15T02:37:11.528360+0000","last_undegraded":"2023-11-15T02:37:11.528360+0000","last_fullsized":"2023-11-15T02:37:11.528360+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526446+0000","last_change":"2023-11-15T02:37:11.134204+0000","last_active":"2023-11-15T02:37:11.526446+0000","last_peered":"2023-11-15T02:37:11.526446+0000","last_clean":"2023-11-15T02:37:11.526446+0000","last_became_active":"2023-11-15T02:37:11.133597+0000","last_became_peered":"2023-11-15T02:37:11.133597+0000","last_unstale":"2023-11-15T02:37:11.526446+0000","last_undegraded":"2023-11-15T02:37:11.526446+0000","last_fullsized":"2023-11-15T02:37:11.526446+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.529851+0000","last_change":"2023-11-15T02:37:11.527099+0000","last_active":"2023-11-15T02:37:11.529851+0000","last_peered":"2023-11-15T02:37:11.529851+0000","last_clean":"2023-11-15T02:37:11.529851+0000","last_became_active":"2023-11-15T02:37:11.526802+0000","last_became_peered":"2023-11-15T02:37:11.526802+0000","last_unstale":"2023-11-15T02:37:11.529851+0000","last_undegraded":"2023-11-15T02:37:11.529851+0000","last_fullsized":"2023-11-15T02:37:11.529851+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535140+0000","last_change":"2023-11-15T02:37:11.136474+0000","last_active":"2023-11-15T02:37:11.535140+0000","last_peered":"2023-11-15T02:37:11.535140+0000","last_clean":"2023-11-15T02:37:11.535140+0000","last_became_active":"2023-11-15T02:37:11.135966+0000","last_became_peered":"2023-11-15T02:37:11.135966+0000","last_unstale":"2023-11-15T02:37:11.535140+0000","last_undegraded":"2023-11-15T02:37:11.535140+0000","last_fullsized":"2023-11-15T02:37:11.535140+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535001+0000","last_change":"2023-11-15T02:37:11.533006+0000","last_active":"2023-11-15T02:37:11.535001+0000","last_peered":"2023-11-15T02:37:11.535001+0000","last_clean":"2023-11-15T02:37:11.535001+0000","last_became_active":"2023-11-15T02:37:11.531957+0000","last_became_peered":"2023-11-15T02:37:11.531957+0000","last_unstale":"2023-11-15T02:37:11.535001+0000","last_undegraded":"2023-11-15T02:37:11.535001+0000","last_fullsized":"2023-11-15T02:37:11.535001+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.527349+0000","last_change":"2023-11-15T02:37:11.134579+0000","last_active":"2023-11-15T02:37:11.527349+0000","last_peered":"2023-11-15T02:37:11.527349+0000","last_clean":"2023-11-15T02:37:11.527349+0000","last_became_active":"2023-11-15T02:37:11.134246+0000","last_became_peered":"2023-11-15T02:37:11.134246+0000","last_unstale":"2023-11-15T02:37:11.527349+0000","last_undegraded":"2023-11-15T02:37:11.527349+0000","last_fullsized":"2023-11-15T02:37:11.527349+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.532195+0000","last_change":"2023-11-15T02:37:11.522330+0000","last_active":"2023-11-15T02:37:11.532195+0000","last_peered":"2023-11-15T02:37:11.532195+0000","last_clean":"2023-11-15T02:37:11.532195+0000","last_became_active":"2023-11-15T02:37:11.522087+0000","last_became_peered":"2023-11-15T02:37:11.522087+0000","last_unstale":"2023-11-15T02:37:11.532195+0000","last_undegraded":"2023-11-15T02:37:11.532195+0000","last_fullsized":"2023-11-15T02:37:11.532195+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512060+0000","last_change":"2023-11-15T02:37:11.129365+0000","last_active":"2023-11-15T02:37:11.512060+0000","last_peered":"2023-11-15T02:37:11.512060+0000","last_clean":"2023-11-15T02:37:11.512060+0000","last_became_active":"2023-11-15T02:37:11.128680+0000","last_became_peered":"2023-11-15T02:37:11.128680+0000","last_unstale":"2023-11-15T02:37:11.512060+0000","last_undegraded":"2023-11-15T02:37:11.512060+0000","last_fullsized":"2023-11-15T02:37:11.512060+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534138+0000","last_change":"2023-11-15T02:37:11.532558+0000","last_active":"2023-11-15T02:37:11.534138+0000","last_peered":"2023-11-15T02:37:11.534138+0000","last_clean":"2023-11-15T02:37:11.534138+0000","last_became_active":"2023-11-15T02:37:11.532227+0000","last_became_peered":"2023-11-15T02:37:11.532227+0000","last_unstale":"2023-11-15T02:37:11.534138+0000","last_undegraded":"2023-11-15T02:37:11.534138+0000","last_fullsized":"2023-11-15T02:37:11.534138+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.511676+0000","last_change":"2023-11-15T02:37:11.138579+0000","last_active":"2023-11-15T02:37:11.511676+0000","last_peered":"2023-11-15T02:37:11.511676+0000","last_clean":"2023-11-15T02:37:11.511676+0000","last_became_active":"2023-11-15T02:37:11.138283+0000","last_became_peered":"2023-11-15T02:37:11.138283+0000","last_unstale":"2023-11-15T02:37:11.511676+0000","last_undegraded":"2023-11-15T02:37:11.511676+0000","last_fullsized":"2023-11-15T02:37:11.511676+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526806+0000","last_change":"2023-11-15T02:37:11.523782+0000","last_active":"2023-11-15T02:37:11.526806+0000","last_peered":"2023-11-15T02:37:11.526806+0000","last_clean":"2023-11-15T02:37:11.526806+0000","last_became_active":"2023-11-15T02:37:11.523313+0000","last_became_peered":"2023-11-15T02:37:11.523313+0000","last_unstale":"2023-11-15T02:37:11.526806+0000","last_undegraded":"2023-11-15T02:37:11.526806+0000","last_fullsized":"2023-11-15T02:37:11.526806+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.520621+0000","last_change":"2023-11-15T02:37:11.136706+0000","last_active":"2023-11-15T02:37:11.520621+0000","last_peered":"2023-11-15T02:37:11.520621+0000","last_clean":"2023-11-15T02:37:11.520621+0000","last_became_active":"2023-11-15T02:37:11.136365+0000","last_became_peered":"2023-11-15T02:37:11.136365+0000","last_unstale":"2023-11-15T02:37:11.520621+0000","last_undegraded":"2023-11-15T02:37:11.520621+0000","last_fullsized":"2023-11-15T02:37:11.520621+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536120+0000","last_change":"2023-11-15T02:37:11.534908+0000","last_active":"2023-11-15T02:37:11.536120+0000","last_peered":"2023-11-15T02:37:11.536120+0000","last_clean":"2023-11-15T02:37:11.536120+0000","last_became_active":"2023-11-15T02:37:11.534296+0000","last_became_peered":"2023-11-15T02:37:11.534296+0000","last_unstale":"2023-11-15T02:37:11.536120+0000","last_undegraded":"2023-11-15T02:37:11.536120+0000","last_fullsized":"2023-11-15T02:37:11.536120+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.517981+0000","last_change":"2023-11-15T02:37:11.142063+0000","last_active":"2023-11-15T02:37:11.517981+0000","last_peered":"2023-11-15T02:37:11.517981+0000","last_clean":"2023-11-15T02:37:11.517981+0000","last_became_active":"2023-11-15T02:37:11.141752+0000","last_became_peered":"2023-11-15T02:37:11.141752+0000","last_unstale":"2023-11-15T02:37:11.517981+0000","last_undegraded":"2023-11-15T02:37:11.517981+0000","last_fullsized":"2023-11-15T02:37:11.517981+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.532742+0000","last_change":"2023-11-15T02:37:11.525977+0000","last_active":"2023-11-15T02:37:11.532742+0000","last_peered":"2023-11-15T02:37:11.532742+0000","last_clean":"2023-11-15T02:37:11.532742+0000","last_became_active":"2023-11-15T02:37:11.525610+0000","last_became_peered":"2023-11-15T02:37:11.525610+0000","last_unstale":"2023-11-15T02:37:11.532742+0000","last_undegraded":"2023-11-15T02:37:11.532742+0000","last_fullsized":"2023-11-15T02:37:11.532742+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514259+0000","last_change":"2023-11-15T02:37:11.138297+0000","last_active":"2023-11-15T02:37:11.514259+0000","last_peered":"2023-11-15T02:37:11.514259+0000","last_clean":"2023-11-15T02:37:11.514259+0000","last_became_active":"2023-11-15T02:37:11.137977+0000","last_became_peered":"2023-11-15T02:37:11.137977+0000","last_unstale":"2023-11-15T02:37:11.514259+0000","last_undegraded":"2023-11-15T02:37:11.514259+0000","last_fullsized":"2023-11-15T02:37:11.514259+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534096+0000","last_change":"2023-11-15T02:37:11.532839+0000","last_active":"2023-11-15T02:37:11.534096+0000","last_peered":"2023-11-15T02:37:11.534096+0000","last_clean":"2023-11-15T02:37:11.534096+0000","last_became_active":"2023-11-15T02:37:11.532575+0000","last_became_peered":"2023-11-15T02:37:11.532575+0000","last_unstale":"2023-11-15T02:37:11.534096+0000","last_undegraded":"2023-11-15T02:37:11.534096+0000","last_fullsized":"2023-11-15T02:37:11.534096+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.539052+0000","last_change":"2023-11-15T02:37:11.142218+0000","last_active":"2023-11-15T02:37:11.539052+0000","last_peered":"2023-11-15T02:37:11.539052+0000","last_clean":"2023-11-15T02:37:11.539052+0000","last_became_active":"2023-11-15T02:37:11.141926+0000","last_became_peered":"2023-11-15T02:37:11.141926+0000","last_unstale":"2023-11-15T02:37:11.539052+0000","last_undegraded":"2023-11-15T02:37:11.539052+0000","last_fullsized":"2023-11-15T02:37:11.539052+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533648+0000","last_change":"2023-11-15T02:37:11.528785+0000","last_active":"2023-11-15T02:37:11.533648+0000","last_peered":"2023-11-15T02:37:11.533648+0000","last_clean":"2023-11-15T02:37:11.533648+0000","last_became_active":"2023-11-15T02:37:11.528476+0000","last_became_peered":"2023-11-15T02:37:11.528476+0000","last_unstale":"2023-11-15T02:37:11.533648+0000","last_undegraded":"2023-11-15T02:37:11.533648+0000","last_fullsized":"2023-11-15T02:37:11.533648+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535039+0000","last_change":"2023-11-15T02:37:11.136220+0000","last_active":"2023-11-15T02:37:11.535039+0000","last_peered":"2023-11-15T02:37:11.535039+0000","last_clean":"2023-11-15T02:37:11.535039+0000","last_became_active":"2023-11-15T02:37:11.135610+0000","last_became_peered":"2023-11-15T02:37:11.135610+0000","last_unstale":"2023-11-15T02:37:11.535039+0000","last_undegraded":"2023-11-15T02:37:11.535039+0000","last_fullsized":"2023-11-15T02:37:11.535039+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.530918+0000","last_change":"2023-11-15T02:37:11.527794+0000","last_active":"2023-11-15T02:37:11.530918+0000","last_peered":"2023-11-15T02:37:11.530918+0000","last_clean":"2023-11-15T02:37:11.530918+0000","last_became_active":"2023-11-15T02:37:11.527527+0000","last_became_peered":"2023-11-15T02:37:11.527527+0000","last_unstale":"2023-11-15T02:37:11.530918+0000","last_undegraded":"2023-11-15T02:37:11.530918+0000","last_fullsized":"2023-11-15T02:37:11.530918+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513230+0000","last_change":"2023-11-15T02:37:11.135916+0000","last_active":"2023-11-15T02:37:11.513230+0000","last_peered":"2023-11-15T02:37:11.513230+0000","last_clean":"2023-11-15T02:37:11.513230+0000","last_became_active":"2023-11-15T02:37:11.135590+0000","last_became_peered":"2023-11-15T02:37:11.135590+0000","last_unstale":"2023-11-15T02:37:11.513230+0000","last_undegraded":"2023-11-15T02:37:11.513230+0000","last_fullsized":"2023-11-15T02:37:11.513230+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534550+0000","last_change":"2023-11-15T02:37:11.532197+0000","last_active":"2023-11-15T02:37:11.534550+0000","last_peered":"2023-11-15T02:37:11.534550+0000","last_clean":"2023-11-15T02:37:11.534550+0000","last_became_active":"2023-11-15T02:37:11.531860+0000","last_became_peered":"2023-11-15T02:37:11.531860+0000","last_unstale":"2023-11-15T02:37:11.534550+0000","last_undegraded":"2023-11-15T02:37:11.534550+0000","last_fullsized":"2023-11-15T02:37:11.534550+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.521034+0000","last_change":"2023-11-15T02:37:11.142090+0000","last_active":"2023-11-15T02:37:11.521034+0000","last_peered":"2023-11-15T02:37:11.521034+0000","last_clean":"2023-11-15T02:37:11.521034+0000","last_became_active":"2023-11-15T02:37:11.141803+0000","last_became_peered":"2023-11-15T02:37:11.141803+0000","last_unstale":"2023-11-15T02:37:11.521034+0000","last_undegraded":"2023-11-15T02:37:11.521034+0000","last_fullsized":"2023-11-15T02:37:11.521034+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534210+0000","last_change":"2023-11-15T02:37:11.532532+0000","last_active":"2023-11-15T02:37:11.534210+0000","last_peered":"2023-11-15T02:37:11.534210+0000","last_clean":"2023-11-15T02:37:11.534210+0000","last_became_active":"2023-11-15T02:37:11.532199+0000","last_became_peered":"2023-11-15T02:37:11.532199+0000","last_unstale":"2023-11-15T02:37:11.534210+0000","last_undegraded":"2023-11-15T02:37:11.534210+0000","last_fullsized":"2023-11-15T02:37:11.534210+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528961+0000","last_change":"2023-11-15T02:37:11.136371+0000","last_active":"2023-11-15T02:37:11.528961+0000","last_peered":"2023-11-15T02:37:11.528961+0000","last_clean":"2023-11-15T02:37:11.528961+0000","last_became_active":"2023-11-15T02:37:11.136083+0000","last_became_peered":"2023-11-15T02:37:11.136083+0000","last_unstale":"2023-11-15T02:37:11.528961+0000","last_undegraded":"2023-11-15T02:37:11.528961+0000","last_fullsized":"2023-11-15T02:37:11.528961+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534844+0000","last_change":"2023-11-15T02:37:11.526164+0000","last_active":"2023-11-15T02:37:11.534844+0000","last_peered":"2023-11-15T02:37:11.534844+0000","last_clean":"2023-11-15T02:37:11.534844+0000","last_became_active":"2023-11-15T02:37:11.525902+0000","last_became_peered":"2023-11-15T02:37:11.525902+0000","last_unstale":"2023-11-15T02:37:11.534844+0000","last_undegraded":"2023-11-15T02:37:11.534844+0000","last_fullsized":"2023-11-15T02:37:11.534844+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.517994+0000","last_change":"2023-11-15T02:37:11.144956+0000","last_active":"2023-11-15T02:37:11.517994+0000","last_peered":"2023-11-15T02:37:11.517994+0000","last_clean":"2023-11-15T02:37:11.517994+0000","last_became_active":"2023-11-15T02:37:11.143804+0000","last_became_peered":"2023-11-15T02:37:11.143804+0000","last_unstale":"2023-11-15T02:37:11.517994+0000","last_undegraded":"2023-11-15T02:37:11.517994+0000","last_fullsized":"2023-11-15T02:37:11.517994+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535716+0000","last_change":"2023-11-15T02:37:11.533485+0000","last_active":"2023-11-15T02:37:11.535716+0000","last_peered":"2023-11-15T02:37:11.535716+0000","last_clean":"2023-11-15T02:37:11.535716+0000","last_became_active":"2023-11-15T02:37:11.533046+0000","last_became_peered":"2023-11-15T02:37:11.533046+0000","last_unstale":"2023-11-15T02:37:11.535716+0000","last_undegraded":"2023-11-15T02:37:11.535716+0000","last_fullsized":"2023-11-15T02:37:11.535716+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510921+0000","last_change":"2023-11-15T02:37:11.138410+0000","last_active":"2023-11-15T02:37:11.510921+0000","last_peered":"2023-11-15T02:37:11.510921+0000","last_clean":"2023-11-15T02:37:11.510921+0000","last_became_active":"2023-11-15T02:37:11.138131+0000","last_became_peered":"2023-11-15T02:37:11.138131+0000","last_unstale":"2023-11-15T02:37:11.510921+0000","last_undegraded":"2023-11-15T02:37:11.510921+0000","last_fullsized":"2023-11-15T02:37:11.510921+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524936+0000","last_change":"2023-11-15T02:37:11.521807+0000","last_active":"2023-11-15T02:37:11.524936+0000","last_peered":"2023-11-15T02:37:11.524936+0000","last_clean":"2023-11-15T02:37:11.524936+0000","last_became_active":"2023-11-15T02:37:11.521312+0000","last_became_peered":"2023-11-15T02:37:11.521312+0000","last_unstale":"2023-11-15T02:37:11.524936+0000","last_undegraded":"2023-11-15T02:37:11.524936+0000","last_fullsized":"2023-11-15T02:37:11.524936+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526411+0000","last_change":"2023-11-15T02:37:11.137674+0000","last_active":"2023-11-15T02:37:11.526411+0000","last_peered":"2023-11-15T02:37:11.526411+0000","last_clean":"2023-11-15T02:37:11.526411+0000","last_became_active":"2023-11-15T02:37:11.136376+0000","last_became_peered":"2023-11-15T02:37:11.136376+0000","last_unstale":"2023-11-15T02:37:11.526411+0000","last_undegraded":"2023-11-15T02:37:11.526411+0000","last_fullsized":"2023-11-15T02:37:11.526411+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.525888+0000","last_change":"2023-11-15T02:37:11.520614+0000","last_active":"2023-11-15T02:37:11.525888+0000","last_peered":"2023-11-15T02:37:11.525888+0000","last_clean":"2023-11-15T02:37:11.525888+0000","last_became_active":"2023-11-15T02:37:11.520282+0000","last_became_peered":"2023-11-15T02:37:11.520282+0000","last_unstale":"2023-11-15T02:37:11.525888+0000","last_undegraded":"2023-11-15T02:37:11.525888+0000","last_fullsized":"2023-11-15T02:37:11.525888+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510123+0000","last_change":"2023-11-15T02:37:11.136684+0000","last_active":"2023-11-15T02:37:11.510123+0000","last_peered":"2023-11-15T02:37:11.510123+0000","last_clean":"2023-11-15T02:37:11.510123+0000","last_became_active":"2023-11-15T02:37:11.135923+0000","last_became_peered":"2023-11-15T02:37:11.135923+0000","last_unstale":"2023-11-15T02:37:11.510123+0000","last_undegraded":"2023-11-15T02:37:11.510123+0000","last_fullsized":"2023-11-15T02:37:11.510123+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533629+0000","last_change":"2023-11-15T02:37:11.533016+0000","last_active":"2023-11-15T02:37:11.533629+0000","last_peered":"2023-11-15T02:37:11.533629+0000","last_clean":"2023-11-15T02:37:11.533629+0000","last_became_active":"2023-11-15T02:37:11.532722+0000","last_became_peered":"2023-11-15T02:37:11.532722+0000","last_unstale":"2023-11-15T02:37:11.533629+0000","last_undegraded":"2023-11-15T02:37:11.533629+0000","last_fullsized":"2023-11-15T02:37:11.533629+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.531510+0000","last_change":"2023-11-15T02:37:11.144826+0000","last_active":"2023-11-15T02:37:11.531510+0000","last_peered":"2023-11-15T02:37:11.531510+0000","last_clean":"2023-11-15T02:37:11.531510+0000","last_became_active":"2023-11-15T02:37:11.144233+0000","last_became_peered":"2023-11-15T02:37:11.144233+0000","last_unstale":"2023-11-15T02:37:11.531510+0000","last_undegraded":"2023-11-15T02:37:11.531510+0000","last_fullsized":"2023-11-15T02:37:11.531510+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524044+0000","last_change":"2023-11-15T02:37:11.521563+0000","last_active":"2023-11-15T02:37:11.524044+0000","last_peered":"2023-11-15T02:37:11.524044+0000","last_clean":"2023-11-15T02:37:11.524044+0000","last_became_active":"2023-11-15T02:37:11.521253+0000","last_became_peered":"2023-11-15T02:37:11.521253+0000","last_unstale":"2023-11-15T02:37:11.524044+0000","last_undegraded":"2023-11-15T02:37:11.524044+0000","last_fullsized":"2023-11-15T02:37:11.524044+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513350+0000","last_change":"2023-11-15T02:37:11.138606+0000","last_active":"2023-11-15T02:37:11.513350+0000","last_peered":"2023-11-15T02:37:11.513350+0000","last_clean":"2023-11-15T02:37:11.513350+0000","last_became_active":"2023-11-15T02:37:11.138304+0000","last_became_peered":"2023-11-15T02:37:11.138304+0000","last_unstale":"2023-11-15T02:37:11.513350+0000","last_undegraded":"2023-11-15T02:37:11.513350+0000","last_fullsized":"2023-11-15T02:37:11.513350+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533878+0000","last_change":"2023-11-15T02:37:11.532201+0000","last_active":"2023-11-15T02:37:11.533878+0000","last_peered":"2023-11-15T02:37:11.533878+0000","last_clean":"2023-11-15T02:37:11.533878+0000","last_became_active":"2023-11-15T02:37:11.531882+0000","last_became_peered":"2023-11-15T02:37:11.531882+0000","last_unstale":"2023-11-15T02:37:11.533878+0000","last_undegraded":"2023-11-15T02:37:11.533878+0000","last_fullsized":"2023-11-15T02:37:11.533878+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513376+0000","last_change":"2023-11-15T02:37:11.131935+0000","last_active":"2023-11-15T02:37:11.513376+0000","last_peered":"2023-11-15T02:37:11.513376+0000","last_clean":"2023-11-15T02:37:11.513376+0000","last_became_active":"2023-11-15T02:37:11.131648+0000","last_became_peered":"2023-11-15T02:37:11.131648+0000","last_unstale":"2023-11-15T02:37:11.513376+0000","last_undegraded":"2023-11-15T02:37:11.513376+0000","last_fullsized":"2023-11-15T02:37:11.513376+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534119+0000","last_change":"2023-11-15T02:37:11.531957+0000","last_active":"2023-11-15T02:37:11.534119+0000","last_peered":"2023-11-15T02:37:11.534119+0000","last_clean":"2023-11-15T02:37:11.534119+0000","last_became_active":"2023-11-15T02:37:11.531708+0000","last_became_peered":"2023-11-15T02:37:11.531708+0000","last_unstale":"2023-11-15T02:37:11.534119+0000","last_undegraded":"2023-11-15T02:37:11.534119+0000","last_fullsized":"2023-11-15T02:37:11.534119+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.522736+0000","last_change":"2023-11-15T02:37:11.144563+0000","last_active":"2023-11-15T02:37:11.522736+0000","last_peered":"2023-11-15T02:37:11.522736+0000","last_clean":"2023-11-15T02:37:11.522736+0000","last_became_active":"2023-11-15T02:37:11.144211+0000","last_became_peered":"2023-11-15T02:37:11.144211+0000","last_unstale":"2023-11-15T02:37:11.522736+0000","last_undegraded":"2023-11-15T02:37:11.522736+0000","last_fullsized":"2023-11-15T02:37:11.522736+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524601+0000","last_change":"2023-11-15T02:37:11.520452+0000","last_active":"2023-11-15T02:37:11.524601+0000","last_peered":"2023-11-15T02:37:11.524601+0000","last_clean":"2023-11-15T02:37:11.524601+0000","last_became_active":"2023-11-15T02:37:11.520186+0000","last_became_peered":"2023-11-15T02:37:11.520186+0000","last_unstale":"2023-11-15T02:37:11.524601+0000","last_undegraded":"2023-11-15T02:37:11.524601+0000","last_fullsized":"2023-11-15T02:37:11.524601+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510527+0000","last_change":"2023-11-15T02:37:11.132982+0000","last_active":"2023-11-15T02:37:11.510527+0000","last_peered":"2023-11-15T02:37:11.510527+0000","last_clean":"2023-11-15T02:37:11.510527+0000","last_became_active":"2023-11-15T02:37:11.132658+0000","last_became_peered":"2023-11-15T02:37:11.132658+0000","last_unstale":"2023-11-15T02:37:11.510527+0000","last_undegraded":"2023-11-15T02:37:11.510527+0000","last_fullsized":"2023-11-15T02:37:11.510527+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534072+0000","last_change":"2023-11-15T02:37:11.532754+0000","last_active":"2023-11-15T02:37:11.534072+0000","last_peered":"2023-11-15T02:37:11.534072+0000","last_clean":"2023-11-15T02:37:11.534072+0000","last_became_active":"2023-11-15T02:37:11.532482+0000","last_became_peered":"2023-11-15T02:37:11.532482+0000","last_unstale":"2023-11-15T02:37:11.534072+0000","last_undegraded":"2023-11-15T02:37:11.534072+0000","last_fullsized":"2023-11-15T02:37:11.534072+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-11-15T02:37:13.229648+0000","last_change":"2023-11-15T02:37:11.137869+0000","last_active":"2023-11-15T02:37:13.229648+0000","last_peered":"2023-11-15T02:37:13.229648+0000","last_clean":"2023-11-15T02:37:13.229648+0000","last_became_active":"2023-11-15T02:37:11.137555+0000","last_became_peered":"2023-11-15T02:37:11.137555+0000","last_unstale":"2023-11-15T02:37:13.229648+0000","last_undegraded":"2023-11-15T02:37:13.229648+0000","last_fullsized":"2023-11-15T02:37:13.229648+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528578+0000","last_change":"2023-11-15T02:37:11.525346+0000","last_active":"2023-11-15T02:37:11.528578+0000","last_peered":"2023-11-15T02:37:11.528578+0000","last_clean":"2023-11-15T02:37:11.528578+0000","last_became_active":"2023-11-15T02:37:11.525079+0000","last_became_peered":"2023-11-15T02:37:11.525079+0000","last_unstale":"2023-11-15T02:37:11.528578+0000","last_undegraded":"2023-11-15T02:37:11.528578+0000","last_fullsized":"2023-11-15T02:37:11.528578+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.510715+0000","last_change":"2023-11-15T02:37:11.133547+0000","last_active":"2023-11-15T02:37:11.510715+0000","last_peered":"2023-11-15T02:37:11.510715+0000","last_clean":"2023-11-15T02:37:11.510715+0000","last_became_active":"2023-11-15T02:37:11.133276+0000","last_became_peered":"2023-11-15T02:37:11.133276+0000","last_unstale":"2023-11-15T02:37:11.510715+0000","last_undegraded":"2023-11-15T02:37:11.510715+0000","last_fullsized":"2023-11-15T02:37:11.510715+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.522175+0000","last_change":"2023-11-15T02:37:11.520512+0000","last_active":"2023-11-15T02:37:11.522175+0000","last_peered":"2023-11-15T02:37:11.522175+0000","last_clean":"2023-11-15T02:37:11.522175+0000","last_became_active":"2023-11-15T02:37:11.520227+0000","last_became_peered":"2023-11-15T02:37:11.520227+0000","last_unstale":"2023-11-15T02:37:11.522175+0000","last_undegraded":"2023-11-15T02:37:11.522175+0000","last_fullsized":"2023-11-15T02:37:11.522175+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514923+0000","last_change":"2023-11-15T02:37:11.127060+0000","last_active":"2023-11-15T02:37:11.514923+0000","last_peered":"2023-11-15T02:37:11.514923+0000","last_clean":"2023-11-15T02:37:11.514923+0000","last_became_active":"2023-11-15T02:37:11.126765+0000","last_became_peered":"2023-11-15T02:37:11.126765+0000","last_unstale":"2023-11-15T02:37:11.514923+0000","last_undegraded":"2023-11-15T02:37:11.514923+0000","last_fullsized":"2023-11-15T02:37:11.514923+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.529831+0000","last_change":"2023-11-15T02:37:11.527043+0000","last_active":"2023-11-15T02:37:11.529831+0000","last_peered":"2023-11-15T02:37:11.529831+0000","last_clean":"2023-11-15T02:37:11.529831+0000","last_became_active":"2023-11-15T02:37:11.526062+0000","last_became_peered":"2023-11-15T02:37:11.526062+0000","last_unstale":"2023-11-15T02:37:11.529831+0000","last_undegraded":"2023-11-15T02:37:11.529831+0000","last_fullsized":"2023-11-15T02:37:11.529831+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512158+0000","last_change":"2023-11-15T02:37:11.135020+0000","last_active":"2023-11-15T02:37:11.512158+0000","last_peered":"2023-11-15T02:37:11.512158+0000","last_clean":"2023-11-15T02:37:11.512158+0000","last_became_active":"2023-11-15T02:37:11.134736+0000","last_became_peered":"2023-11-15T02:37:11.134736+0000","last_unstale":"2023-11-15T02:37:11.512158+0000","last_undegraded":"2023-11-15T02:37:11.512158+0000","last_fullsized":"2023-11-15T02:37:11.512158+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533074+0000","last_change":"2023-11-15T02:37:11.526058+0000","last_active":"2023-11-15T02:37:11.533074+0000","last_peered":"2023-11-15T02:37:11.533074+0000","last_clean":"2023-11-15T02:37:11.533074+0000","last_became_active":"2023-11-15T02:37:11.525787+0000","last_became_peered":"2023-11-15T02:37:11.525787+0000","last_unstale":"2023-11-15T02:37:11.533074+0000","last_undegraded":"2023-11-15T02:37:11.533074+0000","last_fullsized":"2023-11-15T02:37:11.533074+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513463+0000","last_change":"2023-11-15T02:37:11.142039+0000","last_active":"2023-11-15T02:37:11.513463+0000","last_peered":"2023-11-15T02:37:11.513463+0000","last_clean":"2023-11-15T02:37:11.513463+0000","last_became_active":"2023-11-15T02:37:11.138870+0000","last_became_peered":"2023-11-15T02:37:11.138870+0000","last_unstale":"2023-11-15T02:37:11.513463+0000","last_undegraded":"2023-11-15T02:37:11.513463+0000","last_fullsized":"2023-11-15T02:37:11.513463+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524311+0000","last_change":"2023-11-15T02:37:11.516462+0000","last_active":"2023-11-15T02:37:11.524311+0000","last_peered":"2023-11-15T02:37:11.524311+0000","last_clean":"2023-11-15T02:37:11.524311+0000","last_became_active":"2023-11-15T02:37:11.516173+0000","last_became_peered":"2023-11-15T02:37:11.516173+0000","last_unstale":"2023-11-15T02:37:11.524311+0000","last_undegraded":"2023-11-15T02:37:11.524311+0000","last_fullsized":"2023-11-15T02:37:11.524311+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.516846+0000","last_change":"2023-11-15T02:37:11.131463+0000","last_active":"2023-11-15T02:37:11.516846+0000","last_peered":"2023-11-15T02:37:11.516846+0000","last_clean":"2023-11-15T02:37:11.516846+0000","last_became_active":"2023-11-15T02:37:11.131169+0000","last_became_peered":"2023-11-15T02:37:11.131169+0000","last_unstale":"2023-11-15T02:37:11.516846+0000","last_undegraded":"2023-11-15T02:37:11.516846+0000","last_fullsized":"2023-11-15T02:37:11.516846+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535324+0000","last_change":"2023-11-15T02:37:11.533241+0000","last_active":"2023-11-15T02:37:11.535324+0000","last_peered":"2023-11-15T02:37:11.535324+0000","last_clean":"2023-11-15T02:37:11.535324+0000","last_became_active":"2023-11-15T02:37:11.532946+0000","last_became_peered":"2023-11-15T02:37:11.532946+0000","last_unstale":"2023-11-15T02:37:11.535324+0000","last_undegraded":"2023-11-15T02:37:11.535324+0000","last_fullsized":"2023-11-15T02:37:11.535324+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.508592+0000","last_change":"2023-11-15T02:37:11.135042+0000","last_active":"2023-11-15T02:37:11.508592+0000","last_peered":"2023-11-15T02:37:11.508592+0000","last_clean":"2023-11-15T02:37:11.508592+0000","last_became_active":"2023-11-15T02:37:11.134750+0000","last_became_peered":"2023-11-15T02:37:11.134750+0000","last_unstale":"2023-11-15T02:37:11.508592+0000","last_undegraded":"2023-11-15T02:37:11.508592+0000","last_fullsized":"2023-11-15T02:37:11.508592+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534117+0000","last_change":"2023-11-15T02:37:11.531934+0000","last_active":"2023-11-15T02:37:11.534117+0000","last_peered":"2023-11-15T02:37:11.534117+0000","last_clean":"2023-11-15T02:37:11.534117+0000","last_became_active":"2023-11-15T02:37:11.531488+0000","last_became_peered":"2023-11-15T02:37:11.531488+0000","last_unstale":"2023-11-15T02:37:11.534117+0000","last_undegraded":"2023-11-15T02:37:11.534117+0000","last_fullsized":"2023-11-15T02:37:11.534117+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.531593+0000","last_change":"2023-11-15T02:37:11.131225+0000","last_active":"2023-11-15T02:37:11.531593+0000","last_peered":"2023-11-15T02:37:11.531593+0000","last_clean":"2023-11-15T02:37:11.531593+0000","last_became_active":"2023-11-15T02:37:11.130952+0000","last_became_peered":"2023-11-15T02:37:11.130952+0000","last_unstale":"2023-11-15T02:37:11.531593+0000","last_undegraded":"2023-11-15T02:37:11.531593+0000","last_fullsized":"2023-11-15T02:37:11.531593+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.531108+0000","last_change":"2023-11-15T02:37:11.529835+0000","last_active":"2023-11-15T02:37:11.531108+0000","last_peered":"2023-11-15T02:37:11.531108+0000","last_clean":"2023-11-15T02:37:11.531108+0000","last_became_active":"2023-11-15T02:37:11.529617+0000","last_became_peered":"2023-11-15T02:37:11.529617+0000","last_unstale":"2023-11-15T02:37:11.531108+0000","last_undegraded":"2023-11-15T02:37:11.531108+0000","last_fullsized":"2023-11-15T02:37:11.531108+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536892+0000","last_change":"2023-11-15T02:37:11.145324+0000","last_active":"2023-11-15T02:37:11.536892+0000","last_peered":"2023-11-15T02:37:11.536892+0000","last_clean":"2023-11-15T02:37:11.536892+0000","last_became_active":"2023-11-15T02:37:11.144842+0000","last_became_peered":"2023-11-15T02:37:11.144842+0000","last_unstale":"2023-11-15T02:37:11.536892+0000","last_undegraded":"2023-11-15T02:37:11.536892+0000","last_fullsized":"2023-11-15T02:37:11.536892+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.519519+0000","last_change":"2023-11-15T02:37:11.518532+0000","last_active":"2023-11-15T02:37:11.519519+0000","last_peered":"2023-11-15T02:37:11.519519+0000","last_clean":"2023-11-15T02:37:11.519519+0000","last_became_active":"2023-11-15T02:37:11.518235+0000","last_became_peered":"2023-11-15T02:37:11.518235+0000","last_unstale":"2023-11-15T02:37:11.519519+0000","last_undegraded":"2023-11-15T02:37:11.519519+0000","last_fullsized":"2023-11-15T02:37:11.519519+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.537111+0000","last_change":"2023-11-15T02:37:11.146378+0000","last_active":"2023-11-15T02:37:11.537111+0000","last_peered":"2023-11-15T02:37:11.537111+0000","last_clean":"2023-11-15T02:37:11.537111+0000","last_became_active":"2023-11-15T02:37:11.146096+0000","last_became_peered":"2023-11-15T02:37:11.146096+0000","last_unstale":"2023-11-15T02:37:11.537111+0000","last_undegraded":"2023-11-15T02:37:11.537111+0000","last_fullsized":"2023-11-15T02:37:11.537111+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.537964+0000","last_change":"2023-11-15T02:37:11.537305+0000","last_active":"2023-11-15T02:37:11.537964+0000","last_peered":"2023-11-15T02:37:11.537964+0000","last_clean":"2023-11-15T02:37:11.537964+0000","last_became_active":"2023-11-15T02:37:11.537004+0000","last_became_peered":"2023-11-15T02:37:11.537004+0000","last_unstale":"2023-11-15T02:37:11.537964+0000","last_undegraded":"2023-11-15T02:37:11.537964+0000","last_fullsized":"2023-11-15T02:37:11.537964+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512534+0000","last_change":"2023-11-15T02:37:11.139083+0000","last_active":"2023-11-15T02:37:11.512534+0000","last_peered":"2023-11-15T02:37:11.512534+0000","last_clean":"2023-11-15T02:37:11.512534+0000","last_became_active":"2023-11-15T02:37:11.138796+0000","last_became_peered":"2023-11-15T02:37:11.138796+0000","last_unstale":"2023-11-15T02:37:11.512534+0000","last_undegraded":"2023-11-15T02:37:11.512534+0000","last_fullsized":"2023-11-15T02:37:11.512534+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535745+0000","last_change":"2023-11-15T02:37:11.530506+0000","last_active":"2023-11-15T02:37:11.535745+0000","last_peered":"2023-11-15T02:37:11.535745+0000","last_clean":"2023-11-15T02:37:11.535745+0000","last_became_active":"2023-11-15T02:37:11.530121+0000","last_became_peered":"2023-11-15T02:37:11.530121+0000","last_unstale":"2023-11-15T02:37:11.535745+0000","last_undegraded":"2023-11-15T02:37:11.535745+0000","last_fullsized":"2023-11-15T02:37:11.535745+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513258+0000","last_change":"2023-11-15T02:37:11.133202+0000","last_active":"2023-11-15T02:37:11.513258+0000","last_peered":"2023-11-15T02:37:11.513258+0000","last_clean":"2023-11-15T02:37:11.513258+0000","last_became_active":"2023-11-15T02:37:11.132905+0000","last_became_peered":"2023-11-15T02:37:11.132905+0000","last_unstale":"2023-11-15T02:37:11.513258+0000","last_undegraded":"2023-11-15T02:37:11.513258+0000","last_fullsized":"2023-11-15T02:37:11.513258+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526983+0000","last_change":"2023-11-15T02:37:11.523616+0000","last_active":"2023-11-15T02:37:11.526983+0000","last_peered":"2023-11-15T02:37:11.526983+0000","last_clean":"2023-11-15T02:37:11.526983+0000","last_became_active":"2023-11-15T02:37:11.523194+0000","last_became_peered":"2023-11-15T02:37:11.523194+0000","last_unstale":"2023-11-15T02:37:11.526983+0000","last_undegraded":"2023-11-15T02:37:11.526983+0000","last_fullsized":"2023-11-15T02:37:11.526983+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.518581+0000","last_change":"2023-11-15T02:37:11.129805+0000","last_active":"2023-11-15T02:37:11.518581+0000","last_peered":"2023-11-15T02:37:11.518581+0000","last_clean":"2023-11-15T02:37:11.518581+0000","last_became_active":"2023-11-15T02:37:11.129553+0000","last_became_peered":"2023-11-15T02:37:11.129553+0000","last_unstale":"2023-11-15T02:37:11.518581+0000","last_undegraded":"2023-11-15T02:37:11.518581+0000","last_fullsized":"2023-11-15T02:37:11.518581+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.523127+0000","last_change":"2023-11-15T02:37:11.522333+0000","last_active":"2023-11-15T02:37:11.523127+0000","last_peered":"2023-11-15T02:37:11.523127+0000","last_clean":"2023-11-15T02:37:11.523127+0000","last_became_active":"2023-11-15T02:37:11.522063+0000","last_became_peered":"2023-11-15T02:37:11.522063+0000","last_unstale":"2023-11-15T02:37:11.523127+0000","last_undegraded":"2023-11-15T02:37:11.523127+0000","last_fullsized":"2023-11-15T02:37:11.523127+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.517303+0000","last_change":"2023-11-15T02:37:11.140912+0000","last_active":"2023-11-15T02:37:11.517303+0000","last_peered":"2023-11-15T02:37:11.517303+0000","last_clean":"2023-11-15T02:37:11.517303+0000","last_became_active":"2023-11-15T02:37:11.140606+0000","last_became_peered":"2023-11-15T02:37:11.140606+0000","last_unstale":"2023-11-15T02:37:11.517303+0000","last_undegraded":"2023-11-15T02:37:11.517303+0000","last_fullsized":"2023-11-15T02:37:11.517303+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526732+0000","last_change":"2023-11-15T02:37:11.521507+0000","last_active":"2023-11-15T02:37:11.526732+0000","last_peered":"2023-11-15T02:37:11.526732+0000","last_clean":"2023-11-15T02:37:11.526732+0000","last_became_active":"2023-11-15T02:37:11.521206+0000","last_became_peered":"2023-11-15T02:37:11.521206+0000","last_unstale":"2023-11-15T02:37:11.526732+0000","last_undegraded":"2023-11-15T02:37:11.526732+0000","last_fullsized":"2023-11-15T02:37:11.526732+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.520647+0000","last_change":"2023-11-15T02:37:11.131674+0000","last_active":"2023-11-15T02:37:11.520647+0000","last_peered":"2023-11-15T02:37:11.520647+0000","last_clean":"2023-11-15T02:37:11.520647+0000","last_became_active":"2023-11-15T02:37:11.131350+0000","last_became_peered":"2023-11-15T02:37:11.131350+0000","last_unstale":"2023-11-15T02:37:11.520647+0000","last_undegraded":"2023-11-15T02:37:11.520647+0000","last_fullsized":"2023-11-15T02:37:11.520647+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536488+0000","last_change":"2023-11-15T02:37:11.534702+0000","last_active":"2023-11-15T02:37:11.536488+0000","last_peered":"2023-11-15T02:37:11.536488+0000","last_clean":"2023-11-15T02:37:11.536488+0000","last_became_active":"2023-11-15T02:37:11.534388+0000","last_became_peered":"2023-11-15T02:37:11.534388+0000","last_unstale":"2023-11-15T02:37:11.536488+0000","last_undegraded":"2023-11-15T02:37:11.536488+0000","last_fullsized":"2023-11-15T02:37:11.536488+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533909+0000","last_change":"2023-11-15T02:37:11.142894+0000","last_active":"2023-11-15T02:37:11.533909+0000","last_peered":"2023-11-15T02:37:11.533909+0000","last_clean":"2023-11-15T02:37:11.533909+0000","last_became_active":"2023-11-15T02:37:11.142437+0000","last_became_peered":"2023-11-15T02:37:11.142437+0000","last_unstale":"2023-11-15T02:37:11.533909+0000","last_undegraded":"2023-11-15T02:37:11.533909+0000","last_fullsized":"2023-11-15T02:37:11.533909+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535692+0000","last_change":"2023-11-15T02:37:11.533321+0000","last_active":"2023-11-15T02:37:11.535692+0000","last_peered":"2023-11-15T02:37:11.535692+0000","last_clean":"2023-11-15T02:37:11.535692+0000","last_became_active":"2023-11-15T02:37:11.532667+0000","last_became_peered":"2023-11-15T02:37:11.532667+0000","last_unstale":"2023-11-15T02:37:11.535692+0000","last_undegraded":"2023-11-15T02:37:11.535692+0000","last_fullsized":"2023-11-15T02:37:11.535692+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536254+0000","last_change":"2023-11-15T02:37:11.144931+0000","last_active":"2023-11-15T02:37:11.536254+0000","last_peered":"2023-11-15T02:37:11.536254+0000","last_clean":"2023-11-15T02:37:11.536254+0000","last_became_active":"2023-11-15T02:37:11.144570+0000","last_became_peered":"2023-11-15T02:37:11.144570+0000","last_unstale":"2023-11-15T02:37:11.536254+0000","last_undegraded":"2023-11-15T02:37:11.536254+0000","last_fullsized":"2023-11-15T02:37:11.536254+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528891+0000","last_change":"2023-11-15T02:37:11.526949+0000","last_active":"2023-11-15T02:37:11.528891+0000","last_peered":"2023-11-15T02:37:11.528891+0000","last_clean":"2023-11-15T02:37:11.528891+0000","last_became_active":"2023-11-15T02:37:11.526662+0000","last_became_peered":"2023-11-15T02:37:11.526662+0000","last_unstale":"2023-11-15T02:37:11.528891+0000","last_undegraded":"2023-11-15T02:37:11.528891+0000","last_fullsized":"2023-11-15T02:37:11.528891+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514456+0000","last_change":"2023-11-15T02:37:11.133572+0000","last_active":"2023-11-15T02:37:11.514456+0000","last_peered":"2023-11-15T02:37:11.514456+0000","last_clean":"2023-11-15T02:37:11.514456+0000","last_became_active":"2023-11-15T02:37:11.133210+0000","last_became_peered":"2023-11-15T02:37:11.133210+0000","last_unstale":"2023-11-15T02:37:11.514456+0000","last_undegraded":"2023-11-15T02:37:11.514456+0000","last_fullsized":"2023-11-15T02:37:11.514456+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528637+0000","last_change":"2023-11-15T02:37:11.526321+0000","last_active":"2023-11-15T02:37:11.528637+0000","last_peered":"2023-11-15T02:37:11.528637+0000","last_clean":"2023-11-15T02:37:11.528637+0000","last_became_active":"2023-11-15T02:37:11.526038+0000","last_became_peered":"2023-11-15T02:37:11.526038+0000","last_unstale":"2023-11-15T02:37:11.528637+0000","last_undegraded":"2023-11-15T02:37:11.528637+0000","last_fullsized":"2023-11-15T02:37:11.528637+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512409+0000","last_change":"2023-11-15T02:37:11.132885+0000","last_active":"2023-11-15T02:37:11.512409+0000","last_peered":"2023-11-15T02:37:11.512409+0000","last_clean":"2023-11-15T02:37:11.512409+0000","last_became_active":"2023-11-15T02:37:11.132493+0000","last_became_peered":"2023-11-15T02:37:11.132493+0000","last_unstale":"2023-11-15T02:37:11.512409+0000","last_undegraded":"2023-11-15T02:37:11.512409+0000","last_fullsized":"2023-11-15T02:37:11.512409+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535940+0000","last_change":"2023-11-15T02:37:11.533007+0000","last_active":"2023-11-15T02:37:11.535940+0000","last_peered":"2023-11-15T02:37:11.535940+0000","last_clean":"2023-11-15T02:37:11.535940+0000","last_became_active":"2023-11-15T02:37:11.532711+0000","last_became_peered":"2023-11-15T02:37:11.532711+0000","last_unstale":"2023-11-15T02:37:11.535940+0000","last_undegraded":"2023-11-15T02:37:11.535940+0000","last_fullsized":"2023-11-15T02:37:11.535940+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.519877+0000","last_change":"2023-11-15T02:37:11.132042+0000","last_active":"2023-11-15T02:37:11.519877+0000","last_peered":"2023-11-15T02:37:11.519877+0000","last_clean":"2023-11-15T02:37:11.519877+0000","last_became_active":"2023-11-15T02:37:11.131721+0000","last_became_peered":"2023-11-15T02:37:11.131721+0000","last_unstale":"2023-11-15T02:37:11.519877+0000","last_undegraded":"2023-11-15T02:37:11.519877+0000","last_fullsized":"2023-11-15T02:37:11.519877+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524036+0000","last_change":"2023-11-15T02:37:11.522744+0000","last_active":"2023-11-15T02:37:11.524036+0000","last_peered":"2023-11-15T02:37:11.524036+0000","last_clean":"2023-11-15T02:37:11.524036+0000","last_became_active":"2023-11-15T02:37:11.522359+0000","last_became_peered":"2023-11-15T02:37:11.522359+0000","last_unstale":"2023-11-15T02:37:11.524036+0000","last_undegraded":"2023-11-15T02:37:11.524036+0000","last_fullsized":"2023-11-15T02:37:11.524036+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513564+0000","last_change":"2023-11-15T02:37:11.139252+0000","last_active":"2023-11-15T02:37:11.513564+0000","last_peered":"2023-11-15T02:37:11.513564+0000","last_clean":"2023-11-15T02:37:11.513564+0000","last_became_active":"2023-11-15T02:37:11.138855+0000","last_became_peered":"2023-11-15T02:37:11.138855+0000","last_unstale":"2023-11-15T02:37:11.513564+0000","last_undegraded":"2023-11-15T02:37:11.513564+0000","last_fullsized":"2023-11-15T02:37:11.513564+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535771+0000","last_change":"2023-11-15T02:37:11.533811+0000","last_active":"2023-11-15T02:37:11.535771+0000","last_peered":"2023-11-15T02:37:11.535771+0000","last_clean":"2023-11-15T02:37:11.535771+0000","last_became_active":"2023-11-15T02:37:11.533437+0000","last_became_peered":"2023-11-15T02:37:11.533437+0000","last_unstale":"2023-11-15T02:37:11.535771+0000","last_undegraded":"2023-11-15T02:37:11.535771+0000","last_fullsized":"2023-11-15T02:37:11.535771+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512133+0000","last_change":"2023-11-15T02:37:11.129579+0000","last_active":"2023-11-15T02:37:11.512133+0000","last_peered":"2023-11-15T02:37:11.512133+0000","last_clean":"2023-11-15T02:37:11.512133+0000","last_became_active":"2023-11-15T02:37:11.129102+0000","last_became_peered":"2023-11-15T02:37:11.129102+0000","last_unstale":"2023-11-15T02:37:11.512133+0000","last_undegraded":"2023-11-15T02:37:11.512133+0000","last_fullsized":"2023-11-15T02:37:11.512133+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.522568+0000","last_change":"2023-11-15T02:37:11.517937+0000","last_active":"2023-11-15T02:37:11.522568+0000","last_peered":"2023-11-15T02:37:11.522568+0000","last_clean":"2023-11-15T02:37:11.522568+0000","last_became_active":"2023-11-15T02:37:11.517664+0000","last_became_peered":"2023-11-15T02:37:11.517664+0000","last_unstale":"2023-11-15T02:37:11.522568+0000","last_undegraded":"2023-11-15T02:37:11.522568+0000","last_fullsized":"2023-11-15T02:37:11.522568+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514490+0000","last_change":"2023-11-15T02:37:11.131730+0000","last_active":"2023-11-15T02:37:11.514490+0000","last_peered":"2023-11-15T02:37:11.514490+0000","last_clean":"2023-11-15T02:37:11.514490+0000","last_became_active":"2023-11-15T02:37:11.131437+0000","last_became_peered":"2023-11-15T02:37:11.131437+0000","last_unstale":"2023-11-15T02:37:11.514490+0000","last_undegraded":"2023-11-15T02:37:11.514490+0000","last_fullsized":"2023-11-15T02:37:11.514490+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.531631+0000","last_change":"2023-11-15T02:37:11.522292+0000","last_active":"2023-11-15T02:37:11.531631+0000","last_peered":"2023-11-15T02:37:11.531631+0000","last_clean":"2023-11-15T02:37:11.531631+0000","last_became_active":"2023-11-15T02:37:11.522044+0000","last_became_peered":"2023-11-15T02:37:11.522044+0000","last_unstale":"2023-11-15T02:37:11.531631+0000","last_undegraded":"2023-11-15T02:37:11.531631+0000","last_fullsized":"2023-11-15T02:37:11.531631+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528185+0000","last_change":"2023-11-15T02:37:11.132610+0000","last_active":"2023-11-15T02:37:11.528185+0000","last_peered":"2023-11-15T02:37:11.528185+0000","last_clean":"2023-11-15T02:37:11.528185+0000","last_became_active":"2023-11-15T02:37:11.132317+0000","last_became_peered":"2023-11-15T02:37:11.132317+0000","last_unstale":"2023-11-15T02:37:11.528185+0000","last_undegraded":"2023-11-15T02:37:11.528185+0000","last_fullsized":"2023-11-15T02:37:11.528185+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.534578+0000","last_change":"2023-11-15T02:37:11.532374+0000","last_active":"2023-11-15T02:37:11.534578+0000","last_peered":"2023-11-15T02:37:11.534578+0000","last_clean":"2023-11-15T02:37:11.534578+0000","last_became_active":"2023-11-15T02:37:11.531978+0000","last_became_peered":"2023-11-15T02:37:11.531978+0000","last_unstale":"2023-11-15T02:37:11.534578+0000","last_undegraded":"2023-11-15T02:37:11.534578+0000","last_fullsized":"2023-11-15T02:37:11.534578+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.518343+0000","last_change":"2023-11-15T02:37:11.143661+0000","last_active":"2023-11-15T02:37:11.518343+0000","last_peered":"2023-11-15T02:37:11.518343+0000","last_clean":"2023-11-15T02:37:11.518343+0000","last_became_active":"2023-11-15T02:37:11.143395+0000","last_became_peered":"2023-11-15T02:37:11.143395+0000","last_unstale":"2023-11-15T02:37:11.518343+0000","last_undegraded":"2023-11-15T02:37:11.518343+0000","last_fullsized":"2023-11-15T02:37:11.518343+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.527851+0000","last_change":"2023-11-15T02:37:11.521941+0000","last_active":"2023-11-15T02:37:11.527851+0000","last_peered":"2023-11-15T02:37:11.527851+0000","last_clean":"2023-11-15T02:37:11.527851+0000","last_became_active":"2023-11-15T02:37:11.521648+0000","last_became_peered":"2023-11-15T02:37:11.521648+0000","last_unstale":"2023-11-15T02:37:11.527851+0000","last_undegraded":"2023-11-15T02:37:11.527851+0000","last_fullsized":"2023-11-15T02:37:11.527851+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.514553+0000","last_change":"2023-11-15T02:37:11.136397+0000","last_active":"2023-11-15T02:37:11.514553+0000","last_peered":"2023-11-15T02:37:11.514553+0000","last_clean":"2023-11-15T02:37:11.514553+0000","last_became_active":"2023-11-15T02:37:11.136081+0000","last_became_peered":"2023-11-15T02:37:11.136081+0000","last_unstale":"2023-11-15T02:37:11.514553+0000","last_undegraded":"2023-11-15T02:37:11.514553+0000","last_fullsized":"2023-11-15T02:37:11.514553+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.533360+0000","last_change":"2023-11-15T02:37:11.527925+0000","last_active":"2023-11-15T02:37:11.533360+0000","last_peered":"2023-11-15T02:37:11.533360+0000","last_clean":"2023-11-15T02:37:11.533360+0000","last_became_active":"2023-11-15T02:37:11.526688+0000","last_became_peered":"2023-11-15T02:37:11.526688+0000","last_unstale":"2023-11-15T02:37:11.533360+0000","last_undegraded":"2023-11-15T02:37:11.533360+0000","last_fullsized":"2023-11-15T02:37:11.533360+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.518084+0000","last_change":"2023-11-15T02:37:11.135021+0000","last_active":"2023-11-15T02:37:11.518084+0000","last_peered":"2023-11-15T02:37:11.518084+0000","last_clean":"2023-11-15T02:37:11.518084+0000","last_became_active":"2023-11-15T02:37:11.133753+0000","last_became_peered":"2023-11-15T02:37:11.133753+0000","last_unstale":"2023-11-15T02:37:11.518084+0000","last_undegraded":"2023-11-15T02:37:11.518084+0000","last_fullsized":"2023-11-15T02:37:11.518084+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524071+0000","last_change":"2023-11-15T02:37:11.521924+0000","last_active":"2023-11-15T02:37:11.524071+0000","last_peered":"2023-11-15T02:37:11.524071+0000","last_clean":"2023-11-15T02:37:11.524071+0000","last_became_active":"2023-11-15T02:37:11.521625+0000","last_became_peered":"2023-11-15T02:37:11.521625+0000","last_unstale":"2023-11-15T02:37:11.524071+0000","last_undegraded":"2023-11-15T02:37:11.524071+0000","last_fullsized":"2023-11-15T02:37:11.524071+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.517021+0000","last_change":"2023-11-15T02:37:11.134111+0000","last_active":"2023-11-15T02:37:11.517021+0000","last_peered":"2023-11-15T02:37:11.517021+0000","last_clean":"2023-11-15T02:37:11.517021+0000","last_became_active":"2023-11-15T02:37:11.133797+0000","last_became_peered":"2023-11-15T02:37:11.133797+0000","last_unstale":"2023-11-15T02:37:11.517021+0000","last_undegraded":"2023-11-15T02:37:11.517021+0000","last_fullsized":"2023-11-15T02:37:11.517021+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.530553+0000","last_change":"2023-11-15T02:37:11.526898+0000","last_active":"2023-11-15T02:37:11.530553+0000","last_peered":"2023-11-15T02:37:11.530553+0000","last_clean":"2023-11-15T02:37:11.530553+0000","last_became_active":"2023-11-15T02:37:11.526610+0000","last_became_peered":"2023-11-15T02:37:11.526610+0000","last_unstale":"2023-11-15T02:37:11.530553+0000","last_undegraded":"2023-11-15T02:37:11.530553+0000","last_fullsized":"2023-11-15T02:37:11.530553+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.509580+0000","last_change":"2023-11-15T02:37:11.132901+0000","last_active":"2023-11-15T02:37:11.509580+0000","last_peered":"2023-11-15T02:37:11.509580+0000","last_clean":"2023-11-15T02:37:11.509580+0000","last_became_active":"2023-11-15T02:37:11.132583+0000","last_became_peered":"2023-11-15T02:37:11.132583+0000","last_unstale":"2023-11-15T02:37:11.509580+0000","last_undegraded":"2023-11-15T02:37:11.509580+0000","last_fullsized":"2023-11-15T02:37:11.509580+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.523106+0000","last_change":"2023-11-15T02:37:11.521103+0000","last_active":"2023-11-15T02:37:11.523106+0000","last_peered":"2023-11-15T02:37:11.523106+0000","last_clean":"2023-11-15T02:37:11.523106+0000","last_became_active":"2023-11-15T02:37:11.520591+0000","last_became_peered":"2023-11-15T02:37:11.520591+0000","last_unstale":"2023-11-15T02:37:11.523106+0000","last_undegraded":"2023-11-15T02:37:11.523106+0000","last_fullsized":"2023-11-15T02:37:11.523106+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.516861+0000","last_change":"2023-11-15T02:37:11.137659+0000","last_active":"2023-11-15T02:37:11.516861+0000","last_peered":"2023-11-15T02:37:11.516861+0000","last_clean":"2023-11-15T02:37:11.516861+0000","last_became_active":"2023-11-15T02:37:11.137320+0000","last_became_peered":"2023-11-15T02:37:11.137320+0000","last_unstale":"2023-11-15T02:37:11.516861+0000","last_undegraded":"2023-11-15T02:37:11.516861+0000","last_fullsized":"2023-11-15T02:37:11.516861+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536414+0000","last_change":"2023-11-15T02:37:11.535225+0000","last_active":"2023-11-15T02:37:11.536414+0000","last_peered":"2023-11-15T02:37:11.536414+0000","last_clean":"2023-11-15T02:37:11.536414+0000","last_became_active":"2023-11-15T02:37:11.534718+0000","last_became_peered":"2023-11-15T02:37:11.534718+0000","last_unstale":"2023-11-15T02:37:11.536414+0000","last_undegraded":"2023-11-15T02:37:11.536414+0000","last_fullsized":"2023-11-15T02:37:11.536414+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.523332+0000","last_change":"2023-11-15T02:37:11.142425+0000","last_active":"2023-11-15T02:37:11.523332+0000","last_peered":"2023-11-15T02:37:11.523332+0000","last_clean":"2023-11-15T02:37:11.523332+0000","last_became_active":"2023-11-15T02:37:11.141843+0000","last_became_peered":"2023-11-15T02:37:11.141843+0000","last_unstale":"2023-11-15T02:37:11.523332+0000","last_undegraded":"2023-11-15T02:37:11.523332+0000","last_fullsized":"2023-11-15T02:37:11.523332+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536556+0000","last_change":"2023-11-15T02:37:11.535377+0000","last_active":"2023-11-15T02:37:11.536556+0000","last_peered":"2023-11-15T02:37:11.536556+0000","last_clean":"2023-11-15T02:37:11.536556+0000","last_became_active":"2023-11-15T02:37:11.535019+0000","last_became_peered":"2023-11-15T02:37:11.535019+0000","last_unstale":"2023-11-15T02:37:11.536556+0000","last_undegraded":"2023-11-15T02:37:11.536556+0000","last_fullsized":"2023-11-15T02:37:11.536556+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535527+0000","last_change":"2023-11-15T02:37:11.132912+0000","last_active":"2023-11-15T02:37:11.535527+0000","last_peered":"2023-11-15T02:37:11.535527+0000","last_clean":"2023-11-15T02:37:11.535527+0000","last_became_active":"2023-11-15T02:37:11.132624+0000","last_became_peered":"2023-11-15T02:37:11.132624+0000","last_unstale":"2023-11-15T02:37:11.535527+0000","last_undegraded":"2023-11-15T02:37:11.535527+0000","last_fullsized":"2023-11-15T02:37:11.535527+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512622+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:37:11.512622+0000","last_peered":"2023-11-15T02:37:11.512622+0000","last_clean":"2023-11-15T02:37:11.512622+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:37:11.512622+0000","last_undegraded":"2023-11-15T02:37:11.512622+0000","last_fullsized":"2023-11-15T02:37:11.512622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.524918+0000","last_change":"2023-11-15T02:37:11.521619+0000","last_active":"2023-11-15T02:37:11.524918+0000","last_peered":"2023-11-15T02:37:11.524918+0000","last_clean":"2023-11-15T02:37:11.524918+0000","last_became_active":"2023-11-15T02:37:11.520927+0000","last_became_peered":"2023-11-15T02:37:11.520927+0000","last_unstale":"2023-11-15T02:37:11.524918+0000","last_undegraded":"2023-11-15T02:37:11.524918+0000","last_fullsized":"2023-11-15T02:37:11.524918+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"176'3","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.535460+0000","last_change":"2023-11-15T02:37:11.130795+0000","last_active":"2023-11-15T02:37:11.535460+0000","last_peered":"2023-11-15T02:37:11.535460+0000","last_clean":"2023-11-15T02:37:11.535460+0000","last_became_active":"2023-11-15T02:37:11.130494+0000","last_became_peered":"2023-11-15T02:37:11.130494+0000","last_unstale":"2023-11-15T02:37:11.535460+0000","last_undegraded":"2023-11-15T02:37:11.535460+0000","last_fullsized":"2023-11-15T02:37:11.535460+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":146,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.516694+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:37:11.516694+0000","last_peered":"2023-11-15T02:37:11.516694+0000","last_clean":"2023-11-15T02:37:11.516694+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:37:11.516694+0000","last_undegraded":"2023-11-15T02:37:11.516694+0000","last_fullsized":"2023-11-15T02:37:11.516694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536132+0000","last_change":"2023-11-15T02:37:11.535066+0000","last_active":"2023-11-15T02:37:11.536132+0000","last_peered":"2023-11-15T02:37:11.536132+0000","last_clean":"2023-11-15T02:37:11.536132+0000","last_became_active":"2023-11-15T02:37:11.534648+0000","last_became_peered":"2023-11-15T02:37:11.534648+0000","last_unstale":"2023-11-15T02:37:11.536132+0000","last_undegraded":"2023-11-15T02:37:11.536132+0000","last_fullsized":"2023-11-15T02:37:11.536132+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.518450+0000","last_change":"2023-11-15T02:37:11.137646+0000","last_active":"2023-11-15T02:37:11.518450+0000","last_peered":"2023-11-15T02:37:11.518450+0000","last_clean":"2023-11-15T02:37:11.518450+0000","last_became_active":"2023-11-15T02:37:11.137307+0000","last_became_peered":"2023-11-15T02:37:11.137307+0000","last_unstale":"2023-11-15T02:37:11.518450+0000","last_undegraded":"2023-11-15T02:37:11.518450+0000","last_fullsized":"2023-11-15T02:37:11.518450+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":155,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.509104+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:37:11.509104+0000","last_peered":"2023-11-15T02:37:11.509104+0000","last_clean":"2023-11-15T02:37:11.509104+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:37:11.509104+0000","last_undegraded":"2023-11-15T02:37:11.509104+0000","last_fullsized":"2023-11-15T02:37:11.509104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.526543+0000","last_change":"2023-11-15T02:37:11.524654+0000","last_active":"2023-11-15T02:37:11.526543+0000","last_peered":"2023-11-15T02:37:11.526543+0000","last_clean":"2023-11-15T02:37:11.526543+0000","last_became_active":"2023-11-15T02:37:11.524322+0000","last_became_peered":"2023-11-15T02:37:11.524322+0000","last_unstale":"2023-11-15T02:37:11.526543+0000","last_undegraded":"2023-11-15T02:37:11.526543+0000","last_fullsized":"2023-11-15T02:37:11.526543+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.529462+0000","last_change":"2023-11-15T02:37:11.132331+0000","last_active":"2023-11-15T02:37:11.529462+0000","last_peered":"2023-11-15T02:37:11.529462+0000","last_clean":"2023-11-15T02:37:11.529462+0000","last_became_active":"2023-11-15T02:37:11.131991+0000","last_became_peered":"2023-11-15T02:37:11.131991+0000","last_unstale":"2023-11-15T02:37:11.529462+0000","last_undegraded":"2023-11-15T02:37:11.529462+0000","last_fullsized":"2023-11-15T02:37:11.529462+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":146,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.517104+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:37:11.517104+0000","last_peered":"2023-11-15T02:37:11.517104+0000","last_clean":"2023-11-15T02:37:11.517104+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:37:11.517104+0000","last_undegraded":"2023-11-15T02:37:11.517104+0000","last_fullsized":"2023-11-15T02:37:11.517104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":142,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.523425+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:37:11.523425+0000","last_peered":"2023-11-15T02:37:11.523425+0000","last_clean":"2023-11-15T02:37:11.523425+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:37:11.523425+0000","last_undegraded":"2023-11-15T02:37:11.523425+0000","last_fullsized":"2023-11-15T02:37:11.523425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.531464+0000","last_change":"2023-11-15T02:37:11.529970+0000","last_active":"2023-11-15T02:37:11.531464+0000","last_peered":"2023-11-15T02:37:11.531464+0000","last_clean":"2023-11-15T02:37:11.531464+0000","last_became_active":"2023-11-15T02:37:11.529785+0000","last_became_peered":"2023-11-15T02:37:11.529785+0000","last_unstale":"2023-11-15T02:37:11.531464+0000","last_undegraded":"2023-11-15T02:37:11.531464+0000","last_fullsized":"2023-11-15T02:37:11.531464+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.519017+0000","last_change":"2023-11-15T02:37:11.145012+0000","last_active":"2023-11-15T02:37:11.519017+0000","last_peered":"2023-11-15T02:37:11.519017+0000","last_clean":"2023-11-15T02:37:11.519017+0000","last_became_active":"2023-11-15T02:37:11.144138+0000","last_became_peered":"2023-11-15T02:37:11.144138+0000","last_unstale":"2023-11-15T02:37:11.519017+0000","last_undegraded":"2023-11-15T02:37:11.519017+0000","last_fullsized":"2023-11-15T02:37:11.519017+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":140,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.523484+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:37:11.523484+0000","last_peered":"2023-11-15T02:37:11.523484+0000","last_clean":"2023-11-15T02:37:11.523484+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:37:11.523484+0000","last_undegraded":"2023-11-15T02:37:11.523484+0000","last_fullsized":"2023-11-15T02:37:11.523484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.530895+0000","last_change":"2023-11-15T02:37:11.527609+0000","last_active":"2023-11-15T02:37:11.530895+0000","last_peered":"2023-11-15T02:37:11.530895+0000","last_clean":"2023-11-15T02:37:11.530895+0000","last_became_active":"2023-11-15T02:37:11.527253+0000","last_became_peered":"2023-11-15T02:37:11.527253+0000","last_unstale":"2023-11-15T02:37:11.530895+0000","last_undegraded":"2023-11-15T02:37:11.530895+0000","last_fullsized":"2023-11-15T02:37:11.530895+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.512511+0000","last_change":"2023-11-15T02:37:11.132820+0000","last_active":"2023-11-15T02:37:11.512511+0000","last_peered":"2023-11-15T02:37:11.512511+0000","last_clean":"2023-11-15T02:37:11.512511+0000","last_became_active":"2023-11-15T02:37:11.132506+0000","last_became_peered":"2023-11-15T02:37:11.132506+0000","last_unstale":"2023-11-15T02:37:11.512511+0000","last_undegraded":"2023-11-15T02:37:11.512511+0000","last_fullsized":"2023-11-15T02:37:11.512511+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.528979+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:37:11.528979+0000","last_peered":"2023-11-15T02:37:11.528979+0000","last_clean":"2023-11-15T02:37:11.528979+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:37:11.528979+0000","last_undegraded":"2023-11-15T02:37:11.528979+0000","last_fullsized":"2023-11-15T02:37:11.528979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.532924+0000","last_change":"2023-11-15T02:37:11.525701+0000","last_active":"2023-11-15T02:37:11.532924+0000","last_peered":"2023-11-15T02:37:11.532924+0000","last_clean":"2023-11-15T02:37:11.532924+0000","last_became_active":"2023-11-15T02:37:11.525421+0000","last_became_peered":"2023-11-15T02:37:11.525421+0000","last_unstale":"2023-11-15T02:37:11.532924+0000","last_undegraded":"2023-11-15T02:37:11.532924+0000","last_fullsized":"2023-11-15T02:37:11.532924+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.511500+0000","last_change":"2023-11-15T02:37:11.136268+0000","last_active":"2023-11-15T02:37:11.511500+0000","last_peered":"2023-11-15T02:37:11.511500+0000","last_clean":"2023-11-15T02:37:11.511500+0000","last_became_active":"2023-11-15T02:37:11.135994+0000","last_became_peered":"2023-11-15T02:37:11.135994+0000","last_unstale":"2023-11-15T02:37:11.511500+0000","last_undegraded":"2023-11-15T02:37:11.511500+0000","last_fullsized":"2023-11-15T02:37:11.511500+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.513675+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:37:11.513675+0000","last_peered":"2023-11-15T02:37:11.513675+0000","last_clean":"2023-11-15T02:37:11.513675+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:37:11.513675+0000","last_undegraded":"2023-11-15T02:37:11.513675+0000","last_fullsized":"2023-11-15T02:37:11.513675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.536274+0000","last_change":"2023-11-15T02:37:11.533494+0000","last_active":"2023-11-15T02:37:11.536274+0000","last_peered":"2023-11-15T02:37:11.536274+0000","last_clean":"2023-11-15T02:37:11.536274+0000","last_became_active":"2023-11-15T02:37:11.533146+0000","last_became_peered":"2023-11-15T02:37:11.533146+0000","last_unstale":"2023-11-15T02:37:11.536274+0000","last_undegraded":"2023-11-15T02:37:11.536274+0000","last_fullsized":"2023-11-15T02:37:11.536274+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:11.107922+0000","last_clean_scrub_stamp":"2023-11-15T02:37:11.107922+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.537265+0000","last_change":"2023-11-15T02:37:11.142673+0000","last_active":"2023-11-15T02:37:11.537265+0000","last_peered":"2023-11-15T02:37:11.537265+0000","last_clean":"2023-11-15T02:37:11.537265+0000","last_became_active":"2023-11-15T02:37:11.142366+0000","last_became_peered":"2023-11-15T02:37:11.142366+0000","last_unstale":"2023-11-15T02:37:11.537265+0000","last_undegraded":"2023-11-15T02:37:11.537265+0000","last_fullsized":"2023-11-15T02:37:11.537265+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:37:10.102661+0000","last_clean_scrub_stamp":"2023-11-15T02:37:10.102661+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-11-15T02:37:11.511103+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:37:11.511103+0000","last_peered":"2023-11-15T02:37:11.511103+0000","last_clean":"2023-11-15T02:37:11.511103+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:37:11.511103+0000","last_undegraded":"2023-11-15T02:37:11.511103+0000","last_fullsized":"2023-11-15T02:37:11.511103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575751,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303360,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068480,"statfs":{"total":96636764160,"available":96326123520,"internally_reserved":0,"allocated":2220032,"data_stored":1172309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.623},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":0.997,"15min":0.997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33500000000000002},"max":{"1min":0.74199999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64800000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":0.80200000000000005,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78000000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.77400000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79600000000000004,"5min":1.101,"15min":1.101},"last":0.67500000000000004}]},{"osd":4,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.33000000000000002,"15min":0.27300000000000002},"max":{"1min":0.68799999999999994,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":0.749,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.47099999999999997}]},{"osd":5,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48899999999999999,"15min":0.5},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.70499999999999996,"5min":0.70599999999999996,"15min":0.78800000000000003},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.371,"15min":0.33100000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.82799999999999996},"last":0.44}]},{"osd":6,"last update":"Wed Nov 15 02:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.54900000000000004},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.31},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.86299999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.29999999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.85699999999999998},"last":0.42099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575752,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307444,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064396,"statfs":{"total":96636764160,"available":96321941504,"internally_reserved":0,"allocated":2207744,"data_stored":1170841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68500000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.33700000000000002,"5min":0.317,"15min":0.308},"max":{"1min":0.755,"5min":0.78900000000000003,"15min":0.82899999999999996},"last":0.47799999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32100000000000001},"max":{"1min":0.70399999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.34300000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.35299999999999998},"max":{"1min":0.746,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.628}]},{"osd":3,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78800000000000003,"15min":0.80700000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.38700000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.307,"5min":0.28599999999999998,"15min":0.26100000000000001},"max":{"1min":0.65800000000000003,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.39600000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.70999999999999996}]},{"osd":5,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56000000000000005,"15min":0.54700000000000004},"min":{"1min":0.35399999999999998,"5min":0.314,"15min":0.30599999999999999},"max":{"1min":0.74399999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.69499999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.502},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.28799999999999998},"max":{"1min":0.66800000000000004,"5min":0.81000000000000005,"15min":0.81699999999999995},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.41999999999999998,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.83499999999999996,"5min":0.876,"15min":0.876},"last":0.78300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575753,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307452,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064388,"statfs":{"total":96636764160,"available":96321933312,"internally_reserved":0,"allocated":2215936,"data_stored":1171465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.45600000000000002,"5min":0.66000000000000003,"15min":0.66800000000000004},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.52500000000000002,"5min":0.64200000000000002,"15min":0.65800000000000003},"last":0.42399999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.26900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.46300000000000002,"5min":0.59799999999999998,"15min":0.63100000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.44400000000000001,"15min":0.45500000000000002},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.27100000000000002},"max":{"1min":0.56599999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40400000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.30599999999999999},"max":{"1min":0.61799999999999999,"5min":0.69799999999999995,"15min":0.74299999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.48499999999999999,"15min":0.49199999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55500000000000005,"5min":0.70899999999999996,"15min":0.77100000000000002},"last":0.32600000000000001}]},{"osd":4,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":0.89800000000000002,"15min":1.097},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86899999999999999,"5min":0.96499999999999997,"15min":1.014},"last":0.67200000000000004}]},{"osd":5,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":0.89200000000000002,"15min":0.98699999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":0.95399999999999996,"15min":1.024},"last":0.61599999999999999}]},{"osd":6,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.47899999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.85399999999999998,"5min":0.94399999999999995,"15min":0.96799999999999997},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88400000000000001,"5min":0.93200000000000005,"15min":1.143},"last":0.70399999999999996}]},{"osd":7,"last update":"Wed Nov 15 02:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90500000000000003,"5min":0.95799999999999996,"15min":1.111},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":0.97999999999999998,"15min":1.0129999999999999},"last":0.81499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575751,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307460,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064380,"statfs":{"total":96636764160,"available":96321925120,"internally_reserved":0,"allocated":2224128,"data_stored":1171609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60299999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.42299999999999999},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.57999999999999996,"5min":0.63700000000000001,"15min":0.64200000000000002},"last":0.23899999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39400000000000002,"15min":0.39900000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53600000000000003,"5min":0.60099999999999998,"15min":0.83799999999999997},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.72499999999999998},"last":0.33500000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.44,"15min":0.44600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.28899999999999998},"max":{"1min":0.58599999999999997,"5min":0.64700000000000002,"15min":0.69799999999999995},"last":0.311},{"interface":"front","average":{"1min":0.441,"5min":0.46100000000000002,"15min":0.46600000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.71599999999999997},"last":0.34899999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66800000000000004,"15min":0.67600000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.39100000000000001},"max":{"1min":0.92100000000000004,"5min":0.96599999999999997,"15min":1.004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89100000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.59999999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80500000000000005,"5min":0.88300000000000001,"15min":1.05},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65500000000000003,"15min":0.66500000000000004},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.44900000000000001},"max":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":1.004},"last":0.56299999999999994}]},{"osd":6,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64700000000000002,"15min":0.66300000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.42699999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":1.026},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.68200000000000005},"min":{"1min":0.49199999999999999,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.0309999999999999},"last":0.66900000000000004}]},{"osd":7,"last update":"Wed Nov 15 02:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69199999999999995,"15min":0.70799999999999996},"min":{"1min":0.53700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85399999999999998,"5min":0.93200000000000005,"15min":1.0600000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.72199999999999998},"min":{"1min":0.53600000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.997,"5min":0.997,"15min":1.0409999999999999},"last":0.68400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575752,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311552,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060288,"statfs":{"total":96636764160,"available":96317734912,"internally_reserved":0,"allocated":2220032,"data_stored":1171023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.248,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56499999999999995,"5min":0.69699999999999995,"15min":0.83999999999999997},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.25900000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.63500000000000001,"5min":0.69199999999999995,"15min":0.85899999999999999},"last":0.35499999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39400000000000002,"15min":0.40600000000000003},"min":{"1min":0.28699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.52200000000000002,"5min":0.68999999999999995,"15min":0.91000000000000003},"last":0.254},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45600000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55700000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.317}]},{"osd":3,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.33500000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64800000000000002,"5min":0.755,"15min":0.79800000000000004},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":0.65600000000000003,"5min":0.69499999999999995,"15min":1.113},"last":0.26700000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.67100000000000004,"15min":0.65500000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.89000000000000001,"5min":1.0069999999999999,"15min":1.2170000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91100000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.41899999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.153},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69299999999999995,"15min":0.68300000000000005},"min":{"1min":0.497,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.996},"last":0.63}]},{"osd":6,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.442},"max":{"1min":0.85699999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.70599999999999996},"min":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.438},"max":{"1min":0.97299999999999998,"5min":1.079,"15min":1.079},"last":0.82699999999999996}]},{"osd":7,"last update":"Wed Nov 15 02:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95099999999999996,"5min":1.0940000000000001,"15min":1.7270000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.72199999999999998},"min":{"1min":0.495,"5min":0.46800000000000003,"15min":0.45800000000000002},"max":{"1min":0.90900000000000003,"5min":1.038,"15min":1.038},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575753,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311544,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060296,"statfs":{"total":96636764160,"available":96317743104,"internally_reserved":0,"allocated":2211840,"data_stored":1170875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.26400000000000001,"5min":0.24099999999999999,"15min":0.222},"max":{"1min":0.55900000000000005,"5min":0.56299999999999994,"15min":0.67700000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.40699999999999997,"15min":0.41799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.24199999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.67400000000000004},"last":0.38500000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.40200000000000002,"15min":0.41899999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56899999999999995,"5min":0.622,"15min":0.81399999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.25800000000000001},"max":{"1min":0.64900000000000002,"5min":0.746,"15min":0.75800000000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.71499999999999997,"15min":0.76900000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.497,"15min":0.501},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.75600000000000001},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.432,"5min":0.41899999999999998,"15min":0.40500000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.306},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66500000000000004,"15min":0.68000000000000005},"min":{"1min":0.48099999999999998,"5min":0.42899999999999999,"15min":0.39100000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.46999999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.129},"last":0.60899999999999999}]},{"osd":6,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.496,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.46100000000000002,"15min":0.438},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.73199999999999998}]},{"osd":7,"last update":"Wed Nov 15 02:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.439},"max":{"1min":1.159,"5min":1.159,"15min":1.256},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.71999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575751,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1171485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.32000000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.80800000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.67600000000000005,"5min":0.78000000000000003,"15min":1.1919999999999999},"last":0.35399999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.45400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.42999999999999999,"5min":0.39400000000000002,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.82199999999999995,"15min":1.2},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.59899999999999998},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.36599999999999999},"max":{"1min":0.74299999999999999,"5min":0.752,"15min":1.272},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.434,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79800000000000004,"5min":0.81899999999999995,"15min":0.95999999999999996},"last":0.51500000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.40500000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.3109999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.53400000000000003,"15min":0.48599999999999999},"min":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.30299999999999999},"max":{"1min":4.8230000000000004,"5min":4.8230000000000004,"15min":4.8230000000000004},"last":0.443},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.28299999999999997},"max":{"1min":0.71499999999999997,"5min":0.747,"15min":0.79000000000000004},"last":0.5}]},{"osd":6,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.56100000000000005,"15min":0.51800000000000002},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.32900000000000001},"max":{"1min":4.8689999999999998,"5min":4.8689999999999998,"15min":4.8689999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.38500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72099999999999997,"5min":0.78800000000000003,"15min":0.85399999999999998},"last":0.60599999999999998}]},{"osd":7,"last update":"Wed Nov 15 02:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.58099999999999996,"15min":0.54400000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":4.4569999999999999,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.36799999999999999},"max":{"1min":0.75,"5min":0.79100000000000004,"15min":0.83299999999999996},"last":0.59099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575751,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307448,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064392,"statfs":{"total":96636764160,"available":96321937408,"internally_reserved":0,"allocated":2211840,"data_stored":1171733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67300000000000004,"5min":0.76900000000000002,"15min":1.1379999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79000000000000004,"5min":0.79500000000000004,"15min":1.0169999999999999},"last":0.50800000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68899999999999995,"5min":0.84299999999999997,"15min":1.0109999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.55900000000000005,"15min":0.56799999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27600000000000002},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":1.135},"last":0.45600000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":1.155},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76700000000000002,"5min":0.81999999999999995,"15min":1.0369999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.77800000000000002,"5min":0.79200000000000004,"15min":1.1779999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69899999999999995,"5min":0.79900000000000004,"15min":1.171},"last":0.64300000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45700000000000002,"15min":0.45900000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.72399999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.313},"max":{"1min":0.68799999999999994,"5min":0.77900000000000003,"15min":0.78600000000000003},"last":0.67400000000000004}]},{"osd":6,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.317,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.80900000000000005},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.497,"15min":0.498},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64600000000000002,"5min":0.76500000000000001,"15min":0.81899999999999995},"last":0.69999999999999996}]},{"osd":7,"last update":"Wed Nov 15 02:36:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.499,"15min":0.495},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63900000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.36299999999999999},"max":{"1min":0.73999999999999999,"5min":0.78900000000000003,"15min":0.83299999999999996},"last":0.76500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:37:20.391 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-15T02:37:20.392 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-15T02:37:20.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.547+0000 7fbbf4f50700 1 Processor -- start 2023-11-15T02:37:20.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.547+0000 7fbbf4f50700 1 -- start start 2023-11-15T02:37:20.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbf4f50700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbbf01545b0 0x7fbbf00c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbf4f50700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbbf00c7f50 0x7fbbf00c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbf4f50700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf0155830 con 0x7fbbf01541d0 2023-11-15T02:37:20.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbf4f50700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf0158f40 con 0x7fbbf01545b0 2023-11-15T02:37:20.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbf4f50700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf0154a30 con 0x7fbbf00c7f50 2023-11-15T02:37:20.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbeeffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbbf01545b0 0x7fbbf00c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbeeffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbbf01545b0 0x7fbbf00c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43318/0 (socket says 172.21.15.1:43318) 2023-11-15T02:37:20.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbeeffd700 1 -- 172.21.15.1:0/2960082097 learned_addr learned my addr 172.21.15.1:0/2960082097 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:20.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbeffff700 1 --2- 172.21.15.1:0/2960082097 >> v2:172.21.15.141:3300/0 conn(0x7fbbf00c7f50 0x7fbbf00c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbeeffd700 1 -- 172.21.15.1:0/2960082097 >> v2:172.21.15.141:3300/0 conn(0x7fbbf00c7f50 msgr2=0x7fbbf00c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:20.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbeeffd700 1 --2- 172.21.15.1:0/2960082097 >> v2:172.21.15.141:3300/0 conn(0x7fbbf00c7f50 0x7fbbf00c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbeeffd700 1 -- 172.21.15.1:0/2960082097 >> v1:172.21.15.141:6789/0 conn(0x7fbbf01541d0 legacy=0x7fbbf00c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:20.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbeeffd700 1 -- 172.21.15.1:0/2960082097 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf0154c20 con 0x7fbbf01545b0 2023-11-15T02:37:20.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbeeffd700 1 --2- 172.21.15.1:0/2960082097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbf01545b0 0x7fbbf00c7a60 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7fbbf00c56d0 tx=0x7fbbe40090f0).ready entity=mon.0 client_cookie=c74da09cd5a3dfa9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:20.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbee7fc700 1 -- 172.21.15.1:0/2960082097 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe400b5a0 con 0x7fbbf01545b0 2023-11-15T02:37:20.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.548+0000 7fbbee7fc700 1 -- 172.21.15.1:0/2960082097 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe400b700 con 0x7fbbf01545b0 2023-11-15T02:37:20.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.549+0000 7fbbee7fc700 1 -- 172.21.15.1:0/2960082097 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe400ba80 con 0x7fbbf01545b0 2023-11-15T02:37:20.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.549+0000 7fbbf4f50700 1 -- 172.21.15.1:0/2960082097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbf01545b0 msgr2=0x7fbbf00c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.549+0000 7fbbf4f50700 1 --2- 172.21.15.1:0/2960082097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbf01545b0 0x7fbbf00c7a60 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7fbbf00c56d0 tx=0x7fbbe40090f0).stop 2023-11-15T02:37:20.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.549+0000 7fbbf4f50700 1 -- 172.21.15.1:0/2960082097 shutdown_connections 2023-11-15T02:37:20.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.549+0000 7fbbf4f50700 1 --2- 172.21.15.1:0/2960082097 >> v2:172.21.15.141:3300/0 conn(0x7fbbf00c7f50 0x7fbbf00c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.549+0000 7fbbf4f50700 1 --2- 172.21.15.1:0/2960082097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbf01545b0 0x7fbbf00c7a60 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.549+0000 7fbbf4f50700 1 -- 172.21.15.1:0/2960082097 >> 172.21.15.1:0/2960082097 conn(0x7fbbf0069ee0 msgr2=0x7fbbf006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:20.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.549+0000 7fbbf4f50700 1 -- 172.21.15.1:0/2960082097 shutdown_connections 2023-11-15T02:37:20.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.549+0000 7fbbf4f50700 1 -- 172.21.15.1:0/2960082097 wait complete. 2023-11-15T02:37:20.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.550+0000 7fbbf4f50700 1 Processor -- start 2023-11-15T02:37:20.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.550+0000 7fbbf4f50700 1 -- start start 2023-11-15T02:37:20.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbf4f50700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbbf00c7f50 0x7fbbf0150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbf4f50700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbf01541d0 0x7fbbf014e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbf4f50700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbbf01545b0 0x7fbbf0158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbf4f50700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf014ea50 con 0x7fbbf01541d0 2023-11-15T02:37:20.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbf4f50700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf01501f0 con 0x7fbbf00c7f50 2023-11-15T02:37:20.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbf4f50700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf01577a0 con 0x7fbbf01545b0 2023-11-15T02:37:20.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbeeffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbf01541d0 0x7fbbf014e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbeeffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbf01541d0 0x7fbbf014e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43332/0 (socket says 172.21.15.1:43332) 2023-11-15T02:37:20.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbeeffd700 1 -- 172.21.15.1:0/2825607570 learned_addr learned my addr 172.21.15.1:0/2825607570 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:20.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbef7fe700 1 --2- 172.21.15.1:0/2825607570 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbbf00c7f50 0x7fbbf0150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbeffff700 1 --2- 172.21.15.1:0/2825607570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbbf01545b0 0x7fbbf0158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbeeffd700 1 -- 172.21.15.1:0/2825607570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbbf01545b0 msgr2=0x7fbbf0158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbeeffd700 1 --2- 172.21.15.1:0/2825607570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbbf01545b0 0x7fbbf0158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbeeffd700 1 -- 172.21.15.1:0/2825607570 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbbf00c7f50 msgr2=0x7fbbf0150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbeeffd700 1 --2- 172.21.15.1:0/2825607570 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbbf00c7f50 0x7fbbf0150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.551+0000 7fbbeeffd700 1 -- 172.21.15.1:0/2825607570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe4009370 con 0x7fbbf01541d0 2023-11-15T02:37:20.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.552+0000 7fbbeeffd700 1 --2- 172.21.15.1:0/2825607570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbf01541d0 0x7fbbf014e560 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7fbbe4009130 tx=0x7fbbe4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:20.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.552+0000 7fbbd77fe700 1 -- 172.21.15.1:0/2825607570 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe400b870 con 0x7fbbf01541d0 2023-11-15T02:37:20.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.552+0000 7fbbd77fe700 1 -- 172.21.15.1:0/2825607570 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe400b9d0 con 0x7fbbf01541d0 2023-11-15T02:37:20.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.552+0000 7fbbf4f50700 1 -- 172.21.15.1:0/2825607570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf0157a80 con 0x7fbbf01541d0 2023-11-15T02:37:20.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.552+0000 7fbbd77fe700 1 -- 172.21.15.1:0/2825607570 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe401b660 con 0x7fbbf01541d0 2023-11-15T02:37:20.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.552+0000 7fbbf4f50700 1 -- 172.21.15.1:0/2825607570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf014fe80 con 0x7fbbf01541d0 2023-11-15T02:37:20.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.553+0000 7fbbf4f50700 1 -- 172.21.15.1:0/2825607570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf01538d0 con 0x7fbbf01541d0 2023-11-15T02:37:20.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.553+0000 7fbbd77fe700 1 -- 172.21.15.1:0/2825607570 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fbbe401b9d0 con 0x7fbbf01541d0 2023-11-15T02:37:20.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.554+0000 7fbbd77fe700 1 --2- 172.21.15.1:0/2825607570 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbbdc05f270 0x7fbbdc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.554+0000 7fbbd77fe700 1 -- 172.21.15.1:0/2825607570 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fbbe407bcc0 con 0x7fbbf01541d0 2023-11-15T02:37:20.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.554+0000 7fbbef7fe700 1 --2- 172.21.15.1:0/2825607570 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbbdc05f270 0x7fbbdc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.554+0000 7fbbef7fe700 1 --2- 172.21.15.1:0/2825607570 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbbdc05f270 0x7fbbdc061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbbe00038b0 tx=0x7fbbe0007d20).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:20.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.558+0000 7fbbd77fe700 1 -- 172.21.15.1:0/2825607570 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbbe404ccd0 con 0x7fbbf01541d0 2023-11-15T02:37:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.800+0000 7fbbf4f50700 1 -- 172.21.15.1:0/2825607570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbbf0063130 con 0x7fbbf01541d0 2023-11-15T02:37:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.803+0000 7fbbd77fe700 1 -- 172.21.15.1:0/2825607570 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v43) v1 ==== 190+0+0 (secure 0 0 0) 0x7fbbe40502f0 con 0x7fbbf01541d0 2023-11-15T02:37:20.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.805+0000 7fbbf4f50700 1 -- 172.21.15.1:0/2825607570 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbbdc05f270 msgr2=0x7fbbdc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.805+0000 7fbbf4f50700 1 --2- 172.21.15.1:0/2825607570 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbbdc05f270 0x7fbbdc061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbbe00038b0 tx=0x7fbbe0007d20).stop 2023-11-15T02:37:20.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.805+0000 7fbbf4f50700 1 -- 172.21.15.1:0/2825607570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbf01541d0 msgr2=0x7fbbf014e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.806+0000 7fbbf4f50700 1 --2- 172.21.15.1:0/2825607570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbf01541d0 0x7fbbf014e560 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7fbbe4009130 tx=0x7fbbe4015000).stop 2023-11-15T02:37:20.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.806+0000 7fbbf4f50700 1 -- 172.21.15.1:0/2825607570 shutdown_connections 2023-11-15T02:37:20.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.806+0000 7fbbf4f50700 1 --2- 172.21.15.1:0/2825607570 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fbbdc05f270 0x7fbbdc061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.806+0000 7fbbf4f50700 1 --2- 172.21.15.1:0/2825607570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbbf01545b0 0x7fbbf0158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.806+0000 7fbbf4f50700 1 --2- 172.21.15.1:0/2825607570 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbbf00c7f50 0x7fbbf0150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.806+0000 7fbbf4f50700 1 --2- 172.21.15.1:0/2825607570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbf01541d0 0x7fbbf014e560 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.806+0000 7fbbf4f50700 1 -- 172.21.15.1:0/2825607570 >> 172.21.15.1:0/2825607570 conn(0x7fbbf0069ee0 msgr2=0x7fbbf01531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:20.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.806+0000 7fbbf4f50700 1 -- 172.21.15.1:0/2825607570 shutdown_connections 2023-11-15T02:37:20.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.806+0000 7fbbf4f50700 1 -- 172.21.15.1:0/2825607570 wait complete. 2023-11-15T02:37:20.810 INFO:teuthology.orchestra.run.smithi001.stderr:updated caps for client.0 2023-11-15T02:37:20.819 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:37:20.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.936+0000 7fc1de780700 1 Processor -- start 2023-11-15T02:37:20.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.936+0000 7fc1de780700 1 -- start start 2023-11-15T02:37:20.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1de780700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d8154150 0x7fc1d8154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1de780700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc1d80ab1a0 0x7fc1d8158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1de780700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d80c06f0 con 0x7fc1d80aa060 2023-11-15T02:37:20.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1de780700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d80c09d0 con 0x7fc1d80ab1a0 2023-11-15T02:37:20.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1de780700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8158820 con 0x7fc1d8154150 2023-11-15T02:37:20.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1d77fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc1d80ab1a0 0x7fc1d8158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1dcd1d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc1d80aa060 0x7fc1d80c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44780/0 (socket says 172.21.15.1:44780) 2023-11-15T02:37:20.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1dcd1d700 1 -- 172.21.15.1:0/494869390 learned_addr learned my addr 172.21.15.1:0/494869390 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:20.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1d77fe700 1 -- 172.21.15.1:0/494869390 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d8154150 msgr2=0x7fc1d8154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:20.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1d7fff700 1 --2- 172.21.15.1:0/494869390 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d8154150 0x7fc1d8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1d6ffd700 1 -- 172.21.15.1:0/494869390 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048299133 0 0) 0x7fc1d80c06f0 con 0x7fc1d80aa060 2023-11-15T02:37:20.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1d77fe700 1 --2- 172.21.15.1:0/494869390 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d8154150 0x7fc1d8154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1d77fe700 1 -- 172.21.15.1:0/494869390 >> v1:172.21.15.1:6789/0 conn(0x7fc1d80aa060 legacy=0x7fc1d80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1d77fe700 1 -- 172.21.15.1:0/494869390 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d8158b00 con 0x7fc1d80ab1a0 2023-11-15T02:37:20.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1d7fff700 1 --2- 172.21.15.1:0/494869390 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d8154150 0x7fc1d8154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:20.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1d77fe700 1 --2- 172.21.15.1:0/494869390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1d80ab1a0 0x7fc1d8158040 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7fc1cc009760 tx=0x7fc1cc009060).ready entity=mon.0 client_cookie=e71b89fce5961954 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:20.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1d6ffd700 1 -- 172.21.15.1:0/494869390 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0090d0 con 0x7fc1d80ab1a0 2023-11-15T02:37:20.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1d6ffd700 1 -- 172.21.15.1:0/494869390 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc00b580 con 0x7fc1d80ab1a0 2023-11-15T02:37:20.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.937+0000 7fc1d6ffd700 1 -- 172.21.15.1:0/494869390 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc00b900 con 0x7fc1d80ab1a0 2023-11-15T02:37:20.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.938+0000 7fc1de780700 1 -- 172.21.15.1:0/494869390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1d80ab1a0 msgr2=0x7fc1d8158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.938+0000 7fc1de780700 1 --2- 172.21.15.1:0/494869390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1d80ab1a0 0x7fc1d8158040 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7fc1cc009760 tx=0x7fc1cc009060).stop 2023-11-15T02:37:20.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.938+0000 7fc1de780700 1 -- 172.21.15.1:0/494869390 shutdown_connections 2023-11-15T02:37:20.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.938+0000 7fc1de780700 1 --2- 172.21.15.1:0/494869390 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d8154150 0x7fc1d8154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.938+0000 7fc1de780700 1 --2- 172.21.15.1:0/494869390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1d80ab1a0 0x7fc1d8158040 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.938+0000 7fc1de780700 1 -- 172.21.15.1:0/494869390 >> 172.21.15.1:0/494869390 conn(0x7fc1d8064aa0 msgr2=0x7fc1d8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:20.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.938+0000 7fc1de780700 1 -- 172.21.15.1:0/494869390 shutdown_connections 2023-11-15T02:37:20.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.938+0000 7fc1de780700 1 -- 172.21.15.1:0/494869390 wait complete. 2023-11-15T02:37:20.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.939+0000 7fc1de780700 1 Processor -- start 2023-11-15T02:37:20.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.939+0000 7fc1de780700 1 -- start start 2023-11-15T02:37:20.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.940+0000 7fc1de780700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1d80aa060 0x7fc1d8151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.940+0000 7fc1de780700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1d80ab1a0 0x7fc1d80ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.940+0000 7fc1de780700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d8154150 0x7fc1d8152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.940+0000 7fc1de780700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d81529a0 con 0x7fc1d80aa060 2023-11-15T02:37:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.940+0000 7fc1de780700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8151d20 con 0x7fc1d80ab1a0 2023-11-15T02:37:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.940+0000 7fc1de780700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8152000 con 0x7fc1d8154150 2023-11-15T02:37:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.940+0000 7fc1d7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1d80aa060 0x7fc1d8151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.940+0000 7fc1d7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1d80aa060 0x7fc1d8151760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43348/0 (socket says 172.21.15.1:43348) 2023-11-15T02:37:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.940+0000 7fc1d7fff700 1 -- 172.21.15.1:0/782111218 learned_addr learned my addr 172.21.15.1:0/782111218 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.940+0000 7fc1dcd1d700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d8154150 0x7fc1d8152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.940+0000 7fc1d77fe700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1d80ab1a0 0x7fc1d80ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.940+0000 7fc1d7fff700 1 -- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d8154150 msgr2=0x7fc1d8152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.940+0000 7fc1d7fff700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d8154150 0x7fc1d8152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.940+0000 7fc1d7fff700 1 -- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1d80ab1a0 msgr2=0x7fc1d80ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.941+0000 7fc1d7fff700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1d80ab1a0 0x7fc1d80ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.941+0000 7fc1d7fff700 1 -- 172.21.15.1:0/782111218 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc0092a0 con 0x7fc1d80aa060 2023-11-15T02:37:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.941+0000 7fc1dcd1d700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d8154150 0x7fc1d8152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.941+0000 7fc1d77fe700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1d80ab1a0 0x7fc1d80ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.941+0000 7fc1d7fff700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1d80aa060 0x7fc1d8151760 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7fc1c800c880 tx=0x7fc1c8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:20.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.941+0000 7fc1bffff700 1 -- 172.21.15.1:0/782111218 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8010580 con 0x7fc1d80aa060 2023-11-15T02:37:20.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.941+0000 7fc1bffff700 1 -- 172.21.15.1:0/782111218 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c80106e0 con 0x7fc1d80aa060 2023-11-15T02:37:20.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.941+0000 7fc1de780700 1 -- 172.21.15.1:0/782111218 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d81522e0 con 0x7fc1d80aa060 2023-11-15T02:37:20.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.941+0000 7fc1bffff700 1 -- 172.21.15.1:0/782111218 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8010a60 con 0x7fc1d80aa060 2023-11-15T02:37:20.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.941+0000 7fc1de780700 1 -- 172.21.15.1:0/782111218 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d80cad80 con 0x7fc1d80aa060 2023-11-15T02:37:20.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.942+0000 7fc1de780700 1 -- 172.21.15.1:0/782111218 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d8152c10 con 0x7fc1d80aa060 2023-11-15T02:37:20.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.942+0000 7fc1bffff700 1 -- 172.21.15.1:0/782111218 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc1c801b460 con 0x7fc1d80aa060 2023-11-15T02:37:20.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.943+0000 7fc1bffff700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc1c405f270 0x7fc1c4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:20.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.943+0000 7fc1bffff700 1 -- 172.21.15.1:0/782111218 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fc1c807a5b0 con 0x7fc1d80aa060 2023-11-15T02:37:20.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.943+0000 7fc1d77fe700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc1c405f270 0x7fc1c4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:20.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.943+0000 7fc1d77fe700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc1c405f270 0x7fc1c4061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc1cc009760 tx=0x7fc1cc017000).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:20.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:20.947+0000 7fc1bffff700 1 -- 172.21.15.1:0/782111218 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc1c804b4b0 con 0x7fc1d80aa060 2023-11-15T02:37:21.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.163+0000 7fc1de780700 1 -- 172.21.15.1:0/782111218 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1d806c7e0 con 0x7fc1d80aa060 2023-11-15T02:37:21.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.164+0000 7fc1bffff700 1 -- 172.21.15.1:0/782111218 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4493 (secure 0 0 0) 0x7fc1c804ead0 con 0x7fc1d80aa060 2023-11-15T02:37:21.166 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:37:21.166 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3282299930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3282299930},{"type":"v1","addr":"172.21.15.141:6837","nonce":3282299930}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":8281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3059700101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3059700101},{"type":"v1","addr":"172.21.15.141:6836","nonce":3059700101}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9057,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2954825492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2954825492},{"type":"v1","addr":"172.21.15.1:6834","nonce":2954825492}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:37:11.505391+0000","modified":"2023-11-15T02:37:14.517313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9060":{"gid":9060,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3330049946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3330049946},{"type":"v1","addr":"172.21.15.1:6835","nonce":3330049946}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-11-15T02:37:21.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.165+0000 7fc1de780700 1 -- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc1c405f270 msgr2=0x7fc1c4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.165+0000 7fc1de780700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc1c405f270 0x7fc1c4061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc1cc009760 tx=0x7fc1cc017000).stop 2023-11-15T02:37:21.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.165+0000 7fc1de780700 1 -- 172.21.15.1:0/782111218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1d80aa060 msgr2=0x7fc1d8151760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.165+0000 7fc1de780700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1d80aa060 0x7fc1d8151760 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7fc1c800c880 tx=0x7fc1c8008040).stop 2023-11-15T02:37:21.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.165+0000 7fc1de780700 1 -- 172.21.15.1:0/782111218 shutdown_connections 2023-11-15T02:37:21.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.165+0000 7fc1de780700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fc1c405f270 0x7fc1c4061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.165+0000 7fc1de780700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d8154150 0x7fc1d8152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.165+0000 7fc1de780700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1d80aa060 0x7fc1d8151760 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.165+0000 7fc1de780700 1 --2- 172.21.15.1:0/782111218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1d80ab1a0 0x7fc1d80ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.165+0000 7fc1de780700 1 -- 172.21.15.1:0/782111218 >> 172.21.15.1:0/782111218 conn(0x7fc1d8064aa0 msgr2=0x7fc1d80ac050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:21.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.166+0000 7fc1de780700 1 -- 172.21.15.1:0/782111218 shutdown_connections 2023-11-15T02:37:21.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.166+0000 7fc1de780700 1 -- 172.21.15.1:0/782111218 wait complete. 2023-11-15T02:37:21.170 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 79 2023-11-15T02:37:21.581 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-15T02:37:11.505391+0000', 'modified': '2023-11-15T02:37:14.517313+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9060}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9060': {'gid': 9060, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.1:6835/3330049946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6833', 'nonce': 3330049946}, {'type': 'v1', 'addr': '172.21.15.1:6835', 'nonce': 3330049946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-15T02:37:21.582 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-15T02:37:21.582 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-15T02:37:21.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.701+0000 7f0d2de27700 1 Processor -- start 2023-11-15T02:37:21.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.701+0000 7f0d2de27700 1 -- start start 2023-11-15T02:37:21.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.702+0000 7f0d2de27700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d280ab1a0 0x7f0d28154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.702+0000 7f0d2de27700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0d280aa060 0x7f0d280c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.702+0000 7f0d2de27700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d280c06f0 con 0x7f0d28154150 2023-11-15T02:37:21.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.702+0000 7f0d2de27700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d280c09d0 con 0x7f0d280aa060 2023-11-15T02:37:21.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.702+0000 7f0d2de27700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28158820 con 0x7f0d280ab1a0 2023-11-15T02:37:21.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.702+0000 7f0d27fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0d280aa060 0x7f0d280c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.702+0000 7f0d277fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0d28154150 0x7f0d28158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44796/0 (socket says 172.21.15.1:44796) 2023-11-15T02:37:21.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.702+0000 7f0d277fe700 1 -- 172.21.15.1:0/3217705770 learned_addr learned my addr 172.21.15.1:0/3217705770 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:21.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d26ffd700 1 --2- 172.21.15.1:0/3217705770 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d280ab1a0 0x7f0d28154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d27fff700 1 -- 172.21.15.1:0/3217705770 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d280ab1a0 msgr2=0x7f0d28154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:21.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d27fff700 1 --2- 172.21.15.1:0/3217705770 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d280ab1a0 0x7f0d28154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d27fff700 1 -- 172.21.15.1:0/3217705770 >> v1:172.21.15.1:6789/0 conn(0x7f0d28154150 legacy=0x7f0d28158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d267fc700 1 -- 172.21.15.1:0/3217705770 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312244330 0 0) 0x7f0d280c06f0 con 0x7f0d28154150 2023-11-15T02:37:21.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d27fff700 1 -- 172.21.15.1:0/3217705770 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d28158b00 con 0x7f0d280aa060 2023-11-15T02:37:21.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d26ffd700 1 --2- 172.21.15.1:0/3217705770 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d280ab1a0 0x7f0d28154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:21.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d27fff700 1 --2- 172.21.15.1:0/3217705770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d280aa060 0x7f0d280c5f10 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f0d20009e60 tx=0x7f0d20009780).ready entity=mon.0 client_cookie=3d55a62a8ecacba5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:21.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d267fc700 1 -- 172.21.15.1:0/3217705770 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2000e070 con 0x7f0d280aa060 2023-11-15T02:37:21.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d267fc700 1 -- 172.21.15.1:0/3217705770 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2000bc30 con 0x7f0d280aa060 2023-11-15T02:37:21.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d267fc700 1 -- 172.21.15.1:0/3217705770 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d20012410 con 0x7f0d280aa060 2023-11-15T02:37:21.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d2de27700 1 -- 172.21.15.1:0/3217705770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d280aa060 msgr2=0x7f0d280c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d2de27700 1 --2- 172.21.15.1:0/3217705770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d280aa060 0x7f0d280c5f10 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f0d20009e60 tx=0x7f0d20009780).stop 2023-11-15T02:37:21.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d2de27700 1 -- 172.21.15.1:0/3217705770 shutdown_connections 2023-11-15T02:37:21.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d2de27700 1 --2- 172.21.15.1:0/3217705770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d280aa060 0x7f0d280c5f10 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d2de27700 1 --2- 172.21.15.1:0/3217705770 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d280ab1a0 0x7f0d28154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.703+0000 7f0d2de27700 1 -- 172.21.15.1:0/3217705770 >> 172.21.15.1:0/3217705770 conn(0x7f0d28064aa0 msgr2=0x7f0d28064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:21.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.704+0000 7f0d2de27700 1 -- 172.21.15.1:0/3217705770 shutdown_connections 2023-11-15T02:37:21.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.704+0000 7f0d2de27700 1 -- 172.21.15.1:0/3217705770 wait complete. 2023-11-15T02:37:21.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.705+0000 7f0d2de27700 1 Processor -- start 2023-11-15T02:37:21.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.705+0000 7f0d2de27700 1 -- start start 2023-11-15T02:37:21.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d2de27700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d280aa060 0x7f0d2813bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d2de27700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d280ab1a0 0x7f0d280ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d2de27700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d28154150 0x7f0d280ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d2de27700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280cbb90 con 0x7f0d280ab1a0 2023-11-15T02:37:21.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d2de27700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280cb260 con 0x7f0d28154150 2023-11-15T02:37:21.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d2de27700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280cb540 con 0x7f0d280aa060 2023-11-15T02:37:21.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d26ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d280ab1a0 0x7f0d280ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d26ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d280ab1a0 0x7f0d280ca3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43380/0 (socket says 172.21.15.1:43380) 2023-11-15T02:37:21.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d26ffd700 1 -- 172.21.15.1:0/1627811798 learned_addr learned my addr 172.21.15.1:0/1627811798 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d277fe700 1 --2- 172.21.15.1:0/1627811798 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d280aa060 0x7f0d2813bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d27fff700 1 --2- 172.21.15.1:0/1627811798 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d28154150 0x7f0d280ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d26ffd700 1 -- 172.21.15.1:0/1627811798 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d280aa060 msgr2=0x7f0d2813bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d26ffd700 1 --2- 172.21.15.1:0/1627811798 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d280aa060 0x7f0d2813bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d26ffd700 1 -- 172.21.15.1:0/1627811798 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d28154150 msgr2=0x7f0d280ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d26ffd700 1 --2- 172.21.15.1:0/1627811798 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d28154150 0x7f0d280ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d26ffd700 1 -- 172.21.15.1:0/1627811798 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d20009a20 con 0x7f0d280ab1a0 2023-11-15T02:37:21.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d27fff700 1 --2- 172.21.15.1:0/1627811798 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d28154150 0x7f0d280ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:21.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d26ffd700 1 --2- 172.21.15.1:0/1627811798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d280ab1a0 0x7f0d280ca3d0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f0d1c00c880 tx=0x7f0d1c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:21.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d0f7fe700 1 -- 172.21.15.1:0/1627811798 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c010580 con 0x7f0d280ab1a0 2023-11-15T02:37:21.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d0f7fe700 1 -- 172.21.15.1:0/1627811798 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c0106e0 con 0x7f0d280ab1a0 2023-11-15T02:37:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d2de27700 1 -- 172.21.15.1:0/1627811798 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d280cb820 con 0x7f0d280ab1a0 2023-11-15T02:37:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d0f7fe700 1 -- 172.21.15.1:0/1627811798 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c010a60 con 0x7f0d280ab1a0 2023-11-15T02:37:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.706+0000 7f0d2de27700 1 -- 172.21.15.1:0/1627811798 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2813c030 con 0x7f0d280ab1a0 2023-11-15T02:37:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.708+0000 7f0d0f7fe700 1 -- 172.21.15.1:0/1627811798 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0d1c01b460 con 0x7f0d280ab1a0 2023-11-15T02:37:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.708+0000 7f0d0f7fe700 1 --2- 172.21.15.1:0/1627811798 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d1405f270 0x7f0d14061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.708+0000 7f0d0f7fe700 1 -- 172.21.15.1:0/1627811798 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f0d1c07a600 con 0x7f0d280ab1a0 2023-11-15T02:37:21.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.708+0000 7f0d277fe700 1 --2- 172.21.15.1:0/1627811798 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d1405f270 0x7f0d14061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.709+0000 7f0d277fe700 1 --2- 172.21.15.1:0/1627811798 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d1405f270 0x7f0d14061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0d18007fd0 tx=0x7f0d18007dd0).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:21.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.710+0000 7f0d3f7c0b80 1 Processor -- start 2023-11-15T02:37:21.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.710+0000 7f0d3f7c0b80 1 -- start start 2023-11-15T02:37:21.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d3f7c0b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78d07e40 0x562f78f73d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d3f7c0b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78f4b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d3f7c0b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78f4bcb0 0x562f78f46600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d3f7c0b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f78f11060 con 0x562f78d07e40 2023-11-15T02:37:21.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d3f7c0b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f78e881f0 con 0x562f78f4bcb0 2023-11-15T02:37:21.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d3f7c0b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f78e9d440 con 0x562f78f94ea0 2023-11-15T02:37:21.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d277fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78d07e40 0x562f78f73d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d277fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78d07e40 0x562f78f73d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43384/0 (socket says 172.21.15.1:43384) 2023-11-15T02:37:21.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d277fe700 1 -- 172.21.15.1:0/398917561 learned_addr learned my addr 172.21.15.1:0/398917561 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:21.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d26ffd700 1 --2- 172.21.15.1:0/398917561 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78f4b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d27fff700 1 --2- 172.21.15.1:0/398917561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78f4bcb0 0x562f78f46600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d277fe700 1 -- 172.21.15.1:0/398917561 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 msgr2=0x562f78f4b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:21.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d277fe700 1 --2- 172.21.15.1:0/398917561 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78f4b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d277fe700 1 -- 172.21.15.1:0/398917561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78f4bcb0 msgr2=0x562f78f46600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:21.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d277fe700 1 --2- 172.21.15.1:0/398917561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78f4bcb0 0x562f78f46600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d277fe700 1 -- 172.21.15.1:0/398917561 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f78e96620 con 0x562f78d07e40 2023-11-15T02:37:21.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.711+0000 7f0d27fff700 1 --2- 172.21.15.1:0/398917561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78f4bcb0 0x562f78f46600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:21.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.712+0000 7f0d277fe700 1 --2- 172.21.15.1:0/398917561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78d07e40 0x562f78f73d90 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f0d180147d0 tx=0x7f0d18013000).ready entity=mon.0 client_cookie=1fe1427cfc23917c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:21.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.712+0000 7f0d0cff9700 1 -- 172.21.15.1:0/398917561 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18014240 con 0x562f78d07e40 2023-11-15T02:37:21.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.712+0000 7f0d0cff9700 1 -- 172.21.15.1:0/398917561 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d18020450 con 0x562f78d07e40 2023-11-15T02:37:21.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.712+0000 7f0d0cff9700 1 -- 172.21.15.1:0/398917561 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d180207d0 con 0x562f78d07e40 2023-11-15T02:37:21.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.712+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/398917561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78d07e40 msgr2=0x562f78f73d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.712+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/398917561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78d07e40 0x562f78f73d90 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f0d180147d0 tx=0x7f0d18013000).stop 2023-11-15T02:37:21.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.712+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/398917561 shutdown_connections 2023-11-15T02:37:21.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.712+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/398917561 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78f4bcb0 0x562f78f46600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.712+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/398917561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78d07e40 0x562f78f73d90 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.712+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/398917561 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78f4b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.712+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/398917561 >> 172.21.15.1:0/398917561 conn(0x562f78db54a0 msgr2=0x562f78f94790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:21.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.712+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/398917561 shutdown_connections 2023-11-15T02:37:21.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.712+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/398917561 wait complete. 2023-11-15T02:37:21.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.713+0000 7f0d3f7c0b80 1 -- start start 2023-11-15T02:37:21.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.713+0000 7f0d3f7c0b80 1 Processor -- start 2023-11-15T02:37:21.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d3f7c0b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78d07e40 0x562f78f784a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d3f7c0b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78f4bcb0 0x562f78f73400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d3f7c0b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78f70dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d3f7c0b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f78e9d580 con 0x562f78f4bcb0 2023-11-15T02:37:21.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d3f7c0b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f78e9d800 con 0x562f78d07e40 2023-11-15T02:37:21.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d3f7c0b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f78e68e10 con 0x562f78f94ea0 2023-11-15T02:37:21.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d3f7c0b80 10 client.0 ll_register_callbacks cb 0x562f78f0b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T02:37:21.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d26ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78f4bcb0 0x562f78f73400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d26ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78f4bcb0 0x562f78f73400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43386/0 (socket says 172.21.15.1:43386) 2023-11-15T02:37:21.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d26ffd700 1 -- 172.21.15.1:0/3720659472 learned_addr learned my addr 172.21.15.1:0/3720659472 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:21.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d277fe700 1 --2- 172.21.15.1:0/3720659472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78d07e40 0x562f78f784a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d27fff700 1 --2- 172.21.15.1:0/3720659472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78f70dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d26ffd700 1 -- 172.21.15.1:0/3720659472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 msgr2=0x562f78f70dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:21.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d26ffd700 1 --2- 172.21.15.1:0/3720659472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78f70dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d26ffd700 1 -- 172.21.15.1:0/3720659472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78d07e40 msgr2=0x562f78f784a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:21.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d26ffd700 1 --2- 172.21.15.1:0/3720659472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78d07e40 0x562f78f784a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.714+0000 7f0d26ffd700 1 -- 172.21.15.1:0/3720659472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d180144a0 con 0x562f78f4bcb0 2023-11-15T02:37:21.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d26ffd700 1 --2- 172.21.15.1:0/3720659472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78f4bcb0 0x562f78f73400 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f0d1c006fd0 tx=0x7f0d1c01d040).ready entity=mon.0 client_cookie=c21ace7c536c7b6f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:21.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d05ffb700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T02:37:21.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d05ffb700 1 -- 172.21.15.1:0/3720659472 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c04ef30 con 0x562f78f4bcb0 2023-11-15T02:37:21.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d05ffb700 1 -- 172.21.15.1:0/3720659472 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f0d1c04e6b0 con 0x562f78f4bcb0 2023-11-15T02:37:21.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/3720659472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f78f3f720 con 0x562f78f4bcb0 2023-11-15T02:37:21.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d05ffb700 1 -- 172.21.15.1:0/3720659472 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d1c078bb0 con 0x562f78f4bcb0 2023-11-15T02:37:21.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d3f7c0b80 10 client.9234 fetch_fsmap learned FSMap version 79 2023-11-15T02:37:21.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/3720659472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x562f78e919c0 con 0x562f78f4bcb0 2023-11-15T02:37:21.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d05ffb700 1 -- 172.21.15.1:0/3720659472 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562f78f3f720 con 0x562f78f4bcb0 2023-11-15T02:37:21.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d05ffb700 1 -- 172.21.15.1:0/3720659472 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 79) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0d1c078d10 con 0x562f78f4bcb0 2023-11-15T02:37:21.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d3f7c0b80 10 client.9234 fetch_fsmap finished waiting for FSMap version 79 2023-11-15T02:37:21.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d3f7c0b80 10 client.9234 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-15T02:37:21.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d3f7c0b80 20 client.9234 populate_metadata read hostname 'smithi001' 2023-11-15T02:37:21.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/3720659472 >> [v2:172.21.15.1:6833/3330049946,v1:172.21.15.1:6835/3330049946] conn(0x562f78f90370 0x562f78f90750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d3f7c0b80 4 client.9234 mds_command: new command op to 9060 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-15T02:37:21.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/3720659472 --> [v2:172.21.15.1:6833/3330049946,v1:172.21.15.1:6835/3330049946] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f78d03ca0 con 0x562f78f90370 2023-11-15T02:37:21.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.715+0000 7f0d277fe700 1 --2- 172.21.15.1:0/3720659472 >> [v2:172.21.15.1:6833/3330049946,v1:172.21.15.1:6835/3330049946] conn(0x562f78f90370 0x562f78f90750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d05ffb700 10 client.9234 ms_handle_connect on v2:172.21.15.1:6833/3330049946 2023-11-15T02:37:21.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d277fe700 1 --2- 172.21.15.1:0/3720659472 >> [v2:172.21.15.1:6833/3330049946,v1:172.21.15.1:6835/3330049946] conn(0x562f78f90370 0x562f78f90750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=45be462d06ea9e25 server_cookie=b21a73ba04e065a5 in_seq=0 out_seq=0 2023-11-15T02:37:21.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d05ffb700 1 -- 172.21.15.1:0/3720659472 <== mds.0 v2:172.21.15.1:6833/3330049946 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x562f78d03ca0 con 0x562f78f90370 2023-11-15T02:37:21.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d05ffb700 10 client.9234 handle_command_reply: tid=0 2023-11-15T02:37:21.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d3f7c0b80 1 client.9234 shutdown 2023-11-15T02:37:21.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/3720659472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78f4bcb0 msgr2=0x562f78f73400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/3720659472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78f4bcb0 0x562f78f73400 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f0d1c006fd0 tx=0x7f0d1c01d040).stop 2023-11-15T02:37:21.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/3720659472 shutdown_connections 2023-11-15T02:37:21.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/3720659472 >> [v2:172.21.15.1:6833/3330049946,v1:172.21.15.1:6835/3330049946] conn(0x562f78f90370 0x562f78f90750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/3720659472 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78f70dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/3720659472 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78d07e40 0x562f78f784a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d05ffb700 0 client.9234 ms_handle_reset on v2:172.21.15.1:6833/3330049946 2023-11-15T02:37:21.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/3720659472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78f4bcb0 0x562f78f73400 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/3720659472 >> 172.21.15.1:0/3720659472 conn(0x562f78db54a0 msgr2=0x562f78f4c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:21.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/3720659472 shutdown_connections 2023-11-15T02:37:21.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.716+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/3720659472 wait complete. 2023-11-15T02:37:21.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.717+0000 7f0d3f7c0b80 20 client.9234 trim_cache size 0 max 16384 2023-11-15T02:37:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.733+0000 7f0d3f7c0b80 1 Processor -- start 2023-11-15T02:37:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.733+0000 7f0d3f7c0b80 1 -- start start 2023-11-15T02:37:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d3f7c0b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78d07e40 0x562f78f768e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d3f7c0b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78f4bcb0 0x562f78f47850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d3f7c0b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78fa90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d3f7c0b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f78fa26f0 con 0x562f78f4bcb0 2023-11-15T02:37:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d3f7c0b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f78fa23e0 con 0x562f78d07e40 2023-11-15T02:37:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d3f7c0b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f78f75840 con 0x562f78f94ea0 2023-11-15T02:37:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d26ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78f4bcb0 0x562f78f47850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d26ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78f4bcb0 0x562f78f47850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43394/0 (socket says 172.21.15.1:43394) 2023-11-15T02:37:21.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d26ffd700 1 -- 172.21.15.1:0/2209496653 learned_addr learned my addr 172.21.15.1:0/2209496653 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:21.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d27fff700 1 --2- 172.21.15.1:0/2209496653 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78fa90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d277fe700 1 --2- 172.21.15.1:0/2209496653 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78d07e40 0x562f78f768e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d26ffd700 1 -- 172.21.15.1:0/2209496653 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 msgr2=0x562f78fa90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:21.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d26ffd700 1 --2- 172.21.15.1:0/2209496653 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78fa90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d26ffd700 1 -- 172.21.15.1:0/2209496653 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78d07e40 msgr2=0x562f78f768e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:21.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d26ffd700 1 --2- 172.21.15.1:0/2209496653 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78d07e40 0x562f78f768e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d26ffd700 1 -- 172.21.15.1:0/2209496653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f78f3f340 con 0x562f78f4bcb0 2023-11-15T02:37:21.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.734+0000 7f0d26ffd700 1 --2- 172.21.15.1:0/2209496653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78f4bcb0 0x562f78f47850 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f0d1c04b6c0 tx=0x7f0d1c012000).ready entity=mon.0 client_cookie=d65170f4a05b3080 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:21.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.735+0000 7f0d0d7fa700 1 -- 172.21.15.1:0/2209496653 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c018c40 con 0x562f78f4bcb0 2023-11-15T02:37:21.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.735+0000 7f0d0d7fa700 1 -- 172.21.15.1:0/2209496653 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c04ef30 con 0x562f78f4bcb0 2023-11-15T02:37:21.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.735+0000 7f0d0d7fa700 1 -- 172.21.15.1:0/2209496653 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c018e00 con 0x562f78f4bcb0 2023-11-15T02:37:21.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.735+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/2209496653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78f4bcb0 msgr2=0x562f78f47850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.735+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/2209496653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78f4bcb0 0x562f78f47850 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f0d1c04b6c0 tx=0x7f0d1c012000).stop 2023-11-15T02:37:21.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.735+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/2209496653 shutdown_connections 2023-11-15T02:37:21.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.735+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/2209496653 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78fa90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.735+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/2209496653 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78d07e40 0x562f78f768e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.735+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/2209496653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78f4bcb0 0x562f78f47850 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.735+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/2209496653 >> 172.21.15.1:0/2209496653 conn(0x562f78db54a0 msgr2=0x562f78f494c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:21.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.735+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/2209496653 shutdown_connections 2023-11-15T02:37:21.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.735+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/2209496653 wait complete. 2023-11-15T02:37:21.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.736+0000 7f0d3f7c0b80 1 -- start start 2023-11-15T02:37:21.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.736+0000 7f0d3f7c0b80 1 Processor -- start 2023-11-15T02:37:21.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.736+0000 7f0d3f7c0b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78d07e40 0x562f78f8e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d3f7c0b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78f4bcb0 0x562f78fde680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d3f7c0b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78fa9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d3f7c0b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f78fee810 con 0x562f78d07e40 2023-11-15T02:37:21.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d3f7c0b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f78fa99a0 con 0x562f78f4bcb0 2023-11-15T02:37:21.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d3f7c0b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f78fdeb70 con 0x562f78f94ea0 2023-11-15T02:37:21.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d3f7c0b80 10 client.0 ll_register_callbacks cb 0x562f78f0b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T02:37:21.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d277fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78d07e40 0x562f78f8e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d277fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78d07e40 0x562f78f8e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43400/0 (socket says 172.21.15.1:43400) 2023-11-15T02:37:21.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d277fe700 1 -- 172.21.15.1:0/345473461 learned_addr learned my addr 172.21.15.1:0/345473461 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:21.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d27fff700 1 --2- 172.21.15.1:0/345473461 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78fa9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d26ffd700 1 --2- 172.21.15.1:0/345473461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78f4bcb0 0x562f78fde680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d277fe700 1 -- 172.21.15.1:0/345473461 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 msgr2=0x562f78fa9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:21.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d277fe700 1 --2- 172.21.15.1:0/345473461 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78fa9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d277fe700 1 -- 172.21.15.1:0/345473461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78f4bcb0 msgr2=0x562f78fde680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:21.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d277fe700 1 --2- 172.21.15.1:0/345473461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78f4bcb0 0x562f78fde680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d277fe700 1 -- 172.21.15.1:0/345473461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f78e919c0 con 0x562f78d07e40 2023-11-15T02:37:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d27fff700 1 --2- 172.21.15.1:0/345473461 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78fa9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d277fe700 1 --2- 172.21.15.1:0/345473461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78d07e40 0x562f78f8e400 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f0d18007680 tx=0x7f0d18019000).ready entity=mon.0 client_cookie=a4a4ec9ffcc4fc53 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d05ffb700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T02:37:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d05ffb700 1 -- 172.21.15.1:0/345473461 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18027040 con 0x562f78d07e40 2023-11-15T02:37:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d05ffb700 1 -- 172.21.15.1:0/345473461 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f0d18020dd0 con 0x562f78d07e40 2023-11-15T02:37:21.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/345473461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d18020450 con 0x562f78d07e40 2023-11-15T02:37:21.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d05ffb700 1 -- 172.21.15.1:0/345473461 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d18006310 con 0x562f78d07e40 2023-11-15T02:37:21.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d3f7c0b80 10 client.9240 fetch_fsmap learned FSMap version 79 2023-11-15T02:37:21.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/345473461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x562f78e91710 con 0x562f78d07e40 2023-11-15T02:37:21.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.737+0000 7f0d05ffb700 1 -- 172.21.15.1:0/345473461 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d18020450 con 0x562f78d07e40 2023-11-15T02:37:21.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d05ffb700 1 -- 172.21.15.1:0/345473461 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 79) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0d180046b0 con 0x562f78d07e40 2023-11-15T02:37:21.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 10 client.9240 fetch_fsmap finished waiting for FSMap version 79 2023-11-15T02:37:21.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 10 client.9240 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-15T02:37:21.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 20 client.9240 populate_metadata read hostname 'smithi001' 2023-11-15T02:37:21.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/345473461 >> [v2:172.21.15.1:6833/3330049946,v1:172.21.15.1:6835/3330049946] conn(0x562f78fedb50 0x562f78fedf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 4 client.9240 mds_command: new command op to 9060 tid=0[{"prefix": "status"}] 2023-11-15T02:37:21.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/345473461 --> [v2:172.21.15.1:6833/3330049946,v1:172.21.15.1:6835/3330049946] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562f78d3aca0 con 0x562f78fedb50 2023-11-15T02:37:21.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d26ffd700 1 --2- 172.21.15.1:0/345473461 >> [v2:172.21.15.1:6833/3330049946,v1:172.21.15.1:6835/3330049946] conn(0x562f78fedb50 0x562f78fedf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d05ffb700 10 client.9240 ms_handle_connect on v2:172.21.15.1:6833/3330049946 2023-11-15T02:37:21.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d26ffd700 1 --2- 172.21.15.1:0/345473461 >> [v2:172.21.15.1:6833/3330049946,v1:172.21.15.1:6835/3330049946] conn(0x562f78fedb50 0x562f78fedf30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=973b840d2bc97b13 server_cookie=81952d2c4b3ee32e in_seq=0 out_seq=0 2023-11-15T02:37:21.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d05ffb700 1 -- 172.21.15.1:0/345473461 <== mds.0 v2:172.21.15.1:6833/3330049946 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x562f78d3aca0 con 0x562f78fedb50 2023-11-15T02:37:21.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d05ffb700 10 client.9240 handle_command_reply: tid=0 2023-11-15T02:37:21.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 1 client.9240 shutdown 2023-11-15T02:37:21.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/345473461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78d07e40 msgr2=0x562f78f8e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/345473461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78d07e40 0x562f78f8e400 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f0d18007680 tx=0x7f0d18019000).stop 2023-11-15T02:37:21.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/345473461 shutdown_connections 2023-11-15T02:37:21.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/345473461 >> [v2:172.21.15.1:6833/3330049946,v1:172.21.15.1:6835/3330049946] conn(0x562f78fedb50 0x562f78fedf30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/345473461 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562f78f94ea0 0x562f78fa9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/345473461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f78d07e40 0x562f78f8e400 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d05ffb700 0 client.9240 ms_handle_reset on v2:172.21.15.1:6833/3330049946 2023-11-15T02:37:21.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 1 --2- 172.21.15.1:0/345473461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562f78f4bcb0 0x562f78fde680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/345473461 >> 172.21.15.1:0/345473461 conn(0x562f78db54a0 msgr2=0x562f78f47850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:21.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/345473461 shutdown_connections 2023-11-15T02:37:21.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.738+0000 7f0d3f7c0b80 1 -- 172.21.15.1:0/345473461 wait complete. 2023-11-15T02:37:21.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.739+0000 7f0d3f7c0b80 20 client.9240 trim_cache size 0 max 16384 2023-11-15T02:37:21.765 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:37:21.766 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "32ffb44b-12dc-4e79-bad7-24a9692dabf6", 2023-11-15T02:37:21.766 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2023-11-15T02:37:21.766 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 9060, 2023-11-15T02:37:21.766 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2023-11-15T02:37:21.767 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2023-11-15T02:37:21.767 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2023-11-15T02:37:21.767 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 10.232899583, 2023-11-15T02:37:21.767 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 79, 2023-11-15T02:37:21.767 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 177, 2023-11-15T02:37:21.767 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 177, 2023-11-15T02:37:21.768 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 15.724945760000001 2023-11-15T02:37:21.768 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:37:21.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.739+0000 7f0d2de27700 1 -- 172.21.15.1:0/1627811798 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d1405f270 msgr2=0x7f0d14061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.739+0000 7f0d2de27700 1 --2- 172.21.15.1:0/1627811798 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d1405f270 0x7f0d14061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0d18007fd0 tx=0x7f0d18007dd0).stop 2023-11-15T02:37:21.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.739+0000 7f0d2de27700 1 -- 172.21.15.1:0/1627811798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d280ab1a0 msgr2=0x7f0d280ca3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.739+0000 7f0d2de27700 1 --2- 172.21.15.1:0/1627811798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d280ab1a0 0x7f0d280ca3d0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f0d1c00c880 tx=0x7f0d1c008040).stop 2023-11-15T02:37:21.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.739+0000 7f0d2de27700 1 -- 172.21.15.1:0/1627811798 shutdown_connections 2023-11-15T02:37:21.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.739+0000 7f0d2de27700 1 --2- 172.21.15.1:0/1627811798 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f0d1405f270 0x7f0d14061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.739+0000 7f0d2de27700 1 --2- 172.21.15.1:0/1627811798 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d28154150 0x7f0d280ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.739+0000 7f0d2de27700 1 --2- 172.21.15.1:0/1627811798 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d280aa060 0x7f0d2813bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.739+0000 7f0d2de27700 1 --2- 172.21.15.1:0/1627811798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d280ab1a0 0x7f0d280ca3d0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.739+0000 7f0d2de27700 1 -- 172.21.15.1:0/1627811798 >> 172.21.15.1:0/1627811798 conn(0x7f0d28064aa0 msgr2=0x7f0d280c5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:21.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.739+0000 7f0d2de27700 1 -- 172.21.15.1:0/1627811798 shutdown_connections 2023-11-15T02:37:21.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.739+0000 7f0d2de27700 1 -- 172.21.15.1:0/1627811798 wait complete. 2023-11-15T02:37:21.772 DEBUG:teuthology.orchestra.run.smithi001:> ceph fs ls 2023-11-15T02:37:21.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.876+0000 7ff5588db700 1 Processor -- start 2023-11-15T02:37:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.876+0000 7ff5588db700 1 -- start start 2023-11-15T02:37:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff5588db700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff554158cf0 0x7ff5540c1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff5588db700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff554158150 con 0x7ff554154410 2023-11-15T02:37:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff5588db700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff554063670 con 0x7ff554062c10 2023-11-15T02:37:21.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff5588db700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff554063950 con 0x7ff554158cf0 2023-11-15T02:37:21.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55259c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff554154410 0x7ff5540ab090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44804/0 (socket says 172.21.15.1:44804) 2023-11-15T02:37:21.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55259c700 1 -- 172.21.15.1:0/962056134 learned_addr learned my addr 172.21.15.1:0/962056134 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:21.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff552d9d700 1 --2- 172.21.15.1:0/962056134 >> v2:172.21.15.141:3300/0 conn(0x7ff554158cf0 0x7ff5540c1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55159a700 1 -- 172.21.15.1:0/962056134 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977583095 0 0) 0x7ff554158150 con 0x7ff554154410 2023-11-15T02:37:21.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55159a700 1 -- 172.21.15.1:0/962056134 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff53c0033f0 con 0x7ff554154410 2023-11-15T02:37:21.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55159a700 1 -- 172.21.15.1:0/962056134 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3820706210 0 0) 0x7ff53c0033f0 con 0x7ff554154410 2023-11-15T02:37:21.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55159a700 1 -- 172.21.15.1:0/962056134 >> v2:172.21.15.141:3300/0 conn(0x7ff554158cf0 msgr2=0x7ff5540c1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:21.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55159a700 1 --2- 172.21.15.1:0/962056134 >> v2:172.21.15.141:3300/0 conn(0x7ff554158cf0 0x7ff5540c1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55159a700 1 -- 172.21.15.1:0/962056134 >> v1:172.21.15.141:6789/0 conn(0x7ff554062c10 legacy=0x7ff5541585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55159a700 1 -- 172.21.15.1:0/962056134 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff554063c30 con 0x7ff554154410 2023-11-15T02:37:21.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55159a700 1 -- 172.21.15.1:0/962056134 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7ff544001470 con 0x7ff554154410 2023-11-15T02:37:21.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55159a700 1 -- 172.21.15.1:0/962056134 >> v1:172.21.15.1:6789/0 conn(0x7ff554154410 legacy=0x7ff5540ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55159a700 1 --2- 172.21.15.1:0/962056134 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c0038e0 0x7ff53c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55159a700 1 --2- 172.21.15.1:0/962056134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff53c004690 0x7ff53c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55159a700 1 --2- 172.21.15.1:0/962056134 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff53c005000 0x7ff53c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55159a700 1 -- 172.21.15.1:0/962056134 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff554063950 con 0x7ff53c004690 2023-11-15T02:37:21.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55159a700 1 -- 172.21.15.1:0/962056134 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c00beb0 con 0x7ff53c005000 2023-11-15T02:37:21.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.877+0000 7ff55159a700 1 -- 172.21.15.1:0/962056134 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c00c070 con 0x7ff53c0038e0 2023-11-15T02:37:21.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.878+0000 7ff551d9b700 1 --2- 172.21.15.1:0/962056134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff53c004690 0x7ff53c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.878+0000 7ff55259c700 1 --2- 172.21.15.1:0/962056134 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c0038e0 0x7ff53c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.878+0000 7ff552d9d700 1 --2- 172.21.15.1:0/962056134 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff53c005000 0x7ff53c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.878+0000 7ff551d9b700 1 -- 172.21.15.1:0/962056134 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c0038e0 msgr2=0x7ff53c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:21.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.878+0000 7ff551d9b700 1 --2- 172.21.15.1:0/962056134 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c0038e0 0x7ff53c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.878+0000 7ff551d9b700 1 -- 172.21.15.1:0/962056134 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff53c005000 msgr2=0x7ff53c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:21.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.878+0000 7ff551d9b700 1 --2- 172.21.15.1:0/962056134 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff53c005000 0x7ff53c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.878+0000 7ff551d9b700 1 -- 172.21.15.1:0/962056134 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0033f0 con 0x7ff53c004690 2023-11-15T02:37:21.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.878+0000 7ff552d9d700 1 --2- 172.21.15.1:0/962056134 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff53c005000 0x7ff53c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:21.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.878+0000 7ff552d9d700 1 -- 172.21.15.1:0/962056134 reap_dead start 2023-11-15T02:37:21.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.878+0000 7ff551d9b700 1 --2- 172.21.15.1:0/962056134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff53c004690 0x7ff53c004b10 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7ff548001730 tx=0x7ff548007bb0).ready entity=mon.0 client_cookie=dab16e7182d1721f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.878+0000 7ff55159a700 1 -- 172.21.15.1:0/962056134 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548007020 con 0x7ff53c004690 2023-11-15T02:37:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.878+0000 7ff55159a700 1 -- 172.21.15.1:0/962056134 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff548007180 con 0x7ff53c004690 2023-11-15T02:37:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.878+0000 7ff55159a700 1 -- 172.21.15.1:0/962056134 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548007520 con 0x7ff53c004690 2023-11-15T02:37:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.879+0000 7ff5588db700 1 -- 172.21.15.1:0/962056134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff53c004690 msgr2=0x7ff53c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.879+0000 7ff5588db700 1 --2- 172.21.15.1:0/962056134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff53c004690 0x7ff53c004b10 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7ff548001730 tx=0x7ff548007bb0).stop 2023-11-15T02:37:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.879+0000 7ff5588db700 1 -- 172.21.15.1:0/962056134 shutdown_connections 2023-11-15T02:37:21.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.879+0000 7ff5588db700 1 --2- 172.21.15.1:0/962056134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff53c004690 0x7ff53c004b10 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.879+0000 7ff5588db700 1 -- 172.21.15.1:0/962056134 >> 172.21.15.1:0/962056134 conn(0x7ff5540cbbd0 msgr2=0x7ff5540c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:21.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.879+0000 7ff5588db700 1 -- 172.21.15.1:0/962056134 shutdown_connections 2023-11-15T02:37:21.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.879+0000 7ff5588db700 1 -- 172.21.15.1:0/962056134 wait complete. 2023-11-15T02:37:21.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.880+0000 7ff5588db700 1 Processor -- start 2023-11-15T02:37:21.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.880+0000 7ff5588db700 1 -- start start 2023-11-15T02:37:21.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff5588db700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c004690 0x7ff55414bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff5588db700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5541535a0 0x7ff5541569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff5588db700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff554153a20 0x7ff554156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff5588db700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff554153110 con 0x7ff5541535a0 2023-11-15T02:37:21.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff5588db700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5541527e0 con 0x7ff554153a20 2023-11-15T02:37:21.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff5588db700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff554152ac0 con 0x7ff53c004690 2023-11-15T02:37:21.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff551d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5541535a0 0x7ff5541569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff551d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5541535a0 0x7ff5541569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43410/0 (socket says 172.21.15.1:43410) 2023-11-15T02:37:21.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff551d9b700 1 -- 172.21.15.1:0/3842104920 learned_addr learned my addr 172.21.15.1:0/3842104920 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:21.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff55259c700 1 --2- 172.21.15.1:0/3842104920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c004690 0x7ff55414bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff552d9d700 1 --2- 172.21.15.1:0/3842104920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff554153a20 0x7ff554156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff551d9b700 1 -- 172.21.15.1:0/3842104920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c004690 msgr2=0x7ff55414bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff551d9b700 1 --2- 172.21.15.1:0/3842104920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c004690 0x7ff55414bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff551d9b700 1 -- 172.21.15.1:0/3842104920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff554153a20 msgr2=0x7ff554156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:21.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff551d9b700 1 --2- 172.21.15.1:0/3842104920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff554153a20 0x7ff554156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:21.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff551d9b700 1 -- 172.21.15.1:0/3842104920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff554152da0 con 0x7ff5541535a0 2023-11-15T02:37:21.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff551d9b700 1 --2- 172.21.15.1:0/3842104920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5541535a0 0x7ff5541569c0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7ff53c00be80 tx=0x7ff548015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:21.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff5427fc700 1 -- 172.21.15.1:0/3842104920 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548007020 con 0x7ff5541535a0 2023-11-15T02:37:21.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff5427fc700 1 -- 172.21.15.1:0/3842104920 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff548013460 con 0x7ff5541535a0 2023-11-15T02:37:21.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff5588db700 1 -- 172.21.15.1:0/3842104920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff554152420 con 0x7ff5541535a0 2023-11-15T02:37:21.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff5427fc700 1 -- 172.21.15.1:0/3842104920 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548013820 con 0x7ff5541535a0 2023-11-15T02:37:21.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.881+0000 7ff5588db700 1 -- 172.21.15.1:0/3842104920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff554150fd0 con 0x7ff5541535a0 2023-11-15T02:37:21.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.882+0000 7ff5588db700 1 -- 172.21.15.1:0/3842104920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5541532c0 con 0x7ff5541535a0 2023-11-15T02:37:21.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.883+0000 7ff5427fc700 1 -- 172.21.15.1:0/3842104920 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff548013c50 con 0x7ff5541535a0 2023-11-15T02:37:21.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.883+0000 7ff5427fc700 1 --2- 172.21.15.1:0/3842104920 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff53405f2a0 0x7ff534061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:21.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.883+0000 7ff5427fc700 1 -- 172.21.15.1:0/3842104920 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7ff54807ae80 con 0x7ff5541535a0 2023-11-15T02:37:21.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.883+0000 7ff55259c700 1 --2- 172.21.15.1:0/3842104920 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff53405f2a0 0x7ff534061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:21.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.884+0000 7ff55259c700 1 --2- 172.21.15.1:0/3842104920 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff53405f2a0 0x7ff534061760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff544000c00 tx=0x7ff544001e50).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:21.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:21.887+0000 7ff5427fc700 1 -- 172.21.15.1:0/3842104920 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff5541532c0 con 0x7ff5541535a0 2023-11-15T02:37:22.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.103+0000 7ff5588db700 1 -- 172.21.15.1:0/3842104920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff5540475e0 con 0x7ff5541535a0 2023-11-15T02:37:22.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.104+0000 7ff5427fc700 1 -- 172.21.15.1:0/3842104920 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v79) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff548007e60 con 0x7ff5541535a0 2023-11-15T02:37:22.106 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-15T02:37:22.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.105+0000 7ff5588db700 1 -- 172.21.15.1:0/3842104920 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff53405f2a0 msgr2=0x7ff534061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:22.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.105+0000 7ff5588db700 1 --2- 172.21.15.1:0/3842104920 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff53405f2a0 0x7ff534061760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff544000c00 tx=0x7ff544001e50).stop 2023-11-15T02:37:22.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.105+0000 7ff5588db700 1 -- 172.21.15.1:0/3842104920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5541535a0 msgr2=0x7ff5541569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:22.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.105+0000 7ff5588db700 1 --2- 172.21.15.1:0/3842104920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5541535a0 0x7ff5541569c0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7ff53c00be80 tx=0x7ff548015000).stop 2023-11-15T02:37:22.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.105+0000 7ff5588db700 1 -- 172.21.15.1:0/3842104920 shutdown_connections 2023-11-15T02:37:22.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.105+0000 7ff5588db700 1 --2- 172.21.15.1:0/3842104920 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff53405f2a0 0x7ff534061760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:22.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.105+0000 7ff5588db700 1 --2- 172.21.15.1:0/3842104920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff554153a20 0x7ff554156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:22.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.105+0000 7ff5588db700 1 --2- 172.21.15.1:0/3842104920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c004690 0x7ff55414bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:22.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.105+0000 7ff5588db700 1 --2- 172.21.15.1:0/3842104920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5541535a0 0x7ff5541569c0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:22.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.105+0000 7ff5588db700 1 -- 172.21.15.1:0/3842104920 >> 172.21.15.1:0/3842104920 conn(0x7ff5540cbbd0 msgr2=0x7ff5540ac430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:22.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.105+0000 7ff5588db700 1 -- 172.21.15.1:0/3842104920 shutdown_connections 2023-11-15T02:37:22.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.105+0000 7ff5588db700 1 -- 172.21.15.1:0/3842104920 wait complete. 2023-11-15T02:37:22.118 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-15T02:37:22.118 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-15T02:37:22.119 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-11-15T02:37:22.119 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-15T02:37:22.119 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-15T02:37:22.120 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-15T02:37:22.120 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-15T02:37:22.121 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-15T02:37:22.121 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T02:37:22.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:37:22.122 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-11-15T02:37:22.138 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T02:37:22.138 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T02:37:22.139 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T02:37:22.139 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:37:22.139 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-11-15T02:37:22.139 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:37:22.140 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T02:37:22.140 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-11-15T02:37:22.140 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-11-15T02:37:22.140 INFO:teuthology.orchestra.run.smithi001.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-15T02:37:22.140 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-11-15T02:37:22.141 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-11-15T02:37:22.141 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-15T02:37:22.141 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 37963sec preferred_lft 37963sec 2023-11-15T02:37:22.141 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2023-11-15T02:37:22.142 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:37:22.142 INFO:teuthology.orchestra.run.smithi001.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T02:37:22.142 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-11-15T02:37:22.142 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-11-15T02:37:22.142 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T02:37:22.143 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-11-15T02:37:22.143 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-11-15T02:37:22.143 INFO:teuthology.orchestra.run.smithi001.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-15T02:37:22.143 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff 2023-11-15T02:37:22.144 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-15T02:37:22.144 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:37:22.144 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::74ff:4aff:fef6:c8f5/64 scope link 2023-11-15T02:37:22.144 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:37:22.145 INFO:teuthology.orchestra.run.smithi001.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T02:37:22.145 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-15T02:37:22.145 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::10ca:5cff:fe8a:9a23/64 scope link 2023-11-15T02:37:22.145 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:37:22.146 INFO:teuthology.orchestra.run.smithi001.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T02:37:22.146 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 92:7a:64:05:0f:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-15T02:37:22.146 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::907a:64ff:fe05:f37/64 scope link 2023-11-15T02:37:22.146 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:37:22.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:37:22.147 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-15T02:37:22.202 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-11-15T02:37:22.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:37:22.204 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-11-15T02:37:22.260 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-11-15T02:37:22.260 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-15T02:37:22.260 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-15T02:37:22.260 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-15T02:37:22.261 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-15T02:37:22.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:37:22.262 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T02:37:22.262 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T02:37:22.263 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-15T02:37:22.263 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-15T02:37:22.264 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-15T02:37:22.264 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T02:37:22.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:37:22.364 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T02:37:22.379 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-15T02:37:22.380 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-15T02:37:22.380 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T02:37:22.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:37:22.381 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2023-11-15T02:37:22.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:37:22.445 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-15T02:37:22.500 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-15T02:37:22.500 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T02:37:22.580 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T02:37:22.581 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T02:37:22.605 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T02:37:22.605 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T02:37:22.608 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-15T02:37:22.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:37:22.608 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-15T02:37:22.674 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-15T02:37:22.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.830+0000 7f6ecb196700 1 Processor -- start 2023-11-15T02:37:22.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.830+0000 7f6ecb196700 1 -- start start 2023-11-15T02:37:22.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.831+0000 7f6ecb196700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec4154250 0x7f6ec4154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:22.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.831+0000 7f6ecb196700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec4158ff0 con 0x7f6ec40c6110 2023-11-15T02:37:22.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.831+0000 7f6ecb196700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec4158100 con 0x7f6ec40aa700 2023-11-15T02:37:22.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.831+0000 7f6ecb196700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec41583e0 con 0x7f6ec4154250 2023-11-15T02:37:22.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.831+0000 7f6ec3fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6ec40c6110 0x7f6ec40a9ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44820/0 (socket says 172.21.15.1:44820) 2023-11-15T02:37:22.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.831+0000 7f6ec3fff700 1 -- 172.21.15.1:0/691560337 learned_addr learned my addr 172.21.15.1:0/691560337 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:22.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec8f32700 1 --2- 172.21.15.1:0/691560337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec4154250 0x7f6ec4154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:22.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec37fe700 1 -- 172.21.15.1:0/691560337 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736470458 0 0) 0x7f6ec4158ff0 con 0x7f6ec40c6110 2023-11-15T02:37:22.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec37fe700 1 -- 172.21.15.1:0/691560337 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb00033f0 con 0x7f6ec40c6110 2023-11-15T02:37:22.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec37fe700 1 -- 172.21.15.1:0/691560337 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3875295463 0 0) 0x7f6eb00033f0 con 0x7f6ec40c6110 2023-11-15T02:37:22.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec37fe700 1 -- 172.21.15.1:0/691560337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec4154250 msgr2=0x7f6ec4154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:22.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec37fe700 1 --2- 172.21.15.1:0/691560337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec4154250 0x7f6ec4154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec37fe700 1 -- 172.21.15.1:0/691560337 >> v1:172.21.15.141:6789/0 conn(0x7f6ec40aa700 legacy=0x7f6ec40c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec37fe700 1 -- 172.21.15.1:0/691560337 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec41586c0 con 0x7f6ec40c6110 2023-11-15T02:37:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec37fe700 1 -- 172.21.15.1:0/691560337 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f6eb40017f0 con 0x7f6ec40c6110 2023-11-15T02:37:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec37fe700 1 -- 172.21.15.1:0/691560337 >> v1:172.21.15.1:6789/0 conn(0x7f6ec40c6110 legacy=0x7f6ec40a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec37fe700 1 --2- 172.21.15.1:0/691560337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb0003910 0x7f6eb0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec37fe700 1 --2- 172.21.15.1:0/691560337 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6eb0004690 0x7f6eb0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec37fe700 1 --2- 172.21.15.1:0/691560337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec4154250 0x7f6eb0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec37fe700 1 -- 172.21.15.1:0/691560337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec41583e0 con 0x7f6eb0003910 2023-11-15T02:37:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec37fe700 1 -- 172.21.15.1:0/691560337 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb000b910 con 0x7f6eb0004690 2023-11-15T02:37:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec37fe700 1 -- 172.21.15.1:0/691560337 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb000bad0 con 0x7f6ec4154250 2023-11-15T02:37:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec8f32700 1 --2- 172.21.15.1:0/691560337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb0003910 0x7f6eb0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec3fff700 1 --2- 172.21.15.1:0/691560337 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6eb0004690 0x7f6eb0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec9733700 1 --2- 172.21.15.1:0/691560337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec4154250 0x7f6eb0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec8f32700 1 -- 172.21.15.1:0/691560337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec4154250 msgr2=0x7f6eb0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec8f32700 1 --2- 172.21.15.1:0/691560337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec4154250 0x7f6eb0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec8f32700 1 -- 172.21.15.1:0/691560337 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6eb0004690 msgr2=0x7f6eb0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec8f32700 1 --2- 172.21.15.1:0/691560337 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6eb0004690 0x7f6eb0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec8f32700 1 -- 172.21.15.1:0/691560337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb00033f0 con 0x7f6eb0003910 2023-11-15T02:37:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec3fff700 1 --2- 172.21.15.1:0/691560337 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6eb0004690 0x7f6eb0004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:37:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.832+0000 7f6ec8f32700 1 --2- 172.21.15.1:0/691560337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb0003910 0x7f6eb0003d30 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7f6ebc009a80 tx=0x7f6ebc009060).ready entity=mon.0 client_cookie=7e98d4314cc474e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.833+0000 7f6ec37fe700 1 -- 172.21.15.1:0/691560337 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc009430 con 0x7f6eb0003910 2023-11-15T02:37:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.833+0000 7f6ec37fe700 1 -- 172.21.15.1:0/691560337 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc00e640 con 0x7f6eb0003910 2023-11-15T02:37:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.833+0000 7f6ec37fe700 1 -- 172.21.15.1:0/691560337 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc00e9c0 con 0x7f6eb0003910 2023-11-15T02:37:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.833+0000 7f6ecb196700 1 -- 172.21.15.1:0/691560337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb0003910 msgr2=0x7f6eb0003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.833+0000 7f6ecb196700 1 --2- 172.21.15.1:0/691560337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb0003910 0x7f6eb0003d30 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7f6ebc009a80 tx=0x7f6ebc009060).stop 2023-11-15T02:37:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.833+0000 7f6ec9733700 1 -- 172.21.15.1:0/691560337 reap_dead start 2023-11-15T02:37:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.833+0000 7f6ecb196700 1 -- 172.21.15.1:0/691560337 shutdown_connections 2023-11-15T02:37:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.833+0000 7f6ecb196700 1 -- 172.21.15.1:0/691560337 >> 172.21.15.1:0/691560337 conn(0x7f6ec40c7b20 msgr2=0x7f6ec40c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.833+0000 7f6ecb196700 1 -- 172.21.15.1:0/691560337 shutdown_connections 2023-11-15T02:37:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.833+0000 7f6ecb196700 1 -- 172.21.15.1:0/691560337 wait complete. 2023-11-15T02:37:22.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.834+0000 7f6ecb196700 1 Processor -- start 2023-11-15T02:37:22.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.834+0000 7f6ecb196700 1 -- start start 2023-11-15T02:37:22.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.835+0000 7f6ecb196700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb0003910 0x7f6ec40caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:22.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.835+0000 7f6ecb196700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec40b0880 0x7f6ec414c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:22.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.835+0000 7f6ecb196700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ec40c4130 0x7f6ec40c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:22.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.835+0000 7f6ecb196700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec41553b0 con 0x7f6ec40c4130 2023-11-15T02:37:22.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.835+0000 7f6ecb196700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec40c4aa0 con 0x7f6ec40b0880 2023-11-15T02:37:22.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.835+0000 7f6ecb196700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec414c9e0 con 0x7f6eb0003910 2023-11-15T02:37:22.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.835+0000 7f6ec9733700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ec40c4130 0x7f6ec40c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:22.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.835+0000 7f6ec9733700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ec40c4130 0x7f6ec40c45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43428/0 (socket says 172.21.15.1:43428) 2023-11-15T02:37:22.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.835+0000 7f6ec9733700 1 -- 172.21.15.1:0/4175851147 learned_addr learned my addr 172.21.15.1:0/4175851147 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:22.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.835+0000 7f6ec8f32700 1 --2- 172.21.15.1:0/4175851147 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb0003910 0x7f6ec40caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:22.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.835+0000 7f6ec3fff700 1 --2- 172.21.15.1:0/4175851147 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec40b0880 0x7f6ec414c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:22.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.836+0000 7f6ec9733700 1 -- 172.21.15.1:0/4175851147 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb0003910 msgr2=0x7f6ec40caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:22.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.836+0000 7f6ec9733700 1 --2- 172.21.15.1:0/4175851147 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb0003910 0x7f6ec40caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:22.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.836+0000 7f6ec9733700 1 -- 172.21.15.1:0/4175851147 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec40b0880 msgr2=0x7f6ec414c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:22.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.836+0000 7f6ec9733700 1 --2- 172.21.15.1:0/4175851147 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec40b0880 0x7f6ec414c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:22.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.836+0000 7f6ec9733700 1 -- 172.21.15.1:0/4175851147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec40b0d10 con 0x7f6ec40c4130 2023-11-15T02:37:22.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.836+0000 7f6ec9733700 1 --2- 172.21.15.1:0/4175851147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ec40c4130 0x7f6ec40c45b0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7f6ec40c8b70 tx=0x7f6eac009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.836+0000 7f6ec0ff9700 1 -- 172.21.15.1:0/4175851147 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00ec60 con 0x7f6ec40c4130 2023-11-15T02:37:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.836+0000 7f6ec0ff9700 1 -- 172.21.15.1:0/4175851147 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac00edc0 con 0x7f6ec40c4130 2023-11-15T02:37:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.836+0000 7f6ecb196700 1 -- 172.21.15.1:0/4175851147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec40b0ff0 con 0x7f6ec40c4130 2023-11-15T02:37:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.836+0000 7f6ec0ff9700 1 -- 172.21.15.1:0/4175851147 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac014680 con 0x7f6ec40c4130 2023-11-15T02:37:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.836+0000 7f6ecb196700 1 -- 172.21.15.1:0/4175851147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec4156c60 con 0x7f6ec40c4130 2023-11-15T02:37:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.837+0000 7f6ecb196700 1 -- 172.21.15.1:0/4175851147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec41567e0 con 0x7f6ec40c4130 2023-11-15T02:37:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.837+0000 7f6ec0ff9700 1 -- 172.21.15.1:0/4175851147 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6eac014a30 con 0x7f6ec40c4130 2023-11-15T02:37:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.838+0000 7f6ec0ff9700 1 --2- 172.21.15.1:0/4175851147 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ea405f270 0x7f6ea4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.838+0000 7f6ec0ff9700 1 -- 172.21.15.1:0/4175851147 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f6eac079b30 con 0x7f6ec40c4130 2023-11-15T02:37:22.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.838+0000 7f6ec8f32700 1 --2- 172.21.15.1:0/4175851147 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ea405f270 0x7f6ea4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:22.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.838+0000 7f6ec8f32700 1 --2- 172.21.15.1:0/4175851147 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ea405f270 0x7f6ea4061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6ebc006d50 tx=0x7f6ebc01a000).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:22.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:22.842+0000 7f6ec0ff9700 1 -- 172.21.15.1:0/4175851147 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6eac049af0 con 0x7f6ec40c4130 2023-11-15T02:37:23.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.043+0000 7f6ecb196700 1 -- 172.21.15.1:0/4175851147 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ec41589a0 con 0x7f6ea405f270 2023-11-15T02:37:23.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.045+0000 7f6ec0ff9700 1 -- 172.21.15.1:0/4175851147 <== mgr.8110 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f6ec41589a0 con 0x7f6ea405f270 2023-11-15T02:37:23.046 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T02:37:23.047 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:37:23.047 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephfs" 2023-11-15T02:37:23.047 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:37:23.047 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T02:37:23.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.046+0000 7f6ecb196700 1 -- 172.21.15.1:0/4175851147 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ea405f270 msgr2=0x7f6ea4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:23.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.046+0000 7f6ecb196700 1 --2- 172.21.15.1:0/4175851147 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ea405f270 0x7f6ea4061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6ebc006d50 tx=0x7f6ebc01a000).stop 2023-11-15T02:37:23.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.046+0000 7f6ecb196700 1 -- 172.21.15.1:0/4175851147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ec40c4130 msgr2=0x7f6ec40c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:23.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.046+0000 7f6ecb196700 1 --2- 172.21.15.1:0/4175851147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ec40c4130 0x7f6ec40c45b0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7f6ec40c8b70 tx=0x7f6eac009040).stop 2023-11-15T02:37:23.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.046+0000 7f6ecb196700 1 -- 172.21.15.1:0/4175851147 shutdown_connections 2023-11-15T02:37:23.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.046+0000 7f6ecb196700 1 --2- 172.21.15.1:0/4175851147 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f6ea405f270 0x7f6ea4061730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.046+0000 7f6ecb196700 1 --2- 172.21.15.1:0/4175851147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ec40c4130 0x7f6ec40c45b0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.046+0000 7f6ecb196700 1 --2- 172.21.15.1:0/4175851147 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb0003910 0x7f6ec40caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.046+0000 7f6ecb196700 1 --2- 172.21.15.1:0/4175851147 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec40b0880 0x7f6ec414c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.046+0000 7f6ecb196700 1 -- 172.21.15.1:0/4175851147 >> 172.21.15.1:0/4175851147 conn(0x7f6ec40c7b20 msgr2=0x7f6ec414e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:23.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.047+0000 7f6ecb196700 1 -- 172.21.15.1:0/4175851147 shutdown_connections 2023-11-15T02:37:23.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.047+0000 7f6ecb196700 1 -- 172.21.15.1:0/4175851147 wait complete. 2023-11-15T02:37:23.060 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-15T02:37:23.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.179+0000 7ff35359e700 1 Processor -- start 2023-11-15T02:37:23.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.179+0000 7ff35359e700 1 -- start start 2023-11-15T02:37:23.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.180+0000 7ff35359e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3540c8170 0x7ff35415f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:23.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.180+0000 7ff35359e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff354155830 con 0x7ff3541545b0 2023-11-15T02:37:23.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.180+0000 7ff35359e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff354154c20 con 0x7ff3541541d0 2023-11-15T02:37:23.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.180+0000 7ff35359e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff354158f40 con 0x7ff3540c8170 2023-11-15T02:37:23.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.180+0000 7ff351d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff3541545b0 0x7ff3540c7a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44830/0 (socket says 172.21.15.1:44830) 2023-11-15T02:37:23.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.180+0000 7ff351d9b700 1 -- 172.21.15.1:0/2412496112 learned_addr learned my addr 172.21.15.1:0/2412496112 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:23.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.181+0000 7ff352d9d700 1 --2- 172.21.15.1:0/2412496112 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3540c8170 0x7ff35415f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:23.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.181+0000 7ff35159a700 1 -- 172.21.15.1:0/2412496112 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108725891 0 0) 0x7ff354155830 con 0x7ff3541545b0 2023-11-15T02:37:23.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.181+0000 7ff35159a700 1 -- 172.21.15.1:0/2412496112 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3400033f0 con 0x7ff3541545b0 2023-11-15T02:37:23.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.181+0000 7ff35159a700 1 -- 172.21.15.1:0/2412496112 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922321389 0 0) 0x7ff354154c20 con 0x7ff3541541d0 2023-11-15T02:37:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.181+0000 7ff35159a700 1 -- 172.21.15.1:0/2412496112 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff354155830 con 0x7ff3541541d0 2023-11-15T02:37:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.181+0000 7ff35159a700 1 -- 172.21.15.1:0/2412496112 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3952708046 0 0) 0x7ff3400033f0 con 0x7ff3541545b0 2023-11-15T02:37:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.181+0000 7ff352d9d700 1 -- 172.21.15.1:0/2412496112 >> v1:172.21.15.141:6789/0 conn(0x7ff3541541d0 legacy=0x7ff3540c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.181+0000 7ff352d9d700 1 -- 172.21.15.1:0/2412496112 >> v1:172.21.15.1:6789/0 conn(0x7ff3541545b0 legacy=0x7ff3540c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.181+0000 7ff352d9d700 1 -- 172.21.15.1:0/2412496112 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff354154f00 con 0x7ff3540c8170 2023-11-15T02:37:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.181+0000 7ff352d9d700 1 --2- 172.21.15.1:0/2412496112 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3540c8170 0x7ff35415f2d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff34c009790 tx=0x7ff34c009060).ready entity=mon.2 client_cookie=d33f9c231d4c744b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.181+0000 7ff35159a700 1 -- 172.21.15.1:0/2412496112 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c001490 con 0x7ff3540c8170 2023-11-15T02:37:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.181+0000 7ff35159a700 1 -- 172.21.15.1:0/2412496112 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c011400 con 0x7ff3540c8170 2023-11-15T02:37:23.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.181+0000 7ff35159a700 1 -- 172.21.15.1:0/2412496112 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c011780 con 0x7ff3540c8170 2023-11-15T02:37:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.182+0000 7ff35359e700 1 -- 172.21.15.1:0/2412496112 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3540c8170 msgr2=0x7ff35415f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.182+0000 7ff35359e700 1 --2- 172.21.15.1:0/2412496112 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3540c8170 0x7ff35415f2d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff34c009790 tx=0x7ff34c009060).stop 2023-11-15T02:37:23.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.182+0000 7ff35359e700 1 -- 172.21.15.1:0/2412496112 shutdown_connections 2023-11-15T02:37:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.182+0000 7ff35359e700 1 --2- 172.21.15.1:0/2412496112 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3540c8170 0x7ff35415f2d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.182+0000 7ff35359e700 1 -- 172.21.15.1:0/2412496112 >> 172.21.15.1:0/2412496112 conn(0x7ff354069ee0 msgr2=0x7ff35406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.182+0000 7ff35359e700 1 -- 172.21.15.1:0/2412496112 shutdown_connections 2023-11-15T02:37:23.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.182+0000 7ff35359e700 1 -- 172.21.15.1:0/2412496112 wait complete. 2023-11-15T02:37:23.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.183+0000 7ff35359e700 1 Processor -- start 2023-11-15T02:37:23.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.183+0000 7ff35359e700 1 -- start start 2023-11-15T02:37:23.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff35359e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff3540c8170 0x7ff3540ab830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:23.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff35359e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3541541d0 0x7ff3540ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:23.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff35359e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3541545b0 0x7ff3540afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:23.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff35359e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3540c3570 con 0x7ff3541541d0 2023-11-15T02:37:23.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff35359e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3540af700 con 0x7ff3540c8170 2023-11-15T02:37:23.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff35359e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3540af0f0 con 0x7ff3541545b0 2023-11-15T02:37:23.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff351d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3541541d0 0x7ff3540ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:23.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff351d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3541541d0 0x7ff3540ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43442/0 (socket says 172.21.15.1:43442) 2023-11-15T02:37:23.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff351d9b700 1 -- 172.21.15.1:0/909567682 learned_addr learned my addr 172.21.15.1:0/909567682 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:23.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff35259c700 1 --2- 172.21.15.1:0/909567682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff3540c8170 0x7ff3540ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:23.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff352d9d700 1 --2- 172.21.15.1:0/909567682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3541545b0 0x7ff3540afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:23.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff351d9b700 1 -- 172.21.15.1:0/909567682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3541545b0 msgr2=0x7ff3540afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:23.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff351d9b700 1 --2- 172.21.15.1:0/909567682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3541545b0 0x7ff3540afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff351d9b700 1 -- 172.21.15.1:0/909567682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff3540c8170 msgr2=0x7ff3540ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:23.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff351d9b700 1 --2- 172.21.15.1:0/909567682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff3540c8170 0x7ff3540ab830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff351d9b700 1 -- 172.21.15.1:0/909567682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c0092a0 con 0x7ff3541541d0 2023-11-15T02:37:23.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff351d9b700 1 --2- 172.21.15.1:0/909567682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3541541d0 0x7ff3540ad590 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7ff33c00c7e0 tx=0x7ff33c001a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:23.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff34a7fc700 1 -- 172.21.15.1:0/909567682 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c007170 con 0x7ff3541541d0 2023-11-15T02:37:23.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.184+0000 7ff34a7fc700 1 -- 172.21.15.1:0/909567682 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c0072f0 con 0x7ff3541541d0 2023-11-15T02:37:23.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.185+0000 7ff35359e700 1 -- 172.21.15.1:0/909567682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35414b250 con 0x7ff3541541d0 2023-11-15T02:37:23.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.185+0000 7ff34a7fc700 1 -- 172.21.15.1:0/909567682 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0048c0 con 0x7ff3541541d0 2023-11-15T02:37:23.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.185+0000 7ff35359e700 1 -- 172.21.15.1:0/909567682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3540c3290 con 0x7ff3541541d0 2023-11-15T02:37:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.185+0000 7ff35359e700 1 -- 172.21.15.1:0/909567682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3540af890 con 0x7ff3541541d0 2023-11-15T02:37:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.186+0000 7ff34a7fc700 1 -- 172.21.15.1:0/909567682 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff33c004c70 con 0x7ff3541541d0 2023-11-15T02:37:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.186+0000 7ff34a7fc700 1 --2- 172.21.15.1:0/909567682 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff33405f240 0x7ff334061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.186+0000 7ff34a7fc700 1 -- 172.21.15.1:0/909567682 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7ff33c079f60 con 0x7ff3541541d0 2023-11-15T02:37:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.187+0000 7ff35259c700 1 --2- 172.21.15.1:0/909567682 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff33405f240 0x7ff334061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:23.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.187+0000 7ff35259c700 1 --2- 172.21.15.1:0/909567682 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff33405f240 0x7ff334061700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff344003fc0 tx=0x7ff344007f50).ready entity=mgr.8110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:23.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.191+0000 7ff34a7fc700 1 -- 172.21.15.1:0/909567682 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff33c04ae60 con 0x7ff3541541d0 2023-11-15T02:37:23.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.409+0000 7ff35359e700 1 -- 172.21.15.1:0/909567682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7ff3540475e0 con 0x7ff3541541d0 2023-11-15T02:37:23.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.619+0000 7ff34a7fc700 1 -- 172.21.15.1:0/909567682 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 75) v1 ==== 75565+0+0 (secure 0 0 0) 0x7ff33c0779c0 con 0x7ff3541541d0 2023-11-15T02:37:23.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.620+0000 7ff34a7fc700 1 -- 172.21.15.1:0/909567682 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v75) v1 ==== 92+0+0 (secure 0 0 0) 0x7ff33c072cc0 con 0x7ff3541541d0 2023-11-15T02:37:23.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.622+0000 7ff35359e700 1 -- 172.21.15.1:0/909567682 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff33405f240 msgr2=0x7ff334061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:23.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.622+0000 7ff35359e700 1 --2- 172.21.15.1:0/909567682 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff33405f240 0x7ff334061700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff344003fc0 tx=0x7ff344007f50).stop 2023-11-15T02:37:23.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.622+0000 7ff35359e700 1 -- 172.21.15.1:0/909567682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3541541d0 msgr2=0x7ff3540ad590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:23.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.622+0000 7ff35359e700 1 --2- 172.21.15.1:0/909567682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3541541d0 0x7ff3540ad590 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7ff33c00c7e0 tx=0x7ff33c001a50).stop 2023-11-15T02:37:23.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.622+0000 7ff35359e700 1 -- 172.21.15.1:0/909567682 shutdown_connections 2023-11-15T02:37:23.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.622+0000 7ff35359e700 1 --2- 172.21.15.1:0/909567682 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7ff33405f240 0x7ff334061700 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.622+0000 7ff35359e700 1 --2- 172.21.15.1:0/909567682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff3541545b0 0x7ff3540afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.622+0000 7ff35359e700 1 --2- 172.21.15.1:0/909567682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff3540c8170 0x7ff3540ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.622+0000 7ff35359e700 1 --2- 172.21.15.1:0/909567682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3541541d0 0x7ff3540ad590 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.622+0000 7ff35359e700 1 -- 172.21.15.1:0/909567682 >> 172.21.15.1:0/909567682 conn(0x7ff354069ee0 msgr2=0x7ff3540c12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:23.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.622+0000 7ff35359e700 1 -- 172.21.15.1:0/909567682 shutdown_connections 2023-11-15T02:37:23.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.622+0000 7ff35359e700 1 -- 172.21.15.1:0/909567682 wait complete. 2023-11-15T02:37:23.637 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-15T02:37:23.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.760+0000 7fd5a6769700 1 Processor -- start 2023-11-15T02:37:23.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.760+0000 7fd5a6769700 1 -- start start 2023-11-15T02:37:23.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.761+0000 7fd5a6769700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd5a00c4300 0x7fd5a01520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:23.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.761+0000 7fd5a6769700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd5a0062ec0 0x7fd5a01553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:23.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.761+0000 7fd5a6769700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a0065670 con 0x7fd5a0151cc0 2023-11-15T02:37:23.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.761+0000 7fd5a6769700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a00a7560 con 0x7fd5a00c4300 2023-11-15T02:37:23.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.761+0000 7fd5a6769700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a01558b0 con 0x7fd5a0062ec0 2023-11-15T02:37:23.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.761+0000 7fd5a4f66700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd5a00c4300 0x7fd5a01520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:23.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.761+0000 7fd5a5767700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd5a0151cc0 0x7fd5a00627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44844/0 (socket says 172.21.15.1:44844) 2023-11-15T02:37:23.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.761+0000 7fd5a5767700 1 -- 172.21.15.1:0/109246120 learned_addr learned my addr 172.21.15.1:0/109246120 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:23.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.761+0000 7fd5a4f66700 1 --2- 172.21.15.1:0/109246120 >> v2:172.21.15.1:3300/0 conn(0x7fd5a00c4300 0x7fd5a01520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43464/0 (socket says 172.21.15.1:43464) 2023-11-15T02:37:23.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.761+0000 7fd5a5f68700 1 --2- 172.21.15.1:0/109246120 >> v2:172.21.15.141:3300/0 conn(0x7fd5a0062ec0 0x7fd5a01553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:23.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.762+0000 7fd5a4f66700 1 -- 172.21.15.1:0/109246120 >> v2:172.21.15.141:3300/0 conn(0x7fd5a0062ec0 msgr2=0x7fd5a01553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:23.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.762+0000 7fd5a4f66700 1 --2- 172.21.15.1:0/109246120 >> v2:172.21.15.141:3300/0 conn(0x7fd5a0062ec0 0x7fd5a01553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.762+0000 7fd597fff700 1 -- 172.21.15.1:0/109246120 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232589481 0 0) 0x7fd5a0065670 con 0x7fd5a0151cc0 2023-11-15T02:37:23.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.762+0000 7fd5a4f66700 1 -- 172.21.15.1:0/109246120 >> v1:172.21.15.1:6789/0 conn(0x7fd5a0151cc0 legacy=0x7fd5a00627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:23.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.762+0000 7fd5a4f66700 1 -- 172.21.15.1:0/109246120 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a00658c0 con 0x7fd5a00c4300 2023-11-15T02:37:23.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.762+0000 7fd5a4f66700 1 --2- 172.21.15.1:0/109246120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5a00c4300 0x7fd5a01520a0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7fd5a00a6c00 tx=0x7fd59c009060).ready entity=mon.0 client_cookie=ddfeb6af031fcfc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:23.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.762+0000 7fd597fff700 1 -- 172.21.15.1:0/109246120 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c00f510 con 0x7fd5a00c4300 2023-11-15T02:37:23.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.762+0000 7fd597fff700 1 -- 172.21.15.1:0/109246120 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c00f670 con 0x7fd5a00c4300 2023-11-15T02:37:23.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.762+0000 7fd597fff700 1 -- 172.21.15.1:0/109246120 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c00f9f0 con 0x7fd5a00c4300 2023-11-15T02:37:23.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.763+0000 7fd5a6769700 1 -- 172.21.15.1:0/109246120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5a00c4300 msgr2=0x7fd5a01520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:23.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.763+0000 7fd5a6769700 1 --2- 172.21.15.1:0/109246120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5a00c4300 0x7fd5a01520a0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7fd5a00a6c00 tx=0x7fd59c009060).stop 2023-11-15T02:37:23.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.763+0000 7fd5a6769700 1 -- 172.21.15.1:0/109246120 shutdown_connections 2023-11-15T02:37:23.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.763+0000 7fd5a6769700 1 --2- 172.21.15.1:0/109246120 >> v2:172.21.15.141:3300/0 conn(0x7fd5a0062ec0 0x7fd5a01553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.763+0000 7fd5a6769700 1 --2- 172.21.15.1:0/109246120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5a00c4300 0x7fd5a01520a0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.763+0000 7fd5a6769700 1 -- 172.21.15.1:0/109246120 >> 172.21.15.1:0/109246120 conn(0x7fd5a0064390 msgr2=0x7fd5a00c7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:23.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.763+0000 7fd5a6769700 1 -- 172.21.15.1:0/109246120 shutdown_connections 2023-11-15T02:37:23.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.763+0000 7fd5a6769700 1 -- 172.21.15.1:0/109246120 wait complete. 2023-11-15T02:37:23.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.764+0000 7fd5a6769700 1 Processor -- start 2023-11-15T02:37:23.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.764+0000 7fd5a6769700 1 -- start start 2023-11-15T02:37:23.774 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:23.763+0000 7fc668c8c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:37:23.774 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:23.764+0000 7eff1742c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:37:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a6769700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5a0062ec0 0x7fd5a013cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a6769700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5a00c4300 0x7fd5a0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a6769700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5a0151cc0 0x7fd5a0167800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a6769700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a0164320 con 0x7fd5a0151cc0 2023-11-15T02:37:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a6769700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a0168250 con 0x7fd5a0062ec0 2023-11-15T02:37:23.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a6769700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a0168530 con 0x7fd5a00c4300 2023-11-15T02:37:23.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a5f68700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5a0151cc0 0x7fd5a0167800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:23.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a5f68700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5a0151cc0 0x7fd5a0167800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43468/0 (socket says 172.21.15.1:43468) 2023-11-15T02:37:23.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a5f68700 1 -- 172.21.15.1:0/2907252424 learned_addr learned my addr 172.21.15.1:0/2907252424 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:23.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a5767700 1 --2- 172.21.15.1:0/2907252424 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5a0062ec0 0x7fd5a013cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:23.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a4f66700 1 --2- 172.21.15.1:0/2907252424 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5a00c4300 0x7fd5a0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:23.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a5f68700 1 -- 172.21.15.1:0/2907252424 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5a00c4300 msgr2=0x7fd5a0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:23.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a5f68700 1 --2- 172.21.15.1:0/2907252424 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5a00c4300 0x7fd5a0164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a5f68700 1 -- 172.21.15.1:0/2907252424 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5a0062ec0 msgr2=0x7fd5a013cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:23.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a5f68700 1 --2- 172.21.15.1:0/2907252424 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5a0062ec0 0x7fd5a013cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a5f68700 1 -- 172.21.15.1:0/2907252424 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c0092a0 con 0x7fd5a0151cc0 2023-11-15T02:37:23.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.765+0000 7fd5a5f68700 1 --2- 172.21.15.1:0/2907252424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5a0151cc0 0x7fd5a0167800 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7fd598009ef0 tx=0x7fd59800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:23.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.766+0000 7fd5957fa700 1 -- 172.21.15.1:0/2907252424 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59800cb70 con 0x7fd5a0151cc0 2023-11-15T02:37:23.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.766+0000 7fd5957fa700 1 -- 172.21.15.1:0/2907252424 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59800f040 con 0x7fd5a0151cc0 2023-11-15T02:37:23.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.766+0000 7fd5957fa700 1 -- 172.21.15.1:0/2907252424 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd598013400 con 0x7fd5a0151cc0 2023-11-15T02:37:23.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.766+0000 7fd5a6769700 1 -- 172.21.15.1:0/2907252424 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a0164570 con 0x7fd5a0151cc0 2023-11-15T02:37:23.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.766+0000 7fd5a6769700 1 -- 172.21.15.1:0/2907252424 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a014d760 con 0x7fd5a0151cc0 2023-11-15T02:37:23.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.767+0000 7fd5a6769700 1 -- 172.21.15.1:0/2907252424 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a0164a90 con 0x7fd5a0151cc0 2023-11-15T02:37:23.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.767+0000 7fd5957fa700 1 -- 172.21.15.1:0/2907252424 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 75) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fd5980137b0 con 0x7fd5a0151cc0 2023-11-15T02:37:23.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.767+0000 7fd5957fa700 1 --2- 172.21.15.1:0/2907252424 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd58405f2c0 0x7fd584061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:23.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.768+0000 7fd5957fa700 1 -- 172.21.15.1:0/2907252424 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7fd59807ae00 con 0x7fd5a0151cc0 2023-11-15T02:37:23.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.768+0000 7fd5a5767700 1 -- 172.21.15.1:0/2907252424 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd58405f2c0 msgr2=0x7fd584061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:37:23.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.768+0000 7fd5a5767700 1 --2- 172.21.15.1:0/2907252424 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd58405f2c0 0x7fd584061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:37:23.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.772+0000 7fd5957fa700 1 -- 172.21.15.1:0/2907252424 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd5a0164a90 con 0x7fd5a0151cc0 2023-11-15T02:37:23.829 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:23.827+0000 7fc668c8c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:37:23.834 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:23.833+0000 7eff1742c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:37:23.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.949+0000 7fd5a6769700 1 -- 172.21.15.1:0/2907252424 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fd5a0164a90 con 0x7fd5a0151cc0 2023-11-15T02:37:23.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.953+0000 7fd5957fa700 1 -- 172.21.15.1:0/2907252424 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd5a0164a90 con 0x7fd5a0151cc0 2023-11-15T02:37:23.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.955+0000 7fd5a6769700 1 -- 172.21.15.1:0/2907252424 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd58405f2c0 msgr2=0x7fd584061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:37:23.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.955+0000 7fd5a6769700 1 --2- 172.21.15.1:0/2907252424 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd58405f2c0 0x7fd584061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:37:23.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.955+0000 7fd5a6769700 1 -- 172.21.15.1:0/2907252424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5a0151cc0 msgr2=0x7fd5a0167800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:23.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.955+0000 7fd5a6769700 1 --2- 172.21.15.1:0/2907252424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5a0151cc0 0x7fd5a0167800 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7fd598009ef0 tx=0x7fd59800b040).stop 2023-11-15T02:37:23.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.955+0000 7fd5a6769700 1 -- 172.21.15.1:0/2907252424 shutdown_connections 2023-11-15T02:37:23.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.955+0000 7fd5a6769700 1 --2- 172.21.15.1:0/2907252424 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fd58405f2c0 0x7fd584061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:37:23.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.955+0000 7fd5a6769700 1 --2- 172.21.15.1:0/2907252424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5a0151cc0 0x7fd5a0167800 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.955+0000 7fd5a6769700 1 --2- 172.21.15.1:0/2907252424 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5a0062ec0 0x7fd5a013cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.955+0000 7fd5a6769700 1 --2- 172.21.15.1:0/2907252424 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5a00c4300 0x7fd5a0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:23.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.955+0000 7fd5a6769700 1 -- 172.21.15.1:0/2907252424 >> 172.21.15.1:0/2907252424 conn(0x7fd5a0064390 msgr2=0x7fd5a00bcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:23.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.955+0000 7fd5a6769700 1 -- 172.21.15.1:0/2907252424 shutdown_connections 2023-11-15T02:37:23.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:23.955+0000 7fd5a6769700 1 -- 172.21.15.1:0/2907252424 wait complete. 2023-11-15T02:37:23.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:37:23.970 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-15T02:37:23.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:37:23.992 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-11-15T02:37:24.048 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-11-15T02:37:24.103 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:24.101+0000 7fc668c8c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:37:24.127 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:24.125+0000 7eff1742c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:37:24.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.212+0000 7f14656eb700 1 Processor -- start 2023-11-15T02:37:24.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.212+0000 7f14656eb700 1 -- start start 2023-11-15T02:37:24.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.213+0000 7f14656eb700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1460158c70 0x7f14600c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:24.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.213+0000 7f14656eb700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14601580d0 con 0x7f146014b350 2023-11-15T02:37:24.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.213+0000 7f14656eb700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1460155000 con 0x7f14600aa750 2023-11-15T02:37:24.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.213+0000 7f14656eb700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14601552e0 con 0x7f1460158c70 2023-11-15T02:37:24.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.213+0000 7f145effd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f146014b350 0x7f14600aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44856/0 (socket says 172.21.15.1:44856) 2023-11-15T02:37:24.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.213+0000 7f145effd700 1 -- 172.21.15.1:0/2531831499 learned_addr learned my addr 172.21.15.1:0/2531831499 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:24.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.213+0000 7f145f7fe700 1 --2- 172.21.15.1:0/2531831499 >> v2:172.21.15.141:3300/0 conn(0x7f1460158c70 0x7f14600c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:24.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.213+0000 7f145dffb700 1 -- 172.21.15.1:0/2531831499 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285832455 0 0) 0x7f14601580d0 con 0x7f146014b350 2023-11-15T02:37:24.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.214+0000 7f145dffb700 1 -- 172.21.15.1:0/2531831499 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14480033f0 con 0x7f146014b350 2023-11-15T02:37:24.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.214+0000 7f145f7fe700 1 -- 172.21.15.1:0/2531831499 >> v1:172.21.15.141:6789/0 conn(0x7f14600aa750 legacy=0x7f1460158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:24.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.214+0000 7f145dffb700 1 -- 172.21.15.1:0/2531831499 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2396491143 0 0) 0x7f14480033f0 con 0x7f146014b350 2023-11-15T02:37:24.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.214+0000 7f145f7fe700 1 -- 172.21.15.1:0/2531831499 >> v1:172.21.15.1:6789/0 conn(0x7f146014b350 legacy=0x7f14600aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:24.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.214+0000 7f145f7fe700 1 -- 172.21.15.1:0/2531831499 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14601555c0 con 0x7f1460158c70 2023-11-15T02:37:24.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.214+0000 7f145f7fe700 1 --2- 172.21.15.1:0/2531831499 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1460158c70 0x7f14600c8290 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f1458009e60 tx=0x7f1458009780).ready entity=mon.1 client_cookie=579631a82cd4f4a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:24.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.214+0000 7f145dffb700 1 -- 172.21.15.1:0/2531831499 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145800e070 con 0x7f1460158c70 2023-11-15T02:37:24.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.214+0000 7f145dffb700 1 -- 172.21.15.1:0/2531831499 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145800b850 con 0x7f1460158c70 2023-11-15T02:37:24.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.214+0000 7f145dffb700 1 -- 172.21.15.1:0/2531831499 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1454001470 con 0x7f1460158c70 2023-11-15T02:37:24.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.215+0000 7f14656eb700 1 -- 172.21.15.1:0/2531831499 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1460158c70 msgr2=0x7f14600c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:24.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.215+0000 7f14656eb700 1 --2- 172.21.15.1:0/2531831499 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1460158c70 0x7f14600c8290 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f1458009e60 tx=0x7f1458009780).stop 2023-11-15T02:37:24.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.215+0000 7f14656eb700 1 -- 172.21.15.1:0/2531831499 shutdown_connections 2023-11-15T02:37:24.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.215+0000 7f14656eb700 1 --2- 172.21.15.1:0/2531831499 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1460158c70 0x7f14600c8290 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:24.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.215+0000 7f14656eb700 1 -- 172.21.15.1:0/2531831499 >> 172.21.15.1:0/2531831499 conn(0x7f1460069ee0 msgr2=0x7f146006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:24.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.215+0000 7f14656eb700 1 -- 172.21.15.1:0/2531831499 shutdown_connections 2023-11-15T02:37:24.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.215+0000 7f14656eb700 1 -- 172.21.15.1:0/2531831499 wait complete. 2023-11-15T02:37:24.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.216+0000 7f14656eb700 1 Processor -- start 2023-11-15T02:37:24.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.216+0000 7f14656eb700 1 -- start start 2023-11-15T02:37:24.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f14656eb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14600aa750 0x7f146014a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:24.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f14656eb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f146014b350 0x7f14600af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:24.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f14656eb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1460158c70 0x7f14600af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:24.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f14656eb700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14600afbb0 con 0x7f146014b350 2023-11-15T02:37:24.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f14656eb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146014b730 con 0x7f1460158c70 2023-11-15T02:37:24.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f14656eb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146014c2b0 con 0x7f14600aa750 2023-11-15T02:37:24.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f145e7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f146014b350 0x7f14600af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:24.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f145e7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f146014b350 0x7f14600af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43484/0 (socket says 172.21.15.1:43484) 2023-11-15T02:37:24.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f145e7fc700 1 -- 172.21.15.1:0/502018128 learned_addr learned my addr 172.21.15.1:0/502018128 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:24.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f145effd700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14600aa750 0x7f146014a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:24.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f145f7fe700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1460158c70 0x7f14600af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:24.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f145e7fc700 1 -- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14600aa750 msgr2=0x7f146014a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:24.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f145e7fc700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14600aa750 0x7f146014a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:24.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f145e7fc700 1 -- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1460158c70 msgr2=0x7f14600af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:24.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f145e7fc700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1460158c70 0x7f14600af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:24.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.217+0000 7f145e7fc700 1 -- 172.21.15.1:0/502018128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1458009a20 con 0x7f146014b350 2023-11-15T02:37:24.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.218+0000 7f145e7fc700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f146014b350 0x7f14600af1d0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f145000c4f0 tx=0x7f1450007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:24.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.218+0000 7f1446ffd700 1 -- 172.21.15.1:0/502018128 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145000ce00 con 0x7f146014b350 2023-11-15T02:37:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.218+0000 7f1446ffd700 1 -- 172.21.15.1:0/502018128 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1450007020 con 0x7f146014b350 2023-11-15T02:37:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.218+0000 7f14656eb700 1 -- 172.21.15.1:0/502018128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146014b980 con 0x7f146014b350 2023-11-15T02:37:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.218+0000 7f1446ffd700 1 -- 172.21.15.1:0/502018128 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14500073c0 con 0x7f146014b350 2023-11-15T02:37:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.218+0000 7f14656eb700 1 -- 172.21.15.1:0/502018128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146014bf40 con 0x7f146014b350 2023-11-15T02:37:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.219+0000 7f14656eb700 1 -- 172.21.15.1:0/502018128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146006c7e0 con 0x7f146014b350 2023-11-15T02:37:24.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.219+0000 7f1446ffd700 1 -- 172.21.15.1:0/502018128 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 75) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f14500068b0 con 0x7f146014b350 2023-11-15T02:37:24.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.220+0000 7f1446ffd700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 0x7f144c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:24.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.220+0000 7f145effd700 1 -- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 msgr2=0x7f144c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:37:24.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.220+0000 7f1446ffd700 1 -- 172.21.15.1:0/502018128 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6617+0+0 (secure 0 0 0) 0x7f1450079920 con 0x7f146014b350 2023-11-15T02:37:24.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.220+0000 7f145effd700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 0x7f144c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:37:24.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.224+0000 7f1446ffd700 1 -- 172.21.15.1:0/502018128 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1450047af0 con 0x7f146014b350 2023-11-15T02:37:24.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.421+0000 7f145effd700 1 -- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 msgr2=0x7f144c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:37:24.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.421+0000 7f145effd700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 0x7f144c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:37:24.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.424+0000 7f14656eb700 1 -- 172.21.15.1:0/502018128 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f146014c3f0 con 0x7f144c05f2c0 2023-11-15T02:37:24.716 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:24.714+0000 7fc668c8c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:37:24.788 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:24.786+0000 7fc668c8c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:37:24.802 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:24.801+0000 7eff1742c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:37:24.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.822+0000 7f145effd700 1 -- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 msgr2=0x7f144c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:37:24.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:24.822+0000 7f145effd700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 0x7f144c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-15T02:37:24.871 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:24.870+0000 7eff1742c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:37:24.974 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:24.972+0000 7fc668c8c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:37:25.065 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:25.065+0000 7eff1742c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:37:25.393 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:25.391+0000 7fc668c8c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:37:25.495 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:25.493+0000 7fc668c8c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:37:25.506 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:25.505+0000 7eff1742c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:37:25.614 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:25.613+0000 7eff1742c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:37:25.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:25.623+0000 7f145effd700 1 -- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 msgr2=0x7f144c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:37:25.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:25.623+0000 7f145effd700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 0x7f144c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-15T02:37:25.648 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:25.646+0000 7fc668c8c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:37:25.722 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:25.720+0000 7fc668c8c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:37:25.773 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:25.773+0000 7eff1742c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:37:25.789 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:25.787+0000 7fc668c8c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:37:25.852 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:25.852+0000 7eff1742c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:37:25.923 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:25.922+0000 7eff1742c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:37:26.048 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:26.045+0000 7fc668c8c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:37:26.197 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:26.196+0000 7eff1742c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:37:26.235 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:26.233+0000 7fc668c8c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:37:26.391 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:26.390+0000 7eff1742c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:37:26.882 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:26.880+0000 7fc668c8c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:37:26.951 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:26.949+0000 7fc668c8c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:37:27.026 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.024+0000 7fc668c8c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:37:27.079 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:27.079+0000 7eff1742c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:37:27.153 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:27.153+0000 7eff1742c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:37:27.173 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.172+0000 7fc668c8c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:37:27.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:27.225+0000 7f145effd700 1 -- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 msgr2=0x7f144c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/90546 2023-11-15T02:37:27.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:27.225+0000 7f145effd700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 0x7f144c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-15T02:37:27.232 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:27.232+0000 7eff1742c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:37:27.244 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.242+0000 7fc668c8c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:37:27.359 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.357+0000 7fc668c8c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:37:27.386 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:27.386+0000 7eff1742c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:37:27.460 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:27.460+0000 7eff1742c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:37:27.467 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.465+0000 7fc668c8c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:37:27.584 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:27.583+0000 7eff1742c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:37:27.698 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:27.697+0000 7eff1742c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:37:27.759 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.757+0000 7fc668c8c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:37:27.830 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.828+0000 7fc668c8c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:37:27.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:27.851+0000 7f1446ffd700 1 -- 172.21.15.1:0/502018128 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 76) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f145007bd50 con 0x7f146014b350 2023-11-15T02:37:27.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:27.852+0000 7f1446ffd700 1 -- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 msgr2=0x7f144c061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:37:27.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:27.852+0000 7f1446ffd700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 0x7f144c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:37:27.916 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.914+0000 7fc5e0417700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:37:27.917 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.914+0000 7fc5e0417700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:37:27.917 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.914+0000 7fc5e0417700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:37:27.917 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.914+0000 7fc5e0417700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:37:27.917 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.914+0000 7fc5e0417700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:37:27.917 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.914+0000 7fc5dcc10700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:37:27.918 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.914+0000 7fc5dcc10700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:37:27.918 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.914+0000 7fc5dcc10700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:37:27.918 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.914+0000 7fc5dcc10700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:37:27.918 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:37:27.914+0000 7fc5dcc10700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:37:28.004 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:28.004+0000 7eff1742c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:37:28.079 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:37:28.078+0000 7eff1742c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:37:28.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.853+0000 7f1446ffd700 1 -- 172.21.15.1:0/502018128 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 77) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f1450077700 con 0x7f146014b350 2023-11-15T02:37:28.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.854+0000 7f1446ffd700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 0x7f144c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:28.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.854+0000 7f1446ffd700 1 -- 172.21.15.1:0/502018128 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f146014c3f0 con 0x7f144c05f2c0 2023-11-15T02:37:28.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.855+0000 7f145effd700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 0x7f144c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:28.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.857+0000 7f145effd700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 0x7f144c061700 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f14540011e0 tx=0x7f1454000bc0).ready entity=mgr.8443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:28.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.872+0000 7f1446ffd700 1 -- 172.21.15.1:0/502018128 <== mgr.8443 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f146014c3f0 con 0x7f144c05f2c0 2023-11-15T02:37:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-11-15T02:37:28.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.874+0000 7f14656eb700 1 -- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 msgr2=0x7f144c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:28.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.874+0000 7f14656eb700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 0x7f144c061700 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f14540011e0 tx=0x7f1454000bc0).stop 2023-11-15T02:37:28.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.874+0000 7f14656eb700 1 -- 172.21.15.1:0/502018128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f146014b350 msgr2=0x7f14600af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:28.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.874+0000 7f14656eb700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f146014b350 0x7f14600af1d0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f145000c4f0 tx=0x7f1450007dd0).stop 2023-11-15T02:37:28.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.874+0000 7f14656eb700 1 -- 172.21.15.1:0/502018128 shutdown_connections 2023-11-15T02:37:28.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.874+0000 7f14656eb700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f144c05f2c0 0x7f144c061700 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:28.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.874+0000 7f14656eb700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1460158c70 0x7f14600af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:28.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.874+0000 7f14656eb700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14600aa750 0x7f146014a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:28.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.874+0000 7f14656eb700 1 --2- 172.21.15.1:0/502018128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f146014b350 0x7f14600af1d0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:28.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.874+0000 7f14656eb700 1 -- 172.21.15.1:0/502018128 >> 172.21.15.1:0/502018128 conn(0x7f1460069ee0 msgr2=0x7f1460063b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:28.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.874+0000 7f14656eb700 1 -- 172.21.15.1:0/502018128 shutdown_connections 2023-11-15T02:37:28.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:28.874+0000 7f14656eb700 1 -- 172.21.15.1:0/502018128 wait complete. 2023-11-15T02:37:28.889 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-11-15T02:37:28.889 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-11-15T02:37:29.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.057+0000 7f3f3eed5700 1 Processor -- start 2023-11-15T02:37:29.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.057+0000 7f3f3eed5700 1 -- start start 2023-11-15T02:37:29.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.058+0000 7f3f3eed5700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3f380c60c0 0x7f3f380c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:29.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.058+0000 7f3f3eed5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f380aba40 0x7f3f380abed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:29.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.058+0000 7f3f3eed5700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f380caee0 con 0x7f3f380ada30 2023-11-15T02:37:29.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.058+0000 7f3f3eed5700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f38154850 con 0x7f3f380c60c0 2023-11-15T02:37:29.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.058+0000 7f3f3eed5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380ca920 con 0x7f3f380aba40 2023-11-15T02:37:29.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.058+0000 7f3f3ded3700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3f380ada30 0x7f3f380c9f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51352/0 (socket says 172.21.15.1:51352) 2023-11-15T02:37:29.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.058+0000 7f3f3ded3700 1 -- 172.21.15.1:0/4258798523 learned_addr learned my addr 172.21.15.1:0/4258798523 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:37:29.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.058+0000 7f3f3ced1700 1 -- 172.21.15.1:0/4258798523 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405178006 0 0) 0x7f3f380caee0 con 0x7f3f380ada30 2023-11-15T02:37:29.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.058+0000 7f3f3d6d2700 1 --2- 172.21.15.1:0/4258798523 >> v2:172.21.15.141:3300/0 conn(0x7f3f380c60c0 0x7f3f380c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:29.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.058+0000 7f3f3ced1700 1 -- 172.21.15.1:0/4258798523 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f240033f0 con 0x7f3f380ada30 2023-11-15T02:37:29.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.058+0000 7f3f3e6d4700 1 --2- 172.21.15.1:0/4258798523 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f380aba40 0x7f3f380abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:29.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 -- 172.21.15.1:0/4258798523 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4036698989 0 0) 0x7f3f240033f0 con 0x7f3f380ada30 2023-11-15T02:37:29.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 -- 172.21.15.1:0/4258798523 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f380aba40 msgr2=0x7f3f380abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:29.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 --2- 172.21.15.1:0/4258798523 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f380aba40 0x7f3f380abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:29.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 -- 172.21.15.1:0/4258798523 >> v2:172.21.15.141:3300/0 conn(0x7f3f380c60c0 msgr2=0x7f3f380c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:29.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 --2- 172.21.15.1:0/4258798523 >> v2:172.21.15.141:3300/0 conn(0x7f3f380c60c0 0x7f3f380c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:29.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 -- 172.21.15.1:0/4258798523 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f380cac00 con 0x7f3f380ada30 2023-11-15T02:37:29.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 -- 172.21.15.1:0/4258798523 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f3f34001470 con 0x7f3f380ada30 2023-11-15T02:37:29.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 -- 172.21.15.1:0/4258798523 >> v1:172.21.15.1:6789/0 conn(0x7f3f380ada30 legacy=0x7f3f380c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:29.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 --2- 172.21.15.1:0/4258798523 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f380aba40 0x7f3f240038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:29.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 --2- 172.21.15.1:0/4258798523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f24003e10 0x7f3f24004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:29.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 --2- 172.21.15.1:0/4258798523 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f24004b80 0x7f3f24005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:29.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 -- 172.21.15.1:0/4258798523 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f38154850 con 0x7f3f24003e10 2023-11-15T02:37:29.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 -- 172.21.15.1:0/4258798523 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380ca920 con 0x7f3f24004b80 2023-11-15T02:37:29.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 -- 172.21.15.1:0/4258798523 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2400b8e0 con 0x7f3f380aba40 2023-11-15T02:37:29.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3d6d2700 1 --2- 172.21.15.1:0/4258798523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f24003e10 0x7f3f24004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:29.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3e6d4700 1 --2- 172.21.15.1:0/4258798523 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f24004b80 0x7f3f24005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:29.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ded3700 1 --2- 172.21.15.1:0/4258798523 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f380aba40 0x7f3f240038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:29.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3d6d2700 1 -- 172.21.15.1:0/4258798523 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f380aba40 msgr2=0x7f3f240038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:29.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3d6d2700 1 --2- 172.21.15.1:0/4258798523 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f380aba40 0x7f3f240038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:29.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3d6d2700 1 -- 172.21.15.1:0/4258798523 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f24004b80 msgr2=0x7f3f24005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:37:29.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3d6d2700 1 --2- 172.21.15.1:0/4258798523 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f24004b80 0x7f3f24005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:29.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3d6d2700 1 -- 172.21.15.1:0/4258798523 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f240033f0 con 0x7f3f24003e10 2023-11-15T02:37:29.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3d6d2700 1 --2- 172.21.15.1:0/4258798523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f24003e10 0x7f3f24004690 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f3f28009ab0 tx=0x7f3f28009060).ready entity=mon.0 client_cookie=aaab2e9d6e58ce48 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:29.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 -- 172.21.15.1:0/4258798523 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28009430 con 0x7f3f24003e10 2023-11-15T02:37:29.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 -- 172.21.15.1:0/4258798523 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2800e640 con 0x7f3f24003e10 2023-11-15T02:37:29.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.059+0000 7f3f3ced1700 1 -- 172.21.15.1:0/4258798523 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2800e9c0 con 0x7f3f24003e10 2023-11-15T02:37:29.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.060+0000 7f3f3eed5700 1 -- 172.21.15.1:0/4258798523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f24003e10 msgr2=0x7f3f24004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:29.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.060+0000 7f3f3eed5700 1 --2- 172.21.15.1:0/4258798523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f24003e10 0x7f3f24004690 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f3f28009ab0 tx=0x7f3f28009060).stop 2023-11-15T02:37:29.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.060+0000 7f3f3e6d4700 1 -- 172.21.15.1:0/4258798523 reap_dead start 2023-11-15T02:37:29.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.060+0000 7f3f3eed5700 1 -- 172.21.15.1:0/4258798523 shutdown_connections 2023-11-15T02:37:29.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.060+0000 7f3f3eed5700 1 -- 172.21.15.1:0/4258798523 >> 172.21.15.1:0/4258798523 conn(0x7f3f38064a60 msgr2=0x7f3f38064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:29.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.060+0000 7f3f3eed5700 1 -- 172.21.15.1:0/4258798523 shutdown_connections 2023-11-15T02:37:29.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.060+0000 7f3f3eed5700 1 -- 172.21.15.1:0/4258798523 wait complete. 2023-11-15T02:37:29.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.061+0000 7f3f3eed5700 1 Processor -- start 2023-11-15T02:37:29.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.061+0000 7f3f3eed5700 1 -- start start 2023-11-15T02:37:29.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3eed5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f24003e10 0x7f3f380b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:29.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3eed5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f380c4380 0x7f3f380c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:29.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3eed5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f38151c40 0x7f3f381520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:29.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3eed5700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f38168ab0 con 0x7f3f38151c40 2023-11-15T02:37:29.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3eed5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380b0590 con 0x7f3f24003e10 2023-11-15T02:37:29.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3eed5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f381525b0 con 0x7f3f380c4380 2023-11-15T02:37:29.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3e6d4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f38151c40 0x7f3f381520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:29.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3e6d4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f38151c40 0x7f3f381520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43036/0 (socket says 172.21.15.1:43036) 2023-11-15T02:37:29.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3e6d4700 1 -- 172.21.15.1:0/2293260770 learned_addr learned my addr 172.21.15.1:0/2293260770 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:37:29.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3ded3700 1 --2- 172.21.15.1:0/2293260770 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f24003e10 0x7f3f380b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:29.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3d6d2700 1 --2- 172.21.15.1:0/2293260770 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f380c4380 0x7f3f380c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:29.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3e6d4700 1 -- 172.21.15.1:0/2293260770 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f380c4380 msgr2=0x7f3f380c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:29.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3e6d4700 1 --2- 172.21.15.1:0/2293260770 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f380c4380 0x7f3f380c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:29.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3e6d4700 1 -- 172.21.15.1:0/2293260770 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f24003e10 msgr2=0x7f3f380b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:29.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3e6d4700 1 --2- 172.21.15.1:0/2293260770 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f24003e10 0x7f3f380b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:29.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3e6d4700 1 -- 172.21.15.1:0/2293260770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f381687d0 con 0x7f3f38151c40 2023-11-15T02:37:29.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3ded3700 1 --2- 172.21.15.1:0/2293260770 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f24003e10 0x7f3f380b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:37:29.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.062+0000 7f3f3e6d4700 1 --2- 172.21.15.1:0/2293260770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f38151c40 0x7f3f381520c0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f3f300094d0 tx=0x7f3f3000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:29.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.063+0000 7f3f2dffb700 1 -- 172.21.15.1:0/2293260770 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3000e040 con 0x7f3f38151c40 2023-11-15T02:37:29.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.063+0000 7f3f2dffb700 1 -- 172.21.15.1:0/2293260770 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3000f040 con 0x7f3f38151c40 2023-11-15T02:37:29.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.063+0000 7f3f3eed5700 1 -- 172.21.15.1:0/2293260770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f380aff40 con 0x7f3f38151c40 2023-11-15T02:37:29.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.063+0000 7f3f2dffb700 1 -- 172.21.15.1:0/2293260770 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3000fe50 con 0x7f3f38151c40 2023-11-15T02:37:29.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.063+0000 7f3f3eed5700 1 -- 172.21.15.1:0/2293260770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f380b0f10 con 0x7f3f38151c40 2023-11-15T02:37:29.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.064+0000 7f3f3eed5700 1 -- 172.21.15.1:0/2293260770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f380afda0 con 0x7f3f38151c40 2023-11-15T02:37:29.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.064+0000 7f3f2dffb700 1 -- 172.21.15.1:0/2293260770 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 77) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f3f30015660 con 0x7f3f38151c40 2023-11-15T02:37:29.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.065+0000 7f3f2dffb700 1 --2- 172.21.15.1:0/2293260770 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3f1c05f080 0x7f3f1c061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:37:29.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.065+0000 7f3f2dffb700 1 -- 172.21.15.1:0/2293260770 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f3f3007ad70 con 0x7f3f38151c40 2023-11-15T02:37:29.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.065+0000 7f3f3ded3700 1 --2- 172.21.15.1:0/2293260770 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3f1c05f080 0x7f3f1c061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:37:29.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.065+0000 7f3f3ded3700 1 --2- 172.21.15.1:0/2293260770 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3f1c05f080 0x7f3f1c061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3f34001d20 tx=0x7f3f34009040).ready entity=mgr.8443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:37:29.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.069+0000 7f3f2dffb700 1 -- 172.21.15.1:0/2293260770 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3f380afda0 con 0x7f3f38151c40 2023-11-15T02:37:29.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.268+0000 7f3f3eed5700 1 -- 172.21.15.1:0/2293260770 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f380afda0 con 0x7f3f1c05f080 2023-11-15T02:37:29.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.274+0000 7f3f2dffb700 1 -- 172.21.15.1:0/2293260770 <== mgr.8443 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f3f380afda0 con 0x7f3f1c05f080 2023-11-15T02:37:29.275 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-11-15T02:37:29.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.276+0000 7f3f3eed5700 1 -- 172.21.15.1:0/2293260770 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3f1c05f080 msgr2=0x7f3f1c061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:29.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.276+0000 7f3f3eed5700 1 --2- 172.21.15.1:0/2293260770 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3f1c05f080 0x7f3f1c061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3f34001d20 tx=0x7f3f34009040).stop 2023-11-15T02:37:29.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.276+0000 7f3f3eed5700 1 -- 172.21.15.1:0/2293260770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f38151c40 msgr2=0x7f3f381520c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:37:29.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.276+0000 7f3f3eed5700 1 --2- 172.21.15.1:0/2293260770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f38151c40 0x7f3f381520c0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f3f300094d0 tx=0x7f3f3000b040).stop 2023-11-15T02:37:29.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.276+0000 7f3f3eed5700 1 -- 172.21.15.1:0/2293260770 shutdown_connections 2023-11-15T02:37:29.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.276+0000 7f3f3eed5700 1 --2- 172.21.15.1:0/2293260770 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f3f1c05f080 0x7f3f1c061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:29.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.276+0000 7f3f3eed5700 1 --2- 172.21.15.1:0/2293260770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f38151c40 0x7f3f381520c0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:29.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.276+0000 7f3f3eed5700 1 --2- 172.21.15.1:0/2293260770 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f24003e10 0x7f3f380b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:29.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.276+0000 7f3f3eed5700 1 --2- 172.21.15.1:0/2293260770 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f380c4380 0x7f3f380c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:37:29.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.276+0000 7f3f3eed5700 1 -- 172.21.15.1:0/2293260770 >> 172.21.15.1:0/2293260770 conn(0x7f3f38064a60 msgr2=0x7f3f380c0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:37:29.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.276+0000 7f3f3eed5700 1 -- 172.21.15.1:0/2293260770 shutdown_connections 2023-11-15T02:37:29.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:37:29.276+0000 7f3f3eed5700 1 -- 172.21.15.1:0/2293260770 wait complete. 2023-11-15T02:37:29.288 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-11-15T02:37:31.229 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:37:31.232 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:38:00.280 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:38:00.278+0000 7fc5cf3f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:38:00.280 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:38:00.278+0000 7fc5cf3f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:38:00.281 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:38:00.278+0000 7fc5cf3f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:38:00.281 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:38:00.278+0000 7fc5cf3f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:38:00.281 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:38:00.278+0000 7fc5cf3f5700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:38:01.375 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:38:01.378 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:38:31.521 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:38:31.525 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:39:01.643 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:39:01.646 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:39:31.781 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:39:31.784 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:40:01.910 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:40:01.913 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:40:31.981 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:40:31.984 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:41:02.068 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:41:02.072 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:41:32.197 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:41:32.200 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:42:02.352 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:42:02.356 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:42:32.448 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:42:32.451 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:43:02.586 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:43:02.589 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:43:32.715 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:43:32.718 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:44:02.853 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:44:02.856 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:44:32.974 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:44:32.980 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:45:03.040 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:45:03.043 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:45:33.184 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:45:33.187 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:46:03.338 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:46:03.342 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:46:33.493 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:46:33.497 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:47:03.631 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:47:03.634 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:47:33.770 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:47:33.773 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:48:03.890 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:48:03.893 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:48:16.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:48:16.290 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-11-15T02:48:16.311 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_38_00_UTC 2023-11-15T02:48:16.312 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_39_00_UTC 2023-11-15T02:48:16.312 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_40_00_UTC 2023-11-15T02:48:16.312 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_41_00_UTC 2023-11-15T02:48:16.312 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_42_00_UTC 2023-11-15T02:48:16.313 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_43_00_UTC 2023-11-15T02:48:16.313 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_44_00_UTC 2023-11-15T02:48:16.313 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_45_00_UTC 2023-11-15T02:48:16.313 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_46_00_UTC 2023-11-15T02:48:16.313 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_47_00_UTC 2023-11-15T02:48:16.314 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_48_00_UTC 2023-11-15T02:48:16.314 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-15-02_38_00_UTC', 'scheduled-2023-11-15-02_39_00_UTC', 'scheduled-2023-11-15-02_40_00_UTC', 'scheduled-2023-11-15-02_41_00_UTC', 'scheduled-2023-11-15-02_42_00_UTC', 'scheduled-2023-11-15-02_43_00_UTC', 'scheduled-2023-11-15-02_44_00_UTC', 'scheduled-2023-11-15-02_45_00_UTC', 'scheduled-2023-11-15-02_46_00_UTC', 'scheduled-2023-11-15-02_47_00_UTC', 'scheduled-2023-11-15-02_48_00_UTC'] 2023-11-15T02:48:16.314 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-11-15T02:48:16.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.485+0000 7fccad1b5700 1 Processor -- start 2023-11-15T02:48:16.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.485+0000 7fccad1b5700 1 -- start start 2023-11-15T02:48:16.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.486+0000 7fccad1b5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcca8062970 0x7fcca8062d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:48:16.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.486+0000 7fccad1b5700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca806a610 con 0x7fcca80c23d0 2023-11-15T02:48:16.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.486+0000 7fccad1b5700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca8065790 con 0x7fcca80c2850 2023-11-15T02:48:16.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.486+0000 7fccad1b5700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca8065a30 con 0x7fcca8062970 2023-11-15T02:48:16.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.486+0000 7fcca6d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcca8062970 0x7fcca8062d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:48:16.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.486+0000 7fcca659c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fcca80c23d0 0x7fcca80c5930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48448/0 (socket says 172.21.15.1:48448) 2023-11-15T02:48:16.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.486+0000 7fcca659c700 1 -- 172.21.15.1:0/1344340235 learned_addr learned my addr 172.21.15.1:0/1344340235 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:48:16.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.486+0000 7fcca6d9d700 1 -- 172.21.15.1:0/1344340235 >> v1:172.21.15.141:6789/0 conn(0x7fcca80c2850 legacy=0x7fcca813a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:48:16.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.486+0000 7fcca6d9d700 1 -- 172.21.15.1:0/1344340235 >> v1:172.21.15.1:6789/0 conn(0x7fcca80c23d0 legacy=0x7fcca80c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:48:16.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.486+0000 7fcca6d9d700 1 -- 172.21.15.1:0/1344340235 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca8065d10 con 0x7fcca8062970 2023-11-15T02:48:16.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.486+0000 7fcca5d9b700 1 -- 172.21.15.1:0/1344340235 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498220522 0 0) 0x7fcca806a610 con 0x7fcca80c23d0 2023-11-15T02:48:16.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.486+0000 7fcca6d9d700 1 --2- 172.21.15.1:0/1344340235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca8062970 0x7fcca8062d50 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7fcc98009e60 tx=0x7fcc98009780).ready entity=mon.0 client_cookie=516e54f47f5f064d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:48:16.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.486+0000 7fcca5d9b700 1 -- 172.21.15.1:0/1344340235 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9800e070 con 0x7fcca8062970 2023-11-15T02:48:16.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.486+0000 7fcca5d9b700 1 -- 172.21.15.1:0/1344340235 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9800bbf0 con 0x7fcca8062970 2023-11-15T02:48:16.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.487+0000 7fcca5d9b700 1 -- 172.21.15.1:0/1344340235 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98012410 con 0x7fcca8062970 2023-11-15T02:48:16.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.487+0000 7fccad1b5700 1 -- 172.21.15.1:0/1344340235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca8062970 msgr2=0x7fcca8062d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:48:16.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.487+0000 7fccad1b5700 1 --2- 172.21.15.1:0/1344340235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca8062970 0x7fcca8062d50 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7fcc98009e60 tx=0x7fcc98009780).stop 2023-11-15T02:48:16.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.487+0000 7fccad1b5700 1 -- 172.21.15.1:0/1344340235 shutdown_connections 2023-11-15T02:48:16.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.487+0000 7fccad1b5700 1 --2- 172.21.15.1:0/1344340235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca8062970 0x7fcca8062d50 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:48:16.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.487+0000 7fccad1b5700 1 -- 172.21.15.1:0/1344340235 >> 172.21.15.1:0/1344340235 conn(0x7fcca80c7dd0 msgr2=0x7fcca80c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:48:16.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.487+0000 7fccad1b5700 1 -- 172.21.15.1:0/1344340235 shutdown_connections 2023-11-15T02:48:16.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.487+0000 7fccad1b5700 1 -- 172.21.15.1:0/1344340235 wait complete. 2023-11-15T02:48:16.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.488+0000 7fccad1b5700 1 Processor -- start 2023-11-15T02:48:16.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.488+0000 7fccad1b5700 1 -- start start 2023-11-15T02:48:16.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.489+0000 7fccad1b5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca8062970 0x7fcca8159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:48:16.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.489+0000 7fccad1b5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcca80c23d0 0x7fcca81388c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:48:16.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.489+0000 7fccad1b5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca80c2850 0x7fcca8138db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:48:16.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.489+0000 7fccad1b5700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca81392a0 con 0x7fcca8062970 2023-11-15T02:48:16.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.489+0000 7fccad1b5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80bfb20 con 0x7fcca80c23d0 2023-11-15T02:48:16.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.489+0000 7fccad1b5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80bffb0 con 0x7fcca80c2850 2023-11-15T02:48:16.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.489+0000 7fcca6d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca8062970 0x7fcca8159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:48:16.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.489+0000 7fcca6d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca8062970 0x7fcca8159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47992/0 (socket says 172.21.15.1:47992) 2023-11-15T02:48:16.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.489+0000 7fcca6d9d700 1 -- 172.21.15.1:0/3974709760 learned_addr learned my addr 172.21.15.1:0/3974709760 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:48:16.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.489+0000 7fcca759e700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca80c2850 0x7fcca8138db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:48:16.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.489+0000 7fcca659c700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcca80c23d0 0x7fcca81388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:48:16.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.489+0000 7fcca6d9d700 1 -- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca80c2850 msgr2=0x7fcca8138db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:48:16.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.489+0000 7fcca6d9d700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca80c2850 0x7fcca8138db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:48:16.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.489+0000 7fcca6d9d700 1 -- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcca80c23d0 msgr2=0x7fcca81388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:48:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.489+0000 7fcca6d9d700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcca80c23d0 0x7fcca81388c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:48:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.490+0000 7fcca6d9d700 1 -- 172.21.15.1:0/3974709760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc98009a20 con 0x7fcca8062970 2023-11-15T02:48:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.490+0000 7fcca759e700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca80c2850 0x7fcca8138db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:48:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.490+0000 7fcca659c700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcca80c23d0 0x7fcca81388c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:48:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.490+0000 7fcca6d9d700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca8062970 0x7fcca8159640 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7fcca8069380 tx=0x7fcca806a7a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:48:16.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.490+0000 7fcc9effd700 1 -- 172.21.15.1:0/3974709760 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9801d630 con 0x7fcca8062970 2023-11-15T02:48:16.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.490+0000 7fcc9effd700 1 -- 172.21.15.1:0/3974709760 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9801d7b0 con 0x7fcca8062970 2023-11-15T02:48:16.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.490+0000 7fccad1b5700 1 -- 172.21.15.1:0/3974709760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca80bef10 con 0x7fcca8062970 2023-11-15T02:48:16.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.490+0000 7fcc9effd700 1 -- 172.21.15.1:0/3974709760 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9801db70 con 0x7fcca8062970 2023-11-15T02:48:16.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.490+0000 7fccad1b5700 1 -- 172.21.15.1:0/3974709760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca80bf4d0 con 0x7fcca8062970 2023-11-15T02:48:16.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.491+0000 7fccad1b5700 1 -- 172.21.15.1:0/3974709760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca80bfe00 con 0x7fcca8062970 2023-11-15T02:48:16.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.491+0000 7fcc9effd700 1 -- 172.21.15.1:0/3974709760 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 80) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fcc98027460 con 0x7fcca8062970 2023-11-15T02:48:16.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.491+0000 7fcc9effd700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcc8805f2c0 0x7fcc88061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:48:16.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.492+0000 7fcc9effd700 1 -- 172.21.15.1:0/3974709760 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6962+0+0 (secure 0 0 0) 0x7fcc9807c670 con 0x7fcca8062970 2023-11-15T02:48:16.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.492+0000 7fcca659c700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcc8805f2c0 0x7fcc88061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:48:16.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.492+0000 7fcca659c700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcc8805f2c0 0x7fcc88061780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fcc90007fd0 tx=0x7fcc90009040).ready entity=mgr.8443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:48:16.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.496+0000 7fcc9effd700 1 -- 172.21.15.1:0/3974709760 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcc9804d410 con 0x7fcca8062970 2023-11-15T02:48:16.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.693+0000 7fccad1b5700 1 -- 172.21.15.1:0/3974709760 --> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcca806c7e0 con 0x7fcc8805f2c0 2023-11-15T02:48:16.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.695+0000 7fcc9effd700 1 -- 172.21.15.1:0/3974709760 <== mgr.8443 v2:172.21.15.141:6832/90546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fcca806c7e0 con 0x7fcc8805f2c0 2023-11-15T02:48:16.698 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:48:16.698 INFO:teuthology.orchestra.run.smithi001.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T02:37:28", "first": "2023-11-15T02:38:00", "last": "2023-11-15T02:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-11-15T02:48:16.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.697+0000 7fccad1b5700 1 -- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcc8805f2c0 msgr2=0x7fcc88061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:48:16.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.697+0000 7fccad1b5700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcc8805f2c0 0x7fcc88061780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fcc90007fd0 tx=0x7fcc90009040).stop 2023-11-15T02:48:16.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.697+0000 7fccad1b5700 1 -- 172.21.15.1:0/3974709760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca8062970 msgr2=0x7fcca8159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:48:16.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.697+0000 7fccad1b5700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca8062970 0x7fcca8159640 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7fcca8069380 tx=0x7fcca806a7a0).stop 2023-11-15T02:48:16.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.697+0000 7fccad1b5700 1 -- 172.21.15.1:0/3974709760 shutdown_connections 2023-11-15T02:48:16.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.697+0000 7fccad1b5700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7fcc8805f2c0 0x7fcc88061780 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:48:16.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.697+0000 7fccad1b5700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca80c2850 0x7fcca8138db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:48:16.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.697+0000 7fccad1b5700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca8062970 0x7fcca8159640 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:48:16.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.697+0000 7fccad1b5700 1 --2- 172.21.15.1:0/3974709760 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcca80c23d0 0x7fcca81388c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:48:16.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.697+0000 7fccad1b5700 1 -- 172.21.15.1:0/3974709760 >> 172.21.15.1:0/3974709760 conn(0x7fcca80c7dd0 msgr2=0x7fcca80c4670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:48:16.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.697+0000 7fccad1b5700 1 -- 172.21.15.1:0/3974709760 shutdown_connections 2023-11-15T02:48:16.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.697+0000 7fccad1b5700 1 -- 172.21.15.1:0/3974709760 wait complete. 2023-11-15T02:48:16.712 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T02:37:28", "first": "2023-11-15T02:38:00", "last": "2023-11-15T02:48:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-11-15T02:48:16.713 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-11-15T00:00:00', 'created': '2023-11-15T02:37:28', 'first': '2023-11-15T02:38:00', 'last': '2023-11-15T02:48:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-11-15T02:48:16.713 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-11-15T02:48:16.714 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-11-15T02:48:16.714 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-15T02:48:16.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.831+0000 7f3748597700 1 Processor -- start 2023-11-15T02:48:16.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.831+0000 7f3748597700 1 -- start start 2023-11-15T02:48:16.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.832+0000 7f3748597700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f37400c6620 0x7f3740154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:48:16.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.832+0000 7f3748597700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37400c06f0 con 0x7f37400ab1a0 2023-11-15T02:48:16.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.832+0000 7f3748597700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37400c09d0 con 0x7f3740154150 2023-11-15T02:48:16.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.832+0000 7f3748597700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3740158820 con 0x7f37400c6620 2023-11-15T02:48:16.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.832+0000 7f3746b34700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f37400c6620 0x7f3740154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:48:16.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.832+0000 7f3745b32700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f37400ab1a0 0x7f37400c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48450/0 (socket says 172.21.15.1:48450) 2023-11-15T02:48:16.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.832+0000 7f3745b32700 1 -- 172.21.15.1:0/1653172239 learned_addr learned my addr 172.21.15.1:0/1653172239 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:48:16.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.833+0000 7f3746b34700 1 -- 172.21.15.1:0/1653172239 >> v1:172.21.15.141:6789/0 conn(0x7f3740154150 legacy=0x7f3740158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:48:16.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.833+0000 7f3746b34700 1 -- 172.21.15.1:0/1653172239 >> v1:172.21.15.1:6789/0 conn(0x7f37400ab1a0 legacy=0x7f37400c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:48:16.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.833+0000 7f3745331700 1 -- 172.21.15.1:0/1653172239 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131102483 0 0) 0x7f37400c06f0 con 0x7f37400ab1a0 2023-11-15T02:48:16.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.833+0000 7f3746b34700 1 -- 172.21.15.1:0/1653172239 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3740158b00 con 0x7f37400c6620 2023-11-15T02:48:16.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.833+0000 7f3746b34700 1 --2- 172.21.15.1:0/1653172239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37400c6620 0x7f3740154530 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7f3730009760 tx=0x7f3730009060).ready entity=mon.0 client_cookie=e7b0b3d4651d78b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:48:16.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.833+0000 7f3745331700 1 -- 172.21.15.1:0/1653172239 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37300090d0 con 0x7f37400c6620 2023-11-15T02:48:16.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.833+0000 7f3745331700 1 -- 172.21.15.1:0/1653172239 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373000b520 con 0x7f37400c6620 2023-11-15T02:48:16.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.833+0000 7f3745331700 1 -- 172.21.15.1:0/1653172239 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000b8a0 con 0x7f37400c6620 2023-11-15T02:48:16.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.834+0000 7f3748597700 1 -- 172.21.15.1:0/1653172239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37400c6620 msgr2=0x7f3740154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:48:16.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.834+0000 7f3748597700 1 --2- 172.21.15.1:0/1653172239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37400c6620 0x7f3740154530 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7f3730009760 tx=0x7f3730009060).stop 2023-11-15T02:48:16.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.834+0000 7f3748597700 1 -- 172.21.15.1:0/1653172239 shutdown_connections 2023-11-15T02:48:16.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.834+0000 7f3748597700 1 --2- 172.21.15.1:0/1653172239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37400c6620 0x7f3740154530 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:48:16.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.834+0000 7f3748597700 1 -- 172.21.15.1:0/1653172239 >> 172.21.15.1:0/1653172239 conn(0x7f3740064aa0 msgr2=0x7f3740064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:48:16.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.834+0000 7f3748597700 1 -- 172.21.15.1:0/1653172239 shutdown_connections 2023-11-15T02:48:16.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.834+0000 7f3748597700 1 -- 172.21.15.1:0/1653172239 wait complete. 2023-11-15T02:48:16.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.835+0000 7f3748597700 1 Processor -- start 2023-11-15T02:48:16.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.835+0000 7f3748597700 1 -- start start 2023-11-15T02:48:16.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3748597700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37400ab1a0 0x7f37400b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:48:16.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3748597700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37400c6620 0x7f374014d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:48:16.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3748597700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3740154150 0x7f3740156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:48:16.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3748597700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37400b1050 con 0x7f37400c6620 2023-11-15T02:48:16.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3748597700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374014ddb0 con 0x7f3740154150 2023-11-15T02:48:16.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3748597700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37401573c0 con 0x7f37400ab1a0 2023-11-15T02:48:16.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3745b32700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37400c6620 0x7f374014d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:48:16.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3745b32700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37400c6620 0x7f374014d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48018/0 (socket says 172.21.15.1:48018) 2023-11-15T02:48:16.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3745b32700 1 -- 172.21.15.1:0/3254410250 learned_addr learned my addr 172.21.15.1:0/3254410250 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:48:16.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3746333700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37400ab1a0 0x7f37400b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:48:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3746b34700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3740154150 0x7f3740156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:48:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3745b32700 1 -- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37400ab1a0 msgr2=0x7f37400b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:48:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3745b32700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37400ab1a0 0x7f37400b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:48:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3745b32700 1 -- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3740154150 msgr2=0x7f3740156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:48:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3745b32700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3740154150 0x7f3740156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:48:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3745b32700 1 -- 172.21.15.1:0/3254410250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37300092a0 con 0x7f37400c6620 2023-11-15T02:48:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3746333700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37400ab1a0 0x7f37400b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:48:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3746b34700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3740154150 0x7f3740156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:48:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3745b32700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37400c6620 0x7f374014d8c0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f373400c4e0 tx=0x7f3734007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:48:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f373e7fc700 1 -- 172.21.15.1:0/3254410250 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37340072e0 con 0x7f37400c6620 2023-11-15T02:48:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f373e7fc700 1 -- 172.21.15.1:0/3254410250 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3734007440 con 0x7f37400c6620 2023-11-15T02:48:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3748597700 1 -- 172.21.15.1:0/3254410250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3740157670 con 0x7f37400c6620 2023-11-15T02:48:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f373e7fc700 1 -- 172.21.15.1:0/3254410250 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37340057a0 con 0x7f37400c6620 2023-11-15T02:48:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.836+0000 7f3748597700 1 -- 172.21.15.1:0/3254410250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37400ae150 con 0x7f37400c6620 2023-11-15T02:48:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.837+0000 7f3748597700 1 -- 172.21.15.1:0/3254410250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374006c7e0 con 0x7f37400c6620 2023-11-15T02:48:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.838+0000 7f373e7fc700 1 -- 172.21.15.1:0/3254410250 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 80) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f3734005bd0 con 0x7f37400c6620 2023-11-15T02:48:16.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.838+0000 7f373e7fc700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f372c05f2c0 0x7f372c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:48:16.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.838+0000 7f373e7fc700 1 -- 172.21.15.1:0/3254410250 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6962+0+0 (secure 0 0 0) 0x7f373407a0d0 con 0x7f37400c6620 2023-11-15T02:48:16.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.838+0000 7f3746333700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f372c05f2c0 0x7f372c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:48:16.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.839+0000 7f3746333700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f372c05f2c0 0x7f372c061780 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3738006fd0 tx=0x7f3738001300).ready entity=mgr.8443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:48:16.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:16.842+0000 7f373e7fc700 1 -- 172.21.15.1:0/3254410250 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f373404aed0 con 0x7f37400c6620 2023-11-15T02:48:17.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:17.063+0000 7f3748597700 1 -- 172.21.15.1:0/3254410250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f37400c02a0 con 0x7f37400c6620 2023-11-15T02:48:17.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:17.066+0000 7f373e7fc700 1 -- 172.21.15.1:0/3254410250 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v80) v1 ==== 74+0+149160 (secure 0 0 0) 0x7f373404e4f0 con 0x7f37400c6620 2023-11-15T02:48:17.074 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:48:17.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:17.068+0000 7f3748597700 1 -- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f372c05f2c0 msgr2=0x7f372c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:48:17.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:17.068+0000 7f3748597700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f372c05f2c0 0x7f372c061780 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3738006fd0 tx=0x7f3738001300).stop 2023-11-15T02:48:17.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:17.068+0000 7f3748597700 1 -- 172.21.15.1:0/3254410250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37400c6620 msgr2=0x7f374014d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:48:17.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:17.068+0000 7f3748597700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37400c6620 0x7f374014d8c0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f373400c4e0 tx=0x7f3734007c70).stop 2023-11-15T02:48:17.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:17.068+0000 7f3748597700 1 -- 172.21.15.1:0/3254410250 shutdown_connections 2023-11-15T02:48:17.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:17.068+0000 7f3748597700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:6832/90546,v1:172.21.15.141:6833/90546] conn(0x7f372c05f2c0 0x7f372c061780 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:48:17.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:17.068+0000 7f3748597700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3740154150 0x7f3740156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:48:17.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:17.068+0000 7f3748597700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37400ab1a0 0x7f37400b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:48:17.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:17.068+0000 7f3748597700 1 --2- 172.21.15.1:0/3254410250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37400c6620 0x7f374014d8c0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:48:17.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:17.068+0000 7f3748597700 1 -- 172.21.15.1:0/3254410250 >> 172.21.15.1:0/3254410250 conn(0x7f3740064aa0 msgr2=0x7f37400cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:48:17.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:17.069+0000 7f3748597700 1 -- 172.21.15.1:0/3254410250 shutdown_connections 2023-11-15T02:48:17.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:48:17.069+0000 7f3748597700 1 -- 172.21.15.1:0/3254410250 wait complete. 2023-11-15T02:48:17.083 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"active_gid":8443,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":90546},{"type":"v1","addr":"172.21.15.141:6833","nonce":90546}]},"active_addr":"172.21.15.141:6833/90546","active_change":"2023-11-15T02:37:27.844816+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":9267,"name":"y","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":178,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.141:0","nonce":466988614}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.141:0","nonce":4241902942}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.141:0","nonce":573779117}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.141:0","nonce":13260862}]}]} 2023-11-15T02:48:17.087 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: x 2023-11-15T02:48:17.088 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-15T02:48:17.088 INFO:tasks.ceph.mgr.x:Stopping old one... 2023-11-15T02:48:17.089 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-15T02:48:17.089 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:48:17.118 INFO:tasks.ceph.mgr.x:Stopped 2023-11-15T02:48:17.119 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-15T02:48:17.160 INFO:tasks.ceph.mgr.x:Started 2023-11-15T02:48:17.343 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:17.342+0000 7f82f1cca680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:48:17.405 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:17.404+0000 7f82f1cca680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:48:17.676 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:17.674+0000 7f82f1cca680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:48:18.284 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:18.283+0000 7f82f1cca680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:48:18.356 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:18.355+0000 7f82f1cca680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:48:18.543 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:18.542+0000 7f82f1cca680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:48:18.963 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:18.962+0000 7f82f1cca680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:48:19.066 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:19.064+0000 7f82f1cca680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:48:19.219 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:19.218+0000 7f82f1cca680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:48:19.293 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:19.292+0000 7f82f1cca680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:48:19.360 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:19.358+0000 7f82f1cca680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:48:19.617 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:19.616+0000 7f82f1cca680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:48:19.801 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:19.799+0000 7f82f1cca680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:48:20.451 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:20.450+0000 7f82f1cca680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:48:20.519 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:20.518+0000 7f82f1cca680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:48:20.594 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:20.593+0000 7f82f1cca680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:48:20.741 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:20.739+0000 7f82f1cca680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:48:20.811 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:20.810+0000 7f82f1cca680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:48:20.926 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:20.925+0000 7f82f1cca680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:48:21.034 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:21.033+0000 7f82f1cca680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:48:21.324 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:21.323+0000 7f82f1cca680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:48:21.396 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:21.395+0000 7f82f1cca680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:48:21.486 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:21.484+0000 7f8269455700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:48:21.486 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:21.484+0000 7f8269455700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:48:21.486 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:21.484+0000 7f8269455700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:48:21.487 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:21.484+0000 7f8269455700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:48:21.487 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:21.484+0000 7f8269455700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:48:21.487 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:21.484+0000 7f826544d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:48:21.487 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:21.484+0000 7f826544d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:48:21.487 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:21.484+0000 7f826544d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:48:21.488 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:21.484+0000 7f826544d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:48:21.488 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:48:21.484+0000 7f826544d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:48:34.003 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:48:34.006 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:49:00.477 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:49:00.476+0000 7f8271c66700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:49:00.478 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:49:00.476+0000 7f8271c66700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:49:00.478 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:49:00.476+0000 7f8271c66700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:49:00.478 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:49:00.476+0000 7f8271c66700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:49:00.478 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:49:00.476+0000 7f8271c66700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:49:04.132 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:49:04.135 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:49:34.262 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:49:34.265 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:50:04.383 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:50:04.386 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:50:34.446 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:50:34.449 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:51:04.575 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:51:04.578 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:51:34.644 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:51:34.647 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:52:04.775 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:52:04.778 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:52:34.939 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:52:34.943 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:53:05.035 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:53:05.038 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:53:17.162 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-11-15T02:53:17.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.298+0000 7fde2afbc700 1 Processor -- start 2023-11-15T02:53:17.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.298+0000 7fde2afbc700 1 -- start start 2023-11-15T02:53:17.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.299+0000 7fde2afbc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fde2414b350 0x7fde240c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:17.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.299+0000 7fde2afbc700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fde2414b730 0x7fde24154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:17.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.299+0000 7fde2afbc700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde241580d0 con 0x7fde240aa040 2023-11-15T02:53:17.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.299+0000 7fde2afbc700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde24155000 con 0x7fde2414b350 2023-11-15T02:53:17.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.299+0000 7fde2afbc700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde241552e0 con 0x7fde2414b730 2023-11-15T02:53:17.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.299+0000 7fde28d58700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fde2414b350 0x7fde240c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:17.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.299+0000 7fde28d58700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fde2414b350 0x7fde240c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60892/0 (socket says 172.21.15.1:60892) 2023-11-15T02:53:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.299+0000 7fde28d58700 1 -- 172.21.15.1:0/898169338 learned_addr learned my addr 172.21.15.1:0/898169338 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.299+0000 7fde23fff700 1 --2- 172.21.15.1:0/898169338 >> v2:172.21.15.141:3300/0 conn(0x7fde2414b730 0x7fde24154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.299+0000 7fde28d58700 1 -- 172.21.15.1:0/898169338 >> v2:172.21.15.141:3300/0 conn(0x7fde2414b730 msgr2=0x7fde24154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.299+0000 7fde28d58700 1 --2- 172.21.15.1:0/898169338 >> v2:172.21.15.141:3300/0 conn(0x7fde2414b730 0x7fde24154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.299+0000 7fde28d58700 1 -- 172.21.15.1:0/898169338 >> v1:172.21.15.141:6789/0 conn(0x7fde240aa040 legacy=0x7fde24158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.299+0000 7fde28d58700 1 -- 172.21.15.1:0/898169338 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde241555c0 con 0x7fde2414b350 2023-11-15T02:53:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.299+0000 7fde28d58700 1 --2- 172.21.15.1:0/898169338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde2414b350 0x7fde240c8290 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7fde240c8780 tx=0x7fde180090f0).ready entity=mon.0 client_cookie=a7f6b09bc9b19aa server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.300+0000 7fde237fe700 1 -- 172.21.15.1:0/898169338 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1800b5a0 con 0x7fde2414b350 2023-11-15T02:53:17.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.300+0000 7fde237fe700 1 -- 172.21.15.1:0/898169338 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1800b700 con 0x7fde2414b350 2023-11-15T02:53:17.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.300+0000 7fde237fe700 1 -- 172.21.15.1:0/898169338 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1800ba80 con 0x7fde2414b350 2023-11-15T02:53:17.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.300+0000 7fde2afbc700 1 -- 172.21.15.1:0/898169338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde2414b350 msgr2=0x7fde240c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:17.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.300+0000 7fde2afbc700 1 --2- 172.21.15.1:0/898169338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde2414b350 0x7fde240c8290 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7fde240c8780 tx=0x7fde180090f0).stop 2023-11-15T02:53:17.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.300+0000 7fde2afbc700 1 -- 172.21.15.1:0/898169338 shutdown_connections 2023-11-15T02:53:17.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.300+0000 7fde2afbc700 1 --2- 172.21.15.1:0/898169338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde2414b350 0x7fde240c8290 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.300+0000 7fde2afbc700 1 --2- 172.21.15.1:0/898169338 >> v2:172.21.15.141:3300/0 conn(0x7fde2414b730 0x7fde24154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.300+0000 7fde2afbc700 1 -- 172.21.15.1:0/898169338 >> 172.21.15.1:0/898169338 conn(0x7fde24069ee0 msgr2=0x7fde2406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:17.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.300+0000 7fde2afbc700 1 -- 172.21.15.1:0/898169338 shutdown_connections 2023-11-15T02:53:17.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.300+0000 7fde2afbc700 1 -- 172.21.15.1:0/898169338 wait complete. 2023-11-15T02:53:17.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.301+0000 7fde2afbc700 1 Processor -- start 2023-11-15T02:53:17.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.302+0000 7fde2afbc700 1 -- start start 2023-11-15T02:53:17.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.302+0000 7fde2afbc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fde240aa040 0x7fde240ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:17.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.302+0000 7fde2afbc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde2414b350 0x7fde24142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:17.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.302+0000 7fde2afbc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde2414b730 0x7fde240c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:17.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.302+0000 7fde2afbc700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde240c44a0 con 0x7fde2414b730 2023-11-15T02:53:17.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.302+0000 7fde2afbc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde240c4780 con 0x7fde240aa040 2023-11-15T02:53:17.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.302+0000 7fde2afbc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde240c4a60 con 0x7fde2414b350 2023-11-15T02:53:17.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.302+0000 7fde29559700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde2414b730 0x7fde240c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:17.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.302+0000 7fde29559700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde2414b730 0x7fde240c22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60900/0 (socket says 172.21.15.1:60900) 2023-11-15T02:53:17.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.303+0000 7fde29559700 1 -- 172.21.15.1:0/3251245277 learned_addr learned my addr 172.21.15.1:0/3251245277 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:17.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.303+0000 7fde28d58700 1 --2- 172.21.15.1:0/3251245277 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fde240aa040 0x7fde240ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:17.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.303+0000 7fde23fff700 1 --2- 172.21.15.1:0/3251245277 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde2414b350 0x7fde24142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:17.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.303+0000 7fde29559700 1 -- 172.21.15.1:0/3251245277 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde2414b350 msgr2=0x7fde24142d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:17.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.303+0000 7fde29559700 1 --2- 172.21.15.1:0/3251245277 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde2414b350 0x7fde24142d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.303+0000 7fde29559700 1 -- 172.21.15.1:0/3251245277 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fde240aa040 msgr2=0x7fde240ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:17.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.303+0000 7fde29559700 1 --2- 172.21.15.1:0/3251245277 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fde240aa040 0x7fde240ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.303+0000 7fde29559700 1 -- 172.21.15.1:0/3251245277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde18009370 con 0x7fde2414b730 2023-11-15T02:53:17.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.303+0000 7fde29559700 1 --2- 172.21.15.1:0/3251245277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde2414b730 0x7fde240c22f0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7fde1c00b810 tx=0x7fde1c009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:17.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.303+0000 7fde20ff9700 1 -- 172.21.15.1:0/3251245277 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c00d4a0 con 0x7fde2414b730 2023-11-15T02:53:17.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.303+0000 7fde20ff9700 1 -- 172.21.15.1:0/3251245277 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c00d600 con 0x7fde2414b730 2023-11-15T02:53:17.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.303+0000 7fde2afbc700 1 -- 172.21.15.1:0/3251245277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde240c4d40 con 0x7fde2414b730 2023-11-15T02:53:17.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.303+0000 7fde20ff9700 1 -- 172.21.15.1:0/3251245277 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c00d9c0 con 0x7fde2414b730 2023-11-15T02:53:17.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.303+0000 7fde2afbc700 1 -- 172.21.15.1:0/3251245277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde240c27e0 con 0x7fde2414b730 2023-11-15T02:53:17.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.304+0000 7fde2afbc700 1 -- 172.21.15.1:0/3251245277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde2406c7e0 con 0x7fde2414b730 2023-11-15T02:53:17.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.304+0000 7fde20ff9700 1 -- 172.21.15.1:0/3251245277 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 85) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fde1c011400 con 0x7fde2414b730 2023-11-15T02:53:17.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.305+0000 7fde20ff9700 1 --2- 172.21.15.1:0/3251245277 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fde0805f2c0 0x7fde08061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:17.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.305+0000 7fde20ff9700 1 -- 172.21.15.1:0/3251245277 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7134+0+0 (secure 0 0 0) 0x7fde1c079fa0 con 0x7fde2414b730 2023-11-15T02:53:17.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.305+0000 7fde28d58700 1 --2- 172.21.15.1:0/3251245277 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fde0805f2c0 0x7fde08061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:17.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.306+0000 7fde28d58700 1 --2- 172.21.15.1:0/3251245277 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fde0805f2c0 0x7fde08061780 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fde18009130 tx=0x7fde18015000).ready entity=mgr.8509 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:17.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.309+0000 7fde20ff9700 1 -- 172.21.15.1:0/3251245277 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fde1c047af0 con 0x7fde2414b730 2023-11-15T02:53:17.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.509+0000 7fde2afbc700 1 -- 172.21.15.1:0/3251245277 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fde24148e00 con 0x7fde0805f2c0 2023-11-15T02:53:17.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.513+0000 7fde20ff9700 1 -- 172.21.15.1:0/3251245277 <== mgr.8509 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7fde24148e00 con 0x7fde0805f2c0 2023-11-15T02:53:17.516 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-11-15T02:53:17.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.515+0000 7fde2afbc700 1 -- 172.21.15.1:0/3251245277 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fde0805f2c0 msgr2=0x7fde08061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:17.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.515+0000 7fde2afbc700 1 --2- 172.21.15.1:0/3251245277 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fde0805f2c0 0x7fde08061780 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fde18009130 tx=0x7fde18015000).stop 2023-11-15T02:53:17.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.515+0000 7fde2afbc700 1 -- 172.21.15.1:0/3251245277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde2414b730 msgr2=0x7fde240c22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:17.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.515+0000 7fde2afbc700 1 --2- 172.21.15.1:0/3251245277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde2414b730 0x7fde240c22f0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7fde1c00b810 tx=0x7fde1c009290).stop 2023-11-15T02:53:17.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.515+0000 7fde2afbc700 1 -- 172.21.15.1:0/3251245277 shutdown_connections 2023-11-15T02:53:17.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.515+0000 7fde2afbc700 1 --2- 172.21.15.1:0/3251245277 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fde0805f2c0 0x7fde08061780 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.515+0000 7fde2afbc700 1 --2- 172.21.15.1:0/3251245277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde2414b730 0x7fde240c22f0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.515+0000 7fde2afbc700 1 --2- 172.21.15.1:0/3251245277 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fde240aa040 0x7fde240ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.515+0000 7fde2afbc700 1 --2- 172.21.15.1:0/3251245277 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde2414b350 0x7fde24142d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.515+0000 7fde2afbc700 1 -- 172.21.15.1:0/3251245277 >> 172.21.15.1:0/3251245277 conn(0x7fde24069ee0 msgr2=0x7fde24063fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:17.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.515+0000 7fde2afbc700 1 -- 172.21.15.1:0/3251245277 shutdown_connections 2023-11-15T02:53:17.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.515+0000 7fde2afbc700 1 -- 172.21.15.1:0/3251245277 wait complete. 2023-11-15T02:53:17.529 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-11-15T02:53:17.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:17.530 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-11-15T02:53:17.546 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_38_00_UTC 2023-11-15T02:53:17.547 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_39_00_UTC 2023-11-15T02:53:17.547 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_40_00_UTC 2023-11-15T02:53:17.547 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_41_00_UTC 2023-11-15T02:53:17.547 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_42_00_UTC 2023-11-15T02:53:17.547 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_43_00_UTC 2023-11-15T02:53:17.548 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_44_00_UTC 2023-11-15T02:53:17.548 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_45_00_UTC 2023-11-15T02:53:17.548 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_46_00_UTC 2023-11-15T02:53:17.548 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_47_00_UTC 2023-11-15T02:53:17.548 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_48_00_UTC 2023-11-15T02:53:17.549 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_49_00_UTC 2023-11-15T02:53:17.549 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_50_00_UTC 2023-11-15T02:53:17.549 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_51_00_UTC 2023-11-15T02:53:17.549 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_52_00_UTC 2023-11-15T02:53:17.549 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_53_00_UTC 2023-11-15T02:53:17.550 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-11-15-02_38_00_UTC', 'scheduled-2023-11-15-02_39_00_UTC', 'scheduled-2023-11-15-02_40_00_UTC', 'scheduled-2023-11-15-02_41_00_UTC', 'scheduled-2023-11-15-02_42_00_UTC', 'scheduled-2023-11-15-02_43_00_UTC', 'scheduled-2023-11-15-02_44_00_UTC', 'scheduled-2023-11-15-02_45_00_UTC', 'scheduled-2023-11-15-02_46_00_UTC', 'scheduled-2023-11-15-02_47_00_UTC', 'scheduled-2023-11-15-02_48_00_UTC', 'scheduled-2023-11-15-02_49_00_UTC', 'scheduled-2023-11-15-02_50_00_UTC', 'scheduled-2023-11-15-02_51_00_UTC', 'scheduled-2023-11-15-02_52_00_UTC', 'scheduled-2023-11-15-02_53_00_UTC'] 2023-11-15T02:53:17.550 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-11-15T02:53:17.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.706+0000 7f3bc04f8700 1 Processor -- start 2023-11-15T02:53:17.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.706+0000 7f3bc04f8700 1 -- start start 2023-11-15T02:53:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.707+0000 7f3bc04f8700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3bb80c53b0 0x7f3bb80c3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.707+0000 7f3bc04f8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3bb8064660 0x7f3bb8064ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:17.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.707+0000 7f3bc04f8700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb80835c0 con 0x7f3bb80c7f50 2023-11-15T02:53:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.707+0000 7f3bc04f8700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb80c3a00 con 0x7f3bb80c53b0 2023-11-15T02:53:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.707+0000 7f3bc04f8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80c5790 con 0x7f3bb8064660 2023-11-15T02:53:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.707+0000 7f3bbea95700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3bb8064660 0x7f3bb8064ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.707+0000 7f3bbe294700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3bb80c53b0 0x7f3bb80c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:17.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.707+0000 7f3bbda93700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f3bb80c7f50 0x7f3bb80c83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:45140/0 (socket says 172.21.15.1:45140) 2023-11-15T02:53:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.707+0000 7f3bbda93700 1 -- 172.21.15.1:0/3785708779 learned_addr learned my addr 172.21.15.1:0/3785708779 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.707+0000 7f3bbea95700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3bb8064660 0x7f3bb8064ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:60942/0 (socket says 172.21.15.1:60942) 2023-11-15T02:53:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.707+0000 7f3bbe294700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3bb80c53b0 0x7f3bb80c3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:60632/0 (socket says 172.21.15.1:60632) 2023-11-15T02:53:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.708+0000 7f3bbe294700 1 -- 172.21.15.1:0/3785708779 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3bb8064660 msgr2=0x7f3bb8064ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:17.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.708+0000 7f3bbe294700 1 --2- 172.21.15.1:0/3785708779 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3bb8064660 0x7f3bb8064ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.708+0000 7f3bbe294700 1 -- 172.21.15.1:0/3785708779 >> v1:172.21.15.141:6789/0 conn(0x7f3bb80c7f50 legacy=0x7f3bb80c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.708+0000 7f3bbd292700 1 -- 172.21.15.1:0/3785708779 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079988055 0 0) 0x7f3bb80835c0 con 0x7f3bb80c7f50 2023-11-15T02:53:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.708+0000 7f3bbe294700 1 -- 172.21.15.1:0/3785708779 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb80c6eb0 con 0x7f3bb80c53b0 2023-11-15T02:53:17.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.708+0000 7f3bbea95700 1 --2- 172.21.15.1:0/3785708779 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3bb8064660 0x7f3bb8064ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:53:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.708+0000 7f3bbe294700 1 --2- 172.21.15.1:0/3785708779 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3bb80c53b0 0x7f3bb80c3510 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f3bb0006fd0 tx=0x7f3bb0006f40).ready entity=mon.1 client_cookie=6b090c0891c789fe server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.708+0000 7f3bbd292700 1 -- 172.21.15.1:0/3785708779 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0005880 con 0x7f3bb80c53b0 2023-11-15T02:53:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.708+0000 7f3bbd292700 1 -- 172.21.15.1:0/3785708779 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb00059e0 con 0x7f3bb80c53b0 2023-11-15T02:53:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.708+0000 7f3bbd292700 1 -- 172.21.15.1:0/3785708779 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0005d60 con 0x7f3bb80c53b0 2023-11-15T02:53:17.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.709+0000 7f3bc04f8700 1 -- 172.21.15.1:0/3785708779 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3bb80c53b0 msgr2=0x7f3bb80c3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.709+0000 7f3bc04f8700 1 --2- 172.21.15.1:0/3785708779 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3bb80c53b0 0x7f3bb80c3510 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f3bb0006fd0 tx=0x7f3bb0006f40).stop 2023-11-15T02:53:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.709+0000 7f3bc04f8700 1 -- 172.21.15.1:0/3785708779 shutdown_connections 2023-11-15T02:53:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.709+0000 7f3bc04f8700 1 --2- 172.21.15.1:0/3785708779 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3bb8064660 0x7f3bb8064ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.709+0000 7f3bc04f8700 1 --2- 172.21.15.1:0/3785708779 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3bb80c53b0 0x7f3bb80c3510 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.709+0000 7f3bc04f8700 1 -- 172.21.15.1:0/3785708779 >> 172.21.15.1:0/3785708779 conn(0x7f3bb8082f90 msgr2=0x7f3bb80c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.709+0000 7f3bc04f8700 1 -- 172.21.15.1:0/3785708779 shutdown_connections 2023-11-15T02:53:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.709+0000 7f3bc04f8700 1 -- 172.21.15.1:0/3785708779 wait complete. 2023-11-15T02:53:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.710+0000 7f3bc04f8700 1 Processor -- start 2023-11-15T02:53:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.710+0000 7f3bc04f8700 1 -- start start 2023-11-15T02:53:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bc04f8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3bb8064660 0x7f3bb8165af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bc04f8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bb80c53b0 0x7f3bb80bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bc04f8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3bb80c7f50 0x7f3bb80c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bc04f8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80c1380 con 0x7f3bb80c53b0 2023-11-15T02:53:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bc04f8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80c0800 con 0x7f3bb8064660 2023-11-15T02:53:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bc04f8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80c0ae0 con 0x7f3bb80c7f50 2023-11-15T02:53:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bbda93700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bb80c53b0 0x7f3bb80bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bbda93700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bb80c53b0 0x7f3bb80bffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55372/0 (socket says 172.21.15.1:55372) 2023-11-15T02:53:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bbda93700 1 -- 172.21.15.1:0/914924396 learned_addr learned my addr 172.21.15.1:0/914924396 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bbe294700 1 --2- 172.21.15.1:0/914924396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3bb8064660 0x7f3bb8165af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bbea95700 1 --2- 172.21.15.1:0/914924396 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3bb80c7f50 0x7f3bb80c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:17.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bbda93700 1 -- 172.21.15.1:0/914924396 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3bb80c7f50 msgr2=0x7f3bb80c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:17.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bbda93700 1 --2- 172.21.15.1:0/914924396 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3bb80c7f50 0x7f3bb80c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bbda93700 1 -- 172.21.15.1:0/914924396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3bb8064660 msgr2=0x7f3bb8165af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:17.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bbda93700 1 --2- 172.21.15.1:0/914924396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3bb8064660 0x7f3bb8165af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bbda93700 1 -- 172.21.15.1:0/914924396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba8009a20 con 0x7f3bb80c53b0 2023-11-15T02:53:17.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bbda93700 1 --2- 172.21.15.1:0/914924396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bb80c53b0 0x7f3bb80bffb0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f3bac00c4e0 tx=0x7f3bac007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:17.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.711+0000 7f3bb67fc700 1 -- 172.21.15.1:0/914924396 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0072e0 con 0x7f3bb80c53b0 2023-11-15T02:53:17.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.712+0000 7f3bb67fc700 1 -- 172.21.15.1:0/914924396 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac007440 con 0x7f3bb80c53b0 2023-11-15T02:53:17.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.712+0000 7f3bc04f8700 1 -- 172.21.15.1:0/914924396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb0009250 con 0x7f3bb80c53b0 2023-11-15T02:53:17.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.712+0000 7f3bb67fc700 1 -- 172.21.15.1:0/914924396 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0057a0 con 0x7f3bb80c53b0 2023-11-15T02:53:17.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.712+0000 7f3bc04f8700 1 -- 172.21.15.1:0/914924396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb80c10a0 con 0x7f3bb80c53b0 2023-11-15T02:53:17.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.713+0000 7f3bc04f8700 1 -- 172.21.15.1:0/914924396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb80a8a80 con 0x7f3bb80c53b0 2023-11-15T02:53:17.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.713+0000 7f3bb67fc700 1 -- 172.21.15.1:0/914924396 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 85) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f3bac005bd0 con 0x7f3bb80c53b0 2023-11-15T02:53:17.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.713+0000 7f3bb67fc700 1 --2- 172.21.15.1:0/914924396 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f3ba405f2c0 0x7f3ba4061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:17.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.713+0000 7f3bb67fc700 1 -- 172.21.15.1:0/914924396 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7134+0+0 (secure 0 0 0) 0x7f3bac07a0f0 con 0x7f3bb80c53b0 2023-11-15T02:53:17.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.713+0000 7f3bbe294700 1 --2- 172.21.15.1:0/914924396 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f3ba405f2c0 0x7f3ba4061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:17.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.714+0000 7f3bbe294700 1 --2- 172.21.15.1:0/914924396 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f3ba405f2c0 0x7f3ba4061780 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3bb0006f80 tx=0x7f3bb0016000).ready entity=mgr.8509 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:17.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.717+0000 7f3bb67fc700 1 -- 172.21.15.1:0/914924396 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3bb80a8a80 con 0x7f3bb80c53b0 2023-11-15T02:53:17.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.912+0000 7f3bc04f8700 1 -- 172.21.15.1:0/914924396 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3bb80a8a80 con 0x7f3ba405f2c0 2023-11-15T02:53:17.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.914+0000 7f3bb67fc700 1 -- 172.21.15.1:0/914924396 <== mgr.8509 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7f3bb80a8a80 con 0x7f3ba405f2c0 2023-11-15T02:53:17.916 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:17.917 INFO:teuthology.orchestra.run.smithi001.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T02:37:28", "first": "2023-11-15T02:38:00", "last": "2023-11-15T02:53:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-11-15T02:53:17.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.916+0000 7f3bc04f8700 1 -- 172.21.15.1:0/914924396 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f3ba405f2c0 msgr2=0x7f3ba4061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:17.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.916+0000 7f3bc04f8700 1 --2- 172.21.15.1:0/914924396 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f3ba405f2c0 0x7f3ba4061780 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3bb0006f80 tx=0x7f3bb0016000).stop 2023-11-15T02:53:17.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.916+0000 7f3bc04f8700 1 -- 172.21.15.1:0/914924396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bb80c53b0 msgr2=0x7f3bb80bffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:17.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.916+0000 7f3bc04f8700 1 --2- 172.21.15.1:0/914924396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bb80c53b0 0x7f3bb80bffb0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f3bac00c4e0 tx=0x7f3bac007c70).stop 2023-11-15T02:53:17.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.916+0000 7f3bc04f8700 1 -- 172.21.15.1:0/914924396 shutdown_connections 2023-11-15T02:53:17.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.916+0000 7f3bc04f8700 1 --2- 172.21.15.1:0/914924396 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f3ba405f2c0 0x7f3ba4061780 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.916+0000 7f3bc04f8700 1 --2- 172.21.15.1:0/914924396 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3bb80c7f50 0x7f3bb80c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.916+0000 7f3bc04f8700 1 --2- 172.21.15.1:0/914924396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3bb8064660 0x7f3bb8165af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.916+0000 7f3bc04f8700 1 --2- 172.21.15.1:0/914924396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bb80c53b0 0x7f3bb80bffb0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:17.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.916+0000 7f3bc04f8700 1 -- 172.21.15.1:0/914924396 >> 172.21.15.1:0/914924396 conn(0x7f3bb8082f90 msgr2=0x7f3bb80a7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:17.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.916+0000 7f3bc04f8700 1 -- 172.21.15.1:0/914924396 shutdown_connections 2023-11-15T02:53:17.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:17.916+0000 7f3bc04f8700 1 -- 172.21.15.1:0/914924396 wait complete. 2023-11-15T02:53:17.930 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-11-15T00:00:00", "created": "2023-11-15T02:37:28", "first": "2023-11-15T02:38:00", "last": "2023-11-15T02:53:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-11-15T02:53:17.931 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-11-15T00:00:00', 'created': '2023-11-15T02:37:28', 'first': '2023-11-15T02:38:00', 'last': '2023-11-15T02:53:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-11-15T02:53:17.931 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 16 2023-11-15T02:53:17.931 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 16 2023-11-15T02:53:17.932 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-11-15T02:53:18.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.053+0000 7f905f6e1700 1 Processor -- start 2023-11-15T02:53:18.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.053+0000 7f905f6e1700 1 -- start start 2023-11-15T02:53:18.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.054+0000 7f905f6e1700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9058157660 0x7f9058157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:18.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.054+0000 7f905f6e1700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90580c1820 con 0x7f90580aa060 2023-11-15T02:53:18.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.054+0000 7f905f6e1700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90580c0c30 con 0x7f90580c1cb0 2023-11-15T02:53:18.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.054+0000 7f905f6e1700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90580c7540 con 0x7f9058157660 2023-11-15T02:53:18.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.054+0000 7f905dc7e700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f90580aa060 0x7f90580ab190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57164/0 (socket says 172.21.15.1:57164) 2023-11-15T02:53:18.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.054+0000 7f905dc7e700 1 -- 172.21.15.1:0/245174326 learned_addr learned my addr 172.21.15.1:0/245174326 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:18.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.054+0000 7f905d47d700 1 --2- 172.21.15.1:0/245174326 >> v2:172.21.15.141:3300/0 conn(0x7f9058157660 0x7f9058157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:18.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.055+0000 7f9057fff700 1 -- 172.21.15.1:0/245174326 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561073659 0 0) 0x7f90580c1820 con 0x7f90580aa060 2023-11-15T02:53:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.055+0000 7f9057fff700 1 -- 172.21.15.1:0/245174326 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90400033f0 con 0x7f90580aa060 2023-11-15T02:53:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.055+0000 7f905d47d700 1 -- 172.21.15.1:0/245174326 >> v1:172.21.15.141:6789/0 conn(0x7f90580c1cb0 legacy=0x7f90580c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.055+0000 7f905d47d700 1 -- 172.21.15.1:0/245174326 >> v1:172.21.15.1:6789/0 conn(0x7f90580aa060 legacy=0x7f90580ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.055+0000 7f905d47d700 1 -- 172.21.15.1:0/245174326 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90580c0ef0 con 0x7f9058157660 2023-11-15T02:53:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.055+0000 7f905d47d700 1 --2- 172.21.15.1:0/245174326 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9058157660 0x7f9058157a40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f9050009760 tx=0x7f9050009060).ready entity=mon.1 client_cookie=9527726b4cf67a1d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.055+0000 7f9057fff700 1 -- 172.21.15.1:0/245174326 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90500090d0 con 0x7f9058157660 2023-11-15T02:53:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.055+0000 7f9057fff700 1 -- 172.21.15.1:0/245174326 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905000f510 con 0x7f9058157660 2023-11-15T02:53:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.055+0000 7f9057fff700 1 -- 172.21.15.1:0/245174326 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905000f890 con 0x7f9058157660 2023-11-15T02:53:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.056+0000 7f905f6e1700 1 -- 172.21.15.1:0/245174326 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9058157660 msgr2=0x7f9058157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.056+0000 7f905f6e1700 1 --2- 172.21.15.1:0/245174326 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9058157660 0x7f9058157a40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f9050009760 tx=0x7f9050009060).stop 2023-11-15T02:53:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.056+0000 7f905f6e1700 1 -- 172.21.15.1:0/245174326 shutdown_connections 2023-11-15T02:53:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.056+0000 7f905f6e1700 1 --2- 172.21.15.1:0/245174326 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9058157660 0x7f9058157a40 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.056+0000 7f905f6e1700 1 -- 172.21.15.1:0/245174326 >> 172.21.15.1:0/245174326 conn(0x7f9058064aa0 msgr2=0x7f9058064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.056+0000 7f905f6e1700 1 -- 172.21.15.1:0/245174326 shutdown_connections 2023-11-15T02:53:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.056+0000 7f905f6e1700 1 -- 172.21.15.1:0/245174326 wait complete. 2023-11-15T02:53:18.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.057+0000 7f905f6e1700 1 Processor -- start 2023-11-15T02:53:18.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.057+0000 7f905f6e1700 1 -- start start 2023-11-15T02:53:18.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905f6e1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90580aa060 0x7f905813fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:18.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905f6e1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90580c1cb0 0x7f905813be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:18.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905f6e1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9058157660 0x7f9058152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:18.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905f6e1700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9058140070 con 0x7f90580c1cb0 2023-11-15T02:53:18.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905f6e1700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905814fff0 con 0x7f9058157660 2023-11-15T02:53:18.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905f6e1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90580c4fe0 con 0x7f90580aa060 2023-11-15T02:53:18.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905cc7c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90580c1cb0 0x7f905813be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:18.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905cc7c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90580c1cb0 0x7f905813be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55382/0 (socket says 172.21.15.1:55382) 2023-11-15T02:53:18.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905cc7c700 1 -- 172.21.15.1:0/42387461 learned_addr learned my addr 172.21.15.1:0/42387461 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:18.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905d47d700 1 --2- 172.21.15.1:0/42387461 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90580aa060 0x7f905813fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905dc7e700 1 --2- 172.21.15.1:0/42387461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9058157660 0x7f9058152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905cc7c700 1 -- 172.21.15.1:0/42387461 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90580aa060 msgr2=0x7f905813fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905cc7c700 1 --2- 172.21.15.1:0/42387461 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90580aa060 0x7f905813fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905cc7c700 1 -- 172.21.15.1:0/42387461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9058157660 msgr2=0x7f9058152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905cc7c700 1 --2- 172.21.15.1:0/42387461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9058157660 0x7f9058152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:18.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905cc7c700 1 -- 172.21.15.1:0/42387461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90500092a0 con 0x7f90580c1cb0 2023-11-15T02:53:18.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.058+0000 7f905cc7c700 1 --2- 172.21.15.1:0/42387461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90580c1cb0 0x7f905813be20 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f904c00c4f0 tx=0x7f904c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:18.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.059+0000 7f90557fa700 1 -- 172.21.15.1:0/42387461 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c00ce60 con 0x7f90580c1cb0 2023-11-15T02:53:18.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.059+0000 7f90557fa700 1 -- 172.21.15.1:0/42387461 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c001e90 con 0x7f90580c1cb0 2023-11-15T02:53:18.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.059+0000 7f905f6e1700 1 -- 172.21.15.1:0/42387461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905814f6c0 con 0x7f90580c1cb0 2023-11-15T02:53:18.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.059+0000 7f90557fa700 1 -- 172.21.15.1:0/42387461 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c007270 con 0x7f90580c1cb0 2023-11-15T02:53:18.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.059+0000 7f905f6e1700 1 -- 172.21.15.1:0/42387461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905814fc80 con 0x7f90580c1cb0 2023-11-15T02:53:18.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.060+0000 7f905f6e1700 1 -- 172.21.15.1:0/42387461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9058150180 con 0x7f90580c1cb0 2023-11-15T02:53:18.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.060+0000 7f90557fa700 1 -- 172.21.15.1:0/42387461 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 85) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f904c0066a0 con 0x7f90580c1cb0 2023-11-15T02:53:18.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.060+0000 7f90557fa700 1 --2- 172.21.15.1:0/42387461 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f904405f2c0 0x7f9044061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:18.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.060+0000 7f90557fa700 1 -- 172.21.15.1:0/42387461 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7134+0+0 (secure 0 0 0) 0x7f904c079f90 con 0x7f90580c1cb0 2023-11-15T02:53:18.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.061+0000 7f905d47d700 1 --2- 172.21.15.1:0/42387461 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f904405f2c0 0x7f9044061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:18.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.061+0000 7f905d47d700 1 --2- 172.21.15.1:0/42387461 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f904405f2c0 0x7f9044061780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f9050009760 tx=0x7f9050017000).ready entity=mgr.8509 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:18.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.064+0000 7f90557fa700 1 -- 172.21.15.1:0/42387461 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f904c04ac90 con 0x7f90580c1cb0 2023-11-15T02:53:18.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.260+0000 7f905f6e1700 1 -- 172.21.15.1:0/42387461 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f90580c11d0 con 0x7f904405f2c0 2023-11-15T02:53:18.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.265+0000 7f90557fa700 1 -- 172.21.15.1:0/42387461 <== mgr.8509 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7f90580c11d0 con 0x7f904405f2c0 2023-11-15T02:53:18.268 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-11-15T02:53:18.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.267+0000 7f905f6e1700 1 -- 172.21.15.1:0/42387461 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f904405f2c0 msgr2=0x7f9044061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:18.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.267+0000 7f905f6e1700 1 --2- 172.21.15.1:0/42387461 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f904405f2c0 0x7f9044061780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f9050009760 tx=0x7f9050017000).stop 2023-11-15T02:53:18.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.267+0000 7f905f6e1700 1 -- 172.21.15.1:0/42387461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90580c1cb0 msgr2=0x7f905813be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:18.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.267+0000 7f905f6e1700 1 --2- 172.21.15.1:0/42387461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90580c1cb0 0x7f905813be20 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f904c00c4f0 tx=0x7f904c007e00).stop 2023-11-15T02:53:18.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.267+0000 7f905f6e1700 1 -- 172.21.15.1:0/42387461 shutdown_connections 2023-11-15T02:53:18.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.267+0000 7f905f6e1700 1 --2- 172.21.15.1:0/42387461 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f904405f2c0 0x7f9044061780 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:18.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.267+0000 7f905f6e1700 1 --2- 172.21.15.1:0/42387461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9058157660 0x7f9058152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:18.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.267+0000 7f905f6e1700 1 --2- 172.21.15.1:0/42387461 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90580aa060 0x7f905813fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:18.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.267+0000 7f905f6e1700 1 --2- 172.21.15.1:0/42387461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90580c1cb0 0x7f905813be20 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:18.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.267+0000 7f905f6e1700 1 -- 172.21.15.1:0/42387461 >> 172.21.15.1:0/42387461 conn(0x7f9058064aa0 msgr2=0x7f9058154ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:18.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.267+0000 7f905f6e1700 1 -- 172.21.15.1:0/42387461 shutdown_connections 2023-11-15T02:53:18.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:18.267+0000 7f905f6e1700 1 -- 172.21.15.1:0/42387461 wait complete. 2023-11-15T02:53:18.281 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-11-15T02:53:18.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:18.282 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-11-15T02:53:18.298 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_38_00_UTC 2023-11-15T02:53:18.298 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_39_00_UTC 2023-11-15T02:53:18.298 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_40_00_UTC 2023-11-15T02:53:18.299 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_41_00_UTC 2023-11-15T02:53:18.299 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_42_00_UTC 2023-11-15T02:53:18.299 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_43_00_UTC 2023-11-15T02:53:18.299 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_44_00_UTC 2023-11-15T02:53:18.299 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_45_00_UTC 2023-11-15T02:53:18.300 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_46_00_UTC 2023-11-15T02:53:18.300 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_47_00_UTC 2023-11-15T02:53:18.300 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_48_00_UTC 2023-11-15T02:53:18.300 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_49_00_UTC 2023-11-15T02:53:18.300 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_50_00_UTC 2023-11-15T02:53:18.301 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_51_00_UTC 2023-11-15T02:53:18.301 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_52_00_UTC 2023-11-15T02:53:18.301 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_53_00_UTC 2023-11-15T02:53:18.301 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_38_00_UTC 2023-11-15T02:53:18.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:18.302 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_38_00_UTC) 2023-11-15T02:53:18.360 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_39_00_UTC 2023-11-15T02:53:18.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:18.361 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_39_00_UTC) 2023-11-15T02:53:18.422 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_40_00_UTC 2023-11-15T02:53:18.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:18.423 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_40_00_UTC) 2023-11-15T02:53:18.483 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_41_00_UTC 2023-11-15T02:53:18.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:18.484 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_41_00_UTC) 2023-11-15T02:53:18.546 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_42_00_UTC 2023-11-15T02:53:18.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:18.547 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_42_00_UTC) 2023-11-15T02:53:18.611 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_43_00_UTC 2023-11-15T02:53:18.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:18.612 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_43_00_UTC) 2023-11-15T02:53:18.677 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_44_00_UTC 2023-11-15T02:53:18.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:18.678 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_44_00_UTC) 2023-11-15T02:53:18.743 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_45_00_UTC 2023-11-15T02:53:18.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:18.744 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_45_00_UTC) 2023-11-15T02:53:18.804 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_46_00_UTC 2023-11-15T02:53:18.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:18.804 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_46_00_UTC) 2023-11-15T02:53:18.864 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_47_00_UTC 2023-11-15T02:53:18.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:18.865 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_47_00_UTC) 2023-11-15T02:53:18.928 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_48_00_UTC 2023-11-15T02:53:18.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:18.929 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_48_00_UTC) 2023-11-15T02:53:18.988 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_49_00_UTC 2023-11-15T02:53:18.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:18.989 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_49_00_UTC) 2023-11-15T02:53:19.049 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_50_00_UTC 2023-11-15T02:53:19.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:19.050 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_50_00_UTC) 2023-11-15T02:53:19.110 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_51_00_UTC 2023-11-15T02:53:19.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:19.111 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_51_00_UTC) 2023-11-15T02:53:19.172 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_52_00_UTC 2023-11-15T02:53:19.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:19.172 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_52_00_UTC) 2023-11-15T02:53:19.232 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_53_00_UTC 2023-11-15T02:53:19.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:19.233 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-11-15-02_53_00_UTC) 2023-11-15T02:53:19.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:19.294 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-11-15T02:53:19.352 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-15T02:53:19.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.508+0000 7ff8bbc6b700 1 Processor -- start 2023-11-15T02:53:19.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.509+0000 7ff8bbc6b700 1 -- start start 2023-11-15T02:53:19.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.509+0000 7ff8bbc6b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff8b41540a0 0x7ff8b40ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:19.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.509+0000 7ff8bbc6b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b4154480 0x7ff8b40ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:19.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.509+0000 7ff8bbc6b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff8b40c5f40 0x7ff8b40c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:19.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.509+0000 7ff8bbc6b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b40ca050 con 0x7ff8b41540a0 2023-11-15T02:53:19.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.509+0000 7ff8bbc6b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b40c68c0 con 0x7ff8b40c5f40 2023-11-15T02:53:19.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.509+0000 7ff8bbc6b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40c9440 con 0x7ff8b4154480 2023-11-15T02:53:19.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.510+0000 7ff8b9a07700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff8b41540a0 0x7ff8b40ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:19.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.510+0000 7ff8b9a07700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff8b41540a0 0x7ff8b40ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55386/0 (socket says 172.21.15.1:55386) 2023-11-15T02:53:19.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.510+0000 7ff8b9a07700 1 -- 172.21.15.1:0/1819942570 learned_addr learned my addr 172.21.15.1:0/1819942570 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:19.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.510+0000 7ff8b9206700 1 --2- 172.21.15.1:0/1819942570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b4154480 0x7ff8b40ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:19.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.510+0000 7ff8ba208700 1 --2- 172.21.15.1:0/1819942570 >> v2:172.21.15.141:3300/0 conn(0x7ff8b40c5f40 0x7ff8b40c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:19.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.510+0000 7ff8b9a07700 1 -- 172.21.15.1:0/1819942570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b4154480 msgr2=0x7ff8b40ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:19.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.510+0000 7ff8b9a07700 1 --2- 172.21.15.1:0/1819942570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b4154480 0x7ff8b40ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:19.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.510+0000 7ff8b9a07700 1 -- 172.21.15.1:0/1819942570 >> v2:172.21.15.141:3300/0 conn(0x7ff8b40c5f40 msgr2=0x7ff8b40c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:19.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.510+0000 7ff8b9a07700 1 --2- 172.21.15.1:0/1819942570 >> v2:172.21.15.141:3300/0 conn(0x7ff8b40c5f40 0x7ff8b40c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:19.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.510+0000 7ff8b9a07700 1 -- 172.21.15.1:0/1819942570 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b40c9720 con 0x7ff8b41540a0 2023-11-15T02:53:19.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.510+0000 7ff8b9206700 1 --2- 172.21.15.1:0/1819942570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b4154480 0x7ff8b40ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:53:19.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.510+0000 7ff8b9a07700 1 --2- 172.21.15.1:0/1819942570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b41540a0 0x7ff8b40ca4e0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7ff8b40aad10 tx=0x7ff8ac0090f0).ready entity=mon.0 client_cookie=c71634c2696e246d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:19.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.510+0000 7ff8b8a05700 1 -- 172.21.15.1:0/1819942570 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac00b520 con 0x7ff8b41540a0 2023-11-15T02:53:19.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.510+0000 7ff8b8a05700 1 -- 172.21.15.1:0/1819942570 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ac00b680 con 0x7ff8b41540a0 2023-11-15T02:53:19.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.510+0000 7ff8b8a05700 1 -- 172.21.15.1:0/1819942570 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac00ba00 con 0x7ff8b41540a0 2023-11-15T02:53:19.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.511+0000 7ff8bbc6b700 1 -- 172.21.15.1:0/1819942570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b41540a0 msgr2=0x7ff8b40ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:19.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.511+0000 7ff8bbc6b700 1 --2- 172.21.15.1:0/1819942570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b41540a0 0x7ff8b40ca4e0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7ff8b40aad10 tx=0x7ff8ac0090f0).stop 2023-11-15T02:53:19.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.511+0000 7ff8bbc6b700 1 -- 172.21.15.1:0/1819942570 shutdown_connections 2023-11-15T02:53:19.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.511+0000 7ff8bbc6b700 1 --2- 172.21.15.1:0/1819942570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b41540a0 0x7ff8b40ca4e0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:19.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.511+0000 7ff8bbc6b700 1 --2- 172.21.15.1:0/1819942570 >> v2:172.21.15.141:3300/0 conn(0x7ff8b40c5f40 0x7ff8b40c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:19.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.511+0000 7ff8bbc6b700 1 --2- 172.21.15.1:0/1819942570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b4154480 0x7ff8b40ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:19.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.511+0000 7ff8bbc6b700 1 -- 172.21.15.1:0/1819942570 >> 172.21.15.1:0/1819942570 conn(0x7ff8b4064a70 msgr2=0x7ff8b4064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:19.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.511+0000 7ff8bbc6b700 1 -- 172.21.15.1:0/1819942570 shutdown_connections 2023-11-15T02:53:19.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.511+0000 7ff8bbc6b700 1 -- 172.21.15.1:0/1819942570 wait complete. 2023-11-15T02:53:19.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.512+0000 7ff8bbc6b700 1 Processor -- start 2023-11-15T02:53:19.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.512+0000 7ff8bbc6b700 1 -- start start 2023-11-15T02:53:19.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8bbc6b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b40c5f40 0x7ff8b41688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:19.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8bbc6b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b41540a0 0x7ff8b414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:19.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8bbc6b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b4154480 0x7ff8b40af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:19.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8bbc6b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4168420 con 0x7ff8b41540a0 2023-11-15T02:53:19.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8bbc6b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4156f70 con 0x7ff8b40c5f40 2023-11-15T02:53:19.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8bbc6b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4159a10 con 0x7ff8b4154480 2023-11-15T02:53:19.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8b9206700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b41540a0 0x7ff8b414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:19.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8b9206700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b41540a0 0x7ff8b414fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55390/0 (socket says 172.21.15.1:55390) 2023-11-15T02:53:19.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8b9206700 1 -- 172.21.15.1:0/3681841058 learned_addr learned my addr 172.21.15.1:0/3681841058 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:19.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8ba208700 1 --2- 172.21.15.1:0/3681841058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b4154480 0x7ff8b40af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:19.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8b9a07700 1 --2- 172.21.15.1:0/3681841058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b40c5f40 0x7ff8b41688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:19.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8b9206700 1 -- 172.21.15.1:0/3681841058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b4154480 msgr2=0x7ff8b40af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:19.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8b9206700 1 --2- 172.21.15.1:0/3681841058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b4154480 0x7ff8b40af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:19.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8b9206700 1 -- 172.21.15.1:0/3681841058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b40c5f40 msgr2=0x7ff8b41688b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:19.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8b9206700 1 --2- 172.21.15.1:0/3681841058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b40c5f40 0x7ff8b41688b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:19.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8b9206700 1 -- 172.21.15.1:0/3681841058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac009370 con 0x7ff8b41540a0 2023-11-15T02:53:19.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8b9a07700 1 --2- 172.21.15.1:0/3681841058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b40c5f40 0x7ff8b41688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:53:19.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.513+0000 7ff8b9206700 1 --2- 172.21.15.1:0/3681841058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b41540a0 0x7ff8b414fb20 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7ff8a800d890 tx=0x7ff8a8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:19.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.514+0000 7ff8b1ffb700 1 -- 172.21.15.1:0/3681841058 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8011590 con 0x7ff8b41540a0 2023-11-15T02:53:19.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.514+0000 7ff8b1ffb700 1 -- 172.21.15.1:0/3681841058 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a80116f0 con 0x7ff8b41540a0 2023-11-15T02:53:19.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.514+0000 7ff8bbc6b700 1 -- 172.21.15.1:0/3681841058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b4159cf0 con 0x7ff8b41540a0 2023-11-15T02:53:19.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.514+0000 7ff8b1ffb700 1 -- 172.21.15.1:0/3681841058 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8011a70 con 0x7ff8b41540a0 2023-11-15T02:53:19.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.514+0000 7ff8bbc6b700 1 -- 172.21.15.1:0/3681841058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b4168da0 con 0x7ff8b41540a0 2023-11-15T02:53:19.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.515+0000 7ff8bbc6b700 1 -- 172.21.15.1:0/3681841058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b4167f10 con 0x7ff8b41540a0 2023-11-15T02:53:19.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.515+0000 7ff8b1ffb700 1 -- 172.21.15.1:0/3681841058 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 85) v1 ==== 75577+0+0 (secure 0 0 0) 0x7ff8a801c460 con 0x7ff8b41540a0 2023-11-15T02:53:19.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.516+0000 7ff8b1ffb700 1 --2- 172.21.15.1:0/3681841058 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff8a005f290 0x7ff8a0061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:19.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.516+0000 7ff8b1ffb700 1 -- 172.21.15.1:0/3681841058 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7134+0+0 (secure 0 0 0) 0x7ff8a807a7e0 con 0x7ff8b41540a0 2023-11-15T02:53:19.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.516+0000 7ff8b9a07700 1 --2- 172.21.15.1:0/3681841058 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff8a005f290 0x7ff8a0061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:19.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.516+0000 7ff8b9a07700 1 --2- 172.21.15.1:0/3681841058 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff8a005f290 0x7ff8a0061750 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff8ac009130 tx=0x7ff8ac017000).ready entity=mgr.8509 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:19.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.520+0000 7ff8b1ffb700 1 -- 172.21.15.1:0/3681841058 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff8b4167f10 con 0x7ff8b41540a0 2023-11-15T02:53:19.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:19.740+0000 7ff8bbc6b700 1 -- 172.21.15.1:0/3681841058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7ff8b4167f10 con 0x7ff8b41540a0 2023-11-15T02:53:20.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.252+0000 7ff8b1ffb700 1 -- 172.21.15.1:0/3681841058 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7ff8a8077f80 con 0x7ff8b41540a0 2023-11-15T02:53:20.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.253+0000 7ff8b1ffb700 1 -- 172.21.15.1:0/3681841058 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v86) v1 ==== 93+0+0 (secure 0 0 0) 0x7ff8a8072810 con 0x7ff8b41540a0 2023-11-15T02:53:20.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.255+0000 7ff8bbc6b700 1 -- 172.21.15.1:0/3681841058 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff8a005f290 msgr2=0x7ff8a0061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.255+0000 7ff8bbc6b700 1 --2- 172.21.15.1:0/3681841058 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff8a005f290 0x7ff8a0061750 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff8ac009130 tx=0x7ff8ac017000).stop 2023-11-15T02:53:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.255+0000 7ff8bbc6b700 1 -- 172.21.15.1:0/3681841058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b41540a0 msgr2=0x7ff8b414fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.255+0000 7ff8bbc6b700 1 --2- 172.21.15.1:0/3681841058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b41540a0 0x7ff8b414fb20 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7ff8a800d890 tx=0x7ff8a8008040).stop 2023-11-15T02:53:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.255+0000 7ff8bbc6b700 1 -- 172.21.15.1:0/3681841058 shutdown_connections 2023-11-15T02:53:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.255+0000 7ff8bbc6b700 1 --2- 172.21.15.1:0/3681841058 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff8a005f290 0x7ff8a0061750 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.255+0000 7ff8bbc6b700 1 --2- 172.21.15.1:0/3681841058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b4154480 0x7ff8b40af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.255+0000 7ff8bbc6b700 1 --2- 172.21.15.1:0/3681841058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b40c5f40 0x7ff8b41688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.255+0000 7ff8bbc6b700 1 --2- 172.21.15.1:0/3681841058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b41540a0 0x7ff8b414fb20 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.255+0000 7ff8bbc6b700 1 -- 172.21.15.1:0/3681841058 >> 172.21.15.1:0/3681841058 conn(0x7ff8b4064a70 msgr2=0x7ff8b40aaf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:20.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.255+0000 7ff8bbc6b700 1 -- 172.21.15.1:0/3681841058 shutdown_connections 2023-11-15T02:53:20.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.255+0000 7ff8bbc6b700 1 -- 172.21.15.1:0/3681841058 wait complete. 2023-11-15T02:53:20.270 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T02:53:20.271 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:53:20.319 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:53:20.364 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T02:53:20.364 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-15T02:53:20.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:20.365 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-15T02:53:20.401 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:20.399+0000 7f1d16738680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:53:20.406 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:20.404+0000 7f689ce92680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:53:20.408 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T02:53:20.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:53:20.409 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-15T02:53:20.463 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:53:20.467 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:20.466+0000 7f689ce92680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:53:20.469 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:20.467+0000 7f1d16738680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:53:20.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.588+0000 7f200e4c7700 1 Processor -- start 2023-11-15T02:53:20.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.588+0000 7f200e4c7700 1 -- start start 2023-11-15T02:53:20.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.589+0000 7f200e4c7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f20080ab1a0 0x7f2008154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:20.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.589+0000 7f200e4c7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f20080aa060 0x7f20080c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:20.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.589+0000 7f200e4c7700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20080c06f0 con 0x7f2008154150 2023-11-15T02:53:20.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.589+0000 7f200e4c7700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20080c09d0 con 0x7f20080ab1a0 2023-11-15T02:53:20.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.589+0000 7f200e4c7700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2008158820 con 0x7f20080aa060 2023-11-15T02:53:20.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.589+0000 7f20077fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f20080ab1a0 0x7f2008154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:20.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.589+0000 7f20077fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f20080ab1a0 0x7f2008154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55412/0 (socket says 172.21.15.1:55412) 2023-11-15T02:53:20.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.589+0000 7f20077fe700 1 -- 172.21.15.1:0/2195812484 learned_addr learned my addr 172.21.15.1:0/2195812484 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:20.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.590+0000 7f200ca64700 1 --2- 172.21.15.1:0/2195812484 >> v2:172.21.15.141:3300/0 conn(0x7f20080aa060 0x7f20080c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:20.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.590+0000 7f20077fe700 1 -- 172.21.15.1:0/2195812484 >> v2:172.21.15.141:3300/0 conn(0x7f20080aa060 msgr2=0x7f20080c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:20.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.590+0000 7f20077fe700 1 --2- 172.21.15.1:0/2195812484 >> v2:172.21.15.141:3300/0 conn(0x7f20080aa060 0x7f20080c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:20.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.590+0000 7f20077fe700 1 -- 172.21.15.1:0/2195812484 >> v1:172.21.15.141:6789/0 conn(0x7f2008154150 legacy=0x7f2008158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:20.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.590+0000 7f20077fe700 1 -- 172.21.15.1:0/2195812484 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2008158b00 con 0x7f20080ab1a0 2023-11-15T02:53:20.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.590+0000 7f20077fe700 1 --2- 172.21.15.1:0/2195812484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20080ab1a0 0x7f2008154530 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f2008157f80 tx=0x7f1ff00090f0).ready entity=mon.0 client_cookie=b379175757f54b14 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:20.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.590+0000 7f2006ffd700 1 -- 172.21.15.1:0/2195812484 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000b600 con 0x7f20080ab1a0 2023-11-15T02:53:20.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.590+0000 7f2006ffd700 1 -- 172.21.15.1:0/2195812484 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff000b760 con 0x7f20080ab1a0 2023-11-15T02:53:20.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.590+0000 7f2006ffd700 1 -- 172.21.15.1:0/2195812484 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000bb00 con 0x7f20080ab1a0 2023-11-15T02:53:20.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.590+0000 7f200e4c7700 1 -- 172.21.15.1:0/2195812484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20080ab1a0 msgr2=0x7f2008154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:20.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.590+0000 7f200e4c7700 1 --2- 172.21.15.1:0/2195812484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20080ab1a0 0x7f2008154530 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f2008157f80 tx=0x7f1ff00090f0).stop 2023-11-15T02:53:20.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.591+0000 7f200e4c7700 1 -- 172.21.15.1:0/2195812484 shutdown_connections 2023-11-15T02:53:20.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.591+0000 7f200e4c7700 1 --2- 172.21.15.1:0/2195812484 >> v2:172.21.15.141:3300/0 conn(0x7f20080aa060 0x7f20080c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:20.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.591+0000 7f200e4c7700 1 --2- 172.21.15.1:0/2195812484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20080ab1a0 0x7f2008154530 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:20.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.591+0000 7f200e4c7700 1 -- 172.21.15.1:0/2195812484 >> 172.21.15.1:0/2195812484 conn(0x7f2008064aa0 msgr2=0x7f2008064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:20.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.591+0000 7f200e4c7700 1 -- 172.21.15.1:0/2195812484 shutdown_connections 2023-11-15T02:53:20.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.591+0000 7f200e4c7700 1 -- 172.21.15.1:0/2195812484 wait complete. 2023-11-15T02:53:20.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.592+0000 7f200e4c7700 1 Processor -- start 2023-11-15T02:53:20.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.592+0000 7f200e4c7700 1 -- start start 2023-11-15T02:53:20.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f200e4c7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20080aa060 0x7f2008144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:20.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f200e4c7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20080ab1a0 0x7f20080b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:20.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f200e4c7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2008154150 0x7f20080ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:20.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f200e4c7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20080af0f0 con 0x7f2008154150 2023-11-15T02:53:20.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f200e4c7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20080afe00 con 0x7f20080ab1a0 2023-11-15T02:53:20.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f200e4c7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20080aee10 con 0x7f20080aa060 2023-11-15T02:53:20.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f200ca64700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2008154150 0x7f20080ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:20.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f200ca64700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2008154150 0x7f20080ab880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55418/0 (socket says 172.21.15.1:55418) 2023-11-15T02:53:20.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f2007fff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20080aa060 0x7f2008144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:20.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f200ca64700 1 -- 172.21.15.1:0/4121159234 learned_addr learned my addr 172.21.15.1:0/4121159234 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:20.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f20077fe700 1 --2- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20080ab1a0 0x7f20080b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:20.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f200ca64700 1 -- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20080aa060 msgr2=0x7f2008144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:20.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f200ca64700 1 --2- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20080aa060 0x7f2008144620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:20.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f200ca64700 1 -- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20080ab1a0 msgr2=0x7f20080b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:20.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f200ca64700 1 --2- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20080ab1a0 0x7f20080b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:20.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f200ca64700 1 -- 172.21.15.1:0/4121159234 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff0009370 con 0x7f2008154150 2023-11-15T02:53:20.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f2007fff700 1 --2- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20080aa060 0x7f2008144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:53:20.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f20077fe700 1 --2- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20080ab1a0 0x7f20080b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:53:20.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.593+0000 7f200ca64700 1 --2- 172.21.15.1:0/4121159234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2008154150 0x7f20080ab880 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f2000009fa0 tx=0x7f2000009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:20.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.594+0000 7f1ffffff700 1 -- 172.21.15.1:0/4121159234 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200000ebc0 con 0x7f2008154150 2023-11-15T02:53:20.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.594+0000 7f1ffffff700 1 -- 172.21.15.1:0/4121159234 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200000ed20 con 0x7f2008154150 2023-11-15T02:53:20.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.594+0000 7f1ffffff700 1 -- 172.21.15.1:0/4121159234 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2000014610 con 0x7f2008154150 2023-11-15T02:53:20.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.594+0000 7f200e4c7700 1 -- 172.21.15.1:0/4121159234 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20080b00a0 con 0x7f2008154150 2023-11-15T02:53:20.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.594+0000 7f200e4c7700 1 -- 172.21.15.1:0/4121159234 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2008144b10 con 0x7f2008154150 2023-11-15T02:53:20.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.595+0000 7f200e4c7700 1 -- 172.21.15.1:0/4121159234 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200806c7e0 con 0x7f2008154150 2023-11-15T02:53:20.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.595+0000 7f1ffffff700 1 -- 172.21.15.1:0/4121159234 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f20000149c0 con 0x7f2008154150 2023-11-15T02:53:20.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.596+0000 7f1ffffff700 1 --2- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1fe805f270 0x7f1fe8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:20.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.596+0000 7f2007fff700 1 -- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1fe805f270 msgr2=0x7f1fe8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:20.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.596+0000 7f1ffffff700 1 -- 172.21.15.1:0/4121159234 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7134+0+0 (secure 0 0 0) 0x7f200007abe0 con 0x7f2008154150 2023-11-15T02:53:20.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.596+0000 7f2007fff700 1 --2- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1fe805f270 0x7f1fe8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:53:20.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.600+0000 7f1ffffff700 1 -- 172.21.15.1:0/4121159234 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f200004b8e0 con 0x7f2008154150 2023-11-15T02:53:20.740 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:20.739+0000 7f689ce92680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:53:20.763 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:20.761+0000 7f1d16738680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:53:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.797+0000 7f2007fff700 1 -- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1fe805f270 msgr2=0x7f1fe8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.797+0000 7f2007fff700 1 --2- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1fe805f270 0x7f1fe8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:53:20.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.819+0000 7f200e4c7700 1 -- 172.21.15.1:0/4121159234 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20080c02a0 con 0x7f2008154150 2023-11-15T02:53:20.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.820+0000 7f1ffffff700 1 -- 172.21.15.1:0/4121159234 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f200004ef00 con 0x7f2008154150 2023-11-15T02:53:20.822 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:20.823 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3282299930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3282299930},{"type":"v1","addr":"172.21.15.141:6837","nonce":3282299930}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":8281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3059700101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3059700101},{"type":"v1","addr":"172.21.15.141:6836","nonce":3059700101}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9057,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2954825492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2954825492},{"type":"v1","addr":"172.21.15.1:6834","nonce":2954825492}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:37:11.505391+0000","modified":"2023-11-15T02:37:14.517313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9060":{"gid":9060,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3330049946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3330049946},{"type":"v1","addr":"172.21.15.1:6835","nonce":3330049946}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-11-15T02:53:20.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.822+0000 7f200e4c7700 1 -- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1fe805f270 msgr2=0x7f1fe8061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:53:20.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.822+0000 7f200e4c7700 1 --2- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1fe805f270 0x7f1fe8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:20.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.822+0000 7f200e4c7700 1 -- 172.21.15.1:0/4121159234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2008154150 msgr2=0x7f20080ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:20.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.822+0000 7f200e4c7700 1 --2- 172.21.15.1:0/4121159234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2008154150 0x7f20080ab880 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f2000009fa0 tx=0x7f2000009900).stop 2023-11-15T02:53:20.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.822+0000 7f200e4c7700 1 -- 172.21.15.1:0/4121159234 shutdown_connections 2023-11-15T02:53:20.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.822+0000 7f200e4c7700 1 --2- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1fe805f270 0x7f1fe8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:20.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.822+0000 7f200e4c7700 1 --2- 172.21.15.1:0/4121159234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2008154150 0x7f20080ab880 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:20.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.822+0000 7f200e4c7700 1 --2- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f20080aa060 0x7f2008144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:20.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.822+0000 7f200e4c7700 1 --2- 172.21.15.1:0/4121159234 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20080ab1a0 0x7f20080b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:20.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.822+0000 7f200e4c7700 1 -- 172.21.15.1:0/4121159234 >> 172.21.15.1:0/4121159234 conn(0x7f2008064aa0 msgr2=0x7f2008063e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:20.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.822+0000 7f200e4c7700 1 -- 172.21.15.1:0/4121159234 shutdown_connections 2023-11-15T02:53:20.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.822+0000 7f200e4c7700 1 -- 172.21.15.1:0/4121159234 wait complete. 2023-11-15T02:53:20.827 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 79 2023-11-15T02:53:20.837 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:53:20.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.955+0000 7f294188b700 1 Processor -- start 2023-11-15T02:53:20.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.955+0000 7f294188b700 1 -- start start 2023-11-15T02:53:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.956+0000 7f294188b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f293c151e10 0x7f293c155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.956+0000 7f294188b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293c0c7980 con 0x7f293c0c98b0 2023-11-15T02:53:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.956+0000 7f294188b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293c0c8b10 con 0x7f293c0c86b0 2023-11-15T02:53:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.956+0000 7f294188b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293c0aa890 con 0x7f293c151e10 2023-11-15T02:53:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.956+0000 7f294108a700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f293c0c98b0 0x7f293c0c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57172/0 (socket says 172.21.15.1:57172) 2023-11-15T02:53:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.956+0000 7f294108a700 1 -- 172.21.15.1:0/1193898598 learned_addr learned my addr 172.21.15.1:0/1193898598 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:20.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.956+0000 7f2940889700 1 --2- 172.21.15.1:0/1193898598 >> v2:172.21.15.141:3300/0 conn(0x7f293c151e10 0x7f293c155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:20.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.957+0000 7f293b7fe700 1 -- 172.21.15.1:0/1193898598 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208686510 0 0) 0x7f293c0c7980 con 0x7f293c0c98b0 2023-11-15T02:53:20.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.957+0000 7f293b7fe700 1 -- 172.21.15.1:0/1193898598 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f292c0033f0 con 0x7f293c0c98b0 2023-11-15T02:53:20.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.957+0000 7f2940889700 1 -- 172.21.15.1:0/1193898598 >> v1:172.21.15.141:6789/0 conn(0x7f293c0c86b0 legacy=0x7f293c0aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:20.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.957+0000 7f2940889700 1 -- 172.21.15.1:0/1193898598 >> v1:172.21.15.1:6789/0 conn(0x7f293c0c98b0 legacy=0x7f293c0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:20.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.957+0000 7f2940889700 1 -- 172.21.15.1:0/1193898598 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c0c7bd0 con 0x7f293c151e10 2023-11-15T02:53:20.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.957+0000 7f2940889700 1 --2- 172.21.15.1:0/1193898598 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f293c151e10 0x7f293c155530 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f2930009760 tx=0x7f2930009060).ready entity=mon.1 client_cookie=c9864530f63b725e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:20.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.957+0000 7f293b7fe700 1 -- 172.21.15.1:0/1193898598 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293000f510 con 0x7f293c151e10 2023-11-15T02:53:20.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.957+0000 7f293b7fe700 1 -- 172.21.15.1:0/1193898598 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293000f670 con 0x7f293c151e10 2023-11-15T02:53:20.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.957+0000 7f293b7fe700 1 -- 172.21.15.1:0/1193898598 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293000f9f0 con 0x7f293c151e10 2023-11-15T02:53:20.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.957+0000 7f294188b700 1 -- 172.21.15.1:0/1193898598 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f293c151e10 msgr2=0x7f293c155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:20.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.957+0000 7f294188b700 1 --2- 172.21.15.1:0/1193898598 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f293c151e10 0x7f293c155530 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f2930009760 tx=0x7f2930009060).stop 2023-11-15T02:53:20.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.957+0000 7f294188b700 1 -- 172.21.15.1:0/1193898598 shutdown_connections 2023-11-15T02:53:20.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.957+0000 7f294188b700 1 --2- 172.21.15.1:0/1193898598 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f293c151e10 0x7f293c155530 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:20.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.957+0000 7f294188b700 1 -- 172.21.15.1:0/1193898598 >> 172.21.15.1:0/1193898598 conn(0x7f293c0947e0 msgr2=0x7f293c06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:20.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.958+0000 7f294188b700 1 -- 172.21.15.1:0/1193898598 shutdown_connections 2023-11-15T02:53:20.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.958+0000 7f294188b700 1 -- 172.21.15.1:0/1193898598 wait complete. 2023-11-15T02:53:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.959+0000 7f294188b700 1 Processor -- start 2023-11-15T02:53:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.959+0000 7f294188b700 1 -- start start 2023-11-15T02:53:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f294188b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f293c0c86b0 0x7f293c0af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f294188b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f293c0c98b0 0x7f293c0b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:20.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f294188b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f293c151e10 0x7f293c14eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:20.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f294188b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c0af620 con 0x7f293c0c86b0 2023-11-15T02:53:20.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f294188b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c0b1120 con 0x7f293c0c98b0 2023-11-15T02:53:20.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f294188b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c0b0900 con 0x7f293c151e10 2023-11-15T02:53:20.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f2940889700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f293c0c86b0 0x7f293c0af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:20.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f2940889700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f293c0c86b0 0x7f293c0af130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55428/0 (socket says 172.21.15.1:55428) 2023-11-15T02:53:20.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f2940889700 1 -- 172.21.15.1:0/1118304681 learned_addr learned my addr 172.21.15.1:0/1118304681 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:20.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f293bfff700 1 --2- 172.21.15.1:0/1118304681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f293c0c98b0 0x7f293c0b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:20.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f294108a700 1 --2- 172.21.15.1:0/1118304681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f293c151e10 0x7f293c14eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:20.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f2940889700 1 -- 172.21.15.1:0/1118304681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f293c151e10 msgr2=0x7f293c14eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:20.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f2940889700 1 --2- 172.21.15.1:0/1118304681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f293c151e10 0x7f293c14eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:20.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f2940889700 1 -- 172.21.15.1:0/1118304681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f293c0c98b0 msgr2=0x7f293c0b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:20.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f2940889700 1 --2- 172.21.15.1:0/1118304681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f293c0c98b0 0x7f293c0b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:20.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f2940889700 1 -- 172.21.15.1:0/1118304681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29300092a0 con 0x7f293c0c86b0 2023-11-15T02:53:20.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f2940889700 1 --2- 172.21.15.1:0/1118304681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f293c0c86b0 0x7f293c0af130 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f2930009e00 tx=0x7f2930017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:20.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f2938ff9700 1 -- 172.21.15.1:0/1118304681 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293000f7e0 con 0x7f293c0c86b0 2023-11-15T02:53:20.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f2938ff9700 1 -- 172.21.15.1:0/1118304681 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293000f940 con 0x7f293c0c86b0 2023-11-15T02:53:20.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f294188b700 1 -- 172.21.15.1:0/1118304681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293c0b0b60 con 0x7f293c0c86b0 2023-11-15T02:53:20.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f2938ff9700 1 -- 172.21.15.1:0/1118304681 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293001b690 con 0x7f293c0c86b0 2023-11-15T02:53:20.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.960+0000 7f294188b700 1 -- 172.21.15.1:0/1118304681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293c0b0ef0 con 0x7f293c0c86b0 2023-11-15T02:53:20.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.962+0000 7f294188b700 1 -- 172.21.15.1:0/1118304681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293c0475e0 con 0x7f293c0c86b0 2023-11-15T02:53:20.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.962+0000 7f2938ff9700 1 -- 172.21.15.1:0/1118304681 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f293001ba00 con 0x7f293c0c86b0 2023-11-15T02:53:20.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.962+0000 7f2938ff9700 1 --2- 172.21.15.1:0/1118304681 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f292005f240 0x7f2920061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:20.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.962+0000 7f2938ff9700 1 -- 172.21.15.1:0/1118304681 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7134+0+0 (secure 0 0 0) 0x7f293007bd00 con 0x7f293c0c86b0 2023-11-15T02:53:20.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.962+0000 7f293bfff700 1 -- 172.21.15.1:0/1118304681 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f292005f240 msgr2=0x7f2920061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:20.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.962+0000 7f293bfff700 1 --2- 172.21.15.1:0/1118304681 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f292005f240 0x7f2920061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:53:20.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:20.966+0000 7f2938ff9700 1 -- 172.21.15.1:0/1118304681 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f293004ca60 con 0x7f293c0c86b0 2023-11-15T02:53:21.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.142+0000 7f294188b700 1 -- 172.21.15.1:0/1118304681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f293c0c7eb0 con 0x7f293c0c86b0 2023-11-15T02:53:21.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.143+0000 7f2938ff9700 1 -- 172.21.15.1:0/1118304681 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+18419 (secure 0 0 0) 0x7f293001bcb0 con 0x7f293c0c86b0 2023-11-15T02:53:21.145 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:21.145 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":181,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:48:21.409230+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:37:09.163204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-11-15T02:37:10.486624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.5","mappings":[{"from":4,"to":3}]},{"pgid":"22.4","mappings":[{"from":3,"to":0}]},{"pgid":"22.5","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/573779117":"2023-11-16T02:48:21.409186+0000","172.21.15.141:0/4241902942":"2023-11-16T02:48:21.409186+0000","172.21.15.141:0/13260862":"2023-11-16T02:48:21.409186+0000","172.21.15.141:6833/90546":"2023-11-16T02:37:27.844602+0000","172.21.15.141:6832/90546":"2023-11-16T02:37:27.844602+0000","172.21.15.141:0/466988614":"2023-11-16T02:48:21.409186+0000","172.21.15.141:0/3793776780":"2023-11-16T02:37:27.844602+0000","172.21.15.141:0/3172941413":"2023-11-16T02:37:27.844602+0000","172.21.15.141:0/4259245798":"2023-11-16T02:37:27.844602+0000","172.21.15.141:0/1504595735":"2023-11-16T02:37:27.844602+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:53:21.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.144+0000 7f294188b700 1 -- 172.21.15.1:0/1118304681 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f292005f240 msgr2=0x7f2920061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:53:21.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.144+0000 7f294188b700 1 --2- 172.21.15.1:0/1118304681 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f292005f240 0x7f2920061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:21.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.144+0000 7f294188b700 1 -- 172.21.15.1:0/1118304681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f293c0c86b0 msgr2=0x7f293c0af130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:21.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.144+0000 7f294188b700 1 --2- 172.21.15.1:0/1118304681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f293c0c86b0 0x7f293c0af130 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f2930009e00 tx=0x7f2930017000).stop 2023-11-15T02:53:21.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.145+0000 7f294188b700 1 -- 172.21.15.1:0/1118304681 shutdown_connections 2023-11-15T02:53:21.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.145+0000 7f294188b700 1 --2- 172.21.15.1:0/1118304681 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f292005f240 0x7f2920061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:21.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.145+0000 7f294188b700 1 --2- 172.21.15.1:0/1118304681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f293c151e10 0x7f293c14eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:21.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.145+0000 7f294188b700 1 --2- 172.21.15.1:0/1118304681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f293c0c86b0 0x7f293c0af130 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:21.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.145+0000 7f294188b700 1 --2- 172.21.15.1:0/1118304681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f293c0c98b0 0x7f293c0b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:21.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.145+0000 7f294188b700 1 -- 172.21.15.1:0/1118304681 >> 172.21.15.1:0/1118304681 conn(0x7f293c0947e0 msgr2=0x7f293c0a9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:21.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.145+0000 7f294188b700 1 -- 172.21.15.1:0/1118304681 shutdown_connections 2023-11-15T02:53:21.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.145+0000 7f294188b700 1 -- 172.21.15.1:0/1118304681 wait complete. 2023-11-15T02:53:21.159 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T02:37:09.163204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '176', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T02:37:10.486624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '177', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T02:53:21.160 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T02:53:21.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.303+0000 7fc0c01be700 1 Processor -- start 2023-11-15T02:53:21.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.303+0000 7fc0c01be700 1 -- start start 2023-11-15T02:53:21.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.304+0000 7fc0c01be700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc0b813b990 0x7fc0b81568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:21.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0c01be700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0b80a8ab0 0x7fc0b80c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:21.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0c01be700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b80c7760 con 0x7fc0b813bd70 2023-11-15T02:53:21.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0c01be700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b8067340 con 0x7fc0b813b990 2023-11-15T02:53:21.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0c01be700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b8067060 con 0x7fc0b80a8ab0 2023-11-15T02:53:21.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0bdf5a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc0b813b990 0x7fc0b81568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:21.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0bdf5a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc0b813b990 0x7fc0b81568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:60742/0 (socket says 172.21.15.1:60742) 2023-11-15T02:53:21.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0bd759700 1 --1- 172.21.15.1:0/169345453 >> v1:172.21.15.141:6789/0 conn(0x7fc0b813bd70 0x7fc0b8066870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:45178/0 (socket says 172.21.15.1:45178) 2023-11-15T02:53:21.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0bdf5a700 1 -- 172.21.15.1:0/169345453 learned_addr learned my addr 172.21.15.1:0/169345453 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:21.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0be75b700 1 --2- 172.21.15.1:0/169345453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0b80a8ab0 0x7fc0b80c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:21.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0bcf58700 1 -- 172.21.15.1:0/169345453 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962347255 0 0) 0x7fc0b80c7760 con 0x7fc0b813bd70 2023-11-15T02:53:21.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0bcf58700 1 -- 172.21.15.1:0/169345453 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a40033f0 con 0x7fc0b813bd70 2023-11-15T02:53:21.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0bdf5a700 1 -- 172.21.15.1:0/169345453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0b80a8ab0 msgr2=0x7fc0b80c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:21.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0bdf5a700 1 --2- 172.21.15.1:0/169345453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0b80a8ab0 0x7fc0b80c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:21.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0bdf5a700 1 -- 172.21.15.1:0/169345453 >> v1:172.21.15.141:6789/0 conn(0x7fc0b813bd70 legacy=0x7fc0b8066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:21.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0bdf5a700 1 -- 172.21.15.1:0/169345453 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b80c7110 con 0x7fc0b813b990 2023-11-15T02:53:21.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.305+0000 7fc0be75b700 1 --2- 172.21.15.1:0/169345453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0b80a8ab0 0x7fc0b80c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:53:21.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.306+0000 7fc0bdf5a700 1 --2- 172.21.15.1:0/169345453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0b813b990 0x7fc0b81568c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fc0a8006fd0 tx=0x7fc0a80090f0).ready entity=mon.1 client_cookie=284585e5379d8fcd server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:21.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.306+0000 7fc0bcf58700 1 -- 172.21.15.1:0/169345453 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800f510 con 0x7fc0b813b990 2023-11-15T02:53:21.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.306+0000 7fc0bcf58700 1 -- 172.21.15.1:0/169345453 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a800f670 con 0x7fc0b813b990 2023-11-15T02:53:21.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.306+0000 7fc0bcf58700 1 -- 172.21.15.1:0/169345453 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800f9f0 con 0x7fc0b813b990 2023-11-15T02:53:21.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.307+0000 7fc0c01be700 1 -- 172.21.15.1:0/169345453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0b813b990 msgr2=0x7fc0b81568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:21.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.307+0000 7fc0c01be700 1 --2- 172.21.15.1:0/169345453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0b813b990 0x7fc0b81568c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fc0a8006fd0 tx=0x7fc0a80090f0).stop 2023-11-15T02:53:21.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.307+0000 7fc0c01be700 1 -- 172.21.15.1:0/169345453 shutdown_connections 2023-11-15T02:53:21.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.307+0000 7fc0c01be700 1 --2- 172.21.15.1:0/169345453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0b80a8ab0 0x7fc0b80c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:21.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.307+0000 7fc0c01be700 1 --2- 172.21.15.1:0/169345453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0b813b990 0x7fc0b81568c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:21.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.307+0000 7fc0c01be700 1 -- 172.21.15.1:0/169345453 >> 172.21.15.1:0/169345453 conn(0x7fc0b8063280 msgr2=0x7fc0b80c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:21.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.308+0000 7fc0c01be700 1 -- 172.21.15.1:0/169345453 shutdown_connections 2023-11-15T02:53:21.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.308+0000 7fc0c01be700 1 -- 172.21.15.1:0/169345453 wait complete. 2023-11-15T02:53:21.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.309+0000 7fc0c01be700 1 Processor -- start 2023-11-15T02:53:21.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.309+0000 7fc0c01be700 1 -- start start 2023-11-15T02:53:21.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.310+0000 7fc0c01be700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0b80a8ab0 0x7fc0b8139150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:21.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.310+0000 7fc0c01be700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b813b990 0x7fc0b8139640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:21.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.311+0000 7fc0c01be700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0b80aed40 0x7fc0b80be230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:21.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.311+0000 7fc0c01be700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b8139b30 con 0x7fc0b813b990 2023-11-15T02:53:21.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.311+0000 7fc0c01be700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b80c2580 con 0x7fc0b80a8ab0 2023-11-15T02:53:21.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.311+0000 7fc0c01be700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b80c1970 con 0x7fc0b80aed40 2023-11-15T02:53:21.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.311+0000 7fc0bd759700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b813b990 0x7fc0b8139640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:21.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.311+0000 7fc0bd759700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b813b990 0x7fc0b8139640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55432/0 (socket says 172.21.15.1:55432) 2023-11-15T02:53:21.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.311+0000 7fc0be75b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0b80aed40 0x7fc0b80be230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:21.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.311+0000 7fc0bd759700 1 -- 172.21.15.1:0/2191025242 learned_addr learned my addr 172.21.15.1:0/2191025242 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:21.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.311+0000 7fc0bd759700 1 -- 172.21.15.1:0/2191025242 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0b80aed40 msgr2=0x7fc0b80be230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:21.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.311+0000 7fc0bd759700 1 --2- 172.21.15.1:0/2191025242 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0b80aed40 0x7fc0b80be230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:21.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.311+0000 7fc0bd759700 1 -- 172.21.15.1:0/2191025242 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0b80a8ab0 msgr2=0x7fc0b8139150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:21.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.311+0000 7fc0bd759700 1 --2- 172.21.15.1:0/2191025242 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0b80a8ab0 0x7fc0b8139150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:21.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.311+0000 7fc0bd759700 1 -- 172.21.15.1:0/2191025242 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b0009a20 con 0x7fc0b813b990 2023-11-15T02:53:21.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.312+0000 7fc0bd759700 1 --2- 172.21.15.1:0/2191025242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b813b990 0x7fc0b8139640 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7fc0b400c590 tx=0x7fc0b4007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:21.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.312+0000 7fc0adffb700 1 -- 172.21.15.1:0/2191025242 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4007e40 con 0x7fc0b813b990 2023-11-15T02:53:21.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.312+0000 7fc0adffb700 1 -- 172.21.15.1:0/2191025242 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b40072e0 con 0x7fc0b813b990 2023-11-15T02:53:21.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.312+0000 7fc0adffb700 1 -- 172.21.15.1:0/2191025242 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b40056e0 con 0x7fc0b813b990 2023-11-15T02:53:21.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.312+0000 7fc0c01be700 1 -- 172.21.15.1:0/2191025242 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a8009370 con 0x7fc0b813b990 2023-11-15T02:53:21.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.312+0000 7fc0c01be700 1 -- 172.21.15.1:0/2191025242 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b80c1f30 con 0x7fc0b813b990 2023-11-15T02:53:21.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.314+0000 7fc0c01be700 1 -- 172.21.15.1:0/2191025242 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b80c9020 con 0x7fc0b813b990 2023-11-15T02:53:21.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.315+0000 7fc0adffb700 1 -- 172.21.15.1:0/2191025242 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fc0b4005b10 con 0x7fc0b813b990 2023-11-15T02:53:21.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.315+0000 7fc0adffb700 1 --2- 172.21.15.1:0/2191025242 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc09c05f270 0x7fc09c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:21.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.316+0000 7fc0adffb700 1 -- 172.21.15.1:0/2191025242 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 7190+0+0 (secure 0 0 0) 0x7fc0b407a350 con 0x7fc0b813b990 2023-11-15T02:53:21.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.318+0000 7fc0bdf5a700 1 -- 172.21.15.1:0/2191025242 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc09c05f270 msgr2=0x7fc09c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:21.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.318+0000 7fc0bdf5a700 1 --2- 172.21.15.1:0/2191025242 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc09c05f270 0x7fc09c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:53:21.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.321+0000 7fc0adffb700 1 -- 172.21.15.1:0/2191025242 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc0b404b130 con 0x7fc0b813b990 2023-11-15T02:53:21.379 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:21.366+0000 7f689ce92680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:53:21.449 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:21.448+0000 7f689ce92680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:53:21.469 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:21.464+0000 7f1d16738680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:53:21.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.519+0000 7fc0bdf5a700 1 -- 172.21.15.1:0/2191025242 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc09c05f270 msgr2=0x7fc09c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:21.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.519+0000 7fc0bdf5a700 1 --2- 172.21.15.1:0/2191025242 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc09c05f270 0x7fc09c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:53:21.576 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:21.574+0000 7f1d16738680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:53:21.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.590+0000 7fc0c01be700 1 -- 172.21.15.1:0/2191025242 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc0b806c7e0 con 0x7fc0b813b990 2023-11-15T02:53:21.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.591+0000 7fc0adffb700 1 -- 172.21.15.1:0/2191025242 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v182) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc0b404e750 con 0x7fc0b813b990 2023-11-15T02:53:21.593 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T02:53:21.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.593+0000 7fc0c01be700 1 -- 172.21.15.1:0/2191025242 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc09c05f270 msgr2=0x7fc09c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:53:21.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.593+0000 7fc0c01be700 1 --2- 172.21.15.1:0/2191025242 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc09c05f270 0x7fc09c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:21.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.593+0000 7fc0c01be700 1 -- 172.21.15.1:0/2191025242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b813b990 msgr2=0x7fc0b8139640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:21.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.593+0000 7fc0c01be700 1 --2- 172.21.15.1:0/2191025242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b813b990 0x7fc0b8139640 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7fc0b400c590 tx=0x7fc0b4007c80).stop 2023-11-15T02:53:21.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.593+0000 7fc0c01be700 1 -- 172.21.15.1:0/2191025242 shutdown_connections 2023-11-15T02:53:21.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.593+0000 7fc0c01be700 1 --2- 172.21.15.1:0/2191025242 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc09c05f270 0x7fc09c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:21.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.593+0000 7fc0c01be700 1 --2- 172.21.15.1:0/2191025242 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0b80aed40 0x7fc0b80be230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:21.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.593+0000 7fc0c01be700 1 --2- 172.21.15.1:0/2191025242 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0b80a8ab0 0x7fc0b8139150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:21.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.593+0000 7fc0c01be700 1 --2- 172.21.15.1:0/2191025242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b813b990 0x7fc0b8139640 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:21.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.593+0000 7fc0c01be700 1 -- 172.21.15.1:0/2191025242 >> 172.21.15.1:0/2191025242 conn(0x7fc0b8063280 msgr2=0x7fc0b80bf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:21.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.593+0000 7fc0c01be700 1 -- 172.21.15.1:0/2191025242 shutdown_connections 2023-11-15T02:53:21.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.593+0000 7fc0c01be700 1 -- 172.21.15.1:0/2191025242 wait complete. 2023-11-15T02:53:21.607 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T02:53:21.670 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:21.668+0000 7f689ce92680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:53:21.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.730+0000 7f9288d79700 1 Processor -- start 2023-11-15T02:53:21.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.730+0000 7f9288d79700 1 -- start start 2023-11-15T02:53:21.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.731+0000 7f9288d79700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f92840637c0 0x7f9284063c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:21.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.731+0000 7f9288d79700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92840627b0 con 0x7f9284153bc0 2023-11-15T02:53:21.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.731+0000 7f9288d79700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9284063330 con 0x7f92841537e0 2023-11-15T02:53:21.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.731+0000 7f9288d79700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92840c6cc0 con 0x7f92840637c0 2023-11-15T02:53:21.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.731+0000 7f927affd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9284153bc0 0x7f92840c1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57180/0 (socket says 172.21.15.1:57180) 2023-11-15T02:53:21.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.731+0000 7f927affd700 1 -- 172.21.15.1:0/3953960162 learned_addr learned my addr 172.21.15.1:0/3953960162 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:21.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.731+0000 7f9283fff700 1 --2- 172.21.15.1:0/3953960162 >> v2:172.21.15.141:3300/0 conn(0x7f92840637c0 0x7f9284063c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:21.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.732+0000 7f9282ffd700 1 -- 172.21.15.1:0/3953960162 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312544334 0 0) 0x7f92840627b0 con 0x7f9284153bc0 2023-11-15T02:53:21.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.732+0000 7f9282ffd700 1 -- 172.21.15.1:0/3953960162 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92700033f0 con 0x7f9284153bc0 2023-11-15T02:53:21.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.732+0000 7f9283fff700 1 -- 172.21.15.1:0/3953960162 >> v1:172.21.15.141:6789/0 conn(0x7f92841537e0 legacy=0x7f92840bd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:21.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.732+0000 7f9283fff700 1 -- 172.21.15.1:0/3953960162 >> v1:172.21.15.1:6789/0 conn(0x7f9284153bc0 legacy=0x7f92840c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:21.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.732+0000 7f9282ffd700 1 -- 172.21.15.1:0/3953960162 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2818690072 0 0) 0x7f92700033f0 con 0x7f9284153bc0 2023-11-15T02:53:21.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.732+0000 7f9283fff700 1 -- 172.21.15.1:0/3953960162 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284064140 con 0x7f92840637c0 2023-11-15T02:53:21.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.732+0000 7f9283fff700 1 --2- 172.21.15.1:0/3953960162 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92840637c0 0x7f9284063c50 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f927c009e60 tx=0x7f927c009780).ready entity=mon.1 client_cookie=2a9cf75ca3f4853f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:21.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.732+0000 7f9282ffd700 1 -- 172.21.15.1:0/3953960162 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c00e070 con 0x7f92840637c0 2023-11-15T02:53:21.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.732+0000 7f9282ffd700 1 -- 172.21.15.1:0/3953960162 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927c00b850 con 0x7f92840637c0 2023-11-15T02:53:21.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.732+0000 7f9282ffd700 1 -- 172.21.15.1:0/3953960162 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c001470 con 0x7f92840637c0 2023-11-15T02:53:21.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.733+0000 7f9288d79700 1 -- 172.21.15.1:0/3953960162 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92840637c0 msgr2=0x7f9284063c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:21.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.733+0000 7f9288d79700 1 --2- 172.21.15.1:0/3953960162 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92840637c0 0x7f9284063c50 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f927c009e60 tx=0x7f927c009780).stop 2023-11-15T02:53:21.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.733+0000 7f9288d79700 1 -- 172.21.15.1:0/3953960162 shutdown_connections 2023-11-15T02:53:21.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.733+0000 7f9288d79700 1 --2- 172.21.15.1:0/3953960162 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92840637c0 0x7f9284063c50 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:21.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.733+0000 7f9288d79700 1 -- 172.21.15.1:0/3953960162 >> 172.21.15.1:0/3953960162 conn(0x7f92840c3e30 msgr2=0x7f92840c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:21.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.733+0000 7f9288d79700 1 -- 172.21.15.1:0/3953960162 shutdown_connections 2023-11-15T02:53:21.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.733+0000 7f9288d79700 1 -- 172.21.15.1:0/3953960162 wait complete. 2023-11-15T02:53:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.734+0000 7f9288d79700 1 Processor -- start 2023-11-15T02:53:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.734+0000 7f9288d79700 1 -- start start 2023-11-15T02:53:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f9288d79700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92840637c0 0x7f9284146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f9288d79700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92841537e0 0x7f9284144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f9288d79700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9284153bc0 0x7f9284164d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:21.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f9288d79700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92840a0e30 con 0x7f92840637c0 2023-11-15T02:53:21.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f9288d79700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92841464c0 con 0x7f92841537e0 2023-11-15T02:53:21.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f9288d79700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9284146e40 con 0x7f9284153bc0 2023-11-15T02:53:21.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f92837fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92840637c0 0x7f9284146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:21.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f92837fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92840637c0 0x7f9284146950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55442/0 (socket says 172.21.15.1:55442) 2023-11-15T02:53:21.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f92837fe700 1 -- 172.21.15.1:0/2187943748 learned_addr learned my addr 172.21.15.1:0/2187943748 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:21.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f927affd700 1 --2- 172.21.15.1:0/2187943748 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92841537e0 0x7f9284144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:21.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f9283fff700 1 --2- 172.21.15.1:0/2187943748 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9284153bc0 0x7f9284164d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:21.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f92837fe700 1 -- 172.21.15.1:0/2187943748 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9284153bc0 msgr2=0x7f9284164d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:21.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f92837fe700 1 --2- 172.21.15.1:0/2187943748 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9284153bc0 0x7f9284164d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:21.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f92837fe700 1 -- 172.21.15.1:0/2187943748 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92841537e0 msgr2=0x7f9284144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:21.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f92837fe700 1 --2- 172.21.15.1:0/2187943748 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92841537e0 0x7f9284144ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:21.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f92837fe700 1 -- 172.21.15.1:0/2187943748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c009a20 con 0x7f92840637c0 2023-11-15T02:53:21.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f9283fff700 1 --2- 172.21.15.1:0/2187943748 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9284153bc0 0x7f9284164d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:53:21.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.735+0000 7f92837fe700 1 --2- 172.21.15.1:0/2187943748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92840637c0 0x7f9284146950 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7f927400c4c0 tx=0x7f9274007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:21.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.736+0000 7f927bfff700 1 -- 172.21.15.1:0/2187943748 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9274007020 con 0x7f92840637c0 2023-11-15T02:53:21.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.736+0000 7f927bfff700 1 -- 172.21.15.1:0/2187943748 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9274001e90 con 0x7f92840637c0 2023-11-15T02:53:21.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.736+0000 7f927bfff700 1 -- 172.21.15.1:0/2187943748 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92740073b0 con 0x7f92840637c0 2023-11-15T02:53:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.736+0000 7f9288d79700 1 -- 172.21.15.1:0/2187943748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9284145b90 con 0x7f92840637c0 2023-11-15T02:53:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.736+0000 7f9288d79700 1 -- 172.21.15.1:0/2187943748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9284146150 con 0x7f92840637c0 2023-11-15T02:53:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.737+0000 7f927bfff700 1 -- 172.21.15.1:0/2187943748 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f92740068b0 con 0x7f92840637c0 2023-11-15T02:53:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.737+0000 7f9288d79700 1 -- 172.21.15.1:0/2187943748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92840475e0 con 0x7f92840637c0 2023-11-15T02:53:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.737+0000 7f927bfff700 1 --2- 172.21.15.1:0/2187943748 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f926405f270 0x7f9264061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.737+0000 7f927affd700 1 -- 172.21.15.1:0/2187943748 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f926405f270 msgr2=0x7f9264061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:21.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.737+0000 7f927bfff700 1 -- 172.21.15.1:0/2187943748 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 7190+0+0 (secure 0 0 0) 0x7f927407a110 con 0x7f92840637c0 2023-11-15T02:53:21.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.737+0000 7f927affd700 1 --2- 172.21.15.1:0/2187943748 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f926405f270 0x7f9264061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:53:21.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.742+0000 7f927bfff700 1 -- 172.21.15.1:0/2187943748 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f927404ae30 con 0x7f92840637c0 2023-11-15T02:53:21.777 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:21.775+0000 7f1d16738680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:53:21.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.912+0000 7f9288d79700 1 -- 172.21.15.1:0/2187943748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9284062a00 con 0x7f92840637c0 2023-11-15T02:53:21.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.913+0000 7f927bfff700 1 -- 172.21.15.1:0/2187943748 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v182) v1 ==== 92+0+10 (secure 0 0 0) 0x7f927404e450 con 0x7f92840637c0 2023-11-15T02:53:21.915 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T02:53:21.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.915+0000 7f9288d79700 1 -- 172.21.15.1:0/2187943748 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f926405f270 msgr2=0x7f9264061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:53:21.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.915+0000 7f9288d79700 1 --2- 172.21.15.1:0/2187943748 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f926405f270 0x7f9264061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:21.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.915+0000 7f9288d79700 1 -- 172.21.15.1:0/2187943748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92840637c0 msgr2=0x7f9284146950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:21.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.915+0000 7f9288d79700 1 --2- 172.21.15.1:0/2187943748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92840637c0 0x7f9284146950 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7f927400c4c0 tx=0x7f9274007e00).stop 2023-11-15T02:53:21.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.915+0000 7f9288d79700 1 -- 172.21.15.1:0/2187943748 shutdown_connections 2023-11-15T02:53:21.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.915+0000 7f9288d79700 1 --2- 172.21.15.1:0/2187943748 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f926405f270 0x7f9264061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:21.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.915+0000 7f9288d79700 1 --2- 172.21.15.1:0/2187943748 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9284153bc0 0x7f9284164d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:21.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.915+0000 7f9288d79700 1 --2- 172.21.15.1:0/2187943748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92840637c0 0x7f9284146950 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:21.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.915+0000 7f9288d79700 1 --2- 172.21.15.1:0/2187943748 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92841537e0 0x7f9284144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:21.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.915+0000 7f9288d79700 1 -- 172.21.15.1:0/2187943748 >> 172.21.15.1:0/2187943748 conn(0x7f92840c3e30 msgr2=0x7f92840c0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:21.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.915+0000 7f9288d79700 1 -- 172.21.15.1:0/2187943748 shutdown_connections 2023-11-15T02:53:21.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:21.915+0000 7f9288d79700 1 -- 172.21.15.1:0/2187943748 wait complete. 2023-11-15T02:53:21.930 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T02:53:22.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.053+0000 7fb84ba2a700 1 Processor -- start 2023-11-15T02:53:22.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.054+0000 7fb84ba2a700 1 -- start start 2023-11-15T02:53:22.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.054+0000 7fb84ba2a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb84414eac0 0x7fb844155370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.054+0000 7fb84ba2a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb844158e40 con 0x7fb84414e6e0 2023-11-15T02:53:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.054+0000 7fb84ba2a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb844155860 con 0x7fb844062ec0 2023-11-15T02:53:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.054+0000 7fb84ba2a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb844158230 con 0x7fb84414eac0 2023-11-15T02:53:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb8497c6700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb84414e6e0 0x7fb8440627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57196/0 (socket says 172.21.15.1:57196) 2023-11-15T02:53:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb8497c6700 1 -- 172.21.15.1:0/1270081255 learned_addr learned my addr 172.21.15.1:0/1270081255 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb849fc7700 1 --2- 172.21.15.1:0/1270081255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb84414eac0 0x7fb844155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764481697 0 0) 0x7fb844158e40 con 0x7fb84414e6e0 2023-11-15T02:53:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8300033f0 con 0x7fb84414e6e0 2023-11-15T02:53:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64046952 0 0) 0x7fb844155860 con 0x7fb844062ec0 2023-11-15T02:53:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb844158e40 con 0x7fb844062ec0 2023-11-15T02:53:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 197959066 0 0) 0x7fb8300033f0 con 0x7fb84414e6e0 2023-11-15T02:53:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb84414eac0 msgr2=0x7fb844155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 --2- 172.21.15.1:0/1270081255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb84414eac0 0x7fb844155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 >> v1:172.21.15.141:6789/0 conn(0x7fb844062ec0 legacy=0x7fb8440c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb844158510 con 0x7fb84414e6e0 2023-11-15T02:53:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fb840001470 con 0x7fb84414e6e0 2023-11-15T02:53:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 >> v1:172.21.15.1:6789/0 conn(0x7fb84414e6e0 legacy=0x7fb8440627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 --2- 172.21.15.1:0/1270081255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb830003aa0 0x7fb830003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 --2- 172.21.15.1:0/1270081255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb830004690 0x7fb830004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 --2- 172.21.15.1:0/1270081255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb830005000 0x7fb83000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb844158230 con 0x7fb830005000 2023-11-15T02:53:22.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83000bdd0 con 0x7fb830003aa0 2023-11-15T02:53:22.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83000bf90 con 0x7fb830004690 2023-11-15T02:53:22.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.055+0000 7fb849fc7700 1 --2- 172.21.15.1:0/1270081255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb84414eac0 0x7fb844155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:53:22.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.056+0000 7fb8497c6700 1 --2- 172.21.15.1:0/1270081255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb830003aa0 0x7fb830003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.056+0000 7fb848fc5700 1 --2- 172.21.15.1:0/1270081255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb830004690 0x7fb830004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.056+0000 7fb849fc7700 1 --2- 172.21.15.1:0/1270081255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb830005000 0x7fb83000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.056+0000 7fb8497c6700 1 -- 172.21.15.1:0/1270081255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb830004690 msgr2=0x7fb830004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:22.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.056+0000 7fb8497c6700 1 --2- 172.21.15.1:0/1270081255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb830004690 0x7fb830004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.056+0000 7fb8497c6700 1 -- 172.21.15.1:0/1270081255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb830005000 msgr2=0x7fb83000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:22.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.056+0000 7fb8497c6700 1 --2- 172.21.15.1:0/1270081255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb830005000 0x7fb83000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.056+0000 7fb8497c6700 1 -- 172.21.15.1:0/1270081255 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8300033f0 con 0x7fb830003aa0 2023-11-15T02:53:22.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.056+0000 7fb8497c6700 1 --2- 172.21.15.1:0/1270081255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb830003aa0 0x7fb830003ea0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fb84000c140 tx=0x7fb840001e10).ready entity=mon.1 client_cookie=950bc77d9c7f4734 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:22.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.056+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84000ca30 con 0x7fb830003aa0 2023-11-15T02:53:22.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.056+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84000cb90 con 0x7fb830003aa0 2023-11-15T02:53:22.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.056+0000 7fb837fff700 1 -- 172.21.15.1:0/1270081255 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400070d0 con 0x7fb830003aa0 2023-11-15T02:53:22.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.057+0000 7fb84ba2a700 1 -- 172.21.15.1:0/1270081255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb830003aa0 msgr2=0x7fb830003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.057+0000 7fb84ba2a700 1 --2- 172.21.15.1:0/1270081255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb830003aa0 0x7fb830003ea0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fb84000c140 tx=0x7fb840001e10).stop 2023-11-15T02:53:22.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.057+0000 7fb849fc7700 1 -- 172.21.15.1:0/1270081255 reap_dead start 2023-11-15T02:53:22.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.057+0000 7fb84ba2a700 1 -- 172.21.15.1:0/1270081255 shutdown_connections 2023-11-15T02:53:22.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.057+0000 7fb84ba2a700 1 -- 172.21.15.1:0/1270081255 >> 172.21.15.1:0/1270081255 conn(0x7fb8440c7dc0 msgr2=0x7fb8440c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:22.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.057+0000 7fb84ba2a700 1 -- 172.21.15.1:0/1270081255 shutdown_connections 2023-11-15T02:53:22.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.057+0000 7fb84ba2a700 1 -- 172.21.15.1:0/1270081255 wait complete. 2023-11-15T02:53:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.058+0000 7fb84ba2a700 1 Processor -- start 2023-11-15T02:53:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.058+0000 7fb84ba2a700 1 -- start start 2023-11-15T02:53:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb84ba2a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb830003aa0 0x7fb8441380d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb84ba2a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8440a6d60 0x7fb8440a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb84ba2a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8440a6030 0x7fb8440a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb84ba2a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8441385c0 con 0x7fb8440a6d60 2023-11-15T02:53:22.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb84ba2a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440a5520 con 0x7fb830003aa0 2023-11-15T02:53:22.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb84ba2a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440a76d0 con 0x7fb8440a6030 2023-11-15T02:53:22.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb848fc5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8440a6d60 0x7fb8440a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb848fc5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8440a6d60 0x7fb8440a71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55458/0 (socket says 172.21.15.1:55458) 2023-11-15T02:53:22.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb8497c6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb830003aa0 0x7fb8441380d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb848fc5700 1 -- 172.21.15.1:0/830939837 learned_addr learned my addr 172.21.15.1:0/830939837 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:22.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb849fc7700 1 --2- 172.21.15.1:0/830939837 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8440a6030 0x7fb8440a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb848fc5700 1 -- 172.21.15.1:0/830939837 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8440a6030 msgr2=0x7fb8440a64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb848fc5700 1 --2- 172.21.15.1:0/830939837 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8440a6030 0x7fb8440a64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb848fc5700 1 -- 172.21.15.1:0/830939837 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb830003aa0 msgr2=0x7fb8441380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb848fc5700 1 --2- 172.21.15.1:0/830939837 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb830003aa0 0x7fb8441380d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.059+0000 7fb848fc5700 1 -- 172.21.15.1:0/830939837 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8440a4910 con 0x7fb8440a6d60 2023-11-15T02:53:22.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.060+0000 7fb848fc5700 1 --2- 172.21.15.1:0/830939837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8440a6d60 0x7fb8440a71e0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7fb838002a80 tx=0x7fb838007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:22.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.060+0000 7fb8357fa700 1 -- 172.21.15.1:0/830939837 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838002e60 con 0x7fb8440a6d60 2023-11-15T02:53:22.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.060+0000 7fb8357fa700 1 -- 172.21.15.1:0/830939837 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83800f870 con 0x7fb8440a6d60 2023-11-15T02:53:22.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.060+0000 7fb84ba2a700 1 -- 172.21.15.1:0/830939837 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8440a4bf0 con 0x7fb8440a6d60 2023-11-15T02:53:22.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.060+0000 7fb8357fa700 1 -- 172.21.15.1:0/830939837 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83800fbf0 con 0x7fb8440a6d60 2023-11-15T02:53:22.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.060+0000 7fb84ba2a700 1 -- 172.21.15.1:0/830939837 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8440a51b0 con 0x7fb8440a6d60 2023-11-15T02:53:22.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.061+0000 7fb84ba2a700 1 -- 172.21.15.1:0/830939837 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84406c7e0 con 0x7fb8440a6d60 2023-11-15T02:53:22.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.061+0000 7fb8357fa700 1 -- 172.21.15.1:0/830939837 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fb838014450 con 0x7fb8440a6d60 2023-11-15T02:53:22.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.062+0000 7fb8357fa700 1 --2- 172.21.15.1:0/830939837 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb82805f270 0x7fb828061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.062+0000 7fb8497c6700 1 -- 172.21.15.1:0/830939837 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb82805f270 msgr2=0x7fb828061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:22.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.062+0000 7fb8357fa700 1 -- 172.21.15.1:0/830939837 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 7190+0+0 (secure 0 0 0) 0x7fb83807a550 con 0x7fb8440a6d60 2023-11-15T02:53:22.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.062+0000 7fb8497c6700 1 --2- 172.21.15.1:0/830939837 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb82805f270 0x7fb828061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:53:22.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.066+0000 7fb8357fa700 1 -- 172.21.15.1:0/830939837 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb83804aaf0 con 0x7fb8440a6d60 2023-11-15T02:53:22.090 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:22.089+0000 7f689ce92680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:53:22.194 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:22.192+0000 7f689ce92680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:53:22.226 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:22.224+0000 7f1d16738680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:53:22.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.241+0000 7fb84ba2a700 1 -- 172.21.15.1:0/830939837 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8440a5660 con 0x7fb8440a6d60 2023-11-15T02:53:22.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.242+0000 7fb8357fa700 1 -- 172.21.15.1:0/830939837 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v182) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb83804b2c0 con 0x7fb8440a6d60 2023-11-15T02:53:22.244 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T02:53:22.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.244+0000 7fb84ba2a700 1 -- 172.21.15.1:0/830939837 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb82805f270 msgr2=0x7fb828061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:53:22.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.244+0000 7fb84ba2a700 1 --2- 172.21.15.1:0/830939837 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb82805f270 0x7fb828061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:22.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.244+0000 7fb84ba2a700 1 -- 172.21.15.1:0/830939837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8440a6d60 msgr2=0x7fb8440a71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.244+0000 7fb84ba2a700 1 --2- 172.21.15.1:0/830939837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8440a6d60 0x7fb8440a71e0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7fb838002a80 tx=0x7fb838007b90).stop 2023-11-15T02:53:22.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.244+0000 7fb84ba2a700 1 -- 172.21.15.1:0/830939837 shutdown_connections 2023-11-15T02:53:22.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.244+0000 7fb84ba2a700 1 --2- 172.21.15.1:0/830939837 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb82805f270 0x7fb828061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:22.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.244+0000 7fb84ba2a700 1 --2- 172.21.15.1:0/830939837 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8440a6030 0x7fb8440a64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.244+0000 7fb84ba2a700 1 --2- 172.21.15.1:0/830939837 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb830003aa0 0x7fb8441380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.244+0000 7fb84ba2a700 1 --2- 172.21.15.1:0/830939837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8440a6d60 0x7fb8440a71e0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.244+0000 7fb84ba2a700 1 -- 172.21.15.1:0/830939837 >> 172.21.15.1:0/830939837 conn(0x7fb8440c7dc0 msgr2=0x7fb844154c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:22.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.244+0000 7fb84ba2a700 1 -- 172.21.15.1:0/830939837 shutdown_connections 2023-11-15T02:53:22.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.244+0000 7fb84ba2a700 1 -- 172.21.15.1:0/830939837 wait complete. 2023-11-15T02:53:22.258 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T02:53:22.341 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:22.339+0000 7f1d16738680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:53:22.347 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:22.345+0000 7f689ce92680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:53:22.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.379+0000 7f089df4e700 1 Processor -- start 2023-11-15T02:53:22.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.379+0000 7f089df4e700 1 -- start start 2023-11-15T02:53:22.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.380+0000 7f089df4e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f08981540a0 0x7f08980ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.380+0000 7f089df4e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0898154480 0x7f08980ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.380+0000 7f089df4e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08980c5f40 0x7f08980c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.380+0000 7f089df4e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08980ca050 con 0x7f0898154480 2023-11-15T02:53:22.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.380+0000 7f089df4e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08980c68c0 con 0x7f08981540a0 2023-11-15T02:53:22.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.380+0000 7f089df4e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08980c9440 con 0x7f08980c5f40 2023-11-15T02:53:22.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.380+0000 7f0896ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0898154480 0x7f08980ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.380+0000 7f0896ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0898154480 0x7f08980ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55460/0 (socket says 172.21.15.1:55460) 2023-11-15T02:53:22.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.380+0000 7f0896ffd700 1 -- 172.21.15.1:0/1525643652 learned_addr learned my addr 172.21.15.1:0/1525643652 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:22.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.380+0000 7f0897fff700 1 --2- 172.21.15.1:0/1525643652 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08980c5f40 0x7f08980c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.380+0000 7f08977fe700 1 --2- 172.21.15.1:0/1525643652 >> v2:172.21.15.141:3300/0 conn(0x7f08981540a0 0x7f08980ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.380+0000 7f0896ffd700 1 -- 172.21.15.1:0/1525643652 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08980c5f40 msgr2=0x7f08980c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:22.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.380+0000 7f0896ffd700 1 --2- 172.21.15.1:0/1525643652 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08980c5f40 0x7f08980c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.380+0000 7f0896ffd700 1 -- 172.21.15.1:0/1525643652 >> v2:172.21.15.141:3300/0 conn(0x7f08981540a0 msgr2=0x7f08980ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:22.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.381+0000 7f0896ffd700 1 --2- 172.21.15.1:0/1525643652 >> v2:172.21.15.141:3300/0 conn(0x7f08981540a0 0x7f08980ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.381+0000 7f0896ffd700 1 -- 172.21.15.1:0/1525643652 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08980c9720 con 0x7f0898154480 2023-11-15T02:53:22.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.381+0000 7f0896ffd700 1 --2- 172.21.15.1:0/1525643652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0898154480 0x7f08980ca9d0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f089805ff40 tx=0x7f08880090f0).ready entity=mon.0 client_cookie=967d84fabb574777 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:22.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.381+0000 7f08967fc700 1 -- 172.21.15.1:0/1525643652 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088800f510 con 0x7f0898154480 2023-11-15T02:53:22.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.381+0000 7f08967fc700 1 -- 172.21.15.1:0/1525643652 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088800f670 con 0x7f0898154480 2023-11-15T02:53:22.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.381+0000 7f08967fc700 1 -- 172.21.15.1:0/1525643652 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088800f9f0 con 0x7f0898154480 2023-11-15T02:53:22.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.381+0000 7f089df4e700 1 -- 172.21.15.1:0/1525643652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0898154480 msgr2=0x7f08980ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.381+0000 7f089df4e700 1 --2- 172.21.15.1:0/1525643652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0898154480 0x7f08980ca9d0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f089805ff40 tx=0x7f08880090f0).stop 2023-11-15T02:53:22.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.381+0000 7f089df4e700 1 -- 172.21.15.1:0/1525643652 shutdown_connections 2023-11-15T02:53:22.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.381+0000 7f089df4e700 1 --2- 172.21.15.1:0/1525643652 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08980c5f40 0x7f08980c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.381+0000 7f089df4e700 1 --2- 172.21.15.1:0/1525643652 >> v2:172.21.15.141:3300/0 conn(0x7f08981540a0 0x7f08980ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.381+0000 7f089df4e700 1 --2- 172.21.15.1:0/1525643652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0898154480 0x7f08980ca9d0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.381+0000 7f089df4e700 1 -- 172.21.15.1:0/1525643652 >> 172.21.15.1:0/1525643652 conn(0x7f0898064a70 msgr2=0x7f0898064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:22.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.381+0000 7f089df4e700 1 -- 172.21.15.1:0/1525643652 shutdown_connections 2023-11-15T02:53:22.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.381+0000 7f089df4e700 1 -- 172.21.15.1:0/1525643652 wait complete. 2023-11-15T02:53:22.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.383+0000 7f089df4e700 1 Processor -- start 2023-11-15T02:53:22.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.383+0000 7f089df4e700 1 -- start start 2023-11-15T02:53:22.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.383+0000 7f089df4e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08980c5f40 0x7f0898168250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.383+0000 7f089df4e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08981540a0 0x7f089814ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.383+0000 7f089df4e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0898154480 0x7f0898157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.383+0000 7f089df4e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0898158930 con 0x7f08981540a0 2023-11-15T02:53:22.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.383+0000 7f089df4e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08980af7b0 con 0x7f0898154480 2023-11-15T02:53:22.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f089df4e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0898157d20 con 0x7f08980c5f40 2023-11-15T02:53:22.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f0896ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08981540a0 0x7f089814ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f0896ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08981540a0 0x7f089814ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55464/0 (socket says 172.21.15.1:55464) 2023-11-15T02:53:22.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f0896ffd700 1 -- 172.21.15.1:0/2007961409 learned_addr learned my addr 172.21.15.1:0/2007961409 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:22.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f08977fe700 1 --2- 172.21.15.1:0/2007961409 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08980c5f40 0x7f0898168250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f0897fff700 1 --2- 172.21.15.1:0/2007961409 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0898154480 0x7f0898157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f0896ffd700 1 -- 172.21.15.1:0/2007961409 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08980c5f40 msgr2=0x7f0898168250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f0896ffd700 1 --2- 172.21.15.1:0/2007961409 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08980c5f40 0x7f0898168250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f0896ffd700 1 -- 172.21.15.1:0/2007961409 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0898154480 msgr2=0x7f0898157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f0896ffd700 1 --2- 172.21.15.1:0/2007961409 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0898154480 0x7f0898157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f0896ffd700 1 -- 172.21.15.1:0/2007961409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0888009370 con 0x7f08981540a0 2023-11-15T02:53:22.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f0896ffd700 1 --2- 172.21.15.1:0/2007961409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08981540a0 0x7f089814ec70 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f08980c2070 tx=0x7f0888017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:22.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f088f7fe700 1 -- 172.21.15.1:0/2007961409 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088800f7e0 con 0x7f08981540a0 2023-11-15T02:53:22.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f088f7fe700 1 -- 172.21.15.1:0/2007961409 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088800f940 con 0x7f08981540a0 2023-11-15T02:53:22.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f089df4e700 1 -- 172.21.15.1:0/2007961409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0898158000 con 0x7f08981540a0 2023-11-15T02:53:22.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f088f7fe700 1 -- 172.21.15.1:0/2007961409 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088801d680 con 0x7f08981540a0 2023-11-15T02:53:22.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.384+0000 7f089df4e700 1 -- 172.21.15.1:0/2007961409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08981585c0 con 0x7f08981540a0 2023-11-15T02:53:22.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.385+0000 7f089df4e700 1 -- 172.21.15.1:0/2007961409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f089806c7e0 con 0x7f08981540a0 2023-11-15T02:53:22.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.386+0000 7f088f7fe700 1 -- 172.21.15.1:0/2007961409 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f088801da70 con 0x7f08981540a0 2023-11-15T02:53:22.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.386+0000 7f088f7fe700 1 --2- 172.21.15.1:0/2007961409 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f087805f270 0x7f0878061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.386+0000 7f08977fe700 1 -- 172.21.15.1:0/2007961409 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f087805f270 msgr2=0x7f0878061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:22.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.386+0000 7f088f7fe700 1 -- 172.21.15.1:0/2007961409 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 7190+0+0 (secure 0 0 0) 0x7f088807c550 con 0x7f08981540a0 2023-11-15T02:53:22.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.386+0000 7f08977fe700 1 --2- 172.21.15.1:0/2007961409 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f087805f270 0x7f0878061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:53:22.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.390+0000 7f088f7fe700 1 -- 172.21.15.1:0/2007961409 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f088804d320 con 0x7f08981540a0 2023-11-15T02:53:22.421 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:22.420+0000 7f689ce92680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:53:22.487 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:22.486+0000 7f689ce92680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:53:22.503 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:22.501+0000 7f1d16738680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:53:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.565+0000 7f089df4e700 1 -- 172.21.15.1:0/2007961409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08980c9a00 con 0x7f08981540a0 2023-11-15T02:53:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.565+0000 7f088f7fe700 1 -- 172.21.15.1:0/2007961409 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v182) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0888050940 con 0x7f08981540a0 2023-11-15T02:53:22.568 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T02:53:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.567+0000 7f089df4e700 1 -- 172.21.15.1:0/2007961409 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f087805f270 msgr2=0x7f0878061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:53:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.567+0000 7f089df4e700 1 --2- 172.21.15.1:0/2007961409 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f087805f270 0x7f0878061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.567+0000 7f089df4e700 1 -- 172.21.15.1:0/2007961409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08981540a0 msgr2=0x7f089814ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.567+0000 7f089df4e700 1 --2- 172.21.15.1:0/2007961409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08981540a0 0x7f089814ec70 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f08980c2070 tx=0x7f0888017000).stop 2023-11-15T02:53:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.567+0000 7f089df4e700 1 -- 172.21.15.1:0/2007961409 shutdown_connections 2023-11-15T02:53:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.567+0000 7f089df4e700 1 --2- 172.21.15.1:0/2007961409 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f087805f270 0x7f0878061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.567+0000 7f089df4e700 1 --2- 172.21.15.1:0/2007961409 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0898154480 0x7f0898157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.567+0000 7f089df4e700 1 --2- 172.21.15.1:0/2007961409 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08980c5f40 0x7f0898168250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.567+0000 7f089df4e700 1 --2- 172.21.15.1:0/2007961409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08981540a0 0x7f089814ec70 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.567+0000 7f089df4e700 1 -- 172.21.15.1:0/2007961409 >> 172.21.15.1:0/2007961409 conn(0x7f0898064a70 msgr2=0x7f08980aaf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.567+0000 7f089df4e700 1 -- 172.21.15.1:0/2007961409 shutdown_connections 2023-11-15T02:53:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.567+0000 7f089df4e700 1 -- 172.21.15.1:0/2007961409 wait complete. 2023-11-15T02:53:22.582 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:53:22.583 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:22.581+0000 7f1d16738680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:53:22.659 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:22.657+0000 7f1d16738680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:53:22.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.702+0000 7f6ab359e700 1 Processor -- start 2023-11-15T02:53:22.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.702+0000 7f6ab359e700 1 -- start start 2023-11-15T02:53:22.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.703+0000 7f6ab359e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ab4062ec0 0x7f6ab40657e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.703+0000 7f6ab359e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab4066a80 con 0x7f6ab4157dd0 2023-11-15T02:53:22.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.703+0000 7f6ab359e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab4066f10 con 0x7f6ab41579f0 2023-11-15T02:53:22.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.703+0000 7f6ab359e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab4065e70 con 0x7f6ab4062ec0 2023-11-15T02:53:22.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.703+0000 7f6ab1d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6ab4157dd0 0x7f6ab40a4870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57212/0 (socket says 172.21.15.1:57212) 2023-11-15T02:53:22.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.704+0000 7f6ab1d9b700 1 -- 172.21.15.1:0/1946108003 learned_addr learned my addr 172.21.15.1:0/1946108003 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:22.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.704+0000 7f6ab2d9d700 1 --2- 172.21.15.1:0/1946108003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ab4062ec0 0x7f6ab40657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.704+0000 7f6ab159a700 1 -- 172.21.15.1:0/1946108003 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226405769 0 0) 0x7f6ab4066a80 con 0x7f6ab4157dd0 2023-11-15T02:53:22.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.704+0000 7f6ab159a700 1 -- 172.21.15.1:0/1946108003 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a9c0033f0 con 0x7f6ab4157dd0 2023-11-15T02:53:22.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.704+0000 7f6ab159a700 1 -- 172.21.15.1:0/1946108003 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629935883 0 0) 0x7f6ab4066f10 con 0x7f6ab41579f0 2023-11-15T02:53:22.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.704+0000 7f6ab159a700 1 -- 172.21.15.1:0/1946108003 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab4066a80 con 0x7f6ab41579f0 2023-11-15T02:53:22.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.704+0000 7f6ab2d9d700 1 -- 172.21.15.1:0/1946108003 >> v1:172.21.15.141:6789/0 conn(0x7f6ab41579f0 legacy=0x7f6ab40627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.704+0000 7f6ab2d9d700 1 -- 172.21.15.1:0/1946108003 >> v1:172.21.15.1:6789/0 conn(0x7f6ab4157dd0 legacy=0x7f6ab40a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.704+0000 7f6ab2d9d700 1 -- 172.21.15.1:0/1946108003 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab4066150 con 0x7f6ab4062ec0 2023-11-15T02:53:22.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.704+0000 7f6ab2d9d700 1 --2- 172.21.15.1:0/1946108003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ab4062ec0 0x7f6ab40657e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f6aac009e90 tx=0x7f6aac009780).ready entity=mon.2 client_cookie=3fd1ec605ea47a28 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:22.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.704+0000 7f6ab159a700 1 -- 172.21.15.1:0/1946108003 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac00e070 con 0x7f6ab4062ec0 2023-11-15T02:53:22.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.704+0000 7f6ab159a700 1 -- 172.21.15.1:0/1946108003 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac00bab0 con 0x7f6ab4062ec0 2023-11-15T02:53:22.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.704+0000 7f6ab159a700 1 -- 172.21.15.1:0/1946108003 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac00be30 con 0x7f6ab4062ec0 2023-11-15T02:53:22.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.705+0000 7f6ab359e700 1 -- 172.21.15.1:0/1946108003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ab4062ec0 msgr2=0x7f6ab40657e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.705+0000 7f6ab359e700 1 --2- 172.21.15.1:0/1946108003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ab4062ec0 0x7f6ab40657e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f6aac009e90 tx=0x7f6aac009780).stop 2023-11-15T02:53:22.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.705+0000 7f6ab359e700 1 -- 172.21.15.1:0/1946108003 shutdown_connections 2023-11-15T02:53:22.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.705+0000 7f6ab359e700 1 --2- 172.21.15.1:0/1946108003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ab4062ec0 0x7f6ab40657e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.705+0000 7f6ab359e700 1 -- 172.21.15.1:0/1946108003 >> 172.21.15.1:0/1946108003 conn(0x7f6ab40c7c10 msgr2=0x7f6ab40c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:22.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.705+0000 7f6ab359e700 1 -- 172.21.15.1:0/1946108003 shutdown_connections 2023-11-15T02:53:22.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.705+0000 7f6ab359e700 1 -- 172.21.15.1:0/1946108003 wait complete. 2023-11-15T02:53:22.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.706+0000 7f6ab359e700 1 Processor -- start 2023-11-15T02:53:22.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.706+0000 7f6ab359e700 1 -- start start 2023-11-15T02:53:22.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab359e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ab4062ec0 0x7f6ab40a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab359e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ab41579f0 0x7f6ab41504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab359e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ab4157dd0 0x7f6ab41509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab359e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab4150ea0 con 0x7f6ab4062ec0 2023-11-15T02:53:22.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab359e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40aca50 con 0x7f6ab4157dd0 2023-11-15T02:53:22.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab359e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40acd30 con 0x7f6ab41579f0 2023-11-15T02:53:22.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ab4062ec0 0x7f6ab40a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ab4062ec0 0x7f6ab40a9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55468/0 (socket says 172.21.15.1:55468) 2023-11-15T02:53:22.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab259c700 1 -- 172.21.15.1:0/3800783312 learned_addr learned my addr 172.21.15.1:0/3800783312 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:22.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab1d9b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ab41579f0 0x7f6ab41504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab2d9d700 1 --2- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ab4157dd0 0x7f6ab41509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:22.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab1d9b700 1 -- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ab4157dd0 msgr2=0x7f6ab41509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab1d9b700 1 --2- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ab4157dd0 0x7f6ab41509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab1d9b700 1 -- 172.21.15.1:0/3800783312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ab4062ec0 msgr2=0x7f6ab40a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab1d9b700 1 --2- 172.21.15.1:0/3800783312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ab4062ec0 0x7f6ab40a9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab1d9b700 1 -- 172.21.15.1:0/3800783312 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac009a20 con 0x7f6ab41579f0 2023-11-15T02:53:22.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.707+0000 7f6ab259c700 1 --2- 172.21.15.1:0/3800783312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ab4062ec0 0x7f6ab40a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:53:22.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.708+0000 7f6ab1d9b700 1 --2- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ab41579f0 0x7f6ab41504c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f6aa800c3f0 tx=0x7f6aa8007bf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:22.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.708+0000 7f6aa27fc700 1 -- 172.21.15.1:0/3800783312 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa80070d0 con 0x7f6ab41579f0 2023-11-15T02:53:22.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.708+0000 7f6aa27fc700 1 -- 172.21.15.1:0/3800783312 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa8007230 con 0x7f6ab41579f0 2023-11-15T02:53:22.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.708+0000 7f6ab359e700 1 -- 172.21.15.1:0/3800783312 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab40ad010 con 0x7f6ab41579f0 2023-11-15T02:53:22.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.708+0000 7f6aa27fc700 1 -- 172.21.15.1:0/3800783312 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa80075b0 con 0x7f6ab41579f0 2023-11-15T02:53:22.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.708+0000 7f6ab359e700 1 -- 172.21.15.1:0/3800783312 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab40aa3d0 con 0x7f6ab41579f0 2023-11-15T02:53:22.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.709+0000 7f6ab359e700 1 -- 172.21.15.1:0/3800783312 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab40475e0 con 0x7f6ab41579f0 2023-11-15T02:53:22.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.709+0000 7f6aa27fc700 1 -- 172.21.15.1:0/3800783312 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f6aa80059b0 con 0x7f6ab41579f0 2023-11-15T02:53:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.709+0000 7f6aa27fc700 1 --2- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6a9405f270 0x7f6a94061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.710+0000 7f6aa27fc700 1 -- 172.21.15.1:0/3800783312 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 7190+0+0 (secure 0 0 0) 0x7f6aa8079da0 con 0x7f6ab41579f0 2023-11-15T02:53:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.710+0000 7f6ab259c700 1 -- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6a9405f270 msgr2=0x7f6a94061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.710+0000 7f6ab259c700 1 --2- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6a9405f270 0x7f6a94061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:53:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.714+0000 7f6aa27fc700 1 -- 172.21.15.1:0/3800783312 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6aa804aac0 con 0x7f6ab41579f0 2023-11-15T02:53:22.743 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:22.742+0000 7f689ce92680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:53:22.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.911+0000 7f6ab259c700 1 -- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6a9405f270 msgr2=0x7f6a94061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:22.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.911+0000 7f6ab259c700 1 --2- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6a9405f270 0x7f6a94061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:53:22.927 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:22.926+0000 7f689ce92680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:53:22.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.929+0000 7f6ab359e700 1 -- 172.21.15.1:0/3800783312 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ab40ace70 con 0x7f6ab41579f0 2023-11-15T02:53:22.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.930+0000 7f6aa27fc700 1 -- 172.21.15.1:0/3800783312 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f6ab40ace70 con 0x7f6ab41579f0 2023-11-15T02:53:22.932 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:22.932 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3282299930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3282299930},{"type":"v1","addr":"172.21.15.141:6837","nonce":3282299930}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":8281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3059700101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3059700101},{"type":"v1","addr":"172.21.15.141:6836","nonce":3059700101}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9057,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2954825492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2954825492},{"type":"v1","addr":"172.21.15.1:6834","nonce":2954825492}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:37:11.505391+0000","modified":"2023-11-15T02:37:14.517313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9060":{"gid":9060,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3330049946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3330049946},{"type":"v1","addr":"172.21.15.1:6835","nonce":3330049946}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-11-15T02:53:22.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.932+0000 7f6ab359e700 1 -- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6a9405f270 msgr2=0x7f6a94061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:53:22.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.932+0000 7f6ab359e700 1 --2- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6a9405f270 0x7f6a94061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:22.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.932+0000 7f6ab359e700 1 -- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ab41579f0 msgr2=0x7f6ab41504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:22.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.932+0000 7f6ab359e700 1 --2- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ab41579f0 0x7f6ab41504c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f6aa800c3f0 tx=0x7f6aa8007bf0).stop 2023-11-15T02:53:22.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.932+0000 7f6ab359e700 1 -- 172.21.15.1:0/3800783312 shutdown_connections 2023-11-15T02:53:22.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.932+0000 7f6ab359e700 1 --2- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6a9405f270 0x7f6a94061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:22.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.932+0000 7f6ab359e700 1 --2- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ab4157dd0 0x7f6ab41509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.932+0000 7f6ab359e700 1 --2- 172.21.15.1:0/3800783312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ab4062ec0 0x7f6ab40a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.932+0000 7f6ab359e700 1 --2- 172.21.15.1:0/3800783312 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ab41579f0 0x7f6ab41504c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:22.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.932+0000 7f6ab359e700 1 -- 172.21.15.1:0/3800783312 >> 172.21.15.1:0/3800783312 conn(0x7f6ab40c7c10 msgr2=0x7f6ab4155e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:22.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.932+0000 7f6ab359e700 1 -- 172.21.15.1:0/3800783312 shutdown_connections 2023-11-15T02:53:22.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:22.932+0000 7f6ab359e700 1 -- 172.21.15.1:0/3800783312 wait complete. 2023-11-15T02:53:22.937 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 79 2023-11-15T02:53:22.940 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:22.938+0000 7f1d16738680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:53:22.947 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:53:23.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.067+0000 7f56a0197700 1 Processor -- start 2023-11-15T02:53:23.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.067+0000 7f56a0197700 1 -- start start 2023-11-15T02:53:23.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.068+0000 7f56a0197700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5698154150 0x7f5698154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.068+0000 7f56a0197700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56980c06f0 con 0x7f56980aa060 2023-11-15T02:53:23.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.068+0000 7f56a0197700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56980c09d0 con 0x7f56980ab1a0 2023-11-15T02:53:23.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.068+0000 7f56a0197700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5698158820 con 0x7f5698154150 2023-11-15T02:53:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.068+0000 7f569df33700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5698154150 0x7f5698154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.068+0000 7f569e734700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f56980aa060 0x7f56980c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57224/0 (socket says 172.21.15.1:57224) 2023-11-15T02:53:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.068+0000 7f569e734700 1 -- 172.21.15.1:0/3802306804 learned_addr learned my addr 172.21.15.1:0/3802306804 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.068+0000 7f569df33700 1 -- 172.21.15.1:0/3802306804 >> v1:172.21.15.141:6789/0 conn(0x7f56980ab1a0 legacy=0x7f5698158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.068+0000 7f569df33700 1 -- 172.21.15.1:0/3802306804 >> v1:172.21.15.1:6789/0 conn(0x7f56980aa060 legacy=0x7f56980c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:23.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.068+0000 7f569df33700 1 -- 172.21.15.1:0/3802306804 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5698158b00 con 0x7f5698154150 2023-11-15T02:53:23.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.068+0000 7f569cf31700 1 -- 172.21.15.1:0/3802306804 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283571916 0 0) 0x7f56980c06f0 con 0x7f56980aa060 2023-11-15T02:53:23.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.068+0000 7f569df33700 1 --2- 172.21.15.1:0/3802306804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5698154150 0x7f5698154530 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7f5694009760 tx=0x7f5694009060).ready entity=mon.0 client_cookie=1f8263c954c156b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:23.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.068+0000 7f569cf31700 1 -- 172.21.15.1:0/3802306804 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694009120 con 0x7f5698154150 2023-11-15T02:53:23.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.069+0000 7f569cf31700 1 -- 172.21.15.1:0/3802306804 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569400b580 con 0x7f5698154150 2023-11-15T02:53:23.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.069+0000 7f569cf31700 1 -- 172.21.15.1:0/3802306804 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400b900 con 0x7f5698154150 2023-11-15T02:53:23.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.069+0000 7f56a0197700 1 -- 172.21.15.1:0/3802306804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5698154150 msgr2=0x7f5698154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:23.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.069+0000 7f56a0197700 1 --2- 172.21.15.1:0/3802306804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5698154150 0x7f5698154530 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7f5694009760 tx=0x7f5694009060).stop 2023-11-15T02:53:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.069+0000 7f56a0197700 1 -- 172.21.15.1:0/3802306804 shutdown_connections 2023-11-15T02:53:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.069+0000 7f56a0197700 1 --2- 172.21.15.1:0/3802306804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5698154150 0x7f5698154530 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.069+0000 7f56a0197700 1 -- 172.21.15.1:0/3802306804 >> 172.21.15.1:0/3802306804 conn(0x7f5698064aa0 msgr2=0x7f5698064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.069+0000 7f56a0197700 1 -- 172.21.15.1:0/3802306804 shutdown_connections 2023-11-15T02:53:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.069+0000 7f56a0197700 1 -- 172.21.15.1:0/3802306804 wait complete. 2023-11-15T02:53:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.070+0000 7f56a0197700 1 Processor -- start 2023-11-15T02:53:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.070+0000 7f56a0197700 1 -- start start 2023-11-15T02:53:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.071+0000 7f56a0197700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56980aa060 0x7f5698144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.071+0000 7f56a0197700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56980ab1a0 0x7f5698156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.071+0000 7f56a0197700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5698154150 0x7f5698156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.071+0000 7f56a0197700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5698156f30 con 0x7f56980aa060 2023-11-15T02:53:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.071+0000 7f56a0197700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56980c24b0 con 0x7f56980ab1a0 2023-11-15T02:53:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.071+0000 7f56a0197700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56980aea10 con 0x7f5698154150 2023-11-15T02:53:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.071+0000 7f569df33700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56980aa060 0x7f5698144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.071+0000 7f569df33700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56980aa060 0x7f5698144c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55486/0 (socket says 172.21.15.1:55486) 2023-11-15T02:53:23.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.071+0000 7f569df33700 1 -- 172.21.15.1:0/878596788 learned_addr learned my addr 172.21.15.1:0/878596788 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:23.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.071+0000 7f569e734700 1 --2- 172.21.15.1:0/878596788 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5698154150 0x7f5698156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:23.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.071+0000 7f569d732700 1 --2- 172.21.15.1:0/878596788 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56980ab1a0 0x7f5698156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:23.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.072+0000 7f569df33700 1 -- 172.21.15.1:0/878596788 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5698154150 msgr2=0x7f5698156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:23.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.072+0000 7f569df33700 1 --2- 172.21.15.1:0/878596788 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5698154150 0x7f5698156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.072+0000 7f569df33700 1 -- 172.21.15.1:0/878596788 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56980ab1a0 msgr2=0x7f5698156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:23.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.072+0000 7f569df33700 1 --2- 172.21.15.1:0/878596788 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56980ab1a0 0x7f5698156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.072+0000 7f569df33700 1 -- 172.21.15.1:0/878596788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56940092a0 con 0x7f56980aa060 2023-11-15T02:53:23.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.072+0000 7f569df33700 1 --2- 172.21.15.1:0/878596788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56980aa060 0x7f5698144c40 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f5694009eb0 tx=0x7f5694017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:23.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.072+0000 7f568dffb700 1 -- 172.21.15.1:0/878596788 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400b900 con 0x7f56980aa060 2023-11-15T02:53:23.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.072+0000 7f568dffb700 1 -- 172.21.15.1:0/878596788 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569400bcc0 con 0x7f56980aa060 2023-11-15T02:53:23.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.072+0000 7f56a0197700 1 -- 172.21.15.1:0/878596788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5698155740 con 0x7f56980aa060 2023-11-15T02:53:23.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.072+0000 7f568dffb700 1 -- 172.21.15.1:0/878596788 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569401b440 con 0x7f56980aa060 2023-11-15T02:53:23.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.072+0000 7f56a0197700 1 -- 172.21.15.1:0/878596788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5698155d00 con 0x7f56980aa060 2023-11-15T02:53:23.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.073+0000 7f56a0197700 1 -- 172.21.15.1:0/878596788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569806c7e0 con 0x7f56980aa060 2023-11-15T02:53:23.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.074+0000 7f568dffb700 1 -- 172.21.15.1:0/878596788 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f569401b830 con 0x7f56980aa060 2023-11-15T02:53:23.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.074+0000 7f568dffb700 1 --2- 172.21.15.1:0/878596788 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f567c05f270 0x7f567c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.074+0000 7f568dffb700 1 -- 172.21.15.1:0/878596788 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 7190+0+0 (secure 0 0 0) 0x7f569407be90 con 0x7f56980aa060 2023-11-15T02:53:23.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.074+0000 7f569d732700 1 -- 172.21.15.1:0/878596788 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f567c05f270 msgr2=0x7f567c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:23.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.074+0000 7f569d732700 1 --2- 172.21.15.1:0/878596788 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f567c05f270 0x7f567c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:53:23.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.078+0000 7f568dffb700 1 -- 172.21.15.1:0/878596788 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f569404cb50 con 0x7f56980aa060 2023-11-15T02:53:23.137 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:23.136+0000 7f1d16738680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:53:23.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.252+0000 7f56a0197700 1 -- 172.21.15.1:0/878596788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56980c5a50 con 0x7f56980aa060 2023-11-15T02:53:23.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.253+0000 7f568dffb700 1 -- 172.21.15.1:0/878596788 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+18534 (secure 0 0 0) 0x7f5694028090 con 0x7f56980aa060 2023-11-15T02:53:23.256 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:23.256 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":182,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:53:21.250337+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:37:09.163204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-11-15T02:37:10.486624+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":182,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.5","mappings":[{"from":4,"to":3}]},{"pgid":"22.4","mappings":[{"from":3,"to":0}]},{"pgid":"22.5","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/573779117":"2023-11-16T02:48:21.409186+0000","172.21.15.141:0/4241902942":"2023-11-16T02:48:21.409186+0000","172.21.15.141:0/13260862":"2023-11-16T02:48:21.409186+0000","172.21.15.141:6833/90546":"2023-11-16T02:37:27.844602+0000","172.21.15.141:6832/90546":"2023-11-16T02:37:27.844602+0000","172.21.15.141:0/466988614":"2023-11-16T02:48:21.409186+0000","172.21.15.141:0/3793776780":"2023-11-16T02:37:27.844602+0000","172.21.15.141:0/3172941413":"2023-11-16T02:37:27.844602+0000","172.21.15.141:0/4259245798":"2023-11-16T02:37:27.844602+0000","172.21.15.141:0/1504595735":"2023-11-16T02:37:27.844602+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:53:23.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.255+0000 7f56a0197700 1 -- 172.21.15.1:0/878596788 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f567c05f270 msgr2=0x7f567c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:53:23.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.255+0000 7f56a0197700 1 --2- 172.21.15.1:0/878596788 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f567c05f270 0x7f567c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:23.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.255+0000 7f56a0197700 1 -- 172.21.15.1:0/878596788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56980aa060 msgr2=0x7f5698144c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:23.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.255+0000 7f56a0197700 1 --2- 172.21.15.1:0/878596788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56980aa060 0x7f5698144c40 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f5694009eb0 tx=0x7f5694017000).stop 2023-11-15T02:53:23.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.255+0000 7f56a0197700 1 -- 172.21.15.1:0/878596788 shutdown_connections 2023-11-15T02:53:23.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.255+0000 7f56a0197700 1 --2- 172.21.15.1:0/878596788 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f567c05f270 0x7f567c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:23.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.255+0000 7f56a0197700 1 --2- 172.21.15.1:0/878596788 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5698154150 0x7f5698156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.255+0000 7f56a0197700 1 --2- 172.21.15.1:0/878596788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56980aa060 0x7f5698144c40 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.255+0000 7f56a0197700 1 --2- 172.21.15.1:0/878596788 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56980ab1a0 0x7f5698156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.255+0000 7f56a0197700 1 -- 172.21.15.1:0/878596788 >> 172.21.15.1:0/878596788 conn(0x7f5698064aa0 msgr2=0x7f5698152de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:23.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.255+0000 7f56a0197700 1 -- 172.21.15.1:0/878596788 shutdown_connections 2023-11-15T02:53:23.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.255+0000 7f56a0197700 1 -- 172.21.15.1:0/878596788 wait complete. 2023-11-15T02:53:23.270 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-15T02:53:23.271 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:53:23.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.389+0000 7f43e9346700 1 Processor -- start 2023-11-15T02:53:23.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.389+0000 7f43e9346700 1 -- start start 2023-11-15T02:53:23.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e9346700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f43e40833a0 0x7f43e40a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e9346700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43e40be520 0x7f43e4154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e9346700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e40a85e0 con 0x7f43e4154450 2023-11-15T02:53:23.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e9346700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e4065940 con 0x7f43e40833a0 2023-11-15T02:53:23.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e9346700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e4065660 con 0x7f43e40be520 2023-11-15T02:53:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e27fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f43e40833a0 0x7f43e40a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e27fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f43e40833a0 0x7f43e40a7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55500/0 (socket says 172.21.15.1:55500) 2023-11-15T02:53:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e27fc700 1 -- 172.21.15.1:0/1211426710 learned_addr learned my addr 172.21.15.1:0/1211426710 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e37fe700 1 --2- 172.21.15.1:0/1211426710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43e40be520 0x7f43e4154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e27fc700 1 -- 172.21.15.1:0/1211426710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43e40be520 msgr2=0x7f43e4154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:23.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e27fc700 1 --2- 172.21.15.1:0/1211426710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43e40be520 0x7f43e4154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e27fc700 1 -- 172.21.15.1:0/1211426710 >> v1:172.21.15.141:6789/0 conn(0x7f43e4154450 legacy=0x7f43e40bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:23.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e27fc700 1 -- 172.21.15.1:0/1211426710 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e40c6f50 con 0x7f43e40833a0 2023-11-15T02:53:23.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e37fe700 1 --2- 172.21.15.1:0/1211426710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43e40be520 0x7f43e4154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:53:23.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e27fc700 1 --2- 172.21.15.1:0/1211426710 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43e40833a0 0x7f43e40a7ef0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f43d8006fd0 tx=0x7f43d80090f0).ready entity=mon.0 client_cookie=14fc7c8944b6b36d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:23.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e1ffb700 1 -- 172.21.15.1:0/1211426710 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d800b600 con 0x7f43e40833a0 2023-11-15T02:53:23.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e1ffb700 1 -- 172.21.15.1:0/1211426710 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d800b760 con 0x7f43e40833a0 2023-11-15T02:53:23.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.390+0000 7f43e1ffb700 1 -- 172.21.15.1:0/1211426710 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d800bae0 con 0x7f43e40833a0 2023-11-15T02:53:23.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.391+0000 7f43e9346700 1 -- 172.21.15.1:0/1211426710 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43e40833a0 msgr2=0x7f43e40a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:23.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.391+0000 7f43e9346700 1 --2- 172.21.15.1:0/1211426710 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43e40833a0 0x7f43e40a7ef0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f43d8006fd0 tx=0x7f43d80090f0).stop 2023-11-15T02:53:23.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.391+0000 7f43e9346700 1 -- 172.21.15.1:0/1211426710 shutdown_connections 2023-11-15T02:53:23.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.391+0000 7f43e9346700 1 --2- 172.21.15.1:0/1211426710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43e40be520 0x7f43e4154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.391+0000 7f43e9346700 1 --2- 172.21.15.1:0/1211426710 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43e40833a0 0x7f43e40a7ef0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.391+0000 7f43e9346700 1 -- 172.21.15.1:0/1211426710 >> 172.21.15.1:0/1211426710 conn(0x7f43e4082f90 msgr2=0x7f43e40c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:23.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.391+0000 7f43e9346700 1 -- 172.21.15.1:0/1211426710 shutdown_connections 2023-11-15T02:53:23.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.391+0000 7f43e9346700 1 -- 172.21.15.1:0/1211426710 wait complete. 2023-11-15T02:53:23.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.392+0000 7f43e9346700 1 Processor -- start 2023-11-15T02:53:23.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.392+0000 7f43e9346700 1 -- start start 2023-11-15T02:53:23.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.393+0000 7f43e9346700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43e40833a0 0x7f43e414ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.393+0000 7f43e9346700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e40be520 0x7f43e40a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.393+0000 7f43e9346700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43e4154450 0x7f43e40a73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.393+0000 7f43e9346700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40a6a30 con 0x7f43e4154450 2023-11-15T02:53:23.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.393+0000 7f43e9346700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40a5e60 con 0x7f43e40be520 2023-11-15T02:53:23.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.393+0000 7f43e9346700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40a6100 con 0x7f43e40833a0 2023-11-15T02:53:23.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.393+0000 7f43e37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43e4154450 0x7f43e40a73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:23.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.393+0000 7f43e37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43e4154450 0x7f43e40a73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55506/0 (socket says 172.21.15.1:55506) 2023-11-15T02:53:23.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.393+0000 7f43e37fe700 1 -- 172.21.15.1:0/30082901 learned_addr learned my addr 172.21.15.1:0/30082901 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:23.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.393+0000 7f43e2ffd700 1 --2- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43e40833a0 0x7f43e414ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:23.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.393+0000 7f43e27fc700 1 --2- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e40be520 0x7f43e40a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:23.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.394+0000 7f43e37fe700 1 -- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43e40833a0 msgr2=0x7f43e414ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:23.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.394+0000 7f43e37fe700 1 --2- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43e40833a0 0x7f43e414ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.394+0000 7f43e37fe700 1 -- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e40be520 msgr2=0x7f43e40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:23.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.394+0000 7f43e37fe700 1 --2- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e40be520 0x7f43e40a6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.394+0000 7f43e37fe700 1 -- 172.21.15.1:0/30082901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d8009370 con 0x7f43e4154450 2023-11-15T02:53:23.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.394+0000 7f43e37fe700 1 --2- 172.21.15.1:0/30082901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43e4154450 0x7f43e40a73b0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f43dc00d150 tx=0x7f43dc009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:23.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.394+0000 7f43caffd700 1 -- 172.21.15.1:0/30082901 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc00dc90 con 0x7f43e4154450 2023-11-15T02:53:23.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.394+0000 7f43caffd700 1 -- 172.21.15.1:0/30082901 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc00f040 con 0x7f43e4154450 2023-11-15T02:53:23.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.394+0000 7f43e9346700 1 -- 172.21.15.1:0/30082901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e40a63e0 con 0x7f43e4154450 2023-11-15T02:53:23.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.394+0000 7f43caffd700 1 -- 172.21.15.1:0/30082901 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc0133f0 con 0x7f43e4154450 2023-11-15T02:53:23.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.394+0000 7f43e9346700 1 -- 172.21.15.1:0/30082901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e414f1c0 con 0x7f43e4154450 2023-11-15T02:53:23.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.395+0000 7f43e9346700 1 -- 172.21.15.1:0/30082901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e414f410 con 0x7f43e4154450 2023-11-15T02:53:23.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.395+0000 7f43caffd700 1 -- 172.21.15.1:0/30082901 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f43dc0137e0 con 0x7f43e4154450 2023-11-15T02:53:23.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.396+0000 7f43caffd700 1 --2- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43d005f270 0x7f43d0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.396+0000 7f43caffd700 1 -- 172.21.15.1:0/30082901 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 7190+0+0 (secure 0 0 0) 0x7f43dc07ae20 con 0x7f43e4154450 2023-11-15T02:53:23.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.396+0000 7f43e2ffd700 1 -- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43d005f270 msgr2=0x7f43d0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:23.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.396+0000 7f43e2ffd700 1 --2- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43d005f270 0x7f43d0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:53:23.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.404+0000 7f43caffd700 1 -- 172.21.15.1:0/30082901 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f43dc04bae0 con 0x7f43e4154450 2023-11-15T02:53:23.575 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:23.574+0000 7f689ce92680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:53:23.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.597+0000 7f43e2ffd700 1 -- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43d005f270 msgr2=0x7f43d0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:23.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.597+0000 7f43e2ffd700 1 --2- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43d005f270 0x7f43d0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:53:23.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.621+0000 7f43e9346700 1 -- 172.21.15.1:0/30082901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43e406c7e0 con 0x7f43e4154450 2023-11-15T02:53:23.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.621+0000 7f43caffd700 1 -- 172.21.15.1:0/30082901 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f43dc04f100 con 0x7f43e4154450 2023-11-15T02:53:23.624 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:23.624 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3282299930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3282299930},{"type":"v1","addr":"172.21.15.141:6837","nonce":3282299930}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":8281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3059700101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3059700101},{"type":"v1","addr":"172.21.15.141:6836","nonce":3059700101}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9057,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2954825492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2954825492},{"type":"v1","addr":"172.21.15.1:6834","nonce":2954825492}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:37:11.505391+0000","modified":"2023-11-15T02:37:14.517313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9060":{"gid":9060,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3330049946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3330049946},{"type":"v1","addr":"172.21.15.1:6835","nonce":3330049946}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-11-15T02:53:23.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.623+0000 7f43e9346700 1 -- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43d005f270 msgr2=0x7f43d0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:53:23.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.623+0000 7f43e9346700 1 --2- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43d005f270 0x7f43d0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:23.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.623+0000 7f43e9346700 1 -- 172.21.15.1:0/30082901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43e4154450 msgr2=0x7f43e40a73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:23.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.623+0000 7f43e9346700 1 --2- 172.21.15.1:0/30082901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43e4154450 0x7f43e40a73b0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f43dc00d150 tx=0x7f43dc009a50).stop 2023-11-15T02:53:23.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.623+0000 7f43e9346700 1 -- 172.21.15.1:0/30082901 shutdown_connections 2023-11-15T02:53:23.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.623+0000 7f43e9346700 1 --2- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43d005f270 0x7f43d0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:23.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.623+0000 7f43e9346700 1 --2- 172.21.15.1:0/30082901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43e4154450 0x7f43e40a73b0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.623+0000 7f43e9346700 1 --2- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43e40833a0 0x7f43e414ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.623+0000 7f43e9346700 1 --2- 172.21.15.1:0/30082901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43e40be520 0x7f43e40a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.623+0000 7f43e9346700 1 -- 172.21.15.1:0/30082901 >> 172.21.15.1:0/30082901 conn(0x7f43e4082f90 msgr2=0x7f43e40c48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:23.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.624+0000 7f43e9346700 1 -- 172.21.15.1:0/30082901 shutdown_connections 2023-11-15T02:53:23.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.624+0000 7f43e9346700 1 -- 172.21.15.1:0/30082901 wait complete. 2023-11-15T02:53:23.628 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 79 2023-11-15T02:53:23.638 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:53:23.643 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:23.642+0000 7f689ce92680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:53:23.718 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:23.717+0000 7f689ce92680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:53:23.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.760+0000 7fe4da047700 1 Processor -- start 2023-11-15T02:53:23.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.760+0000 7fe4da047700 1 -- start start 2023-11-15T02:53:23.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.760+0000 7fe4da047700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4d413a860 0x7fe4d40c5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4da047700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe4d4062ec0 0x7fe4d4066540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4da047700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d40660b0 con 0x7fe4d40c2ed0 2023-11-15T02:53:23.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4da047700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d40c7500 con 0x7fe4d4062ec0 2023-11-15T02:53:23.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4da047700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d40c77e0 con 0x7fe4d413a860 2023-11-15T02:53:23.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4d3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe4d4062ec0 0x7fe4d4066540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:23.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4caffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe4d40c2ed0 0x7fe4d40627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57240/0 (socket says 172.21.15.1:57240) 2023-11-15T02:53:23.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4caffd700 1 -- 172.21.15.1:0/2604926592 learned_addr learned my addr 172.21.15.1:0/2604926592 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:23.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4d3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe4d4062ec0 0x7fe4d4066540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55508/0 (socket says 172.21.15.1:55508) 2023-11-15T02:53:23.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4d37fe700 1 --2- 172.21.15.1:0/2604926592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4d413a860 0x7fe4d40c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:23.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4d2ffd700 1 -- 172.21.15.1:0/2604926592 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559330730 0 0) 0x7fe4d40660b0 con 0x7fe4d40c2ed0 2023-11-15T02:53:23.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4d2ffd700 1 -- 172.21.15.1:0/2604926592 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c00033f0 con 0x7fe4d40c2ed0 2023-11-15T02:53:23.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4d3fff700 1 -- 172.21.15.1:0/2604926592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4d413a860 msgr2=0x7fe4d40c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:23.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4d3fff700 1 --2- 172.21.15.1:0/2604926592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4d413a860 0x7fe4d40c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4d3fff700 1 -- 172.21.15.1:0/2604926592 >> v1:172.21.15.1:6789/0 conn(0x7fe4d40c2ed0 legacy=0x7fe4d40627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:23.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4d3fff700 1 -- 172.21.15.1:0/2604926592 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d40c7ac0 con 0x7fe4d4062ec0 2023-11-15T02:53:23.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4d3fff700 1 --2- 172.21.15.1:0/2604926592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4d4062ec0 0x7fe4d4066540 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7fe4cc009e60 tx=0x7fe4cc009780).ready entity=mon.0 client_cookie=707bb44c5106ff3d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:23.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.761+0000 7fe4d2ffd700 1 -- 172.21.15.1:0/2604926592 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc00e070 con 0x7fe4d4062ec0 2023-11-15T02:53:23.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.762+0000 7fe4d2ffd700 1 -- 172.21.15.1:0/2604926592 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc00bab0 con 0x7fe4d4062ec0 2023-11-15T02:53:23.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.762+0000 7fe4d2ffd700 1 -- 172.21.15.1:0/2604926592 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc00be30 con 0x7fe4d4062ec0 2023-11-15T02:53:23.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.762+0000 7fe4da047700 1 -- 172.21.15.1:0/2604926592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4d4062ec0 msgr2=0x7fe4d4066540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:23.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.762+0000 7fe4da047700 1 --2- 172.21.15.1:0/2604926592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4d4062ec0 0x7fe4d4066540 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7fe4cc009e60 tx=0x7fe4cc009780).stop 2023-11-15T02:53:23.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.762+0000 7fe4da047700 1 -- 172.21.15.1:0/2604926592 shutdown_connections 2023-11-15T02:53:23.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.762+0000 7fe4da047700 1 --2- 172.21.15.1:0/2604926592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4d4062ec0 0x7fe4d4066540 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.762+0000 7fe4da047700 1 --2- 172.21.15.1:0/2604926592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4d413a860 0x7fe4d40c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.762+0000 7fe4da047700 1 -- 172.21.15.1:0/2604926592 >> 172.21.15.1:0/2604926592 conn(0x7fe4d40c88e0 msgr2=0x7fe4d40c48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:23.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.762+0000 7fe4da047700 1 -- 172.21.15.1:0/2604926592 shutdown_connections 2023-11-15T02:53:23.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.762+0000 7fe4da047700 1 -- 172.21.15.1:0/2604926592 wait complete. 2023-11-15T02:53:23.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.763+0000 7fe4da047700 1 Processor -- start 2023-11-15T02:53:23.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.764+0000 7fe4da047700 1 -- start start 2023-11-15T02:53:23.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.764+0000 7fe4da047700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4d4062ec0 0x7fe4d40c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.764+0000 7fe4da047700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4d40c2ed0 0x7fe4d40a9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.764+0000 7fe4da047700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4d413a860 0x7fe4d4139820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.764+0000 7fe4da047700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d40a97f0 con 0x7fe4d40c2ed0 2023-11-15T02:53:23.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.764+0000 7fe4da047700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d40aa5f0 con 0x7fe4d413a860 2023-11-15T02:53:23.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.764+0000 7fe4da047700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d40a99e0 con 0x7fe4d4062ec0 2023-11-15T02:53:23.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.764+0000 7fe4caffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4d40c2ed0 0x7fe4d40a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:23.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.764+0000 7fe4caffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4d40c2ed0 0x7fe4d40a9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55510/0 (socket says 172.21.15.1:55510) 2023-11-15T02:53:23.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.765+0000 7fe4caffd700 1 -- 172.21.15.1:0/663439168 learned_addr learned my addr 172.21.15.1:0/663439168 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:23.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.765+0000 7fe4d37fe700 1 --2- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4d4062ec0 0x7fe4d40c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:23.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.765+0000 7fe4d3fff700 1 --2- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4d413a860 0x7fe4d4139820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:23.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.765+0000 7fe4caffd700 1 -- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4d4062ec0 msgr2=0x7fe4d40c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:23.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.765+0000 7fe4caffd700 1 --2- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4d4062ec0 0x7fe4d40c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.765+0000 7fe4caffd700 1 -- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4d413a860 msgr2=0x7fe4d4139820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:23.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.765+0000 7fe4caffd700 1 --2- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4d413a860 0x7fe4d4139820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:23.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.765+0000 7fe4caffd700 1 -- 172.21.15.1:0/663439168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc009a20 con 0x7fe4d40c2ed0 2023-11-15T02:53:23.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.765+0000 7fe4caffd700 1 --2- 172.21.15.1:0/663439168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4d40c2ed0 0x7fe4d40a9300 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7fe4bc00c4c0 tx=0x7fe4bc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:23.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.765+0000 7fe4cbfff700 1 -- 172.21.15.1:0/663439168 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc00ce70 con 0x7fe4d40c2ed0 2023-11-15T02:53:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.765+0000 7fe4cbfff700 1 -- 172.21.15.1:0/663439168 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc0072e0 con 0x7fe4d40c2ed0 2023-11-15T02:53:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.765+0000 7fe4da047700 1 -- 172.21.15.1:0/663439168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d40a9cc0 con 0x7fe4d40c2ed0 2023-11-15T02:53:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.765+0000 7fe4cbfff700 1 -- 172.21.15.1:0/663439168 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0057a0 con 0x7fe4d40c2ed0 2023-11-15T02:53:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.765+0000 7fe4da047700 1 -- 172.21.15.1:0/663439168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d40aa280 con 0x7fe4d40c2ed0 2023-11-15T02:53:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.767+0000 7fe4cbfff700 1 -- 172.21.15.1:0/663439168 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fe4bc005bd0 con 0x7fe4d40c2ed0 2023-11-15T02:53:23.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.767+0000 7fe4da047700 1 -- 172.21.15.1:0/663439168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d406c7e0 con 0x7fe4d40c2ed0 2023-11-15T02:53:23.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.767+0000 7fe4cbfff700 1 --2- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe4b405f270 0x7fe4b4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:23.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.767+0000 7fe4cbfff700 1 -- 172.21.15.1:0/663439168 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 7190+0+0 (secure 0 0 0) 0x7fe4bc079ee0 con 0x7fe4d40c2ed0 2023-11-15T02:53:23.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.767+0000 7fe4d37fe700 1 -- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe4b405f270 msgr2=0x7fe4b4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:23.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.767+0000 7fe4d37fe700 1 --2- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe4b405f270 0x7fe4b4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:53:23.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.771+0000 7fe4cbfff700 1 -- 172.21.15.1:0/663439168 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe4bc04ac00 con 0x7fe4d40c2ed0 2023-11-15T02:53:23.858 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:23.856+0000 7f1d16738680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:53:23.864 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:23.863+0000 7f689ce92680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:53:23.931 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:23.929+0000 7f1d16738680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:53:23.934 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:23.933+0000 7f689ce92680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:53:23.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.968+0000 7fe4d37fe700 1 -- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe4b405f270 msgr2=0x7fe4b4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:23.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:23.968+0000 7fe4d37fe700 1 --2- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe4b405f270 0x7fe4b4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:53:24.011 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:24.009+0000 7f1d16738680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:53:24.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.019+0000 7fe4da047700 1 -- 172.21.15.1:0/663439168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4d4065d40 con 0x7fe4d40c2ed0 2023-11-15T02:53:24.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.020+0000 7fe4cbfff700 1 -- 172.21.15.1:0/663439168 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4493 (secure 0 0 0) 0x7fe4bc04e220 con 0x7fe4d40c2ed0 2023-11-15T02:53:24.022 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:24.023 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3282299930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3282299930},{"type":"v1","addr":"172.21.15.141:6837","nonce":3282299930}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":8281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3059700101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3059700101},{"type":"v1","addr":"172.21.15.141:6836","nonce":3059700101}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9057,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2954825492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2954825492},{"type":"v1","addr":"172.21.15.1:6834","nonce":2954825492}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:37:11.505391+0000","modified":"2023-11-15T02:37:14.517313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9060":{"gid":9060,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3330049946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3330049946},{"type":"v1","addr":"172.21.15.1:6835","nonce":3330049946}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-11-15T02:53:24.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.022+0000 7fe4da047700 1 -- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe4b405f270 msgr2=0x7fe4b4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:53:24.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.022+0000 7fe4da047700 1 --2- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe4b405f270 0x7fe4b4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.022+0000 7fe4da047700 1 -- 172.21.15.1:0/663439168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4d40c2ed0 msgr2=0x7fe4d40a9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.022+0000 7fe4da047700 1 --2- 172.21.15.1:0/663439168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4d40c2ed0 0x7fe4d40a9300 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7fe4bc00c4c0 tx=0x7fe4bc007c50).stop 2023-11-15T02:53:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.022+0000 7fe4da047700 1 -- 172.21.15.1:0/663439168 shutdown_connections 2023-11-15T02:53:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.022+0000 7fe4da047700 1 --2- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe4b405f270 0x7fe4b4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.022+0000 7fe4da047700 1 --2- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4d413a860 0x7fe4d4139820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.022+0000 7fe4da047700 1 --2- 172.21.15.1:0/663439168 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4d4062ec0 0x7fe4d40c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.022+0000 7fe4da047700 1 --2- 172.21.15.1:0/663439168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4d40c2ed0 0x7fe4d40a9300 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.022+0000 7fe4da047700 1 -- 172.21.15.1:0/663439168 >> 172.21.15.1:0/663439168 conn(0x7fe4d40c88e0 msgr2=0x7fe4d40bcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:24.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.022+0000 7fe4da047700 1 -- 172.21.15.1:0/663439168 shutdown_connections 2023-11-15T02:53:24.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.022+0000 7fe4da047700 1 -- 172.21.15.1:0/663439168 wait complete. 2023-11-15T02:53:24.027 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 79 2023-11-15T02:53:24.036 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:53:24.049 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:24.048+0000 7f689ce92680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:53:24.155 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:24.154+0000 7f689ce92680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:53:24.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.155+0000 7f729577d700 1 Processor -- start 2023-11-15T02:53:24.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.155+0000 7f729577d700 1 -- start start 2023-11-15T02:53:24.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.156+0000 7f729577d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7290157d00 0x7f72900c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:24.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.156+0000 7f729577d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f72900bc360 0x7f72900c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:24.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.156+0000 7f729577d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72900633c0 con 0x7f72900c50b0 2023-11-15T02:53:24.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.156+0000 7f729577d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72900627b0 con 0x7f72900bc360 2023-11-15T02:53:24.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.156+0000 7f729577d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7290062a90 con 0x7f7290157d00 2023-11-15T02:53:24.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.156+0000 7f728e7fc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7290157d00 0x7f72900c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:24.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.156+0000 7f728f7fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f72900bc360 0x7f72900c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:24.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.156+0000 7f728e7fc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7290157d00 0x7f72900c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:32922/0 (socket says 172.21.15.1:32922) 2023-11-15T02:53:24.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.156+0000 7f728f7fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f72900bc360 0x7f72900c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:60856/0 (socket says 172.21.15.1:60856) 2023-11-15T02:53:24.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.156+0000 7f728e7fc700 1 -- 172.21.15.1:0/3797330617 learned_addr learned my addr 172.21.15.1:0/3797330617 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:24.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.156+0000 7f728effd700 1 --1- 172.21.15.1:0/3797330617 >> v1:172.21.15.141:6789/0 conn(0x7f72900c50b0 0x7f72900c1990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:45214/0 (socket says 172.21.15.1:45214) 2023-11-15T02:53:24.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.157+0000 7f728e7fc700 1 -- 172.21.15.1:0/3797330617 >> v2:172.21.15.141:3300/0 conn(0x7f72900bc360 msgr2=0x7f72900c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:24.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.157+0000 7f728e7fc700 1 --2- 172.21.15.1:0/3797330617 >> v2:172.21.15.141:3300/0 conn(0x7f72900bc360 0x7f72900c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.157+0000 7f728e7fc700 1 -- 172.21.15.1:0/3797330617 >> v1:172.21.15.141:6789/0 conn(0x7f72900c50b0 legacy=0x7f72900c1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:24.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.157+0000 7f728e7fc700 1 -- 172.21.15.1:0/3797330617 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7290062d70 con 0x7f7290157d00 2023-11-15T02:53:24.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.157+0000 7f728f7fe700 1 --2- 172.21.15.1:0/3797330617 >> v2:172.21.15.141:3300/0 conn(0x7f72900bc360 0x7f72900c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:53:24.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.157+0000 7f728e7fc700 1 --2- 172.21.15.1:0/3797330617 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7290157d00 0x7f72900c6e00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f7280006fd0 tx=0x7f72800090f0).ready entity=mon.2 client_cookie=cdd2177c80c2e319 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:24.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.157+0000 7f728dffb700 1 -- 172.21.15.1:0/3797330617 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728000b580 con 0x7f7290157d00 2023-11-15T02:53:24.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.157+0000 7f728dffb700 1 -- 172.21.15.1:0/3797330617 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728000b6e0 con 0x7f7290157d00 2023-11-15T02:53:24.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.157+0000 7f728dffb700 1 -- 172.21.15.1:0/3797330617 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728000ba60 con 0x7f7290157d00 2023-11-15T02:53:24.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.157+0000 7f729577d700 1 -- 172.21.15.1:0/3797330617 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7290157d00 msgr2=0x7f72900c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:24.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.157+0000 7f729577d700 1 --2- 172.21.15.1:0/3797330617 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7290157d00 0x7f72900c6e00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f7280006fd0 tx=0x7f72800090f0).stop 2023-11-15T02:53:24.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.158+0000 7f729577d700 1 -- 172.21.15.1:0/3797330617 shutdown_connections 2023-11-15T02:53:24.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.158+0000 7f729577d700 1 --2- 172.21.15.1:0/3797330617 >> v2:172.21.15.141:3300/0 conn(0x7f72900bc360 0x7f72900c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.158+0000 7f729577d700 1 --2- 172.21.15.1:0/3797330617 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7290157d00 0x7f72900c6e00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.158+0000 7f729577d700 1 -- 172.21.15.1:0/3797330617 >> 172.21.15.1:0/3797330617 conn(0x7f72900c3e30 msgr2=0x7f72900c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:24.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.158+0000 7f729577d700 1 -- 172.21.15.1:0/3797330617 shutdown_connections 2023-11-15T02:53:24.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.158+0000 7f729577d700 1 -- 172.21.15.1:0/3797330617 wait complete. 2023-11-15T02:53:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.159+0000 7f729577d700 1 Processor -- start 2023-11-15T02:53:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.159+0000 7f729577d700 1 -- start start 2023-11-15T02:53:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f729577d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72900bc360 0x7f729013c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f729577d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72900c50b0 0x7f7290151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:24.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f729577d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7290157d00 0x7f7290151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:24.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f729577d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7290152300 con 0x7f7290157d00 2023-11-15T02:53:24.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f729577d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72900aaa30 con 0x7f72900c50b0 2023-11-15T02:53:24.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f729577d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72900c1440 con 0x7f72900bc360 2023-11-15T02:53:24.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f728f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7290157d00 0x7f7290151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:24.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f728e7fc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72900c50b0 0x7f7290151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:24.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f728e7fc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72900c50b0 0x7f7290151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:60860/0 (socket says 172.21.15.1:60860) 2023-11-15T02:53:24.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f728e7fc700 1 -- 172.21.15.1:0/59465488 learned_addr learned my addr 172.21.15.1:0/59465488 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:24.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f728effd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72900bc360 0x7f729013c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:24.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f728f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7290157d00 0x7f7290151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55524/0 (socket says 172.21.15.1:55524) 2023-11-15T02:53:24.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f728e7fc700 1 -- 172.21.15.1:0/59465488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72900bc360 msgr2=0x7f729013c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:24.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f728e7fc700 1 --2- 172.21.15.1:0/59465488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72900bc360 0x7f729013c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f728e7fc700 1 -- 172.21.15.1:0/59465488 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7290157d00 msgr2=0x7f7290151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:24.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f728e7fc700 1 --2- 172.21.15.1:0/59465488 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7290157d00 0x7f7290151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f728e7fc700 1 -- 172.21.15.1:0/59465488 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7288009a20 con 0x7f72900c50b0 2023-11-15T02:53:24.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f728e7fc700 1 --2- 172.21.15.1:0/59465488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72900c50b0 0x7f7290151920 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f7290062bd0 tx=0x7f7280017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:24.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.160+0000 7f7276ffd700 1 -- 172.21.15.1:0/59465488 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728000b850 con 0x7f72900c50b0 2023-11-15T02:53:24.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.161+0000 7f7276ffd700 1 -- 172.21.15.1:0/59465488 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728000b9b0 con 0x7f72900c50b0 2023-11-15T02:53:24.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.161+0000 7f729577d700 1 -- 172.21.15.1:0/59465488 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7280009370 con 0x7f72900c50b0 2023-11-15T02:53:24.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.161+0000 7f7276ffd700 1 -- 172.21.15.1:0/59465488 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728001c670 con 0x7f72900c50b0 2023-11-15T02:53:24.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.161+0000 7f729577d700 1 -- 172.21.15.1:0/59465488 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72900aa3e0 con 0x7f72900c50b0 2023-11-15T02:53:24.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.161+0000 7f729577d700 1 -- 172.21.15.1:0/59465488 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72900aabe0 con 0x7f72900c50b0 2023-11-15T02:53:24.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.162+0000 7f7276ffd700 1 -- 172.21.15.1:0/59465488 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f728001c9e0 con 0x7f72900c50b0 2023-11-15T02:53:24.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.162+0000 7f7276ffd700 1 --2- 172.21.15.1:0/59465488 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f727c05f2a0 0x7f727c061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:24.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.162+0000 7f728effd700 1 -- 172.21.15.1:0/59465488 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f727c05f2a0 msgr2=0x7f727c061760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:24.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.162+0000 7f7276ffd700 1 -- 172.21.15.1:0/59465488 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 7190+0+0 (secure 0 0 0) 0x7f728007c3e0 con 0x7f72900c50b0 2023-11-15T02:53:24.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.162+0000 7f728effd700 1 --2- 172.21.15.1:0/59465488 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f727c05f2a0 0x7f727c061760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:53:24.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.167+0000 7f7276ffd700 1 -- 172.21.15.1:0/59465488 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f72900aabe0 con 0x7f72900c50b0 2023-11-15T02:53:24.175 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:24.169+0000 7f1d16738680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:53:24.248 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:24.246+0000 7f1d16738680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:53:24.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.343+0000 7f729577d700 1 -- 172.21.15.1:0/59465488 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72900aabe0 con 0x7f72900c50b0 2023-11-15T02:53:24.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.344+0000 7f7276ffd700 1 -- 172.21.15.1:0/59465488 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+18534 (secure 0 0 0) 0x7f72900aabe0 con 0x7f72900c50b0 2023-11-15T02:53:24.346 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:24.347 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":182,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:53:21.250337+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:37:09.163204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-11-15T02:37:10.486624+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":182,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.5","mappings":[{"from":4,"to":3}]},{"pgid":"22.4","mappings":[{"from":3,"to":0}]},{"pgid":"22.5","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/573779117":"2023-11-16T02:48:21.409186+0000","172.21.15.141:0/4241902942":"2023-11-16T02:48:21.409186+0000","172.21.15.141:0/13260862":"2023-11-16T02:48:21.409186+0000","172.21.15.141:6833/90546":"2023-11-16T02:37:27.844602+0000","172.21.15.141:6832/90546":"2023-11-16T02:37:27.844602+0000","172.21.15.141:0/466988614":"2023-11-16T02:48:21.409186+0000","172.21.15.141:0/3793776780":"2023-11-16T02:37:27.844602+0000","172.21.15.141:0/3172941413":"2023-11-16T02:37:27.844602+0000","172.21.15.141:0/4259245798":"2023-11-16T02:37:27.844602+0000","172.21.15.141:0/1504595735":"2023-11-16T02:37:27.844602+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:53:24.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.346+0000 7f729577d700 1 -- 172.21.15.1:0/59465488 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f727c05f2a0 msgr2=0x7f727c061760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:53:24.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.346+0000 7f729577d700 1 --2- 172.21.15.1:0/59465488 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f727c05f2a0 0x7f727c061760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:24.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.346+0000 7f729577d700 1 -- 172.21.15.1:0/59465488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72900c50b0 msgr2=0x7f7290151920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:24.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.346+0000 7f729577d700 1 --2- 172.21.15.1:0/59465488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72900c50b0 0x7f7290151920 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f7290062bd0 tx=0x7f7280017000).stop 2023-11-15T02:53:24.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.346+0000 7f729577d700 1 -- 172.21.15.1:0/59465488 shutdown_connections 2023-11-15T02:53:24.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.346+0000 7f729577d700 1 --2- 172.21.15.1:0/59465488 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f727c05f2a0 0x7f727c061760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:24.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.346+0000 7f729577d700 1 --2- 172.21.15.1:0/59465488 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7290157d00 0x7f7290151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.346+0000 7f729577d700 1 --2- 172.21.15.1:0/59465488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72900bc360 0x7f729013c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.346+0000 7f729577d700 1 --2- 172.21.15.1:0/59465488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f72900c50b0 0x7f7290151920 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.346+0000 7f729577d700 1 -- 172.21.15.1:0/59465488 >> 172.21.15.1:0/59465488 conn(0x7f72900c3e30 msgr2=0x7f72900c1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:24.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.346+0000 7f729577d700 1 -- 172.21.15.1:0/59465488 shutdown_connections 2023-11-15T02:53:24.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.346+0000 7f729577d700 1 -- 172.21.15.1:0/59465488 wait complete. 2023-11-15T02:53:24.361 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-15T02:53:24.373 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:24.371+0000 7f1d16738680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:53:24.447 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:24.446+0000 7f689ce92680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:53:24.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.479+0000 7f5238826700 1 Processor -- start 2023-11-15T02:53:24.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.479+0000 7f5238826700 1 -- start start 2023-11-15T02:53:24.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.481+0000 7f5238826700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f52340bccd0 0x7f52340bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:24.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.481+0000 7f5238826700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52340c60b0 0x7f52340c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:24.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.481+0000 7f5238826700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523406a6b0 con 0x7f5234154680 2023-11-15T02:53:24.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.481+0000 7f5238826700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52340c3360 con 0x7f52340bccd0 2023-11-15T02:53:24.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.481+0000 7f5238826700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52340bd620 con 0x7f52340c60b0 2023-11-15T02:53:24.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.481+0000 7f5231d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f52340bccd0 0x7f52340bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:24.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.481+0000 7f5231d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f52340bccd0 0x7f52340bd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55534/0 (socket says 172.21.15.1:55534) 2023-11-15T02:53:24.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.481+0000 7f5231d9b700 1 -- 172.21.15.1:0/1660197617 learned_addr learned my addr 172.21.15.1:0/1660197617 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:24.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.481+0000 7f5232d9d700 1 --2- 172.21.15.1:0/1660197617 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52340c60b0 0x7f52340c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:24.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.481+0000 7f5231d9b700 1 -- 172.21.15.1:0/1660197617 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52340c60b0 msgr2=0x7f52340c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:24.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.481+0000 7f5231d9b700 1 --2- 172.21.15.1:0/1660197617 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52340c60b0 0x7f52340c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.481+0000 7f5231d9b700 1 -- 172.21.15.1:0/1660197617 >> v1:172.21.15.141:6789/0 conn(0x7f5234154680 legacy=0x7f5234069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:24.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.481+0000 7f5231d9b700 1 -- 172.21.15.1:0/1660197617 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52340c2750 con 0x7f52340bccd0 2023-11-15T02:53:24.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.481+0000 7f523159a700 1 -- 172.21.15.1:0/1660197617 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174170315 0 0) 0x7f523406a6b0 con 0x7f5234154680 2023-11-15T02:53:24.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.481+0000 7f5231d9b700 1 --2- 172.21.15.1:0/1660197617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52340bccd0 0x7f52340bd130 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f5228006fd0 tx=0x7f52280090f0).ready entity=mon.0 client_cookie=7abdfa7b32196059 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:24.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.482+0000 7f523159a700 1 -- 172.21.15.1:0/1660197617 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800b580 con 0x7f52340bccd0 2023-11-15T02:53:24.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.482+0000 7f523159a700 1 -- 172.21.15.1:0/1660197617 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522800b6e0 con 0x7f52340bccd0 2023-11-15T02:53:24.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.482+0000 7f523159a700 1 -- 172.21.15.1:0/1660197617 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800ba60 con 0x7f52340bccd0 2023-11-15T02:53:24.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.482+0000 7f5238826700 1 -- 172.21.15.1:0/1660197617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52340bccd0 msgr2=0x7f52340bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:24.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.482+0000 7f5238826700 1 --2- 172.21.15.1:0/1660197617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52340bccd0 0x7f52340bd130 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f5228006fd0 tx=0x7f52280090f0).stop 2023-11-15T02:53:24.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.482+0000 7f5238826700 1 -- 172.21.15.1:0/1660197617 shutdown_connections 2023-11-15T02:53:24.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.482+0000 7f5238826700 1 --2- 172.21.15.1:0/1660197617 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52340c60b0 0x7f52340c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.482+0000 7f5238826700 1 --2- 172.21.15.1:0/1660197617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52340bccd0 0x7f52340bd130 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.482+0000 7f5238826700 1 -- 172.21.15.1:0/1660197617 >> 172.21.15.1:0/1660197617 conn(0x7f52340c7d70 msgr2=0x7f52340c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:24.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.482+0000 7f5238826700 1 -- 172.21.15.1:0/1660197617 shutdown_connections 2023-11-15T02:53:24.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.482+0000 7f5238826700 1 -- 172.21.15.1:0/1660197617 wait complete. 2023-11-15T02:53:24.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.483+0000 7f5238826700 1 Processor -- start 2023-11-15T02:53:24.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.483+0000 7f5238826700 1 -- start start 2023-11-15T02:53:24.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.484+0000 7f5238826700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52340bccd0 0x7f523414ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:24.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.484+0000 7f5238826700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52340c60b0 0x7f523414e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:24.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.484+0000 7f5238826700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5234154680 0x7f523414eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:24.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.484+0000 7f5238826700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523414f070 con 0x7f5234154680 2023-11-15T02:53:24.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.484+0000 7f5238826700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5234154a60 con 0x7f52340bccd0 2023-11-15T02:53:24.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.484+0000 7f5238826700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5234158ff0 con 0x7f52340c60b0 2023-11-15T02:53:24.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.484+0000 7f5232d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5234154680 0x7f523414eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:24.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.484+0000 7f5232d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5234154680 0x7f523414eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55540/0 (socket says 172.21.15.1:55540) 2023-11-15T02:53:24.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.484+0000 7f5232d9d700 1 -- 172.21.15.1:0/2123974783 learned_addr learned my addr 172.21.15.1:0/2123974783 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:24.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.484+0000 7f523259c700 1 --2- 172.21.15.1:0/2123974783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52340bccd0 0x7f523414ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:24.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.484+0000 7f5231d9b700 1 --2- 172.21.15.1:0/2123974783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52340c60b0 0x7f523414e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:24.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.485+0000 7f5232d9d700 1 -- 172.21.15.1:0/2123974783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52340c60b0 msgr2=0x7f523414e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:24.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.485+0000 7f5232d9d700 1 --2- 172.21.15.1:0/2123974783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52340c60b0 0x7f523414e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.485+0000 7f5232d9d700 1 -- 172.21.15.1:0/2123974783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52340bccd0 msgr2=0x7f523414ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:24.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.485+0000 7f5232d9d700 1 --2- 172.21.15.1:0/2123974783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52340bccd0 0x7f523414ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:24.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.485+0000 7f5232d9d700 1 -- 172.21.15.1:0/2123974783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5228009370 con 0x7f5234154680 2023-11-15T02:53:24.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.485+0000 7f5232d9d700 1 --2- 172.21.15.1:0/2123974783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5234154680 0x7f523414eb80 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f522c009e90 tx=0x7f522c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:24.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.485+0000 7f52227fc700 1 -- 172.21.15.1:0/2123974783 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c00caa0 con 0x7f5234154680 2023-11-15T02:53:24.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.485+0000 7f52227fc700 1 -- 172.21.15.1:0/2123974783 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c00f040 con 0x7f5234154680 2023-11-15T02:53:24.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.485+0000 7f5238826700 1 -- 172.21.15.1:0/2123974783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52341592d0 con 0x7f5234154680 2023-11-15T02:53:24.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.485+0000 7f52227fc700 1 -- 172.21.15.1:0/2123974783 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c00ce10 con 0x7f5234154680 2023-11-15T02:53:24.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.485+0000 7f5238826700 1 -- 172.21.15.1:0/2123974783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5234159890 con 0x7f5234154680 2023-11-15T02:53:24.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.486+0000 7f5238826700 1 -- 172.21.15.1:0/2123974783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5234154c80 con 0x7f5234154680 2023-11-15T02:53:24.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.487+0000 7f52227fc700 1 -- 172.21.15.1:0/2123974783 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f522c013610 con 0x7f5234154680 2023-11-15T02:53:24.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.487+0000 7f52227fc700 1 --2- 172.21.15.1:0/2123974783 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f521405f270 0x7f5214061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:24.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.487+0000 7f523259c700 1 -- 172.21.15.1:0/2123974783 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f521405f270 msgr2=0x7f5214061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:24.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.487+0000 7f52227fc700 1 -- 172.21.15.1:0/2123974783 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 7190+0+0 (secure 0 0 0) 0x7f522c07b0c0 con 0x7f5234154680 2023-11-15T02:53:24.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.487+0000 7f523259c700 1 --2- 172.21.15.1:0/2123974783 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f521405f270 0x7f5214061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:53:24.498 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:24.491+0000 7f1d16738680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:53:24.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.492+0000 7f52227fc700 1 -- 172.21.15.1:0/2123974783 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5234154c80 con 0x7f5234154680 2023-11-15T02:53:24.518 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:24.517+0000 7f689ce92680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:53:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.537+0000 7f52227fc700 1 -- 172.21.15.1:0/2123974783 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 87) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f522c0789a0 con 0x7f5234154680 2023-11-15T02:53:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.537+0000 7f52227fc700 1 -- 172.21.15.1:0/2123974783 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f521405f270 msgr2=0x7f5214061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:53:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.537+0000 7f52227fc700 1 --2- 172.21.15.1:0/2123974783 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f521405f270 0x7f5214061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:24.599 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:24.597+0000 7f6816e22700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:24.599 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:24.597+0000 7f6816e22700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:24.599 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:24.597+0000 7f6816e22700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:24.599 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:24.597+0000 7f6816e22700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:24.600 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:24.597+0000 7f6816e22700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:24.600 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:24.597+0000 7f681a629700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:24.600 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:24.598+0000 7f681a629700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:24.600 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:24.598+0000 7f681a629700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:24.601 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:24.598+0000 7f681a629700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:24.601 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:24.598+0000 7f681a629700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:24.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:24.718+0000 7f5238826700 1 -- 172.21.15.1:0/2123974783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5234154c80 con 0x7f5234154680 2023-11-15T02:53:24.802 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:24.800+0000 7f1d16738680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:53:24.879 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:24.877+0000 7f1d16738680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:53:25.534 INFO:tasks.ceph.mon.a.smithi001.stderr:2023-11-15T02:53:25.532+0000 7f8072214700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-15T02:53:25.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.536+0000 7f52227fc700 1 -- 172.21.15.1:0/2123974783 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v80) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5234154c80 con 0x7f5234154680 2023-11-15T02:53:25.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.538+0000 7f5238826700 1 -- 172.21.15.1:0/2123974783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5234154680 msgr2=0x7f523414eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:25.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.538+0000 7f5238826700 1 --2- 172.21.15.1:0/2123974783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5234154680 0x7f523414eb80 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f522c009e90 tx=0x7f522c00b040).stop 2023-11-15T02:53:25.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.538+0000 7f5238826700 1 -- 172.21.15.1:0/2123974783 shutdown_connections 2023-11-15T02:53:25.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.538+0000 7f5238826700 1 --2- 172.21.15.1:0/2123974783 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f521405f270 0x7f5214061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:25.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.538+0000 7f5238826700 1 --2- 172.21.15.1:0/2123974783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5234154680 0x7f523414eb80 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:25.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.538+0000 7f5238826700 1 --2- 172.21.15.1:0/2123974783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52340bccd0 0x7f523414ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:25.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.538+0000 7f5238826700 1 --2- 172.21.15.1:0/2123974783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52340c60b0 0x7f523414e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:25.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.538+0000 7f5238826700 1 -- 172.21.15.1:0/2123974783 >> 172.21.15.1:0/2123974783 conn(0x7f52340c7d70 msgr2=0x7f523415a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:25.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.538+0000 7f5238826700 1 -- 172.21.15.1:0/2123974783 shutdown_connections 2023-11-15T02:53:25.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.538+0000 7f5238826700 1 -- 172.21.15.1:0/2123974783 wait complete. 2023-11-15T02:53:25.542 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-15T02:53:25.558 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-15T02:53:25.574 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-11-15T02:53:25.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.694+0000 7f6bd944f700 1 Processor -- start 2023-11-15T02:53:25.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.694+0000 7f6bd944f700 1 -- start start 2023-11-15T02:53:25.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.695+0000 7f6bd944f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6bd413bd70 0x7f6bd41568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:25.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.695+0000 7f6bd944f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bd40a8ab0 0x7f6bd40c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:25.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.695+0000 7f6bd944f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd40c7760 con 0x7f6bd413b990 2023-11-15T02:53:25.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.695+0000 7f6bd944f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd4067340 con 0x7f6bd413bd70 2023-11-15T02:53:25.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.695+0000 7f6bd944f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd4067060 con 0x7f6bd40a8ab0 2023-11-15T02:53:25.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.695+0000 7f6bd2ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6bd413b990 0x7f6bd4066870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57258/0 (socket says 172.21.15.1:57258) 2023-11-15T02:53:25.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.695+0000 7f6bd2ffd700 1 -- 172.21.15.1:0/1757783162 learned_addr learned my addr 172.21.15.1:0/1757783162 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:25.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.696+0000 7f6bd37fe700 1 --2- 172.21.15.1:0/1757783162 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bd40a8ab0 0x7f6bd40c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:25.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.696+0000 7f6bd27fc700 1 --2- 172.21.15.1:0/1757783162 >> v2:172.21.15.141:3300/0 conn(0x7f6bd413bd70 0x7f6bd41568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:25.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.696+0000 7f6bd1ffb700 1 -- 172.21.15.1:0/1757783162 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417622024 0 0) 0x7f6bd40c7760 con 0x7f6bd413b990 2023-11-15T02:53:25.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.696+0000 7f6bd1ffb700 1 -- 172.21.15.1:0/1757783162 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bc00033f0 con 0x7f6bd413b990 2023-11-15T02:53:25.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.696+0000 7f6bd37fe700 1 -- 172.21.15.1:0/1757783162 >> v2:172.21.15.141:3300/0 conn(0x7f6bd413bd70 msgr2=0x7f6bd41568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:25.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.696+0000 7f6bd37fe700 1 --2- 172.21.15.1:0/1757783162 >> v2:172.21.15.141:3300/0 conn(0x7f6bd413bd70 0x7f6bd41568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:25.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.696+0000 7f6bd1ffb700 1 -- 172.21.15.1:0/1757783162 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2223201646 0 0) 0x7f6bc00033f0 con 0x7f6bd413b990 2023-11-15T02:53:25.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.696+0000 7f6bd37fe700 1 -- 172.21.15.1:0/1757783162 >> v1:172.21.15.1:6789/0 conn(0x7f6bd413b990 legacy=0x7f6bd4066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:25.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.696+0000 7f6bd37fe700 1 -- 172.21.15.1:0/1757783162 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd40c7110 con 0x7f6bd40a8ab0 2023-11-15T02:53:25.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.696+0000 7f6bd37fe700 1 --2- 172.21.15.1:0/1757783162 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bd40a8ab0 0x7f6bd40c3500 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f6bc4009e60 tx=0x7f6bc4009780).ready entity=mon.2 client_cookie=bad8cfe3f51090c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:25.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.696+0000 7f6bd1ffb700 1 -- 172.21.15.1:0/1757783162 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc400e070 con 0x7f6bd40a8ab0 2023-11-15T02:53:25.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.696+0000 7f6bd1ffb700 1 -- 172.21.15.1:0/1757783162 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc400b7a0 con 0x7f6bd40a8ab0 2023-11-15T02:53:25.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.696+0000 7f6bd1ffb700 1 -- 172.21.15.1:0/1757783162 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc001470 con 0x7f6bd40a8ab0 2023-11-15T02:53:25.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.697+0000 7f6bd944f700 1 -- 172.21.15.1:0/1757783162 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bd40a8ab0 msgr2=0x7f6bd40c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.697+0000 7f6bd944f700 1 --2- 172.21.15.1:0/1757783162 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bd40a8ab0 0x7f6bd40c3500 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f6bc4009e60 tx=0x7f6bc4009780).stop 2023-11-15T02:53:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.697+0000 7f6bd944f700 1 -- 172.21.15.1:0/1757783162 shutdown_connections 2023-11-15T02:53:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.697+0000 7f6bd944f700 1 --2- 172.21.15.1:0/1757783162 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bd40a8ab0 0x7f6bd40c3500 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.697+0000 7f6bd944f700 1 --2- 172.21.15.1:0/1757783162 >> v2:172.21.15.141:3300/0 conn(0x7f6bd413bd70 0x7f6bd41568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.697+0000 7f6bd944f700 1 -- 172.21.15.1:0/1757783162 >> 172.21.15.1:0/1757783162 conn(0x7f6bd4063280 msgr2=0x7f6bd40c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:25.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.697+0000 7f6bd944f700 1 -- 172.21.15.1:0/1757783162 shutdown_connections 2023-11-15T02:53:25.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.697+0000 7f6bd944f700 1 -- 172.21.15.1:0/1757783162 wait complete. 2023-11-15T02:53:25.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.698+0000 7f6bd944f700 1 Processor -- start 2023-11-15T02:53:25.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.698+0000 7f6bd944f700 1 -- start start 2023-11-15T02:53:25.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd944f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bd40a8ab0 0x7f6bd4153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:25.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd944f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6bd413b990 0x7f6bd4151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd944f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bd4151c00 0x7f6bd4165ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd944f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40c15c0 con 0x7f6bd4151c00 2023-11-15T02:53:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd944f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40c0c90 con 0x7f6bd413b990 2023-11-15T02:53:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd944f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40c0f70 con 0x7f6bd40a8ab0 2023-11-15T02:53:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bd4151c00 0x7f6bd4165ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bd4151c00 0x7f6bd4165ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55572/0 (socket says 172.21.15.1:55572) 2023-11-15T02:53:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd37fe700 1 -- 172.21.15.1:0/2063310120 learned_addr learned my addr 172.21.15.1:0/2063310120 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd27fc700 1 --2- 172.21.15.1:0/2063310120 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6bd413b990 0x7f6bd4151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd2ffd700 1 --2- 172.21.15.1:0/2063310120 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bd40a8ab0 0x7f6bd4153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd37fe700 1 -- 172.21.15.1:0/2063310120 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bd40a8ab0 msgr2=0x7f6bd4153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd37fe700 1 --2- 172.21.15.1:0/2063310120 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bd40a8ab0 0x7f6bd4153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd37fe700 1 -- 172.21.15.1:0/2063310120 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6bd413b990 msgr2=0x7f6bd4151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd37fe700 1 --2- 172.21.15.1:0/2063310120 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6bd413b990 0x7f6bd4151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd37fe700 1 -- 172.21.15.1:0/2063310120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc4009a20 con 0x7f6bd4151c00 2023-11-15T02:53:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.699+0000 7f6bd2ffd700 1 --2- 172.21.15.1:0/2063310120 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bd40a8ab0 0x7f6bd4153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:53:25.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.700+0000 7f6bd37fe700 1 --2- 172.21.15.1:0/2063310120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bd4151c00 0x7f6bd4165ca0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7f6bc400b610 tx=0x7f6bc4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:25.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.700+0000 7f6bcaffd700 1 -- 172.21.15.1:0/2063310120 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc401d420 con 0x7f6bd4151c00 2023-11-15T02:53:25.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.700+0000 7f6bcaffd700 1 -- 172.21.15.1:0/2063310120 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc401d580 con 0x7f6bd4151c00 2023-11-15T02:53:25.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.700+0000 7f6bd944f700 1 -- 172.21.15.1:0/2063310120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd40c1250 con 0x7f6bd4151c00 2023-11-15T02:53:25.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.700+0000 7f6bcaffd700 1 -- 172.21.15.1:0/2063310120 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc401d940 con 0x7f6bd4151c00 2023-11-15T02:53:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.700+0000 7f6bd944f700 1 -- 172.21.15.1:0/2063310120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd4153f50 con 0x7f6bd4151c00 2023-11-15T02:53:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.701+0000 7f6bd944f700 1 -- 172.21.15.1:0/2063310120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd405f960 con 0x7f6bd4151c00 2023-11-15T02:53:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.701+0000 7f6bcaffd700 1 -- 172.21.15.1:0/2063310120 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 88) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f6bc4003040 con 0x7f6bd4151c00 2023-11-15T02:53:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.701+0000 7f6bcaffd700 1 --2- 172.21.15.1:0/2063310120 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6bb405f030 0x7f6bb40614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.702+0000 7f6bcaffd700 1 -- 172.21.15.1:0/2063310120 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 7506+0+0 (secure 0 0 0) 0x7f6bc407be70 con 0x7f6bd4151c00 2023-11-15T02:53:25.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.702+0000 7f6bd2ffd700 1 --2- 172.21.15.1:0/2063310120 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6bb405f030 0x7f6bb40614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:25.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.702+0000 7f6bd2ffd700 1 --2- 172.21.15.1:0/2063310120 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6bb405f030 0x7f6bb40614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f6bcc0011e0 tx=0x7f6bcc001a00).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:25.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.706+0000 7f6bcaffd700 1 -- 172.21.15.1:0/2063310120 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6bd405f960 con 0x7f6bd4151c00 2023-11-15T02:53:25.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:25.923+0000 7f6bd944f700 1 -- 172.21.15.1:0/2063310120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6bd405f960 con 0x7f6bd4151c00 2023-11-15T02:53:26.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.544+0000 7f6bcaffd700 1 -- 172.21.15.1:0/2063310120 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v81) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6bd405f960 con 0x7f6bd4151c00 2023-11-15T02:53:26.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.546+0000 7f6bd944f700 1 -- 172.21.15.1:0/2063310120 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6bb405f030 msgr2=0x7f6bb40614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:26.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.546+0000 7f6bd944f700 1 --2- 172.21.15.1:0/2063310120 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6bb405f030 0x7f6bb40614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f6bcc0011e0 tx=0x7f6bcc001a00).stop 2023-11-15T02:53:26.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.546+0000 7f6bd944f700 1 -- 172.21.15.1:0/2063310120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bd4151c00 msgr2=0x7f6bd4165ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:26.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.546+0000 7f6bd944f700 1 --2- 172.21.15.1:0/2063310120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bd4151c00 0x7f6bd4165ca0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7f6bc400b610 tx=0x7f6bc4009780).stop 2023-11-15T02:53:26.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.546+0000 7f6bd944f700 1 -- 172.21.15.1:0/2063310120 shutdown_connections 2023-11-15T02:53:26.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.546+0000 7f6bd944f700 1 --2- 172.21.15.1:0/2063310120 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6bb405f030 0x7f6bb40614f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:26.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.546+0000 7f6bd944f700 1 --2- 172.21.15.1:0/2063310120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bd4151c00 0x7f6bd4165ca0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:26.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.546+0000 7f6bd944f700 1 --2- 172.21.15.1:0/2063310120 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bd40a8ab0 0x7f6bd4153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:26.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.546+0000 7f6bd944f700 1 --2- 172.21.15.1:0/2063310120 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6bd413b990 0x7f6bd4151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:26.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.546+0000 7f6bd944f700 1 -- 172.21.15.1:0/2063310120 >> 172.21.15.1:0/2063310120 conn(0x7f6bd4063280 msgr2=0x7f6bd40be4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:26.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.546+0000 7f6bd944f700 1 -- 172.21.15.1:0/2063310120 shutdown_connections 2023-11-15T02:53:26.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.546+0000 7f6bd944f700 1 -- 172.21.15.1:0/2063310120 wait complete. 2023-11-15T02:53:26.562 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-15T02:53:26.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.685+0000 7fef534b3700 1 Processor -- start 2023-11-15T02:53:26.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.685+0000 7fef534b3700 1 -- start start 2023-11-15T02:53:26.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.686+0000 7fef534b3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4c154320 0x7fef4c154700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:26.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.686+0000 7fef534b3700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4c0bf420 con 0x7fef4c0833a0 2023-11-15T02:53:26.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.686+0000 7fef534b3700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4c065200 con 0x7fef4c0c7f00 2023-11-15T02:53:26.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.686+0000 7fef534b3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c0654e0 con 0x7fef4c154320 2023-11-15T02:53:26.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.686+0000 7fef50a4e700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fef4c0833a0 0x7fef4c064440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57268/0 (socket says 172.21.15.1:57268) 2023-11-15T02:53:26.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.686+0000 7fef50a4e700 1 -- 172.21.15.1:0/1628316684 learned_addr learned my addr 172.21.15.1:0/1628316684 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:26.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef4bfff700 1 -- 172.21.15.1:0/1628316684 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970495489 0 0) 0x7fef4c0bf420 con 0x7fef4c0833a0 2023-11-15T02:53:26.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef4bfff700 1 -- 172.21.15.1:0/1628316684 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef340033f0 con 0x7fef4c0833a0 2023-11-15T02:53:26.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef5124f700 1 --2- 172.21.15.1:0/1628316684 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4c154320 0x7fef4c154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:26.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef4bfff700 1 -- 172.21.15.1:0/1628316684 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2396634917 0 0) 0x7fef340033f0 con 0x7fef4c0833a0 2023-11-15T02:53:26.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef4bfff700 1 -- 172.21.15.1:0/1628316684 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4c154320 msgr2=0x7fef4c154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:26.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef4bfff700 1 --2- 172.21.15.1:0/1628316684 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4c154320 0x7fef4c154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:26.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef4bfff700 1 -- 172.21.15.1:0/1628316684 >> v1:172.21.15.141:6789/0 conn(0x7fef4c0c7f00 legacy=0x7fef4c0bde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:26.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef4bfff700 1 -- 172.21.15.1:0/1628316684 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c0657c0 con 0x7fef4c0833a0 2023-11-15T02:53:26.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef4bfff700 1 -- 172.21.15.1:0/1628316684 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fef400015f0 con 0x7fef4c0833a0 2023-11-15T02:53:26.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef4bfff700 1 -- 172.21.15.1:0/1628316684 >> v1:172.21.15.1:6789/0 conn(0x7fef4c0833a0 legacy=0x7fef4c064440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:26.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef4bfff700 1 --2- 172.21.15.1:0/1628316684 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4c154320 0x7fef34003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:26.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef4bfff700 1 --2- 172.21.15.1:0/1628316684 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef34003e40 0x7fef34004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:26.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef4bfff700 1 --2- 172.21.15.1:0/1628316684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef34004b80 0x7fef34005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:26.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef4bfff700 1 -- 172.21.15.1:0/1628316684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c0654e0 con 0x7fef34004b80 2023-11-15T02:53:26.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef4bfff700 1 -- 172.21.15.1:0/1628316684 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3400b990 con 0x7fef34003e40 2023-11-15T02:53:26.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef4bfff700 1 -- 172.21.15.1:0/1628316684 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3400bb50 con 0x7fef4c154320 2023-11-15T02:53:26.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef51a50700 1 --2- 172.21.15.1:0/1628316684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef34004b80 0x7fef34005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:26.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef5124f700 1 --2- 172.21.15.1:0/1628316684 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4c154320 0x7fef34003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:26.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.687+0000 7fef50a4e700 1 --2- 172.21.15.1:0/1628316684 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef34003e40 0x7fef34004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:26.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef51a50700 1 -- 172.21.15.1:0/1628316684 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4c154320 msgr2=0x7fef34003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:26.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef51a50700 1 --2- 172.21.15.1:0/1628316684 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4c154320 0x7fef34003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:26.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef51a50700 1 -- 172.21.15.1:0/1628316684 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef34003e40 msgr2=0x7fef34004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:26.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef51a50700 1 --2- 172.21.15.1:0/1628316684 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef34003e40 0x7fef34004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:26.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef51a50700 1 -- 172.21.15.1:0/1628316684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef340033f0 con 0x7fef34004b80 2023-11-15T02:53:26.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef51a50700 1 --2- 172.21.15.1:0/1628316684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef34004b80 0x7fef34005000 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fef44001e30 tx=0x7fef44007f30).ready entity=mon.0 client_cookie=87165dbf7e74fe8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:26.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef4bfff700 1 -- 172.21.15.1:0/1628316684 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44006a20 con 0x7fef34004b80 2023-11-15T02:53:26.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef4bfff700 1 -- 172.21.15.1:0/1628316684 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef44006b80 con 0x7fef34004b80 2023-11-15T02:53:26.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef4bfff700 1 -- 172.21.15.1:0/1628316684 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4400c5d0 con 0x7fef34004b80 2023-11-15T02:53:26.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef534b3700 1 -- 172.21.15.1:0/1628316684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef34004b80 msgr2=0x7fef34005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:26.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef534b3700 1 --2- 172.21.15.1:0/1628316684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef34004b80 0x7fef34005000 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fef44001e30 tx=0x7fef44007f30).stop 2023-11-15T02:53:26.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef51a50700 1 -- 172.21.15.1:0/1628316684 reap_dead start 2023-11-15T02:53:26.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef534b3700 1 -- 172.21.15.1:0/1628316684 shutdown_connections 2023-11-15T02:53:26.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef534b3700 1 -- 172.21.15.1:0/1628316684 >> 172.21.15.1:0/1628316684 conn(0x7fef4c082f90 msgr2=0x7fef4c0c8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:26.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef534b3700 1 -- 172.21.15.1:0/1628316684 shutdown_connections 2023-11-15T02:53:26.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.688+0000 7fef534b3700 1 -- 172.21.15.1:0/1628316684 wait complete. 2023-11-15T02:53:26.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.690+0000 7fef534b3700 1 Processor -- start 2023-11-15T02:53:26.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.690+0000 7fef534b3700 1 -- start start 2023-11-15T02:53:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.690+0000 7fef534b3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4c146cb0 0x7fef4c14dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.690+0000 7fef534b3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef4c0c4410 0x7fef4c14f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.690+0000 7fef534b3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef4c14fe60 0x7fef4c0bff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.690+0000 7fef534b3700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c14e8d0 con 0x7fef4c0c4410 2023-11-15T02:53:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.690+0000 7fef534b3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c14ebb0 con 0x7fef4c14fe60 2023-11-15T02:53:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.690+0000 7fef534b3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c14ee90 con 0x7fef4c146cb0 2023-11-15T02:53:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef50a4e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef4c0c4410 0x7fef4c14f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef50a4e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef4c0c4410 0x7fef4c14f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55598/0 (socket says 172.21.15.1:55598) 2023-11-15T02:53:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef50a4e700 1 -- 172.21.15.1:0/677076416 learned_addr learned my addr 172.21.15.1:0/677076416 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef51a50700 1 --2- 172.21.15.1:0/677076416 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef4c14fe60 0x7fef4c0bff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:26.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef5124f700 1 --2- 172.21.15.1:0/677076416 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4c146cb0 0x7fef4c14dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:26.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef50a4e700 1 -- 172.21.15.1:0/677076416 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4c146cb0 msgr2=0x7fef4c14dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:26.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef50a4e700 1 --2- 172.21.15.1:0/677076416 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4c146cb0 0x7fef4c14dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:26.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef50a4e700 1 -- 172.21.15.1:0/677076416 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef4c14fe60 msgr2=0x7fef4c0bff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:26.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef50a4e700 1 --2- 172.21.15.1:0/677076416 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef4c14fe60 0x7fef4c0bff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:26.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef50a4e700 1 -- 172.21.15.1:0/677076416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c14f170 con 0x7fef4c0c4410 2023-11-15T02:53:26.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef50a4e700 1 --2- 172.21.15.1:0/677076416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef4c0c4410 0x7fef4c14f970 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7fef40000fd0 tx=0x7fef40009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:26.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef497fa700 1 -- 172.21.15.1:0/677076416 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef400070d0 con 0x7fef4c0c4410 2023-11-15T02:53:26.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef497fa700 1 -- 172.21.15.1:0/677076416 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef40007230 con 0x7fef4c0c4410 2023-11-15T02:53:26.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef534b3700 1 -- 172.21.15.1:0/677076416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4c14f450 con 0x7fef4c0c4410 2023-11-15T02:53:26.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef497fa700 1 -- 172.21.15.1:0/677076416 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40005880 con 0x7fef4c0c4410 2023-11-15T02:53:26.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.691+0000 7fef534b3700 1 -- 172.21.15.1:0/677076416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4c147090 con 0x7fef4c0c4410 2023-11-15T02:53:26.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.692+0000 7fef534b3700 1 -- 172.21.15.1:0/677076416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4c14f7c0 con 0x7fef4c0c4410 2023-11-15T02:53:26.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.693+0000 7fef497fa700 1 -- 172.21.15.1:0/677076416 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 88) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fef40005cb0 con 0x7fef4c0c4410 2023-11-15T02:53:26.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.693+0000 7fef497fa700 1 --2- 172.21.15.1:0/677076416 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fef3805f030 0x7fef380614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:26.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.693+0000 7fef497fa700 1 -- 172.21.15.1:0/677076416 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 7506+0+0 (secure 0 0 0) 0x7fef40079ca0 con 0x7fef4c0c4410 2023-11-15T02:53:26.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.693+0000 7fef5124f700 1 --2- 172.21.15.1:0/677076416 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fef3805f030 0x7fef380614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:26.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.694+0000 7fef5124f700 1 --2- 172.21.15.1:0/677076416 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fef3805f030 0x7fef380614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fef3c006cf0 tx=0x7fef3c006f40).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:26.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.697+0000 7fef497fa700 1 -- 172.21.15.1:0/677076416 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fef40049af0 con 0x7fef4c0c4410 2023-11-15T02:53:26.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:26.868+0000 7fef534b3700 1 -- 172.21.15.1:0/677076416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef4c0c08a0 con 0x7fef4c0c4410 2023-11-15T02:53:27.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.558+0000 7fef497fa700 1 -- 172.21.15.1:0/677076416 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fef400776d0 con 0x7fef4c0c4410 2023-11-15T02:53:27.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.559+0000 7fef497fa700 1 -- 172.21.15.1:0/677076416 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v186) v1 ==== 181+0+0 (secure 0 0 0) 0x7fef40072a00 con 0x7fef4c0c4410 2023-11-15T02:53:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.563+0000 7fef534b3700 1 -- 172.21.15.1:0/677076416 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fef3805f030 msgr2=0x7fef380614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.563+0000 7fef534b3700 1 --2- 172.21.15.1:0/677076416 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fef3805f030 0x7fef380614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fef3c006cf0 tx=0x7fef3c006f40).stop 2023-11-15T02:53:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.563+0000 7fef534b3700 1 -- 172.21.15.1:0/677076416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef4c0c4410 msgr2=0x7fef4c14f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:27.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.563+0000 7fef534b3700 1 --2- 172.21.15.1:0/677076416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef4c0c4410 0x7fef4c14f970 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7fef40000fd0 tx=0x7fef40009040).stop 2023-11-15T02:53:27.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.563+0000 7fef534b3700 1 -- 172.21.15.1:0/677076416 shutdown_connections 2023-11-15T02:53:27.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.563+0000 7fef534b3700 1 --2- 172.21.15.1:0/677076416 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fef3805f030 0x7fef380614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:27.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.563+0000 7fef534b3700 1 --2- 172.21.15.1:0/677076416 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef4c14fe60 0x7fef4c0bff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:27.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.563+0000 7fef534b3700 1 --2- 172.21.15.1:0/677076416 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4c146cb0 0x7fef4c14dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.563+0000 7fef534b3700 1 --2- 172.21.15.1:0/677076416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef4c0c4410 0x7fef4c14f970 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.563+0000 7fef534b3700 1 -- 172.21.15.1:0/677076416 >> 172.21.15.1:0/677076416 conn(0x7fef4c082f90 msgr2=0x7fef4c0a6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.563+0000 7fef534b3700 1 -- 172.21.15.1:0/677076416 shutdown_connections 2023-11-15T02:53:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.563+0000 7fef534b3700 1 -- 172.21.15.1:0/677076416 wait complete. 2023-11-15T02:53:27.568 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2023-11-15T02:53:27.580 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-15T02:53:27.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.706+0000 7f490a28f700 1 Processor -- start 2023-11-15T02:53:27.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.706+0000 7f490a28f700 1 -- start start 2023-11-15T02:53:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.707+0000 7f490a28f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4904155790 0x7f49040a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.707+0000 7f490a28f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f49040a6190 0x7f49040c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.707+0000 7f490a28f700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49040c7ae0 con 0x7f49040833a0 2023-11-15T02:53:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.707+0000 7f490a28f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4904066210 con 0x7f49040a6190 2023-11-15T02:53:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.707+0000 7f490a28f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49040c77b0 con 0x7f4904155790 2023-11-15T02:53:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.707+0000 7f49037fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f49040a6190 0x7f49040c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.708+0000 7f49037fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f49040a6190 0x7f49040c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40064/0 (socket says 172.21.15.1:40064) 2023-11-15T02:53:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.708+0000 7f49037fe700 1 -- 172.21.15.1:0/4235941869 learned_addr learned my addr 172.21.15.1:0/4235941869 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.708+0000 7f4903fff700 1 --2- 172.21.15.1:0/4235941869 >> v2:172.21.15.141:3300/0 conn(0x7f4904155790 0x7f49040a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.708+0000 7f49037fe700 1 -- 172.21.15.1:0/4235941869 >> v2:172.21.15.141:3300/0 conn(0x7f4904155790 msgr2=0x7f49040a5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.708+0000 7f49037fe700 1 --2- 172.21.15.1:0/4235941869 >> v2:172.21.15.141:3300/0 conn(0x7f4904155790 0x7f49040a5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.708+0000 7f49037fe700 1 -- 172.21.15.1:0/4235941869 >> v1:172.21.15.141:6789/0 conn(0x7f49040833a0 legacy=0x7f49040c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.708+0000 7f49037fe700 1 -- 172.21.15.1:0/4235941869 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49040c4c50 con 0x7f49040a6190 2023-11-15T02:53:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.708+0000 7f49037fe700 1 --2- 172.21.15.1:0/4235941869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49040a6190 0x7f49040c3fe0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f49040693d0 tx=0x7f48f8009060).ready entity=mon.0 client_cookie=d252ee133bd0345e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.708+0000 7f4902ffd700 1 -- 172.21.15.1:0/4235941869 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f8005880 con 0x7f49040a6190 2023-11-15T02:53:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.708+0000 7f4902ffd700 1 -- 172.21.15.1:0/4235941869 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f80059e0 con 0x7f49040a6190 2023-11-15T02:53:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.708+0000 7f4902ffd700 1 -- 172.21.15.1:0/4235941869 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f8005d60 con 0x7f49040a6190 2023-11-15T02:53:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.709+0000 7f490a28f700 1 -- 172.21.15.1:0/4235941869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49040a6190 msgr2=0x7f49040c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.709+0000 7f490a28f700 1 --2- 172.21.15.1:0/4235941869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49040a6190 0x7f49040c3fe0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f49040693d0 tx=0x7f48f8009060).stop 2023-11-15T02:53:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.709+0000 7f490a28f700 1 -- 172.21.15.1:0/4235941869 shutdown_connections 2023-11-15T02:53:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.709+0000 7f490a28f700 1 --2- 172.21.15.1:0/4235941869 >> v2:172.21.15.141:3300/0 conn(0x7f4904155790 0x7f49040a5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.709+0000 7f490a28f700 1 --2- 172.21.15.1:0/4235941869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49040a6190 0x7f49040c3fe0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.709+0000 7f490a28f700 1 -- 172.21.15.1:0/4235941869 >> 172.21.15.1:0/4235941869 conn(0x7f4904082f90 msgr2=0x7f49040c8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.709+0000 7f490a28f700 1 -- 172.21.15.1:0/4235941869 shutdown_connections 2023-11-15T02:53:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.709+0000 7f490a28f700 1 -- 172.21.15.1:0/4235941869 wait complete. 2023-11-15T02:53:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.710+0000 7f490a28f700 1 Processor -- start 2023-11-15T02:53:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.710+0000 7f490a28f700 1 -- start start 2023-11-15T02:53:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f490a28f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49040833a0 0x7f490414df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f490a28f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49040a6190 0x7f4904066980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f490a28f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4904155790 0x7f4904066e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f490a28f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4904067360 con 0x7f4904155790 2023-11-15T02:53:27.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f490a28f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49040acbc0 con 0x7f49040833a0 2023-11-15T02:53:27.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f490a28f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49040abfb0 con 0x7f49040a6190 2023-11-15T02:53:27.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f490882c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4904155790 0x7f4904066e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:27.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f490882c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4904155790 0x7f4904066e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40066/0 (socket says 172.21.15.1:40066) 2023-11-15T02:53:27.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f490882c700 1 -- 172.21.15.1:0/888022481 learned_addr learned my addr 172.21.15.1:0/888022481 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:27.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f4903fff700 1 --2- 172.21.15.1:0/888022481 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49040833a0 0x7f490414df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:27.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f49037fe700 1 --2- 172.21.15.1:0/888022481 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49040a6190 0x7f4904066980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:27.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f490882c700 1 -- 172.21.15.1:0/888022481 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49040a6190 msgr2=0x7f4904066980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:27.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f490882c700 1 --2- 172.21.15.1:0/888022481 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49040a6190 0x7f4904066980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:27.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f490882c700 1 -- 172.21.15.1:0/888022481 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49040833a0 msgr2=0x7f490414df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:27.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f490882c700 1 --2- 172.21.15.1:0/888022481 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49040833a0 0x7f490414df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:27.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f490882c700 1 -- 172.21.15.1:0/888022481 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f8009300 con 0x7f4904155790 2023-11-15T02:53:27.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.711+0000 7f490882c700 1 --2- 172.21.15.1:0/888022481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4904155790 0x7f4904066e70 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f48fc002230 tx=0x7f48fc0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:27.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.712+0000 7f48ebfff700 1 -- 172.21.15.1:0/888022481 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00e4a0 con 0x7f4904155790 2023-11-15T02:53:27.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.712+0000 7f48ebfff700 1 -- 172.21.15.1:0/888022481 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc00e600 con 0x7f4904155790 2023-11-15T02:53:27.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.712+0000 7f490a28f700 1 -- 172.21.15.1:0/888022481 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49040ac290 con 0x7f4904155790 2023-11-15T02:53:27.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.712+0000 7f48ebfff700 1 -- 172.21.15.1:0/888022481 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00e980 con 0x7f4904155790 2023-11-15T02:53:27.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.712+0000 7f490a28f700 1 -- 172.21.15.1:0/888022481 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49040ac8d0 con 0x7f4904155790 2023-11-15T02:53:27.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.713+0000 7f490a28f700 1 -- 172.21.15.1:0/888022481 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49040acd50 con 0x7f4904155790 2023-11-15T02:53:27.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.713+0000 7f48ebfff700 1 -- 172.21.15.1:0/888022481 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f48fc01b3b0 con 0x7f4904155790 2023-11-15T02:53:27.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.713+0000 7f48ebfff700 1 --2- 172.21.15.1:0/888022481 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f48f005f270 0x7f48f0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:27.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.713+0000 7f48ebfff700 1 -- 172.21.15.1:0/888022481 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 7039+0+0 (secure 0 0 0) 0x7f48fc079de0 con 0x7f4904155790 2023-11-15T02:53:27.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.714+0000 7f4903fff700 1 --2- 172.21.15.1:0/888022481 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f48f005f270 0x7f48f0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:27.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.714+0000 7f4903fff700 1 --2- 172.21.15.1:0/888022481 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f48f005f270 0x7f48f0061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f48f4006fd0 tx=0x7f48f4006f40).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:27.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.717+0000 7f48ebfff700 1 -- 172.21.15.1:0/888022481 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f48fc048af0 con 0x7f4904155790 2023-11-15T02:53:27.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:27.894+0000 7f490a28f700 1 -- 172.21.15.1:0/888022481 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f490406c7e0 con 0x7f4904155790 2023-11-15T02:53:28.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.558+0000 7f48ebfff700 1 -- 172.21.15.1:0/888022481 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v187) v1 ==== 169+0+0 (secure 0 0 0) 0x7f48fc04e620 con 0x7f4904155790 2023-11-15T02:53:28.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.562+0000 7f490a28f700 1 -- 172.21.15.1:0/888022481 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f48f005f270 msgr2=0x7f48f0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:28.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.562+0000 7f490a28f700 1 --2- 172.21.15.1:0/888022481 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f48f005f270 0x7f48f0061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f48f4006fd0 tx=0x7f48f4006f40).stop 2023-11-15T02:53:28.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.562+0000 7f490a28f700 1 -- 172.21.15.1:0/888022481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4904155790 msgr2=0x7f4904066e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:28.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.562+0000 7f490a28f700 1 --2- 172.21.15.1:0/888022481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4904155790 0x7f4904066e70 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f48fc002230 tx=0x7f48fc0015e0).stop 2023-11-15T02:53:28.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.562+0000 7f490a28f700 1 -- 172.21.15.1:0/888022481 shutdown_connections 2023-11-15T02:53:28.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.562+0000 7f490a28f700 1 --2- 172.21.15.1:0/888022481 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f48f005f270 0x7f48f0061730 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:28.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.562+0000 7f490a28f700 1 --2- 172.21.15.1:0/888022481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4904155790 0x7f4904066e70 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:28.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.562+0000 7f490a28f700 1 --2- 172.21.15.1:0/888022481 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49040833a0 0x7f490414df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:28.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.562+0000 7f490a28f700 1 --2- 172.21.15.1:0/888022481 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49040a6190 0x7f4904066980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:28.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.562+0000 7f490a28f700 1 -- 172.21.15.1:0/888022481 >> 172.21.15.1:0/888022481 conn(0x7f4904082f90 msgr2=0x7f4904158750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:28.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.562+0000 7f490a28f700 1 -- 172.21.15.1:0/888022481 shutdown_connections 2023-11-15T02:53:28.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.562+0000 7f490a28f700 1 -- 172.21.15.1:0/888022481 wait complete. 2023-11-15T02:53:28.567 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2023-11-15T02:53:28.580 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-15T02:53:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.708+0000 7fb93764a700 1 Processor -- start 2023-11-15T02:53:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.708+0000 7fb93764a700 1 -- start start 2023-11-15T02:53:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb93764a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb930154480 0x7fb9300c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb93764a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9300ca050 con 0x7fb9301540a0 2023-11-15T02:53:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb93764a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9300c68c0 con 0x7fb9300c6430 2023-11-15T02:53:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb93764a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9300c9440 con 0x7fb930154480 2023-11-15T02:53:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb934be5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb930154480 0x7fb9300c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb9353e6700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb9301540a0 0x7fb9300ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49182/0 (socket says 172.21.15.1:49182) 2023-11-15T02:53:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb934be5700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb930154480 0x7fb9300c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40072/0 (socket says 172.21.15.1:40072) 2023-11-15T02:53:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb9353e6700 1 -- 172.21.15.1:0/3762816016 learned_addr learned my addr 172.21.15.1:0/3762816016 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb927fff700 1 -- 172.21.15.1:0/3762816016 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532194579 0 0) 0x7fb9300ca050 con 0x7fb9301540a0 2023-11-15T02:53:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb927fff700 1 -- 172.21.15.1:0/3762816016 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb91c0033f0 con 0x7fb9301540a0 2023-11-15T02:53:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb934be5700 1 -- 172.21.15.1:0/3762816016 >> v1:172.21.15.141:6789/0 conn(0x7fb9300c6430 legacy=0x7fb9300aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb934be5700 1 -- 172.21.15.1:0/3762816016 >> v1:172.21.15.1:6789/0 conn(0x7fb9301540a0 legacy=0x7fb9300ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb934be5700 1 -- 172.21.15.1:0/3762816016 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300c9720 con 0x7fb930154480 2023-11-15T02:53:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb934be5700 1 --2- 172.21.15.1:0/3762816016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb930154480 0x7fb9300c5f40 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7fb920009760 tx=0x7fb920009060).ready entity=mon.0 client_cookie=22c8f379e2ae3499 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb927fff700 1 -- 172.21.15.1:0/3762816016 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92000f510 con 0x7fb930154480 2023-11-15T02:53:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb927fff700 1 -- 172.21.15.1:0/3762816016 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92000f670 con 0x7fb930154480 2023-11-15T02:53:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.709+0000 7fb927fff700 1 -- 172.21.15.1:0/3762816016 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92000f9f0 con 0x7fb930154480 2023-11-15T02:53:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.710+0000 7fb93764a700 1 -- 172.21.15.1:0/3762816016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb930154480 msgr2=0x7fb9300c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:28.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.710+0000 7fb93764a700 1 --2- 172.21.15.1:0/3762816016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb930154480 0x7fb9300c5f40 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7fb920009760 tx=0x7fb920009060).stop 2023-11-15T02:53:28.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.710+0000 7fb93764a700 1 -- 172.21.15.1:0/3762816016 shutdown_connections 2023-11-15T02:53:28.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.710+0000 7fb93764a700 1 --2- 172.21.15.1:0/3762816016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb930154480 0x7fb9300c5f40 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:28.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.710+0000 7fb93764a700 1 -- 172.21.15.1:0/3762816016 >> 172.21.15.1:0/3762816016 conn(0x7fb930064a70 msgr2=0x7fb930064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:28.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.710+0000 7fb93764a700 1 -- 172.21.15.1:0/3762816016 shutdown_connections 2023-11-15T02:53:28.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.710+0000 7fb93764a700 1 -- 172.21.15.1:0/3762816016 wait complete. 2023-11-15T02:53:28.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.711+0000 7fb93764a700 1 Processor -- start 2023-11-15T02:53:28.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.711+0000 7fb93764a700 1 -- start start 2023-11-15T02:53:28.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.712+0000 7fb93764a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9300c6430 0x7fb93014fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:28.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.712+0000 7fb93764a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9301540a0 0x7fb9300aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:28.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.712+0000 7fb93764a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb930154480 0x7fb9300ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:28.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.712+0000 7fb93764a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb930164730 con 0x7fb9300c6430 2023-11-15T02:53:28.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.712+0000 7fb93764a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb930150c90 con 0x7fb9301540a0 2023-11-15T02:53:28.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.712+0000 7fb93764a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9301503f0 con 0x7fb930154480 2023-11-15T02:53:28.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.712+0000 7fb9353e6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9300c6430 0x7fb93014fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:28.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.712+0000 7fb9353e6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9300c6430 0x7fb93014fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40082/0 (socket says 172.21.15.1:40082) 2023-11-15T02:53:28.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.712+0000 7fb9353e6700 1 -- 172.21.15.1:0/2379175695 learned_addr learned my addr 172.21.15.1:0/2379175695 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:28.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.713+0000 7fb9353e6700 1 -- 172.21.15.1:0/2379175695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb930154480 msgr2=0x7fb9300ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:28.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.713+0000 7fb935be7700 1 --2- 172.21.15.1:0/2379175695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb930154480 0x7fb9300ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:28.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.713+0000 7fb934be5700 1 --2- 172.21.15.1:0/2379175695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9301540a0 0x7fb9300aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:28.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.713+0000 7fb9353e6700 1 --2- 172.21.15.1:0/2379175695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb930154480 0x7fb9300ac810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:28.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.713+0000 7fb9353e6700 1 -- 172.21.15.1:0/2379175695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9301540a0 msgr2=0x7fb9300aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:28.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.713+0000 7fb9353e6700 1 --2- 172.21.15.1:0/2379175695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9301540a0 0x7fb9300aa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:28.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.713+0000 7fb9353e6700 1 -- 172.21.15.1:0/2379175695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9200092a0 con 0x7fb9300c6430 2023-11-15T02:53:28.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.713+0000 7fb935be7700 1 --2- 172.21.15.1:0/2379175695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb930154480 0x7fb9300ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:28.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.713+0000 7fb9353e6700 1 --2- 172.21.15.1:0/2379175695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9300c6430 0x7fb93014fac0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7fb92c00c590 tx=0x7fb92c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:28.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.713+0000 7fb9257fa700 1 -- 172.21.15.1:0/2379175695 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c007e40 con 0x7fb9300c6430 2023-11-15T02:53:28.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.713+0000 7fb9257fa700 1 -- 172.21.15.1:0/2379175695 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c0072e0 con 0x7fb9300c6430 2023-11-15T02:53:28.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.713+0000 7fb93764a700 1 -- 172.21.15.1:0/2379175695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9301506d0 con 0x7fb9300c6430 2023-11-15T02:53:28.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.713+0000 7fb9257fa700 1 -- 172.21.15.1:0/2379175695 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c0057a0 con 0x7fb9300c6430 2023-11-15T02:53:28.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.713+0000 7fb93764a700 1 -- 172.21.15.1:0/2379175695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93014ffb0 con 0x7fb9300c6430 2023-11-15T02:53:28.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.714+0000 7fb93764a700 1 -- 172.21.15.1:0/2379175695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb930164530 con 0x7fb9300c6430 2023-11-15T02:53:28.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.714+0000 7fb9257fa700 1 -- 172.21.15.1:0/2379175695 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb92c005bd0 con 0x7fb9300c6430 2023-11-15T02:53:28.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.715+0000 7fb9257fa700 1 --2- 172.21.15.1:0/2379175695 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb91405f270 0x7fb914061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:28.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.715+0000 7fb9257fa700 1 -- 172.21.15.1:0/2379175695 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6567+0+0 (secure 0 0 0) 0x7fb92c079ac0 con 0x7fb9300c6430 2023-11-15T02:53:28.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.715+0000 7fb934be5700 1 --2- 172.21.15.1:0/2379175695 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb91405f270 0x7fb914061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:28.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.715+0000 7fb934be5700 1 --2- 172.21.15.1:0/2379175695 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb91405f270 0x7fb914061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fb9300ad3c0 tx=0x7fb920017000).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:28.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.719+0000 7fb9257fa700 1 -- 172.21.15.1:0/2379175695 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb92c04aa50 con 0x7fb9300c6430 2023-11-15T02:53:28.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.893+0000 7fb93764a700 1 -- 172.21.15.1:0/2379175695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb9301501a0 con 0x7fb9300c6430 2023-11-15T02:53:28.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.896+0000 7fb9257fa700 1 -- 172.21.15.1:0/2379175695 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb92c018020 con 0x7fb9300c6430 2023-11-15T02:53:28.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.898+0000 7fb93764a700 1 -- 172.21.15.1:0/2379175695 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb91405f270 msgr2=0x7fb914061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:28.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.898+0000 7fb93764a700 1 --2- 172.21.15.1:0/2379175695 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb91405f270 0x7fb914061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fb9300ad3c0 tx=0x7fb920017000).stop 2023-11-15T02:53:28.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.898+0000 7fb93764a700 1 -- 172.21.15.1:0/2379175695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9300c6430 msgr2=0x7fb93014fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:28.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.898+0000 7fb93764a700 1 --2- 172.21.15.1:0/2379175695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9300c6430 0x7fb93014fac0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7fb92c00c590 tx=0x7fb92c007c80).stop 2023-11-15T02:53:28.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.898+0000 7fb93764a700 1 -- 172.21.15.1:0/2379175695 shutdown_connections 2023-11-15T02:53:28.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.898+0000 7fb93764a700 1 --2- 172.21.15.1:0/2379175695 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb91405f270 0x7fb914061730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:28.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.898+0000 7fb93764a700 1 --2- 172.21.15.1:0/2379175695 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb930154480 0x7fb9300ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:28.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.898+0000 7fb93764a700 1 --2- 172.21.15.1:0/2379175695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9300c6430 0x7fb93014fac0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:28.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.898+0000 7fb93764a700 1 --2- 172.21.15.1:0/2379175695 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb9301540a0 0x7fb9300aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:28.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.898+0000 7fb93764a700 1 -- 172.21.15.1:0/2379175695 >> 172.21.15.1:0/2379175695 conn(0x7fb930064a70 msgr2=0x7fb9301532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:28.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.898+0000 7fb93764a700 1 -- 172.21.15.1:0/2379175695 shutdown_connections 2023-11-15T02:53:28.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:28.898+0000 7fb93764a700 1 -- 172.21.15.1:0/2379175695 wait complete. 2023-11-15T02:53:28.912 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-15T02:53:29.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.031+0000 7f392d575700 1 Processor -- start 2023-11-15T02:53:29.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.031+0000 7f392d575700 1 -- start start 2023-11-15T02:53:29.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f392d575700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39281540a0 0x7f39280ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:29.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f392d575700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3928154480 0x7f39280ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:29.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f392d575700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f39280c5f40 0x7f39280c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:29.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f392d575700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39280c68e0 con 0x7f3928154480 2023-11-15T02:53:29.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f392d575700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39280ca050 con 0x7f39280c5f40 2023-11-15T02:53:29.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f392d575700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39280c9440 con 0x7f39281540a0 2023-11-15T02:53:29.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f39267fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3928154480 0x7f39280ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:29.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f39267fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3928154480 0x7f39280ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40086/0 (socket says 172.21.15.1:40086) 2023-11-15T02:53:29.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f39267fc700 1 -- 172.21.15.1:0/1083076071 learned_addr learned my addr 172.21.15.1:0/1083076071 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:29.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f3926ffd700 1 --2- 172.21.15.1:0/1083076071 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39281540a0 0x7f39280ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:29.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f39267fc700 1 -- 172.21.15.1:0/1083076071 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39281540a0 msgr2=0x7f39280ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:29.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f39277fe700 1 --2- 172.21.15.1:0/1083076071 >> v2:172.21.15.141:3300/0 conn(0x7f39280c5f40 0x7f39280c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:29.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f39267fc700 1 --2- 172.21.15.1:0/1083076071 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39281540a0 0x7f39280ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f39267fc700 1 -- 172.21.15.1:0/1083076071 >> v2:172.21.15.141:3300/0 conn(0x7f39280c5f40 msgr2=0x7f39280c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:29.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f39267fc700 1 --2- 172.21.15.1:0/1083076071 >> v2:172.21.15.141:3300/0 conn(0x7f39280c5f40 0x7f39280c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f39267fc700 1 -- 172.21.15.1:0/1083076071 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39280c9720 con 0x7f3928154480 2023-11-15T02:53:29.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f39277fe700 1 --2- 172.21.15.1:0/1083076071 >> v2:172.21.15.141:3300/0 conn(0x7f39280c5f40 0x7f39280c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:29.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f39267fc700 1 --2- 172.21.15.1:0/1083076071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3928154480 0x7f39280ca9d0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f39280aad10 tx=0x7f391c0090f0).ready entity=mon.0 client_cookie=2f1b0901f36d5432 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:29.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.032+0000 7f3925ffb700 1 -- 172.21.15.1:0/1083076071 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00b600 con 0x7f3928154480 2023-11-15T02:53:29.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.033+0000 7f3925ffb700 1 -- 172.21.15.1:0/1083076071 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c00b760 con 0x7f3928154480 2023-11-15T02:53:29.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.033+0000 7f3925ffb700 1 -- 172.21.15.1:0/1083076071 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00bae0 con 0x7f3928154480 2023-11-15T02:53:29.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.033+0000 7f392d575700 1 -- 172.21.15.1:0/1083076071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3928154480 msgr2=0x7f39280ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:29.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.033+0000 7f392d575700 1 --2- 172.21.15.1:0/1083076071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3928154480 0x7f39280ca9d0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f39280aad10 tx=0x7f391c0090f0).stop 2023-11-15T02:53:29.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.033+0000 7f392d575700 1 -- 172.21.15.1:0/1083076071 shutdown_connections 2023-11-15T02:53:29.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.033+0000 7f392d575700 1 --2- 172.21.15.1:0/1083076071 >> v2:172.21.15.141:3300/0 conn(0x7f39280c5f40 0x7f39280c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.033+0000 7f392d575700 1 --2- 172.21.15.1:0/1083076071 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39281540a0 0x7f39280ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.033+0000 7f392d575700 1 --2- 172.21.15.1:0/1083076071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3928154480 0x7f39280ca9d0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.033+0000 7f392d575700 1 -- 172.21.15.1:0/1083076071 >> 172.21.15.1:0/1083076071 conn(0x7f3928064a70 msgr2=0x7f3928064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:29.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.033+0000 7f392d575700 1 -- 172.21.15.1:0/1083076071 shutdown_connections 2023-11-15T02:53:29.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.033+0000 7f392d575700 1 -- 172.21.15.1:0/1083076071 wait complete. 2023-11-15T02:53:29.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.034+0000 7f392d575700 1 Processor -- start 2023-11-15T02:53:29.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.034+0000 7f392d575700 1 -- start start 2023-11-15T02:53:29.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.035+0000 7f392d575700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39280c5f40 0x7f39280ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:29.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.035+0000 7f392d575700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39281540a0 0x7f3928142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:29.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.035+0000 7f392d575700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3928154480 0x7f39280ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:29.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.035+0000 7f392d575700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3928156b40 con 0x7f3928154480 2023-11-15T02:53:29.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.035+0000 7f392d575700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3928168da0 con 0x7f39280c5f40 2023-11-15T02:53:29.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.035+0000 7f392d575700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3928168190 con 0x7f39281540a0 2023-11-15T02:53:29.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.035+0000 7f39277fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3928154480 0x7f39280ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:29.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.035+0000 7f39277fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3928154480 0x7f39280ac7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40096/0 (socket says 172.21.15.1:40096) 2023-11-15T02:53:29.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.035+0000 7f39277fe700 1 -- 172.21.15.1:0/1791173947 learned_addr learned my addr 172.21.15.1:0/1791173947 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:29.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.035+0000 7f3926ffd700 1 --2- 172.21.15.1:0/1791173947 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39280c5f40 0x7f39280ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:29.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.035+0000 7f39267fc700 1 --2- 172.21.15.1:0/1791173947 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39281540a0 0x7f3928142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:29.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.036+0000 7f39277fe700 1 -- 172.21.15.1:0/1791173947 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39281540a0 msgr2=0x7f3928142980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:29.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.036+0000 7f39277fe700 1 --2- 172.21.15.1:0/1791173947 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39281540a0 0x7f3928142980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.036+0000 7f39277fe700 1 -- 172.21.15.1:0/1791173947 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39280c5f40 msgr2=0x7f39280ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:29.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.036+0000 7f39277fe700 1 --2- 172.21.15.1:0/1791173947 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39280c5f40 0x7f39280ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.036+0000 7f39277fe700 1 -- 172.21.15.1:0/1791173947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c009370 con 0x7f3928154480 2023-11-15T02:53:29.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.036+0000 7f39277fe700 1 --2- 172.21.15.1:0/1791173947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3928154480 0x7f39280ac7e0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f392000cef0 tx=0x7f3920007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:29.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.036+0000 7f390effd700 1 -- 172.21.15.1:0/1791173947 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392000ad20 con 0x7f3928154480 2023-11-15T02:53:29.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.036+0000 7f390effd700 1 -- 172.21.15.1:0/1791173947 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392000ae80 con 0x7f3928154480 2023-11-15T02:53:29.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.036+0000 7f392d575700 1 -- 172.21.15.1:0/1791173947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3928168470 con 0x7f3928154480 2023-11-15T02:53:29.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.036+0000 7f390effd700 1 -- 172.21.15.1:0/1791173947 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920016610 con 0x7f3928154480 2023-11-15T02:53:29.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.036+0000 7f392d575700 1 -- 172.21.15.1:0/1791173947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3928168a30 con 0x7f3928154480 2023-11-15T02:53:29.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.037+0000 7f392d575700 1 -- 172.21.15.1:0/1791173947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392806c7e0 con 0x7f3928154480 2023-11-15T02:53:29.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.037+0000 7f390effd700 1 -- 172.21.15.1:0/1791173947 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f392001f3f0 con 0x7f3928154480 2023-11-15T02:53:29.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.038+0000 7f390effd700 1 --2- 172.21.15.1:0/1791173947 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f391405f270 0x7f3914061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:29.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.038+0000 7f390effd700 1 -- 172.21.15.1:0/1791173947 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6567+0+0 (secure 0 0 0) 0x7f392007ab90 con 0x7f3928154480 2023-11-15T02:53:29.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.038+0000 7f3926ffd700 1 --2- 172.21.15.1:0/1791173947 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f391405f270 0x7f3914061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:29.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.038+0000 7f3926ffd700 1 --2- 172.21.15.1:0/1791173947 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f391405f270 0x7f3914061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f391800ab00 tx=0x7f3918006f90).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:29.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.042+0000 7f390effd700 1 -- 172.21.15.1:0/1791173947 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f392004bb70 con 0x7f3928154480 2023-11-15T02:53:29.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.215+0000 7f392d575700 1 -- 172.21.15.1:0/1791173947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f39280afc50 con 0x7f3928154480 2023-11-15T02:53:29.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.218+0000 7f390effd700 1 -- 172.21.15.1:0/1791173947 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v37) v1 ==== 120+0+0 (secure 0 0 0) 0x7f392001b0b0 con 0x7f3928154480 2023-11-15T02:53:29.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.220+0000 7f392d575700 1 -- 172.21.15.1:0/1791173947 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f391405f270 msgr2=0x7f3914061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:29.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.220+0000 7f392d575700 1 --2- 172.21.15.1:0/1791173947 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f391405f270 0x7f3914061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f391800ab00 tx=0x7f3918006f90).stop 2023-11-15T02:53:29.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.220+0000 7f392d575700 1 -- 172.21.15.1:0/1791173947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3928154480 msgr2=0x7f39280ac7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:29.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.220+0000 7f392d575700 1 --2- 172.21.15.1:0/1791173947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3928154480 0x7f39280ac7e0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f392000cef0 tx=0x7f3920007860).stop 2023-11-15T02:53:29.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.220+0000 7f392d575700 1 -- 172.21.15.1:0/1791173947 shutdown_connections 2023-11-15T02:53:29.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.220+0000 7f392d575700 1 --2- 172.21.15.1:0/1791173947 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f391405f270 0x7f3914061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.220+0000 7f392d575700 1 --2- 172.21.15.1:0/1791173947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3928154480 0x7f39280ac7e0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.220+0000 7f392d575700 1 --2- 172.21.15.1:0/1791173947 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39280c5f40 0x7f39280ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.220+0000 7f392d575700 1 --2- 172.21.15.1:0/1791173947 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39281540a0 0x7f3928142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.220+0000 7f392d575700 1 -- 172.21.15.1:0/1791173947 >> 172.21.15.1:0/1791173947 conn(0x7f3928064a70 msgr2=0x7f39280ab350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:29.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.221+0000 7f392d575700 1 -- 172.21.15.1:0/1791173947 shutdown_connections 2023-11-15T02:53:29.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.221+0000 7f392d575700 1 -- 172.21.15.1:0/1791173947 wait complete. 2023-11-15T02:53:29.234 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-11-15T02:53:29.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.351+0000 7f73a2d07700 1 Processor -- start 2023-11-15T02:53:29.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.351+0000 7f73a2d07700 1 -- start start 2023-11-15T02:53:29.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.352+0000 7f73a2d07700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f739c154150 0x7f739c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:29.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.352+0000 7f73a2d07700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f739c0aa060 0x7f739c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:29.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.352+0000 7f73a2d07700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739c0c06f0 con 0x7f739c0ab1a0 2023-11-15T02:53:29.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.352+0000 7f73a2d07700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739c0c09d0 con 0x7f739c154150 2023-11-15T02:53:29.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.352+0000 7f73a2d07700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739c158820 con 0x7f739c0aa060 2023-11-15T02:53:29.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.352+0000 7f73a0aa3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f739c154150 0x7f739c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:29.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.352+0000 7f739bfff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f739c0ab1a0 0x7f739c158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49192/0 (socket says 172.21.15.1:49192) 2023-11-15T02:53:29.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.352+0000 7f739bfff700 1 -- 172.21.15.1:0/1126612016 learned_addr learned my addr 172.21.15.1:0/1126612016 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:29.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.352+0000 7f73a12a4700 1 --2- 172.21.15.1:0/1126612016 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f739c0aa060 0x7f739c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:29.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f73a0aa3700 1 -- 172.21.15.1:0/1126612016 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f739c0aa060 msgr2=0x7f739c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:29.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f73a0aa3700 1 --2- 172.21.15.1:0/1126612016 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f739c0aa060 0x7f739c0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f73a0aa3700 1 -- 172.21.15.1:0/1126612016 >> v1:172.21.15.1:6789/0 conn(0x7f739c0ab1a0 legacy=0x7f739c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:29.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f739b7fe700 1 -- 172.21.15.1:0/1126612016 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669718740 0 0) 0x7f739c0c06f0 con 0x7f739c0ab1a0 2023-11-15T02:53:29.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f73a0aa3700 1 -- 172.21.15.1:0/1126612016 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c158b00 con 0x7f739c154150 2023-11-15T02:53:29.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f73a0aa3700 1 --2- 172.21.15.1:0/1126612016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f739c154150 0x7f739c154530 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f7394009e60 tx=0x7f7394009780).ready entity=mon.0 client_cookie=cc13c53e1ba91fbe server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:29.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f739b7fe700 1 -- 172.21.15.1:0/1126612016 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739400e070 con 0x7f739c154150 2023-11-15T02:53:29.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f739b7fe700 1 -- 172.21.15.1:0/1126612016 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739400bc30 con 0x7f739c154150 2023-11-15T02:53:29.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f739b7fe700 1 -- 172.21.15.1:0/1126612016 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7394012410 con 0x7f739c154150 2023-11-15T02:53:29.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f73a2d07700 1 -- 172.21.15.1:0/1126612016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f739c154150 msgr2=0x7f739c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:29.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f73a2d07700 1 --2- 172.21.15.1:0/1126612016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f739c154150 0x7f739c154530 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f7394009e60 tx=0x7f7394009780).stop 2023-11-15T02:53:29.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f73a2d07700 1 -- 172.21.15.1:0/1126612016 shutdown_connections 2023-11-15T02:53:29.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f73a2d07700 1 --2- 172.21.15.1:0/1126612016 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f739c0aa060 0x7f739c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f73a2d07700 1 --2- 172.21.15.1:0/1126612016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f739c154150 0x7f739c154530 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f73a2d07700 1 -- 172.21.15.1:0/1126612016 >> 172.21.15.1:0/1126612016 conn(0x7f739c064aa0 msgr2=0x7f739c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:29.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f73a2d07700 1 -- 172.21.15.1:0/1126612016 shutdown_connections 2023-11-15T02:53:29.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.353+0000 7f73a2d07700 1 -- 172.21.15.1:0/1126612016 wait complete. 2023-11-15T02:53:29.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.355+0000 7f73a2d07700 1 Processor -- start 2023-11-15T02:53:29.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.355+0000 7f73a2d07700 1 -- start start 2023-11-15T02:53:29.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.355+0000 7f73a2d07700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f739c0aa060 0x7f739c141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:29.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.355+0000 7f73a2d07700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f739c0ab1a0 0x7f739c0b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:29.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a2d07700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f739c154150 0x7f739c0b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:29.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a2d07700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c0b09f0 con 0x7f739c0aa060 2023-11-15T02:53:29.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a2d07700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c154ae0 con 0x7f739c0ab1a0 2023-11-15T02:53:29.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a2d07700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739c0aee80 con 0x7f739c154150 2023-11-15T02:53:29.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a0aa3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f739c0aa060 0x7f739c141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:29.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a0aa3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f739c0aa060 0x7f739c141a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40116/0 (socket says 172.21.15.1:40116) 2023-11-15T02:53:29.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a0aa3700 1 -- 172.21.15.1:0/1251705107 learned_addr learned my addr 172.21.15.1:0/1251705107 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:29.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a12a4700 1 --2- 172.21.15.1:0/1251705107 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f739c154150 0x7f739c0b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:29.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f739bfff700 1 --2- 172.21.15.1:0/1251705107 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f739c0ab1a0 0x7f739c0b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:29.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a0aa3700 1 -- 172.21.15.1:0/1251705107 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f739c154150 msgr2=0x7f739c0b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:29.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a0aa3700 1 --2- 172.21.15.1:0/1251705107 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f739c154150 0x7f739c0b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a0aa3700 1 -- 172.21.15.1:0/1251705107 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f739c0ab1a0 msgr2=0x7f739c0b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:29.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a0aa3700 1 --2- 172.21.15.1:0/1251705107 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f739c0ab1a0 0x7f739c0b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:29.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a0aa3700 1 -- 172.21.15.1:0/1251705107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7394009a20 con 0x7f739c0aa060 2023-11-15T02:53:29.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a0aa3700 1 --2- 172.21.15.1:0/1251705107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f739c0aa060 0x7f739c141a10 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f739400b6c0 tx=0x7f7394009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:29.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f7398ff9700 1 -- 172.21.15.1:0/1251705107 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7394007080 con 0x7f739c0aa060 2023-11-15T02:53:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f7398ff9700 1 -- 172.21.15.1:0/1251705107 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739401d630 con 0x7f739c0aa060 2023-11-15T02:53:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a2d07700 1 -- 172.21.15.1:0/1251705107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f739c0af160 con 0x7f739c0aa060 2023-11-15T02:53:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f7398ff9700 1 -- 172.21.15.1:0/1251705107 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739401d9d0 con 0x7f739c0aa060 2023-11-15T02:53:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.356+0000 7f73a2d07700 1 -- 172.21.15.1:0/1251705107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739c0af720 con 0x7f739c0aa060 2023-11-15T02:53:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.357+0000 7f73a2d07700 1 -- 172.21.15.1:0/1251705107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739c06c7e0 con 0x7f739c0aa060 2023-11-15T02:53:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.358+0000 7f7398ff9700 1 -- 172.21.15.1:0/1251705107 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7394003040 con 0x7f739c0aa060 2023-11-15T02:53:29.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.358+0000 7f7398ff9700 1 --2- 172.21.15.1:0/1251705107 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f737c05f270 0x7f737c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:29.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.358+0000 7f7398ff9700 1 -- 172.21.15.1:0/1251705107 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6567+0+0 (secure 0 0 0) 0x7f739407c160 con 0x7f739c0aa060 2023-11-15T02:53:29.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.358+0000 7f739bfff700 1 --2- 172.21.15.1:0/1251705107 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f737c05f270 0x7f737c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:29.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.359+0000 7f739bfff700 1 --2- 172.21.15.1:0/1251705107 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f737c05f270 0x7f737c061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f739c0b1270 tx=0x7f738c009040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:29.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.362+0000 7f7398ff9700 1 -- 172.21.15.1:0/1251705107 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f739404d0f0 con 0x7f739c0aa060 2023-11-15T02:53:29.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:29.603+0000 7f73a2d07700 1 -- 172.21.15.1:0/1251705107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f739c0c02a0 con 0x7f739c0aa060 2023-11-15T02:53:30.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.558+0000 7f7398ff9700 1 -- 172.21.15.1:0/1251705107 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2946) v1 ==== 165+0+0 (secure 0 0 0) 0x7f7394050710 con 0x7f739c0aa060 2023-11-15T02:53:30.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.561+0000 7f73a2d07700 1 -- 172.21.15.1:0/1251705107 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f737c05f270 msgr2=0x7f737c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:30.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.561+0000 7f73a2d07700 1 --2- 172.21.15.1:0/1251705107 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f737c05f270 0x7f737c061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f739c0b1270 tx=0x7f738c009040).stop 2023-11-15T02:53:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.561+0000 7f73a2d07700 1 -- 172.21.15.1:0/1251705107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f739c0aa060 msgr2=0x7f739c141a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.561+0000 7f73a2d07700 1 --2- 172.21.15.1:0/1251705107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f739c0aa060 0x7f739c141a10 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f739400b6c0 tx=0x7f7394009780).stop 2023-11-15T02:53:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.561+0000 7f73a2d07700 1 -- 172.21.15.1:0/1251705107 shutdown_connections 2023-11-15T02:53:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.561+0000 7f73a2d07700 1 --2- 172.21.15.1:0/1251705107 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f737c05f270 0x7f737c061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.561+0000 7f73a2d07700 1 --2- 172.21.15.1:0/1251705107 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f739c154150 0x7f739c0b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.561+0000 7f73a2d07700 1 --2- 172.21.15.1:0/1251705107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f739c0aa060 0x7f739c141a10 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.561+0000 7f73a2d07700 1 --2- 172.21.15.1:0/1251705107 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f739c0ab1a0 0x7f739c0b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.561+0000 7f73a2d07700 1 -- 172.21.15.1:0/1251705107 >> 172.21.15.1:0/1251705107 conn(0x7f739c064aa0 msgr2=0x7f739c0c96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.561+0000 7f73a2d07700 1 -- 172.21.15.1:0/1251705107 shutdown_connections 2023-11-15T02:53:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.561+0000 7f73a2d07700 1 -- 172.21.15.1:0/1251705107 wait complete. 2023-11-15T02:53:30.578 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-11-15T02:53:30.579 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-11-15T02:53:30.579 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-11-15T02:53:30.580 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-11-15T02:53:30.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.703+0000 7f8c1e309700 1 Processor -- start 2023-11-15T02:53:30.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.704+0000 7f8c1e309700 1 -- start start 2023-11-15T02:53:30.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.704+0000 7f8c1e309700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8c18151e10 0x7f8c18155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:30.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.704+0000 7f8c1e309700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c180c86b0 0x7f8c180aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:30.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.704+0000 7f8c1e309700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8c180c98b0 0x7f8c180c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:30.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.704+0000 7f8c1e309700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c180c7980 con 0x7f8c180c98b0 2023-11-15T02:53:30.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.704+0000 7f8c1e309700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c180c8b10 con 0x7f8c18151e10 2023-11-15T02:53:30.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.704+0000 7f8c1e309700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180ca210 con 0x7f8c180c86b0 2023-11-15T02:53:30.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.705+0000 7f8c1db08700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8c180c98b0 0x7f8c180c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:30.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.705+0000 7f8c1db08700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8c180c98b0 0x7f8c180c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40126/0 (socket says 172.21.15.1:40126) 2023-11-15T02:53:30.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.705+0000 7f8c1db08700 1 -- 172.21.15.1:0/1961960601 learned_addr learned my addr 172.21.15.1:0/1961960601 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:30.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.705+0000 7f8c1cb06700 1 --2- 172.21.15.1:0/1961960601 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c180c86b0 0x7f8c180aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:30.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.705+0000 7f8c1d307700 1 --2- 172.21.15.1:0/1961960601 >> v2:172.21.15.141:3300/0 conn(0x7f8c18151e10 0x7f8c18155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:30.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.705+0000 7f8c1db08700 1 -- 172.21.15.1:0/1961960601 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c180c86b0 msgr2=0x7f8c180aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:30.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.705+0000 7f8c1db08700 1 --2- 172.21.15.1:0/1961960601 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c180c86b0 0x7f8c180aa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:30.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.705+0000 7f8c1db08700 1 -- 172.21.15.1:0/1961960601 >> v2:172.21.15.141:3300/0 conn(0x7f8c18151e10 msgr2=0x7f8c18155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:30.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.705+0000 7f8c1db08700 1 --2- 172.21.15.1:0/1961960601 >> v2:172.21.15.141:3300/0 conn(0x7f8c18151e10 0x7f8c18155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:30.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.705+0000 7f8c1db08700 1 -- 172.21.15.1:0/1961960601 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c180aa5c0 con 0x7f8c180c98b0 2023-11-15T02:53:30.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.705+0000 7f8c1db08700 1 --2- 172.21.15.1:0/1961960601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c180c98b0 0x7f8c180c9d20 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f8c18084780 tx=0x7f8c08009840).ready entity=mon.0 client_cookie=626863f7dd594d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:30.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.705+0000 7f8c17fff700 1 -- 172.21.15.1:0/1961960601 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0800e070 con 0x7f8c180c98b0 2023-11-15T02:53:30.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.705+0000 7f8c17fff700 1 -- 172.21.15.1:0/1961960601 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0800ba50 con 0x7f8c180c98b0 2023-11-15T02:53:30.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.705+0000 7f8c17fff700 1 -- 172.21.15.1:0/1961960601 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0800bdd0 con 0x7f8c180c98b0 2023-11-15T02:53:30.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.706+0000 7f8c1e309700 1 -- 172.21.15.1:0/1961960601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c180c98b0 msgr2=0x7f8c180c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:30.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.706+0000 7f8c1e309700 1 --2- 172.21.15.1:0/1961960601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c180c98b0 0x7f8c180c9d20 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f8c18084780 tx=0x7f8c08009840).stop 2023-11-15T02:53:30.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.706+0000 7f8c1e309700 1 -- 172.21.15.1:0/1961960601 shutdown_connections 2023-11-15T02:53:30.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.706+0000 7f8c1e309700 1 --2- 172.21.15.1:0/1961960601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c180c98b0 0x7f8c180c9d20 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:30.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.706+0000 7f8c1e309700 1 --2- 172.21.15.1:0/1961960601 >> v2:172.21.15.141:3300/0 conn(0x7f8c18151e10 0x7f8c18155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:30.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.706+0000 7f8c1e309700 1 --2- 172.21.15.1:0/1961960601 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c180c86b0 0x7f8c180aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:30.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.706+0000 7f8c1e309700 1 -- 172.21.15.1:0/1961960601 >> 172.21.15.1:0/1961960601 conn(0x7f8c180947e0 msgr2=0x7f8c1806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:30.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.706+0000 7f8c1e309700 1 -- 172.21.15.1:0/1961960601 shutdown_connections 2023-11-15T02:53:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.706+0000 7f8c1e309700 1 -- 172.21.15.1:0/1961960601 wait complete. 2023-11-15T02:53:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.707+0000 7f8c1e309700 1 Processor -- start 2023-11-15T02:53:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.707+0000 7f8c1e309700 1 -- start start 2023-11-15T02:53:30.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.708+0000 7f8c1e309700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c180c86b0 0x7f8c18096af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:30.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.708+0000 7f8c1e309700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c180c98b0 0x7f8c1814eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:30.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.708+0000 7f8c1e309700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c18151e10 0x7f8c180ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:30.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.708+0000 7f8c1e309700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180973d0 con 0x7f8c18151e10 2023-11-15T02:53:30.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.708+0000 7f8c1e309700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180976b0 con 0x7f8c180c98b0 2023-11-15T02:53:30.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.708+0000 7f8c1e309700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c18097990 con 0x7f8c180c86b0 2023-11-15T02:53:30.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.708+0000 7f8c1db08700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c18151e10 0x7f8c180ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:30.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.708+0000 7f8c1db08700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c18151e10 0x7f8c180ae350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40142/0 (socket says 172.21.15.1:40142) 2023-11-15T02:53:30.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.708+0000 7f8c1d307700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c180c86b0 0x7f8c18096af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:30.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.708+0000 7f8c1db08700 1 -- 172.21.15.1:0/1542937360 learned_addr learned my addr 172.21.15.1:0/1542937360 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:30.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.708+0000 7f8c1cb06700 1 --2- 172.21.15.1:0/1542937360 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c180c98b0 0x7f8c1814eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:30.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.708+0000 7f8c1db08700 1 -- 172.21.15.1:0/1542937360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c180c86b0 msgr2=0x7f8c18096af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:30.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.708+0000 7f8c1db08700 1 --2- 172.21.15.1:0/1542937360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c180c86b0 0x7f8c18096af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:30.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.708+0000 7f8c1db08700 1 -- 172.21.15.1:0/1542937360 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c180c98b0 msgr2=0x7f8c1814eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:30.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.709+0000 7f8c1db08700 1 --2- 172.21.15.1:0/1542937360 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c180c98b0 0x7f8c1814eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:30.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.709+0000 7f8c1db08700 1 -- 172.21.15.1:0/1542937360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c08009ae0 con 0x7f8c18151e10 2023-11-15T02:53:30.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.709+0000 7f8c1db08700 1 --2- 172.21.15.1:0/1542937360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c18151e10 0x7f8c180ae350 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f8c08009fd0 tx=0x7f8c08009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:30.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.709+0000 7f8c157fa700 1 -- 172.21.15.1:0/1542937360 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c08013e60 con 0x7f8c18151e10 2023-11-15T02:53:30.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.709+0000 7f8c157fa700 1 -- 172.21.15.1:0/1542937360 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c080092e0 con 0x7f8c18151e10 2023-11-15T02:53:30.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.709+0000 7f8c1e309700 1 -- 172.21.15.1:0/1542937360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c18097c70 con 0x7f8c18151e10 2023-11-15T02:53:30.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.709+0000 7f8c157fa700 1 -- 172.21.15.1:0/1542937360 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0801e6c0 con 0x7f8c18151e10 2023-11-15T02:53:30.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.709+0000 7f8c1e309700 1 -- 172.21.15.1:0/1542937360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c18096fe0 con 0x7f8c18151e10 2023-11-15T02:53:30.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.710+0000 7f8c1e309700 1 -- 172.21.15.1:0/1542937360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c180475e0 con 0x7f8c18151e10 2023-11-15T02:53:30.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.710+0000 7f8c157fa700 1 -- 172.21.15.1:0/1542937360 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8c08003040 con 0x7f8c18151e10 2023-11-15T02:53:30.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.711+0000 7f8c157fa700 1 --2- 172.21.15.1:0/1542937360 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8c0405f270 0x7f8c04061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:30.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.711+0000 7f8c157fa700 1 -- 172.21.15.1:0/1542937360 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6567+0+0 (secure 0 0 0) 0x7f8c0807bb50 con 0x7f8c18151e10 2023-11-15T02:53:30.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.711+0000 7f8c1d307700 1 --2- 172.21.15.1:0/1542937360 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8c0405f270 0x7f8c04061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:30.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.711+0000 7f8c1d307700 1 --2- 172.21.15.1:0/1542937360 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8c0405f270 0x7f8c04061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8c1000bb10 tx=0x7f8c10008040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:30.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.715+0000 7f8c157fa700 1 -- 172.21.15.1:0/1542937360 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8c0804cae0 con 0x7f8c18151e10 2023-11-15T02:53:30.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:30.957+0000 7f8c1e309700 1 -- 172.21.15.1:0/1542937360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f8c180aa890 con 0x7f8c18151e10 2023-11-15T02:53:31.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.560+0000 7f8c157fa700 1 -- 172.21.15.1:0/1542937360 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v2947) v1 ==== 166+0+0 (secure 0 0 0) 0x7f8c08023030 con 0x7f8c18151e10 2023-11-15T02:53:31.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.563+0000 7f8c1e309700 1 -- 172.21.15.1:0/1542937360 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8c0405f270 msgr2=0x7f8c04061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:31.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.563+0000 7f8c1e309700 1 --2- 172.21.15.1:0/1542937360 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8c0405f270 0x7f8c04061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8c1000bb10 tx=0x7f8c10008040).stop 2023-11-15T02:53:31.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.563+0000 7f8c1e309700 1 -- 172.21.15.1:0/1542937360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c18151e10 msgr2=0x7f8c180ae350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:31.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.563+0000 7f8c1e309700 1 --2- 172.21.15.1:0/1542937360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c18151e10 0x7f8c180ae350 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f8c08009fd0 tx=0x7f8c08009840).stop 2023-11-15T02:53:31.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.563+0000 7f8c1e309700 1 -- 172.21.15.1:0/1542937360 shutdown_connections 2023-11-15T02:53:31.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.563+0000 7f8c1e309700 1 --2- 172.21.15.1:0/1542937360 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8c0405f270 0x7f8c04061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:31.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.563+0000 7f8c1e309700 1 --2- 172.21.15.1:0/1542937360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c18151e10 0x7f8c180ae350 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:31.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.563+0000 7f8c1e309700 1 --2- 172.21.15.1:0/1542937360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c180c86b0 0x7f8c18096af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:31.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.563+0000 7f8c1e309700 1 --2- 172.21.15.1:0/1542937360 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c180c98b0 0x7f8c1814eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:31.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.563+0000 7f8c1e309700 1 -- 172.21.15.1:0/1542937360 >> 172.21.15.1:0/1542937360 conn(0x7f8c180947e0 msgr2=0x7f8c180a9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:31.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.563+0000 7f8c1e309700 1 -- 172.21.15.1:0/1542937360 shutdown_connections 2023-11-15T02:53:31.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.563+0000 7f8c1e309700 1 -- 172.21.15.1:0/1542937360 wait complete. 2023-11-15T02:53:31.580 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-15T02:53:31.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.706+0000 7f758f117700 1 Processor -- start 2023-11-15T02:53:31.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.706+0000 7f758f117700 1 -- start start 2023-11-15T02:53:31.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.707+0000 7f758f117700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f75881540a0 0x7f75880ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:31.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.707+0000 7f758f117700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f75880c6650 0x7f75880ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:31.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.707+0000 7f758f117700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75880ca050 con 0x7f7588154480 2023-11-15T02:53:31.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.707+0000 7f758f117700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75880c9440 con 0x7f75880c6650 2023-11-15T02:53:31.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.707+0000 7f758f117700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75880c9720 con 0x7f75881540a0 2023-11-15T02:53:31.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.707+0000 7f758d6b4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f75880c6650 0x7f75880ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:31.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.707+0000 7f7587fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7588154480 0x7f75880c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49196/0 (socket says 172.21.15.1:49196) 2023-11-15T02:53:31.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.707+0000 7f7587fff700 1 -- 172.21.15.1:0/3546125680 learned_addr learned my addr 172.21.15.1:0/3546125680 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:31.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f758ceb3700 1 --2- 172.21.15.1:0/3546125680 >> v2:172.21.15.141:3300/0 conn(0x7f75881540a0 0x7f75880ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:31.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f758d6b4700 1 -- 172.21.15.1:0/3546125680 >> v2:172.21.15.141:3300/0 conn(0x7f75881540a0 msgr2=0x7f75880ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:31.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f758d6b4700 1 --2- 172.21.15.1:0/3546125680 >> v2:172.21.15.141:3300/0 conn(0x7f75881540a0 0x7f75880ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:31.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f758d6b4700 1 -- 172.21.15.1:0/3546125680 >> v1:172.21.15.1:6789/0 conn(0x7f7588154480 legacy=0x7f75880c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:31.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f75877fe700 1 -- 172.21.15.1:0/3546125680 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765926868 0 0) 0x7f75880ca050 con 0x7f7588154480 2023-11-15T02:53:31.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f758d6b4700 1 -- 172.21.15.1:0/3546125680 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75880c9a00 con 0x7f75880c6650 2023-11-15T02:53:31.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f758d6b4700 1 --2- 172.21.15.1:0/3546125680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75880c6650 0x7f75880ca9d0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7f758805ff40 tx=0x7f7580009780).ready entity=mon.0 client_cookie=976f8f285c838216 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:31.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f75877fe700 1 -- 172.21.15.1:0/3546125680 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758000e070 con 0x7f75880c6650 2023-11-15T02:53:31.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f75877fe700 1 -- 172.21.15.1:0/3546125680 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758000bc30 con 0x7f75880c6650 2023-11-15T02:53:31.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f75877fe700 1 -- 172.21.15.1:0/3546125680 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7580012410 con 0x7f75880c6650 2023-11-15T02:53:31.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f758f117700 1 -- 172.21.15.1:0/3546125680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75880c6650 msgr2=0x7f75880ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:31.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f758f117700 1 --2- 172.21.15.1:0/3546125680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75880c6650 0x7f75880ca9d0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7f758805ff40 tx=0x7f7580009780).stop 2023-11-15T02:53:31.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f758f117700 1 -- 172.21.15.1:0/3546125680 shutdown_connections 2023-11-15T02:53:31.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f758f117700 1 --2- 172.21.15.1:0/3546125680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75880c6650 0x7f75880ca9d0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:31.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f758f117700 1 --2- 172.21.15.1:0/3546125680 >> v2:172.21.15.141:3300/0 conn(0x7f75881540a0 0x7f75880ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:31.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.708+0000 7f758f117700 1 -- 172.21.15.1:0/3546125680 >> 172.21.15.1:0/3546125680 conn(0x7f7588064a70 msgr2=0x7f7588064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:31.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.709+0000 7f758f117700 1 -- 172.21.15.1:0/3546125680 shutdown_connections 2023-11-15T02:53:31.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.709+0000 7f758f117700 1 -- 172.21.15.1:0/3546125680 wait complete. 2023-11-15T02:53:31.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.710+0000 7f758f117700 1 Processor -- start 2023-11-15T02:53:31.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.710+0000 7f758f117700 1 -- start start 2023-11-15T02:53:31.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.710+0000 7f758f117700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75880c6650 0x7f75880b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:31.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758f117700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75881540a0 0x7f7588147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:31.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758f117700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7588154480 0x7f75880c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:31.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758f117700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75881483f0 con 0x7f75880c6650 2023-11-15T02:53:31.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758f117700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75880c34f0 con 0x7f75881540a0 2023-11-15T02:53:31.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758f117700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75880c2660 con 0x7f7588154480 2023-11-15T02:53:31.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758ceb3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75880c6650 0x7f75880b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:31.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758ceb3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75880c6650 0x7f75880b0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40154/0 (socket says 172.21.15.1:40154) 2023-11-15T02:53:31.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758ceb3700 1 -- 172.21.15.1:0/2272985721 learned_addr learned my addr 172.21.15.1:0/2272985721 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:31.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758d6b4700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7588154480 0x7f75880c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:31.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f7587fff700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75881540a0 0x7f7588147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:31.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758ceb3700 1 -- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7588154480 msgr2=0x7f75880c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:31.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758ceb3700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7588154480 0x7f75880c2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:31.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758ceb3700 1 -- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75881540a0 msgr2=0x7f7588147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:31.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758ceb3700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75881540a0 0x7f7588147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:31.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758ceb3700 1 -- 172.21.15.1:0/2272985721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7580009a20 con 0x7f75880c6650 2023-11-15T02:53:31.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f7587fff700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75881540a0 0x7f7588147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:53:31.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758d6b4700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7588154480 0x7f75880c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:53:31.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758ceb3700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75880c6650 0x7f75880b0220 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7f757800d8c0 tx=0x7f7578008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:31.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f7584ff9700 1 -- 172.21.15.1:0/2272985721 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75780095b0 con 0x7f75880c6650 2023-11-15T02:53:31.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f7584ff9700 1 -- 172.21.15.1:0/2272985721 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7578009710 con 0x7f75880c6650 2023-11-15T02:53:31.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758f117700 1 -- 172.21.15.1:0/2272985721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75880c28e0 con 0x7f75880c6650 2023-11-15T02:53:31.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f7584ff9700 1 -- 172.21.15.1:0/2272985721 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7578009a90 con 0x7f75880c6650 2023-11-15T02:53:31.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.711+0000 7f758f117700 1 -- 172.21.15.1:0/2272985721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75880c2ea0 con 0x7f75880c6650 2023-11-15T02:53:31.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.713+0000 7f758f117700 1 -- 172.21.15.1:0/2272985721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758806c7e0 con 0x7f75880c6650 2023-11-15T02:53:31.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.713+0000 7f7584ff9700 1 -- 172.21.15.1:0/2272985721 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7578013480 con 0x7f75880c6650 2023-11-15T02:53:31.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.713+0000 7f7584ff9700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f757405f270 0x7f7574061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:31.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.713+0000 7f7584ff9700 1 -- 172.21.15.1:0/2272985721 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6567+0+0 (secure 0 0 0) 0x7f757807a470 con 0x7f75880c6650 2023-11-15T02:53:31.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.713+0000 7f7587fff700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f757405f270 0x7f7574061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:31.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.714+0000 7f7587fff700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f757405f270 0x7f7574061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f757c001710 tx=0x7f757c009040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:31.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.717+0000 7f7584ff9700 1 -- 172.21.15.1:0/2272985721 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f757804b400 con 0x7f75880c6650 2023-11-15T02:53:31.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.890+0000 7f758f117700 1 -- 172.21.15.1:0/2272985721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f75880c9ce0 con 0x7f75880c6650 2023-11-15T02:53:31.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.894+0000 7f7584ff9700 1 -- 172.21.15.1:0/2272985721 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7f757804ea20 con 0x7f75880c6650 2023-11-15T02:53:31.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.895+0000 7f758f117700 1 -- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f757405f270 msgr2=0x7f7574061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:31.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.895+0000 7f758f117700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f757405f270 0x7f7574061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f757c001710 tx=0x7f757c009040).stop 2023-11-15T02:53:31.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.895+0000 7f758f117700 1 -- 172.21.15.1:0/2272985721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75880c6650 msgr2=0x7f75880b0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:31.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.895+0000 7f758f117700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75880c6650 0x7f75880b0220 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7f757800d8c0 tx=0x7f7578008040).stop 2023-11-15T02:53:31.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.895+0000 7f758f117700 1 -- 172.21.15.1:0/2272985721 shutdown_connections 2023-11-15T02:53:31.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.895+0000 7f758f117700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f757405f270 0x7f7574061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:31.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.895+0000 7f758f117700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7588154480 0x7f75880c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:31.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.895+0000 7f758f117700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75880c6650 0x7f75880b0220 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:31.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.895+0000 7f758f117700 1 --2- 172.21.15.1:0/2272985721 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75881540a0 0x7f7588147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:31.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.895+0000 7f758f117700 1 -- 172.21.15.1:0/2272985721 >> 172.21.15.1:0/2272985721 conn(0x7f7588064a70 msgr2=0x7f758814df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:31.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.896+0000 7f758f117700 1 -- 172.21.15.1:0/2272985721 shutdown_connections 2023-11-15T02:53:31.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:31.896+0000 7f758f117700 1 -- 172.21.15.1:0/2272985721 wait complete. 2023-11-15T02:53:31.910 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T02:53:31.910 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:53:31.953 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:53:31.997 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T02:53:31.997 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-15T02:53:31.998 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:53:32.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.114+0000 7f649c3eb700 1 Processor -- start 2023-11-15T02:53:32.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.114+0000 7f649c3eb700 1 -- start start 2023-11-15T02:53:32.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.115+0000 7f649c3eb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f64940ab1a0 0x7f6494154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:32.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.115+0000 7f649c3eb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64940aa060 0x7f64940c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:32.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.115+0000 7f649c3eb700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64940c06f0 con 0x7f6494154150 2023-11-15T02:53:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.115+0000 7f649c3eb700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64940c09d0 con 0x7f64940ab1a0 2023-11-15T02:53:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.115+0000 7f649c3eb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6494158820 con 0x7f64940aa060 2023-11-15T02:53:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.115+0000 7f6499986700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f64940ab1a0 0x7f6494154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.115+0000 7f649a187700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6494154150 0x7f6494158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49198/0 (socket says 172.21.15.1:49198) 2023-11-15T02:53:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.115+0000 7f649a187700 1 -- 172.21.15.1:0/3590451608 learned_addr learned my addr 172.21.15.1:0/3590451608 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.116+0000 7f649a988700 1 --2- 172.21.15.1:0/3590451608 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64940aa060 0x7f64940c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.116+0000 7f6499986700 1 -- 172.21.15.1:0/3590451608 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64940aa060 msgr2=0x7f64940c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.116+0000 7f6499986700 1 --2- 172.21.15.1:0/3590451608 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64940aa060 0x7f64940c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.116+0000 7f6499986700 1 -- 172.21.15.1:0/3590451608 >> v1:172.21.15.1:6789/0 conn(0x7f6494154150 legacy=0x7f6494158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.116+0000 7f6499185700 1 -- 172.21.15.1:0/3590451608 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563690872 0 0) 0x7f64940c06f0 con 0x7f6494154150 2023-11-15T02:53:32.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.116+0000 7f6499986700 1 -- 172.21.15.1:0/3590451608 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6494158b00 con 0x7f64940ab1a0 2023-11-15T02:53:32.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.116+0000 7f6499986700 1 --2- 172.21.15.1:0/3590451608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64940ab1a0 0x7f6494154530 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7f6488009760 tx=0x7f6488009060).ready entity=mon.0 client_cookie=d8c0b49dc4247e7f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:32.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.116+0000 7f6499185700 1 -- 172.21.15.1:0/3590451608 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64880090d0 con 0x7f64940ab1a0 2023-11-15T02:53:32.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.116+0000 7f6499185700 1 -- 172.21.15.1:0/3590451608 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648800b580 con 0x7f64940ab1a0 2023-11-15T02:53:32.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.116+0000 7f6499185700 1 -- 172.21.15.1:0/3590451608 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648800b900 con 0x7f64940ab1a0 2023-11-15T02:53:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.117+0000 7f649c3eb700 1 -- 172.21.15.1:0/3590451608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64940ab1a0 msgr2=0x7f6494154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.117+0000 7f649c3eb700 1 --2- 172.21.15.1:0/3590451608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64940ab1a0 0x7f6494154530 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7f6488009760 tx=0x7f6488009060).stop 2023-11-15T02:53:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.117+0000 7f649c3eb700 1 -- 172.21.15.1:0/3590451608 shutdown_connections 2023-11-15T02:53:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.117+0000 7f649c3eb700 1 --2- 172.21.15.1:0/3590451608 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64940aa060 0x7f64940c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.117+0000 7f649c3eb700 1 --2- 172.21.15.1:0/3590451608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64940ab1a0 0x7f6494154530 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:32.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.117+0000 7f649c3eb700 1 -- 172.21.15.1:0/3590451608 >> 172.21.15.1:0/3590451608 conn(0x7f6494064aa0 msgr2=0x7f6494064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:32.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.117+0000 7f649c3eb700 1 -- 172.21.15.1:0/3590451608 shutdown_connections 2023-11-15T02:53:32.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.117+0000 7f649c3eb700 1 -- 172.21.15.1:0/3590451608 wait complete. 2023-11-15T02:53:32.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.118+0000 7f649c3eb700 1 Processor -- start 2023-11-15T02:53:32.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.118+0000 7f649c3eb700 1 -- start start 2023-11-15T02:53:32.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f649c3eb700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64940aa060 0x7f6494148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:32.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f649c3eb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64940ab1a0 0x7f6494157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:32.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f649c3eb700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6494154150 0x7f6494157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:32.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f649c3eb700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64941563a0 con 0x7f64940ab1a0 2023-11-15T02:53:32.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f649c3eb700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64940c90c0 con 0x7f6494154150 2023-11-15T02:53:32.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f649c3eb700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64940c9360 con 0x7f64940aa060 2023-11-15T02:53:32.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f6499986700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64940ab1a0 0x7f6494157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:32.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f6499986700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64940ab1a0 0x7f6494157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40170/0 (socket says 172.21.15.1:40170) 2023-11-15T02:53:32.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f6499986700 1 -- 172.21.15.1:0/3815770487 learned_addr learned my addr 172.21.15.1:0/3815770487 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:32.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f649a187700 1 --2- 172.21.15.1:0/3815770487 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64940aa060 0x7f6494148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:32.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f649a988700 1 --2- 172.21.15.1:0/3815770487 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6494154150 0x7f6494157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:32.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f6499986700 1 -- 172.21.15.1:0/3815770487 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64940aa060 msgr2=0x7f6494148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:32.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f6499986700 1 --2- 172.21.15.1:0/3815770487 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64940aa060 0x7f6494148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:32.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f6499986700 1 -- 172.21.15.1:0/3815770487 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6494154150 msgr2=0x7f6494157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:32.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f6499986700 1 --2- 172.21.15.1:0/3815770487 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6494154150 0x7f6494157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:32.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f6499986700 1 -- 172.21.15.1:0/3815770487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64880092a0 con 0x7f64940ab1a0 2023-11-15T02:53:32.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f649a187700 1 --2- 172.21.15.1:0/3815770487 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64940aa060 0x7f6494148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:53:32.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f6499986700 1 --2- 172.21.15.1:0/3815770487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64940ab1a0 0x7f6494157220 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7f6488009eb0 tx=0x7f6488017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:32.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f64927fc700 1 -- 172.21.15.1:0/3815770487 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648800b900 con 0x7f64940ab1a0 2023-11-15T02:53:32.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f64927fc700 1 -- 172.21.15.1:0/3815770487 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648800bcc0 con 0x7f64940ab1a0 2023-11-15T02:53:32.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f649c3eb700 1 -- 172.21.15.1:0/3815770487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64940c9640 con 0x7f64940ab1a0 2023-11-15T02:53:32.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f64927fc700 1 -- 172.21.15.1:0/3815770487 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648801b410 con 0x7f64940ab1a0 2023-11-15T02:53:32.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.119+0000 7f649c3eb700 1 -- 172.21.15.1:0/3815770487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64940c9c00 con 0x7f64940ab1a0 2023-11-15T02:53:32.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.120+0000 7f649c3eb700 1 -- 172.21.15.1:0/3815770487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64940ca250 con 0x7f64940ab1a0 2023-11-15T02:53:32.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.121+0000 7f64927fc700 1 -- 172.21.15.1:0/3815770487 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f648801b800 con 0x7f64940ab1a0 2023-11-15T02:53:32.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.121+0000 7f64927fc700 1 --2- 172.21.15.1:0/3815770487 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f648005f270 0x7f6480061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:32.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.121+0000 7f64927fc700 1 -- 172.21.15.1:0/3815770487 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6567+0+0 (secure 0 0 0) 0x7f648807c0a0 con 0x7f64940ab1a0 2023-11-15T02:53:32.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.121+0000 7f649a187700 1 --2- 172.21.15.1:0/3815770487 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f648005f270 0x7f6480061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:32.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.122+0000 7f649a187700 1 --2- 172.21.15.1:0/3815770487 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f648005f270 0x7f6480061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f648c001e10 tx=0x7f648c009040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:32.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.125+0000 7f64927fc700 1 -- 172.21.15.1:0/3815770487 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f648804cf70 con 0x7f64940ab1a0 2023-11-15T02:53:32.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.340+0000 7f649c3eb700 1 -- 172.21.15.1:0/3815770487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6494158de0 con 0x7f64940ab1a0 2023-11-15T02:53:32.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.341+0000 7f64927fc700 1 -- 172.21.15.1:0/3815770487 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f648801f090 con 0x7f64940ab1a0 2023-11-15T02:53:32.343 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:32.344 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":81,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7322,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/3282299930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":3282299930},{"type":"v1","addr":"172.21.15.141:6837","nonce":3282299930}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":8281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3059700101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3059700101},{"type":"v1","addr":"172.21.15.141:6836","nonce":3059700101}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9057,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2954825492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2954825492},{"type":"v1","addr":"172.21.15.1:6834","nonce":2954825492}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9522,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2943312122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":2943312122},{"type":"v1","addr":"172.21.15.1:6835","nonce":2943312122}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[]} 2023-11-15T02:53:32.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.342+0000 7f649c3eb700 1 -- 172.21.15.1:0/3815770487 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f648005f270 msgr2=0x7f6480061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:32.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.342+0000 7f649c3eb700 1 --2- 172.21.15.1:0/3815770487 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f648005f270 0x7f6480061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f648c001e10 tx=0x7f648c009040).stop 2023-11-15T02:53:32.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.342+0000 7f649c3eb700 1 -- 172.21.15.1:0/3815770487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64940ab1a0 msgr2=0x7f6494157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:32.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.342+0000 7f649c3eb700 1 --2- 172.21.15.1:0/3815770487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64940ab1a0 0x7f6494157220 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7f6488009eb0 tx=0x7f6488017000).stop 2023-11-15T02:53:32.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.343+0000 7f649c3eb700 1 -- 172.21.15.1:0/3815770487 shutdown_connections 2023-11-15T02:53:32.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.343+0000 7f649c3eb700 1 --2- 172.21.15.1:0/3815770487 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f648005f270 0x7f6480061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:32.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.343+0000 7f649c3eb700 1 --2- 172.21.15.1:0/3815770487 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6494154150 0x7f6494157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:32.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.343+0000 7f649c3eb700 1 --2- 172.21.15.1:0/3815770487 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64940aa060 0x7f6494148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:32.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.343+0000 7f649c3eb700 1 --2- 172.21.15.1:0/3815770487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64940ab1a0 0x7f6494157220 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:32.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.343+0000 7f649c3eb700 1 -- 172.21.15.1:0/3815770487 >> 172.21.15.1:0/3815770487 conn(0x7f6494064aa0 msgr2=0x7f64940abfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:32.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.343+0000 7f649c3eb700 1 -- 172.21.15.1:0/3815770487 shutdown_connections 2023-11-15T02:53:32.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.343+0000 7f649c3eb700 1 -- 172.21.15.1:0/3815770487 wait complete. 2023-11-15T02:53:32.347 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 81 2023-11-15T02:53:32.357 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-15T02:53:32.357 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-15T02:53:32.358 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-15T02:53:32.358 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:53:32.358 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-15T02:53:32.358 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-15T02:53:32.359 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-15T02:53:32.359 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:53:32.359 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-15T02:53:32.360 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-15T02:53:32.360 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-15T02:53:32.360 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:53:32.360 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-15T02:53:32.361 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-15T02:53:32.361 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-15T02:53:32.361 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:53:32.366 INFO:tasks.ceph.mds.a:Stopped 2023-11-15T02:53:32.367 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-15T02:53:32.368 INFO:tasks.ceph.mds.c:Stopped 2023-11-15T02:53:32.368 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-15T02:53:32.372 INFO:tasks.ceph.mds.b:Stopped 2023-11-15T02:53:32.372 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-15T02:53:32.373 INFO:tasks.ceph.mds.d:Stopped 2023-11-15T02:53:32.373 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-15T02:53:32.409 INFO:tasks.ceph.mds.a:Started 2023-11-15T02:53:32.410 DEBUG:teuthology.parallel:result is None 2023-11-15T02:53:32.410 INFO:tasks.ceph.mds.c:Started 2023-11-15T02:53:32.411 DEBUG:teuthology.parallel:result is None 2023-11-15T02:53:32.415 INFO:tasks.ceph.mds.b:Started 2023-11-15T02:53:32.415 DEBUG:teuthology.parallel:result is None 2023-11-15T02:53:32.416 INFO:tasks.ceph.mds.d:Started 2023-11-15T02:53:32.416 DEBUG:teuthology.parallel:result is None 2023-11-15T02:53:32.417 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-15T02:53:32.484 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-11-15T02:53:32.485 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T02:53:32.498 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T02:53:32.498 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-15T02:53:32.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.544+0000 7f93cfedc700 1 Processor -- start 2023-11-15T02:53:32.546 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.544+0000 7f93cfedc700 1 -- start start 2023-11-15T02:53:32.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.545+0000 7f93cfedc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93c80833a0 0x7f93c80a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:32.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.545+0000 7f93cfedc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f93c80be520 0x7f93c8154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:32.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.545+0000 7f93cfedc700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c80a85e0 con 0x7f93c8154450 2023-11-15T02:53:32.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.545+0000 7f93cfedc700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c8065940 con 0x7f93c80be520 2023-11-15T02:53:32.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.545+0000 7f93cfedc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c8065660 con 0x7f93c80833a0 2023-11-15T02:53:32.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.545+0000 7f93cdc78700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f93c8154450 0x7f93c80bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49208/0 (socket says 172.21.15.1:49208) 2023-11-15T02:53:32.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.545+0000 7f93cdc78700 1 -- 172.21.15.1:0/3055875513 learned_addr learned my addr 172.21.15.1:0/3055875513 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:32.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.545+0000 7f93ce479700 1 --2- 172.21.15.1:0/3055875513 >> v2:172.21.15.1:3300/0 conn(0x7f93c80be520 0x7f93c8154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:32.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.545+0000 7f93ccc76700 1 -- 172.21.15.1:0/3055875513 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729293459 0 0) 0x7f93c80a85e0 con 0x7f93c8154450 2023-11-15T02:53:32.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.545+0000 7f93ccc76700 1 -- 172.21.15.1:0/3055875513 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93b40033f0 con 0x7f93c8154450 2023-11-15T02:53:32.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.545+0000 7f93cd477700 1 --2- 172.21.15.1:0/3055875513 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93c80833a0 0x7f93c80a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:32.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.545+0000 7f93ce479700 1 -- 172.21.15.1:0/3055875513 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93c80833a0 msgr2=0x7f93c80a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:32.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.545+0000 7f93ce479700 1 --2- 172.21.15.1:0/3055875513 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93c80833a0 0x7f93c80a7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:32.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.545+0000 7f93ce479700 1 -- 172.21.15.1:0/3055875513 >> v1:172.21.15.1:6789/0 conn(0x7f93c8154450 legacy=0x7f93c80bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:32.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.545+0000 7f93ce479700 1 -- 172.21.15.1:0/3055875513 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c80c6f50 con 0x7f93c80be520 2023-11-15T02:53:32.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.546+0000 7f93ce479700 1 --2- 172.21.15.1:0/3055875513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93c80be520 0x7f93c8154830 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f93c0009e60 tx=0x7f93c0009780).ready entity=mon.0 client_cookie=fc7f27778df7642d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.546+0000 7f93ccc76700 1 -- 172.21.15.1:0/3055875513 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c000e070 con 0x7f93c80be520 2023-11-15T02:53:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.546+0000 7f93ccc76700 1 -- 172.21.15.1:0/3055875513 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c000bb60 con 0x7f93c80be520 2023-11-15T02:53:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.546+0000 7f93ccc76700 1 -- 172.21.15.1:0/3055875513 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0012410 con 0x7f93c80be520 2023-11-15T02:53:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.546+0000 7f93cfedc700 1 -- 172.21.15.1:0/3055875513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93c80be520 msgr2=0x7f93c8154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.546+0000 7f93cfedc700 1 --2- 172.21.15.1:0/3055875513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93c80be520 0x7f93c8154830 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f93c0009e60 tx=0x7f93c0009780).stop 2023-11-15T02:53:32.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.546+0000 7f93cfedc700 1 -- 172.21.15.1:0/3055875513 shutdown_connections 2023-11-15T02:53:32.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.546+0000 7f93cfedc700 1 --2- 172.21.15.1:0/3055875513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93c80be520 0x7f93c8154830 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:32.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.546+0000 7f93cfedc700 1 --2- 172.21.15.1:0/3055875513 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93c80833a0 0x7f93c80a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:32.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.546+0000 7f93cfedc700 1 -- 172.21.15.1:0/3055875513 >> 172.21.15.1:0/3055875513 conn(0x7f93c8082f90 msgr2=0x7f93c80c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:32.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.546+0000 7f93cfedc700 1 -- 172.21.15.1:0/3055875513 shutdown_connections 2023-11-15T02:53:32.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.546+0000 7f93cfedc700 1 -- 172.21.15.1:0/3055875513 wait complete. 2023-11-15T02:53:32.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.547+0000 7f93cfedc700 1 Processor -- start 2023-11-15T02:53:32.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.547+0000 7f93cfedc700 1 -- start start 2023-11-15T02:53:32.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.548+0000 7f93cfedc700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93c80833a0 0x7f93c8141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.548+0000 7f93cfedc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93c80be520 0x7f93c80a8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.548+0000 7f93cfedc700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93c8154450 0x7f93c8151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.548+0000 7f93cfedc700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80ac830 con 0x7f93c80be520 2023-11-15T02:53:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.548+0000 7f93cfedc700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80acd80 con 0x7f93c80833a0 2023-11-15T02:53:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.548+0000 7f93cfedc700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80c5920 con 0x7f93c8154450 2023-11-15T02:53:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.548+0000 7f93cd477700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93c80be520 0x7f93c80a8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.548+0000 7f93cd477700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93c80be520 0x7f93c80a8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40218/0 (socket says 172.21.15.1:40218) 2023-11-15T02:53:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.548+0000 7f93cdc78700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93c80833a0 0x7f93c8141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.548+0000 7f93cd477700 1 -- 172.21.15.1:0/117350358 learned_addr learned my addr 172.21.15.1:0/117350358 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:32.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.548+0000 7f93ce479700 1 --2- 172.21.15.1:0/117350358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93c8154450 0x7f93c8151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:32.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.549+0000 7f93cd477700 1 -- 172.21.15.1:0/117350358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93c8154450 msgr2=0x7f93c8151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:32.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.549+0000 7f93cd477700 1 --2- 172.21.15.1:0/117350358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93c8154450 0x7f93c8151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:32.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.549+0000 7f93cd477700 1 -- 172.21.15.1:0/117350358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93c80833a0 msgr2=0x7f93c8141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:32.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.549+0000 7f93cd477700 1 --2- 172.21.15.1:0/117350358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93c80833a0 0x7f93c8141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:32.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.549+0000 7f93cd477700 1 -- 172.21.15.1:0/117350358 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c0009a20 con 0x7f93c80be520 2023-11-15T02:53:32.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.549+0000 7f93cd477700 1 --2- 172.21.15.1:0/117350358 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93c80be520 0x7f93c80a8960 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f93b800c850 tx=0x7f93b8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:32.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.549+0000 7f93bdffb700 1 -- 172.21.15.1:0/117350358 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8010580 con 0x7f93c80be520 2023-11-15T02:53:32.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.549+0000 7f93bdffb700 1 -- 172.21.15.1:0/117350358 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b80106e0 con 0x7f93c80be520 2023-11-15T02:53:32.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.549+0000 7f93bdffb700 1 -- 172.21.15.1:0/117350358 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8010a60 con 0x7f93c80be520 2023-11-15T02:53:32.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.549+0000 7f93cfedc700 1 -- 172.21.15.1:0/117350358 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c80c5c00 con 0x7f93c80be520 2023-11-15T02:53:32.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.549+0000 7f93cfedc700 1 -- 172.21.15.1:0/117350358 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c8092cf0 con 0x7f93c80be520 2023-11-15T02:53:32.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.550+0000 7f93cfedc700 1 -- 172.21.15.1:0/117350358 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c806c7e0 con 0x7f93c80be520 2023-11-15T02:53:32.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.551+0000 7f93bdffb700 1 -- 172.21.15.1:0/117350358 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f93b801b460 con 0x7f93c80be520 2023-11-15T02:53:32.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.551+0000 7f93bdffb700 1 --2- 172.21.15.1:0/117350358 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f93ac05f270 0x7f93ac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:32.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.551+0000 7f93bdffb700 1 -- 172.21.15.1:0/117350358 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6567+0+0 (secure 0 0 0) 0x7f93b807a3a0 con 0x7f93c80be520 2023-11-15T02:53:32.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.551+0000 7f93cdc78700 1 --2- 172.21.15.1:0/117350358 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f93ac05f270 0x7f93ac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:32.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.551+0000 7f93cdc78700 1 --2- 172.21.15.1:0/117350358 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f93ac05f270 0x7f93ac061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f93c4001360 tx=0x7f93c4009040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:32.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.555+0000 7f93bdffb700 1 -- 172.21.15.1:0/117350358 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f93b804b2d0 con 0x7f93c80be520 2023-11-15T02:53:32.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:32.741+0000 7f93cfedc700 1 -- 172.21.15.1:0/117350358 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f93c80acec0 con 0x7f93c80be520 2023-11-15T02:53:33.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.565+0000 7f93bdffb700 1 -- 172.21.15.1:0/117350358 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v192) v1 ==== 97+0+0 (secure 0 0 0) 0x7f93b804e8f0 con 0x7f93c80be520 2023-11-15T02:53:33.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.568+0000 7f93cfedc700 1 -- 172.21.15.1:0/117350358 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f93ac05f270 msgr2=0x7f93ac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:33.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.568+0000 7f93cfedc700 1 --2- 172.21.15.1:0/117350358 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f93ac05f270 0x7f93ac061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f93c4001360 tx=0x7f93c4009040).stop 2023-11-15T02:53:33.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.568+0000 7f93cfedc700 1 -- 172.21.15.1:0/117350358 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93c80be520 msgr2=0x7f93c80a8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:33.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.568+0000 7f93cfedc700 1 --2- 172.21.15.1:0/117350358 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93c80be520 0x7f93c80a8960 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f93b800c850 tx=0x7f93b8008040).stop 2023-11-15T02:53:33.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.568+0000 7f93cfedc700 1 -- 172.21.15.1:0/117350358 shutdown_connections 2023-11-15T02:53:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.568+0000 7f93cfedc700 1 --2- 172.21.15.1:0/117350358 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f93ac05f270 0x7f93ac061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.568+0000 7f93cfedc700 1 --2- 172.21.15.1:0/117350358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93c8154450 0x7f93c8151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.568+0000 7f93cfedc700 1 --2- 172.21.15.1:0/117350358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93c80833a0 0x7f93c8141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.568+0000 7f93cfedc700 1 --2- 172.21.15.1:0/117350358 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93c80be520 0x7f93c80a8960 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.568+0000 7f93cfedc700 1 -- 172.21.15.1:0/117350358 >> 172.21.15.1:0/117350358 conn(0x7f93c8082f90 msgr2=0x7f93c80bde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:33.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.568+0000 7f93cfedc700 1 -- 172.21.15.1:0/117350358 shutdown_connections 2023-11-15T02:53:33.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.568+0000 7f93cfedc700 1 -- 172.21.15.1:0/117350358 wait complete. 2023-11-15T02:53:33.573 INFO:teuthology.orchestra.run.smithi001.stderr: removed all blocklist entries 2023-11-15T02:53:33.585 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-15T02:53:33.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.711+0000 7fea1605a700 1 Processor -- start 2023-11-15T02:53:33.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.711+0000 7fea1605a700 1 -- start start 2023-11-15T02:53:33.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.712+0000 7fea1605a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fea10155b70 0x7fea100bee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:33.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.712+0000 7fea1605a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea10083630 con 0x7fea100bf310 2023-11-15T02:53:33.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.712+0000 7fea1605a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea100c7c90 con 0x7fea10155790 2023-11-15T02:53:33.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.712+0000 7fea1605a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea100c5420 con 0x7fea10155b70 2023-11-15T02:53:33.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.712+0000 7fea0effd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fea10155b70 0x7fea100bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:33.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.712+0000 7fea0ffff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fea100bf310 0x7fea100c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49216/0 (socket says 172.21.15.1:49216) 2023-11-15T02:53:33.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.712+0000 7fea0ffff700 1 -- 172.21.15.1:0/2908653364 learned_addr learned my addr 172.21.15.1:0/2908653364 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:33.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.712+0000 7fea0effd700 1 -- 172.21.15.1:0/2908653364 >> v1:172.21.15.141:6789/0 conn(0x7fea10155790 legacy=0x7fea100a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:33.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.712+0000 7fea0effd700 1 -- 172.21.15.1:0/2908653364 >> v1:172.21.15.1:6789/0 conn(0x7fea100bf310 legacy=0x7fea100c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:33.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.712+0000 7fea0e7fc700 1 -- 172.21.15.1:0/2908653364 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369525504 0 0) 0x7fea10083630 con 0x7fea100bf310 2023-11-15T02:53:33.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.712+0000 7fea0effd700 1 -- 172.21.15.1:0/2908653364 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea100c7960 con 0x7fea10155b70 2023-11-15T02:53:33.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.712+0000 7fea0effd700 1 --2- 172.21.15.1:0/2908653364 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea10155b70 0x7fea100bee20 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fea04009760 tx=0x7fea04009060).ready entity=mon.0 client_cookie=b9099aa966ee3c7d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:33.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.713+0000 7fea0e7fc700 1 -- 172.21.15.1:0/2908653364 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0400b580 con 0x7fea10155b70 2023-11-15T02:53:33.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.713+0000 7fea0e7fc700 1 -- 172.21.15.1:0/2908653364 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0400b6e0 con 0x7fea10155b70 2023-11-15T02:53:33.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.713+0000 7fea0e7fc700 1 -- 172.21.15.1:0/2908653364 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0400ba60 con 0x7fea10155b70 2023-11-15T02:53:33.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.713+0000 7fea1605a700 1 -- 172.21.15.1:0/2908653364 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea10155b70 msgr2=0x7fea100bee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:33.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.713+0000 7fea1605a700 1 --2- 172.21.15.1:0/2908653364 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea10155b70 0x7fea100bee20 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fea04009760 tx=0x7fea04009060).stop 2023-11-15T02:53:33.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.713+0000 7fea1605a700 1 -- 172.21.15.1:0/2908653364 shutdown_connections 2023-11-15T02:53:33.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.713+0000 7fea1605a700 1 --2- 172.21.15.1:0/2908653364 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea10155b70 0x7fea100bee20 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:33.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.713+0000 7fea1605a700 1 -- 172.21.15.1:0/2908653364 >> 172.21.15.1:0/2908653364 conn(0x7fea10082f90 msgr2=0x7fea100c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:33.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.713+0000 7fea1605a700 1 -- 172.21.15.1:0/2908653364 shutdown_connections 2023-11-15T02:53:33.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.713+0000 7fea1605a700 1 -- 172.21.15.1:0/2908653364 wait complete. 2023-11-15T02:53:33.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.714+0000 7fea1605a700 1 Processor -- start 2023-11-15T02:53:33.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.715+0000 7fea1605a700 1 -- start start 2023-11-15T02:53:33.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.715+0000 7fea1605a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea100bf310 0x7fea1014d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:33.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.715+0000 7fea1605a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea10155790 0x7fea100c2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:33.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.715+0000 7fea1605a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea10155b70 0x7fea10157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:33.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.715+0000 7fea1605a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea101576a0 con 0x7fea10155b70 2023-11-15T02:53:33.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.715+0000 7fea1605a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea10156a90 con 0x7fea10155790 2023-11-15T02:53:33.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.715+0000 7fea1605a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea10156d70 con 0x7fea100bf310 2023-11-15T02:53:33.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.715+0000 7fea0ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea10155b70 0x7fea10157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:33.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.715+0000 7fea0ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea10155b70 0x7fea10157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40248/0 (socket says 172.21.15.1:40248) 2023-11-15T02:53:33.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.715+0000 7fea0ffff700 1 -- 172.21.15.1:0/4133492477 learned_addr learned my addr 172.21.15.1:0/4133492477 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:33.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.716+0000 7fea0effd700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea10155790 0x7fea100c2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:33.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.716+0000 7fea0f7fe700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea100bf310 0x7fea1014d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:33.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.716+0000 7fea0ffff700 1 -- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea100bf310 msgr2=0x7fea1014d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:33.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.716+0000 7fea0ffff700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea100bf310 0x7fea1014d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:33.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.716+0000 7fea0ffff700 1 -- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea10155790 msgr2=0x7fea100c2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:33.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.716+0000 7fea0ffff700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea10155790 0x7fea100c2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:33.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.716+0000 7fea0ffff700 1 -- 172.21.15.1:0/4133492477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea040092a0 con 0x7fea10155b70 2023-11-15T02:53:33.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.716+0000 7fea0effd700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea10155790 0x7fea100c2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:33.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.716+0000 7fea0f7fe700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea100bf310 0x7fea1014d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:33.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.716+0000 7fea0ffff700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea10155b70 0x7fea10157b30 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7fea0800c730 tx=0x7fea08001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:33.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.716+0000 7fe9f77fe700 1 -- 172.21.15.1:0/4133492477 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08005d30 con 0x7fea10155b70 2023-11-15T02:53:33.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.716+0000 7fe9f77fe700 1 -- 172.21.15.1:0/4133492477 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea08005e90 con 0x7fea10155b70 2023-11-15T02:53:33.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.716+0000 7fea1605a700 1 -- 172.21.15.1:0/4133492477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea10157050 con 0x7fea10155b70 2023-11-15T02:53:33.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.716+0000 7fe9f77fe700 1 -- 172.21.15.1:0/4133492477 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08007340 con 0x7fea10155b70 2023-11-15T02:53:33.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.716+0000 7fea1605a700 1 -- 172.21.15.1:0/4133492477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1014e320 con 0x7fea10155b70 2023-11-15T02:53:33.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.717+0000 7fea1605a700 1 -- 172.21.15.1:0/4133492477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea10157810 con 0x7fea10155b70 2023-11-15T02:53:33.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.718+0000 7fe9f77fe700 1 -- 172.21.15.1:0/4133492477 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fea080076f0 con 0x7fea10155b70 2023-11-15T02:53:33.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.718+0000 7fe9f77fe700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe9fc05f270 0x7fe9fc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:33.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.718+0000 7fe9f77fe700 1 -- 172.21.15.1:0/4133492477 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5793+0+0 (secure 0 0 0) 0x7fea0807a2a0 con 0x7fea10155b70 2023-11-15T02:53:33.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.718+0000 7fea0f7fe700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe9fc05f270 0x7fe9fc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:33.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.719+0000 7fea0f7fe700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe9fc05f270 0x7fe9fc061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fea00001700 tx=0x7fea00009040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:33.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.722+0000 7fe9f77fe700 1 -- 172.21.15.1:0/4133492477 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fea0804b530 con 0x7fea10155b70 2023-11-15T02:53:33.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.960+0000 7fea1605a700 1 -- 172.21.15.1:0/4133492477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fea100c4ba0 con 0x7fea10155b70 2023-11-15T02:53:33.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.961+0000 7fe9f77fe700 1 -- 172.21.15.1:0/4133492477 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v50) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fea080079a0 con 0x7fea10155b70 2023-11-15T02:53:33.964 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:33.964 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:53:33.964 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_dump": [ 2023-11-15T02:53:33.964 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.964 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.a", 2023-11-15T02:53:33.965 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlmtf5GBAA2CojasXoquGQ9L5rKjVwTQ==", 2023-11-15T02:53:33.965 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.965 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:53:33.965 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:53:33.966 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:53:33.966 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:53:33.966 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.966 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.967 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.967 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.b", 2023-11-15T02:53:33.967 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl/Y5mJBAAz7iLl3kBJ8kSsyTetTZByw==", 2023-11-15T02:53:33.967 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.967 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:53:33.968 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:53:33.968 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:53:33.968 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:53:33.968 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.968 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.969 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.969 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.c", 2023-11-15T02:53:33.969 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlWTrwHxAAqLVpwNca0vAXUBFnWUN3pg==", 2023-11-15T02:53:33.969 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.969 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:53:33.970 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:53:33.970 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:53:33.970 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:53:33.970 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.971 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.971 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.971 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.d", 2023-11-15T02:53:33.971 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlVwUnKxAAhx2/mX1ljgQwJLagVpmZIA==", 2023-11-15T02:53:33.971 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.972 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:53:33.972 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:53:33.973 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:53:33.973 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:53:33.973 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.973 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.973 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.974 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.0", 2023-11-15T02:53:33.974 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDxHFRlII6rERAA/kvPPhTPHHy6pu5wSPsR/A==", 2023-11-15T02:53:33.974 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.974 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:53:33.974 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:53:33.975 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:53:33.975 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.975 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.975 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.975 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.1", 2023-11-15T02:53:33.975 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD0HFRlPkstEBAAqx31fnNonRCVh98eY6qbxQ==", 2023-11-15T02:53:33.976 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.976 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:53:33.976 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:53:33.976 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:53:33.976 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.977 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.977 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.977 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.2", 2023-11-15T02:53:33.977 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD3HFRl8e3nDRAAKigcbIo0/BFo0Qi6rV+amQ==", 2023-11-15T02:53:33.977 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.978 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:53:33.978 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:53:33.978 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:53:33.978 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.978 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.979 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.979 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.3", 2023-11-15T02:53:33.979 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD6HFRlbwDTCxAAkWv04RyNqW4p8pOqvYCS3A==", 2023-11-15T02:53:33.979 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.979 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:53:33.979 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:53:33.980 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:53:33.980 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.980 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.980 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.980 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.4", 2023-11-15T02:53:33.981 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAAHVRlTQihDxAA/HcZbSytP9qD5PsTjvJBoA==", 2023-11-15T02:53:33.981 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.981 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:53:33.981 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:53:33.981 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:53:33.982 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.982 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.982 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.983 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.5", 2023-11-15T02:53:33.983 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQADHVRlQ2hjDRAAFiI+hKubCPcZ/1AJVu1fvQ==", 2023-11-15T02:53:33.983 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.983 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:53:33.983 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:53:33.984 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:53:33.984 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.984 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.984 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.984 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.6", 2023-11-15T02:53:33.985 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAGHVRl/KEbCxAAmKTnRU4m4qNzX+SVcFY+Qw==", 2023-11-15T02:53:33.985 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.985 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:53:33.985 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:53:33.986 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:53:33.986 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.986 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.986 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.986 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.7", 2023-11-15T02:53:33.986 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAJHVRl4wOFCBAAAiGT4UPE5vSb2LjqgGgGFw==", 2023-11-15T02:53:33.987 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.987 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:53:33.987 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:53:33.987 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:53:33.987 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.988 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.988 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.988 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.0", 2023-11-15T02:53:33.988 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl2hkHLxAAxQE/Cslig6gmXR/xcVlRuw==", 2023-11-15T02:53:33.988 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.989 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:53:33.989 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow r", 2023-11-15T02:53:33.989 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-15T02:53:33.989 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.989 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.990 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.990 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.1", 2023-11-15T02:53:33.990 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRltolkNxAAXmQ4yXOlavwqKq2jFKwsYQ==", 2023-11-15T02:53:33.990 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.990 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:53:33.990 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T02:53:33.991 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T02:53:33.991 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T02:53:33.991 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.991 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.991 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.992 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.2", 2023-11-15T02:53:33.992 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlFrJvNBAAH97x7ERzuzpWrUALO+HvpA==", 2023-11-15T02:53:33.992 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.992 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:53:33.993 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T02:53:33.993 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T02:53:33.993 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T02:53:33.993 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.994 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.994 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.994 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.3", 2023-11-15T02:53:33.995 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDwHFRlko0ZARAA2RqeRJGwWns00DeWgd/9hA==", 2023-11-15T02:53:33.995 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.995 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:53:33.995 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T02:53:33.995 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T02:53:33.995 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T02:53:33.996 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.996 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.996 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.996 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.admin", 2023-11-15T02:53:33.996 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDuHFRlxIQDORAALrVIyQoaVSADkyv9yzMaZw==", 2023-11-15T02:53:33.997 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.997 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T02:53:33.997 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:53:33.997 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:53:33.998 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:53:33.998 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:33.998 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:33.998 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:33.998 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.x", 2023-11-15T02:53:33.999 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlnyjlFRAAjJwtxkAvJ0ZGmvOOawQseQ==", 2023-11-15T02:53:33.999 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:33.999 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T02:53:33.999 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T02:53:33.999 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:53:34.000 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:34.000 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:34.000 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:34.000 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.y", 2023-11-15T02:53:34.000 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl8nW3ERAA4CJQt/ZEZCJ9UaRRuEHfzw==", 2023-11-15T02:53:34.001 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:53:34.001 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T02:53:34.001 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T02:53:34.001 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:53:34.001 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:34.001 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:34.002 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2023-11-15T02:53:34.002 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:53:34.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.963+0000 7fea1605a700 1 -- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe9fc05f270 msgr2=0x7fe9fc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.963+0000 7fea1605a700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe9fc05f270 0x7fe9fc061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fea00001700 tx=0x7fea00009040).stop 2023-11-15T02:53:34.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.963+0000 7fea1605a700 1 -- 172.21.15.1:0/4133492477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea10155b70 msgr2=0x7fea10157b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.963+0000 7fea1605a700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea10155b70 0x7fea10157b30 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7fea0800c730 tx=0x7fea08001520).stop 2023-11-15T02:53:34.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.963+0000 7fea1605a700 1 -- 172.21.15.1:0/4133492477 shutdown_connections 2023-11-15T02:53:34.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.963+0000 7fea1605a700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe9fc05f270 0x7fe9fc061730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.963+0000 7fea1605a700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea10155b70 0x7fea10157b30 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.963+0000 7fea1605a700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea100bf310 0x7fea1014d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.963+0000 7fea1605a700 1 --2- 172.21.15.1:0/4133492477 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea10155790 0x7fea100c2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.963+0000 7fea1605a700 1 -- 172.21.15.1:0/4133492477 >> 172.21.15.1:0/4133492477 conn(0x7fea10082f90 msgr2=0x7fea100bde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:34.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.963+0000 7fea1605a700 1 -- 172.21.15.1:0/4133492477 shutdown_connections 2023-11-15T02:53:34.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:33.963+0000 7fea1605a700 1 -- 172.21.15.1:0/4133492477 wait complete. 2023-11-15T02:53:34.007 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:53:34.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.124+0000 7f97666a6700 1 Processor -- start 2023-11-15T02:53:34.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.124+0000 7f97666a6700 1 -- start start 2023-11-15T02:53:34.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f97666a6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9760154150 0x7f9760154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f97666a6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97600aa060 0x7f97600c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f97666a6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97600c06f0 con 0x7f97600ab1a0 2023-11-15T02:53:34.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f97666a6700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97600c09d0 con 0x7f9760154150 2023-11-15T02:53:34.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f97666a6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9760158820 con 0x7f97600aa060 2023-11-15T02:53:34.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f975ffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9760154150 0x7f9760154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f975f7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f97600ab1a0 0x7f9760158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49232/0 (socket says 172.21.15.1:49232) 2023-11-15T02:53:34.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f975f7fe700 1 -- 172.21.15.1:0/1862579644 learned_addr learned my addr 172.21.15.1:0/1862579644 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:34.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f975ffff700 1 -- 172.21.15.1:0/1862579644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97600aa060 msgr2=0x7f97600c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:34.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f9764c43700 1 --2- 172.21.15.1:0/1862579644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97600aa060 0x7f97600c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f975effd700 1 -- 172.21.15.1:0/1862579644 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898604144 0 0) 0x7f97600c06f0 con 0x7f97600ab1a0 2023-11-15T02:53:34.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f975ffff700 1 --2- 172.21.15.1:0/1862579644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97600aa060 0x7f97600c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f975ffff700 1 -- 172.21.15.1:0/1862579644 >> v1:172.21.15.1:6789/0 conn(0x7f97600ab1a0 legacy=0x7f9760158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f975ffff700 1 -- 172.21.15.1:0/1862579644 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9760158b00 con 0x7f9760154150 2023-11-15T02:53:34.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f975ffff700 1 --2- 172.21.15.1:0/1862579644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9760154150 0x7f9760154530 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f9750009760 tx=0x7f9750009060).ready entity=mon.0 client_cookie=abeca241c97128f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:34.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f975effd700 1 -- 172.21.15.1:0/1862579644 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97500090d0 con 0x7f9760154150 2023-11-15T02:53:34.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f975effd700 1 -- 172.21.15.1:0/1862579644 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975000b580 con 0x7f9760154150 2023-11-15T02:53:34.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.125+0000 7f975effd700 1 -- 172.21.15.1:0/1862579644 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975000b900 con 0x7f9760154150 2023-11-15T02:53:34.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.126+0000 7f97666a6700 1 -- 172.21.15.1:0/1862579644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9760154150 msgr2=0x7f9760154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.126+0000 7f97666a6700 1 --2- 172.21.15.1:0/1862579644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9760154150 0x7f9760154530 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f9750009760 tx=0x7f9750009060).stop 2023-11-15T02:53:34.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.126+0000 7f97666a6700 1 -- 172.21.15.1:0/1862579644 shutdown_connections 2023-11-15T02:53:34.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.126+0000 7f97666a6700 1 --2- 172.21.15.1:0/1862579644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97600aa060 0x7f97600c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.126+0000 7f97666a6700 1 --2- 172.21.15.1:0/1862579644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9760154150 0x7f9760154530 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.126+0000 7f97666a6700 1 -- 172.21.15.1:0/1862579644 >> 172.21.15.1:0/1862579644 conn(0x7f9760064aa0 msgr2=0x7f9760064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:34.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.126+0000 7f97666a6700 1 -- 172.21.15.1:0/1862579644 shutdown_connections 2023-11-15T02:53:34.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.126+0000 7f97666a6700 1 -- 172.21.15.1:0/1862579644 wait complete. 2023-11-15T02:53:34.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.127+0000 7f97666a6700 1 Processor -- start 2023-11-15T02:53:34.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.127+0000 7f97666a6700 1 -- start start 2023-11-15T02:53:34.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f97666a6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97600aa060 0x7f976014cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f97666a6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97600ab1a0 0x7f97600c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f97666a6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9760154150 0x7f97600b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f97666a6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97600cb8b0 con 0x7f9760154150 2023-11-15T02:53:34.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f97666a6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97600ae8f0 con 0x7f97600aa060 2023-11-15T02:53:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f97666a6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97600aeb40 con 0x7f97600ab1a0 2023-11-15T02:53:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f9764c43700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9760154150 0x7f97600b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f9764c43700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9760154150 0x7f97600b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40258/0 (socket says 172.21.15.1:40258) 2023-11-15T02:53:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f9764c43700 1 -- 172.21.15.1:0/3236944291 learned_addr learned my addr 172.21.15.1:0/3236944291 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f975ffff700 1 --2- 172.21.15.1:0/3236944291 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97600aa060 0x7f976014cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f975f7fe700 1 --2- 172.21.15.1:0/3236944291 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97600ab1a0 0x7f97600c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f9764c43700 1 -- 172.21.15.1:0/3236944291 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97600ab1a0 msgr2=0x7f97600c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f9764c43700 1 --2- 172.21.15.1:0/3236944291 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97600ab1a0 0x7f97600c4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f9764c43700 1 -- 172.21.15.1:0/3236944291 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97600aa060 msgr2=0x7f976014cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f9764c43700 1 --2- 172.21.15.1:0/3236944291 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97600aa060 0x7f976014cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.128+0000 7f9764c43700 1 -- 172.21.15.1:0/3236944291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500092a0 con 0x7f9760154150 2023-11-15T02:53:34.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.129+0000 7f9764c43700 1 --2- 172.21.15.1:0/3236944291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9760154150 0x7f97600b0450 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f975800cf00 tx=0x7f9758007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:34.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.129+0000 7f9747fff700 1 -- 172.21.15.1:0/3236944291 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975800ac60 con 0x7f9760154150 2023-11-15T02:53:34.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.129+0000 7f9747fff700 1 -- 172.21.15.1:0/3236944291 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975800adc0 con 0x7f9760154150 2023-11-15T02:53:34.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.129+0000 7f9747fff700 1 -- 172.21.15.1:0/3236944291 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758016630 con 0x7f9760154150 2023-11-15T02:53:34.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.129+0000 7f97666a6700 1 -- 172.21.15.1:0/3236944291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97600aee20 con 0x7f9760154150 2023-11-15T02:53:34.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.129+0000 7f97666a6700 1 -- 172.21.15.1:0/3236944291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97600c3e00 con 0x7f9760154150 2023-11-15T02:53:34.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.130+0000 7f97666a6700 1 -- 172.21.15.1:0/3236944291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97600c3ff0 con 0x7f9760154150 2023-11-15T02:53:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.130+0000 7f9747fff700 1 -- 172.21.15.1:0/3236944291 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9758009030 con 0x7f9760154150 2023-11-15T02:53:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.130+0000 7f9747fff700 1 --2- 172.21.15.1:0/3236944291 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f974c05f270 0x7f974c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.131+0000 7f9747fff700 1 -- 172.21.15.1:0/3236944291 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5793+0+0 (secure 0 0 0) 0x7f975807a7b0 con 0x7f9760154150 2023-11-15T02:53:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.131+0000 7f975ffff700 1 --2- 172.21.15.1:0/3236944291 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f974c05f270 0x7f974c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.131+0000 7f975ffff700 1 --2- 172.21.15.1:0/3236944291 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f974c05f270 0x7f974c061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f975000b340 tx=0x7f9750017000).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:34.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.135+0000 7f9747fff700 1 -- 172.21.15.1:0/3236944291 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f975804ba40 con 0x7f9760154150 2023-11-15T02:53:34.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.308+0000 7f97666a6700 1 -- 172.21.15.1:0/3236944291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f976006c7e0 con 0x7f9760154150 2023-11-15T02:53:34.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.309+0000 7f9747fff700 1 -- 172.21.15.1:0/3236944291 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+14481 (secure 0 0 0) 0x7f97580078d0 con 0x7f9760154150 2023-11-15T02:53:34.311 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:34.311 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":192,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:53:33.561861+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:53:34.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.310+0000 7f97666a6700 1 -- 172.21.15.1:0/3236944291 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f974c05f270 msgr2=0x7f974c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.310+0000 7f97666a6700 1 --2- 172.21.15.1:0/3236944291 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f974c05f270 0x7f974c061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f975000b340 tx=0x7f9750017000).stop 2023-11-15T02:53:34.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.310+0000 7f97666a6700 1 -- 172.21.15.1:0/3236944291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9760154150 msgr2=0x7f97600b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.310+0000 7f97666a6700 1 --2- 172.21.15.1:0/3236944291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9760154150 0x7f97600b0450 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f975800cf00 tx=0x7f9758007860).stop 2023-11-15T02:53:34.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.310+0000 7f97666a6700 1 -- 172.21.15.1:0/3236944291 shutdown_connections 2023-11-15T02:53:34.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.310+0000 7f97666a6700 1 --2- 172.21.15.1:0/3236944291 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f974c05f270 0x7f974c061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.310+0000 7f97666a6700 1 --2- 172.21.15.1:0/3236944291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9760154150 0x7f97600b0450 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.310+0000 7f97666a6700 1 --2- 172.21.15.1:0/3236944291 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97600aa060 0x7f976014cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.310+0000 7f97666a6700 1 --2- 172.21.15.1:0/3236944291 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97600ab1a0 0x7f97600c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.310+0000 7f97666a6700 1 -- 172.21.15.1:0/3236944291 >> 172.21.15.1:0/3236944291 conn(0x7f9760064aa0 msgr2=0x7f976014d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:34.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.310+0000 7f97666a6700 1 -- 172.21.15.1:0/3236944291 shutdown_connections 2023-11-15T02:53:34.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.310+0000 7f97666a6700 1 -- 172.21.15.1:0/3236944291 wait complete. 2023-11-15T02:53:34.325 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '185', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-15T02:53:34.326 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T02:53:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.445+0000 7f0998eb7700 1 Processor -- start 2023-11-15T02:53:34.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.445+0000 7f0998eb7700 1 -- start start 2023-11-15T02:53:34.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.446+0000 7f0998eb7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f09941540a0 0x7f09940ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.446+0000 7f0998eb7700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09940ca050 con 0x7f0994154480 2023-11-15T02:53:34.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.446+0000 7f0998eb7700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09940c9440 con 0x7f09940c6650 2023-11-15T02:53:34.450 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.446+0000 7f0998eb7700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09940c9720 con 0x7f09941540a0 2023-11-15T02:53:34.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.446+0000 7f099259c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f09941540a0 0x7f09940ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.446+0000 7f0991d9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0994154480 0x7f09940c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49238/0 (socket says 172.21.15.1:49238) 2023-11-15T02:53:34.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.446+0000 7f0991d9b700 1 -- 172.21.15.1:0/58270881 learned_addr learned my addr 172.21.15.1:0/58270881 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:34.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.447+0000 7f099259c700 1 -- 172.21.15.1:0/58270881 >> v1:172.21.15.141:6789/0 conn(0x7f09940c6650 legacy=0x7f09940aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:34.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.447+0000 7f099259c700 1 -- 172.21.15.1:0/58270881 >> v1:172.21.15.1:6789/0 conn(0x7f0994154480 legacy=0x7f09940c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.447+0000 7f099259c700 1 -- 172.21.15.1:0/58270881 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09940c9a00 con 0x7f09941540a0 2023-11-15T02:53:34.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.447+0000 7f099159a700 1 -- 172.21.15.1:0/58270881 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709650654 0 0) 0x7f09940ca050 con 0x7f0994154480 2023-11-15T02:53:34.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.447+0000 7f099259c700 1 --2- 172.21.15.1:0/58270881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09941540a0 0x7f09940ca4e0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7f098c009e60 tx=0x7f098c009780).ready entity=mon.0 client_cookie=547cd173cb4444cb server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:34.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.447+0000 7f099159a700 1 -- 172.21.15.1:0/58270881 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00e070 con 0x7f09941540a0 2023-11-15T02:53:34.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.447+0000 7f099159a700 1 -- 172.21.15.1:0/58270881 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c00bbf0 con 0x7f09941540a0 2023-11-15T02:53:34.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.447+0000 7f099159a700 1 -- 172.21.15.1:0/58270881 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c012410 con 0x7f09941540a0 2023-11-15T02:53:34.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.447+0000 7f0998eb7700 1 -- 172.21.15.1:0/58270881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09941540a0 msgr2=0x7f09940ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.447+0000 7f0998eb7700 1 --2- 172.21.15.1:0/58270881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09941540a0 0x7f09940ca4e0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7f098c009e60 tx=0x7f098c009780).stop 2023-11-15T02:53:34.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.447+0000 7f0998eb7700 1 -- 172.21.15.1:0/58270881 shutdown_connections 2023-11-15T02:53:34.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.447+0000 7f0998eb7700 1 --2- 172.21.15.1:0/58270881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09941540a0 0x7f09940ca4e0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.447+0000 7f0998eb7700 1 -- 172.21.15.1:0/58270881 >> 172.21.15.1:0/58270881 conn(0x7f0994064a70 msgr2=0x7f0994064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:34.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.448+0000 7f0998eb7700 1 -- 172.21.15.1:0/58270881 shutdown_connections 2023-11-15T02:53:34.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.448+0000 7f0998eb7700 1 -- 172.21.15.1:0/58270881 wait complete. 2023-11-15T02:53:34.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.449+0000 7f0998eb7700 1 Processor -- start 2023-11-15T02:53:34.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.449+0000 7f0998eb7700 1 -- start start 2023-11-15T02:53:34.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.449+0000 7f0998eb7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09940c6650 0x7f09941573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.449+0000 7f0998eb7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09941540a0 0x7f099415a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.449+0000 7f0998eb7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0994154480 0x7f099415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.449+0000 7f0998eb7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099415ae10 con 0x7f09940c6650 2023-11-15T02:53:34.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.449+0000 7f0998eb7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940aeae0 con 0x7f09941540a0 2023-11-15T02:53:34.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.449+0000 7f0998eb7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0994159d20 con 0x7f0994154480 2023-11-15T02:53:34.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.449+0000 7f099259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09940c6650 0x7f09941573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.449+0000 7f099259c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09940c6650 0x7f09941573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40280/0 (socket says 172.21.15.1:40280) 2023-11-15T02:53:34.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.449+0000 7f099259c700 1 -- 172.21.15.1:0/2125416659 learned_addr learned my addr 172.21.15.1:0/2125416659 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:34.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.450+0000 7f0991d9b700 1 --2- 172.21.15.1:0/2125416659 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09941540a0 0x7f099415a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.450+0000 7f0992d9d700 1 --2- 172.21.15.1:0/2125416659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0994154480 0x7f099415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.450+0000 7f099259c700 1 -- 172.21.15.1:0/2125416659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0994154480 msgr2=0x7f099415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.450+0000 7f099259c700 1 --2- 172.21.15.1:0/2125416659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0994154480 0x7f099415a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.450+0000 7f099259c700 1 -- 172.21.15.1:0/2125416659 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09941540a0 msgr2=0x7f099415a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.450+0000 7f099259c700 1 --2- 172.21.15.1:0/2125416659 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09941540a0 0x7f099415a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.450+0000 7f099259c700 1 -- 172.21.15.1:0/2125416659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c009a20 con 0x7f09940c6650 2023-11-15T02:53:34.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.450+0000 7f0992d9d700 1 --2- 172.21.15.1:0/2125416659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0994154480 0x7f099415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:34.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.450+0000 7f099259c700 1 --2- 172.21.15.1:0/2125416659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09940c6650 0x7f09941573c0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f098c00b6c0 tx=0x7f098c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:34.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.450+0000 7f098a7fc700 1 -- 172.21.15.1:0/2125416659 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c01d630 con 0x7f09940c6650 2023-11-15T02:53:34.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.450+0000 7f098a7fc700 1 -- 172.21.15.1:0/2125416659 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c01d790 con 0x7f09940c6650 2023-11-15T02:53:34.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.450+0000 7f0998eb7700 1 -- 172.21.15.1:0/2125416659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09940aed30 con 0x7f09940c6650 2023-11-15T02:53:34.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.450+0000 7f098a7fc700 1 -- 172.21.15.1:0/2125416659 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c01db30 con 0x7f09940c6650 2023-11-15T02:53:34.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.450+0000 7f0998eb7700 1 -- 172.21.15.1:0/2125416659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09940af2f0 con 0x7f09940c6650 2023-11-15T02:53:34.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.451+0000 7f0998eb7700 1 -- 172.21.15.1:0/2125416659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099406c7e0 con 0x7f09940c6650 2023-11-15T02:53:34.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.451+0000 7f098a7fc700 1 -- 172.21.15.1:0/2125416659 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f098c026410 con 0x7f09940c6650 2023-11-15T02:53:34.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.452+0000 7f098a7fc700 1 --2- 172.21.15.1:0/2125416659 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f097405f240 0x7f0974061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.452+0000 7f098a7fc700 1 -- 172.21.15.1:0/2125416659 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5793+0+0 (secure 0 0 0) 0x7f098c07c150 con 0x7f09940c6650 2023-11-15T02:53:34.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.452+0000 7f0991d9b700 1 --2- 172.21.15.1:0/2125416659 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f097405f240 0x7f0974061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.452+0000 7f0991d9b700 1 --2- 172.21.15.1:0/2125416659 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f097405f240 0x7f0974061700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f099414ff20 tx=0x7f097c009040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:34.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.456+0000 7f098a7fc700 1 -- 172.21.15.1:0/2125416659 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f098c04d430 con 0x7f09940c6650 2023-11-15T02:53:34.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.630+0000 7f0998eb7700 1 -- 172.21.15.1:0/2125416659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f09940c9ce0 con 0x7f09940c6650 2023-11-15T02:53:34.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.630+0000 7f098a7fc700 1 -- 172.21.15.1:0/2125416659 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v192) v1 ==== 110+0+10 (secure 0 0 0) 0x7f098c050a50 con 0x7f09940c6650 2023-11-15T02:53:34.633 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T02:53:34.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.632+0000 7f0998eb7700 1 -- 172.21.15.1:0/2125416659 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f097405f240 msgr2=0x7f0974061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.632+0000 7f0998eb7700 1 --2- 172.21.15.1:0/2125416659 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f097405f240 0x7f0974061700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f099414ff20 tx=0x7f097c009040).stop 2023-11-15T02:53:34.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.632+0000 7f0998eb7700 1 -- 172.21.15.1:0/2125416659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09940c6650 msgr2=0x7f09941573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.632+0000 7f0998eb7700 1 --2- 172.21.15.1:0/2125416659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09940c6650 0x7f09941573c0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f098c00b6c0 tx=0x7f098c009780).stop 2023-11-15T02:53:34.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.632+0000 7f0998eb7700 1 -- 172.21.15.1:0/2125416659 shutdown_connections 2023-11-15T02:53:34.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.632+0000 7f0998eb7700 1 --2- 172.21.15.1:0/2125416659 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f097405f240 0x7f0974061700 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.632+0000 7f0998eb7700 1 --2- 172.21.15.1:0/2125416659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0994154480 0x7f099415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.632+0000 7f0998eb7700 1 --2- 172.21.15.1:0/2125416659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09940c6650 0x7f09941573c0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.632+0000 7f0998eb7700 1 --2- 172.21.15.1:0/2125416659 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09941540a0 0x7f099415a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.632+0000 7f0998eb7700 1 -- 172.21.15.1:0/2125416659 >> 172.21.15.1:0/2125416659 conn(0x7f0994064a70 msgr2=0x7f09940aa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:34.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.632+0000 7f0998eb7700 1 -- 172.21.15.1:0/2125416659 shutdown_connections 2023-11-15T02:53:34.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.632+0000 7f0998eb7700 1 -- 172.21.15.1:0/2125416659 wait complete. 2023-11-15T02:53:34.646 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T02:53:34.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.765+0000 7f28e359e700 1 Processor -- start 2023-11-15T02:53:34.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.765+0000 7f28e359e700 1 -- start start 2023-11-15T02:53:34.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.766+0000 7f28e359e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28e4137450 0x7f28e40c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.766+0000 7f28e359e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f28e4137830 0x7f28e4066940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.766+0000 7f28e359e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e40672e0 con 0x7f28e4066e30 2023-11-15T02:53:34.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.766+0000 7f28e359e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e4159030 con 0x7f28e4137830 2023-11-15T02:53:34.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.766+0000 7f28e359e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e4158480 con 0x7f28e4137450 2023-11-15T02:53:34.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.766+0000 7f28e1d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f28e4137830 0x7f28e4066940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.766+0000 7f28e1d9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f28e4137830 0x7f28e4066940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40296/0 (socket says 172.21.15.1:40296) 2023-11-15T02:53:34.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.766+0000 7f28e1d9b700 1 -- 172.21.15.1:0/380951011 learned_addr learned my addr 172.21.15.1:0/380951011 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:34.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.766+0000 7f28e259c700 1 --2- 172.21.15.1:0/380951011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28e4137450 0x7f28e40c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.766+0000 7f28e1d9b700 1 -- 172.21.15.1:0/380951011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28e4137450 msgr2=0x7f28e40c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:34.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.766+0000 7f28e1d9b700 1 --2- 172.21.15.1:0/380951011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28e4137450 0x7f28e40c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.766+0000 7f28e1d9b700 1 -- 172.21.15.1:0/380951011 >> v1:172.21.15.141:6789/0 conn(0x7f28e4066e30 legacy=0x7f28e4067e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:34.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.766+0000 7f28e1d9b700 1 -- 172.21.15.1:0/380951011 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e4158720 con 0x7f28e4137830 2023-11-15T02:53:34.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.766+0000 7f28e1d9b700 1 --2- 172.21.15.1:0/380951011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e4137830 0x7f28e4066940 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f28cc006fd0 tx=0x7f28cc0090f0).ready entity=mon.0 client_cookie=6b22af59b7c53fc server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:34.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.766+0000 7f28e159a700 1 -- 172.21.15.1:0/380951011 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00b600 con 0x7f28e4137830 2023-11-15T02:53:34.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.767+0000 7f28e159a700 1 -- 172.21.15.1:0/380951011 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc00b760 con 0x7f28e4137830 2023-11-15T02:53:34.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.767+0000 7f28e159a700 1 -- 172.21.15.1:0/380951011 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00bae0 con 0x7f28e4137830 2023-11-15T02:53:34.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.767+0000 7f28e359e700 1 -- 172.21.15.1:0/380951011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e4137830 msgr2=0x7f28e4066940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.767+0000 7f28e359e700 1 --2- 172.21.15.1:0/380951011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e4137830 0x7f28e4066940 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f28cc006fd0 tx=0x7f28cc0090f0).stop 2023-11-15T02:53:34.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.767+0000 7f28e359e700 1 -- 172.21.15.1:0/380951011 shutdown_connections 2023-11-15T02:53:34.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.767+0000 7f28e359e700 1 --2- 172.21.15.1:0/380951011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28e4137450 0x7f28e40c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.767+0000 7f28e359e700 1 --2- 172.21.15.1:0/380951011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e4137830 0x7f28e4066940 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.767+0000 7f28e359e700 1 -- 172.21.15.1:0/380951011 >> 172.21.15.1:0/380951011 conn(0x7f28e40c8f50 msgr2=0x7f28e40c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:34.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.767+0000 7f28e359e700 1 -- 172.21.15.1:0/380951011 shutdown_connections 2023-11-15T02:53:34.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.767+0000 7f28e359e700 1 -- 172.21.15.1:0/380951011 wait complete. 2023-11-15T02:53:34.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.768+0000 7f28e359e700 1 Processor -- start 2023-11-15T02:53:34.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.768+0000 7f28e359e700 1 -- start start 2023-11-15T02:53:34.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e359e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f28e4066e30 0x7f28e41647c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e359e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e4137450 0x7f28e40c09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e359e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28e40c0ea0 0x7f28e413b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e359e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e40c2060 con 0x7f28e4137450 2023-11-15T02:53:34.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e359e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e40c1450 con 0x7f28e4066e30 2023-11-15T02:53:34.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e359e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e40c1730 con 0x7f28e40c0ea0 2023-11-15T02:53:34.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e1d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e4137450 0x7f28e40c09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e1d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e4137450 0x7f28e40c09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40306/0 (socket says 172.21.15.1:40306) 2023-11-15T02:53:34.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e1d9b700 1 -- 172.21.15.1:0/1827777939 learned_addr learned my addr 172.21.15.1:0/1827777939 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:34.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e259c700 1 --2- 172.21.15.1:0/1827777939 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f28e4066e30 0x7f28e41647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e2d9d700 1 --2- 172.21.15.1:0/1827777939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28e40c0ea0 0x7f28e413b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e1d9b700 1 -- 172.21.15.1:0/1827777939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28e40c0ea0 msgr2=0x7f28e413b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e1d9b700 1 --2- 172.21.15.1:0/1827777939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28e40c0ea0 0x7f28e413b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e1d9b700 1 -- 172.21.15.1:0/1827777939 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f28e4066e30 msgr2=0x7f28e41647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e1d9b700 1 --2- 172.21.15.1:0/1827777939 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f28e4066e30 0x7f28e41647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.769+0000 7f28e1d9b700 1 -- 172.21.15.1:0/1827777939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc009370 con 0x7f28e4137450 2023-11-15T02:53:34.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.770+0000 7f28e1d9b700 1 --2- 172.21.15.1:0/1827777939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e4137450 0x7f28e40c09b0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f28e40663d0 tx=0x7f28cc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:34.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.770+0000 7f28da7fc700 1 -- 172.21.15.1:0/1827777939 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00b8d0 con 0x7f28e4137450 2023-11-15T02:53:34.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.770+0000 7f28da7fc700 1 -- 172.21.15.1:0/1827777939 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc00ba30 con 0x7f28e4137450 2023-11-15T02:53:34.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.770+0000 7f28e359e700 1 -- 172.21.15.1:0/1827777939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e40c1a10 con 0x7f28e4137450 2023-11-15T02:53:34.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.770+0000 7f28da7fc700 1 -- 172.21.15.1:0/1827777939 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc01d680 con 0x7f28e4137450 2023-11-15T02:53:34.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.770+0000 7f28e359e700 1 -- 172.21.15.1:0/1827777939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e40aaa60 con 0x7f28e4137450 2023-11-15T02:53:34.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.771+0000 7f28e359e700 1 -- 172.21.15.1:0/1827777939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e40c21d0 con 0x7f28e4137450 2023-11-15T02:53:34.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.771+0000 7f28da7fc700 1 -- 172.21.15.1:0/1827777939 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f28cc01da30 con 0x7f28e4137450 2023-11-15T02:53:34.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.772+0000 7f28da7fc700 1 --2- 172.21.15.1:0/1827777939 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f28c405f270 0x7f28c4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:34.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.772+0000 7f28da7fc700 1 -- 172.21.15.1:0/1827777939 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5793+0+0 (secure 0 0 0) 0x7f28cc07bd60 con 0x7f28e4137450 2023-11-15T02:53:34.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.772+0000 7f28e259c700 1 --2- 172.21.15.1:0/1827777939 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f28c405f270 0x7f28c4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:34.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.772+0000 7f28e259c700 1 --2- 172.21.15.1:0/1827777939 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f28c405f270 0x7f28c4061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f28dc00f610 tx=0x7f28dc0077f0).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:34.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.776+0000 7f28da7fc700 1 -- 172.21.15.1:0/1827777939 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f28cc04cff0 con 0x7f28e4137450 2023-11-15T02:53:34.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.949+0000 7f28e359e700 1 -- 172.21.15.1:0/1827777939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f28e40672e0 con 0x7f28e4137450 2023-11-15T02:53:34.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.950+0000 7f28da7fc700 1 -- 172.21.15.1:0/1827777939 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v192) v1 ==== 92+0+10 (secure 0 0 0) 0x7f28e40672e0 con 0x7f28e4137450 2023-11-15T02:53:34.952 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T02:53:34.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.952+0000 7f28e359e700 1 -- 172.21.15.1:0/1827777939 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f28c405f270 msgr2=0x7f28c4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.952+0000 7f28e359e700 1 --2- 172.21.15.1:0/1827777939 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f28c405f270 0x7f28c4061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f28dc00f610 tx=0x7f28dc0077f0).stop 2023-11-15T02:53:34.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.952+0000 7f28e359e700 1 -- 172.21.15.1:0/1827777939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e4137450 msgr2=0x7f28e40c09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:34.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.952+0000 7f28e359e700 1 --2- 172.21.15.1:0/1827777939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e4137450 0x7f28e40c09b0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f28e40663d0 tx=0x7f28cc017000).stop 2023-11-15T02:53:34.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.952+0000 7f28e359e700 1 -- 172.21.15.1:0/1827777939 shutdown_connections 2023-11-15T02:53:34.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.952+0000 7f28e359e700 1 --2- 172.21.15.1:0/1827777939 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f28c405f270 0x7f28c4061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.952+0000 7f28e359e700 1 --2- 172.21.15.1:0/1827777939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28e40c0ea0 0x7f28e413b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.952+0000 7f28e359e700 1 --2- 172.21.15.1:0/1827777939 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f28e4066e30 0x7f28e41647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.952+0000 7f28e359e700 1 --2- 172.21.15.1:0/1827777939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e4137450 0x7f28e40c09b0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:34.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.952+0000 7f28e359e700 1 -- 172.21.15.1:0/1827777939 >> 172.21.15.1:0/1827777939 conn(0x7f28e40c8f50 msgr2=0x7f28e40bdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:34.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.952+0000 7f28e359e700 1 -- 172.21.15.1:0/1827777939 shutdown_connections 2023-11-15T02:53:34.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:34.952+0000 7f28e359e700 1 -- 172.21.15.1:0/1827777939 wait complete. 2023-11-15T02:53:34.966 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-15T02:53:35.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.082+0000 7f157f91c700 1 Processor -- start 2023-11-15T02:53:35.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.082+0000 7f157f91c700 1 -- start start 2023-11-15T02:53:35.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.083+0000 7f157f91c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15780ab1a0 0x7f1578154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:35.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.083+0000 7f157f91c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15780c06f0 con 0x7f15780aa060 2023-11-15T02:53:35.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.083+0000 7f157f91c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15780c09d0 con 0x7f1578154150 2023-11-15T02:53:35.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.083+0000 7f157f91c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1578158820 con 0x7f15780ab1a0 2023-11-15T02:53:35.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.083+0000 7f157deb9700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f15780aa060 0x7f15780c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49254/0 (socket says 172.21.15.1:49254) 2023-11-15T02:53:35.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.083+0000 7f157deb9700 1 -- 172.21.15.1:0/155221266 learned_addr learned my addr 172.21.15.1:0/155221266 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:35.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.083+0000 7f157ceb7700 1 --2- 172.21.15.1:0/155221266 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15780ab1a0 0x7f1578154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:35.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f1577fff700 1 -- 172.21.15.1:0/155221266 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502433303 0 0) 0x7f15780c06f0 con 0x7f15780aa060 2023-11-15T02:53:35.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f1577fff700 1 -- 172.21.15.1:0/155221266 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15600033f0 con 0x7f15780aa060 2023-11-15T02:53:35.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f1577fff700 1 -- 172.21.15.1:0/155221266 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3709836023 0 0) 0x7f15600033f0 con 0x7f15780aa060 2023-11-15T02:53:35.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f1577fff700 1 -- 172.21.15.1:0/155221266 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15780ab1a0 msgr2=0x7f1578154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:35.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f1577fff700 1 --2- 172.21.15.1:0/155221266 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15780ab1a0 0x7f1578154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:35.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f1577fff700 1 -- 172.21.15.1:0/155221266 >> v1:172.21.15.141:6789/0 conn(0x7f1578154150 legacy=0x7f1578158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:35.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f1577fff700 1 -- 172.21.15.1:0/155221266 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1578158b00 con 0x7f15780aa060 2023-11-15T02:53:35.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f1577fff700 1 -- 172.21.15.1:0/155221266 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f15680017f0 con 0x7f15780aa060 2023-11-15T02:53:35.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f1577fff700 1 -- 172.21.15.1:0/155221266 >> v1:172.21.15.1:6789/0 conn(0x7f15780aa060 legacy=0x7f15780c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:35.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f1577fff700 1 --2- 172.21.15.1:0/155221266 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15780ab1a0 0x7f1560003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:35.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f1577fff700 1 --2- 172.21.15.1:0/155221266 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1560003e40 0x7f1560004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:35.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f1577fff700 1 --2- 172.21.15.1:0/155221266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1560004b80 0x7f1560005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:35.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f1577fff700 1 -- 172.21.15.1:0/155221266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1578158820 con 0x7f1560004b80 2023-11-15T02:53:35.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f1577fff700 1 -- 172.21.15.1:0/155221266 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156000ba10 con 0x7f1560003e40 2023-11-15T02:53:35.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f1577fff700 1 -- 172.21.15.1:0/155221266 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156000bbd0 con 0x7f15780ab1a0 2023-11-15T02:53:35.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f157deb9700 1 --2- 172.21.15.1:0/155221266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1560004b80 0x7f1560005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:35.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f157ceb7700 1 --2- 172.21.15.1:0/155221266 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1560003e40 0x7f1560004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:35.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f157d6b8700 1 --2- 172.21.15.1:0/155221266 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15780ab1a0 0x7f1560003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:35.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f157deb9700 1 -- 172.21.15.1:0/155221266 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15780ab1a0 msgr2=0x7f1560003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:35.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f157deb9700 1 --2- 172.21.15.1:0/155221266 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f15780ab1a0 0x7f1560003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:35.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f157deb9700 1 -- 172.21.15.1:0/155221266 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1560003e40 msgr2=0x7f1560004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:35.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f157deb9700 1 --2- 172.21.15.1:0/155221266 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1560003e40 0x7f1560004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:35.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.084+0000 7f157deb9700 1 -- 172.21.15.1:0/155221266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15600033f0 con 0x7f1560004b80 2023-11-15T02:53:35.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.085+0000 7f157deb9700 1 --2- 172.21.15.1:0/155221266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1560004b80 0x7f1560005000 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f156800c450 tx=0x7f156800c760).ready entity=mon.0 client_cookie=52c9bc07a9898c2f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:35.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.085+0000 7f1577fff700 1 -- 172.21.15.1:0/155221266 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1568002030 con 0x7f1560004b80 2023-11-15T02:53:35.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.085+0000 7f1577fff700 1 -- 172.21.15.1:0/155221266 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156800cdf0 con 0x7f1560004b80 2023-11-15T02:53:35.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.085+0000 7f1577fff700 1 -- 172.21.15.1:0/155221266 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1568005d30 con 0x7f1560004b80 2023-11-15T02:53:35.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.085+0000 7f157f91c700 1 -- 172.21.15.1:0/155221266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1560004b80 msgr2=0x7f1560005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:35.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.085+0000 7f157f91c700 1 --2- 172.21.15.1:0/155221266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1560004b80 0x7f1560005000 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f156800c450 tx=0x7f156800c760).stop 2023-11-15T02:53:35.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.085+0000 7f157deb9700 1 -- 172.21.15.1:0/155221266 reap_dead start 2023-11-15T02:53:35.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.085+0000 7f157f91c700 1 -- 172.21.15.1:0/155221266 shutdown_connections 2023-11-15T02:53:35.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.085+0000 7f157f91c700 1 -- 172.21.15.1:0/155221266 >> 172.21.15.1:0/155221266 conn(0x7f1578064aa0 msgr2=0x7f1578064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:35.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.085+0000 7f157f91c700 1 -- 172.21.15.1:0/155221266 shutdown_connections 2023-11-15T02:53:35.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.085+0000 7f157f91c700 1 -- 172.21.15.1:0/155221266 wait complete. 2023-11-15T02:53:35.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.086+0000 7f157f91c700 1 Processor -- start 2023-11-15T02:53:35.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.086+0000 7f157f91c700 1 -- start start 2023-11-15T02:53:35.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.087+0000 7f157f91c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1578144cd0 0x7f1578168180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:35.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.087+0000 7f157f91c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1578151300 0x7f15780af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:35.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.087+0000 7f157f91c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f157814ce50 0x7f157814d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:35.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.087+0000 7f157f91c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15781450b0 con 0x7f157814ce50 2023-11-15T02:53:35.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.087+0000 7f157f91c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1578169070 con 0x7f1578151300 2023-11-15T02:53:35.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.087+0000 7f157f91c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15780ca290 con 0x7f1578144cd0 2023-11-15T02:53:35.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.087+0000 7f157deb9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f157814ce50 0x7f157814d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:35.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.087+0000 7f157deb9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f157814ce50 0x7f157814d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40316/0 (socket says 172.21.15.1:40316) 2023-11-15T02:53:35.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.087+0000 7f157deb9700 1 -- 172.21.15.1:0/3042663285 learned_addr learned my addr 172.21.15.1:0/3042663285 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:35.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.088+0000 7f157d6b8700 1 --2- 172.21.15.1:0/3042663285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1578144cd0 0x7f1578168180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:35.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.088+0000 7f157ceb7700 1 --2- 172.21.15.1:0/3042663285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1578151300 0x7f15780af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:35.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.088+0000 7f157deb9700 1 -- 172.21.15.1:0/3042663285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1578144cd0 msgr2=0x7f1578168180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:35.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.088+0000 7f157deb9700 1 --2- 172.21.15.1:0/3042663285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1578144cd0 0x7f1578168180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:35.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.088+0000 7f157deb9700 1 -- 172.21.15.1:0/3042663285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1578151300 msgr2=0x7f15780af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:35.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.088+0000 7f157deb9700 1 --2- 172.21.15.1:0/3042663285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1578151300 0x7f15780af350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:35.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.088+0000 7f157deb9700 1 -- 172.21.15.1:0/3042663285 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157814d7c0 con 0x7f157814ce50 2023-11-15T02:53:35.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.088+0000 7f157ceb7700 1 --2- 172.21.15.1:0/3042663285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1578151300 0x7f15780af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:35.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.088+0000 7f157deb9700 1 --2- 172.21.15.1:0/3042663285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f157814ce50 0x7f157814d2d0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f156800c7a0 tx=0x7f1568015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:35.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.088+0000 7f15757fa700 1 -- 172.21.15.1:0/3042663285 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1568002030 con 0x7f157814ce50 2023-11-15T02:53:35.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.088+0000 7f15757fa700 1 -- 172.21.15.1:0/3042663285 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1568013450 con 0x7f157814ce50 2023-11-15T02:53:35.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.088+0000 7f157f91c700 1 -- 172.21.15.1:0/3042663285 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15780af840 con 0x7f157814ce50 2023-11-15T02:53:35.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.088+0000 7f15757fa700 1 -- 172.21.15.1:0/3042663285 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15680017f0 con 0x7f157814ce50 2023-11-15T02:53:35.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.088+0000 7f157f91c700 1 -- 172.21.15.1:0/3042663285 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1578168ab0 con 0x7f157814ce50 2023-11-15T02:53:35.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.089+0000 7f157f91c700 1 -- 172.21.15.1:0/3042663285 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157806c7e0 con 0x7f157814ce50 2023-11-15T02:53:35.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.090+0000 7f15757fa700 1 -- 172.21.15.1:0/3042663285 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1568013a20 con 0x7f157814ce50 2023-11-15T02:53:35.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.090+0000 7f15757fa700 1 --2- 172.21.15.1:0/3042663285 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f156405f270 0x7f1564061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:35.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.090+0000 7f15757fa700 1 -- 172.21.15.1:0/3042663285 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5793+0+0 (secure 0 0 0) 0x7f156807b030 con 0x7f157814ce50 2023-11-15T02:53:35.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.090+0000 7f157d6b8700 1 --2- 172.21.15.1:0/3042663285 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f156405f270 0x7f1564061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:35.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.091+0000 7f157d6b8700 1 --2- 172.21.15.1:0/3042663285 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f156405f270 0x7f1564061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1570000c00 tx=0x7f1570009040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:35.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.094+0000 7f15757fa700 1 -- 172.21.15.1:0/3042663285 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f156804c2c0 con 0x7f157814ce50 2023-11-15T02:53:35.165 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:53:35.170 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:53:35.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.272+0000 7f157f91c700 1 -- 172.21.15.1:0/3042663285 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f15780ca3d0 con 0x7f157814ce50 2023-11-15T02:53:35.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.272+0000 7f15757fa700 1 -- 172.21.15.1:0/3042663285 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v192) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1568025070 con 0x7f157814ce50 2023-11-15T02:53:35.275 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:35.276 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T02:53:35.276 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:35.276 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2023-11-15T02:53:35.277 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "device_health_metrics" 2023-11-15T02:53:35.277 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:53:35.277 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:35.277 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 2, 2023-11-15T02:53:35.278 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "rbd" 2023-11-15T02:53:35.278 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:35.278 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T02:53:35.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.274+0000 7f157f91c700 1 -- 172.21.15.1:0/3042663285 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f156405f270 msgr2=0x7f1564061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:35.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.274+0000 7f157f91c700 1 --2- 172.21.15.1:0/3042663285 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f156405f270 0x7f1564061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1570000c00 tx=0x7f1570009040).stop 2023-11-15T02:53:35.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.274+0000 7f157f91c700 1 -- 172.21.15.1:0/3042663285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f157814ce50 msgr2=0x7f157814d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:35.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.274+0000 7f157f91c700 1 --2- 172.21.15.1:0/3042663285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f157814ce50 0x7f157814d2d0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f156800c7a0 tx=0x7f1568015000).stop 2023-11-15T02:53:35.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.274+0000 7f157f91c700 1 -- 172.21.15.1:0/3042663285 shutdown_connections 2023-11-15T02:53:35.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.274+0000 7f157f91c700 1 --2- 172.21.15.1:0/3042663285 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f156405f270 0x7f1564061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:35.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.274+0000 7f157f91c700 1 --2- 172.21.15.1:0/3042663285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f157814ce50 0x7f157814d2d0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:35.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.274+0000 7f157f91c700 1 --2- 172.21.15.1:0/3042663285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1578144cd0 0x7f1578168180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:35.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.274+0000 7f157f91c700 1 --2- 172.21.15.1:0/3042663285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1578151300 0x7f15780af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:35.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.274+0000 7f157f91c700 1 -- 172.21.15.1:0/3042663285 >> 172.21.15.1:0/3042663285 conn(0x7f1578064aa0 msgr2=0x7f157814e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:35.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.274+0000 7f157f91c700 1 -- 172.21.15.1:0/3042663285 shutdown_connections 2023-11-15T02:53:35.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.274+0000 7f157f91c700 1 -- 172.21.15.1:0/3042663285 wait complete. 2023-11-15T02:53:35.288 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-15T02:53:35.289 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-15T02:53:35.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.411+0000 7fddbeba2700 1 Processor -- start 2023-11-15T02:53:35.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.411+0000 7fddbeba2700 1 -- start start 2023-11-15T02:53:35.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbeba2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fddb80ada30 0x7fddb80c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:35.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbeba2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fddb80ca400 0x7fddb80c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:35.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbeba2700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb80caee0 con 0x7fddb80c65b0 2023-11-15T02:53:35.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbeba2700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb8154850 con 0x7fddb80ada30 2023-11-15T02:53:35.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbeba2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80ca920 con 0x7fddb80ca400 2023-11-15T02:53:35.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbdba0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fddb80ada30 0x7fddb80c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:35.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbe3a1700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fddb80c65b0 0x7fddb8063510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49260/0 (socket says 172.21.15.1:49260) 2023-11-15T02:53:35.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbe3a1700 1 -- 172.21.15.1:0/4189496792 learned_addr learned my addr 172.21.15.1:0/4189496792 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:35.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbd39f700 1 --2- 172.21.15.1:0/4189496792 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fddb80ca400 0x7fddb80c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:35.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbdba0700 1 -- 172.21.15.1:0/4189496792 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fddb80ca400 msgr2=0x7fddb80c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:35.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbdba0700 1 --2- 172.21.15.1:0/4189496792 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fddb80ca400 0x7fddb80c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:35.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbdba0700 1 -- 172.21.15.1:0/4189496792 >> v1:172.21.15.1:6789/0 conn(0x7fddb80c65b0 legacy=0x7fddb8063510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:35.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbdba0700 1 -- 172.21.15.1:0/4189496792 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb80cac00 con 0x7fddb80ada30 2023-11-15T02:53:35.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbcb9e700 1 -- 172.21.15.1:0/4189496792 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803953590 0 0) 0x7fddb80caee0 con 0x7fddb80c65b0 2023-11-15T02:53:35.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbdba0700 1 --2- 172.21.15.1:0/4189496792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb80ada30 0x7fddb80c9f10 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7fddb0009760 tx=0x7fddb0009060).ready entity=mon.0 client_cookie=ceed5d65c76b963b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:35.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbcb9e700 1 -- 172.21.15.1:0/4189496792 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb000f510 con 0x7fddb80ada30 2023-11-15T02:53:35.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbcb9e700 1 -- 172.21.15.1:0/4189496792 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb000f670 con 0x7fddb80ada30 2023-11-15T02:53:35.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.412+0000 7fddbcb9e700 1 -- 172.21.15.1:0/4189496792 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb000f9f0 con 0x7fddb80ada30 2023-11-15T02:53:35.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.413+0000 7fddbeba2700 1 -- 172.21.15.1:0/4189496792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb80ada30 msgr2=0x7fddb80c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:35.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.413+0000 7fddbeba2700 1 --2- 172.21.15.1:0/4189496792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb80ada30 0x7fddb80c9f10 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7fddb0009760 tx=0x7fddb0009060).stop 2023-11-15T02:53:35.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.413+0000 7fddbeba2700 1 -- 172.21.15.1:0/4189496792 shutdown_connections 2023-11-15T02:53:35.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.413+0000 7fddbeba2700 1 --2- 172.21.15.1:0/4189496792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb80ada30 0x7fddb80c9f10 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:35.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.413+0000 7fddbeba2700 1 --2- 172.21.15.1:0/4189496792 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fddb80ca400 0x7fddb80c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:35.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.413+0000 7fddbeba2700 1 -- 172.21.15.1:0/4189496792 >> 172.21.15.1:0/4189496792 conn(0x7fddb8064a60 msgr2=0x7fddb8064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:35.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.413+0000 7fddbeba2700 1 -- 172.21.15.1:0/4189496792 shutdown_connections 2023-11-15T02:53:35.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.413+0000 7fddbeba2700 1 -- 172.21.15.1:0/4189496792 wait complete. 2023-11-15T02:53:35.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.414+0000 7fddbeba2700 1 Processor -- start 2023-11-15T02:53:35.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.414+0000 7fddbeba2700 1 -- start start 2023-11-15T02:53:35.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbeba2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb80ada30 0x7fddb80c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:35.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbeba2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fddb80c65b0 0x7fddb8156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:35.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbeba2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fddb80ca400 0x7fddb80c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:35.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbeba2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80c4390 con 0x7fddb80ada30 2023-11-15T02:53:35.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbeba2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80c3780 con 0x7fddb80ca400 2023-11-15T02:53:35.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbeba2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80c3a60 con 0x7fddb80c65b0 2023-11-15T02:53:35.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbdba0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb80ada30 0x7fddb80c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:35.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbdba0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb80ada30 0x7fddb80c30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40328/0 (socket says 172.21.15.1:40328) 2023-11-15T02:53:35.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbdba0700 1 -- 172.21.15.1:0/616229538 learned_addr learned my addr 172.21.15.1:0/616229538 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:35.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbd39f700 1 --2- 172.21.15.1:0/616229538 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fddb80c65b0 0x7fddb8156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:35.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbe3a1700 1 --2- 172.21.15.1:0/616229538 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fddb80ca400 0x7fddb80c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:35.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbdba0700 1 -- 172.21.15.1:0/616229538 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fddb80c65b0 msgr2=0x7fddb8156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:35.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbdba0700 1 --2- 172.21.15.1:0/616229538 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fddb80c65b0 0x7fddb8156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:35.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbdba0700 1 -- 172.21.15.1:0/616229538 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fddb80ca400 msgr2=0x7fddb80c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:35.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbdba0700 1 --2- 172.21.15.1:0/616229538 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fddb80ca400 0x7fddb80c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:35.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbdba0700 1 -- 172.21.15.1:0/616229538 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb00092a0 con 0x7fddb80ada30 2023-11-15T02:53:35.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbd39f700 1 --2- 172.21.15.1:0/616229538 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fddb80c65b0 0x7fddb8156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:53:35.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.415+0000 7fddbdba0700 1 --2- 172.21.15.1:0/616229538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb80ada30 0x7fddb80c30c0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7fddb80c2140 tx=0x7fddb0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:35.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.416+0000 7fddb5ffb700 1 -- 172.21.15.1:0/616229538 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb000f7e0 con 0x7fddb80ada30 2023-11-15T02:53:35.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.416+0000 7fddb5ffb700 1 -- 172.21.15.1:0/616229538 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb000f940 con 0x7fddb80ada30 2023-11-15T02:53:35.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.416+0000 7fddbeba2700 1 -- 172.21.15.1:0/616229538 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb80c3d40 con 0x7fddb80ada30 2023-11-15T02:53:35.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.416+0000 7fddb5ffb700 1 -- 172.21.15.1:0/616229538 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb001b660 con 0x7fddb80ada30 2023-11-15T02:53:35.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.416+0000 7fddbeba2700 1 -- 172.21.15.1:0/616229538 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb8157320 con 0x7fddb80ada30 2023-11-15T02:53:35.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.417+0000 7fddbeba2700 1 -- 172.21.15.1:0/616229538 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb80c4670 con 0x7fddb80ada30 2023-11-15T02:53:35.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.417+0000 7fddb5ffb700 1 -- 172.21.15.1:0/616229538 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fddb001ba50 con 0x7fddb80ada30 2023-11-15T02:53:35.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.417+0000 7fddb5ffb700 1 --2- 172.21.15.1:0/616229538 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fdda405f270 0x7fdda4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:35.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.418+0000 7fddb5ffb700 1 -- 172.21.15.1:0/616229538 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5793+0+0 (secure 0 0 0) 0x7fddb007be60 con 0x7fddb80ada30 2023-11-15T02:53:35.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.418+0000 7fddbd39f700 1 --2- 172.21.15.1:0/616229538 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fdda405f270 0x7fdda4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:35.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.418+0000 7fddbd39f700 1 --2- 172.21.15.1:0/616229538 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fdda405f270 0x7fdda4061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fddb8153190 tx=0x7fddac008040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:35.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.422+0000 7fddb5ffb700 1 -- 172.21.15.1:0/616229538 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fddb004d0f0 con 0x7fddb80ada30 2023-11-15T02:53:35.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:35.596+0000 7fddbeba2700 1 -- 172.21.15.1:0/616229538 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fddb80475e0 con 0x7fddb80ada30 2023-11-15T02:53:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.578+0000 7fddb5ffb700 1 -- 172.21.15.1:0/616229538 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v193) v1 ==== 152+0+0 (secure 0 0 0) 0x7fddb0050710 con 0x7fddb80ada30 2023-11-15T02:53:36.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.583+0000 7fddbeba2700 1 -- 172.21.15.1:0/616229538 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fdda405f270 msgr2=0x7fdda4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:36.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.583+0000 7fddbeba2700 1 --2- 172.21.15.1:0/616229538 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fdda405f270 0x7fdda4061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fddb8153190 tx=0x7fddac008040).stop 2023-11-15T02:53:36.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.583+0000 7fddbeba2700 1 -- 172.21.15.1:0/616229538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb80ada30 msgr2=0x7fddb80c30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:36.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.583+0000 7fddbeba2700 1 --2- 172.21.15.1:0/616229538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb80ada30 0x7fddb80c30c0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7fddb80c2140 tx=0x7fddb0017000).stop 2023-11-15T02:53:36.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.583+0000 7fddbeba2700 1 -- 172.21.15.1:0/616229538 shutdown_connections 2023-11-15T02:53:36.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.583+0000 7fddbeba2700 1 --2- 172.21.15.1:0/616229538 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fdda405f270 0x7fdda4061730 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0x7fddb8153190 tx=0x7fddac008040).stop 2023-11-15T02:53:36.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.583+0000 7fddbeba2700 1 --2- 172.21.15.1:0/616229538 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fddb80ca400 0x7fddb80c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:36.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.583+0000 7fddbeba2700 1 --2- 172.21.15.1:0/616229538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb80ada30 0x7fddb80c30c0 secure :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 rx=0x7fddb80c2140 tx=0x7fddb0017000).stop 2023-11-15T02:53:36.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.583+0000 7fddbeba2700 1 --2- 172.21.15.1:0/616229538 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fddb80c65b0 0x7fddb8156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:36.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.583+0000 7fddbeba2700 1 -- 172.21.15.1:0/616229538 >> 172.21.15.1:0/616229538 conn(0x7fddb8064a60 msgr2=0x7fddb80c0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:36.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.585+0000 7fddbeba2700 1 -- 172.21.15.1:0/616229538 shutdown_connections 2023-11-15T02:53:36.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.585+0000 7fddbeba2700 1 -- 172.21.15.1:0/616229538 wait complete. 2023-11-15T02:53:36.592 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2023-11-15T02:53:36.606 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-15T02:53:36.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.735+0000 7fe45ba28700 1 Processor -- start 2023-11-15T02:53:36.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.736+0000 7fe45ba28700 1 -- start start 2023-11-15T02:53:36.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.736+0000 7fe45ba28700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe4540bcbf0 0x7fe454062910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:36.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.736+0000 7fe45ba28700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe454062e00 0x7fe4540c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:36.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.736+0000 7fe45ba28700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4540c5480 con 0x7fe45414e960 2023-11-15T02:53:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.736+0000 7fe45ba28700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4540636e0 con 0x7fe4540bcbf0 2023-11-15T02:53:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.736+0000 7fe45ba28700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4540639c0 con 0x7fe454062e00 2023-11-15T02:53:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.737+0000 7fe458fc3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe4540bcbf0 0x7fe454062910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.737+0000 7fe4597c4700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe45414e960 0x7fe4540bc4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49274/0 (socket says 172.21.15.1:49274) 2023-11-15T02:53:36.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.737+0000 7fe4597c4700 1 -- 172.21.15.1:0/96746547 learned_addr learned my addr 172.21.15.1:0/96746547 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:36.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.737+0000 7fe458fc3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe4540bcbf0 0x7fe454062910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40342/0 (socket says 172.21.15.1:40342) 2023-11-15T02:53:36.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.737+0000 7fe459fc5700 1 --2- 172.21.15.1:0/96746547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe454062e00 0x7fe4540c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:36.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.737+0000 7fe458fc3700 1 -- 172.21.15.1:0/96746547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe454062e00 msgr2=0x7fe4540c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:36.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.737+0000 7fe458fc3700 1 --2- 172.21.15.1:0/96746547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe454062e00 0x7fe4540c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:36.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.737+0000 7fe458fc3700 1 -- 172.21.15.1:0/96746547 >> v1:172.21.15.1:6789/0 conn(0x7fe45414e960 legacy=0x7fe4540bc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:36.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.737+0000 7fe458fc3700 1 -- 172.21.15.1:0/96746547 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe454063ca0 con 0x7fe4540bcbf0 2023-11-15T02:53:36.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.737+0000 7fe453fff700 1 -- 172.21.15.1:0/96746547 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3213368952 0 0) 0x7fe4540c5480 con 0x7fe45414e960 2023-11-15T02:53:36.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.737+0000 7fe458fc3700 1 --2- 172.21.15.1:0/96746547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4540bcbf0 0x7fe454062910 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7fe448009760 tx=0x7fe448009060).ready entity=mon.0 client_cookie=35b2fc7f1cf2b417 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:36.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.737+0000 7fe453fff700 1 -- 172.21.15.1:0/96746547 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44800f510 con 0x7fe4540bcbf0 2023-11-15T02:53:36.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.737+0000 7fe453fff700 1 -- 172.21.15.1:0/96746547 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44800f670 con 0x7fe4540bcbf0 2023-11-15T02:53:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.737+0000 7fe453fff700 1 -- 172.21.15.1:0/96746547 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44800f9f0 con 0x7fe4540bcbf0 2023-11-15T02:53:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.738+0000 7fe45ba28700 1 -- 172.21.15.1:0/96746547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4540bcbf0 msgr2=0x7fe454062910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.738+0000 7fe45ba28700 1 --2- 172.21.15.1:0/96746547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4540bcbf0 0x7fe454062910 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7fe448009760 tx=0x7fe448009060).stop 2023-11-15T02:53:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.738+0000 7fe45ba28700 1 -- 172.21.15.1:0/96746547 shutdown_connections 2023-11-15T02:53:36.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.738+0000 7fe45ba28700 1 --2- 172.21.15.1:0/96746547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe454062e00 0x7fe4540c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:36.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.738+0000 7fe45ba28700 1 --2- 172.21.15.1:0/96746547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4540bcbf0 0x7fe454062910 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:36.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.738+0000 7fe45ba28700 1 -- 172.21.15.1:0/96746547 >> 172.21.15.1:0/96746547 conn(0x7fe4540c8050 msgr2=0x7fe4540c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:36.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.738+0000 7fe45ba28700 1 -- 172.21.15.1:0/96746547 shutdown_connections 2023-11-15T02:53:36.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.738+0000 7fe45ba28700 1 -- 172.21.15.1:0/96746547 wait complete. 2023-11-15T02:53:36.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.739+0000 7fe45ba28700 1 Processor -- start 2023-11-15T02:53:36.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.739+0000 7fe45ba28700 1 -- start start 2023-11-15T02:53:36.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe45ba28700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe454062e00 0x7fe454163dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:36.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe45ba28700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4540bcbf0 0x7fe4541642c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:36.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe45ba28700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe45414e960 0x7fe4540a55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:36.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe45ba28700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4540abb70 con 0x7fe45414e960 2023-11-15T02:53:36.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe45ba28700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4540abe50 con 0x7fe4540bcbf0 2023-11-15T02:53:36.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe45ba28700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4540ac130 con 0x7fe454062e00 2023-11-15T02:53:36.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe459fc5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe45414e960 0x7fe4540a55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:36.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe4597c4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe454062e00 0x7fe454163dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:36.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe459fc5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe45414e960 0x7fe4540a55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40344/0 (socket says 172.21.15.1:40344) 2023-11-15T02:53:36.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe459fc5700 1 -- 172.21.15.1:0/2279739881 learned_addr learned my addr 172.21.15.1:0/2279739881 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:36.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe458fc3700 1 --2- 172.21.15.1:0/2279739881 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4540bcbf0 0x7fe4541642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:36.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe459fc5700 1 -- 172.21.15.1:0/2279739881 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe454062e00 msgr2=0x7fe454163dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:36.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe459fc5700 1 --2- 172.21.15.1:0/2279739881 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe454062e00 0x7fe454163dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:36.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe459fc5700 1 -- 172.21.15.1:0/2279739881 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4540bcbf0 msgr2=0x7fe4541642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:36.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe459fc5700 1 --2- 172.21.15.1:0/2279739881 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4540bcbf0 0x7fe4541642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:36.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.740+0000 7fe459fc5700 1 -- 172.21.15.1:0/2279739881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4480092a0 con 0x7fe45414e960 2023-11-15T02:53:36.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.741+0000 7fe459fc5700 1 --2- 172.21.15.1:0/2279739881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe45414e960 0x7fe4540a55a0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fe444009e90 tx=0x7fe44400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:36.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.741+0000 7fe4517fa700 1 -- 172.21.15.1:0/2279739881 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44400caa0 con 0x7fe45414e960 2023-11-15T02:53:36.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.741+0000 7fe4517fa700 1 -- 172.21.15.1:0/2279739881 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44400f040 con 0x7fe45414e960 2023-11-15T02:53:36.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.741+0000 7fe45ba28700 1 -- 172.21.15.1:0/2279739881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe454164920 con 0x7fe45414e960 2023-11-15T02:53:36.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.741+0000 7fe4517fa700 1 -- 172.21.15.1:0/2279739881 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44400ce10 con 0x7fe45414e960 2023-11-15T02:53:36.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.741+0000 7fe45ba28700 1 -- 172.21.15.1:0/2279739881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4540a5c50 con 0x7fe45414e960 2023-11-15T02:53:36.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.742+0000 7fe45ba28700 1 -- 172.21.15.1:0/2279739881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe454164b10 con 0x7fe45414e960 2023-11-15T02:53:36.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.742+0000 7fe4517fa700 1 -- 172.21.15.1:0/2279739881 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe444013610 con 0x7fe45414e960 2023-11-15T02:53:36.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.742+0000 7fe4517fa700 1 --2- 172.21.15.1:0/2279739881 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe44005f270 0x7fe440061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:36.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.743+0000 7fe4517fa700 1 -- 172.21.15.1:0/2279739881 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6163+0+0 (secure 0 0 0) 0x7fe44407abf0 con 0x7fe45414e960 2023-11-15T02:53:36.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.743+0000 7fe4597c4700 1 --2- 172.21.15.1:0/2279739881 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe44005f270 0x7fe440061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:36.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.743+0000 7fe4597c4700 1 --2- 172.21.15.1:0/2279739881 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe44005f270 0x7fe440061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe44c007fd0 tx=0x7fe44c007dd0).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:36.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.747+0000 7fe4517fa700 1 -- 172.21.15.1:0/2279739881 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe444081080 con 0x7fe45414e960 2023-11-15T02:53:36.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:36.921+0000 7fe45ba28700 1 -- 172.21.15.1:0/2279739881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe45406c7e0 con 0x7fe45414e960 2023-11-15T02:53:37.585 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.583+0000 7fe4517fa700 1 -- 172.21.15.1:0/2279739881 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v194) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe44404f740 con 0x7fe45414e960 2023-11-15T02:53:37.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.589+0000 7fe45ba28700 1 -- 172.21.15.1:0/2279739881 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe44005f270 msgr2=0x7fe440061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:37.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.589+0000 7fe45ba28700 1 --2- 172.21.15.1:0/2279739881 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe44005f270 0x7fe440061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe44c007fd0 tx=0x7fe44c007dd0).stop 2023-11-15T02:53:37.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.589+0000 7fe45ba28700 1 -- 172.21.15.1:0/2279739881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe45414e960 msgr2=0x7fe4540a55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:37.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.589+0000 7fe45ba28700 1 --2- 172.21.15.1:0/2279739881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe45414e960 0x7fe4540a55a0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fe444009e90 tx=0x7fe44400b040).stop 2023-11-15T02:53:37.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.591+0000 7fe45ba28700 1 -- 172.21.15.1:0/2279739881 shutdown_connections 2023-11-15T02:53:37.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.591+0000 7fe45ba28700 1 --2- 172.21.15.1:0/2279739881 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe44005f270 0x7fe440061730 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0x7fe44c007fd0 tx=0x7fe44c007dd0).stop 2023-11-15T02:53:37.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.591+0000 7fe45ba28700 1 --2- 172.21.15.1:0/2279739881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe45414e960 0x7fe4540a55a0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:37.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.591+0000 7fe45ba28700 1 --2- 172.21.15.1:0/2279739881 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe454062e00 0x7fe454163dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:37.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.591+0000 7fe45ba28700 1 --2- 172.21.15.1:0/2279739881 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4540bcbf0 0x7fe4541642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:37.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.591+0000 7fe45ba28700 1 -- 172.21.15.1:0/2279739881 >> 172.21.15.1:0/2279739881 conn(0x7fe4540c8050 msgr2=0x7fe4540c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:37.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.595+0000 7fe45ba28700 1 -- 172.21.15.1:0/2279739881 shutdown_connections 2023-11-15T02:53:37.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.595+0000 7fe45ba28700 1 -- 172.21.15.1:0/2279739881 wait complete. 2023-11-15T02:53:37.607 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2023-11-15T02:53:37.623 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-15T02:53:37.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.748+0000 7f66b1486700 1 Processor -- start 2023-11-15T02:53:37.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.748+0000 7f66b1486700 1 -- start start 2023-11-15T02:53:37.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.749+0000 7f66b1486700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f66ac0ad790 0x7f66ac1555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:37.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.749+0000 7f66b1486700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f66ac158150 0x7f66ac0c7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:37.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.749+0000 7f66b1486700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ac0c9210 con 0x7f66ac0c7e70 2023-11-15T02:53:37.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.749+0000 7f66b1486700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ac0c6440 con 0x7f66ac0ad790 2023-11-15T02:53:37.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.749+0000 7f66b1486700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ac155ab0 con 0x7f66ac158150 2023-11-15T02:53:37.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.749+0000 7f66aaffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f66ac0ad790 0x7f66ac1555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:37.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.749+0000 7f66aaffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f66ac0ad790 0x7f66ac1555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59418/0 (socket says 172.21.15.1:59418) 2023-11-15T02:53:37.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.749+0000 7f66aaffd700 1 -- 172.21.15.1:0/1918523831 learned_addr learned my addr 172.21.15.1:0/1918523831 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:37.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.749+0000 7f66aa7fc700 1 --2- 172.21.15.1:0/1918523831 >> v2:172.21.15.141:3300/0 conn(0x7f66ac158150 0x7f66ac0c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:37.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.749+0000 7f66aaffd700 1 -- 172.21.15.1:0/1918523831 >> v2:172.21.15.141:3300/0 conn(0x7f66ac158150 msgr2=0x7f66ac0c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:37.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.749+0000 7f66aaffd700 1 --2- 172.21.15.1:0/1918523831 >> v2:172.21.15.141:3300/0 conn(0x7f66ac158150 0x7f66ac0c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:37.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.749+0000 7f66aaffd700 1 -- 172.21.15.1:0/1918523831 >> v1:172.21.15.141:6789/0 conn(0x7f66ac0c7e70 legacy=0x7f66ac063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:37.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.749+0000 7f66aaffd700 1 -- 172.21.15.1:0/1918523831 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac158650 con 0x7f66ac0ad790 2023-11-15T02:53:37.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.750+0000 7f66aaffd700 1 --2- 172.21.15.1:0/1918523831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66ac0ad790 0x7f66ac1555c0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7f66ac1527a0 tx=0x7f66a40090f0).ready entity=mon.0 client_cookie=e0dc2761a7ce82d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:37.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.750+0000 7f66a9ffb700 1 -- 172.21.15.1:0/1918523831 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a400b520 con 0x7f66ac0ad790 2023-11-15T02:53:37.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.750+0000 7f66a9ffb700 1 -- 172.21.15.1:0/1918523831 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a400b680 con 0x7f66ac0ad790 2023-11-15T02:53:37.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.750+0000 7f66a9ffb700 1 -- 172.21.15.1:0/1918523831 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a400ba00 con 0x7f66ac0ad790 2023-11-15T02:53:37.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.750+0000 7f66b1486700 1 -- 172.21.15.1:0/1918523831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66ac0ad790 msgr2=0x7f66ac1555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:37.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.750+0000 7f66b1486700 1 --2- 172.21.15.1:0/1918523831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66ac0ad790 0x7f66ac1555c0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7f66ac1527a0 tx=0x7f66a40090f0).stop 2023-11-15T02:53:37.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.750+0000 7f66b1486700 1 -- 172.21.15.1:0/1918523831 shutdown_connections 2023-11-15T02:53:37.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.750+0000 7f66b1486700 1 --2- 172.21.15.1:0/1918523831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66ac0ad790 0x7f66ac1555c0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:37.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.750+0000 7f66b1486700 1 --2- 172.21.15.1:0/1918523831 >> v2:172.21.15.141:3300/0 conn(0x7f66ac158150 0x7f66ac0c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:37.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.750+0000 7f66b1486700 1 -- 172.21.15.1:0/1918523831 >> 172.21.15.1:0/1918523831 conn(0x7f66ac064a90 msgr2=0x7f66ac064ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:37.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.750+0000 7f66b1486700 1 -- 172.21.15.1:0/1918523831 shutdown_connections 2023-11-15T02:53:37.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.750+0000 7f66b1486700 1 -- 172.21.15.1:0/1918523831 wait complete. 2023-11-15T02:53:37.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.752+0000 7f66b1486700 1 Processor -- start 2023-11-15T02:53:37.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.752+0000 7f66b1486700 1 -- start start 2023-11-15T02:53:37.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.752+0000 7f66b1486700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66ac0ad790 0x7f66ac0c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:37.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.752+0000 7f66b1486700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66ac0c7e70 0x7f66ac143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:37.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.752+0000 7f66b1486700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66ac158150 0x7f66ac167e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:37.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.752+0000 7f66b1486700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac0c4800 con 0x7f66ac158150 2023-11-15T02:53:37.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.752+0000 7f66b1486700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac0ab390 con 0x7f66ac0c7e70 2023-11-15T02:53:37.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.752+0000 7f66b1486700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac0c30b0 con 0x7f66ac0ad790 2023-11-15T02:53:37.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.752+0000 7f66ab7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66ac158150 0x7f66ac167e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:37.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.752+0000 7f66ab7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66ac158150 0x7f66ac167e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59434/0 (socket says 172.21.15.1:59434) 2023-11-15T02:53:37.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.753+0000 7f66ab7fe700 1 -- 172.21.15.1:0/1944656524 learned_addr learned my addr 172.21.15.1:0/1944656524 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:37.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.753+0000 7f66aa7fc700 1 --2- 172.21.15.1:0/1944656524 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66ac0c7e70 0x7f66ac143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:37.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.753+0000 7f66aaffd700 1 --2- 172.21.15.1:0/1944656524 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66ac0ad790 0x7f66ac0c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:37.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.753+0000 7f66ab7fe700 1 -- 172.21.15.1:0/1944656524 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66ac0ad790 msgr2=0x7f66ac0c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:37.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.753+0000 7f66ab7fe700 1 --2- 172.21.15.1:0/1944656524 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66ac0ad790 0x7f66ac0c2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:37.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.753+0000 7f66ab7fe700 1 -- 172.21.15.1:0/1944656524 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66ac0c7e70 msgr2=0x7f66ac143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:37.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.753+0000 7f66ab7fe700 1 --2- 172.21.15.1:0/1944656524 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66ac0c7e70 0x7f66ac143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:37.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.753+0000 7f66ab7fe700 1 -- 172.21.15.1:0/1944656524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a4009370 con 0x7f66ac158150 2023-11-15T02:53:37.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.753+0000 7f66aa7fc700 1 --2- 172.21.15.1:0/1944656524 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66ac0c7e70 0x7f66ac143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:53:37.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.753+0000 7f66ab7fe700 1 --2- 172.21.15.1:0/1944656524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66ac158150 0x7f66ac167e40 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f669c00c790 tx=0x7f669c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:37.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.753+0000 7f66a2ffd700 1 -- 172.21.15.1:0/1944656524 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c00e4a0 con 0x7f66ac158150 2023-11-15T02:53:37.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.753+0000 7f66a2ffd700 1 -- 172.21.15.1:0/1944656524 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c00e600 con 0x7f66ac158150 2023-11-15T02:53:37.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.753+0000 7f66a2ffd700 1 -- 172.21.15.1:0/1944656524 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c00e980 con 0x7f66ac158150 2023-11-15T02:53:37.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.753+0000 7f66b1486700 1 -- 172.21.15.1:0/1944656524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ac0c4fd0 con 0x7f66ac158150 2023-11-15T02:53:37.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.753+0000 7f66b1486700 1 -- 172.21.15.1:0/1944656524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ac0c4cf0 con 0x7f66ac158150 2023-11-15T02:53:37.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.754+0000 7f66b1486700 1 -- 172.21.15.1:0/1944656524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ac0ab540 con 0x7f66ac158150 2023-11-15T02:53:37.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.755+0000 7f66a2ffd700 1 -- 172.21.15.1:0/1944656524 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f669c01b3b0 con 0x7f66ac158150 2023-11-15T02:53:37.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.755+0000 7f66a2ffd700 1 --2- 172.21.15.1:0/1944656524 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f668c05f270 0x7f668c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:37.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.755+0000 7f66a2ffd700 1 -- 172.21.15.1:0/1944656524 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f669c079b70 con 0x7f66ac158150 2023-11-15T02:53:37.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.755+0000 7f66aaffd700 1 --2- 172.21.15.1:0/1944656524 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f668c05f270 0x7f668c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:37.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.755+0000 7f66aaffd700 1 --2- 172.21.15.1:0/1944656524 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f668c05f270 0x7f668c061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f66a4009130 tx=0x7f66a4017000).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:37.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.759+0000 7f66a2ffd700 1 -- 172.21.15.1:0/1944656524 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f669c048af0 con 0x7f66ac158150 2023-11-15T02:53:37.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.976+0000 7f66b1486700 1 -- 172.21.15.1:0/1944656524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f66ac1442d0 con 0x7f66ac158150 2023-11-15T02:53:37.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.981+0000 7f66a2ffd700 1 -- 172.21.15.1:0/1944656524 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v83) v1 ==== 174+0+0 (secure 0 0 0) 0x7f66ac0ab540 con 0x7f66ac158150 2023-11-15T02:53:37.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.987+0000 7f66b1486700 1 -- 172.21.15.1:0/1944656524 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f668c05f270 msgr2=0x7f668c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:37.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.987+0000 7f66b1486700 1 --2- 172.21.15.1:0/1944656524 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f668c05f270 0x7f668c061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f66a4009130 tx=0x7f66a4017000).stop 2023-11-15T02:53:37.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.987+0000 7f66b1486700 1 -- 172.21.15.1:0/1944656524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66ac158150 msgr2=0x7f66ac167e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:37.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.987+0000 7f66b1486700 1 --2- 172.21.15.1:0/1944656524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66ac158150 0x7f66ac167e40 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f669c00c790 tx=0x7f669c0015e0).stop 2023-11-15T02:53:37.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.988+0000 7f66b1486700 1 -- 172.21.15.1:0/1944656524 shutdown_connections 2023-11-15T02:53:37.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.988+0000 7f66b1486700 1 --2- 172.21.15.1:0/1944656524 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f668c05f270 0x7f668c061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:37.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.988+0000 7f66b1486700 1 --2- 172.21.15.1:0/1944656524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66ac158150 0x7f66ac167e40 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:37.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.988+0000 7f66b1486700 1 --2- 172.21.15.1:0/1944656524 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66ac0ad790 0x7f66ac0c2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:37.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.988+0000 7f66b1486700 1 --2- 172.21.15.1:0/1944656524 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66ac0c7e70 0x7f66ac143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:37.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.988+0000 7f66b1486700 1 -- 172.21.15.1:0/1944656524 >> 172.21.15.1:0/1944656524 conn(0x7f66ac064a90 msgr2=0x7f66ac14fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:37.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.988+0000 7f66b1486700 1 -- 172.21.15.1:0/1944656524 shutdown_connections 2023-11-15T02:53:37.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:37.989+0000 7f66b1486700 1 -- 172.21.15.1:0/1944656524 wait complete. 2023-11-15T02:53:37.995 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 23 and data pool 24 2023-11-15T02:53:38.014 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:53:38.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.130+0000 7fc1cb236700 1 Processor -- start 2023-11-15T02:53:38.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.130+0000 7fc1cb236700 1 -- start start 2023-11-15T02:53:38.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.131+0000 7fc1cb236700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc1c4154450 0x7fc1c40a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.131+0000 7fc1cb236700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1c40be520 0x7fc1c4154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.131+0000 7fc1cb236700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c40a85e0 con 0x7fc1c40833a0 2023-11-15T02:53:38.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.131+0000 7fc1cb236700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c4065940 con 0x7fc1c4154450 2023-11-15T02:53:38.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.131+0000 7fc1cb236700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c4065660 con 0x7fc1c40be520 2023-11-15T02:53:38.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.131+0000 7fc1c8fd2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc1c4154450 0x7fc1c40a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.131+0000 7fc1c3fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc1c40833a0 0x7fc1c40bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57236/0 (socket says 172.21.15.1:57236) 2023-11-15T02:53:38.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.131+0000 7fc1c3fff700 1 -- 172.21.15.1:0/3230639267 learned_addr learned my addr 172.21.15.1:0/3230639267 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:38.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.131+0000 7fc1c97d3700 1 --2- 172.21.15.1:0/3230639267 >> v2:172.21.15.141:3300/0 conn(0x7fc1c40be520 0x7fc1c4154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1c8fd2700 1 -- 172.21.15.1:0/3230639267 >> v2:172.21.15.141:3300/0 conn(0x7fc1c40be520 msgr2=0x7fc1c4154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:38.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1c8fd2700 1 --2- 172.21.15.1:0/3230639267 >> v2:172.21.15.141:3300/0 conn(0x7fc1c40be520 0x7fc1c4154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1c8fd2700 1 -- 172.21.15.1:0/3230639267 >> v1:172.21.15.1:6789/0 conn(0x7fc1c40833a0 legacy=0x7fc1c40bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1c37fe700 1 -- 172.21.15.1:0/3230639267 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112203392 0 0) 0x7fc1c40a85e0 con 0x7fc1c40833a0 2023-11-15T02:53:38.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1c8fd2700 1 -- 172.21.15.1:0/3230639267 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c40c6f50 con 0x7fc1c4154450 2023-11-15T02:53:38.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1c8fd2700 1 --2- 172.21.15.1:0/3230639267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4154450 0x7fc1c40a7ef0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7fc1c406a610 tx=0x7fc1bc006f40).ready entity=mon.0 client_cookie=a84a14e98e2041cf server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:38.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1c37fe700 1 -- 172.21.15.1:0/3230639267 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc005880 con 0x7fc1c4154450 2023-11-15T02:53:38.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1c37fe700 1 -- 172.21.15.1:0/3230639267 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc0059e0 con 0x7fc1c4154450 2023-11-15T02:53:38.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1c37fe700 1 -- 172.21.15.1:0/3230639267 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc005d60 con 0x7fc1c4154450 2023-11-15T02:53:38.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1cb236700 1 -- 172.21.15.1:0/3230639267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4154450 msgr2=0x7fc1c40a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1cb236700 1 --2- 172.21.15.1:0/3230639267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4154450 0x7fc1c40a7ef0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7fc1c406a610 tx=0x7fc1bc006f40).stop 2023-11-15T02:53:38.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1cb236700 1 -- 172.21.15.1:0/3230639267 shutdown_connections 2023-11-15T02:53:38.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1cb236700 1 --2- 172.21.15.1:0/3230639267 >> v2:172.21.15.141:3300/0 conn(0x7fc1c40be520 0x7fc1c4154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1cb236700 1 --2- 172.21.15.1:0/3230639267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4154450 0x7fc1c40a7ef0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1cb236700 1 -- 172.21.15.1:0/3230639267 >> 172.21.15.1:0/3230639267 conn(0x7fc1c4082f90 msgr2=0x7fc1c40c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:38.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1cb236700 1 -- 172.21.15.1:0/3230639267 shutdown_connections 2023-11-15T02:53:38.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.132+0000 7fc1cb236700 1 -- 172.21.15.1:0/3230639267 wait complete. 2023-11-15T02:53:38.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.134+0000 7fc1cb236700 1 Processor -- start 2023-11-15T02:53:38.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.134+0000 7fc1cb236700 1 -- start start 2023-11-15T02:53:38.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1cb236700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1c40833a0 0x7fc1c4164ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1cb236700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1c40be520 0x7fc1c40a8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1cb236700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4154450 0x7fc1c4150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1cb236700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40ad070 con 0x7fc1c4154450 2023-11-15T02:53:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1cb236700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40a94c0 con 0x7fc1c40be520 2023-11-15T02:53:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1cb236700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40a97a0 con 0x7fc1c40833a0 2023-11-15T02:53:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1c97d3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4154450 0x7fc1c4150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1c97d3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4154450 0x7fc1c4150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59462/0 (socket says 172.21.15.1:59462) 2023-11-15T02:53:38.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1c97d3700 1 -- 172.21.15.1:0/3562646316 learned_addr learned my addr 172.21.15.1:0/3562646316 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:38.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1c3fff700 1 --2- 172.21.15.1:0/3562646316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1c40be520 0x7fc1c40a8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1c8fd2700 1 --2- 172.21.15.1:0/3562646316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1c40833a0 0x7fc1c4164ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1c97d3700 1 -- 172.21.15.1:0/3562646316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1c40833a0 msgr2=0x7fc1c4164ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1c97d3700 1 --2- 172.21.15.1:0/3562646316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1c40833a0 0x7fc1c4164ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1c97d3700 1 -- 172.21.15.1:0/3562646316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1c40be520 msgr2=0x7fc1c40a8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1c97d3700 1 --2- 172.21.15.1:0/3562646316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1c40be520 0x7fc1c40a8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1c97d3700 1 -- 172.21.15.1:0/3562646316 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc009250 con 0x7fc1c4154450 2023-11-15T02:53:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1c8fd2700 1 --2- 172.21.15.1:0/3562646316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1c40833a0 0x7fc1c4164ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1c97d3700 1 --2- 172.21.15.1:0/3562646316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4154450 0x7fc1c4150cf0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7fc1ac00d860 tx=0x7fc1ac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:38.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1c0ff9700 1 -- 172.21.15.1:0/3562646316 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac011590 con 0x7fc1c4154450 2023-11-15T02:53:38.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1c0ff9700 1 -- 172.21.15.1:0/3562646316 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac0116f0 con 0x7fc1c4154450 2023-11-15T02:53:38.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1cb236700 1 -- 172.21.15.1:0/3562646316 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c40a9a80 con 0x7fc1c4154450 2023-11-15T02:53:38.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1c0ff9700 1 -- 172.21.15.1:0/3562646316 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac011a70 con 0x7fc1c4154450 2023-11-15T02:53:38.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.135+0000 7fc1cb236700 1 -- 172.21.15.1:0/3562646316 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c40a9180 con 0x7fc1c4154450 2023-11-15T02:53:38.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.136+0000 7fc1cb236700 1 -- 172.21.15.1:0/3562646316 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c40ad220 con 0x7fc1c4154450 2023-11-15T02:53:38.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.137+0000 7fc1c0ff9700 1 -- 172.21.15.1:0/3562646316 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc1ac01c460 con 0x7fc1c4154450 2023-11-15T02:53:38.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.137+0000 7fc1c0ff9700 1 --2- 172.21.15.1:0/3562646316 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc1a405f270 0x7fc1a4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.137+0000 7fc1c0ff9700 1 -- 172.21.15.1:0/3562646316 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6645+0+0 (secure 0 0 0) 0x7fc1ac07a3b0 con 0x7fc1c4154450 2023-11-15T02:53:38.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.137+0000 7fc1c8fd2700 1 --2- 172.21.15.1:0/3562646316 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc1a405f270 0x7fc1a4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.138+0000 7fc1c8fd2700 1 --2- 172.21.15.1:0/3562646316 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc1a405f270 0x7fc1a4061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fc1bc006fa0 tx=0x7fc1bc016000).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.141+0000 7fc1c0ff9700 1 -- 172.21.15.1:0/3562646316 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc1c40ad220 con 0x7fc1c4154450 2023-11-15T02:53:38.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.316+0000 7fc1cb236700 1 -- 172.21.15.1:0/3562646316 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1c40ad1b0 con 0x7fc1c4154450 2023-11-15T02:53:38.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.317+0000 7fc1c0ff9700 1 -- 172.21.15.1:0/3562646316 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+17714 (secure 0 0 0) 0x7fc1ac04ecc0 con 0x7fc1c4154450 2023-11-15T02:53:38.319 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:38.320 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":195,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:53:37.977774+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:53:35.639437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-11-15T02:53:36.965896+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:53:38.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.319+0000 7fc1cb236700 1 -- 172.21.15.1:0/3562646316 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc1a405f270 msgr2=0x7fc1a4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.319+0000 7fc1cb236700 1 --2- 172.21.15.1:0/3562646316 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc1a405f270 0x7fc1a4061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fc1bc006fa0 tx=0x7fc1bc016000).stop 2023-11-15T02:53:38.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.319+0000 7fc1cb236700 1 -- 172.21.15.1:0/3562646316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4154450 msgr2=0x7fc1c4150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.319+0000 7fc1cb236700 1 --2- 172.21.15.1:0/3562646316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4154450 0x7fc1c4150cf0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7fc1ac00d860 tx=0x7fc1ac008040).stop 2023-11-15T02:53:38.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.319+0000 7fc1cb236700 1 -- 172.21.15.1:0/3562646316 shutdown_connections 2023-11-15T02:53:38.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.319+0000 7fc1cb236700 1 --2- 172.21.15.1:0/3562646316 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc1a405f270 0x7fc1a4061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.319+0000 7fc1cb236700 1 --2- 172.21.15.1:0/3562646316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1c4154450 0x7fc1c4150cf0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.319+0000 7fc1cb236700 1 --2- 172.21.15.1:0/3562646316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1c40833a0 0x7fc1c4164ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.319+0000 7fc1cb236700 1 --2- 172.21.15.1:0/3562646316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1c40be520 0x7fc1c40a8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.319+0000 7fc1cb236700 1 -- 172.21.15.1:0/3562646316 >> 172.21.15.1:0/3562646316 conn(0x7fc1c4082f90 msgr2=0x7fc1c40c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:38.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.319+0000 7fc1cb236700 1 -- 172.21.15.1:0/3562646316 shutdown_connections 2023-11-15T02:53:38.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.319+0000 7fc1cb236700 1 -- 172.21.15.1:0/3562646316 wait complete. 2023-11-15T02:53:38.334 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:53:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.451+0000 7f309d0a7700 1 Processor -- start 2023-11-15T02:53:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.451+0000 7f309d0a7700 1 -- start start 2023-11-15T02:53:38.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.452+0000 7f309d0a7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30980c9fc0 0x7f30980c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.452+0000 7f309d0a7700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30980c7980 con 0x7f3098151e10 2023-11-15T02:53:38.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.452+0000 7f309d0a7700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30980aa890 con 0x7f3098155530 2023-11-15T02:53:38.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.452+0000 7f309d0a7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30980c7bd0 con 0x7f30980c9fc0 2023-11-15T02:53:38.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.452+0000 7f3097fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3098151e10 0x7f30980aa0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57242/0 (socket says 172.21.15.1:57242) 2023-11-15T02:53:38.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.452+0000 7f3097fff700 1 -- 172.21.15.1:0/798509208 learned_addr learned my addr 172.21.15.1:0/798509208 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:38.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.452+0000 7f309c8a6700 1 --2- 172.21.15.1:0/798509208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30980c9fc0 0x7f30980c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.452+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475244109 0 0) 0x7f30980c7980 con 0x7f3098151e10 2023-11-15T02:53:38.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.452+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30840033f0 con 0x7f3098151e10 2023-11-15T02:53:38.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373883924 0 0) 0x7f30980aa890 con 0x7f3098155530 2023-11-15T02:53:38.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30980c7980 con 0x7f3098155530 2023-11-15T02:53:38.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 119691536 0 0) 0x7f30840033f0 con 0x7f3098151e10 2023-11-15T02:53:38.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30980c9fc0 msgr2=0x7f30980c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:38.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 --2- 172.21.15.1:0/798509208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30980c9fc0 0x7f30980c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 >> v1:172.21.15.141:6789/0 conn(0x7f3098155530 legacy=0x7f30980c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980c7eb0 con 0x7f3098151e10 2023-11-15T02:53:38.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f3088001470 con 0x7f3098151e10 2023-11-15T02:53:38.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 >> v1:172.21.15.1:6789/0 conn(0x7f3098151e10 legacy=0x7f30980aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 --2- 172.21.15.1:0/798509208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30980c9fc0 0x7f3084003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 --2- 172.21.15.1:0/798509208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3084003fb0 0x7f3084004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 --2- 172.21.15.1:0/798509208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3084004b80 0x7f3084005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30980c7bd0 con 0x7f3084003fb0 2023-11-15T02:53:38.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308400b990 con 0x7f3084004b80 2023-11-15T02:53:38.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308400bb50 con 0x7f30980c9fc0 2023-11-15T02:53:38.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f30977fe700 1 --2- 172.21.15.1:0/798509208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3084003fb0 0x7f3084004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3097fff700 1 --2- 172.21.15.1:0/798509208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30980c9fc0 0x7f3084003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f309c8a6700 1 --2- 172.21.15.1:0/798509208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3084004b80 0x7f3084005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f30977fe700 1 -- 172.21.15.1:0/798509208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30980c9fc0 msgr2=0x7f3084003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:38.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f30977fe700 1 --2- 172.21.15.1:0/798509208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30980c9fc0 0x7f3084003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f30977fe700 1 -- 172.21.15.1:0/798509208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3084004b80 msgr2=0x7f3084005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:38.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f30977fe700 1 --2- 172.21.15.1:0/798509208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3084004b80 0x7f3084005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f30977fe700 1 -- 172.21.15.1:0/798509208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30840033f0 con 0x7f3084003fb0 2023-11-15T02:53:38.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f30977fe700 1 --2- 172.21.15.1:0/798509208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3084003fb0 0x7f3084004690 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7f30800018d0 tx=0x7f3080007bb0).ready entity=mon.0 client_cookie=edeafd6a859e8677 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:38.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.453+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3080007020 con 0x7f3084003fb0 2023-11-15T02:53:38.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.454+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3080007180 con 0x7f3084003fb0 2023-11-15T02:53:38.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.454+0000 7f3096ffd700 1 -- 172.21.15.1:0/798509208 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3080007500 con 0x7f3084003fb0 2023-11-15T02:53:38.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.454+0000 7f309d0a7700 1 -- 172.21.15.1:0/798509208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3084003fb0 msgr2=0x7f3084004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.454+0000 7f309d0a7700 1 --2- 172.21.15.1:0/798509208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3084003fb0 0x7f3084004690 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7f30800018d0 tx=0x7f3080007bb0).stop 2023-11-15T02:53:38.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.454+0000 7f309c8a6700 1 -- 172.21.15.1:0/798509208 reap_dead start 2023-11-15T02:53:38.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.454+0000 7f309d0a7700 1 -- 172.21.15.1:0/798509208 shutdown_connections 2023-11-15T02:53:38.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.454+0000 7f309d0a7700 1 -- 172.21.15.1:0/798509208 >> 172.21.15.1:0/798509208 conn(0x7f30980947e0 msgr2=0x7f309806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:38.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.454+0000 7f309d0a7700 1 -- 172.21.15.1:0/798509208 shutdown_connections 2023-11-15T02:53:38.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.454+0000 7f309d0a7700 1 -- 172.21.15.1:0/798509208 wait complete. 2023-11-15T02:53:38.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.455+0000 7f309d0a7700 1 Processor -- start 2023-11-15T02:53:38.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.455+0000 7f309d0a7700 1 -- start start 2023-11-15T02:53:38.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.456+0000 7f309d0a7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3084003fb0 0x7f30980aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.456+0000 7f309d0a7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309814dca0 0x7f309814d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.456+0000 7f309d0a7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30981531c0 0x7f3098153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.456+0000 7f309d0a7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3098153b30 con 0x7f309814dca0 2023-11-15T02:53:38.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.456+0000 7f309d0a7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30980ab9e0 con 0x7f3084003fb0 2023-11-15T02:53:38.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.456+0000 7f309d0a7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30980abcc0 con 0x7f30981531c0 2023-11-15T02:53:38.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.456+0000 7f30977fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309814dca0 0x7f309814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.456+0000 7f30977fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309814dca0 0x7f309814d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59490/0 (socket says 172.21.15.1:59490) 2023-11-15T02:53:38.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.456+0000 7f30977fe700 1 -- 172.21.15.1:0/1735309157 learned_addr learned my addr 172.21.15.1:0/1735309157 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:38.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.456+0000 7f3097fff700 1 --2- 172.21.15.1:0/1735309157 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3084003fb0 0x7f30980aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.456+0000 7f30977fe700 1 -- 172.21.15.1:0/1735309157 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30981531c0 msgr2=0x7f3098153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.456+0000 7f309c8a6700 1 --2- 172.21.15.1:0/1735309157 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30981531c0 0x7f3098153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.473 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.456+0000 7f30977fe700 1 --2- 172.21.15.1:0/1735309157 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30981531c0 0x7f3098153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.473 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.456+0000 7f30977fe700 1 -- 172.21.15.1:0/1735309157 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3084003fb0 msgr2=0x7f30980aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.473 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.457+0000 7f30977fe700 1 --2- 172.21.15.1:0/1735309157 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3084003fb0 0x7f30980aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.473 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.457+0000 7f30977fe700 1 -- 172.21.15.1:0/1735309157 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980abfa0 con 0x7f309814dca0 2023-11-15T02:53:38.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.457+0000 7f3097fff700 1 --2- 172.21.15.1:0/1735309157 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3084003fb0 0x7f30980aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:38.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.457+0000 7f30977fe700 1 --2- 172.21.15.1:0/1735309157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309814dca0 0x7f309814d500 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f308000c0e0 tx=0x7f3080016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:38.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.457+0000 7f308ffff700 1 -- 172.21.15.1:0/1735309157 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3080007020 con 0x7f309814dca0 2023-11-15T02:53:38.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.457+0000 7f308ffff700 1 -- 172.21.15.1:0/1735309157 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3080012610 con 0x7f309814dca0 2023-11-15T02:53:38.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.457+0000 7f308ffff700 1 -- 172.21.15.1:0/1735309157 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3080012990 con 0x7f309814dca0 2023-11-15T02:53:38.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.457+0000 7f309d0a7700 1 -- 172.21.15.1:0/1735309157 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30980ac280 con 0x7f309814dca0 2023-11-15T02:53:38.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.457+0000 7f309d0a7700 1 -- 172.21.15.1:0/1735309157 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309814d9f0 con 0x7f309814dca0 2023-11-15T02:53:38.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.458+0000 7f309d0a7700 1 -- 172.21.15.1:0/1735309157 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30980475e0 con 0x7f309814dca0 2023-11-15T02:53:38.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.458+0000 7f308ffff700 1 -- 172.21.15.1:0/1735309157 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f308001d440 con 0x7f309814dca0 2023-11-15T02:53:38.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.459+0000 7f308ffff700 1 --2- 172.21.15.1:0/1735309157 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f307805f270 0x7f3078061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.459+0000 7f308ffff700 1 -- 172.21.15.1:0/1735309157 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f308007b430 con 0x7f309814dca0 2023-11-15T02:53:38.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.459+0000 7f3097fff700 1 --2- 172.21.15.1:0/1735309157 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f307805f270 0x7f3078061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.459+0000 7f3097fff700 1 --2- 172.21.15.1:0/1735309157 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f307805f270 0x7f3078061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3088001c80 tx=0x7f3088009040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:38.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.463+0000 7f308ffff700 1 -- 172.21.15.1:0/1735309157 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f308004c380 con 0x7f309814dca0 2023-11-15T02:53:38.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.635+0000 7f309d0a7700 1 -- 172.21.15.1:0/1735309157 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3098060900 con 0x7f309814dca0 2023-11-15T02:53:38.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.636+0000 7f308ffff700 1 -- 172.21.15.1:0/1735309157 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+17714 (secure 0 0 0) 0x7f3080022020 con 0x7f309814dca0 2023-11-15T02:53:38.639 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:38.639 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":195,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:53:37.977774+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:53:35.639437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-11-15T02:53:36.965896+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:53:38.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.638+0000 7f309d0a7700 1 -- 172.21.15.1:0/1735309157 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f307805f270 msgr2=0x7f3078061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.638+0000 7f309d0a7700 1 --2- 172.21.15.1:0/1735309157 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f307805f270 0x7f3078061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3088001c80 tx=0x7f3088009040).stop 2023-11-15T02:53:38.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.638+0000 7f309d0a7700 1 -- 172.21.15.1:0/1735309157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309814dca0 msgr2=0x7f309814d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.638+0000 7f309d0a7700 1 --2- 172.21.15.1:0/1735309157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309814dca0 0x7f309814d500 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f308000c0e0 tx=0x7f3080016000).stop 2023-11-15T02:53:38.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.638+0000 7f309d0a7700 1 -- 172.21.15.1:0/1735309157 shutdown_connections 2023-11-15T02:53:38.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.638+0000 7f309d0a7700 1 --2- 172.21.15.1:0/1735309157 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f307805f270 0x7f3078061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.638+0000 7f309d0a7700 1 --2- 172.21.15.1:0/1735309157 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30981531c0 0x7f3098153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.638+0000 7f309d0a7700 1 --2- 172.21.15.1:0/1735309157 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3084003fb0 0x7f30980aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.638+0000 7f309d0a7700 1 --2- 172.21.15.1:0/1735309157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309814dca0 0x7f309814d500 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.638+0000 7f309d0a7700 1 -- 172.21.15.1:0/1735309157 >> 172.21.15.1:0/1735309157 conn(0x7f30980947e0 msgr2=0x7f3098151100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:38.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.638+0000 7f309d0a7700 1 -- 172.21.15.1:0/1735309157 shutdown_connections 2023-11-15T02:53:38.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.638+0000 7f309d0a7700 1 -- 172.21.15.1:0/1735309157 wait complete. 2023-11-15T02:53:38.653 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-15T02:53:38.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.772+0000 7f85e3bac700 1 Processor -- start 2023-11-15T02:53:38.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.773+0000 7f85e3bac700 1 -- start start 2023-11-15T02:53:38.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.773+0000 7f85e3bac700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f85dc1540a0 0x7f85dc0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.773+0000 7f85e3bac700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85dc0ca050 con 0x7f85dc0c6650 2023-11-15T02:53:38.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.773+0000 7f85e3bac700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85dc0c9440 con 0x7f85dc154480 2023-11-15T02:53:38.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.773+0000 7f85e3bac700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85dc0c9720 con 0x7f85dc1540a0 2023-11-15T02:53:38.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.774+0000 7f85e1948700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f85dc1540a0 0x7f85dc0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.774+0000 7f85e1948700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f85dc1540a0 0x7f85dc0ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59498/0 (socket says 172.21.15.1:59498) 2023-11-15T02:53:38.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.774+0000 7f85e2149700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f85dc0c6650 0x7f85dc0aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57244/0 (socket says 172.21.15.1:57244) 2023-11-15T02:53:38.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.774+0000 7f85e1948700 1 -- 172.21.15.1:0/3633423773 learned_addr learned my addr 172.21.15.1:0/3633423773 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:38.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.774+0000 7f85e1948700 1 -- 172.21.15.1:0/3633423773 >> v1:172.21.15.141:6789/0 conn(0x7f85dc154480 legacy=0x7f85dc0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.774+0000 7f85e1948700 1 -- 172.21.15.1:0/3633423773 >> v1:172.21.15.1:6789/0 conn(0x7f85dc0c6650 legacy=0x7f85dc0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.774+0000 7f85e1948700 1 -- 172.21.15.1:0/3633423773 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc0c9a00 con 0x7f85dc1540a0 2023-11-15T02:53:38.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.774+0000 7f85e1948700 1 --2- 172.21.15.1:0/3633423773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85dc1540a0 0x7f85dc0ca4e0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f85d4006fd0 tx=0x7f85d40090f0).ready entity=mon.0 client_cookie=3e4e62fe1f519c47 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.774+0000 7f85e0946700 1 -- 172.21.15.1:0/3633423773 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d400b600 con 0x7f85dc1540a0 2023-11-15T02:53:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.774+0000 7f85e0946700 1 -- 172.21.15.1:0/3633423773 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d400b760 con 0x7f85dc1540a0 2023-11-15T02:53:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.774+0000 7f85e0946700 1 -- 172.21.15.1:0/3633423773 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d400bae0 con 0x7f85dc1540a0 2023-11-15T02:53:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.775+0000 7f85e3bac700 1 -- 172.21.15.1:0/3633423773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85dc1540a0 msgr2=0x7f85dc0ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.775+0000 7f85e3bac700 1 --2- 172.21.15.1:0/3633423773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85dc1540a0 0x7f85dc0ca4e0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f85d4006fd0 tx=0x7f85d40090f0).stop 2023-11-15T02:53:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.775+0000 7f85e3bac700 1 -- 172.21.15.1:0/3633423773 shutdown_connections 2023-11-15T02:53:38.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.775+0000 7f85e3bac700 1 --2- 172.21.15.1:0/3633423773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85dc1540a0 0x7f85dc0ca4e0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.775+0000 7f85e3bac700 1 -- 172.21.15.1:0/3633423773 >> 172.21.15.1:0/3633423773 conn(0x7f85dc064a70 msgr2=0x7f85dc064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:38.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.775+0000 7f85e3bac700 1 -- 172.21.15.1:0/3633423773 shutdown_connections 2023-11-15T02:53:38.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.775+0000 7f85e3bac700 1 -- 172.21.15.1:0/3633423773 wait complete. 2023-11-15T02:53:38.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.776+0000 7f85e3bac700 1 Processor -- start 2023-11-15T02:53:38.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.776+0000 7f85e3bac700 1 -- start start 2023-11-15T02:53:38.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e3bac700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f85dc0c6650 0x7f85dc14f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e3bac700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85dc1540a0 0x7f85dc157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e3bac700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85dc154480 0x7f85dc15a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e3bac700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc159330 con 0x7f85dc154480 2023-11-15T02:53:38.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e3bac700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc159610 con 0x7f85dc1540a0 2023-11-15T02:53:38.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e3bac700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc1598f0 con 0x7f85dc0c6650 2023-11-15T02:53:38.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e2149700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85dc154480 0x7f85dc15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e2149700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85dc154480 0x7f85dc15a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59512/0 (socket says 172.21.15.1:59512) 2023-11-15T02:53:38.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e2149700 1 -- 172.21.15.1:0/863164533 learned_addr learned my addr 172.21.15.1:0/863164533 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:38.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e1147700 1 --2- 172.21.15.1:0/863164533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85dc1540a0 0x7f85dc157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e1948700 1 --2- 172.21.15.1:0/863164533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f85dc0c6650 0x7f85dc14f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e2149700 1 -- 172.21.15.1:0/863164533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f85dc0c6650 msgr2=0x7f85dc14f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e2149700 1 --2- 172.21.15.1:0/863164533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f85dc0c6650 0x7f85dc14f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e2149700 1 -- 172.21.15.1:0/863164533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85dc1540a0 msgr2=0x7f85dc157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:38.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e2149700 1 --2- 172.21.15.1:0/863164533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85dc1540a0 0x7f85dc157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:38.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e2149700 1 -- 172.21.15.1:0/863164533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d4009370 con 0x7f85dc154480 2023-11-15T02:53:38.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e1948700 1 --2- 172.21.15.1:0/863164533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f85dc0c6650 0x7f85dc14f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:53:38.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85e2149700 1 --2- 172.21.15.1:0/863164533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85dc154480 0x7f85dc15a560 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f85cc00c7c0 tx=0x7f85cc001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:38.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85d9ffb700 1 -- 172.21.15.1:0/863164533 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc005c70 con 0x7f85dc154480 2023-11-15T02:53:38.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85d9ffb700 1 -- 172.21.15.1:0/863164533 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc005dd0 con 0x7f85dc154480 2023-11-15T02:53:38.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.777+0000 7f85d9ffb700 1 -- 172.21.15.1:0/863164533 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc007320 con 0x7f85dc154480 2023-11-15T02:53:38.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.778+0000 7f85e3bac700 1 -- 172.21.15.1:0/863164533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85dc159bd0 con 0x7f85dc154480 2023-11-15T02:53:38.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.778+0000 7f85e3bac700 1 -- 172.21.15.1:0/863164533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85dc151470 con 0x7f85dc154480 2023-11-15T02:53:38.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.779+0000 7f85e3bac700 1 -- 172.21.15.1:0/863164533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85dc06c7e0 con 0x7f85dc154480 2023-11-15T02:53:38.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.779+0000 7f85d9ffb700 1 -- 172.21.15.1:0/863164533 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f85cc0076d0 con 0x7f85dc154480 2023-11-15T02:53:38.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.779+0000 7f85d9ffb700 1 --2- 172.21.15.1:0/863164533 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f85c805f270 0x7f85c8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:38.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.779+0000 7f85d9ffb700 1 -- 172.21.15.1:0/863164533 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f85cc07a4d0 con 0x7f85dc154480 2023-11-15T02:53:38.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.779+0000 7f85e1948700 1 --2- 172.21.15.1:0/863164533 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f85c805f270 0x7f85c8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:38.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.780+0000 7f85e1948700 1 --2- 172.21.15.1:0/863164533 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f85c805f270 0x7f85c8061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f85d4009130 tx=0x7f85d4017000).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:38.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:38.783+0000 7f85d9ffb700 1 -- 172.21.15.1:0/863164533 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f85cc04b410 con 0x7f85dc154480 2023-11-15T02:53:39.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:39.000+0000 7f85e3bac700 1 -- 172.21.15.1:0/863164533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f85dc0c9ce0 con 0x7f85dc154480 2023-11-15T02:53:39.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:39.995+0000 7f85d9ffb700 1 -- 172.21.15.1:0/863164533 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v86) v1 ==== 118+0+0 (secure 0 0 0) 0x7f85cc04ea30 con 0x7f85dc154480 2023-11-15T02:53:40.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:39.998+0000 7f85e3bac700 1 -- 172.21.15.1:0/863164533 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f85c805f270 msgr2=0x7f85c8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:40.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:39.998+0000 7f85e3bac700 1 --2- 172.21.15.1:0/863164533 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f85c805f270 0x7f85c8061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f85d4009130 tx=0x7f85d4017000).stop 2023-11-15T02:53:40.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:39.998+0000 7f85e3bac700 1 -- 172.21.15.1:0/863164533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85dc154480 msgr2=0x7f85dc15a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:40.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:39.998+0000 7f85e3bac700 1 --2- 172.21.15.1:0/863164533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85dc154480 0x7f85dc15a560 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f85cc00c7c0 tx=0x7f85cc001530).stop 2023-11-15T02:53:40.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:39.998+0000 7f85e3bac700 1 -- 172.21.15.1:0/863164533 shutdown_connections 2023-11-15T02:53:40.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:39.998+0000 7f85e3bac700 1 --2- 172.21.15.1:0/863164533 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f85c805f270 0x7f85c8061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:40.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:39.998+0000 7f85e3bac700 1 --2- 172.21.15.1:0/863164533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85dc154480 0x7f85dc15a560 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:40.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:39.998+0000 7f85e3bac700 1 --2- 172.21.15.1:0/863164533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f85dc0c6650 0x7f85dc14f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:40.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:39.998+0000 7f85e3bac700 1 --2- 172.21.15.1:0/863164533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85dc1540a0 0x7f85dc157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:40.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:39.998+0000 7f85e3bac700 1 -- 172.21.15.1:0/863164533 >> 172.21.15.1:0/863164533 conn(0x7f85dc064a70 msgr2=0x7f85dc0ab6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:40.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:39.998+0000 7f85e3bac700 1 -- 172.21.15.1:0/863164533 shutdown_connections 2023-11-15T02:53:40.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:39.998+0000 7f85e3bac700 1 -- 172.21.15.1:0/863164533 wait complete. 2023-11-15T02:53:40.015 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-15T02:53:40.015 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-15T02:53:40.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.141+0000 7f30f8eea700 1 Processor -- start 2023-11-15T02:53:40.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.141+0000 7f30f8eea700 1 -- start start 2023-11-15T02:53:40.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.142+0000 7f30f8eea700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f30f40c3e30 0x7f30f40c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:40.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.142+0000 7f30f8eea700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f30f4069ba0 0x7f30f4154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:40.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.142+0000 7f30f8eea700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30f4066cd0 0x7f30f4067160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:40.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.142+0000 7f30f8eea700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f4155bc0 con 0x7f30f40c3e30 2023-11-15T02:53:40.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.142+0000 7f30f8eea700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f41550e0 con 0x7f30f4069ba0 2023-11-15T02:53:40.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.142+0000 7f30f8eea700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f406a020 con 0x7f30f4066cd0 2023-11-15T02:53:40.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.142+0000 7f30f259c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f30f40c3e30 0x7f30f40c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:40.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.142+0000 7f30f259c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f30f40c3e30 0x7f30f40c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59516/0 (socket says 172.21.15.1:59516) 2023-11-15T02:53:40.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.142+0000 7f30f259c700 1 -- 172.21.15.1:0/3332094696 learned_addr learned my addr 172.21.15.1:0/3332094696 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:40.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.143+0000 7f30f2d9d700 1 --2- 172.21.15.1:0/3332094696 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30f4066cd0 0x7f30f4067160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:40.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.143+0000 7f30f1d9b700 1 --2- 172.21.15.1:0/3332094696 >> v2:172.21.15.141:3300/0 conn(0x7f30f4069ba0 0x7f30f4154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:40.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.143+0000 7f30f259c700 1 -- 172.21.15.1:0/3332094696 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30f4066cd0 msgr2=0x7f30f4067160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:40.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.143+0000 7f30f259c700 1 --2- 172.21.15.1:0/3332094696 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30f4066cd0 0x7f30f4067160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:40.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.143+0000 7f30f259c700 1 -- 172.21.15.1:0/3332094696 >> v2:172.21.15.141:3300/0 conn(0x7f30f4069ba0 msgr2=0x7f30f4154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:40.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.143+0000 7f30f259c700 1 --2- 172.21.15.1:0/3332094696 >> v2:172.21.15.141:3300/0 conn(0x7f30f4069ba0 0x7f30f4154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:40.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.143+0000 7f30f259c700 1 -- 172.21.15.1:0/3332094696 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f4155320 con 0x7f30f40c3e30 2023-11-15T02:53:40.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.143+0000 7f30f259c700 1 --2- 172.21.15.1:0/3332094696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30f40c3e30 0x7f30f40c4210 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f30f40c8e30 tx=0x7f30e40090f0).ready entity=mon.0 client_cookie=69abba276be7ba8e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:40.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.143+0000 7f30f159a700 1 -- 172.21.15.1:0/3332094696 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e400b600 con 0x7f30f40c3e30 2023-11-15T02:53:40.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.143+0000 7f30f159a700 1 -- 172.21.15.1:0/3332094696 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e400b760 con 0x7f30f40c3e30 2023-11-15T02:53:40.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.143+0000 7f30f159a700 1 -- 172.21.15.1:0/3332094696 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e400bae0 con 0x7f30f40c3e30 2023-11-15T02:53:40.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.143+0000 7f30f8eea700 1 -- 172.21.15.1:0/3332094696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30f40c3e30 msgr2=0x7f30f40c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:40.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.143+0000 7f30f8eea700 1 --2- 172.21.15.1:0/3332094696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30f40c3e30 0x7f30f40c4210 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f30f40c8e30 tx=0x7f30e40090f0).stop 2023-11-15T02:53:40.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.144+0000 7f30f8eea700 1 -- 172.21.15.1:0/3332094696 shutdown_connections 2023-11-15T02:53:40.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.144+0000 7f30f8eea700 1 --2- 172.21.15.1:0/3332094696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30f40c3e30 0x7f30f40c4210 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:40.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.144+0000 7f30f8eea700 1 --2- 172.21.15.1:0/3332094696 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30f4066cd0 0x7f30f4067160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:40.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.144+0000 7f30f8eea700 1 --2- 172.21.15.1:0/3332094696 >> v2:172.21.15.141:3300/0 conn(0x7f30f4069ba0 0x7f30f4154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:40.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.144+0000 7f30f8eea700 1 -- 172.21.15.1:0/3332094696 >> 172.21.15.1:0/3332094696 conn(0x7f30f40c7dc0 msgr2=0x7f30f40c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:40.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.144+0000 7f30f8eea700 1 -- 172.21.15.1:0/3332094696 shutdown_connections 2023-11-15T02:53:40.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.144+0000 7f30f8eea700 1 -- 172.21.15.1:0/3332094696 wait complete. 2023-11-15T02:53:40.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.145+0000 7f30f8eea700 1 Processor -- start 2023-11-15T02:53:40.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.145+0000 7f30f8eea700 1 -- start start 2023-11-15T02:53:40.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.145+0000 7f30f8eea700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30f4066cd0 0x7f30f40c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:40.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.145+0000 7f30f8eea700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30f4069ba0 0x7f30f414ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:40.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.145+0000 7f30f8eea700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30f40c3e30 0x7f30f40bee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:40.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.145+0000 7f30f8eea700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f41504b0 con 0x7f30f4069ba0 2023-11-15T02:53:40.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.145+0000 7f30f8eea700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f40c1800 con 0x7f30f4066cd0 2023-11-15T02:53:40.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30f8eea700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f40c0950 con 0x7f30f40c3e30 2023-11-15T02:53:40.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30f1d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30f4069ba0 0x7f30f414ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:40.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30f1d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30f4069ba0 0x7f30f414ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59524/0 (socket says 172.21.15.1:59524) 2023-11-15T02:53:40.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30f1d9b700 1 -- 172.21.15.1:0/2862638678 learned_addr learned my addr 172.21.15.1:0/2862638678 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:40.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30f2d9d700 1 --2- 172.21.15.1:0/2862638678 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30f40c3e30 0x7f30f40bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:40.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30f259c700 1 --2- 172.21.15.1:0/2862638678 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30f4066cd0 0x7f30f40c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:40.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30f1d9b700 1 -- 172.21.15.1:0/2862638678 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30f40c3e30 msgr2=0x7f30f40bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:40.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30f1d9b700 1 --2- 172.21.15.1:0/2862638678 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30f40c3e30 0x7f30f40bee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:40.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30f1d9b700 1 -- 172.21.15.1:0/2862638678 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30f4066cd0 msgr2=0x7f30f40c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:40.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30f1d9b700 1 --2- 172.21.15.1:0/2862638678 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30f4066cd0 0x7f30f40c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:40.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30f1d9b700 1 -- 172.21.15.1:0/2862638678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e4009370 con 0x7f30f4069ba0 2023-11-15T02:53:40.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30f2d9d700 1 --2- 172.21.15.1:0/2862638678 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30f40c3e30 0x7f30f40bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:53:40.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30f1d9b700 1 --2- 172.21.15.1:0/2862638678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30f4069ba0 0x7f30f414ffc0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f30e800d890 tx=0x7f30e8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:40.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30e27fc700 1 -- 172.21.15.1:0/2862638678 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e80125f0 con 0x7f30f4069ba0 2023-11-15T02:53:40.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30e27fc700 1 -- 172.21.15.1:0/2862638678 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8012750 con 0x7f30f4069ba0 2023-11-15T02:53:40.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30e27fc700 1 -- 172.21.15.1:0/2862638678 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8012ad0 con 0x7f30f4069ba0 2023-11-15T02:53:40.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30f8eea700 1 -- 172.21.15.1:0/2862638678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f40c0bf0 con 0x7f30f4069ba0 2023-11-15T02:53:40.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.146+0000 7f30f8eea700 1 -- 172.21.15.1:0/2862638678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f40c11b0 con 0x7f30f4069ba0 2023-11-15T02:53:40.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.147+0000 7f30f8eea700 1 -- 172.21.15.1:0/2862638678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f40c19b0 con 0x7f30f4069ba0 2023-11-15T02:53:40.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.148+0000 7f30e27fc700 1 -- 172.21.15.1:0/2862638678 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f30e8013480 con 0x7f30f4069ba0 2023-11-15T02:53:40.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.148+0000 7f30e27fc700 1 --2- 172.21.15.1:0/2862638678 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f30d405f270 0x7f30d4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:40.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.148+0000 7f30e27fc700 1 -- 172.21.15.1:0/2862638678 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f30e807a6b0 con 0x7f30f4069ba0 2023-11-15T02:53:40.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.148+0000 7f30f259c700 1 --2- 172.21.15.1:0/2862638678 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f30d405f270 0x7f30d4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:40.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.149+0000 7f30f259c700 1 --2- 172.21.15.1:0/2862638678 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f30d405f270 0x7f30d4061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f30e4009130 tx=0x7f30e4017000).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:40.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.154+0000 7f30e27fc700 1 -- 172.21.15.1:0/2862638678 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f30f40c19b0 con 0x7f30f4069ba0 2023-11-15T02:53:40.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.372+0000 7f30f8eea700 1 -- 172.21.15.1:0/2862638678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f30f40c19b0 con 0x7f30f4069ba0 2023-11-15T02:53:41.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:40.999+0000 7f30e27fc700 1 -- 172.21.15.1:0/2862638678 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v87) v1 ==== 122+0+0 (secure 0 0 0) 0x7f30f40c19b0 con 0x7f30f4069ba0 2023-11-15T02:53:41.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.002+0000 7f30f8eea700 1 -- 172.21.15.1:0/2862638678 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f30d405f270 msgr2=0x7f30d4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.002+0000 7f30f8eea700 1 --2- 172.21.15.1:0/2862638678 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f30d405f270 0x7f30d4061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f30e4009130 tx=0x7f30e4017000).stop 2023-11-15T02:53:41.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.002+0000 7f30f8eea700 1 -- 172.21.15.1:0/2862638678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30f4069ba0 msgr2=0x7f30f414ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.002+0000 7f30f8eea700 1 --2- 172.21.15.1:0/2862638678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30f4069ba0 0x7f30f414ffc0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f30e800d890 tx=0x7f30e8008040).stop 2023-11-15T02:53:41.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.002+0000 7f30f8eea700 1 -- 172.21.15.1:0/2862638678 shutdown_connections 2023-11-15T02:53:41.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.002+0000 7f30f8eea700 1 --2- 172.21.15.1:0/2862638678 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f30d405f270 0x7f30d4061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.002+0000 7f30f8eea700 1 --2- 172.21.15.1:0/2862638678 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30f40c3e30 0x7f30f40bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.002+0000 7f30f8eea700 1 --2- 172.21.15.1:0/2862638678 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30f4066cd0 0x7f30f40c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.002+0000 7f30f8eea700 1 --2- 172.21.15.1:0/2862638678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30f4069ba0 0x7f30f414ffc0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.002+0000 7f30f8eea700 1 -- 172.21.15.1:0/2862638678 >> 172.21.15.1:0/2862638678 conn(0x7f30f40c7dc0 msgr2=0x7f30f40c4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:41.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.002+0000 7f30f8eea700 1 -- 172.21.15.1:0/2862638678 shutdown_connections 2023-11-15T02:53:41.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.002+0000 7f30f8eea700 1 -- 172.21.15.1:0/2862638678 wait complete. 2023-11-15T02:53:41.018 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-15T02:53:41.019 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:53:41.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.141+0000 7f6870d1b700 1 Processor -- start 2023-11-15T02:53:41.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.141+0000 7f6870d1b700 1 -- start start 2023-11-15T02:53:41.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.142+0000 7f6870d1b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f686c154150 0x7f686c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.142+0000 7f6870d1b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686c0c06f0 con 0x7f686c0aa060 2023-11-15T02:53:41.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.142+0000 7f6870d1b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686c0c09d0 con 0x7f686c0ab1a0 2023-11-15T02:53:41.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.142+0000 7f6870d1b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f686c158820 con 0x7f686c154150 2023-11-15T02:53:41.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686ad9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f686c0aa060 0x7f686c0c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57260/0 (socket says 172.21.15.1:57260) 2023-11-15T02:53:41.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686ad9d700 1 -- 172.21.15.1:0/1543338962 learned_addr learned my addr 172.21.15.1:0/1543338962 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:41.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686a59c700 1 --2- 172.21.15.1:0/1543338962 >> v2:172.21.15.141:3300/0 conn(0x7f686c154150 0x7f686c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686959a700 1 -- 172.21.15.1:0/1543338962 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811169458 0 0) 0x7f686c0c06f0 con 0x7f686c0aa060 2023-11-15T02:53:41.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686959a700 1 -- 172.21.15.1:0/1543338962 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68580033f0 con 0x7f686c0aa060 2023-11-15T02:53:41.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686959a700 1 -- 172.21.15.1:0/1543338962 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2839009535 0 0) 0x7f68580033f0 con 0x7f686c0aa060 2023-11-15T02:53:41.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686959a700 1 -- 172.21.15.1:0/1543338962 >> v2:172.21.15.141:3300/0 conn(0x7f686c154150 msgr2=0x7f686c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:41.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686959a700 1 --2- 172.21.15.1:0/1543338962 >> v2:172.21.15.141:3300/0 conn(0x7f686c154150 0x7f686c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686959a700 1 -- 172.21.15.1:0/1543338962 >> v1:172.21.15.141:6789/0 conn(0x7f686c0ab1a0 legacy=0x7f686c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686959a700 1 -- 172.21.15.1:0/1543338962 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c158b00 con 0x7f686c0aa060 2023-11-15T02:53:41.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686959a700 1 -- 172.21.15.1:0/1543338962 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f685c0017f0 con 0x7f686c0aa060 2023-11-15T02:53:41.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686959a700 1 -- 172.21.15.1:0/1543338962 >> v1:172.21.15.1:6789/0 conn(0x7f686c0aa060 legacy=0x7f686c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686959a700 1 --2- 172.21.15.1:0/1543338962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68580038e0 0x7f6858003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686959a700 1 --2- 172.21.15.1:0/1543338962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6858004690 0x7f6858004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686959a700 1 --2- 172.21.15.1:0/1543338962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6858005050 0x7f685800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686959a700 1 -- 172.21.15.1:0/1543338962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c158820 con 0x7f6858005050 2023-11-15T02:53:41.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686959a700 1 -- 172.21.15.1:0/1543338962 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685800bfe0 con 0x7f6858004690 2023-11-15T02:53:41.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686959a700 1 -- 172.21.15.1:0/1543338962 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685800c1a0 con 0x7f68580038e0 2023-11-15T02:53:41.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f686ad9d700 1 --2- 172.21.15.1:0/1543338962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6858005050 0x7f685800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.143+0000 7f6869d9b700 1 --2- 172.21.15.1:0/1543338962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6858004690 0x7f6858004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.144+0000 7f686a59c700 1 --2- 172.21.15.1:0/1543338962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68580038e0 0x7f6858003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.144+0000 7f686ad9d700 1 -- 172.21.15.1:0/1543338962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68580038e0 msgr2=0x7f6858003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.144+0000 7f686ad9d700 1 --2- 172.21.15.1:0/1543338962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68580038e0 0x7f6858003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.144+0000 7f686ad9d700 1 -- 172.21.15.1:0/1543338962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6858004690 msgr2=0x7f6858004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:41.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.144+0000 7f686ad9d700 1 --2- 172.21.15.1:0/1543338962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6858004690 0x7f6858004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.144+0000 7f686ad9d700 1 -- 172.21.15.1:0/1543338962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68580033f0 con 0x7f6858005050 2023-11-15T02:53:41.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.144+0000 7f686a59c700 1 --2- 172.21.15.1:0/1543338962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68580038e0 0x7f6858003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:53:41.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.144+0000 7f686ad9d700 1 -- 172.21.15.1:0/1543338962 reap_dead start 2023-11-15T02:53:41.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.144+0000 7f686ad9d700 1 --2- 172.21.15.1:0/1543338962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6858005050 0x7f685800b8e0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f685c00c450 tx=0x7f685c00c760).ready entity=mon.0 client_cookie=2104f3ad9420ddd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:41.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.144+0000 7f686959a700 1 -- 172.21.15.1:0/1543338962 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c002030 con 0x7f6858005050 2023-11-15T02:53:41.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.144+0000 7f686959a700 1 -- 172.21.15.1:0/1543338962 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c00cdf0 con 0x7f6858005050 2023-11-15T02:53:41.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.144+0000 7f686959a700 1 -- 172.21.15.1:0/1543338962 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c005d30 con 0x7f6858005050 2023-11-15T02:53:41.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.144+0000 7f6870d1b700 1 -- 172.21.15.1:0/1543338962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6858005050 msgr2=0x7f685800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.144+0000 7f6870d1b700 1 --2- 172.21.15.1:0/1543338962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6858005050 0x7f685800b8e0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f685c00c450 tx=0x7f685c00c760).stop 2023-11-15T02:53:41.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.145+0000 7f6870d1b700 1 -- 172.21.15.1:0/1543338962 shutdown_connections 2023-11-15T02:53:41.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.145+0000 7f6870d1b700 1 --2- 172.21.15.1:0/1543338962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6858005050 0x7f685800b8e0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.145+0000 7f6870d1b700 1 -- 172.21.15.1:0/1543338962 >> 172.21.15.1:0/1543338962 conn(0x7f686c064aa0 msgr2=0x7f686c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:41.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.145+0000 7f6870d1b700 1 -- 172.21.15.1:0/1543338962 shutdown_connections 2023-11-15T02:53:41.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.145+0000 7f6870d1b700 1 -- 172.21.15.1:0/1543338962 wait complete. 2023-11-15T02:53:41.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.146+0000 7f6870d1b700 1 Processor -- start 2023-11-15T02:53:41.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.146+0000 7f6870d1b700 1 -- start start 2023-11-15T02:53:41.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.146+0000 7f6870d1b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6858005050 0x7f686c0c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.146+0000 7f6870d1b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f686c1504f0 0x7f686c14fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.146+0000 7f6870d1b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f686c14ba70 0x7f686c14bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.146+0000 7f6870d1b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c150970 con 0x7f686c14ba70 2023-11-15T02:53:41.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.146+0000 7f6870d1b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c0ab6d0 con 0x7f686c1504f0 2023-11-15T02:53:41.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.146+0000 7f6870d1b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686c150280 con 0x7f6858005050 2023-11-15T02:53:41.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f686ad9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f686c14ba70 0x7f686c14bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f686ad9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f686c14ba70 0x7f686c14bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59532/0 (socket says 172.21.15.1:59532) 2023-11-15T02:53:41.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f686ad9d700 1 -- 172.21.15.1:0/224468330 learned_addr learned my addr 172.21.15.1:0/224468330 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:41.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f6869d9b700 1 --2- 172.21.15.1:0/224468330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f686c1504f0 0x7f686c14fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f686a59c700 1 --2- 172.21.15.1:0/224468330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6858005050 0x7f686c0c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f686ad9d700 1 -- 172.21.15.1:0/224468330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6858005050 msgr2=0x7f686c0c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f686ad9d700 1 --2- 172.21.15.1:0/224468330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6858005050 0x7f686c0c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f686ad9d700 1 -- 172.21.15.1:0/224468330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f686c1504f0 msgr2=0x7f686c14fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f686ad9d700 1 --2- 172.21.15.1:0/224468330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f686c1504f0 0x7f686c14fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f686ad9d700 1 -- 172.21.15.1:0/224468330 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c14c3e0 con 0x7f686c14ba70 2023-11-15T02:53:41.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f686ad9d700 1 --2- 172.21.15.1:0/224468330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f686c14ba70 0x7f686c14bef0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f685c00c7a0 tx=0x7f685c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:41.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f68627fc700 1 -- 172.21.15.1:0/224468330 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c002030 con 0x7f686c14ba70 2023-11-15T02:53:41.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f68627fc700 1 -- 172.21.15.1:0/224468330 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c00cae0 con 0x7f686c14ba70 2023-11-15T02:53:41.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f68627fc700 1 -- 172.21.15.1:0/224468330 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c013450 con 0x7f686c14ba70 2023-11-15T02:53:41.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f6870d1b700 1 -- 172.21.15.1:0/224468330 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686c152c90 con 0x7f686c14ba70 2023-11-15T02:53:41.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.147+0000 7f6870d1b700 1 -- 172.21.15.1:0/224468330 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686c153250 con 0x7f686c14ba70 2023-11-15T02:53:41.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.148+0000 7f6870d1b700 1 -- 172.21.15.1:0/224468330 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686c06c7e0 con 0x7f686c14ba70 2023-11-15T02:53:41.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.149+0000 7f68627fc700 1 -- 172.21.15.1:0/224468330 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f685c013800 con 0x7f686c14ba70 2023-11-15T02:53:41.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.149+0000 7f68627fc700 1 --2- 172.21.15.1:0/224468330 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f684c05f270 0x7f684c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.149+0000 7f68627fc700 1 -- 172.21.15.1:0/224468330 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f685c07b6d0 con 0x7f686c14ba70 2023-11-15T02:53:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.149+0000 7f686a59c700 1 --2- 172.21.15.1:0/224468330 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f684c05f270 0x7f684c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.150+0000 7f686a59c700 1 --2- 172.21.15.1:0/224468330 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f684c05f270 0x7f684c061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6864006f70 tx=0x7f6864008040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:41.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.153+0000 7f68627fc700 1 -- 172.21.15.1:0/224468330 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f685c04c610 con 0x7f686c14ba70 2023-11-15T02:53:41.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.368+0000 7f6870d1b700 1 -- 172.21.15.1:0/224468330 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f686c0ab810 con 0x7f686c14ba70 2023-11-15T02:53:41.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.368+0000 7f68627fc700 1 -- 172.21.15.1:0/224468330 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f685c01a090 con 0x7f686c14ba70 2023-11-15T02:53:41.371 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:41.371 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":87,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8764,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/1669030169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1669030169},{"type":"v1","addr":"172.21.15.141:6837","nonce":1669030169}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9597,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2404592830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2404592830},{"type":"v1","addr":"172.21.15.1:6834","nonce":2404592830}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9600,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3663257097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3663257097},{"type":"v1","addr":"172.21.15.1:6835","nonce":3663257097}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:53:37.978121+0000","modified":"2023-11-15T02:53:40.995474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9609},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9609":{"gid":9609,"name":"d","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6836/1387364974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":1387364974},{"type":"v1","addr":"172.21.15.141:6836","nonce":1387364974}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-11-15T02:53:41.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.370+0000 7f6870d1b700 1 -- 172.21.15.1:0/224468330 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f684c05f270 msgr2=0x7f684c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.370+0000 7f6870d1b700 1 --2- 172.21.15.1:0/224468330 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f684c05f270 0x7f684c061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6864006f70 tx=0x7f6864008040).stop 2023-11-15T02:53:41.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.370+0000 7f6870d1b700 1 -- 172.21.15.1:0/224468330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f686c14ba70 msgr2=0x7f686c14bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.370+0000 7f6870d1b700 1 --2- 172.21.15.1:0/224468330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f686c14ba70 0x7f686c14bef0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f685c00c7a0 tx=0x7f685c015000).stop 2023-11-15T02:53:41.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.370+0000 7f6870d1b700 1 -- 172.21.15.1:0/224468330 shutdown_connections 2023-11-15T02:53:41.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.370+0000 7f6870d1b700 1 --2- 172.21.15.1:0/224468330 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f684c05f270 0x7f684c061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.370+0000 7f6870d1b700 1 --2- 172.21.15.1:0/224468330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f686c14ba70 0x7f686c14bef0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.370+0000 7f6870d1b700 1 --2- 172.21.15.1:0/224468330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6858005050 0x7f686c0c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.370+0000 7f6870d1b700 1 --2- 172.21.15.1:0/224468330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f686c1504f0 0x7f686c14fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.370+0000 7f6870d1b700 1 -- 172.21.15.1:0/224468330 >> 172.21.15.1:0/224468330 conn(0x7f686c064aa0 msgr2=0x7f686c0c9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:41.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.370+0000 7f6870d1b700 1 -- 172.21.15.1:0/224468330 shutdown_connections 2023-11-15T02:53:41.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.370+0000 7f6870d1b700 1 -- 172.21.15.1:0/224468330 wait complete. 2023-11-15T02:53:41.375 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 87 2023-11-15T02:53:41.385 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:53:41.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.502+0000 7f68de5e2700 1 Processor -- start 2023-11-15T02:53:41.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.502+0000 7f68de5e2700 1 -- start start 2023-11-15T02:53:41.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.502+0000 7f68de5e2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68d80629e0 0x7f68d80c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.502+0000 7f68de5e2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f68d80abb40 0x7f68d8064df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.502+0000 7f68de5e2700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d80a9f60 con 0x7f68d80c3400 2023-11-15T02:53:41.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.502+0000 7f68de5e2700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d80c3880 con 0x7f68d80abb40 2023-11-15T02:53:41.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.502+0000 7f68de5e2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d8151700 con 0x7f68d80629e0 2023-11-15T02:53:41.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.503+0000 7f68dcb7f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f68d80abb40 0x7f68d8064df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.503+0000 7f68dcb7f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f68d80abb40 0x7f68d8064df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59544/0 (socket says 172.21.15.1:59544) 2023-11-15T02:53:41.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.503+0000 7f68dcb7f700 1 -- 172.21.15.1:0/3081997923 learned_addr learned my addr 172.21.15.1:0/3081997923 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:41.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.503+0000 7f68d7fff700 1 --2- 172.21.15.1:0/3081997923 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68d80629e0 0x7f68d80c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.503+0000 7f68dcb7f700 1 -- 172.21.15.1:0/3081997923 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68d80629e0 msgr2=0x7f68d80c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:41.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.503+0000 7f68dcb7f700 1 --2- 172.21.15.1:0/3081997923 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68d80629e0 0x7f68d80c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.503+0000 7f68dcb7f700 1 -- 172.21.15.1:0/3081997923 >> v1:172.21.15.141:6789/0 conn(0x7f68d80c3400 legacy=0x7f68d80ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.503+0000 7f68dcb7f700 1 -- 172.21.15.1:0/3081997923 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d80c2a80 con 0x7f68d80abb40 2023-11-15T02:53:41.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.503+0000 7f68dcb7f700 1 --2- 172.21.15.1:0/3081997923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68d80abb40 0x7f68d8064df0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f68d0009f50 tx=0x7f68d0009840).ready entity=mon.0 client_cookie=6ad67c5423a0a21d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:41.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.503+0000 7f68d77fe700 1 -- 172.21.15.1:0/3081997923 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d000e070 con 0x7f68d80abb40 2023-11-15T02:53:41.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.503+0000 7f68d77fe700 1 -- 172.21.15.1:0/3081997923 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d000ba70 con 0x7f68d80abb40 2023-11-15T02:53:41.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.503+0000 7f68d77fe700 1 -- 172.21.15.1:0/3081997923 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d000bdf0 con 0x7f68d80abb40 2023-11-15T02:53:41.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.504+0000 7f68de5e2700 1 -- 172.21.15.1:0/3081997923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68d80abb40 msgr2=0x7f68d8064df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.504+0000 7f68de5e2700 1 --2- 172.21.15.1:0/3081997923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68d80abb40 0x7f68d8064df0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f68d0009f50 tx=0x7f68d0009840).stop 2023-11-15T02:53:41.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.504+0000 7f68de5e2700 1 -- 172.21.15.1:0/3081997923 shutdown_connections 2023-11-15T02:53:41.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.504+0000 7f68de5e2700 1 --2- 172.21.15.1:0/3081997923 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68d80629e0 0x7f68d80c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.504+0000 7f68de5e2700 1 --2- 172.21.15.1:0/3081997923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68d80abb40 0x7f68d8064df0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.504+0000 7f68de5e2700 1 -- 172.21.15.1:0/3081997923 >> 172.21.15.1:0/3081997923 conn(0x7f68d80c74f0 msgr2=0x7f68d80c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:41.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.504+0000 7f68de5e2700 1 -- 172.21.15.1:0/3081997923 shutdown_connections 2023-11-15T02:53:41.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.504+0000 7f68de5e2700 1 -- 172.21.15.1:0/3081997923 wait complete. 2023-11-15T02:53:41.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.505+0000 7f68de5e2700 1 Processor -- start 2023-11-15T02:53:41.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.505+0000 7f68de5e2700 1 -- start start 2023-11-15T02:53:41.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68de5e2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68d80629e0 0x7f68d80a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68de5e2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68d80c3400 0x7f68d814d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68de5e2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68d81549d0 0x7f68d8154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68de5e2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80a3b40 con 0x7f68d80629e0 2023-11-15T02:53:41.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68de5e2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d8165d20 con 0x7f68d80c3400 2023-11-15T02:53:41.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68de5e2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d814de90 con 0x7f68d81549d0 2023-11-15T02:53:41.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68d7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68d80629e0 0x7f68d80a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68d7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68d80629e0 0x7f68d80a3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59558/0 (socket says 172.21.15.1:59558) 2023-11-15T02:53:41.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68d7fff700 1 -- 172.21.15.1:0/3415394335 learned_addr learned my addr 172.21.15.1:0/3415394335 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:41.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68cffff700 1 --2- 172.21.15.1:0/3415394335 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68d80c3400 0x7f68d814d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68dcb7f700 1 --2- 172.21.15.1:0/3415394335 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68d81549d0 0x7f68d8154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68d7fff700 1 -- 172.21.15.1:0/3415394335 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68d81549d0 msgr2=0x7f68d8154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68d7fff700 1 --2- 172.21.15.1:0/3415394335 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68d81549d0 0x7f68d8154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68d7fff700 1 -- 172.21.15.1:0/3415394335 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68d80c3400 msgr2=0x7f68d814d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68d7fff700 1 --2- 172.21.15.1:0/3415394335 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68d80c3400 0x7f68d814d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68d7fff700 1 -- 172.21.15.1:0/3415394335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d0009ae0 con 0x7f68d80629e0 2023-11-15T02:53:41.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68d7fff700 1 --2- 172.21.15.1:0/3415394335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68d80629e0 0x7f68d80a3650 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f68c800d890 tx=0x7f68c8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:41.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.506+0000 7f68d4ff9700 1 -- 172.21.15.1:0/3415394335 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c8011590 con 0x7f68d80629e0 2023-11-15T02:53:41.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.507+0000 7f68d4ff9700 1 -- 172.21.15.1:0/3415394335 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c80116f0 con 0x7f68d80629e0 2023-11-15T02:53:41.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.507+0000 7f68de5e2700 1 -- 172.21.15.1:0/3415394335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d8165f70 con 0x7f68d80629e0 2023-11-15T02:53:41.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.507+0000 7f68d4ff9700 1 -- 172.21.15.1:0/3415394335 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c8011a70 con 0x7f68d80629e0 2023-11-15T02:53:41.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.507+0000 7f68de5e2700 1 -- 172.21.15.1:0/3415394335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d8166530 con 0x7f68d80629e0 2023-11-15T02:53:41.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.508+0000 7f68de5e2700 1 -- 172.21.15.1:0/3415394335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d806c7e0 con 0x7f68d80629e0 2023-11-15T02:53:41.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.508+0000 7f68d4ff9700 1 -- 172.21.15.1:0/3415394335 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f68c801c460 con 0x7f68d80629e0 2023-11-15T02:53:41.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.508+0000 7f68d4ff9700 1 --2- 172.21.15.1:0/3415394335 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f68b805f270 0x7f68b8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.508+0000 7f68d4ff9700 1 -- 172.21.15.1:0/3415394335 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f68c807a3d0 con 0x7f68d80629e0 2023-11-15T02:53:41.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.508+0000 7f68cffff700 1 --2- 172.21.15.1:0/3415394335 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f68b805f270 0x7f68b8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.509+0000 7f68cffff700 1 --2- 172.21.15.1:0/3415394335 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f68b805f270 0x7f68b8061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f68d80c1ad0 tx=0x7f68c0007d40).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:41.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.513+0000 7f68d4ff9700 1 -- 172.21.15.1:0/3415394335 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f68c804b1f0 con 0x7f68d80629e0 2023-11-15T02:53:41.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.685+0000 7f68de5e2700 1 -- 172.21.15.1:0/3415394335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68d80c1b90 con 0x7f68d80629e0 2023-11-15T02:53:41.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.686+0000 7f68d4ff9700 1 -- 172.21.15.1:0/3415394335 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+17701 (secure 0 0 0) 0x7f68c804e810 con 0x7f68d80629e0 2023-11-15T02:53:41.689 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:41.689 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":196,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:53:38.979781+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:53:35.639437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-11-15T02:53:36.965896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:53:41.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.688+0000 7f68de5e2700 1 -- 172.21.15.1:0/3415394335 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f68b805f270 msgr2=0x7f68b8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.688+0000 7f68de5e2700 1 --2- 172.21.15.1:0/3415394335 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f68b805f270 0x7f68b8061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f68d80c1ad0 tx=0x7f68c0007d40).stop 2023-11-15T02:53:41.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.688+0000 7f68de5e2700 1 -- 172.21.15.1:0/3415394335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68d80629e0 msgr2=0x7f68d80a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.688+0000 7f68de5e2700 1 --2- 172.21.15.1:0/3415394335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68d80629e0 0x7f68d80a3650 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f68c800d890 tx=0x7f68c8008040).stop 2023-11-15T02:53:41.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.688+0000 7f68de5e2700 1 -- 172.21.15.1:0/3415394335 shutdown_connections 2023-11-15T02:53:41.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.688+0000 7f68de5e2700 1 --2- 172.21.15.1:0/3415394335 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f68b805f270 0x7f68b8061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.688+0000 7f68de5e2700 1 --2- 172.21.15.1:0/3415394335 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68d81549d0 0x7f68d8154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.688+0000 7f68de5e2700 1 --2- 172.21.15.1:0/3415394335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68d80629e0 0x7f68d80a3650 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.688+0000 7f68de5e2700 1 --2- 172.21.15.1:0/3415394335 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68d80c3400 0x7f68d814d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.688+0000 7f68de5e2700 1 -- 172.21.15.1:0/3415394335 >> 172.21.15.1:0/3415394335 conn(0x7f68d80c74f0 msgr2=0x7f68d80c6260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:41.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.688+0000 7f68de5e2700 1 -- 172.21.15.1:0/3415394335 shutdown_connections 2023-11-15T02:53:41.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.688+0000 7f68de5e2700 1 -- 172.21.15.1:0/3415394335 wait complete. 2023-11-15T02:53:41.703 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-15T02:53:41.703 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:53:41.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.819+0000 7f0efd8ad700 1 Processor -- start 2023-11-15T02:53:41.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.819+0000 7f0efd8ad700 1 -- start start 2023-11-15T02:53:41.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.820+0000 7f0efd8ad700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0ef8154450 0x7f0ef80a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.820+0000 7f0efd8ad700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ef80be520 0x7f0ef8154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.820+0000 7f0efd8ad700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef80a85e0 con 0x7f0ef80833a0 2023-11-15T02:53:41.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.820+0000 7f0efd8ad700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef8065940 con 0x7f0ef8154450 2023-11-15T02:53:41.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.820+0000 7f0efd8ad700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8065660 con 0x7f0ef80be520 2023-11-15T02:53:41.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef67fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0ef80833a0 0x7f0ef80bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57274/0 (socket says 172.21.15.1:57274) 2023-11-15T02:53:41.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef67fc700 1 -- 172.21.15.1:0/1498103907 learned_addr learned my addr 172.21.15.1:0/1498103907 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:41.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef6ffd700 1 --2- 172.21.15.1:0/1498103907 >> v2:172.21.15.141:3300/0 conn(0x7f0ef8154450 0x7f0ef80a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef77fe700 1 --2- 172.21.15.1:0/1498103907 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ef80be520 0x7f0ef8154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 -- 172.21.15.1:0/1498103907 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999862129 0 0) 0x7f0ef80a85e0 con 0x7f0ef80833a0 2023-11-15T02:53:41.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 -- 172.21.15.1:0/1498103907 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ee40033f0 con 0x7f0ef80833a0 2023-11-15T02:53:41.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 -- 172.21.15.1:0/1498103907 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4018594941 0 0) 0x7f0ee40033f0 con 0x7f0ef80833a0 2023-11-15T02:53:41.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 -- 172.21.15.1:0/1498103907 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ef80be520 msgr2=0x7f0ef8154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:41.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 --2- 172.21.15.1:0/1498103907 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ef80be520 0x7f0ef8154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 -- 172.21.15.1:0/1498103907 >> v2:172.21.15.141:3300/0 conn(0x7f0ef8154450 msgr2=0x7f0ef80a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:41.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 --2- 172.21.15.1:0/1498103907 >> v2:172.21.15.141:3300/0 conn(0x7f0ef8154450 0x7f0ef80a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 -- 172.21.15.1:0/1498103907 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef80c6f50 con 0x7f0ef80833a0 2023-11-15T02:53:41.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 -- 172.21.15.1:0/1498103907 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f0ee0001470 con 0x7f0ef80833a0 2023-11-15T02:53:41.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 -- 172.21.15.1:0/1498103907 >> v1:172.21.15.1:6789/0 conn(0x7f0ef80833a0 legacy=0x7f0ef80bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 --2- 172.21.15.1:0/1498103907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ee40038e0 0x7f0ee4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 --2- 172.21.15.1:0/1498103907 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ee4004690 0x7f0ee4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 --2- 172.21.15.1:0/1498103907 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ef80be520 0x7f0ee4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 -- 172.21.15.1:0/1498103907 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8065940 con 0x7f0ee40038e0 2023-11-15T02:53:41.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 -- 172.21.15.1:0/1498103907 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8065660 con 0x7f0ee4004690 2023-11-15T02:53:41.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef5ffb700 1 -- 172.21.15.1:0/1498103907 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee400b8e0 con 0x7f0ef80be520 2023-11-15T02:53:41.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef6ffd700 1 --2- 172.21.15.1:0/1498103907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ee40038e0 0x7f0ee4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef67fc700 1 --2- 172.21.15.1:0/1498103907 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ee4004690 0x7f0ee4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.821+0000 7f0ef77fe700 1 --2- 172.21.15.1:0/1498103907 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ef80be520 0x7f0ee4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0ef6ffd700 1 -- 172.21.15.1:0/1498103907 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ef80be520 msgr2=0x7f0ee4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:41.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0ef6ffd700 1 --2- 172.21.15.1:0/1498103907 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ef80be520 0x7f0ee4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0ef6ffd700 1 -- 172.21.15.1:0/1498103907 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ee4004690 msgr2=0x7f0ee4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0ef6ffd700 1 --2- 172.21.15.1:0/1498103907 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ee4004690 0x7f0ee4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0ef6ffd700 1 -- 172.21.15.1:0/1498103907 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee40033f0 con 0x7f0ee40038e0 2023-11-15T02:53:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0ef6ffd700 1 --2- 172.21.15.1:0/1498103907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ee40038e0 0x7f0ee4003d00 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7f0ef0006fd0 tx=0x7f0ef0006f40).ready entity=mon.0 client_cookie=6e1d3ce04a9c3397 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0ef5ffb700 1 -- 172.21.15.1:0/1498103907 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0009430 con 0x7f0ee40038e0 2023-11-15T02:53:41.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0ef5ffb700 1 -- 172.21.15.1:0/1498103907 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef000e640 con 0x7f0ee40038e0 2023-11-15T02:53:41.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0ef5ffb700 1 -- 172.21.15.1:0/1498103907 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef000e9c0 con 0x7f0ee40038e0 2023-11-15T02:53:41.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0efd8ad700 1 -- 172.21.15.1:0/1498103907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ee40038e0 msgr2=0x7f0ee4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0efd8ad700 1 --2- 172.21.15.1:0/1498103907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ee40038e0 0x7f0ee4003d00 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7f0ef0006fd0 tx=0x7f0ef0006f40).stop 2023-11-15T02:53:41.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0ef77fe700 1 -- 172.21.15.1:0/1498103907 reap_dead start 2023-11-15T02:53:41.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0efd8ad700 1 -- 172.21.15.1:0/1498103907 shutdown_connections 2023-11-15T02:53:41.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0efd8ad700 1 -- 172.21.15.1:0/1498103907 >> 172.21.15.1:0/1498103907 conn(0x7f0ef8082f90 msgr2=0x7f0ef80c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:41.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0efd8ad700 1 -- 172.21.15.1:0/1498103907 shutdown_connections 2023-11-15T02:53:41.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.822+0000 7f0efd8ad700 1 -- 172.21.15.1:0/1498103907 wait complete. 2023-11-15T02:53:41.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.824+0000 7f0efd8ad700 1 Processor -- start 2023-11-15T02:53:41.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.824+0000 7f0efd8ad700 1 -- start start 2023-11-15T02:53:41.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.824+0000 7f0efd8ad700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ee40038e0 0x7f0ef81682e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.824+0000 7f0efd8ad700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ef814f580 0x7f0ef814fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.824+0000 7f0efd8ad700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ef814d710 0x7f0ef814db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.824+0000 7f0efd8ad700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8169260 con 0x7f0ee40038e0 2023-11-15T02:53:41.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.824+0000 7f0efd8ad700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef81687d0 con 0x7f0ef814d710 2023-11-15T02:53:41.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.824+0000 7f0efd8ad700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef814fef0 con 0x7f0ef814f580 2023-11-15T02:53:41.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0ef6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ee40038e0 0x7f0ef81682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0ef6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ee40038e0 0x7f0ef81682e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59570/0 (socket says 172.21.15.1:59570) 2023-11-15T02:53:41.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0ef6ffd700 1 -- 172.21.15.1:0/3070957361 learned_addr learned my addr 172.21.15.1:0/3070957361 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:41.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0ef77fe700 1 --2- 172.21.15.1:0/3070957361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ef814d710 0x7f0ef814db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0ef67fc700 1 --2- 172.21.15.1:0/3070957361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ef814f580 0x7f0ef814fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0ef6ffd700 1 -- 172.21.15.1:0/3070957361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ef814f580 msgr2=0x7f0ef814fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0ef6ffd700 1 --2- 172.21.15.1:0/3070957361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ef814f580 0x7f0ef814fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0ef6ffd700 1 -- 172.21.15.1:0/3070957361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ef814d710 msgr2=0x7f0ef814db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:41.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0ef6ffd700 1 --2- 172.21.15.1:0/3070957361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ef814d710 0x7f0ef814db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:41.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0ef6ffd700 1 -- 172.21.15.1:0/3070957361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef81689c0 con 0x7f0ee40038e0 2023-11-15T02:53:41.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0ef6ffd700 1 --2- 172.21.15.1:0/3070957361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ee40038e0 0x7f0ef81682e0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7f0ef000a010 tx=0x7f0ef001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:41.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0eeeffd700 1 -- 172.21.15.1:0/3070957361 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef000e9c0 con 0x7f0ee40038e0 2023-11-15T02:53:41.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0eeeffd700 1 -- 172.21.15.1:0/3070957361 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef0006040 con 0x7f0ee40038e0 2023-11-15T02:53:41.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0efd8ad700 1 -- 172.21.15.1:0/3070957361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef8168ca0 con 0x7f0ee40038e0 2023-11-15T02:53:41.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0eeeffd700 1 -- 172.21.15.1:0/3070957361 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00063c0 con 0x7f0ee40038e0 2023-11-15T02:53:41.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.825+0000 7f0efd8ad700 1 -- 172.21.15.1:0/3070957361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef80a8af0 con 0x7f0ee40038e0 2023-11-15T02:53:41.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.826+0000 7f0efd8ad700 1 -- 172.21.15.1:0/3070957361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef80a8e60 con 0x7f0ee40038e0 2023-11-15T02:53:41.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.827+0000 7f0eeeffd700 1 -- 172.21.15.1:0/3070957361 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0ef001b450 con 0x7f0ee40038e0 2023-11-15T02:53:41.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.827+0000 7f0eeeffd700 1 --2- 172.21.15.1:0/3070957361 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0ed805f270 0x7f0ed8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:41.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.827+0000 7f0eeeffd700 1 -- 172.21.15.1:0/3070957361 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f0ef007bb30 con 0x7f0ee40038e0 2023-11-15T02:53:41.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.827+0000 7f0ef67fc700 1 --2- 172.21.15.1:0/3070957361 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0ed805f270 0x7f0ed8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:41.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.828+0000 7f0ef67fc700 1 --2- 172.21.15.1:0/3070957361 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0ed805f270 0x7f0ed8061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0ef80ab950 tx=0x7f0ee0009040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:41.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.831+0000 7f0eeeffd700 1 -- 172.21.15.1:0/3070957361 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0ef004ca10 con 0x7f0ee40038e0 2023-11-15T02:53:42.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:41.998+0000 7f0efd8ad700 1 -- 172.21.15.1:0/3070957361 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ef80c3320 con 0x7f0ed805f270 2023-11-15T02:53:42.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.010+0000 7f0eeeffd700 1 -- 172.21.15.1:0/3070957361 <== mgr.8590 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360912 (secure 0 0 0) 0x7f0ef80c3320 con 0x7f0ed805f270 2023-11-15T02:53:42.016 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:42.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.013+0000 7f0efd8ad700 1 -- 172.21.15.1:0/3070957361 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0ed805f270 msgr2=0x7f0ed8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.013+0000 7f0efd8ad700 1 --2- 172.21.15.1:0/3070957361 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0ed805f270 0x7f0ed8061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0ef80ab950 tx=0x7f0ee0009040).stop 2023-11-15T02:53:42.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.013+0000 7f0efd8ad700 1 -- 172.21.15.1:0/3070957361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ee40038e0 msgr2=0x7f0ef81682e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.013+0000 7f0efd8ad700 1 --2- 172.21.15.1:0/3070957361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ee40038e0 0x7f0ef81682e0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7f0ef000a010 tx=0x7f0ef001a000).stop 2023-11-15T02:53:42.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.013+0000 7f0efd8ad700 1 -- 172.21.15.1:0/3070957361 shutdown_connections 2023-11-15T02:53:42.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.013+0000 7f0efd8ad700 1 --2- 172.21.15.1:0/3070957361 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0ed805f270 0x7f0ed8061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.013+0000 7f0efd8ad700 1 --2- 172.21.15.1:0/3070957361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ef814d710 0x7f0ef814db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.013+0000 7f0efd8ad700 1 --2- 172.21.15.1:0/3070957361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ee40038e0 0x7f0ef81682e0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.013+0000 7f0efd8ad700 1 --2- 172.21.15.1:0/3070957361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ef814f580 0x7f0ef814fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.013+0000 7f0efd8ad700 1 -- 172.21.15.1:0/3070957361 >> 172.21.15.1:0/3070957361 conn(0x7f0ef8082f90 msgr2=0x7f0ef80be950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:42.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.013+0000 7f0efd8ad700 1 -- 172.21.15.1:0/3070957361 shutdown_connections 2023-11-15T02:53:42.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.013+0000 7f0efd8ad700 1 -- 172.21.15.1:0/3070957361 wait complete. 2023-11-15T02:53:42.024 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:53:42.027 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T02:53:40.551013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1414,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":246,"acting":246,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":212,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2469620,"kb_used_data":19124,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752505100,"statfs":{"total":773094113280,"available":770565222400,"internally_reserved":0,"allocated":19582976,"data_stored":10436601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-594407,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-209,"num_write_kb":-720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.007154"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.004115+0000","last_change":"2023-11-15T02:53:37.995183+0000","last_active":"2023-11-15T02:53:38.004115+0000","last_peered":"2023-11-15T02:53:38.004115+0000","last_clean":"2023-11-15T02:53:38.004115+0000","last_became_active":"2023-11-15T02:53:37.994643+0000","last_became_peered":"2023-11-15T02:53:37.994643+0000","last_unstale":"2023-11-15T02:53:38.004115+0000","last_undegraded":"2023-11-15T02:53:38.004115+0000","last_fullsized":"2023-11-15T02:53:38.004115+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"195'3","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011940+0000","last_change":"2023-11-15T02:53:37.606094+0000","last_active":"2023-11-15T02:53:38.011940+0000","last_peered":"2023-11-15T02:53:38.011940+0000","last_clean":"2023-11-15T02:53:38.011940+0000","last_became_active":"2023-11-15T02:53:37.605797+0000","last_became_peered":"2023-11-15T02:53:37.605797+0000","last_unstale":"2023-11-15T02:53:38.011940+0000","last_undegraded":"2023-11-15T02:53:38.011940+0000","last_fullsized":"2023-11-15T02:53:38.011940+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011234+0000","last_change":"2023-11-15T02:53:38.006818+0000","last_active":"2023-11-15T02:53:38.011234+0000","last_peered":"2023-11-15T02:53:38.011234+0000","last_clean":"2023-11-15T02:53:38.011234+0000","last_became_active":"2023-11-15T02:53:38.006545+0000","last_became_peered":"2023-11-15T02:53:38.006545+0000","last_unstale":"2023-11-15T02:53:38.011234+0000","last_undegraded":"2023-11-15T02:53:38.011234+0000","last_fullsized":"2023-11-15T02:53:38.011234+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998658+0000","last_change":"2023-11-15T02:53:37.991499+0000","last_active":"2023-11-15T02:53:37.998658+0000","last_peered":"2023-11-15T02:53:37.998658+0000","last_clean":"2023-11-15T02:53:37.998658+0000","last_became_active":"2023-11-15T02:53:37.991219+0000","last_became_peered":"2023-11-15T02:53:37.991219+0000","last_unstale":"2023-11-15T02:53:37.998658+0000","last_undegraded":"2023-11-15T02:53:37.998658+0000","last_fullsized":"2023-11-15T02:53:37.998658+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999215+0000","last_change":"2023-11-15T02:53:37.598351+0000","last_active":"2023-11-15T02:53:37.999215+0000","last_peered":"2023-11-15T02:53:37.999215+0000","last_clean":"2023-11-15T02:53:37.999215+0000","last_became_active":"2023-11-15T02:53:37.598074+0000","last_became_peered":"2023-11-15T02:53:37.598074+0000","last_unstale":"2023-11-15T02:53:37.999215+0000","last_undegraded":"2023-11-15T02:53:37.999215+0000","last_fullsized":"2023-11-15T02:53:37.999215+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009794+0000","last_change":"2023-11-15T02:53:38.005640+0000","last_active":"2023-11-15T02:53:38.009794+0000","last_peered":"2023-11-15T02:53:38.009794+0000","last_clean":"2023-11-15T02:53:38.009794+0000","last_became_active":"2023-11-15T02:53:38.005427+0000","last_became_peered":"2023-11-15T02:53:38.005427+0000","last_unstale":"2023-11-15T02:53:38.009794+0000","last_undegraded":"2023-11-15T02:53:38.009794+0000","last_fullsized":"2023-11-15T02:53:38.009794+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003329+0000","last_change":"2023-11-15T02:53:37.605508+0000","last_active":"2023-11-15T02:53:38.003329+0000","last_peered":"2023-11-15T02:53:38.003329+0000","last_clean":"2023-11-15T02:53:38.003329+0000","last_became_active":"2023-11-15T02:53:37.605050+0000","last_became_peered":"2023-11-15T02:53:37.605050+0000","last_unstale":"2023-11-15T02:53:38.003329+0000","last_undegraded":"2023-11-15T02:53:38.003329+0000","last_fullsized":"2023-11-15T02:53:38.003329+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.007889+0000","last_change":"2023-11-15T02:53:38.003090+0000","last_active":"2023-11-15T02:53:38.007889+0000","last_peered":"2023-11-15T02:53:38.007889+0000","last_clean":"2023-11-15T02:53:38.007889+0000","last_became_active":"2023-11-15T02:53:38.002775+0000","last_became_peered":"2023-11-15T02:53:38.002775+0000","last_unstale":"2023-11-15T02:53:38.007889+0000","last_undegraded":"2023-11-15T02:53:38.007889+0000","last_fullsized":"2023-11-15T02:53:38.007889+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.013228+0000","last_change":"2023-11-15T02:53:38.010179+0000","last_active":"2023-11-15T02:53:38.013228+0000","last_peered":"2023-11-15T02:53:38.013228+0000","last_clean":"2023-11-15T02:53:38.013228+0000","last_became_active":"2023-11-15T02:53:38.009853+0000","last_became_peered":"2023-11-15T02:53:38.009853+0000","last_unstale":"2023-11-15T02:53:38.013228+0000","last_undegraded":"2023-11-15T02:53:38.013228+0000","last_fullsized":"2023-11-15T02:53:38.013228+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998494+0000","last_change":"2023-11-15T02:53:37.610005+0000","last_active":"2023-11-15T02:53:37.998494+0000","last_peered":"2023-11-15T02:53:37.998494+0000","last_clean":"2023-11-15T02:53:37.998494+0000","last_became_active":"2023-11-15T02:53:37.609699+0000","last_became_peered":"2023-11-15T02:53:37.609699+0000","last_unstale":"2023-11-15T02:53:37.998494+0000","last_undegraded":"2023-11-15T02:53:37.998494+0000","last_fullsized":"2023-11-15T02:53:37.998494+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006567+0000","last_change":"2023-11-15T02:53:38.001561+0000","last_active":"2023-11-15T02:53:38.006567+0000","last_peered":"2023-11-15T02:53:38.006567+0000","last_clean":"2023-11-15T02:53:38.006567+0000","last_became_active":"2023-11-15T02:53:38.001242+0000","last_became_peered":"2023-11-15T02:53:38.001242+0000","last_unstale":"2023-11-15T02:53:38.006567+0000","last_undegraded":"2023-11-15T02:53:38.006567+0000","last_fullsized":"2023-11-15T02:53:38.006567+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.981858+0000","last_change":"2023-11-15T02:53:37.606473+0000","last_active":"2023-11-15T02:53:37.981858+0000","last_peered":"2023-11-15T02:53:37.981858+0000","last_clean":"2023-11-15T02:53:37.981858+0000","last_became_active":"2023-11-15T02:53:37.606137+0000","last_became_peered":"2023-11-15T02:53:37.606137+0000","last_unstale":"2023-11-15T02:53:37.981858+0000","last_undegraded":"2023-11-15T02:53:37.981858+0000","last_fullsized":"2023-11-15T02:53:37.981858+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002949+0000","last_change":"2023-11-15T02:53:37.999287+0000","last_active":"2023-11-15T02:53:38.002949+0000","last_peered":"2023-11-15T02:53:38.002949+0000","last_clean":"2023-11-15T02:53:38.002949+0000","last_became_active":"2023-11-15T02:53:37.998970+0000","last_became_peered":"2023-11-15T02:53:37.998970+0000","last_unstale":"2023-11-15T02:53:38.002949+0000","last_undegraded":"2023-11-15T02:53:38.002949+0000","last_fullsized":"2023-11-15T02:53:38.002949+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008738+0000","last_change":"2023-11-15T02:53:38.007229+0000","last_active":"2023-11-15T02:53:38.008738+0000","last_peered":"2023-11-15T02:53:38.008738+0000","last_clean":"2023-11-15T02:53:38.008738+0000","last_became_active":"2023-11-15T02:53:38.006946+0000","last_became_peered":"2023-11-15T02:53:38.006946+0000","last_unstale":"2023-11-15T02:53:38.008738+0000","last_undegraded":"2023-11-15T02:53:38.008738+0000","last_fullsized":"2023-11-15T02:53:38.008738+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003079+0000","last_change":"2023-11-15T02:53:37.998235+0000","last_active":"2023-11-15T02:53:38.003079+0000","last_peered":"2023-11-15T02:53:38.003079+0000","last_clean":"2023-11-15T02:53:38.003079+0000","last_became_active":"2023-11-15T02:53:37.997964+0000","last_became_peered":"2023-11-15T02:53:37.997964+0000","last_unstale":"2023-11-15T02:53:38.003079+0000","last_undegraded":"2023-11-15T02:53:38.003079+0000","last_fullsized":"2023-11-15T02:53:38.003079+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.007921+0000","last_change":"2023-11-15T02:53:38.003127+0000","last_active":"2023-11-15T02:53:38.007921+0000","last_peered":"2023-11-15T02:53:38.007921+0000","last_clean":"2023-11-15T02:53:38.007921+0000","last_became_active":"2023-11-15T02:53:38.002839+0000","last_became_peered":"2023-11-15T02:53:38.002839+0000","last_unstale":"2023-11-15T02:53:38.007921+0000","last_undegraded":"2023-11-15T02:53:38.007921+0000","last_fullsized":"2023-11-15T02:53:38.007921+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009318+0000","last_change":"2023-11-15T02:53:38.001828+0000","last_active":"2023-11-15T02:53:38.009318+0000","last_peered":"2023-11-15T02:53:38.009318+0000","last_clean":"2023-11-15T02:53:38.009318+0000","last_became_active":"2023-11-15T02:53:37.997960+0000","last_became_peered":"2023-11-15T02:53:37.997960+0000","last_unstale":"2023-11-15T02:53:38.009318+0000","last_undegraded":"2023-11-15T02:53:38.009318+0000","last_fullsized":"2023-11-15T02:53:38.009318+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001253+0000","last_change":"2023-11-15T02:53:37.996705+0000","last_active":"2023-11-15T02:53:38.001253+0000","last_peered":"2023-11-15T02:53:38.001253+0000","last_clean":"2023-11-15T02:53:38.001253+0000","last_became_active":"2023-11-15T02:53:37.995805+0000","last_became_peered":"2023-11-15T02:53:37.995805+0000","last_unstale":"2023-11-15T02:53:38.001253+0000","last_undegraded":"2023-11-15T02:53:38.001253+0000","last_fullsized":"2023-11-15T02:53:38.001253+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010242+0000","last_change":"2023-11-15T02:53:37.604059+0000","last_active":"2023-11-15T02:53:38.010242+0000","last_peered":"2023-11-15T02:53:38.010242+0000","last_clean":"2023-11-15T02:53:38.010242+0000","last_became_active":"2023-11-15T02:53:37.603596+0000","last_became_peered":"2023-11-15T02:53:37.603596+0000","last_unstale":"2023-11-15T02:53:38.010242+0000","last_undegraded":"2023-11-15T02:53:38.010242+0000","last_fullsized":"2023-11-15T02:53:38.010242+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001234+0000","last_change":"2023-11-15T02:53:37.997221+0000","last_active":"2023-11-15T02:53:38.001234+0000","last_peered":"2023-11-15T02:53:38.001234+0000","last_clean":"2023-11-15T02:53:38.001234+0000","last_became_active":"2023-11-15T02:53:37.996900+0000","last_became_peered":"2023-11-15T02:53:37.996900+0000","last_unstale":"2023-11-15T02:53:38.001234+0000","last_undegraded":"2023-11-15T02:53:38.001234+0000","last_fullsized":"2023-11-15T02:53:38.001234+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989867+0000","last_change":"2023-11-15T02:53:37.605082+0000","last_active":"2023-11-15T02:53:37.989867+0000","last_peered":"2023-11-15T02:53:37.989867+0000","last_clean":"2023-11-15T02:53:37.989867+0000","last_became_active":"2023-11-15T02:53:37.604780+0000","last_became_peered":"2023-11-15T02:53:37.604780+0000","last_unstale":"2023-11-15T02:53:37.989867+0000","last_undegraded":"2023-11-15T02:53:37.989867+0000","last_fullsized":"2023-11-15T02:53:37.989867+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.013267+0000","last_change":"2023-11-15T02:53:38.012265+0000","last_active":"2023-11-15T02:53:38.013267+0000","last_peered":"2023-11-15T02:53:38.013267+0000","last_clean":"2023-11-15T02:53:38.013267+0000","last_became_active":"2023-11-15T02:53:38.011882+0000","last_became_peered":"2023-11-15T02:53:38.011882+0000","last_unstale":"2023-11-15T02:53:38.013267+0000","last_undegraded":"2023-11-15T02:53:38.013267+0000","last_fullsized":"2023-11-15T02:53:38.013267+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.991858+0000","last_change":"2023-11-15T02:53:37.604365+0000","last_active":"2023-11-15T02:53:37.991858+0000","last_peered":"2023-11-15T02:53:37.991858+0000","last_clean":"2023-11-15T02:53:37.991858+0000","last_became_active":"2023-11-15T02:53:37.604087+0000","last_became_peered":"2023-11-15T02:53:37.604087+0000","last_unstale":"2023-11-15T02:53:37.991858+0000","last_undegraded":"2023-11-15T02:53:37.991858+0000","last_fullsized":"2023-11-15T02:53:37.991858+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008119+0000","last_change":"2023-11-15T02:53:38.003008+0000","last_active":"2023-11-15T02:53:38.008119+0000","last_peered":"2023-11-15T02:53:38.008119+0000","last_clean":"2023-11-15T02:53:38.008119+0000","last_became_active":"2023-11-15T02:53:38.002701+0000","last_became_peered":"2023-11-15T02:53:38.002701+0000","last_unstale":"2023-11-15T02:53:38.008119+0000","last_undegraded":"2023-11-15T02:53:38.008119+0000","last_fullsized":"2023-11-15T02:53:38.008119+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"195'4","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.000336+0000","last_change":"2023-11-15T02:53:37.608083+0000","last_active":"2023-11-15T02:53:38.000336+0000","last_peered":"2023-11-15T02:53:38.000336+0000","last_clean":"2023-11-15T02:53:38.000336+0000","last_became_active":"2023-11-15T02:53:37.607564+0000","last_became_peered":"2023-11-15T02:53:37.607564+0000","last_unstale":"2023-11-15T02:53:38.000336+0000","last_undegraded":"2023-11-15T02:53:38.000336+0000","last_fullsized":"2023-11-15T02:53:38.000336+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:37.577352+0000","last_change":"2023-11-15T02:53:37.577352+0000","last_active":"2023-11-15T02:53:37.577352+0000","last_peered":"2023-11-15T02:53:37.577352+0000","last_clean":"2023-11-15T02:53:37.577352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:37.577352+0000","last_undegraded":"2023-11-15T02:53:37.577352+0000","last_fullsized":"2023-11-15T02:53:37.577352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987749+0000","last_change":"2023-11-15T02:53:37.601064+0000","last_active":"2023-11-15T02:53:37.987749+0000","last_peered":"2023-11-15T02:53:37.987749+0000","last_clean":"2023-11-15T02:53:37.987749+0000","last_became_active":"2023-11-15T02:53:37.600760+0000","last_became_peered":"2023-11-15T02:53:37.600760+0000","last_unstale":"2023-11-15T02:53:37.987749+0000","last_undegraded":"2023-11-15T02:53:37.987749+0000","last_fullsized":"2023-11-15T02:53:37.987749+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.016084+0000","last_change":"2023-11-15T02:53:38.012049+0000","last_active":"2023-11-15T02:53:38.016084+0000","last_peered":"2023-11-15T02:53:38.016084+0000","last_clean":"2023-11-15T02:53:38.016084+0000","last_became_active":"2023-11-15T02:53:38.011349+0000","last_became_peered":"2023-11-15T02:53:38.011349+0000","last_unstale":"2023-11-15T02:53:38.016084+0000","last_undegraded":"2023-11-15T02:53:38.016084+0000","last_fullsized":"2023-11-15T02:53:38.016084+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984955+0000","last_change":"2023-11-15T02:53:37.603600+0000","last_active":"2023-11-15T02:53:37.984955+0000","last_peered":"2023-11-15T02:53:37.984955+0000","last_clean":"2023-11-15T02:53:37.984955+0000","last_became_active":"2023-11-15T02:53:37.603284+0000","last_became_peered":"2023-11-15T02:53:37.603284+0000","last_unstale":"2023-11-15T02:53:37.984955+0000","last_undegraded":"2023-11-15T02:53:37.984955+0000","last_fullsized":"2023-11-15T02:53:37.984955+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:37.577352+0000","last_change":"2023-11-15T02:53:37.577352+0000","last_active":"2023-11-15T02:53:37.577352+0000","last_peered":"2023-11-15T02:53:37.577352+0000","last_clean":"2023-11-15T02:53:37.577352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:37.577352+0000","last_undegraded":"2023-11-15T02:53:37.577352+0000","last_fullsized":"2023-11-15T02:53:37.577352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002993+0000","last_change":"2023-11-15T02:53:37.600693+0000","last_active":"2023-11-15T02:53:38.002993+0000","last_peered":"2023-11-15T02:53:38.002993+0000","last_clean":"2023-11-15T02:53:38.002993+0000","last_became_active":"2023-11-15T02:53:37.600356+0000","last_became_peered":"2023-11-15T02:53:37.600356+0000","last_unstale":"2023-11-15T02:53:38.002993+0000","last_undegraded":"2023-11-15T02:53:38.002993+0000","last_fullsized":"2023-11-15T02:53:38.002993+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.007925+0000","last_change":"2023-11-15T02:53:38.004010+0000","last_active":"2023-11-15T02:53:38.007925+0000","last_peered":"2023-11-15T02:53:38.007925+0000","last_clean":"2023-11-15T02:53:38.007925+0000","last_became_active":"2023-11-15T02:53:38.003715+0000","last_became_peered":"2023-11-15T02:53:38.003715+0000","last_unstale":"2023-11-15T02:53:38.007925+0000","last_undegraded":"2023-11-15T02:53:38.007925+0000","last_fullsized":"2023-11-15T02:53:38.007925+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989453+0000","last_change":"2023-11-15T02:53:37.602439+0000","last_active":"2023-11-15T02:53:37.989453+0000","last_peered":"2023-11-15T02:53:37.989453+0000","last_clean":"2023-11-15T02:53:37.989453+0000","last_became_active":"2023-11-15T02:53:37.602154+0000","last_became_peered":"2023-11-15T02:53:37.602154+0000","last_unstale":"2023-11-15T02:53:37.989453+0000","last_undegraded":"2023-11-15T02:53:37.989453+0000","last_fullsized":"2023-11-15T02:53:37.989453+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009800+0000","last_change":"2023-11-15T02:53:38.006153+0000","last_active":"2023-11-15T02:53:38.009800+0000","last_peered":"2023-11-15T02:53:38.009800+0000","last_clean":"2023-11-15T02:53:38.009800+0000","last_became_active":"2023-11-15T02:53:38.005382+0000","last_became_peered":"2023-11-15T02:53:38.005382+0000","last_unstale":"2023-11-15T02:53:38.009800+0000","last_undegraded":"2023-11-15T02:53:38.009800+0000","last_fullsized":"2023-11-15T02:53:38.009800+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002479+0000","last_change":"2023-11-15T02:53:37.600307+0000","last_active":"2023-11-15T02:53:38.002479+0000","last_peered":"2023-11-15T02:53:38.002479+0000","last_clean":"2023-11-15T02:53:38.002479+0000","last_became_active":"2023-11-15T02:53:37.599973+0000","last_became_peered":"2023-11-15T02:53:37.599973+0000","last_unstale":"2023-11-15T02:53:38.002479+0000","last_undegraded":"2023-11-15T02:53:38.002479+0000","last_fullsized":"2023-11-15T02:53:38.002479+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006387+0000","last_change":"2023-11-15T02:53:38.000564+0000","last_active":"2023-11-15T02:53:38.006387+0000","last_peered":"2023-11-15T02:53:38.006387+0000","last_clean":"2023-11-15T02:53:38.006387+0000","last_became_active":"2023-11-15T02:53:38.000275+0000","last_became_peered":"2023-11-15T02:53:38.000275+0000","last_unstale":"2023-11-15T02:53:38.006387+0000","last_undegraded":"2023-11-15T02:53:38.006387+0000","last_fullsized":"2023-11-15T02:53:38.006387+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006231+0000","last_change":"2023-11-15T02:53:38.003771+0000","last_active":"2023-11-15T02:53:38.006231+0000","last_peered":"2023-11-15T02:53:38.006231+0000","last_clean":"2023-11-15T02:53:38.006231+0000","last_became_active":"2023-11-15T02:53:38.003121+0000","last_became_peered":"2023-11-15T02:53:38.003121+0000","last_unstale":"2023-11-15T02:53:38.006231+0000","last_undegraded":"2023-11-15T02:53:38.006231+0000","last_fullsized":"2023-11-15T02:53:38.006231+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987451+0000","last_change":"2023-11-15T02:53:37.596686+0000","last_active":"2023-11-15T02:53:37.987451+0000","last_peered":"2023-11-15T02:53:37.987451+0000","last_clean":"2023-11-15T02:53:37.987451+0000","last_became_active":"2023-11-15T02:53:37.596410+0000","last_became_peered":"2023-11-15T02:53:37.596410+0000","last_unstale":"2023-11-15T02:53:37.987451+0000","last_undegraded":"2023-11-15T02:53:37.987451+0000","last_fullsized":"2023-11-15T02:53:37.987451+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011367+0000","last_change":"2023-11-15T02:53:38.010715+0000","last_active":"2023-11-15T02:53:38.011367+0000","last_peered":"2023-11-15T02:53:38.011367+0000","last_clean":"2023-11-15T02:53:38.011367+0000","last_became_active":"2023-11-15T02:53:38.010419+0000","last_became_peered":"2023-11-15T02:53:38.010419+0000","last_unstale":"2023-11-15T02:53:38.011367+0000","last_undegraded":"2023-11-15T02:53:38.011367+0000","last_fullsized":"2023-11-15T02:53:38.011367+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999239+0000","last_change":"2023-11-15T02:53:37.994959+0000","last_active":"2023-11-15T02:53:37.999239+0000","last_peered":"2023-11-15T02:53:37.999239+0000","last_clean":"2023-11-15T02:53:37.999239+0000","last_became_active":"2023-11-15T02:53:37.994284+0000","last_became_peered":"2023-11-15T02:53:37.994284+0000","last_unstale":"2023-11-15T02:53:37.999239+0000","last_undegraded":"2023-11-15T02:53:37.999239+0000","last_fullsized":"2023-11-15T02:53:37.999239+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.997791+0000","last_change":"2023-11-15T02:53:37.600152+0000","last_active":"2023-11-15T02:53:37.997791+0000","last_peered":"2023-11-15T02:53:37.997791+0000","last_clean":"2023-11-15T02:53:37.997791+0000","last_became_active":"2023-11-15T02:53:37.599885+0000","last_became_peered":"2023-11-15T02:53:37.599885+0000","last_unstale":"2023-11-15T02:53:37.997791+0000","last_undegraded":"2023-11-15T02:53:37.997791+0000","last_fullsized":"2023-11-15T02:53:37.997791+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009330+0000","last_change":"2023-11-15T02:53:38.003735+0000","last_active":"2023-11-15T02:53:38.009330+0000","last_peered":"2023-11-15T02:53:38.009330+0000","last_clean":"2023-11-15T02:53:38.009330+0000","last_became_active":"2023-11-15T02:53:38.003432+0000","last_became_peered":"2023-11-15T02:53:38.003432+0000","last_unstale":"2023-11-15T02:53:38.009330+0000","last_undegraded":"2023-11-15T02:53:38.009330+0000","last_fullsized":"2023-11-15T02:53:38.009330+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.982577+0000","last_change":"2023-11-15T02:53:37.608038+0000","last_active":"2023-11-15T02:53:37.982577+0000","last_peered":"2023-11-15T02:53:37.982577+0000","last_clean":"2023-11-15T02:53:37.982577+0000","last_became_active":"2023-11-15T02:53:37.607545+0000","last_became_peered":"2023-11-15T02:53:37.607545+0000","last_unstale":"2023-11-15T02:53:37.982577+0000","last_undegraded":"2023-11-15T02:53:37.982577+0000","last_fullsized":"2023-11-15T02:53:37.982577+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005747+0000","last_change":"2023-11-15T02:53:38.000626+0000","last_active":"2023-11-15T02:53:38.005747+0000","last_peered":"2023-11-15T02:53:38.005747+0000","last_clean":"2023-11-15T02:53:38.005747+0000","last_became_active":"2023-11-15T02:53:38.000346+0000","last_became_peered":"2023-11-15T02:53:38.000346+0000","last_unstale":"2023-11-15T02:53:38.005747+0000","last_undegraded":"2023-11-15T02:53:38.005747+0000","last_fullsized":"2023-11-15T02:53:38.005747+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999272+0000","last_change":"2023-11-15T02:53:37.602774+0000","last_active":"2023-11-15T02:53:37.999272+0000","last_peered":"2023-11-15T02:53:37.999272+0000","last_clean":"2023-11-15T02:53:37.999272+0000","last_became_active":"2023-11-15T02:53:37.602261+0000","last_became_peered":"2023-11-15T02:53:37.602261+0000","last_unstale":"2023-11-15T02:53:37.999272+0000","last_undegraded":"2023-11-15T02:53:37.999272+0000","last_fullsized":"2023-11-15T02:53:37.999272+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005731+0000","last_change":"2023-11-15T02:53:38.004561+0000","last_active":"2023-11-15T02:53:38.005731+0000","last_peered":"2023-11-15T02:53:38.005731+0000","last_clean":"2023-11-15T02:53:38.005731+0000","last_became_active":"2023-11-15T02:53:38.004279+0000","last_became_peered":"2023-11-15T02:53:38.004279+0000","last_unstale":"2023-11-15T02:53:38.005731+0000","last_undegraded":"2023-11-15T02:53:38.005731+0000","last_fullsized":"2023-11-15T02:53:38.005731+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998408+0000","last_change":"2023-11-15T02:53:37.606814+0000","last_active":"2023-11-15T02:53:37.998408+0000","last_peered":"2023-11-15T02:53:37.998408+0000","last_clean":"2023-11-15T02:53:37.998408+0000","last_became_active":"2023-11-15T02:53:37.606517+0000","last_became_peered":"2023-11-15T02:53:37.606517+0000","last_unstale":"2023-11-15T02:53:37.998408+0000","last_undegraded":"2023-11-15T02:53:37.998408+0000","last_fullsized":"2023-11-15T02:53:37.998408+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002264+0000","last_change":"2023-11-15T02:53:37.998598+0000","last_active":"2023-11-15T02:53:38.002264+0000","last_peered":"2023-11-15T02:53:38.002264+0000","last_clean":"2023-11-15T02:53:38.002264+0000","last_became_active":"2023-11-15T02:53:37.998240+0000","last_became_peered":"2023-11-15T02:53:37.998240+0000","last_unstale":"2023-11-15T02:53:38.002264+0000","last_undegraded":"2023-11-15T02:53:38.002264+0000","last_fullsized":"2023-11-15T02:53:38.002264+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989840+0000","last_change":"2023-11-15T02:53:37.603875+0000","last_active":"2023-11-15T02:53:37.989840+0000","last_peered":"2023-11-15T02:53:37.989840+0000","last_clean":"2023-11-15T02:53:37.989840+0000","last_became_active":"2023-11-15T02:53:37.603204+0000","last_became_peered":"2023-11-15T02:53:37.603204+0000","last_unstale":"2023-11-15T02:53:37.989840+0000","last_undegraded":"2023-11-15T02:53:37.989840+0000","last_fullsized":"2023-11-15T02:53:37.989840+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010801+0000","last_change":"2023-11-15T02:53:38.009250+0000","last_active":"2023-11-15T02:53:38.010801+0000","last_peered":"2023-11-15T02:53:38.010801+0000","last_clean":"2023-11-15T02:53:38.010801+0000","last_became_active":"2023-11-15T02:53:38.009018+0000","last_became_peered":"2023-11-15T02:53:38.009018+0000","last_unstale":"2023-11-15T02:53:38.010801+0000","last_undegraded":"2023-11-15T02:53:38.010801+0000","last_fullsized":"2023-11-15T02:53:38.010801+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.986167+0000","last_change":"2023-11-15T02:53:37.604578+0000","last_active":"2023-11-15T02:53:37.986167+0000","last_peered":"2023-11-15T02:53:37.986167+0000","last_clean":"2023-11-15T02:53:37.986167+0000","last_became_active":"2023-11-15T02:53:37.604300+0000","last_became_peered":"2023-11-15T02:53:37.604300+0000","last_unstale":"2023-11-15T02:53:37.986167+0000","last_undegraded":"2023-11-15T02:53:37.986167+0000","last_fullsized":"2023-11-15T02:53:37.986167+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:37.577352+0000","last_change":"2023-11-15T02:53:37.577352+0000","last_active":"2023-11-15T02:53:37.577352+0000","last_peered":"2023-11-15T02:53:37.577352+0000","last_clean":"2023-11-15T02:53:37.577352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:37.577352+0000","last_undegraded":"2023-11-15T02:53:37.577352+0000","last_fullsized":"2023-11-15T02:53:37.577352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.986004+0000","last_change":"2023-11-15T02:53:37.608032+0000","last_active":"2023-11-15T02:53:37.986004+0000","last_peered":"2023-11-15T02:53:37.986004+0000","last_clean":"2023-11-15T02:53:37.986004+0000","last_became_active":"2023-11-15T02:53:37.607639+0000","last_became_peered":"2023-11-15T02:53:37.607639+0000","last_unstale":"2023-11-15T02:53:37.986004+0000","last_undegraded":"2023-11-15T02:53:37.986004+0000","last_fullsized":"2023-11-15T02:53:37.986004+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009389+0000","last_change":"2023-11-15T02:53:38.008531+0000","last_active":"2023-11-15T02:53:38.009389+0000","last_peered":"2023-11-15T02:53:38.009389+0000","last_clean":"2023-11-15T02:53:38.009389+0000","last_became_active":"2023-11-15T02:53:38.008308+0000","last_became_peered":"2023-11-15T02:53:38.008308+0000","last_unstale":"2023-11-15T02:53:38.009389+0000","last_undegraded":"2023-11-15T02:53:38.009389+0000","last_fullsized":"2023-11-15T02:53:38.009389+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984117+0000","last_change":"2023-11-15T02:53:37.603697+0000","last_active":"2023-11-15T02:53:37.984117+0000","last_peered":"2023-11-15T02:53:37.984117+0000","last_clean":"2023-11-15T02:53:37.984117+0000","last_became_active":"2023-11-15T02:53:37.603383+0000","last_became_peered":"2023-11-15T02:53:37.603383+0000","last_unstale":"2023-11-15T02:53:37.984117+0000","last_undegraded":"2023-11-15T02:53:37.984117+0000","last_fullsized":"2023-11-15T02:53:37.984117+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009909+0000","last_change":"2023-11-15T02:53:38.006412+0000","last_active":"2023-11-15T02:53:38.009909+0000","last_peered":"2023-11-15T02:53:38.009909+0000","last_clean":"2023-11-15T02:53:38.009909+0000","last_became_active":"2023-11-15T02:53:38.006097+0000","last_became_peered":"2023-11-15T02:53:38.006097+0000","last_unstale":"2023-11-15T02:53:38.009909+0000","last_undegraded":"2023-11-15T02:53:38.009909+0000","last_fullsized":"2023-11-15T02:53:38.009909+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999987+0000","last_change":"2023-11-15T02:53:37.605820+0000","last_active":"2023-11-15T02:53:37.999987+0000","last_peered":"2023-11-15T02:53:37.999987+0000","last_clean":"2023-11-15T02:53:37.999987+0000","last_became_active":"2023-11-15T02:53:37.605501+0000","last_became_peered":"2023-11-15T02:53:37.605501+0000","last_unstale":"2023-11-15T02:53:37.999987+0000","last_undegraded":"2023-11-15T02:53:37.999987+0000","last_fullsized":"2023-11-15T02:53:37.999987+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006092+0000","last_change":"2023-11-15T02:53:38.004891+0000","last_active":"2023-11-15T02:53:38.006092+0000","last_peered":"2023-11-15T02:53:38.006092+0000","last_clean":"2023-11-15T02:53:38.006092+0000","last_became_active":"2023-11-15T02:53:38.004627+0000","last_became_peered":"2023-11-15T02:53:38.004627+0000","last_unstale":"2023-11-15T02:53:38.006092+0000","last_undegraded":"2023-11-15T02:53:38.006092+0000","last_fullsized":"2023-11-15T02:53:38.006092+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003886+0000","last_change":"2023-11-15T02:53:37.607870+0000","last_active":"2023-11-15T02:53:38.003886+0000","last_peered":"2023-11-15T02:53:38.003886+0000","last_clean":"2023-11-15T02:53:38.003886+0000","last_became_active":"2023-11-15T02:53:37.607197+0000","last_became_peered":"2023-11-15T02:53:37.607197+0000","last_unstale":"2023-11-15T02:53:38.003886+0000","last_undegraded":"2023-11-15T02:53:38.003886+0000","last_fullsized":"2023-11-15T02:53:38.003886+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998637+0000","last_change":"2023-11-15T02:53:37.991469+0000","last_active":"2023-11-15T02:53:37.998637+0000","last_peered":"2023-11-15T02:53:37.998637+0000","last_clean":"2023-11-15T02:53:37.998637+0000","last_became_active":"2023-11-15T02:53:37.991176+0000","last_became_peered":"2023-11-15T02:53:37.991176+0000","last_unstale":"2023-11-15T02:53:37.998637+0000","last_undegraded":"2023-11-15T02:53:37.998637+0000","last_fullsized":"2023-11-15T02:53:37.998637+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009368+0000","last_change":"2023-11-15T02:53:37.602556+0000","last_active":"2023-11-15T02:53:38.009368+0000","last_peered":"2023-11-15T02:53:38.009368+0000","last_clean":"2023-11-15T02:53:38.009368+0000","last_became_active":"2023-11-15T02:53:37.601820+0000","last_became_peered":"2023-11-15T02:53:37.601820+0000","last_unstale":"2023-11-15T02:53:38.009368+0000","last_undegraded":"2023-11-15T02:53:38.009368+0000","last_fullsized":"2023-11-15T02:53:38.009368+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010539+0000","last_change":"2023-11-15T02:53:38.005868+0000","last_active":"2023-11-15T02:53:38.010539+0000","last_peered":"2023-11-15T02:53:38.010539+0000","last_clean":"2023-11-15T02:53:38.010539+0000","last_became_active":"2023-11-15T02:53:38.005558+0000","last_became_peered":"2023-11-15T02:53:38.005558+0000","last_unstale":"2023-11-15T02:53:38.010539+0000","last_undegraded":"2023-11-15T02:53:38.010539+0000","last_fullsized":"2023-11-15T02:53:38.010539+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987451+0000","last_change":"2023-11-15T02:53:37.601130+0000","last_active":"2023-11-15T02:53:37.987451+0000","last_peered":"2023-11-15T02:53:37.987451+0000","last_clean":"2023-11-15T02:53:37.987451+0000","last_became_active":"2023-11-15T02:53:37.600820+0000","last_became_peered":"2023-11-15T02:53:37.600820+0000","last_unstale":"2023-11-15T02:53:37.987451+0000","last_undegraded":"2023-11-15T02:53:37.987451+0000","last_fullsized":"2023-11-15T02:53:37.987451+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003379+0000","last_change":"2023-11-15T02:53:38.001102+0000","last_active":"2023-11-15T02:53:38.003379+0000","last_peered":"2023-11-15T02:53:38.003379+0000","last_clean":"2023-11-15T02:53:38.003379+0000","last_became_active":"2023-11-15T02:53:38.000814+0000","last_became_peered":"2023-11-15T02:53:38.000814+0000","last_unstale":"2023-11-15T02:53:38.003379+0000","last_undegraded":"2023-11-15T02:53:38.003379+0000","last_fullsized":"2023-11-15T02:53:38.003379+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998161+0000","last_change":"2023-11-15T02:53:37.609358+0000","last_active":"2023-11-15T02:53:37.998161+0000","last_peered":"2023-11-15T02:53:37.998161+0000","last_clean":"2023-11-15T02:53:37.998161+0000","last_became_active":"2023-11-15T02:53:37.608596+0000","last_became_peered":"2023-11-15T02:53:37.608596+0000","last_unstale":"2023-11-15T02:53:37.998161+0000","last_undegraded":"2023-11-15T02:53:37.998161+0000","last_fullsized":"2023-11-15T02:53:37.998161+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.995398+0000","last_change":"2023-11-15T02:53:37.993686+0000","last_active":"2023-11-15T02:53:37.995398+0000","last_peered":"2023-11-15T02:53:37.995398+0000","last_clean":"2023-11-15T02:53:37.995398+0000","last_became_active":"2023-11-15T02:53:37.993388+0000","last_became_peered":"2023-11-15T02:53:37.993388+0000","last_unstale":"2023-11-15T02:53:37.995398+0000","last_undegraded":"2023-11-15T02:53:37.995398+0000","last_fullsized":"2023-11-15T02:53:37.995398+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.982323+0000","last_change":"2023-11-15T02:53:37.607029+0000","last_active":"2023-11-15T02:53:37.982323+0000","last_peered":"2023-11-15T02:53:37.982323+0000","last_clean":"2023-11-15T02:53:37.982323+0000","last_became_active":"2023-11-15T02:53:37.606692+0000","last_became_peered":"2023-11-15T02:53:37.606692+0000","last_unstale":"2023-11-15T02:53:37.982323+0000","last_undegraded":"2023-11-15T02:53:37.982323+0000","last_fullsized":"2023-11-15T02:53:37.982323+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006246+0000","last_change":"2023-11-15T02:53:38.003944+0000","last_active":"2023-11-15T02:53:38.006246+0000","last_peered":"2023-11-15T02:53:38.006246+0000","last_clean":"2023-11-15T02:53:38.006246+0000","last_became_active":"2023-11-15T02:53:38.003507+0000","last_became_peered":"2023-11-15T02:53:38.003507+0000","last_unstale":"2023-11-15T02:53:38.006246+0000","last_undegraded":"2023-11-15T02:53:38.006246+0000","last_fullsized":"2023-11-15T02:53:38.006246+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987342+0000","last_change":"2023-11-15T02:53:37.609959+0000","last_active":"2023-11-15T02:53:37.987342+0000","last_peered":"2023-11-15T02:53:37.987342+0000","last_clean":"2023-11-15T02:53:37.987342+0000","last_became_active":"2023-11-15T02:53:37.609646+0000","last_became_peered":"2023-11-15T02:53:37.609646+0000","last_unstale":"2023-11-15T02:53:37.987342+0000","last_undegraded":"2023-11-15T02:53:37.987342+0000","last_fullsized":"2023-11-15T02:53:37.987342+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008553+0000","last_change":"2023-11-15T02:53:38.007038+0000","last_active":"2023-11-15T02:53:38.008553+0000","last_peered":"2023-11-15T02:53:38.008553+0000","last_clean":"2023-11-15T02:53:38.008553+0000","last_became_active":"2023-11-15T02:53:38.006729+0000","last_became_peered":"2023-11-15T02:53:38.006729+0000","last_unstale":"2023-11-15T02:53:38.008553+0000","last_undegraded":"2023-11-15T02:53:38.008553+0000","last_fullsized":"2023-11-15T02:53:38.008553+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.996205+0000","last_change":"2023-11-15T02:53:37.606243+0000","last_active":"2023-11-15T02:53:37.996205+0000","last_peered":"2023-11-15T02:53:37.996205+0000","last_clean":"2023-11-15T02:53:37.996205+0000","last_became_active":"2023-11-15T02:53:37.605925+0000","last_became_peered":"2023-11-15T02:53:37.605925+0000","last_unstale":"2023-11-15T02:53:37.996205+0000","last_undegraded":"2023-11-15T02:53:37.996205+0000","last_fullsized":"2023-11-15T02:53:37.996205+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005006+0000","last_change":"2023-11-15T02:53:38.002861+0000","last_active":"2023-11-15T02:53:38.005006+0000","last_peered":"2023-11-15T02:53:38.005006+0000","last_clean":"2023-11-15T02:53:38.005006+0000","last_became_active":"2023-11-15T02:53:38.002540+0000","last_became_peered":"2023-11-15T02:53:38.002540+0000","last_unstale":"2023-11-15T02:53:38.005006+0000","last_undegraded":"2023-11-15T02:53:38.005006+0000","last_fullsized":"2023-11-15T02:53:38.005006+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.004585+0000","last_change":"2023-11-15T02:53:37.607128+0000","last_active":"2023-11-15T02:53:38.004585+0000","last_peered":"2023-11-15T02:53:38.004585+0000","last_clean":"2023-11-15T02:53:38.004585+0000","last_became_active":"2023-11-15T02:53:37.606792+0000","last_became_peered":"2023-11-15T02:53:37.606792+0000","last_unstale":"2023-11-15T02:53:38.004585+0000","last_undegraded":"2023-11-15T02:53:38.004585+0000","last_fullsized":"2023-11-15T02:53:38.004585+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:37.577352+0000","last_change":"2023-11-15T02:53:37.577352+0000","last_active":"2023-11-15T02:53:37.577352+0000","last_peered":"2023-11-15T02:53:37.577352+0000","last_clean":"2023-11-15T02:53:37.577352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:37.577352+0000","last_undegraded":"2023-11-15T02:53:37.577352+0000","last_fullsized":"2023-11-15T02:53:37.577352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006720+0000","last_change":"2023-11-15T02:53:37.605340+0000","last_active":"2023-11-15T02:53:38.006720+0000","last_peered":"2023-11-15T02:53:38.006720+0000","last_clean":"2023-11-15T02:53:38.006720+0000","last_became_active":"2023-11-15T02:53:37.604736+0000","last_became_peered":"2023-11-15T02:53:37.604736+0000","last_unstale":"2023-11-15T02:53:38.006720+0000","last_undegraded":"2023-11-15T02:53:38.006720+0000","last_fullsized":"2023-11-15T02:53:38.006720+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009363+0000","last_change":"2023-11-15T02:53:38.004869+0000","last_active":"2023-11-15T02:53:38.009363+0000","last_peered":"2023-11-15T02:53:38.009363+0000","last_clean":"2023-11-15T02:53:38.009363+0000","last_became_active":"2023-11-15T02:53:38.004603+0000","last_became_peered":"2023-11-15T02:53:38.004603+0000","last_unstale":"2023-11-15T02:53:38.009363+0000","last_undegraded":"2023-11-15T02:53:38.009363+0000","last_fullsized":"2023-11-15T02:53:38.009363+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.982661+0000","last_change":"2023-11-15T02:53:37.599911+0000","last_active":"2023-11-15T02:53:37.982661+0000","last_peered":"2023-11-15T02:53:37.982661+0000","last_clean":"2023-11-15T02:53:37.982661+0000","last_became_active":"2023-11-15T02:53:37.599611+0000","last_became_peered":"2023-11-15T02:53:37.599611+0000","last_unstale":"2023-11-15T02:53:37.982661+0000","last_undegraded":"2023-11-15T02:53:37.982661+0000","last_fullsized":"2023-11-15T02:53:37.982661+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011156+0000","last_change":"2023-11-15T02:53:38.006173+0000","last_active":"2023-11-15T02:53:38.011156+0000","last_peered":"2023-11-15T02:53:38.011156+0000","last_clean":"2023-11-15T02:53:38.011156+0000","last_became_active":"2023-11-15T02:53:38.005873+0000","last_became_peered":"2023-11-15T02:53:38.005873+0000","last_unstale":"2023-11-15T02:53:38.011156+0000","last_undegraded":"2023-11-15T02:53:38.011156+0000","last_fullsized":"2023-11-15T02:53:38.011156+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998518+0000","last_change":"2023-11-15T02:53:37.609046+0000","last_active":"2023-11-15T02:53:37.998518+0000","last_peered":"2023-11-15T02:53:37.998518+0000","last_clean":"2023-11-15T02:53:37.998518+0000","last_became_active":"2023-11-15T02:53:37.608665+0000","last_became_peered":"2023-11-15T02:53:37.608665+0000","last_unstale":"2023-11-15T02:53:37.998518+0000","last_undegraded":"2023-11-15T02:53:37.998518+0000","last_fullsized":"2023-11-15T02:53:37.998518+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009819+0000","last_change":"2023-11-15T02:53:38.006320+0000","last_active":"2023-11-15T02:53:38.009819+0000","last_peered":"2023-11-15T02:53:38.009819+0000","last_clean":"2023-11-15T02:53:38.009819+0000","last_became_active":"2023-11-15T02:53:38.005786+0000","last_became_peered":"2023-11-15T02:53:38.005786+0000","last_unstale":"2023-11-15T02:53:38.009819+0000","last_undegraded":"2023-11-15T02:53:38.009819+0000","last_fullsized":"2023-11-15T02:53:38.009819+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001944+0000","last_change":"2023-11-15T02:53:37.599390+0000","last_active":"2023-11-15T02:53:38.001944+0000","last_peered":"2023-11-15T02:53:38.001944+0000","last_clean":"2023-11-15T02:53:38.001944+0000","last_became_active":"2023-11-15T02:53:37.598476+0000","last_became_peered":"2023-11-15T02:53:37.598476+0000","last_unstale":"2023-11-15T02:53:38.001944+0000","last_undegraded":"2023-11-15T02:53:38.001944+0000","last_fullsized":"2023-11-15T02:53:38.001944+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009422+0000","last_change":"2023-11-15T02:53:38.005651+0000","last_active":"2023-11-15T02:53:38.009422+0000","last_peered":"2023-11-15T02:53:38.009422+0000","last_clean":"2023-11-15T02:53:38.009422+0000","last_became_active":"2023-11-15T02:53:38.005405+0000","last_became_peered":"2023-11-15T02:53:38.005405+0000","last_unstale":"2023-11-15T02:53:38.009422+0000","last_undegraded":"2023-11-15T02:53:38.009422+0000","last_fullsized":"2023-11-15T02:53:38.009422+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.996886+0000","last_change":"2023-11-15T02:53:37.603759+0000","last_active":"2023-11-15T02:53:37.996886+0000","last_peered":"2023-11-15T02:53:37.996886+0000","last_clean":"2023-11-15T02:53:37.996886+0000","last_became_active":"2023-11-15T02:53:37.603485+0000","last_became_peered":"2023-11-15T02:53:37.603485+0000","last_unstale":"2023-11-15T02:53:37.996886+0000","last_undegraded":"2023-11-15T02:53:37.996886+0000","last_fullsized":"2023-11-15T02:53:37.996886+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999205+0000","last_change":"2023-11-15T02:53:37.998244+0000","last_active":"2023-11-15T02:53:37.999205+0000","last_peered":"2023-11-15T02:53:37.999205+0000","last_clean":"2023-11-15T02:53:37.999205+0000","last_became_active":"2023-11-15T02:53:37.997925+0000","last_became_peered":"2023-11-15T02:53:37.997925+0000","last_unstale":"2023-11-15T02:53:37.999205+0000","last_undegraded":"2023-11-15T02:53:37.999205+0000","last_fullsized":"2023-11-15T02:53:37.999205+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987621+0000","last_change":"2023-11-15T02:53:37.595509+0000","last_active":"2023-11-15T02:53:37.987621+0000","last_peered":"2023-11-15T02:53:37.987621+0000","last_clean":"2023-11-15T02:53:37.987621+0000","last_became_active":"2023-11-15T02:53:37.595150+0000","last_became_peered":"2023-11-15T02:53:37.595150+0000","last_unstale":"2023-11-15T02:53:37.987621+0000","last_undegraded":"2023-11-15T02:53:37.987621+0000","last_fullsized":"2023-11-15T02:53:37.987621+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006014+0000","last_change":"2023-11-15T02:53:37.998617+0000","last_active":"2023-11-15T02:53:38.006014+0000","last_peered":"2023-11-15T02:53:38.006014+0000","last_clean":"2023-11-15T02:53:38.006014+0000","last_became_active":"2023-11-15T02:53:37.998336+0000","last_became_peered":"2023-11-15T02:53:37.998336+0000","last_unstale":"2023-11-15T02:53:38.006014+0000","last_undegraded":"2023-11-15T02:53:38.006014+0000","last_fullsized":"2023-11-15T02:53:38.006014+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992794+0000","last_change":"2023-11-15T02:53:37.605177+0000","last_active":"2023-11-15T02:53:37.992794+0000","last_peered":"2023-11-15T02:53:37.992794+0000","last_clean":"2023-11-15T02:53:37.992794+0000","last_became_active":"2023-11-15T02:53:37.604785+0000","last_became_peered":"2023-11-15T02:53:37.604785+0000","last_unstale":"2023-11-15T02:53:37.992794+0000","last_undegraded":"2023-11-15T02:53:37.992794+0000","last_fullsized":"2023-11-15T02:53:37.992794+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009156+0000","last_change":"2023-11-15T02:53:38.005499+0000","last_active":"2023-11-15T02:53:38.009156+0000","last_peered":"2023-11-15T02:53:38.009156+0000","last_clean":"2023-11-15T02:53:38.009156+0000","last_became_active":"2023-11-15T02:53:38.005211+0000","last_became_peered":"2023-11-15T02:53:38.005211+0000","last_unstale":"2023-11-15T02:53:38.009156+0000","last_undegraded":"2023-11-15T02:53:38.009156+0000","last_fullsized":"2023-11-15T02:53:38.009156+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005286+0000","last_change":"2023-11-15T02:53:37.593975+0000","last_active":"2023-11-15T02:53:38.005286+0000","last_peered":"2023-11-15T02:53:38.005286+0000","last_clean":"2023-11-15T02:53:38.005286+0000","last_became_active":"2023-11-15T02:53:37.593701+0000","last_became_peered":"2023-11-15T02:53:37.593701+0000","last_unstale":"2023-11-15T02:53:38.005286+0000","last_undegraded":"2023-11-15T02:53:38.005286+0000","last_fullsized":"2023-11-15T02:53:38.005286+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003057+0000","last_change":"2023-11-15T02:53:37.998034+0000","last_active":"2023-11-15T02:53:38.003057+0000","last_peered":"2023-11-15T02:53:38.003057+0000","last_clean":"2023-11-15T02:53:38.003057+0000","last_became_active":"2023-11-15T02:53:37.997729+0000","last_became_peered":"2023-11-15T02:53:37.997729+0000","last_unstale":"2023-11-15T02:53:38.003057+0000","last_undegraded":"2023-11-15T02:53:38.003057+0000","last_fullsized":"2023-11-15T02:53:38.003057+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.985057+0000","last_change":"2023-11-15T02:53:37.610489+0000","last_active":"2023-11-15T02:53:37.985057+0000","last_peered":"2023-11-15T02:53:37.985057+0000","last_clean":"2023-11-15T02:53:37.985057+0000","last_became_active":"2023-11-15T02:53:37.610002+0000","last_became_peered":"2023-11-15T02:53:37.610002+0000","last_unstale":"2023-11-15T02:53:37.985057+0000","last_undegraded":"2023-11-15T02:53:37.985057+0000","last_fullsized":"2023-11-15T02:53:37.985057+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002358+0000","last_change":"2023-11-15T02:53:38.000481+0000","last_active":"2023-11-15T02:53:38.002358+0000","last_peered":"2023-11-15T02:53:38.002358+0000","last_clean":"2023-11-15T02:53:38.002358+0000","last_became_active":"2023-11-15T02:53:38.000196+0000","last_became_peered":"2023-11-15T02:53:38.000196+0000","last_unstale":"2023-11-15T02:53:38.002358+0000","last_undegraded":"2023-11-15T02:53:38.002358+0000","last_fullsized":"2023-11-15T02:53:38.002358+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984215+0000","last_change":"2023-11-15T02:53:37.601783+0000","last_active":"2023-11-15T02:53:37.984215+0000","last_peered":"2023-11-15T02:53:37.984215+0000","last_clean":"2023-11-15T02:53:37.984215+0000","last_became_active":"2023-11-15T02:53:37.601473+0000","last_became_peered":"2023-11-15T02:53:37.601473+0000","last_unstale":"2023-11-15T02:53:37.984215+0000","last_undegraded":"2023-11-15T02:53:37.984215+0000","last_fullsized":"2023-11-15T02:53:37.984215+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002345+0000","last_change":"2023-11-15T02:53:37.997031+0000","last_active":"2023-11-15T02:53:38.002345+0000","last_peered":"2023-11-15T02:53:38.002345+0000","last_clean":"2023-11-15T02:53:38.002345+0000","last_became_active":"2023-11-15T02:53:37.996771+0000","last_became_peered":"2023-11-15T02:53:37.996771+0000","last_unstale":"2023-11-15T02:53:38.002345+0000","last_undegraded":"2023-11-15T02:53:38.002345+0000","last_fullsized":"2023-11-15T02:53:38.002345+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987557+0000","last_change":"2023-11-15T02:53:37.603411+0000","last_active":"2023-11-15T02:53:37.987557+0000","last_peered":"2023-11-15T02:53:37.987557+0000","last_clean":"2023-11-15T02:53:37.987557+0000","last_became_active":"2023-11-15T02:53:37.603095+0000","last_became_peered":"2023-11-15T02:53:37.603095+0000","last_unstale":"2023-11-15T02:53:37.987557+0000","last_undegraded":"2023-11-15T02:53:37.987557+0000","last_fullsized":"2023-11-15T02:53:37.987557+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.000207+0000","last_change":"2023-11-15T02:53:37.992925+0000","last_active":"2023-11-15T02:53:38.000207+0000","last_peered":"2023-11-15T02:53:38.000207+0000","last_clean":"2023-11-15T02:53:38.000207+0000","last_became_active":"2023-11-15T02:53:37.991495+0000","last_became_peered":"2023-11-15T02:53:37.991495+0000","last_unstale":"2023-11-15T02:53:38.000207+0000","last_undegraded":"2023-11-15T02:53:38.000207+0000","last_fullsized":"2023-11-15T02:53:38.000207+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.986519+0000","last_change":"2023-11-15T02:53:37.602735+0000","last_active":"2023-11-15T02:53:37.986519+0000","last_peered":"2023-11-15T02:53:37.986519+0000","last_clean":"2023-11-15T02:53:37.986519+0000","last_became_active":"2023-11-15T02:53:37.602437+0000","last_became_peered":"2023-11-15T02:53:37.602437+0000","last_unstale":"2023-11-15T02:53:37.986519+0000","last_undegraded":"2023-11-15T02:53:37.986519+0000","last_fullsized":"2023-11-15T02:53:37.986519+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010619+0000","last_change":"2023-11-15T02:53:38.006525+0000","last_active":"2023-11-15T02:53:38.010619+0000","last_peered":"2023-11-15T02:53:38.010619+0000","last_clean":"2023-11-15T02:53:38.010619+0000","last_became_active":"2023-11-15T02:53:38.006118+0000","last_became_peered":"2023-11-15T02:53:38.006118+0000","last_unstale":"2023-11-15T02:53:38.010619+0000","last_undegraded":"2023-11-15T02:53:38.010619+0000","last_fullsized":"2023-11-15T02:53:38.010619+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.985276+0000","last_change":"2023-11-15T02:53:37.604591+0000","last_active":"2023-11-15T02:53:37.985276+0000","last_peered":"2023-11-15T02:53:37.985276+0000","last_clean":"2023-11-15T02:53:37.985276+0000","last_became_active":"2023-11-15T02:53:37.604050+0000","last_became_peered":"2023-11-15T02:53:37.604050+0000","last_unstale":"2023-11-15T02:53:37.985276+0000","last_undegraded":"2023-11-15T02:53:37.985276+0000","last_fullsized":"2023-11-15T02:53:37.985276+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009789+0000","last_change":"2023-11-15T02:53:38.005163+0000","last_active":"2023-11-15T02:53:38.009789+0000","last_peered":"2023-11-15T02:53:38.009789+0000","last_clean":"2023-11-15T02:53:38.009789+0000","last_became_active":"2023-11-15T02:53:38.004858+0000","last_became_peered":"2023-11-15T02:53:38.004858+0000","last_unstale":"2023-11-15T02:53:38.009789+0000","last_undegraded":"2023-11-15T02:53:38.009789+0000","last_fullsized":"2023-11-15T02:53:38.009789+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001263+0000","last_change":"2023-11-15T02:53:37.603691+0000","last_active":"2023-11-15T02:53:38.001263+0000","last_peered":"2023-11-15T02:53:38.001263+0000","last_clean":"2023-11-15T02:53:38.001263+0000","last_became_active":"2023-11-15T02:53:37.603376+0000","last_became_peered":"2023-11-15T02:53:37.603376+0000","last_unstale":"2023-11-15T02:53:38.001263+0000","last_undegraded":"2023-11-15T02:53:38.001263+0000","last_fullsized":"2023-11-15T02:53:38.001263+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009156+0000","last_change":"2023-11-15T02:53:38.007691+0000","last_active":"2023-11-15T02:53:38.009156+0000","last_peered":"2023-11-15T02:53:38.009156+0000","last_clean":"2023-11-15T02:53:38.009156+0000","last_became_active":"2023-11-15T02:53:38.007438+0000","last_became_peered":"2023-11-15T02:53:38.007438+0000","last_unstale":"2023-11-15T02:53:38.009156+0000","last_undegraded":"2023-11-15T02:53:38.009156+0000","last_fullsized":"2023-11-15T02:53:38.009156+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.981762+0000","last_change":"2023-11-15T02:53:37.607898+0000","last_active":"2023-11-15T02:53:37.981762+0000","last_peered":"2023-11-15T02:53:37.981762+0000","last_clean":"2023-11-15T02:53:37.981762+0000","last_became_active":"2023-11-15T02:53:37.607133+0000","last_became_peered":"2023-11-15T02:53:37.607133+0000","last_unstale":"2023-11-15T02:53:37.981762+0000","last_undegraded":"2023-11-15T02:53:37.981762+0000","last_fullsized":"2023-11-15T02:53:37.981762+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010798+0000","last_change":"2023-11-15T02:53:38.009352+0000","last_active":"2023-11-15T02:53:38.010798+0000","last_peered":"2023-11-15T02:53:38.010798+0000","last_clean":"2023-11-15T02:53:38.010798+0000","last_became_active":"2023-11-15T02:53:38.007690+0000","last_became_peered":"2023-11-15T02:53:38.007690+0000","last_unstale":"2023-11-15T02:53:38.010798+0000","last_undegraded":"2023-11-15T02:53:38.010798+0000","last_fullsized":"2023-11-15T02:53:38.010798+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003527+0000","last_change":"2023-11-15T02:53:37.607389+0000","last_active":"2023-11-15T02:53:38.003527+0000","last_peered":"2023-11-15T02:53:38.003527+0000","last_clean":"2023-11-15T02:53:38.003527+0000","last_became_active":"2023-11-15T02:53:37.607111+0000","last_became_peered":"2023-11-15T02:53:37.607111+0000","last_unstale":"2023-11-15T02:53:38.003527+0000","last_undegraded":"2023-11-15T02:53:38.003527+0000","last_fullsized":"2023-11-15T02:53:38.003527+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998721+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:53:37.998721+0000","last_peered":"2023-11-15T02:53:37.998721+0000","last_clean":"2023-11-15T02:53:37.998721+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:53:37.998721+0000","last_undegraded":"2023-11-15T02:53:37.998721+0000","last_fullsized":"2023-11-15T02:53:37.998721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009887+0000","last_change":"2023-11-15T02:53:38.006186+0000","last_active":"2023-11-15T02:53:38.009887+0000","last_peered":"2023-11-15T02:53:38.009887+0000","last_clean":"2023-11-15T02:53:38.009887+0000","last_became_active":"2023-11-15T02:53:38.005653+0000","last_became_peered":"2023-11-15T02:53:38.005653+0000","last_unstale":"2023-11-15T02:53:38.009887+0000","last_undegraded":"2023-11-15T02:53:38.009887+0000","last_fullsized":"2023-11-15T02:53:38.009887+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984526+0000","last_change":"2023-11-15T02:53:37.610922+0000","last_active":"2023-11-15T02:53:37.984526+0000","last_peered":"2023-11-15T02:53:37.984526+0000","last_clean":"2023-11-15T02:53:37.984526+0000","last_became_active":"2023-11-15T02:53:37.610028+0000","last_became_peered":"2023-11-15T02:53:37.610028+0000","last_unstale":"2023-11-15T02:53:37.984526+0000","last_undegraded":"2023-11-15T02:53:37.984526+0000","last_fullsized":"2023-11-15T02:53:37.984526+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":162,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.997839+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:53:37.997839+0000","last_peered":"2023-11-15T02:53:37.997839+0000","last_clean":"2023-11-15T02:53:37.997839+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:53:37.997839+0000","last_undegraded":"2023-11-15T02:53:37.997839+0000","last_fullsized":"2023-11-15T02:53:37.997839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.996916+0000","last_change":"2023-11-15T02:53:37.995964+0000","last_active":"2023-11-15T02:53:37.996916+0000","last_peered":"2023-11-15T02:53:37.996916+0000","last_clean":"2023-11-15T02:53:37.996916+0000","last_became_active":"2023-11-15T02:53:37.995659+0000","last_became_peered":"2023-11-15T02:53:37.995659+0000","last_unstale":"2023-11-15T02:53:37.996916+0000","last_undegraded":"2023-11-15T02:53:37.996916+0000","last_fullsized":"2023-11-15T02:53:37.996916+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.004104+0000","last_change":"2023-11-15T02:53:37.610832+0000","last_active":"2023-11-15T02:53:38.004104+0000","last_peered":"2023-11-15T02:53:38.004104+0000","last_clean":"2023-11-15T02:53:38.004104+0000","last_became_active":"2023-11-15T02:53:37.610517+0000","last_became_peered":"2023-11-15T02:53:37.610517+0000","last_unstale":"2023-11-15T02:53:38.004104+0000","last_undegraded":"2023-11-15T02:53:38.004104+0000","last_fullsized":"2023-11-15T02:53:38.004104+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987235+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:53:37.987235+0000","last_peered":"2023-11-15T02:53:37.987235+0000","last_clean":"2023-11-15T02:53:37.987235+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:53:37.987235+0000","last_undegraded":"2023-11-15T02:53:37.987235+0000","last_fullsized":"2023-11-15T02:53:37.987235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008034+0000","last_change":"2023-11-15T02:53:38.004908+0000","last_active":"2023-11-15T02:53:38.008034+0000","last_peered":"2023-11-15T02:53:38.008034+0000","last_clean":"2023-11-15T02:53:38.008034+0000","last_became_active":"2023-11-15T02:53:38.004646+0000","last_became_peered":"2023-11-15T02:53:38.004646+0000","last_unstale":"2023-11-15T02:53:38.008034+0000","last_undegraded":"2023-11-15T02:53:38.008034+0000","last_fullsized":"2023-11-15T02:53:38.008034+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984950+0000","last_change":"2023-11-15T02:53:37.611678+0000","last_active":"2023-11-15T02:53:37.984950+0000","last_peered":"2023-11-15T02:53:37.984950+0000","last_clean":"2023-11-15T02:53:37.984950+0000","last_became_active":"2023-11-15T02:53:37.610384+0000","last_became_peered":"2023-11-15T02:53:37.610384+0000","last_unstale":"2023-11-15T02:53:37.984950+0000","last_undegraded":"2023-11-15T02:53:37.984950+0000","last_fullsized":"2023-11-15T02:53:37.984950+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":162,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989854+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:53:37.989854+0000","last_peered":"2023-11-15T02:53:37.989854+0000","last_clean":"2023-11-15T02:53:37.989854+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:53:37.989854+0000","last_undegraded":"2023-11-15T02:53:37.989854+0000","last_fullsized":"2023-11-15T02:53:37.989854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992682+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:53:37.992682+0000","last_peered":"2023-11-15T02:53:37.992682+0000","last_clean":"2023-11-15T02:53:37.992682+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:53:37.992682+0000","last_undegraded":"2023-11-15T02:53:37.992682+0000","last_fullsized":"2023-11-15T02:53:37.992682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.000622+0000","last_change":"2023-11-15T02:53:37.996966+0000","last_active":"2023-11-15T02:53:38.000622+0000","last_peered":"2023-11-15T02:53:38.000622+0000","last_clean":"2023-11-15T02:53:38.000622+0000","last_became_active":"2023-11-15T02:53:37.996716+0000","last_became_peered":"2023-11-15T02:53:37.996716+0000","last_unstale":"2023-11-15T02:53:38.000622+0000","last_undegraded":"2023-11-15T02:53:38.000622+0000","last_fullsized":"2023-11-15T02:53:38.000622+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"195'3","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010557+0000","last_change":"2023-11-15T02:53:37.602954+0000","last_active":"2023-11-15T02:53:38.010557+0000","last_peered":"2023-11-15T02:53:38.010557+0000","last_clean":"2023-11-15T02:53:38.010557+0000","last_became_active":"2023-11-15T02:53:37.602650+0000","last_became_peered":"2023-11-15T02:53:37.602650+0000","last_unstale":"2023-11-15T02:53:38.010557+0000","last_undegraded":"2023-11-15T02:53:38.010557+0000","last_fullsized":"2023-11-15T02:53:38.010557+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992790+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:53:37.992790+0000","last_peered":"2023-11-15T02:53:37.992790+0000","last_clean":"2023-11-15T02:53:37.992790+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:53:37.992790+0000","last_undegraded":"2023-11-15T02:53:37.992790+0000","last_fullsized":"2023-11-15T02:53:37.992790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006116+0000","last_change":"2023-11-15T02:53:38.004904+0000","last_active":"2023-11-15T02:53:38.006116+0000","last_peered":"2023-11-15T02:53:38.006116+0000","last_clean":"2023-11-15T02:53:38.006116+0000","last_became_active":"2023-11-15T02:53:38.002970+0000","last_became_peered":"2023-11-15T02:53:38.002970+0000","last_unstale":"2023-11-15T02:53:38.006116+0000","last_undegraded":"2023-11-15T02:53:38.006116+0000","last_fullsized":"2023-11-15T02:53:38.006116+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"195'4","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010616+0000","last_change":"2023-11-15T02:53:37.602372+0000","last_active":"2023-11-15T02:53:38.010616+0000","last_peered":"2023-11-15T02:53:38.010616+0000","last_clean":"2023-11-15T02:53:38.010616+0000","last_became_active":"2023-11-15T02:53:37.602042+0000","last_became_peered":"2023-11-15T02:53:37.602042+0000","last_unstale":"2023-11-15T02:53:38.010616+0000","last_undegraded":"2023-11-15T02:53:38.010616+0000","last_fullsized":"2023-11-15T02:53:38.010616+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.993798+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:53:37.993798+0000","last_peered":"2023-11-15T02:53:37.993798+0000","last_clean":"2023-11-15T02:53:37.993798+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:53:37.993798+0000","last_undegraded":"2023-11-15T02:53:37.993798+0000","last_fullsized":"2023-11-15T02:53:37.993798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:37.577352+0000","last_change":"2023-11-15T02:53:37.577352+0000","last_active":"2023-11-15T02:53:37.577352+0000","last_peered":"2023-11-15T02:53:37.577352+0000","last_clean":"2023-11-15T02:53:37.577352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:37.577352+0000","last_undegraded":"2023-11-15T02:53:37.577352+0000","last_fullsized":"2023-11-15T02:53:37.577352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011456+0000","last_change":"2023-11-15T02:53:37.607737+0000","last_active":"2023-11-15T02:53:38.011456+0000","last_peered":"2023-11-15T02:53:38.011456+0000","last_clean":"2023-11-15T02:53:38.011456+0000","last_became_active":"2023-11-15T02:53:37.607051+0000","last_became_peered":"2023-11-15T02:53:37.607051+0000","last_unstale":"2023-11-15T02:53:38.011456+0000","last_undegraded":"2023-11-15T02:53:38.011456+0000","last_fullsized":"2023-11-15T02:53:38.011456+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001049+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:53:38.001049+0000","last_peered":"2023-11-15T02:53:38.001049+0000","last_clean":"2023-11-15T02:53:38.001049+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:53:38.001049+0000","last_undegraded":"2023-11-15T02:53:38.001049+0000","last_fullsized":"2023-11-15T02:53:38.001049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003060+0000","last_change":"2023-11-15T02:53:37.998675+0000","last_active":"2023-11-15T02:53:38.003060+0000","last_peered":"2023-11-15T02:53:38.003060+0000","last_clean":"2023-11-15T02:53:38.003060+0000","last_became_active":"2023-11-15T02:53:37.998261+0000","last_became_peered":"2023-11-15T02:53:37.998261+0000","last_unstale":"2023-11-15T02:53:38.003060+0000","last_undegraded":"2023-11-15T02:53:38.003060+0000","last_fullsized":"2023-11-15T02:53:38.003060+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.985238+0000","last_change":"2023-11-15T02:53:37.598178+0000","last_active":"2023-11-15T02:53:37.985238+0000","last_peered":"2023-11-15T02:53:37.985238+0000","last_clean":"2023-11-15T02:53:37.985238+0000","last_became_active":"2023-11-15T02:53:37.597661+0000","last_became_peered":"2023-11-15T02:53:37.597661+0000","last_unstale":"2023-11-15T02:53:37.985238+0000","last_undegraded":"2023-11-15T02:53:37.985238+0000","last_fullsized":"2023-11-15T02:53:37.985238+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":178,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-11-15T02:53:32.537966+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:53:32.537966+0000","last_peered":"2023-11-15T02:53:32.537966+0000","last_clean":"2023-11-15T02:53:32.537966+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:53:32.537966+0000","last_undegraded":"2023-11-15T02:53:32.537966+0000","last_fullsized":"2023-11-15T02:53:32.537966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":118,"acting":118,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":1414,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":110,"acting":110,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575945,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303580,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068260,"statfs":{"total":96636764160,"available":96325898240,"internally_reserved":0,"allocated":2445312,"data_stored":1303745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.82599999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.57699999999999996},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72599999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.51400000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.42099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.67900000000000005,"5min":0.752,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.78000000000000003,"15min":0.80400000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.44800000000000001,"5min":0.441,"15min":0.40999999999999998},"max":{"1min":0.75700000000000001,"5min":0.79100000000000004,"15min":0.83799999999999997},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.754,"5min":0.81000000000000005,"15min":0.88500000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.62},"min":{"1min":0.47899999999999998,"5min":0.40699999999999997,"15min":0.377},"max":{"1min":0.81899999999999995,"5min":0.84799999999999998,"15min":0.86699999999999999},"last":0.58099999999999996}]},{"osd":4,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46100000000000002,"15min":0.47699999999999998},"min":{"1min":0.32800000000000001,"5min":0.29199999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.749},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.64700000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47899999999999998,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.79500000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.81999999999999995},"last":0.625}]},{"osd":6,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.37,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.84899999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.35299999999999998,"15min":0.28499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.68899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575945,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307632,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064208,"statfs":{"total":96636764160,"available":96321748992,"internally_reserved":0,"allocated":2400256,"data_stored":1280648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.24099999999999999},"max":{"1min":0.749,"5min":0.80000000000000004,"15min":0.92500000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.27700000000000002},"max":{"1min":0.71999999999999997,"5min":0.77300000000000002,"15min":0.873},"last":1.466}]},{"osd":1,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75700000000000001,"5min":0.81399999999999995,"15min":0.81999999999999995},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.36199999999999999},"max":{"1min":0.69299999999999995,"5min":0.77200000000000002,"15min":0.88},"last":1.53}]},{"osd":2,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.78400000000000003,"15min":0.84599999999999997},"last":1.026},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.45300000000000001,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.72799999999999998,"5min":0.83399999999999996,"15min":0.88900000000000001},"last":0.99199999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.42699999999999999,"5min":0.35299999999999998,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60799999999999998,"15min":0.60699999999999998},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.38},"max":{"1min":0.78000000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":1.498}]},{"osd":4,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45900000000000002},"min":{"1min":0.29799999999999999,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.64100000000000001,"5min":0.72999999999999998,"15min":0.82199999999999995},"last":1.4810000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.39600000000000002,"5min":0.34799999999999998,"15min":0.30099999999999999},"max":{"1min":0.70899999999999996,"5min":0.79500000000000004,"15min":0.874},"last":1.5189999999999999}]},{"osd":5,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.32400000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.82799999999999996},"last":1.5880000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.32000000000000001},"max":{"1min":0.70999999999999996,"5min":0.77000000000000002,"15min":0.95099999999999996},"last":1.5669999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.50900000000000001},"min":{"1min":0.33700000000000002,"5min":0.32600000000000001,"15min":0.30499999999999999},"max":{"1min":0.65200000000000002,"5min":0.74199999999999999,"15min":0.90100000000000002},"last":1.04},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.434,"5min":0.42599999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.83799999999999997,"15min":0.875},"last":1.5509999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575947,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307688,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064152,"statfs":{"total":96636764160,"available":96321691648,"internally_reserved":0,"allocated":2457600,"data_stored":1310171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.39200000000000002},"min":{"1min":0.28599999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.432},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.436,"15min":0.41899999999999998},"min":{"1min":0.28799999999999998,"5min":0.255,"15min":0.255},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.312}]},{"osd":2,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42099999999999999,"15min":0.40799999999999997},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.47799999999999998,"15min":0.46300000000000002},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.40799999999999997}]},{"osd":3,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.441,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.375},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.41999999999999998,"5min":0.32500000000000001,"15min":0.315},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.441}]},{"osd":4,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.49199999999999999,"5min":0.436,"15min":0.372},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.53400000000000003,"5min":0.42399999999999999,"15min":0.41299999999999998},"max":{"1min":1.0289999999999999,"5min":1.081,"15min":1.081},"last":0.69899999999999995}]},{"osd":5,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67000000000000004,"15min":0.66000000000000003},"min":{"1min":0.52100000000000002,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68700000000000006,"15min":0.67400000000000004},"min":{"1min":0.54900000000000004,"5min":0.45600000000000002,"15min":0.42699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.70799999999999996}]},{"osd":6,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.52300000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.73599999999999999,"15min":0.72399999999999998},"min":{"1min":0.64500000000000002,"5min":0.53500000000000003,"15min":0.48999999999999999},"max":{"1min":0.98399999999999999,"5min":1,"15min":1},"last":0.75800000000000001}]},{"osd":7,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.67600000000000005,"5min":0.52600000000000002,"15min":0.46600000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.746,"15min":0.72999999999999998},"min":{"1min":0.627,"5min":0.52100000000000002,"15min":0.48399999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0009999999999999},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575945,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311768,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060072,"statfs":{"total":96636764160,"available":96317513728,"internally_reserved":0,"allocated":2441216,"data_stored":1302333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.40000000000000002,"15min":0.39900000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.63300000000000001,"15min":0.73499999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61299999999999999,"5min":0.68100000000000005,"15min":0.89400000000000002},"last":0.39000000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41699999999999998,"15min":0.40799999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.23599999999999999},"max":{"1min":0.626,"5min":0.66500000000000004,"15min":0.755},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47099999999999997,"15min":0.46500000000000002},"min":{"1min":0.35499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64700000000000002,"5min":0.71199999999999997,"15min":0.77200000000000002},"last":0.33000000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66200000000000003,"5min":0.73399999999999999,"15min":0.83199999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.317},"max":{"1min":0.61699999999999999,"5min":0.70999999999999996,"15min":0.86699999999999999},"last":0.373}]},{"osd":4,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.69399999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.40500000000000003},"max":{"1min":0.89900000000000002,"5min":1.034,"15min":1.0720000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70799999999999996,"15min":0.68999999999999995},"min":{"1min":0.55000000000000004,"5min":0.46600000000000003,"15min":0.42699999999999999},"max":{"1min":0.92600000000000005,"5min":1.022,"15min":1.0549999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.51400000000000001,"5min":0.47899999999999998,"15min":0.378},"max":{"1min":0.89000000000000001,"5min":0.96699999999999997,"15min":1.0449999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70399999999999996,"15min":0.68000000000000005},"min":{"1min":0.498,"5min":0.45400000000000001,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.028},"last":0.70299999999999996}]},{"osd":6,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69899999999999995,"15min":0.67700000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.441},"max":{"1min":0.85399999999999998,"5min":0.95399999999999996,"15min":1.171},"last":0.627},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.443},"max":{"1min":0.86599999999999999,"5min":1.01,"15min":1.135},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73299999999999998,"15min":0.72199999999999998},"min":{"1min":0.59899999999999998,"5min":0.47399999999999998,"15min":0.40699999999999997},"max":{"1min":0.94099999999999995,"5min":1.0549999999999999,"15min":1.083},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.75700000000000001,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95199999999999996,"5min":1.089,"15min":1.107},"last":0.65100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575946,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315876,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055964,"statfs":{"total":96636764160,"available":96313307136,"internally_reserved":0,"allocated":2453504,"data_stored":1309597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27000000000000002,"5min":0.25900000000000001,"15min":0.253},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.63700000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.433,"15min":0.437},"min":{"1min":0.29099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.67100000000000004,"15min":0.72899999999999998},"last":0.38500000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53700000000000003,"5min":0.628,"15min":0.69099999999999995},"last":0.255},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.45600000000000002},"min":{"1min":0.35899999999999999,"5min":0.32500000000000001,"15min":0.28100000000000003},"max":{"1min":0.61599999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.35199999999999998}]},{"osd":3,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47999999999999998,"15min":0.48199999999999998},"min":{"1min":0.39100000000000001,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.70099999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.31900000000000001},"max":{"1min":0.62,"5min":0.753,"15min":0.81399999999999995},"last":0.39800000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.501,"5min":0.46300000000000002,"15min":0.41099999999999998},"max":{"1min":0.88900000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66600000000000004,"15min":0.67600000000000005},"min":{"1min":0.46300000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97199999999999998,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.47299999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.52300000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67400000000000004,"15min":0.67700000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90000000000000002,"5min":1.056,"15min":1.056},"last":0.48199999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.47799999999999998},"max":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.113},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.55800000000000005,"5min":0.48999999999999999,"15min":0.46400000000000002},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.46700000000000003}]},{"osd":7,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.54100000000000004,"5min":0.502,"15min":0.46500000000000002},"max":{"1min":0.995,"5min":1.012,"15min":1.0680000000000001},"last":0.504},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.72499999999999998},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.48699999999999999},"max":{"1min":0.93500000000000005,"5min":1.089,"15min":1.1499999999999999},"last":0.53800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575947,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311788,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060052,"statfs":{"total":96636764160,"available":96317493248,"internally_reserved":0,"allocated":2461696,"data_stored":1310193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41099999999999998,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.54800000000000004,"5min":0.624,"15min":0.67500000000000004},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63200000000000001,"5min":0.64400000000000002,"15min":0.65800000000000003},"last":0.28899999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":0.67100000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.34300000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48199999999999998,"15min":0.47799999999999998},"min":{"1min":0.35499999999999998,"5min":0.31,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.72299999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.32200000000000001}]},{"osd":4,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.52900000000000003,"5min":0.41999999999999998,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.91700000000000004,"15min":1.0149999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.45200000000000001},"max":{"1min":0.98499999999999999,"5min":1.04,"15min":1.04},"last":0.72599999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69399999999999995,"15min":0.68600000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96199999999999997,"5min":1.0569999999999999,"15min":1.1100000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.67800000000000005},"min":{"1min":0.47799999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93500000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66400000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.40999999999999998},"max":{"1min":0.93400000000000005,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.622},{"interface":"front","average":{"1min":0.746,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.52200000000000002,"15min":0.46400000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0720000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.54900000000000004,"5min":0.53000000000000003,"15min":0.47899999999999998},"max":{"1min":0.94399999999999995,"5min":0.97999999999999998,"15min":1.071},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575945,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303596,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068244,"statfs":{"total":96636764160,"available":96325881856,"internally_reserved":0,"allocated":2461696,"data_stored":1309709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.44500000000000001,"5min":0.40799999999999997,"15min":0.28299999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.81000000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":0.75700000000000001,"5min":0.79000000000000004,"15min":0.97199999999999998},"last":0.495}]},{"osd":1,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.42399999999999999,"5min":0.41099999999999998,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":0.78100000000000003,"15min":0.89900000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.33600000000000002},"max":{"1min":0.78200000000000003,"5min":0.83299999999999996,"15min":0.88700000000000001},"last":0.56899999999999995}]},{"osd":2,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.86399999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.38200000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.85599999999999998},"last":0.65800000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38300000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.80800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.48799999999999999,"5min":0.48399999999999999,"15min":0.36599999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.83099999999999996},"last":0.621}]},{"osd":5,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.28100000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.76200000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51300000000000001,"15min":0.51100000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.79100000000000004},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34999999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.69599999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.39600000000000002,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.81799999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.79300000000000004,"15min":0.84599999999999997},"last":0.72199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575945,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307692,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064148,"statfs":{"total":96636764160,"available":96321687552,"internally_reserved":0,"allocated":2461696,"data_stored":1310205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73899999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.441},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.86899999999999999},"last":0.66900000000000004}]},{"osd":1,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.33300000000000002},"max":{"1min":0.76700000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.52600000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.372},"max":{"1min":0.71999999999999997,"5min":0.876,"15min":0.90000000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59699999999999998,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34499999999999997},"max":{"1min":0.75600000000000001,"5min":0.78100000000000003,"15min":0.83299999999999996},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":0.78700000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.34399999999999997},"max":{"1min":0.78600000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46100000000000002,"15min":0.47199999999999998},"min":{"1min":0.311,"5min":0.308,"15min":0.27900000000000003},"max":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.751},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.32600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.73399999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.313,"5min":0.312,"15min":0.312},"max":{"1min":0.753,"5min":0.753,"15min":0.75600000000000001},"last":0.74299999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.502,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.67400000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.75700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:53:42.036 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:53:42.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.184+0000 7f6a7538b700 1 Processor -- start 2023-11-15T02:53:42.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.184+0000 7f6a7538b700 1 -- start start 2023-11-15T02:53:42.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a7538b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7014eac0 0x7f6a701554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a7538b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6a700c7a50 0x7f6a700c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a7538b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a70155050 con 0x7f6a7006a7a0 2023-11-15T02:53:42.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a7538b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a700c1220 con 0x7f6a700c7a50 2023-11-15T02:53:42.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a7538b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700c83a0 con 0x7f6a7014eac0 2023-11-15T02:53:42.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a6f7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6a700c7a50 0x7f6a700c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a6e7fc700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6a7006a7a0 0x7f6a700c0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57288/0 (socket says 172.21.15.1:57288) 2023-11-15T02:53:42.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a6e7fc700 1 -- 172.21.15.1:0/3341142018 learned_addr learned my addr 172.21.15.1:0/3341142018 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:42.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a6effd700 1 --2- 172.21.15.1:0/3341142018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7014eac0 0x7f6a701554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a6f7fe700 1 -- 172.21.15.1:0/3341142018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7014eac0 msgr2=0x7f6a701554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:42.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a6f7fe700 1 --2- 172.21.15.1:0/3341142018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7014eac0 0x7f6a701554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a6f7fe700 1 -- 172.21.15.1:0/3341142018 >> v1:172.21.15.1:6789/0 conn(0x7f6a7006a7a0 legacy=0x7f6a700c0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a6dffb700 1 -- 172.21.15.1:0/3341142018 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678620234 0 0) 0x7f6a70155050 con 0x7f6a7006a7a0 2023-11-15T02:53:42.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a6f7fe700 1 -- 172.21.15.1:0/3341142018 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a700c1420 con 0x7f6a700c7a50 2023-11-15T02:53:42.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a6effd700 1 --2- 172.21.15.1:0/3341142018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7014eac0 0x7f6a701554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:42.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.185+0000 7f6a6f7fe700 1 --2- 172.21.15.1:0/3341142018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a700c7a50 0x7f6a700c7eb0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7f6a60009e60 tx=0x7f6a60009780).ready entity=mon.0 client_cookie=51d58b58ee0a2d44 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:42.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.186+0000 7f6a6dffb700 1 -- 172.21.15.1:0/3341142018 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6000e070 con 0x7f6a700c7a50 2023-11-15T02:53:42.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.186+0000 7f6a6dffb700 1 -- 172.21.15.1:0/3341142018 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6000bc30 con 0x7f6a700c7a50 2023-11-15T02:53:42.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.186+0000 7f6a6dffb700 1 -- 172.21.15.1:0/3341142018 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a60012410 con 0x7f6a700c7a50 2023-11-15T02:53:42.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.186+0000 7f6a7538b700 1 -- 172.21.15.1:0/3341142018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a700c7a50 msgr2=0x7f6a700c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.186+0000 7f6a7538b700 1 --2- 172.21.15.1:0/3341142018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a700c7a50 0x7f6a700c7eb0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7f6a60009e60 tx=0x7f6a60009780).stop 2023-11-15T02:53:42.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.186+0000 7f6a7538b700 1 -- 172.21.15.1:0/3341142018 shutdown_connections 2023-11-15T02:53:42.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.186+0000 7f6a7538b700 1 --2- 172.21.15.1:0/3341142018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a700c7a50 0x7f6a700c7eb0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.186+0000 7f6a7538b700 1 --2- 172.21.15.1:0/3341142018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a7014eac0 0x7f6a701554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.186+0000 7f6a7538b700 1 -- 172.21.15.1:0/3341142018 >> 172.21.15.1:0/3341142018 conn(0x7f6a70084ec0 msgr2=0x7f6a700947e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:42.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.186+0000 7f6a7538b700 1 -- 172.21.15.1:0/3341142018 shutdown_connections 2023-11-15T02:53:42.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.186+0000 7f6a7538b700 1 -- 172.21.15.1:0/3341142018 wait complete. 2023-11-15T02:53:42.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.187+0000 7f6a7538b700 1 Processor -- start 2023-11-15T02:53:42.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.187+0000 7f6a7538b700 1 -- start start 2023-11-15T02:53:42.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.188+0000 7f6a7538b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a7006a7a0 0x7f6a70167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.188+0000 7f6a7538b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a700c7a50 0x7f6a7014dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.188+0000 7f6a7538b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a7014eac0 0x7f6a700c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.188+0000 7f6a7538b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700c25d0 con 0x7f6a7006a7a0 2023-11-15T02:53:42.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.188+0000 7f6a7538b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700c22a0 con 0x7f6a7014eac0 2023-11-15T02:53:42.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.188+0000 7f6a7538b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a70168520 con 0x7f6a700c7a50 2023-11-15T02:53:42.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.188+0000 7f6a6effd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a7006a7a0 0x7f6a70167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.188+0000 7f6a6effd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a7006a7a0 0x7f6a70167c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59590/0 (socket says 172.21.15.1:59590) 2023-11-15T02:53:42.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.188+0000 7f6a6effd700 1 -- 172.21.15.1:0/1596519969 learned_addr learned my addr 172.21.15.1:0/1596519969 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:42.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.188+0000 7f6a6e7fc700 1 --2- 172.21.15.1:0/1596519969 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a700c7a50 0x7f6a7014dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.188+0000 7f6a6f7fe700 1 --2- 172.21.15.1:0/1596519969 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a7014eac0 0x7f6a700c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.188+0000 7f6a6effd700 1 -- 172.21.15.1:0/1596519969 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a700c7a50 msgr2=0x7f6a7014dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.189+0000 7f6a6effd700 1 --2- 172.21.15.1:0/1596519969 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a700c7a50 0x7f6a7014dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.189+0000 7f6a6effd700 1 -- 172.21.15.1:0/1596519969 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a7014eac0 msgr2=0x7f6a700c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.189+0000 7f6a6effd700 1 --2- 172.21.15.1:0/1596519969 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a7014eac0 0x7f6a700c2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.189+0000 7f6a6effd700 1 -- 172.21.15.1:0/1596519969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a60009a20 con 0x7f6a7006a7a0 2023-11-15T02:53:42.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.189+0000 7f6a6effd700 1 --2- 172.21.15.1:0/1596519969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a7006a7a0 0x7f6a70167c20 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7f6a6800c880 tx=0x7f6a68008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:42.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.189+0000 7f6a66ffd700 1 -- 172.21.15.1:0/1596519969 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68010580 con 0x7f6a7006a7a0 2023-11-15T02:53:42.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.189+0000 7f6a66ffd700 1 -- 172.21.15.1:0/1596519969 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a680106e0 con 0x7f6a7006a7a0 2023-11-15T02:53:42.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.189+0000 7f6a7538b700 1 -- 172.21.15.1:0/1596519969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a70168800 con 0x7f6a7006a7a0 2023-11-15T02:53:42.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.189+0000 7f6a66ffd700 1 -- 172.21.15.1:0/1596519969 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68010a80 con 0x7f6a7006a7a0 2023-11-15T02:53:42.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.189+0000 7f6a7538b700 1 -- 172.21.15.1:0/1596519969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a70168110 con 0x7f6a7006a7a0 2023-11-15T02:53:42.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.190+0000 7f6a7538b700 1 -- 172.21.15.1:0/1596519969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a700475e0 con 0x7f6a7006a7a0 2023-11-15T02:53:42.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.190+0000 7f6a66ffd700 1 -- 172.21.15.1:0/1596519969 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6a6801b460 con 0x7f6a7006a7a0 2023-11-15T02:53:42.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.190+0000 7f6a66ffd700 1 --2- 172.21.15.1:0/1596519969 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6a5005f270 0x7f6a50061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.191+0000 7f6a66ffd700 1 -- 172.21.15.1:0/1596519969 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f6a6807a5b0 con 0x7f6a7006a7a0 2023-11-15T02:53:42.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.191+0000 7f6a6e7fc700 1 --2- 172.21.15.1:0/1596519969 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6a5005f270 0x7f6a50061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.191+0000 7f6a6e7fc700 1 --2- 172.21.15.1:0/1596519969 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6a5005f270 0x7f6a50061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6a700c7870 tx=0x7f6a58009040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:42.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.195+0000 7f6a66ffd700 1 -- 172.21.15.1:0/1596519969 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6a6804b490 con 0x7f6a7006a7a0 2023-11-15T02:53:42.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.363+0000 7f6a7538b700 1 -- 172.21.15.1:0/1596519969 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6a700c2710 con 0x7f6a5005f270 2023-11-15T02:53:42.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.374+0000 7f6a66ffd700 1 -- 172.21.15.1:0/1596519969 <== mgr.8590 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360912 (secure 0 0 0) 0x7f6a58007110 con 0x7f6a5005f270 2023-11-15T02:53:42.380 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:42.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.377+0000 7f6a7538b700 1 -- 172.21.15.1:0/1596519969 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6a5005f270 msgr2=0x7f6a50061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.377+0000 7f6a7538b700 1 --2- 172.21.15.1:0/1596519969 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6a5005f270 0x7f6a50061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6a700c7870 tx=0x7f6a58009040).stop 2023-11-15T02:53:42.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.377+0000 7f6a7538b700 1 -- 172.21.15.1:0/1596519969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a7006a7a0 msgr2=0x7f6a70167c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.377+0000 7f6a7538b700 1 --2- 172.21.15.1:0/1596519969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a7006a7a0 0x7f6a70167c20 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7f6a6800c880 tx=0x7f6a68008040).stop 2023-11-15T02:53:42.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.377+0000 7f6a7538b700 1 -- 172.21.15.1:0/1596519969 shutdown_connections 2023-11-15T02:53:42.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.377+0000 7f6a7538b700 1 --2- 172.21.15.1:0/1596519969 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6a5005f270 0x7f6a50061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.377+0000 7f6a7538b700 1 --2- 172.21.15.1:0/1596519969 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6a7014eac0 0x7f6a700c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.377+0000 7f6a7538b700 1 --2- 172.21.15.1:0/1596519969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a7006a7a0 0x7f6a70167c20 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.377+0000 7f6a7538b700 1 --2- 172.21.15.1:0/1596519969 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6a700c7a50 0x7f6a7014dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.377+0000 7f6a7538b700 1 -- 172.21.15.1:0/1596519969 >> 172.21.15.1:0/1596519969 conn(0x7f6a70084ec0 msgr2=0x7f6a70153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:42.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.377+0000 7f6a7538b700 1 -- 172.21.15.1:0/1596519969 shutdown_connections 2023-11-15T02:53:42.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.377+0000 7f6a7538b700 1 -- 172.21.15.1:0/1596519969 wait complete. 2023-11-15T02:53:42.386 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:53:42.391 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T02:53:40.551013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1414,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":246,"acting":246,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":212,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2469620,"kb_used_data":19124,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752505100,"statfs":{"total":773094113280,"available":770565222400,"internally_reserved":0,"allocated":19582976,"data_stored":10436601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-594407,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-209,"num_write_kb":-720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.007154"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.004115+0000","last_change":"2023-11-15T02:53:37.995183+0000","last_active":"2023-11-15T02:53:38.004115+0000","last_peered":"2023-11-15T02:53:38.004115+0000","last_clean":"2023-11-15T02:53:38.004115+0000","last_became_active":"2023-11-15T02:53:37.994643+0000","last_became_peered":"2023-11-15T02:53:37.994643+0000","last_unstale":"2023-11-15T02:53:38.004115+0000","last_undegraded":"2023-11-15T02:53:38.004115+0000","last_fullsized":"2023-11-15T02:53:38.004115+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"195'3","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011940+0000","last_change":"2023-11-15T02:53:37.606094+0000","last_active":"2023-11-15T02:53:38.011940+0000","last_peered":"2023-11-15T02:53:38.011940+0000","last_clean":"2023-11-15T02:53:38.011940+0000","last_became_active":"2023-11-15T02:53:37.605797+0000","last_became_peered":"2023-11-15T02:53:37.605797+0000","last_unstale":"2023-11-15T02:53:38.011940+0000","last_undegraded":"2023-11-15T02:53:38.011940+0000","last_fullsized":"2023-11-15T02:53:38.011940+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011234+0000","last_change":"2023-11-15T02:53:38.006818+0000","last_active":"2023-11-15T02:53:38.011234+0000","last_peered":"2023-11-15T02:53:38.011234+0000","last_clean":"2023-11-15T02:53:38.011234+0000","last_became_active":"2023-11-15T02:53:38.006545+0000","last_became_peered":"2023-11-15T02:53:38.006545+0000","last_unstale":"2023-11-15T02:53:38.011234+0000","last_undegraded":"2023-11-15T02:53:38.011234+0000","last_fullsized":"2023-11-15T02:53:38.011234+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998658+0000","last_change":"2023-11-15T02:53:37.991499+0000","last_active":"2023-11-15T02:53:37.998658+0000","last_peered":"2023-11-15T02:53:37.998658+0000","last_clean":"2023-11-15T02:53:37.998658+0000","last_became_active":"2023-11-15T02:53:37.991219+0000","last_became_peered":"2023-11-15T02:53:37.991219+0000","last_unstale":"2023-11-15T02:53:37.998658+0000","last_undegraded":"2023-11-15T02:53:37.998658+0000","last_fullsized":"2023-11-15T02:53:37.998658+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999215+0000","last_change":"2023-11-15T02:53:37.598351+0000","last_active":"2023-11-15T02:53:37.999215+0000","last_peered":"2023-11-15T02:53:37.999215+0000","last_clean":"2023-11-15T02:53:37.999215+0000","last_became_active":"2023-11-15T02:53:37.598074+0000","last_became_peered":"2023-11-15T02:53:37.598074+0000","last_unstale":"2023-11-15T02:53:37.999215+0000","last_undegraded":"2023-11-15T02:53:37.999215+0000","last_fullsized":"2023-11-15T02:53:37.999215+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009794+0000","last_change":"2023-11-15T02:53:38.005640+0000","last_active":"2023-11-15T02:53:38.009794+0000","last_peered":"2023-11-15T02:53:38.009794+0000","last_clean":"2023-11-15T02:53:38.009794+0000","last_became_active":"2023-11-15T02:53:38.005427+0000","last_became_peered":"2023-11-15T02:53:38.005427+0000","last_unstale":"2023-11-15T02:53:38.009794+0000","last_undegraded":"2023-11-15T02:53:38.009794+0000","last_fullsized":"2023-11-15T02:53:38.009794+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003329+0000","last_change":"2023-11-15T02:53:37.605508+0000","last_active":"2023-11-15T02:53:38.003329+0000","last_peered":"2023-11-15T02:53:38.003329+0000","last_clean":"2023-11-15T02:53:38.003329+0000","last_became_active":"2023-11-15T02:53:37.605050+0000","last_became_peered":"2023-11-15T02:53:37.605050+0000","last_unstale":"2023-11-15T02:53:38.003329+0000","last_undegraded":"2023-11-15T02:53:38.003329+0000","last_fullsized":"2023-11-15T02:53:38.003329+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.007889+0000","last_change":"2023-11-15T02:53:38.003090+0000","last_active":"2023-11-15T02:53:38.007889+0000","last_peered":"2023-11-15T02:53:38.007889+0000","last_clean":"2023-11-15T02:53:38.007889+0000","last_became_active":"2023-11-15T02:53:38.002775+0000","last_became_peered":"2023-11-15T02:53:38.002775+0000","last_unstale":"2023-11-15T02:53:38.007889+0000","last_undegraded":"2023-11-15T02:53:38.007889+0000","last_fullsized":"2023-11-15T02:53:38.007889+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.013228+0000","last_change":"2023-11-15T02:53:38.010179+0000","last_active":"2023-11-15T02:53:38.013228+0000","last_peered":"2023-11-15T02:53:38.013228+0000","last_clean":"2023-11-15T02:53:38.013228+0000","last_became_active":"2023-11-15T02:53:38.009853+0000","last_became_peered":"2023-11-15T02:53:38.009853+0000","last_unstale":"2023-11-15T02:53:38.013228+0000","last_undegraded":"2023-11-15T02:53:38.013228+0000","last_fullsized":"2023-11-15T02:53:38.013228+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998494+0000","last_change":"2023-11-15T02:53:37.610005+0000","last_active":"2023-11-15T02:53:37.998494+0000","last_peered":"2023-11-15T02:53:37.998494+0000","last_clean":"2023-11-15T02:53:37.998494+0000","last_became_active":"2023-11-15T02:53:37.609699+0000","last_became_peered":"2023-11-15T02:53:37.609699+0000","last_unstale":"2023-11-15T02:53:37.998494+0000","last_undegraded":"2023-11-15T02:53:37.998494+0000","last_fullsized":"2023-11-15T02:53:37.998494+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006567+0000","last_change":"2023-11-15T02:53:38.001561+0000","last_active":"2023-11-15T02:53:38.006567+0000","last_peered":"2023-11-15T02:53:38.006567+0000","last_clean":"2023-11-15T02:53:38.006567+0000","last_became_active":"2023-11-15T02:53:38.001242+0000","last_became_peered":"2023-11-15T02:53:38.001242+0000","last_unstale":"2023-11-15T02:53:38.006567+0000","last_undegraded":"2023-11-15T02:53:38.006567+0000","last_fullsized":"2023-11-15T02:53:38.006567+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.981858+0000","last_change":"2023-11-15T02:53:37.606473+0000","last_active":"2023-11-15T02:53:37.981858+0000","last_peered":"2023-11-15T02:53:37.981858+0000","last_clean":"2023-11-15T02:53:37.981858+0000","last_became_active":"2023-11-15T02:53:37.606137+0000","last_became_peered":"2023-11-15T02:53:37.606137+0000","last_unstale":"2023-11-15T02:53:37.981858+0000","last_undegraded":"2023-11-15T02:53:37.981858+0000","last_fullsized":"2023-11-15T02:53:37.981858+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002949+0000","last_change":"2023-11-15T02:53:37.999287+0000","last_active":"2023-11-15T02:53:38.002949+0000","last_peered":"2023-11-15T02:53:38.002949+0000","last_clean":"2023-11-15T02:53:38.002949+0000","last_became_active":"2023-11-15T02:53:37.998970+0000","last_became_peered":"2023-11-15T02:53:37.998970+0000","last_unstale":"2023-11-15T02:53:38.002949+0000","last_undegraded":"2023-11-15T02:53:38.002949+0000","last_fullsized":"2023-11-15T02:53:38.002949+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008738+0000","last_change":"2023-11-15T02:53:38.007229+0000","last_active":"2023-11-15T02:53:38.008738+0000","last_peered":"2023-11-15T02:53:38.008738+0000","last_clean":"2023-11-15T02:53:38.008738+0000","last_became_active":"2023-11-15T02:53:38.006946+0000","last_became_peered":"2023-11-15T02:53:38.006946+0000","last_unstale":"2023-11-15T02:53:38.008738+0000","last_undegraded":"2023-11-15T02:53:38.008738+0000","last_fullsized":"2023-11-15T02:53:38.008738+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003079+0000","last_change":"2023-11-15T02:53:37.998235+0000","last_active":"2023-11-15T02:53:38.003079+0000","last_peered":"2023-11-15T02:53:38.003079+0000","last_clean":"2023-11-15T02:53:38.003079+0000","last_became_active":"2023-11-15T02:53:37.997964+0000","last_became_peered":"2023-11-15T02:53:37.997964+0000","last_unstale":"2023-11-15T02:53:38.003079+0000","last_undegraded":"2023-11-15T02:53:38.003079+0000","last_fullsized":"2023-11-15T02:53:38.003079+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.007921+0000","last_change":"2023-11-15T02:53:38.003127+0000","last_active":"2023-11-15T02:53:38.007921+0000","last_peered":"2023-11-15T02:53:38.007921+0000","last_clean":"2023-11-15T02:53:38.007921+0000","last_became_active":"2023-11-15T02:53:38.002839+0000","last_became_peered":"2023-11-15T02:53:38.002839+0000","last_unstale":"2023-11-15T02:53:38.007921+0000","last_undegraded":"2023-11-15T02:53:38.007921+0000","last_fullsized":"2023-11-15T02:53:38.007921+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009318+0000","last_change":"2023-11-15T02:53:38.001828+0000","last_active":"2023-11-15T02:53:38.009318+0000","last_peered":"2023-11-15T02:53:38.009318+0000","last_clean":"2023-11-15T02:53:38.009318+0000","last_became_active":"2023-11-15T02:53:37.997960+0000","last_became_peered":"2023-11-15T02:53:37.997960+0000","last_unstale":"2023-11-15T02:53:38.009318+0000","last_undegraded":"2023-11-15T02:53:38.009318+0000","last_fullsized":"2023-11-15T02:53:38.009318+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001253+0000","last_change":"2023-11-15T02:53:37.996705+0000","last_active":"2023-11-15T02:53:38.001253+0000","last_peered":"2023-11-15T02:53:38.001253+0000","last_clean":"2023-11-15T02:53:38.001253+0000","last_became_active":"2023-11-15T02:53:37.995805+0000","last_became_peered":"2023-11-15T02:53:37.995805+0000","last_unstale":"2023-11-15T02:53:38.001253+0000","last_undegraded":"2023-11-15T02:53:38.001253+0000","last_fullsized":"2023-11-15T02:53:38.001253+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010242+0000","last_change":"2023-11-15T02:53:37.604059+0000","last_active":"2023-11-15T02:53:38.010242+0000","last_peered":"2023-11-15T02:53:38.010242+0000","last_clean":"2023-11-15T02:53:38.010242+0000","last_became_active":"2023-11-15T02:53:37.603596+0000","last_became_peered":"2023-11-15T02:53:37.603596+0000","last_unstale":"2023-11-15T02:53:38.010242+0000","last_undegraded":"2023-11-15T02:53:38.010242+0000","last_fullsized":"2023-11-15T02:53:38.010242+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001234+0000","last_change":"2023-11-15T02:53:37.997221+0000","last_active":"2023-11-15T02:53:38.001234+0000","last_peered":"2023-11-15T02:53:38.001234+0000","last_clean":"2023-11-15T02:53:38.001234+0000","last_became_active":"2023-11-15T02:53:37.996900+0000","last_became_peered":"2023-11-15T02:53:37.996900+0000","last_unstale":"2023-11-15T02:53:38.001234+0000","last_undegraded":"2023-11-15T02:53:38.001234+0000","last_fullsized":"2023-11-15T02:53:38.001234+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989867+0000","last_change":"2023-11-15T02:53:37.605082+0000","last_active":"2023-11-15T02:53:37.989867+0000","last_peered":"2023-11-15T02:53:37.989867+0000","last_clean":"2023-11-15T02:53:37.989867+0000","last_became_active":"2023-11-15T02:53:37.604780+0000","last_became_peered":"2023-11-15T02:53:37.604780+0000","last_unstale":"2023-11-15T02:53:37.989867+0000","last_undegraded":"2023-11-15T02:53:37.989867+0000","last_fullsized":"2023-11-15T02:53:37.989867+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.013267+0000","last_change":"2023-11-15T02:53:38.012265+0000","last_active":"2023-11-15T02:53:38.013267+0000","last_peered":"2023-11-15T02:53:38.013267+0000","last_clean":"2023-11-15T02:53:38.013267+0000","last_became_active":"2023-11-15T02:53:38.011882+0000","last_became_peered":"2023-11-15T02:53:38.011882+0000","last_unstale":"2023-11-15T02:53:38.013267+0000","last_undegraded":"2023-11-15T02:53:38.013267+0000","last_fullsized":"2023-11-15T02:53:38.013267+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.991858+0000","last_change":"2023-11-15T02:53:37.604365+0000","last_active":"2023-11-15T02:53:37.991858+0000","last_peered":"2023-11-15T02:53:37.991858+0000","last_clean":"2023-11-15T02:53:37.991858+0000","last_became_active":"2023-11-15T02:53:37.604087+0000","last_became_peered":"2023-11-15T02:53:37.604087+0000","last_unstale":"2023-11-15T02:53:37.991858+0000","last_undegraded":"2023-11-15T02:53:37.991858+0000","last_fullsized":"2023-11-15T02:53:37.991858+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008119+0000","last_change":"2023-11-15T02:53:38.003008+0000","last_active":"2023-11-15T02:53:38.008119+0000","last_peered":"2023-11-15T02:53:38.008119+0000","last_clean":"2023-11-15T02:53:38.008119+0000","last_became_active":"2023-11-15T02:53:38.002701+0000","last_became_peered":"2023-11-15T02:53:38.002701+0000","last_unstale":"2023-11-15T02:53:38.008119+0000","last_undegraded":"2023-11-15T02:53:38.008119+0000","last_fullsized":"2023-11-15T02:53:38.008119+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"195'4","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.000336+0000","last_change":"2023-11-15T02:53:37.608083+0000","last_active":"2023-11-15T02:53:38.000336+0000","last_peered":"2023-11-15T02:53:38.000336+0000","last_clean":"2023-11-15T02:53:38.000336+0000","last_became_active":"2023-11-15T02:53:37.607564+0000","last_became_peered":"2023-11-15T02:53:37.607564+0000","last_unstale":"2023-11-15T02:53:38.000336+0000","last_undegraded":"2023-11-15T02:53:38.000336+0000","last_fullsized":"2023-11-15T02:53:38.000336+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:37.577352+0000","last_change":"2023-11-15T02:53:37.577352+0000","last_active":"2023-11-15T02:53:37.577352+0000","last_peered":"2023-11-15T02:53:37.577352+0000","last_clean":"2023-11-15T02:53:37.577352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:37.577352+0000","last_undegraded":"2023-11-15T02:53:37.577352+0000","last_fullsized":"2023-11-15T02:53:37.577352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987749+0000","last_change":"2023-11-15T02:53:37.601064+0000","last_active":"2023-11-15T02:53:37.987749+0000","last_peered":"2023-11-15T02:53:37.987749+0000","last_clean":"2023-11-15T02:53:37.987749+0000","last_became_active":"2023-11-15T02:53:37.600760+0000","last_became_peered":"2023-11-15T02:53:37.600760+0000","last_unstale":"2023-11-15T02:53:37.987749+0000","last_undegraded":"2023-11-15T02:53:37.987749+0000","last_fullsized":"2023-11-15T02:53:37.987749+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.016084+0000","last_change":"2023-11-15T02:53:38.012049+0000","last_active":"2023-11-15T02:53:38.016084+0000","last_peered":"2023-11-15T02:53:38.016084+0000","last_clean":"2023-11-15T02:53:38.016084+0000","last_became_active":"2023-11-15T02:53:38.011349+0000","last_became_peered":"2023-11-15T02:53:38.011349+0000","last_unstale":"2023-11-15T02:53:38.016084+0000","last_undegraded":"2023-11-15T02:53:38.016084+0000","last_fullsized":"2023-11-15T02:53:38.016084+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984955+0000","last_change":"2023-11-15T02:53:37.603600+0000","last_active":"2023-11-15T02:53:37.984955+0000","last_peered":"2023-11-15T02:53:37.984955+0000","last_clean":"2023-11-15T02:53:37.984955+0000","last_became_active":"2023-11-15T02:53:37.603284+0000","last_became_peered":"2023-11-15T02:53:37.603284+0000","last_unstale":"2023-11-15T02:53:37.984955+0000","last_undegraded":"2023-11-15T02:53:37.984955+0000","last_fullsized":"2023-11-15T02:53:37.984955+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:37.577352+0000","last_change":"2023-11-15T02:53:37.577352+0000","last_active":"2023-11-15T02:53:37.577352+0000","last_peered":"2023-11-15T02:53:37.577352+0000","last_clean":"2023-11-15T02:53:37.577352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:37.577352+0000","last_undegraded":"2023-11-15T02:53:37.577352+0000","last_fullsized":"2023-11-15T02:53:37.577352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002993+0000","last_change":"2023-11-15T02:53:37.600693+0000","last_active":"2023-11-15T02:53:38.002993+0000","last_peered":"2023-11-15T02:53:38.002993+0000","last_clean":"2023-11-15T02:53:38.002993+0000","last_became_active":"2023-11-15T02:53:37.600356+0000","last_became_peered":"2023-11-15T02:53:37.600356+0000","last_unstale":"2023-11-15T02:53:38.002993+0000","last_undegraded":"2023-11-15T02:53:38.002993+0000","last_fullsized":"2023-11-15T02:53:38.002993+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.007925+0000","last_change":"2023-11-15T02:53:38.004010+0000","last_active":"2023-11-15T02:53:38.007925+0000","last_peered":"2023-11-15T02:53:38.007925+0000","last_clean":"2023-11-15T02:53:38.007925+0000","last_became_active":"2023-11-15T02:53:38.003715+0000","last_became_peered":"2023-11-15T02:53:38.003715+0000","last_unstale":"2023-11-15T02:53:38.007925+0000","last_undegraded":"2023-11-15T02:53:38.007925+0000","last_fullsized":"2023-11-15T02:53:38.007925+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989453+0000","last_change":"2023-11-15T02:53:37.602439+0000","last_active":"2023-11-15T02:53:37.989453+0000","last_peered":"2023-11-15T02:53:37.989453+0000","last_clean":"2023-11-15T02:53:37.989453+0000","last_became_active":"2023-11-15T02:53:37.602154+0000","last_became_peered":"2023-11-15T02:53:37.602154+0000","last_unstale":"2023-11-15T02:53:37.989453+0000","last_undegraded":"2023-11-15T02:53:37.989453+0000","last_fullsized":"2023-11-15T02:53:37.989453+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009800+0000","last_change":"2023-11-15T02:53:38.006153+0000","last_active":"2023-11-15T02:53:38.009800+0000","last_peered":"2023-11-15T02:53:38.009800+0000","last_clean":"2023-11-15T02:53:38.009800+0000","last_became_active":"2023-11-15T02:53:38.005382+0000","last_became_peered":"2023-11-15T02:53:38.005382+0000","last_unstale":"2023-11-15T02:53:38.009800+0000","last_undegraded":"2023-11-15T02:53:38.009800+0000","last_fullsized":"2023-11-15T02:53:38.009800+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002479+0000","last_change":"2023-11-15T02:53:37.600307+0000","last_active":"2023-11-15T02:53:38.002479+0000","last_peered":"2023-11-15T02:53:38.002479+0000","last_clean":"2023-11-15T02:53:38.002479+0000","last_became_active":"2023-11-15T02:53:37.599973+0000","last_became_peered":"2023-11-15T02:53:37.599973+0000","last_unstale":"2023-11-15T02:53:38.002479+0000","last_undegraded":"2023-11-15T02:53:38.002479+0000","last_fullsized":"2023-11-15T02:53:38.002479+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006387+0000","last_change":"2023-11-15T02:53:38.000564+0000","last_active":"2023-11-15T02:53:38.006387+0000","last_peered":"2023-11-15T02:53:38.006387+0000","last_clean":"2023-11-15T02:53:38.006387+0000","last_became_active":"2023-11-15T02:53:38.000275+0000","last_became_peered":"2023-11-15T02:53:38.000275+0000","last_unstale":"2023-11-15T02:53:38.006387+0000","last_undegraded":"2023-11-15T02:53:38.006387+0000","last_fullsized":"2023-11-15T02:53:38.006387+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006231+0000","last_change":"2023-11-15T02:53:38.003771+0000","last_active":"2023-11-15T02:53:38.006231+0000","last_peered":"2023-11-15T02:53:38.006231+0000","last_clean":"2023-11-15T02:53:38.006231+0000","last_became_active":"2023-11-15T02:53:38.003121+0000","last_became_peered":"2023-11-15T02:53:38.003121+0000","last_unstale":"2023-11-15T02:53:38.006231+0000","last_undegraded":"2023-11-15T02:53:38.006231+0000","last_fullsized":"2023-11-15T02:53:38.006231+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987451+0000","last_change":"2023-11-15T02:53:37.596686+0000","last_active":"2023-11-15T02:53:37.987451+0000","last_peered":"2023-11-15T02:53:37.987451+0000","last_clean":"2023-11-15T02:53:37.987451+0000","last_became_active":"2023-11-15T02:53:37.596410+0000","last_became_peered":"2023-11-15T02:53:37.596410+0000","last_unstale":"2023-11-15T02:53:37.987451+0000","last_undegraded":"2023-11-15T02:53:37.987451+0000","last_fullsized":"2023-11-15T02:53:37.987451+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011367+0000","last_change":"2023-11-15T02:53:38.010715+0000","last_active":"2023-11-15T02:53:38.011367+0000","last_peered":"2023-11-15T02:53:38.011367+0000","last_clean":"2023-11-15T02:53:38.011367+0000","last_became_active":"2023-11-15T02:53:38.010419+0000","last_became_peered":"2023-11-15T02:53:38.010419+0000","last_unstale":"2023-11-15T02:53:38.011367+0000","last_undegraded":"2023-11-15T02:53:38.011367+0000","last_fullsized":"2023-11-15T02:53:38.011367+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:36.572051+0000","last_change":"2023-11-15T02:53:36.572051+0000","last_active":"2023-11-15T02:53:36.572051+0000","last_peered":"2023-11-15T02:53:36.572051+0000","last_clean":"2023-11-15T02:53:36.572051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:36.572051+0000","last_undegraded":"2023-11-15T02:53:36.572051+0000","last_fullsized":"2023-11-15T02:53:36.572051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999239+0000","last_change":"2023-11-15T02:53:37.994959+0000","last_active":"2023-11-15T02:53:37.999239+0000","last_peered":"2023-11-15T02:53:37.999239+0000","last_clean":"2023-11-15T02:53:37.999239+0000","last_became_active":"2023-11-15T02:53:37.994284+0000","last_became_peered":"2023-11-15T02:53:37.994284+0000","last_unstale":"2023-11-15T02:53:37.999239+0000","last_undegraded":"2023-11-15T02:53:37.999239+0000","last_fullsized":"2023-11-15T02:53:37.999239+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.997791+0000","last_change":"2023-11-15T02:53:37.600152+0000","last_active":"2023-11-15T02:53:37.997791+0000","last_peered":"2023-11-15T02:53:37.997791+0000","last_clean":"2023-11-15T02:53:37.997791+0000","last_became_active":"2023-11-15T02:53:37.599885+0000","last_became_peered":"2023-11-15T02:53:37.599885+0000","last_unstale":"2023-11-15T02:53:37.997791+0000","last_undegraded":"2023-11-15T02:53:37.997791+0000","last_fullsized":"2023-11-15T02:53:37.997791+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009330+0000","last_change":"2023-11-15T02:53:38.003735+0000","last_active":"2023-11-15T02:53:38.009330+0000","last_peered":"2023-11-15T02:53:38.009330+0000","last_clean":"2023-11-15T02:53:38.009330+0000","last_became_active":"2023-11-15T02:53:38.003432+0000","last_became_peered":"2023-11-15T02:53:38.003432+0000","last_unstale":"2023-11-15T02:53:38.009330+0000","last_undegraded":"2023-11-15T02:53:38.009330+0000","last_fullsized":"2023-11-15T02:53:38.009330+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.982577+0000","last_change":"2023-11-15T02:53:37.608038+0000","last_active":"2023-11-15T02:53:37.982577+0000","last_peered":"2023-11-15T02:53:37.982577+0000","last_clean":"2023-11-15T02:53:37.982577+0000","last_became_active":"2023-11-15T02:53:37.607545+0000","last_became_peered":"2023-11-15T02:53:37.607545+0000","last_unstale":"2023-11-15T02:53:37.982577+0000","last_undegraded":"2023-11-15T02:53:37.982577+0000","last_fullsized":"2023-11-15T02:53:37.982577+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005747+0000","last_change":"2023-11-15T02:53:38.000626+0000","last_active":"2023-11-15T02:53:38.005747+0000","last_peered":"2023-11-15T02:53:38.005747+0000","last_clean":"2023-11-15T02:53:38.005747+0000","last_became_active":"2023-11-15T02:53:38.000346+0000","last_became_peered":"2023-11-15T02:53:38.000346+0000","last_unstale":"2023-11-15T02:53:38.005747+0000","last_undegraded":"2023-11-15T02:53:38.005747+0000","last_fullsized":"2023-11-15T02:53:38.005747+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999272+0000","last_change":"2023-11-15T02:53:37.602774+0000","last_active":"2023-11-15T02:53:37.999272+0000","last_peered":"2023-11-15T02:53:37.999272+0000","last_clean":"2023-11-15T02:53:37.999272+0000","last_became_active":"2023-11-15T02:53:37.602261+0000","last_became_peered":"2023-11-15T02:53:37.602261+0000","last_unstale":"2023-11-15T02:53:37.999272+0000","last_undegraded":"2023-11-15T02:53:37.999272+0000","last_fullsized":"2023-11-15T02:53:37.999272+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005731+0000","last_change":"2023-11-15T02:53:38.004561+0000","last_active":"2023-11-15T02:53:38.005731+0000","last_peered":"2023-11-15T02:53:38.005731+0000","last_clean":"2023-11-15T02:53:38.005731+0000","last_became_active":"2023-11-15T02:53:38.004279+0000","last_became_peered":"2023-11-15T02:53:38.004279+0000","last_unstale":"2023-11-15T02:53:38.005731+0000","last_undegraded":"2023-11-15T02:53:38.005731+0000","last_fullsized":"2023-11-15T02:53:38.005731+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998408+0000","last_change":"2023-11-15T02:53:37.606814+0000","last_active":"2023-11-15T02:53:37.998408+0000","last_peered":"2023-11-15T02:53:37.998408+0000","last_clean":"2023-11-15T02:53:37.998408+0000","last_became_active":"2023-11-15T02:53:37.606517+0000","last_became_peered":"2023-11-15T02:53:37.606517+0000","last_unstale":"2023-11-15T02:53:37.998408+0000","last_undegraded":"2023-11-15T02:53:37.998408+0000","last_fullsized":"2023-11-15T02:53:37.998408+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002264+0000","last_change":"2023-11-15T02:53:37.998598+0000","last_active":"2023-11-15T02:53:38.002264+0000","last_peered":"2023-11-15T02:53:38.002264+0000","last_clean":"2023-11-15T02:53:38.002264+0000","last_became_active":"2023-11-15T02:53:37.998240+0000","last_became_peered":"2023-11-15T02:53:37.998240+0000","last_unstale":"2023-11-15T02:53:38.002264+0000","last_undegraded":"2023-11-15T02:53:38.002264+0000","last_fullsized":"2023-11-15T02:53:38.002264+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989840+0000","last_change":"2023-11-15T02:53:37.603875+0000","last_active":"2023-11-15T02:53:37.989840+0000","last_peered":"2023-11-15T02:53:37.989840+0000","last_clean":"2023-11-15T02:53:37.989840+0000","last_became_active":"2023-11-15T02:53:37.603204+0000","last_became_peered":"2023-11-15T02:53:37.603204+0000","last_unstale":"2023-11-15T02:53:37.989840+0000","last_undegraded":"2023-11-15T02:53:37.989840+0000","last_fullsized":"2023-11-15T02:53:37.989840+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010801+0000","last_change":"2023-11-15T02:53:38.009250+0000","last_active":"2023-11-15T02:53:38.010801+0000","last_peered":"2023-11-15T02:53:38.010801+0000","last_clean":"2023-11-15T02:53:38.010801+0000","last_became_active":"2023-11-15T02:53:38.009018+0000","last_became_peered":"2023-11-15T02:53:38.009018+0000","last_unstale":"2023-11-15T02:53:38.010801+0000","last_undegraded":"2023-11-15T02:53:38.010801+0000","last_fullsized":"2023-11-15T02:53:38.010801+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.986167+0000","last_change":"2023-11-15T02:53:37.604578+0000","last_active":"2023-11-15T02:53:37.986167+0000","last_peered":"2023-11-15T02:53:37.986167+0000","last_clean":"2023-11-15T02:53:37.986167+0000","last_became_active":"2023-11-15T02:53:37.604300+0000","last_became_peered":"2023-11-15T02:53:37.604300+0000","last_unstale":"2023-11-15T02:53:37.986167+0000","last_undegraded":"2023-11-15T02:53:37.986167+0000","last_fullsized":"2023-11-15T02:53:37.986167+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:37.577352+0000","last_change":"2023-11-15T02:53:37.577352+0000","last_active":"2023-11-15T02:53:37.577352+0000","last_peered":"2023-11-15T02:53:37.577352+0000","last_clean":"2023-11-15T02:53:37.577352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:37.577352+0000","last_undegraded":"2023-11-15T02:53:37.577352+0000","last_fullsized":"2023-11-15T02:53:37.577352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.986004+0000","last_change":"2023-11-15T02:53:37.608032+0000","last_active":"2023-11-15T02:53:37.986004+0000","last_peered":"2023-11-15T02:53:37.986004+0000","last_clean":"2023-11-15T02:53:37.986004+0000","last_became_active":"2023-11-15T02:53:37.607639+0000","last_became_peered":"2023-11-15T02:53:37.607639+0000","last_unstale":"2023-11-15T02:53:37.986004+0000","last_undegraded":"2023-11-15T02:53:37.986004+0000","last_fullsized":"2023-11-15T02:53:37.986004+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009389+0000","last_change":"2023-11-15T02:53:38.008531+0000","last_active":"2023-11-15T02:53:38.009389+0000","last_peered":"2023-11-15T02:53:38.009389+0000","last_clean":"2023-11-15T02:53:38.009389+0000","last_became_active":"2023-11-15T02:53:38.008308+0000","last_became_peered":"2023-11-15T02:53:38.008308+0000","last_unstale":"2023-11-15T02:53:38.009389+0000","last_undegraded":"2023-11-15T02:53:38.009389+0000","last_fullsized":"2023-11-15T02:53:38.009389+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984117+0000","last_change":"2023-11-15T02:53:37.603697+0000","last_active":"2023-11-15T02:53:37.984117+0000","last_peered":"2023-11-15T02:53:37.984117+0000","last_clean":"2023-11-15T02:53:37.984117+0000","last_became_active":"2023-11-15T02:53:37.603383+0000","last_became_peered":"2023-11-15T02:53:37.603383+0000","last_unstale":"2023-11-15T02:53:37.984117+0000","last_undegraded":"2023-11-15T02:53:37.984117+0000","last_fullsized":"2023-11-15T02:53:37.984117+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009909+0000","last_change":"2023-11-15T02:53:38.006412+0000","last_active":"2023-11-15T02:53:38.009909+0000","last_peered":"2023-11-15T02:53:38.009909+0000","last_clean":"2023-11-15T02:53:38.009909+0000","last_became_active":"2023-11-15T02:53:38.006097+0000","last_became_peered":"2023-11-15T02:53:38.006097+0000","last_unstale":"2023-11-15T02:53:38.009909+0000","last_undegraded":"2023-11-15T02:53:38.009909+0000","last_fullsized":"2023-11-15T02:53:38.009909+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999987+0000","last_change":"2023-11-15T02:53:37.605820+0000","last_active":"2023-11-15T02:53:37.999987+0000","last_peered":"2023-11-15T02:53:37.999987+0000","last_clean":"2023-11-15T02:53:37.999987+0000","last_became_active":"2023-11-15T02:53:37.605501+0000","last_became_peered":"2023-11-15T02:53:37.605501+0000","last_unstale":"2023-11-15T02:53:37.999987+0000","last_undegraded":"2023-11-15T02:53:37.999987+0000","last_fullsized":"2023-11-15T02:53:37.999987+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006092+0000","last_change":"2023-11-15T02:53:38.004891+0000","last_active":"2023-11-15T02:53:38.006092+0000","last_peered":"2023-11-15T02:53:38.006092+0000","last_clean":"2023-11-15T02:53:38.006092+0000","last_became_active":"2023-11-15T02:53:38.004627+0000","last_became_peered":"2023-11-15T02:53:38.004627+0000","last_unstale":"2023-11-15T02:53:38.006092+0000","last_undegraded":"2023-11-15T02:53:38.006092+0000","last_fullsized":"2023-11-15T02:53:38.006092+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003886+0000","last_change":"2023-11-15T02:53:37.607870+0000","last_active":"2023-11-15T02:53:38.003886+0000","last_peered":"2023-11-15T02:53:38.003886+0000","last_clean":"2023-11-15T02:53:38.003886+0000","last_became_active":"2023-11-15T02:53:37.607197+0000","last_became_peered":"2023-11-15T02:53:37.607197+0000","last_unstale":"2023-11-15T02:53:38.003886+0000","last_undegraded":"2023-11-15T02:53:38.003886+0000","last_fullsized":"2023-11-15T02:53:38.003886+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998637+0000","last_change":"2023-11-15T02:53:37.991469+0000","last_active":"2023-11-15T02:53:37.998637+0000","last_peered":"2023-11-15T02:53:37.998637+0000","last_clean":"2023-11-15T02:53:37.998637+0000","last_became_active":"2023-11-15T02:53:37.991176+0000","last_became_peered":"2023-11-15T02:53:37.991176+0000","last_unstale":"2023-11-15T02:53:37.998637+0000","last_undegraded":"2023-11-15T02:53:37.998637+0000","last_fullsized":"2023-11-15T02:53:37.998637+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009368+0000","last_change":"2023-11-15T02:53:37.602556+0000","last_active":"2023-11-15T02:53:38.009368+0000","last_peered":"2023-11-15T02:53:38.009368+0000","last_clean":"2023-11-15T02:53:38.009368+0000","last_became_active":"2023-11-15T02:53:37.601820+0000","last_became_peered":"2023-11-15T02:53:37.601820+0000","last_unstale":"2023-11-15T02:53:38.009368+0000","last_undegraded":"2023-11-15T02:53:38.009368+0000","last_fullsized":"2023-11-15T02:53:38.009368+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010539+0000","last_change":"2023-11-15T02:53:38.005868+0000","last_active":"2023-11-15T02:53:38.010539+0000","last_peered":"2023-11-15T02:53:38.010539+0000","last_clean":"2023-11-15T02:53:38.010539+0000","last_became_active":"2023-11-15T02:53:38.005558+0000","last_became_peered":"2023-11-15T02:53:38.005558+0000","last_unstale":"2023-11-15T02:53:38.010539+0000","last_undegraded":"2023-11-15T02:53:38.010539+0000","last_fullsized":"2023-11-15T02:53:38.010539+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987451+0000","last_change":"2023-11-15T02:53:37.601130+0000","last_active":"2023-11-15T02:53:37.987451+0000","last_peered":"2023-11-15T02:53:37.987451+0000","last_clean":"2023-11-15T02:53:37.987451+0000","last_became_active":"2023-11-15T02:53:37.600820+0000","last_became_peered":"2023-11-15T02:53:37.600820+0000","last_unstale":"2023-11-15T02:53:37.987451+0000","last_undegraded":"2023-11-15T02:53:37.987451+0000","last_fullsized":"2023-11-15T02:53:37.987451+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003379+0000","last_change":"2023-11-15T02:53:38.001102+0000","last_active":"2023-11-15T02:53:38.003379+0000","last_peered":"2023-11-15T02:53:38.003379+0000","last_clean":"2023-11-15T02:53:38.003379+0000","last_became_active":"2023-11-15T02:53:38.000814+0000","last_became_peered":"2023-11-15T02:53:38.000814+0000","last_unstale":"2023-11-15T02:53:38.003379+0000","last_undegraded":"2023-11-15T02:53:38.003379+0000","last_fullsized":"2023-11-15T02:53:38.003379+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998161+0000","last_change":"2023-11-15T02:53:37.609358+0000","last_active":"2023-11-15T02:53:37.998161+0000","last_peered":"2023-11-15T02:53:37.998161+0000","last_clean":"2023-11-15T02:53:37.998161+0000","last_became_active":"2023-11-15T02:53:37.608596+0000","last_became_peered":"2023-11-15T02:53:37.608596+0000","last_unstale":"2023-11-15T02:53:37.998161+0000","last_undegraded":"2023-11-15T02:53:37.998161+0000","last_fullsized":"2023-11-15T02:53:37.998161+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.995398+0000","last_change":"2023-11-15T02:53:37.993686+0000","last_active":"2023-11-15T02:53:37.995398+0000","last_peered":"2023-11-15T02:53:37.995398+0000","last_clean":"2023-11-15T02:53:37.995398+0000","last_became_active":"2023-11-15T02:53:37.993388+0000","last_became_peered":"2023-11-15T02:53:37.993388+0000","last_unstale":"2023-11-15T02:53:37.995398+0000","last_undegraded":"2023-11-15T02:53:37.995398+0000","last_fullsized":"2023-11-15T02:53:37.995398+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.982323+0000","last_change":"2023-11-15T02:53:37.607029+0000","last_active":"2023-11-15T02:53:37.982323+0000","last_peered":"2023-11-15T02:53:37.982323+0000","last_clean":"2023-11-15T02:53:37.982323+0000","last_became_active":"2023-11-15T02:53:37.606692+0000","last_became_peered":"2023-11-15T02:53:37.606692+0000","last_unstale":"2023-11-15T02:53:37.982323+0000","last_undegraded":"2023-11-15T02:53:37.982323+0000","last_fullsized":"2023-11-15T02:53:37.982323+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006246+0000","last_change":"2023-11-15T02:53:38.003944+0000","last_active":"2023-11-15T02:53:38.006246+0000","last_peered":"2023-11-15T02:53:38.006246+0000","last_clean":"2023-11-15T02:53:38.006246+0000","last_became_active":"2023-11-15T02:53:38.003507+0000","last_became_peered":"2023-11-15T02:53:38.003507+0000","last_unstale":"2023-11-15T02:53:38.006246+0000","last_undegraded":"2023-11-15T02:53:38.006246+0000","last_fullsized":"2023-11-15T02:53:38.006246+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987342+0000","last_change":"2023-11-15T02:53:37.609959+0000","last_active":"2023-11-15T02:53:37.987342+0000","last_peered":"2023-11-15T02:53:37.987342+0000","last_clean":"2023-11-15T02:53:37.987342+0000","last_became_active":"2023-11-15T02:53:37.609646+0000","last_became_peered":"2023-11-15T02:53:37.609646+0000","last_unstale":"2023-11-15T02:53:37.987342+0000","last_undegraded":"2023-11-15T02:53:37.987342+0000","last_fullsized":"2023-11-15T02:53:37.987342+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008553+0000","last_change":"2023-11-15T02:53:38.007038+0000","last_active":"2023-11-15T02:53:38.008553+0000","last_peered":"2023-11-15T02:53:38.008553+0000","last_clean":"2023-11-15T02:53:38.008553+0000","last_became_active":"2023-11-15T02:53:38.006729+0000","last_became_peered":"2023-11-15T02:53:38.006729+0000","last_unstale":"2023-11-15T02:53:38.008553+0000","last_undegraded":"2023-11-15T02:53:38.008553+0000","last_fullsized":"2023-11-15T02:53:38.008553+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.996205+0000","last_change":"2023-11-15T02:53:37.606243+0000","last_active":"2023-11-15T02:53:37.996205+0000","last_peered":"2023-11-15T02:53:37.996205+0000","last_clean":"2023-11-15T02:53:37.996205+0000","last_became_active":"2023-11-15T02:53:37.605925+0000","last_became_peered":"2023-11-15T02:53:37.605925+0000","last_unstale":"2023-11-15T02:53:37.996205+0000","last_undegraded":"2023-11-15T02:53:37.996205+0000","last_fullsized":"2023-11-15T02:53:37.996205+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005006+0000","last_change":"2023-11-15T02:53:38.002861+0000","last_active":"2023-11-15T02:53:38.005006+0000","last_peered":"2023-11-15T02:53:38.005006+0000","last_clean":"2023-11-15T02:53:38.005006+0000","last_became_active":"2023-11-15T02:53:38.002540+0000","last_became_peered":"2023-11-15T02:53:38.002540+0000","last_unstale":"2023-11-15T02:53:38.005006+0000","last_undegraded":"2023-11-15T02:53:38.005006+0000","last_fullsized":"2023-11-15T02:53:38.005006+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.004585+0000","last_change":"2023-11-15T02:53:37.607128+0000","last_active":"2023-11-15T02:53:38.004585+0000","last_peered":"2023-11-15T02:53:38.004585+0000","last_clean":"2023-11-15T02:53:38.004585+0000","last_became_active":"2023-11-15T02:53:37.606792+0000","last_became_peered":"2023-11-15T02:53:37.606792+0000","last_unstale":"2023-11-15T02:53:38.004585+0000","last_undegraded":"2023-11-15T02:53:38.004585+0000","last_fullsized":"2023-11-15T02:53:38.004585+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:37.577352+0000","last_change":"2023-11-15T02:53:37.577352+0000","last_active":"2023-11-15T02:53:37.577352+0000","last_peered":"2023-11-15T02:53:37.577352+0000","last_clean":"2023-11-15T02:53:37.577352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:37.577352+0000","last_undegraded":"2023-11-15T02:53:37.577352+0000","last_fullsized":"2023-11-15T02:53:37.577352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006720+0000","last_change":"2023-11-15T02:53:37.605340+0000","last_active":"2023-11-15T02:53:38.006720+0000","last_peered":"2023-11-15T02:53:38.006720+0000","last_clean":"2023-11-15T02:53:38.006720+0000","last_became_active":"2023-11-15T02:53:37.604736+0000","last_became_peered":"2023-11-15T02:53:37.604736+0000","last_unstale":"2023-11-15T02:53:38.006720+0000","last_undegraded":"2023-11-15T02:53:38.006720+0000","last_fullsized":"2023-11-15T02:53:38.006720+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009363+0000","last_change":"2023-11-15T02:53:38.004869+0000","last_active":"2023-11-15T02:53:38.009363+0000","last_peered":"2023-11-15T02:53:38.009363+0000","last_clean":"2023-11-15T02:53:38.009363+0000","last_became_active":"2023-11-15T02:53:38.004603+0000","last_became_peered":"2023-11-15T02:53:38.004603+0000","last_unstale":"2023-11-15T02:53:38.009363+0000","last_undegraded":"2023-11-15T02:53:38.009363+0000","last_fullsized":"2023-11-15T02:53:38.009363+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.982661+0000","last_change":"2023-11-15T02:53:37.599911+0000","last_active":"2023-11-15T02:53:37.982661+0000","last_peered":"2023-11-15T02:53:37.982661+0000","last_clean":"2023-11-15T02:53:37.982661+0000","last_became_active":"2023-11-15T02:53:37.599611+0000","last_became_peered":"2023-11-15T02:53:37.599611+0000","last_unstale":"2023-11-15T02:53:37.982661+0000","last_undegraded":"2023-11-15T02:53:37.982661+0000","last_fullsized":"2023-11-15T02:53:37.982661+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011156+0000","last_change":"2023-11-15T02:53:38.006173+0000","last_active":"2023-11-15T02:53:38.011156+0000","last_peered":"2023-11-15T02:53:38.011156+0000","last_clean":"2023-11-15T02:53:38.011156+0000","last_became_active":"2023-11-15T02:53:38.005873+0000","last_became_peered":"2023-11-15T02:53:38.005873+0000","last_unstale":"2023-11-15T02:53:38.011156+0000","last_undegraded":"2023-11-15T02:53:38.011156+0000","last_fullsized":"2023-11-15T02:53:38.011156+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998518+0000","last_change":"2023-11-15T02:53:37.609046+0000","last_active":"2023-11-15T02:53:37.998518+0000","last_peered":"2023-11-15T02:53:37.998518+0000","last_clean":"2023-11-15T02:53:37.998518+0000","last_became_active":"2023-11-15T02:53:37.608665+0000","last_became_peered":"2023-11-15T02:53:37.608665+0000","last_unstale":"2023-11-15T02:53:37.998518+0000","last_undegraded":"2023-11-15T02:53:37.998518+0000","last_fullsized":"2023-11-15T02:53:37.998518+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009819+0000","last_change":"2023-11-15T02:53:38.006320+0000","last_active":"2023-11-15T02:53:38.009819+0000","last_peered":"2023-11-15T02:53:38.009819+0000","last_clean":"2023-11-15T02:53:38.009819+0000","last_became_active":"2023-11-15T02:53:38.005786+0000","last_became_peered":"2023-11-15T02:53:38.005786+0000","last_unstale":"2023-11-15T02:53:38.009819+0000","last_undegraded":"2023-11-15T02:53:38.009819+0000","last_fullsized":"2023-11-15T02:53:38.009819+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001944+0000","last_change":"2023-11-15T02:53:37.599390+0000","last_active":"2023-11-15T02:53:38.001944+0000","last_peered":"2023-11-15T02:53:38.001944+0000","last_clean":"2023-11-15T02:53:38.001944+0000","last_became_active":"2023-11-15T02:53:37.598476+0000","last_became_peered":"2023-11-15T02:53:37.598476+0000","last_unstale":"2023-11-15T02:53:38.001944+0000","last_undegraded":"2023-11-15T02:53:38.001944+0000","last_fullsized":"2023-11-15T02:53:38.001944+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009422+0000","last_change":"2023-11-15T02:53:38.005651+0000","last_active":"2023-11-15T02:53:38.009422+0000","last_peered":"2023-11-15T02:53:38.009422+0000","last_clean":"2023-11-15T02:53:38.009422+0000","last_became_active":"2023-11-15T02:53:38.005405+0000","last_became_peered":"2023-11-15T02:53:38.005405+0000","last_unstale":"2023-11-15T02:53:38.009422+0000","last_undegraded":"2023-11-15T02:53:38.009422+0000","last_fullsized":"2023-11-15T02:53:38.009422+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.996886+0000","last_change":"2023-11-15T02:53:37.603759+0000","last_active":"2023-11-15T02:53:37.996886+0000","last_peered":"2023-11-15T02:53:37.996886+0000","last_clean":"2023-11-15T02:53:37.996886+0000","last_became_active":"2023-11-15T02:53:37.603485+0000","last_became_peered":"2023-11-15T02:53:37.603485+0000","last_unstale":"2023-11-15T02:53:37.996886+0000","last_undegraded":"2023-11-15T02:53:37.996886+0000","last_fullsized":"2023-11-15T02:53:37.996886+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999205+0000","last_change":"2023-11-15T02:53:37.998244+0000","last_active":"2023-11-15T02:53:37.999205+0000","last_peered":"2023-11-15T02:53:37.999205+0000","last_clean":"2023-11-15T02:53:37.999205+0000","last_became_active":"2023-11-15T02:53:37.997925+0000","last_became_peered":"2023-11-15T02:53:37.997925+0000","last_unstale":"2023-11-15T02:53:37.999205+0000","last_undegraded":"2023-11-15T02:53:37.999205+0000","last_fullsized":"2023-11-15T02:53:37.999205+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987621+0000","last_change":"2023-11-15T02:53:37.595509+0000","last_active":"2023-11-15T02:53:37.987621+0000","last_peered":"2023-11-15T02:53:37.987621+0000","last_clean":"2023-11-15T02:53:37.987621+0000","last_became_active":"2023-11-15T02:53:37.595150+0000","last_became_peered":"2023-11-15T02:53:37.595150+0000","last_unstale":"2023-11-15T02:53:37.987621+0000","last_undegraded":"2023-11-15T02:53:37.987621+0000","last_fullsized":"2023-11-15T02:53:37.987621+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006014+0000","last_change":"2023-11-15T02:53:37.998617+0000","last_active":"2023-11-15T02:53:38.006014+0000","last_peered":"2023-11-15T02:53:38.006014+0000","last_clean":"2023-11-15T02:53:38.006014+0000","last_became_active":"2023-11-15T02:53:37.998336+0000","last_became_peered":"2023-11-15T02:53:37.998336+0000","last_unstale":"2023-11-15T02:53:38.006014+0000","last_undegraded":"2023-11-15T02:53:38.006014+0000","last_fullsized":"2023-11-15T02:53:38.006014+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992794+0000","last_change":"2023-11-15T02:53:37.605177+0000","last_active":"2023-11-15T02:53:37.992794+0000","last_peered":"2023-11-15T02:53:37.992794+0000","last_clean":"2023-11-15T02:53:37.992794+0000","last_became_active":"2023-11-15T02:53:37.604785+0000","last_became_peered":"2023-11-15T02:53:37.604785+0000","last_unstale":"2023-11-15T02:53:37.992794+0000","last_undegraded":"2023-11-15T02:53:37.992794+0000","last_fullsized":"2023-11-15T02:53:37.992794+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009156+0000","last_change":"2023-11-15T02:53:38.005499+0000","last_active":"2023-11-15T02:53:38.009156+0000","last_peered":"2023-11-15T02:53:38.009156+0000","last_clean":"2023-11-15T02:53:38.009156+0000","last_became_active":"2023-11-15T02:53:38.005211+0000","last_became_peered":"2023-11-15T02:53:38.005211+0000","last_unstale":"2023-11-15T02:53:38.009156+0000","last_undegraded":"2023-11-15T02:53:38.009156+0000","last_fullsized":"2023-11-15T02:53:38.009156+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005286+0000","last_change":"2023-11-15T02:53:37.593975+0000","last_active":"2023-11-15T02:53:38.005286+0000","last_peered":"2023-11-15T02:53:38.005286+0000","last_clean":"2023-11-15T02:53:38.005286+0000","last_became_active":"2023-11-15T02:53:37.593701+0000","last_became_peered":"2023-11-15T02:53:37.593701+0000","last_unstale":"2023-11-15T02:53:38.005286+0000","last_undegraded":"2023-11-15T02:53:38.005286+0000","last_fullsized":"2023-11-15T02:53:38.005286+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003057+0000","last_change":"2023-11-15T02:53:37.998034+0000","last_active":"2023-11-15T02:53:38.003057+0000","last_peered":"2023-11-15T02:53:38.003057+0000","last_clean":"2023-11-15T02:53:38.003057+0000","last_became_active":"2023-11-15T02:53:37.997729+0000","last_became_peered":"2023-11-15T02:53:37.997729+0000","last_unstale":"2023-11-15T02:53:38.003057+0000","last_undegraded":"2023-11-15T02:53:38.003057+0000","last_fullsized":"2023-11-15T02:53:38.003057+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.985057+0000","last_change":"2023-11-15T02:53:37.610489+0000","last_active":"2023-11-15T02:53:37.985057+0000","last_peered":"2023-11-15T02:53:37.985057+0000","last_clean":"2023-11-15T02:53:37.985057+0000","last_became_active":"2023-11-15T02:53:37.610002+0000","last_became_peered":"2023-11-15T02:53:37.610002+0000","last_unstale":"2023-11-15T02:53:37.985057+0000","last_undegraded":"2023-11-15T02:53:37.985057+0000","last_fullsized":"2023-11-15T02:53:37.985057+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002358+0000","last_change":"2023-11-15T02:53:38.000481+0000","last_active":"2023-11-15T02:53:38.002358+0000","last_peered":"2023-11-15T02:53:38.002358+0000","last_clean":"2023-11-15T02:53:38.002358+0000","last_became_active":"2023-11-15T02:53:38.000196+0000","last_became_peered":"2023-11-15T02:53:38.000196+0000","last_unstale":"2023-11-15T02:53:38.002358+0000","last_undegraded":"2023-11-15T02:53:38.002358+0000","last_fullsized":"2023-11-15T02:53:38.002358+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984215+0000","last_change":"2023-11-15T02:53:37.601783+0000","last_active":"2023-11-15T02:53:37.984215+0000","last_peered":"2023-11-15T02:53:37.984215+0000","last_clean":"2023-11-15T02:53:37.984215+0000","last_became_active":"2023-11-15T02:53:37.601473+0000","last_became_peered":"2023-11-15T02:53:37.601473+0000","last_unstale":"2023-11-15T02:53:37.984215+0000","last_undegraded":"2023-11-15T02:53:37.984215+0000","last_fullsized":"2023-11-15T02:53:37.984215+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002345+0000","last_change":"2023-11-15T02:53:37.997031+0000","last_active":"2023-11-15T02:53:38.002345+0000","last_peered":"2023-11-15T02:53:38.002345+0000","last_clean":"2023-11-15T02:53:38.002345+0000","last_became_active":"2023-11-15T02:53:37.996771+0000","last_became_peered":"2023-11-15T02:53:37.996771+0000","last_unstale":"2023-11-15T02:53:38.002345+0000","last_undegraded":"2023-11-15T02:53:38.002345+0000","last_fullsized":"2023-11-15T02:53:38.002345+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987557+0000","last_change":"2023-11-15T02:53:37.603411+0000","last_active":"2023-11-15T02:53:37.987557+0000","last_peered":"2023-11-15T02:53:37.987557+0000","last_clean":"2023-11-15T02:53:37.987557+0000","last_became_active":"2023-11-15T02:53:37.603095+0000","last_became_peered":"2023-11-15T02:53:37.603095+0000","last_unstale":"2023-11-15T02:53:37.987557+0000","last_undegraded":"2023-11-15T02:53:37.987557+0000","last_fullsized":"2023-11-15T02:53:37.987557+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.000207+0000","last_change":"2023-11-15T02:53:37.992925+0000","last_active":"2023-11-15T02:53:38.000207+0000","last_peered":"2023-11-15T02:53:38.000207+0000","last_clean":"2023-11-15T02:53:38.000207+0000","last_became_active":"2023-11-15T02:53:37.991495+0000","last_became_peered":"2023-11-15T02:53:37.991495+0000","last_unstale":"2023-11-15T02:53:38.000207+0000","last_undegraded":"2023-11-15T02:53:38.000207+0000","last_fullsized":"2023-11-15T02:53:38.000207+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.986519+0000","last_change":"2023-11-15T02:53:37.602735+0000","last_active":"2023-11-15T02:53:37.986519+0000","last_peered":"2023-11-15T02:53:37.986519+0000","last_clean":"2023-11-15T02:53:37.986519+0000","last_became_active":"2023-11-15T02:53:37.602437+0000","last_became_peered":"2023-11-15T02:53:37.602437+0000","last_unstale":"2023-11-15T02:53:37.986519+0000","last_undegraded":"2023-11-15T02:53:37.986519+0000","last_fullsized":"2023-11-15T02:53:37.986519+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010619+0000","last_change":"2023-11-15T02:53:38.006525+0000","last_active":"2023-11-15T02:53:38.010619+0000","last_peered":"2023-11-15T02:53:38.010619+0000","last_clean":"2023-11-15T02:53:38.010619+0000","last_became_active":"2023-11-15T02:53:38.006118+0000","last_became_peered":"2023-11-15T02:53:38.006118+0000","last_unstale":"2023-11-15T02:53:38.010619+0000","last_undegraded":"2023-11-15T02:53:38.010619+0000","last_fullsized":"2023-11-15T02:53:38.010619+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.985276+0000","last_change":"2023-11-15T02:53:37.604591+0000","last_active":"2023-11-15T02:53:37.985276+0000","last_peered":"2023-11-15T02:53:37.985276+0000","last_clean":"2023-11-15T02:53:37.985276+0000","last_became_active":"2023-11-15T02:53:37.604050+0000","last_became_peered":"2023-11-15T02:53:37.604050+0000","last_unstale":"2023-11-15T02:53:37.985276+0000","last_undegraded":"2023-11-15T02:53:37.985276+0000","last_fullsized":"2023-11-15T02:53:37.985276+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009789+0000","last_change":"2023-11-15T02:53:38.005163+0000","last_active":"2023-11-15T02:53:38.009789+0000","last_peered":"2023-11-15T02:53:38.009789+0000","last_clean":"2023-11-15T02:53:38.009789+0000","last_became_active":"2023-11-15T02:53:38.004858+0000","last_became_peered":"2023-11-15T02:53:38.004858+0000","last_unstale":"2023-11-15T02:53:38.009789+0000","last_undegraded":"2023-11-15T02:53:38.009789+0000","last_fullsized":"2023-11-15T02:53:38.009789+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001263+0000","last_change":"2023-11-15T02:53:37.603691+0000","last_active":"2023-11-15T02:53:38.001263+0000","last_peered":"2023-11-15T02:53:38.001263+0000","last_clean":"2023-11-15T02:53:38.001263+0000","last_became_active":"2023-11-15T02:53:37.603376+0000","last_became_peered":"2023-11-15T02:53:37.603376+0000","last_unstale":"2023-11-15T02:53:38.001263+0000","last_undegraded":"2023-11-15T02:53:38.001263+0000","last_fullsized":"2023-11-15T02:53:38.001263+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009156+0000","last_change":"2023-11-15T02:53:38.007691+0000","last_active":"2023-11-15T02:53:38.009156+0000","last_peered":"2023-11-15T02:53:38.009156+0000","last_clean":"2023-11-15T02:53:38.009156+0000","last_became_active":"2023-11-15T02:53:38.007438+0000","last_became_peered":"2023-11-15T02:53:38.007438+0000","last_unstale":"2023-11-15T02:53:38.009156+0000","last_undegraded":"2023-11-15T02:53:38.009156+0000","last_fullsized":"2023-11-15T02:53:38.009156+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.981762+0000","last_change":"2023-11-15T02:53:37.607898+0000","last_active":"2023-11-15T02:53:37.981762+0000","last_peered":"2023-11-15T02:53:37.981762+0000","last_clean":"2023-11-15T02:53:37.981762+0000","last_became_active":"2023-11-15T02:53:37.607133+0000","last_became_peered":"2023-11-15T02:53:37.607133+0000","last_unstale":"2023-11-15T02:53:37.981762+0000","last_undegraded":"2023-11-15T02:53:37.981762+0000","last_fullsized":"2023-11-15T02:53:37.981762+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010798+0000","last_change":"2023-11-15T02:53:38.009352+0000","last_active":"2023-11-15T02:53:38.010798+0000","last_peered":"2023-11-15T02:53:38.010798+0000","last_clean":"2023-11-15T02:53:38.010798+0000","last_became_active":"2023-11-15T02:53:38.007690+0000","last_became_peered":"2023-11-15T02:53:38.007690+0000","last_unstale":"2023-11-15T02:53:38.010798+0000","last_undegraded":"2023-11-15T02:53:38.010798+0000","last_fullsized":"2023-11-15T02:53:38.010798+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003527+0000","last_change":"2023-11-15T02:53:37.607389+0000","last_active":"2023-11-15T02:53:38.003527+0000","last_peered":"2023-11-15T02:53:38.003527+0000","last_clean":"2023-11-15T02:53:38.003527+0000","last_became_active":"2023-11-15T02:53:37.607111+0000","last_became_peered":"2023-11-15T02:53:37.607111+0000","last_unstale":"2023-11-15T02:53:38.003527+0000","last_undegraded":"2023-11-15T02:53:38.003527+0000","last_fullsized":"2023-11-15T02:53:38.003527+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998721+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:53:37.998721+0000","last_peered":"2023-11-15T02:53:37.998721+0000","last_clean":"2023-11-15T02:53:37.998721+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:53:37.998721+0000","last_undegraded":"2023-11-15T02:53:37.998721+0000","last_fullsized":"2023-11-15T02:53:37.998721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009887+0000","last_change":"2023-11-15T02:53:38.006186+0000","last_active":"2023-11-15T02:53:38.009887+0000","last_peered":"2023-11-15T02:53:38.009887+0000","last_clean":"2023-11-15T02:53:38.009887+0000","last_became_active":"2023-11-15T02:53:38.005653+0000","last_became_peered":"2023-11-15T02:53:38.005653+0000","last_unstale":"2023-11-15T02:53:38.009887+0000","last_undegraded":"2023-11-15T02:53:38.009887+0000","last_fullsized":"2023-11-15T02:53:38.009887+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984526+0000","last_change":"2023-11-15T02:53:37.610922+0000","last_active":"2023-11-15T02:53:37.984526+0000","last_peered":"2023-11-15T02:53:37.984526+0000","last_clean":"2023-11-15T02:53:37.984526+0000","last_became_active":"2023-11-15T02:53:37.610028+0000","last_became_peered":"2023-11-15T02:53:37.610028+0000","last_unstale":"2023-11-15T02:53:37.984526+0000","last_undegraded":"2023-11-15T02:53:37.984526+0000","last_fullsized":"2023-11-15T02:53:37.984526+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":162,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.997839+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:53:37.997839+0000","last_peered":"2023-11-15T02:53:37.997839+0000","last_clean":"2023-11-15T02:53:37.997839+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:53:37.997839+0000","last_undegraded":"2023-11-15T02:53:37.997839+0000","last_fullsized":"2023-11-15T02:53:37.997839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.996916+0000","last_change":"2023-11-15T02:53:37.995964+0000","last_active":"2023-11-15T02:53:37.996916+0000","last_peered":"2023-11-15T02:53:37.996916+0000","last_clean":"2023-11-15T02:53:37.996916+0000","last_became_active":"2023-11-15T02:53:37.995659+0000","last_became_peered":"2023-11-15T02:53:37.995659+0000","last_unstale":"2023-11-15T02:53:37.996916+0000","last_undegraded":"2023-11-15T02:53:37.996916+0000","last_fullsized":"2023-11-15T02:53:37.996916+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.004104+0000","last_change":"2023-11-15T02:53:37.610832+0000","last_active":"2023-11-15T02:53:38.004104+0000","last_peered":"2023-11-15T02:53:38.004104+0000","last_clean":"2023-11-15T02:53:38.004104+0000","last_became_active":"2023-11-15T02:53:37.610517+0000","last_became_peered":"2023-11-15T02:53:37.610517+0000","last_unstale":"2023-11-15T02:53:38.004104+0000","last_undegraded":"2023-11-15T02:53:38.004104+0000","last_fullsized":"2023-11-15T02:53:38.004104+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987235+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:53:37.987235+0000","last_peered":"2023-11-15T02:53:37.987235+0000","last_clean":"2023-11-15T02:53:37.987235+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:53:37.987235+0000","last_undegraded":"2023-11-15T02:53:37.987235+0000","last_fullsized":"2023-11-15T02:53:37.987235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008034+0000","last_change":"2023-11-15T02:53:38.004908+0000","last_active":"2023-11-15T02:53:38.008034+0000","last_peered":"2023-11-15T02:53:38.008034+0000","last_clean":"2023-11-15T02:53:38.008034+0000","last_became_active":"2023-11-15T02:53:38.004646+0000","last_became_peered":"2023-11-15T02:53:38.004646+0000","last_unstale":"2023-11-15T02:53:38.008034+0000","last_undegraded":"2023-11-15T02:53:38.008034+0000","last_fullsized":"2023-11-15T02:53:38.008034+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984950+0000","last_change":"2023-11-15T02:53:37.611678+0000","last_active":"2023-11-15T02:53:37.984950+0000","last_peered":"2023-11-15T02:53:37.984950+0000","last_clean":"2023-11-15T02:53:37.984950+0000","last_became_active":"2023-11-15T02:53:37.610384+0000","last_became_peered":"2023-11-15T02:53:37.610384+0000","last_unstale":"2023-11-15T02:53:37.984950+0000","last_undegraded":"2023-11-15T02:53:37.984950+0000","last_fullsized":"2023-11-15T02:53:37.984950+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":162,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989854+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:53:37.989854+0000","last_peered":"2023-11-15T02:53:37.989854+0000","last_clean":"2023-11-15T02:53:37.989854+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:53:37.989854+0000","last_undegraded":"2023-11-15T02:53:37.989854+0000","last_fullsized":"2023-11-15T02:53:37.989854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992682+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:53:37.992682+0000","last_peered":"2023-11-15T02:53:37.992682+0000","last_clean":"2023-11-15T02:53:37.992682+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:53:37.992682+0000","last_undegraded":"2023-11-15T02:53:37.992682+0000","last_fullsized":"2023-11-15T02:53:37.992682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.000622+0000","last_change":"2023-11-15T02:53:37.996966+0000","last_active":"2023-11-15T02:53:38.000622+0000","last_peered":"2023-11-15T02:53:38.000622+0000","last_clean":"2023-11-15T02:53:38.000622+0000","last_became_active":"2023-11-15T02:53:37.996716+0000","last_became_peered":"2023-11-15T02:53:37.996716+0000","last_unstale":"2023-11-15T02:53:38.000622+0000","last_undegraded":"2023-11-15T02:53:38.000622+0000","last_fullsized":"2023-11-15T02:53:38.000622+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"195'3","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010557+0000","last_change":"2023-11-15T02:53:37.602954+0000","last_active":"2023-11-15T02:53:38.010557+0000","last_peered":"2023-11-15T02:53:38.010557+0000","last_clean":"2023-11-15T02:53:38.010557+0000","last_became_active":"2023-11-15T02:53:37.602650+0000","last_became_peered":"2023-11-15T02:53:37.602650+0000","last_unstale":"2023-11-15T02:53:38.010557+0000","last_undegraded":"2023-11-15T02:53:38.010557+0000","last_fullsized":"2023-11-15T02:53:38.010557+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992790+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:53:37.992790+0000","last_peered":"2023-11-15T02:53:37.992790+0000","last_clean":"2023-11-15T02:53:37.992790+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:53:37.992790+0000","last_undegraded":"2023-11-15T02:53:37.992790+0000","last_fullsized":"2023-11-15T02:53:37.992790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006116+0000","last_change":"2023-11-15T02:53:38.004904+0000","last_active":"2023-11-15T02:53:38.006116+0000","last_peered":"2023-11-15T02:53:38.006116+0000","last_clean":"2023-11-15T02:53:38.006116+0000","last_became_active":"2023-11-15T02:53:38.002970+0000","last_became_peered":"2023-11-15T02:53:38.002970+0000","last_unstale":"2023-11-15T02:53:38.006116+0000","last_undegraded":"2023-11-15T02:53:38.006116+0000","last_fullsized":"2023-11-15T02:53:38.006116+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"195'4","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010616+0000","last_change":"2023-11-15T02:53:37.602372+0000","last_active":"2023-11-15T02:53:38.010616+0000","last_peered":"2023-11-15T02:53:38.010616+0000","last_clean":"2023-11-15T02:53:38.010616+0000","last_became_active":"2023-11-15T02:53:37.602042+0000","last_became_peered":"2023-11-15T02:53:37.602042+0000","last_unstale":"2023-11-15T02:53:38.010616+0000","last_undegraded":"2023-11-15T02:53:38.010616+0000","last_fullsized":"2023-11-15T02:53:38.010616+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.993798+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:53:37.993798+0000","last_peered":"2023-11-15T02:53:37.993798+0000","last_clean":"2023-11-15T02:53:37.993798+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:53:37.993798+0000","last_undegraded":"2023-11-15T02:53:37.993798+0000","last_fullsized":"2023-11-15T02:53:37.993798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-15T02:53:37.577352+0000","last_change":"2023-11-15T02:53:37.577352+0000","last_active":"2023-11-15T02:53:37.577352+0000","last_peered":"2023-11-15T02:53:37.577352+0000","last_clean":"2023-11-15T02:53:37.577352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-15T02:53:37.577352+0000","last_undegraded":"2023-11-15T02:53:37.577352+0000","last_fullsized":"2023-11-15T02:53:37.577352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011456+0000","last_change":"2023-11-15T02:53:37.607737+0000","last_active":"2023-11-15T02:53:38.011456+0000","last_peered":"2023-11-15T02:53:38.011456+0000","last_clean":"2023-11-15T02:53:38.011456+0000","last_became_active":"2023-11-15T02:53:37.607051+0000","last_became_peered":"2023-11-15T02:53:37.607051+0000","last_unstale":"2023-11-15T02:53:38.011456+0000","last_undegraded":"2023-11-15T02:53:38.011456+0000","last_fullsized":"2023-11-15T02:53:38.011456+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001049+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:53:38.001049+0000","last_peered":"2023-11-15T02:53:38.001049+0000","last_clean":"2023-11-15T02:53:38.001049+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:53:38.001049+0000","last_undegraded":"2023-11-15T02:53:38.001049+0000","last_fullsized":"2023-11-15T02:53:38.001049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003060+0000","last_change":"2023-11-15T02:53:37.998675+0000","last_active":"2023-11-15T02:53:38.003060+0000","last_peered":"2023-11-15T02:53:38.003060+0000","last_clean":"2023-11-15T02:53:38.003060+0000","last_became_active":"2023-11-15T02:53:37.998261+0000","last_became_peered":"2023-11-15T02:53:37.998261+0000","last_unstale":"2023-11-15T02:53:38.003060+0000","last_undegraded":"2023-11-15T02:53:38.003060+0000","last_fullsized":"2023-11-15T02:53:38.003060+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.985238+0000","last_change":"2023-11-15T02:53:37.598178+0000","last_active":"2023-11-15T02:53:37.985238+0000","last_peered":"2023-11-15T02:53:37.985238+0000","last_clean":"2023-11-15T02:53:37.985238+0000","last_became_active":"2023-11-15T02:53:37.597661+0000","last_became_peered":"2023-11-15T02:53:37.597661+0000","last_unstale":"2023-11-15T02:53:37.985238+0000","last_undegraded":"2023-11-15T02:53:37.985238+0000","last_fullsized":"2023-11-15T02:53:37.985238+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":178,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-11-15T02:53:32.537966+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:53:32.537966+0000","last_peered":"2023-11-15T02:53:32.537966+0000","last_clean":"2023-11-15T02:53:32.537966+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:53:32.537966+0000","last_undegraded":"2023-11-15T02:53:32.537966+0000","last_fullsized":"2023-11-15T02:53:32.537966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":118,"acting":118,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":1414,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":110,"acting":110,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575945,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303580,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068260,"statfs":{"total":96636764160,"available":96325898240,"internally_reserved":0,"allocated":2445312,"data_stored":1303745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.82599999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.57699999999999996},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72599999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.51400000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.42099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.67900000000000005,"5min":0.752,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.78000000000000003,"15min":0.80400000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.44800000000000001,"5min":0.441,"15min":0.40999999999999998},"max":{"1min":0.75700000000000001,"5min":0.79100000000000004,"15min":0.83799999999999997},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.754,"5min":0.81000000000000005,"15min":0.88500000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.62},"min":{"1min":0.47899999999999998,"5min":0.40699999999999997,"15min":0.377},"max":{"1min":0.81899999999999995,"5min":0.84799999999999998,"15min":0.86699999999999999},"last":0.58099999999999996}]},{"osd":4,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46100000000000002,"15min":0.47699999999999998},"min":{"1min":0.32800000000000001,"5min":0.29199999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.749},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.64700000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47899999999999998,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.79500000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.81999999999999995},"last":0.625}]},{"osd":6,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.37,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.84899999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.35299999999999998,"15min":0.28499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.68899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575945,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307632,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064208,"statfs":{"total":96636764160,"available":96321748992,"internally_reserved":0,"allocated":2400256,"data_stored":1280648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.24099999999999999},"max":{"1min":0.749,"5min":0.80000000000000004,"15min":0.92500000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.27700000000000002},"max":{"1min":0.71999999999999997,"5min":0.77300000000000002,"15min":0.873},"last":1.466}]},{"osd":1,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75700000000000001,"5min":0.81399999999999995,"15min":0.81999999999999995},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.36199999999999999},"max":{"1min":0.69299999999999995,"5min":0.77200000000000002,"15min":0.88},"last":1.53}]},{"osd":2,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.78400000000000003,"15min":0.84599999999999997},"last":1.026},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.45300000000000001,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.72799999999999998,"5min":0.83399999999999996,"15min":0.88900000000000001},"last":0.99199999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.42699999999999999,"5min":0.35299999999999998,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60799999999999998,"15min":0.60699999999999998},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.38},"max":{"1min":0.78000000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":1.498}]},{"osd":4,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45900000000000002},"min":{"1min":0.29799999999999999,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.64100000000000001,"5min":0.72999999999999998,"15min":0.82199999999999995},"last":1.4810000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.39600000000000002,"5min":0.34799999999999998,"15min":0.30099999999999999},"max":{"1min":0.70899999999999996,"5min":0.79500000000000004,"15min":0.874},"last":1.5189999999999999}]},{"osd":5,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.32400000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.82799999999999996},"last":1.5880000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.32000000000000001},"max":{"1min":0.70999999999999996,"5min":0.77000000000000002,"15min":0.95099999999999996},"last":1.5669999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.50900000000000001},"min":{"1min":0.33700000000000002,"5min":0.32600000000000001,"15min":0.30499999999999999},"max":{"1min":0.65200000000000002,"5min":0.74199999999999999,"15min":0.90100000000000002},"last":1.04},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.434,"5min":0.42599999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.83799999999999997,"15min":0.875},"last":1.5509999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575947,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307688,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064152,"statfs":{"total":96636764160,"available":96321691648,"internally_reserved":0,"allocated":2457600,"data_stored":1310171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.39200000000000002},"min":{"1min":0.28599999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.432},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.436,"15min":0.41899999999999998},"min":{"1min":0.28799999999999998,"5min":0.255,"15min":0.255},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.312}]},{"osd":2,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42099999999999999,"15min":0.40799999999999997},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.47799999999999998,"15min":0.46300000000000002},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.40799999999999997}]},{"osd":3,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.441,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.375},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.41999999999999998,"5min":0.32500000000000001,"15min":0.315},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.441}]},{"osd":4,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.49199999999999999,"5min":0.436,"15min":0.372},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.53400000000000003,"5min":0.42399999999999999,"15min":0.41299999999999998},"max":{"1min":1.0289999999999999,"5min":1.081,"15min":1.081},"last":0.69899999999999995}]},{"osd":5,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67000000000000004,"15min":0.66000000000000003},"min":{"1min":0.52100000000000002,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68700000000000006,"15min":0.67400000000000004},"min":{"1min":0.54900000000000004,"5min":0.45600000000000002,"15min":0.42699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.70799999999999996}]},{"osd":6,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.52300000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.73599999999999999,"15min":0.72399999999999998},"min":{"1min":0.64500000000000002,"5min":0.53500000000000003,"15min":0.48999999999999999},"max":{"1min":0.98399999999999999,"5min":1,"15min":1},"last":0.75800000000000001}]},{"osd":7,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.67600000000000005,"5min":0.52600000000000002,"15min":0.46600000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.746,"15min":0.72999999999999998},"min":{"1min":0.627,"5min":0.52100000000000002,"15min":0.48399999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0009999999999999},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575945,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311768,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060072,"statfs":{"total":96636764160,"available":96317513728,"internally_reserved":0,"allocated":2441216,"data_stored":1302333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.40000000000000002,"15min":0.39900000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.63300000000000001,"15min":0.73499999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61299999999999999,"5min":0.68100000000000005,"15min":0.89400000000000002},"last":0.39000000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41699999999999998,"15min":0.40799999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.23599999999999999},"max":{"1min":0.626,"5min":0.66500000000000004,"15min":0.755},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47099999999999997,"15min":0.46500000000000002},"min":{"1min":0.35499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64700000000000002,"5min":0.71199999999999997,"15min":0.77200000000000002},"last":0.33000000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66200000000000003,"5min":0.73399999999999999,"15min":0.83199999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.317},"max":{"1min":0.61699999999999999,"5min":0.70999999999999996,"15min":0.86699999999999999},"last":0.373}]},{"osd":4,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.69399999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.40500000000000003},"max":{"1min":0.89900000000000002,"5min":1.034,"15min":1.0720000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70799999999999996,"15min":0.68999999999999995},"min":{"1min":0.55000000000000004,"5min":0.46600000000000003,"15min":0.42699999999999999},"max":{"1min":0.92600000000000005,"5min":1.022,"15min":1.0549999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.51400000000000001,"5min":0.47899999999999998,"15min":0.378},"max":{"1min":0.89000000000000001,"5min":0.96699999999999997,"15min":1.0449999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70399999999999996,"15min":0.68000000000000005},"min":{"1min":0.498,"5min":0.45400000000000001,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.028},"last":0.70299999999999996}]},{"osd":6,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69899999999999995,"15min":0.67700000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.441},"max":{"1min":0.85399999999999998,"5min":0.95399999999999996,"15min":1.171},"last":0.627},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.443},"max":{"1min":0.86599999999999999,"5min":1.01,"15min":1.135},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73299999999999998,"15min":0.72199999999999998},"min":{"1min":0.59899999999999998,"5min":0.47399999999999998,"15min":0.40699999999999997},"max":{"1min":0.94099999999999995,"5min":1.0549999999999999,"15min":1.083},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.75700000000000001,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95199999999999996,"5min":1.089,"15min":1.107},"last":0.65100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575946,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315876,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055964,"statfs":{"total":96636764160,"available":96313307136,"internally_reserved":0,"allocated":2453504,"data_stored":1309597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27000000000000002,"5min":0.25900000000000001,"15min":0.253},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.63700000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.433,"15min":0.437},"min":{"1min":0.29099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.67100000000000004,"15min":0.72899999999999998},"last":0.38500000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53700000000000003,"5min":0.628,"15min":0.69099999999999995},"last":0.255},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.45600000000000002},"min":{"1min":0.35899999999999999,"5min":0.32500000000000001,"15min":0.28100000000000003},"max":{"1min":0.61599999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.35199999999999998}]},{"osd":3,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47999999999999998,"15min":0.48199999999999998},"min":{"1min":0.39100000000000001,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.70099999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.31900000000000001},"max":{"1min":0.62,"5min":0.753,"15min":0.81399999999999995},"last":0.39800000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.501,"5min":0.46300000000000002,"15min":0.41099999999999998},"max":{"1min":0.88900000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66600000000000004,"15min":0.67600000000000005},"min":{"1min":0.46300000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97199999999999998,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.47299999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.52300000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67400000000000004,"15min":0.67700000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90000000000000002,"5min":1.056,"15min":1.056},"last":0.48199999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.47799999999999998},"max":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.113},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.55800000000000005,"5min":0.48999999999999999,"15min":0.46400000000000002},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.46700000000000003}]},{"osd":7,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.54100000000000004,"5min":0.502,"15min":0.46500000000000002},"max":{"1min":0.995,"5min":1.012,"15min":1.0680000000000001},"last":0.504},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.72499999999999998},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.48699999999999999},"max":{"1min":0.93500000000000005,"5min":1.089,"15min":1.1499999999999999},"last":0.53800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575947,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311788,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060052,"statfs":{"total":96636764160,"available":96317493248,"internally_reserved":0,"allocated":2461696,"data_stored":1310193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41099999999999998,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.54800000000000004,"5min":0.624,"15min":0.67500000000000004},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63200000000000001,"5min":0.64400000000000002,"15min":0.65800000000000003},"last":0.28899999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":0.67100000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.34300000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48199999999999998,"15min":0.47799999999999998},"min":{"1min":0.35499999999999998,"5min":0.31,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.72299999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.32200000000000001}]},{"osd":4,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.52900000000000003,"5min":0.41999999999999998,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.91700000000000004,"15min":1.0149999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.45200000000000001},"max":{"1min":0.98499999999999999,"5min":1.04,"15min":1.04},"last":0.72599999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69399999999999995,"15min":0.68600000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96199999999999997,"5min":1.0569999999999999,"15min":1.1100000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.67800000000000005},"min":{"1min":0.47799999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93500000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66400000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.40999999999999998},"max":{"1min":0.93400000000000005,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.622},{"interface":"front","average":{"1min":0.746,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.52200000000000002,"15min":0.46400000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0720000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.54900000000000004,"5min":0.53000000000000003,"15min":0.47899999999999998},"max":{"1min":0.94399999999999995,"5min":0.97999999999999998,"15min":1.071},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575945,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303596,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068244,"statfs":{"total":96636764160,"available":96325881856,"internally_reserved":0,"allocated":2461696,"data_stored":1309709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.44500000000000001,"5min":0.40799999999999997,"15min":0.28299999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.81000000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":0.75700000000000001,"5min":0.79000000000000004,"15min":0.97199999999999998},"last":0.495}]},{"osd":1,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.42399999999999999,"5min":0.41099999999999998,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":0.78100000000000003,"15min":0.89900000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.33600000000000002},"max":{"1min":0.78200000000000003,"5min":0.83299999999999996,"15min":0.88700000000000001},"last":0.56899999999999995}]},{"osd":2,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.86399999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.38200000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.85599999999999998},"last":0.65800000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38300000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.80800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.48799999999999999,"5min":0.48399999999999999,"15min":0.36599999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.83099999999999996},"last":0.621}]},{"osd":5,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.28100000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.76200000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51300000000000001,"15min":0.51100000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.79100000000000004},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34999999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.69599999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.39600000000000002,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.81799999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.79300000000000004,"15min":0.84599999999999997},"last":0.72199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575945,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307692,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064148,"statfs":{"total":96636764160,"available":96321687552,"internally_reserved":0,"allocated":2461696,"data_stored":1310205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73899999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.441},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.86899999999999999},"last":0.66900000000000004}]},{"osd":1,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.33300000000000002},"max":{"1min":0.76700000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.52600000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.372},"max":{"1min":0.71999999999999997,"5min":0.876,"15min":0.90000000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59699999999999998,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34499999999999997},"max":{"1min":0.75600000000000001,"5min":0.78100000000000003,"15min":0.83299999999999996},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":0.78700000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.34399999999999997},"max":{"1min":0.78600000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46100000000000002,"15min":0.47199999999999998},"min":{"1min":0.311,"5min":0.308,"15min":0.27900000000000003},"max":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.751},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.32600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.73399999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.313,"5min":0.312,"15min":0.312},"max":{"1min":0.753,"5min":0.753,"15min":0.75600000000000001},"last":0.74299999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.502,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.67400000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.75700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:53:42.399 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:53:42.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.547+0000 7f49ed6cf700 1 Processor -- start 2023-11-15T02:53:42.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.547+0000 7f49ed6cf700 1 -- start start 2023-11-15T02:53:42.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.548+0000 7f49ed6cf700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f49e80bdfb0 0x7f49e80be390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.548+0000 7f49ed6cf700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49e80c6d10 0x7f49e80bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.548+0000 7f49ed6cf700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e80ad5e0 con 0x7f49e80bd8f0 2023-11-15T02:53:42.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.548+0000 7f49ed6cf700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e80bccd0 con 0x7f49e80bdfb0 2023-11-15T02:53:42.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.548+0000 7f49ed6cf700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80ad8c0 con 0x7f49e80c6d10 2023-11-15T02:53:42.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.548+0000 7f49e6ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f49e80bdfb0 0x7f49e80be390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.548+0000 7f49e6ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f49e80bdfb0 0x7f49e80be390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59600/0 (socket says 172.21.15.1:59600) 2023-11-15T02:53:42.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.548+0000 7f49e6ffd700 1 -- 172.21.15.1:0/2370469546 learned_addr learned my addr 172.21.15.1:0/2370469546 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:42.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49e67fc700 1 --2- 172.21.15.1:0/2370469546 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49e80c6d10 0x7f49e80bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49e6ffd700 1 -- 172.21.15.1:0/2370469546 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49e80c6d10 msgr2=0x7f49e80bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:42.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49e6ffd700 1 --2- 172.21.15.1:0/2370469546 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49e80c6d10 0x7f49e80bd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49e6ffd700 1 -- 172.21.15.1:0/2370469546 >> v1:172.21.15.141:6789/0 conn(0x7f49e80bd8f0 legacy=0x7f49e8154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:42.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49e6ffd700 1 -- 172.21.15.1:0/2370469546 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e80adba0 con 0x7f49e80bdfb0 2023-11-15T02:53:42.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49e6ffd700 1 --2- 172.21.15.1:0/2370469546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49e80bdfb0 0x7f49e80be390 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7f49e0006fd0 tx=0x7f49e000b3b0).ready entity=mon.0 client_cookie=5722e9890d99fc94 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:42.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49e5ffb700 1 -- 172.21.15.1:0/2370469546 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e000db00 con 0x7f49e80bdfb0 2023-11-15T02:53:42.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49e5ffb700 1 -- 172.21.15.1:0/2370469546 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e000dc60 con 0x7f49e80bdfb0 2023-11-15T02:53:42.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49e5ffb700 1 -- 172.21.15.1:0/2370469546 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0010470 con 0x7f49e80bdfb0 2023-11-15T02:53:42.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49ed6cf700 1 -- 172.21.15.1:0/2370469546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49e80bdfb0 msgr2=0x7f49e80be390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49ed6cf700 1 --2- 172.21.15.1:0/2370469546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49e80bdfb0 0x7f49e80be390 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7f49e0006fd0 tx=0x7f49e000b3b0).stop 2023-11-15T02:53:42.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49ed6cf700 1 -- 172.21.15.1:0/2370469546 shutdown_connections 2023-11-15T02:53:42.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49ed6cf700 1 --2- 172.21.15.1:0/2370469546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49e80bdfb0 0x7f49e80be390 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49ed6cf700 1 --2- 172.21.15.1:0/2370469546 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49e80c6d10 0x7f49e80bd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49ed6cf700 1 -- 172.21.15.1:0/2370469546 >> 172.21.15.1:0/2370469546 conn(0x7f49e80c7d70 msgr2=0x7f49e80c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:42.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.549+0000 7f49ed6cf700 1 -- 172.21.15.1:0/2370469546 shutdown_connections 2023-11-15T02:53:42.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.550+0000 7f49ed6cf700 1 -- 172.21.15.1:0/2370469546 wait complete. 2023-11-15T02:53:42.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.551+0000 7f49ed6cf700 1 Processor -- start 2023-11-15T02:53:42.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.551+0000 7f49ed6cf700 1 -- start start 2023-11-15T02:53:42.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49ed6cf700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49e80bd8f0 0x7f49e814dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49ed6cf700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49e80bdfb0 0x7f49e8161870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49ed6cf700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49e80c6d10 0x7f49e813f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49ed6cf700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e814e170 con 0x7f49e80bd8f0 2023-11-15T02:53:42.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49ed6cf700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8161d60 con 0x7f49e80c6d10 2023-11-15T02:53:42.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49ed6cf700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e814ef70 con 0x7f49e80bdfb0 2023-11-15T02:53:42.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49e6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49e80bd8f0 0x7f49e814dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49e6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49e80bd8f0 0x7f49e814dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59604/0 (socket says 172.21.15.1:59604) 2023-11-15T02:53:42.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49e6ffd700 1 -- 172.21.15.1:0/1127884626 learned_addr learned my addr 172.21.15.1:0/1127884626 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:42.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49e67fc700 1 --2- 172.21.15.1:0/1127884626 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49e80bdfb0 0x7f49e8161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49e77fe700 1 --2- 172.21.15.1:0/1127884626 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49e80c6d10 0x7f49e813f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49e6ffd700 1 -- 172.21.15.1:0/1127884626 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49e80bdfb0 msgr2=0x7f49e8161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49e6ffd700 1 --2- 172.21.15.1:0/1127884626 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49e80bdfb0 0x7f49e8161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49e6ffd700 1 -- 172.21.15.1:0/1127884626 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49e80c6d10 msgr2=0x7f49e813f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49e6ffd700 1 --2- 172.21.15.1:0/1127884626 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49e80c6d10 0x7f49e813f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49e6ffd700 1 -- 172.21.15.1:0/1127884626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e000b610 con 0x7f49e80bd8f0 2023-11-15T02:53:42.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49e6ffd700 1 --2- 172.21.15.1:0/1127884626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49e80bd8f0 0x7f49e814dc80 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7f49e0006ba0 tx=0x7f49e000b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:42.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49deffd700 1 -- 172.21.15.1:0/1127884626 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0020070 con 0x7f49e80bd8f0 2023-11-15T02:53:42.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49deffd700 1 -- 172.21.15.1:0/1127884626 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e0019660 con 0x7f49e80bd8f0 2023-11-15T02:53:42.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49ed6cf700 1 -- 172.21.15.1:0/1127884626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e814e360 con 0x7f49e80bd8f0 2023-11-15T02:53:42.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49deffd700 1 -- 172.21.15.1:0/1127884626 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0019a20 con 0x7f49e80bd8f0 2023-11-15T02:53:42.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.552+0000 7f49ed6cf700 1 -- 172.21.15.1:0/1127884626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e814e920 con 0x7f49e80bd8f0 2023-11-15T02:53:42.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.553+0000 7f49ed6cf700 1 -- 172.21.15.1:0/1127884626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e806c7e0 con 0x7f49e80bd8f0 2023-11-15T02:53:42.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.554+0000 7f49deffd700 1 -- 172.21.15.1:0/1127884626 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f49e000f3d0 con 0x7f49e80bd8f0 2023-11-15T02:53:42.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.554+0000 7f49deffd700 1 --2- 172.21.15.1:0/1127884626 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f49c805f270 0x7f49c8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.554+0000 7f49deffd700 1 -- 172.21.15.1:0/1127884626 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f49e007de60 con 0x7f49e80bd8f0 2023-11-15T02:53:42.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.554+0000 7f49e67fc700 1 --2- 172.21.15.1:0/1127884626 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f49c805f270 0x7f49c8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.555+0000 7f49e67fc700 1 --2- 172.21.15.1:0/1127884626 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f49c805f270 0x7f49c8061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f49e814b980 tx=0x7f49d0008040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:42.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.558+0000 7f49deffd700 1 -- 172.21.15.1:0/1127884626 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f49e004ed40 con 0x7f49e80bd8f0 2023-11-15T02:53:42.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.725+0000 7f49ed6cf700 1 -- 172.21.15.1:0/1127884626 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f49e806a530 con 0x7f49c805f270 2023-11-15T02:53:42.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.735+0000 7f49deffd700 1 -- 172.21.15.1:0/1127884626 <== mgr.8590 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362304 (secure 0 0 0) 0x7f49e806a530 con 0x7f49c805f270 2023-11-15T02:53:42.742 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:42.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.738+0000 7f49ed6cf700 1 -- 172.21.15.1:0/1127884626 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f49c805f270 msgr2=0x7f49c8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.738+0000 7f49ed6cf700 1 --2- 172.21.15.1:0/1127884626 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f49c805f270 0x7f49c8061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f49e814b980 tx=0x7f49d0008040).stop 2023-11-15T02:53:42.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.738+0000 7f49ed6cf700 1 -- 172.21.15.1:0/1127884626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49e80bd8f0 msgr2=0x7f49e814dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.738+0000 7f49ed6cf700 1 --2- 172.21.15.1:0/1127884626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49e80bd8f0 0x7f49e814dc80 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7f49e0006ba0 tx=0x7f49e000b3b0).stop 2023-11-15T02:53:42.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.739+0000 7f49ed6cf700 1 -- 172.21.15.1:0/1127884626 shutdown_connections 2023-11-15T02:53:42.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.739+0000 7f49ed6cf700 1 --2- 172.21.15.1:0/1127884626 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f49c805f270 0x7f49c8061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.739+0000 7f49ed6cf700 1 --2- 172.21.15.1:0/1127884626 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49e80c6d10 0x7f49e813f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.739+0000 7f49ed6cf700 1 --2- 172.21.15.1:0/1127884626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49e80bd8f0 0x7f49e814dc80 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.739+0000 7f49ed6cf700 1 --2- 172.21.15.1:0/1127884626 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49e80bdfb0 0x7f49e8161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.739+0000 7f49ed6cf700 1 -- 172.21.15.1:0/1127884626 >> 172.21.15.1:0/1127884626 conn(0x7f49e80c7d70 msgr2=0x7f49e814fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:42.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.739+0000 7f49ed6cf700 1 -- 172.21.15.1:0/1127884626 shutdown_connections 2023-11-15T02:53:42.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.739+0000 7f49ed6cf700 1 -- 172.21.15.1:0/1127884626 wait complete. 2023-11-15T02:53:42.748 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:53:42.752 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T02:53:42.551565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":221,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2469672,"kb_used_data":19176,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752505048,"statfs":{"total":773094113280,"available":770565169152,"internally_reserved":0,"allocated":19636224,"data_stored":10466372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-593515,"num_objects":-21,"num_object_clones":0,"num_object_copies":-42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-21,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-205,"num_write_kb":-719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.007705"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.004115+0000","last_change":"2023-11-15T02:53:37.995183+0000","last_active":"2023-11-15T02:53:38.004115+0000","last_peered":"2023-11-15T02:53:38.004115+0000","last_clean":"2023-11-15T02:53:38.004115+0000","last_became_active":"2023-11-15T02:53:37.994643+0000","last_became_peered":"2023-11-15T02:53:37.994643+0000","last_unstale":"2023-11-15T02:53:38.004115+0000","last_undegraded":"2023-11-15T02:53:38.004115+0000","last_fullsized":"2023-11-15T02:53:38.004115+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"195'3","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011940+0000","last_change":"2023-11-15T02:53:37.606094+0000","last_active":"2023-11-15T02:53:38.011940+0000","last_peered":"2023-11-15T02:53:38.011940+0000","last_clean":"2023-11-15T02:53:38.011940+0000","last_became_active":"2023-11-15T02:53:37.605797+0000","last_became_peered":"2023-11-15T02:53:37.605797+0000","last_unstale":"2023-11-15T02:53:38.011940+0000","last_undegraded":"2023-11-15T02:53:38.011940+0000","last_fullsized":"2023-11-15T02:53:38.011940+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011234+0000","last_change":"2023-11-15T02:53:38.006818+0000","last_active":"2023-11-15T02:53:38.011234+0000","last_peered":"2023-11-15T02:53:38.011234+0000","last_clean":"2023-11-15T02:53:38.011234+0000","last_became_active":"2023-11-15T02:53:38.006545+0000","last_became_peered":"2023-11-15T02:53:38.006545+0000","last_unstale":"2023-11-15T02:53:38.011234+0000","last_undegraded":"2023-11-15T02:53:38.011234+0000","last_fullsized":"2023-11-15T02:53:38.011234+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.995290+0000","last_change":"2023-11-15T02:53:37.600571+0000","last_active":"2023-11-15T02:53:37.995290+0000","last_peered":"2023-11-15T02:53:37.995290+0000","last_clean":"2023-11-15T02:53:37.995290+0000","last_became_active":"2023-11-15T02:53:37.600299+0000","last_became_peered":"2023-11-15T02:53:37.600299+0000","last_unstale":"2023-11-15T02:53:37.995290+0000","last_undegraded":"2023-11-15T02:53:37.995290+0000","last_fullsized":"2023-11-15T02:53:37.995290+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998658+0000","last_change":"2023-11-15T02:53:37.991499+0000","last_active":"2023-11-15T02:53:37.998658+0000","last_peered":"2023-11-15T02:53:37.998658+0000","last_clean":"2023-11-15T02:53:37.998658+0000","last_became_active":"2023-11-15T02:53:37.991219+0000","last_became_peered":"2023-11-15T02:53:37.991219+0000","last_unstale":"2023-11-15T02:53:37.998658+0000","last_undegraded":"2023-11-15T02:53:37.998658+0000","last_fullsized":"2023-11-15T02:53:37.998658+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999215+0000","last_change":"2023-11-15T02:53:37.598351+0000","last_active":"2023-11-15T02:53:37.999215+0000","last_peered":"2023-11-15T02:53:37.999215+0000","last_clean":"2023-11-15T02:53:37.999215+0000","last_became_active":"2023-11-15T02:53:37.598074+0000","last_became_peered":"2023-11-15T02:53:37.598074+0000","last_unstale":"2023-11-15T02:53:37.999215+0000","last_undegraded":"2023-11-15T02:53:37.999215+0000","last_fullsized":"2023-11-15T02:53:37.999215+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009794+0000","last_change":"2023-11-15T02:53:38.005640+0000","last_active":"2023-11-15T02:53:38.009794+0000","last_peered":"2023-11-15T02:53:38.009794+0000","last_clean":"2023-11-15T02:53:38.009794+0000","last_became_active":"2023-11-15T02:53:38.005427+0000","last_became_peered":"2023-11-15T02:53:38.005427+0000","last_unstale":"2023-11-15T02:53:38.009794+0000","last_undegraded":"2023-11-15T02:53:38.009794+0000","last_fullsized":"2023-11-15T02:53:38.009794+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003329+0000","last_change":"2023-11-15T02:53:37.605508+0000","last_active":"2023-11-15T02:53:38.003329+0000","last_peered":"2023-11-15T02:53:38.003329+0000","last_clean":"2023-11-15T02:53:38.003329+0000","last_became_active":"2023-11-15T02:53:37.605050+0000","last_became_peered":"2023-11-15T02:53:37.605050+0000","last_unstale":"2023-11-15T02:53:38.003329+0000","last_undegraded":"2023-11-15T02:53:38.003329+0000","last_fullsized":"2023-11-15T02:53:38.003329+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.007889+0000","last_change":"2023-11-15T02:53:38.003090+0000","last_active":"2023-11-15T02:53:38.007889+0000","last_peered":"2023-11-15T02:53:38.007889+0000","last_clean":"2023-11-15T02:53:38.007889+0000","last_became_active":"2023-11-15T02:53:38.002775+0000","last_became_peered":"2023-11-15T02:53:38.002775+0000","last_unstale":"2023-11-15T02:53:38.007889+0000","last_undegraded":"2023-11-15T02:53:38.007889+0000","last_fullsized":"2023-11-15T02:53:38.007889+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002517+0000","last_change":"2023-11-15T02:53:37.596100+0000","last_active":"2023-11-15T02:53:38.002517+0000","last_peered":"2023-11-15T02:53:38.002517+0000","last_clean":"2023-11-15T02:53:38.002517+0000","last_became_active":"2023-11-15T02:53:37.595738+0000","last_became_peered":"2023-11-15T02:53:37.595738+0000","last_unstale":"2023-11-15T02:53:38.002517+0000","last_undegraded":"2023-11-15T02:53:38.002517+0000","last_fullsized":"2023-11-15T02:53:38.002517+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.013228+0000","last_change":"2023-11-15T02:53:38.010179+0000","last_active":"2023-11-15T02:53:38.013228+0000","last_peered":"2023-11-15T02:53:38.013228+0000","last_clean":"2023-11-15T02:53:38.013228+0000","last_became_active":"2023-11-15T02:53:38.009853+0000","last_became_peered":"2023-11-15T02:53:38.009853+0000","last_unstale":"2023-11-15T02:53:38.013228+0000","last_undegraded":"2023-11-15T02:53:38.013228+0000","last_fullsized":"2023-11-15T02:53:38.013228+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998494+0000","last_change":"2023-11-15T02:53:37.610005+0000","last_active":"2023-11-15T02:53:37.998494+0000","last_peered":"2023-11-15T02:53:37.998494+0000","last_clean":"2023-11-15T02:53:37.998494+0000","last_became_active":"2023-11-15T02:53:37.609699+0000","last_became_peered":"2023-11-15T02:53:37.609699+0000","last_unstale":"2023-11-15T02:53:37.998494+0000","last_undegraded":"2023-11-15T02:53:37.998494+0000","last_fullsized":"2023-11-15T02:53:37.998494+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006567+0000","last_change":"2023-11-15T02:53:38.001561+0000","last_active":"2023-11-15T02:53:38.006567+0000","last_peered":"2023-11-15T02:53:38.006567+0000","last_clean":"2023-11-15T02:53:38.006567+0000","last_became_active":"2023-11-15T02:53:38.001242+0000","last_became_peered":"2023-11-15T02:53:38.001242+0000","last_unstale":"2023-11-15T02:53:38.006567+0000","last_undegraded":"2023-11-15T02:53:38.006567+0000","last_fullsized":"2023-11-15T02:53:38.006567+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.981858+0000","last_change":"2023-11-15T02:53:37.606473+0000","last_active":"2023-11-15T02:53:37.981858+0000","last_peered":"2023-11-15T02:53:37.981858+0000","last_clean":"2023-11-15T02:53:37.981858+0000","last_became_active":"2023-11-15T02:53:37.606137+0000","last_became_peered":"2023-11-15T02:53:37.606137+0000","last_unstale":"2023-11-15T02:53:37.981858+0000","last_undegraded":"2023-11-15T02:53:37.981858+0000","last_fullsized":"2023-11-15T02:53:37.981858+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002949+0000","last_change":"2023-11-15T02:53:37.999287+0000","last_active":"2023-11-15T02:53:38.002949+0000","last_peered":"2023-11-15T02:53:38.002949+0000","last_clean":"2023-11-15T02:53:38.002949+0000","last_became_active":"2023-11-15T02:53:37.998970+0000","last_became_peered":"2023-11-15T02:53:37.998970+0000","last_unstale":"2023-11-15T02:53:38.002949+0000","last_undegraded":"2023-11-15T02:53:38.002949+0000","last_fullsized":"2023-11-15T02:53:38.002949+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989720+0000","last_change":"2023-11-15T02:53:37.596882+0000","last_active":"2023-11-15T02:53:37.989720+0000","last_peered":"2023-11-15T02:53:37.989720+0000","last_clean":"2023-11-15T02:53:37.989720+0000","last_became_active":"2023-11-15T02:53:37.596607+0000","last_became_peered":"2023-11-15T02:53:37.596607+0000","last_unstale":"2023-11-15T02:53:37.989720+0000","last_undegraded":"2023-11-15T02:53:37.989720+0000","last_fullsized":"2023-11-15T02:53:37.989720+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008738+0000","last_change":"2023-11-15T02:53:38.007229+0000","last_active":"2023-11-15T02:53:38.008738+0000","last_peered":"2023-11-15T02:53:38.008738+0000","last_clean":"2023-11-15T02:53:38.008738+0000","last_became_active":"2023-11-15T02:53:38.006946+0000","last_became_peered":"2023-11-15T02:53:38.006946+0000","last_unstale":"2023-11-15T02:53:38.008738+0000","last_undegraded":"2023-11-15T02:53:38.008738+0000","last_fullsized":"2023-11-15T02:53:38.008738+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.994300+0000","last_change":"2023-11-15T02:53:37.597995+0000","last_active":"2023-11-15T02:53:37.994300+0000","last_peered":"2023-11-15T02:53:37.994300+0000","last_clean":"2023-11-15T02:53:37.994300+0000","last_became_active":"2023-11-15T02:53:37.597683+0000","last_became_peered":"2023-11-15T02:53:37.597683+0000","last_unstale":"2023-11-15T02:53:37.994300+0000","last_undegraded":"2023-11-15T02:53:37.994300+0000","last_fullsized":"2023-11-15T02:53:37.994300+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003079+0000","last_change":"2023-11-15T02:53:37.998235+0000","last_active":"2023-11-15T02:53:38.003079+0000","last_peered":"2023-11-15T02:53:38.003079+0000","last_clean":"2023-11-15T02:53:38.003079+0000","last_became_active":"2023-11-15T02:53:37.997964+0000","last_became_peered":"2023-11-15T02:53:37.997964+0000","last_unstale":"2023-11-15T02:53:38.003079+0000","last_undegraded":"2023-11-15T02:53:38.003079+0000","last_fullsized":"2023-11-15T02:53:38.003079+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.995410+0000","last_change":"2023-11-15T02:53:37.603411+0000","last_active":"2023-11-15T02:53:37.995410+0000","last_peered":"2023-11-15T02:53:37.995410+0000","last_clean":"2023-11-15T02:53:37.995410+0000","last_became_active":"2023-11-15T02:53:37.603074+0000","last_became_peered":"2023-11-15T02:53:37.603074+0000","last_unstale":"2023-11-15T02:53:37.995410+0000","last_undegraded":"2023-11-15T02:53:37.995410+0000","last_fullsized":"2023-11-15T02:53:37.995410+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.007921+0000","last_change":"2023-11-15T02:53:38.003127+0000","last_active":"2023-11-15T02:53:38.007921+0000","last_peered":"2023-11-15T02:53:38.007921+0000","last_clean":"2023-11-15T02:53:38.007921+0000","last_became_active":"2023-11-15T02:53:38.002839+0000","last_became_peered":"2023-11-15T02:53:38.002839+0000","last_unstale":"2023-11-15T02:53:38.007921+0000","last_undegraded":"2023-11-15T02:53:38.007921+0000","last_fullsized":"2023-11-15T02:53:38.007921+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992555+0000","last_change":"2023-11-15T02:53:37.597628+0000","last_active":"2023-11-15T02:53:37.992555+0000","last_peered":"2023-11-15T02:53:37.992555+0000","last_clean":"2023-11-15T02:53:37.992555+0000","last_became_active":"2023-11-15T02:53:37.597332+0000","last_became_peered":"2023-11-15T02:53:37.597332+0000","last_unstale":"2023-11-15T02:53:37.992555+0000","last_undegraded":"2023-11-15T02:53:37.992555+0000","last_fullsized":"2023-11-15T02:53:37.992555+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009318+0000","last_change":"2023-11-15T02:53:38.001828+0000","last_active":"2023-11-15T02:53:38.009318+0000","last_peered":"2023-11-15T02:53:38.009318+0000","last_clean":"2023-11-15T02:53:38.009318+0000","last_became_active":"2023-11-15T02:53:37.997960+0000","last_became_peered":"2023-11-15T02:53:37.997960+0000","last_unstale":"2023-11-15T02:53:38.009318+0000","last_undegraded":"2023-11-15T02:53:38.009318+0000","last_fullsized":"2023-11-15T02:53:38.009318+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"195'4","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011033+0000","last_change":"2023-11-15T02:53:37.601586+0000","last_active":"2023-11-15T02:53:38.011033+0000","last_peered":"2023-11-15T02:53:38.011033+0000","last_clean":"2023-11-15T02:53:38.011033+0000","last_became_active":"2023-11-15T02:53:37.601290+0000","last_became_peered":"2023-11-15T02:53:37.601290+0000","last_unstale":"2023-11-15T02:53:38.011033+0000","last_undegraded":"2023-11-15T02:53:38.011033+0000","last_fullsized":"2023-11-15T02:53:38.011033+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001253+0000","last_change":"2023-11-15T02:53:37.996705+0000","last_active":"2023-11-15T02:53:38.001253+0000","last_peered":"2023-11-15T02:53:38.001253+0000","last_clean":"2023-11-15T02:53:38.001253+0000","last_became_active":"2023-11-15T02:53:37.995805+0000","last_became_peered":"2023-11-15T02:53:37.995805+0000","last_unstale":"2023-11-15T02:53:38.001253+0000","last_undegraded":"2023-11-15T02:53:38.001253+0000","last_fullsized":"2023-11-15T02:53:38.001253+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010242+0000","last_change":"2023-11-15T02:53:37.604059+0000","last_active":"2023-11-15T02:53:38.010242+0000","last_peered":"2023-11-15T02:53:38.010242+0000","last_clean":"2023-11-15T02:53:38.010242+0000","last_became_active":"2023-11-15T02:53:37.603596+0000","last_became_peered":"2023-11-15T02:53:37.603596+0000","last_unstale":"2023-11-15T02:53:38.010242+0000","last_undegraded":"2023-11-15T02:53:38.010242+0000","last_fullsized":"2023-11-15T02:53:38.010242+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001234+0000","last_change":"2023-11-15T02:53:37.997221+0000","last_active":"2023-11-15T02:53:38.001234+0000","last_peered":"2023-11-15T02:53:38.001234+0000","last_clean":"2023-11-15T02:53:38.001234+0000","last_became_active":"2023-11-15T02:53:37.996900+0000","last_became_peered":"2023-11-15T02:53:37.996900+0000","last_unstale":"2023-11-15T02:53:38.001234+0000","last_undegraded":"2023-11-15T02:53:38.001234+0000","last_fullsized":"2023-11-15T02:53:38.001234+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989867+0000","last_change":"2023-11-15T02:53:37.605082+0000","last_active":"2023-11-15T02:53:37.989867+0000","last_peered":"2023-11-15T02:53:37.989867+0000","last_clean":"2023-11-15T02:53:37.989867+0000","last_became_active":"2023-11-15T02:53:37.604780+0000","last_became_peered":"2023-11-15T02:53:37.604780+0000","last_unstale":"2023-11-15T02:53:37.989867+0000","last_undegraded":"2023-11-15T02:53:37.989867+0000","last_fullsized":"2023-11-15T02:53:37.989867+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.013267+0000","last_change":"2023-11-15T02:53:38.012265+0000","last_active":"2023-11-15T02:53:38.013267+0000","last_peered":"2023-11-15T02:53:38.013267+0000","last_clean":"2023-11-15T02:53:38.013267+0000","last_became_active":"2023-11-15T02:53:38.011882+0000","last_became_peered":"2023-11-15T02:53:38.011882+0000","last_unstale":"2023-11-15T02:53:38.013267+0000","last_undegraded":"2023-11-15T02:53:38.013267+0000","last_fullsized":"2023-11-15T02:53:38.013267+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.991858+0000","last_change":"2023-11-15T02:53:37.604365+0000","last_active":"2023-11-15T02:53:37.991858+0000","last_peered":"2023-11-15T02:53:37.991858+0000","last_clean":"2023-11-15T02:53:37.991858+0000","last_became_active":"2023-11-15T02:53:37.604087+0000","last_became_peered":"2023-11-15T02:53:37.604087+0000","last_unstale":"2023-11-15T02:53:37.991858+0000","last_undegraded":"2023-11-15T02:53:37.991858+0000","last_fullsized":"2023-11-15T02:53:37.991858+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008119+0000","last_change":"2023-11-15T02:53:38.003008+0000","last_active":"2023-11-15T02:53:38.008119+0000","last_peered":"2023-11-15T02:53:38.008119+0000","last_clean":"2023-11-15T02:53:38.008119+0000","last_became_active":"2023-11-15T02:53:38.002701+0000","last_became_peered":"2023-11-15T02:53:38.002701+0000","last_unstale":"2023-11-15T02:53:38.008119+0000","last_undegraded":"2023-11-15T02:53:38.008119+0000","last_fullsized":"2023-11-15T02:53:38.008119+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"195'4","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.000336+0000","last_change":"2023-11-15T02:53:37.608083+0000","last_active":"2023-11-15T02:53:38.000336+0000","last_peered":"2023-11-15T02:53:38.000336+0000","last_clean":"2023-11-15T02:53:38.000336+0000","last_became_active":"2023-11-15T02:53:37.607564+0000","last_became_peered":"2023-11-15T02:53:37.607564+0000","last_unstale":"2023-11-15T02:53:38.000336+0000","last_undegraded":"2023-11-15T02:53:38.000336+0000","last_fullsized":"2023-11-15T02:53:38.000336+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002097+0000","last_change":"2023-11-15T02:53:38.000908+0000","last_active":"2023-11-15T02:53:38.002097+0000","last_peered":"2023-11-15T02:53:38.002097+0000","last_clean":"2023-11-15T02:53:38.002097+0000","last_became_active":"2023-11-15T02:53:38.000211+0000","last_became_peered":"2023-11-15T02:53:38.000211+0000","last_unstale":"2023-11-15T02:53:38.002097+0000","last_undegraded":"2023-11-15T02:53:38.002097+0000","last_fullsized":"2023-11-15T02:53:38.002097+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987749+0000","last_change":"2023-11-15T02:53:37.601064+0000","last_active":"2023-11-15T02:53:37.987749+0000","last_peered":"2023-11-15T02:53:37.987749+0000","last_clean":"2023-11-15T02:53:37.987749+0000","last_became_active":"2023-11-15T02:53:37.600760+0000","last_became_peered":"2023-11-15T02:53:37.600760+0000","last_unstale":"2023-11-15T02:53:37.987749+0000","last_undegraded":"2023-11-15T02:53:37.987749+0000","last_fullsized":"2023-11-15T02:53:37.987749+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.016084+0000","last_change":"2023-11-15T02:53:38.012049+0000","last_active":"2023-11-15T02:53:38.016084+0000","last_peered":"2023-11-15T02:53:38.016084+0000","last_clean":"2023-11-15T02:53:38.016084+0000","last_became_active":"2023-11-15T02:53:38.011349+0000","last_became_peered":"2023-11-15T02:53:38.011349+0000","last_unstale":"2023-11-15T02:53:38.016084+0000","last_undegraded":"2023-11-15T02:53:38.016084+0000","last_fullsized":"2023-11-15T02:53:38.016084+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984955+0000","last_change":"2023-11-15T02:53:37.603600+0000","last_active":"2023-11-15T02:53:37.984955+0000","last_peered":"2023-11-15T02:53:37.984955+0000","last_clean":"2023-11-15T02:53:37.984955+0000","last_became_active":"2023-11-15T02:53:37.603284+0000","last_became_peered":"2023-11-15T02:53:37.603284+0000","last_unstale":"2023-11-15T02:53:37.984955+0000","last_undegraded":"2023-11-15T02:53:37.984955+0000","last_fullsized":"2023-11-15T02:53:37.984955+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002020+0000","last_change":"2023-11-15T02:53:38.000564+0000","last_active":"2023-11-15T02:53:38.002020+0000","last_peered":"2023-11-15T02:53:38.002020+0000","last_clean":"2023-11-15T02:53:38.002020+0000","last_became_active":"2023-11-15T02:53:38.000288+0000","last_became_peered":"2023-11-15T02:53:38.000288+0000","last_unstale":"2023-11-15T02:53:38.002020+0000","last_undegraded":"2023-11-15T02:53:38.002020+0000","last_fullsized":"2023-11-15T02:53:38.002020+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002993+0000","last_change":"2023-11-15T02:53:37.600693+0000","last_active":"2023-11-15T02:53:38.002993+0000","last_peered":"2023-11-15T02:53:38.002993+0000","last_clean":"2023-11-15T02:53:38.002993+0000","last_became_active":"2023-11-15T02:53:37.600356+0000","last_became_peered":"2023-11-15T02:53:37.600356+0000","last_unstale":"2023-11-15T02:53:38.002993+0000","last_undegraded":"2023-11-15T02:53:38.002993+0000","last_fullsized":"2023-11-15T02:53:38.002993+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.007925+0000","last_change":"2023-11-15T02:53:38.004010+0000","last_active":"2023-11-15T02:53:38.007925+0000","last_peered":"2023-11-15T02:53:38.007925+0000","last_clean":"2023-11-15T02:53:38.007925+0000","last_became_active":"2023-11-15T02:53:38.003715+0000","last_became_peered":"2023-11-15T02:53:38.003715+0000","last_unstale":"2023-11-15T02:53:38.007925+0000","last_undegraded":"2023-11-15T02:53:38.007925+0000","last_fullsized":"2023-11-15T02:53:38.007925+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989453+0000","last_change":"2023-11-15T02:53:37.602439+0000","last_active":"2023-11-15T02:53:37.989453+0000","last_peered":"2023-11-15T02:53:37.989453+0000","last_clean":"2023-11-15T02:53:37.989453+0000","last_became_active":"2023-11-15T02:53:37.602154+0000","last_became_peered":"2023-11-15T02:53:37.602154+0000","last_unstale":"2023-11-15T02:53:37.989453+0000","last_undegraded":"2023-11-15T02:53:37.989453+0000","last_fullsized":"2023-11-15T02:53:37.989453+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009800+0000","last_change":"2023-11-15T02:53:38.006153+0000","last_active":"2023-11-15T02:53:38.009800+0000","last_peered":"2023-11-15T02:53:38.009800+0000","last_clean":"2023-11-15T02:53:38.009800+0000","last_became_active":"2023-11-15T02:53:38.005382+0000","last_became_peered":"2023-11-15T02:53:38.005382+0000","last_unstale":"2023-11-15T02:53:38.009800+0000","last_undegraded":"2023-11-15T02:53:38.009800+0000","last_fullsized":"2023-11-15T02:53:38.009800+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002479+0000","last_change":"2023-11-15T02:53:37.600307+0000","last_active":"2023-11-15T02:53:38.002479+0000","last_peered":"2023-11-15T02:53:38.002479+0000","last_clean":"2023-11-15T02:53:38.002479+0000","last_became_active":"2023-11-15T02:53:37.599973+0000","last_became_peered":"2023-11-15T02:53:37.599973+0000","last_unstale":"2023-11-15T02:53:38.002479+0000","last_undegraded":"2023-11-15T02:53:38.002479+0000","last_fullsized":"2023-11-15T02:53:38.002479+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006387+0000","last_change":"2023-11-15T02:53:38.000564+0000","last_active":"2023-11-15T02:53:38.006387+0000","last_peered":"2023-11-15T02:53:38.006387+0000","last_clean":"2023-11-15T02:53:38.006387+0000","last_became_active":"2023-11-15T02:53:38.000275+0000","last_became_peered":"2023-11-15T02:53:38.000275+0000","last_unstale":"2023-11-15T02:53:38.006387+0000","last_undegraded":"2023-11-15T02:53:38.006387+0000","last_fullsized":"2023-11-15T02:53:38.006387+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.993463+0000","last_change":"2023-11-15T02:53:37.607356+0000","last_active":"2023-11-15T02:53:37.993463+0000","last_peered":"2023-11-15T02:53:37.993463+0000","last_clean":"2023-11-15T02:53:37.993463+0000","last_became_active":"2023-11-15T02:53:37.607085+0000","last_became_peered":"2023-11-15T02:53:37.607085+0000","last_unstale":"2023-11-15T02:53:37.993463+0000","last_undegraded":"2023-11-15T02:53:37.993463+0000","last_fullsized":"2023-11-15T02:53:37.993463+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006231+0000","last_change":"2023-11-15T02:53:38.003771+0000","last_active":"2023-11-15T02:53:38.006231+0000","last_peered":"2023-11-15T02:53:38.006231+0000","last_clean":"2023-11-15T02:53:38.006231+0000","last_became_active":"2023-11-15T02:53:38.003121+0000","last_became_peered":"2023-11-15T02:53:38.003121+0000","last_unstale":"2023-11-15T02:53:38.006231+0000","last_undegraded":"2023-11-15T02:53:38.006231+0000","last_fullsized":"2023-11-15T02:53:38.006231+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987451+0000","last_change":"2023-11-15T02:53:37.596686+0000","last_active":"2023-11-15T02:53:37.987451+0000","last_peered":"2023-11-15T02:53:37.987451+0000","last_clean":"2023-11-15T02:53:37.987451+0000","last_became_active":"2023-11-15T02:53:37.596410+0000","last_became_peered":"2023-11-15T02:53:37.596410+0000","last_unstale":"2023-11-15T02:53:37.987451+0000","last_undegraded":"2023-11-15T02:53:37.987451+0000","last_fullsized":"2023-11-15T02:53:37.987451+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011367+0000","last_change":"2023-11-15T02:53:38.010715+0000","last_active":"2023-11-15T02:53:38.011367+0000","last_peered":"2023-11-15T02:53:38.011367+0000","last_clean":"2023-11-15T02:53:38.011367+0000","last_became_active":"2023-11-15T02:53:38.010419+0000","last_became_peered":"2023-11-15T02:53:38.010419+0000","last_unstale":"2023-11-15T02:53:38.011367+0000","last_undegraded":"2023-11-15T02:53:38.011367+0000","last_fullsized":"2023-11-15T02:53:38.011367+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989838+0000","last_change":"2023-11-15T02:53:37.600629+0000","last_active":"2023-11-15T02:53:37.989838+0000","last_peered":"2023-11-15T02:53:37.989838+0000","last_clean":"2023-11-15T02:53:37.989838+0000","last_became_active":"2023-11-15T02:53:37.600331+0000","last_became_peered":"2023-11-15T02:53:37.600331+0000","last_unstale":"2023-11-15T02:53:37.989838+0000","last_undegraded":"2023-11-15T02:53:37.989838+0000","last_fullsized":"2023-11-15T02:53:37.989838+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999239+0000","last_change":"2023-11-15T02:53:37.994959+0000","last_active":"2023-11-15T02:53:37.999239+0000","last_peered":"2023-11-15T02:53:37.999239+0000","last_clean":"2023-11-15T02:53:37.999239+0000","last_became_active":"2023-11-15T02:53:37.994284+0000","last_became_peered":"2023-11-15T02:53:37.994284+0000","last_unstale":"2023-11-15T02:53:37.999239+0000","last_undegraded":"2023-11-15T02:53:37.999239+0000","last_fullsized":"2023-11-15T02:53:37.999239+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.997791+0000","last_change":"2023-11-15T02:53:37.600152+0000","last_active":"2023-11-15T02:53:37.997791+0000","last_peered":"2023-11-15T02:53:37.997791+0000","last_clean":"2023-11-15T02:53:37.997791+0000","last_became_active":"2023-11-15T02:53:37.599885+0000","last_became_peered":"2023-11-15T02:53:37.599885+0000","last_unstale":"2023-11-15T02:53:37.997791+0000","last_undegraded":"2023-11-15T02:53:37.997791+0000","last_fullsized":"2023-11-15T02:53:37.997791+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009330+0000","last_change":"2023-11-15T02:53:38.003735+0000","last_active":"2023-11-15T02:53:38.009330+0000","last_peered":"2023-11-15T02:53:38.009330+0000","last_clean":"2023-11-15T02:53:38.009330+0000","last_became_active":"2023-11-15T02:53:38.003432+0000","last_became_peered":"2023-11-15T02:53:38.003432+0000","last_unstale":"2023-11-15T02:53:38.009330+0000","last_undegraded":"2023-11-15T02:53:38.009330+0000","last_fullsized":"2023-11-15T02:53:38.009330+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.982577+0000","last_change":"2023-11-15T02:53:37.608038+0000","last_active":"2023-11-15T02:53:37.982577+0000","last_peered":"2023-11-15T02:53:37.982577+0000","last_clean":"2023-11-15T02:53:37.982577+0000","last_became_active":"2023-11-15T02:53:37.607545+0000","last_became_peered":"2023-11-15T02:53:37.607545+0000","last_unstale":"2023-11-15T02:53:37.982577+0000","last_undegraded":"2023-11-15T02:53:37.982577+0000","last_fullsized":"2023-11-15T02:53:37.982577+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005747+0000","last_change":"2023-11-15T02:53:38.000626+0000","last_active":"2023-11-15T02:53:38.005747+0000","last_peered":"2023-11-15T02:53:38.005747+0000","last_clean":"2023-11-15T02:53:38.005747+0000","last_became_active":"2023-11-15T02:53:38.000346+0000","last_became_peered":"2023-11-15T02:53:38.000346+0000","last_unstale":"2023-11-15T02:53:38.005747+0000","last_undegraded":"2023-11-15T02:53:38.005747+0000","last_fullsized":"2023-11-15T02:53:38.005747+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999272+0000","last_change":"2023-11-15T02:53:37.602774+0000","last_active":"2023-11-15T02:53:37.999272+0000","last_peered":"2023-11-15T02:53:37.999272+0000","last_clean":"2023-11-15T02:53:37.999272+0000","last_became_active":"2023-11-15T02:53:37.602261+0000","last_became_peered":"2023-11-15T02:53:37.602261+0000","last_unstale":"2023-11-15T02:53:37.999272+0000","last_undegraded":"2023-11-15T02:53:37.999272+0000","last_fullsized":"2023-11-15T02:53:37.999272+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005731+0000","last_change":"2023-11-15T02:53:38.004561+0000","last_active":"2023-11-15T02:53:38.005731+0000","last_peered":"2023-11-15T02:53:38.005731+0000","last_clean":"2023-11-15T02:53:38.005731+0000","last_became_active":"2023-11-15T02:53:38.004279+0000","last_became_peered":"2023-11-15T02:53:38.004279+0000","last_unstale":"2023-11-15T02:53:38.005731+0000","last_undegraded":"2023-11-15T02:53:38.005731+0000","last_fullsized":"2023-11-15T02:53:38.005731+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998408+0000","last_change":"2023-11-15T02:53:37.606814+0000","last_active":"2023-11-15T02:53:37.998408+0000","last_peered":"2023-11-15T02:53:37.998408+0000","last_clean":"2023-11-15T02:53:37.998408+0000","last_became_active":"2023-11-15T02:53:37.606517+0000","last_became_peered":"2023-11-15T02:53:37.606517+0000","last_unstale":"2023-11-15T02:53:37.998408+0000","last_undegraded":"2023-11-15T02:53:37.998408+0000","last_fullsized":"2023-11-15T02:53:37.998408+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002264+0000","last_change":"2023-11-15T02:53:37.998598+0000","last_active":"2023-11-15T02:53:38.002264+0000","last_peered":"2023-11-15T02:53:38.002264+0000","last_clean":"2023-11-15T02:53:38.002264+0000","last_became_active":"2023-11-15T02:53:37.998240+0000","last_became_peered":"2023-11-15T02:53:37.998240+0000","last_unstale":"2023-11-15T02:53:38.002264+0000","last_undegraded":"2023-11-15T02:53:38.002264+0000","last_fullsized":"2023-11-15T02:53:38.002264+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989840+0000","last_change":"2023-11-15T02:53:37.603875+0000","last_active":"2023-11-15T02:53:37.989840+0000","last_peered":"2023-11-15T02:53:37.989840+0000","last_clean":"2023-11-15T02:53:37.989840+0000","last_became_active":"2023-11-15T02:53:37.603204+0000","last_became_peered":"2023-11-15T02:53:37.603204+0000","last_unstale":"2023-11-15T02:53:37.989840+0000","last_undegraded":"2023-11-15T02:53:37.989840+0000","last_fullsized":"2023-11-15T02:53:37.989840+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010801+0000","last_change":"2023-11-15T02:53:38.009250+0000","last_active":"2023-11-15T02:53:38.010801+0000","last_peered":"2023-11-15T02:53:38.010801+0000","last_clean":"2023-11-15T02:53:38.010801+0000","last_became_active":"2023-11-15T02:53:38.009018+0000","last_became_peered":"2023-11-15T02:53:38.009018+0000","last_unstale":"2023-11-15T02:53:38.010801+0000","last_undegraded":"2023-11-15T02:53:38.010801+0000","last_fullsized":"2023-11-15T02:53:38.010801+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.986167+0000","last_change":"2023-11-15T02:53:37.604578+0000","last_active":"2023-11-15T02:53:37.986167+0000","last_peered":"2023-11-15T02:53:37.986167+0000","last_clean":"2023-11-15T02:53:37.986167+0000","last_became_active":"2023-11-15T02:53:37.604300+0000","last_became_peered":"2023-11-15T02:53:37.604300+0000","last_unstale":"2023-11-15T02:53:37.986167+0000","last_undegraded":"2023-11-15T02:53:37.986167+0000","last_fullsized":"2023-11-15T02:53:37.986167+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010581+0000","last_change":"2023-11-15T02:53:38.005419+0000","last_active":"2023-11-15T02:53:38.010581+0000","last_peered":"2023-11-15T02:53:38.010581+0000","last_clean":"2023-11-15T02:53:38.010581+0000","last_became_active":"2023-11-15T02:53:38.005121+0000","last_became_peered":"2023-11-15T02:53:38.005121+0000","last_unstale":"2023-11-15T02:53:38.010581+0000","last_undegraded":"2023-11-15T02:53:38.010581+0000","last_fullsized":"2023-11-15T02:53:38.010581+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.986004+0000","last_change":"2023-11-15T02:53:37.608032+0000","last_active":"2023-11-15T02:53:37.986004+0000","last_peered":"2023-11-15T02:53:37.986004+0000","last_clean":"2023-11-15T02:53:37.986004+0000","last_became_active":"2023-11-15T02:53:37.607639+0000","last_became_peered":"2023-11-15T02:53:37.607639+0000","last_unstale":"2023-11-15T02:53:37.986004+0000","last_undegraded":"2023-11-15T02:53:37.986004+0000","last_fullsized":"2023-11-15T02:53:37.986004+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009389+0000","last_change":"2023-11-15T02:53:38.008531+0000","last_active":"2023-11-15T02:53:38.009389+0000","last_peered":"2023-11-15T02:53:38.009389+0000","last_clean":"2023-11-15T02:53:38.009389+0000","last_became_active":"2023-11-15T02:53:38.008308+0000","last_became_peered":"2023-11-15T02:53:38.008308+0000","last_unstale":"2023-11-15T02:53:38.009389+0000","last_undegraded":"2023-11-15T02:53:38.009389+0000","last_fullsized":"2023-11-15T02:53:38.009389+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984117+0000","last_change":"2023-11-15T02:53:37.603697+0000","last_active":"2023-11-15T02:53:37.984117+0000","last_peered":"2023-11-15T02:53:37.984117+0000","last_clean":"2023-11-15T02:53:37.984117+0000","last_became_active":"2023-11-15T02:53:37.603383+0000","last_became_peered":"2023-11-15T02:53:37.603383+0000","last_unstale":"2023-11-15T02:53:37.984117+0000","last_undegraded":"2023-11-15T02:53:37.984117+0000","last_fullsized":"2023-11-15T02:53:37.984117+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009909+0000","last_change":"2023-11-15T02:53:38.006412+0000","last_active":"2023-11-15T02:53:38.009909+0000","last_peered":"2023-11-15T02:53:38.009909+0000","last_clean":"2023-11-15T02:53:38.009909+0000","last_became_active":"2023-11-15T02:53:38.006097+0000","last_became_peered":"2023-11-15T02:53:38.006097+0000","last_unstale":"2023-11-15T02:53:38.009909+0000","last_undegraded":"2023-11-15T02:53:38.009909+0000","last_fullsized":"2023-11-15T02:53:38.009909+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999987+0000","last_change":"2023-11-15T02:53:37.605820+0000","last_active":"2023-11-15T02:53:37.999987+0000","last_peered":"2023-11-15T02:53:37.999987+0000","last_clean":"2023-11-15T02:53:37.999987+0000","last_became_active":"2023-11-15T02:53:37.605501+0000","last_became_peered":"2023-11-15T02:53:37.605501+0000","last_unstale":"2023-11-15T02:53:37.999987+0000","last_undegraded":"2023-11-15T02:53:37.999987+0000","last_fullsized":"2023-11-15T02:53:37.999987+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006092+0000","last_change":"2023-11-15T02:53:38.004891+0000","last_active":"2023-11-15T02:53:38.006092+0000","last_peered":"2023-11-15T02:53:38.006092+0000","last_clean":"2023-11-15T02:53:38.006092+0000","last_became_active":"2023-11-15T02:53:38.004627+0000","last_became_peered":"2023-11-15T02:53:38.004627+0000","last_unstale":"2023-11-15T02:53:38.006092+0000","last_undegraded":"2023-11-15T02:53:38.006092+0000","last_fullsized":"2023-11-15T02:53:38.006092+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003886+0000","last_change":"2023-11-15T02:53:37.607870+0000","last_active":"2023-11-15T02:53:38.003886+0000","last_peered":"2023-11-15T02:53:38.003886+0000","last_clean":"2023-11-15T02:53:38.003886+0000","last_became_active":"2023-11-15T02:53:37.607197+0000","last_became_peered":"2023-11-15T02:53:37.607197+0000","last_unstale":"2023-11-15T02:53:38.003886+0000","last_undegraded":"2023-11-15T02:53:38.003886+0000","last_fullsized":"2023-11-15T02:53:38.003886+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998637+0000","last_change":"2023-11-15T02:53:37.991469+0000","last_active":"2023-11-15T02:53:37.998637+0000","last_peered":"2023-11-15T02:53:37.998637+0000","last_clean":"2023-11-15T02:53:37.998637+0000","last_became_active":"2023-11-15T02:53:37.991176+0000","last_became_peered":"2023-11-15T02:53:37.991176+0000","last_unstale":"2023-11-15T02:53:37.998637+0000","last_undegraded":"2023-11-15T02:53:37.998637+0000","last_fullsized":"2023-11-15T02:53:37.998637+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009368+0000","last_change":"2023-11-15T02:53:37.602556+0000","last_active":"2023-11-15T02:53:38.009368+0000","last_peered":"2023-11-15T02:53:38.009368+0000","last_clean":"2023-11-15T02:53:38.009368+0000","last_became_active":"2023-11-15T02:53:37.601820+0000","last_became_peered":"2023-11-15T02:53:37.601820+0000","last_unstale":"2023-11-15T02:53:38.009368+0000","last_undegraded":"2023-11-15T02:53:38.009368+0000","last_fullsized":"2023-11-15T02:53:38.009368+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010539+0000","last_change":"2023-11-15T02:53:38.005868+0000","last_active":"2023-11-15T02:53:38.010539+0000","last_peered":"2023-11-15T02:53:38.010539+0000","last_clean":"2023-11-15T02:53:38.010539+0000","last_became_active":"2023-11-15T02:53:38.005558+0000","last_became_peered":"2023-11-15T02:53:38.005558+0000","last_unstale":"2023-11-15T02:53:38.010539+0000","last_undegraded":"2023-11-15T02:53:38.010539+0000","last_fullsized":"2023-11-15T02:53:38.010539+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987451+0000","last_change":"2023-11-15T02:53:37.601130+0000","last_active":"2023-11-15T02:53:37.987451+0000","last_peered":"2023-11-15T02:53:37.987451+0000","last_clean":"2023-11-15T02:53:37.987451+0000","last_became_active":"2023-11-15T02:53:37.600820+0000","last_became_peered":"2023-11-15T02:53:37.600820+0000","last_unstale":"2023-11-15T02:53:37.987451+0000","last_undegraded":"2023-11-15T02:53:37.987451+0000","last_fullsized":"2023-11-15T02:53:37.987451+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003379+0000","last_change":"2023-11-15T02:53:38.001102+0000","last_active":"2023-11-15T02:53:38.003379+0000","last_peered":"2023-11-15T02:53:38.003379+0000","last_clean":"2023-11-15T02:53:38.003379+0000","last_became_active":"2023-11-15T02:53:38.000814+0000","last_became_peered":"2023-11-15T02:53:38.000814+0000","last_unstale":"2023-11-15T02:53:38.003379+0000","last_undegraded":"2023-11-15T02:53:38.003379+0000","last_fullsized":"2023-11-15T02:53:38.003379+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998161+0000","last_change":"2023-11-15T02:53:37.609358+0000","last_active":"2023-11-15T02:53:37.998161+0000","last_peered":"2023-11-15T02:53:37.998161+0000","last_clean":"2023-11-15T02:53:37.998161+0000","last_became_active":"2023-11-15T02:53:37.608596+0000","last_became_peered":"2023-11-15T02:53:37.608596+0000","last_unstale":"2023-11-15T02:53:37.998161+0000","last_undegraded":"2023-11-15T02:53:37.998161+0000","last_fullsized":"2023-11-15T02:53:37.998161+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.995398+0000","last_change":"2023-11-15T02:53:37.993686+0000","last_active":"2023-11-15T02:53:37.995398+0000","last_peered":"2023-11-15T02:53:37.995398+0000","last_clean":"2023-11-15T02:53:37.995398+0000","last_became_active":"2023-11-15T02:53:37.993388+0000","last_became_peered":"2023-11-15T02:53:37.993388+0000","last_unstale":"2023-11-15T02:53:37.995398+0000","last_undegraded":"2023-11-15T02:53:37.995398+0000","last_fullsized":"2023-11-15T02:53:37.995398+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.982323+0000","last_change":"2023-11-15T02:53:37.607029+0000","last_active":"2023-11-15T02:53:37.982323+0000","last_peered":"2023-11-15T02:53:37.982323+0000","last_clean":"2023-11-15T02:53:37.982323+0000","last_became_active":"2023-11-15T02:53:37.606692+0000","last_became_peered":"2023-11-15T02:53:37.606692+0000","last_unstale":"2023-11-15T02:53:37.982323+0000","last_undegraded":"2023-11-15T02:53:37.982323+0000","last_fullsized":"2023-11-15T02:53:37.982323+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006246+0000","last_change":"2023-11-15T02:53:38.003944+0000","last_active":"2023-11-15T02:53:38.006246+0000","last_peered":"2023-11-15T02:53:38.006246+0000","last_clean":"2023-11-15T02:53:38.006246+0000","last_became_active":"2023-11-15T02:53:38.003507+0000","last_became_peered":"2023-11-15T02:53:38.003507+0000","last_unstale":"2023-11-15T02:53:38.006246+0000","last_undegraded":"2023-11-15T02:53:38.006246+0000","last_fullsized":"2023-11-15T02:53:38.006246+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987342+0000","last_change":"2023-11-15T02:53:37.609959+0000","last_active":"2023-11-15T02:53:37.987342+0000","last_peered":"2023-11-15T02:53:37.987342+0000","last_clean":"2023-11-15T02:53:37.987342+0000","last_became_active":"2023-11-15T02:53:37.609646+0000","last_became_peered":"2023-11-15T02:53:37.609646+0000","last_unstale":"2023-11-15T02:53:37.987342+0000","last_undegraded":"2023-11-15T02:53:37.987342+0000","last_fullsized":"2023-11-15T02:53:37.987342+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008553+0000","last_change":"2023-11-15T02:53:38.007038+0000","last_active":"2023-11-15T02:53:38.008553+0000","last_peered":"2023-11-15T02:53:38.008553+0000","last_clean":"2023-11-15T02:53:38.008553+0000","last_became_active":"2023-11-15T02:53:38.006729+0000","last_became_peered":"2023-11-15T02:53:38.006729+0000","last_unstale":"2023-11-15T02:53:38.008553+0000","last_undegraded":"2023-11-15T02:53:38.008553+0000","last_fullsized":"2023-11-15T02:53:38.008553+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.996205+0000","last_change":"2023-11-15T02:53:37.606243+0000","last_active":"2023-11-15T02:53:37.996205+0000","last_peered":"2023-11-15T02:53:37.996205+0000","last_clean":"2023-11-15T02:53:37.996205+0000","last_became_active":"2023-11-15T02:53:37.605925+0000","last_became_peered":"2023-11-15T02:53:37.605925+0000","last_unstale":"2023-11-15T02:53:37.996205+0000","last_undegraded":"2023-11-15T02:53:37.996205+0000","last_fullsized":"2023-11-15T02:53:37.996205+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005006+0000","last_change":"2023-11-15T02:53:38.002861+0000","last_active":"2023-11-15T02:53:38.005006+0000","last_peered":"2023-11-15T02:53:38.005006+0000","last_clean":"2023-11-15T02:53:38.005006+0000","last_became_active":"2023-11-15T02:53:38.002540+0000","last_became_peered":"2023-11-15T02:53:38.002540+0000","last_unstale":"2023-11-15T02:53:38.005006+0000","last_undegraded":"2023-11-15T02:53:38.005006+0000","last_fullsized":"2023-11-15T02:53:38.005006+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.004585+0000","last_change":"2023-11-15T02:53:37.607128+0000","last_active":"2023-11-15T02:53:38.004585+0000","last_peered":"2023-11-15T02:53:38.004585+0000","last_clean":"2023-11-15T02:53:38.004585+0000","last_became_active":"2023-11-15T02:53:37.606792+0000","last_became_peered":"2023-11-15T02:53:37.606792+0000","last_unstale":"2023-11-15T02:53:38.004585+0000","last_undegraded":"2023-11-15T02:53:38.004585+0000","last_fullsized":"2023-11-15T02:53:38.004585+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.016079+0000","last_change":"2023-11-15T02:53:38.012509+0000","last_active":"2023-11-15T02:53:38.016079+0000","last_peered":"2023-11-15T02:53:38.016079+0000","last_clean":"2023-11-15T02:53:38.016079+0000","last_became_active":"2023-11-15T02:53:38.011598+0000","last_became_peered":"2023-11-15T02:53:38.011598+0000","last_unstale":"2023-11-15T02:53:38.016079+0000","last_undegraded":"2023-11-15T02:53:38.016079+0000","last_fullsized":"2023-11-15T02:53:38.016079+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006720+0000","last_change":"2023-11-15T02:53:37.605340+0000","last_active":"2023-11-15T02:53:38.006720+0000","last_peered":"2023-11-15T02:53:38.006720+0000","last_clean":"2023-11-15T02:53:38.006720+0000","last_became_active":"2023-11-15T02:53:37.604736+0000","last_became_peered":"2023-11-15T02:53:37.604736+0000","last_unstale":"2023-11-15T02:53:38.006720+0000","last_undegraded":"2023-11-15T02:53:38.006720+0000","last_fullsized":"2023-11-15T02:53:38.006720+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009363+0000","last_change":"2023-11-15T02:53:38.004869+0000","last_active":"2023-11-15T02:53:38.009363+0000","last_peered":"2023-11-15T02:53:38.009363+0000","last_clean":"2023-11-15T02:53:38.009363+0000","last_became_active":"2023-11-15T02:53:38.004603+0000","last_became_peered":"2023-11-15T02:53:38.004603+0000","last_unstale":"2023-11-15T02:53:38.009363+0000","last_undegraded":"2023-11-15T02:53:38.009363+0000","last_fullsized":"2023-11-15T02:53:38.009363+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.982661+0000","last_change":"2023-11-15T02:53:37.599911+0000","last_active":"2023-11-15T02:53:37.982661+0000","last_peered":"2023-11-15T02:53:37.982661+0000","last_clean":"2023-11-15T02:53:37.982661+0000","last_became_active":"2023-11-15T02:53:37.599611+0000","last_became_peered":"2023-11-15T02:53:37.599611+0000","last_unstale":"2023-11-15T02:53:37.982661+0000","last_undegraded":"2023-11-15T02:53:37.982661+0000","last_fullsized":"2023-11-15T02:53:37.982661+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011156+0000","last_change":"2023-11-15T02:53:38.006173+0000","last_active":"2023-11-15T02:53:38.011156+0000","last_peered":"2023-11-15T02:53:38.011156+0000","last_clean":"2023-11-15T02:53:38.011156+0000","last_became_active":"2023-11-15T02:53:38.005873+0000","last_became_peered":"2023-11-15T02:53:38.005873+0000","last_unstale":"2023-11-15T02:53:38.011156+0000","last_undegraded":"2023-11-15T02:53:38.011156+0000","last_fullsized":"2023-11-15T02:53:38.011156+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998518+0000","last_change":"2023-11-15T02:53:37.609046+0000","last_active":"2023-11-15T02:53:37.998518+0000","last_peered":"2023-11-15T02:53:37.998518+0000","last_clean":"2023-11-15T02:53:37.998518+0000","last_became_active":"2023-11-15T02:53:37.608665+0000","last_became_peered":"2023-11-15T02:53:37.608665+0000","last_unstale":"2023-11-15T02:53:37.998518+0000","last_undegraded":"2023-11-15T02:53:37.998518+0000","last_fullsized":"2023-11-15T02:53:37.998518+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009819+0000","last_change":"2023-11-15T02:53:38.006320+0000","last_active":"2023-11-15T02:53:38.009819+0000","last_peered":"2023-11-15T02:53:38.009819+0000","last_clean":"2023-11-15T02:53:38.009819+0000","last_became_active":"2023-11-15T02:53:38.005786+0000","last_became_peered":"2023-11-15T02:53:38.005786+0000","last_unstale":"2023-11-15T02:53:38.009819+0000","last_undegraded":"2023-11-15T02:53:38.009819+0000","last_fullsized":"2023-11-15T02:53:38.009819+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001944+0000","last_change":"2023-11-15T02:53:37.599390+0000","last_active":"2023-11-15T02:53:38.001944+0000","last_peered":"2023-11-15T02:53:38.001944+0000","last_clean":"2023-11-15T02:53:38.001944+0000","last_became_active":"2023-11-15T02:53:37.598476+0000","last_became_peered":"2023-11-15T02:53:37.598476+0000","last_unstale":"2023-11-15T02:53:38.001944+0000","last_undegraded":"2023-11-15T02:53:38.001944+0000","last_fullsized":"2023-11-15T02:53:38.001944+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009422+0000","last_change":"2023-11-15T02:53:38.005651+0000","last_active":"2023-11-15T02:53:38.009422+0000","last_peered":"2023-11-15T02:53:38.009422+0000","last_clean":"2023-11-15T02:53:38.009422+0000","last_became_active":"2023-11-15T02:53:38.005405+0000","last_became_peered":"2023-11-15T02:53:38.005405+0000","last_unstale":"2023-11-15T02:53:38.009422+0000","last_undegraded":"2023-11-15T02:53:38.009422+0000","last_fullsized":"2023-11-15T02:53:38.009422+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.996886+0000","last_change":"2023-11-15T02:53:37.603759+0000","last_active":"2023-11-15T02:53:37.996886+0000","last_peered":"2023-11-15T02:53:37.996886+0000","last_clean":"2023-11-15T02:53:37.996886+0000","last_became_active":"2023-11-15T02:53:37.603485+0000","last_became_peered":"2023-11-15T02:53:37.603485+0000","last_unstale":"2023-11-15T02:53:37.996886+0000","last_undegraded":"2023-11-15T02:53:37.996886+0000","last_fullsized":"2023-11-15T02:53:37.996886+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999205+0000","last_change":"2023-11-15T02:53:37.998244+0000","last_active":"2023-11-15T02:53:37.999205+0000","last_peered":"2023-11-15T02:53:37.999205+0000","last_clean":"2023-11-15T02:53:37.999205+0000","last_became_active":"2023-11-15T02:53:37.997925+0000","last_became_peered":"2023-11-15T02:53:37.997925+0000","last_unstale":"2023-11-15T02:53:37.999205+0000","last_undegraded":"2023-11-15T02:53:37.999205+0000","last_fullsized":"2023-11-15T02:53:37.999205+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987621+0000","last_change":"2023-11-15T02:53:37.595509+0000","last_active":"2023-11-15T02:53:37.987621+0000","last_peered":"2023-11-15T02:53:37.987621+0000","last_clean":"2023-11-15T02:53:37.987621+0000","last_became_active":"2023-11-15T02:53:37.595150+0000","last_became_peered":"2023-11-15T02:53:37.595150+0000","last_unstale":"2023-11-15T02:53:37.987621+0000","last_undegraded":"2023-11-15T02:53:37.987621+0000","last_fullsized":"2023-11-15T02:53:37.987621+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006014+0000","last_change":"2023-11-15T02:53:37.998617+0000","last_active":"2023-11-15T02:53:38.006014+0000","last_peered":"2023-11-15T02:53:38.006014+0000","last_clean":"2023-11-15T02:53:38.006014+0000","last_became_active":"2023-11-15T02:53:37.998336+0000","last_became_peered":"2023-11-15T02:53:37.998336+0000","last_unstale":"2023-11-15T02:53:38.006014+0000","last_undegraded":"2023-11-15T02:53:38.006014+0000","last_fullsized":"2023-11-15T02:53:38.006014+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992794+0000","last_change":"2023-11-15T02:53:37.605177+0000","last_active":"2023-11-15T02:53:37.992794+0000","last_peered":"2023-11-15T02:53:37.992794+0000","last_clean":"2023-11-15T02:53:37.992794+0000","last_became_active":"2023-11-15T02:53:37.604785+0000","last_became_peered":"2023-11-15T02:53:37.604785+0000","last_unstale":"2023-11-15T02:53:37.992794+0000","last_undegraded":"2023-11-15T02:53:37.992794+0000","last_fullsized":"2023-11-15T02:53:37.992794+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009156+0000","last_change":"2023-11-15T02:53:38.005499+0000","last_active":"2023-11-15T02:53:38.009156+0000","last_peered":"2023-11-15T02:53:38.009156+0000","last_clean":"2023-11-15T02:53:38.009156+0000","last_became_active":"2023-11-15T02:53:38.005211+0000","last_became_peered":"2023-11-15T02:53:38.005211+0000","last_unstale":"2023-11-15T02:53:38.009156+0000","last_undegraded":"2023-11-15T02:53:38.009156+0000","last_fullsized":"2023-11-15T02:53:38.009156+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005286+0000","last_change":"2023-11-15T02:53:37.593975+0000","last_active":"2023-11-15T02:53:38.005286+0000","last_peered":"2023-11-15T02:53:38.005286+0000","last_clean":"2023-11-15T02:53:38.005286+0000","last_became_active":"2023-11-15T02:53:37.593701+0000","last_became_peered":"2023-11-15T02:53:37.593701+0000","last_unstale":"2023-11-15T02:53:38.005286+0000","last_undegraded":"2023-11-15T02:53:38.005286+0000","last_fullsized":"2023-11-15T02:53:38.005286+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003057+0000","last_change":"2023-11-15T02:53:37.998034+0000","last_active":"2023-11-15T02:53:38.003057+0000","last_peered":"2023-11-15T02:53:38.003057+0000","last_clean":"2023-11-15T02:53:38.003057+0000","last_became_active":"2023-11-15T02:53:37.997729+0000","last_became_peered":"2023-11-15T02:53:37.997729+0000","last_unstale":"2023-11-15T02:53:38.003057+0000","last_undegraded":"2023-11-15T02:53:38.003057+0000","last_fullsized":"2023-11-15T02:53:38.003057+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.985057+0000","last_change":"2023-11-15T02:53:37.610489+0000","last_active":"2023-11-15T02:53:37.985057+0000","last_peered":"2023-11-15T02:53:37.985057+0000","last_clean":"2023-11-15T02:53:37.985057+0000","last_became_active":"2023-11-15T02:53:37.610002+0000","last_became_peered":"2023-11-15T02:53:37.610002+0000","last_unstale":"2023-11-15T02:53:37.985057+0000","last_undegraded":"2023-11-15T02:53:37.985057+0000","last_fullsized":"2023-11-15T02:53:37.985057+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002358+0000","last_change":"2023-11-15T02:53:38.000481+0000","last_active":"2023-11-15T02:53:38.002358+0000","last_peered":"2023-11-15T02:53:38.002358+0000","last_clean":"2023-11-15T02:53:38.002358+0000","last_became_active":"2023-11-15T02:53:38.000196+0000","last_became_peered":"2023-11-15T02:53:38.000196+0000","last_unstale":"2023-11-15T02:53:38.002358+0000","last_undegraded":"2023-11-15T02:53:38.002358+0000","last_fullsized":"2023-11-15T02:53:38.002358+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984215+0000","last_change":"2023-11-15T02:53:37.601783+0000","last_active":"2023-11-15T02:53:37.984215+0000","last_peered":"2023-11-15T02:53:37.984215+0000","last_clean":"2023-11-15T02:53:37.984215+0000","last_became_active":"2023-11-15T02:53:37.601473+0000","last_became_peered":"2023-11-15T02:53:37.601473+0000","last_unstale":"2023-11-15T02:53:37.984215+0000","last_undegraded":"2023-11-15T02:53:37.984215+0000","last_fullsized":"2023-11-15T02:53:37.984215+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002345+0000","last_change":"2023-11-15T02:53:37.997031+0000","last_active":"2023-11-15T02:53:38.002345+0000","last_peered":"2023-11-15T02:53:38.002345+0000","last_clean":"2023-11-15T02:53:38.002345+0000","last_became_active":"2023-11-15T02:53:37.996771+0000","last_became_peered":"2023-11-15T02:53:37.996771+0000","last_unstale":"2023-11-15T02:53:38.002345+0000","last_undegraded":"2023-11-15T02:53:38.002345+0000","last_fullsized":"2023-11-15T02:53:38.002345+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987557+0000","last_change":"2023-11-15T02:53:37.603411+0000","last_active":"2023-11-15T02:53:37.987557+0000","last_peered":"2023-11-15T02:53:37.987557+0000","last_clean":"2023-11-15T02:53:37.987557+0000","last_became_active":"2023-11-15T02:53:37.603095+0000","last_became_peered":"2023-11-15T02:53:37.603095+0000","last_unstale":"2023-11-15T02:53:37.987557+0000","last_undegraded":"2023-11-15T02:53:37.987557+0000","last_fullsized":"2023-11-15T02:53:37.987557+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.000207+0000","last_change":"2023-11-15T02:53:37.992925+0000","last_active":"2023-11-15T02:53:38.000207+0000","last_peered":"2023-11-15T02:53:38.000207+0000","last_clean":"2023-11-15T02:53:38.000207+0000","last_became_active":"2023-11-15T02:53:37.991495+0000","last_became_peered":"2023-11-15T02:53:37.991495+0000","last_unstale":"2023-11-15T02:53:38.000207+0000","last_undegraded":"2023-11-15T02:53:38.000207+0000","last_fullsized":"2023-11-15T02:53:38.000207+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.986519+0000","last_change":"2023-11-15T02:53:37.602735+0000","last_active":"2023-11-15T02:53:37.986519+0000","last_peered":"2023-11-15T02:53:37.986519+0000","last_clean":"2023-11-15T02:53:37.986519+0000","last_became_active":"2023-11-15T02:53:37.602437+0000","last_became_peered":"2023-11-15T02:53:37.602437+0000","last_unstale":"2023-11-15T02:53:37.986519+0000","last_undegraded":"2023-11-15T02:53:37.986519+0000","last_fullsized":"2023-11-15T02:53:37.986519+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010619+0000","last_change":"2023-11-15T02:53:38.006525+0000","last_active":"2023-11-15T02:53:38.010619+0000","last_peered":"2023-11-15T02:53:38.010619+0000","last_clean":"2023-11-15T02:53:38.010619+0000","last_became_active":"2023-11-15T02:53:38.006118+0000","last_became_peered":"2023-11-15T02:53:38.006118+0000","last_unstale":"2023-11-15T02:53:38.010619+0000","last_undegraded":"2023-11-15T02:53:38.010619+0000","last_fullsized":"2023-11-15T02:53:38.010619+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.985276+0000","last_change":"2023-11-15T02:53:37.604591+0000","last_active":"2023-11-15T02:53:37.985276+0000","last_peered":"2023-11-15T02:53:37.985276+0000","last_clean":"2023-11-15T02:53:37.985276+0000","last_became_active":"2023-11-15T02:53:37.604050+0000","last_became_peered":"2023-11-15T02:53:37.604050+0000","last_unstale":"2023-11-15T02:53:37.985276+0000","last_undegraded":"2023-11-15T02:53:37.985276+0000","last_fullsized":"2023-11-15T02:53:37.985276+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009789+0000","last_change":"2023-11-15T02:53:38.005163+0000","last_active":"2023-11-15T02:53:38.009789+0000","last_peered":"2023-11-15T02:53:38.009789+0000","last_clean":"2023-11-15T02:53:38.009789+0000","last_became_active":"2023-11-15T02:53:38.004858+0000","last_became_peered":"2023-11-15T02:53:38.004858+0000","last_unstale":"2023-11-15T02:53:38.009789+0000","last_undegraded":"2023-11-15T02:53:38.009789+0000","last_fullsized":"2023-11-15T02:53:38.009789+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001263+0000","last_change":"2023-11-15T02:53:37.603691+0000","last_active":"2023-11-15T02:53:38.001263+0000","last_peered":"2023-11-15T02:53:38.001263+0000","last_clean":"2023-11-15T02:53:38.001263+0000","last_became_active":"2023-11-15T02:53:37.603376+0000","last_became_peered":"2023-11-15T02:53:37.603376+0000","last_unstale":"2023-11-15T02:53:38.001263+0000","last_undegraded":"2023-11-15T02:53:38.001263+0000","last_fullsized":"2023-11-15T02:53:38.001263+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009156+0000","last_change":"2023-11-15T02:53:38.007691+0000","last_active":"2023-11-15T02:53:38.009156+0000","last_peered":"2023-11-15T02:53:38.009156+0000","last_clean":"2023-11-15T02:53:38.009156+0000","last_became_active":"2023-11-15T02:53:38.007438+0000","last_became_peered":"2023-11-15T02:53:38.007438+0000","last_unstale":"2023-11-15T02:53:38.009156+0000","last_undegraded":"2023-11-15T02:53:38.009156+0000","last_fullsized":"2023-11-15T02:53:38.009156+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.981762+0000","last_change":"2023-11-15T02:53:37.607898+0000","last_active":"2023-11-15T02:53:37.981762+0000","last_peered":"2023-11-15T02:53:37.981762+0000","last_clean":"2023-11-15T02:53:37.981762+0000","last_became_active":"2023-11-15T02:53:37.607133+0000","last_became_peered":"2023-11-15T02:53:37.607133+0000","last_unstale":"2023-11-15T02:53:37.981762+0000","last_undegraded":"2023-11-15T02:53:37.981762+0000","last_fullsized":"2023-11-15T02:53:37.981762+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010798+0000","last_change":"2023-11-15T02:53:38.009352+0000","last_active":"2023-11-15T02:53:38.010798+0000","last_peered":"2023-11-15T02:53:38.010798+0000","last_clean":"2023-11-15T02:53:38.010798+0000","last_became_active":"2023-11-15T02:53:38.007690+0000","last_became_peered":"2023-11-15T02:53:38.007690+0000","last_unstale":"2023-11-15T02:53:38.010798+0000","last_undegraded":"2023-11-15T02:53:38.010798+0000","last_fullsized":"2023-11-15T02:53:38.010798+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003527+0000","last_change":"2023-11-15T02:53:37.607389+0000","last_active":"2023-11-15T02:53:38.003527+0000","last_peered":"2023-11-15T02:53:38.003527+0000","last_clean":"2023-11-15T02:53:38.003527+0000","last_became_active":"2023-11-15T02:53:37.607111+0000","last_became_peered":"2023-11-15T02:53:37.607111+0000","last_unstale":"2023-11-15T02:53:38.003527+0000","last_undegraded":"2023-11-15T02:53:38.003527+0000","last_fullsized":"2023-11-15T02:53:38.003527+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998721+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:53:37.998721+0000","last_peered":"2023-11-15T02:53:37.998721+0000","last_clean":"2023-11-15T02:53:37.998721+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:53:37.998721+0000","last_undegraded":"2023-11-15T02:53:37.998721+0000","last_fullsized":"2023-11-15T02:53:37.998721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009887+0000","last_change":"2023-11-15T02:53:38.006186+0000","last_active":"2023-11-15T02:53:38.009887+0000","last_peered":"2023-11-15T02:53:38.009887+0000","last_clean":"2023-11-15T02:53:38.009887+0000","last_became_active":"2023-11-15T02:53:38.005653+0000","last_became_peered":"2023-11-15T02:53:38.005653+0000","last_unstale":"2023-11-15T02:53:38.009887+0000","last_undegraded":"2023-11-15T02:53:38.009887+0000","last_fullsized":"2023-11-15T02:53:38.009887+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984526+0000","last_change":"2023-11-15T02:53:37.610922+0000","last_active":"2023-11-15T02:53:37.984526+0000","last_peered":"2023-11-15T02:53:37.984526+0000","last_clean":"2023-11-15T02:53:37.984526+0000","last_became_active":"2023-11-15T02:53:37.610028+0000","last_became_peered":"2023-11-15T02:53:37.610028+0000","last_unstale":"2023-11-15T02:53:37.984526+0000","last_undegraded":"2023-11-15T02:53:37.984526+0000","last_fullsized":"2023-11-15T02:53:37.984526+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":162,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.997839+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:53:37.997839+0000","last_peered":"2023-11-15T02:53:37.997839+0000","last_clean":"2023-11-15T02:53:37.997839+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:53:37.997839+0000","last_undegraded":"2023-11-15T02:53:37.997839+0000","last_fullsized":"2023-11-15T02:53:37.997839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.996916+0000","last_change":"2023-11-15T02:53:37.995964+0000","last_active":"2023-11-15T02:53:37.996916+0000","last_peered":"2023-11-15T02:53:37.996916+0000","last_clean":"2023-11-15T02:53:37.996916+0000","last_became_active":"2023-11-15T02:53:37.995659+0000","last_became_peered":"2023-11-15T02:53:37.995659+0000","last_unstale":"2023-11-15T02:53:37.996916+0000","last_undegraded":"2023-11-15T02:53:37.996916+0000","last_fullsized":"2023-11-15T02:53:37.996916+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.004104+0000","last_change":"2023-11-15T02:53:37.610832+0000","last_active":"2023-11-15T02:53:38.004104+0000","last_peered":"2023-11-15T02:53:38.004104+0000","last_clean":"2023-11-15T02:53:38.004104+0000","last_became_active":"2023-11-15T02:53:37.610517+0000","last_became_peered":"2023-11-15T02:53:37.610517+0000","last_unstale":"2023-11-15T02:53:38.004104+0000","last_undegraded":"2023-11-15T02:53:38.004104+0000","last_fullsized":"2023-11-15T02:53:38.004104+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987235+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:53:37.987235+0000","last_peered":"2023-11-15T02:53:37.987235+0000","last_clean":"2023-11-15T02:53:37.987235+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:53:37.987235+0000","last_undegraded":"2023-11-15T02:53:37.987235+0000","last_fullsized":"2023-11-15T02:53:37.987235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008034+0000","last_change":"2023-11-15T02:53:38.004908+0000","last_active":"2023-11-15T02:53:38.008034+0000","last_peered":"2023-11-15T02:53:38.008034+0000","last_clean":"2023-11-15T02:53:38.008034+0000","last_became_active":"2023-11-15T02:53:38.004646+0000","last_became_peered":"2023-11-15T02:53:38.004646+0000","last_unstale":"2023-11-15T02:53:38.008034+0000","last_undegraded":"2023-11-15T02:53:38.008034+0000","last_fullsized":"2023-11-15T02:53:38.008034+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984950+0000","last_change":"2023-11-15T02:53:37.611678+0000","last_active":"2023-11-15T02:53:37.984950+0000","last_peered":"2023-11-15T02:53:37.984950+0000","last_clean":"2023-11-15T02:53:37.984950+0000","last_became_active":"2023-11-15T02:53:37.610384+0000","last_became_peered":"2023-11-15T02:53:37.610384+0000","last_unstale":"2023-11-15T02:53:37.984950+0000","last_undegraded":"2023-11-15T02:53:37.984950+0000","last_fullsized":"2023-11-15T02:53:37.984950+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":162,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989854+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:53:37.989854+0000","last_peered":"2023-11-15T02:53:37.989854+0000","last_clean":"2023-11-15T02:53:37.989854+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:53:37.989854+0000","last_undegraded":"2023-11-15T02:53:37.989854+0000","last_fullsized":"2023-11-15T02:53:37.989854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992682+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:53:37.992682+0000","last_peered":"2023-11-15T02:53:37.992682+0000","last_clean":"2023-11-15T02:53:37.992682+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:53:37.992682+0000","last_undegraded":"2023-11-15T02:53:37.992682+0000","last_fullsized":"2023-11-15T02:53:37.992682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.000622+0000","last_change":"2023-11-15T02:53:37.996966+0000","last_active":"2023-11-15T02:53:38.000622+0000","last_peered":"2023-11-15T02:53:38.000622+0000","last_clean":"2023-11-15T02:53:38.000622+0000","last_became_active":"2023-11-15T02:53:37.996716+0000","last_became_peered":"2023-11-15T02:53:37.996716+0000","last_unstale":"2023-11-15T02:53:38.000622+0000","last_undegraded":"2023-11-15T02:53:38.000622+0000","last_fullsized":"2023-11-15T02:53:38.000622+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"195'3","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010557+0000","last_change":"2023-11-15T02:53:37.602954+0000","last_active":"2023-11-15T02:53:38.010557+0000","last_peered":"2023-11-15T02:53:38.010557+0000","last_clean":"2023-11-15T02:53:38.010557+0000","last_became_active":"2023-11-15T02:53:37.602650+0000","last_became_peered":"2023-11-15T02:53:37.602650+0000","last_unstale":"2023-11-15T02:53:38.010557+0000","last_undegraded":"2023-11-15T02:53:38.010557+0000","last_fullsized":"2023-11-15T02:53:38.010557+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992790+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:53:37.992790+0000","last_peered":"2023-11-15T02:53:37.992790+0000","last_clean":"2023-11-15T02:53:37.992790+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:53:37.992790+0000","last_undegraded":"2023-11-15T02:53:37.992790+0000","last_fullsized":"2023-11-15T02:53:37.992790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006116+0000","last_change":"2023-11-15T02:53:38.004904+0000","last_active":"2023-11-15T02:53:38.006116+0000","last_peered":"2023-11-15T02:53:38.006116+0000","last_clean":"2023-11-15T02:53:38.006116+0000","last_became_active":"2023-11-15T02:53:38.002970+0000","last_became_peered":"2023-11-15T02:53:38.002970+0000","last_unstale":"2023-11-15T02:53:38.006116+0000","last_undegraded":"2023-11-15T02:53:38.006116+0000","last_fullsized":"2023-11-15T02:53:38.006116+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"195'4","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010616+0000","last_change":"2023-11-15T02:53:37.602372+0000","last_active":"2023-11-15T02:53:38.010616+0000","last_peered":"2023-11-15T02:53:38.010616+0000","last_clean":"2023-11-15T02:53:38.010616+0000","last_became_active":"2023-11-15T02:53:37.602042+0000","last_became_peered":"2023-11-15T02:53:37.602042+0000","last_unstale":"2023-11-15T02:53:38.010616+0000","last_undegraded":"2023-11-15T02:53:38.010616+0000","last_fullsized":"2023-11-15T02:53:38.010616+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.993798+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:53:37.993798+0000","last_peered":"2023-11-15T02:53:37.993798+0000","last_clean":"2023-11-15T02:53:37.993798+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:53:37.993798+0000","last_undegraded":"2023-11-15T02:53:37.993798+0000","last_fullsized":"2023-11-15T02:53:37.993798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009380+0000","last_change":"2023-11-15T02:53:38.002981+0000","last_active":"2023-11-15T02:53:38.009380+0000","last_peered":"2023-11-15T02:53:38.009380+0000","last_clean":"2023-11-15T02:53:38.009380+0000","last_became_active":"2023-11-15T02:53:38.002343+0000","last_became_peered":"2023-11-15T02:53:38.002343+0000","last_unstale":"2023-11-15T02:53:38.009380+0000","last_undegraded":"2023-11-15T02:53:38.009380+0000","last_fullsized":"2023-11-15T02:53:38.009380+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011456+0000","last_change":"2023-11-15T02:53:37.607737+0000","last_active":"2023-11-15T02:53:38.011456+0000","last_peered":"2023-11-15T02:53:38.011456+0000","last_clean":"2023-11-15T02:53:38.011456+0000","last_became_active":"2023-11-15T02:53:37.607051+0000","last_became_peered":"2023-11-15T02:53:37.607051+0000","last_unstale":"2023-11-15T02:53:38.011456+0000","last_undegraded":"2023-11-15T02:53:38.011456+0000","last_fullsized":"2023-11-15T02:53:38.011456+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001049+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:53:38.001049+0000","last_peered":"2023-11-15T02:53:38.001049+0000","last_clean":"2023-11-15T02:53:38.001049+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:53:38.001049+0000","last_undegraded":"2023-11-15T02:53:38.001049+0000","last_fullsized":"2023-11-15T02:53:38.001049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003060+0000","last_change":"2023-11-15T02:53:37.998675+0000","last_active":"2023-11-15T02:53:38.003060+0000","last_peered":"2023-11-15T02:53:38.003060+0000","last_clean":"2023-11-15T02:53:38.003060+0000","last_became_active":"2023-11-15T02:53:37.998261+0000","last_became_peered":"2023-11-15T02:53:37.998261+0000","last_unstale":"2023-11-15T02:53:38.003060+0000","last_undegraded":"2023-11-15T02:53:38.003060+0000","last_fullsized":"2023-11-15T02:53:38.003060+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.985238+0000","last_change":"2023-11-15T02:53:37.598178+0000","last_active":"2023-11-15T02:53:37.985238+0000","last_peered":"2023-11-15T02:53:37.985238+0000","last_clean":"2023-11-15T02:53:37.985238+0000","last_became_active":"2023-11-15T02:53:37.597661+0000","last_became_peered":"2023-11-15T02:53:37.597661+0000","last_unstale":"2023-11-15T02:53:37.985238+0000","last_undegraded":"2023-11-15T02:53:37.985238+0000","last_fullsized":"2023-11-15T02:53:37.985238+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":182,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.994361+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:53:37.994361+0000","last_peered":"2023-11-15T02:53:37.994361+0000","last_clean":"2023-11-15T02:53:37.994361+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:53:37.994361+0000","last_undegraded":"2023-11-15T02:53:37.994361+0000","last_fullsized":"2023-11-15T02:53:37.994361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575945,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303580,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068260,"statfs":{"total":96636764160,"available":96325898240,"internally_reserved":0,"allocated":2445312,"data_stored":1303745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.82599999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.57699999999999996},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72599999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.51400000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.42099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.67900000000000005,"5min":0.752,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.78000000000000003,"15min":0.80400000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.44800000000000001,"5min":0.441,"15min":0.40999999999999998},"max":{"1min":0.75700000000000001,"5min":0.79100000000000004,"15min":0.83799999999999997},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.754,"5min":0.81000000000000005,"15min":0.88500000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.62},"min":{"1min":0.47899999999999998,"5min":0.40699999999999997,"15min":0.377},"max":{"1min":0.81899999999999995,"5min":0.84799999999999998,"15min":0.86699999999999999},"last":0.58099999999999996}]},{"osd":4,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46100000000000002,"15min":0.47699999999999998},"min":{"1min":0.32800000000000001,"5min":0.29199999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.749},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.64700000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47899999999999998,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.79500000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.81999999999999995},"last":0.625}]},{"osd":6,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.37,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.84899999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.35299999999999998,"15min":0.28499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.68899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575946,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307684,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064156,"statfs":{"total":96636764160,"available":96321695744,"internally_reserved":0,"allocated":2453504,"data_stored":1310419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.24099999999999999},"max":{"1min":0.749,"5min":0.80000000000000004,"15min":0.92500000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.27700000000000002},"max":{"1min":0.71999999999999997,"5min":0.77300000000000002,"15min":0.873},"last":0.65500000000000003}]},{"osd":1,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75700000000000001,"5min":0.81399999999999995,"15min":0.81999999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.36199999999999999},"max":{"1min":0.69299999999999995,"5min":0.77200000000000002,"15min":0.88},"last":0.58299999999999996}]},{"osd":2,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.78400000000000003,"15min":0.84599999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.45300000000000001,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.72799999999999998,"5min":0.83399999999999996,"15min":0.88900000000000001},"last":0.71399999999999997}]},{"osd":3,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.42699999999999999,"5min":0.35299999999999998,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60799999999999998,"15min":0.60699999999999998},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.38},"max":{"1min":0.78000000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64700000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45900000000000002},"min":{"1min":0.29799999999999999,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.64100000000000001,"5min":0.72999999999999998,"15min":0.82199999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.39600000000000002,"5min":0.34799999999999998,"15min":0.30099999999999999},"max":{"1min":0.70899999999999996,"5min":0.79500000000000004,"15min":0.874},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.32400000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.82799999999999996},"last":0.442},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.32000000000000001},"max":{"1min":0.70999999999999996,"5min":0.77000000000000002,"15min":0.95099999999999996},"last":0.47799999999999998}]},{"osd":7,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.50900000000000001},"min":{"1min":0.33700000000000002,"5min":0.32600000000000001,"15min":0.30499999999999999},"max":{"1min":0.65200000000000002,"5min":0.74199999999999999,"15min":0.90100000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.434,"5min":0.42599999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.83799999999999997,"15min":0.875},"last":0.496}]}]},{"osd":1,"up_from":13,"seq":55834575947,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307688,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064152,"statfs":{"total":96636764160,"available":96321691648,"internally_reserved":0,"allocated":2457600,"data_stored":1310171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.39200000000000002},"min":{"1min":0.28599999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.432},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.436,"15min":0.41899999999999998},"min":{"1min":0.28799999999999998,"5min":0.255,"15min":0.255},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.312}]},{"osd":2,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42099999999999999,"15min":0.40799999999999997},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.47799999999999998,"15min":0.46300000000000002},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.40799999999999997}]},{"osd":3,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.441,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.375},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.41999999999999998,"5min":0.32500000000000001,"15min":0.315},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.441}]},{"osd":4,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.49199999999999999,"5min":0.436,"15min":0.372},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.53400000000000003,"5min":0.42399999999999999,"15min":0.41299999999999998},"max":{"1min":1.0289999999999999,"5min":1.081,"15min":1.081},"last":0.69899999999999995}]},{"osd":5,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67000000000000004,"15min":0.66000000000000003},"min":{"1min":0.52100000000000002,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68700000000000006,"15min":0.67400000000000004},"min":{"1min":0.54900000000000004,"5min":0.45600000000000002,"15min":0.42699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.70799999999999996}]},{"osd":6,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.52300000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.73599999999999999,"15min":0.72399999999999998},"min":{"1min":0.64500000000000002,"5min":0.53500000000000003,"15min":0.48999999999999999},"max":{"1min":0.98399999999999999,"5min":1,"15min":1},"last":0.75800000000000001}]},{"osd":7,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.67600000000000005,"5min":0.52600000000000002,"15min":0.46600000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.746,"15min":0.72999999999999998},"min":{"1min":0.627,"5min":0.52100000000000002,"15min":0.48399999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0009999999999999},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575945,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311768,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060072,"statfs":{"total":96636764160,"available":96317513728,"internally_reserved":0,"allocated":2441216,"data_stored":1302333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.40000000000000002,"15min":0.39900000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.63300000000000001,"15min":0.73499999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61299999999999999,"5min":0.68100000000000005,"15min":0.89400000000000002},"last":0.39000000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41699999999999998,"15min":0.40799999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.23599999999999999},"max":{"1min":0.626,"5min":0.66500000000000004,"15min":0.755},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47099999999999997,"15min":0.46500000000000002},"min":{"1min":0.35499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64700000000000002,"5min":0.71199999999999997,"15min":0.77200000000000002},"last":0.33000000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66200000000000003,"5min":0.73399999999999999,"15min":0.83199999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.317},"max":{"1min":0.61699999999999999,"5min":0.70999999999999996,"15min":0.86699999999999999},"last":0.373}]},{"osd":4,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.69399999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.40500000000000003},"max":{"1min":0.89900000000000002,"5min":1.034,"15min":1.0720000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70799999999999996,"15min":0.68999999999999995},"min":{"1min":0.55000000000000004,"5min":0.46600000000000003,"15min":0.42699999999999999},"max":{"1min":0.92600000000000005,"5min":1.022,"15min":1.0549999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.51400000000000001,"5min":0.47899999999999998,"15min":0.378},"max":{"1min":0.89000000000000001,"5min":0.96699999999999997,"15min":1.0449999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70399999999999996,"15min":0.68000000000000005},"min":{"1min":0.498,"5min":0.45400000000000001,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.028},"last":0.70299999999999996}]},{"osd":6,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69899999999999995,"15min":0.67700000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.441},"max":{"1min":0.85399999999999998,"5min":0.95399999999999996,"15min":1.171},"last":0.627},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.443},"max":{"1min":0.86599999999999999,"5min":1.01,"15min":1.135},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73299999999999998,"15min":0.72199999999999998},"min":{"1min":0.59899999999999998,"5min":0.47399999999999998,"15min":0.40699999999999997},"max":{"1min":0.94099999999999995,"5min":1.0549999999999999,"15min":1.083},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.75700000000000001,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95199999999999996,"5min":1.089,"15min":1.107},"last":0.65100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575946,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315876,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055964,"statfs":{"total":96636764160,"available":96313307136,"internally_reserved":0,"allocated":2453504,"data_stored":1309597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27000000000000002,"5min":0.25900000000000001,"15min":0.253},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.63700000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.433,"15min":0.437},"min":{"1min":0.29099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.67100000000000004,"15min":0.72899999999999998},"last":0.38500000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53700000000000003,"5min":0.628,"15min":0.69099999999999995},"last":0.255},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.45600000000000002},"min":{"1min":0.35899999999999999,"5min":0.32500000000000001,"15min":0.28100000000000003},"max":{"1min":0.61599999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.35199999999999998}]},{"osd":3,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47999999999999998,"15min":0.48199999999999998},"min":{"1min":0.39100000000000001,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.70099999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.31900000000000001},"max":{"1min":0.62,"5min":0.753,"15min":0.81399999999999995},"last":0.39800000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.501,"5min":0.46300000000000002,"15min":0.41099999999999998},"max":{"1min":0.88900000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66600000000000004,"15min":0.67600000000000005},"min":{"1min":0.46300000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97199999999999998,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.47299999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.52300000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67400000000000004,"15min":0.67700000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90000000000000002,"5min":1.056,"15min":1.056},"last":0.48199999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.47799999999999998},"max":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.113},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.55800000000000005,"5min":0.48999999999999999,"15min":0.46400000000000002},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.46700000000000003}]},{"osd":7,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.54100000000000004,"5min":0.502,"15min":0.46500000000000002},"max":{"1min":0.995,"5min":1.012,"15min":1.0680000000000001},"last":0.504},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.72499999999999998},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.48699999999999999},"max":{"1min":0.93500000000000005,"5min":1.089,"15min":1.1499999999999999},"last":0.53800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575947,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311788,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060052,"statfs":{"total":96636764160,"available":96317493248,"internally_reserved":0,"allocated":2461696,"data_stored":1310193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41099999999999998,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.54800000000000004,"5min":0.624,"15min":0.67500000000000004},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63200000000000001,"5min":0.64400000000000002,"15min":0.65800000000000003},"last":0.28899999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":0.67100000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.34300000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48199999999999998,"15min":0.47799999999999998},"min":{"1min":0.35499999999999998,"5min":0.31,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.72299999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.32200000000000001}]},{"osd":4,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.52900000000000003,"5min":0.41999999999999998,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.91700000000000004,"15min":1.0149999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.45200000000000001},"max":{"1min":0.98499999999999999,"5min":1.04,"15min":1.04},"last":0.72599999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69399999999999995,"15min":0.68600000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96199999999999997,"5min":1.0569999999999999,"15min":1.1100000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.67800000000000005},"min":{"1min":0.47799999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93500000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66400000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.40999999999999998},"max":{"1min":0.93400000000000005,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.622},{"interface":"front","average":{"1min":0.746,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.52200000000000002,"15min":0.46400000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0720000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.54900000000000004,"5min":0.53000000000000003,"15min":0.47899999999999998},"max":{"1min":0.94399999999999995,"5min":0.97999999999999998,"15min":1.071},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575945,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303596,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068244,"statfs":{"total":96636764160,"available":96325881856,"internally_reserved":0,"allocated":2461696,"data_stored":1309709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.44500000000000001,"5min":0.40799999999999997,"15min":0.28299999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.81000000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":0.75700000000000001,"5min":0.79000000000000004,"15min":0.97199999999999998},"last":0.495}]},{"osd":1,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.42399999999999999,"5min":0.41099999999999998,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":0.78100000000000003,"15min":0.89900000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.33600000000000002},"max":{"1min":0.78200000000000003,"5min":0.83299999999999996,"15min":0.88700000000000001},"last":0.56899999999999995}]},{"osd":2,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.86399999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.38200000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.85599999999999998},"last":0.65800000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38300000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.80800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.48799999999999999,"5min":0.48399999999999999,"15min":0.36599999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.83099999999999996},"last":0.621}]},{"osd":5,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.28100000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.76200000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51300000000000001,"15min":0.51100000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.79100000000000004},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34999999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.69599999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.39600000000000002,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.81799999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.79300000000000004,"15min":0.84599999999999997},"last":0.72199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575945,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307692,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064148,"statfs":{"total":96636764160,"available":96321687552,"internally_reserved":0,"allocated":2461696,"data_stored":1310205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73899999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.441},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.86899999999999999},"last":0.66900000000000004}]},{"osd":1,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.33300000000000002},"max":{"1min":0.76700000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.52600000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.372},"max":{"1min":0.71999999999999997,"5min":0.876,"15min":0.90000000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59699999999999998,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34499999999999997},"max":{"1min":0.75600000000000001,"5min":0.78100000000000003,"15min":0.83299999999999996},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":0.78700000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.34399999999999997},"max":{"1min":0.78600000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46100000000000002,"15min":0.47199999999999998},"min":{"1min":0.311,"5min":0.308,"15min":0.27900000000000003},"max":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.751},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.32600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.73399999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.313,"5min":0.312,"15min":0.312},"max":{"1min":0.753,"5min":0.753,"15min":0.75600000000000001},"last":0.74299999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.502,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.67400000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.75700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:53:42.761 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-15T02:53:42.901 INFO:tasks.ceph.mds.d.smithi141.stderr:2023-11-15T02:53:42.900+0000 7f3466be8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T02:53:42.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.908+0000 7fe7aa4fa700 1 Processor -- start 2023-11-15T02:53:42.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.908+0000 7fe7aa4fa700 1 -- start start 2023-11-15T02:53:42.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.909+0000 7fe7aa4fa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7a4154150 0x7fe7a4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.909+0000 7fe7aa4fa700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe7a40ab1a0 0x7fe7a4158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.909+0000 7fe7aa4fa700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a40c06f0 con 0x7fe7a40aa060 2023-11-15T02:53:42.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.909+0000 7fe7aa4fa700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a40c09d0 con 0x7fe7a40ab1a0 2023-11-15T02:53:42.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.909+0000 7fe7aa4fa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a4158820 con 0x7fe7a4154150 2023-11-15T02:53:42.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.910+0000 7fe7a3fff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7a4154150 0x7fe7a4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.910+0000 7fe7a37fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe7a40ab1a0 0x7fe7a4158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.910+0000 7fe7a37fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe7a40ab1a0 0x7fe7a4158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:37456/0 (socket says 172.21.15.1:37456) 2023-11-15T02:53:42.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.910+0000 7fe7a3fff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7a4154150 0x7fe7a4154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:39272/0 (socket says 172.21.15.1:39272) 2023-11-15T02:53:42.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.910+0000 7fe7a37fe700 1 -- 172.21.15.1:0/1156089124 learned_addr learned my addr 172.21.15.1:0/1156089124 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:42.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.910+0000 7fe7a37fe700 1 -- 172.21.15.1:0/1156089124 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7a4154150 msgr2=0x7fe7a4154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:42.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.910+0000 7fe7a37fe700 1 --2- 172.21.15.1:0/1156089124 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7a4154150 0x7fe7a4154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.910+0000 7fe7a37fe700 1 -- 172.21.15.1:0/1156089124 >> v1:172.21.15.141:6789/0 conn(0x7fe7a40aa060 legacy=0x7fe7a40c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.910+0000 7fe7a37fe700 1 -- 172.21.15.1:0/1156089124 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a4158b00 con 0x7fe7a40ab1a0 2023-11-15T02:53:42.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.910+0000 7fe7a37fe700 1 --2- 172.21.15.1:0/1156089124 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7a40ab1a0 0x7fe7a4158040 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fe78c006fd0 tx=0x7fe78c0090f0).ready entity=mon.1 client_cookie=b0f409110731149d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:42.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.910+0000 7fe7a2ffd700 1 -- 172.21.15.1:0/1156089124 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00b580 con 0x7fe7a40ab1a0 2023-11-15T02:53:42.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.910+0000 7fe7a2ffd700 1 -- 172.21.15.1:0/1156089124 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c00b6e0 con 0x7fe7a40ab1a0 2023-11-15T02:53:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.910+0000 7fe7a2ffd700 1 -- 172.21.15.1:0/1156089124 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00ba80 con 0x7fe7a40ab1a0 2023-11-15T02:53:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.911+0000 7fe7aa4fa700 1 -- 172.21.15.1:0/1156089124 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7a40ab1a0 msgr2=0x7fe7a4158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.911+0000 7fe7aa4fa700 1 --2- 172.21.15.1:0/1156089124 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7a40ab1a0 0x7fe7a4158040 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fe78c006fd0 tx=0x7fe78c0090f0).stop 2023-11-15T02:53:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.911+0000 7fe7aa4fa700 1 -- 172.21.15.1:0/1156089124 shutdown_connections 2023-11-15T02:53:42.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.911+0000 7fe7aa4fa700 1 --2- 172.21.15.1:0/1156089124 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7a4154150 0x7fe7a4154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.911+0000 7fe7aa4fa700 1 --2- 172.21.15.1:0/1156089124 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7a40ab1a0 0x7fe7a4158040 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.911+0000 7fe7aa4fa700 1 -- 172.21.15.1:0/1156089124 >> 172.21.15.1:0/1156089124 conn(0x7fe7a4064aa0 msgr2=0x7fe7a4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:42.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.911+0000 7fe7aa4fa700 1 -- 172.21.15.1:0/1156089124 shutdown_connections 2023-11-15T02:53:42.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.911+0000 7fe7aa4fa700 1 -- 172.21.15.1:0/1156089124 wait complete. 2023-11-15T02:53:42.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.912+0000 7fe7aa4fa700 1 Processor -- start 2023-11-15T02:53:42.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.912+0000 7fe7aa4fa700 1 -- start start 2023-11-15T02:53:42.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7aa4fa700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7a40aa060 0x7fe7a4168850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7aa4fa700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7a40ab1a0 0x7fe7a4140b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7aa4fa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7a4154150 0x7fe7a4166be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7aa4fa700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a41683c0 con 0x7fe7a40aa060 2023-11-15T02:53:42.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7aa4fa700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a4141070 con 0x7fe7a40ab1a0 2023-11-15T02:53:42.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7aa4fa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a4156bb0 con 0x7fe7a4154150 2023-11-15T02:53:42.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7a3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7a40aa060 0x7fe7a4168850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7a3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7a40aa060 0x7fe7a4168850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59612/0 (socket says 172.21.15.1:59612) 2023-11-15T02:53:42.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7a3fff700 1 -- 172.21.15.1:0/1057768394 learned_addr learned my addr 172.21.15.1:0/1057768394 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:42.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7a37fe700 1 --2- 172.21.15.1:0/1057768394 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7a40ab1a0 0x7fe7a4140b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7a8a97700 1 --2- 172.21.15.1:0/1057768394 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7a4154150 0x7fe7a4166be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7a3fff700 1 -- 172.21.15.1:0/1057768394 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7a4154150 msgr2=0x7fe7a4166be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7a3fff700 1 --2- 172.21.15.1:0/1057768394 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7a4154150 0x7fe7a4166be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7a3fff700 1 -- 172.21.15.1:0/1057768394 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7a40ab1a0 msgr2=0x7fe7a4140b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7a3fff700 1 --2- 172.21.15.1:0/1057768394 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7a40ab1a0 0x7fe7a4140b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:42.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.913+0000 7fe7a3fff700 1 -- 172.21.15.1:0/1057768394 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c009370 con 0x7fe7a40aa060 2023-11-15T02:53:42.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.914+0000 7fe7a3fff700 1 --2- 172.21.15.1:0/1057768394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7a40aa060 0x7fe7a4168850 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7fe79400e900 tx=0x7fe794009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:42.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.914+0000 7fe79bfff700 1 -- 172.21.15.1:0/1057768394 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400c640 con 0x7fe7a40aa060 2023-11-15T02:53:42.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.914+0000 7fe79bfff700 1 -- 172.21.15.1:0/1057768394 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79400c7a0 con 0x7fe7a40aa060 2023-11-15T02:53:42.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.914+0000 7fe7aa4fa700 1 -- 172.21.15.1:0/1057768394 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a4167740 con 0x7fe7a40aa060 2023-11-15T02:53:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.914+0000 7fe79bfff700 1 -- 172.21.15.1:0/1057768394 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400cb20 con 0x7fe7a40aa060 2023-11-15T02:53:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.914+0000 7fe7aa4fa700 1 -- 172.21.15.1:0/1057768394 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a4167d70 con 0x7fe7a40aa060 2023-11-15T02:53:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.915+0000 7fe7aa4fa700 1 -- 172.21.15.1:0/1057768394 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a41686a0 con 0x7fe7a40aa060 2023-11-15T02:53:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.915+0000 7fe79bfff700 1 -- 172.21.15.1:0/1057768394 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe79401b400 con 0x7fe7a40aa060 2023-11-15T02:53:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.916+0000 7fe79bfff700 1 --2- 172.21.15.1:0/1057768394 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe78405f270 0x7fe784061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.916+0000 7fe79bfff700 1 -- 172.21.15.1:0/1057768394 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7fe79407aaa0 con 0x7fe7a40aa060 2023-11-15T02:53:42.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.916+0000 7fe7a37fe700 1 --2- 172.21.15.1:0/1057768394 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe78405f270 0x7fe784061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:42.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.916+0000 7fe7a37fe700 1 --2- 172.21.15.1:0/1057768394 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe78405f270 0x7fe784061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe78c006fd0 tx=0x7fe78c017000).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:42.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:42.920+0000 7fe79bfff700 1 -- 172.21.15.1:0/1057768394 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe79404b980 con 0x7fe7a40aa060 2023-11-15T02:53:43.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.163+0000 7fe7aa4fa700 1 -- 172.21.15.1:0/1057768394 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe7a41674f0 con 0x7fe7a40aa060 2023-11-15T02:53:43.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.163+0000 7fe79bfff700 1 -- 172.21.15.1:0/1057768394 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+957 (secure 0 0 0) 0x7fe794016080 con 0x7fe7a40aa060 2023-11-15T02:53:43.165 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:43.166 INFO:teuthology.orchestra.run.smithi001.stdout:{"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5544,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":196,"num_osds":8,"num_up_osds":8,"osd_up_since":1700011287,"num_in_osds":8,"osd_in_since":1700011281,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":2528944128,"bytes_avail":770565169152,"bytes_total":773094113280},"fsmap":{"epoch":87,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"d","status":"up:active","gid":9609}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2023-11-15T02:49:23.445245+0000","services":{}},"progress_events":{}} 2023-11-15T02:53:43.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.165+0000 7fe7aa4fa700 1 -- 172.21.15.1:0/1057768394 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe78405f270 msgr2=0x7fe784061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:43.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.165+0000 7fe7aa4fa700 1 --2- 172.21.15.1:0/1057768394 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe78405f270 0x7fe784061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe78c006fd0 tx=0x7fe78c017000).stop 2023-11-15T02:53:43.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.165+0000 7fe7aa4fa700 1 -- 172.21.15.1:0/1057768394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7a40aa060 msgr2=0x7fe7a4168850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:43.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.165+0000 7fe7aa4fa700 1 --2- 172.21.15.1:0/1057768394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7a40aa060 0x7fe7a4168850 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7fe79400e900 tx=0x7fe794009060).stop 2023-11-15T02:53:43.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.165+0000 7fe7aa4fa700 1 -- 172.21.15.1:0/1057768394 shutdown_connections 2023-11-15T02:53:43.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.165+0000 7fe7aa4fa700 1 --2- 172.21.15.1:0/1057768394 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe78405f270 0x7fe784061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.165+0000 7fe7aa4fa700 1 --2- 172.21.15.1:0/1057768394 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7a4154150 0x7fe7a4166be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.165+0000 7fe7aa4fa700 1 --2- 172.21.15.1:0/1057768394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7a40aa060 0x7fe7a4168850 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.165+0000 7fe7aa4fa700 1 --2- 172.21.15.1:0/1057768394 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7a40ab1a0 0x7fe7a4140b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.165+0000 7fe7aa4fa700 1 -- 172.21.15.1:0/1057768394 >> 172.21.15.1:0/1057768394 conn(0x7fe7a4064aa0 msgr2=0x7fe7a40ab950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.165+0000 7fe7aa4fa700 1 -- 172.21.15.1:0/1057768394 shutdown_connections 2023-11-15T02:53:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.165+0000 7fe7aa4fa700 1 -- 172.21.15.1:0/1057768394 wait complete. 2023-11-15T02:53:43.179 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-15T02:53:43.180 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:53:43.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.296+0000 7f1efde5f700 1 Processor -- start 2023-11-15T02:53:43.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.296+0000 7f1efde5f700 1 -- start start 2023-11-15T02:53:43.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.297+0000 7f1efde5f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1ef8154150 0x7f1ef8154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:43.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.297+0000 7f1efde5f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ef80aa060 0x7f1ef80c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:43.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.297+0000 7f1efde5f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef80c06f0 con 0x7f1ef80ab1a0 2023-11-15T02:53:43.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.297+0000 7f1efde5f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef80c09d0 con 0x7f1ef8154150 2023-11-15T02:53:43.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.297+0000 7f1efde5f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef8158820 con 0x7f1ef80aa060 2023-11-15T02:53:43.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.297+0000 7f1ef6ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f1ef80ab1a0 0x7f1ef8158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57296/0 (socket says 172.21.15.1:57296) 2023-11-15T02:53:43.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.297+0000 7f1ef6ffd700 1 -- 172.21.15.1:0/1916016193 learned_addr learned my addr 172.21.15.1:0/1916016193 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:43.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.297+0000 7f1ef77fe700 1 --2- 172.21.15.1:0/1916016193 >> v2:172.21.15.141:3300/0 conn(0x7f1ef8154150 0x7f1ef8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:43.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.297+0000 7f1ef7fff700 1 --2- 172.21.15.1:0/1916016193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ef80aa060 0x7f1ef80c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:43.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.297+0000 7f1ef67fc700 1 -- 172.21.15.1:0/1916016193 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830039473 0 0) 0x7f1ef80c06f0 con 0x7f1ef80ab1a0 2023-11-15T02:53:43.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.297+0000 7f1ef67fc700 1 -- 172.21.15.1:0/1916016193 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ee00033f0 con 0x7f1ef80ab1a0 2023-11-15T02:53:43.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 -- 172.21.15.1:0/1916016193 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 928804257 0 0) 0x7f1ee00033f0 con 0x7f1ef80ab1a0 2023-11-15T02:53:43.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 -- 172.21.15.1:0/1916016193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ef80aa060 msgr2=0x7f1ef80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:43.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 --2- 172.21.15.1:0/1916016193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ef80aa060 0x7f1ef80c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:43.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 -- 172.21.15.1:0/1916016193 >> v2:172.21.15.141:3300/0 conn(0x7f1ef8154150 msgr2=0x7f1ef8154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:43.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 --2- 172.21.15.1:0/1916016193 >> v2:172.21.15.141:3300/0 conn(0x7f1ef8154150 0x7f1ef8154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:43.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 -- 172.21.15.1:0/1916016193 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef8158b00 con 0x7f1ef80ab1a0 2023-11-15T02:53:43.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 -- 172.21.15.1:0/1916016193 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f1eec001470 con 0x7f1ef80ab1a0 2023-11-15T02:53:43.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 -- 172.21.15.1:0/1916016193 >> v1:172.21.15.1:6789/0 conn(0x7f1ef80ab1a0 legacy=0x7f1ef8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:43.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 --2- 172.21.15.1:0/1916016193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ee00038e0 0x7f1ee0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:43.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 --2- 172.21.15.1:0/1916016193 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ee0004690 0x7f1ee0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:43.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 --2- 172.21.15.1:0/1916016193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ef80aa060 0x7f1ee0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:43.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 -- 172.21.15.1:0/1916016193 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef80c09d0 con 0x7f1ee00038e0 2023-11-15T02:53:43.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 -- 172.21.15.1:0/1916016193 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef8158820 con 0x7f1ee0004690 2023-11-15T02:53:43.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 -- 172.21.15.1:0/1916016193 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee000b8e0 con 0x7f1ef80aa060 2023-11-15T02:53:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef77fe700 1 --2- 172.21.15.1:0/1916016193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ee00038e0 0x7f1ee0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef6ffd700 1 --2- 172.21.15.1:0/1916016193 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ee0004690 0x7f1ee0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef7fff700 1 --2- 172.21.15.1:0/1916016193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ef80aa060 0x7f1ee0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef77fe700 1 -- 172.21.15.1:0/1916016193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ef80aa060 msgr2=0x7f1ee0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef77fe700 1 --2- 172.21.15.1:0/1916016193 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ef80aa060 0x7f1ee0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:43.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef77fe700 1 -- 172.21.15.1:0/1916016193 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ee0004690 msgr2=0x7f1ee0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:43.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef77fe700 1 --2- 172.21.15.1:0/1916016193 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ee0004690 0x7f1ee0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:43.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef77fe700 1 -- 172.21.15.1:0/1916016193 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee00033f0 con 0x7f1ee00038e0 2023-11-15T02:53:43.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef77fe700 1 --2- 172.21.15.1:0/1916016193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ee00038e0 0x7f1ee0003d00 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7f1ee8009ab0 tx=0x7f1ee8009060).ready entity=mon.0 client_cookie=a24ae8a83eb7ec39 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:43.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 -- 172.21.15.1:0/1916016193 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8009430 con 0x7f1ee00038e0 2023-11-15T02:53:43.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 -- 172.21.15.1:0/1916016193 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee800e640 con 0x7f1ee00038e0 2023-11-15T02:53:43.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.298+0000 7f1ef67fc700 1 -- 172.21.15.1:0/1916016193 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee800e9c0 con 0x7f1ee00038e0 2023-11-15T02:53:43.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.299+0000 7f1efde5f700 1 -- 172.21.15.1:0/1916016193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ee00038e0 msgr2=0x7f1ee0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:43.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.299+0000 7f1efde5f700 1 --2- 172.21.15.1:0/1916016193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ee00038e0 0x7f1ee0003d00 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7f1ee8009ab0 tx=0x7f1ee8009060).stop 2023-11-15T02:53:43.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.299+0000 7f1ef7fff700 1 -- 172.21.15.1:0/1916016193 reap_dead start 2023-11-15T02:53:43.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.299+0000 7f1efde5f700 1 -- 172.21.15.1:0/1916016193 shutdown_connections 2023-11-15T02:53:43.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.299+0000 7f1efde5f700 1 -- 172.21.15.1:0/1916016193 >> 172.21.15.1:0/1916016193 conn(0x7f1ef8064aa0 msgr2=0x7f1ef8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:43.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.299+0000 7f1efde5f700 1 -- 172.21.15.1:0/1916016193 shutdown_connections 2023-11-15T02:53:43.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.299+0000 7f1efde5f700 1 -- 172.21.15.1:0/1916016193 wait complete. 2023-11-15T02:53:43.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.300+0000 7f1efde5f700 1 Processor -- start 2023-11-15T02:53:43.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.300+0000 7f1efde5f700 1 -- start start 2023-11-15T02:53:43.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1efde5f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ee00038e0 0x7f1ef8156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:43.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1efde5f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ef81577d0 0x7f1ef81479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:43.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1efde5f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ef8147e90 0x7f1ef8167dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:43.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1efde5f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef8167c10 con 0x7f1ef81577d0 2023-11-15T02:53:43.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1efde5f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef81568c0 con 0x7f1ef8147e90 2023-11-15T02:53:43.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1efde5f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef8155cd0 con 0x7f1ee00038e0 2023-11-15T02:53:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1ef6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ef81577d0 0x7f1ef81479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1ef6ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ef81577d0 0x7f1ef81479a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59640/0 (socket says 172.21.15.1:59640) 2023-11-15T02:53:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1ef6ffd700 1 -- 172.21.15.1:0/2859278540 learned_addr learned my addr 172.21.15.1:0/2859278540 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1ef77fe700 1 --2- 172.21.15.1:0/2859278540 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ee00038e0 0x7f1ef8156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:43.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1ef7fff700 1 --2- 172.21.15.1:0/2859278540 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ef8147e90 0x7f1ef8167dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:43.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1ef6ffd700 1 -- 172.21.15.1:0/2859278540 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ee00038e0 msgr2=0x7f1ef8156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:43.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1ef6ffd700 1 --2- 172.21.15.1:0/2859278540 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ee00038e0 0x7f1ef8156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:43.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1ef6ffd700 1 -- 172.21.15.1:0/2859278540 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ef8147e90 msgr2=0x7f1ef8167dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:43.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1ef6ffd700 1 --2- 172.21.15.1:0/2859278540 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ef8147e90 0x7f1ef8167dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:43.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1ef6ffd700 1 -- 172.21.15.1:0/2859278540 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef8155f90 con 0x7f1ef81577d0 2023-11-15T02:53:43.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.301+0000 7f1ef77fe700 1 --2- 172.21.15.1:0/2859278540 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ee00038e0 0x7f1ef8156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:43.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.302+0000 7f1ef6ffd700 1 --2- 172.21.15.1:0/2859278540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ef81577d0 0x7f1ef81479a0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7f1eec0049e0 tx=0x7f1eec001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:43.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.302+0000 7f1edf7fe700 1 -- 172.21.15.1:0/2859278540 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec00f850 con 0x7f1ef81577d0 2023-11-15T02:53:43.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.302+0000 7f1edf7fe700 1 -- 172.21.15.1:0/2859278540 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eec00f9b0 con 0x7f1ef81577d0 2023-11-15T02:53:43.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.302+0000 7f1efde5f700 1 -- 172.21.15.1:0/2859278540 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef8156270 con 0x7f1ef81577d0 2023-11-15T02:53:43.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.302+0000 7f1edf7fe700 1 -- 172.21.15.1:0/2859278540 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec00fd50 con 0x7f1ef81577d0 2023-11-15T02:53:43.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.302+0000 7f1efde5f700 1 -- 172.21.15.1:0/2859278540 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef8147700 con 0x7f1ef81577d0 2023-11-15T02:53:43.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.303+0000 7f1efde5f700 1 -- 172.21.15.1:0/2859278540 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef8153980 con 0x7f1ef81577d0 2023-11-15T02:53:43.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.303+0000 7f1edf7fe700 1 -- 172.21.15.1:0/2859278540 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1eec012560 con 0x7f1ef81577d0 2023-11-15T02:53:43.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.304+0000 7f1edf7fe700 1 --2- 172.21.15.1:0/2859278540 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1ee405f2a0 0x7f1ee4061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:43.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.304+0000 7f1edf7fe700 1 -- 172.21.15.1:0/2859278540 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f1eec07a1e0 con 0x7f1ef81577d0 2023-11-15T02:53:43.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.304+0000 7f1ef77fe700 1 --2- 172.21.15.1:0/2859278540 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1ee405f2a0 0x7f1ee4061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:43.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.304+0000 7f1ef77fe700 1 --2- 172.21.15.1:0/2859278540 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1ee405f2a0 0x7f1ee4061760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1ee8009ab0 tx=0x7f1ee801a000).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:43.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.308+0000 7f1edf7fe700 1 -- 172.21.15.1:0/2859278540 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1eec04b120 con 0x7f1ef81577d0 2023-11-15T02:53:43.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.475+0000 7f1efde5f700 1 -- 172.21.15.1:0/2859278540 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ef8156a50 con 0x7f1ee405f2a0 2023-11-15T02:53:43.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.485+0000 7f1edf7fe700 1 -- 172.21.15.1:0/2859278540 <== mgr.8590 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362304 (secure 0 0 0) 0x7f1ef8156a50 con 0x7f1ee405f2a0 2023-11-15T02:53:43.491 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:43.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.488+0000 7f1efde5f700 1 -- 172.21.15.1:0/2859278540 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1ee405f2a0 msgr2=0x7f1ee4061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:43.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.488+0000 7f1efde5f700 1 --2- 172.21.15.1:0/2859278540 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1ee405f2a0 0x7f1ee4061760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1ee8009ab0 tx=0x7f1ee801a000).stop 2023-11-15T02:53:43.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.488+0000 7f1efde5f700 1 -- 172.21.15.1:0/2859278540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ef81577d0 msgr2=0x7f1ef81479a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:43.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.488+0000 7f1efde5f700 1 --2- 172.21.15.1:0/2859278540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ef81577d0 0x7f1ef81479a0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7f1eec0049e0 tx=0x7f1eec001e90).stop 2023-11-15T02:53:43.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.488+0000 7f1efde5f700 1 -- 172.21.15.1:0/2859278540 shutdown_connections 2023-11-15T02:53:43.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.488+0000 7f1efde5f700 1 --2- 172.21.15.1:0/2859278540 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1ee405f2a0 0x7f1ee4061760 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:43.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.488+0000 7f1efde5f700 1 --2- 172.21.15.1:0/2859278540 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ef8147e90 0x7f1ef8167dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:43.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.488+0000 7f1efde5f700 1 --2- 172.21.15.1:0/2859278540 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ee00038e0 0x7f1ef8156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:43.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.488+0000 7f1efde5f700 1 --2- 172.21.15.1:0/2859278540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ef81577d0 0x7f1ef81479a0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:43.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.488+0000 7f1efde5f700 1 -- 172.21.15.1:0/2859278540 >> 172.21.15.1:0/2859278540 conn(0x7f1ef8064aa0 msgr2=0x7f1ef814f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:43.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.488+0000 7f1efde5f700 1 -- 172.21.15.1:0/2859278540 shutdown_connections 2023-11-15T02:53:43.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:43.488+0000 7f1efde5f700 1 -- 172.21.15.1:0/2859278540 wait complete. 2023-11-15T02:53:43.497 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:53:43.503 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-15T02:53:42.551565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":221,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2469672,"kb_used_data":19176,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752505048,"statfs":{"total":773094113280,"available":770565169152,"internally_reserved":0,"allocated":19636224,"data_stored":10466372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-593515,"num_objects":-21,"num_object_clones":0,"num_object_copies":-42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-21,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-205,"num_write_kb":-719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.007705"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.004115+0000","last_change":"2023-11-15T02:53:37.995183+0000","last_active":"2023-11-15T02:53:38.004115+0000","last_peered":"2023-11-15T02:53:38.004115+0000","last_clean":"2023-11-15T02:53:38.004115+0000","last_became_active":"2023-11-15T02:53:37.994643+0000","last_became_peered":"2023-11-15T02:53:37.994643+0000","last_unstale":"2023-11-15T02:53:38.004115+0000","last_undegraded":"2023-11-15T02:53:38.004115+0000","last_fullsized":"2023-11-15T02:53:38.004115+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"195'3","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011940+0000","last_change":"2023-11-15T02:53:37.606094+0000","last_active":"2023-11-15T02:53:38.011940+0000","last_peered":"2023-11-15T02:53:38.011940+0000","last_clean":"2023-11-15T02:53:38.011940+0000","last_became_active":"2023-11-15T02:53:37.605797+0000","last_became_peered":"2023-11-15T02:53:37.605797+0000","last_unstale":"2023-11-15T02:53:38.011940+0000","last_undegraded":"2023-11-15T02:53:38.011940+0000","last_fullsized":"2023-11-15T02:53:38.011940+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011234+0000","last_change":"2023-11-15T02:53:38.006818+0000","last_active":"2023-11-15T02:53:38.011234+0000","last_peered":"2023-11-15T02:53:38.011234+0000","last_clean":"2023-11-15T02:53:38.011234+0000","last_became_active":"2023-11-15T02:53:38.006545+0000","last_became_peered":"2023-11-15T02:53:38.006545+0000","last_unstale":"2023-11-15T02:53:38.011234+0000","last_undegraded":"2023-11-15T02:53:38.011234+0000","last_fullsized":"2023-11-15T02:53:38.011234+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.995290+0000","last_change":"2023-11-15T02:53:37.600571+0000","last_active":"2023-11-15T02:53:37.995290+0000","last_peered":"2023-11-15T02:53:37.995290+0000","last_clean":"2023-11-15T02:53:37.995290+0000","last_became_active":"2023-11-15T02:53:37.600299+0000","last_became_peered":"2023-11-15T02:53:37.600299+0000","last_unstale":"2023-11-15T02:53:37.995290+0000","last_undegraded":"2023-11-15T02:53:37.995290+0000","last_fullsized":"2023-11-15T02:53:37.995290+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998658+0000","last_change":"2023-11-15T02:53:37.991499+0000","last_active":"2023-11-15T02:53:37.998658+0000","last_peered":"2023-11-15T02:53:37.998658+0000","last_clean":"2023-11-15T02:53:37.998658+0000","last_became_active":"2023-11-15T02:53:37.991219+0000","last_became_peered":"2023-11-15T02:53:37.991219+0000","last_unstale":"2023-11-15T02:53:37.998658+0000","last_undegraded":"2023-11-15T02:53:37.998658+0000","last_fullsized":"2023-11-15T02:53:37.998658+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999215+0000","last_change":"2023-11-15T02:53:37.598351+0000","last_active":"2023-11-15T02:53:37.999215+0000","last_peered":"2023-11-15T02:53:37.999215+0000","last_clean":"2023-11-15T02:53:37.999215+0000","last_became_active":"2023-11-15T02:53:37.598074+0000","last_became_peered":"2023-11-15T02:53:37.598074+0000","last_unstale":"2023-11-15T02:53:37.999215+0000","last_undegraded":"2023-11-15T02:53:37.999215+0000","last_fullsized":"2023-11-15T02:53:37.999215+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009794+0000","last_change":"2023-11-15T02:53:38.005640+0000","last_active":"2023-11-15T02:53:38.009794+0000","last_peered":"2023-11-15T02:53:38.009794+0000","last_clean":"2023-11-15T02:53:38.009794+0000","last_became_active":"2023-11-15T02:53:38.005427+0000","last_became_peered":"2023-11-15T02:53:38.005427+0000","last_unstale":"2023-11-15T02:53:38.009794+0000","last_undegraded":"2023-11-15T02:53:38.009794+0000","last_fullsized":"2023-11-15T02:53:38.009794+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003329+0000","last_change":"2023-11-15T02:53:37.605508+0000","last_active":"2023-11-15T02:53:38.003329+0000","last_peered":"2023-11-15T02:53:38.003329+0000","last_clean":"2023-11-15T02:53:38.003329+0000","last_became_active":"2023-11-15T02:53:37.605050+0000","last_became_peered":"2023-11-15T02:53:37.605050+0000","last_unstale":"2023-11-15T02:53:38.003329+0000","last_undegraded":"2023-11-15T02:53:38.003329+0000","last_fullsized":"2023-11-15T02:53:38.003329+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.007889+0000","last_change":"2023-11-15T02:53:38.003090+0000","last_active":"2023-11-15T02:53:38.007889+0000","last_peered":"2023-11-15T02:53:38.007889+0000","last_clean":"2023-11-15T02:53:38.007889+0000","last_became_active":"2023-11-15T02:53:38.002775+0000","last_became_peered":"2023-11-15T02:53:38.002775+0000","last_unstale":"2023-11-15T02:53:38.007889+0000","last_undegraded":"2023-11-15T02:53:38.007889+0000","last_fullsized":"2023-11-15T02:53:38.007889+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002517+0000","last_change":"2023-11-15T02:53:37.596100+0000","last_active":"2023-11-15T02:53:38.002517+0000","last_peered":"2023-11-15T02:53:38.002517+0000","last_clean":"2023-11-15T02:53:38.002517+0000","last_became_active":"2023-11-15T02:53:37.595738+0000","last_became_peered":"2023-11-15T02:53:37.595738+0000","last_unstale":"2023-11-15T02:53:38.002517+0000","last_undegraded":"2023-11-15T02:53:38.002517+0000","last_fullsized":"2023-11-15T02:53:38.002517+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.013228+0000","last_change":"2023-11-15T02:53:38.010179+0000","last_active":"2023-11-15T02:53:38.013228+0000","last_peered":"2023-11-15T02:53:38.013228+0000","last_clean":"2023-11-15T02:53:38.013228+0000","last_became_active":"2023-11-15T02:53:38.009853+0000","last_became_peered":"2023-11-15T02:53:38.009853+0000","last_unstale":"2023-11-15T02:53:38.013228+0000","last_undegraded":"2023-11-15T02:53:38.013228+0000","last_fullsized":"2023-11-15T02:53:38.013228+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998494+0000","last_change":"2023-11-15T02:53:37.610005+0000","last_active":"2023-11-15T02:53:37.998494+0000","last_peered":"2023-11-15T02:53:37.998494+0000","last_clean":"2023-11-15T02:53:37.998494+0000","last_became_active":"2023-11-15T02:53:37.609699+0000","last_became_peered":"2023-11-15T02:53:37.609699+0000","last_unstale":"2023-11-15T02:53:37.998494+0000","last_undegraded":"2023-11-15T02:53:37.998494+0000","last_fullsized":"2023-11-15T02:53:37.998494+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006567+0000","last_change":"2023-11-15T02:53:38.001561+0000","last_active":"2023-11-15T02:53:38.006567+0000","last_peered":"2023-11-15T02:53:38.006567+0000","last_clean":"2023-11-15T02:53:38.006567+0000","last_became_active":"2023-11-15T02:53:38.001242+0000","last_became_peered":"2023-11-15T02:53:38.001242+0000","last_unstale":"2023-11-15T02:53:38.006567+0000","last_undegraded":"2023-11-15T02:53:38.006567+0000","last_fullsized":"2023-11-15T02:53:38.006567+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.981858+0000","last_change":"2023-11-15T02:53:37.606473+0000","last_active":"2023-11-15T02:53:37.981858+0000","last_peered":"2023-11-15T02:53:37.981858+0000","last_clean":"2023-11-15T02:53:37.981858+0000","last_became_active":"2023-11-15T02:53:37.606137+0000","last_became_peered":"2023-11-15T02:53:37.606137+0000","last_unstale":"2023-11-15T02:53:37.981858+0000","last_undegraded":"2023-11-15T02:53:37.981858+0000","last_fullsized":"2023-11-15T02:53:37.981858+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002949+0000","last_change":"2023-11-15T02:53:37.999287+0000","last_active":"2023-11-15T02:53:38.002949+0000","last_peered":"2023-11-15T02:53:38.002949+0000","last_clean":"2023-11-15T02:53:38.002949+0000","last_became_active":"2023-11-15T02:53:37.998970+0000","last_became_peered":"2023-11-15T02:53:37.998970+0000","last_unstale":"2023-11-15T02:53:38.002949+0000","last_undegraded":"2023-11-15T02:53:38.002949+0000","last_fullsized":"2023-11-15T02:53:38.002949+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989720+0000","last_change":"2023-11-15T02:53:37.596882+0000","last_active":"2023-11-15T02:53:37.989720+0000","last_peered":"2023-11-15T02:53:37.989720+0000","last_clean":"2023-11-15T02:53:37.989720+0000","last_became_active":"2023-11-15T02:53:37.596607+0000","last_became_peered":"2023-11-15T02:53:37.596607+0000","last_unstale":"2023-11-15T02:53:37.989720+0000","last_undegraded":"2023-11-15T02:53:37.989720+0000","last_fullsized":"2023-11-15T02:53:37.989720+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008738+0000","last_change":"2023-11-15T02:53:38.007229+0000","last_active":"2023-11-15T02:53:38.008738+0000","last_peered":"2023-11-15T02:53:38.008738+0000","last_clean":"2023-11-15T02:53:38.008738+0000","last_became_active":"2023-11-15T02:53:38.006946+0000","last_became_peered":"2023-11-15T02:53:38.006946+0000","last_unstale":"2023-11-15T02:53:38.008738+0000","last_undegraded":"2023-11-15T02:53:38.008738+0000","last_fullsized":"2023-11-15T02:53:38.008738+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.994300+0000","last_change":"2023-11-15T02:53:37.597995+0000","last_active":"2023-11-15T02:53:37.994300+0000","last_peered":"2023-11-15T02:53:37.994300+0000","last_clean":"2023-11-15T02:53:37.994300+0000","last_became_active":"2023-11-15T02:53:37.597683+0000","last_became_peered":"2023-11-15T02:53:37.597683+0000","last_unstale":"2023-11-15T02:53:37.994300+0000","last_undegraded":"2023-11-15T02:53:37.994300+0000","last_fullsized":"2023-11-15T02:53:37.994300+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003079+0000","last_change":"2023-11-15T02:53:37.998235+0000","last_active":"2023-11-15T02:53:38.003079+0000","last_peered":"2023-11-15T02:53:38.003079+0000","last_clean":"2023-11-15T02:53:38.003079+0000","last_became_active":"2023-11-15T02:53:37.997964+0000","last_became_peered":"2023-11-15T02:53:37.997964+0000","last_unstale":"2023-11-15T02:53:38.003079+0000","last_undegraded":"2023-11-15T02:53:38.003079+0000","last_fullsized":"2023-11-15T02:53:38.003079+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.995410+0000","last_change":"2023-11-15T02:53:37.603411+0000","last_active":"2023-11-15T02:53:37.995410+0000","last_peered":"2023-11-15T02:53:37.995410+0000","last_clean":"2023-11-15T02:53:37.995410+0000","last_became_active":"2023-11-15T02:53:37.603074+0000","last_became_peered":"2023-11-15T02:53:37.603074+0000","last_unstale":"2023-11-15T02:53:37.995410+0000","last_undegraded":"2023-11-15T02:53:37.995410+0000","last_fullsized":"2023-11-15T02:53:37.995410+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.007921+0000","last_change":"2023-11-15T02:53:38.003127+0000","last_active":"2023-11-15T02:53:38.007921+0000","last_peered":"2023-11-15T02:53:38.007921+0000","last_clean":"2023-11-15T02:53:38.007921+0000","last_became_active":"2023-11-15T02:53:38.002839+0000","last_became_peered":"2023-11-15T02:53:38.002839+0000","last_unstale":"2023-11-15T02:53:38.007921+0000","last_undegraded":"2023-11-15T02:53:38.007921+0000","last_fullsized":"2023-11-15T02:53:38.007921+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992555+0000","last_change":"2023-11-15T02:53:37.597628+0000","last_active":"2023-11-15T02:53:37.992555+0000","last_peered":"2023-11-15T02:53:37.992555+0000","last_clean":"2023-11-15T02:53:37.992555+0000","last_became_active":"2023-11-15T02:53:37.597332+0000","last_became_peered":"2023-11-15T02:53:37.597332+0000","last_unstale":"2023-11-15T02:53:37.992555+0000","last_undegraded":"2023-11-15T02:53:37.992555+0000","last_fullsized":"2023-11-15T02:53:37.992555+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009318+0000","last_change":"2023-11-15T02:53:38.001828+0000","last_active":"2023-11-15T02:53:38.009318+0000","last_peered":"2023-11-15T02:53:38.009318+0000","last_clean":"2023-11-15T02:53:38.009318+0000","last_became_active":"2023-11-15T02:53:37.997960+0000","last_became_peered":"2023-11-15T02:53:37.997960+0000","last_unstale":"2023-11-15T02:53:38.009318+0000","last_undegraded":"2023-11-15T02:53:38.009318+0000","last_fullsized":"2023-11-15T02:53:38.009318+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"195'4","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011033+0000","last_change":"2023-11-15T02:53:37.601586+0000","last_active":"2023-11-15T02:53:38.011033+0000","last_peered":"2023-11-15T02:53:38.011033+0000","last_clean":"2023-11-15T02:53:38.011033+0000","last_became_active":"2023-11-15T02:53:37.601290+0000","last_became_peered":"2023-11-15T02:53:37.601290+0000","last_unstale":"2023-11-15T02:53:38.011033+0000","last_undegraded":"2023-11-15T02:53:38.011033+0000","last_fullsized":"2023-11-15T02:53:38.011033+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001253+0000","last_change":"2023-11-15T02:53:37.996705+0000","last_active":"2023-11-15T02:53:38.001253+0000","last_peered":"2023-11-15T02:53:38.001253+0000","last_clean":"2023-11-15T02:53:38.001253+0000","last_became_active":"2023-11-15T02:53:37.995805+0000","last_became_peered":"2023-11-15T02:53:37.995805+0000","last_unstale":"2023-11-15T02:53:38.001253+0000","last_undegraded":"2023-11-15T02:53:38.001253+0000","last_fullsized":"2023-11-15T02:53:38.001253+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010242+0000","last_change":"2023-11-15T02:53:37.604059+0000","last_active":"2023-11-15T02:53:38.010242+0000","last_peered":"2023-11-15T02:53:38.010242+0000","last_clean":"2023-11-15T02:53:38.010242+0000","last_became_active":"2023-11-15T02:53:37.603596+0000","last_became_peered":"2023-11-15T02:53:37.603596+0000","last_unstale":"2023-11-15T02:53:38.010242+0000","last_undegraded":"2023-11-15T02:53:38.010242+0000","last_fullsized":"2023-11-15T02:53:38.010242+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001234+0000","last_change":"2023-11-15T02:53:37.997221+0000","last_active":"2023-11-15T02:53:38.001234+0000","last_peered":"2023-11-15T02:53:38.001234+0000","last_clean":"2023-11-15T02:53:38.001234+0000","last_became_active":"2023-11-15T02:53:37.996900+0000","last_became_peered":"2023-11-15T02:53:37.996900+0000","last_unstale":"2023-11-15T02:53:38.001234+0000","last_undegraded":"2023-11-15T02:53:38.001234+0000","last_fullsized":"2023-11-15T02:53:38.001234+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989867+0000","last_change":"2023-11-15T02:53:37.605082+0000","last_active":"2023-11-15T02:53:37.989867+0000","last_peered":"2023-11-15T02:53:37.989867+0000","last_clean":"2023-11-15T02:53:37.989867+0000","last_became_active":"2023-11-15T02:53:37.604780+0000","last_became_peered":"2023-11-15T02:53:37.604780+0000","last_unstale":"2023-11-15T02:53:37.989867+0000","last_undegraded":"2023-11-15T02:53:37.989867+0000","last_fullsized":"2023-11-15T02:53:37.989867+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.013267+0000","last_change":"2023-11-15T02:53:38.012265+0000","last_active":"2023-11-15T02:53:38.013267+0000","last_peered":"2023-11-15T02:53:38.013267+0000","last_clean":"2023-11-15T02:53:38.013267+0000","last_became_active":"2023-11-15T02:53:38.011882+0000","last_became_peered":"2023-11-15T02:53:38.011882+0000","last_unstale":"2023-11-15T02:53:38.013267+0000","last_undegraded":"2023-11-15T02:53:38.013267+0000","last_fullsized":"2023-11-15T02:53:38.013267+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.991858+0000","last_change":"2023-11-15T02:53:37.604365+0000","last_active":"2023-11-15T02:53:37.991858+0000","last_peered":"2023-11-15T02:53:37.991858+0000","last_clean":"2023-11-15T02:53:37.991858+0000","last_became_active":"2023-11-15T02:53:37.604087+0000","last_became_peered":"2023-11-15T02:53:37.604087+0000","last_unstale":"2023-11-15T02:53:37.991858+0000","last_undegraded":"2023-11-15T02:53:37.991858+0000","last_fullsized":"2023-11-15T02:53:37.991858+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008119+0000","last_change":"2023-11-15T02:53:38.003008+0000","last_active":"2023-11-15T02:53:38.008119+0000","last_peered":"2023-11-15T02:53:38.008119+0000","last_clean":"2023-11-15T02:53:38.008119+0000","last_became_active":"2023-11-15T02:53:38.002701+0000","last_became_peered":"2023-11-15T02:53:38.002701+0000","last_unstale":"2023-11-15T02:53:38.008119+0000","last_undegraded":"2023-11-15T02:53:38.008119+0000","last_fullsized":"2023-11-15T02:53:38.008119+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"195'4","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.000336+0000","last_change":"2023-11-15T02:53:37.608083+0000","last_active":"2023-11-15T02:53:38.000336+0000","last_peered":"2023-11-15T02:53:38.000336+0000","last_clean":"2023-11-15T02:53:38.000336+0000","last_became_active":"2023-11-15T02:53:37.607564+0000","last_became_peered":"2023-11-15T02:53:37.607564+0000","last_unstale":"2023-11-15T02:53:38.000336+0000","last_undegraded":"2023-11-15T02:53:38.000336+0000","last_fullsized":"2023-11-15T02:53:38.000336+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002097+0000","last_change":"2023-11-15T02:53:38.000908+0000","last_active":"2023-11-15T02:53:38.002097+0000","last_peered":"2023-11-15T02:53:38.002097+0000","last_clean":"2023-11-15T02:53:38.002097+0000","last_became_active":"2023-11-15T02:53:38.000211+0000","last_became_peered":"2023-11-15T02:53:38.000211+0000","last_unstale":"2023-11-15T02:53:38.002097+0000","last_undegraded":"2023-11-15T02:53:38.002097+0000","last_fullsized":"2023-11-15T02:53:38.002097+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987749+0000","last_change":"2023-11-15T02:53:37.601064+0000","last_active":"2023-11-15T02:53:37.987749+0000","last_peered":"2023-11-15T02:53:37.987749+0000","last_clean":"2023-11-15T02:53:37.987749+0000","last_became_active":"2023-11-15T02:53:37.600760+0000","last_became_peered":"2023-11-15T02:53:37.600760+0000","last_unstale":"2023-11-15T02:53:37.987749+0000","last_undegraded":"2023-11-15T02:53:37.987749+0000","last_fullsized":"2023-11-15T02:53:37.987749+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.016084+0000","last_change":"2023-11-15T02:53:38.012049+0000","last_active":"2023-11-15T02:53:38.016084+0000","last_peered":"2023-11-15T02:53:38.016084+0000","last_clean":"2023-11-15T02:53:38.016084+0000","last_became_active":"2023-11-15T02:53:38.011349+0000","last_became_peered":"2023-11-15T02:53:38.011349+0000","last_unstale":"2023-11-15T02:53:38.016084+0000","last_undegraded":"2023-11-15T02:53:38.016084+0000","last_fullsized":"2023-11-15T02:53:38.016084+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984955+0000","last_change":"2023-11-15T02:53:37.603600+0000","last_active":"2023-11-15T02:53:37.984955+0000","last_peered":"2023-11-15T02:53:37.984955+0000","last_clean":"2023-11-15T02:53:37.984955+0000","last_became_active":"2023-11-15T02:53:37.603284+0000","last_became_peered":"2023-11-15T02:53:37.603284+0000","last_unstale":"2023-11-15T02:53:37.984955+0000","last_undegraded":"2023-11-15T02:53:37.984955+0000","last_fullsized":"2023-11-15T02:53:37.984955+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002020+0000","last_change":"2023-11-15T02:53:38.000564+0000","last_active":"2023-11-15T02:53:38.002020+0000","last_peered":"2023-11-15T02:53:38.002020+0000","last_clean":"2023-11-15T02:53:38.002020+0000","last_became_active":"2023-11-15T02:53:38.000288+0000","last_became_peered":"2023-11-15T02:53:38.000288+0000","last_unstale":"2023-11-15T02:53:38.002020+0000","last_undegraded":"2023-11-15T02:53:38.002020+0000","last_fullsized":"2023-11-15T02:53:38.002020+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002993+0000","last_change":"2023-11-15T02:53:37.600693+0000","last_active":"2023-11-15T02:53:38.002993+0000","last_peered":"2023-11-15T02:53:38.002993+0000","last_clean":"2023-11-15T02:53:38.002993+0000","last_became_active":"2023-11-15T02:53:37.600356+0000","last_became_peered":"2023-11-15T02:53:37.600356+0000","last_unstale":"2023-11-15T02:53:38.002993+0000","last_undegraded":"2023-11-15T02:53:38.002993+0000","last_fullsized":"2023-11-15T02:53:38.002993+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.007925+0000","last_change":"2023-11-15T02:53:38.004010+0000","last_active":"2023-11-15T02:53:38.007925+0000","last_peered":"2023-11-15T02:53:38.007925+0000","last_clean":"2023-11-15T02:53:38.007925+0000","last_became_active":"2023-11-15T02:53:38.003715+0000","last_became_peered":"2023-11-15T02:53:38.003715+0000","last_unstale":"2023-11-15T02:53:38.007925+0000","last_undegraded":"2023-11-15T02:53:38.007925+0000","last_fullsized":"2023-11-15T02:53:38.007925+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989453+0000","last_change":"2023-11-15T02:53:37.602439+0000","last_active":"2023-11-15T02:53:37.989453+0000","last_peered":"2023-11-15T02:53:37.989453+0000","last_clean":"2023-11-15T02:53:37.989453+0000","last_became_active":"2023-11-15T02:53:37.602154+0000","last_became_peered":"2023-11-15T02:53:37.602154+0000","last_unstale":"2023-11-15T02:53:37.989453+0000","last_undegraded":"2023-11-15T02:53:37.989453+0000","last_fullsized":"2023-11-15T02:53:37.989453+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009800+0000","last_change":"2023-11-15T02:53:38.006153+0000","last_active":"2023-11-15T02:53:38.009800+0000","last_peered":"2023-11-15T02:53:38.009800+0000","last_clean":"2023-11-15T02:53:38.009800+0000","last_became_active":"2023-11-15T02:53:38.005382+0000","last_became_peered":"2023-11-15T02:53:38.005382+0000","last_unstale":"2023-11-15T02:53:38.009800+0000","last_undegraded":"2023-11-15T02:53:38.009800+0000","last_fullsized":"2023-11-15T02:53:38.009800+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002479+0000","last_change":"2023-11-15T02:53:37.600307+0000","last_active":"2023-11-15T02:53:38.002479+0000","last_peered":"2023-11-15T02:53:38.002479+0000","last_clean":"2023-11-15T02:53:38.002479+0000","last_became_active":"2023-11-15T02:53:37.599973+0000","last_became_peered":"2023-11-15T02:53:37.599973+0000","last_unstale":"2023-11-15T02:53:38.002479+0000","last_undegraded":"2023-11-15T02:53:38.002479+0000","last_fullsized":"2023-11-15T02:53:38.002479+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006387+0000","last_change":"2023-11-15T02:53:38.000564+0000","last_active":"2023-11-15T02:53:38.006387+0000","last_peered":"2023-11-15T02:53:38.006387+0000","last_clean":"2023-11-15T02:53:38.006387+0000","last_became_active":"2023-11-15T02:53:38.000275+0000","last_became_peered":"2023-11-15T02:53:38.000275+0000","last_unstale":"2023-11-15T02:53:38.006387+0000","last_undegraded":"2023-11-15T02:53:38.006387+0000","last_fullsized":"2023-11-15T02:53:38.006387+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.993463+0000","last_change":"2023-11-15T02:53:37.607356+0000","last_active":"2023-11-15T02:53:37.993463+0000","last_peered":"2023-11-15T02:53:37.993463+0000","last_clean":"2023-11-15T02:53:37.993463+0000","last_became_active":"2023-11-15T02:53:37.607085+0000","last_became_peered":"2023-11-15T02:53:37.607085+0000","last_unstale":"2023-11-15T02:53:37.993463+0000","last_undegraded":"2023-11-15T02:53:37.993463+0000","last_fullsized":"2023-11-15T02:53:37.993463+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006231+0000","last_change":"2023-11-15T02:53:38.003771+0000","last_active":"2023-11-15T02:53:38.006231+0000","last_peered":"2023-11-15T02:53:38.006231+0000","last_clean":"2023-11-15T02:53:38.006231+0000","last_became_active":"2023-11-15T02:53:38.003121+0000","last_became_peered":"2023-11-15T02:53:38.003121+0000","last_unstale":"2023-11-15T02:53:38.006231+0000","last_undegraded":"2023-11-15T02:53:38.006231+0000","last_fullsized":"2023-11-15T02:53:38.006231+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987451+0000","last_change":"2023-11-15T02:53:37.596686+0000","last_active":"2023-11-15T02:53:37.987451+0000","last_peered":"2023-11-15T02:53:37.987451+0000","last_clean":"2023-11-15T02:53:37.987451+0000","last_became_active":"2023-11-15T02:53:37.596410+0000","last_became_peered":"2023-11-15T02:53:37.596410+0000","last_unstale":"2023-11-15T02:53:37.987451+0000","last_undegraded":"2023-11-15T02:53:37.987451+0000","last_fullsized":"2023-11-15T02:53:37.987451+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011367+0000","last_change":"2023-11-15T02:53:38.010715+0000","last_active":"2023-11-15T02:53:38.011367+0000","last_peered":"2023-11-15T02:53:38.011367+0000","last_clean":"2023-11-15T02:53:38.011367+0000","last_became_active":"2023-11-15T02:53:38.010419+0000","last_became_peered":"2023-11-15T02:53:38.010419+0000","last_unstale":"2023-11-15T02:53:38.011367+0000","last_undegraded":"2023-11-15T02:53:38.011367+0000","last_fullsized":"2023-11-15T02:53:38.011367+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989838+0000","last_change":"2023-11-15T02:53:37.600629+0000","last_active":"2023-11-15T02:53:37.989838+0000","last_peered":"2023-11-15T02:53:37.989838+0000","last_clean":"2023-11-15T02:53:37.989838+0000","last_became_active":"2023-11-15T02:53:37.600331+0000","last_became_peered":"2023-11-15T02:53:37.600331+0000","last_unstale":"2023-11-15T02:53:37.989838+0000","last_undegraded":"2023-11-15T02:53:37.989838+0000","last_fullsized":"2023-11-15T02:53:37.989838+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999239+0000","last_change":"2023-11-15T02:53:37.994959+0000","last_active":"2023-11-15T02:53:37.999239+0000","last_peered":"2023-11-15T02:53:37.999239+0000","last_clean":"2023-11-15T02:53:37.999239+0000","last_became_active":"2023-11-15T02:53:37.994284+0000","last_became_peered":"2023-11-15T02:53:37.994284+0000","last_unstale":"2023-11-15T02:53:37.999239+0000","last_undegraded":"2023-11-15T02:53:37.999239+0000","last_fullsized":"2023-11-15T02:53:37.999239+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.997791+0000","last_change":"2023-11-15T02:53:37.600152+0000","last_active":"2023-11-15T02:53:37.997791+0000","last_peered":"2023-11-15T02:53:37.997791+0000","last_clean":"2023-11-15T02:53:37.997791+0000","last_became_active":"2023-11-15T02:53:37.599885+0000","last_became_peered":"2023-11-15T02:53:37.599885+0000","last_unstale":"2023-11-15T02:53:37.997791+0000","last_undegraded":"2023-11-15T02:53:37.997791+0000","last_fullsized":"2023-11-15T02:53:37.997791+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009330+0000","last_change":"2023-11-15T02:53:38.003735+0000","last_active":"2023-11-15T02:53:38.009330+0000","last_peered":"2023-11-15T02:53:38.009330+0000","last_clean":"2023-11-15T02:53:38.009330+0000","last_became_active":"2023-11-15T02:53:38.003432+0000","last_became_peered":"2023-11-15T02:53:38.003432+0000","last_unstale":"2023-11-15T02:53:38.009330+0000","last_undegraded":"2023-11-15T02:53:38.009330+0000","last_fullsized":"2023-11-15T02:53:38.009330+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.982577+0000","last_change":"2023-11-15T02:53:37.608038+0000","last_active":"2023-11-15T02:53:37.982577+0000","last_peered":"2023-11-15T02:53:37.982577+0000","last_clean":"2023-11-15T02:53:37.982577+0000","last_became_active":"2023-11-15T02:53:37.607545+0000","last_became_peered":"2023-11-15T02:53:37.607545+0000","last_unstale":"2023-11-15T02:53:37.982577+0000","last_undegraded":"2023-11-15T02:53:37.982577+0000","last_fullsized":"2023-11-15T02:53:37.982577+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005747+0000","last_change":"2023-11-15T02:53:38.000626+0000","last_active":"2023-11-15T02:53:38.005747+0000","last_peered":"2023-11-15T02:53:38.005747+0000","last_clean":"2023-11-15T02:53:38.005747+0000","last_became_active":"2023-11-15T02:53:38.000346+0000","last_became_peered":"2023-11-15T02:53:38.000346+0000","last_unstale":"2023-11-15T02:53:38.005747+0000","last_undegraded":"2023-11-15T02:53:38.005747+0000","last_fullsized":"2023-11-15T02:53:38.005747+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999272+0000","last_change":"2023-11-15T02:53:37.602774+0000","last_active":"2023-11-15T02:53:37.999272+0000","last_peered":"2023-11-15T02:53:37.999272+0000","last_clean":"2023-11-15T02:53:37.999272+0000","last_became_active":"2023-11-15T02:53:37.602261+0000","last_became_peered":"2023-11-15T02:53:37.602261+0000","last_unstale":"2023-11-15T02:53:37.999272+0000","last_undegraded":"2023-11-15T02:53:37.999272+0000","last_fullsized":"2023-11-15T02:53:37.999272+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005731+0000","last_change":"2023-11-15T02:53:38.004561+0000","last_active":"2023-11-15T02:53:38.005731+0000","last_peered":"2023-11-15T02:53:38.005731+0000","last_clean":"2023-11-15T02:53:38.005731+0000","last_became_active":"2023-11-15T02:53:38.004279+0000","last_became_peered":"2023-11-15T02:53:38.004279+0000","last_unstale":"2023-11-15T02:53:38.005731+0000","last_undegraded":"2023-11-15T02:53:38.005731+0000","last_fullsized":"2023-11-15T02:53:38.005731+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998408+0000","last_change":"2023-11-15T02:53:37.606814+0000","last_active":"2023-11-15T02:53:37.998408+0000","last_peered":"2023-11-15T02:53:37.998408+0000","last_clean":"2023-11-15T02:53:37.998408+0000","last_became_active":"2023-11-15T02:53:37.606517+0000","last_became_peered":"2023-11-15T02:53:37.606517+0000","last_unstale":"2023-11-15T02:53:37.998408+0000","last_undegraded":"2023-11-15T02:53:37.998408+0000","last_fullsized":"2023-11-15T02:53:37.998408+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002264+0000","last_change":"2023-11-15T02:53:37.998598+0000","last_active":"2023-11-15T02:53:38.002264+0000","last_peered":"2023-11-15T02:53:38.002264+0000","last_clean":"2023-11-15T02:53:38.002264+0000","last_became_active":"2023-11-15T02:53:37.998240+0000","last_became_peered":"2023-11-15T02:53:37.998240+0000","last_unstale":"2023-11-15T02:53:38.002264+0000","last_undegraded":"2023-11-15T02:53:38.002264+0000","last_fullsized":"2023-11-15T02:53:38.002264+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989840+0000","last_change":"2023-11-15T02:53:37.603875+0000","last_active":"2023-11-15T02:53:37.989840+0000","last_peered":"2023-11-15T02:53:37.989840+0000","last_clean":"2023-11-15T02:53:37.989840+0000","last_became_active":"2023-11-15T02:53:37.603204+0000","last_became_peered":"2023-11-15T02:53:37.603204+0000","last_unstale":"2023-11-15T02:53:37.989840+0000","last_undegraded":"2023-11-15T02:53:37.989840+0000","last_fullsized":"2023-11-15T02:53:37.989840+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010801+0000","last_change":"2023-11-15T02:53:38.009250+0000","last_active":"2023-11-15T02:53:38.010801+0000","last_peered":"2023-11-15T02:53:38.010801+0000","last_clean":"2023-11-15T02:53:38.010801+0000","last_became_active":"2023-11-15T02:53:38.009018+0000","last_became_peered":"2023-11-15T02:53:38.009018+0000","last_unstale":"2023-11-15T02:53:38.010801+0000","last_undegraded":"2023-11-15T02:53:38.010801+0000","last_fullsized":"2023-11-15T02:53:38.010801+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.986167+0000","last_change":"2023-11-15T02:53:37.604578+0000","last_active":"2023-11-15T02:53:37.986167+0000","last_peered":"2023-11-15T02:53:37.986167+0000","last_clean":"2023-11-15T02:53:37.986167+0000","last_became_active":"2023-11-15T02:53:37.604300+0000","last_became_peered":"2023-11-15T02:53:37.604300+0000","last_unstale":"2023-11-15T02:53:37.986167+0000","last_undegraded":"2023-11-15T02:53:37.986167+0000","last_fullsized":"2023-11-15T02:53:37.986167+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010581+0000","last_change":"2023-11-15T02:53:38.005419+0000","last_active":"2023-11-15T02:53:38.010581+0000","last_peered":"2023-11-15T02:53:38.010581+0000","last_clean":"2023-11-15T02:53:38.010581+0000","last_became_active":"2023-11-15T02:53:38.005121+0000","last_became_peered":"2023-11-15T02:53:38.005121+0000","last_unstale":"2023-11-15T02:53:38.010581+0000","last_undegraded":"2023-11-15T02:53:38.010581+0000","last_fullsized":"2023-11-15T02:53:38.010581+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.986004+0000","last_change":"2023-11-15T02:53:37.608032+0000","last_active":"2023-11-15T02:53:37.986004+0000","last_peered":"2023-11-15T02:53:37.986004+0000","last_clean":"2023-11-15T02:53:37.986004+0000","last_became_active":"2023-11-15T02:53:37.607639+0000","last_became_peered":"2023-11-15T02:53:37.607639+0000","last_unstale":"2023-11-15T02:53:37.986004+0000","last_undegraded":"2023-11-15T02:53:37.986004+0000","last_fullsized":"2023-11-15T02:53:37.986004+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009389+0000","last_change":"2023-11-15T02:53:38.008531+0000","last_active":"2023-11-15T02:53:38.009389+0000","last_peered":"2023-11-15T02:53:38.009389+0000","last_clean":"2023-11-15T02:53:38.009389+0000","last_became_active":"2023-11-15T02:53:38.008308+0000","last_became_peered":"2023-11-15T02:53:38.008308+0000","last_unstale":"2023-11-15T02:53:38.009389+0000","last_undegraded":"2023-11-15T02:53:38.009389+0000","last_fullsized":"2023-11-15T02:53:38.009389+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984117+0000","last_change":"2023-11-15T02:53:37.603697+0000","last_active":"2023-11-15T02:53:37.984117+0000","last_peered":"2023-11-15T02:53:37.984117+0000","last_clean":"2023-11-15T02:53:37.984117+0000","last_became_active":"2023-11-15T02:53:37.603383+0000","last_became_peered":"2023-11-15T02:53:37.603383+0000","last_unstale":"2023-11-15T02:53:37.984117+0000","last_undegraded":"2023-11-15T02:53:37.984117+0000","last_fullsized":"2023-11-15T02:53:37.984117+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009909+0000","last_change":"2023-11-15T02:53:38.006412+0000","last_active":"2023-11-15T02:53:38.009909+0000","last_peered":"2023-11-15T02:53:38.009909+0000","last_clean":"2023-11-15T02:53:38.009909+0000","last_became_active":"2023-11-15T02:53:38.006097+0000","last_became_peered":"2023-11-15T02:53:38.006097+0000","last_unstale":"2023-11-15T02:53:38.009909+0000","last_undegraded":"2023-11-15T02:53:38.009909+0000","last_fullsized":"2023-11-15T02:53:38.009909+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999987+0000","last_change":"2023-11-15T02:53:37.605820+0000","last_active":"2023-11-15T02:53:37.999987+0000","last_peered":"2023-11-15T02:53:37.999987+0000","last_clean":"2023-11-15T02:53:37.999987+0000","last_became_active":"2023-11-15T02:53:37.605501+0000","last_became_peered":"2023-11-15T02:53:37.605501+0000","last_unstale":"2023-11-15T02:53:37.999987+0000","last_undegraded":"2023-11-15T02:53:37.999987+0000","last_fullsized":"2023-11-15T02:53:37.999987+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006092+0000","last_change":"2023-11-15T02:53:38.004891+0000","last_active":"2023-11-15T02:53:38.006092+0000","last_peered":"2023-11-15T02:53:38.006092+0000","last_clean":"2023-11-15T02:53:38.006092+0000","last_became_active":"2023-11-15T02:53:38.004627+0000","last_became_peered":"2023-11-15T02:53:38.004627+0000","last_unstale":"2023-11-15T02:53:38.006092+0000","last_undegraded":"2023-11-15T02:53:38.006092+0000","last_fullsized":"2023-11-15T02:53:38.006092+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003886+0000","last_change":"2023-11-15T02:53:37.607870+0000","last_active":"2023-11-15T02:53:38.003886+0000","last_peered":"2023-11-15T02:53:38.003886+0000","last_clean":"2023-11-15T02:53:38.003886+0000","last_became_active":"2023-11-15T02:53:37.607197+0000","last_became_peered":"2023-11-15T02:53:37.607197+0000","last_unstale":"2023-11-15T02:53:38.003886+0000","last_undegraded":"2023-11-15T02:53:38.003886+0000","last_fullsized":"2023-11-15T02:53:38.003886+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998637+0000","last_change":"2023-11-15T02:53:37.991469+0000","last_active":"2023-11-15T02:53:37.998637+0000","last_peered":"2023-11-15T02:53:37.998637+0000","last_clean":"2023-11-15T02:53:37.998637+0000","last_became_active":"2023-11-15T02:53:37.991176+0000","last_became_peered":"2023-11-15T02:53:37.991176+0000","last_unstale":"2023-11-15T02:53:37.998637+0000","last_undegraded":"2023-11-15T02:53:37.998637+0000","last_fullsized":"2023-11-15T02:53:37.998637+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009368+0000","last_change":"2023-11-15T02:53:37.602556+0000","last_active":"2023-11-15T02:53:38.009368+0000","last_peered":"2023-11-15T02:53:38.009368+0000","last_clean":"2023-11-15T02:53:38.009368+0000","last_became_active":"2023-11-15T02:53:37.601820+0000","last_became_peered":"2023-11-15T02:53:37.601820+0000","last_unstale":"2023-11-15T02:53:38.009368+0000","last_undegraded":"2023-11-15T02:53:38.009368+0000","last_fullsized":"2023-11-15T02:53:38.009368+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010539+0000","last_change":"2023-11-15T02:53:38.005868+0000","last_active":"2023-11-15T02:53:38.010539+0000","last_peered":"2023-11-15T02:53:38.010539+0000","last_clean":"2023-11-15T02:53:38.010539+0000","last_became_active":"2023-11-15T02:53:38.005558+0000","last_became_peered":"2023-11-15T02:53:38.005558+0000","last_unstale":"2023-11-15T02:53:38.010539+0000","last_undegraded":"2023-11-15T02:53:38.010539+0000","last_fullsized":"2023-11-15T02:53:38.010539+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987451+0000","last_change":"2023-11-15T02:53:37.601130+0000","last_active":"2023-11-15T02:53:37.987451+0000","last_peered":"2023-11-15T02:53:37.987451+0000","last_clean":"2023-11-15T02:53:37.987451+0000","last_became_active":"2023-11-15T02:53:37.600820+0000","last_became_peered":"2023-11-15T02:53:37.600820+0000","last_unstale":"2023-11-15T02:53:37.987451+0000","last_undegraded":"2023-11-15T02:53:37.987451+0000","last_fullsized":"2023-11-15T02:53:37.987451+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003379+0000","last_change":"2023-11-15T02:53:38.001102+0000","last_active":"2023-11-15T02:53:38.003379+0000","last_peered":"2023-11-15T02:53:38.003379+0000","last_clean":"2023-11-15T02:53:38.003379+0000","last_became_active":"2023-11-15T02:53:38.000814+0000","last_became_peered":"2023-11-15T02:53:38.000814+0000","last_unstale":"2023-11-15T02:53:38.003379+0000","last_undegraded":"2023-11-15T02:53:38.003379+0000","last_fullsized":"2023-11-15T02:53:38.003379+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998161+0000","last_change":"2023-11-15T02:53:37.609358+0000","last_active":"2023-11-15T02:53:37.998161+0000","last_peered":"2023-11-15T02:53:37.998161+0000","last_clean":"2023-11-15T02:53:37.998161+0000","last_became_active":"2023-11-15T02:53:37.608596+0000","last_became_peered":"2023-11-15T02:53:37.608596+0000","last_unstale":"2023-11-15T02:53:37.998161+0000","last_undegraded":"2023-11-15T02:53:37.998161+0000","last_fullsized":"2023-11-15T02:53:37.998161+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.995398+0000","last_change":"2023-11-15T02:53:37.993686+0000","last_active":"2023-11-15T02:53:37.995398+0000","last_peered":"2023-11-15T02:53:37.995398+0000","last_clean":"2023-11-15T02:53:37.995398+0000","last_became_active":"2023-11-15T02:53:37.993388+0000","last_became_peered":"2023-11-15T02:53:37.993388+0000","last_unstale":"2023-11-15T02:53:37.995398+0000","last_undegraded":"2023-11-15T02:53:37.995398+0000","last_fullsized":"2023-11-15T02:53:37.995398+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.982323+0000","last_change":"2023-11-15T02:53:37.607029+0000","last_active":"2023-11-15T02:53:37.982323+0000","last_peered":"2023-11-15T02:53:37.982323+0000","last_clean":"2023-11-15T02:53:37.982323+0000","last_became_active":"2023-11-15T02:53:37.606692+0000","last_became_peered":"2023-11-15T02:53:37.606692+0000","last_unstale":"2023-11-15T02:53:37.982323+0000","last_undegraded":"2023-11-15T02:53:37.982323+0000","last_fullsized":"2023-11-15T02:53:37.982323+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006246+0000","last_change":"2023-11-15T02:53:38.003944+0000","last_active":"2023-11-15T02:53:38.006246+0000","last_peered":"2023-11-15T02:53:38.006246+0000","last_clean":"2023-11-15T02:53:38.006246+0000","last_became_active":"2023-11-15T02:53:38.003507+0000","last_became_peered":"2023-11-15T02:53:38.003507+0000","last_unstale":"2023-11-15T02:53:38.006246+0000","last_undegraded":"2023-11-15T02:53:38.006246+0000","last_fullsized":"2023-11-15T02:53:38.006246+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987342+0000","last_change":"2023-11-15T02:53:37.609959+0000","last_active":"2023-11-15T02:53:37.987342+0000","last_peered":"2023-11-15T02:53:37.987342+0000","last_clean":"2023-11-15T02:53:37.987342+0000","last_became_active":"2023-11-15T02:53:37.609646+0000","last_became_peered":"2023-11-15T02:53:37.609646+0000","last_unstale":"2023-11-15T02:53:37.987342+0000","last_undegraded":"2023-11-15T02:53:37.987342+0000","last_fullsized":"2023-11-15T02:53:37.987342+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008553+0000","last_change":"2023-11-15T02:53:38.007038+0000","last_active":"2023-11-15T02:53:38.008553+0000","last_peered":"2023-11-15T02:53:38.008553+0000","last_clean":"2023-11-15T02:53:38.008553+0000","last_became_active":"2023-11-15T02:53:38.006729+0000","last_became_peered":"2023-11-15T02:53:38.006729+0000","last_unstale":"2023-11-15T02:53:38.008553+0000","last_undegraded":"2023-11-15T02:53:38.008553+0000","last_fullsized":"2023-11-15T02:53:38.008553+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.996205+0000","last_change":"2023-11-15T02:53:37.606243+0000","last_active":"2023-11-15T02:53:37.996205+0000","last_peered":"2023-11-15T02:53:37.996205+0000","last_clean":"2023-11-15T02:53:37.996205+0000","last_became_active":"2023-11-15T02:53:37.605925+0000","last_became_peered":"2023-11-15T02:53:37.605925+0000","last_unstale":"2023-11-15T02:53:37.996205+0000","last_undegraded":"2023-11-15T02:53:37.996205+0000","last_fullsized":"2023-11-15T02:53:37.996205+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005006+0000","last_change":"2023-11-15T02:53:38.002861+0000","last_active":"2023-11-15T02:53:38.005006+0000","last_peered":"2023-11-15T02:53:38.005006+0000","last_clean":"2023-11-15T02:53:38.005006+0000","last_became_active":"2023-11-15T02:53:38.002540+0000","last_became_peered":"2023-11-15T02:53:38.002540+0000","last_unstale":"2023-11-15T02:53:38.005006+0000","last_undegraded":"2023-11-15T02:53:38.005006+0000","last_fullsized":"2023-11-15T02:53:38.005006+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.004585+0000","last_change":"2023-11-15T02:53:37.607128+0000","last_active":"2023-11-15T02:53:38.004585+0000","last_peered":"2023-11-15T02:53:38.004585+0000","last_clean":"2023-11-15T02:53:38.004585+0000","last_became_active":"2023-11-15T02:53:37.606792+0000","last_became_peered":"2023-11-15T02:53:37.606792+0000","last_unstale":"2023-11-15T02:53:38.004585+0000","last_undegraded":"2023-11-15T02:53:38.004585+0000","last_fullsized":"2023-11-15T02:53:38.004585+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.016079+0000","last_change":"2023-11-15T02:53:38.012509+0000","last_active":"2023-11-15T02:53:38.016079+0000","last_peered":"2023-11-15T02:53:38.016079+0000","last_clean":"2023-11-15T02:53:38.016079+0000","last_became_active":"2023-11-15T02:53:38.011598+0000","last_became_peered":"2023-11-15T02:53:38.011598+0000","last_unstale":"2023-11-15T02:53:38.016079+0000","last_undegraded":"2023-11-15T02:53:38.016079+0000","last_fullsized":"2023-11-15T02:53:38.016079+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006720+0000","last_change":"2023-11-15T02:53:37.605340+0000","last_active":"2023-11-15T02:53:38.006720+0000","last_peered":"2023-11-15T02:53:38.006720+0000","last_clean":"2023-11-15T02:53:38.006720+0000","last_became_active":"2023-11-15T02:53:37.604736+0000","last_became_peered":"2023-11-15T02:53:37.604736+0000","last_unstale":"2023-11-15T02:53:38.006720+0000","last_undegraded":"2023-11-15T02:53:38.006720+0000","last_fullsized":"2023-11-15T02:53:38.006720+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009363+0000","last_change":"2023-11-15T02:53:38.004869+0000","last_active":"2023-11-15T02:53:38.009363+0000","last_peered":"2023-11-15T02:53:38.009363+0000","last_clean":"2023-11-15T02:53:38.009363+0000","last_became_active":"2023-11-15T02:53:38.004603+0000","last_became_peered":"2023-11-15T02:53:38.004603+0000","last_unstale":"2023-11-15T02:53:38.009363+0000","last_undegraded":"2023-11-15T02:53:38.009363+0000","last_fullsized":"2023-11-15T02:53:38.009363+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.982661+0000","last_change":"2023-11-15T02:53:37.599911+0000","last_active":"2023-11-15T02:53:37.982661+0000","last_peered":"2023-11-15T02:53:37.982661+0000","last_clean":"2023-11-15T02:53:37.982661+0000","last_became_active":"2023-11-15T02:53:37.599611+0000","last_became_peered":"2023-11-15T02:53:37.599611+0000","last_unstale":"2023-11-15T02:53:37.982661+0000","last_undegraded":"2023-11-15T02:53:37.982661+0000","last_fullsized":"2023-11-15T02:53:37.982661+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011156+0000","last_change":"2023-11-15T02:53:38.006173+0000","last_active":"2023-11-15T02:53:38.011156+0000","last_peered":"2023-11-15T02:53:38.011156+0000","last_clean":"2023-11-15T02:53:38.011156+0000","last_became_active":"2023-11-15T02:53:38.005873+0000","last_became_peered":"2023-11-15T02:53:38.005873+0000","last_unstale":"2023-11-15T02:53:38.011156+0000","last_undegraded":"2023-11-15T02:53:38.011156+0000","last_fullsized":"2023-11-15T02:53:38.011156+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998518+0000","last_change":"2023-11-15T02:53:37.609046+0000","last_active":"2023-11-15T02:53:37.998518+0000","last_peered":"2023-11-15T02:53:37.998518+0000","last_clean":"2023-11-15T02:53:37.998518+0000","last_became_active":"2023-11-15T02:53:37.608665+0000","last_became_peered":"2023-11-15T02:53:37.608665+0000","last_unstale":"2023-11-15T02:53:37.998518+0000","last_undegraded":"2023-11-15T02:53:37.998518+0000","last_fullsized":"2023-11-15T02:53:37.998518+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009819+0000","last_change":"2023-11-15T02:53:38.006320+0000","last_active":"2023-11-15T02:53:38.009819+0000","last_peered":"2023-11-15T02:53:38.009819+0000","last_clean":"2023-11-15T02:53:38.009819+0000","last_became_active":"2023-11-15T02:53:38.005786+0000","last_became_peered":"2023-11-15T02:53:38.005786+0000","last_unstale":"2023-11-15T02:53:38.009819+0000","last_undegraded":"2023-11-15T02:53:38.009819+0000","last_fullsized":"2023-11-15T02:53:38.009819+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001944+0000","last_change":"2023-11-15T02:53:37.599390+0000","last_active":"2023-11-15T02:53:38.001944+0000","last_peered":"2023-11-15T02:53:38.001944+0000","last_clean":"2023-11-15T02:53:38.001944+0000","last_became_active":"2023-11-15T02:53:37.598476+0000","last_became_peered":"2023-11-15T02:53:37.598476+0000","last_unstale":"2023-11-15T02:53:38.001944+0000","last_undegraded":"2023-11-15T02:53:38.001944+0000","last_fullsized":"2023-11-15T02:53:38.001944+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009422+0000","last_change":"2023-11-15T02:53:38.005651+0000","last_active":"2023-11-15T02:53:38.009422+0000","last_peered":"2023-11-15T02:53:38.009422+0000","last_clean":"2023-11-15T02:53:38.009422+0000","last_became_active":"2023-11-15T02:53:38.005405+0000","last_became_peered":"2023-11-15T02:53:38.005405+0000","last_unstale":"2023-11-15T02:53:38.009422+0000","last_undegraded":"2023-11-15T02:53:38.009422+0000","last_fullsized":"2023-11-15T02:53:38.009422+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.996886+0000","last_change":"2023-11-15T02:53:37.603759+0000","last_active":"2023-11-15T02:53:37.996886+0000","last_peered":"2023-11-15T02:53:37.996886+0000","last_clean":"2023-11-15T02:53:37.996886+0000","last_became_active":"2023-11-15T02:53:37.603485+0000","last_became_peered":"2023-11-15T02:53:37.603485+0000","last_unstale":"2023-11-15T02:53:37.996886+0000","last_undegraded":"2023-11-15T02:53:37.996886+0000","last_fullsized":"2023-11-15T02:53:37.996886+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999205+0000","last_change":"2023-11-15T02:53:37.998244+0000","last_active":"2023-11-15T02:53:37.999205+0000","last_peered":"2023-11-15T02:53:37.999205+0000","last_clean":"2023-11-15T02:53:37.999205+0000","last_became_active":"2023-11-15T02:53:37.997925+0000","last_became_peered":"2023-11-15T02:53:37.997925+0000","last_unstale":"2023-11-15T02:53:37.999205+0000","last_undegraded":"2023-11-15T02:53:37.999205+0000","last_fullsized":"2023-11-15T02:53:37.999205+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987621+0000","last_change":"2023-11-15T02:53:37.595509+0000","last_active":"2023-11-15T02:53:37.987621+0000","last_peered":"2023-11-15T02:53:37.987621+0000","last_clean":"2023-11-15T02:53:37.987621+0000","last_became_active":"2023-11-15T02:53:37.595150+0000","last_became_peered":"2023-11-15T02:53:37.595150+0000","last_unstale":"2023-11-15T02:53:37.987621+0000","last_undegraded":"2023-11-15T02:53:37.987621+0000","last_fullsized":"2023-11-15T02:53:37.987621+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006014+0000","last_change":"2023-11-15T02:53:37.998617+0000","last_active":"2023-11-15T02:53:38.006014+0000","last_peered":"2023-11-15T02:53:38.006014+0000","last_clean":"2023-11-15T02:53:38.006014+0000","last_became_active":"2023-11-15T02:53:37.998336+0000","last_became_peered":"2023-11-15T02:53:37.998336+0000","last_unstale":"2023-11-15T02:53:38.006014+0000","last_undegraded":"2023-11-15T02:53:38.006014+0000","last_fullsized":"2023-11-15T02:53:38.006014+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992794+0000","last_change":"2023-11-15T02:53:37.605177+0000","last_active":"2023-11-15T02:53:37.992794+0000","last_peered":"2023-11-15T02:53:37.992794+0000","last_clean":"2023-11-15T02:53:37.992794+0000","last_became_active":"2023-11-15T02:53:37.604785+0000","last_became_peered":"2023-11-15T02:53:37.604785+0000","last_unstale":"2023-11-15T02:53:37.992794+0000","last_undegraded":"2023-11-15T02:53:37.992794+0000","last_fullsized":"2023-11-15T02:53:37.992794+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009156+0000","last_change":"2023-11-15T02:53:38.005499+0000","last_active":"2023-11-15T02:53:38.009156+0000","last_peered":"2023-11-15T02:53:38.009156+0000","last_clean":"2023-11-15T02:53:38.009156+0000","last_became_active":"2023-11-15T02:53:38.005211+0000","last_became_peered":"2023-11-15T02:53:38.005211+0000","last_unstale":"2023-11-15T02:53:38.009156+0000","last_undegraded":"2023-11-15T02:53:38.009156+0000","last_fullsized":"2023-11-15T02:53:38.009156+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005286+0000","last_change":"2023-11-15T02:53:37.593975+0000","last_active":"2023-11-15T02:53:38.005286+0000","last_peered":"2023-11-15T02:53:38.005286+0000","last_clean":"2023-11-15T02:53:38.005286+0000","last_became_active":"2023-11-15T02:53:37.593701+0000","last_became_peered":"2023-11-15T02:53:37.593701+0000","last_unstale":"2023-11-15T02:53:38.005286+0000","last_undegraded":"2023-11-15T02:53:38.005286+0000","last_fullsized":"2023-11-15T02:53:38.005286+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003057+0000","last_change":"2023-11-15T02:53:37.998034+0000","last_active":"2023-11-15T02:53:38.003057+0000","last_peered":"2023-11-15T02:53:38.003057+0000","last_clean":"2023-11-15T02:53:38.003057+0000","last_became_active":"2023-11-15T02:53:37.997729+0000","last_became_peered":"2023-11-15T02:53:37.997729+0000","last_unstale":"2023-11-15T02:53:38.003057+0000","last_undegraded":"2023-11-15T02:53:38.003057+0000","last_fullsized":"2023-11-15T02:53:38.003057+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.985057+0000","last_change":"2023-11-15T02:53:37.610489+0000","last_active":"2023-11-15T02:53:37.985057+0000","last_peered":"2023-11-15T02:53:37.985057+0000","last_clean":"2023-11-15T02:53:37.985057+0000","last_became_active":"2023-11-15T02:53:37.610002+0000","last_became_peered":"2023-11-15T02:53:37.610002+0000","last_unstale":"2023-11-15T02:53:37.985057+0000","last_undegraded":"2023-11-15T02:53:37.985057+0000","last_fullsized":"2023-11-15T02:53:37.985057+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002358+0000","last_change":"2023-11-15T02:53:38.000481+0000","last_active":"2023-11-15T02:53:38.002358+0000","last_peered":"2023-11-15T02:53:38.002358+0000","last_clean":"2023-11-15T02:53:38.002358+0000","last_became_active":"2023-11-15T02:53:38.000196+0000","last_became_peered":"2023-11-15T02:53:38.000196+0000","last_unstale":"2023-11-15T02:53:38.002358+0000","last_undegraded":"2023-11-15T02:53:38.002358+0000","last_fullsized":"2023-11-15T02:53:38.002358+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984215+0000","last_change":"2023-11-15T02:53:37.601783+0000","last_active":"2023-11-15T02:53:37.984215+0000","last_peered":"2023-11-15T02:53:37.984215+0000","last_clean":"2023-11-15T02:53:37.984215+0000","last_became_active":"2023-11-15T02:53:37.601473+0000","last_became_peered":"2023-11-15T02:53:37.601473+0000","last_unstale":"2023-11-15T02:53:37.984215+0000","last_undegraded":"2023-11-15T02:53:37.984215+0000","last_fullsized":"2023-11-15T02:53:37.984215+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002345+0000","last_change":"2023-11-15T02:53:37.997031+0000","last_active":"2023-11-15T02:53:38.002345+0000","last_peered":"2023-11-15T02:53:38.002345+0000","last_clean":"2023-11-15T02:53:38.002345+0000","last_became_active":"2023-11-15T02:53:37.996771+0000","last_became_peered":"2023-11-15T02:53:37.996771+0000","last_unstale":"2023-11-15T02:53:38.002345+0000","last_undegraded":"2023-11-15T02:53:38.002345+0000","last_fullsized":"2023-11-15T02:53:38.002345+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987557+0000","last_change":"2023-11-15T02:53:37.603411+0000","last_active":"2023-11-15T02:53:37.987557+0000","last_peered":"2023-11-15T02:53:37.987557+0000","last_clean":"2023-11-15T02:53:37.987557+0000","last_became_active":"2023-11-15T02:53:37.603095+0000","last_became_peered":"2023-11-15T02:53:37.603095+0000","last_unstale":"2023-11-15T02:53:37.987557+0000","last_undegraded":"2023-11-15T02:53:37.987557+0000","last_fullsized":"2023-11-15T02:53:37.987557+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.000207+0000","last_change":"2023-11-15T02:53:37.992925+0000","last_active":"2023-11-15T02:53:38.000207+0000","last_peered":"2023-11-15T02:53:38.000207+0000","last_clean":"2023-11-15T02:53:38.000207+0000","last_became_active":"2023-11-15T02:53:37.991495+0000","last_became_peered":"2023-11-15T02:53:37.991495+0000","last_unstale":"2023-11-15T02:53:38.000207+0000","last_undegraded":"2023-11-15T02:53:38.000207+0000","last_fullsized":"2023-11-15T02:53:38.000207+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.986519+0000","last_change":"2023-11-15T02:53:37.602735+0000","last_active":"2023-11-15T02:53:37.986519+0000","last_peered":"2023-11-15T02:53:37.986519+0000","last_clean":"2023-11-15T02:53:37.986519+0000","last_became_active":"2023-11-15T02:53:37.602437+0000","last_became_peered":"2023-11-15T02:53:37.602437+0000","last_unstale":"2023-11-15T02:53:37.986519+0000","last_undegraded":"2023-11-15T02:53:37.986519+0000","last_fullsized":"2023-11-15T02:53:37.986519+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010619+0000","last_change":"2023-11-15T02:53:38.006525+0000","last_active":"2023-11-15T02:53:38.010619+0000","last_peered":"2023-11-15T02:53:38.010619+0000","last_clean":"2023-11-15T02:53:38.010619+0000","last_became_active":"2023-11-15T02:53:38.006118+0000","last_became_peered":"2023-11-15T02:53:38.006118+0000","last_unstale":"2023-11-15T02:53:38.010619+0000","last_undegraded":"2023-11-15T02:53:38.010619+0000","last_fullsized":"2023-11-15T02:53:38.010619+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.985276+0000","last_change":"2023-11-15T02:53:37.604591+0000","last_active":"2023-11-15T02:53:37.985276+0000","last_peered":"2023-11-15T02:53:37.985276+0000","last_clean":"2023-11-15T02:53:37.985276+0000","last_became_active":"2023-11-15T02:53:37.604050+0000","last_became_peered":"2023-11-15T02:53:37.604050+0000","last_unstale":"2023-11-15T02:53:37.985276+0000","last_undegraded":"2023-11-15T02:53:37.985276+0000","last_fullsized":"2023-11-15T02:53:37.985276+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009789+0000","last_change":"2023-11-15T02:53:38.005163+0000","last_active":"2023-11-15T02:53:38.009789+0000","last_peered":"2023-11-15T02:53:38.009789+0000","last_clean":"2023-11-15T02:53:38.009789+0000","last_became_active":"2023-11-15T02:53:38.004858+0000","last_became_peered":"2023-11-15T02:53:38.004858+0000","last_unstale":"2023-11-15T02:53:38.009789+0000","last_undegraded":"2023-11-15T02:53:38.009789+0000","last_fullsized":"2023-11-15T02:53:38.009789+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001263+0000","last_change":"2023-11-15T02:53:37.603691+0000","last_active":"2023-11-15T02:53:38.001263+0000","last_peered":"2023-11-15T02:53:38.001263+0000","last_clean":"2023-11-15T02:53:38.001263+0000","last_became_active":"2023-11-15T02:53:37.603376+0000","last_became_peered":"2023-11-15T02:53:37.603376+0000","last_unstale":"2023-11-15T02:53:38.001263+0000","last_undegraded":"2023-11-15T02:53:38.001263+0000","last_fullsized":"2023-11-15T02:53:38.001263+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009156+0000","last_change":"2023-11-15T02:53:38.007691+0000","last_active":"2023-11-15T02:53:38.009156+0000","last_peered":"2023-11-15T02:53:38.009156+0000","last_clean":"2023-11-15T02:53:38.009156+0000","last_became_active":"2023-11-15T02:53:38.007438+0000","last_became_peered":"2023-11-15T02:53:38.007438+0000","last_unstale":"2023-11-15T02:53:38.009156+0000","last_undegraded":"2023-11-15T02:53:38.009156+0000","last_fullsized":"2023-11-15T02:53:38.009156+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.981762+0000","last_change":"2023-11-15T02:53:37.607898+0000","last_active":"2023-11-15T02:53:37.981762+0000","last_peered":"2023-11-15T02:53:37.981762+0000","last_clean":"2023-11-15T02:53:37.981762+0000","last_became_active":"2023-11-15T02:53:37.607133+0000","last_became_peered":"2023-11-15T02:53:37.607133+0000","last_unstale":"2023-11-15T02:53:37.981762+0000","last_undegraded":"2023-11-15T02:53:37.981762+0000","last_fullsized":"2023-11-15T02:53:37.981762+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010798+0000","last_change":"2023-11-15T02:53:38.009352+0000","last_active":"2023-11-15T02:53:38.010798+0000","last_peered":"2023-11-15T02:53:38.010798+0000","last_clean":"2023-11-15T02:53:38.010798+0000","last_became_active":"2023-11-15T02:53:38.007690+0000","last_became_peered":"2023-11-15T02:53:38.007690+0000","last_unstale":"2023-11-15T02:53:38.010798+0000","last_undegraded":"2023-11-15T02:53:38.010798+0000","last_fullsized":"2023-11-15T02:53:38.010798+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003527+0000","last_change":"2023-11-15T02:53:37.607389+0000","last_active":"2023-11-15T02:53:38.003527+0000","last_peered":"2023-11-15T02:53:38.003527+0000","last_clean":"2023-11-15T02:53:38.003527+0000","last_became_active":"2023-11-15T02:53:37.607111+0000","last_became_peered":"2023-11-15T02:53:37.607111+0000","last_unstale":"2023-11-15T02:53:38.003527+0000","last_undegraded":"2023-11-15T02:53:38.003527+0000","last_fullsized":"2023-11-15T02:53:38.003527+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998721+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:53:37.998721+0000","last_peered":"2023-11-15T02:53:37.998721+0000","last_clean":"2023-11-15T02:53:37.998721+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:53:37.998721+0000","last_undegraded":"2023-11-15T02:53:37.998721+0000","last_fullsized":"2023-11-15T02:53:37.998721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009887+0000","last_change":"2023-11-15T02:53:38.006186+0000","last_active":"2023-11-15T02:53:38.009887+0000","last_peered":"2023-11-15T02:53:38.009887+0000","last_clean":"2023-11-15T02:53:38.009887+0000","last_became_active":"2023-11-15T02:53:38.005653+0000","last_became_peered":"2023-11-15T02:53:38.005653+0000","last_unstale":"2023-11-15T02:53:38.009887+0000","last_undegraded":"2023-11-15T02:53:38.009887+0000","last_fullsized":"2023-11-15T02:53:38.009887+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984526+0000","last_change":"2023-11-15T02:53:37.610922+0000","last_active":"2023-11-15T02:53:37.984526+0000","last_peered":"2023-11-15T02:53:37.984526+0000","last_clean":"2023-11-15T02:53:37.984526+0000","last_became_active":"2023-11-15T02:53:37.610028+0000","last_became_peered":"2023-11-15T02:53:37.610028+0000","last_unstale":"2023-11-15T02:53:37.984526+0000","last_undegraded":"2023-11-15T02:53:37.984526+0000","last_fullsized":"2023-11-15T02:53:37.984526+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":162,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.997839+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:53:37.997839+0000","last_peered":"2023-11-15T02:53:37.997839+0000","last_clean":"2023-11-15T02:53:37.997839+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:53:37.997839+0000","last_undegraded":"2023-11-15T02:53:37.997839+0000","last_fullsized":"2023-11-15T02:53:37.997839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.996916+0000","last_change":"2023-11-15T02:53:37.995964+0000","last_active":"2023-11-15T02:53:37.996916+0000","last_peered":"2023-11-15T02:53:37.996916+0000","last_clean":"2023-11-15T02:53:37.996916+0000","last_became_active":"2023-11-15T02:53:37.995659+0000","last_became_peered":"2023-11-15T02:53:37.995659+0000","last_unstale":"2023-11-15T02:53:37.996916+0000","last_undegraded":"2023-11-15T02:53:37.996916+0000","last_fullsized":"2023-11-15T02:53:37.996916+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.004104+0000","last_change":"2023-11-15T02:53:37.610832+0000","last_active":"2023-11-15T02:53:38.004104+0000","last_peered":"2023-11-15T02:53:38.004104+0000","last_clean":"2023-11-15T02:53:38.004104+0000","last_became_active":"2023-11-15T02:53:37.610517+0000","last_became_peered":"2023-11-15T02:53:37.610517+0000","last_unstale":"2023-11-15T02:53:38.004104+0000","last_undegraded":"2023-11-15T02:53:38.004104+0000","last_fullsized":"2023-11-15T02:53:38.004104+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987235+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:53:37.987235+0000","last_peered":"2023-11-15T02:53:37.987235+0000","last_clean":"2023-11-15T02:53:37.987235+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:53:37.987235+0000","last_undegraded":"2023-11-15T02:53:37.987235+0000","last_fullsized":"2023-11-15T02:53:37.987235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008034+0000","last_change":"2023-11-15T02:53:38.004908+0000","last_active":"2023-11-15T02:53:38.008034+0000","last_peered":"2023-11-15T02:53:38.008034+0000","last_clean":"2023-11-15T02:53:38.008034+0000","last_became_active":"2023-11-15T02:53:38.004646+0000","last_became_peered":"2023-11-15T02:53:38.004646+0000","last_unstale":"2023-11-15T02:53:38.008034+0000","last_undegraded":"2023-11-15T02:53:38.008034+0000","last_fullsized":"2023-11-15T02:53:38.008034+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984950+0000","last_change":"2023-11-15T02:53:37.611678+0000","last_active":"2023-11-15T02:53:37.984950+0000","last_peered":"2023-11-15T02:53:37.984950+0000","last_clean":"2023-11-15T02:53:37.984950+0000","last_became_active":"2023-11-15T02:53:37.610384+0000","last_became_peered":"2023-11-15T02:53:37.610384+0000","last_unstale":"2023-11-15T02:53:37.984950+0000","last_undegraded":"2023-11-15T02:53:37.984950+0000","last_fullsized":"2023-11-15T02:53:37.984950+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":162,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989854+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:53:37.989854+0000","last_peered":"2023-11-15T02:53:37.989854+0000","last_clean":"2023-11-15T02:53:37.989854+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:53:37.989854+0000","last_undegraded":"2023-11-15T02:53:37.989854+0000","last_fullsized":"2023-11-15T02:53:37.989854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992682+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:53:37.992682+0000","last_peered":"2023-11-15T02:53:37.992682+0000","last_clean":"2023-11-15T02:53:37.992682+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:53:37.992682+0000","last_undegraded":"2023-11-15T02:53:37.992682+0000","last_fullsized":"2023-11-15T02:53:37.992682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.000622+0000","last_change":"2023-11-15T02:53:37.996966+0000","last_active":"2023-11-15T02:53:38.000622+0000","last_peered":"2023-11-15T02:53:38.000622+0000","last_clean":"2023-11-15T02:53:38.000622+0000","last_became_active":"2023-11-15T02:53:37.996716+0000","last_became_peered":"2023-11-15T02:53:37.996716+0000","last_unstale":"2023-11-15T02:53:38.000622+0000","last_undegraded":"2023-11-15T02:53:38.000622+0000","last_fullsized":"2023-11-15T02:53:38.000622+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"195'3","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010557+0000","last_change":"2023-11-15T02:53:37.602954+0000","last_active":"2023-11-15T02:53:38.010557+0000","last_peered":"2023-11-15T02:53:38.010557+0000","last_clean":"2023-11-15T02:53:38.010557+0000","last_became_active":"2023-11-15T02:53:37.602650+0000","last_became_peered":"2023-11-15T02:53:37.602650+0000","last_unstale":"2023-11-15T02:53:38.010557+0000","last_undegraded":"2023-11-15T02:53:38.010557+0000","last_fullsized":"2023-11-15T02:53:38.010557+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992790+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:53:37.992790+0000","last_peered":"2023-11-15T02:53:37.992790+0000","last_clean":"2023-11-15T02:53:37.992790+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:53:37.992790+0000","last_undegraded":"2023-11-15T02:53:37.992790+0000","last_fullsized":"2023-11-15T02:53:37.992790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006116+0000","last_change":"2023-11-15T02:53:38.004904+0000","last_active":"2023-11-15T02:53:38.006116+0000","last_peered":"2023-11-15T02:53:38.006116+0000","last_clean":"2023-11-15T02:53:38.006116+0000","last_became_active":"2023-11-15T02:53:38.002970+0000","last_became_peered":"2023-11-15T02:53:38.002970+0000","last_unstale":"2023-11-15T02:53:38.006116+0000","last_undegraded":"2023-11-15T02:53:38.006116+0000","last_fullsized":"2023-11-15T02:53:38.006116+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"195'4","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010616+0000","last_change":"2023-11-15T02:53:37.602372+0000","last_active":"2023-11-15T02:53:38.010616+0000","last_peered":"2023-11-15T02:53:38.010616+0000","last_clean":"2023-11-15T02:53:38.010616+0000","last_became_active":"2023-11-15T02:53:37.602042+0000","last_became_peered":"2023-11-15T02:53:37.602042+0000","last_unstale":"2023-11-15T02:53:38.010616+0000","last_undegraded":"2023-11-15T02:53:38.010616+0000","last_fullsized":"2023-11-15T02:53:38.010616+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.993798+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:53:37.993798+0000","last_peered":"2023-11-15T02:53:37.993798+0000","last_clean":"2023-11-15T02:53:37.993798+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:53:37.993798+0000","last_undegraded":"2023-11-15T02:53:37.993798+0000","last_fullsized":"2023-11-15T02:53:37.993798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009380+0000","last_change":"2023-11-15T02:53:38.002981+0000","last_active":"2023-11-15T02:53:38.009380+0000","last_peered":"2023-11-15T02:53:38.009380+0000","last_clean":"2023-11-15T02:53:38.009380+0000","last_became_active":"2023-11-15T02:53:38.002343+0000","last_became_peered":"2023-11-15T02:53:38.002343+0000","last_unstale":"2023-11-15T02:53:38.009380+0000","last_undegraded":"2023-11-15T02:53:38.009380+0000","last_fullsized":"2023-11-15T02:53:38.009380+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011456+0000","last_change":"2023-11-15T02:53:37.607737+0000","last_active":"2023-11-15T02:53:38.011456+0000","last_peered":"2023-11-15T02:53:38.011456+0000","last_clean":"2023-11-15T02:53:38.011456+0000","last_became_active":"2023-11-15T02:53:37.607051+0000","last_became_peered":"2023-11-15T02:53:37.607051+0000","last_unstale":"2023-11-15T02:53:38.011456+0000","last_undegraded":"2023-11-15T02:53:38.011456+0000","last_fullsized":"2023-11-15T02:53:38.011456+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001049+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:53:38.001049+0000","last_peered":"2023-11-15T02:53:38.001049+0000","last_clean":"2023-11-15T02:53:38.001049+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:53:38.001049+0000","last_undegraded":"2023-11-15T02:53:38.001049+0000","last_fullsized":"2023-11-15T02:53:38.001049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003060+0000","last_change":"2023-11-15T02:53:37.998675+0000","last_active":"2023-11-15T02:53:38.003060+0000","last_peered":"2023-11-15T02:53:38.003060+0000","last_clean":"2023-11-15T02:53:38.003060+0000","last_became_active":"2023-11-15T02:53:37.998261+0000","last_became_peered":"2023-11-15T02:53:37.998261+0000","last_unstale":"2023-11-15T02:53:38.003060+0000","last_undegraded":"2023-11-15T02:53:38.003060+0000","last_fullsized":"2023-11-15T02:53:38.003060+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.985238+0000","last_change":"2023-11-15T02:53:37.598178+0000","last_active":"2023-11-15T02:53:37.985238+0000","last_peered":"2023-11-15T02:53:37.985238+0000","last_clean":"2023-11-15T02:53:37.985238+0000","last_became_active":"2023-11-15T02:53:37.597661+0000","last_became_peered":"2023-11-15T02:53:37.597661+0000","last_unstale":"2023-11-15T02:53:37.985238+0000","last_undegraded":"2023-11-15T02:53:37.985238+0000","last_fullsized":"2023-11-15T02:53:37.985238+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":182,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.994361+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:53:37.994361+0000","last_peered":"2023-11-15T02:53:37.994361+0000","last_clean":"2023-11-15T02:53:37.994361+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:53:37.994361+0000","last_undegraded":"2023-11-15T02:53:37.994361+0000","last_fullsized":"2023-11-15T02:53:37.994361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575945,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303580,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068260,"statfs":{"total":96636764160,"available":96325898240,"internally_reserved":0,"allocated":2445312,"data_stored":1303745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.82599999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.57699999999999996},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72599999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.51400000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.42099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.67900000000000005,"5min":0.752,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.78000000000000003,"15min":0.80400000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.44800000000000001,"5min":0.441,"15min":0.40999999999999998},"max":{"1min":0.75700000000000001,"5min":0.79100000000000004,"15min":0.83799999999999997},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.754,"5min":0.81000000000000005,"15min":0.88500000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.62},"min":{"1min":0.47899999999999998,"5min":0.40699999999999997,"15min":0.377},"max":{"1min":0.81899999999999995,"5min":0.84799999999999998,"15min":0.86699999999999999},"last":0.58099999999999996}]},{"osd":4,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46100000000000002,"15min":0.47699999999999998},"min":{"1min":0.32800000000000001,"5min":0.29199999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.749},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.64700000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47899999999999998,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.79500000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.81999999999999995},"last":0.625}]},{"osd":6,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.37,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.84899999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.35299999999999998,"15min":0.28499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.68899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575946,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307684,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064156,"statfs":{"total":96636764160,"available":96321695744,"internally_reserved":0,"allocated":2453504,"data_stored":1310419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.24099999999999999},"max":{"1min":0.749,"5min":0.80000000000000004,"15min":0.92500000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.27700000000000002},"max":{"1min":0.71999999999999997,"5min":0.77300000000000002,"15min":0.873},"last":0.65500000000000003}]},{"osd":1,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75700000000000001,"5min":0.81399999999999995,"15min":0.81999999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.36199999999999999},"max":{"1min":0.69299999999999995,"5min":0.77200000000000002,"15min":0.88},"last":0.58299999999999996}]},{"osd":2,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.78400000000000003,"15min":0.84599999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.45300000000000001,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.72799999999999998,"5min":0.83399999999999996,"15min":0.88900000000000001},"last":0.71399999999999997}]},{"osd":3,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.42699999999999999,"5min":0.35299999999999998,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60799999999999998,"15min":0.60699999999999998},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.38},"max":{"1min":0.78000000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64700000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45900000000000002},"min":{"1min":0.29799999999999999,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.64100000000000001,"5min":0.72999999999999998,"15min":0.82199999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.39600000000000002,"5min":0.34799999999999998,"15min":0.30099999999999999},"max":{"1min":0.70899999999999996,"5min":0.79500000000000004,"15min":0.874},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.32400000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.82799999999999996},"last":0.442},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.32000000000000001},"max":{"1min":0.70999999999999996,"5min":0.77000000000000002,"15min":0.95099999999999996},"last":0.47799999999999998}]},{"osd":7,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.50900000000000001},"min":{"1min":0.33700000000000002,"5min":0.32600000000000001,"15min":0.30499999999999999},"max":{"1min":0.65200000000000002,"5min":0.74199999999999999,"15min":0.90100000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.434,"5min":0.42599999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.83799999999999997,"15min":0.875},"last":0.496}]}]},{"osd":1,"up_from":13,"seq":55834575947,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307688,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064152,"statfs":{"total":96636764160,"available":96321691648,"internally_reserved":0,"allocated":2457600,"data_stored":1310171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.39200000000000002},"min":{"1min":0.28599999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.432},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.436,"15min":0.41899999999999998},"min":{"1min":0.28799999999999998,"5min":0.255,"15min":0.255},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.312}]},{"osd":2,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42099999999999999,"15min":0.40799999999999997},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.47799999999999998,"15min":0.46300000000000002},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.40799999999999997}]},{"osd":3,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.441,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.375},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.41999999999999998,"5min":0.32500000000000001,"15min":0.315},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.441}]},{"osd":4,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.49199999999999999,"5min":0.436,"15min":0.372},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.53400000000000003,"5min":0.42399999999999999,"15min":0.41299999999999998},"max":{"1min":1.0289999999999999,"5min":1.081,"15min":1.081},"last":0.69899999999999995}]},{"osd":5,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67000000000000004,"15min":0.66000000000000003},"min":{"1min":0.52100000000000002,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68700000000000006,"15min":0.67400000000000004},"min":{"1min":0.54900000000000004,"5min":0.45600000000000002,"15min":0.42699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.70799999999999996}]},{"osd":6,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.52300000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.73599999999999999,"15min":0.72399999999999998},"min":{"1min":0.64500000000000002,"5min":0.53500000000000003,"15min":0.48999999999999999},"max":{"1min":0.98399999999999999,"5min":1,"15min":1},"last":0.75800000000000001}]},{"osd":7,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.67600000000000005,"5min":0.52600000000000002,"15min":0.46600000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.746,"15min":0.72999999999999998},"min":{"1min":0.627,"5min":0.52100000000000002,"15min":0.48399999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0009999999999999},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575945,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311768,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060072,"statfs":{"total":96636764160,"available":96317513728,"internally_reserved":0,"allocated":2441216,"data_stored":1302333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.40000000000000002,"15min":0.39900000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.63300000000000001,"15min":0.73499999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61299999999999999,"5min":0.68100000000000005,"15min":0.89400000000000002},"last":0.39000000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41699999999999998,"15min":0.40799999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.23599999999999999},"max":{"1min":0.626,"5min":0.66500000000000004,"15min":0.755},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47099999999999997,"15min":0.46500000000000002},"min":{"1min":0.35499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64700000000000002,"5min":0.71199999999999997,"15min":0.77200000000000002},"last":0.33000000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66200000000000003,"5min":0.73399999999999999,"15min":0.83199999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.317},"max":{"1min":0.61699999999999999,"5min":0.70999999999999996,"15min":0.86699999999999999},"last":0.373}]},{"osd":4,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.69399999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.40500000000000003},"max":{"1min":0.89900000000000002,"5min":1.034,"15min":1.0720000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70799999999999996,"15min":0.68999999999999995},"min":{"1min":0.55000000000000004,"5min":0.46600000000000003,"15min":0.42699999999999999},"max":{"1min":0.92600000000000005,"5min":1.022,"15min":1.0549999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.51400000000000001,"5min":0.47899999999999998,"15min":0.378},"max":{"1min":0.89000000000000001,"5min":0.96699999999999997,"15min":1.0449999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70399999999999996,"15min":0.68000000000000005},"min":{"1min":0.498,"5min":0.45400000000000001,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.028},"last":0.70299999999999996}]},{"osd":6,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69899999999999995,"15min":0.67700000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.441},"max":{"1min":0.85399999999999998,"5min":0.95399999999999996,"15min":1.171},"last":0.627},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.443},"max":{"1min":0.86599999999999999,"5min":1.01,"15min":1.135},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73299999999999998,"15min":0.72199999999999998},"min":{"1min":0.59899999999999998,"5min":0.47399999999999998,"15min":0.40699999999999997},"max":{"1min":0.94099999999999995,"5min":1.0549999999999999,"15min":1.083},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.75700000000000001,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95199999999999996,"5min":1.089,"15min":1.107},"last":0.65100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575946,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315876,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055964,"statfs":{"total":96636764160,"available":96313307136,"internally_reserved":0,"allocated":2453504,"data_stored":1309597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27000000000000002,"5min":0.25900000000000001,"15min":0.253},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.63700000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.433,"15min":0.437},"min":{"1min":0.29099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.67100000000000004,"15min":0.72899999999999998},"last":0.38500000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53700000000000003,"5min":0.628,"15min":0.69099999999999995},"last":0.255},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.45600000000000002},"min":{"1min":0.35899999999999999,"5min":0.32500000000000001,"15min":0.28100000000000003},"max":{"1min":0.61599999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.35199999999999998}]},{"osd":3,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47999999999999998,"15min":0.48199999999999998},"min":{"1min":0.39100000000000001,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.70099999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.31900000000000001},"max":{"1min":0.62,"5min":0.753,"15min":0.81399999999999995},"last":0.39800000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.501,"5min":0.46300000000000002,"15min":0.41099999999999998},"max":{"1min":0.88900000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66600000000000004,"15min":0.67600000000000005},"min":{"1min":0.46300000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97199999999999998,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.47299999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.52300000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67400000000000004,"15min":0.67700000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90000000000000002,"5min":1.056,"15min":1.056},"last":0.48199999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.47799999999999998},"max":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.113},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.55800000000000005,"5min":0.48999999999999999,"15min":0.46400000000000002},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.46700000000000003}]},{"osd":7,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.54100000000000004,"5min":0.502,"15min":0.46500000000000002},"max":{"1min":0.995,"5min":1.012,"15min":1.0680000000000001},"last":0.504},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.72499999999999998},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.48699999999999999},"max":{"1min":0.93500000000000005,"5min":1.089,"15min":1.1499999999999999},"last":0.53800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575947,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311788,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060052,"statfs":{"total":96636764160,"available":96317493248,"internally_reserved":0,"allocated":2461696,"data_stored":1310193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41099999999999998,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.54800000000000004,"5min":0.624,"15min":0.67500000000000004},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63200000000000001,"5min":0.64400000000000002,"15min":0.65800000000000003},"last":0.28899999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":0.67100000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.34300000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48199999999999998,"15min":0.47799999999999998},"min":{"1min":0.35499999999999998,"5min":0.31,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.72299999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.32200000000000001}]},{"osd":4,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.52900000000000003,"5min":0.41999999999999998,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.91700000000000004,"15min":1.0149999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.45200000000000001},"max":{"1min":0.98499999999999999,"5min":1.04,"15min":1.04},"last":0.72599999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69399999999999995,"15min":0.68600000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96199999999999997,"5min":1.0569999999999999,"15min":1.1100000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.67800000000000005},"min":{"1min":0.47799999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93500000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66400000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.40999999999999998},"max":{"1min":0.93400000000000005,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.622},{"interface":"front","average":{"1min":0.746,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.52200000000000002,"15min":0.46400000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0720000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.54900000000000004,"5min":0.53000000000000003,"15min":0.47899999999999998},"max":{"1min":0.94399999999999995,"5min":0.97999999999999998,"15min":1.071},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575945,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303596,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068244,"statfs":{"total":96636764160,"available":96325881856,"internally_reserved":0,"allocated":2461696,"data_stored":1309709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.44500000000000001,"5min":0.40799999999999997,"15min":0.28299999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.81000000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":0.75700000000000001,"5min":0.79000000000000004,"15min":0.97199999999999998},"last":0.495}]},{"osd":1,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.42399999999999999,"5min":0.41099999999999998,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":0.78100000000000003,"15min":0.89900000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.33600000000000002},"max":{"1min":0.78200000000000003,"5min":0.83299999999999996,"15min":0.88700000000000001},"last":0.56899999999999995}]},{"osd":2,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.86399999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.38200000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.85599999999999998},"last":0.65800000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38300000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.80800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.48799999999999999,"5min":0.48399999999999999,"15min":0.36599999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.83099999999999996},"last":0.621}]},{"osd":5,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.28100000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.76200000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51300000000000001,"15min":0.51100000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.79100000000000004},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34999999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.69599999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.39600000000000002,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.81799999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.79300000000000004,"15min":0.84599999999999997},"last":0.72199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575945,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307692,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064148,"statfs":{"total":96636764160,"available":96321687552,"internally_reserved":0,"allocated":2461696,"data_stored":1310205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73899999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.441},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.86899999999999999},"last":0.66900000000000004}]},{"osd":1,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.33300000000000002},"max":{"1min":0.76700000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.52600000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.372},"max":{"1min":0.71999999999999997,"5min":0.876,"15min":0.90000000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59699999999999998,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34499999999999997},"max":{"1min":0.75600000000000001,"5min":0.78100000000000003,"15min":0.83299999999999996},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":0.78700000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.34399999999999997},"max":{"1min":0.78600000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46100000000000002,"15min":0.47199999999999998},"min":{"1min":0.311,"5min":0.308,"15min":0.27900000000000003},"max":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.751},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.32600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.73399999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53900000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.313,"5min":0.312,"15min":0.312},"max":{"1min":0.753,"5min":0.753,"15min":0.75600000000000001},"last":0.74299999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.502,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.67400000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.75700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:53:46.511 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:53:46.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.643+0000 7ff0b531a700 1 Processor -- start 2023-11-15T02:53:46.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.643+0000 7ff0b531a700 1 -- start start 2023-11-15T02:53:46.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.644+0000 7ff0b531a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0b00ca9b0 0x7ff0b00c0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:46.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.644+0000 7ff0b531a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b01559e0 con 0x7ff0b006a6c0 2023-11-15T02:53:46.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.644+0000 7ff0b531a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b0154dd0 con 0x7ff0b00c8390 2023-11-15T02:53:46.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.644+0000 7ff0b531a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b01550b0 con 0x7ff0b00ca9b0 2023-11-15T02:53:46.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.644+0000 7ff0af7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff0b006a6c0 0x7ff0b00c6550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57300/0 (socket says 172.21.15.1:57300) 2023-11-15T02:53:46.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.644+0000 7ff0af7fe700 1 -- 172.21.15.1:0/1345961215 learned_addr learned my addr 172.21.15.1:0/1345961215 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:46.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.644+0000 7ff0aeffd700 1 --2- 172.21.15.1:0/1345961215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0b00ca9b0 0x7ff0b00c0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:46.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440222179 0 0) 0x7ff0b01559e0 con 0x7ff0b006a6c0 2023-11-15T02:53:46.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff09c0033f0 con 0x7ff0b006a6c0 2023-11-15T02:53:46.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010751824 0 0) 0x7ff0b0154dd0 con 0x7ff0b00c8390 2023-11-15T02:53:46.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0b01559e0 con 0x7ff0b00c8390 2023-11-15T02:53:46.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3758648348 0 0) 0x7ff09c0033f0 con 0x7ff0b006a6c0 2023-11-15T02:53:46.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0b00ca9b0 msgr2=0x7ff0b00c0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:46.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 --2- 172.21.15.1:0/1345961215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0b00ca9b0 0x7ff0b00c0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:46.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 >> v1:172.21.15.141:6789/0 conn(0x7ff0b00c8390 legacy=0x7ff0b014e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:46.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b0155390 con 0x7ff0b006a6c0 2023-11-15T02:53:46.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7ff0a00017f0 con 0x7ff0b006a6c0 2023-11-15T02:53:46.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 >> v1:172.21.15.1:6789/0 conn(0x7ff0b006a6c0 legacy=0x7ff0b00c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:46.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 --2- 172.21.15.1:0/1345961215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff09c003aa0 0x7ff09c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:46.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 --2- 172.21.15.1:0/1345961215 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff09c004690 0x7ff09c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:46.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 --2- 172.21.15.1:0/1345961215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff09c005000 0x7ff09c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:46.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b01550b0 con 0x7ff09c005000 2023-11-15T02:53:46.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c00be80 con 0x7ff09c004690 2023-11-15T02:53:46.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c00c040 con 0x7ff09c003aa0 2023-11-15T02:53:46.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0aeffd700 1 --2- 172.21.15.1:0/1345961215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0b00ca9b0 0x7ff0b00c0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:53:46.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0af7fe700 1 --2- 172.21.15.1:0/1345961215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff09c005000 0x7ff09c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:46.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0aeffd700 1 --2- 172.21.15.1:0/1345961215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff09c003aa0 0x7ff09c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:46.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0af7fe700 1 -- 172.21.15.1:0/1345961215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff09c003aa0 msgr2=0x7ff09c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:46.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0ae7fc700 1 --2- 172.21.15.1:0/1345961215 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff09c004690 0x7ff09c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:46.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0af7fe700 1 --2- 172.21.15.1:0/1345961215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff09c003aa0 0x7ff09c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:46.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0af7fe700 1 -- 172.21.15.1:0/1345961215 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff09c004690 msgr2=0x7ff09c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:46.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0af7fe700 1 --2- 172.21.15.1:0/1345961215 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff09c004690 0x7ff09c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:46.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0af7fe700 1 -- 172.21.15.1:0/1345961215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c0033f0 con 0x7ff09c005000 2023-11-15T02:53:46.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.645+0000 7ff0ae7fc700 1 --2- 172.21.15.1:0/1345961215 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff09c004690 0x7ff09c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:46.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.646+0000 7ff0af7fe700 1 --2- 172.21.15.1:0/1345961215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff09c005000 0x7ff09c00b8e0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7ff0a000c5c0 tx=0x7ff0a0007f40).ready entity=mon.0 client_cookie=384254b2b484d1c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:46.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.646+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a000cdc0 con 0x7ff09c005000 2023-11-15T02:53:46.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.646+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a0005b20 con 0x7ff09c005000 2023-11-15T02:53:46.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.646+0000 7ff0adffb700 1 -- 172.21.15.1:0/1345961215 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0005ea0 con 0x7ff09c005000 2023-11-15T02:53:46.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.646+0000 7ff0b531a700 1 -- 172.21.15.1:0/1345961215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff09c005000 msgr2=0x7ff09c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:46.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.646+0000 7ff0b531a700 1 --2- 172.21.15.1:0/1345961215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff09c005000 0x7ff09c00b8e0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7ff0a000c5c0 tx=0x7ff0a0007f40).stop 2023-11-15T02:53:46.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.646+0000 7ff0af7fe700 1 -- 172.21.15.1:0/1345961215 reap_dead start 2023-11-15T02:53:46.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.646+0000 7ff0b531a700 1 -- 172.21.15.1:0/1345961215 shutdown_connections 2023-11-15T02:53:46.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.646+0000 7ff0b531a700 1 -- 172.21.15.1:0/1345961215 >> 172.21.15.1:0/1345961215 conn(0x7ff0b0084ec0 msgr2=0x7ff0b00947e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:46.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.646+0000 7ff0b531a700 1 -- 172.21.15.1:0/1345961215 shutdown_connections 2023-11-15T02:53:46.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.646+0000 7ff0b531a700 1 -- 172.21.15.1:0/1345961215 wait complete. 2023-11-15T02:53:46.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.648+0000 7ff0b531a700 1 Processor -- start 2023-11-15T02:53:46.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.648+0000 7ff0b531a700 1 -- start start 2023-11-15T02:53:46.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.648+0000 7ff0b531a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff09c005000 0x7ff0b0164570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:46.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.648+0000 7ff0b531a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0b0157020 0x7ff0b01574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:46.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.648+0000 7ff0b531a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0b00c4390 0x7ff0b00c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:46.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.648+0000 7ff0b531a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b0164a60 con 0x7ff0b00c4390 2023-11-15T02:53:46.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.648+0000 7ff0b531a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b00c3f00 con 0x7ff0b0157020 2023-11-15T02:53:46.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.648+0000 7ff0b531a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b00c3010 con 0x7ff09c005000 2023-11-15T02:53:46.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.648+0000 7ff0af7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0b00c4390 0x7ff0b00c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:46.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.649+0000 7ff0af7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0b00c4390 0x7ff0b00c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59650/0 (socket says 172.21.15.1:59650) 2023-11-15T02:53:46.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.649+0000 7ff0af7fe700 1 -- 172.21.15.1:0/548204092 learned_addr learned my addr 172.21.15.1:0/548204092 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:46.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.649+0000 7ff0aeffd700 1 --2- 172.21.15.1:0/548204092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff09c005000 0x7ff0b0164570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:46.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.649+0000 7ff0ae7fc700 1 --2- 172.21.15.1:0/548204092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0b0157020 0x7ff0b01574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:46.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.649+0000 7ff0af7fe700 1 -- 172.21.15.1:0/548204092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff09c005000 msgr2=0x7ff0b0164570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:46.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.649+0000 7ff0af7fe700 1 --2- 172.21.15.1:0/548204092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff09c005000 0x7ff0b0164570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:46.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.649+0000 7ff0af7fe700 1 -- 172.21.15.1:0/548204092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0b0157020 msgr2=0x7ff0b01574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:46.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.649+0000 7ff0af7fe700 1 --2- 172.21.15.1:0/548204092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0b0157020 0x7ff0b01574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:46.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.649+0000 7ff0af7fe700 1 -- 172.21.15.1:0/548204092 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b00c32f0 con 0x7ff0b00c4390 2023-11-15T02:53:46.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.649+0000 7ff0af7fe700 1 --2- 172.21.15.1:0/548204092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0b00c4390 0x7ff0b00c4810 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7ff0a000cbb0 tx=0x7ff0a0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:46.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.649+0000 7ff0a6ffd700 1 -- 172.21.15.1:0/548204092 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a000cdc0 con 0x7ff0b00c4390 2023-11-15T02:53:46.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.649+0000 7ff0a6ffd700 1 -- 172.21.15.1:0/548204092 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a0005c90 con 0x7ff0b00c4390 2023-11-15T02:53:46.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.649+0000 7ff0b531a700 1 -- 172.21.15.1:0/548204092 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b00c35d0 con 0x7ff0b00c4390 2023-11-15T02:53:46.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.649+0000 7ff0a6ffd700 1 -- 172.21.15.1:0/548204092 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0013680 con 0x7ff0b00c4390 2023-11-15T02:53:46.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.649+0000 7ff0b531a700 1 -- 172.21.15.1:0/548204092 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b00c3b90 con 0x7ff0b00c4390 2023-11-15T02:53:46.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.650+0000 7ff0b531a700 1 -- 172.21.15.1:0/548204092 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b00475e0 con 0x7ff0b00c4390 2023-11-15T02:53:46.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.651+0000 7ff0a6ffd700 1 -- 172.21.15.1:0/548204092 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff0a00139f0 con 0x7ff0b00c4390 2023-11-15T02:53:46.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.651+0000 7ff0a6ffd700 1 --2- 172.21.15.1:0/548204092 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff09005f270 0x7ff090061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:46.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.651+0000 7ff0a6ffd700 1 -- 172.21.15.1:0/548204092 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7ff0a007b4d0 con 0x7ff0b00c4390 2023-11-15T02:53:46.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.651+0000 7ff0aeffd700 1 --2- 172.21.15.1:0/548204092 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff09005f270 0x7ff090061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:46.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.652+0000 7ff0aeffd700 1 --2- 172.21.15.1:0/548204092 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff09005f270 0x7ff090061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff0b0083c50 tx=0x7ff0a8008040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:46.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.655+0000 7ff0a6ffd700 1 -- 172.21.15.1:0/548204092 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff0a004c410 con 0x7ff0b00c4390 2023-11-15T02:53:46.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.825+0000 7ff0b531a700 1 -- 172.21.15.1:0/548204092 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0b0060900 con 0x7ff09005f270 2023-11-15T02:53:46.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.836+0000 7ff0a6ffd700 1 -- 172.21.15.1:0/548204092 <== mgr.8590 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362248 (secure 0 0 0) 0x7ff0b0060900 con 0x7ff09005f270 2023-11-15T02:53:46.841 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:46.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.840+0000 7ff0b531a700 1 -- 172.21.15.1:0/548204092 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff09005f270 msgr2=0x7ff090061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:46.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.840+0000 7ff0b531a700 1 --2- 172.21.15.1:0/548204092 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff09005f270 0x7ff090061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff0b0083c50 tx=0x7ff0a8008040).stop 2023-11-15T02:53:46.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.840+0000 7ff0b531a700 1 -- 172.21.15.1:0/548204092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0b00c4390 msgr2=0x7ff0b00c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:46.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.840+0000 7ff0b531a700 1 --2- 172.21.15.1:0/548204092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0b00c4390 0x7ff0b00c4810 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7ff0a000cbb0 tx=0x7ff0a0015000).stop 2023-11-15T02:53:46.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.840+0000 7ff0b531a700 1 -- 172.21.15.1:0/548204092 shutdown_connections 2023-11-15T02:53:46.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.840+0000 7ff0b531a700 1 --2- 172.21.15.1:0/548204092 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff09005f270 0x7ff090061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:46.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.840+0000 7ff0b531a700 1 --2- 172.21.15.1:0/548204092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0b00c4390 0x7ff0b00c4810 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:46.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.840+0000 7ff0b531a700 1 --2- 172.21.15.1:0/548204092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff09c005000 0x7ff0b0164570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:46.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.840+0000 7ff0b531a700 1 --2- 172.21.15.1:0/548204092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0b0157020 0x7ff0b01574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:46.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.840+0000 7ff0b531a700 1 -- 172.21.15.1:0/548204092 >> 172.21.15.1:0/548204092 conn(0x7ff0b0084ec0 msgr2=0x7ff0b0151a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:46.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.840+0000 7ff0b531a700 1 -- 172.21.15.1:0/548204092 shutdown_connections 2023-11-15T02:53:46.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:46.840+0000 7ff0b531a700 1 -- 172.21.15.1:0/548204092 wait complete. 2023-11-15T02:53:46.847 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:53:46.853 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-11-15T02:53:46.552420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2469696,"kb_used_data":19200,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752505024,"statfs":{"total":773094113280,"available":770565144576,"internally_reserved":0,"allocated":19660800,"data_stored":10480828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-593515,"num_objects":-20,"num_object_clones":0,"num_object_copies":-40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-20,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-204,"num_write_kb":-719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.008561"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.004115+0000","last_change":"2023-11-15T02:53:37.995183+0000","last_active":"2023-11-15T02:53:38.004115+0000","last_peered":"2023-11-15T02:53:38.004115+0000","last_clean":"2023-11-15T02:53:38.004115+0000","last_became_active":"2023-11-15T02:53:37.994643+0000","last_became_peered":"2023-11-15T02:53:37.994643+0000","last_unstale":"2023-11-15T02:53:38.004115+0000","last_undegraded":"2023-11-15T02:53:38.004115+0000","last_fullsized":"2023-11-15T02:53:38.004115+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"195'3","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011940+0000","last_change":"2023-11-15T02:53:37.606094+0000","last_active":"2023-11-15T02:53:38.011940+0000","last_peered":"2023-11-15T02:53:38.011940+0000","last_clean":"2023-11-15T02:53:38.011940+0000","last_became_active":"2023-11-15T02:53:37.605797+0000","last_became_peered":"2023-11-15T02:53:37.605797+0000","last_unstale":"2023-11-15T02:53:38.011940+0000","last_undegraded":"2023-11-15T02:53:38.011940+0000","last_fullsized":"2023-11-15T02:53:38.011940+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011234+0000","last_change":"2023-11-15T02:53:38.006818+0000","last_active":"2023-11-15T02:53:38.011234+0000","last_peered":"2023-11-15T02:53:38.011234+0000","last_clean":"2023-11-15T02:53:38.011234+0000","last_became_active":"2023-11-15T02:53:38.006545+0000","last_became_peered":"2023-11-15T02:53:38.006545+0000","last_unstale":"2023-11-15T02:53:38.011234+0000","last_undegraded":"2023-11-15T02:53:38.011234+0000","last_fullsized":"2023-11-15T02:53:38.011234+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.995290+0000","last_change":"2023-11-15T02:53:37.600571+0000","last_active":"2023-11-15T02:53:37.995290+0000","last_peered":"2023-11-15T02:53:37.995290+0000","last_clean":"2023-11-15T02:53:37.995290+0000","last_became_active":"2023-11-15T02:53:37.600299+0000","last_became_peered":"2023-11-15T02:53:37.600299+0000","last_unstale":"2023-11-15T02:53:37.995290+0000","last_undegraded":"2023-11-15T02:53:37.995290+0000","last_fullsized":"2023-11-15T02:53:37.995290+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998658+0000","last_change":"2023-11-15T02:53:37.991499+0000","last_active":"2023-11-15T02:53:37.998658+0000","last_peered":"2023-11-15T02:53:37.998658+0000","last_clean":"2023-11-15T02:53:37.998658+0000","last_became_active":"2023-11-15T02:53:37.991219+0000","last_became_peered":"2023-11-15T02:53:37.991219+0000","last_unstale":"2023-11-15T02:53:37.998658+0000","last_undegraded":"2023-11-15T02:53:37.998658+0000","last_fullsized":"2023-11-15T02:53:37.998658+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999215+0000","last_change":"2023-11-15T02:53:37.598351+0000","last_active":"2023-11-15T02:53:37.999215+0000","last_peered":"2023-11-15T02:53:37.999215+0000","last_clean":"2023-11-15T02:53:37.999215+0000","last_became_active":"2023-11-15T02:53:37.598074+0000","last_became_peered":"2023-11-15T02:53:37.598074+0000","last_unstale":"2023-11-15T02:53:37.999215+0000","last_undegraded":"2023-11-15T02:53:37.999215+0000","last_fullsized":"2023-11-15T02:53:37.999215+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009794+0000","last_change":"2023-11-15T02:53:38.005640+0000","last_active":"2023-11-15T02:53:38.009794+0000","last_peered":"2023-11-15T02:53:38.009794+0000","last_clean":"2023-11-15T02:53:38.009794+0000","last_became_active":"2023-11-15T02:53:38.005427+0000","last_became_peered":"2023-11-15T02:53:38.005427+0000","last_unstale":"2023-11-15T02:53:38.009794+0000","last_undegraded":"2023-11-15T02:53:38.009794+0000","last_fullsized":"2023-11-15T02:53:38.009794+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003329+0000","last_change":"2023-11-15T02:53:37.605508+0000","last_active":"2023-11-15T02:53:38.003329+0000","last_peered":"2023-11-15T02:53:38.003329+0000","last_clean":"2023-11-15T02:53:38.003329+0000","last_became_active":"2023-11-15T02:53:37.605050+0000","last_became_peered":"2023-11-15T02:53:37.605050+0000","last_unstale":"2023-11-15T02:53:38.003329+0000","last_undegraded":"2023-11-15T02:53:38.003329+0000","last_fullsized":"2023-11-15T02:53:38.003329+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.007889+0000","last_change":"2023-11-15T02:53:38.003090+0000","last_active":"2023-11-15T02:53:38.007889+0000","last_peered":"2023-11-15T02:53:38.007889+0000","last_clean":"2023-11-15T02:53:38.007889+0000","last_became_active":"2023-11-15T02:53:38.002775+0000","last_became_peered":"2023-11-15T02:53:38.002775+0000","last_unstale":"2023-11-15T02:53:38.007889+0000","last_undegraded":"2023-11-15T02:53:38.007889+0000","last_fullsized":"2023-11-15T02:53:38.007889+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002517+0000","last_change":"2023-11-15T02:53:37.596100+0000","last_active":"2023-11-15T02:53:38.002517+0000","last_peered":"2023-11-15T02:53:38.002517+0000","last_clean":"2023-11-15T02:53:38.002517+0000","last_became_active":"2023-11-15T02:53:37.595738+0000","last_became_peered":"2023-11-15T02:53:37.595738+0000","last_unstale":"2023-11-15T02:53:38.002517+0000","last_undegraded":"2023-11-15T02:53:38.002517+0000","last_fullsized":"2023-11-15T02:53:38.002517+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.013228+0000","last_change":"2023-11-15T02:53:38.010179+0000","last_active":"2023-11-15T02:53:38.013228+0000","last_peered":"2023-11-15T02:53:38.013228+0000","last_clean":"2023-11-15T02:53:38.013228+0000","last_became_active":"2023-11-15T02:53:38.009853+0000","last_became_peered":"2023-11-15T02:53:38.009853+0000","last_unstale":"2023-11-15T02:53:38.013228+0000","last_undegraded":"2023-11-15T02:53:38.013228+0000","last_fullsized":"2023-11-15T02:53:38.013228+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998494+0000","last_change":"2023-11-15T02:53:37.610005+0000","last_active":"2023-11-15T02:53:37.998494+0000","last_peered":"2023-11-15T02:53:37.998494+0000","last_clean":"2023-11-15T02:53:37.998494+0000","last_became_active":"2023-11-15T02:53:37.609699+0000","last_became_peered":"2023-11-15T02:53:37.609699+0000","last_unstale":"2023-11-15T02:53:37.998494+0000","last_undegraded":"2023-11-15T02:53:37.998494+0000","last_fullsized":"2023-11-15T02:53:37.998494+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006567+0000","last_change":"2023-11-15T02:53:38.001561+0000","last_active":"2023-11-15T02:53:38.006567+0000","last_peered":"2023-11-15T02:53:38.006567+0000","last_clean":"2023-11-15T02:53:38.006567+0000","last_became_active":"2023-11-15T02:53:38.001242+0000","last_became_peered":"2023-11-15T02:53:38.001242+0000","last_unstale":"2023-11-15T02:53:38.006567+0000","last_undegraded":"2023-11-15T02:53:38.006567+0000","last_fullsized":"2023-11-15T02:53:38.006567+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.981858+0000","last_change":"2023-11-15T02:53:37.606473+0000","last_active":"2023-11-15T02:53:37.981858+0000","last_peered":"2023-11-15T02:53:37.981858+0000","last_clean":"2023-11-15T02:53:37.981858+0000","last_became_active":"2023-11-15T02:53:37.606137+0000","last_became_peered":"2023-11-15T02:53:37.606137+0000","last_unstale":"2023-11-15T02:53:37.981858+0000","last_undegraded":"2023-11-15T02:53:37.981858+0000","last_fullsized":"2023-11-15T02:53:37.981858+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002949+0000","last_change":"2023-11-15T02:53:37.999287+0000","last_active":"2023-11-15T02:53:38.002949+0000","last_peered":"2023-11-15T02:53:38.002949+0000","last_clean":"2023-11-15T02:53:38.002949+0000","last_became_active":"2023-11-15T02:53:37.998970+0000","last_became_peered":"2023-11-15T02:53:37.998970+0000","last_unstale":"2023-11-15T02:53:38.002949+0000","last_undegraded":"2023-11-15T02:53:38.002949+0000","last_fullsized":"2023-11-15T02:53:38.002949+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989720+0000","last_change":"2023-11-15T02:53:37.596882+0000","last_active":"2023-11-15T02:53:37.989720+0000","last_peered":"2023-11-15T02:53:37.989720+0000","last_clean":"2023-11-15T02:53:37.989720+0000","last_became_active":"2023-11-15T02:53:37.596607+0000","last_became_peered":"2023-11-15T02:53:37.596607+0000","last_unstale":"2023-11-15T02:53:37.989720+0000","last_undegraded":"2023-11-15T02:53:37.989720+0000","last_fullsized":"2023-11-15T02:53:37.989720+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008738+0000","last_change":"2023-11-15T02:53:38.007229+0000","last_active":"2023-11-15T02:53:38.008738+0000","last_peered":"2023-11-15T02:53:38.008738+0000","last_clean":"2023-11-15T02:53:38.008738+0000","last_became_active":"2023-11-15T02:53:38.006946+0000","last_became_peered":"2023-11-15T02:53:38.006946+0000","last_unstale":"2023-11-15T02:53:38.008738+0000","last_undegraded":"2023-11-15T02:53:38.008738+0000","last_fullsized":"2023-11-15T02:53:38.008738+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.994300+0000","last_change":"2023-11-15T02:53:37.597995+0000","last_active":"2023-11-15T02:53:37.994300+0000","last_peered":"2023-11-15T02:53:37.994300+0000","last_clean":"2023-11-15T02:53:37.994300+0000","last_became_active":"2023-11-15T02:53:37.597683+0000","last_became_peered":"2023-11-15T02:53:37.597683+0000","last_unstale":"2023-11-15T02:53:37.994300+0000","last_undegraded":"2023-11-15T02:53:37.994300+0000","last_fullsized":"2023-11-15T02:53:37.994300+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003079+0000","last_change":"2023-11-15T02:53:37.998235+0000","last_active":"2023-11-15T02:53:38.003079+0000","last_peered":"2023-11-15T02:53:38.003079+0000","last_clean":"2023-11-15T02:53:38.003079+0000","last_became_active":"2023-11-15T02:53:37.997964+0000","last_became_peered":"2023-11-15T02:53:37.997964+0000","last_unstale":"2023-11-15T02:53:38.003079+0000","last_undegraded":"2023-11-15T02:53:38.003079+0000","last_fullsized":"2023-11-15T02:53:38.003079+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.995410+0000","last_change":"2023-11-15T02:53:37.603411+0000","last_active":"2023-11-15T02:53:37.995410+0000","last_peered":"2023-11-15T02:53:37.995410+0000","last_clean":"2023-11-15T02:53:37.995410+0000","last_became_active":"2023-11-15T02:53:37.603074+0000","last_became_peered":"2023-11-15T02:53:37.603074+0000","last_unstale":"2023-11-15T02:53:37.995410+0000","last_undegraded":"2023-11-15T02:53:37.995410+0000","last_fullsized":"2023-11-15T02:53:37.995410+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.007921+0000","last_change":"2023-11-15T02:53:38.003127+0000","last_active":"2023-11-15T02:53:38.007921+0000","last_peered":"2023-11-15T02:53:38.007921+0000","last_clean":"2023-11-15T02:53:38.007921+0000","last_became_active":"2023-11-15T02:53:38.002839+0000","last_became_peered":"2023-11-15T02:53:38.002839+0000","last_unstale":"2023-11-15T02:53:38.007921+0000","last_undegraded":"2023-11-15T02:53:38.007921+0000","last_fullsized":"2023-11-15T02:53:38.007921+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992555+0000","last_change":"2023-11-15T02:53:37.597628+0000","last_active":"2023-11-15T02:53:37.992555+0000","last_peered":"2023-11-15T02:53:37.992555+0000","last_clean":"2023-11-15T02:53:37.992555+0000","last_became_active":"2023-11-15T02:53:37.597332+0000","last_became_peered":"2023-11-15T02:53:37.597332+0000","last_unstale":"2023-11-15T02:53:37.992555+0000","last_undegraded":"2023-11-15T02:53:37.992555+0000","last_fullsized":"2023-11-15T02:53:37.992555+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009318+0000","last_change":"2023-11-15T02:53:38.001828+0000","last_active":"2023-11-15T02:53:38.009318+0000","last_peered":"2023-11-15T02:53:38.009318+0000","last_clean":"2023-11-15T02:53:38.009318+0000","last_became_active":"2023-11-15T02:53:37.997960+0000","last_became_peered":"2023-11-15T02:53:37.997960+0000","last_unstale":"2023-11-15T02:53:38.009318+0000","last_undegraded":"2023-11-15T02:53:38.009318+0000","last_fullsized":"2023-11-15T02:53:38.009318+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"195'4","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011033+0000","last_change":"2023-11-15T02:53:37.601586+0000","last_active":"2023-11-15T02:53:38.011033+0000","last_peered":"2023-11-15T02:53:38.011033+0000","last_clean":"2023-11-15T02:53:38.011033+0000","last_became_active":"2023-11-15T02:53:37.601290+0000","last_became_peered":"2023-11-15T02:53:37.601290+0000","last_unstale":"2023-11-15T02:53:38.011033+0000","last_undegraded":"2023-11-15T02:53:38.011033+0000","last_fullsized":"2023-11-15T02:53:38.011033+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001253+0000","last_change":"2023-11-15T02:53:37.996705+0000","last_active":"2023-11-15T02:53:38.001253+0000","last_peered":"2023-11-15T02:53:38.001253+0000","last_clean":"2023-11-15T02:53:38.001253+0000","last_became_active":"2023-11-15T02:53:37.995805+0000","last_became_peered":"2023-11-15T02:53:37.995805+0000","last_unstale":"2023-11-15T02:53:38.001253+0000","last_undegraded":"2023-11-15T02:53:38.001253+0000","last_fullsized":"2023-11-15T02:53:38.001253+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010242+0000","last_change":"2023-11-15T02:53:37.604059+0000","last_active":"2023-11-15T02:53:38.010242+0000","last_peered":"2023-11-15T02:53:38.010242+0000","last_clean":"2023-11-15T02:53:38.010242+0000","last_became_active":"2023-11-15T02:53:37.603596+0000","last_became_peered":"2023-11-15T02:53:37.603596+0000","last_unstale":"2023-11-15T02:53:38.010242+0000","last_undegraded":"2023-11-15T02:53:38.010242+0000","last_fullsized":"2023-11-15T02:53:38.010242+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001234+0000","last_change":"2023-11-15T02:53:37.997221+0000","last_active":"2023-11-15T02:53:38.001234+0000","last_peered":"2023-11-15T02:53:38.001234+0000","last_clean":"2023-11-15T02:53:38.001234+0000","last_became_active":"2023-11-15T02:53:37.996900+0000","last_became_peered":"2023-11-15T02:53:37.996900+0000","last_unstale":"2023-11-15T02:53:38.001234+0000","last_undegraded":"2023-11-15T02:53:38.001234+0000","last_fullsized":"2023-11-15T02:53:38.001234+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989867+0000","last_change":"2023-11-15T02:53:37.605082+0000","last_active":"2023-11-15T02:53:37.989867+0000","last_peered":"2023-11-15T02:53:37.989867+0000","last_clean":"2023-11-15T02:53:37.989867+0000","last_became_active":"2023-11-15T02:53:37.604780+0000","last_became_peered":"2023-11-15T02:53:37.604780+0000","last_unstale":"2023-11-15T02:53:37.989867+0000","last_undegraded":"2023-11-15T02:53:37.989867+0000","last_fullsized":"2023-11-15T02:53:37.989867+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.013267+0000","last_change":"2023-11-15T02:53:38.012265+0000","last_active":"2023-11-15T02:53:38.013267+0000","last_peered":"2023-11-15T02:53:38.013267+0000","last_clean":"2023-11-15T02:53:38.013267+0000","last_became_active":"2023-11-15T02:53:38.011882+0000","last_became_peered":"2023-11-15T02:53:38.011882+0000","last_unstale":"2023-11-15T02:53:38.013267+0000","last_undegraded":"2023-11-15T02:53:38.013267+0000","last_fullsized":"2023-11-15T02:53:38.013267+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.991858+0000","last_change":"2023-11-15T02:53:37.604365+0000","last_active":"2023-11-15T02:53:37.991858+0000","last_peered":"2023-11-15T02:53:37.991858+0000","last_clean":"2023-11-15T02:53:37.991858+0000","last_became_active":"2023-11-15T02:53:37.604087+0000","last_became_peered":"2023-11-15T02:53:37.604087+0000","last_unstale":"2023-11-15T02:53:37.991858+0000","last_undegraded":"2023-11-15T02:53:37.991858+0000","last_fullsized":"2023-11-15T02:53:37.991858+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008119+0000","last_change":"2023-11-15T02:53:38.003008+0000","last_active":"2023-11-15T02:53:38.008119+0000","last_peered":"2023-11-15T02:53:38.008119+0000","last_clean":"2023-11-15T02:53:38.008119+0000","last_became_active":"2023-11-15T02:53:38.002701+0000","last_became_peered":"2023-11-15T02:53:38.002701+0000","last_unstale":"2023-11-15T02:53:38.008119+0000","last_undegraded":"2023-11-15T02:53:38.008119+0000","last_fullsized":"2023-11-15T02:53:38.008119+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"195'4","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.000336+0000","last_change":"2023-11-15T02:53:37.608083+0000","last_active":"2023-11-15T02:53:38.000336+0000","last_peered":"2023-11-15T02:53:38.000336+0000","last_clean":"2023-11-15T02:53:38.000336+0000","last_became_active":"2023-11-15T02:53:37.607564+0000","last_became_peered":"2023-11-15T02:53:37.607564+0000","last_unstale":"2023-11-15T02:53:38.000336+0000","last_undegraded":"2023-11-15T02:53:38.000336+0000","last_fullsized":"2023-11-15T02:53:38.000336+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002097+0000","last_change":"2023-11-15T02:53:38.000908+0000","last_active":"2023-11-15T02:53:38.002097+0000","last_peered":"2023-11-15T02:53:38.002097+0000","last_clean":"2023-11-15T02:53:38.002097+0000","last_became_active":"2023-11-15T02:53:38.000211+0000","last_became_peered":"2023-11-15T02:53:38.000211+0000","last_unstale":"2023-11-15T02:53:38.002097+0000","last_undegraded":"2023-11-15T02:53:38.002097+0000","last_fullsized":"2023-11-15T02:53:38.002097+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987749+0000","last_change":"2023-11-15T02:53:37.601064+0000","last_active":"2023-11-15T02:53:37.987749+0000","last_peered":"2023-11-15T02:53:37.987749+0000","last_clean":"2023-11-15T02:53:37.987749+0000","last_became_active":"2023-11-15T02:53:37.600760+0000","last_became_peered":"2023-11-15T02:53:37.600760+0000","last_unstale":"2023-11-15T02:53:37.987749+0000","last_undegraded":"2023-11-15T02:53:37.987749+0000","last_fullsized":"2023-11-15T02:53:37.987749+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.016084+0000","last_change":"2023-11-15T02:53:38.012049+0000","last_active":"2023-11-15T02:53:38.016084+0000","last_peered":"2023-11-15T02:53:38.016084+0000","last_clean":"2023-11-15T02:53:38.016084+0000","last_became_active":"2023-11-15T02:53:38.011349+0000","last_became_peered":"2023-11-15T02:53:38.011349+0000","last_unstale":"2023-11-15T02:53:38.016084+0000","last_undegraded":"2023-11-15T02:53:38.016084+0000","last_fullsized":"2023-11-15T02:53:38.016084+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984955+0000","last_change":"2023-11-15T02:53:37.603600+0000","last_active":"2023-11-15T02:53:37.984955+0000","last_peered":"2023-11-15T02:53:37.984955+0000","last_clean":"2023-11-15T02:53:37.984955+0000","last_became_active":"2023-11-15T02:53:37.603284+0000","last_became_peered":"2023-11-15T02:53:37.603284+0000","last_unstale":"2023-11-15T02:53:37.984955+0000","last_undegraded":"2023-11-15T02:53:37.984955+0000","last_fullsized":"2023-11-15T02:53:37.984955+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002020+0000","last_change":"2023-11-15T02:53:38.000564+0000","last_active":"2023-11-15T02:53:38.002020+0000","last_peered":"2023-11-15T02:53:38.002020+0000","last_clean":"2023-11-15T02:53:38.002020+0000","last_became_active":"2023-11-15T02:53:38.000288+0000","last_became_peered":"2023-11-15T02:53:38.000288+0000","last_unstale":"2023-11-15T02:53:38.002020+0000","last_undegraded":"2023-11-15T02:53:38.002020+0000","last_fullsized":"2023-11-15T02:53:38.002020+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002993+0000","last_change":"2023-11-15T02:53:37.600693+0000","last_active":"2023-11-15T02:53:38.002993+0000","last_peered":"2023-11-15T02:53:38.002993+0000","last_clean":"2023-11-15T02:53:38.002993+0000","last_became_active":"2023-11-15T02:53:37.600356+0000","last_became_peered":"2023-11-15T02:53:37.600356+0000","last_unstale":"2023-11-15T02:53:38.002993+0000","last_undegraded":"2023-11-15T02:53:38.002993+0000","last_fullsized":"2023-11-15T02:53:38.002993+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.007925+0000","last_change":"2023-11-15T02:53:38.004010+0000","last_active":"2023-11-15T02:53:38.007925+0000","last_peered":"2023-11-15T02:53:38.007925+0000","last_clean":"2023-11-15T02:53:38.007925+0000","last_became_active":"2023-11-15T02:53:38.003715+0000","last_became_peered":"2023-11-15T02:53:38.003715+0000","last_unstale":"2023-11-15T02:53:38.007925+0000","last_undegraded":"2023-11-15T02:53:38.007925+0000","last_fullsized":"2023-11-15T02:53:38.007925+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989453+0000","last_change":"2023-11-15T02:53:37.602439+0000","last_active":"2023-11-15T02:53:37.989453+0000","last_peered":"2023-11-15T02:53:37.989453+0000","last_clean":"2023-11-15T02:53:37.989453+0000","last_became_active":"2023-11-15T02:53:37.602154+0000","last_became_peered":"2023-11-15T02:53:37.602154+0000","last_unstale":"2023-11-15T02:53:37.989453+0000","last_undegraded":"2023-11-15T02:53:37.989453+0000","last_fullsized":"2023-11-15T02:53:37.989453+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009800+0000","last_change":"2023-11-15T02:53:38.006153+0000","last_active":"2023-11-15T02:53:38.009800+0000","last_peered":"2023-11-15T02:53:38.009800+0000","last_clean":"2023-11-15T02:53:38.009800+0000","last_became_active":"2023-11-15T02:53:38.005382+0000","last_became_peered":"2023-11-15T02:53:38.005382+0000","last_unstale":"2023-11-15T02:53:38.009800+0000","last_undegraded":"2023-11-15T02:53:38.009800+0000","last_fullsized":"2023-11-15T02:53:38.009800+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002479+0000","last_change":"2023-11-15T02:53:37.600307+0000","last_active":"2023-11-15T02:53:38.002479+0000","last_peered":"2023-11-15T02:53:38.002479+0000","last_clean":"2023-11-15T02:53:38.002479+0000","last_became_active":"2023-11-15T02:53:37.599973+0000","last_became_peered":"2023-11-15T02:53:37.599973+0000","last_unstale":"2023-11-15T02:53:38.002479+0000","last_undegraded":"2023-11-15T02:53:38.002479+0000","last_fullsized":"2023-11-15T02:53:38.002479+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006387+0000","last_change":"2023-11-15T02:53:38.000564+0000","last_active":"2023-11-15T02:53:38.006387+0000","last_peered":"2023-11-15T02:53:38.006387+0000","last_clean":"2023-11-15T02:53:38.006387+0000","last_became_active":"2023-11-15T02:53:38.000275+0000","last_became_peered":"2023-11-15T02:53:38.000275+0000","last_unstale":"2023-11-15T02:53:38.006387+0000","last_undegraded":"2023-11-15T02:53:38.006387+0000","last_fullsized":"2023-11-15T02:53:38.006387+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.993463+0000","last_change":"2023-11-15T02:53:37.607356+0000","last_active":"2023-11-15T02:53:37.993463+0000","last_peered":"2023-11-15T02:53:37.993463+0000","last_clean":"2023-11-15T02:53:37.993463+0000","last_became_active":"2023-11-15T02:53:37.607085+0000","last_became_peered":"2023-11-15T02:53:37.607085+0000","last_unstale":"2023-11-15T02:53:37.993463+0000","last_undegraded":"2023-11-15T02:53:37.993463+0000","last_fullsized":"2023-11-15T02:53:37.993463+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006231+0000","last_change":"2023-11-15T02:53:38.003771+0000","last_active":"2023-11-15T02:53:38.006231+0000","last_peered":"2023-11-15T02:53:38.006231+0000","last_clean":"2023-11-15T02:53:38.006231+0000","last_became_active":"2023-11-15T02:53:38.003121+0000","last_became_peered":"2023-11-15T02:53:38.003121+0000","last_unstale":"2023-11-15T02:53:38.006231+0000","last_undegraded":"2023-11-15T02:53:38.006231+0000","last_fullsized":"2023-11-15T02:53:38.006231+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987451+0000","last_change":"2023-11-15T02:53:37.596686+0000","last_active":"2023-11-15T02:53:37.987451+0000","last_peered":"2023-11-15T02:53:37.987451+0000","last_clean":"2023-11-15T02:53:37.987451+0000","last_became_active":"2023-11-15T02:53:37.596410+0000","last_became_peered":"2023-11-15T02:53:37.596410+0000","last_unstale":"2023-11-15T02:53:37.987451+0000","last_undegraded":"2023-11-15T02:53:37.987451+0000","last_fullsized":"2023-11-15T02:53:37.987451+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011367+0000","last_change":"2023-11-15T02:53:38.010715+0000","last_active":"2023-11-15T02:53:38.011367+0000","last_peered":"2023-11-15T02:53:38.011367+0000","last_clean":"2023-11-15T02:53:38.011367+0000","last_became_active":"2023-11-15T02:53:38.010419+0000","last_became_peered":"2023-11-15T02:53:38.010419+0000","last_unstale":"2023-11-15T02:53:38.011367+0000","last_undegraded":"2023-11-15T02:53:38.011367+0000","last_fullsized":"2023-11-15T02:53:38.011367+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989838+0000","last_change":"2023-11-15T02:53:37.600629+0000","last_active":"2023-11-15T02:53:37.989838+0000","last_peered":"2023-11-15T02:53:37.989838+0000","last_clean":"2023-11-15T02:53:37.989838+0000","last_became_active":"2023-11-15T02:53:37.600331+0000","last_became_peered":"2023-11-15T02:53:37.600331+0000","last_unstale":"2023-11-15T02:53:37.989838+0000","last_undegraded":"2023-11-15T02:53:37.989838+0000","last_fullsized":"2023-11-15T02:53:37.989838+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999239+0000","last_change":"2023-11-15T02:53:37.994959+0000","last_active":"2023-11-15T02:53:37.999239+0000","last_peered":"2023-11-15T02:53:37.999239+0000","last_clean":"2023-11-15T02:53:37.999239+0000","last_became_active":"2023-11-15T02:53:37.994284+0000","last_became_peered":"2023-11-15T02:53:37.994284+0000","last_unstale":"2023-11-15T02:53:37.999239+0000","last_undegraded":"2023-11-15T02:53:37.999239+0000","last_fullsized":"2023-11-15T02:53:37.999239+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.997791+0000","last_change":"2023-11-15T02:53:37.600152+0000","last_active":"2023-11-15T02:53:37.997791+0000","last_peered":"2023-11-15T02:53:37.997791+0000","last_clean":"2023-11-15T02:53:37.997791+0000","last_became_active":"2023-11-15T02:53:37.599885+0000","last_became_peered":"2023-11-15T02:53:37.599885+0000","last_unstale":"2023-11-15T02:53:37.997791+0000","last_undegraded":"2023-11-15T02:53:37.997791+0000","last_fullsized":"2023-11-15T02:53:37.997791+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009330+0000","last_change":"2023-11-15T02:53:38.003735+0000","last_active":"2023-11-15T02:53:38.009330+0000","last_peered":"2023-11-15T02:53:38.009330+0000","last_clean":"2023-11-15T02:53:38.009330+0000","last_became_active":"2023-11-15T02:53:38.003432+0000","last_became_peered":"2023-11-15T02:53:38.003432+0000","last_unstale":"2023-11-15T02:53:38.009330+0000","last_undegraded":"2023-11-15T02:53:38.009330+0000","last_fullsized":"2023-11-15T02:53:38.009330+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-11-15T02:53:40.151908+0000","last_change":"2023-11-15T02:53:37.608038+0000","last_active":"2023-11-15T02:53:40.151908+0000","last_peered":"2023-11-15T02:53:40.151908+0000","last_clean":"2023-11-15T02:53:40.151908+0000","last_became_active":"2023-11-15T02:53:37.607545+0000","last_became_peered":"2023-11-15T02:53:37.607545+0000","last_unstale":"2023-11-15T02:53:40.151908+0000","last_undegraded":"2023-11-15T02:53:40.151908+0000","last_fullsized":"2023-11-15T02:53:40.151908+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005747+0000","last_change":"2023-11-15T02:53:38.000626+0000","last_active":"2023-11-15T02:53:38.005747+0000","last_peered":"2023-11-15T02:53:38.005747+0000","last_clean":"2023-11-15T02:53:38.005747+0000","last_became_active":"2023-11-15T02:53:38.000346+0000","last_became_peered":"2023-11-15T02:53:38.000346+0000","last_unstale":"2023-11-15T02:53:38.005747+0000","last_undegraded":"2023-11-15T02:53:38.005747+0000","last_fullsized":"2023-11-15T02:53:38.005747+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999272+0000","last_change":"2023-11-15T02:53:37.602774+0000","last_active":"2023-11-15T02:53:37.999272+0000","last_peered":"2023-11-15T02:53:37.999272+0000","last_clean":"2023-11-15T02:53:37.999272+0000","last_became_active":"2023-11-15T02:53:37.602261+0000","last_became_peered":"2023-11-15T02:53:37.602261+0000","last_unstale":"2023-11-15T02:53:37.999272+0000","last_undegraded":"2023-11-15T02:53:37.999272+0000","last_fullsized":"2023-11-15T02:53:37.999272+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005731+0000","last_change":"2023-11-15T02:53:38.004561+0000","last_active":"2023-11-15T02:53:38.005731+0000","last_peered":"2023-11-15T02:53:38.005731+0000","last_clean":"2023-11-15T02:53:38.005731+0000","last_became_active":"2023-11-15T02:53:38.004279+0000","last_became_peered":"2023-11-15T02:53:38.004279+0000","last_unstale":"2023-11-15T02:53:38.005731+0000","last_undegraded":"2023-11-15T02:53:38.005731+0000","last_fullsized":"2023-11-15T02:53:38.005731+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998408+0000","last_change":"2023-11-15T02:53:37.606814+0000","last_active":"2023-11-15T02:53:37.998408+0000","last_peered":"2023-11-15T02:53:37.998408+0000","last_clean":"2023-11-15T02:53:37.998408+0000","last_became_active":"2023-11-15T02:53:37.606517+0000","last_became_peered":"2023-11-15T02:53:37.606517+0000","last_unstale":"2023-11-15T02:53:37.998408+0000","last_undegraded":"2023-11-15T02:53:37.998408+0000","last_fullsized":"2023-11-15T02:53:37.998408+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002264+0000","last_change":"2023-11-15T02:53:37.998598+0000","last_active":"2023-11-15T02:53:38.002264+0000","last_peered":"2023-11-15T02:53:38.002264+0000","last_clean":"2023-11-15T02:53:38.002264+0000","last_became_active":"2023-11-15T02:53:37.998240+0000","last_became_peered":"2023-11-15T02:53:37.998240+0000","last_unstale":"2023-11-15T02:53:38.002264+0000","last_undegraded":"2023-11-15T02:53:38.002264+0000","last_fullsized":"2023-11-15T02:53:38.002264+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989840+0000","last_change":"2023-11-15T02:53:37.603875+0000","last_active":"2023-11-15T02:53:37.989840+0000","last_peered":"2023-11-15T02:53:37.989840+0000","last_clean":"2023-11-15T02:53:37.989840+0000","last_became_active":"2023-11-15T02:53:37.603204+0000","last_became_peered":"2023-11-15T02:53:37.603204+0000","last_unstale":"2023-11-15T02:53:37.989840+0000","last_undegraded":"2023-11-15T02:53:37.989840+0000","last_fullsized":"2023-11-15T02:53:37.989840+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010801+0000","last_change":"2023-11-15T02:53:38.009250+0000","last_active":"2023-11-15T02:53:38.010801+0000","last_peered":"2023-11-15T02:53:38.010801+0000","last_clean":"2023-11-15T02:53:38.010801+0000","last_became_active":"2023-11-15T02:53:38.009018+0000","last_became_peered":"2023-11-15T02:53:38.009018+0000","last_unstale":"2023-11-15T02:53:38.010801+0000","last_undegraded":"2023-11-15T02:53:38.010801+0000","last_fullsized":"2023-11-15T02:53:38.010801+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.986167+0000","last_change":"2023-11-15T02:53:37.604578+0000","last_active":"2023-11-15T02:53:37.986167+0000","last_peered":"2023-11-15T02:53:37.986167+0000","last_clean":"2023-11-15T02:53:37.986167+0000","last_became_active":"2023-11-15T02:53:37.604300+0000","last_became_peered":"2023-11-15T02:53:37.604300+0000","last_unstale":"2023-11-15T02:53:37.986167+0000","last_undegraded":"2023-11-15T02:53:37.986167+0000","last_fullsized":"2023-11-15T02:53:37.986167+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010581+0000","last_change":"2023-11-15T02:53:38.005419+0000","last_active":"2023-11-15T02:53:38.010581+0000","last_peered":"2023-11-15T02:53:38.010581+0000","last_clean":"2023-11-15T02:53:38.010581+0000","last_became_active":"2023-11-15T02:53:38.005121+0000","last_became_peered":"2023-11-15T02:53:38.005121+0000","last_unstale":"2023-11-15T02:53:38.010581+0000","last_undegraded":"2023-11-15T02:53:38.010581+0000","last_fullsized":"2023-11-15T02:53:38.010581+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.986004+0000","last_change":"2023-11-15T02:53:37.608032+0000","last_active":"2023-11-15T02:53:37.986004+0000","last_peered":"2023-11-15T02:53:37.986004+0000","last_clean":"2023-11-15T02:53:37.986004+0000","last_became_active":"2023-11-15T02:53:37.607639+0000","last_became_peered":"2023-11-15T02:53:37.607639+0000","last_unstale":"2023-11-15T02:53:37.986004+0000","last_undegraded":"2023-11-15T02:53:37.986004+0000","last_fullsized":"2023-11-15T02:53:37.986004+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009389+0000","last_change":"2023-11-15T02:53:38.008531+0000","last_active":"2023-11-15T02:53:38.009389+0000","last_peered":"2023-11-15T02:53:38.009389+0000","last_clean":"2023-11-15T02:53:38.009389+0000","last_became_active":"2023-11-15T02:53:38.008308+0000","last_became_peered":"2023-11-15T02:53:38.008308+0000","last_unstale":"2023-11-15T02:53:38.009389+0000","last_undegraded":"2023-11-15T02:53:38.009389+0000","last_fullsized":"2023-11-15T02:53:38.009389+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984117+0000","last_change":"2023-11-15T02:53:37.603697+0000","last_active":"2023-11-15T02:53:37.984117+0000","last_peered":"2023-11-15T02:53:37.984117+0000","last_clean":"2023-11-15T02:53:37.984117+0000","last_became_active":"2023-11-15T02:53:37.603383+0000","last_became_peered":"2023-11-15T02:53:37.603383+0000","last_unstale":"2023-11-15T02:53:37.984117+0000","last_undegraded":"2023-11-15T02:53:37.984117+0000","last_fullsized":"2023-11-15T02:53:37.984117+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009909+0000","last_change":"2023-11-15T02:53:38.006412+0000","last_active":"2023-11-15T02:53:38.009909+0000","last_peered":"2023-11-15T02:53:38.009909+0000","last_clean":"2023-11-15T02:53:38.009909+0000","last_became_active":"2023-11-15T02:53:38.006097+0000","last_became_peered":"2023-11-15T02:53:38.006097+0000","last_unstale":"2023-11-15T02:53:38.009909+0000","last_undegraded":"2023-11-15T02:53:38.009909+0000","last_fullsized":"2023-11-15T02:53:38.009909+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999987+0000","last_change":"2023-11-15T02:53:37.605820+0000","last_active":"2023-11-15T02:53:37.999987+0000","last_peered":"2023-11-15T02:53:37.999987+0000","last_clean":"2023-11-15T02:53:37.999987+0000","last_became_active":"2023-11-15T02:53:37.605501+0000","last_became_peered":"2023-11-15T02:53:37.605501+0000","last_unstale":"2023-11-15T02:53:37.999987+0000","last_undegraded":"2023-11-15T02:53:37.999987+0000","last_fullsized":"2023-11-15T02:53:37.999987+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006092+0000","last_change":"2023-11-15T02:53:38.004891+0000","last_active":"2023-11-15T02:53:38.006092+0000","last_peered":"2023-11-15T02:53:38.006092+0000","last_clean":"2023-11-15T02:53:38.006092+0000","last_became_active":"2023-11-15T02:53:38.004627+0000","last_became_peered":"2023-11-15T02:53:38.004627+0000","last_unstale":"2023-11-15T02:53:38.006092+0000","last_undegraded":"2023-11-15T02:53:38.006092+0000","last_fullsized":"2023-11-15T02:53:38.006092+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003886+0000","last_change":"2023-11-15T02:53:37.607870+0000","last_active":"2023-11-15T02:53:38.003886+0000","last_peered":"2023-11-15T02:53:38.003886+0000","last_clean":"2023-11-15T02:53:38.003886+0000","last_became_active":"2023-11-15T02:53:37.607197+0000","last_became_peered":"2023-11-15T02:53:37.607197+0000","last_unstale":"2023-11-15T02:53:38.003886+0000","last_undegraded":"2023-11-15T02:53:38.003886+0000","last_fullsized":"2023-11-15T02:53:38.003886+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998637+0000","last_change":"2023-11-15T02:53:37.991469+0000","last_active":"2023-11-15T02:53:37.998637+0000","last_peered":"2023-11-15T02:53:37.998637+0000","last_clean":"2023-11-15T02:53:37.998637+0000","last_became_active":"2023-11-15T02:53:37.991176+0000","last_became_peered":"2023-11-15T02:53:37.991176+0000","last_unstale":"2023-11-15T02:53:37.998637+0000","last_undegraded":"2023-11-15T02:53:37.998637+0000","last_fullsized":"2023-11-15T02:53:37.998637+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009368+0000","last_change":"2023-11-15T02:53:37.602556+0000","last_active":"2023-11-15T02:53:38.009368+0000","last_peered":"2023-11-15T02:53:38.009368+0000","last_clean":"2023-11-15T02:53:38.009368+0000","last_became_active":"2023-11-15T02:53:37.601820+0000","last_became_peered":"2023-11-15T02:53:37.601820+0000","last_unstale":"2023-11-15T02:53:38.009368+0000","last_undegraded":"2023-11-15T02:53:38.009368+0000","last_fullsized":"2023-11-15T02:53:38.009368+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010539+0000","last_change":"2023-11-15T02:53:38.005868+0000","last_active":"2023-11-15T02:53:38.010539+0000","last_peered":"2023-11-15T02:53:38.010539+0000","last_clean":"2023-11-15T02:53:38.010539+0000","last_became_active":"2023-11-15T02:53:38.005558+0000","last_became_peered":"2023-11-15T02:53:38.005558+0000","last_unstale":"2023-11-15T02:53:38.010539+0000","last_undegraded":"2023-11-15T02:53:38.010539+0000","last_fullsized":"2023-11-15T02:53:38.010539+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987451+0000","last_change":"2023-11-15T02:53:37.601130+0000","last_active":"2023-11-15T02:53:37.987451+0000","last_peered":"2023-11-15T02:53:37.987451+0000","last_clean":"2023-11-15T02:53:37.987451+0000","last_became_active":"2023-11-15T02:53:37.600820+0000","last_became_peered":"2023-11-15T02:53:37.600820+0000","last_unstale":"2023-11-15T02:53:37.987451+0000","last_undegraded":"2023-11-15T02:53:37.987451+0000","last_fullsized":"2023-11-15T02:53:37.987451+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003379+0000","last_change":"2023-11-15T02:53:38.001102+0000","last_active":"2023-11-15T02:53:38.003379+0000","last_peered":"2023-11-15T02:53:38.003379+0000","last_clean":"2023-11-15T02:53:38.003379+0000","last_became_active":"2023-11-15T02:53:38.000814+0000","last_became_peered":"2023-11-15T02:53:38.000814+0000","last_unstale":"2023-11-15T02:53:38.003379+0000","last_undegraded":"2023-11-15T02:53:38.003379+0000","last_fullsized":"2023-11-15T02:53:38.003379+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998161+0000","last_change":"2023-11-15T02:53:37.609358+0000","last_active":"2023-11-15T02:53:37.998161+0000","last_peered":"2023-11-15T02:53:37.998161+0000","last_clean":"2023-11-15T02:53:37.998161+0000","last_became_active":"2023-11-15T02:53:37.608596+0000","last_became_peered":"2023-11-15T02:53:37.608596+0000","last_unstale":"2023-11-15T02:53:37.998161+0000","last_undegraded":"2023-11-15T02:53:37.998161+0000","last_fullsized":"2023-11-15T02:53:37.998161+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.995398+0000","last_change":"2023-11-15T02:53:37.993686+0000","last_active":"2023-11-15T02:53:37.995398+0000","last_peered":"2023-11-15T02:53:37.995398+0000","last_clean":"2023-11-15T02:53:37.995398+0000","last_became_active":"2023-11-15T02:53:37.993388+0000","last_became_peered":"2023-11-15T02:53:37.993388+0000","last_unstale":"2023-11-15T02:53:37.995398+0000","last_undegraded":"2023-11-15T02:53:37.995398+0000","last_fullsized":"2023-11-15T02:53:37.995398+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.982323+0000","last_change":"2023-11-15T02:53:37.607029+0000","last_active":"2023-11-15T02:53:37.982323+0000","last_peered":"2023-11-15T02:53:37.982323+0000","last_clean":"2023-11-15T02:53:37.982323+0000","last_became_active":"2023-11-15T02:53:37.606692+0000","last_became_peered":"2023-11-15T02:53:37.606692+0000","last_unstale":"2023-11-15T02:53:37.982323+0000","last_undegraded":"2023-11-15T02:53:37.982323+0000","last_fullsized":"2023-11-15T02:53:37.982323+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006246+0000","last_change":"2023-11-15T02:53:38.003944+0000","last_active":"2023-11-15T02:53:38.006246+0000","last_peered":"2023-11-15T02:53:38.006246+0000","last_clean":"2023-11-15T02:53:38.006246+0000","last_became_active":"2023-11-15T02:53:38.003507+0000","last_became_peered":"2023-11-15T02:53:38.003507+0000","last_unstale":"2023-11-15T02:53:38.006246+0000","last_undegraded":"2023-11-15T02:53:38.006246+0000","last_fullsized":"2023-11-15T02:53:38.006246+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987342+0000","last_change":"2023-11-15T02:53:37.609959+0000","last_active":"2023-11-15T02:53:37.987342+0000","last_peered":"2023-11-15T02:53:37.987342+0000","last_clean":"2023-11-15T02:53:37.987342+0000","last_became_active":"2023-11-15T02:53:37.609646+0000","last_became_peered":"2023-11-15T02:53:37.609646+0000","last_unstale":"2023-11-15T02:53:37.987342+0000","last_undegraded":"2023-11-15T02:53:37.987342+0000","last_fullsized":"2023-11-15T02:53:37.987342+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008553+0000","last_change":"2023-11-15T02:53:38.007038+0000","last_active":"2023-11-15T02:53:38.008553+0000","last_peered":"2023-11-15T02:53:38.008553+0000","last_clean":"2023-11-15T02:53:38.008553+0000","last_became_active":"2023-11-15T02:53:38.006729+0000","last_became_peered":"2023-11-15T02:53:38.006729+0000","last_unstale":"2023-11-15T02:53:38.008553+0000","last_undegraded":"2023-11-15T02:53:38.008553+0000","last_fullsized":"2023-11-15T02:53:38.008553+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.996205+0000","last_change":"2023-11-15T02:53:37.606243+0000","last_active":"2023-11-15T02:53:37.996205+0000","last_peered":"2023-11-15T02:53:37.996205+0000","last_clean":"2023-11-15T02:53:37.996205+0000","last_became_active":"2023-11-15T02:53:37.605925+0000","last_became_peered":"2023-11-15T02:53:37.605925+0000","last_unstale":"2023-11-15T02:53:37.996205+0000","last_undegraded":"2023-11-15T02:53:37.996205+0000","last_fullsized":"2023-11-15T02:53:37.996205+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005006+0000","last_change":"2023-11-15T02:53:38.002861+0000","last_active":"2023-11-15T02:53:38.005006+0000","last_peered":"2023-11-15T02:53:38.005006+0000","last_clean":"2023-11-15T02:53:38.005006+0000","last_became_active":"2023-11-15T02:53:38.002540+0000","last_became_peered":"2023-11-15T02:53:38.002540+0000","last_unstale":"2023-11-15T02:53:38.005006+0000","last_undegraded":"2023-11-15T02:53:38.005006+0000","last_fullsized":"2023-11-15T02:53:38.005006+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.004585+0000","last_change":"2023-11-15T02:53:37.607128+0000","last_active":"2023-11-15T02:53:38.004585+0000","last_peered":"2023-11-15T02:53:38.004585+0000","last_clean":"2023-11-15T02:53:38.004585+0000","last_became_active":"2023-11-15T02:53:37.606792+0000","last_became_peered":"2023-11-15T02:53:37.606792+0000","last_unstale":"2023-11-15T02:53:38.004585+0000","last_undegraded":"2023-11-15T02:53:38.004585+0000","last_fullsized":"2023-11-15T02:53:38.004585+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.016079+0000","last_change":"2023-11-15T02:53:38.012509+0000","last_active":"2023-11-15T02:53:38.016079+0000","last_peered":"2023-11-15T02:53:38.016079+0000","last_clean":"2023-11-15T02:53:38.016079+0000","last_became_active":"2023-11-15T02:53:38.011598+0000","last_became_peered":"2023-11-15T02:53:38.011598+0000","last_unstale":"2023-11-15T02:53:38.016079+0000","last_undegraded":"2023-11-15T02:53:38.016079+0000","last_fullsized":"2023-11-15T02:53:38.016079+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006720+0000","last_change":"2023-11-15T02:53:37.605340+0000","last_active":"2023-11-15T02:53:38.006720+0000","last_peered":"2023-11-15T02:53:38.006720+0000","last_clean":"2023-11-15T02:53:38.006720+0000","last_became_active":"2023-11-15T02:53:37.604736+0000","last_became_peered":"2023-11-15T02:53:37.604736+0000","last_unstale":"2023-11-15T02:53:38.006720+0000","last_undegraded":"2023-11-15T02:53:38.006720+0000","last_fullsized":"2023-11-15T02:53:38.006720+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009363+0000","last_change":"2023-11-15T02:53:38.004869+0000","last_active":"2023-11-15T02:53:38.009363+0000","last_peered":"2023-11-15T02:53:38.009363+0000","last_clean":"2023-11-15T02:53:38.009363+0000","last_became_active":"2023-11-15T02:53:38.004603+0000","last_became_peered":"2023-11-15T02:53:38.004603+0000","last_unstale":"2023-11-15T02:53:38.009363+0000","last_undegraded":"2023-11-15T02:53:38.009363+0000","last_fullsized":"2023-11-15T02:53:38.009363+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.982661+0000","last_change":"2023-11-15T02:53:37.599911+0000","last_active":"2023-11-15T02:53:37.982661+0000","last_peered":"2023-11-15T02:53:37.982661+0000","last_clean":"2023-11-15T02:53:37.982661+0000","last_became_active":"2023-11-15T02:53:37.599611+0000","last_became_peered":"2023-11-15T02:53:37.599611+0000","last_unstale":"2023-11-15T02:53:37.982661+0000","last_undegraded":"2023-11-15T02:53:37.982661+0000","last_fullsized":"2023-11-15T02:53:37.982661+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011156+0000","last_change":"2023-11-15T02:53:38.006173+0000","last_active":"2023-11-15T02:53:38.011156+0000","last_peered":"2023-11-15T02:53:38.011156+0000","last_clean":"2023-11-15T02:53:38.011156+0000","last_became_active":"2023-11-15T02:53:38.005873+0000","last_became_peered":"2023-11-15T02:53:38.005873+0000","last_unstale":"2023-11-15T02:53:38.011156+0000","last_undegraded":"2023-11-15T02:53:38.011156+0000","last_fullsized":"2023-11-15T02:53:38.011156+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998518+0000","last_change":"2023-11-15T02:53:37.609046+0000","last_active":"2023-11-15T02:53:37.998518+0000","last_peered":"2023-11-15T02:53:37.998518+0000","last_clean":"2023-11-15T02:53:37.998518+0000","last_became_active":"2023-11-15T02:53:37.608665+0000","last_became_peered":"2023-11-15T02:53:37.608665+0000","last_unstale":"2023-11-15T02:53:37.998518+0000","last_undegraded":"2023-11-15T02:53:37.998518+0000","last_fullsized":"2023-11-15T02:53:37.998518+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009819+0000","last_change":"2023-11-15T02:53:38.006320+0000","last_active":"2023-11-15T02:53:38.009819+0000","last_peered":"2023-11-15T02:53:38.009819+0000","last_clean":"2023-11-15T02:53:38.009819+0000","last_became_active":"2023-11-15T02:53:38.005786+0000","last_became_peered":"2023-11-15T02:53:38.005786+0000","last_unstale":"2023-11-15T02:53:38.009819+0000","last_undegraded":"2023-11-15T02:53:38.009819+0000","last_fullsized":"2023-11-15T02:53:38.009819+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001944+0000","last_change":"2023-11-15T02:53:37.599390+0000","last_active":"2023-11-15T02:53:38.001944+0000","last_peered":"2023-11-15T02:53:38.001944+0000","last_clean":"2023-11-15T02:53:38.001944+0000","last_became_active":"2023-11-15T02:53:37.598476+0000","last_became_peered":"2023-11-15T02:53:37.598476+0000","last_unstale":"2023-11-15T02:53:38.001944+0000","last_undegraded":"2023-11-15T02:53:38.001944+0000","last_fullsized":"2023-11-15T02:53:38.001944+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009422+0000","last_change":"2023-11-15T02:53:38.005651+0000","last_active":"2023-11-15T02:53:38.009422+0000","last_peered":"2023-11-15T02:53:38.009422+0000","last_clean":"2023-11-15T02:53:38.009422+0000","last_became_active":"2023-11-15T02:53:38.005405+0000","last_became_peered":"2023-11-15T02:53:38.005405+0000","last_unstale":"2023-11-15T02:53:38.009422+0000","last_undegraded":"2023-11-15T02:53:38.009422+0000","last_fullsized":"2023-11-15T02:53:38.009422+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.996886+0000","last_change":"2023-11-15T02:53:37.603759+0000","last_active":"2023-11-15T02:53:37.996886+0000","last_peered":"2023-11-15T02:53:37.996886+0000","last_clean":"2023-11-15T02:53:37.996886+0000","last_became_active":"2023-11-15T02:53:37.603485+0000","last_became_peered":"2023-11-15T02:53:37.603485+0000","last_unstale":"2023-11-15T02:53:37.996886+0000","last_undegraded":"2023-11-15T02:53:37.996886+0000","last_fullsized":"2023-11-15T02:53:37.996886+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.999205+0000","last_change":"2023-11-15T02:53:37.998244+0000","last_active":"2023-11-15T02:53:37.999205+0000","last_peered":"2023-11-15T02:53:37.999205+0000","last_clean":"2023-11-15T02:53:37.999205+0000","last_became_active":"2023-11-15T02:53:37.997925+0000","last_became_peered":"2023-11-15T02:53:37.997925+0000","last_unstale":"2023-11-15T02:53:37.999205+0000","last_undegraded":"2023-11-15T02:53:37.999205+0000","last_fullsized":"2023-11-15T02:53:37.999205+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987621+0000","last_change":"2023-11-15T02:53:37.595509+0000","last_active":"2023-11-15T02:53:37.987621+0000","last_peered":"2023-11-15T02:53:37.987621+0000","last_clean":"2023-11-15T02:53:37.987621+0000","last_became_active":"2023-11-15T02:53:37.595150+0000","last_became_peered":"2023-11-15T02:53:37.595150+0000","last_unstale":"2023-11-15T02:53:37.987621+0000","last_undegraded":"2023-11-15T02:53:37.987621+0000","last_fullsized":"2023-11-15T02:53:37.987621+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006014+0000","last_change":"2023-11-15T02:53:37.998617+0000","last_active":"2023-11-15T02:53:38.006014+0000","last_peered":"2023-11-15T02:53:38.006014+0000","last_clean":"2023-11-15T02:53:38.006014+0000","last_became_active":"2023-11-15T02:53:37.998336+0000","last_became_peered":"2023-11-15T02:53:37.998336+0000","last_unstale":"2023-11-15T02:53:38.006014+0000","last_undegraded":"2023-11-15T02:53:38.006014+0000","last_fullsized":"2023-11-15T02:53:38.006014+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992794+0000","last_change":"2023-11-15T02:53:37.605177+0000","last_active":"2023-11-15T02:53:37.992794+0000","last_peered":"2023-11-15T02:53:37.992794+0000","last_clean":"2023-11-15T02:53:37.992794+0000","last_became_active":"2023-11-15T02:53:37.604785+0000","last_became_peered":"2023-11-15T02:53:37.604785+0000","last_unstale":"2023-11-15T02:53:37.992794+0000","last_undegraded":"2023-11-15T02:53:37.992794+0000","last_fullsized":"2023-11-15T02:53:37.992794+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009156+0000","last_change":"2023-11-15T02:53:38.005499+0000","last_active":"2023-11-15T02:53:38.009156+0000","last_peered":"2023-11-15T02:53:38.009156+0000","last_clean":"2023-11-15T02:53:38.009156+0000","last_became_active":"2023-11-15T02:53:38.005211+0000","last_became_peered":"2023-11-15T02:53:38.005211+0000","last_unstale":"2023-11-15T02:53:38.009156+0000","last_undegraded":"2023-11-15T02:53:38.009156+0000","last_fullsized":"2023-11-15T02:53:38.009156+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.005286+0000","last_change":"2023-11-15T02:53:37.593975+0000","last_active":"2023-11-15T02:53:38.005286+0000","last_peered":"2023-11-15T02:53:38.005286+0000","last_clean":"2023-11-15T02:53:38.005286+0000","last_became_active":"2023-11-15T02:53:37.593701+0000","last_became_peered":"2023-11-15T02:53:37.593701+0000","last_unstale":"2023-11-15T02:53:38.005286+0000","last_undegraded":"2023-11-15T02:53:38.005286+0000","last_fullsized":"2023-11-15T02:53:38.005286+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003057+0000","last_change":"2023-11-15T02:53:37.998034+0000","last_active":"2023-11-15T02:53:38.003057+0000","last_peered":"2023-11-15T02:53:38.003057+0000","last_clean":"2023-11-15T02:53:38.003057+0000","last_became_active":"2023-11-15T02:53:37.997729+0000","last_became_peered":"2023-11-15T02:53:37.997729+0000","last_unstale":"2023-11-15T02:53:38.003057+0000","last_undegraded":"2023-11-15T02:53:38.003057+0000","last_fullsized":"2023-11-15T02:53:38.003057+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.985057+0000","last_change":"2023-11-15T02:53:37.610489+0000","last_active":"2023-11-15T02:53:37.985057+0000","last_peered":"2023-11-15T02:53:37.985057+0000","last_clean":"2023-11-15T02:53:37.985057+0000","last_became_active":"2023-11-15T02:53:37.610002+0000","last_became_peered":"2023-11-15T02:53:37.610002+0000","last_unstale":"2023-11-15T02:53:37.985057+0000","last_undegraded":"2023-11-15T02:53:37.985057+0000","last_fullsized":"2023-11-15T02:53:37.985057+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002358+0000","last_change":"2023-11-15T02:53:38.000481+0000","last_active":"2023-11-15T02:53:38.002358+0000","last_peered":"2023-11-15T02:53:38.002358+0000","last_clean":"2023-11-15T02:53:38.002358+0000","last_became_active":"2023-11-15T02:53:38.000196+0000","last_became_peered":"2023-11-15T02:53:38.000196+0000","last_unstale":"2023-11-15T02:53:38.002358+0000","last_undegraded":"2023-11-15T02:53:38.002358+0000","last_fullsized":"2023-11-15T02:53:38.002358+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984215+0000","last_change":"2023-11-15T02:53:37.601783+0000","last_active":"2023-11-15T02:53:37.984215+0000","last_peered":"2023-11-15T02:53:37.984215+0000","last_clean":"2023-11-15T02:53:37.984215+0000","last_became_active":"2023-11-15T02:53:37.601473+0000","last_became_peered":"2023-11-15T02:53:37.601473+0000","last_unstale":"2023-11-15T02:53:37.984215+0000","last_undegraded":"2023-11-15T02:53:37.984215+0000","last_fullsized":"2023-11-15T02:53:37.984215+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.002345+0000","last_change":"2023-11-15T02:53:37.997031+0000","last_active":"2023-11-15T02:53:38.002345+0000","last_peered":"2023-11-15T02:53:38.002345+0000","last_clean":"2023-11-15T02:53:38.002345+0000","last_became_active":"2023-11-15T02:53:37.996771+0000","last_became_peered":"2023-11-15T02:53:37.996771+0000","last_unstale":"2023-11-15T02:53:38.002345+0000","last_undegraded":"2023-11-15T02:53:38.002345+0000","last_fullsized":"2023-11-15T02:53:38.002345+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987557+0000","last_change":"2023-11-15T02:53:37.603411+0000","last_active":"2023-11-15T02:53:37.987557+0000","last_peered":"2023-11-15T02:53:37.987557+0000","last_clean":"2023-11-15T02:53:37.987557+0000","last_became_active":"2023-11-15T02:53:37.603095+0000","last_became_peered":"2023-11-15T02:53:37.603095+0000","last_unstale":"2023-11-15T02:53:37.987557+0000","last_undegraded":"2023-11-15T02:53:37.987557+0000","last_fullsized":"2023-11-15T02:53:37.987557+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.000207+0000","last_change":"2023-11-15T02:53:37.992925+0000","last_active":"2023-11-15T02:53:38.000207+0000","last_peered":"2023-11-15T02:53:38.000207+0000","last_clean":"2023-11-15T02:53:38.000207+0000","last_became_active":"2023-11-15T02:53:37.991495+0000","last_became_peered":"2023-11-15T02:53:37.991495+0000","last_unstale":"2023-11-15T02:53:38.000207+0000","last_undegraded":"2023-11-15T02:53:38.000207+0000","last_fullsized":"2023-11-15T02:53:38.000207+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.986519+0000","last_change":"2023-11-15T02:53:37.602735+0000","last_active":"2023-11-15T02:53:37.986519+0000","last_peered":"2023-11-15T02:53:37.986519+0000","last_clean":"2023-11-15T02:53:37.986519+0000","last_became_active":"2023-11-15T02:53:37.602437+0000","last_became_peered":"2023-11-15T02:53:37.602437+0000","last_unstale":"2023-11-15T02:53:37.986519+0000","last_undegraded":"2023-11-15T02:53:37.986519+0000","last_fullsized":"2023-11-15T02:53:37.986519+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010619+0000","last_change":"2023-11-15T02:53:38.006525+0000","last_active":"2023-11-15T02:53:38.010619+0000","last_peered":"2023-11-15T02:53:38.010619+0000","last_clean":"2023-11-15T02:53:38.010619+0000","last_became_active":"2023-11-15T02:53:38.006118+0000","last_became_peered":"2023-11-15T02:53:38.006118+0000","last_unstale":"2023-11-15T02:53:38.010619+0000","last_undegraded":"2023-11-15T02:53:38.010619+0000","last_fullsized":"2023-11-15T02:53:38.010619+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.985276+0000","last_change":"2023-11-15T02:53:37.604591+0000","last_active":"2023-11-15T02:53:37.985276+0000","last_peered":"2023-11-15T02:53:37.985276+0000","last_clean":"2023-11-15T02:53:37.985276+0000","last_became_active":"2023-11-15T02:53:37.604050+0000","last_became_peered":"2023-11-15T02:53:37.604050+0000","last_unstale":"2023-11-15T02:53:37.985276+0000","last_undegraded":"2023-11-15T02:53:37.985276+0000","last_fullsized":"2023-11-15T02:53:37.985276+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009789+0000","last_change":"2023-11-15T02:53:38.005163+0000","last_active":"2023-11-15T02:53:38.009789+0000","last_peered":"2023-11-15T02:53:38.009789+0000","last_clean":"2023-11-15T02:53:38.009789+0000","last_became_active":"2023-11-15T02:53:38.004858+0000","last_became_peered":"2023-11-15T02:53:38.004858+0000","last_unstale":"2023-11-15T02:53:38.009789+0000","last_undegraded":"2023-11-15T02:53:38.009789+0000","last_fullsized":"2023-11-15T02:53:38.009789+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001263+0000","last_change":"2023-11-15T02:53:37.603691+0000","last_active":"2023-11-15T02:53:38.001263+0000","last_peered":"2023-11-15T02:53:38.001263+0000","last_clean":"2023-11-15T02:53:38.001263+0000","last_became_active":"2023-11-15T02:53:37.603376+0000","last_became_peered":"2023-11-15T02:53:37.603376+0000","last_unstale":"2023-11-15T02:53:38.001263+0000","last_undegraded":"2023-11-15T02:53:38.001263+0000","last_fullsized":"2023-11-15T02:53:38.001263+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009156+0000","last_change":"2023-11-15T02:53:38.007691+0000","last_active":"2023-11-15T02:53:38.009156+0000","last_peered":"2023-11-15T02:53:38.009156+0000","last_clean":"2023-11-15T02:53:38.009156+0000","last_became_active":"2023-11-15T02:53:38.007438+0000","last_became_peered":"2023-11-15T02:53:38.007438+0000","last_unstale":"2023-11-15T02:53:38.009156+0000","last_undegraded":"2023-11-15T02:53:38.009156+0000","last_fullsized":"2023-11-15T02:53:38.009156+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.981762+0000","last_change":"2023-11-15T02:53:37.607898+0000","last_active":"2023-11-15T02:53:37.981762+0000","last_peered":"2023-11-15T02:53:37.981762+0000","last_clean":"2023-11-15T02:53:37.981762+0000","last_became_active":"2023-11-15T02:53:37.607133+0000","last_became_peered":"2023-11-15T02:53:37.607133+0000","last_unstale":"2023-11-15T02:53:37.981762+0000","last_undegraded":"2023-11-15T02:53:37.981762+0000","last_fullsized":"2023-11-15T02:53:37.981762+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010798+0000","last_change":"2023-11-15T02:53:38.009352+0000","last_active":"2023-11-15T02:53:38.010798+0000","last_peered":"2023-11-15T02:53:38.010798+0000","last_clean":"2023-11-15T02:53:38.010798+0000","last_became_active":"2023-11-15T02:53:38.007690+0000","last_became_peered":"2023-11-15T02:53:38.007690+0000","last_unstale":"2023-11-15T02:53:38.010798+0000","last_undegraded":"2023-11-15T02:53:38.010798+0000","last_fullsized":"2023-11-15T02:53:38.010798+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003527+0000","last_change":"2023-11-15T02:53:37.607389+0000","last_active":"2023-11-15T02:53:38.003527+0000","last_peered":"2023-11-15T02:53:38.003527+0000","last_clean":"2023-11-15T02:53:38.003527+0000","last_became_active":"2023-11-15T02:53:37.607111+0000","last_became_peered":"2023-11-15T02:53:37.607111+0000","last_unstale":"2023-11-15T02:53:38.003527+0000","last_undegraded":"2023-11-15T02:53:38.003527+0000","last_fullsized":"2023-11-15T02:53:38.003527+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.998721+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:53:37.998721+0000","last_peered":"2023-11-15T02:53:37.998721+0000","last_clean":"2023-11-15T02:53:37.998721+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:53:37.998721+0000","last_undegraded":"2023-11-15T02:53:37.998721+0000","last_fullsized":"2023-11-15T02:53:37.998721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009887+0000","last_change":"2023-11-15T02:53:38.006186+0000","last_active":"2023-11-15T02:53:38.009887+0000","last_peered":"2023-11-15T02:53:38.009887+0000","last_clean":"2023-11-15T02:53:38.009887+0000","last_became_active":"2023-11-15T02:53:38.005653+0000","last_became_peered":"2023-11-15T02:53:38.005653+0000","last_unstale":"2023-11-15T02:53:38.009887+0000","last_undegraded":"2023-11-15T02:53:38.009887+0000","last_fullsized":"2023-11-15T02:53:38.009887+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984526+0000","last_change":"2023-11-15T02:53:37.610922+0000","last_active":"2023-11-15T02:53:37.984526+0000","last_peered":"2023-11-15T02:53:37.984526+0000","last_clean":"2023-11-15T02:53:37.984526+0000","last_became_active":"2023-11-15T02:53:37.610028+0000","last_became_peered":"2023-11-15T02:53:37.610028+0000","last_unstale":"2023-11-15T02:53:37.984526+0000","last_undegraded":"2023-11-15T02:53:37.984526+0000","last_fullsized":"2023-11-15T02:53:37.984526+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":162,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.997839+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:53:37.997839+0000","last_peered":"2023-11-15T02:53:37.997839+0000","last_clean":"2023-11-15T02:53:37.997839+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:53:37.997839+0000","last_undegraded":"2023-11-15T02:53:37.997839+0000","last_fullsized":"2023-11-15T02:53:37.997839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.996916+0000","last_change":"2023-11-15T02:53:37.995964+0000","last_active":"2023-11-15T02:53:37.996916+0000","last_peered":"2023-11-15T02:53:37.996916+0000","last_clean":"2023-11-15T02:53:37.996916+0000","last_became_active":"2023-11-15T02:53:37.995659+0000","last_became_peered":"2023-11-15T02:53:37.995659+0000","last_unstale":"2023-11-15T02:53:37.996916+0000","last_undegraded":"2023-11-15T02:53:37.996916+0000","last_fullsized":"2023-11-15T02:53:37.996916+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.004104+0000","last_change":"2023-11-15T02:53:37.610832+0000","last_active":"2023-11-15T02:53:38.004104+0000","last_peered":"2023-11-15T02:53:38.004104+0000","last_clean":"2023-11-15T02:53:38.004104+0000","last_became_active":"2023-11-15T02:53:37.610517+0000","last_became_peered":"2023-11-15T02:53:37.610517+0000","last_unstale":"2023-11-15T02:53:38.004104+0000","last_undegraded":"2023-11-15T02:53:38.004104+0000","last_fullsized":"2023-11-15T02:53:38.004104+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.987235+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:53:37.987235+0000","last_peered":"2023-11-15T02:53:37.987235+0000","last_clean":"2023-11-15T02:53:37.987235+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:53:37.987235+0000","last_undegraded":"2023-11-15T02:53:37.987235+0000","last_fullsized":"2023-11-15T02:53:37.987235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.008034+0000","last_change":"2023-11-15T02:53:38.004908+0000","last_active":"2023-11-15T02:53:38.008034+0000","last_peered":"2023-11-15T02:53:38.008034+0000","last_clean":"2023-11-15T02:53:38.008034+0000","last_became_active":"2023-11-15T02:53:38.004646+0000","last_became_peered":"2023-11-15T02:53:38.004646+0000","last_unstale":"2023-11-15T02:53:38.008034+0000","last_undegraded":"2023-11-15T02:53:38.008034+0000","last_fullsized":"2023-11-15T02:53:38.008034+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.984950+0000","last_change":"2023-11-15T02:53:37.611678+0000","last_active":"2023-11-15T02:53:37.984950+0000","last_peered":"2023-11-15T02:53:37.984950+0000","last_clean":"2023-11-15T02:53:37.984950+0000","last_became_active":"2023-11-15T02:53:37.610384+0000","last_became_peered":"2023-11-15T02:53:37.610384+0000","last_unstale":"2023-11-15T02:53:37.984950+0000","last_undegraded":"2023-11-15T02:53:37.984950+0000","last_fullsized":"2023-11-15T02:53:37.984950+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":162,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.989854+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:53:37.989854+0000","last_peered":"2023-11-15T02:53:37.989854+0000","last_clean":"2023-11-15T02:53:37.989854+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:53:37.989854+0000","last_undegraded":"2023-11-15T02:53:37.989854+0000","last_fullsized":"2023-11-15T02:53:37.989854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992682+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:53:37.992682+0000","last_peered":"2023-11-15T02:53:37.992682+0000","last_clean":"2023-11-15T02:53:37.992682+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:53:37.992682+0000","last_undegraded":"2023-11-15T02:53:37.992682+0000","last_fullsized":"2023-11-15T02:53:37.992682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.000622+0000","last_change":"2023-11-15T02:53:37.996966+0000","last_active":"2023-11-15T02:53:38.000622+0000","last_peered":"2023-11-15T02:53:38.000622+0000","last_clean":"2023-11-15T02:53:38.000622+0000","last_became_active":"2023-11-15T02:53:37.996716+0000","last_became_peered":"2023-11-15T02:53:37.996716+0000","last_unstale":"2023-11-15T02:53:38.000622+0000","last_undegraded":"2023-11-15T02:53:38.000622+0000","last_fullsized":"2023-11-15T02:53:38.000622+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"195'3","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010557+0000","last_change":"2023-11-15T02:53:37.602954+0000","last_active":"2023-11-15T02:53:38.010557+0000","last_peered":"2023-11-15T02:53:38.010557+0000","last_clean":"2023-11-15T02:53:38.010557+0000","last_became_active":"2023-11-15T02:53:37.602650+0000","last_became_peered":"2023-11-15T02:53:37.602650+0000","last_unstale":"2023-11-15T02:53:38.010557+0000","last_undegraded":"2023-11-15T02:53:38.010557+0000","last_fullsized":"2023-11-15T02:53:38.010557+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.992790+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:53:37.992790+0000","last_peered":"2023-11-15T02:53:37.992790+0000","last_clean":"2023-11-15T02:53:37.992790+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:53:37.992790+0000","last_undegraded":"2023-11-15T02:53:37.992790+0000","last_fullsized":"2023-11-15T02:53:37.992790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.006116+0000","last_change":"2023-11-15T02:53:38.004904+0000","last_active":"2023-11-15T02:53:38.006116+0000","last_peered":"2023-11-15T02:53:38.006116+0000","last_clean":"2023-11-15T02:53:38.006116+0000","last_became_active":"2023-11-15T02:53:38.002970+0000","last_became_peered":"2023-11-15T02:53:38.002970+0000","last_unstale":"2023-11-15T02:53:38.006116+0000","last_undegraded":"2023-11-15T02:53:38.006116+0000","last_fullsized":"2023-11-15T02:53:38.006116+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"195'4","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.010616+0000","last_change":"2023-11-15T02:53:37.602372+0000","last_active":"2023-11-15T02:53:38.010616+0000","last_peered":"2023-11-15T02:53:38.010616+0000","last_clean":"2023-11-15T02:53:38.010616+0000","last_became_active":"2023-11-15T02:53:37.602042+0000","last_became_peered":"2023-11-15T02:53:37.602042+0000","last_unstale":"2023-11-15T02:53:38.010616+0000","last_undegraded":"2023-11-15T02:53:38.010616+0000","last_fullsized":"2023-11-15T02:53:38.010616+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.993798+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:53:37.993798+0000","last_peered":"2023-11-15T02:53:37.993798+0000","last_clean":"2023-11-15T02:53:37.993798+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:53:37.993798+0000","last_undegraded":"2023-11-15T02:53:37.993798+0000","last_fullsized":"2023-11-15T02:53:37.993798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.009380+0000","last_change":"2023-11-15T02:53:38.002981+0000","last_active":"2023-11-15T02:53:38.009380+0000","last_peered":"2023-11-15T02:53:38.009380+0000","last_clean":"2023-11-15T02:53:38.009380+0000","last_became_active":"2023-11-15T02:53:38.002343+0000","last_became_peered":"2023-11-15T02:53:38.002343+0000","last_unstale":"2023-11-15T02:53:38.009380+0000","last_undegraded":"2023-11-15T02:53:38.009380+0000","last_fullsized":"2023-11-15T02:53:38.009380+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.011456+0000","last_change":"2023-11-15T02:53:37.607737+0000","last_active":"2023-11-15T02:53:38.011456+0000","last_peered":"2023-11-15T02:53:38.011456+0000","last_clean":"2023-11-15T02:53:38.011456+0000","last_became_active":"2023-11-15T02:53:37.607051+0000","last_became_peered":"2023-11-15T02:53:37.607051+0000","last_unstale":"2023-11-15T02:53:38.011456+0000","last_undegraded":"2023-11-15T02:53:38.011456+0000","last_fullsized":"2023-11-15T02:53:38.011456+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.001049+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:53:38.001049+0000","last_peered":"2023-11-15T02:53:38.001049+0000","last_clean":"2023-11-15T02:53:38.001049+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:53:38.001049+0000","last_undegraded":"2023-11-15T02:53:38.001049+0000","last_fullsized":"2023-11-15T02:53:38.001049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:38.003060+0000","last_change":"2023-11-15T02:53:37.998675+0000","last_active":"2023-11-15T02:53:38.003060+0000","last_peered":"2023-11-15T02:53:38.003060+0000","last_clean":"2023-11-15T02:53:38.003060+0000","last_became_active":"2023-11-15T02:53:37.998261+0000","last_became_peered":"2023-11-15T02:53:37.998261+0000","last_unstale":"2023-11-15T02:53:38.003060+0000","last_undegraded":"2023-11-15T02:53:38.003060+0000","last_fullsized":"2023-11-15T02:53:38.003060+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:37.577352+0000","last_clean_scrub_stamp":"2023-11-15T02:53:37.577352+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.985238+0000","last_change":"2023-11-15T02:53:37.598178+0000","last_active":"2023-11-15T02:53:37.985238+0000","last_peered":"2023-11-15T02:53:37.985238+0000","last_clean":"2023-11-15T02:53:37.985238+0000","last_became_active":"2023-11-15T02:53:37.597661+0000","last_became_peered":"2023-11-15T02:53:37.597661+0000","last_unstale":"2023-11-15T02:53:37.985238+0000","last_undegraded":"2023-11-15T02:53:37.985238+0000","last_fullsized":"2023-11-15T02:53:37.985238+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:53:36.572051+0000","last_clean_scrub_stamp":"2023-11-15T02:53:36.572051+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":182,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-11-15T02:53:37.994361+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:53:37.994361+0000","last_peered":"2023-11-15T02:53:37.994361+0000","last_clean":"2023-11-15T02:53:37.994361+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:53:37.994361+0000","last_undegraded":"2023-11-15T02:53:37.994361+0000","last_fullsized":"2023-11-15T02:53:37.994361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575946,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303592,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068248,"statfs":{"total":96636764160,"available":96325885952,"internally_reserved":0,"allocated":2457600,"data_stored":1310973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.82599999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.57699999999999996},"min":{"1min":0.376,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72599999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.48199999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.42099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.67900000000000005,"5min":0.752,"15min":0.82299999999999995},"last":0.443}]},{"osd":2,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.78000000000000003,"15min":0.80400000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.44800000000000001,"5min":0.441,"15min":0.40999999999999998},"max":{"1min":0.75700000000000001,"5min":0.79100000000000004,"15min":0.83799999999999997},"last":0.56599999999999995}]},{"osd":3,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.754,"5min":0.81000000000000005,"15min":0.88500000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.62},"min":{"1min":0.47899999999999998,"5min":0.40699999999999997,"15min":0.377},"max":{"1min":0.81899999999999995,"5min":0.84799999999999998,"15min":0.86699999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46100000000000002,"15min":0.47699999999999998},"min":{"1min":0.32800000000000001,"5min":0.29199999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.749},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.64200000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47899999999999998,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27300000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.79500000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.81999999999999995},"last":0.60899999999999999}]},{"osd":6,"last update":"Wed Nov 15 02:53:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.37,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.84899999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.35299999999999998,"15min":0.28499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.68400000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575947,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307684,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064156,"statfs":{"total":96636764160,"available":96321695744,"internally_reserved":0,"allocated":2453504,"data_stored":1310419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.24099999999999999},"max":{"1min":0.749,"5min":0.80000000000000004,"15min":0.92500000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.27700000000000002},"max":{"1min":0.71999999999999997,"5min":0.77300000000000002,"15min":0.873},"last":0.44500000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75700000000000001,"5min":0.81399999999999995,"15min":0.81999999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.38200000000000001,"15min":0.36199999999999999},"max":{"1min":0.69299999999999995,"5min":0.77200000000000002,"15min":0.88},"last":0.48599999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.78400000000000003,"15min":0.84599999999999997},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.45300000000000001,"5min":0.35799999999999998,"15min":0.313},"max":{"1min":0.72799999999999998,"5min":0.83399999999999996,"15min":0.88900000000000001},"last":0.42999999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.42699999999999999,"5min":0.35299999999999998,"15min":0.32900000000000001},"max":{"1min":0.76300000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60799999999999998,"15min":0.60699999999999998},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.38},"max":{"1min":0.78000000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.41399999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45900000000000002},"min":{"1min":0.29799999999999999,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.64100000000000001,"5min":0.72999999999999998,"15min":0.82199999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.39600000000000002,"5min":0.34799999999999998,"15min":0.30099999999999999},"max":{"1min":0.70899999999999996,"5min":0.79500000000000004,"15min":0.874},"last":0.46800000000000003}]},{"osd":5,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.32400000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.82799999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.32000000000000001},"max":{"1min":0.70999999999999996,"5min":0.77000000000000002,"15min":0.95099999999999996},"last":0.31}]},{"osd":7,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.50900000000000001},"min":{"1min":0.33700000000000002,"5min":0.32600000000000001,"15min":0.30499999999999999},"max":{"1min":0.65200000000000002,"5min":0.74199999999999999,"15min":0.90100000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.434,"5min":0.42599999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.83799999999999997,"15min":0.875},"last":0.498}]}]},{"osd":1,"up_from":13,"seq":55834575948,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307688,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064152,"statfs":{"total":96636764160,"available":96321691648,"internally_reserved":0,"allocated":2457600,"data_stored":1310171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.39200000000000002},"min":{"1min":0.28599999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.436,"15min":0.41899999999999998},"min":{"1min":0.28799999999999998,"5min":0.255,"15min":0.255},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.53500000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42099999999999999,"15min":0.40799999999999997},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.47799999999999998,"15min":0.46300000000000002},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.27500000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.372}]},{"osd":3,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.441,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.41999999999999998,"5min":0.32500000000000001,"15min":0.315},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.49199999999999999}]},{"osd":4,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.49199999999999999,"5min":0.436,"15min":0.372},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.53400000000000003,"5min":0.42399999999999999,"15min":0.41299999999999998},"max":{"1min":1.0289999999999999,"5min":1.081,"15min":1.081},"last":0.66400000000000003}]},{"osd":5,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67000000000000004,"15min":0.66000000000000003},"min":{"1min":0.52100000000000002,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68700000000000006,"15min":0.67400000000000004},"min":{"1min":0.54900000000000004,"5min":0.45600000000000002,"15min":0.42699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.52300000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.73599999999999999,"15min":0.72399999999999998},"min":{"1min":0.64500000000000002,"5min":0.53500000000000003,"15min":0.48999999999999999},"max":{"1min":0.98399999999999999,"5min":1,"15min":1},"last":0.82299999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.67600000000000005,"5min":0.52600000000000002,"15min":0.46600000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.746,"15min":0.72999999999999998},"min":{"1min":0.627,"5min":0.52100000000000002,"15min":0.48399999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0009999999999999},"last":0.80100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575946,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311780,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060060,"statfs":{"total":96636764160,"available":96317501440,"internally_reserved":0,"allocated":2453504,"data_stored":1309561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.40000000000000002,"15min":0.39900000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.63300000000000001,"15min":0.73499999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61299999999999999,"5min":0.68100000000000005,"15min":0.89400000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41699999999999998,"15min":0.40799999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.23599999999999999},"max":{"1min":0.626,"5min":0.66500000000000004,"15min":0.755},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47099999999999997,"15min":0.46500000000000002},"min":{"1min":0.35499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64700000000000002,"5min":0.71199999999999997,"15min":0.77200000000000002},"last":0.36799999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66200000000000003,"5min":0.73399999999999999,"15min":0.83199999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.317},"max":{"1min":0.61699999999999999,"5min":0.70999999999999996,"15min":0.86699999999999999},"last":0.39800000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.69399999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.40500000000000003},"max":{"1min":0.89900000000000002,"5min":1.034,"15min":1.0720000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70799999999999996,"15min":0.68999999999999995},"min":{"1min":0.55000000000000004,"5min":0.46600000000000003,"15min":0.42699999999999999},"max":{"1min":0.92600000000000005,"5min":1.022,"15min":1.0549999999999999},"last":0.755}]},{"osd":5,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.51400000000000001,"5min":0.47899999999999998,"15min":0.378},"max":{"1min":0.89000000000000001,"5min":0.96699999999999997,"15min":1.0449999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70399999999999996,"15min":0.68000000000000005},"min":{"1min":0.498,"5min":0.45400000000000001,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.028},"last":0.78200000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69899999999999995,"15min":0.67700000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.441},"max":{"1min":0.85399999999999998,"5min":0.95399999999999996,"15min":1.171},"last":0.624},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.443},"max":{"1min":0.86599999999999999,"5min":1.01,"15min":1.135},"last":0.76400000000000001}]},{"osd":7,"last update":"Wed Nov 15 02:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73299999999999998,"15min":0.72199999999999998},"min":{"1min":0.59899999999999998,"5min":0.47399999999999998,"15min":0.40699999999999997},"max":{"1min":0.94099999999999995,"5min":1.0549999999999999,"15min":1.083},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.75700000000000001,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95199999999999996,"5min":1.089,"15min":1.107},"last":0.83099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575947,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315876,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055964,"statfs":{"total":96636764160,"available":96313307136,"internally_reserved":0,"allocated":2453504,"data_stored":1309597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27000000000000002,"5min":0.25900000000000001,"15min":0.253},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.63700000000000001},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.433,"15min":0.437},"min":{"1min":0.29099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.67100000000000004,"15min":0.72899999999999998},"last":0.35199999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40400000000000003,"15min":0.40300000000000002},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53700000000000003,"5min":0.628,"15min":0.69099999999999995},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.45600000000000002},"min":{"1min":0.35899999999999999,"5min":0.32500000000000001,"15min":0.28100000000000003},"max":{"1min":0.61599999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.45800000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47999999999999998,"15min":0.48199999999999998},"min":{"1min":0.39100000000000001,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.70099999999999996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.31900000000000001},"max":{"1min":0.62,"5min":0.753,"15min":0.81399999999999995},"last":0.376}]},{"osd":4,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.501,"5min":0.46300000000000002,"15min":0.41099999999999998},"max":{"1min":0.88900000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66600000000000004,"15min":0.67600000000000005},"min":{"1min":0.46300000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97199999999999998,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.52300000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67400000000000004,"15min":0.67700000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90000000000000002,"5min":1.056,"15min":1.056},"last":0.78300000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.47799999999999998},"max":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.113},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.55800000000000005,"5min":0.48999999999999999,"15min":0.46400000000000002},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Wed Nov 15 02:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.54100000000000004,"5min":0.502,"15min":0.46500000000000002},"max":{"1min":0.995,"5min":1.012,"15min":1.0680000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.72499999999999998},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.48699999999999999},"max":{"1min":0.93500000000000005,"5min":1.089,"15min":1.1499999999999999},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575948,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311788,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060052,"statfs":{"total":96636764160,"available":96317493248,"internally_reserved":0,"allocated":2461696,"data_stored":1310193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41099999999999998,"15min":0.40400000000000003},"min":{"1min":0.28299999999999997,"5min":0.27800000000000002,"15min":0.26100000000000001},"max":{"1min":0.54800000000000004,"5min":0.624,"15min":0.67500000000000004},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63200000000000001,"5min":0.64400000000000002,"15min":0.65800000000000003},"last":0.28299999999999997}]},{"osd":1,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":0.67100000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.34100000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48199999999999998,"15min":0.47799999999999998},"min":{"1min":0.35499999999999998,"5min":0.31,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.72299999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40200000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.52900000000000003,"5min":0.41999999999999998,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.91700000000000004,"15min":1.0149999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.45200000000000001},"max":{"1min":0.98499999999999999,"5min":1.04,"15min":1.04},"last":0.45600000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69399999999999995,"15min":0.68600000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96199999999999997,"5min":1.0569999999999999,"15min":1.1100000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.67800000000000005},"min":{"1min":0.47799999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93500000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.58699999999999997}]},{"osd":6,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.40999999999999998},"max":{"1min":0.93400000000000005,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.52200000000000002,"15min":0.46400000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0720000000000001},"last":0.57299999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:53:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.54800000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.54900000000000004,"5min":0.53000000000000003,"15min":0.47899999999999998},"max":{"1min":0.94399999999999995,"5min":0.97999999999999998,"15min":1.071},"last":0.60799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575946,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303596,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068244,"statfs":{"total":96636764160,"available":96325881856,"internally_reserved":0,"allocated":2461696,"data_stored":1309709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.44500000000000001,"5min":0.40799999999999997,"15min":0.28299999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.81000000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":0.75700000000000001,"5min":0.79000000000000004,"15min":0.97199999999999998},"last":0.495}]},{"osd":1,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.42399999999999999,"5min":0.41099999999999998,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":0.78100000000000003,"15min":0.89900000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.33600000000000002},"max":{"1min":0.78200000000000003,"5min":0.83299999999999996,"15min":0.88700000000000001},"last":0.56899999999999995}]},{"osd":2,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.86399999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.38200000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.85599999999999998},"last":0.65800000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38300000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.80800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.48799999999999999,"5min":0.48399999999999999,"15min":0.36599999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.83099999999999996},"last":0.621}]},{"osd":5,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.28100000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.76200000000000001},"last":0.59899999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51300000000000001,"15min":0.51100000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.73999999999999999,"5min":0.76500000000000001,"15min":0.79100000000000004},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34999999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.69599999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.54200000000000004},"min":{"1min":0.39600000000000002,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.81799999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.79300000000000004,"15min":0.84599999999999997},"last":0.72199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575946,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307692,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064148,"statfs":{"total":96636764160,"available":96321687552,"internally_reserved":0,"allocated":2461696,"data_stored":1310205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73899999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.86899999999999999},"last":0.39700000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.33300000000000002},"max":{"1min":0.76700000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.372},"max":{"1min":0.71999999999999997,"5min":0.876,"15min":0.90000000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59699999999999998,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34499999999999997},"max":{"1min":0.75600000000000001,"5min":0.78100000000000003,"15min":0.83299999999999996},"last":0.53800000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":0.78700000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.34399999999999997},"max":{"1min":0.78600000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.57499999999999996}]},{"osd":4,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46100000000000002,"15min":0.47199999999999998},"min":{"1min":0.311,"5min":0.308,"15min":0.27900000000000003},"max":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.751},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.32600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.73399999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.313,"5min":0.312,"15min":0.312},"max":{"1min":0.753,"5min":0.753,"15min":0.75600000000000001},"last":0.52100000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.502,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.67400000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.44},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.66000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:53:46.860 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-15T02:53:46.861 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-15T02:53:47.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.017+0000 7f21a97db700 1 Processor -- start 2023-11-15T02:53:47.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.017+0000 7f21a97db700 1 -- start start 2023-11-15T02:53:47.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.018+0000 7f21a97db700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f21a41541d0 0x7f21a41545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:47.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.018+0000 7f21a97db700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21a40c8170 0x7f21a40c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:47.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.018+0000 7f21a97db700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a4155830 con 0x7f21a40c60d0 2023-11-15T02:53:47.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.018+0000 7f21a97db700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a4158f40 con 0x7f21a41541d0 2023-11-15T02:53:47.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.018+0000 7f21a97db700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a4154c20 con 0x7f21a40c8170 2023-11-15T02:53:47.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.018+0000 7f21a3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f21a41541d0 0x7f21a41545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:47.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.018+0000 7f21a3fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f21a41541d0 0x7f21a41545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59666/0 (socket says 172.21.15.1:59666) 2023-11-15T02:53:47.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.018+0000 7f21a3fff700 1 -- 172.21.15.1:0/2001139168 learned_addr learned my addr 172.21.15.1:0/2001139168 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:47.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.018+0000 7f21a8fda700 1 --2- 172.21.15.1:0/2001139168 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21a40c8170 0x7f21a40c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:47.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.018+0000 7f21a3fff700 1 -- 172.21.15.1:0/2001139168 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21a40c8170 msgr2=0x7f21a40c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:47.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.018+0000 7f21a3fff700 1 --2- 172.21.15.1:0/2001139168 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21a40c8170 0x7f21a40c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.018+0000 7f21a3fff700 1 -- 172.21.15.1:0/2001139168 >> v1:172.21.15.141:6789/0 conn(0x7f21a40c60d0 legacy=0x7f21a40c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:47.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.018+0000 7f21a3fff700 1 -- 172.21.15.1:0/2001139168 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a4154f00 con 0x7f21a41541d0 2023-11-15T02:53:47.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.018+0000 7f21a3fff700 1 --2- 172.21.15.1:0/2001139168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21a41541d0 0x7f21a41545b0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7f218c006fd0 tx=0x7f218c0090f0).ready entity=mon.0 client_cookie=f811a1fa3affd281 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:47.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.018+0000 7f21a2ffd700 1 -- 172.21.15.1:0/2001139168 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c00b600 con 0x7f21a41541d0 2023-11-15T02:53:47.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.019+0000 7f21a2ffd700 1 -- 172.21.15.1:0/2001139168 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c00b760 con 0x7f21a41541d0 2023-11-15T02:53:47.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.019+0000 7f21a2ffd700 1 -- 172.21.15.1:0/2001139168 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c00bae0 con 0x7f21a41541d0 2023-11-15T02:53:47.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.019+0000 7f21a97db700 1 -- 172.21.15.1:0/2001139168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21a41541d0 msgr2=0x7f21a41545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:47.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.019+0000 7f21a97db700 1 --2- 172.21.15.1:0/2001139168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21a41541d0 0x7f21a41545b0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7f218c006fd0 tx=0x7f218c0090f0).stop 2023-11-15T02:53:47.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.019+0000 7f21a97db700 1 -- 172.21.15.1:0/2001139168 shutdown_connections 2023-11-15T02:53:47.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.019+0000 7f21a97db700 1 --2- 172.21.15.1:0/2001139168 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21a40c8170 0x7f21a40c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.019+0000 7f21a97db700 1 --2- 172.21.15.1:0/2001139168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21a41541d0 0x7f21a41545b0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.019+0000 7f21a97db700 1 -- 172.21.15.1:0/2001139168 >> 172.21.15.1:0/2001139168 conn(0x7f21a4069ee0 msgr2=0x7f21a406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:47.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.019+0000 7f21a97db700 1 -- 172.21.15.1:0/2001139168 shutdown_connections 2023-11-15T02:53:47.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.019+0000 7f21a97db700 1 -- 172.21.15.1:0/2001139168 wait complete. 2023-11-15T02:53:47.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.020+0000 7f21a97db700 1 Processor -- start 2023-11-15T02:53:47.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.021+0000 7f21a97db700 1 -- start start 2023-11-15T02:53:47.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.021+0000 7f21a97db700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21a40c60d0 0x7f21a40b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:47.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.021+0000 7f21a97db700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f21a40c8170 0x7f21a4164910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:47.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.021+0000 7f21a97db700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21a41541d0 0x7f21a41563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:47.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.021+0000 7f21a97db700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a4165930 con 0x7f21a41541d0 2023-11-15T02:53:47.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.021+0000 7f21a97db700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40c3960 con 0x7f21a40c8170 2023-11-15T02:53:47.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.021+0000 7f21a97db700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a4165370 con 0x7f21a40c60d0 2023-11-15T02:53:47.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.021+0000 7f21a8fda700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21a41541d0 0x7f21a41563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:47.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.021+0000 7f21a8fda700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21a41541d0 0x7f21a41563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59670/0 (socket says 172.21.15.1:59670) 2023-11-15T02:53:47.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.021+0000 7f21a8fda700 1 -- 172.21.15.1:0/1083412959 learned_addr learned my addr 172.21.15.1:0/1083412959 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:47.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.022+0000 7f21a37fe700 1 --2- 172.21.15.1:0/1083412959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f21a40c8170 0x7f21a4164910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:47.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.022+0000 7f21a3fff700 1 --2- 172.21.15.1:0/1083412959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21a40c60d0 0x7f21a40b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:47.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.022+0000 7f21a8fda700 1 -- 172.21.15.1:0/1083412959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21a40c60d0 msgr2=0x7f21a40b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:47.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.022+0000 7f21a8fda700 1 --2- 172.21.15.1:0/1083412959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21a40c60d0 0x7f21a40b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.022+0000 7f21a8fda700 1 -- 172.21.15.1:0/1083412959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f21a40c8170 msgr2=0x7f21a4164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:47.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.022+0000 7f21a8fda700 1 --2- 172.21.15.1:0/1083412959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f21a40c8170 0x7f21a4164910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.022+0000 7f21a8fda700 1 -- 172.21.15.1:0/1083412959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c009370 con 0x7f21a41541d0 2023-11-15T02:53:47.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.022+0000 7f21a8fda700 1 --2- 172.21.15.1:0/1083412959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21a41541d0 0x7f21a41563e0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f219c009fa0 tx=0x7f219c009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:47.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.022+0000 7f219bfff700 1 -- 172.21.15.1:0/1083412959 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c00ebc0 con 0x7f21a41541d0 2023-11-15T02:53:47.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.022+0000 7f219bfff700 1 -- 172.21.15.1:0/1083412959 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c00ed20 con 0x7f21a41541d0 2023-11-15T02:53:47.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.022+0000 7f219bfff700 1 -- 172.21.15.1:0/1083412959 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c014610 con 0x7f21a41541d0 2023-11-15T02:53:47.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.022+0000 7f21a97db700 1 -- 172.21.15.1:0/1083412959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a4165650 con 0x7f21a41541d0 2023-11-15T02:53:47.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.022+0000 7f21a97db700 1 -- 172.21.15.1:0/1083412959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a40af170 con 0x7f21a41541d0 2023-11-15T02:53:47.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.023+0000 7f21a97db700 1 -- 172.21.15.1:0/1083412959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a40c3450 con 0x7f21a41541d0 2023-11-15T02:53:47.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.024+0000 7f219bfff700 1 -- 172.21.15.1:0/1083412959 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f219c01d3b0 con 0x7f21a41541d0 2023-11-15T02:53:47.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.024+0000 7f219bfff700 1 --2- 172.21.15.1:0/1083412959 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f218405f240 0x7f2184061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:47.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.024+0000 7f219bfff700 1 -- 172.21.15.1:0/1083412959 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f219c07aaf0 con 0x7f21a41541d0 2023-11-15T02:53:47.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.024+0000 7f21a3fff700 1 --2- 172.21.15.1:0/1083412959 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f218405f240 0x7f2184061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:47.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.025+0000 7f21a3fff700 1 --2- 172.21.15.1:0/1083412959 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f218405f240 0x7f2184061700 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f218c009130 tx=0x7f218c017000).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:47.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.028+0000 7f219bfff700 1 -- 172.21.15.1:0/1083412959 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f21a40c3450 con 0x7f21a41541d0 2023-11-15T02:53:47.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.267+0000 7f21a97db700 1 -- 172.21.15.1:0/1083412959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f21a40c3450 con 0x7f21a41541d0 2023-11-15T02:53:47.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.271+0000 7f219bfff700 1 -- 172.21.15.1:0/1083412959 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v51) v1 ==== 190+0+0 (secure 0 0 0) 0x7f21a40c3450 con 0x7f21a41541d0 2023-11-15T02:53:47.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.273+0000 7f21a97db700 1 -- 172.21.15.1:0/1083412959 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f218405f240 msgr2=0x7f2184061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:47.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.273+0000 7f21a97db700 1 --2- 172.21.15.1:0/1083412959 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f218405f240 0x7f2184061700 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f218c009130 tx=0x7f218c017000).stop 2023-11-15T02:53:47.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.273+0000 7f21a97db700 1 -- 172.21.15.1:0/1083412959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21a41541d0 msgr2=0x7f21a41563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:47.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.273+0000 7f21a97db700 1 --2- 172.21.15.1:0/1083412959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21a41541d0 0x7f21a41563e0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f219c009fa0 tx=0x7f219c009900).stop 2023-11-15T02:53:47.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.273+0000 7f21a97db700 1 -- 172.21.15.1:0/1083412959 shutdown_connections 2023-11-15T02:53:47.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.273+0000 7f21a97db700 1 --2- 172.21.15.1:0/1083412959 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f218405f240 0x7f2184061700 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.273+0000 7f21a97db700 1 --2- 172.21.15.1:0/1083412959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21a41541d0 0x7f21a41563e0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.273+0000 7f21a97db700 1 --2- 172.21.15.1:0/1083412959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21a40c60d0 0x7f21a40b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.273+0000 7f21a97db700 1 --2- 172.21.15.1:0/1083412959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f21a40c8170 0x7f21a4164910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.273+0000 7f21a97db700 1 -- 172.21.15.1:0/1083412959 >> 172.21.15.1:0/1083412959 conn(0x7f21a4069ee0 msgr2=0x7f21a40c0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:47.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.273+0000 7f21a97db700 1 -- 172.21.15.1:0/1083412959 shutdown_connections 2023-11-15T02:53:47.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.273+0000 7f21a97db700 1 -- 172.21.15.1:0/1083412959 wait complete. 2023-11-15T02:53:47.277 INFO:teuthology.orchestra.run.smithi001.stderr:updated caps for client.0 2023-11-15T02:53:47.286 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:53:47.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.403+0000 7f24b1aa3700 1 Processor -- start 2023-11-15T02:53:47.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.403+0000 7f24b1aa3700 1 -- start start 2023-11-15T02:53:47.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.404+0000 7f24b1aa3700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f24ac0833a0 0x7f24ac0a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:47.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.404+0000 7f24b1aa3700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac0a85e0 con 0x7f24ac154450 2023-11-15T02:53:47.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.404+0000 7f24b1aa3700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac065660 con 0x7f24ac0be520 2023-11-15T02:53:47.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.404+0000 7f24b1aa3700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ac065940 con 0x7f24ac0833a0 2023-11-15T02:53:47.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.404+0000 7f24ab7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f24ac154450 0x7f24ac0bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:57306/0 (socket says 172.21.15.1:57306) 2023-11-15T02:53:47.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.404+0000 7f24ab7fe700 1 -- 172.21.15.1:0/2479343218 learned_addr learned my addr 172.21.15.1:0/2479343218 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:47.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aaffd700 1 --2- 172.21.15.1:0/2479343218 >> v2:172.21.15.141:3300/0 conn(0x7f24ac0833a0 0x7f24ac0a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:47.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aa7fc700 1 -- 172.21.15.1:0/2479343218 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826461524 0 0) 0x7f24ac0a85e0 con 0x7f24ac154450 2023-11-15T02:53:47.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aa7fc700 1 -- 172.21.15.1:0/2479343218 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24980033f0 con 0x7f24ac154450 2023-11-15T02:53:47.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aa7fc700 1 -- 172.21.15.1:0/2479343218 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 714958149 0 0) 0x7f24980033f0 con 0x7f24ac154450 2023-11-15T02:53:47.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aa7fc700 1 -- 172.21.15.1:0/2479343218 >> v2:172.21.15.141:3300/0 conn(0x7f24ac0833a0 msgr2=0x7f24ac0a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:47.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aa7fc700 1 --2- 172.21.15.1:0/2479343218 >> v2:172.21.15.141:3300/0 conn(0x7f24ac0833a0 0x7f24ac0a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aa7fc700 1 -- 172.21.15.1:0/2479343218 >> v1:172.21.15.141:6789/0 conn(0x7f24ac0be520 legacy=0x7f24ac0c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:47.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aa7fc700 1 -- 172.21.15.1:0/2479343218 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac0c6f50 con 0x7f24ac154450 2023-11-15T02:53:47.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aa7fc700 1 -- 172.21.15.1:0/2479343218 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f24a40015f0 con 0x7f24ac154450 2023-11-15T02:53:47.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aa7fc700 1 -- 172.21.15.1:0/2479343218 >> v1:172.21.15.1:6789/0 conn(0x7f24ac154450 legacy=0x7f24ac0bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:47.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aa7fc700 1 --2- 172.21.15.1:0/2479343218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24980038e0 0x7f2498003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:47.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aa7fc700 1 --2- 172.21.15.1:0/2479343218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2498004690 0x7f2498004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:47.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aa7fc700 1 --2- 172.21.15.1:0/2479343218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2498005000 0x7f249800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:47.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aa7fc700 1 -- 172.21.15.1:0/2479343218 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac065940 con 0x7f2498004690 2023-11-15T02:53:47.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aa7fc700 1 -- 172.21.15.1:0/2479343218 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249800beb0 con 0x7f24980038e0 2023-11-15T02:53:47.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aa7fc700 1 -- 172.21.15.1:0/2479343218 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249800c070 con 0x7f2498005000 2023-11-15T02:53:47.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aaffd700 1 --2- 172.21.15.1:0/2479343218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2498004690 0x7f2498004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:47.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24ab7fe700 1 --2- 172.21.15.1:0/2479343218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24980038e0 0x7f2498003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:47.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24abfff700 1 --2- 172.21.15.1:0/2479343218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2498005000 0x7f249800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:47.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aaffd700 1 -- 172.21.15.1:0/2479343218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2498005000 msgr2=0x7f249800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:47.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aaffd700 1 --2- 172.21.15.1:0/2479343218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2498005000 0x7f249800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aaffd700 1 -- 172.21.15.1:0/2479343218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24980038e0 msgr2=0x7f2498003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:47.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.405+0000 7f24aaffd700 1 --2- 172.21.15.1:0/2479343218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24980038e0 0x7f2498003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.406+0000 7f24aaffd700 1 -- 172.21.15.1:0/2479343218 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24980033f0 con 0x7f2498004690 2023-11-15T02:53:47.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.406+0000 7f24abfff700 1 -- 172.21.15.1:0/2479343218 reap_dead start 2023-11-15T02:53:47.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.406+0000 7f24aaffd700 1 --2- 172.21.15.1:0/2479343218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2498004690 0x7f2498004b10 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f2494009a80 tx=0x7f2494009060).ready entity=mon.0 client_cookie=1546beca5a151d83 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:47.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.406+0000 7f24aa7fc700 1 -- 172.21.15.1:0/2479343218 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494009430 con 0x7f2498004690 2023-11-15T02:53:47.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.406+0000 7f24aa7fc700 1 -- 172.21.15.1:0/2479343218 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249400e640 con 0x7f2498004690 2023-11-15T02:53:47.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.406+0000 7f24aa7fc700 1 -- 172.21.15.1:0/2479343218 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249400e9c0 con 0x7f2498004690 2023-11-15T02:53:47.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.406+0000 7f24b1aa3700 1 -- 172.21.15.1:0/2479343218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2498004690 msgr2=0x7f2498004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:47.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.406+0000 7f24b1aa3700 1 --2- 172.21.15.1:0/2479343218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2498004690 0x7f2498004b10 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f2494009a80 tx=0x7f2494009060).stop 2023-11-15T02:53:47.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.406+0000 7f24b1aa3700 1 -- 172.21.15.1:0/2479343218 shutdown_connections 2023-11-15T02:53:47.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.406+0000 7f24b1aa3700 1 --2- 172.21.15.1:0/2479343218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2498004690 0x7f2498004b10 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.406+0000 7f24b1aa3700 1 -- 172.21.15.1:0/2479343218 >> 172.21.15.1:0/2479343218 conn(0x7f24ac082f90 msgr2=0x7f24ac0c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:47.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.406+0000 7f24b1aa3700 1 -- 172.21.15.1:0/2479343218 shutdown_connections 2023-11-15T02:53:47.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.406+0000 7f24b1aa3700 1 -- 172.21.15.1:0/2479343218 wait complete. 2023-11-15T02:53:47.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.408+0000 7f24b1aa3700 1 Processor -- start 2023-11-15T02:53:47.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.408+0000 7f24b1aa3700 1 -- start start 2023-11-15T02:53:47.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.408+0000 7f24b1aa3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2498004690 0x7f24ac0bff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:47.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.408+0000 7f24b1aa3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24ac0a8d20 0x7f24ac14fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:47.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.408+0000 7f24b1aa3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24ac0a7af0 0x7f24ac0c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:47.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.408+0000 7f24b1aa3700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac0c0440 con 0x7f24ac0a7af0 2023-11-15T02:53:47.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.408+0000 7f24b1aa3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac0ab090 con 0x7f2498004690 2023-11-15T02:53:47.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.408+0000 7f24b1aa3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac0a5e40 con 0x7f24ac0a8d20 2023-11-15T02:53:47.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.408+0000 7f24abfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24ac0a7af0 0x7f24ac0c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:47.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24abfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24ac0a7af0 0x7f24ac0c4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59686/0 (socket says 172.21.15.1:59686) 2023-11-15T02:53:47.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24abfff700 1 -- 172.21.15.1:0/3200794302 learned_addr learned my addr 172.21.15.1:0/3200794302 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:47.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24ab7fe700 1 --2- 172.21.15.1:0/3200794302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2498004690 0x7f24ac0bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:47.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24aaffd700 1 --2- 172.21.15.1:0/3200794302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24ac0a8d20 0x7f24ac14fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:47.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24abfff700 1 -- 172.21.15.1:0/3200794302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24ac0a8d20 msgr2=0x7f24ac14fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:47.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24abfff700 1 --2- 172.21.15.1:0/3200794302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24ac0a8d20 0x7f24ac14fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24abfff700 1 -- 172.21.15.1:0/3200794302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2498004690 msgr2=0x7f24ac0bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:47.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24abfff700 1 --2- 172.21.15.1:0/3200794302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2498004690 0x7f24ac0bff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24abfff700 1 -- 172.21.15.1:0/3200794302 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac0ab330 con 0x7f24ac0a7af0 2023-11-15T02:53:47.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24ab7fe700 1 --2- 172.21.15.1:0/3200794302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2498004690 0x7f24ac0bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:47.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24abfff700 1 --2- 172.21.15.1:0/3200794302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24ac0a7af0 0x7f24ac0c4060 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f24ac0698e0 tx=0x7f249c007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:47.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24a37fe700 1 -- 172.21.15.1:0/3200794302 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c006c30 con 0x7f24ac0a7af0 2023-11-15T02:53:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24a37fe700 1 -- 172.21.15.1:0/3200794302 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c006d90 con 0x7f24ac0a7af0 2023-11-15T02:53:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24b1aa3700 1 -- 172.21.15.1:0/3200794302 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ac0ab610 con 0x7f24ac0a7af0 2023-11-15T02:53:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24a37fe700 1 -- 172.21.15.1:0/3200794302 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c007280 con 0x7f24ac0a7af0 2023-11-15T02:53:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.409+0000 7f24b1aa3700 1 -- 172.21.15.1:0/3200794302 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ac1503b0 con 0x7f24ac0a7af0 2023-11-15T02:53:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.410+0000 7f24b1aa3700 1 -- 172.21.15.1:0/3200794302 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ac0ab850 con 0x7f24ac0a7af0 2023-11-15T02:53:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.410+0000 7f24a37fe700 1 -- 172.21.15.1:0/3200794302 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f249c007670 con 0x7f24ac0a7af0 2023-11-15T02:53:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.411+0000 7f24a37fe700 1 --2- 172.21.15.1:0/3200794302 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f248c05f270 0x7f248c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.411+0000 7f24a37fe700 1 -- 172.21.15.1:0/3200794302 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f249c079ed0 con 0x7f24ac0a7af0 2023-11-15T02:53:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.411+0000 7f24ab7fe700 1 --2- 172.21.15.1:0/3200794302 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f248c05f270 0x7f248c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.411+0000 7f24ab7fe700 1 --2- 172.21.15.1:0/3200794302 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f248c05f270 0x7f248c061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f24a4001720 tx=0x7f24a4009040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.415+0000 7f24a37fe700 1 -- 172.21.15.1:0/3200794302 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f249c049af0 con 0x7f24ac0a7af0 2023-11-15T02:53:47.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.629+0000 7f24b1aa3700 1 -- 172.21.15.1:0/3200794302 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24ac06c7e0 con 0x7f24ac0a7af0 2023-11-15T02:53:47.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.630+0000 7f24a37fe700 1 -- 172.21.15.1:0/3200794302 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f249c04ae10 con 0x7f24ac0a7af0 2023-11-15T02:53:47.631 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:47.632 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":87,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8764,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/1669030169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1669030169},{"type":"v1","addr":"172.21.15.141:6837","nonce":1669030169}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9597,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2404592830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2404592830},{"type":"v1","addr":"172.21.15.1:6834","nonce":2404592830}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9600,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3663257097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3663257097},{"type":"v1","addr":"172.21.15.1:6835","nonce":3663257097}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:53:37.978121+0000","modified":"2023-11-15T02:53:40.995474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9609},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9609":{"gid":9609,"name":"d","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6836/1387364974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":1387364974},{"type":"v1","addr":"172.21.15.141:6836","nonce":1387364974}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-11-15T02:53:47.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.631+0000 7f24b1aa3700 1 -- 172.21.15.1:0/3200794302 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f248c05f270 msgr2=0x7f248c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:47.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.631+0000 7f24b1aa3700 1 --2- 172.21.15.1:0/3200794302 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f248c05f270 0x7f248c061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f24a4001720 tx=0x7f24a4009040).stop 2023-11-15T02:53:47.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.631+0000 7f24b1aa3700 1 -- 172.21.15.1:0/3200794302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24ac0a7af0 msgr2=0x7f24ac0c4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:47.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.631+0000 7f24b1aa3700 1 --2- 172.21.15.1:0/3200794302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24ac0a7af0 0x7f24ac0c4060 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f24ac0698e0 tx=0x7f249c007f30).stop 2023-11-15T02:53:47.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.632+0000 7f24b1aa3700 1 -- 172.21.15.1:0/3200794302 shutdown_connections 2023-11-15T02:53:47.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.632+0000 7f24b1aa3700 1 --2- 172.21.15.1:0/3200794302 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f248c05f270 0x7f248c061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.632+0000 7f24b1aa3700 1 --2- 172.21.15.1:0/3200794302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24ac0a7af0 0x7f24ac0c4060 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.632+0000 7f24b1aa3700 1 --2- 172.21.15.1:0/3200794302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2498004690 0x7f24ac0bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.632+0000 7f24b1aa3700 1 --2- 172.21.15.1:0/3200794302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24ac0a8d20 0x7f24ac14fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:47.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.632+0000 7f24b1aa3700 1 -- 172.21.15.1:0/3200794302 >> 172.21.15.1:0/3200794302 conn(0x7f24ac082f90 msgr2=0x7f24ac0bde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:47.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.632+0000 7f24b1aa3700 1 -- 172.21.15.1:0/3200794302 shutdown_connections 2023-11-15T02:53:47.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:47.632+0000 7f24b1aa3700 1 -- 172.21.15.1:0/3200794302 wait complete. 2023-11-15T02:53:47.636 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 87 2023-11-15T02:53:48.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 87, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-15T02:53:37.978121+0000', 'modified': '2023-11-15T02:53:40.995474+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9609}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9609': {'gid': 9609, 'name': 'd', 'rank': 0, 'incarnation': 83, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.141:6836/1387364974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6834', 'nonce': 1387364974}, {'type': 'v1', 'addr': '172.21.15.141:6836', 'nonce': 1387364974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-15T02:53:48.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-15T02:53:48.049 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-15T02:53:48.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.170+0000 7f70de292700 1 Processor -- start 2023-11-15T02:53:48.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.171+0000 7f70de292700 1 -- start start 2023-11-15T02:53:48.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.171+0000 7f70de292700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d8152330 0x7f70d80aa080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.171+0000 7f70de292700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f70d8062ec0 0x7f70d80aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.171+0000 7f70de292700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d80bd040 con 0x7f70d8152710 2023-11-15T02:53:48.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.171+0000 7f70de292700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d8069720 con 0x7f70d8062ec0 2023-11-15T02:53:48.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.171+0000 7f70de292700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d8069a00 con 0x7f70d8152330 2023-11-15T02:53:48.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.172+0000 7f70dc82f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f70d8062ec0 0x7f70d80aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.172+0000 7f70d77fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f70d8152710 0x7f70d80627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44622/0 (socket says 172.21.15.1:44622) 2023-11-15T02:53:48.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.172+0000 7f70d77fe700 1 -- 172.21.15.1:0/229351071 learned_addr learned my addr 172.21.15.1:0/229351071 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:48.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.172+0000 7f70d7fff700 1 --2- 172.21.15.1:0/229351071 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d8152330 0x7f70d80aa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.172+0000 7f70dc82f700 1 -- 172.21.15.1:0/229351071 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d8152330 msgr2=0x7f70d80aa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:48.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.172+0000 7f70dc82f700 1 --2- 172.21.15.1:0/229351071 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d8152330 0x7f70d80aa080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.172+0000 7f70dc82f700 1 -- 172.21.15.1:0/229351071 >> v1:172.21.15.1:6789/0 conn(0x7f70d8152710 legacy=0x7f70d80627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.172+0000 7f70d6ffd700 1 -- 172.21.15.1:0/229351071 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057085485 0 0) 0x7f70d80bd040 con 0x7f70d8152710 2023-11-15T02:53:48.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.172+0000 7f70dc82f700 1 -- 172.21.15.1:0/229351071 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d8069ce0 con 0x7f70d8062ec0 2023-11-15T02:53:48.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.172+0000 7f70d7fff700 1 --2- 172.21.15.1:0/229351071 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d8152330 0x7f70d80aa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:53:48.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.172+0000 7f70dc82f700 1 --2- 172.21.15.1:0/229351071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70d8062ec0 0x7f70d80aa570 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7f70d0009e60 tx=0x7f70d0009780).ready entity=mon.0 client_cookie=c80d2dd692476132 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:48.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.172+0000 7f70d6ffd700 1 -- 172.21.15.1:0/229351071 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d000e070 con 0x7f70d8062ec0 2023-11-15T02:53:48.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.172+0000 7f70d6ffd700 1 -- 172.21.15.1:0/229351071 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d000bc30 con 0x7f70d8062ec0 2023-11-15T02:53:48.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.172+0000 7f70d6ffd700 1 -- 172.21.15.1:0/229351071 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0012410 con 0x7f70d8062ec0 2023-11-15T02:53:48.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.173+0000 7f70de292700 1 -- 172.21.15.1:0/229351071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70d8062ec0 msgr2=0x7f70d80aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.173+0000 7f70de292700 1 --2- 172.21.15.1:0/229351071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70d8062ec0 0x7f70d80aa570 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7f70d0009e60 tx=0x7f70d0009780).stop 2023-11-15T02:53:48.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.173+0000 7f70de292700 1 -- 172.21.15.1:0/229351071 shutdown_connections 2023-11-15T02:53:48.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.173+0000 7f70de292700 1 --2- 172.21.15.1:0/229351071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70d8062ec0 0x7f70d80aa570 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.173+0000 7f70de292700 1 --2- 172.21.15.1:0/229351071 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d8152330 0x7f70d80aa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.173+0000 7f70de292700 1 -- 172.21.15.1:0/229351071 >> 172.21.15.1:0/229351071 conn(0x7f70d80c7dc0 msgr2=0x7f70d80c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:48.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.173+0000 7f70de292700 1 -- 172.21.15.1:0/229351071 shutdown_connections 2023-11-15T02:53:48.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.173+0000 7f70de292700 1 -- 172.21.15.1:0/229351071 wait complete. 2023-11-15T02:53:48.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.174+0000 7f70de292700 1 Processor -- start 2023-11-15T02:53:48.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.174+0000 7f70de292700 1 -- start start 2023-11-15T02:53:48.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70de292700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70d8062ec0 0x7f70d80c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70de292700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d8152330 0x7f70d80c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70de292700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70d8152710 0x7f70d8164b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70de292700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80a4a30 con 0x7f70d8062ec0 2023-11-15T02:53:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70de292700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80c7280 con 0x7f70d8152710 2023-11-15T02:53:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70de292700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80c69e0 con 0x7f70d8152330 2023-11-15T02:53:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70d7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70d8062ec0 0x7f70d80c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70d7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70d8062ec0 0x7f70d80c5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46326/0 (socket says 172.21.15.1:46326) 2023-11-15T02:53:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70d7fff700 1 -- 172.21.15.1:0/2454843589 learned_addr learned my addr 172.21.15.1:0/2454843589 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70d77fe700 1 --2- 172.21.15.1:0/2454843589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d8152330 0x7f70d80c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70dc82f700 1 --2- 172.21.15.1:0/2454843589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70d8152710 0x7f70d8164b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70d7fff700 1 -- 172.21.15.1:0/2454843589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d8152330 msgr2=0x7f70d80c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70d7fff700 1 --2- 172.21.15.1:0/2454843589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d8152330 0x7f70d80c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70d7fff700 1 -- 172.21.15.1:0/2454843589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70d8152710 msgr2=0x7f70d8164b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70d7fff700 1 --2- 172.21.15.1:0/2454843589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70d8152710 0x7f70d8164b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70d7fff700 1 -- 172.21.15.1:0/2454843589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d0009a20 con 0x7f70d8062ec0 2023-11-15T02:53:48.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70dc82f700 1 --2- 172.21.15.1:0/2454843589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70d8152710 0x7f70d8164b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:53:48.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.175+0000 7f70d7fff700 1 --2- 172.21.15.1:0/2454843589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70d8062ec0 0x7f70d80c5c10 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f70c000d860 tx=0x7f70c0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:48.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.176+0000 7f70cffff700 1 -- 172.21.15.1:0/2454843589 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0011590 con 0x7f70d8062ec0 2023-11-15T02:53:48.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.176+0000 7f70cffff700 1 -- 172.21.15.1:0/2454843589 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c00116f0 con 0x7f70d8062ec0 2023-11-15T02:53:48.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.176+0000 7f70cffff700 1 -- 172.21.15.1:0/2454843589 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0011a70 con 0x7f70d8062ec0 2023-11-15T02:53:48.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.176+0000 7f70de292700 1 -- 172.21.15.1:0/2454843589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d80c6cc0 con 0x7f70d8062ec0 2023-11-15T02:53:48.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.176+0000 7f70de292700 1 -- 172.21.15.1:0/2454843589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d80c65f0 con 0x7f70d8062ec0 2023-11-15T02:53:48.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.177+0000 7f70cffff700 1 -- 172.21.15.1:0/2454843589 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f70c0012420 con 0x7f70d8062ec0 2023-11-15T02:53:48.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.178+0000 7f70cffff700 1 --2- 172.21.15.1:0/2454843589 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f70b805f270 0x7f70b8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.178+0000 7f70cffff700 1 -- 172.21.15.1:0/2454843589 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f70c007a250 con 0x7f70d8062ec0 2023-11-15T02:53:48.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.178+0000 7f70d77fe700 1 --2- 172.21.15.1:0/2454843589 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f70b805f270 0x7f70b8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.178+0000 7f70d77fe700 1 --2- 172.21.15.1:0/2454843589 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f70b805f270 0x7f70b8061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f70d80ae050 tx=0x7f70c8009040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:48.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.180+0000 7f70efc2bb80 1 Processor -- start 2023-11-15T02:53:48.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.180+0000 7f70efc2bb80 1 -- start start 2023-11-15T02:53:48.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.180+0000 7f70efc2bb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb6a5e40 0x5590eb911d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70efc2bb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb932ea0 0x5590eb8e97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70efc2bb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb8e9cb0 0x5590eb8e4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70efc2bb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590eb8af060 con 0x5590eb6a5e40 2023-11-15T02:53:48.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70efc2bb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590eb8261f0 con 0x5590eb8e9cb0 2023-11-15T02:53:48.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70efc2bb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590eb83b440 con 0x5590eb932ea0 2023-11-15T02:53:48.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70d7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb6a5e40 0x5590eb911d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70d7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb6a5e40 0x5590eb911d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46334/0 (socket says 172.21.15.1:46334) 2023-11-15T02:53:48.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70d7fff700 1 -- 172.21.15.1:0/654797611 learned_addr learned my addr 172.21.15.1:0/654797611 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:48.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70dc82f700 1 --2- 172.21.15.1:0/654797611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb8e9cb0 0x5590eb8e4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70d77fe700 1 --2- 172.21.15.1:0/654797611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb932ea0 0x5590eb8e97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70d7fff700 1 -- 172.21.15.1:0/654797611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb932ea0 msgr2=0x5590eb8e97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:48.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70d7fff700 1 --2- 172.21.15.1:0/654797611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb932ea0 0x5590eb8e97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70d7fff700 1 -- 172.21.15.1:0/654797611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb8e9cb0 msgr2=0x5590eb8e4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:48.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70d7fff700 1 --2- 172.21.15.1:0/654797611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb8e9cb0 0x5590eb8e4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70d7fff700 1 -- 172.21.15.1:0/654797611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590eb834620 con 0x5590eb6a5e40 2023-11-15T02:53:48.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70d7fff700 1 --2- 172.21.15.1:0/654797611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb6a5e40 0x5590eb911d90 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7f70c004b230 tx=0x7f70c0010000).ready entity=mon.0 client_cookie=51a1ea7873cacaaa server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:48.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70cd7fa700 1 -- 172.21.15.1:0/654797611 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c004ed50 con 0x5590eb6a5e40 2023-11-15T02:53:48.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70cd7fa700 1 -- 172.21.15.1:0/654797611 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0054470 con 0x5590eb6a5e40 2023-11-15T02:53:48.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.181+0000 7f70cd7fa700 1 -- 172.21.15.1:0/654797611 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0010d90 con 0x5590eb6a5e40 2023-11-15T02:53:48.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.182+0000 7f70efc2bb80 1 -- 172.21.15.1:0/654797611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb6a5e40 msgr2=0x5590eb911d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.182+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/654797611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb6a5e40 0x5590eb911d90 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7f70c004b230 tx=0x7f70c0010000).stop 2023-11-15T02:53:48.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.182+0000 7f70efc2bb80 1 -- 172.21.15.1:0/654797611 shutdown_connections 2023-11-15T02:53:48.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.182+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/654797611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb8e9cb0 0x5590eb8e4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.182+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/654797611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb6a5e40 0x5590eb911d90 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.182+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/654797611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb932ea0 0x5590eb8e97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.182+0000 7f70efc2bb80 1 -- 172.21.15.1:0/654797611 >> 172.21.15.1:0/654797611 conn(0x5590eb7534a0 msgr2=0x5590eb932790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:48.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.182+0000 7f70efc2bb80 1 -- 172.21.15.1:0/654797611 shutdown_connections 2023-11-15T02:53:48.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.182+0000 7f70efc2bb80 1 -- 172.21.15.1:0/654797611 wait complete. 2023-11-15T02:53:48.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.183+0000 7f70efc2bb80 1 -- start start 2023-11-15T02:53:48.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.183+0000 7f70efc2bb80 1 Processor -- start 2023-11-15T02:53:48.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.183+0000 7f70efc2bb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb6a5e40 0x5590eb93e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.183+0000 7f70efc2bb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb8e9cb0 0x5590eb9298b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.183+0000 7f70efc2bb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb932ea0 0x5590eb9161d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.183+0000 7f70efc2bb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590eb83b580 con 0x5590eb932ea0 2023-11-15T02:53:48.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.183+0000 7f70efc2bb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590eb83b800 con 0x5590eb8e9cb0 2023-11-15T02:53:48.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.183+0000 7f70efc2bb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590eb806e10 con 0x5590eb6a5e40 2023-11-15T02:53:48.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.183+0000 7f70efc2bb80 10 client.0 ll_register_callbacks cb 0x5590eb8a9460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T02:53:48.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.183+0000 7f70dc82f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb932ea0 0x5590eb9161d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70dc82f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb932ea0 0x5590eb9161d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46342/0 (socket says 172.21.15.1:46342) 2023-11-15T02:53:48.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70dc82f700 1 -- 172.21.15.1:0/4185200509 learned_addr learned my addr 172.21.15.1:0/4185200509 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:48.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70d7fff700 1 --2- 172.21.15.1:0/4185200509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb6a5e40 0x5590eb93e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70d77fe700 1 --2- 172.21.15.1:0/4185200509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb8e9cb0 0x5590eb9298b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70dc82f700 1 -- 172.21.15.1:0/4185200509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb6a5e40 msgr2=0x5590eb93e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:48.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70dc82f700 1 --2- 172.21.15.1:0/4185200509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb6a5e40 0x5590eb93e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70dc82f700 1 -- 172.21.15.1:0/4185200509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb8e9cb0 msgr2=0x5590eb9298b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:48.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70dc82f700 1 --2- 172.21.15.1:0/4185200509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb8e9cb0 0x5590eb9298b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70dc82f700 1 -- 172.21.15.1:0/4185200509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d80c65f0 con 0x5590eb932ea0 2023-11-15T02:53:48.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70dc82f700 1 --2- 172.21.15.1:0/4185200509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb932ea0 0x5590eb9161d0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f70d0011000 tx=0x7f70d80a7970).ready entity=mon.0 client_cookie=44c8d1422522903b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:48.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70b67fc700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T02:53:48.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70b67fc700 1 -- 172.21.15.1:0/4185200509 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0012410 con 0x5590eb932ea0 2023-11-15T02:53:48.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70b67fc700 1 -- 172.21.15.1:0/4185200509 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f70d001e400 con 0x5590eb932ea0 2023-11-15T02:53:48.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70efc2bb80 1 -- 172.21.15.1:0/4185200509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5590eb8dd720 con 0x5590eb932ea0 2023-11-15T02:53:48.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70b67fc700 1 -- 172.21.15.1:0/4185200509 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70d001e810 con 0x5590eb932ea0 2023-11-15T02:53:48.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70efc2bb80 10 client.9789 fetch_fsmap learned FSMap version 87 2023-11-15T02:53:48.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70efc2bb80 1 -- 172.21.15.1:0/4185200509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x5590eb82f9c0 con 0x5590eb932ea0 2023-11-15T02:53:48.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.184+0000 7f70b67fc700 1 -- 172.21.15.1:0/4185200509 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5590eb8dd720 con 0x5590eb932ea0 2023-11-15T02:53:48.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.185+0000 7f70b67fc700 1 -- 172.21.15.1:0/4185200509 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 87) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f70d0024020 con 0x5590eb932ea0 2023-11-15T02:53:48.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.185+0000 7f70efc2bb80 10 client.9789 fetch_fsmap finished waiting for FSMap version 87 2023-11-15T02:53:48.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.185+0000 7f70efc2bb80 10 client.9789 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-15T02:53:48.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.185+0000 7f70efc2bb80 20 client.9789 populate_metadata read hostname 'smithi001' 2023-11-15T02:53:48.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.185+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/4185200509 >> [v2:172.21.15.141:6834/1387364974,v1:172.21.15.141:6836/1387364974] conn(0x5590eb92df00 0x5590eb92e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.185+0000 7f70efc2bb80 4 client.9789 mds_command: new command op to 9609 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-15T02:53:48.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.185+0000 7f70efc2bb80 1 -- 172.21.15.1:0/4185200509 --> [v2:172.21.15.141:6834/1387364974,v1:172.21.15.141:6836/1387364974] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590eb6a1ca0 con 0x5590eb92df00 2023-11-15T02:53:48.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.185+0000 7f70d7fff700 1 --2- 172.21.15.1:0/4185200509 >> [v2:172.21.15.141:6834/1387364974,v1:172.21.15.141:6836/1387364974] conn(0x5590eb92df00 0x5590eb92e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.185+0000 7f70b67fc700 10 client.9789 ms_handle_connect on v2:172.21.15.141:6834/1387364974 2023-11-15T02:53:48.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.185+0000 7f70d7fff700 1 --2- 172.21.15.1:0/4185200509 >> [v2:172.21.15.141:6834/1387364974,v1:172.21.15.141:6836/1387364974] conn(0x5590eb92df00 0x5590eb92e2e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=cde44f9bd8bf3ac7 server_cookie=144535f5469e8fe9 in_seq=0 out_seq=0 2023-11-15T02:53:48.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.186+0000 7f70b67fc700 1 -- 172.21.15.1:0/4185200509 <== mds.0 v2:172.21.15.141:6834/1387364974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5590eb6a1ca0 con 0x5590eb92df00 2023-11-15T02:53:48.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.186+0000 7f70b67fc700 10 client.9789 handle_command_reply: tid=0 2023-11-15T02:53:48.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.186+0000 7f70efc2bb80 1 client.9789 shutdown 2023-11-15T02:53:48.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.186+0000 7f70efc2bb80 1 -- 172.21.15.1:0/4185200509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb932ea0 msgr2=0x5590eb9161d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.186+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/4185200509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb932ea0 0x5590eb9161d0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f70d0011000 tx=0x7f70d80a7970).stop 2023-11-15T02:53:48.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.186+0000 7f70efc2bb80 1 -- 172.21.15.1:0/4185200509 shutdown_connections 2023-11-15T02:53:48.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.186+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/4185200509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb932ea0 0x5590eb9161d0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.186+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/4185200509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb6a5e40 0x5590eb93e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.186+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/4185200509 >> [v2:172.21.15.141:6834/1387364974,v1:172.21.15.141:6836/1387364974] conn(0x5590eb92df00 0x5590eb92e2e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.186+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/4185200509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb8e9cb0 0x5590eb9298b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.186+0000 7f70b67fc700 0 client.9789 ms_handle_reset on v2:172.21.15.141:6834/1387364974 2023-11-15T02:53:48.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.186+0000 7f70efc2bb80 1 -- 172.21.15.1:0/4185200509 >> 172.21.15.1:0/4185200509 conn(0x5590eb7534a0 msgr2=0x5590eb8ea110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:48.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.186+0000 7f70efc2bb80 1 -- 172.21.15.1:0/4185200509 shutdown_connections 2023-11-15T02:53:48.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.186+0000 7f70efc2bb80 1 -- 172.21.15.1:0/4185200509 wait complete. 2023-11-15T02:53:48.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.186+0000 7f70efc2bb80 20 client.9789 trim_cache size 0 max 16384 2023-11-15T02:53:48.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.203+0000 7f70efc2bb80 1 Processor -- start 2023-11-15T02:53:48.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.203+0000 7f70efc2bb80 1 -- start start 2023-11-15T02:53:48.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70efc2bb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb6a5e40 0x5590eb93e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70efc2bb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb8e9cb0 0x5590eb8e7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70efc2bb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb932ea0 0x5590eb93ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70efc2bb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590eb8e5680 con 0x5590eb6a5e40 2023-11-15T02:53:48.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70efc2bb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590eb92c9d0 con 0x5590eb932ea0 2023-11-15T02:53:48.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70efc2bb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590eb929620 con 0x5590eb8e9cb0 2023-11-15T02:53:48.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70d7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb6a5e40 0x5590eb93e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70d7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb6a5e40 0x5590eb93e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46354/0 (socket says 172.21.15.1:46354) 2023-11-15T02:53:48.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70d7fff700 1 -- 172.21.15.1:0/2166638095 learned_addr learned my addr 172.21.15.1:0/2166638095 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:48.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70d77fe700 1 --2- 172.21.15.1:0/2166638095 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb8e9cb0 0x5590eb8e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70dc82f700 1 --2- 172.21.15.1:0/2166638095 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb932ea0 0x5590eb93ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70d7fff700 1 -- 172.21.15.1:0/2166638095 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb8e9cb0 msgr2=0x5590eb8e7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:48.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70d7fff700 1 --2- 172.21.15.1:0/2166638095 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb8e9cb0 0x5590eb8e7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70d7fff700 1 -- 172.21.15.1:0/2166638095 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb932ea0 msgr2=0x5590eb93ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:48.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70d7fff700 1 --2- 172.21.15.1:0/2166638095 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb932ea0 0x5590eb93ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70d7fff700 1 -- 172.21.15.1:0/2166638095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590eb8dd340 con 0x5590eb6a5e40 2023-11-15T02:53:48.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70d77fe700 1 --2- 172.21.15.1:0/2166638095 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb8e9cb0 0x5590eb8e7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:48.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70dc82f700 1 --2- 172.21.15.1:0/2166638095 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb932ea0 0x5590eb93ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:48.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70d7fff700 1 --2- 172.21.15.1:0/2166638095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb6a5e40 0x5590eb93e490 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7f70c004e910 tx=0x7f70c0056000).ready entity=mon.0 client_cookie=ed0847cac125254e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:48.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.204+0000 7f70cdffb700 1 -- 172.21.15.1:0/2166638095 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c005f110 con 0x5590eb6a5e40 2023-11-15T02:53:48.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.205+0000 7f70cdffb700 1 -- 172.21.15.1:0/2166638095 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c004ce70 con 0x5590eb6a5e40 2023-11-15T02:53:48.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.205+0000 7f70cdffb700 1 -- 172.21.15.1:0/2166638095 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0011bd0 con 0x5590eb6a5e40 2023-11-15T02:53:48.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.205+0000 7f70efc2bb80 1 -- 172.21.15.1:0/2166638095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb6a5e40 msgr2=0x5590eb93e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.205+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/2166638095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb6a5e40 0x5590eb93e490 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7f70c004e910 tx=0x7f70c0056000).stop 2023-11-15T02:53:48.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.205+0000 7f70efc2bb80 1 -- 172.21.15.1:0/2166638095 shutdown_connections 2023-11-15T02:53:48.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.205+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/2166638095 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb932ea0 0x5590eb93ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.205+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/2166638095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb6a5e40 0x5590eb93e490 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.205+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/2166638095 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb8e9cb0 0x5590eb8e7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.205+0000 7f70efc2bb80 1 -- 172.21.15.1:0/2166638095 >> 172.21.15.1:0/2166638095 conn(0x5590eb7534a0 msgr2=0x5590eb9161b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:48.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.205+0000 7f70efc2bb80 1 -- 172.21.15.1:0/2166638095 shutdown_connections 2023-11-15T02:53:48.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.205+0000 7f70efc2bb80 1 -- 172.21.15.1:0/2166638095 wait complete. 2023-11-15T02:53:48.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.206+0000 7f70efc2bb80 1 -- start start 2023-11-15T02:53:48.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.206+0000 7f70efc2bb80 1 Processor -- start 2023-11-15T02:53:48.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70efc2bb80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb6a5e40 0x5590eb937b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70efc2bb80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb8e9cb0 0x5590eb914460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70efc2bb80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb932ea0 0x5590eb914950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70efc2bb80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590eb914e40 con 0x5590eb932ea0 2023-11-15T02:53:48.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70efc2bb80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590eb936510 con 0x5590eb6a5e40 2023-11-15T02:53:48.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70efc2bb80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590eb935ec0 con 0x5590eb8e9cb0 2023-11-15T02:53:48.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70efc2bb80 10 client.0 ll_register_callbacks cb 0x5590eb8a9460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T02:53:48.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70dc82f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb932ea0 0x5590eb914950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70dc82f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb932ea0 0x5590eb914950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46370/0 (socket says 172.21.15.1:46370) 2023-11-15T02:53:48.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70dc82f700 1 -- 172.21.15.1:0/2832264818 learned_addr learned my addr 172.21.15.1:0/2832264818 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:48.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70d7fff700 1 --2- 172.21.15.1:0/2832264818 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb6a5e40 0x5590eb937b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70d77fe700 1 --2- 172.21.15.1:0/2832264818 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb8e9cb0 0x5590eb914460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70dc82f700 1 -- 172.21.15.1:0/2832264818 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb8e9cb0 msgr2=0x5590eb914460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:48.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70dc82f700 1 --2- 172.21.15.1:0/2832264818 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb8e9cb0 0x5590eb914460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70dc82f700 1 -- 172.21.15.1:0/2832264818 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb6a5e40 msgr2=0x5590eb937b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:48.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70dc82f700 1 --2- 172.21.15.1:0/2832264818 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb6a5e40 0x5590eb937b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70dc82f700 1 -- 172.21.15.1:0/2832264818 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590eb834620 con 0x5590eb932ea0 2023-11-15T02:53:48.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70dc82f700 1 --2- 172.21.15.1:0/2832264818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb932ea0 0x5590eb914950 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f70d0002230 tx=0x7f70d001f000).ready entity=mon.0 client_cookie=872106b275fb9d40 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:48.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70b67fc700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T02:53:48.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70b67fc700 1 -- 172.21.15.1:0/2832264818 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d001e9c0 con 0x5590eb932ea0 2023-11-15T02:53:48.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70b67fc700 1 -- 172.21.15.1:0/2832264818 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f70d001e400 con 0x5590eb932ea0 2023-11-15T02:53:48.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70efc2bb80 1 -- 172.21.15.1:0/2832264818 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70c0054470 con 0x5590eb932ea0 2023-11-15T02:53:48.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70b67fc700 1 -- 172.21.15.1:0/2832264818 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70d001ee10 con 0x5590eb932ea0 2023-11-15T02:53:48.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.207+0000 7f70efc2bb80 10 client.9795 fetch_fsmap learned FSMap version 87 2023-11-15T02:53:48.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.208+0000 7f70efc2bb80 1 -- 172.21.15.1:0/2832264818 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x5590eb82f710 con 0x5590eb932ea0 2023-11-15T02:53:48.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.208+0000 7f70b67fc700 1 -- 172.21.15.1:0/2832264818 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0054470 con 0x5590eb932ea0 2023-11-15T02:53:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.208+0000 7f70b67fc700 1 -- 172.21.15.1:0/2832264818 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 87) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f70d000b3e0 con 0x5590eb932ea0 2023-11-15T02:53:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.208+0000 7f70efc2bb80 10 client.9795 fetch_fsmap finished waiting for FSMap version 87 2023-11-15T02:53:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.208+0000 7f70efc2bb80 10 client.9795 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-15T02:53:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.208+0000 7f70efc2bb80 20 client.9795 populate_metadata read hostname 'smithi001' 2023-11-15T02:53:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.208+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/2832264818 >> [v2:172.21.15.141:6834/1387364974,v1:172.21.15.141:6836/1387364974] conn(0x5590eb936c30 0x5590eb937010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.208+0000 7f70efc2bb80 4 client.9795 mds_command: new command op to 9609 tid=0[{"prefix": "status"}] 2023-11-15T02:53:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.208+0000 7f70efc2bb80 1 -- 172.21.15.1:0/2832264818 --> [v2:172.21.15.141:6834/1387364974,v1:172.21.15.141:6836/1387364974] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5590eb6d8ca0 con 0x5590eb936c30 2023-11-15T02:53:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.208+0000 7f70d7fff700 1 --2- 172.21.15.1:0/2832264818 >> [v2:172.21.15.141:6834/1387364974,v1:172.21.15.141:6836/1387364974] conn(0x5590eb936c30 0x5590eb937010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.208+0000 7f70b67fc700 10 client.9795 ms_handle_connect on v2:172.21.15.141:6834/1387364974 2023-11-15T02:53:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.208+0000 7f70d7fff700 1 --2- 172.21.15.1:0/2832264818 >> [v2:172.21.15.141:6834/1387364974,v1:172.21.15.141:6836/1387364974] conn(0x5590eb936c30 0x5590eb937010 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1e65bbbcd87a5c77 server_cookie=11170450b7dcc3f3 in_seq=0 out_seq=0 2023-11-15T02:53:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70b67fc700 1 -- 172.21.15.1:0/2832264818 <== mds.0 v2:172.21.15.141:6834/1387364974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5590eb6d8ca0 con 0x5590eb936c30 2023-11-15T02:53:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70b67fc700 10 client.9795 handle_command_reply: tid=0 2023-11-15T02:53:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70efc2bb80 1 client.9795 shutdown 2023-11-15T02:53:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70efc2bb80 1 -- 172.21.15.1:0/2832264818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb932ea0 msgr2=0x5590eb914950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/2832264818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb932ea0 0x5590eb914950 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f70d0002230 tx=0x7f70d001f000).stop 2023-11-15T02:53:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70efc2bb80 1 -- 172.21.15.1:0/2832264818 shutdown_connections 2023-11-15T02:53:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/2832264818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590eb932ea0 0x5590eb914950 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/2832264818 >> [v2:172.21.15.141:6834/1387364974,v1:172.21.15.141:6836/1387364974] conn(0x5590eb936c30 0x5590eb937010 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/2832264818 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5590eb6a5e40 0x5590eb937b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70efc2bb80 1 --2- 172.21.15.1:0/2832264818 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590eb8e9cb0 0x5590eb914460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70b67fc700 0 client.9795 ms_handle_reset on v2:172.21.15.141:6834/1387364974 2023-11-15T02:53:48.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70efc2bb80 1 -- 172.21.15.1:0/2832264818 >> 172.21.15.1:0/2832264818 conn(0x5590eb7534a0 msgr2=0x5590eb92e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:48.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70efc2bb80 1 -- 172.21.15.1:0/2832264818 shutdown_connections 2023-11-15T02:53:48.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70efc2bb80 1 -- 172.21.15.1:0/2832264818 wait complete. 2023-11-15T02:53:48.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70efc2bb80 20 client.9795 trim_cache size 0 max 16384 2023-11-15T02:53:48.234 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:53:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "32ffb44b-12dc-4e79-bad7-24a9692dabf6", 2023-11-15T02:53:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2023-11-15T02:53:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 9609, 2023-11-15T02:53:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2023-11-15T02:53:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2023-11-15T02:53:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2023-11-15T02:53:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 10.229068207999999, 2023-11-15T02:53:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 87, 2023-11-15T02:53:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 196, 2023-11-15T02:53:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 196, 2023-11-15T02:53:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 15.709580247 2023-11-15T02:53:48.236 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:53:48.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70de292700 1 -- 172.21.15.1:0/2454843589 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f70b805f270 msgr2=0x7f70b8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70de292700 1 --2- 172.21.15.1:0/2454843589 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f70b805f270 0x7f70b8061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f70d80ae050 tx=0x7f70c8009040).stop 2023-11-15T02:53:48.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70de292700 1 -- 172.21.15.1:0/2454843589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70d8062ec0 msgr2=0x7f70d80c5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70de292700 1 --2- 172.21.15.1:0/2454843589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70d8062ec0 0x7f70d80c5c10 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f70c000d860 tx=0x7f70c0008040).stop 2023-11-15T02:53:48.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70de292700 1 -- 172.21.15.1:0/2454843589 shutdown_connections 2023-11-15T02:53:48.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70de292700 1 --2- 172.21.15.1:0/2454843589 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f70b805f270 0x7f70b8061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70de292700 1 --2- 172.21.15.1:0/2454843589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70d8152710 0x7f70d8164b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70de292700 1 --2- 172.21.15.1:0/2454843589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70d8062ec0 0x7f70d80c5c10 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70de292700 1 --2- 172.21.15.1:0/2454843589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d8152330 0x7f70d80c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70de292700 1 -- 172.21.15.1:0/2454843589 >> 172.21.15.1:0/2454843589 conn(0x7f70d80c7dc0 msgr2=0x7f70d814bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:48.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70de292700 1 -- 172.21.15.1:0/2454843589 shutdown_connections 2023-11-15T02:53:48.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.209+0000 7f70de292700 1 -- 172.21.15.1:0/2454843589 wait complete. 2023-11-15T02:53:48.240 DEBUG:teuthology.orchestra.run.smithi001:> ceph fs ls 2023-11-15T02:53:48.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.346+0000 7f48f587f700 1 Processor -- start 2023-11-15T02:53:48.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.346+0000 7f48f587f700 1 -- start start 2023-11-15T02:53:48.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.346+0000 7f48f587f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48f0154410 0x7f48f00ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.346+0000 7f48f587f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f48f0062c10 0x7f48f00ab580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.346+0000 7f48f587f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f0158150 con 0x7f48f0063140 2023-11-15T02:53:48.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.346+0000 7f48f587f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f0063670 con 0x7f48f0062c10 2023-11-15T02:53:48.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.346+0000 7f48f587f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f0063950 con 0x7f48f0154410 2023-11-15T02:53:48.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.347+0000 7f48ee7fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f48f0062c10 0x7f48f00ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.347+0000 7f48ef7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f48f0063140 0x7f48f01585e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44638/0 (socket says 172.21.15.1:44638) 2023-11-15T02:53:48.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.347+0000 7f48ef7fe700 1 -- 172.21.15.1:0/2419753040 learned_addr learned my addr 172.21.15.1:0/2419753040 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:48.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.347+0000 7f48eeffd700 1 --2- 172.21.15.1:0/2419753040 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48f0154410 0x7f48f00ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.347+0000 7f48ee7fc700 1 -- 172.21.15.1:0/2419753040 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48f0154410 msgr2=0x7f48f00ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:48.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.347+0000 7f48ee7fc700 1 --2- 172.21.15.1:0/2419753040 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48f0154410 0x7f48f00ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.347+0000 7f48ee7fc700 1 -- 172.21.15.1:0/2419753040 >> v1:172.21.15.1:6789/0 conn(0x7f48f0063140 legacy=0x7f48f01585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.347+0000 7f48ee7fc700 1 -- 172.21.15.1:0/2419753040 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f0063c30 con 0x7f48f0062c10 2023-11-15T02:53:48.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.347+0000 7f48edffb700 1 -- 172.21.15.1:0/2419753040 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005188108 0 0) 0x7f48f0158150 con 0x7f48f0063140 2023-11-15T02:53:48.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.347+0000 7f48eeffd700 1 --2- 172.21.15.1:0/2419753040 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48f0154410 0x7f48f00ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:48.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.347+0000 7f48ee7fc700 1 --2- 172.21.15.1:0/2419753040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48f0062c10 0x7f48f00ab580 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f48d8009760 tx=0x7f48d8009060).ready entity=mon.0 client_cookie=ef924edd9ea9ec67 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:48.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.347+0000 7f48edffb700 1 -- 172.21.15.1:0/2419753040 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d800b580 con 0x7f48f0062c10 2023-11-15T02:53:48.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.347+0000 7f48edffb700 1 -- 172.21.15.1:0/2419753040 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d800b6e0 con 0x7f48f0062c10 2023-11-15T02:53:48.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.347+0000 7f48edffb700 1 -- 172.21.15.1:0/2419753040 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d800ba60 con 0x7f48f0062c10 2023-11-15T02:53:48.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.348+0000 7f48f587f700 1 -- 172.21.15.1:0/2419753040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48f0062c10 msgr2=0x7f48f00ab580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.348+0000 7f48f587f700 1 --2- 172.21.15.1:0/2419753040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48f0062c10 0x7f48f00ab580 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f48d8009760 tx=0x7f48d8009060).stop 2023-11-15T02:53:48.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.348+0000 7f48f587f700 1 -- 172.21.15.1:0/2419753040 shutdown_connections 2023-11-15T02:53:48.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.348+0000 7f48f587f700 1 --2- 172.21.15.1:0/2419753040 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48f0154410 0x7f48f00ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.348+0000 7f48f587f700 1 --2- 172.21.15.1:0/2419753040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48f0062c10 0x7f48f00ab580 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.348+0000 7f48f587f700 1 -- 172.21.15.1:0/2419753040 >> 172.21.15.1:0/2419753040 conn(0x7f48f00cbbd0 msgr2=0x7f48f00c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:48.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.348+0000 7f48f587f700 1 -- 172.21.15.1:0/2419753040 shutdown_connections 2023-11-15T02:53:48.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.348+0000 7f48f587f700 1 -- 172.21.15.1:0/2419753040 wait complete. 2023-11-15T02:53:48.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.349+0000 7f48f587f700 1 Processor -- start 2023-11-15T02:53:48.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.349+0000 7f48f587f700 1 -- start start 2023-11-15T02:53:48.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48f587f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48f0062c10 0x7f48f0168d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48f587f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48f0063140 0x7f48f01556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48f587f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48f0154410 0x7f48f01572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48f587f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f01688d0 con 0x7f48f0154410 2023-11-15T02:53:48.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48f587f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f0155bb0 con 0x7f48f0062c10 2023-11-15T02:53:48.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48f587f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f00c2940 con 0x7f48f0063140 2023-11-15T02:53:48.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48ef7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48f0154410 0x7f48f01572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48ef7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48f0154410 0x7f48f01572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46394/0 (socket says 172.21.15.1:46394) 2023-11-15T02:53:48.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48ef7fe700 1 -- 172.21.15.1:0/4054404451 learned_addr learned my addr 172.21.15.1:0/4054404451 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:48.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48ee7fc700 1 --2- 172.21.15.1:0/4054404451 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48f0063140 0x7f48f01556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48eeffd700 1 --2- 172.21.15.1:0/4054404451 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48f0062c10 0x7f48f0168d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48ef7fe700 1 -- 172.21.15.1:0/4054404451 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48f0063140 msgr2=0x7f48f01556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48ef7fe700 1 --2- 172.21.15.1:0/4054404451 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48f0063140 0x7f48f01556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48ef7fe700 1 -- 172.21.15.1:0/4054404451 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48f0062c10 msgr2=0x7f48f0168d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48ef7fe700 1 --2- 172.21.15.1:0/4054404451 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48f0062c10 0x7f48f0168d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48ef7fe700 1 -- 172.21.15.1:0/4054404451 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d80092a0 con 0x7f48f0154410 2023-11-15T02:53:48.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.350+0000 7f48ef7fe700 1 --2- 172.21.15.1:0/4054404451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48f0154410 0x7f48f01572b0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f48e000c810 tx=0x7f48e0007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:48.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.351+0000 7f48e6ffd700 1 -- 172.21.15.1:0/4054404451 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0005d30 con 0x7f48f0154410 2023-11-15T02:53:48.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.351+0000 7f48e6ffd700 1 -- 172.21.15.1:0/4054404451 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e0005e90 con 0x7f48f0154410 2023-11-15T02:53:48.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.351+0000 7f48f587f700 1 -- 172.21.15.1:0/4054404451 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f00c2c00 con 0x7f48f0154410 2023-11-15T02:53:48.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.351+0000 7f48e6ffd700 1 -- 172.21.15.1:0/4054404451 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0007340 con 0x7f48f0154410 2023-11-15T02:53:48.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.351+0000 7f48f587f700 1 -- 172.21.15.1:0/4054404451 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f0168280 con 0x7f48f0154410 2023-11-15T02:53:48.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.352+0000 7f48f587f700 1 -- 172.21.15.1:0/4054404451 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f00475e0 con 0x7f48f0154410 2023-11-15T02:53:48.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.352+0000 7f48e6ffd700 1 -- 172.21.15.1:0/4054404451 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f48e00076f0 con 0x7f48f0154410 2023-11-15T02:53:48.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.352+0000 7f48e6ffd700 1 --2- 172.21.15.1:0/4054404451 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f48d005f270 0x7f48d0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:48.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.352+0000 7f48e6ffd700 1 -- 172.21.15.1:0/4054404451 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f48e007a550 con 0x7f48f0154410 2023-11-15T02:53:48.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.353+0000 7f48eeffd700 1 --2- 172.21.15.1:0/4054404451 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f48d005f270 0x7f48d0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:48.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.353+0000 7f48eeffd700 1 --2- 172.21.15.1:0/4054404451 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f48d005f270 0x7f48d0061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f48e800ab40 tx=0x7f48e8008040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:48.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.357+0000 7f48e6ffd700 1 -- 172.21.15.1:0/4054404451 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f48e004b490 con 0x7f48f0154410 2023-11-15T02:53:48.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.572+0000 7f48f587f700 1 -- 172.21.15.1:0/4054404451 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f48f0063f10 con 0x7f48f0154410 2023-11-15T02:53:48.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.572+0000 7f48e6ffd700 1 -- 172.21.15.1:0/4054404451 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v87) v1 ==== 53+0+73 (secure 0 0 0) 0x7f48e00079a0 con 0x7f48f0154410 2023-11-15T02:53:48.597 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-15T02:53:48.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.574+0000 7f48f587f700 1 -- 172.21.15.1:0/4054404451 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f48d005f270 msgr2=0x7f48d0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.574+0000 7f48f587f700 1 --2- 172.21.15.1:0/4054404451 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f48d005f270 0x7f48d0061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f48e800ab40 tx=0x7f48e8008040).stop 2023-11-15T02:53:48.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.574+0000 7f48f587f700 1 -- 172.21.15.1:0/4054404451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48f0154410 msgr2=0x7f48f01572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:48.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.574+0000 7f48f587f700 1 --2- 172.21.15.1:0/4054404451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48f0154410 0x7f48f01572b0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f48e000c810 tx=0x7f48e0007f30).stop 2023-11-15T02:53:48.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.574+0000 7f48f587f700 1 -- 172.21.15.1:0/4054404451 shutdown_connections 2023-11-15T02:53:48.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.574+0000 7f48f587f700 1 --2- 172.21.15.1:0/4054404451 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f48d005f270 0x7f48d0061730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.574+0000 7f48f587f700 1 --2- 172.21.15.1:0/4054404451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48f0154410 0x7f48f01572b0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.574+0000 7f48f587f700 1 --2- 172.21.15.1:0/4054404451 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48f0062c10 0x7f48f0168d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.574+0000 7f48f587f700 1 --2- 172.21.15.1:0/4054404451 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48f0063140 0x7f48f01556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:48.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.574+0000 7f48f587f700 1 -- 172.21.15.1:0/4054404451 >> 172.21.15.1:0/4054404451 conn(0x7f48f00cbbd0 msgr2=0x7f48f00ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:48.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.574+0000 7f48f587f700 1 -- 172.21.15.1:0/4054404451 shutdown_connections 2023-11-15T02:53:48.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:48.574+0000 7f48f587f700 1 -- 172.21.15.1:0/4054404451 wait complete. 2023-11-15T02:53:48.601 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-15T02:53:48.602 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-15T02:53:48.602 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-11-15T02:53:48.603 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-15T02:53:48.603 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-15T02:53:48.603 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-15T02:53:48.604 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-15T02:53:48.604 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-15T02:53:48.604 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T02:53:48.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:53:48.605 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-11-15T02:53:48.622 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T02:53:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T02:53:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T02:53:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:53:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-11-15T02:53:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:53:48.624 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T02:53:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-11-15T02:53:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-11-15T02:53:48.624 INFO:teuthology.orchestra.run.smithi001.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-15T02:53:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-11-15T02:53:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-11-15T02:53:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-15T02:53:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 36977sec preferred_lft 36977sec 2023-11-15T02:53:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2023-11-15T02:53:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:53:48.626 INFO:teuthology.orchestra.run.smithi001.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T02:53:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-11-15T02:53:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-11-15T02:53:48.626 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T02:53:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-11-15T02:53:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-11-15T02:53:48.627 INFO:teuthology.orchestra.run.smithi001.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-15T02:53:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff 2023-11-15T02:53:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-15T02:53:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:53:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::74ff:4aff:fef6:c8f5/64 scope link 2023-11-15T02:53:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:53:48.628 INFO:teuthology.orchestra.run.smithi001.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T02:53:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-15T02:53:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::10ca:5cff:fe8a:9a23/64 scope link 2023-11-15T02:53:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:53:48.629 INFO:teuthology.orchestra.run.smithi001.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T02:53:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 92:7a:64:05:0f:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-15T02:53:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::907a:64ff:fe05:f37/64 scope link 2023-11-15T02:53:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:53:48.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:53:48.630 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-15T02:53:48.687 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-11-15T02:53:48.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:53:48.689 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-11-15T02:53:48.746 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-11-15T02:53:48.746 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-15T02:53:48.746 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-15T02:53:48.746 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-15T02:53:48.747 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-15T02:53:48.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:53:48.748 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T02:53:48.748 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T02:53:48.748 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-15T02:53:48.749 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-15T02:53:48.749 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-15T02:53:48.750 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T02:53:48.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:53:48.849 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T02:53:48.864 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-15T02:53:48.864 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-15T02:53:48.865 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T02:53:48.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:53:48.865 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2023-11-15T02:53:48.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:53:48.930 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-15T02:53:48.986 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-15T02:53:48.987 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T02:53:49.067 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T02:53:49.067 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T02:53:49.092 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T02:53:49.093 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T02:53:49.095 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-15T02:53:49.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:53:49.096 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-15T02:53:49.160 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-15T02:53:49.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.319+0000 7fab7b5d0700 1 Processor -- start 2023-11-15T02:53:49.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.319+0000 7fab7b5d0700 1 -- start start 2023-11-15T02:53:49.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.320+0000 7fab7b5d0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab740833a0 0x7fab740a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:49.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.320+0000 7fab7b5d0700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab740a85e0 con 0x7fab740be520 2023-11-15T02:53:49.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.320+0000 7fab7b5d0700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab74065660 con 0x7fab74154450 2023-11-15T02:53:49.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.320+0000 7fab7b5d0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab74065940 con 0x7fab740833a0 2023-11-15T02:53:49.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.320+0000 7fab79b6d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fab740be520 0x7fab740c7470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44642/0 (socket says 172.21.15.1:44642) 2023-11-15T02:53:49.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.320+0000 7fab79b6d700 1 -- 172.21.15.1:0/3226553190 learned_addr learned my addr 172.21.15.1:0/3226553190 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:49.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.320+0000 7fab78b6b700 1 --2- 172.21.15.1:0/3226553190 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab740833a0 0x7fab740a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:49.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.320+0000 7fab6bfff700 1 -- 172.21.15.1:0/3226553190 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195198103 0 0) 0x7fab740a85e0 con 0x7fab740be520 2023-11-15T02:53:49.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.320+0000 7fab6bfff700 1 -- 172.21.15.1:0/3226553190 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab600033f0 con 0x7fab740be520 2023-11-15T02:53:49.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.320+0000 7fab6bfff700 1 -- 172.21.15.1:0/3226553190 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699374741 0 0) 0x7fab74065660 con 0x7fab74154450 2023-11-15T02:53:49.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.320+0000 7fab6bfff700 1 -- 172.21.15.1:0/3226553190 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab740a85e0 con 0x7fab74154450 2023-11-15T02:53:49.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.320+0000 7fab78b6b700 1 -- 172.21.15.1:0/3226553190 >> v1:172.21.15.141:6789/0 conn(0x7fab74154450 legacy=0x7fab740bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:49.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.321+0000 7fab78b6b700 1 -- 172.21.15.1:0/3226553190 >> v1:172.21.15.1:6789/0 conn(0x7fab740be520 legacy=0x7fab740c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:49.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.321+0000 7fab78b6b700 1 -- 172.21.15.1:0/3226553190 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab740c6f50 con 0x7fab740833a0 2023-11-15T02:53:49.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.321+0000 7fab78b6b700 1 --2- 172.21.15.1:0/3226553190 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab740833a0 0x7fab740a7ef0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fab64009790 tx=0x7fab64009060).ready entity=mon.2 client_cookie=d583457e64853d91 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:49.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.321+0000 7fab6bfff700 1 -- 172.21.15.1:0/3226553190 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6400f510 con 0x7fab740833a0 2023-11-15T02:53:49.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.321+0000 7fab6bfff700 1 -- 172.21.15.1:0/3226553190 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6400f670 con 0x7fab740833a0 2023-11-15T02:53:49.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.321+0000 7fab6bfff700 1 -- 172.21.15.1:0/3226553190 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6400f9f0 con 0x7fab740833a0 2023-11-15T02:53:49.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.321+0000 7fab7b5d0700 1 -- 172.21.15.1:0/3226553190 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab740833a0 msgr2=0x7fab740a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:49.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.321+0000 7fab7b5d0700 1 --2- 172.21.15.1:0/3226553190 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab740833a0 0x7fab740a7ef0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fab64009790 tx=0x7fab64009060).stop 2023-11-15T02:53:49.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.321+0000 7fab7b5d0700 1 -- 172.21.15.1:0/3226553190 shutdown_connections 2023-11-15T02:53:49.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.321+0000 7fab7b5d0700 1 --2- 172.21.15.1:0/3226553190 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab740833a0 0x7fab740a7ef0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:49.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.321+0000 7fab7b5d0700 1 -- 172.21.15.1:0/3226553190 >> 172.21.15.1:0/3226553190 conn(0x7fab74082f90 msgr2=0x7fab740c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:49.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.321+0000 7fab7b5d0700 1 -- 172.21.15.1:0/3226553190 shutdown_connections 2023-11-15T02:53:49.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.321+0000 7fab7b5d0700 1 -- 172.21.15.1:0/3226553190 wait complete. 2023-11-15T02:53:49.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.323+0000 7fab7b5d0700 1 Processor -- start 2023-11-15T02:53:49.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.323+0000 7fab7b5d0700 1 -- start start 2023-11-15T02:53:49.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.323+0000 7fab7b5d0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab740833a0 0x7fab741501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:49.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.323+0000 7fab7b5d0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab740be520 0x7fab740ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:49.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.323+0000 7fab7b5d0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab74154450 0x7fab74167a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:49.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.323+0000 7fab7b5d0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab74168900 con 0x7fab74154450 2023-11-15T02:53:49.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.323+0000 7fab7b5d0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7414fd40 con 0x7fab740833a0 2023-11-15T02:53:49.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.323+0000 7fab7b5d0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab74168620 con 0x7fab740be520 2023-11-15T02:53:49.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab79b6d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab74154450 0x7fab74167a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:49.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab79b6d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab74154450 0x7fab74167a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46396/0 (socket says 172.21.15.1:46396) 2023-11-15T02:53:49.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab79b6d700 1 -- 172.21.15.1:0/329228657 learned_addr learned my addr 172.21.15.1:0/329228657 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:49.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab78b6b700 1 --2- 172.21.15.1:0/329228657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab740be520 0x7fab740ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:49.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab7936c700 1 --2- 172.21.15.1:0/329228657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab740833a0 0x7fab741501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:49.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab79b6d700 1 -- 172.21.15.1:0/329228657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab740be520 msgr2=0x7fab740ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:49.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab79b6d700 1 --2- 172.21.15.1:0/329228657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab740be520 0x7fab740ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:49.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab79b6d700 1 -- 172.21.15.1:0/329228657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab740833a0 msgr2=0x7fab741501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:49.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab79b6d700 1 --2- 172.21.15.1:0/329228657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab740833a0 0x7fab741501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:49.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab79b6d700 1 -- 172.21.15.1:0/329228657 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab640092a0 con 0x7fab74154450 2023-11-15T02:53:49.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab78b6b700 1 --2- 172.21.15.1:0/329228657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab740be520 0x7fab740ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:53:49.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab79b6d700 1 --2- 172.21.15.1:0/329228657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab74154450 0x7fab74167a40 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7fab6c00c790 tx=0x7fab6c007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:49.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab697fa700 1 -- 172.21.15.1:0/329228657 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c005d30 con 0x7fab74154450 2023-11-15T02:53:49.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab697fa700 1 -- 172.21.15.1:0/329228657 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c005e90 con 0x7fab74154450 2023-11-15T02:53:49.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab697fa700 1 -- 172.21.15.1:0/329228657 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c007360 con 0x7fab74154450 2023-11-15T02:53:49.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab7b5d0700 1 -- 172.21.15.1:0/329228657 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7414f6f0 con 0x7fab74154450 2023-11-15T02:53:49.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.324+0000 7fab7b5d0700 1 -- 172.21.15.1:0/329228657 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab740ae660 con 0x7fab74154450 2023-11-15T02:53:49.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.325+0000 7fab7b5d0700 1 -- 172.21.15.1:0/329228657 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7414feb0 con 0x7fab74154450 2023-11-15T02:53:49.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.326+0000 7fab697fa700 1 -- 172.21.15.1:0/329228657 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fab6c0076d0 con 0x7fab74154450 2023-11-15T02:53:49.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.326+0000 7fab697fa700 1 --2- 172.21.15.1:0/329228657 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fab5805f240 0x7fab58061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:49.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.326+0000 7fab697fa700 1 -- 172.21.15.1:0/329228657 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7fab6c07a560 con 0x7fab74154450 2023-11-15T02:53:49.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.326+0000 7fab7936c700 1 --2- 172.21.15.1:0/329228657 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fab5805f240 0x7fab58061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:49.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.327+0000 7fab7936c700 1 --2- 172.21.15.1:0/329228657 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fab5805f240 0x7fab58061700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fab70003730 tx=0x7fab70009040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:49.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.330+0000 7fab697fa700 1 -- 172.21.15.1:0/329228657 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fab6c04eed0 con 0x7fab74154450 2023-11-15T02:53:49.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.533+0000 7fab7b5d0700 1 -- 172.21.15.1:0/329228657 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fab74065350 con 0x7fab5805f240 2023-11-15T02:53:49.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.535+0000 7fab697fa700 1 -- 172.21.15.1:0/329228657 <== mgr.8590 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fab74065350 con 0x7fab5805f240 2023-11-15T02:53:49.536 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T02:53:49.536 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:53:49.536 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephfs" 2023-11-15T02:53:49.537 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:53:49.537 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T02:53:49.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.537+0000 7fab7b5d0700 1 -- 172.21.15.1:0/329228657 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fab5805f240 msgr2=0x7fab58061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:49.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.537+0000 7fab7b5d0700 1 --2- 172.21.15.1:0/329228657 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fab5805f240 0x7fab58061700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fab70003730 tx=0x7fab70009040).stop 2023-11-15T02:53:49.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.537+0000 7fab7b5d0700 1 -- 172.21.15.1:0/329228657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab74154450 msgr2=0x7fab74167a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:49.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.537+0000 7fab7b5d0700 1 --2- 172.21.15.1:0/329228657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab74154450 0x7fab74167a40 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7fab6c00c790 tx=0x7fab6c007f70).stop 2023-11-15T02:53:49.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.537+0000 7fab7b5d0700 1 -- 172.21.15.1:0/329228657 shutdown_connections 2023-11-15T02:53:49.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.537+0000 7fab7b5d0700 1 --2- 172.21.15.1:0/329228657 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fab5805f240 0x7fab58061700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:49.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.537+0000 7fab7b5d0700 1 --2- 172.21.15.1:0/329228657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab74154450 0x7fab74167a40 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:49.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.537+0000 7fab7b5d0700 1 --2- 172.21.15.1:0/329228657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab740833a0 0x7fab741501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:49.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.537+0000 7fab7b5d0700 1 --2- 172.21.15.1:0/329228657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab740be520 0x7fab740ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:49.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.537+0000 7fab7b5d0700 1 -- 172.21.15.1:0/329228657 >> 172.21.15.1:0/329228657 conn(0x7fab74082f90 msgr2=0x7fab740a7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:49.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.537+0000 7fab7b5d0700 1 -- 172.21.15.1:0/329228657 shutdown_connections 2023-11-15T02:53:49.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.537+0000 7fab7b5d0700 1 -- 172.21.15.1:0/329228657 wait complete. 2023-11-15T02:53:49.550 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-15T02:53:49.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.669+0000 7f214417b700 1 Processor -- start 2023-11-15T02:53:49.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.669+0000 7f214417b700 1 -- start start 2023-11-15T02:53:49.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.670+0000 7f214417b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f213c14ebd0 0x7f213c137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:49.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.670+0000 7f214417b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213c154ce0 con 0x7f213c137030 2023-11-15T02:53:49.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.670+0000 7f214417b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213c154fc0 con 0x7f213c066f80 2023-11-15T02:53:49.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.670+0000 7f214417b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213c137900 con 0x7f213c14ebd0 2023-11-15T02:53:49.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.670+0000 7f2141f17700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f213c137030 0x7f213c066870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44652/0 (socket says 172.21.15.1:44652) 2023-11-15T02:53:49.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.670+0000 7f2141f17700 1 -- 172.21.15.1:0/1118011016 learned_addr learned my addr 172.21.15.1:0/1118011016 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:49.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.670+0000 7f2142718700 1 --2- 172.21.15.1:0/1118011016 >> v2:172.21.15.141:3300/0 conn(0x7f213c14ebd0 0x7f213c137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:49.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.671+0000 7f2140f15700 1 -- 172.21.15.1:0/1118011016 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314235524 0 0) 0x7f213c154ce0 con 0x7f213c137030 2023-11-15T02:53:49.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.671+0000 7f2140f15700 1 -- 172.21.15.1:0/1118011016 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21240033f0 con 0x7f213c137030 2023-11-15T02:53:49.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.671+0000 7f2142718700 1 -- 172.21.15.1:0/1118011016 >> v1:172.21.15.141:6789/0 conn(0x7f213c066f80 legacy=0x7f213c14e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:49.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.671+0000 7f2140f15700 1 -- 172.21.15.1:0/1118011016 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288968298 0 0) 0x7f213c154fc0 con 0x7f213c066f80 2023-11-15T02:53:49.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.671+0000 7f2142718700 1 -- 172.21.15.1:0/1118011016 >> v1:172.21.15.1:6789/0 conn(0x7f213c137030 legacy=0x7f213c066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:49.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.671+0000 7f2142718700 1 -- 172.21.15.1:0/1118011016 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c1552a0 con 0x7f213c14ebd0 2023-11-15T02:53:49.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.671+0000 7f2142718700 1 --2- 172.21.15.1:0/1118011016 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f213c14ebd0 0x7f213c137410 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f212c009e60 tx=0x7f212c009780).ready entity=mon.1 client_cookie=64114a60c6109048 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:49.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.671+0000 7f2140f15700 1 -- 172.21.15.1:0/1118011016 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c00e070 con 0x7f213c14ebd0 2023-11-15T02:53:49.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.671+0000 7f2140f15700 1 -- 172.21.15.1:0/1118011016 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c00bb60 con 0x7f213c14ebd0 2023-11-15T02:53:49.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.671+0000 7f2140f15700 1 -- 172.21.15.1:0/1118011016 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c00bee0 con 0x7f213c14ebd0 2023-11-15T02:53:49.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.672+0000 7f214417b700 1 -- 172.21.15.1:0/1118011016 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f213c14ebd0 msgr2=0x7f213c137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:49.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.672+0000 7f214417b700 1 --2- 172.21.15.1:0/1118011016 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f213c14ebd0 0x7f213c137410 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f212c009e60 tx=0x7f212c009780).stop 2023-11-15T02:53:49.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.672+0000 7f214417b700 1 -- 172.21.15.1:0/1118011016 shutdown_connections 2023-11-15T02:53:49.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.672+0000 7f214417b700 1 --2- 172.21.15.1:0/1118011016 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f213c14ebd0 0x7f213c137410 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:49.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.672+0000 7f214417b700 1 -- 172.21.15.1:0/1118011016 >> 172.21.15.1:0/1118011016 conn(0x7f213c063280 msgr2=0x7f213c0c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:49.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.672+0000 7f214417b700 1 -- 172.21.15.1:0/1118011016 shutdown_connections 2023-11-15T02:53:49.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.672+0000 7f214417b700 1 -- 172.21.15.1:0/1118011016 wait complete. 2023-11-15T02:53:49.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.673+0000 7f214417b700 1 Processor -- start 2023-11-15T02:53:49.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.673+0000 7f214417b700 1 -- start start 2023-11-15T02:53:49.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f214417b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f213c066f80 0x7f213c1383f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:49.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f214417b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f213c137030 0x7f213c136710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:49.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f214417b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f213c14ebd0 0x7f213c150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:49.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f214417b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c164530 con 0x7f213c137030 2023-11-15T02:53:49.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f214417b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c14e770 con 0x7f213c066f80 2023-11-15T02:53:49.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f214417b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213c0acc30 con 0x7f213c14ebd0 2023-11-15T02:53:49.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2141716700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f213c137030 0x7f213c136710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:49.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2141716700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f213c137030 0x7f213c136710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46404/0 (socket says 172.21.15.1:46404) 2023-11-15T02:53:49.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2141716700 1 -- 172.21.15.1:0/2971692043 learned_addr learned my addr 172.21.15.1:0/2971692043 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:49.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2142718700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f213c14ebd0 0x7f213c150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:49.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2141f17700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f213c066f80 0x7f213c1383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2141716700 1 -- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f213c14ebd0 msgr2=0x7f213c150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2141716700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f213c14ebd0 0x7f213c150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2141716700 1 -- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f213c066f80 msgr2=0x7f213c1383f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2141716700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f213c066f80 0x7f213c1383f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2141716700 1 -- 172.21.15.1:0/2971692043 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c009a20 con 0x7f213c137030 2023-11-15T02:53:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2142718700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f213c14ebd0 0x7f213c150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2141f17700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f213c066f80 0x7f213c1383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:53:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2141716700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f213c137030 0x7f213c136710 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f213000c490 tx=0x7f2130007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2139ffb700 1 -- 172.21.15.1:0/2971692043 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130007020 con 0x7f213c137030 2023-11-15T02:53:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2139ffb700 1 -- 172.21.15.1:0/2971692043 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21300071a0 con 0x7f213c137030 2023-11-15T02:53:49.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f214417b700 1 -- 172.21.15.1:0/2971692043 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213c0acf10 con 0x7f213c137030 2023-11-15T02:53:49.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.674+0000 7f2139ffb700 1 -- 172.21.15.1:0/2971692043 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130007560 con 0x7f213c137030 2023-11-15T02:53:49.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.675+0000 7f214417b700 1 -- 172.21.15.1:0/2971692043 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213c0ad4d0 con 0x7f213c137030 2023-11-15T02:53:49.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.676+0000 7f214417b700 1 -- 172.21.15.1:0/2971692043 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213c0aee50 con 0x7f213c137030 2023-11-15T02:53:49.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.676+0000 7f2139ffb700 1 -- 172.21.15.1:0/2971692043 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 89) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f21300068b0 con 0x7f213c137030 2023-11-15T02:53:49.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.676+0000 7f2139ffb700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f212805f240 0x7f2128061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:49.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.676+0000 7f2139ffb700 1 -- 172.21.15.1:0/2971692043 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f2130079fa0 con 0x7f213c137030 2023-11-15T02:53:49.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.676+0000 7f2141f17700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f212805f240 0x7f2128061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:49.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.677+0000 7f2141f17700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f212805f240 0x7f2128061700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2134005750 tx=0x7f2134009040).ready entity=mgr.8590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:49.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.680+0000 7f2139ffb700 1 -- 172.21.15.1:0/2971692043 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f213004aee0 con 0x7f213c137030 2023-11-15T02:53:49.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:49.903+0000 7f214417b700 1 -- 172.21.15.1:0/2971692043 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f213c06c7e0 con 0x7f213c137030 2023-11-15T02:53:50.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.838+0000 7f2139ffb700 1 -- 172.21.15.1:0/2971692043 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 90) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f21300779e0 con 0x7f213c137030 2023-11-15T02:53:50.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.840+0000 7f2139ffb700 1 -- 172.21.15.1:0/2971692043 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v90) v1 ==== 92+0+0 (secure 0 0 0) 0x7f2130073200 con 0x7f213c137030 2023-11-15T02:53:50.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.842+0000 7f214417b700 1 -- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f212805f240 msgr2=0x7f2128061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:50.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.842+0000 7f214417b700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f212805f240 0x7f2128061700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2134005750 tx=0x7f2134009040).stop 2023-11-15T02:53:50.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.842+0000 7f214417b700 1 -- 172.21.15.1:0/2971692043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f213c137030 msgr2=0x7f213c136710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:50.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.842+0000 7f214417b700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f213c137030 0x7f213c136710 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f213000c490 tx=0x7f2130007da0).stop 2023-11-15T02:53:50.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.843+0000 7f214417b700 1 -- 172.21.15.1:0/2971692043 shutdown_connections 2023-11-15T02:53:50.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.843+0000 7f214417b700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f212805f240 0x7f2128061700 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:50.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.843+0000 7f214417b700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f213c14ebd0 0x7f213c150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:50.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.843+0000 7f214417b700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f213c066f80 0x7f213c1383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:50.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.843+0000 7f214417b700 1 --2- 172.21.15.1:0/2971692043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f213c137030 0x7f213c136710 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:50.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.843+0000 7f214417b700 1 -- 172.21.15.1:0/2971692043 >> 172.21.15.1:0/2971692043 conn(0x7f213c063280 msgr2=0x7f213c063ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:50.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.843+0000 7f214417b700 1 -- 172.21.15.1:0/2971692043 shutdown_connections 2023-11-15T02:53:50.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.843+0000 7f214417b700 1 -- 172.21.15.1:0/2971692043 wait complete. 2023-11-15T02:53:50.860 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-15T02:53:50.985 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:50.984+0000 7f5be47eb680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:53:50.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.988+0000 7f5bf5041700 1 Processor -- start 2023-11-15T02:53:50.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.988+0000 7f5bf5041700 1 -- start start 2023-11-15T02:53:50.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.989+0000 7f5bf5041700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5bf00c6650 0x7f5bf00aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:50.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.989+0000 7f5bf5041700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf00ca050 con 0x7f5bf01540a0 2023-11-15T02:53:50.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.989+0000 7f5bf5041700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf00c9440 con 0x7f5bf0154480 2023-11-15T02:53:50.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.989+0000 7f5bf5041700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf00c9720 con 0x7f5bf00c6650 2023-11-15T02:53:50.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.989+0000 7f5bef59e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5bf00c6650 0x7f5bf00aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:50.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.989+0000 7f5bef59e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5bf00c6650 0x7f5bf00aaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46434/0 (socket says 172.21.15.1:46434) 2023-11-15T02:53:50.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.989+0000 7f5bef59e700 1 -- 172.21.15.1:0/2735609938 learned_addr learned my addr 172.21.15.1:0/2735609938 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:50.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.989+0000 7f5beed9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5bf01540a0 0x7f5bf00ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44668/0 (socket says 172.21.15.1:44668) 2023-11-15T02:53:50.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.990+0000 7f5bef59e700 1 -- 172.21.15.1:0/2735609938 >> v1:172.21.15.141:6789/0 conn(0x7f5bf0154480 legacy=0x7f5bf00c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:50.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.990+0000 7f5bef59e700 1 -- 172.21.15.1:0/2735609938 >> v1:172.21.15.1:6789/0 conn(0x7f5bf01540a0 legacy=0x7f5bf00ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:50.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.990+0000 7f5bedd9b700 1 -- 172.21.15.1:0/2735609938 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208567414 0 0) 0x7f5bf00c9440 con 0x7f5bf0154480 2023-11-15T02:53:50.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.990+0000 7f5bef59e700 1 -- 172.21.15.1:0/2735609938 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf00c9a00 con 0x7f5bf00c6650 2023-11-15T02:53:50.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.990+0000 7f5bef59e700 1 --2- 172.21.15.1:0/2735609938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bf00c6650 0x7f5bf00aaf40 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7f5be8009f20 tx=0x7f5be8009840).ready entity=mon.0 client_cookie=df4de9146ace52f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:50.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.990+0000 7f5bedd9b700 1 -- 172.21.15.1:0/2735609938 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be800e070 con 0x7f5bf00c6650 2023-11-15T02:53:50.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.990+0000 7f5bedd9b700 1 -- 172.21.15.1:0/2735609938 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be800b980 con 0x7f5bf00c6650 2023-11-15T02:53:50.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.990+0000 7f5bedd9b700 1 -- 172.21.15.1:0/2735609938 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be800bd00 con 0x7f5bf00c6650 2023-11-15T02:53:50.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.991+0000 7f5bf5041700 1 -- 172.21.15.1:0/2735609938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bf00c6650 msgr2=0x7f5bf00aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:50.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.991+0000 7f5bf5041700 1 --2- 172.21.15.1:0/2735609938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bf00c6650 0x7f5bf00aaf40 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7f5be8009f20 tx=0x7f5be8009840).stop 2023-11-15T02:53:50.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.991+0000 7f5bf5041700 1 -- 172.21.15.1:0/2735609938 shutdown_connections 2023-11-15T02:53:50.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.991+0000 7f5bf5041700 1 --2- 172.21.15.1:0/2735609938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bf00c6650 0x7f5bf00aaf40 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:50.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.991+0000 7f5bf5041700 1 -- 172.21.15.1:0/2735609938 >> 172.21.15.1:0/2735609938 conn(0x7f5bf0064a70 msgr2=0x7f5bf0064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:50.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.991+0000 7f5bf5041700 1 -- 172.21.15.1:0/2735609938 shutdown_connections 2023-11-15T02:53:50.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.991+0000 7f5bf5041700 1 -- 172.21.15.1:0/2735609938 wait complete. 2023-11-15T02:53:50.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.992+0000 7f5bf5041700 1 Processor -- start 2023-11-15T02:53:50.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.992+0000 7f5bf5041700 1 -- start start 2023-11-15T02:53:50.997 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:50.992+0000 7fa49d7cc680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:53:51.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5bf5041700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5bf00c6650 0x7f5bf00c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:51.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5bf5041700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bf01540a0 0x7f5bf013dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:51.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5bf5041700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5bf0154480 0x7f5bf0164c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:51.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5bf5041700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf013e180 con 0x7f5bf01540a0 2023-11-15T02:53:51.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5bf5041700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00af430 con 0x7f5bf00c6650 2023-11-15T02:53:51.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5bf5041700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00c3700 con 0x7f5bf0154480 2023-11-15T02:53:51.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5bee59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bf01540a0 0x7f5bf013dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:51.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5beed9d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5bf00c6650 0x7f5bf00c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:51.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5bee59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bf01540a0 0x7f5bf013dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46436/0 (socket says 172.21.15.1:46436) 2023-11-15T02:53:51.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5bee59c700 1 -- 172.21.15.1:0/2771899593 learned_addr learned my addr 172.21.15.1:0/2771899593 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:51.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5bef59e700 1 --2- 172.21.15.1:0/2771899593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5bf0154480 0x7f5bf0164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:51.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5bee59c700 1 -- 172.21.15.1:0/2771899593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5bf0154480 msgr2=0x7f5bf0164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:51.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5bee59c700 1 --2- 172.21.15.1:0/2771899593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5bf0154480 0x7f5bf0164c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:51.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5bee59c700 1 -- 172.21.15.1:0/2771899593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5bf00c6650 msgr2=0x7f5bf00c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:51.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5bee59c700 1 --2- 172.21.15.1:0/2771899593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5bf00c6650 0x7f5bf00c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:51.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.993+0000 7f5bee59c700 1 -- 172.21.15.1:0/2771899593 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be8009ae0 con 0x7f5bf01540a0 2023-11-15T02:53:51.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.994+0000 7f5bee59c700 1 --2- 172.21.15.1:0/2771899593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bf01540a0 0x7f5bf013dc90 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f5be400c410 tx=0x7f5be4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:51.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.994+0000 7f5bd6ffd700 1 -- 172.21.15.1:0/2771899593 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4007020 con 0x7f5bf01540a0 2023-11-15T02:53:51.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.994+0000 7f5bd6ffd700 1 -- 172.21.15.1:0/2771899593 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be40071a0 con 0x7f5bf01540a0 2023-11-15T02:53:51.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.994+0000 7f5bf5041700 1 -- 172.21.15.1:0/2771899593 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf00c39e0 con 0x7f5bf01540a0 2023-11-15T02:53:51.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.994+0000 7f5bd6ffd700 1 -- 172.21.15.1:0/2771899593 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4007560 con 0x7f5bf01540a0 2023-11-15T02:53:51.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.994+0000 7f5bf5041700 1 -- 172.21.15.1:0/2771899593 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf00c3fa0 con 0x7f5bf01540a0 2023-11-15T02:53:51.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.995+0000 7f5bf5041700 1 -- 172.21.15.1:0/2771899593 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf006c7e0 con 0x7f5bf01540a0 2023-11-15T02:53:51.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.995+0000 7f5bd6ffd700 1 -- 172.21.15.1:0/2771899593 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 90) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f5be40068b0 con 0x7f5bf01540a0 2023-11-15T02:53:51.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.995+0000 7f5bd6ffd700 1 --2- 172.21.15.1:0/2771899593 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bdc05f2c0 0x7f5bdc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:51.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.996+0000 7f5bd6ffd700 1 -- 172.21.15.1:0/2771899593 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f5be4079940 con 0x7f5bf01540a0 2023-11-15T02:53:51.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.996+0000 7f5beed9d700 1 -- 172.21.15.1:0/2771899593 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bdc05f2c0 msgr2=0x7f5bdc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:51.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:50.996+0000 7f5beed9d700 1 --2- 172.21.15.1:0/2771899593 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bdc05f2c0 0x7f5bdc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:53:51.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.000+0000 7f5bd6ffd700 1 -- 172.21.15.1:0/2771899593 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5be4047af0 con 0x7f5bf01540a0 2023-11-15T02:53:51.050 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:51.049+0000 7f5be47eb680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:53:51.064 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:51.063+0000 7fa49d7cc680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:53:51.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.174+0000 7f5bf5041700 1 -- 172.21.15.1:0/2771899593 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f5bf00c9ce0 con 0x7f5bf01540a0 2023-11-15T02:53:51.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.179+0000 7f5bd6ffd700 1 -- 172.21.15.1:0/2771899593 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v39)=0 v39) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5be404a880 con 0x7f5bf01540a0 2023-11-15T02:53:51.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.181+0000 7f5bf5041700 1 -- 172.21.15.1:0/2771899593 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bdc05f2c0 msgr2=0x7f5bdc061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:53:51.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.181+0000 7f5bf5041700 1 --2- 172.21.15.1:0/2771899593 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bdc05f2c0 0x7f5bdc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:51.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.181+0000 7f5bf5041700 1 -- 172.21.15.1:0/2771899593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bf01540a0 msgr2=0x7f5bf013dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:51.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.181+0000 7f5bf5041700 1 --2- 172.21.15.1:0/2771899593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bf01540a0 0x7f5bf013dc90 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f5be400c410 tx=0x7f5be4007e00).stop 2023-11-15T02:53:51.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.181+0000 7f5bf5041700 1 -- 172.21.15.1:0/2771899593 shutdown_connections 2023-11-15T02:53:51.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.181+0000 7f5bf5041700 1 --2- 172.21.15.1:0/2771899593 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bdc05f2c0 0x7f5bdc061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:51.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.181+0000 7f5bf5041700 1 --2- 172.21.15.1:0/2771899593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5bf0154480 0x7f5bf0164c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:51.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.181+0000 7f5bf5041700 1 --2- 172.21.15.1:0/2771899593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5bf00c6650 0x7f5bf00c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:51.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.181+0000 7f5bf5041700 1 --2- 172.21.15.1:0/2771899593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bf01540a0 0x7f5bf013dc90 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:51.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.181+0000 7f5bf5041700 1 -- 172.21.15.1:0/2771899593 >> 172.21.15.1:0/2771899593 conn(0x7f5bf0064a70 msgr2=0x7f5bf014d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:51.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.181+0000 7f5bf5041700 1 -- 172.21.15.1:0/2771899593 shutdown_connections 2023-11-15T02:53:51.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.181+0000 7f5bf5041700 1 -- 172.21.15.1:0/2771899593 wait complete. 2023-11-15T02:53:51.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:51.195 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-15T02:53:51.215 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-11-15T02:53:51.324 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:51.322+0000 7f5be47eb680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:53:51.358 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:51.357+0000 7fa49d7cc680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:53:51.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.379+0000 7fb045451700 1 Processor -- start 2023-11-15T02:53:51.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.379+0000 7fb045451700 1 -- start start 2023-11-15T02:53:51.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.380+0000 7fb045451700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb040153aa0 0x7fb0400c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:51.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.380+0000 7fb045451700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb0400c1930 0x7fb0400c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:51.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.380+0000 7fb045451700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0400c22d0 con 0x7fb040153e80 2023-11-15T02:53:51.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.380+0000 7fb045451700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0400c6160 con 0x7fb0400c1930 2023-11-15T02:53:51.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.380+0000 7fb045451700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400c5550 con 0x7fb040153aa0 2023-11-15T02:53:51.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.380+0000 7fb03f7fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb0400c1930 0x7fb0400c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:51.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.380+0000 7fb03effd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb040153aa0 0x7fb0400c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:51.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.380+0000 7fb03f7fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb0400c1930 0x7fb0400c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:57908/0 (socket says 172.21.15.1:57908) 2023-11-15T02:53:51.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.380+0000 7fb03f7fe700 1 -- 172.21.15.1:0/932647127 learned_addr learned my addr 172.21.15.1:0/932647127 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:51.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.380+0000 7fb03effd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb040153aa0 0x7fb0400c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:48048/0 (socket says 172.21.15.1:48048) 2023-11-15T02:53:51.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.381+0000 7fb03f7fe700 1 -- 172.21.15.1:0/932647127 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb040153aa0 msgr2=0x7fb0400c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:51.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.381+0000 7fb03f7fe700 1 --2- 172.21.15.1:0/932647127 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb040153aa0 0x7fb0400c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:51.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.381+0000 7fb03f7fe700 1 -- 172.21.15.1:0/932647127 >> v1:172.21.15.141:6789/0 conn(0x7fb040153e80 legacy=0x7fb040069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:51.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.381+0000 7fb03f7fe700 1 -- 172.21.15.1:0/932647127 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0400c5830 con 0x7fb0400c1930 2023-11-15T02:53:51.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.381+0000 7fb03f7fe700 1 --2- 172.21.15.1:0/932647127 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0400c1930 0x7fb0400c1de0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fb03800d1a0 tx=0x7fb03800ba50).ready entity=mon.1 client_cookie=1daf0002a197e9f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:51.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.381+0000 7fb03dffb700 1 -- 172.21.15.1:0/932647127 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038010070 con 0x7fb0400c1930 2023-11-15T02:53:51.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.381+0000 7fb03dffb700 1 -- 172.21.15.1:0/932647127 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03800de10 con 0x7fb0400c1930 2023-11-15T02:53:51.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.381+0000 7fb03dffb700 1 -- 172.21.15.1:0/932647127 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03800b2e0 con 0x7fb0400c1930 2023-11-15T02:53:51.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.382+0000 7fb045451700 1 -- 172.21.15.1:0/932647127 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0400c1930 msgr2=0x7fb0400c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:51.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.382+0000 7fb045451700 1 --2- 172.21.15.1:0/932647127 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0400c1930 0x7fb0400c1de0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fb03800d1a0 tx=0x7fb03800ba50).stop 2023-11-15T02:53:51.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.382+0000 7fb045451700 1 -- 172.21.15.1:0/932647127 shutdown_connections 2023-11-15T02:53:51.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.382+0000 7fb045451700 1 --2- 172.21.15.1:0/932647127 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0400c1930 0x7fb0400c1de0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:51.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.382+0000 7fb045451700 1 --2- 172.21.15.1:0/932647127 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb040153aa0 0x7fb0400c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:51.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.382+0000 7fb045451700 1 -- 172.21.15.1:0/932647127 >> 172.21.15.1:0/932647127 conn(0x7fb040063280 msgr2=0x7fb0400c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:51.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.382+0000 7fb045451700 1 -- 172.21.15.1:0/932647127 shutdown_connections 2023-11-15T02:53:51.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.382+0000 7fb045451700 1 -- 172.21.15.1:0/932647127 wait complete. 2023-11-15T02:53:51.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.383+0000 7fb045451700 1 Processor -- start 2023-11-15T02:53:51.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.383+0000 7fb045451700 1 -- start start 2023-11-15T02:53:51.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb045451700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0400c1930 0x7fb040143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:51.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb045451700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb040153aa0 0x7fb040165800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:51.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb045451700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb040153e80 0x7fb0400a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:51.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb045451700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb040148fe0 con 0x7fb040153e80 2023-11-15T02:53:51.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb045451700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400a5310 con 0x7fb040153aa0 2023-11-15T02:53:51.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb045451700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400a55f0 con 0x7fb0400c1930 2023-11-15T02:53:51.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb03f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb040153e80 0x7fb0400a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:51.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb03f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb040153e80 0x7fb0400a4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46444/0 (socket says 172.21.15.1:46444) 2023-11-15T02:53:51.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb03f7fe700 1 -- 172.21.15.1:0/2390322096 learned_addr learned my addr 172.21.15.1:0/2390322096 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:51.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb03e7fc700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb040153aa0 0x7fb040165800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:51.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb03effd700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0400c1930 0x7fb040143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:51.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb03f7fe700 1 -- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0400c1930 msgr2=0x7fb040143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:51.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb03f7fe700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0400c1930 0x7fb040143930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:51.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb03f7fe700 1 -- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb040153aa0 msgr2=0x7fb040165800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:51.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb03f7fe700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb040153aa0 0x7fb040165800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:51.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb03f7fe700 1 -- 172.21.15.1:0/2390322096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03800bcf0 con 0x7fb040153e80 2023-11-15T02:53:51.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb03e7fc700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb040153aa0 0x7fb040165800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:53:51.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.384+0000 7fb03f7fe700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb040153e80 0x7fb0400a4870 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7fb0400c7c60 tx=0x7fb03800ba50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:51.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.385+0000 7fb026ffd700 1 -- 172.21.15.1:0/2390322096 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03800b600 con 0x7fb040153e80 2023-11-15T02:53:51.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.385+0000 7fb026ffd700 1 -- 172.21.15.1:0/2390322096 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03800ad60 con 0x7fb040153e80 2023-11-15T02:53:51.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.385+0000 7fb045451700 1 -- 172.21.15.1:0/2390322096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb040149240 con 0x7fb040153e80 2023-11-15T02:53:51.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.385+0000 7fb026ffd700 1 -- 172.21.15.1:0/2390322096 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038015630 con 0x7fb040153e80 2023-11-15T02:53:51.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.385+0000 7fb045451700 1 -- 172.21.15.1:0/2390322096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0401479c0 con 0x7fb040153e80 2023-11-15T02:53:51.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.386+0000 7fb045451700 1 -- 172.21.15.1:0/2390322096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb040149740 con 0x7fb040153e80 2023-11-15T02:53:51.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.386+0000 7fb026ffd700 1 -- 172.21.15.1:0/2390322096 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 90) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fb038003040 con 0x7fb040153e80 2023-11-15T02:53:51.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.386+0000 7fb026ffd700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 0x7fb02c061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:51.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.387+0000 7fb03effd700 1 -- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 msgr2=0x7fb02c061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:51.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.387+0000 7fb026ffd700 1 -- 172.21.15.1:0/2390322096 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6645+0+0 (secure 0 0 0) 0x7fb03807bab0 con 0x7fb040153e80 2023-11-15T02:53:51.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.387+0000 7fb03effd700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 0x7fb02c061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:53:51.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.391+0000 7fb026ffd700 1 -- 172.21.15.1:0/2390322096 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb03804c9f0 con 0x7fb040153e80 2023-11-15T02:53:51.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.588+0000 7fb03effd700 1 -- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 msgr2=0x7fb02c061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:51.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.588+0000 7fb03effd700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 0x7fb02c061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:53:51.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.592+0000 7fb045451700 1 -- 172.21.15.1:0/2390322096 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb04006c7e0 con 0x7fb02c05f290 2023-11-15T02:53:51.935 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:51.933+0000 7f5be47eb680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:53:51.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.989+0000 7fb03effd700 1 -- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 msgr2=0x7fb02c061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:51.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:51.989+0000 7fb03effd700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 0x7fb02c061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-15T02:53:52.007 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:52.005+0000 7f5be47eb680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:53:52.030 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:52.030+0000 7fa49d7cc680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:53:52.100 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:52.099+0000 7fa49d7cc680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:53:52.194 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:52.191+0000 7f5be47eb680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:53:52.295 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:52.294+0000 7fa49d7cc680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:53:52.613 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:52.610+0000 7f5be47eb680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:53:52.715 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:52.713+0000 7f5be47eb680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:53:52.736 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:52.735+0000 7fa49d7cc680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:53:52.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:52.790+0000 7fb03effd700 1 -- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 msgr2=0x7fb02c061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:52.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:52.790+0000 7fb03effd700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 0x7fb02c061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-15T02:53:52.846 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:52.845+0000 7fa49d7cc680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:53:52.869 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:52.866+0000 7f5be47eb680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:53:52.943 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:52.941+0000 7f5be47eb680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:53:53.006 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:53.005+0000 7fa49d7cc680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:53:53.011 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:53.009+0000 7f5be47eb680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:53:53.085 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:53.084+0000 7fa49d7cc680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:53:53.155 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:53.154+0000 7fa49d7cc680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:53:53.268 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:53.266+0000 7f5be47eb680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:53:53.432 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:53.431+0000 7fa49d7cc680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:53:53.454 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:53.452+0000 7f5be47eb680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:53:53.624 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:53.623+0000 7fa49d7cc680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:53:54.111 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:54.108+0000 7f5be47eb680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:53:54.179 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:54.177+0000 7f5be47eb680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:53:54.255 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:54.253+0000 7f5be47eb680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:53:54.318 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:54.317+0000 7fa49d7cc680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:53:54.391 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:54.390+0000 7fa49d7cc680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:53:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:54.392+0000 7fb03effd700 1 -- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 msgr2=0x7fb02c061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:53:54.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:54.392+0000 7fb03effd700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 0x7fb02c061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-15T02:53:54.402 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:54.399+0000 7f5be47eb680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:53:54.470 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:54.469+0000 7fa49d7cc680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:53:54.472 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:54.470+0000 7f5be47eb680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:53:54.588 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:54.585+0000 7f5be47eb680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:53:54.625 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:54.624+0000 7fa49d7cc680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:53:54.695 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:54.693+0000 7f5be47eb680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:53:54.699 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:54.698+0000 7fa49d7cc680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:53:54.822 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:54.821+0000 7fa49d7cc680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:53:54.936 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:54.935+0000 7fa49d7cc680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:53:54.988 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:54.986+0000 7f5be47eb680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:53:55.060 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:55.057+0000 7f5be47eb680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:53:55.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:55.080+0000 7fb026ffd700 1 -- 172.21.15.1:0/2390322096 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 91) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fb0380794f0 con 0x7fb040153e80 2023-11-15T02:53:55.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:55.081+0000 7fb026ffd700 1 -- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 msgr2=0x7fb02c061750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:53:55.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:55.081+0000 7fb026ffd700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 0x7fb02c061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:53:55.144 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:55.141+0000 7f5b5876f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:55.144 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:55.141+0000 7f5b5876f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:55.144 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:55.141+0000 7f5b5876f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:55.145 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:55.141+0000 7f5b5876f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:55.145 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:55.141+0000 7f5b5876f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:55.145 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:55.141+0000 7f5b5bf76700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:55.145 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:55.141+0000 7f5b5bf76700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:55.145 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:55.141+0000 7f5b5bf76700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:55.146 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:55.141+0000 7f5b5bf76700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:55.146 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:53:55.141+0000 7f5b5bf76700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:53:55.244 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:55.243+0000 7fa49d7cc680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:53:55.319 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:53:55.318+0000 7fa49d7cc680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:53:56.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.086+0000 7fb026ffd700 1 -- 172.21.15.1:0/2390322096 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 92) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fb038079870 con 0x7fb040153e80 2023-11-15T02:53:56.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.086+0000 7fb026ffd700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 0x7fb02c0616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:56.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.086+0000 7fb026ffd700 1 -- 172.21.15.1:0/2390322096 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb04006c7e0 con 0x7fb02c05f290 2023-11-15T02:53:56.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.087+0000 7fb03effd700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 0x7fb02c0616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:56.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.088+0000 7fb03effd700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 0x7fb02c0616d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fb034009620 tx=0x7fb034009060).ready entity=mgr.7823 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:56.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.109+0000 7fb026ffd700 1 -- 172.21.15.1:0/2390322096 <== mgr.7823 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb04006c7e0 con 0x7fb02c05f290 2023-11-15T02:53:56.110 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path snap_test_dir1 2023-11-15T02:53:56.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.111+0000 7fb045451700 1 -- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 msgr2=0x7fb02c0616d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:56.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.111+0000 7fb045451700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 0x7fb02c0616d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fb034009620 tx=0x7fb034009060).stop 2023-11-15T02:53:56.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.111+0000 7fb045451700 1 -- 172.21.15.1:0/2390322096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb040153e80 msgr2=0x7fb0400a4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:56.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.111+0000 7fb045451700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb040153e80 0x7fb0400a4870 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7fb0400c7c60 tx=0x7fb03800ba50).stop 2023-11-15T02:53:56.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.111+0000 7fb045451700 1 -- 172.21.15.1:0/2390322096 shutdown_connections 2023-11-15T02:53:56.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.111+0000 7fb045451700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb02c05f290 0x7fb02c0616d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.111+0000 7fb045451700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb040153e80 0x7fb0400a4870 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.111+0000 7fb045451700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0400c1930 0x7fb040143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.111+0000 7fb045451700 1 --2- 172.21.15.1:0/2390322096 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb040153aa0 0x7fb040165800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.111+0000 7fb045451700 1 -- 172.21.15.1:0/2390322096 >> 172.21.15.1:0/2390322096 conn(0x7fb040063280 msgr2=0x7fb04014d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.111+0000 7fb045451700 1 -- 172.21.15.1:0/2390322096 shutdown_connections 2023-11-15T02:53:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.111+0000 7fb045451700 1 -- 172.21.15.1:0/2390322096 wait complete. 2023-11-15T02:53:56.126 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-11-15T02:53:56.127 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-11-15T02:53:56.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.256+0000 7ff4a4846700 1 Processor -- start 2023-11-15T02:53:56.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.256+0000 7ff4a4846700 1 -- start start 2023-11-15T02:53:56.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff4a4846700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff4a01541d0 0x7ff4a01545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:56.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff4a4846700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a0155830 con 0x7ff4a00c60d0 2023-11-15T02:53:56.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff4a4846700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a0154c20 con 0x7ff4a00c8170 2023-11-15T02:53:56.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff4a4846700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a0158f40 con 0x7ff4a01541d0 2023-11-15T02:53:56.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49e59c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff4a00c60d0 0x7ff4a00c7a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44674/0 (socket says 172.21.15.1:44674) 2023-11-15T02:53:56.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49e59c700 1 -- 172.21.15.1:0/4200397257 learned_addr learned my addr 172.21.15.1:0/4200397257 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:53:56.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49ed9d700 1 --2- 172.21.15.1:0/4200397257 >> v2:172.21.15.141:3300/0 conn(0x7ff4a01541d0 0x7ff4a01545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:56.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056789940 0 0) 0x7ff4a0155830 con 0x7ff4a00c60d0 2023-11-15T02:53:56.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4880033f0 con 0x7ff4a00c60d0 2023-11-15T02:53:56.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752649439 0 0) 0x7ff4a0154c20 con 0x7ff4a00c8170 2023-11-15T02:53:56.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a0155830 con 0x7ff4a00c8170 2023-11-15T02:53:56.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3272411350 0 0) 0x7ff4880033f0 con 0x7ff4a00c60d0 2023-11-15T02:53:56.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 >> v2:172.21.15.141:3300/0 conn(0x7ff4a01541d0 msgr2=0x7ff4a01545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:56.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 --2- 172.21.15.1:0/4200397257 >> v2:172.21.15.141:3300/0 conn(0x7ff4a01541d0 0x7ff4a01545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 >> v1:172.21.15.141:6789/0 conn(0x7ff4a00c8170 legacy=0x7ff4a00c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:56.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a0154f00 con 0x7ff4a00c60d0 2023-11-15T02:53:56.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7ff494001470 con 0x7ff4a00c60d0 2023-11-15T02:53:56.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 >> v1:172.21.15.1:6789/0 conn(0x7ff4a00c60d0 legacy=0x7ff4a00c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:56.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 --2- 172.21.15.1:0/4200397257 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff488003a70 0x7ff488003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:56.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 --2- 172.21.15.1:0/4200397257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff488004690 0x7ff488004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:56.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 --2- 172.21.15.1:0/4200397257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff488005000 0x7ff48800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:56.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48800be80 con 0x7ff488004690 2023-11-15T02:53:56.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48800bfc0 con 0x7ff488003a70 2023-11-15T02:53:56.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48800c180 con 0x7ff488005000 2023-11-15T02:53:56.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.257+0000 7ff49ed9d700 1 --2- 172.21.15.1:0/4200397257 >> v2:172.21.15.141:3300/0 conn(0x7ff4a01541d0 0x7ff4a01545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:53:56.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.258+0000 7ff49e59c700 1 --2- 172.21.15.1:0/4200397257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff488004690 0x7ff488004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:56.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.258+0000 7ff49f59e700 1 --2- 172.21.15.1:0/4200397257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff488005000 0x7ff48800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:56.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.258+0000 7ff49ed9d700 1 --2- 172.21.15.1:0/4200397257 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff488003a70 0x7ff488003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:56.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.258+0000 7ff49e59c700 1 -- 172.21.15.1:0/4200397257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff488005000 msgr2=0x7ff48800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:56.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.258+0000 7ff49e59c700 1 --2- 172.21.15.1:0/4200397257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff488005000 0x7ff48800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.258+0000 7ff49e59c700 1 -- 172.21.15.1:0/4200397257 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff488003a70 msgr2=0x7ff488003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:56.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.258+0000 7ff49e59c700 1 --2- 172.21.15.1:0/4200397257 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff488003a70 0x7ff488003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.258+0000 7ff49e59c700 1 -- 172.21.15.1:0/4200397257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880033f0 con 0x7ff488004690 2023-11-15T02:53:56.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.258+0000 7ff49f59e700 1 -- 172.21.15.1:0/4200397257 reap_dead start 2023-11-15T02:53:56.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.258+0000 7ff49e59c700 1 --2- 172.21.15.1:0/4200397257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff488004690 0x7ff488004b10 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7ff49400c160 tx=0x7ff494001e10).ready entity=mon.0 client_cookie=5600a8b732880a5c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:56.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.258+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49400c9d0 con 0x7ff488004690 2023-11-15T02:53:56.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.258+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49400cb30 con 0x7ff488004690 2023-11-15T02:53:56.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.258+0000 7ff49dd9b700 1 -- 172.21.15.1:0/4200397257 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4940070d0 con 0x7ff488004690 2023-11-15T02:53:56.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.259+0000 7ff4a4846700 1 -- 172.21.15.1:0/4200397257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff488004690 msgr2=0x7ff488004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:56.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.259+0000 7ff4a4846700 1 --2- 172.21.15.1:0/4200397257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff488004690 0x7ff488004b10 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7ff49400c160 tx=0x7ff494001e10).stop 2023-11-15T02:53:56.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.259+0000 7ff4a4846700 1 -- 172.21.15.1:0/4200397257 shutdown_connections 2023-11-15T02:53:56.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.259+0000 7ff4a4846700 1 --2- 172.21.15.1:0/4200397257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff488004690 0x7ff488004b10 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.259+0000 7ff4a4846700 1 -- 172.21.15.1:0/4200397257 >> 172.21.15.1:0/4200397257 conn(0x7ff4a0069ee0 msgr2=0x7ff4a006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:56.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.259+0000 7ff4a4846700 1 -- 172.21.15.1:0/4200397257 shutdown_connections 2023-11-15T02:53:56.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.259+0000 7ff4a4846700 1 -- 172.21.15.1:0/4200397257 wait complete. 2023-11-15T02:53:56.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.260+0000 7ff4a4846700 1 Processor -- start 2023-11-15T02:53:56.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.260+0000 7ff4a4846700 1 -- start start 2023-11-15T02:53:56.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff4a4846700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff488004690 0x7ff4a0164f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:56.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff4a4846700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4a00b04f0 0x7ff4a014f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:56.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff4a4846700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4a01656a0 0x7ff4a0150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:56.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff4a4846700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a01654c0 con 0x7ff488004690 2023-11-15T02:53:56.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff4a4846700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00aeb30 con 0x7ff4a00b04f0 2023-11-15T02:53:56.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff4a4846700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00ae200 con 0x7ff4a01656a0 2023-11-15T02:53:56.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff49ed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff488004690 0x7ff4a0164f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:56.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff49ed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff488004690 0x7ff4a0164f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46470/0 (socket says 172.21.15.1:46470) 2023-11-15T02:53:56.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff49ed9d700 1 -- 172.21.15.1:0/2981864711 learned_addr learned my addr 172.21.15.1:0/2981864711 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:56.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff49e59c700 1 --2- 172.21.15.1:0/2981864711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4a00b04f0 0x7ff4a014f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:56.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff49f59e700 1 --2- 172.21.15.1:0/2981864711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4a01656a0 0x7ff4a0150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:56.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff49ed9d700 1 -- 172.21.15.1:0/2981864711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4a01656a0 msgr2=0x7ff4a0150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:56.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff49ed9d700 1 --2- 172.21.15.1:0/2981864711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4a01656a0 0x7ff4a0150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff49ed9d700 1 -- 172.21.15.1:0/2981864711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4a00b04f0 msgr2=0x7ff4a014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:56.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff49ed9d700 1 --2- 172.21.15.1:0/2981864711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4a00b04f0 0x7ff4a014f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff49ed9d700 1 -- 172.21.15.1:0/2981864711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a00ae4e0 con 0x7ff488004690 2023-11-15T02:53:56.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.261+0000 7ff49ed9d700 1 --2- 172.21.15.1:0/2981864711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff488004690 0x7ff4a0164f10 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7ff490011a20 tx=0x7ff490009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:56.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.262+0000 7ff486ffd700 1 -- 172.21.15.1:0/2981864711 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490011e60 con 0x7ff488004690 2023-11-15T02:53:56.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.262+0000 7ff486ffd700 1 -- 172.21.15.1:0/2981864711 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49000f940 con 0x7ff488004690 2023-11-15T02:53:56.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.262+0000 7ff4a4846700 1 -- 172.21.15.1:0/2981864711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a00ae7c0 con 0x7ff488004690 2023-11-15T02:53:56.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.262+0000 7ff486ffd700 1 -- 172.21.15.1:0/2981864711 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49000fcc0 con 0x7ff488004690 2023-11-15T02:53:56.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.262+0000 7ff4a4846700 1 -- 172.21.15.1:0/2981864711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a00b1040 con 0x7ff488004690 2023-11-15T02:53:56.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.263+0000 7ff4a4846700 1 -- 172.21.15.1:0/2981864711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a00aee10 con 0x7ff488004690 2023-11-15T02:53:56.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.263+0000 7ff486ffd700 1 -- 172.21.15.1:0/2981864711 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 92) v1 ==== 75357+0+0 (secure 0 0 0) 0x7ff490014650 con 0x7ff488004690 2023-11-15T02:53:56.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.263+0000 7ff486ffd700 1 --2- 172.21.15.1:0/2981864711 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff48c05f080 0x7ff48c061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:56.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.263+0000 7ff486ffd700 1 -- 172.21.15.1:0/2981864711 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6903+0+0 (secure 0 0 0) 0x7ff49007ae20 con 0x7ff488004690 2023-11-15T02:53:56.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.264+0000 7ff49e59c700 1 --2- 172.21.15.1:0/2981864711 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff48c05f080 0x7ff48c061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:56.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.264+0000 7ff49e59c700 1 --2- 172.21.15.1:0/2981864711 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff48c05f080 0x7ff48c061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff4a00c49a0 tx=0x7ff494015000).ready entity=mgr.7823 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:56.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.268+0000 7ff486ffd700 1 -- 172.21.15.1:0/2981864711 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff49004bfb0 con 0x7ff488004690 2023-11-15T02:53:56.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.467+0000 7ff4a4846700 1 -- 172.21.15.1:0/2981864711 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4a00475e0 con 0x7ff48c05f080 2023-11-15T02:53:56.473 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.472+0000 7ff486ffd700 1 -- 172.21.15.1:0/2981864711 <== mgr.7823 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7ff4a00475e0 con 0x7ff48c05f080 2023-11-15T02:53:56.473 INFO:teuthology.orchestra.run.smithi001.stdout:Retention added to path snap_test_dir1 2023-11-15T02:53:56.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.474+0000 7ff4a4846700 1 -- 172.21.15.1:0/2981864711 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff48c05f080 msgr2=0x7ff48c061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:56.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.474+0000 7ff4a4846700 1 --2- 172.21.15.1:0/2981864711 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff48c05f080 0x7ff48c061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff4a00c49a0 tx=0x7ff494015000).stop 2023-11-15T02:53:56.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.474+0000 7ff4a4846700 1 -- 172.21.15.1:0/2981864711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff488004690 msgr2=0x7ff4a0164f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:56.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.474+0000 7ff4a4846700 1 --2- 172.21.15.1:0/2981864711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff488004690 0x7ff4a0164f10 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7ff490011a20 tx=0x7ff490009060).stop 2023-11-15T02:53:56.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.474+0000 7ff4a4846700 1 -- 172.21.15.1:0/2981864711 shutdown_connections 2023-11-15T02:53:56.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.474+0000 7ff4a4846700 1 --2- 172.21.15.1:0/2981864711 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff48c05f080 0x7ff48c061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.474+0000 7ff4a4846700 1 --2- 172.21.15.1:0/2981864711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4a01656a0 0x7ff4a0150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.474+0000 7ff4a4846700 1 --2- 172.21.15.1:0/2981864711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff488004690 0x7ff4a0164f10 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.474+0000 7ff4a4846700 1 --2- 172.21.15.1:0/2981864711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4a00b04f0 0x7ff4a014f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.474+0000 7ff4a4846700 1 -- 172.21.15.1:0/2981864711 >> 172.21.15.1:0/2981864711 conn(0x7ff4a0069ee0 msgr2=0x7ff4a00ab020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:56.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.474+0000 7ff4a4846700 1 -- 172.21.15.1:0/2981864711 shutdown_connections 2023-11-15T02:53:56.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.474+0000 7ff4a4846700 1 -- 172.21.15.1:0/2981864711 wait complete. 2023-11-15T02:53:56.487 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-11-15T02:53:56.488 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-11-15-02_54_00 in ~4s... 2023-11-15T02:53:56.488 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-11-15T02:53:56.489 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-11-15T02:53:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.609+0000 7f615fba6700 1 Processor -- start 2023-11-15T02:53:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.609+0000 7f615fba6700 1 -- start start 2023-11-15T02:53:56.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.610+0000 7f615fba6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6158157660 0x7f6158157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:56.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.610+0000 7f615fba6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f61580c1cb0 0x7f61580c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:56.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.610+0000 7f615fba6700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61580c1820 con 0x7f61580c6770 2023-11-15T02:53:56.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.610+0000 7f615fba6700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61580c7540 con 0x7f61580c1cb0 2023-11-15T02:53:56.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.610+0000 7f615fba6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61580c0c30 con 0x7f6158157660 2023-11-15T02:53:56.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.610+0000 7f615d141700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f61580c1cb0 0x7f61580c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:56.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.610+0000 7f615d141700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f61580c1cb0 0x7f61580c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46478/0 (socket says 172.21.15.1:46478) 2023-11-15T02:53:56.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.610+0000 7f615d141700 1 -- 172.21.15.1:0/732615635 learned_addr learned my addr 172.21.15.1:0/732615635 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:56.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.610+0000 7f615d942700 1 --2- 172.21.15.1:0/732615635 >> v2:172.21.15.141:3300/0 conn(0x7f6158157660 0x7f6158157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:56.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.610+0000 7f615d141700 1 -- 172.21.15.1:0/732615635 >> v2:172.21.15.141:3300/0 conn(0x7f6158157660 msgr2=0x7f6158157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:53:56.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.610+0000 7f615d141700 1 --2- 172.21.15.1:0/732615635 >> v2:172.21.15.141:3300/0 conn(0x7f6158157660 0x7f6158157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.610+0000 7f615d141700 1 -- 172.21.15.1:0/732615635 >> v1:172.21.15.141:6789/0 conn(0x7f61580c6770 legacy=0x7f61580aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:56.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.610+0000 7f615d141700 1 -- 172.21.15.1:0/732615635 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61580c0ef0 con 0x7f61580c1cb0 2023-11-15T02:53:56.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.611+0000 7f615d141700 1 --2- 172.21.15.1:0/732615635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61580c1cb0 0x7f61580c6280 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7f61580cc160 tx=0x7f614c0090f0).ready entity=mon.0 client_cookie=10ab4eb57acbf3b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:56.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.611+0000 7f615c940700 1 -- 172.21.15.1:0/732615635 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c00b520 con 0x7f61580c1cb0 2023-11-15T02:53:56.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.611+0000 7f615c940700 1 -- 172.21.15.1:0/732615635 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c00b680 con 0x7f61580c1cb0 2023-11-15T02:53:56.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.611+0000 7f615c940700 1 -- 172.21.15.1:0/732615635 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c00ba20 con 0x7f61580c1cb0 2023-11-15T02:53:56.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.611+0000 7f615fba6700 1 -- 172.21.15.1:0/732615635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61580c1cb0 msgr2=0x7f61580c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:56.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.611+0000 7f615fba6700 1 --2- 172.21.15.1:0/732615635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61580c1cb0 0x7f61580c6280 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7f61580cc160 tx=0x7f614c0090f0).stop 2023-11-15T02:53:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.611+0000 7f615fba6700 1 -- 172.21.15.1:0/732615635 shutdown_connections 2023-11-15T02:53:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.611+0000 7f615fba6700 1 --2- 172.21.15.1:0/732615635 >> v2:172.21.15.141:3300/0 conn(0x7f6158157660 0x7f6158157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.611+0000 7f615fba6700 1 --2- 172.21.15.1:0/732615635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61580c1cb0 0x7f61580c6280 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.611+0000 7f615fba6700 1 -- 172.21.15.1:0/732615635 >> 172.21.15.1:0/732615635 conn(0x7f6158064aa0 msgr2=0x7f6158064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.611+0000 7f615fba6700 1 -- 172.21.15.1:0/732615635 shutdown_connections 2023-11-15T02:53:56.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.611+0000 7f615fba6700 1 -- 172.21.15.1:0/732615635 wait complete. 2023-11-15T02:53:56.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.613+0000 7f615fba6700 1 Processor -- start 2023-11-15T02:53:56.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.613+0000 7f615fba6700 1 -- start start 2023-11-15T02:53:56.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.613+0000 7f615fba6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61580c1cb0 0x7f61580a9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:56.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.613+0000 7f615fba6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61580c6770 0x7f61580c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:56.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.613+0000 7f615fba6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6158157660 0x7f61580c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:56.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.613+0000 7f615fba6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61581533f0 con 0x7f61580c6770 2023-11-15T02:53:56.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.613+0000 7f615fba6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61580af010 con 0x7f61580c1cb0 2023-11-15T02:53:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.613+0000 7f615fba6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61580ae400 con 0x7f6158157660 2023-11-15T02:53:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.613+0000 7f615d141700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61580c6770 0x7f61580c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.613+0000 7f615d141700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61580c6770 0x7f61580c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46480/0 (socket says 172.21.15.1:46480) 2023-11-15T02:53:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.613+0000 7f615d141700 1 -- 172.21.15.1:0/276694597 learned_addr learned my addr 172.21.15.1:0/276694597 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:53:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.614+0000 7f615d942700 1 --2- 172.21.15.1:0/276694597 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61580c1cb0 0x7f61580a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.614+0000 7f615e143700 1 --2- 172.21.15.1:0/276694597 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6158157660 0x7f61580c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.614+0000 7f615d141700 1 -- 172.21.15.1:0/276694597 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6158157660 msgr2=0x7f61580c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.614+0000 7f615d141700 1 --2- 172.21.15.1:0/276694597 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6158157660 0x7f61580c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.614+0000 7f615d141700 1 -- 172.21.15.1:0/276694597 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61580c1cb0 msgr2=0x7f61580a9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.614+0000 7f615d141700 1 --2- 172.21.15.1:0/276694597 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61580c1cb0 0x7f61580a9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.614+0000 7f615d141700 1 -- 172.21.15.1:0/276694597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c009370 con 0x7f61580c6770 2023-11-15T02:53:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.614+0000 7f615d141700 1 --2- 172.21.15.1:0/276694597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61580c6770 0x7f61580c49d0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7f6158083ed0 tx=0x7f614c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.614+0000 7f6155ffb700 1 -- 172.21.15.1:0/276694597 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c000bc0 con 0x7f61580c6770 2023-11-15T02:53:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.614+0000 7f6155ffb700 1 -- 172.21.15.1:0/276694597 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c00b7f0 con 0x7f61580c6770 2023-11-15T02:53:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.614+0000 7f615fba6700 1 -- 172.21.15.1:0/276694597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61580ae6e0 con 0x7f61580c6770 2023-11-15T02:53:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.614+0000 7f6155ffb700 1 -- 172.21.15.1:0/276694597 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c000d20 con 0x7f61580c6770 2023-11-15T02:53:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.614+0000 7f615fba6700 1 -- 172.21.15.1:0/276694597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61580aeca0 con 0x7f61580c6770 2023-11-15T02:53:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.615+0000 7f615fba6700 1 -- 172.21.15.1:0/276694597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615806c7e0 con 0x7f61580c6770 2023-11-15T02:53:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.616+0000 7f6155ffb700 1 -- 172.21.15.1:0/276694597 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 92) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f614c01c630 con 0x7f61580c6770 2023-11-15T02:53:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.616+0000 7f6155ffb700 1 --2- 172.21.15.1:0/276694597 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f614405f080 0x7f6144061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:53:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.616+0000 7f6155ffb700 1 -- 172.21.15.1:0/276694597 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f614c07bf50 con 0x7f61580c6770 2023-11-15T02:53:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.616+0000 7f615d942700 1 --2- 172.21.15.1:0/276694597 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f614405f080 0x7f6144061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:53:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.617+0000 7f615d942700 1 --2- 172.21.15.1:0/276694597 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f614405f080 0x7f6144061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6150009b20 tx=0x7f6150008040).ready entity=mgr.7823 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:53:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.620+0000 7f6155ffb700 1 -- 172.21.15.1:0/276694597 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f614c0aaaf0 con 0x7f61580c6770 2023-11-15T02:53:56.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.817+0000 7f615fba6700 1 -- 172.21.15.1:0/276694597 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f615805f8b0 con 0x7f614405f080 2023-11-15T02:53:56.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.820+0000 7f6155ffb700 1 -- 172.21.15.1:0/276694597 <== mgr.7823 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f615805f8b0 con 0x7f614405f080 2023-11-15T02:53:56.821 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:53:56.822 INFO:teuthology.orchestra.run.smithi001.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-11-15T02:53:56.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.822+0000 7f615fba6700 1 -- 172.21.15.1:0/276694597 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f614405f080 msgr2=0x7f6144061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:56.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.822+0000 7f615fba6700 1 --2- 172.21.15.1:0/276694597 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f614405f080 0x7f6144061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6150009b20 tx=0x7f6150008040).stop 2023-11-15T02:53:56.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.822+0000 7f615fba6700 1 -- 172.21.15.1:0/276694597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61580c6770 msgr2=0x7f61580c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:53:56.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.822+0000 7f615fba6700 1 --2- 172.21.15.1:0/276694597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61580c6770 0x7f61580c49d0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7f6158083ed0 tx=0x7f614c017000).stop 2023-11-15T02:53:56.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.822+0000 7f615fba6700 1 -- 172.21.15.1:0/276694597 shutdown_connections 2023-11-15T02:53:56.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.822+0000 7f615fba6700 1 --2- 172.21.15.1:0/276694597 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f614405f080 0x7f6144061540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.822+0000 7f615fba6700 1 --2- 172.21.15.1:0/276694597 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6158157660 0x7f61580c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.822+0000 7f615fba6700 1 --2- 172.21.15.1:0/276694597 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61580c1cb0 0x7f61580a9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.822+0000 7f615fba6700 1 --2- 172.21.15.1:0/276694597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61580c6770 0x7f61580c49d0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:53:56.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.822+0000 7f615fba6700 1 -- 172.21.15.1:0/276694597 >> 172.21.15.1:0/276694597 conn(0x7f6158064aa0 msgr2=0x7f6158063c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:53:56.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.822+0000 7f615fba6700 1 -- 172.21.15.1:0/276694597 shutdown_connections 2023-11-15T02:53:56.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:53:56.822+0000 7f615fba6700 1 -- 172.21.15.1:0/276694597 wait complete. 2023-11-15T02:53:56.835 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-11-15T02:53:56.835 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-11-15T02:53:56.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:56.836 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:53:57.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:57.853 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:53:58.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:58.876 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:53:59.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:53:59.899 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:00.477 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:54:00.475+0000 7f5b4af54700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:54:00.477 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:54:00.475+0000 7f5b4af54700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:54:00.477 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:54:00.475+0000 7f5b4af54700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:54:00.478 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:54:00.475+0000 7f5b4af54700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:54:00.478 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:54:00.475+0000 7f5b4af54700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:54:00.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:00.920 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:00.940 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:00.941 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-11-15-02_54_00_UTC'] 2023-11-15T02:54:00.941 DEBUG:tasks.cephfs.test_snap_schedules:exec=1700016836.4882174, now = 1700016840.941475, timo = 4 2023-11-15T02:54:01.942 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-11-15-02_54_00 in ~64s... 2023-11-15T02:54:01.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:01.943 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:01.962 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:02.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:02.964 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:02.985 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:03.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:03.986 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:04.006 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:05.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:05.009 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:05.027 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:05.311 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:54:05.314 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:54:06.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:06.029 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:06.048 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:07.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:07.051 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:07.070 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:08.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:08.073 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:08.093 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:09.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:09.095 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:09.116 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:10.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:10.118 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:10.138 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:11.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:11.141 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:11.160 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:12.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:12.162 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:12.182 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:13.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:13.185 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:13.205 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:14.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:14.207 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:14.226 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:15.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:15.229 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:15.250 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:16.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:16.252 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:16.271 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:17.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:17.273 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:17.294 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:18.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:18.296 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:18.315 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:19.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:19.318 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:19.336 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:20.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:20.338 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:20.358 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:21.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:21.360 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:21.380 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:22.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:22.382 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:22.401 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:23.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:23.403 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:23.423 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:24.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:24.425 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:24.445 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:25.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:25.447 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:25.467 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:26.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:26.468 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:26.488 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:27.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:27.490 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:27.510 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:28.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:28.512 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:28.531 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:29.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:29.533 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:29.553 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:30.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:30.556 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:30.575 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:31.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:31.578 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:31.597 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:32.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:32.599 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:32.618 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:33.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:33.621 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:33.642 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:34.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:34.643 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:34.663 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:35.449 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:54:35.452 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:54:35.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:35.665 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:35.684 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:36.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:36.687 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:36.706 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:37.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:37.708 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:37.728 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:38.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:38.730 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:38.749 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:39.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:39.751 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:39.769 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:40.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:40.772 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:40.792 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:41.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:41.794 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:41.814 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:42.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:42.817 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:42.837 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:43.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:43.838 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:43.858 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:44.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:44.860 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:44.880 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:45.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:45.882 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:45.902 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:46.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:46.904 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:46.923 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:47.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:47.926 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:47.945 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:48.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:48.948 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:48.967 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:49.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:49.970 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:49.992 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:51.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:51.037 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:51.057 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:52.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:52.059 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:52.079 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:53.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:53.081 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:53.100 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:54.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:54.102 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:54.122 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:55.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:55.124 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:55.144 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:56.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:56.145 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:56.165 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:57.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:57.168 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:57.188 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:58.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:58.190 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:58.209 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:54:59.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:54:59.212 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:54:59.232 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:55:00.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:55:00.233 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:55:00.253 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_54_00_UTC 2023-11-15T02:55:01.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:55:01.255 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:55:01.275 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_55_00_UTC 2023-11-15T02:55:01.276 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-11-15-02_54_00_UTC'] 2023-11-15T02:55:01.277 DEBUG:tasks.cephfs.test_snap_schedules:exec=1700016836.4882174, now = 1700016901.2769918, timo = 64 2023-11-15T02:55:02.278 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-11-15T02:55:02.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.413+0000 7f249061e700 1 Processor -- start 2023-11-15T02:55:02.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.413+0000 7f249061e700 1 -- start start 2023-11-15T02:55:02.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.414+0000 7f249061e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2488155790 0x7f24880a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:02.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.414+0000 7f249061e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f24880a6190 0x7f24880c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:02.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.414+0000 7f249061e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f24880833a0 0x7f24880c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:02.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.414+0000 7f249061e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2488066210 con 0x7f24880833a0 2023-11-15T02:55:02.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.414+0000 7f249061e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24880c7ae0 con 0x7f24880a6190 2023-11-15T02:55:02.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.414+0000 7f249061e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24880c49c0 con 0x7f2488155790 2023-11-15T02:55:02.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.414+0000 7f248ebbb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f24880833a0 0x7f24880c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:02.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.415+0000 7f248ebbb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f24880833a0 0x7f24880c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43796/0 (socket says 172.21.15.1:43796) 2023-11-15T02:55:02.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.415+0000 7f248ebbb700 1 -- 172.21.15.1:0/1356832020 learned_addr learned my addr 172.21.15.1:0/1356832020 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:02.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.415+0000 7f248e3ba700 1 --2- 172.21.15.1:0/1356832020 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2488155790 0x7f24880a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:02.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.415+0000 7f248dbb9700 1 --2- 172.21.15.1:0/1356832020 >> v2:172.21.15.141:3300/0 conn(0x7f24880a6190 0x7f24880c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:02.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.415+0000 7f248ebbb700 1 -- 172.21.15.1:0/1356832020 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2488155790 msgr2=0x7f24880a5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:02.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.415+0000 7f248ebbb700 1 --2- 172.21.15.1:0/1356832020 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2488155790 0x7f24880a5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.415+0000 7f248ebbb700 1 -- 172.21.15.1:0/1356832020 >> v2:172.21.15.141:3300/0 conn(0x7f24880a6190 msgr2=0x7f24880c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:02.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.415+0000 7f248ebbb700 1 --2- 172.21.15.1:0/1356832020 >> v2:172.21.15.141:3300/0 conn(0x7f24880a6190 0x7f24880c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.415+0000 7f248ebbb700 1 -- 172.21.15.1:0/1356832020 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24880c77b0 con 0x7f24880833a0 2023-11-15T02:55:02.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.415+0000 7f248dbb9700 1 --2- 172.21.15.1:0/1356832020 >> v2:172.21.15.141:3300/0 conn(0x7f24880a6190 0x7f24880c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:02.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.415+0000 7f248ebbb700 1 --2- 172.21.15.1:0/1356832020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24880833a0 0x7f24880c44d0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7f2488069620 tx=0x7f24780090f0).ready entity=mon.0 client_cookie=274a76947634f007 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:02.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.415+0000 7f248d3b8700 1 -- 172.21.15.1:0/1356832020 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247800b600 con 0x7f24880833a0 2023-11-15T02:55:02.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.415+0000 7f248d3b8700 1 -- 172.21.15.1:0/1356832020 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247800b760 con 0x7f24880833a0 2023-11-15T02:55:02.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.415+0000 7f248d3b8700 1 -- 172.21.15.1:0/1356832020 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247800bae0 con 0x7f24880833a0 2023-11-15T02:55:02.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.416+0000 7f249061e700 1 -- 172.21.15.1:0/1356832020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24880833a0 msgr2=0x7f24880c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:02.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.416+0000 7f249061e700 1 --2- 172.21.15.1:0/1356832020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24880833a0 0x7f24880c44d0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7f2488069620 tx=0x7f24780090f0).stop 2023-11-15T02:55:02.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.416+0000 7f249061e700 1 -- 172.21.15.1:0/1356832020 shutdown_connections 2023-11-15T02:55:02.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.416+0000 7f249061e700 1 --2- 172.21.15.1:0/1356832020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24880833a0 0x7f24880c44d0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.416+0000 7f249061e700 1 --2- 172.21.15.1:0/1356832020 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2488155790 0x7f24880a5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.416+0000 7f249061e700 1 --2- 172.21.15.1:0/1356832020 >> v2:172.21.15.141:3300/0 conn(0x7f24880a6190 0x7f24880c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.416+0000 7f249061e700 1 -- 172.21.15.1:0/1356832020 >> 172.21.15.1:0/1356832020 conn(0x7f2488082f90 msgr2=0x7f24880c8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:02.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.416+0000 7f249061e700 1 -- 172.21.15.1:0/1356832020 shutdown_connections 2023-11-15T02:55:02.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.416+0000 7f249061e700 1 -- 172.21.15.1:0/1356832020 wait complete. 2023-11-15T02:55:02.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.417+0000 7f249061e700 1 Processor -- start 2023-11-15T02:55:02.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.417+0000 7f249061e700 1 -- start start 2023-11-15T02:55:02.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f249061e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24880833a0 0x7f24880638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:02.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f249061e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24880a6190 0x7f248814d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:02.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f249061e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2488155790 0x7f24880ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:02.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f249061e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2488065730 con 0x7f24880a6190 2023-11-15T02:55:02.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f249061e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2488064b20 con 0x7f24880833a0 2023-11-15T02:55:02.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f249061e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2488064e00 con 0x7f2488155790 2023-11-15T02:55:02.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f248dbb9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24880a6190 0x7f248814d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:02.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f248dbb9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24880a6190 0x7f248814d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43802/0 (socket says 172.21.15.1:43802) 2023-11-15T02:55:02.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f248e3ba700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24880833a0 0x7f24880638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:02.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f248dbb9700 1 -- 172.21.15.1:0/1892002782 learned_addr learned my addr 172.21.15.1:0/1892002782 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:02.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f248ebbb700 1 --2- 172.21.15.1:0/1892002782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2488155790 0x7f24880ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:02.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f248dbb9700 1 -- 172.21.15.1:0/1892002782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2488155790 msgr2=0x7f24880ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:02.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f248dbb9700 1 --2- 172.21.15.1:0/1892002782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2488155790 0x7f24880ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f248dbb9700 1 -- 172.21.15.1:0/1892002782 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24880833a0 msgr2=0x7f24880638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:02.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f248dbb9700 1 --2- 172.21.15.1:0/1892002782 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24880833a0 0x7f24880638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f248dbb9700 1 -- 172.21.15.1:0/1892002782 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2478009370 con 0x7f24880a6190 2023-11-15T02:55:02.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.418+0000 7f248dbb9700 1 --2- 172.21.15.1:0/1892002782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24880a6190 0x7f248814d3a0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7f247c00c880 tx=0x7f247c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:02.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.419+0000 7f24867fc700 1 -- 172.21.15.1:0/1892002782 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c015070 con 0x7f24880a6190 2023-11-15T02:55:02.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.419+0000 7f24867fc700 1 -- 172.21.15.1:0/1892002782 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c010580 con 0x7f24880a6190 2023-11-15T02:55:02.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.419+0000 7f249061e700 1 -- 172.21.15.1:0/1892002782 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24880650e0 con 0x7f24880a6190 2023-11-15T02:55:02.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.419+0000 7f24867fc700 1 -- 172.21.15.1:0/1892002782 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c010900 con 0x7f24880a6190 2023-11-15T02:55:02.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.419+0000 7f249061e700 1 -- 172.21.15.1:0/1892002782 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248814dee0 con 0x7f24880a6190 2023-11-15T02:55:02.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.420+0000 7f249061e700 1 -- 172.21.15.1:0/1892002782 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248806c7e0 con 0x7f24880a6190 2023-11-15T02:55:02.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.420+0000 7f24867fc700 1 -- 172.21.15.1:0/1892002782 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 94) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f247c010cf0 con 0x7f24880a6190 2023-11-15T02:55:02.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.420+0000 7f24867fc700 1 --2- 172.21.15.1:0/1892002782 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f247405f3e0 0x7f24740618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:02.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.420+0000 7f24867fc700 1 -- 172.21.15.1:0/1892002782 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f247c07a050 con 0x7f24880a6190 2023-11-15T02:55:02.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.421+0000 7f248e3ba700 1 --2- 172.21.15.1:0/1892002782 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f247405f3e0 0x7f24740618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:02.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.421+0000 7f248e3ba700 1 --2- 172.21.15.1:0/1892002782 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f247405f3e0 0x7f24740618a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f24800075e0 tx=0x7f2480009830).ready entity=mgr.7823 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:02.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.425+0000 7f24867fc700 1 -- 172.21.15.1:0/1892002782 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f247c04ac00 con 0x7f24880a6190 2023-11-15T02:55:02.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.623+0000 7f249061e700 1 -- 172.21.15.1:0/1892002782 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2488065870 con 0x7f247405f3e0 2023-11-15T02:55:02.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.627+0000 7f24867fc700 1 -- 172.21.15.1:0/1892002782 <== mgr.7823 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2488065870 con 0x7f247405f3e0 2023-11-15T02:55:02.629 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path snap_test_dir1 2023-11-15T02:55:02.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.629+0000 7f249061e700 1 -- 172.21.15.1:0/1892002782 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f247405f3e0 msgr2=0x7f24740618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:02.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.629+0000 7f249061e700 1 --2- 172.21.15.1:0/1892002782 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f247405f3e0 0x7f24740618a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f24800075e0 tx=0x7f2480009830).stop 2023-11-15T02:55:02.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.629+0000 7f249061e700 1 -- 172.21.15.1:0/1892002782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24880a6190 msgr2=0x7f248814d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:02.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.629+0000 7f249061e700 1 --2- 172.21.15.1:0/1892002782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24880a6190 0x7f248814d3a0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7f247c00c880 tx=0x7f247c008040).stop 2023-11-15T02:55:02.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.629+0000 7f249061e700 1 -- 172.21.15.1:0/1892002782 shutdown_connections 2023-11-15T02:55:02.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.629+0000 7f249061e700 1 --2- 172.21.15.1:0/1892002782 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f247405f3e0 0x7f24740618a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.629+0000 7f249061e700 1 --2- 172.21.15.1:0/1892002782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2488155790 0x7f24880ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.629+0000 7f249061e700 1 --2- 172.21.15.1:0/1892002782 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24880833a0 0x7f24880638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.629+0000 7f249061e700 1 --2- 172.21.15.1:0/1892002782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24880a6190 0x7f248814d3a0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.629+0000 7f249061e700 1 -- 172.21.15.1:0/1892002782 >> 172.21.15.1:0/1892002782 conn(0x7f2488082f90 msgr2=0x7f24880c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:02.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.629+0000 7f249061e700 1 -- 172.21.15.1:0/1892002782 shutdown_connections 2023-11-15T02:55:02.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.629+0000 7f249061e700 1 -- 172.21.15.1:0/1892002782 wait complete. 2023-11-15T02:55:02.643 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-11-15T02:55:02.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:55:02.644 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:55:02.660 INFO:teuthology.orchestra.run.smithi001.stdout:scheduled-2023-11-15-02_55_00_UTC 2023-11-15T02:55:02.660 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-11-15-02_55_00_UTC 2023-11-15T02:55:02.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:55:02.661 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-11-15-02_55_00_UTC) 2023-11-15T02:55:02.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:55:02.721 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-11-15T02:55:02.779 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-15T02:55:02.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.938+0000 7f0e08a94700 1 Processor -- start 2023-11-15T02:55:02.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.938+0000 7f0e08a94700 1 -- start start 2023-11-15T02:55:02.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.939+0000 7f0e08a94700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e041541d0 0x7f0e041545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:02.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.939+0000 7f0e08a94700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0e040c8170 0x7f0e040c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:02.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.939+0000 7f0e08a94700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e04155830 con 0x7f0e040c60d0 2023-11-15T02:55:02.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.939+0000 7f0e08a94700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e04158f40 con 0x7f0e040c8170 2023-11-15T02:55:02.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.939+0000 7f0e08a94700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e04154c20 con 0x7f0e041541d0 2023-11-15T02:55:02.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.939+0000 7f0e03fff700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0e040c8170 0x7f0e040c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:02.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.939+0000 7f0e037fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e041541d0 0x7f0e041545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:02.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.939+0000 7f0e02ffd700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f0e040c60d0 0x7f0e040c7a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:50906/0 (socket says 172.21.15.1:50906) 2023-11-15T02:55:02.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.939+0000 7f0e02ffd700 1 -- 172.21.15.1:0/2448578252 learned_addr learned my addr 172.21.15.1:0/2448578252 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:02.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.939+0000 7f0e03fff700 1 -- 172.21.15.1:0/2448578252 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e041541d0 msgr2=0x7f0e041545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:02.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.939+0000 7f0e03fff700 1 --2- 172.21.15.1:0/2448578252 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e041541d0 0x7f0e041545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.939+0000 7f0e03fff700 1 -- 172.21.15.1:0/2448578252 >> v1:172.21.15.141:6789/0 conn(0x7f0e040c60d0 legacy=0x7f0e040c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:02.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.939+0000 7f0e03fff700 1 -- 172.21.15.1:0/2448578252 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04154f00 con 0x7f0e040c8170 2023-11-15T02:55:02.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.939+0000 7f0e037fe700 1 --2- 172.21.15.1:0/2448578252 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e041541d0 0x7f0e041545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:02.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.939+0000 7f0e027fc700 1 -- 172.21.15.1:0/2448578252 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329376439 0 0) 0x7f0e04155830 con 0x7f0e040c60d0 2023-11-15T02:55:02.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.940+0000 7f0e03fff700 1 --2- 172.21.15.1:0/2448578252 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e040c8170 0x7f0e040c6550 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f0dfc009e60 tx=0x7f0dfc009780).ready entity=mon.1 client_cookie=1183922563d1c2f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:02.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.940+0000 7f0e027fc700 1 -- 172.21.15.1:0/2448578252 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc00e070 con 0x7f0e040c8170 2023-11-15T02:55:02.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.940+0000 7f0e027fc700 1 -- 172.21.15.1:0/2448578252 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc00bb60 con 0x7f0e040c8170 2023-11-15T02:55:02.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.940+0000 7f0e027fc700 1 -- 172.21.15.1:0/2448578252 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc012410 con 0x7f0e040c8170 2023-11-15T02:55:02.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.940+0000 7f0e08a94700 1 -- 172.21.15.1:0/2448578252 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e040c8170 msgr2=0x7f0e040c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:02.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.940+0000 7f0e08a94700 1 --2- 172.21.15.1:0/2448578252 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e040c8170 0x7f0e040c6550 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f0dfc009e60 tx=0x7f0dfc009780).stop 2023-11-15T02:55:02.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.940+0000 7f0e08a94700 1 -- 172.21.15.1:0/2448578252 shutdown_connections 2023-11-15T02:55:02.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.940+0000 7f0e08a94700 1 --2- 172.21.15.1:0/2448578252 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e040c8170 0x7f0e040c6550 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.940+0000 7f0e08a94700 1 --2- 172.21.15.1:0/2448578252 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e041541d0 0x7f0e041545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.940+0000 7f0e08a94700 1 -- 172.21.15.1:0/2448578252 >> 172.21.15.1:0/2448578252 conn(0x7f0e04069ee0 msgr2=0x7f0e0406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:02.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.940+0000 7f0e08a94700 1 -- 172.21.15.1:0/2448578252 shutdown_connections 2023-11-15T02:55:02.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.940+0000 7f0e08a94700 1 -- 172.21.15.1:0/2448578252 wait complete. 2023-11-15T02:55:02.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.942+0000 7f0e08a94700 1 Processor -- start 2023-11-15T02:55:02.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.942+0000 7f0e08a94700 1 -- start start 2023-11-15T02:55:02.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.942+0000 7f0e08a94700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e040c60d0 0x7f0e040b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:02.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.942+0000 7f0e08a94700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e040c8170 0x7f0e04151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:02.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.942+0000 7f0e08a94700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e041541d0 0x7f0e04151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:02.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.942+0000 7f0e08a94700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e04165520 con 0x7f0e040c60d0 2023-11-15T02:55:02.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.942+0000 7f0e08a94700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e040aeaa0 con 0x7f0e040c8170 2023-11-15T02:55:02.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.942+0000 7f0e08a94700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e04152050 con 0x7f0e041541d0 2023-11-15T02:55:02.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.942+0000 7f0e037fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e040c60d0 0x7f0e040b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:02.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.943+0000 7f0e037fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e040c60d0 0x7f0e040b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43804/0 (socket says 172.21.15.1:43804) 2023-11-15T02:55:02.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.943+0000 7f0e037fe700 1 -- 172.21.15.1:0/1525900357 learned_addr learned my addr 172.21.15.1:0/1525900357 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:02.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.943+0000 7f0e02ffd700 1 --2- 172.21.15.1:0/1525900357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e040c8170 0x7f0e04151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:02.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.943+0000 7f0e03fff700 1 --2- 172.21.15.1:0/1525900357 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e041541d0 0x7f0e04151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:02.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.943+0000 7f0e037fe700 1 -- 172.21.15.1:0/1525900357 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e041541d0 msgr2=0x7f0e04151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:02.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.943+0000 7f0e037fe700 1 --2- 172.21.15.1:0/1525900357 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e041541d0 0x7f0e04151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.943+0000 7f0e037fe700 1 -- 172.21.15.1:0/1525900357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e040c8170 msgr2=0x7f0e04151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:02.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.943+0000 7f0e037fe700 1 --2- 172.21.15.1:0/1525900357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e040c8170 0x7f0e04151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:02.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.943+0000 7f0e037fe700 1 -- 172.21.15.1:0/1525900357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df40092a0 con 0x7f0e040c60d0 2023-11-15T02:55:02.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.943+0000 7f0e037fe700 1 --2- 172.21.15.1:0/1525900357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e040c60d0 0x7f0e040b08e0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f0df400e9b0 tx=0x7f0df4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:02.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.943+0000 7f0dfb7fe700 1 -- 172.21.15.1:0/1525900357 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df400c850 con 0x7f0e040c60d0 2023-11-15T02:55:02.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.943+0000 7f0e08a94700 1 -- 172.21.15.1:0/1525900357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc009a20 con 0x7f0e040c60d0 2023-11-15T02:55:02.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.943+0000 7f0dfb7fe700 1 -- 172.21.15.1:0/1525900357 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df400c9b0 con 0x7f0e040c60d0 2023-11-15T02:55:02.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.943+0000 7f0dfb7fe700 1 -- 172.21.15.1:0/1525900357 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df400cd30 con 0x7f0e040c60d0 2023-11-15T02:55:02.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.943+0000 7f0e08a94700 1 -- 172.21.15.1:0/1525900357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e040ae450 con 0x7f0e040c60d0 2023-11-15T02:55:02.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.944+0000 7f0e08a94700 1 -- 172.21.15.1:0/1525900357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e040475e0 con 0x7f0e040c60d0 2023-11-15T02:55:02.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.945+0000 7f0dfb7fe700 1 -- 172.21.15.1:0/1525900357 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 94) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f0df4012600 con 0x7f0e040c60d0 2023-11-15T02:55:02.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.946+0000 7f0dfb7fe700 1 --2- 172.21.15.1:0/1525900357 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0de405f3e0 0x7f0de40618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:02.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.946+0000 7f0dfb7fe700 1 -- 172.21.15.1:0/1525900357 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f0df407b460 con 0x7f0e040c60d0 2023-11-15T02:55:02.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.946+0000 7f0e02ffd700 1 --2- 172.21.15.1:0/1525900357 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0de405f3e0 0x7f0de40618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:02.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.947+0000 7f0e02ffd700 1 --2- 172.21.15.1:0/1525900357 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0de405f3e0 0x7f0de40618a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0e0414e1f0 tx=0x7f0dec009040).ready entity=mgr.7823 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:02.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:02.949+0000 7f0dfb7fe700 1 -- 172.21.15.1:0/1525900357 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0df404c060 con 0x7f0e040c60d0 2023-11-15T02:55:03.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:03.168+0000 7f0e08a94700 1 -- 172.21.15.1:0/1525900357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f0e041551e0 con 0x7f0e040c60d0 2023-11-15T02:55:03.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:03.900+0000 7f0dfb7fe700 1 -- 172.21.15.1:0/1525900357 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f0df407b0d0 con 0x7f0e040c60d0 2023-11-15T02:55:03.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:03.901+0000 7f0dfb7fe700 1 -- 172.21.15.1:0/1525900357 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v95) v1 ==== 93+0+0 (secure 0 0 0) 0x7f0df4074420 con 0x7f0e040c60d0 2023-11-15T02:55:03.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:03.903+0000 7f0e08a94700 1 -- 172.21.15.1:0/1525900357 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0de405f3e0 msgr2=0x7f0de40618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:03.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:03.903+0000 7f0e08a94700 1 --2- 172.21.15.1:0/1525900357 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0de405f3e0 0x7f0de40618a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0e0414e1f0 tx=0x7f0dec009040).stop 2023-11-15T02:55:03.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:03.904+0000 7f0e08a94700 1 -- 172.21.15.1:0/1525900357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e040c60d0 msgr2=0x7f0e040b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:03.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:03.904+0000 7f0e08a94700 1 --2- 172.21.15.1:0/1525900357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e040c60d0 0x7f0e040b08e0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f0df400e9b0 tx=0x7f0df4009060).stop 2023-11-15T02:55:03.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:03.904+0000 7f0e08a94700 1 -- 172.21.15.1:0/1525900357 shutdown_connections 2023-11-15T02:55:03.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:03.904+0000 7f0e08a94700 1 --2- 172.21.15.1:0/1525900357 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0de405f3e0 0x7f0de40618a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:03.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:03.904+0000 7f0e08a94700 1 --2- 172.21.15.1:0/1525900357 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e041541d0 0x7f0e04151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:03.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:03.904+0000 7f0e08a94700 1 --2- 172.21.15.1:0/1525900357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e040c60d0 0x7f0e040b08e0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:03.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:03.904+0000 7f0e08a94700 1 --2- 172.21.15.1:0/1525900357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e040c8170 0x7f0e04151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:03.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:03.904+0000 7f0e08a94700 1 -- 172.21.15.1:0/1525900357 >> 172.21.15.1:0/1525900357 conn(0x7f0e04069ee0 msgr2=0x7f0e040c1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:03.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:03.904+0000 7f0e08a94700 1 -- 172.21.15.1:0/1525900357 shutdown_connections 2023-11-15T02:55:03.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:03.904+0000 7f0e08a94700 1 -- 172.21.15.1:0/1525900357 wait complete. 2023-11-15T02:55:03.920 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T02:55:03.920 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:55:03.960 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:55:04.003 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T02:55:04.003 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-15T02:55:04.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:55:04.004 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-15T02:55:04.052 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:04.051+0000 7ff71fea9680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:55:04.053 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T02:55:04.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:04.054 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-15T02:55:04.055 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:04.054+0000 7f5c1e149680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:55:04.071 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:55:04.114 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:04.112+0000 7ff71fea9680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:55:04.121 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:04.120+0000 7f5c1e149680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:55:04.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.230+0000 7f119cf60700 1 Processor -- start 2023-11-15T02:55:04.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.230+0000 7f119cf60700 1 -- start start 2023-11-15T02:55:04.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.231+0000 7f119cf60700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1198154680 0x7f1198069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.231+0000 7f119cf60700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11980bccd0 0x7f11980bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.231+0000 7f119cf60700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11980c3360 con 0x7f11980627b0 2023-11-15T02:55:04.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.231+0000 7f119cf60700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11980bd620 con 0x7f1198154680 2023-11-15T02:55:04.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.231+0000 7f119cf60700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11980c2750 con 0x7f11980bccd0 2023-11-15T02:55:04.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.231+0000 7f119659c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1198154680 0x7f1198069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:04.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.232+0000 7f1196d9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f11980627b0 0x7f1198062c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59206/0 (socket says 172.21.15.1:59206) 2023-11-15T02:55:04.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.232+0000 7f1196d9d700 1 -- 172.21.15.1:0/4115386785 learned_addr learned my addr 172.21.15.1:0/4115386785 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:04.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.232+0000 7f1195d9b700 1 --2- 172.21.15.1:0/4115386785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11980bccd0 0x7f11980bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:04.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.232+0000 7f119659c700 1 -- 172.21.15.1:0/4115386785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11980bccd0 msgr2=0x7f11980bd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:04.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.232+0000 7f119659c700 1 --2- 172.21.15.1:0/4115386785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11980bccd0 0x7f11980bd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.232+0000 7f119659c700 1 -- 172.21.15.1:0/4115386785 >> v1:172.21.15.1:6789/0 conn(0x7f11980627b0 legacy=0x7f1198062c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:04.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.232+0000 7f119559a700 1 -- 172.21.15.1:0/4115386785 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736559036 0 0) 0x7f11980c3360 con 0x7f11980627b0 2023-11-15T02:55:04.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.232+0000 7f119659c700 1 -- 172.21.15.1:0/4115386785 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11980c2a30 con 0x7f1198154680 2023-11-15T02:55:04.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.232+0000 7f119659c700 1 --2- 172.21.15.1:0/4115386785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1198154680 0x7f1198069fa0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f1180009760 tx=0x7f1180009060).ready entity=mon.0 client_cookie=b2912e0fe88c44fb server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:04.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.232+0000 7f119559a700 1 -- 172.21.15.1:0/4115386785 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118000f510 con 0x7f1198154680 2023-11-15T02:55:04.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.232+0000 7f119559a700 1 -- 172.21.15.1:0/4115386785 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118000f670 con 0x7f1198154680 2023-11-15T02:55:04.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.232+0000 7f119559a700 1 -- 172.21.15.1:0/4115386785 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118000f9f0 con 0x7f1198154680 2023-11-15T02:55:04.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.233+0000 7f119cf60700 1 -- 172.21.15.1:0/4115386785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1198154680 msgr2=0x7f1198069fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:04.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.233+0000 7f119cf60700 1 --2- 172.21.15.1:0/4115386785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1198154680 0x7f1198069fa0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f1180009760 tx=0x7f1180009060).stop 2023-11-15T02:55:04.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.233+0000 7f119cf60700 1 -- 172.21.15.1:0/4115386785 shutdown_connections 2023-11-15T02:55:04.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.233+0000 7f119cf60700 1 --2- 172.21.15.1:0/4115386785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1198154680 0x7f1198069fa0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.233+0000 7f119cf60700 1 --2- 172.21.15.1:0/4115386785 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11980bccd0 0x7f11980bd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.233+0000 7f119cf60700 1 -- 172.21.15.1:0/4115386785 >> 172.21.15.1:0/4115386785 conn(0x7f11980c7d70 msgr2=0x7f11980c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:04.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.233+0000 7f119cf60700 1 -- 172.21.15.1:0/4115386785 shutdown_connections 2023-11-15T02:55:04.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.233+0000 7f119cf60700 1 -- 172.21.15.1:0/4115386785 wait complete. 2023-11-15T02:55:04.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.234+0000 7f119cf60700 1 Processor -- start 2023-11-15T02:55:04.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.234+0000 7f119cf60700 1 -- start start 2023-11-15T02:55:04.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f119cf60700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11980627b0 0x7f11981598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f119cf60700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11980bccd0 0x7f1198149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f119cf60700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1198154680 0x7f1198069cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f119cf60700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1198159420 con 0x7f1198154680 2023-11-15T02:55:04.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f119cf60700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1198157e50 con 0x7f11980627b0 2023-11-15T02:55:04.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f119cf60700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1198158af0 con 0x7f11980bccd0 2023-11-15T02:55:04.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f1196d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1198154680 0x7f1198069cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:04.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f1196d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1198154680 0x7f1198069cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43834/0 (socket says 172.21.15.1:43834) 2023-11-15T02:55:04.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f1196d9d700 1 -- 172.21.15.1:0/2867943474 learned_addr learned my addr 172.21.15.1:0/2867943474 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:04.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f1195d9b700 1 --2- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11980bccd0 0x7f1198149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:04.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f119659c700 1 --2- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11980627b0 0x7f11981598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:04.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f1196d9d700 1 -- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11980bccd0 msgr2=0x7f1198149860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:04.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f1196d9d700 1 --2- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11980bccd0 0x7f1198149860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f1196d9d700 1 -- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11980627b0 msgr2=0x7f11981598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:04.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f1196d9d700 1 --2- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11980627b0 0x7f11981598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f1196d9d700 1 -- 172.21.15.1:0/2867943474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11800092a0 con 0x7f1198154680 2023-11-15T02:55:04.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f1196d9d700 1 --2- 172.21.15.1:0/2867943474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1198154680 0x7f1198069cc0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f119000c810 tx=0x7f11900014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:04.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.235+0000 7f118e7fc700 1 -- 172.21.15.1:0/2867943474 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190005d30 con 0x7f1198154680 2023-11-15T02:55:04.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.236+0000 7f118e7fc700 1 -- 172.21.15.1:0/2867943474 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1190005e90 con 0x7f1198154680 2023-11-15T02:55:04.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.236+0000 7f119cf60700 1 -- 172.21.15.1:0/2867943474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1198158dd0 con 0x7f1198154680 2023-11-15T02:55:04.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.236+0000 7f118e7fc700 1 -- 172.21.15.1:0/2867943474 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11900072e0 con 0x7f1198154680 2023-11-15T02:55:04.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.236+0000 7f119cf60700 1 -- 172.21.15.1:0/2867943474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1198149d50 con 0x7f1198154680 2023-11-15T02:55:04.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.237+0000 7f119cf60700 1 -- 172.21.15.1:0/2867943474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1198159590 con 0x7f1198154680 2023-11-15T02:55:04.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.237+0000 7f118e7fc700 1 -- 172.21.15.1:0/2867943474 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f1190007710 con 0x7f1198154680 2023-11-15T02:55:04.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.237+0000 7f118e7fc700 1 --2- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f117805f390 0x7f1178061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.238+0000 7f118e7fc700 1 -- 172.21.15.1:0/2867943474 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f119007a1f0 con 0x7f1198154680 2023-11-15T02:55:04.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.238+0000 7f119659c700 1 -- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f117805f390 msgr2=0x7f1178061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:04.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.238+0000 7f119659c700 1 --2- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f117805f390 0x7f1178061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:04.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.242+0000 7f118e7fc700 1 -- 172.21.15.1:0/2867943474 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f119004aeb0 con 0x7f1198154680 2023-11-15T02:55:04.386 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:04.385+0000 7ff71fea9680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:55:04.415 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:04.413+0000 7f5c1e149680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:55:04.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.439+0000 7f119659c700 1 -- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f117805f390 msgr2=0x7f1178061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:04.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.439+0000 7f119659c700 1 --2- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f117805f390 0x7f1178061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:55:04.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.459+0000 7f119cf60700 1 -- 172.21.15.1:0/2867943474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f119806c7e0 con 0x7f1198154680 2023-11-15T02:55:04.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.460+0000 7f118e7fc700 1 -- 172.21.15.1:0/2867943474 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f119004e4d0 con 0x7f1198154680 2023-11-15T02:55:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:04.463 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":87,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8764,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/1669030169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1669030169},{"type":"v1","addr":"172.21.15.141:6837","nonce":1669030169}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9597,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2404592830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2404592830},{"type":"v1","addr":"172.21.15.1:6834","nonce":2404592830}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9600,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3663257097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3663257097},{"type":"v1","addr":"172.21.15.1:6835","nonce":3663257097}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:53:37.978121+0000","modified":"2023-11-15T02:53:40.995474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9609},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9609":{"gid":9609,"name":"d","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6836/1387364974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":1387364974},{"type":"v1","addr":"172.21.15.141:6836","nonce":1387364974}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-11-15T02:55:04.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.462+0000 7f119cf60700 1 -- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f117805f390 msgr2=0x7f1178061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:04.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.462+0000 7f119cf60700 1 --2- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f117805f390 0x7f1178061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:04.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.462+0000 7f119cf60700 1 -- 172.21.15.1:0/2867943474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1198154680 msgr2=0x7f1198069cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:04.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.462+0000 7f119cf60700 1 --2- 172.21.15.1:0/2867943474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1198154680 0x7f1198069cc0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f119000c810 tx=0x7f11900014d0).stop 2023-11-15T02:55:04.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.462+0000 7f119cf60700 1 -- 172.21.15.1:0/2867943474 shutdown_connections 2023-11-15T02:55:04.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.462+0000 7f119cf60700 1 --2- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f117805f390 0x7f1178061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:04.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.462+0000 7f119cf60700 1 --2- 172.21.15.1:0/2867943474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1198154680 0x7f1198069cc0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.462+0000 7f119cf60700 1 --2- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11980627b0 0x7f11981598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.462+0000 7f119cf60700 1 --2- 172.21.15.1:0/2867943474 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11980bccd0 0x7f1198149860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.462+0000 7f119cf60700 1 -- 172.21.15.1:0/2867943474 >> 172.21.15.1:0/2867943474 conn(0x7f11980c7d70 msgr2=0x7f119815a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:04.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.462+0000 7f119cf60700 1 -- 172.21.15.1:0/2867943474 shutdown_connections 2023-11-15T02:55:04.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.462+0000 7f119cf60700 1 -- 172.21.15.1:0/2867943474 wait complete. 2023-11-15T02:55:04.466 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 87 2023-11-15T02:55:04.476 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:55:04.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.633+0000 7f5464d13700 1 Processor -- start 2023-11-15T02:55:04.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.634+0000 7f5464d13700 1 -- start start 2023-11-15T02:55:04.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.634+0000 7f5464d13700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f54600bccd0 0x7f54600bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.634+0000 7f5464d13700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546006a6b0 con 0x7f54600c60b0 2023-11-15T02:55:04.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.634+0000 7f5464d13700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54600c3360 con 0x7f5460154680 2023-11-15T02:55:04.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.634+0000 7f5464d13700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54600bd620 con 0x7f54600bccd0 2023-11-15T02:55:04.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.635+0000 7f545dd9b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f54600bccd0 0x7f54600bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:04.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.635+0000 7f545ed9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f54600c60b0 0x7f54600c6500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59214/0 (socket says 172.21.15.1:59214) 2023-11-15T02:55:04.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.635+0000 7f545ed9d700 1 -- 172.21.15.1:0/1370791914 learned_addr learned my addr 172.21.15.1:0/1370791914 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:04.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.635+0000 7f545dd9b700 1 -- 172.21.15.1:0/1370791914 >> v1:172.21.15.141:6789/0 conn(0x7f5460154680 legacy=0x7f5460069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:04.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.635+0000 7f545dd9b700 1 -- 172.21.15.1:0/1370791914 >> v1:172.21.15.1:6789/0 conn(0x7f54600c60b0 legacy=0x7f54600c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:04.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.635+0000 7f545d59a700 1 -- 172.21.15.1:0/1370791914 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798167775 0 0) 0x7f546006a6b0 con 0x7f54600c60b0 2023-11-15T02:55:04.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.635+0000 7f545dd9b700 1 -- 172.21.15.1:0/1370791914 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54600c2750 con 0x7f54600bccd0 2023-11-15T02:55:04.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.635+0000 7f545dd9b700 1 --2- 172.21.15.1:0/1370791914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600bccd0 0x7f54600bd130 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f5454009760 tx=0x7f5454009060).ready entity=mon.0 client_cookie=9bc895bf2c9eb332 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:04.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.635+0000 7f545d59a700 1 -- 172.21.15.1:0/1370791914 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545400b580 con 0x7f54600bccd0 2023-11-15T02:55:04.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.635+0000 7f545d59a700 1 -- 172.21.15.1:0/1370791914 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545400b6e0 con 0x7f54600bccd0 2023-11-15T02:55:04.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.635+0000 7f545d59a700 1 -- 172.21.15.1:0/1370791914 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545400ba60 con 0x7f54600bccd0 2023-11-15T02:55:04.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.636+0000 7f5464d13700 1 -- 172.21.15.1:0/1370791914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600bccd0 msgr2=0x7f54600bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:04.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.636+0000 7f5464d13700 1 --2- 172.21.15.1:0/1370791914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600bccd0 0x7f54600bd130 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f5454009760 tx=0x7f5454009060).stop 2023-11-15T02:55:04.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.636+0000 7f5464d13700 1 -- 172.21.15.1:0/1370791914 shutdown_connections 2023-11-15T02:55:04.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.636+0000 7f5464d13700 1 --2- 172.21.15.1:0/1370791914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600bccd0 0x7f54600bd130 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.636+0000 7f5464d13700 1 -- 172.21.15.1:0/1370791914 >> 172.21.15.1:0/1370791914 conn(0x7f54600c7d70 msgr2=0x7f54600c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:04.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.636+0000 7f5464d13700 1 -- 172.21.15.1:0/1370791914 shutdown_connections 2023-11-15T02:55:04.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.636+0000 7f5464d13700 1 -- 172.21.15.1:0/1370791914 wait complete. 2023-11-15T02:55:04.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.637+0000 7f5464d13700 1 Processor -- start 2023-11-15T02:55:04.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.637+0000 7f5464d13700 1 -- start start 2023-11-15T02:55:04.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.638+0000 7f5464d13700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600bccd0 0x7f54600a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.638+0000 7f5464d13700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f54600c60b0 0x7f546014c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.638+0000 7f5464d13700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5460154680 0x7f54600aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.638+0000 7f5464d13700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54600ad4d0 con 0x7f54600bccd0 2023-11-15T02:55:04.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.638+0000 7f5464d13700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54600ac910 con 0x7f5460154680 2023-11-15T02:55:04.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.638+0000 7f5464d13700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54600acba0 con 0x7f54600c60b0 2023-11-15T02:55:04.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.638+0000 7f545e59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600bccd0 0x7f54600a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:04.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.638+0000 7f545e59c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600bccd0 0x7f54600a9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43848/0 (socket says 172.21.15.1:43848) 2023-11-15T02:55:04.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.638+0000 7f545e59c700 1 -- 172.21.15.1:0/658599627 learned_addr learned my addr 172.21.15.1:0/658599627 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:04.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.638+0000 7f545dd9b700 1 --2- 172.21.15.1:0/658599627 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f54600c60b0 0x7f546014c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:04.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.638+0000 7f545ed9d700 1 --2- 172.21.15.1:0/658599627 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5460154680 0x7f54600aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:04.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.639+0000 7f545e59c700 1 -- 172.21.15.1:0/658599627 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f54600c60b0 msgr2=0x7f546014c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:04.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.639+0000 7f545e59c700 1 --2- 172.21.15.1:0/658599627 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f54600c60b0 0x7f546014c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.639+0000 7f545e59c700 1 -- 172.21.15.1:0/658599627 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5460154680 msgr2=0x7f54600aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:04.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.639+0000 7f545e59c700 1 --2- 172.21.15.1:0/658599627 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5460154680 0x7f54600aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.639+0000 7f545e59c700 1 -- 172.21.15.1:0/658599627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54540092a0 con 0x7f54600bccd0 2023-11-15T02:55:04.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.639+0000 7f545e59c700 1 --2- 172.21.15.1:0/658599627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600bccd0 0x7f54600a9cb0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f545000c440 tx=0x7f5450007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:04.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.639+0000 7f544e7fc700 1 -- 172.21.15.1:0/658599627 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450007020 con 0x7f54600bccd0 2023-11-15T02:55:04.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.639+0000 7f544e7fc700 1 -- 172.21.15.1:0/658599627 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5450007180 con 0x7f54600bccd0 2023-11-15T02:55:04.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.639+0000 7f5464d13700 1 -- 172.21.15.1:0/658599627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54600ace80 con 0x7f54600bccd0 2023-11-15T02:55:04.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.639+0000 7f544e7fc700 1 -- 172.21.15.1:0/658599627 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450007520 con 0x7f54600bccd0 2023-11-15T02:55:04.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.639+0000 7f5464d13700 1 -- 172.21.15.1:0/658599627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546014d400 con 0x7f54600bccd0 2023-11-15T02:55:04.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.640+0000 7f5464d13700 1 -- 172.21.15.1:0/658599627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54600ad320 con 0x7f54600bccd0 2023-11-15T02:55:04.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.641+0000 7f544e7fc700 1 -- 172.21.15.1:0/658599627 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f54500068b0 con 0x7f54600bccd0 2023-11-15T02:55:04.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.641+0000 7f544e7fc700 1 --2- 172.21.15.1:0/658599627 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f544005f360 0x7f5440061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.641+0000 7f545dd9b700 1 -- 172.21.15.1:0/658599627 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f544005f360 msgr2=0x7f5440061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:04.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.641+0000 7f544e7fc700 1 -- 172.21.15.1:0/658599627 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f5450079b30 con 0x7f54600bccd0 2023-11-15T02:55:04.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.641+0000 7f545dd9b700 1 --2- 172.21.15.1:0/658599627 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f544005f360 0x7f5440061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:04.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.645+0000 7f544e7fc700 1 -- 172.21.15.1:0/658599627 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5450047af0 con 0x7f54600bccd0 2023-11-15T02:55:04.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.821+0000 7f5464d13700 1 -- 172.21.15.1:0/658599627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f546006c7e0 con 0x7f54600bccd0 2023-11-15T02:55:04.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.822+0000 7f544e7fc700 1 -- 172.21.15.1:0/658599627 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+18074 (secure 0 0 0) 0x7f545004a7f0 con 0x7f54600bccd0 2023-11-15T02:55:04.823 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:04.823 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":197,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:53:55.073315+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:53:35.639437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-11-15T02:53:36.965896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/3875176396":"2023-11-16T02:53:55.073280+0000","172.21.15.141:0/349376685":"2023-11-16T02:53:55.073280+0000","172.21.15.141:0/1909336456":"2023-11-16T02:53:55.073280+0000","172.21.15.141:6832/103755":"2023-11-16T02:53:55.073280+0000","172.21.15.141:6833/103755":"2023-11-16T02:53:55.073280+0000","172.21.15.141:0/477213196":"2023-11-16T02:53:55.073280+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:55:04.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.824+0000 7f5464d13700 1 -- 172.21.15.1:0/658599627 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f544005f360 msgr2=0x7f5440061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:04.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.824+0000 7f5464d13700 1 --2- 172.21.15.1:0/658599627 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f544005f360 0x7f5440061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:04.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.824+0000 7f5464d13700 1 -- 172.21.15.1:0/658599627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600bccd0 msgr2=0x7f54600a9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:04.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.824+0000 7f5464d13700 1 --2- 172.21.15.1:0/658599627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600bccd0 0x7f54600a9cb0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f545000c440 tx=0x7f5450007e00).stop 2023-11-15T02:55:04.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.824+0000 7f5464d13700 1 -- 172.21.15.1:0/658599627 shutdown_connections 2023-11-15T02:55:04.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.824+0000 7f5464d13700 1 --2- 172.21.15.1:0/658599627 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f544005f360 0x7f5440061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:04.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.824+0000 7f5464d13700 1 --2- 172.21.15.1:0/658599627 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5460154680 0x7f54600aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.824+0000 7f5464d13700 1 --2- 172.21.15.1:0/658599627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54600bccd0 0x7f54600a9cb0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.824+0000 7f5464d13700 1 --2- 172.21.15.1:0/658599627 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f54600c60b0 0x7f546014c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.824+0000 7f5464d13700 1 -- 172.21.15.1:0/658599627 >> 172.21.15.1:0/658599627 conn(0x7f54600c7d70 msgr2=0x7f546015a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:04.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.824+0000 7f5464d13700 1 -- 172.21.15.1:0/658599627 shutdown_connections 2023-11-15T02:55:04.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.824+0000 7f5464d13700 1 -- 172.21.15.1:0/658599627 wait complete. 2023-11-15T02:55:04.837 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '185', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T02:53:35.639437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T02:53:36.965896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '196', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T02:55:04.838 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T02:55:04.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.965+0000 7f5dde6a7700 1 Processor -- start 2023-11-15T02:55:04.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.965+0000 7f5dde6a7700 1 -- start start 2023-11-15T02:55:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.966+0000 7f5dde6a7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dd81541d0 0x7f5dd81545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.966+0000 7f5dde6a7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5dd80c8170 0x7f5dd80c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.966+0000 7f5dde6a7700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd8155830 con 0x7f5dd80c60d0 2023-11-15T02:55:04.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.966+0000 7f5dde6a7700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd8158f40 con 0x7f5dd80c8170 2023-11-15T02:55:04.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.966+0000 7f5dde6a7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd8154c20 con 0x7f5dd81541d0 2023-11-15T02:55:04.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.966+0000 7f5ddd6a5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dd81541d0 0x7f5dd81545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:04.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.966+0000 7f5dddea6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5dd80c8170 0x7f5dd80c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:04.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.966+0000 7f5ddd6a5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dd81541d0 0x7f5dd81545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:43348/0 (socket says 172.21.15.1:43348) 2023-11-15T02:55:04.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.966+0000 7f5dddea6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5dd80c8170 0x7f5dd80c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:53534/0 (socket says 172.21.15.1:53534) 2023-11-15T02:55:04.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.966+0000 7f5ddd6a5700 1 -- 172.21.15.1:0/785968491 learned_addr learned my addr 172.21.15.1:0/785968491 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:04.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.967+0000 7f5ddd6a5700 1 -- 172.21.15.1:0/785968491 >> v2:172.21.15.141:3300/0 conn(0x7f5dd80c8170 msgr2=0x7f5dd80c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:04.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.967+0000 7f5ddd6a5700 1 --2- 172.21.15.1:0/785968491 >> v2:172.21.15.141:3300/0 conn(0x7f5dd80c8170 0x7f5dd80c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.967+0000 7f5ddd6a5700 1 -- 172.21.15.1:0/785968491 >> v1:172.21.15.141:6789/0 conn(0x7f5dd80c60d0 legacy=0x7f5dd80c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:04.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.967+0000 7f5ddd6a5700 1 -- 172.21.15.1:0/785968491 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd8154f00 con 0x7f5dd81541d0 2023-11-15T02:55:04.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.967+0000 7f5dddea6700 1 --2- 172.21.15.1:0/785968491 >> v2:172.21.15.141:3300/0 conn(0x7f5dd80c8170 0x7f5dd80c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:04.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.967+0000 7f5ddd6a5700 1 --2- 172.21.15.1:0/785968491 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dd81541d0 0x7f5dd81545b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f5dc8006fd0 tx=0x7f5dc80090f0).ready entity=mon.2 client_cookie=b5b14da7c0003220 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:04.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.967+0000 7f5dcffff700 1 -- 172.21.15.1:0/785968491 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc800b580 con 0x7f5dd81541d0 2023-11-15T02:55:04.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.967+0000 7f5dcffff700 1 -- 172.21.15.1:0/785968491 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc800b6e0 con 0x7f5dd81541d0 2023-11-15T02:55:04.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.967+0000 7f5dcffff700 1 -- 172.21.15.1:0/785968491 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc800ba60 con 0x7f5dd81541d0 2023-11-15T02:55:04.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.968+0000 7f5dde6a7700 1 -- 172.21.15.1:0/785968491 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dd81541d0 msgr2=0x7f5dd81545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:04.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.968+0000 7f5dde6a7700 1 --2- 172.21.15.1:0/785968491 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dd81541d0 0x7f5dd81545b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f5dc8006fd0 tx=0x7f5dc80090f0).stop 2023-11-15T02:55:04.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.968+0000 7f5dde6a7700 1 -- 172.21.15.1:0/785968491 shutdown_connections 2023-11-15T02:55:04.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.968+0000 7f5dde6a7700 1 --2- 172.21.15.1:0/785968491 >> v2:172.21.15.141:3300/0 conn(0x7f5dd80c8170 0x7f5dd80c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.968+0000 7f5dde6a7700 1 --2- 172.21.15.1:0/785968491 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dd81541d0 0x7f5dd81545b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.968+0000 7f5dde6a7700 1 -- 172.21.15.1:0/785968491 >> 172.21.15.1:0/785968491 conn(0x7f5dd8069ee0 msgr2=0x7f5dd806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:04.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.968+0000 7f5dde6a7700 1 -- 172.21.15.1:0/785968491 shutdown_connections 2023-11-15T02:55:04.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.968+0000 7f5dde6a7700 1 -- 172.21.15.1:0/785968491 wait complete. 2023-11-15T02:55:04.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.969+0000 7f5dde6a7700 1 Processor -- start 2023-11-15T02:55:04.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.969+0000 7f5dde6a7700 1 -- start start 2023-11-15T02:55:04.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5dde6a7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dd80c60d0 0x7f5dd8152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5dde6a7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dd80c8170 0x7f5dd8165380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5dde6a7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5dd81541d0 0x7f5dd80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5dde6a7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd81583d0 con 0x7f5dd81541d0 2023-11-15T02:55:04.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5dde6a7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd8165870 con 0x7f5dd80c8170 2023-11-15T02:55:04.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5dde6a7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd80ae9d0 con 0x7f5dd80c60d0 2023-11-15T02:55:04.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5dddea6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5dd81541d0 0x7f5dd80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:04.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5dddea6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5dd81541d0 0x7f5dd80b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43858/0 (socket says 172.21.15.1:43858) 2023-11-15T02:55:04.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5dddea6700 1 -- 172.21.15.1:0/2408604246 learned_addr learned my addr 172.21.15.1:0/2408604246 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:04.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5ddcea4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dd80c8170 0x7f5dd8165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:04.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5ddd6a5700 1 --2- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dd80c60d0 0x7f5dd8152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:04.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5dddea6700 1 -- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dd80c60d0 msgr2=0x7f5dd8152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:04.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5dddea6700 1 --2- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dd80c60d0 0x7f5dd8152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5dddea6700 1 -- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dd80c8170 msgr2=0x7f5dd8165380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:04.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5dddea6700 1 --2- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dd80c8170 0x7f5dd8165380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:04.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5dddea6700 1 -- 172.21.15.1:0/2408604246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd0009a20 con 0x7f5dd81541d0 2023-11-15T02:55:04.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.970+0000 7f5ddcea4700 1 --2- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dd80c8170 0x7f5dd8165380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:04.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.971+0000 7f5dddea6700 1 --2- 172.21.15.1:0/2408604246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5dd81541d0 0x7f5dd80b0070 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7f5dd0009f90 tx=0x7f5dd000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:04.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.971+0000 7f5dcd7fa700 1 -- 172.21.15.1:0/2408604246 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000cbd0 con 0x7f5dd81541d0 2023-11-15T02:55:04.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.971+0000 7f5dcd7fa700 1 -- 172.21.15.1:0/2408604246 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd000f040 con 0x7f5dd81541d0 2023-11-15T02:55:04.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.971+0000 7f5dde6a7700 1 -- 172.21.15.1:0/2408604246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc8009370 con 0x7f5dd81541d0 2023-11-15T02:55:04.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.971+0000 7f5dcd7fa700 1 -- 172.21.15.1:0/2408604246 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0013400 con 0x7f5dd81541d0 2023-11-15T02:55:04.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.971+0000 7f5dde6a7700 1 -- 172.21.15.1:0/2408604246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd80aef90 con 0x7f5dd81541d0 2023-11-15T02:55:04.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.972+0000 7f5dde6a7700 1 -- 172.21.15.1:0/2408604246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd80475e0 con 0x7f5dd81541d0 2023-11-15T02:55:04.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.972+0000 7f5dcd7fa700 1 -- 172.21.15.1:0/2408604246 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f5dd0013770 con 0x7f5dd81541d0 2023-11-15T02:55:04.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.973+0000 7f5dcd7fa700 1 --2- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5dbc05f390 0x7f5dbc061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:04.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.973+0000 7f5ddd6a5700 1 -- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5dbc05f390 msgr2=0x7f5dbc061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:04.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.973+0000 7f5dcd7fa700 1 -- 172.21.15.1:0/2408604246 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f5dd007b280 con 0x7f5dd81541d0 2023-11-15T02:55:04.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.973+0000 7f5ddd6a5700 1 --2- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5dbc05f390 0x7f5dbc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:04.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:04.977+0000 7f5dcd7fa700 1 -- 172.21.15.1:0/2408604246 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5dd004be30 con 0x7f5dd81541d0 2023-11-15T02:55:05.007 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:05.006+0000 7ff71fea9680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:55:05.079 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:05.078+0000 7ff71fea9680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:55:05.087 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:05.087+0000 7f5c1e149680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:55:05.158 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:05.157+0000 7f5c1e149680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:55:05.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.174+0000 7f5ddd6a5700 1 -- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5dbc05f390 msgr2=0x7f5dbc061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:05.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.174+0000 7f5ddd6a5700 1 --2- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5dbc05f390 0x7f5dbc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:55:05.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.197+0000 7f5dde6a7700 1 -- 172.21.15.1:0/2408604246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5dd81551e0 con 0x7f5dd81541d0 2023-11-15T02:55:05.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.198+0000 7f5dcd7fa700 1 -- 172.21.15.1:0/2408604246 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v197) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5dd004f450 con 0x7f5dd81541d0 2023-11-15T02:55:05.199 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T02:55:05.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.200+0000 7f5dde6a7700 1 -- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5dbc05f390 msgr2=0x7f5dbc061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:05.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.200+0000 7f5dde6a7700 1 --2- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5dbc05f390 0x7f5dbc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:05.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.200+0000 7f5dde6a7700 1 -- 172.21.15.1:0/2408604246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5dd81541d0 msgr2=0x7f5dd80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:05.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.200+0000 7f5dde6a7700 1 --2- 172.21.15.1:0/2408604246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5dd81541d0 0x7f5dd80b0070 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7f5dd0009f90 tx=0x7f5dd000b040).stop 2023-11-15T02:55:05.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.200+0000 7f5dde6a7700 1 -- 172.21.15.1:0/2408604246 shutdown_connections 2023-11-15T02:55:05.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.200+0000 7f5dde6a7700 1 --2- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5dbc05f390 0x7f5dbc061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:05.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.200+0000 7f5dde6a7700 1 --2- 172.21.15.1:0/2408604246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5dd81541d0 0x7f5dd80b0070 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.200+0000 7f5dde6a7700 1 --2- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dd80c60d0 0x7f5dd8152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.200+0000 7f5dde6a7700 1 --2- 172.21.15.1:0/2408604246 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dd80c8170 0x7f5dd8165380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.200+0000 7f5dde6a7700 1 -- 172.21.15.1:0/2408604246 >> 172.21.15.1:0/2408604246 conn(0x7f5dd8069ee0 msgr2=0x7f5dd8153510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:05.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.200+0000 7f5dde6a7700 1 -- 172.21.15.1:0/2408604246 shutdown_connections 2023-11-15T02:55:05.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.200+0000 7f5dde6a7700 1 -- 172.21.15.1:0/2408604246 wait complete. 2023-11-15T02:55:05.214 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T02:55:05.263 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:05.262+0000 7ff71fea9680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:55:05.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.337+0000 7f41aedd8700 1 Processor -- start 2023-11-15T02:55:05.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.337+0000 7f41aedd8700 1 -- start start 2023-11-15T02:55:05.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.338+0000 7f41aedd8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f41a8062ec0 0x7f41a814eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:05.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.338+0000 7f41aedd8700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a8158e40 con 0x7f41a814e6e0 2023-11-15T02:55:05.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.338+0000 7f41aedd8700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a8158230 con 0x7f41a8155370 2023-11-15T02:55:05.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.338+0000 7f41aedd8700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a8158510 con 0x7f41a8062ec0 2023-11-15T02:55:05.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.338+0000 7f41a7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f41a8062ec0 0x7f41a814eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:05.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.338+0000 7f41a7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f41a8062ec0 0x7f41a814eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43870/0 (socket says 172.21.15.1:43870) 2023-11-15T02:55:05.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.338+0000 7f41a7fff700 1 -- 172.21.15.1:0/2412082831 learned_addr learned my addr 172.21.15.1:0/2412082831 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:05.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.338+0000 7f41acb74700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f41a814e6e0 0x7f41a80627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59222/0 (socket says 172.21.15.1:59222) 2023-11-15T02:55:05.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.339+0000 7f41a7fff700 1 -- 172.21.15.1:0/2412082831 >> v1:172.21.15.141:6789/0 conn(0x7f41a8155370 legacy=0x7f41a80c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:05.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.339+0000 7f41a7fff700 1 -- 172.21.15.1:0/2412082831 >> v1:172.21.15.1:6789/0 conn(0x7f41a814e6e0 legacy=0x7f41a80627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:05.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.339+0000 7f41a77fe700 1 -- 172.21.15.1:0/2412082831 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749033034 0 0) 0x7f41a8158e40 con 0x7f41a814e6e0 2023-11-15T02:55:05.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.339+0000 7f41a7fff700 1 -- 172.21.15.1:0/2412082831 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a81587f0 con 0x7f41a8062ec0 2023-11-15T02:55:05.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.339+0000 7f41a7fff700 1 --2- 172.21.15.1:0/2412082831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41a8062ec0 0x7f41a814eac0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f4194006fd0 tx=0x7f41940090f0).ready entity=mon.0 client_cookie=45c32caf8a4a0763 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:05.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.339+0000 7f41a77fe700 1 -- 172.21.15.1:0/2412082831 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419400b600 con 0x7f41a8062ec0 2023-11-15T02:55:05.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.339+0000 7f41a77fe700 1 -- 172.21.15.1:0/2412082831 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419400b760 con 0x7f41a8062ec0 2023-11-15T02:55:05.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.339+0000 7f41a77fe700 1 -- 172.21.15.1:0/2412082831 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419400bae0 con 0x7f41a8062ec0 2023-11-15T02:55:05.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.340+0000 7f41aedd8700 1 -- 172.21.15.1:0/2412082831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41a8062ec0 msgr2=0x7f41a814eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:05.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.340+0000 7f41aedd8700 1 --2- 172.21.15.1:0/2412082831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41a8062ec0 0x7f41a814eac0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f4194006fd0 tx=0x7f41940090f0).stop 2023-11-15T02:55:05.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.340+0000 7f41aedd8700 1 -- 172.21.15.1:0/2412082831 shutdown_connections 2023-11-15T02:55:05.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.340+0000 7f41aedd8700 1 --2- 172.21.15.1:0/2412082831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41a8062ec0 0x7f41a814eac0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.340+0000 7f41aedd8700 1 -- 172.21.15.1:0/2412082831 >> 172.21.15.1:0/2412082831 conn(0x7f41a80c7dc0 msgr2=0x7f41a80c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.340+0000 7f41aedd8700 1 -- 172.21.15.1:0/2412082831 shutdown_connections 2023-11-15T02:55:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.340+0000 7f41aedd8700 1 -- 172.21.15.1:0/2412082831 wait complete. 2023-11-15T02:55:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.341+0000 7f41aedd8700 1 Processor -- start 2023-11-15T02:55:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.341+0000 7f41aedd8700 1 -- start start 2023-11-15T02:55:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.342+0000 7f41aedd8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41a8062ec0 0x7f41a8138e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.342+0000 7f41aedd8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41a814e6e0 0x7f41a80c0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.342+0000 7f41aedd8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41a8155370 0x7f41a8167b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:05.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.342+0000 7f41aedd8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a8136480 con 0x7f41a814e6e0 2023-11-15T02:55:05.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.342+0000 7f41aedd8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a813bc80 con 0x7f41a8062ec0 2023-11-15T02:55:05.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.342+0000 7f41aedd8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a8139340 con 0x7f41a8155370 2023-11-15T02:55:05.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.342+0000 7f41a7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41a814e6e0 0x7f41a80c0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:05.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.342+0000 7f41a7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41a814e6e0 0x7f41a80c0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43876/0 (socket says 172.21.15.1:43876) 2023-11-15T02:55:05.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.342+0000 7f41a7fff700 1 -- 172.21.15.1:0/2887899618 learned_addr learned my addr 172.21.15.1:0/2887899618 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:05.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.342+0000 7f41acb74700 1 --2- 172.21.15.1:0/2887899618 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41a8062ec0 0x7f41a8138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:05.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.342+0000 7f41ad375700 1 --2- 172.21.15.1:0/2887899618 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41a8155370 0x7f41a8167b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:05.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.343+0000 7f41a7fff700 1 -- 172.21.15.1:0/2887899618 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41a8155370 msgr2=0x7f41a8167b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.343+0000 7f41a7fff700 1 --2- 172.21.15.1:0/2887899618 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41a8155370 0x7f41a8167b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.343+0000 7f41a7fff700 1 -- 172.21.15.1:0/2887899618 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41a8062ec0 msgr2=0x7f41a8138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.343+0000 7f41a7fff700 1 --2- 172.21.15.1:0/2887899618 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41a8062ec0 0x7f41a8138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.343+0000 7f41a7fff700 1 -- 172.21.15.1:0/2887899618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4194009370 con 0x7f41a814e6e0 2023-11-15T02:55:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.343+0000 7f41a7fff700 1 --2- 172.21.15.1:0/2887899618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41a814e6e0 0x7f41a80c0c10 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f4194009130 tx=0x7f4194017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.343+0000 7f41a4ff9700 1 -- 172.21.15.1:0/2887899618 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419400b8d0 con 0x7f41a814e6e0 2023-11-15T02:55:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.343+0000 7f41a4ff9700 1 -- 172.21.15.1:0/2887899618 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419400ba30 con 0x7f41a814e6e0 2023-11-15T02:55:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.343+0000 7f41a4ff9700 1 -- 172.21.15.1:0/2887899618 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419401c670 con 0x7f41a814e6e0 2023-11-15T02:55:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.343+0000 7f41aedd8700 1 -- 172.21.15.1:0/2887899618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a813b070 con 0x7f41a814e6e0 2023-11-15T02:55:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.343+0000 7f41aedd8700 1 -- 172.21.15.1:0/2887899618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a813b630 con 0x7f41a814e6e0 2023-11-15T02:55:05.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.344+0000 7f41aedd8700 1 -- 172.21.15.1:0/2887899618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a813be10 con 0x7f41a814e6e0 2023-11-15T02:55:05.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.344+0000 7f41a4ff9700 1 -- 172.21.15.1:0/2887899618 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f419401c9e0 con 0x7f41a814e6e0 2023-11-15T02:55:05.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.345+0000 7f41a4ff9700 1 --2- 172.21.15.1:0/2887899618 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f418c05f390 0x7f418c061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:05.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.345+0000 7f41a4ff9700 1 -- 172.21.15.1:0/2887899618 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f419407bfb0 con 0x7f41a814e6e0 2023-11-15T02:55:05.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.345+0000 7f41acb74700 1 -- 172.21.15.1:0/2887899618 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f418c05f390 msgr2=0x7f418c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:05.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.345+0000 7f41acb74700 1 --2- 172.21.15.1:0/2887899618 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f418c05f390 0x7f418c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:05.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.353+0000 7f41a4ff9700 1 -- 172.21.15.1:0/2887899618 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f41940aaaf0 con 0x7f41a814e6e0 2023-11-15T02:55:05.362 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:05.361+0000 7f5c1e149680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:55:05.519 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:55:05.522 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:55:05.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.527+0000 7f41aedd8700 1 -- 172.21.15.1:0/2887899618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f41a806c7e0 con 0x7f41a814e6e0 2023-11-15T02:55:05.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.527+0000 7f41a4ff9700 1 -- 172.21.15.1:0/2887899618 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v197) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4194020070 con 0x7f41a814e6e0 2023-11-15T02:55:05.528 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T02:55:05.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.529+0000 7f41aedd8700 1 -- 172.21.15.1:0/2887899618 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f418c05f390 msgr2=0x7f418c061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:05.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.529+0000 7f41aedd8700 1 --2- 172.21.15.1:0/2887899618 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f418c05f390 0x7f418c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:05.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.529+0000 7f41aedd8700 1 -- 172.21.15.1:0/2887899618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41a814e6e0 msgr2=0x7f41a80c0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:05.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.529+0000 7f41aedd8700 1 --2- 172.21.15.1:0/2887899618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41a814e6e0 0x7f41a80c0c10 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f4194009130 tx=0x7f4194017000).stop 2023-11-15T02:55:05.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.529+0000 7f41aedd8700 1 -- 172.21.15.1:0/2887899618 shutdown_connections 2023-11-15T02:55:05.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.529+0000 7f41aedd8700 1 --2- 172.21.15.1:0/2887899618 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f418c05f390 0x7f418c061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:05.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.529+0000 7f41aedd8700 1 --2- 172.21.15.1:0/2887899618 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41a8155370 0x7f41a8167b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.529+0000 7f41aedd8700 1 --2- 172.21.15.1:0/2887899618 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41a8062ec0 0x7f41a8138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.529+0000 7f41aedd8700 1 --2- 172.21.15.1:0/2887899618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41a814e6e0 0x7f41a80c0c10 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.529+0000 7f41aedd8700 1 -- 172.21.15.1:0/2887899618 >> 172.21.15.1:0/2887899618 conn(0x7f41a80c7dc0 msgr2=0x7f41a80bddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:05.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.529+0000 7f41aedd8700 1 -- 172.21.15.1:0/2887899618 shutdown_connections 2023-11-15T02:55:05.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.529+0000 7f41aedd8700 1 -- 172.21.15.1:0/2887899618 wait complete. 2023-11-15T02:55:05.544 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T02:55:05.688 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:05.687+0000 7ff71fea9680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:55:05.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.743+0000 7fb4e5378700 1 Processor -- start 2023-11-15T02:55:05.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.743+0000 7fb4e5378700 1 -- start start 2023-11-15T02:55:05.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.743+0000 7fb4e5378700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4e01540a0 0x7fb4e00ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:05.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.743+0000 7fb4e5378700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb4e0154480 0x7fb4e00ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:05.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.743+0000 7fb4e5378700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e00ca050 con 0x7fb4e00c5f40 2023-11-15T02:55:05.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.743+0000 7fb4e5378700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e00c9440 con 0x7fb4e0154480 2023-11-15T02:55:05.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.743+0000 7fb4e5378700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e00c9720 con 0x7fb4e01540a0 2023-11-15T02:55:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.744+0000 7fb4de7fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb4e0154480 0x7fb4e00ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.744+0000 7fb4df7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb4e00c5f40 0x7fb4e00aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59228/0 (socket says 172.21.15.1:59228) 2023-11-15T02:55:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.744+0000 7fb4df7fe700 1 -- 172.21.15.1:0/2079701600 learned_addr learned my addr 172.21.15.1:0/2079701600 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.744+0000 7fb4deffd700 1 --2- 172.21.15.1:0/2079701600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4e01540a0 0x7fb4e00ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.744+0000 7fb4de7fc700 1 -- 172.21.15.1:0/2079701600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4e01540a0 msgr2=0x7fb4e00ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:05.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.744+0000 7fb4de7fc700 1 --2- 172.21.15.1:0/2079701600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4e01540a0 0x7fb4e00ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.744+0000 7fb4de7fc700 1 -- 172.21.15.1:0/2079701600 >> v1:172.21.15.1:6789/0 conn(0x7fb4e00c5f40 legacy=0x7fb4e00aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:05.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.744+0000 7fb4ddffb700 1 -- 172.21.15.1:0/2079701600 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256997641 0 0) 0x7fb4e00ca050 con 0x7fb4e00c5f40 2023-11-15T02:55:05.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.744+0000 7fb4de7fc700 1 -- 172.21.15.1:0/2079701600 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e00c9a00 con 0x7fb4e0154480 2023-11-15T02:55:05.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.744+0000 7fb4de7fc700 1 --2- 172.21.15.1:0/2079701600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e0154480 0x7fb4e00ca9d0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7fb4d0009760 tx=0x7fb4d0009060).ready entity=mon.0 client_cookie=8eacc4862683bea0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:05.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.744+0000 7fb4ddffb700 1 -- 172.21.15.1:0/2079701600 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d000f510 con 0x7fb4e0154480 2023-11-15T02:55:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.744+0000 7fb4ddffb700 1 -- 172.21.15.1:0/2079701600 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d000f670 con 0x7fb4e0154480 2023-11-15T02:55:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.744+0000 7fb4ddffb700 1 -- 172.21.15.1:0/2079701600 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d000f9f0 con 0x7fb4e0154480 2023-11-15T02:55:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.745+0000 7fb4e5378700 1 -- 172.21.15.1:0/2079701600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e0154480 msgr2=0x7fb4e00ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.745+0000 7fb4e5378700 1 --2- 172.21.15.1:0/2079701600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e0154480 0x7fb4e00ca9d0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7fb4d0009760 tx=0x7fb4d0009060).stop 2023-11-15T02:55:05.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.745+0000 7fb4e5378700 1 -- 172.21.15.1:0/2079701600 shutdown_connections 2023-11-15T02:55:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.745+0000 7fb4e5378700 1 --2- 172.21.15.1:0/2079701600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4e01540a0 0x7fb4e00ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.745+0000 7fb4e5378700 1 --2- 172.21.15.1:0/2079701600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e0154480 0x7fb4e00ca9d0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.745+0000 7fb4e5378700 1 -- 172.21.15.1:0/2079701600 >> 172.21.15.1:0/2079701600 conn(0x7fb4e0064a70 msgr2=0x7fb4e0064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.745+0000 7fb4e5378700 1 -- 172.21.15.1:0/2079701600 shutdown_connections 2023-11-15T02:55:05.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.745+0000 7fb4e5378700 1 -- 172.21.15.1:0/2079701600 wait complete. 2023-11-15T02:55:05.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.746+0000 7fb4e5378700 1 Processor -- start 2023-11-15T02:55:05.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.746+0000 7fb4e5378700 1 -- start start 2023-11-15T02:55:05.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.747+0000 7fb4e5378700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4e00c5f40 0x7fb4e0157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:05.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.747+0000 7fb4e5378700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e01540a0 0x7fb4e01533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:05.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.747+0000 7fb4e5378700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4e0154480 0x7fb4e0156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:05.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.747+0000 7fb4e5378700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e0158570 con 0x7fb4e01540a0 2023-11-15T02:55:05.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.747+0000 7fb4e5378700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e0159530 con 0x7fb4e0154480 2023-11-15T02:55:05.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.747+0000 7fb4e5378700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e01569c0 con 0x7fb4e00c5f40 2023-11-15T02:55:05.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.747+0000 7fb4de7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e01540a0 0x7fb4e01533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:05.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.747+0000 7fb4de7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e01540a0 0x7fb4e01533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43906/0 (socket says 172.21.15.1:43906) 2023-11-15T02:55:05.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.747+0000 7fb4de7fc700 1 -- 172.21.15.1:0/2680679920 learned_addr learned my addr 172.21.15.1:0/2680679920 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:05.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.747+0000 7fb4deffd700 1 --2- 172.21.15.1:0/2680679920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4e00c5f40 0x7fb4e0157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:05.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.747+0000 7fb4df7fe700 1 --2- 172.21.15.1:0/2680679920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4e0154480 0x7fb4e0156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:05.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.748+0000 7fb4de7fc700 1 -- 172.21.15.1:0/2680679920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4e00c5f40 msgr2=0x7fb4e0157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:05.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.748+0000 7fb4de7fc700 1 --2- 172.21.15.1:0/2680679920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4e00c5f40 0x7fb4e0157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.748+0000 7fb4de7fc700 1 -- 172.21.15.1:0/2680679920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4e0154480 msgr2=0x7fb4e0156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:05.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.748+0000 7fb4de7fc700 1 --2- 172.21.15.1:0/2680679920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4e0154480 0x7fb4e0156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.748+0000 7fb4de7fc700 1 -- 172.21.15.1:0/2680679920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d00092a0 con 0x7fb4e01540a0 2023-11-15T02:55:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.748+0000 7fb4de7fc700 1 --2- 172.21.15.1:0/2680679920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e01540a0 0x7fb4e01533a0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7fb4e00c2070 tx=0x7fb4d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.748+0000 7fb4d6ffd700 1 -- 172.21.15.1:0/2680679920 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d001a4d0 con 0x7fb4e01540a0 2023-11-15T02:55:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.748+0000 7fb4d6ffd700 1 -- 172.21.15.1:0/2680679920 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d001e070 con 0x7fb4e01540a0 2023-11-15T02:55:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.748+0000 7fb4e5378700 1 -- 172.21.15.1:0/2680679920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e0156090 con 0x7fb4e01540a0 2023-11-15T02:55:05.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.748+0000 7fb4d6ffd700 1 -- 172.21.15.1:0/2680679920 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d001a8a0 con 0x7fb4e01540a0 2023-11-15T02:55:05.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.748+0000 7fb4e5378700 1 -- 172.21.15.1:0/2680679920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e0156650 con 0x7fb4e01540a0 2023-11-15T02:55:05.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.749+0000 7fb4d6ffd700 1 -- 172.21.15.1:0/2680679920 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fb4d0020030 con 0x7fb4e01540a0 2023-11-15T02:55:05.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.749+0000 7fb4e5378700 1 -- 172.21.15.1:0/2680679920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e0156b70 con 0x7fb4e01540a0 2023-11-15T02:55:05.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.750+0000 7fb4d6ffd700 1 --2- 172.21.15.1:0/2680679920 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb4c005f390 0x7fb4c0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:05.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.750+0000 7fb4d6ffd700 1 -- 172.21.15.1:0/2680679920 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6903+0+0 (secure 0 0 0) 0x7fb4d007b720 con 0x7fb4e01540a0 2023-11-15T02:55:05.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.750+0000 7fb4deffd700 1 -- 172.21.15.1:0/2680679920 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb4c005f390 msgr2=0x7fb4c0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:05.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.750+0000 7fb4deffd700 1 --2- 172.21.15.1:0/2680679920 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb4c005f390 0x7fb4c0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:05.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.754+0000 7fb4d6ffd700 1 -- 172.21.15.1:0/2680679920 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb4e0156b70 con 0x7fb4e01540a0 2023-11-15T02:55:05.792 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:05.791+0000 7ff71fea9680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:55:05.811 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:05.810+0000 7f5c1e149680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:55:05.921 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:05.919+0000 7f5c1e149680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:55:05.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.926+0000 7fb4e5378700 1 -- 172.21.15.1:0/2680679920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4e0156b30 con 0x7fb4e01540a0 2023-11-15T02:55:05.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.927+0000 7fb4d6ffd700 1 -- 172.21.15.1:0/2680679920 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v197) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4d004c490 con 0x7fb4e01540a0 2023-11-15T02:55:05.928 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T02:55:05.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.929+0000 7fb4e5378700 1 -- 172.21.15.1:0/2680679920 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb4c005f390 msgr2=0x7fb4c0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:05.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.929+0000 7fb4e5378700 1 --2- 172.21.15.1:0/2680679920 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb4c005f390 0x7fb4c0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:05.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.929+0000 7fb4e5378700 1 -- 172.21.15.1:0/2680679920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e01540a0 msgr2=0x7fb4e01533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:05.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.929+0000 7fb4e5378700 1 --2- 172.21.15.1:0/2680679920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e01540a0 0x7fb4e01533a0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7fb4e00c2070 tx=0x7fb4d0017000).stop 2023-11-15T02:55:05.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.929+0000 7fb4e5378700 1 -- 172.21.15.1:0/2680679920 shutdown_connections 2023-11-15T02:55:05.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.929+0000 7fb4e5378700 1 --2- 172.21.15.1:0/2680679920 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb4c005f390 0x7fb4c0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:05.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.929+0000 7fb4e5378700 1 --2- 172.21.15.1:0/2680679920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4e0154480 0x7fb4e0156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.929+0000 7fb4e5378700 1 --2- 172.21.15.1:0/2680679920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4e00c5f40 0x7fb4e0157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.929+0000 7fb4e5378700 1 --2- 172.21.15.1:0/2680679920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e01540a0 0x7fb4e01533a0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:05.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.929+0000 7fb4e5378700 1 -- 172.21.15.1:0/2680679920 >> 172.21.15.1:0/2680679920 conn(0x7fb4e0064a70 msgr2=0x7fb4e00ab6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:05.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.929+0000 7fb4e5378700 1 -- 172.21.15.1:0/2680679920 shutdown_connections 2023-11-15T02:55:05.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:05.929+0000 7fb4e5378700 1 -- 172.21.15.1:0/2680679920 wait complete. 2023-11-15T02:55:05.943 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T02:55:05.945 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:05.944+0000 7ff71fea9680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:55:06.021 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:06.020+0000 7ff71fea9680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:55:06.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.071+0000 7fbd993fe700 1 Processor -- start 2023-11-15T02:55:06.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.071+0000 7fbd993fe700 1 -- start start 2023-11-15T02:55:06.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.072+0000 7fbd993fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd941545b0 0x7fbd940c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.072+0000 7fbd993fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbd940c7f50 0x7fbd940c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.072+0000 7fbd993fe700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd94155830 con 0x7fbd941541d0 2023-11-15T02:55:06.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.072+0000 7fbd993fe700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd94158f40 con 0x7fbd940c7f50 2023-11-15T02:55:06.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.072+0000 7fbd993fe700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd94154a30 con 0x7fbd941545b0 2023-11-15T02:55:06.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.072+0000 7fbd93fff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fbd941541d0 0x7fbd940c60d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59244/0 (socket says 172.21.15.1:59244) 2023-11-15T02:55:06.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.072+0000 7fbd93fff700 1 -- 172.21.15.1:0/607823106 learned_addr learned my addr 172.21.15.1:0/607823106 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:06.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.072+0000 7fbd98bfd700 1 --2- 172.21.15.1:0/607823106 >> v2:172.21.15.141:3300/0 conn(0x7fbd940c7f50 0x7fbd940c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.072+0000 7fbd937fe700 1 --2- 172.21.15.1:0/607823106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd941545b0 0x7fbd940c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.072+0000 7fbd92ffd700 1 -- 172.21.15.1:0/607823106 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421964867 0 0) 0x7fbd94155830 con 0x7fbd941541d0 2023-11-15T02:55:06.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.073+0000 7fbd92ffd700 1 -- 172.21.15.1:0/607823106 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd7c0033f0 con 0x7fbd941541d0 2023-11-15T02:55:06.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.073+0000 7fbd98bfd700 1 -- 172.21.15.1:0/607823106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd941545b0 msgr2=0x7fbd940c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:06.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.073+0000 7fbd98bfd700 1 --2- 172.21.15.1:0/607823106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd941545b0 0x7fbd940c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.073+0000 7fbd98bfd700 1 -- 172.21.15.1:0/607823106 >> v1:172.21.15.1:6789/0 conn(0x7fbd941541d0 legacy=0x7fbd940c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:06.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.073+0000 7fbd98bfd700 1 -- 172.21.15.1:0/607823106 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd940c83a0 con 0x7fbd940c7f50 2023-11-15T02:55:06.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.073+0000 7fbd98bfd700 1 --2- 172.21.15.1:0/607823106 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd940c7f50 0x7fbd940c9620 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fbd8c009e60 tx=0x7fbd8c009780).ready entity=mon.1 client_cookie=74b01ab5589458e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:06.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.073+0000 7fbd92ffd700 1 -- 172.21.15.1:0/607823106 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c00e070 con 0x7fbd940c7f50 2023-11-15T02:55:06.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.073+0000 7fbd92ffd700 1 -- 172.21.15.1:0/607823106 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8c00bab0 con 0x7fbd940c7f50 2023-11-15T02:55:06.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.073+0000 7fbd92ffd700 1 -- 172.21.15.1:0/607823106 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c00be30 con 0x7fbd940c7f50 2023-11-15T02:55:06.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.074+0000 7fbd993fe700 1 -- 172.21.15.1:0/607823106 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd940c7f50 msgr2=0x7fbd940c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:06.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.074+0000 7fbd993fe700 1 --2- 172.21.15.1:0/607823106 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd940c7f50 0x7fbd940c9620 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fbd8c009e60 tx=0x7fbd8c009780).stop 2023-11-15T02:55:06.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.074+0000 7fbd993fe700 1 -- 172.21.15.1:0/607823106 shutdown_connections 2023-11-15T02:55:06.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.074+0000 7fbd993fe700 1 --2- 172.21.15.1:0/607823106 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd940c7f50 0x7fbd940c9620 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.074+0000 7fbd993fe700 1 --2- 172.21.15.1:0/607823106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd941545b0 0x7fbd940c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.074+0000 7fbd993fe700 1 -- 172.21.15.1:0/607823106 >> 172.21.15.1:0/607823106 conn(0x7fbd94069ee0 msgr2=0x7fbd9406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:06.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.074+0000 7fbd993fe700 1 -- 172.21.15.1:0/607823106 shutdown_connections 2023-11-15T02:55:06.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.074+0000 7fbd993fe700 1 -- 172.21.15.1:0/607823106 wait complete. 2023-11-15T02:55:06.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.075+0000 7fbd993fe700 1 Processor -- start 2023-11-15T02:55:06.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.075+0000 7fbd993fe700 1 -- start start 2023-11-15T02:55:06.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd993fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940c7f50 0x7fbd940ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd993fe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd941541d0 0x7fbd94147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd993fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd941545b0 0x7fbd940c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd993fe700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd940ab910 con 0x7fbd940c7f50 2023-11-15T02:55:06.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd993fe700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd941512c0 con 0x7fbd941541d0 2023-11-15T02:55:06.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd993fe700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd940abbd0 con 0x7fbd941545b0 2023-11-15T02:55:06.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd93fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940c7f50 0x7fbd940ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd93fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940c7f50 0x7fbd940ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43908/0 (socket says 172.21.15.1:43908) 2023-11-15T02:55:06.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd93fff700 1 -- 172.21.15.1:0/2819826215 learned_addr learned my addr 172.21.15.1:0/2819826215 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:06.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd937fe700 1 --2- 172.21.15.1:0/2819826215 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd941541d0 0x7fbd94147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd98bfd700 1 --2- 172.21.15.1:0/2819826215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd941545b0 0x7fbd940c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd93fff700 1 -- 172.21.15.1:0/2819826215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd941545b0 msgr2=0x7fbd940c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:06.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd93fff700 1 --2- 172.21.15.1:0/2819826215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd941545b0 0x7fbd940c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd93fff700 1 -- 172.21.15.1:0/2819826215 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd941541d0 msgr2=0x7fbd94147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:06.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd93fff700 1 --2- 172.21.15.1:0/2819826215 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd941541d0 0x7fbd94147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd93fff700 1 -- 172.21.15.1:0/2819826215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c009a20 con 0x7fbd940c7f50 2023-11-15T02:55:06.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.076+0000 7fbd93fff700 1 --2- 172.21.15.1:0/2819826215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940c7f50 0x7fbd940ae0b0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7fbd8800c590 tx=0x7fbd88007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:06.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.077+0000 7fbd7bfff700 1 -- 172.21.15.1:0/2819826215 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd880072e0 con 0x7fbd940c7f50 2023-11-15T02:55:06.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.077+0000 7fbd7bfff700 1 -- 172.21.15.1:0/2819826215 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd88007440 con 0x7fbd940c7f50 2023-11-15T02:55:06.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.077+0000 7fbd7bfff700 1 -- 172.21.15.1:0/2819826215 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd880057a0 con 0x7fbd940c7f50 2023-11-15T02:55:06.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.077+0000 7fbd993fe700 1 -- 172.21.15.1:0/2819826215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd940abeb0 con 0x7fbd940c7f50 2023-11-15T02:55:06.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.077+0000 7fbd993fe700 1 -- 172.21.15.1:0/2819826215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd940ae5a0 con 0x7fbd940c7f50 2023-11-15T02:55:06.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.078+0000 7fbd7bfff700 1 -- 172.21.15.1:0/2819826215 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fbd88005bd0 con 0x7fbd940c7f50 2023-11-15T02:55:06.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.078+0000 7fbd993fe700 1 -- 172.21.15.1:0/2819826215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd940c1200 con 0x7fbd940c7f50 2023-11-15T02:55:06.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.078+0000 7fbd7bfff700 1 --2- 172.21.15.1:0/2819826215 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbd8005f390 0x7fbd80061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.078+0000 7fbd937fe700 1 -- 172.21.15.1:0/2819826215 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbd8005f390 msgr2=0x7fbd80061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:06.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.078+0000 7fbd7bfff700 1 -- 172.21.15.1:0/2819826215 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6903+0+0 (secure 0 0 0) 0x7fbd88079ff0 con 0x7fbd940c7f50 2023-11-15T02:55:06.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.078+0000 7fbd937fe700 1 --2- 172.21.15.1:0/2819826215 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbd8005f390 0x7fbd80061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:06.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.083+0000 7fbd7bfff700 1 -- 172.21.15.1:0/2819826215 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbd8804acb0 con 0x7fbd940c7f50 2023-11-15T02:55:06.104 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:06.087+0000 7ff71fea9680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:55:06.104 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:06.087+0000 7f5c1e149680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:55:06.168 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:06.167+0000 7f5c1e149680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:55:06.238 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:06.237+0000 7f5c1e149680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:55:06.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.256+0000 7fbd993fe700 1 -- 172.21.15.1:0/2819826215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd940475e0 con 0x7fbd940c7f50 2023-11-15T02:55:06.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.257+0000 7fbd7bfff700 1 -- 172.21.15.1:0/2819826215 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v197) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd8804e2d0 con 0x7fbd940c7f50 2023-11-15T02:55:06.258 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T02:55:06.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.259+0000 7fbd993fe700 1 -- 172.21.15.1:0/2819826215 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbd8005f390 msgr2=0x7fbd80061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:06.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.259+0000 7fbd993fe700 1 --2- 172.21.15.1:0/2819826215 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbd8005f390 0x7fbd80061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:06.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.259+0000 7fbd993fe700 1 -- 172.21.15.1:0/2819826215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940c7f50 msgr2=0x7fbd940ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:06.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.259+0000 7fbd993fe700 1 --2- 172.21.15.1:0/2819826215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940c7f50 0x7fbd940ae0b0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7fbd8800c590 tx=0x7fbd88007c80).stop 2023-11-15T02:55:06.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.259+0000 7fbd993fe700 1 -- 172.21.15.1:0/2819826215 shutdown_connections 2023-11-15T02:55:06.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.259+0000 7fbd993fe700 1 --2- 172.21.15.1:0/2819826215 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbd8005f390 0x7fbd80061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:06.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.259+0000 7fbd993fe700 1 --2- 172.21.15.1:0/2819826215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd941545b0 0x7fbd940c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.259+0000 7fbd993fe700 1 --2- 172.21.15.1:0/2819826215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd940c7f50 0x7fbd940ae0b0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.259+0000 7fbd993fe700 1 --2- 172.21.15.1:0/2819826215 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd941541d0 0x7fbd94147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.259+0000 7fbd993fe700 1 -- 172.21.15.1:0/2819826215 >> 172.21.15.1:0/2819826215 conn(0x7fbd94069ee0 msgr2=0x7fbd9414fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:06.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.259+0000 7fbd993fe700 1 -- 172.21.15.1:0/2819826215 shutdown_connections 2023-11-15T02:55:06.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.259+0000 7fbd993fe700 1 -- 172.21.15.1:0/2819826215 wait complete. 2023-11-15T02:55:06.272 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:55:06.346 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:06.345+0000 7ff71fea9680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:55:06.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.391+0000 7f7e05b0c700 1 Processor -- start 2023-11-15T02:55:06.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.391+0000 7f7e05b0c700 1 -- start start 2023-11-15T02:55:06.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.392+0000 7f7e05b0c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7e000c45d0 0x7f7e00158b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.392+0000 7f7e05b0c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7e001546e0 0x7f7e000bc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.392+0000 7f7e05b0c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e00069640 con 0x7f7e00154300 2023-11-15T02:55:06.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.392+0000 7f7e05b0c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0006a1e0 con 0x7f7e001546e0 2023-11-15T02:55:06.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.392+0000 7f7e05b0c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0006bac0 con 0x7f7e000c45d0 2023-11-15T02:55:06.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.392+0000 7f7e0530b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7e001546e0 0x7f7e000bc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.392+0000 7f7e04b0a700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7e00154300 0x7f7e00069ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59252/0 (socket says 172.21.15.1:59252) 2023-11-15T02:55:06.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.392+0000 7f7e04b0a700 1 -- 172.21.15.1:0/3829774485 learned_addr learned my addr 172.21.15.1:0/3829774485 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:06.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.392+0000 7f7dfffff700 1 --2- 172.21.15.1:0/3829774485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7e000c45d0 0x7f7e00158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.392+0000 7f7e0530b700 1 -- 172.21.15.1:0/3829774485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7e000c45d0 msgr2=0x7f7e00158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:06.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.392+0000 7f7e0530b700 1 --2- 172.21.15.1:0/3829774485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7e000c45d0 0x7f7e00158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.393+0000 7f7e0530b700 1 -- 172.21.15.1:0/3829774485 >> v1:172.21.15.1:6789/0 conn(0x7f7e00154300 legacy=0x7f7e00069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:06.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.393+0000 7f7e0530b700 1 -- 172.21.15.1:0/3829774485 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e00068d10 con 0x7f7e001546e0 2023-11-15T02:55:06.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.393+0000 7f7dff7fe700 1 -- 172.21.15.1:0/3829774485 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691881841 0 0) 0x7f7e00069640 con 0x7f7e00154300 2023-11-15T02:55:06.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.393+0000 7f7dfffff700 1 --2- 172.21.15.1:0/3829774485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7e000c45d0 0x7f7e00158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:06.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.393+0000 7f7e0530b700 1 --2- 172.21.15.1:0/3829774485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e001546e0 0x7f7e000bc2f0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7f7df8009e90 tx=0x7f7df8009780).ready entity=mon.0 client_cookie=1d43b3871a709b57 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:06.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.393+0000 7f7dff7fe700 1 -- 172.21.15.1:0/3829774485 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df800e070 con 0x7f7e001546e0 2023-11-15T02:55:06.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.393+0000 7f7dff7fe700 1 -- 172.21.15.1:0/3829774485 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df800bbf0 con 0x7f7e001546e0 2023-11-15T02:55:06.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.393+0000 7f7dff7fe700 1 -- 172.21.15.1:0/3829774485 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8012410 con 0x7f7e001546e0 2023-11-15T02:55:06.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.393+0000 7f7e05b0c700 1 -- 172.21.15.1:0/3829774485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e001546e0 msgr2=0x7f7e000bc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:06.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.393+0000 7f7e05b0c700 1 --2- 172.21.15.1:0/3829774485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e001546e0 0x7f7e000bc2f0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7f7df8009e90 tx=0x7f7df8009780).stop 2023-11-15T02:55:06.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.393+0000 7f7e05b0c700 1 -- 172.21.15.1:0/3829774485 shutdown_connections 2023-11-15T02:55:06.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.393+0000 7f7e05b0c700 1 --2- 172.21.15.1:0/3829774485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e001546e0 0x7f7e000bc2f0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.393+0000 7f7e05b0c700 1 --2- 172.21.15.1:0/3829774485 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7e000c45d0 0x7f7e00158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.393+0000 7f7e05b0c700 1 -- 172.21.15.1:0/3829774485 >> 172.21.15.1:0/3829774485 conn(0x7f7e000c7e00 msgr2=0x7f7e000c3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:06.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.394+0000 7f7e05b0c700 1 -- 172.21.15.1:0/3829774485 shutdown_connections 2023-11-15T02:55:06.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.394+0000 7f7e05b0c700 1 -- 172.21.15.1:0/3829774485 wait complete. 2023-11-15T02:55:06.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.395+0000 7f7e05b0c700 1 Processor -- start 2023-11-15T02:55:06.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.395+0000 7f7e05b0c700 1 -- start start 2023-11-15T02:55:06.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.395+0000 7f7e05b0c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e000c45d0 0x7f7e000c0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.395+0000 7f7e05b0c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7e00154300 0x7f7e000c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.395+0000 7f7e05b0c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7e001546e0 0x7f7e000be980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7e05b0c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000be780 con 0x7f7e000c45d0 2023-11-15T02:55:06.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7e05b0c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000c0920 con 0x7f7e001546e0 2023-11-15T02:55:06.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7e05b0c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000bf520 con 0x7f7e00154300 2023-11-15T02:55:06.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7e04b0a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e000c45d0 0x7f7e000c0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7e04b0a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e000c45d0 0x7f7e000c0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43938/0 (socket says 172.21.15.1:43938) 2023-11-15T02:55:06.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7e04b0a700 1 -- 172.21.15.1:0/782564711 learned_addr learned my addr 172.21.15.1:0/782564711 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:06.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7e0530b700 1 --2- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7e001546e0 0x7f7e000be980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7dfffff700 1 --2- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7e00154300 0x7f7e000c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7e04b0a700 1 -- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7e00154300 msgr2=0x7f7e000c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:06.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7e04b0a700 1 --2- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7e00154300 0x7f7e000c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7e04b0a700 1 -- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7e001546e0 msgr2=0x7f7e000be980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:06.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7e04b0a700 1 --2- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7e001546e0 0x7f7e000be980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7e04b0a700 1 -- 172.21.15.1:0/782564711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df8009a20 con 0x7f7e000c45d0 2023-11-15T02:55:06.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7e04b0a700 1 --2- 172.21.15.1:0/782564711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e000c45d0 0x7f7e000c0db0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7f7df400c4e0 tx=0x7f7df4007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:06.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7dfcff9700 1 -- 172.21.15.1:0/782564711 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df400ce90 con 0x7f7e000c45d0 2023-11-15T02:55:06.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7dfcff9700 1 -- 172.21.15.1:0/782564711 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df40072e0 con 0x7f7e000c45d0 2023-11-15T02:55:06.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7e05b0c700 1 -- 172.21.15.1:0/782564711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e000bf800 con 0x7f7e000c45d0 2023-11-15T02:55:06.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7dfcff9700 1 -- 172.21.15.1:0/782564711 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df4007660 con 0x7f7e000c45d0 2023-11-15T02:55:06.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.396+0000 7f7e05b0c700 1 -- 172.21.15.1:0/782564711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e000c12a0 con 0x7f7e000c45d0 2023-11-15T02:55:06.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.397+0000 7f7e05b0c700 1 -- 172.21.15.1:0/782564711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e000c03e0 con 0x7f7e000c45d0 2023-11-15T02:55:06.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.398+0000 7f7dfcff9700 1 -- 172.21.15.1:0/782564711 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f7df40059b0 con 0x7f7e000c45d0 2023-11-15T02:55:06.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.398+0000 7f7dfcff9700 1 --2- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7de405f390 0x7f7de4061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.398+0000 7f7dfffff700 1 -- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7de405f390 msgr2=0x7f7de4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:06.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.398+0000 7f7dfcff9700 1 -- 172.21.15.1:0/782564711 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f7df4079f90 con 0x7f7e000c45d0 2023-11-15T02:55:06.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.398+0000 7f7dfffff700 1 --2- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7de405f390 0x7f7de4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:06.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.403+0000 7f7dfcff9700 1 -- 172.21.15.1:0/782564711 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7df404ac50 con 0x7f7e000c45d0 2023-11-15T02:55:06.518 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:06.517+0000 7f5c1e149680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:55:06.528 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:06.527+0000 7ff71fea9680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:55:06.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.599+0000 7f7dfffff700 1 -- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7de405f390 msgr2=0x7f7de4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:06.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.599+0000 7f7dfffff700 1 --2- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7de405f390 0x7f7de4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:55:06.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.618+0000 7f7e05b0c700 1 -- 172.21.15.1:0/782564711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e000c8210 con 0x7f7e000c45d0 2023-11-15T02:55:06.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.618+0000 7f7dfcff9700 1 -- 172.21.15.1:0/782564711 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f7df404e270 con 0x7f7e000c45d0 2023-11-15T02:55:06.620 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:06.620 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":87,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8764,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/1669030169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1669030169},{"type":"v1","addr":"172.21.15.141:6837","nonce":1669030169}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9597,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2404592830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2404592830},{"type":"v1","addr":"172.21.15.1:6834","nonce":2404592830}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9600,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3663257097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3663257097},{"type":"v1","addr":"172.21.15.1:6835","nonce":3663257097}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:53:37.978121+0000","modified":"2023-11-15T02:53:40.995474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9609},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9609":{"gid":9609,"name":"d","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6836/1387364974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":1387364974},{"type":"v1","addr":"172.21.15.141:6836","nonce":1387364974}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-11-15T02:55:06.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.620+0000 7f7e05b0c700 1 -- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7de405f390 msgr2=0x7f7de4061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:06.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.620+0000 7f7e05b0c700 1 --2- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7de405f390 0x7f7de4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:06.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.620+0000 7f7e05b0c700 1 -- 172.21.15.1:0/782564711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e000c45d0 msgr2=0x7f7e000c0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:06.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.620+0000 7f7e05b0c700 1 --2- 172.21.15.1:0/782564711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e000c45d0 0x7f7e000c0db0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7f7df400c4e0 tx=0x7f7df4007c70).stop 2023-11-15T02:55:06.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.620+0000 7f7e05b0c700 1 -- 172.21.15.1:0/782564711 shutdown_connections 2023-11-15T02:55:06.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.620+0000 7f7e05b0c700 1 --2- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7de405f390 0x7f7de4061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:06.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.620+0000 7f7e05b0c700 1 --2- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7e001546e0 0x7f7e000be980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.620+0000 7f7e05b0c700 1 --2- 172.21.15.1:0/782564711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e000c45d0 0x7f7e000c0db0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.620+0000 7f7e05b0c700 1 --2- 172.21.15.1:0/782564711 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7e00154300 0x7f7e000c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.620+0000 7f7e05b0c700 1 -- 172.21.15.1:0/782564711 >> 172.21.15.1:0/782564711 conn(0x7f7e000c7e00 msgr2=0x7f7e000ac830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:06.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.621+0000 7f7e05b0c700 1 -- 172.21.15.1:0/782564711 shutdown_connections 2023-11-15T02:55:06.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.621+0000 7f7e05b0c700 1 -- 172.21.15.1:0/782564711 wait complete. 2023-11-15T02:55:06.626 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 87 2023-11-15T02:55:06.635 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:55:06.712 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:06.711+0000 7f5c1e149680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:55:06.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.755+0000 7f7869f40700 1 Processor -- start 2023-11-15T02:55:06.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.756+0000 7f7869f40700 1 -- start start 2023-11-15T02:55:06.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.756+0000 7f7869f40700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f78640c2a70 0x7f78641518f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.756+0000 7f7869f40700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78640c2e50 0x7f78640c1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.756+0000 7f7869f40700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7864155910 0x7f7864065650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.756+0000 7f7869f40700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78640695a0 con 0x7f78640c2a70 2023-11-15T02:55:06.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.756+0000 7f7869f40700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7864069710 con 0x7f7864155910 2023-11-15T02:55:06.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.756+0000 7f7869f40700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78640bce80 con 0x7f78640c2e50 2023-11-15T02:55:06.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.757+0000 7f78637fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f78640c2a70 0x7f78641518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.757+0000 7f78637fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f78640c2a70 0x7f78641518f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43946/0 (socket says 172.21.15.1:43946) 2023-11-15T02:55:06.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.757+0000 7f78637fe700 1 -- 172.21.15.1:0/4279870067 learned_addr learned my addr 172.21.15.1:0/4279870067 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:06.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.757+0000 7f7862ffd700 1 --2- 172.21.15.1:0/4279870067 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78640c2e50 0x7f78640c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.757+0000 7f7863fff700 1 --2- 172.21.15.1:0/4279870067 >> v2:172.21.15.141:3300/0 conn(0x7f7864155910 0x7f7864065650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.757+0000 7f78637fe700 1 -- 172.21.15.1:0/4279870067 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78640c2e50 msgr2=0x7f78640c1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:06.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.757+0000 7f78637fe700 1 --2- 172.21.15.1:0/4279870067 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78640c2e50 0x7f78640c1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.757+0000 7f78637fe700 1 -- 172.21.15.1:0/4279870067 >> v2:172.21.15.141:3300/0 conn(0x7f7864155910 msgr2=0x7f7864065650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:06.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.757+0000 7f78637fe700 1 --2- 172.21.15.1:0/4279870067 >> v2:172.21.15.141:3300/0 conn(0x7f7864155910 0x7f7864065650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.757+0000 7f78637fe700 1 -- 172.21.15.1:0/4279870067 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7864155da0 con 0x7f78640c2a70 2023-11-15T02:55:06.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.757+0000 7f78637fe700 1 --2- 172.21.15.1:0/4279870067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78640c2a70 0x7f78641518f0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f78640c11b0 tx=0x7f7854009060).ready entity=mon.0 client_cookie=182b22538f090114 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:06.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.757+0000 7f78627fc700 1 -- 172.21.15.1:0/4279870067 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854005880 con 0x7f78640c2a70 2023-11-15T02:55:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.757+0000 7f78627fc700 1 -- 172.21.15.1:0/4279870067 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78540059e0 con 0x7f78640c2a70 2023-11-15T02:55:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.757+0000 7f78627fc700 1 -- 172.21.15.1:0/4279870067 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854005d60 con 0x7f78640c2a70 2023-11-15T02:55:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.758+0000 7f7869f40700 1 -- 172.21.15.1:0/4279870067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78640c2a70 msgr2=0x7f78641518f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.758+0000 7f7869f40700 1 --2- 172.21.15.1:0/4279870067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78640c2a70 0x7f78641518f0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f78640c11b0 tx=0x7f7854009060).stop 2023-11-15T02:55:06.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.758+0000 7f7869f40700 1 -- 172.21.15.1:0/4279870067 shutdown_connections 2023-11-15T02:55:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.758+0000 7f7869f40700 1 --2- 172.21.15.1:0/4279870067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78640c2a70 0x7f78641518f0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.758+0000 7f7869f40700 1 --2- 172.21.15.1:0/4279870067 >> v2:172.21.15.141:3300/0 conn(0x7f7864155910 0x7f7864065650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.758+0000 7f7869f40700 1 --2- 172.21.15.1:0/4279870067 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78640c2e50 0x7f78640c1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.758+0000 7f7869f40700 1 -- 172.21.15.1:0/4279870067 >> 172.21.15.1:0/4279870067 conn(0x7f78640627b0 msgr2=0x7f7864062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:06.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.758+0000 7f7869f40700 1 -- 172.21.15.1:0/4279870067 shutdown_connections 2023-11-15T02:55:06.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.758+0000 7f7869f40700 1 -- 172.21.15.1:0/4279870067 wait complete. 2023-11-15T02:55:06.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.759+0000 7f7869f40700 1 Processor -- start 2023-11-15T02:55:06.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.759+0000 7f7869f40700 1 -- start start 2023-11-15T02:55:06.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f7869f40700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78640c2a70 0x7f786414d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f7869f40700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78640c2e50 0x7f78641504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f7869f40700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7864155910 0x7f78641367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f7869f40700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786414dd20 con 0x7f78640c2e50 2023-11-15T02:55:06.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f7869f40700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786414e000 con 0x7f78640c2a70 2023-11-15T02:55:06.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f7869f40700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786414e2e0 con 0x7f7864155910 2023-11-15T02:55:06.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f7862ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78640c2e50 0x7f78641504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f7862ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78640c2e50 0x7f78641504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43962/0 (socket says 172.21.15.1:43962) 2023-11-15T02:55:06.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f7862ffd700 1 -- 172.21.15.1:0/1945603351 learned_addr learned my addr 172.21.15.1:0/1945603351 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:06.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f78637fe700 1 --2- 172.21.15.1:0/1945603351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78640c2a70 0x7f786414d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f7863fff700 1 --2- 172.21.15.1:0/1945603351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7864155910 0x7f78641367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:06.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f7862ffd700 1 -- 172.21.15.1:0/1945603351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7864155910 msgr2=0x7f78641367c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:06.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f7862ffd700 1 --2- 172.21.15.1:0/1945603351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7864155910 0x7f78641367c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f7862ffd700 1 -- 172.21.15.1:0/1945603351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78640c2a70 msgr2=0x7f786414d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:06.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f7862ffd700 1 --2- 172.21.15.1:0/1945603351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78640c2a70 0x7f786414d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f7862ffd700 1 -- 172.21.15.1:0/1945603351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7854009300 con 0x7f78640c2e50 2023-11-15T02:55:06.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.760+0000 7f78637fe700 1 --2- 172.21.15.1:0/1945603351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78640c2a70 0x7f786414d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:06.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.761+0000 7f7862ffd700 1 --2- 172.21.15.1:0/1945603351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78640c2e50 0x7f78641504f0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7f785800e930 tx=0x7f7858009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:06.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.761+0000 7f784b7fe700 1 -- 172.21.15.1:0/1945603351 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858012600 con 0x7f78640c2e50 2023-11-15T02:55:06.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.761+0000 7f784b7fe700 1 -- 172.21.15.1:0/1945603351 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7858012760 con 0x7f78640c2e50 2023-11-15T02:55:06.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.761+0000 7f7869f40700 1 -- 172.21.15.1:0/1945603351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786414e5c0 con 0x7f78640c2e50 2023-11-15T02:55:06.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.761+0000 7f784b7fe700 1 -- 172.21.15.1:0/1945603351 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858012ae0 con 0x7f78640c2e50 2023-11-15T02:55:06.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.761+0000 7f7869f40700 1 -- 172.21.15.1:0/1945603351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786414edc0 con 0x7f78640c2e50 2023-11-15T02:55:06.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.762+0000 7f7869f40700 1 -- 172.21.15.1:0/1945603351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7864062da0 con 0x7f78640c2e50 2023-11-15T02:55:06.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.762+0000 7f784b7fe700 1 -- 172.21.15.1:0/1945603351 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f785801b400 con 0x7f78640c2e50 2023-11-15T02:55:06.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.762+0000 7f784b7fe700 1 --2- 172.21.15.1:0/1945603351 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f785005f390 0x7f7850061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:06.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.762+0000 7f784b7fe700 1 -- 172.21.15.1:0/1945603351 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f785807ad20 con 0x7f78640c2e50 2023-11-15T02:55:06.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.762+0000 7f78637fe700 1 -- 172.21.15.1:0/1945603351 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f785005f390 msgr2=0x7f7850061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:06.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.762+0000 7f78637fe700 1 --2- 172.21.15.1:0/1945603351 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f785005f390 0x7f7850061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:06.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.767+0000 7f784b7fe700 1 -- 172.21.15.1:0/1945603351 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f785804b980 con 0x7f78640c2e50 2023-11-15T02:55:06.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.942+0000 7f7869f40700 1 -- 172.21.15.1:0/1945603351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f786406c7e0 con 0x7f78640c2e50 2023-11-15T02:55:06.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.942+0000 7f784b7fe700 1 -- 172.21.15.1:0/1945603351 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+18074 (secure 0 0 0) 0x7f785804efa0 con 0x7f78640c2e50 2023-11-15T02:55:06.947 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:06.947 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":197,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:53:55.073315+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:53:35.639437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-11-15T02:53:36.965896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/3875176396":"2023-11-16T02:53:55.073280+0000","172.21.15.141:0/349376685":"2023-11-16T02:53:55.073280+0000","172.21.15.141:0/1909336456":"2023-11-16T02:53:55.073280+0000","172.21.15.141:6832/103755":"2023-11-16T02:53:55.073280+0000","172.21.15.141:6833/103755":"2023-11-16T02:53:55.073280+0000","172.21.15.141:0/477213196":"2023-11-16T02:53:55.073280+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:55:06.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.945+0000 7f7869f40700 1 -- 172.21.15.1:0/1945603351 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f785005f390 msgr2=0x7f7850061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:06.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.945+0000 7f7869f40700 1 --2- 172.21.15.1:0/1945603351 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f785005f390 0x7f7850061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:06.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.945+0000 7f7869f40700 1 -- 172.21.15.1:0/1945603351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78640c2e50 msgr2=0x7f78641504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:06.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.945+0000 7f7869f40700 1 --2- 172.21.15.1:0/1945603351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78640c2e50 0x7f78641504f0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7f785800e930 tx=0x7f7858009060).stop 2023-11-15T02:55:06.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.945+0000 7f7869f40700 1 -- 172.21.15.1:0/1945603351 shutdown_connections 2023-11-15T02:55:06.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.945+0000 7f7869f40700 1 --2- 172.21.15.1:0/1945603351 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f785005f390 0x7f7850061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:06.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.945+0000 7f7869f40700 1 --2- 172.21.15.1:0/1945603351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7864155910 0x7f78641367c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.945+0000 7f7869f40700 1 --2- 172.21.15.1:0/1945603351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78640c2a70 0x7f786414d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.945+0000 7f7869f40700 1 --2- 172.21.15.1:0/1945603351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78640c2e50 0x7f78641504f0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:06.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.945+0000 7f7869f40700 1 -- 172.21.15.1:0/1945603351 >> 172.21.15.1:0/1945603351 conn(0x7f78640627b0 msgr2=0x7f78640c4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:06.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.945+0000 7f7869f40700 1 -- 172.21.15.1:0/1945603351 shutdown_connections 2023-11-15T02:55:06.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:06.945+0000 7f7869f40700 1 -- 172.21.15.1:0/1945603351 wait complete. 2023-11-15T02:55:06.958 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-15T02:55:06.959 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:55:07.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.078+0000 7f1839a74700 1 Processor -- start 2023-11-15T02:55:07.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.078+0000 7f1839a74700 1 -- start start 2023-11-15T02:55:07.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.078+0000 7f1839a74700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1834154680 0x7f1834069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.078+0000 7f1839a74700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18340c70c0 0x7f18340bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.079+0000 7f1839a74700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18340c3360 con 0x7f18340bccd0 2023-11-15T02:55:07.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.079+0000 7f1839a74700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18340bd620 con 0x7f1834154680 2023-11-15T02:55:07.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.079+0000 7f1839a74700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18340c2750 con 0x7f18340c70c0 2023-11-15T02:55:07.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.079+0000 7f18337fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1834154680 0x7f1834069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:07.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.079+0000 7f1833fff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18340c70c0 0x7f18340bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:07.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.079+0000 7f18337fe700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1834154680 0x7f1834069fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:53598/0 (socket says 172.21.15.1:53598) 2023-11-15T02:55:07.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.079+0000 7f18337fe700 1 -- 172.21.15.1:0/3505109139 learned_addr learned my addr 172.21.15.1:0/3505109139 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:07.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.079+0000 7f1833fff700 1 -- 172.21.15.1:0/3505109139 >> v2:172.21.15.141:3300/0 conn(0x7f1834154680 msgr2=0x7f1834069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:07.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.079+0000 7f1833fff700 1 --2- 172.21.15.1:0/3505109139 >> v2:172.21.15.141:3300/0 conn(0x7f1834154680 0x7f1834069fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.079+0000 7f1833fff700 1 -- 172.21.15.1:0/3505109139 >> v1:172.21.15.141:6789/0 conn(0x7f18340bccd0 legacy=0x7f18340627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.079+0000 7f1833fff700 1 -- 172.21.15.1:0/3505109139 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18340c2a30 con 0x7f18340c70c0 2023-11-15T02:55:07.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.079+0000 7f18337fe700 1 --2- 172.21.15.1:0/3505109139 >> v2:172.21.15.141:3300/0 conn(0x7f1834154680 0x7f1834069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:07.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.079+0000 7f1833fff700 1 --2- 172.21.15.1:0/3505109139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18340c70c0 0x7f18340bd130 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f182c009e60 tx=0x7f182c009780).ready entity=mon.2 client_cookie=3cad31d42a90e677 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:07.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.080+0000 7f18327fc700 1 -- 172.21.15.1:0/3505109139 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c00e070 con 0x7f18340c70c0 2023-11-15T02:55:07.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.080+0000 7f18327fc700 1 -- 172.21.15.1:0/3505109139 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182c00bb60 con 0x7f18340c70c0 2023-11-15T02:55:07.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.080+0000 7f18327fc700 1 -- 172.21.15.1:0/3505109139 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c012410 con 0x7f18340c70c0 2023-11-15T02:55:07.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.080+0000 7f1839a74700 1 -- 172.21.15.1:0/3505109139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18340c70c0 msgr2=0x7f18340bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.080+0000 7f1839a74700 1 --2- 172.21.15.1:0/3505109139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18340c70c0 0x7f18340bd130 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f182c009e60 tx=0x7f182c009780).stop 2023-11-15T02:55:07.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.080+0000 7f1839a74700 1 -- 172.21.15.1:0/3505109139 shutdown_connections 2023-11-15T02:55:07.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.080+0000 7f1839a74700 1 --2- 172.21.15.1:0/3505109139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18340c70c0 0x7f18340bd130 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.080+0000 7f1839a74700 1 --2- 172.21.15.1:0/3505109139 >> v2:172.21.15.141:3300/0 conn(0x7f1834154680 0x7f1834069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.080+0000 7f1839a74700 1 -- 172.21.15.1:0/3505109139 >> 172.21.15.1:0/3505109139 conn(0x7f18340c7d70 msgr2=0x7f18340c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:07.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.080+0000 7f1839a74700 1 -- 172.21.15.1:0/3505109139 shutdown_connections 2023-11-15T02:55:07.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.080+0000 7f1839a74700 1 -- 172.21.15.1:0/3505109139 wait complete. 2023-11-15T02:55:07.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.082+0000 7f1839a74700 1 Processor -- start 2023-11-15T02:55:07.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.082+0000 7f1839a74700 1 -- start start 2023-11-15T02:55:07.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.082+0000 7f1839a74700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18340bccd0 0x7f1834151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.082+0000 7f1839a74700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18340c70c0 0x7f18340a9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.082+0000 7f1839a74700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1834154680 0x7f18340ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.082+0000 7f1839a74700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18340ace20 con 0x7f18340c70c0 2023-11-15T02:55:07.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.082+0000 7f1839a74700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1834152110 con 0x7f1834154680 2023-11-15T02:55:07.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.082+0000 7f1839a74700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18340a9e70 con 0x7f18340bccd0 2023-11-15T02:55:07.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f1832ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18340c70c0 0x7f18340a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:07.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f1832ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18340c70c0 0x7f18340a9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43972/0 (socket says 172.21.15.1:43972) 2023-11-15T02:55:07.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f1832ffd700 1 -- 172.21.15.1:0/2224867236 learned_addr learned my addr 172.21.15.1:0/2224867236 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:07.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f18337fe700 1 --2- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18340bccd0 0x7f1834151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:07.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f1833fff700 1 --2- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1834154680 0x7f18340ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:07.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f1832ffd700 1 -- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18340bccd0 msgr2=0x7f1834151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f1832ffd700 1 --2- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18340bccd0 0x7f1834151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f1832ffd700 1 -- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1834154680 msgr2=0x7f18340ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f1832ffd700 1 --2- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1834154680 0x7f18340ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f1832ffd700 1 -- 172.21.15.1:0/2224867236 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824009370 con 0x7f18340c70c0 2023-11-15T02:55:07.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f1832ffd700 1 --2- 172.21.15.1:0/2224867236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18340c70c0 0x7f18340a9980 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7f182800c4c0 tx=0x7f1828007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:07.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f181b7fe700 1 -- 172.21.15.1:0/2224867236 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182800ce70 con 0x7f18340c70c0 2023-11-15T02:55:07.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f181b7fe700 1 -- 172.21.15.1:0/2224867236 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1828001e90 con 0x7f18340c70c0 2023-11-15T02:55:07.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f1839a74700 1 -- 172.21.15.1:0/2224867236 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182c009a20 con 0x7f18340c70c0 2023-11-15T02:55:07.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f181b7fe700 1 -- 172.21.15.1:0/2224867236 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1828007270 con 0x7f18340c70c0 2023-11-15T02:55:07.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.083+0000 7f1839a74700 1 -- 172.21.15.1:0/2224867236 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18340ac4f0 con 0x7f18340c70c0 2023-11-15T02:55:07.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.085+0000 7f1839a74700 1 -- 172.21.15.1:0/2224867236 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18340acf90 con 0x7f18340c70c0 2023-11-15T02:55:07.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.086+0000 7f181b7fe700 1 -- 172.21.15.1:0/2224867236 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f18280066a0 con 0x7f18340c70c0 2023-11-15T02:55:07.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.086+0000 7f181b7fe700 1 --2- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f182005f390 0x7f1820061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.086+0000 7f18337fe700 1 -- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f182005f390 msgr2=0x7f1820061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:07.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.086+0000 7f181b7fe700 1 -- 172.21.15.1:0/2224867236 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f182807a6d0 con 0x7f18340c70c0 2023-11-15T02:55:07.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.086+0000 7f18337fe700 1 --2- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f182005f390 0x7f1820061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:07.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.090+0000 7f181b7fe700 1 -- 172.21.15.1:0/2224867236 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f182804b3f0 con 0x7f18340c70c0 2023-11-15T02:55:07.177 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:07.176+0000 7ff71fea9680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:55:07.245 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:07.244+0000 7ff71fea9680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:55:07.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.287+0000 7f18337fe700 1 -- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f182005f390 msgr2=0x7f1820061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:07.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.287+0000 7f18337fe700 1 --2- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f182005f390 0x7f1820061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:55:07.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.311+0000 7f1839a74700 1 -- 172.21.15.1:0/2224867236 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f183406c7e0 con 0x7f18340c70c0 2023-11-15T02:55:07.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.312+0000 7f181b7fe700 1 -- 172.21.15.1:0/2224867236 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f182804ea10 con 0x7f18340c70c0 2023-11-15T02:55:07.313 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:07.314 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":87,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8764,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/1669030169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1669030169},{"type":"v1","addr":"172.21.15.141:6837","nonce":1669030169}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9597,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2404592830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2404592830},{"type":"v1","addr":"172.21.15.1:6834","nonce":2404592830}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9600,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3663257097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3663257097},{"type":"v1","addr":"172.21.15.1:6835","nonce":3663257097}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:53:37.978121+0000","modified":"2023-11-15T02:53:40.995474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9609},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9609":{"gid":9609,"name":"d","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6836/1387364974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":1387364974},{"type":"v1","addr":"172.21.15.141:6836","nonce":1387364974}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-11-15T02:55:07.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.315+0000 7f1839a74700 1 -- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f182005f390 msgr2=0x7f1820061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:07.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.315+0000 7f1839a74700 1 --2- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f182005f390 0x7f1820061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:07.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.315+0000 7f1839a74700 1 -- 172.21.15.1:0/2224867236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18340c70c0 msgr2=0x7f18340a9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.315+0000 7f1839a74700 1 --2- 172.21.15.1:0/2224867236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18340c70c0 0x7f18340a9980 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7f182800c4c0 tx=0x7f1828007e00).stop 2023-11-15T02:55:07.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.315+0000 7f1839a74700 1 -- 172.21.15.1:0/2224867236 shutdown_connections 2023-11-15T02:55:07.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.315+0000 7f1839a74700 1 --2- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f182005f390 0x7f1820061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:07.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.315+0000 7f1839a74700 1 --2- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1834154680 0x7f18340ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.315+0000 7f1839a74700 1 --2- 172.21.15.1:0/2224867236 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18340bccd0 0x7f1834151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.315+0000 7f1839a74700 1 --2- 172.21.15.1:0/2224867236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18340c70c0 0x7f18340a9980 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.315+0000 7f1839a74700 1 -- 172.21.15.1:0/2224867236 >> 172.21.15.1:0/2224867236 conn(0x7f18340c7d70 msgr2=0x7f1834069590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:07.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.315+0000 7f1839a74700 1 -- 172.21.15.1:0/2224867236 shutdown_connections 2023-11-15T02:55:07.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.315+0000 7f1839a74700 1 -- 172.21.15.1:0/2224867236 wait complete. 2023-11-15T02:55:07.319 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 87 2023-11-15T02:55:07.320 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:07.319+0000 7ff71fea9680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:55:07.334 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:55:07.416 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:07.415+0000 7f5c1e149680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:55:07.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.453+0000 7f76c7279700 1 Processor -- start 2023-11-15T02:55:07.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.453+0000 7f76c7279700 1 -- start start 2023-11-15T02:55:07.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.454+0000 7f76c7279700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76c0063160 0x7f76c0068dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.454+0000 7f76c7279700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c0150d50 con 0x7f76c0150530 2023-11-15T02:55:07.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.454+0000 7f76c7279700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c00c2290 con 0x7f76c0150910 2023-11-15T02:55:07.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.454+0000 7f76c7279700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c00650f0 con 0x7f76c0063160 2023-11-15T02:55:07.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.454+0000 7f76c5015700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f76c0150530 0x7f76c00c2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59262/0 (socket says 172.21.15.1:59262) 2023-11-15T02:55:07.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.454+0000 7f76c5015700 1 -- 172.21.15.1:0/4083738333 learned_addr learned my addr 172.21.15.1:0/4083738333 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:07.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.454+0000 7f76c5816700 1 --2- 172.21.15.1:0/4083738333 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76c0063160 0x7f76c0068dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:07.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.454+0000 7f76b7fff700 1 -- 172.21.15.1:0/4083738333 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165485262 0 0) 0x7f76c0150d50 con 0x7f76c0150530 2023-11-15T02:55:07.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.454+0000 7f76b7fff700 1 -- 172.21.15.1:0/4083738333 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76ac0033f0 con 0x7f76c0150530 2023-11-15T02:55:07.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.454+0000 7f76b7fff700 1 -- 172.21.15.1:0/4083738333 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292307803 0 0) 0x7f76c00c2290 con 0x7f76c0150910 2023-11-15T02:55:07.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.454+0000 7f76b7fff700 1 -- 172.21.15.1:0/4083738333 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76c0150d50 con 0x7f76c0150910 2023-11-15T02:55:07.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.455+0000 7f76c5816700 1 -- 172.21.15.1:0/4083738333 >> v1:172.21.15.141:6789/0 conn(0x7f76c0150910 legacy=0x7f76c0062a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.455+0000 7f76b7fff700 1 -- 172.21.15.1:0/4083738333 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2437598807 0 0) 0x7f76ac0033f0 con 0x7f76c0150530 2023-11-15T02:55:07.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.455+0000 7f76c5816700 1 -- 172.21.15.1:0/4083738333 >> v1:172.21.15.1:6789/0 conn(0x7f76c0150530 legacy=0x7f76c00c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.455+0000 7f76c5816700 1 -- 172.21.15.1:0/4083738333 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c00635f0 con 0x7f76c0063160 2023-11-15T02:55:07.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.455+0000 7f76c5816700 1 --2- 172.21.15.1:0/4083738333 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76c0063160 0x7f76c0068dd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f76b8009e90 tx=0x7f76b8009780).ready entity=mon.2 client_cookie=2f4ed9e9064dec2d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:07.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.455+0000 7f76b7fff700 1 -- 172.21.15.1:0/4083738333 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b800e070 con 0x7f76c0063160 2023-11-15T02:55:07.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.455+0000 7f76b7fff700 1 -- 172.21.15.1:0/4083738333 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b800b7a0 con 0x7f76c0063160 2023-11-15T02:55:07.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.455+0000 7f76b7fff700 1 -- 172.21.15.1:0/4083738333 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0001470 con 0x7f76c0063160 2023-11-15T02:55:07.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.456+0000 7f76c7279700 1 -- 172.21.15.1:0/4083738333 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76c0063160 msgr2=0x7f76c0068dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.456+0000 7f76c7279700 1 --2- 172.21.15.1:0/4083738333 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76c0063160 0x7f76c0068dd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f76b8009e90 tx=0x7f76b8009780).stop 2023-11-15T02:55:07.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.456+0000 7f76c7279700 1 -- 172.21.15.1:0/4083738333 shutdown_connections 2023-11-15T02:55:07.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.456+0000 7f76c7279700 1 --2- 172.21.15.1:0/4083738333 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76c0063160 0x7f76c0068dd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.456+0000 7f76c7279700 1 -- 172.21.15.1:0/4083738333 >> 172.21.15.1:0/4083738333 conn(0x7f76c00c74f0 msgr2=0x7f76c00c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:07.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.456+0000 7f76c7279700 1 -- 172.21.15.1:0/4083738333 shutdown_connections 2023-11-15T02:55:07.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.456+0000 7f76c7279700 1 -- 172.21.15.1:0/4083738333 wait complete. 2023-11-15T02:55:07.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.457+0000 7f76c7279700 1 Processor -- start 2023-11-15T02:55:07.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.457+0000 7f76c7279700 1 -- start start 2023-11-15T02:55:07.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c7279700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76c0150530 0x7f76c013d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c7279700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76c0150910 0x7f76c00be540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c7279700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76c00bea30 0x7f76c00c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c7279700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c013dec0 con 0x7f76c0150530 2023-11-15T02:55:07.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c7279700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c00bffa0 con 0x7f76c0150910 2023-11-15T02:55:07.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c7279700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c00bfb10 con 0x7f76c00bea30 2023-11-15T02:55:07.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c5015700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76c0150530 0x7f76c013d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:07.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c5015700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76c0150530 0x7f76c013d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43976/0 (socket says 172.21.15.1:43976) 2023-11-15T02:55:07.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c5816700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76c00bea30 0x7f76c00c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:07.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c4814700 1 --2- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76c0150910 0x7f76c00be540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:07.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c5015700 1 -- 172.21.15.1:0/3387517245 learned_addr learned my addr 172.21.15.1:0/3387517245 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:07.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c5015700 1 -- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76c00bea30 msgr2=0x7f76c00c04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c5015700 1 --2- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76c00bea30 0x7f76c00c04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c5015700 1 -- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76c0150910 msgr2=0x7f76c00be540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c5015700 1 --2- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76c0150910 0x7f76c00be540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c5015700 1 -- 172.21.15.1:0/3387517245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b8009a20 con 0x7f76c0150530 2023-11-15T02:55:07.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.458+0000 7f76c4814700 1 --2- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76c0150910 0x7f76c00be540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:07.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.459+0000 7f76c5015700 1 --2- 172.21.15.1:0/3387517245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76c0150530 0x7f76c013d9d0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7f76b000c840 tx=0x7f76b0001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:07.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.459+0000 7f76b57fa700 1 -- 172.21.15.1:0/3387517245 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0007170 con 0x7f76c0150530 2023-11-15T02:55:07.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.459+0000 7f76b57fa700 1 -- 172.21.15.1:0/3387517245 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b00072d0 con 0x7f76c0150530 2023-11-15T02:55:07.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.459+0000 7f76b57fa700 1 -- 172.21.15.1:0/3387517245 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b00048c0 con 0x7f76c0150530 2023-11-15T02:55:07.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.459+0000 7f76c7279700 1 -- 172.21.15.1:0/3387517245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c00bef00 con 0x7f76c0150530 2023-11-15T02:55:07.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.459+0000 7f76c7279700 1 -- 172.21.15.1:0/3387517245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c00bf4c0 con 0x7f76c0150530 2023-11-15T02:55:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.460+0000 7f76c7279700 1 -- 172.21.15.1:0/3387517245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c00bfdf0 con 0x7f76c0150530 2023-11-15T02:55:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.460+0000 7f76b57fa700 1 -- 172.21.15.1:0/3387517245 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f76b0004c70 con 0x7f76c0150530 2023-11-15T02:55:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.461+0000 7f76b57fa700 1 --2- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f76a405f390 0x7f76a4061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.461+0000 7f76c4814700 1 -- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f76a405f390 msgr2=0x7f76a4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:07.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.461+0000 7f76b57fa700 1 -- 172.21.15.1:0/3387517245 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f76b007a1c0 con 0x7f76c0150530 2023-11-15T02:55:07.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.461+0000 7f76c4814700 1 --2- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f76a405f390 0x7f76a4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:07.471 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:07.466+0000 7ff71fea9680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:55:07.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.465+0000 7f76b57fa700 1 -- 172.21.15.1:0/3387517245 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f76b004ae80 con 0x7f76c0150530 2023-11-15T02:55:07.491 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:07.490+0000 7f5c1e149680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:55:07.539 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:07.538+0000 7ff71fea9680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:55:07.570 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:07.569+0000 7f5c1e149680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:55:07.653 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:07.652+0000 7ff71fea9680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:55:07.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.662+0000 7f76c4814700 1 -- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f76a405f390 msgr2=0x7f76a4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:07.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.662+0000 7f76c4814700 1 --2- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f76a405f390 0x7f76a4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:55:07.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.685+0000 7f76c7279700 1 -- 172.21.15.1:0/3387517245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76c00bd1e0 con 0x7f76c0150530 2023-11-15T02:55:07.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.686+0000 7f76b57fa700 1 -- 172.21.15.1:0/3387517245 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f76b0019070 con 0x7f76c0150530 2023-11-15T02:55:07.687 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:07.688 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":87,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8764,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/1669030169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1669030169},{"type":"v1","addr":"172.21.15.141:6837","nonce":1669030169}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9597,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2404592830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2404592830},{"type":"v1","addr":"172.21.15.1:6834","nonce":2404592830}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9600,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3663257097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3663257097},{"type":"v1","addr":"172.21.15.1:6835","nonce":3663257097}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:53:37.978121+0000","modified":"2023-11-15T02:53:40.995474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9609},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9609":{"gid":9609,"name":"d","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6836/1387364974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":1387364974},{"type":"v1","addr":"172.21.15.141:6836","nonce":1387364974}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-11-15T02:55:07.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.688+0000 7f76c7279700 1 -- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f76a405f390 msgr2=0x7f76a4061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:07.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.688+0000 7f76c7279700 1 --2- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f76a405f390 0x7f76a4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:07.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.688+0000 7f76c7279700 1 -- 172.21.15.1:0/3387517245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76c0150530 msgr2=0x7f76c013d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.688+0000 7f76c7279700 1 --2- 172.21.15.1:0/3387517245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76c0150530 0x7f76c013d9d0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7f76b000c840 tx=0x7f76b0001b50).stop 2023-11-15T02:55:07.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.688+0000 7f76c7279700 1 -- 172.21.15.1:0/3387517245 shutdown_connections 2023-11-15T02:55:07.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.688+0000 7f76c7279700 1 --2- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f76a405f390 0x7f76a4061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:07.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.688+0000 7f76c7279700 1 --2- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76c00bea30 0x7f76c00c04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.688+0000 7f76c7279700 1 --2- 172.21.15.1:0/3387517245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76c0150530 0x7f76c013d9d0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.688+0000 7f76c7279700 1 --2- 172.21.15.1:0/3387517245 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76c0150910 0x7f76c00be540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.688+0000 7f76c7279700 1 -- 172.21.15.1:0/3387517245 >> 172.21.15.1:0/3387517245 conn(0x7f76c00c74f0 msgr2=0x7f76c00c2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:07.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.688+0000 7f76c7279700 1 -- 172.21.15.1:0/3387517245 shutdown_connections 2023-11-15T02:55:07.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.688+0000 7f76c7279700 1 -- 172.21.15.1:0/3387517245 wait complete. 2023-11-15T02:55:07.692 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 87 2023-11-15T02:55:07.702 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:55:07.728 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:07.728+0000 7f5c1e149680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:55:07.761 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:07.759+0000 7ff71fea9680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:55:07.805 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:07.805+0000 7f5c1e149680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:55:07.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.821+0000 7f4f68309700 1 Processor -- start 2023-11-15T02:55:07.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.821+0000 7f4f68309700 1 -- start start 2023-11-15T02:55:07.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.822+0000 7f4f68309700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4f600be390 0x7f4f600bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.822+0000 7f4f68309700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f600ad5e0 con 0x7f4f600bdfb0 2023-11-15T02:55:07.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.822+0000 7f4f68309700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f600ad8c0 con 0x7f4f600bd8f0 2023-11-15T02:55:07.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.822+0000 7f4f68309700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f600bccd0 con 0x7f4f600be390 2023-11-15T02:55:07.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.822+0000 7f4f658a4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4f600be390 0x7f4f600bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:07.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.822+0000 7f4f660a5700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4f600bdfb0 0x7f4f600c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59936/0 (socket says 172.21.15.1:59936) 2023-11-15T02:55:07.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.822+0000 7f4f660a5700 1 -- 172.21.15.1:0/2824963418 learned_addr learned my addr 172.21.15.1:0/2824963418 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:07.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.822+0000 7f4f658a4700 1 -- 172.21.15.1:0/2824963418 >> v1:172.21.15.141:6789/0 conn(0x7f4f600bd8f0 legacy=0x7f4f60154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.822+0000 7f4f658a4700 1 -- 172.21.15.1:0/2824963418 >> v1:172.21.15.1:6789/0 conn(0x7f4f600bdfb0 legacy=0x7f4f600c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.822+0000 7f4f658a4700 1 -- 172.21.15.1:0/2824963418 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f600adba0 con 0x7f4f600be390 2023-11-15T02:55:07.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.823+0000 7f4f658a4700 1 --2- 172.21.15.1:0/2824963418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f600be390 0x7f4f600bd400 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f4f5c009760 tx=0x7f4f5c009060).ready entity=mon.0 client_cookie=aa311132cdfe8bdc server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:07.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.823+0000 7f4f650a3700 1 -- 172.21.15.1:0/2824963418 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c00b580 con 0x7f4f600be390 2023-11-15T02:55:07.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.823+0000 7f4f650a3700 1 -- 172.21.15.1:0/2824963418 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c00b6e0 con 0x7f4f600be390 2023-11-15T02:55:07.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.823+0000 7f4f650a3700 1 -- 172.21.15.1:0/2824963418 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c00ba60 con 0x7f4f600be390 2023-11-15T02:55:07.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.823+0000 7f4f68309700 1 -- 172.21.15.1:0/2824963418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f600be390 msgr2=0x7f4f600bd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.823+0000 7f4f68309700 1 --2- 172.21.15.1:0/2824963418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f600be390 0x7f4f600bd400 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f4f5c009760 tx=0x7f4f5c009060).stop 2023-11-15T02:55:07.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.823+0000 7f4f68309700 1 -- 172.21.15.1:0/2824963418 shutdown_connections 2023-11-15T02:55:07.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.823+0000 7f4f68309700 1 --2- 172.21.15.1:0/2824963418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f600be390 0x7f4f600bd400 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.823+0000 7f4f68309700 1 -- 172.21.15.1:0/2824963418 >> 172.21.15.1:0/2824963418 conn(0x7f4f600c7d70 msgr2=0x7f4f600c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:07.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.823+0000 7f4f68309700 1 -- 172.21.15.1:0/2824963418 shutdown_connections 2023-11-15T02:55:07.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.823+0000 7f4f68309700 1 -- 172.21.15.1:0/2824963418 wait complete. 2023-11-15T02:55:07.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.824+0000 7f4f68309700 1 Processor -- start 2023-11-15T02:55:07.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.825+0000 7f4f68309700 1 -- start start 2023-11-15T02:55:07.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.825+0000 7f4f68309700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f600bd8f0 0x7f4f60141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.825+0000 7f4f68309700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f600bdfb0 0x7f4f6014cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.825+0000 7f4f68309700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f600be390 0x7f4f600bf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.825+0000 7f4f68309700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600c01b0 con 0x7f4f600bdfb0 2023-11-15T02:55:07.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.825+0000 7f4f68309700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6014c120 con 0x7f4f600be390 2023-11-15T02:55:07.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.825+0000 7f4f68309700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6014c400 con 0x7f4f600bd8f0 2023-11-15T02:55:07.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.825+0000 7f4f658a4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f600bdfb0 0x7f4f6014cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:07.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.825+0000 7f4f658a4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f600bdfb0 0x7f4f6014cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40904/0 (socket says 172.21.15.1:40904) 2023-11-15T02:55:07.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.825+0000 7f4f658a4700 1 -- 172.21.15.1:0/1293278556 learned_addr learned my addr 172.21.15.1:0/1293278556 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:07.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.826+0000 7f4f660a5700 1 --2- 172.21.15.1:0/1293278556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f600bd8f0 0x7f4f60141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:07.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.826+0000 7f4f668a6700 1 --2- 172.21.15.1:0/1293278556 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f600be390 0x7f4f600bf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:07.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.826+0000 7f4f658a4700 1 -- 172.21.15.1:0/1293278556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f600bd8f0 msgr2=0x7f4f60141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.826+0000 7f4f658a4700 1 --2- 172.21.15.1:0/1293278556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f600bd8f0 0x7f4f60141a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.826+0000 7f4f658a4700 1 -- 172.21.15.1:0/1293278556 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f600be390 msgr2=0x7f4f600bf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:07.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.826+0000 7f4f658a4700 1 --2- 172.21.15.1:0/1293278556 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f600be390 0x7f4f600bf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:07.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.826+0000 7f4f658a4700 1 -- 172.21.15.1:0/1293278556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0092a0 con 0x7f4f600bdfb0 2023-11-15T02:55:07.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.826+0000 7f4f668a6700 1 --2- 172.21.15.1:0/1293278556 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f600be390 0x7f4f600bf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:07.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.826+0000 7f4f658a4700 1 --2- 172.21.15.1:0/1293278556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f600bdfb0 0x7f4f6014cc00 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f4f5c009eb0 tx=0x7f4f5c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:07.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.826+0000 7f4f567fc700 1 -- 172.21.15.1:0/1293278556 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c00ba60 con 0x7f4f600bdfb0 2023-11-15T02:55:07.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.826+0000 7f4f567fc700 1 -- 172.21.15.1:0/1293278556 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c000c90 con 0x7f4f600bdfb0 2023-11-15T02:55:07.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.826+0000 7f4f68309700 1 -- 172.21.15.1:0/1293278556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6014c6e0 con 0x7f4f600bdfb0 2023-11-15T02:55:07.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.826+0000 7f4f567fc700 1 -- 172.21.15.1:0/1293278556 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c01b650 con 0x7f4f600bdfb0 2023-11-15T02:55:07.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.826+0000 7f4f68309700 1 -- 172.21.15.1:0/1293278556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f60141f00 con 0x7f4f600bdfb0 2023-11-15T02:55:07.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.828+0000 7f4f68309700 1 -- 172.21.15.1:0/1293278556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6014c920 con 0x7f4f600bdfb0 2023-11-15T02:55:07.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.829+0000 7f4f567fc700 1 -- 172.21.15.1:0/1293278556 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f4f5c01ba00 con 0x7f4f600bdfb0 2023-11-15T02:55:07.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.829+0000 7f4f567fc700 1 --2- 172.21.15.1:0/1293278556 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4f4405f390 0x7f4f44061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:07.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.829+0000 7f4f660a5700 1 -- 172.21.15.1:0/1293278556 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4f4405f390 msgr2=0x7f4f44061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:07.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.829+0000 7f4f567fc700 1 -- 172.21.15.1:0/1293278556 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f4f5c07cbc0 con 0x7f4f600bdfb0 2023-11-15T02:55:07.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.829+0000 7f4f660a5700 1 --2- 172.21.15.1:0/1293278556 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4f4405f390 0x7f4f44061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:07.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:07.833+0000 7f4f567fc700 1 -- 172.21.15.1:0/1293278556 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4f5c04d940 con 0x7f4f600bdfb0 2023-11-15T02:55:07.930 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:07.929+0000 7f5c1e149680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:55:08.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.014+0000 7f4f68309700 1 -- 172.21.15.1:0/1293278556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f6014c920 con 0x7f4f600bdfb0 2023-11-15T02:55:08.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.015+0000 7f4f567fc700 1 -- 172.21.15.1:0/1293278556 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) v1 ==== 74+0+18186 (secure 0 0 0) 0x7f4f6014c920 con 0x7f4f600bdfb0 2023-11-15T02:55:08.017 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:08.017 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":198,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:55:07.938987+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:53:35.639437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-11-15T02:53:36.965896+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":198,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/3875176396":"2023-11-16T02:53:55.073280+0000","172.21.15.141:0/349376685":"2023-11-16T02:53:55.073280+0000","172.21.15.141:0/1909336456":"2023-11-16T02:53:55.073280+0000","172.21.15.141:6832/103755":"2023-11-16T02:53:55.073280+0000","172.21.15.141:6833/103755":"2023-11-16T02:53:55.073280+0000","172.21.15.141:0/477213196":"2023-11-16T02:53:55.073280+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:55:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.018+0000 7f4f68309700 1 -- 172.21.15.1:0/1293278556 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4f4405f390 msgr2=0x7f4f44061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.018+0000 7f4f68309700 1 --2- 172.21.15.1:0/1293278556 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4f4405f390 0x7f4f44061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.018+0000 7f4f68309700 1 -- 172.21.15.1:0/1293278556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f600bdfb0 msgr2=0x7f4f6014cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.018+0000 7f4f68309700 1 --2- 172.21.15.1:0/1293278556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f600bdfb0 0x7f4f6014cc00 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f4f5c009eb0 tx=0x7f4f5c017000).stop 2023-11-15T02:55:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.018+0000 7f4f68309700 1 -- 172.21.15.1:0/1293278556 shutdown_connections 2023-11-15T02:55:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.018+0000 7f4f68309700 1 --2- 172.21.15.1:0/1293278556 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4f4405f390 0x7f4f44061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.018+0000 7f4f68309700 1 --2- 172.21.15.1:0/1293278556 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f600be390 0x7f4f600bf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.018+0000 7f4f68309700 1 --2- 172.21.15.1:0/1293278556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f600bd8f0 0x7f4f60141a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:08.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.018+0000 7f4f68309700 1 --2- 172.21.15.1:0/1293278556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f600bdfb0 0x7f4f6014cc00 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:08.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.018+0000 7f4f68309700 1 -- 172.21.15.1:0/1293278556 >> 172.21.15.1:0/1293278556 conn(0x7f4f600c7d70 msgr2=0x7f4f6014da50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:08.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.018+0000 7f4f68309700 1 -- 172.21.15.1:0/1293278556 shutdown_connections 2023-11-15T02:55:08.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.018+0000 7f4f68309700 1 -- 172.21.15.1:0/1293278556 wait complete. 2023-11-15T02:55:08.036 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-15T02:55:08.055 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:08.054+0000 7ff71fea9680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:55:08.059 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:08.058+0000 7f5c1e149680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:55:08.125 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:08.124+0000 7ff71fea9680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:55:08.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.187+0000 7f873026c700 1 Processor -- start 2023-11-15T02:55:08.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.187+0000 7f873026c700 1 -- start start 2023-11-15T02:55:08.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f873026c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8728150910 0x7f8728062a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:08.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f873026c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8728062f40 0x7f8728068dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:08.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f873026c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8728150d50 con 0x7f8728150530 2023-11-15T02:55:08.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f873026c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87280c2290 con 0x7f8728150910 2023-11-15T02:55:08.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f873026c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87280633a0 con 0x7f8728062f40 2023-11-15T02:55:08.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f872d807700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8728150910 0x7f8728062a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:08.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f872e008700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8728150530 0x7f87280c2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59938/0 (socket says 172.21.15.1:59938) 2023-11-15T02:55:08.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f872d807700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8728150910 0x7f8728062a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40916/0 (socket says 172.21.15.1:40916) 2023-11-15T02:55:08.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f872e008700 1 -- 172.21.15.1:0/1941827440 learned_addr learned my addr 172.21.15.1:0/1941827440 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:08.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f872e809700 1 --2- 172.21.15.1:0/1941827440 >> v2:172.21.15.141:3300/0 conn(0x7f8728062f40 0x7f8728068dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:08.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f872d807700 1 -- 172.21.15.1:0/1941827440 >> v2:172.21.15.141:3300/0 conn(0x7f8728062f40 msgr2=0x7f8728068dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:08.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f872d807700 1 --2- 172.21.15.1:0/1941827440 >> v2:172.21.15.141:3300/0 conn(0x7f8728062f40 0x7f8728068dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:08.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f872d807700 1 -- 172.21.15.1:0/1941827440 >> v1:172.21.15.1:6789/0 conn(0x7f8728150530 legacy=0x7f87280c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:08.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f872d006700 1 -- 172.21.15.1:0/1941827440 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487063602 0 0) 0x7f8728150d50 con 0x7f8728150530 2023-11-15T02:55:08.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f872d807700 1 -- 172.21.15.1:0/1941827440 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87280650f0 con 0x7f8728150910 2023-11-15T02:55:08.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f872d807700 1 --2- 172.21.15.1:0/1941827440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8728150910 0x7f8728062a50 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f87280c3f30 tx=0x7f8724009060).ready entity=mon.0 client_cookie=99253be9d26e7846 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:08.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f872d006700 1 -- 172.21.15.1:0/1941827440 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872400f510 con 0x7f8728150910 2023-11-15T02:55:08.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f872d006700 1 -- 172.21.15.1:0/1941827440 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872400f670 con 0x7f8728150910 2023-11-15T02:55:08.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.188+0000 7f872d006700 1 -- 172.21.15.1:0/1941827440 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872400f9f0 con 0x7f8728150910 2023-11-15T02:55:08.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.189+0000 7f873026c700 1 -- 172.21.15.1:0/1941827440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8728150910 msgr2=0x7f8728062a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:08.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.189+0000 7f873026c700 1 --2- 172.21.15.1:0/1941827440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8728150910 0x7f8728062a50 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f87280c3f30 tx=0x7f8724009060).stop 2023-11-15T02:55:08.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.189+0000 7f873026c700 1 -- 172.21.15.1:0/1941827440 shutdown_connections 2023-11-15T02:55:08.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.189+0000 7f873026c700 1 --2- 172.21.15.1:0/1941827440 >> v2:172.21.15.141:3300/0 conn(0x7f8728062f40 0x7f8728068dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:08.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.189+0000 7f873026c700 1 --2- 172.21.15.1:0/1941827440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8728150910 0x7f8728062a50 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:08.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.189+0000 7f873026c700 1 -- 172.21.15.1:0/1941827440 >> 172.21.15.1:0/1941827440 conn(0x7f87280c74f0 msgr2=0x7f87280c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:08.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.189+0000 7f873026c700 1 -- 172.21.15.1:0/1941827440 shutdown_connections 2023-11-15T02:55:08.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.189+0000 7f873026c700 1 -- 172.21.15.1:0/1941827440 wait complete. 2023-11-15T02:55:08.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.190+0000 7f873026c700 1 Processor -- start 2023-11-15T02:55:08.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.191+0000 7f873026c700 1 -- start start 2023-11-15T02:55:08.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.191+0000 7f873026c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8728062f40 0x7f8728140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:08.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.191+0000 7f873026c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8728150530 0x7f87280be540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:08.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.191+0000 7f873026c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8728150910 0x7f87280bbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:08.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.191+0000 7f873026c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87280bfd50 con 0x7f8728062f40 2023-11-15T02:55:08.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.191+0000 7f873026c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87280beeb0 con 0x7f8728150530 2023-11-15T02:55:08.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.191+0000 7f873026c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87280bf190 con 0x7f8728150910 2023-11-15T02:55:08.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.191+0000 7f872e008700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8728062f40 0x7f8728140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:08.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.191+0000 7f872e008700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8728062f40 0x7f8728140890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40928/0 (socket says 172.21.15.1:40928) 2023-11-15T02:55:08.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.191+0000 7f872e008700 1 -- 172.21.15.1:0/293556746 learned_addr learned my addr 172.21.15.1:0/293556746 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:08.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.191+0000 7f872d807700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8728150530 0x7f87280be540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:08.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.192+0000 7f872e809700 1 --2- 172.21.15.1:0/293556746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8728150910 0x7f87280bbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:08.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.192+0000 7f872e008700 1 -- 172.21.15.1:0/293556746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8728150910 msgr2=0x7f87280bbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:08.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.192+0000 7f872e008700 1 --2- 172.21.15.1:0/293556746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8728150910 0x7f87280bbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:08.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.192+0000 7f872e008700 1 -- 172.21.15.1:0/293556746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8728150530 msgr2=0x7f87280be540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:08.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.192+0000 7f872e008700 1 --2- 172.21.15.1:0/293556746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8728150530 0x7f87280be540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:08.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.192+0000 7f872e008700 1 -- 172.21.15.1:0/293556746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87240092a0 con 0x7f8728062f40 2023-11-15T02:55:08.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.192+0000 7f872d807700 1 --2- 172.21.15.1:0/293556746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8728150530 0x7f87280be540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:08.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.192+0000 7f872e008700 1 --2- 172.21.15.1:0/293556746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8728062f40 0x7f8728140890 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f871800c4e0 tx=0x7f8718007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:08.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.192+0000 7f871e7fc700 1 -- 172.21.15.1:0/293556746 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871800ce90 con 0x7f8728062f40 2023-11-15T02:55:08.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.192+0000 7f871e7fc700 1 -- 172.21.15.1:0/293556746 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87180072e0 con 0x7f8728062f40 2023-11-15T02:55:08.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.192+0000 7f871e7fc700 1 -- 172.21.15.1:0/293556746 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8718007660 con 0x7f8728062f40 2023-11-15T02:55:08.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.192+0000 7f873026c700 1 -- 172.21.15.1:0/293556746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87280bf470 con 0x7f8728062f40 2023-11-15T02:55:08.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.192+0000 7f873026c700 1 -- 172.21.15.1:0/293556746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8728140d80 con 0x7f8728062f40 2023-11-15T02:55:08.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.193+0000 7f873026c700 1 -- 172.21.15.1:0/293556746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872806c7e0 con 0x7f8728062f40 2023-11-15T02:55:08.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.194+0000 7f871e7fc700 1 -- 172.21.15.1:0/293556746 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 96) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f87180059b0 con 0x7f8728062f40 2023-11-15T02:55:08.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.194+0000 7f871e7fc700 1 -- 172.21.15.1:0/293556746 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 7189+0+0 (secure 0 0 0) 0x7f8718079a60 con 0x7f8728062f40 2023-11-15T02:55:08.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.199+0000 7f871e7fc700 1 -- 172.21.15.1:0/293556746 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f871804aad0 con 0x7f8728062f40 2023-11-15T02:55:08.208 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:08.207+0000 7ff698e37700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:08.208 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:08.207+0000 7ff698e37700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:08.209 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:08.207+0000 7ff698e37700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:08.209 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:08.207+0000 7ff698e37700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:08.209 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:08.207+0000 7ff698e37700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:08.209 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:08.207+0000 7ff69ce3f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:08.209 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:08.207+0000 7ff69ce3f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:08.210 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:08.207+0000 7ff69ce3f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:08.210 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:08.207+0000 7ff69ce3f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:08.210 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:08.207+0000 7ff69ce3f700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:08.378 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:08.377+0000 7f5c1e149680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:55:08.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:08.426+0000 7f873026c700 1 -- 172.21.15.1:0/293556746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f87280635f0 con 0x7f8728062f40 2023-11-15T02:55:08.453 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:08.453+0000 7f5c1e149680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:55:09.142 INFO:tasks.ceph.mon.a.smithi001.stderr:2023-11-15T02:55:09.141+0000 7f8072214700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-15T02:55:09.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.147+0000 7f871e7fc700 1 -- 172.21.15.1:0/293556746 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 97) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f87180775d0 con 0x7f8728062f40 2023-11-15T02:55:09.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.148+0000 7f871e7fc700 1 --2- 172.21.15.1:0/293556746 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f870c0302c0 0x7f870c0680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:09.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.148+0000 7f872d807700 1 --2- 172.21.15.1:0/293556746 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f870c0302c0 0x7f870c0680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:09.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.149+0000 7f872d807700 1 --2- 172.21.15.1:0/293556746 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f870c0302c0 0x7f870c0680e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8728062bb0 tx=0x7f8724017000).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:09.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.154+0000 7f871e7fc700 1 -- 172.21.15.1:0/293556746 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v88) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8718073810 con 0x7f8728062f40 2023-11-15T02:55:09.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.156+0000 7f873026c700 1 -- 172.21.15.1:0/293556746 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f870c0302c0 msgr2=0x7f870c0680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:09.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.156+0000 7f873026c700 1 --2- 172.21.15.1:0/293556746 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f870c0302c0 0x7f870c0680e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8728062bb0 tx=0x7f8724017000).stop 2023-11-15T02:55:09.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.156+0000 7f873026c700 1 -- 172.21.15.1:0/293556746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8728062f40 msgr2=0x7f8728140890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:09.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.156+0000 7f873026c700 1 --2- 172.21.15.1:0/293556746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8728062f40 0x7f8728140890 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f871800c4e0 tx=0x7f8718007c70).stop 2023-11-15T02:55:09.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.156+0000 7f873026c700 1 -- 172.21.15.1:0/293556746 shutdown_connections 2023-11-15T02:55:09.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.156+0000 7f873026c700 1 --2- 172.21.15.1:0/293556746 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f870c0302c0 0x7f870c0680e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:09.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.156+0000 7f873026c700 1 --2- 172.21.15.1:0/293556746 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8728150910 0x7f87280bbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:09.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.156+0000 7f873026c700 1 --2- 172.21.15.1:0/293556746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8728062f40 0x7f8728140890 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:09.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.156+0000 7f873026c700 1 --2- 172.21.15.1:0/293556746 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8728150530 0x7f87280be540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:09.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.156+0000 7f873026c700 1 -- 172.21.15.1:0/293556746 >> 172.21.15.1:0/293556746 conn(0x7f87280c74f0 msgr2=0x7f87280c2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:09.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.156+0000 7f873026c700 1 -- 172.21.15.1:0/293556746 shutdown_connections 2023-11-15T02:55:09.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.156+0000 7f873026c700 1 -- 172.21.15.1:0/293556746 wait complete. 2023-11-15T02:55:09.161 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-15T02:55:09.173 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-15T02:55:09.189 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T02:55:09.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.298+0000 7f5c1c7de700 1 Processor -- start 2023-11-15T02:55:09.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.298+0000 7f5c1c7de700 1 -- start start 2023-11-15T02:55:09.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.299+0000 7f5c1c7de700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c140c6920 0x7f5c140bca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:09.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.299+0000 7f5c1c7de700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c140c5480 con 0x7f5c140bc6a0 2023-11-15T02:55:09.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.299+0000 7f5c1c7de700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c140636a0 con 0x7f5c140a6bd0 2023-11-15T02:55:09.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.299+0000 7f5c1c7de700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c14063980 con 0x7f5c140c6920 2023-11-15T02:55:09.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.299+0000 7f5c1a57a700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5c140bc6a0 0x7f5c140a64c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59948/0 (socket says 172.21.15.1:59948) 2023-11-15T02:55:09.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.299+0000 7f5c1a57a700 1 -- 172.21.15.1:0/3036398014 learned_addr learned my addr 172.21.15.1:0/3036398014 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:09.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.300+0000 7f5c1ad7b700 1 --2- 172.21.15.1:0/3036398014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c140c6920 0x7f5c140bca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:09.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.300+0000 7f5c19578700 1 -- 172.21.15.1:0/3036398014 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692931265 0 0) 0x7f5c140c5480 con 0x7f5c140bc6a0 2023-11-15T02:55:09.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.300+0000 7f5c19578700 1 -- 172.21.15.1:0/3036398014 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c000033f0 con 0x7f5c140bc6a0 2023-11-15T02:55:09.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.300+0000 7f5c19578700 1 -- 172.21.15.1:0/3036398014 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520149189 0 0) 0x7f5c140636a0 con 0x7f5c140a6bd0 2023-11-15T02:55:09.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.300+0000 7f5c19578700 1 -- 172.21.15.1:0/3036398014 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c140c5480 con 0x7f5c140a6bd0 2023-11-15T02:55:09.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.300+0000 7f5c1ad7b700 1 -- 172.21.15.1:0/3036398014 >> v1:172.21.15.141:6789/0 conn(0x7f5c140a6bd0 legacy=0x7f5c141592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:09.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.300+0000 7f5c1ad7b700 1 -- 172.21.15.1:0/3036398014 >> v1:172.21.15.1:6789/0 conn(0x7f5c140bc6a0 legacy=0x7f5c140a64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:09.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.300+0000 7f5c1ad7b700 1 -- 172.21.15.1:0/3036398014 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c14063c60 con 0x7f5c140c6920 2023-11-15T02:55:09.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.300+0000 7f5c1ad7b700 1 --2- 172.21.15.1:0/3036398014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c140c6920 0x7f5c140bca80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f5c0c009ec0 tx=0x7f5c0c009780).ready entity=mon.2 client_cookie=47440b99eb9c7837 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:09.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.300+0000 7f5c19578700 1 -- 172.21.15.1:0/3036398014 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c00e070 con 0x7f5c140c6920 2023-11-15T02:55:09.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.300+0000 7f5c19578700 1 -- 172.21.15.1:0/3036398014 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c00bb40 con 0x7f5c140c6920 2023-11-15T02:55:09.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.300+0000 7f5c19578700 1 -- 172.21.15.1:0/3036398014 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c012410 con 0x7f5c140c6920 2023-11-15T02:55:09.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.301+0000 7f5c1c7de700 1 -- 172.21.15.1:0/3036398014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c140c6920 msgr2=0x7f5c140bca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:09.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.301+0000 7f5c1c7de700 1 --2- 172.21.15.1:0/3036398014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c140c6920 0x7f5c140bca80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f5c0c009ec0 tx=0x7f5c0c009780).stop 2023-11-15T02:55:09.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.301+0000 7f5c1c7de700 1 -- 172.21.15.1:0/3036398014 shutdown_connections 2023-11-15T02:55:09.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.301+0000 7f5c1c7de700 1 --2- 172.21.15.1:0/3036398014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c140c6920 0x7f5c140bca80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:09.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.301+0000 7f5c1c7de700 1 -- 172.21.15.1:0/3036398014 >> 172.21.15.1:0/3036398014 conn(0x7f5c140c8050 msgr2=0x7f5c140c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:09.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.301+0000 7f5c1c7de700 1 -- 172.21.15.1:0/3036398014 shutdown_connections 2023-11-15T02:55:09.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.301+0000 7f5c1c7de700 1 -- 172.21.15.1:0/3036398014 wait complete. 2023-11-15T02:55:09.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.302+0000 7f5c1c7de700 1 Processor -- start 2023-11-15T02:55:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.302+0000 7f5c1c7de700 1 -- start start 2023-11-15T02:55:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c1c7de700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c140a6bd0 0x7f5c141560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c1c7de700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c140bc6a0 0x7f5c140ac550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c1c7de700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c140c6920 0x7f5c1413a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c1c7de700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c141538e0 con 0x7f5c140bc6a0 2023-11-15T02:55:09.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c1c7de700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c140aca40 con 0x7f5c140a6bd0 2023-11-15T02:55:09.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c1c7de700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c14156760 con 0x7f5c140c6920 2023-11-15T02:55:09.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c19d79700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c140bc6a0 0x7f5c140ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:09.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c19d79700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c140bc6a0 0x7f5c140ac550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40930/0 (socket says 172.21.15.1:40930) 2023-11-15T02:55:09.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c19d79700 1 -- 172.21.15.1:0/219804619 learned_addr learned my addr 172.21.15.1:0/219804619 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:09.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c1ad7b700 1 --2- 172.21.15.1:0/219804619 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c140c6920 0x7f5c1413a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:09.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c1a57a700 1 --2- 172.21.15.1:0/219804619 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c140a6bd0 0x7f5c141560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:09.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c19d79700 1 -- 172.21.15.1:0/219804619 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c140c6920 msgr2=0x7f5c1413a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:09.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c19d79700 1 --2- 172.21.15.1:0/219804619 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c140c6920 0x7f5c1413a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:09.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c19d79700 1 -- 172.21.15.1:0/219804619 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c140a6bd0 msgr2=0x7f5c141560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c19d79700 1 --2- 172.21.15.1:0/219804619 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c140a6bd0 0x7f5c141560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c19d79700 1 -- 172.21.15.1:0/219804619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c009a20 con 0x7f5c140bc6a0 2023-11-15T02:55:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.303+0000 7f5c19d79700 1 --2- 172.21.15.1:0/219804619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c140bc6a0 0x7f5c140ac550 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f5c0400c4c0 tx=0x7f5c04007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.304+0000 7f5c0a7fc700 1 -- 172.21.15.1:0/219804619 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0400ce30 con 0x7f5c140bc6a0 2023-11-15T02:55:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.304+0000 7f5c0a7fc700 1 -- 172.21.15.1:0/219804619 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0400f470 con 0x7f5c140bc6a0 2023-11-15T02:55:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.304+0000 7f5c1c7de700 1 -- 172.21.15.1:0/219804619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c140a7a80 con 0x7f5c140bc6a0 2023-11-15T02:55:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.304+0000 7f5c0a7fc700 1 -- 172.21.15.1:0/219804619 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0400f830 con 0x7f5c140bc6a0 2023-11-15T02:55:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.304+0000 7f5c1c7de700 1 -- 172.21.15.1:0/219804619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c140a7430 con 0x7f5c140bc6a0 2023-11-15T02:55:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.305+0000 7f5c1c7de700 1 -- 172.21.15.1:0/219804619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1406c7e0 con 0x7f5c140bc6a0 2023-11-15T02:55:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.305+0000 7f5c0a7fc700 1 -- 172.21.15.1:0/219804619 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 97) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f5c0400fc20 con 0x7f5c140bc6a0 2023-11-15T02:55:09.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.305+0000 7f5c0a7fc700 1 --2- 172.21.15.1:0/219804619 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bf805f030 0x7f5bf80614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:09.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.305+0000 7f5c0a7fc700 1 -- 172.21.15.1:0/219804619 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 7275+0+0 (secure 0 0 0) 0x7f5c040797a0 con 0x7f5c140bc6a0 2023-11-15T02:55:09.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.306+0000 7f5c1a57a700 1 --2- 172.21.15.1:0/219804619 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bf805f030 0x7f5bf80614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:09.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.306+0000 7f5c1a57a700 1 --2- 172.21.15.1:0/219804619 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bf805f030 0x7f5bf80614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f5c10005750 tx=0x7f5c10009040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:09.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.309+0000 7f5c0a7fc700 1 -- 172.21.15.1:0/219804619 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5c04048af0 con 0x7f5c140bc6a0 2023-11-15T02:55:09.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:09.527+0000 7f5c1c7de700 1 -- 172.21.15.1:0/219804619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5c14063f40 con 0x7f5c140bc6a0 2023-11-15T02:55:10.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.161+0000 7f5c0a7fc700 1 -- 172.21.15.1:0/219804619 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v89) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5c0404a870 con 0x7f5c140bc6a0 2023-11-15T02:55:10.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.163+0000 7f5c1c7de700 1 -- 172.21.15.1:0/219804619 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bf805f030 msgr2=0x7f5bf80614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:10.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.164+0000 7f5c1c7de700 1 --2- 172.21.15.1:0/219804619 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bf805f030 0x7f5bf80614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f5c10005750 tx=0x7f5c10009040).stop 2023-11-15T02:55:10.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.164+0000 7f5c1c7de700 1 -- 172.21.15.1:0/219804619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c140bc6a0 msgr2=0x7f5c140ac550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:10.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.164+0000 7f5c1c7de700 1 --2- 172.21.15.1:0/219804619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c140bc6a0 0x7f5c140ac550 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f5c0400c4c0 tx=0x7f5c04007c40).stop 2023-11-15T02:55:10.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.164+0000 7f5c1c7de700 1 -- 172.21.15.1:0/219804619 shutdown_connections 2023-11-15T02:55:10.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.164+0000 7f5c1c7de700 1 --2- 172.21.15.1:0/219804619 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bf805f030 0x7f5bf80614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:10.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.164+0000 7f5c1c7de700 1 --2- 172.21.15.1:0/219804619 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c140c6920 0x7f5c1413a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:10.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.164+0000 7f5c1c7de700 1 --2- 172.21.15.1:0/219804619 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c140a6bd0 0x7f5c141560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:10.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.164+0000 7f5c1c7de700 1 --2- 172.21.15.1:0/219804619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c140bc6a0 0x7f5c140ac550 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:10.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.164+0000 7f5c1c7de700 1 -- 172.21.15.1:0/219804619 >> 172.21.15.1:0/219804619 conn(0x7f5c140c8050 msgr2=0x7f5c1413b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:10.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.164+0000 7f5c1c7de700 1 -- 172.21.15.1:0/219804619 shutdown_connections 2023-11-15T02:55:10.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.164+0000 7f5c1c7de700 1 -- 172.21.15.1:0/219804619 wait complete. 2023-11-15T02:55:10.179 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-15T02:55:10.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.306+0000 7f6ebf5ab700 1 Processor -- start 2023-11-15T02:55:10.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.306+0000 7f6ebf5ab700 1 -- start start 2023-11-15T02:55:10.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.307+0000 7f6ebf5ab700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6eb80c53b0 0x7f6eb80c3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:10.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.307+0000 7f6ebf5ab700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb80c7f50 0x7f6eb80c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:10.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.307+0000 7f6ebf5ab700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6eb80c88a0 0x7f6eb80bde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:10.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.307+0000 7f6ebf5ab700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb80c3a00 con 0x7f6eb80c88a0 2023-11-15T02:55:10.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.307+0000 7f6ebf5ab700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb80835c0 con 0x7f6eb80c53b0 2023-11-15T02:55:10.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.307+0000 7f6ebf5ab700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80c5790 con 0x7f6eb80c7f50 2023-11-15T02:55:10.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.307+0000 7f6ebdb48700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6eb80c88a0 0x7f6eb80bde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:10.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.307+0000 7f6ebdb48700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6eb80c88a0 0x7f6eb80bde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40932/0 (socket says 172.21.15.1:40932) 2023-11-15T02:55:10.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.307+0000 7f6ebdb48700 1 -- 172.21.15.1:0/1826423500 learned_addr learned my addr 172.21.15.1:0/1826423500 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:10.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.308+0000 7f6ebd347700 1 --2- 172.21.15.1:0/1826423500 >> v2:172.21.15.141:3300/0 conn(0x7f6eb80c53b0 0x7f6eb80c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:10.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.308+0000 7f6ebcb46700 1 --2- 172.21.15.1:0/1826423500 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb80c7f50 0x7f6eb80c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:10.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.308+0000 7f6ebdb48700 1 -- 172.21.15.1:0/1826423500 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb80c7f50 msgr2=0x7f6eb80c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:10.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.308+0000 7f6ebdb48700 1 --2- 172.21.15.1:0/1826423500 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb80c7f50 0x7f6eb80c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:10.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.308+0000 7f6ebdb48700 1 -- 172.21.15.1:0/1826423500 >> v2:172.21.15.141:3300/0 conn(0x7f6eb80c53b0 msgr2=0x7f6eb80c3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:10.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.308+0000 7f6ebdb48700 1 --2- 172.21.15.1:0/1826423500 >> v2:172.21.15.141:3300/0 conn(0x7f6eb80c53b0 0x7f6eb80c3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:10.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.308+0000 7f6ebdb48700 1 -- 172.21.15.1:0/1826423500 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb80c6eb0 con 0x7f6eb80c88a0 2023-11-15T02:55:10.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.308+0000 7f6ebd347700 1 --2- 172.21.15.1:0/1826423500 >> v2:172.21.15.141:3300/0 conn(0x7f6eb80c53b0 0x7f6eb80c3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:10.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.308+0000 7f6ebdb48700 1 --2- 172.21.15.1:0/1826423500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb80c88a0 0x7f6eb80bde70 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7f6eb806a5d0 tx=0x7f6ea8009840).ready entity=mon.0 client_cookie=5dbde716c626f867 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:10.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.308+0000 7f6eb7fff700 1 -- 172.21.15.1:0/1826423500 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea800e070 con 0x7f6eb80c88a0 2023-11-15T02:55:10.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.308+0000 7f6eb7fff700 1 -- 172.21.15.1:0/1826423500 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea800bae0 con 0x7f6eb80c88a0 2023-11-15T02:55:10.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.308+0000 7f6eb7fff700 1 -- 172.21.15.1:0/1826423500 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea800be60 con 0x7f6eb80c88a0 2023-11-15T02:55:10.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.309+0000 7f6ebf5ab700 1 -- 172.21.15.1:0/1826423500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb80c88a0 msgr2=0x7f6eb80bde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:10.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.309+0000 7f6ebf5ab700 1 --2- 172.21.15.1:0/1826423500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb80c88a0 0x7f6eb80bde70 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7f6eb806a5d0 tx=0x7f6ea8009840).stop 2023-11-15T02:55:10.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.309+0000 7f6ebf5ab700 1 -- 172.21.15.1:0/1826423500 shutdown_connections 2023-11-15T02:55:10.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.309+0000 7f6ebf5ab700 1 --2- 172.21.15.1:0/1826423500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb80c88a0 0x7f6eb80bde70 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:10.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.309+0000 7f6ebf5ab700 1 --2- 172.21.15.1:0/1826423500 >> v2:172.21.15.141:3300/0 conn(0x7f6eb80c53b0 0x7f6eb80c3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:10.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.309+0000 7f6ebf5ab700 1 --2- 172.21.15.1:0/1826423500 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb80c7f50 0x7f6eb80c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:10.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.309+0000 7f6ebf5ab700 1 -- 172.21.15.1:0/1826423500 >> 172.21.15.1:0/1826423500 conn(0x7f6eb8082f90 msgr2=0x7f6eb80c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:10.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.309+0000 7f6ebf5ab700 1 -- 172.21.15.1:0/1826423500 shutdown_connections 2023-11-15T02:55:10.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.309+0000 7f6ebf5ab700 1 -- 172.21.15.1:0/1826423500 wait complete. 2023-11-15T02:55:10.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.310+0000 7f6ebf5ab700 1 Processor -- start 2023-11-15T02:55:10.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.310+0000 7f6ebf5ab700 1 -- start start 2023-11-15T02:55:10.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebf5ab700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb80c53b0 0x7f6eb80ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:10.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebf5ab700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6eb80c7f50 0x7f6eb80c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:10.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebf5ab700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb80c88a0 0x7f6eb80c0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:10.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebf5ab700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80c17c0 con 0x7f6eb80c88a0 2023-11-15T02:55:10.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebf5ab700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80c0050 con 0x7f6eb80c7f50 2023-11-15T02:55:10.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebf5ab700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80c0fe0 con 0x7f6eb80c53b0 2023-11-15T02:55:10.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebdb48700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb80c88a0 0x7f6eb80c0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:10.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebdb48700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb80c88a0 0x7f6eb80c0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40944/0 (socket says 172.21.15.1:40944) 2023-11-15T02:55:10.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebdb48700 1 -- 172.21.15.1:0/4254001316 learned_addr learned my addr 172.21.15.1:0/4254001316 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:10.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebd347700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb80c53b0 0x7f6eb80ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:10.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebcb46700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6eb80c7f50 0x7f6eb80c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:10.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebdb48700 1 -- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb80c53b0 msgr2=0x7f6eb80ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:10.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebdb48700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb80c53b0 0x7f6eb80ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:10.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebdb48700 1 -- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6eb80c7f50 msgr2=0x7f6eb80c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:10.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebdb48700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6eb80c7f50 0x7f6eb80c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:10.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebdb48700 1 -- 172.21.15.1:0/4254001316 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea8009ae0 con 0x7f6eb80c88a0 2023-11-15T02:55:10.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebcb46700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6eb80c7f50 0x7f6eb80c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:10.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebd347700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb80c53b0 0x7f6eb80ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:10.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6ebdb48700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb80c88a0 0x7f6eb80c0af0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7f6ea8009590 tx=0x7f6ea8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:10.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.311+0000 7f6eb57fa700 1 -- 172.21.15.1:0/4254001316 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea80092e0 con 0x7f6eb80c88a0 2023-11-15T02:55:10.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.312+0000 7f6eb57fa700 1 -- 172.21.15.1:0/4254001316 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea8007610 con 0x7f6eb80c88a0 2023-11-15T02:55:10.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.312+0000 7f6ebf5ab700 1 -- 172.21.15.1:0/4254001316 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb80c1a40 con 0x7f6eb80c88a0 2023-11-15T02:55:10.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.312+0000 7f6eb57fa700 1 -- 172.21.15.1:0/4254001316 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea80079d0 con 0x7f6eb80c88a0 2023-11-15T02:55:10.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.312+0000 7f6ebf5ab700 1 -- 172.21.15.1:0/4254001316 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb80c05d0 con 0x7f6eb80c88a0 2023-11-15T02:55:10.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.313+0000 7f6ebf5ab700 1 -- 172.21.15.1:0/4254001316 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb806c7e0 con 0x7f6eb80c88a0 2023-11-15T02:55:10.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.313+0000 7f6eb57fa700 1 -- 172.21.15.1:0/4254001316 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 97) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f6ea8003040 con 0x7f6eb80c88a0 2023-11-15T02:55:10.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.313+0000 7f6eb57fa700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6ea405f030 0x7f6ea40614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:10.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.313+0000 7f6eb57fa700 1 -- 172.21.15.1:0/4254001316 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 7275+0+0 (secure 0 0 0) 0x7f6ea807c1f0 con 0x7f6eb80c88a0 2023-11-15T02:55:10.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.314+0000 7f6ebd347700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6ea405f030 0x7f6ea40614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:10.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.314+0000 7f6ebd347700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6ea405f030 0x7f6ea40614f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6eb0006fd0 tx=0x7f6eb0008040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:10.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.318+0000 7f6eb57fa700 1 -- 172.21.15.1:0/4254001316 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6ea804d210 con 0x7f6eb80c88a0 2023-11-15T02:55:10.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.490+0000 7f6ebf5ab700 1 -- 172.21.15.1:0/4254001316 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6eb80833a0 con 0x7f6eb80c88a0 2023-11-15T02:55:10.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:10.965+0000 7f6eb57fa700 1 -- 172.21.15.1:0/4254001316 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6ea8079d10 con 0x7f6eb80c88a0 2023-11-15T02:55:11.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.163+0000 7f6eb57fa700 1 -- 172.21.15.1:0/4254001316 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v202) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6ea8042da0 con 0x7f6eb80c88a0 2023-11-15T02:55:11.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.167+0000 7f6ebf5ab700 1 -- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6ea405f030 msgr2=0x7f6ea40614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:11.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.167+0000 7f6ebf5ab700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6ea405f030 0x7f6ea40614f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6eb0006fd0 tx=0x7f6eb0008040).stop 2023-11-15T02:55:11.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.167+0000 7f6ebf5ab700 1 -- 172.21.15.1:0/4254001316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb80c88a0 msgr2=0x7f6eb80c0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:11.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.167+0000 7f6ebf5ab700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb80c88a0 0x7f6eb80c0af0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7f6ea8009590 tx=0x7f6ea8009840).stop 2023-11-15T02:55:11.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.167+0000 7f6ebf5ab700 1 -- 172.21.15.1:0/4254001316 shutdown_connections 2023-11-15T02:55:11.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.167+0000 7f6ebf5ab700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6ea405f030 0x7f6ea40614f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:11.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.168+0000 7f6ebf5ab700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eb80c88a0 0x7f6eb80c0af0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:11.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.168+0000 7f6ebf5ab700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6eb80c53b0 0x7f6eb80ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:11.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.168+0000 7f6ebf5ab700 1 --2- 172.21.15.1:0/4254001316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6eb80c7f50 0x7f6eb80c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:11.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.168+0000 7f6ebf5ab700 1 -- 172.21.15.1:0/4254001316 >> 172.21.15.1:0/4254001316 conn(0x7f6eb8082f90 msgr2=0x7f6eb80c59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:11.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.169+0000 7f6ebf5ab700 1 -- 172.21.15.1:0/4254001316 shutdown_connections 2023-11-15T02:55:11.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.169+0000 7f6ebf5ab700 1 -- 172.21.15.1:0/4254001316 wait complete. 2023-11-15T02:55:11.171 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2023-11-15T02:55:11.184 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-15T02:55:11.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.308+0000 7f75fe5ce700 1 Processor -- start 2023-11-15T02:55:11.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.308+0000 7f75fe5ce700 1 -- start start 2023-11-15T02:55:11.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.309+0000 7f75fe5ce700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f75f814b350 0x7f75f80c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:11.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.309+0000 7f75fe5ce700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75f814b730 0x7f75f8154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:11.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.309+0000 7f75fe5ce700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f81580d0 con 0x7f75f80aa040 2023-11-15T02:55:11.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.309+0000 7f75fe5ce700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f8155000 con 0x7f75f814b350 2023-11-15T02:55:11.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.309+0000 7f75fe5ce700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f81552e0 con 0x7f75f814b730 2023-11-15T02:55:11.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.309+0000 7f75f7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f75f814b350 0x7f75f80c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:11.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.309+0000 7f75f7fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f75f814b350 0x7f75f80c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40958/0 (socket says 172.21.15.1:40958) 2023-11-15T02:55:11.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.309+0000 7f75f7fff700 1 -- 172.21.15.1:0/1097305235 learned_addr learned my addr 172.21.15.1:0/1097305235 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:11.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.310+0000 7f75f77fe700 1 --2- 172.21.15.1:0/1097305235 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75f814b730 0x7f75f8154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:11.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.310+0000 7f75f7fff700 1 -- 172.21.15.1:0/1097305235 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75f814b730 msgr2=0x7f75f8154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:11.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.310+0000 7f75f7fff700 1 --2- 172.21.15.1:0/1097305235 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75f814b730 0x7f75f8154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:11.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.310+0000 7f75f7fff700 1 -- 172.21.15.1:0/1097305235 >> v1:172.21.15.141:6789/0 conn(0x7f75f80aa040 legacy=0x7f75f8158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.310+0000 7f75f7fff700 1 -- 172.21.15.1:0/1097305235 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f81555c0 con 0x7f75f814b350 2023-11-15T02:55:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.310+0000 7f75f7fff700 1 --2- 172.21.15.1:0/1097305235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f814b350 0x7f75f80c8290 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7f75e8006fd0 tx=0x7f75e80090f0).ready entity=mon.0 client_cookie=e7b7e47e951887e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.310+0000 7f75f6ffd700 1 -- 172.21.15.1:0/1097305235 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e800b600 con 0x7f75f814b350 2023-11-15T02:55:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.310+0000 7f75f6ffd700 1 -- 172.21.15.1:0/1097305235 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e800b760 con 0x7f75f814b350 2023-11-15T02:55:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.310+0000 7f75f6ffd700 1 -- 172.21.15.1:0/1097305235 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e800bae0 con 0x7f75f814b350 2023-11-15T02:55:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.310+0000 7f75fe5ce700 1 -- 172.21.15.1:0/1097305235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f814b350 msgr2=0x7f75f80c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.310+0000 7f75fe5ce700 1 --2- 172.21.15.1:0/1097305235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f814b350 0x7f75f80c8290 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7f75e8006fd0 tx=0x7f75e80090f0).stop 2023-11-15T02:55:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.310+0000 7f75fe5ce700 1 -- 172.21.15.1:0/1097305235 shutdown_connections 2023-11-15T02:55:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.310+0000 7f75fe5ce700 1 --2- 172.21.15.1:0/1097305235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f814b350 0x7f75f80c8290 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.310+0000 7f75fe5ce700 1 --2- 172.21.15.1:0/1097305235 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75f814b730 0x7f75f8154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.310+0000 7f75fe5ce700 1 -- 172.21.15.1:0/1097305235 >> 172.21.15.1:0/1097305235 conn(0x7f75f8069ee0 msgr2=0x7f75f806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.311+0000 7f75fe5ce700 1 -- 172.21.15.1:0/1097305235 shutdown_connections 2023-11-15T02:55:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.311+0000 7f75fe5ce700 1 -- 172.21.15.1:0/1097305235 wait complete. 2023-11-15T02:55:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.312+0000 7f75fe5ce700 1 Processor -- start 2023-11-15T02:55:11.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.312+0000 7f75fe5ce700 1 -- start start 2023-11-15T02:55:11.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75fe5ce700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75f80aa040 0x7f75f8144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75fe5ce700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f814b350 0x7f75f8149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75fe5ce700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75f814b730 0x7f75f814a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75fe5ce700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f814a560 con 0x7f75f814b350 2023-11-15T02:55:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75fe5ce700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80c2f50 con 0x7f75f814b730 2023-11-15T02:55:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75fe5ce700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80c4810 con 0x7f75f80aa040 2023-11-15T02:55:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f814b350 0x7f75f8149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f814b350 0x7f75f8149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40968/0 (socket says 172.21.15.1:40968) 2023-11-15T02:55:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75f77fe700 1 -- 172.21.15.1:0/2276326539 learned_addr learned my addr 172.21.15.1:0/2276326539 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75f77fe700 1 -- 172.21.15.1:0/2276326539 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75f80aa040 msgr2=0x7f75f8144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75f77fe700 1 --2- 172.21.15.1:0/2276326539 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75f80aa040 0x7f75f8144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75f77fe700 1 -- 172.21.15.1:0/2276326539 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75f814b730 msgr2=0x7f75f814a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75fcb6b700 1 --2- 172.21.15.1:0/2276326539 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75f814b730 0x7f75f814a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75f77fe700 1 --2- 172.21.15.1:0/2276326539 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75f814b730 0x7f75f814a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:11.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75f77fe700 1 -- 172.21.15.1:0/2276326539 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e8009370 con 0x7f75f814b350 2023-11-15T02:55:11.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75f77fe700 1 --2- 172.21.15.1:0/2276326539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f814b350 0x7f75f8149b80 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f75e000d890 tx=0x7f75e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:11.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75effff700 1 -- 172.21.15.1:0/2276326539 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e00125f0 con 0x7f75f814b350 2023-11-15T02:55:11.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75effff700 1 -- 172.21.15.1:0/2276326539 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e0012750 con 0x7f75f814b350 2023-11-15T02:55:11.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75fe5ce700 1 -- 172.21.15.1:0/2276326539 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f80c33e0 con 0x7f75f814b350 2023-11-15T02:55:11.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75effff700 1 -- 172.21.15.1:0/2276326539 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0012ad0 con 0x7f75f814b350 2023-11-15T02:55:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.313+0000 7f75fe5ce700 1 -- 172.21.15.1:0/2276326539 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f80c2620 con 0x7f75f814b350 2023-11-15T02:55:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.314+0000 7f75fe5ce700 1 -- 172.21.15.1:0/2276326539 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f806c7e0 con 0x7f75f814b350 2023-11-15T02:55:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.315+0000 7f75effff700 1 -- 172.21.15.1:0/2276326539 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f75e0013480 con 0x7f75f814b350 2023-11-15T02:55:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.315+0000 7f75effff700 1 --2- 172.21.15.1:0/2276326539 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f75d805f270 0x7f75d8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:11.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.315+0000 7f75effff700 1 -- 172.21.15.1:0/2276326539 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6837+0+0 (secure 0 0 0) 0x7f75e007a3d0 con 0x7f75f814b350 2023-11-15T02:55:11.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.315+0000 7f75f7fff700 1 --2- 172.21.15.1:0/2276326539 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f75d805f270 0x7f75d8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:11.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.316+0000 7f75f7fff700 1 --2- 172.21.15.1:0/2276326539 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f75d805f270 0x7f75d8061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f75e8009130 tx=0x7f75e8017000).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:11.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.319+0000 7f75effff700 1 -- 172.21.15.1:0/2276326539 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f75e004b1f0 con 0x7f75f814b350 2023-11-15T02:55:11.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:11.499+0000 7f75fe5ce700 1 -- 172.21.15.1:0/2276326539 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f75f80c30c0 con 0x7f75f814b350 2023-11-15T02:55:12.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.165+0000 7f75effff700 1 -- 172.21.15.1:0/2276326539 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v203) v1 ==== 169+0+0 (secure 0 0 0) 0x7f75e004e810 con 0x7f75f814b350 2023-11-15T02:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.169+0000 7f75fe5ce700 1 -- 172.21.15.1:0/2276326539 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f75d805f270 msgr2=0x7f75d8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.169+0000 7f75fe5ce700 1 --2- 172.21.15.1:0/2276326539 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f75d805f270 0x7f75d8061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f75e8009130 tx=0x7f75e8017000).stop 2023-11-15T02:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.169+0000 7f75fe5ce700 1 -- 172.21.15.1:0/2276326539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f814b350 msgr2=0x7f75f8149b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.169+0000 7f75fe5ce700 1 --2- 172.21.15.1:0/2276326539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f814b350 0x7f75f8149b80 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f75e000d890 tx=0x7f75e0008040).stop 2023-11-15T02:55:12.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.170+0000 7f75fe5ce700 1 -- 172.21.15.1:0/2276326539 shutdown_connections 2023-11-15T02:55:12.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.170+0000 7f75fe5ce700 1 --2- 172.21.15.1:0/2276326539 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f75d805f270 0x7f75d8061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.170+0000 7f75fe5ce700 1 --2- 172.21.15.1:0/2276326539 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75f814b730 0x7f75f814a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.170+0000 7f75fe5ce700 1 --2- 172.21.15.1:0/2276326539 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75f80aa040 0x7f75f8144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:12.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.170+0000 7f75fe5ce700 1 --2- 172.21.15.1:0/2276326539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f814b350 0x7f75f8149b80 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.170+0000 7f75fe5ce700 1 -- 172.21.15.1:0/2276326539 >> 172.21.15.1:0/2276326539 conn(0x7f75f8069ee0 msgr2=0x7f75f8156ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:12.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.171+0000 7f75fe5ce700 1 -- 172.21.15.1:0/2276326539 shutdown_connections 2023-11-15T02:55:12.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.171+0000 7f75fe5ce700 1 -- 172.21.15.1:0/2276326539 wait complete. 2023-11-15T02:55:12.175 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2023-11-15T02:55:12.190 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-15T02:55:12.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.313+0000 7f92a2956700 1 Processor -- start 2023-11-15T02:55:12.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.313+0000 7f92a2956700 1 -- start start 2023-11-15T02:55:12.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a2956700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f929c1541d0 0x7f929c1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a2956700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929c0c60d0 0x7f929c0c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a2956700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f929c0c7a60 0x7f929c0c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a2956700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c158f40 con 0x7f929c1541d0 2023-11-15T02:55:12.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a2956700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c155830 con 0x7f929c0c7a60 2023-11-15T02:55:12.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a2956700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0c83a0 con 0x7f929c0c60d0 2023-11-15T02:55:12.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a1954700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f929c1541d0 0x7f929c1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a1954700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f929c1541d0 0x7f929c1545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40978/0 (socket says 172.21.15.1:40978) 2023-11-15T02:55:12.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a1954700 1 -- 172.21.15.1:0/4107951705 learned_addr learned my addr 172.21.15.1:0/4107951705 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:12.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a2155700 1 --2- 172.21.15.1:0/4107951705 >> v2:172.21.15.141:3300/0 conn(0x7f929c0c7a60 0x7f929c0c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a1153700 1 --2- 172.21.15.1:0/4107951705 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929c0c60d0 0x7f929c0c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a1954700 1 -- 172.21.15.1:0/4107951705 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929c0c60d0 msgr2=0x7f929c0c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a1954700 1 --2- 172.21.15.1:0/4107951705 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929c0c60d0 0x7f929c0c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a1954700 1 -- 172.21.15.1:0/4107951705 >> v2:172.21.15.141:3300/0 conn(0x7f929c0c7a60 msgr2=0x7f929c0c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a1954700 1 --2- 172.21.15.1:0/4107951705 >> v2:172.21.15.141:3300/0 conn(0x7f929c0c7a60 0x7f929c0c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a1954700 1 -- 172.21.15.1:0/4107951705 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c154c20 con 0x7f929c1541d0 2023-11-15T02:55:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a1954700 1 --2- 172.21.15.1:0/4107951705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f929c1541d0 0x7f929c1545b0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7f929c0cb0d0 tx=0x7f928c009840).ready entity=mon.0 client_cookie=1186329f3cb2943c server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.314+0000 7f92a0952700 1 -- 172.21.15.1:0/4107951705 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c00e070 con 0x7f929c1541d0 2023-11-15T02:55:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.315+0000 7f92a0952700 1 -- 172.21.15.1:0/4107951705 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928c00ba50 con 0x7f929c1541d0 2023-11-15T02:55:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.315+0000 7f92a0952700 1 -- 172.21.15.1:0/4107951705 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c00bdd0 con 0x7f929c1541d0 2023-11-15T02:55:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.315+0000 7f92a2956700 1 -- 172.21.15.1:0/4107951705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f929c1541d0 msgr2=0x7f929c1545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.315+0000 7f92a2956700 1 --2- 172.21.15.1:0/4107951705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f929c1541d0 0x7f929c1545b0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7f929c0cb0d0 tx=0x7f928c009840).stop 2023-11-15T02:55:12.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.315+0000 7f92a2956700 1 -- 172.21.15.1:0/4107951705 shutdown_connections 2023-11-15T02:55:12.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.315+0000 7f92a2956700 1 --2- 172.21.15.1:0/4107951705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f929c1541d0 0x7f929c1545b0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.315+0000 7f92a2956700 1 --2- 172.21.15.1:0/4107951705 >> v2:172.21.15.141:3300/0 conn(0x7f929c0c7a60 0x7f929c0c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.315+0000 7f92a2956700 1 --2- 172.21.15.1:0/4107951705 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929c0c60d0 0x7f929c0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.315+0000 7f92a2956700 1 -- 172.21.15.1:0/4107951705 >> 172.21.15.1:0/4107951705 conn(0x7f929c069ee0 msgr2=0x7f929c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:12.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.315+0000 7f92a2956700 1 -- 172.21.15.1:0/4107951705 shutdown_connections 2023-11-15T02:55:12.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.315+0000 7f92a2956700 1 -- 172.21.15.1:0/4107951705 wait complete. 2023-11-15T02:55:12.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.316+0000 7f92a2956700 1 Processor -- start 2023-11-15T02:55:12.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.316+0000 7f92a2956700 1 -- start start 2023-11-15T02:55:12.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a2956700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f929c0c60d0 0x7f929c1527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a2956700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f929c0c7a60 0x7f929c0ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a2956700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929c1541d0 0x7f929c0c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a2956700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0a9db0 con 0x7f929c0c7a60 2023-11-15T02:55:12.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a2956700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c155cf0 con 0x7f929c0c60d0 2023-11-15T02:55:12.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a2956700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0af2e0 con 0x7f929c1541d0 2023-11-15T02:55:12.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a1153700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f929c0c7a60 0x7f929c0ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a1153700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f929c0c7a60 0x7f929c0ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40992/0 (socket says 172.21.15.1:40992) 2023-11-15T02:55:12.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a1153700 1 -- 172.21.15.1:0/1215668323 learned_addr learned my addr 172.21.15.1:0/1215668323 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:12.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a1954700 1 --2- 172.21.15.1:0/1215668323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f929c0c60d0 0x7f929c1527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a2155700 1 --2- 172.21.15.1:0/1215668323 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929c1541d0 0x7f929c0c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a1153700 1 -- 172.21.15.1:0/1215668323 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929c1541d0 msgr2=0x7f929c0c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a1153700 1 --2- 172.21.15.1:0/1215668323 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929c1541d0 0x7f929c0c4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a1153700 1 -- 172.21.15.1:0/1215668323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f929c0c60d0 msgr2=0x7f929c1527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a1153700 1 --2- 172.21.15.1:0/1215668323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f929c0c60d0 0x7f929c1527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a1153700 1 -- 172.21.15.1:0/1215668323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c009ae0 con 0x7f929c0c7a60 2023-11-15T02:55:12.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a1954700 1 --2- 172.21.15.1:0/1215668323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f929c0c60d0 0x7f929c1527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:12.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.317+0000 7f92a1153700 1 --2- 172.21.15.1:0/1215668323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f929c0c7a60 0x7f929c0ae0d0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7f929000d890 tx=0x7f9290008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:12.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.318+0000 7f9299ffb700 1 -- 172.21.15.1:0/1215668323 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92900125f0 con 0x7f929c0c7a60 2023-11-15T02:55:12.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.318+0000 7f9299ffb700 1 -- 172.21.15.1:0/1215668323 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9290012750 con 0x7f929c0c7a60 2023-11-15T02:55:12.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.318+0000 7f92a2956700 1 -- 172.21.15.1:0/1215668323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929c0aea40 con 0x7f929c0c7a60 2023-11-15T02:55:12.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.318+0000 7f9299ffb700 1 -- 172.21.15.1:0/1215668323 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9290012ad0 con 0x7f929c0c7a60 2023-11-15T02:55:12.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.318+0000 7f92a2956700 1 -- 172.21.15.1:0/1215668323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c0af000 con 0x7f929c0c7a60 2023-11-15T02:55:12.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.319+0000 7f92a2956700 1 -- 172.21.15.1:0/1215668323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929c155e60 con 0x7f929c0c7a60 2023-11-15T02:55:12.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.319+0000 7f9299ffb700 1 -- 172.21.15.1:0/1215668323 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9290013480 con 0x7f929c0c7a60 2023-11-15T02:55:12.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.319+0000 7f9299ffb700 1 --2- 172.21.15.1:0/1215668323 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f928805f270 0x7f9288061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.319+0000 7f9299ffb700 1 -- 172.21.15.1:0/1215668323 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6423+0+0 (secure 0 0 0) 0x7f929007a340 con 0x7f929c0c7a60 2023-11-15T02:55:12.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.320+0000 7f92a1954700 1 --2- 172.21.15.1:0/1215668323 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f928805f270 0x7f9288061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.320+0000 7f92a1954700 1 --2- 172.21.15.1:0/1215668323 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f928805f270 0x7f9288061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f928c00ba20 tx=0x7f928c009840).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:12.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.324+0000 7f9299ffb700 1 -- 172.21.15.1:0/1215668323 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f929c155e60 con 0x7f929c0c7a60 2023-11-15T02:55:12.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.506+0000 7f92a2956700 1 -- 172.21.15.1:0/1215668323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f929c155e60 con 0x7f929c0c7a60 2023-11-15T02:55:12.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.509+0000 7f9299ffb700 1 -- 172.21.15.1:0/1215668323 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7f929c155e60 con 0x7f929c0c7a60 2023-11-15T02:55:12.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.511+0000 7f92a2956700 1 -- 172.21.15.1:0/1215668323 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f928805f270 msgr2=0x7f9288061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.511+0000 7f92a2956700 1 --2- 172.21.15.1:0/1215668323 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f928805f270 0x7f9288061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f928c00ba20 tx=0x7f928c009840).stop 2023-11-15T02:55:12.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.511+0000 7f92a2956700 1 -- 172.21.15.1:0/1215668323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f929c0c7a60 msgr2=0x7f929c0ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.511+0000 7f92a2956700 1 --2- 172.21.15.1:0/1215668323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f929c0c7a60 0x7f929c0ae0d0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7f929000d890 tx=0x7f9290008040).stop 2023-11-15T02:55:12.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.511+0000 7f92a2956700 1 -- 172.21.15.1:0/1215668323 shutdown_connections 2023-11-15T02:55:12.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.511+0000 7f92a2956700 1 --2- 172.21.15.1:0/1215668323 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f928805f270 0x7f9288061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.511+0000 7f92a2956700 1 --2- 172.21.15.1:0/1215668323 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f929c1541d0 0x7f929c0c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.511+0000 7f92a2956700 1 --2- 172.21.15.1:0/1215668323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f929c0c60d0 0x7f929c1527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.511+0000 7f92a2956700 1 --2- 172.21.15.1:0/1215668323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f929c0c7a60 0x7f929c0ae0d0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.511+0000 7f92a2956700 1 -- 172.21.15.1:0/1215668323 >> 172.21.15.1:0/1215668323 conn(0x7f929c069ee0 msgr2=0x7f929c0aa320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:12.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.511+0000 7f92a2956700 1 -- 172.21.15.1:0/1215668323 shutdown_connections 2023-11-15T02:55:12.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.511+0000 7f92a2956700 1 -- 172.21.15.1:0/1215668323 wait complete. 2023-11-15T02:55:12.524 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-15T02:55:12.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.644+0000 7f3ca2213700 1 Processor -- start 2023-11-15T02:55:12.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.644+0000 7f3ca2213700 1 -- start start 2023-11-15T02:55:12.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.645+0000 7f3ca2213700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c9c0c4900 0x7f3c9c0c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.645+0000 7f3ca2213700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3c9c0c1ee0 0x7f3c9c0a6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.645+0000 7f3ca2213700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c9c0a4870 con 0x7f3c9c1576c0 2023-11-15T02:55:12.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.645+0000 7f3ca2213700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9c0c2640 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.645+0000 7f3ca2213700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c0a50f0 con 0x7f3c9c0c4900 2023-11-15T02:55:12.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.645+0000 7f3c9bfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3c9c0c1ee0 0x7f3c9c0a6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.645+0000 7f3c9bfff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3c9c0c1ee0 0x7f3c9c0a6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41000/0 (socket says 172.21.15.1:41000) 2023-11-15T02:55:12.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.645+0000 7f3c9bfff700 1 -- 172.21.15.1:0/1762762121 learned_addr learned my addr 172.21.15.1:0/1762762121 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:12.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.645+0000 7f3c9affd700 1 --2- 172.21.15.1:0/1762762121 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c9c0c4900 0x7f3c9c0c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.645+0000 7f3c9bfff700 1 -- 172.21.15.1:0/1762762121 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c9c0c4900 msgr2=0x7f3c9c0c19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:12.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.645+0000 7f3c9bfff700 1 --2- 172.21.15.1:0/1762762121 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c9c0c4900 0x7f3c9c0c19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.645+0000 7f3c9bfff700 1 -- 172.21.15.1:0/1762762121 >> v1:172.21.15.141:6789/0 conn(0x7f3c9c1576c0 legacy=0x7f3c9c0a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:12.650 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.645+0000 7f3c9bfff700 1 -- 172.21.15.1:0/1762762121 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c0a5c90 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.645+0000 7f3c9bfff700 1 --2- 172.21.15.1:0/1762762121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c9c0c1ee0 0x7f3c9c0a6050 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f3c94009f20 tx=0x7f3c94009840).ready entity=mon.0 client_cookie=c7f006299e8d271 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:12.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.646+0000 7f3c9a7fc700 1 -- 172.21.15.1:0/1762762121 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9400e070 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.646+0000 7f3c9a7fc700 1 -- 172.21.15.1:0/1762762121 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9400ba40 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.646+0000 7f3c9a7fc700 1 -- 172.21.15.1:0/1762762121 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9400bdc0 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.646+0000 7f3ca2213700 1 -- 172.21.15.1:0/1762762121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c9c0c1ee0 msgr2=0x7f3c9c0a6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.646+0000 7f3ca2213700 1 --2- 172.21.15.1:0/1762762121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c9c0c1ee0 0x7f3c9c0a6050 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f3c94009f20 tx=0x7f3c94009840).stop 2023-11-15T02:55:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.646+0000 7f3ca2213700 1 -- 172.21.15.1:0/1762762121 shutdown_connections 2023-11-15T02:55:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.646+0000 7f3ca2213700 1 --2- 172.21.15.1:0/1762762121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c9c0c1ee0 0x7f3c9c0a6050 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.646+0000 7f3ca2213700 1 --2- 172.21.15.1:0/1762762121 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c9c0c4900 0x7f3c9c0c19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.646+0000 7f3ca2213700 1 -- 172.21.15.1:0/1762762121 >> 172.21.15.1:0/1762762121 conn(0x7f3c9c0c7c10 msgr2=0x7f3c9c0c3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.646+0000 7f3ca2213700 1 -- 172.21.15.1:0/1762762121 shutdown_connections 2023-11-15T02:55:12.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.646+0000 7f3ca2213700 1 -- 172.21.15.1:0/1762762121 wait complete. 2023-11-15T02:55:12.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.647+0000 7f3ca2213700 1 Processor -- start 2023-11-15T02:55:12.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.647+0000 7f3ca2213700 1 -- start start 2023-11-15T02:55:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.648+0000 7f3ca2213700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c9c0c1ee0 0x7f3c9c0acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.648+0000 7f3ca2213700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c9c0c4900 0x7f3c9c14fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.648+0000 7f3ca2213700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c9c1576c0 0x7f3c9c0c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.648+0000 7f3ca2213700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c0abb20 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.648+0000 7f3ca2213700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c0ac6a0 con 0x7f3c9c1576c0 2023-11-15T02:55:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.648+0000 7f3ca2213700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c0abd70 con 0x7f3c9c0c4900 2023-11-15T02:55:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.648+0000 7f3c9b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c9c0c1ee0 0x7f3c9c0acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.648+0000 7f3c9b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c9c0c1ee0 0x7f3c9c0acb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41012/0 (socket says 172.21.15.1:41012) 2023-11-15T02:55:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.648+0000 7f3c9b7fe700 1 -- 172.21.15.1:0/3893238911 learned_addr learned my addr 172.21.15.1:0/3893238911 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.648+0000 7f3c9bfff700 1 --2- 172.21.15.1:0/3893238911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c9c1576c0 0x7f3c9c0c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.648+0000 7f3c9affd700 1 --2- 172.21.15.1:0/3893238911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c9c0c4900 0x7f3c9c14fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.649+0000 7f3c9b7fe700 1 -- 172.21.15.1:0/3893238911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c9c0c4900 msgr2=0x7f3c9c14fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.649+0000 7f3c9b7fe700 1 --2- 172.21.15.1:0/3893238911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c9c0c4900 0x7f3c9c14fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.649+0000 7f3c9b7fe700 1 -- 172.21.15.1:0/3893238911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c9c1576c0 msgr2=0x7f3c9c0c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.649+0000 7f3c9b7fe700 1 --2- 172.21.15.1:0/3893238911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c9c1576c0 0x7f3c9c0c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.649+0000 7f3c9b7fe700 1 -- 172.21.15.1:0/3893238911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c94009ae0 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.649+0000 7f3c9affd700 1 --2- 172.21.15.1:0/3893238911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c9c0c4900 0x7f3c9c14fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.649+0000 7f3c9b7fe700 1 --2- 172.21.15.1:0/3893238911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c9c0c1ee0 0x7f3c9c0acb30 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7f3c8c00b490 tx=0x7f3c8c006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.649+0000 7f3c837fe700 1 -- 172.21.15.1:0/3893238911 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c012410 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.649+0000 7f3c837fe700 1 -- 172.21.15.1:0/3893238911 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c012590 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.649+0000 7f3ca2213700 1 -- 172.21.15.1:0/3893238911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9c0ac050 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.649+0000 7f3c837fe700 1 -- 172.21.15.1:0/3893238911 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c012950 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.649+0000 7f3ca2213700 1 -- 172.21.15.1:0/3893238911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9c0ad020 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.650+0000 7f3ca2213700 1 -- 172.21.15.1:0/3893238911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9c06c7e0 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.650+0000 7f3c837fe700 1 -- 172.21.15.1:0/3893238911 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3c8c012d00 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.651+0000 7f3c837fe700 1 --2- 172.21.15.1:0/3893238911 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f3c8805f270 0x7f3c88061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.651+0000 7f3c837fe700 1 -- 172.21.15.1:0/3893238911 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6423+0+0 (secure 0 0 0) 0x7f3c8c07a370 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.651+0000 7f3c9affd700 1 --2- 172.21.15.1:0/3893238911 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f3c8805f270 0x7f3c88061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.651+0000 7f3c9affd700 1 --2- 172.21.15.1:0/3893238911 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f3c8805f270 0x7f3c88061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3c9c0aaa70 tx=0x7f3c90008040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.655+0000 7f3c837fe700 1 -- 172.21.15.1:0/3893238911 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3c8c04b2d0 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.827+0000 7f3ca2213700 1 -- 172.21.15.1:0/3893238911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f3c9c0c46e0 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.831+0000 7f3c837fe700 1 -- 172.21.15.1:0/3893238911 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v41) v1 ==== 120+0+0 (secure 0 0 0) 0x7f3c9c0c46e0 con 0x7f3c9c0c1ee0 2023-11-15T02:55:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.833+0000 7f3ca2213700 1 -- 172.21.15.1:0/3893238911 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f3c8805f270 msgr2=0x7f3c88061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.833+0000 7f3ca2213700 1 --2- 172.21.15.1:0/3893238911 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f3c8805f270 0x7f3c88061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3c9c0aaa70 tx=0x7f3c90008040).stop 2023-11-15T02:55:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.833+0000 7f3ca2213700 1 -- 172.21.15.1:0/3893238911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c9c0c1ee0 msgr2=0x7f3c9c0acb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.833+0000 7f3ca2213700 1 --2- 172.21.15.1:0/3893238911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c9c0c1ee0 0x7f3c9c0acb30 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7f3c8c00b490 tx=0x7f3c8c006f20).stop 2023-11-15T02:55:12.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.833+0000 7f3ca2213700 1 -- 172.21.15.1:0/3893238911 shutdown_connections 2023-11-15T02:55:12.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.833+0000 7f3ca2213700 1 --2- 172.21.15.1:0/3893238911 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f3c8805f270 0x7f3c88061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.833+0000 7f3ca2213700 1 --2- 172.21.15.1:0/3893238911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c9c1576c0 0x7f3c9c0c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.833+0000 7f3ca2213700 1 --2- 172.21.15.1:0/3893238911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c9c0c1ee0 0x7f3c9c0acb30 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.833+0000 7f3ca2213700 1 --2- 172.21.15.1:0/3893238911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c9c0c4900 0x7f3c9c14fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.833+0000 7f3ca2213700 1 -- 172.21.15.1:0/3893238911 >> 172.21.15.1:0/3893238911 conn(0x7f3c9c0c7c10 msgr2=0x7f3c9c06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:12.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.833+0000 7f3ca2213700 1 -- 172.21.15.1:0/3893238911 shutdown_connections 2023-11-15T02:55:12.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.833+0000 7f3ca2213700 1 -- 172.21.15.1:0/3893238911 wait complete. 2023-11-15T02:55:12.846 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-11-15T02:55:12.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.963+0000 7fedd04e3700 1 Processor -- start 2023-11-15T02:55:12.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.963+0000 7fedd04e3700 1 -- start start 2023-11-15T02:55:12.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.964+0000 7fedd04e3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fedc8154150 0x7fedc8154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.964+0000 7fedd04e3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fedc80aa060 0x7fedc80c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.964+0000 7fedd04e3700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc80c06f0 con 0x7fedc80ab1a0 2023-11-15T02:55:12.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.964+0000 7fedd04e3700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc80c09d0 con 0x7fedc80aa060 2023-11-15T02:55:12.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.964+0000 7fedd04e3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc8158820 con 0x7fedc8154150 2023-11-15T02:55:12.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.964+0000 7fedcea80700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fedc80aa060 0x7fedc80c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.964+0000 7fedcea80700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fedc80aa060 0x7fedc80c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41016/0 (socket says 172.21.15.1:41016) 2023-11-15T02:55:12.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.964+0000 7fedcea80700 1 -- 172.21.15.1:0/2344529989 learned_addr learned my addr 172.21.15.1:0/2344529989 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:12.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.964+0000 7fedce27f700 1 --2- 172.21.15.1:0/2344529989 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fedc8154150 0x7fedc8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.965+0000 7fedcea80700 1 -- 172.21.15.1:0/2344529989 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fedc8154150 msgr2=0x7fedc8154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:12.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.965+0000 7fedcea80700 1 --2- 172.21.15.1:0/2344529989 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fedc8154150 0x7fedc8154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.965+0000 7fedcea80700 1 -- 172.21.15.1:0/2344529989 >> v1:172.21.15.141:6789/0 conn(0x7fedc80ab1a0 legacy=0x7fedc8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.965+0000 7fedcea80700 1 -- 172.21.15.1:0/2344529989 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc8158b00 con 0x7fedc80aa060 2023-11-15T02:55:12.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.965+0000 7fedcea80700 1 --2- 172.21.15.1:0/2344529989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedc80aa060 0x7fedc80c5f10 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fedb8006fd0 tx=0x7fedb80090f0).ready entity=mon.0 client_cookie=a1cae69298a650ff server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:12.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.966+0000 7fedcd27d700 1 -- 172.21.15.1:0/2344529989 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb800b580 con 0x7fedc80aa060 2023-11-15T02:55:12.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.966+0000 7fedcd27d700 1 -- 172.21.15.1:0/2344529989 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb800b6e0 con 0x7fedc80aa060 2023-11-15T02:55:12.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.966+0000 7fedcd27d700 1 -- 172.21.15.1:0/2344529989 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb800ba80 con 0x7fedc80aa060 2023-11-15T02:55:12.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.967+0000 7fedd04e3700 1 -- 172.21.15.1:0/2344529989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedc80aa060 msgr2=0x7fedc80c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.967+0000 7fedd04e3700 1 --2- 172.21.15.1:0/2344529989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedc80aa060 0x7fedc80c5f10 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fedb8006fd0 tx=0x7fedb80090f0).stop 2023-11-15T02:55:12.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.967+0000 7fedd04e3700 1 -- 172.21.15.1:0/2344529989 shutdown_connections 2023-11-15T02:55:12.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.967+0000 7fedd04e3700 1 --2- 172.21.15.1:0/2344529989 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fedc8154150 0x7fedc8154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.967+0000 7fedd04e3700 1 --2- 172.21.15.1:0/2344529989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedc80aa060 0x7fedc80c5f10 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.967+0000 7fedd04e3700 1 -- 172.21.15.1:0/2344529989 >> 172.21.15.1:0/2344529989 conn(0x7fedc8064aa0 msgr2=0x7fedc8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:12.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.967+0000 7fedd04e3700 1 -- 172.21.15.1:0/2344529989 shutdown_connections 2023-11-15T02:55:12.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.967+0000 7fedd04e3700 1 -- 172.21.15.1:0/2344529989 wait complete. 2023-11-15T02:55:12.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.968+0000 7fedd04e3700 1 Processor -- start 2023-11-15T02:55:12.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.968+0000 7fedd04e3700 1 -- start start 2023-11-15T02:55:12.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedd04e3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedc80aa060 0x7fedc80c2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedd04e3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fedc80ab1a0 0x7fedc81491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedd04e3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fedc8154150 0x7fedc80c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedd04e3700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc80c28b0 con 0x7fedc80aa060 2023-11-15T02:55:12.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedd04e3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc80c2b90 con 0x7fedc8154150 2023-11-15T02:55:12.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedd04e3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc80c2e70 con 0x7fedc80ab1a0 2023-11-15T02:55:12.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedce27f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedc80aa060 0x7fedc80c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedce27f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedc80aa060 0x7fedc80c2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41026/0 (socket says 172.21.15.1:41026) 2023-11-15T02:55:12.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedce27f700 1 -- 172.21.15.1:0/907535541 learned_addr learned my addr 172.21.15.1:0/907535541 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:12.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedcea80700 1 --2- 172.21.15.1:0/907535541 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fedc8154150 0x7fedc80c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedcda7e700 1 --2- 172.21.15.1:0/907535541 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fedc80ab1a0 0x7fedc81491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedce27f700 1 -- 172.21.15.1:0/907535541 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fedc80ab1a0 msgr2=0x7fedc81491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedce27f700 1 --2- 172.21.15.1:0/907535541 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fedc80ab1a0 0x7fedc81491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedce27f700 1 -- 172.21.15.1:0/907535541 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fedc8154150 msgr2=0x7fedc80c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:12.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedce27f700 1 --2- 172.21.15.1:0/907535541 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fedc8154150 0x7fedc80c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:12.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.969+0000 7fedce27f700 1 -- 172.21.15.1:0/907535541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb8009370 con 0x7fedc80aa060 2023-11-15T02:55:12.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.970+0000 7fedce27f700 1 --2- 172.21.15.1:0/907535541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedc80aa060 0x7fedc80c2240 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7fedc0009e70 tx=0x7fedc000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:12.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.970+0000 7fedc67fc700 1 -- 172.21.15.1:0/907535541 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc000caa0 con 0x7fedc80aa060 2023-11-15T02:55:12.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.970+0000 7fedc67fc700 1 -- 172.21.15.1:0/907535541 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc000f040 con 0x7fedc80aa060 2023-11-15T02:55:12.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.970+0000 7fedd04e3700 1 -- 172.21.15.1:0/907535541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc80c3150 con 0x7fedc80aa060 2023-11-15T02:55:12.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.970+0000 7fedc67fc700 1 -- 172.21.15.1:0/907535541 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc000ce10 con 0x7fedc80aa060 2023-11-15T02:55:12.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.970+0000 7fedd04e3700 1 -- 172.21.15.1:0/907535541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc80c3da0 con 0x7fedc80aa060 2023-11-15T02:55:12.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.971+0000 7fedd04e3700 1 -- 172.21.15.1:0/907535541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc81496a0 con 0x7fedc80aa060 2023-11-15T02:55:12.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.971+0000 7fedc67fc700 1 -- 172.21.15.1:0/907535541 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fedc0013610 con 0x7fedc80aa060 2023-11-15T02:55:12.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.971+0000 7fedc67fc700 1 --2- 172.21.15.1:0/907535541 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fedb405f270 0x7fedb4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:12.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.972+0000 7fedc67fc700 1 -- 172.21.15.1:0/907535541 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6423+0+0 (secure 0 0 0) 0x7fedc007ac60 con 0x7fedc80aa060 2023-11-15T02:55:12.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.972+0000 7fedcda7e700 1 --2- 172.21.15.1:0/907535541 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fedb405f270 0x7fedb4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:12.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.972+0000 7fedcda7e700 1 --2- 172.21.15.1:0/907535541 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fedb405f270 0x7fedb4061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fedc8157bd0 tx=0x7fedbc007d40).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:12.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:12.976+0000 7fedc67fc700 1 -- 172.21.15.1:0/907535541 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fedc004bc80 con 0x7fedc80aa060 2023-11-15T02:55:13.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:13.220+0000 7fedd04e3700 1 -- 172.21.15.1:0/907535541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7fedc806c7e0 con 0x7fedc80aa060 2023-11-15T02:55:14.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.176+0000 7fedc67fc700 1 -- 172.21.15.1:0/907535541 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v3013) v1 ==== 163+0+0 (secure 0 0 0) 0x7fedc0013e60 con 0x7fedc80aa060 2023-11-15T02:55:14.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.179+0000 7fedd04e3700 1 -- 172.21.15.1:0/907535541 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fedb405f270 msgr2=0x7fedb4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:14.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.179+0000 7fedd04e3700 1 --2- 172.21.15.1:0/907535541 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fedb405f270 0x7fedb4061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fedc8157bd0 tx=0x7fedbc007d40).stop 2023-11-15T02:55:14.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.179+0000 7fedd04e3700 1 -- 172.21.15.1:0/907535541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedc80aa060 msgr2=0x7fedc80c2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:14.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.179+0000 7fedd04e3700 1 --2- 172.21.15.1:0/907535541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedc80aa060 0x7fedc80c2240 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7fedc0009e70 tx=0x7fedc000b040).stop 2023-11-15T02:55:14.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.179+0000 7fedd04e3700 1 -- 172.21.15.1:0/907535541 shutdown_connections 2023-11-15T02:55:14.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.179+0000 7fedd04e3700 1 --2- 172.21.15.1:0/907535541 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fedb405f270 0x7fedb4061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:14.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.179+0000 7fedd04e3700 1 --2- 172.21.15.1:0/907535541 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fedc8154150 0x7fedc80c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:14.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.179+0000 7fedd04e3700 1 --2- 172.21.15.1:0/907535541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedc80aa060 0x7fedc80c2240 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:14.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.179+0000 7fedd04e3700 1 --2- 172.21.15.1:0/907535541 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fedc80ab1a0 0x7fedc81491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:14.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.179+0000 7fedd04e3700 1 -- 172.21.15.1:0/907535541 >> 172.21.15.1:0/907535541 conn(0x7fedc8064aa0 msgr2=0x7fedc8063460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:14.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.179+0000 7fedd04e3700 1 -- 172.21.15.1:0/907535541 shutdown_connections 2023-11-15T02:55:14.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.179+0000 7fedd04e3700 1 -- 172.21.15.1:0/907535541 wait complete. 2023-11-15T02:55:14.195 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-11-15T02:55:14.195 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-11-15T02:55:14.196 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-11-15T02:55:14.196 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-11-15T02:55:14.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.320+0000 7f231a94e700 1 Processor -- start 2023-11-15T02:55:14.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.320+0000 7f231a94e700 1 -- start start 2023-11-15T02:55:14.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.321+0000 7f231a94e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2314154150 0x7f2314154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:14.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.321+0000 7f231a94e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f23140aa060 0x7f23140c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:14.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.321+0000 7f231a94e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23140c06f0 con 0x7f23140ab1a0 2023-11-15T02:55:14.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.321+0000 7f231a94e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23140c09d0 con 0x7f23140aa060 2023-11-15T02:55:14.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.321+0000 7f231a94e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2314158820 con 0x7f2314154150 2023-11-15T02:55:14.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.321+0000 7f2318eeb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f23140aa060 0x7f23140c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:14.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.321+0000 7f2318eeb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f23140aa060 0x7f23140c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41034/0 (socket says 172.21.15.1:41034) 2023-11-15T02:55:14.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.321+0000 7f2318eeb700 1 -- 172.21.15.1:0/2634822903 learned_addr learned my addr 172.21.15.1:0/2634822903 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:14.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.321+0000 7f2313fff700 1 --2- 172.21.15.1:0/2634822903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2314154150 0x7f2314154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:14.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.321+0000 7f2318eeb700 1 -- 172.21.15.1:0/2634822903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2314154150 msgr2=0x7f2314154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:14.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.321+0000 7f2318eeb700 1 --2- 172.21.15.1:0/2634822903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2314154150 0x7f2314154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:14.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.321+0000 7f2318eeb700 1 -- 172.21.15.1:0/2634822903 >> v1:172.21.15.1:6789/0 conn(0x7f23140ab1a0 legacy=0x7f2314158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:14.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.321+0000 7f2318eeb700 1 -- 172.21.15.1:0/2634822903 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2314158b00 con 0x7f23140aa060 2023-11-15T02:55:14.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.321+0000 7f2313fff700 1 --2- 172.21.15.1:0/2634822903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2314154150 0x7f2314154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:14.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.321+0000 7f2318eeb700 1 --2- 172.21.15.1:0/2634822903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23140aa060 0x7f23140c5f10 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f230c009f20 tx=0x7f230c009840).ready entity=mon.0 client_cookie=cec3353b28adf8a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:14.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.322+0000 7f2312ffd700 1 -- 172.21.15.1:0/2634822903 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c00e070 con 0x7f23140aa060 2023-11-15T02:55:14.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.322+0000 7f2312ffd700 1 -- 172.21.15.1:0/2634822903 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c00ba80 con 0x7f23140aa060 2023-11-15T02:55:14.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.322+0000 7f2312ffd700 1 -- 172.21.15.1:0/2634822903 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c00be00 con 0x7f23140aa060 2023-11-15T02:55:14.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.322+0000 7f231a94e700 1 -- 172.21.15.1:0/2634822903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23140aa060 msgr2=0x7f23140c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:14.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.322+0000 7f231a94e700 1 --2- 172.21.15.1:0/2634822903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23140aa060 0x7f23140c5f10 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f230c009f20 tx=0x7f230c009840).stop 2023-11-15T02:55:14.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.322+0000 7f231a94e700 1 -- 172.21.15.1:0/2634822903 shutdown_connections 2023-11-15T02:55:14.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.322+0000 7f231a94e700 1 --2- 172.21.15.1:0/2634822903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23140aa060 0x7f23140c5f10 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:14.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.322+0000 7f231a94e700 1 --2- 172.21.15.1:0/2634822903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2314154150 0x7f2314154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:14.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.322+0000 7f231a94e700 1 -- 172.21.15.1:0/2634822903 >> 172.21.15.1:0/2634822903 conn(0x7f2314064aa0 msgr2=0x7f2314064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:14.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.322+0000 7f231a94e700 1 -- 172.21.15.1:0/2634822903 shutdown_connections 2023-11-15T02:55:14.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.322+0000 7f231a94e700 1 -- 172.21.15.1:0/2634822903 wait complete. 2023-11-15T02:55:14.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.323+0000 7f231a94e700 1 Processor -- start 2023-11-15T02:55:14.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.323+0000 7f231a94e700 1 -- start start 2023-11-15T02:55:14.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.324+0000 7f231a94e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f23140aa060 0x7f2314154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:14.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.324+0000 7f231a94e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23140ab1a0 0x7f2314154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:14.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.324+0000 7f231a94e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2314154150 0x7f2314156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:14.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.324+0000 7f231a94e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2314155490 con 0x7f2314154150 2023-11-15T02:55:14.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.324+0000 7f231a94e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23140af3b0 con 0x7f23140aa060 2023-11-15T02:55:14.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.324+0000 7f231a94e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23140ae7a0 con 0x7f23140ab1a0 2023-11-15T02:55:14.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.324+0000 7f2318eeb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2314154150 0x7f2314156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:14.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.324+0000 7f2318eeb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2314154150 0x7f2314156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41040/0 (socket says 172.21.15.1:41040) 2023-11-15T02:55:14.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.324+0000 7f2318eeb700 1 -- 172.21.15.1:0/2655383366 learned_addr learned my addr 172.21.15.1:0/2655383366 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:14.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.324+0000 7f23137fe700 1 --2- 172.21.15.1:0/2655383366 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23140ab1a0 0x7f2314154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:14.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.324+0000 7f2318eeb700 1 -- 172.21.15.1:0/2655383366 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23140ab1a0 msgr2=0x7f2314154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:14.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.325+0000 7f2318eeb700 1 --2- 172.21.15.1:0/2655383366 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23140ab1a0 0x7f2314154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:14.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.325+0000 7f2313fff700 1 --2- 172.21.15.1:0/2655383366 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f23140aa060 0x7f2314154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:14.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.325+0000 7f2318eeb700 1 -- 172.21.15.1:0/2655383366 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f23140aa060 msgr2=0x7f2314154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:14.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.325+0000 7f2318eeb700 1 --2- 172.21.15.1:0/2655383366 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f23140aa060 0x7f2314154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:14.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.325+0000 7f2318eeb700 1 -- 172.21.15.1:0/2655383366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c009ae0 con 0x7f2314154150 2023-11-15T02:55:14.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.325+0000 7f2313fff700 1 --2- 172.21.15.1:0/2655383366 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f23140aa060 0x7f2314154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:14.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.325+0000 7f2318eeb700 1 --2- 172.21.15.1:0/2655383366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2314154150 0x7f2314156a60 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7f230c010000 tx=0x7f230c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:14.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.325+0000 7f230bfff700 1 -- 172.21.15.1:0/2655383366 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c0032f0 con 0x7f2314154150 2023-11-15T02:55:14.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.325+0000 7f230bfff700 1 -- 172.21.15.1:0/2655383366 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c007080 con 0x7f2314154150 2023-11-15T02:55:14.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.325+0000 7f231a94e700 1 -- 172.21.15.1:0/2655383366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23140aea80 con 0x7f2314154150 2023-11-15T02:55:14.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.325+0000 7f230bfff700 1 -- 172.21.15.1:0/2655383366 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c01e680 con 0x7f2314154150 2023-11-15T02:55:14.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.325+0000 7f231a94e700 1 -- 172.21.15.1:0/2655383366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23140af040 con 0x7f2314154150 2023-11-15T02:55:14.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.326+0000 7f231a94e700 1 -- 172.21.15.1:0/2655383366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231406c7e0 con 0x7f2314154150 2023-11-15T02:55:14.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.326+0000 7f230bfff700 1 -- 172.21.15.1:0/2655383366 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f230c003040 con 0x7f2314154150 2023-11-15T02:55:14.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.326+0000 7f230bfff700 1 --2- 172.21.15.1:0/2655383366 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f22f405f270 0x7f22f4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:14.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.327+0000 7f230bfff700 1 -- 172.21.15.1:0/2655383366 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6423+0+0 (secure 0 0 0) 0x7f230c07b930 con 0x7f2314154150 2023-11-15T02:55:14.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.327+0000 7f2313fff700 1 --2- 172.21.15.1:0/2655383366 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f22f405f270 0x7f22f4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:14.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.327+0000 7f2313fff700 1 --2- 172.21.15.1:0/2655383366 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f22f405f270 0x7f22f4061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f22fc006d80 tx=0x7f22fc008040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:14.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.331+0000 7f230bfff700 1 -- 172.21.15.1:0/2655383366 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f230c04ca00 con 0x7f2314154150 2023-11-15T02:55:14.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:14.573+0000 7f231a94e700 1 -- 172.21.15.1:0/2655383366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f2314158de0 con 0x7f2314154150 2023-11-15T02:55:15.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.178+0000 7f230bfff700 1 -- 172.21.15.1:0/2655383366 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3014) v1 ==== 158+0+0 (secure 0 0 0) 0x7f230c023070 con 0x7f2314154150 2023-11-15T02:55:15.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.180+0000 7f231a94e700 1 -- 172.21.15.1:0/2655383366 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f22f405f270 msgr2=0x7f22f4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:15.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.180+0000 7f231a94e700 1 --2- 172.21.15.1:0/2655383366 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f22f405f270 0x7f22f4061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f22fc006d80 tx=0x7f22fc008040).stop 2023-11-15T02:55:15.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.180+0000 7f231a94e700 1 -- 172.21.15.1:0/2655383366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2314154150 msgr2=0x7f2314156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:15.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.180+0000 7f231a94e700 1 --2- 172.21.15.1:0/2655383366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2314154150 0x7f2314156a60 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7f230c010000 tx=0x7f230c009840).stop 2023-11-15T02:55:15.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.180+0000 7f231a94e700 1 -- 172.21.15.1:0/2655383366 shutdown_connections 2023-11-15T02:55:15.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.180+0000 7f231a94e700 1 --2- 172.21.15.1:0/2655383366 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f22f405f270 0x7f22f4061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.180+0000 7f231a94e700 1 --2- 172.21.15.1:0/2655383366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2314154150 0x7f2314156a60 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.180+0000 7f231a94e700 1 --2- 172.21.15.1:0/2655383366 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f23140aa060 0x7f2314154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.180+0000 7f231a94e700 1 --2- 172.21.15.1:0/2655383366 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23140ab1a0 0x7f2314154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.180+0000 7f231a94e700 1 -- 172.21.15.1:0/2655383366 >> 172.21.15.1:0/2655383366 conn(0x7f2314064aa0 msgr2=0x7f2314063460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:15.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.180+0000 7f231a94e700 1 -- 172.21.15.1:0/2655383366 shutdown_connections 2023-11-15T02:55:15.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.180+0000 7f231a94e700 1 -- 172.21.15.1:0/2655383366 wait complete. 2023-11-15T02:55:15.194 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-15T02:55:15.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.316+0000 7f6781a0c700 1 Processor -- start 2023-11-15T02:55:15.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.316+0000 7f6781a0c700 1 -- start start 2023-11-15T02:55:15.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.317+0000 7f6781a0c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f677c066f80 0x7f677c137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:15.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.317+0000 7f6781a0c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677c154ce0 con 0x7f677c137030 2023-11-15T02:55:15.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.317+0000 7f6781a0c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677c154fc0 con 0x7f677c1588e0 2023-11-15T02:55:15.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.317+0000 7f6781a0c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c137900 con 0x7f677c066f80 2023-11-15T02:55:15.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.317+0000 7f677affd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f677c137030 0x7f677c066870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59960/0 (socket says 172.21.15.1:59960) 2023-11-15T02:55:15.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.317+0000 7f677affd700 1 -- 172.21.15.1:0/3323084607 learned_addr learned my addr 172.21.15.1:0/3323084607 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:15.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f677a7fc700 1 --2- 172.21.15.1:0/3323084607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f677c066f80 0x7f677c137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:15.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f6779ffb700 1 -- 172.21.15.1:0/3323084607 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584716062 0 0) 0x7f677c154ce0 con 0x7f677c137030 2023-11-15T02:55:15.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f6779ffb700 1 -- 172.21.15.1:0/3323084607 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67680033f0 con 0x7f677c137030 2023-11-15T02:55:15.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f6779ffb700 1 -- 172.21.15.1:0/3323084607 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2177404008 0 0) 0x7f67680033f0 con 0x7f677c137030 2023-11-15T02:55:15.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f6779ffb700 1 -- 172.21.15.1:0/3323084607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f677c066f80 msgr2=0x7f677c137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:15.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f6779ffb700 1 --2- 172.21.15.1:0/3323084607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f677c066f80 0x7f677c137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f6779ffb700 1 -- 172.21.15.1:0/3323084607 >> v1:172.21.15.141:6789/0 conn(0x7f677c1588e0 legacy=0x7f677c14e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:15.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f6779ffb700 1 -- 172.21.15.1:0/3323084607 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c1552a0 con 0x7f677c137030 2023-11-15T02:55:15.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f6779ffb700 1 -- 172.21.15.1:0/3323084607 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f67740017f0 con 0x7f677c137030 2023-11-15T02:55:15.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f6779ffb700 1 -- 172.21.15.1:0/3323084607 >> v1:172.21.15.1:6789/0 conn(0x7f677c137030 legacy=0x7f677c066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:15.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f6779ffb700 1 --2- 172.21.15.1:0/3323084607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6768003910 0x7f6768003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:15.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f6779ffb700 1 --2- 172.21.15.1:0/3323084607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f677c066f80 0x7f6768004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:15.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f6779ffb700 1 --2- 172.21.15.1:0/3323084607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6768004b80 0x7f6768005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:15.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f6779ffb700 1 -- 172.21.15.1:0/3323084607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c137900 con 0x7f6768003910 2023-11-15T02:55:15.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f6779ffb700 1 -- 172.21.15.1:0/3323084607 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676800b8e0 con 0x7f6768004b80 2023-11-15T02:55:15.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f6779ffb700 1 -- 172.21.15.1:0/3323084607 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676800ba50 con 0x7f677c066f80 2023-11-15T02:55:15.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f677affd700 1 --2- 172.21.15.1:0/3323084607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6768003910 0x7f6768003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:15.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f677a7fc700 1 --2- 172.21.15.1:0/3323084607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f677c066f80 0x7f6768004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:15.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f677b7fe700 1 --2- 172.21.15.1:0/3323084607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6768004b80 0x7f6768005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:15.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f677affd700 1 -- 172.21.15.1:0/3323084607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f677c066f80 msgr2=0x7f6768004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:15.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f677affd700 1 --2- 172.21.15.1:0/3323084607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f677c066f80 0x7f6768004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f677affd700 1 -- 172.21.15.1:0/3323084607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6768004b80 msgr2=0x7f6768005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f677affd700 1 --2- 172.21.15.1:0/3323084607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6768004b80 0x7f6768005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f677affd700 1 -- 172.21.15.1:0/3323084607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67680033f0 con 0x7f6768003910 2023-11-15T02:55:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.318+0000 7f677b7fe700 1 --2- 172.21.15.1:0/3323084607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6768004b80 0x7f6768005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.319+0000 7f677affd700 1 --2- 172.21.15.1:0/3323084607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6768003910 0x7f6768003cf0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f677400c5f0 tx=0x7f6774001d90).ready entity=mon.0 client_cookie=521b94d95925ae31 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.319+0000 7f6779ffb700 1 -- 172.21.15.1:0/3323084607 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677400ce60 con 0x7f6768003910 2023-11-15T02:55:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.319+0000 7f6779ffb700 1 -- 172.21.15.1:0/3323084607 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6774001fc0 con 0x7f6768003910 2023-11-15T02:55:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.319+0000 7f6779ffb700 1 -- 172.21.15.1:0/3323084607 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774005d30 con 0x7f6768003910 2023-11-15T02:55:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.319+0000 7f6781a0c700 1 -- 172.21.15.1:0/3323084607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6768003910 msgr2=0x7f6768003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.319+0000 7f6781a0c700 1 --2- 172.21.15.1:0/3323084607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6768003910 0x7f6768003cf0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f677400c5f0 tx=0x7f6774001d90).stop 2023-11-15T02:55:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.319+0000 7f677b7fe700 1 -- 172.21.15.1:0/3323084607 reap_dead start 2023-11-15T02:55:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.319+0000 7f6781a0c700 1 -- 172.21.15.1:0/3323084607 shutdown_connections 2023-11-15T02:55:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.319+0000 7f6781a0c700 1 -- 172.21.15.1:0/3323084607 >> 172.21.15.1:0/3323084607 conn(0x7f677c063280 msgr2=0x7f677c0c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.319+0000 7f6781a0c700 1 -- 172.21.15.1:0/3323084607 shutdown_connections 2023-11-15T02:55:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.319+0000 7f6781a0c700 1 -- 172.21.15.1:0/3323084607 wait complete. 2023-11-15T02:55:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.321+0000 7f6781a0c700 1 Processor -- start 2023-11-15T02:55:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.321+0000 7f6781a0c700 1 -- start start 2023-11-15T02:55:15.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.321+0000 7f6781a0c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6768003910 0x7f677c0ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:15.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.321+0000 7f6781a0c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f677c0c1e60 0x7f677c0c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:15.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.321+0000 7f6781a0c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f677c0c3b70 0x7f677c1681f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:15.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.321+0000 7f6781a0c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c0c22e0 con 0x7f677c0c3b70 2023-11-15T02:55:15.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.321+0000 7f6781a0c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c0c19d0 con 0x7f6768003910 2023-11-15T02:55:15.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.321+0000 7f6781a0c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c0c0dc0 con 0x7f677c0c1e60 2023-11-15T02:55:15.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.321+0000 7f677b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f677c0c3b70 0x7f677c1681f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:15.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.321+0000 7f677b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f677c0c3b70 0x7f677c1681f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41062/0 (socket says 172.21.15.1:41062) 2023-11-15T02:55:15.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.321+0000 7f677b7fe700 1 -- 172.21.15.1:0/3478834260 learned_addr learned my addr 172.21.15.1:0/3478834260 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:15.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.322+0000 7f677b7fe700 1 -- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f677c0c1e60 msgr2=0x7f677c0c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:15.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.322+0000 7f677a7fc700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f677c0c1e60 0x7f677c0c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:15.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.322+0000 7f677affd700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6768003910 0x7f677c0ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:15.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.322+0000 7f677b7fe700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f677c0c1e60 0x7f677c0c3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.322+0000 7f677b7fe700 1 -- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6768003910 msgr2=0x7f677c0ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:15.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.322+0000 7f677b7fe700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6768003910 0x7f677c0ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.322+0000 7f677b7fe700 1 -- 172.21.15.1:0/3478834260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c0c10a0 con 0x7f677c0c3b70 2023-11-15T02:55:15.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.322+0000 7f677a7fc700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f677c0c1e60 0x7f677c0c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:15.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.322+0000 7f677affd700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6768003910 0x7f677c0ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:15.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.322+0000 7f677b7fe700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f677c0c3b70 0x7f677c1681f0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7f677c0af190 tx=0x7f676c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:15.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.322+0000 7f6772ffd700 1 -- 172.21.15.1:0/3478834260 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c014430 con 0x7f677c0c3b70 2023-11-15T02:55:15.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.322+0000 7f6772ffd700 1 -- 172.21.15.1:0/3478834260 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c014590 con 0x7f677c0c3b70 2023-11-15T02:55:15.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.322+0000 7f6772ffd700 1 -- 172.21.15.1:0/3478834260 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c014930 con 0x7f677c0c3b70 2023-11-15T02:55:15.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.322+0000 7f6781a0c700 1 -- 172.21.15.1:0/3478834260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677c0c1380 con 0x7f677c0c3b70 2023-11-15T02:55:15.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.322+0000 7f6781a0c700 1 -- 172.21.15.1:0/3478834260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677c0c0a50 con 0x7f677c0c3b70 2023-11-15T02:55:15.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.323+0000 7f6781a0c700 1 -- 172.21.15.1:0/3478834260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677c06c7e0 con 0x7f677c0c3b70 2023-11-15T02:55:15.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.324+0000 7f6772ffd700 1 -- 172.21.15.1:0/3478834260 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f676c014d20 con 0x7f677c0c3b70 2023-11-15T02:55:15.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.324+0000 7f6772ffd700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f675c05f270 0x7f675c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:15.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.324+0000 7f6772ffd700 1 -- 172.21.15.1:0/3478834260 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6423+0+0 (secure 0 0 0) 0x7f676c079590 con 0x7f677c0c3b70 2023-11-15T02:55:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.324+0000 7f677affd700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f675c05f270 0x7f675c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.325+0000 7f677affd700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f675c05f270 0x7f675c061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f6774002130 tx=0x7f6774015000).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:15.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.328+0000 7f6772ffd700 1 -- 172.21.15.1:0/3478834260 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f676c04a5b0 con 0x7f677c0c3b70 2023-11-15T02:55:15.503 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.502+0000 7f6781a0c700 1 -- 172.21.15.1:0/3478834260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f677c0ab8e0 con 0x7f677c0c3b70 2023-11-15T02:55:15.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.505+0000 7f6772ffd700 1 -- 172.21.15.1:0/3478834260 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) v1 ==== 122+0+0 (secure 0 0 0) 0x7f676c01c0c0 con 0x7f677c0c3b70 2023-11-15T02:55:15.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.507+0000 7f6781a0c700 1 -- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f675c05f270 msgr2=0x7f675c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:15.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.507+0000 7f6781a0c700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f675c05f270 0x7f675c061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f6774002130 tx=0x7f6774015000).stop 2023-11-15T02:55:15.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.507+0000 7f6781a0c700 1 -- 172.21.15.1:0/3478834260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f677c0c3b70 msgr2=0x7f677c1681f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:15.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.507+0000 7f6781a0c700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f677c0c3b70 0x7f677c1681f0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7f677c0af190 tx=0x7f676c009040).stop 2023-11-15T02:55:15.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.507+0000 7f6781a0c700 1 -- 172.21.15.1:0/3478834260 shutdown_connections 2023-11-15T02:55:15.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.507+0000 7f6781a0c700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f675c05f270 0x7f675c061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.507+0000 7f6781a0c700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f677c0c3b70 0x7f677c1681f0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.507+0000 7f6781a0c700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6768003910 0x7f677c0ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.507+0000 7f6781a0c700 1 --2- 172.21.15.1:0/3478834260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f677c0c1e60 0x7f677c0c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.507+0000 7f6781a0c700 1 -- 172.21.15.1:0/3478834260 >> 172.21.15.1:0/3478834260 conn(0x7f677c063280 msgr2=0x7f677c0bf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:15.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.507+0000 7f6781a0c700 1 -- 172.21.15.1:0/3478834260 shutdown_connections 2023-11-15T02:55:15.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.507+0000 7f6781a0c700 1 -- 172.21.15.1:0/3478834260 wait complete. 2023-11-15T02:55:15.520 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T02:55:15.521 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:55:15.561 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:55:15.602 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T02:55:15.602 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-15T02:55:15.603 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:55:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.720+0000 7f43ff59e700 1 Processor -- start 2023-11-15T02:55:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.720+0000 7f43ff59e700 1 -- start start 2023-11-15T02:55:15.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.721+0000 7f43ff59e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44001579f0 0x7f44000657e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:15.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.721+0000 7f43ff59e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4400157dd0 0x7f44000627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:15.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.721+0000 7f43ff59e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f44000a6fd0 0x7f4400062ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:15.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.721+0000 7f43ff59e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4400063190 con 0x7f44000a6fd0 2023-11-15T02:55:15.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.721+0000 7f43ff59e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4400066a80 con 0x7f4400157dd0 2023-11-15T02:55:15.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.721+0000 7f43ff59e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4400066f10 con 0x7f44001579f0 2023-11-15T02:55:15.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.721+0000 7f43fed9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f44000a6fd0 0x7f4400062ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:15.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.721+0000 7f43fed9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f44000a6fd0 0x7f4400062ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41074/0 (socket says 172.21.15.1:41074) 2023-11-15T02:55:15.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.721+0000 7f43fed9d700 1 -- 172.21.15.1:0/3078527630 learned_addr learned my addr 172.21.15.1:0/3078527630 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:15.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.721+0000 7f43fe59c700 1 --2- 172.21.15.1:0/3078527630 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44001579f0 0x7f44000657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:15.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.721+0000 7f43fdd9b700 1 --2- 172.21.15.1:0/3078527630 >> v2:172.21.15.141:3300/0 conn(0x7f4400157dd0 0x7f44000627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:15.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43fed9d700 1 -- 172.21.15.1:0/3078527630 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44001579f0 msgr2=0x7f44000657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:15.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43fed9d700 1 --2- 172.21.15.1:0/3078527630 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44001579f0 0x7f44000657e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43fed9d700 1 -- 172.21.15.1:0/3078527630 >> v2:172.21.15.141:3300/0 conn(0x7f4400157dd0 msgr2=0x7f44000627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:15.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43fed9d700 1 --2- 172.21.15.1:0/3078527630 >> v2:172.21.15.141:3300/0 conn(0x7f4400157dd0 0x7f44000627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43fed9d700 1 -- 172.21.15.1:0/3078527630 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4400065e70 con 0x7f44000a6fd0 2023-11-15T02:55:15.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43fed9d700 1 --2- 172.21.15.1:0/3078527630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44000a6fd0 0x7f4400062ca0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f4400069250 tx=0x7f43f0009840).ready entity=mon.0 client_cookie=cc1a78e48b867c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:15.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43fd59a700 1 -- 172.21.15.1:0/3078527630 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f000e070 con 0x7f44000a6fd0 2023-11-15T02:55:15.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43fd59a700 1 -- 172.21.15.1:0/3078527630 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f000b970 con 0x7f44000a6fd0 2023-11-15T02:55:15.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43fd59a700 1 -- 172.21.15.1:0/3078527630 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f000bcf0 con 0x7f44000a6fd0 2023-11-15T02:55:15.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43ff59e700 1 -- 172.21.15.1:0/3078527630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44000a6fd0 msgr2=0x7f4400062ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:15.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43ff59e700 1 --2- 172.21.15.1:0/3078527630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44000a6fd0 0x7f4400062ca0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f4400069250 tx=0x7f43f0009840).stop 2023-11-15T02:55:15.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43ff59e700 1 -- 172.21.15.1:0/3078527630 shutdown_connections 2023-11-15T02:55:15.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43ff59e700 1 --2- 172.21.15.1:0/3078527630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44000a6fd0 0x7f4400062ca0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43ff59e700 1 --2- 172.21.15.1:0/3078527630 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44001579f0 0x7f44000657e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43ff59e700 1 --2- 172.21.15.1:0/3078527630 >> v2:172.21.15.141:3300/0 conn(0x7f4400157dd0 0x7f44000627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.722+0000 7f43ff59e700 1 -- 172.21.15.1:0/3078527630 >> 172.21.15.1:0/3078527630 conn(0x7f44000c7c10 msgr2=0x7f44000c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:15.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.723+0000 7f43ff59e700 1 -- 172.21.15.1:0/3078527630 shutdown_connections 2023-11-15T02:55:15.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.723+0000 7f43ff59e700 1 -- 172.21.15.1:0/3078527630 wait complete. 2023-11-15T02:55:15.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.724+0000 7f43ff59e700 1 Processor -- start 2023-11-15T02:55:15.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.724+0000 7f43ff59e700 1 -- start start 2023-11-15T02:55:15.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.724+0000 7f43ff59e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44000a6fd0 0x7f440013f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:15.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.724+0000 7f43ff59e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44001579f0 0x7f440013f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:15.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.724+0000 7f43ff59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4400157dd0 0x7f4400154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:15.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.724+0000 7f43ff59e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44000a8930 con 0x7f4400157dd0 2023-11-15T02:55:15.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.724+0000 7f43ff59e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4400153250 con 0x7f44001579f0 2023-11-15T02:55:15.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.724+0000 7f43ff59e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4400153530 con 0x7f44000a6fd0 2023-11-15T02:55:15.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43fed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4400157dd0 0x7f4400154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:15.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43fed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4400157dd0 0x7f4400154b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41088/0 (socket says 172.21.15.1:41088) 2023-11-15T02:55:15.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43fed9d700 1 -- 172.21.15.1:0/1871946546 learned_addr learned my addr 172.21.15.1:0/1871946546 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:15.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43fe59c700 1 --2- 172.21.15.1:0/1871946546 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44000a6fd0 0x7f440013f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:15.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43fdd9b700 1 --2- 172.21.15.1:0/1871946546 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44001579f0 0x7f440013f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:15.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43fed9d700 1 -- 172.21.15.1:0/1871946546 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44000a6fd0 msgr2=0x7f440013f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:15.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43fed9d700 1 --2- 172.21.15.1:0/1871946546 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44000a6fd0 0x7f440013f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43fed9d700 1 -- 172.21.15.1:0/1871946546 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44001579f0 msgr2=0x7f440013f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:15.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43fed9d700 1 --2- 172.21.15.1:0/1871946546 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44001579f0 0x7f440013f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43fed9d700 1 -- 172.21.15.1:0/1871946546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f0009ae0 con 0x7f4400157dd0 2023-11-15T02:55:15.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43fdd9b700 1 --2- 172.21.15.1:0/1871946546 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44001579f0 0x7f440013f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:15.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43fed9d700 1 --2- 172.21.15.1:0/1871946546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4400157dd0 0x7f4400154b30 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7f43f000b610 tx=0x7f43f0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:15.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43f67fc700 1 -- 172.21.15.1:0/1871946546 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f000bee0 con 0x7f4400157dd0 2023-11-15T02:55:15.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43f67fc700 1 -- 172.21.15.1:0/1871946546 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f00092e0 con 0x7f4400157dd0 2023-11-15T02:55:15.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43ff59e700 1 -- 172.21.15.1:0/1871946546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44000a8bf0 con 0x7f4400157dd0 2023-11-15T02:55:15.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43f67fc700 1 -- 172.21.15.1:0/1871946546 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f001e680 con 0x7f4400157dd0 2023-11-15T02:55:15.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.725+0000 7f43ff59e700 1 -- 172.21.15.1:0/1871946546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4400155260 con 0x7f4400157dd0 2023-11-15T02:55:15.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.726+0000 7f43ff59e700 1 -- 172.21.15.1:0/1871946546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44000a8790 con 0x7f4400157dd0 2023-11-15T02:55:15.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.727+0000 7f43f67fc700 1 -- 172.21.15.1:0/1871946546 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f43f0003040 con 0x7f4400157dd0 2023-11-15T02:55:15.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.727+0000 7f43f67fc700 1 --2- 172.21.15.1:0/1871946546 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43e005f270 0x7f43e0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:15.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.727+0000 7f43f67fc700 1 -- 172.21.15.1:0/1871946546 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6423+0+0 (secure 0 0 0) 0x7f43f007b9a0 con 0x7f4400157dd0 2023-11-15T02:55:15.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.727+0000 7f43fe59c700 1 --2- 172.21.15.1:0/1871946546 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43e005f270 0x7f43e0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:15.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.728+0000 7f43fe59c700 1 --2- 172.21.15.1:0/1871946546 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43e005f270 0x7f43e0061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f43f8009bc0 tx=0x7f43f8008040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:15.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.731+0000 7f43f67fc700 1 -- 172.21.15.1:0/1871946546 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f44000a8790 con 0x7f4400157dd0 2023-11-15T02:55:15.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.948+0000 7f43ff59e700 1 -- 172.21.15.1:0/1871946546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44000a8790 con 0x7f4400157dd0 2023-11-15T02:55:15.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.949+0000 7f43f67fc700 1 -- 172.21.15.1:0/1871946546 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f44000a8790 con 0x7f4400157dd0 2023-11-15T02:55:15.952 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:15.953 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":89,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8764,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/1669030169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1669030169},{"type":"v1","addr":"172.21.15.141:6837","nonce":1669030169}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9094,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/2842413997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":2842413997},{"type":"v1","addr":"172.21.15.141:6836","nonce":2842413997}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":9597,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6834/2404592830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2404592830},{"type":"v1","addr":"172.21.15.1:6834","nonce":2404592830}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9600,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3663257097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6833","nonce":3663257097},{"type":"v1","addr":"172.21.15.1:6835","nonce":3663257097}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[]} 2023-11-15T02:55:15.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.951+0000 7f43ff59e700 1 -- 172.21.15.1:0/1871946546 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43e005f270 msgr2=0x7f43e0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:15.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.951+0000 7f43ff59e700 1 --2- 172.21.15.1:0/1871946546 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43e005f270 0x7f43e0061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f43f8009bc0 tx=0x7f43f8008040).stop 2023-11-15T02:55:15.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.951+0000 7f43ff59e700 1 -- 172.21.15.1:0/1871946546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4400157dd0 msgr2=0x7f4400154b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:15.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.951+0000 7f43ff59e700 1 --2- 172.21.15.1:0/1871946546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4400157dd0 0x7f4400154b30 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7f43f000b610 tx=0x7f43f0009840).stop 2023-11-15T02:55:15.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.951+0000 7f43ff59e700 1 -- 172.21.15.1:0/1871946546 shutdown_connections 2023-11-15T02:55:15.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.951+0000 7f43ff59e700 1 --2- 172.21.15.1:0/1871946546 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43e005f270 0x7f43e0061730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.951+0000 7f43ff59e700 1 --2- 172.21.15.1:0/1871946546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4400157dd0 0x7f4400154b30 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.951+0000 7f43ff59e700 1 --2- 172.21.15.1:0/1871946546 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44000a6fd0 0x7f440013f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.951+0000 7f43ff59e700 1 --2- 172.21.15.1:0/1871946546 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44001579f0 0x7f440013f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:15.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.951+0000 7f43ff59e700 1 -- 172.21.15.1:0/1871946546 >> 172.21.15.1:0/1871946546 conn(0x7f44000c7c10 msgr2=0x7f44000c4920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:15.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.951+0000 7f43ff59e700 1 -- 172.21.15.1:0/1871946546 shutdown_connections 2023-11-15T02:55:15.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:15.951+0000 7f43ff59e700 1 -- 172.21.15.1:0/1871946546 wait complete. 2023-11-15T02:55:15.959 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 89 2023-11-15T02:55:15.965 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-15T02:55:15.965 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-15T02:55:15.966 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-15T02:55:15.966 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:55:15.967 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-15T02:55:15.967 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-15T02:55:15.967 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-15T02:55:15.968 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:55:15.968 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-15T02:55:15.968 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-15T02:55:15.969 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-15T02:55:15.969 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:55:15.970 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-15T02:55:15.970 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-15T02:55:15.970 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-15T02:55:15.971 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:55:15.975 INFO:tasks.ceph.mds.a:Stopped 2023-11-15T02:55:15.975 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-15T02:55:15.976 INFO:tasks.ceph.mds.c:Stopped 2023-11-15T02:55:15.977 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-15T02:55:15.980 INFO:tasks.ceph.mds.b:Stopped 2023-11-15T02:55:15.981 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-15T02:55:15.982 INFO:tasks.ceph.mds.d:Stopped 2023-11-15T02:55:15.982 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-15T02:55:16.019 INFO:tasks.ceph.mds.a:Started 2023-11-15T02:55:16.020 DEBUG:teuthology.parallel:result is None 2023-11-15T02:55:16.021 INFO:tasks.ceph.mds.c:Started 2023-11-15T02:55:16.021 DEBUG:teuthology.parallel:result is None 2023-11-15T02:55:16.024 INFO:tasks.ceph.mds.b:Started 2023-11-15T02:55:16.024 DEBUG:teuthology.parallel:result is None 2023-11-15T02:55:16.026 INFO:tasks.ceph.mds.d:Started 2023-11-15T02:55:16.026 DEBUG:teuthology.parallel:result is None 2023-11-15T02:55:16.027 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-15T02:55:16.093 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-11-15T02:55:16.095 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-11-15T02:55:16.105 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T02:55:16.105 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-15T02:55:16.106 INFO:tasks.ceph.mds.d.smithi141.stderr:2023-11-15T02:55:16.105+0000 7f3b3e6bf700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-11-15T02:55:16.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.154+0000 7fa0a5bf4700 1 Processor -- start 2023-11-15T02:55:16.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.154+0000 7fa0a5bf4700 1 -- start start 2023-11-15T02:55:16.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.155+0000 7fa0a5bf4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa0a0150460 0x7fa0a0150840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:16.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.155+0000 7fa0a5bf4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa0a0069210 0x7fa0a00c26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:16.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.155+0000 7fa0a5bf4700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa0a00c2bb0 0x7fa0a0066060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:16.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.155+0000 7fa0a5bf4700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a006a350 con 0x7fa0a0150460 2023-11-15T02:55:16.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.155+0000 7fa0a5bf4700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a0069740 con 0x7fa0a00c2bb0 2023-11-15T02:55:16.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.155+0000 7fa0a5bf4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a0069a20 con 0x7fa0a0069210 2023-11-15T02:55:16.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.155+0000 7fa0a4bf2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa0a0150460 0x7fa0a0150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:16.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.155+0000 7fa0a4bf2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa0a0150460 0x7fa0a0150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41146/0 (socket says 172.21.15.1:41146) 2023-11-15T02:55:16.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.155+0000 7fa0a4bf2700 1 -- 172.21.15.1:0/3548554773 learned_addr learned my addr 172.21.15.1:0/3548554773 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:16.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.155+0000 7fa09ffff700 1 --2- 172.21.15.1:0/3548554773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa0a0069210 0x7fa0a00c26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:16.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.155+0000 7fa0a53f3700 1 --2- 172.21.15.1:0/3548554773 >> v2:172.21.15.141:3300/0 conn(0x7fa0a00c2bb0 0x7fa0a0066060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:16.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.155+0000 7fa0a4bf2700 1 -- 172.21.15.1:0/3548554773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa0a0069210 msgr2=0x7fa0a00c26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:16.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.155+0000 7fa0a4bf2700 1 --2- 172.21.15.1:0/3548554773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa0a0069210 0x7fa0a00c26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:16.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa0a4bf2700 1 -- 172.21.15.1:0/3548554773 >> v2:172.21.15.141:3300/0 conn(0x7fa0a00c2bb0 msgr2=0x7fa0a0066060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:16.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa0a4bf2700 1 --2- 172.21.15.1:0/3548554773 >> v2:172.21.15.141:3300/0 conn(0x7fa0a00c2bb0 0x7fa0a0066060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:16.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa0a4bf2700 1 -- 172.21.15.1:0/3548554773 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a0069d00 con 0x7fa0a0150460 2023-11-15T02:55:16.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa0a4bf2700 1 --2- 172.21.15.1:0/3548554773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0a0150460 0x7fa0a0150840 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7fa0a00c7120 tx=0x7fa09400b3b0).ready entity=mon.0 client_cookie=f41dee5b61a3857d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:16.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa09f7fe700 1 -- 172.21.15.1:0/3548554773 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09400db10 con 0x7fa0a0150460 2023-11-15T02:55:16.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa09f7fe700 1 -- 172.21.15.1:0/3548554773 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09400dc70 con 0x7fa0a0150460 2023-11-15T02:55:16.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa09f7fe700 1 -- 172.21.15.1:0/3548554773 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094010470 con 0x7fa0a0150460 2023-11-15T02:55:16.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa0a5bf4700 1 -- 172.21.15.1:0/3548554773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0a0150460 msgr2=0x7fa0a0150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:16.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa0a5bf4700 1 --2- 172.21.15.1:0/3548554773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0a0150460 0x7fa0a0150840 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7fa0a00c7120 tx=0x7fa09400b3b0).stop 2023-11-15T02:55:16.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa0a5bf4700 1 -- 172.21.15.1:0/3548554773 shutdown_connections 2023-11-15T02:55:16.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa0a5bf4700 1 --2- 172.21.15.1:0/3548554773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0a0150460 0x7fa0a0150840 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:16.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa0a5bf4700 1 --2- 172.21.15.1:0/3548554773 >> v2:172.21.15.141:3300/0 conn(0x7fa0a00c2bb0 0x7fa0a0066060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:16.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa0a5bf4700 1 --2- 172.21.15.1:0/3548554773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa0a0069210 0x7fa0a00c26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:16.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa0a5bf4700 1 -- 172.21.15.1:0/3548554773 >> 172.21.15.1:0/3548554773 conn(0x7fa0a00c7c10 msgr2=0x7fa0a00c3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:16.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa0a5bf4700 1 -- 172.21.15.1:0/3548554773 shutdown_connections 2023-11-15T02:55:16.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.156+0000 7fa0a5bf4700 1 -- 172.21.15.1:0/3548554773 wait complete. 2023-11-15T02:55:16.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.158+0000 7fa0a5bf4700 1 Processor -- start 2023-11-15T02:55:16.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.158+0000 7fa0a5bf4700 1 -- start start 2023-11-15T02:55:16.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.158+0000 7fa0a5bf4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0a0069210 0x7fa0a0140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:16.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.158+0000 7fa0a5bf4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa0a00c2bb0 0x7fa0a00acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:16.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.158+0000 7fa0a5bf4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa0a0150460 0x7fa0a00ab260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:16.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.158+0000 7fa0a5bf4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00ac930 con 0x7fa0a0069210 2023-11-15T02:55:16.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.158+0000 7fa0a5bf4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a0156be0 con 0x7fa0a00c2bb0 2023-11-15T02:55:16.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.158+0000 7fa0a5bf4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00abd20 con 0x7fa0a0150460 2023-11-15T02:55:16.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.159+0000 7fa0a4bf2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0a0069210 0x7fa0a0140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:16.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.159+0000 7fa0a4bf2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0a0069210 0x7fa0a0140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41154/0 (socket says 172.21.15.1:41154) 2023-11-15T02:55:16.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.159+0000 7fa0a4bf2700 1 -- 172.21.15.1:0/1099778202 learned_addr learned my addr 172.21.15.1:0/1099778202 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:16.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.159+0000 7fa0a4bf2700 1 -- 172.21.15.1:0/1099778202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa0a0150460 msgr2=0x7fa0a00ab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:16.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.159+0000 7fa0a4bf2700 1 --2- 172.21.15.1:0/1099778202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa0a0150460 0x7fa0a00ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:16.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.159+0000 7fa0a4bf2700 1 -- 172.21.15.1:0/1099778202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa0a00c2bb0 msgr2=0x7fa0a00acdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:16.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.159+0000 7fa0a4bf2700 1 --2- 172.21.15.1:0/1099778202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa0a00c2bb0 0x7fa0a00acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:16.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.159+0000 7fa0a4bf2700 1 -- 172.21.15.1:0/1099778202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09400b610 con 0x7fa0a0069210 2023-11-15T02:55:16.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.159+0000 7fa0a4bf2700 1 --2- 172.21.15.1:0/1099778202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0a0069210 0x7fa0a0140e20 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7fa09400bfd0 tx=0x7fa0a006a2c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:16.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.159+0000 7fa09cff9700 1 -- 172.21.15.1:0/1099778202 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094020070 con 0x7fa0a0069210 2023-11-15T02:55:16.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.159+0000 7fa09cff9700 1 -- 172.21.15.1:0/1099778202 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa094000d10 con 0x7fa0a0069210 2023-11-15T02:55:16.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.159+0000 7fa0a5bf4700 1 -- 172.21.15.1:0/1099778202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a00ac000 con 0x7fa0a0069210 2023-11-15T02:55:16.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.159+0000 7fa09cff9700 1 -- 172.21.15.1:0/1099778202 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0940198b0 con 0x7fa0a0069210 2023-11-15T02:55:16.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.159+0000 7fa0a5bf4700 1 -- 172.21.15.1:0/1099778202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a00ac5c0 con 0x7fa0a0069210 2023-11-15T02:55:16.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.160+0000 7fa0a5bf4700 1 -- 172.21.15.1:0/1099778202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a00ac780 con 0x7fa0a0069210 2023-11-15T02:55:16.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.161+0000 7fa09cff9700 1 -- 172.21.15.1:0/1099778202 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa094019c60 con 0x7fa0a0069210 2023-11-15T02:55:16.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.161+0000 7fa09cff9700 1 --2- 172.21.15.1:0/1099778202 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa08405f270 0x7fa084061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:16.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.161+0000 7fa09cff9700 1 -- 172.21.15.1:0/1099778202 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6423+0+0 (secure 0 0 0) 0x7fa09407e170 con 0x7fa0a0069210 2023-11-15T02:55:16.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.161+0000 7fa09ffff700 1 --2- 172.21.15.1:0/1099778202 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa08405f270 0x7fa084061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:16.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.162+0000 7fa09ffff700 1 --2- 172.21.15.1:0/1099778202 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa08405f270 0x7fa084061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fa0a01565b0 tx=0x7fa08c008040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:16.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.165+0000 7fa09cff9700 1 -- 172.21.15.1:0/1099778202 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa09404f250 con 0x7fa0a0069210 2023-11-15T02:55:16.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:16.354+0000 7fa0a5bf4700 1 -- 172.21.15.1:0/1099778202 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa0a00475e0 con 0x7fa0a0069210 2023-11-15T02:55:17.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.184+0000 7fa09cff9700 1 -- 172.21.15.1:0/1099778202 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v208) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa094052870 con 0x7fa0a0069210 2023-11-15T02:55:17.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.187+0000 7fa0a5bf4700 1 -- 172.21.15.1:0/1099778202 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa08405f270 msgr2=0x7fa084061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:17.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.187+0000 7fa0a5bf4700 1 --2- 172.21.15.1:0/1099778202 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa08405f270 0x7fa084061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fa0a01565b0 tx=0x7fa08c008040).stop 2023-11-15T02:55:17.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.187+0000 7fa0a5bf4700 1 -- 172.21.15.1:0/1099778202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0a0069210 msgr2=0x7fa0a0140e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:17.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.187+0000 7fa0a5bf4700 1 --2- 172.21.15.1:0/1099778202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0a0069210 0x7fa0a0140e20 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7fa09400bfd0 tx=0x7fa0a006a2c0).stop 2023-11-15T02:55:17.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.187+0000 7fa0a5bf4700 1 -- 172.21.15.1:0/1099778202 shutdown_connections 2023-11-15T02:55:17.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.187+0000 7fa0a5bf4700 1 --2- 172.21.15.1:0/1099778202 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa08405f270 0x7fa084061730 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.187+0000 7fa0a5bf4700 1 --2- 172.21.15.1:0/1099778202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa0a0150460 0x7fa0a00ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:17.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.187+0000 7fa0a5bf4700 1 --2- 172.21.15.1:0/1099778202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0a0069210 0x7fa0a0140e20 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.187+0000 7fa0a5bf4700 1 --2- 172.21.15.1:0/1099778202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa0a00c2bb0 0x7fa0a00acdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:17.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.187+0000 7fa0a5bf4700 1 -- 172.21.15.1:0/1099778202 >> 172.21.15.1:0/1099778202 conn(0x7fa0a00c7c10 msgr2=0x7fa0a00c5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:17.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.187+0000 7fa0a5bf4700 1 -- 172.21.15.1:0/1099778202 shutdown_connections 2023-11-15T02:55:17.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.187+0000 7fa0a5bf4700 1 -- 172.21.15.1:0/1099778202 wait complete. 2023-11-15T02:55:17.191 INFO:teuthology.orchestra.run.smithi001.stderr: removed all blocklist entries 2023-11-15T02:55:17.202 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-15T02:55:17.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.326+0000 7f67677b9700 1 Processor -- start 2023-11-15T02:55:17.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.326+0000 7f67677b9700 1 -- start start 2023-11-15T02:55:17.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.327+0000 7f67677b9700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f67600ab1a0 0x7f6760154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:17.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.327+0000 7f67677b9700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f67600aa060 0x7f67600c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:17.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.327+0000 7f67677b9700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67600c06f0 con 0x7f6760154150 2023-11-15T02:55:17.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.327+0000 7f67677b9700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67600c09d0 con 0x7f67600aa060 2023-11-15T02:55:17.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.327+0000 7f67677b9700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6760158820 con 0x7f67600ab1a0 2023-11-15T02:55:17.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.327+0000 7f6765d56700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f67600aa060 0x7f67600c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:17.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.327+0000 7f6765555700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6760154150 0x7f6760158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:59974/0 (socket says 172.21.15.1:59974) 2023-11-15T02:55:17.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.327+0000 7f6765555700 1 -- 172.21.15.1:0/507606820 learned_addr learned my addr 172.21.15.1:0/507606820 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:17.331 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.328+0000 7f6764d54700 1 --2- 172.21.15.1:0/507606820 >> v2:172.21.15.141:3300/0 conn(0x7f67600ab1a0 0x7f6760154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:17.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.328+0000 7f6765d56700 1 -- 172.21.15.1:0/507606820 >> v2:172.21.15.141:3300/0 conn(0x7f67600ab1a0 msgr2=0x7f6760154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:17.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.328+0000 7f6765d56700 1 --2- 172.21.15.1:0/507606820 >> v2:172.21.15.141:3300/0 conn(0x7f67600ab1a0 0x7f6760154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.328+0000 7f6765d56700 1 -- 172.21.15.1:0/507606820 >> v1:172.21.15.1:6789/0 conn(0x7f6760154150 legacy=0x7f6760158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:17.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.328+0000 7f6765d56700 1 -- 172.21.15.1:0/507606820 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6760158b00 con 0x7f67600aa060 2023-11-15T02:55:17.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.328+0000 7f675ffff700 1 -- 172.21.15.1:0/507606820 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993558246 0 0) 0x7f67600c06f0 con 0x7f6760154150 2023-11-15T02:55:17.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.328+0000 7f6765d56700 1 --2- 172.21.15.1:0/507606820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67600aa060 0x7f67600c5f10 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7f6760158750 tx=0x7f6750009780).ready entity=mon.0 client_cookie=68224d37a7727f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:17.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.328+0000 7f675ffff700 1 -- 172.21.15.1:0/507606820 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675000e070 con 0x7f67600aa060 2023-11-15T02:55:17.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.328+0000 7f675ffff700 1 -- 172.21.15.1:0/507606820 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675000bc30 con 0x7f67600aa060 2023-11-15T02:55:17.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.328+0000 7f675ffff700 1 -- 172.21.15.1:0/507606820 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750012410 con 0x7f67600aa060 2023-11-15T02:55:17.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.328+0000 7f67677b9700 1 -- 172.21.15.1:0/507606820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67600aa060 msgr2=0x7f67600c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:17.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.328+0000 7f67677b9700 1 --2- 172.21.15.1:0/507606820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67600aa060 0x7f67600c5f10 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7f6760158750 tx=0x7f6750009780).stop 2023-11-15T02:55:17.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.329+0000 7f67677b9700 1 -- 172.21.15.1:0/507606820 shutdown_connections 2023-11-15T02:55:17.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.329+0000 7f67677b9700 1 --2- 172.21.15.1:0/507606820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67600aa060 0x7f67600c5f10 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.329+0000 7f67677b9700 1 --2- 172.21.15.1:0/507606820 >> v2:172.21.15.141:3300/0 conn(0x7f67600ab1a0 0x7f6760154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.329+0000 7f67677b9700 1 -- 172.21.15.1:0/507606820 >> 172.21.15.1:0/507606820 conn(0x7f6760064aa0 msgr2=0x7f6760064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:17.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.329+0000 7f67677b9700 1 -- 172.21.15.1:0/507606820 shutdown_connections 2023-11-15T02:55:17.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.329+0000 7f67677b9700 1 -- 172.21.15.1:0/507606820 wait complete. 2023-11-15T02:55:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.330+0000 7f67677b9700 1 Processor -- start 2023-11-15T02:55:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.330+0000 7f67677b9700 1 -- start start 2023-11-15T02:55:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f67677b9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67600aa060 0x7f6760156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f67677b9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67600ab1a0 0x7f67600ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f67677b9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6760154150 0x7f6760163780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f67677b9700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6760151bd0 con 0x7f67600aa060 2023-11-15T02:55:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f67677b9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6760151eb0 con 0x7f67600ab1a0 2023-11-15T02:55:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f67677b9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6760152190 con 0x7f6760154150 2023-11-15T02:55:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f6765555700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67600aa060 0x7f6760156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f6765555700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67600aa060 0x7f6760156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41178/0 (socket says 172.21.15.1:41178) 2023-11-15T02:55:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f6765555700 1 -- 172.21.15.1:0/1090235091 learned_addr learned my addr 172.21.15.1:0/1090235091 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f6764d54700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67600ab1a0 0x7f67600ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f6765d56700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6760154150 0x7f6760163780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f6765555700 1 -- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6760154150 msgr2=0x7f6760163780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f6765555700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6760154150 0x7f6760163780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f6765555700 1 -- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67600ab1a0 msgr2=0x7f67600ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f6765555700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67600ab1a0 0x7f67600ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f6765555700 1 -- 172.21.15.1:0/1090235091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6750009a20 con 0x7f67600aa060 2023-11-15T02:55:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f6765d56700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6760154150 0x7f6760163780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f6764d54700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67600ab1a0 0x7f67600ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f6765555700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67600aa060 0x7f6760156490 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f6758001eb0 tx=0x7f6758007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.331+0000 7f675d7fa700 1 -- 172.21.15.1:0/1090235091 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580072e0 con 0x7f67600aa060 2023-11-15T02:55:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.332+0000 7f675d7fa700 1 -- 172.21.15.1:0/1090235091 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6758007440 con 0x7f67600aa060 2023-11-15T02:55:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.332+0000 7f67677b9700 1 -- 172.21.15.1:0/1090235091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6760152470 con 0x7f67600aa060 2023-11-15T02:55:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.332+0000 7f675d7fa700 1 -- 172.21.15.1:0/1090235091 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580057a0 con 0x7f67600aa060 2023-11-15T02:55:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.332+0000 7f67677b9700 1 -- 172.21.15.1:0/1090235091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6760156980 con 0x7f67600aa060 2023-11-15T02:55:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.333+0000 7f67677b9700 1 -- 172.21.15.1:0/1090235091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6760151d10 con 0x7f67600aa060 2023-11-15T02:55:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.333+0000 7f675d7fa700 1 -- 172.21.15.1:0/1090235091 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6758005bd0 con 0x7f67600aa060 2023-11-15T02:55:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.333+0000 7f675d7fa700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f674c05f270 0x7f674c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.333+0000 7f675d7fa700 1 -- 172.21.15.1:0/1090235091 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 5821+0+0 (secure 0 0 0) 0x7f6758079a70 con 0x7f67600aa060 2023-11-15T02:55:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.334+0000 7f6764d54700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f674c05f270 0x7f674c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.334+0000 7f6764d54700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f674c05f270 0x7f674c061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6760157bb0 tx=0x7f6754008040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.338+0000 7f675d7fa700 1 -- 172.21.15.1:0/1090235091 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6760151d10 con 0x7f67600aa060 2023-11-15T02:55:17.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.577+0000 7f67677b9700 1 -- 172.21.15.1:0/1090235091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f676006c7e0 con 0x7f67600aa060 2023-11-15T02:55:17.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.578+0000 7f675d7fa700 1 -- 172.21.15.1:0/1090235091 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v51) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f675804ac30 con 0x7f67600aa060 2023-11-15T02:55:17.579 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:17.579 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:55:17.579 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_dump": [ 2023-11-15T02:55:17.580 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.580 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.a", 2023-11-15T02:55:17.580 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlmtf5GBAA2CojasXoquGQ9L5rKjVwTQ==", 2023-11-15T02:55:17.580 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.580 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:55:17.581 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:55:17.581 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:55:17.581 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:55:17.581 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.581 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.582 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.582 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.b", 2023-11-15T02:55:17.582 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl/Y5mJBAAz7iLl3kBJ8kSsyTetTZByw==", 2023-11-15T02:55:17.582 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.582 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:55:17.583 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:55:17.583 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:55:17.583 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:55:17.583 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.583 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.584 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.584 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.c", 2023-11-15T02:55:17.586 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlWTrwHxAAqLVpwNca0vAXUBFnWUN3pg==", 2023-11-15T02:55:17.586 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.586 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:55:17.586 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:55:17.587 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:55:17.587 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:55:17.587 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.587 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.587 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.588 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.d", 2023-11-15T02:55:17.588 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlVwUnKxAAhx2/mX1ljgQwJLagVpmZIA==", 2023-11-15T02:55:17.588 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.588 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:55:17.588 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:55:17.589 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:55:17.589 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:55:17.589 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.589 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.589 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.590 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.0", 2023-11-15T02:55:17.590 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDxHFRlII6rERAA/kvPPhTPHHy6pu5wSPsR/A==", 2023-11-15T02:55:17.590 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.590 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:55:17.590 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:55:17.591 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:55:17.591 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.591 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.591 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.591 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.1", 2023-11-15T02:55:17.591 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD0HFRlPkstEBAAqx31fnNonRCVh98eY6qbxQ==", 2023-11-15T02:55:17.592 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.592 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:55:17.592 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:55:17.592 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:55:17.592 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.593 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.593 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.2", 2023-11-15T02:55:17.593 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD3HFRl8e3nDRAAKigcbIo0/BFo0Qi6rV+amQ==", 2023-11-15T02:55:17.593 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.594 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:55:17.594 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:55:17.594 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:55:17.594 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.594 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.595 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.595 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.3", 2023-11-15T02:55:17.595 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQD6HFRlbwDTCxAAkWv04RyNqW4p8pOqvYCS3A==", 2023-11-15T02:55:17.595 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.595 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:55:17.596 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:55:17.596 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:55:17.596 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.596 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.596 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.597 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.4", 2023-11-15T02:55:17.597 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAAHVRlTQihDxAA/HcZbSytP9qD5PsTjvJBoA==", 2023-11-15T02:55:17.597 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.597 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:55:17.597 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:55:17.598 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:55:17.598 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.598 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.598 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.5", 2023-11-15T02:55:17.599 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQADHVRlQ2hjDRAAFiI+hKubCPcZ/1AJVu1fvQ==", 2023-11-15T02:55:17.599 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.599 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:55:17.599 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:55:17.599 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:55:17.599 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.600 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.600 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.6", 2023-11-15T02:55:17.600 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAGHVRl/KEbCxAAmKTnRU4m4qNzX+SVcFY+Qw==", 2023-11-15T02:55:17.600 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.601 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:55:17.601 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:55:17.601 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:55:17.601 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.601 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.602 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.602 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.7", 2023-11-15T02:55:17.602 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQAJHVRl4wOFCBAAAiGT4UPE5vSb2LjqgGgGFw==", 2023-11-15T02:55:17.602 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.602 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-11-15T02:55:17.603 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-11-15T02:55:17.603 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:55:17.603 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.603 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.603 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.603 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.0", 2023-11-15T02:55:17.604 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl2hkHLxAAxQE/Cslig6gmXR/xcVlRuw==", 2023-11-15T02:55:17.604 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.604 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:55:17.604 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow r", 2023-11-15T02:55:17.604 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-15T02:55:17.605 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.605 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.605 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.605 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.1", 2023-11-15T02:55:17.605 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRltolkNxAAXmQ4yXOlavwqKq2jFKwsYQ==", 2023-11-15T02:55:17.606 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.606 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:55:17.606 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T02:55:17.606 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T02:55:17.606 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T02:55:17.607 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.607 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.607 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.607 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.2", 2023-11-15T02:55:17.607 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlFrJvNBAAH97x7ERzuzpWrUALO+HvpA==", 2023-11-15T02:55:17.608 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.608 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:55:17.608 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T02:55:17.608 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T02:55:17.608 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T02:55:17.609 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.609 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.609 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.609 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.3", 2023-11-15T02:55:17.609 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDwHFRlko0ZARAA2RqeRJGwWns00DeWgd/9hA==", 2023-11-15T02:55:17.610 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.610 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-11-15T02:55:17.610 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-11-15T02:55:17.610 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-11-15T02:55:17.610 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-11-15T02:55:17.611 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.611 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.611 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.611 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.admin", 2023-11-15T02:55:17.611 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDuHFRlxIQDORAALrVIyQoaVSADkyv9yzMaZw==", 2023-11-15T02:55:17.612 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.612 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T02:55:17.612 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-11-15T02:55:17.612 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-11-15T02:55:17.612 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:55:17.613 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.613 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.613 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.613 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.x", 2023-11-15T02:55:17.613 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRlnyjlFRAAjJwtxkAvJ0ZGmvOOawQseQ==", 2023-11-15T02:55:17.614 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.614 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T02:55:17.614 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T02:55:17.614 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:55:17.614 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:17.615 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:17.615 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.y", 2023-11-15T02:55:17.615 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQDvHFRl8nW3ERAA4CJQt/ZEZCJ9UaRRuEHfzw==", 2023-11-15T02:55:17.616 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-11-15T02:55:17.616 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-11-15T02:55:17.616 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-11-15T02:55:17.616 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-11-15T02:55:17.616 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.617 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:17.617 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2023-11-15T02:55:17.617 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:55:17.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.579+0000 7f67677b9700 1 -- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f674c05f270 msgr2=0x7f674c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:17.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.579+0000 7f67677b9700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f674c05f270 0x7f674c061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6760157bb0 tx=0x7f6754008040).stop 2023-11-15T02:55:17.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.579+0000 7f67677b9700 1 -- 172.21.15.1:0/1090235091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67600aa060 msgr2=0x7f6760156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:17.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.579+0000 7f67677b9700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67600aa060 0x7f6760156490 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f6758001eb0 tx=0x7f6758007e90).stop 2023-11-15T02:55:17.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.580+0000 7f67677b9700 1 -- 172.21.15.1:0/1090235091 shutdown_connections 2023-11-15T02:55:17.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.580+0000 7f67677b9700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f674c05f270 0x7f674c061730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.580+0000 7f67677b9700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6760154150 0x7f6760163780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.580+0000 7f67677b9700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67600aa060 0x7f6760156490 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.580+0000 7f67677b9700 1 --2- 172.21.15.1:0/1090235091 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f67600ab1a0 0x7f67600ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.580+0000 7f67677b9700 1 -- 172.21.15.1:0/1090235091 >> 172.21.15.1:0/1090235091 conn(0x7f6760064aa0 msgr2=0x7f67600ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:17.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.580+0000 7f67677b9700 1 -- 172.21.15.1:0/1090235091 shutdown_connections 2023-11-15T02:55:17.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.580+0000 7f67677b9700 1 -- 172.21.15.1:0/1090235091 wait complete. 2023-11-15T02:55:17.622 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:55:17.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.739+0000 7ff7a09d4700 1 Processor -- start 2023-11-15T02:55:17.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.739+0000 7ff7a09d4700 1 -- start start 2023-11-15T02:55:17.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.740+0000 7ff7a09d4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff79c151e10 0x7ff79c155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:17.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.740+0000 7ff7a09d4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff79c0c86b0 0x7ff79c0aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:17.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.740+0000 7ff7a09d4700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79c0c7980 con 0x7ff79c0c98b0 2023-11-15T02:55:17.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.740+0000 7ff7a09d4700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79c0c8b10 con 0x7ff79c151e10 2023-11-15T02:55:17.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.740+0000 7ff7a09d4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c0aa5c0 con 0x7ff79c0c86b0 2023-11-15T02:55:17.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.740+0000 7ff79ad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff79c151e10 0x7ff79c155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:17.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.740+0000 7ff79b59e700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff79c0c98b0 0x7ff79c0c61a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:50060/0 (socket says 172.21.15.1:50060) 2023-11-15T02:55:17.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.740+0000 7ff79b59e700 1 -- 172.21.15.1:0/1963578237 learned_addr learned my addr 172.21.15.1:0/1963578237 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:17.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.740+0000 7ff79a59c700 1 --2- 172.21.15.1:0/1963578237 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff79c0c86b0 0x7ff79c0aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.740+0000 7ff799d9b700 1 -- 172.21.15.1:0/1963578237 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814486119 0 0) 0x7ff79c0c7980 con 0x7ff79c0c98b0 2023-11-15T02:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.740+0000 7ff799d9b700 1 -- 172.21.15.1:0/1963578237 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7880033f0 con 0x7ff79c0c98b0 2023-11-15T02:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.740+0000 7ff79ad9d700 1 -- 172.21.15.1:0/1963578237 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff79c0c86b0 msgr2=0x7ff79c0aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.740+0000 7ff79ad9d700 1 --2- 172.21.15.1:0/1963578237 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff79c0c86b0 0x7ff79c0aa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.740+0000 7ff79ad9d700 1 -- 172.21.15.1:0/1963578237 >> v1:172.21.15.1:6789/0 conn(0x7ff79c0c98b0 legacy=0x7ff79c0c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.740+0000 7ff79ad9d700 1 -- 172.21.15.1:0/1963578237 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c0aa890 con 0x7ff79c151e10 2023-11-15T02:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.741+0000 7ff79ad9d700 1 --2- 172.21.15.1:0/1963578237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff79c151e10 0x7ff79c155530 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7ff78c009760 tx=0x7ff78c009060).ready entity=mon.0 client_cookie=e54f39b2537080cd server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.741+0000 7ff799d9b700 1 -- 172.21.15.1:0/1963578237 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c00d4a0 con 0x7ff79c151e10 2023-11-15T02:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.741+0000 7ff799d9b700 1 -- 172.21.15.1:0/1963578237 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c00d600 con 0x7ff79c151e10 2023-11-15T02:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.741+0000 7ff799d9b700 1 -- 172.21.15.1:0/1963578237 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c00d980 con 0x7ff79c151e10 2023-11-15T02:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.741+0000 7ff7a09d4700 1 -- 172.21.15.1:0/1963578237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff79c151e10 msgr2=0x7ff79c155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:17.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.741+0000 7ff7a09d4700 1 --2- 172.21.15.1:0/1963578237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff79c151e10 0x7ff79c155530 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7ff78c009760 tx=0x7ff78c009060).stop 2023-11-15T02:55:17.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.741+0000 7ff7a09d4700 1 -- 172.21.15.1:0/1963578237 shutdown_connections 2023-11-15T02:55:17.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.741+0000 7ff7a09d4700 1 --2- 172.21.15.1:0/1963578237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff79c151e10 0x7ff79c155530 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.741+0000 7ff7a09d4700 1 --2- 172.21.15.1:0/1963578237 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff79c0c86b0 0x7ff79c0aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.741+0000 7ff7a09d4700 1 -- 172.21.15.1:0/1963578237 >> 172.21.15.1:0/1963578237 conn(0x7ff79c0947e0 msgr2=0x7ff79c06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:17.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.741+0000 7ff7a09d4700 1 -- 172.21.15.1:0/1963578237 shutdown_connections 2023-11-15T02:55:17.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.741+0000 7ff7a09d4700 1 -- 172.21.15.1:0/1963578237 wait complete. 2023-11-15T02:55:17.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.743+0000 7ff7a09d4700 1 Processor -- start 2023-11-15T02:55:17.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.743+0000 7ff7a09d4700 1 -- start start 2023-11-15T02:55:17.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.743+0000 7ff7a09d4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff79c0c86b0 0x7ff79c1594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:17.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.743+0000 7ff7a09d4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff79c0c98b0 0x7ff79c0aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:17.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.743+0000 7ff7a09d4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff79c151e10 0x7ff79c0ab210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:17.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.743+0000 7ff7a09d4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c0ab700 con 0x7ff79c0c86b0 2023-11-15T02:55:17.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.743+0000 7ff7a09d4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c159060 con 0x7ff79c0c98b0 2023-11-15T02:55:17.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.743+0000 7ff7a09d4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c158450 con 0x7ff79c151e10 2023-11-15T02:55:17.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.743+0000 7ff79ad9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff79c0c86b0 0x7ff79c1594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:17.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.743+0000 7ff79ad9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff79c0c86b0 0x7ff79c1594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36234/0 (socket says 172.21.15.1:36234) 2023-11-15T02:55:17.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.743+0000 7ff79ad9d700 1 -- 172.21.15.1:0/4058547351 learned_addr learned my addr 172.21.15.1:0/4058547351 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:17.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.744+0000 7ff79b59e700 1 --2- 172.21.15.1:0/4058547351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff79c151e10 0x7ff79c0ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:17.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.744+0000 7ff79a59c700 1 --2- 172.21.15.1:0/4058547351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff79c0c98b0 0x7ff79c0aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:17.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.744+0000 7ff79ad9d700 1 -- 172.21.15.1:0/4058547351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff79c151e10 msgr2=0x7ff79c0ab210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:17.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.744+0000 7ff79ad9d700 1 --2- 172.21.15.1:0/4058547351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff79c151e10 0x7ff79c0ab210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.744+0000 7ff79ad9d700 1 -- 172.21.15.1:0/4058547351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff79c0c98b0 msgr2=0x7ff79c0aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:17.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.744+0000 7ff79ad9d700 1 --2- 172.21.15.1:0/4058547351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff79c0c98b0 0x7ff79c0aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.744+0000 7ff79ad9d700 1 -- 172.21.15.1:0/4058547351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c0092a0 con 0x7ff79c0c86b0 2023-11-15T02:55:17.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.744+0000 7ff79ad9d700 1 --2- 172.21.15.1:0/4058547351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff79c0c86b0 0x7ff79c1594f0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7ff79c084670 tx=0x7ff78c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:17.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.744+0000 7ff792ffd700 1 -- 172.21.15.1:0/4058547351 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c000c90 con 0x7ff79c0c86b0 2023-11-15T02:55:17.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.744+0000 7ff792ffd700 1 -- 172.21.15.1:0/4058547351 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c00d770 con 0x7ff79c0c86b0 2023-11-15T02:55:17.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.744+0000 7ff792ffd700 1 -- 172.21.15.1:0/4058547351 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c01d430 con 0x7ff79c0c86b0 2023-11-15T02:55:17.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.744+0000 7ff7a09d4700 1 -- 172.21.15.1:0/4058547351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff79c158730 con 0x7ff79c0c86b0 2023-11-15T02:55:17.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.744+0000 7ff7a09d4700 1 -- 172.21.15.1:0/4058547351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79c158cf0 con 0x7ff79c0c86b0 2023-11-15T02:55:17.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.745+0000 7ff7a09d4700 1 -- 172.21.15.1:0/4058547351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79c159340 con 0x7ff79c0c86b0 2023-11-15T02:55:17.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.745+0000 7ff792ffd700 1 -- 172.21.15.1:0/4058547351 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff78c01d860 con 0x7ff79c0c86b0 2023-11-15T02:55:17.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.746+0000 7ff792ffd700 1 --2- 172.21.15.1:0/4058547351 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff77c05f270 0x7ff77c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:17.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.746+0000 7ff792ffd700 1 -- 172.21.15.1:0/4058547351 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 5821+0+0 (secure 0 0 0) 0x7ff78c07bac0 con 0x7ff79c0c86b0 2023-11-15T02:55:17.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.746+0000 7ff79a59c700 1 --2- 172.21.15.1:0/4058547351 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff77c05f270 0x7ff77c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:17.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.746+0000 7ff79a59c700 1 --2- 172.21.15.1:0/4058547351 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff77c05f270 0x7ff77c061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff79c0ade70 tx=0x7ff784008040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:17.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.750+0000 7ff792ffd700 1 -- 172.21.15.1:0/4058547351 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff78c04cd40 con 0x7ff79c0c86b0 2023-11-15T02:55:17.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.922+0000 7ff7a09d4700 1 -- 172.21.15.1:0/4058547351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff79c0475e0 con 0x7ff79c0c86b0 2023-11-15T02:55:17.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.923+0000 7ff792ffd700 1 -- 172.21.15.1:0/4058547351 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v208) v1 ==== 74+0+14526 (secure 0 0 0) 0x7ff78c050360 con 0x7ff79c0c86b0 2023-11-15T02:55:17.924 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:17.925 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":208,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:55:17.178712+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:55:17.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.924+0000 7ff7a09d4700 1 -- 172.21.15.1:0/4058547351 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff77c05f270 msgr2=0x7ff77c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:17.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.924+0000 7ff7a09d4700 1 --2- 172.21.15.1:0/4058547351 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff77c05f270 0x7ff77c061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff79c0ade70 tx=0x7ff784008040).stop 2023-11-15T02:55:17.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.924+0000 7ff7a09d4700 1 -- 172.21.15.1:0/4058547351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff79c0c86b0 msgr2=0x7ff79c1594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:17.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.924+0000 7ff7a09d4700 1 --2- 172.21.15.1:0/4058547351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff79c0c86b0 0x7ff79c1594f0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7ff79c084670 tx=0x7ff78c016000).stop 2023-11-15T02:55:17.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.924+0000 7ff7a09d4700 1 -- 172.21.15.1:0/4058547351 shutdown_connections 2023-11-15T02:55:17.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.924+0000 7ff7a09d4700 1 --2- 172.21.15.1:0/4058547351 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff77c05f270 0x7ff77c061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.924+0000 7ff7a09d4700 1 --2- 172.21.15.1:0/4058547351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff79c151e10 0x7ff79c0ab210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.924+0000 7ff7a09d4700 1 --2- 172.21.15.1:0/4058547351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff79c0c86b0 0x7ff79c1594f0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.924+0000 7ff7a09d4700 1 --2- 172.21.15.1:0/4058547351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff79c0c98b0 0x7ff79c0aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:17.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.924+0000 7ff7a09d4700 1 -- 172.21.15.1:0/4058547351 >> 172.21.15.1:0/4058547351 conn(0x7ff79c0947e0 msgr2=0x7ff79c150be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:17.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.924+0000 7ff7a09d4700 1 -- 172.21.15.1:0/4058547351 shutdown_connections 2023-11-15T02:55:17.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:17.924+0000 7ff7a09d4700 1 -- 172.21.15.1:0/4058547351 wait complete. 2023-11-15T02:55:17.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '201', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-15T02:55:17.938 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T02:55:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.059+0000 7f160759e700 1 Processor -- start 2023-11-15T02:55:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.059+0000 7f160759e700 1 -- start start 2023-11-15T02:55:18.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.060+0000 7f160759e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16081545b0 0x7f16080c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.060+0000 7f160759e700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f16080c7f50 0x7f16080c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.060+0000 7f160759e700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1608155830 con 0x7f16081541d0 2023-11-15T02:55:18.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.060+0000 7f160759e700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1608158f40 con 0x7f16080c7f50 2023-11-15T02:55:18.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.060+0000 7f160759e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1608154a30 con 0x7f16081545b0 2023-11-15T02:55:18.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.060+0000 7f1605d9b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16081545b0 0x7f16080c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.060+0000 7f1606d9d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f16080c7f50 0x7f16080c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.060+0000 7f1605d9b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16081545b0 0x7f16080c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:38172/0 (socket says 172.21.15.1:38172) 2023-11-15T02:55:18.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.060+0000 7f1605d9b700 1 -- 172.21.15.1:0/1319294593 learned_addr learned my addr 172.21.15.1:0/1319294593 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:18.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.060+0000 7f1606d9d700 1 -- 172.21.15.1:0/1319294593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16081545b0 msgr2=0x7f16080c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:18.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.060+0000 7f1606d9d700 1 --2- 172.21.15.1:0/1319294593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16081545b0 0x7f16080c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.060+0000 7f1606d9d700 1 -- 172.21.15.1:0/1319294593 >> v1:172.21.15.141:6789/0 conn(0x7f16081541d0 legacy=0x7f16080c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.060+0000 7f1606d9d700 1 -- 172.21.15.1:0/1319294593 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16080c83a0 con 0x7f16080c7f50 2023-11-15T02:55:18.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.060+0000 7f1605d9b700 1 --2- 172.21.15.1:0/1319294593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16081545b0 0x7f16080c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:18.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.061+0000 7f1606d9d700 1 --2- 172.21.15.1:0/1319294593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16080c7f50 0x7f16080c9620 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f15f8009760 tx=0x7f15f8009060).ready entity=mon.1 client_cookie=8aba9adb17312e26 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:18.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.061+0000 7f160559a700 1 -- 172.21.15.1:0/1319294593 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f800f510 con 0x7f16080c7f50 2023-11-15T02:55:18.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.061+0000 7f160559a700 1 -- 172.21.15.1:0/1319294593 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f800f670 con 0x7f16080c7f50 2023-11-15T02:55:18.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.061+0000 7f160559a700 1 -- 172.21.15.1:0/1319294593 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f800f9f0 con 0x7f16080c7f50 2023-11-15T02:55:18.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.061+0000 7f160759e700 1 -- 172.21.15.1:0/1319294593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16080c7f50 msgr2=0x7f16080c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.061+0000 7f160759e700 1 --2- 172.21.15.1:0/1319294593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16080c7f50 0x7f16080c9620 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f15f8009760 tx=0x7f15f8009060).stop 2023-11-15T02:55:18.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.061+0000 7f160759e700 1 -- 172.21.15.1:0/1319294593 shutdown_connections 2023-11-15T02:55:18.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.061+0000 7f160759e700 1 --2- 172.21.15.1:0/1319294593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16080c7f50 0x7f16080c9620 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.061+0000 7f160759e700 1 --2- 172.21.15.1:0/1319294593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16081545b0 0x7f16080c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.061+0000 7f160759e700 1 -- 172.21.15.1:0/1319294593 >> 172.21.15.1:0/1319294593 conn(0x7f1608069ee0 msgr2=0x7f160806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.061+0000 7f160759e700 1 -- 172.21.15.1:0/1319294593 shutdown_connections 2023-11-15T02:55:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.061+0000 7f160759e700 1 -- 172.21.15.1:0/1319294593 wait complete. 2023-11-15T02:55:18.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.062+0000 7f160759e700 1 Processor -- start 2023-11-15T02:55:18.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.063+0000 7f160759e700 1 -- start start 2023-11-15T02:55:18.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.063+0000 7f160759e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16080c7f50 0x7f160814d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.063+0000 7f160759e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16081541d0 0x7f16080c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.063+0000 7f160759e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16081545b0 0x7f16080c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.063+0000 7f160759e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16080c4cf0 con 0x7f16081541d0 2023-11-15T02:55:18.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.063+0000 7f160759e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16081574c0 con 0x7f16080c7f50 2023-11-15T02:55:18.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.063+0000 7f160759e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1608156bb0 con 0x7f16081545b0 2023-11-15T02:55:18.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.063+0000 7f1605d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16081541d0 0x7f16080c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.063+0000 7f1605d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16081541d0 0x7f16080c4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36242/0 (socket says 172.21.15.1:36242) 2023-11-15T02:55:18.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.063+0000 7f1605d9b700 1 -- 172.21.15.1:0/3082617681 learned_addr learned my addr 172.21.15.1:0/3082617681 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:18.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.064+0000 7f1606d9d700 1 --2- 172.21.15.1:0/3082617681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16081545b0 0x7f16080c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.064+0000 7f160659c700 1 --2- 172.21.15.1:0/3082617681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16080c7f50 0x7f160814d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.064+0000 7f1605d9b700 1 -- 172.21.15.1:0/3082617681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16081545b0 msgr2=0x7f16080c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.064+0000 7f1605d9b700 1 --2- 172.21.15.1:0/3082617681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16081545b0 0x7f16080c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.064+0000 7f1605d9b700 1 -- 172.21.15.1:0/3082617681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16080c7f50 msgr2=0x7f160814d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.064+0000 7f1605d9b700 1 --2- 172.21.15.1:0/3082617681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16080c7f50 0x7f160814d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.064+0000 7f1605d9b700 1 -- 172.21.15.1:0/3082617681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f0009370 con 0x7f16081541d0 2023-11-15T02:55:18.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.064+0000 7f1606d9d700 1 --2- 172.21.15.1:0/3082617681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16081545b0 0x7f16080c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:18.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.064+0000 7f1605d9b700 1 --2- 172.21.15.1:0/3082617681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16081541d0 0x7f16080c4310 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f15f000ea20 tx=0x7f15f00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:18.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.064+0000 7f15fe7fc700 1 -- 172.21.15.1:0/3082617681 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f000c850 con 0x7f16081541d0 2023-11-15T02:55:18.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.064+0000 7f15fe7fc700 1 -- 172.21.15.1:0/3082617681 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f000c9b0 con 0x7f16081541d0 2023-11-15T02:55:18.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.064+0000 7f160759e700 1 -- 172.21.15.1:0/3082617681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f80092a0 con 0x7f16081541d0 2023-11-15T02:55:18.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.064+0000 7f15fe7fc700 1 -- 172.21.15.1:0/3082617681 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f000cd30 con 0x7f16081541d0 2023-11-15T02:55:18.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.064+0000 7f160759e700 1 -- 172.21.15.1:0/3082617681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1608156ef0 con 0x7f16081541d0 2023-11-15T02:55:18.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.065+0000 7f160759e700 1 -- 172.21.15.1:0/3082617681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16080475e0 con 0x7f16081541d0 2023-11-15T02:55:18.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.065+0000 7f15fe7fc700 1 -- 172.21.15.1:0/3082617681 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f15f0012600 con 0x7f16081541d0 2023-11-15T02:55:18.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.066+0000 7f15fe7fc700 1 --2- 172.21.15.1:0/3082617681 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f15e805f2a0 0x7f15e8061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.066+0000 7f15fe7fc700 1 -- 172.21.15.1:0/3082617681 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 5821+0+0 (secure 0 0 0) 0x7f15f007a830 con 0x7f16081541d0 2023-11-15T02:55:18.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.066+0000 7f160659c700 1 --2- 172.21.15.1:0/3082617681 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f15e805f2a0 0x7f15e8061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.066+0000 7f160659c700 1 --2- 172.21.15.1:0/3082617681 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f15e805f2a0 0x7f15e8061760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1600003e70 tx=0x7f1600009040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:18.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.070+0000 7f15fe7fc700 1 -- 172.21.15.1:0/3082617681 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f15f004bab0 con 0x7f16081541d0 2023-11-15T02:55:18.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.242+0000 7f160759e700 1 -- 172.21.15.1:0/3082617681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1608157210 con 0x7f16081541d0 2023-11-15T02:55:18.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.242+0000 7f15fe7fc700 1 -- 172.21.15.1:0/3082617681 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v208) v1 ==== 110+0+10 (secure 0 0 0) 0x7f15f0016020 con 0x7f16081541d0 2023-11-15T02:55:18.243 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T02:55:18.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.244+0000 7f160759e700 1 -- 172.21.15.1:0/3082617681 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f15e805f2a0 msgr2=0x7f15e8061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.244+0000 7f160759e700 1 --2- 172.21.15.1:0/3082617681 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f15e805f2a0 0x7f15e8061760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1600003e70 tx=0x7f1600009040).stop 2023-11-15T02:55:18.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.244+0000 7f160759e700 1 -- 172.21.15.1:0/3082617681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16081541d0 msgr2=0x7f16080c4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.244+0000 7f160759e700 1 --2- 172.21.15.1:0/3082617681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16081541d0 0x7f16080c4310 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f15f000ea20 tx=0x7f15f00090f0).stop 2023-11-15T02:55:18.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.244+0000 7f160759e700 1 -- 172.21.15.1:0/3082617681 shutdown_connections 2023-11-15T02:55:18.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.244+0000 7f160759e700 1 --2- 172.21.15.1:0/3082617681 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f15e805f2a0 0x7f15e8061760 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.244+0000 7f160759e700 1 --2- 172.21.15.1:0/3082617681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16081545b0 0x7f16080c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.244+0000 7f160759e700 1 --2- 172.21.15.1:0/3082617681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16080c7f50 0x7f160814d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.244+0000 7f160759e700 1 --2- 172.21.15.1:0/3082617681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16081541d0 0x7f16080c4310 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.244+0000 7f160759e700 1 -- 172.21.15.1:0/3082617681 >> 172.21.15.1:0/3082617681 conn(0x7f1608069ee0 msgr2=0x7f16080cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:18.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.244+0000 7f160759e700 1 -- 172.21.15.1:0/3082617681 shutdown_connections 2023-11-15T02:55:18.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.244+0000 7f160759e700 1 -- 172.21.15.1:0/3082617681 wait complete. 2023-11-15T02:55:18.257 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T02:55:18.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.377+0000 7f1c635d1700 1 Processor -- start 2023-11-15T02:55:18.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.377+0000 7f1c635d1700 1 -- start start 2023-11-15T02:55:18.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.378+0000 7f1c635d1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c5c134fa0 0x7f1c5c155690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.378+0000 7f1c635d1700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1c5c135380 0x7f1c5c0bbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.378+0000 7f1c635d1700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1c5c0bc100 0x7f1c5c068500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.378+0000 7f1c635d1700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5c0bc5b0 con 0x7f1c5c135380 2023-11-15T02:55:18.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.378+0000 7f1c635d1700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5c0bd400 con 0x7f1c5c0bc100 2023-11-15T02:55:18.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.378+0000 7f1c635d1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c152a40 con 0x7f1c5c134fa0 2023-11-15T02:55:18.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.378+0000 7f1c60b6c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1c5c135380 0x7f1c5c0bbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.378+0000 7f1c60b6c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1c5c135380 0x7f1c5c0bbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36254/0 (socket says 172.21.15.1:36254) 2023-11-15T02:55:18.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.378+0000 7f1c60b6c700 1 -- 172.21.15.1:0/314329149 learned_addr learned my addr 172.21.15.1:0/314329149 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:18.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.378+0000 7f1c61b6e700 1 --2- 172.21.15.1:0/314329149 >> v2:172.21.15.141:3300/0 conn(0x7f1c5c0bc100 0x7f1c5c068500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.378+0000 7f1c6136d700 1 --2- 172.21.15.1:0/314329149 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c5c134fa0 0x7f1c5c155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c60b6c700 1 -- 172.21.15.1:0/314329149 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c5c134fa0 msgr2=0x7f1c5c155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:18.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c60b6c700 1 --2- 172.21.15.1:0/314329149 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c5c134fa0 0x7f1c5c155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c60b6c700 1 -- 172.21.15.1:0/314329149 >> v2:172.21.15.141:3300/0 conn(0x7f1c5c0bc100 msgr2=0x7f1c5c068500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:18.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c60b6c700 1 --2- 172.21.15.1:0/314329149 >> v2:172.21.15.141:3300/0 conn(0x7f1c5c0bc100 0x7f1c5c068500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c60b6c700 1 -- 172.21.15.1:0/314329149 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c0bc7f0 con 0x7f1c5c135380 2023-11-15T02:55:18.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c60b6c700 1 --2- 172.21.15.1:0/314329149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c5c135380 0x7f1c5c0bbc10 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7f1c5c13be70 tx=0x7f1c500090f0).ready entity=mon.0 client_cookie=e217ef8a9a82d796 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:18.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c5bfff700 1 -- 172.21.15.1:0/314329149 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5000b600 con 0x7f1c5c135380 2023-11-15T02:55:18.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c5bfff700 1 -- 172.21.15.1:0/314329149 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5000b760 con 0x7f1c5c135380 2023-11-15T02:55:18.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c5bfff700 1 -- 172.21.15.1:0/314329149 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5000bae0 con 0x7f1c5c135380 2023-11-15T02:55:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c635d1700 1 -- 172.21.15.1:0/314329149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c5c135380 msgr2=0x7f1c5c0bbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c635d1700 1 --2- 172.21.15.1:0/314329149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c5c135380 0x7f1c5c0bbc10 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7f1c5c13be70 tx=0x7f1c500090f0).stop 2023-11-15T02:55:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c635d1700 1 -- 172.21.15.1:0/314329149 shutdown_connections 2023-11-15T02:55:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c635d1700 1 --2- 172.21.15.1:0/314329149 >> v2:172.21.15.141:3300/0 conn(0x7f1c5c0bc100 0x7f1c5c068500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c635d1700 1 --2- 172.21.15.1:0/314329149 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c5c134fa0 0x7f1c5c155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c635d1700 1 --2- 172.21.15.1:0/314329149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c5c135380 0x7f1c5c0bbc10 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c635d1700 1 -- 172.21.15.1:0/314329149 >> 172.21.15.1:0/314329149 conn(0x7f1c5c063280 msgr2=0x7f1c5c0c6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:18.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c635d1700 1 -- 172.21.15.1:0/314329149 shutdown_connections 2023-11-15T02:55:18.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.379+0000 7f1c635d1700 1 -- 172.21.15.1:0/314329149 wait complete. 2023-11-15T02:55:18.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.381+0000 7f1c635d1700 1 Processor -- start 2023-11-15T02:55:18.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.381+0000 7f1c635d1700 1 -- start start 2023-11-15T02:55:18.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.381+0000 7f1c635d1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c5c0bc100 0x7f1c5c150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.381+0000 7f1c635d1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c5c134fa0 0x7f1c5c164f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.381+0000 7f1c635d1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c5c135380 0x7f1c5c1341c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.381+0000 7f1c635d1700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c164ab0 con 0x7f1c5c0bc100 2023-11-15T02:55:18.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.381+0000 7f1c635d1700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c165430 con 0x7f1c5c134fa0 2023-11-15T02:55:18.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.381+0000 7f1c635d1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c1346b0 con 0x7f1c5c135380 2023-11-15T02:55:18.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c6136d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c5c0bc100 0x7f1c5c150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c6136d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c5c0bc100 0x7f1c5c150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36264/0 (socket says 172.21.15.1:36264) 2023-11-15T02:55:18.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c6136d700 1 -- 172.21.15.1:0/2897776611 learned_addr learned my addr 172.21.15.1:0/2897776611 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:18.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c60b6c700 1 --2- 172.21.15.1:0/2897776611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c5c134fa0 0x7f1c5c164f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c61b6e700 1 --2- 172.21.15.1:0/2897776611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c5c135380 0x7f1c5c1341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c6136d700 1 -- 172.21.15.1:0/2897776611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c5c135380 msgr2=0x7f1c5c1341c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c6136d700 1 --2- 172.21.15.1:0/2897776611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c5c135380 0x7f1c5c1341c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c6136d700 1 -- 172.21.15.1:0/2897776611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c5c134fa0 msgr2=0x7f1c5c164f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c6136d700 1 --2- 172.21.15.1:0/2897776611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c5c134fa0 0x7f1c5c164f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c6136d700 1 -- 172.21.15.1:0/2897776611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c50009370 con 0x7f1c5c0bc100 2023-11-15T02:55:18.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c60b6c700 1 --2- 172.21.15.1:0/2897776611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c5c134fa0 0x7f1c5c164f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:18.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c6136d700 1 --2- 172.21.15.1:0/2897776611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c5c0bc100 0x7f1c5c150940 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7f1c4c00e1c0 tx=0x7f1c4c009920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:18.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c597fa700 1 -- 172.21.15.1:0/2897776611 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00ee60 con 0x7f1c5c0bc100 2023-11-15T02:55:18.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c597fa700 1 -- 172.21.15.1:0/2897776611 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c014400 con 0x7f1c5c0bc100 2023-11-15T02:55:18.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c635d1700 1 -- 172.21.15.1:0/2897776611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5c164480 con 0x7f1c5c0bc100 2023-11-15T02:55:18.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c597fa700 1 -- 172.21.15.1:0/2897776611 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c014780 con 0x7f1c5c0bc100 2023-11-15T02:55:18.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.382+0000 7f1c635d1700 1 -- 172.21.15.1:0/2897776611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5c1396c0 con 0x7f1c5c0bc100 2023-11-15T02:55:18.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.383+0000 7f1c635d1700 1 -- 172.21.15.1:0/2897776611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5c06c7e0 con 0x7f1c5c0bc100 2023-11-15T02:55:18.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.384+0000 7f1c597fa700 1 -- 172.21.15.1:0/2897776611 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1c4c01d3b0 con 0x7f1c5c0bc100 2023-11-15T02:55:18.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.384+0000 7f1c597fa700 1 --2- 172.21.15.1:0/2897776611 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1c4805f270 0x7f1c48061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.384+0000 7f1c597fa700 1 -- 172.21.15.1:0/2897776611 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 5821+0+0 (secure 0 0 0) 0x7f1c4c07a7e0 con 0x7f1c5c0bc100 2023-11-15T02:55:18.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.384+0000 7f1c60b6c700 1 --2- 172.21.15.1:0/2897776611 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1c4805f270 0x7f1c48061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.385+0000 7f1c60b6c700 1 --2- 172.21.15.1:0/2897776611 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1c4805f270 0x7f1c48061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1c5c13be70 tx=0x7f1c50017000).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:18.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.388+0000 7f1c597fa700 1 -- 172.21.15.1:0/2897776611 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1c4c04ba00 con 0x7f1c5c0bc100 2023-11-15T02:55:18.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.558+0000 7f1c635d1700 1 -- 172.21.15.1:0/2897776611 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1c5c0bcad0 con 0x7f1c5c0bc100 2023-11-15T02:55:18.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.559+0000 7f1c597fa700 1 -- 172.21.15.1:0/2897776611 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v208) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1c4c04f020 con 0x7f1c5c0bc100 2023-11-15T02:55:18.560 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T02:55:18.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.560+0000 7f1c635d1700 1 -- 172.21.15.1:0/2897776611 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1c4805f270 msgr2=0x7f1c48061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.560+0000 7f1c635d1700 1 --2- 172.21.15.1:0/2897776611 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1c4805f270 0x7f1c48061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1c5c13be70 tx=0x7f1c50017000).stop 2023-11-15T02:55:18.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.561+0000 7f1c635d1700 1 -- 172.21.15.1:0/2897776611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c5c0bc100 msgr2=0x7f1c5c150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.561+0000 7f1c635d1700 1 --2- 172.21.15.1:0/2897776611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c5c0bc100 0x7f1c5c150940 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7f1c4c00e1c0 tx=0x7f1c4c009920).stop 2023-11-15T02:55:18.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.561+0000 7f1c635d1700 1 -- 172.21.15.1:0/2897776611 shutdown_connections 2023-11-15T02:55:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.561+0000 7f1c635d1700 1 --2- 172.21.15.1:0/2897776611 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1c4805f270 0x7f1c48061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.561+0000 7f1c635d1700 1 --2- 172.21.15.1:0/2897776611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c5c135380 0x7f1c5c1341c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.561+0000 7f1c635d1700 1 --2- 172.21.15.1:0/2897776611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c5c0bc100 0x7f1c5c150940 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.561+0000 7f1c635d1700 1 --2- 172.21.15.1:0/2897776611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c5c134fa0 0x7f1c5c164f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.561+0000 7f1c635d1700 1 -- 172.21.15.1:0/2897776611 >> 172.21.15.1:0/2897776611 conn(0x7f1c5c063280 msgr2=0x7f1c5c157e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.561+0000 7f1c635d1700 1 -- 172.21.15.1:0/2897776611 shutdown_connections 2023-11-15T02:55:18.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.561+0000 7f1c635d1700 1 -- 172.21.15.1:0/2897776611 wait complete. 2023-11-15T02:55:18.574 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-15T02:55:18.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.691+0000 7fbf11faf700 1 Processor -- start 2023-11-15T02:55:18.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.691+0000 7fbf11faf700 1 -- start start 2023-11-15T02:55:18.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.692+0000 7fbf11faf700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbf0c154680 0x7fbf0c069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.692+0000 7fbf11faf700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbf0c0bccd0 0x7fbf0c0bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.692+0000 7fbf11faf700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf0c0627b0 0x7fbf0c062c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.692+0000 7fbf11faf700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0c0c3360 con 0x7fbf0c0bccd0 2023-11-15T02:55:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.692+0000 7fbf11faf700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0c0bd620 con 0x7fbf0c154680 2023-11-15T02:55:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.692+0000 7fbf11faf700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c0c2750 con 0x7fbf0c0627b0 2023-11-15T02:55:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.692+0000 7fbf0affd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbf0c0bccd0 0x7fbf0c0bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.692+0000 7fbf0affd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbf0c0bccd0 0x7fbf0c0bd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36274/0 (socket says 172.21.15.1:36274) 2023-11-15T02:55:18.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.692+0000 7fbf0affd700 1 -- 172.21.15.1:0/1300189205 learned_addr learned my addr 172.21.15.1:0/1300189205 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:18.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.692+0000 7fbf0bfff700 1 --2- 172.21.15.1:0/1300189205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf0c0627b0 0x7fbf0c062c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.692+0000 7fbf0b7fe700 1 --2- 172.21.15.1:0/1300189205 >> v2:172.21.15.141:3300/0 conn(0x7fbf0c154680 0x7fbf0c069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf0affd700 1 -- 172.21.15.1:0/1300189205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf0c0627b0 msgr2=0x7fbf0c062c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:18.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf0affd700 1 --2- 172.21.15.1:0/1300189205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf0c0627b0 0x7fbf0c062c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf0affd700 1 -- 172.21.15.1:0/1300189205 >> v2:172.21.15.141:3300/0 conn(0x7fbf0c154680 msgr2=0x7fbf0c069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:18.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf0affd700 1 --2- 172.21.15.1:0/1300189205 >> v2:172.21.15.141:3300/0 conn(0x7fbf0c154680 0x7fbf0c069fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf0affd700 1 -- 172.21.15.1:0/1300189205 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c0c2a30 con 0x7fbf0c0bccd0 2023-11-15T02:55:18.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf0affd700 1 --2- 172.21.15.1:0/1300189205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf0c0bccd0 0x7fbf0c0bd130 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7fbf0c064c90 tx=0x7fbef40090f0).ready entity=mon.0 client_cookie=4f3460f2b2c17570 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:18.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf0a7fc700 1 -- 172.21.15.1:0/1300189205 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef400b600 con 0x7fbf0c0bccd0 2023-11-15T02:55:18.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf0a7fc700 1 -- 172.21.15.1:0/1300189205 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef400b760 con 0x7fbf0c0bccd0 2023-11-15T02:55:18.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf0a7fc700 1 -- 172.21.15.1:0/1300189205 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef400bae0 con 0x7fbf0c0bccd0 2023-11-15T02:55:18.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf11faf700 1 -- 172.21.15.1:0/1300189205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf0c0bccd0 msgr2=0x7fbf0c0bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf11faf700 1 --2- 172.21.15.1:0/1300189205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf0c0bccd0 0x7fbf0c0bd130 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7fbf0c064c90 tx=0x7fbef40090f0).stop 2023-11-15T02:55:18.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf11faf700 1 -- 172.21.15.1:0/1300189205 shutdown_connections 2023-11-15T02:55:18.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf11faf700 1 --2- 172.21.15.1:0/1300189205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf0c0627b0 0x7fbf0c062c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf11faf700 1 --2- 172.21.15.1:0/1300189205 >> v2:172.21.15.141:3300/0 conn(0x7fbf0c154680 0x7fbf0c069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf11faf700 1 --2- 172.21.15.1:0/1300189205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf0c0bccd0 0x7fbf0c0bd130 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf11faf700 1 -- 172.21.15.1:0/1300189205 >> 172.21.15.1:0/1300189205 conn(0x7fbf0c0c7d70 msgr2=0x7fbf0c0c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:18.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf11faf700 1 -- 172.21.15.1:0/1300189205 shutdown_connections 2023-11-15T02:55:18.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.693+0000 7fbf11faf700 1 -- 172.21.15.1:0/1300189205 wait complete. 2023-11-15T02:55:18.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.695+0000 7fbf11faf700 1 Processor -- start 2023-11-15T02:55:18.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.695+0000 7fbf11faf700 1 -- start start 2023-11-15T02:55:18.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.695+0000 7fbf11faf700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf0c0627b0 0x7fbf0c0aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.695+0000 7fbf11faf700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf0c0bccd0 0x7fbf0c0ab210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.695+0000 7fbf11faf700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf0c154680 0x7fbf0c0aa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.695+0000 7fbf11faf700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c14cb80 con 0x7fbf0c154680 2023-11-15T02:55:18.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.695+0000 7fbf11faf700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c0a8fa0 con 0x7fbf0c0bccd0 2023-11-15T02:55:18.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.695+0000 7fbf11faf700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c0a9280 con 0x7fbf0c0627b0 2023-11-15T02:55:18.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf0bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf0c154680 0x7fbf0c0aa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf0bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf0c154680 0x7fbf0c0aa040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36276/0 (socket says 172.21.15.1:36276) 2023-11-15T02:55:18.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf0bfff700 1 -- 172.21.15.1:0/1341956463 learned_addr learned my addr 172.21.15.1:0/1341956463 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:18.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf0b7fe700 1 --2- 172.21.15.1:0/1341956463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf0c0627b0 0x7fbf0c0aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf0affd700 1 --2- 172.21.15.1:0/1341956463 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf0c0bccd0 0x7fbf0c0ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf0bfff700 1 -- 172.21.15.1:0/1341956463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf0c0627b0 msgr2=0x7fbf0c0aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf0bfff700 1 --2- 172.21.15.1:0/1341956463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf0c0627b0 0x7fbf0c0aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf0bfff700 1 -- 172.21.15.1:0/1341956463 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf0c0bccd0 msgr2=0x7fbf0c0ab210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf0bfff700 1 --2- 172.21.15.1:0/1341956463 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf0c0bccd0 0x7fbf0c0ab210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf0bfff700 1 -- 172.21.15.1:0/1341956463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef4009370 con 0x7fbf0c154680 2023-11-15T02:55:18.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf0bfff700 1 --2- 172.21.15.1:0/1341956463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf0c154680 0x7fbf0c0aa040 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7fbf04009fa0 tx=0x7fbf04009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:18.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf037fe700 1 -- 172.21.15.1:0/1341956463 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400ebc0 con 0x7fbf0c154680 2023-11-15T02:55:18.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf037fe700 1 -- 172.21.15.1:0/1341956463 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0400ed20 con 0x7fbf0c154680 2023-11-15T02:55:18.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf11faf700 1 -- 172.21.15.1:0/1341956463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0c0a9560 con 0x7fbf0c154680 2023-11-15T02:55:18.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf037fe700 1 -- 172.21.15.1:0/1341956463 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04014610 con 0x7fbf0c154680 2023-11-15T02:55:18.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.696+0000 7fbf11faf700 1 -- 172.21.15.1:0/1341956463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0c0a9b20 con 0x7fbf0c154680 2023-11-15T02:55:18.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.697+0000 7fbf11faf700 1 -- 172.21.15.1:0/1341956463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf0c06c7e0 con 0x7fbf0c154680 2023-11-15T02:55:18.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.698+0000 7fbf037fe700 1 -- 172.21.15.1:0/1341956463 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fbf0401d3b0 con 0x7fbf0c154680 2023-11-15T02:55:18.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.698+0000 7fbf037fe700 1 --2- 172.21.15.1:0/1341956463 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbeec05f270 0x7fbeec061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:18.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.698+0000 7fbf037fe700 1 -- 172.21.15.1:0/1341956463 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 5821+0+0 (secure 0 0 0) 0x7fbf0407a6e0 con 0x7fbf0c154680 2023-11-15T02:55:18.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.698+0000 7fbf0b7fe700 1 --2- 172.21.15.1:0/1341956463 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbeec05f270 0x7fbeec061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:18.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.699+0000 7fbf0b7fe700 1 --2- 172.21.15.1:0/1341956463 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbeec05f270 0x7fbeec061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fbefc00bb10 tx=0x7fbefc008040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:18.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.702+0000 7fbf037fe700 1 -- 172.21.15.1:0/1341956463 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbf0404b900 con 0x7fbf0c154680 2023-11-15T02:55:18.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.877+0000 7fbf11faf700 1 -- 172.21.15.1:0/1341956463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbf0c0aa950 con 0x7fbf0c154680 2023-11-15T02:55:18.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.877+0000 7fbf037fe700 1 -- 172.21.15.1:0/1341956463 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v208) v1 ==== 84+0+143 (secure 0 0 0) 0x7fbf0c0aa950 con 0x7fbf0c154680 2023-11-15T02:55:18.879 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:18.879 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T02:55:18.880 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:18.880 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2023-11-15T02:55:18.880 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "device_health_metrics" 2023-11-15T02:55:18.880 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-11-15T02:55:18.881 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:18.881 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 2, 2023-11-15T02:55:18.881 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": "rbd" 2023-11-15T02:55:18.882 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:18.882 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T02:55:18.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.879+0000 7fbf11faf700 1 -- 172.21.15.1:0/1341956463 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbeec05f270 msgr2=0x7fbeec061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.879+0000 7fbf11faf700 1 --2- 172.21.15.1:0/1341956463 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbeec05f270 0x7fbeec061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fbefc00bb10 tx=0x7fbefc008040).stop 2023-11-15T02:55:18.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.879+0000 7fbf11faf700 1 -- 172.21.15.1:0/1341956463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf0c154680 msgr2=0x7fbf0c0aa040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:18.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.879+0000 7fbf11faf700 1 --2- 172.21.15.1:0/1341956463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf0c154680 0x7fbf0c0aa040 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7fbf04009fa0 tx=0x7fbf04009900).stop 2023-11-15T02:55:18.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.879+0000 7fbf11faf700 1 -- 172.21.15.1:0/1341956463 shutdown_connections 2023-11-15T02:55:18.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.879+0000 7fbf11faf700 1 --2- 172.21.15.1:0/1341956463 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbeec05f270 0x7fbeec061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.879+0000 7fbf11faf700 1 --2- 172.21.15.1:0/1341956463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf0c154680 0x7fbf0c0aa040 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.879+0000 7fbf11faf700 1 --2- 172.21.15.1:0/1341956463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf0c0627b0 0x7fbf0c0aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.879+0000 7fbf11faf700 1 --2- 172.21.15.1:0/1341956463 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf0c0bccd0 0x7fbf0c0ab210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:18.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.879+0000 7fbf11faf700 1 -- 172.21.15.1:0/1341956463 >> 172.21.15.1:0/1341956463 conn(0x7fbf0c0c7d70 msgr2=0x7fbf0c066460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:18.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.879+0000 7fbf11faf700 1 -- 172.21.15.1:0/1341956463 shutdown_connections 2023-11-15T02:55:18.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:18.879+0000 7fbf11faf700 1 -- 172.21.15.1:0/1341956463 wait complete. 2023-11-15T02:55:18.892 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-15T02:55:18.893 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-15T02:55:19.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.015+0000 7f8f7165f700 1 Processor -- start 2023-11-15T02:55:19.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.015+0000 7f8f7165f700 1 -- start start 2023-11-15T02:55:19.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.016+0000 7f8f7165f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8f6c0aa750 0x7f8f6c0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:19.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.016+0000 7f8f7165f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f6c14b730 0x7f8f6c154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:19.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.016+0000 7f8f7165f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6c1580d0 con 0x7f8f6c14b350 2023-11-15T02:55:19.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.016+0000 7f8f7165f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c155000 con 0x7f8f6c0aa750 2023-11-15T02:55:19.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.016+0000 7f8f7165f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c1552e0 con 0x7f8f6c14b730 2023-11-15T02:55:19.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.016+0000 7f8f6affd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8f6c14b350 0x7f8f6c0aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:50070/0 (socket says 172.21.15.1:50070) 2023-11-15T02:55:19.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.016+0000 7f8f6affd700 1 -- 172.21.15.1:0/1252072603 learned_addr learned my addr 172.21.15.1:0/1252072603 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:19.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.016+0000 7f8f6b7fe700 1 --2- 172.21.15.1:0/1252072603 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f6c14b730 0x7f8f6c154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:19.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.016+0000 7f8f6a7fc700 1 --2- 172.21.15.1:0/1252072603 >> v2:172.21.15.141:3300/0 conn(0x7f8f6c0aa750 0x7f8f6c0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:19.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.016+0000 7f8f69ffb700 1 -- 172.21.15.1:0/1252072603 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3733652916 0 0) 0x7f8f6c1580d0 con 0x7f8f6c14b350 2023-11-15T02:55:19.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.016+0000 7f8f69ffb700 1 -- 172.21.15.1:0/1252072603 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f580033f0 con 0x7f8f6c14b350 2023-11-15T02:55:19.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.017+0000 7f8f69ffb700 1 -- 172.21.15.1:0/1252072603 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4030291071 0 0) 0x7f8f580033f0 con 0x7f8f6c14b350 2023-11-15T02:55:19.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.017+0000 7f8f6b7fe700 1 -- 172.21.15.1:0/1252072603 >> v2:172.21.15.141:3300/0 conn(0x7f8f6c0aa750 msgr2=0x7f8f6c0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:19.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.017+0000 7f8f6b7fe700 1 --2- 172.21.15.1:0/1252072603 >> v2:172.21.15.141:3300/0 conn(0x7f8f6c0aa750 0x7f8f6c0c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:19.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.017+0000 7f8f6b7fe700 1 -- 172.21.15.1:0/1252072603 >> v1:172.21.15.1:6789/0 conn(0x7f8f6c14b350 legacy=0x7f8f6c0aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:19.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.017+0000 7f8f6b7fe700 1 -- 172.21.15.1:0/1252072603 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c1555c0 con 0x7f8f6c14b730 2023-11-15T02:55:19.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.017+0000 7f8f6a7fc700 1 --2- 172.21.15.1:0/1252072603 >> v2:172.21.15.141:3300/0 conn(0x7f8f6c0aa750 0x7f8f6c0c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:19.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.017+0000 7f8f6b7fe700 1 --2- 172.21.15.1:0/1252072603 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f6c14b730 0x7f8f6c154a10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f8f64009760 tx=0x7f8f64009060).ready entity=mon.2 client_cookie=9a28fba588a0d803 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:19.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.017+0000 7f8f69ffb700 1 -- 172.21.15.1:0/1252072603 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0017f0 con 0x7f8f6c14b730 2023-11-15T02:55:19.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.017+0000 7f8f69ffb700 1 -- 172.21.15.1:0/1252072603 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f64011400 con 0x7f8f6c14b730 2023-11-15T02:55:19.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.017+0000 7f8f69ffb700 1 -- 172.21.15.1:0/1252072603 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64011780 con 0x7f8f6c14b730 2023-11-15T02:55:19.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.017+0000 7f8f7165f700 1 -- 172.21.15.1:0/1252072603 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f6c14b730 msgr2=0x7f8f6c154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:19.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.017+0000 7f8f7165f700 1 --2- 172.21.15.1:0/1252072603 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f6c14b730 0x7f8f6c154a10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f8f64009760 tx=0x7f8f64009060).stop 2023-11-15T02:55:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.018+0000 7f8f7165f700 1 -- 172.21.15.1:0/1252072603 shutdown_connections 2023-11-15T02:55:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.018+0000 7f8f7165f700 1 --2- 172.21.15.1:0/1252072603 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f6c14b730 0x7f8f6c154a10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.018+0000 7f8f7165f700 1 --2- 172.21.15.1:0/1252072603 >> v2:172.21.15.141:3300/0 conn(0x7f8f6c0aa750 0x7f8f6c0c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:19.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.018+0000 7f8f7165f700 1 -- 172.21.15.1:0/1252072603 >> 172.21.15.1:0/1252072603 conn(0x7f8f6c069ee0 msgr2=0x7f8f6c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:19.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.018+0000 7f8f7165f700 1 -- 172.21.15.1:0/1252072603 shutdown_connections 2023-11-15T02:55:19.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.018+0000 7f8f7165f700 1 -- 172.21.15.1:0/1252072603 wait complete. 2023-11-15T02:55:19.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.019+0000 7f8f7165f700 1 Processor -- start 2023-11-15T02:55:19.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.019+0000 7f8f7165f700 1 -- start start 2023-11-15T02:55:19.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f7165f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f6c0aa750 0x7f8f6c0c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:19.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f7165f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8f6c14b350 0x7f8f6c158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:19.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f7165f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f6c14b730 0x7f8f6c0ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:19.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f7165f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0c21a0 con 0x7f8f6c14b730 2023-11-15T02:55:19.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f7165f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c1494d0 con 0x7f8f6c14b350 2023-11-15T02:55:19.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f7165f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0c2440 con 0x7f8f6c0aa750 2023-11-15T02:55:19.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f6b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f6c14b730 0x7f8f6c0ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:19.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f6b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f6c14b730 0x7f8f6c0ac090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36288/0 (socket says 172.21.15.1:36288) 2023-11-15T02:55:19.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f6b7fe700 1 -- 172.21.15.1:0/49208346 learned_addr learned my addr 172.21.15.1:0/49208346 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:19.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f6affd700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f6c0aa750 0x7f8f6c0c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:19.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f6a7fc700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8f6c14b350 0x7f8f6c158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:19.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f6b7fe700 1 -- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f6c0aa750 msgr2=0x7f8f6c0c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:19.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f6b7fe700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f6c0aa750 0x7f8f6c0c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:19.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f6b7fe700 1 -- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8f6c14b350 msgr2=0x7f8f6c158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:19.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f6b7fe700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8f6c14b350 0x7f8f6c158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:19.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f6b7fe700 1 -- 172.21.15.1:0/49208346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f540092a0 con 0x7f8f6c14b730 2023-11-15T02:55:19.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f6affd700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f6c0aa750 0x7f8f6c0c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:19.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f6a7fc700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8f6c14b350 0x7f8f6c158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:19.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f6b7fe700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f6c14b730 0x7f8f6c0ac090 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 rx=0x7f8f64009d50 tx=0x7f8f64016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:19.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f62ffd700 1 -- 172.21.15.1:0/49208346 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64010bb0 con 0x7f8f6c14b730 2023-11-15T02:55:19.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f62ffd700 1 -- 172.21.15.1:0/49208346 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f64010d10 con 0x7f8f6c14b730 2023-11-15T02:55:19.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f7165f700 1 -- 172.21.15.1:0/49208346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f640092a0 con 0x7f8f6c14b730 2023-11-15T02:55:19.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.020+0000 7f8f62ffd700 1 -- 172.21.15.1:0/49208346 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6401d660 con 0x7f8f6c14b730 2023-11-15T02:55:19.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.021+0000 7f8f7165f700 1 -- 172.21.15.1:0/49208346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c0c4860 con 0x7f8f6c14b730 2023-11-15T02:55:19.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.022+0000 7f8f7165f700 1 -- 172.21.15.1:0/49208346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c064490 con 0x7f8f6c14b730 2023-11-15T02:55:19.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.022+0000 7f8f62ffd700 1 -- 172.21.15.1:0/49208346 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8f640263b0 con 0x7f8f6c14b730 2023-11-15T02:55:19.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.022+0000 7f8f62ffd700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8f4c05f270 0x7f8f4c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:19.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.022+0000 7f8f62ffd700 1 -- 172.21.15.1:0/49208346 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 5821+0+0 (secure 0 0 0) 0x7f8f6407b1f0 con 0x7f8f6c14b730 2023-11-15T02:55:19.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.023+0000 7f8f6affd700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8f4c05f270 0x7f8f4c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:19.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.023+0000 7f8f6affd700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8f4c05f270 0x7f8f4c061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8f6c14a7b0 tx=0x7f8f5c001960).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:19.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.027+0000 7f8f62ffd700 1 -- 172.21.15.1:0/49208346 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8f6404c410 con 0x7f8f6c14b730 2023-11-15T02:55:19.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:19.200+0000 7f8f7165f700 1 -- 172.21.15.1:0/49208346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f8f6c06c7e0 con 0x7f8f6c14b730 2023-11-15T02:55:20.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.197+0000 7f8f62ffd700 1 -- 172.21.15.1:0/49208346 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v209) v1 ==== 152+0+0 (secure 0 0 0) 0x7f8f64022020 con 0x7f8f6c14b730 2023-11-15T02:55:20.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.202+0000 7f8f7165f700 1 -- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8f4c05f270 msgr2=0x7f8f4c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:20.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.202+0000 7f8f7165f700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8f4c05f270 0x7f8f4c061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8f6c14a7b0 tx=0x7f8f5c001960).stop 2023-11-15T02:55:20.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.202+0000 7f8f7165f700 1 -- 172.21.15.1:0/49208346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f6c14b730 msgr2=0x7f8f6c0ac090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:20.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.202+0000 7f8f7165f700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f6c14b730 0x7f8f6c0ac090 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 rx=0x7f8f64009d50 tx=0x7f8f64016000).stop 2023-11-15T02:55:20.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.202+0000 7f8f7165f700 1 -- 172.21.15.1:0/49208346 shutdown_connections 2023-11-15T02:55:20.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.202+0000 7f8f7165f700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8f4c05f270 0x7f8f4c061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:20.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.202+0000 7f8f7165f700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f6c14b730 0x7f8f6c0ac090 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:20.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.202+0000 7f8f7165f700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f6c0aa750 0x7f8f6c0c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:20.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.202+0000 7f8f7165f700 1 --2- 172.21.15.1:0/49208346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8f6c14b350 0x7f8f6c158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:20.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.202+0000 7f8f7165f700 1 -- 172.21.15.1:0/49208346 >> 172.21.15.1:0/49208346 conn(0x7f8f6c069ee0 msgr2=0x7f8f6c0cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:20.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.203+0000 7f8f7165f700 1 -- 172.21.15.1:0/49208346 shutdown_connections 2023-11-15T02:55:20.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.203+0000 7f8f7165f700 1 -- 172.21.15.1:0/49208346 wait complete. 2023-11-15T02:55:20.209 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2023-11-15T02:55:20.223 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-15T02:55:20.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.353+0000 7feb0327c700 1 Processor -- start 2023-11-15T02:55:20.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.353+0000 7feb0327c700 1 -- start start 2023-11-15T02:55:20.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb0327c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feafc1541d0 0x7feafc1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:20.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb0327c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7feafc0c8170 0x7feafc0c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:20.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb0327c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc155830 con 0x7feafc0c60d0 2023-11-15T02:55:20.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb0327c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feafc158f40 con 0x7feafc1541d0 2023-11-15T02:55:20.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb0327c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feafc154c20 con 0x7feafc0c8170 2023-11-15T02:55:20.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb0227a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feafc1541d0 0x7feafc1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:20.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb0227a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feafc1541d0 0x7feafc1545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36290/0 (socket says 172.21.15.1:36290) 2023-11-15T02:55:20.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb01a79700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7feafc0c60d0 0x7feafc0c7a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:50082/0 (socket says 172.21.15.1:50082) 2023-11-15T02:55:20.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb0227a700 1 -- 172.21.15.1:0/3852222431 learned_addr learned my addr 172.21.15.1:0/3852222431 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:20.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb02a7b700 1 --2- 172.21.15.1:0/3852222431 >> v2:172.21.15.141:3300/0 conn(0x7feafc0c8170 0x7feafc0c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:20.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb0227a700 1 -- 172.21.15.1:0/3852222431 >> v2:172.21.15.141:3300/0 conn(0x7feafc0c8170 msgr2=0x7feafc0c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:20.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb0227a700 1 --2- 172.21.15.1:0/3852222431 >> v2:172.21.15.141:3300/0 conn(0x7feafc0c8170 0x7feafc0c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:20.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb0227a700 1 -- 172.21.15.1:0/3852222431 >> v1:172.21.15.1:6789/0 conn(0x7feafc0c60d0 legacy=0x7feafc0c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:20.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb01278700 1 -- 172.21.15.1:0/3852222431 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687747154 0 0) 0x7feafc155830 con 0x7feafc0c60d0 2023-11-15T02:55:20.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb0227a700 1 -- 172.21.15.1:0/3852222431 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc154f00 con 0x7feafc1541d0 2023-11-15T02:55:20.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.354+0000 7feb0227a700 1 --2- 172.21.15.1:0/3852222431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feafc1541d0 0x7feafc1545b0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7feafc0c56d0 tx=0x7feaf80090f0).ready entity=mon.0 client_cookie=aeaabe385cb4a630 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:20.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.355+0000 7feb01278700 1 -- 172.21.15.1:0/3852222431 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf800b600 con 0x7feafc1541d0 2023-11-15T02:55:20.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.355+0000 7feb01278700 1 -- 172.21.15.1:0/3852222431 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf800b760 con 0x7feafc1541d0 2023-11-15T02:55:20.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.355+0000 7feb01278700 1 -- 172.21.15.1:0/3852222431 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf800bae0 con 0x7feafc1541d0 2023-11-15T02:55:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.355+0000 7feb0327c700 1 -- 172.21.15.1:0/3852222431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feafc1541d0 msgr2=0x7feafc1545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.355+0000 7feb0327c700 1 --2- 172.21.15.1:0/3852222431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feafc1541d0 0x7feafc1545b0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7feafc0c56d0 tx=0x7feaf80090f0).stop 2023-11-15T02:55:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.355+0000 7feb0327c700 1 -- 172.21.15.1:0/3852222431 shutdown_connections 2023-11-15T02:55:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.355+0000 7feb0327c700 1 --2- 172.21.15.1:0/3852222431 >> v2:172.21.15.141:3300/0 conn(0x7feafc0c8170 0x7feafc0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.355+0000 7feb0327c700 1 --2- 172.21.15.1:0/3852222431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feafc1541d0 0x7feafc1545b0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.355+0000 7feb0327c700 1 -- 172.21.15.1:0/3852222431 >> 172.21.15.1:0/3852222431 conn(0x7feafc069ee0 msgr2=0x7feafc06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.355+0000 7feb0327c700 1 -- 172.21.15.1:0/3852222431 shutdown_connections 2023-11-15T02:55:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.355+0000 7feb0327c700 1 -- 172.21.15.1:0/3852222431 wait complete. 2023-11-15T02:55:20.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.356+0000 7feb0327c700 1 Processor -- start 2023-11-15T02:55:20.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.356+0000 7feb0327c700 1 -- start start 2023-11-15T02:55:20.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.357+0000 7feb0327c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feafc0c60d0 0x7feafc151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:20.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.357+0000 7feb0327c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feafc0c8170 0x7feafc158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:20.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.357+0000 7feb0327c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feafc1541d0 0x7feafc0aa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:20.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.357+0000 7feb0327c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc167a70 con 0x7feafc1541d0 2023-11-15T02:55:20.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.357+0000 7feb0327c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc167ce0 con 0x7feafc0c60d0 2023-11-15T02:55:20.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.357+0000 7feb0327c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc167fc0 con 0x7feafc0c8170 2023-11-15T02:55:20.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.357+0000 7feb02a7b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feafc1541d0 0x7feafc0aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:20.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.357+0000 7feb0227a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feafc0c60d0 0x7feafc151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:20.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.357+0000 7feb02a7b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feafc1541d0 0x7feafc0aa400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36304/0 (socket says 172.21.15.1:36304) 2023-11-15T02:55:20.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.357+0000 7feb02a7b700 1 -- 172.21.15.1:0/849386030 learned_addr learned my addr 172.21.15.1:0/849386030 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:20.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.357+0000 7feb01a79700 1 --2- 172.21.15.1:0/849386030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feafc0c8170 0x7feafc158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:20.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.357+0000 7feb02a7b700 1 -- 172.21.15.1:0/849386030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feafc0c8170 msgr2=0x7feafc158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:20.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.357+0000 7feb02a7b700 1 --2- 172.21.15.1:0/849386030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feafc0c8170 0x7feafc158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:20.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.357+0000 7feb02a7b700 1 -- 172.21.15.1:0/849386030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feafc0c60d0 msgr2=0x7feafc151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:20.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.357+0000 7feb02a7b700 1 --2- 172.21.15.1:0/849386030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feafc0c60d0 0x7feafc151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:20.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.358+0000 7feb02a7b700 1 -- 172.21.15.1:0/849386030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf8009370 con 0x7feafc1541d0 2023-11-15T02:55:20.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.358+0000 7feb02a7b700 1 --2- 172.21.15.1:0/849386030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feafc1541d0 0x7feafc0aa400 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7feaf4009fa0 tx=0x7feaf4009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:20.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.358+0000 7feaf27fc700 1 -- 172.21.15.1:0/849386030 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf400ebc0 con 0x7feafc1541d0 2023-11-15T02:55:20.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.358+0000 7feaf27fc700 1 -- 172.21.15.1:0/849386030 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf400ed20 con 0x7feafc1541d0 2023-11-15T02:55:20.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.358+0000 7feb0327c700 1 -- 172.21.15.1:0/849386030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feafc1682a0 con 0x7feafc1541d0 2023-11-15T02:55:20.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.358+0000 7feaf27fc700 1 -- 172.21.15.1:0/849386030 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4014610 con 0x7feafc1541d0 2023-11-15T02:55:20.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.358+0000 7feb0327c700 1 -- 172.21.15.1:0/849386030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feafc0afb00 con 0x7feafc1541d0 2023-11-15T02:55:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.359+0000 7feb0327c700 1 -- 172.21.15.1:0/849386030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feafc1687c0 con 0x7feafc1541d0 2023-11-15T02:55:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.360+0000 7feaf27fc700 1 -- 172.21.15.1:0/849386030 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7feaf401d3b0 con 0x7feafc1541d0 2023-11-15T02:55:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.360+0000 7feaf27fc700 1 --2- 172.21.15.1:0/849386030 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7feae005f270 0x7feae0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.360+0000 7feaf27fc700 1 -- 172.21.15.1:0/849386030 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6191+0+0 (secure 0 0 0) 0x7feaf407a340 con 0x7feafc1541d0 2023-11-15T02:55:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.360+0000 7feb0227a700 1 --2- 172.21.15.1:0/849386030 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7feae005f270 0x7feae0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.361+0000 7feb0227a700 1 --2- 172.21.15.1:0/849386030 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7feae005f270 0x7feae0061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7feaf8009130 tx=0x7feaf8017000).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.365+0000 7feaf27fc700 1 -- 172.21.15.1:0/849386030 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7feaf404aaf0 con 0x7feafc1541d0 2023-11-15T02:55:20.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:20.536+0000 7feb0327c700 1 -- 172.21.15.1:0/849386030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7feafc0475e0 con 0x7feafc1541d0 2023-11-15T02:55:21.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.200+0000 7feaf27fc700 1 -- 172.21.15.1:0/849386030 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v210) v1 ==== 170+0+0 (secure 0 0 0) 0x7feafc1687c0 con 0x7feafc1541d0 2023-11-15T02:55:21.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.205+0000 7feb0327c700 1 -- 172.21.15.1:0/849386030 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7feae005f270 msgr2=0x7feae0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:21.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.205+0000 7feb0327c700 1 --2- 172.21.15.1:0/849386030 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7feae005f270 0x7feae0061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7feaf8009130 tx=0x7feaf8017000).stop 2023-11-15T02:55:21.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.205+0000 7feb0327c700 1 -- 172.21.15.1:0/849386030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feafc1541d0 msgr2=0x7feafc0aa400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:21.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.205+0000 7feb0327c700 1 --2- 172.21.15.1:0/849386030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feafc1541d0 0x7feafc0aa400 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7feaf4009fa0 tx=0x7feaf4009900).stop 2023-11-15T02:55:21.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.212+0000 7feb0327c700 1 -- 172.21.15.1:0/849386030 shutdown_connections 2023-11-15T02:55:21.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.212+0000 7feb0327c700 1 --2- 172.21.15.1:0/849386030 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7feae005f270 0x7feae0061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.212+0000 7feb0327c700 1 --2- 172.21.15.1:0/849386030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feafc1541d0 0x7feafc0aa400 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.212+0000 7feb0327c700 1 --2- 172.21.15.1:0/849386030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feafc0c60d0 0x7feafc151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.212+0000 7feb0327c700 1 --2- 172.21.15.1:0/849386030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feafc0c8170 0x7feafc158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.212+0000 7feb0327c700 1 -- 172.21.15.1:0/849386030 >> 172.21.15.1:0/849386030 conn(0x7feafc069ee0 msgr2=0x7feafc153410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:21.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.214+0000 7feb0327c700 1 -- 172.21.15.1:0/849386030 shutdown_connections 2023-11-15T02:55:21.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.214+0000 7feb0327c700 1 -- 172.21.15.1:0/849386030 wait complete. 2023-11-15T02:55:21.218 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2023-11-15T02:55:21.237 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-15T02:55:21.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.357+0000 7f29fc164700 1 Processor -- start 2023-11-15T02:55:21.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.357+0000 7f29fc164700 1 -- start start 2023-11-15T02:55:21.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.358+0000 7f29fc164700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f29f4154480 0x7f29f40c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:21.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.358+0000 7f29fc164700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f29f40c6430 0x7f29f40aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:21.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.358+0000 7f29fc164700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f40ca050 con 0x7f29f41540a0 2023-11-15T02:55:21.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.358+0000 7f29fc164700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f40c68c0 con 0x7f29f4154480 2023-11-15T02:55:21.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.358+0000 7f29fc164700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f40c9440 con 0x7f29f40c6430 2023-11-15T02:55:21.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.358+0000 7f29f96ff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f29f4154480 0x7f29f40c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:21.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.358+0000 7f29f96ff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f29f4154480 0x7f29f40c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36312/0 (socket says 172.21.15.1:36312) 2023-11-15T02:55:21.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.358+0000 7f29f96ff700 1 -- 172.21.15.1:0/1595716598 learned_addr learned my addr 172.21.15.1:0/1595716598 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:21.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.358+0000 7f29fa701700 1 --2- 172.21.15.1:0/1595716598 >> v2:172.21.15.141:3300/0 conn(0x7f29f40c6430 0x7f29f40aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:21.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.358+0000 7f29f96ff700 1 -- 172.21.15.1:0/1595716598 >> v2:172.21.15.141:3300/0 conn(0x7f29f40c6430 msgr2=0x7f29f40aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:21.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.358+0000 7f29f96ff700 1 --2- 172.21.15.1:0/1595716598 >> v2:172.21.15.141:3300/0 conn(0x7f29f40c6430 0x7f29f40aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.358+0000 7f29f96ff700 1 -- 172.21.15.1:0/1595716598 >> v1:172.21.15.141:6789/0 conn(0x7f29f41540a0 legacy=0x7f29f40ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:21.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.358+0000 7f29f96ff700 1 -- 172.21.15.1:0/1595716598 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f40c9720 con 0x7f29f4154480 2023-11-15T02:55:21.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.359+0000 7f29f96ff700 1 --2- 172.21.15.1:0/1595716598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f4154480 0x7f29f40c5f40 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7f29f40aab60 tx=0x7f29e80090f0).ready entity=mon.0 client_cookie=d69c41c77ed786cb server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:21.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.359+0000 7f29f8efe700 1 -- 172.21.15.1:0/1595716598 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e800b5a0 con 0x7f29f4154480 2023-11-15T02:55:21.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.359+0000 7f29f8efe700 1 -- 172.21.15.1:0/1595716598 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e800b700 con 0x7f29f4154480 2023-11-15T02:55:21.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.359+0000 7f29f8efe700 1 -- 172.21.15.1:0/1595716598 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e800ba80 con 0x7f29f4154480 2023-11-15T02:55:21.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.359+0000 7f29fc164700 1 -- 172.21.15.1:0/1595716598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f4154480 msgr2=0x7f29f40c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:21.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.359+0000 7f29fc164700 1 --2- 172.21.15.1:0/1595716598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f4154480 0x7f29f40c5f40 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7f29f40aab60 tx=0x7f29e80090f0).stop 2023-11-15T02:55:21.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.359+0000 7f29fc164700 1 -- 172.21.15.1:0/1595716598 shutdown_connections 2023-11-15T02:55:21.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.359+0000 7f29fc164700 1 --2- 172.21.15.1:0/1595716598 >> v2:172.21.15.141:3300/0 conn(0x7f29f40c6430 0x7f29f40aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.359+0000 7f29fc164700 1 --2- 172.21.15.1:0/1595716598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f4154480 0x7f29f40c5f40 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.359+0000 7f29fc164700 1 -- 172.21.15.1:0/1595716598 >> 172.21.15.1:0/1595716598 conn(0x7f29f4064a70 msgr2=0x7f29f4064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:21.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.359+0000 7f29fc164700 1 -- 172.21.15.1:0/1595716598 shutdown_connections 2023-11-15T02:55:21.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.359+0000 7f29fc164700 1 -- 172.21.15.1:0/1595716598 wait complete. 2023-11-15T02:55:21.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.360+0000 7f29fc164700 1 Processor -- start 2023-11-15T02:55:21.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.361+0000 7f29fc164700 1 -- start start 2023-11-15T02:55:21.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.361+0000 7f29fc164700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29f40c6430 0x7f29f40b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:21.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.361+0000 7f29fc164700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29f41540a0 0x7f29f414d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:21.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.361+0000 7f29fc164700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f4154480 0x7f29f40aa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:21.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.361+0000 7f29fc164700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40aa990 con 0x7f29f4154480 2023-11-15T02:55:21.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.361+0000 7f29fc164700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40afe70 con 0x7f29f40c6430 2023-11-15T02:55:21.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.361+0000 7f29fc164700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f4150600 con 0x7f29f41540a0 2023-11-15T02:55:21.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.361+0000 7f29fa701700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f4154480 0x7f29f40aa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:21.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.361+0000 7f29fa701700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f4154480 0x7f29f40aa140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36324/0 (socket says 172.21.15.1:36324) 2023-11-15T02:55:21.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.361+0000 7f29fa701700 1 -- 172.21.15.1:0/1878006796 learned_addr learned my addr 172.21.15.1:0/1878006796 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:21.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.362+0000 7f29f9f00700 1 --2- 172.21.15.1:0/1878006796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29f40c6430 0x7f29f40b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:21.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.362+0000 7f29f96ff700 1 --2- 172.21.15.1:0/1878006796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29f41540a0 0x7f29f414d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:21.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.362+0000 7f29fa701700 1 -- 172.21.15.1:0/1878006796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29f41540a0 msgr2=0x7f29f414d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:21.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.362+0000 7f29fa701700 1 --2- 172.21.15.1:0/1878006796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29f41540a0 0x7f29f414d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.362+0000 7f29fa701700 1 -- 172.21.15.1:0/1878006796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29f40c6430 msgr2=0x7f29f40b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:21.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.362+0000 7f29fa701700 1 --2- 172.21.15.1:0/1878006796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29f40c6430 0x7f29f40b0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.362+0000 7f29fa701700 1 -- 172.21.15.1:0/1878006796 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e8009370 con 0x7f29f4154480 2023-11-15T02:55:21.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.362+0000 7f29f9f00700 1 --2- 172.21.15.1:0/1878006796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29f40c6430 0x7f29f40b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:21.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.362+0000 7f29fa701700 1 --2- 172.21.15.1:0/1878006796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f4154480 0x7f29f40aa140 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7f29e4009fa0 tx=0x7f29e4009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:21.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.362+0000 7f29f1ffb700 1 -- 172.21.15.1:0/1878006796 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e400ed20 con 0x7f29f4154480 2023-11-15T02:55:21.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.362+0000 7f29f1ffb700 1 -- 172.21.15.1:0/1878006796 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e400ee80 con 0x7f29f4154480 2023-11-15T02:55:21.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.362+0000 7f29fc164700 1 -- 172.21.15.1:0/1878006796 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f41508e0 con 0x7f29f4154480 2023-11-15T02:55:21.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.362+0000 7f29f1ffb700 1 -- 172.21.15.1:0/1878006796 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4014610 con 0x7f29f4154480 2023-11-15T02:55:21.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.362+0000 7f29fc164700 1 -- 172.21.15.1:0/1878006796 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f4150ea0 con 0x7f29f4154480 2023-11-15T02:55:21.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.363+0000 7f29fc164700 1 -- 172.21.15.1:0/1878006796 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f4151090 con 0x7f29f4154480 2023-11-15T02:55:21.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.364+0000 7f29f1ffb700 1 -- 172.21.15.1:0/1878006796 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f29e401d3b0 con 0x7f29f4154480 2023-11-15T02:55:21.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.364+0000 7f29f1ffb700 1 --2- 172.21.15.1:0/1878006796 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f29e005f240 0x7f29e0061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:21.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.364+0000 7f29f1ffb700 1 -- 172.21.15.1:0/1878006796 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6573+0+0 (secure 0 0 0) 0x7f29e407ac00 con 0x7f29f4154480 2023-11-15T02:55:21.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.364+0000 7f29f9f00700 1 --2- 172.21.15.1:0/1878006796 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f29e005f240 0x7f29e0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:21.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.365+0000 7f29f9f00700 1 --2- 172.21.15.1:0/1878006796 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f29e005f240 0x7f29e0061700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f29ec0026f0 tx=0x7f29ec009040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:21.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.369+0000 7f29f1ffb700 1 -- 172.21.15.1:0/1878006796 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f29e404ba70 con 0x7f29f4154480 2023-11-15T02:55:21.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.587+0000 7f29fc164700 1 -- 172.21.15.1:0/1878006796 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f29f406c7e0 con 0x7f29f4154480 2023-11-15T02:55:21.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.592+0000 7f29f1ffb700 1 -- 172.21.15.1:0/1878006796 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v91) v1 ==== 174+0+0 (secure 0 0 0) 0x7f29e404f090 con 0x7f29f4154480 2023-11-15T02:55:21.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.596+0000 7f29fc164700 1 -- 172.21.15.1:0/1878006796 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f29e005f240 msgr2=0x7f29e0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:21.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.596+0000 7f29fc164700 1 --2- 172.21.15.1:0/1878006796 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f29e005f240 0x7f29e0061700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f29ec0026f0 tx=0x7f29ec009040).stop 2023-11-15T02:55:21.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.596+0000 7f29fc164700 1 -- 172.21.15.1:0/1878006796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f4154480 msgr2=0x7f29f40aa140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:21.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.596+0000 7f29fc164700 1 --2- 172.21.15.1:0/1878006796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f4154480 0x7f29f40aa140 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7f29e4009fa0 tx=0x7f29e4009900).stop 2023-11-15T02:55:21.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.597+0000 7f29fc164700 1 -- 172.21.15.1:0/1878006796 shutdown_connections 2023-11-15T02:55:21.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.597+0000 7f29fc164700 1 --2- 172.21.15.1:0/1878006796 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f29e005f240 0x7f29e0061700 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.597+0000 7f29fc164700 1 --2- 172.21.15.1:0/1878006796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f4154480 0x7f29f40aa140 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.597+0000 7f29fc164700 1 --2- 172.21.15.1:0/1878006796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f29f40c6430 0x7f29f40b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.597+0000 7f29fc164700 1 --2- 172.21.15.1:0/1878006796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f29f41540a0 0x7f29f414d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.597+0000 7f29fc164700 1 -- 172.21.15.1:0/1878006796 >> 172.21.15.1:0/1878006796 conn(0x7f29f4064a70 msgr2=0x7f29f40ad3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:21.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.604+0000 7f29fc164700 1 -- 172.21.15.1:0/1878006796 shutdown_connections 2023-11-15T02:55:21.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.606+0000 7f29fc164700 1 -- 172.21.15.1:0/1878006796 wait complete. 2023-11-15T02:55:21.609 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 25 and data pool 26 2023-11-15T02:55:21.626 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:55:21.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.743+0000 7f0d8b445700 1 Processor -- start 2023-11-15T02:55:21.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.743+0000 7f0d8b445700 1 -- start start 2023-11-15T02:55:21.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d8b445700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d840ab1a0 0x7f0d84154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:21.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d8b445700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0d840aa060 0x7f0d840c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:21.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d8b445700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d840c06f0 con 0x7f0d84154150 2023-11-15T02:55:21.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d8b445700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d840c09d0 con 0x7f0d840aa060 2023-11-15T02:55:21.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d8b445700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84158820 con 0x7f0d840ab1a0 2023-11-15T02:55:21.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d899e2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0d840aa060 0x7f0d840c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:21.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d899e2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0d840aa060 0x7f0d840c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36328/0 (socket says 172.21.15.1:36328) 2023-11-15T02:55:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d899e2700 1 -- 172.21.15.1:0/3504093556 learned_addr learned my addr 172.21.15.1:0/3504093556 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d889e0700 1 --2- 172.21.15.1:0/3504093556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d840ab1a0 0x7f0d84154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d899e2700 1 -- 172.21.15.1:0/3504093556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d840ab1a0 msgr2=0x7f0d84154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d899e2700 1 --2- 172.21.15.1:0/3504093556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d840ab1a0 0x7f0d84154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d899e2700 1 -- 172.21.15.1:0/3504093556 >> v1:172.21.15.141:6789/0 conn(0x7f0d84154150 legacy=0x7f0d84158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d899e2700 1 -- 172.21.15.1:0/3504093556 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d84158b00 con 0x7f0d840aa060 2023-11-15T02:55:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d889e0700 1 --2- 172.21.15.1:0/3504093556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d840ab1a0 0x7f0d84154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d899e2700 1 --2- 172.21.15.1:0/3504093556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d840aa060 0x7f0d840c5f10 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7f0d7c006fd0 tx=0x7f0d7c0090f0).ready entity=mon.0 client_cookie=25ae587d1bae3515 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.744+0000 7f0d83fff700 1 -- 172.21.15.1:0/3504093556 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00b600 con 0x7f0d840aa060 2023-11-15T02:55:21.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.745+0000 7f0d83fff700 1 -- 172.21.15.1:0/3504093556 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c00b760 con 0x7f0d840aa060 2023-11-15T02:55:21.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.745+0000 7f0d83fff700 1 -- 172.21.15.1:0/3504093556 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00bb00 con 0x7f0d840aa060 2023-11-15T02:55:21.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.745+0000 7f0d8b445700 1 -- 172.21.15.1:0/3504093556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d840aa060 msgr2=0x7f0d840c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:21.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.745+0000 7f0d8b445700 1 --2- 172.21.15.1:0/3504093556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d840aa060 0x7f0d840c5f10 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7f0d7c006fd0 tx=0x7f0d7c0090f0).stop 2023-11-15T02:55:21.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.745+0000 7f0d8b445700 1 -- 172.21.15.1:0/3504093556 shutdown_connections 2023-11-15T02:55:21.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.745+0000 7f0d8b445700 1 --2- 172.21.15.1:0/3504093556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d840aa060 0x7f0d840c5f10 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.745+0000 7f0d8b445700 1 --2- 172.21.15.1:0/3504093556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d840ab1a0 0x7f0d84154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.745+0000 7f0d8b445700 1 -- 172.21.15.1:0/3504093556 >> 172.21.15.1:0/3504093556 conn(0x7f0d84064aa0 msgr2=0x7f0d84064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:21.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.745+0000 7f0d8b445700 1 -- 172.21.15.1:0/3504093556 shutdown_connections 2023-11-15T02:55:21.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.745+0000 7f0d8b445700 1 -- 172.21.15.1:0/3504093556 wait complete. 2023-11-15T02:55:21.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.746+0000 7f0d8b445700 1 Processor -- start 2023-11-15T02:55:21.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.746+0000 7f0d8b445700 1 -- start start 2023-11-15T02:55:21.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.747+0000 7f0d8b445700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d840aa060 0x7f0d84156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:21.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.747+0000 7f0d8b445700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d840ab1a0 0x7f0d84167820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:21.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.747+0000 7f0d8b445700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d84154150 0x7f0d8414c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:21.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.747+0000 7f0d8b445700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84154ab0 con 0x7f0d840ab1a0 2023-11-15T02:55:21.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.747+0000 7f0d8b445700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84154d90 con 0x7f0d84154150 2023-11-15T02:55:21.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.747+0000 7f0d8b445700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84155070 con 0x7f0d840aa060 2023-11-15T02:55:21.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.747+0000 7f0d889e0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d840ab1a0 0x7f0d84167820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:21.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.747+0000 7f0d889e0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d840ab1a0 0x7f0d84167820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36332/0 (socket says 172.21.15.1:36332) 2023-11-15T02:55:21.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.747+0000 7f0d889e0700 1 -- 172.21.15.1:0/2300515838 learned_addr learned my addr 172.21.15.1:0/2300515838 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:21.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.747+0000 7f0d891e1700 1 --2- 172.21.15.1:0/2300515838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d840aa060 0x7f0d84156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:21.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.748+0000 7f0d899e2700 1 --2- 172.21.15.1:0/2300515838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d84154150 0x7f0d8414c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:21.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.748+0000 7f0d889e0700 1 -- 172.21.15.1:0/2300515838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d840aa060 msgr2=0x7f0d84156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.748+0000 7f0d889e0700 1 --2- 172.21.15.1:0/2300515838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d840aa060 0x7f0d84156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.748+0000 7f0d889e0700 1 -- 172.21.15.1:0/2300515838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d84154150 msgr2=0x7f0d8414c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.748+0000 7f0d889e0700 1 --2- 172.21.15.1:0/2300515838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d84154150 0x7f0d8414c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.748+0000 7f0d889e0700 1 -- 172.21.15.1:0/2300515838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c009370 con 0x7f0d840ab1a0 2023-11-15T02:55:21.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.748+0000 7f0d891e1700 1 --2- 172.21.15.1:0/2300515838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d840aa060 0x7f0d84156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:21.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.748+0000 7f0d889e0700 1 --2- 172.21.15.1:0/2300515838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d840ab1a0 0x7f0d84167820 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7f0d7800a400 tx=0x7f0d78007910).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:21.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.748+0000 7f0d817fa700 1 -- 172.21.15.1:0/2300515838 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7800d650 con 0x7f0d840ab1a0 2023-11-15T02:55:21.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.748+0000 7f0d817fa700 1 -- 172.21.15.1:0/2300515838 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7800d7b0 con 0x7f0d840ab1a0 2023-11-15T02:55:21.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.748+0000 7f0d8b445700 1 -- 172.21.15.1:0/2300515838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d84155350 con 0x7f0d840ab1a0 2023-11-15T02:55:21.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.748+0000 7f0d817fa700 1 -- 172.21.15.1:0/2300515838 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7800db30 con 0x7f0d840ab1a0 2023-11-15T02:55:21.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.748+0000 7f0d8b445700 1 -- 172.21.15.1:0/2300515838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d84155910 con 0x7f0d840ab1a0 2023-11-15T02:55:21.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.749+0000 7f0d8b445700 1 -- 172.21.15.1:0/2300515838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8406c7e0 con 0x7f0d840ab1a0 2023-11-15T02:55:21.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.749+0000 7f0d817fa700 1 -- 172.21.15.1:0/2300515838 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0d78013070 con 0x7f0d840ab1a0 2023-11-15T02:55:21.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.750+0000 7f0d817fa700 1 --2- 172.21.15.1:0/2300515838 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0d7005f270 0x7f0d70061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:21.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.750+0000 7f0d817fa700 1 -- 172.21.15.1:0/2300515838 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6673+0+0 (secure 0 0 0) 0x7f0d7807b270 con 0x7f0d840ab1a0 2023-11-15T02:55:21.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.750+0000 7f0d891e1700 1 --2- 172.21.15.1:0/2300515838 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0d7005f270 0x7f0d70061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:21.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.750+0000 7f0d891e1700 1 --2- 172.21.15.1:0/2300515838 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0d7005f270 0x7f0d70061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0d7400b810 tx=0x7f0d74008040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:21.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.754+0000 7f0d817fa700 1 -- 172.21.15.1:0/2300515838 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0d7804c190 con 0x7f0d840ab1a0 2023-11-15T02:55:21.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.926+0000 7f0d8b445700 1 -- 172.21.15.1:0/2300515838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d840c02a0 con 0x7f0d840ab1a0 2023-11-15T02:55:21.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.927+0000 7f0d817fa700 1 -- 172.21.15.1:0/2300515838 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v211) v1 ==== 74+0+17759 (secure 0 0 0) 0x7f0d7801b020 con 0x7f0d840ab1a0 2023-11-15T02:55:21.929 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:21.930 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":211,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:55:21.588048+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:55:19.243909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-11-15T02:55:20.580363+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:55:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.929+0000 7f0d8b445700 1 -- 172.21.15.1:0/2300515838 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0d7005f270 msgr2=0x7f0d70061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.929+0000 7f0d8b445700 1 --2- 172.21.15.1:0/2300515838 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0d7005f270 0x7f0d70061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0d7400b810 tx=0x7f0d74008040).stop 2023-11-15T02:55:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.929+0000 7f0d8b445700 1 -- 172.21.15.1:0/2300515838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d840ab1a0 msgr2=0x7f0d84167820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.929+0000 7f0d8b445700 1 --2- 172.21.15.1:0/2300515838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d840ab1a0 0x7f0d84167820 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7f0d7800a400 tx=0x7f0d78007910).stop 2023-11-15T02:55:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.929+0000 7f0d8b445700 1 -- 172.21.15.1:0/2300515838 shutdown_connections 2023-11-15T02:55:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.929+0000 7f0d8b445700 1 --2- 172.21.15.1:0/2300515838 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0d7005f270 0x7f0d70061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.929+0000 7f0d8b445700 1 --2- 172.21.15.1:0/2300515838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d84154150 0x7f0d8414c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.929+0000 7f0d8b445700 1 --2- 172.21.15.1:0/2300515838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d840aa060 0x7f0d84156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.929+0000 7f0d8b445700 1 --2- 172.21.15.1:0/2300515838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d840ab1a0 0x7f0d84167820 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.929+0000 7f0d8b445700 1 -- 172.21.15.1:0/2300515838 >> 172.21.15.1:0/2300515838 conn(0x7f0d84064aa0 msgr2=0x7f0d840ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.929+0000 7f0d8b445700 1 -- 172.21.15.1:0/2300515838 shutdown_connections 2023-11-15T02:55:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:21.929+0000 7f0d8b445700 1 -- 172.21.15.1:0/2300515838 wait complete. 2023-11-15T02:55:21.943 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:55:22.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.060+0000 7fc0c5938700 1 Processor -- start 2023-11-15T02:55:22.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.060+0000 7fc0c5938700 1 -- start start 2023-11-15T02:55:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.061+0000 7fc0c5938700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0c00ab1a0 0x7fc0c0154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.061+0000 7fc0c5938700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c00c06f0 con 0x7fc0c0154150 2023-11-15T02:55:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.061+0000 7fc0c5938700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c00c09d0 con 0x7fc0c00aa060 2023-11-15T02:55:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.061+0000 7fc0c5938700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c0158820 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.061+0000 7fc0beffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc0c0154150 0x7fc0c0158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:50090/0 (socket says 172.21.15.1:50090) 2023-11-15T02:55:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.061+0000 7fc0beffd700 1 -- 172.21.15.1:0/2297731963 learned_addr learned my addr 172.21.15.1:0/2297731963 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.061+0000 7fc0be7fc700 1 --2- 172.21.15.1:0/2297731963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0c00ab1a0 0x7fc0c0154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.061+0000 7fc0bdffb700 1 -- 172.21.15.1:0/2297731963 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117337875 0 0) 0x7fc0c00c06f0 con 0x7fc0c0154150 2023-11-15T02:55:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.061+0000 7fc0bdffb700 1 -- 172.21.15.1:0/2297731963 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0ac0033f0 con 0x7fc0c0154150 2023-11-15T02:55:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.061+0000 7fc0be7fc700 1 -- 172.21.15.1:0/2297731963 >> v1:172.21.15.141:6789/0 conn(0x7fc0c00aa060 legacy=0x7fc0c00c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.061+0000 7fc0be7fc700 1 -- 172.21.15.1:0/2297731963 >> v1:172.21.15.1:6789/0 conn(0x7fc0c0154150 legacy=0x7fc0c0158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.061+0000 7fc0be7fc700 1 -- 172.21.15.1:0/2297731963 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c0158b00 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.061+0000 7fc0be7fc700 1 --2- 172.21.15.1:0/2297731963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0c00ab1a0 0x7fc0c0154530 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fc0a8009790 tx=0x7fc0a8009060).ready entity=mon.2 client_cookie=909ad6f308c2db1d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.062+0000 7fc0bdffb700 1 -- 172.21.15.1:0/2297731963 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a80090d0 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.062+0000 7fc0bdffb700 1 -- 172.21.15.1:0/2297731963 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a800f510 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.062+0000 7fc0bdffb700 1 -- 172.21.15.1:0/2297731963 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800f890 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.062+0000 7fc0c5938700 1 -- 172.21.15.1:0/2297731963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0c00ab1a0 msgr2=0x7fc0c0154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.062+0000 7fc0c5938700 1 --2- 172.21.15.1:0/2297731963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0c00ab1a0 0x7fc0c0154530 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fc0a8009790 tx=0x7fc0a8009060).stop 2023-11-15T02:55:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.062+0000 7fc0c5938700 1 -- 172.21.15.1:0/2297731963 shutdown_connections 2023-11-15T02:55:22.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.062+0000 7fc0c5938700 1 --2- 172.21.15.1:0/2297731963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0c00ab1a0 0x7fc0c0154530 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:22.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.062+0000 7fc0c5938700 1 -- 172.21.15.1:0/2297731963 >> 172.21.15.1:0/2297731963 conn(0x7fc0c0064aa0 msgr2=0x7fc0c0064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:22.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.062+0000 7fc0c5938700 1 -- 172.21.15.1:0/2297731963 shutdown_connections 2023-11-15T02:55:22.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.062+0000 7fc0c5938700 1 -- 172.21.15.1:0/2297731963 wait complete. 2023-11-15T02:55:22.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.063+0000 7fc0c5938700 1 Processor -- start 2023-11-15T02:55:22.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.063+0000 7fc0c5938700 1 -- start start 2023-11-15T02:55:22.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0c5938700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0c00aa060 0x7fc0c01575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:22.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0c5938700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0c00ab1a0 0x7fc0c00c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:22.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0c5938700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0c0154150 0x7fc0c00c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:22.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0c5938700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c01551c0 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0c5938700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c0157130 con 0x7fc0c00aa060 2023-11-15T02:55:22.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0c5938700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c0154bb0 con 0x7fc0c0154150 2023-11-15T02:55:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0be7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0c00ab1a0 0x7fc0c00c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0be7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0c00ab1a0 0x7fc0c00c4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36338/0 (socket says 172.21.15.1:36338) 2023-11-15T02:55:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0be7fc700 1 -- 172.21.15.1:0/1378612901 learned_addr learned my addr 172.21.15.1:0/1378612901 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0bf7fe700 1 --2- 172.21.15.1:0/1378612901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0c0154150 0x7fc0c00c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:22.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0beffd700 1 --2- 172.21.15.1:0/1378612901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0c00aa060 0x7fc0c01575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:22.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0be7fc700 1 -- 172.21.15.1:0/1378612901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0c0154150 msgr2=0x7fc0c00c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:22.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0be7fc700 1 --2- 172.21.15.1:0/1378612901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0c0154150 0x7fc0c00c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:22.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0be7fc700 1 -- 172.21.15.1:0/1378612901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0c00aa060 msgr2=0x7fc0c01575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:22.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0be7fc700 1 --2- 172.21.15.1:0/1378612901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0c00aa060 0x7fc0c01575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:22.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.064+0000 7fc0be7fc700 1 -- 172.21.15.1:0/1378612901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a80092a0 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.065+0000 7fc0be7fc700 1 --2- 172.21.15.1:0/1378612901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0c00ab1a0 0x7fc0c00c4ed0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7fc0a8009e30 tx=0x7fc0a8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:22.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.065+0000 7fc0b6ffd700 1 -- 172.21.15.1:0/1378612901 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800f890 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.065+0000 7fc0b6ffd700 1 -- 172.21.15.1:0/1378612901 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a8006950 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.065+0000 7fc0c5938700 1 -- 172.21.15.1:0/1378612901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c0156e50 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.065+0000 7fc0b6ffd700 1 -- 172.21.15.1:0/1378612901 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800fe60 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.065+0000 7fc0c5938700 1 -- 172.21.15.1:0/1378612901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c00c53c0 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.066+0000 7fc0c5938700 1 -- 172.21.15.1:0/1378612901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c0155330 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.066+0000 7fc0b6ffd700 1 -- 172.21.15.1:0/1378612901 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc0a801b620 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.067+0000 7fc0b6ffd700 1 --2- 172.21.15.1:0/1378612901 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc0a005f270 0x7fc0a0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:22.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.067+0000 7fc0b6ffd700 1 -- 172.21.15.1:0/1378612901 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6673+0+0 (secure 0 0 0) 0x7fc0a807bf90 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.067+0000 7fc0beffd700 1 --2- 172.21.15.1:0/1378612901 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc0a005f270 0x7fc0a0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:22.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.067+0000 7fc0beffd700 1 --2- 172.21.15.1:0/1378612901 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc0a005f270 0x7fc0a0061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc0b0005ad0 tx=0x7fc0b0009040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:22.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.071+0000 7fc0b6ffd700 1 -- 172.21.15.1:0/1378612901 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc0a80aaaf0 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.243+0000 7fc0c5938700 1 -- 172.21.15.1:0/1378612901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0c0158de0 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.243+0000 7fc0b6ffd700 1 -- 172.21.15.1:0/1378612901 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v211) v1 ==== 74+0+17759 (secure 0 0 0) 0x7fc0a8028070 con 0x7fc0c00ab1a0 2023-11-15T02:55:22.245 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:22.245 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":211,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:55:21.588048+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:55:19.243909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-11-15T02:55:20.580363+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:55:22.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.245+0000 7fc0c5938700 1 -- 172.21.15.1:0/1378612901 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc0a005f270 msgr2=0x7fc0a0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:22.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.245+0000 7fc0c5938700 1 --2- 172.21.15.1:0/1378612901 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc0a005f270 0x7fc0a0061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc0b0005ad0 tx=0x7fc0b0009040).stop 2023-11-15T02:55:22.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.245+0000 7fc0c5938700 1 -- 172.21.15.1:0/1378612901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0c00ab1a0 msgr2=0x7fc0c00c4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:22.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.245+0000 7fc0c5938700 1 --2- 172.21.15.1:0/1378612901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0c00ab1a0 0x7fc0c00c4ed0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7fc0a8009e30 tx=0x7fc0a8017000).stop 2023-11-15T02:55:22.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.246+0000 7fc0c5938700 1 -- 172.21.15.1:0/1378612901 shutdown_connections 2023-11-15T02:55:22.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.246+0000 7fc0c5938700 1 --2- 172.21.15.1:0/1378612901 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc0a005f270 0x7fc0a0061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:22.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.246+0000 7fc0c5938700 1 --2- 172.21.15.1:0/1378612901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc0c0154150 0x7fc0c00c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:22.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.246+0000 7fc0c5938700 1 --2- 172.21.15.1:0/1378612901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc0c00aa060 0x7fc0c01575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:22.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.246+0000 7fc0c5938700 1 --2- 172.21.15.1:0/1378612901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0c00ab1a0 0x7fc0c00c4ed0 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:22.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.246+0000 7fc0c5938700 1 -- 172.21.15.1:0/1378612901 >> 172.21.15.1:0/1378612901 conn(0x7fc0c0064aa0 msgr2=0x7fc0c00acae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:22.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.246+0000 7fc0c5938700 1 -- 172.21.15.1:0/1378612901 shutdown_connections 2023-11-15T02:55:22.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.246+0000 7fc0c5938700 1 -- 172.21.15.1:0/1378612901 wait complete. 2023-11-15T02:55:22.259 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-15T02:55:22.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.379+0000 7f23008b6700 1 Processor -- start 2023-11-15T02:55:22.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.379+0000 7f23008b6700 1 -- start start 2023-11-15T02:55:22.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f23008b6700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f22fc1541d0 0x7f22fc1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:22.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f23008b6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f22fc0c60d0 0x7f22fc0c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:22.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f23008b6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22fc0c7a60 0x7f22fc0c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:22.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f23008b6700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22fc158f40 con 0x7f22fc1541d0 2023-11-15T02:55:22.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f23008b6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22fc155830 con 0x7f22fc0c60d0 2023-11-15T02:55:22.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f23008b6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc154c20 con 0x7f22fc0c7a60 2023-11-15T02:55:22.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f22fb7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f22fc1541d0 0x7f22fc1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:22.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f22fb7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f22fc1541d0 0x7f22fc1545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36344/0 (socket says 172.21.15.1:36344) 2023-11-15T02:55:22.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f22fb7fe700 1 -- 172.21.15.1:0/3237699933 learned_addr learned my addr 172.21.15.1:0/3237699933 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:22.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f22fb7fe700 1 -- 172.21.15.1:0/3237699933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22fc0c7a60 msgr2=0x7f22fc0c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:22.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f22fbfff700 1 --2- 172.21.15.1:0/3237699933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22fc0c7a60 0x7f22fc0c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:22.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f22faffd700 1 --2- 172.21.15.1:0/3237699933 >> v2:172.21.15.141:3300/0 conn(0x7f22fc0c60d0 0x7f22fc0c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:22.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f22fb7fe700 1 --2- 172.21.15.1:0/3237699933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22fc0c7a60 0x7f22fc0c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:22.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f22fb7fe700 1 -- 172.21.15.1:0/3237699933 >> v2:172.21.15.141:3300/0 conn(0x7f22fc0c60d0 msgr2=0x7f22fc0c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:22.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f22fb7fe700 1 --2- 172.21.15.1:0/3237699933 >> v2:172.21.15.141:3300/0 conn(0x7f22fc0c60d0 0x7f22fc0c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:22.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f22fb7fe700 1 -- 172.21.15.1:0/3237699933 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc154f00 con 0x7f22fc1541d0 2023-11-15T02:55:22.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f22fbfff700 1 --2- 172.21.15.1:0/3237699933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22fc0c7a60 0x7f22fc0c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:22.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f22faffd700 1 --2- 172.21.15.1:0/3237699933 >> v2:172.21.15.141:3300/0 conn(0x7f22fc0c60d0 0x7f22fc0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:22.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.380+0000 7f22fb7fe700 1 --2- 172.21.15.1:0/3237699933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22fc1541d0 0x7f22fc1545b0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f22fc05fbf0 tx=0x7f22ec0090f0).ready entity=mon.0 client_cookie=7a3472cba9e95891 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:22.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.381+0000 7f22fa7fc700 1 -- 172.21.15.1:0/3237699933 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00b600 con 0x7f22fc1541d0 2023-11-15T02:55:22.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.381+0000 7f22fa7fc700 1 -- 172.21.15.1:0/3237699933 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec00b760 con 0x7f22fc1541d0 2023-11-15T02:55:22.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.381+0000 7f22fa7fc700 1 -- 172.21.15.1:0/3237699933 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00bae0 con 0x7f22fc1541d0 2023-11-15T02:55:22.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.381+0000 7f23008b6700 1 -- 172.21.15.1:0/3237699933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22fc1541d0 msgr2=0x7f22fc1545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:22.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.381+0000 7f23008b6700 1 --2- 172.21.15.1:0/3237699933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22fc1541d0 0x7f22fc1545b0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f22fc05fbf0 tx=0x7f22ec0090f0).stop 2023-11-15T02:55:22.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.381+0000 7f23008b6700 1 -- 172.21.15.1:0/3237699933 shutdown_connections 2023-11-15T02:55:22.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.381+0000 7f23008b6700 1 --2- 172.21.15.1:0/3237699933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22fc1541d0 0x7f22fc1545b0 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:22.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.381+0000 7f23008b6700 1 --2- 172.21.15.1:0/3237699933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22fc0c7a60 0x7f22fc0c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:22.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.381+0000 7f23008b6700 1 --2- 172.21.15.1:0/3237699933 >> v2:172.21.15.141:3300/0 conn(0x7f22fc0c60d0 0x7f22fc0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:22.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.381+0000 7f23008b6700 1 -- 172.21.15.1:0/3237699933 >> 172.21.15.1:0/3237699933 conn(0x7f22fc069ee0 msgr2=0x7f22fc06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:22.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.381+0000 7f23008b6700 1 -- 172.21.15.1:0/3237699933 shutdown_connections 2023-11-15T02:55:22.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.381+0000 7f23008b6700 1 -- 172.21.15.1:0/3237699933 wait complete. 2023-11-15T02:55:22.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.382+0000 7f23008b6700 1 Processor -- start 2023-11-15T02:55:22.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.383+0000 7f23008b6700 1 -- start start 2023-11-15T02:55:22.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.383+0000 7f23008b6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22fc0c60d0 0x7f22fc1575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:22.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.383+0000 7f23008b6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22fc0c7a60 0x7f22fc143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:22.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.383+0000 7f23008b6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22fc1541d0 0x7f22fc155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:22.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.383+0000 7f23008b6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc157120 con 0x7f22fc0c60d0 2023-11-15T02:55:22.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.383+0000 7f23008b6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc156510 con 0x7f22fc1541d0 2023-11-15T02:55:22.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.383+0000 7f23008b6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc1567f0 con 0x7f22fc0c7a60 2023-11-15T02:55:22.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.383+0000 7f22fb7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22fc0c60d0 0x7f22fc1575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:22.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.383+0000 7f22fb7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22fc0c60d0 0x7f22fc1575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36352/0 (socket says 172.21.15.1:36352) 2023-11-15T02:55:22.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.383+0000 7f22fb7fe700 1 -- 172.21.15.1:0/1671787087 learned_addr learned my addr 172.21.15.1:0/1671787087 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:22.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.383+0000 7f22faffd700 1 --2- 172.21.15.1:0/1671787087 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22fc0c7a60 0x7f22fc143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:22.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.384+0000 7f22fbfff700 1 --2- 172.21.15.1:0/1671787087 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22fc1541d0 0x7f22fc155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:22.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.384+0000 7f22fb7fe700 1 -- 172.21.15.1:0/1671787087 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22fc0c7a60 msgr2=0x7f22fc143b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:22.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.384+0000 7f22fb7fe700 1 --2- 172.21.15.1:0/1671787087 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22fc0c7a60 0x7f22fc143b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:22.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.384+0000 7f22fb7fe700 1 -- 172.21.15.1:0/1671787087 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22fc1541d0 msgr2=0x7f22fc155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:22.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.384+0000 7f22fb7fe700 1 --2- 172.21.15.1:0/1671787087 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22fc1541d0 0x7f22fc155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:22.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.384+0000 7f22fb7fe700 1 -- 172.21.15.1:0/1671787087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec009370 con 0x7f22fc0c60d0 2023-11-15T02:55:22.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.384+0000 7f22fb7fe700 1 --2- 172.21.15.1:0/1671787087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22fc0c60d0 0x7f22fc1575b0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f22ec009130 tx=0x7f22ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:22.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.384+0000 7f22e37fe700 1 -- 172.21.15.1:0/1671787087 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00b8d0 con 0x7f22fc0c60d0 2023-11-15T02:55:22.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.384+0000 7f22e37fe700 1 -- 172.21.15.1:0/1671787087 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec00ba30 con 0x7f22fc0c60d0 2023-11-15T02:55:22.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.384+0000 7f23008b6700 1 -- 172.21.15.1:0/1671787087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc156ad0 con 0x7f22fc0c60d0 2023-11-15T02:55:22.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.384+0000 7f22e37fe700 1 -- 172.21.15.1:0/1671787087 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec01b660 con 0x7f22fc0c60d0 2023-11-15T02:55:22.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.384+0000 7f23008b6700 1 -- 172.21.15.1:0/1671787087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc144070 con 0x7f22fc0c60d0 2023-11-15T02:55:22.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.385+0000 7f23008b6700 1 -- 172.21.15.1:0/1671787087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc157400 con 0x7f22fc0c60d0 2023-11-15T02:55:22.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.386+0000 7f22e37fe700 1 -- 172.21.15.1:0/1671787087 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f22ec01ba10 con 0x7f22fc0c60d0 2023-11-15T02:55:22.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.386+0000 7f22e37fe700 1 --2- 172.21.15.1:0/1671787087 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f22e805f240 0x7f22e8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:22.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.386+0000 7f22e37fe700 1 -- 172.21.15.1:0/1671787087 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6673+0+0 (secure 0 0 0) 0x7f22ec07bfd0 con 0x7f22fc0c60d0 2023-11-15T02:55:22.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.386+0000 7f22faffd700 1 --2- 172.21.15.1:0/1671787087 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f22e805f240 0x7f22e8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:22.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.387+0000 7f22faffd700 1 --2- 172.21.15.1:0/1671787087 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f22e805f240 0x7f22e8061700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f22fc0aa550 tx=0x7f22f0008040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:22.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.390+0000 7f22e37fe700 1 -- 172.21.15.1:0/1671787087 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f22ec04cef0 con 0x7f22fc0c60d0 2023-11-15T02:55:22.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:22.607+0000 7f23008b6700 1 -- 172.21.15.1:0/1671787087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f22fc0475e0 con 0x7f22fc0c60d0 2023-11-15T02:55:23.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.601+0000 7f22e37fe700 1 -- 172.21.15.1:0/1671787087 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v94) v1 ==== 118+0+0 (secure 0 0 0) 0x7f22ec01f0b0 con 0x7f22fc0c60d0 2023-11-15T02:55:23.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.604+0000 7f23008b6700 1 -- 172.21.15.1:0/1671787087 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f22e805f240 msgr2=0x7f22e8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:23.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.604+0000 7f23008b6700 1 --2- 172.21.15.1:0/1671787087 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f22e805f240 0x7f22e8061700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f22fc0aa550 tx=0x7f22f0008040).stop 2023-11-15T02:55:23.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.604+0000 7f23008b6700 1 -- 172.21.15.1:0/1671787087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22fc0c60d0 msgr2=0x7f22fc1575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:23.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.604+0000 7f23008b6700 1 --2- 172.21.15.1:0/1671787087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22fc0c60d0 0x7f22fc1575b0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f22ec009130 tx=0x7f22ec017000).stop 2023-11-15T02:55:23.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.604+0000 7f23008b6700 1 -- 172.21.15.1:0/1671787087 shutdown_connections 2023-11-15T02:55:23.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.604+0000 7f23008b6700 1 --2- 172.21.15.1:0/1671787087 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f22e805f240 0x7f22e8061700 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:23.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.604+0000 7f23008b6700 1 --2- 172.21.15.1:0/1671787087 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f22fc1541d0 0x7f22fc155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:23.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.604+0000 7f23008b6700 1 --2- 172.21.15.1:0/1671787087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22fc0c60d0 0x7f22fc1575b0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:23.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.604+0000 7f23008b6700 1 --2- 172.21.15.1:0/1671787087 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f22fc0c7a60 0x7f22fc143b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:23.608 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.604+0000 7f23008b6700 1 -- 172.21.15.1:0/1671787087 >> 172.21.15.1:0/1671787087 conn(0x7f22fc069ee0 msgr2=0x7f22fc153300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:23.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.604+0000 7f23008b6700 1 -- 172.21.15.1:0/1671787087 shutdown_connections 2023-11-15T02:55:23.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.604+0000 7f23008b6700 1 -- 172.21.15.1:0/1671787087 wait complete. 2023-11-15T02:55:23.620 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-15T02:55:23.621 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-15T02:55:23.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.750+0000 7fee098d1700 1 Processor -- start 2023-11-15T02:55:23.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.750+0000 7fee098d1700 1 -- start start 2023-11-15T02:55:23.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.751+0000 7fee098d1700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fee041540a0 0x7fee040ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:23.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.751+0000 7fee098d1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee04154480 0x7fee040ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:23.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.751+0000 7fee098d1700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee040ca050 con 0x7fee040c5f40 2023-11-15T02:55:23.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.751+0000 7fee098d1700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee040c9440 con 0x7fee041540a0 2023-11-15T02:55:23.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.751+0000 7fee098d1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee040c9720 con 0x7fee04154480 2023-11-15T02:55:23.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.751+0000 7fee02ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fee041540a0 0x7fee040ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:23.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.751+0000 7fee037fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fee040c5f40 0x7fee040aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:50100/0 (socket says 172.21.15.1:50100) 2023-11-15T02:55:23.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.751+0000 7fee037fe700 1 -- 172.21.15.1:0/387406262 learned_addr learned my addr 172.21.15.1:0/387406262 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:23.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.751+0000 7fee027fc700 1 --2- 172.21.15.1:0/387406262 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee04154480 0x7fee040ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:23.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.751+0000 7fee02ffd700 1 -- 172.21.15.1:0/387406262 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee04154480 msgr2=0x7fee040ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:23.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.751+0000 7fee02ffd700 1 --2- 172.21.15.1:0/387406262 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee04154480 0x7fee040ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:23.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.751+0000 7fee02ffd700 1 -- 172.21.15.1:0/387406262 >> v1:172.21.15.1:6789/0 conn(0x7fee040c5f40 legacy=0x7fee040aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:23.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.751+0000 7fee01ffb700 1 -- 172.21.15.1:0/387406262 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64312779 0 0) 0x7fee040ca050 con 0x7fee040c5f40 2023-11-15T02:55:23.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.751+0000 7fee02ffd700 1 -- 172.21.15.1:0/387406262 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee040c9a00 con 0x7fee041540a0 2023-11-15T02:55:23.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.751+0000 7fee02ffd700 1 --2- 172.21.15.1:0/387406262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee041540a0 0x7fee040ca4e0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7fedfc009e60 tx=0x7fedfc009780).ready entity=mon.0 client_cookie=acf65ef891d35bf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:23.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.752+0000 7fee01ffb700 1 -- 172.21.15.1:0/387406262 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc00e070 con 0x7fee041540a0 2023-11-15T02:55:23.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.752+0000 7fee01ffb700 1 -- 172.21.15.1:0/387406262 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc00bc30 con 0x7fee041540a0 2023-11-15T02:55:23.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.752+0000 7fee01ffb700 1 -- 172.21.15.1:0/387406262 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc012410 con 0x7fee041540a0 2023-11-15T02:55:23.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.752+0000 7fee098d1700 1 -- 172.21.15.1:0/387406262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee041540a0 msgr2=0x7fee040ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:23.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.752+0000 7fee098d1700 1 --2- 172.21.15.1:0/387406262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee041540a0 0x7fee040ca4e0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7fedfc009e60 tx=0x7fedfc009780).stop 2023-11-15T02:55:23.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.752+0000 7fee098d1700 1 -- 172.21.15.1:0/387406262 shutdown_connections 2023-11-15T02:55:23.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.752+0000 7fee098d1700 1 --2- 172.21.15.1:0/387406262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee041540a0 0x7fee040ca4e0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:23.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.752+0000 7fee098d1700 1 --2- 172.21.15.1:0/387406262 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee04154480 0x7fee040ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:23.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.752+0000 7fee098d1700 1 -- 172.21.15.1:0/387406262 >> 172.21.15.1:0/387406262 conn(0x7fee04064a70 msgr2=0x7fee04064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:23.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.752+0000 7fee098d1700 1 -- 172.21.15.1:0/387406262 shutdown_connections 2023-11-15T02:55:23.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.752+0000 7fee098d1700 1 -- 172.21.15.1:0/387406262 wait complete. 2023-11-15T02:55:23.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.753+0000 7fee098d1700 1 Processor -- start 2023-11-15T02:55:23.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.754+0000 7fee098d1700 1 -- start start 2023-11-15T02:55:23.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.754+0000 7fee098d1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee040c5f40 0x7fee04150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:23.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.754+0000 7fee098d1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee041540a0 0x7fee04157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:23.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.754+0000 7fee098d1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee04154480 0x7fee040cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:23.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.754+0000 7fee098d1700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee041593d0 con 0x7fee041540a0 2023-11-15T02:55:23.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.754+0000 7fee098d1700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee04151410 con 0x7fee04154480 2023-11-15T02:55:23.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.754+0000 7fee098d1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee041587c0 con 0x7fee040c5f40 2023-11-15T02:55:23.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.754+0000 7fee027fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee041540a0 0x7fee04157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:23.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.754+0000 7fee027fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee041540a0 0x7fee04157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36374/0 (socket says 172.21.15.1:36374) 2023-11-15T02:55:23.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.754+0000 7fee027fc700 1 -- 172.21.15.1:0/4096696181 learned_addr learned my addr 172.21.15.1:0/4096696181 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:23.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.755+0000 7fee027fc700 1 -- 172.21.15.1:0/4096696181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee040c5f40 msgr2=0x7fee04150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:23.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.755+0000 7fee027fc700 1 --2- 172.21.15.1:0/4096696181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee040c5f40 0x7fee04150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:23.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.755+0000 7fee037fe700 1 --2- 172.21.15.1:0/4096696181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee04154480 0x7fee040cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:23.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.755+0000 7fee027fc700 1 -- 172.21.15.1:0/4096696181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee04154480 msgr2=0x7fee040cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:23.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.755+0000 7fee027fc700 1 --2- 172.21.15.1:0/4096696181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee04154480 0x7fee040cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:23.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.755+0000 7fee027fc700 1 -- 172.21.15.1:0/4096696181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc009a20 con 0x7fee041540a0 2023-11-15T02:55:23.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.755+0000 7fee027fc700 1 --2- 172.21.15.1:0/4096696181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee041540a0 0x7fee04157840 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7fedec00d890 tx=0x7fedec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:23.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.755+0000 7fedfaffd700 1 -- 172.21.15.1:0/4096696181 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec0125f0 con 0x7fee041540a0 2023-11-15T02:55:23.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.755+0000 7fedfaffd700 1 -- 172.21.15.1:0/4096696181 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec012750 con 0x7fee041540a0 2023-11-15T02:55:23.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.755+0000 7fee098d1700 1 -- 172.21.15.1:0/4096696181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee04158aa0 con 0x7fee041540a0 2023-11-15T02:55:23.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.755+0000 7fedfaffd700 1 -- 172.21.15.1:0/4096696181 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec012ad0 con 0x7fee041540a0 2023-11-15T02:55:23.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.755+0000 7fee098d1700 1 -- 172.21.15.1:0/4096696181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee04159060 con 0x7fee041540a0 2023-11-15T02:55:23.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.756+0000 7fee098d1700 1 -- 172.21.15.1:0/4096696181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee041596b0 con 0x7fee041540a0 2023-11-15T02:55:23.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.756+0000 7fedfaffd700 1 -- 172.21.15.1:0/4096696181 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fedec013480 con 0x7fee041540a0 2023-11-15T02:55:23.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.757+0000 7fedfaffd700 1 --2- 172.21.15.1:0/4096696181 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fede405f270 0x7fede4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:23.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.757+0000 7fedfaffd700 1 -- 172.21.15.1:0/4096696181 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6673+0+0 (secure 0 0 0) 0x7fedec07a7d0 con 0x7fee041540a0 2023-11-15T02:55:23.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.757+0000 7fee02ffd700 1 --2- 172.21.15.1:0/4096696181 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fede405f270 0x7fede4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:23.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.758+0000 7fee02ffd700 1 --2- 172.21.15.1:0/4096696181 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fede405f270 0x7fede4061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fedfc009e60 tx=0x7fedfc009780).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:23.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.761+0000 7fedfaffd700 1 -- 172.21.15.1:0/4096696181 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fedec04b6f0 con 0x7fee041540a0 2023-11-15T02:55:23.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:23.976+0000 7fee098d1700 1 -- 172.21.15.1:0/4096696181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fee04159510 con 0x7fee041540a0 2023-11-15T02:55:24.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.605+0000 7fedfaffd700 1 -- 172.21.15.1:0/4096696181 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v95) v1 ==== 122+0+0 (secure 0 0 0) 0x7fee04159510 con 0x7fee041540a0 2023-11-15T02:55:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.608+0000 7fee098d1700 1 -- 172.21.15.1:0/4096696181 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fede405f270 msgr2=0x7fede4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.608+0000 7fee098d1700 1 --2- 172.21.15.1:0/4096696181 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fede405f270 0x7fede4061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fedfc009e60 tx=0x7fedfc009780).stop 2023-11-15T02:55:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.608+0000 7fee098d1700 1 -- 172.21.15.1:0/4096696181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee041540a0 msgr2=0x7fee04157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.608+0000 7fee098d1700 1 --2- 172.21.15.1:0/4096696181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee041540a0 0x7fee04157840 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7fedec00d890 tx=0x7fedec008040).stop 2023-11-15T02:55:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.608+0000 7fee098d1700 1 -- 172.21.15.1:0/4096696181 shutdown_connections 2023-11-15T02:55:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.608+0000 7fee098d1700 1 --2- 172.21.15.1:0/4096696181 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fede405f270 0x7fede4061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.608+0000 7fee098d1700 1 --2- 172.21.15.1:0/4096696181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee04154480 0x7fee040cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.608+0000 7fee098d1700 1 --2- 172.21.15.1:0/4096696181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee040c5f40 0x7fee04150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:24.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.608+0000 7fee098d1700 1 --2- 172.21.15.1:0/4096696181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee041540a0 0x7fee04157840 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:24.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.608+0000 7fee098d1700 1 -- 172.21.15.1:0/4096696181 >> 172.21.15.1:0/4096696181 conn(0x7fee04064a70 msgr2=0x7fee040ab780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:24.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.608+0000 7fee098d1700 1 -- 172.21.15.1:0/4096696181 shutdown_connections 2023-11-15T02:55:24.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.608+0000 7fee098d1700 1 -- 172.21.15.1:0/4096696181 wait complete. 2023-11-15T02:55:24.623 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-15T02:55:24.623 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:55:24.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.744+0000 7fd177b91700 1 Processor -- start 2023-11-15T02:55:24.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.744+0000 7fd177b91700 1 -- start start 2023-11-15T02:55:24.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.745+0000 7fd177b91700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd170154150 0x7fd170154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:24.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.745+0000 7fd177b91700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1700ab1a0 0x7fd170158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:24.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.745+0000 7fd177b91700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1700c06f0 con 0x7fd1700aa060 2023-11-15T02:55:24.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.745+0000 7fd177b91700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1700c09d0 con 0x7fd170154150 2023-11-15T02:55:24.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.745+0000 7fd177b91700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd170158820 con 0x7fd1700ab1a0 2023-11-15T02:55:24.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.745+0000 7fd17612e700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd1700aa060 0x7fd1700c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:50102/0 (socket says 172.21.15.1:50102) 2023-11-15T02:55:24.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.745+0000 7fd17612e700 1 -- 172.21.15.1:0/4090747272 learned_addr learned my addr 172.21.15.1:0/4090747272 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:24.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.745+0000 7fd17512c700 1 --2- 172.21.15.1:0/4090747272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1700ab1a0 0x7fd170158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:24.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.745+0000 7fd17592d700 1 --2- 172.21.15.1:0/4090747272 >> v2:172.21.15.141:3300/0 conn(0x7fd170154150 0x7fd170154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:24.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.745+0000 7fd17492b700 1 -- 172.21.15.1:0/4090747272 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083041846 0 0) 0x7fd1700c06f0 con 0x7fd1700aa060 2023-11-15T02:55:24.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.745+0000 7fd17492b700 1 -- 172.21.15.1:0/4090747272 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1580033f0 con 0x7fd1700aa060 2023-11-15T02:55:24.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17492b700 1 -- 172.21.15.1:0/4090747272 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3757107585 0 0) 0x7fd1580033f0 con 0x7fd1700aa060 2023-11-15T02:55:24.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17492b700 1 -- 172.21.15.1:0/4090747272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1700ab1a0 msgr2=0x7fd170158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:24.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17492b700 1 --2- 172.21.15.1:0/4090747272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1700ab1a0 0x7fd170158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:24.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17492b700 1 -- 172.21.15.1:0/4090747272 >> v2:172.21.15.141:3300/0 conn(0x7fd170154150 msgr2=0x7fd170154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:24.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17492b700 1 --2- 172.21.15.1:0/4090747272 >> v2:172.21.15.141:3300/0 conn(0x7fd170154150 0x7fd170154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:24.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17492b700 1 -- 172.21.15.1:0/4090747272 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd170158b00 con 0x7fd1700aa060 2023-11-15T02:55:24.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17492b700 1 -- 172.21.15.1:0/4090747272 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fd1600017f0 con 0x7fd1700aa060 2023-11-15T02:55:24.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17492b700 1 -- 172.21.15.1:0/4090747272 >> v1:172.21.15.1:6789/0 conn(0x7fd1700aa060 legacy=0x7fd1700c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:24.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17492b700 1 --2- 172.21.15.1:0/4090747272 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1580038e0 0x7fd158003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:24.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17492b700 1 --2- 172.21.15.1:0/4090747272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1700ab1a0 0x7fd158004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:24.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17492b700 1 --2- 172.21.15.1:0/4090747272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd158004b80 0x7fd158005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:24.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17492b700 1 -- 172.21.15.1:0/4090747272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700c09d0 con 0x7fd158004b80 2023-11-15T02:55:24.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17492b700 1 -- 172.21.15.1:0/4090747272 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd170158820 con 0x7fd1580038e0 2023-11-15T02:55:24.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17492b700 1 -- 172.21.15.1:0/4090747272 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15800b8e0 con 0x7fd1700ab1a0 2023-11-15T02:55:24.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17612e700 1 --2- 172.21.15.1:0/4090747272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd158004b80 0x7fd158005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:24.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17592d700 1 --2- 172.21.15.1:0/4090747272 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1580038e0 0x7fd158003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:24.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17512c700 1 --2- 172.21.15.1:0/4090747272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1700ab1a0 0x7fd158004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:24.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17612e700 1 -- 172.21.15.1:0/4090747272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1700ab1a0 msgr2=0x7fd158004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:24.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17612e700 1 --2- 172.21.15.1:0/4090747272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1700ab1a0 0x7fd158004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:24.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17612e700 1 -- 172.21.15.1:0/4090747272 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1580038e0 msgr2=0x7fd158003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:24.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17612e700 1 --2- 172.21.15.1:0/4090747272 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1580038e0 0x7fd158003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:24.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17612e700 1 -- 172.21.15.1:0/4090747272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1580033f0 con 0x7fd158004b80 2023-11-15T02:55:24.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.746+0000 7fd17612e700 1 --2- 172.21.15.1:0/4090747272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd158004b80 0x7fd158005000 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7fd16000c500 tx=0x7fd160001d90).ready entity=mon.0 client_cookie=ef844944edbf44c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:24.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.747+0000 7fd17492b700 1 -- 172.21.15.1:0/4090747272 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16000ce30 con 0x7fd158004b80 2023-11-15T02:55:24.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.747+0000 7fd17492b700 1 -- 172.21.15.1:0/4090747272 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd160005b20 con 0x7fd158004b80 2023-11-15T02:55:24.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.747+0000 7fd17492b700 1 -- 172.21.15.1:0/4090747272 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1600070d0 con 0x7fd158004b80 2023-11-15T02:55:24.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.747+0000 7fd177b91700 1 -- 172.21.15.1:0/4090747272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd158004b80 msgr2=0x7fd158005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:24.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.747+0000 7fd177b91700 1 --2- 172.21.15.1:0/4090747272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd158004b80 0x7fd158005000 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7fd16000c500 tx=0x7fd160001d90).stop 2023-11-15T02:55:24.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.747+0000 7fd17612e700 1 -- 172.21.15.1:0/4090747272 reap_dead start 2023-11-15T02:55:24.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.747+0000 7fd177b91700 1 -- 172.21.15.1:0/4090747272 shutdown_connections 2023-11-15T02:55:24.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.747+0000 7fd177b91700 1 -- 172.21.15.1:0/4090747272 >> 172.21.15.1:0/4090747272 conn(0x7fd170064aa0 msgr2=0x7fd170064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:24.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.747+0000 7fd177b91700 1 -- 172.21.15.1:0/4090747272 shutdown_connections 2023-11-15T02:55:24.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.747+0000 7fd177b91700 1 -- 172.21.15.1:0/4090747272 wait complete. 2023-11-15T02:55:24.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.748+0000 7fd177b91700 1 Processor -- start 2023-11-15T02:55:24.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.748+0000 7fd177b91700 1 -- start start 2023-11-15T02:55:24.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.749+0000 7fd177b91700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1700c4970 0x7fd17014c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:24.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.749+0000 7fd177b91700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1700c4d50 0x7fd17014c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:24.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.749+0000 7fd177b91700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1700c2290 0x7fd1700c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:24.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.749+0000 7fd177b91700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700cbb50 con 0x7fd1700c4d50 2023-11-15T02:55:24.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.749+0000 7fd177b91700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17014ce30 con 0x7fd1700c4970 2023-11-15T02:55:24.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.749+0000 7fd177b91700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700c9fa0 con 0x7fd1700c2290 2023-11-15T02:55:24.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.749+0000 7fd17512c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1700c4d50 0x7fd17014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:24.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.749+0000 7fd17512c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1700c4d50 0x7fd17014c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36384/0 (socket says 172.21.15.1:36384) 2023-11-15T02:55:24.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.749+0000 7fd17512c700 1 -- 172.21.15.1:0/309094609 learned_addr learned my addr 172.21.15.1:0/309094609 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:24.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.749+0000 7fd17592d700 1 --2- 172.21.15.1:0/309094609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1700c4970 0x7fd17014c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:24.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.749+0000 7fd17612e700 1 --2- 172.21.15.1:0/309094609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1700c2290 0x7fd1700c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:24.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.750+0000 7fd17512c700 1 -- 172.21.15.1:0/309094609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1700c2290 msgr2=0x7fd1700c26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:24.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.750+0000 7fd17512c700 1 --2- 172.21.15.1:0/309094609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1700c2290 0x7fd1700c26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:24.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.750+0000 7fd17512c700 1 -- 172.21.15.1:0/309094609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1700c4970 msgr2=0x7fd17014c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:24.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.750+0000 7fd17512c700 1 --2- 172.21.15.1:0/309094609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1700c4970 0x7fd17014c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:24.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.750+0000 7fd17512c700 1 -- 172.21.15.1:0/309094609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1700c9670 con 0x7fd1700c4d50 2023-11-15T02:55:24.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.750+0000 7fd17592d700 1 --2- 172.21.15.1:0/309094609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1700c4970 0x7fd17014c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:24.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.750+0000 7fd17512c700 1 --2- 172.21.15.1:0/309094609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1700c4d50 0x7fd17014c940 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7fd1640119c0 tx=0x7fd164009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:24.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.750+0000 7fd16dffb700 1 -- 172.21.15.1:0/309094609 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16400f8e0 con 0x7fd1700c4d50 2023-11-15T02:55:24.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.750+0000 7fd16dffb700 1 -- 172.21.15.1:0/309094609 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16400fa40 con 0x7fd1700c4d50 2023-11-15T02:55:24.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.750+0000 7fd177b91700 1 -- 172.21.15.1:0/309094609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1700c9950 con 0x7fd1700c4d50 2023-11-15T02:55:24.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.750+0000 7fd16dffb700 1 -- 172.21.15.1:0/309094609 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16400fdc0 con 0x7fd1700c4d50 2023-11-15T02:55:24.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.750+0000 7fd177b91700 1 -- 172.21.15.1:0/309094609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1700c2fe0 con 0x7fd1700c4d50 2023-11-15T02:55:24.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.751+0000 7fd177b91700 1 -- 172.21.15.1:0/309094609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17006c7e0 con 0x7fd1700c4d50 2023-11-15T02:55:24.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.751+0000 7fd16dffb700 1 -- 172.21.15.1:0/309094609 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd164014650 con 0x7fd1700c4d50 2023-11-15T02:55:24.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.752+0000 7fd16dffb700 1 --2- 172.21.15.1:0/309094609 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd15c05f240 0x7fd15c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:24.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.752+0000 7fd16dffb700 1 -- 172.21.15.1:0/309094609 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6673+0+0 (secure 0 0 0) 0x7fd16407b200 con 0x7fd1700c4d50 2023-11-15T02:55:24.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.752+0000 7fd17592d700 1 --2- 172.21.15.1:0/309094609 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd15c05f240 0x7fd15c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:24.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.752+0000 7fd17592d700 1 --2- 172.21.15.1:0/309094609 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd15c05f240 0x7fd15c061700 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fd168006d80 tx=0x7fd168008040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:24.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.756+0000 7fd16dffb700 1 -- 172.21.15.1:0/309094609 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd16404c120 con 0x7fd1700c4d50 2023-11-15T02:55:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.971+0000 7fd177b91700 1 -- 172.21.15.1:0/309094609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd170158de0 con 0x7fd1700c4d50 2023-11-15T02:55:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.972+0000 7fd16dffb700 1 -- 172.21.15.1:0/309094609 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4499 (secure 0 0 0) 0x7fd16404f740 con 0x7fd1700c4d50 2023-11-15T02:55:24.973 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:24.974 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":95,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10101,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2281092627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2281092627},{"type":"v1","addr":"172.21.15.1:6833","nonce":2281092627}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":10104,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3718177238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3718177238},{"type":"v1","addr":"172.21.15.1:6835","nonce":3718177238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":10113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3331826313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3331826313},{"type":"v1","addr":"172.21.15.141:6836","nonce":3331826313}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:55:21.588380+0000","modified":"2023-11-15T02:55:24.600875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10116":{"gid":10116,"name":"d","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/1145495775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1145495775},{"type":"v1","addr":"172.21.15.141:6837","nonce":1145495775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-11-15T02:55:24.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.974+0000 7fd177b91700 1 -- 172.21.15.1:0/309094609 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd15c05f240 msgr2=0x7fd15c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.974+0000 7fd177b91700 1 --2- 172.21.15.1:0/309094609 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd15c05f240 0x7fd15c061700 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fd168006d80 tx=0x7fd168008040).stop 2023-11-15T02:55:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.974+0000 7fd177b91700 1 -- 172.21.15.1:0/309094609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1700c4d50 msgr2=0x7fd17014c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.974+0000 7fd177b91700 1 --2- 172.21.15.1:0/309094609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1700c4d50 0x7fd17014c940 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7fd1640119c0 tx=0x7fd164009060).stop 2023-11-15T02:55:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.974+0000 7fd177b91700 1 -- 172.21.15.1:0/309094609 shutdown_connections 2023-11-15T02:55:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.974+0000 7fd177b91700 1 --2- 172.21.15.1:0/309094609 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd15c05f240 0x7fd15c061700 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.974+0000 7fd177b91700 1 --2- 172.21.15.1:0/309094609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1700c2290 0x7fd1700c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.974+0000 7fd177b91700 1 --2- 172.21.15.1:0/309094609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1700c4970 0x7fd17014c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.974+0000 7fd177b91700 1 --2- 172.21.15.1:0/309094609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1700c4d50 0x7fd17014c940 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.974+0000 7fd177b91700 1 -- 172.21.15.1:0/309094609 >> 172.21.15.1:0/309094609 conn(0x7fd170064aa0 msgr2=0x7fd1700c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.974+0000 7fd177b91700 1 -- 172.21.15.1:0/309094609 shutdown_connections 2023-11-15T02:55:24.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:24.974+0000 7fd177b91700 1 -- 172.21.15.1:0/309094609 wait complete. 2023-11-15T02:55:24.978 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 95 2023-11-15T02:55:24.987 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:55:25.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.105+0000 7f85a686b700 1 Processor -- start 2023-11-15T02:55:25.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.105+0000 7f85a686b700 1 -- start start 2023-11-15T02:55:25.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f85a686b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f85a00ab1a0 0x7f85a0154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f85a686b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a00c06f0 con 0x7f85a00aa060 2023-11-15T02:55:25.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f85a686b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a00c09d0 con 0x7f85a0154150 2023-11-15T02:55:25.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f85a686b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a0158820 con 0x7f85a00ab1a0 2023-11-15T02:55:25.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f85a4e08700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f85a00aa060 0x7f85a00c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:50106/0 (socket says 172.21.15.1:50106) 2023-11-15T02:55:25.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f85a4e08700 1 -- 172.21.15.1:0/820841853 learned_addr learned my addr 172.21.15.1:0/820841853 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:25.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859f7fe700 1 --2- 172.21.15.1:0/820841853 >> v2:172.21.15.141:3300/0 conn(0x7f85a00ab1a0 0x7f85a0154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859effd700 1 -- 172.21.15.1:0/820841853 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164620516 0 0) 0x7f85a00c06f0 con 0x7f85a00aa060 2023-11-15T02:55:25.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859effd700 1 -- 172.21.15.1:0/820841853 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f858c0033f0 con 0x7f85a00aa060 2023-11-15T02:55:25.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859effd700 1 -- 172.21.15.1:0/820841853 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1425053521 0 0) 0x7f858c0033f0 con 0x7f85a00aa060 2023-11-15T02:55:25.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859effd700 1 -- 172.21.15.1:0/820841853 >> v2:172.21.15.141:3300/0 conn(0x7f85a00ab1a0 msgr2=0x7f85a0154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:25.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859effd700 1 --2- 172.21.15.1:0/820841853 >> v2:172.21.15.141:3300/0 conn(0x7f85a00ab1a0 0x7f85a0154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859effd700 1 -- 172.21.15.1:0/820841853 >> v1:172.21.15.141:6789/0 conn(0x7f85a0154150 legacy=0x7f85a0158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859effd700 1 -- 172.21.15.1:0/820841853 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a0158b00 con 0x7f85a00aa060 2023-11-15T02:55:25.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859effd700 1 -- 172.21.15.1:0/820841853 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f85980017f0 con 0x7f85a00aa060 2023-11-15T02:55:25.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859effd700 1 -- 172.21.15.1:0/820841853 >> v1:172.21.15.1:6789/0 conn(0x7f85a00aa060 legacy=0x7f85a00c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859effd700 1 --2- 172.21.15.1:0/820841853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f858c0038e0 0x7f858c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859effd700 1 --2- 172.21.15.1:0/820841853 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f858c004690 0x7f858c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859effd700 1 --2- 172.21.15.1:0/820841853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f858c005050 0x7f858c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859effd700 1 -- 172.21.15.1:0/820841853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a0158820 con 0x7f858c0038e0 2023-11-15T02:55:25.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859effd700 1 -- 172.21.15.1:0/820841853 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c00bfe0 con 0x7f858c005050 2023-11-15T02:55:25.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859effd700 1 -- 172.21.15.1:0/820841853 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c00c1a0 con 0x7f858c004690 2023-11-15T02:55:25.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.106+0000 7f859ffff700 1 --2- 172.21.15.1:0/820841853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f858c0038e0 0x7f858c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.107+0000 7f85a4e08700 1 --2- 172.21.15.1:0/820841853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f858c005050 0x7f858c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.107+0000 7f859f7fe700 1 --2- 172.21.15.1:0/820841853 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f858c004690 0x7f858c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.107+0000 7f859ffff700 1 -- 172.21.15.1:0/820841853 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f858c004690 msgr2=0x7f858c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:25.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.107+0000 7f859ffff700 1 --2- 172.21.15.1:0/820841853 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f858c004690 0x7f858c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.107+0000 7f859ffff700 1 -- 172.21.15.1:0/820841853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f858c005050 msgr2=0x7f858c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:25.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.107+0000 7f859ffff700 1 --2- 172.21.15.1:0/820841853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f858c005050 0x7f858c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.107+0000 7f859ffff700 1 -- 172.21.15.1:0/820841853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c0033f0 con 0x7f858c0038e0 2023-11-15T02:55:25.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.107+0000 7f85a4e08700 1 -- 172.21.15.1:0/820841853 reap_dead start 2023-11-15T02:55:25.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.107+0000 7f859ffff700 1 --2- 172.21.15.1:0/820841853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f858c0038e0 0x7f858c003d00 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7f8590001700 tx=0x7f8590007bb0).ready entity=mon.0 client_cookie=96a72c89981fa252 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:25.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.107+0000 7f859effd700 1 -- 172.21.15.1:0/820841853 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8590007020 con 0x7f858c0038e0 2023-11-15T02:55:25.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.107+0000 7f859effd700 1 -- 172.21.15.1:0/820841853 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8590007180 con 0x7f858c0038e0 2023-11-15T02:55:25.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.107+0000 7f859effd700 1 -- 172.21.15.1:0/820841853 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8590007520 con 0x7f858c0038e0 2023-11-15T02:55:25.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.108+0000 7f85a686b700 1 -- 172.21.15.1:0/820841853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f858c0038e0 msgr2=0x7f858c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.108+0000 7f85a686b700 1 --2- 172.21.15.1:0/820841853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f858c0038e0 0x7f858c003d00 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7f8590001700 tx=0x7f8590007bb0).stop 2023-11-15T02:55:25.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.108+0000 7f85a686b700 1 -- 172.21.15.1:0/820841853 shutdown_connections 2023-11-15T02:55:25.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.108+0000 7f85a686b700 1 --2- 172.21.15.1:0/820841853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f858c0038e0 0x7f858c003d00 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.108+0000 7f85a686b700 1 -- 172.21.15.1:0/820841853 >> 172.21.15.1:0/820841853 conn(0x7f85a0064aa0 msgr2=0x7f85a0064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:25.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.108+0000 7f85a686b700 1 -- 172.21.15.1:0/820841853 shutdown_connections 2023-11-15T02:55:25.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.108+0000 7f85a686b700 1 -- 172.21.15.1:0/820841853 wait complete. 2023-11-15T02:55:25.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.109+0000 7f85a686b700 1 Processor -- start 2023-11-15T02:55:25.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.109+0000 7f85a686b700 1 -- start start 2023-11-15T02:55:25.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f85a686b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f858c0038e0 0x7f85a0155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f85a686b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85a00aea40 0x7f85a0140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f85a686b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85a00aca60 0x7f85a00acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f85a686b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a0164530 con 0x7f85a00aca60 2023-11-15T02:55:25.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f85a686b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00ad3d0 con 0x7f85a00aea40 2023-11-15T02:55:25.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f85a686b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00af1b0 con 0x7f858c0038e0 2023-11-15T02:55:25.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f85a4e08700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85a00aca60 0x7f85a00acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f85a4e08700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85a00aca60 0x7f85a00acee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36400/0 (socket says 172.21.15.1:36400) 2023-11-15T02:55:25.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f85a4e08700 1 -- 172.21.15.1:0/1016088913 learned_addr learned my addr 172.21.15.1:0/1016088913 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:25.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f859ffff700 1 --2- 172.21.15.1:0/1016088913 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f858c0038e0 0x7f85a0155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f859f7fe700 1 --2- 172.21.15.1:0/1016088913 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85a00aea40 0x7f85a0140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f85a4e08700 1 -- 172.21.15.1:0/1016088913 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f858c0038e0 msgr2=0x7f85a0155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f85a4e08700 1 --2- 172.21.15.1:0/1016088913 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f858c0038e0 0x7f85a0155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f85a4e08700 1 -- 172.21.15.1:0/1016088913 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85a00aea40 msgr2=0x7f85a0140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f85a4e08700 1 --2- 172.21.15.1:0/1016088913 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85a00aea40 0x7f85a0140990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f85a4e08700 1 -- 172.21.15.1:0/1016088913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a00af490 con 0x7f85a00aca60 2023-11-15T02:55:25.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f859f7fe700 1 --2- 172.21.15.1:0/1016088913 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85a00aea40 0x7f85a0140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:25.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f85a4e08700 1 --2- 172.21.15.1:0/1016088913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85a00aca60 0x7f85a00acee0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 rx=0x7f85a0083d70 tx=0x7f8598007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:25.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.110+0000 7f8597fff700 1 -- 172.21.15.1:0/1016088913 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598001320 con 0x7f85a00aca60 2023-11-15T02:55:25.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.111+0000 7f8597fff700 1 -- 172.21.15.1:0/1016088913 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859800f840 con 0x7f85a00aca60 2023-11-15T02:55:25.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.111+0000 7f85a686b700 1 -- 172.21.15.1:0/1016088913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a00af770 con 0x7f85a00aca60 2023-11-15T02:55:25.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.111+0000 7f8597fff700 1 -- 172.21.15.1:0/1016088913 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859800fc00 con 0x7f85a00aca60 2023-11-15T02:55:25.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.111+0000 7f85a686b700 1 -- 172.21.15.1:0/1016088913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a00aeec0 con 0x7f85a00aca60 2023-11-15T02:55:25.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.112+0000 7f85a686b700 1 -- 172.21.15.1:0/1016088913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a006c7e0 con 0x7f85a00aca60 2023-11-15T02:55:25.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.112+0000 7f8597fff700 1 -- 172.21.15.1:0/1016088913 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8598015410 con 0x7f85a00aca60 2023-11-15T02:55:25.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.112+0000 7f8597fff700 1 --2- 172.21.15.1:0/1016088913 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f858005f2a0 0x7f8580061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.112+0000 7f8597fff700 1 -- 172.21.15.1:0/1016088913 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6673+0+0 (secure 0 0 0) 0x7f8598079960 con 0x7f85a00aca60 2023-11-15T02:55:25.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.113+0000 7f859ffff700 1 --2- 172.21.15.1:0/1016088913 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f858005f2a0 0x7f8580061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.113+0000 7f859ffff700 1 --2- 172.21.15.1:0/1016088913 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f858005f2a0 0x7f8580061760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8590000fd0 tx=0x7f8590016000).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:25.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.117+0000 7f8597fff700 1 -- 172.21.15.1:0/1016088913 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f859804a820 con 0x7f85a00aca60 2023-11-15T02:55:25.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.290+0000 7f85a686b700 1 -- 172.21.15.1:0/1016088913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85a00c02a0 con 0x7f85a00aca60 2023-11-15T02:55:25.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.291+0000 7f8597fff700 1 -- 172.21.15.1:0/1016088913 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v212) v1 ==== 74+0+17746 (secure 0 0 0) 0x7f8598047e60 con 0x7f85a00aca60 2023-11-15T02:55:25.292 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:25.292 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":212,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:55:22.590268+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:55:19.243909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-11-15T02:55:20.580363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:55:25.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.293+0000 7f85a686b700 1 -- 172.21.15.1:0/1016088913 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f858005f2a0 msgr2=0x7f8580061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.293+0000 7f85a686b700 1 --2- 172.21.15.1:0/1016088913 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f858005f2a0 0x7f8580061760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8590000fd0 tx=0x7f8590016000).stop 2023-11-15T02:55:25.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.293+0000 7f85a686b700 1 -- 172.21.15.1:0/1016088913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85a00aca60 msgr2=0x7f85a00acee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.293+0000 7f85a686b700 1 --2- 172.21.15.1:0/1016088913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85a00aca60 0x7f85a00acee0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 rx=0x7f85a0083d70 tx=0x7f8598007ca0).stop 2023-11-15T02:55:25.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.293+0000 7f85a686b700 1 -- 172.21.15.1:0/1016088913 shutdown_connections 2023-11-15T02:55:25.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.293+0000 7f85a686b700 1 --2- 172.21.15.1:0/1016088913 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f858005f2a0 0x7f8580061760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.293+0000 7f85a686b700 1 --2- 172.21.15.1:0/1016088913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85a00aca60 0x7f85a00acee0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.293+0000 7f85a686b700 1 --2- 172.21.15.1:0/1016088913 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f858c0038e0 0x7f85a0155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.293+0000 7f85a686b700 1 --2- 172.21.15.1:0/1016088913 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85a00aea40 0x7f85a0140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.293+0000 7f85a686b700 1 -- 172.21.15.1:0/1016088913 >> 172.21.15.1:0/1016088913 conn(0x7f85a0064aa0 msgr2=0x7f85a00c9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:25.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.293+0000 7f85a686b700 1 -- 172.21.15.1:0/1016088913 shutdown_connections 2023-11-15T02:55:25.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.293+0000 7f85a686b700 1 -- 172.21.15.1:0/1016088913 wait complete. 2023-11-15T02:55:25.307 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-15T02:55:25.307 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:55:25.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.424+0000 7fa2ad015700 1 Processor -- start 2023-11-15T02:55:25.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.424+0000 7fa2ad015700 1 -- start start 2023-11-15T02:55:25.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.425+0000 7fa2ad015700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa2a80ab1a0 0x7fa2a8154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.425+0000 7fa2ad015700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a80c06f0 con 0x7fa2a8154150 2023-11-15T02:55:25.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.425+0000 7fa2ad015700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a80c09d0 con 0x7fa2a80aa060 2023-11-15T02:55:25.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.425+0000 7fa2ad015700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a8158820 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.425+0000 7fa2a6d9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa2a8154150 0x7fa2a8158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:50114/0 (socket says 172.21.15.1:50114) 2023-11-15T02:55:25.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.425+0000 7fa2a6d9d700 1 -- 172.21.15.1:0/1362943978 learned_addr learned my addr 172.21.15.1:0/1362943978 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:25.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.425+0000 7fa2a659c700 1 --2- 172.21.15.1:0/1362943978 >> v2:172.21.15.141:3300/0 conn(0x7fa2a80ab1a0 0x7fa2a8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.426+0000 7fa2a5d9b700 1 -- 172.21.15.1:0/1362943978 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031187527 0 0) 0x7fa2a80c06f0 con 0x7fa2a8154150 2023-11-15T02:55:25.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.426+0000 7fa2a5d9b700 1 -- 172.21.15.1:0/1362943978 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2940033f0 con 0x7fa2a8154150 2023-11-15T02:55:25.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.426+0000 7fa2a5d9b700 1 -- 172.21.15.1:0/1362943978 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692095241 0 0) 0x7fa2a80c09d0 con 0x7fa2a80aa060 2023-11-15T02:55:25.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.426+0000 7fa2a5d9b700 1 -- 172.21.15.1:0/1362943978 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2a80c06f0 con 0x7fa2a80aa060 2023-11-15T02:55:25.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.426+0000 7fa2a659c700 1 -- 172.21.15.1:0/1362943978 >> v1:172.21.15.141:6789/0 conn(0x7fa2a80aa060 legacy=0x7fa2a80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.426+0000 7fa2a5d9b700 1 -- 172.21.15.1:0/1362943978 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3141584202 0 0) 0x7fa2940033f0 con 0x7fa2a8154150 2023-11-15T02:55:25.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.426+0000 7fa2a659c700 1 -- 172.21.15.1:0/1362943978 >> v1:172.21.15.1:6789/0 conn(0x7fa2a8154150 legacy=0x7fa2a8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.426+0000 7fa2a659c700 1 -- 172.21.15.1:0/1362943978 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a8158b00 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.426+0000 7fa2a659c700 1 --2- 172.21.15.1:0/1362943978 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2a80ab1a0 0x7fa2a8154530 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fa290009760 tx=0x7fa290009060).ready entity=mon.1 client_cookie=6311f252d231f136 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.426+0000 7fa2a5d9b700 1 -- 172.21.15.1:0/1362943978 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0001470 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.426+0000 7fa2a5d9b700 1 -- 172.21.15.1:0/1362943978 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2900090d0 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.426+0000 7fa2a5d9b700 1 -- 172.21.15.1:0/1362943978 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290011610 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.427+0000 7fa2ad015700 1 -- 172.21.15.1:0/1362943978 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2a80ab1a0 msgr2=0x7fa2a8154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.427+0000 7fa2ad015700 1 --2- 172.21.15.1:0/1362943978 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2a80ab1a0 0x7fa2a8154530 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fa290009760 tx=0x7fa290009060).stop 2023-11-15T02:55:25.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.427+0000 7fa2ad015700 1 -- 172.21.15.1:0/1362943978 shutdown_connections 2023-11-15T02:55:25.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.427+0000 7fa2ad015700 1 --2- 172.21.15.1:0/1362943978 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2a80ab1a0 0x7fa2a8154530 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.427+0000 7fa2ad015700 1 -- 172.21.15.1:0/1362943978 >> 172.21.15.1:0/1362943978 conn(0x7fa2a8064aa0 msgr2=0x7fa2a8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:25.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.427+0000 7fa2ad015700 1 -- 172.21.15.1:0/1362943978 shutdown_connections 2023-11-15T02:55:25.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.427+0000 7fa2ad015700 1 -- 172.21.15.1:0/1362943978 wait complete. 2023-11-15T02:55:25.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.428+0000 7fa2ad015700 1 Processor -- start 2023-11-15T02:55:25.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.428+0000 7fa2ad015700 1 -- start start 2023-11-15T02:55:25.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2ad015700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2a80aa060 0x7fa2a8150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2ad015700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2a80ab1a0 0x7fa2a80ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2ad015700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2a8154150 0x7fa2a80ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2ad015700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a80c2d30 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2ad015700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8151390 con 0x7fa2a80aa060 2023-11-15T02:55:25.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2ad015700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a80aeaf0 con 0x7fa2a8154150 2023-11-15T02:55:25.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2a659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2a80ab1a0 0x7fa2a80ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2a659c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2a80ab1a0 0x7fa2a80ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36408/0 (socket says 172.21.15.1:36408) 2023-11-15T02:55:25.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2a659c700 1 -- 172.21.15.1:0/684642999 learned_addr learned my addr 172.21.15.1:0/684642999 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:25.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2a6d9d700 1 --2- 172.21.15.1:0/684642999 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2a80aa060 0x7fa2a8150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2a759e700 1 --2- 172.21.15.1:0/684642999 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2a8154150 0x7fa2a80ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2a659c700 1 -- 172.21.15.1:0/684642999 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2a8154150 msgr2=0x7fa2a80ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2a659c700 1 --2- 172.21.15.1:0/684642999 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2a8154150 0x7fa2a80ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2a659c700 1 -- 172.21.15.1:0/684642999 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2a80aa060 msgr2=0x7fa2a8150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2a659c700 1 --2- 172.21.15.1:0/684642999 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2a80aa060 0x7fa2a8150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2a659c700 1 -- 172.21.15.1:0/684642999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900092a0 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.429+0000 7fa2a659c700 1 --2- 172.21.15.1:0/684642999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2a80ab1a0 0x7fa2a80ae030 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7fa290009d50 tx=0x7fa290016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:25.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.430+0000 7fa29effd700 1 -- 172.21.15.1:0/684642999 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290010740 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.430+0000 7fa29effd700 1 -- 172.21.15.1:0/684642999 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2900108a0 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.430+0000 7fa2ad015700 1 -- 172.21.15.1:0/684642999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a80aedd0 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.430+0000 7fa29effd700 1 -- 172.21.15.1:0/684642999 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290010c40 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.430+0000 7fa2ad015700 1 -- 172.21.15.1:0/684642999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a80af390 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.431+0000 7fa2ad015700 1 -- 172.21.15.1:0/684642999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a80c5480 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.431+0000 7fa29effd700 1 -- 172.21.15.1:0/684642999 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa290027460 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.431+0000 7fa29effd700 1 --2- 172.21.15.1:0/684642999 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa28805f270 0x7fa288061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.431+0000 7fa29effd700 1 -- 172.21.15.1:0/684642999 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6673+0+0 (secure 0 0 0) 0x7fa29007bac0 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.432+0000 7fa2a6d9d700 1 --2- 172.21.15.1:0/684642999 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa28805f270 0x7fa288061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.432+0000 7fa2a6d9d700 1 --2- 172.21.15.1:0/684642999 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa28805f270 0x7fa288061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa2a0000ff0 tx=0x7fa2a0001980).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:25.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.436+0000 7fa29effd700 1 -- 172.21.15.1:0/684642999 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa29004c980 con 0x7fa2a80ab1a0 2023-11-15T02:55:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.603+0000 7fa2ad015700 1 -- 172.21.15.1:0/684642999 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2a806c7e0 con 0x7fa28805f270 2023-11-15T02:55:25.616 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.615+0000 7fa29effd700 1 -- 172.21.15.1:0/684642999 <== mgr.7898 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362216 (secure 0 0 0) 0x7fa2a806c7e0 con 0x7fa28805f270 2023-11-15T02:55:25.621 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:25.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.619+0000 7fa2ad015700 1 -- 172.21.15.1:0/684642999 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa28805f270 msgr2=0x7fa288061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.619+0000 7fa2ad015700 1 --2- 172.21.15.1:0/684642999 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa28805f270 0x7fa288061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa2a0000ff0 tx=0x7fa2a0001980).stop 2023-11-15T02:55:25.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.619+0000 7fa2ad015700 1 -- 172.21.15.1:0/684642999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2a80ab1a0 msgr2=0x7fa2a80ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.619+0000 7fa2ad015700 1 --2- 172.21.15.1:0/684642999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2a80ab1a0 0x7fa2a80ae030 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7fa290009d50 tx=0x7fa290016000).stop 2023-11-15T02:55:25.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.619+0000 7fa2ad015700 1 -- 172.21.15.1:0/684642999 shutdown_connections 2023-11-15T02:55:25.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.619+0000 7fa2ad015700 1 --2- 172.21.15.1:0/684642999 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa28805f270 0x7fa288061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.619+0000 7fa2ad015700 1 --2- 172.21.15.1:0/684642999 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2a8154150 0x7fa2a80ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.619+0000 7fa2ad015700 1 --2- 172.21.15.1:0/684642999 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2a80aa060 0x7fa2a8150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.619+0000 7fa2ad015700 1 --2- 172.21.15.1:0/684642999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2a80ab1a0 0x7fa2a80ae030 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.619+0000 7fa2ad015700 1 -- 172.21.15.1:0/684642999 >> 172.21.15.1:0/684642999 conn(0x7fa2a8064aa0 msgr2=0x7fa2a80ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:25.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.619+0000 7fa2ad015700 1 -- 172.21.15.1:0/684642999 shutdown_connections 2023-11-15T02:55:25.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.619+0000 7fa2ad015700 1 -- 172.21.15.1:0/684642999 wait complete. 2023-11-15T02:55:25.627 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:55:25.632 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T02:55:24.156537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2471296,"kb_used_data":20800,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752503424,"statfs":{"total":773094113280,"available":770563506176,"internally_reserved":0,"allocated":21299200,"data_stored":11396964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28932,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-81,"num_write_kb":-63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.009766"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.617734+0000","last_change":"2023-11-15T02:55:21.617218+0000","last_active":"2023-11-15T02:55:21.617734+0000","last_peered":"2023-11-15T02:55:21.617734+0000","last_clean":"2023-11-15T02:55:21.617734+0000","last_became_active":"2023-11-15T02:55:21.616872+0000","last_became_peered":"2023-11-15T02:55:21.616872+0000","last_unstale":"2023-11-15T02:55:21.617734+0000","last_undegraded":"2023-11-15T02:55:21.617734+0000","last_fullsized":"2023-11-15T02:55:21.617734+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3f","version":"211'3","reported_seq":13,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.621620+0000","last_change":"2023-11-15T02:55:21.221309+0000","last_active":"2023-11-15T02:55:21.621620+0000","last_peered":"2023-11-15T02:55:21.621620+0000","last_clean":"2023-11-15T02:55:21.621620+0000","last_became_active":"2023-11-15T02:55:21.220936+0000","last_became_peered":"2023-11-15T02:55:21.220936+0000","last_unstale":"2023-11-15T02:55:21.621620+0000","last_undegraded":"2023-11-15T02:55:21.621620+0000","last_fullsized":"2023-11-15T02:55:21.621620+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.618438+0000","last_change":"2023-11-15T02:55:21.609606+0000","last_active":"2023-11-15T02:55:21.618438+0000","last_peered":"2023-11-15T02:55:21.618438+0000","last_clean":"2023-11-15T02:55:21.618438+0000","last_became_active":"2023-11-15T02:55:21.608454+0000","last_became_peered":"2023-11-15T02:55:21.608454+0000","last_unstale":"2023-11-15T02:55:21.618438+0000","last_undegraded":"2023-11-15T02:55:21.618438+0000","last_fullsized":"2023-11-15T02:55:21.618438+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601547+0000","last_change":"2023-11-15T02:55:21.219687+0000","last_active":"2023-11-15T02:55:21.601547+0000","last_peered":"2023-11-15T02:55:21.601547+0000","last_clean":"2023-11-15T02:55:21.601547+0000","last_became_active":"2023-11-15T02:55:21.219355+0000","last_became_peered":"2023-11-15T02:55:21.219355+0000","last_unstale":"2023-11-15T02:55:21.601547+0000","last_undegraded":"2023-11-15T02:55:21.601547+0000","last_fullsized":"2023-11-15T02:55:21.601547+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616494+0000","last_change":"2023-11-15T02:55:21.615570+0000","last_active":"2023-11-15T02:55:21.616494+0000","last_peered":"2023-11-15T02:55:21.616494+0000","last_clean":"2023-11-15T02:55:21.616494+0000","last_became_active":"2023-11-15T02:55:21.615302+0000","last_became_peered":"2023-11-15T02:55:21.615302+0000","last_unstale":"2023-11-15T02:55:21.616494+0000","last_undegraded":"2023-11-15T02:55:21.616494+0000","last_fullsized":"2023-11-15T02:55:21.616494+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.600659+0000","last_change":"2023-11-15T02:55:21.216817+0000","last_active":"2023-11-15T02:55:21.600659+0000","last_peered":"2023-11-15T02:55:21.600659+0000","last_clean":"2023-11-15T02:55:21.600659+0000","last_became_active":"2023-11-15T02:55:21.216544+0000","last_became_peered":"2023-11-15T02:55:21.216544+0000","last_unstale":"2023-11-15T02:55:21.600659+0000","last_undegraded":"2023-11-15T02:55:21.600659+0000","last_fullsized":"2023-11-15T02:55:21.600659+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.620397+0000","last_change":"2023-11-15T02:55:21.619714+0000","last_active":"2023-11-15T02:55:21.620397+0000","last_peered":"2023-11-15T02:55:21.620397+0000","last_clean":"2023-11-15T02:55:21.620397+0000","last_became_active":"2023-11-15T02:55:21.619413+0000","last_became_peered":"2023-11-15T02:55:21.619413+0000","last_unstale":"2023-11-15T02:55:21.620397+0000","last_undegraded":"2023-11-15T02:55:21.620397+0000","last_fullsized":"2023-11-15T02:55:21.620397+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.618234+0000","last_change":"2023-11-15T02:55:21.216951+0000","last_active":"2023-11-15T02:55:21.618234+0000","last_peered":"2023-11-15T02:55:21.618234+0000","last_clean":"2023-11-15T02:55:21.618234+0000","last_became_active":"2023-11-15T02:55:21.216663+0000","last_became_peered":"2023-11-15T02:55:21.216663+0000","last_unstale":"2023-11-15T02:55:21.618234+0000","last_undegraded":"2023-11-15T02:55:21.618234+0000","last_fullsized":"2023-11-15T02:55:21.618234+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.621503+0000","last_change":"2023-11-15T02:55:21.618620+0000","last_active":"2023-11-15T02:55:21.621503+0000","last_peered":"2023-11-15T02:55:21.621503+0000","last_clean":"2023-11-15T02:55:21.621503+0000","last_became_active":"2023-11-15T02:55:21.618289+0000","last_became_peered":"2023-11-15T02:55:21.618289+0000","last_unstale":"2023-11-15T02:55:21.621503+0000","last_undegraded":"2023-11-15T02:55:21.621503+0000","last_fullsized":"2023-11-15T02:55:21.621503+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3b","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614815+0000","last_change":"2023-11-15T02:55:21.217154+0000","last_active":"2023-11-15T02:55:21.614815+0000","last_peered":"2023-11-15T02:55:21.614815+0000","last_clean":"2023-11-15T02:55:21.614815+0000","last_became_active":"2023-11-15T02:55:21.216522+0000","last_became_peered":"2023-11-15T02:55:21.216522+0000","last_unstale":"2023-11-15T02:55:21.614815+0000","last_undegraded":"2023-11-15T02:55:21.614815+0000","last_fullsized":"2023-11-15T02:55:21.614815+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.619725+0000","last_change":"2023-11-15T02:55:21.619114+0000","last_active":"2023-11-15T02:55:21.619725+0000","last_peered":"2023-11-15T02:55:21.619725+0000","last_clean":"2023-11-15T02:55:21.619725+0000","last_became_active":"2023-11-15T02:55:21.618826+0000","last_became_peered":"2023-11-15T02:55:21.618826+0000","last_unstale":"2023-11-15T02:55:21.619725+0000","last_undegraded":"2023-11-15T02:55:21.619725+0000","last_fullsized":"2023-11-15T02:55:21.619725+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.618303+0000","last_change":"2023-11-15T02:55:21.224197+0000","last_active":"2023-11-15T02:55:21.618303+0000","last_peered":"2023-11-15T02:55:21.618303+0000","last_clean":"2023-11-15T02:55:21.618303+0000","last_became_active":"2023-11-15T02:55:21.223929+0000","last_became_peered":"2023-11-15T02:55:21.223929+0000","last_unstale":"2023-11-15T02:55:21.618303+0000","last_undegraded":"2023-11-15T02:55:21.618303+0000","last_fullsized":"2023-11-15T02:55:21.618303+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610647+0000","last_change":"2023-11-15T02:55:21.606881+0000","last_active":"2023-11-15T02:55:21.610647+0000","last_peered":"2023-11-15T02:55:21.610647+0000","last_clean":"2023-11-15T02:55:21.610647+0000","last_became_active":"2023-11-15T02:55:21.606608+0000","last_became_peered":"2023-11-15T02:55:21.606608+0000","last_unstale":"2023-11-15T02:55:21.610647+0000","last_undegraded":"2023-11-15T02:55:21.610647+0000","last_fullsized":"2023-11-15T02:55:21.610647+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.603759+0000","last_change":"2023-11-15T02:55:21.221639+0000","last_active":"2023-11-15T02:55:21.603759+0000","last_peered":"2023-11-15T02:55:21.603759+0000","last_clean":"2023-11-15T02:55:21.603759+0000","last_became_active":"2023-11-15T02:55:21.221361+0000","last_became_peered":"2023-11-15T02:55:21.221361+0000","last_unstale":"2023-11-15T02:55:21.603759+0000","last_undegraded":"2023-11-15T02:55:21.603759+0000","last_fullsized":"2023-11-15T02:55:21.603759+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616608+0000","last_change":"2023-11-15T02:55:21.613497+0000","last_active":"2023-11-15T02:55:21.616608+0000","last_peered":"2023-11-15T02:55:21.616608+0000","last_clean":"2023-11-15T02:55:21.616608+0000","last_became_active":"2023-11-15T02:55:21.613201+0000","last_became_peered":"2023-11-15T02:55:21.613201+0000","last_unstale":"2023-11-15T02:55:21.616608+0000","last_undegraded":"2023-11-15T02:55:21.616608+0000","last_fullsized":"2023-11-15T02:55:21.616608+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.596247+0000","last_change":"2023-11-15T02:55:21.222138+0000","last_active":"2023-11-15T02:55:21.596247+0000","last_peered":"2023-11-15T02:55:21.596247+0000","last_clean":"2023-11-15T02:55:21.596247+0000","last_became_active":"2023-11-15T02:55:21.221823+0000","last_became_peered":"2023-11-15T02:55:21.221823+0000","last_unstale":"2023-11-15T02:55:21.596247+0000","last_undegraded":"2023-11-15T02:55:21.596247+0000","last_fullsized":"2023-11-15T02:55:21.596247+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.621627+0000","last_change":"2023-11-15T02:55:21.621029+0000","last_active":"2023-11-15T02:55:21.621627+0000","last_peered":"2023-11-15T02:55:21.621627+0000","last_clean":"2023-11-15T02:55:21.621627+0000","last_became_active":"2023-11-15T02:55:21.620734+0000","last_became_peered":"2023-11-15T02:55:21.620734+0000","last_unstale":"2023-11-15T02:55:21.621627+0000","last_undegraded":"2023-11-15T02:55:21.621627+0000","last_fullsized":"2023-11-15T02:55:21.621627+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.599450+0000","last_change":"2023-11-15T02:55:21.211916+0000","last_active":"2023-11-15T02:55:21.599450+0000","last_peered":"2023-11-15T02:55:21.599450+0000","last_clean":"2023-11-15T02:55:21.599450+0000","last_became_active":"2023-11-15T02:55:21.211605+0000","last_became_peered":"2023-11-15T02:55:21.211605+0000","last_unstale":"2023-11-15T02:55:21.599450+0000","last_undegraded":"2023-11-15T02:55:21.599450+0000","last_fullsized":"2023-11-15T02:55:21.599450+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613510+0000","last_change":"2023-11-15T02:55:21.612429+0000","last_active":"2023-11-15T02:55:21.613510+0000","last_peered":"2023-11-15T02:55:21.613510+0000","last_clean":"2023-11-15T02:55:21.613510+0000","last_became_active":"2023-11-15T02:55:21.612111+0000","last_became_peered":"2023-11-15T02:55:21.612111+0000","last_unstale":"2023-11-15T02:55:21.613510+0000","last_undegraded":"2023-11-15T02:55:21.613510+0000","last_fullsized":"2023-11-15T02:55:21.613510+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.598723+0000","last_change":"2023-11-15T02:55:21.212267+0000","last_active":"2023-11-15T02:55:21.598723+0000","last_peered":"2023-11-15T02:55:21.598723+0000","last_clean":"2023-11-15T02:55:21.598723+0000","last_became_active":"2023-11-15T02:55:21.212026+0000","last_became_peered":"2023-11-15T02:55:21.212026+0000","last_unstale":"2023-11-15T02:55:21.598723+0000","last_undegraded":"2023-11-15T02:55:21.598723+0000","last_fullsized":"2023-11-15T02:55:21.598723+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.612312+0000","last_change":"2023-11-15T02:55:21.611558+0000","last_active":"2023-11-15T02:55:21.612312+0000","last_peered":"2023-11-15T02:55:21.612312+0000","last_clean":"2023-11-15T02:55:21.612312+0000","last_became_active":"2023-11-15T02:55:21.611255+0000","last_became_peered":"2023-11-15T02:55:21.611255+0000","last_unstale":"2023-11-15T02:55:21.612312+0000","last_undegraded":"2023-11-15T02:55:21.612312+0000","last_fullsized":"2023-11-15T02:55:21.612312+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.604960+0000","last_change":"2023-11-15T02:55:21.221986+0000","last_active":"2023-11-15T02:55:21.604960+0000","last_peered":"2023-11-15T02:55:21.604960+0000","last_clean":"2023-11-15T02:55:21.604960+0000","last_became_active":"2023-11-15T02:55:21.221655+0000","last_became_peered":"2023-11-15T02:55:21.221655+0000","last_unstale":"2023-11-15T02:55:21.604960+0000","last_undegraded":"2023-11-15T02:55:21.604960+0000","last_fullsized":"2023-11-15T02:55:21.604960+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615784+0000","last_change":"2023-11-15T02:55:21.614212+0000","last_active":"2023-11-15T02:55:21.615784+0000","last_peered":"2023-11-15T02:55:21.615784+0000","last_clean":"2023-11-15T02:55:21.615784+0000","last_became_active":"2023-11-15T02:55:21.613901+0000","last_became_peered":"2023-11-15T02:55:21.613901+0000","last_unstale":"2023-11-15T02:55:21.615784+0000","last_undegraded":"2023-11-15T02:55:21.615784+0000","last_fullsized":"2023-11-15T02:55:21.615784+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"211'4","reported_seq":14,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.627969+0000","last_change":"2023-11-15T02:55:21.218597+0000","last_active":"2023-11-15T02:55:21.627969+0000","last_peered":"2023-11-15T02:55:21.627969+0000","last_clean":"2023-11-15T02:55:21.627969+0000","last_became_active":"2023-11-15T02:55:21.218325+0000","last_became_peered":"2023-11-15T02:55:21.218325+0000","last_unstale":"2023-11-15T02:55:21.627969+0000","last_undegraded":"2023-11-15T02:55:21.627969+0000","last_fullsized":"2023-11-15T02:55:21.627969+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616596+0000","last_change":"2023-11-15T02:55:21.613984+0000","last_active":"2023-11-15T02:55:21.616596+0000","last_peered":"2023-11-15T02:55:21.616596+0000","last_clean":"2023-11-15T02:55:21.616596+0000","last_became_active":"2023-11-15T02:55:21.613711+0000","last_became_peered":"2023-11-15T02:55:21.613711+0000","last_unstale":"2023-11-15T02:55:21.616596+0000","last_undegraded":"2023-11-15T02:55:21.616596+0000","last_fullsized":"2023-11-15T02:55:21.616596+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616477+0000","last_change":"2023-11-15T02:55:21.225819+0000","last_active":"2023-11-15T02:55:21.616477+0000","last_peered":"2023-11-15T02:55:21.616477+0000","last_clean":"2023-11-15T02:55:21.616477+0000","last_became_active":"2023-11-15T02:55:21.225546+0000","last_became_peered":"2023-11-15T02:55:21.225546+0000","last_unstale":"2023-11-15T02:55:21.616477+0000","last_undegraded":"2023-11-15T02:55:21.616477+0000","last_fullsized":"2023-11-15T02:55:21.616477+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613907+0000","last_change":"2023-11-15T02:55:21.611452+0000","last_active":"2023-11-15T02:55:21.613907+0000","last_peered":"2023-11-15T02:55:21.613907+0000","last_clean":"2023-11-15T02:55:21.613907+0000","last_became_active":"2023-11-15T02:55:21.611189+0000","last_became_peered":"2023-11-15T02:55:21.611189+0000","last_unstale":"2023-11-15T02:55:21.613907+0000","last_undegraded":"2023-11-15T02:55:21.613907+0000","last_fullsized":"2023-11-15T02:55:21.613907+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601849+0000","last_change":"2023-11-15T02:55:21.216276+0000","last_active":"2023-11-15T02:55:21.601849+0000","last_peered":"2023-11-15T02:55:21.601849+0000","last_clean":"2023-11-15T02:55:21.601849+0000","last_became_active":"2023-11-15T02:55:21.215991+0000","last_became_peered":"2023-11-15T02:55:21.215991+0000","last_unstale":"2023-11-15T02:55:21.601849+0000","last_undegraded":"2023-11-15T02:55:21.601849+0000","last_fullsized":"2023-11-15T02:55:21.601849+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.605418+0000","last_change":"2023-11-15T02:55:21.601149+0000","last_active":"2023-11-15T02:55:21.605418+0000","last_peered":"2023-11-15T02:55:21.605418+0000","last_clean":"2023-11-15T02:55:21.605418+0000","last_became_active":"2023-11-15T02:55:21.600856+0000","last_became_peered":"2023-11-15T02:55:21.600856+0000","last_unstale":"2023-11-15T02:55:21.605418+0000","last_undegraded":"2023-11-15T02:55:21.605418+0000","last_fullsized":"2023-11-15T02:55:21.605418+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.603980+0000","last_change":"2023-11-15T02:55:21.219528+0000","last_active":"2023-11-15T02:55:21.603980+0000","last_peered":"2023-11-15T02:55:21.603980+0000","last_clean":"2023-11-15T02:55:21.603980+0000","last_became_active":"2023-11-15T02:55:21.219238+0000","last_became_peered":"2023-11-15T02:55:21.219238+0000","last_unstale":"2023-11-15T02:55:21.603980+0000","last_undegraded":"2023-11-15T02:55:21.603980+0000","last_fullsized":"2023-11-15T02:55:21.603980+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.619571+0000","last_change":"2023-11-15T02:55:21.615078+0000","last_active":"2023-11-15T02:55:21.619571+0000","last_peered":"2023-11-15T02:55:21.619571+0000","last_clean":"2023-11-15T02:55:21.619571+0000","last_became_active":"2023-11-15T02:55:21.614308+0000","last_became_peered":"2023-11-15T02:55:21.614308+0000","last_unstale":"2023-11-15T02:55:21.619571+0000","last_undegraded":"2023-11-15T02:55:21.619571+0000","last_fullsized":"2023-11-15T02:55:21.619571+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.30","version":"211'4","reported_seq":14,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616531+0000","last_change":"2023-11-15T02:55:21.213072+0000","last_active":"2023-11-15T02:55:21.616531+0000","last_peered":"2023-11-15T02:55:21.616531+0000","last_clean":"2023-11-15T02:55:21.616531+0000","last_became_active":"2023-11-15T02:55:21.212729+0000","last_became_peered":"2023-11-15T02:55:21.212729+0000","last_unstale":"2023-11-15T02:55:21.616531+0000","last_undegraded":"2023-11-15T02:55:21.616531+0000","last_fullsized":"2023-11-15T02:55:21.616531+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.620579+0000","last_change":"2023-11-15T02:55:21.619554+0000","last_active":"2023-11-15T02:55:21.620579+0000","last_peered":"2023-11-15T02:55:21.620579+0000","last_clean":"2023-11-15T02:55:21.620579+0000","last_became_active":"2023-11-15T02:55:21.619271+0000","last_became_peered":"2023-11-15T02:55:21.619271+0000","last_unstale":"2023-11-15T02:55:21.620579+0000","last_undegraded":"2023-11-15T02:55:21.620579+0000","last_fullsized":"2023-11-15T02:55:21.620579+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.592674+0000","last_change":"2023-11-15T02:55:21.227855+0000","last_active":"2023-11-15T02:55:21.592674+0000","last_peered":"2023-11-15T02:55:21.592674+0000","last_clean":"2023-11-15T02:55:21.592674+0000","last_became_active":"2023-11-15T02:55:21.227460+0000","last_became_peered":"2023-11-15T02:55:21.227460+0000","last_unstale":"2023-11-15T02:55:21.592674+0000","last_undegraded":"2023-11-15T02:55:21.592674+0000","last_fullsized":"2023-11-15T02:55:21.592674+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613874+0000","last_change":"2023-11-15T02:55:21.607637+0000","last_active":"2023-11-15T02:55:21.613874+0000","last_peered":"2023-11-15T02:55:21.613874+0000","last_clean":"2023-11-15T02:55:21.613874+0000","last_became_active":"2023-11-15T02:55:21.607353+0000","last_became_peered":"2023-11-15T02:55:21.607353+0000","last_unstale":"2023-11-15T02:55:21.613874+0000","last_undegraded":"2023-11-15T02:55:21.613874+0000","last_fullsized":"2023-11-15T02:55:21.613874+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.612115+0000","last_change":"2023-11-15T02:55:21.218165+0000","last_active":"2023-11-15T02:55:21.612115+0000","last_peered":"2023-11-15T02:55:21.612115+0000","last_clean":"2023-11-15T02:55:21.612115+0000","last_became_active":"2023-11-15T02:55:21.217817+0000","last_became_peered":"2023-11-15T02:55:21.217817+0000","last_unstale":"2023-11-15T02:55:21.612115+0000","last_undegraded":"2023-11-15T02:55:21.612115+0000","last_fullsized":"2023-11-15T02:55:21.612115+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614719+0000","last_change":"2023-11-15T02:55:21.610702+0000","last_active":"2023-11-15T02:55:21.614719+0000","last_peered":"2023-11-15T02:55:21.614719+0000","last_clean":"2023-11-15T02:55:21.614719+0000","last_became_active":"2023-11-15T02:55:21.610432+0000","last_became_peered":"2023-11-15T02:55:21.610432+0000","last_unstale":"2023-11-15T02:55:21.614719+0000","last_undegraded":"2023-11-15T02:55:21.614719+0000","last_fullsized":"2023-11-15T02:55:21.614719+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2d","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615435+0000","last_change":"2023-11-15T02:55:21.212329+0000","last_active":"2023-11-15T02:55:21.615435+0000","last_peered":"2023-11-15T02:55:21.615435+0000","last_clean":"2023-11-15T02:55:21.615435+0000","last_became_active":"2023-11-15T02:55:21.212012+0000","last_became_peered":"2023-11-15T02:55:21.212012+0000","last_unstale":"2023-11-15T02:55:21.615435+0000","last_undegraded":"2023-11-15T02:55:21.615435+0000","last_fullsized":"2023-11-15T02:55:21.615435+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.620296+0000","last_change":"2023-11-15T02:55:21.619265+0000","last_active":"2023-11-15T02:55:21.620296+0000","last_peered":"2023-11-15T02:55:21.620296+0000","last_clean":"2023-11-15T02:55:21.620296+0000","last_became_active":"2023-11-15T02:55:21.618971+0000","last_became_peered":"2023-11-15T02:55:21.618971+0000","last_unstale":"2023-11-15T02:55:21.620296+0000","last_undegraded":"2023-11-15T02:55:21.620296+0000","last_fullsized":"2023-11-15T02:55:21.620296+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.592503+0000","last_change":"2023-11-15T02:55:21.227686+0000","last_active":"2023-11-15T02:55:21.592503+0000","last_peered":"2023-11-15T02:55:21.592503+0000","last_clean":"2023-11-15T02:55:21.592503+0000","last_became_active":"2023-11-15T02:55:21.227351+0000","last_became_peered":"2023-11-15T02:55:21.227351+0000","last_unstale":"2023-11-15T02:55:21.592503+0000","last_undegraded":"2023-11-15T02:55:21.592503+0000","last_fullsized":"2023-11-15T02:55:21.592503+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.620181+0000","last_change":"2023-11-15T02:55:21.619366+0000","last_active":"2023-11-15T02:55:21.620181+0000","last_peered":"2023-11-15T02:55:21.620181+0000","last_clean":"2023-11-15T02:55:21.620181+0000","last_became_active":"2023-11-15T02:55:21.618900+0000","last_became_peered":"2023-11-15T02:55:21.618900+0000","last_unstale":"2023-11-15T02:55:21.620181+0000","last_undegraded":"2023-11-15T02:55:21.620181+0000","last_fullsized":"2023-11-15T02:55:21.620181+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2b","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614932+0000","last_change":"2023-11-15T02:55:21.217331+0000","last_active":"2023-11-15T02:55:21.614932+0000","last_peered":"2023-11-15T02:55:21.614932+0000","last_clean":"2023-11-15T02:55:21.614932+0000","last_became_active":"2023-11-15T02:55:21.216887+0000","last_became_peered":"2023-11-15T02:55:21.216887+0000","last_unstale":"2023-11-15T02:55:21.614932+0000","last_undegraded":"2023-11-15T02:55:21.614932+0000","last_fullsized":"2023-11-15T02:55:21.614932+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.622414+0000","last_change":"2023-11-15T02:55:21.618728+0000","last_active":"2023-11-15T02:55:21.622414+0000","last_peered":"2023-11-15T02:55:21.622414+0000","last_clean":"2023-11-15T02:55:21.622414+0000","last_became_active":"2023-11-15T02:55:21.618254+0000","last_became_peered":"2023-11-15T02:55:21.618254+0000","last_unstale":"2023-11-15T02:55:21.622414+0000","last_undegraded":"2023-11-15T02:55:21.622414+0000","last_fullsized":"2023-11-15T02:55:21.622414+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.600687+0000","last_change":"2023-11-15T02:55:21.210719+0000","last_active":"2023-11-15T02:55:21.600687+0000","last_peered":"2023-11-15T02:55:21.600687+0000","last_clean":"2023-11-15T02:55:21.600687+0000","last_became_active":"2023-11-15T02:55:21.210410+0000","last_became_peered":"2023-11-15T02:55:21.210410+0000","last_unstale":"2023-11-15T02:55:21.600687+0000","last_undegraded":"2023-11-15T02:55:21.600687+0000","last_fullsized":"2023-11-15T02:55:21.600687+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613993+0000","last_change":"2023-11-15T02:55:21.609012+0000","last_active":"2023-11-15T02:55:21.613993+0000","last_peered":"2023-11-15T02:55:21.613993+0000","last_clean":"2023-11-15T02:55:21.613993+0000","last_became_active":"2023-11-15T02:55:21.608529+0000","last_became_peered":"2023-11-15T02:55:21.608529+0000","last_unstale":"2023-11-15T02:55:21.613993+0000","last_undegraded":"2023-11-15T02:55:21.613993+0000","last_fullsized":"2023-11-15T02:55:21.613993+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.602085+0000","last_change":"2023-11-15T02:55:21.221985+0000","last_active":"2023-11-15T02:55:21.602085+0000","last_peered":"2023-11-15T02:55:21.602085+0000","last_clean":"2023-11-15T02:55:21.602085+0000","last_became_active":"2023-11-15T02:55:21.220880+0000","last_became_peered":"2023-11-15T02:55:21.220880+0000","last_unstale":"2023-11-15T02:55:21.602085+0000","last_undegraded":"2023-11-15T02:55:21.602085+0000","last_fullsized":"2023-11-15T02:55:21.602085+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614153+0000","last_change":"2023-11-15T02:55:21.610227+0000","last_active":"2023-11-15T02:55:21.614153+0000","last_peered":"2023-11-15T02:55:21.614153+0000","last_clean":"2023-11-15T02:55:21.614153+0000","last_became_active":"2023-11-15T02:55:21.608882+0000","last_became_peered":"2023-11-15T02:55:21.608882+0000","last_unstale":"2023-11-15T02:55:21.614153+0000","last_undegraded":"2023-11-15T02:55:21.614153+0000","last_fullsized":"2023-11-15T02:55:21.614153+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.596464+0000","last_change":"2023-11-15T02:55:21.215727+0000","last_active":"2023-11-15T02:55:21.596464+0000","last_peered":"2023-11-15T02:55:21.596464+0000","last_clean":"2023-11-15T02:55:21.596464+0000","last_became_active":"2023-11-15T02:55:21.215449+0000","last_became_peered":"2023-11-15T02:55:21.215449+0000","last_unstale":"2023-11-15T02:55:21.596464+0000","last_undegraded":"2023-11-15T02:55:21.596464+0000","last_fullsized":"2023-11-15T02:55:21.596464+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616548+0000","last_change":"2023-11-15T02:55:21.613647+0000","last_active":"2023-11-15T02:55:21.616548+0000","last_peered":"2023-11-15T02:55:21.616548+0000","last_clean":"2023-11-15T02:55:21.616548+0000","last_became_active":"2023-11-15T02:55:21.613368+0000","last_became_peered":"2023-11-15T02:55:21.613368+0000","last_unstale":"2023-11-15T02:55:21.616548+0000","last_undegraded":"2023-11-15T02:55:21.616548+0000","last_fullsized":"2023-11-15T02:55:21.616548+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.605043+0000","last_change":"2023-11-15T02:55:21.214345+0000","last_active":"2023-11-15T02:55:21.605043+0000","last_peered":"2023-11-15T02:55:21.605043+0000","last_clean":"2023-11-15T02:55:21.605043+0000","last_became_active":"2023-11-15T02:55:21.214054+0000","last_became_peered":"2023-11-15T02:55:21.214054+0000","last_unstale":"2023-11-15T02:55:21.605043+0000","last_undegraded":"2023-11-15T02:55:21.605043+0000","last_fullsized":"2023-11-15T02:55:21.605043+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.624947+0000","last_change":"2023-11-15T02:55:21.620201+0000","last_active":"2023-11-15T02:55:21.624947+0000","last_peered":"2023-11-15T02:55:21.624947+0000","last_clean":"2023-11-15T02:55:21.624947+0000","last_became_active":"2023-11-15T02:55:21.619889+0000","last_became_peered":"2023-11-15T02:55:21.619889+0000","last_unstale":"2023-11-15T02:55:21.624947+0000","last_undegraded":"2023-11-15T02:55:21.624947+0000","last_fullsized":"2023-11-15T02:55:21.624947+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610196+0000","last_change":"2023-11-15T02:55:21.221519+0000","last_active":"2023-11-15T02:55:21.610196+0000","last_peered":"2023-11-15T02:55:21.610196+0000","last_clean":"2023-11-15T02:55:21.610196+0000","last_became_active":"2023-11-15T02:55:21.221288+0000","last_became_peered":"2023-11-15T02:55:21.221288+0000","last_unstale":"2023-11-15T02:55:21.610196+0000","last_undegraded":"2023-11-15T02:55:21.610196+0000","last_fullsized":"2023-11-15T02:55:21.610196+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615452+0000","last_change":"2023-11-15T02:55:21.614053+0000","last_active":"2023-11-15T02:55:21.615452+0000","last_peered":"2023-11-15T02:55:21.615452+0000","last_clean":"2023-11-15T02:55:21.615452+0000","last_became_active":"2023-11-15T02:55:21.613748+0000","last_became_peered":"2023-11-15T02:55:21.613748+0000","last_unstale":"2023-11-15T02:55:21.615452+0000","last_undegraded":"2023-11-15T02:55:21.615452+0000","last_fullsized":"2023-11-15T02:55:21.615452+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.600764+0000","last_change":"2023-11-15T02:55:21.220650+0000","last_active":"2023-11-15T02:55:21.600764+0000","last_peered":"2023-11-15T02:55:21.600764+0000","last_clean":"2023-11-15T02:55:21.600764+0000","last_became_active":"2023-11-15T02:55:21.220333+0000","last_became_peered":"2023-11-15T02:55:21.220333+0000","last_unstale":"2023-11-15T02:55:21.600764+0000","last_undegraded":"2023-11-15T02:55:21.600764+0000","last_fullsized":"2023-11-15T02:55:21.600764+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.606066+0000","last_change":"2023-11-15T02:55:21.605181+0000","last_active":"2023-11-15T02:55:21.606066+0000","last_peered":"2023-11-15T02:55:21.606066+0000","last_clean":"2023-11-15T02:55:21.606066+0000","last_became_active":"2023-11-15T02:55:21.604913+0000","last_became_peered":"2023-11-15T02:55:21.604913+0000","last_unstale":"2023-11-15T02:55:21.606066+0000","last_undegraded":"2023-11-15T02:55:21.606066+0000","last_fullsized":"2023-11-15T02:55:21.606066+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.592679+0000","last_change":"2023-11-15T02:55:21.209265+0000","last_active":"2023-11-15T02:55:21.592679+0000","last_peered":"2023-11-15T02:55:21.592679+0000","last_clean":"2023-11-15T02:55:21.592679+0000","last_became_active":"2023-11-15T02:55:21.208981+0000","last_became_peered":"2023-11-15T02:55:21.208981+0000","last_unstale":"2023-11-15T02:55:21.592679+0000","last_undegraded":"2023-11-15T02:55:21.592679+0000","last_fullsized":"2023-11-15T02:55:21.592679+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.607057+0000","last_change":"2023-11-15T02:55:21.604720+0000","last_active":"2023-11-15T02:55:21.607057+0000","last_peered":"2023-11-15T02:55:21.607057+0000","last_clean":"2023-11-15T02:55:21.607057+0000","last_became_active":"2023-11-15T02:55:21.604443+0000","last_became_peered":"2023-11-15T02:55:21.604443+0000","last_unstale":"2023-11-15T02:55:21.607057+0000","last_undegraded":"2023-11-15T02:55:21.607057+0000","last_fullsized":"2023-11-15T02:55:21.607057+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.604682+0000","last_change":"2023-11-15T02:55:21.217970+0000","last_active":"2023-11-15T02:55:21.604682+0000","last_peered":"2023-11-15T02:55:21.604682+0000","last_clean":"2023-11-15T02:55:21.604682+0000","last_became_active":"2023-11-15T02:55:21.217692+0000","last_became_peered":"2023-11-15T02:55:21.217692+0000","last_unstale":"2023-11-15T02:55:21.604682+0000","last_undegraded":"2023-11-15T02:55:21.604682+0000","last_fullsized":"2023-11-15T02:55:21.604682+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610339+0000","last_change":"2023-11-15T02:55:21.609596+0000","last_active":"2023-11-15T02:55:21.610339+0000","last_peered":"2023-11-15T02:55:21.610339+0000","last_clean":"2023-11-15T02:55:21.610339+0000","last_became_active":"2023-11-15T02:55:21.609299+0000","last_became_peered":"2023-11-15T02:55:21.609299+0000","last_unstale":"2023-11-15T02:55:21.610339+0000","last_undegraded":"2023-11-15T02:55:21.610339+0000","last_fullsized":"2023-11-15T02:55:21.610339+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601898+0000","last_change":"2023-11-15T02:55:21.219356+0000","last_active":"2023-11-15T02:55:21.601898+0000","last_peered":"2023-11-15T02:55:21.601898+0000","last_clean":"2023-11-15T02:55:21.601898+0000","last_became_active":"2023-11-15T02:55:21.219049+0000","last_became_peered":"2023-11-15T02:55:21.219049+0000","last_unstale":"2023-11-15T02:55:21.601898+0000","last_undegraded":"2023-11-15T02:55:21.601898+0000","last_fullsized":"2023-11-15T02:55:21.601898+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613356+0000","last_change":"2023-11-15T02:55:21.612069+0000","last_active":"2023-11-15T02:55:21.613356+0000","last_peered":"2023-11-15T02:55:21.613356+0000","last_clean":"2023-11-15T02:55:21.613356+0000","last_became_active":"2023-11-15T02:55:21.611743+0000","last_became_peered":"2023-11-15T02:55:21.611743+0000","last_unstale":"2023-11-15T02:55:21.613356+0000","last_undegraded":"2023-11-15T02:55:21.613356+0000","last_fullsized":"2023-11-15T02:55:21.613356+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601981+0000","last_change":"2023-11-15T02:55:21.224316+0000","last_active":"2023-11-15T02:55:21.601981+0000","last_peered":"2023-11-15T02:55:21.601981+0000","last_clean":"2023-11-15T02:55:21.601981+0000","last_became_active":"2023-11-15T02:55:21.224020+0000","last_became_peered":"2023-11-15T02:55:21.224020+0000","last_unstale":"2023-11-15T02:55:21.601981+0000","last_undegraded":"2023-11-15T02:55:21.601981+0000","last_fullsized":"2023-11-15T02:55:21.601981+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613220+0000","last_change":"2023-11-15T02:55:21.608033+0000","last_active":"2023-11-15T02:55:21.613220+0000","last_peered":"2023-11-15T02:55:21.613220+0000","last_clean":"2023-11-15T02:55:21.613220+0000","last_became_active":"2023-11-15T02:55:21.607691+0000","last_became_peered":"2023-11-15T02:55:21.607691+0000","last_unstale":"2023-11-15T02:55:21.613220+0000","last_undegraded":"2023-11-15T02:55:21.613220+0000","last_fullsized":"2023-11-15T02:55:21.613220+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.591661+0000","last_change":"2023-11-15T02:55:21.222631+0000","last_active":"2023-11-15T02:55:21.591661+0000","last_peered":"2023-11-15T02:55:21.591661+0000","last_clean":"2023-11-15T02:55:21.591661+0000","last_became_active":"2023-11-15T02:55:21.222362+0000","last_became_peered":"2023-11-15T02:55:21.222362+0000","last_unstale":"2023-11-15T02:55:21.591661+0000","last_undegraded":"2023-11-15T02:55:21.591661+0000","last_fullsized":"2023-11-15T02:55:21.591661+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.627741+0000","last_change":"2023-11-15T02:55:21.621207+0000","last_active":"2023-11-15T02:55:21.627741+0000","last_peered":"2023-11-15T02:55:21.627741+0000","last_clean":"2023-11-15T02:55:21.627741+0000","last_became_active":"2023-11-15T02:55:21.620885+0000","last_became_peered":"2023-11-15T02:55:21.620885+0000","last_unstale":"2023-11-15T02:55:21.627741+0000","last_undegraded":"2023-11-15T02:55:21.627741+0000","last_fullsized":"2023-11-15T02:55:21.627741+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.596149+0000","last_change":"2023-11-15T02:55:21.224507+0000","last_active":"2023-11-15T02:55:21.596149+0000","last_peered":"2023-11-15T02:55:21.596149+0000","last_clean":"2023-11-15T02:55:21.596149+0000","last_became_active":"2023-11-15T02:55:21.224240+0000","last_became_peered":"2023-11-15T02:55:21.224240+0000","last_unstale":"2023-11-15T02:55:21.596149+0000","last_undegraded":"2023-11-15T02:55:21.596149+0000","last_fullsized":"2023-11-15T02:55:21.596149+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.609949+0000","last_change":"2023-11-15T02:55:21.606117+0000","last_active":"2023-11-15T02:55:21.609949+0000","last_peered":"2023-11-15T02:55:21.609949+0000","last_clean":"2023-11-15T02:55:21.609949+0000","last_became_active":"2023-11-15T02:55:21.605854+0000","last_became_peered":"2023-11-15T02:55:21.605854+0000","last_unstale":"2023-11-15T02:55:21.609949+0000","last_undegraded":"2023-11-15T02:55:21.609949+0000","last_fullsized":"2023-11-15T02:55:21.609949+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601597+0000","last_change":"2023-11-15T02:55:21.221606+0000","last_active":"2023-11-15T02:55:21.601597+0000","last_peered":"2023-11-15T02:55:21.601597+0000","last_clean":"2023-11-15T02:55:21.601597+0000","last_became_active":"2023-11-15T02:55:21.221310+0000","last_became_peered":"2023-11-15T02:55:21.221310+0000","last_unstale":"2023-11-15T02:55:21.601597+0000","last_undegraded":"2023-11-15T02:55:21.601597+0000","last_fullsized":"2023-11-15T02:55:21.601597+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.620202+0000","last_change":"2023-11-15T02:55:21.617344+0000","last_active":"2023-11-15T02:55:21.620202+0000","last_peered":"2023-11-15T02:55:21.620202+0000","last_clean":"2023-11-15T02:55:21.620202+0000","last_became_active":"2023-11-15T02:55:21.617064+0000","last_became_peered":"2023-11-15T02:55:21.617064+0000","last_unstale":"2023-11-15T02:55:21.620202+0000","last_undegraded":"2023-11-15T02:55:21.620202+0000","last_fullsized":"2023-11-15T02:55:21.620202+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"211'3","reported_seq":13,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.607247+0000","last_change":"2023-11-15T02:55:21.224349+0000","last_active":"2023-11-15T02:55:21.607247+0000","last_peered":"2023-11-15T02:55:21.607247+0000","last_clean":"2023-11-15T02:55:21.607247+0000","last_became_active":"2023-11-15T02:55:21.224088+0000","last_became_peered":"2023-11-15T02:55:21.224088+0000","last_unstale":"2023-11-15T02:55:21.607247+0000","last_undegraded":"2023-11-15T02:55:21.607247+0000","last_fullsized":"2023-11-15T02:55:21.607247+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.620114+0000","last_change":"2023-11-15T02:55:21.618942+0000","last_active":"2023-11-15T02:55:21.620114+0000","last_peered":"2023-11-15T02:55:21.620114+0000","last_clean":"2023-11-15T02:55:21.620114+0000","last_became_active":"2023-11-15T02:55:21.618653+0000","last_became_peered":"2023-11-15T02:55:21.618653+0000","last_unstale":"2023-11-15T02:55:21.620114+0000","last_undegraded":"2023-11-15T02:55:21.620114+0000","last_fullsized":"2023-11-15T02:55:21.620114+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.617012+0000","last_change":"2023-11-15T02:55:21.223028+0000","last_active":"2023-11-15T02:55:21.617012+0000","last_peered":"2023-11-15T02:55:21.617012+0000","last_clean":"2023-11-15T02:55:21.617012+0000","last_became_active":"2023-11-15T02:55:21.222757+0000","last_became_peered":"2023-11-15T02:55:21.222757+0000","last_unstale":"2023-11-15T02:55:21.617012+0000","last_undegraded":"2023-11-15T02:55:21.617012+0000","last_fullsized":"2023-11-15T02:55:21.617012+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616955+0000","last_change":"2023-11-15T02:55:21.613838+0000","last_active":"2023-11-15T02:55:21.616955+0000","last_peered":"2023-11-15T02:55:21.616955+0000","last_clean":"2023-11-15T02:55:21.616955+0000","last_became_active":"2023-11-15T02:55:21.613565+0000","last_became_peered":"2023-11-15T02:55:21.613565+0000","last_unstale":"2023-11-15T02:55:21.616955+0000","last_undegraded":"2023-11-15T02:55:21.616955+0000","last_fullsized":"2023-11-15T02:55:21.616955+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614079+0000","last_change":"2023-11-15T02:55:21.222093+0000","last_active":"2023-11-15T02:55:21.614079+0000","last_peered":"2023-11-15T02:55:21.614079+0000","last_clean":"2023-11-15T02:55:21.614079+0000","last_became_active":"2023-11-15T02:55:21.221526+0000","last_became_peered":"2023-11-15T02:55:21.221526+0000","last_unstale":"2023-11-15T02:55:21.614079+0000","last_undegraded":"2023-11-15T02:55:21.614079+0000","last_fullsized":"2023-11-15T02:55:21.614079+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616601+0000","last_change":"2023-11-15T02:55:21.614388+0000","last_active":"2023-11-15T02:55:21.616601+0000","last_peered":"2023-11-15T02:55:21.616601+0000","last_clean":"2023-11-15T02:55:21.616601+0000","last_became_active":"2023-11-15T02:55:21.614117+0000","last_became_peered":"2023-11-15T02:55:21.614117+0000","last_unstale":"2023-11-15T02:55:21.616601+0000","last_undegraded":"2023-11-15T02:55:21.616601+0000","last_fullsized":"2023-11-15T02:55:21.616601+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601107+0000","last_change":"2023-11-15T02:55:21.221019+0000","last_active":"2023-11-15T02:55:21.601107+0000","last_peered":"2023-11-15T02:55:21.601107+0000","last_clean":"2023-11-15T02:55:21.601107+0000","last_became_active":"2023-11-15T02:55:21.220753+0000","last_became_peered":"2023-11-15T02:55:21.220753+0000","last_unstale":"2023-11-15T02:55:21.601107+0000","last_undegraded":"2023-11-15T02:55:21.601107+0000","last_fullsized":"2023-11-15T02:55:21.601107+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613357+0000","last_change":"2023-11-15T02:55:21.608060+0000","last_active":"2023-11-15T02:55:21.613357+0000","last_peered":"2023-11-15T02:55:21.613357+0000","last_clean":"2023-11-15T02:55:21.613357+0000","last_became_active":"2023-11-15T02:55:21.607743+0000","last_became_peered":"2023-11-15T02:55:21.607743+0000","last_unstale":"2023-11-15T02:55:21.613357+0000","last_undegraded":"2023-11-15T02:55:21.613357+0000","last_fullsized":"2023-11-15T02:55:21.613357+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.598891+0000","last_change":"2023-11-15T02:55:21.223501+0000","last_active":"2023-11-15T02:55:21.598891+0000","last_peered":"2023-11-15T02:55:21.598891+0000","last_clean":"2023-11-15T02:55:21.598891+0000","last_became_active":"2023-11-15T02:55:21.222459+0000","last_became_peered":"2023-11-15T02:55:21.222459+0000","last_unstale":"2023-11-15T02:55:21.598891+0000","last_undegraded":"2023-11-15T02:55:21.598891+0000","last_fullsized":"2023-11-15T02:55:21.598891+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616570+0000","last_change":"2023-11-15T02:55:21.609792+0000","last_active":"2023-11-15T02:55:21.616570+0000","last_peered":"2023-11-15T02:55:21.616570+0000","last_clean":"2023-11-15T02:55:21.616570+0000","last_became_active":"2023-11-15T02:55:21.608512+0000","last_became_peered":"2023-11-15T02:55:21.608512+0000","last_unstale":"2023-11-15T02:55:21.616570+0000","last_undegraded":"2023-11-15T02:55:21.616570+0000","last_fullsized":"2023-11-15T02:55:21.616570+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"211'4","reported_seq":14,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615003+0000","last_change":"2023-11-15T02:55:21.211489+0000","last_active":"2023-11-15T02:55:21.615003+0000","last_peered":"2023-11-15T02:55:21.615003+0000","last_clean":"2023-11-15T02:55:21.615003+0000","last_became_active":"2023-11-15T02:55:21.211194+0000","last_became_peered":"2023-11-15T02:55:21.211194+0000","last_unstale":"2023-11-15T02:55:21.615003+0000","last_undegraded":"2023-11-15T02:55:21.615003+0000","last_fullsized":"2023-11-15T02:55:21.615003+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.608482+0000","last_change":"2023-11-15T02:55:21.607138+0000","last_active":"2023-11-15T02:55:21.608482+0000","last_peered":"2023-11-15T02:55:21.608482+0000","last_clean":"2023-11-15T02:55:21.608482+0000","last_became_active":"2023-11-15T02:55:21.606842+0000","last_became_peered":"2023-11-15T02:55:21.606842+0000","last_unstale":"2023-11-15T02:55:21.608482+0000","last_undegraded":"2023-11-15T02:55:21.608482+0000","last_fullsized":"2023-11-15T02:55:21.608482+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615958+0000","last_change":"2023-11-15T02:55:21.213860+0000","last_active":"2023-11-15T02:55:21.615958+0000","last_peered":"2023-11-15T02:55:21.615958+0000","last_clean":"2023-11-15T02:55:21.615958+0000","last_became_active":"2023-11-15T02:55:21.213563+0000","last_became_peered":"2023-11-15T02:55:21.213563+0000","last_unstale":"2023-11-15T02:55:21.615958+0000","last_undegraded":"2023-11-15T02:55:21.615958+0000","last_fullsized":"2023-11-15T02:55:21.615958+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.612364+0000","last_change":"2023-11-15T02:55:21.611597+0000","last_active":"2023-11-15T02:55:21.612364+0000","last_peered":"2023-11-15T02:55:21.612364+0000","last_clean":"2023-11-15T02:55:21.612364+0000","last_became_active":"2023-11-15T02:55:21.611310+0000","last_became_peered":"2023-11-15T02:55:21.611310+0000","last_unstale":"2023-11-15T02:55:21.612364+0000","last_undegraded":"2023-11-15T02:55:21.612364+0000","last_fullsized":"2023-11-15T02:55:21.612364+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614692+0000","last_change":"2023-11-15T02:55:21.223224+0000","last_active":"2023-11-15T02:55:21.614692+0000","last_peered":"2023-11-15T02:55:21.614692+0000","last_clean":"2023-11-15T02:55:21.614692+0000","last_became_active":"2023-11-15T02:55:21.222920+0000","last_became_peered":"2023-11-15T02:55:21.222920+0000","last_unstale":"2023-11-15T02:55:21.614692+0000","last_undegraded":"2023-11-15T02:55:21.614692+0000","last_fullsized":"2023-11-15T02:55:21.614692+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613500+0000","last_change":"2023-11-15T02:55:21.610561+0000","last_active":"2023-11-15T02:55:21.613500+0000","last_peered":"2023-11-15T02:55:21.613500+0000","last_clean":"2023-11-15T02:55:21.613500+0000","last_became_active":"2023-11-15T02:55:21.610252+0000","last_became_peered":"2023-11-15T02:55:21.610252+0000","last_unstale":"2023-11-15T02:55:21.613500+0000","last_undegraded":"2023-11-15T02:55:21.613500+0000","last_fullsized":"2023-11-15T02:55:21.613500+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.602628+0000","last_change":"2023-11-15T02:55:21.224625+0000","last_active":"2023-11-15T02:55:21.602628+0000","last_peered":"2023-11-15T02:55:21.602628+0000","last_clean":"2023-11-15T02:55:21.602628+0000","last_became_active":"2023-11-15T02:55:21.224303+0000","last_became_peered":"2023-11-15T02:55:21.224303+0000","last_unstale":"2023-11-15T02:55:21.602628+0000","last_undegraded":"2023-11-15T02:55:21.602628+0000","last_fullsized":"2023-11-15T02:55:21.602628+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610588+0000","last_change":"2023-11-15T02:55:21.608019+0000","last_active":"2023-11-15T02:55:21.610588+0000","last_peered":"2023-11-15T02:55:21.610588+0000","last_clean":"2023-11-15T02:55:21.610588+0000","last_became_active":"2023-11-15T02:55:21.607691+0000","last_became_peered":"2023-11-15T02:55:21.607691+0000","last_unstale":"2023-11-15T02:55:21.610588+0000","last_undegraded":"2023-11-15T02:55:21.610588+0000","last_fullsized":"2023-11-15T02:55:21.610588+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.607245+0000","last_change":"2023-11-15T02:55:21.220350+0000","last_active":"2023-11-15T02:55:21.607245+0000","last_peered":"2023-11-15T02:55:21.607245+0000","last_clean":"2023-11-15T02:55:21.607245+0000","last_became_active":"2023-11-15T02:55:21.220020+0000","last_became_peered":"2023-11-15T02:55:21.220020+0000","last_unstale":"2023-11-15T02:55:21.607245+0000","last_undegraded":"2023-11-15T02:55:21.607245+0000","last_fullsized":"2023-11-15T02:55:21.607245+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615813+0000","last_change":"2023-11-15T02:55:21.609007+0000","last_active":"2023-11-15T02:55:21.615813+0000","last_peered":"2023-11-15T02:55:21.615813+0000","last_clean":"2023-11-15T02:55:21.615813+0000","last_became_active":"2023-11-15T02:55:21.608715+0000","last_became_peered":"2023-11-15T02:55:21.608715+0000","last_unstale":"2023-11-15T02:55:21.615813+0000","last_undegraded":"2023-11-15T02:55:21.615813+0000","last_fullsized":"2023-11-15T02:55:21.615813+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613212+0000","last_change":"2023-11-15T02:55:21.224368+0000","last_active":"2023-11-15T02:55:21.613212+0000","last_peered":"2023-11-15T02:55:21.613212+0000","last_clean":"2023-11-15T02:55:21.613212+0000","last_became_active":"2023-11-15T02:55:21.224105+0000","last_became_peered":"2023-11-15T02:55:21.224105+0000","last_unstale":"2023-11-15T02:55:21.613212+0000","last_undegraded":"2023-11-15T02:55:21.613212+0000","last_fullsized":"2023-11-15T02:55:21.613212+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.617098+0000","last_change":"2023-11-15T02:55:21.615992+0000","last_active":"2023-11-15T02:55:21.617098+0000","last_peered":"2023-11-15T02:55:21.617098+0000","last_clean":"2023-11-15T02:55:21.617098+0000","last_became_active":"2023-11-15T02:55:21.615695+0000","last_became_peered":"2023-11-15T02:55:21.615695+0000","last_unstale":"2023-11-15T02:55:21.617098+0000","last_undegraded":"2023-11-15T02:55:21.617098+0000","last_fullsized":"2023-11-15T02:55:21.617098+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.600876+0000","last_change":"2023-11-15T02:55:21.217336+0000","last_active":"2023-11-15T02:55:21.600876+0000","last_peered":"2023-11-15T02:55:21.600876+0000","last_clean":"2023-11-15T02:55:21.600876+0000","last_became_active":"2023-11-15T02:55:21.217023+0000","last_became_peered":"2023-11-15T02:55:21.217023+0000","last_unstale":"2023-11-15T02:55:21.600876+0000","last_undegraded":"2023-11-15T02:55:21.600876+0000","last_fullsized":"2023-11-15T02:55:21.600876+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615598+0000","last_change":"2023-11-15T02:55:21.614273+0000","last_active":"2023-11-15T02:55:21.615598+0000","last_peered":"2023-11-15T02:55:21.615598+0000","last_clean":"2023-11-15T02:55:21.615598+0000","last_became_active":"2023-11-15T02:55:21.614011+0000","last_became_peered":"2023-11-15T02:55:21.614011+0000","last_unstale":"2023-11-15T02:55:21.615598+0000","last_undegraded":"2023-11-15T02:55:21.615598+0000","last_fullsized":"2023-11-15T02:55:21.615598+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.592036+0000","last_change":"2023-11-15T02:55:21.220570+0000","last_active":"2023-11-15T02:55:21.592036+0000","last_peered":"2023-11-15T02:55:21.592036+0000","last_clean":"2023-11-15T02:55:21.592036+0000","last_became_active":"2023-11-15T02:55:21.220284+0000","last_became_peered":"2023-11-15T02:55:21.220284+0000","last_unstale":"2023-11-15T02:55:21.592036+0000","last_undegraded":"2023-11-15T02:55:21.592036+0000","last_fullsized":"2023-11-15T02:55:21.592036+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.605672+0000","last_change":"2023-11-15T02:55:21.598660+0000","last_active":"2023-11-15T02:55:21.605672+0000","last_peered":"2023-11-15T02:55:21.605672+0000","last_clean":"2023-11-15T02:55:21.605672+0000","last_became_active":"2023-11-15T02:55:21.598369+0000","last_became_peered":"2023-11-15T02:55:21.598369+0000","last_unstale":"2023-11-15T02:55:21.605672+0000","last_undegraded":"2023-11-15T02:55:21.605672+0000","last_fullsized":"2023-11-15T02:55:21.605672+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.598855+0000","last_change":"2023-11-15T02:55:21.219561+0000","last_active":"2023-11-15T02:55:21.598855+0000","last_peered":"2023-11-15T02:55:21.598855+0000","last_clean":"2023-11-15T02:55:21.598855+0000","last_became_active":"2023-11-15T02:55:21.219279+0000","last_became_peered":"2023-11-15T02:55:21.219279+0000","last_unstale":"2023-11-15T02:55:21.598855+0000","last_undegraded":"2023-11-15T02:55:21.598855+0000","last_fullsized":"2023-11-15T02:55:21.598855+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616997+0000","last_change":"2023-11-15T02:55:21.615208+0000","last_active":"2023-11-15T02:55:21.616997+0000","last_peered":"2023-11-15T02:55:21.616997+0000","last_clean":"2023-11-15T02:55:21.616997+0000","last_became_active":"2023-11-15T02:55:21.614949+0000","last_became_peered":"2023-11-15T02:55:21.614949+0000","last_unstale":"2023-11-15T02:55:21.616997+0000","last_undegraded":"2023-11-15T02:55:21.616997+0000","last_fullsized":"2023-11-15T02:55:21.616997+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.621656+0000","last_change":"2023-11-15T02:55:21.220786+0000","last_active":"2023-11-15T02:55:21.621656+0000","last_peered":"2023-11-15T02:55:21.621656+0000","last_clean":"2023-11-15T02:55:21.621656+0000","last_became_active":"2023-11-15T02:55:21.220508+0000","last_became_peered":"2023-11-15T02:55:21.220508+0000","last_unstale":"2023-11-15T02:55:21.621656+0000","last_undegraded":"2023-11-15T02:55:21.621656+0000","last_fullsized":"2023-11-15T02:55:21.621656+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610796+0000","last_change":"2023-11-15T02:55:21.607461+0000","last_active":"2023-11-15T02:55:21.610796+0000","last_peered":"2023-11-15T02:55:21.610796+0000","last_clean":"2023-11-15T02:55:21.610796+0000","last_became_active":"2023-11-15T02:55:21.606083+0000","last_became_peered":"2023-11-15T02:55:21.606083+0000","last_unstale":"2023-11-15T02:55:21.610796+0000","last_undegraded":"2023-11-15T02:55:21.610796+0000","last_fullsized":"2023-11-15T02:55:21.610796+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.592325+0000","last_change":"2023-11-15T02:55:21.221600+0000","last_active":"2023-11-15T02:55:21.592325+0000","last_peered":"2023-11-15T02:55:21.592325+0000","last_clean":"2023-11-15T02:55:21.592325+0000","last_became_active":"2023-11-15T02:55:21.221325+0000","last_became_peered":"2023-11-15T02:55:21.221325+0000","last_unstale":"2023-11-15T02:55:21.592325+0000","last_undegraded":"2023-11-15T02:55:21.592325+0000","last_fullsized":"2023-11-15T02:55:21.592325+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.627805+0000","last_change":"2023-11-15T02:55:21.621970+0000","last_active":"2023-11-15T02:55:21.627805+0000","last_peered":"2023-11-15T02:55:21.627805+0000","last_clean":"2023-11-15T02:55:21.627805+0000","last_became_active":"2023-11-15T02:55:21.621681+0000","last_became_peered":"2023-11-15T02:55:21.621681+0000","last_unstale":"2023-11-15T02:55:21.627805+0000","last_undegraded":"2023-11-15T02:55:21.627805+0000","last_fullsized":"2023-11-15T02:55:21.627805+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.596419+0000","last_change":"2023-11-15T02:55:21.221930+0000","last_active":"2023-11-15T02:55:21.596419+0000","last_peered":"2023-11-15T02:55:21.596419+0000","last_clean":"2023-11-15T02:55:21.596419+0000","last_became_active":"2023-11-15T02:55:21.221224+0000","last_became_peered":"2023-11-15T02:55:21.221224+0000","last_unstale":"2023-11-15T02:55:21.596419+0000","last_undegraded":"2023-11-15T02:55:21.596419+0000","last_fullsized":"2023-11-15T02:55:21.596419+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615599+0000","last_change":"2023-11-15T02:55:21.613035+0000","last_active":"2023-11-15T02:55:21.615599+0000","last_peered":"2023-11-15T02:55:21.615599+0000","last_clean":"2023-11-15T02:55:21.615599+0000","last_became_active":"2023-11-15T02:55:21.612719+0000","last_became_peered":"2023-11-15T02:55:21.612719+0000","last_unstale":"2023-11-15T02:55:21.615599+0000","last_undegraded":"2023-11-15T02:55:21.615599+0000","last_fullsized":"2023-11-15T02:55:21.615599+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.596032+0000","last_change":"2023-11-15T02:55:21.215981+0000","last_active":"2023-11-15T02:55:21.596032+0000","last_peered":"2023-11-15T02:55:21.596032+0000","last_clean":"2023-11-15T02:55:21.596032+0000","last_became_active":"2023-11-15T02:55:21.215705+0000","last_became_peered":"2023-11-15T02:55:21.215705+0000","last_unstale":"2023-11-15T02:55:21.596032+0000","last_undegraded":"2023-11-15T02:55:21.596032+0000","last_fullsized":"2023-11-15T02:55:21.596032+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610988+0000","last_change":"2023-11-15T02:55:21.608986+0000","last_active":"2023-11-15T02:55:21.610988+0000","last_peered":"2023-11-15T02:55:21.610988+0000","last_clean":"2023-11-15T02:55:21.610988+0000","last_became_active":"2023-11-15T02:55:21.608682+0000","last_became_peered":"2023-11-15T02:55:21.608682+0000","last_unstale":"2023-11-15T02:55:21.610988+0000","last_undegraded":"2023-11-15T02:55:21.610988+0000","last_fullsized":"2023-11-15T02:55:21.610988+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601238+0000","last_change":"2023-11-15T02:55:21.222991+0000","last_active":"2023-11-15T02:55:21.601238+0000","last_peered":"2023-11-15T02:55:21.601238+0000","last_clean":"2023-11-15T02:55:21.601238+0000","last_became_active":"2023-11-15T02:55:21.222708+0000","last_became_peered":"2023-11-15T02:55:21.222708+0000","last_unstale":"2023-11-15T02:55:21.601238+0000","last_undegraded":"2023-11-15T02:55:21.601238+0000","last_fullsized":"2023-11-15T02:55:21.601238+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.619508+0000","last_change":"2023-11-15T02:55:21.614790+0000","last_active":"2023-11-15T02:55:21.619508+0000","last_peered":"2023-11-15T02:55:21.619508+0000","last_clean":"2023-11-15T02:55:21.619508+0000","last_became_active":"2023-11-15T02:55:21.614259+0000","last_became_peered":"2023-11-15T02:55:21.614259+0000","last_unstale":"2023-11-15T02:55:21.619508+0000","last_undegraded":"2023-11-15T02:55:21.619508+0000","last_fullsized":"2023-11-15T02:55:21.619508+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601473+0000","last_change":"2023-11-15T02:55:21.224187+0000","last_active":"2023-11-15T02:55:21.601473+0000","last_peered":"2023-11-15T02:55:21.601473+0000","last_clean":"2023-11-15T02:55:21.601473+0000","last_became_active":"2023-11-15T02:55:21.223896+0000","last_became_peered":"2023-11-15T02:55:21.223896+0000","last_unstale":"2023-11-15T02:55:21.601473+0000","last_undegraded":"2023-11-15T02:55:21.601473+0000","last_fullsized":"2023-11-15T02:55:21.601473+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614014+0000","last_change":"2023-11-15T02:55:21.612373+0000","last_active":"2023-11-15T02:55:21.614014+0000","last_peered":"2023-11-15T02:55:21.614014+0000","last_clean":"2023-11-15T02:55:21.614014+0000","last_became_active":"2023-11-15T02:55:21.608996+0000","last_became_peered":"2023-11-15T02:55:21.608996+0000","last_unstale":"2023-11-15T02:55:21.614014+0000","last_undegraded":"2023-11-15T02:55:21.614014+0000","last_fullsized":"2023-11-15T02:55:21.614014+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.592130+0000","last_change":"2023-11-15T02:55:21.227648+0000","last_active":"2023-11-15T02:55:21.592130+0000","last_peered":"2023-11-15T02:55:21.592130+0000","last_clean":"2023-11-15T02:55:21.592130+0000","last_became_active":"2023-11-15T02:55:21.227094+0000","last_became_peered":"2023-11-15T02:55:21.227094+0000","last_unstale":"2023-11-15T02:55:21.592130+0000","last_undegraded":"2023-11-15T02:55:21.592130+0000","last_fullsized":"2023-11-15T02:55:21.592130+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.619917+0000","last_change":"2023-11-15T02:55:21.611510+0000","last_active":"2023-11-15T02:55:21.619917+0000","last_peered":"2023-11-15T02:55:21.619917+0000","last_clean":"2023-11-15T02:55:21.619917+0000","last_became_active":"2023-11-15T02:55:21.611262+0000","last_became_peered":"2023-11-15T02:55:21.611262+0000","last_unstale":"2023-11-15T02:55:21.619917+0000","last_undegraded":"2023-11-15T02:55:21.619917+0000","last_fullsized":"2023-11-15T02:55:21.619917+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.598947+0000","last_change":"2023-11-15T02:55:21.215272+0000","last_active":"2023-11-15T02:55:21.598947+0000","last_peered":"2023-11-15T02:55:21.598947+0000","last_clean":"2023-11-15T02:55:21.598947+0000","last_became_active":"2023-11-15T02:55:21.214976+0000","last_became_peered":"2023-11-15T02:55:21.214976+0000","last_unstale":"2023-11-15T02:55:21.598947+0000","last_undegraded":"2023-11-15T02:55:21.598947+0000","last_fullsized":"2023-11-15T02:55:21.598947+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.627717+0000","last_change":"2023-11-15T02:55:21.620652+0000","last_active":"2023-11-15T02:55:21.627717+0000","last_peered":"2023-11-15T02:55:21.627717+0000","last_clean":"2023-11-15T02:55:21.627717+0000","last_became_active":"2023-11-15T02:55:21.620208+0000","last_became_peered":"2023-11-15T02:55:21.620208+0000","last_unstale":"2023-11-15T02:55:21.627717+0000","last_undegraded":"2023-11-15T02:55:21.627717+0000","last_fullsized":"2023-11-15T02:55:21.627717+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.607425+0000","last_change":"2023-11-15T02:55:21.210495+0000","last_active":"2023-11-15T02:55:21.607425+0000","last_peered":"2023-11-15T02:55:21.607425+0000","last_clean":"2023-11-15T02:55:21.607425+0000","last_became_active":"2023-11-15T02:55:21.209916+0000","last_became_peered":"2023-11-15T02:55:21.209916+0000","last_unstale":"2023-11-15T02:55:21.607425+0000","last_undegraded":"2023-11-15T02:55:21.607425+0000","last_fullsized":"2023-11-15T02:55:21.607425+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":175,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601902+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:55:21.601902+0000","last_peered":"2023-11-15T02:55:21.601902+0000","last_clean":"2023-11-15T02:55:21.601902+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:55:21.601902+0000","last_undegraded":"2023-11-15T02:55:21.601902+0000","last_fullsized":"2023-11-15T02:55:21.601902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614193+0000","last_change":"2023-11-15T02:55:21.613179+0000","last_active":"2023-11-15T02:55:21.614193+0000","last_peered":"2023-11-15T02:55:21.614193+0000","last_clean":"2023-11-15T02:55:21.614193+0000","last_became_active":"2023-11-15T02:55:21.612678+0000","last_became_peered":"2023-11-15T02:55:21.612678+0000","last_unstale":"2023-11-15T02:55:21.614193+0000","last_undegraded":"2023-11-15T02:55:21.614193+0000","last_fullsized":"2023-11-15T02:55:21.614193+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.603795+0000","last_change":"2023-11-15T02:55:21.221847+0000","last_active":"2023-11-15T02:55:21.603795+0000","last_peered":"2023-11-15T02:55:21.603795+0000","last_clean":"2023-11-15T02:55:21.603795+0000","last_became_active":"2023-11-15T02:55:21.220997+0000","last_became_peered":"2023-11-15T02:55:21.220997+0000","last_unstale":"2023-11-15T02:55:21.603795+0000","last_undegraded":"2023-11-15T02:55:21.603795+0000","last_fullsized":"2023-11-15T02:55:21.603795+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":174,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.602411+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:55:21.602411+0000","last_peered":"2023-11-15T02:55:21.602411+0000","last_clean":"2023-11-15T02:55:21.602411+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:55:21.602411+0000","last_undegraded":"2023-11-15T02:55:21.602411+0000","last_fullsized":"2023-11-15T02:55:21.602411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610879+0000","last_change":"2023-11-15T02:55:21.608087+0000","last_active":"2023-11-15T02:55:21.610879+0000","last_peered":"2023-11-15T02:55:21.610879+0000","last_clean":"2023-11-15T02:55:21.610879+0000","last_became_active":"2023-11-15T02:55:21.607690+0000","last_became_peered":"2023-11-15T02:55:21.607690+0000","last_unstale":"2023-11-15T02:55:21.610879+0000","last_undegraded":"2023-11-15T02:55:21.610879+0000","last_fullsized":"2023-11-15T02:55:21.610879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.600782+0000","last_change":"2023-11-15T02:55:21.217339+0000","last_active":"2023-11-15T02:55:21.600782+0000","last_peered":"2023-11-15T02:55:21.600782+0000","last_clean":"2023-11-15T02:55:21.600782+0000","last_became_active":"2023-11-15T02:55:21.217053+0000","last_became_peered":"2023-11-15T02:55:21.217053+0000","last_unstale":"2023-11-15T02:55:21.600782+0000","last_undegraded":"2023-11-15T02:55:21.600782+0000","last_fullsized":"2023-11-15T02:55:21.600782+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":185,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.592123+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:55:21.592123+0000","last_peered":"2023-11-15T02:55:21.592123+0000","last_clean":"2023-11-15T02:55:21.592123+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:55:21.592123+0000","last_undegraded":"2023-11-15T02:55:21.592123+0000","last_fullsized":"2023-11-15T02:55:21.592123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.609324+0000","last_change":"2023-11-15T02:55:21.606442+0000","last_active":"2023-11-15T02:55:21.609324+0000","last_peered":"2023-11-15T02:55:21.609324+0000","last_clean":"2023-11-15T02:55:21.609324+0000","last_became_active":"2023-11-15T02:55:21.606160+0000","last_became_peered":"2023-11-15T02:55:21.606160+0000","last_unstale":"2023-11-15T02:55:21.609324+0000","last_undegraded":"2023-11-15T02:55:21.609324+0000","last_fullsized":"2023-11-15T02:55:21.609324+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.598514+0000","last_change":"2023-11-15T02:55:21.212398+0000","last_active":"2023-11-15T02:55:21.598514+0000","last_peered":"2023-11-15T02:55:21.598514+0000","last_clean":"2023-11-15T02:55:21.598514+0000","last_became_active":"2023-11-15T02:55:21.210863+0000","last_became_peered":"2023-11-15T02:55:21.210863+0000","last_unstale":"2023-11-15T02:55:21.598514+0000","last_undegraded":"2023-11-15T02:55:21.598514+0000","last_fullsized":"2023-11-15T02:55:21.598514+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601987+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:55:21.601987+0000","last_peered":"2023-11-15T02:55:21.601987+0000","last_clean":"2023-11-15T02:55:21.601987+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:55:21.601987+0000","last_undegraded":"2023-11-15T02:55:21.601987+0000","last_fullsized":"2023-11-15T02:55:21.601987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":169,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601265+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:55:21.601265+0000","last_peered":"2023-11-15T02:55:21.601265+0000","last_clean":"2023-11-15T02:55:21.601265+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:55:21.601265+0000","last_undegraded":"2023-11-15T02:55:21.601265+0000","last_fullsized":"2023-11-15T02:55:21.601265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613282+0000","last_change":"2023-11-15T02:55:21.607951+0000","last_active":"2023-11-15T02:55:21.613282+0000","last_peered":"2023-11-15T02:55:21.613282+0000","last_clean":"2023-11-15T02:55:21.613282+0000","last_became_active":"2023-11-15T02:55:21.607565+0000","last_became_peered":"2023-11-15T02:55:21.607565+0000","last_unstale":"2023-11-15T02:55:21.613282+0000","last_undegraded":"2023-11-15T02:55:21.613282+0000","last_fullsized":"2023-11-15T02:55:21.613282+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.596698+0000","last_change":"2023-11-15T02:55:21.220069+0000","last_active":"2023-11-15T02:55:21.596698+0000","last_peered":"2023-11-15T02:55:21.596698+0000","last_clean":"2023-11-15T02:55:21.596698+0000","last_became_active":"2023-11-15T02:55:21.219652+0000","last_became_peered":"2023-11-15T02:55:21.219652+0000","last_unstale":"2023-11-15T02:55:21.596698+0000","last_undegraded":"2023-11-15T02:55:21.596698+0000","last_fullsized":"2023-11-15T02:55:21.596698+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601340+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:55:21.601340+0000","last_peered":"2023-11-15T02:55:21.601340+0000","last_clean":"2023-11-15T02:55:21.601340+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:55:21.601340+0000","last_undegraded":"2023-11-15T02:55:21.601340+0000","last_fullsized":"2023-11-15T02:55:21.601340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610304+0000","last_change":"2023-11-15T02:55:21.608221+0000","last_active":"2023-11-15T02:55:21.610304+0000","last_peered":"2023-11-15T02:55:21.610304+0000","last_clean":"2023-11-15T02:55:21.610304+0000","last_became_active":"2023-11-15T02:55:21.607956+0000","last_became_peered":"2023-11-15T02:55:21.607956+0000","last_unstale":"2023-11-15T02:55:21.610304+0000","last_undegraded":"2023-11-15T02:55:21.610304+0000","last_fullsized":"2023-11-15T02:55:21.610304+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.604907+0000","last_change":"2023-11-15T02:55:21.218825+0000","last_active":"2023-11-15T02:55:21.604907+0000","last_peered":"2023-11-15T02:55:21.604907+0000","last_clean":"2023-11-15T02:55:21.604907+0000","last_became_active":"2023-11-15T02:55:21.218507+0000","last_became_peered":"2023-11-15T02:55:21.218507+0000","last_unstale":"2023-11-15T02:55:21.604907+0000","last_undegraded":"2023-11-15T02:55:21.604907+0000","last_fullsized":"2023-11-15T02:55:21.604907+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.605977+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:55:21.605977+0000","last_peered":"2023-11-15T02:55:21.605977+0000","last_clean":"2023-11-15T02:55:21.605977+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:55:21.605977+0000","last_undegraded":"2023-11-15T02:55:21.605977+0000","last_fullsized":"2023-11-15T02:55:21.605977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.624980+0000","last_change":"2023-11-15T02:55:21.622245+0000","last_active":"2023-11-15T02:55:21.624980+0000","last_peered":"2023-11-15T02:55:21.624980+0000","last_clean":"2023-11-15T02:55:21.624980+0000","last_became_active":"2023-11-15T02:55:21.621957+0000","last_became_peered":"2023-11-15T02:55:21.621957+0000","last_unstale":"2023-11-15T02:55:21.624980+0000","last_undegraded":"2023-11-15T02:55:21.624980+0000","last_fullsized":"2023-11-15T02:55:21.624980+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615712+0000","last_change":"2023-11-15T02:55:21.223138+0000","last_active":"2023-11-15T02:55:21.615712+0000","last_peered":"2023-11-15T02:55:21.615712+0000","last_clean":"2023-11-15T02:55:21.615712+0000","last_became_active":"2023-11-15T02:55:21.222861+0000","last_became_peered":"2023-11-15T02:55:21.222861+0000","last_unstale":"2023-11-15T02:55:21.615712+0000","last_undegraded":"2023-11-15T02:55:21.615712+0000","last_fullsized":"2023-11-15T02:55:21.615712+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":175,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601688+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:55:21.601688+0000","last_peered":"2023-11-15T02:55:21.601688+0000","last_clean":"2023-11-15T02:55:21.601688+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:55:21.601688+0000","last_undegraded":"2023-11-15T02:55:21.601688+0000","last_fullsized":"2023-11-15T02:55:21.601688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.621392+0000","last_change":"2023-11-15T02:55:21.616899+0000","last_active":"2023-11-15T02:55:21.621392+0000","last_peered":"2023-11-15T02:55:21.621392+0000","last_clean":"2023-11-15T02:55:21.621392+0000","last_became_active":"2023-11-15T02:55:21.616586+0000","last_became_peered":"2023-11-15T02:55:21.616586+0000","last_unstale":"2023-11-15T02:55:21.621392+0000","last_undegraded":"2023-11-15T02:55:21.621392+0000","last_fullsized":"2023-11-15T02:55:21.621392+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.604862+0000","last_change":"2023-11-15T02:55:21.223225+0000","last_active":"2023-11-15T02:55:21.604862+0000","last_peered":"2023-11-15T02:55:21.604862+0000","last_clean":"2023-11-15T02:55:21.604862+0000","last_became_active":"2023-11-15T02:55:21.222928+0000","last_became_peered":"2023-11-15T02:55:21.222928+0000","last_unstale":"2023-11-15T02:55:21.604862+0000","last_undegraded":"2023-11-15T02:55:21.604862+0000","last_fullsized":"2023-11-15T02:55:21.604862+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":198,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.605148+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:55:21.605148+0000","last_peered":"2023-11-15T02:55:21.605148+0000","last_clean":"2023-11-15T02:55:21.605148+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:55:21.605148+0000","last_undegraded":"2023-11-15T02:55:21.605148+0000","last_fullsized":"2023-11-15T02:55:21.605148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2662400,"data_stored":1425490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.66500000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.82399999999999995},"last":0.81200000000000006}]},{"osd":1,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.39400000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75900000000000001,"5min":0.78500000000000003,"15min":0.79200000000000004},"last":0.748},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.57899999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.749,"5min":0.76300000000000001,"15min":0.82299999999999995},"last":0.78600000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.58299999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.80400000000000005},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76500000000000001,"5min":0.82799999999999996,"15min":0.83799999999999997},"last":0.69699999999999995}]},{"osd":3,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.88500000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.86699999999999999},"last":0.77600000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.35299999999999998,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.63700000000000001,"5min":0.71699999999999997,"15min":0.749},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.74299999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.73599999999999999}]},{"osd":5,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.30199999999999999,"15min":0.27300000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.497,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.81999999999999995},"last":0.65700000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.72399999999999998,"5min":0.78200000000000003,"15min":0.84899999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.28499999999999998},"max":{"1min":0.78400000000000003,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.63700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575966,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307884,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063956,"statfs":{"total":96636764160,"available":96321490944,"internally_reserved":0,"allocated":2658304,"data_stored":1424936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.24099999999999999},"max":{"1min":0.79500000000000004,"5min":0.79700000000000004,"15min":0.92500000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.437,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":1.466,"15min":1.466},"last":0.53400000000000003}]},{"osd":1,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81999999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78400000000000003,"5min":1.53,"15min":1.53},"last":0.66300000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.36899999999999999,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":1.026,"15min":1.026},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.80200000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.61499999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.32900000000000001},"max":{"1min":0.71099999999999997,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.81200000000000006,"5min":1.498,"15min":1.498},"last":0.73899999999999999}]},{"osd":4,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.61299999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.68400000000000005,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.442}]},{"osd":5,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.499,"15min":0.48999999999999999},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65600000000000003,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.377},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.376,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.48399999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.498,"15min":0.503},"min":{"1min":0.34300000000000003,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.76400000000000001,"5min":1.04,"15min":1.04},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80000000000000004,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.51300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575967,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307880,"kb_used_data":2592,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063960,"statfs":{"total":96636764160,"available":96321495040,"internally_reserved":0,"allocated":2654208,"data_stored":1424044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40100000000000002,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.26100000000000001,"15min":0.23999999999999999},"max":{"1min":0.47899999999999998,"5min":1.149,"15min":1.149},"last":0.37},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.30499999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.499,"5min":1.044,"15min":1.044},"last":0.70499999999999996}]},{"osd":2,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40799999999999997,"15min":0.40699999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51100000000000001,"5min":0.748,"15min":0.748},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46899999999999997,"15min":0.46200000000000002},"min":{"1min":0.313,"5min":0.311,"15min":0.27500000000000002},"max":{"1min":0.58299999999999996,"5min":1.101,"15min":1.101},"last":0.53200000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63600000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.504,"15min":0.505},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66200000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.67800000000000005}]},{"osd":4,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.40999999999999998,"15min":0.372},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65500000000000003,"15min":0.66200000000000003},"min":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":1.052,"15min":1.081},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.53300000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88600000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73099999999999998,"15min":0.68899999999999995},"min":{"1min":0.498,"5min":0.42999999999999999,"15min":0.42699999999999999},"max":{"1min":0.86499999999999999,"5min":5.7590000000000003,"15min":5.7590000000000003},"last":0.58499999999999996}]},{"osd":6,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89300000000000002,"5min":1.089,"15min":1.089},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76800000000000002,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91900000000000004,"5min":5.7930000000000001,"15min":5.7930000000000001},"last":0.55400000000000005}]},{"osd":7,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72399999999999998,"15min":0.72699999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88300000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.59699999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85699999999999998,"5min":1.04,"15min":1.04},"last":0.91800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575965,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311996,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059844,"statfs":{"total":96636764160,"available":96317280256,"internally_reserved":0,"allocated":2674688,"data_stored":1424814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56799999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.432,"15min":0.44},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.58099999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"last":0.30499999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52700000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.37},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57099999999999995,"5min":0.72499999999999998,"15min":0.75800000000000001},"last":0.36199999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.58599999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60999999999999999,"5min":1.776,"15min":1.776},"last":0.41899999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.72399999999999998,"15min":0.70399999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.40500000000000003},"max":{"1min":1.0129999999999999,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.42699999999999999},"max":{"1min":0.86399999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.68400000000000005}]},{"osd":5,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67500000000000004,"15min":0.65900000000000003},"min":{"1min":0.435,"5min":0.39100000000000001,"15min":0.378},"max":{"1min":0.83399999999999996,"5min":3.766,"15min":3.766},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.877,"5min":0.98399999999999999,"15min":1.028},"last":0.67500000000000004}]},{"osd":6,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.52900000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94499999999999995,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.40699999999999997},"max":{"1min":0.85399999999999998,"5min":0.97799999999999998,"15min":1.0549999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.47599999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.107},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575966,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316072,"kb_used_data":2592,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055768,"statfs":{"total":96636764160,"available":96313106432,"internally_reserved":0,"allocated":2654208,"data_stored":1424044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.47499999999999998,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.27000000000000002,"15min":0.253},"max":{"1min":0.64000000000000001,"5min":8.5280000000000005,"15min":8.5280000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.26900000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69299999999999995,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.39900000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39800000000000002,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.34399999999999997,"5min":0.31,"15min":0.29499999999999998},"max":{"1min":0.66200000000000003,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.442}]},{"osd":3,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.621,"5min":0.65900000000000003,"15min":0.70099999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54600000000000004,"15min":0.495},"min":{"1min":0.376,"5min":0.32500000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":8.7200000000000006,"15min":8.7200000000000006},"last":0.379}]},{"osd":4,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.70799999999999996,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89500000000000002,"5min":8.5890000000000004,"15min":8.5890000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64100000000000001,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88800000000000001,"5min":0.97199999999999998,"15min":0.98399999999999999},"last":0.82099999999999995}]},{"osd":5,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.66600000000000004},"min":{"1min":0.442,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85399999999999998,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.74299999999999999,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94699999999999995,"5min":8.625,"15min":8.625},"last":0.72499999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.52200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.89400000000000002,"5min":1.0269999999999999,"15min":1.113},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67700000000000005,"15min":0.70199999999999996},"min":{"1min":0.47299999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.0660000000000001},"last":0.73499999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69099999999999995,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93500000000000005,"5min":0.995,"15min":1.0680000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.71399999999999997},"min":{"1min":0.505,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91200000000000003,"5min":1.089,"15min":1.1499999999999999},"last":0.77600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575967,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311980,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059860,"statfs":{"total":96636764160,"available":96317296640,"internally_reserved":0,"allocated":2658304,"data_stored":1424134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.40000000000000002,"15min":0.40100000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26100000000000001},"max":{"1min":0.51700000000000002,"5min":0.624,"15min":0.65100000000000002},"last":0.311},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40699999999999997,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.56299999999999994,"5min":0.64400000000000002,"15min":0.65800000000000003},"last":0.52000000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.41499999999999998,"15min":0.42099999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.33700000000000002,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":0.59899999999999998,"5min":0.67100000000000004,"15min":0.76600000000000001},"last":0.45200000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47099999999999997,"15min":0.47399999999999998},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.308},"max":{"1min":0.58699999999999997,"5min":0.69699999999999995,"15min":0.72299999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.51100000000000001,"15min":0.51400000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64100000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40400000000000003}]},{"osd":4,"last update":"Wed Nov 15 02:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.64600000000000002,"15min":0.65200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":0.79200000000000004,"5min":0.90100000000000002,"15min":1.0149999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.65000000000000002,"15min":0.66100000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90700000000000003,"5min":1.04,"15min":1.04},"last":0.94199999999999995}]},{"osd":5,"last update":"Wed Nov 15 02:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.68000000000000005,"15min":0.68300000000000005},"min":{"1min":0.436,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80900000000000005,"5min":1.0569999999999999,"15min":1.1100000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.44800000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Wed Nov 15 02:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68200000000000005,"15min":0.68700000000000006},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.40999999999999998},"max":{"1min":0.90100000000000002,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.873,"5min":1.0069999999999999,"15min":1.0720000000000001},"last":0.69199999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.70399999999999996,"15min":0.71099999999999997},"min":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79300000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94399999999999995,"5min":0.97999999999999998,"15min":1.071},"last":0.88400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575965,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303796,"kb_used_data":2604,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068044,"statfs":{"total":96636764160,"available":96325677056,"internally_reserved":0,"allocated":2666496,"data_stored":1424722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.47099999999999997,"5min":0.38500000000000001,"15min":0.28299999999999997},"max":{"1min":0.79600000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.45200000000000001,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.79000000000000004,"15min":0.97199999999999998},"last":0.51500000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.442,"5min":0.41099999999999998,"15min":0.34999999999999998},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.89900000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.33600000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.88700000000000001},"last":0.443}]},{"osd":2,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.48199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.5},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.48999999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38300000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.83099999999999996},"last":0.45700000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.31,"15min":0.28100000000000003},"max":{"1min":0.69399999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.373},{"interface":"front","average":{"1min":0.496,"5min":0.502,"15min":0.497},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.315},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.76200000000000001},"last":0.47399999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34899999999999998,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.755,"5min":0.76500000000000001,"15min":0.79100000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56599999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.81799999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.34200000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.58199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575965,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307896,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063944,"statfs":{"total":96636764160,"available":96321478656,"internally_reserved":0,"allocated":2670592,"data_stored":1424780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.36599999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.80700000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.78700000000000003,"15min":0.86899999999999999},"last":0.69699999999999995}]},{"osd":1,"last update":"Wed Nov 15 02:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72599999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60099999999999998,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39500000000000002,"15min":0.33300000000000002},"max":{"1min":0.77300000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57799999999999996}]},{"osd":2,"last update":"Wed Nov 15 02:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76200000000000001,"5min":0.876,"15min":0.90000000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.81100000000000005},"last":0.63300000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60599999999999998,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.749,"5min":0.77000000000000002,"15min":0.78700000000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60799999999999998,"15min":0.59899999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.34399999999999997},"max":{"1min":0.80500000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51100000000000001}]},{"osd":4,"last update":"Wed Nov 15 02:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.33000000000000002,"5min":0.308,"15min":0.27900000000000003},"max":{"1min":0.63100000000000001,"5min":0.70099999999999996,"15min":0.751},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.43099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.76800000000000002,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.64300000000000002}]},{"osd":6,"last update":"Wed Nov 15 02:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.47999999999999998,"15min":0.47699999999999998},"min":{"1min":0.33700000000000002,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.67300000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32900000000000001,"5min":0.313,"15min":0.312},"max":{"1min":0.74299999999999999,"5min":0.753,"15min":0.75600000000000001},"last":0.52000000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.503,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.68300000000000005,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.45000000000000001,"5min":0.40799999999999997,"15min":0.35199999999999998},"max":{"1min":0.75700000000000001,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:55:25.640 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:55:25.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.790+0000 7f9a141a7700 1 Processor -- start 2023-11-15T02:55:25.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.790+0000 7f9a141a7700 1 -- start start 2023-11-15T02:55:25.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a141a7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a0c0ab1a0 0x7f9a0c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a141a7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9a0c0aa060 0x7f9a0c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a141a7700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c0c06f0 con 0x7f9a0c154150 2023-11-15T02:55:25.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a141a7700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0c0c09d0 con 0x7f9a0c0aa060 2023-11-15T02:55:25.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a141a7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c158820 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a12744700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9a0c0aa060 0x7f9a0c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a11742700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a0c0ab1a0 0x7f9a0c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a11f43700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f9a0c154150 0x7f9a0c158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:53684/0 (socket says 172.21.15.1:53684) 2023-11-15T02:55:25.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a12744700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9a0c0aa060 0x7f9a0c0c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:49520/0 (socket says 172.21.15.1:49520) 2023-11-15T02:55:25.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a11f43700 1 -- 172.21.15.1:0/1830280841 learned_addr learned my addr 172.21.15.1:0/1830280841 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:25.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a11742700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a0c0ab1a0 0x7f9a0c154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:38398/0 (socket says 172.21.15.1:38398) 2023-11-15T02:55:25.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a10f41700 1 -- 172.21.15.1:0/1830280841 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359590904 0 0) 0x7f9a0c0c06f0 con 0x7f9a0c154150 2023-11-15T02:55:25.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a10f41700 1 -- 172.21.15.1:0/1830280841 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f40033f0 con 0x7f9a0c154150 2023-11-15T02:55:25.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a11742700 1 -- 172.21.15.1:0/1830280841 >> v2:172.21.15.141:3300/0 conn(0x7f9a0c0aa060 msgr2=0x7f9a0c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:25.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a11742700 1 --2- 172.21.15.1:0/1830280841 >> v2:172.21.15.141:3300/0 conn(0x7f9a0c0aa060 0x7f9a0c0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a11742700 1 -- 172.21.15.1:0/1830280841 >> v1:172.21.15.141:6789/0 conn(0x7f9a0c154150 legacy=0x7f9a0c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a11742700 1 -- 172.21.15.1:0/1830280841 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c158b00 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a12744700 1 --2- 172.21.15.1:0/1830280841 >> v2:172.21.15.141:3300/0 conn(0x7f9a0c0aa060 0x7f9a0c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:25.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.791+0000 7f9a11742700 1 --2- 172.21.15.1:0/1830280841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a0c0ab1a0 0x7f9a0c154530 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f9a00009760 tx=0x7f9a00009060).ready entity=mon.2 client_cookie=36fd3e567c1b0435 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:25.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.792+0000 7f9a10f41700 1 -- 172.21.15.1:0/1830280841 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a000090d0 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.792+0000 7f9a10f41700 1 -- 172.21.15.1:0/1830280841 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0000d4a0 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.792+0000 7f9a10f41700 1 -- 172.21.15.1:0/1830280841 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0000d820 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.792+0000 7f9a141a7700 1 -- 172.21.15.1:0/1830280841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a0c0ab1a0 msgr2=0x7f9a0c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.792+0000 7f9a141a7700 1 --2- 172.21.15.1:0/1830280841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a0c0ab1a0 0x7f9a0c154530 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f9a00009760 tx=0x7f9a00009060).stop 2023-11-15T02:55:25.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.792+0000 7f9a141a7700 1 -- 172.21.15.1:0/1830280841 shutdown_connections 2023-11-15T02:55:25.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.792+0000 7f9a141a7700 1 --2- 172.21.15.1:0/1830280841 >> v2:172.21.15.141:3300/0 conn(0x7f9a0c0aa060 0x7f9a0c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.792+0000 7f9a141a7700 1 --2- 172.21.15.1:0/1830280841 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a0c0ab1a0 0x7f9a0c154530 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.792+0000 7f9a141a7700 1 -- 172.21.15.1:0/1830280841 >> 172.21.15.1:0/1830280841 conn(0x7f9a0c064aa0 msgr2=0x7f9a0c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:25.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.792+0000 7f9a141a7700 1 -- 172.21.15.1:0/1830280841 shutdown_connections 2023-11-15T02:55:25.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.792+0000 7f9a141a7700 1 -- 172.21.15.1:0/1830280841 wait complete. 2023-11-15T02:55:25.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.793+0000 7f9a141a7700 1 Processor -- start 2023-11-15T02:55:25.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.793+0000 7f9a141a7700 1 -- start start 2023-11-15T02:55:25.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.794+0000 7f9a141a7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a0c0aa060 0x7f9a0c155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.794+0000 7f9a141a7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a0c0ab1a0 0x7f9a0c156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.794+0000 7f9a141a7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a0c154150 0x7f9a0c0c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.794+0000 7f9a141a7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c155ae0 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.794+0000 7f9a141a7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c155dc0 con 0x7f9a0c0aa060 2023-11-15T02:55:25.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.794+0000 7f9a141a7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c1560a0 con 0x7f9a0c154150 2023-11-15T02:55:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.794+0000 7f9a11742700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a0c0ab1a0 0x7f9a0c156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.794+0000 7f9a11742700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a0c0ab1a0 0x7f9a0c156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36414/0 (socket says 172.21.15.1:36414) 2023-11-15T02:55:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.794+0000 7f9a11742700 1 -- 172.21.15.1:0/2801146357 learned_addr learned my addr 172.21.15.1:0/2801146357 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.794+0000 7f9a12744700 1 --2- 172.21.15.1:0/2801146357 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a0c154150 0x7f9a0c0c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.794+0000 7f9a11f43700 1 --2- 172.21.15.1:0/2801146357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a0c0aa060 0x7f9a0c155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.795+0000 7f9a11742700 1 -- 172.21.15.1:0/2801146357 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a0c154150 msgr2=0x7f9a0c0c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.795+0000 7f9a11742700 1 --2- 172.21.15.1:0/2801146357 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a0c154150 0x7f9a0c0c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.795+0000 7f9a11742700 1 -- 172.21.15.1:0/2801146357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a0c0aa060 msgr2=0x7f9a0c155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.795+0000 7f9a11742700 1 --2- 172.21.15.1:0/2801146357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a0c0aa060 0x7f9a0c155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.795+0000 7f9a11742700 1 -- 172.21.15.1:0/2801146357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a040092a0 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.795+0000 7f9a11742700 1 --2- 172.21.15.1:0/2801146357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a0c0ab1a0 0x7f9a0c156b80 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7f9a00009d50 tx=0x7f9a00016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:25.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.795+0000 7f9a09ffb700 1 -- 172.21.15.1:0/2801146357 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a000117e0 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.795+0000 7f9a09ffb700 1 -- 172.21.15.1:0/2801146357 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a00011940 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.795+0000 7f9a09ffb700 1 -- 172.21.15.1:0/2801146357 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00011cc0 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.795+0000 7f9a141a7700 1 -- 172.21.15.1:0/2801146357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a000092a0 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.795+0000 7f9a141a7700 1 -- 172.21.15.1:0/2801146357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c156660 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.796+0000 7f9a141a7700 1 -- 172.21.15.1:0/2801146357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c06c7e0 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.796+0000 7f9a09ffb700 1 -- 172.21.15.1:0/2801146357 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9a0001d640 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.797+0000 7f9a09ffb700 1 --2- 172.21.15.1:0/2801146357 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f99f805f270 0x7f99f8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:25.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.797+0000 7f9a09ffb700 1 -- 172.21.15.1:0/2801146357 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6673+0+0 (secure 0 0 0) 0x7f9a0007b360 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.797+0000 7f9a11f43700 1 --2- 172.21.15.1:0/2801146357 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f99f805f270 0x7f99f8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:25.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.798+0000 7f9a11f43700 1 --2- 172.21.15.1:0/2801146357 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f99f805f270 0x7f99f8061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f99fc005ad0 tx=0x7f99fc009040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:25.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.801+0000 7f9a09ffb700 1 -- 172.21.15.1:0/2801146357 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9a0004c330 con 0x7f9a0c0ab1a0 2023-11-15T02:55:25.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.971+0000 7f9a141a7700 1 -- 172.21.15.1:0/2801146357 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a0c158de0 con 0x7f99f805f270 2023-11-15T02:55:25.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.981+0000 7f9a09ffb700 1 -- 172.21.15.1:0/2801146357 <== mgr.7898 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362216 (secure 0 0 0) 0x7f9a0c158de0 con 0x7f99f805f270 2023-11-15T02:55:25.986 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:25.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.984+0000 7f9a141a7700 1 -- 172.21.15.1:0/2801146357 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f99f805f270 msgr2=0x7f99f8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.984+0000 7f9a141a7700 1 --2- 172.21.15.1:0/2801146357 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f99f805f270 0x7f99f8061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f99fc005ad0 tx=0x7f99fc009040).stop 2023-11-15T02:55:25.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.984+0000 7f9a141a7700 1 -- 172.21.15.1:0/2801146357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a0c0ab1a0 msgr2=0x7f9a0c156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:25.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.984+0000 7f9a141a7700 1 --2- 172.21.15.1:0/2801146357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a0c0ab1a0 0x7f9a0c156b80 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7f9a00009d50 tx=0x7f9a00016000).stop 2023-11-15T02:55:25.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.984+0000 7f9a141a7700 1 -- 172.21.15.1:0/2801146357 shutdown_connections 2023-11-15T02:55:25.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.984+0000 7f9a141a7700 1 --2- 172.21.15.1:0/2801146357 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f99f805f270 0x7f99f8061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.984+0000 7f9a141a7700 1 --2- 172.21.15.1:0/2801146357 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a0c154150 0x7f9a0c0c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.984+0000 7f9a141a7700 1 --2- 172.21.15.1:0/2801146357 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a0c0aa060 0x7f9a0c155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.984+0000 7f9a141a7700 1 --2- 172.21.15.1:0/2801146357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a0c0ab1a0 0x7f9a0c156b80 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:25.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.984+0000 7f9a141a7700 1 -- 172.21.15.1:0/2801146357 >> 172.21.15.1:0/2801146357 conn(0x7f9a0c064aa0 msgr2=0x7f9a0c0ab580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:25.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.985+0000 7f9a141a7700 1 -- 172.21.15.1:0/2801146357 shutdown_connections 2023-11-15T02:55:25.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:25.985+0000 7f9a141a7700 1 -- 172.21.15.1:0/2801146357 wait complete. 2023-11-15T02:55:25.992 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:55:25.997 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-15T02:55:24.156537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2471296,"kb_used_data":20800,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752503424,"statfs":{"total":773094113280,"available":770563506176,"internally_reserved":0,"allocated":21299200,"data_stored":11396964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28932,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-81,"num_write_kb":-63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.009766"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.617734+0000","last_change":"2023-11-15T02:55:21.617218+0000","last_active":"2023-11-15T02:55:21.617734+0000","last_peered":"2023-11-15T02:55:21.617734+0000","last_clean":"2023-11-15T02:55:21.617734+0000","last_became_active":"2023-11-15T02:55:21.616872+0000","last_became_peered":"2023-11-15T02:55:21.616872+0000","last_unstale":"2023-11-15T02:55:21.617734+0000","last_undegraded":"2023-11-15T02:55:21.617734+0000","last_fullsized":"2023-11-15T02:55:21.617734+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3f","version":"211'3","reported_seq":13,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.621620+0000","last_change":"2023-11-15T02:55:21.221309+0000","last_active":"2023-11-15T02:55:21.621620+0000","last_peered":"2023-11-15T02:55:21.621620+0000","last_clean":"2023-11-15T02:55:21.621620+0000","last_became_active":"2023-11-15T02:55:21.220936+0000","last_became_peered":"2023-11-15T02:55:21.220936+0000","last_unstale":"2023-11-15T02:55:21.621620+0000","last_undegraded":"2023-11-15T02:55:21.621620+0000","last_fullsized":"2023-11-15T02:55:21.621620+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.618438+0000","last_change":"2023-11-15T02:55:21.609606+0000","last_active":"2023-11-15T02:55:21.618438+0000","last_peered":"2023-11-15T02:55:21.618438+0000","last_clean":"2023-11-15T02:55:21.618438+0000","last_became_active":"2023-11-15T02:55:21.608454+0000","last_became_peered":"2023-11-15T02:55:21.608454+0000","last_unstale":"2023-11-15T02:55:21.618438+0000","last_undegraded":"2023-11-15T02:55:21.618438+0000","last_fullsized":"2023-11-15T02:55:21.618438+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601547+0000","last_change":"2023-11-15T02:55:21.219687+0000","last_active":"2023-11-15T02:55:21.601547+0000","last_peered":"2023-11-15T02:55:21.601547+0000","last_clean":"2023-11-15T02:55:21.601547+0000","last_became_active":"2023-11-15T02:55:21.219355+0000","last_became_peered":"2023-11-15T02:55:21.219355+0000","last_unstale":"2023-11-15T02:55:21.601547+0000","last_undegraded":"2023-11-15T02:55:21.601547+0000","last_fullsized":"2023-11-15T02:55:21.601547+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616494+0000","last_change":"2023-11-15T02:55:21.615570+0000","last_active":"2023-11-15T02:55:21.616494+0000","last_peered":"2023-11-15T02:55:21.616494+0000","last_clean":"2023-11-15T02:55:21.616494+0000","last_became_active":"2023-11-15T02:55:21.615302+0000","last_became_peered":"2023-11-15T02:55:21.615302+0000","last_unstale":"2023-11-15T02:55:21.616494+0000","last_undegraded":"2023-11-15T02:55:21.616494+0000","last_fullsized":"2023-11-15T02:55:21.616494+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.600659+0000","last_change":"2023-11-15T02:55:21.216817+0000","last_active":"2023-11-15T02:55:21.600659+0000","last_peered":"2023-11-15T02:55:21.600659+0000","last_clean":"2023-11-15T02:55:21.600659+0000","last_became_active":"2023-11-15T02:55:21.216544+0000","last_became_peered":"2023-11-15T02:55:21.216544+0000","last_unstale":"2023-11-15T02:55:21.600659+0000","last_undegraded":"2023-11-15T02:55:21.600659+0000","last_fullsized":"2023-11-15T02:55:21.600659+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.620397+0000","last_change":"2023-11-15T02:55:21.619714+0000","last_active":"2023-11-15T02:55:21.620397+0000","last_peered":"2023-11-15T02:55:21.620397+0000","last_clean":"2023-11-15T02:55:21.620397+0000","last_became_active":"2023-11-15T02:55:21.619413+0000","last_became_peered":"2023-11-15T02:55:21.619413+0000","last_unstale":"2023-11-15T02:55:21.620397+0000","last_undegraded":"2023-11-15T02:55:21.620397+0000","last_fullsized":"2023-11-15T02:55:21.620397+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.618234+0000","last_change":"2023-11-15T02:55:21.216951+0000","last_active":"2023-11-15T02:55:21.618234+0000","last_peered":"2023-11-15T02:55:21.618234+0000","last_clean":"2023-11-15T02:55:21.618234+0000","last_became_active":"2023-11-15T02:55:21.216663+0000","last_became_peered":"2023-11-15T02:55:21.216663+0000","last_unstale":"2023-11-15T02:55:21.618234+0000","last_undegraded":"2023-11-15T02:55:21.618234+0000","last_fullsized":"2023-11-15T02:55:21.618234+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.621503+0000","last_change":"2023-11-15T02:55:21.618620+0000","last_active":"2023-11-15T02:55:21.621503+0000","last_peered":"2023-11-15T02:55:21.621503+0000","last_clean":"2023-11-15T02:55:21.621503+0000","last_became_active":"2023-11-15T02:55:21.618289+0000","last_became_peered":"2023-11-15T02:55:21.618289+0000","last_unstale":"2023-11-15T02:55:21.621503+0000","last_undegraded":"2023-11-15T02:55:21.621503+0000","last_fullsized":"2023-11-15T02:55:21.621503+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3b","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614815+0000","last_change":"2023-11-15T02:55:21.217154+0000","last_active":"2023-11-15T02:55:21.614815+0000","last_peered":"2023-11-15T02:55:21.614815+0000","last_clean":"2023-11-15T02:55:21.614815+0000","last_became_active":"2023-11-15T02:55:21.216522+0000","last_became_peered":"2023-11-15T02:55:21.216522+0000","last_unstale":"2023-11-15T02:55:21.614815+0000","last_undegraded":"2023-11-15T02:55:21.614815+0000","last_fullsized":"2023-11-15T02:55:21.614815+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.619725+0000","last_change":"2023-11-15T02:55:21.619114+0000","last_active":"2023-11-15T02:55:21.619725+0000","last_peered":"2023-11-15T02:55:21.619725+0000","last_clean":"2023-11-15T02:55:21.619725+0000","last_became_active":"2023-11-15T02:55:21.618826+0000","last_became_peered":"2023-11-15T02:55:21.618826+0000","last_unstale":"2023-11-15T02:55:21.619725+0000","last_undegraded":"2023-11-15T02:55:21.619725+0000","last_fullsized":"2023-11-15T02:55:21.619725+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.618303+0000","last_change":"2023-11-15T02:55:21.224197+0000","last_active":"2023-11-15T02:55:21.618303+0000","last_peered":"2023-11-15T02:55:21.618303+0000","last_clean":"2023-11-15T02:55:21.618303+0000","last_became_active":"2023-11-15T02:55:21.223929+0000","last_became_peered":"2023-11-15T02:55:21.223929+0000","last_unstale":"2023-11-15T02:55:21.618303+0000","last_undegraded":"2023-11-15T02:55:21.618303+0000","last_fullsized":"2023-11-15T02:55:21.618303+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610647+0000","last_change":"2023-11-15T02:55:21.606881+0000","last_active":"2023-11-15T02:55:21.610647+0000","last_peered":"2023-11-15T02:55:21.610647+0000","last_clean":"2023-11-15T02:55:21.610647+0000","last_became_active":"2023-11-15T02:55:21.606608+0000","last_became_peered":"2023-11-15T02:55:21.606608+0000","last_unstale":"2023-11-15T02:55:21.610647+0000","last_undegraded":"2023-11-15T02:55:21.610647+0000","last_fullsized":"2023-11-15T02:55:21.610647+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.603759+0000","last_change":"2023-11-15T02:55:21.221639+0000","last_active":"2023-11-15T02:55:21.603759+0000","last_peered":"2023-11-15T02:55:21.603759+0000","last_clean":"2023-11-15T02:55:21.603759+0000","last_became_active":"2023-11-15T02:55:21.221361+0000","last_became_peered":"2023-11-15T02:55:21.221361+0000","last_unstale":"2023-11-15T02:55:21.603759+0000","last_undegraded":"2023-11-15T02:55:21.603759+0000","last_fullsized":"2023-11-15T02:55:21.603759+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616608+0000","last_change":"2023-11-15T02:55:21.613497+0000","last_active":"2023-11-15T02:55:21.616608+0000","last_peered":"2023-11-15T02:55:21.616608+0000","last_clean":"2023-11-15T02:55:21.616608+0000","last_became_active":"2023-11-15T02:55:21.613201+0000","last_became_peered":"2023-11-15T02:55:21.613201+0000","last_unstale":"2023-11-15T02:55:21.616608+0000","last_undegraded":"2023-11-15T02:55:21.616608+0000","last_fullsized":"2023-11-15T02:55:21.616608+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.596247+0000","last_change":"2023-11-15T02:55:21.222138+0000","last_active":"2023-11-15T02:55:21.596247+0000","last_peered":"2023-11-15T02:55:21.596247+0000","last_clean":"2023-11-15T02:55:21.596247+0000","last_became_active":"2023-11-15T02:55:21.221823+0000","last_became_peered":"2023-11-15T02:55:21.221823+0000","last_unstale":"2023-11-15T02:55:21.596247+0000","last_undegraded":"2023-11-15T02:55:21.596247+0000","last_fullsized":"2023-11-15T02:55:21.596247+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.621627+0000","last_change":"2023-11-15T02:55:21.621029+0000","last_active":"2023-11-15T02:55:21.621627+0000","last_peered":"2023-11-15T02:55:21.621627+0000","last_clean":"2023-11-15T02:55:21.621627+0000","last_became_active":"2023-11-15T02:55:21.620734+0000","last_became_peered":"2023-11-15T02:55:21.620734+0000","last_unstale":"2023-11-15T02:55:21.621627+0000","last_undegraded":"2023-11-15T02:55:21.621627+0000","last_fullsized":"2023-11-15T02:55:21.621627+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.599450+0000","last_change":"2023-11-15T02:55:21.211916+0000","last_active":"2023-11-15T02:55:21.599450+0000","last_peered":"2023-11-15T02:55:21.599450+0000","last_clean":"2023-11-15T02:55:21.599450+0000","last_became_active":"2023-11-15T02:55:21.211605+0000","last_became_peered":"2023-11-15T02:55:21.211605+0000","last_unstale":"2023-11-15T02:55:21.599450+0000","last_undegraded":"2023-11-15T02:55:21.599450+0000","last_fullsized":"2023-11-15T02:55:21.599450+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613510+0000","last_change":"2023-11-15T02:55:21.612429+0000","last_active":"2023-11-15T02:55:21.613510+0000","last_peered":"2023-11-15T02:55:21.613510+0000","last_clean":"2023-11-15T02:55:21.613510+0000","last_became_active":"2023-11-15T02:55:21.612111+0000","last_became_peered":"2023-11-15T02:55:21.612111+0000","last_unstale":"2023-11-15T02:55:21.613510+0000","last_undegraded":"2023-11-15T02:55:21.613510+0000","last_fullsized":"2023-11-15T02:55:21.613510+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.598723+0000","last_change":"2023-11-15T02:55:21.212267+0000","last_active":"2023-11-15T02:55:21.598723+0000","last_peered":"2023-11-15T02:55:21.598723+0000","last_clean":"2023-11-15T02:55:21.598723+0000","last_became_active":"2023-11-15T02:55:21.212026+0000","last_became_peered":"2023-11-15T02:55:21.212026+0000","last_unstale":"2023-11-15T02:55:21.598723+0000","last_undegraded":"2023-11-15T02:55:21.598723+0000","last_fullsized":"2023-11-15T02:55:21.598723+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.612312+0000","last_change":"2023-11-15T02:55:21.611558+0000","last_active":"2023-11-15T02:55:21.612312+0000","last_peered":"2023-11-15T02:55:21.612312+0000","last_clean":"2023-11-15T02:55:21.612312+0000","last_became_active":"2023-11-15T02:55:21.611255+0000","last_became_peered":"2023-11-15T02:55:21.611255+0000","last_unstale":"2023-11-15T02:55:21.612312+0000","last_undegraded":"2023-11-15T02:55:21.612312+0000","last_fullsized":"2023-11-15T02:55:21.612312+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.604960+0000","last_change":"2023-11-15T02:55:21.221986+0000","last_active":"2023-11-15T02:55:21.604960+0000","last_peered":"2023-11-15T02:55:21.604960+0000","last_clean":"2023-11-15T02:55:21.604960+0000","last_became_active":"2023-11-15T02:55:21.221655+0000","last_became_peered":"2023-11-15T02:55:21.221655+0000","last_unstale":"2023-11-15T02:55:21.604960+0000","last_undegraded":"2023-11-15T02:55:21.604960+0000","last_fullsized":"2023-11-15T02:55:21.604960+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615784+0000","last_change":"2023-11-15T02:55:21.614212+0000","last_active":"2023-11-15T02:55:21.615784+0000","last_peered":"2023-11-15T02:55:21.615784+0000","last_clean":"2023-11-15T02:55:21.615784+0000","last_became_active":"2023-11-15T02:55:21.613901+0000","last_became_peered":"2023-11-15T02:55:21.613901+0000","last_unstale":"2023-11-15T02:55:21.615784+0000","last_undegraded":"2023-11-15T02:55:21.615784+0000","last_fullsized":"2023-11-15T02:55:21.615784+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"211'4","reported_seq":14,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.627969+0000","last_change":"2023-11-15T02:55:21.218597+0000","last_active":"2023-11-15T02:55:21.627969+0000","last_peered":"2023-11-15T02:55:21.627969+0000","last_clean":"2023-11-15T02:55:21.627969+0000","last_became_active":"2023-11-15T02:55:21.218325+0000","last_became_peered":"2023-11-15T02:55:21.218325+0000","last_unstale":"2023-11-15T02:55:21.627969+0000","last_undegraded":"2023-11-15T02:55:21.627969+0000","last_fullsized":"2023-11-15T02:55:21.627969+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616596+0000","last_change":"2023-11-15T02:55:21.613984+0000","last_active":"2023-11-15T02:55:21.616596+0000","last_peered":"2023-11-15T02:55:21.616596+0000","last_clean":"2023-11-15T02:55:21.616596+0000","last_became_active":"2023-11-15T02:55:21.613711+0000","last_became_peered":"2023-11-15T02:55:21.613711+0000","last_unstale":"2023-11-15T02:55:21.616596+0000","last_undegraded":"2023-11-15T02:55:21.616596+0000","last_fullsized":"2023-11-15T02:55:21.616596+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616477+0000","last_change":"2023-11-15T02:55:21.225819+0000","last_active":"2023-11-15T02:55:21.616477+0000","last_peered":"2023-11-15T02:55:21.616477+0000","last_clean":"2023-11-15T02:55:21.616477+0000","last_became_active":"2023-11-15T02:55:21.225546+0000","last_became_peered":"2023-11-15T02:55:21.225546+0000","last_unstale":"2023-11-15T02:55:21.616477+0000","last_undegraded":"2023-11-15T02:55:21.616477+0000","last_fullsized":"2023-11-15T02:55:21.616477+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613907+0000","last_change":"2023-11-15T02:55:21.611452+0000","last_active":"2023-11-15T02:55:21.613907+0000","last_peered":"2023-11-15T02:55:21.613907+0000","last_clean":"2023-11-15T02:55:21.613907+0000","last_became_active":"2023-11-15T02:55:21.611189+0000","last_became_peered":"2023-11-15T02:55:21.611189+0000","last_unstale":"2023-11-15T02:55:21.613907+0000","last_undegraded":"2023-11-15T02:55:21.613907+0000","last_fullsized":"2023-11-15T02:55:21.613907+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601849+0000","last_change":"2023-11-15T02:55:21.216276+0000","last_active":"2023-11-15T02:55:21.601849+0000","last_peered":"2023-11-15T02:55:21.601849+0000","last_clean":"2023-11-15T02:55:21.601849+0000","last_became_active":"2023-11-15T02:55:21.215991+0000","last_became_peered":"2023-11-15T02:55:21.215991+0000","last_unstale":"2023-11-15T02:55:21.601849+0000","last_undegraded":"2023-11-15T02:55:21.601849+0000","last_fullsized":"2023-11-15T02:55:21.601849+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.605418+0000","last_change":"2023-11-15T02:55:21.601149+0000","last_active":"2023-11-15T02:55:21.605418+0000","last_peered":"2023-11-15T02:55:21.605418+0000","last_clean":"2023-11-15T02:55:21.605418+0000","last_became_active":"2023-11-15T02:55:21.600856+0000","last_became_peered":"2023-11-15T02:55:21.600856+0000","last_unstale":"2023-11-15T02:55:21.605418+0000","last_undegraded":"2023-11-15T02:55:21.605418+0000","last_fullsized":"2023-11-15T02:55:21.605418+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.603980+0000","last_change":"2023-11-15T02:55:21.219528+0000","last_active":"2023-11-15T02:55:21.603980+0000","last_peered":"2023-11-15T02:55:21.603980+0000","last_clean":"2023-11-15T02:55:21.603980+0000","last_became_active":"2023-11-15T02:55:21.219238+0000","last_became_peered":"2023-11-15T02:55:21.219238+0000","last_unstale":"2023-11-15T02:55:21.603980+0000","last_undegraded":"2023-11-15T02:55:21.603980+0000","last_fullsized":"2023-11-15T02:55:21.603980+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.619571+0000","last_change":"2023-11-15T02:55:21.615078+0000","last_active":"2023-11-15T02:55:21.619571+0000","last_peered":"2023-11-15T02:55:21.619571+0000","last_clean":"2023-11-15T02:55:21.619571+0000","last_became_active":"2023-11-15T02:55:21.614308+0000","last_became_peered":"2023-11-15T02:55:21.614308+0000","last_unstale":"2023-11-15T02:55:21.619571+0000","last_undegraded":"2023-11-15T02:55:21.619571+0000","last_fullsized":"2023-11-15T02:55:21.619571+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.30","version":"211'4","reported_seq":14,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616531+0000","last_change":"2023-11-15T02:55:21.213072+0000","last_active":"2023-11-15T02:55:21.616531+0000","last_peered":"2023-11-15T02:55:21.616531+0000","last_clean":"2023-11-15T02:55:21.616531+0000","last_became_active":"2023-11-15T02:55:21.212729+0000","last_became_peered":"2023-11-15T02:55:21.212729+0000","last_unstale":"2023-11-15T02:55:21.616531+0000","last_undegraded":"2023-11-15T02:55:21.616531+0000","last_fullsized":"2023-11-15T02:55:21.616531+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.620579+0000","last_change":"2023-11-15T02:55:21.619554+0000","last_active":"2023-11-15T02:55:21.620579+0000","last_peered":"2023-11-15T02:55:21.620579+0000","last_clean":"2023-11-15T02:55:21.620579+0000","last_became_active":"2023-11-15T02:55:21.619271+0000","last_became_peered":"2023-11-15T02:55:21.619271+0000","last_unstale":"2023-11-15T02:55:21.620579+0000","last_undegraded":"2023-11-15T02:55:21.620579+0000","last_fullsized":"2023-11-15T02:55:21.620579+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.592674+0000","last_change":"2023-11-15T02:55:21.227855+0000","last_active":"2023-11-15T02:55:21.592674+0000","last_peered":"2023-11-15T02:55:21.592674+0000","last_clean":"2023-11-15T02:55:21.592674+0000","last_became_active":"2023-11-15T02:55:21.227460+0000","last_became_peered":"2023-11-15T02:55:21.227460+0000","last_unstale":"2023-11-15T02:55:21.592674+0000","last_undegraded":"2023-11-15T02:55:21.592674+0000","last_fullsized":"2023-11-15T02:55:21.592674+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613874+0000","last_change":"2023-11-15T02:55:21.607637+0000","last_active":"2023-11-15T02:55:21.613874+0000","last_peered":"2023-11-15T02:55:21.613874+0000","last_clean":"2023-11-15T02:55:21.613874+0000","last_became_active":"2023-11-15T02:55:21.607353+0000","last_became_peered":"2023-11-15T02:55:21.607353+0000","last_unstale":"2023-11-15T02:55:21.613874+0000","last_undegraded":"2023-11-15T02:55:21.613874+0000","last_fullsized":"2023-11-15T02:55:21.613874+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.612115+0000","last_change":"2023-11-15T02:55:21.218165+0000","last_active":"2023-11-15T02:55:21.612115+0000","last_peered":"2023-11-15T02:55:21.612115+0000","last_clean":"2023-11-15T02:55:21.612115+0000","last_became_active":"2023-11-15T02:55:21.217817+0000","last_became_peered":"2023-11-15T02:55:21.217817+0000","last_unstale":"2023-11-15T02:55:21.612115+0000","last_undegraded":"2023-11-15T02:55:21.612115+0000","last_fullsized":"2023-11-15T02:55:21.612115+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614719+0000","last_change":"2023-11-15T02:55:21.610702+0000","last_active":"2023-11-15T02:55:21.614719+0000","last_peered":"2023-11-15T02:55:21.614719+0000","last_clean":"2023-11-15T02:55:21.614719+0000","last_became_active":"2023-11-15T02:55:21.610432+0000","last_became_peered":"2023-11-15T02:55:21.610432+0000","last_unstale":"2023-11-15T02:55:21.614719+0000","last_undegraded":"2023-11-15T02:55:21.614719+0000","last_fullsized":"2023-11-15T02:55:21.614719+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2d","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615435+0000","last_change":"2023-11-15T02:55:21.212329+0000","last_active":"2023-11-15T02:55:21.615435+0000","last_peered":"2023-11-15T02:55:21.615435+0000","last_clean":"2023-11-15T02:55:21.615435+0000","last_became_active":"2023-11-15T02:55:21.212012+0000","last_became_peered":"2023-11-15T02:55:21.212012+0000","last_unstale":"2023-11-15T02:55:21.615435+0000","last_undegraded":"2023-11-15T02:55:21.615435+0000","last_fullsized":"2023-11-15T02:55:21.615435+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.620296+0000","last_change":"2023-11-15T02:55:21.619265+0000","last_active":"2023-11-15T02:55:21.620296+0000","last_peered":"2023-11-15T02:55:21.620296+0000","last_clean":"2023-11-15T02:55:21.620296+0000","last_became_active":"2023-11-15T02:55:21.618971+0000","last_became_peered":"2023-11-15T02:55:21.618971+0000","last_unstale":"2023-11-15T02:55:21.620296+0000","last_undegraded":"2023-11-15T02:55:21.620296+0000","last_fullsized":"2023-11-15T02:55:21.620296+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.592503+0000","last_change":"2023-11-15T02:55:21.227686+0000","last_active":"2023-11-15T02:55:21.592503+0000","last_peered":"2023-11-15T02:55:21.592503+0000","last_clean":"2023-11-15T02:55:21.592503+0000","last_became_active":"2023-11-15T02:55:21.227351+0000","last_became_peered":"2023-11-15T02:55:21.227351+0000","last_unstale":"2023-11-15T02:55:21.592503+0000","last_undegraded":"2023-11-15T02:55:21.592503+0000","last_fullsized":"2023-11-15T02:55:21.592503+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.620181+0000","last_change":"2023-11-15T02:55:21.619366+0000","last_active":"2023-11-15T02:55:21.620181+0000","last_peered":"2023-11-15T02:55:21.620181+0000","last_clean":"2023-11-15T02:55:21.620181+0000","last_became_active":"2023-11-15T02:55:21.618900+0000","last_became_peered":"2023-11-15T02:55:21.618900+0000","last_unstale":"2023-11-15T02:55:21.620181+0000","last_undegraded":"2023-11-15T02:55:21.620181+0000","last_fullsized":"2023-11-15T02:55:21.620181+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2b","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614932+0000","last_change":"2023-11-15T02:55:21.217331+0000","last_active":"2023-11-15T02:55:21.614932+0000","last_peered":"2023-11-15T02:55:21.614932+0000","last_clean":"2023-11-15T02:55:21.614932+0000","last_became_active":"2023-11-15T02:55:21.216887+0000","last_became_peered":"2023-11-15T02:55:21.216887+0000","last_unstale":"2023-11-15T02:55:21.614932+0000","last_undegraded":"2023-11-15T02:55:21.614932+0000","last_fullsized":"2023-11-15T02:55:21.614932+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.622414+0000","last_change":"2023-11-15T02:55:21.618728+0000","last_active":"2023-11-15T02:55:21.622414+0000","last_peered":"2023-11-15T02:55:21.622414+0000","last_clean":"2023-11-15T02:55:21.622414+0000","last_became_active":"2023-11-15T02:55:21.618254+0000","last_became_peered":"2023-11-15T02:55:21.618254+0000","last_unstale":"2023-11-15T02:55:21.622414+0000","last_undegraded":"2023-11-15T02:55:21.622414+0000","last_fullsized":"2023-11-15T02:55:21.622414+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.600687+0000","last_change":"2023-11-15T02:55:21.210719+0000","last_active":"2023-11-15T02:55:21.600687+0000","last_peered":"2023-11-15T02:55:21.600687+0000","last_clean":"2023-11-15T02:55:21.600687+0000","last_became_active":"2023-11-15T02:55:21.210410+0000","last_became_peered":"2023-11-15T02:55:21.210410+0000","last_unstale":"2023-11-15T02:55:21.600687+0000","last_undegraded":"2023-11-15T02:55:21.600687+0000","last_fullsized":"2023-11-15T02:55:21.600687+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613993+0000","last_change":"2023-11-15T02:55:21.609012+0000","last_active":"2023-11-15T02:55:21.613993+0000","last_peered":"2023-11-15T02:55:21.613993+0000","last_clean":"2023-11-15T02:55:21.613993+0000","last_became_active":"2023-11-15T02:55:21.608529+0000","last_became_peered":"2023-11-15T02:55:21.608529+0000","last_unstale":"2023-11-15T02:55:21.613993+0000","last_undegraded":"2023-11-15T02:55:21.613993+0000","last_fullsized":"2023-11-15T02:55:21.613993+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.602085+0000","last_change":"2023-11-15T02:55:21.221985+0000","last_active":"2023-11-15T02:55:21.602085+0000","last_peered":"2023-11-15T02:55:21.602085+0000","last_clean":"2023-11-15T02:55:21.602085+0000","last_became_active":"2023-11-15T02:55:21.220880+0000","last_became_peered":"2023-11-15T02:55:21.220880+0000","last_unstale":"2023-11-15T02:55:21.602085+0000","last_undegraded":"2023-11-15T02:55:21.602085+0000","last_fullsized":"2023-11-15T02:55:21.602085+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614153+0000","last_change":"2023-11-15T02:55:21.610227+0000","last_active":"2023-11-15T02:55:21.614153+0000","last_peered":"2023-11-15T02:55:21.614153+0000","last_clean":"2023-11-15T02:55:21.614153+0000","last_became_active":"2023-11-15T02:55:21.608882+0000","last_became_peered":"2023-11-15T02:55:21.608882+0000","last_unstale":"2023-11-15T02:55:21.614153+0000","last_undegraded":"2023-11-15T02:55:21.614153+0000","last_fullsized":"2023-11-15T02:55:21.614153+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.596464+0000","last_change":"2023-11-15T02:55:21.215727+0000","last_active":"2023-11-15T02:55:21.596464+0000","last_peered":"2023-11-15T02:55:21.596464+0000","last_clean":"2023-11-15T02:55:21.596464+0000","last_became_active":"2023-11-15T02:55:21.215449+0000","last_became_peered":"2023-11-15T02:55:21.215449+0000","last_unstale":"2023-11-15T02:55:21.596464+0000","last_undegraded":"2023-11-15T02:55:21.596464+0000","last_fullsized":"2023-11-15T02:55:21.596464+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616548+0000","last_change":"2023-11-15T02:55:21.613647+0000","last_active":"2023-11-15T02:55:21.616548+0000","last_peered":"2023-11-15T02:55:21.616548+0000","last_clean":"2023-11-15T02:55:21.616548+0000","last_became_active":"2023-11-15T02:55:21.613368+0000","last_became_peered":"2023-11-15T02:55:21.613368+0000","last_unstale":"2023-11-15T02:55:21.616548+0000","last_undegraded":"2023-11-15T02:55:21.616548+0000","last_fullsized":"2023-11-15T02:55:21.616548+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.605043+0000","last_change":"2023-11-15T02:55:21.214345+0000","last_active":"2023-11-15T02:55:21.605043+0000","last_peered":"2023-11-15T02:55:21.605043+0000","last_clean":"2023-11-15T02:55:21.605043+0000","last_became_active":"2023-11-15T02:55:21.214054+0000","last_became_peered":"2023-11-15T02:55:21.214054+0000","last_unstale":"2023-11-15T02:55:21.605043+0000","last_undegraded":"2023-11-15T02:55:21.605043+0000","last_fullsized":"2023-11-15T02:55:21.605043+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.624947+0000","last_change":"2023-11-15T02:55:21.620201+0000","last_active":"2023-11-15T02:55:21.624947+0000","last_peered":"2023-11-15T02:55:21.624947+0000","last_clean":"2023-11-15T02:55:21.624947+0000","last_became_active":"2023-11-15T02:55:21.619889+0000","last_became_peered":"2023-11-15T02:55:21.619889+0000","last_unstale":"2023-11-15T02:55:21.624947+0000","last_undegraded":"2023-11-15T02:55:21.624947+0000","last_fullsized":"2023-11-15T02:55:21.624947+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610196+0000","last_change":"2023-11-15T02:55:21.221519+0000","last_active":"2023-11-15T02:55:21.610196+0000","last_peered":"2023-11-15T02:55:21.610196+0000","last_clean":"2023-11-15T02:55:21.610196+0000","last_became_active":"2023-11-15T02:55:21.221288+0000","last_became_peered":"2023-11-15T02:55:21.221288+0000","last_unstale":"2023-11-15T02:55:21.610196+0000","last_undegraded":"2023-11-15T02:55:21.610196+0000","last_fullsized":"2023-11-15T02:55:21.610196+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615452+0000","last_change":"2023-11-15T02:55:21.614053+0000","last_active":"2023-11-15T02:55:21.615452+0000","last_peered":"2023-11-15T02:55:21.615452+0000","last_clean":"2023-11-15T02:55:21.615452+0000","last_became_active":"2023-11-15T02:55:21.613748+0000","last_became_peered":"2023-11-15T02:55:21.613748+0000","last_unstale":"2023-11-15T02:55:21.615452+0000","last_undegraded":"2023-11-15T02:55:21.615452+0000","last_fullsized":"2023-11-15T02:55:21.615452+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.600764+0000","last_change":"2023-11-15T02:55:21.220650+0000","last_active":"2023-11-15T02:55:21.600764+0000","last_peered":"2023-11-15T02:55:21.600764+0000","last_clean":"2023-11-15T02:55:21.600764+0000","last_became_active":"2023-11-15T02:55:21.220333+0000","last_became_peered":"2023-11-15T02:55:21.220333+0000","last_unstale":"2023-11-15T02:55:21.600764+0000","last_undegraded":"2023-11-15T02:55:21.600764+0000","last_fullsized":"2023-11-15T02:55:21.600764+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.606066+0000","last_change":"2023-11-15T02:55:21.605181+0000","last_active":"2023-11-15T02:55:21.606066+0000","last_peered":"2023-11-15T02:55:21.606066+0000","last_clean":"2023-11-15T02:55:21.606066+0000","last_became_active":"2023-11-15T02:55:21.604913+0000","last_became_peered":"2023-11-15T02:55:21.604913+0000","last_unstale":"2023-11-15T02:55:21.606066+0000","last_undegraded":"2023-11-15T02:55:21.606066+0000","last_fullsized":"2023-11-15T02:55:21.606066+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.592679+0000","last_change":"2023-11-15T02:55:21.209265+0000","last_active":"2023-11-15T02:55:21.592679+0000","last_peered":"2023-11-15T02:55:21.592679+0000","last_clean":"2023-11-15T02:55:21.592679+0000","last_became_active":"2023-11-15T02:55:21.208981+0000","last_became_peered":"2023-11-15T02:55:21.208981+0000","last_unstale":"2023-11-15T02:55:21.592679+0000","last_undegraded":"2023-11-15T02:55:21.592679+0000","last_fullsized":"2023-11-15T02:55:21.592679+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.607057+0000","last_change":"2023-11-15T02:55:21.604720+0000","last_active":"2023-11-15T02:55:21.607057+0000","last_peered":"2023-11-15T02:55:21.607057+0000","last_clean":"2023-11-15T02:55:21.607057+0000","last_became_active":"2023-11-15T02:55:21.604443+0000","last_became_peered":"2023-11-15T02:55:21.604443+0000","last_unstale":"2023-11-15T02:55:21.607057+0000","last_undegraded":"2023-11-15T02:55:21.607057+0000","last_fullsized":"2023-11-15T02:55:21.607057+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.604682+0000","last_change":"2023-11-15T02:55:21.217970+0000","last_active":"2023-11-15T02:55:21.604682+0000","last_peered":"2023-11-15T02:55:21.604682+0000","last_clean":"2023-11-15T02:55:21.604682+0000","last_became_active":"2023-11-15T02:55:21.217692+0000","last_became_peered":"2023-11-15T02:55:21.217692+0000","last_unstale":"2023-11-15T02:55:21.604682+0000","last_undegraded":"2023-11-15T02:55:21.604682+0000","last_fullsized":"2023-11-15T02:55:21.604682+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610339+0000","last_change":"2023-11-15T02:55:21.609596+0000","last_active":"2023-11-15T02:55:21.610339+0000","last_peered":"2023-11-15T02:55:21.610339+0000","last_clean":"2023-11-15T02:55:21.610339+0000","last_became_active":"2023-11-15T02:55:21.609299+0000","last_became_peered":"2023-11-15T02:55:21.609299+0000","last_unstale":"2023-11-15T02:55:21.610339+0000","last_undegraded":"2023-11-15T02:55:21.610339+0000","last_fullsized":"2023-11-15T02:55:21.610339+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601898+0000","last_change":"2023-11-15T02:55:21.219356+0000","last_active":"2023-11-15T02:55:21.601898+0000","last_peered":"2023-11-15T02:55:21.601898+0000","last_clean":"2023-11-15T02:55:21.601898+0000","last_became_active":"2023-11-15T02:55:21.219049+0000","last_became_peered":"2023-11-15T02:55:21.219049+0000","last_unstale":"2023-11-15T02:55:21.601898+0000","last_undegraded":"2023-11-15T02:55:21.601898+0000","last_fullsized":"2023-11-15T02:55:21.601898+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613356+0000","last_change":"2023-11-15T02:55:21.612069+0000","last_active":"2023-11-15T02:55:21.613356+0000","last_peered":"2023-11-15T02:55:21.613356+0000","last_clean":"2023-11-15T02:55:21.613356+0000","last_became_active":"2023-11-15T02:55:21.611743+0000","last_became_peered":"2023-11-15T02:55:21.611743+0000","last_unstale":"2023-11-15T02:55:21.613356+0000","last_undegraded":"2023-11-15T02:55:21.613356+0000","last_fullsized":"2023-11-15T02:55:21.613356+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601981+0000","last_change":"2023-11-15T02:55:21.224316+0000","last_active":"2023-11-15T02:55:21.601981+0000","last_peered":"2023-11-15T02:55:21.601981+0000","last_clean":"2023-11-15T02:55:21.601981+0000","last_became_active":"2023-11-15T02:55:21.224020+0000","last_became_peered":"2023-11-15T02:55:21.224020+0000","last_unstale":"2023-11-15T02:55:21.601981+0000","last_undegraded":"2023-11-15T02:55:21.601981+0000","last_fullsized":"2023-11-15T02:55:21.601981+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613220+0000","last_change":"2023-11-15T02:55:21.608033+0000","last_active":"2023-11-15T02:55:21.613220+0000","last_peered":"2023-11-15T02:55:21.613220+0000","last_clean":"2023-11-15T02:55:21.613220+0000","last_became_active":"2023-11-15T02:55:21.607691+0000","last_became_peered":"2023-11-15T02:55:21.607691+0000","last_unstale":"2023-11-15T02:55:21.613220+0000","last_undegraded":"2023-11-15T02:55:21.613220+0000","last_fullsized":"2023-11-15T02:55:21.613220+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.591661+0000","last_change":"2023-11-15T02:55:21.222631+0000","last_active":"2023-11-15T02:55:21.591661+0000","last_peered":"2023-11-15T02:55:21.591661+0000","last_clean":"2023-11-15T02:55:21.591661+0000","last_became_active":"2023-11-15T02:55:21.222362+0000","last_became_peered":"2023-11-15T02:55:21.222362+0000","last_unstale":"2023-11-15T02:55:21.591661+0000","last_undegraded":"2023-11-15T02:55:21.591661+0000","last_fullsized":"2023-11-15T02:55:21.591661+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.627741+0000","last_change":"2023-11-15T02:55:21.621207+0000","last_active":"2023-11-15T02:55:21.627741+0000","last_peered":"2023-11-15T02:55:21.627741+0000","last_clean":"2023-11-15T02:55:21.627741+0000","last_became_active":"2023-11-15T02:55:21.620885+0000","last_became_peered":"2023-11-15T02:55:21.620885+0000","last_unstale":"2023-11-15T02:55:21.627741+0000","last_undegraded":"2023-11-15T02:55:21.627741+0000","last_fullsized":"2023-11-15T02:55:21.627741+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.596149+0000","last_change":"2023-11-15T02:55:21.224507+0000","last_active":"2023-11-15T02:55:21.596149+0000","last_peered":"2023-11-15T02:55:21.596149+0000","last_clean":"2023-11-15T02:55:21.596149+0000","last_became_active":"2023-11-15T02:55:21.224240+0000","last_became_peered":"2023-11-15T02:55:21.224240+0000","last_unstale":"2023-11-15T02:55:21.596149+0000","last_undegraded":"2023-11-15T02:55:21.596149+0000","last_fullsized":"2023-11-15T02:55:21.596149+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.609949+0000","last_change":"2023-11-15T02:55:21.606117+0000","last_active":"2023-11-15T02:55:21.609949+0000","last_peered":"2023-11-15T02:55:21.609949+0000","last_clean":"2023-11-15T02:55:21.609949+0000","last_became_active":"2023-11-15T02:55:21.605854+0000","last_became_peered":"2023-11-15T02:55:21.605854+0000","last_unstale":"2023-11-15T02:55:21.609949+0000","last_undegraded":"2023-11-15T02:55:21.609949+0000","last_fullsized":"2023-11-15T02:55:21.609949+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601597+0000","last_change":"2023-11-15T02:55:21.221606+0000","last_active":"2023-11-15T02:55:21.601597+0000","last_peered":"2023-11-15T02:55:21.601597+0000","last_clean":"2023-11-15T02:55:21.601597+0000","last_became_active":"2023-11-15T02:55:21.221310+0000","last_became_peered":"2023-11-15T02:55:21.221310+0000","last_unstale":"2023-11-15T02:55:21.601597+0000","last_undegraded":"2023-11-15T02:55:21.601597+0000","last_fullsized":"2023-11-15T02:55:21.601597+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.620202+0000","last_change":"2023-11-15T02:55:21.617344+0000","last_active":"2023-11-15T02:55:21.620202+0000","last_peered":"2023-11-15T02:55:21.620202+0000","last_clean":"2023-11-15T02:55:21.620202+0000","last_became_active":"2023-11-15T02:55:21.617064+0000","last_became_peered":"2023-11-15T02:55:21.617064+0000","last_unstale":"2023-11-15T02:55:21.620202+0000","last_undegraded":"2023-11-15T02:55:21.620202+0000","last_fullsized":"2023-11-15T02:55:21.620202+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"211'3","reported_seq":13,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.607247+0000","last_change":"2023-11-15T02:55:21.224349+0000","last_active":"2023-11-15T02:55:21.607247+0000","last_peered":"2023-11-15T02:55:21.607247+0000","last_clean":"2023-11-15T02:55:21.607247+0000","last_became_active":"2023-11-15T02:55:21.224088+0000","last_became_peered":"2023-11-15T02:55:21.224088+0000","last_unstale":"2023-11-15T02:55:21.607247+0000","last_undegraded":"2023-11-15T02:55:21.607247+0000","last_fullsized":"2023-11-15T02:55:21.607247+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.620114+0000","last_change":"2023-11-15T02:55:21.618942+0000","last_active":"2023-11-15T02:55:21.620114+0000","last_peered":"2023-11-15T02:55:21.620114+0000","last_clean":"2023-11-15T02:55:21.620114+0000","last_became_active":"2023-11-15T02:55:21.618653+0000","last_became_peered":"2023-11-15T02:55:21.618653+0000","last_unstale":"2023-11-15T02:55:21.620114+0000","last_undegraded":"2023-11-15T02:55:21.620114+0000","last_fullsized":"2023-11-15T02:55:21.620114+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.617012+0000","last_change":"2023-11-15T02:55:21.223028+0000","last_active":"2023-11-15T02:55:21.617012+0000","last_peered":"2023-11-15T02:55:21.617012+0000","last_clean":"2023-11-15T02:55:21.617012+0000","last_became_active":"2023-11-15T02:55:21.222757+0000","last_became_peered":"2023-11-15T02:55:21.222757+0000","last_unstale":"2023-11-15T02:55:21.617012+0000","last_undegraded":"2023-11-15T02:55:21.617012+0000","last_fullsized":"2023-11-15T02:55:21.617012+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616955+0000","last_change":"2023-11-15T02:55:21.613838+0000","last_active":"2023-11-15T02:55:21.616955+0000","last_peered":"2023-11-15T02:55:21.616955+0000","last_clean":"2023-11-15T02:55:21.616955+0000","last_became_active":"2023-11-15T02:55:21.613565+0000","last_became_peered":"2023-11-15T02:55:21.613565+0000","last_unstale":"2023-11-15T02:55:21.616955+0000","last_undegraded":"2023-11-15T02:55:21.616955+0000","last_fullsized":"2023-11-15T02:55:21.616955+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614079+0000","last_change":"2023-11-15T02:55:21.222093+0000","last_active":"2023-11-15T02:55:21.614079+0000","last_peered":"2023-11-15T02:55:21.614079+0000","last_clean":"2023-11-15T02:55:21.614079+0000","last_became_active":"2023-11-15T02:55:21.221526+0000","last_became_peered":"2023-11-15T02:55:21.221526+0000","last_unstale":"2023-11-15T02:55:21.614079+0000","last_undegraded":"2023-11-15T02:55:21.614079+0000","last_fullsized":"2023-11-15T02:55:21.614079+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616601+0000","last_change":"2023-11-15T02:55:21.614388+0000","last_active":"2023-11-15T02:55:21.616601+0000","last_peered":"2023-11-15T02:55:21.616601+0000","last_clean":"2023-11-15T02:55:21.616601+0000","last_became_active":"2023-11-15T02:55:21.614117+0000","last_became_peered":"2023-11-15T02:55:21.614117+0000","last_unstale":"2023-11-15T02:55:21.616601+0000","last_undegraded":"2023-11-15T02:55:21.616601+0000","last_fullsized":"2023-11-15T02:55:21.616601+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601107+0000","last_change":"2023-11-15T02:55:21.221019+0000","last_active":"2023-11-15T02:55:21.601107+0000","last_peered":"2023-11-15T02:55:21.601107+0000","last_clean":"2023-11-15T02:55:21.601107+0000","last_became_active":"2023-11-15T02:55:21.220753+0000","last_became_peered":"2023-11-15T02:55:21.220753+0000","last_unstale":"2023-11-15T02:55:21.601107+0000","last_undegraded":"2023-11-15T02:55:21.601107+0000","last_fullsized":"2023-11-15T02:55:21.601107+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613357+0000","last_change":"2023-11-15T02:55:21.608060+0000","last_active":"2023-11-15T02:55:21.613357+0000","last_peered":"2023-11-15T02:55:21.613357+0000","last_clean":"2023-11-15T02:55:21.613357+0000","last_became_active":"2023-11-15T02:55:21.607743+0000","last_became_peered":"2023-11-15T02:55:21.607743+0000","last_unstale":"2023-11-15T02:55:21.613357+0000","last_undegraded":"2023-11-15T02:55:21.613357+0000","last_fullsized":"2023-11-15T02:55:21.613357+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.598891+0000","last_change":"2023-11-15T02:55:21.223501+0000","last_active":"2023-11-15T02:55:21.598891+0000","last_peered":"2023-11-15T02:55:21.598891+0000","last_clean":"2023-11-15T02:55:21.598891+0000","last_became_active":"2023-11-15T02:55:21.222459+0000","last_became_peered":"2023-11-15T02:55:21.222459+0000","last_unstale":"2023-11-15T02:55:21.598891+0000","last_undegraded":"2023-11-15T02:55:21.598891+0000","last_fullsized":"2023-11-15T02:55:21.598891+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616570+0000","last_change":"2023-11-15T02:55:21.609792+0000","last_active":"2023-11-15T02:55:21.616570+0000","last_peered":"2023-11-15T02:55:21.616570+0000","last_clean":"2023-11-15T02:55:21.616570+0000","last_became_active":"2023-11-15T02:55:21.608512+0000","last_became_peered":"2023-11-15T02:55:21.608512+0000","last_unstale":"2023-11-15T02:55:21.616570+0000","last_undegraded":"2023-11-15T02:55:21.616570+0000","last_fullsized":"2023-11-15T02:55:21.616570+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"211'4","reported_seq":14,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615003+0000","last_change":"2023-11-15T02:55:21.211489+0000","last_active":"2023-11-15T02:55:21.615003+0000","last_peered":"2023-11-15T02:55:21.615003+0000","last_clean":"2023-11-15T02:55:21.615003+0000","last_became_active":"2023-11-15T02:55:21.211194+0000","last_became_peered":"2023-11-15T02:55:21.211194+0000","last_unstale":"2023-11-15T02:55:21.615003+0000","last_undegraded":"2023-11-15T02:55:21.615003+0000","last_fullsized":"2023-11-15T02:55:21.615003+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.608482+0000","last_change":"2023-11-15T02:55:21.607138+0000","last_active":"2023-11-15T02:55:21.608482+0000","last_peered":"2023-11-15T02:55:21.608482+0000","last_clean":"2023-11-15T02:55:21.608482+0000","last_became_active":"2023-11-15T02:55:21.606842+0000","last_became_peered":"2023-11-15T02:55:21.606842+0000","last_unstale":"2023-11-15T02:55:21.608482+0000","last_undegraded":"2023-11-15T02:55:21.608482+0000","last_fullsized":"2023-11-15T02:55:21.608482+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615958+0000","last_change":"2023-11-15T02:55:21.213860+0000","last_active":"2023-11-15T02:55:21.615958+0000","last_peered":"2023-11-15T02:55:21.615958+0000","last_clean":"2023-11-15T02:55:21.615958+0000","last_became_active":"2023-11-15T02:55:21.213563+0000","last_became_peered":"2023-11-15T02:55:21.213563+0000","last_unstale":"2023-11-15T02:55:21.615958+0000","last_undegraded":"2023-11-15T02:55:21.615958+0000","last_fullsized":"2023-11-15T02:55:21.615958+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.612364+0000","last_change":"2023-11-15T02:55:21.611597+0000","last_active":"2023-11-15T02:55:21.612364+0000","last_peered":"2023-11-15T02:55:21.612364+0000","last_clean":"2023-11-15T02:55:21.612364+0000","last_became_active":"2023-11-15T02:55:21.611310+0000","last_became_peered":"2023-11-15T02:55:21.611310+0000","last_unstale":"2023-11-15T02:55:21.612364+0000","last_undegraded":"2023-11-15T02:55:21.612364+0000","last_fullsized":"2023-11-15T02:55:21.612364+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614692+0000","last_change":"2023-11-15T02:55:21.223224+0000","last_active":"2023-11-15T02:55:21.614692+0000","last_peered":"2023-11-15T02:55:21.614692+0000","last_clean":"2023-11-15T02:55:21.614692+0000","last_became_active":"2023-11-15T02:55:21.222920+0000","last_became_peered":"2023-11-15T02:55:21.222920+0000","last_unstale":"2023-11-15T02:55:21.614692+0000","last_undegraded":"2023-11-15T02:55:21.614692+0000","last_fullsized":"2023-11-15T02:55:21.614692+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613500+0000","last_change":"2023-11-15T02:55:21.610561+0000","last_active":"2023-11-15T02:55:21.613500+0000","last_peered":"2023-11-15T02:55:21.613500+0000","last_clean":"2023-11-15T02:55:21.613500+0000","last_became_active":"2023-11-15T02:55:21.610252+0000","last_became_peered":"2023-11-15T02:55:21.610252+0000","last_unstale":"2023-11-15T02:55:21.613500+0000","last_undegraded":"2023-11-15T02:55:21.613500+0000","last_fullsized":"2023-11-15T02:55:21.613500+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.602628+0000","last_change":"2023-11-15T02:55:21.224625+0000","last_active":"2023-11-15T02:55:21.602628+0000","last_peered":"2023-11-15T02:55:21.602628+0000","last_clean":"2023-11-15T02:55:21.602628+0000","last_became_active":"2023-11-15T02:55:21.224303+0000","last_became_peered":"2023-11-15T02:55:21.224303+0000","last_unstale":"2023-11-15T02:55:21.602628+0000","last_undegraded":"2023-11-15T02:55:21.602628+0000","last_fullsized":"2023-11-15T02:55:21.602628+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610588+0000","last_change":"2023-11-15T02:55:21.608019+0000","last_active":"2023-11-15T02:55:21.610588+0000","last_peered":"2023-11-15T02:55:21.610588+0000","last_clean":"2023-11-15T02:55:21.610588+0000","last_became_active":"2023-11-15T02:55:21.607691+0000","last_became_peered":"2023-11-15T02:55:21.607691+0000","last_unstale":"2023-11-15T02:55:21.610588+0000","last_undegraded":"2023-11-15T02:55:21.610588+0000","last_fullsized":"2023-11-15T02:55:21.610588+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.607245+0000","last_change":"2023-11-15T02:55:21.220350+0000","last_active":"2023-11-15T02:55:21.607245+0000","last_peered":"2023-11-15T02:55:21.607245+0000","last_clean":"2023-11-15T02:55:21.607245+0000","last_became_active":"2023-11-15T02:55:21.220020+0000","last_became_peered":"2023-11-15T02:55:21.220020+0000","last_unstale":"2023-11-15T02:55:21.607245+0000","last_undegraded":"2023-11-15T02:55:21.607245+0000","last_fullsized":"2023-11-15T02:55:21.607245+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615813+0000","last_change":"2023-11-15T02:55:21.609007+0000","last_active":"2023-11-15T02:55:21.615813+0000","last_peered":"2023-11-15T02:55:21.615813+0000","last_clean":"2023-11-15T02:55:21.615813+0000","last_became_active":"2023-11-15T02:55:21.608715+0000","last_became_peered":"2023-11-15T02:55:21.608715+0000","last_unstale":"2023-11-15T02:55:21.615813+0000","last_undegraded":"2023-11-15T02:55:21.615813+0000","last_fullsized":"2023-11-15T02:55:21.615813+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613212+0000","last_change":"2023-11-15T02:55:21.224368+0000","last_active":"2023-11-15T02:55:21.613212+0000","last_peered":"2023-11-15T02:55:21.613212+0000","last_clean":"2023-11-15T02:55:21.613212+0000","last_became_active":"2023-11-15T02:55:21.224105+0000","last_became_peered":"2023-11-15T02:55:21.224105+0000","last_unstale":"2023-11-15T02:55:21.613212+0000","last_undegraded":"2023-11-15T02:55:21.613212+0000","last_fullsized":"2023-11-15T02:55:21.613212+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.617098+0000","last_change":"2023-11-15T02:55:21.615992+0000","last_active":"2023-11-15T02:55:21.617098+0000","last_peered":"2023-11-15T02:55:21.617098+0000","last_clean":"2023-11-15T02:55:21.617098+0000","last_became_active":"2023-11-15T02:55:21.615695+0000","last_became_peered":"2023-11-15T02:55:21.615695+0000","last_unstale":"2023-11-15T02:55:21.617098+0000","last_undegraded":"2023-11-15T02:55:21.617098+0000","last_fullsized":"2023-11-15T02:55:21.617098+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.600876+0000","last_change":"2023-11-15T02:55:21.217336+0000","last_active":"2023-11-15T02:55:21.600876+0000","last_peered":"2023-11-15T02:55:21.600876+0000","last_clean":"2023-11-15T02:55:21.600876+0000","last_became_active":"2023-11-15T02:55:21.217023+0000","last_became_peered":"2023-11-15T02:55:21.217023+0000","last_unstale":"2023-11-15T02:55:21.600876+0000","last_undegraded":"2023-11-15T02:55:21.600876+0000","last_fullsized":"2023-11-15T02:55:21.600876+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615598+0000","last_change":"2023-11-15T02:55:21.614273+0000","last_active":"2023-11-15T02:55:21.615598+0000","last_peered":"2023-11-15T02:55:21.615598+0000","last_clean":"2023-11-15T02:55:21.615598+0000","last_became_active":"2023-11-15T02:55:21.614011+0000","last_became_peered":"2023-11-15T02:55:21.614011+0000","last_unstale":"2023-11-15T02:55:21.615598+0000","last_undegraded":"2023-11-15T02:55:21.615598+0000","last_fullsized":"2023-11-15T02:55:21.615598+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.592036+0000","last_change":"2023-11-15T02:55:21.220570+0000","last_active":"2023-11-15T02:55:21.592036+0000","last_peered":"2023-11-15T02:55:21.592036+0000","last_clean":"2023-11-15T02:55:21.592036+0000","last_became_active":"2023-11-15T02:55:21.220284+0000","last_became_peered":"2023-11-15T02:55:21.220284+0000","last_unstale":"2023-11-15T02:55:21.592036+0000","last_undegraded":"2023-11-15T02:55:21.592036+0000","last_fullsized":"2023-11-15T02:55:21.592036+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.605672+0000","last_change":"2023-11-15T02:55:21.598660+0000","last_active":"2023-11-15T02:55:21.605672+0000","last_peered":"2023-11-15T02:55:21.605672+0000","last_clean":"2023-11-15T02:55:21.605672+0000","last_became_active":"2023-11-15T02:55:21.598369+0000","last_became_peered":"2023-11-15T02:55:21.598369+0000","last_unstale":"2023-11-15T02:55:21.605672+0000","last_undegraded":"2023-11-15T02:55:21.605672+0000","last_fullsized":"2023-11-15T02:55:21.605672+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.598855+0000","last_change":"2023-11-15T02:55:21.219561+0000","last_active":"2023-11-15T02:55:21.598855+0000","last_peered":"2023-11-15T02:55:21.598855+0000","last_clean":"2023-11-15T02:55:21.598855+0000","last_became_active":"2023-11-15T02:55:21.219279+0000","last_became_peered":"2023-11-15T02:55:21.219279+0000","last_unstale":"2023-11-15T02:55:21.598855+0000","last_undegraded":"2023-11-15T02:55:21.598855+0000","last_fullsized":"2023-11-15T02:55:21.598855+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.616997+0000","last_change":"2023-11-15T02:55:21.615208+0000","last_active":"2023-11-15T02:55:21.616997+0000","last_peered":"2023-11-15T02:55:21.616997+0000","last_clean":"2023-11-15T02:55:21.616997+0000","last_became_active":"2023-11-15T02:55:21.614949+0000","last_became_peered":"2023-11-15T02:55:21.614949+0000","last_unstale":"2023-11-15T02:55:21.616997+0000","last_undegraded":"2023-11-15T02:55:21.616997+0000","last_fullsized":"2023-11-15T02:55:21.616997+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.621656+0000","last_change":"2023-11-15T02:55:21.220786+0000","last_active":"2023-11-15T02:55:21.621656+0000","last_peered":"2023-11-15T02:55:21.621656+0000","last_clean":"2023-11-15T02:55:21.621656+0000","last_became_active":"2023-11-15T02:55:21.220508+0000","last_became_peered":"2023-11-15T02:55:21.220508+0000","last_unstale":"2023-11-15T02:55:21.621656+0000","last_undegraded":"2023-11-15T02:55:21.621656+0000","last_fullsized":"2023-11-15T02:55:21.621656+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610796+0000","last_change":"2023-11-15T02:55:21.607461+0000","last_active":"2023-11-15T02:55:21.610796+0000","last_peered":"2023-11-15T02:55:21.610796+0000","last_clean":"2023-11-15T02:55:21.610796+0000","last_became_active":"2023-11-15T02:55:21.606083+0000","last_became_peered":"2023-11-15T02:55:21.606083+0000","last_unstale":"2023-11-15T02:55:21.610796+0000","last_undegraded":"2023-11-15T02:55:21.610796+0000","last_fullsized":"2023-11-15T02:55:21.610796+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.592325+0000","last_change":"2023-11-15T02:55:21.221600+0000","last_active":"2023-11-15T02:55:21.592325+0000","last_peered":"2023-11-15T02:55:21.592325+0000","last_clean":"2023-11-15T02:55:21.592325+0000","last_became_active":"2023-11-15T02:55:21.221325+0000","last_became_peered":"2023-11-15T02:55:21.221325+0000","last_unstale":"2023-11-15T02:55:21.592325+0000","last_undegraded":"2023-11-15T02:55:21.592325+0000","last_fullsized":"2023-11-15T02:55:21.592325+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.627805+0000","last_change":"2023-11-15T02:55:21.621970+0000","last_active":"2023-11-15T02:55:21.627805+0000","last_peered":"2023-11-15T02:55:21.627805+0000","last_clean":"2023-11-15T02:55:21.627805+0000","last_became_active":"2023-11-15T02:55:21.621681+0000","last_became_peered":"2023-11-15T02:55:21.621681+0000","last_unstale":"2023-11-15T02:55:21.627805+0000","last_undegraded":"2023-11-15T02:55:21.627805+0000","last_fullsized":"2023-11-15T02:55:21.627805+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.596419+0000","last_change":"2023-11-15T02:55:21.221930+0000","last_active":"2023-11-15T02:55:21.596419+0000","last_peered":"2023-11-15T02:55:21.596419+0000","last_clean":"2023-11-15T02:55:21.596419+0000","last_became_active":"2023-11-15T02:55:21.221224+0000","last_became_peered":"2023-11-15T02:55:21.221224+0000","last_unstale":"2023-11-15T02:55:21.596419+0000","last_undegraded":"2023-11-15T02:55:21.596419+0000","last_fullsized":"2023-11-15T02:55:21.596419+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615599+0000","last_change":"2023-11-15T02:55:21.613035+0000","last_active":"2023-11-15T02:55:21.615599+0000","last_peered":"2023-11-15T02:55:21.615599+0000","last_clean":"2023-11-15T02:55:21.615599+0000","last_became_active":"2023-11-15T02:55:21.612719+0000","last_became_peered":"2023-11-15T02:55:21.612719+0000","last_unstale":"2023-11-15T02:55:21.615599+0000","last_undegraded":"2023-11-15T02:55:21.615599+0000","last_fullsized":"2023-11-15T02:55:21.615599+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.596032+0000","last_change":"2023-11-15T02:55:21.215981+0000","last_active":"2023-11-15T02:55:21.596032+0000","last_peered":"2023-11-15T02:55:21.596032+0000","last_clean":"2023-11-15T02:55:21.596032+0000","last_became_active":"2023-11-15T02:55:21.215705+0000","last_became_peered":"2023-11-15T02:55:21.215705+0000","last_unstale":"2023-11-15T02:55:21.596032+0000","last_undegraded":"2023-11-15T02:55:21.596032+0000","last_fullsized":"2023-11-15T02:55:21.596032+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610988+0000","last_change":"2023-11-15T02:55:21.608986+0000","last_active":"2023-11-15T02:55:21.610988+0000","last_peered":"2023-11-15T02:55:21.610988+0000","last_clean":"2023-11-15T02:55:21.610988+0000","last_became_active":"2023-11-15T02:55:21.608682+0000","last_became_peered":"2023-11-15T02:55:21.608682+0000","last_unstale":"2023-11-15T02:55:21.610988+0000","last_undegraded":"2023-11-15T02:55:21.610988+0000","last_fullsized":"2023-11-15T02:55:21.610988+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601238+0000","last_change":"2023-11-15T02:55:21.222991+0000","last_active":"2023-11-15T02:55:21.601238+0000","last_peered":"2023-11-15T02:55:21.601238+0000","last_clean":"2023-11-15T02:55:21.601238+0000","last_became_active":"2023-11-15T02:55:21.222708+0000","last_became_peered":"2023-11-15T02:55:21.222708+0000","last_unstale":"2023-11-15T02:55:21.601238+0000","last_undegraded":"2023-11-15T02:55:21.601238+0000","last_fullsized":"2023-11-15T02:55:21.601238+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.619508+0000","last_change":"2023-11-15T02:55:21.614790+0000","last_active":"2023-11-15T02:55:21.619508+0000","last_peered":"2023-11-15T02:55:21.619508+0000","last_clean":"2023-11-15T02:55:21.619508+0000","last_became_active":"2023-11-15T02:55:21.614259+0000","last_became_peered":"2023-11-15T02:55:21.614259+0000","last_unstale":"2023-11-15T02:55:21.619508+0000","last_undegraded":"2023-11-15T02:55:21.619508+0000","last_fullsized":"2023-11-15T02:55:21.619508+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601473+0000","last_change":"2023-11-15T02:55:21.224187+0000","last_active":"2023-11-15T02:55:21.601473+0000","last_peered":"2023-11-15T02:55:21.601473+0000","last_clean":"2023-11-15T02:55:21.601473+0000","last_became_active":"2023-11-15T02:55:21.223896+0000","last_became_peered":"2023-11-15T02:55:21.223896+0000","last_unstale":"2023-11-15T02:55:21.601473+0000","last_undegraded":"2023-11-15T02:55:21.601473+0000","last_fullsized":"2023-11-15T02:55:21.601473+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614014+0000","last_change":"2023-11-15T02:55:21.612373+0000","last_active":"2023-11-15T02:55:21.614014+0000","last_peered":"2023-11-15T02:55:21.614014+0000","last_clean":"2023-11-15T02:55:21.614014+0000","last_became_active":"2023-11-15T02:55:21.608996+0000","last_became_peered":"2023-11-15T02:55:21.608996+0000","last_unstale":"2023-11-15T02:55:21.614014+0000","last_undegraded":"2023-11-15T02:55:21.614014+0000","last_fullsized":"2023-11-15T02:55:21.614014+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.592130+0000","last_change":"2023-11-15T02:55:21.227648+0000","last_active":"2023-11-15T02:55:21.592130+0000","last_peered":"2023-11-15T02:55:21.592130+0000","last_clean":"2023-11-15T02:55:21.592130+0000","last_became_active":"2023-11-15T02:55:21.227094+0000","last_became_peered":"2023-11-15T02:55:21.227094+0000","last_unstale":"2023-11-15T02:55:21.592130+0000","last_undegraded":"2023-11-15T02:55:21.592130+0000","last_fullsized":"2023-11-15T02:55:21.592130+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.619917+0000","last_change":"2023-11-15T02:55:21.611510+0000","last_active":"2023-11-15T02:55:21.619917+0000","last_peered":"2023-11-15T02:55:21.619917+0000","last_clean":"2023-11-15T02:55:21.619917+0000","last_became_active":"2023-11-15T02:55:21.611262+0000","last_became_peered":"2023-11-15T02:55:21.611262+0000","last_unstale":"2023-11-15T02:55:21.619917+0000","last_undegraded":"2023-11-15T02:55:21.619917+0000","last_fullsized":"2023-11-15T02:55:21.619917+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.598947+0000","last_change":"2023-11-15T02:55:21.215272+0000","last_active":"2023-11-15T02:55:21.598947+0000","last_peered":"2023-11-15T02:55:21.598947+0000","last_clean":"2023-11-15T02:55:21.598947+0000","last_became_active":"2023-11-15T02:55:21.214976+0000","last_became_peered":"2023-11-15T02:55:21.214976+0000","last_unstale":"2023-11-15T02:55:21.598947+0000","last_undegraded":"2023-11-15T02:55:21.598947+0000","last_fullsized":"2023-11-15T02:55:21.598947+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.627717+0000","last_change":"2023-11-15T02:55:21.620652+0000","last_active":"2023-11-15T02:55:21.627717+0000","last_peered":"2023-11-15T02:55:21.627717+0000","last_clean":"2023-11-15T02:55:21.627717+0000","last_became_active":"2023-11-15T02:55:21.620208+0000","last_became_peered":"2023-11-15T02:55:21.620208+0000","last_unstale":"2023-11-15T02:55:21.627717+0000","last_undegraded":"2023-11-15T02:55:21.627717+0000","last_fullsized":"2023-11-15T02:55:21.627717+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.607425+0000","last_change":"2023-11-15T02:55:21.210495+0000","last_active":"2023-11-15T02:55:21.607425+0000","last_peered":"2023-11-15T02:55:21.607425+0000","last_clean":"2023-11-15T02:55:21.607425+0000","last_became_active":"2023-11-15T02:55:21.209916+0000","last_became_peered":"2023-11-15T02:55:21.209916+0000","last_unstale":"2023-11-15T02:55:21.607425+0000","last_undegraded":"2023-11-15T02:55:21.607425+0000","last_fullsized":"2023-11-15T02:55:21.607425+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":175,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601902+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:55:21.601902+0000","last_peered":"2023-11-15T02:55:21.601902+0000","last_clean":"2023-11-15T02:55:21.601902+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:55:21.601902+0000","last_undegraded":"2023-11-15T02:55:21.601902+0000","last_fullsized":"2023-11-15T02:55:21.601902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.614193+0000","last_change":"2023-11-15T02:55:21.613179+0000","last_active":"2023-11-15T02:55:21.614193+0000","last_peered":"2023-11-15T02:55:21.614193+0000","last_clean":"2023-11-15T02:55:21.614193+0000","last_became_active":"2023-11-15T02:55:21.612678+0000","last_became_peered":"2023-11-15T02:55:21.612678+0000","last_unstale":"2023-11-15T02:55:21.614193+0000","last_undegraded":"2023-11-15T02:55:21.614193+0000","last_fullsized":"2023-11-15T02:55:21.614193+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.603795+0000","last_change":"2023-11-15T02:55:21.221847+0000","last_active":"2023-11-15T02:55:21.603795+0000","last_peered":"2023-11-15T02:55:21.603795+0000","last_clean":"2023-11-15T02:55:21.603795+0000","last_became_active":"2023-11-15T02:55:21.220997+0000","last_became_peered":"2023-11-15T02:55:21.220997+0000","last_unstale":"2023-11-15T02:55:21.603795+0000","last_undegraded":"2023-11-15T02:55:21.603795+0000","last_fullsized":"2023-11-15T02:55:21.603795+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":174,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.602411+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:55:21.602411+0000","last_peered":"2023-11-15T02:55:21.602411+0000","last_clean":"2023-11-15T02:55:21.602411+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:55:21.602411+0000","last_undegraded":"2023-11-15T02:55:21.602411+0000","last_fullsized":"2023-11-15T02:55:21.602411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610879+0000","last_change":"2023-11-15T02:55:21.608087+0000","last_active":"2023-11-15T02:55:21.610879+0000","last_peered":"2023-11-15T02:55:21.610879+0000","last_clean":"2023-11-15T02:55:21.610879+0000","last_became_active":"2023-11-15T02:55:21.607690+0000","last_became_peered":"2023-11-15T02:55:21.607690+0000","last_unstale":"2023-11-15T02:55:21.610879+0000","last_undegraded":"2023-11-15T02:55:21.610879+0000","last_fullsized":"2023-11-15T02:55:21.610879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.600782+0000","last_change":"2023-11-15T02:55:21.217339+0000","last_active":"2023-11-15T02:55:21.600782+0000","last_peered":"2023-11-15T02:55:21.600782+0000","last_clean":"2023-11-15T02:55:21.600782+0000","last_became_active":"2023-11-15T02:55:21.217053+0000","last_became_peered":"2023-11-15T02:55:21.217053+0000","last_unstale":"2023-11-15T02:55:21.600782+0000","last_undegraded":"2023-11-15T02:55:21.600782+0000","last_fullsized":"2023-11-15T02:55:21.600782+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":185,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.592123+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:55:21.592123+0000","last_peered":"2023-11-15T02:55:21.592123+0000","last_clean":"2023-11-15T02:55:21.592123+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:55:21.592123+0000","last_undegraded":"2023-11-15T02:55:21.592123+0000","last_fullsized":"2023-11-15T02:55:21.592123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.609324+0000","last_change":"2023-11-15T02:55:21.606442+0000","last_active":"2023-11-15T02:55:21.609324+0000","last_peered":"2023-11-15T02:55:21.609324+0000","last_clean":"2023-11-15T02:55:21.609324+0000","last_became_active":"2023-11-15T02:55:21.606160+0000","last_became_peered":"2023-11-15T02:55:21.606160+0000","last_unstale":"2023-11-15T02:55:21.609324+0000","last_undegraded":"2023-11-15T02:55:21.609324+0000","last_fullsized":"2023-11-15T02:55:21.609324+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.598514+0000","last_change":"2023-11-15T02:55:21.212398+0000","last_active":"2023-11-15T02:55:21.598514+0000","last_peered":"2023-11-15T02:55:21.598514+0000","last_clean":"2023-11-15T02:55:21.598514+0000","last_became_active":"2023-11-15T02:55:21.210863+0000","last_became_peered":"2023-11-15T02:55:21.210863+0000","last_unstale":"2023-11-15T02:55:21.598514+0000","last_undegraded":"2023-11-15T02:55:21.598514+0000","last_fullsized":"2023-11-15T02:55:21.598514+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601987+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:55:21.601987+0000","last_peered":"2023-11-15T02:55:21.601987+0000","last_clean":"2023-11-15T02:55:21.601987+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:55:21.601987+0000","last_undegraded":"2023-11-15T02:55:21.601987+0000","last_fullsized":"2023-11-15T02:55:21.601987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":169,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601265+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:55:21.601265+0000","last_peered":"2023-11-15T02:55:21.601265+0000","last_clean":"2023-11-15T02:55:21.601265+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:55:21.601265+0000","last_undegraded":"2023-11-15T02:55:21.601265+0000","last_fullsized":"2023-11-15T02:55:21.601265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.613282+0000","last_change":"2023-11-15T02:55:21.607951+0000","last_active":"2023-11-15T02:55:21.613282+0000","last_peered":"2023-11-15T02:55:21.613282+0000","last_clean":"2023-11-15T02:55:21.613282+0000","last_became_active":"2023-11-15T02:55:21.607565+0000","last_became_peered":"2023-11-15T02:55:21.607565+0000","last_unstale":"2023-11-15T02:55:21.613282+0000","last_undegraded":"2023-11-15T02:55:21.613282+0000","last_fullsized":"2023-11-15T02:55:21.613282+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.596698+0000","last_change":"2023-11-15T02:55:21.220069+0000","last_active":"2023-11-15T02:55:21.596698+0000","last_peered":"2023-11-15T02:55:21.596698+0000","last_clean":"2023-11-15T02:55:21.596698+0000","last_became_active":"2023-11-15T02:55:21.219652+0000","last_became_peered":"2023-11-15T02:55:21.219652+0000","last_unstale":"2023-11-15T02:55:21.596698+0000","last_undegraded":"2023-11-15T02:55:21.596698+0000","last_fullsized":"2023-11-15T02:55:21.596698+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601340+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:55:21.601340+0000","last_peered":"2023-11-15T02:55:21.601340+0000","last_clean":"2023-11-15T02:55:21.601340+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:55:21.601340+0000","last_undegraded":"2023-11-15T02:55:21.601340+0000","last_fullsized":"2023-11-15T02:55:21.601340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.610304+0000","last_change":"2023-11-15T02:55:21.608221+0000","last_active":"2023-11-15T02:55:21.610304+0000","last_peered":"2023-11-15T02:55:21.610304+0000","last_clean":"2023-11-15T02:55:21.610304+0000","last_became_active":"2023-11-15T02:55:21.607956+0000","last_became_peered":"2023-11-15T02:55:21.607956+0000","last_unstale":"2023-11-15T02:55:21.610304+0000","last_undegraded":"2023-11-15T02:55:21.610304+0000","last_fullsized":"2023-11-15T02:55:21.610304+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.604907+0000","last_change":"2023-11-15T02:55:21.218825+0000","last_active":"2023-11-15T02:55:21.604907+0000","last_peered":"2023-11-15T02:55:21.604907+0000","last_clean":"2023-11-15T02:55:21.604907+0000","last_became_active":"2023-11-15T02:55:21.218507+0000","last_became_peered":"2023-11-15T02:55:21.218507+0000","last_unstale":"2023-11-15T02:55:21.604907+0000","last_undegraded":"2023-11-15T02:55:21.604907+0000","last_fullsized":"2023-11-15T02:55:21.604907+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.605977+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:55:21.605977+0000","last_peered":"2023-11-15T02:55:21.605977+0000","last_clean":"2023-11-15T02:55:21.605977+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:55:21.605977+0000","last_undegraded":"2023-11-15T02:55:21.605977+0000","last_fullsized":"2023-11-15T02:55:21.605977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.624980+0000","last_change":"2023-11-15T02:55:21.622245+0000","last_active":"2023-11-15T02:55:21.624980+0000","last_peered":"2023-11-15T02:55:21.624980+0000","last_clean":"2023-11-15T02:55:21.624980+0000","last_became_active":"2023-11-15T02:55:21.621957+0000","last_became_peered":"2023-11-15T02:55:21.621957+0000","last_unstale":"2023-11-15T02:55:21.624980+0000","last_undegraded":"2023-11-15T02:55:21.624980+0000","last_fullsized":"2023-11-15T02:55:21.624980+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.615712+0000","last_change":"2023-11-15T02:55:21.223138+0000","last_active":"2023-11-15T02:55:21.615712+0000","last_peered":"2023-11-15T02:55:21.615712+0000","last_clean":"2023-11-15T02:55:21.615712+0000","last_became_active":"2023-11-15T02:55:21.222861+0000","last_became_peered":"2023-11-15T02:55:21.222861+0000","last_unstale":"2023-11-15T02:55:21.615712+0000","last_undegraded":"2023-11-15T02:55:21.615712+0000","last_fullsized":"2023-11-15T02:55:21.615712+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":175,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.601688+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:55:21.601688+0000","last_peered":"2023-11-15T02:55:21.601688+0000","last_clean":"2023-11-15T02:55:21.601688+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:55:21.601688+0000","last_undegraded":"2023-11-15T02:55:21.601688+0000","last_fullsized":"2023-11-15T02:55:21.601688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.621392+0000","last_change":"2023-11-15T02:55:21.616899+0000","last_active":"2023-11-15T02:55:21.621392+0000","last_peered":"2023-11-15T02:55:21.621392+0000","last_clean":"2023-11-15T02:55:21.621392+0000","last_became_active":"2023-11-15T02:55:21.616586+0000","last_became_peered":"2023-11-15T02:55:21.616586+0000","last_unstale":"2023-11-15T02:55:21.621392+0000","last_undegraded":"2023-11-15T02:55:21.621392+0000","last_fullsized":"2023-11-15T02:55:21.621392+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:21.195910+0000","last_clean_scrub_stamp":"2023-11-15T02:55:21.195910+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.604862+0000","last_change":"2023-11-15T02:55:21.223225+0000","last_active":"2023-11-15T02:55:21.604862+0000","last_peered":"2023-11-15T02:55:21.604862+0000","last_clean":"2023-11-15T02:55:21.604862+0000","last_became_active":"2023-11-15T02:55:21.222928+0000","last_became_peered":"2023-11-15T02:55:21.222928+0000","last_unstale":"2023-11-15T02:55:21.604862+0000","last_undegraded":"2023-11-15T02:55:21.604862+0000","last_fullsized":"2023-11-15T02:55:21.604862+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:20.190216+0000","last_clean_scrub_stamp":"2023-11-15T02:55:20.190216+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":198,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-11-15T02:55:21.605148+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:55:21.605148+0000","last_peered":"2023-11-15T02:55:21.605148+0000","last_clean":"2023-11-15T02:55:21.605148+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:55:21.605148+0000","last_undegraded":"2023-11-15T02:55:21.605148+0000","last_fullsized":"2023-11-15T02:55:21.605148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2662400,"data_stored":1425490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.66500000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.82399999999999995},"last":0.81200000000000006}]},{"osd":1,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.39400000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75900000000000001,"5min":0.78500000000000003,"15min":0.79200000000000004},"last":0.748},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.57899999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.749,"5min":0.76300000000000001,"15min":0.82299999999999995},"last":0.78600000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.58299999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.80400000000000005},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76500000000000001,"5min":0.82799999999999996,"15min":0.83799999999999997},"last":0.69699999999999995}]},{"osd":3,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.88500000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.86699999999999999},"last":0.77600000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.35299999999999998,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.63700000000000001,"5min":0.71699999999999997,"15min":0.749},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.74299999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.73599999999999999}]},{"osd":5,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.30199999999999999,"15min":0.27300000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.497,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.81999999999999995},"last":0.65700000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.72399999999999998,"5min":0.78200000000000003,"15min":0.84899999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.28499999999999998},"max":{"1min":0.78400000000000003,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.63700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575966,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307884,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063956,"statfs":{"total":96636764160,"available":96321490944,"internally_reserved":0,"allocated":2658304,"data_stored":1424936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.24099999999999999},"max":{"1min":0.79500000000000004,"5min":0.79700000000000004,"15min":0.92500000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.437,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":1.466,"15min":1.466},"last":0.53400000000000003}]},{"osd":1,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81999999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78400000000000003,"5min":1.53,"15min":1.53},"last":0.66300000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.36899999999999999,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":1.026,"15min":1.026},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.80200000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.61499999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.32900000000000001},"max":{"1min":0.71099999999999997,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.81200000000000006,"5min":1.498,"15min":1.498},"last":0.73899999999999999}]},{"osd":4,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.61299999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.68400000000000005,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.442}]},{"osd":5,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.499,"15min":0.48999999999999999},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65600000000000003,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.377},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.376,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.48399999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.498,"15min":0.503},"min":{"1min":0.34300000000000003,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.76400000000000001,"5min":1.04,"15min":1.04},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80000000000000004,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.51300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575967,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307880,"kb_used_data":2592,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063960,"statfs":{"total":96636764160,"available":96321495040,"internally_reserved":0,"allocated":2654208,"data_stored":1424044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40100000000000002,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.26100000000000001,"15min":0.23999999999999999},"max":{"1min":0.47899999999999998,"5min":1.149,"15min":1.149},"last":0.37},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.30499999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.499,"5min":1.044,"15min":1.044},"last":0.70499999999999996}]},{"osd":2,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40799999999999997,"15min":0.40699999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51100000000000001,"5min":0.748,"15min":0.748},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46899999999999997,"15min":0.46200000000000002},"min":{"1min":0.313,"5min":0.311,"15min":0.27500000000000002},"max":{"1min":0.58299999999999996,"5min":1.101,"15min":1.101},"last":0.53200000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63600000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.504,"15min":0.505},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66200000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.67800000000000005}]},{"osd":4,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.40999999999999998,"15min":0.372},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65500000000000003,"15min":0.66200000000000003},"min":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":1.052,"15min":1.081},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.53300000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88600000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73099999999999998,"15min":0.68899999999999995},"min":{"1min":0.498,"5min":0.42999999999999999,"15min":0.42699999999999999},"max":{"1min":0.86499999999999999,"5min":5.7590000000000003,"15min":5.7590000000000003},"last":0.58499999999999996}]},{"osd":6,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89300000000000002,"5min":1.089,"15min":1.089},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76800000000000002,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91900000000000004,"5min":5.7930000000000001,"15min":5.7930000000000001},"last":0.55400000000000005}]},{"osd":7,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72399999999999998,"15min":0.72699999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88300000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.59699999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85699999999999998,"5min":1.04,"15min":1.04},"last":0.91800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575965,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311996,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059844,"statfs":{"total":96636764160,"available":96317280256,"internally_reserved":0,"allocated":2674688,"data_stored":1424814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56799999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.432,"15min":0.44},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.58099999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"last":0.30499999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52700000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.37},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57099999999999995,"5min":0.72499999999999998,"15min":0.75800000000000001},"last":0.36199999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.58599999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60999999999999999,"5min":1.776,"15min":1.776},"last":0.41899999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.72399999999999998,"15min":0.70399999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.40500000000000003},"max":{"1min":1.0129999999999999,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.42699999999999999},"max":{"1min":0.86399999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.68400000000000005}]},{"osd":5,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67500000000000004,"15min":0.65900000000000003},"min":{"1min":0.435,"5min":0.39100000000000001,"15min":0.378},"max":{"1min":0.83399999999999996,"5min":3.766,"15min":3.766},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.877,"5min":0.98399999999999999,"15min":1.028},"last":0.67500000000000004}]},{"osd":6,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.52900000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94499999999999995,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.40699999999999997},"max":{"1min":0.85399999999999998,"5min":0.97799999999999998,"15min":1.0549999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.47599999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.107},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575966,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316072,"kb_used_data":2592,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055768,"statfs":{"total":96636764160,"available":96313106432,"internally_reserved":0,"allocated":2654208,"data_stored":1424044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.47499999999999998,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.27000000000000002,"15min":0.253},"max":{"1min":0.64000000000000001,"5min":8.5280000000000005,"15min":8.5280000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.26900000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69299999999999995,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.39900000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39800000000000002,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.34399999999999997,"5min":0.31,"15min":0.29499999999999998},"max":{"1min":0.66200000000000003,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.442}]},{"osd":3,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.621,"5min":0.65900000000000003,"15min":0.70099999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54600000000000004,"15min":0.495},"min":{"1min":0.376,"5min":0.32500000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":8.7200000000000006,"15min":8.7200000000000006},"last":0.379}]},{"osd":4,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.70799999999999996,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89500000000000002,"5min":8.5890000000000004,"15min":8.5890000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64100000000000001,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88800000000000001,"5min":0.97199999999999998,"15min":0.98399999999999999},"last":0.82099999999999995}]},{"osd":5,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.66600000000000004},"min":{"1min":0.442,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85399999999999998,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.74299999999999999,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94699999999999995,"5min":8.625,"15min":8.625},"last":0.72499999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.52200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.89400000000000002,"5min":1.0269999999999999,"15min":1.113},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67700000000000005,"15min":0.70199999999999996},"min":{"1min":0.47299999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.0660000000000001},"last":0.73499999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69099999999999995,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93500000000000005,"5min":0.995,"15min":1.0680000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.71399999999999997},"min":{"1min":0.505,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91200000000000003,"5min":1.089,"15min":1.1499999999999999},"last":0.77600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575967,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311980,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059860,"statfs":{"total":96636764160,"available":96317296640,"internally_reserved":0,"allocated":2658304,"data_stored":1424134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.40000000000000002,"15min":0.40100000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26100000000000001},"max":{"1min":0.51700000000000002,"5min":0.624,"15min":0.65100000000000002},"last":0.311},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40699999999999997,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.56299999999999994,"5min":0.64400000000000002,"15min":0.65800000000000003},"last":0.52000000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.41499999999999998,"15min":0.42099999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.33700000000000002,"5min":0.29599999999999999,"15min":0.28599999999999998},"max":{"1min":0.59899999999999998,"5min":0.67100000000000004,"15min":0.76600000000000001},"last":0.45200000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47099999999999997,"15min":0.47399999999999998},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.308},"max":{"1min":0.58699999999999997,"5min":0.69699999999999995,"15min":0.72299999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.51100000000000001,"15min":0.51400000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64100000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40400000000000003}]},{"osd":4,"last update":"Wed Nov 15 02:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.64600000000000002,"15min":0.65200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":0.79200000000000004,"5min":0.90100000000000002,"15min":1.0149999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.65000000000000002,"15min":0.66100000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90700000000000003,"5min":1.04,"15min":1.04},"last":0.94199999999999995}]},{"osd":5,"last update":"Wed Nov 15 02:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.68000000000000005,"15min":0.68300000000000005},"min":{"1min":0.436,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80900000000000005,"5min":1.0569999999999999,"15min":1.1100000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.44800000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Wed Nov 15 02:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68200000000000005,"15min":0.68700000000000006},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.40999999999999998},"max":{"1min":0.90100000000000002,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.873,"5min":1.0069999999999999,"15min":1.0720000000000001},"last":0.69199999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.70399999999999996,"15min":0.71099999999999997},"min":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79300000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94399999999999995,"5min":0.97999999999999998,"15min":1.071},"last":0.88400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575965,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303796,"kb_used_data":2604,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068044,"statfs":{"total":96636764160,"available":96325677056,"internally_reserved":0,"allocated":2666496,"data_stored":1424722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.47099999999999997,"5min":0.38500000000000001,"15min":0.28299999999999997},"max":{"1min":0.79600000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.45200000000000001,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.79000000000000004,"15min":0.97199999999999998},"last":0.51500000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.442,"5min":0.41099999999999998,"15min":0.34999999999999998},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.89900000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.33600000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.88700000000000001},"last":0.443}]},{"osd":2,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.48199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.5},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.48999999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38300000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.83099999999999996},"last":0.45700000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.31,"15min":0.28100000000000003},"max":{"1min":0.69399999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.373},{"interface":"front","average":{"1min":0.496,"5min":0.502,"15min":0.497},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.315},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.76200000000000001},"last":0.47399999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34899999999999998,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.755,"5min":0.76500000000000001,"15min":0.79100000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56599999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.81799999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.34200000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.58199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575965,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307896,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063944,"statfs":{"total":96636764160,"available":96321478656,"internally_reserved":0,"allocated":2670592,"data_stored":1424780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.36599999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.80700000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.78700000000000003,"15min":0.86899999999999999},"last":0.69699999999999995}]},{"osd":1,"last update":"Wed Nov 15 02:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72599999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60099999999999998,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39500000000000002,"15min":0.33300000000000002},"max":{"1min":0.77300000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57799999999999996}]},{"osd":2,"last update":"Wed Nov 15 02:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76200000000000001,"5min":0.876,"15min":0.90000000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.81100000000000005},"last":0.63300000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60599999999999998,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.749,"5min":0.77000000000000002,"15min":0.78700000000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60799999999999998,"15min":0.59899999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.34399999999999997},"max":{"1min":0.80500000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51100000000000001}]},{"osd":4,"last update":"Wed Nov 15 02:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.33000000000000002,"5min":0.308,"15min":0.27900000000000003},"max":{"1min":0.63100000000000001,"5min":0.70099999999999996,"15min":0.751},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.43099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.76800000000000002,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.64300000000000002}]},{"osd":6,"last update":"Wed Nov 15 02:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.47999999999999998,"15min":0.47699999999999998},"min":{"1min":0.33700000000000002,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.67300000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32900000000000001,"5min":0.313,"15min":0.312},"max":{"1min":0.74299999999999999,"5min":0.753,"15min":0.75600000000000001},"last":0.52000000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.503,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.68300000000000005,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.45000000000000001,"5min":0.40799999999999997,"15min":0.35199999999999998},"max":{"1min":0.75700000000000001,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:55:26.005 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-15T02:55:26.006 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-15T02:55:26.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.161+0000 7fe12b5f1700 1 Processor -- start 2023-11-15T02:55:26.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.162+0000 7fe12b5f1700 1 -- start start 2023-11-15T02:55:26.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.162+0000 7fe12b5f1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1240c6650 0x7fe1240aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:26.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.162+0000 7fe12b5f1700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1240ca050 con 0x7fe124154480 2023-11-15T02:55:26.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.162+0000 7fe12b5f1700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1240c9440 con 0x7fe1241540a0 2023-11-15T02:55:26.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.162+0000 7fe12b5f1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240c9720 con 0x7fe1240c6650 2023-11-15T02:55:26.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.163+0000 7fe128b8c700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe124154480 0x7fe1240c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:50118/0 (socket says 172.21.15.1:50118) 2023-11-15T02:55:26.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.163+0000 7fe128b8c700 1 -- 172.21.15.1:0/2856051920 learned_addr learned my addr 172.21.15.1:0/2856051920 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:26.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.163+0000 7fe129b8e700 1 --2- 172.21.15.1:0/2856051920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1240c6650 0x7fe1240aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:26.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.163+0000 7fe123fff700 1 -- 172.21.15.1:0/2856051920 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453992536 0 0) 0x7fe1240ca050 con 0x7fe124154480 2023-11-15T02:55:26.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.163+0000 7fe123fff700 1 -- 172.21.15.1:0/2856051920 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe10c0033f0 con 0x7fe124154480 2023-11-15T02:55:26.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.163+0000 7fe123fff700 1 -- 172.21.15.1:0/2856051920 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284566651 0 0) 0x7fe1240c9440 con 0x7fe1241540a0 2023-11-15T02:55:26.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.163+0000 7fe123fff700 1 -- 172.21.15.1:0/2856051920 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1240ca050 con 0x7fe1241540a0 2023-11-15T02:55:26.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.163+0000 7fe123fff700 1 -- 172.21.15.1:0/2856051920 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4238532506 0 0) 0x7fe10c0033f0 con 0x7fe124154480 2023-11-15T02:55:26.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.163+0000 7fe129b8e700 1 -- 172.21.15.1:0/2856051920 >> v1:172.21.15.141:6789/0 conn(0x7fe1241540a0 legacy=0x7fe1240ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:26.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.163+0000 7fe129b8e700 1 -- 172.21.15.1:0/2856051920 >> v1:172.21.15.1:6789/0 conn(0x7fe124154480 legacy=0x7fe1240c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:26.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.163+0000 7fe129b8e700 1 -- 172.21.15.1:0/2856051920 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1240c9a00 con 0x7fe1240c6650 2023-11-15T02:55:26.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.163+0000 7fe129b8e700 1 --2- 172.21.15.1:0/2856051920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1240c6650 0x7fe1240aaf40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fe114009e90 tx=0x7fe114009780).ready entity=mon.2 client_cookie=94d405b38436e497 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:26.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.163+0000 7fe123fff700 1 -- 172.21.15.1:0/2856051920 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11400e070 con 0x7fe1240c6650 2023-11-15T02:55:26.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.164+0000 7fe123fff700 1 -- 172.21.15.1:0/2856051920 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11400b7a0 con 0x7fe1240c6650 2023-11-15T02:55:26.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.164+0000 7fe123fff700 1 -- 172.21.15.1:0/2856051920 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118001470 con 0x7fe1240c6650 2023-11-15T02:55:26.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.164+0000 7fe12b5f1700 1 -- 172.21.15.1:0/2856051920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1240c6650 msgr2=0x7fe1240aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:26.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.164+0000 7fe12b5f1700 1 --2- 172.21.15.1:0/2856051920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1240c6650 0x7fe1240aaf40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fe114009e90 tx=0x7fe114009780).stop 2023-11-15T02:55:26.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.164+0000 7fe12b5f1700 1 -- 172.21.15.1:0/2856051920 shutdown_connections 2023-11-15T02:55:26.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.164+0000 7fe12b5f1700 1 --2- 172.21.15.1:0/2856051920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1240c6650 0x7fe1240aaf40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:26.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.164+0000 7fe12b5f1700 1 -- 172.21.15.1:0/2856051920 >> 172.21.15.1:0/2856051920 conn(0x7fe124064a70 msgr2=0x7fe124064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:26.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.164+0000 7fe12b5f1700 1 -- 172.21.15.1:0/2856051920 shutdown_connections 2023-11-15T02:55:26.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.164+0000 7fe12b5f1700 1 -- 172.21.15.1:0/2856051920 wait complete. 2023-11-15T02:55:26.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.165+0000 7fe12b5f1700 1 Processor -- start 2023-11-15T02:55:26.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.165+0000 7fe12b5f1700 1 -- start start 2023-11-15T02:55:26.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.166+0000 7fe12b5f1700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1240c6650 0x7fe1240c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:26.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.166+0000 7fe12b5f1700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1241540a0 0x7fe124147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:26.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.166+0000 7fe12b5f1700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe124154480 0x7fe12414bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:26.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.166+0000 7fe12b5f1700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240c2540 con 0x7fe1240c6650 2023-11-15T02:55:26.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.166+0000 7fe12b5f1700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240b0310 con 0x7fe124154480 2023-11-15T02:55:26.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.166+0000 7fe12b5f1700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240c3730 con 0x7fe1241540a0 2023-11-15T02:55:26.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.166+0000 7fe12938d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1240c6650 0x7fe1240c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:26.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.166+0000 7fe12938d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1240c6650 0x7fe1240c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36426/0 (socket says 172.21.15.1:36426) 2023-11-15T02:55:26.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.166+0000 7fe12938d700 1 -- 172.21.15.1:0/3143233429 learned_addr learned my addr 172.21.15.1:0/3143233429 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:26.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.166+0000 7fe129b8e700 1 --2- 172.21.15.1:0/3143233429 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe124154480 0x7fe12414bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:26.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.166+0000 7fe128b8c700 1 --2- 172.21.15.1:0/3143233429 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1241540a0 0x7fe124147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:26.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.166+0000 7fe12938d700 1 -- 172.21.15.1:0/3143233429 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1241540a0 msgr2=0x7fe124147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:26.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.166+0000 7fe12938d700 1 --2- 172.21.15.1:0/3143233429 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1241540a0 0x7fe124147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:26.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.167+0000 7fe12938d700 1 -- 172.21.15.1:0/3143233429 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe124154480 msgr2=0x7fe12414bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:26.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.167+0000 7fe12938d700 1 --2- 172.21.15.1:0/3143233429 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe124154480 0x7fe12414bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:26.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.167+0000 7fe12938d700 1 -- 172.21.15.1:0/3143233429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe114009a20 con 0x7fe1240c6650 2023-11-15T02:55:26.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.167+0000 7fe12938d700 1 --2- 172.21.15.1:0/3143233429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1240c6650 0x7fe1240c3100 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7fe11c00c4c0 tx=0x7fe11c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:26.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.167+0000 7fe1217fa700 1 -- 172.21.15.1:0/3143233429 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c00ce10 con 0x7fe1240c6650 2023-11-15T02:55:26.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.167+0000 7fe1217fa700 1 -- 172.21.15.1:0/3143233429 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c00f470 con 0x7fe1240c6650 2023-11-15T02:55:26.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.167+0000 7fe12b5f1700 1 -- 172.21.15.1:0/3143233429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1240afcc0 con 0x7fe1240c6650 2023-11-15T02:55:26.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.167+0000 7fe1217fa700 1 -- 172.21.15.1:0/3143233429 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c00f830 con 0x7fe1240c6650 2023-11-15T02:55:26.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.167+0000 7fe12b5f1700 1 -- 172.21.15.1:0/3143233429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1240af970 con 0x7fe1240c6650 2023-11-15T02:55:26.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.168+0000 7fe12b5f1700 1 -- 172.21.15.1:0/3143233429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12406c7e0 con 0x7fe1240c6650 2023-11-15T02:55:26.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.168+0000 7fe1217fa700 1 -- 172.21.15.1:0/3143233429 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe11c00fc20 con 0x7fe1240c6650 2023-11-15T02:55:26.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.169+0000 7fe1217fa700 1 --2- 172.21.15.1:0/3143233429 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe11005f270 0x7fe110061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:26.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.169+0000 7fe1217fa700 1 -- 172.21.15.1:0/3143233429 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6673+0+0 (secure 0 0 0) 0x7fe11c079a00 con 0x7fe1240c6650 2023-11-15T02:55:26.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.169+0000 7fe128b8c700 1 --2- 172.21.15.1:0/3143233429 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe11005f270 0x7fe110061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:26.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.169+0000 7fe128b8c700 1 --2- 172.21.15.1:0/3143233429 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe11005f270 0x7fe110061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe1240ac730 tx=0x7fe118001930).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:26.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.173+0000 7fe1217fa700 1 -- 172.21.15.1:0/3143233429 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe11c048af0 con 0x7fe1240c6650 2023-11-15T02:55:26.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.413+0000 7fe12b5f1700 1 -- 172.21.15.1:0/3143233429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe1240c9ce0 con 0x7fe1240c6650 2023-11-15T02:55:26.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.416+0000 7fe1217fa700 1 -- 172.21.15.1:0/3143233429 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v52) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe11c04a9d0 con 0x7fe1240c6650 2023-11-15T02:55:26.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.418+0000 7fe12b5f1700 1 -- 172.21.15.1:0/3143233429 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe11005f270 msgr2=0x7fe110061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:26.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.418+0000 7fe12b5f1700 1 --2- 172.21.15.1:0/3143233429 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe11005f270 0x7fe110061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe1240ac730 tx=0x7fe118001930).stop 2023-11-15T02:55:26.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.418+0000 7fe12b5f1700 1 -- 172.21.15.1:0/3143233429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1240c6650 msgr2=0x7fe1240c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:26.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.418+0000 7fe12b5f1700 1 --2- 172.21.15.1:0/3143233429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1240c6650 0x7fe1240c3100 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7fe11c00c4c0 tx=0x7fe11c007c10).stop 2023-11-15T02:55:26.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.418+0000 7fe12b5f1700 1 -- 172.21.15.1:0/3143233429 shutdown_connections 2023-11-15T02:55:26.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.418+0000 7fe12b5f1700 1 --2- 172.21.15.1:0/3143233429 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe11005f270 0x7fe110061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:26.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.418+0000 7fe12b5f1700 1 --2- 172.21.15.1:0/3143233429 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe124154480 0x7fe12414bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:26.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.418+0000 7fe12b5f1700 1 --2- 172.21.15.1:0/3143233429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1240c6650 0x7fe1240c3100 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:26.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.418+0000 7fe12b5f1700 1 --2- 172.21.15.1:0/3143233429 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe1241540a0 0x7fe124147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:26.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.418+0000 7fe12b5f1700 1 -- 172.21.15.1:0/3143233429 >> 172.21.15.1:0/3143233429 conn(0x7fe124064a70 msgr2=0x7fe12414f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:26.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.419+0000 7fe12b5f1700 1 -- 172.21.15.1:0/3143233429 shutdown_connections 2023-11-15T02:55:26.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.419+0000 7fe12b5f1700 1 -- 172.21.15.1:0/3143233429 wait complete. 2023-11-15T02:55:26.422 INFO:teuthology.orchestra.run.smithi001.stderr:updated caps for client.0 2023-11-15T02:55:26.431 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:55:26.512 INFO:tasks.ceph.mds.d.smithi141.stderr:2023-11-15T02:55:26.510+0000 7f3b386b3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T02:55:26.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.549+0000 7f2ba815b700 1 Processor -- start 2023-11-15T02:55:26.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.549+0000 7f2ba815b700 1 -- start start 2023-11-15T02:55:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.550+0000 7f2ba815b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2ba0154150 0x7f2ba0154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.550+0000 7f2ba815b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ba00ab1a0 0x7f2ba0158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.550+0000 7f2ba815b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba00c06f0 con 0x7f2ba00aa060 2023-11-15T02:55:26.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.550+0000 7f2ba815b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba00c09d0 con 0x7f2ba0154150 2023-11-15T02:55:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.550+0000 7f2ba815b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0158820 con 0x7f2ba00ab1a0 2023-11-15T02:55:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.550+0000 7f2ba5ef7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2ba0154150 0x7f2ba0154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.550+0000 7f2ba66f8700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2ba00aa060 0x7f2ba00c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:50120/0 (socket says 172.21.15.1:50120) 2023-11-15T02:55:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.550+0000 7f2ba66f8700 1 -- 172.21.15.1:0/908068581 learned_addr learned my addr 172.21.15.1:0/908068581 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:26.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.551+0000 7f2ba56f6700 1 --2- 172.21.15.1:0/908068581 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ba00ab1a0 0x7f2ba0158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.551+0000 7f2ba5ef7700 1 -- 172.21.15.1:0/908068581 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ba00ab1a0 msgr2=0x7f2ba0158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.551+0000 7f2ba5ef7700 1 --2- 172.21.15.1:0/908068581 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ba00ab1a0 0x7f2ba0158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.551+0000 7f2ba5ef7700 1 -- 172.21.15.1:0/908068581 >> v1:172.21.15.1:6789/0 conn(0x7f2ba00aa060 legacy=0x7f2ba00c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.551+0000 7f2ba4ef5700 1 -- 172.21.15.1:0/908068581 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328956882 0 0) 0x7f2ba00c06f0 con 0x7f2ba00aa060 2023-11-15T02:55:26.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.551+0000 7f2ba5ef7700 1 -- 172.21.15.1:0/908068581 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba0158b00 con 0x7f2ba0154150 2023-11-15T02:55:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.551+0000 7f2ba5ef7700 1 --2- 172.21.15.1:0/908068581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba0154150 0x7f2ba0154530 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7f2b98009760 tx=0x7f2b98009060).ready entity=mon.0 client_cookie=308dc984971bc2e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.551+0000 7f2ba4ef5700 1 -- 172.21.15.1:0/908068581 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b980090d0 con 0x7f2ba0154150 2023-11-15T02:55:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.551+0000 7f2ba4ef5700 1 -- 172.21.15.1:0/908068581 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9800b580 con 0x7f2ba0154150 2023-11-15T02:55:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.551+0000 7f2ba4ef5700 1 -- 172.21.15.1:0/908068581 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9800b900 con 0x7f2ba0154150 2023-11-15T02:55:26.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.551+0000 7f2ba815b700 1 -- 172.21.15.1:0/908068581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba0154150 msgr2=0x7f2ba0154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:26.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.551+0000 7f2ba815b700 1 --2- 172.21.15.1:0/908068581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba0154150 0x7f2ba0154530 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7f2b98009760 tx=0x7f2b98009060).stop 2023-11-15T02:55:26.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.551+0000 7f2ba815b700 1 -- 172.21.15.1:0/908068581 shutdown_connections 2023-11-15T02:55:26.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.551+0000 7f2ba815b700 1 --2- 172.21.15.1:0/908068581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba0154150 0x7f2ba0154530 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:26.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.551+0000 7f2ba815b700 1 --2- 172.21.15.1:0/908068581 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ba00ab1a0 0x7f2ba0158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:26.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.552+0000 7f2ba815b700 1 -- 172.21.15.1:0/908068581 >> 172.21.15.1:0/908068581 conn(0x7f2ba0064aa0 msgr2=0x7f2ba0064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:26.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.552+0000 7f2ba815b700 1 -- 172.21.15.1:0/908068581 shutdown_connections 2023-11-15T02:55:26.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.552+0000 7f2ba815b700 1 -- 172.21.15.1:0/908068581 wait complete. 2023-11-15T02:55:26.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.553+0000 7f2ba815b700 1 Processor -- start 2023-11-15T02:55:26.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.553+0000 7f2ba815b700 1 -- start start 2023-11-15T02:55:26.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba815b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba00aa060 0x7f2ba00cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:26.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba815b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ba00ab1a0 0x7f2ba00c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:26.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba815b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ba0154150 0x7f2ba00c2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:26.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba815b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00c2b20 con 0x7f2ba00aa060 2023-11-15T02:55:26.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba815b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00cadc0 con 0x7f2ba0154150 2023-11-15T02:55:26.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba815b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00ca1b0 con 0x7f2ba00ab1a0 2023-11-15T02:55:26.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba5ef7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba00aa060 0x7f2ba00cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:26.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba5ef7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba00aa060 0x7f2ba00cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36440/0 (socket says 172.21.15.1:36440) 2023-11-15T02:55:26.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba5ef7700 1 -- 172.21.15.1:0/4077690140 learned_addr learned my addr 172.21.15.1:0/4077690140 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:26.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba5ef7700 1 -- 172.21.15.1:0/4077690140 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ba00ab1a0 msgr2=0x7f2ba00c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:26.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba5ef7700 1 --2- 172.21.15.1:0/4077690140 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ba00ab1a0 0x7f2ba00c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:26.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba5ef7700 1 -- 172.21.15.1:0/4077690140 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ba0154150 msgr2=0x7f2ba00c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:26.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba5ef7700 1 --2- 172.21.15.1:0/4077690140 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ba0154150 0x7f2ba00c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:26.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba5ef7700 1 -- 172.21.15.1:0/4077690140 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b980092a0 con 0x7f2ba00aa060 2023-11-15T02:55:26.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba5ef7700 1 --2- 172.21.15.1:0/4077690140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba00aa060 0x7f2ba00cb250 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7f2b98009eb0 tx=0x7f2b98017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:26.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2b9dffb700 1 -- 172.21.15.1:0/4077690140 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9800b900 con 0x7f2ba00aa060 2023-11-15T02:55:26.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2b9dffb700 1 -- 172.21.15.1:0/4077690140 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b98006950 con 0x7f2ba00aa060 2023-11-15T02:55:26.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba815b700 1 -- 172.21.15.1:0/4077690140 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba00ca490 con 0x7f2ba00aa060 2023-11-15T02:55:26.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2b9dffb700 1 -- 172.21.15.1:0/4077690140 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9801b440 con 0x7f2ba00aa060 2023-11-15T02:55:26.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.554+0000 7f2ba815b700 1 -- 172.21.15.1:0/4077690140 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba00caa50 con 0x7f2ba00aa060 2023-11-15T02:55:26.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.556+0000 7f2ba815b700 1 -- 172.21.15.1:0/4077690140 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba00cb0a0 con 0x7f2ba00aa060 2023-11-15T02:55:26.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.556+0000 7f2b9dffb700 1 -- 172.21.15.1:0/4077690140 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2b9801b870 con 0x7f2ba00aa060 2023-11-15T02:55:26.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.556+0000 7f2b9dffb700 1 --2- 172.21.15.1:0/4077690140 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f2b8c05f270 0x7f2b8c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:26.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.556+0000 7f2b9dffb700 1 -- 172.21.15.1:0/4077690140 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6673+0+0 (secure 0 0 0) 0x7f2b9807bd80 con 0x7f2ba00aa060 2023-11-15T02:55:26.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.557+0000 7f2ba56f6700 1 --2- 172.21.15.1:0/4077690140 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f2b8c05f270 0x7f2b8c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:26.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.557+0000 7f2ba56f6700 1 --2- 172.21.15.1:0/4077690140 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f2b8c05f270 0x7f2b8c061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2ba00cbce0 tx=0x7f2b94008040).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:26.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.561+0000 7f2b9dffb700 1 -- 172.21.15.1:0/4077690140 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2b9804cc40 con 0x7f2ba00aa060 2023-11-15T02:55:26.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.776+0000 7f2ba815b700 1 -- 172.21.15.1:0/4077690140 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ba006c7e0 con 0x7f2ba00aa060 2023-11-15T02:55:26.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.776+0000 7f2b9dffb700 1 -- 172.21.15.1:0/4077690140 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f2b98050260 con 0x7f2ba00aa060 2023-11-15T02:55:26.778 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:26.778 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":95,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10101,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2281092627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2281092627},{"type":"v1","addr":"172.21.15.1:6833","nonce":2281092627}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":10104,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3718177238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3718177238},{"type":"v1","addr":"172.21.15.1:6835","nonce":3718177238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":10113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3331826313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3331826313},{"type":"v1","addr":"172.21.15.141:6836","nonce":3331826313}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:55:21.588380+0000","modified":"2023-11-15T02:55:24.600875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10116":{"gid":10116,"name":"d","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/1145495775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1145495775},{"type":"v1","addr":"172.21.15.141:6837","nonce":1145495775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-11-15T02:55:26.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.778+0000 7f2ba815b700 1 -- 172.21.15.1:0/4077690140 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f2b8c05f270 msgr2=0x7f2b8c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:26.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.778+0000 7f2ba815b700 1 --2- 172.21.15.1:0/4077690140 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f2b8c05f270 0x7f2b8c061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2ba00cbce0 tx=0x7f2b94008040).stop 2023-11-15T02:55:26.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.778+0000 7f2ba815b700 1 -- 172.21.15.1:0/4077690140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba00aa060 msgr2=0x7f2ba00cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:26.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.778+0000 7f2ba815b700 1 --2- 172.21.15.1:0/4077690140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba00aa060 0x7f2ba00cb250 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7f2b98009eb0 tx=0x7f2b98017000).stop 2023-11-15T02:55:26.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.778+0000 7f2ba815b700 1 -- 172.21.15.1:0/4077690140 shutdown_connections 2023-11-15T02:55:26.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.778+0000 7f2ba815b700 1 --2- 172.21.15.1:0/4077690140 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f2b8c05f270 0x7f2b8c061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:26.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.778+0000 7f2ba815b700 1 --2- 172.21.15.1:0/4077690140 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ba0154150 0x7f2ba00c2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:26.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.778+0000 7f2ba815b700 1 --2- 172.21.15.1:0/4077690140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba00aa060 0x7f2ba00cb250 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:26.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.778+0000 7f2ba815b700 1 --2- 172.21.15.1:0/4077690140 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ba00ab1a0 0x7f2ba00c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:26.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.778+0000 7f2ba815b700 1 -- 172.21.15.1:0/4077690140 >> 172.21.15.1:0/4077690140 conn(0x7f2ba0064aa0 msgr2=0x7f2ba00ac610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:26.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.778+0000 7f2ba815b700 1 -- 172.21.15.1:0/4077690140 shutdown_connections 2023-11-15T02:55:26.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:26.778+0000 7f2ba815b700 1 -- 172.21.15.1:0/4077690140 wait complete. 2023-11-15T02:55:26.782 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 95 2023-11-15T02:55:27.194 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 95, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-15T02:55:21.588380+0000', 'modified': '2023-11-15T02:55:24.600875+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10116}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10116': {'gid': 10116, 'name': 'd', 'rank': 0, 'incarnation': 91, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.141:6837/1145495775', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6835', 'nonce': 1145495775}, {'type': 'v1', 'addr': '172.21.15.141:6837', 'nonce': 1145495775}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-15T02:55:27.195 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-15T02:55:27.195 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-15T02:55:27.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.316+0000 7f01f8c6a700 1 Processor -- start 2023-11-15T02:55:27.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.316+0000 7f01f8c6a700 1 -- start start 2023-11-15T02:55:27.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.317+0000 7f01f8c6a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f01f41579f0 0x7f01f40657e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.317+0000 7f01f8c6a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f01f4062ec0 0x7f01f40a4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.317+0000 7f01f8c6a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f4066a80 con 0x7f01f4157dd0 2023-11-15T02:55:27.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.317+0000 7f01f8c6a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f4066f10 con 0x7f01f41579f0 2023-11-15T02:55:27.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.317+0000 7f01f8c6a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f4065e70 con 0x7f01f4062ec0 2023-11-15T02:55:27.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.317+0000 7f01f37fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f01f41579f0 0x7f01f40657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.317+0000 7f01f37fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f01f41579f0 0x7f01f40657e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36452/0 (socket says 172.21.15.1:36452) 2023-11-15T02:55:27.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.317+0000 7f01f37fe700 1 -- 172.21.15.1:0/3341707703 learned_addr learned my addr 172.21.15.1:0/3341707703 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:27.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.317+0000 7f01f3fff700 1 --2- 172.21.15.1:0/3341707703 >> v2:172.21.15.141:3300/0 conn(0x7f01f4062ec0 0x7f01f40a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.317+0000 7f01f37fe700 1 -- 172.21.15.1:0/3341707703 >> v2:172.21.15.141:3300/0 conn(0x7f01f4062ec0 msgr2=0x7f01f40a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:27.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.317+0000 7f01f37fe700 1 --2- 172.21.15.1:0/3341707703 >> v2:172.21.15.141:3300/0 conn(0x7f01f4062ec0 0x7f01f40a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.317+0000 7f01f37fe700 1 -- 172.21.15.1:0/3341707703 >> v1:172.21.15.141:6789/0 conn(0x7f01f4157dd0 legacy=0x7f01f40627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:27.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.317+0000 7f01f37fe700 1 -- 172.21.15.1:0/3341707703 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f4066150 con 0x7f01f41579f0 2023-11-15T02:55:27.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.318+0000 7f01f37fe700 1 --2- 172.21.15.1:0/3341707703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f41579f0 0x7f01f40657e0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7f01f405f200 tx=0x7f01e40090f0).ready entity=mon.0 client_cookie=bf91425134efb1c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:27.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.318+0000 7f01f27fc700 1 -- 172.21.15.1:0/3341707703 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e400b5a0 con 0x7f01f41579f0 2023-11-15T02:55:27.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.318+0000 7f01f27fc700 1 -- 172.21.15.1:0/3341707703 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e400b700 con 0x7f01f41579f0 2023-11-15T02:55:27.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.318+0000 7f01f27fc700 1 -- 172.21.15.1:0/3341707703 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e400ba80 con 0x7f01f41579f0 2023-11-15T02:55:27.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.318+0000 7f01f8c6a700 1 -- 172.21.15.1:0/3341707703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f41579f0 msgr2=0x7f01f40657e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.318+0000 7f01f8c6a700 1 --2- 172.21.15.1:0/3341707703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f41579f0 0x7f01f40657e0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7f01f405f200 tx=0x7f01e40090f0).stop 2023-11-15T02:55:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.318+0000 7f01f8c6a700 1 -- 172.21.15.1:0/3341707703 shutdown_connections 2023-11-15T02:55:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.318+0000 7f01f8c6a700 1 --2- 172.21.15.1:0/3341707703 >> v2:172.21.15.141:3300/0 conn(0x7f01f4062ec0 0x7f01f40a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.318+0000 7f01f8c6a700 1 --2- 172.21.15.1:0/3341707703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f41579f0 0x7f01f40657e0 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.318+0000 7f01f8c6a700 1 -- 172.21.15.1:0/3341707703 >> 172.21.15.1:0/3341707703 conn(0x7f01f40c7c10 msgr2=0x7f01f40c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.318+0000 7f01f8c6a700 1 -- 172.21.15.1:0/3341707703 shutdown_connections 2023-11-15T02:55:27.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.318+0000 7f01f8c6a700 1 -- 172.21.15.1:0/3341707703 wait complete. 2023-11-15T02:55:27.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.320+0000 7f01f8c6a700 1 Processor -- start 2023-11-15T02:55:27.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.320+0000 7f01f8c6a700 1 -- start start 2023-11-15T02:55:27.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.320+0000 7f01f8c6a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f01f4062ec0 0x7f01f4158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.320+0000 7f01f8c6a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f01f41579f0 0x7f01f41649d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.320+0000 7f01f8c6a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f4157dd0 0x7f01f4164ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.320+0000 7f01f8c6a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40ac970 con 0x7f01f4157dd0 2023-11-15T02:55:27.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.320+0000 7f01f8c6a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40abd60 con 0x7f01f41579f0 2023-11-15T02:55:27.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.320+0000 7f01f8c6a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40ac040 con 0x7f01f4062ec0 2023-11-15T02:55:27.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01f3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f4157dd0 0x7f01f4164ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01f3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f4157dd0 0x7f01f4164ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36462/0 (socket says 172.21.15.1:36462) 2023-11-15T02:55:27.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01f3fff700 1 -- 172.21.15.1:0/3666902097 learned_addr learned my addr 172.21.15.1:0/3666902097 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:27.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01f2ffd700 1 --2- 172.21.15.1:0/3666902097 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f01f41579f0 0x7f01f41649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01f37fe700 1 --2- 172.21.15.1:0/3666902097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f01f4062ec0 0x7f01f4158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01f3fff700 1 -- 172.21.15.1:0/3666902097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f01f4062ec0 msgr2=0x7f01f4158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01f3fff700 1 --2- 172.21.15.1:0/3666902097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f01f4062ec0 0x7f01f4158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01f3fff700 1 -- 172.21.15.1:0/3666902097 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f01f41579f0 msgr2=0x7f01f41649d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01f3fff700 1 --2- 172.21.15.1:0/3666902097 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f01f41579f0 0x7f01f41649d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01f3fff700 1 -- 172.21.15.1:0/3666902097 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e4009370 con 0x7f01f4157dd0 2023-11-15T02:55:27.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01f37fe700 1 --2- 172.21.15.1:0/3666902097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f01f4062ec0 0x7f01f4158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:27.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01f3fff700 1 --2- 172.21.15.1:0/3666902097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f4157dd0 0x7f01f4164ec0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7f01ec007f30 tx=0x7f01ec0098e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:27.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01db7fe700 1 -- 172.21.15.1:0/3666902097 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec00ecf0 con 0x7f01f4157dd0 2023-11-15T02:55:27.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01db7fe700 1 -- 172.21.15.1:0/3666902097 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec00ee50 con 0x7f01f4157dd0 2023-11-15T02:55:27.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01db7fe700 1 -- 172.21.15.1:0/3666902097 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec014610 con 0x7f01f4157dd0 2023-11-15T02:55:27.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01f8c6a700 1 -- 172.21.15.1:0/3666902097 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f40ac320 con 0x7f01f4157dd0 2023-11-15T02:55:27.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.321+0000 7f01f8c6a700 1 -- 172.21.15.1:0/3666902097 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f4158d20 con 0x7f01f4157dd0 2023-11-15T02:55:27.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.323+0000 7f01db7fe700 1 -- 172.21.15.1:0/3666902097 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f01ec0149c0 con 0x7f01f4157dd0 2023-11-15T02:55:27.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.323+0000 7f01db7fe700 1 --2- 172.21.15.1:0/3666902097 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f01e005f270 0x7f01e0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.323+0000 7f01db7fe700 1 -- 172.21.15.1:0/3666902097 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6673+0+0 (secure 0 0 0) 0x7f01ec07ab30 con 0x7f01f4157dd0 2023-11-15T02:55:27.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.323+0000 7f01f37fe700 1 --2- 172.21.15.1:0/3666902097 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f01e005f270 0x7f01e0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.324+0000 7f01f37fe700 1 --2- 172.21.15.1:0/3666902097 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f01e005f270 0x7f01e0061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f01e400c010 tx=0x7f01e4015000).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.325+0000 7f020b865b80 1 Processor -- start 2023-11-15T02:55:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.325+0000 7f020b865b80 1 -- start start 2023-11-15T02:55:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.326+0000 7f020b865b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cd35e40 0x555d2cf79880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.326+0000 7f020b865b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cfc24e0 0x555d2cf79d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.326+0000 7f020b865b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfa1cf0 0x555d2cf747e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.326+0000 7f020b865b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2cf3f060 con 0x555d2cfa1cf0 2023-11-15T02:55:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.326+0000 7f020b865b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2ceb61f0 con 0x555d2cd35e40 2023-11-15T02:55:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.326+0000 7f020b865b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d2cecb440 con 0x555d2cfc24e0 2023-11-15T02:55:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.326+0000 7f01f3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfa1cf0 0x555d2cf747e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.326+0000 7f01f3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfa1cf0 0x555d2cf747e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36478/0 (socket says 172.21.15.1:36478) 2023-11-15T02:55:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.326+0000 7f01f37fe700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cd35e40 0x555d2cf79880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.326+0000 7f01f3fff700 1 -- 172.21.15.1:0/2400064704 learned_addr learned my addr 172.21.15.1:0/2400064704 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.326+0000 7f01f2ffd700 1 --2- 172.21.15.1:0/2400064704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cfc24e0 0x555d2cf79d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.327+0000 7f01f3fff700 1 -- 172.21.15.1:0/2400064704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cfc24e0 msgr2=0x555d2cf79d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.327+0000 7f01f3fff700 1 --2- 172.21.15.1:0/2400064704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cfc24e0 0x555d2cf79d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.327+0000 7f01f3fff700 1 -- 172.21.15.1:0/2400064704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cd35e40 msgr2=0x555d2cf79880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.327+0000 7f01f3fff700 1 --2- 172.21.15.1:0/2400064704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cd35e40 0x555d2cf79880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.327+0000 7f01f3fff700 1 -- 172.21.15.1:0/2400064704 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d2cec4620 con 0x555d2cfa1cf0 2023-11-15T02:55:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.327+0000 7f01f3fff700 1 --2- 172.21.15.1:0/2400064704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfa1cf0 0x555d2cf747e0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7f01ec078cb0 tx=0x7f01ec011000).ready entity=mon.0 client_cookie=5f71a557be773bf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.327+0000 7f01d8ff9700 1 -- 172.21.15.1:0/2400064704 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec058030 con 0x555d2cfa1cf0 2023-11-15T02:55:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.327+0000 7f01d8ff9700 1 -- 172.21.15.1:0/2400064704 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec04d850 con 0x555d2cfa1cf0 2023-11-15T02:55:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.327+0000 7f01d8ff9700 1 -- 172.21.15.1:0/2400064704 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec04be20 con 0x555d2cfa1cf0 2023-11-15T02:55:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.327+0000 7f020b865b80 1 -- 172.21.15.1:0/2400064704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfa1cf0 msgr2=0x555d2cf747e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.327+0000 7f020b865b80 1 --2- 172.21.15.1:0/2400064704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfa1cf0 0x555d2cf747e0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7f01ec078cb0 tx=0x7f01ec011000).stop 2023-11-15T02:55:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.327+0000 7f020b865b80 1 -- 172.21.15.1:0/2400064704 shutdown_connections 2023-11-15T02:55:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.327+0000 7f020b865b80 1 --2- 172.21.15.1:0/2400064704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfa1cf0 0x555d2cf747e0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.327+0000 7f020b865b80 1 --2- 172.21.15.1:0/2400064704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cd35e40 0x555d2cf79880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.327+0000 7f020b865b80 1 --2- 172.21.15.1:0/2400064704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cfc24e0 0x555d2cf79d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.328+0000 7f020b865b80 1 -- 172.21.15.1:0/2400064704 >> 172.21.15.1:0/2400064704 conn(0x555d2cde34a0 msgr2=0x555d2cfc2970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.328+0000 7f020b865b80 1 -- 172.21.15.1:0/2400064704 shutdown_connections 2023-11-15T02:55:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.328+0000 7f020b865b80 1 -- 172.21.15.1:0/2400064704 wait complete. 2023-11-15T02:55:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.328+0000 7f020b865b80 1 -- start start 2023-11-15T02:55:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.328+0000 7f020b865b80 1 Processor -- start 2023-11-15T02:55:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f020b865b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cd35e40 0x555d2cfa8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f020b865b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cfa1cf0 0x555d2cfa5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f020b865b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfc24e0 0x555d2cfa5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f020b865b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2cecb580 con 0x555d2cd35e40 2023-11-15T02:55:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f020b865b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2cecb800 con 0x555d2cfc24e0 2023-11-15T02:55:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f020b865b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d2ce96e10 con 0x555d2cfa1cf0 2023-11-15T02:55:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f020b865b80 10 client.0 ll_register_callbacks cb 0x555d2cf39640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T02:55:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f01f37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cd35e40 0x555d2cfa8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f01f37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cd35e40 0x555d2cfa8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36486/0 (socket says 172.21.15.1:36486) 2023-11-15T02:55:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f01f37fe700 1 -- 172.21.15.1:0/3576869809 learned_addr learned my addr 172.21.15.1:0/3576869809 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f01f2ffd700 1 --2- 172.21.15.1:0/3576869809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cfa1cf0 0x555d2cfa5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f01f3fff700 1 --2- 172.21.15.1:0/3576869809 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfc24e0 0x555d2cfa5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f01f37fe700 1 -- 172.21.15.1:0/3576869809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cfa1cf0 msgr2=0x555d2cfa5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:27.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f01f37fe700 1 --2- 172.21.15.1:0/3576869809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cfa1cf0 0x555d2cfa5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f01f37fe700 1 -- 172.21.15.1:0/3576869809 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfc24e0 msgr2=0x555d2cfa5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:27.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f01f37fe700 1 --2- 172.21.15.1:0/3576869809 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfc24e0 0x555d2cfa5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.329+0000 7f01f37fe700 1 -- 172.21.15.1:0/3576869809 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f4158d20 con 0x555d2cd35e40 2023-11-15T02:55:27.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f01f37fe700 1 --2- 172.21.15.1:0/3576869809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cd35e40 0x555d2cfa8590 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 rx=0x7f01e4006fd0 tx=0x7f01e401e070).ready entity=mon.0 client_cookie=57f2937e0d997d3b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:27.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f01d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T02:55:27.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f01d1ffb700 1 -- 172.21.15.1:0/3576869809 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e40276f0 con 0x555d2cd35e40 2023-11-15T02:55:27.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f01d1ffb700 1 -- 172.21.15.1:0/3576869809 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(212..212 src has 1..212) v4 ==== 6673+0+0 (secure 0 0 0) 0x7f01e4027850 con 0x555d2cd35e40 2023-11-15T02:55:27.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f020b865b80 1 -- 172.21.15.1:0/3576869809 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d2cf6d720 con 0x555d2cd35e40 2023-11-15T02:55:27.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f01d1ffb700 1 -- 172.21.15.1:0/3576869809 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01e4027c20 con 0x555d2cd35e40 2023-11-15T02:55:27.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f020b865b80 10 client.10251 fetch_fsmap learned FSMap version 95 2023-11-15T02:55:27.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f020b865b80 1 -- 172.21.15.1:0/3576869809 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x555d2cebf9c0 con 0x555d2cd35e40 2023-11-15T02:55:27.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f01d1ffb700 1 -- 172.21.15.1:0/3576869809 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555d2cf6d720 con 0x555d2cd35e40 2023-11-15T02:55:27.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f01d1ffb700 1 -- 172.21.15.1:0/3576869809 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 95) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f01e4030420 con 0x555d2cd35e40 2023-11-15T02:55:27.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f020b865b80 10 client.10251 fetch_fsmap finished waiting for FSMap version 95 2023-11-15T02:55:27.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f020b865b80 10 client.10251 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-15T02:55:27.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f020b865b80 20 client.10251 populate_metadata read hostname 'smithi001' 2023-11-15T02:55:27.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f020b865b80 1 --2- 172.21.15.1:0/3576869809 >> [v2:172.21.15.141:6835/1145495775,v1:172.21.15.141:6837/1145495775] conn(0x555d2cf9dd10 0x555d2cfbffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f020b865b80 4 client.10251 mds_command: new command op to 10116 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-15T02:55:27.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f020b865b80 1 -- 172.21.15.1:0/3576869809 --> [v2:172.21.15.141:6835/1145495775,v1:172.21.15.141:6837/1145495775] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d2cd31ca0 con 0x555d2cf9dd10 2023-11-15T02:55:27.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.330+0000 7f01f2ffd700 1 --2- 172.21.15.1:0/3576869809 >> [v2:172.21.15.141:6835/1145495775,v1:172.21.15.141:6837/1145495775] conn(0x555d2cf9dd10 0x555d2cfbffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.331+0000 7f01d1ffb700 10 client.10251 ms_handle_connect on v2:172.21.15.141:6835/1145495775 2023-11-15T02:55:27.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.331+0000 7f01f2ffd700 1 --2- 172.21.15.1:0/3576869809 >> [v2:172.21.15.141:6835/1145495775,v1:172.21.15.141:6837/1145495775] conn(0x555d2cf9dd10 0x555d2cfbffd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3d6a2cf615b3e50d server_cookie=69f3f54cf70d042f in_seq=0 out_seq=0 2023-11-15T02:55:27.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.331+0000 7f01d1ffb700 1 -- 172.21.15.1:0/3576869809 <== mds.0 v2:172.21.15.141:6835/1145495775 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x555d2cd31ca0 con 0x555d2cf9dd10 2023-11-15T02:55:27.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.331+0000 7f01d1ffb700 10 client.10251 handle_command_reply: tid=0 2023-11-15T02:55:27.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.332+0000 7f020b865b80 1 client.10251 shutdown 2023-11-15T02:55:27.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.332+0000 7f020b865b80 1 -- 172.21.15.1:0/3576869809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cd35e40 msgr2=0x555d2cfa8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.332+0000 7f020b865b80 1 --2- 172.21.15.1:0/3576869809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cd35e40 0x555d2cfa8590 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 rx=0x7f01e4006fd0 tx=0x7f01e401e070).stop 2023-11-15T02:55:27.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.332+0000 7f020b865b80 1 -- 172.21.15.1:0/3576869809 shutdown_connections 2023-11-15T02:55:27.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.332+0000 7f020b865b80 1 --2- 172.21.15.1:0/3576869809 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfc24e0 0x555d2cfa5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.332+0000 7f020b865b80 1 --2- 172.21.15.1:0/3576869809 >> [v2:172.21.15.141:6835/1145495775,v1:172.21.15.141:6837/1145495775] conn(0x555d2cf9dd10 0x555d2cfbffd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.332+0000 7f020b865b80 1 --2- 172.21.15.1:0/3576869809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cd35e40 0x555d2cfa8590 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.332+0000 7f020b865b80 1 --2- 172.21.15.1:0/3576869809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cfa1cf0 0x555d2cfa5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.332+0000 7f01d1ffb700 0 client.10251 ms_handle_reset on v2:172.21.15.141:6835/1145495775 2023-11-15T02:55:27.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.332+0000 7f020b865b80 1 -- 172.21.15.1:0/3576869809 >> 172.21.15.1:0/3576869809 conn(0x555d2cde34a0 msgr2=0x555d2cf79880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:27.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.332+0000 7f020b865b80 1 -- 172.21.15.1:0/3576869809 shutdown_connections 2023-11-15T02:55:27.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.332+0000 7f020b865b80 1 -- 172.21.15.1:0/3576869809 wait complete. 2023-11-15T02:55:27.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.332+0000 7f020b865b80 20 client.10251 trim_cache size 0 max 16384 2023-11-15T02:55:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.348+0000 7f020b865b80 1 Processor -- start 2023-11-15T02:55:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.348+0000 7f020b865b80 1 -- start start 2023-11-15T02:55:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f020b865b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cd35e40 0x555d2cf7b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f020b865b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfa1cf0 0x555d2cf7ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f020b865b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfc24e0 0x555d2d01a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f020b865b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2cf6fdc0 con 0x555d2cfc24e0 2023-11-15T02:55:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f020b865b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2cf73510 con 0x555d2cfa1cf0 2023-11-15T02:55:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f020b865b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d2cfd8080 con 0x555d2cd35e40 2023-11-15T02:55:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f01f3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfc24e0 0x555d2d01a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f01f3fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfc24e0 0x555d2d01a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36500/0 (socket says 172.21.15.1:36500) 2023-11-15T02:55:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f01f3fff700 1 -- 172.21.15.1:0/2555279435 learned_addr learned my addr 172.21.15.1:0/2555279435 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f01f37fe700 1 --2- 172.21.15.1:0/2555279435 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cd35e40 0x555d2cf7b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f01f2ffd700 1 --2- 172.21.15.1:0/2555279435 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfa1cf0 0x555d2cf7ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f01f3fff700 1 -- 172.21.15.1:0/2555279435 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cd35e40 msgr2=0x555d2cf7b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f01f3fff700 1 --2- 172.21.15.1:0/2555279435 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cd35e40 0x555d2cf7b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f01f3fff700 1 -- 172.21.15.1:0/2555279435 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfa1cf0 msgr2=0x555d2cf7ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:27.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f01f3fff700 1 --2- 172.21.15.1:0/2555279435 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfa1cf0 0x555d2cf7ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f01f3fff700 1 -- 172.21.15.1:0/2555279435 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d2cf75ad0 con 0x555d2cfc24e0 2023-11-15T02:55:27.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f01f2ffd700 1 --2- 172.21.15.1:0/2555279435 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfa1cf0 0x555d2cf7ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:27.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.349+0000 7f01f37fe700 1 --2- 172.21.15.1:0/2555279435 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cd35e40 0x555d2cf7b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.350+0000 7f01f3fff700 1 --2- 172.21.15.1:0/2555279435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfc24e0 0x555d2d01a440 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7f01ec078d60 tx=0x7f01ec059000).ready entity=mon.0 client_cookie=18a2189c91738da8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.350+0000 7f01d97fa700 1 -- 172.21.15.1:0/2555279435 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec062030 con 0x555d2cfc24e0 2023-11-15T02:55:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.350+0000 7f01d97fa700 1 -- 172.21.15.1:0/2555279435 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec00eae0 con 0x555d2cfc24e0 2023-11-15T02:55:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.350+0000 7f01d97fa700 1 -- 172.21.15.1:0/2555279435 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec058040 con 0x555d2cfc24e0 2023-11-15T02:55:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.350+0000 7f020b865b80 1 -- 172.21.15.1:0/2555279435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfc24e0 msgr2=0x555d2d01a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.350+0000 7f020b865b80 1 --2- 172.21.15.1:0/2555279435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfc24e0 0x555d2d01a440 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7f01ec078d60 tx=0x7f01ec059000).stop 2023-11-15T02:55:27.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.350+0000 7f020b865b80 1 -- 172.21.15.1:0/2555279435 shutdown_connections 2023-11-15T02:55:27.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.350+0000 7f020b865b80 1 --2- 172.21.15.1:0/2555279435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfc24e0 0x555d2d01a440 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.350+0000 7f020b865b80 1 --2- 172.21.15.1:0/2555279435 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cd35e40 0x555d2cf7b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.350+0000 7f020b865b80 1 --2- 172.21.15.1:0/2555279435 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfa1cf0 0x555d2cf7ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.350+0000 7f020b865b80 1 -- 172.21.15.1:0/2555279435 >> 172.21.15.1:0/2555279435 conn(0x555d2cde34a0 msgr2=0x555d2cfd7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:27.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.350+0000 7f020b865b80 1 -- 172.21.15.1:0/2555279435 shutdown_connections 2023-11-15T02:55:27.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.350+0000 7f020b865b80 1 -- 172.21.15.1:0/2555279435 wait complete. 2023-11-15T02:55:27.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.351+0000 7f020b865b80 1 -- start start 2023-11-15T02:55:27.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.351+0000 7f020b865b80 1 Processor -- start 2023-11-15T02:55:27.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f020b865b80 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cd35e40 0x555d2cf9e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f020b865b80 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfa1cf0 0x555d2cf9e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f020b865b80 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfc24e0 0x555d2cfa78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f020b865b80 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2cf9eb20 con 0x555d2cfa1cf0 2023-11-15T02:55:27.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f020b865b80 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2d024be0 con 0x555d2cfc24e0 2023-11-15T02:55:27.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f020b865b80 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d2d01af30 con 0x555d2cd35e40 2023-11-15T02:55:27.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f020b865b80 10 client.0 ll_register_callbacks cb 0x555d2cf39640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-15T02:55:27.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01f2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfa1cf0 0x555d2cf9e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01f2ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfa1cf0 0x555d2cf9e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36504/0 (socket says 172.21.15.1:36504) 2023-11-15T02:55:27.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01f2ffd700 1 -- 172.21.15.1:0/960864998 learned_addr learned my addr 172.21.15.1:0/960864998 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:27.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01f3fff700 1 --2- 172.21.15.1:0/960864998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfc24e0 0x555d2cfa78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01f2ffd700 1 -- 172.21.15.1:0/960864998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cd35e40 msgr2=0x555d2cf9e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:27.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01f37fe700 1 --2- 172.21.15.1:0/960864998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cd35e40 0x555d2cf9e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01f2ffd700 1 --2- 172.21.15.1:0/960864998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cd35e40 0x555d2cf9e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01f2ffd700 1 -- 172.21.15.1:0/960864998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfc24e0 msgr2=0x555d2cfa78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:27.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01f2ffd700 1 --2- 172.21.15.1:0/960864998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfc24e0 0x555d2cfa78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01f2ffd700 1 -- 172.21.15.1:0/960864998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d2cec4620 con 0x555d2cfa1cf0 2023-11-15T02:55:27.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01f3fff700 1 --2- 172.21.15.1:0/960864998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfc24e0 0x555d2cfa78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:27.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01f37fe700 1 --2- 172.21.15.1:0/960864998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cd35e40 0x555d2cf9e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:27.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01f2ffd700 1 --2- 172.21.15.1:0/960864998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfa1cf0 0x555d2cf9e630 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7f01e800b300 tx=0x7f01e801b040).ready entity=mon.0 client_cookie=f3040bffd1534369 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:27.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-11-15T02:55:27.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01d1ffb700 1 -- 172.21.15.1:0/960864998 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e8016430 con 0x555d2cfa1cf0 2023-11-15T02:55:27.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f020b865b80 1 -- 172.21.15.1:0/960864998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01ec04d850 con 0x555d2cfa1cf0 2023-11-15T02:55:27.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01d1ffb700 1 -- 172.21.15.1:0/960864998 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(212..212 src has 1..212) v4 ==== 6673+0+0 (secure 0 0 0) 0x7f01e8016590 con 0x555d2cfa1cf0 2023-11-15T02:55:27.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f01d1ffb700 1 -- 172.21.15.1:0/960864998 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01e8016960 con 0x555d2cfa1cf0 2023-11-15T02:55:27.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f020b865b80 10 client.10257 fetch_fsmap learned FSMap version 95 2023-11-15T02:55:27.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.352+0000 7f020b865b80 1 -- 172.21.15.1:0/960864998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x555d2cebf710 con 0x555d2cfa1cf0 2023-11-15T02:55:27.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.353+0000 7f01d1ffb700 1 -- 172.21.15.1:0/960864998 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec04d850 con 0x555d2cfa1cf0 2023-11-15T02:55:27.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.353+0000 7f01d1ffb700 1 -- 172.21.15.1:0/960864998 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 95) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f01e8020030 con 0x555d2cfa1cf0 2023-11-15T02:55:27.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.353+0000 7f020b865b80 10 client.10257 fetch_fsmap finished waiting for FSMap version 95 2023-11-15T02:55:27.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.353+0000 7f020b865b80 10 client.10257 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-15T02:55:27.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.353+0000 7f020b865b80 20 client.10257 populate_metadata read hostname 'smithi001' 2023-11-15T02:55:27.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.353+0000 7f020b865b80 1 --2- 172.21.15.1:0/960864998 >> [v2:172.21.15.141:6835/1145495775,v1:172.21.15.141:6837/1145495775] conn(0x555d2cfa7e20 0x555d2cfa8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.353+0000 7f020b865b80 4 client.10257 mds_command: new command op to 10116 tid=0[{"prefix": "status"}] 2023-11-15T02:55:27.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.353+0000 7f020b865b80 1 -- 172.21.15.1:0/960864998 --> [v2:172.21.15.141:6835/1145495775,v1:172.21.15.141:6837/1145495775] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555d2cd68ca0 con 0x555d2cfa7e20 2023-11-15T02:55:27.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.353+0000 7f01f37fe700 1 --2- 172.21.15.1:0/960864998 >> [v2:172.21.15.141:6835/1145495775,v1:172.21.15.141:6837/1145495775] conn(0x555d2cfa7e20 0x555d2cfa8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.353+0000 7f01d1ffb700 10 client.10257 ms_handle_connect on v2:172.21.15.141:6835/1145495775 2023-11-15T02:55:27.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.353+0000 7f01f37fe700 1 --2- 172.21.15.1:0/960864998 >> [v2:172.21.15.141:6835/1145495775,v1:172.21.15.141:6837/1145495775] conn(0x555d2cfa7e20 0x555d2cfa8200 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7aad29af12645faa server_cookie=b47fdc369aa85197 in_seq=0 out_seq=0 2023-11-15T02:55:27.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.353+0000 7f01d1ffb700 1 -- 172.21.15.1:0/960864998 <== mds.0 v2:172.21.15.141:6835/1145495775 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x555d2cd68ca0 con 0x555d2cfa7e20 2023-11-15T02:55:27.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f01d1ffb700 10 client.10257 handle_command_reply: tid=0 2023-11-15T02:55:27.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f020b865b80 1 client.10257 shutdown 2023-11-15T02:55:27.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f020b865b80 1 -- 172.21.15.1:0/960864998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfa1cf0 msgr2=0x555d2cf9e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f020b865b80 1 --2- 172.21.15.1:0/960864998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfa1cf0 0x555d2cf9e630 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7f01e800b300 tx=0x7f01e801b040).stop 2023-11-15T02:55:27.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f020b865b80 1 -- 172.21.15.1:0/960864998 shutdown_connections 2023-11-15T02:55:27.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f020b865b80 1 --2- 172.21.15.1:0/960864998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555d2cfc24e0 0x555d2cfa78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f020b865b80 1 --2- 172.21.15.1:0/960864998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555d2cd35e40 0x555d2cf9e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f020b865b80 1 --2- 172.21.15.1:0/960864998 >> [v2:172.21.15.141:6835/1145495775,v1:172.21.15.141:6837/1145495775] conn(0x555d2cfa7e20 0x555d2cfa8200 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f020b865b80 1 --2- 172.21.15.1:0/960864998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d2cfa1cf0 0x555d2cf9e630 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f01d1ffb700 0 client.10257 ms_handle_reset on v2:172.21.15.141:6835/1145495775 2023-11-15T02:55:27.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f020b865b80 1 -- 172.21.15.1:0/960864998 >> 172.21.15.1:0/960864998 conn(0x555d2cde34a0 msgr2=0x555d2cf9f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:27.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f020b865b80 1 -- 172.21.15.1:0/960864998 shutdown_connections 2023-11-15T02:55:27.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f020b865b80 1 -- 172.21.15.1:0/960864998 wait complete. 2023-11-15T02:55:27.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f020b865b80 20 client.10257 trim_cache size 0 max 16384 2023-11-15T02:55:27.381 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:55:27.382 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "32ffb44b-12dc-4e79-bad7-24a9692dabf6", 2023-11-15T02:55:27.382 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2023-11-15T02:55:27.382 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 10116, 2023-11-15T02:55:27.382 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2023-11-15T02:55:27.382 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2023-11-15T02:55:27.383 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2023-11-15T02:55:27.383 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 5.7637462839999998, 2023-11-15T02:55:27.383 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 95, 2023-11-15T02:55:27.383 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 212, 2023-11-15T02:55:27.383 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 212, 2023-11-15T02:55:27.384 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 11.24741689 2023-11-15T02:55:27.384 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:55:27.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f01f8c6a700 1 -- 172.21.15.1:0/3666902097 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f01e005f270 msgr2=0x7f01e0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f01f8c6a700 1 --2- 172.21.15.1:0/3666902097 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f01e005f270 0x7f01e0061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f01e400c010 tx=0x7f01e4015000).stop 2023-11-15T02:55:27.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f01f8c6a700 1 -- 172.21.15.1:0/3666902097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f4157dd0 msgr2=0x7f01f4164ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f01f8c6a700 1 --2- 172.21.15.1:0/3666902097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f4157dd0 0x7f01f4164ec0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7f01ec007f30 tx=0x7f01ec0098e0).stop 2023-11-15T02:55:27.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f01f8c6a700 1 -- 172.21.15.1:0/3666902097 shutdown_connections 2023-11-15T02:55:27.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f01f8c6a700 1 --2- 172.21.15.1:0/3666902097 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f01e005f270 0x7f01e0061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f01f8c6a700 1 --2- 172.21.15.1:0/3666902097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f4157dd0 0x7f01f4164ec0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f01f8c6a700 1 --2- 172.21.15.1:0/3666902097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f01f4062ec0 0x7f01f4158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f01f8c6a700 1 --2- 172.21.15.1:0/3666902097 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f01f41579f0 0x7f01f41649d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f01f8c6a700 1 -- 172.21.15.1:0/3666902097 >> 172.21.15.1:0/3666902097 conn(0x7f01f40c7c10 msgr2=0x7f01f40a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:27.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f01f8c6a700 1 -- 172.21.15.1:0/3666902097 shutdown_connections 2023-11-15T02:55:27.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.354+0000 7f01f8c6a700 1 -- 172.21.15.1:0/3666902097 wait complete. 2023-11-15T02:55:27.388 DEBUG:teuthology.orchestra.run.smithi001:> ceph fs ls 2023-11-15T02:55:27.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.493+0000 7f2cae5bf700 1 Processor -- start 2023-11-15T02:55:27.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.493+0000 7f2cae5bf700 1 -- start start 2023-11-15T02:55:27.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.493+0000 7f2cae5bf700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca8158cf0 0x7f2ca80c1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.493+0000 7f2cae5bf700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca8158150 con 0x7f2ca8062c10 2023-11-15T02:55:27.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.493+0000 7f2cae5bf700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca8063670 con 0x7f2ca8154410 2023-11-15T02:55:27.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.493+0000 7f2cae5bf700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8063950 con 0x7f2ca8158cf0 2023-11-15T02:55:27.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.494+0000 7f2ca77fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2ca8062c10 0x7f2ca81585e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:50132/0 (socket says 172.21.15.1:50132) 2023-11-15T02:55:27.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.494+0000 7f2ca77fe700 1 -- 172.21.15.1:0/2763550644 learned_addr learned my addr 172.21.15.1:0/2763550644 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:27.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.494+0000 7f2cacb5c700 1 --2- 172.21.15.1:0/2763550644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca8158cf0 0x7f2ca80c1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.494+0000 7f2ca6ffd700 1 -- 172.21.15.1:0/2763550644 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854517443 0 0) 0x7f2ca8158150 con 0x7f2ca8062c10 2023-11-15T02:55:27.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.494+0000 7f2ca6ffd700 1 -- 172.21.15.1:0/2763550644 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c940033f0 con 0x7f2ca8062c10 2023-11-15T02:55:27.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.494+0000 7f2ca6ffd700 1 -- 172.21.15.1:0/2763550644 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709351030 0 0) 0x7f2ca8063670 con 0x7f2ca8154410 2023-11-15T02:55:27.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.494+0000 7f2ca6ffd700 1 -- 172.21.15.1:0/2763550644 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca8158150 con 0x7f2ca8154410 2023-11-15T02:55:27.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.494+0000 7f2cacb5c700 1 -- 172.21.15.1:0/2763550644 >> v1:172.21.15.141:6789/0 conn(0x7f2ca8154410 legacy=0x7f2ca80ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.494+0000 7f2cacb5c700 1 -- 172.21.15.1:0/2763550644 >> v1:172.21.15.1:6789/0 conn(0x7f2ca8062c10 legacy=0x7f2ca81585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.494+0000 7f2cacb5c700 1 -- 172.21.15.1:0/2763550644 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca8063c30 con 0x7f2ca8158cf0 2023-11-15T02:55:27.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.494+0000 7f2cacb5c700 1 --2- 172.21.15.1:0/2763550644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca8158cf0 0x7f2ca80c1030 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f2ca0009e90 tx=0x7f2ca0009780).ready entity=mon.2 client_cookie=fd1c48b6a3667faa server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:27.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.494+0000 7f2ca6ffd700 1 -- 172.21.15.1:0/2763550644 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000e070 con 0x7f2ca8158cf0 2023-11-15T02:55:27.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.494+0000 7f2ca6ffd700 1 -- 172.21.15.1:0/2763550644 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca000bab0 con 0x7f2ca8158cf0 2023-11-15T02:55:27.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.494+0000 7f2ca6ffd700 1 -- 172.21.15.1:0/2763550644 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000be30 con 0x7f2ca8158cf0 2023-11-15T02:55:27.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.495+0000 7f2cae5bf700 1 -- 172.21.15.1:0/2763550644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca8158cf0 msgr2=0x7f2ca80c1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.495+0000 7f2cae5bf700 1 --2- 172.21.15.1:0/2763550644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca8158cf0 0x7f2ca80c1030 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f2ca0009e90 tx=0x7f2ca0009780).stop 2023-11-15T02:55:27.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.495+0000 7f2cae5bf700 1 -- 172.21.15.1:0/2763550644 shutdown_connections 2023-11-15T02:55:27.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.495+0000 7f2cae5bf700 1 --2- 172.21.15.1:0/2763550644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca8158cf0 0x7f2ca80c1030 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.495+0000 7f2cae5bf700 1 -- 172.21.15.1:0/2763550644 >> 172.21.15.1:0/2763550644 conn(0x7f2ca80cbbd0 msgr2=0x7f2ca80c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:27.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.495+0000 7f2cae5bf700 1 -- 172.21.15.1:0/2763550644 shutdown_connections 2023-11-15T02:55:27.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.495+0000 7f2cae5bf700 1 -- 172.21.15.1:0/2763550644 wait complete. 2023-11-15T02:55:27.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.496+0000 7f2cae5bf700 1 Processor -- start 2023-11-15T02:55:27.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.496+0000 7f2cae5bf700 1 -- start start 2023-11-15T02:55:27.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2cae5bf700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ca8062c10 0x7f2ca80ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2cae5bf700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca8154410 0x7f2ca81679b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2cae5bf700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca8158cf0 0x7f2ca8165580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2cae5bf700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8167ea0 con 0x7f2ca8154410 2023-11-15T02:55:27.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2cae5bf700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca80aefe0 con 0x7f2ca8062c10 2023-11-15T02:55:27.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2cae5bf700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca80c0a80 con 0x7f2ca8158cf0 2023-11-15T02:55:27.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2ca77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca8154410 0x7f2ca81679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2ca77fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca8154410 0x7f2ca81679b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36508/0 (socket says 172.21.15.1:36508) 2023-11-15T02:55:27.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2ca77fe700 1 -- 172.21.15.1:0/918761658 learned_addr learned my addr 172.21.15.1:0/918761658 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:27.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2cacb5c700 1 --2- 172.21.15.1:0/918761658 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca8158cf0 0x7f2ca8165580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2ca7fff700 1 --2- 172.21.15.1:0/918761658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ca8062c10 0x7f2ca80ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2ca77fe700 1 -- 172.21.15.1:0/918761658 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca8158cf0 msgr2=0x7f2ca8165580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2ca77fe700 1 --2- 172.21.15.1:0/918761658 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca8158cf0 0x7f2ca8165580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2ca77fe700 1 -- 172.21.15.1:0/918761658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ca8062c10 msgr2=0x7f2ca80ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2ca77fe700 1 --2- 172.21.15.1:0/918761658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ca8062c10 0x7f2ca80ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.497+0000 7f2ca77fe700 1 -- 172.21.15.1:0/918761658 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0009a20 con 0x7f2ca8154410 2023-11-15T02:55:27.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.498+0000 7f2ca77fe700 1 --2- 172.21.15.1:0/918761658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca8154410 0x7f2ca81679b0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f2c9800c590 tx=0x7f2c98007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:27.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.498+0000 7f2c9ffff700 1 -- 172.21.15.1:0/918761658 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800ce60 con 0x7f2ca8154410 2023-11-15T02:55:27.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.498+0000 7f2c9ffff700 1 -- 172.21.15.1:0/918761658 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c980072e0 con 0x7f2ca8154410 2023-11-15T02:55:27.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.498+0000 7f2cae5bf700 1 -- 172.21.15.1:0/918761658 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca8165a70 con 0x7f2ca8154410 2023-11-15T02:55:27.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.498+0000 7f2c9ffff700 1 -- 172.21.15.1:0/918761658 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98007660 con 0x7f2ca8154410 2023-11-15T02:55:27.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.498+0000 7f2cae5bf700 1 -- 172.21.15.1:0/918761658 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca80c0430 con 0x7f2ca8154410 2023-11-15T02:55:27.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.499+0000 7f2cae5bf700 1 -- 172.21.15.1:0/918761658 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca80475e0 con 0x7f2ca8154410 2023-11-15T02:55:27.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.499+0000 7f2c9ffff700 1 -- 172.21.15.1:0/918761658 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2c980059b0 con 0x7f2ca8154410 2023-11-15T02:55:27.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.499+0000 7f2c9ffff700 1 --2- 172.21.15.1:0/918761658 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f2c8805f270 0x7f2c88061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:27.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.499+0000 7f2c9ffff700 1 -- 172.21.15.1:0/918761658 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6673+0+0 (secure 0 0 0) 0x7f2c98079c20 con 0x7f2ca8154410 2023-11-15T02:55:27.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.500+0000 7f2ca7fff700 1 --2- 172.21.15.1:0/918761658 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f2c8805f270 0x7f2c88061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:27.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.500+0000 7f2ca7fff700 1 --2- 172.21.15.1:0/918761658 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f2c8805f270 0x7f2c88061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2c90000c00 tx=0x7f2c90007bb0).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:27.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.504+0000 7f2c9ffff700 1 -- 172.21.15.1:0/918761658 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2c9804ab40 con 0x7f2ca8154410 2023-11-15T02:55:27.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.723+0000 7f2cae5bf700 1 -- 172.21.15.1:0/918761658 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2ca8063f10 con 0x7f2ca8154410 2023-11-15T02:55:27.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.723+0000 7f2c9ffff700 1 -- 172.21.15.1:0/918761658 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v95) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2c9804e160 con 0x7f2ca8154410 2023-11-15T02:55:27.725 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-15T02:55:27.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.725+0000 7f2cae5bf700 1 -- 172.21.15.1:0/918761658 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f2c8805f270 msgr2=0x7f2c88061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.725+0000 7f2cae5bf700 1 --2- 172.21.15.1:0/918761658 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f2c8805f270 0x7f2c88061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2c90000c00 tx=0x7f2c90007bb0).stop 2023-11-15T02:55:27.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.725+0000 7f2cae5bf700 1 -- 172.21.15.1:0/918761658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca8154410 msgr2=0x7f2ca81679b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:27.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.725+0000 7f2cae5bf700 1 --2- 172.21.15.1:0/918761658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca8154410 0x7f2ca81679b0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f2c9800c590 tx=0x7f2c98007d20).stop 2023-11-15T02:55:27.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.725+0000 7f2cae5bf700 1 -- 172.21.15.1:0/918761658 shutdown_connections 2023-11-15T02:55:27.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.725+0000 7f2cae5bf700 1 --2- 172.21.15.1:0/918761658 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f2c8805f270 0x7f2c88061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.725+0000 7f2cae5bf700 1 --2- 172.21.15.1:0/918761658 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ca8158cf0 0x7f2ca8165580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.725+0000 7f2cae5bf700 1 --2- 172.21.15.1:0/918761658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ca8062c10 0x7f2ca80ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.725+0000 7f2cae5bf700 1 --2- 172.21.15.1:0/918761658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ca8154410 0x7f2ca81679b0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:27.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.725+0000 7f2cae5bf700 1 -- 172.21.15.1:0/918761658 >> 172.21.15.1:0/918761658 conn(0x7f2ca80cbbd0 msgr2=0x7f2ca8153370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:27.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.725+0000 7f2cae5bf700 1 -- 172.21.15.1:0/918761658 shutdown_connections 2023-11-15T02:55:27.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:27.725+0000 7f2cae5bf700 1 -- 172.21.15.1:0/918761658 wait complete. 2023-11-15T02:55:27.737 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-15T02:55:27.737 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-15T02:55:27.738 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-11-15T02:55:27.738 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-15T02:55:27.738 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-15T02:55:27.739 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-15T02:55:27.739 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-15T02:55:27.739 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-15T02:55:27.740 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T02:55:27.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:27.741 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-11-15T02:55:27.756 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-15T02:55:27.757 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-15T02:55:27.757 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-11-15T02:55:27.757 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:55:27.757 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-11-15T02:55:27.757 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:55:27.757 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T02:55:27.758 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-11-15T02:55:27.758 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-11-15T02:55:27.758 INFO:teuthology.orchestra.run.smithi001.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-15T02:55:27.758 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-11-15T02:55:27.758 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-11-15T02:55:27.759 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-15T02:55:27.759 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 36877sec preferred_lft 36877sec 2023-11-15T02:55:27.759 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2023-11-15T02:55:27.759 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:55:27.759 INFO:teuthology.orchestra.run.smithi001.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T02:55:27.760 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-11-15T02:55:27.760 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-11-15T02:55:27.760 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-15T02:55:27.760 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-11-15T02:55:27.760 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-11-15T02:55:27.761 INFO:teuthology.orchestra.run.smithi001.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-15T02:55:27.761 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff 2023-11-15T02:55:27.761 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-15T02:55:27.761 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:55:27.761 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::74ff:4aff:fef6:c8f5/64 scope link 2023-11-15T02:55:27.762 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:55:27.762 INFO:teuthology.orchestra.run.smithi001.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T02:55:27.762 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 12:ca:5c:8a:9a:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-15T02:55:27.762 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::10ca:5cff:fe8a:9a23/64 scope link 2023-11-15T02:55:27.762 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:55:27.763 INFO:teuthology.orchestra.run.smithi001.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-15T02:55:27.763 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 92:7a:64:05:0f:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-15T02:55:27.763 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::907a:64ff:fe05:f37/64 scope link 2023-11-15T02:55:27.763 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-11-15T02:55:27.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:27.764 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-15T02:55:27.821 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-11-15T02:55:27.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:27.823 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-11-15T02:55:27.879 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-11-15T02:55:27.879 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-15T02:55:27.880 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-15T02:55:27.880 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-15T02:55:27.880 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-15T02:55:27.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:27.881 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-11-15T02:55:27.881 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-11-15T02:55:27.882 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-15T02:55:27.882 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-15T02:55:27.883 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-15T02:55:27.883 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-11-15T02:55:27.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:27.983 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T02:55:27.998 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-15T02:55:27.998 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-15T02:55:27.998 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-15T02:55:27.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:27.999 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2023-11-15T02:55:28.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:28.063 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-15T02:55:28.118 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-15T02:55:28.118 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T02:55:28.198 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T02:55:28.198 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T02:55:28.225 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-11-15T02:55:28.226 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-11-15T02:55:28.228 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-15T02:55:28.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:28.229 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-15T02:55:28.294 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-15T02:55:28.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.451+0000 7fd5e7daa700 1 Processor -- start 2023-11-15T02:55:28.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.451+0000 7fd5e7daa700 1 -- start start 2023-11-15T02:55:28.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.452+0000 7fd5e7daa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5e0154250 0x7fd5e0154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:28.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.452+0000 7fd5e7daa700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd5e00c6110 0x7fd5e00c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:28.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.452+0000 7fd5e7daa700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e0158ff0 con 0x7fd5e00a9ff0 2023-11-15T02:55:28.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.452+0000 7fd5e7daa700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e0158100 con 0x7fd5e00c6110 2023-11-15T02:55:28.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.452+0000 7fd5e7daa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e01583e0 con 0x7fd5e0154250 2023-11-15T02:55:28.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.453+0000 7fd5e5b46700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5e0154250 0x7fd5e0154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:28.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.453+0000 7fd5e5345700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd5e00c6110 0x7fd5e00c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:28.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.453+0000 7fd5e5b46700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5e0154250 0x7fd5e0154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:36638/0 (socket says 172.21.15.1:36638) 2023-11-15T02:55:28.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.453+0000 7fd5e5b46700 1 -- 172.21.15.1:0/2094646381 learned_addr learned my addr 172.21.15.1:0/2094646381 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:28.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.453+0000 7fd5e5b46700 1 -- 172.21.15.1:0/2094646381 >> v2:172.21.15.141:3300/0 conn(0x7fd5e00c6110 msgr2=0x7fd5e00c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:28.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.453+0000 7fd5e5b46700 1 --2- 172.21.15.1:0/2094646381 >> v2:172.21.15.141:3300/0 conn(0x7fd5e00c6110 0x7fd5e00c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:28.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.453+0000 7fd5e5b46700 1 -- 172.21.15.1:0/2094646381 >> v1:172.21.15.141:6789/0 conn(0x7fd5e00a9ff0 legacy=0x7fd5e0063510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:28.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.453+0000 7fd5e5b46700 1 -- 172.21.15.1:0/2094646381 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e01586c0 con 0x7fd5e0154250 2023-11-15T02:55:28.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.453+0000 7fd5e5b46700 1 --2- 172.21.15.1:0/2094646381 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5e0154250 0x7fd5e0154630 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fd5d8006fd0 tx=0x7fd5d80090f0).ready entity=mon.2 client_cookie=e8c83beec0901f5a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:28.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.453+0000 7fd5e4b44700 1 -- 172.21.15.1:0/2094646381 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d800b580 con 0x7fd5e0154250 2023-11-15T02:55:28.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.453+0000 7fd5e4b44700 1 -- 172.21.15.1:0/2094646381 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d800b6e0 con 0x7fd5e0154250 2023-11-15T02:55:28.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.453+0000 7fd5e4b44700 1 -- 172.21.15.1:0/2094646381 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d800ba60 con 0x7fd5e0154250 2023-11-15T02:55:28.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.454+0000 7fd5e7daa700 1 -- 172.21.15.1:0/2094646381 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5e0154250 msgr2=0x7fd5e0154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:28.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.454+0000 7fd5e7daa700 1 --2- 172.21.15.1:0/2094646381 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5e0154250 0x7fd5e0154630 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fd5d8006fd0 tx=0x7fd5d80090f0).stop 2023-11-15T02:55:28.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.454+0000 7fd5e7daa700 1 -- 172.21.15.1:0/2094646381 shutdown_connections 2023-11-15T02:55:28.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.454+0000 7fd5e7daa700 1 --2- 172.21.15.1:0/2094646381 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5e0154250 0x7fd5e0154630 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:28.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.454+0000 7fd5e7daa700 1 --2- 172.21.15.1:0/2094646381 >> v2:172.21.15.141:3300/0 conn(0x7fd5e00c6110 0x7fd5e00c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:28.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.454+0000 7fd5e7daa700 1 -- 172.21.15.1:0/2094646381 >> 172.21.15.1:0/2094646381 conn(0x7fd5e00c7b20 msgr2=0x7fd5e00c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:28.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.454+0000 7fd5e7daa700 1 -- 172.21.15.1:0/2094646381 shutdown_connections 2023-11-15T02:55:28.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.454+0000 7fd5e7daa700 1 -- 172.21.15.1:0/2094646381 wait complete. 2023-11-15T02:55:28.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.455+0000 7fd5e7daa700 1 Processor -- start 2023-11-15T02:55:28.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.455+0000 7fd5e7daa700 1 -- start start 2023-11-15T02:55:28.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e7daa700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5e00a9ff0 0x7fd5e014cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:28.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e7daa700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5e00c6110 0x7fd5e00c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:28.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e7daa700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5e0154250 0x7fd5e00ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:28.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e7daa700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00ac760 con 0x7fd5e00a9ff0 2023-11-15T02:55:28.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e7daa700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00ac180 con 0x7fd5e0154250 2023-11-15T02:55:28.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e7daa700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00c4a60 con 0x7fd5e00c6110 2023-11-15T02:55:28.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e5b46700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5e00a9ff0 0x7fd5e014cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:28.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e5b46700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5e00a9ff0 0x7fd5e014cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45138/0 (socket says 172.21.15.1:45138) 2023-11-15T02:55:28.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e5b46700 1 -- 172.21.15.1:0/3093627712 learned_addr learned my addr 172.21.15.1:0/3093627712 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:28.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e5345700 1 --2- 172.21.15.1:0/3093627712 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5e00c6110 0x7fd5e00c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:28.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e6347700 1 --2- 172.21.15.1:0/3093627712 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5e0154250 0x7fd5e00ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:28.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e5b46700 1 -- 172.21.15.1:0/3093627712 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5e00c6110 msgr2=0x7fd5e00c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:28.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e5b46700 1 --2- 172.21.15.1:0/3093627712 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5e00c6110 0x7fd5e00c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:28.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e5b46700 1 -- 172.21.15.1:0/3093627712 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5e0154250 msgr2=0x7fd5e00ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:28.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e5b46700 1 --2- 172.21.15.1:0/3093627712 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5e0154250 0x7fd5e00ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:28.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e5b46700 1 -- 172.21.15.1:0/3093627712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d8009370 con 0x7fd5e00a9ff0 2023-11-15T02:55:28.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.456+0000 7fd5e5b46700 1 --2- 172.21.15.1:0/3093627712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5e00a9ff0 0x7fd5e014cb70 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7fd5d8009ea0 tx=0x7fd5d8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.457+0000 7fd5ddffb700 1 -- 172.21.15.1:0/3093627712 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d800b850 con 0x7fd5e00a9ff0 2023-11-15T02:55:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.457+0000 7fd5ddffb700 1 -- 172.21.15.1:0/3093627712 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d800b9b0 con 0x7fd5e00a9ff0 2023-11-15T02:55:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.457+0000 7fd5ddffb700 1 -- 172.21.15.1:0/3093627712 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d801c670 con 0x7fd5e00a9ff0 2023-11-15T02:55:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.457+0000 7fd5e7daa700 1 -- 172.21.15.1:0/3093627712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e00ac3f0 con 0x7fd5e00a9ff0 2023-11-15T02:55:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.457+0000 7fd5e7daa700 1 -- 172.21.15.1:0/3093627712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e014d060 con 0x7fd5e00a9ff0 2023-11-15T02:55:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.458+0000 7fd5e7daa700 1 -- 172.21.15.1:0/3093627712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e00aca40 con 0x7fd5e00a9ff0 2023-11-15T02:55:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.458+0000 7fd5ddffb700 1 -- 172.21.15.1:0/3093627712 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd5d801c9e0 con 0x7fd5e00a9ff0 2023-11-15T02:55:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.459+0000 7fd5ddffb700 1 --2- 172.21.15.1:0/3093627712 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd5cc05f270 0x7fd5cc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.459+0000 7fd5ddffb700 1 -- 172.21.15.1:0/3093627712 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6673+0+0 (secure 0 0 0) 0x7fd5d807c2c0 con 0x7fd5e00a9ff0 2023-11-15T02:55:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.459+0000 7fd5e5345700 1 --2- 172.21.15.1:0/3093627712 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd5cc05f270 0x7fd5cc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.459+0000 7fd5e5345700 1 --2- 172.21.15.1:0/3093627712 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd5cc05f270 0x7fd5cc061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd5e00adc90 tx=0x7fd5d4009060).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:28.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.463+0000 7fd5ddffb700 1 -- 172.21.15.1:0/3093627712 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd5d804d1e0 con 0x7fd5e00a9ff0 2023-11-15T02:55:28.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.666+0000 7fd5e7daa700 1 -- 172.21.15.1:0/3093627712 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5e014d250 con 0x7fd5cc05f270 2023-11-15T02:55:28.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.668+0000 7fd5ddffb700 1 -- 172.21.15.1:0/3093627712 <== mgr.7898 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd5e014d250 con 0x7fd5cc05f270 2023-11-15T02:55:28.669 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-11-15T02:55:28.669 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-11-15T02:55:28.670 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephfs" 2023-11-15T02:55:28.670 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-11-15T02:55:28.670 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-11-15T02:55:28.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.670+0000 7fd5e7daa700 1 -- 172.21.15.1:0/3093627712 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd5cc05f270 msgr2=0x7fd5cc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:28.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.670+0000 7fd5e7daa700 1 --2- 172.21.15.1:0/3093627712 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd5cc05f270 0x7fd5cc061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd5e00adc90 tx=0x7fd5d4009060).stop 2023-11-15T02:55:28.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.670+0000 7fd5e7daa700 1 -- 172.21.15.1:0/3093627712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5e00a9ff0 msgr2=0x7fd5e014cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:28.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.670+0000 7fd5e7daa700 1 --2- 172.21.15.1:0/3093627712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5e00a9ff0 0x7fd5e014cb70 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7fd5d8009ea0 tx=0x7fd5d8017000).stop 2023-11-15T02:55:28.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.670+0000 7fd5e7daa700 1 -- 172.21.15.1:0/3093627712 shutdown_connections 2023-11-15T02:55:28.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.670+0000 7fd5e7daa700 1 --2- 172.21.15.1:0/3093627712 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd5cc05f270 0x7fd5cc061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:28.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.670+0000 7fd5e7daa700 1 --2- 172.21.15.1:0/3093627712 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd5e0154250 0x7fd5e00ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:28.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.670+0000 7fd5e7daa700 1 --2- 172.21.15.1:0/3093627712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5e00a9ff0 0x7fd5e014cb70 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:28.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.670+0000 7fd5e7daa700 1 --2- 172.21.15.1:0/3093627712 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd5e00c6110 0x7fd5e00c40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:28.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.670+0000 7fd5e7daa700 1 -- 172.21.15.1:0/3093627712 >> 172.21.15.1:0/3093627712 conn(0x7fd5e00c7b20 msgr2=0x7fd5e00633a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:28.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.670+0000 7fd5e7daa700 1 -- 172.21.15.1:0/3093627712 shutdown_connections 2023-11-15T02:55:28.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.670+0000 7fd5e7daa700 1 -- 172.21.15.1:0/3093627712 wait complete. 2023-11-15T02:55:28.683 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-11-15T02:55:28.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.802+0000 7f7b8d793700 1 Processor -- start 2023-11-15T02:55:28.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.802+0000 7f7b8d793700 1 -- start start 2023-11-15T02:55:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.803+0000 7f7b8d793700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b881540a0 0x7f7b880ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.803+0000 7f7b8d793700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7b88154480 0x7f7b880ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.803+0000 7f7b8d793700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7b880c5f40 0x7f7b880c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:28.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.803+0000 7f7b8d793700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b880c68e0 con 0x7f7b88154480 2023-11-15T02:55:28.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.803+0000 7f7b8d793700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b880ca050 con 0x7f7b880c5f40 2023-11-15T02:55:28.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.803+0000 7f7b8d793700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880c9440 con 0x7f7b881540a0 2023-11-15T02:55:28.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.803+0000 7f7b867fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7b88154480 0x7f7b880ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:28.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.803+0000 7f7b867fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7b88154480 0x7f7b880ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45142/0 (socket says 172.21.15.1:45142) 2023-11-15T02:55:28.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.803+0000 7f7b867fc700 1 -- 172.21.15.1:0/2508560404 learned_addr learned my addr 172.21.15.1:0/2508560404 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:28.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.803+0000 7f7b86ffd700 1 --2- 172.21.15.1:0/2508560404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b881540a0 0x7f7b880ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:28.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.803+0000 7f7b877fe700 1 --2- 172.21.15.1:0/2508560404 >> v2:172.21.15.141:3300/0 conn(0x7f7b880c5f40 0x7f7b880c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:28.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b867fc700 1 -- 172.21.15.1:0/2508560404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b881540a0 msgr2=0x7f7b880ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:28.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b867fc700 1 --2- 172.21.15.1:0/2508560404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b881540a0 0x7f7b880ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:28.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b867fc700 1 -- 172.21.15.1:0/2508560404 >> v2:172.21.15.141:3300/0 conn(0x7f7b880c5f40 msgr2=0x7f7b880c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:28.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b867fc700 1 --2- 172.21.15.1:0/2508560404 >> v2:172.21.15.141:3300/0 conn(0x7f7b880c5f40 0x7f7b880c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:28.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b867fc700 1 -- 172.21.15.1:0/2508560404 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b880c9720 con 0x7f7b88154480 2023-11-15T02:55:28.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b867fc700 1 --2- 172.21.15.1:0/2508560404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b88154480 0x7f7b880ca9d0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7f7b880aad10 tx=0x7f7b700090f0).ready entity=mon.0 client_cookie=a12e7c31610135a server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:28.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b85ffb700 1 -- 172.21.15.1:0/2508560404 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7000f510 con 0x7f7b88154480 2023-11-15T02:55:28.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b85ffb700 1 -- 172.21.15.1:0/2508560404 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7000f670 con 0x7f7b88154480 2023-11-15T02:55:28.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b85ffb700 1 -- 172.21.15.1:0/2508560404 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7000f9f0 con 0x7f7b88154480 2023-11-15T02:55:28.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b8d793700 1 -- 172.21.15.1:0/2508560404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b88154480 msgr2=0x7f7b880ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:28.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b8d793700 1 --2- 172.21.15.1:0/2508560404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b88154480 0x7f7b880ca9d0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7f7b880aad10 tx=0x7f7b700090f0).stop 2023-11-15T02:55:28.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b8d793700 1 -- 172.21.15.1:0/2508560404 shutdown_connections 2023-11-15T02:55:28.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b8d793700 1 --2- 172.21.15.1:0/2508560404 >> v2:172.21.15.141:3300/0 conn(0x7f7b880c5f40 0x7f7b880c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:28.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b8d793700 1 --2- 172.21.15.1:0/2508560404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b881540a0 0x7f7b880ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:28.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b8d793700 1 --2- 172.21.15.1:0/2508560404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b88154480 0x7f7b880ca9d0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:28.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b8d793700 1 -- 172.21.15.1:0/2508560404 >> 172.21.15.1:0/2508560404 conn(0x7f7b88064a70 msgr2=0x7f7b88064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:28.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.804+0000 7f7b8d793700 1 -- 172.21.15.1:0/2508560404 shutdown_connections 2023-11-15T02:55:28.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.805+0000 7f7b8d793700 1 -- 172.21.15.1:0/2508560404 wait complete. 2023-11-15T02:55:28.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.806+0000 7f7b8d793700 1 Processor -- start 2023-11-15T02:55:28.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.806+0000 7f7b8d793700 1 -- start start 2023-11-15T02:55:28.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b8d793700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b880c5f40 0x7f7b88144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:28.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b8d793700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881540a0 0x7f7b881505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:28.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b8d793700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b88154480 0x7f7b88167d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:28.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b8d793700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b88142630 con 0x7f7b881540a0 2023-11-15T02:55:28.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b8d793700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b88150f70 con 0x7f7b88154480 2023-11-15T02:55:28.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b8d793700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b88151250 con 0x7f7b880c5f40 2023-11-15T02:55:28.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b867fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881540a0 0x7f7b881505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:28.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b867fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881540a0 0x7f7b881505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45154/0 (socket says 172.21.15.1:45154) 2023-11-15T02:55:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b867fc700 1 -- 172.21.15.1:0/1667501280 learned_addr learned my addr 172.21.15.1:0/1667501280 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b867fc700 1 -- 172.21.15.1:0/1667501280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b880c5f40 msgr2=0x7f7b88144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b877fe700 1 --2- 172.21.15.1:0/1667501280 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b88154480 0x7f7b88167d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b867fc700 1 --2- 172.21.15.1:0/1667501280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b880c5f40 0x7f7b88144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b867fc700 1 -- 172.21.15.1:0/1667501280 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b88154480 msgr2=0x7f7b88167d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b867fc700 1 --2- 172.21.15.1:0/1667501280 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b88154480 0x7f7b88167d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b867fc700 1 -- 172.21.15.1:0/1667501280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b70009370 con 0x7f7b881540a0 2023-11-15T02:55:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b867fc700 1 --2- 172.21.15.1:0/1667501280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881540a0 0x7f7b881505f0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7f7b7000fba0 tx=0x7f7b70017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b7effd700 1 -- 172.21.15.1:0/1667501280 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b70011ca0 con 0x7f7b881540a0 2023-11-15T02:55:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b7effd700 1 -- 172.21.15.1:0/1667501280 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70011e00 con 0x7f7b881540a0 2023-11-15T02:55:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b8d793700 1 -- 172.21.15.1:0/1667501280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b88151530 con 0x7f7b881540a0 2023-11-15T02:55:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b7effd700 1 -- 172.21.15.1:0/1667501280 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7001c670 con 0x7f7b881540a0 2023-11-15T02:55:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.807+0000 7f7b8d793700 1 -- 172.21.15.1:0/1667501280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b88151af0 con 0x7f7b881540a0 2023-11-15T02:55:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.808+0000 7f7b8d793700 1 -- 172.21.15.1:0/1667501280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b88151ce0 con 0x7f7b881540a0 2023-11-15T02:55:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.809+0000 7f7b7effd700 1 -- 172.21.15.1:0/1667501280 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 98) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7b7001ca60 con 0x7f7b881540a0 2023-11-15T02:55:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.809+0000 7f7b7effd700 1 --2- 172.21.15.1:0/1667501280 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7b6805f270 0x7f7b68061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.809+0000 7f7b7effd700 1 -- 172.21.15.1:0/1667501280 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6673+0+0 (secure 0 0 0) 0x7f7b7007bd20 con 0x7f7b881540a0 2023-11-15T02:55:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.809+0000 7f7b86ffd700 1 --2- 172.21.15.1:0/1667501280 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7b6805f270 0x7f7b68061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.810+0000 7f7b86ffd700 1 --2- 172.21.15.1:0/1667501280 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7b6805f270 0x7f7b68061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f7b78009990 tx=0x7f7b78009060).ready entity=mgr.7898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:28.814+0000 7f7b7effd700 1 -- 172.21.15.1:0/1667501280 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7b7004ccf0 con 0x7f7b881540a0 2023-11-15T02:55:29.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.031+0000 7f7b8d793700 1 -- 172.21.15.1:0/1667501280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f7b8806c7e0 con 0x7f7b881540a0 2023-11-15T02:55:29.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.625+0000 7f7b7effd700 1 -- 172.21.15.1:0/1667501280 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 99) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f7b7001cd10 con 0x7f7b881540a0 2023-11-15T02:55:29.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.626+0000 7f7b7effd700 1 -- 172.21.15.1:0/1667501280 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v99) v1 ==== 92+0+0 (secure 0 0 0) 0x7f7b70041810 con 0x7f7b881540a0 2023-11-15T02:55:29.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.629+0000 7f7b8d793700 1 -- 172.21.15.1:0/1667501280 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7b6805f270 msgr2=0x7f7b68061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:29.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.629+0000 7f7b8d793700 1 --2- 172.21.15.1:0/1667501280 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7b6805f270 0x7f7b68061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f7b78009990 tx=0x7f7b78009060).stop 2023-11-15T02:55:29.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.629+0000 7f7b8d793700 1 -- 172.21.15.1:0/1667501280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881540a0 msgr2=0x7f7b881505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:29.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.629+0000 7f7b8d793700 1 --2- 172.21.15.1:0/1667501280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881540a0 0x7f7b881505f0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7f7b7000fba0 tx=0x7f7b70017000).stop 2023-11-15T02:55:29.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.629+0000 7f7b8d793700 1 -- 172.21.15.1:0/1667501280 shutdown_connections 2023-11-15T02:55:29.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.629+0000 7f7b8d793700 1 --2- 172.21.15.1:0/1667501280 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7b6805f270 0x7f7b68061730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:29.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.629+0000 7f7b8d793700 1 --2- 172.21.15.1:0/1667501280 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b88154480 0x7f7b88167d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:29.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.629+0000 7f7b8d793700 1 --2- 172.21.15.1:0/1667501280 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b880c5f40 0x7f7b88144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:29.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.629+0000 7f7b8d793700 1 --2- 172.21.15.1:0/1667501280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881540a0 0x7f7b881505f0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:29.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.629+0000 7f7b8d793700 1 -- 172.21.15.1:0/1667501280 >> 172.21.15.1:0/1667501280 conn(0x7f7b88064a70 msgr2=0x7f7b880c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:29.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.629+0000 7f7b8d793700 1 -- 172.21.15.1:0/1667501280 shutdown_connections 2023-11-15T02:55:29.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.629+0000 7f7b8d793700 1 -- 172.21.15.1:0/1667501280 wait complete. 2023-11-15T02:55:29.645 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-11-15T02:55:29.772 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:29.770+0000 7fd8e22b8680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:55:29.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.771+0000 7fe98f6a2700 1 Processor -- start 2023-11-15T02:55:29.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.771+0000 7fe98f6a2700 1 -- start start 2023-11-15T02:55:29.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.772+0000 7fe98f6a2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9880c3e30 0x7fe9880c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:29.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.772+0000 7fe98f6a2700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98806a020 con 0x7fe988069ba0 2023-11-15T02:55:29.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.772+0000 7fe98f6a2700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9881550a0 con 0x7fe988154bf0 2023-11-15T02:55:29.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.772+0000 7fe98f6a2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe988155bc0 con 0x7fe9880c3e30 2023-11-15T02:55:29.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.772+0000 7fe98cc3d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe988069ba0 0x7fe988066cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:56626/0 (socket says 172.21.15.1:56626) 2023-11-15T02:55:29.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.773+0000 7fe98cc3d700 1 -- 172.21.15.1:0/752542693 learned_addr learned my addr 172.21.15.1:0/752542693 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:29.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.773+0000 7fe98d43e700 1 --2- 172.21.15.1:0/752542693 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9880c3e30 0x7fe9880c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:29.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.773+0000 7fe97ffff700 1 -- 172.21.15.1:0/752542693 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487011136 0 0) 0x7fe98806a020 con 0x7fe988069ba0 2023-11-15T02:55:29.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.773+0000 7fe97ffff700 1 -- 172.21.15.1:0/752542693 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9740033f0 con 0x7fe988069ba0 2023-11-15T02:55:29.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.773+0000 7fe97ffff700 1 -- 172.21.15.1:0/752542693 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422073893 0 0) 0x7fe9881550a0 con 0x7fe988154bf0 2023-11-15T02:55:29.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.773+0000 7fe97ffff700 1 -- 172.21.15.1:0/752542693 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe98806a020 con 0x7fe988154bf0 2023-11-15T02:55:29.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.773+0000 7fe98d43e700 1 -- 172.21.15.1:0/752542693 >> v1:172.21.15.141:6789/0 conn(0x7fe988154bf0 legacy=0x7fe98813a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:29.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.773+0000 7fe98d43e700 1 -- 172.21.15.1:0/752542693 >> v1:172.21.15.1:6789/0 conn(0x7fe988069ba0 legacy=0x7fe988066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:29.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.773+0000 7fe98d43e700 1 -- 172.21.15.1:0/752542693 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe988155320 con 0x7fe9880c3e30 2023-11-15T02:55:29.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.773+0000 7fe98d43e700 1 --2- 172.21.15.1:0/752542693 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9880c3e30 0x7fe9880c4210 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fe978009790 tx=0x7fe978009060).ready entity=mon.2 client_cookie=a6943d688248f1c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:29.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.773+0000 7fe97ffff700 1 -- 172.21.15.1:0/752542693 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97800f510 con 0x7fe9880c3e30 2023-11-15T02:55:29.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.773+0000 7fe97ffff700 1 -- 172.21.15.1:0/752542693 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97800f670 con 0x7fe9880c3e30 2023-11-15T02:55:29.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.773+0000 7fe97ffff700 1 -- 172.21.15.1:0/752542693 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97800f9f0 con 0x7fe9880c3e30 2023-11-15T02:55:29.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.774+0000 7fe98f6a2700 1 -- 172.21.15.1:0/752542693 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9880c3e30 msgr2=0x7fe9880c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:29.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.774+0000 7fe98f6a2700 1 --2- 172.21.15.1:0/752542693 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9880c3e30 0x7fe9880c4210 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fe978009790 tx=0x7fe978009060).stop 2023-11-15T02:55:29.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.774+0000 7fe98f6a2700 1 -- 172.21.15.1:0/752542693 shutdown_connections 2023-11-15T02:55:29.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.774+0000 7fe98f6a2700 1 --2- 172.21.15.1:0/752542693 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9880c3e30 0x7fe9880c4210 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:29.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.774+0000 7fe98f6a2700 1 -- 172.21.15.1:0/752542693 >> 172.21.15.1:0/752542693 conn(0x7fe9880c7dc0 msgr2=0x7fe9880c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:29.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.774+0000 7fe98f6a2700 1 -- 172.21.15.1:0/752542693 shutdown_connections 2023-11-15T02:55:29.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.774+0000 7fe98f6a2700 1 -- 172.21.15.1:0/752542693 wait complete. 2023-11-15T02:55:29.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.775+0000 7fe98f6a2700 1 Processor -- start 2023-11-15T02:55:29.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.775+0000 7fe98f6a2700 1 -- start start 2023-11-15T02:55:29.782 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:29.775+0000 7f792e1e1680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:55:29.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.776+0000 7fe98f6a2700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe988069ba0 0x7fe98814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:29.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.776+0000 7fe98f6a2700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9880c3e30 0x7fe9880a7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:29.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.776+0000 7fe98f6a2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe988154bf0 0x7fe9880c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:29.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.776+0000 7fe98f6a2700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe988166ff0 con 0x7fe988154bf0 2023-11-15T02:55:29.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.776+0000 7fe98f6a2700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe988153ab0 con 0x7fe9880c3e30 2023-11-15T02:55:29.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.776+0000 7fe98f6a2700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe988153180 con 0x7fe988069ba0 2023-11-15T02:55:29.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.776+0000 7fe98dc3f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe988154bf0 0x7fe9880c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:29.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.776+0000 7fe98d43e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe988069ba0 0x7fe98814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:29.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.776+0000 7fe98cc3d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9880c3e30 0x7fe9880a7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:29.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.776+0000 7fe98dc3f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe988154bf0 0x7fe9880c10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45196/0 (socket says 172.21.15.1:45196) 2023-11-15T02:55:29.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.776+0000 7fe98d43e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe988069ba0 0x7fe98814ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:36702/0 (socket says 172.21.15.1:36702) 2023-11-15T02:55:29.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.776+0000 7fe98dc3f700 1 -- 172.21.15.1:0/3598545100 learned_addr learned my addr 172.21.15.1:0/3598545100 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:29.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.777+0000 7fe98dc3f700 1 -- 172.21.15.1:0/3598545100 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe988069ba0 msgr2=0x7fe98814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:29.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.777+0000 7fe98dc3f700 1 --2- 172.21.15.1:0/3598545100 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe988069ba0 0x7fe98814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:29.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.777+0000 7fe98dc3f700 1 -- 172.21.15.1:0/3598545100 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9880c3e30 msgr2=0x7fe9880a7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:29.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.777+0000 7fe98dc3f700 1 --2- 172.21.15.1:0/3598545100 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9880c3e30 0x7fe9880a7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:29.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.777+0000 7fe98dc3f700 1 -- 172.21.15.1:0/3598545100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9780092a0 con 0x7fe988154bf0 2023-11-15T02:55:29.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.777+0000 7fe98dc3f700 1 --2- 172.21.15.1:0/3598545100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe988154bf0 0x7fe9880c10f0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7fe98000c7c0 tx=0x7fe98000cad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:29.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.777+0000 7fe97d7fa700 1 -- 172.21.15.1:0/3598545100 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe980002240 con 0x7fe988154bf0 2023-11-15T02:55:29.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.777+0000 7fe97d7fa700 1 -- 172.21.15.1:0/3598545100 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9800023a0 con 0x7fe988154bf0 2023-11-15T02:55:29.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.777+0000 7fe98f6a2700 1 -- 172.21.15.1:0/3598545100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe988153460 con 0x7fe988154bf0 2023-11-15T02:55:29.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.777+0000 7fe97d7fa700 1 -- 172.21.15.1:0/3598545100 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9800017e0 con 0x7fe988154bf0 2023-11-15T02:55:29.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.777+0000 7fe98f6a2700 1 -- 172.21.15.1:0/3598545100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe988152da0 con 0x7fe988154bf0 2023-11-15T02:55:29.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.778+0000 7fe98f6a2700 1 -- 172.21.15.1:0/3598545100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe988153c40 con 0x7fe988154bf0 2023-11-15T02:55:29.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.778+0000 7fe97d7fa700 1 -- 172.21.15.1:0/3598545100 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 99) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fe980002510 con 0x7fe988154bf0 2023-11-15T02:55:29.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.778+0000 7fe97d7fa700 1 --2- 172.21.15.1:0/3598545100 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe96c05f2c0 0x7fe96c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:29.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.779+0000 7fe98d43e700 1 -- 172.21.15.1:0/3598545100 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe96c05f2c0 msgr2=0x7fe96c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:29.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.779+0000 7fe97d7fa700 1 -- 172.21.15.1:0/3598545100 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6673+0+0 (secure 0 0 0) 0x7fe98007a480 con 0x7fe988154bf0 2023-11-15T02:55:29.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.779+0000 7fe98d43e700 1 --2- 172.21.15.1:0/3598545100 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe96c05f2c0 0x7fe96c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:29.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.783+0000 7fe97d7fa700 1 -- 172.21.15.1:0/3598545100 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe98004edd0 con 0x7fe988154bf0 2023-11-15T02:55:29.835 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:29.833+0000 7fd8e22b8680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:55:29.844 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:29.843+0000 7f792e1e1680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:55:29.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.957+0000 7fe98f6a2700 1 -- 172.21.15.1:0/3598545100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fe98806c7e0 con 0x7fe988154bf0 2023-11-15T02:55:29.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.961+0000 7fe97d7fa700 1 -- 172.21.15.1:0/3598545100 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v43)=0 v43) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe98004e9c0 con 0x7fe988154bf0 2023-11-15T02:55:29.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.962+0000 7fe98f6a2700 1 -- 172.21.15.1:0/3598545100 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe96c05f2c0 msgr2=0x7fe96c061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:29.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.962+0000 7fe98f6a2700 1 --2- 172.21.15.1:0/3598545100 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe96c05f2c0 0x7fe96c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:29.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.962+0000 7fe98f6a2700 1 -- 172.21.15.1:0/3598545100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe988154bf0 msgr2=0x7fe9880c10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:29.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.962+0000 7fe98f6a2700 1 --2- 172.21.15.1:0/3598545100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe988154bf0 0x7fe9880c10f0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7fe98000c7c0 tx=0x7fe98000cad0).stop 2023-11-15T02:55:29.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.962+0000 7fe98f6a2700 1 -- 172.21.15.1:0/3598545100 shutdown_connections 2023-11-15T02:55:29.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.962+0000 7fe98f6a2700 1 --2- 172.21.15.1:0/3598545100 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fe96c05f2c0 0x7fe96c061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:29.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.962+0000 7fe98f6a2700 1 --2- 172.21.15.1:0/3598545100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe988154bf0 0x7fe9880c10f0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:29.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.962+0000 7fe98f6a2700 1 --2- 172.21.15.1:0/3598545100 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe988069ba0 0x7fe98814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:29.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.963+0000 7fe98f6a2700 1 --2- 172.21.15.1:0/3598545100 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9880c3e30 0x7fe9880a7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:29.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.963+0000 7fe98f6a2700 1 -- 172.21.15.1:0/3598545100 >> 172.21.15.1:0/3598545100 conn(0x7fe9880c7dc0 msgr2=0x7fe9880c2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:29.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.963+0000 7fe98f6a2700 1 -- 172.21.15.1:0/3598545100 shutdown_connections 2023-11-15T02:55:29.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:29.963+0000 7fe98f6a2700 1 -- 172.21.15.1:0/3598545100 wait complete. 2023-11-15T02:55:29.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:55:29.977 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-11-15T02:55:29.997 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-11-15T02:55:30.111 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:30.109+0000 7fd8e22b8680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:55:30.140 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:30.139+0000 7f792e1e1680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:55:30.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.161+0000 7fc164b60700 1 Processor -- start 2023-11-15T02:55:30.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.161+0000 7fc164b60700 1 -- start start 2023-11-15T02:55:30.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.162+0000 7fc164b60700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc160062970 0x7fc160062d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:30.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.162+0000 7fc164b60700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc16006a610 con 0x7fc1600c23d0 2023-11-15T02:55:30.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.162+0000 7fc164b60700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc160065790 con 0x7fc1600c2850 2023-11-15T02:55:30.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.162+0000 7fc164b60700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc160065a30 con 0x7fc160062970 2023-11-15T02:55:30.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.162+0000 7fc15dd9b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc1600c23d0 0x7fc1600c5930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:56634/0 (socket says 172.21.15.1:56634) 2023-11-15T02:55:30.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.163+0000 7fc15dd9b700 1 -- 172.21.15.1:0/3808326370 learned_addr learned my addr 172.21.15.1:0/3808326370 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:30.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.163+0000 7fc15e59c700 1 --2- 172.21.15.1:0/3808326370 >> v2:172.21.15.141:3300/0 conn(0x7fc160062970 0x7fc160062d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:30.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.163+0000 7fc15d59a700 1 -- 172.21.15.1:0/3808326370 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356332585 0 0) 0x7fc16006a610 con 0x7fc1600c23d0 2023-11-15T02:55:30.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.163+0000 7fc15d59a700 1 -- 172.21.15.1:0/3808326370 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1480033f0 con 0x7fc1600c23d0 2023-11-15T02:55:30.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.163+0000 7fc15e59c700 1 -- 172.21.15.1:0/3808326370 >> v1:172.21.15.141:6789/0 conn(0x7fc1600c2850 legacy=0x7fc16013a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:30.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.163+0000 7fc15d59a700 1 -- 172.21.15.1:0/3808326370 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608406242 0 0) 0x7fc160065790 con 0x7fc1600c2850 2023-11-15T02:55:30.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.163+0000 7fc15e59c700 1 -- 172.21.15.1:0/3808326370 >> v1:172.21.15.1:6789/0 conn(0x7fc1600c23d0 legacy=0x7fc1600c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:30.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.163+0000 7fc15e59c700 1 -- 172.21.15.1:0/3808326370 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc160065d10 con 0x7fc160062970 2023-11-15T02:55:30.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.163+0000 7fc15e59c700 1 --2- 172.21.15.1:0/3808326370 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc160062970 0x7fc160062d50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7fc154009760 tx=0x7fc154009060).ready entity=mon.1 client_cookie=84fe9dc33c56b754 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:30.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.163+0000 7fc15d59a700 1 -- 172.21.15.1:0/3808326370 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400f510 con 0x7fc160062970 2023-11-15T02:55:30.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.163+0000 7fc15d59a700 1 -- 172.21.15.1:0/3808326370 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15400f670 con 0x7fc160062970 2023-11-15T02:55:30.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.163+0000 7fc15d59a700 1 -- 172.21.15.1:0/3808326370 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400f9f0 con 0x7fc160062970 2023-11-15T02:55:30.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.164+0000 7fc164b60700 1 -- 172.21.15.1:0/3808326370 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc160062970 msgr2=0x7fc160062d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:30.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.164+0000 7fc164b60700 1 --2- 172.21.15.1:0/3808326370 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc160062970 0x7fc160062d50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7fc154009760 tx=0x7fc154009060).stop 2023-11-15T02:55:30.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.164+0000 7fc164b60700 1 -- 172.21.15.1:0/3808326370 shutdown_connections 2023-11-15T02:55:30.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.164+0000 7fc164b60700 1 --2- 172.21.15.1:0/3808326370 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc160062970 0x7fc160062d50 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:30.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.164+0000 7fc164b60700 1 -- 172.21.15.1:0/3808326370 >> 172.21.15.1:0/3808326370 conn(0x7fc1600c7dd0 msgr2=0x7fc1600c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:30.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.164+0000 7fc164b60700 1 -- 172.21.15.1:0/3808326370 shutdown_connections 2023-11-15T02:55:30.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.164+0000 7fc164b60700 1 -- 172.21.15.1:0/3808326370 wait complete. 2023-11-15T02:55:30.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.165+0000 7fc164b60700 1 Processor -- start 2023-11-15T02:55:30.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.165+0000 7fc164b60700 1 -- start start 2023-11-15T02:55:30.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc164b60700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc160062970 0x7fc1600c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:30.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc164b60700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1600c23d0 0x7fc1600ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:30.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc164b60700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1600c2850 0x7fc1600ad570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:30.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc164b60700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc160158130 con 0x7fc1600c23d0 2023-11-15T02:55:30.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc164b60700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc160167f20 con 0x7fc1600c2850 2023-11-15T02:55:30.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc164b60700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc160168200 con 0x7fc160062970 2023-11-15T02:55:30.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc15dd9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1600c23d0 0x7fc1600ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:30.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc15e59c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc160062970 0x7fc1600c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:30.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc15dd9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1600c23d0 0x7fc1600ad080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45208/0 (socket says 172.21.15.1:45208) 2023-11-15T02:55:30.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc15dd9b700 1 -- 172.21.15.1:0/1204470660 learned_addr learned my addr 172.21.15.1:0/1204470660 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:30.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc15ed9d700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1600c2850 0x7fc1600ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:30.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc15e59c700 1 -- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1600c2850 msgr2=0x7fc1600ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:30.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc15e59c700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1600c2850 0x7fc1600ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:30.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc15e59c700 1 -- 172.21.15.1:0/1204470660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1600c23d0 msgr2=0x7fc1600ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:30.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc15e59c700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1600c23d0 0x7fc1600ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:30.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc15e59c700 1 -- 172.21.15.1:0/1204470660 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1540092a0 con 0x7fc160062970 2023-11-15T02:55:30.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc15dd9b700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1600c23d0 0x7fc1600ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:30.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.166+0000 7fc15ed9d700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1600c2850 0x7fc1600ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:30.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.167+0000 7fc15e59c700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc160062970 0x7fc1600c10d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fc154014000 tx=0x7fc154017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:30.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.167+0000 7fc14e7fc700 1 -- 172.21.15.1:0/1204470660 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400fe80 con 0x7fc160062970 2023-11-15T02:55:30.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.167+0000 7fc14e7fc700 1 -- 172.21.15.1:0/1204470660 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15400f7e0 con 0x7fc160062970 2023-11-15T02:55:30.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.167+0000 7fc164b60700 1 -- 172.21.15.1:0/1204470660 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1601684e0 con 0x7fc160062970 2023-11-15T02:55:30.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.167+0000 7fc14e7fc700 1 -- 172.21.15.1:0/1204470660 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15401b640 con 0x7fc160062970 2023-11-15T02:55:30.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.167+0000 7fc164b60700 1 -- 172.21.15.1:0/1204470660 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1600ada60 con 0x7fc160062970 2023-11-15T02:55:30.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.168+0000 7fc164b60700 1 -- 172.21.15.1:0/1204470660 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16006c7e0 con 0x7fc160062970 2023-11-15T02:55:30.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.168+0000 7fc14e7fc700 1 -- 172.21.15.1:0/1204470660 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 99) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fc15401b9b0 con 0x7fc160062970 2023-11-15T02:55:30.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.168+0000 7fc14e7fc700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 0x7fc140061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:30.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.169+0000 7fc14e7fc700 1 -- 172.21.15.1:0/1204470660 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6673+0+0 (secure 0 0 0) 0x7fc15407bfa0 con 0x7fc160062970 2023-11-15T02:55:30.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.169+0000 7fc15dd9b700 1 -- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 msgr2=0x7fc140061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:30.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.169+0000 7fc15dd9b700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 0x7fc140061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:30.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.173+0000 7fc14e7fc700 1 -- 172.21.15.1:0/1204470660 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc15404cec0 con 0x7fc160062970 2023-11-15T02:55:30.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.370+0000 7fc15dd9b700 1 -- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 msgr2=0x7fc140061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:30.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.370+0000 7fc15dd9b700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 0x7fc140061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:55:30.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.376+0000 7fc164b60700 1 -- 172.21.15.1:0/1204470660 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc160065ff0 con 0x7fc14005f2c0 2023-11-15T02:55:30.722 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:30.720+0000 7fd8e22b8680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:55:30.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.771+0000 7fc15dd9b700 1 -- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 msgr2=0x7fc140061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:30.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:30.771+0000 7fc15dd9b700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 0x7fc140061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-11-15T02:55:30.794 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:30.792+0000 7fd8e22b8680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:55:30.808 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:30.807+0000 7f792e1e1680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:55:30.877 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:30.876+0000 7f792e1e1680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:55:30.980 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:30.977+0000 7fd8e22b8680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:55:31.072 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:31.071+0000 7f792e1e1680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:55:31.399 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:31.396+0000 7fd8e22b8680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:55:31.501 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:31.499+0000 7fd8e22b8680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:55:31.513 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:31.512+0000 7f792e1e1680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:55:31.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:31.572+0000 7fc15dd9b700 1 -- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 msgr2=0x7fc140061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:31.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:31.572+0000 7fc15dd9b700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 0x7fc140061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-11-15T02:55:31.622 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:31.621+0000 7f792e1e1680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:55:31.655 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:31.652+0000 7fd8e22b8680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:55:31.729 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:31.727+0000 7fd8e22b8680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:55:31.781 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:31.780+0000 7f792e1e1680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:55:31.795 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:31.793+0000 7fd8e22b8680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:55:31.859 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:31.858+0000 7f792e1e1680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:55:31.930 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:31.929+0000 7f792e1e1680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:55:32.053 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:32.050+0000 7fd8e22b8680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:55:32.204 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:32.202+0000 7f792e1e1680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:55:32.236 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:32.234+0000 7fd8e22b8680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:55:32.399 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:32.397+0000 7f792e1e1680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:55:32.884 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:32.882+0000 7fd8e22b8680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:55:32.953 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:32.950+0000 7fd8e22b8680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:55:33.028 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.027+0000 7fd8e22b8680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:55:33.086 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:33.084+0000 7f792e1e1680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:55:33.161 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:33.157+0000 7f792e1e1680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:55:33.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:33.172+0000 7fc15dd9b700 1 -- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 msgr2=0x7fc140061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:33.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:33.172+0000 7fc15dd9b700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 0x7fc140061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-11-15T02:55:33.175 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.174+0000 7fd8e22b8680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:55:33.238 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:33.236+0000 7f792e1e1680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:55:33.245 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.244+0000 7fd8e22b8680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:55:33.360 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.359+0000 7fd8e22b8680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:55:33.392 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:33.390+0000 7f792e1e1680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:55:33.466 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:33.464+0000 7f792e1e1680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:55:33.468 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.467+0000 7fd8e22b8680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:55:33.588 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:33.586+0000 7f792e1e1680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:55:33.702 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:33.700+0000 7f792e1e1680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:55:33.758 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.756+0000 7fd8e22b8680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:55:33.828 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.827+0000 7fd8e22b8680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:55:33.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:33.849+0000 7fc14e7fc700 1 -- 172.21.15.1:0/1204470660 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mgrmap(e 100) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fc1540799c0 con 0x7fc160062970 2023-11-15T02:55:33.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:33.849+0000 7fc14e7fc700 1 -- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 msgr2=0x7fc140061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:33.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:33.849+0000 7fc14e7fc700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 0x7fc140061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:33.912 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.911+0000 7fd859a43700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:33.913 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.911+0000 7fd859a43700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:33.913 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.911+0000 7fd859a43700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:33.913 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.911+0000 7fd859a43700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:33.913 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.911+0000 7fd859a43700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:33.913 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.911+0000 7fd856a3d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:33.914 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.911+0000 7fd856a3d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:33.914 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.911+0000 7fd856a3d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:33.914 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.911+0000 7fd856a3d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:33.914 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:33.911+0000 7fd856a3d700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:34.009 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:34.007+0000 7f792e1e1680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:55:34.083 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:34.081+0000 7f792e1e1680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:55:34.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.849+0000 7fc14e7fc700 1 -- 172.21.15.1:0/1204470660 <== mon.2 v2:172.21.15.141:3301/0 8 ==== mgrmap(e 101) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fc154079d40 con 0x7fc160062970 2023-11-15T02:55:34.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.850+0000 7fc14e7fc700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 0x7fc140061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:34.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.850+0000 7fc14e7fc700 1 -- 172.21.15.1:0/1204470660 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc160065ff0 con 0x7fc14005f2c0 2023-11-15T02:55:34.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.850+0000 7fc15dd9b700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 0x7fc140061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:34.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.852+0000 7fc15dd9b700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 0x7fc140061700 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fc1500011e0 tx=0x7fc150000bc0).ready entity=mgr.9286 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:34.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.872+0000 7fc14e7fc700 1 -- 172.21.15.1:0/1204470660 <== mgr.9286 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc160065ff0 con 0x7fc14005f2c0 2023-11-15T02:55:34.874 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule set for path snap_test_dir1 2023-11-15T02:55:34.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.874+0000 7fc164b60700 1 -- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 msgr2=0x7fc140061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:34.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.874+0000 7fc164b60700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 0x7fc140061700 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fc1500011e0 tx=0x7fc150000bc0).stop 2023-11-15T02:55:34.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.874+0000 7fc164b60700 1 -- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc160062970 msgr2=0x7fc1600c10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:34.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.874+0000 7fc164b60700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc160062970 0x7fc1600c10d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fc154014000 tx=0x7fc154017000).stop 2023-11-15T02:55:34.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.874+0000 7fc164b60700 1 -- 172.21.15.1:0/1204470660 shutdown_connections 2023-11-15T02:55:34.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.874+0000 7fc164b60700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc14005f2c0 0x7fc140061700 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:34.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.874+0000 7fc164b60700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1600c2850 0x7fc1600ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:34.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.874+0000 7fc164b60700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc160062970 0x7fc1600c10d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:34.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.874+0000 7fc164b60700 1 --2- 172.21.15.1:0/1204470660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1600c23d0 0x7fc1600ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:34.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.874+0000 7fc164b60700 1 -- 172.21.15.1:0/1204470660 >> 172.21.15.1:0/1204470660 conn(0x7fc1600c7dd0 msgr2=0x7fc1600c2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:34.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.874+0000 7fc164b60700 1 -- 172.21.15.1:0/1204470660 shutdown_connections 2023-11-15T02:55:34.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:34.874+0000 7fc164b60700 1 -- 172.21.15.1:0/1204470660 wait complete. 2023-11-15T02:55:34.891 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-11-15T02:55:34.891 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-11-15T02:55:35.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.019+0000 7fd18f3e8700 1 Processor -- start 2023-11-15T02:55:35.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.019+0000 7fd18f3e8700 1 -- start start 2023-11-15T02:55:35.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18f3e8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd18814e6e0 0x7fd18814eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18f3e8700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd188155370 0x7fd1880627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18f3e8700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd188062ca0 0x7fd188069610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18f3e8700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd188158e40 con 0x7fd188062ca0 2023-11-15T02:55:35.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18f3e8700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd188063130 con 0x7fd188155370 2023-11-15T02:55:35.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18f3e8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd188158230 con 0x7fd18814e6e0 2023-11-15T02:55:35.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18d985700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd188062ca0 0x7fd188069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18d985700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd188062ca0 0x7fd188069610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45212/0 (socket says 172.21.15.1:45212) 2023-11-15T02:55:35.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18d985700 1 -- 172.21.15.1:0/2221055869 learned_addr learned my addr 172.21.15.1:0/2221055869 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:35.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18c983700 1 --2- 172.21.15.1:0/2221055869 >> v2:172.21.15.141:3300/0 conn(0x7fd188155370 0x7fd1880627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18d184700 1 --2- 172.21.15.1:0/2221055869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd18814e6e0 0x7fd18814eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18d985700 1 -- 172.21.15.1:0/2221055869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd18814e6e0 msgr2=0x7fd18814eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:35.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18d985700 1 --2- 172.21.15.1:0/2221055869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd18814e6e0 0x7fd18814eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18d985700 1 -- 172.21.15.1:0/2221055869 >> v2:172.21.15.141:3300/0 conn(0x7fd188155370 msgr2=0x7fd1880627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:35.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18d985700 1 --2- 172.21.15.1:0/2221055869 >> v2:172.21.15.141:3300/0 conn(0x7fd188155370 0x7fd1880627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18d985700 1 -- 172.21.15.1:0/2221055869 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd188158510 con 0x7fd188062ca0 2023-11-15T02:55:35.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18d184700 1 --2- 172.21.15.1:0/2221055869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd18814e6e0 0x7fd18814eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:35.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18c983700 1 --2- 172.21.15.1:0/2221055869 >> v2:172.21.15.141:3300/0 conn(0x7fd188155370 0x7fd1880627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:35.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.020+0000 7fd18d985700 1 --2- 172.21.15.1:0/2221055869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188062ca0 0x7fd188069610 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7fd18805fb70 tx=0x7fd1780090f0).ready entity=mon.0 client_cookie=a248208751812fac server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:35.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.021+0000 7fd187fff700 1 -- 172.21.15.1:0/2221055869 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17800b600 con 0x7fd188062ca0 2023-11-15T02:55:35.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.021+0000 7fd187fff700 1 -- 172.21.15.1:0/2221055869 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17800b760 con 0x7fd188062ca0 2023-11-15T02:55:35.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.021+0000 7fd187fff700 1 -- 172.21.15.1:0/2221055869 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17800bae0 con 0x7fd188062ca0 2023-11-15T02:55:35.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.021+0000 7fd18f3e8700 1 -- 172.21.15.1:0/2221055869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188062ca0 msgr2=0x7fd188069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.021+0000 7fd18f3e8700 1 --2- 172.21.15.1:0/2221055869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188062ca0 0x7fd188069610 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7fd18805fb70 tx=0x7fd1780090f0).stop 2023-11-15T02:55:35.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.021+0000 7fd18f3e8700 1 -- 172.21.15.1:0/2221055869 shutdown_connections 2023-11-15T02:55:35.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.021+0000 7fd18f3e8700 1 --2- 172.21.15.1:0/2221055869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188062ca0 0x7fd188069610 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.021+0000 7fd18f3e8700 1 --2- 172.21.15.1:0/2221055869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd18814e6e0 0x7fd18814eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.021+0000 7fd18f3e8700 1 --2- 172.21.15.1:0/2221055869 >> v2:172.21.15.141:3300/0 conn(0x7fd188155370 0x7fd1880627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.021+0000 7fd18f3e8700 1 -- 172.21.15.1:0/2221055869 >> 172.21.15.1:0/2221055869 conn(0x7fd1880c7dc0 msgr2=0x7fd1880c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:35.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.021+0000 7fd18f3e8700 1 -- 172.21.15.1:0/2221055869 shutdown_connections 2023-11-15T02:55:35.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.021+0000 7fd18f3e8700 1 -- 172.21.15.1:0/2221055869 wait complete. 2023-11-15T02:55:35.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.022+0000 7fd18f3e8700 1 Processor -- start 2023-11-15T02:55:35.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.022+0000 7fd18f3e8700 1 -- start start 2023-11-15T02:55:35.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.023+0000 7fd18f3e8700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd188062ca0 0x7fd1881396f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.023+0000 7fd18f3e8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd18814e6e0 0x7fd18813af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.023+0000 7fd18f3e8700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd188155370 0x7fd18813da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.023+0000 7fd18f3e8700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880aa120 con 0x7fd18814e6e0 2023-11-15T02:55:35.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.023+0000 7fd18f3e8700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18813def0 con 0x7fd188062ca0 2023-11-15T02:55:35.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.023+0000 7fd18f3e8700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18813d250 con 0x7fd188155370 2023-11-15T02:55:35.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.023+0000 7fd18c983700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd18814e6e0 0x7fd18813af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.023+0000 7fd18c983700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd18814e6e0 0x7fd18813af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45222/0 (socket says 172.21.15.1:45222) 2023-11-15T02:55:35.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.023+0000 7fd18c983700 1 -- 172.21.15.1:0/471753326 learned_addr learned my addr 172.21.15.1:0/471753326 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:35.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.024+0000 7fd18c983700 1 -- 172.21.15.1:0/471753326 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd188155370 msgr2=0x7fd18813da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.024+0000 7fd18c983700 1 --2- 172.21.15.1:0/471753326 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd188155370 0x7fd18813da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:35.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.024+0000 7fd18c983700 1 -- 172.21.15.1:0/471753326 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd188062ca0 msgr2=0x7fd1881396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.024+0000 7fd18c983700 1 --2- 172.21.15.1:0/471753326 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd188062ca0 0x7fd1881396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:35.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.024+0000 7fd18c983700 1 -- 172.21.15.1:0/471753326 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd178009370 con 0x7fd18814e6e0 2023-11-15T02:55:35.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.024+0000 7fd18c983700 1 --2- 172.21.15.1:0/471753326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd18814e6e0 0x7fd18813af40 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7fd17c00d8c0 tx=0x7fd17c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:35.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.024+0000 7fd1857fa700 1 -- 172.21.15.1:0/471753326 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c017070 con 0x7fd18814e6e0 2023-11-15T02:55:35.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.024+0000 7fd1857fa700 1 -- 172.21.15.1:0/471753326 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c0095b0 con 0x7fd18814e6e0 2023-11-15T02:55:35.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.024+0000 7fd18f3e8700 1 -- 172.21.15.1:0/471753326 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1880aa370 con 0x7fd18814e6e0 2023-11-15T02:55:35.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.024+0000 7fd1857fa700 1 -- 172.21.15.1:0/471753326 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c009950 con 0x7fd18814e6e0 2023-11-15T02:55:35.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.024+0000 7fd18f3e8700 1 -- 172.21.15.1:0/471753326 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18813d4e0 con 0x7fd18814e6e0 2023-11-15T02:55:35.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.025+0000 7fd18f3e8700 1 -- 172.21.15.1:0/471753326 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18813d670 con 0x7fd18814e6e0 2023-11-15T02:55:35.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.025+0000 7fd1857fa700 1 -- 172.21.15.1:0/471753326 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 101) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fd17c009d00 con 0x7fd18814e6e0 2023-11-15T02:55:35.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.026+0000 7fd1857fa700 1 --2- 172.21.15.1:0/471753326 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd17405f080 0x7fd174061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.026+0000 7fd1857fa700 1 -- 172.21.15.1:0/471753326 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7fd17c079cd0 con 0x7fd18814e6e0 2023-11-15T02:55:35.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.026+0000 7fd18d184700 1 --2- 172.21.15.1:0/471753326 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd17405f080 0x7fd174061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.026+0000 7fd18d184700 1 --2- 172.21.15.1:0/471753326 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd17405f080 0x7fd174061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd1800094d0 tx=0x7fd1800096b0).ready entity=mgr.9286 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:35.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.030+0000 7fd1857fa700 1 -- 172.21.15.1:0/471753326 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd17c04ae40 con 0x7fd18814e6e0 2023-11-15T02:55:35.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.227+0000 7fd18f3e8700 1 -- 172.21.15.1:0/471753326 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd18806c7e0 con 0x7fd17405f080 2023-11-15T02:55:35.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.232+0000 7fd1857fa700 1 -- 172.21.15.1:0/471753326 <== mgr.9286 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fd18806c7e0 con 0x7fd17405f080 2023-11-15T02:55:35.235 INFO:teuthology.orchestra.run.smithi001.stdout:Retention added to path snap_test_dir1 2023-11-15T02:55:35.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.234+0000 7fd18f3e8700 1 -- 172.21.15.1:0/471753326 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd17405f080 msgr2=0x7fd174061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.234+0000 7fd18f3e8700 1 --2- 172.21.15.1:0/471753326 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd17405f080 0x7fd174061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd1800094d0 tx=0x7fd1800096b0).stop 2023-11-15T02:55:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.234+0000 7fd18f3e8700 1 -- 172.21.15.1:0/471753326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd18814e6e0 msgr2=0x7fd18813af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.234+0000 7fd18f3e8700 1 --2- 172.21.15.1:0/471753326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd18814e6e0 0x7fd18813af40 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7fd17c00d8c0 tx=0x7fd17c008040).stop 2023-11-15T02:55:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.234+0000 7fd18f3e8700 1 -- 172.21.15.1:0/471753326 shutdown_connections 2023-11-15T02:55:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.234+0000 7fd18f3e8700 1 --2- 172.21.15.1:0/471753326 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd17405f080 0x7fd174061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.234+0000 7fd18f3e8700 1 --2- 172.21.15.1:0/471753326 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd188155370 0x7fd18813da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.234+0000 7fd18f3e8700 1 --2- 172.21.15.1:0/471753326 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd188062ca0 0x7fd1881396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.234+0000 7fd18f3e8700 1 --2- 172.21.15.1:0/471753326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd18814e6e0 0x7fd18813af40 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.234+0000 7fd18f3e8700 1 -- 172.21.15.1:0/471753326 >> 172.21.15.1:0/471753326 conn(0x7fd1880c7dc0 msgr2=0x7fd18813a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:35.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.234+0000 7fd18f3e8700 1 -- 172.21.15.1:0/471753326 shutdown_connections 2023-11-15T02:55:35.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.234+0000 7fd18f3e8700 1 -- 172.21.15.1:0/471753326 wait complete. 2023-11-15T02:55:35.248 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-11-15T02:55:35.253 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-11-15-02_56_00 in ~25s... 2023-11-15T02:55:35.253 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-11-15T02:55:35.254 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-11-15T02:55:35.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.374+0000 7fab88058700 1 Processor -- start 2023-11-15T02:55:35.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.374+0000 7fab88058700 1 -- start start 2023-11-15T02:55:35.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab88058700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fab801556d0 0x7fab80066b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab88058700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab80062ec0 0x7fab800a7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab88058700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8006a240 con 0x7fab80067070 2023-11-15T02:55:35.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab88058700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab800c39f0 con 0x7fab801556d0 2023-11-15T02:55:35.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab88058700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab80069630 con 0x7fab80062ec0 2023-11-15T02:55:35.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab865f5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab80062ec0 0x7fab800a7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab85df4700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fab801556d0 0x7fab80066b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab865f5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab80062ec0 0x7fab800a7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:36744/0 (socket says 172.21.15.1:36744) 2023-11-15T02:55:35.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab85df4700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fab801556d0 0x7fab80066b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:38156/0 (socket says 172.21.15.1:38156) 2023-11-15T02:55:35.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab865f5700 1 -- 172.21.15.1:0/3048364185 learned_addr learned my addr 172.21.15.1:0/3048364185 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:35.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab865f5700 1 -- 172.21.15.1:0/3048364185 >> v2:172.21.15.141:3300/0 conn(0x7fab801556d0 msgr2=0x7fab80066b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:35.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab865f5700 1 --2- 172.21.15.1:0/3048364185 >> v2:172.21.15.141:3300/0 conn(0x7fab801556d0 0x7fab80066b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab865f5700 1 -- 172.21.15.1:0/3048364185 >> v1:172.21.15.141:6789/0 conn(0x7fab80067070 legacy=0x7fab800627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab84df2700 1 -- 172.21.15.1:0/3048364185 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189375727 0 0) 0x7fab8006a240 con 0x7fab80067070 2023-11-15T02:55:35.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab865f5700 1 -- 172.21.15.1:0/3048364185 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab80069910 con 0x7fab80062ec0 2023-11-15T02:55:35.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.375+0000 7fab85df4700 1 --2- 172.21.15.1:0/3048364185 >> v2:172.21.15.141:3300/0 conn(0x7fab801556d0 0x7fab80066b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:35.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.376+0000 7fab865f5700 1 --2- 172.21.15.1:0/3048364185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab80062ec0 0x7fab800a7980 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fab70006fd0 tx=0x7fab700090f0).ready entity=mon.2 client_cookie=7b799f52ee08d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:35.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.376+0000 7fab84df2700 1 -- 172.21.15.1:0/3048364185 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7000b580 con 0x7fab80062ec0 2023-11-15T02:55:35.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.376+0000 7fab84df2700 1 -- 172.21.15.1:0/3048364185 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7000b6e0 con 0x7fab80062ec0 2023-11-15T02:55:35.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.376+0000 7fab84df2700 1 -- 172.21.15.1:0/3048364185 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7000ba60 con 0x7fab80062ec0 2023-11-15T02:55:35.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.376+0000 7fab88058700 1 -- 172.21.15.1:0/3048364185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab80062ec0 msgr2=0x7fab800a7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.376+0000 7fab88058700 1 --2- 172.21.15.1:0/3048364185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab80062ec0 0x7fab800a7980 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fab70006fd0 tx=0x7fab700090f0).stop 2023-11-15T02:55:35.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.376+0000 7fab88058700 1 -- 172.21.15.1:0/3048364185 shutdown_connections 2023-11-15T02:55:35.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.376+0000 7fab88058700 1 --2- 172.21.15.1:0/3048364185 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab80062ec0 0x7fab800a7980 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.376+0000 7fab88058700 1 --2- 172.21.15.1:0/3048364185 >> v2:172.21.15.141:3300/0 conn(0x7fab801556d0 0x7fab80066b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.376+0000 7fab88058700 1 -- 172.21.15.1:0/3048364185 >> 172.21.15.1:0/3048364185 conn(0x7fab800c7dd0 msgr2=0x7fab800c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:35.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.376+0000 7fab88058700 1 -- 172.21.15.1:0/3048364185 shutdown_connections 2023-11-15T02:55:35.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.376+0000 7fab88058700 1 -- 172.21.15.1:0/3048364185 wait complete. 2023-11-15T02:55:35.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.377+0000 7fab88058700 1 Processor -- start 2023-11-15T02:55:35.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.378+0000 7fab88058700 1 -- start start 2023-11-15T02:55:35.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.378+0000 7fab88058700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab80062ec0 0x7fab800aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.378+0000 7fab88058700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab80067070 0x7fab80144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.378+0000 7fab88058700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab801556d0 0x7fab80152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.378+0000 7fab88058700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab80145b10 con 0x7fab801556d0 2023-11-15T02:55:35.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.378+0000 7fab88058700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab800c1470 con 0x7fab80067070 2023-11-15T02:55:35.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.378+0000 7fab88058700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab800c1750 con 0x7fab80062ec0 2023-11-15T02:55:35.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.378+0000 7fab865f5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab801556d0 0x7fab80152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.378+0000 7fab865f5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab801556d0 0x7fab80152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45234/0 (socket says 172.21.15.1:45234) 2023-11-15T02:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.378+0000 7fab865f5700 1 -- 172.21.15.1:0/4016539657 learned_addr learned my addr 172.21.15.1:0/4016539657 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.379+0000 7fab85df4700 1 --2- 172.21.15.1:0/4016539657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab80062ec0 0x7fab800aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.379+0000 7fab855f3700 1 --2- 172.21.15.1:0/4016539657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab80067070 0x7fab80144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.379+0000 7fab865f5700 1 -- 172.21.15.1:0/4016539657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab80062ec0 msgr2=0x7fab800aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.379+0000 7fab865f5700 1 --2- 172.21.15.1:0/4016539657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab80062ec0 0x7fab800aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.379+0000 7fab865f5700 1 -- 172.21.15.1:0/4016539657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab80067070 msgr2=0x7fab80144e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.379+0000 7fab865f5700 1 --2- 172.21.15.1:0/4016539657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab80067070 0x7fab80144e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.379+0000 7fab865f5700 1 -- 172.21.15.1:0/4016539657 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab78009a20 con 0x7fab801556d0 2023-11-15T02:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.379+0000 7fab865f5700 1 --2- 172.21.15.1:0/4016539657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab801556d0 0x7fab80152d40 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7fab70009fd0 tx=0x7fab70017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.379+0000 7fab7dffb700 1 -- 172.21.15.1:0/4016539657 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab70006d90 con 0x7fab801556d0 2023-11-15T02:55:35.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.379+0000 7fab7dffb700 1 -- 172.21.15.1:0/4016539657 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7000b850 con 0x7fab801556d0 2023-11-15T02:55:35.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.379+0000 7fab88058700 1 -- 172.21.15.1:0/4016539657 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab70009370 con 0x7fab801556d0 2023-11-15T02:55:35.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.379+0000 7fab7dffb700 1 -- 172.21.15.1:0/4016539657 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7001b640 con 0x7fab801556d0 2023-11-15T02:55:35.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.379+0000 7fab88058700 1 -- 172.21.15.1:0/4016539657 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab800c1090 con 0x7fab801556d0 2023-11-15T02:55:35.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.380+0000 7fab88058700 1 -- 172.21.15.1:0/4016539657 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8006c7e0 con 0x7fab801556d0 2023-11-15T02:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.381+0000 7fab7dffb700 1 -- 172.21.15.1:0/4016539657 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 101) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fab7001b9f0 con 0x7fab801556d0 2023-11-15T02:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.381+0000 7fab7dffb700 1 --2- 172.21.15.1:0/4016539657 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fab6c05f080 0x7fab6c061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.381+0000 7fab7dffb700 1 -- 172.21.15.1:0/4016539657 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7fab7007bd10 con 0x7fab801556d0 2023-11-15T02:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.381+0000 7fab85df4700 1 --2- 172.21.15.1:0/4016539657 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fab6c05f080 0x7fab6c061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.382+0000 7fab85df4700 1 --2- 172.21.15.1:0/4016539657 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fab6c05f080 0x7fab6c061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fab78009fd0 tx=0x7fab7800b040).ready entity=mgr.9286 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.385+0000 7fab7dffb700 1 -- 172.21.15.1:0/4016539657 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fab700aaaf0 con 0x7fab801556d0 2023-11-15T02:55:35.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.581+0000 7fab88058700 1 -- 172.21.15.1:0/4016539657 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab800c1bf0 con 0x7fab6c05f080 2023-11-15T02:55:35.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.584+0000 7fab7dffb700 1 -- 172.21.15.1:0/4016539657 <== mgr.9286 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7fab800c1bf0 con 0x7fab6c05f080 2023-11-15T02:55:35.586 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:35.586 INFO:teuthology.orchestra.run.smithi001.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-11-15T02:55:35.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.586+0000 7fab88058700 1 -- 172.21.15.1:0/4016539657 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fab6c05f080 msgr2=0x7fab6c061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.586+0000 7fab88058700 1 --2- 172.21.15.1:0/4016539657 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fab6c05f080 0x7fab6c061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fab78009fd0 tx=0x7fab7800b040).stop 2023-11-15T02:55:35.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.586+0000 7fab88058700 1 -- 172.21.15.1:0/4016539657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab801556d0 msgr2=0x7fab80152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.586+0000 7fab88058700 1 --2- 172.21.15.1:0/4016539657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab801556d0 0x7fab80152d40 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7fab70009fd0 tx=0x7fab70017000).stop 2023-11-15T02:55:35.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.586+0000 7fab88058700 1 -- 172.21.15.1:0/4016539657 shutdown_connections 2023-11-15T02:55:35.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.586+0000 7fab88058700 1 --2- 172.21.15.1:0/4016539657 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fab6c05f080 0x7fab6c061540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.586+0000 7fab88058700 1 --2- 172.21.15.1:0/4016539657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fab801556d0 0x7fab80152d40 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.586+0000 7fab88058700 1 --2- 172.21.15.1:0/4016539657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab80062ec0 0x7fab800aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.586+0000 7fab88058700 1 --2- 172.21.15.1:0/4016539657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab80067070 0x7fab80144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.586+0000 7fab88058700 1 -- 172.21.15.1:0/4016539657 >> 172.21.15.1:0/4016539657 conn(0x7fab800c7dd0 msgr2=0x7fab801549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:35.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.586+0000 7fab88058700 1 -- 172.21.15.1:0/4016539657 shutdown_connections 2023-11-15T02:55:35.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.586+0000 7fab88058700 1 -- 172.21.15.1:0/4016539657 wait complete. 2023-11-15T02:55:35.600 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-11-15T02:55:35.600 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-11-15T02:55:35.601 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-11-15T02:55:35.674 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:55:35.677 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:55:35.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.722+0000 7f30955b4700 1 Processor -- start 2023-11-15T02:55:35.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.722+0000 7f30955b4700 1 -- start start 2023-11-15T02:55:35.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.722+0000 7f30955b4700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f309014b350 0x7f30900c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.722+0000 7f30955b4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309014b730 0x7f3090154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.722+0000 7f30955b4700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30901580d0 con 0x7f30900aa040 2023-11-15T02:55:35.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.722+0000 7f30955b4700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3090155000 con 0x7f309014b350 2023-11-15T02:55:35.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.722+0000 7f30955b4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30901552e0 con 0x7f309014b730 2023-11-15T02:55:35.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308f7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f30900aa040 0x7f3090158560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:56640/0 (socket says 172.21.15.1:56640) 2023-11-15T02:55:35.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308f7fe700 1 -- 172.21.15.1:0/2370947838 learned_addr learned my addr 172.21.15.1:0/2370947838 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:35.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308effd700 1 --2- 172.21.15.1:0/2370947838 >> v2:172.21.15.141:3300/0 conn(0x7f309014b350 0x7f30900c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308e7fc700 1 --2- 172.21.15.1:0/2370947838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309014b730 0x7f3090154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 -- 172.21.15.1:0/2370947838 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798178301 0 0) 0x7f30901580d0 con 0x7f30900aa040 2023-11-15T02:55:35.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 -- 172.21.15.1:0/2370947838 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30780033f0 con 0x7f30900aa040 2023-11-15T02:55:35.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 -- 172.21.15.1:0/2370947838 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3497615371 0 0) 0x7f30780033f0 con 0x7f30900aa040 2023-11-15T02:55:35.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 -- 172.21.15.1:0/2370947838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309014b730 msgr2=0x7f3090154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:35.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 --2- 172.21.15.1:0/2370947838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309014b730 0x7f3090154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 -- 172.21.15.1:0/2370947838 >> v2:172.21.15.141:3300/0 conn(0x7f309014b350 msgr2=0x7f30900c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:35.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 --2- 172.21.15.1:0/2370947838 >> v2:172.21.15.141:3300/0 conn(0x7f309014b350 0x7f30900c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 -- 172.21.15.1:0/2370947838 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30901555c0 con 0x7f30900aa040 2023-11-15T02:55:35.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 -- 172.21.15.1:0/2370947838 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f3088001470 con 0x7f30900aa040 2023-11-15T02:55:35.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 -- 172.21.15.1:0/2370947838 >> v1:172.21.15.1:6789/0 conn(0x7f30900aa040 legacy=0x7f3090158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 --2- 172.21.15.1:0/2370947838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30780038e0 0x7f3078003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 --2- 172.21.15.1:0/2370947838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309014b730 0x7f3078004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 --2- 172.21.15.1:0/2370947838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3078004b80 0x7f3078005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 -- 172.21.15.1:0/2370947838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3090155000 con 0x7f3078004b80 2023-11-15T02:55:35.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 -- 172.21.15.1:0/2370947838 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30901552e0 con 0x7f30780038e0 2023-11-15T02:55:35.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308dffb700 1 -- 172.21.15.1:0/2370947838 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307800b8e0 con 0x7f309014b730 2023-11-15T02:55:35.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.723+0000 7f308f7fe700 1 --2- 172.21.15.1:0/2370947838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3078004b80 0x7f3078005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.724+0000 7f308effd700 1 --2- 172.21.15.1:0/2370947838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30780038e0 0x7f3078003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.724+0000 7f308e7fc700 1 --2- 172.21.15.1:0/2370947838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309014b730 0x7f3078004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.724+0000 7f308f7fe700 1 -- 172.21.15.1:0/2370947838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309014b730 msgr2=0x7f3078004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:35.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.724+0000 7f308f7fe700 1 --2- 172.21.15.1:0/2370947838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309014b730 0x7f3078004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.724+0000 7f308f7fe700 1 -- 172.21.15.1:0/2370947838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30780038e0 msgr2=0x7f3078003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:35.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.724+0000 7f308f7fe700 1 --2- 172.21.15.1:0/2370947838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30780038e0 0x7f3078003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.724+0000 7f308f7fe700 1 -- 172.21.15.1:0/2370947838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30780033f0 con 0x7f3078004b80 2023-11-15T02:55:35.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.724+0000 7f308e7fc700 1 --2- 172.21.15.1:0/2370947838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f309014b730 0x7f3078004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:35.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.724+0000 7f308effd700 1 --2- 172.21.15.1:0/2370947838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30780038e0 0x7f3078003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:35.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.724+0000 7f308f7fe700 1 --2- 172.21.15.1:0/2370947838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3078004b80 0x7f3078005000 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 rx=0x7f308800c210 tx=0x7f3088001e90).ready entity=mon.0 client_cookie=70307a2d3c8a1354 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:35.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.724+0000 7f308dffb700 1 -- 172.21.15.1:0/2370947838 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088007a60 con 0x7f3078004b80 2023-11-15T02:55:35.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.724+0000 7f308dffb700 1 -- 172.21.15.1:0/2370947838 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308800cae0 con 0x7f3078004b80 2023-11-15T02:55:35.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.724+0000 7f308dffb700 1 -- 172.21.15.1:0/2370947838 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308800ce60 con 0x7f3078004b80 2023-11-15T02:55:35.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.725+0000 7f30955b4700 1 -- 172.21.15.1:0/2370947838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3078004b80 msgr2=0x7f3078005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.725+0000 7f30955b4700 1 --2- 172.21.15.1:0/2370947838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3078004b80 0x7f3078005000 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 rx=0x7f308800c210 tx=0x7f3088001e90).stop 2023-11-15T02:55:35.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.725+0000 7f308f7fe700 1 -- 172.21.15.1:0/2370947838 reap_dead start 2023-11-15T02:55:35.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.725+0000 7f30955b4700 1 -- 172.21.15.1:0/2370947838 shutdown_connections 2023-11-15T02:55:35.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.725+0000 7f30955b4700 1 -- 172.21.15.1:0/2370947838 >> 172.21.15.1:0/2370947838 conn(0x7f3090069ee0 msgr2=0x7f309006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:35.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.725+0000 7f30955b4700 1 -- 172.21.15.1:0/2370947838 shutdown_connections 2023-11-15T02:55:35.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.725+0000 7f30955b4700 1 -- 172.21.15.1:0/2370947838 wait complete. 2023-11-15T02:55:35.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.726+0000 7f30955b4700 1 Processor -- start 2023-11-15T02:55:35.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.726+0000 7f30955b4700 1 -- start start 2023-11-15T02:55:35.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f30955b4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309014a860 0x7f30900b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f30955b4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30900ae090 0x7f3090167cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f30955b4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30901681a0 0x7f30900c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f30955b4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30900af380 con 0x7f309014a860 2023-11-15T02:55:35.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f30955b4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309014ac40 con 0x7f30901681a0 2023-11-15T02:55:35.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f30955b4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3090168600 con 0x7f30900ae090 2023-11-15T02:55:35.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f308effd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309014a860 0x7f30900b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f308effd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309014a860 0x7f30900b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45246/0 (socket says 172.21.15.1:45246) 2023-11-15T02:55:35.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f308effd700 1 -- 172.21.15.1:0/1515109011 learned_addr learned my addr 172.21.15.1:0/1515109011 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:35.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f308f7fe700 1 --2- 172.21.15.1:0/1515109011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30901681a0 0x7f30900c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f308e7fc700 1 --2- 172.21.15.1:0/1515109011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30900ae090 0x7f3090167cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f308effd700 1 -- 172.21.15.1:0/1515109011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30900ae090 msgr2=0x7f3090167cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f308effd700 1 --2- 172.21.15.1:0/1515109011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30900ae090 0x7f3090167cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f308effd700 1 -- 172.21.15.1:0/1515109011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30901681a0 msgr2=0x7f30900c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f308effd700 1 --2- 172.21.15.1:0/1515109011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30901681a0 0x7f30900c4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f308effd700 1 -- 172.21.15.1:0/1515109011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30900ae800 con 0x7f309014a860 2023-11-15T02:55:35.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f308f7fe700 1 --2- 172.21.15.1:0/1515109011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30901681a0 0x7f30900c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:35.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f308effd700 1 --2- 172.21.15.1:0/1515109011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309014a860 0x7f30900b0b80 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7f308000f330 tx=0x7f308000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:35.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f3076ffd700 1 -- 172.21.15.1:0/1515109011 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308000e040 con 0x7f309014a860 2023-11-15T02:55:35.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.727+0000 7f3076ffd700 1 -- 172.21.15.1:0/1515109011 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308000f040 con 0x7f309014a860 2023-11-15T02:55:35.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.728+0000 7f30955b4700 1 -- 172.21.15.1:0/1515109011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30900aeae0 con 0x7f309014a860 2023-11-15T02:55:35.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.728+0000 7f3076ffd700 1 -- 172.21.15.1:0/1515109011 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3080015660 con 0x7f309014a860 2023-11-15T02:55:35.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.728+0000 7f30955b4700 1 -- 172.21.15.1:0/1515109011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30900af0a0 con 0x7f309014a860 2023-11-15T02:55:35.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.729+0000 7f30955b4700 1 -- 172.21.15.1:0/1515109011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309006c7e0 con 0x7f309014a860 2023-11-15T02:55:35.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.729+0000 7f3076ffd700 1 -- 172.21.15.1:0/1515109011 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 101) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f3080015a50 con 0x7f309014a860 2023-11-15T02:55:35.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.729+0000 7f3076ffd700 1 --2- 172.21.15.1:0/1515109011 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f307c05f080 0x7f307c061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:35.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.729+0000 7f3076ffd700 1 -- 172.21.15.1:0/1515109011 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7f308007b520 con 0x7f309014a860 2023-11-15T02:55:35.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.730+0000 7f308e7fc700 1 --2- 172.21.15.1:0/1515109011 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f307c05f080 0x7f307c061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:35.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.730+0000 7f308e7fc700 1 --2- 172.21.15.1:0/1515109011 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f307c05f080 0x7f307c061540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3084006d30 tx=0x7f3084009060).ready entity=mgr.9286 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:35.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.734+0000 7f3076ffd700 1 -- 172.21.15.1:0/1515109011 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f308004c690 con 0x7f309014a860 2023-11-15T02:55:35.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.899+0000 7f3076ffd700 1 -- 172.21.15.1:0/1515109011 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 102) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f3080015d00 con 0x7f309014a860 2023-11-15T02:55:35.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.934+0000 7f30955b4700 1 -- 172.21.15.1:0/1515109011 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f30900c61c0 con 0x7f307c05f080 2023-11-15T02:55:35.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.938+0000 7f3076ffd700 1 -- 172.21.15.1:0/1515109011 <== mgr.9286 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f30900c61c0 con 0x7f307c05f080 2023-11-15T02:55:35.940 INFO:teuthology.orchestra.run.smithi001.stdout:Schedule removed for path snap_test_dir1 2023-11-15T02:55:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.940+0000 7f30955b4700 1 -- 172.21.15.1:0/1515109011 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f307c05f080 msgr2=0x7f307c061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.940+0000 7f30955b4700 1 --2- 172.21.15.1:0/1515109011 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f307c05f080 0x7f307c061540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3084006d30 tx=0x7f3084009060).stop 2023-11-15T02:55:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.940+0000 7f30955b4700 1 -- 172.21.15.1:0/1515109011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309014a860 msgr2=0x7f30900b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.940+0000 7f30955b4700 1 --2- 172.21.15.1:0/1515109011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309014a860 0x7f30900b0b80 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7f308000f330 tx=0x7f308000b040).stop 2023-11-15T02:55:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.940+0000 7f30955b4700 1 -- 172.21.15.1:0/1515109011 shutdown_connections 2023-11-15T02:55:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.940+0000 7f30955b4700 1 --2- 172.21.15.1:0/1515109011 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f307c05f080 0x7f307c061540 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.940+0000 7f30955b4700 1 --2- 172.21.15.1:0/1515109011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30901681a0 0x7f30900c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.940+0000 7f30955b4700 1 --2- 172.21.15.1:0/1515109011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f309014a860 0x7f30900b0b80 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.940+0000 7f30955b4700 1 --2- 172.21.15.1:0/1515109011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30900ae090 0x7f3090167cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.940+0000 7f30955b4700 1 -- 172.21.15.1:0/1515109011 >> 172.21.15.1:0/1515109011 conn(0x7f3090069ee0 msgr2=0x7f30900c1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:35.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.940+0000 7f30955b4700 1 -- 172.21.15.1:0/1515109011 shutdown_connections 2023-11-15T02:55:35.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:35.940+0000 7f30955b4700 1 -- 172.21.15.1:0/1515109011 wait complete. 2023-11-15T02:55:35.955 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-11-15T02:55:35.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:55:35.956 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-11-15T02:55:35.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:55:35.973 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-11-15T02:55:36.031 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-11-15T02:55:36.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.189+0000 7fa94f47d700 1 Processor -- start 2023-11-15T02:55:36.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.189+0000 7fa94f47d700 1 -- start start 2023-11-15T02:55:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.190+0000 7fa94f47d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948137030 0x7fa948137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.190+0000 7fa94f47d700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa948066f80 0x7fa94814e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.190+0000 7fa94f47d700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa948154ce0 con 0x7fa9481588e0 2023-11-15T02:55:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.190+0000 7fa94f47d700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa948137900 con 0x7fa948066f80 2023-11-15T02:55:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.190+0000 7fa94f47d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa948154fc0 con 0x7fa948137030 2023-11-15T02:55:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.190+0000 7fa94d219700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948137030 0x7fa948137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.190+0000 7fa94da1a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa948066f80 0x7fa94814e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.190+0000 7fa94d219700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948137030 0x7fa948137410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:36772/0 (socket says 172.21.15.1:36772) 2023-11-15T02:55:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.190+0000 7fa94da1a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa948066f80 0x7fa94814e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:38192/0 (socket says 172.21.15.1:38192) 2023-11-15T02:55:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.190+0000 7fa94d219700 1 -- 172.21.15.1:0/4004031264 learned_addr learned my addr 172.21.15.1:0/4004031264 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.190+0000 7fa94ca18700 1 --1- 172.21.15.1:0/4004031264 >> v1:172.21.15.141:6789/0 conn(0x7fa9481588e0 0x7fa948066870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:47970/0 (socket says 172.21.15.1:47970) 2023-11-15T02:55:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa94d219700 1 -- 172.21.15.1:0/4004031264 >> v2:172.21.15.141:3300/0 conn(0x7fa948066f80 msgr2=0x7fa94814e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa94d219700 1 --2- 172.21.15.1:0/4004031264 >> v2:172.21.15.141:3300/0 conn(0x7fa948066f80 0x7fa94814e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa94d219700 1 -- 172.21.15.1:0/4004031264 >> v1:172.21.15.141:6789/0 conn(0x7fa9481588e0 legacy=0x7fa948066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa94d219700 1 -- 172.21.15.1:0/4004031264 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9481552a0 con 0x7fa948137030 2023-11-15T02:55:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa94da1a700 1 --2- 172.21.15.1:0/4004031264 >> v2:172.21.15.141:3300/0 conn(0x7fa948066f80 0x7fa94814e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa947fff700 1 -- 172.21.15.1:0/4004031264 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956935302 0 0) 0x7fa948154ce0 con 0x7fa9481588e0 2023-11-15T02:55:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa94d219700 1 --2- 172.21.15.1:0/4004031264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948137030 0x7fa948137410 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fa940009f20 tx=0x7fa940009840).ready entity=mon.2 client_cookie=35a4dcbc5e9cfe50 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa947fff700 1 -- 172.21.15.1:0/4004031264 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94000e070 con 0x7fa948137030 2023-11-15T02:55:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa947fff700 1 -- 172.21.15.1:0/4004031264 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94000b9d0 con 0x7fa948137030 2023-11-15T02:55:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa947fff700 1 -- 172.21.15.1:0/4004031264 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94000bd50 con 0x7fa948137030 2023-11-15T02:55:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa94f47d700 1 -- 172.21.15.1:0/4004031264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948137030 msgr2=0x7fa948137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa94f47d700 1 --2- 172.21.15.1:0/4004031264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948137030 0x7fa948137410 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fa940009f20 tx=0x7fa940009840).stop 2023-11-15T02:55:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa94f47d700 1 -- 172.21.15.1:0/4004031264 shutdown_connections 2023-11-15T02:55:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa94f47d700 1 --2- 172.21.15.1:0/4004031264 >> v2:172.21.15.141:3300/0 conn(0x7fa948066f80 0x7fa94814e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa94f47d700 1 --2- 172.21.15.1:0/4004031264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948137030 0x7fa948137410 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.191+0000 7fa94f47d700 1 -- 172.21.15.1:0/4004031264 >> 172.21.15.1:0/4004031264 conn(0x7fa948063280 msgr2=0x7fa9480c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.192+0000 7fa94f47d700 1 -- 172.21.15.1:0/4004031264 shutdown_connections 2023-11-15T02:55:36.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.192+0000 7fa94f47d700 1 -- 172.21.15.1:0/4004031264 wait complete. 2023-11-15T02:55:36.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.193+0000 7fa94f47d700 1 Processor -- start 2023-11-15T02:55:36.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.193+0000 7fa94f47d700 1 -- start start 2023-11-15T02:55:36.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94f47d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948066f80 0x7fa948165560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:36.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94f47d700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948137030 0x7fa9480adce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:36.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94f47d700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9481588e0 0x7fa9480ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:36.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94f47d700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9480ad850 con 0x7fa948066f80 2023-11-15T02:55:36.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94f47d700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa948150e40 con 0x7fa948137030 2023-11-15T02:55:36.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94f47d700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9480acf20 con 0x7fa9481588e0 2023-11-15T02:55:36.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94d219700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948066f80 0x7fa948165560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:36.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94d219700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948066f80 0x7fa948165560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45260/0 (socket says 172.21.15.1:45260) 2023-11-15T02:55:36.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94d219700 1 -- 172.21.15.1:0/2773013133 learned_addr learned my addr 172.21.15.1:0/2773013133 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:36.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94da1a700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9481588e0 0x7fa9480ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:36.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94ca18700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948137030 0x7fa9480adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:36.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94d219700 1 -- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9481588e0 msgr2=0x7fa9480ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:36.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94d219700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9481588e0 0x7fa9480ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:36.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94d219700 1 -- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948137030 msgr2=0x7fa9480adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:36.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94d219700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948137030 0x7fa9480adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:36.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94d219700 1 -- 172.21.15.1:0/2773013133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9380092a0 con 0x7fa948066f80 2023-11-15T02:55:36.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94ca18700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948137030 0x7fa9480adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:36.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94da1a700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9481588e0 0x7fa9480ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:36.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94d219700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948066f80 0x7fa948165560 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7fa94000b610 tx=0x7fa940009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:36.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa9457fa700 1 -- 172.21.15.1:0/2773013133 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9400092e0 con 0x7fa948066f80 2023-11-15T02:55:36.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa9457fa700 1 -- 172.21.15.1:0/2773013133 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94000bb40 con 0x7fa948066f80 2023-11-15T02:55:36.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94f47d700 1 -- 172.21.15.1:0/2773013133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa940009ae0 con 0x7fa948066f80 2023-11-15T02:55:36.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa9457fa700 1 -- 172.21.15.1:0/2773013133 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94001e680 con 0x7fa948066f80 2023-11-15T02:55:36.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.194+0000 7fa94f47d700 1 -- 172.21.15.1:0/2773013133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9480ad4e0 con 0x7fa948066f80 2023-11-15T02:55:36.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.195+0000 7fa94f47d700 1 -- 172.21.15.1:0/2773013133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9480adb30 con 0x7fa948066f80 2023-11-15T02:55:36.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.196+0000 7fa9457fa700 1 -- 172.21.15.1:0/2773013133 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 102) v1 ==== 75622+0+0 (secure 0 0 0) 0x7fa940003040 con 0x7fa948066f80 2023-11-15T02:55:36.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.196+0000 7fa9457fa700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa93405f350 0x7fa934061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:36.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.196+0000 7fa9457fa700 1 -- 172.21.15.1:0/2773013133 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7fa94007bc60 con 0x7fa948066f80 2023-11-15T02:55:36.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.196+0000 7fa94ca18700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa93405f350 0x7fa934061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:36.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.197+0000 7fa94ca18700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa93405f350 0x7fa934061810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa93c007fd0 tx=0x7fa93c009040).ready entity=mgr.9286 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:36.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.200+0000 7fa9457fa700 1 -- 172.21.15.1:0/2773013133 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa94004c9a0 con 0x7fa948066f80 2023-11-15T02:55:36.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.419+0000 7fa94f47d700 1 -- 172.21.15.1:0/2773013133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fa94806c7e0 con 0x7fa948066f80 2023-11-15T02:55:36.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.911+0000 7fa9457fa700 1 -- 172.21.15.1:0/2773013133 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fa9400793f0 con 0x7fa948066f80 2023-11-15T02:55:36.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.912+0000 7fa9457fa700 1 -- 172.21.15.1:0/2773013133 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v103) v1 ==== 93+0+0 (secure 0 0 0) 0x7fa940041b80 con 0x7fa948066f80 2023-11-15T02:55:36.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.915+0000 7fa94f47d700 1 -- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa93405f350 msgr2=0x7fa934061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:36.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.915+0000 7fa94f47d700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa93405f350 0x7fa934061810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa93c007fd0 tx=0x7fa93c009040).stop 2023-11-15T02:55:36.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.915+0000 7fa94f47d700 1 -- 172.21.15.1:0/2773013133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948066f80 msgr2=0x7fa948165560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:36.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.915+0000 7fa94f47d700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948066f80 0x7fa948165560 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7fa94000b610 tx=0x7fa940009840).stop 2023-11-15T02:55:36.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.915+0000 7fa94f47d700 1 -- 172.21.15.1:0/2773013133 shutdown_connections 2023-11-15T02:55:36.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.915+0000 7fa94f47d700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa93405f350 0x7fa934061810 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:36.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.915+0000 7fa94f47d700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9481588e0 0x7fa9480ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:36.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.915+0000 7fa94f47d700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa948066f80 0x7fa948165560 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:36.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.915+0000 7fa94f47d700 1 --2- 172.21.15.1:0/2773013133 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948137030 0x7fa9480adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:36.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.915+0000 7fa94f47d700 1 -- 172.21.15.1:0/2773013133 >> 172.21.15.1:0/2773013133 conn(0x7fa948063280 msgr2=0x7fa9480647f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:36.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.915+0000 7fa94f47d700 1 -- 172.21.15.1:0/2773013133 shutdown_connections 2023-11-15T02:55:36.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:36.915+0000 7fa94f47d700 1 -- 172.21.15.1:0/2773013133 wait complete. 2023-11-15T02:55:36.932 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-15T02:55:36.933 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:55:36.973 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-15T02:55:37.017 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-15T02:55:37.017 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-15T02:55:37.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-15T02:55:37.018 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-15T02:55:37.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T02:55:37.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:37.062 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-15T02:55:37.063 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:37.062+0000 7f7ae0a78680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:55:37.064 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:37.062+0000 7f37a9667680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-15T02:55:37.079 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:55:37.126 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:37.125+0000 7f7ae0a78680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:55:37.131 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:37.129+0000 7f37a9667680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-15T02:55:37.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.243+0000 7fc5d1f2b700 1 Processor -- start 2023-11-15T02:55:37.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.243+0000 7fc5d1f2b700 1 -- start start 2023-11-15T02:55:37.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5d1f2b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc5cc154150 0x7fc5cc154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5d1f2b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc5cc0ab1a0 0x7fc5cc158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5d1f2b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5cc0c06f0 con 0x7fc5cc0aa060 2023-11-15T02:55:37.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5d1f2b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc0c09d0 con 0x7fc5cc0ab1a0 2023-11-15T02:55:37.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5d1f2b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc158820 con 0x7fc5cc154150 2023-11-15T02:55:37.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5caffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc5cc0ab1a0 0x7fc5cc158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:37.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5caffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc5cc0ab1a0 0x7fc5cc158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45268/0 (socket says 172.21.15.1:45268) 2023-11-15T02:55:37.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5caffd700 1 -- 172.21.15.1:0/2882477915 learned_addr learned my addr 172.21.15.1:0/2882477915 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:37.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5cb7fe700 1 --2- 172.21.15.1:0/2882477915 >> v2:172.21.15.141:3300/0 conn(0x7fc5cc154150 0x7fc5cc154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:37.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5caffd700 1 -- 172.21.15.1:0/2882477915 >> v2:172.21.15.141:3300/0 conn(0x7fc5cc154150 msgr2=0x7fc5cc154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:37.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5caffd700 1 --2- 172.21.15.1:0/2882477915 >> v2:172.21.15.141:3300/0 conn(0x7fc5cc154150 0x7fc5cc154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5caffd700 1 -- 172.21.15.1:0/2882477915 >> v1:172.21.15.141:6789/0 conn(0x7fc5cc0aa060 legacy=0x7fc5cc0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:37.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5caffd700 1 -- 172.21.15.1:0/2882477915 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc158b00 con 0x7fc5cc0ab1a0 2023-11-15T02:55:37.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5caffd700 1 --2- 172.21.15.1:0/2882477915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5cc0ab1a0 0x7fc5cc158040 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7fc5cc06bfb0 tx=0x7fc5c00090f0).ready entity=mon.0 client_cookie=fdfbe0854eb70dc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:37.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5ca7fc700 1 -- 172.21.15.1:0/2882477915 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000b520 con 0x7fc5cc0ab1a0 2023-11-15T02:55:37.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5ca7fc700 1 -- 172.21.15.1:0/2882477915 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c000b680 con 0x7fc5cc0ab1a0 2023-11-15T02:55:37.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.244+0000 7fc5ca7fc700 1 -- 172.21.15.1:0/2882477915 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000ba20 con 0x7fc5cc0ab1a0 2023-11-15T02:55:37.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.245+0000 7fc5d1f2b700 1 -- 172.21.15.1:0/2882477915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5cc0ab1a0 msgr2=0x7fc5cc158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:37.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.245+0000 7fc5d1f2b700 1 --2- 172.21.15.1:0/2882477915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5cc0ab1a0 0x7fc5cc158040 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7fc5cc06bfb0 tx=0x7fc5c00090f0).stop 2023-11-15T02:55:37.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.245+0000 7fc5d1f2b700 1 -- 172.21.15.1:0/2882477915 shutdown_connections 2023-11-15T02:55:37.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.245+0000 7fc5d1f2b700 1 --2- 172.21.15.1:0/2882477915 >> v2:172.21.15.141:3300/0 conn(0x7fc5cc154150 0x7fc5cc154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.245+0000 7fc5d1f2b700 1 --2- 172.21.15.1:0/2882477915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5cc0ab1a0 0x7fc5cc158040 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.245+0000 7fc5d1f2b700 1 -- 172.21.15.1:0/2882477915 >> 172.21.15.1:0/2882477915 conn(0x7fc5cc064aa0 msgr2=0x7fc5cc064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:37.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.245+0000 7fc5d1f2b700 1 -- 172.21.15.1:0/2882477915 shutdown_connections 2023-11-15T02:55:37.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.245+0000 7fc5d1f2b700 1 -- 172.21.15.1:0/2882477915 wait complete. 2023-11-15T02:55:37.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.246+0000 7fc5d1f2b700 1 Processor -- start 2023-11-15T02:55:37.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.246+0000 7fc5d1f2b700 1 -- start start 2023-11-15T02:55:37.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.247+0000 7fc5d1f2b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5cc0aa060 0x7fc5cc144830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.247+0000 7fc5d1f2b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc5cc0ab1a0 0x7fc5cc0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.247+0000 7fc5d1f2b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5cc154150 0x7fc5cc0c1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.247+0000 7fc5d1f2b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc154fe0 con 0x7fc5cc154150 2023-11-15T02:55:37.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.247+0000 7fc5d1f2b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc1552c0 con 0x7fc5cc0aa060 2023-11-15T02:55:37.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.247+0000 7fc5d1f2b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc1555a0 con 0x7fc5cc0ab1a0 2023-11-15T02:55:37.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.247+0000 7fc5cbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5cc154150 0x7fc5cc0c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:37.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.247+0000 7fc5cbfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5cc154150 0x7fc5cc0c1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45270/0 (socket says 172.21.15.1:45270) 2023-11-15T02:55:37.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.247+0000 7fc5cbfff700 1 -- 172.21.15.1:0/846979030 learned_addr learned my addr 172.21.15.1:0/846979030 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:37.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.247+0000 7fc5cb7fe700 1 --2- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5cc0aa060 0x7fc5cc144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:37.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.247+0000 7fc5caffd700 1 --2- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc5cc0ab1a0 0x7fc5cc0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:37.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.248+0000 7fc5cbfff700 1 -- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc5cc0ab1a0 msgr2=0x7fc5cc0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:37.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.248+0000 7fc5cbfff700 1 --2- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc5cc0ab1a0 0x7fc5cc0b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.248+0000 7fc5cbfff700 1 -- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5cc0aa060 msgr2=0x7fc5cc144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:37.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.248+0000 7fc5cbfff700 1 --2- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5cc0aa060 0x7fc5cc144830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.248+0000 7fc5cbfff700 1 -- 172.21.15.1:0/846979030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c0009370 con 0x7fc5cc154150 2023-11-15T02:55:37.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.248+0000 7fc5cbfff700 1 --2- 172.21.15.1:0/846979030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5cc154150 0x7fc5cc0c1270 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7fc5c4002230 tx=0x7fc5c40015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:37.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.248+0000 7fc5b37fe700 1 -- 172.21.15.1:0/846979030 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4010510 con 0x7fc5cc154150 2023-11-15T02:55:37.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.248+0000 7fc5b37fe700 1 -- 172.21.15.1:0/846979030 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c4010670 con 0x7fc5cc154150 2023-11-15T02:55:37.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.248+0000 7fc5d1f2b700 1 -- 172.21.15.1:0/846979030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5cc155880 con 0x7fc5cc154150 2023-11-15T02:55:37.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.248+0000 7fc5b37fe700 1 -- 172.21.15.1:0/846979030 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c40109f0 con 0x7fc5cc154150 2023-11-15T02:55:37.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.248+0000 7fc5d1f2b700 1 -- 172.21.15.1:0/846979030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc144d20 con 0x7fc5cc154150 2023-11-15T02:55:37.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.249+0000 7fc5d1f2b700 1 -- 172.21.15.1:0/846979030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5cc06c7e0 con 0x7fc5cc154150 2023-11-15T02:55:37.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.249+0000 7fc5b37fe700 1 -- 172.21.15.1:0/846979030 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fc5c401b400 con 0x7fc5cc154150 2023-11-15T02:55:37.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.250+0000 7fc5b37fe700 1 --2- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc5b805f300 0x7fc5b80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.250+0000 7fc5b37fe700 1 -- 172.21.15.1:0/846979030 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7fc5c407a530 con 0x7fc5cc154150 2023-11-15T02:55:37.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.250+0000 7fc5cb7fe700 1 -- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc5b805f300 msgr2=0x7fc5b80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:37.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.250+0000 7fc5cb7fe700 1 --2- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc5b805f300 0x7fc5b80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:37.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.254+0000 7fc5b37fe700 1 -- 172.21.15.1:0/846979030 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc5c404b270 con 0x7fc5cc154150 2023-11-15T02:55:37.404 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:37.403+0000 7f7ae0a78680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:55:37.430 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:37.428+0000 7f37a9667680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-15T02:55:37.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.451+0000 7fc5cb7fe700 1 -- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc5b805f300 msgr2=0x7fc5b80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:37.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.451+0000 7fc5cb7fe700 1 --2- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc5b805f300 0x7fc5b80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:55:37.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.469+0000 7fc5d1f2b700 1 -- 172.21.15.1:0/846979030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5cc158de0 con 0x7fc5cc154150 2023-11-15T02:55:37.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.470+0000 7fc5b37fe700 1 -- 172.21.15.1:0/846979030 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4499 (secure 0 0 0) 0x7fc5c404e890 con 0x7fc5cc154150 2023-11-15T02:55:37.472 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:37.473 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":95,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10101,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2281092627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2281092627},{"type":"v1","addr":"172.21.15.1:6833","nonce":2281092627}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":10104,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3718177238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3718177238},{"type":"v1","addr":"172.21.15.1:6835","nonce":3718177238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":10113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3331826313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3331826313},{"type":"v1","addr":"172.21.15.141:6836","nonce":3331826313}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:55:21.588380+0000","modified":"2023-11-15T02:55:24.600875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10116":{"gid":10116,"name":"d","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/1145495775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1145495775},{"type":"v1","addr":"172.21.15.141:6837","nonce":1145495775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-11-15T02:55:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.472+0000 7fc5d1f2b700 1 -- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc5b805f300 msgr2=0x7fc5b80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.472+0000 7fc5d1f2b700 1 --2- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc5b805f300 0x7fc5b80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.472+0000 7fc5d1f2b700 1 -- 172.21.15.1:0/846979030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5cc154150 msgr2=0x7fc5cc0c1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.472+0000 7fc5d1f2b700 1 --2- 172.21.15.1:0/846979030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5cc154150 0x7fc5cc0c1270 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7fc5c4002230 tx=0x7fc5c40015e0).stop 2023-11-15T02:55:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.472+0000 7fc5d1f2b700 1 -- 172.21.15.1:0/846979030 shutdown_connections 2023-11-15T02:55:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.472+0000 7fc5d1f2b700 1 --2- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc5b805f300 0x7fc5b80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.472+0000 7fc5d1f2b700 1 --2- 172.21.15.1:0/846979030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5cc154150 0x7fc5cc0c1270 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.472+0000 7fc5d1f2b700 1 --2- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc5cc0aa060 0x7fc5cc144830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.472+0000 7fc5d1f2b700 1 --2- 172.21.15.1:0/846979030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc5cc0ab1a0 0x7fc5cc0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.472+0000 7fc5d1f2b700 1 -- 172.21.15.1:0/846979030 >> 172.21.15.1:0/846979030 conn(0x7fc5cc064aa0 msgr2=0x7fc5cc063460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:37.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.472+0000 7fc5d1f2b700 1 -- 172.21.15.1:0/846979030 shutdown_connections 2023-11-15T02:55:37.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.472+0000 7fc5d1f2b700 1 -- 172.21.15.1:0/846979030 wait complete. 2023-11-15T02:55:37.478 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 95 2023-11-15T02:55:37.487 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:55:37.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.649+0000 7f0279fc5700 1 Processor -- start 2023-11-15T02:55:37.651 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.649+0000 7f0279fc5700 1 -- start start 2023-11-15T02:55:37.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.649+0000 7f0279fc5700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f02740c8840 0x7f02740c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.649+0000 7f0279fc5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02740648d0 0x7f0274064d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.649+0000 7f0279fc5700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02740bed80 con 0x7f02740c7510 2023-11-15T02:55:37.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.649+0000 7f0279fc5700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02740c3ac0 con 0x7f02740c8840 2023-11-15T02:55:37.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.649+0000 7f0279fc5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0274154a50 con 0x7f02740648d0 2023-11-15T02:55:37.655 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.650+0000 7f0278fc3700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f02740c8840 0x7f02740c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:37.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.650+0000 7f02797c4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02740648d0 0x7f0274064d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:37.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.650+0000 7f0273fff700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f02740c7510 0x7f02740c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:37922/0 (socket says 172.21.15.1:37922) 2023-11-15T02:55:37.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.650+0000 7f0278fc3700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f02740c8840 0x7f02740c35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:58230/0 (socket says 172.21.15.1:58230) 2023-11-15T02:55:37.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.650+0000 7f0273fff700 1 -- 172.21.15.1:0/485453342 learned_addr learned my addr 172.21.15.1:0/485453342 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:37.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.650+0000 7f02797c4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02740648d0 0x7f0274064d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:47192/0 (socket says 172.21.15.1:47192) 2023-11-15T02:55:37.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.650+0000 7f02797c4700 1 -- 172.21.15.1:0/485453342 >> v2:172.21.15.141:3300/0 conn(0x7f02740c8840 msgr2=0x7f02740c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:37.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.650+0000 7f02797c4700 1 --2- 172.21.15.1:0/485453342 >> v2:172.21.15.141:3300/0 conn(0x7f02740c8840 0x7f02740c35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.650+0000 7f02797c4700 1 -- 172.21.15.1:0/485453342 >> v1:172.21.15.141:6789/0 conn(0x7f02740c7510 legacy=0x7f02740c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:37.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.650+0000 7f02737fe700 1 -- 172.21.15.1:0/485453342 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399353547 0 0) 0x7f02740bed80 con 0x7f02740c7510 2023-11-15T02:55:37.657 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.650+0000 7f02797c4700 1 -- 172.21.15.1:0/485453342 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740bde90 con 0x7f02740648d0 2023-11-15T02:55:37.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.650+0000 7f0278fc3700 1 --2- 172.21.15.1:0/485453342 >> v2:172.21.15.141:3300/0 conn(0x7f02740c8840 0x7f02740c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:37.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.650+0000 7f02797c4700 1 --2- 172.21.15.1:0/485453342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02740648d0 0x7f0274064d60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f026c009e60 tx=0x7f026c009780).ready entity=mon.2 client_cookie=6c857b672cbd1855 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:37.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.651+0000 7f02737fe700 1 -- 172.21.15.1:0/485453342 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c00e070 con 0x7f02740648d0 2023-11-15T02:55:37.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.651+0000 7f02737fe700 1 -- 172.21.15.1:0/485453342 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026c00bb60 con 0x7f02740648d0 2023-11-15T02:55:37.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.651+0000 7f02737fe700 1 -- 172.21.15.1:0/485453342 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c012410 con 0x7f02740648d0 2023-11-15T02:55:37.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.651+0000 7f0279fc5700 1 -- 172.21.15.1:0/485453342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02740648d0 msgr2=0x7f0274064d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:37.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.651+0000 7f0279fc5700 1 --2- 172.21.15.1:0/485453342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02740648d0 0x7f0274064d60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f026c009e60 tx=0x7f026c009780).stop 2023-11-15T02:55:37.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.651+0000 7f0279fc5700 1 -- 172.21.15.1:0/485453342 shutdown_connections 2023-11-15T02:55:37.659 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.651+0000 7f0279fc5700 1 --2- 172.21.15.1:0/485453342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02740648d0 0x7f0274064d60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.651+0000 7f0279fc5700 1 --2- 172.21.15.1:0/485453342 >> v2:172.21.15.141:3300/0 conn(0x7f02740c8840 0x7f02740c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.651+0000 7f0279fc5700 1 -- 172.21.15.1:0/485453342 >> 172.21.15.1:0/485453342 conn(0x7f0274062f90 msgr2=0x7f02740c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:37.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.651+0000 7f0279fc5700 1 -- 172.21.15.1:0/485453342 shutdown_connections 2023-11-15T02:55:37.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.651+0000 7f0279fc5700 1 -- 172.21.15.1:0/485453342 wait complete. 2023-11-15T02:55:37.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.652+0000 7f0279fc5700 1 Processor -- start 2023-11-15T02:55:37.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.652+0000 7f0279fc5700 1 -- start start 2023-11-15T02:55:37.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.653+0000 7f0279fc5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02740648d0 0x7f0274164ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.653+0000 7f0279fc5700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02740c7510 0x7f0274163cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.653+0000 7f0279fc5700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02740c8840 0x7f02740950b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.653+0000 7f0279fc5700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0274164cc0 con 0x7f02740648d0 2023-11-15T02:55:37.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.653+0000 7f0279fc5700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02740931f0 con 0x7f02740c7510 2023-11-15T02:55:37.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.653+0000 7f0279fc5700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0274164700 con 0x7f02740c8840 2023-11-15T02:55:37.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.653+0000 7f0278fc3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02740648d0 0x7f0274164ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:37.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.653+0000 7f0273fff700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02740c7510 0x7f0274163cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:37.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.653+0000 7f0278fc3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02740648d0 0x7f0274164ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52748/0 (socket says 172.21.15.1:52748) 2023-11-15T02:55:37.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.653+0000 7f0278fc3700 1 -- 172.21.15.1:0/2966437302 learned_addr learned my addr 172.21.15.1:0/2966437302 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:37.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.653+0000 7f02797c4700 1 --2- 172.21.15.1:0/2966437302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02740c8840 0x7f02740950b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:37.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.654+0000 7f0273fff700 1 -- 172.21.15.1:0/2966437302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02740c8840 msgr2=0x7f02740950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:37.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.654+0000 7f0273fff700 1 --2- 172.21.15.1:0/2966437302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02740c8840 0x7f02740950b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.654+0000 7f0273fff700 1 -- 172.21.15.1:0/2966437302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02740648d0 msgr2=0x7f0274164ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:37.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.654+0000 7f0273fff700 1 --2- 172.21.15.1:0/2966437302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02740648d0 0x7f0274164ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.654+0000 7f0273fff700 1 -- 172.21.15.1:0/2966437302 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02680092a0 con 0x7f02740c7510 2023-11-15T02:55:37.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.654+0000 7f02797c4700 1 --2- 172.21.15.1:0/2966437302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02740c8840 0x7f02740950b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:37.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.654+0000 7f0278fc3700 1 --2- 172.21.15.1:0/2966437302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02740648d0 0x7f0274164ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:37.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.654+0000 7f0273fff700 1 --2- 172.21.15.1:0/2966437302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02740c7510 0x7f0274163cc0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f0260001eb0 tx=0x7f0260007bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:37.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.654+0000 7f0270ff9700 1 -- 172.21.15.1:0/2966437302 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02600070d0 con 0x7f02740c7510 2023-11-15T02:55:37.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.654+0000 7f0270ff9700 1 -- 172.21.15.1:0/2966437302 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0260007250 con 0x7f02740c7510 2023-11-15T02:55:37.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.654+0000 7f0279fc5700 1 -- 172.21.15.1:0/2966437302 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026c009a20 con 0x7f02740c7510 2023-11-15T02:55:37.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.654+0000 7f0270ff9700 1 -- 172.21.15.1:0/2966437302 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260007610 con 0x7f02740c7510 2023-11-15T02:55:37.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.654+0000 7f0279fc5700 1 -- 172.21.15.1:0/2966437302 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0274092e80 con 0x7f02740c7510 2023-11-15T02:55:37.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.655+0000 7f0279fc5700 1 -- 172.21.15.1:0/2966437302 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02740635d0 con 0x7f02740c7510 2023-11-15T02:55:37.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.656+0000 7f0270ff9700 1 -- 172.21.15.1:0/2966437302 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f02600059b0 con 0x7f02740c7510 2023-11-15T02:55:37.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.656+0000 7f0270ff9700 1 --2- 172.21.15.1:0/2966437302 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f025805f300 0x7f02580617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.656+0000 7f0270ff9700 1 -- 172.21.15.1:0/2966437302 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7f0260079d80 con 0x7f02740c7510 2023-11-15T02:55:37.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.656+0000 7f0278fc3700 1 -- 172.21.15.1:0/2966437302 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f025805f300 msgr2=0x7f02580617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:37.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.656+0000 7f0278fc3700 1 --2- 172.21.15.1:0/2966437302 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f025805f300 0x7f02580617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:37.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.664+0000 7f0270ff9700 1 -- 172.21.15.1:0/2966437302 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f026004ab20 con 0x7f02740c7510 2023-11-15T02:55:37.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.841+0000 7f0279fc5700 1 -- 172.21.15.1:0/2966437302 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02740475e0 con 0x7f02740c7510 2023-11-15T02:55:37.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.842+0000 7f0270ff9700 1 -- 172.21.15.1:0/2966437302 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v213) v1 ==== 74+0+18121 (secure 0 0 0) 0x7f026007b070 con 0x7f02740c7510 2023-11-15T02:55:37.845 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:37.845 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":213,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:55:33.841451+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:55:19.243909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-11-15T02:55:20.580363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/1187088985":"2023-11-16T02:55:33.841413+0000","172.21.15.141:6833/103755":"2023-11-16T02:55:33.841413+0000","172.21.15.141:6832/103755":"2023-11-16T02:55:33.841413+0000","172.21.15.141:0/2020531998":"2023-11-16T02:55:33.841413+0000","172.21.15.141:0/2287874460":"2023-11-16T02:55:33.841413+0000","172.21.15.141:0/2718331164":"2023-11-16T02:55:33.841413+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:55:37.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.845+0000 7f0279fc5700 1 -- 172.21.15.1:0/2966437302 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f025805f300 msgr2=0x7f02580617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:37.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.845+0000 7f0279fc5700 1 --2- 172.21.15.1:0/2966437302 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f025805f300 0x7f02580617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:37.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.845+0000 7f0279fc5700 1 -- 172.21.15.1:0/2966437302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02740c7510 msgr2=0x7f0274163cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:37.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.845+0000 7f0279fc5700 1 --2- 172.21.15.1:0/2966437302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02740c7510 0x7f0274163cc0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f0260001eb0 tx=0x7f0260007bb0).stop 2023-11-15T02:55:37.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.845+0000 7f0279fc5700 1 -- 172.21.15.1:0/2966437302 shutdown_connections 2023-11-15T02:55:37.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.845+0000 7f0279fc5700 1 --2- 172.21.15.1:0/2966437302 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f025805f300 0x7f02580617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:37.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.845+0000 7f0279fc5700 1 --2- 172.21.15.1:0/2966437302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02740c8840 0x7f02740950b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.845+0000 7f0279fc5700 1 --2- 172.21.15.1:0/2966437302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02740648d0 0x7f0274164ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.845+0000 7f0279fc5700 1 --2- 172.21.15.1:0/2966437302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02740c7510 0x7f0274163cc0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.845+0000 7f0279fc5700 1 -- 172.21.15.1:0/2966437302 >> 172.21.15.1:0/2966437302 conn(0x7f0274062f90 msgr2=0x7f02740c4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:37.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.845+0000 7f0279fc5700 1 -- 172.21.15.1:0/2966437302 shutdown_connections 2023-11-15T02:55:37.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.845+0000 7f0279fc5700 1 -- 172.21.15.1:0/2966437302 wait complete. 2023-11-15T02:55:37.860 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-15T01:21:27.821797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '201', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-15T01:21:30.052498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-15T02:55:19.243909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '211', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-11-15T02:55:20.580363+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '212', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-15T02:55:37.861 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-15T02:55:37.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.984+0000 7fd1263d9700 1 Processor -- start 2023-11-15T02:55:37.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.984+0000 7fd1263d9700 1 -- start start 2023-11-15T02:55:37.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd1263d9700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd1200c50b0 0x7fd1200c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd1263d9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1200bc410 0x7fd1200bd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd1263d9700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd1200c1990 0x7fd1200c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd1263d9700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1200bd820 con 0x7fd1200c50b0 2023-11-15T02:55:37.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd1263d9700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12006bb50 con 0x7fd1200c1990 2023-11-15T02:55:37.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd1263d9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200627b0 con 0x7fd1200bc410 2023-11-15T02:55:37.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd1253d7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd1200c50b0 0x7fd1200c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:37.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd1253d7700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd1200c50b0 0x7fd1200c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52758/0 (socket says 172.21.15.1:52758) 2023-11-15T02:55:37.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd1253d7700 1 -- 172.21.15.1:0/4251635756 learned_addr learned my addr 172.21.15.1:0/4251635756 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:37.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd124bd6700 1 --2- 172.21.15.1:0/4251635756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1200bc410 0x7fd1200bd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:37.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd125bd8700 1 --2- 172.21.15.1:0/4251635756 >> v2:172.21.15.141:3300/0 conn(0x7fd1200c1990 0x7fd1200c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:37.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd1253d7700 1 -- 172.21.15.1:0/4251635756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1200bc410 msgr2=0x7fd1200bd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:37.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd1253d7700 1 --2- 172.21.15.1:0/4251635756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1200bc410 0x7fd1200bd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd1253d7700 1 -- 172.21.15.1:0/4251635756 >> v2:172.21.15.141:3300/0 conn(0x7fd1200c1990 msgr2=0x7fd1200c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:37.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd1253d7700 1 --2- 172.21.15.1:0/4251635756 >> v2:172.21.15.141:3300/0 conn(0x7fd1200c1990 0x7fd1200c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.985+0000 7fd1253d7700 1 -- 172.21.15.1:0/4251635756 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd120062a00 con 0x7fd1200c50b0 2023-11-15T02:55:37.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.986+0000 7fd1253d7700 1 --2- 172.21.15.1:0/4251635756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1200c50b0 0x7fd1200c5490 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7fd1200c1920 tx=0x7fd1140090f0).ready entity=mon.0 client_cookie=febdcdc1c32b9784 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:37.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.986+0000 7fd113fff700 1 -- 172.21.15.1:0/4251635756 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11400b600 con 0x7fd1200c50b0 2023-11-15T02:55:37.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.986+0000 7fd113fff700 1 -- 172.21.15.1:0/4251635756 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11400b760 con 0x7fd1200c50b0 2023-11-15T02:55:37.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.986+0000 7fd113fff700 1 -- 172.21.15.1:0/4251635756 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11400bae0 con 0x7fd1200c50b0 2023-11-15T02:55:37.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.986+0000 7fd1263d9700 1 -- 172.21.15.1:0/4251635756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1200c50b0 msgr2=0x7fd1200c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:37.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.986+0000 7fd1263d9700 1 --2- 172.21.15.1:0/4251635756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1200c50b0 0x7fd1200c5490 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7fd1200c1920 tx=0x7fd1140090f0).stop 2023-11-15T02:55:37.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.986+0000 7fd1263d9700 1 -- 172.21.15.1:0/4251635756 shutdown_connections 2023-11-15T02:55:37.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.986+0000 7fd1263d9700 1 --2- 172.21.15.1:0/4251635756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1200c50b0 0x7fd1200c5490 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.986+0000 7fd1263d9700 1 --2- 172.21.15.1:0/4251635756 >> v2:172.21.15.141:3300/0 conn(0x7fd1200c1990 0x7fd1200c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.986+0000 7fd1263d9700 1 --2- 172.21.15.1:0/4251635756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1200bc410 0x7fd1200bd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:37.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.986+0000 7fd1263d9700 1 -- 172.21.15.1:0/4251635756 >> 172.21.15.1:0/4251635756 conn(0x7fd1200c3e30 msgr2=0x7fd1200c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:37.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.986+0000 7fd1263d9700 1 -- 172.21.15.1:0/4251635756 shutdown_connections 2023-11-15T02:55:37.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.987+0000 7fd1263d9700 1 -- 172.21.15.1:0/4251635756 wait complete. 2023-11-15T02:55:37.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.988+0000 7fd1263d9700 1 Processor -- start 2023-11-15T02:55:37.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.988+0000 7fd1263d9700 1 -- start start 2023-11-15T02:55:37.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd1263d9700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1200bc410 0x7fd12014f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd1263d9700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1200c1990 0x7fd120167cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd1263d9700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1200c50b0 0x7fd1200a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:37.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd1263d9700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200be840 con 0x7fd1200c50b0 2023-11-15T02:55:37.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd1263d9700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1201685d0 con 0x7fd1200bc410 2023-11-15T02:55:37.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd1263d9700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1201688b0 con 0x7fd1200c1990 2023-11-15T02:55:37.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd125bd8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1200c50b0 0x7fd1200a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:38.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd125bd8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1200c50b0 0x7fd1200a7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52768/0 (socket says 172.21.15.1:52768) 2023-11-15T02:55:38.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd125bd8700 1 -- 172.21.15.1:0/4250012786 learned_addr learned my addr 172.21.15.1:0/4250012786 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:38.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd124bd6700 1 --2- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1200c1990 0x7fd120167cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:38.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd1253d7700 1 --2- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1200bc410 0x7fd12014f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:38.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd125bd8700 1 -- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1200c1990 msgr2=0x7fd120167cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:38.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd125bd8700 1 --2- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1200c1990 0x7fd120167cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd125bd8700 1 -- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1200bc410 msgr2=0x7fd12014f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:38.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd125bd8700 1 --2- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1200bc410 0x7fd12014f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd125bd8700 1 -- 172.21.15.1:0/4250012786 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd114009370 con 0x7fd1200c50b0 2023-11-15T02:55:38.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd125bd8700 1 --2- 172.21.15.1:0/4250012786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1200c50b0 0x7fd1200a7de0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7fd118009fa0 tx=0x7fd118009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:38.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd1117fa700 1 -- 172.21.15.1:0/4250012786 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11800ebc0 con 0x7fd1200c50b0 2023-11-15T02:55:38.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd1117fa700 1 -- 172.21.15.1:0/4250012786 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11800ed20 con 0x7fd1200c50b0 2023-11-15T02:55:38.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd1263d9700 1 -- 172.21.15.1:0/4250012786 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd120168b90 con 0x7fd1200c50b0 2023-11-15T02:55:38.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.989+0000 7fd1117fa700 1 -- 172.21.15.1:0/4250012786 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118014610 con 0x7fd1200c50b0 2023-11-15T02:55:38.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.990+0000 7fd1263d9700 1 -- 172.21.15.1:0/4250012786 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12014f600 con 0x7fd1200c50b0 2023-11-15T02:55:38.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.991+0000 7fd1117fa700 1 -- 172.21.15.1:0/4250012786 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fd11801d3b0 con 0x7fd1200c50b0 2023-11-15T02:55:38.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.991+0000 7fd1263d9700 1 -- 172.21.15.1:0/4250012786 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1200be9b0 con 0x7fd1200c50b0 2023-11-15T02:55:38.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.991+0000 7fd1117fa700 1 --2- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd10405f300 0x7fd1040617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:38.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.991+0000 7fd1253d7700 1 -- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd10405f300 msgr2=0x7fd1040617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:38.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.991+0000 7fd1117fa700 1 -- 172.21.15.1:0/4250012786 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7fd11807ac20 con 0x7fd1200c50b0 2023-11-15T02:55:38.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.991+0000 7fd1253d7700 1 --2- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd10405f300 0x7fd1040617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:38.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:37.995+0000 7fd1117fa700 1 -- 172.21.15.1:0/4250012786 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd11804b960 con 0x7fd1200c50b0 2023-11-15T02:55:38.026 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:38.025+0000 7f7ae0a78680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:55:38.098 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:38.097+0000 7f7ae0a78680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:55:38.121 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:38.119+0000 7f37a9667680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-15T02:55:38.190 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:38.188+0000 7f37a9667680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-15T02:55:38.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.192+0000 7fd1253d7700 1 -- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd10405f300 msgr2=0x7fd1040617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:38.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.192+0000 7fd1253d7700 1 --2- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd10405f300 0x7fd1040617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:55:38.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.216+0000 7fd1263d9700 1 -- 172.21.15.1:0/4250012786 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd1200475e0 con 0x7fd1200c50b0 2023-11-15T02:55:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.217+0000 7fd1117fa700 1 -- 172.21.15.1:0/4250012786 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v213) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd11804ef80 con 0x7fd1200c50b0 2023-11-15T02:55:38.219 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-11-15T02:55:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.218+0000 7fd1263d9700 1 -- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd10405f300 msgr2=0x7fd1040617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.218+0000 7fd1263d9700 1 --2- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd10405f300 0x7fd1040617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.218+0000 7fd1263d9700 1 -- 172.21.15.1:0/4250012786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1200c50b0 msgr2=0x7fd1200a7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:38.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.218+0000 7fd1263d9700 1 --2- 172.21.15.1:0/4250012786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1200c50b0 0x7fd1200a7de0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7fd118009fa0 tx=0x7fd118009900).stop 2023-11-15T02:55:38.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.219+0000 7fd1263d9700 1 -- 172.21.15.1:0/4250012786 shutdown_connections 2023-11-15T02:55:38.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.219+0000 7fd1263d9700 1 --2- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fd10405f300 0x7fd1040617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:38.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.219+0000 7fd1263d9700 1 --2- 172.21.15.1:0/4250012786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd1200c50b0 0x7fd1200a7de0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.219+0000 7fd1263d9700 1 --2- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1200bc410 0x7fd12014f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.219+0000 7fd1263d9700 1 --2- 172.21.15.1:0/4250012786 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1200c1990 0x7fd120167cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.219+0000 7fd1263d9700 1 -- 172.21.15.1:0/4250012786 >> 172.21.15.1:0/4250012786 conn(0x7fd1200c3e30 msgr2=0x7fd120065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:38.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.219+0000 7fd1263d9700 1 -- 172.21.15.1:0/4250012786 shutdown_connections 2023-11-15T02:55:38.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.219+0000 7fd1263d9700 1 -- 172.21.15.1:0/4250012786 wait complete. 2023-11-15T02:55:38.234 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-15T02:55:38.284 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:38.283+0000 7f7ae0a78680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:55:38.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.356+0000 7fbc9b90b700 1 Processor -- start 2023-11-15T02:55:38.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.356+0000 7fbc9b90b700 1 -- start start 2023-11-15T02:55:38.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.357+0000 7fbc9b90b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbc940c4210 0x7fbc94069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:38.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.357+0000 7fbc9b90b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc94155320 con 0x7fbc940c3e30 2023-11-15T02:55:38.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.357+0000 7fbc9b90b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc94155600 con 0x7fbc94154bf0 2023-11-15T02:55:38.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.357+0000 7fbc9b90b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc94155bc0 con 0x7fbc940c4210 2023-11-15T02:55:38.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.357+0000 7fbc996a7700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fbc940c3e30 0x7fbc94066cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48692/0 (socket says 172.21.15.1:48692) 2023-11-15T02:55:38.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.357+0000 7fbc996a7700 1 -- 172.21.15.1:0/31557251 learned_addr learned my addr 172.21.15.1:0/31557251 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:38.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.358+0000 7fbc98ea6700 1 --2- 172.21.15.1:0/31557251 >> v2:172.21.15.141:3300/0 conn(0x7fbc940c4210 0x7fbc94069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:38.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.358+0000 7fbc8bfff700 1 -- 172.21.15.1:0/31557251 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912453146 0 0) 0x7fbc94155320 con 0x7fbc940c3e30 2023-11-15T02:55:38.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.358+0000 7fbc8bfff700 1 -- 172.21.15.1:0/31557251 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc800033f0 con 0x7fbc940c3e30 2023-11-15T02:55:38.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.358+0000 7fbc8bfff700 1 -- 172.21.15.1:0/31557251 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544733816 0 0) 0x7fbc94155600 con 0x7fbc94154bf0 2023-11-15T02:55:38.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.358+0000 7fbc8bfff700 1 -- 172.21.15.1:0/31557251 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc94155320 con 0x7fbc94154bf0 2023-11-15T02:55:38.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.358+0000 7fbc98ea6700 1 -- 172.21.15.1:0/31557251 >> v1:172.21.15.141:6789/0 conn(0x7fbc94154bf0 legacy=0x7fbc9413a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:38.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.358+0000 7fbc8bfff700 1 -- 172.21.15.1:0/31557251 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1857330811 0 0) 0x7fbc800033f0 con 0x7fbc940c3e30 2023-11-15T02:55:38.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.358+0000 7fbc98ea6700 1 -- 172.21.15.1:0/31557251 >> v1:172.21.15.1:6789/0 conn(0x7fbc940c3e30 legacy=0x7fbc94066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:38.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.358+0000 7fbc98ea6700 1 -- 172.21.15.1:0/31557251 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc941558e0 con 0x7fbc940c4210 2023-11-15T02:55:38.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.358+0000 7fbc98ea6700 1 --2- 172.21.15.1:0/31557251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc940c4210 0x7fbc94069ba0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fbc90009760 tx=0x7fbc90009060).ready entity=mon.1 client_cookie=98859fc57764a795 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:38.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.358+0000 7fbc8bfff700 1 -- 172.21.15.1:0/31557251 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84001470 con 0x7fbc940c4210 2023-11-15T02:55:38.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.358+0000 7fbc8bfff700 1 -- 172.21.15.1:0/31557251 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc90011400 con 0x7fbc940c4210 2023-11-15T02:55:38.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.358+0000 7fbc8bfff700 1 -- 172.21.15.1:0/31557251 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90011780 con 0x7fbc940c4210 2023-11-15T02:55:38.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.359+0000 7fbc9b90b700 1 -- 172.21.15.1:0/31557251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc940c4210 msgr2=0x7fbc94069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:38.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.359+0000 7fbc9b90b700 1 --2- 172.21.15.1:0/31557251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc940c4210 0x7fbc94069ba0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fbc90009760 tx=0x7fbc90009060).stop 2023-11-15T02:55:38.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.359+0000 7fbc9b90b700 1 -- 172.21.15.1:0/31557251 shutdown_connections 2023-11-15T02:55:38.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.359+0000 7fbc9b90b700 1 --2- 172.21.15.1:0/31557251 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc940c4210 0x7fbc94069ba0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.359+0000 7fbc9b90b700 1 -- 172.21.15.1:0/31557251 >> 172.21.15.1:0/31557251 conn(0x7fbc940c7dc0 msgr2=0x7fbc940c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:38.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.359+0000 7fbc9b90b700 1 -- 172.21.15.1:0/31557251 shutdown_connections 2023-11-15T02:55:38.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.359+0000 7fbc9b90b700 1 -- 172.21.15.1:0/31557251 wait complete. 2023-11-15T02:55:38.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.360+0000 7fbc9b90b700 1 Processor -- start 2023-11-15T02:55:38.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.360+0000 7fbc9b90b700 1 -- start start 2023-11-15T02:55:38.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.361+0000 7fbc9b90b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc940c3e30 0x7fbc940c0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:38.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.361+0000 7fbc9b90b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc940c4210 0x7fbc940c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:38.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.361+0000 7fbc9b90b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc94154bf0 0x7fbc940627b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:38.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.361+0000 7fbc9b90b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9406a090 con 0x7fbc94154bf0 2023-11-15T02:55:38.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.361+0000 7fbc9b90b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc940c1990 con 0x7fbc940c4210 2023-11-15T02:55:38.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.361+0000 7fbc9b90b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc940a5520 con 0x7fbc940c3e30 2023-11-15T02:55:38.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.361+0000 7fbc99ea8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc94154bf0 0x7fbc940627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:38.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.361+0000 7fbc99ea8700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc94154bf0 0x7fbc940627b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52776/0 (socket says 172.21.15.1:52776) 2023-11-15T02:55:38.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.361+0000 7fbc99ea8700 1 -- 172.21.15.1:0/640452408 learned_addr learned my addr 172.21.15.1:0/640452408 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:38.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.361+0000 7fbc98ea6700 1 --2- 172.21.15.1:0/640452408 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc940c4210 0x7fbc940c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:38.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.361+0000 7fbc996a7700 1 --2- 172.21.15.1:0/640452408 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc940c3e30 0x7fbc940c0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:38.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.362+0000 7fbc99ea8700 1 -- 172.21.15.1:0/640452408 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc940c3e30 msgr2=0x7fbc940c0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:38.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.362+0000 7fbc99ea8700 1 --2- 172.21.15.1:0/640452408 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc940c3e30 0x7fbc940c0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.362+0000 7fbc99ea8700 1 -- 172.21.15.1:0/640452408 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc940c4210 msgr2=0x7fbc940c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:38.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.362+0000 7fbc99ea8700 1 --2- 172.21.15.1:0/640452408 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc940c4210 0x7fbc940c14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.362+0000 7fbc99ea8700 1 -- 172.21.15.1:0/640452408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc900092a0 con 0x7fbc94154bf0 2023-11-15T02:55:38.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.362+0000 7fbc99ea8700 1 --2- 172.21.15.1:0/640452408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc94154bf0 0x7fbc940627b0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 rx=0x7fbc8c00c710 tx=0x7fbc8c00ca20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:38.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.362+0000 7fbc897fa700 1 -- 172.21.15.1:0/640452408 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c00e4a0 con 0x7fbc94154bf0 2023-11-15T02:55:38.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.362+0000 7fbc897fa700 1 -- 172.21.15.1:0/640452408 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8c00e600 con 0x7fbc94154bf0 2023-11-15T02:55:38.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.362+0000 7fbc9b90b700 1 -- 172.21.15.1:0/640452408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc940a4910 con 0x7fbc94154bf0 2023-11-15T02:55:38.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.362+0000 7fbc897fa700 1 -- 172.21.15.1:0/640452408 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c00e980 con 0x7fbc94154bf0 2023-11-15T02:55:38.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.362+0000 7fbc9b90b700 1 -- 172.21.15.1:0/640452408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc940a4ed0 con 0x7fbc94154bf0 2023-11-15T02:55:38.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.363+0000 7fbc9b90b700 1 -- 172.21.15.1:0/640452408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9406c7e0 con 0x7fbc94154bf0 2023-11-15T02:55:38.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.363+0000 7fbc897fa700 1 -- 172.21.15.1:0/640452408 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fbc8c012400 con 0x7fbc94154bf0 2023-11-15T02:55:38.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.364+0000 7fbc897fa700 1 --2- 172.21.15.1:0/640452408 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbc7805f300 0x7fbc780617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:38.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.364+0000 7fbc996a7700 1 -- 172.21.15.1:0/640452408 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbc7805f300 msgr2=0x7fbc780617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:38.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.364+0000 7fbc897fa700 1 -- 172.21.15.1:0/640452408 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7fbc8c079e80 con 0x7fbc94154bf0 2023-11-15T02:55:38.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.364+0000 7fbc996a7700 1 --2- 172.21.15.1:0/640452408 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbc7805f300 0x7fbc780617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:38.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.368+0000 7fbc897fa700 1 -- 172.21.15.1:0/640452408 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbc8c048af0 con 0x7fbc94154bf0 2023-11-15T02:55:38.390 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:38.388+0000 7f37a9667680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-15T02:55:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.542+0000 7fbc9b90b700 1 -- 172.21.15.1:0/640452408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbc940a5660 con 0x7fbc94154bf0 2023-11-15T02:55:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.543+0000 7fbc897fa700 1 -- 172.21.15.1:0/640452408 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v213) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbc8c04ac70 con 0x7fbc94154bf0 2023-11-15T02:55:38.545 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 8 2023-11-15T02:55:38.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.544+0000 7fbc9b90b700 1 -- 172.21.15.1:0/640452408 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbc7805f300 msgr2=0x7fbc780617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:38.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.544+0000 7fbc9b90b700 1 --2- 172.21.15.1:0/640452408 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbc7805f300 0x7fbc780617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:38.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.545+0000 7fbc9b90b700 1 -- 172.21.15.1:0/640452408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc94154bf0 msgr2=0x7fbc940627b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:38.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.545+0000 7fbc9b90b700 1 --2- 172.21.15.1:0/640452408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc94154bf0 0x7fbc940627b0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 rx=0x7fbc8c00c710 tx=0x7fbc8c00ca20).stop 2023-11-15T02:55:38.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.545+0000 7fbc9b90b700 1 -- 172.21.15.1:0/640452408 shutdown_connections 2023-11-15T02:55:38.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.545+0000 7fbc9b90b700 1 --2- 172.21.15.1:0/640452408 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbc7805f300 0x7fbc780617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:38.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.545+0000 7fbc9b90b700 1 --2- 172.21.15.1:0/640452408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc94154bf0 0x7fbc940627b0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.545+0000 7fbc9b90b700 1 --2- 172.21.15.1:0/640452408 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc940c3e30 0x7fbc940c0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.545+0000 7fbc9b90b700 1 --2- 172.21.15.1:0/640452408 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc940c4210 0x7fbc940c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.545+0000 7fbc9b90b700 1 -- 172.21.15.1:0/640452408 >> 172.21.15.1:0/640452408 conn(0x7fbc940c7dc0 msgr2=0x7fbc940c4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:38.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.545+0000 7fbc9b90b700 1 -- 172.21.15.1:0/640452408 shutdown_connections 2023-11-15T02:55:38.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.545+0000 7fbc9b90b700 1 -- 172.21.15.1:0/640452408 wait complete. 2023-11-15T02:55:38.559 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-15T02:55:38.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.682+0000 7f34d42ca700 1 Processor -- start 2023-11-15T02:55:38.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.682+0000 7f34d42ca700 1 -- start start 2023-11-15T02:55:38.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.683+0000 7f34d42ca700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f34cc13b990 0x7f34cc1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:38.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.683+0000 7f34d42ca700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34cc0c7760 con 0x7f34cc13bd70 2023-11-15T02:55:38.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.683+0000 7f34d42ca700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34cc067060 con 0x7f34cc0a8ab0 2023-11-15T02:55:38.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.683+0000 7f34d42ca700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34cc067340 con 0x7f34cc13b990 2023-11-15T02:55:38.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.683+0000 7f34d1865700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f34cc13bd70 0x7f34cc066870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48702/0 (socket says 172.21.15.1:48702) 2023-11-15T02:55:38.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.683+0000 7f34d1865700 1 -- 172.21.15.1:0/3803260166 learned_addr learned my addr 172.21.15.1:0/3803260166 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:38.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.683+0000 7f34d2066700 1 --2- 172.21.15.1:0/3803260166 >> v2:172.21.15.141:3300/0 conn(0x7f34cc13b990 0x7f34cc1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:38.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.684+0000 7f34d1064700 1 -- 172.21.15.1:0/3803260166 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439871284 0 0) 0x7f34cc0c7760 con 0x7f34cc13bd70 2023-11-15T02:55:38.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.684+0000 7f34d1064700 1 -- 172.21.15.1:0/3803260166 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34b80033f0 con 0x7f34cc13bd70 2023-11-15T02:55:38.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.684+0000 7f34d2066700 1 -- 172.21.15.1:0/3803260166 >> v1:172.21.15.141:6789/0 conn(0x7f34cc0a8ab0 legacy=0x7f34cc0c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:38.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.684+0000 7f34d1064700 1 -- 172.21.15.1:0/3803260166 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946372855 0 0) 0x7f34cc067060 con 0x7f34cc0a8ab0 2023-11-15T02:55:38.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.684+0000 7f34d2066700 1 -- 172.21.15.1:0/3803260166 >> v1:172.21.15.1:6789/0 conn(0x7f34cc13bd70 legacy=0x7f34cc066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:38.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.684+0000 7f34d2066700 1 -- 172.21.15.1:0/3803260166 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc0c7110 con 0x7f34cc13b990 2023-11-15T02:55:38.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.684+0000 7f34d2066700 1 --2- 172.21.15.1:0/3803260166 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34cc13b990 0x7f34cc1568c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f34bc009760 tx=0x7f34bc009060).ready entity=mon.1 client_cookie=802105baef7c6661 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:38.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.684+0000 7f34d1064700 1 -- 172.21.15.1:0/3803260166 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc00f510 con 0x7f34cc13b990 2023-11-15T02:55:38.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.684+0000 7f34d1064700 1 -- 172.21.15.1:0/3803260166 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34bc00f670 con 0x7f34cc13b990 2023-11-15T02:55:38.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.684+0000 7f34d1064700 1 -- 172.21.15.1:0/3803260166 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc00f9f0 con 0x7f34cc13b990 2023-11-15T02:55:38.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.685+0000 7f34d42ca700 1 -- 172.21.15.1:0/3803260166 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34cc13b990 msgr2=0x7f34cc1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:38.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.685+0000 7f34d42ca700 1 --2- 172.21.15.1:0/3803260166 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34cc13b990 0x7f34cc1568c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f34bc009760 tx=0x7f34bc009060).stop 2023-11-15T02:55:38.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.685+0000 7f34d42ca700 1 -- 172.21.15.1:0/3803260166 shutdown_connections 2023-11-15T02:55:38.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.685+0000 7f34d42ca700 1 --2- 172.21.15.1:0/3803260166 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34cc13b990 0x7f34cc1568c0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.685+0000 7f34d42ca700 1 -- 172.21.15.1:0/3803260166 >> 172.21.15.1:0/3803260166 conn(0x7f34cc063280 msgr2=0x7f34cc0c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:38.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.685+0000 7f34d42ca700 1 -- 172.21.15.1:0/3803260166 shutdown_connections 2023-11-15T02:55:38.692 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.685+0000 7f34d42ca700 1 -- 172.21.15.1:0/3803260166 wait complete. 2023-11-15T02:55:38.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.686+0000 7f34d42ca700 1 Processor -- start 2023-11-15T02:55:38.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.686+0000 7f34d42ca700 1 -- start start 2023-11-15T02:55:38.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d42ca700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34cc0a8ab0 0x7f34cc139210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:38.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d42ca700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34cc13b990 0x7f34cc0638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:38.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d42ca700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34cc1686e0 0x7f34cc0abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:38.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d42ca700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc0652b0 con 0x7f34cc1686e0 2023-11-15T02:55:38.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d42ca700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc064e20 con 0x7f34cc13b990 2023-11-15T02:55:38.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d42ca700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc064210 con 0x7f34cc0a8ab0 2023-11-15T02:55:38.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d2867700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34cc1686e0 0x7f34cc0abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:38.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d2867700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34cc1686e0 0x7f34cc0abeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52782/0 (socket says 172.21.15.1:52782) 2023-11-15T02:55:38.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d2867700 1 -- 172.21.15.1:0/3983903417 learned_addr learned my addr 172.21.15.1:0/3983903417 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:38.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d1865700 1 --2- 172.21.15.1:0/3983903417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34cc13b990 0x7f34cc0638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:38.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d2066700 1 --2- 172.21.15.1:0/3983903417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34cc0a8ab0 0x7f34cc139210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:38.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d1865700 1 -- 172.21.15.1:0/3983903417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34cc0a8ab0 msgr2=0x7f34cc139210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:38.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d1865700 1 --2- 172.21.15.1:0/3983903417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34cc0a8ab0 0x7f34cc139210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d1865700 1 -- 172.21.15.1:0/3983903417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34cc1686e0 msgr2=0x7f34cc0abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:38.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d1865700 1 --2- 172.21.15.1:0/3983903417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34cc1686e0 0x7f34cc0abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d1865700 1 -- 172.21.15.1:0/3983903417 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc0092a0 con 0x7f34cc13b990 2023-11-15T02:55:38.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.687+0000 7f34d2867700 1 --2- 172.21.15.1:0/3983903417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34cc1686e0 0x7f34cc0abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:38.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.688+0000 7f34d1865700 1 --2- 172.21.15.1:0/3983903417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34cc13b990 0x7f34cc0638c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f34c800c410 tx=0x7f34c8007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:38.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.688+0000 7f34c27fc700 1 -- 172.21.15.1:0/3983903417 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c80070d0 con 0x7f34cc13b990 2023-11-15T02:55:38.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.688+0000 7f34c27fc700 1 -- 172.21.15.1:0/3983903417 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c8007250 con 0x7f34cc13b990 2023-11-15T02:55:38.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.688+0000 7f34d42ca700 1 -- 172.21.15.1:0/3983903417 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34cc0644f0 con 0x7f34cc13b990 2023-11-15T02:55:38.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.688+0000 7f34c27fc700 1 -- 172.21.15.1:0/3983903417 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8007610 con 0x7f34cc13b990 2023-11-15T02:55:38.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.688+0000 7f34d42ca700 1 -- 172.21.15.1:0/3983903417 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34cc064ab0 con 0x7f34cc13b990 2023-11-15T02:55:38.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.689+0000 7f34d42ca700 1 -- 172.21.15.1:0/3983903417 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34cc064f90 con 0x7f34cc13b990 2023-11-15T02:55:38.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.689+0000 7f34c27fc700 1 -- 172.21.15.1:0/3983903417 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f34c80059b0 con 0x7f34cc13b990 2023-11-15T02:55:38.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.689+0000 7f34c27fc700 1 --2- 172.21.15.1:0/3983903417 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f34b005f300 0x7f34b00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:38.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.689+0000 7f34d2066700 1 -- 172.21.15.1:0/3983903417 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f34b005f300 msgr2=0x7f34b00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:38.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.689+0000 7f34c27fc700 1 -- 172.21.15.1:0/3983903417 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7f34c8079b90 con 0x7f34cc13b990 2023-11-15T02:55:38.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.690+0000 7f34d2066700 1 --2- 172.21.15.1:0/3983903417 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f34b005f300 0x7f34b00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:38.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.694+0000 7f34c27fc700 1 -- 172.21.15.1:0/3983903417 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f34c804a930 con 0x7f34cc13b990 2023-11-15T02:55:38.707 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:38.706+0000 7f7ae0a78680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:55:38.812 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:38.811+0000 7f7ae0a78680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:55:38.836 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:38.834+0000 7f37a9667680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-15T02:55:38.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.868+0000 7f34d42ca700 1 -- 172.21.15.1:0/3983903417 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34cc06c7e0 con 0x7f34cc13b990 2023-11-15T02:55:38.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.869+0000 7f34c27fc700 1 -- 172.21.15.1:0/3983903417 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v213) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34c8018020 con 0x7f34cc13b990 2023-11-15T02:55:38.871 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T02:55:38.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.871+0000 7f34d42ca700 1 -- 172.21.15.1:0/3983903417 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f34b005f300 msgr2=0x7f34b00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:38.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.871+0000 7f34d42ca700 1 --2- 172.21.15.1:0/3983903417 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f34b005f300 0x7f34b00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:38.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.871+0000 7f34d42ca700 1 -- 172.21.15.1:0/3983903417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34cc13b990 msgr2=0x7f34cc0638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:38.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.871+0000 7f34d42ca700 1 --2- 172.21.15.1:0/3983903417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34cc13b990 0x7f34cc0638c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f34c800c410 tx=0x7f34c8007b90).stop 2023-11-15T02:55:38.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.871+0000 7f34d42ca700 1 -- 172.21.15.1:0/3983903417 shutdown_connections 2023-11-15T02:55:38.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.871+0000 7f34d42ca700 1 --2- 172.21.15.1:0/3983903417 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f34b005f300 0x7f34b00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:38.874 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.871+0000 7f34d42ca700 1 --2- 172.21.15.1:0/3983903417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34cc1686e0 0x7f34cc0abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.871+0000 7f34d42ca700 1 --2- 172.21.15.1:0/3983903417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34cc0a8ab0 0x7f34cc139210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.871+0000 7f34d42ca700 1 --2- 172.21.15.1:0/3983903417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34cc13b990 0x7f34cc0638c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:38.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.871+0000 7f34d42ca700 1 -- 172.21.15.1:0/3983903417 >> 172.21.15.1:0/3983903417 conn(0x7f34cc063280 msgr2=0x7f34cc0bf660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:38.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.871+0000 7f34d42ca700 1 -- 172.21.15.1:0/3983903417 shutdown_connections 2023-11-15T02:55:38.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:38.871+0000 7f34d42ca700 1 -- 172.21.15.1:0/3983903417 wait complete. 2023-11-15T02:55:38.885 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-15T02:55:38.951 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:38.949+0000 7f37a9667680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:55:38.967 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:38.966+0000 7f7ae0a78680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:55:39.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.008+0000 7f9c6fd87700 1 Processor -- start 2023-11-15T02:55:39.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.008+0000 7f9c6fd87700 1 -- start start 2023-11-15T02:55:39.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6fd87700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c681540a0 0x7f9c680ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6fd87700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9c68154480 0x7f9c680ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6fd87700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9c680c5f40 0x7f9c680c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6fd87700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c680c68e0 con 0x7f9c680c5f40 2023-11-15T02:55:39.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6fd87700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c680ca050 con 0x7f9c68154480 2023-11-15T02:55:39.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6fd87700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680c9440 con 0x7f9c681540a0 2023-11-15T02:55:39.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6e324700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9c680c5f40 0x7f9c680c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:39.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6e324700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9c680c5f40 0x7f9c680c63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52798/0 (socket says 172.21.15.1:52798) 2023-11-15T02:55:39.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6e324700 1 -- 172.21.15.1:0/3433313053 learned_addr learned my addr 172.21.15.1:0/3433313053 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:39.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6d322700 1 --2- 172.21.15.1:0/3433313053 >> v2:172.21.15.141:3300/0 conn(0x7f9c68154480 0x7f9c680ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:39.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6db23700 1 --2- 172.21.15.1:0/3433313053 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c681540a0 0x7f9c680ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:39.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6e324700 1 -- 172.21.15.1:0/3433313053 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c681540a0 msgr2=0x7f9c680ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:39.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6e324700 1 --2- 172.21.15.1:0/3433313053 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c681540a0 0x7f9c680ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6e324700 1 -- 172.21.15.1:0/3433313053 >> v2:172.21.15.141:3300/0 conn(0x7f9c68154480 msgr2=0x7f9c680ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:39.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6e324700 1 --2- 172.21.15.1:0/3433313053 >> v2:172.21.15.141:3300/0 conn(0x7f9c68154480 0x7f9c680ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6e324700 1 -- 172.21.15.1:0/3433313053 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c680c9720 con 0x7f9c680c5f40 2023-11-15T02:55:39.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.009+0000 7f9c6e324700 1 --2- 172.21.15.1:0/3433313053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c680c5f40 0x7f9c680c63f0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7f9c68084410 tx=0x7f9c60009840).ready entity=mon.0 client_cookie=7de04c4629e3806 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:39.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.010+0000 7f9c6cb21700 1 -- 172.21.15.1:0/3433313053 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6000e070 con 0x7f9c680c5f40 2023-11-15T02:55:39.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.010+0000 7f9c6cb21700 1 -- 172.21.15.1:0/3433313053 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6000b970 con 0x7f9c680c5f40 2023-11-15T02:55:39.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.010+0000 7f9c6cb21700 1 -- 172.21.15.1:0/3433313053 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6000bcf0 con 0x7f9c680c5f40 2023-11-15T02:55:39.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.010+0000 7f9c6fd87700 1 -- 172.21.15.1:0/3433313053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c680c5f40 msgr2=0x7f9c680c63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.010+0000 7f9c6fd87700 1 --2- 172.21.15.1:0/3433313053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c680c5f40 0x7f9c680c63f0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7f9c68084410 tx=0x7f9c60009840).stop 2023-11-15T02:55:39.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.010+0000 7f9c6fd87700 1 -- 172.21.15.1:0/3433313053 shutdown_connections 2023-11-15T02:55:39.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.010+0000 7f9c6fd87700 1 --2- 172.21.15.1:0/3433313053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c680c5f40 0x7f9c680c63f0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.010+0000 7f9c6fd87700 1 --2- 172.21.15.1:0/3433313053 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c681540a0 0x7f9c680ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.010+0000 7f9c6fd87700 1 --2- 172.21.15.1:0/3433313053 >> v2:172.21.15.141:3300/0 conn(0x7f9c68154480 0x7f9c680ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.010+0000 7f9c6fd87700 1 -- 172.21.15.1:0/3433313053 >> 172.21.15.1:0/3433313053 conn(0x7f9c68064a70 msgr2=0x7f9c68064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:39.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.010+0000 7f9c6fd87700 1 -- 172.21.15.1:0/3433313053 shutdown_connections 2023-11-15T02:55:39.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.010+0000 7f9c6fd87700 1 -- 172.21.15.1:0/3433313053 wait complete. 2023-11-15T02:55:39.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.011+0000 7f9c6fd87700 1 Processor -- start 2023-11-15T02:55:39.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.011+0000 7f9c6fd87700 1 -- start start 2023-11-15T02:55:39.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.012+0000 7f9c6fd87700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c680c5f40 0x7f9c68151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.012+0000 7f9c6fd87700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c681540a0 0x7f9c680af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.012+0000 7f9c6fd87700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c68154480 0x7f9c680c3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.012+0000 7f9c6fd87700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680c3160 con 0x7f9c680c5f40 2023-11-15T02:55:39.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.012+0000 7f9c6fd87700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680aecf0 con 0x7f9c681540a0 2023-11-15T02:55:39.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.012+0000 7f9c6fd87700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680c2e80 con 0x7f9c68154480 2023-11-15T02:55:39.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.012+0000 7f9c6db23700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c680c5f40 0x7f9c68151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:39.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.012+0000 7f9c6db23700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c680c5f40 0x7f9c68151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52806/0 (socket says 172.21.15.1:52806) 2023-11-15T02:55:39.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.012+0000 7f9c6db23700 1 -- 172.21.15.1:0/1210398263 learned_addr learned my addr 172.21.15.1:0/1210398263 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:39.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.012+0000 7f9c6d322700 1 --2- 172.21.15.1:0/1210398263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c681540a0 0x7f9c680af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:39.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.012+0000 7f9c6e324700 1 --2- 172.21.15.1:0/1210398263 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c68154480 0x7f9c680c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:39.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.013+0000 7f9c6db23700 1 -- 172.21.15.1:0/1210398263 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c68154480 msgr2=0x7f9c680c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.013+0000 7f9c6db23700 1 --2- 172.21.15.1:0/1210398263 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c68154480 0x7f9c680c3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.013+0000 7f9c6db23700 1 -- 172.21.15.1:0/1210398263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c681540a0 msgr2=0x7f9c680af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.013+0000 7f9c6db23700 1 --2- 172.21.15.1:0/1210398263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c681540a0 0x7f9c680af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.013+0000 7f9c6db23700 1 -- 172.21.15.1:0/1210398263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c60009ae0 con 0x7f9c680c5f40 2023-11-15T02:55:39.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.013+0000 7f9c6db23700 1 --2- 172.21.15.1:0/1210398263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c680c5f40 0x7f9c68151b00 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7f9c6400e900 tx=0x7f9c64009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:39.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.013+0000 7f9c5dffb700 1 -- 172.21.15.1:0/1210398263 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c640093b0 con 0x7f9c680c5f40 2023-11-15T02:55:39.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.013+0000 7f9c5dffb700 1 -- 172.21.15.1:0/1210398263 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c64012600 con 0x7f9c680c5f40 2023-11-15T02:55:39.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.013+0000 7f9c5dffb700 1 -- 172.21.15.1:0/1210398263 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c64012980 con 0x7f9c680c5f40 2023-11-15T02:55:39.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.013+0000 7f9c6fd87700 1 -- 172.21.15.1:0/1210398263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c680ae6a0 con 0x7f9c680c5f40 2023-11-15T02:55:39.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.013+0000 7f9c6fd87700 1 -- 172.21.15.1:0/1210398263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c68151ff0 con 0x7f9c680c5f40 2023-11-15T02:55:39.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.014+0000 7f9c6fd87700 1 -- 172.21.15.1:0/1210398263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6806c7e0 con 0x7f9c680c5f40 2023-11-15T02:55:39.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.014+0000 7f9c5dffb700 1 -- 172.21.15.1:0/1210398263 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f9c64012d30 con 0x7f9c680c5f40 2023-11-15T02:55:39.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.015+0000 7f9c5dffb700 1 --2- 172.21.15.1:0/1210398263 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f9c4c05f300 0x7f9c4c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.015+0000 7f9c5dffb700 1 -- 172.21.15.1:0/1210398263 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7f9c6407a9c0 con 0x7f9c680c5f40 2023-11-15T02:55:39.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.015+0000 7f9c6d322700 1 -- 172.21.15.1:0/1210398263 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f9c4c05f300 msgr2=0x7f9c4c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:39.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.015+0000 7f9c6d322700 1 --2- 172.21.15.1:0/1210398263 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f9c4c05f300 0x7f9c4c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:39.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.019+0000 7f9c5dffb700 1 -- 172.21.15.1:0/1210398263 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9c6404b760 con 0x7f9c680c5f40 2023-11-15T02:55:39.042 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:39.041+0000 7f7ae0a78680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:55:39.109 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:39.108+0000 7f7ae0a78680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:55:39.113 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:39.111+0000 7f37a9667680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-15T02:55:39.192 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:39.190+0000 7f37a9667680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-15T02:55:39.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.195+0000 7f9c6fd87700 1 -- 172.21.15.1:0/1210398263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c680c9a00 con 0x7f9c680c5f40 2023-11-15T02:55:39.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.196+0000 7f9c5dffb700 1 -- 172.21.15.1:0/1210398263 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v213) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c6404ed80 con 0x7f9c680c5f40 2023-11-15T02:55:39.199 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-11-15T02:55:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.197+0000 7f9c6fd87700 1 -- 172.21.15.1:0/1210398263 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f9c4c05f300 msgr2=0x7f9c4c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.197+0000 7f9c6fd87700 1 --2- 172.21.15.1:0/1210398263 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f9c4c05f300 0x7f9c4c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.197+0000 7f9c6fd87700 1 -- 172.21.15.1:0/1210398263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c680c5f40 msgr2=0x7f9c68151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.197+0000 7f9c6fd87700 1 --2- 172.21.15.1:0/1210398263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c680c5f40 0x7f9c68151b00 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7f9c6400e900 tx=0x7f9c64009060).stop 2023-11-15T02:55:39.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.198+0000 7f9c6fd87700 1 -- 172.21.15.1:0/1210398263 shutdown_connections 2023-11-15T02:55:39.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.198+0000 7f9c6fd87700 1 --2- 172.21.15.1:0/1210398263 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f9c4c05f300 0x7f9c4c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:39.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.198+0000 7f9c6fd87700 1 --2- 172.21.15.1:0/1210398263 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c68154480 0x7f9c680c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.198+0000 7f9c6fd87700 1 --2- 172.21.15.1:0/1210398263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c680c5f40 0x7f9c68151b00 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.198+0000 7f9c6fd87700 1 --2- 172.21.15.1:0/1210398263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c681540a0 0x7f9c680af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.198+0000 7f9c6fd87700 1 -- 172.21.15.1:0/1210398263 >> 172.21.15.1:0/1210398263 conn(0x7f9c68064a70 msgr2=0x7f9c68064e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:39.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.198+0000 7f9c6fd87700 1 -- 172.21.15.1:0/1210398263 shutdown_connections 2023-11-15T02:55:39.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.198+0000 7f9c6fd87700 1 -- 172.21.15.1:0/1210398263 wait complete. 2023-11-15T02:55:39.212 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:55:39.267 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:39.265+0000 7f37a9667680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-15T02:55:39.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.332+0000 7f4612d6f700 1 Processor -- start 2023-11-15T02:55:39.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.332+0000 7f4612d6f700 1 -- start start 2023-11-15T02:55:39.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.333+0000 7f4612d6f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f460c154150 0x7f460c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.333+0000 7f4612d6f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460c0c06f0 con 0x7f460c0ab1a0 2023-11-15T02:55:39.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.333+0000 7f4612d6f700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460c0c09d0 con 0x7f460c0aa060 2023-11-15T02:55:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.333+0000 7f4612d6f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460c158820 con 0x7f460c154150 2023-11-15T02:55:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.333+0000 7f460bfff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f460c0ab1a0 0x7f460c158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48712/0 (socket says 172.21.15.1:48712) 2023-11-15T02:55:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.333+0000 7f460bfff700 1 -- 172.21.15.1:0/1813755614 learned_addr learned my addr 172.21.15.1:0/1813755614 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.333+0000 7f4610b0b700 1 --2- 172.21.15.1:0/1813755614 >> v2:172.21.15.141:3300/0 conn(0x7f460c154150 0x7f460c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:39.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.333+0000 7f460b7fe700 1 -- 172.21.15.1:0/1813755614 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765654398 0 0) 0x7f460c0c06f0 con 0x7f460c0ab1a0 2023-11-15T02:55:39.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.333+0000 7f460b7fe700 1 -- 172.21.15.1:0/1813755614 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45fc0033f0 con 0x7f460c0ab1a0 2023-11-15T02:55:39.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.333+0000 7f4610b0b700 1 -- 172.21.15.1:0/1813755614 >> v1:172.21.15.141:6789/0 conn(0x7f460c0aa060 legacy=0x7f460c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.333+0000 7f460b7fe700 1 -- 172.21.15.1:0/1813755614 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503076826 0 0) 0x7f460c0c09d0 con 0x7f460c0aa060 2023-11-15T02:55:39.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.333+0000 7f4610b0b700 1 -- 172.21.15.1:0/1813755614 >> v1:172.21.15.1:6789/0 conn(0x7f460c0ab1a0 legacy=0x7f460c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.333+0000 7f4610b0b700 1 -- 172.21.15.1:0/1813755614 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c158b00 con 0x7f460c154150 2023-11-15T02:55:39.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.334+0000 7f4610b0b700 1 --2- 172.21.15.1:0/1813755614 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f460c154150 0x7f460c154530 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f4600009760 tx=0x7f4600009060).ready entity=mon.1 client_cookie=1691c3e09d5ed932 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:39.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.334+0000 7f460b7fe700 1 -- 172.21.15.1:0/1813755614 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46000090d0 con 0x7f460c154150 2023-11-15T02:55:39.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.334+0000 7f460b7fe700 1 -- 172.21.15.1:0/1813755614 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460000f510 con 0x7f460c154150 2023-11-15T02:55:39.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.334+0000 7f460b7fe700 1 -- 172.21.15.1:0/1813755614 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460000f890 con 0x7f460c154150 2023-11-15T02:55:39.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.334+0000 7f4612d6f700 1 -- 172.21.15.1:0/1813755614 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f460c154150 msgr2=0x7f460c154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.334+0000 7f4612d6f700 1 --2- 172.21.15.1:0/1813755614 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f460c154150 0x7f460c154530 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f4600009760 tx=0x7f4600009060).stop 2023-11-15T02:55:39.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.334+0000 7f4612d6f700 1 -- 172.21.15.1:0/1813755614 shutdown_connections 2023-11-15T02:55:39.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.334+0000 7f4612d6f700 1 --2- 172.21.15.1:0/1813755614 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f460c154150 0x7f460c154530 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.334+0000 7f4612d6f700 1 -- 172.21.15.1:0/1813755614 >> 172.21.15.1:0/1813755614 conn(0x7f460c064aa0 msgr2=0x7f460c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:39.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.334+0000 7f4612d6f700 1 -- 172.21.15.1:0/1813755614 shutdown_connections 2023-11-15T02:55:39.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.335+0000 7f4612d6f700 1 -- 172.21.15.1:0/1813755614 wait complete. 2023-11-15T02:55:39.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.336+0000 7f4612d6f700 1 Processor -- start 2023-11-15T02:55:39.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.336+0000 7f4612d6f700 1 -- start start 2023-11-15T02:55:39.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f4612d6f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f460c0aa060 0x7f460c0c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f4612d6f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f460c0ab1a0 0x7f460c0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f4612d6f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f460c154150 0x7f460c14d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f4612d6f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c164430 con 0x7f460c0ab1a0 2023-11-15T02:55:39.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f4612d6f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0c4940 con 0x7f460c0aa060 2023-11-15T02:55:39.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f4612d6f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460c155f60 con 0x7f460c154150 2023-11-15T02:55:39.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f460bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f460c0ab1a0 0x7f460c0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:39.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f460bfff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f460c0ab1a0 0x7f460c0c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52816/0 (socket says 172.21.15.1:52816) 2023-11-15T02:55:39.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f460bfff700 1 -- 172.21.15.1:0/3266421014 learned_addr learned my addr 172.21.15.1:0/3266421014 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:39.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f4610b0b700 1 --2- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f460c0aa060 0x7f460c0c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:39.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f461130c700 1 --2- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f460c154150 0x7f460c14d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:39.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f460bfff700 1 -- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f460c154150 msgr2=0x7f460c14d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f460bfff700 1 --2- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f460c154150 0x7f460c14d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f460bfff700 1 -- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f460c0aa060 msgr2=0x7f460c0c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f460bfff700 1 --2- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f460c0aa060 0x7f460c0c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f460bfff700 1 -- 172.21.15.1:0/3266421014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46000092a0 con 0x7f460c0ab1a0 2023-11-15T02:55:39.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f461130c700 1 --2- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f460c154150 0x7f460c14d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:39.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f460bfff700 1 --2- 172.21.15.1:0/3266421014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f460c0ab1a0 0x7f460c0c3920 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7f45f800c490 tx=0x7f45f8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:39.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f4608ff9700 1 -- 172.21.15.1:0/3266421014 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f80072e0 con 0x7f460c0ab1a0 2023-11-15T02:55:39.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f4608ff9700 1 -- 172.21.15.1:0/3266421014 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f8007440 con 0x7f460c0ab1a0 2023-11-15T02:55:39.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f4612d6f700 1 -- 172.21.15.1:0/3266421014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460c156240 con 0x7f460c0ab1a0 2023-11-15T02:55:39.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f4608ff9700 1 -- 172.21.15.1:0/3266421014 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f80057a0 con 0x7f460c0ab1a0 2023-11-15T02:55:39.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.337+0000 7f4612d6f700 1 -- 172.21.15.1:0/3266421014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460c0afbb0 con 0x7f460c0ab1a0 2023-11-15T02:55:39.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.339+0000 7f4608ff9700 1 -- 172.21.15.1:0/3266421014 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f45f8005b50 con 0x7f460c0ab1a0 2023-11-15T02:55:39.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.339+0000 7f4612d6f700 1 -- 172.21.15.1:0/3266421014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460c06c7e0 con 0x7f460c0ab1a0 2023-11-15T02:55:39.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.339+0000 7f4608ff9700 1 --2- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f45f005f300 0x7f45f00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.339+0000 7f4608ff9700 1 -- 172.21.15.1:0/3266421014 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7f45f8079cb0 con 0x7f460c0ab1a0 2023-11-15T02:55:39.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.339+0000 7f4610b0b700 1 -- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f45f005f300 msgr2=0x7f45f00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:39.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.339+0000 7f4610b0b700 1 --2- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f45f005f300 0x7f45f00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:39.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.343+0000 7f4608ff9700 1 -- 172.21.15.1:0/3266421014 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f45f804aa50 con 0x7f460c0ab1a0 2023-11-15T02:55:39.369 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:39.367+0000 7f7ae0a78680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:55:39.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.540+0000 7f4610b0b700 1 -- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f45f005f300 msgr2=0x7f45f00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:39.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.540+0000 7f4610b0b700 1 --2- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f45f005f300 0x7f45f00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:55:39.546 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:39.544+0000 7f37a9667680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-15T02:55:39.552 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:39.551+0000 7f7ae0a78680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:55:39.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.559+0000 7f4612d6f700 1 -- 172.21.15.1:0/3266421014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f460c0afbb0 con 0x7f460c0ab1a0 2023-11-15T02:55:39.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.560+0000 7f4608ff9700 1 -- 172.21.15.1:0/3266421014 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f460c0afbb0 con 0x7f460c0ab1a0 2023-11-15T02:55:39.562 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:39.562 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":95,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10101,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2281092627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2281092627},{"type":"v1","addr":"172.21.15.1:6833","nonce":2281092627}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":10104,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3718177238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3718177238},{"type":"v1","addr":"172.21.15.1:6835","nonce":3718177238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":10113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3331826313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3331826313},{"type":"v1","addr":"172.21.15.141:6836","nonce":3331826313}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:55:21.588380+0000","modified":"2023-11-15T02:55:24.600875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10116":{"gid":10116,"name":"d","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/1145495775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1145495775},{"type":"v1","addr":"172.21.15.141:6837","nonce":1145495775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-11-15T02:55:39.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.561+0000 7f4612d6f700 1 -- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f45f005f300 msgr2=0x7f45f00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:39.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.561+0000 7f4612d6f700 1 --2- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f45f005f300 0x7f45f00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:39.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.562+0000 7f4612d6f700 1 -- 172.21.15.1:0/3266421014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f460c0ab1a0 msgr2=0x7f460c0c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.562+0000 7f4612d6f700 1 --2- 172.21.15.1:0/3266421014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f460c0ab1a0 0x7f460c0c3920 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7f45f800c490 tx=0x7f45f8007c70).stop 2023-11-15T02:55:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.562+0000 7f4612d6f700 1 -- 172.21.15.1:0/3266421014 shutdown_connections 2023-11-15T02:55:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.562+0000 7f4612d6f700 1 --2- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f45f005f300 0x7f45f00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.562+0000 7f4612d6f700 1 --2- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f460c154150 0x7f460c14d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.562+0000 7f4612d6f700 1 --2- 172.21.15.1:0/3266421014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f460c0aa060 0x7f460c0c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.562+0000 7f4612d6f700 1 --2- 172.21.15.1:0/3266421014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f460c0ab1a0 0x7f460c0c3920 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.562+0000 7f4612d6f700 1 -- 172.21.15.1:0/3266421014 >> 172.21.15.1:0/3266421014 conn(0x7f460c064aa0 msgr2=0x7f460c063d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.562+0000 7f4612d6f700 1 -- 172.21.15.1:0/3266421014 shutdown_connections 2023-11-15T02:55:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.562+0000 7f4612d6f700 1 -- 172.21.15.1:0/3266421014 wait complete. 2023-11-15T02:55:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 95 2023-11-15T02:55:39.581 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:55:39.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.704+0000 7ff9d9ab6700 1 Processor -- start 2023-11-15T02:55:39.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.704+0000 7ff9d9ab6700 1 -- start start 2023-11-15T02:55:39.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.705+0000 7ff9d9ab6700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff9d40c6620 0x7ff9d4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.708 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.705+0000 7ff9d9ab6700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d40c06f0 con 0x7ff9d40ab1a0 2023-11-15T02:55:39.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.705+0000 7ff9d9ab6700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d40c09d0 con 0x7ff9d4154150 2023-11-15T02:55:39.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.705+0000 7ff9d9ab6700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d4158820 con 0x7ff9d40c6620 2023-11-15T02:55:39.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.705+0000 7ff9caffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff9d40ab1a0 0x7ff9d40c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48718/0 (socket says 172.21.15.1:48718) 2023-11-15T02:55:39.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.705+0000 7ff9caffd700 1 -- 172.21.15.1:0/542945331 learned_addr learned my addr 172.21.15.1:0/542945331 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:39.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.705+0000 7ff9d3fff700 1 --2- 172.21.15.1:0/542945331 >> v2:172.21.15.141:3300/0 conn(0x7ff9d40c6620 0x7ff9d4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:39.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.706+0000 7ff9d2ffd700 1 -- 172.21.15.1:0/542945331 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534493755 0 0) 0x7ff9d40c06f0 con 0x7ff9d40ab1a0 2023-11-15T02:55:39.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.706+0000 7ff9d2ffd700 1 -- 172.21.15.1:0/542945331 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9c00033f0 con 0x7ff9d40ab1a0 2023-11-15T02:55:39.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.706+0000 7ff9d2ffd700 1 -- 172.21.15.1:0/542945331 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226322069 0 0) 0x7ff9d40c09d0 con 0x7ff9d4154150 2023-11-15T02:55:39.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.706+0000 7ff9d2ffd700 1 -- 172.21.15.1:0/542945331 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9d40c06f0 con 0x7ff9d4154150 2023-11-15T02:55:39.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.706+0000 7ff9d3fff700 1 -- 172.21.15.1:0/542945331 >> v1:172.21.15.141:6789/0 conn(0x7ff9d4154150 legacy=0x7ff9d4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.706+0000 7ff9d3fff700 1 -- 172.21.15.1:0/542945331 >> v1:172.21.15.1:6789/0 conn(0x7ff9d40ab1a0 legacy=0x7ff9d40c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.706+0000 7ff9d3fff700 1 -- 172.21.15.1:0/542945331 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d4158b00 con 0x7ff9d40c6620 2023-11-15T02:55:39.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.706+0000 7ff9d3fff700 1 --2- 172.21.15.1:0/542945331 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9d40c6620 0x7ff9d4154530 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7ff9cc009e60 tx=0x7ff9cc009780).ready entity=mon.1 client_cookie=220ab9b6d422b878 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:39.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.706+0000 7ff9d2ffd700 1 -- 172.21.15.1:0/542945331 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc00e070 con 0x7ff9d40c6620 2023-11-15T02:55:39.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.706+0000 7ff9d2ffd700 1 -- 172.21.15.1:0/542945331 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9cc00bab0 con 0x7ff9d40c6620 2023-11-15T02:55:39.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.706+0000 7ff9d2ffd700 1 -- 172.21.15.1:0/542945331 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc00be30 con 0x7ff9d40c6620 2023-11-15T02:55:39.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.707+0000 7ff9d9ab6700 1 -- 172.21.15.1:0/542945331 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9d40c6620 msgr2=0x7ff9d4154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.707+0000 7ff9d9ab6700 1 --2- 172.21.15.1:0/542945331 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9d40c6620 0x7ff9d4154530 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7ff9cc009e60 tx=0x7ff9cc009780).stop 2023-11-15T02:55:39.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.707+0000 7ff9d9ab6700 1 -- 172.21.15.1:0/542945331 shutdown_connections 2023-11-15T02:55:39.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.707+0000 7ff9d9ab6700 1 --2- 172.21.15.1:0/542945331 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9d40c6620 0x7ff9d4154530 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.707+0000 7ff9d9ab6700 1 -- 172.21.15.1:0/542945331 >> 172.21.15.1:0/542945331 conn(0x7ff9d4064aa0 msgr2=0x7ff9d4064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:39.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.707+0000 7ff9d9ab6700 1 -- 172.21.15.1:0/542945331 shutdown_connections 2023-11-15T02:55:39.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.707+0000 7ff9d9ab6700 1 -- 172.21.15.1:0/542945331 wait complete. 2023-11-15T02:55:39.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.708+0000 7ff9d9ab6700 1 Processor -- start 2023-11-15T02:55:39.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.708+0000 7ff9d9ab6700 1 -- start start 2023-11-15T02:55:39.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.709+0000 7ff9d9ab6700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9d40ab1a0 0x7ff9d40b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.709+0000 7ff9d9ab6700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9d40c6620 0x7ff9d4147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.709+0000 7ff9d9ab6700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff9d4154150 0x7ff9d4154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.709+0000 7ff9d9ab6700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d40ac0c0 con 0x7ff9d40c6620 2023-11-15T02:55:39.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.709+0000 7ff9d9ab6700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d40abab0 con 0x7ff9d40ab1a0 2023-11-15T02:55:39.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.709+0000 7ff9d9ab6700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d4155b20 con 0x7ff9d4154150 2023-11-15T02:55:39.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.709+0000 7ff9caffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9d40c6620 0x7ff9d4147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:39.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.709+0000 7ff9caffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9d40c6620 0x7ff9d4147af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52818/0 (socket says 172.21.15.1:52818) 2023-11-15T02:55:39.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.709+0000 7ff9caffd700 1 -- 172.21.15.1:0/4266013542 learned_addr learned my addr 172.21.15.1:0/4266013542 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:39.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.709+0000 7ff9d37fe700 1 --2- 172.21.15.1:0/4266013542 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9d40ab1a0 0x7ff9d40b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:39.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.709+0000 7ff9d3fff700 1 --2- 172.21.15.1:0/4266013542 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff9d4154150 0x7ff9d4154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:39.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.710+0000 7ff9caffd700 1 -- 172.21.15.1:0/4266013542 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff9d4154150 msgr2=0x7ff9d4154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.710+0000 7ff9caffd700 1 --2- 172.21.15.1:0/4266013542 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff9d4154150 0x7ff9d4154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.710+0000 7ff9caffd700 1 -- 172.21.15.1:0/4266013542 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9d40ab1a0 msgr2=0x7ff9d40b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.710+0000 7ff9caffd700 1 --2- 172.21.15.1:0/4266013542 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9d40ab1a0 0x7ff9d40b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.710+0000 7ff9caffd700 1 -- 172.21.15.1:0/4266013542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc009a20 con 0x7ff9d40c6620 2023-11-15T02:55:39.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.710+0000 7ff9caffd700 1 --2- 172.21.15.1:0/4266013542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9d40c6620 0x7ff9d4147af0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7ff9bc00c560 tx=0x7ff9bc007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:39.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.710+0000 7ff9cbfff700 1 -- 172.21.15.1:0/4266013542 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc00ce70 con 0x7ff9d40c6620 2023-11-15T02:55:39.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.710+0000 7ff9cbfff700 1 -- 172.21.15.1:0/4266013542 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc0072e0 con 0x7ff9d40c6620 2023-11-15T02:55:39.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.710+0000 7ff9d9ab6700 1 -- 172.21.15.1:0/4266013542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d40abd50 con 0x7ff9d40c6620 2023-11-15T02:55:39.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.710+0000 7ff9cbfff700 1 -- 172.21.15.1:0/4266013542 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc0057a0 con 0x7ff9d40c6620 2023-11-15T02:55:39.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.710+0000 7ff9d9ab6700 1 -- 172.21.15.1:0/4266013542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d40b0980 con 0x7ff9d40c6620 2023-11-15T02:55:39.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.711+0000 7ff9d9ab6700 1 -- 172.21.15.1:0/4266013542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d406c7e0 con 0x7ff9d40c6620 2023-11-15T02:55:39.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.713+0000 7ff9cbfff700 1 -- 172.21.15.1:0/4266013542 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7ff9bc005b90 con 0x7ff9d40c6620 2023-11-15T02:55:39.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.713+0000 7ff9cbfff700 1 --2- 172.21.15.1:0/4266013542 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff9b405f300 0x7ff9b40617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:39.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.713+0000 7ff9cbfff700 1 -- 172.21.15.1:0/4266013542 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7ff9bc079f20 con 0x7ff9d40c6620 2023-11-15T02:55:39.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.713+0000 7ff9d37fe700 1 -- 172.21.15.1:0/4266013542 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff9b405f300 msgr2=0x7ff9b40617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:39.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.713+0000 7ff9d37fe700 1 --2- 172.21.15.1:0/4266013542 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff9b405f300 0x7ff9b40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:39.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.717+0000 7ff9cbfff700 1 -- 172.21.15.1:0/4266013542 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff9bc048af0 con 0x7ff9d40c6620 2023-11-15T02:55:39.748 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:39.746+0000 7f37a9667680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-15T02:55:39.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.891+0000 7ff9d9ab6700 1 -- 172.21.15.1:0/4266013542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9d4158de0 con 0x7ff9d40c6620 2023-11-15T02:55:39.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.892+0000 7ff9cbfff700 1 -- 172.21.15.1:0/4266013542 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v213) v1 ==== 74+0+18121 (secure 0 0 0) 0x7ff9bc04e770 con 0x7ff9d40c6620 2023-11-15T02:55:39.895 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:39.895 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":213,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:55:33.841451+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:55:19.243909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-11-15T02:55:20.580363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/1187088985":"2023-11-16T02:55:33.841413+0000","172.21.15.141:6833/103755":"2023-11-16T02:55:33.841413+0000","172.21.15.141:6832/103755":"2023-11-16T02:55:33.841413+0000","172.21.15.141:0/2020531998":"2023-11-16T02:55:33.841413+0000","172.21.15.141:0/2287874460":"2023-11-16T02:55:33.841413+0000","172.21.15.141:0/2718331164":"2023-11-16T02:55:33.841413+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:55:39.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.894+0000 7ff9d9ab6700 1 -- 172.21.15.1:0/4266013542 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff9b405f300 msgr2=0x7ff9b40617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:39.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.894+0000 7ff9d9ab6700 1 --2- 172.21.15.1:0/4266013542 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff9b405f300 0x7ff9b40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:39.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.894+0000 7ff9d9ab6700 1 -- 172.21.15.1:0/4266013542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9d40c6620 msgr2=0x7ff9d4147af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:39.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.894+0000 7ff9d9ab6700 1 --2- 172.21.15.1:0/4266013542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9d40c6620 0x7ff9d4147af0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7ff9bc00c560 tx=0x7ff9bc007d00).stop 2023-11-15T02:55:39.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.894+0000 7ff9d9ab6700 1 -- 172.21.15.1:0/4266013542 shutdown_connections 2023-11-15T02:55:39.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.894+0000 7ff9d9ab6700 1 --2- 172.21.15.1:0/4266013542 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff9b405f300 0x7ff9b40617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:39.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.894+0000 7ff9d9ab6700 1 --2- 172.21.15.1:0/4266013542 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff9d4154150 0x7ff9d4154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.894+0000 7ff9d9ab6700 1 --2- 172.21.15.1:0/4266013542 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9d40ab1a0 0x7ff9d40b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.894+0000 7ff9d9ab6700 1 --2- 172.21.15.1:0/4266013542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9d40c6620 0x7ff9d4147af0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:39.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.894+0000 7ff9d9ab6700 1 -- 172.21.15.1:0/4266013542 >> 172.21.15.1:0/4266013542 conn(0x7ff9d4064aa0 msgr2=0x7ff9d40c0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:39.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.894+0000 7ff9d9ab6700 1 -- 172.21.15.1:0/4266013542 shutdown_connections 2023-11-15T02:55:39.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:39.895+0000 7ff9d9ab6700 1 -- 172.21.15.1:0/4266013542 wait complete. 2023-11-15T02:55:39.910 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-15T02:55:39.911 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:55:40.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.029+0000 7fa9ed47a700 1 Processor -- start 2023-11-15T02:55:40.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.029+0000 7fa9ed47a700 1 -- start start 2023-11-15T02:55:40.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.030+0000 7fa9ed47a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa9e81579f0 0x7fa9e80657e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.030+0000 7fa9ed47a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa9e8157dd0 0x7fa9e80627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.030+0000 7fa9ed47a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e8066a80 con 0x7fa9e80a6fd0 2023-11-15T02:55:40.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.030+0000 7fa9ed47a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e80a5880 con 0x7fa9e8157dd0 2023-11-15T02:55:40.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.030+0000 7fa9ed47a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e8066f10 con 0x7fa9e81579f0 2023-11-15T02:55:40.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.030+0000 7fa9e77fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa9e8157dd0 0x7fa9e80627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:40.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.030+0000 7fa9ecc79700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa9e80a6fd0 0x7fa9e8069460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48732/0 (socket says 172.21.15.1:48732) 2023-11-15T02:55:40.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.030+0000 7fa9ecc79700 1 -- 172.21.15.1:0/2797713402 learned_addr learned my addr 172.21.15.1:0/2797713402 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:40.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.030+0000 7fa9e7fff700 1 --2- 172.21.15.1:0/2797713402 >> v2:172.21.15.141:3300/0 conn(0x7fa9e81579f0 0x7fa9e80657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:40.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.030+0000 7fa9e77fe700 1 -- 172.21.15.1:0/2797713402 >> v2:172.21.15.141:3300/0 conn(0x7fa9e81579f0 msgr2=0x7fa9e80657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:40.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.030+0000 7fa9e77fe700 1 --2- 172.21.15.1:0/2797713402 >> v2:172.21.15.141:3300/0 conn(0x7fa9e81579f0 0x7fa9e80657e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.030+0000 7fa9e77fe700 1 -- 172.21.15.1:0/2797713402 >> v1:172.21.15.1:6789/0 conn(0x7fa9e80a6fd0 legacy=0x7fa9e8069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:40.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.030+0000 7fa9e6ffd700 1 -- 172.21.15.1:0/2797713402 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75429591 0 0) 0x7fa9e8066a80 con 0x7fa9e80a6fd0 2023-11-15T02:55:40.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.030+0000 7fa9e77fe700 1 -- 172.21.15.1:0/2797713402 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e8065e70 con 0x7fa9e8157dd0 2023-11-15T02:55:40.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.031+0000 7fa9e77fe700 1 --2- 172.21.15.1:0/2797713402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9e8157dd0 0x7fa9e80627b0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 rx=0x7fa9e80bebb0 tx=0x7fa9d8009060).ready entity=mon.0 client_cookie=cc19e5493fd403f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:40.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.031+0000 7fa9e6ffd700 1 -- 172.21.15.1:0/2797713402 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800f510 con 0x7fa9e8157dd0 2023-11-15T02:55:40.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.031+0000 7fa9e6ffd700 1 -- 172.21.15.1:0/2797713402 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d800f670 con 0x7fa9e8157dd0 2023-11-15T02:55:40.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.031+0000 7fa9e6ffd700 1 -- 172.21.15.1:0/2797713402 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800f9f0 con 0x7fa9e8157dd0 2023-11-15T02:55:40.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.031+0000 7fa9ed47a700 1 -- 172.21.15.1:0/2797713402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9e8157dd0 msgr2=0x7fa9e80627b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:40.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.031+0000 7fa9ed47a700 1 --2- 172.21.15.1:0/2797713402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9e8157dd0 0x7fa9e80627b0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 rx=0x7fa9e80bebb0 tx=0x7fa9d8009060).stop 2023-11-15T02:55:40.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.031+0000 7fa9ed47a700 1 -- 172.21.15.1:0/2797713402 shutdown_connections 2023-11-15T02:55:40.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.031+0000 7fa9ed47a700 1 --2- 172.21.15.1:0/2797713402 >> v2:172.21.15.141:3300/0 conn(0x7fa9e81579f0 0x7fa9e80657e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.031+0000 7fa9ed47a700 1 --2- 172.21.15.1:0/2797713402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9e8157dd0 0x7fa9e80627b0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.031+0000 7fa9ed47a700 1 -- 172.21.15.1:0/2797713402 >> 172.21.15.1:0/2797713402 conn(0x7fa9e80c7c10 msgr2=0x7fa9e80c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:40.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.031+0000 7fa9ed47a700 1 -- 172.21.15.1:0/2797713402 shutdown_connections 2023-11-15T02:55:40.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.031+0000 7fa9ed47a700 1 -- 172.21.15.1:0/2797713402 wait complete. 2023-11-15T02:55:40.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.033+0000 7fa9ed47a700 1 Processor -- start 2023-11-15T02:55:40.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.033+0000 7fa9ed47a700 1 -- start start 2023-11-15T02:55:40.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.033+0000 7fa9ed47a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9e80a6fd0 0x7fa9e80ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.033+0000 7fa9ed47a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9e81579f0 0x7fa9e814cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.033+0000 7fa9ed47a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9e8157dd0 0x7fa9e8159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.033+0000 7fa9ed47a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e815a560 con 0x7fa9e80a6fd0 2023-11-15T02:55:40.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.033+0000 7fa9ed47a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e814d220 con 0x7fa9e81579f0 2023-11-15T02:55:40.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.033+0000 7fa9ed47a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e8159950 con 0x7fa9e8157dd0 2023-11-15T02:55:40.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9e7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9e80a6fd0 0x7fa9e80ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:40.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9e7fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9e80a6fd0 0x7fa9e80ad760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52828/0 (socket says 172.21.15.1:52828) 2023-11-15T02:55:40.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9e7fff700 1 -- 172.21.15.1:0/2134471153 learned_addr learned my addr 172.21.15.1:0/2134471153 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:40.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9e77fe700 1 --2- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9e81579f0 0x7fa9e814cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:40.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9ecc79700 1 --2- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9e8157dd0 0x7fa9e8159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:40.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9e7fff700 1 -- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9e8157dd0 msgr2=0x7fa9e8159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:40.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9e7fff700 1 --2- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9e8157dd0 0x7fa9e8159100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9e7fff700 1 -- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9e81579f0 msgr2=0x7fa9e814cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:40.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9e7fff700 1 --2- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9e81579f0 0x7fa9e814cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9e7fff700 1 -- 172.21.15.1:0/2134471153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d80092a0 con 0x7fa9e80a6fd0 2023-11-15T02:55:40.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9e7fff700 1 --2- 172.21.15.1:0/2134471153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9e80a6fd0 0x7fa9e80ad760 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7fa9dc00e960 tx=0x7fa9dc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:40.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9cffff700 1 -- 172.21.15.1:0/2134471153 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc009510 con 0x7fa9e80a6fd0 2023-11-15T02:55:40.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9ed47a700 1 -- 172.21.15.1:0/2134471153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e8159c30 con 0x7fa9e80a6fd0 2023-11-15T02:55:40.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9cffff700 1 -- 172.21.15.1:0/2134471153 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc012600 con 0x7fa9e80a6fd0 2023-11-15T02:55:40.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9cffff700 1 -- 172.21.15.1:0/2134471153 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc012980 con 0x7fa9e80a6fd0 2023-11-15T02:55:40.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.034+0000 7fa9ed47a700 1 -- 172.21.15.1:0/2134471153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e815a1f0 con 0x7fa9e80a6fd0 2023-11-15T02:55:40.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.035+0000 7fa9ed47a700 1 -- 172.21.15.1:0/2134471153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e80475e0 con 0x7fa9e80a6fd0 2023-11-15T02:55:40.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.036+0000 7fa9cffff700 1 -- 172.21.15.1:0/2134471153 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fa9dc012d30 con 0x7fa9e80a6fd0 2023-11-15T02:55:40.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.036+0000 7fa9cffff700 1 --2- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa9d405f2d0 0x7fa9d4061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.036+0000 7fa9cffff700 1 -- 172.21.15.1:0/2134471153 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7fa9dc07abc0 con 0x7fa9e80a6fd0 2023-11-15T02:55:40.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.036+0000 7fa9e77fe700 1 -- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa9d405f2d0 msgr2=0x7fa9d4061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:40.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.036+0000 7fa9e77fe700 1 --2- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa9d405f2d0 0x7fa9d4061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:40.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.044+0000 7fa9cffff700 1 -- 172.21.15.1:0/2134471153 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa9dc04b960 con 0x7fa9e80a6fd0 2023-11-15T02:55:40.209 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:40.208+0000 7f7ae0a78680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:55:40.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.237+0000 7fa9e77fe700 1 -- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa9d405f2d0 msgr2=0x7fa9d4061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:40.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.237+0000 7fa9e77fe700 1 --2- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa9d405f2d0 0x7fa9d4061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:55:40.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.260+0000 7fa9ed47a700 1 -- 172.21.15.1:0/2134471153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9e8067430 con 0x7fa9e80a6fd0 2023-11-15T02:55:40.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.261+0000 7fa9cffff700 1 -- 172.21.15.1:0/2134471153 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4499 (secure 0 0 0) 0x7fa9dc04ef80 con 0x7fa9e80a6fd0 2023-11-15T02:55:40.263 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:40.263 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":95,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10101,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2281092627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2281092627},{"type":"v1","addr":"172.21.15.1:6833","nonce":2281092627}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":10104,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3718177238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3718177238},{"type":"v1","addr":"172.21.15.1:6835","nonce":3718177238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":10113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3331826313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3331826313},{"type":"v1","addr":"172.21.15.141:6836","nonce":3331826313}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:55:21.588380+0000","modified":"2023-11-15T02:55:24.600875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10116":{"gid":10116,"name":"d","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/1145495775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1145495775},{"type":"v1","addr":"172.21.15.141:6837","nonce":1145495775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-11-15T02:55:40.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.263+0000 7fa9ed47a700 1 -- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa9d405f2d0 msgr2=0x7fa9d4061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:40.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.263+0000 7fa9ed47a700 1 --2- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa9d405f2d0 0x7fa9d4061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:40.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.263+0000 7fa9ed47a700 1 -- 172.21.15.1:0/2134471153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9e80a6fd0 msgr2=0x7fa9e80ad760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:40.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.263+0000 7fa9ed47a700 1 --2- 172.21.15.1:0/2134471153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9e80a6fd0 0x7fa9e80ad760 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7fa9dc00e960 tx=0x7fa9dc009060).stop 2023-11-15T02:55:40.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.263+0000 7fa9ed47a700 1 -- 172.21.15.1:0/2134471153 shutdown_connections 2023-11-15T02:55:40.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.263+0000 7fa9ed47a700 1 --2- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa9d405f2d0 0x7fa9d4061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:40.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.263+0000 7fa9ed47a700 1 --2- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9e8157dd0 0x7fa9e8159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.263+0000 7fa9ed47a700 1 --2- 172.21.15.1:0/2134471153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9e80a6fd0 0x7fa9e80ad760 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.263+0000 7fa9ed47a700 1 --2- 172.21.15.1:0/2134471153 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9e81579f0 0x7fa9e814cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.263+0000 7fa9ed47a700 1 -- 172.21.15.1:0/2134471153 >> 172.21.15.1:0/2134471153 conn(0x7fa9e80c7c10 msgr2=0x7fa9e80c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:40.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.263+0000 7fa9ed47a700 1 -- 172.21.15.1:0/2134471153 shutdown_connections 2023-11-15T02:55:40.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.263+0000 7fa9ed47a700 1 -- 172.21.15.1:0/2134471153 wait complete. 2023-11-15T02:55:40.268 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 95 2023-11-15T02:55:40.278 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:55:40.279 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:40.277+0000 7f7ae0a78680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:55:40.354 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:40.353+0000 7f7ae0a78680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:55:40.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.400+0000 7f02f6162700 1 Processor -- start 2023-11-15T02:55:40.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.400+0000 7f02f6162700 1 -- start start 2023-11-15T02:55:40.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.401+0000 7f02f6162700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f02f0154180 0x7f02f0158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.401+0000 7f02f6162700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f00aa640 0x7f02f00c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.401+0000 7f02f6162700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f0064e80 con 0x7f02f0154560 2023-11-15T02:55:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.401+0000 7f02f6162700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f01585e0 con 0x7f02f0154180 2023-11-15T02:55:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.401+0000 7f02f6162700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f01588c0 con 0x7f02f00aa640 2023-11-15T02:55:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.401+0000 7f02eeffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f02f0154560 0x7f02f0063bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48748/0 (socket says 172.21.15.1:48748) 2023-11-15T02:55:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.401+0000 7f02eeffd700 1 -- 172.21.15.1:0/1807360405 learned_addr learned my addr 172.21.15.1:0/1807360405 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.401+0000 7f02effff700 1 --2- 172.21.15.1:0/1807360405 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f00aa640 0x7f02f00c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.401+0000 7f02ef7fe700 1 --2- 172.21.15.1:0/1807360405 >> v2:172.21.15.141:3300/0 conn(0x7f02f0154180 0x7f02f0158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.401+0000 7f02ee7fc700 1 -- 172.21.15.1:0/1807360405 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335787623 0 0) 0x7f02f0064e80 con 0x7f02f0154560 2023-11-15T02:55:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.402+0000 7f02ee7fc700 1 -- 172.21.15.1:0/1807360405 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02dc0033f0 con 0x7f02f0154560 2023-11-15T02:55:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.402+0000 7f02effff700 1 -- 172.21.15.1:0/1807360405 >> v2:172.21.15.141:3300/0 conn(0x7f02f0154180 msgr2=0x7f02f0158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.402+0000 7f02effff700 1 --2- 172.21.15.1:0/1807360405 >> v2:172.21.15.141:3300/0 conn(0x7f02f0154180 0x7f02f0158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.402+0000 7f02effff700 1 -- 172.21.15.1:0/1807360405 >> v1:172.21.15.1:6789/0 conn(0x7f02f0154560 legacy=0x7f02f0063bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:40.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.402+0000 7f02effff700 1 -- 172.21.15.1:0/1807360405 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f0158ba0 con 0x7f02f00aa640 2023-11-15T02:55:40.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.402+0000 7f02ef7fe700 1 --2- 172.21.15.1:0/1807360405 >> v2:172.21.15.141:3300/0 conn(0x7f02f0154180 0x7f02f0158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:40.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.402+0000 7f02effff700 1 --2- 172.21.15.1:0/1807360405 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f00aa640 0x7f02f00c1b90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f02e8009e60 tx=0x7f02e8009780).ready entity=mon.2 client_cookie=e7c0e70ab400e87 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:40.408 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.402+0000 7f02ee7fc700 1 -- 172.21.15.1:0/1807360405 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800e070 con 0x7f02f00aa640 2023-11-15T02:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.402+0000 7f02ee7fc700 1 -- 172.21.15.1:0/1807360405 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e800bab0 con 0x7f02f00aa640 2023-11-15T02:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.402+0000 7f02ee7fc700 1 -- 172.21.15.1:0/1807360405 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800be30 con 0x7f02f00aa640 2023-11-15T02:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.403+0000 7f02f6162700 1 -- 172.21.15.1:0/1807360405 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f00aa640 msgr2=0x7f02f00c1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.403+0000 7f02f6162700 1 --2- 172.21.15.1:0/1807360405 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f00aa640 0x7f02f00c1b90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f02e8009e60 tx=0x7f02e8009780).stop 2023-11-15T02:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.403+0000 7f02f6162700 1 -- 172.21.15.1:0/1807360405 shutdown_connections 2023-11-15T02:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.403+0000 7f02f6162700 1 --2- 172.21.15.1:0/1807360405 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f00aa640 0x7f02f00c1b90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.403+0000 7f02f6162700 1 --2- 172.21.15.1:0/1807360405 >> v2:172.21.15.141:3300/0 conn(0x7f02f0154180 0x7f02f0158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.403+0000 7f02f6162700 1 -- 172.21.15.1:0/1807360405 >> 172.21.15.1:0/1807360405 conn(0x7f02f00c74f0 msgr2=0x7f02f00c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:40.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.403+0000 7f02f6162700 1 -- 172.21.15.1:0/1807360405 shutdown_connections 2023-11-15T02:55:40.410 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.403+0000 7f02f6162700 1 -- 172.21.15.1:0/1807360405 wait complete. 2023-11-15T02:55:40.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.404+0000 7f02f6162700 1 Processor -- start 2023-11-15T02:55:40.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.404+0000 7f02f6162700 1 -- start start 2023-11-15T02:55:40.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02f6162700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02f00aa640 0x7f02f0150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02f6162700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f0154180 0x7f02f00a7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02f6162700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f0154560 0x7f02f00a7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02f6162700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f0157730 con 0x7f02f0154560 2023-11-15T02:55:40.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02f6162700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f0151160 con 0x7f02f00aa640 2023-11-15T02:55:40.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02f6162700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00a7e50 con 0x7f02f0154180 2023-11-15T02:55:40.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02effff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f0154560 0x7f02f00a7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:40.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02effff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f0154560 0x7f02f00a7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52834/0 (socket says 172.21.15.1:52834) 2023-11-15T02:55:40.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02effff700 1 -- 172.21.15.1:0/3931854012 learned_addr learned my addr 172.21.15.1:0/3931854012 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:40.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02ef7fe700 1 --2- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02f00aa640 0x7f02f0150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02eeffd700 1 --2- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f0154180 0x7f02f00a7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02effff700 1 -- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f0154180 msgr2=0x7f02f00a7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02effff700 1 --2- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f0154180 0x7f02f00a7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02effff700 1 -- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02f00aa640 msgr2=0x7f02f0150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02effff700 1 --2- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02f00aa640 0x7f02f0150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02effff700 1 -- 172.21.15.1:0/3931854012 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d80092a0 con 0x7f02f0154560 2023-11-15T02:55:40.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02effff700 1 --2- 172.21.15.1:0/3931854012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f0154560 0x7f02f00a7960 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7f02e800b610 tx=0x7f02e8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:40.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.405+0000 7f02e77fe700 1 -- 172.21.15.1:0/3931854012 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8013e70 con 0x7f02f0154560 2023-11-15T02:55:40.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.406+0000 7f02e77fe700 1 -- 172.21.15.1:0/3931854012 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e801d630 con 0x7f02f0154560 2023-11-15T02:55:40.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.406+0000 7f02f6162700 1 -- 172.21.15.1:0/3931854012 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e8009a20 con 0x7f02f0154560 2023-11-15T02:55:40.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.406+0000 7f02e77fe700 1 -- 172.21.15.1:0/3931854012 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e801d9d0 con 0x7f02f0154560 2023-11-15T02:55:40.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.406+0000 7f02f6162700 1 -- 172.21.15.1:0/3931854012 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f00a50d0 con 0x7f02f0154560 2023-11-15T02:55:40.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.407+0000 7f02f6162700 1 -- 172.21.15.1:0/3931854012 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f006c7e0 con 0x7f02f0154560 2023-11-15T02:55:40.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.407+0000 7f02e77fe700 1 -- 172.21.15.1:0/3931854012 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f02e8003040 con 0x7f02f0154560 2023-11-15T02:55:40.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.407+0000 7f02e77fe700 1 --2- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f02d005f300 0x7f02d00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.407+0000 7f02ef7fe700 1 -- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f02d005f300 msgr2=0x7f02d00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:40.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.407+0000 7f02e77fe700 1 -- 172.21.15.1:0/3931854012 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7f02e807c560 con 0x7f02f0154560 2023-11-15T02:55:40.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.407+0000 7f02ef7fe700 1 --2- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f02d005f300 0x7f02d00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:40.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.415+0000 7f02e77fe700 1 -- 172.21.15.1:0/3931854012 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f02e804d1f0 con 0x7f02f0154560 2023-11-15T02:55:40.454 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:40.452+0000 7f37a9667680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-15T02:55:40.502 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:40.501+0000 7f7ae0a78680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:55:40.527 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:40.525+0000 7f37a9667680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-15T02:55:40.573 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:40.571+0000 7f7ae0a78680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:55:40.607 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:40.605+0000 7f37a9667680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-15T02:55:40.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.608+0000 7f02ef7fe700 1 -- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f02d005f300 msgr2=0x7f02d00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:40.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.608+0000 7f02ef7fe700 1 --2- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f02d005f300 0x7f02d00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-11-15T02:55:40.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.632+0000 7f02f6162700 1 -- 172.21.15.1:0/3931854012 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02f0158e80 con 0x7f02f0154560 2023-11-15T02:55:40.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.633+0000 7f02e77fe700 1 -- 172.21.15.1:0/3931854012 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f02e8050810 con 0x7f02f0154560 2023-11-15T02:55:40.635 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:40.635 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":95,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10101,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2281092627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2281092627},{"type":"v1","addr":"172.21.15.1:6833","nonce":2281092627}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":10104,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3718177238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3718177238},{"type":"v1","addr":"172.21.15.1:6835","nonce":3718177238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":10113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3331826313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3331826313},{"type":"v1","addr":"172.21.15.141:6836","nonce":3331826313}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-15T02:55:21.588380+0000","modified":"2023-11-15T02:55:24.600875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10116":{"gid":10116,"name":"d","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6837/1145495775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":1145495775},{"type":"v1","addr":"172.21.15.141:6837","nonce":1145495775}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-11-15T02:55:40.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.635+0000 7f02f6162700 1 -- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f02d005f300 msgr2=0x7f02d00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:40.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.635+0000 7f02f6162700 1 --2- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f02d005f300 0x7f02d00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:40.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.635+0000 7f02f6162700 1 -- 172.21.15.1:0/3931854012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f0154560 msgr2=0x7f02f00a7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:40.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.635+0000 7f02f6162700 1 --2- 172.21.15.1:0/3931854012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f0154560 0x7f02f00a7960 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7f02e800b610 tx=0x7f02e8009780).stop 2023-11-15T02:55:40.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.635+0000 7f02f6162700 1 -- 172.21.15.1:0/3931854012 shutdown_connections 2023-11-15T02:55:40.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.635+0000 7f02f6162700 1 --2- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f02d005f300 0x7f02d00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:40.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.635+0000 7f02f6162700 1 --2- 172.21.15.1:0/3931854012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f0154560 0x7f02f00a7960 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.635+0000 7f02f6162700 1 --2- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02f00aa640 0x7f02f0150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.635+0000 7f02f6162700 1 --2- 172.21.15.1:0/3931854012 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02f0154180 0x7f02f00a7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.635+0000 7f02f6162700 1 -- 172.21.15.1:0/3931854012 >> 172.21.15.1:0/3931854012 conn(0x7f02f00c74f0 msgr2=0x7f02f00c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:40.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.635+0000 7f02f6162700 1 -- 172.21.15.1:0/3931854012 shutdown_connections 2023-11-15T02:55:40.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.635+0000 7f02f6162700 1 -- 172.21.15.1:0/3931854012 wait complete. 2023-11-15T02:55:40.640 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 95 2023-11-15T02:55:40.649 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:55:40.688 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:40.687+0000 7f7ae0a78680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:55:40.770 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:40.768+0000 7f37a9667680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-15T02:55:40.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.770+0000 7f342dbc0700 1 Processor -- start 2023-11-15T02:55:40.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.770+0000 7f342dbc0700 1 -- start start 2023-11-15T02:55:40.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.771+0000 7f342dbc0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3428154450 0x7f34280a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.771+0000 7f342dbc0700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f34280be520 0x7f3428154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.771+0000 7f342dbc0700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34280a85e0 con 0x7f34280833a0 2023-11-15T02:55:40.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.771+0000 7f342dbc0700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3428065940 con 0x7f34280be520 2023-11-15T02:55:40.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.771+0000 7f342dbc0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3428065660 con 0x7f3428154450 2023-11-15T02:55:40.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.771+0000 7f3426ffd700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f34280833a0 0x7f34280bde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48750/0 (socket says 172.21.15.1:48750) 2023-11-15T02:55:40.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.771+0000 7f3426ffd700 1 -- 172.21.15.1:0/2216718439 learned_addr learned my addr 172.21.15.1:0/2216718439 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:40.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.771+0000 7f34277fe700 1 --2- 172.21.15.1:0/2216718439 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3428154450 0x7f34280a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:40.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.771+0000 7f3427fff700 1 --2- 172.21.15.1:0/2216718439 >> v2:172.21.15.141:3300/0 conn(0x7f34280be520 0x7f3428154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:40.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.771+0000 7f34267fc700 1 -- 172.21.15.1:0/2216718439 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980717973 0 0) 0x7f34280a85e0 con 0x7f34280833a0 2023-11-15T02:55:40.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.771+0000 7f34267fc700 1 -- 172.21.15.1:0/2216718439 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34140033f0 con 0x7f34280833a0 2023-11-15T02:55:40.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.771+0000 7f34277fe700 1 -- 172.21.15.1:0/2216718439 >> v2:172.21.15.141:3300/0 conn(0x7f34280be520 msgr2=0x7f3428154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:40.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.771+0000 7f34277fe700 1 --2- 172.21.15.1:0/2216718439 >> v2:172.21.15.141:3300/0 conn(0x7f34280be520 0x7f3428154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.771+0000 7f34277fe700 1 -- 172.21.15.1:0/2216718439 >> v1:172.21.15.1:6789/0 conn(0x7f34280833a0 legacy=0x7f34280bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:40.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.771+0000 7f34277fe700 1 -- 172.21.15.1:0/2216718439 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34280c6f50 con 0x7f3428154450 2023-11-15T02:55:40.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.772+0000 7f34277fe700 1 --2- 172.21.15.1:0/2216718439 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3428154450 0x7f34280a7ef0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f3410006fd0 tx=0x7f3410006f40).ready entity=mon.2 client_cookie=3d29ffbdac02e8f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:40.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.772+0000 7f34267fc700 1 -- 172.21.15.1:0/2216718439 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410005880 con 0x7f3428154450 2023-11-15T02:55:40.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.772+0000 7f34267fc700 1 -- 172.21.15.1:0/2216718439 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34100059e0 con 0x7f3428154450 2023-11-15T02:55:40.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.772+0000 7f34267fc700 1 -- 172.21.15.1:0/2216718439 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410005d60 con 0x7f3428154450 2023-11-15T02:55:40.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.772+0000 7f342dbc0700 1 -- 172.21.15.1:0/2216718439 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3428154450 msgr2=0x7f34280a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:40.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.772+0000 7f342dbc0700 1 --2- 172.21.15.1:0/2216718439 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3428154450 0x7f34280a7ef0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f3410006fd0 tx=0x7f3410006f40).stop 2023-11-15T02:55:40.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.772+0000 7f342dbc0700 1 -- 172.21.15.1:0/2216718439 shutdown_connections 2023-11-15T02:55:40.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.772+0000 7f342dbc0700 1 --2- 172.21.15.1:0/2216718439 >> v2:172.21.15.141:3300/0 conn(0x7f34280be520 0x7f3428154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.772+0000 7f342dbc0700 1 --2- 172.21.15.1:0/2216718439 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3428154450 0x7f34280a7ef0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.772+0000 7f342dbc0700 1 -- 172.21.15.1:0/2216718439 >> 172.21.15.1:0/2216718439 conn(0x7f3428082f90 msgr2=0x7f34280c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:40.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.772+0000 7f342dbc0700 1 -- 172.21.15.1:0/2216718439 shutdown_connections 2023-11-15T02:55:40.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.772+0000 7f342dbc0700 1 -- 172.21.15.1:0/2216718439 wait complete. 2023-11-15T02:55:40.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.774+0000 7f342dbc0700 1 Processor -- start 2023-11-15T02:55:40.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.774+0000 7f342dbc0700 1 -- start start 2023-11-15T02:55:40.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.774+0000 7f342dbc0700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34280833a0 0x7f34280c1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.774+0000 7f342dbc0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34280be520 0x7f34281589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.774+0000 7f342dbc0700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3428154450 0x7f3428145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.774+0000 7f342dbc0700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280ad5f0 con 0x7f34280be520 2023-11-15T02:55:40.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.774+0000 7f342dbc0700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280c1f10 con 0x7f3428154450 2023-11-15T02:55:40.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.774+0000 7f342dbc0700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34280c21f0 con 0x7f34280833a0 2023-11-15T02:55:40.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f3426ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34280be520 0x7f34281589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:40.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f3426ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34280be520 0x7f34281589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52838/0 (socket says 172.21.15.1:52838) 2023-11-15T02:55:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f34277fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34280833a0 0x7f34280c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f3426ffd700 1 -- 172.21.15.1:0/3780028401 learned_addr learned my addr 172.21.15.1:0/3780028401 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f3427fff700 1 --2- 172.21.15.1:0/3780028401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3428154450 0x7f3428145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f34277fe700 1 -- 172.21.15.1:0/3780028401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3428154450 msgr2=0x7f3428145d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f34277fe700 1 --2- 172.21.15.1:0/3780028401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3428154450 0x7f3428145d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f34277fe700 1 -- 172.21.15.1:0/3780028401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34280be520 msgr2=0x7f34281589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f34277fe700 1 --2- 172.21.15.1:0/3780028401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34280be520 0x7f34281589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f34277fe700 1 -- 172.21.15.1:0/3780028401 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3410009250 con 0x7f34280833a0 2023-11-15T02:55:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f3426ffd700 1 --2- 172.21.15.1:0/3780028401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34280be520 0x7f34281589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:40.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f34277fe700 1 --2- 172.21.15.1:0/3780028401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34280833a0 0x7f34280c1930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f3410012000 tx=0x7f3410015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:40.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f341f7fe700 1 -- 172.21.15.1:0/3780028401 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410009d50 con 0x7f34280833a0 2023-11-15T02:55:40.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f341f7fe700 1 -- 172.21.15.1:0/3780028401 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341000d6b0 con 0x7f34280833a0 2023-11-15T02:55:40.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f342dbc0700 1 -- 172.21.15.1:0/3780028401 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34280c24d0 con 0x7f34280833a0 2023-11-15T02:55:40.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f341f7fe700 1 -- 172.21.15.1:0/3780028401 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341000da30 con 0x7f34280833a0 2023-11-15T02:55:40.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.775+0000 7f342dbc0700 1 -- 172.21.15.1:0/3780028401 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34280c2a90 con 0x7f34280833a0 2023-11-15T02:55:40.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.776+0000 7f342dbc0700 1 -- 172.21.15.1:0/3780028401 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342806c7e0 con 0x7f34280833a0 2023-11-15T02:55:40.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.777+0000 7f341f7fe700 1 -- 172.21.15.1:0/3780028401 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f34100113f0 con 0x7f34280833a0 2023-11-15T02:55:40.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.777+0000 7f341f7fe700 1 --2- 172.21.15.1:0/3780028401 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f340805f300 0x7f34080617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:40.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.777+0000 7f341f7fe700 1 -- 172.21.15.1:0/3780028401 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7f341007bb60 con 0x7f34280833a0 2023-11-15T02:55:40.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.777+0000 7f3426ffd700 1 -- 172.21.15.1:0/3780028401 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f340805f300 msgr2=0x7f34080617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:40.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.777+0000 7f3426ffd700 1 --2- 172.21.15.1:0/3780028401 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f340805f300 0x7f34080617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:40.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.781+0000 7f341f7fe700 1 -- 172.21.15.1:0/3780028401 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f341004c8a0 con 0x7f34280833a0 2023-11-15T02:55:40.797 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:40.796+0000 7f7ae0a78680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:55:40.846 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:40.844+0000 7f37a9667680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-15T02:55:40.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.956+0000 7f342dbc0700 1 -- 172.21.15.1:0/3780028401 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34280a8960 con 0x7f34280833a0 2023-11-15T02:55:40.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.957+0000 7f341f7fe700 1 -- 172.21.15.1:0/3780028401 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v213) v1 ==== 74+0+18121 (secure 0 0 0) 0x7f3410023020 con 0x7f34280833a0 2023-11-15T02:55:40.960 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:40.960 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":213,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:55:33.841451+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-11-15T02:55:19.243909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-11-15T02:55:20.580363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:0/1187088985":"2023-11-16T02:55:33.841413+0000","172.21.15.141:6833/103755":"2023-11-16T02:55:33.841413+0000","172.21.15.141:6832/103755":"2023-11-16T02:55:33.841413+0000","172.21.15.141:0/2020531998":"2023-11-16T02:55:33.841413+0000","172.21.15.141:0/2287874460":"2023-11-16T02:55:33.841413+0000","172.21.15.141:0/2718331164":"2023-11-16T02:55:33.841413+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:55:40.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.959+0000 7f342dbc0700 1 -- 172.21.15.1:0/3780028401 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f340805f300 msgr2=0x7f34080617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:40.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.959+0000 7f342dbc0700 1 --2- 172.21.15.1:0/3780028401 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f340805f300 0x7f34080617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:40.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.959+0000 7f342dbc0700 1 -- 172.21.15.1:0/3780028401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34280833a0 msgr2=0x7f34280c1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:40.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.959+0000 7f342dbc0700 1 --2- 172.21.15.1:0/3780028401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34280833a0 0x7f34280c1930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f3410012000 tx=0x7f3410015000).stop 2023-11-15T02:55:40.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.959+0000 7f342dbc0700 1 -- 172.21.15.1:0/3780028401 shutdown_connections 2023-11-15T02:55:40.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.959+0000 7f342dbc0700 1 --2- 172.21.15.1:0/3780028401 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f340805f300 0x7f34080617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:40.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.959+0000 7f342dbc0700 1 --2- 172.21.15.1:0/3780028401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3428154450 0x7f3428145d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.959+0000 7f342dbc0700 1 --2- 172.21.15.1:0/3780028401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34280833a0 0x7f34280c1930 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.959+0000 7f342dbc0700 1 --2- 172.21.15.1:0/3780028401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34280be520 0x7f34281589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:40.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.959+0000 7f342dbc0700 1 -- 172.21.15.1:0/3780028401 >> 172.21.15.1:0/3780028401 conn(0x7f3428082f90 msgr2=0x7f34280a7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:40.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.959+0000 7f342dbc0700 1 -- 172.21.15.1:0/3780028401 shutdown_connections 2023-11-15T02:55:40.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:40.959+0000 7f342dbc0700 1 -- 172.21.15.1:0/3780028401 wait complete. 2023-11-15T02:55:40.971 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:40.969+0000 7f37a9667680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-15T02:55:40.975 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-15T02:55:41.088 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:41.086+0000 7f7ae0a78680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:55:41.089 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:41.086+0000 7f37a9667680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-15T02:55:41.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.093+0000 7f0c2523c700 1 Processor -- start 2023-11-15T02:55:41.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.094+0000 7f0c2523c700 1 -- start start 2023-11-15T02:55:41.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.094+0000 7f0c2523c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c20155530 0x7f0c200c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:41.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.094+0000 7f0c2523c700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c200c7980 con 0x7f0c200c98b0 2023-11-15T02:55:41.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.094+0000 7f0c2523c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c200aa890 con 0x7f0c20151e10 2023-11-15T02:55:41.100 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.094+0000 7f0c2523c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c200c7bd0 con 0x7f0c20155530 2023-11-15T02:55:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.095+0000 7f0c24a3b700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0c200c98b0 0x7f0c200c61a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48760/0 (socket says 172.21.15.1:48760) 2023-11-15T02:55:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.095+0000 7f0c24a3b700 1 -- 172.21.15.1:0/1985260865 learned_addr learned my addr 172.21.15.1:0/1985260865 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.095+0000 7f0c1f7fe700 1 --2- 172.21.15.1:0/1985260865 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c20155530 0x7f0c200c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.095+0000 7f0c1effd700 1 -- 172.21.15.1:0/1985260865 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599399904 0 0) 0x7f0c200c7980 con 0x7f0c200c98b0 2023-11-15T02:55:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.095+0000 7f0c1effd700 1 -- 172.21.15.1:0/1985260865 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c080033f0 con 0x7f0c200c98b0 2023-11-15T02:55:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.095+0000 7f0c1effd700 1 -- 172.21.15.1:0/1985260865 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313816023 0 0) 0x7f0c200aa890 con 0x7f0c20151e10 2023-11-15T02:55:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.095+0000 7f0c1effd700 1 -- 172.21.15.1:0/1985260865 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c200c7980 con 0x7f0c20151e10 2023-11-15T02:55:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.095+0000 7f0c1f7fe700 1 -- 172.21.15.1:0/1985260865 >> v1:172.21.15.141:6789/0 conn(0x7f0c20151e10 legacy=0x7f0c200aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.095+0000 7f0c1f7fe700 1 -- 172.21.15.1:0/1985260865 >> v1:172.21.15.1:6789/0 conn(0x7f0c200c98b0 legacy=0x7f0c200c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.095+0000 7f0c1f7fe700 1 -- 172.21.15.1:0/1985260865 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c200c7eb0 con 0x7f0c20155530 2023-11-15T02:55:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.095+0000 7f0c1f7fe700 1 --2- 172.21.15.1:0/1985260865 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c20155530 0x7f0c200c86b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f0c14009790 tx=0x7f0c14009060).ready entity=mon.2 client_cookie=25fc4c3195ec0512 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.095+0000 7f0c1effd700 1 -- 172.21.15.1:0/1985260865 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400f510 con 0x7f0c20155530 2023-11-15T02:55:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.095+0000 7f0c1effd700 1 -- 172.21.15.1:0/1985260865 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1400f670 con 0x7f0c20155530 2023-11-15T02:55:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.095+0000 7f0c1effd700 1 -- 172.21.15.1:0/1985260865 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400f9f0 con 0x7f0c20155530 2023-11-15T02:55:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.096+0000 7f0c2523c700 1 -- 172.21.15.1:0/1985260865 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c20155530 msgr2=0x7f0c200c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.096+0000 7f0c2523c700 1 --2- 172.21.15.1:0/1985260865 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c20155530 0x7f0c200c86b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f0c14009790 tx=0x7f0c14009060).stop 2023-11-15T02:55:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.096+0000 7f0c2523c700 1 -- 172.21.15.1:0/1985260865 shutdown_connections 2023-11-15T02:55:41.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.096+0000 7f0c2523c700 1 --2- 172.21.15.1:0/1985260865 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c20155530 0x7f0c200c86b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:41.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.096+0000 7f0c2523c700 1 -- 172.21.15.1:0/1985260865 >> 172.21.15.1:0/1985260865 conn(0x7f0c200947e0 msgr2=0x7f0c2006a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:41.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.096+0000 7f0c2523c700 1 -- 172.21.15.1:0/1985260865 shutdown_connections 2023-11-15T02:55:41.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.096+0000 7f0c2523c700 1 -- 172.21.15.1:0/1985260865 wait complete. 2023-11-15T02:55:41.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.097+0000 7f0c2523c700 1 Processor -- start 2023-11-15T02:55:41.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.097+0000 7f0c2523c700 1 -- start start 2023-11-15T02:55:41.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.098+0000 7f0c2523c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c200c98b0 0x7f0c200af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:41.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.098+0000 7f0c2523c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20151e10 0x7f0c20165160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:41.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.098+0000 7f0c2523c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c20155530 0x7f0c20165650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:41.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.098+0000 7f0c2523c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c20163f40 con 0x7f0c20151e10 2023-11-15T02:55:41.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.098+0000 7f0c2523c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c200b0620 con 0x7f0c200c98b0 2023-11-15T02:55:41.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.098+0000 7f0c2523c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c200afd80 con 0x7f0c20155530 2023-11-15T02:55:41.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.098+0000 7f0c1f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20151e10 0x7f0c20165160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:41.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.098+0000 7f0c1f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20151e10 0x7f0c20165160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52842/0 (socket says 172.21.15.1:52842) 2023-11-15T02:55:41.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.098+0000 7f0c1f7fe700 1 -- 172.21.15.1:0/60783934 learned_addr learned my addr 172.21.15.1:0/60783934 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:41.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.098+0000 7f0c1ffff700 1 --2- 172.21.15.1:0/60783934 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c200c98b0 0x7f0c200af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:41.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.098+0000 7f0c24a3b700 1 --2- 172.21.15.1:0/60783934 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c20155530 0x7f0c20165650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:41.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.099+0000 7f0c1f7fe700 1 -- 172.21.15.1:0/60783934 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c20155530 msgr2=0x7f0c20165650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:41.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.099+0000 7f0c1f7fe700 1 --2- 172.21.15.1:0/60783934 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c20155530 0x7f0c20165650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:41.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.099+0000 7f0c1f7fe700 1 -- 172.21.15.1:0/60783934 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c200c98b0 msgr2=0x7f0c200af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:41.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.099+0000 7f0c1f7fe700 1 --2- 172.21.15.1:0/60783934 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c200c98b0 0x7f0c200af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:41.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.099+0000 7f0c1f7fe700 1 -- 172.21.15.1:0/60783934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c140092a0 con 0x7f0c20151e10 2023-11-15T02:55:41.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.099+0000 7f0c1f7fe700 1 --2- 172.21.15.1:0/60783934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20151e10 0x7f0c20165160 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7f0c20084670 tx=0x7f0c14017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:41.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.099+0000 7f0c07fff700 1 -- 172.21.15.1:0/60783934 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400fe80 con 0x7f0c20151e10 2023-11-15T02:55:41.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.099+0000 7f0c07fff700 1 -- 172.21.15.1:0/60783934 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1400f7e0 con 0x7f0c20151e10 2023-11-15T02:55:41.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.099+0000 7f0c2523c700 1 -- 172.21.15.1:0/60783934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c200b0060 con 0x7f0c20151e10 2023-11-15T02:55:41.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.099+0000 7f0c07fff700 1 -- 172.21.15.1:0/60783934 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1401b640 con 0x7f0c20151e10 2023-11-15T02:55:41.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.099+0000 7f0c2523c700 1 -- 172.21.15.1:0/60783934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c20164130 con 0x7f0c20151e10 2023-11-15T02:55:41.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.100+0000 7f0c2523c700 1 -- 172.21.15.1:0/60783934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c20164320 con 0x7f0c20151e10 2023-11-15T02:55:41.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.100+0000 7f0c07fff700 1 -- 172.21.15.1:0/60783934 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 103) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f0c1401ba00 con 0x7f0c20151e10 2023-11-15T02:55:41.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.101+0000 7f0c07fff700 1 --2- 172.21.15.1:0/60783934 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0c0c05f300 0x7f0c0c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:41.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.101+0000 7f0c1ffff700 1 -- 172.21.15.1:0/60783934 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0c0c05f300 msgr2=0x7f0c0c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.141:6832/103755 2023-11-15T02:55:41.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.101+0000 7f0c07fff700 1 -- 172.21.15.1:0/60783934 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6931+0+0 (secure 0 0 0) 0x7f0c1407c0e0 con 0x7f0c20151e10 2023-11-15T02:55:41.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.101+0000 7f0c1ffff700 1 --2- 172.21.15.1:0/60783934 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0c0c05f300 0x7f0c0c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-11-15T02:55:41.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.109+0000 7f0c07fff700 1 -- 172.21.15.1:0/60783934 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0c1404ce80 con 0x7f0c20151e10 2023-11-15T02:55:41.163 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:41.161+0000 7f7ae0a78680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:55:41.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.184+0000 7f0c07fff700 1 -- 172.21.15.1:0/60783934 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 104) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f0c14079980 con 0x7f0c20151e10 2023-11-15T02:55:41.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.184+0000 7f0c07fff700 1 -- 172.21.15.1:0/60783934 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0c0c05f300 msgr2=0x7f0c0c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:41.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.184+0000 7f0c07fff700 1 --2- 172.21.15.1:0/60783934 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0c0c05f300 0x7f0c0c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:41.240 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:41.238+0000 7f7a5b209700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:41.240 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:41.238+0000 7f7a5b209700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:41.240 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:41.238+0000 7f7a5b209700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:41.241 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:41.238+0000 7f7a5b209700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:41.241 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:41.238+0000 7f7a5b209700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:41.241 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:41.238+0000 7f7a5da0e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:41.241 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:41.238+0000 7f7a5da0e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:41.241 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:41.238+0000 7f7a5da0e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:41.242 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:41.238+0000 7f7a5da0e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:41.242 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-15T02:55:41.238+0000 7f7a5da0e700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-15T02:55:41.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:41.334+0000 7f0c2523c700 1 -- 172.21.15.1:0/60783934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0c200475e0 con 0x7f0c20151e10 2023-11-15T02:55:41.402 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:41.400+0000 7f37a9667680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-15T02:55:41.477 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-11-15T02:55:41.475+0000 7f37a9667680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-15T02:55:42.179 INFO:tasks.ceph.mon.a.smithi001.stderr:2023-11-15T02:55:42.178+0000 7f8072214700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-15T02:55:42.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.184+0000 7f0c07fff700 1 -- 172.21.15.1:0/60783934 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v96) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0c140543f0 con 0x7f0c20151e10 2023-11-15T02:55:42.187 INFO:tasks.ceph.mds.d.smithi141.stderr: -3951> 2023-11-15T02:55:16.105+0000 7f3b3e6bf700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-11-15T02:55:42.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.187+0000 7f0c2523c700 1 -- 172.21.15.1:0/60783934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20151e10 msgr2=0x7f0c20165160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:42.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.187+0000 7f0c2523c700 1 --2- 172.21.15.1:0/60783934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20151e10 0x7f0c20165160 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7f0c20084670 tx=0x7f0c14017000).stop 2023-11-15T02:55:42.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.187+0000 7f0c2523c700 1 -- 172.21.15.1:0/60783934 shutdown_connections 2023-11-15T02:55:42.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.187+0000 7f0c2523c700 1 --2- 172.21.15.1:0/60783934 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f0c0c05f300 0x7f0c0c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:42.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.187+0000 7f0c2523c700 1 --2- 172.21.15.1:0/60783934 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c20155530 0x7f0c20165650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:42.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.187+0000 7f0c2523c700 1 --2- 172.21.15.1:0/60783934 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c200c98b0 0x7f0c200af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:42.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.187+0000 7f0c2523c700 1 --2- 172.21.15.1:0/60783934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20151e10 0x7f0c20165160 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:42.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.187+0000 7f0c2523c700 1 -- 172.21.15.1:0/60783934 >> 172.21.15.1:0/60783934 conn(0x7f0c200947e0 msgr2=0x7f0c200c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:42.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.187+0000 7f0c2523c700 1 -- 172.21.15.1:0/60783934 shutdown_connections 2023-11-15T02:55:42.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.187+0000 7f0c2523c700 1 -- 172.21.15.1:0/60783934 wait complete. 2023-11-15T02:55:42.192 INFO:tasks.ceph.mds.d.smithi141.stderr: -2773> 2023-11-15T02:55:26.510+0000 7f3b386b3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-15T02:55:42.192 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-15T02:55:42.208 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-15T02:55:42.218 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-15T02:55:42.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.332+0000 7fae90f9f700 1 Processor -- start 2023-11-15T02:55:42.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.332+0000 7fae90f9f700 1 -- start start 2023-11-15T02:55:42.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.333+0000 7fae90f9f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae8c1545b0 0x7fae8c0c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:42.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.333+0000 7fae90f9f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8c155830 con 0x7fae8c1541d0 2023-11-15T02:55:42.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.333+0000 7fae90f9f700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8c0c83a0 con 0x7fae8c0c7f50 2023-11-15T02:55:42.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.333+0000 7fae90f9f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c158f40 con 0x7fae8c1545b0 2023-11-15T02:55:42.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.333+0000 7fae8b7fe700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fae8c1541d0 0x7fae8c0c60d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48776/0 (socket says 172.21.15.1:48776) 2023-11-15T02:55:42.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.333+0000 7fae8b7fe700 1 -- 172.21.15.1:0/4203632612 learned_addr learned my addr 172.21.15.1:0/4203632612 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:42.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8affd700 1 --2- 172.21.15.1:0/4203632612 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae8c1545b0 0x7fae8c0c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:42.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8a7fc700 1 -- 172.21.15.1:0/4203632612 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258719476 0 0) 0x7fae8c155830 con 0x7fae8c1541d0 2023-11-15T02:55:42.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8a7fc700 1 -- 172.21.15.1:0/4203632612 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae740033f0 con 0x7fae8c1541d0 2023-11-15T02:55:42.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8a7fc700 1 -- 172.21.15.1:0/4203632612 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 307044531 0 0) 0x7fae740033f0 con 0x7fae8c1541d0 2023-11-15T02:55:42.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8a7fc700 1 -- 172.21.15.1:0/4203632612 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae8c1545b0 msgr2=0x7fae8c0c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:42.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8a7fc700 1 --2- 172.21.15.1:0/4203632612 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae8c1545b0 0x7fae8c0c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8a7fc700 1 -- 172.21.15.1:0/4203632612 >> v1:172.21.15.141:6789/0 conn(0x7fae8c0c7f50 legacy=0x7fae8c0c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8a7fc700 1 -- 172.21.15.1:0/4203632612 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c154c20 con 0x7fae8c1541d0 2023-11-15T02:55:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8a7fc700 1 -- 172.21.15.1:0/4203632612 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fae7c001470 con 0x7fae8c1541d0 2023-11-15T02:55:42.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8a7fc700 1 -- 172.21.15.1:0/4203632612 >> v1:172.21.15.1:6789/0 conn(0x7fae8c1541d0 legacy=0x7fae8c0c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:42.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8a7fc700 1 --2- 172.21.15.1:0/4203632612 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae74003910 0x7fae74003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:42.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8a7fc700 1 --2- 172.21.15.1:0/4203632612 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae8c1545b0 0x7fae74004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:42.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8a7fc700 1 --2- 172.21.15.1:0/4203632612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae74004b80 0x7fae74005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:42.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8a7fc700 1 -- 172.21.15.1:0/4203632612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7400b8e0 con 0x7fae74004b80 2023-11-15T02:55:42.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8a7fc700 1 -- 172.21.15.1:0/4203632612 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7400ba20 con 0x7fae74003910 2023-11-15T02:55:42.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8a7fc700 1 -- 172.21.15.1:0/4203632612 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7400bb90 con 0x7fae8c1545b0 2023-11-15T02:55:42.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8bfff700 1 --2- 172.21.15.1:0/4203632612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae74004b80 0x7fae74005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:42.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8b7fe700 1 --2- 172.21.15.1:0/4203632612 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae74003910 0x7fae74003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:42.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.334+0000 7fae8affd700 1 --2- 172.21.15.1:0/4203632612 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae8c1545b0 0x7fae74004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:42.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.335+0000 7fae8bfff700 1 -- 172.21.15.1:0/4203632612 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae8c1545b0 msgr2=0x7fae74004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:42.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.335+0000 7fae8bfff700 1 --2- 172.21.15.1:0/4203632612 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae8c1545b0 0x7fae74004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:42.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.335+0000 7fae8bfff700 1 -- 172.21.15.1:0/4203632612 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae74003910 msgr2=0x7fae74003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:42.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.335+0000 7fae8bfff700 1 --2- 172.21.15.1:0/4203632612 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae74003910 0x7fae74003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:42.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.335+0000 7fae8bfff700 1 -- 172.21.15.1:0/4203632612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae740033f0 con 0x7fae74004b80 2023-11-15T02:55:42.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.335+0000 7fae8b7fe700 1 --2- 172.21.15.1:0/4203632612 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae74003910 0x7fae74003cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.335+0000 7fae8bfff700 1 --2- 172.21.15.1:0/4203632612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae74004b80 0x7fae74005000 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7fae84001f20 tx=0x7fae84007f10).ready entity=mon.0 client_cookie=68f38ec8f879d500 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.335+0000 7fae8a7fc700 1 -- 172.21.15.1:0/4203632612 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae840017e0 con 0x7fae74004b80 2023-11-15T02:55:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.335+0000 7fae8a7fc700 1 -- 172.21.15.1:0/4203632612 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8400c670 con 0x7fae74004b80 2023-11-15T02:55:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.335+0000 7fae8a7fc700 1 -- 172.21.15.1:0/4203632612 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8400c9f0 con 0x7fae74004b80 2023-11-15T02:55:42.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.335+0000 7fae90f9f700 1 -- 172.21.15.1:0/4203632612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae74004b80 msgr2=0x7fae74005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.335+0000 7fae90f9f700 1 --2- 172.21.15.1:0/4203632612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae74004b80 0x7fae74005000 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7fae84001f20 tx=0x7fae84007f10).stop 2023-11-15T02:55:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.335+0000 7fae8bfff700 1 -- 172.21.15.1:0/4203632612 reap_dead start 2023-11-15T02:55:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.335+0000 7fae90f9f700 1 -- 172.21.15.1:0/4203632612 shutdown_connections 2023-11-15T02:55:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.335+0000 7fae90f9f700 1 -- 172.21.15.1:0/4203632612 >> 172.21.15.1:0/4203632612 conn(0x7fae8c069ee0 msgr2=0x7fae8c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:42.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.336+0000 7fae90f9f700 1 -- 172.21.15.1:0/4203632612 shutdown_connections 2023-11-15T02:55:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.336+0000 7fae90f9f700 1 -- 172.21.15.1:0/4203632612 wait complete. 2023-11-15T02:55:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.337+0000 7fae90f9f700 1 Processor -- start 2023-11-15T02:55:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.337+0000 7fae90f9f700 1 -- start start 2023-11-15T02:55:42.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.338+0000 7fae90f9f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae8c164290 0x7fae8c150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:42.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.338+0000 7fae90f9f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae8c150d00 0x7fae8c0c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:42.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.338+0000 7fae90f9f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae8c0c62a0 0x7fae8c0af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:42.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.338+0000 7fae90f9f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0af130 con 0x7fae8c164290 2023-11-15T02:55:42.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.338+0000 7fae90f9f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0c6720 con 0x7fae8c150d00 2023-11-15T02:55:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.338+0000 7fae90f9f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0ae4b0 con 0x7fae8c0c62a0 2023-11-15T02:55:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.338+0000 7fae8b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae8c164290 0x7fae8c150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.338+0000 7fae8b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae8c164290 0x7fae8c150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52870/0 (socket says 172.21.15.1:52870) 2023-11-15T02:55:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.338+0000 7fae8b7fe700 1 -- 172.21.15.1:0/4011822781 learned_addr learned my addr 172.21.15.1:0/4011822781 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:42.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.338+0000 7fae8affd700 1 --2- 172.21.15.1:0/4011822781 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae8c150d00 0x7fae8c0c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:42.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.339+0000 7fae8b7fe700 1 -- 172.21.15.1:0/4011822781 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae8c0c62a0 msgr2=0x7fae8c0af550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-15T02:55:42.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.339+0000 7fae8b7fe700 1 --2- 172.21.15.1:0/4011822781 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae8c0c62a0 0x7fae8c0af550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:42.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.339+0000 7fae8b7fe700 1 -- 172.21.15.1:0/4011822781 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae8c150d00 msgr2=0x7fae8c0c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:42.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.339+0000 7fae8b7fe700 1 --2- 172.21.15.1:0/4011822781 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae8c150d00 0x7fae8c0c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:42.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.339+0000 7fae8b7fe700 1 -- 172.21.15.1:0/4011822781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c0ae790 con 0x7fae8c164290 2023-11-15T02:55:42.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.339+0000 7fae8b7fe700 1 --2- 172.21.15.1:0/4011822781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae8c164290 0x7fae8c150810 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7fae7c0048a0 tx=0x7fae7c001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:42.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.339+0000 7fae737fe700 1 -- 172.21.15.1:0/4011822781 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c00f670 con 0x7fae8c164290 2023-11-15T02:55:42.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.339+0000 7fae737fe700 1 -- 172.21.15.1:0/4011822781 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c00f7d0 con 0x7fae8c164290 2023-11-15T02:55:42.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.339+0000 7fae90f9f700 1 -- 172.21.15.1:0/4011822781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c0aea70 con 0x7fae8c164290 2023-11-15T02:55:42.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.339+0000 7fae737fe700 1 -- 172.21.15.1:0/4011822781 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c00fb50 con 0x7fae8c164290 2023-11-15T02:55:42.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.339+0000 7fae90f9f700 1 -- 172.21.15.1:0/4011822781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c0ae0d0 con 0x7fae8c164290 2023-11-15T02:55:42.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.340+0000 7fae90f9f700 1 -- 172.21.15.1:0/4011822781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8c0af270 con 0x7fae8c164290 2023-11-15T02:55:42.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.340+0000 7fae737fe700 1 -- 172.21.15.1:0/4011822781 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 105) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fae7c01d3b0 con 0x7fae8c164290 2023-11-15T02:55:42.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.341+0000 7fae737fe700 1 --2- 172.21.15.1:0/4011822781 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fae7805f030 0x7fae780614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:42.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.341+0000 7fae737fe700 1 -- 172.21.15.1:0/4011822781 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 7232+0+0 (secure 0 0 0) 0x7fae7c079d20 con 0x7fae8c164290 2023-11-15T02:55:42.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.342+0000 7fae8affd700 1 --2- 172.21.15.1:0/4011822781 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fae7805f030 0x7fae780614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:42.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.342+0000 7fae8affd700 1 --2- 172.21.15.1:0/4011822781 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fae7805f030 0x7fae780614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fae80006d80 tx=0x7fae80009060).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:42.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.345+0000 7fae737fe700 1 -- 172.21.15.1:0/4011822781 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fae8c0af270 con 0x7fae8c164290 2023-11-15T02:55:42.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:42.563+0000 7fae90f9f700 1 -- 172.21.15.1:0/4011822781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fae8c0af270 con 0x7fae8c164290 2023-11-15T02:55:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.197+0000 7fae737fe700 1 -- 172.21.15.1:0/4011822781 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v97) v1 ==== 104+0+0 (secure 0 0 0) 0x7fae8c0af270 con 0x7fae8c164290 2023-11-15T02:55:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.200+0000 7fae90f9f700 1 -- 172.21.15.1:0/4011822781 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fae7805f030 msgr2=0x7fae780614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.200+0000 7fae90f9f700 1 --2- 172.21.15.1:0/4011822781 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fae7805f030 0x7fae780614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fae80006d80 tx=0x7fae80009060).stop 2023-11-15T02:55:43.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.200+0000 7fae90f9f700 1 -- 172.21.15.1:0/4011822781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae8c164290 msgr2=0x7fae8c150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:43.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.200+0000 7fae90f9f700 1 --2- 172.21.15.1:0/4011822781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae8c164290 0x7fae8c150810 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7fae7c0048a0 tx=0x7fae7c001e70).stop 2023-11-15T02:55:43.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.200+0000 7fae90f9f700 1 -- 172.21.15.1:0/4011822781 shutdown_connections 2023-11-15T02:55:43.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.200+0000 7fae90f9f700 1 --2- 172.21.15.1:0/4011822781 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fae7805f030 0x7fae780614f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:43.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.200+0000 7fae90f9f700 1 --2- 172.21.15.1:0/4011822781 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae8c0c62a0 0x7fae8c0af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:43.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.200+0000 7fae90f9f700 1 --2- 172.21.15.1:0/4011822781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae8c164290 0x7fae8c150810 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:43.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.200+0000 7fae90f9f700 1 --2- 172.21.15.1:0/4011822781 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae8c150d00 0x7fae8c0c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:43.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.200+0000 7fae90f9f700 1 -- 172.21.15.1:0/4011822781 >> 172.21.15.1:0/4011822781 conn(0x7fae8c069ee0 msgr2=0x7fae8c0c0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:43.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.200+0000 7fae90f9f700 1 -- 172.21.15.1:0/4011822781 shutdown_connections 2023-11-15T02:55:43.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.200+0000 7fae90f9f700 1 -- 172.21.15.1:0/4011822781 wait complete. 2023-11-15T02:55:43.218 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-15T02:55:43.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.345+0000 7f849a4c7700 1 Processor -- start 2023-11-15T02:55:43.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.345+0000 7f849a4c7700 1 -- start start 2023-11-15T02:55:43.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.346+0000 7f849a4c7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84940ada30 0x7f84940c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:43.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.346+0000 7f849a4c7700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f84940ca400 0x7f84940c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:43.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.346+0000 7f849a4c7700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84940caee0 con 0x7f84940c65b0 2023-11-15T02:55:43.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.346+0000 7f849a4c7700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8494154850 con 0x7f84940ca400 2023-11-15T02:55:43.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.346+0000 7f849a4c7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84940ca920 con 0x7f84940ada30 2023-11-15T02:55:43.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.346+0000 7f8499cc6700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f84940c65b0 0x7f8494063510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48786/0 (socket says 172.21.15.1:48786) 2023-11-15T02:55:43.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.346+0000 7f8499cc6700 1 -- 172.21.15.1:0/3600802786 learned_addr learned my addr 172.21.15.1:0/3600802786 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:43.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.346+0000 7f84994c5700 1 --2- 172.21.15.1:0/3600802786 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84940ada30 0x7f84940c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:43.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.346+0000 7f8498cc4700 1 --2- 172.21.15.1:0/3600802786 >> v2:172.21.15.141:3300/0 conn(0x7f84940ca400 0x7f84940c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:43.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.346+0000 7f8493fff700 1 -- 172.21.15.1:0/3600802786 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236344125 0 0) 0x7f84940caee0 con 0x7f84940c65b0 2023-11-15T02:55:43.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.346+0000 7f8493fff700 1 -- 172.21.15.1:0/3600802786 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f847c0033f0 con 0x7f84940c65b0 2023-11-15T02:55:43.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 -- 172.21.15.1:0/3600802786 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2836103324 0 0) 0x7f847c0033f0 con 0x7f84940c65b0 2023-11-15T02:55:43.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 -- 172.21.15.1:0/3600802786 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84940ada30 msgr2=0x7f84940c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:43.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 --2- 172.21.15.1:0/3600802786 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84940ada30 0x7f84940c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:43.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 -- 172.21.15.1:0/3600802786 >> v2:172.21.15.141:3300/0 conn(0x7f84940ca400 msgr2=0x7f84940c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:43.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 --2- 172.21.15.1:0/3600802786 >> v2:172.21.15.141:3300/0 conn(0x7f84940ca400 0x7f84940c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:43.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 -- 172.21.15.1:0/3600802786 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84940cac00 con 0x7f84940c65b0 2023-11-15T02:55:43.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 -- 172.21.15.1:0/3600802786 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f84840017f0 con 0x7f84940c65b0 2023-11-15T02:55:43.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 -- 172.21.15.1:0/3600802786 >> v1:172.21.15.1:6789/0 conn(0x7f84940c65b0 legacy=0x7f8494063510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:43.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 --2- 172.21.15.1:0/3600802786 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f847c0038e0 0x7f847c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:43.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 --2- 172.21.15.1:0/3600802786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f847c004690 0x7f847c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:43.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 --2- 172.21.15.1:0/3600802786 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84940ada30 0x7f847c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:43.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 -- 172.21.15.1:0/3600802786 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8494154850 con 0x7f847c004690 2023-11-15T02:55:43.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 -- 172.21.15.1:0/3600802786 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84940ca920 con 0x7f847c0038e0 2023-11-15T02:55:43.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 -- 172.21.15.1:0/3600802786 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847c00b8e0 con 0x7f84940ada30 2023-11-15T02:55:43.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8498cc4700 1 --2- 172.21.15.1:0/3600802786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f847c004690 0x7f847c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:43.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f84994c5700 1 --2- 172.21.15.1:0/3600802786 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f847c0038e0 0x7f847c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:43.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8499cc6700 1 --2- 172.21.15.1:0/3600802786 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84940ada30 0x7f847c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:43.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8498cc4700 1 -- 172.21.15.1:0/3600802786 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84940ada30 msgr2=0x7f847c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:43.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8498cc4700 1 --2- 172.21.15.1:0/3600802786 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84940ada30 0x7f847c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:43.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8498cc4700 1 -- 172.21.15.1:0/3600802786 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f847c0038e0 msgr2=0x7f847c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:43.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8498cc4700 1 --2- 172.21.15.1:0/3600802786 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f847c0038e0 0x7f847c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:43.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8498cc4700 1 -- 172.21.15.1:0/3600802786 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847c0033f0 con 0x7f847c004690 2023-11-15T02:55:43.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f84994c5700 1 --2- 172.21.15.1:0/3600802786 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f847c0038e0 0x7f847c003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:43.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8498cc4700 1 --2- 172.21.15.1:0/3600802786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f847c004690 0x7f847c004b10 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7f8494157e50 tx=0x7f8488009060).ready entity=mon.0 client_cookie=a8e6885bca6cf763 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:43.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 -- 172.21.15.1:0/3600802786 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488009e90 con 0x7f847c004690 2023-11-15T02:55:43.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.347+0000 7f8493fff700 1 -- 172.21.15.1:0/3600802786 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8488009430 con 0x7f847c004690 2023-11-15T02:55:43.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.348+0000 7f8493fff700 1 -- 172.21.15.1:0/3600802786 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848800e850 con 0x7f847c004690 2023-11-15T02:55:43.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.348+0000 7f849a4c7700 1 -- 172.21.15.1:0/3600802786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f847c004690 msgr2=0x7f847c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:43.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.348+0000 7f849a4c7700 1 --2- 172.21.15.1:0/3600802786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f847c004690 0x7f847c004b10 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7f8494157e50 tx=0x7f8488009060).stop 2023-11-15T02:55:43.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.348+0000 7f8499cc6700 1 -- 172.21.15.1:0/3600802786 reap_dead start 2023-11-15T02:55:43.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.348+0000 7f849a4c7700 1 -- 172.21.15.1:0/3600802786 shutdown_connections 2023-11-15T02:55:43.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.348+0000 7f849a4c7700 1 -- 172.21.15.1:0/3600802786 >> 172.21.15.1:0/3600802786 conn(0x7f8494064a60 msgr2=0x7f8494064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:43.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.348+0000 7f849a4c7700 1 -- 172.21.15.1:0/3600802786 shutdown_connections 2023-11-15T02:55:43.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.348+0000 7f849a4c7700 1 -- 172.21.15.1:0/3600802786 wait complete. 2023-11-15T02:55:43.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.349+0000 7f849a4c7700 1 Processor -- start 2023-11-15T02:55:43.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.349+0000 7f849a4c7700 1 -- start start 2023-11-15T02:55:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.350+0000 7f849a4c7700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f847c004690 0x7f84940c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.350+0000 7f849a4c7700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8494165280 0x7f849414ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.350+0000 7f849a4c7700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8494156ab0 0x7f8494156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.350+0000 7f849a4c7700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84940c2530 con 0x7f847c004690 2023-11-15T02:55:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.350+0000 7f849a4c7700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84940c5010 con 0x7f8494156ab0 2023-11-15T02:55:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.350+0000 7f849a4c7700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8494157400 con 0x7f8494165280 2023-11-15T02:55:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.350+0000 7f84994c5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f847c004690 0x7f84940c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.350+0000 7f84994c5700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f847c004690 0x7f84940c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52878/0 (socket says 172.21.15.1:52878) 2023-11-15T02:55:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.350+0000 7f84994c5700 1 -- 172.21.15.1:0/400759384 learned_addr learned my addr 172.21.15.1:0/400759384 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:43.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.351+0000 7f8498cc4700 1 --2- 172.21.15.1:0/400759384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8494165280 0x7f849414ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:43.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.351+0000 7f8499cc6700 1 --2- 172.21.15.1:0/400759384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8494156ab0 0x7f8494156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:43.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.351+0000 7f84994c5700 1 -- 172.21.15.1:0/400759384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8494165280 msgr2=0x7f849414ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:43.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.351+0000 7f84994c5700 1 --2- 172.21.15.1:0/400759384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8494165280 0x7f849414ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:43.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.351+0000 7f84994c5700 1 -- 172.21.15.1:0/400759384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8494156ab0 msgr2=0x7f8494156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:43.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.351+0000 7f84994c5700 1 --2- 172.21.15.1:0/400759384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8494156ab0 0x7f8494156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:43.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.351+0000 7f84994c5700 1 -- 172.21.15.1:0/400759384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84940c4400 con 0x7f847c004690 2023-11-15T02:55:43.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.351+0000 7f84994c5700 1 --2- 172.21.15.1:0/400759384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f847c004690 0x7f84940c3e20 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7f848c011960 tx=0x7f848c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:43.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.351+0000 7f84917fa700 1 -- 172.21.15.1:0/400759384 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c00f6d0 con 0x7f847c004690 2023-11-15T02:55:43.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.351+0000 7f84917fa700 1 -- 172.21.15.1:0/400759384 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c00f830 con 0x7f847c004690 2023-11-15T02:55:43.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.351+0000 7f849a4c7700 1 -- 172.21.15.1:0/400759384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84940c46e0 con 0x7f847c004690 2023-11-15T02:55:43.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.351+0000 7f84917fa700 1 -- 172.21.15.1:0/400759384 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c00fbb0 con 0x7f847c004690 2023-11-15T02:55:43.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.351+0000 7f849a4c7700 1 -- 172.21.15.1:0/400759384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84940c4ca0 con 0x7f847c004690 2023-11-15T02:55:43.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.352+0000 7f849a4c7700 1 -- 172.21.15.1:0/400759384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84940475e0 con 0x7f847c004690 2023-11-15T02:55:43.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.352+0000 7f84917fa700 1 -- 172.21.15.1:0/400759384 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 105) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f848c015480 con 0x7f847c004690 2023-11-15T02:55:43.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.353+0000 7f84917fa700 1 --2- 172.21.15.1:0/400759384 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f848005f030 0x7f84800614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:43.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.353+0000 7f84917fa700 1 -- 172.21.15.1:0/400759384 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 7232+0+0 (secure 0 0 0) 0x7f848c07a6c0 con 0x7f847c004690 2023-11-15T02:55:43.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.353+0000 7f8498cc4700 1 --2- 172.21.15.1:0/400759384 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f848005f030 0x7f84800614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:43.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.353+0000 7f8498cc4700 1 --2- 172.21.15.1:0/400759384 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f848005f030 0x7f84800614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f84880095a0 tx=0x7f848801a000).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:43.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.357+0000 7f84917fa700 1 -- 172.21.15.1:0/400759384 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f848c04b6b0 con 0x7f847c004690 2023-11-15T02:55:43.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.531+0000 7f849a4c7700 1 -- 172.21.15.1:0/400759384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f84940ab240 con 0x7f847c004690 2023-11-15T02:55:43.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:43.922+0000 7f84917fa700 1 -- 172.21.15.1:0/400759384 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f848c078210 con 0x7f847c004690 2023-11-15T02:55:44.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.199+0000 7f84917fa700 1 -- 172.21.15.1:0/400759384 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v217) v1 ==== 181+0+0 (secure 0 0 0) 0x7f848c070470 con 0x7f847c004690 2023-11-15T02:55:44.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.203+0000 7f849a4c7700 1 -- 172.21.15.1:0/400759384 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f848005f030 msgr2=0x7f84800614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:44.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.203+0000 7f849a4c7700 1 --2- 172.21.15.1:0/400759384 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f848005f030 0x7f84800614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f84880095a0 tx=0x7f848801a000).stop 2023-11-15T02:55:44.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.203+0000 7f849a4c7700 1 -- 172.21.15.1:0/400759384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f847c004690 msgr2=0x7f84940c3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:44.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.203+0000 7f849a4c7700 1 --2- 172.21.15.1:0/400759384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f847c004690 0x7f84940c3e20 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7f848c011960 tx=0x7f848c008040).stop 2023-11-15T02:55:44.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.211+0000 7f849a4c7700 1 -- 172.21.15.1:0/400759384 shutdown_connections 2023-11-15T02:55:44.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.211+0000 7f849a4c7700 1 --2- 172.21.15.1:0/400759384 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f848005f030 0x7f84800614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:44.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.211+0000 7f849a4c7700 1 --2- 172.21.15.1:0/400759384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8494156ab0 0x7f8494156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:44.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.211+0000 7f849a4c7700 1 --2- 172.21.15.1:0/400759384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f847c004690 0x7f84940c3e20 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:44.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.211+0000 7f849a4c7700 1 --2- 172.21.15.1:0/400759384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8494165280 0x7f849414ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:44.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.211+0000 7f849a4c7700 1 -- 172.21.15.1:0/400759384 >> 172.21.15.1:0/400759384 conn(0x7f8494064a60 msgr2=0x7f84940c1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.213+0000 7f849a4c7700 1 -- 172.21.15.1:0/400759384 shutdown_connections 2023-11-15T02:55:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.213+0000 7f849a4c7700 1 -- 172.21.15.1:0/400759384 wait complete. 2023-11-15T02:55:44.221 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2023-11-15T02:55:44.233 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-15T02:55:44.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.358+0000 7f5bea40f700 1 Processor -- start 2023-11-15T02:55:44.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.358+0000 7f5bea40f700 1 -- start start 2023-11-15T02:55:44.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.358+0000 7f5bea40f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5be414b350 0x7f5be40c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:44.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5bea40f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5be414b730 0x7f5be4154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:44.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5bea40f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be40aa040 0x7f5be40aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:44.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5bea40f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be40aa9e0 con 0x7f5be414b730 2023-11-15T02:55:44.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5bea40f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be41580d0 con 0x7f5be414b350 2023-11-15T02:55:44.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5bea40f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be4155000 con 0x7f5be40aa040 2023-11-15T02:55:44.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5be37fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5be414b730 0x7f5be4154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:44.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5be37fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5be414b730 0x7f5be4154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52884/0 (socket says 172.21.15.1:52884) 2023-11-15T02:55:44.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5be37fe700 1 -- 172.21.15.1:0/3718198967 learned_addr learned my addr 172.21.15.1:0/3718198967 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:44.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5be3fff700 1 --2- 172.21.15.1:0/3718198967 >> v2:172.21.15.141:3300/0 conn(0x7f5be414b350 0x7f5be40c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:44.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5be89ac700 1 --2- 172.21.15.1:0/3718198967 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be40aa040 0x7f5be40aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:44.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5be37fe700 1 -- 172.21.15.1:0/3718198967 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be40aa040 msgr2=0x7f5be40aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:44.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5be37fe700 1 --2- 172.21.15.1:0/3718198967 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be40aa040 0x7f5be40aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:44.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5be37fe700 1 -- 172.21.15.1:0/3718198967 >> v2:172.21.15.141:3300/0 conn(0x7f5be414b350 msgr2=0x7f5be40c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:44.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5be37fe700 1 --2- 172.21.15.1:0/3718198967 >> v2:172.21.15.141:3300/0 conn(0x7f5be414b350 0x7f5be40c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:44.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5be37fe700 1 -- 172.21.15.1:0/3718198967 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be41552e0 con 0x7f5be414b730 2023-11-15T02:55:44.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5be3fff700 1 --2- 172.21.15.1:0/3718198967 >> v2:172.21.15.141:3300/0 conn(0x7f5be414b350 0x7f5be40c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:44.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5be37fe700 1 --2- 172.21.15.1:0/3718198967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be414b730 0x7f5be4154a10 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 rx=0x7f5be4062ba0 tx=0x7f5bd80090f0).ready entity=mon.0 client_cookie=1f21f0dd5e115a1d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:44.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5be2ffd700 1 -- 172.21.15.1:0/3718198967 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800b600 con 0x7f5be414b730 2023-11-15T02:55:44.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5be2ffd700 1 -- 172.21.15.1:0/3718198967 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd800b760 con 0x7f5be414b730 2023-11-15T02:55:44.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.359+0000 7f5be2ffd700 1 -- 172.21.15.1:0/3718198967 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800bae0 con 0x7f5be414b730 2023-11-15T02:55:44.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.360+0000 7f5bea40f700 1 -- 172.21.15.1:0/3718198967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be414b730 msgr2=0x7f5be4154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:44.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.360+0000 7f5bea40f700 1 --2- 172.21.15.1:0/3718198967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be414b730 0x7f5be4154a10 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 rx=0x7f5be4062ba0 tx=0x7f5bd80090f0).stop 2023-11-15T02:55:44.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.360+0000 7f5bea40f700 1 -- 172.21.15.1:0/3718198967 shutdown_connections 2023-11-15T02:55:44.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.360+0000 7f5bea40f700 1 --2- 172.21.15.1:0/3718198967 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be40aa040 0x7f5be40aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:44.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.360+0000 7f5bea40f700 1 --2- 172.21.15.1:0/3718198967 >> v2:172.21.15.141:3300/0 conn(0x7f5be414b350 0x7f5be40c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:44.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.360+0000 7f5bea40f700 1 --2- 172.21.15.1:0/3718198967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be414b730 0x7f5be4154a10 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:44.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.360+0000 7f5bea40f700 1 -- 172.21.15.1:0/3718198967 >> 172.21.15.1:0/3718198967 conn(0x7f5be4069ee0 msgr2=0x7f5be406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:44.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.360+0000 7f5bea40f700 1 -- 172.21.15.1:0/3718198967 shutdown_connections 2023-11-15T02:55:44.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.360+0000 7f5bea40f700 1 -- 172.21.15.1:0/3718198967 wait complete. 2023-11-15T02:55:44.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.361+0000 7f5bea40f700 1 Processor -- start 2023-11-15T02:55:44.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.361+0000 7f5bea40f700 1 -- start start 2023-11-15T02:55:44.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5bea40f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5be40aa040 0x7f5be40c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:44.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5bea40f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be414b350 0x7f5be4144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:44.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5bea40f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be414b730 0x7f5be40c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:44.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5bea40f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be416c120 con 0x7f5be414b350 2023-11-15T02:55:44.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5bea40f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40ae500 con 0x7f5be40aa040 2023-11-15T02:55:44.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5bea40f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40ae7e0 con 0x7f5be414b730 2023-11-15T02:55:44.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5be37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be414b350 0x7f5be4144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:44.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5be37fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be414b350 0x7f5be4144520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52886/0 (socket says 172.21.15.1:52886) 2023-11-15T02:55:44.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5be37fe700 1 -- 172.21.15.1:0/908070826 learned_addr learned my addr 172.21.15.1:0/908070826 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:44.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5be3fff700 1 --2- 172.21.15.1:0/908070826 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5be40aa040 0x7f5be40c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:44.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5be89ac700 1 --2- 172.21.15.1:0/908070826 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be414b730 0x7f5be40c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:44.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5be37fe700 1 -- 172.21.15.1:0/908070826 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be414b730 msgr2=0x7f5be40c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:44.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5be37fe700 1 --2- 172.21.15.1:0/908070826 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be414b730 0x7f5be40c2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:44.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5be37fe700 1 -- 172.21.15.1:0/908070826 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5be40aa040 msgr2=0x7f5be40c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:44.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5be37fe700 1 --2- 172.21.15.1:0/908070826 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5be40aa040 0x7f5be40c4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:44.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.362+0000 7f5be37fe700 1 -- 172.21.15.1:0/908070826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd8009370 con 0x7f5be414b350 2023-11-15T02:55:44.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.363+0000 7f5be37fe700 1 --2- 172.21.15.1:0/908070826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be414b350 0x7f5be4144520 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7f5bd8006fd0 tx=0x7f5bd8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:44.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.363+0000 7f5bcbfff700 1 -- 172.21.15.1:0/908070826 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800bea0 con 0x7f5be414b350 2023-11-15T02:55:44.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.363+0000 7f5bcbfff700 1 -- 172.21.15.1:0/908070826 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd800b8d0 con 0x7f5be414b350 2023-11-15T02:55:44.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.363+0000 7f5bea40f700 1 -- 172.21.15.1:0/908070826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be40aeac0 con 0x7f5be414b350 2023-11-15T02:55:44.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.363+0000 7f5bcbfff700 1 -- 172.21.15.1:0/908070826 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd801c670 con 0x7f5be414b350 2023-11-15T02:55:44.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.363+0000 7f5bea40f700 1 -- 172.21.15.1:0/908070826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be40aeda0 con 0x7f5be414b350 2023-11-15T02:55:44.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.364+0000 7f5bea40f700 1 -- 172.21.15.1:0/908070826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be416c2d0 con 0x7f5be414b350 2023-11-15T02:55:44.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.364+0000 7f5bcbfff700 1 -- 172.21.15.1:0/908070826 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5bd801c9e0 con 0x7f5be414b350 2023-11-15T02:55:44.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.364+0000 7f5bcbfff700 1 --2- 172.21.15.1:0/908070826 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bd005f270 0x7f5bd0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:44.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.364+0000 7f5bcbfff700 1 -- 172.21.15.1:0/908070826 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6794+0+0 (secure 0 0 0) 0x7f5bd807c0b0 con 0x7f5be414b350 2023-11-15T02:55:44.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.365+0000 7f5be3fff700 1 --2- 172.21.15.1:0/908070826 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bd005f270 0x7f5bd0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:44.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.365+0000 7f5be3fff700 1 --2- 172.21.15.1:0/908070826 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bd005f270 0x7f5bd0061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5bd4006d80 tx=0x7f5bd4008040).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:44.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.369+0000 7f5bcbfff700 1 -- 172.21.15.1:0/908070826 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5be416c2d0 con 0x7f5be414b350 2023-11-15T02:55:44.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:44.540+0000 7f5bea40f700 1 -- 172.21.15.1:0/908070826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5be416c260 con 0x7f5be414b350 2023-11-15T02:55:45.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.200+0000 7f5bcbfff700 1 -- 172.21.15.1:0/908070826 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v218) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5bd804cfd0 con 0x7f5be414b350 2023-11-15T02:55:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.204+0000 7f5bea40f700 1 -- 172.21.15.1:0/908070826 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bd005f270 msgr2=0x7f5bd0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.204+0000 7f5bea40f700 1 --2- 172.21.15.1:0/908070826 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bd005f270 0x7f5bd0061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5bd4006d80 tx=0x7f5bd4008040).stop 2023-11-15T02:55:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.204+0000 7f5bea40f700 1 -- 172.21.15.1:0/908070826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be414b350 msgr2=0x7f5be4144520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.204+0000 7f5bea40f700 1 --2- 172.21.15.1:0/908070826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be414b350 0x7f5be4144520 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7f5bd8006fd0 tx=0x7f5bd8017000).stop 2023-11-15T02:55:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.204+0000 7f5bea40f700 1 -- 172.21.15.1:0/908070826 shutdown_connections 2023-11-15T02:55:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.204+0000 7f5bea40f700 1 --2- 172.21.15.1:0/908070826 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bd005f270 0x7f5bd0061730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.204+0000 7f5bea40f700 1 --2- 172.21.15.1:0/908070826 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be414b730 0x7f5be40c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.204+0000 7f5bea40f700 1 --2- 172.21.15.1:0/908070826 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5be40aa040 0x7f5be40c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.204+0000 7f5bea40f700 1 --2- 172.21.15.1:0/908070826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be414b350 0x7f5be4144520 secure :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 rx=0x7f5bd8006fd0 tx=0x7f5bd8017000).stop 2023-11-15T02:55:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.204+0000 7f5bea40f700 1 -- 172.21.15.1:0/908070826 >> 172.21.15.1:0/908070826 conn(0x7f5be4069ee0 msgr2=0x7f5be40c1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.204+0000 7f5bea40f700 1 -- 172.21.15.1:0/908070826 shutdown_connections 2023-11-15T02:55:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.204+0000 7f5bea40f700 1 -- 172.21.15.1:0/908070826 wait complete. 2023-11-15T02:55:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2023-11-15T02:55:45.222 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-15T02:55:45.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.345+0000 7f4a9496b700 1 Processor -- start 2023-11-15T02:55:45.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.345+0000 7f4a9496b700 1 -- start start 2023-11-15T02:55:45.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.346+0000 7f4a9496b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4a901545b0 0x7f4a900c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:45.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.346+0000 7f4a9496b700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a90155830 con 0x7f4a900c7f50 2023-11-15T02:55:45.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.346+0000 7f4a9496b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a90154c20 con 0x7f4a901541d0 2023-11-15T02:55:45.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.346+0000 7f4a9496b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a90158f40 con 0x7f4a901545b0 2023-11-15T02:55:45.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.346+0000 7f4a8f59e700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4a900c7f50 0x7f4a900c9620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48788/0 (socket says 172.21.15.1:48788) 2023-11-15T02:55:45.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.346+0000 7f4a8f59e700 1 -- 172.21.15.1:0/6597989 learned_addr learned my addr 172.21.15.1:0/6597989 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:45.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.346+0000 7f4a8e59c700 1 --2- 172.21.15.1:0/6597989 >> v2:172.21.15.141:3300/0 conn(0x7f4a901545b0 0x7f4a900c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:45.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.346+0000 7f4a8dd9b700 1 -- 172.21.15.1:0/6597989 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716586160 0 0) 0x7f4a90155830 con 0x7f4a900c7f50 2023-11-15T02:55:45.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.346+0000 7f4a8dd9b700 1 -- 172.21.15.1:0/6597989 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a7c0033f0 con 0x7f4a900c7f50 2023-11-15T02:55:45.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8dd9b700 1 -- 172.21.15.1:0/6597989 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2351594449 0 0) 0x7f4a7c0033f0 con 0x7f4a900c7f50 2023-11-15T02:55:45.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8dd9b700 1 -- 172.21.15.1:0/6597989 >> v2:172.21.15.141:3300/0 conn(0x7f4a901545b0 msgr2=0x7f4a900c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:45.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8dd9b700 1 --2- 172.21.15.1:0/6597989 >> v2:172.21.15.141:3300/0 conn(0x7f4a901545b0 0x7f4a900c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8dd9b700 1 -- 172.21.15.1:0/6597989 >> v1:172.21.15.141:6789/0 conn(0x7f4a901541d0 legacy=0x7f4a900c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:45.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8dd9b700 1 -- 172.21.15.1:0/6597989 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a90154f00 con 0x7f4a900c7f50 2023-11-15T02:55:45.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8dd9b700 1 -- 172.21.15.1:0/6597989 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f4a88001470 con 0x7f4a900c7f50 2023-11-15T02:55:45.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8dd9b700 1 -- 172.21.15.1:0/6597989 >> v1:172.21.15.1:6789/0 conn(0x7f4a900c7f50 legacy=0x7f4a900c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:45.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8dd9b700 1 --2- 172.21.15.1:0/6597989 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4a7c0038e0 0x7f4a7c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:45.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8dd9b700 1 --2- 172.21.15.1:0/6597989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7c004690 0x7f4a7c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:45.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8dd9b700 1 --2- 172.21.15.1:0/6597989 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4a7c005000 0x7f4a7c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:45.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8dd9b700 1 -- 172.21.15.1:0/6597989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c00be80 con 0x7f4a7c004690 2023-11-15T02:55:45.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8dd9b700 1 -- 172.21.15.1:0/6597989 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c00bff0 con 0x7f4a7c0038e0 2023-11-15T02:55:45.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8dd9b700 1 -- 172.21.15.1:0/6597989 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c00c1b0 con 0x7f4a7c005000 2023-11-15T02:55:45.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8e59c700 1 --2- 172.21.15.1:0/6597989 >> v2:172.21.15.141:3300/0 conn(0x7f4a901545b0 0x7f4a900c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:45.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8e59c700 1 --2- 172.21.15.1:0/6597989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7c004690 0x7f4a7c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:45.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8ed9d700 1 --2- 172.21.15.1:0/6597989 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4a7c0038e0 0x7f4a7c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:45.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8f59e700 1 --2- 172.21.15.1:0/6597989 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4a7c005000 0x7f4a7c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:45.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8e59c700 1 -- 172.21.15.1:0/6597989 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4a7c005000 msgr2=0x7f4a7c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:45.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8e59c700 1 --2- 172.21.15.1:0/6597989 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4a7c005000 0x7f4a7c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8e59c700 1 -- 172.21.15.1:0/6597989 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4a7c0038e0 msgr2=0x7f4a7c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:45.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8e59c700 1 --2- 172.21.15.1:0/6597989 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4a7c0038e0 0x7f4a7c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8f59e700 1 -- 172.21.15.1:0/6597989 reap_dead start 2023-11-15T02:55:45.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8e59c700 1 -- 172.21.15.1:0/6597989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7c0033f0 con 0x7f4a7c004690 2023-11-15T02:55:45.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.347+0000 7f4a8e59c700 1 --2- 172.21.15.1:0/6597989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7c004690 0x7f4a7c004b10 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7f4a78009c30 tx=0x7f4a78009060).ready entity=mon.0 client_cookie=78033329d41d0b7d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:45.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.348+0000 7f4a8dd9b700 1 -- 172.21.15.1:0/6597989 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a780095c0 con 0x7f4a7c004690 2023-11-15T02:55:45.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.348+0000 7f4a8dd9b700 1 -- 172.21.15.1:0/6597989 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7800e710 con 0x7f4a7c004690 2023-11-15T02:55:45.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.348+0000 7f4a8dd9b700 1 -- 172.21.15.1:0/6597989 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7800ea90 con 0x7f4a7c004690 2023-11-15T02:55:45.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.348+0000 7f4a9496b700 1 -- 172.21.15.1:0/6597989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7c004690 msgr2=0x7f4a7c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:45.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.348+0000 7f4a9496b700 1 --2- 172.21.15.1:0/6597989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7c004690 0x7f4a7c004b10 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7f4a78009c30 tx=0x7f4a78009060).stop 2023-11-15T02:55:45.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.348+0000 7f4a9496b700 1 -- 172.21.15.1:0/6597989 shutdown_connections 2023-11-15T02:55:45.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.348+0000 7f4a9496b700 1 --2- 172.21.15.1:0/6597989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7c004690 0x7f4a7c004b10 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.348+0000 7f4a9496b700 1 -- 172.21.15.1:0/6597989 >> 172.21.15.1:0/6597989 conn(0x7f4a90069ee0 msgr2=0x7f4a9006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:45.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.348+0000 7f4a9496b700 1 -- 172.21.15.1:0/6597989 shutdown_connections 2023-11-15T02:55:45.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.348+0000 7f4a9496b700 1 -- 172.21.15.1:0/6597989 wait complete. 2023-11-15T02:55:45.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.349+0000 7f4a9496b700 1 Processor -- start 2023-11-15T02:55:45.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.349+0000 7f4a9496b700 1 -- start start 2023-11-15T02:55:45.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a9496b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7c004690 0x7f4a900c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:45.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a9496b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4a900c3190 0x7f4a90148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:45.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a9496b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4a90148b10 0x7f4a9014ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:45.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a9496b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a90148f50 con 0x7f4a7c004690 2023-11-15T02:55:45.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a9496b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a900c3690 con 0x7f4a90148b10 2023-11-15T02:55:45.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a9496b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a900c3970 con 0x7f4a900c3190 2023-11-15T02:55:45.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a8ed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7c004690 0x7f4a900c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:45.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a8ed9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7c004690 0x7f4a900c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52910/0 (socket says 172.21.15.1:52910) 2023-11-15T02:55:45.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a8ed9d700 1 -- 172.21.15.1:0/103360676 learned_addr learned my addr 172.21.15.1:0/103360676 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:45.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a8f59e700 1 --2- 172.21.15.1:0/103360676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4a90148b10 0x7f4a9014ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:45.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a8e59c700 1 --2- 172.21.15.1:0/103360676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4a900c3190 0x7f4a90148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:45.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a8ed9d700 1 -- 172.21.15.1:0/103360676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4a900c3190 msgr2=0x7f4a90148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:45.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a8ed9d700 1 --2- 172.21.15.1:0/103360676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4a900c3190 0x7f4a90148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a8ed9d700 1 -- 172.21.15.1:0/103360676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4a90148b10 msgr2=0x7f4a9014ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:45.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a8ed9d700 1 --2- 172.21.15.1:0/103360676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4a90148b10 0x7f4a9014ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.350+0000 7f4a8ed9d700 1 -- 172.21.15.1:0/103360676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a900c3c50 con 0x7f4a7c004690 2023-11-15T02:55:45.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.351+0000 7f4a8ed9d700 1 --2- 172.21.15.1:0/103360676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7c004690 0x7f4a900c4710 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7f4a8000e830 tx=0x7f4a80007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:45.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.351+0000 7f4a86ffd700 1 -- 172.21.15.1:0/103360676 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a80012590 con 0x7f4a7c004690 2023-11-15T02:55:45.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.351+0000 7f4a86ffd700 1 -- 172.21.15.1:0/103360676 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a800126f0 con 0x7f4a7c004690 2023-11-15T02:55:45.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.351+0000 7f4a9496b700 1 -- 172.21.15.1:0/103360676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a900c3f30 con 0x7f4a7c004690 2023-11-15T02:55:45.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.351+0000 7f4a86ffd700 1 -- 172.21.15.1:0/103360676 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a80012a70 con 0x7f4a7c004690 2023-11-15T02:55:45.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.351+0000 7f4a9496b700 1 -- 172.21.15.1:0/103360676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9014b200 con 0x7f4a7c004690 2023-11-15T02:55:45.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.352+0000 7f4a9496b700 1 -- 172.21.15.1:0/103360676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a900c43d0 con 0x7f4a7c004690 2023-11-15T02:55:45.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.352+0000 7f4a86ffd700 1 -- 172.21.15.1:0/103360676 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4a8001d460 con 0x7f4a7c004690 2023-11-15T02:55:45.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.352+0000 7f4a86ffd700 1 --2- 172.21.15.1:0/103360676 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4a7005f270 0x7f4a70061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:45.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.353+0000 7f4a86ffd700 1 -- 172.21.15.1:0/103360676 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f4a8007a4c0 con 0x7f4a7c004690 2023-11-15T02:55:45.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.353+0000 7f4a8e59c700 1 --2- 172.21.15.1:0/103360676 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4a7005f270 0x7f4a70061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:45.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.353+0000 7f4a8e59c700 1 --2- 172.21.15.1:0/103360676 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4a7005f270 0x7f4a70061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4a78006d50 tx=0x7f4a78019000).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:45.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.357+0000 7f4a86ffd700 1 -- 172.21.15.1:0/103360676 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4a8004b4b0 con 0x7f4a7c004690 2023-11-15T02:55:45.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.532+0000 7f4a9496b700 1 -- 172.21.15.1:0/103360676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4a9014b8a0 con 0x7f4a7c004690 2023-11-15T02:55:45.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.536+0000 7f4a86ffd700 1 -- 172.21.15.1:0/103360676 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4a8004ead0 con 0x7f4a7c004690 2023-11-15T02:55:45.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.538+0000 7f4a9496b700 1 -- 172.21.15.1:0/103360676 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4a7005f270 msgr2=0x7f4a70061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:45.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.538+0000 7f4a9496b700 1 --2- 172.21.15.1:0/103360676 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4a7005f270 0x7f4a70061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4a78006d50 tx=0x7f4a78019000).stop 2023-11-15T02:55:45.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.538+0000 7f4a9496b700 1 -- 172.21.15.1:0/103360676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7c004690 msgr2=0x7f4a900c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:45.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.538+0000 7f4a9496b700 1 --2- 172.21.15.1:0/103360676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7c004690 0x7f4a900c4710 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7f4a8000e830 tx=0x7f4a80007f30).stop 2023-11-15T02:55:45.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.538+0000 7f4a9496b700 1 -- 172.21.15.1:0/103360676 shutdown_connections 2023-11-15T02:55:45.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.538+0000 7f4a9496b700 1 --2- 172.21.15.1:0/103360676 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4a7005f270 0x7f4a70061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.538+0000 7f4a9496b700 1 --2- 172.21.15.1:0/103360676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4a90148b10 0x7f4a9014ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.538+0000 7f4a9496b700 1 --2- 172.21.15.1:0/103360676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7c004690 0x7f4a900c4710 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.538+0000 7f4a9496b700 1 --2- 172.21.15.1:0/103360676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4a900c3190 0x7f4a90148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.538+0000 7f4a9496b700 1 -- 172.21.15.1:0/103360676 >> 172.21.15.1:0/103360676 conn(0x7f4a90069ee0 msgr2=0x7f4a90063550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:45.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.538+0000 7f4a9496b700 1 -- 172.21.15.1:0/103360676 shutdown_connections 2023-11-15T02:55:45.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.538+0000 7f4a9496b700 1 -- 172.21.15.1:0/103360676 wait complete. 2023-11-15T02:55:45.552 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-11-15T02:55:45.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.671+0000 7f045a34c700 1 Processor -- start 2023-11-15T02:55:45.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.671+0000 7f045a34c700 1 -- start start 2023-11-15T02:55:45.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.672+0000 7f045a34c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04541541d0 0x7f04541545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:45.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.672+0000 7f045a34c700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f04540c8170 0x7f04540c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:45.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.672+0000 7f045a34c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0454155830 con 0x7f04540c60d0 2023-11-15T02:55:45.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.672+0000 7f045a34c700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0454158f40 con 0x7f04540c8170 2023-11-15T02:55:45.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.672+0000 7f045a34c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0454154c20 con 0x7f04541541d0 2023-11-15T02:55:45.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.672+0000 7f0459b4b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f04540c8170 0x7f04540c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:45.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.672+0000 7f0459b4b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f04540c8170 0x7f04540c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52912/0 (socket says 172.21.15.1:52912) 2023-11-15T02:55:45.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.672+0000 7f0459b4b700 1 -- 172.21.15.1:0/2043328061 learned_addr learned my addr 172.21.15.1:0/2043328061 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:45.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.672+0000 7f045934a700 1 --2- 172.21.15.1:0/2043328061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04541541d0 0x7f04541545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:45.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.672+0000 7f0459b4b700 1 -- 172.21.15.1:0/2043328061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04541541d0 msgr2=0x7f04541545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:45.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.672+0000 7f0459b4b700 1 --2- 172.21.15.1:0/2043328061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04541541d0 0x7f04541545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.672+0000 7f0459b4b700 1 -- 172.21.15.1:0/2043328061 >> v1:172.21.15.141:6789/0 conn(0x7f04540c60d0 legacy=0x7f04540c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:45.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.672+0000 7f0459b4b700 1 -- 172.21.15.1:0/2043328061 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0454154f00 con 0x7f04540c8170 2023-11-15T02:55:45.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.672+0000 7f045934a700 1 --2- 172.21.15.1:0/2043328061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04541541d0 0x7f04541545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:45.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.673+0000 7f0459b4b700 1 --2- 172.21.15.1:0/2043328061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04540c8170 0x7f04540c6550 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 rx=0x7f0444009f20 tx=0x7f0444009840).ready entity=mon.0 client_cookie=4b55381de25ae68b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:45.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.673+0000 7f0453fff700 1 -- 172.21.15.1:0/2043328061 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044400e070 con 0x7f04540c8170 2023-11-15T02:55:45.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.673+0000 7f0453fff700 1 -- 172.21.15.1:0/2043328061 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044400ba80 con 0x7f04540c8170 2023-11-15T02:55:45.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.673+0000 7f0453fff700 1 -- 172.21.15.1:0/2043328061 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044400be00 con 0x7f04540c8170 2023-11-15T02:55:45.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.673+0000 7f045a34c700 1 -- 172.21.15.1:0/2043328061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04540c8170 msgr2=0x7f04540c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:45.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.673+0000 7f045a34c700 1 --2- 172.21.15.1:0/2043328061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04540c8170 0x7f04540c6550 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 rx=0x7f0444009f20 tx=0x7f0444009840).stop 2023-11-15T02:55:45.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.673+0000 7f045a34c700 1 -- 172.21.15.1:0/2043328061 shutdown_connections 2023-11-15T02:55:45.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.673+0000 7f045a34c700 1 --2- 172.21.15.1:0/2043328061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04541541d0 0x7f04541545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.673+0000 7f045a34c700 1 --2- 172.21.15.1:0/2043328061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04540c8170 0x7f04540c6550 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.673+0000 7f045a34c700 1 -- 172.21.15.1:0/2043328061 >> 172.21.15.1:0/2043328061 conn(0x7f0454069ee0 msgr2=0x7f045406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:45.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.673+0000 7f045a34c700 1 -- 172.21.15.1:0/2043328061 shutdown_connections 2023-11-15T02:55:45.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.673+0000 7f045a34c700 1 -- 172.21.15.1:0/2043328061 wait complete. 2023-11-15T02:55:45.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.674+0000 7f045a34c700 1 Processor -- start 2023-11-15T02:55:45.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.674+0000 7f045a34c700 1 -- start start 2023-11-15T02:55:45.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.675+0000 7f045a34c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04540c60d0 0x7f04540af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:45.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.675+0000 7f045a34c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04540c8170 0x7f04540aa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:45.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.675+0000 7f045a34c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04541541d0 0x7f0454164ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:45.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.675+0000 7f045a34c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04540aaa30 con 0x7f04540c60d0 2023-11-15T02:55:45.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.675+0000 7f045a34c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0454168590 con 0x7f04541541d0 2023-11-15T02:55:45.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.675+0000 7f045a34c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04540af150 con 0x7f04540c8170 2023-11-15T02:55:45.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.675+0000 7f045934a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04540c60d0 0x7f04540af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:45.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.675+0000 7f045934a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04540c60d0 0x7f04540af5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52926/0 (socket says 172.21.15.1:52926) 2023-11-15T02:55:45.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.675+0000 7f045934a700 1 -- 172.21.15.1:0/2847572527 learned_addr learned my addr 172.21.15.1:0/2847572527 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:45.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.676+0000 7f0459b4b700 1 --2- 172.21.15.1:0/2847572527 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04541541d0 0x7f0454164ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:45.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.676+0000 7f0458b49700 1 --2- 172.21.15.1:0/2847572527 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04540c8170 0x7f04540aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:45.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.676+0000 7f045934a700 1 -- 172.21.15.1:0/2847572527 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04540c8170 msgr2=0x7f04540aa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:45.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.676+0000 7f045934a700 1 --2- 172.21.15.1:0/2847572527 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04540c8170 0x7f04540aa540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.676+0000 7f045934a700 1 -- 172.21.15.1:0/2847572527 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04541541d0 msgr2=0x7f0454164ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:45.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.676+0000 7f045934a700 1 --2- 172.21.15.1:0/2847572527 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04541541d0 0x7f0454164ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.676+0000 7f045934a700 1 -- 172.21.15.1:0/2847572527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0444009ae0 con 0x7f04540c60d0 2023-11-15T02:55:45.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.676+0000 7f045934a700 1 --2- 172.21.15.1:0/2847572527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04540c60d0 0x7f04540af5e0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7f044c00d8c0 tx=0x7f044c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:45.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.676+0000 7f04517fa700 1 -- 172.21.15.1:0/2847572527 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c0095b0 con 0x7f04540c60d0 2023-11-15T02:55:45.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.676+0000 7f04517fa700 1 -- 172.21.15.1:0/2847572527 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c009710 con 0x7f04540c60d0 2023-11-15T02:55:45.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.676+0000 7f045a34c700 1 -- 172.21.15.1:0/2847572527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0454165b80 con 0x7f04540c60d0 2023-11-15T02:55:45.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.676+0000 7f04517fa700 1 -- 172.21.15.1:0/2847572527 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c009a90 con 0x7f04540c60d0 2023-11-15T02:55:45.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.676+0000 7f045a34c700 1 -- 172.21.15.1:0/2847572527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04540aeb00 con 0x7f04540c60d0 2023-11-15T02:55:45.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.677+0000 7f045a34c700 1 -- 172.21.15.1:0/2847572527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045414f6c0 con 0x7f04540c60d0 2023-11-15T02:55:45.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.677+0000 7f04517fa700 1 -- 172.21.15.1:0/2847572527 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f044c013480 con 0x7f04540c60d0 2023-11-15T02:55:45.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.678+0000 7f04517fa700 1 --2- 172.21.15.1:0/2847572527 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f044005f270 0x7f0440061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:45.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.678+0000 7f04517fa700 1 -- 172.21.15.1:0/2847572527 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f044c07a240 con 0x7f04540c60d0 2023-11-15T02:55:45.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.678+0000 7f0458b49700 1 --2- 172.21.15.1:0/2847572527 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f044005f270 0x7f0440061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:45.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.678+0000 7f0458b49700 1 --2- 172.21.15.1:0/2847572527 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f044005f270 0x7f0440061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f04540c4d00 tx=0x7f0448009040).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:45.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.682+0000 7f04517fa700 1 -- 172.21.15.1:0/2847572527 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f044c04b230 con 0x7f04540c60d0 2023-11-15T02:55:45.858 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.856+0000 7f045a34c700 1 -- 172.21.15.1:0/2847572527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f04540475e0 con 0x7f04540c60d0 2023-11-15T02:55:45.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.863+0000 7f04517fa700 1 -- 172.21.15.1:0/2847572527 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v45) v1 ==== 120+0+0 (secure 0 0 0) 0x7f044c04e850 con 0x7f04540c60d0 2023-11-15T02:55:45.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.865+0000 7f045a34c700 1 -- 172.21.15.1:0/2847572527 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f044005f270 msgr2=0x7f0440061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:45.867 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.865+0000 7f045a34c700 1 --2- 172.21.15.1:0/2847572527 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f044005f270 0x7f0440061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f04540c4d00 tx=0x7f0448009040).stop 2023-11-15T02:55:45.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.865+0000 7f045a34c700 1 -- 172.21.15.1:0/2847572527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04540c60d0 msgr2=0x7f04540af5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:45.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.865+0000 7f045a34c700 1 --2- 172.21.15.1:0/2847572527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04540c60d0 0x7f04540af5e0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7f044c00d8c0 tx=0x7f044c008040).stop 2023-11-15T02:55:45.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.865+0000 7f045a34c700 1 -- 172.21.15.1:0/2847572527 shutdown_connections 2023-11-15T02:55:45.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.865+0000 7f045a34c700 1 --2- 172.21.15.1:0/2847572527 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f044005f270 0x7f0440061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.868 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.865+0000 7f045a34c700 1 --2- 172.21.15.1:0/2847572527 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04541541d0 0x7f0454164ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.865+0000 7f045a34c700 1 --2- 172.21.15.1:0/2847572527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04540c60d0 0x7f04540af5e0 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.865+0000 7f045a34c700 1 --2- 172.21.15.1:0/2847572527 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04540c8170 0x7f04540aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:45.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.865+0000 7f045a34c700 1 -- 172.21.15.1:0/2847572527 >> 172.21.15.1:0/2847572527 conn(0x7f0454069ee0 msgr2=0x7f045406a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:45.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.865+0000 7f045a34c700 1 -- 172.21.15.1:0/2847572527 shutdown_connections 2023-11-15T02:55:45.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.865+0000 7f045a34c700 1 -- 172.21.15.1:0/2847572527 wait complete. 2023-11-15T02:55:45.879 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-11-15T02:55:45.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.996+0000 7fb80a8a4700 1 Processor -- start 2023-11-15T02:55:45.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.996+0000 7fb80a8a4700 1 -- start start 2023-11-15T02:55:46.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.996+0000 7fb80a8a4700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb804154150 0x7fb804154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:46.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.996+0000 7fb80a8a4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb8040ab1a0 0x7fb804158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:46.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.996+0000 7fb80a8a4700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8040c06f0 con 0x7fb8040aa060 2023-11-15T02:55:46.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.996+0000 7fb80a8a4700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8040c09d0 con 0x7fb8040ab1a0 2023-11-15T02:55:46.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.996+0000 7fb80a8a4700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb804158820 con 0x7fb804154150 2023-11-15T02:55:46.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.997+0000 7fb8037fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb8040ab1a0 0x7fb804158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.997+0000 7fb8037fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb8040ab1a0 0x7fb804158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52928/0 (socket says 172.21.15.1:52928) 2023-11-15T02:55:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.997+0000 7fb8037fe700 1 -- 172.21.15.1:0/2914591843 learned_addr learned my addr 172.21.15.1:0/2914591843 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.997+0000 7fb803fff700 1 --2- 172.21.15.1:0/2914591843 >> v2:172.21.15.141:3300/0 conn(0x7fb804154150 0x7fb804154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.997+0000 7fb8037fe700 1 -- 172.21.15.1:0/2914591843 >> v2:172.21.15.141:3300/0 conn(0x7fb804154150 msgr2=0x7fb804154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.997+0000 7fb8037fe700 1 --2- 172.21.15.1:0/2914591843 >> v2:172.21.15.141:3300/0 conn(0x7fb804154150 0x7fb804154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:46.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.997+0000 7fb8037fe700 1 -- 172.21.15.1:0/2914591843 >> v1:172.21.15.141:6789/0 conn(0x7fb8040aa060 legacy=0x7fb8040c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:46.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.997+0000 7fb8037fe700 1 -- 172.21.15.1:0/2914591843 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb804158b00 con 0x7fb8040ab1a0 2023-11-15T02:55:46.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.997+0000 7fb8037fe700 1 --2- 172.21.15.1:0/2914591843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8040ab1a0 0x7fb804158040 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7fb80406bfb0 tx=0x7fb7f80090f0).ready entity=mon.0 client_cookie=68829ac70af645f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:46.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.997+0000 7fb802ffd700 1 -- 172.21.15.1:0/2914591843 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f800b520 con 0x7fb8040ab1a0 2023-11-15T02:55:46.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.997+0000 7fb802ffd700 1 -- 172.21.15.1:0/2914591843 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f800b680 con 0x7fb8040ab1a0 2023-11-15T02:55:46.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.997+0000 7fb802ffd700 1 -- 172.21.15.1:0/2914591843 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f800ba20 con 0x7fb8040ab1a0 2023-11-15T02:55:46.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.998+0000 7fb80a8a4700 1 -- 172.21.15.1:0/2914591843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8040ab1a0 msgr2=0x7fb804158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:46.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.998+0000 7fb80a8a4700 1 --2- 172.21.15.1:0/2914591843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8040ab1a0 0x7fb804158040 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7fb80406bfb0 tx=0x7fb7f80090f0).stop 2023-11-15T02:55:46.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.998+0000 7fb80a8a4700 1 -- 172.21.15.1:0/2914591843 shutdown_connections 2023-11-15T02:55:46.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.998+0000 7fb80a8a4700 1 --2- 172.21.15.1:0/2914591843 >> v2:172.21.15.141:3300/0 conn(0x7fb804154150 0x7fb804154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:46.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.998+0000 7fb80a8a4700 1 --2- 172.21.15.1:0/2914591843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8040ab1a0 0x7fb804158040 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:46.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.998+0000 7fb80a8a4700 1 -- 172.21.15.1:0/2914591843 >> 172.21.15.1:0/2914591843 conn(0x7fb804064aa0 msgr2=0x7fb804064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:46.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.998+0000 7fb80a8a4700 1 -- 172.21.15.1:0/2914591843 shutdown_connections 2023-11-15T02:55:46.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.998+0000 7fb80a8a4700 1 -- 172.21.15.1:0/2914591843 wait complete. 2023-11-15T02:55:46.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.999+0000 7fb80a8a4700 1 Processor -- start 2023-11-15T02:55:46.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:45.999+0000 7fb80a8a4700 1 -- start start 2023-11-15T02:55:46.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb80a8a4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8040aa060 0x7fb804154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:46.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb80a8a4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8040ab1a0 0x7fb8041429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:46.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb80a8a4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb804154150 0x7fb8040ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:46.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb80a8a4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb804157630 con 0x7fb8040ab1a0 2023-11-15T02:55:46.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb80a8a4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb804157ac0 con 0x7fb804154150 2023-11-15T02:55:46.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb80a8a4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb804156a20 con 0x7fb8040aa060 2023-11-15T02:55:46.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb8037fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8040ab1a0 0x7fb8041429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:46.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb8037fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8040ab1a0 0x7fb8041429b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52932/0 (socket says 172.21.15.1:52932) 2023-11-15T02:55:46.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb8037fe700 1 -- 172.21.15.1:0/3381447963 learned_addr learned my addr 172.21.15.1:0/3381447963 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:46.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb803fff700 1 --2- 172.21.15.1:0/3381447963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8040aa060 0x7fb804154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:46.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb808e41700 1 --2- 172.21.15.1:0/3381447963 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb804154150 0x7fb8040ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:46.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb8037fe700 1 -- 172.21.15.1:0/3381447963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8040aa060 msgr2=0x7fb804154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb8037fe700 1 --2- 172.21.15.1:0/3381447963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8040aa060 0x7fb804154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb8037fe700 1 -- 172.21.15.1:0/3381447963 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb804154150 msgr2=0x7fb8040ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb8037fe700 1 --2- 172.21.15.1:0/3381447963 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb804154150 0x7fb8040ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb8037fe700 1 -- 172.21.15.1:0/3381447963 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f8009370 con 0x7fb8040ab1a0 2023-11-15T02:55:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.000+0000 7fb8037fe700 1 --2- 172.21.15.1:0/3381447963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8040ab1a0 0x7fb8041429b0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 rx=0x7fb804062af0 tx=0x7fb7f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:46.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.001+0000 7fb7ebfff700 1 -- 172.21.15.1:0/3381447963 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8006d90 con 0x7fb8040ab1a0 2023-11-15T02:55:46.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.001+0000 7fb7ebfff700 1 -- 172.21.15.1:0/3381447963 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f8000bc0 con 0x7fb8040ab1a0 2023-11-15T02:55:46.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.001+0000 7fb80a8a4700 1 -- 172.21.15.1:0/3381447963 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb804156d00 con 0x7fb8040ab1a0 2023-11-15T02:55:46.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.001+0000 7fb7ebfff700 1 -- 172.21.15.1:0/3381447963 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f801c420 con 0x7fb8040ab1a0 2023-11-15T02:55:46.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.001+0000 7fb80a8a4700 1 -- 172.21.15.1:0/3381447963 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8041572c0 con 0x7fb8040ab1a0 2023-11-15T02:55:46.012 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.002+0000 7fb80a8a4700 1 -- 172.21.15.1:0/3381447963 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80406c7e0 con 0x7fb8040ab1a0 2023-11-15T02:55:46.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.002+0000 7fb7ebfff700 1 -- 172.21.15.1:0/3381447963 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb7f801c7d0 con 0x7fb8040ab1a0 2023-11-15T02:55:46.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.002+0000 7fb7ebfff700 1 --2- 172.21.15.1:0/3381447963 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb7f005f270 0x7fb7f0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:46.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.002+0000 7fb7ebfff700 1 -- 172.21.15.1:0/3381447963 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7fb7f807bf40 con 0x7fb8040ab1a0 2023-11-15T02:55:46.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.003+0000 7fb803fff700 1 --2- 172.21.15.1:0/3381447963 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb7f005f270 0x7fb7f0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:46.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.003+0000 7fb803fff700 1 --2- 172.21.15.1:0/3381447963 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb7f005f270 0x7fb7f0061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb7f4009b90 tx=0x7fb7f4009060).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:46.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.007+0000 7fb7ebfff700 1 -- 172.21.15.1:0/3381447963 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb7f804cf90 con 0x7fb8040ab1a0 2023-11-15T02:55:46.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:46.246+0000 7fb80a8a4700 1 -- 172.21.15.1:0/3381447963 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7fb8041539a0 con 0x7fb8040ab1a0 2023-11-15T02:55:47.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:47.206+0000 7fb7ebfff700 1 -- 172.21.15.1:0/3381447963 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3043) v1 ==== 155+0+0 (secure 0 0 0) 0x7fb7f802a070 con 0x7fb8040ab1a0 2023-11-15T02:55:47.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:47.208+0000 7fb80a8a4700 1 -- 172.21.15.1:0/3381447963 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb7f005f270 msgr2=0x7fb7f0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:47.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:47.208+0000 7fb80a8a4700 1 --2- 172.21.15.1:0/3381447963 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb7f005f270 0x7fb7f0061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb7f4009b90 tx=0x7fb7f4009060).stop 2023-11-15T02:55:47.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:47.208+0000 7fb80a8a4700 1 -- 172.21.15.1:0/3381447963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8040ab1a0 msgr2=0x7fb8041429b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:47.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:47.208+0000 7fb80a8a4700 1 --2- 172.21.15.1:0/3381447963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8040ab1a0 0x7fb8041429b0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 rx=0x7fb804062af0 tx=0x7fb7f8017000).stop 2023-11-15T02:55:47.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:47.208+0000 7fb80a8a4700 1 -- 172.21.15.1:0/3381447963 shutdown_connections 2023-11-15T02:55:47.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:47.208+0000 7fb80a8a4700 1 --2- 172.21.15.1:0/3381447963 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb7f005f270 0x7fb7f0061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:47.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:47.208+0000 7fb80a8a4700 1 --2- 172.21.15.1:0/3381447963 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb804154150 0x7fb8040ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:47.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:47.208+0000 7fb80a8a4700 1 --2- 172.21.15.1:0/3381447963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8040aa060 0x7fb804154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:47.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:47.208+0000 7fb80a8a4700 1 --2- 172.21.15.1:0/3381447963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8040ab1a0 0x7fb8041429b0 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:47.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:47.208+0000 7fb80a8a4700 1 -- 172.21.15.1:0/3381447963 >> 172.21.15.1:0/3381447963 conn(0x7fb804064aa0 msgr2=0x7fb804153120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:47.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:47.209+0000 7fb80a8a4700 1 -- 172.21.15.1:0/3381447963 shutdown_connections 2023-11-15T02:55:47.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:47.209+0000 7fb80a8a4700 1 -- 172.21.15.1:0/3381447963 wait complete. 2023-11-15T02:55:47.224 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-11-15T02:55:47.225 INFO:tasks.cephfs_test_runner: 2023-11-15T02:55:47.225 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-15T02:55:47.226 INFO:tasks.cephfs_test_runner:Ran 11 tests in 5620.483s 2023-11-15T02:55:47.226 INFO:tasks.cephfs_test_runner: 2023-11-15T02:55:47.226 INFO:tasks.cephfs_test_runner:OK 2023-11-15T02:55:47.227 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-15T02:55:47.236 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-15T02:55:47.245 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-15T02:55:47.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:47.246 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T02:55:47.263 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-15T02:55:47.263 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-15T02:55:47.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:47.264 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-15T02:55:47.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:47.341 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-15T02:55:47.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:47.417 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2023-11-15T02:55:47.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:47.515 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-11-15T02:55:47.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:47.533 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2023-11-15T02:55:47.600 INFO:teuthology.orchestra.run.smithi001.stderr:Cannot find device "ceph-brx" 2023-11-15T02:55:47.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-15T02:55:47.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:47.602 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list 2023-11-15T02:55:47.621 INFO:teuthology.orchestra.run.smithi141.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-15T02:55:47.621 INFO:teuthology.orchestra.run.smithi141.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-15T02:55:47.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:47.622 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-15T02:55:47.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:47.704 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-15T02:55:47.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:47.787 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link delete ceph-brx 2023-11-15T02:55:47.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:47.883 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list 2023-11-15T02:55:47.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-15T02:55:47.899 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link delete ceph-brx 2023-11-15T02:55:47.967 INFO:teuthology.orchestra.run.smithi141.stderr:Cannot find device "ceph-brx" 2023-11-15T02:55:47.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-15T02:55:47.969 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-15T02:55:47.979 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-11-15T02:55:47.979 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:55:48.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.102+0000 7efe27068700 1 Processor -- start 2023-11-15T02:55:48.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.102+0000 7efe27068700 1 -- start start 2023-11-15T02:55:48.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.103+0000 7efe27068700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efe20154560 0x7efe200c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.103+0000 7efe27068700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe20064e80 con 0x7efe20158000 2023-11-15T02:55:48.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.103+0000 7efe27068700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe201585e0 con 0x7efe20154180 2023-11-15T02:55:48.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.103+0000 7efe27068700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe201588c0 con 0x7efe20154560 2023-11-15T02:55:48.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.103+0000 7efe1ffff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7efe20158000 0x7efe200aa640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37172/0 (socket says 172.21.15.1:37172) 2023-11-15T02:55:48.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.103+0000 7efe1ffff700 1 -- 172.21.15.1:0/1665596583 learned_addr learned my addr 172.21.15.1:0/1665596583 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:48.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.103+0000 7efe25605700 1 --2- 172.21.15.1:0/1665596583 >> v2:172.21.15.141:3300/0 conn(0x7efe20154560 0x7efe200c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.103+0000 7efe1f7fe700 1 -- 172.21.15.1:0/1665596583 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215246720 0 0) 0x7efe20064e80 con 0x7efe20158000 2023-11-15T02:55:48.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.103+0000 7efe1f7fe700 1 -- 172.21.15.1:0/1665596583 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe0c0033f0 con 0x7efe20158000 2023-11-15T02:55:48.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.103+0000 7efe1f7fe700 1 -- 172.21.15.1:0/1665596583 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 603857706 0 0) 0x7efe0c0033f0 con 0x7efe20158000 2023-11-15T02:55:48.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.103+0000 7efe1f7fe700 1 -- 172.21.15.1:0/1665596583 >> v2:172.21.15.141:3300/0 conn(0x7efe20154560 msgr2=0x7efe200c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:48.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.103+0000 7efe1f7fe700 1 --2- 172.21.15.1:0/1665596583 >> v2:172.21.15.141:3300/0 conn(0x7efe20154560 0x7efe200c1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.103+0000 7efe1f7fe700 1 -- 172.21.15.1:0/1665596583 >> v1:172.21.15.141:6789/0 conn(0x7efe20154180 legacy=0x7efe20063bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe1f7fe700 1 -- 172.21.15.1:0/1665596583 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe20158ba0 con 0x7efe20158000 2023-11-15T02:55:48.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe1f7fe700 1 -- 172.21.15.1:0/1665596583 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7efe100017f0 con 0x7efe20158000 2023-11-15T02:55:48.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe1f7fe700 1 -- 172.21.15.1:0/1665596583 >> v1:172.21.15.1:6789/0 conn(0x7efe20158000 legacy=0x7efe200aa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe1f7fe700 1 --2- 172.21.15.1:0/1665596583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe0c0038e0 0x7efe0c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe1f7fe700 1 --2- 172.21.15.1:0/1665596583 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe0c004690 0x7efe0c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe1f7fe700 1 --2- 172.21.15.1:0/1665596583 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe0c005000 0x7efe0c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe1f7fe700 1 -- 172.21.15.1:0/1665596583 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe201588c0 con 0x7efe0c0038e0 2023-11-15T02:55:48.118 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe1f7fe700 1 -- 172.21.15.1:0/1665596583 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c00beb0 con 0x7efe0c004690 2023-11-15T02:55:48.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe1f7fe700 1 -- 172.21.15.1:0/1665596583 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c00c070 con 0x7efe0c005000 2023-11-15T02:55:48.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe24e04700 1 --2- 172.21.15.1:0/1665596583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe0c0038e0 0x7efe0c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe1ffff700 1 --2- 172.21.15.1:0/1665596583 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe0c004690 0x7efe0c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe25605700 1 --2- 172.21.15.1:0/1665596583 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe0c005000 0x7efe0c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe24e04700 1 -- 172.21.15.1:0/1665596583 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe0c005000 msgr2=0x7efe0c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:48.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe24e04700 1 --2- 172.21.15.1:0/1665596583 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe0c005000 0x7efe0c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe24e04700 1 -- 172.21.15.1:0/1665596583 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe0c004690 msgr2=0x7efe0c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:48.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe24e04700 1 --2- 172.21.15.1:0/1665596583 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe0c004690 0x7efe0c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe24e04700 1 -- 172.21.15.1:0/1665596583 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c0033f0 con 0x7efe0c0038e0 2023-11-15T02:55:48.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe25605700 1 -- 172.21.15.1:0/1665596583 reap_dead start 2023-11-15T02:55:48.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe24e04700 1 --2- 172.21.15.1:0/1665596583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe0c0038e0 0x7efe0c003cc0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 rx=0x7efe18001820 tx=0x7efe18007b90).ready entity=mon.0 client_cookie=bc5fc52475937877 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:48.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe1f7fe700 1 -- 172.21.15.1:0/1665596583 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe18007ea0 con 0x7efe0c0038e0 2023-11-15T02:55:48.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe1f7fe700 1 -- 172.21.15.1:0/1665596583 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe18012400 con 0x7efe0c0038e0 2023-11-15T02:55:48.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.104+0000 7efe1f7fe700 1 -- 172.21.15.1:0/1665596583 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe180127a0 con 0x7efe0c0038e0 2023-11-15T02:55:48.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.105+0000 7efe27068700 1 -- 172.21.15.1:0/1665596583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe0c0038e0 msgr2=0x7efe0c003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.105+0000 7efe27068700 1 --2- 172.21.15.1:0/1665596583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe0c0038e0 0x7efe0c003cc0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 rx=0x7efe18001820 tx=0x7efe18007b90).stop 2023-11-15T02:55:48.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.105+0000 7efe27068700 1 -- 172.21.15.1:0/1665596583 shutdown_connections 2023-11-15T02:55:48.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.105+0000 7efe27068700 1 --2- 172.21.15.1:0/1665596583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe0c0038e0 0x7efe0c003cc0 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.105+0000 7efe27068700 1 -- 172.21.15.1:0/1665596583 >> 172.21.15.1:0/1665596583 conn(0x7efe200c74f0 msgr2=0x7efe200c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:48.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.105+0000 7efe27068700 1 -- 172.21.15.1:0/1665596583 shutdown_connections 2023-11-15T02:55:48.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.105+0000 7efe27068700 1 -- 172.21.15.1:0/1665596583 wait complete. 2023-11-15T02:55:48.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.106+0000 7efe27068700 1 Processor -- start 2023-11-15T02:55:48.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.106+0000 7efe27068700 1 -- start start 2023-11-15T02:55:48.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.107+0000 7efe27068700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe0c0038e0 0x7efe20151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.107+0000 7efe27068700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe20157490 0x7efe200a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.107+0000 7efe27068700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe200a6680 0x7efe200aa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.107+0000 7efe27068700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe200a75b0 con 0x7efe200a6680 2023-11-15T02:55:48.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.107+0000 7efe27068700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe20151d80 con 0x7efe0c0038e0 2023-11-15T02:55:48.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.107+0000 7efe27068700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe200a6ff0 con 0x7efe20157490 2023-11-15T02:55:48.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.107+0000 7efe25605700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe200a6680 0x7efe200aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.107+0000 7efe25605700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe200a6680 0x7efe200aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43432/0 (socket says 172.21.15.1:43432) 2023-11-15T02:55:48.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.107+0000 7efe25605700 1 -- 172.21.15.1:0/1473350257 learned_addr learned my addr 172.21.15.1:0/1473350257 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:48.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.108+0000 7efe24e04700 1 --2- 172.21.15.1:0/1473350257 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe0c0038e0 0x7efe20151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.108+0000 7efe1ffff700 1 --2- 172.21.15.1:0/1473350257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe20157490 0x7efe200a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.108+0000 7efe25605700 1 -- 172.21.15.1:0/1473350257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe20157490 msgr2=0x7efe200a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.108+0000 7efe25605700 1 --2- 172.21.15.1:0/1473350257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe20157490 0x7efe200a56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.108+0000 7efe25605700 1 -- 172.21.15.1:0/1473350257 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe0c0038e0 msgr2=0x7efe20151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.108+0000 7efe25605700 1 --2- 172.21.15.1:0/1473350257 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe0c0038e0 0x7efe20151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.108+0000 7efe25605700 1 -- 172.21.15.1:0/1473350257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe200a72d0 con 0x7efe200a6680 2023-11-15T02:55:48.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.108+0000 7efe1ffff700 1 --2- 172.21.15.1:0/1473350257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe20157490 0x7efe200a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:48.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.108+0000 7efe25605700 1 --2- 172.21.15.1:0/1473350257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe200a6680 0x7efe200aa570 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 rx=0x7efe200c8010 tx=0x7efe08009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:48.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.108+0000 7efe1cff9700 1 -- 172.21.15.1:0/1473350257 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0800f700 con 0x7efe200a6680 2023-11-15T02:55:48.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.108+0000 7efe1cff9700 1 -- 172.21.15.1:0/1473350257 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0800f860 con 0x7efe200a6680 2023-11-15T02:55:48.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.108+0000 7efe27068700 1 -- 172.21.15.1:0/1473350257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe200a4ef0 con 0x7efe200a6680 2023-11-15T02:55:48.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.108+0000 7efe1cff9700 1 -- 172.21.15.1:0/1473350257 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0800fc00 con 0x7efe200a6680 2023-11-15T02:55:48.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.108+0000 7efe27068700 1 -- 172.21.15.1:0/1473350257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe200a5be0 con 0x7efe200a6680 2023-11-15T02:55:48.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.109+0000 7efe27068700 1 -- 172.21.15.1:0/1473350257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe200a4d50 con 0x7efe200a6680 2023-11-15T02:55:48.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.109+0000 7efe1cff9700 1 -- 172.21.15.1:0/1473350257 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7efe0801f460 con 0x7efe200a6680 2023-11-15T02:55:48.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.110+0000 7efe1cff9700 1 --2- 172.21.15.1:0/1473350257 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7efe0005f240 0x7efe00061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.110+0000 7efe1cff9700 1 -- 172.21.15.1:0/1473350257 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7efe0807aa20 con 0x7efe200a6680 2023-11-15T02:55:48.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.110+0000 7efe24e04700 1 --2- 172.21.15.1:0/1473350257 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7efe0005f240 0x7efe00061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.110+0000 7efe24e04700 1 --2- 172.21.15.1:0/1473350257 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7efe0005f240 0x7efe00061700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7efe180015b0 tx=0x7efe18016000).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:48.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.114+0000 7efe1cff9700 1 -- 172.21.15.1:0/1473350257 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efe200a4d50 con 0x7efe200a6680 2023-11-15T02:55:48.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.290+0000 7efe27068700 1 -- 172.21.15.1:0/1473350257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe200a4d50 con 0x7efe200a6680 2023-11-15T02:55:48.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.291+0000 7efe1cff9700 1 -- 172.21.15.1:0/1473350257 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v218) v1 ==== 74+0+15346 (secure 0 0 0) 0x7efe200a4d50 con 0x7efe200a6680 2023-11-15T02:55:48.293 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:48.293 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":218,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:55:45.198824+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"216","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:6835/1145495775":"2023-11-16T02:55:41.335814+0000","172.21.15.141:0/3972018425":"2023-11-16T02:55:41.176674+0000","172.21.15.141:0/1164679632":"2023-11-16T02:55:41.176674+0000","172.21.15.141:0/3133295023":"2023-11-16T02:55:41.176674+0000","172.21.15.141:0/49188968":"2023-11-16T02:55:41.176674+0000","172.21.15.141:6837/1145495775":"2023-11-16T02:55:41.335814+0000","172.21.15.141:0/3942885922":"2023-11-16T02:55:41.176674+0000","172.21.15.141:0/1187088985":"2023-11-16T02:55:33.841413+0000","172.21.15.141:6833/103755":"2023-11-16T02:55:33.841413+0000","172.21.15.141:6832/103755":"2023-11-16T02:55:33.841413+0000","172.21.15.141:0/2020531998":"2023-11-16T02:55:33.841413+0000","172.21.15.141:0/2287874460":"2023-11-16T02:55:33.841413+0000","172.21.15.141:0/2718331164":"2023-11-16T02:55:33.841413+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:55:48.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.293+0000 7efe27068700 1 -- 172.21.15.1:0/1473350257 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7efe0005f240 msgr2=0x7efe00061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.293+0000 7efe27068700 1 --2- 172.21.15.1:0/1473350257 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7efe0005f240 0x7efe00061700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7efe180015b0 tx=0x7efe18016000).stop 2023-11-15T02:55:48.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.293+0000 7efe27068700 1 -- 172.21.15.1:0/1473350257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe200a6680 msgr2=0x7efe200aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.293+0000 7efe27068700 1 --2- 172.21.15.1:0/1473350257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe200a6680 0x7efe200aa570 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 rx=0x7efe200c8010 tx=0x7efe08009060).stop 2023-11-15T02:55:48.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.293+0000 7efe27068700 1 -- 172.21.15.1:0/1473350257 shutdown_connections 2023-11-15T02:55:48.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.293+0000 7efe27068700 1 --2- 172.21.15.1:0/1473350257 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7efe0005f240 0x7efe00061700 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.293+0000 7efe27068700 1 --2- 172.21.15.1:0/1473350257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe200a6680 0x7efe200aa570 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.293+0000 7efe27068700 1 --2- 172.21.15.1:0/1473350257 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efe0c0038e0 0x7efe20151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.293+0000 7efe27068700 1 --2- 172.21.15.1:0/1473350257 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efe20157490 0x7efe200a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.293+0000 7efe27068700 1 -- 172.21.15.1:0/1473350257 >> 172.21.15.1:0/1473350257 conn(0x7efe200c74f0 msgr2=0x7efe200c42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:48.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.293+0000 7efe27068700 1 -- 172.21.15.1:0/1473350257 shutdown_connections 2023-11-15T02:55:48.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.293+0000 7efe27068700 1 -- 172.21.15.1:0/1473350257 wait complete. 2023-11-15T02:55:48.307 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-15T02:55:48.307 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:55:48.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.423+0000 7f5aff606700 1 Processor -- start 2023-11-15T02:55:48.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.423+0000 7f5aff606700 1 -- start start 2023-11-15T02:55:48.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.424+0000 7f5aff606700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5af8154150 0x7f5af8154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.424+0000 7f5aff606700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5af80ab1a0 0x7f5af8158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.424+0000 7f5aff606700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5af80aa060 0x7f5af80c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.424+0000 7f5aff606700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af80c06f0 con 0x7f5af8154150 2023-11-15T02:55:48.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.424+0000 7f5aff606700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af80c09d0 con 0x7f5af80ab1a0 2023-11-15T02:55:48.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.424+0000 7f5aff606700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8158820 con 0x7f5af80aa060 2023-11-15T02:55:48.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.424+0000 7f5afd3a2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5af8154150 0x7f5af8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.424+0000 7f5afd3a2700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5af8154150 0x7f5af8154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43440/0 (socket says 172.21.15.1:43440) 2023-11-15T02:55:48.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.424+0000 7f5afd3a2700 1 -- 172.21.15.1:0/4255092723 learned_addr learned my addr 172.21.15.1:0/4255092723 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:48.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.424+0000 7f5afcba1700 1 --2- 172.21.15.1:0/4255092723 >> v2:172.21.15.141:3300/0 conn(0x7f5af80ab1a0 0x7f5af8158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.424+0000 7f5afdba3700 1 --2- 172.21.15.1:0/4255092723 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5af80aa060 0x7f5af80c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5afd3a2700 1 -- 172.21.15.1:0/4255092723 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5af80aa060 msgr2=0x7f5af80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:48.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5afd3a2700 1 --2- 172.21.15.1:0/4255092723 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5af80aa060 0x7f5af80c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5afd3a2700 1 -- 172.21.15.1:0/4255092723 >> v2:172.21.15.141:3300/0 conn(0x7f5af80ab1a0 msgr2=0x7f5af8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:48.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5afd3a2700 1 --2- 172.21.15.1:0/4255092723 >> v2:172.21.15.141:3300/0 conn(0x7f5af80ab1a0 0x7f5af8158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5afd3a2700 1 -- 172.21.15.1:0/4255092723 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af8158b00 con 0x7f5af8154150 2023-11-15T02:55:48.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5afd3a2700 1 --2- 172.21.15.1:0/4255092723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5af8154150 0x7f5af8154530 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7f5af80c0270 tx=0x7f5af00090f0).ready entity=mon.0 client_cookie=381cd69efa2a23e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:48.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5af7fff700 1 -- 172.21.15.1:0/4255092723 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000f510 con 0x7f5af8154150 2023-11-15T02:55:48.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5af7fff700 1 -- 172.21.15.1:0/4255092723 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af000f670 con 0x7f5af8154150 2023-11-15T02:55:48.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5af7fff700 1 -- 172.21.15.1:0/4255092723 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000fa10 con 0x7f5af8154150 2023-11-15T02:55:48.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5aff606700 1 -- 172.21.15.1:0/4255092723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5af8154150 msgr2=0x7f5af8154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5aff606700 1 --2- 172.21.15.1:0/4255092723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5af8154150 0x7f5af8154530 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7f5af80c0270 tx=0x7f5af00090f0).stop 2023-11-15T02:55:48.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5aff606700 1 -- 172.21.15.1:0/4255092723 shutdown_connections 2023-11-15T02:55:48.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5aff606700 1 --2- 172.21.15.1:0/4255092723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5af8154150 0x7f5af8154530 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5aff606700 1 --2- 172.21.15.1:0/4255092723 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5af80aa060 0x7f5af80c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5aff606700 1 --2- 172.21.15.1:0/4255092723 >> v2:172.21.15.141:3300/0 conn(0x7f5af80ab1a0 0x7f5af8158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.425+0000 7f5aff606700 1 -- 172.21.15.1:0/4255092723 >> 172.21.15.1:0/4255092723 conn(0x7f5af8064aa0 msgr2=0x7f5af8064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:48.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.426+0000 7f5aff606700 1 -- 172.21.15.1:0/4255092723 shutdown_connections 2023-11-15T02:55:48.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.426+0000 7f5aff606700 1 -- 172.21.15.1:0/4255092723 wait complete. 2023-11-15T02:55:48.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.427+0000 7f5aff606700 1 Processor -- start 2023-11-15T02:55:48.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.427+0000 7f5aff606700 1 -- start start 2023-11-15T02:55:48.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5aff606700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5af80aa060 0x7f5af80c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5aff606700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5af80ab1a0 0x7f5af814c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5aff606700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5af8154150 0x7f5af80cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5aff606700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80c3380 con 0x7f5af80aa060 2023-11-15T02:55:48.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5aff606700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80c3660 con 0x7f5af8154150 2023-11-15T02:55:48.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5aff606700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80c3940 con 0x7f5af80ab1a0 2023-11-15T02:55:48.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5afd3a2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5af80aa060 0x7f5af80c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5afd3a2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5af80aa060 0x7f5af80c2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43450/0 (socket says 172.21.15.1:43450) 2023-11-15T02:55:48.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5afd3a2700 1 -- 172.21.15.1:0/1953641012 learned_addr learned my addr 172.21.15.1:0/1953641012 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:48.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5afcba1700 1 --2- 172.21.15.1:0/1953641012 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5af80ab1a0 0x7f5af814c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5afd3a2700 1 -- 172.21.15.1:0/1953641012 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5af80ab1a0 msgr2=0x7f5af814c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5afdba3700 1 --2- 172.21.15.1:0/1953641012 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5af8154150 0x7f5af80cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5afd3a2700 1 --2- 172.21.15.1:0/1953641012 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5af80ab1a0 0x7f5af814c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5afd3a2700 1 -- 172.21.15.1:0/1953641012 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5af8154150 msgr2=0x7f5af80cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5afd3a2700 1 --2- 172.21.15.1:0/1953641012 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5af8154150 0x7f5af80cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5afd3a2700 1 -- 172.21.15.1:0/1953641012 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af0009370 con 0x7f5af80aa060 2023-11-15T02:55:48.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5afd3a2700 1 --2- 172.21.15.1:0/1953641012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5af80aa060 0x7f5af80c2a80 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7f5af0006fd0 tx=0x7f5af0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:48.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5af57fa700 1 -- 172.21.15.1:0/1953641012 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000fe00 con 0x7f5af80aa060 2023-11-15T02:55:48.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5af57fa700 1 -- 172.21.15.1:0/1953641012 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af000f7e0 con 0x7f5af80aa060 2023-11-15T02:55:48.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5aff606700 1 -- 172.21.15.1:0/1953641012 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af80c3c20 con 0x7f5af80aa060 2023-11-15T02:55:48.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5af57fa700 1 -- 172.21.15.1:0/1953641012 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af001c440 con 0x7f5af80aa060 2023-11-15T02:55:48.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.428+0000 7f5aff606700 1 -- 172.21.15.1:0/1953641012 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af80c2f70 con 0x7f5af80aa060 2023-11-15T02:55:48.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.429+0000 7f5aff606700 1 -- 172.21.15.1:0/1953641012 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af806c7e0 con 0x7f5af80aa060 2023-11-15T02:55:48.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.430+0000 7f5af57fa700 1 -- 172.21.15.1:0/1953641012 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5af001c7b0 con 0x7f5af80aa060 2023-11-15T02:55:48.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.430+0000 7f5af57fa700 1 --2- 172.21.15.1:0/1953641012 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5ae405f270 0x7f5ae4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.430+0000 7f5af57fa700 1 -- 172.21.15.1:0/1953641012 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f5af007be90 con 0x7f5af80aa060 2023-11-15T02:55:48.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.430+0000 7f5afcba1700 1 --2- 172.21.15.1:0/1953641012 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5ae405f270 0x7f5ae4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.431+0000 7f5afcba1700 1 --2- 172.21.15.1:0/1953641012 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5ae405f270 0x7f5ae4061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5aec009270 tx=0x7f5aec008040).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:48.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.434+0000 7f5af57fa700 1 -- 172.21.15.1:0/1953641012 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5af004cee0 con 0x7f5af80aa060 2023-11-15T02:55:48.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.603+0000 7f5aff606700 1 -- 172.21.15.1:0/1953641012 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5af80c3160 con 0x7f5ae405f270 2023-11-15T02:55:48.609 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.607+0000 7f5af57fa700 1 -- 172.21.15.1:0/1953641012 <== mgr.9370 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71377 (secure 0 0 0) 0x7f5aec009750 con 0x7f5ae405f270 2023-11-15T02:55:48.610 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:48.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.608+0000 7f5aff606700 1 -- 172.21.15.1:0/1953641012 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5ae405f270 msgr2=0x7f5ae4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.608+0000 7f5aff606700 1 --2- 172.21.15.1:0/1953641012 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5ae405f270 0x7f5ae4061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5aec009270 tx=0x7f5aec008040).stop 2023-11-15T02:55:48.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.608+0000 7f5aff606700 1 -- 172.21.15.1:0/1953641012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5af80aa060 msgr2=0x7f5af80c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.608+0000 7f5aff606700 1 --2- 172.21.15.1:0/1953641012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5af80aa060 0x7f5af80c2a80 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7f5af0006fd0 tx=0x7f5af0016000).stop 2023-11-15T02:55:48.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.609+0000 7f5aff606700 1 -- 172.21.15.1:0/1953641012 shutdown_connections 2023-11-15T02:55:48.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.609+0000 7f5aff606700 1 --2- 172.21.15.1:0/1953641012 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5ae405f270 0x7f5ae4061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.609+0000 7f5aff606700 1 --2- 172.21.15.1:0/1953641012 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5af8154150 0x7f5af80cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.609+0000 7f5aff606700 1 --2- 172.21.15.1:0/1953641012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5af80aa060 0x7f5af80c2a80 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.609+0000 7f5aff606700 1 --2- 172.21.15.1:0/1953641012 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5af80ab1a0 0x7f5af814c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.609+0000 7f5aff606700 1 -- 172.21.15.1:0/1953641012 >> 172.21.15.1:0/1953641012 conn(0x7f5af8064aa0 msgr2=0x7f5af80ad420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:48.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.609+0000 7f5aff606700 1 -- 172.21.15.1:0/1953641012 shutdown_connections 2023-11-15T02:55:48.614 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.609+0000 7f5aff606700 1 -- 172.21.15.1:0/1953641012 wait complete. 2023-11-15T02:55:48.614 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:55:48.622 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-11-15T02:55:47.192914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2471528,"kb_used_data":21032,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752503192,"statfs":{"total":773094113280,"available":770563268608,"internally_reserved":0,"allocated":21536768,"data_stored":11541433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14654,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-68,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.997579"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.185221+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:55:41.185221+0000","last_peered":"2023-11-15T02:55:41.185221+0000","last_clean":"2023-11-15T02:55:41.185221+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:55:41.185221+0000","last_undegraded":"2023-11-15T02:55:41.185221+0000","last_fullsized":"2023-11-15T02:55:41.185221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":177,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.229789+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:55:41.229789+0000","last_peered":"2023-11-15T02:55:41.229789+0000","last_clean":"2023-11-15T02:55:41.229789+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:55:41.229789+0000","last_undegraded":"2023-11-15T02:55:41.229789+0000","last_fullsized":"2023-11-15T02:55:41.229789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":188,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.234834+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:55:41.234834+0000","last_peered":"2023-11-15T02:55:41.234834+0000","last_clean":"2023-11-15T02:55:41.234834+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:55:41.234834+0000","last_undegraded":"2023-11-15T02:55:41.234834+0000","last_fullsized":"2023-11-15T02:55:41.234834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":177,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.230014+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:55:41.230014+0000","last_peered":"2023-11-15T02:55:41.230014+0000","last_clean":"2023-11-15T02:55:41.230014+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:55:41.230014+0000","last_undegraded":"2023-11-15T02:55:41.230014+0000","last_fullsized":"2023-11-15T02:55:41.230014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":172,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.189784+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:55:41.189784+0000","last_peered":"2023-11-15T02:55:41.189784+0000","last_clean":"2023-11-15T02:55:41.189784+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:55:41.189784+0000","last_undegraded":"2023-11-15T02:55:41.189784+0000","last_fullsized":"2023-11-15T02:55:41.189784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":170,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.189704+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:55:41.189704+0000","last_peered":"2023-11-15T02:55:41.189704+0000","last_clean":"2023-11-15T02:55:41.189704+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:55:41.189704+0000","last_undegraded":"2023-11-15T02:55:41.189704+0000","last_fullsized":"2023-11-15T02:55:41.189704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":170,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.190175+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:55:41.190175+0000","last_peered":"2023-11-15T02:55:41.190175+0000","last_clean":"2023-11-15T02:55:41.190175+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:55:41.190175+0000","last_undegraded":"2023-11-15T02:55:41.190175+0000","last_fullsized":"2023-11-15T02:55:41.190175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":178,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.186364+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:55:41.186364+0000","last_peered":"2023-11-15T02:55:41.186364+0000","last_clean":"2023-11-15T02:55:41.186364+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:55:41.186364+0000","last_undegraded":"2023-11-15T02:55:41.186364+0000","last_fullsized":"2023-11-15T02:55:41.186364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":201,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.183064+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:55:41.183064+0000","last_peered":"2023-11-15T02:55:41.183064+0000","last_clean":"2023-11-15T02:55:41.183064+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:55:41.183064+0000","last_undegraded":"2023-11-15T02:55:41.183064+0000","last_fullsized":"2023-11-15T02:55:41.183064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575968,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303828,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068012,"statfs":{"total":96636764160,"available":96325644288,"internally_reserved":0,"allocated":2699264,"data_stored":1452034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.66500000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.44},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.82399999999999995},"last":0.51900000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.39400000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75900000000000001,"5min":0.78500000000000003,"15min":0.79200000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.57899999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.749,"5min":0.76300000000000001,"15min":0.82299999999999995},"last":0.36099999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.58299999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.80400000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76500000000000001,"5min":0.82799999999999996,"15min":0.83799999999999997},"last":0.45400000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.88500000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.86699999999999999},"last":0.41699999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.35299999999999998,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.63700000000000001,"5min":0.71699999999999997,"15min":0.749},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.74299999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.498}]},{"osd":5,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.30199999999999999,"15min":0.27300000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.497,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.81999999999999995},"last":0.42799999999999999}]},{"osd":6,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.72399999999999998,"5min":0.78200000000000003,"15min":0.84899999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.28499999999999998},"max":{"1min":0.78400000000000003,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.46500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575969,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307936,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063904,"statfs":{"total":96636764160,"available":96321437696,"internally_reserved":0,"allocated":2711552,"data_stored":1459091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.24099999999999999},"max":{"1min":0.79500000000000004,"5min":0.79700000000000004,"15min":0.92500000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.437,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":1.466,"15min":1.466},"last":0.79000000000000004}]},{"osd":1,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81999999999999995},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78400000000000003,"5min":1.53,"15min":1.53},"last":0.64000000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.36899999999999999,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":1.026,"15min":1.026},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.80200000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.67800000000000005}]},{"osd":3,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.32900000000000001},"max":{"1min":0.71099999999999997,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.81200000000000006,"5min":1.498,"15min":1.498},"last":0.84999999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.61299999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.68400000000000005,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.70799999999999996}]},{"osd":5,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.499,"15min":0.48999999999999999},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65600000000000003,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.624},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.376,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.54500000000000004}]},{"osd":7,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.498,"15min":0.503},"min":{"1min":0.34300000000000003,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.76400000000000001,"5min":1.04,"15min":1.04},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80000000000000004,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.877}]}]},{"osd":1,"up_from":13,"seq":55834575970,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307920,"kb_used_data":2632,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063920,"statfs":{"total":96636764160,"available":96321454080,"internally_reserved":0,"allocated":2695168,"data_stored":1446675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40100000000000002,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.26100000000000001,"15min":0.23999999999999999},"max":{"1min":0.47899999999999998,"5min":1.149,"15min":1.149},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.30499999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.499,"5min":1.044,"15min":1.044},"last":0.33500000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40799999999999997,"15min":0.40699999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51100000000000001,"5min":0.748,"15min":0.748},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46899999999999997,"15min":0.46200000000000002},"min":{"1min":0.313,"5min":0.311,"15min":0.27500000000000002},"max":{"1min":0.58299999999999996,"5min":1.101,"15min":1.101},"last":0.439}]},{"osd":3,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63600000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.504,"15min":0.505},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66200000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.47899999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.40999999999999998,"15min":0.372},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65500000000000003,"15min":0.66200000000000003},"min":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":1.052,"15min":1.081},"last":0.61699999999999999}]},{"osd":5,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.53300000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88600000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73099999999999998,"15min":0.68899999999999995},"min":{"1min":0.498,"5min":0.42999999999999999,"15min":0.42699999999999999},"max":{"1min":0.86499999999999999,"5min":5.7590000000000003,"15min":5.7590000000000003},"last":0.60399999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89300000000000002,"5min":1.089,"15min":1.089},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76800000000000002,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91900000000000004,"5min":5.7930000000000001,"15min":5.7930000000000001},"last":0.64500000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72399999999999998,"15min":0.72699999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88300000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.59699999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85699999999999998,"5min":1.04,"15min":1.04},"last":0.628}]}]},{"osd":0,"up_from":13,"seq":55834575968,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312012,"kb_used_data":2628,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059828,"statfs":{"total":96636764160,"available":96317263872,"internally_reserved":0,"allocated":2691072,"data_stored":1432918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56799999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.432,"15min":0.44},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.58099999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"last":0.36399999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52700000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57099999999999995,"5min":0.72499999999999998,"15min":0.75800000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.58599999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60999999999999999,"5min":1.776,"15min":1.776},"last":0.38}]},{"osd":4,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.72399999999999998,"15min":0.70399999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.40500000000000003},"max":{"1min":1.0129999999999999,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":0.626},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.42699999999999999},"max":{"1min":0.86399999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67500000000000004,"15min":0.65900000000000003},"min":{"1min":0.435,"5min":0.39100000000000001,"15min":0.378},"max":{"1min":0.83399999999999996,"5min":3.766,"15min":3.766},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.877,"5min":0.98399999999999999,"15min":1.028},"last":0.65900000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.52900000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94499999999999995,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.74099999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.40699999999999997},"max":{"1min":0.85399999999999998,"5min":0.97799999999999998,"15min":1.0549999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.47599999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.107},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575969,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316084,"kb_used_data":2604,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055756,"statfs":{"total":96636764160,"available":96313094144,"internally_reserved":0,"allocated":2666496,"data_stored":1431425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.47499999999999998,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.27000000000000002,"15min":0.253},"max":{"1min":0.64000000000000001,"5min":8.5280000000000005,"15min":8.5280000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.26900000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69299999999999995,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.315}]},{"osd":1,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39800000000000002,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.34399999999999997,"5min":0.31,"15min":0.29499999999999998},"max":{"1min":0.66200000000000003,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.40699999999999997}]},{"osd":3,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.621,"5min":0.65900000000000003,"15min":0.70099999999999996},"last":0.376},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54600000000000004,"15min":0.495},"min":{"1min":0.376,"5min":0.32500000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":8.7200000000000006,"15min":8.7200000000000006},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.70799999999999996,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89500000000000002,"5min":8.5890000000000004,"15min":8.5890000000000004},"last":0.495},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64100000000000001,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88800000000000001,"5min":0.97199999999999998,"15min":0.98399999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.66600000000000004},"min":{"1min":0.442,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85399999999999998,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.74299999999999999,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94699999999999995,"5min":8.625,"15min":8.625},"last":0.58999999999999997}]},{"osd":6,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.52200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.89400000000000002,"5min":1.0269999999999999,"15min":1.113},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67700000000000005,"15min":0.70199999999999996},"min":{"1min":0.47299999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.0660000000000001},"last":0.51100000000000001}]},{"osd":7,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69099999999999995,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93500000000000005,"5min":0.995,"15min":1.0680000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.71399999999999997},"min":{"1min":0.505,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91200000000000003,"5min":1.089,"15min":1.1499999999999999},"last":0.56699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575970,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312020,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059820,"statfs":{"total":96636764160,"available":96317255680,"internally_reserved":0,"allocated":2699264,"data_stored":1447387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39000000000000001,"15min":0.39800000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59899999999999998,"5min":0.624,"15min":0.65100000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.41899999999999998},"min":{"1min":0.28100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.55900000000000005,"5min":0.63200000000000001,"15min":0.65800000000000003},"last":0.437}]},{"osd":1,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40000000000000002,"15min":0.41799999999999998},"min":{"1min":0.26700000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.44400000000000001,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.55700000000000005,"5min":0.67100000000000004,"15min":0.76600000000000001},"last":0.36699999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.47299999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63500000000000001,"5min":0.69699999999999995,"15min":0.72299999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.495,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65200000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47099999999999997}]},{"osd":4,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.629,"15min":0.65100000000000002},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":0.71499999999999997,"5min":0.88500000000000001,"15min":1.0149999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.66100000000000003},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94199999999999995,"5min":0.98499999999999999,"15min":1.04},"last":0.53100000000000003}]},{"osd":5,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.68000000000000005},"min":{"1min":0.50700000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80000000000000004,"5min":0.96199999999999997,"15min":1.1100000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65800000000000003,"15min":0.67300000000000004},"min":{"1min":0.46700000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.87,"5min":0.93500000000000005,"15min":1.0660000000000001},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66900000000000004,"15min":0.68600000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.40999999999999998},"max":{"1min":0.91500000000000004,"5min":0.93400000000000005,"15min":1.0860000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.69799999999999995,"15min":0.71599999999999997},"min":{"1min":0.47199999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.78800000000000003,"5min":1.0069999999999999,"15min":1.0720000000000001},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.68600000000000005,"15min":0.70899999999999996},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92300000000000004,"5min":0.996,"15min":1.1040000000000001},"last":0.629},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.69899999999999995,"15min":0.72199999999999998},"min":{"1min":0.48799999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93400000000000005,"5min":0.94399999999999995,"15min":1.071},"last":0.63500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575968,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303808,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068032,"statfs":{"total":96636764160,"available":96325664768,"internally_reserved":0,"allocated":2678784,"data_stored":1432103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.47099999999999997,"5min":0.38500000000000001,"15min":0.28299999999999997},"max":{"1min":0.79600000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.45200000000000001,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.79000000000000004,"15min":0.97199999999999998},"last":0.29599999999999999}]},{"osd":1,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.442,"5min":0.41099999999999998,"15min":0.34999999999999998},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.89900000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.33600000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.88700000000000001},"last":0.36499999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.48199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34799999999999998}]},{"osd":3,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38300000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.83099999999999996},"last":0.35699999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.31,"15min":0.28100000000000003},"max":{"1min":0.69399999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.502,"15min":0.497},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.315},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.76200000000000001},"last":0.371}]},{"osd":6,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34899999999999998,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.755,"5min":0.76500000000000001,"15min":0.79100000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.315}]},{"osd":7,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.81799999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.34200000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.42999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575968,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307920,"kb_used_data":2632,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063920,"statfs":{"total":96636764160,"available":96321454080,"internally_reserved":0,"allocated":2695168,"data_stored":1439800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.76500000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71999999999999997,"5min":0.78700000000000003,"15min":0.86899999999999999},"last":0.496}]},{"osd":1,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71799999999999997,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.33300000000000002},"max":{"1min":0.72699999999999998,"5min":0.80300000000000005,"15min":0.81200000000000006},"last":0.45400000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.748,"5min":0.876,"15min":0.90000000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.40500000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":0.78400000000000003,"15min":0.81100000000000005},"last":0.47599999999999998}]},{"osd":3,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.504},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.34399999999999997},"max":{"1min":0.76000000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.44700000000000001}]},{"osd":4,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.376,"5min":0.316,"15min":0.316},"max":{"1min":0.746,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.438}]},{"osd":6,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.47999999999999998},"min":{"1min":0.35899999999999999,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.36599999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52000000000000002,"15min":0.50900000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.35199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.51300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:55:48.625 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:55:48.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.742+0000 7f87a1fde700 1 Processor -- start 2023-11-15T02:55:48.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.742+0000 7f87a1fde700 1 -- start start 2023-11-15T02:55:48.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.742+0000 7f87a1fde700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f879c0ab1a0 0x7f879c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.742+0000 7f87a1fde700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f879c0aa060 0x7f879c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.742+0000 7f87a1fde700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879c0c06f0 con 0x7f879c154150 2023-11-15T02:55:48.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.742+0000 7f87a1fde700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879c0c09d0 con 0x7f879c0ab1a0 2023-11-15T02:55:48.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.742+0000 7f87a1fde700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c158820 con 0x7f879c0aa060 2023-11-15T02:55:48.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.743+0000 7f879affd700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f879c0ab1a0 0x7f879c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.743+0000 7f879bfff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f879c0aa060 0x7f879c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.743+0000 7f879bfff700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f879c0aa060 0x7f879c0c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:49962/0 (socket says 172.21.15.1:49962) 2023-11-15T02:55:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.743+0000 7f879affd700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f879c0ab1a0 0x7f879c154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:33526/0 (socket says 172.21.15.1:33526) 2023-11-15T02:55:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.743+0000 7f879bfff700 1 -- 172.21.15.1:0/2938978903 learned_addr learned my addr 172.21.15.1:0/2938978903 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.743+0000 7f879b7fe700 1 --1- 172.21.15.1:0/2938978903 >> v1:172.21.15.141:6789/0 conn(0x7f879c154150 0x7f879c158040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:33612/0 (socket says 172.21.15.1:33612) 2023-11-15T02:55:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.743+0000 7f879a7fc700 1 -- 172.21.15.1:0/2938978903 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546922795 0 0) 0x7f879c0c06f0 con 0x7f879c154150 2023-11-15T02:55:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.743+0000 7f879bfff700 1 -- 172.21.15.1:0/2938978903 >> v2:172.21.15.141:3300/0 conn(0x7f879c0ab1a0 msgr2=0x7f879c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.743+0000 7f879bfff700 1 --2- 172.21.15.1:0/2938978903 >> v2:172.21.15.141:3300/0 conn(0x7f879c0ab1a0 0x7f879c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.743+0000 7f879bfff700 1 -- 172.21.15.1:0/2938978903 >> v1:172.21.15.141:6789/0 conn(0x7f879c154150 legacy=0x7f879c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.743+0000 7f879bfff700 1 -- 172.21.15.1:0/2938978903 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c158b00 con 0x7f879c0aa060 2023-11-15T02:55:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.743+0000 7f879bfff700 1 --2- 172.21.15.1:0/2938978903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f879c0aa060 0x7f879c0c5f10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f8794009f20 tx=0x7f8794009840).ready entity=mon.2 client_cookie=dd6f9df8201e8f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.743+0000 7f879a7fc700 1 -- 172.21.15.1:0/2938978903 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879400e070 con 0x7f879c0aa060 2023-11-15T02:55:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.743+0000 7f879a7fc700 1 -- 172.21.15.1:0/2938978903 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879400b9d0 con 0x7f879c0aa060 2023-11-15T02:55:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.743+0000 7f879a7fc700 1 -- 172.21.15.1:0/2938978903 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879400bd50 con 0x7f879c0aa060 2023-11-15T02:55:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.744+0000 7f87a1fde700 1 -- 172.21.15.1:0/2938978903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f879c0aa060 msgr2=0x7f879c0c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.744+0000 7f87a1fde700 1 --2- 172.21.15.1:0/2938978903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f879c0aa060 0x7f879c0c5f10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f8794009f20 tx=0x7f8794009840).stop 2023-11-15T02:55:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.744+0000 7f87a1fde700 1 -- 172.21.15.1:0/2938978903 shutdown_connections 2023-11-15T02:55:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.744+0000 7f87a1fde700 1 --2- 172.21.15.1:0/2938978903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f879c0aa060 0x7f879c0c5f10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.744+0000 7f87a1fde700 1 --2- 172.21.15.1:0/2938978903 >> v2:172.21.15.141:3300/0 conn(0x7f879c0ab1a0 0x7f879c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.744+0000 7f87a1fde700 1 -- 172.21.15.1:0/2938978903 >> 172.21.15.1:0/2938978903 conn(0x7f879c064aa0 msgr2=0x7f879c064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:48.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.744+0000 7f87a1fde700 1 -- 172.21.15.1:0/2938978903 shutdown_connections 2023-11-15T02:55:48.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.744+0000 7f87a1fde700 1 -- 172.21.15.1:0/2938978903 wait complete. 2023-11-15T02:55:48.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.745+0000 7f87a1fde700 1 Processor -- start 2023-11-15T02:55:48.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.745+0000 7f87a1fde700 1 -- start start 2023-11-15T02:55:48.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.746+0000 7f87a1fde700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f879c0aa060 0x7f879c147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.746+0000 7f87a1fde700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f879c0ab1a0 0x7f879c0c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.746+0000 7f87a1fde700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f879c154150 0x7f879c147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.746+0000 7f87a1fde700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0c2b50 con 0x7f879c0aa060 2023-11-15T02:55:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.746+0000 7f87a1fde700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0c2d60 con 0x7f879c0ab1a0 2023-11-15T02:55:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.746+0000 7f87a1fde700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0c3040 con 0x7f879c154150 2023-11-15T02:55:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.746+0000 7f879b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f879c0aa060 0x7f879c147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.746+0000 7f879b7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f879c0aa060 0x7f879c147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43460/0 (socket says 172.21.15.1:43460) 2023-11-15T02:55:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.746+0000 7f879b7fe700 1 -- 172.21.15.1:0/222303307 learned_addr learned my addr 172.21.15.1:0/222303307 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.746+0000 7f879affd700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f879c0ab1a0 0x7f879c0c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.746+0000 7f879bfff700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f879c154150 0x7f879c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.747+0000 7f879bfff700 1 -- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f879c0ab1a0 msgr2=0x7f879c0c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.747+0000 7f879bfff700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f879c0ab1a0 0x7f879c0c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.747+0000 7f879bfff700 1 -- 172.21.15.1:0/222303307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f879c0aa060 msgr2=0x7f879c147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.747+0000 7f879bfff700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f879c0aa060 0x7f879c147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.747+0000 7f879bfff700 1 -- 172.21.15.1:0/222303307 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8794009ae0 con 0x7f879c154150 2023-11-15T02:55:48.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.747+0000 7f879affd700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f879c0ab1a0 0x7f879c0c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:48.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.747+0000 7f879b7fe700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f879c0aa060 0x7f879c147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:48.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.747+0000 7f879bfff700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f879c154150 0x7f879c147980 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f8794013000 tx=0x7f8794009840).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:48.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.747+0000 7f87837fe700 1 -- 172.21.15.1:0/222303307 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87940092e0 con 0x7f879c154150 2023-11-15T02:55:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.747+0000 7f87837fe700 1 -- 172.21.15.1:0/222303307 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879401e470 con 0x7f879c154150 2023-11-15T02:55:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.747+0000 7f87a1fde700 1 -- 172.21.15.1:0/222303307 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879c0c3320 con 0x7f879c154150 2023-11-15T02:55:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.747+0000 7f87837fe700 1 -- 172.21.15.1:0/222303307 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879401e7f0 con 0x7f879c154150 2023-11-15T02:55:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.747+0000 7f87a1fde700 1 -- 172.21.15.1:0/222303307 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c0c38e0 con 0x7f879c154150 2023-11-15T02:55:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.748+0000 7f87a1fde700 1 -- 172.21.15.1:0/222303307 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c0c3ad0 con 0x7f879c154150 2023-11-15T02:55:48.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.748+0000 7f87837fe700 1 -- 172.21.15.1:0/222303307 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8794003040 con 0x7f879c154150 2023-11-15T02:55:48.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.749+0000 7f87837fe700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f878805f270 0x7f8788061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:48.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.749+0000 7f87837fe700 1 -- 172.21.15.1:0/222303307 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f879407b870 con 0x7f879c154150 2023-11-15T02:55:48.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.749+0000 7f879b7fe700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f878805f270 0x7f8788061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:48.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.749+0000 7f879b7fe700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f878805f270 0x7f8788061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f878c004860 tx=0x7f878c007f90).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:48.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.753+0000 7f87837fe700 1 -- 172.21.15.1:0/222303307 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f879404c8c0 con 0x7f879c154150 2023-11-15T02:55:48.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.922+0000 7f87a1fde700 1 -- 172.21.15.1:0/222303307 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f879c0c3180 con 0x7f878805f270 2023-11-15T02:55:48.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.925+0000 7f87837fe700 1 -- 172.21.15.1:0/222303307 <== mgr.9370 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71377 (secure 0 0 0) 0x7f879c0c3180 con 0x7f878805f270 2023-11-15T02:55:48.929 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:48.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.927+0000 7f87a1fde700 1 -- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f878805f270 msgr2=0x7f8788061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.927+0000 7f87a1fde700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f878805f270 0x7f8788061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f878c004860 tx=0x7f878c007f90).stop 2023-11-15T02:55:48.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.927+0000 7f87a1fde700 1 -- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f879c154150 msgr2=0x7f879c147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:48.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.927+0000 7f87a1fde700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f879c154150 0x7f879c147980 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f8794013000 tx=0x7f8794009840).stop 2023-11-15T02:55:48.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.927+0000 7f87a1fde700 1 -- 172.21.15.1:0/222303307 shutdown_connections 2023-11-15T02:55:48.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.927+0000 7f87a1fde700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f878805f270 0x7f8788061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.927+0000 7f87a1fde700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f879c154150 0x7f879c147980 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.927+0000 7f87a1fde700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f879c0aa060 0x7f879c147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.927+0000 7f87a1fde700 1 --2- 172.21.15.1:0/222303307 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f879c0ab1a0 0x7f879c0c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:48.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.927+0000 7f87a1fde700 1 -- 172.21.15.1:0/222303307 >> 172.21.15.1:0/222303307 conn(0x7f879c064aa0 msgr2=0x7f879c14e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:48.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.927+0000 7f87a1fde700 1 -- 172.21.15.1:0/222303307 shutdown_connections 2023-11-15T02:55:48.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:48.927+0000 7f87a1fde700 1 -- 172.21.15.1:0/222303307 wait complete. 2023-11-15T02:55:48.934 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:55:48.942 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-11-15T02:55:47.192914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2471528,"kb_used_data":21032,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752503192,"statfs":{"total":773094113280,"available":770563268608,"internally_reserved":0,"allocated":21536768,"data_stored":11541433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14654,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-68,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.997579"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.185221+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:55:41.185221+0000","last_peered":"2023-11-15T02:55:41.185221+0000","last_clean":"2023-11-15T02:55:41.185221+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:55:41.185221+0000","last_undegraded":"2023-11-15T02:55:41.185221+0000","last_fullsized":"2023-11-15T02:55:41.185221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":177,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.229789+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:55:41.229789+0000","last_peered":"2023-11-15T02:55:41.229789+0000","last_clean":"2023-11-15T02:55:41.229789+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:55:41.229789+0000","last_undegraded":"2023-11-15T02:55:41.229789+0000","last_fullsized":"2023-11-15T02:55:41.229789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":188,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.234834+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:55:41.234834+0000","last_peered":"2023-11-15T02:55:41.234834+0000","last_clean":"2023-11-15T02:55:41.234834+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:55:41.234834+0000","last_undegraded":"2023-11-15T02:55:41.234834+0000","last_fullsized":"2023-11-15T02:55:41.234834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":177,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.230014+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:55:41.230014+0000","last_peered":"2023-11-15T02:55:41.230014+0000","last_clean":"2023-11-15T02:55:41.230014+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:55:41.230014+0000","last_undegraded":"2023-11-15T02:55:41.230014+0000","last_fullsized":"2023-11-15T02:55:41.230014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":172,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.189784+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:55:41.189784+0000","last_peered":"2023-11-15T02:55:41.189784+0000","last_clean":"2023-11-15T02:55:41.189784+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:55:41.189784+0000","last_undegraded":"2023-11-15T02:55:41.189784+0000","last_fullsized":"2023-11-15T02:55:41.189784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":170,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.189704+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:55:41.189704+0000","last_peered":"2023-11-15T02:55:41.189704+0000","last_clean":"2023-11-15T02:55:41.189704+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:55:41.189704+0000","last_undegraded":"2023-11-15T02:55:41.189704+0000","last_fullsized":"2023-11-15T02:55:41.189704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":170,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.190175+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:55:41.190175+0000","last_peered":"2023-11-15T02:55:41.190175+0000","last_clean":"2023-11-15T02:55:41.190175+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:55:41.190175+0000","last_undegraded":"2023-11-15T02:55:41.190175+0000","last_fullsized":"2023-11-15T02:55:41.190175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":178,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.186364+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:55:41.186364+0000","last_peered":"2023-11-15T02:55:41.186364+0000","last_clean":"2023-11-15T02:55:41.186364+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:55:41.186364+0000","last_undegraded":"2023-11-15T02:55:41.186364+0000","last_fullsized":"2023-11-15T02:55:41.186364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":201,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-11-15T02:55:41.183064+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:55:41.183064+0000","last_peered":"2023-11-15T02:55:41.183064+0000","last_clean":"2023-11-15T02:55:41.183064+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:55:41.183064+0000","last_undegraded":"2023-11-15T02:55:41.183064+0000","last_fullsized":"2023-11-15T02:55:41.183064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575968,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303828,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068012,"statfs":{"total":96636764160,"available":96325644288,"internally_reserved":0,"allocated":2699264,"data_stored":1452034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.66500000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.44},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.82399999999999995},"last":0.51900000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.39400000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75900000000000001,"5min":0.78500000000000003,"15min":0.79200000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.57899999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.749,"5min":0.76300000000000001,"15min":0.82299999999999995},"last":0.36099999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.58299999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.80400000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76500000000000001,"5min":0.82799999999999996,"15min":0.83799999999999997},"last":0.45400000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.88500000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.86699999999999999},"last":0.41699999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.35299999999999998,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.63700000000000001,"5min":0.71699999999999997,"15min":0.749},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.74299999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.498}]},{"osd":5,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.30199999999999999,"15min":0.27300000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.497,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.81999999999999995},"last":0.42799999999999999}]},{"osd":6,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.72399999999999998,"5min":0.78200000000000003,"15min":0.84899999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.28499999999999998},"max":{"1min":0.78400000000000003,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.46500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575969,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307936,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063904,"statfs":{"total":96636764160,"available":96321437696,"internally_reserved":0,"allocated":2711552,"data_stored":1459091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.24099999999999999},"max":{"1min":0.79500000000000004,"5min":0.79700000000000004,"15min":0.92500000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.437,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":1.466,"15min":1.466},"last":0.79000000000000004}]},{"osd":1,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81999999999999995},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78400000000000003,"5min":1.53,"15min":1.53},"last":0.64000000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.36899999999999999,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":1.026,"15min":1.026},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.80200000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.67800000000000005}]},{"osd":3,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.32900000000000001},"max":{"1min":0.71099999999999997,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.81200000000000006,"5min":1.498,"15min":1.498},"last":0.84999999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.61299999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.68400000000000005,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.70799999999999996}]},{"osd":5,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.499,"15min":0.48999999999999999},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65600000000000003,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.624},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.376,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.54500000000000004}]},{"osd":7,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.498,"15min":0.503},"min":{"1min":0.34300000000000003,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.76400000000000001,"5min":1.04,"15min":1.04},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80000000000000004,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.877}]}]},{"osd":1,"up_from":13,"seq":55834575970,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307920,"kb_used_data":2632,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063920,"statfs":{"total":96636764160,"available":96321454080,"internally_reserved":0,"allocated":2695168,"data_stored":1446675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40100000000000002,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.26100000000000001,"15min":0.23999999999999999},"max":{"1min":0.47899999999999998,"5min":1.149,"15min":1.149},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.30499999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.499,"5min":1.044,"15min":1.044},"last":0.33500000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40799999999999997,"15min":0.40699999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51100000000000001,"5min":0.748,"15min":0.748},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46899999999999997,"15min":0.46200000000000002},"min":{"1min":0.313,"5min":0.311,"15min":0.27500000000000002},"max":{"1min":0.58299999999999996,"5min":1.101,"15min":1.101},"last":0.439}]},{"osd":3,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63600000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.504,"15min":0.505},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66200000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.47899999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.40999999999999998,"15min":0.372},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65500000000000003,"15min":0.66200000000000003},"min":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":1.052,"15min":1.081},"last":0.61699999999999999}]},{"osd":5,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.53300000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88600000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73099999999999998,"15min":0.68899999999999995},"min":{"1min":0.498,"5min":0.42999999999999999,"15min":0.42699999999999999},"max":{"1min":0.86499999999999999,"5min":5.7590000000000003,"15min":5.7590000000000003},"last":0.60399999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89300000000000002,"5min":1.089,"15min":1.089},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76800000000000002,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91900000000000004,"5min":5.7930000000000001,"15min":5.7930000000000001},"last":0.64500000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72399999999999998,"15min":0.72699999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88300000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.59699999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85699999999999998,"5min":1.04,"15min":1.04},"last":0.628}]}]},{"osd":0,"up_from":13,"seq":55834575968,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312012,"kb_used_data":2628,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059828,"statfs":{"total":96636764160,"available":96317263872,"internally_reserved":0,"allocated":2691072,"data_stored":1432918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56799999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.432,"15min":0.44},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.58099999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"last":0.36399999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52700000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57099999999999995,"5min":0.72499999999999998,"15min":0.75800000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.58599999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60999999999999999,"5min":1.776,"15min":1.776},"last":0.38}]},{"osd":4,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.72399999999999998,"15min":0.70399999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.40500000000000003},"max":{"1min":1.0129999999999999,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":0.626},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.42699999999999999},"max":{"1min":0.86399999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67500000000000004,"15min":0.65900000000000003},"min":{"1min":0.435,"5min":0.39100000000000001,"15min":0.378},"max":{"1min":0.83399999999999996,"5min":3.766,"15min":3.766},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.877,"5min":0.98399999999999999,"15min":1.028},"last":0.65900000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.52900000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94499999999999995,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.74099999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.40699999999999997},"max":{"1min":0.85399999999999998,"5min":0.97799999999999998,"15min":1.0549999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.47599999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.107},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575969,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316084,"kb_used_data":2604,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055756,"statfs":{"total":96636764160,"available":96313094144,"internally_reserved":0,"allocated":2666496,"data_stored":1431425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.47499999999999998,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.27000000000000002,"15min":0.253},"max":{"1min":0.64000000000000001,"5min":8.5280000000000005,"15min":8.5280000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.26900000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69299999999999995,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.315}]},{"osd":1,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39800000000000002,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.34399999999999997,"5min":0.31,"15min":0.29499999999999998},"max":{"1min":0.66200000000000003,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.40699999999999997}]},{"osd":3,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.621,"5min":0.65900000000000003,"15min":0.70099999999999996},"last":0.376},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54600000000000004,"15min":0.495},"min":{"1min":0.376,"5min":0.32500000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":8.7200000000000006,"15min":8.7200000000000006},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.70799999999999996,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89500000000000002,"5min":8.5890000000000004,"15min":8.5890000000000004},"last":0.495},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64100000000000001,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88800000000000001,"5min":0.97199999999999998,"15min":0.98399999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.66600000000000004},"min":{"1min":0.442,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85399999999999998,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.74299999999999999,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94699999999999995,"5min":8.625,"15min":8.625},"last":0.58999999999999997}]},{"osd":6,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.52200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.89400000000000002,"5min":1.0269999999999999,"15min":1.113},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67700000000000005,"15min":0.70199999999999996},"min":{"1min":0.47299999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.0660000000000001},"last":0.51100000000000001}]},{"osd":7,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69099999999999995,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93500000000000005,"5min":0.995,"15min":1.0680000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.71399999999999997},"min":{"1min":0.505,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91200000000000003,"5min":1.089,"15min":1.1499999999999999},"last":0.56699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575970,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312020,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059820,"statfs":{"total":96636764160,"available":96317255680,"internally_reserved":0,"allocated":2699264,"data_stored":1447387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39000000000000001,"15min":0.39800000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59899999999999998,"5min":0.624,"15min":0.65100000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.41899999999999998},"min":{"1min":0.28100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.55900000000000005,"5min":0.63200000000000001,"15min":0.65800000000000003},"last":0.437}]},{"osd":1,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40000000000000002,"15min":0.41799999999999998},"min":{"1min":0.26700000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.44400000000000001,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.55700000000000005,"5min":0.67100000000000004,"15min":0.76600000000000001},"last":0.36699999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.47299999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63500000000000001,"5min":0.69699999999999995,"15min":0.72299999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.495,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65200000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47099999999999997}]},{"osd":4,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.629,"15min":0.65100000000000002},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":0.71499999999999997,"5min":0.88500000000000001,"15min":1.0149999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.66100000000000003},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94199999999999995,"5min":0.98499999999999999,"15min":1.04},"last":0.53100000000000003}]},{"osd":5,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.68000000000000005},"min":{"1min":0.50700000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80000000000000004,"5min":0.96199999999999997,"15min":1.1100000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65800000000000003,"15min":0.67300000000000004},"min":{"1min":0.46700000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.87,"5min":0.93500000000000005,"15min":1.0660000000000001},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66900000000000004,"15min":0.68600000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.40999999999999998},"max":{"1min":0.91500000000000004,"5min":0.93400000000000005,"15min":1.0860000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.69799999999999995,"15min":0.71599999999999997},"min":{"1min":0.47199999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.78800000000000003,"5min":1.0069999999999999,"15min":1.0720000000000001},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.68600000000000005,"15min":0.70899999999999996},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92300000000000004,"5min":0.996,"15min":1.1040000000000001},"last":0.629},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.69899999999999995,"15min":0.72199999999999998},"min":{"1min":0.48799999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93400000000000005,"5min":0.94399999999999995,"15min":1.071},"last":0.63500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575968,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303808,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068032,"statfs":{"total":96636764160,"available":96325664768,"internally_reserved":0,"allocated":2678784,"data_stored":1432103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.47099999999999997,"5min":0.38500000000000001,"15min":0.28299999999999997},"max":{"1min":0.79600000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.45200000000000001,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.79000000000000004,"15min":0.97199999999999998},"last":0.29599999999999999}]},{"osd":1,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.442,"5min":0.41099999999999998,"15min":0.34999999999999998},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.89900000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.33600000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.88700000000000001},"last":0.36499999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.48199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34799999999999998}]},{"osd":3,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38300000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.83099999999999996},"last":0.35699999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.31,"15min":0.28100000000000003},"max":{"1min":0.69399999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.502,"15min":0.497},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.315},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.76200000000000001},"last":0.371}]},{"osd":6,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34899999999999998,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.755,"5min":0.76500000000000001,"15min":0.79100000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.315}]},{"osd":7,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.81799999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.34200000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.42999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575968,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307920,"kb_used_data":2632,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063920,"statfs":{"total":96636764160,"available":96321454080,"internally_reserved":0,"allocated":2695168,"data_stored":1439800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.76500000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71999999999999997,"5min":0.78700000000000003,"15min":0.86899999999999999},"last":0.496}]},{"osd":1,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71799999999999997,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.33300000000000002},"max":{"1min":0.72699999999999998,"5min":0.80300000000000005,"15min":0.81200000000000006},"last":0.45400000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.748,"5min":0.876,"15min":0.90000000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.40500000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":0.78400000000000003,"15min":0.81100000000000005},"last":0.47599999999999998}]},{"osd":3,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.504},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.34399999999999997},"max":{"1min":0.76000000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.44700000000000001}]},{"osd":4,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.376,"5min":0.316,"15min":0.316},"max":{"1min":0.746,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.438}]},{"osd":6,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.47999999999999998},"min":{"1min":0.35899999999999999,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.36599999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52000000000000002,"15min":0.50900000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.35199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.51300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:55:48.944 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-15T02:55:48.944 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:55:49.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.060+0000 7f4b9c782700 1 Processor -- start 2023-11-15T02:55:49.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.060+0000 7f4b9c782700 1 -- start start 2023-11-15T02:55:49.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.061+0000 7f4b9c782700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b94154450 0x7f4b940a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:49.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.061+0000 7f4b9c782700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4b940833a0 0x7f4b94154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:49.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.061+0000 7f4b9c782700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b940a85e0 con 0x7f4b940bde10 2023-11-15T02:55:49.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.061+0000 7f4b9c782700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b94065940 con 0x7f4b940833a0 2023-11-15T02:55:49.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.061+0000 7f4b9c782700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b94065660 con 0x7f4b94154450 2023-11-15T02:55:49.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.061+0000 7f4b99d1d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4b940833a0 0x7f4b94154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:49.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.062+0000 7f4b99d1d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4b940833a0 0x7f4b94154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43464/0 (socket says 172.21.15.1:43464) 2023-11-15T02:55:49.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.062+0000 7f4b99d1d700 1 -- 172.21.15.1:0/766220665 learned_addr learned my addr 172.21.15.1:0/766220665 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:49.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.062+0000 7f4b9ad1f700 1 --1- 172.21.15.1:0/766220665 >> v1:172.21.15.1:6789/0 conn(0x7f4b940bde10 0x7f4b940be210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37178/0 (socket says 172.21.15.1:37178) 2023-11-15T02:55:49.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.062+0000 7f4b9a51e700 1 --2- 172.21.15.1:0/766220665 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b94154450 0x7f4b940a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:49.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.062+0000 7f4b99d1d700 1 -- 172.21.15.1:0/766220665 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b94154450 msgr2=0x7f4b940a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:49.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.062+0000 7f4b99d1d700 1 --2- 172.21.15.1:0/766220665 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b94154450 0x7f4b940a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.062+0000 7f4b99d1d700 1 -- 172.21.15.1:0/766220665 >> v1:172.21.15.1:6789/0 conn(0x7f4b940bde10 legacy=0x7f4b940be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:49.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.062+0000 7f4b99d1d700 1 -- 172.21.15.1:0/766220665 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b940c6f50 con 0x7f4b940833a0 2023-11-15T02:55:49.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.062+0000 7f4b99d1d700 1 --2- 172.21.15.1:0/766220665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b940833a0 0x7f4b94154830 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7f4b88006fd0 tx=0x7f4b880090f0).ready entity=mon.0 client_cookie=570df4294dfb3064 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:49.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.062+0000 7f4b9951c700 1 -- 172.21.15.1:0/766220665 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8800b580 con 0x7f4b940833a0 2023-11-15T02:55:49.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.062+0000 7f4b9951c700 1 -- 172.21.15.1:0/766220665 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8800b6e0 con 0x7f4b940833a0 2023-11-15T02:55:49.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.062+0000 7f4b9951c700 1 -- 172.21.15.1:0/766220665 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8800ba60 con 0x7f4b940833a0 2023-11-15T02:55:49.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.063+0000 7f4b9c782700 1 -- 172.21.15.1:0/766220665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b940833a0 msgr2=0x7f4b94154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:49.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.063+0000 7f4b9c782700 1 --2- 172.21.15.1:0/766220665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b940833a0 0x7f4b94154830 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7f4b88006fd0 tx=0x7f4b880090f0).stop 2023-11-15T02:55:49.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.063+0000 7f4b9c782700 1 -- 172.21.15.1:0/766220665 shutdown_connections 2023-11-15T02:55:49.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.063+0000 7f4b9c782700 1 --2- 172.21.15.1:0/766220665 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b94154450 0x7f4b940a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.063+0000 7f4b9c782700 1 --2- 172.21.15.1:0/766220665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b940833a0 0x7f4b94154830 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.063+0000 7f4b9c782700 1 -- 172.21.15.1:0/766220665 >> 172.21.15.1:0/766220665 conn(0x7f4b94082f90 msgr2=0x7f4b940c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:49.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.063+0000 7f4b9c782700 1 -- 172.21.15.1:0/766220665 shutdown_connections 2023-11-15T02:55:49.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.063+0000 7f4b9c782700 1 -- 172.21.15.1:0/766220665 wait complete. 2023-11-15T02:55:49.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.064+0000 7f4b9c782700 1 Processor -- start 2023-11-15T02:55:49.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.064+0000 7f4b9c782700 1 -- start start 2023-11-15T02:55:49.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9c782700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b940833a0 0x7f4b940a6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:49.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9c782700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b940bde10 0x7f4b9414ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:49.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9c782700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b94154450 0x7f4b940c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:49.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9c782700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940a7440 con 0x7f4b940833a0 2023-11-15T02:55:49.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9c782700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940a81d0 con 0x7f4b940bde10 2023-11-15T02:55:49.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9c782700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940a7650 con 0x7f4b94154450 2023-11-15T02:55:49.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9a51e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b940833a0 0x7f4b940a6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:49.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9a51e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b940833a0 0x7f4b940a6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43472/0 (socket says 172.21.15.1:43472) 2023-11-15T02:55:49.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9a51e700 1 -- 172.21.15.1:0/1394510855 learned_addr learned my addr 172.21.15.1:0/1394510855 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:49.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9ad1f700 1 --2- 172.21.15.1:0/1394510855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b94154450 0x7f4b940c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:49.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b99d1d700 1 --2- 172.21.15.1:0/1394510855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b940bde10 0x7f4b9414ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:49.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9a51e700 1 -- 172.21.15.1:0/1394510855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b94154450 msgr2=0x7f4b940c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:49.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9a51e700 1 --2- 172.21.15.1:0/1394510855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b94154450 0x7f4b940c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9a51e700 1 -- 172.21.15.1:0/1394510855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b940bde10 msgr2=0x7f4b9414ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:49.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9a51e700 1 --2- 172.21.15.1:0/1394510855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b940bde10 0x7f4b9414ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9a51e700 1 -- 172.21.15.1:0/1394510855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b88009370 con 0x7f4b940833a0 2023-11-15T02:55:49.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9a51e700 1 --2- 172.21.15.1:0/1394510855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b940833a0 0x7f4b940a6f50 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7f4b8c00e900 tx=0x7f4b8c006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:49.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b927fc700 1 -- 172.21.15.1:0/1394510855 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c012600 con 0x7f4b940833a0 2023-11-15T02:55:49.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b927fc700 1 -- 172.21.15.1:0/1394510855 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c012760 con 0x7f4b940833a0 2023-11-15T02:55:49.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9c782700 1 -- 172.21.15.1:0/1394510855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b940a7930 con 0x7f4b940833a0 2023-11-15T02:55:49.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b927fc700 1 -- 172.21.15.1:0/1394510855 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c012ae0 con 0x7f4b940833a0 2023-11-15T02:55:49.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.065+0000 7f4b9c782700 1 -- 172.21.15.1:0/1394510855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b940a7ef0 con 0x7f4b940833a0 2023-11-15T02:55:49.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.066+0000 7f4b9c782700 1 -- 172.21.15.1:0/1394510855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9406b8d0 con 0x7f4b940833a0 2023-11-15T02:55:49.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.067+0000 7f4b927fc700 1 -- 172.21.15.1:0/1394510855 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4b8c01b400 con 0x7f4b940833a0 2023-11-15T02:55:49.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.067+0000 7f4b927fc700 1 --2- 172.21.15.1:0/1394510855 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4b8005f240 0x7f4b80061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:49.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.067+0000 7f4b927fc700 1 -- 172.21.15.1:0/1394510855 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f4b8c07a740 con 0x7f4b940833a0 2023-11-15T02:55:49.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.067+0000 7f4b99d1d700 1 --2- 172.21.15.1:0/1394510855 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4b8005f240 0x7f4b80061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:49.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.068+0000 7f4b99d1d700 1 --2- 172.21.15.1:0/1394510855 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4b8005f240 0x7f4b80061700 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4b940bff20 tx=0x7f4b88017000).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:49.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.071+0000 7f4b927fc700 1 -- 172.21.15.1:0/1394510855 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4b8c04b730 con 0x7f4b940833a0 2023-11-15T02:55:49.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.241+0000 7f4b9c782700 1 -- 172.21.15.1:0/1394510855 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b94065350 con 0x7f4b8005f240 2023-11-15T02:55:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.244+0000 7f4b927fc700 1 -- 172.21.15.1:0/1394510855 <== mgr.9370 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71449 (secure 0 0 0) 0x7f4b94065350 con 0x7f4b8005f240 2023-11-15T02:55:49.247 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.246+0000 7f4b9c782700 1 -- 172.21.15.1:0/1394510855 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4b8005f240 msgr2=0x7f4b80061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.246+0000 7f4b9c782700 1 --2- 172.21.15.1:0/1394510855 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4b8005f240 0x7f4b80061700 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4b940bff20 tx=0x7f4b88017000).stop 2023-11-15T02:55:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.246+0000 7f4b9c782700 1 -- 172.21.15.1:0/1394510855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b940833a0 msgr2=0x7f4b940a6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.246+0000 7f4b9c782700 1 --2- 172.21.15.1:0/1394510855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b940833a0 0x7f4b940a6f50 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7f4b8c00e900 tx=0x7f4b8c006f40).stop 2023-11-15T02:55:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.246+0000 7f4b9c782700 1 -- 172.21.15.1:0/1394510855 shutdown_connections 2023-11-15T02:55:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.246+0000 7f4b9c782700 1 --2- 172.21.15.1:0/1394510855 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f4b8005f240 0x7f4b80061700 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.246+0000 7f4b9c782700 1 --2- 172.21.15.1:0/1394510855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b94154450 0x7f4b940c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.246+0000 7f4b9c782700 1 --2- 172.21.15.1:0/1394510855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b940833a0 0x7f4b940a6f50 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.246+0000 7f4b9c782700 1 --2- 172.21.15.1:0/1394510855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b940bde10 0x7f4b9414ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.246+0000 7f4b9c782700 1 -- 172.21.15.1:0/1394510855 >> 172.21.15.1:0/1394510855 conn(0x7f4b94082f90 msgr2=0x7f4b94153500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.246+0000 7f4b9c782700 1 -- 172.21.15.1:0/1394510855 shutdown_connections 2023-11-15T02:55:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.246+0000 7f4b9c782700 1 -- 172.21.15.1:0/1394510855 wait complete. 2023-11-15T02:55:49.251 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:55:49.260 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-11-15T02:55:49.193354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2471824,"kb_used_data":21328,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752502896,"statfs":{"total":773094113280,"available":770562965504,"internally_reserved":0,"allocated":21839872,"data_stored":11729474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14654,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-68,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.997579"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.210541+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:55:44.210541+0000","last_peered":"2023-11-15T02:55:44.210541+0000","last_clean":"2023-11-15T02:55:44.210541+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:55:44.210541+0000","last_undegraded":"2023-11-15T02:55:44.210541+0000","last_fullsized":"2023-11-15T02:55:44.210541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":180,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.206772+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:55:44.206772+0000","last_peered":"2023-11-15T02:55:44.206772+0000","last_clean":"2023-11-15T02:55:44.206772+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:55:44.206772+0000","last_undegraded":"2023-11-15T02:55:44.206772+0000","last_fullsized":"2023-11-15T02:55:44.206772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":191,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.201735+0000","last_change":"2023-11-15T01:21:31.804775+0000","last_active":"2023-11-15T02:55:44.201735+0000","last_peered":"2023-11-15T02:55:44.201735+0000","last_clean":"2023-11-15T02:55:44.201735+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:55:44.201735+0000","last_undegraded":"2023-11-15T02:55:44.201735+0000","last_fullsized":"2023-11-15T02:55:44.201735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":180,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.206343+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:55:44.206343+0000","last_peered":"2023-11-15T02:55:44.206343+0000","last_clean":"2023-11-15T02:55:44.206343+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:55:44.206343+0000","last_undegraded":"2023-11-15T02:55:44.206343+0000","last_fullsized":"2023-11-15T02:55:44.206343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":175,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.211551+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:55:44.211551+0000","last_peered":"2023-11-15T02:55:44.211551+0000","last_clean":"2023-11-15T02:55:44.211551+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:55:44.211551+0000","last_undegraded":"2023-11-15T02:55:44.211551+0000","last_fullsized":"2023-11-15T02:55:44.211551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":173,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.211636+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:55:44.211636+0000","last_peered":"2023-11-15T02:55:44.211636+0000","last_clean":"2023-11-15T02:55:44.211636+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:55:44.211636+0000","last_undegraded":"2023-11-15T02:55:44.211636+0000","last_fullsized":"2023-11-15T02:55:44.211636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":173,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.208875+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:55:44.208875+0000","last_peered":"2023-11-15T02:55:44.208875+0000","last_clean":"2023-11-15T02:55:44.208875+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:55:44.208875+0000","last_undegraded":"2023-11-15T02:55:44.208875+0000","last_fullsized":"2023-11-15T02:55:44.208875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.214841+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:55:44.214841+0000","last_peered":"2023-11-15T02:55:44.214841+0000","last_clean":"2023-11-15T02:55:44.214841+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:55:44.214841+0000","last_undegraded":"2023-11-15T02:55:44.214841+0000","last_fullsized":"2023-11-15T02:55:44.214841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":204,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.204453+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:55:44.204453+0000","last_peered":"2023-11-15T02:55:44.204453+0000","last_clean":"2023-11-15T02:55:44.204453+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:55:44.204453+0000","last_undegraded":"2023-11-15T02:55:44.204453+0000","last_fullsized":"2023-11-15T02:55:44.204453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575969,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303848,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067992,"statfs":{"total":96636764160,"available":96325623808,"internally_reserved":0,"allocated":2719744,"data_stored":1461813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.66500000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.82399999999999995},"last":0.68200000000000005}]},{"osd":1,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.39400000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75900000000000001,"5min":0.78500000000000003,"15min":0.79200000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.57899999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.749,"5min":0.76300000000000001,"15min":0.82299999999999995},"last":0.623}]},{"osd":2,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.58299999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.80400000000000005},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76500000000000001,"5min":0.82799999999999996,"15min":0.83799999999999997},"last":0.70999999999999996}]},{"osd":3,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.88500000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.86699999999999999},"last":0.58599999999999997}]},{"osd":4,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.35299999999999998,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.63700000000000001,"5min":0.71699999999999997,"15min":0.749},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.74299999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.67300000000000004}]},{"osd":5,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.30199999999999999,"15min":0.27300000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.497,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.81999999999999995},"last":0.41799999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.72399999999999998,"5min":0.78200000000000003,"15min":0.84899999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.28499999999999998},"max":{"1min":0.78400000000000003,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575970,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307960,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063880,"statfs":{"total":96636764160,"available":96321413120,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.24099999999999999},"max":{"1min":0.79500000000000004,"5min":0.79700000000000004,"15min":0.92500000000000004},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.437,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":1.466,"15min":1.466},"last":0.41199999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81999999999999995},"last":0.501},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78400000000000003,"5min":1.53,"15min":1.53},"last":1.298}]},{"osd":2,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.36899999999999999,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":1.026,"15min":1.026},"last":2.145},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.80200000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":1.4079999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.32900000000000001},"max":{"1min":0.71099999999999997,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":2.3610000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.81200000000000006,"5min":1.498,"15min":1.498},"last":0.82399999999999995}]},{"osd":4,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.61299999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.68400000000000005,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":2.4630000000000001}]},{"osd":5,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.499,"15min":0.48999999999999999},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65600000000000003,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.376,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.498,"15min":0.503},"min":{"1min":0.34300000000000003,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.76400000000000001,"5min":1.04,"15min":1.04},"last":2.4220000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80000000000000004,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.96399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575971,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307944,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063896,"statfs":{"total":96636764160,"available":96321429504,"internally_reserved":0,"allocated":2719744,"data_stored":1461813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40100000000000002,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.26100000000000001,"15min":0.23999999999999999},"max":{"1min":0.47899999999999998,"5min":1.149,"15min":1.149},"last":0.503},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.30499999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.499,"5min":1.044,"15min":1.044},"last":0.40799999999999997}]},{"osd":2,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40799999999999997,"15min":0.40699999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51100000000000001,"5min":0.748,"15min":0.748},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46899999999999997,"15min":0.46200000000000002},"min":{"1min":0.313,"5min":0.311,"15min":0.27500000000000002},"max":{"1min":0.58299999999999996,"5min":1.101,"15min":1.101},"last":0.46800000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63600000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.504,"15min":0.505},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66200000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.45700000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.40999999999999998,"15min":0.372},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65500000000000003,"15min":0.66200000000000003},"min":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":1.052,"15min":1.081},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.53300000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88600000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.629},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73099999999999998,"15min":0.68899999999999995},"min":{"1min":0.498,"5min":0.42999999999999999,"15min":0.42699999999999999},"max":{"1min":0.86499999999999999,"5min":5.7590000000000003,"15min":5.7590000000000003},"last":0.68999999999999995}]},{"osd":6,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89300000000000002,"5min":1.089,"15min":1.089},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76800000000000002,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91900000000000004,"5min":5.7930000000000001,"15min":5.7930000000000001},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72399999999999998,"15min":0.72699999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88300000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.59699999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85699999999999998,"5min":1.04,"15min":1.04},"last":0.72699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575969,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312056,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059784,"statfs":{"total":96636764160,"available":96317218816,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56799999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.432,"15min":0.44},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.58099999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"last":0.443}]},{"osd":2,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52700000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57099999999999995,"5min":0.72499999999999998,"15min":0.75800000000000001},"last":0.39600000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.58599999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60999999999999999,"5min":1.776,"15min":1.776},"last":0.41999999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.72399999999999998,"15min":0.70399999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.40500000000000003},"max":{"1min":1.0129999999999999,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.42699999999999999},"max":{"1min":0.86399999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.65000000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67500000000000004,"15min":0.65900000000000003},"min":{"1min":0.435,"5min":0.39100000000000001,"15min":0.378},"max":{"1min":0.83399999999999996,"5min":3.766,"15min":3.766},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.877,"5min":0.98399999999999999,"15min":1.028},"last":0.71699999999999997}]},{"osd":6,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.52900000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94499999999999995,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.40699999999999997},"max":{"1min":0.85399999999999998,"5min":0.97799999999999998,"15min":1.0549999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.47599999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.107},"last":0.68000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575970,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316152,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055688,"statfs":{"total":96636764160,"available":96313024512,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.47499999999999998,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.27000000000000002,"15min":0.253},"max":{"1min":0.64000000000000001,"5min":8.5280000000000005,"15min":8.5280000000000005},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.26900000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69299999999999995,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.41899999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39800000000000002,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.442},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.34399999999999997,"5min":0.31,"15min":0.29499999999999998},"max":{"1min":0.66200000000000003,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.47699999999999998}]},{"osd":3,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.621,"5min":0.65900000000000003,"15min":0.70099999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54600000000000004,"15min":0.495},"min":{"1min":0.376,"5min":0.32500000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":8.7200000000000006,"15min":8.7200000000000006},"last":0.46700000000000003}]},{"osd":4,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.70799999999999996,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89500000000000002,"5min":8.5890000000000004,"15min":8.5890000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64100000000000001,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88800000000000001,"5min":0.97199999999999998,"15min":0.98399999999999999},"last":0.90200000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.66600000000000004},"min":{"1min":0.442,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85399999999999998,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.74299999999999999,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94699999999999995,"5min":8.625,"15min":8.625},"last":0.89100000000000001}]},{"osd":6,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.52200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.89400000000000002,"5min":1.0269999999999999,"15min":1.113},"last":0.999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67700000000000005,"15min":0.70199999999999996},"min":{"1min":0.47299999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.0660000000000001},"last":0.92500000000000004}]},{"osd":7,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69099999999999995,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93500000000000005,"5min":0.995,"15min":1.0680000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.71399999999999997},"min":{"1min":0.505,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91200000000000003,"5min":1.089,"15min":1.1499999999999999},"last":0.97199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575971,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312056,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059784,"statfs":{"total":96636764160,"available":96317218816,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39000000000000001,"15min":0.39800000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59899999999999998,"5min":0.624,"15min":0.65100000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.41899999999999998},"min":{"1min":0.28100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.55900000000000005,"5min":0.63200000000000001,"15min":0.65800000000000003},"last":0.38300000000000001}]},{"osd":1,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40000000000000002,"15min":0.41799999999999998},"min":{"1min":0.26700000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.254},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.44400000000000001,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.55700000000000005,"5min":0.67100000000000004,"15min":0.76600000000000001},"last":0.33900000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.47299999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63500000000000001,"5min":0.69699999999999995,"15min":0.72299999999999998},"last":0.311},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.495,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65200000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.32100000000000001}]},{"osd":4,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.629,"15min":0.65100000000000002},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":0.71499999999999997,"5min":0.88500000000000001,"15min":1.0149999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.66100000000000003},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94199999999999995,"5min":0.98499999999999999,"15min":1.04},"last":0.47199999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.68000000000000005},"min":{"1min":0.50700000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80000000000000004,"5min":0.96199999999999997,"15min":1.1100000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65800000000000003,"15min":0.67300000000000004},"min":{"1min":0.46700000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.87,"5min":0.93500000000000005,"15min":1.0660000000000001},"last":0.47999999999999998}]},{"osd":6,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66900000000000004,"15min":0.68600000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.40999999999999998},"max":{"1min":0.91500000000000004,"5min":0.93400000000000005,"15min":1.0860000000000001},"last":0.437},{"interface":"front","average":{"1min":0.625,"5min":0.69799999999999995,"15min":0.71599999999999997},"min":{"1min":0.47199999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.78800000000000003,"5min":1.0069999999999999,"15min":1.0720000000000001},"last":0.57899999999999996}]},{"osd":7,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.68600000000000005,"15min":0.70899999999999996},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92300000000000004,"5min":0.996,"15min":1.1040000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.69899999999999995,"15min":0.72199999999999998},"min":{"1min":0.48799999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93400000000000005,"5min":0.94399999999999995,"15min":1.071},"last":0.502}]}]},{"osd":4,"up_from":13,"seq":55834575969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303864,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067976,"statfs":{"total":96636764160,"available":96325607424,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.47099999999999997,"5min":0.38500000000000001,"15min":0.28299999999999997},"max":{"1min":0.79600000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.45200000000000001,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.79000000000000004,"15min":0.97199999999999998},"last":0.77300000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.442,"5min":0.41099999999999998,"15min":0.34999999999999998},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.89900000000000002},"last":0.753},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.33600000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.88700000000000001},"last":0.63600000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.48199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38300000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.83099999999999996},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.31,"15min":0.28100000000000003},"max":{"1min":0.69399999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.502,"15min":0.497},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.315},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.76200000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34899999999999998,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.755,"5min":0.76500000000000001,"15min":0.79100000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.78700000000000003}]},{"osd":7,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.81799999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.34200000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.67600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575969,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307944,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063896,"statfs":{"total":96636764160,"available":96321429504,"internally_reserved":0,"allocated":2719744,"data_stored":1461813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.76500000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71999999999999997,"5min":0.78700000000000003,"15min":0.86899999999999999},"last":0.53500000000000003}]},{"osd":1,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71799999999999997,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.33300000000000002},"max":{"1min":0.72699999999999998,"5min":0.80300000000000005,"15min":0.81200000000000006},"last":0.60599999999999998}]},{"osd":2,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.748,"5min":0.876,"15min":0.90000000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.40500000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":0.78400000000000003,"15min":0.81100000000000005},"last":0.54900000000000004}]},{"osd":3,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.34399999999999997},"max":{"1min":0.76000000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.62}]},{"osd":4,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.376,"5min":0.316,"15min":0.316},"max":{"1min":0.746,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.63}]},{"osd":6,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.47999999999999998},"min":{"1min":0.35899999999999999,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52000000000000002,"15min":0.50900000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.35199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.65900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:55:49.263 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-15T02:55:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.379+0000 7fc19e908700 1 Processor -- start 2023-11-15T02:55:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.379+0000 7fc19e908700 1 -- start start 2023-11-15T02:55:49.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.380+0000 7fc19e908700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc198151e10 0x7fc198155530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:49.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.380+0000 7fc19e908700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1980c98b0 0x7fc1980c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:49.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.380+0000 7fc19e908700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1980c7980 con 0x7fc1980c86b0 2023-11-15T02:55:49.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.380+0000 7fc19e908700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1980c8b10 con 0x7fc198151e10 2023-11-15T02:55:49.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.380+0000 7fc19e908700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1980ca1f0 con 0x7fc1980c98b0 2023-11-15T02:55:49.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.380+0000 7fc19d105700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc1980c86b0 0x7fc1980aa0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37190/0 (socket says 172.21.15.1:37190) 2023-11-15T02:55:49.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.380+0000 7fc19d105700 1 -- 172.21.15.1:0/137556439 learned_addr learned my addr 172.21.15.1:0/137556439 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:49.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.380+0000 7fc19e107700 1 --2- 172.21.15.1:0/137556439 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1980c98b0 0x7fc1980c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.380+0000 7fc19d906700 1 --2- 172.21.15.1:0/137556439 >> v2:172.21.15.141:3300/0 conn(0x7fc198151e10 0x7fc198155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.381+0000 7fc19c904700 1 -- 172.21.15.1:0/137556439 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817486575 0 0) 0x7fc1980c7980 con 0x7fc1980c86b0 2023-11-15T02:55:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.381+0000 7fc19c904700 1 -- 172.21.15.1:0/137556439 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1800033f0 con 0x7fc1980c86b0 2023-11-15T02:55:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.381+0000 7fc19e107700 1 -- 172.21.15.1:0/137556439 >> v2:172.21.15.141:3300/0 conn(0x7fc198151e10 msgr2=0x7fc198155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.381+0000 7fc19e107700 1 --2- 172.21.15.1:0/137556439 >> v2:172.21.15.141:3300/0 conn(0x7fc198151e10 0x7fc198155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.381+0000 7fc19e107700 1 -- 172.21.15.1:0/137556439 >> v1:172.21.15.1:6789/0 conn(0x7fc1980c86b0 legacy=0x7fc1980aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.381+0000 7fc19e107700 1 -- 172.21.15.1:0/137556439 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1980aa890 con 0x7fc1980c98b0 2023-11-15T02:55:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.381+0000 7fc19d906700 1 --2- 172.21.15.1:0/137556439 >> v2:172.21.15.141:3300/0 conn(0x7fc198151e10 0x7fc198155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.381+0000 7fc19e107700 1 --2- 172.21.15.1:0/137556439 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1980c98b0 0x7fc1980c9d00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fc190009760 tx=0x7fc190009060).ready entity=mon.2 client_cookie=bc0db93d61c4d25d server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.381+0000 7fc19c904700 1 -- 172.21.15.1:0/137556439 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19000d4a0 con 0x7fc1980c98b0 2023-11-15T02:55:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.381+0000 7fc19c904700 1 -- 172.21.15.1:0/137556439 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19000d600 con 0x7fc1980c98b0 2023-11-15T02:55:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.381+0000 7fc19c904700 1 -- 172.21.15.1:0/137556439 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19000d980 con 0x7fc1980c98b0 2023-11-15T02:55:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.382+0000 7fc19e908700 1 -- 172.21.15.1:0/137556439 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1980c98b0 msgr2=0x7fc1980c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.382+0000 7fc19e908700 1 --2- 172.21.15.1:0/137556439 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1980c98b0 0x7fc1980c9d00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fc190009760 tx=0x7fc190009060).stop 2023-11-15T02:55:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.382+0000 7fc19e908700 1 -- 172.21.15.1:0/137556439 shutdown_connections 2023-11-15T02:55:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.382+0000 7fc19e908700 1 --2- 172.21.15.1:0/137556439 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1980c98b0 0x7fc1980c9d00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.382+0000 7fc19e908700 1 --2- 172.21.15.1:0/137556439 >> v2:172.21.15.141:3300/0 conn(0x7fc198151e10 0x7fc198155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.382+0000 7fc19e908700 1 -- 172.21.15.1:0/137556439 >> 172.21.15.1:0/137556439 conn(0x7fc1980947e0 msgr2=0x7fc19806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.382+0000 7fc19e908700 1 -- 172.21.15.1:0/137556439 shutdown_connections 2023-11-15T02:55:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.382+0000 7fc19e908700 1 -- 172.21.15.1:0/137556439 wait complete. 2023-11-15T02:55:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.383+0000 7fc19e908700 1 Processor -- start 2023-11-15T02:55:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.383+0000 7fc19e908700 1 -- start start 2023-11-15T02:55:49.394 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e908700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1980c86b0 0x7fc1980aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e908700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1980c98b0 0x7fc1980aca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e908700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc198151e10 0x7fc1980acf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e908700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19814ee70 con 0x7fc198151e10 2023-11-15T02:55:49.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e908700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1980ae860 con 0x7fc1980c86b0 2023-11-15T02:55:49.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e908700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1980aeb40 con 0x7fc1980c98b0 2023-11-15T02:55:49.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e107700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc198151e10 0x7fc1980acf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:49.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e107700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc198151e10 0x7fc1980acf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43478/0 (socket says 172.21.15.1:43478) 2023-11-15T02:55:49.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e107700 1 -- 172.21.15.1:0/1931416287 learned_addr learned my addr 172.21.15.1:0/1931416287 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:49.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19d105700 1 --2- 172.21.15.1:0/1931416287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1980c98b0 0x7fc1980aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19d906700 1 --2- 172.21.15.1:0/1931416287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1980c86b0 0x7fc1980aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e107700 1 -- 172.21.15.1:0/1931416287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1980c98b0 msgr2=0x7fc1980aca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e107700 1 --2- 172.21.15.1:0/1931416287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1980c98b0 0x7fc1980aca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e107700 1 -- 172.21.15.1:0/1931416287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1980c86b0 msgr2=0x7fc1980aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:49.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e107700 1 --2- 172.21.15.1:0/1931416287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1980c86b0 0x7fc1980aaff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e107700 1 -- 172.21.15.1:0/1931416287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188009a20 con 0x7fc198151e10 2023-11-15T02:55:49.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e107700 1 --2- 172.21.15.1:0/1931416287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc198151e10 0x7fc1980acf40 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7fc1980ca330 tx=0x7fc190016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:49.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc195ffb700 1 -- 172.21.15.1:0/1931416287 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19000d4a0 con 0x7fc198151e10 2023-11-15T02:55:49.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc195ffb700 1 -- 172.21.15.1:0/1931416287 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19000d770 con 0x7fc198151e10 2023-11-15T02:55:49.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc19e908700 1 -- 172.21.15.1:0/1931416287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1900092a0 con 0x7fc198151e10 2023-11-15T02:55:49.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.384+0000 7fc195ffb700 1 -- 172.21.15.1:0/1931416287 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19001d430 con 0x7fc198151e10 2023-11-15T02:55:49.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.385+0000 7fc19e908700 1 -- 172.21.15.1:0/1931416287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1980aeed0 con 0x7fc198151e10 2023-11-15T02:55:49.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.386+0000 7fc19e908700 1 -- 172.21.15.1:0/1931416287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1980475e0 con 0x7fc198151e10 2023-11-15T02:55:49.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.386+0000 7fc195ffb700 1 -- 172.21.15.1:0/1931416287 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc19001d7a0 con 0x7fc198151e10 2023-11-15T02:55:49.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.386+0000 7fc195ffb700 1 --2- 172.21.15.1:0/1931416287 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc18405f240 0x7fc184061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:49.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.386+0000 7fc195ffb700 1 -- 172.21.15.1:0/1931416287 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7fc19007bca0 con 0x7fc198151e10 2023-11-15T02:55:49.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.386+0000 7fc19d906700 1 --2- 172.21.15.1:0/1931416287 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc18405f240 0x7fc184061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:49.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.387+0000 7fc19d906700 1 --2- 172.21.15.1:0/1931416287 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc18405f240 0x7fc184061700 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc188009fd0 tx=0x7fc18800b040).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:49.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.390+0000 7fc195ffb700 1 -- 172.21.15.1:0/1931416287 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc19004ccf0 con 0x7fc198151e10 2023-11-15T02:55:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.564+0000 7fc19e908700 1 -- 172.21.15.1:0/1931416287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1980c7bd0 con 0x7fc198151e10 2023-11-15T02:55:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.565+0000 7fc195ffb700 1 -- 172.21.15.1:0/1931416287 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v218) v1 ==== 74+0+15346 (secure 0 0 0) 0x7fc190050310 con 0x7fc198151e10 2023-11-15T02:55:49.568 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:49.568 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":218,"fsid":"32ffb44b-12dc-4e79-bad7-24a9692dabf6","created":"2023-11-15T01:21:18.879445+0000","modified":"2023-11-15T02:55:45.198824+0000","last_up_change":"2023-11-15T01:21:27.772234+0000","last_in_change":"2023-11-15T01:21:21.298719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-15T01:21:27.821797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"216","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-15T01:21:30.052498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"258e1dda-d8fc-4fb3-9b0b-450f861dc57b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":90903},{"type":"v1","addr":"172.21.15.1:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":90903},{"type":"v1","addr":"172.21.15.1:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":90903},{"type":"v1","addr":"172.21.15.1:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":90903},{"type":"v1","addr":"172.21.15.1:6805","nonce":90903}]},"public_addr":"172.21.15.1:6801/90903","cluster_addr":"172.21.15.1:6803/90903","heartbeat_back_addr":"172.21.15.1:6807/90903","heartbeat_front_addr":"172.21.15.1:6805/90903","state":["exists","up"]},{"osd":1,"uuid":"f5eaa189-2d2d-49f4-937c-36beb144c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":90904},{"type":"v1","addr":"172.21.15.1:6817","nonce":90904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":90904},{"type":"v1","addr":"172.21.15.1:6819","nonce":90904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":90904},{"type":"v1","addr":"172.21.15.1:6823","nonce":90904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":90904},{"type":"v1","addr":"172.21.15.1:6821","nonce":90904}]},"public_addr":"172.21.15.1:6817/90904","cluster_addr":"172.21.15.1:6819/90904","heartbeat_back_addr":"172.21.15.1:6823/90904","heartbeat_front_addr":"172.21.15.1:6821/90904","state":["exists","up"]},{"osd":2,"uuid":"07abd0db-e8ff-4edb-8f1d-d8f6b878f182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":90915},{"type":"v1","addr":"172.21.15.1:6809","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":90915},{"type":"v1","addr":"172.21.15.1:6811","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":90915},{"type":"v1","addr":"172.21.15.1:6815","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":90915},{"type":"v1","addr":"172.21.15.1:6813","nonce":90915}]},"public_addr":"172.21.15.1:6809/90915","cluster_addr":"172.21.15.1:6811/90915","heartbeat_back_addr":"172.21.15.1:6815/90915","heartbeat_front_addr":"172.21.15.1:6813/90915","state":["exists","up"]},{"osd":3,"uuid":"abb82def-5a3e-4448-bcac-91eabf9d8918","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":90920},{"type":"v1","addr":"172.21.15.1:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":90920},{"type":"v1","addr":"172.21.15.1:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":90920},{"type":"v1","addr":"172.21.15.1:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":90920},{"type":"v1","addr":"172.21.15.1:6829","nonce":90920}]},"public_addr":"172.21.15.1:6825/90920","cluster_addr":"172.21.15.1:6827/90920","heartbeat_back_addr":"172.21.15.1:6831/90920","heartbeat_front_addr":"172.21.15.1:6829/90920","state":["exists","up"]},{"osd":4,"uuid":"4820bf25-02bf-42ed-ac5e-e35b86be758a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":91135},{"type":"v1","addr":"172.21.15.141:6802","nonce":91135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6805","nonce":91135},{"type":"v1","addr":"172.21.15.141:6807","nonce":91135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":91135},{"type":"v1","addr":"172.21.15.141:6815","nonce":91135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":91135},{"type":"v1","addr":"172.21.15.141:6812","nonce":91135}]},"public_addr":"172.21.15.141:6802/91135","cluster_addr":"172.21.15.141:6807/91135","heartbeat_back_addr":"172.21.15.141:6815/91135","heartbeat_front_addr":"172.21.15.141:6812/91135","state":["exists","up"]},{"osd":5,"uuid":"06808d54-5af3-4945-a877-b91d31656ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":91137},{"type":"v1","addr":"172.21.15.141:6817","nonce":91137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":91137},{"type":"v1","addr":"172.21.15.141:6819","nonce":91137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":91137},{"type":"v1","addr":"172.21.15.141:6823","nonce":91137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":91137},{"type":"v1","addr":"172.21.15.141:6821","nonce":91137}]},"public_addr":"172.21.15.141:6817/91137","cluster_addr":"172.21.15.141:6819/91137","heartbeat_back_addr":"172.21.15.141:6823/91137","heartbeat_front_addr":"172.21.15.141:6821/91137","state":["exists","up"]},{"osd":6,"uuid":"c6b482bc-4eb0-44bf-8830-ccac8c9b1790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6801","nonce":91136},{"type":"v1","addr":"172.21.15.141:6803","nonce":91136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":91136},{"type":"v1","addr":"172.21.15.141:6806","nonce":91136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6811","nonce":91136},{"type":"v1","addr":"172.21.15.141:6813","nonce":91136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":91136},{"type":"v1","addr":"172.21.15.141:6809","nonce":91136}]},"public_addr":"172.21.15.141:6803/91136","cluster_addr":"172.21.15.141:6806/91136","heartbeat_back_addr":"172.21.15.141:6813/91136","heartbeat_front_addr":"172.21.15.141:6809/91136","state":["exists","up"]},{"osd":7,"uuid":"8529e0b4-b421-4e0e-abaa-227d6866bd00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":91166},{"type":"v1","addr":"172.21.15.141:6825","nonce":91166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":91166},{"type":"v1","addr":"172.21.15.141:6827","nonce":91166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":91166},{"type":"v1","addr":"172.21.15.141:6831","nonce":91166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":91166},{"type":"v1","addr":"172.21.15.141:6829","nonce":91166}]},"public_addr":"172.21.15.141:6825/91166","cluster_addr":"172.21.15.141:6827/91166","heartbeat_back_addr":"172.21.15.141:6831/91166","heartbeat_front_addr":"172.21.15.141:6829/91166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.420279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.498865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.443616+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.406127+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.464999+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.429985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.413655+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-15T01:21:26.505590+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:6835/1145495775":"2023-11-16T02:55:41.335814+0000","172.21.15.141:0/3972018425":"2023-11-16T02:55:41.176674+0000","172.21.15.141:0/1164679632":"2023-11-16T02:55:41.176674+0000","172.21.15.141:0/3133295023":"2023-11-16T02:55:41.176674+0000","172.21.15.141:0/49188968":"2023-11-16T02:55:41.176674+0000","172.21.15.141:6837/1145495775":"2023-11-16T02:55:41.335814+0000","172.21.15.141:0/3942885922":"2023-11-16T02:55:41.176674+0000","172.21.15.141:0/1187088985":"2023-11-16T02:55:33.841413+0000","172.21.15.141:6833/103755":"2023-11-16T02:55:33.841413+0000","172.21.15.141:6832/103755":"2023-11-16T02:55:33.841413+0000","172.21.15.141:0/2020531998":"2023-11-16T02:55:33.841413+0000","172.21.15.141:0/2287874460":"2023-11-16T02:55:33.841413+0000","172.21.15.141:0/2718331164":"2023-11-16T02:55:33.841413+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":1},{"begin":15,"length":1},{"begin":19,"length":1},{"begin":26,"length":1},{"begin":30,"length":1},{"begin":36,"length":1},{"begin":40,"length":1},{"begin":46,"length":1},{"begin":50,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":104,"length":1},{"begin":107,"length":1},{"begin":111,"length":1},{"begin":199,"length":23}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-15T02:55:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.567+0000 7fc19e908700 1 -- 172.21.15.1:0/1931416287 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc18405f240 msgr2=0x7fc184061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.567+0000 7fc19e908700 1 --2- 172.21.15.1:0/1931416287 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc18405f240 0x7fc184061700 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc188009fd0 tx=0x7fc18800b040).stop 2023-11-15T02:55:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.567+0000 7fc19e908700 1 -- 172.21.15.1:0/1931416287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc198151e10 msgr2=0x7fc1980acf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:49.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.567+0000 7fc19e908700 1 --2- 172.21.15.1:0/1931416287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc198151e10 0x7fc1980acf40 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7fc1980ca330 tx=0x7fc190016000).stop 2023-11-15T02:55:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.567+0000 7fc19e908700 1 -- 172.21.15.1:0/1931416287 shutdown_connections 2023-11-15T02:55:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.567+0000 7fc19e908700 1 --2- 172.21.15.1:0/1931416287 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fc18405f240 0x7fc184061700 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.567+0000 7fc19e908700 1 --2- 172.21.15.1:0/1931416287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc198151e10 0x7fc1980acf40 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.567+0000 7fc19e908700 1 --2- 172.21.15.1:0/1931416287 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1980c86b0 0x7fc1980aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.567+0000 7fc19e908700 1 --2- 172.21.15.1:0/1931416287 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1980c98b0 0x7fc1980aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.567+0000 7fc19e908700 1 -- 172.21.15.1:0/1931416287 >> 172.21.15.1:0/1931416287 conn(0x7fc1980947e0 msgr2=0x7fc1980c6160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.568+0000 7fc19e908700 1 -- 172.21.15.1:0/1931416287 shutdown_connections 2023-11-15T02:55:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:49.568+0000 7fc19e908700 1 -- 172.21.15.1:0/1931416287 wait complete. 2023-11-15T02:55:50.583 INFO:tasks.ceph:Scrubbing osd.0 2023-11-15T02:55:50.583 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-15T02:55:50.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.716+0000 7ff2ec91e700 1 Processor -- start 2023-11-15T02:55:50.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.717+0000 7ff2ec91e700 1 -- start start 2023-11-15T02:55:50.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.717+0000 7ff2ec91e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2e813a890 0x7ff2e813ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:50.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.717+0000 7ff2ec91e700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff2e8069c90 0x7ff2e80bcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:50.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.717+0000 7ff2ec91e700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e80c34c0 con 0x7ff2e80c6330 2023-11-15T02:55:50.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2ec91e700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e80c2cc0 con 0x7ff2e8069c90 2023-11-15T02:55:50.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2ec91e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80c4140 con 0x7ff2e813a890 2023-11-15T02:55:50.722 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2e6d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff2e8069c90 0x7ff2e80bcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:50.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2e6d9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff2e8069c90 0x7ff2e80bcd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43484/0 (socket says 172.21.15.1:43484) 2023-11-15T02:55:50.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2e6d9d700 1 -- 172.21.15.1:0/3772174878 learned_addr learned my addr 172.21.15.1:0/3772174878 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:50.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2e5d9b700 1 --1- 172.21.15.1:0/3772174878 >> v1:172.21.15.1:6789/0 conn(0x7ff2e80c6330 0x7ff2e8069580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37202/0 (socket says 172.21.15.1:37202) 2023-11-15T02:55:50.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2e659c700 1 --2- 172.21.15.1:0/3772174878 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2e813a890 0x7ff2e813ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:50.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2e6d9d700 1 -- 172.21.15.1:0/3772174878 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2e813a890 msgr2=0x7ff2e813ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:50.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2e6d9d700 1 --2- 172.21.15.1:0/3772174878 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2e813a890 0x7ff2e813ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:50.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2e6d9d700 1 -- 172.21.15.1:0/3772174878 >> v1:172.21.15.1:6789/0 conn(0x7ff2e80c6330 legacy=0x7ff2e8069580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:50.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2e6d9d700 1 -- 172.21.15.1:0/3772174878 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e80c37a0 con 0x7ff2e8069c90 2023-11-15T02:55:50.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2e659c700 1 --2- 172.21.15.1:0/3772174878 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2e813a890 0x7ff2e813ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:50.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2e6d9d700 1 --2- 172.21.15.1:0/3772174878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2e8069c90 0x7ff2e80bcd20 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 rx=0x7ff2d8009f20 tx=0x7ff2d8009840).ready entity=mon.0 client_cookie=37f56e6ac47575e server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:50.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2e559a700 1 -- 172.21.15.1:0/3772174878 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d800e070 con 0x7ff2e8069c90 2023-11-15T02:55:50.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2e559a700 1 -- 172.21.15.1:0/3772174878 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d800ba80 con 0x7ff2e8069c90 2023-11-15T02:55:50.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.718+0000 7ff2e559a700 1 -- 172.21.15.1:0/3772174878 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d800be00 con 0x7ff2e8069c90 2023-11-15T02:55:50.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.719+0000 7ff2ec91e700 1 -- 172.21.15.1:0/3772174878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2e8069c90 msgr2=0x7ff2e80bcd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:50.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.719+0000 7ff2ec91e700 1 --2- 172.21.15.1:0/3772174878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2e8069c90 0x7ff2e80bcd20 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 rx=0x7ff2d8009f20 tx=0x7ff2d8009840).stop 2023-11-15T02:55:50.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.719+0000 7ff2ec91e700 1 -- 172.21.15.1:0/3772174878 shutdown_connections 2023-11-15T02:55:50.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.719+0000 7ff2ec91e700 1 --2- 172.21.15.1:0/3772174878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2e8069c90 0x7ff2e80bcd20 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:50.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.719+0000 7ff2ec91e700 1 --2- 172.21.15.1:0/3772174878 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2e813a890 0x7ff2e813ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:50.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.719+0000 7ff2ec91e700 1 -- 172.21.15.1:0/3772174878 >> 172.21.15.1:0/3772174878 conn(0x7ff2e80c7dc0 msgr2=0x7ff2e80c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:50.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.719+0000 7ff2ec91e700 1 -- 172.21.15.1:0/3772174878 shutdown_connections 2023-11-15T02:55:50.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.719+0000 7ff2ec91e700 1 -- 172.21.15.1:0/3772174878 wait complete. 2023-11-15T02:55:50.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.720+0000 7ff2ec91e700 1 Processor -- start 2023-11-15T02:55:50.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.720+0000 7ff2ec91e700 1 -- start start 2023-11-15T02:55:50.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2ec91e700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2e8069c90 0x7ff2e80c0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:50.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2ec91e700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2e80c6330 0x7ff2e8153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:50.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2ec91e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2e813a890 0x7ff2e8155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:50.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2ec91e700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80c1d90 con 0x7ff2e813a890 2023-11-15T02:55:50.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2ec91e700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80c1180 con 0x7ff2e8069c90 2023-11-15T02:55:50.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2ec91e700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80c1460 con 0x7ff2e80c6330 2023-11-15T02:55:50.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2e6d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2e813a890 0x7ff2e8155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:50.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2e6d9d700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2e813a890 0x7ff2e8155080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43500/0 (socket says 172.21.15.1:43500) 2023-11-15T02:55:50.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2e6d9d700 1 -- 172.21.15.1:0/1574363912 learned_addr learned my addr 172.21.15.1:0/1574363912 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:50.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2e659c700 1 --2- 172.21.15.1:0/1574363912 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2e8069c90 0x7ff2e80c0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:50.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2e5d9b700 1 --2- 172.21.15.1:0/1574363912 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2e80c6330 0x7ff2e8153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:50.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2e6d9d700 1 -- 172.21.15.1:0/1574363912 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2e80c6330 msgr2=0x7ff2e8153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:50.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2e6d9d700 1 --2- 172.21.15.1:0/1574363912 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2e80c6330 0x7ff2e8153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:50.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2e6d9d700 1 -- 172.21.15.1:0/1574363912 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2e8069c90 msgr2=0x7ff2e80c0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:50.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2e6d9d700 1 --2- 172.21.15.1:0/1574363912 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2e8069c90 0x7ff2e80c0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:50.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2e6d9d700 1 -- 172.21.15.1:0/1574363912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d8009ae0 con 0x7ff2e813a890 2023-11-15T02:55:50.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2e659c700 1 --2- 172.21.15.1:0/1574363912 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2e8069c90 0x7ff2e80c0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:50.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.721+0000 7ff2e6d9d700 1 --2- 172.21.15.1:0/1574363912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2e813a890 0x7ff2e8155080 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7ff2e805fe30 tx=0x7ff2d8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.722+0000 7ff2de7fc700 1 -- 172.21.15.1:0/1574363912 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80092e0 con 0x7ff2e813a890 2023-11-15T02:55:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.722+0000 7ff2de7fc700 1 -- 172.21.15.1:0/1574363912 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d801e470 con 0x7ff2e813a890 2023-11-15T02:55:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.722+0000 7ff2de7fc700 1 -- 172.21.15.1:0/1574363912 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d801e830 con 0x7ff2e813a890 2023-11-15T02:55:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.722+0000 7ff2ec91e700 1 -- 172.21.15.1:0/1574363912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e80c1740 con 0x7ff2e813a890 2023-11-15T02:55:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.722+0000 7ff2ec91e700 1 -- 172.21.15.1:0/1574363912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e80c0d70 con 0x7ff2e813a890 2023-11-15T02:55:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.722+0000 7ff2ec91e700 1 -- 172.21.15.1:0/1574363912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2e80c0f60 con 0x7ff2e813a890 2023-11-15T02:55:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.723+0000 7ff2de7fc700 1 -- 172.21.15.1:0/1574363912 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff2d8003040 con 0x7ff2e813a890 2023-11-15T02:55:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.724+0000 7ff2de7fc700 1 --2- 172.21.15.1:0/1574363912 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff2c805f270 0x7ff2c8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.724+0000 7ff2de7fc700 1 -- 172.21.15.1:0/1574363912 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7ff2d807c5f0 con 0x7ff2e813a890 2023-11-15T02:55:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.724+0000 7ff2e659c700 1 --2- 172.21.15.1:0/1574363912 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff2c805f270 0x7ff2c8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.724+0000 7ff2de7fc700 1 --2- 172.21.15.1:0/1574363912 >> [v2:172.21.15.1:6800/90903,v1:172.21.15.1:6801/90903] conn(0x7ff2c8066220 0x7ff2c80686c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.724+0000 7ff2de7fc700 1 -- 172.21.15.1:0/1574363912 --> [v2:172.21.15.1:6800/90903,v1:172.21.15.1:6801/90903] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2c8068ca0 con 0x7ff2c8066220 2023-11-15T02:55:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.724+0000 7ff2de7fc700 1 -- 172.21.15.1:0/1574363912 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2d807c9d0 con 0x7ff2e813a890 2023-11-15T02:55:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.724+0000 7ff2e5d9b700 1 --2- 172.21.15.1:0/1574363912 >> [v2:172.21.15.1:6800/90903,v1:172.21.15.1:6801/90903] conn(0x7ff2c8066220 0x7ff2c80686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.724+0000 7ff2e659c700 1 --2- 172.21.15.1:0/1574363912 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff2c805f270 0x7ff2c8061730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff2e0006fd0 tx=0x7ff2e0008040).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:50.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.724+0000 7ff2e5d9b700 1 --2- 172.21.15.1:0/1574363912 >> [v2:172.21.15.1:6800/90903,v1:172.21.15.1:6801/90903] conn(0x7ff2c8066220 0x7ff2c80686c0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:50.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.725+0000 7ff2de7fc700 1 -- 172.21.15.1:0/1574363912 <== osd.0 v2:172.21.15.1:6800/90903 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7ff2c8068ca0 con 0x7ff2c8066220 2023-11-15T02:55:50.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.738+0000 7ff2ec91e700 1 -- 172.21.15.1:0/1574363912 --> [v2:172.21.15.1:6800/90903,v1:172.21.15.1:6801/90903] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff2e806c7e0 con 0x7ff2c8066220 2023-11-15T02:55:50.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.739+0000 7ff2de7fc700 1 -- 172.21.15.1:0/1574363912 <== osd.0 v2:172.21.15.1:6800/90903 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff2e806c7e0 con 0x7ff2c8066220 2023-11-15T02:55:50.741 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:55:50.742 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-15T02:55:50.742 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:55:50.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.739+0000 7ff2ec91e700 1 -- 172.21.15.1:0/1574363912 >> [v2:172.21.15.1:6800/90903,v1:172.21.15.1:6801/90903] conn(0x7ff2c8066220 msgr2=0x7ff2c80686c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:50.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.739+0000 7ff2ec91e700 1 --2- 172.21.15.1:0/1574363912 >> [v2:172.21.15.1:6800/90903,v1:172.21.15.1:6801/90903] conn(0x7ff2c8066220 0x7ff2c80686c0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:50.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.739+0000 7ff2ec91e700 1 -- 172.21.15.1:0/1574363912 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff2c805f270 msgr2=0x7ff2c8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:50.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.739+0000 7ff2ec91e700 1 --2- 172.21.15.1:0/1574363912 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff2c805f270 0x7ff2c8061730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff2e0006fd0 tx=0x7ff2e0008040).stop 2023-11-15T02:55:50.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.739+0000 7ff2ec91e700 1 -- 172.21.15.1:0/1574363912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2e813a890 msgr2=0x7ff2e8155080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:50.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.739+0000 7ff2ec91e700 1 --2- 172.21.15.1:0/1574363912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2e813a890 0x7ff2e8155080 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7ff2e805fe30 tx=0x7ff2d8009840).stop 2023-11-15T02:55:50.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.739+0000 7ff2e6d9d700 1 -- 172.21.15.1:0/1574363912 reap_dead start 2023-11-15T02:55:50.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.739+0000 7ff2ec91e700 1 -- 172.21.15.1:0/1574363912 shutdown_connections 2023-11-15T02:55:50.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.739+0000 7ff2ec91e700 1 -- 172.21.15.1:0/1574363912 >> 172.21.15.1:0/1574363912 conn(0x7ff2e80c7dc0 msgr2=0x7ff2e8066cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:50.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.739+0000 7ff2ec91e700 1 -- 172.21.15.1:0/1574363912 shutdown_connections 2023-11-15T02:55:50.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.739+0000 7ff2ec91e700 1 -- 172.21.15.1:0/1574363912 wait complete. 2023-11-15T02:55:50.753 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-15T02:55:50.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.869+0000 7fb3eeb9a700 1 Processor -- start 2023-11-15T02:55:50.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.870+0000 7fb3eeb9a700 1 -- start start 2023-11-15T02:55:50.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.870+0000 7fb3eeb9a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb3e8154630 0x7fb3e80a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:50.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.870+0000 7fb3eeb9a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e8158ff0 con 0x7fb3e8154250 2023-11-15T02:55:50.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.870+0000 7fb3eeb9a700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e80aa930 con 0x7fb3e80aa4e0 2023-11-15T02:55:50.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.870+0000 7fb3eeb9a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e8158100 con 0x7fb3e8154630 2023-11-15T02:55:50.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3ec936700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb3e8154250 0x7fb3e80c6110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37214/0 (socket says 172.21.15.1:37214) 2023-11-15T02:55:50.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3ec936700 1 -- 172.21.15.1:0/2849121575 learned_addr learned my addr 172.21.15.1:0/2849121575 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:50.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e7fff700 1 --2- 172.21.15.1:0/2849121575 >> v2:172.21.15.141:3300/0 conn(0x7fb3e8154630 0x7fb3e80a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:50.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e77fe700 1 -- 172.21.15.1:0/2849121575 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878882804 0 0) 0x7fb3e8158ff0 con 0x7fb3e8154250 2023-11-15T02:55:50.877 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e77fe700 1 -- 172.21.15.1:0/2849121575 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3d40033f0 con 0x7fb3e8154250 2023-11-15T02:55:50.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e77fe700 1 -- 172.21.15.1:0/2849121575 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4023627483 0 0) 0x7fb3d40033f0 con 0x7fb3e8154250 2023-11-15T02:55:50.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e77fe700 1 -- 172.21.15.1:0/2849121575 >> v2:172.21.15.141:3300/0 conn(0x7fb3e8154630 msgr2=0x7fb3e80a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:50.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e77fe700 1 --2- 172.21.15.1:0/2849121575 >> v2:172.21.15.141:3300/0 conn(0x7fb3e8154630 0x7fb3e80a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:50.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e77fe700 1 -- 172.21.15.1:0/2849121575 >> v1:172.21.15.141:6789/0 conn(0x7fb3e80aa4e0 legacy=0x7fb3e80c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:50.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e77fe700 1 -- 172.21.15.1:0/2849121575 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e81583e0 con 0x7fb3e8154250 2023-11-15T02:55:50.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e77fe700 1 -- 172.21.15.1:0/2849121575 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fb3e00017f0 con 0x7fb3e8154250 2023-11-15T02:55:50.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e77fe700 1 -- 172.21.15.1:0/2849121575 >> v1:172.21.15.1:6789/0 conn(0x7fb3e8154250 legacy=0x7fb3e80c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:50.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e77fe700 1 --2- 172.21.15.1:0/2849121575 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3d40038e0 0x7fb3d4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:50.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e77fe700 1 --2- 172.21.15.1:0/2849121575 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3d4004690 0x7fb3d4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:50.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e77fe700 1 --2- 172.21.15.1:0/2849121575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3d4005000 0x7fb3d400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:50.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e77fe700 1 -- 172.21.15.1:0/2849121575 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8158100 con 0x7fb3d4005000 2023-11-15T02:55:50.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e77fe700 1 -- 172.21.15.1:0/2849121575 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d400beb0 con 0x7fb3d4004690 2023-11-15T02:55:50.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e77fe700 1 -- 172.21.15.1:0/2849121575 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d400c070 con 0x7fb3d40038e0 2023-11-15T02:55:50.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3ed137700 1 --2- 172.21.15.1:0/2849121575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3d4005000 0x7fb3d400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:50.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3e7fff700 1 --2- 172.21.15.1:0/2849121575 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3d4004690 0x7fb3d4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:50.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.871+0000 7fb3ec936700 1 --2- 172.21.15.1:0/2849121575 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3d40038e0 0x7fb3d4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:50.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.872+0000 7fb3ed137700 1 -- 172.21.15.1:0/2849121575 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3d40038e0 msgr2=0x7fb3d4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:50.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.872+0000 7fb3ed137700 1 --2- 172.21.15.1:0/2849121575 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3d40038e0 0x7fb3d4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:50.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.872+0000 7fb3ed137700 1 -- 172.21.15.1:0/2849121575 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3d4004690 msgr2=0x7fb3d4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:50.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.872+0000 7fb3ed137700 1 --2- 172.21.15.1:0/2849121575 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3d4004690 0x7fb3d4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:50.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.872+0000 7fb3ed137700 1 -- 172.21.15.1:0/2849121575 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d40033f0 con 0x7fb3d4005000 2023-11-15T02:55:50.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.872+0000 7fb3ed137700 1 -- 172.21.15.1:0/2849121575 reap_dead start 2023-11-15T02:55:50.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.872+0000 7fb3ed137700 1 --2- 172.21.15.1:0/2849121575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3d4005000 0x7fb3d400b8e0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7fb3d0001730 tx=0x7fb3d0007bb0).ready entity=mon.0 client_cookie=711924008ef283 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:50.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.872+0000 7fb3e77fe700 1 -- 172.21.15.1:0/2849121575 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0007020 con 0x7fb3d4005000 2023-11-15T02:55:50.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.872+0000 7fb3e77fe700 1 -- 172.21.15.1:0/2849121575 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d0007180 con 0x7fb3d4005000 2023-11-15T02:55:50.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.872+0000 7fb3e77fe700 1 -- 172.21.15.1:0/2849121575 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0007520 con 0x7fb3d4005000 2023-11-15T02:55:50.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.872+0000 7fb3eeb9a700 1 -- 172.21.15.1:0/2849121575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3d4005000 msgr2=0x7fb3d400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:50.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.872+0000 7fb3eeb9a700 1 --2- 172.21.15.1:0/2849121575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3d4005000 0x7fb3d400b8e0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7fb3d0001730 tx=0x7fb3d0007bb0).stop 2023-11-15T02:55:50.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.872+0000 7fb3eeb9a700 1 -- 172.21.15.1:0/2849121575 shutdown_connections 2023-11-15T02:55:50.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.872+0000 7fb3eeb9a700 1 --2- 172.21.15.1:0/2849121575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3d4005000 0x7fb3d400b8e0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:50.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.873+0000 7fb3eeb9a700 1 -- 172.21.15.1:0/2849121575 >> 172.21.15.1:0/2849121575 conn(0x7fb3e80c7b20 msgr2=0x7fb3e80c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:50.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.873+0000 7fb3eeb9a700 1 -- 172.21.15.1:0/2849121575 shutdown_connections 2023-11-15T02:55:50.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.873+0000 7fb3eeb9a700 1 -- 172.21.15.1:0/2849121575 wait complete. 2023-11-15T02:55:50.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.874+0000 7fb3eeb9a700 1 Processor -- start 2023-11-15T02:55:50.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.874+0000 7fb3eeb9a700 1 -- start start 2023-11-15T02:55:50.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3eeb9a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3d4005000 0x7fb3e81574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:50.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3eeb9a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3e80c4b10 0x7fb3e80ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:50.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3eeb9a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3e8147ff0 0x7fb3e814e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:50.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3eeb9a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80c4f90 con 0x7fb3d4005000 2023-11-15T02:55:50.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3eeb9a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80c3ac0 con 0x7fb3e8147ff0 2023-11-15T02:55:50.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3eeb9a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80c3d50 con 0x7fb3e80c4b10 2023-11-15T02:55:50.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3ec936700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3d4005000 0x7fb3e81574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:50.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3ec936700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3d4005000 0x7fb3e81574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43512/0 (socket says 172.21.15.1:43512) 2023-11-15T02:55:50.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3ec936700 1 -- 172.21.15.1:0/679927031 learned_addr learned my addr 172.21.15.1:0/679927031 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:50.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3ed137700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3e8147ff0 0x7fb3e814e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:50.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3e7fff700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3e80c4b10 0x7fb3e80ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:50.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3ec936700 1 -- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3e80c4b10 msgr2=0x7fb3e80ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:50.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3ec936700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3e80c4b10 0x7fb3e80ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:50.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3ec936700 1 -- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3e8147ff0 msgr2=0x7fb3e814e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:50.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3ec936700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3e8147ff0 0x7fb3e814e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:50.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3ec936700 1 -- 172.21.15.1:0/679927031 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e80c4030 con 0x7fb3d4005000 2023-11-15T02:55:50.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3e7fff700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3e80c4b10 0x7fb3e80ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:50.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3ed137700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3e8147ff0 0x7fb3e814e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:50.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3ec936700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3d4005000 0x7fb3e81574e0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7fb3e0007d30 tx=0x7fb3e8158f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:50.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3e4ff9700 1 -- 172.21.15.1:0/679927031 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000f8a0 con 0x7fb3d4005000 2023-11-15T02:55:50.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3e4ff9700 1 -- 172.21.15.1:0/679927031 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e000fa00 con 0x7fb3d4005000 2023-11-15T02:55:50.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3eeb9a700 1 -- 172.21.15.1:0/679927031 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e80c4310 con 0x7fb3d4005000 2023-11-15T02:55:50.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3e4ff9700 1 -- 172.21.15.1:0/679927031 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000fd80 con 0x7fb3d4005000 2023-11-15T02:55:50.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.875+0000 7fb3eeb9a700 1 -- 172.21.15.1:0/679927031 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e80acb90 con 0x7fb3d4005000 2023-11-15T02:55:50.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.876+0000 7fb3eeb9a700 1 -- 172.21.15.1:0/679927031 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e806c7e0 con 0x7fb3d4005000 2023-11-15T02:55:50.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.877+0000 7fb3e4ff9700 1 -- 172.21.15.1:0/679927031 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb3e0012560 con 0x7fb3d4005000 2023-11-15T02:55:50.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.877+0000 7fb3e4ff9700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb3c805f240 0x7fb3c8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:50.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.877+0000 7fb3e4ff9700 1 -- 172.21.15.1:0/679927031 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7fb3e007a0d0 con 0x7fb3d4005000 2023-11-15T02:55:50.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.877+0000 7fb3e7fff700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb3c805f240 0x7fb3c8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:50.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.878+0000 7fb3e7fff700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb3c805f240 0x7fb3c8061700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb3d8006f70 tx=0x7fb3d8008040).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:50.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:50.881+0000 7fb3e4ff9700 1 -- 172.21.15.1:0/679927031 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb3e004b1d0 con 0x7fb3d4005000 2023-11-15T02:55:51.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.053+0000 7fb3eeb9a700 1 -- 172.21.15.1:0/679927031 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3e814e040 con 0x7fb3c805f240 2023-11-15T02:55:51.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.053+0000 7fb3e4ff9700 1 -- 172.21.15.1:0/679927031 <== mgr.9370 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb3e814e040 con 0x7fb3c805f240 2023-11-15T02:55:51.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.055+0000 7fb3eeb9a700 1 -- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb3c805f240 msgr2=0x7fb3c8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.055+0000 7fb3eeb9a700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb3c805f240 0x7fb3c8061700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb3d8006f70 tx=0x7fb3d8008040).stop 2023-11-15T02:55:51.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.055+0000 7fb3eeb9a700 1 -- 172.21.15.1:0/679927031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3d4005000 msgr2=0x7fb3e81574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.055+0000 7fb3eeb9a700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3d4005000 0x7fb3e81574e0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7fb3e0007d30 tx=0x7fb3e8158f60).stop 2023-11-15T02:55:51.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.055+0000 7fb3eeb9a700 1 -- 172.21.15.1:0/679927031 shutdown_connections 2023-11-15T02:55:51.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.055+0000 7fb3eeb9a700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fb3c805f240 0x7fb3c8061700 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.055+0000 7fb3eeb9a700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3e8147ff0 0x7fb3e814e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.055+0000 7fb3eeb9a700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3d4005000 0x7fb3e81574e0 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.055+0000 7fb3eeb9a700 1 --2- 172.21.15.1:0/679927031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3e80c4b10 0x7fb3e80ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.055+0000 7fb3eeb9a700 1 -- 172.21.15.1:0/679927031 >> 172.21.15.1:0/679927031 conn(0x7fb3e80c7b20 msgr2=0x7fb3e80c9780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:51.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.055+0000 7fb3eeb9a700 1 -- 172.21.15.1:0/679927031 shutdown_connections 2023-11-15T02:55:51.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.055+0000 7fb3eeb9a700 1 -- 172.21.15.1:0/679927031 wait complete. 2023-11-15T02:55:51.060 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 0 to deep-scrub 2023-11-15T02:55:51.069 INFO:tasks.ceph:Scrubbing osd.1 2023-11-15T02:55:51.070 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-15T02:55:51.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.189+0000 7f6d98efd700 1 Processor -- start 2023-11-15T02:55:51.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.189+0000 7f6d98efd700 1 -- start start 2023-11-15T02:55:51.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.190+0000 7f6d98efd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d94154b90 0x7f6d940bd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.190+0000 7f6d98efd700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d940bcc80 con 0x7f6d94155680 2023-11-15T02:55:51.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.190+0000 7f6d98efd700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d940c1fd0 con 0x7f6d940c2460 2023-11-15T02:55:51.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.190+0000 7f6d98efd700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940bced0 con 0x7f6d94154b90 2023-11-15T02:55:51.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.190+0000 7f6d92d9d700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6d94155680 0x7f6d940627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37224/0 (socket says 172.21.15.1:37224) 2023-11-15T02:55:51.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.190+0000 7f6d92d9d700 1 -- 172.21.15.1:0/2870028571 learned_addr learned my addr 172.21.15.1:0/2870028571 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:51.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.190+0000 7f6d9259c700 1 --2- 172.21.15.1:0/2870028571 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d94154b90 0x7f6d940bd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.191+0000 7f6d9159a700 1 -- 172.21.15.1:0/2870028571 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212009217 0 0) 0x7f6d940bcc80 con 0x7f6d94155680 2023-11-15T02:55:51.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.191+0000 7f6d9159a700 1 -- 172.21.15.1:0/2870028571 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d800033f0 con 0x7f6d94155680 2023-11-15T02:55:51.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.191+0000 7f6d9159a700 1 -- 172.21.15.1:0/2870028571 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108870395 0 0) 0x7f6d940c1fd0 con 0x7f6d940c2460 2023-11-15T02:55:51.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.191+0000 7f6d9159a700 1 -- 172.21.15.1:0/2870028571 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d940bcc80 con 0x7f6d940c2460 2023-11-15T02:55:51.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.191+0000 7f6d9259c700 1 -- 172.21.15.1:0/2870028571 >> v1:172.21.15.141:6789/0 conn(0x7f6d940c2460 legacy=0x7f6d94154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.191+0000 7f6d9259c700 1 -- 172.21.15.1:0/2870028571 >> v1:172.21.15.1:6789/0 conn(0x7f6d94155680 legacy=0x7f6d940627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.191+0000 7f6d9259c700 1 -- 172.21.15.1:0/2870028571 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d940bd1b0 con 0x7f6d94154b90 2023-11-15T02:55:51.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.191+0000 7f6d9259c700 1 --2- 172.21.15.1:0/2870028571 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d94154b90 0x7f6d940bd9b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f6d84009e90 tx=0x7f6d84009780).ready entity=mon.2 client_cookie=f6ad792a932994f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:51.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.191+0000 7f6d9159a700 1 -- 172.21.15.1:0/2870028571 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400e070 con 0x7f6d94154b90 2023-11-15T02:55:51.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.191+0000 7f6d9159a700 1 -- 172.21.15.1:0/2870028571 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8400bab0 con 0x7f6d94154b90 2023-11-15T02:55:51.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.191+0000 7f6d9159a700 1 -- 172.21.15.1:0/2870028571 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400be30 con 0x7f6d94154b90 2023-11-15T02:55:51.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.192+0000 7f6d98efd700 1 -- 172.21.15.1:0/2870028571 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d94154b90 msgr2=0x7f6d940bd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.192+0000 7f6d98efd700 1 --2- 172.21.15.1:0/2870028571 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d94154b90 0x7f6d940bd9b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f6d84009e90 tx=0x7f6d84009780).stop 2023-11-15T02:55:51.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.192+0000 7f6d98efd700 1 -- 172.21.15.1:0/2870028571 shutdown_connections 2023-11-15T02:55:51.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.192+0000 7f6d98efd700 1 --2- 172.21.15.1:0/2870028571 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d94154b90 0x7f6d940bd9b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.192+0000 7f6d98efd700 1 -- 172.21.15.1:0/2870028571 >> 172.21.15.1:0/2870028571 conn(0x7f6d940c4010 msgr2=0x7f6d940c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:51.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.192+0000 7f6d98efd700 1 -- 172.21.15.1:0/2870028571 shutdown_connections 2023-11-15T02:55:51.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.192+0000 7f6d98efd700 1 -- 172.21.15.1:0/2870028571 wait complete. 2023-11-15T02:55:51.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.193+0000 7f6d98efd700 1 Processor -- start 2023-11-15T02:55:51.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.193+0000 7f6d98efd700 1 -- start start 2023-11-15T02:55:51.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d98efd700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d940c2460 0x7f6d940a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d98efd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d94154b90 0x7f6d94165830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d98efd700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d94155680 0x7f6d940a6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d98efd700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940bf650 con 0x7f6d94154b90 2023-11-15T02:55:51.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d98efd700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940c03a0 con 0x7f6d940c2460 2023-11-15T02:55:51.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d98efd700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940a9ff0 con 0x7f6d94155680 2023-11-15T02:55:51.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d91d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d94154b90 0x7f6d94165830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d91d9b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d94154b90 0x7f6d94165830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43514/0 (socket says 172.21.15.1:43514) 2023-11-15T02:55:51.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d91d9b700 1 -- 172.21.15.1:0/3839158000 learned_addr learned my addr 172.21.15.1:0/3839158000 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:51.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d9259c700 1 --2- 172.21.15.1:0/3839158000 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d940c2460 0x7f6d940a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d92d9d700 1 --2- 172.21.15.1:0/3839158000 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d94155680 0x7f6d940a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d91d9b700 1 -- 172.21.15.1:0/3839158000 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d94155680 msgr2=0x7f6d940a6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d91d9b700 1 --2- 172.21.15.1:0/3839158000 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d94155680 0x7f6d940a6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d91d9b700 1 -- 172.21.15.1:0/3839158000 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d940c2460 msgr2=0x7f6d940a9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d91d9b700 1 --2- 172.21.15.1:0/3839158000 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d940c2460 0x7f6d940a9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d91d9b700 1 -- 172.21.15.1:0/3839158000 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d84009a20 con 0x7f6d94154b90 2023-11-15T02:55:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d91d9b700 1 --2- 172.21.15.1:0/3839158000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d94154b90 0x7f6d94165830 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7f6d7c00c4c0 tx=0x7f6d7c007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.194+0000 7f6d8a7fc700 1 -- 172.21.15.1:0/3839158000 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c00ce30 con 0x7f6d94154b90 2023-11-15T02:55:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.195+0000 7f6d8a7fc700 1 -- 172.21.15.1:0/3839158000 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c00f470 con 0x7f6d94154b90 2023-11-15T02:55:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.195+0000 7f6d98efd700 1 -- 172.21.15.1:0/3839158000 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d940bea40 con 0x7f6d94154b90 2023-11-15T02:55:51.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.195+0000 7f6d8a7fc700 1 -- 172.21.15.1:0/3839158000 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c00f830 con 0x7f6d94154b90 2023-11-15T02:55:51.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.195+0000 7f6d98efd700 1 -- 172.21.15.1:0/3839158000 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d940bf000 con 0x7f6d94154b90 2023-11-15T02:55:51.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.195+0000 7f6d98efd700 1 -- 172.21.15.1:0/3839158000 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d94154f70 con 0x7f6d94154b90 2023-11-15T02:55:51.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.196+0000 7f6d8a7fc700 1 -- 172.21.15.1:0/3839158000 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6d7c00fbe0 con 0x7f6d94154b90 2023-11-15T02:55:51.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.196+0000 7f6d8a7fc700 1 --2- 172.21.15.1:0/3839158000 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6d7405f270 0x7f6d74061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.196+0000 7f6d8a7fc700 1 -- 172.21.15.1:0/3839158000 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f6d7c07a0f0 con 0x7f6d94154b90 2023-11-15T02:55:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.196+0000 7f6d8a7fc700 1 --2- 172.21.15.1:0/3839158000 >> [v2:172.21.15.1:6816/90904,v1:172.21.15.1:6817/90904] conn(0x7f6d74066220 0x7f6d740686c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.196+0000 7f6d8a7fc700 1 -- 172.21.15.1:0/3839158000 --> [v2:172.21.15.1:6816/90904,v1:172.21.15.1:6817/90904] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d74068ca0 con 0x7f6d74066220 2023-11-15T02:55:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.196+0000 7f6d8a7fc700 1 -- 172.21.15.1:0/3839158000 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d7c07a4d0 con 0x7f6d94154b90 2023-11-15T02:55:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.196+0000 7f6d9259c700 1 --2- 172.21.15.1:0/3839158000 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6d7405f270 0x7f6d74061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.197+0000 7f6d92d9d700 1 --2- 172.21.15.1:0/3839158000 >> [v2:172.21.15.1:6816/90904,v1:172.21.15.1:6817/90904] conn(0x7f6d74066220 0x7f6d740686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.197+0000 7f6d92d9d700 1 --2- 172.21.15.1:0/3839158000 >> [v2:172.21.15.1:6816/90904,v1:172.21.15.1:6817/90904] conn(0x7f6d74066220 0x7f6d740686c0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:51.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.197+0000 7f6d9259c700 1 --2- 172.21.15.1:0/3839158000 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6d7405f270 0x7f6d74061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6d84009de0 tx=0x7f6d84009780).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:51.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.197+0000 7f6d8a7fc700 1 -- 172.21.15.1:0/3839158000 <== osd.1 v2:172.21.15.1:6816/90904 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f6d74068ca0 con 0x7f6d74066220 2023-11-15T02:55:51.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.211+0000 7f6d98efd700 1 -- 172.21.15.1:0/3839158000 --> [v2:172.21.15.1:6816/90904,v1:172.21.15.1:6817/90904] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6d94150700 con 0x7f6d74066220 2023-11-15T02:55:51.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.211+0000 7f6d8a7fc700 1 -- 172.21.15.1:0/3839158000 <== osd.1 v2:172.21.15.1:6816/90904 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6d94150700 con 0x7f6d74066220 2023-11-15T02:55:51.213 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:55:51.213 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-15T02:55:51.214 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:55:51.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.211+0000 7f6d98efd700 1 -- 172.21.15.1:0/3839158000 >> [v2:172.21.15.1:6816/90904,v1:172.21.15.1:6817/90904] conn(0x7f6d74066220 msgr2=0x7f6d740686c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.211+0000 7f6d98efd700 1 --2- 172.21.15.1:0/3839158000 >> [v2:172.21.15.1:6816/90904,v1:172.21.15.1:6817/90904] conn(0x7f6d74066220 0x7f6d740686c0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.211+0000 7f6d98efd700 1 -- 172.21.15.1:0/3839158000 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6d7405f270 msgr2=0x7f6d74061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.211+0000 7f6d98efd700 1 --2- 172.21.15.1:0/3839158000 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6d7405f270 0x7f6d74061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6d84009de0 tx=0x7f6d84009780).stop 2023-11-15T02:55:51.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.211+0000 7f6d98efd700 1 -- 172.21.15.1:0/3839158000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d94154b90 msgr2=0x7f6d94165830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.211+0000 7f6d98efd700 1 --2- 172.21.15.1:0/3839158000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d94154b90 0x7f6d94165830 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7f6d7c00c4c0 tx=0x7f6d7c007c60).stop 2023-11-15T02:55:51.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.211+0000 7f6d92d9d700 1 -- 172.21.15.1:0/3839158000 reap_dead start 2023-11-15T02:55:51.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.211+0000 7f6d98efd700 1 -- 172.21.15.1:0/3839158000 shutdown_connections 2023-11-15T02:55:51.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.211+0000 7f6d98efd700 1 -- 172.21.15.1:0/3839158000 >> 172.21.15.1:0/3839158000 conn(0x7f6d940c4010 msgr2=0x7f6d940c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:51.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.211+0000 7f6d98efd700 1 -- 172.21.15.1:0/3839158000 shutdown_connections 2023-11-15T02:55:51.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.211+0000 7f6d98efd700 1 -- 172.21.15.1:0/3839158000 wait complete. 2023-11-15T02:55:51.225 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-15T02:55:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.342+0000 7f9016028700 1 Processor -- start 2023-11-15T02:55:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.342+0000 7f9016028700 1 -- start start 2023-11-15T02:55:51.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.343+0000 7f9016028700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f90100c8840 0x7f90100c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.343+0000 7f9016028700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90100c7510 0x7f90100c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.343+0000 7f9016028700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90100bed80 con 0x7f90100bf210 2023-11-15T02:55:51.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.343+0000 7f9016028700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90100c3ac0 con 0x7f90100c8840 2023-11-15T02:55:51.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.343+0000 7f9016028700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9010154a50 con 0x7f90100c7510 2023-11-15T02:55:51.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.343+0000 7f9015827700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f90100bf210 0x7f90100bf6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37234/0 (socket says 172.21.15.1:37234) 2023-11-15T02:55:51.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.343+0000 7f9015827700 1 -- 172.21.15.1:0/3571247356 learned_addr learned my addr 172.21.15.1:0/3571247356 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:51.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.343+0000 7f9015026700 1 --2- 172.21.15.1:0/3571247356 >> v2:172.21.15.141:3300/0 conn(0x7f90100c8840 0x7f90100c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.343+0000 7f9014825700 1 --2- 172.21.15.1:0/3571247356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90100c7510 0x7f90100c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.343+0000 7f900ffff700 1 -- 172.21.15.1:0/3571247356 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037780886 0 0) 0x7f90100bed80 con 0x7f90100bf210 2023-11-15T02:55:51.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.343+0000 7f900ffff700 1 -- 172.21.15.1:0/3571247356 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ff80033f0 con 0x7f90100bf210 2023-11-15T02:55:51.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f900ffff700 1 -- 172.21.15.1:0/3571247356 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1756622596 0 0) 0x7f8ff80033f0 con 0x7f90100bf210 2023-11-15T02:55:51.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f900ffff700 1 -- 172.21.15.1:0/3571247356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90100c7510 msgr2=0x7f90100c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:51.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f900ffff700 1 --2- 172.21.15.1:0/3571247356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90100c7510 0x7f90100c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f900ffff700 1 -- 172.21.15.1:0/3571247356 >> v2:172.21.15.141:3300/0 conn(0x7f90100c8840 msgr2=0x7f90100c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:51.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f900ffff700 1 --2- 172.21.15.1:0/3571247356 >> v2:172.21.15.141:3300/0 conn(0x7f90100c8840 0x7f90100c35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f900ffff700 1 -- 172.21.15.1:0/3571247356 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90100bfdb0 con 0x7f90100bf210 2023-11-15T02:55:51.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f900ffff700 1 -- 172.21.15.1:0/3571247356 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7f90000017f0 con 0x7f90100bf210 2023-11-15T02:55:51.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f900ffff700 1 -- 172.21.15.1:0/3571247356 >> v1:172.21.15.1:6789/0 conn(0x7f90100bf210 legacy=0x7f90100bf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f900ffff700 1 --2- 172.21.15.1:0/3571247356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff80038e0 0x7f8ff8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f900ffff700 1 --2- 172.21.15.1:0/3571247356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ff8004690 0x7f8ff8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f900ffff700 1 --2- 172.21.15.1:0/3571247356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ff8005000 0x7f8ff800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f900ffff700 1 -- 172.21.15.1:0/3571247356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90100c3ac0 con 0x7f8ff80038e0 2023-11-15T02:55:51.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f900ffff700 1 -- 172.21.15.1:0/3571247356 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9010154a50 con 0x7f8ff8004690 2023-11-15T02:55:51.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f900ffff700 1 -- 172.21.15.1:0/3571247356 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff800bdd0 con 0x7f8ff8005000 2023-11-15T02:55:51.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f9014825700 1 --2- 172.21.15.1:0/3571247356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90100c7510 0x7f90100c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:51.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f9015026700 1 --2- 172.21.15.1:0/3571247356 >> v2:172.21.15.141:3300/0 conn(0x7f90100c8840 0x7f90100c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:55:51.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f9015026700 1 --2- 172.21.15.1:0/3571247356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff80038e0 0x7f8ff8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f9015827700 1 --2- 172.21.15.1:0/3571247356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ff8005000 0x7f8ff800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f9014825700 1 --2- 172.21.15.1:0/3571247356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ff8004690 0x7f8ff8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f9015026700 1 -- 172.21.15.1:0/3571247356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ff8005000 msgr2=0x7f8ff800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:51.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f9015026700 1 --2- 172.21.15.1:0/3571247356 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ff8005000 0x7f8ff800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f9015026700 1 -- 172.21.15.1:0/3571247356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ff8004690 msgr2=0x7f8ff8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:51.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f9015026700 1 --2- 172.21.15.1:0/3571247356 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ff8004690 0x7f8ff8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f9015026700 1 -- 172.21.15.1:0/3571247356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff80033f0 con 0x7f8ff80038e0 2023-11-15T02:55:51.355 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.344+0000 7f9015026700 1 --2- 172.21.15.1:0/3571247356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff80038e0 0x7f8ff8003d00 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 rx=0x7f9008009c60 tx=0x7f9008009060).ready entity=mon.0 client_cookie=7c0b9c04cc336fee server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:51.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.345+0000 7f900ffff700 1 -- 172.21.15.1:0/3571247356 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080095c0 con 0x7f8ff80038e0 2023-11-15T02:55:51.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.345+0000 7f900ffff700 1 -- 172.21.15.1:0/3571247356 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900800e710 con 0x7f8ff80038e0 2023-11-15T02:55:51.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.345+0000 7f900ffff700 1 -- 172.21.15.1:0/3571247356 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900800ea90 con 0x7f8ff80038e0 2023-11-15T02:55:51.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.345+0000 7f9016028700 1 -- 172.21.15.1:0/3571247356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff80038e0 msgr2=0x7f8ff8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.345+0000 7f9016028700 1 --2- 172.21.15.1:0/3571247356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff80038e0 0x7f8ff8003d00 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 rx=0x7f9008009c60 tx=0x7f9008009060).stop 2023-11-15T02:55:51.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.345+0000 7f9015827700 1 -- 172.21.15.1:0/3571247356 reap_dead start 2023-11-15T02:55:51.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.345+0000 7f9016028700 1 -- 172.21.15.1:0/3571247356 shutdown_connections 2023-11-15T02:55:51.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.345+0000 7f9016028700 1 -- 172.21.15.1:0/3571247356 >> 172.21.15.1:0/3571247356 conn(0x7f9010062f90 msgr2=0x7f90100c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:51.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.345+0000 7f9016028700 1 -- 172.21.15.1:0/3571247356 shutdown_connections 2023-11-15T02:55:51.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.345+0000 7f9016028700 1 -- 172.21.15.1:0/3571247356 wait complete. 2023-11-15T02:55:51.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.346+0000 7f9016028700 1 Processor -- start 2023-11-15T02:55:51.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.346+0000 7f9016028700 1 -- start start 2023-11-15T02:55:51.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.347+0000 7f9016028700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff80038e0 0x7f90100aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.347+0000 7f9016028700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90101597d0 0x7f9010152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.347+0000 7f9016028700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90100638c0 0x7f9010063d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.347+0000 7f9016028700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90100ad3a0 con 0x7f8ff80038e0 2023-11-15T02:55:51.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.347+0000 7f9016028700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9010092e80 con 0x7f90100638c0 2023-11-15T02:55:51.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.347+0000 7f9016028700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9010064230 con 0x7f90101597d0 2023-11-15T02:55:51.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.347+0000 7f9015026700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff80038e0 0x7f90100aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.347+0000 7f9015026700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff80038e0 0x7f90100aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43536/0 (socket says 172.21.15.1:43536) 2023-11-15T02:55:51.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.347+0000 7f9015026700 1 -- 172.21.15.1:0/1673541051 learned_addr learned my addr 172.21.15.1:0/1673541051 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:51.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.348+0000 7f9015827700 1 --2- 172.21.15.1:0/1673541051 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90100638c0 0x7f9010063d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.348+0000 7f9014825700 1 --2- 172.21.15.1:0/1673541051 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90101597d0 0x7f9010152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.348+0000 7f9015026700 1 -- 172.21.15.1:0/1673541051 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90101597d0 msgr2=0x7f9010152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.348+0000 7f9015026700 1 --2- 172.21.15.1:0/1673541051 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90101597d0 0x7f9010152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.348+0000 7f9015026700 1 -- 172.21.15.1:0/1673541051 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90100638c0 msgr2=0x7f9010063d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.348+0000 7f9015026700 1 --2- 172.21.15.1:0/1673541051 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90100638c0 0x7f9010063d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.348+0000 7f9015026700 1 -- 172.21.15.1:0/1673541051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9010159c50 con 0x7f8ff80038e0 2023-11-15T02:55:51.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.348+0000 7f9015026700 1 --2- 172.21.15.1:0/1673541051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff80038e0 0x7f90100aceb0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7f900800e4b0 tx=0x7f9008019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:51.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.348+0000 7f900d7fa700 1 -- 172.21.15.1:0/1673541051 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900800e880 con 0x7f8ff80038e0 2023-11-15T02:55:51.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.348+0000 7f900d7fa700 1 -- 172.21.15.1:0/1673541051 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900800ea00 con 0x7f8ff80038e0 2023-11-15T02:55:51.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.348+0000 7f9016028700 1 -- 172.21.15.1:0/1673541051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90100ad5b0 con 0x7f8ff80038e0 2023-11-15T02:55:51.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.348+0000 7f900d7fa700 1 -- 172.21.15.1:0/1673541051 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900801b6c0 con 0x7f8ff80038e0 2023-11-15T02:55:51.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.348+0000 7f9016028700 1 -- 172.21.15.1:0/1673541051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90100adb70 con 0x7f8ff80038e0 2023-11-15T02:55:51.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.349+0000 7f9016028700 1 -- 172.21.15.1:0/1673541051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90100c9820 con 0x7f8ff80038e0 2023-11-15T02:55:51.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.349+0000 7f900d7fa700 1 -- 172.21.15.1:0/1673541051 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f900801ba30 con 0x7f8ff80038e0 2023-11-15T02:55:51.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.350+0000 7f900d7fa700 1 --2- 172.21.15.1:0/1673541051 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8ffc05f270 0x7f8ffc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.350+0000 7f900d7fa700 1 -- 172.21.15.1:0/1673541051 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f900807c280 con 0x7f8ff80038e0 2023-11-15T02:55:51.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.350+0000 7f9014825700 1 --2- 172.21.15.1:0/1673541051 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8ffc05f270 0x7f8ffc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.350+0000 7f9014825700 1 --2- 172.21.15.1:0/1673541051 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8ffc05f270 0x7f8ffc061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9010069140 tx=0x7f9004009060).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:51.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.354+0000 7f900d7fa700 1 -- 172.21.15.1:0/1673541051 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f900804d390 con 0x7f8ff80038e0 2023-11-15T02:55:51.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.526+0000 7f9016028700 1 -- 172.21.15.1:0/1673541051 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f90100635d0 con 0x7f8ffc05f270 2023-11-15T02:55:51.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.527+0000 7f900d7fa700 1 -- 172.21.15.1:0/1673541051 <== mgr.9370 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f90100635d0 con 0x7f8ffc05f270 2023-11-15T02:55:51.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.529+0000 7f9016028700 1 -- 172.21.15.1:0/1673541051 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8ffc05f270 msgr2=0x7f8ffc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.529+0000 7f9016028700 1 --2- 172.21.15.1:0/1673541051 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8ffc05f270 0x7f8ffc061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9010069140 tx=0x7f9004009060).stop 2023-11-15T02:55:51.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.529+0000 7f9016028700 1 -- 172.21.15.1:0/1673541051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff80038e0 msgr2=0x7f90100aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.529+0000 7f9016028700 1 --2- 172.21.15.1:0/1673541051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff80038e0 0x7f90100aceb0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7f900800e4b0 tx=0x7f9008019000).stop 2023-11-15T02:55:51.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.529+0000 7f9016028700 1 -- 172.21.15.1:0/1673541051 shutdown_connections 2023-11-15T02:55:51.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.529+0000 7f9016028700 1 --2- 172.21.15.1:0/1673541051 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8ffc05f270 0x7f8ffc061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.529+0000 7f9016028700 1 --2- 172.21.15.1:0/1673541051 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90100638c0 0x7f9010063d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.529+0000 7f9016028700 1 --2- 172.21.15.1:0/1673541051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff80038e0 0x7f90100aceb0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.529+0000 7f9016028700 1 --2- 172.21.15.1:0/1673541051 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90101597d0 0x7f9010152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.529+0000 7f9016028700 1 -- 172.21.15.1:0/1673541051 >> 172.21.15.1:0/1673541051 conn(0x7f9010062f90 msgr2=0x7f90100c4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:51.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.529+0000 7f9016028700 1 -- 172.21.15.1:0/1673541051 shutdown_connections 2023-11-15T02:55:51.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.529+0000 7f9016028700 1 -- 172.21.15.1:0/1673541051 wait complete. 2023-11-15T02:55:51.534 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 1 to deep-scrub 2023-11-15T02:55:51.543 INFO:tasks.ceph:Scrubbing osd.2 2023-11-15T02:55:51.543 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-15T02:55:51.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.663+0000 7f84a597c700 1 Processor -- start 2023-11-15T02:55:51.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.663+0000 7f84a597c700 1 -- start start 2023-11-15T02:55:51.668 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.664+0000 7f84a597c700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f84a0157660 0x7f84a0157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.664+0000 7f84a597c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84a00aa060 0x7f84a00aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.664+0000 7f84a597c700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a00c1820 con 0x7f84a00c1cb0 2023-11-15T02:55:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.664+0000 7f84a597c700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a00c7540 con 0x7f84a0157660 2023-11-15T02:55:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.664+0000 7f84a597c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a00aa9e0 con 0x7f84a00aa060 2023-11-15T02:55:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.664+0000 7f849effd700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f84a0157660 0x7f84a0157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.664+0000 7f849f7fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84a00aa060 0x7f84a00aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.665+0000 7f849effd700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f84a0157660 0x7f84a0157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.1:33626/0 (socket says 172.21.15.1:33626) 2023-11-15T02:55:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.665+0000 7f849f7fe700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84a00aa060 0x7f84a00aa4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.1:50104/0 (socket says 172.21.15.1:50104) 2023-11-15T02:55:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.665+0000 7f849e7fc700 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f84a00c1cb0 0x7f84a00c6280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.1:33646/0 (socket says 172.21.15.1:33646) 2023-11-15T02:55:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.665+0000 7f849effd700 1 -- 172.21.15.1:0/3819270313 learned_addr learned my addr 172.21.15.1:0/3819270313 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.665+0000 7f849effd700 1 -- 172.21.15.1:0/3819270313 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84a00aa060 msgr2=0x7f84a00aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.665+0000 7f849effd700 1 --2- 172.21.15.1:0/3819270313 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84a00aa060 0x7f84a00aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.665+0000 7f849effd700 1 -- 172.21.15.1:0/3819270313 >> v1:172.21.15.141:6789/0 conn(0x7f84a00c1cb0 legacy=0x7f84a00c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.665+0000 7f849dffb700 1 -- 172.21.15.1:0/3819270313 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303458248 0 0) 0x7f84a00c1820 con 0x7f84a00c1cb0 2023-11-15T02:55:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.665+0000 7f849effd700 1 -- 172.21.15.1:0/3819270313 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a00c0c30 con 0x7f84a0157660 2023-11-15T02:55:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.665+0000 7f849effd700 1 --2- 172.21.15.1:0/3819270313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84a0157660 0x7f84a0157a40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f8490009f20 tx=0x7f8490009840).ready entity=mon.1 client_cookie=3a226254664268db server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.665+0000 7f849dffb700 1 -- 172.21.15.1:0/3819270313 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849000e070 con 0x7f84a0157660 2023-11-15T02:55:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.665+0000 7f849dffb700 1 -- 172.21.15.1:0/3819270313 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849000b9d0 con 0x7f84a0157660 2023-11-15T02:55:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.665+0000 7f849dffb700 1 -- 172.21.15.1:0/3819270313 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849000bd50 con 0x7f84a0157660 2023-11-15T02:55:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.666+0000 7f84a597c700 1 -- 172.21.15.1:0/3819270313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84a0157660 msgr2=0x7f84a0157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.666+0000 7f84a597c700 1 --2- 172.21.15.1:0/3819270313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84a0157660 0x7f84a0157a40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f8490009f20 tx=0x7f8490009840).stop 2023-11-15T02:55:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.666+0000 7f84a597c700 1 -- 172.21.15.1:0/3819270313 shutdown_connections 2023-11-15T02:55:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.666+0000 7f84a597c700 1 --2- 172.21.15.1:0/3819270313 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84a00aa060 0x7f84a00aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.666+0000 7f84a597c700 1 --2- 172.21.15.1:0/3819270313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84a0157660 0x7f84a0157a40 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.666+0000 7f84a597c700 1 -- 172.21.15.1:0/3819270313 >> 172.21.15.1:0/3819270313 conn(0x7f84a0064aa0 msgr2=0x7f84a0064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.666+0000 7f84a597c700 1 -- 172.21.15.1:0/3819270313 shutdown_connections 2023-11-15T02:55:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.666+0000 7f84a597c700 1 -- 172.21.15.1:0/3819270313 wait complete. 2023-11-15T02:55:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.667+0000 7f84a597c700 1 Processor -- start 2023-11-15T02:55:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.667+0000 7f84a597c700 1 -- start start 2023-11-15T02:55:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f84a597c700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84a00aa060 0x7f84a0168960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f84a597c700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84a00c1cb0 0x7f84a0147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f84a597c700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84a0157660 0x7f84a01493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f84a597c700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a0152d60 con 0x7f84a0157660 2023-11-15T02:55:51.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f84a597c700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a0147f20 con 0x7f84a00c1cb0 2023-11-15T02:55:51.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f84a597c700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a00af160 con 0x7f84a00aa060 2023-11-15T02:55:51.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f849f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84a0157660 0x7f84a01493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f849f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84a0157660 0x7f84a01493b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43542/0 (socket says 172.21.15.1:43542) 2023-11-15T02:55:51.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f849f7fe700 1 -- 172.21.15.1:0/2845808724 learned_addr learned my addr 172.21.15.1:0/2845808724 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:51.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f849effd700 1 --2- 172.21.15.1:0/2845808724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84a00aa060 0x7f84a0168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f849e7fc700 1 --2- 172.21.15.1:0/2845808724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84a00c1cb0 0x7f84a0147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f849f7fe700 1 -- 172.21.15.1:0/2845808724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84a00aa060 msgr2=0x7f84a0168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f849f7fe700 1 --2- 172.21.15.1:0/2845808724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84a00aa060 0x7f84a0168960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f849f7fe700 1 -- 172.21.15.1:0/2845808724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84a00c1cb0 msgr2=0x7f84a0147330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f849f7fe700 1 --2- 172.21.15.1:0/2845808724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84a00c1cb0 0x7f84a0147330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f849f7fe700 1 -- 172.21.15.1:0/2845808724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490009ae0 con 0x7f84a0157660 2023-11-15T02:55:51.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.668+0000 7f849f7fe700 1 --2- 172.21.15.1:0/2845808724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84a0157660 0x7f84a01493b0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f849800e8d0 tx=0x7f8498009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:51.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.669+0000 7f8496ffd700 1 -- 172.21.15.1:0/2845808724 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498009530 con 0x7f84a0157660 2023-11-15T02:55:51.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.669+0000 7f8496ffd700 1 -- 172.21.15.1:0/2845808724 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8498012600 con 0x7f84a0157660 2023-11-15T02:55:51.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.669+0000 7f84a597c700 1 -- 172.21.15.1:0/2845808724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a00ae870 con 0x7f84a0157660 2023-11-15T02:55:51.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.669+0000 7f8496ffd700 1 -- 172.21.15.1:0/2845808724 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498012980 con 0x7f84a0157660 2023-11-15T02:55:51.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.669+0000 7f84a597c700 1 -- 172.21.15.1:0/2845808724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a00aedf0 con 0x7f84a0157660 2023-11-15T02:55:51.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.669+0000 7f84a597c700 1 -- 172.21.15.1:0/2845808724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f84a00655d0 con 0x7f84a0157660 2023-11-15T02:55:51.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.670+0000 7f8496ffd700 1 -- 172.21.15.1:0/2845808724 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8498012d30 con 0x7f84a0157660 2023-11-15T02:55:51.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.670+0000 7f8496ffd700 1 --2- 172.21.15.1:0/2845808724 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f848005f270 0x7f8480061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.670+0000 7f8496ffd700 1 -- 172.21.15.1:0/2845808724 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f849807a880 con 0x7f84a0157660 2023-11-15T02:55:51.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.671+0000 7f849effd700 1 --2- 172.21.15.1:0/2845808724 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f848005f270 0x7f8480061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.671+0000 7f8496ffd700 1 --2- 172.21.15.1:0/2845808724 >> [v2:172.21.15.1:6808/90915,v1:172.21.15.1:6809/90915] conn(0x7f8480066210 0x7f84800686b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.671+0000 7f8496ffd700 1 -- 172.21.15.1:0/2845808724 --> [v2:172.21.15.1:6808/90915,v1:172.21.15.1:6809/90915] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8480068c90 con 0x7f8480066210 2023-11-15T02:55:51.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.671+0000 7f8496ffd700 1 -- 172.21.15.1:0/2845808724 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7f849807f240 con 0x7f84a0157660 2023-11-15T02:55:51.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.671+0000 7f849e7fc700 1 --2- 172.21.15.1:0/2845808724 >> [v2:172.21.15.1:6808/90915,v1:172.21.15.1:6809/90915] conn(0x7f8480066210 0x7f84800686b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.671+0000 7f849effd700 1 --2- 172.21.15.1:0/2845808724 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f848005f270 0x7f8480061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8490009930 tx=0x7f8490009840).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:51.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.671+0000 7f849e7fc700 1 --2- 172.21.15.1:0/2845808724 >> [v2:172.21.15.1:6808/90915,v1:172.21.15.1:6809/90915] conn(0x7f8480066210 0x7f84800686b0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:51.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.672+0000 7f8496ffd700 1 -- 172.21.15.1:0/2845808724 <== osd.2 v2:172.21.15.1:6808/90915 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f8480068c90 con 0x7f8480066210 2023-11-15T02:55:51.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.685+0000 7f84a597c700 1 -- 172.21.15.1:0/2845808724 --> [v2:172.21.15.1:6808/90915,v1:172.21.15.1:6809/90915] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f84a006c7e0 con 0x7f8480066210 2023-11-15T02:55:51.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.685+0000 7f8496ffd700 1 -- 172.21.15.1:0/2845808724 <== osd.2 v2:172.21.15.1:6808/90915 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f84a006c7e0 con 0x7f8480066210 2023-11-15T02:55:51.687 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:55:51.688 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-15T02:55:51.688 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:55:51.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.685+0000 7f84a597c700 1 -- 172.21.15.1:0/2845808724 >> [v2:172.21.15.1:6808/90915,v1:172.21.15.1:6809/90915] conn(0x7f8480066210 msgr2=0x7f84800686b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.685+0000 7f84a597c700 1 --2- 172.21.15.1:0/2845808724 >> [v2:172.21.15.1:6808/90915,v1:172.21.15.1:6809/90915] conn(0x7f8480066210 0x7f84800686b0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.686+0000 7f84a597c700 1 -- 172.21.15.1:0/2845808724 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f848005f270 msgr2=0x7f8480061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.686+0000 7f84a597c700 1 --2- 172.21.15.1:0/2845808724 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f848005f270 0x7f8480061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8490009930 tx=0x7f8490009840).stop 2023-11-15T02:55:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.686+0000 7f84a597c700 1 -- 172.21.15.1:0/2845808724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84a0157660 msgr2=0x7f84a01493b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.686+0000 7f84a597c700 1 --2- 172.21.15.1:0/2845808724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84a0157660 0x7f84a01493b0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f849800e8d0 tx=0x7f8498009060).stop 2023-11-15T02:55:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.686+0000 7f849f7fe700 1 -- 172.21.15.1:0/2845808724 reap_dead start 2023-11-15T02:55:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.686+0000 7f84a597c700 1 -- 172.21.15.1:0/2845808724 shutdown_connections 2023-11-15T02:55:51.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.686+0000 7f84a597c700 1 -- 172.21.15.1:0/2845808724 >> 172.21.15.1:0/2845808724 conn(0x7f84a0064aa0 msgr2=0x7f84a0153b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:51.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.686+0000 7f84a597c700 1 -- 172.21.15.1:0/2845808724 shutdown_connections 2023-11-15T02:55:51.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.686+0000 7f84a597c700 1 -- 172.21.15.1:0/2845808724 wait complete. 2023-11-15T02:55:51.699 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-15T02:55:51.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.816+0000 7f647b579700 1 Processor -- start 2023-11-15T02:55:51.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.817+0000 7f647b579700 1 -- start start 2023-11-15T02:55:51.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.817+0000 7f647b579700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f64740be520 0x7f64740a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.817+0000 7f647b579700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64740a85e0 con 0x7f6474154450 2023-11-15T02:55:51.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.817+0000 7f647b579700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6474065660 con 0x7f64740833a0 2023-11-15T02:55:51.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.817+0000 7f647b579700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6474065940 con 0x7f64740be520 2023-11-15T02:55:51.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.817+0000 7f6479b16700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f64740be520 0x7f64740a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.818+0000 7f6479b16700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f64740be520 0x7f64740a7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43558/0 (socket says 172.21.15.1:43558) 2023-11-15T02:55:51.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.818+0000 7f6479b16700 1 -- 172.21.15.1:0/1144763446 learned_addr learned my addr 172.21.15.1:0/1144763446 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:51.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.818+0000 7f6479b16700 1 -- 172.21.15.1:0/1144763446 >> v1:172.21.15.141:6789/0 conn(0x7f64740833a0 legacy=0x7f64740c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:51.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.818+0000 7f6479b16700 1 -- 172.21.15.1:0/1144763446 >> v1:172.21.15.1:6789/0 conn(0x7f6474154450 legacy=0x7f64740bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.818+0000 7f6479b16700 1 -- 172.21.15.1:0/1144763446 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64740c6f50 con 0x7f64740be520 2023-11-15T02:55:51.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.818+0000 7f6479b16700 1 --2- 172.21.15.1:0/1144763446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64740be520 0x7f64740a7ef0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7f6464009f20 tx=0x7f6464009840).ready entity=mon.0 client_cookie=c5a032ce1a5174c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:51.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.818+0000 7f6473fff700 1 -- 172.21.15.1:0/1144763446 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646400e070 con 0x7f64740be520 2023-11-15T02:55:51.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.818+0000 7f6473fff700 1 -- 172.21.15.1:0/1144763446 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646400ba40 con 0x7f64740be520 2023-11-15T02:55:51.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.818+0000 7f6473fff700 1 -- 172.21.15.1:0/1144763446 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646400bdc0 con 0x7f64740be520 2023-11-15T02:55:51.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.819+0000 7f647b579700 1 -- 172.21.15.1:0/1144763446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64740be520 msgr2=0x7f64740a7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.819+0000 7f647b579700 1 --2- 172.21.15.1:0/1144763446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64740be520 0x7f64740a7ef0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7f6464009f20 tx=0x7f6464009840).stop 2023-11-15T02:55:51.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.819+0000 7f647b579700 1 -- 172.21.15.1:0/1144763446 shutdown_connections 2023-11-15T02:55:51.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.819+0000 7f647b579700 1 --2- 172.21.15.1:0/1144763446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64740be520 0x7f64740a7ef0 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.819+0000 7f647b579700 1 -- 172.21.15.1:0/1144763446 >> 172.21.15.1:0/1144763446 conn(0x7f6474082f90 msgr2=0x7f64740c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:51.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.819+0000 7f647b579700 1 -- 172.21.15.1:0/1144763446 shutdown_connections 2023-11-15T02:55:51.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.819+0000 7f647b579700 1 -- 172.21.15.1:0/1144763446 wait complete. 2023-11-15T02:55:51.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.820+0000 7f647b579700 1 Processor -- start 2023-11-15T02:55:51.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.820+0000 7f647b579700 1 -- start start 2023-11-15T02:55:51.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f647b579700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64740833a0 0x7f64740c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f647b579700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64740be520 0x7f64740a9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f647b579700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6474154450 0x7f647414e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f647b579700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64740a9810 con 0x7f64740be520 2023-11-15T02:55:51.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f647b579700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647414e770 con 0x7f6474154450 2023-11-15T02:55:51.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f647b579700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64740a9a90 con 0x7f64740833a0 2023-11-15T02:55:51.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f6478b14700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64740be520 0x7f64740a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f6478b14700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64740be520 0x7f64740a9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43574/0 (socket says 172.21.15.1:43574) 2023-11-15T02:55:51.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f6478b14700 1 -- 172.21.15.1:0/4023207568 learned_addr learned my addr 172.21.15.1:0/4023207568 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:51.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f6479315700 1 --2- 172.21.15.1:0/4023207568 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64740833a0 0x7f64740c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f6479b16700 1 --2- 172.21.15.1:0/4023207568 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6474154450 0x7f647414e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f6478b14700 1 -- 172.21.15.1:0/4023207568 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64740833a0 msgr2=0x7f64740c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f6478b14700 1 --2- 172.21.15.1:0/4023207568 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64740833a0 0x7f64740c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f6478b14700 1 -- 172.21.15.1:0/4023207568 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6474154450 msgr2=0x7f647414e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:51.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f6478b14700 1 --2- 172.21.15.1:0/4023207568 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6474154450 0x7f647414e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:51.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.821+0000 7f6478b14700 1 -- 172.21.15.1:0/4023207568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6464009ae0 con 0x7f64740be520 2023-11-15T02:55:51.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.822+0000 7f6478b14700 1 --2- 172.21.15.1:0/4023207568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64740be520 0x7f64740a9320 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7f646800c440 tx=0x7f6468007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:51.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.822+0000 7f64717fa700 1 -- 172.21.15.1:0/4023207568 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468012400 con 0x7f64740be520 2023-11-15T02:55:51.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.822+0000 7f64717fa700 1 -- 172.21.15.1:0/4023207568 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6468012580 con 0x7f64740be520 2023-11-15T02:55:51.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.822+0000 7f647b579700 1 -- 172.21.15.1:0/4023207568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64740a9d70 con 0x7f64740be520 2023-11-15T02:55:51.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.822+0000 7f64717fa700 1 -- 172.21.15.1:0/4023207568 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468012940 con 0x7f64740be520 2023-11-15T02:55:51.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.822+0000 7f647b579700 1 -- 172.21.15.1:0/4023207568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64740aa330 con 0x7f64740be520 2023-11-15T02:55:51.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.823+0000 7f647b579700 1 -- 172.21.15.1:0/4023207568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64740aa660 con 0x7f64740be520 2023-11-15T02:55:51.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.823+0000 7f64717fa700 1 -- 172.21.15.1:0/4023207568 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6468012d30 con 0x7f64740be520 2023-11-15T02:55:51.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.823+0000 7f64717fa700 1 --2- 172.21.15.1:0/4023207568 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f646005f270 0x7f6460061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:51.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.824+0000 7f64717fa700 1 -- 172.21.15.1:0/4023207568 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f6468079950 con 0x7f64740be520 2023-11-15T02:55:51.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.824+0000 7f6479315700 1 --2- 172.21.15.1:0/4023207568 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f646005f270 0x7f6460061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:51.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.824+0000 7f6479315700 1 --2- 172.21.15.1:0/4023207568 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f646005f270 0x7f6460061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f646c003780 tx=0x7f646c007d20).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:51.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.828+0000 7f64717fa700 1 -- 172.21.15.1:0/4023207568 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6468048af0 con 0x7f64740be520 2023-11-15T02:55:52.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:51.999+0000 7f647b579700 1 -- 172.21.15.1:0/4023207568 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6474065350 con 0x7f646005f270 2023-11-15T02:55:52.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.000+0000 7f64717fa700 1 -- 172.21.15.1:0/4023207568 <== mgr.9370 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6474065350 con 0x7f646005f270 2023-11-15T02:55:52.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.002+0000 7f647b579700 1 -- 172.21.15.1:0/4023207568 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f646005f270 msgr2=0x7f6460061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.002+0000 7f647b579700 1 --2- 172.21.15.1:0/4023207568 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f646005f270 0x7f6460061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f646c003780 tx=0x7f646c007d20).stop 2023-11-15T02:55:52.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.002+0000 7f647b579700 1 -- 172.21.15.1:0/4023207568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64740be520 msgr2=0x7f64740a9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.002+0000 7f647b579700 1 --2- 172.21.15.1:0/4023207568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64740be520 0x7f64740a9320 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7f646800c440 tx=0x7f6468007de0).stop 2023-11-15T02:55:52.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.002+0000 7f647b579700 1 -- 172.21.15.1:0/4023207568 shutdown_connections 2023-11-15T02:55:52.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.002+0000 7f647b579700 1 --2- 172.21.15.1:0/4023207568 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f646005f270 0x7f6460061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.002+0000 7f647b579700 1 --2- 172.21.15.1:0/4023207568 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6474154450 0x7f647414e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.002+0000 7f647b579700 1 --2- 172.21.15.1:0/4023207568 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f64740833a0 0x7f64740c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.002+0000 7f647b579700 1 --2- 172.21.15.1:0/4023207568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64740be520 0x7f64740a9320 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.002+0000 7f647b579700 1 -- 172.21.15.1:0/4023207568 >> 172.21.15.1:0/4023207568 conn(0x7f6474082f90 msgr2=0x7f64740c5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:52.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.002+0000 7f647b579700 1 -- 172.21.15.1:0/4023207568 shutdown_connections 2023-11-15T02:55:52.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.002+0000 7f647b579700 1 -- 172.21.15.1:0/4023207568 wait complete. 2023-11-15T02:55:52.007 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 2 to deep-scrub 2023-11-15T02:55:52.016 INFO:tasks.ceph:Scrubbing osd.3 2023-11-15T02:55:52.016 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-15T02:55:52.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.136+0000 7f9796243700 1 Processor -- start 2023-11-15T02:55:52.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.136+0000 7f9796243700 1 -- start start 2023-11-15T02:55:52.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.137+0000 7f9796243700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f979014b350 0x7f97900c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.137+0000 7f9796243700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97900aa750 0x7f9790154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.137+0000 7f9796243700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97901580d0 con 0x7f979014b730 2023-11-15T02:55:52.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.137+0000 7f9796243700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9790155000 con 0x7f979014b350 2023-11-15T02:55:52.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.137+0000 7f9796243700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97901552e0 con 0x7f97900aa750 2023-11-15T02:55:52.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.137+0000 7f978f7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f979014b350 0x7f97900c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.137+0000 7f978f7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f979014b350 0x7f97900c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43590/0 (socket says 172.21.15.1:43590) 2023-11-15T02:55:52.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.137+0000 7f978f7fe700 1 -- 172.21.15.1:0/802713862 learned_addr learned my addr 172.21.15.1:0/802713862 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:52.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.138+0000 7f978ffff700 1 --2- 172.21.15.1:0/802713862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97900aa750 0x7f9790154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.138+0000 7f978f7fe700 1 -- 172.21.15.1:0/802713862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97900aa750 msgr2=0x7f9790154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:52.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.138+0000 7f978f7fe700 1 --2- 172.21.15.1:0/802713862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97900aa750 0x7f9790154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.138+0000 7f978f7fe700 1 -- 172.21.15.1:0/802713862 >> v1:172.21.15.141:6789/0 conn(0x7f979014b730 legacy=0x7f97900aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.138+0000 7f978f7fe700 1 -- 172.21.15.1:0/802713862 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97901555c0 con 0x7f979014b350 2023-11-15T02:55:52.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.138+0000 7f978ffff700 1 --2- 172.21.15.1:0/802713862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97900aa750 0x7f9790154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:52.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.138+0000 7f978f7fe700 1 --2- 172.21.15.1:0/802713862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f979014b350 0x7f97900c8290 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 rx=0x7f9780006fd0 tx=0x7f97800090f0).ready entity=mon.0 client_cookie=f664e1ef58caac9b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:52.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.138+0000 7f978e7fc700 1 -- 172.21.15.1:0/802713862 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978000b600 con 0x7f979014b350 2023-11-15T02:55:52.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.138+0000 7f978e7fc700 1 -- 172.21.15.1:0/802713862 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978000b760 con 0x7f979014b350 2023-11-15T02:55:52.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.138+0000 7f978e7fc700 1 -- 172.21.15.1:0/802713862 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978000bae0 con 0x7f979014b350 2023-11-15T02:55:52.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.139+0000 7f9796243700 1 -- 172.21.15.1:0/802713862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f979014b350 msgr2=0x7f97900c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.139+0000 7f9796243700 1 --2- 172.21.15.1:0/802713862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f979014b350 0x7f97900c8290 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 rx=0x7f9780006fd0 tx=0x7f97800090f0).stop 2023-11-15T02:55:52.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.139+0000 7f9796243700 1 -- 172.21.15.1:0/802713862 shutdown_connections 2023-11-15T02:55:52.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.139+0000 7f9796243700 1 --2- 172.21.15.1:0/802713862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97900aa750 0x7f9790154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.139+0000 7f9796243700 1 --2- 172.21.15.1:0/802713862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f979014b350 0x7f97900c8290 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.139+0000 7f9796243700 1 -- 172.21.15.1:0/802713862 >> 172.21.15.1:0/802713862 conn(0x7f9790069ee0 msgr2=0x7f979006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:52.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.139+0000 7f9796243700 1 -- 172.21.15.1:0/802713862 shutdown_connections 2023-11-15T02:55:52.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.139+0000 7f9796243700 1 -- 172.21.15.1:0/802713862 wait complete. 2023-11-15T02:55:52.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.140+0000 7f9796243700 1 Processor -- start 2023-11-15T02:55:52.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.140+0000 7f9796243700 1 -- start start 2023-11-15T02:55:52.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f9796243700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97900aa750 0x7f97900c3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f9796243700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f979014b350 0x7f97900c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f9796243700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f979014b730 0x7f97900c2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f9796243700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97901474b0 con 0x7f97900aa750 2023-11-15T02:55:52.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f9796243700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97900c3bb0 con 0x7f979014b350 2023-11-15T02:55:52.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f9796243700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97900c2b80 con 0x7f979014b730 2023-11-15T02:55:52.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f978f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97900aa750 0x7f97900c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f978f7fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97900aa750 0x7f97900c3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43602/0 (socket says 172.21.15.1:43602) 2023-11-15T02:55:52.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f978f7fe700 1 -- 172.21.15.1:0/3802927724 learned_addr learned my addr 172.21.15.1:0/3802927724 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:52.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f978effd700 1 --2- 172.21.15.1:0/3802927724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f979014b350 0x7f97900c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f978ffff700 1 --2- 172.21.15.1:0/3802927724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f979014b730 0x7f97900c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f978f7fe700 1 -- 172.21.15.1:0/3802927724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f979014b730 msgr2=0x7f97900c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f978f7fe700 1 --2- 172.21.15.1:0/3802927724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f979014b730 0x7f97900c2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f978f7fe700 1 -- 172.21.15.1:0/3802927724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f979014b350 msgr2=0x7f97900c21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f978f7fe700 1 --2- 172.21.15.1:0/3802927724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f979014b350 0x7f97900c21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f978f7fe700 1 -- 172.21.15.1:0/3802927724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9780009370 con 0x7f97900aa750 2023-11-15T02:55:52.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f978effd700 1 --2- 172.21.15.1:0/3802927724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f979014b350 0x7f97900c21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:52.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f978f7fe700 1 --2- 172.21.15.1:0/3802927724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97900aa750 0x7f97900c3050 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7f9780009f50 tx=0x7f9780017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:52.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f97777fe700 1 -- 172.21.15.1:0/3802927724 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780006a40 con 0x7f97900aa750 2023-11-15T02:55:52.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f97777fe700 1 -- 172.21.15.1:0/3802927724 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978000b8d0 con 0x7f97900aa750 2023-11-15T02:55:52.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.141+0000 7f9796243700 1 -- 172.21.15.1:0/3802927724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97900c9a10 con 0x7f97900aa750 2023-11-15T02:55:52.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.142+0000 7f97777fe700 1 -- 172.21.15.1:0/3802927724 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978001b620 con 0x7f97900aa750 2023-11-15T02:55:52.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.142+0000 7f9796243700 1 -- 172.21.15.1:0/3802927724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97900c38d0 con 0x7f97900aa750 2023-11-15T02:55:52.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.142+0000 7f9796243700 1 -- 172.21.15.1:0/3802927724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9790154310 con 0x7f97900aa750 2023-11-15T02:55:52.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.143+0000 7f97777fe700 1 -- 172.21.15.1:0/3802927724 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f978001ba10 con 0x7f97900aa750 2023-11-15T02:55:52.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.143+0000 7f97777fe700 1 --2- 172.21.15.1:0/3802927724 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f977c05f270 0x7f977c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.143+0000 7f97777fe700 1 -- 172.21.15.1:0/3802927724 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f978007bef0 con 0x7f97900aa750 2023-11-15T02:55:52.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.143+0000 7f97777fe700 1 --2- 172.21.15.1:0/3802927724 >> [v2:172.21.15.1:6824/90920,v1:172.21.15.1:6825/90920] conn(0x7f977c066220 0x7f977c0686c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.143+0000 7f97777fe700 1 -- 172.21.15.1:0/3802927724 --> [v2:172.21.15.1:6824/90920,v1:172.21.15.1:6825/90920] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f977c068ca0 con 0x7f977c066220 2023-11-15T02:55:52.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.143+0000 7f97777fe700 1 -- 172.21.15.1:0/3802927724 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7f978007e540 con 0x7f97900aa750 2023-11-15T02:55:52.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.143+0000 7f978effd700 1 --2- 172.21.15.1:0/3802927724 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f977c05f270 0x7f977c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.143+0000 7f978ffff700 1 --2- 172.21.15.1:0/3802927724 >> [v2:172.21.15.1:6824/90920,v1:172.21.15.1:6825/90920] conn(0x7f977c066220 0x7f977c0686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.144+0000 7f978ffff700 1 --2- 172.21.15.1:0/3802927724 >> [v2:172.21.15.1:6824/90920,v1:172.21.15.1:6825/90920] conn(0x7f977c066220 0x7f977c0686c0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:52.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.144+0000 7f978effd700 1 --2- 172.21.15.1:0/3802927724 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f977c05f270 0x7f977c061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f97900c14f0 tx=0x7f9784009040).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:52.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.144+0000 7f97777fe700 1 -- 172.21.15.1:0/3802927724 <== osd.3 v2:172.21.15.1:6824/90920 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f977c068ca0 con 0x7f977c066220 2023-11-15T02:55:52.166 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.158+0000 7f9796243700 1 -- 172.21.15.1:0/3802927724 --> [v2:172.21.15.1:6824/90920,v1:172.21.15.1:6825/90920] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f979006c7e0 con 0x7f977c066220 2023-11-15T02:55:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.158+0000 7f97777fe700 1 -- 172.21.15.1:0/3802927724 <== osd.3 v2:172.21.15.1:6824/90920 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f979006c7e0 con 0x7f977c066220 2023-11-15T02:55:52.167 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:55:52.168 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-15T02:55:52.168 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:55:52.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.158+0000 7f9796243700 1 -- 172.21.15.1:0/3802927724 >> [v2:172.21.15.1:6824/90920,v1:172.21.15.1:6825/90920] conn(0x7f977c066220 msgr2=0x7f977c0686c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.158+0000 7f9796243700 1 --2- 172.21.15.1:0/3802927724 >> [v2:172.21.15.1:6824/90920,v1:172.21.15.1:6825/90920] conn(0x7f977c066220 0x7f977c0686c0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.158+0000 7f9796243700 1 -- 172.21.15.1:0/3802927724 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f977c05f270 msgr2=0x7f977c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.158+0000 7f9796243700 1 --2- 172.21.15.1:0/3802927724 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f977c05f270 0x7f977c061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f97900c14f0 tx=0x7f9784009040).stop 2023-11-15T02:55:52.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.158+0000 7f9796243700 1 -- 172.21.15.1:0/3802927724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97900aa750 msgr2=0x7f97900c3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.158+0000 7f9796243700 1 --2- 172.21.15.1:0/3802927724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97900aa750 0x7f97900c3050 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7f9780009f50 tx=0x7f9780017000).stop 2023-11-15T02:55:52.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.158+0000 7f978ffff700 1 -- 172.21.15.1:0/3802927724 reap_dead start 2023-11-15T02:55:52.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.158+0000 7f9796243700 1 -- 172.21.15.1:0/3802927724 shutdown_connections 2023-11-15T02:55:52.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.158+0000 7f9796243700 1 -- 172.21.15.1:0/3802927724 >> 172.21.15.1:0/3802927724 conn(0x7f9790069ee0 msgr2=0x7f979006a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:52.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.158+0000 7f9796243700 1 -- 172.21.15.1:0/3802927724 shutdown_connections 2023-11-15T02:55:52.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.158+0000 7f9796243700 1 -- 172.21.15.1:0/3802927724 wait complete. 2023-11-15T02:55:52.174 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-15T02:55:52.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.293+0000 7f95f593b700 1 Processor -- start 2023-11-15T02:55:52.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.293+0000 7f95f593b700 1 -- start start 2023-11-15T02:55:52.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.294+0000 7f95f593b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95f00ca9b0 0x7f95f00c0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.294+0000 7f95f593b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f95f006a6c0 0x7f95f00c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.294+0000 7f95f593b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f01559e0 con 0x7f95f00c8390 2023-11-15T02:55:52.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.294+0000 7f95f593b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f00c15b0 con 0x7f95f006a6c0 2023-11-15T02:55:52.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.294+0000 7f95f593b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00c7560 con 0x7f95f00ca9b0 2023-11-15T02:55:52.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.294+0000 7f95ef7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f95f006a6c0 0x7f95f00c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.294+0000 7f95ef7fe700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f95f006a6c0 0x7f95f00c10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43618/0 (socket says 172.21.15.1:43618) 2023-11-15T02:55:52.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.294+0000 7f95ef7fe700 1 -- 172.21.15.1:0/1692132226 learned_addr learned my addr 172.21.15.1:0/1692132226 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:52.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.294+0000 7f95ef7fe700 1 -- 172.21.15.1:0/1692132226 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95f00ca9b0 msgr2=0x7f95f00c0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:52.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.294+0000 7f95ef7fe700 1 --2- 172.21.15.1:0/1692132226 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95f00ca9b0 0x7f95f00c0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:52.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.294+0000 7f95ef7fe700 1 -- 172.21.15.1:0/1692132226 >> v1:172.21.15.141:6789/0 conn(0x7f95f00c8390 legacy=0x7f95f014e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:52.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.294+0000 7f95ef7fe700 1 -- 172.21.15.1:0/1692132226 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f0154dd0 con 0x7f95f006a6c0 2023-11-15T02:55:52.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.295+0000 7f95ef7fe700 1 --2- 172.21.15.1:0/1692132226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95f006a6c0 0x7f95f00c10c0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7f95e0009f20 tx=0x7f95e0009840).ready entity=mon.0 client_cookie=3799302d75eff1fb server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:52.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.295+0000 7f95edffb700 1 -- 172.21.15.1:0/1692132226 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e000e070 con 0x7f95f006a6c0 2023-11-15T02:55:52.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.295+0000 7f95edffb700 1 -- 172.21.15.1:0/1692132226 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e000ba40 con 0x7f95f006a6c0 2023-11-15T02:55:52.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.295+0000 7f95edffb700 1 -- 172.21.15.1:0/1692132226 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e000bdc0 con 0x7f95f006a6c0 2023-11-15T02:55:52.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.295+0000 7f95f593b700 1 -- 172.21.15.1:0/1692132226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95f006a6c0 msgr2=0x7f95f00c10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.295+0000 7f95f593b700 1 --2- 172.21.15.1:0/1692132226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95f006a6c0 0x7f95f00c10c0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7f95e0009f20 tx=0x7f95e0009840).stop 2023-11-15T02:55:52.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.295+0000 7f95f593b700 1 -- 172.21.15.1:0/1692132226 shutdown_connections 2023-11-15T02:55:52.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.295+0000 7f95f593b700 1 --2- 172.21.15.1:0/1692132226 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95f00ca9b0 0x7f95f00c0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:52.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.295+0000 7f95f593b700 1 --2- 172.21.15.1:0/1692132226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95f006a6c0 0x7f95f00c10c0 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.295+0000 7f95f593b700 1 -- 172.21.15.1:0/1692132226 >> 172.21.15.1:0/1692132226 conn(0x7f95f0084ec0 msgr2=0x7f95f00947e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:52.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.295+0000 7f95f593b700 1 -- 172.21.15.1:0/1692132226 shutdown_connections 2023-11-15T02:55:52.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.295+0000 7f95f593b700 1 -- 172.21.15.1:0/1692132226 wait complete. 2023-11-15T02:55:52.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.297+0000 7f95f593b700 1 Processor -- start 2023-11-15T02:55:52.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.297+0000 7f95f593b700 1 -- start start 2023-11-15T02:55:52.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.297+0000 7f95f593b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95f006a6c0 0x7f95f00c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.297+0000 7f95f593b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95f00c8390 0x7f95f00965e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.297+0000 7f95f593b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f95f00ca9b0 0x7f95f0168020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.297+0000 7f95f593b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f0097bf0 con 0x7f95f00c8390 2023-11-15T02:55:52.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.297+0000 7f95f593b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f0096fe0 con 0x7f95f00ca9b0 2023-11-15T02:55:52.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.297+0000 7f95f593b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00972c0 con 0x7f95f006a6c0 2023-11-15T02:55:52.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.297+0000 7f95ee7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95f00c8390 0x7f95f00965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.297+0000 7f95ee7fc700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95f00c8390 0x7f95f00965e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43624/0 (socket says 172.21.15.1:43624) 2023-11-15T02:55:52.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.297+0000 7f95ee7fc700 1 -- 172.21.15.1:0/2721453550 learned_addr learned my addr 172.21.15.1:0/2721453550 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:52.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.298+0000 7f95ee7fc700 1 -- 172.21.15.1:0/2721453550 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95f006a6c0 msgr2=0x7f95f00c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.298+0000 7f95ee7fc700 1 --2- 172.21.15.1:0/2721453550 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95f006a6c0 0x7f95f00c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:52.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.298+0000 7f95ee7fc700 1 -- 172.21.15.1:0/2721453550 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f95f00ca9b0 msgr2=0x7f95f0168020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.298+0000 7f95ef7fe700 1 --2- 172.21.15.1:0/2721453550 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f95f00ca9b0 0x7f95f0168020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.298+0000 7f95ee7fc700 1 --2- 172.21.15.1:0/2721453550 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f95f00ca9b0 0x7f95f0168020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.298+0000 7f95ee7fc700 1 -- 172.21.15.1:0/2721453550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e0009ae0 con 0x7f95f00c8390 2023-11-15T02:55:52.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.298+0000 7f95ee7fc700 1 --2- 172.21.15.1:0/2721453550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95f00c8390 0x7f95f00965e0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 rx=0x7f95d800b490 tx=0x7f95d8006f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:52.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.298+0000 7f95e6ffd700 1 -- 172.21.15.1:0/2721453550 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8012410 con 0x7f95f00c8390 2023-11-15T02:55:52.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.298+0000 7f95e6ffd700 1 -- 172.21.15.1:0/2721453550 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d8012570 con 0x7f95f00c8390 2023-11-15T02:55:52.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.298+0000 7f95f593b700 1 -- 172.21.15.1:0/2721453550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f00975a0 con 0x7f95f00c8390 2023-11-15T02:55:52.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.298+0000 7f95e6ffd700 1 -- 172.21.15.1:0/2721453550 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8012930 con 0x7f95f00c8390 2023-11-15T02:55:52.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.298+0000 7f95f593b700 1 -- 172.21.15.1:0/2721453550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f0094e50 con 0x7f95f00c8390 2023-11-15T02:55:52.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.299+0000 7f95f593b700 1 -- 172.21.15.1:0/2721453550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f0065430 con 0x7f95f00c8390 2023-11-15T02:55:52.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.299+0000 7f95e6ffd700 1 -- 172.21.15.1:0/2721453550 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f95d8012ce0 con 0x7f95f00c8390 2023-11-15T02:55:52.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.300+0000 7f95e6ffd700 1 --2- 172.21.15.1:0/2721453550 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f95d005f270 0x7f95d0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.300+0000 7f95e6ffd700 1 -- 172.21.15.1:0/2721453550 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f95d807a1d0 con 0x7f95f00c8390 2023-11-15T02:55:52.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.300+0000 7f95eeffd700 1 --2- 172.21.15.1:0/2721453550 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f95d005f270 0x7f95d0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.300+0000 7f95eeffd700 1 --2- 172.21.15.1:0/2721453550 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f95d005f270 0x7f95d0061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f95e80096a0 tx=0x7f95e8006b80).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:52.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.304+0000 7f95e6ffd700 1 -- 172.21.15.1:0/2721453550 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f95d804b220 con 0x7f95f00c8390 2023-11-15T02:55:52.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.477+0000 7f95f593b700 1 -- 172.21.15.1:0/2721453550 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f95f00950d0 con 0x7f95d005f270 2023-11-15T02:55:52.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.478+0000 7f95e6ffd700 1 -- 172.21.15.1:0/2721453550 <== mgr.9370 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f95f00950d0 con 0x7f95d005f270 2023-11-15T02:55:52.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.480+0000 7f95f593b700 1 -- 172.21.15.1:0/2721453550 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f95d005f270 msgr2=0x7f95d0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.480+0000 7f95f593b700 1 --2- 172.21.15.1:0/2721453550 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f95d005f270 0x7f95d0061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f95e80096a0 tx=0x7f95e8006b80).stop 2023-11-15T02:55:52.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.480+0000 7f95f593b700 1 -- 172.21.15.1:0/2721453550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95f00c8390 msgr2=0x7f95f00965e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.480+0000 7f95f593b700 1 --2- 172.21.15.1:0/2721453550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95f00c8390 0x7f95f00965e0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 rx=0x7f95d800b490 tx=0x7f95d8006f70).stop 2023-11-15T02:55:52.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.480+0000 7f95f593b700 1 -- 172.21.15.1:0/2721453550 shutdown_connections 2023-11-15T02:55:52.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.480+0000 7f95f593b700 1 --2- 172.21.15.1:0/2721453550 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f95d005f270 0x7f95d0061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.480+0000 7f95f593b700 1 --2- 172.21.15.1:0/2721453550 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f95f00ca9b0 0x7f95f0168020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.480+0000 7f95f593b700 1 --2- 172.21.15.1:0/2721453550 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95f006a6c0 0x7f95f00c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:52.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.480+0000 7f95f593b700 1 --2- 172.21.15.1:0/2721453550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95f00c8390 0x7f95f00965e0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.480+0000 7f95f593b700 1 -- 172.21.15.1:0/2721453550 >> 172.21.15.1:0/2721453550 conn(0x7f95f0084ec0 msgr2=0x7f95f00635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:52.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.480+0000 7f95f593b700 1 -- 172.21.15.1:0/2721453550 shutdown_connections 2023-11-15T02:55:52.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.480+0000 7f95f593b700 1 -- 172.21.15.1:0/2721453550 wait complete. 2023-11-15T02:55:52.485 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 3 to deep-scrub 2023-11-15T02:55:52.495 INFO:tasks.ceph:Scrubbing osd.4 2023-11-15T02:55:52.495 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-15T02:55:52.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.615+0000 7f6d9d39a700 1 Processor -- start 2023-11-15T02:55:52.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.615+0000 7f6d9d39a700 1 -- start start 2023-11-15T02:55:52.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d9d39a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d98137500 0x7f6d981378e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d9d39a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6d98138030 0x7f6d98069fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d9d39a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6d9806a4a0 0x7f6d98065740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d9d39a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9806a950 con 0x7f6d98138030 2023-11-15T02:55:52.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d9d39a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d980c4820 con 0x7f6d9806a4a0 2023-11-15T02:55:52.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d9d39a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d980c5680 con 0x7f6d98137500 2023-11-15T02:55:52.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d967fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6d98138030 0x7f6d98069fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d967fc700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6d98138030 0x7f6d98069fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43640/0 (socket says 172.21.15.1:43640) 2023-11-15T02:55:52.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d967fc700 1 -- 172.21.15.1:0/2432234755 learned_addr learned my addr 172.21.15.1:0/2432234755 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:52.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d96ffd700 1 --2- 172.21.15.1:0/2432234755 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d98137500 0x7f6d981378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d977fe700 1 --2- 172.21.15.1:0/2432234755 >> v2:172.21.15.141:3300/0 conn(0x7f6d9806a4a0 0x7f6d98065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d967fc700 1 -- 172.21.15.1:0/2432234755 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d98137500 msgr2=0x7f6d981378e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:52.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d967fc700 1 --2- 172.21.15.1:0/2432234755 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d98137500 0x7f6d981378e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d967fc700 1 -- 172.21.15.1:0/2432234755 >> v2:172.21.15.141:3300/0 conn(0x7f6d9806a4a0 msgr2=0x7f6d98065740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:52.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d967fc700 1 --2- 172.21.15.1:0/2432234755 >> v2:172.21.15.141:3300/0 conn(0x7f6d9806a4a0 0x7f6d98065740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d967fc700 1 -- 172.21.15.1:0/2432234755 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d980c4a70 con 0x7f6d98138030 2023-11-15T02:55:52.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d977fe700 1 --2- 172.21.15.1:0/2432234755 >> v2:172.21.15.141:3300/0 conn(0x7f6d9806a4a0 0x7f6d98065740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:52.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d96ffd700 1 --2- 172.21.15.1:0/2432234755 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d98137500 0x7f6d981378e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:52.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d967fc700 1 --2- 172.21.15.1:0/2432234755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d98138030 0x7f6d98069fb0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 rx=0x7f6d981517d0 tx=0x7f6d800090f0).ready entity=mon.0 client_cookie=1aa5edf79cbd0ead server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:52.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.616+0000 7f6d95ffb700 1 -- 172.21.15.1:0/2432234755 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8000b600 con 0x7f6d98138030 2023-11-15T02:55:52.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.617+0000 7f6d95ffb700 1 -- 172.21.15.1:0/2432234755 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8000b760 con 0x7f6d98138030 2023-11-15T02:55:52.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.617+0000 7f6d95ffb700 1 -- 172.21.15.1:0/2432234755 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8000bae0 con 0x7f6d98138030 2023-11-15T02:55:52.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.617+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2432234755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d98138030 msgr2=0x7f6d98069fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.617+0000 7f6d9d39a700 1 --2- 172.21.15.1:0/2432234755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d98138030 0x7f6d98069fb0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 rx=0x7f6d981517d0 tx=0x7f6d800090f0).stop 2023-11-15T02:55:52.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.617+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2432234755 shutdown_connections 2023-11-15T02:55:52.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.617+0000 7f6d9d39a700 1 --2- 172.21.15.1:0/2432234755 >> v2:172.21.15.141:3300/0 conn(0x7f6d9806a4a0 0x7f6d98065740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.617+0000 7f6d9d39a700 1 --2- 172.21.15.1:0/2432234755 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d98137500 0x7f6d981378e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.617+0000 7f6d9d39a700 1 --2- 172.21.15.1:0/2432234755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d98138030 0x7f6d98069fb0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.617+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2432234755 >> 172.21.15.1:0/2432234755 conn(0x7f6d98063280 msgr2=0x7f6d980c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:52.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.617+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2432234755 shutdown_connections 2023-11-15T02:55:52.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.617+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2432234755 wait complete. 2023-11-15T02:55:52.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.618+0000 7f6d9d39a700 1 Processor -- start 2023-11-15T02:55:52.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.618+0000 7f6d9d39a700 1 -- start start 2023-11-15T02:55:52.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.619+0000 7f6d9d39a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d9806a4a0 0x7f6d980abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.619+0000 7f6d9d39a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d98137500 0x7f6d98133750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.619+0000 7f6d9d39a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d98138030 0x7f6d98133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.619+0000 7f6d9d39a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d98132cb0 con 0x7f6d98138030 2023-11-15T02:55:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.619+0000 7f6d9d39a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d981524a0 con 0x7f6d98137500 2023-11-15T02:55:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.619+0000 7f6d9d39a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d98132f50 con 0x7f6d9806a4a0 2023-11-15T02:55:52.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.619+0000 7f6d977fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d98138030 0x7f6d98133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.619+0000 7f6d977fe700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d98138030 0x7f6d98133c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43654/0 (socket says 172.21.15.1:43654) 2023-11-15T02:55:52.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.619+0000 7f6d977fe700 1 -- 172.21.15.1:0/2420768542 learned_addr learned my addr 172.21.15.1:0/2420768542 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:52.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.619+0000 7f6d967fc700 1 --2- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d98137500 0x7f6d98133750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.619+0000 7f6d96ffd700 1 --2- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d9806a4a0 0x7f6d980abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.620+0000 7f6d977fe700 1 -- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d9806a4a0 msgr2=0x7f6d980abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.620+0000 7f6d977fe700 1 --2- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d9806a4a0 0x7f6d980abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.620+0000 7f6d977fe700 1 -- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d98137500 msgr2=0x7f6d98133750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.620+0000 7f6d977fe700 1 --2- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d98137500 0x7f6d98133750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.620+0000 7f6d977fe700 1 -- 172.21.15.1:0/2420768542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d80009370 con 0x7f6d98138030 2023-11-15T02:55:52.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.620+0000 7f6d977fe700 1 --2- 172.21.15.1:0/2420768542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d98138030 0x7f6d98133c40 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 rx=0x7f6d8800a380 tx=0x7f6d88007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:52.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.620+0000 7f6d8effd700 1 -- 172.21.15.1:0/2420768542 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88016470 con 0x7f6d98138030 2023-11-15T02:55:52.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.620+0000 7f6d8effd700 1 -- 172.21.15.1:0/2420768542 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d880165d0 con 0x7f6d98138030 2023-11-15T02:55:52.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.620+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2420768542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d98133230 con 0x7f6d98138030 2023-11-15T02:55:52.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.620+0000 7f6d8effd700 1 -- 172.21.15.1:0/2420768542 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88016950 con 0x7f6d98138030 2023-11-15T02:55:52.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.620+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2420768542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d980ac270 con 0x7f6d98138030 2023-11-15T02:55:52.636 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.621+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2420768542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d9806c7e0 con 0x7f6d98138030 2023-11-15T02:55:52.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.621+0000 7f6d8effd700 1 -- 172.21.15.1:0/2420768542 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6d88013070 con 0x7f6d98138030 2023-11-15T02:55:52.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.622+0000 7f6d8effd700 1 --2- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6d7805f270 0x7f6d78061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.622+0000 7f6d8effd700 1 -- 172.21.15.1:0/2420768542 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f6d8807ae90 con 0x7f6d98138030 2023-11-15T02:55:52.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.622+0000 7f6d8effd700 1 --2- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:6800/91135,v1:172.21.15.141:6802/91135] conn(0x7f6d78066220 0x7f6d780686c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.622+0000 7f6d8effd700 1 -- 172.21.15.1:0/2420768542 --> [v2:172.21.15.141:6800/91135,v1:172.21.15.141:6802/91135] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d78068ca0 con 0x7f6d78066220 2023-11-15T02:55:52.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.622+0000 7f6d8effd700 1 -- 172.21.15.1:0/2420768542 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d8807d3f0 con 0x7f6d98138030 2023-11-15T02:55:52.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.622+0000 7f6d96ffd700 1 --2- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6d7805f270 0x7f6d78061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.622+0000 7f6d967fc700 1 --2- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:6800/91135,v1:172.21.15.141:6802/91135] conn(0x7f6d78066220 0x7f6d780686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.622+0000 7f6d96ffd700 1 --2- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6d7805f270 0x7f6d78061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6d9000abd0 tx=0x7f6d90008040).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:52.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.622+0000 7f6d967fc700 1 --2- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:6800/91135,v1:172.21.15.141:6802/91135] conn(0x7f6d78066220 0x7f6d780686c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:52.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.623+0000 7f6d8effd700 1 -- 172.21.15.1:0/2420768542 <== osd.4 v2:172.21.15.141:6800/91135 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f6d78068ca0 con 0x7f6d78066220 2023-11-15T02:55:52.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.636+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2420768542 --> [v2:172.21.15.141:6800/91135,v1:172.21.15.141:6802/91135] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6d980c4d50 con 0x7f6d78066220 2023-11-15T02:55:52.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.637+0000 7f6d8effd700 1 -- 172.21.15.1:0/2420768542 <== osd.4 v2:172.21.15.141:6800/91135 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6d980c4d50 con 0x7f6d78066220 2023-11-15T02:55:52.640 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:55:52.640 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-15T02:55:52.640 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:55:52.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.637+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:6800/91135,v1:172.21.15.141:6802/91135] conn(0x7f6d78066220 msgr2=0x7f6d780686c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.637+0000 7f6d9d39a700 1 --2- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:6800/91135,v1:172.21.15.141:6802/91135] conn(0x7f6d78066220 0x7f6d780686c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.637+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6d7805f270 msgr2=0x7f6d78061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.637+0000 7f6d9d39a700 1 --2- 172.21.15.1:0/2420768542 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f6d7805f270 0x7f6d78061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6d9000abd0 tx=0x7f6d90008040).stop 2023-11-15T02:55:52.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.637+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2420768542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d98138030 msgr2=0x7f6d98133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.637+0000 7f6d9d39a700 1 --2- 172.21.15.1:0/2420768542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d98138030 0x7f6d98133c40 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 rx=0x7f6d8800a380 tx=0x7f6d88007900).stop 2023-11-15T02:55:52.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.637+0000 7f6d977fe700 1 -- 172.21.15.1:0/2420768542 reap_dead start 2023-11-15T02:55:52.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.637+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2420768542 shutdown_connections 2023-11-15T02:55:52.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.637+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2420768542 >> 172.21.15.1:0/2420768542 conn(0x7f6d98063280 msgr2=0x7f6d980c6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:52.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.637+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2420768542 shutdown_connections 2023-11-15T02:55:52.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.638+0000 7f6d9d39a700 1 -- 172.21.15.1:0/2420768542 wait complete. 2023-11-15T02:55:52.651 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-15T02:55:52.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.768+0000 7f8f47937700 1 Processor -- start 2023-11-15T02:55:52.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.768+0000 7f8f47937700 1 -- start start 2023-11-15T02:55:52.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.769+0000 7f8f47937700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f400aa770 0x7f8f400c6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.769+0000 7f8f47937700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f401583d0 con 0x7f8f400c63e0 2023-11-15T02:55:52.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.769+0000 7f8f47937700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f401586b0 con 0x7f8f400c1850 2023-11-15T02:55:52.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.769+0000 7f8f47937700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f40158990 con 0x7f8f400aa770 2023-11-15T02:55:52.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.769+0000 7f8f44ed2700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8f400c63e0 0x7f8f400aa060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37258/0 (socket says 172.21.15.1:37258) 2023-11-15T02:55:52.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.769+0000 7f8f44ed2700 1 -- 172.21.15.1:0/2014050346 learned_addr learned my addr 172.21.15.1:0/2014050346 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:52.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.770+0000 7f8f45ed4700 1 --2- 172.21.15.1:0/2014050346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f400aa770 0x7f8f400c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.770+0000 7f8f3ffff700 1 -- 172.21.15.1:0/2014050346 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916781724 0 0) 0x7f8f401583d0 con 0x7f8f400c63e0 2023-11-15T02:55:52.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.770+0000 7f8f3ffff700 1 -- 172.21.15.1:0/2014050346 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f280033f0 con 0x7f8f400c63e0 2023-11-15T02:55:52.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.770+0000 7f8f3ffff700 1 -- 172.21.15.1:0/2014050346 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471660653 0 0) 0x7f8f401586b0 con 0x7f8f400c1850 2023-11-15T02:55:52.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.770+0000 7f8f45ed4700 1 -- 172.21.15.1:0/2014050346 >> v1:172.21.15.141:6789/0 conn(0x7f8f400c1850 legacy=0x7f8f400c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.770+0000 7f8f45ed4700 1 -- 172.21.15.1:0/2014050346 >> v1:172.21.15.1:6789/0 conn(0x7f8f400c63e0 legacy=0x7f8f400aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.770+0000 7f8f45ed4700 1 -- 172.21.15.1:0/2014050346 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f40158c70 con 0x7f8f400aa770 2023-11-15T02:55:52.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.770+0000 7f8f45ed4700 1 --2- 172.21.15.1:0/2014050346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f400aa770 0x7f8f400c6860 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f8f30009790 tx=0x7f8f30009060).ready entity=mon.2 client_cookie=4e0235b1ae20ff5 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:52.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.770+0000 7f8f3ffff700 1 -- 172.21.15.1:0/2014050346 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3000f510 con 0x7f8f400aa770 2023-11-15T02:55:52.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.770+0000 7f8f3ffff700 1 -- 172.21.15.1:0/2014050346 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3000f670 con 0x7f8f400aa770 2023-11-15T02:55:52.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.770+0000 7f8f3ffff700 1 -- 172.21.15.1:0/2014050346 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3000f9f0 con 0x7f8f400aa770 2023-11-15T02:55:52.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.771+0000 7f8f47937700 1 -- 172.21.15.1:0/2014050346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f400aa770 msgr2=0x7f8f400c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.771+0000 7f8f47937700 1 --2- 172.21.15.1:0/2014050346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f400aa770 0x7f8f400c6860 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f8f30009790 tx=0x7f8f30009060).stop 2023-11-15T02:55:52.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.771+0000 7f8f47937700 1 -- 172.21.15.1:0/2014050346 shutdown_connections 2023-11-15T02:55:52.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.771+0000 7f8f47937700 1 --2- 172.21.15.1:0/2014050346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f400aa770 0x7f8f400c6860 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.771+0000 7f8f47937700 1 -- 172.21.15.1:0/2014050346 >> 172.21.15.1:0/2014050346 conn(0x7f8f40065570 msgr2=0x7f8f40069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:52.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.771+0000 7f8f47937700 1 -- 172.21.15.1:0/2014050346 shutdown_connections 2023-11-15T02:55:52.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.771+0000 7f8f47937700 1 -- 172.21.15.1:0/2014050346 wait complete. 2023-11-15T02:55:52.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.772+0000 7f8f47937700 1 Processor -- start 2023-11-15T02:55:52.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.772+0000 7f8f47937700 1 -- start start 2023-11-15T02:55:52.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f47937700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f400aa770 0x7f8f400ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f47937700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f400c1850 0x7f8f40163620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f47937700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8f400c63e0 0x7f8f40163b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f47937700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f40164ab0 con 0x7f8f400c1850 2023-11-15T02:55:52.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f47937700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f40164180 con 0x7f8f400c63e0 2023-11-15T02:55:52.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f47937700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f40164460 con 0x7f8f400aa770 2023-11-15T02:55:52.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f44ed2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f400c1850 0x7f8f40163620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f44ed2700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f400c1850 0x7f8f40163620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43656/0 (socket says 172.21.15.1:43656) 2023-11-15T02:55:52.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f44ed2700 1 -- 172.21.15.1:0/2303640549 learned_addr learned my addr 172.21.15.1:0/2303640549 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:52.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f45ed4700 1 --2- 172.21.15.1:0/2303640549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8f400c63e0 0x7f8f40163b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f456d3700 1 --2- 172.21.15.1:0/2303640549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f400aa770 0x7f8f400ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f44ed2700 1 -- 172.21.15.1:0/2303640549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f400aa770 msgr2=0x7f8f400ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f44ed2700 1 --2- 172.21.15.1:0/2303640549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f400aa770 0x7f8f400ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f44ed2700 1 -- 172.21.15.1:0/2303640549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8f400c63e0 msgr2=0x7f8f40163b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f44ed2700 1 --2- 172.21.15.1:0/2303640549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8f400c63e0 0x7f8f40163b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.773+0000 7f8f44ed2700 1 -- 172.21.15.1:0/2303640549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f300092a0 con 0x7f8f400c1850 2023-11-15T02:55:52.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.774+0000 7f8f44ed2700 1 --2- 172.21.15.1:0/2303640549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f400c1850 0x7f8f40163620 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 rx=0x7f8f3400c410 tx=0x7f8f34007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:52.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.774+0000 7f8f3d7fa700 1 -- 172.21.15.1:0/2303640549 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340070d0 con 0x7f8f400c1850 2023-11-15T02:55:52.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.774+0000 7f8f3d7fa700 1 -- 172.21.15.1:0/2303640549 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f34007230 con 0x7f8f400c1850 2023-11-15T02:55:52.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.774+0000 7f8f47937700 1 -- 172.21.15.1:0/2303640549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f40164740 con 0x7f8f400c1850 2023-11-15T02:55:52.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.774+0000 7f8f3d7fa700 1 -- 172.21.15.1:0/2303640549 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340075d0 con 0x7f8f400c1850 2023-11-15T02:55:52.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.774+0000 7f8f47937700 1 -- 172.21.15.1:0/2303640549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f400c2210 con 0x7f8f400c1850 2023-11-15T02:55:52.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.775+0000 7f8f47937700 1 -- 172.21.15.1:0/2303640549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f400c24f0 con 0x7f8f400c1850 2023-11-15T02:55:52.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.775+0000 7f8f3d7fa700 1 -- 172.21.15.1:0/2303640549 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8f340059b0 con 0x7f8f400c1850 2023-11-15T02:55:52.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.775+0000 7f8f3d7fa700 1 --2- 172.21.15.1:0/2303640549 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8f2c05f270 0x7f8f2c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:52.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.776+0000 7f8f3d7fa700 1 -- 172.21.15.1:0/2303640549 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f8f34079ad0 con 0x7f8f400c1850 2023-11-15T02:55:52.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.776+0000 7f8f456d3700 1 --2- 172.21.15.1:0/2303640549 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8f2c05f270 0x7f8f2c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:52.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.776+0000 7f8f456d3700 1 --2- 172.21.15.1:0/2303640549 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8f2c05f270 0x7f8f2c061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8f38002dd0 tx=0x7f8f38007ee0).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:52.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.780+0000 7f8f3d7fa700 1 -- 172.21.15.1:0/2303640549 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8f3404ab20 con 0x7f8f400c1850 2023-11-15T02:55:52.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.951+0000 7f8f47937700 1 -- 172.21.15.1:0/2303640549 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f4006c7e0 con 0x7f8f2c05f270 2023-11-15T02:55:52.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.952+0000 7f8f3d7fa700 1 -- 172.21.15.1:0/2303640549 <== mgr.9370 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8f4006c7e0 con 0x7f8f2c05f270 2023-11-15T02:55:52.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.953+0000 7f8f47937700 1 -- 172.21.15.1:0/2303640549 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8f2c05f270 msgr2=0x7f8f2c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.953+0000 7f8f47937700 1 --2- 172.21.15.1:0/2303640549 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8f2c05f270 0x7f8f2c061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8f38002dd0 tx=0x7f8f38007ee0).stop 2023-11-15T02:55:52.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.954+0000 7f8f47937700 1 -- 172.21.15.1:0/2303640549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f400c1850 msgr2=0x7f8f40163620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:52.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.954+0000 7f8f47937700 1 --2- 172.21.15.1:0/2303640549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f400c1850 0x7f8f40163620 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 rx=0x7f8f3400c410 tx=0x7f8f34007c70).stop 2023-11-15T02:55:52.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.954+0000 7f8f47937700 1 -- 172.21.15.1:0/2303640549 shutdown_connections 2023-11-15T02:55:52.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.954+0000 7f8f47937700 1 --2- 172.21.15.1:0/2303640549 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f8f2c05f270 0x7f8f2c061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.954+0000 7f8f47937700 1 --2- 172.21.15.1:0/2303640549 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8f400c63e0 0x7f8f40163b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.954+0000 7f8f47937700 1 --2- 172.21.15.1:0/2303640549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8f400aa770 0x7f8f400ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.954+0000 7f8f47937700 1 --2- 172.21.15.1:0/2303640549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f400c1850 0x7f8f40163620 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:52.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.954+0000 7f8f47937700 1 -- 172.21.15.1:0/2303640549 >> 172.21.15.1:0/2303640549 conn(0x7f8f40065570 msgr2=0x7f8f40069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:52.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.954+0000 7f8f47937700 1 -- 172.21.15.1:0/2303640549 shutdown_connections 2023-11-15T02:55:52.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:52.954+0000 7f8f47937700 1 -- 172.21.15.1:0/2303640549 wait complete. 2023-11-15T02:55:52.959 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 4 to deep-scrub 2023-11-15T02:55:52.968 INFO:tasks.ceph:Scrubbing osd.5 2023-11-15T02:55:52.968 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-15T02:55:53.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.088+0000 7f440e049700 1 Processor -- start 2023-11-15T02:55:53.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.088+0000 7f440e049700 1 -- start start 2023-11-15T02:55:53.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.089+0000 7f440e049700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4408137210 0x7f44081552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.089+0000 7f440e049700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44081375f0 0x7f440814e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.089+0000 7f440e049700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4408158330 con 0x7f440814ea50 2023-11-15T02:55:53.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.089+0000 7f440e049700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4408158610 con 0x7f4408137210 2023-11-15T02:55:53.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.089+0000 7f440e049700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44081588f0 con 0x7f44081375f0 2023-11-15T02:55:53.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.089+0000 7f440d047700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4408137210 0x7f44081552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.089+0000 7f440d047700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4408137210 0x7f44081552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43668/0 (socket says 172.21.15.1:43668) 2023-11-15T02:55:53.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.089+0000 7f440d047700 1 -- 172.21.15.1:0/3097981513 learned_addr learned my addr 172.21.15.1:0/3097981513 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:53.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.089+0000 7f440c846700 1 --2- 172.21.15.1:0/3097981513 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44081375f0 0x7f440814e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.089+0000 7f440d047700 1 -- 172.21.15.1:0/3097981513 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44081375f0 msgr2=0x7f440814e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:53.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.089+0000 7f440d047700 1 --2- 172.21.15.1:0/3097981513 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44081375f0 0x7f440814e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.089+0000 7f440d047700 1 -- 172.21.15.1:0/3097981513 >> v1:172.21.15.1:6789/0 conn(0x7f440814ea50 legacy=0x7f4408066850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.089+0000 7f43fffff700 1 -- 172.21.15.1:0/3097981513 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639558190 0 0) 0x7f4408158330 con 0x7f440814ea50 2023-11-15T02:55:53.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.089+0000 7f440d047700 1 -- 172.21.15.1:0/3097981513 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4408158bd0 con 0x7f4408137210 2023-11-15T02:55:53.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.090+0000 7f440d047700 1 --2- 172.21.15.1:0/3097981513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4408137210 0x7f44081552a0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 rx=0x7f4404006fd0 tx=0x7f44040090f0).ready entity=mon.0 client_cookie=3ade802edfe9da45 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:53.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.090+0000 7f43fffff700 1 -- 172.21.15.1:0/3097981513 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440400b580 con 0x7f4408137210 2023-11-15T02:55:53.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.090+0000 7f43fffff700 1 -- 172.21.15.1:0/3097981513 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440400b6e0 con 0x7f4408137210 2023-11-15T02:55:53.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.090+0000 7f43fffff700 1 -- 172.21.15.1:0/3097981513 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440400ba60 con 0x7f4408137210 2023-11-15T02:55:53.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.090+0000 7f440e049700 1 -- 172.21.15.1:0/3097981513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4408137210 msgr2=0x7f44081552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.090+0000 7f440e049700 1 --2- 172.21.15.1:0/3097981513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4408137210 0x7f44081552a0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 rx=0x7f4404006fd0 tx=0x7f44040090f0).stop 2023-11-15T02:55:53.097 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.090+0000 7f440e049700 1 -- 172.21.15.1:0/3097981513 shutdown_connections 2023-11-15T02:55:53.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.090+0000 7f440e049700 1 --2- 172.21.15.1:0/3097981513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4408137210 0x7f44081552a0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.090+0000 7f440e049700 1 --2- 172.21.15.1:0/3097981513 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44081375f0 0x7f440814e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.090+0000 7f440e049700 1 -- 172.21.15.1:0/3097981513 >> 172.21.15.1:0/3097981513 conn(0x7f4408063280 msgr2=0x7f44080c8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:53.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.090+0000 7f440e049700 1 -- 172.21.15.1:0/3097981513 shutdown_connections 2023-11-15T02:55:53.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.090+0000 7f440e049700 1 -- 172.21.15.1:0/3097981513 wait complete. 2023-11-15T02:55:53.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.091+0000 7f440e049700 1 Processor -- start 2023-11-15T02:55:53.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.092+0000 7f440e049700 1 -- start start 2023-11-15T02:55:53.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.092+0000 7f440e049700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4408137210 0x7f44080addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.092+0000 7f440e049700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44081375f0 0x7f4408135880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.092+0000 7f440e049700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f440814ea50 0x7f44080abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.092+0000 7f440e049700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4408138110 con 0x7f4408137210 2023-11-15T02:55:53.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.092+0000 7f440e049700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4408137b30 con 0x7f440814ea50 2023-11-15T02:55:53.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.092+0000 7f440e049700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44080ae630 con 0x7f44081375f0 2023-11-15T02:55:53.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f440d047700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4408137210 0x7f44080addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f440d047700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4408137210 0x7f44080addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43670/0 (socket says 172.21.15.1:43670) 2023-11-15T02:55:53.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f440d047700 1 -- 172.21.15.1:0/1564588512 learned_addr learned my addr 172.21.15.1:0/1564588512 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:53.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f440c846700 1 --2- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44081375f0 0x7f4408135880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f440d848700 1 --2- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f440814ea50 0x7f44080abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f440d047700 1 -- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44081375f0 msgr2=0x7f4408135880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f440d047700 1 --2- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44081375f0 0x7f4408135880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f440d047700 1 -- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f440814ea50 msgr2=0x7f44080abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f440d047700 1 --2- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f440814ea50 0x7f44080abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f440d047700 1 -- 172.21.15.1:0/1564588512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4404009370 con 0x7f4408137210 2023-11-15T02:55:53.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f440c846700 1 --2- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44081375f0 0x7f4408135880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:53.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f440d047700 1 --2- 172.21.15.1:0/1564588512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4408137210 0x7f44080addc0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7f4404009130 tx=0x7f4404017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:53.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f43fd7fa700 1 -- 172.21.15.1:0/1564588512 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440400b850 con 0x7f4408137210 2023-11-15T02:55:53.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f43fd7fa700 1 -- 172.21.15.1:0/1564588512 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440400b9b0 con 0x7f4408137210 2023-11-15T02:55:53.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f440e049700 1 -- 172.21.15.1:0/1564588512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4408137da0 con 0x7f4408137210 2023-11-15T02:55:53.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f43fd7fa700 1 -- 172.21.15.1:0/1564588512 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440401c670 con 0x7f4408137210 2023-11-15T02:55:53.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.093+0000 7f440e049700 1 -- 172.21.15.1:0/1564588512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44080c0d20 con 0x7f4408137210 2023-11-15T02:55:53.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.094+0000 7f440e049700 1 -- 172.21.15.1:0/1564588512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44080475e0 con 0x7f4408137210 2023-11-15T02:55:53.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.094+0000 7f43fd7fa700 1 -- 172.21.15.1:0/1564588512 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f440401ca60 con 0x7f4408137210 2023-11-15T02:55:53.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.095+0000 7f43fd7fa700 1 --2- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43ec05f270 0x7f43ec061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.095+0000 7f43fd7fa700 1 -- 172.21.15.1:0/1564588512 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f440407c1c0 con 0x7f4408137210 2023-11-15T02:55:53.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.095+0000 7f440c846700 1 --2- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43ec05f270 0x7f43ec061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.095+0000 7f43fd7fa700 1 --2- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:6816/91137,v1:172.21.15.141:6817/91137] conn(0x7f43ec066220 0x7f43ec0686c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.095+0000 7f43fd7fa700 1 -- 172.21.15.1:0/1564588512 --> [v2:172.21.15.141:6816/91137,v1:172.21.15.141:6817/91137] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43ec068ca0 con 0x7f43ec066220 2023-11-15T02:55:53.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.095+0000 7f43fd7fa700 1 -- 172.21.15.1:0/1564588512 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7f440407e810 con 0x7f4408137210 2023-11-15T02:55:53.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.095+0000 7f440d848700 1 --2- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:6816/91137,v1:172.21.15.141:6817/91137] conn(0x7f43ec066220 0x7f43ec0686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.095+0000 7f440c846700 1 --2- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43ec05f270 0x7f43ec061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f44080c3480 tx=0x7f43f8008040).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:53.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.096+0000 7f440d848700 1 --2- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:6816/91137,v1:172.21.15.141:6817/91137] conn(0x7f43ec066220 0x7f43ec0686c0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:53.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.096+0000 7f43fd7fa700 1 -- 172.21.15.1:0/1564588512 <== osd.5 v2:172.21.15.141:6816/91137 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f43ec068ca0 con 0x7f43ec066220 2023-11-15T02:55:53.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.110+0000 7f440e049700 1 -- 172.21.15.1:0/1564588512 --> [v2:172.21.15.141:6816/91137,v1:172.21.15.141:6817/91137] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4408138250 con 0x7f43ec066220 2023-11-15T02:55:53.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.110+0000 7f43fd7fa700 1 -- 172.21.15.1:0/1564588512 <== osd.5 v2:172.21.15.141:6816/91137 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4400003e40 con 0x7f43ec066220 2023-11-15T02:55:53.112 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:55:53.113 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-15T02:55:53.113 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:55:53.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.111+0000 7f440e049700 1 -- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:6816/91137,v1:172.21.15.141:6817/91137] conn(0x7f43ec066220 msgr2=0x7f43ec0686c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.111+0000 7f440e049700 1 --2- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:6816/91137,v1:172.21.15.141:6817/91137] conn(0x7f43ec066220 0x7f43ec0686c0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.111+0000 7f440e049700 1 -- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43ec05f270 msgr2=0x7f43ec061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.111+0000 7f440e049700 1 --2- 172.21.15.1:0/1564588512 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f43ec05f270 0x7f43ec061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f44080c3480 tx=0x7f43f8008040).stop 2023-11-15T02:55:53.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.111+0000 7f440e049700 1 -- 172.21.15.1:0/1564588512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4408137210 msgr2=0x7f44080addc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.111+0000 7f440e049700 1 --2- 172.21.15.1:0/1564588512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4408137210 0x7f44080addc0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7f4404009130 tx=0x7f4404017000).stop 2023-11-15T02:55:53.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.111+0000 7f440d848700 1 -- 172.21.15.1:0/1564588512 reap_dead start 2023-11-15T02:55:53.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.111+0000 7f440e049700 1 -- 172.21.15.1:0/1564588512 shutdown_connections 2023-11-15T02:55:53.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.111+0000 7f440e049700 1 -- 172.21.15.1:0/1564588512 >> 172.21.15.1:0/1564588512 conn(0x7f4408063280 msgr2=0x7f4408156120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:53.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.111+0000 7f440e049700 1 -- 172.21.15.1:0/1564588512 shutdown_connections 2023-11-15T02:55:53.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.111+0000 7f440e049700 1 -- 172.21.15.1:0/1564588512 wait complete. 2023-11-15T02:55:53.124 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-15T02:55:53.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.242+0000 7f7d61f3a700 1 Processor -- start 2023-11-15T02:55:53.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.242+0000 7f7d61f3a700 1 -- start start 2023-11-15T02:55:53.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.243+0000 7f7d61f3a700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7d5c1511b0 0x7f7d5c0c5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.243+0000 7f7d61f3a700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7d5c151590 0x7f7d5c151a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.243+0000 7f7d61f3a700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5c0c6220 con 0x7f7d5c0c1830 2023-11-15T02:55:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.243+0000 7f7d61f3a700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5c14b360 con 0x7f7d5c1511b0 2023-11-15T02:55:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.243+0000 7f7d61f3a700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5c0c5610 con 0x7f7d5c151590 2023-11-15T02:55:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.243+0000 7f7d60f38700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7d5c1511b0 0x7f7d5c0c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.243+0000 7f7d60f38700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7d5c1511b0 0x7f7d5c0c5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43686/0 (socket says 172.21.15.1:43686) 2023-11-15T02:55:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.243+0000 7f7d60f38700 1 -- 172.21.15.1:0/611774842 learned_addr learned my addr 172.21.15.1:0/611774842 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.243+0000 7f7d61739700 1 --1- 172.21.15.1:0/611774842 >> v1:172.21.15.1:6789/0 conn(0x7f7d5c0c1830 0x7f7d5c0c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37262/0 (socket says 172.21.15.1:37262) 2023-11-15T02:55:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.243+0000 7f7d5bfff700 1 --2- 172.21.15.1:0/611774842 >> v2:172.21.15.141:3300/0 conn(0x7f7d5c151590 0x7f7d5c151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.243+0000 7f7d60f38700 1 -- 172.21.15.1:0/611774842 >> v2:172.21.15.141:3300/0 conn(0x7f7d5c151590 msgr2=0x7f7d5c151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.243+0000 7f7d60f38700 1 --2- 172.21.15.1:0/611774842 >> v2:172.21.15.141:3300/0 conn(0x7f7d5c151590 0x7f7d5c151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.243+0000 7f7d60f38700 1 -- 172.21.15.1:0/611774842 >> v1:172.21.15.1:6789/0 conn(0x7f7d5c0c1830 legacy=0x7f7d5c0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.243+0000 7f7d60f38700 1 -- 172.21.15.1:0/611774842 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c0c58f0 con 0x7f7d5c1511b0 2023-11-15T02:55:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.243+0000 7f7d60f38700 1 --2- 172.21.15.1:0/611774842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d5c1511b0 0x7f7d5c0c5030 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 rx=0x7f7d5c0c4de0 tx=0x7f7d54009840).ready entity=mon.0 client_cookie=ad4c4fac24d6caab server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.244+0000 7f7d5b7fe700 1 -- 172.21.15.1:0/611774842 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5400e070 con 0x7f7d5c1511b0 2023-11-15T02:55:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.244+0000 7f7d5b7fe700 1 -- 172.21.15.1:0/611774842 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5400ba50 con 0x7f7d5c1511b0 2023-11-15T02:55:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.244+0000 7f7d5b7fe700 1 -- 172.21.15.1:0/611774842 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5400bdd0 con 0x7f7d5c1511b0 2023-11-15T02:55:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.244+0000 7f7d61f3a700 1 -- 172.21.15.1:0/611774842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d5c1511b0 msgr2=0x7f7d5c0c5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.244+0000 7f7d61f3a700 1 --2- 172.21.15.1:0/611774842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d5c1511b0 0x7f7d5c0c5030 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 rx=0x7f7d5c0c4de0 tx=0x7f7d54009840).stop 2023-11-15T02:55:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.244+0000 7f7d61f3a700 1 -- 172.21.15.1:0/611774842 shutdown_connections 2023-11-15T02:55:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.244+0000 7f7d61f3a700 1 --2- 172.21.15.1:0/611774842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d5c1511b0 0x7f7d5c0c5030 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.244+0000 7f7d61f3a700 1 --2- 172.21.15.1:0/611774842 >> v2:172.21.15.141:3300/0 conn(0x7f7d5c151590 0x7f7d5c151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.244+0000 7f7d61f3a700 1 -- 172.21.15.1:0/611774842 >> 172.21.15.1:0/611774842 conn(0x7f7d5c063280 msgr2=0x7f7d5c0c6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:53.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.244+0000 7f7d61f3a700 1 -- 172.21.15.1:0/611774842 shutdown_connections 2023-11-15T02:55:53.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.244+0000 7f7d61f3a700 1 -- 172.21.15.1:0/611774842 wait complete. 2023-11-15T02:55:53.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.245+0000 7f7d61f3a700 1 Processor -- start 2023-11-15T02:55:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.245+0000 7f7d61f3a700 1 -- start start 2023-11-15T02:55:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.246+0000 7f7d61f3a700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d5c0c1830 0x7f7d5c149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.246+0000 7f7d61f3a700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d5c1511b0 0x7f7d5c0bdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.246+0000 7f7d61f3a700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d5c151590 0x7f7d5c0be080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.246+0000 7f7d61f3a700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0a6b20 con 0x7f7d5c151590 2023-11-15T02:55:53.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.246+0000 7f7d61f3a700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0bf550 con 0x7f7d5c0c1830 2023-11-15T02:55:53.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.246+0000 7f7d61f3a700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0be700 con 0x7f7d5c1511b0 2023-11-15T02:55:53.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d61739700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d5c151590 0x7f7d5c0be080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d61739700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d5c151590 0x7f7d5c0be080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43692/0 (socket says 172.21.15.1:43692) 2023-11-15T02:55:53.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d61739700 1 -- 172.21.15.1:0/3961291773 learned_addr learned my addr 172.21.15.1:0/3961291773 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:53.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d5bfff700 1 --2- 172.21.15.1:0/3961291773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d5c1511b0 0x7f7d5c0bdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d60f38700 1 --2- 172.21.15.1:0/3961291773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d5c0c1830 0x7f7d5c149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d61739700 1 -- 172.21.15.1:0/3961291773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d5c1511b0 msgr2=0x7f7d5c0bdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d61739700 1 --2- 172.21.15.1:0/3961291773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d5c1511b0 0x7f7d5c0bdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d61739700 1 -- 172.21.15.1:0/3961291773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d5c0c1830 msgr2=0x7f7d5c149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d61739700 1 --2- 172.21.15.1:0/3961291773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d5c0c1830 0x7f7d5c149610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d61739700 1 -- 172.21.15.1:0/3961291773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d54009ae0 con 0x7f7d5c151590 2023-11-15T02:55:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d61739700 1 --2- 172.21.15.1:0/3961291773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d5c151590 0x7f7d5c0be080 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 rx=0x7f7d4c00c410 tx=0x7f7d4c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d58ff9700 1 -- 172.21.15.1:0/3961291773 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0072e0 con 0x7f7d5c151590 2023-11-15T02:55:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d58ff9700 1 -- 172.21.15.1:0/3961291773 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c007440 con 0x7f7d5c151590 2023-11-15T02:55:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d61f3a700 1 -- 172.21.15.1:0/3961291773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c0be9e0 con 0x7f7d5c151590 2023-11-15T02:55:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d58ff9700 1 -- 172.21.15.1:0/3961291773 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0058f0 con 0x7f7d5c151590 2023-11-15T02:55:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.247+0000 7f7d61f3a700 1 -- 172.21.15.1:0/3961291773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c149b00 con 0x7f7d5c151590 2023-11-15T02:55:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.248+0000 7f7d61f3a700 1 -- 172.21.15.1:0/3961291773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c0a6610 con 0x7f7d5c151590 2023-11-15T02:55:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.248+0000 7f7d58ff9700 1 -- 172.21.15.1:0/3961291773 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7d4c005ce0 con 0x7f7d5c151590 2023-11-15T02:55:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.249+0000 7f7d58ff9700 1 --2- 172.21.15.1:0/3961291773 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7d4805f270 0x7f7d48061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.249+0000 7f7d58ff9700 1 -- 172.21.15.1:0/3961291773 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f7d4c0798d0 con 0x7f7d5c151590 2023-11-15T02:55:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.249+0000 7f7d60f38700 1 --2- 172.21.15.1:0/3961291773 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7d4805f270 0x7f7d48061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.250+0000 7f7d60f38700 1 --2- 172.21.15.1:0/3961291773 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7d4805f270 0x7f7d48061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7d5c14aae0 tx=0x7f7d5c067fd0).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.253+0000 7f7d58ff9700 1 -- 172.21.15.1:0/3961291773 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7d5c0a6610 con 0x7f7d5c151590 2023-11-15T02:55:53.426 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.424+0000 7f7d61f3a700 1 -- 172.21.15.1:0/3961291773 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d5c0a6610 con 0x7f7d4805f270 2023-11-15T02:55:53.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.425+0000 7f7d58ff9700 1 -- 172.21.15.1:0/3961291773 <== mgr.9370 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7d5c0a6610 con 0x7f7d4805f270 2023-11-15T02:55:53.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.426+0000 7f7d61f3a700 1 -- 172.21.15.1:0/3961291773 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7d4805f270 msgr2=0x7f7d48061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.426+0000 7f7d61f3a700 1 --2- 172.21.15.1:0/3961291773 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7d4805f270 0x7f7d48061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7d5c14aae0 tx=0x7f7d5c067fd0).stop 2023-11-15T02:55:53.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.426+0000 7f7d61f3a700 1 -- 172.21.15.1:0/3961291773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d5c151590 msgr2=0x7f7d5c0be080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.426+0000 7f7d61f3a700 1 --2- 172.21.15.1:0/3961291773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d5c151590 0x7f7d5c0be080 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 rx=0x7f7d4c00c410 tx=0x7f7d4c007d70).stop 2023-11-15T02:55:53.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.427+0000 7f7d61f3a700 1 -- 172.21.15.1:0/3961291773 shutdown_connections 2023-11-15T02:55:53.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.427+0000 7f7d61f3a700 1 --2- 172.21.15.1:0/3961291773 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f7d4805f270 0x7f7d48061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.427+0000 7f7d61f3a700 1 --2- 172.21.15.1:0/3961291773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d5c151590 0x7f7d5c0be080 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.427+0000 7f7d61f3a700 1 --2- 172.21.15.1:0/3961291773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d5c0c1830 0x7f7d5c149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.427+0000 7f7d61f3a700 1 --2- 172.21.15.1:0/3961291773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d5c1511b0 0x7f7d5c0bdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.427+0000 7f7d61f3a700 1 -- 172.21.15.1:0/3961291773 >> 172.21.15.1:0/3961291773 conn(0x7f7d5c063280 msgr2=0x7f7d5c0c3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:53.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.427+0000 7f7d61f3a700 1 -- 172.21.15.1:0/3961291773 shutdown_connections 2023-11-15T02:55:53.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.427+0000 7f7d61f3a700 1 -- 172.21.15.1:0/3961291773 wait complete. 2023-11-15T02:55:53.431 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 5 to deep-scrub 2023-11-15T02:55:53.440 INFO:tasks.ceph:Scrubbing osd.6 2023-11-15T02:55:53.441 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-15T02:55:53.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.560+0000 7f7563b45700 1 Processor -- start 2023-11-15T02:55:53.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.560+0000 7f7563b45700 1 -- start start 2023-11-15T02:55:53.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.561+0000 7f7563b45700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f755c137500 0x7f755c1378e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.561+0000 7f7563b45700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f755c138030 0x7f755c069fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.561+0000 7f7563b45700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755c0c4820 con 0x7f755c06a4a0 2023-11-15T02:55:53.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.561+0000 7f7563b45700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755c06a950 con 0x7f755c138030 2023-11-15T02:55:53.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.561+0000 7f7563b45700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c0c5680 con 0x7f755c137500 2023-11-15T02:55:53.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.561+0000 7f75610e0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f755c138030 0x7f755c069fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.561+0000 7f75610e0700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f755c138030 0x7f755c069fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43698/0 (socket says 172.21.15.1:43698) 2023-11-15T02:55:53.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.561+0000 7f75610e0700 1 -- 172.21.15.1:0/3715328716 learned_addr learned my addr 172.21.15.1:0/3715328716 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:53.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.561+0000 7f75620e2700 1 --1- 172.21.15.1:0/3715328716 >> v1:172.21.15.1:6789/0 conn(0x7f755c06a4a0 0x7f755c065740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37278/0 (socket says 172.21.15.1:37278) 2023-11-15T02:55:53.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.561+0000 7f75618e1700 1 --2- 172.21.15.1:0/3715328716 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f755c137500 0x7f755c1378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.561+0000 7f75610e0700 1 -- 172.21.15.1:0/3715328716 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f755c137500 msgr2=0x7f755c1378e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:53.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.562+0000 7f75610e0700 1 --2- 172.21.15.1:0/3715328716 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f755c137500 0x7f755c1378e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.562+0000 7f75610e0700 1 -- 172.21.15.1:0/3715328716 >> v1:172.21.15.1:6789/0 conn(0x7f755c06a4a0 legacy=0x7f755c065740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.562+0000 7f75610e0700 1 -- 172.21.15.1:0/3715328716 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c0c4a70 con 0x7f755c138030 2023-11-15T02:55:53.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.562+0000 7f75618e1700 1 --2- 172.21.15.1:0/3715328716 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f755c137500 0x7f755c1378e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:53.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.562+0000 7f75610e0700 1 --2- 172.21.15.1:0/3715328716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f755c138030 0x7f755c069fb0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 rx=0x7f7558006fd0 tx=0x7f75580090f0).ready entity=mon.0 client_cookie=4cf4018f1b598d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:53.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.562+0000 7f75608df700 1 -- 172.21.15.1:0/3715328716 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755800b600 con 0x7f755c138030 2023-11-15T02:55:53.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.562+0000 7f75608df700 1 -- 172.21.15.1:0/3715328716 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755800b760 con 0x7f755c138030 2023-11-15T02:55:53.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.562+0000 7f75608df700 1 -- 172.21.15.1:0/3715328716 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755800bae0 con 0x7f755c138030 2023-11-15T02:55:53.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.562+0000 7f7563b45700 1 -- 172.21.15.1:0/3715328716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f755c138030 msgr2=0x7f755c069fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.562+0000 7f7563b45700 1 --2- 172.21.15.1:0/3715328716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f755c138030 0x7f755c069fb0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 rx=0x7f7558006fd0 tx=0x7f75580090f0).stop 2023-11-15T02:55:53.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.562+0000 7f7563b45700 1 -- 172.21.15.1:0/3715328716 shutdown_connections 2023-11-15T02:55:53.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.562+0000 7f7563b45700 1 --2- 172.21.15.1:0/3715328716 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f755c137500 0x7f755c1378e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.562+0000 7f7563b45700 1 --2- 172.21.15.1:0/3715328716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f755c138030 0x7f755c069fb0 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.562+0000 7f7563b45700 1 -- 172.21.15.1:0/3715328716 >> 172.21.15.1:0/3715328716 conn(0x7f755c063280 msgr2=0x7f755c0c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:53.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.563+0000 7f7563b45700 1 -- 172.21.15.1:0/3715328716 shutdown_connections 2023-11-15T02:55:53.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.563+0000 7f7563b45700 1 -- 172.21.15.1:0/3715328716 wait complete. 2023-11-15T02:55:53.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.564+0000 7f7563b45700 1 Processor -- start 2023-11-15T02:55:53.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.564+0000 7f7563b45700 1 -- start start 2023-11-15T02:55:53.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.564+0000 7f7563b45700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f755c06a4a0 0x7f755c161c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.564+0000 7f7563b45700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f755c137500 0x7f755c165bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.564+0000 7f7563b45700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f755c138030 0x7f755c162de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.564+0000 7f7563b45700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c0abde0 con 0x7f755c137500 2023-11-15T02:55:53.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.564+0000 7f7563b45700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c1660e0 con 0x7f755c06a4a0 2023-11-15T02:55:53.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.564+0000 7f7563b45700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c162260 con 0x7f755c138030 2023-11-15T02:55:53.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.564+0000 7f75610e0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f755c137500 0x7f755c165bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.564+0000 7f75610e0700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f755c137500 0x7f755c165bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43706/0 (socket says 172.21.15.1:43706) 2023-11-15T02:55:53.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.564+0000 7f75610e0700 1 -- 172.21.15.1:0/1006732884 learned_addr learned my addr 172.21.15.1:0/1006732884 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:53.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.565+0000 7f75618e1700 1 --2- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f755c06a4a0 0x7f755c161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.565+0000 7f75620e2700 1 --2- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f755c138030 0x7f755c162de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.565+0000 7f75610e0700 1 -- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f755c138030 msgr2=0x7f755c162de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.565+0000 7f75610e0700 1 --2- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f755c138030 0x7f755c162de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.565+0000 7f75610e0700 1 -- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f755c06a4a0 msgr2=0x7f755c161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.565+0000 7f75610e0700 1 --2- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f755c06a4a0 0x7f755c161c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.565+0000 7f75610e0700 1 -- 172.21.15.1:0/1006732884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7558009370 con 0x7f755c137500 2023-11-15T02:55:53.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.565+0000 7f75618e1700 1 --2- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f755c06a4a0 0x7f755c161c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:53.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.565+0000 7f75610e0700 1 --2- 172.21.15.1:0/1006732884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f755c137500 0x7f755c165bf0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 rx=0x7f7558011000 tx=0x7f7558017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:53.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.565+0000 7f7551ffb700 1 -- 172.21.15.1:0/1006732884 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7558020070 con 0x7f755c137500 2023-11-15T02:55:53.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.565+0000 7f7551ffb700 1 -- 172.21.15.1:0/1006732884 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7558000c90 con 0x7f755c137500 2023-11-15T02:55:53.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.565+0000 7f7551ffb700 1 -- 172.21.15.1:0/1006732884 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755800bae0 con 0x7f755c137500 2023-11-15T02:55:53.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.565+0000 7f7563b45700 1 -- 172.21.15.1:0/1006732884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c162540 con 0x7f755c137500 2023-11-15T02:55:53.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.565+0000 7f7563b45700 1 -- 172.21.15.1:0/1006732884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755c162b00 con 0x7f755c137500 2023-11-15T02:55:53.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.566+0000 7f7563b45700 1 -- 172.21.15.1:0/1006732884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f755c0abbb0 con 0x7f755c137500 2023-11-15T02:55:53.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.566+0000 7f7551ffb700 1 -- 172.21.15.1:0/1006732884 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f755801b8b0 con 0x7f755c137500 2023-11-15T02:55:53.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.567+0000 7f7551ffb700 1 --2- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f754005f270 0x7f7540061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.567+0000 7f7551ffb700 1 -- 172.21.15.1:0/1006732884 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f755807bb20 con 0x7f755c137500 2023-11-15T02:55:53.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.567+0000 7f7551ffb700 1 --2- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:6801/91136,v1:172.21.15.141:6803/91136] conn(0x7f7540066220 0x7f75400686c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.567+0000 7f7551ffb700 1 -- 172.21.15.1:0/1006732884 --> [v2:172.21.15.141:6801/91136,v1:172.21.15.141:6803/91136] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7540068ca0 con 0x7f7540066220 2023-11-15T02:55:53.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.567+0000 7f7551ffb700 1 -- 172.21.15.1:0/1006732884 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7558080240 con 0x7f755c137500 2023-11-15T02:55:53.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.567+0000 7f75618e1700 1 --2- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f754005f270 0x7f7540061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.567+0000 7f75620e2700 1 --2- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:6801/91136,v1:172.21.15.141:6803/91136] conn(0x7f7540066220 0x7f75400686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.567+0000 7f75618e1700 1 --2- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f754005f270 0x7f7540061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f755c0c20d0 tx=0x7f754c008040).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:53.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.568+0000 7f75620e2700 1 --2- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:6801/91136,v1:172.21.15.141:6803/91136] conn(0x7f7540066220 0x7f75400686c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:53.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.568+0000 7f7551ffb700 1 -- 172.21.15.1:0/1006732884 <== osd.6 v2:172.21.15.141:6801/91136 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f7540068ca0 con 0x7f7540066220 2023-11-15T02:55:53.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.581+0000 7f7563b45700 1 -- 172.21.15.1:0/1006732884 --> [v2:172.21.15.141:6801/91136,v1:172.21.15.141:6803/91136] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f755c06c7e0 con 0x7f7540066220 2023-11-15T02:55:53.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.582+0000 7f7551ffb700 1 -- 172.21.15.1:0/1006732884 <== osd.6 v2:172.21.15.141:6801/91136 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f755c06c7e0 con 0x7f7540066220 2023-11-15T02:55:53.584 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:55:53.585 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-15T02:55:53.585 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:55:53.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.582+0000 7f7563b45700 1 -- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:6801/91136,v1:172.21.15.141:6803/91136] conn(0x7f7540066220 msgr2=0x7f75400686c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.582+0000 7f7563b45700 1 --2- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:6801/91136,v1:172.21.15.141:6803/91136] conn(0x7f7540066220 0x7f75400686c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.582+0000 7f7563b45700 1 -- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f754005f270 msgr2=0x7f7540061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.582+0000 7f7563b45700 1 --2- 172.21.15.1:0/1006732884 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f754005f270 0x7f7540061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f755c0c20d0 tx=0x7f754c008040).stop 2023-11-15T02:55:53.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.582+0000 7f7563b45700 1 -- 172.21.15.1:0/1006732884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f755c137500 msgr2=0x7f755c165bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.582+0000 7f7563b45700 1 --2- 172.21.15.1:0/1006732884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f755c137500 0x7f755c165bf0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 rx=0x7f7558011000 tx=0x7f7558017000).stop 2023-11-15T02:55:53.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.582+0000 7f75620e2700 1 -- 172.21.15.1:0/1006732884 reap_dead start 2023-11-15T02:55:53.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.582+0000 7f7563b45700 1 -- 172.21.15.1:0/1006732884 shutdown_connections 2023-11-15T02:55:53.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.582+0000 7f7563b45700 1 -- 172.21.15.1:0/1006732884 >> 172.21.15.1:0/1006732884 conn(0x7f755c063280 msgr2=0x7f755c0c2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:53.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.582+0000 7f7563b45700 1 -- 172.21.15.1:0/1006732884 shutdown_connections 2023-11-15T02:55:53.588 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.582+0000 7f7563b45700 1 -- 172.21.15.1:0/1006732884 wait complete. 2023-11-15T02:55:53.596 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-15T02:55:53.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.712+0000 7fa55a8c4700 1 Processor -- start 2023-11-15T02:55:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.712+0000 7fa55a8c4700 1 -- start start 2023-11-15T02:55:53.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.713+0000 7fa55a8c4700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa5540a8230 0x7fa5540c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.713+0000 7fa55a8c4700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5540835e0 con 0x7fa5540bf720 2023-11-15T02:55:53.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.713+0000 7fa55a8c4700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5540beb80 con 0x7fa5540c39c0 2023-11-15T02:55:53.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.713+0000 7fa55a8c4700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5540bdfb0 con 0x7fa5540a8230 2023-11-15T02:55:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.713+0000 7fa553fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa5540a8230 0x7fa5540c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.713+0000 7fa553fff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa5540a8230 0x7fa5540c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43722/0 (socket says 172.21.15.1:43722) 2023-11-15T02:55:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.713+0000 7fa553fff700 1 -- 172.21.15.1:0/4208508286 learned_addr learned my addr 172.21.15.1:0/4208508286 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.714+0000 7fa553fff700 1 -- 172.21.15.1:0/4208508286 >> v1:172.21.15.141:6789/0 conn(0x7fa5540c39c0 legacy=0x7fa5540bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.714+0000 7fa553fff700 1 -- 172.21.15.1:0/4208508286 >> v1:172.21.15.1:6789/0 conn(0x7fa5540bf720 legacy=0x7fa5540c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.714+0000 7fa553fff700 1 -- 172.21.15.1:0/4208508286 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5540be250 con 0x7fa5540a8230 2023-11-15T02:55:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.714+0000 7fa553fff700 1 --2- 172.21.15.1:0/4208508286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5540a8230 0x7fa5540c34d0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 rx=0x7fa544006fd0 tx=0x7fa5440090f0).ready entity=mon.0 client_cookie=6c34ac43bb620d3f server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.714+0000 7fa552ffd700 1 -- 172.21.15.1:0/4208508286 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54400b600 con 0x7fa5540a8230 2023-11-15T02:55:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.714+0000 7fa552ffd700 1 -- 172.21.15.1:0/4208508286 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54400b760 con 0x7fa5540a8230 2023-11-15T02:55:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.714+0000 7fa552ffd700 1 -- 172.21.15.1:0/4208508286 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54400bae0 con 0x7fa5540a8230 2023-11-15T02:55:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.714+0000 7fa55a8c4700 1 -- 172.21.15.1:0/4208508286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5540a8230 msgr2=0x7fa5540c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.715+0000 7fa55a8c4700 1 --2- 172.21.15.1:0/4208508286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5540a8230 0x7fa5540c34d0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 rx=0x7fa544006fd0 tx=0x7fa5440090f0).stop 2023-11-15T02:55:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.715+0000 7fa55a8c4700 1 -- 172.21.15.1:0/4208508286 shutdown_connections 2023-11-15T02:55:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.715+0000 7fa55a8c4700 1 --2- 172.21.15.1:0/4208508286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5540a8230 0x7fa5540c34d0 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.715+0000 7fa55a8c4700 1 -- 172.21.15.1:0/4208508286 >> 172.21.15.1:0/4208508286 conn(0x7fa554082f90 msgr2=0x7fa5540c8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.715+0000 7fa55a8c4700 1 -- 172.21.15.1:0/4208508286 shutdown_connections 2023-11-15T02:55:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.715+0000 7fa55a8c4700 1 -- 172.21.15.1:0/4208508286 wait complete. 2023-11-15T02:55:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.716+0000 7fa55a8c4700 1 Processor -- start 2023-11-15T02:55:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.716+0000 7fa55a8c4700 1 -- start start 2023-11-15T02:55:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa55a8c4700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5540a8230 0x7fa5540ad610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa55a8c4700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5540bf720 0x7fa5540ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa55a8c4700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5540c39c0 0x7fa5540a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa55a8c4700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa554159290 con 0x7fa5540a8230 2023-11-15T02:55:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa55a8c4700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5541583a0 con 0x7fa5540c39c0 2023-11-15T02:55:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa55a8c4700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa554158680 con 0x7fa5540bf720 2023-11-15T02:55:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa553fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5540a8230 0x7fa5540ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa553fff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5540a8230 0x7fa5540ad610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43738/0 (socket says 172.21.15.1:43738) 2023-11-15T02:55:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa553fff700 1 -- 172.21.15.1:0/2441004029 learned_addr learned my addr 172.21.15.1:0/2441004029 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa5537fe700 1 --2- 172.21.15.1:0/2441004029 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5540bf720 0x7fa5540ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa558e61700 1 --2- 172.21.15.1:0/2441004029 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5540c39c0 0x7fa5540a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa553fff700 1 -- 172.21.15.1:0/2441004029 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5540bf720 msgr2=0x7fa5540ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa553fff700 1 --2- 172.21.15.1:0/2441004029 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5540bf720 0x7fa5540ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa553fff700 1 -- 172.21.15.1:0/2441004029 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5540c39c0 msgr2=0x7fa5540a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa553fff700 1 --2- 172.21.15.1:0/2441004029 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5540c39c0 0x7fa5540a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa553fff700 1 -- 172.21.15.1:0/2441004029 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa544009370 con 0x7fa5540a8230 2023-11-15T02:55:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa553fff700 1 --2- 172.21.15.1:0/2441004029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5540a8230 0x7fa5540ad610 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7fa544009f50 tx=0x7fa544017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa53bfff700 1 -- 172.21.15.1:0/2441004029 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54400bae0 con 0x7fa5540a8230 2023-11-15T02:55:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa53bfff700 1 -- 172.21.15.1:0/2441004029 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa544000c90 con 0x7fa5540a8230 2023-11-15T02:55:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa55a8c4700 1 -- 172.21.15.1:0/2441004029 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa554158960 con 0x7fa5540a8230 2023-11-15T02:55:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.717+0000 7fa53bfff700 1 -- 172.21.15.1:0/2441004029 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54401a430 con 0x7fa5540a8230 2023-11-15T02:55:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.718+0000 7fa55a8c4700 1 -- 172.21.15.1:0/2441004029 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa554158f20 con 0x7fa5540a8230 2023-11-15T02:55:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.719+0000 7fa55a8c4700 1 -- 172.21.15.1:0/2441004029 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55406c7e0 con 0x7fa5540a8230 2023-11-15T02:55:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.719+0000 7fa53bfff700 1 -- 172.21.15.1:0/2441004029 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa544021020 con 0x7fa5540a8230 2023-11-15T02:55:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.719+0000 7fa53bfff700 1 --2- 172.21.15.1:0/2441004029 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa54005f270 0x7fa540061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.719+0000 7fa53bfff700 1 -- 172.21.15.1:0/2441004029 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7fa54407bc50 con 0x7fa5540a8230 2023-11-15T02:55:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.720+0000 7fa5537fe700 1 --2- 172.21.15.1:0/2441004029 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa54005f270 0x7fa540061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.720+0000 7fa5537fe700 1 --2- 172.21.15.1:0/2441004029 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa54005f270 0x7fa540061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fa554154310 tx=0x7fa548008040).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.724+0000 7fa53bfff700 1 -- 172.21.15.1:0/2441004029 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa54404cd60 con 0x7fa5540a8230 2023-11-15T02:55:53.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.894+0000 7fa55a8c4700 1 -- 172.21.15.1:0/2441004029 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5541593d0 con 0x7fa54005f270 2023-11-15T02:55:53.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.895+0000 7fa53bfff700 1 -- 172.21.15.1:0/2441004029 <== mgr.9370 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa54800b3d0 con 0x7fa54005f270 2023-11-15T02:55:53.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.897+0000 7fa55a8c4700 1 -- 172.21.15.1:0/2441004029 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa54005f270 msgr2=0x7fa540061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.897+0000 7fa55a8c4700 1 --2- 172.21.15.1:0/2441004029 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa54005f270 0x7fa540061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fa554154310 tx=0x7fa548008040).stop 2023-11-15T02:55:53.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.897+0000 7fa55a8c4700 1 -- 172.21.15.1:0/2441004029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5540a8230 msgr2=0x7fa5540ad610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:53.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.897+0000 7fa55a8c4700 1 --2- 172.21.15.1:0/2441004029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5540a8230 0x7fa5540ad610 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7fa544009f50 tx=0x7fa544017000).stop 2023-11-15T02:55:53.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.897+0000 7fa55a8c4700 1 -- 172.21.15.1:0/2441004029 shutdown_connections 2023-11-15T02:55:53.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.897+0000 7fa55a8c4700 1 --2- 172.21.15.1:0/2441004029 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa54005f270 0x7fa540061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.897+0000 7fa55a8c4700 1 --2- 172.21.15.1:0/2441004029 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5540c39c0 0x7fa5540a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.897+0000 7fa55a8c4700 1 --2- 172.21.15.1:0/2441004029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5540a8230 0x7fa5540ad610 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.897+0000 7fa55a8c4700 1 --2- 172.21.15.1:0/2441004029 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5540bf720 0x7fa5540ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:53.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.897+0000 7fa55a8c4700 1 -- 172.21.15.1:0/2441004029 >> 172.21.15.1:0/2441004029 conn(0x7fa554082f90 msgr2=0x7fa5540c7660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:53.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.897+0000 7fa55a8c4700 1 -- 172.21.15.1:0/2441004029 shutdown_connections 2023-11-15T02:55:53.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:53.897+0000 7fa55a8c4700 1 -- 172.21.15.1:0/2441004029 wait complete. 2023-11-15T02:55:53.902 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 6 to deep-scrub 2023-11-15T02:55:53.911 INFO:tasks.ceph:Scrubbing osd.7 2023-11-15T02:55:53.911 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-15T02:55:54.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.031+0000 7fbf3ed3f700 1 Processor -- start 2023-11-15T02:55:54.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.031+0000 7fbf3ed3f700 1 -- start start 2023-11-15T02:55:54.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.032+0000 7fbf3ed3f700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbf3814b350 0x7fbf380c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.032+0000 7fbf3ed3f700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbf3814b730 0x7fbf38154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.032+0000 7fbf3ed3f700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf381580d0 con 0x7fbf380aa040 2023-11-15T02:55:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.032+0000 7fbf3ed3f700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf38155000 con 0x7fbf3814b350 2023-11-15T02:55:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.032+0000 7fbf3ed3f700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf381552e0 con 0x7fbf3814b730 2023-11-15T02:55:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.032+0000 7fbf3cadb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbf3814b350 0x7fbf380c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.032+0000 7fbf3cadb700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbf3814b350 0x7fbf380c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43754/0 (socket says 172.21.15.1:43754) 2023-11-15T02:55:54.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.032+0000 7fbf3cadb700 1 -- 172.21.15.1:0/1965150513 learned_addr learned my addr 172.21.15.1:0/1965150513 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:54.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf37fff700 1 --2- 172.21.15.1:0/1965150513 >> v2:172.21.15.141:3300/0 conn(0x7fbf3814b730 0x7fbf38154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf3cadb700 1 -- 172.21.15.1:0/1965150513 >> v2:172.21.15.141:3300/0 conn(0x7fbf3814b730 msgr2=0x7fbf38154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:54.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf3cadb700 1 --2- 172.21.15.1:0/1965150513 >> v2:172.21.15.141:3300/0 conn(0x7fbf3814b730 0x7fbf38154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf3cadb700 1 -- 172.21.15.1:0/1965150513 >> v1:172.21.15.1:6789/0 conn(0x7fbf380aa040 legacy=0x7fbf38158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf3cadb700 1 -- 172.21.15.1:0/1965150513 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf381555c0 con 0x7fbf3814b350 2023-11-15T02:55:54.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf3cadb700 1 --2- 172.21.15.1:0/1965150513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf3814b350 0x7fbf380c8290 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 rx=0x7fbf380c8780 tx=0x7fbf300090f0).ready entity=mon.0 client_cookie=b11164a5158a4983 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:54.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf377fe700 1 -- 172.21.15.1:0/1965150513 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3000b600 con 0x7fbf3814b350 2023-11-15T02:55:54.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf377fe700 1 -- 172.21.15.1:0/1965150513 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3000b760 con 0x7fbf3814b350 2023-11-15T02:55:54.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf377fe700 1 -- 172.21.15.1:0/1965150513 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3000bae0 con 0x7fbf3814b350 2023-11-15T02:55:54.039 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/1965150513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf3814b350 msgr2=0x7fbf380c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf3ed3f700 1 --2- 172.21.15.1:0/1965150513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf3814b350 0x7fbf380c8290 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 rx=0x7fbf380c8780 tx=0x7fbf300090f0).stop 2023-11-15T02:55:54.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/1965150513 shutdown_connections 2023-11-15T02:55:54.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf3ed3f700 1 --2- 172.21.15.1:0/1965150513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf3814b350 0x7fbf380c8290 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf3ed3f700 1 --2- 172.21.15.1:0/1965150513 >> v2:172.21.15.141:3300/0 conn(0x7fbf3814b730 0x7fbf38154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/1965150513 >> 172.21.15.1:0/1965150513 conn(0x7fbf38069ee0 msgr2=0x7fbf3806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:54.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/1965150513 shutdown_connections 2023-11-15T02:55:54.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.033+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/1965150513 wait complete. 2023-11-15T02:55:54.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.035+0000 7fbf3ed3f700 1 Processor -- start 2023-11-15T02:55:54.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.035+0000 7fbf3ed3f700 1 -- start start 2023-11-15T02:55:54.045 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.035+0000 7fbf3ed3f700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf380aa040 0x7fbf38142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.035+0000 7fbf3ed3f700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf3814b350 0x7fbf380c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3ed3f700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf3814b730 0x7fbf38158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3ed3f700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf380c3380 con 0x7fbf380aa040 2023-11-15T02:55:54.046 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3ed3f700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf380c21a0 con 0x7fbf3814b350 2023-11-15T02:55:54.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3ed3f700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf380c2970 con 0x7fbf3814b730 2023-11-15T02:55:54.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3cadb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf380aa040 0x7fbf38142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3cadb700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf380aa040 0x7fbf38142c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43760/0 (socket says 172.21.15.1:43760) 2023-11-15T02:55:54.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3cadb700 1 -- 172.21.15.1:0/2058632212 learned_addr learned my addr 172.21.15.1:0/2058632212 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:54.047 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf37fff700 1 --2- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf3814b350 0x7fbf380c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3d2dc700 1 --2- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf3814b730 0x7fbf38158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3cadb700 1 -- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf3814b730 msgr2=0x7fbf38158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3cadb700 1 --2- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf3814b730 0x7fbf38158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3cadb700 1 -- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf3814b350 msgr2=0x7fbf380c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3cadb700 1 --2- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbf3814b350 0x7fbf380c2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3cadb700 1 -- 172.21.15.1:0/2058632212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf30009370 con 0x7fbf380aa040 2023-11-15T02:55:54.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3d2dc700 1 --2- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbf3814b730 0x7fbf38158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:54.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3cadb700 1 --2- 172.21.15.1:0/2058632212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf380aa040 0x7fbf38142c00 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 rx=0x7fbf30009130 tx=0x7fbf30017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:54.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf34ff9700 1 -- 172.21.15.1:0/2058632212 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3000b8d0 con 0x7fbf380aa040 2023-11-15T02:55:54.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf34ff9700 1 -- 172.21.15.1:0/2058632212 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3000ba30 con 0x7fbf380aa040 2023-11-15T02:55:54.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/2058632212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf380ab280 con 0x7fbf380aa040 2023-11-15T02:55:54.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf34ff9700 1 -- 172.21.15.1:0/2058632212 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3001c670 con 0x7fbf380aa040 2023-11-15T02:55:54.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.036+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/2058632212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf380c2690 con 0x7fbf380aa040 2023-11-15T02:55:54.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.037+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/2058632212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbf38154470 con 0x7fbf380aa040 2023-11-15T02:55:54.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.038+0000 7fbf34ff9700 1 -- 172.21.15.1:0/2058632212 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fbf3001c9e0 con 0x7fbf380aa040 2023-11-15T02:55:54.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.038+0000 7fbf34ff9700 1 --2- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbf1805f270 0x7fbf18061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.038+0000 7fbf34ff9700 1 -- 172.21.15.1:0/2058632212 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7fbf3007bcc0 con 0x7fbf380aa040 2023-11-15T02:55:54.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.038+0000 7fbf37fff700 1 --2- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbf1805f270 0x7fbf18061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.038+0000 7fbf34ff9700 1 --2- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:6824/91166,v1:172.21.15.141:6825/91166] conn(0x7fbf18066220 0x7fbf180686c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.038+0000 7fbf34ff9700 1 -- 172.21.15.1:0/2058632212 --> [v2:172.21.15.141:6824/91166,v1:172.21.15.141:6825/91166] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf18068ca0 con 0x7fbf18066220 2023-11-15T02:55:54.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.038+0000 7fbf34ff9700 1 -- 172.21.15.1:0/2058632212 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf3007e310 con 0x7fbf380aa040 2023-11-15T02:55:54.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.038+0000 7fbf3d2dc700 1 --2- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:6824/91166,v1:172.21.15.141:6825/91166] conn(0x7fbf18066220 0x7fbf180686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.039+0000 7fbf37fff700 1 --2- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbf1805f270 0x7fbf18061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fbf380cab80 tx=0x7fbf280097a0).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:54.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.039+0000 7fbf3d2dc700 1 --2- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:6824/91166,v1:172.21.15.141:6825/91166] conn(0x7fbf18066220 0x7fbf180686c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:54.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.040+0000 7fbf34ff9700 1 -- 172.21.15.1:0/2058632212 <== osd.7 v2:172.21.15.141:6824/91166 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fbf18068ca0 con 0x7fbf18066220 2023-11-15T02:55:54.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.053+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/2058632212 --> [v2:172.21.15.141:6824/91166,v1:172.21.15.141:6825/91166] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbf3806c7e0 con 0x7fbf18066220 2023-11-15T02:55:54.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.053+0000 7fbf34ff9700 1 -- 172.21.15.1:0/2058632212 <== osd.7 v2:172.21.15.141:6824/91166 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbf3806c7e0 con 0x7fbf18066220 2023-11-15T02:55:54.056 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-11-15T02:55:54.056 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-15T02:55:54.056 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-11-15T02:55:54.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.054+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:6824/91166,v1:172.21.15.141:6825/91166] conn(0x7fbf18066220 msgr2=0x7fbf180686c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.054+0000 7fbf3ed3f700 1 --2- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:6824/91166,v1:172.21.15.141:6825/91166] conn(0x7fbf18066220 0x7fbf180686c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.054+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbf1805f270 msgr2=0x7fbf18061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.054+0000 7fbf3ed3f700 1 --2- 172.21.15.1:0/2058632212 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fbf1805f270 0x7fbf18061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fbf380cab80 tx=0x7fbf280097a0).stop 2023-11-15T02:55:54.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.054+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/2058632212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf380aa040 msgr2=0x7fbf38142c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.054+0000 7fbf3ed3f700 1 --2- 172.21.15.1:0/2058632212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf380aa040 0x7fbf38142c00 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 rx=0x7fbf30009130 tx=0x7fbf30017000).stop 2023-11-15T02:55:54.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.054+0000 7fbf3d2dc700 1 -- 172.21.15.1:0/2058632212 reap_dead start 2023-11-15T02:55:54.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.054+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/2058632212 shutdown_connections 2023-11-15T02:55:54.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.054+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/2058632212 >> 172.21.15.1:0/2058632212 conn(0x7fbf38069ee0 msgr2=0x7fbf380c12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:54.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.054+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/2058632212 shutdown_connections 2023-11-15T02:55:54.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.054+0000 7fbf3ed3f700 1 -- 172.21.15.1:0/2058632212 wait complete. 2023-11-15T02:55:54.067 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-15T02:55:54.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.184+0000 7fa316d58700 1 Processor -- start 2023-11-15T02:55:54.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.184+0000 7fa316d58700 1 -- start start 2023-11-15T02:55:54.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.185+0000 7fa316d58700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa310154250 0x7fa310154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.185+0000 7fa316d58700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa3100c6110 0x7fa3100c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.185+0000 7fa316d58700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa310158ff0 con 0x7fa3100a9ff0 2023-11-15T02:55:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.185+0000 7fa316d58700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa310158100 con 0x7fa3100c6110 2023-11-15T02:55:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.185+0000 7fa316d58700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3101583e0 con 0x7fa310154250 2023-11-15T02:55:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.185+0000 7fa3152f5700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa3100a9ff0 0x7fa310063510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37312/0 (socket says 172.21.15.1:37312) 2023-11-15T02:55:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.185+0000 7fa3152f5700 1 -- 172.21.15.1:0/2083949645 learned_addr learned my addr 172.21.15.1:0/2083949645 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:55:54.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa314af4700 1 --2- 172.21.15.1:0/2083949645 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa310154250 0x7fa310154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 -- 172.21.15.1:0/2083949645 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188370890 0 0) 0x7fa310158ff0 con 0x7fa3100a9ff0 2023-11-15T02:55:54.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 -- 172.21.15.1:0/2083949645 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2fc0033f0 con 0x7fa3100a9ff0 2023-11-15T02:55:54.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30ffff700 1 --2- 172.21.15.1:0/2083949645 >> v2:172.21.15.141:3300/0 conn(0x7fa3100c6110 0x7fa3100c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 -- 172.21.15.1:0/2083949645 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 298324269 0 0) 0x7fa2fc0033f0 con 0x7fa3100a9ff0 2023-11-15T02:55:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 -- 172.21.15.1:0/2083949645 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa310154250 msgr2=0x7fa310154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 --2- 172.21.15.1:0/2083949645 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa310154250 0x7fa310154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 -- 172.21.15.1:0/2083949645 >> v2:172.21.15.141:3300/0 conn(0x7fa3100c6110 msgr2=0x7fa3100c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:54.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 --2- 172.21.15.1:0/2083949645 >> v2:172.21.15.141:3300/0 conn(0x7fa3100c6110 0x7fa3100c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 -- 172.21.15.1:0/2083949645 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3101586c0 con 0x7fa3100a9ff0 2023-11-15T02:55:54.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 -- 172.21.15.1:0/2083949645 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3802558392 0 0) 0x7fa2f8001470 con 0x7fa3100a9ff0 2023-11-15T02:55:54.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 -- 172.21.15.1:0/2083949645 >> v1:172.21.15.1:6789/0 conn(0x7fa3100a9ff0 legacy=0x7fa310063510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 --2- 172.21.15.1:0/2083949645 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa310154250 0x7fa2fc0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 --2- 172.21.15.1:0/2083949645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2fc003e10 0x7fa2fc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 --2- 172.21.15.1:0/2083949645 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2fc004b80 0x7fa2fc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 -- 172.21.15.1:0/2083949645 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310158100 con 0x7fa2fc003e10 2023-11-15T02:55:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 -- 172.21.15.1:0/2083949645 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3101583e0 con 0x7fa2fc004b80 2023-11-15T02:55:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30f7fe700 1 -- 172.21.15.1:0/2083949645 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc00b8e0 con 0x7fa310154250 2023-11-15T02:55:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30ffff700 1 --2- 172.21.15.1:0/2083949645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2fc003e10 0x7fa2fc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa314af4700 1 --2- 172.21.15.1:0/2083949645 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa310154250 0x7fa2fc0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa3152f5700 1 --2- 172.21.15.1:0/2083949645 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2fc004b80 0x7fa2fc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30ffff700 1 -- 172.21.15.1:0/2083949645 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa310154250 msgr2=0x7fa2fc0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30ffff700 1 --2- 172.21.15.1:0/2083949645 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa310154250 0x7fa2fc0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30ffff700 1 -- 172.21.15.1:0/2083949645 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2fc004b80 msgr2=0x7fa2fc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30ffff700 1 --2- 172.21.15.1:0/2083949645 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2fc004b80 0x7fa2fc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa30ffff700 1 -- 172.21.15.1:0/2083949645 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc0033f0 con 0x7fa2fc003e10 2023-11-15T02:55:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.186+0000 7fa3152f5700 1 --2- 172.21.15.1:0/2083949645 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2fc004b80 0x7fa2fc005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.187+0000 7fa30ffff700 1 --2- 172.21.15.1:0/2083949645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2fc003e10 0x7fa2fc004690 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7fa30000e210 tx=0x7fa30000b040).ready entity=mon.0 client_cookie=542662dc77b0c627 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.187+0000 7fa30f7fe700 1 -- 172.21.15.1:0/2083949645 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300009ac0 con 0x7fa2fc003e10 2023-11-15T02:55:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.187+0000 7fa30f7fe700 1 -- 172.21.15.1:0/2083949645 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30000f040 con 0x7fa2fc003e10 2023-11-15T02:55:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.187+0000 7fa30f7fe700 1 -- 172.21.15.1:0/2083949645 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000ecd0 con 0x7fa2fc003e10 2023-11-15T02:55:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.187+0000 7fa316d58700 1 -- 172.21.15.1:0/2083949645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2fc003e10 msgr2=0x7fa2fc004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.187+0000 7fa316d58700 1 --2- 172.21.15.1:0/2083949645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2fc003e10 0x7fa2fc004690 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7fa30000e210 tx=0x7fa30000b040).stop 2023-11-15T02:55:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.187+0000 7fa3152f5700 1 -- 172.21.15.1:0/2083949645 reap_dead start 2023-11-15T02:55:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.187+0000 7fa316d58700 1 -- 172.21.15.1:0/2083949645 shutdown_connections 2023-11-15T02:55:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.187+0000 7fa316d58700 1 -- 172.21.15.1:0/2083949645 >> 172.21.15.1:0/2083949645 conn(0x7fa3100c7b20 msgr2=0x7fa3100c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.187+0000 7fa316d58700 1 -- 172.21.15.1:0/2083949645 shutdown_connections 2023-11-15T02:55:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.187+0000 7fa316d58700 1 -- 172.21.15.1:0/2083949645 wait complete. 2023-11-15T02:55:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.188+0000 7fa316d58700 1 Processor -- start 2023-11-15T02:55:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.189+0000 7fa316d58700 1 -- start start 2023-11-15T02:55:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.189+0000 7fa316d58700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2fc003e10 0x7fa310147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.189+0000 7fa316d58700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3100c3db0 0x7fa3100ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.189+0000 7fa316d58700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3100c4230 0x7fa3100ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.189+0000 7fa316d58700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100acab0 con 0x7fa3100c3db0 2023-11-15T02:55:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.189+0000 7fa316d58700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100af000 con 0x7fa2fc003e10 2023-11-15T02:55:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.189+0000 7fa316d58700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100ae3f0 con 0x7fa3100c4230 2023-11-15T02:55:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.189+0000 7fa30ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3100c3db0 0x7fa3100ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.189+0000 7fa30ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3100c3db0 0x7fa3100ac0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43786/0 (socket says 172.21.15.1:43786) 2023-11-15T02:55:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.189+0000 7fa30ffff700 1 -- 172.21.15.1:0/1748007551 learned_addr learned my addr 172.21.15.1:0/1748007551 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.190+0000 7fa30ffff700 1 -- 172.21.15.1:0/1748007551 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3100c4230 msgr2=0x7fa3100ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.190+0000 7fa314af4700 1 --2- 172.21.15.1:0/1748007551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2fc003e10 0x7fa310147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.190+0000 7fa3152f5700 1 --2- 172.21.15.1:0/1748007551 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3100c4230 0x7fa3100ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.190+0000 7fa30ffff700 1 --2- 172.21.15.1:0/1748007551 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3100c4230 0x7fa3100ac5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.190+0000 7fa30ffff700 1 -- 172.21.15.1:0/1748007551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2fc003e10 msgr2=0x7fa310147df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.190+0000 7fa30ffff700 1 --2- 172.21.15.1:0/1748007551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2fc003e10 0x7fa310147df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.190+0000 7fa30ffff700 1 -- 172.21.15.1:0/1748007551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3100ae6d0 con 0x7fa3100c3db0 2023-11-15T02:55:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.190+0000 7fa314af4700 1 --2- 172.21.15.1:0/1748007551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2fc003e10 0x7fa310147df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:55:54.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.190+0000 7fa30ffff700 1 --2- 172.21.15.1:0/1748007551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3100c3db0 0x7fa3100ac0d0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 rx=0x7fa30000e800 tx=0x7fa30001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:54.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.190+0000 7fa30cff9700 1 -- 172.21.15.1:0/1748007551 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3000139f0 con 0x7fa3100c3db0 2023-11-15T02:55:54.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.190+0000 7fa30cff9700 1 -- 172.21.15.1:0/1748007551 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa300013b50 con 0x7fa3100c3db0 2023-11-15T02:55:54.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.190+0000 7fa316d58700 1 -- 172.21.15.1:0/1748007551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3100ae9b0 con 0x7fa3100c3db0 2023-11-15T02:55:54.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.190+0000 7fa30cff9700 1 -- 172.21.15.1:0/1748007551 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30001d400 con 0x7fa3100c3db0 2023-11-15T02:55:54.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.190+0000 7fa316d58700 1 -- 172.21.15.1:0/1748007551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3100ae010 con 0x7fa3100c3db0 2023-11-15T02:55:54.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.191+0000 7fa316d58700 1 -- 172.21.15.1:0/1748007551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31006c7e0 con 0x7fa3100c3db0 2023-11-15T02:55:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.191+0000 7fa30cff9700 1 -- 172.21.15.1:0/1748007551 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa300003040 con 0x7fa3100c3db0 2023-11-15T02:55:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.192+0000 7fa30cff9700 1 --2- 172.21.15.1:0/1748007551 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa2f005f240 0x7fa2f0061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.192+0000 7fa30cff9700 1 -- 172.21.15.1:0/1748007551 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7fa30007c240 con 0x7fa3100c3db0 2023-11-15T02:55:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.192+0000 7fa314af4700 1 --2- 172.21.15.1:0/1748007551 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa2f005f240 0x7fa2f0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.192+0000 7fa314af4700 1 --2- 172.21.15.1:0/1748007551 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa2f005f240 0x7fa2f0061700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa308006c40 tx=0x7fa308008040).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.196+0000 7fa30cff9700 1 -- 172.21.15.1:0/1748007551 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa30004d290 con 0x7fa3100c3db0 2023-11-15T02:55:54.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.368+0000 7fa316d58700 1 -- 172.21.15.1:0/1748007551 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3101589a0 con 0x7fa2f005f240 2023-11-15T02:55:54.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.368+0000 7fa30cff9700 1 -- 172.21.15.1:0/1748007551 <== mgr.9370 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa3101589a0 con 0x7fa2f005f240 2023-11-15T02:55:54.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.370+0000 7fa316d58700 1 -- 172.21.15.1:0/1748007551 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa2f005f240 msgr2=0x7fa2f0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.370+0000 7fa316d58700 1 --2- 172.21.15.1:0/1748007551 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa2f005f240 0x7fa2f0061700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa308006c40 tx=0x7fa308008040).stop 2023-11-15T02:55:54.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.370+0000 7fa316d58700 1 -- 172.21.15.1:0/1748007551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3100c3db0 msgr2=0x7fa3100ac0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.370+0000 7fa316d58700 1 --2- 172.21.15.1:0/1748007551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3100c3db0 0x7fa3100ac0d0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 rx=0x7fa30000e800 tx=0x7fa30001a000).stop 2023-11-15T02:55:54.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.370+0000 7fa316d58700 1 -- 172.21.15.1:0/1748007551 shutdown_connections 2023-11-15T02:55:54.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.370+0000 7fa316d58700 1 --2- 172.21.15.1:0/1748007551 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7fa2f005f240 0x7fa2f0061700 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.370+0000 7fa316d58700 1 --2- 172.21.15.1:0/1748007551 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3100c4230 0x7fa3100ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.370+0000 7fa316d58700 1 --2- 172.21.15.1:0/1748007551 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2fc003e10 0x7fa310147df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.370+0000 7fa316d58700 1 --2- 172.21.15.1:0/1748007551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3100c3db0 0x7fa3100ac0d0 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.370+0000 7fa316d58700 1 -- 172.21.15.1:0/1748007551 >> 172.21.15.1:0/1748007551 conn(0x7fa3100c7b20 msgr2=0x7fa3100c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:54.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.370+0000 7fa316d58700 1 -- 172.21.15.1:0/1748007551 shutdown_connections 2023-11-15T02:55:54.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.370+0000 7fa316d58700 1 -- 172.21.15.1:0/1748007551 wait complete. 2023-11-15T02:55:54.375 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 7 to deep-scrub 2023-11-15T02:55:54.384 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:55:54.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.500+0000 7f483db04700 1 Processor -- start 2023-11-15T02:55:54.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.500+0000 7f483db04700 1 -- start start 2023-11-15T02:55:54.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.501+0000 7f483db04700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4838154150 0x7f4838154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.501+0000 7f483db04700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f48380ab1a0 0x7f4838158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.501+0000 7f483db04700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48380c06f0 con 0x7f48380aa060 2023-11-15T02:55:54.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.501+0000 7f483db04700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48380c09d0 con 0x7f48380ab1a0 2023-11-15T02:55:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.501+0000 7f483db04700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4838158820 con 0x7f4838154150 2023-11-15T02:55:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.501+0000 7f4836ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f48380ab1a0 0x7f4838158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.501+0000 7f4836ffd700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f48380ab1a0 0x7f4838158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43798/0 (socket says 172.21.15.1:43798) 2023-11-15T02:55:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.501+0000 7f4836ffd700 1 -- 172.21.15.1:0/1547816020 learned_addr learned my addr 172.21.15.1:0/1547816020 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:54.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.501+0000 7f48377fe700 1 --2- 172.21.15.1:0/1547816020 >> v2:172.21.15.141:3300/0 conn(0x7f4838154150 0x7f4838154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.501+0000 7f4836ffd700 1 -- 172.21.15.1:0/1547816020 >> v2:172.21.15.141:3300/0 conn(0x7f4838154150 msgr2=0x7f4838154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:55:54.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f4836ffd700 1 --2- 172.21.15.1:0/1547816020 >> v2:172.21.15.141:3300/0 conn(0x7f4838154150 0x7f4838154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f4836ffd700 1 -- 172.21.15.1:0/1547816020 >> v1:172.21.15.1:6789/0 conn(0x7f48380aa060 legacy=0x7f48380c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f4836ffd700 1 -- 172.21.15.1:0/1547816020 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4838158b00 con 0x7f48380ab1a0 2023-11-15T02:55:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f48377fe700 1 --2- 172.21.15.1:0/1547816020 >> v2:172.21.15.141:3300/0 conn(0x7f4838154150 0x7f4838154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:55:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f4836ffd700 1 --2- 172.21.15.1:0/1547816020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48380ab1a0 0x7f4838158040 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 rx=0x7f483806bfb0 tx=0x7f482c0090f0).ready entity=mon.0 client_cookie=353abbe87123049b server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f48367fc700 1 -- 172.21.15.1:0/1547816020 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c00b600 con 0x7f48380ab1a0 2023-11-15T02:55:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f48367fc700 1 -- 172.21.15.1:0/1547816020 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482c00b760 con 0x7f48380ab1a0 2023-11-15T02:55:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f48367fc700 1 -- 172.21.15.1:0/1547816020 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c00bb00 con 0x7f48380ab1a0 2023-11-15T02:55:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f483db04700 1 -- 172.21.15.1:0/1547816020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48380ab1a0 msgr2=0x7f4838158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f483db04700 1 --2- 172.21.15.1:0/1547816020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48380ab1a0 0x7f4838158040 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 rx=0x7f483806bfb0 tx=0x7f482c0090f0).stop 2023-11-15T02:55:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f483db04700 1 -- 172.21.15.1:0/1547816020 shutdown_connections 2023-11-15T02:55:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f483db04700 1 --2- 172.21.15.1:0/1547816020 >> v2:172.21.15.141:3300/0 conn(0x7f4838154150 0x7f4838154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f483db04700 1 --2- 172.21.15.1:0/1547816020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48380ab1a0 0x7f4838158040 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f483db04700 1 -- 172.21.15.1:0/1547816020 >> 172.21.15.1:0/1547816020 conn(0x7f4838064aa0 msgr2=0x7f4838064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f483db04700 1 -- 172.21.15.1:0/1547816020 shutdown_connections 2023-11-15T02:55:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.502+0000 7f483db04700 1 -- 172.21.15.1:0/1547816020 wait complete. 2023-11-15T02:55:54.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.504+0000 7f483db04700 1 Processor -- start 2023-11-15T02:55:54.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.504+0000 7f483db04700 1 -- start start 2023-11-15T02:55:54.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.504+0000 7f483db04700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48380aa060 0x7f4838156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.504+0000 7f483db04700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48380ab1a0 0x7f48380c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.504+0000 7f483db04700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4838154150 0x7f4838152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.504+0000 7f483db04700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48380c2350 con 0x7f48380ab1a0 2023-11-15T02:55:54.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.504+0000 7f483db04700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48380c2bf0 con 0x7f48380aa060 2023-11-15T02:55:54.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.504+0000 7f483db04700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48381571a0 con 0x7f4838154150 2023-11-15T02:55:54.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.504+0000 7f4836ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48380ab1a0 0x7f48380c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.505+0000 7f4836ffd700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48380ab1a0 0x7f48380c4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43810/0 (socket says 172.21.15.1:43810) 2023-11-15T02:55:54.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.505+0000 7f4836ffd700 1 -- 172.21.15.1:0/2532045256 learned_addr learned my addr 172.21.15.1:0/2532045256 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:55:54.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.505+0000 7f4836ffd700 1 -- 172.21.15.1:0/2532045256 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4838154150 msgr2=0x7f4838152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.505+0000 7f4836ffd700 1 --2- 172.21.15.1:0/2532045256 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4838154150 0x7f4838152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:54.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.505+0000 7f48377fe700 1 --2- 172.21.15.1:0/2532045256 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48380aa060 0x7f4838156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.505+0000 7f4836ffd700 1 -- 172.21.15.1:0/2532045256 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48380aa060 msgr2=0x7f4838156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.505+0000 7f4836ffd700 1 --2- 172.21.15.1:0/2532045256 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48380aa060 0x7f4838156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.505+0000 7f4836ffd700 1 -- 172.21.15.1:0/2532045256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c009370 con 0x7f48380ab1a0 2023-11-15T02:55:54.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.505+0000 7f4836ffd700 1 --2- 172.21.15.1:0/2532045256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48380ab1a0 0x7f48380c4eb0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 rx=0x7f4838062af0 tx=0x7f482c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:54.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.505+0000 7f481f7fe700 1 -- 172.21.15.1:0/2532045256 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c002f30 con 0x7f48380ab1a0 2023-11-15T02:55:54.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.505+0000 7f481f7fe700 1 -- 172.21.15.1:0/2532045256 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482c00b8d0 con 0x7f48380ab1a0 2023-11-15T02:55:54.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.505+0000 7f483db04700 1 -- 172.21.15.1:0/2532045256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48380c25a0 con 0x7f48380ab1a0 2023-11-15T02:55:54.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.505+0000 7f481f7fe700 1 -- 172.21.15.1:0/2532045256 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c024470 con 0x7f48380ab1a0 2023-11-15T02:55:54.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.505+0000 7f483db04700 1 -- 172.21.15.1:0/2532045256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48380c53a0 con 0x7f48380ab1a0 2023-11-15T02:55:54.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.506+0000 7f483db04700 1 -- 172.21.15.1:0/2532045256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483806c7e0 con 0x7f48380ab1a0 2023-11-15T02:55:54.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.506+0000 7f481f7fe700 1 -- 172.21.15.1:0/2532045256 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f482c021070 con 0x7f48380ab1a0 2023-11-15T02:55:54.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.507+0000 7f481f7fe700 1 --2- 172.21.15.1:0/2532045256 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f482405f270 0x7f4824061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:55:54.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.507+0000 7f481f7fe700 1 -- 172.21.15.1:0/2532045256 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f482c07bf50 con 0x7f48380ab1a0 2023-11-15T02:55:54.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.507+0000 7f48377fe700 1 --2- 172.21.15.1:0/2532045256 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f482405f270 0x7f4824061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:55:54.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.507+0000 7f48377fe700 1 --2- 172.21.15.1:0/2532045256 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f482405f270 0x7f4824061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f4828006d80 tx=0x7f4828008040).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:55:54.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.511+0000 7f481f7fe700 1 -- 172.21.15.1:0/2532045256 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f482c04d050 con 0x7f48380ab1a0 2023-11-15T02:55:54.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.680+0000 7f483db04700 1 -- 172.21.15.1:0/2532045256 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f48380c02a0 con 0x7f482405f270 2023-11-15T02:55:54.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.684+0000 7f481f7fe700 1 -- 172.21.15.1:0/2532045256 <== mgr.9370 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71335 (secure 0 0 0) 0x7f48380c02a0 con 0x7f482405f270 2023-11-15T02:55:54.686 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:55:54.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.685+0000 7f483db04700 1 -- 172.21.15.1:0/2532045256 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f482405f270 msgr2=0x7f4824061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.685+0000 7f483db04700 1 --2- 172.21.15.1:0/2532045256 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f482405f270 0x7f4824061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f4828006d80 tx=0x7f4828008040).stop 2023-11-15T02:55:54.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.685+0000 7f483db04700 1 -- 172.21.15.1:0/2532045256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48380ab1a0 msgr2=0x7f48380c4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:55:54.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.685+0000 7f483db04700 1 --2- 172.21.15.1:0/2532045256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48380ab1a0 0x7f48380c4eb0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 rx=0x7f4838062af0 tx=0x7f482c017000).stop 2023-11-15T02:55:54.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.685+0000 7f483db04700 1 -- 172.21.15.1:0/2532045256 shutdown_connections 2023-11-15T02:55:54.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.685+0000 7f483db04700 1 --2- 172.21.15.1:0/2532045256 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f482405f270 0x7f4824061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.685+0000 7f483db04700 1 --2- 172.21.15.1:0/2532045256 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4838154150 0x7f4838152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-15T02:55:54.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.685+0000 7f483db04700 1 --2- 172.21.15.1:0/2532045256 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48380aa060 0x7f4838156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.685+0000 7f483db04700 1 --2- 172.21.15.1:0/2532045256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48380ab1a0 0x7f48380c4eb0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:55:54.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.685+0000 7f483db04700 1 -- 172.21.15.1:0/2532045256 >> 172.21.15.1:0/2532045256 conn(0x7f4838064aa0 msgr2=0x7f48380ca8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:55:54.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.685+0000 7f483db04700 1 -- 172.21.15.1:0/2532045256 shutdown_connections 2023-11-15T02:55:54.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:55:54.685+0000 7f483db04700 1 -- 172.21.15.1:0/2532045256 wait complete. 2023-11-15T02:55:54.690 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:55:54.699 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-11-15T02:55:53.194038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2471872,"kb_used_data":21376,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752502848,"statfs":{"total":773094113280,"available":770562916352,"internally_reserved":0,"allocated":21889024,"data_stored":11750456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14654,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-68,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.997579"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.210541+0000","last_change":"2023-11-15T01:21:32.295154+0000","last_active":"2023-11-15T02:55:44.210541+0000","last_peered":"2023-11-15T02:55:44.210541+0000","last_clean":"2023-11-15T02:55:44.210541+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:55:44.210541+0000","last_undegraded":"2023-11-15T02:55:44.210541+0000","last_fullsized":"2023-11-15T02:55:44.210541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":180,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.206772+0000","last_change":"2023-11-15T01:21:31.809775+0000","last_active":"2023-11-15T02:55:44.206772+0000","last_peered":"2023-11-15T02:55:44.206772+0000","last_clean":"2023-11-15T02:55:44.206772+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:55:44.206772+0000","last_undegraded":"2023-11-15T02:55:44.206772+0000","last_fullsized":"2023-11-15T02:55:44.206772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-15T02:55:52.194016+0000","last_change":"2023-11-15T02:55:52.194016+0000","last_active":"2023-11-15T02:55:52.194016+0000","last_peered":"2023-11-15T02:55:52.194016+0000","last_clean":"2023-11-15T02:55:52.194016+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:55:52.194016+0000","last_undegraded":"2023-11-15T02:55:52.194016+0000","last_fullsized":"2023-11-15T02:55:52.194016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:52.193913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:52.193913+0000","last_clean_scrub_stamp":"2023-11-15T02:55:52.193913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":180,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.206343+0000","last_change":"2023-11-15T01:21:31.810944+0000","last_active":"2023-11-15T02:55:44.206343+0000","last_peered":"2023-11-15T02:55:44.206343+0000","last_clean":"2023-11-15T02:55:44.206343+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:55:44.206343+0000","last_undegraded":"2023-11-15T02:55:44.206343+0000","last_fullsized":"2023-11-15T02:55:44.206343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":175,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.211551+0000","last_change":"2023-11-15T01:21:30.329347+0000","last_active":"2023-11-15T02:55:44.211551+0000","last_peered":"2023-11-15T02:55:44.211551+0000","last_clean":"2023-11-15T02:55:44.211551+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:55:44.211551+0000","last_undegraded":"2023-11-15T02:55:44.211551+0000","last_fullsized":"2023-11-15T02:55:44.211551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:28.778860+0000","last_clean_scrub_stamp":"2023-11-15T01:21:28.778860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":173,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.211636+0000","last_change":"2023-11-15T01:21:31.810034+0000","last_active":"2023-11-15T02:55:44.211636+0000","last_peered":"2023-11-15T02:55:44.211636+0000","last_clean":"2023-11-15T02:55:44.211636+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:55:44.211636+0000","last_undegraded":"2023-11-15T02:55:44.211636+0000","last_fullsized":"2023-11-15T02:55:44.211636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":173,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.208875+0000","last_change":"2023-11-15T01:21:32.295452+0000","last_active":"2023-11-15T02:55:44.208875+0000","last_peered":"2023-11-15T02:55:44.208875+0000","last_clean":"2023-11-15T02:55:44.208875+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:55:44.208875+0000","last_undegraded":"2023-11-15T02:55:44.208875+0000","last_fullsized":"2023-11-15T02:55:44.208875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.214841+0000","last_change":"2023-11-15T01:21:31.816574+0000","last_active":"2023-11-15T02:55:44.214841+0000","last_peered":"2023-11-15T02:55:44.214841+0000","last_clean":"2023-11-15T02:55:44.214841+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:55:44.214841+0000","last_undegraded":"2023-11-15T02:55:44.214841+0000","last_fullsized":"2023-11-15T02:55:44.214841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":204,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-11-15T02:55:44.204453+0000","last_change":"2023-11-15T01:21:31.816559+0000","last_active":"2023-11-15T02:55:44.204453+0000","last_peered":"2023-11-15T02:55:44.204453+0000","last_clean":"2023-11-15T02:55:44.204453+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:55:44.204453+0000","last_undegraded":"2023-11-15T02:55:44.204453+0000","last_fullsized":"2023-11-15T02:55:44.204453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T01:21:30.790436+0000","last_clean_scrub_stamp":"2023-11-15T01:21:30.790436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575970,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303864,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067976,"statfs":{"total":96636764160,"available":96325607424,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.66500000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.82399999999999995},"last":0.39800000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.39400000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75900000000000001,"5min":0.78500000000000003,"15min":0.79200000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.57899999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.749,"5min":0.76300000000000001,"15min":0.82299999999999995},"last":0.43099999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.58299999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.80400000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76500000000000001,"5min":0.82799999999999996,"15min":0.83799999999999997},"last":0.49399999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.88500000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.86699999999999999},"last":0.59999999999999998}]},{"osd":4,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.35299999999999998,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.63700000000000001,"5min":0.71699999999999997,"15min":0.749},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.74299999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.66100000000000003}]},{"osd":5,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.30199999999999999,"15min":0.27300000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.497,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.81999999999999995},"last":0.51000000000000001}]},{"osd":6,"last update":"Wed Nov 15 02:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.72399999999999998,"5min":0.78200000000000003,"15min":0.84899999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.28499999999999998},"max":{"1min":0.78400000000000003,"5min":0.80000000000000004,"15min":0.82899999999999996},"last":0.69199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575971,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307960,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063880,"statfs":{"total":96636764160,"available":96321413120,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.24099999999999999},"max":{"1min":0.79500000000000004,"5min":0.79700000000000004,"15min":0.92500000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.437,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":1.466,"15min":1.466},"last":0.52500000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81999999999999995},"last":0.499},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78400000000000003,"5min":1.53,"15min":1.53},"last":0.60799999999999998}]},{"osd":2,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.36899999999999999,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":1.026,"15min":1.026},"last":0.621},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.80200000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.32900000000000001},"max":{"1min":0.71099999999999997,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.63},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.81200000000000006,"5min":1.498,"15min":1.498},"last":0.65300000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.61299999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.68400000000000005,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.68300000000000005}]},{"osd":5,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.499,"15min":0.48999999999999999},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65600000000000003,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.376,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.498,"15min":0.503},"min":{"1min":0.34300000000000003,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.76400000000000001,"5min":1.04,"15min":1.04},"last":0.75},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80000000000000004,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.70599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575972,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307960,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063880,"statfs":{"total":96636764160,"available":96321413120,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40100000000000002,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.26100000000000001,"15min":0.23999999999999999},"max":{"1min":0.47899999999999998,"5min":1.149,"15min":1.149},"last":0.253},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.30499999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.499,"5min":1.044,"15min":1.044},"last":0.31900000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40799999999999997,"15min":0.40699999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51100000000000001,"5min":0.748,"15min":0.748},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46899999999999997,"15min":0.46200000000000002},"min":{"1min":0.313,"5min":0.311,"15min":0.27500000000000002},"max":{"1min":0.58299999999999996,"5min":1.101,"15min":1.101},"last":0.29699999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63600000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.504,"15min":0.505},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66200000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.37}]},{"osd":4,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.40999999999999998,"15min":0.372},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.496},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65500000000000003,"15min":0.66200000000000003},"min":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":1.052,"15min":1.081},"last":0.66200000000000003}]},{"osd":5,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.53300000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88600000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73099999999999998,"15min":0.68899999999999995},"min":{"1min":0.498,"5min":0.42999999999999999,"15min":0.42699999999999999},"max":{"1min":0.86499999999999999,"5min":5.7590000000000003,"15min":5.7590000000000003},"last":0.56200000000000006}]},{"osd":6,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89300000000000002,"5min":1.089,"15min":1.089},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76800000000000002,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91900000000000004,"5min":5.7930000000000001,"15min":5.7930000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Wed Nov 15 02:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72399999999999998,"15min":0.72699999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88300000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.59699999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85699999999999998,"5min":1.04,"15min":1.04},"last":0.66900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575970,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312056,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059784,"statfs":{"total":96636764160,"available":96317218816,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56799999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.432,"15min":0.44},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.58099999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"last":0.32000000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52700000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.253},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57099999999999995,"5min":0.72499999999999998,"15min":0.75800000000000001},"last":0.38500000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.58599999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.375},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60999999999999999,"5min":1.776,"15min":1.776},"last":0.39900000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.72399999999999998,"15min":0.70399999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.40500000000000003},"max":{"1min":1.0129999999999999,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":0.498},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.42699999999999999},"max":{"1min":0.86399999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.51000000000000001}]},{"osd":5,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67500000000000004,"15min":0.65900000000000003},"min":{"1min":0.435,"5min":0.39100000000000001,"15min":0.378},"max":{"1min":0.83399999999999996,"5min":3.766,"15min":3.766},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.877,"5min":0.98399999999999999,"15min":1.028},"last":0.54900000000000004}]},{"osd":6,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.52900000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94499999999999995,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.40699999999999997},"max":{"1min":0.85399999999999998,"5min":0.97799999999999998,"15min":1.0549999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.47599999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.107},"last":0.57199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575971,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316152,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055688,"statfs":{"total":96636764160,"available":96313024512,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.47499999999999998,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.27000000000000002,"15min":0.253},"max":{"1min":0.64000000000000001,"5min":8.5280000000000005,"15min":8.5280000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.26900000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69299999999999995,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.29299999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39800000000000002,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.34399999999999997,"5min":0.31,"15min":0.29499999999999998},"max":{"1min":0.66200000000000003,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.621,"5min":0.65900000000000003,"15min":0.70099999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54600000000000004,"15min":0.495},"min":{"1min":0.376,"5min":0.32500000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":8.7200000000000006,"15min":8.7200000000000006},"last":0.31900000000000001}]},{"osd":4,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.70799999999999996,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89500000000000002,"5min":8.5890000000000004,"15min":8.5890000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64100000000000001,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88800000000000001,"5min":0.97199999999999998,"15min":0.98399999999999999},"last":0.68300000000000005}]},{"osd":5,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.66600000000000004},"min":{"1min":0.442,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85399999999999998,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.74299999999999999,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94699999999999995,"5min":8.625,"15min":8.625},"last":0.621}]},{"osd":6,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.52200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.89400000000000002,"5min":1.0269999999999999,"15min":1.113},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67700000000000005,"15min":0.70199999999999996},"min":{"1min":0.47299999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.0660000000000001},"last":0.63300000000000001}]},{"osd":7,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69099999999999995,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93500000000000005,"5min":0.995,"15min":1.0680000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.71399999999999997},"min":{"1min":0.505,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91200000000000003,"5min":1.089,"15min":1.1499999999999999},"last":0.66400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575972,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312056,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059784,"statfs":{"total":96636764160,"available":96317218816,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39000000000000001,"15min":0.39800000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59899999999999998,"5min":0.624,"15min":0.65100000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.41899999999999998},"min":{"1min":0.28100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.55900000000000005,"5min":0.63200000000000001,"15min":0.65800000000000003},"last":0.34200000000000003}]},{"osd":1,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40000000000000002,"15min":0.41799999999999998},"min":{"1min":0.26700000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.44400000000000001,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.55700000000000005,"5min":0.67100000000000004,"15min":0.76600000000000001},"last":0.36899999999999999}]},{"osd":2,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.47299999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63500000000000001,"5min":0.69699999999999995,"15min":0.72299999999999998},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.495,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65200000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.32700000000000001}]},{"osd":4,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.629,"15min":0.65100000000000002},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":0.71499999999999997,"5min":0.88500000000000001,"15min":1.0149999999999999},"last":0.628},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.66100000000000003},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94199999999999995,"5min":0.98499999999999999,"15min":1.04},"last":0.51300000000000001}]},{"osd":5,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.68000000000000005},"min":{"1min":0.50700000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80000000000000004,"5min":0.96199999999999997,"15min":1.1100000000000001},"last":0.505},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65800000000000003,"15min":0.67300000000000004},"min":{"1min":0.46700000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.87,"5min":0.93500000000000005,"15min":1.0660000000000001},"last":0.64800000000000002}]},{"osd":6,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66900000000000004,"15min":0.68600000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.40999999999999998},"max":{"1min":0.91500000000000004,"5min":0.93400000000000005,"15min":1.0860000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.69799999999999995,"15min":0.71599999999999997},"min":{"1min":0.47199999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.78800000000000003,"5min":1.0069999999999999,"15min":1.0720000000000001},"last":0.55800000000000005}]},{"osd":7,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.68600000000000005,"15min":0.70899999999999996},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92300000000000004,"5min":0.996,"15min":1.1040000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.69899999999999995,"15min":0.72199999999999998},"min":{"1min":0.48799999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93400000000000005,"5min":0.94399999999999995,"15min":1.071},"last":0.61899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303864,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067976,"statfs":{"total":96636764160,"available":96325607424,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.47099999999999997,"5min":0.38500000000000001,"15min":0.28299999999999997},"max":{"1min":0.79600000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.45200000000000001,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.79000000000000004,"15min":0.97199999999999998},"last":0.46100000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.442,"5min":0.41099999999999998,"15min":0.34999999999999998},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.89900000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.33600000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.88700000000000001},"last":0.441}]},{"osd":2,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.48199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38300000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.83099999999999996},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.31,"15min":0.28100000000000003},"max":{"1min":0.69399999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.502,"15min":0.497},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.315},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.76200000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34899999999999998,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.755,"5min":0.76500000000000001,"15min":0.79100000000000004},"last":0.434},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.57599999999999996}]},{"osd":7,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.81799999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.34200000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.58699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575970,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307960,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063880,"statfs":{"total":96636764160,"available":96321413120,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.76500000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71999999999999997,"5min":0.78700000000000003,"15min":0.86899999999999999},"last":0.47299999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71799999999999997,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.33300000000000002},"max":{"1min":0.72699999999999998,"5min":0.80300000000000005,"15min":0.81200000000000006},"last":0.51300000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.748,"5min":0.876,"15min":0.90000000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.40500000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":0.78400000000000003,"15min":0.81100000000000005},"last":0.499}]},{"osd":3,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.34399999999999997},"max":{"1min":0.76000000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.54500000000000004}]},{"osd":4,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.376,"5min":0.316,"15min":0.316},"max":{"1min":0.746,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53100000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.47999999999999998},"min":{"1min":0.35899999999999999,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.48499999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52000000000000002,"15min":0.50900000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.35199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:55:54.704 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-15T01:21:30.790436+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=1, tm_min=21, tm_sec=30, tm_wday=2, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=2, tm_min=55, tm_sec=49, tm_wday=2, tm_yday=319, tm_isdst=0) 2023-11-15T02:55:54.704 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-15T01:21:30.790436+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=1, tm_min=21, tm_sec=30, tm_wday=2, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=2, tm_min=55, tm_sec=49, tm_wday=2, tm_yday=319, tm_isdst=0) 2023-11-15T02:55:54.704 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-15T01:21:30.790436+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=1, tm_min=21, tm_sec=30, tm_wday=2, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=2, tm_min=55, tm_sec=49, tm_wday=2, tm_yday=319, tm_isdst=0) 2023-11-15T02:55:54.705 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-15T01:21:28.778860+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=1, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=2, tm_min=55, tm_sec=49, tm_wday=2, tm_yday=319, tm_isdst=0) 2023-11-15T02:55:54.705 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-15T01:21:30.790436+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=1, tm_min=21, tm_sec=30, tm_wday=2, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=2, tm_min=55, tm_sec=49, tm_wday=2, tm_yday=319, tm_isdst=0) 2023-11-15T02:55:54.705 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-15T01:21:30.790436+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=1, tm_min=21, tm_sec=30, tm_wday=2, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=2, tm_min=55, tm_sec=49, tm_wday=2, tm_yday=319, tm_isdst=0) 2023-11-15T02:55:54.706 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-15T01:21:30.790436+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=1, tm_min=21, tm_sec=30, tm_wday=2, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=2, tm_min=55, tm_sec=49, tm_wday=2, tm_yday=319, tm_isdst=0) 2023-11-15T02:55:54.706 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-15T01:21:30.790436+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=1, tm_min=21, tm_sec=30, tm_wday=2, tm_yday=319, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=15, tm_hour=2, tm_min=55, tm_sec=49, tm_wday=2, tm_yday=319, tm_isdst=0) 2023-11-15T02:55:54.706 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-15T02:56:05.813 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:56:05.816 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:56:14.707 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-15T02:56:14.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.838+0000 7f5be67f3700 1 Processor -- start 2023-11-15T02:56:14.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.838+0000 7f5be67f3700 1 -- start start 2023-11-15T02:56:14.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5be67f3700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5be0154150 0x7f5be0154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:14.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5be67f3700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5be00ab1a0 0x7f5be0158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:14.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5be67f3700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be00c06f0 con 0x7f5be00aa060 2023-11-15T02:56:14.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5be67f3700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be00c09d0 con 0x7f5be0154150 2023-11-15T02:56:14.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5be67f3700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be0158820 con 0x7f5be00ab1a0 2023-11-15T02:56:14.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5bdffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5be0154150 0x7f5be0154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:14.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5bdffff700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5be0154150 0x7f5be0154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36978/0 (socket says 172.21.15.1:36978) 2023-11-15T02:56:14.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5bdffff700 1 -- 172.21.15.1:0/3178515562 learned_addr learned my addr 172.21.15.1:0/3178515562 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:56:14.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5bdf7fe700 1 --2- 172.21.15.1:0/3178515562 >> v2:172.21.15.141:3300/0 conn(0x7f5be00ab1a0 0x7f5be0158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:14.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5bdffff700 1 -- 172.21.15.1:0/3178515562 >> v2:172.21.15.141:3300/0 conn(0x7f5be00ab1a0 msgr2=0x7f5be0158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:56:14.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5bdffff700 1 --2- 172.21.15.1:0/3178515562 >> v2:172.21.15.141:3300/0 conn(0x7f5be00ab1a0 0x7f5be0158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:14.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5bdffff700 1 -- 172.21.15.1:0/3178515562 >> v1:172.21.15.1:6789/0 conn(0x7f5be00aa060 legacy=0x7f5be00c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:14.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5bdffff700 1 -- 172.21.15.1:0/3178515562 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be0158b00 con 0x7f5be0154150 2023-11-15T02:56:14.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5bdeffd700 1 -- 172.21.15.1:0/3178515562 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987984711 0 0) 0x7f5be00c06f0 con 0x7f5be00aa060 2023-11-15T02:56:14.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5bdf7fe700 1 --2- 172.21.15.1:0/3178515562 >> v2:172.21.15.141:3300/0 conn(0x7f5be00ab1a0 0x7f5be0158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:56:14.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.839+0000 7f5bdffff700 1 --2- 172.21.15.1:0/3178515562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be0154150 0x7f5be0154530 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7f5be00c0270 tx=0x7f5bd00090f0).ready entity=mon.0 client_cookie=5d940e6ad02e5284 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:56:14.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.840+0000 7f5bdeffd700 1 -- 172.21.15.1:0/3178515562 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000b600 con 0x7f5be0154150 2023-11-15T02:56:14.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.840+0000 7f5bdeffd700 1 -- 172.21.15.1:0/3178515562 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd000b760 con 0x7f5be0154150 2023-11-15T02:56:14.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.840+0000 7f5bdeffd700 1 -- 172.21.15.1:0/3178515562 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000bb00 con 0x7f5be0154150 2023-11-15T02:56:14.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.840+0000 7f5be67f3700 1 -- 172.21.15.1:0/3178515562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be0154150 msgr2=0x7f5be0154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:14.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.840+0000 7f5be67f3700 1 --2- 172.21.15.1:0/3178515562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be0154150 0x7f5be0154530 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7f5be00c0270 tx=0x7f5bd00090f0).stop 2023-11-15T02:56:14.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.840+0000 7f5be67f3700 1 -- 172.21.15.1:0/3178515562 shutdown_connections 2023-11-15T02:56:14.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.840+0000 7f5be67f3700 1 --2- 172.21.15.1:0/3178515562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be0154150 0x7f5be0154530 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:14.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.840+0000 7f5be67f3700 1 --2- 172.21.15.1:0/3178515562 >> v2:172.21.15.141:3300/0 conn(0x7f5be00ab1a0 0x7f5be0158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:14.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.840+0000 7f5be67f3700 1 -- 172.21.15.1:0/3178515562 >> 172.21.15.1:0/3178515562 conn(0x7f5be0064aa0 msgr2=0x7f5be0064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:56:14.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.840+0000 7f5be67f3700 1 -- 172.21.15.1:0/3178515562 shutdown_connections 2023-11-15T02:56:14.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.840+0000 7f5be67f3700 1 -- 172.21.15.1:0/3178515562 wait complete. 2023-11-15T02:56:14.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.841+0000 7f5be67f3700 1 Processor -- start 2023-11-15T02:56:14.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.842+0000 7f5be67f3700 1 -- start start 2023-11-15T02:56:14.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.842+0000 7f5be67f3700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be00aa060 0x7f5be0147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:14.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.842+0000 7f5be67f3700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5be00ab1a0 0x7f5be0164880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:14.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.842+0000 7f5be67f3700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be0154150 0x7f5be0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:14.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.842+0000 7f5be67f3700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be0155d00 con 0x7f5be00aa060 2023-11-15T02:56:14.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.842+0000 7f5be67f3700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be0156250 con 0x7f5be00ab1a0 2023-11-15T02:56:14.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.842+0000 7f5be67f3700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be0148160 con 0x7f5be0154150 2023-11-15T02:56:14.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.842+0000 7f5bdffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be00aa060 0x7f5be0147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:14.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.842+0000 7f5bdffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be00aa060 0x7f5be0147c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36980/0 (socket says 172.21.15.1:36980) 2023-11-15T02:56:14.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.842+0000 7f5bdffff700 1 -- 172.21.15.1:0/1607311207 learned_addr learned my addr 172.21.15.1:0/1607311207 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:56:14.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.843+0000 7f5bdf7fe700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5be00ab1a0 0x7f5be0164880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:14.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.843+0000 7f5bdffff700 1 -- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be0154150 msgr2=0x7f5be0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:14.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.843+0000 7f5be4d90700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be0154150 0x7f5be0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:14.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.843+0000 7f5bdffff700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be0154150 0x7f5be0164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:14.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.843+0000 7f5bdffff700 1 -- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5be00ab1a0 msgr2=0x7f5be0164880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:14.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.843+0000 7f5bdffff700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5be00ab1a0 0x7f5be0164880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:14.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.843+0000 7f5bdffff700 1 -- 172.21.15.1:0/1607311207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd0009370 con 0x7f5be00aa060 2023-11-15T02:56:14.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.843+0000 7f5bdf7fe700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5be00ab1a0 0x7f5be0164880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:56:14.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.843+0000 7f5be4d90700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be0154150 0x7f5be0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-15T02:56:14.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.843+0000 7f5bdffff700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be00aa060 0x7f5be0147c70 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7f5bd0006fd0 tx=0x7f5bd0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:56:14.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.843+0000 7f5bc7fff700 1 -- 172.21.15.1:0/1607311207 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000b8d0 con 0x7f5be00aa060 2023-11-15T02:56:14.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.843+0000 7f5bc7fff700 1 -- 172.21.15.1:0/1607311207 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd000ba30 con 0x7f5be00aa060 2023-11-15T02:56:14.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.843+0000 7f5be67f3700 1 -- 172.21.15.1:0/1607311207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be0165370 con 0x7f5be00aa060 2023-11-15T02:56:14.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.843+0000 7f5bc7fff700 1 -- 172.21.15.1:0/1607311207 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd001c670 con 0x7f5be00aa060 2023-11-15T02:56:14.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.843+0000 7f5be67f3700 1 -- 172.21.15.1:0/1607311207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be0155ee0 con 0x7f5be00aa060 2023-11-15T02:56:14.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.844+0000 7f5be67f3700 1 -- 172.21.15.1:0/1607311207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be0165890 con 0x7f5be00aa060 2023-11-15T02:56:14.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.844+0000 7f5bc7fff700 1 -- 172.21.15.1:0/1607311207 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5bd001ca20 con 0x7f5be00aa060 2023-11-15T02:56:14.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.845+0000 7f5bc7fff700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bcc05f270 0x7f5bcc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:14.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.845+0000 7f5bc7fff700 1 -- 172.21.15.1:0/1607311207 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f5bd007c0c0 con 0x7f5be00aa060 2023-11-15T02:56:14.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.845+0000 7f5bdf7fe700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bcc05f270 0x7f5bcc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:14.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.846+0000 7f5bdf7fe700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bcc05f270 0x7f5bcc061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5be014eb60 tx=0x7f5bd4008040).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:56:14.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:14.849+0000 7f5bc7fff700 1 -- 172.21.15.1:0/1607311207 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5be0165890 con 0x7f5be00aa060 2023-11-15T02:56:15.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.019+0000 7f5be67f3700 1 -- 172.21.15.1:0/1607311207 --> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5be0165890 con 0x7f5bcc05f270 2023-11-15T02:56:15.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.023+0000 7f5bc7fff700 1 -- 172.21.15.1:0/1607311207 <== mgr.9370 v2:172.21.15.141:6832/103755 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71351 (secure 0 0 0) 0x7f5be0165890 con 0x7f5bcc05f270 2023-11-15T02:56:15.025 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:56:15.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.024+0000 7f5be67f3700 1 -- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bcc05f270 msgr2=0x7f5bcc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.024+0000 7f5be67f3700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bcc05f270 0x7f5bcc061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5be014eb60 tx=0x7f5bd4008040).stop 2023-11-15T02:56:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.024+0000 7f5be67f3700 1 -- 172.21.15.1:0/1607311207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be00aa060 msgr2=0x7f5be0147c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.024+0000 7f5be67f3700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be00aa060 0x7f5be0147c70 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7f5bd0006fd0 tx=0x7f5bd0017000).stop 2023-11-15T02:56:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.024+0000 7f5be67f3700 1 -- 172.21.15.1:0/1607311207 shutdown_connections 2023-11-15T02:56:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.024+0000 7f5be67f3700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f5bcc05f270 0x7f5bcc061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.024+0000 7f5be67f3700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5be0154150 0x7f5be0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.024+0000 7f5be67f3700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5be00aa060 0x7f5be0147c70 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.024+0000 7f5be67f3700 1 --2- 172.21.15.1:0/1607311207 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5be00ab1a0 0x7f5be0164880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.024+0000 7f5be67f3700 1 -- 172.21.15.1:0/1607311207 >> 172.21.15.1:0/1607311207 conn(0x7f5be0064aa0 msgr2=0x7f5be00c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:56:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.024+0000 7f5be67f3700 1 -- 172.21.15.1:0/1607311207 shutdown_connections 2023-11-15T02:56:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.024+0000 7f5be67f3700 1 -- 172.21.15.1:0/1607311207 wait complete. 2023-11-15T02:56:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-11-15T02:56:15.038 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-15T02:56:13.198456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2471872,"kb_used_data":21376,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752502848,"statfs":{"total":773094113280,"available":770562916352,"internally_reserved":0,"allocated":21889024,"data_stored":11750456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14654,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-68,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.997579"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":186,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-15T02:55:52.489767+0000","last_change":"2023-11-15T02:55:52.489767+0000","last_active":"2023-11-15T02:55:52.489767+0000","last_peered":"2023-11-15T02:55:52.489767+0000","last_clean":"2023-11-15T02:55:52.489767+0000","last_became_active":"2023-11-15T01:21:32.294800+0000","last_became_peered":"2023-11-15T01:21:32.294800+0000","last_unstale":"2023-11-15T02:55:52.489767+0000","last_undegraded":"2023-11-15T02:55:52.489767+0000","last_fullsized":"2023-11-15T02:55:52.489767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:52.489666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:52.489666+0000","last_clean_scrub_stamp":"2023-11-15T02:55:52.489666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":185,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-15T02:56:01.591163+0000","last_change":"2023-11-15T02:56:01.591163+0000","last_active":"2023-11-15T02:56:01.591163+0000","last_peered":"2023-11-15T02:56:01.591163+0000","last_clean":"2023-11-15T02:56:01.591163+0000","last_became_active":"2023-11-15T01:21:31.809423+0000","last_became_peered":"2023-11-15T01:21:31.809423+0000","last_unstale":"2023-11-15T02:56:01.591163+0000","last_undegraded":"2023-11-15T02:56:01.591163+0000","last_fullsized":"2023-11-15T02:56:01.591163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:56:01.591047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:56:01.591047+0000","last_clean_scrub_stamp":"2023-11-15T02:56:01.591047+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-15T02:55:52.194016+0000","last_change":"2023-11-15T02:55:52.194016+0000","last_active":"2023-11-15T02:55:52.194016+0000","last_peered":"2023-11-15T02:55:52.194016+0000","last_clean":"2023-11-15T02:55:52.194016+0000","last_became_active":"2023-11-15T01:21:31.804450+0000","last_became_peered":"2023-11-15T01:21:31.804450+0000","last_unstale":"2023-11-15T02:55:52.194016+0000","last_undegraded":"2023-11-15T02:55:52.194016+0000","last_fullsized":"2023-11-15T02:55:52.194016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:52.193913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:52.193913+0000","last_clean_scrub_stamp":"2023-11-15T02:55:52.193913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":185,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-15T02:56:02.635329+0000","last_change":"2023-11-15T02:56:02.635329+0000","last_active":"2023-11-15T02:56:02.635329+0000","last_peered":"2023-11-15T02:56:02.635329+0000","last_clean":"2023-11-15T02:56:02.635329+0000","last_became_active":"2023-11-15T01:21:31.810598+0000","last_became_peered":"2023-11-15T01:21:31.810598+0000","last_unstale":"2023-11-15T02:56:02.635329+0000","last_undegraded":"2023-11-15T02:56:02.635329+0000","last_fullsized":"2023-11-15T02:56:02.635329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:56:02.635219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:56:02.635219+0000","last_clean_scrub_stamp":"2023-11-15T02:56:02.635219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":180,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-15T02:56:03.269159+0000","last_change":"2023-11-15T02:56:03.269159+0000","last_active":"2023-11-15T02:56:03.269159+0000","last_peered":"2023-11-15T02:56:03.269159+0000","last_clean":"2023-11-15T02:56:03.269159+0000","last_became_active":"2023-11-15T01:21:30.329022+0000","last_became_peered":"2023-11-15T01:21:30.329022+0000","last_unstale":"2023-11-15T02:56:03.269159+0000","last_undegraded":"2023-11-15T02:56:03.269159+0000","last_fullsized":"2023-11-15T02:56:03.269159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:56:03.269031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:56:03.269031+0000","last_clean_scrub_stamp":"2023-11-15T02:56:03.269031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":178,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-15T02:56:07.270222+0000","last_change":"2023-11-15T02:56:07.270222+0000","last_active":"2023-11-15T02:56:07.270222+0000","last_peered":"2023-11-15T02:56:07.270222+0000","last_clean":"2023-11-15T02:56:07.270222+0000","last_became_active":"2023-11-15T01:21:31.809654+0000","last_became_peered":"2023-11-15T01:21:31.809654+0000","last_unstale":"2023-11-15T02:56:07.270222+0000","last_undegraded":"2023-11-15T02:56:07.270222+0000","last_fullsized":"2023-11-15T02:56:07.270222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:56:07.270091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:56:07.270091+0000","last_clean_scrub_stamp":"2023-11-15T02:56:07.270091+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":178,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-15T02:56:08.229188+0000","last_change":"2023-11-15T02:56:08.229188+0000","last_active":"2023-11-15T02:56:08.229188+0000","last_peered":"2023-11-15T02:56:08.229188+0000","last_clean":"2023-11-15T02:56:08.229188+0000","last_became_active":"2023-11-15T01:21:32.295150+0000","last_became_peered":"2023-11-15T01:21:32.295150+0000","last_unstale":"2023-11-15T02:56:08.229188+0000","last_undegraded":"2023-11-15T02:56:08.229188+0000","last_fullsized":"2023-11-15T02:56:08.229188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:56:08.229056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:56:08.229056+0000","last_clean_scrub_stamp":"2023-11-15T02:56:08.229056+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":186,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-15T02:55:54.488661+0000","last_change":"2023-11-15T02:55:54.488661+0000","last_active":"2023-11-15T02:55:54.488661+0000","last_peered":"2023-11-15T02:55:54.488661+0000","last_clean":"2023-11-15T02:55:54.488661+0000","last_became_active":"2023-11-15T01:21:31.816266+0000","last_became_peered":"2023-11-15T01:21:31.816266+0000","last_unstale":"2023-11-15T02:55:54.488661+0000","last_undegraded":"2023-11-15T02:55:54.488661+0000","last_fullsized":"2023-11-15T02:55:54.488661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:54.488572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:54.488572+0000","last_clean_scrub_stamp":"2023-11-15T02:55:54.488572+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":209,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-11-15T02:55:54.700634+0000","last_change":"2023-11-15T02:55:54.700634+0000","last_active":"2023-11-15T02:55:54.700634+0000","last_peered":"2023-11-15T02:55:54.700634+0000","last_clean":"2023-11-15T02:55:54.700634+0000","last_became_active":"2023-11-15T01:21:31.816182+0000","last_became_peered":"2023-11-15T01:21:31.816182+0000","last_unstale":"2023-11-15T02:55:54.700634+0000","last_undegraded":"2023-11-15T02:55:54.700634+0000","last_fullsized":"2023-11-15T02:55:54.700634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-15T02:55:54.700518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-15T02:55:54.700518+0000","last_clean_scrub_stamp":"2023-11-15T02:55:54.700518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575974,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303864,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067976,"statfs":{"total":96636764160,"available":96325607424,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:56:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.80300000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.82399999999999995},"last":0.80300000000000005}]},{"osd":1,"last update":"Wed Nov 15 02:56:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.34100000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.748,"5min":0.78500000000000003,"15min":0.79200000000000004},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55100000000000005,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.82299999999999995},"last":0.58999999999999997}]},{"osd":2,"last update":"Wed Nov 15 02:56:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56100000000000005,"15min":0.57999999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76400000000000001,"5min":0.78000000000000003,"15min":0.80400000000000005},"last":0.624},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76700000000000002,"5min":0.82799999999999996,"15min":0.83799999999999997},"last":0.76600000000000001}]},{"osd":3,"last update":"Wed Nov 15 02:56:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80300000000000005,"5min":0.82399999999999995,"15min":0.88500000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.61399999999999999},"min":{"1min":0.40500000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77600000000000002,"5min":0.81899999999999995,"15min":0.86699999999999999},"last":0.65300000000000002}]},{"osd":4,"last update":"Wed Nov 15 02:56:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.46899999999999997,"15min":0.47499999999999998},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.63200000000000001,"5min":0.71699999999999997,"15min":0.73399999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56299999999999994,"15min":0.55200000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.29399999999999998},"max":{"1min":0.73599999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.57099999999999995}]},{"osd":5,"last update":"Wed Nov 15 02:56:11 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48799999999999999,"15min":0.48299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30199999999999999,"15min":0.27300000000000002},"max":{"1min":0.755,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.501,"15min":0.501},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65700000000000003,"5min":0.77000000000000002,"15min":0.81999999999999995},"last":0.52200000000000002}]},{"osd":6,"last update":"Wed Nov 15 02:56:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.53300000000000003},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.73999999999999999,"5min":0.78200000000000003,"15min":0.84899999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.28499999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.66700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575975,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307960,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063880,"statfs":{"total":96636764160,"available":96321413120,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.24099999999999999},"max":{"1min":0.79500000000000004,"5min":0.79700000000000004,"15min":0.92500000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.437,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":1.466,"15min":1.466},"last":0.373}]},{"osd":1,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81999999999999995},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78400000000000003,"5min":1.53,"15min":1.53},"last":0.48099999999999998}]},{"osd":2,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.36899999999999999,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":1.026,"15min":1.026},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.80200000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.52400000000000002}]},{"osd":3,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.378,"5min":0.35299999999999998,"15min":0.32900000000000001},"max":{"1min":0.71099999999999997,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.81200000000000006,"5min":1.498,"15min":1.498},"last":0.53800000000000003}]},{"osd":4,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.28100000000000003},"max":{"1min":0.61299999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.68400000000000005,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.56599999999999995}]},{"osd":5,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.499,"15min":0.48999999999999999},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65600000000000003,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.376,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.629}]},{"osd":7,"last update":"Wed Nov 15 02:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.498,"15min":0.503},"min":{"1min":0.34300000000000003,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":0.76400000000000001,"5min":1.04,"15min":1.04},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.441,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80000000000000004,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.61699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575976,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307960,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063880,"statfs":{"total":96636764160,"available":96321413120,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.38900000000000001,"15min":0.39100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.23999999999999999},"max":{"1min":0.52500000000000002,"5min":1.149,"15min":1.149},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.41399999999999998,"15min":0.41699999999999998},"min":{"1min":0.318,"5min":0.254,"15min":0.254},"max":{"1min":0.70499999999999996,"5min":1.044,"15min":1.044},"last":0.45000000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.39800000000000002,"15min":0.40500000000000003},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.47899999999999998,"5min":0.748,"15min":0.748},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.45800000000000002,"15min":0.46200000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28299999999999997},"max":{"1min":0.54000000000000004,"5min":1.101,"15min":1.101},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Nov 15 02:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.61199999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67800000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.40600000000000003}]},{"osd":4,"last update":"Wed Nov 15 02:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.47299999999999998,"5min":0.40999999999999998,"15min":0.372},"max":{"1min":0.879,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65300000000000002,"15min":0.66100000000000003},"min":{"1min":0.47799999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76000000000000001,"5min":1.052,"15min":1.081},"last":0.60799999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64500000000000002,"15min":0.65500000000000003},"min":{"1min":0.48299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84899999999999998,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.748},{"interface":"front","average":{"1min":0.62,"5min":0.71599999999999997,"15min":0.68799999999999994},"min":{"1min":0.436,"5min":0.42999999999999999,"15min":0.42699999999999999},"max":{"1min":0.83699999999999997,"5min":5.7590000000000003,"15min":5.7590000000000003},"last":0.65400000000000003}]},{"osd":6,"last update":"Wed Nov 15 02:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68999999999999995,"15min":0.70499999999999996},"min":{"1min":0.51500000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95999999999999996,"5min":1.089,"15min":1.089},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.75700000000000001,"15min":0.73699999999999999},"min":{"1min":0.53600000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91000000000000003,"5min":5.7930000000000001,"15min":5.7930000000000001},"last":0.86899999999999999}]},{"osd":7,"last update":"Wed Nov 15 02:56:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86599999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.56599999999999995,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91800000000000004,"5min":1.04,"15min":1.04},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575974,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312056,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059784,"statfs":{"total":96636764160,"available":96317218816,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56799999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.432,"15min":0.44},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.58099999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"last":0.46400000000000002}]},{"osd":2,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52700000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.443},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57099999999999995,"5min":0.72499999999999998,"15min":0.75800000000000001},"last":0.628}]},{"osd":3,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.58599999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60999999999999999,"5min":1.776,"15min":1.776},"last":0.50700000000000001}]},{"osd":4,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.72399999999999998,"15min":0.70399999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.40500000000000003},"max":{"1min":1.0129999999999999,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":0.621},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.42699999999999999},"max":{"1min":0.86399999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67500000000000004,"15min":0.65900000000000003},"min":{"1min":0.435,"5min":0.39100000000000001,"15min":0.378},"max":{"1min":0.83399999999999996,"5min":3.766,"15min":3.766},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.877,"5min":0.98399999999999999,"15min":1.028},"last":0.749}]},{"osd":6,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.52900000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94499999999999995,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.76200000000000001}]},{"osd":7,"last update":"Wed Nov 15 02:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.40699999999999997},"max":{"1min":0.85399999999999998,"5min":0.97799999999999998,"15min":1.0549999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.47599999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.107},"last":0.71899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575975,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316152,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055688,"statfs":{"total":96636764160,"available":96313024512,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.47499999999999998,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.27000000000000002,"15min":0.253},"max":{"1min":0.64000000000000001,"5min":8.5280000000000005,"15min":8.5280000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42099999999999999,"15min":0.432},"min":{"1min":0.26900000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69299999999999995,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.41399999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39800000000000002,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.34399999999999997,"5min":0.31,"15min":0.29499999999999998},"max":{"1min":0.66200000000000003,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.621,"5min":0.65900000000000003,"15min":0.70099999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54600000000000004,"15min":0.495},"min":{"1min":0.376,"5min":0.32500000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":8.7200000000000006,"15min":8.7200000000000006},"last":0.433}]},{"osd":4,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.70799999999999996,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89500000000000002,"5min":8.5890000000000004,"15min":8.5890000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64100000000000001,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88800000000000001,"5min":0.97199999999999998,"15min":0.98399999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.66600000000000004},"min":{"1min":0.442,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85399999999999998,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.74299999999999999,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94699999999999995,"5min":8.625,"15min":8.625},"last":0.76400000000000001}]},{"osd":6,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.52200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.89400000000000002,"5min":1.0269999999999999,"15min":1.113},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67700000000000005,"15min":0.70199999999999996},"min":{"1min":0.47299999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.0660000000000001},"last":0.751}]},{"osd":7,"last update":"Wed Nov 15 02:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69099999999999995,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93500000000000005,"5min":0.995,"15min":1.0680000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.71399999999999997},"min":{"1min":0.505,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91200000000000003,"5min":1.089,"15min":1.1499999999999999},"last":0.79400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575976,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312056,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059784,"statfs":{"total":96636764160,"available":96317218816,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39000000000000001,"15min":0.39800000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59899999999999998,"5min":0.624,"15min":0.65100000000000002},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.41899999999999998},"min":{"1min":0.28100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.55900000000000005,"5min":0.63200000000000001,"15min":0.65800000000000003},"last":0.35599999999999998}]},{"osd":1,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40000000000000002,"15min":0.41799999999999998},"min":{"1min":0.26700000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.44400000000000001,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.55700000000000005,"5min":0.67100000000000004,"15min":0.76600000000000001},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.47299999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63500000000000001,"5min":0.69699999999999995,"15min":0.72299999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.495,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65200000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.443}]},{"osd":4,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.629,"15min":0.65100000000000002},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":0.71499999999999997,"5min":0.88500000000000001,"15min":1.0149999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.66100000000000003},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94199999999999995,"5min":0.98499999999999999,"15min":1.04},"last":0.80400000000000005}]},{"osd":5,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66300000000000003,"15min":0.68000000000000005},"min":{"1min":0.50700000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80000000000000004,"5min":0.96199999999999997,"15min":1.1100000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65800000000000003,"15min":0.67300000000000004},"min":{"1min":0.46700000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.87,"5min":0.93500000000000005,"15min":1.0660000000000001},"last":0.70599999999999996}]},{"osd":6,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66900000000000004,"15min":0.68600000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.40999999999999998},"max":{"1min":0.91500000000000004,"5min":0.93400000000000005,"15min":1.0860000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.69799999999999995,"15min":0.71599999999999997},"min":{"1min":0.47199999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.78800000000000003,"5min":1.0069999999999999,"15min":1.0720000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Wed Nov 15 02:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.68600000000000005,"15min":0.70899999999999996},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92300000000000004,"5min":0.996,"15min":1.1040000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.69899999999999995,"15min":0.72199999999999998},"min":{"1min":0.48799999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93400000000000005,"5min":0.94399999999999995,"15min":1.071},"last":0.71899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303864,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067976,"statfs":{"total":96636764160,"available":96325607424,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.47099999999999997,"5min":0.38500000000000001,"15min":0.28299999999999997},"max":{"1min":0.79600000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.45200000000000001,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.79000000000000004,"15min":0.97199999999999998},"last":0.45900000000000002}]},{"osd":1,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.442,"5min":0.41099999999999998,"15min":0.34999999999999998},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.89900000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.33600000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.88700000000000001},"last":0.51100000000000001}]},{"osd":2,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.48199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.86399999999999999},"last":0.434},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.626}]},{"osd":3,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38300000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.83099999999999996},"last":0.53500000000000003}]},{"osd":5,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.31,"15min":0.28100000000000003},"max":{"1min":0.69399999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.502,"15min":0.497},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.315},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.76200000000000001},"last":0.58699999999999997}]},{"osd":6,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34899999999999998,"5min":0.32200000000000001,"15min":0.315},"max":{"1min":0.755,"5min":0.76500000000000001,"15min":0.79100000000000004},"last":0.499},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.55300000000000005}]},{"osd":7,"last update":"Wed Nov 15 02:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.35699999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.81799999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.34200000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.61599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575974,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307960,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063880,"statfs":{"total":96636764160,"available":96321413120,"internally_reserved":0,"allocated":2736128,"data_stored":1468807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.76500000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71999999999999997,"5min":0.78700000000000003,"15min":0.86899999999999999},"last":0.68700000000000006}]},{"osd":1,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71799999999999997,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.33300000000000002},"max":{"1min":0.72699999999999998,"5min":0.80300000000000005,"15min":0.81200000000000006},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.748,"5min":0.876,"15min":0.90000000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.40500000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":0.78400000000000003,"15min":0.81100000000000005},"last":0.59099999999999997}]},{"osd":3,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.34399999999999997},"max":{"1min":0.76000000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.55300000000000005}]},{"osd":4,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.376,"5min":0.316,"15min":0.316},"max":{"1min":0.746,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52000000000000002}]},{"osd":6,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.47999999999999998},"min":{"1min":0.35899999999999999,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.46600000000000003}]},{"osd":7,"last update":"Wed Nov 15 02:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52000000000000002,"15min":0.50900000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.35199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.49199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-15T02:56:15.040 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-15T02:56:15.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.155+0000 7f1be102b700 1 Processor -- start 2023-11-15T02:56:15.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.155+0000 7f1be102b700 1 -- start start 2023-11-15T02:56:15.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.156+0000 7f1be102b700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1bdc137030 0x7f1bdc137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:15.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.156+0000 7f1be102b700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1bdc1588e0 0x7f1bdc066870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:15.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.156+0000 7f1be102b700 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bdc0671b0 con 0x7f1bdc066d60 2023-11-15T02:56:15.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.156+0000 7f1be102b700 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bdc137900 con 0x7f1bdc137030 2023-11-15T02:56:15.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.156+0000 7f1be102b700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bdc158d90 con 0x7f1bdc1588e0 2023-11-15T02:56:15.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.156+0000 7f1bdad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1bdc137030 0x7f1bdc137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:15.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.156+0000 7f1bdad9d700 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1bdc137030 0x7f1bdc137410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36984/0 (socket says 172.21.15.1:36984) 2023-11-15T02:56:15.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.156+0000 7f1bdad9d700 1 -- 172.21.15.1:0/309923008 learned_addr learned my addr 172.21.15.1:0/309923008 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:56:15.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.157+0000 7f1bda59c700 1 --2- 172.21.15.1:0/309923008 >> v2:172.21.15.141:3300/0 conn(0x7f1bdc1588e0 0x7f1bdc066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:15.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.157+0000 7f1bdad9d700 1 -- 172.21.15.1:0/309923008 >> v2:172.21.15.141:3300/0 conn(0x7f1bdc1588e0 msgr2=0x7f1bdc066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:56:15.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.157+0000 7f1bdad9d700 1 --2- 172.21.15.1:0/309923008 >> v2:172.21.15.141:3300/0 conn(0x7f1bdc1588e0 0x7f1bdc066870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.157+0000 7f1bdad9d700 1 -- 172.21.15.1:0/309923008 >> v1:172.21.15.141:6789/0 conn(0x7f1bdc066d60 legacy=0x7f1bdc14e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:15.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.157+0000 7f1bdad9d700 1 -- 172.21.15.1:0/309923008 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc154ce0 con 0x7f1bdc137030 2023-11-15T02:56:15.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.157+0000 7f1bda59c700 1 --2- 172.21.15.1:0/309923008 >> v2:172.21.15.141:3300/0 conn(0x7f1bdc1588e0 0x7f1bdc066870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-15T02:56:15.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.157+0000 7f1bdad9d700 1 --2- 172.21.15.1:0/309923008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bdc137030 0x7f1bdc137410 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7f1bdc0c89d0 tx=0x7f1bd40090f0).ready entity=mon.0 client_cookie=38d096eea988abaa server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:56:15.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.157+0000 7f1bd9d9b700 1 -- 172.21.15.1:0/309923008 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd400b600 con 0x7f1bdc137030 2023-11-15T02:56:15.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.157+0000 7f1bd9d9b700 1 -- 172.21.15.1:0/309923008 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd400b760 con 0x7f1bdc137030 2023-11-15T02:56:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.157+0000 7f1bd9d9b700 1 -- 172.21.15.1:0/309923008 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd400bae0 con 0x7f1bdc137030 2023-11-15T02:56:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.158+0000 7f1be102b700 1 -- 172.21.15.1:0/309923008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bdc137030 msgr2=0x7f1bdc137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.158+0000 7f1be102b700 1 --2- 172.21.15.1:0/309923008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bdc137030 0x7f1bdc137410 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7f1bdc0c89d0 tx=0x7f1bd40090f0).stop 2023-11-15T02:56:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.158+0000 7f1be102b700 1 -- 172.21.15.1:0/309923008 shutdown_connections 2023-11-15T02:56:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.158+0000 7f1be102b700 1 --2- 172.21.15.1:0/309923008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bdc137030 0x7f1bdc137410 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.158+0000 7f1be102b700 1 --2- 172.21.15.1:0/309923008 >> v2:172.21.15.141:3300/0 conn(0x7f1bdc1588e0 0x7f1bdc066870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.158+0000 7f1be102b700 1 -- 172.21.15.1:0/309923008 >> 172.21.15.1:0/309923008 conn(0x7f1bdc063280 msgr2=0x7f1bdc0c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:56:15.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.158+0000 7f1be102b700 1 -- 172.21.15.1:0/309923008 shutdown_connections 2023-11-15T02:56:15.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.158+0000 7f1be102b700 1 -- 172.21.15.1:0/309923008 wait complete. 2023-11-15T02:56:15.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.159+0000 7f1be102b700 1 Processor -- start 2023-11-15T02:56:15.168 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.159+0000 7f1be102b700 1 -- start start 2023-11-15T02:56:15.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1be102b700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bdc066d60 0x7f1bdc1386a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:15.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1be102b700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1bdc137030 0x7f1bdc13a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:15.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1be102b700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bdc1588e0 0x7f1bdc150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:15.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1be102b700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc0ac7e0 con 0x7f1bdc1588e0 2023-11-15T02:56:15.169 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1be102b700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc13aaf0 con 0x7f1bdc137030 2023-11-15T02:56:15.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1be102b700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc0abeb0 con 0x7f1bdc066d60 2023-11-15T02:56:15.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1bdb59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bdc1588e0 0x7f1bdc150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:15.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1bdb59e700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bdc1588e0 0x7f1bdc150490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36994/0 (socket says 172.21.15.1:36994) 2023-11-15T02:56:15.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1bdb59e700 1 -- 172.21.15.1:0/1471308514 learned_addr learned my addr 172.21.15.1:0/1471308514 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:56:15.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1bda59c700 1 --2- 172.21.15.1:0/1471308514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1bdc137030 0x7f1bdc13a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:15.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1bdad9d700 1 --2- 172.21.15.1:0/1471308514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bdc066d60 0x7f1bdc1386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:15.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1bdb59e700 1 -- 172.21.15.1:0/1471308514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bdc066d60 msgr2=0x7f1bdc1386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:15.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1bdb59e700 1 --2- 172.21.15.1:0/1471308514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bdc066d60 0x7f1bdc1386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1bdb59e700 1 -- 172.21.15.1:0/1471308514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1bdc137030 msgr2=0x7f1bdc13a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:15.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1bdb59e700 1 --2- 172.21.15.1:0/1471308514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1bdc137030 0x7f1bdc13a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1bdb59e700 1 -- 172.21.15.1:0/1471308514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd4009370 con 0x7f1bdc1588e0 2023-11-15T02:56:15.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1bdb59e700 1 --2- 172.21.15.1:0/1471308514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bdc1588e0 0x7f1bdc150490 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 rx=0x7f1bcc00c7c0 tx=0x7f1bcc001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:56:15.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.160+0000 7f1bd2ffd700 1 -- 172.21.15.1:0/1471308514 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc00e4a0 con 0x7f1bdc1588e0 2023-11-15T02:56:15.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.161+0000 7f1bd2ffd700 1 -- 172.21.15.1:0/1471308514 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc00e600 con 0x7f1bdc1588e0 2023-11-15T02:56:15.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.161+0000 7f1bd2ffd700 1 -- 172.21.15.1:0/1471308514 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc00e980 con 0x7f1bdc1588e0 2023-11-15T02:56:15.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.161+0000 7f1be102b700 1 -- 172.21.15.1:0/1471308514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bdc0ac190 con 0x7f1bdc1588e0 2023-11-15T02:56:15.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.161+0000 7f1be102b700 1 -- 172.21.15.1:0/1471308514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bdc138b90 con 0x7f1bdc1588e0 2023-11-15T02:56:15.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.162+0000 7f1be102b700 1 -- 172.21.15.1:0/1471308514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bdc0ac950 con 0x7f1bdc1588e0 2023-11-15T02:56:15.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.162+0000 7f1bd2ffd700 1 -- 172.21.15.1:0/1471308514 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1bcc0123f0 con 0x7f1bdc1588e0 2023-11-15T02:56:15.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.162+0000 7f1bd2ffd700 1 --2- 172.21.15.1:0/1471308514 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1bbc05f240 0x7f1bbc061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:15.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.162+0000 7f1bd2ffd700 1 -- 172.21.15.1:0/1471308514 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f1bcc079cc0 con 0x7f1bdc1588e0 2023-11-15T02:56:15.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.162+0000 7f1bdad9d700 1 --2- 172.21.15.1:0/1471308514 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1bbc05f240 0x7f1bbc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:15.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.163+0000 7f1bdad9d700 1 --2- 172.21.15.1:0/1471308514 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1bbc05f240 0x7f1bbc061700 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1bd4009130 tx=0x7f1bd4017000).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:56:15.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.166+0000 7f1bd2ffd700 1 -- 172.21.15.1:0/1471308514 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1bcc047af0 con 0x7f1bdc1588e0 2023-11-15T02:56:15.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.339+0000 7f1be102b700 1 -- 172.21.15.1:0/1471308514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f1bdc06c7e0 con 0x7f1bdc1588e0 2023-11-15T02:56:15.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.343+0000 7f1bd2ffd700 1 -- 172.21.15.1:0/1471308514 <== mon.0 v2:172.21.15.1:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1bcc001630 con 0x7f1bdc1588e0 2023-11-15T02:56:15.346 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.344+0000 7f1bd2ffd700 1 -- 172.21.15.1:0/1471308514 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v46)=0 v46) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1bcc04e6e0 con 0x7f1bdc1588e0 2023-11-15T02:56:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.346+0000 7f1be102b700 1 -- 172.21.15.1:0/1471308514 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1bbc05f240 msgr2=0x7f1bbc061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.346+0000 7f1be102b700 1 --2- 172.21.15.1:0/1471308514 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1bbc05f240 0x7f1bbc061700 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1bd4009130 tx=0x7f1bd4017000).stop 2023-11-15T02:56:15.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.346+0000 7f1be102b700 1 -- 172.21.15.1:0/1471308514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bdc1588e0 msgr2=0x7f1bdc150490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.346+0000 7f1be102b700 1 --2- 172.21.15.1:0/1471308514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bdc1588e0 0x7f1bdc150490 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 rx=0x7f1bcc00c7c0 tx=0x7f1bcc001510).stop 2023-11-15T02:56:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.346+0000 7f1be102b700 1 -- 172.21.15.1:0/1471308514 shutdown_connections 2023-11-15T02:56:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.346+0000 7f1be102b700 1 --2- 172.21.15.1:0/1471308514 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7f1bbc05f240 0x7f1bbc061700 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.346+0000 7f1be102b700 1 --2- 172.21.15.1:0/1471308514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bdc1588e0 0x7f1bdc150490 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.349 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.346+0000 7f1be102b700 1 --2- 172.21.15.1:0/1471308514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bdc066d60 0x7f1bdc1386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.346+0000 7f1be102b700 1 --2- 172.21.15.1:0/1471308514 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1bdc137030 0x7f1bdc13a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.346+0000 7f1be102b700 1 -- 172.21.15.1:0/1471308514 >> 172.21.15.1:0/1471308514 conn(0x7f1bdc063280 msgr2=0x7f1bdc063aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:56:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.346+0000 7f1be102b700 1 -- 172.21.15.1:0/1471308514 shutdown_connections 2023-11-15T02:56:15.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.346+0000 7f1be102b700 1 -- 172.21.15.1:0/1471308514 wait complete. 2023-11-15T02:56:15.360 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-15T02:56:15.360 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-15T02:56:15.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.475+0000 7ff547023700 1 Processor -- start 2023-11-15T02:56:15.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.475+0000 7ff547023700 1 -- start start 2023-11-15T02:56:15.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.476+0000 7ff547023700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5400bdfb0 0x7ff5400be390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:15.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.476+0000 7ff547023700 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff540154e70 0x7ff540155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:15.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.476+0000 7ff547023700 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5401557f0 con 0x7ff5400c6d10 2023-11-15T02:56:15.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.476+0000 7ff547023700 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5400bccd0 con 0x7ff540154e70 2023-11-15T02:56:15.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.476+0000 7ff547023700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5400ad5e0 con 0x7ff5400bdfb0 2023-11-15T02:56:15.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.476+0000 7ff53ffff700 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff5400c6d10 0x7ff5400bd400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:50990/0 (socket says 172.21.15.1:50990) 2023-11-15T02:56:15.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.477+0000 7ff53ffff700 1 -- 172.21.15.1:0/1872746450 learned_addr learned my addr 172.21.15.1:0/1872746450 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-11-15T02:56:15.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.477+0000 7ff5455c0700 1 --2- 172.21.15.1:0/1872746450 >> v2:172.21.15.141:3300/0 conn(0x7ff540154e70 0x7ff540155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:15.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.477+0000 7ff544dbf700 1 --2- 172.21.15.1:0/1872746450 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5400bdfb0 0x7ff5400be390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:15.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.477+0000 7ff53f7fe700 1 -- 172.21.15.1:0/1872746450 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762503226 0 0) 0x7ff5401557f0 con 0x7ff5400c6d10 2023-11-15T02:56:15.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.477+0000 7ff53f7fe700 1 -- 172.21.15.1:0/1872746450 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff52c0033f0 con 0x7ff5400c6d10 2023-11-15T02:56:15.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.477+0000 7ff53f7fe700 1 -- 172.21.15.1:0/1872746450 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3307849635 0 0) 0x7ff52c0033f0 con 0x7ff5400c6d10 2023-11-15T02:56:15.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.477+0000 7ff544dbf700 1 -- 172.21.15.1:0/1872746450 >> v2:172.21.15.141:3300/0 conn(0x7ff540154e70 msgr2=0x7ff540155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-15T02:56:15.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.477+0000 7ff544dbf700 1 --2- 172.21.15.1:0/1872746450 >> v2:172.21.15.141:3300/0 conn(0x7ff540154e70 0x7ff540155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.477+0000 7ff544dbf700 1 -- 172.21.15.1:0/1872746450 >> v1:172.21.15.1:6789/0 conn(0x7ff5400c6d10 legacy=0x7ff5400bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:15.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.477+0000 7ff544dbf700 1 -- 172.21.15.1:0/1872746450 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5400ad8c0 con 0x7ff5400bdfb0 2023-11-15T02:56:15.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.477+0000 7ff5455c0700 1 --2- 172.21.15.1:0/1872746450 >> v2:172.21.15.141:3300/0 conn(0x7ff540154e70 0x7ff540155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-15T02:56:15.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.477+0000 7ff544dbf700 1 --2- 172.21.15.1:0/1872746450 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5400bdfb0 0x7ff5400be390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7ff538009760 tx=0x7ff538009060).ready entity=mon.2 client_cookie=4dc5ceaab3f05328 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:56:15.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.477+0000 7ff53f7fe700 1 -- 172.21.15.1:0/1872746450 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5300017f0 con 0x7ff5400bdfb0 2023-11-15T02:56:15.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.477+0000 7ff53f7fe700 1 -- 172.21.15.1:0/1872746450 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff538011400 con 0x7ff5400bdfb0 2023-11-15T02:56:15.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.478+0000 7ff53f7fe700 1 -- 172.21.15.1:0/1872746450 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5380117a0 con 0x7ff5400bdfb0 2023-11-15T02:56:15.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.478+0000 7ff547023700 1 -- 172.21.15.1:0/1872746450 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5400bdfb0 msgr2=0x7ff5400be390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:15.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.478+0000 7ff547023700 1 --2- 172.21.15.1:0/1872746450 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5400bdfb0 0x7ff5400be390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7ff538009760 tx=0x7ff538009060).stop 2023-11-15T02:56:15.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.478+0000 7ff547023700 1 -- 172.21.15.1:0/1872746450 shutdown_connections 2023-11-15T02:56:15.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.478+0000 7ff547023700 1 --2- 172.21.15.1:0/1872746450 >> v2:172.21.15.141:3300/0 conn(0x7ff540154e70 0x7ff540155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.478+0000 7ff547023700 1 --2- 172.21.15.1:0/1872746450 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5400bdfb0 0x7ff5400be390 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.478+0000 7ff547023700 1 -- 172.21.15.1:0/1872746450 >> 172.21.15.1:0/1872746450 conn(0x7ff5400c7d70 msgr2=0x7ff5400c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:56:15.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.478+0000 7ff547023700 1 -- 172.21.15.1:0/1872746450 shutdown_connections 2023-11-15T02:56:15.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.478+0000 7ff547023700 1 -- 172.21.15.1:0/1872746450 wait complete. 2023-11-15T02:56:15.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.479+0000 7ff547023700 1 Processor -- start 2023-11-15T02:56:15.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.479+0000 7ff547023700 1 -- start start 2023-11-15T02:56:15.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.480+0000 7ff547023700 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5400bdfb0 0x7ff5400c17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:15.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.480+0000 7ff547023700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5400c6d10 0x7ff540134ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:15.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.480+0000 7ff547023700 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff540154e70 0x7ff540149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:15.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.480+0000 7ff547023700 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5400bf180 con 0x7ff5400c6d10 2023-11-15T02:56:15.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.480+0000 7ff547023700 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff540149770 con 0x7ff5400bdfb0 2023-11-15T02:56:15.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.480+0000 7ff547023700 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff540149a30 con 0x7ff540154e70 2023-11-15T02:56:15.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.480+0000 7ff53ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5400c6d10 0x7ff540134ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:15.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.480+0000 7ff53ffff700 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5400c6d10 0x7ff540134ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37002/0 (socket says 172.21.15.1:37002) 2023-11-15T02:56:15.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.480+0000 7ff53ffff700 1 -- 172.21.15.1:0/495304313 learned_addr learned my addr 172.21.15.1:0/495304313 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-11-15T02:56:15.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.480+0000 7ff544dbf700 1 --2- 172.21.15.1:0/495304313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5400bdfb0 0x7ff5400c17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:15.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.480+0000 7ff5455c0700 1 --2- 172.21.15.1:0/495304313 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff540154e70 0x7ff540149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:15.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.481+0000 7ff53ffff700 1 -- 172.21.15.1:0/495304313 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff540154e70 msgr2=0x7ff540149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:15.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.481+0000 7ff53ffff700 1 --2- 172.21.15.1:0/495304313 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff540154e70 0x7ff540149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.481+0000 7ff53ffff700 1 -- 172.21.15.1:0/495304313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5400bdfb0 msgr2=0x7ff5400c17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:15.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.481+0000 7ff53ffff700 1 --2- 172.21.15.1:0/495304313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5400bdfb0 0x7ff5400c17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.481+0000 7ff53ffff700 1 -- 172.21.15.1:0/495304313 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5280092a0 con 0x7ff5400c6d10 2023-11-15T02:56:15.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.481+0000 7ff53ffff700 1 --2- 172.21.15.1:0/495304313 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5400c6d10 0x7ff540134ae0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7ff53000cb60 tx=0x7ff530007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:56:15.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.481+0000 7ff53cff9700 1 -- 172.21.15.1:0/495304313 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530005d30 con 0x7ff5400c6d10 2023-11-15T02:56:15.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.481+0000 7ff53cff9700 1 -- 172.21.15.1:0/495304313 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff530005e90 con 0x7ff5400c6d10 2023-11-15T02:56:15.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.481+0000 7ff547023700 1 -- 172.21.15.1:0/495304313 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5380092a0 con 0x7ff5400c6d10 2023-11-15T02:56:15.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.481+0000 7ff53cff9700 1 -- 172.21.15.1:0/495304313 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530007380 con 0x7ff5400c6d10 2023-11-15T02:56:15.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.481+0000 7ff547023700 1 -- 172.21.15.1:0/495304313 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff540149ff0 con 0x7ff5400c6d10 2023-11-15T02:56:15.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.482+0000 7ff547023700 1 -- 172.21.15.1:0/495304313 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5400bf330 con 0x7ff5400c6d10 2023-11-15T02:56:15.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.482+0000 7ff53cff9700 1 -- 172.21.15.1:0/495304313 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 106) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff5300077b0 con 0x7ff5400c6d10 2023-11-15T02:56:15.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.483+0000 7ff53cff9700 1 --2- 172.21.15.1:0/495304313 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff52005f270 0x7ff520061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-15T02:56:15.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.483+0000 7ff53cff9700 1 -- 172.21.15.1:0/495304313 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6380+0+0 (secure 0 0 0) 0x7ff53007a6f0 con 0x7ff5400c6d10 2023-11-15T02:56:15.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.483+0000 7ff544dbf700 1 --2- 172.21.15.1:0/495304313 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff52005f270 0x7ff520061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-15T02:56:15.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.484+0000 7ff544dbf700 1 --2- 172.21.15.1:0/495304313 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff52005f270 0x7ff520061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff538009270 tx=0x7ff538009060).ready entity=mgr.9370 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-15T02:56:15.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.487+0000 7ff53cff9700 1 -- 172.21.15.1:0/495304313 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff5400bf330 con 0x7ff5400c6d10 2023-11-15T02:56:15.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.699+0000 7ff547023700 1 -- 172.21.15.1:0/495304313 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff54006c7e0 con 0x7ff5400c6d10 2023-11-15T02:56:15.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.699+0000 7ff53cff9700 1 -- 172.21.15.1:0/495304313 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+3532 (secure 0 0 0) 0x7ff53004b740 con 0x7ff5400c6d10 2023-11-15T02:56:15.702 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-11-15T02:56:15.702 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":97,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6837/2155613527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6835","nonce":2155613527},{"type":"v1","addr":"172.21.15.141:6837","nonce":2155613527}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":10101,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/2281092627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2281092627},{"type":"v1","addr":"172.21.15.1:6833","nonce":2281092627}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":10104,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3718177238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3718177238},{"type":"v1","addr":"172.21.15.1:6835","nonce":3718177238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":10113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6836/3331826313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6834","nonce":3331826313},{"type":"v1","addr":"172.21.15.141:6836","nonce":3331826313}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90}],"filesystems":[]} 2023-11-15T02:56:15.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.701+0000 7ff547023700 1 -- 172.21.15.1:0/495304313 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff52005f270 msgr2=0x7ff520061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:15.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.701+0000 7ff547023700 1 --2- 172.21.15.1:0/495304313 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff52005f270 0x7ff520061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff538009270 tx=0x7ff538009060).stop 2023-11-15T02:56:15.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.701+0000 7ff547023700 1 -- 172.21.15.1:0/495304313 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5400c6d10 msgr2=0x7ff540134ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-15T02:56:15.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.701+0000 7ff547023700 1 --2- 172.21.15.1:0/495304313 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5400c6d10 0x7ff540134ae0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7ff53000cb60 tx=0x7ff530007bd0).stop 2023-11-15T02:56:15.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.701+0000 7ff547023700 1 -- 172.21.15.1:0/495304313 shutdown_connections 2023-11-15T02:56:15.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.701+0000 7ff547023700 1 --2- 172.21.15.1:0/495304313 >> [v2:172.21.15.141:6832/103755,v1:172.21.15.141:6833/103755] conn(0x7ff52005f270 0x7ff520061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.701+0000 7ff547023700 1 --2- 172.21.15.1:0/495304313 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff540154e70 0x7ff540149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.701+0000 7ff547023700 1 --2- 172.21.15.1:0/495304313 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5400bdfb0 0x7ff5400c17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.701+0000 7ff547023700 1 --2- 172.21.15.1:0/495304313 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5400c6d10 0x7ff540134ae0 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-15T02:56:15.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.701+0000 7ff547023700 1 -- 172.21.15.1:0/495304313 >> 172.21.15.1:0/495304313 conn(0x7ff5400c7d70 msgr2=0x7ff5400c3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-15T02:56:15.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.701+0000 7ff547023700 1 -- 172.21.15.1:0/495304313 shutdown_connections 2023-11-15T02:56:15.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-11-15T02:56:15.701+0000 7ff547023700 1 -- 172.21.15.1:0/495304313 wait complete. 2023-11-15T02:56:15.706 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 97 2023-11-15T02:56:15.715 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-15T02:56:15.715 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-15T02:56:15.716 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-15T02:56:15.716 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:15.724 INFO:tasks.ceph.mds.a:Stopped 2023-11-15T02:56:15.724 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-15T02:56:15.725 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:15.772 INFO:tasks.ceph.mds.c:Stopped 2023-11-15T02:56:15.773 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-15T02:56:15.773 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:15.784 INFO:tasks.ceph.mds.b:Stopped 2023-11-15T02:56:15.784 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-15T02:56:15.785 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:15.835 INFO:tasks.ceph.mds.d:Stopped 2023-11-15T02:56:15.835 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-15T02:56:15.835 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-15T02:56:15.836 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:15.872 INFO:tasks.ceph.osd.0:Stopped 2023-11-15T02:56:15.873 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-15T02:56:15.873 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:15.946 INFO:tasks.ceph.osd.1:Stopped 2023-11-15T02:56:15.946 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-15T02:56:15.947 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:16.012 INFO:tasks.ceph.osd.2:Stopped 2023-11-15T02:56:16.012 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-15T02:56:16.013 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:16.086 INFO:tasks.ceph.osd.3:Stopped 2023-11-15T02:56:16.087 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-15T02:56:16.087 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:16.121 INFO:tasks.ceph.osd.4:Stopped 2023-11-15T02:56:16.121 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-15T02:56:16.121 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:16.196 INFO:tasks.ceph.osd.5:Stopped 2023-11-15T02:56:16.197 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-15T02:56:16.197 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:16.265 INFO:tasks.ceph.osd.6:Stopped 2023-11-15T02:56:16.266 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-15T02:56:16.266 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:16.338 INFO:tasks.ceph.osd.7:Stopped 2023-11-15T02:56:16.339 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-15T02:56:16.339 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-15T02:56:16.339 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:16.365 INFO:tasks.ceph.mgr.y:Stopped 2023-11-15T02:56:16.366 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-15T02:56:16.366 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:16.406 INFO:tasks.ceph.mgr.x:Stopped 2023-11-15T02:56:16.407 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-15T02:56:16.408 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-15T02:56:16.408 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:16.428 INFO:tasks.ceph.mon.a:Stopped 2023-11-15T02:56:16.428 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-15T02:56:16.429 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:16.464 INFO:tasks.ceph.mon.b:Stopped 2023-11-15T02:56:16.465 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-15T02:56:16.465 INFO:teuthology.orchestra.run:waiting for 300 2023-11-15T02:56:16.522 INFO:tasks.ceph.mon.c:Stopped 2023-11-15T02:56:16.522 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-15T02:56:16.523 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-15T02:56:16.553 INFO:teuthology.orchestra.run.smithi001.stdout:2023-11-15T01:23:37.765251+0000 mon.a (mon.0) 313 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-11-15T02:56:16.554 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-11-15T02:56:16.554 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-15T02:56:16.623 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-15T02:56:16.694 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-15T02:56:16.764 INFO:teuthology.orchestra.run.smithi001.stdout:2023-11-15T01:23:37.765251+0000 mon.a (mon.0) 313 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-11-15T02:56:16.765 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T02:56:16.765 DEBUG:teuthology.orchestra.run.smithi001:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-15T02:56:17.024 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T02:56:17.025 DEBUG:teuthology.orchestra.run.smithi001:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-15T02:56:17.112 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T02:56:17.112 DEBUG:teuthology.orchestra.run.smithi001:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-15T02:56:17.174 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T02:56:17.175 DEBUG:teuthology.orchestra.run.smithi001:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-15T02:56:17.237 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-15T02:56:17.238 DEBUG:teuthology.orchestra.run.smithi141:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-15T02:56:17.403 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-15T02:56:17.403 DEBUG:teuthology.orchestra.run.smithi141:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-15T02:56:17.527 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-15T02:56:17.527 DEBUG:teuthology.orchestra.run.smithi141:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-15T02:56:17.592 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-15T02:56:17.593 DEBUG:teuthology.orchestra.run.smithi141:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-15T02:56:17.652 INFO:tasks.ceph:Archiving mon data... 2023-11-15T02:56:17.654 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075/data/mon.a.tgz 2023-11-15T02:56:17.655 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2023-11-15T02:56:17.671 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.nkr7tbnxkj 2023-11-15T02:56:17.671 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nkr7tbnxkj 2023-11-15T02:56:18.227 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.nkr7tbnxkj 2023-11-15T02:56:18.312 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.nkr7tbnxkj is 2MB 2023-11-15T02:56:18.444 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.nkr7tbnxkj 2023-11-15T02:56:18.462 DEBUG:teuthology.misc:Transferring archived files from smithi141:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075/data/mon.b.tgz 2023-11-15T02:56:18.462 DEBUG:teuthology.orchestra.run.smithi141:> mktemp 2023-11-15T02:56:18.478 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.MiEA4CB87W 2023-11-15T02:56:18.478 DEBUG:teuthology.orchestra.run.smithi141:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.MiEA4CB87W 2023-11-15T02:56:19.042 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.MiEA4CB87W 2023-11-15T02:56:19.124 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.MiEA4CB87W is 3MB 2023-11-15T02:56:19.270 DEBUG:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.MiEA4CB87W 2023-11-15T02:56:19.285 DEBUG:teuthology.misc:Transferring archived files from smithi141:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075/data/mon.c.tgz 2023-11-15T02:56:19.285 DEBUG:teuthology.orchestra.run.smithi141:> mktemp 2023-11-15T02:56:19.338 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.QBmKrXegVL 2023-11-15T02:56:19.339 DEBUG:teuthology.orchestra.run.smithi141:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.QBmKrXegVL 2023-11-15T02:56:19.879 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.QBmKrXegVL 2023-11-15T02:56:19.960 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.QBmKrXegVL is 3MB 2023-11-15T02:56:20.074 DEBUG:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.QBmKrXegVL 2023-11-15T02:56:20.089 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-15T02:56:20.090 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-15T02:56:20.092 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-15T02:56:20.154 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-15T02:56:20.154 DEBUG:teuthology.orchestra.run.smithi001:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-15T02:56:20.162 DEBUG:teuthology.orchestra.run.smithi141:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-15T02:56:20.190 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-15T02:56:20.218 INFO:teuthology.orchestra.run.smithi141.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-15T02:56:20.227 INFO:tasks.ceph:Archiving crash dumps... 2023-11-15T02:56:20.229 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075/remote/smithi001/crash 2023-11-15T02:56:20.230 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-15T02:56:20.266 DEBUG:teuthology.misc:Transferring archived files from smithi141:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075/remote/smithi141/crash 2023-11-15T02:56:20.267 DEBUG:teuthology.orchestra.run.smithi141:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-15T02:56:20.291 INFO:tasks.ceph:Shutting down logrotate 2023-11-15T02:56:20.291 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:56:20.311 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-15T02:56:20.384 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-15T02:56:20.411 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-15T02:56:20.435 INFO:tasks.ceph:Compressing logs... 2023-11-15T02:56:20.435 DEBUG:teuthology.orchestra.run.smithi001:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-15T02:56:20.454 DEBUG:teuthology.orchestra.run.smithi141:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-15T02:56:20.520 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90996.log 2023-11-15T02:56:20.521 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90780.log 2023-11-15T02:56:20.521 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.admin.90996.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-15T02:56:20.521 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.admin.90780.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.90996.log.gz 2023-11-15T02:56:20.521 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95140.log 2023-11-15T02:56:20.521 INFO:teuthology.orchestra.run.smithi141.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90780.log.gz 2023-11-15T02:56:20.522 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90911.log 2023-11-15T02:56:20.522 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.admin.95140.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-15T02:56:20.522 INFO:teuthology.orchestra.run.smithi141.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95140.log.gz 2023-11-15T02:56:20.522 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.admin.90911.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-15T02:56:20.522 INFO:teuthology.orchestra.run.smithi141.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90911.log.gz 2023-11-15T02:56:20.523 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90953.log 2023-11-15T02:56:20.523 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90738.log 2023-11-15T02:56:20.523 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.admin.90953.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-15T02:56:20.523 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.admin.90738.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90953.log.gz 2023-11-15T02:56:20.523 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-15T02:56:20.524 INFO:teuthology.orchestra.run.smithi141.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90738.log.gz 2023-11-15T02:56:20.524 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-15T02:56:20.524 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90862.log 2023-11-15T02:56:20.524 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.90862.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.90862.log.gz 2023-11-15T02:56:20.524 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95112.log 2023-11-15T02:56:20.525 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-15T02:56:20.525 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.1.95112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.95112.log.gz 2023-11-15T02:56:20.525 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90822.log 2023-11-15T02:56:20.525 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.admin.90822.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.90822.log.gz 2023-11-15T02:56:20.525 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-15T02:56:20.526 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-mds.b.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-15T02:56:20.526 INFO:teuthology.orchestra.run.smithi141.stderr: 94.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-15T02:56:20.526 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94698.log 2023-11-15T02:56:20.526 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-15T02:56:20.529 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.admin.94698.log: 88.0%/var/log/ceph/ceph-osd.6.log: -- replaced with /var/log/ceph/ceph-client.admin.94698.log.gz 2023-11-15T02:56:20.530 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-15T02:56:20.541 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.95498.log 2023-11-15T02:56:20.561 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.3.95498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.95498.log.gz 2023-11-15T02:56:20.562 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91037.log 2023-11-15T02:56:20.573 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.admin.91037.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91037.log.gz 2023-11-15T02:56:20.573 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-15T02:56:20.578 INFO:teuthology.orchestra.run.smithi141.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-15T02:56:20.659 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122778.log 2023-11-15T02:56:20.659 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107665.log 2023-11-15T02:56:20.659 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122600.log 2023-11-15T02:56:20.660 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122778.log: /var/log/ceph/ceph-client.admin.107665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113938.log 2023-11-15T02:56:20.660 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122778.log.gz 2023-11-15T02:56:20.660 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122600.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107665.log.gz 2023-11-15T02:56:20.660 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129786.log 2023-11-15T02:56:20.661 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113938.log: 88.6%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.122600.log.gz-- 2023-11-15T02:56:20.661 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.103307.log 2023-11-15T02:56:20.661 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129786.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113938.log.gz 2023-11-15T02:56:20.661 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142217.log 2023-11-15T02:56:20.661 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.103307.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.129786.log.gz 2023-11-15T02:56:20.662 INFO:teuthology.orchestra.run.smithi001.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.123424.log 2023-11-15T02:56:20.662 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103307.log.gz 2023-11-15T02:56:20.662 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141993.log 2023-11-15T02:56:20.662 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143265.log 2023-11-15T02:56:20.662 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142217.log.gz 2023-11-15T02:56:20.663 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.141993.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123424.log.gz 2023-11-15T02:56:20.663 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122950.log 2023-11-15T02:56:20.663 INFO:teuthology.orchestra.run.smithi001.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.141993.log.gz 2023-11-15T02:56:20.663 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143559.log 2023-11-15T02:56:20.663 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96645.log 2023-11-15T02:56:20.664 INFO:teuthology.orchestra.run.smithi001.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.143265.log.gz 2023-11-15T02:56:20.664 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114374.log 2023-11-15T02:56:20.664 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.122950.log.gz 2023-11-15T02:56:20.664 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120126.log 2023-11-15T02:56:20.664 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143559.log.gz 2023-11-15T02:56:20.665 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114374.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96645.log.gz 2023-11-15T02:56:20.665 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118874.log 2023-11-15T02:56:20.665 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114374.log.gz 2023-11-15T02:56:20.665 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121082.log 2023-11-15T02:56:20.665 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.118874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124343.log 2023-11-15T02:56:20.666 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120126.log.gz 2023-11-15T02:56:20.666 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.121082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111994.log 2023-11-15T02:56:20.666 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118874.log.gz 2023-11-15T02:56:20.666 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121082.log.gz 2023-11-15T02:56:20.666 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.124343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100292.log 2023-11-15T02:56:20.667 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111994.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124343.log.gz 2023-11-15T02:56:20.667 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119782.log 2023-11-15T02:56:20.667 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.100292.log: gzip 89.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.111994.log.gz-- 2023-11-15T02:56:20.667 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.103482.log 2023-11-15T02:56:20.667 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100292.log.gz 2023-11-15T02:56:20.668 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123833.log 2023-11-15T02:56:20.668 INFO:teuthology.orchestra.run.smithi001.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119782.log.gz 2023-11-15T02:56:20.668 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.103482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129478.log 2023-11-15T02:56:20.668 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140639.log 2023-11-15T02:56:20.668 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103482.log.gz 2023-11-15T02:56:20.669 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129478.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123833.log.gz 2023-11-15T02:56:20.669 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136977.log 2023-11-15T02:56:20.669 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2%/var/log/ceph/ceph-client.admin.140639.log: -- replaced with /var/log/ceph/ceph-client.admin.129478.log.gz 2023-11-15T02:56:20.669 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111372.log 2023-11-15T02:56:20.669 INFO:teuthology.orchestra.run.smithi001.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140639.log.gz 2023-11-15T02:56:20.670 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141684.log 2023-11-15T02:56:20.670 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111372.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136977.log.gz 2023-11-15T02:56:20.670 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103075.log 2023-11-15T02:56:20.670 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.111372.log.gz 2023-11-15T02:56:20.670 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.141684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122464.log 2023-11-15T02:56:20.671 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.103075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98441.log 2023-11-15T02:56:20.671 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141684.log.gz 2023-11-15T02:56:20.671 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102891.log 2023-11-15T02:56:20.671 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103075.log.gz 2023-11-15T02:56:20.671 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8%/var/log/ceph/ceph-client.admin.98441.log: -- replaced with /var/log/ceph/ceph-client.admin.122464.log.gz 2023-11-15T02:56:20.672 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.141215.log 2023-11-15T02:56:20.672 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.102891.log: 87.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.98441.log.gz--verbose 2023-11-15T02:56:20.672 INFO:teuthology.orchestra.run.smithi001.stderr:-- /var/log/ceph/ceph-client.admin.132633.log 2023-11-15T02:56:20.672 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.141215.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.102891.log.gz 2023-11-15T02:56:20.672 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117851.log 2023-11-15T02:56:20.673 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.141215.log.gz 2023-11-15T02:56:20.673 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96435.log 2023-11-15T02:56:20.673 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.132633.log.gz 2023-11-15T02:56:20.673 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135892.log 2023-11-15T02:56:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96435.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117851.log.gz 2023-11-15T02:56:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110915.log 2023-11-15T02:56:20.674 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96435.log.gz 2023-11-15T02:56:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132767.log 2023-11-15T02:56:20.674 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.135892.log.gz 2023-11-15T02:56:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.110915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131684.log 2023-11-15T02:56:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122908.log 2023-11-15T02:56:20.675 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110915.log.gz 2023-11-15T02:56:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131684.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.132767.log.gz 2023-11-15T02:56:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140299.log 2023-11-15T02:56:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122908.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.131684.log.gz 2023-11-15T02:56:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122733.log 2023-11-15T02:56:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140299.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122908.log.gz 2023-11-15T02:56:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142436.log 2023-11-15T02:56:20.676 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140299.log.gz 2023-11-15T02:56:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114788.log 2023-11-15T02:56:20.677 INFO:teuthology.orchestra.run.smithi001.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.122733.log.gz 2023-11-15T02:56:20.677 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94682.log 2023-11-15T02:56:20.677 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114788.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.142436.log.gz 2023-11-15T02:56:20.677 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127522.log 2023-11-15T02:56:20.677 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114788.log.gz 2023-11-15T02:56:20.678 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.94682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100028.log 2023-11-15T02:56:20.678 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6%/var/log/ceph/ceph-client.admin.127522.log: -- replaced with /var/log/ceph/ceph-client.admin.94682.log.gz 2023-11-15T02:56:20.678 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97853.log 2023-11-15T02:56:20.678 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.100028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111503.log 2023-11-15T02:56:20.678 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127522.log.gz 2023-11-15T02:56:20.679 INFO:teuthology.orchestra.run.smithi001.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100028.log.gz 2023-11-15T02:56:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.97853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133273.log 2023-11-15T02:56:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111503.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97853.log.gz 2023-11-15T02:56:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131228.log 2023-11-15T02:56:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.133273.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111503.log.gz 2023-11-15T02:56:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141947.log 2023-11-15T02:56:20.680 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122277.log 2023-11-15T02:56:20.680 INFO:teuthology.orchestra.run.smithi001.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.133273.log.gz 2023-11-15T02:56:20.680 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.131228.log.gz 2023-11-15T02:56:20.680 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.141947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99776.log 2023-11-15T02:56:20.680 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122277.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.141947.log.gz 2023-11-15T02:56:20.681 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120296.log 2023-11-15T02:56:20.681 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7%/var/log/ceph/ceph-client.admin.99776.log: -- replaced with /var/log/ceph/ceph-client.admin.122277.log.gz 2023-11-15T02:56:20.681 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120338.log 2023-11-15T02:56:20.681 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113046.log 2023-11-15T02:56:20.681 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99776.log.gz 2023-11-15T02:56:20.682 INFO:teuthology.orchestra.run.smithi001.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120296.log.gz 2023-11-15T02:56:20.682 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136326.log 2023-11-15T02:56:20.682 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113046.log: gzip -5 88.5%--verbose -- /var/log/ceph/ceph-client.admin.96561.log -- replaced with /var/log/ceph/ceph-client.admin.120338.log.gz 2023-11-15T02:56:20.682 INFO:teuthology.orchestra.run.smithi001.stderr: 2023-11-15T02:56:20.682 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136326.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113046.log.gz 2023-11-15T02:56:20.683 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137061.log 2023-11-15T02:56:20.683 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136326.log.gz 2023-11-15T02:56:20.683 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103424.log 2023-11-15T02:56:20.683 INFO:teuthology.orchestra.run.smithi001.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96561.log.gz 2023-11-15T02:56:20.683 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.137061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114211.log 2023-11-15T02:56:20.683 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.103424.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.137061.log.gz-5 2023-11-15T02:56:20.684 INFO:teuthology.orchestra.run.smithi001.stderr:--verbose -- /var/log/ceph/ceph-client.admin.121351.log 2023-11-15T02:56:20.684 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103424.log.gz 2023-11-15T02:56:20.684 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100462.log 2023-11-15T02:56:20.684 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.121351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135523.log 2023-11-15T02:56:20.684 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114211.log.gz 2023-11-15T02:56:20.685 INFO:teuthology.orchestra.run.smithi001.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.121351.log.gz 2023-11-15T02:56:20.685 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.100462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96603.log 2023-11-15T02:56:20.685 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100462.log.gz 2023-11-15T02:56:20.685 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100720.log 2023-11-15T02:56:20.685 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96603.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.135523.log.gz 2023-11-15T02:56:20.686 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128691.log 2023-11-15T02:56:20.686 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.100720.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96603.log.gz 2023-11-15T02:56:20.686 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101586.log 2023-11-15T02:56:20.686 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100720.log.gz 2023-11-15T02:56:20.686 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.128691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120800.log 2023-11-15T02:56:20.687 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128691.log.gz 2023-11-15T02:56:20.687 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134348.log 2023-11-15T02:56:20.687 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101586.log: /var/log/ceph/ceph-client.admin.120800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133189.log 2023-11-15T02:56:20.687 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101586.log.gz 2023-11-15T02:56:20.687 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.134348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98694.log 2023-11-15T02:56:20.688 INFO:teuthology.orchestra.run.smithi001.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.134348.log.gz 2023-11-15T02:56:20.688 INFO:teuthology.orchestra.run.smithi001.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.120800.log.gz 2023-11-15T02:56:20.688 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.133189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123789.log 2023-11-15T02:56:20.688 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140723.log 2023-11-15T02:56:20.688 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.133189.log.gz 2023-11-15T02:56:20.689 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123789.log: gzip 87.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.98694.log.gz-- /var/log/ceph/ceph-client.admin.130262.log 2023-11-15T02:56:20.689 INFO:teuthology.orchestra.run.smithi001.stderr: 2023-11-15T02:56:20.689 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123789.log.gz 2023-11-15T02:56:20.689 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137620.log 2023-11-15T02:56:20.689 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130262.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140723.log.gz 2023-11-15T02:56:20.690 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139609.log 2023-11-15T02:56:20.690 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.137620.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-15T02:56:20.690 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130262.log.gz 2023-11-15T02:56:20.690 INFO:teuthology.orchestra.run.smithi001.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.137620.log.gz 2023-11-15T02:56:20.690 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140765.log 2023-11-15T02:56:20.691 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.139609.log.gz 2023-11-15T02:56:20.691 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108586.log 2023-11-15T02:56:20.691 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130220.log 2023-11-15T02:56:20.691 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.108586.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140765.log.gz 2023-11-15T02:56:20.691 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98950.log 2023-11-15T02:56:20.692 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130220.log: 87.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.108586.log.gz--verbose 2023-11-15T02:56:20.692 INFO:teuthology.orchestra.run.smithi001.stderr:-- /var/log/ceph/ceph-client.admin.117725.log 2023-11-15T02:56:20.692 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98950.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.130220.log.gz 2023-11-15T02:56:20.692 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129166.log 2023-11-15T02:56:20.692 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98950.log.gz/var/log/ceph/ceph-client.admin.117725.log: 2023-11-15T02:56:20.693 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108261.log 2023-11-15T02:56:20.693 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117725.log.gz 2023-11-15T02:56:20.693 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118830.log 2023-11-15T02:56:20.693 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.108261.log: gzip -5 87.8%--verbose -- /var/log/ceph/ceph-client.admin.136683.log -- replaced with /var/log/ceph/ceph-client.admin.129166.log.gz 2023-11-15T02:56:20.693 INFO:teuthology.orchestra.run.smithi001.stderr: 2023-11-15T02:56:20.693 INFO:teuthology.orchestra.run.smithi001.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108261.log.gz 2023-11-15T02:56:20.694 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.118830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107103.log 2023-11-15T02:56:20.694 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118830.log.gz 2023-11-15T02:56:20.694 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96141.log 2023-11-15T02:56:20.694 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114452.log 2023-11-15T02:56:20.694 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136683.log.gz 2023-11-15T02:56:20.695 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96141.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107103.log.gz 2023-11-15T02:56:20.695 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120082.log 2023-11-15T02:56:20.695 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96141.log.gz 2023-11-15T02:56:20.695 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120716.log 2023-11-15T02:56:20.695 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120082.log: gzip -5 88.3%--verbose -- /var/log/ceph/ceph-client.admin.142562.log -- replaced with /var/log/ceph/ceph-client.admin.114452.log.gz 2023-11-15T02:56:20.696 INFO:teuthology.orchestra.run.smithi001.stderr: 2023-11-15T02:56:20.696 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120082.log.gz 2023-11-15T02:56:20.696 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130472.log 2023-11-15T02:56:20.696 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120716.log.gz 2023-11-15T02:56:20.696 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117133.log 2023-11-15T02:56:20.697 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130472.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142562.log.gz 2023-11-15T02:56:20.697 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122509.log 2023-11-15T02:56:20.697 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113313.log 2023-11-15T02:56:20.697 INFO:teuthology.orchestra.run.smithi001.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.130472.log.gz 2023-11-15T02:56:20.697 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117133.log.gz 2023-11-15T02:56:20.698 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106770.log 2023-11-15T02:56:20.698 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98021.log 2023-11-15T02:56:20.698 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113313.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122509.log.gz 2023-11-15T02:56:20.698 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.106770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118579.log 2023-11-15T02:56:20.698 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113313.log.gz 2023-11-15T02:56:20.698 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98063.log 87.9% 2023-11-15T02:56:20.699 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.106770.log.gz 2023-11-15T02:56:20.699 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.118579.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.98021.log.gz 2023-11-15T02:56:20.699 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117091.log 2023-11-15T02:56:20.699 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118579.log.gz 2023-11-15T02:56:20.699 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.137469.log 2023-11-15T02:56:20.700 INFO:teuthology.orchestra.run.smithi001.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98063.log.gz 2023-11-15T02:56:20.700 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124043.log 2023-11-15T02:56:20.700 INFO:teuthology.orchestra.run.smithi001.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117091.log.gz 2023-11-15T02:56:20.700 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.137469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136767.log 2023-11-15T02:56:20.700 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.137469.log.gz 2023-11-15T02:56:20.701 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.124043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123034.log 2023-11-15T02:56:20.701 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129870.log 2023-11-15T02:56:20.701 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124043.log.gz 2023-11-15T02:56:20.701 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123034.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136767.log.gz 2023-11-15T02:56:20.701 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106358.log 2023-11-15T02:56:20.702 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99076.log 2023-11-15T02:56:20.702 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123034.log.gz 2023-11-15T02:56:20.702 INFO:teuthology.orchestra.run.smithi001.stderr: 89.2%/var/log/ceph/ceph-client.admin.106358.log: -- replaced with /var/log/ceph/ceph-client.admin.129870.log.gz 2023-11-15T02:56:20.702 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117259.log 2023-11-15T02:56:20.702 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106358.log.gz 2023-11-15T02:56:20.703 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100200.log 2023-11-15T02:56:20.703 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132503.log 2023-11-15T02:56:20.703 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99076.log.gz 2023-11-15T02:56:20.703 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5%/var/log/ceph/ceph-client.admin.100200.log: -- replaced with /var/log/ceph/ceph-client.admin.117259.log.gz 2023-11-15T02:56:20.703 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135702.log 2023-11-15T02:56:20.704 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132503.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100200.log.gz 2023-11-15T02:56:20.704 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95973.log 2023-11-15T02:56:20.704 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94894.log 2023-11-15T02:56:20.704 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132503.log.gz 2023-11-15T02:56:20.704 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8%/var/log/ceph/ceph-client.admin.95973.log: -- replaced with /var/log/ceph/ceph-client.admin.135702.log.gz 2023-11-15T02:56:20.705 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141551.log 2023-11-15T02:56:20.705 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95973.log.gz 2023-11-15T02:56:20.705 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.94894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113847.log 2023-11-15T02:56:20.705 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.141551.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94894.log.gz 2023-11-15T02:56:20.705 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107883.log 2023-11-15T02:56:20.706 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141551.log.gz 2023-11-15T02:56:20.706 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112248.log 2023-11-15T02:56:20.706 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113847.log.gz 2023-11-15T02:56:20.706 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107409.log 2023-11-15T02:56:20.706 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.112248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114169.log 2023-11-15T02:56:20.707 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107883.log.gz 2023-11-15T02:56:20.707 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107409.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112248.log.gz 2023-11-15T02:56:20.707 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113759.log 2023-11-15T02:56:20.707 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107409.log.gz 2023-11-15T02:56:20.707 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113713.log 2023-11-15T02:56:20.708 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112120.log 2023-11-15T02:56:20.708 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114169.log.gz 2023-11-15T02:56:20.708 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113759.log.gz 2023-11-15T02:56:20.708 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99902.log 2023-11-15T02:56:20.708 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113713.log.gz 2023-11-15T02:56:20.709 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.112120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117809.log 2023-11-15T02:56:20.709 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143307.log 2023-11-15T02:56:20.709 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112120.log.gz 2023-11-15T02:56:20.709 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99902.log.gz 2023-11-15T02:56:20.709 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133147.log 2023-11-15T02:56:20.710 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117809.log.gz 2023-11-15T02:56:20.710 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133231.log 2023-11-15T02:56:20.710 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.133147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143097.log 2023-11-15T02:56:20.710 INFO:teuthology.orchestra.run.smithi001.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.143307.log.gz 2023-11-15T02:56:20.710 INFO:teuthology.orchestra.run.smithi001.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.133147.log.gz 2023-11-15T02:56:20.711 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.133231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137554.log 2023-11-15T02:56:20.711 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.133231.log.gz 2023-11-15T02:56:20.711 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139950.log 2023-11-15T02:56:20.711 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.137554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131639.log 2023-11-15T02:56:20.711 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143097.log.gz 2023-11-15T02:56:20.712 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139950.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.137554.log.gz 2023-11-15T02:56:20.712 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98652.log 2023-11-15T02:56:20.712 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139950.log.gz 2023-11-15T02:56:20.712 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128743.log 2023-11-15T02:56:20.712 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114576.log 87.3% 2023-11-15T02:56:20.713 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.131639.log.gz 2023-11-15T02:56:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.128743.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98652.log.gz 2023-11-15T02:56:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95242.log 2023-11-15T02:56:20.713 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128743.log.gz 2023-11-15T02:56:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102765.log 2023-11-15T02:56:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95242.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.114576.log.gz 2023-11-15T02:56:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106269.log 2023-11-15T02:56:20.714 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95242.log.gz 2023-11-15T02:56:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.102765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103249.log 2023-11-15T02:56:20.714 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102765.log.gz 2023-11-15T02:56:20.715 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.106269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102681.log 2023-11-15T02:56:20.715 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.103249.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106269.log.gz 2023-11-15T02:56:20.715 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101644.log 2023-11-15T02:56:20.715 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5%/var/log/ceph/ceph-client.admin.102681.log: -- replaced with /var/log/ceph/ceph-client.admin.103249.log.gz 2023-11-15T02:56:20.716 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108303.log 2023-11-15T02:56:20.716 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102681.log.gz 2023-11-15T02:56:20.716 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117431.log 2023-11-15T02:56:20.716 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.108303.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101644.log.gz 2023-11-15T02:56:20.716 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115312.log 2023-11-15T02:56:20.717 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136202.log 2023-11-15T02:56:20.717 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% 90.8% -- replaced with /var/log/ceph/ceph-client.admin.108303.log.gz -- replaced with /var/log/ceph/ceph-client.admin.117431.log.gz 2023-11-15T02:56:20.717 INFO:teuthology.orchestra.run.smithi001.stderr: 2023-11-15T02:56:20.717 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111817.log 2023-11-15T02:56:20.717 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108093.log 2023-11-15T02:56:20.717 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111817.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.115312.log.gz 2023-11-15T02:56:20.718 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.136202.log.gz 2023-11-15T02:56:20.718 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96855.log 2023-11-15T02:56:20.718 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111817.log.gz 2023-11-15T02:56:20.718 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.108093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140597.log 2023-11-15T02:56:20.719 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108093.log.gz 2023-11-15T02:56:20.719 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132419.log 2023-11-15T02:56:20.719 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140597.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96855.log.gz 2023-11-15T02:56:20.719 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98736.log 2023-11-15T02:56:20.719 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.140597.log.gz 2023-11-15T02:56:20.719 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116407.log 2023-11-15T02:56:20.720 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.132419.log.gz 2023-11-15T02:56:20.720 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124085.log 2023-11-15T02:56:20.720 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116407.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98736.log.gz 2023-11-15T02:56:20.720 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.100912.log 2023-11-15T02:56:20.720 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.116407.log.gz 2023-11-15T02:56:20.721 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.124085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137277.log 2023-11-15T02:56:20.721 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124085.log.gz 2023-11-15T02:56:20.721 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.100912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140891.log 2023-11-15T02:56:20.721 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.100912.log.gz 2023-11-15T02:56:20.721 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.137277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119258.log 2023-11-15T02:56:20.722 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133021.log 2023-11-15T02:56:20.722 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137277.log.gz 2023-11-15T02:56:20.722 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119258.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.140891.log.gz 2023-11-15T02:56:20.722 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103890.log 2023-11-15T02:56:20.722 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.133021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139012.log 2023-11-15T02:56:20.723 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.119258.log.gz 2023-11-15T02:56:20.723 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.103890.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.133021.log.gz-5 2023-11-15T02:56:20.723 INFO:teuthology.orchestra.run.smithi001.stderr:--verbose -- /var/log/ceph/ceph-client.admin.128603.log 2023-11-15T02:56:20.723 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103890.log.gz 2023-11-15T02:56:20.723 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117935.log 2023-11-15T02:56:20.724 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.128603.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139012.log.gz 2023-11-15T02:56:20.724 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129103.log 2023-11-15T02:56:20.724 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128603.log.gz 2023-11-15T02:56:20.724 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133597.log 2023-11-15T02:56:20.724 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117935.log.gz 2023-11-15T02:56:20.725 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119914.log 2023-11-15T02:56:20.725 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.133597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116684.log 2023-11-15T02:56:20.725 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129103.log.gz 2023-11-15T02:56:20.725 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119914.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.133597.log.gz 2023-11-15T02:56:20.725 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119872.log 2023-11-15T02:56:20.726 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119914.log.gz 2023-11-15T02:56:20.726 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95368.log 2023-11-15T02:56:20.726 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119872.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116684.log.gz 2023-11-15T02:56:20.726 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123382.log 2023-11-15T02:56:20.726 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.119872.log.gz 2023-11-15T02:56:20.727 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106410.log 2023-11-15T02:56:20.727 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95368.log.gz 2023-11-15T02:56:20.727 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104390.log 2023-11-15T02:56:20.727 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.106410.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123382.log.gz 2023-11-15T02:56:20.727 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106635.log 2023-11-15T02:56:20.728 INFO:teuthology.orchestra.run.smithi001.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.106410.log.gz 2023-11-15T02:56:20.728 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.104390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142971.log 2023-11-15T02:56:20.728 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104390.log.gz 2023-11-15T02:56:20.728 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.106635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120674.log 2023-11-15T02:56:20.728 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142971.log: gzip 87.5%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.106635.log.gz-- 2023-11-15T02:56:20.729 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95889.log 2023-11-15T02:56:20.729 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120674.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142971.log.gz 2023-11-15T02:56:20.729 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95578.log 2023-11-15T02:56:20.729 INFO:teuthology.orchestra.run.smithi001.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.120674.log.gz 2023-11-15T02:56:20.729 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132175.log 2023-11-15T02:56:20.730 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95578.log: gzip -5 88.4%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.95889.log.gz/var/log/ceph/ceph-client.admin.117389.log 2023-11-15T02:56:20.730 INFO:teuthology.orchestra.run.smithi001.stderr: 2023-11-15T02:56:20.730 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132175.log: gzip -5 --verbose -- 88.6%/var/log/ceph/ceph-client.admin.114660.log 2023-11-15T02:56:20.730 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95578.log.gz 2023-11-15T02:56:20.730 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132175.log.gz 2023-11-15T02:56:20.731 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116040.log 2023-11-15T02:56:20.731 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129251.log 2023-11-15T02:56:20.731 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117389.log.gz 2023-11-15T02:56:20.731 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114660.log.gz 2023-11-15T02:56:20.731 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115360.log 2023-11-15T02:56:20.731 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116040.log.gz 2023-11-15T02:56:20.732 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142352.log 2023-11-15T02:56:20.732 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.129251.log.gz 2023-11-15T02:56:20.732 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123705.log 2023-11-15T02:56:20.732 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122866.log 2023-11-15T02:56:20.733 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115360.log.gz 2023-11-15T02:56:20.733 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123705.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142352.log.gz 2023-11-15T02:56:20.733 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105394.log 2023-11-15T02:56:20.733 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123705.log.gz 2023-11-15T02:56:20.733 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130430.log 2023-11-15T02:56:20.734 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.105394.log: gzip -5 --verbose 87.5%-- /var/log/ceph/ceph-client.admin.131551.log 2023-11-15T02:56:20.734 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.122866.log.gz 2023-11-15T02:56:20.734 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111629.log 88.6% 2023-11-15T02:56:20.734 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105394.log.gz 2023-11-15T02:56:20.734 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7%/var/log/ceph/ceph-client.admin.131551.log: -- replaced with /var/log/ceph/ceph-client.admin.130430.log.gz 2023-11-15T02:56:20.735 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133321.log 2023-11-15T02:56:20.735 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99328.log 2023-11-15T02:56:20.735 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.131551.log.gz 2023-11-15T02:56:20.735 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.133321.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111629.log.gz 2023-11-15T02:56:20.735 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99944.log 2023-11-15T02:56:20.736 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.133321.log.gz 2023-11-15T02:56:20.736 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137229.log 2023-11-15T02:56:20.736 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94639.log 2023-11-15T02:56:20.736 INFO:teuthology.orchestra.run.smithi001.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.99328.log.gz 2023-11-15T02:56:20.736 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.137229.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99944.log.gz 2023-11-15T02:56:20.737 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136555.log 2023-11-15T02:56:20.737 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.94639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142887.log 2023-11-15T02:56:20.737 INFO:teuthology.orchestra.run.smithi001.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.137229.log.gz 2023-11-15T02:56:20.737 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94639.log.gz 2023-11-15T02:56:20.737 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94597.log 2023-11-15T02:56:20.737 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120548.log 2023-11-15T02:56:20.738 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142887.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.136555.log.gz 2023-11-15T02:56:20.738 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.94597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135808.log 2023-11-15T02:56:20.738 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142887.log.gz 2023-11-15T02:56:20.738 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94597.log.gz 2023-11-15T02:56:20.738 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117683.log 2023-11-15T02:56:20.739 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135808.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120548.log.gz 2023-11-15T02:56:20.739 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99986.log 2023-11-15T02:56:20.739 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117683.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135808.log.gz 2023-11-15T02:56:20.739 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119474.log 2023-11-15T02:56:20.739 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7%/var/log/ceph/ceph-client.admin.99986.log: -- replaced with /var/log/ceph/ceph-client.admin.117683.log.gz 2023-11-15T02:56:20.740 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106876.log 2023-11-15T02:56:20.740 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119474.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99986.log.gz 2023-11-15T02:56:20.740 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102807.log 2023-11-15T02:56:20.740 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.106876.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119474.log.gz 2023-11-15T02:56:20.740 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140215.log 2023-11-15T02:56:20.741 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106876.log.gz 2023-11-15T02:56:20.741 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.102807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112638.log 2023-11-15T02:56:20.741 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140215.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-15T02:56:20.741 INFO:teuthology.orchestra.run.smithi001.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.102807.log.gz 2023-11-15T02:56:20.741 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.112638.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140215.log.gz 2023-11-15T02:56:20.742 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107493.log 2023-11-15T02:56:20.742 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112638.log.gz 2023-11-15T02:56:20.742 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107621.log 2023-11-15T02:56:20.742 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129620.log 2023-11-15T02:56:20.742 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95494.log 2023-11-15T02:56:20.743 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107493.log.gz 2023-11-15T02:56:20.743 INFO:teuthology.orchestra.run.smithi001.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.107621.log.gz 2023-11-15T02:56:20.743 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114966.log 2023-11-15T02:56:20.743 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95494.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129620.log.gz 2023-11-15T02:56:20.743 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130304.log 2023-11-15T02:56:20.744 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95494.log.gz 2023-11-15T02:56:20.745 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124619.log 2023-11-15T02:56:20.745 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130178.log 2023-11-15T02:56:20.745 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130304.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.114966.log.gz 2023-11-15T02:56:20.746 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.124619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112204.log 2023-11-15T02:56:20.746 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.130304.log.gz 2023-11-15T02:56:20.746 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117599.log 2023-11-15T02:56:20.746 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130178.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124619.log.gz 2023-11-15T02:56:20.747 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.112204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91031.log 2023-11-15T02:56:20.747 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.130178.log.gz 2023-11-15T02:56:20.747 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133555.log 2023-11-15T02:56:20.747 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112204.log.gz 2023-11-15T02:56:20.747 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.117599.log.gz 2023-11-15T02:56:20.748 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.91031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132979.log 2023-11-15T02:56:20.748 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128968.log 2023-11-15T02:56:20.748 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91031.log.gz/var/log/ceph/ceph-client.admin.133555.log: 2023-11-15T02:56:20.748 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96897.log 2023-11-15T02:56:20.748 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.133555.log.gz 2023-11-15T02:56:20.749 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117347.log 2023-11-15T02:56:20.749 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.128968.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132979.log.gz 2023-11-15T02:56:20.749 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96897.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128968.log.gz 2023-11-15T02:56:20.749 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128924.log 2023-11-15T02:56:20.749 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120254.log 2023-11-15T02:56:20.750 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117347.log: /var/log/ceph/ceph-client.admin.128924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139824.log 2023-11-15T02:56:20.750 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117347.log.gz 2023-11-15T02:56:20.750 INFO:teuthology.orchestra.run.smithi001.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.96897.log.gz 2023-11-15T02:56:20.750 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120254.log: gzip -5 --verbose 87.5%-- /var/log/ceph/ceph-client.admin.119516.log 2023-11-15T02:56:20.750 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.128924.log.gz 2023-11-15T02:56:20.751 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.120254.log.gz--verbose 2023-11-15T02:56:20.751 INFO:teuthology.orchestra.run.smithi001.stderr:-- /var/log/ceph/ceph-client.admin.94808.log 2023-11-15T02:56:20.751 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139824.log: /var/log/ceph/ceph-client.admin.119516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132070.log 2023-11-15T02:56:20.751 INFO:teuthology.orchestra.run.smithi001.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139824.log.gz 2023-11-15T02:56:20.751 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119516.log.gz 2023-11-15T02:56:20.752 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.94808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99734.log 2023-11-15T02:56:20.752 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111147.log 2023-11-15T02:56:20.752 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132070.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94808.log.gz 2023-11-15T02:56:20.752 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115228.log 2023-11-15T02:56:20.752 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132070.log.gz 2023-11-15T02:56:20.753 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99734.log.gz 2023-11-15T02:56:20.753 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99118.log 2023-11-15T02:56:20.753 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111147.log: 89.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-15T02:56:20.753 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99860.log 2023-11-15T02:56:20.753 INFO:teuthology.orchestra.run.smithi001.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.111147.log.gz 2023-11-15T02:56:20.753 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99118.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115228.log.gz 2023-11-15T02:56:20.754 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96267.log 2023-11-15T02:56:20.754 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99860.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99118.log.gzgzip 2023-11-15T02:56:20.754 INFO:teuthology.orchestra.run.smithi001.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.136599.log 2023-11-15T02:56:20.754 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99860.log.gz 2023-11-15T02:56:20.755 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95410.log 2023-11-15T02:56:20.755 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5%/var/log/ceph/ceph-client.admin.136599.log: -- replaced with /var/log/ceph/ceph-client.admin.96267.log.gz 2023-11-15T02:56:20.755 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141365.log 2023-11-15T02:56:20.755 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99160.log 88.1% 2023-11-15T02:56:20.755 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.136599.log.gz 2023-11-15T02:56:20.756 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95410.log.gz 2023-11-15T02:56:20.756 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.141365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124253.log 2023-11-15T02:56:20.756 INFO:teuthology.orchestra.run.smithi001.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.141365.log.gz 2023-11-15T02:56:20.756 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115060.log 2023-11-15T02:56:20.756 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.124253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136641.log 2023-11-15T02:56:20.756 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99160.log.gz 2023-11-15T02:56:20.757 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124253.log.gz 2023-11-15T02:56:20.757 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115102.log 2023-11-15T02:56:20.757 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115060.log.gz 2023-11-15T02:56:20.757 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140681.log 2023-11-15T02:56:20.757 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114534.log 2023-11-15T02:56:20.758 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136641.log.gz 2023-11-15T02:56:20.758 INFO:teuthology.orchestra.run.smithi001.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115102.log.gz 2023-11-15T02:56:20.758 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116274.log 2023-11-15T02:56:20.758 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140681.log.gz 2023-11-15T02:56:20.758 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131729.log 2023-11-15T02:56:20.759 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116274.log: gzip 88.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.114534.log.gz--verbose 2023-11-15T02:56:20.759 INFO:teuthology.orchestra.run.smithi001.stderr:-- /var/log/ceph/ceph-client.admin.107207.log 2023-11-15T02:56:20.759 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116274.log.gz 2023-11-15T02:56:20.759 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119125.log 2023-11-15T02:56:20.759 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131729.log.gz 2023-11-15T02:56:20.760 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130050.log 2023-11-15T02:56:20.760 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111461.log 2023-11-15T02:56:20.760 INFO:teuthology.orchestra.run.smithi001.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107207.log.gz 2023-11-15T02:56:20.760 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119125.log.gz 2023-11-15T02:56:20.760 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140975.log 2023-11-15T02:56:20.761 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.130050.log.gz 2023-11-15T02:56:20.761 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141593.log 2023-11-15T02:56:20.761 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116967.log 2023-11-15T02:56:20.761 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111461.log.gz 2023-11-15T02:56:20.761 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.141593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101238.log 2023-11-15T02:56:20.762 INFO:teuthology.orchestra.run.smithi001.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.140975.log.gz 2023-11-15T02:56:20.762 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98315.log 2023-11-15T02:56:20.762 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.141593.log.gz 2023-11-15T02:56:20.762 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116967.log.gz 2023-11-15T02:56:20.763 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142761.log 2023-11-15T02:56:20.763 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101238.log: /var/log/ceph/ceph-client.admin.98315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.97811.log 2023-11-15T02:56:20.763 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101238.log.gz 2023-11-15T02:56:20.763 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98315.log.gz 2023-11-15T02:56:20.763 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116642.log 2023-11-15T02:56:20.764 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.2.97811.log: gzip -5 --verbose 88.7%-- /var/log/ceph/ceph-client.admin.120632.log -- replaced with /var/log/ceph/ceph-client.admin.142761.log.gz 2023-11-15T02:56:20.764 INFO:teuthology.orchestra.run.smithi001.stderr: 2023-11-15T02:56:20.764 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.97811.log.gz 2023-11-15T02:56:20.764 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99818.log 2023-11-15T02:56:20.764 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116642.log.gz 2023-11-15T02:56:20.765 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96477.log 2023-11-15T02:56:20.765 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120632.log.gz 2023-11-15T02:56:20.765 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142262.log 2023-11-15T02:56:20.765 INFO:teuthology.orchestra.run.smithi001.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99818.log.gz 2023-11-15T02:56:20.765 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139180.log 2023-11-15T02:56:20.765 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115996.log 2023-11-15T02:56:20.766 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96477.log.gz 2023-11-15T02:56:20.766 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139180.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142262.log.gz 2023-11-15T02:56:20.766 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136725.log 2023-11-15T02:56:20.766 INFO:teuthology.orchestra.run.smithi001.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.139180.log.gz 2023-11-15T02:56:20.766 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111238.log 2023-11-15T02:56:20.767 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135976.log 2023-11-15T02:56:20.767 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.115996.log.gz 2023-11-15T02:56:20.767 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111238.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.136725.log.gz 2023-11-15T02:56:20.767 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136893.log 2023-11-15T02:56:20.767 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111238.log.gz 2023-11-15T02:56:20.768 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112722.log 2023-11-15T02:56:20.768 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136893.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.135976.log.gz 2023-11-15T02:56:20.768 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101954.log 2023-11-15T02:56:20.768 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.112722.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136893.log.gz 2023-11-15T02:56:20.768 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113892.log 2023-11-15T02:56:20.769 INFO:teuthology.orchestra.run.smithi001.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.112722.log.gz 2023-11-15T02:56:20.769 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117049.log 2023-11-15T02:56:20.769 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101954.log: /var/log/ceph/ceph-client.admin.113892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136851.log 2023-11-15T02:56:20.769 INFO:teuthology.orchestra.run.smithi001.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.101954.log.gz 2023-11-15T02:56:20.769 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2%/var/log/ceph/ceph-client.admin.117049.log: -- replaced with /var/log/ceph/ceph-client.admin.113892.log.gz 2023-11-15T02:56:20.770 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104893.log 2023-11-15T02:56:20.770 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117049.log.gz 2023-11-15T02:56:20.770 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139519.log 2023-11-15T02:56:20.770 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.104893.log: gzip 88.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.136851.log.gz--verbose 2023-11-15T02:56:20.770 INFO:teuthology.orchestra.run.smithi001.stderr:-- /var/log/ceph/ceph-client.admin.143601.log 2023-11-15T02:56:20.771 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139519.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.104893.log.gz 2023-11-15T02:56:20.771 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95200.log 2023-11-15T02:56:20.771 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139519.log.gz 2023-11-15T02:56:20.771 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132112.log 2023-11-15T02:56:20.771 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100672.log 2023-11-15T02:56:20.772 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143601.log.gz 2023-11-15T02:56:20.772 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132112.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95200.log.gz 2023-11-15T02:56:20.772 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107707.log 2023-11-15T02:56:20.772 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.132112.log.gz 2023-11-15T02:56:20.772 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.100672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133063.log 2023-11-15T02:56:20.773 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141509.log 2023-11-15T02:56:20.773 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.133063.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107707.log.gz 2023-11-15T02:56:20.773 INFO:teuthology.orchestra.run.smithi001.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.100672.log.gz 2023-11-15T02:56:20.773 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94555.log 2023-11-15T02:56:20.773 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.133063.log.gz 2023-11-15T02:56:20.774 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.141509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122688.log 2023-11-15T02:56:20.774 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141509.log.gz 2023-11-15T02:56:20.774 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.94555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133663.log 2023-11-15T02:56:20.774 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122688.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.94555.log.gz-5 2023-11-15T02:56:20.774 INFO:teuthology.orchestra.run.smithi001.stderr:--verbose -- /var/log/ceph/ceph-client.admin.137764.log 2023-11-15T02:56:20.775 INFO:teuthology.orchestra.run.smithi001.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122688.log.gz 2023-11-15T02:56:20.775 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.133663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116785.log 2023-11-15T02:56:20.775 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.133663.log.gz 2023-11-15T02:56:20.775 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.137764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99650.log 2023-11-15T02:56:20.775 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114127.log 2023-11-15T02:56:20.776 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137764.log.gz 2023-11-15T02:56:20.776 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116785.log.gz 2023-11-15T02:56:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143349.log 2023-11-15T02:56:20.776 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99650.log.gz 2023-11-15T02:56:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108009.log 2023-11-15T02:56:20.777 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131800.log 2023-11-15T02:56:20.777 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114127.log.gz 2023-11-15T02:56:20.777 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143349.log.gz 2023-11-15T02:56:20.777 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.108009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134749.log 2023-11-15T02:56:20.777 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108009.log.gz 2023-11-15T02:56:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111545.log 2023-11-15T02:56:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.134749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100546.log 2023-11-15T02:56:20.778 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.131800.log.gz 2023-11-15T02:56:20.778 INFO:teuthology.orchestra.run.smithi001.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.134749.log.gz 2023-11-15T02:56:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101140.log 2023-11-15T02:56:20.779 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111545.log.gz 2023-11-15T02:56:20.779 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.100546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114924.log 2023-11-15T02:56:20.779 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107577.log 2023-11-15T02:56:20.779 INFO:teuthology.orchestra.run.smithi001.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.100546.log.gz 2023-11-15T02:56:20.779 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114924.log: gzip 89.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.101140.log.gz 2023-11-15T02:56:20.779 INFO:teuthology.orchestra.run.smithi001.stderr:--verbose -- /var/log/ceph/ceph-client.admin.115594.log 2023-11-15T02:56:20.780 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114924.log.gz 2023-11-15T02:56:20.780 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133823.log 2023-11-15T02:56:20.780 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106680.log 2023-11-15T02:56:20.780 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107577.log.gz 2023-11-15T02:56:20.780 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115594.log.gz 2023-11-15T02:56:20.780 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.133823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123340.log 2023-11-15T02:56:20.781 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.133823.log.gz 2023-11-15T02:56:20.781 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.106680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98908.log 2023-11-15T02:56:20.781 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111587.log 2023-11-15T02:56:20.781 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106680.log.gz 2023-11-15T02:56:20.781 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123340.log.gz 2023-11-15T02:56:20.782 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127480.log 2023-11-15T02:56:20.782 INFO:teuthology.orchestra.run.smithi001.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98908.log.gz 2023-11-15T02:56:20.782 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111587.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-15T02:56:20.782 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.127480.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111587.log.gz 2023-11-15T02:56:20.783 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123747.log 2023-11-15T02:56:20.783 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph.audit.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127480.log.gz 2023-11-15T02:56:20.783 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136368.log 2023-11-15T02:56:20.783 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111056.log 2023-11-15T02:56:20.783 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136368.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123747.log.gz 2023-11-15T02:56:20.783 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119956.log 2023-11-15T02:56:20.784 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.136368.log.gz 2023-11-15T02:56:20.784 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96351.log 2023-11-15T02:56:20.784 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111056.log: /var/log/ceph/ceph-client.admin.119956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121251.log 2023-11-15T02:56:20.784 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111056.log.gz 2023-11-15T02:56:20.784 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119956.log.gz 2023-11-15T02:56:20.784 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120464.log 2023-11-15T02:56:20.785 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123258.log 2023-11-15T02:56:20.785 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.121251.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96351.log.gz 2023-11-15T02:56:20.785 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143672.log 2023-11-15T02:56:20.785 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121251.log.gz 2023-11-15T02:56:20.785 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120464.log.gz 2023-11-15T02:56:20.786 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108880.log 2023-11-15T02:56:20.786 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112470.log 2023-11-15T02:56:20.786 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123258.log.gz 2023-11-15T02:56:20.786 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143672.log.gz 2023-11-15T02:56:20.786 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.108880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121124.log 2023-11-15T02:56:20.787 INFO:teuthology.orchestra.run.smithi001.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.108880.log.gz 2023-11-15T02:56:20.787 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.112470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116452.log 2023-11-15T02:56:20.787 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131049.log 2023-11-15T02:56:20.787 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3%/var/log/ceph/ceph-client.admin.121124.log: -- replaced with /var/log/ceph/ceph-client.admin.112470.log.gz 2023-11-15T02:56:20.787 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124295.log 2023-11-15T02:56:20.788 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.121124.log.gz 2023-11-15T02:56:20.788 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116452.log.gz 2023-11-15T02:56:20.788 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123508.log 2023-11-15T02:56:20.788 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131049.log: /var/log/ceph/ceph-client.admin.124295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96057.log 2023-11-15T02:56:20.788 INFO:teuthology.orchestra.run.smithi001.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.131049.log.gz 2023-11-15T02:56:20.788 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102080.log 2023-11-15T02:56:20.789 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123508.log.gz 2023-11-15T02:56:20.789 INFO:teuthology.orchestra.run.smithi001.stderr: 90.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-15T02:56:20.789 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142038.log 2023-11-15T02:56:20.789 INFO:teuthology.orchestra.run.smithi001.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.124295.log.gz 2023-11-15T02:56:20.789 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.102080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96183.log 2023-11-15T02:56:20.790 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96057.log.gz 2023-11-15T02:56:20.790 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142038.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102080.log.gz 2023-11-15T02:56:20.790 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130388.log 2023-11-15T02:56:20.790 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8%/var/log/ceph/ceph-client.admin.96183.log: -- replaced with /var/log/ceph/ceph-client.admin.142038.log.gz 2023-11-15T02:56:20.790 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95072.log 2023-11-15T02:56:20.791 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130388.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.96183.log.gz-5 2023-11-15T02:56:20.791 INFO:teuthology.orchestra.run.smithi001.stderr:--verbose -- /var/log/ceph/ceph-client.admin.143055.log 2023-11-15T02:56:20.791 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5%/var/log/ceph/ceph-client.admin.95072.log: -- replaced with /var/log/ceph/ceph-client.admin.130388.log.gz 2023-11-15T02:56:20.791 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139782.log 2023-11-15T02:56:20.791 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143055.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95072.log.gz 2023-11-15T02:56:20.792 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113215.log 2023-11-15T02:56:20.792 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143055.log.gz 2023-11-15T02:56:20.792 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.108543.log 2023-11-15T02:56:20.792 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139782.log.gz 2023-11-15T02:56:20.792 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124001.log 2023-11-15T02:56:20.792 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.108543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100336.log 2023-11-15T02:56:20.793 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.108543.log.gz 2023-11-15T02:56:20.793 INFO:teuthology.orchestra.run.smithi001.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113215.log.gz 2023-11-15T02:56:20.793 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.124001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95284.log 2023-11-15T02:56:20.793 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1%/var/log/ceph/ceph-client.admin.100336.log: -- replaced with /var/log/ceph/ceph-client.admin.124001.log.gz 2023-11-15T02:56:20.793 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97937.log 2023-11-15T02:56:20.794 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.100336.log.gz 2023-11-15T02:56:20.794 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106501.log 2023-11-15T02:56:20.794 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.97937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135342.log 2023-11-15T02:56:20.794 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95284.log.gz 2023-11-15T02:56:20.794 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97937.log.gz 2023-11-15T02:56:20.795 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.106501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140555.log 2023-11-15T02:56:20.795 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106501.log.gz 2023-11-15T02:56:20.795 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128479.log 2023-11-15T02:56:20.795 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140555.log: gzip -5 --verbose 87.1%-- /var/log/ceph/ceph-client.admin.103640.log -- replaced with /var/log/ceph/ceph-client.admin.135342.log.gz 2023-11-15T02:56:20.795 INFO:teuthology.orchestra.run.smithi001.stderr: 2023-11-15T02:56:20.796 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.128479.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140555.log.gz 2023-11-15T02:56:20.796 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122418.log 2023-11-15T02:56:20.796 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.128479.log.gz 2023-11-15T02:56:20.796 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.103640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113668.log 2023-11-15T02:56:20.796 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122418.log: gzip -5 88.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.103640.log.gz/var/log/ceph/ceph-client.admin.94724.log 2023-11-15T02:56:20.797 INFO:teuthology.orchestra.run.smithi001.stderr: 2023-11-15T02:56:20.797 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113668.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122418.log.gz 2023-11-15T02:56:20.797 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143139.log 2023-11-15T02:56:20.797 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113668.log.gz 2023-11-15T02:56:20.797 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.94724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95662.log 2023-11-15T02:56:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143139.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.94724.log.gz 2023-11-15T02:56:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129013.log 2023-11-15T02:56:20.798 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.143139.log.gz 2023-11-15T02:56:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120758.log 2023-11-15T02:56:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119558.log 2023-11-15T02:56:20.799 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95662.log.gz 2023-11-15T02:56:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120758.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129013.log.gz 2023-11-15T02:56:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114001.log 2023-11-15T02:56:20.799 INFO:teuthology.orchestra.run.smithi001.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120758.log.gz 2023-11-15T02:56:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114085.log 2023-11-15T02:56:20.799 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119558.log.gz 2023-11-15T02:56:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105647.log 2023-11-15T02:56:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114085.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.114001.log.gz 2023-11-15T02:56:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112426.log 2023-11-15T02:56:20.800 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114085.log.gz 2023-11-15T02:56:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.105647.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-15T02:56:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.112426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94988.log 2023-11-15T02:56:20.801 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105647.log.gz 2023-11-15T02:56:20.801 INFO:teuthology.orchestra.run.smithi001.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112426.log.gz 2023-11-15T02:56:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113525.log 2023-11-15T02:56:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.94988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132683.log 2023-11-15T02:56:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113525.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94988.log.gz 2023-11-15T02:56:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98273.log 2023-11-15T02:56:20.802 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113525.log.gz 2023-11-15T02:56:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140513.log 2023-11-15T02:56:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132683.log: /var/log/ceph/ceph-client.admin.98273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132811.log 2023-11-15T02:56:20.803 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.132683.log.gz 2023-11-15T02:56:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140513.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98273.log.gz 2023-11-15T02:56:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135567.log 2023-11-15T02:56:20.803 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140513.log.gz 2023-11-15T02:56:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116227.log 2023-11-15T02:56:20.804 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.132811.log.gz 2023-11-15T02:56:20.804 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96519.log 2023-11-15T02:56:20.804 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135567.log: /var/log/ceph/ceph-client.admin.116227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96687.log 2023-11-15T02:56:20.804 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135567.log.gz 2023-11-15T02:56:20.804 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116227.log.gz 2023-11-15T02:56:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118926.log 2023-11-15T02:56:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139740.log 2023-11-15T02:56:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96687.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96519.log.gz 2023-11-15T02:56:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.118926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140425.log 2023-11-15T02:56:20.805 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96687.log.gz 2023-11-15T02:56:20.806 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118926.log.gz 2023-11-15T02:56:20.806 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108694.log 2023-11-15T02:56:20.806 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139740.log: /var/log/ceph/ceph-client.admin.140425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108628.log 2023-11-15T02:56:20.806 INFO:teuthology.orchestra.run.smithi001.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139740.log.gz 2023-11-15T02:56:20.806 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.108694.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140425.log.gz 2023-11-15T02:56:20.807 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123959.log 2023-11-15T02:56:20.807 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108694.log.gz 2023-11-15T02:56:20.807 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.108628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118412.log 2023-11-15T02:56:20.807 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108628.log.gz 2023-11-15T02:56:20.807 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120506.log 2023-11-15T02:56:20.808 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.118412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102849.log 2023-11-15T02:56:20.808 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123959.log.gz 2023-11-15T02:56:20.808 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120506.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118412.log.gz 2023-11-15T02:56:20.808 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132725.log 2023-11-15T02:56:20.808 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134649.log 2023-11-15T02:56:20.809 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.102849.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120506.log.gz 2023-11-15T02:56:20.809 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137145.log 2023-11-15T02:56:20.809 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102849.log.gz 2023-11-15T02:56:20.809 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.132725.log.gz 2023-11-15T02:56:20.809 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105143.log 2023-11-15T02:56:20.810 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.134649.log: /var/log/ceph/ceph-client.admin.137145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118785.log 2023-11-15T02:56:20.810 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.134649.log.gz 2023-11-15T02:56:20.810 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.105143.log: gzip -5 --verbose -- 88.4%/var/log/ceph/ceph-client.admin.113088.log 2023-11-15T02:56:20.810 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.137145.log.gz 2023-11-15T02:56:20.810 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105143.log.gz 2023-11-15T02:56:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.118785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143223.log 2023-11-15T02:56:20.811 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118785.log.gz 2023-11-15T02:56:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112812.log 2023-11-15T02:56:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119061.log 2023-11-15T02:56:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143223.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113088.log.gz 2023-11-15T02:56:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.112812.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143223.log.gz 2023-11-15T02:56:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141257.log 2023-11-15T02:56:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130346.log 2023-11-15T02:56:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119061.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112812.log.gz 2023-11-15T02:56:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.141257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107145.log 2023-11-15T02:56:20.813 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.119061.log.gz 2023-11-15T02:56:20.813 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141257.log.gz 2023-11-15T02:56:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128789.log 2023-11-15T02:56:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130346.log: /var/log/ceph/ceph-client.admin.107145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111102.log 2023-11-15T02:56:20.813 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130346.log.gz 2023-11-15T02:56:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.128789.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.107145.log.gz 2023-11-15T02:56:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135201.log 2023-11-15T02:56:20.814 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128789.log.gz 2023-11-15T02:56:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108051.log 2023-11-15T02:56:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95704.log 2023-11-15T02:56:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135201.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.111102.log.gz 2023-11-15T02:56:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.108051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98526.log 2023-11-15T02:56:20.815 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.135201.log.gz 2023-11-15T02:56:20.815 INFO:teuthology.orchestra.run.smithi001.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.108051.log.gz 2023-11-15T02:56:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107367.log 2023-11-15T02:56:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95704.log: /var/log/ceph/ceph-client.admin.98526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106725.log 2023-11-15T02:56:20.816 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95704.log.gz 2023-11-15T02:56:20.816 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143433.log 2023-11-15T02:56:20.816 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98526.log.gz 2023-11-15T02:56:20.816 INFO:teuthology.orchestra.run.smithi001.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107367.log.gz 2023-11-15T02:56:20.816 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.106725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117641.log 2023-11-15T02:56:20.817 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106725.log.gz 2023-11-15T02:56:20.817 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98147.log 2023-11-15T02:56:20.817 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112292.log 2023-11-15T02:56:20.817 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117641.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143433.log.gz 2023-11-15T02:56:20.817 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98147.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117641.log.gz 2023-11-15T02:56:20.818 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135079.log 2023-11-15T02:56:20.818 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129058.log 2023-11-15T02:56:20.818 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.112292.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98147.log.gz 2023-11-15T02:56:20.818 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135079.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112292.log.gz 2023-11-15T02:56:20.818 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135612.log 2023-11-15T02:56:20.819 INFO:teuthology.orchestra.run.smithi001.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135079.log.gz 2023-11-15T02:56:20.819 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135433.log 2023-11-15T02:56:20.819 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129058.log: /var/log/ceph/ceph-client.admin.135612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137512.log 2023-11-15T02:56:20.819 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129058.log.gz 2023-11-15T02:56:20.819 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139698.log 2023-11-15T02:56:20.820 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135612.log.gz 2023-11-15T02:56:20.820 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135433.log.gz 2023-11-15T02:56:20.820 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.137512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129293.log 2023-11-15T02:56:20.820 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.137512.log.gz 2023-11-15T02:56:20.820 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101702.log 2023-11-15T02:56:20.821 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139698.log: /var/log/ceph/ceph-client.admin.129293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133105.log 2023-11-15T02:56:20.821 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.139698.log.gz 2023-11-15T02:56:20.821 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129293.log.gz 2023-11-15T02:56:20.821 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119642.log 2023-11-15T02:56:20.821 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141299.log 2023-11-15T02:56:20.822 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.133105.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101702.log.gz 2023-11-15T02:56:20.822 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132377.log 2023-11-15T02:56:20.822 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.133105.log.gz 2023-11-15T02:56:20.822 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.119642.log.gz 2023-11-15T02:56:20.822 INFO:teuthology.orchestra.run.smithi001.stderr:gzip /var/log/ceph/ceph-client.admin.141299.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96225.log 2023-11-15T02:56:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96771.log 2023-11-15T02:56:20.823 INFO:teuthology.orchestra.run.smithi001.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.141299.log.gz 2023-11-15T02:56:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112554.log 2023-11-15T02:56:20.823 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.132377.log.gz 2023-11-15T02:56:20.823 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96225.log.gz 2023-11-15T02:56:20.824 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104140.log 2023-11-15T02:56:20.824 INFO:teuthology.orchestra.run.smithi001.stderr:gzip 88.6%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.96771.log.gz-- 2023-11-15T02:56:20.824 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114043.log 2023-11-15T02:56:20.824 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.112554.log: /var/log/ceph/ceph-client.admin.104140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135388.log 2023-11-15T02:56:20.824 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112554.log.gz 2023-11-15T02:56:20.824 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114043.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104140.log.gz 2023-11-15T02:56:20.825 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97417.log 2023-11-15T02:56:20.825 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100954.log 2023-11-15T02:56:20.825 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135388.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114043.log.gz 2023-11-15T02:56:20.825 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.97417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.97417.log.gz 2023-11-15T02:56:20.825 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135656.log 2023-11-15T02:56:20.826 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135388.log.gz 2023-11-15T02:56:20.826 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111004.log 2023-11-15T02:56:20.826 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.100954.log: /var/log/ceph/ceph-client.admin.135656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99692.log 2023-11-15T02:56:20.826 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100954.log.gz 2023-11-15T02:56:20.826 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111004.log: gzip -5 --verbose -- 88.2%/var/log/ceph/ceph-client.admin.100504.log 2023-11-15T02:56:20.827 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.135656.log.gz 2023-11-15T02:56:20.827 INFO:teuthology.orchestra.run.smithi001.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111004.log.gz 2023-11-15T02:56:20.827 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142394.log 2023-11-15T02:56:20.827 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99692.log.gz 2023-11-15T02:56:20.827 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123655.log 2023-11-15T02:56:20.828 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.100504.log: /var/log/ceph/ceph-client.admin.142394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131843.log 2023-11-15T02:56:20.828 INFO:teuthology.orchestra.run.smithi001.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.100504.log.gz 2023-11-15T02:56:20.828 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123655.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142394.log.gz 2023-11-15T02:56:20.828 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99286.log 2023-11-15T02:56:20.828 INFO:teuthology.orchestra.run.smithi001.stderr:gzip /var/log/ceph/ceph-client.admin.131843.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.119432.log 2023-11-15T02:56:20.829 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123655.log.gz 2023-11-15T02:56:20.829 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99286.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.131843.log.gz 2023-11-15T02:56:20.829 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117175.log 2023-11-15T02:56:20.829 INFO:teuthology.orchestra.run.smithi001.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.99286.log.gz 2023-11-15T02:56:20.829 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100588.log 2023-11-15T02:56:20.829 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119432.log: /var/log/ceph/ceph-client.admin.117175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99473.log 2023-11-15T02:56:20.830 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.119432.log.gz 2023-11-15T02:56:20.830 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.100588.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117175.log.gz 2023-11-15T02:56:20.830 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139563.log 2023-11-15T02:56:20.830 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8%/var/log/ceph/ceph-client.admin.99473.log: -- replaced with /var/log/ceph/ceph-client.admin.100588.log.gz 2023-11-15T02:56:20.830 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117515.log 2023-11-15T02:56:20.831 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99473.log.gz 2023-11-15T02:56:20.831 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100156.log 2023-11-15T02:56:20.831 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139563.log: /var/log/ceph/ceph-client.admin.117515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140469.log 2023-11-15T02:56:20.831 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.139563.log.gz 2023-11-15T02:56:20.831 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117515.log.gz 2023-11-15T02:56:20.832 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.100156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107061.log 2023-11-15T02:56:20.832 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95788.log 2023-11-15T02:56:20.832 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140469.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.100156.log.gz 2023-11-15T02:56:20.832 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116138.log 2023-11-15T02:56:20.832 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140469.log.gz 2023-11-15T02:56:20.833 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107061.log.gz 2023-11-15T02:56:20.833 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116889.log 2023-11-15T02:56:20.833 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95788.log: /var/log/ceph/ceph-client.admin.116138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111895.log 2023-11-15T02:56:20.833 INFO:teuthology.orchestra.run.smithi001.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95788.log.gz 2023-11-15T02:56:20.833 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116889.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116138.log.gz 2023-11-15T02:56:20.834 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142129.log 2023-11-15T02:56:20.834 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116889.log.gz 2023-11-15T02:56:20.834 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112036.log 2023-11-15T02:56:20.834 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111895.log.gz 2023-11-15T02:56:20.834 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119168.log 2023-11-15T02:56:20.835 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142129.log: /var/log/ceph/ceph-client.admin.112036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98105.log 2023-11-15T02:56:20.835 INFO:teuthology.orchestra.run.smithi001.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.142129.log.gz 2023-11-15T02:56:20.835 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.112036.log.gz 2023-11-15T02:56:20.835 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123567.log 2023-11-15T02:56:20.835 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103191.log 2023-11-15T02:56:20.836 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98105.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119168.log.gz 2023-11-15T02:56:20.836 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99244.log 2023-11-15T02:56:20.836 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98105.log.gz 2023-11-15T02:56:20.836 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123567.log.gz 2023-11-15T02:56:20.836 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103191.log: /var/log/ceph/ceph-client.admin.114618.log 2023-11-15T02:56:20.837 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141895.log 2023-11-15T02:56:20.837 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103191.log.gz 2023-11-15T02:56:20.837 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114618.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99244.log.gz 2023-11-15T02:56:20.837 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132335.log 2023-11-15T02:56:20.837 INFO:teuthology.orchestra.run.smithi001.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114618.log.gz 2023-11-15T02:56:20.838 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.141895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131273.log 2023-11-15T02:56:20.838 INFO:teuthology.orchestra.run.smithi001.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141895.log.gz 2023-11-15T02:56:20.838 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116558.log 2023-11-15T02:56:20.838 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132335.log: /var/log/ceph/ceph-client.admin.131273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119017.log 2023-11-15T02:56:20.838 INFO:teuthology.orchestra.run.smithi001.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.132335.log.gz 2023-11-15T02:56:20.839 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.131273.log.gz 2023-11-15T02:56:20.839 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135290.log 2023-11-15T02:56:20.839 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129912.log 2023-11-15T02:56:20.839 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119017.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116558.log.gz 2023-11-15T02:56:20.839 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106833.log 2023-11-15T02:56:20.839 INFO:teuthology.orchestra.run.smithi001.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.119017.log.gz 2023-11-15T02:56:20.840 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.135290.log.gz 2023-11-15T02:56:20.840 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137103.log 2023-11-15T02:56:20.840 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129912.log: /var/log/ceph/ceph-client.admin.106833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128878.log 2023-11-15T02:56:20.840 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129912.log.gz 2023-11-15T02:56:20.840 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.137103.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106833.log.gz 2023-11-15T02:56:20.841 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120380.log 2023-11-15T02:56:20.841 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137103.log.gz 2023-11-15T02:56:20.841 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.128878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114832.log 2023-11-15T02:56:20.841 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107841.log 2023-11-15T02:56:20.841 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120380.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128878.log.gz 2023-11-15T02:56:20.842 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102639.log 2023-11-15T02:56:20.842 INFO:teuthology.orchestra.run.smithi001.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.120380.log.gz 2023-11-15T02:56:20.842 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114832.log.gz 2023-11-15T02:56:20.842 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99388.log 2023-11-15T02:56:20.842 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.102639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107535.log 2023-11-15T02:56:20.843 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107841.log.gz 2023-11-15T02:56:20.843 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99388.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102639.log.gz 2023-11-15T02:56:20.843 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142929.log 2023-11-15T02:56:20.843 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99388.log.gz 2023-11-15T02:56:20.843 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131106.log 2023-11-15T02:56:20.844 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95116.log 2023-11-15T02:56:20.844 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107535.log.gz 2023-11-15T02:56:20.844 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131106.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142929.log.gz 2023-11-15T02:56:20.844 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140383.log 2023-11-15T02:56:20.844 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.131106.log.gz 2023-11-15T02:56:20.845 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95116.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-15T02:56:20.845 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123611.log 2023-11-15T02:56:20.845 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95116.log.gz 2023-11-15T02:56:20.845 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-osd.3.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140383.log.gz 2023-11-15T02:56:20.845 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136452.log 2023-11-15T02:56:20.846 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95847.log 2023-11-15T02:56:20.846 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123611.log.gz 2023-11-15T02:56:20.846 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142307.log 2023-11-15T02:56:20.846 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117217.log 2023-11-15T02:56:20.846 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136452.log.gz 2023-11-15T02:56:20.847 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142307.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95847.log.gz 2023-11-15T02:56:20.847 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106977.log 2023-11-15T02:56:20.847 INFO:teuthology.orchestra.run.smithi001.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.142307.log.gz 2023-11-15T02:56:20.847 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117217.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-15T02:56:20.847 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101912.log 2023-11-15T02:56:20.848 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.106977.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117217.log.gz 2023-11-15T02:56:20.848 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94850.log 2023-11-15T02:56:20.848 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106977.log.gz 2023-11-15T02:56:20.848 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132253.log 2023-11-15T02:56:20.848 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.94850.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.101912.log.gz 2023-11-15T02:56:20.848 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124127.log 2023-11-15T02:56:20.849 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132253.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94850.log.gz 2023-11-15T02:56:20.849 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.132253.log.gz 2023-11-15T02:56:20.849 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.124127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119998.log 2023-11-15T02:56:20.849 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124127.log.gz 2023-11-15T02:56:20.849 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110960.log 2023-11-15T02:56:20.850 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129956.log 2023-11-15T02:56:20.850 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.110960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106591.log 2023-11-15T02:56:20.850 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.119998.log.gz 2023-11-15T02:56:20.850 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96309.log 2023-11-15T02:56:20.850 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110960.log.gz 2023-11-15T02:56:20.851 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.106591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107967.log 2023-11-15T02:56:20.851 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129956.log.gz 2023-11-15T02:56:20.851 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101296.log 2023-11-15T02:56:20.851 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106591.log.gz 2023-11-15T02:56:20.851 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.133513.log 2023-11-15T02:56:20.852 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96309.log.gz 2023-11-15T02:56:20.852 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107757.log 2023-11-15T02:56:20.852 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107967.log.gz 2023-11-15T02:56:20.852 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.133513.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101296.log.gz 2023-11-15T02:56:20.852 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.133513.log.gz 2023-11-15T02:56:20.853 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107757.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107757.log.gz 2023-11-15T02:56:20.853 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128834.log 2023-11-15T02:56:20.853 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130000.log 2023-11-15T02:56:20.853 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.128834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.124535.log 2023-11-15T02:56:20.853 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131594.log 2023-11-15T02:56:20.854 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.128834.log.gz 2023-11-15T02:56:20.854 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.124535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102038.log 2023-11-15T02:56:20.854 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130000.log.gz 2023-11-15T02:56:20.854 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.124535.log.gz 2023-11-15T02:56:20.854 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124211.log 2023-11-15T02:56:20.855 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.102038.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.131594.log.gz 2023-11-15T02:56:20.855 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.124211.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102038.log.gz 2023-11-15T02:56:20.855 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124211.log.gz 2023-11-15T02:56:20.855 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106314.log 2023-11-15T02:56:20.855 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136284.log 2023-11-15T02:56:20.856 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.106314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135477.log 2023-11-15T02:56:20.856 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95536.log 2023-11-15T02:56:20.856 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106314.log.gz 2023-11-15T02:56:20.856 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107019.log 2023-11-15T02:56:20.856 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.136284.log.gz 2023-11-15T02:56:20.856 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95536.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.135477.log.gz 2023-11-15T02:56:20.857 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107019.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95536.log.gz 2023-11-15T02:56:20.857 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95746.log 2023-11-15T02:56:20.857 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107019.log.gz 2023-11-15T02:56:20.857 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95158.log 2023-11-15T02:56:20.857 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98399.log 2023-11-15T02:56:20.858 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140133.log 2023-11-15T02:56:20.858 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95746.log.gz 2023-11-15T02:56:20.858 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112384.log 2023-11-15T02:56:20.858 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95158.log.gz 2023-11-15T02:56:20.858 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108755.log 2023-11-15T02:56:20.859 INFO:teuthology.orchestra.run.smithi001.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98399.log.gz 2023-11-15T02:56:20.859 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.112384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132545.log 88.7% 2023-11-15T02:56:20.859 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.140133.log.gz 2023-11-15T02:56:20.859 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.108755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102975.log 2023-11-15T02:56:20.859 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112384.log.gz 2023-11-15T02:56:20.860 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113802.log 2023-11-15T02:56:20.860 INFO:teuthology.orchestra.run.smithi001.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.108755.log.gz 2023-11-15T02:56:20.860 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.102975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95030.log 2023-11-15T02:56:20.860 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.132545.log.gz 2023-11-15T02:56:20.860 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94299.log 2023-11-15T02:56:20.860 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102975.log.gz 2023-11-15T02:56:20.861 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98866.log 2023-11-15T02:56:20.861 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113802.log.gz 2023-11-15T02:56:20.861 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.94299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122153.log 2023-11-15T02:56:20.861 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95030.log.gz 2023-11-15T02:56:20.861 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98866.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94299.log.gz 2023-11-15T02:56:20.862 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122153.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98866.log.gz 2023-11-15T02:56:20.862 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122153.log.gz 2023-11-15T02:56:20.862 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120848.log 2023-11-15T02:56:20.862 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117303.log 2023-11-15T02:56:20.863 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102933.log 2023-11-15T02:56:20.863 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130520.log 2023-11-15T02:56:20.863 INFO:teuthology.orchestra.run.smithi001.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120848.log.gz 2023-11-15T02:56:20.863 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.102933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120040.log 2023-11-15T02:56:20.863 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117303.log.gz 2023-11-15T02:56:20.863 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130520.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102933.log.gz 2023-11-15T02:56:20.864 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108838.log 2023-11-15T02:56:20.864 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.130520.log.gz 2023-11-15T02:56:20.864 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120040.log: /var/log/ceph/ceph-client.admin.108838.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.120040.log.gz 2023-11-15T02:56:20.864 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99568.log 2023-11-15T02:56:20.864 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108838.log.gz 2023-11-15T02:56:20.865 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140807.log 2023-11-15T02:56:20.865 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101828.log 2023-11-15T02:56:20.865 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140807.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-15T02:56:20.865 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.99568.log.gz 2023-11-15T02:56:20.866 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122643.log 2023-11-15T02:56:20.866 INFO:teuthology.orchestra.run.smithi001.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.140807.log.gz 2023-11-15T02:56:20.866 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mon.a.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101828.log.gz 2023-11-15T02:56:20.866 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122643.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122643.log.gz 2023-11-15T02:56:20.866 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122322.log 2023-11-15T02:56:20.867 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129542.log 2023-11-15T02:56:20.867 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103540.log 2023-11-15T02:56:20.867 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129542.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122322.log.gz 2023-11-15T02:56:20.867 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.103540.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.129542.log.gz 2023-11-15T02:56:20.867 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103540.log.gz 2023-11-15T02:56:20.868 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103598.log 2023-11-15T02:56:20.868 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130134.log 2023-11-15T02:56:20.868 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.103598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96099.log 2023-11-15T02:56:20.868 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130134.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103598.log.gz 2023-11-15T02:56:20.868 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96099.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.130134.log.gz 2023-11-15T02:56:20.868 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96099.log.gz 2023-11-15T02:56:20.869 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94354.log 2023-11-15T02:56:20.869 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117767.log 2023-11-15T02:56:20.869 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.94354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114702.log 2023-11-15T02:56:20.869 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117767.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94354.log.gz 2023-11-15T02:56:20.869 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114702.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117767.log.gz 2023-11-15T02:56:20.870 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114702.log.gz 2023-11-15T02:56:20.870 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95620.log 2023-11-15T02:56:20.870 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139992.log 2023-11-15T02:56:20.870 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136809.log 2023-11-15T02:56:20.870 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139992.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95620.log.gz 2023-11-15T02:56:20.871 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136809.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139992.log.gz 2023-11-15T02:56:20.871 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136809.log.gz 2023-11-15T02:56:20.871 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95326.log 2023-11-15T02:56:20.871 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120170.log 2023-11-15T02:56:20.871 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110792.log 2023-11-15T02:56:20.872 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120170.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95326.log.gz 2023-11-15T02:56:20.872 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.110792.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120170.log.gz 2023-11-15T02:56:20.872 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110792.log.gz 2023-11-15T02:56:20.872 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120590.log 2023-11-15T02:56:20.872 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99431.log 2023-11-15T02:56:20.873 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 /var/log/ceph/ceph-client.admin.120590.log: --verbose -- /var/log/ceph/ceph-client.admin.123076.log 2023-11-15T02:56:20.873 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99431.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.120590.log.gz 2023-11-15T02:56:20.873 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99431.log.gz 2023-11-15T02:56:20.873 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99202.log 2023-11-15T02:56:20.873 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123076.log.gz 2023-11-15T02:56:20.873 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113577.log 2023-11-15T02:56:20.874 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137019.log 2023-11-15T02:56:20.874 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113577.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99202.log.gz 2023-11-15T02:56:20.874 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.137019.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113577.log.gz 2023-11-15T02:56:20.874 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137019.log.gz 2023-11-15T02:56:20.874 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119304.log 2023-11-15T02:56:20.875 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142719.log 2023-11-15T02:56:20.875 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113004.log 2023-11-15T02:56:20.875 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142719.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.119304.log.gz 2023-11-15T02:56:20.875 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.113004.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.142719.log.gz 2023-11-15T02:56:20.875 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.113004.log.gz 2023-11-15T02:56:20.876 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118217.log 2023-11-15T02:56:20.876 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143754.log 2023-11-15T02:56:20.876 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.118217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124746.log 2023-11-15T02:56:20.876 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118217.log.gz 2023-11-15T02:56:20.876 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143013.log 2023-11-15T02:56:20.877 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.124746.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143754.log.gz 2023-11-15T02:56:20.877 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143013.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.124746.log.gz 2023-11-15T02:56:20.877 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.143013.log.gz 2023-11-15T02:56:20.877 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111671.log 2023-11-15T02:56:20.877 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130092.log 2023-11-15T02:56:20.877 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119390.log 2023-11-15T02:56:20.878 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130092.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111671.log.gz 2023-11-15T02:56:20.878 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119390.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.130092.log.gz 2023-11-15T02:56:20.878 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119390.log.gz 2023-11-15T02:56:20.878 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132937.log 2023-11-15T02:56:20.879 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101354.log 2023-11-15T02:56:20.879 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132937.log: /var/log/ceph/ceph-client.admin.101354.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.132937.log.gz 2023-11-15T02:56:20.879 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101354.log.gz 2023-11-15T02:56:20.879 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98484.log 2023-11-15T02:56:20.879 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102122.log 2023-11-15T02:56:20.879 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101528.log 2023-11-15T02:56:20.880 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.102122.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98484.log.gz 2023-11-15T02:56:20.880 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101528.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102122.log.gz 2023-11-15T02:56:20.880 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101528.log.gz 2023-11-15T02:56:20.880 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101870.log 2023-11-15T02:56:20.880 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116726.log 2023-11-15T02:56:20.881 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131415.log 2023-11-15T02:56:20.881 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116726.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101870.log.gz 2023-11-15T02:56:20.881 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131415.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116726.log.gz 2023-11-15T02:56:20.881 INFO:teuthology.orchestra.run.smithi001.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.131415.log.gz 2023-11-15T02:56:20.881 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142845.log 2023-11-15T02:56:20.882 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115829.log 2023-11-15T02:56:20.882 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.115552.log 2023-11-15T02:56:20.882 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115829.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142845.log.gz 2023-11-15T02:56:20.882 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.115552.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.115829.log.gz 2023-11-15T02:56:20.882 INFO:teuthology.orchestra.run.smithi001.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.115552.log.gz 2023-11-15T02:56:20.883 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117977.log 2023-11-15T02:56:20.883 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118621.log 2023-11-15T02:56:20.883 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97013.log 2023-11-15T02:56:20.883 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.118621.log: /var/log/ceph/ceph-client.admin.97013.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118621.log.gz 2023-11-15T02:56:20.883 INFO:teuthology.orchestra.run.smithi001.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.117977.log.gz 2023-11-15T02:56:20.884 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97013.log.gz 2023-11-15T02:56:20.884 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118663.log 2023-11-15T02:56:20.884 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102723.log 2023-11-15T02:56:20.884 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.118663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107799.log 2023-11-15T02:56:20.884 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.102723.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118663.log.gz 2023-11-15T02:56:20.885 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107799.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102723.log.gz 2023-11-15T02:56:20.885 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107799.log.gz 2023-11-15T02:56:20.885 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143517.log 2023-11-15T02:56:20.885 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101786.log 2023-11-15T02:56:20.885 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101744.log 2023-11-15T02:56:20.886 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101786.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143517.log.gz 2023-11-15T02:56:20.886 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101744.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.101786.log.gz 2023-11-15T02:56:20.886 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101744.log.gz 2023-11-15T02:56:20.886 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108219.log 2023-11-15T02:56:20.886 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143712.log 2023-11-15T02:56:20.887 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.108219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119348.log 2023-11-15T02:56:20.887 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143712.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108219.log.gz 2023-11-15T02:56:20.887 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119348.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143712.log.gz 2023-11-15T02:56:20.887 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119348.log.gz 2023-11-15T02:56:20.887 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138922.log 2023-11-15T02:56:20.887 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99034.log 2023-11-15T02:56:20.888 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.138922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135765.log 2023-11-15T02:56:20.888 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.99034.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.138922.log.gz 2023-11-15T02:56:20.888 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135765.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99034.log.gz 2023-11-15T02:56:20.888 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135765.log.gz 2023-11-15T02:56:20.888 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129828.log 2023-11-15T02:56:20.889 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100420.log 2023-11-15T02:56:20.890 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-mon.b.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-15T02:56:20.917 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90634.log 2023-11-15T02:56:20.917 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.100420.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.129828.log.gz 2023-11-15T02:56:20.918 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.90634.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100420.log.gz 2023-11-15T02:56:20.918 INFO:teuthology.orchestra.run.smithi001.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.90634.log.gz 2023-11-15T02:56:20.918 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142172.log 2023-11-15T02:56:20.918 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142803.log 2023-11-15T02:56:20.918 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123180.log 2023-11-15T02:56:20.919 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142803.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142172.log.gz 2023-11-15T02:56:20.919 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123180.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142803.log.gz 2023-11-15T02:56:20.919 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106147.log 2023-11-15T02:56:20.919 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123180.log.gz 2023-11-15T02:56:20.919 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135934.log 2023-11-15T02:56:20.920 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.106147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113623.log 2023-11-15T02:56:20.920 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135934.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106147.log.gz 2023-11-15T02:56:20.920 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113623.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.135934.log.gz 2023-11-15T02:56:20.920 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113623.log.gz 2023-11-15T02:56:20.920 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115010.log 2023-11-15T02:56:20.921 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108351.log 2023-11-15T02:56:20.921 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115186.log 2023-11-15T02:56:20.921 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.108351.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.115010.log.gz 2023-11-15T02:56:20.921 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115186.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108351.log.gz 2023-11-15T02:56:20.921 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115186.log.gz 2023-11-15T02:56:20.922 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100996.log 2023-11-15T02:56:20.922 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107285.log 2023-11-15T02:56:20.922 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.100996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116515.log 2023-11-15T02:56:20.922 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107285.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100996.log.gz 2023-11-15T02:56:20.922 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116515.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107285.log.gz 2023-11-15T02:56:20.923 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116515.log.gz 2023-11-15T02:56:20.923 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130924.log 2023-11-15T02:56:20.923 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140055.log 2023-11-15T02:56:20.923 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115144.log 2023-11-15T02:56:20.923 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140055.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.130924.log.gz 2023-11-15T02:56:20.924 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115144.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140055.log.gz 2023-11-15T02:56:20.924 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115144.log.gz 2023-11-15T02:56:20.924 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130863.log 2023-11-15T02:56:20.924 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107451.log 2023-11-15T02:56:20.925 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111326.log 2023-11-15T02:56:20.925 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107451.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.130863.log.gz 2023-11-15T02:56:20.925 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111326.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107451.log.gz 2023-11-15T02:56:20.925 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141851.log 2023-11-15T02:56:20.925 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111326.log.gz 2023-11-15T02:56:20.926 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139224.log 2023-11-15T02:56:20.926 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.141851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142478.log 2023-11-15T02:56:20.926 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139224.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141851.log.gz 2023-11-15T02:56:20.926 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142478.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139224.log.gz 2023-11-15T02:56:20.926 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142478.log.gz 2023-11-15T02:56:20.927 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142082.log 2023-11-15T02:56:20.927 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141426.log 2023-11-15T02:56:20.927 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94938.log 2023-11-15T02:56:20.927 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.141426.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.142082.log.gz 2023-11-15T02:56:20.927 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.94938.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141426.log.gz 2023-11-15T02:56:20.927 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94938.log.gz 2023-11-15T02:56:20.928 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139654.log 2023-11-15T02:56:20.928 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139135.log 2023-11-15T02:56:20.928 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103133.log 2023-11-15T02:56:20.928 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139135.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139654.log.gz 2023-11-15T02:56:20.928 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139135.log.gz 2023-11-15T02:56:20.929 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.103133.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103133.log.gz 2023-11-15T02:56:20.929 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141023.log 2023-11-15T02:56:20.929 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124685.log 2023-11-15T02:56:20.929 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.141023.log: /var/log/ceph/ceph-client.admin.124685.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.141023.log.gz 2023-11-15T02:56:20.929 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124685.log.gz 2023-11-15T02:56:20.930 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94396.log 2023-11-15T02:56:20.930 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120212.log 2023-11-15T02:56:20.930 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.94396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136935.log 2023-11-15T02:56:20.930 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120212.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94396.log.gz 2023-11-15T02:56:20.931 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136935.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120212.log.gz 2023-11-15T02:56:20.931 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.136935.log.gz 2023-11-15T02:56:20.931 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-15T02:56:20.931 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123875.log 2023-11-15T02:56:20.931 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100630.log 2023-11-15T02:56:20.932 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123875.log: /var/log/ceph/ceph-client.admin.100630.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123875.log.gz 2023-11-15T02:56:20.932 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100630.log.gz 2023-11-15T02:56:20.932 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106545.log 2023-11-15T02:56:20.932 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118972.log 2023-11-15T02:56:20.932 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.106545.log: /var/log/ceph/ceph-client.admin.118972.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106545.log.gz 2023-11-15T02:56:20.933 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118972.log.gz 2023-11-15T02:56:20.933 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131460.log 2023-11-15T02:56:20.933 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116317.log 2023-11-15T02:56:20.933 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131460.log: /var/log/ceph/ceph-client.admin.116317.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.131460.log.gz 2023-11-15T02:56:20.933 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116317.log.gz 2023-11-15T02:56:20.934 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116092.log 2023-11-15T02:56:20.934 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141806.log 2023-11-15T02:56:20.934 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116092.log: /var/log/ceph/ceph-client.admin.141806.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116092.log.gz 2023-11-15T02:56:20.934 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141806.log.gz 2023-11-15T02:56:20.934 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114253.log 2023-11-15T02:56:20.935 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112680.log 2023-11-15T02:56:20.935 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114253.log: /var/log/ceph/ceph-client.admin.112680.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114253.log.gz 2023-11-15T02:56:20.935 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112680.log.gz 2023-11-15T02:56:20.935 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142520.log 2023-11-15T02:56:20.935 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122824.log 2023-11-15T02:56:20.935 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.142520.log: /var/log/ceph/ceph-client.admin.122824.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142520.log.gz 2023-11-15T02:56:20.936 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122824.log.gz 2023-11-15T02:56:20.936 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113481.log 2023-11-15T02:56:20.936 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136511.log 2023-11-15T02:56:20.936 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113481.log: /var/log/ceph/ceph-client.admin.136511.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113481.log.gz 2023-11-15T02:56:20.936 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136511.log.gz 2023-11-15T02:56:20.937 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134707.log 2023-11-15T02:56:20.937 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98568.log 2023-11-15T02:56:20.937 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.134707.log: /var/log/ceph/ceph-client.admin.98568.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.134707.log.gz 2023-11-15T02:56:20.937 INFO:teuthology.orchestra.run.smithi001.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.98568.log.gz 2023-11-15T02:56:20.937 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120422.log 2023-11-15T02:56:20.938 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137187.log 2023-11-15T02:56:20.938 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.120422.log: /var/log/ceph/ceph-client.admin.137187.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120422.log.gz 2023-11-15T02:56:20.938 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137187.log.gz 2023-11-15T02:56:20.938 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121190.log 2023-11-15T02:56:20.938 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119704.log 2023-11-15T02:56:20.939 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.121190.log: /var/log/ceph/ceph-client.admin.119704.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121190.log.gz 2023-11-15T02:56:20.939 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119704.log.gz 2023-11-15T02:56:20.939 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104640.log 2023-11-15T02:56:20.939 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101412.log 2023-11-15T02:56:20.939 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.104640.log: /var/log/ceph/ceph-client.admin.101412.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104640.log.gz 2023-11-15T02:56:20.940 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101412.log.gz 2023-11-15T02:56:20.940 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96813.log 2023-11-15T02:56:20.940 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110686.log 2023-11-15T02:56:20.940 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96813.log: /var/log/ceph/ceph-client.admin.110686.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96813.log.gz 2023-11-15T02:56:20.940 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110686.log.gz 2023-11-15T02:56:20.941 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139475.log 2023-11-15T02:56:20.941 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96015.log 2023-11-15T02:56:20.941 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139475.log: /var/log/ceph/ceph-client.admin.96015.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.139475.log.gz 2023-11-15T02:56:20.941 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96015.log.gz 2023-11-15T02:56:20.941 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140933.log 2023-11-15T02:56:20.942 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130797.log 2023-11-15T02:56:20.942 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140933.log: /var/log/ceph/ceph-client.admin.130797.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.140933.log.gz 2023-11-15T02:56:20.942 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130797.log.gz 2023-11-15T02:56:20.942 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128647.log 2023-11-15T02:56:20.942 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114312.log 2023-11-15T02:56:20.943 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.128647.log: /var/log/ceph/ceph-client.admin.114312.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.128647.log.gz 2023-11-15T02:56:20.943 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114312.log.gz 2023-11-15T02:56:20.943 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132461.log 2023-11-15T02:56:20.943 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103365.log 2023-11-15T02:56:20.943 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132461.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132461.log.gz 2023-11-15T02:56:20.944 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112764.log 2023-11-15T02:56:20.944 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.103365.log: /var/log/ceph/ceph-client.admin.112764.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103365.log.gz 2023-11-15T02:56:20.944 INFO:teuthology.orchestra.run.smithi001.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.112764.log.gz 2023-11-15T02:56:20.944 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116362.log 2023-11-15T02:56:20.944 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112342.log 2023-11-15T02:56:20.945 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116362.log: /var/log/ceph/ceph-client.admin.112342.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116362.log.gz 2023-11-15T02:56:20.945 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112342.log.gz 2023-11-15T02:56:20.945 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124577.log 2023-11-15T02:56:20.945 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132589.log 2023-11-15T02:56:20.945 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.124577.log: /var/log/ceph/ceph-client.admin.132589.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.124577.log.gz 2023-11-15T02:56:20.946 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.132589.log.gz 2023-11-15T02:56:20.946 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95452.log 2023-11-15T02:56:20.946 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108177.log 2023-11-15T02:56:20.946 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95452.log: /var/log/ceph/ceph-client.admin.108177.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95452.log.gz 2023-11-15T02:56:20.946 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108177.log.gz 2023-11-15T02:56:20.947 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101470.log 2023-11-15T02:56:20.947 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100378.log 2023-11-15T02:56:20.949 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101470.log: /var/log/ceph/ceph-client.admin.100378.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101470.log.gz 2023-11-15T02:56:20.949 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.100378.log.gz 2023-11-15T02:56:20.950 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116827.log 2023-11-15T02:56:20.950 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129436.log 2023-11-15T02:56:20.950 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116827.log: /var/log/ceph/ceph-client.admin.129436.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116827.log.gz 2023-11-15T02:56:20.950 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.129436.log.gz 2023-11-15T02:56:20.950 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122553.log 2023-11-15T02:56:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137806.log 2023-11-15T02:56:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122553.log: /var/log/ceph/ceph-client.admin.137806.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122553.log.gz 2023-11-15T02:56:20.951 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137806.log.gz 2023-11-15T02:56:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124871.log 2023-11-15T02:56:20.951 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140341.log 2023-11-15T02:56:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.124871.log: /var/log/ceph/ceph-client.admin.140341.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124871.log.gz 2023-11-15T02:56:20.952 INFO:teuthology.orchestra.run.smithi001.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140341.log.gz 2023-11-15T02:56:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117473.log 2023-11-15T02:56:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132028.log 2023-11-15T02:56:20.952 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117473.log: /var/log/ceph/ceph-client.admin.132028.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117473.log.gz 2023-11-15T02:56:20.952 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.132028.log.gz 2023-11-15T02:56:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114744.log 2023-11-15T02:56:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122992.log 2023-11-15T02:56:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114744.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114744.log.gz 2023-11-15T02:56:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135246.log 2023-11-15T02:56:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122992.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122992.log.gz 2023-11-15T02:56:20.954 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135246.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.135246.log.gz 2023-11-15T02:56:20.954 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97445.log 2023-11-15T02:56:20.954 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140849.log 2023-11-15T02:56:20.954 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.97445.log: /var/log/ceph/ceph-client.admin.140849.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97445.log.gz 2023-11-15T02:56:20.954 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140849.log.gz 2023-11-15T02:56:20.955 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129209.log 2023-11-15T02:56:20.955 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111417.log 2023-11-15T02:56:20.955 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129209.log: /var/log/ceph/ceph-client.admin.111417.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129209.log.gz 2023-11-15T02:56:20.955 INFO:teuthology.orchestra.run.smithi001.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.111417.log.gz 2023-11-15T02:56:20.955 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.130712.log 2023-11-15T02:56:20.956 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103017.log 2023-11-15T02:56:20.956 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.130712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.130712.log.gz 2023-11-15T02:56:20.956 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.103017.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.103017.log.gz 2023-11-15T02:56:20.956 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136410.log 2023-11-15T02:56:20.956 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-15T02:56:20.957 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136410.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136410.log.gz 2023-11-15T02:56:20.957 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113154.log 2023-11-15T02:56:20.957 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113154.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.113154.log.gz 2023-11-15T02:56:20.957 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96393.log 2023-11-15T02:56:20.957 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96393.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96393.log.gz 2023-11-15T02:56:20.958 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.121040.log 2023-11-15T02:56:20.958 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.121040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.121040.log.gz 2023-11-15T02:56:20.958 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117557.log 2023-11-15T02:56:20.958 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117557.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117557.log.gz 2023-11-15T02:56:20.958 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133741.log 2023-11-15T02:56:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.133741.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.133741.log.gz 2023-11-15T02:56:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.84605.log 2023-11-15T02:56:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph.tmp-client.admin.84605.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.84605.log.gz 2023-11-15T02:56:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111192.log 2023-11-15T02:56:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111192.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111192.log.gz 2023-11-15T02:56:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98231.log 2023-11-15T02:56:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98231.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98231.log.gz 2023-11-15T02:56:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100070.log 2023-11-15T02:56:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.100070.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100070.log.gz 2023-11-15T02:56:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129744.log 2023-11-15T02:56:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129744.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.129744.log.gz 2023-11-15T02:56:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124829.log 2023-11-15T02:56:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.124829.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.124829.log.gz 2023-11-15T02:56:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107925.log 2023-11-15T02:56:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.107925.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.107925.log.gz 2023-11-15T02:56:20.962 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132895.log 2023-11-15T02:56:20.962 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132895.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.132895.log.gz 2023-11-15T02:56:20.962 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136124.log 2023-11-15T02:56:20.962 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136124.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136124.log.gz 2023-11-15T02:56:20.962 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131369.log 2023-11-15T02:56:20.963 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131369.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.131369.log.gz 2023-11-15T02:56:20.963 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98189.log 2023-11-15T02:56:20.963 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98189.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98189.log.gz 2023-11-15T02:56:20.963 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115747.log 2023-11-15T02:56:20.963 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115747.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115747.log.gz 2023-11-15T02:56:20.964 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134390.log 2023-11-15T02:56:20.964 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.134390.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.134390.log.gz 2023-11-15T02:56:20.964 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139866.log 2023-11-15T02:56:20.964 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139866.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139866.log.gz 2023-11-15T02:56:20.964 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119600.log 2023-11-15T02:56:20.965 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119600.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119600.log.gz 2023-11-15T02:56:20.965 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118495.log 2023-11-15T02:56:20.965 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.118495.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118495.log.gz 2023-11-15T02:56:20.965 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118259.log 2023-11-15T02:56:20.965 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.118259.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118259.log.gz 2023-11-15T02:56:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143475.log 2023-11-15T02:56:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143475.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143475.log.gz 2023-11-15T02:56:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123917.log 2023-11-15T02:56:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123917.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123917.log.gz 2023-11-15T02:56:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118301.log 2023-11-15T02:56:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.118301.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118301.log.gz 2023-11-15T02:56:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112162.log 2023-11-15T02:56:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.112162.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112162.log.gz 2023-11-15T02:56:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137681.log 2023-11-15T02:56:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.137681.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.137681.log.gz 2023-11-15T02:56:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139276.log 2023-11-15T02:56:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139276.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.139276.log.gz 2023-11-15T02:56:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136018.log 2023-11-15T02:56:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136018.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136018.log.gz 2023-11-15T02:56:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98610.log 2023-11-15T02:56:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98610.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.98610.log.gz 2023-11-15T02:56:20.969 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139430.log 2023-11-15T02:56:20.969 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139430.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139430.log.gz 2023-11-15T02:56:20.969 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100250.log 2023-11-15T02:56:20.969 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.100250.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100250.log.gz 2023-11-15T02:56:20.969 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119213.log 2023-11-15T02:56:20.970 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.119213.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119213.log.gz 2023-11-15T02:56:20.970 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139339.log 2023-11-15T02:56:20.970 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139339.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139339.log.gz 2023-11-15T02:56:20.970 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100112.log 2023-11-15T02:56:20.970 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.100112.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100112.log.gz 2023-11-15T02:56:20.971 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101062.log 2023-11-15T02:56:20.971 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101062.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101062.log.gz 2023-11-15T02:56:20.971 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130755.log 2023-11-15T02:56:20.971 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.130755.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130755.log.gz 2023-11-15T02:56:20.971 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116600.log 2023-11-15T02:56:20.972 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116600.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116600.log.gz 2023-11-15T02:56:20.972 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115951.log 2023-11-15T02:56:20.972 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115951.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115951.log.gz 2023-11-15T02:56:20.972 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90902.log 2023-11-15T02:56:20.972 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.90902.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90902.log.gz 2023-11-15T02:56:20.973 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112078.log 2023-11-15T02:56:20.973 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.112078.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112078.log.gz 2023-11-15T02:56:20.973 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112596.log 2023-11-15T02:56:20.973 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.112596.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.112596.log.gz 2023-11-15T02:56:20.973 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131902.log 2023-11-15T02:56:20.974 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131902.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.131902.log.gz 2023-11-15T02:56:20.974 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122366.log 2023-11-15T02:56:20.974 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122366.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122366.log.gz 2023-11-15T02:56:20.974 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122061.log 2023-11-15T02:56:20.974 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.122061.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122061.log.gz 2023-11-15T02:56:20.975 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114882.log 2023-11-15T02:56:20.975 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.114882.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114882.log.gz 2023-11-15T02:56:20.975 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135850.log 2023-11-15T02:56:20.975 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.135850.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135850.log.gz 2023-11-15T02:56:20.975 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96729.log 2023-11-15T02:56:20.975 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.96729.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96729.log.gz 2023-11-15T02:56:20.976 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131504.log 2023-11-15T02:56:20.976 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131504.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.131504.log.gz 2023-11-15T02:56:20.976 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111713.log 2023-11-15T02:56:20.976 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111713.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111713.log.gz 2023-11-15T02:56:20.976 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117893.log 2023-11-15T02:56:20.977 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.117893.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117893.log.gz 2023-11-15T02:56:20.977 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97895.log 2023-11-15T02:56:20.977 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.97895.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97895.log.gz 2023-11-15T02:56:20.977 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131986.log 2023-11-15T02:56:20.977 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131986.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.131986.log.gz 2023-11-15T02:56:20.978 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106918.log 2023-11-15T02:56:20.978 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.106918.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106918.log.gz 2023-11-15T02:56:20.978 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94766.log 2023-11-15T02:56:20.978 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.94766.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94766.log.gz 2023-11-15T02:56:20.978 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131007.log 2023-11-15T02:56:20.979 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131007.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.131007.log.gz 2023-11-15T02:56:20.979 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139384.log 2023-11-15T02:56:20.979 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139384.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.139384.log.gz 2023-11-15T02:56:20.979 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108135.log 2023-11-15T02:56:20.979 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.108135.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108135.log.gz 2023-11-15T02:56:20.980 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113436.log 2023-11-15T02:56:20.980 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.113436.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113436.log.gz 2023-11-15T02:56:20.980 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129377.log 2023-11-15T02:56:20.980 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129377.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129377.log.gz 2023-11-15T02:56:20.980 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115702.log 2023-11-15T02:56:20.981 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115702.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115702.log.gz 2023-11-15T02:56:20.981 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115636.log 2023-11-15T02:56:20.981 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115636.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115636.log.gz 2023-11-15T02:56:20.981 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123118.log 2023-11-15T02:56:20.981 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123118.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123118.log.gz 2023-11-15T02:56:20.982 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94474.log 2023-11-15T02:56:20.982 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.94474.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94474.log.gz 2023-11-15T02:56:20.982 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143391.log 2023-11-15T02:56:20.982 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143391.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143391.log.gz 2023-11-15T02:56:20.982 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139908.log 2023-11-15T02:56:20.983 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.139908.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139908.log.gz 2023-11-15T02:56:20.983 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124169.log 2023-11-15T02:56:20.983 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.124169.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124169.log.gz 2023-11-15T02:56:20.983 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129335.log 2023-11-15T02:56:20.983 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129335.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129335.log.gz 2023-11-15T02:56:20.984 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131944.log 2023-11-15T02:56:20.984 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131944.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.131944.log.gz 2023-11-15T02:56:20.984 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118367.log 2023-11-15T02:56:20.984 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.118367.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118367.log.gz 2023-11-15T02:56:20.984 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118025.log 2023-11-15T02:56:20.984 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.118025.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118025.log.gz 2023-11-15T02:56:20.985 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95931.log 2023-11-15T02:56:20.985 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.95931.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95931.log.gz 2023-11-15T02:56:20.985 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112512.log 2023-11-15T02:56:20.985 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.112512.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112512.log.gz 2023-11-15T02:56:20.985 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111755.log 2023-11-15T02:56:20.986 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111755.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111755.log.gz 2023-11-15T02:56:20.986 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115270.log 2023-11-15T02:56:20.986 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.115270.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115270.log.gz 2023-11-15T02:56:20.986 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97979.log 2023-11-15T02:56:20.987 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.97979.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.97979.log.gz 2023-11-15T02:56:20.987 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136061.log 2023-11-15T02:56:20.987 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.136061.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136061.log.gz 2023-11-15T02:56:20.987 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140257.log 2023-11-15T02:56:20.987 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.140257.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140257.log.gz 2023-11-15T02:56:20.988 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98992.log 2023-11-15T02:56:20.988 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98992.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98992.log.gz 2023-11-15T02:56:20.988 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132853.log 2023-11-15T02:56:20.988 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.132853.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.132853.log.gz 2023-11-15T02:56:20.988 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123466.log 2023-11-15T02:56:20.989 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.123466.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123466.log.gz 2023-11-15T02:56:20.989 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-15T02:56:20.989 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111282.log 2023-11-15T02:56:20.989 INFO:teuthology.orchestra.run.smithi001.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-15T02:56:20.989 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.111282.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111282.log.gz 2023-11-15T02:56:20.990 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106456.log 2023-11-15T02:56:20.990 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.106456.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106456.log.gz 2023-11-15T02:56:20.990 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101996.log 2023-11-15T02:56:20.990 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.101996.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101996.log.gz 2023-11-15T02:56:20.990 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129702.log 2023-11-15T02:56:20.991 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.129702.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129702.log.gz 2023-11-15T02:56:20.991 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98357.log 2023-11-15T02:56:20.991 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.98357.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98357.log.gz 2023-11-15T02:56:20.991 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105897.log 2023-11-15T02:56:20.991 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.105897.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105897.log.gz 2023-11-15T02:56:20.992 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143181.log 2023-11-15T02:56:20.992 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.143181.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143181.log.gz 2023-11-15T02:56:20.992 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131317.log 2023-11-15T02:56:20.992 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.131317.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.131317.log.gz 2023-11-15T02:56:20.992 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116183.log 2023-11-15T02:56:20.992 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.116183.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116183.log.gz 2023-11-15T02:56:21.174 INFO:teuthology.orchestra.run.smithi001.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-15T02:56:21.670 INFO:teuthology.orchestra.run.smithi001.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-15T02:56:22.130 INFO:teuthology.orchestra.run.smithi141.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-15T02:56:22.239 INFO:teuthology.orchestra.run.smithi141.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-15T02:56:22.498 INFO:teuthology.orchestra.run.smithi141.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-15T02:56:22.620 INFO:teuthology.orchestra.run.smithi141.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-15T02:56:22.856 INFO:teuthology.orchestra.run.smithi001.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-15T02:56:23.105 INFO:teuthology.orchestra.run.smithi141.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-15T02:56:23.122 INFO:teuthology.orchestra.run.smithi001.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-15T02:56:23.234 INFO:teuthology.orchestra.run.smithi141.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-15T02:56:23.472 INFO:teuthology.orchestra.run.smithi141.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-15T02:56:23.474 INFO:teuthology.orchestra.run.smithi141.stderr: 2023-11-15T02:56:23.474 INFO:teuthology.orchestra.run.smithi141.stderr:real 0m2.979s 2023-11-15T02:56:23.475 INFO:teuthology.orchestra.run.smithi141.stderr:user 0m15.385s 2023-11-15T02:56:23.475 INFO:teuthology.orchestra.run.smithi141.stderr:sys 0m0.578s 2023-11-15T02:56:23.544 INFO:teuthology.orchestra.run.smithi001.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-15T02:56:23.737 INFO:teuthology.orchestra.run.smithi001.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-15T02:56:23.881 INFO:teuthology.orchestra.run.smithi001.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-15T02:56:23.883 INFO:teuthology.orchestra.run.smithi001.stderr: 2023-11-15T02:56:23.884 INFO:teuthology.orchestra.run.smithi001.stderr:real 0m3.417s 2023-11-15T02:56:23.884 INFO:teuthology.orchestra.run.smithi001.stderr:user 0m15.489s 2023-11-15T02:56:23.884 INFO:teuthology.orchestra.run.smithi001.stderr:sys 0m0.918s 2023-11-15T02:56:23.885 INFO:tasks.ceph:Archiving logs... 2023-11-15T02:56:23.885 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075/remote/smithi001/log 2023-11-15T02:56:23.886 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-15T02:56:26.550 DEBUG:teuthology.misc:Transferring archived files from smithi141:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075/remote/smithi141/log 2023-11-15T02:56:26.551 DEBUG:teuthology.orchestra.run.smithi141:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-15T02:56:28.362 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-15T02:56:28.371 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-15T02:56:28.371 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-15T02:56:28.374 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-15T02:56:28.461 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-15T02:56:28.471 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-15T02:56:28.472 DEBUG:teuthology.orchestra.run.smithi001:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-15T02:56:28.474 DEBUG:teuthology.orchestra.run.smithi141:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-15T02:56:28.487 INFO:teuthology.orchestra.run.smithi001.stderr:bash: ntpq: command not found 2023-11-15T02:56:28.490 INFO:teuthology.orchestra.run.smithi141.stderr:bash: ntpq: command not found 2023-11-15T02:56:28.491 INFO:teuthology.orchestra.run.smithi001.stdout:210 Number of sources = 4 2023-11-15T02:56:28.492 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-15T02:56:28.492 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2023-11-15T02:56:28.492 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 44 -404us[ -404us] +/- 98ms 2023-11-15T02:56:28.492 INFO:teuthology.orchestra.run.smithi001.stdout:^* hv02.front.sepia.ceph.com 3 7 377 112 +58us[ +48us] +/- 76ms 2023-11-15T02:56:28.493 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +306us[ +306us] +/- 81ms 2023-11-15T02:56:28.493 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-11-15T02:56:28.494 INFO:teuthology.orchestra.run.smithi141.stdout:210 Number of sources = 4 2023-11-15T02:56:28.495 INFO:teuthology.orchestra.run.smithi141.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-15T02:56:28.495 INFO:teuthology.orchestra.run.smithi141.stdout:=============================================================================== 2023-11-15T02:56:28.495 INFO:teuthology.orchestra.run.smithi141.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 45 -399us[ -389us] +/- 98ms 2023-11-15T02:56:28.495 INFO:teuthology.orchestra.run.smithi141.stdout:^* hv02.front.sepia.ceph.com 3 7 377 45 +43us[ +53us] +/- 77ms 2023-11-15T02:56:28.496 INFO:teuthology.orchestra.run.smithi141.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 +294us[ +304us] +/- 81ms 2023-11-15T02:56:28.496 INFO:teuthology.orchestra.run.smithi141.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-11-15T02:56:28.496 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-15T02:56:28.506 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-15T02:56:28.507 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-15T02:56:28.517 DEBUG:teuthology.orchestra.run.smithi001:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-15T02:56:28.580 DEBUG:teuthology.orchestra.run.smithi141:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-15T02:56:28.681 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-15T02:56:28.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-15T02:56:28.710 DEBUG:teuthology.orchestra.run.smithi141:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-15T02:56:28.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-15T02:56:28.742 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-15T02:56:28.791 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-15T02:56:28.801 INFO:teuthology.task.internal:Duration was 6371.842557 seconds 2023-11-15T02:56:28.801 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-15T02:56:28.818 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-15T02:56:28.819 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-15T02:56:28.821 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-15T02:56:28.867 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-15T02:56:28.868 INFO:teuthology.orchestra.run.smithi141.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-15T02:56:29.311 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-15T02:56:29.311 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi001.front.sepia.ceph.com 2023-11-15T02:56:29.312 DEBUG:teuthology.orchestra.run.smithi001:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-15T02:56:29.333 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi141.front.sepia.ceph.com 2023-11-15T02:56:29.334 DEBUG:teuthology.orchestra.run.smithi141:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-15T02:56:29.353 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-15T02:56:29.353 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-15T02:56:29.376 DEBUG:teuthology.orchestra.run.smithi141:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-15T02:56:29.433 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-15T02:56:29.434 DEBUG:teuthology.orchestra.run.smithi001:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-15T02:56:29.436 DEBUG:teuthology.orchestra.run.smithi141:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-15T02:56:29.553 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-15T02:56:29.563 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-15T02:56:29.564 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-15T02:56:29.589 DEBUG:teuthology.orchestra.run.smithi141:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-15T02:56:29.615 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-15T02:56:29.625 DEBUG:teuthology.orchestra.run.smithi001:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-15T02:56:29.632 DEBUG:teuthology.orchestra.run.smithi141:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-15T02:56:29.654 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = core 2023-11-15T02:56:29.678 INFO:teuthology.orchestra.run.smithi141.stdout:kernel.core_pattern = core 2023-11-15T02:56:29.692 DEBUG:teuthology.orchestra.run.smithi001:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-15T02:56:29.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-15T02:56:29.723 DEBUG:teuthology.orchestra.run.smithi141:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-15T02:56:29.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-15T02:56:29.746 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-15T02:56:29.757 INFO:teuthology.task.internal:Transferring archived files... 2023-11-15T02:56:29.758 DEBUG:teuthology.misc:Transferring archived files from smithi001:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075/remote/smithi001 2023-11-15T02:56:29.758 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-15T02:56:29.798 DEBUG:teuthology.misc:Transferring archived files from smithi141:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075/remote/smithi141 2023-11-15T02:56:29.799 DEBUG:teuthology.orchestra.run.smithi141:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-15T02:56:29.835 INFO:teuthology.task.internal:Removing archive directory... 2023-11-15T02:56:29.835 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-15T02:56:29.837 DEBUG:teuthology.orchestra.run.smithi141:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-15T02:56:29.883 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-15T02:56:29.896 INFO:teuthology.task.internal:Not uploading archives. 2023-11-15T02:56:29.896 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-15T02:56:29.906 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-15T02:56:29.907 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-15T02:56:29.909 DEBUG:teuthology.orchestra.run.smithi141:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-15T02:56:29.921 INFO:teuthology.orchestra.run.smithi001.stdout: 262990 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 15 02:56 /home/ubuntu/cephtest 2023-11-15T02:56:29.938 INFO:teuthology.orchestra.run.smithi141.stdout: 263007 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 15 02:56 /home/ubuntu/cephtest 2023-11-15T02:56:29.939 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-15T02:56:29.950 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-15T02:56:29.970 INFO:teuthology.nuke:Checking targets against current locks 2023-11-15T02:56:30.000 DEBUG:teuthology.nuke:shortname: smithi001 2023-11-15T02:56:30.000 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T02:56:30.024 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 01:03:00.631046', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJeFylrmsKFW81CfzONyFLuEEkwlYoHfyZEe/20rdwDOWr4O1mHrlgMK1nfliLLBrxbQw+OniB5V0ngiiD24By8='} 2023-11-15T02:56:30.027 DEBUG:teuthology.nuke:shortname: smithi141 2023-11-15T02:56:30.027 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T02:56:30.048 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458075', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 01:03:00.632880', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRe93QIcO8EMbYevl+g6VFx5qJmSBRJHUVgq8TO9pdI8ccHzx0Nil5qaualtx3+f9S0HUsYLIV8zz7pJ+2gUSQ='} 2023-11-15T02:56:30.080 INFO:teuthology.orchestra.console.smithi001:Power off 2023-11-15T02:56:30.081 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T02:56:30.104 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off 2023-11-15T02:56:30.105 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:56:30.122 INFO:teuthology.orchestra.console.smithi141:Power off 2023-11-15T02:56:30.123 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T02:56:30.133 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2023-11-15T02:56:30.146 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-11-15T02:56:30.146 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:56:30.170 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-11-15T02:56:34.134 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:56:34.171 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:56:34.245 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2023-11-15T02:56:34.282 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-11-15T02:56:38.248 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:56:38.284 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:56:38.359 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2023-11-15T02:56:38.394 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-11-15T02:56:38.460 INFO:teuthology.orchestra.console.smithi001:Power off completed 2023-11-15T02:56:38.496 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-11-15T02:56:38.603 INFO:teuthology.run:Summary data: description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 6371.84255695343 failure_reason: '"2023-11-15T01:23:37.765251+0000 mon.a (mon.0) 313 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-11-15T02:56:38.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T02:56:38.685 INFO:teuthology.run:FAIL